-- Logs begin at Wed 2022-10-19 02:20:00 UTC, end at Wed 2022-10-19 05:10:03 UTC. -- Oct 19 03:01:00.337813 n-d-861333-8 systemd[1]: Starting Devstack devstack@n-api.service... Oct 19 03:01:00.348476 n-d-861333-8 devstack@n-api.service[105198]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 19 03:01:00.350605 n-d-861333-8 devstack@n-api.service[105198]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Oct 19 03:01:00 2022] *** Oct 19 03:01:00.350605 n-d-861333-8 devstack@n-api.service[105198]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 19 03:01:00.350605 n-d-861333-8 devstack@n-api.service[105198]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 19 03:01:00.350605 n-d-861333-8 devstack@n-api.service[105198]: nodename: n-d-861333-8 Oct 19 03:01:00.350605 n-d-861333-8 devstack@n-api.service[105198]: machine: x86_64 Oct 19 03:01:00.350605 n-d-861333-8 devstack@n-api.service[105198]: clock source: unix Oct 19 03:01:00.350605 n-d-861333-8 devstack@n-api.service[105198]: pcre jit disabled Oct 19 03:01:00.350605 n-d-861333-8 devstack@n-api.service[105198]: detected number of CPU cores: 4 Oct 19 03:01:00.350605 n-d-861333-8 devstack@n-api.service[105198]: current working directory: / Oct 19 03:01:00.350605 n-d-861333-8 devstack@n-api.service[105198]: detected binary path: /usr/bin/uwsgi-core Oct 19 03:01:00.351279 n-d-861333-8 devstack@n-api.service[105198]: your processes number limit is 47680 Oct 19 03:01:00.351279 n-d-861333-8 devstack@n-api.service[105198]: your memory page size is 4096 bytes Oct 19 03:01:00.351279 n-d-861333-8 devstack@n-api.service[105198]: detected max file descriptor number: 2048 Oct 19 03:01:00.351279 n-d-861333-8 devstack@n-api.service[105198]: lock engine: pthread robust mutexes Oct 19 03:01:00.351279 n-d-861333-8 devstack@n-api.service[105198]: thunder lock: enabled Oct 19 03:01:00.351279 n-d-861333-8 devstack@n-api.service[105198]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 19 03:01:00.351279 n-d-861333-8 devstack@n-api.service[105198]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 19 03:01:00.389797 n-d-861333-8 devstack@n-api.service[105198]: Python main interpreter initialized at 0x5589ecfd39c0 Oct 19 03:01:00.389797 n-d-861333-8 devstack@n-api.service[105198]: python threads support enabled Oct 19 03:01:00.389797 n-d-861333-8 devstack@n-api.service[105198]: your server socket listen backlog is limited to 100 connections Oct 19 03:01:00.389797 n-d-861333-8 devstack@n-api.service[105198]: your mercy for graceful operations on workers is 90 seconds Oct 19 03:01:00.390135 n-d-861333-8 devstack@n-api.service[105198]: mapped 403077 bytes (393 KB) for 2 cores Oct 19 03:01:00.390234 n-d-861333-8 devstack@n-api.service[105198]: *** Operational MODE: preforking *** Oct 19 03:01:00.390499 n-d-861333-8 devstack@n-api.service[105198]: *** uWSGI is running in multiple interpreter mode *** Oct 19 03:01:00.390499 n-d-861333-8 devstack@n-api.service[105198]: spawned uWSGI master process (pid: 105198) Oct 19 03:01:00.390691 n-d-861333-8 systemd[1]: Started Devstack devstack@n-api.service. Oct 19 03:01:00.391778 n-d-861333-8 devstack@n-api.service[105198]: spawned uWSGI worker 1 (pid: 105199, cores: 1) Oct 19 03:01:00.391778 n-d-861333-8 devstack@n-api.service[105198]: spawned uWSGI worker 2 (pid: 105200, cores: 1) Oct 19 03:01:00.391778 n-d-861333-8 devstack@n-api.service[105198]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 19 03:01:01.054181 n-d-861333-8 devstack@n-api.service[105199]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 19 03:01:01.056166 n-d-861333-8 devstack@n-api.service[105200]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 19 03:01:02.136345 n-d-861333-8 devstack@n-api.service[105200]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 19 03:01:02.136345 n-d-861333-8 devstack@n-api.service[105200]: from cryptography.utils import int_from_bytes Oct 19 03:01:02.137072 n-d-861333-8 devstack@n-api.service[105200]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 19 03:01:02.137072 n-d-861333-8 devstack@n-api.service[105200]: from cryptography.utils import int_from_bytes Oct 19 03:01:02.137727 n-d-861333-8 devstack@n-api.service[105199]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 19 03:01:02.137727 n-d-861333-8 devstack@n-api.service[105199]: from cryptography.utils import int_from_bytes Oct 19 03:01:02.138150 n-d-861333-8 devstack@n-api.service[105199]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 19 03:01:02.138150 n-d-861333-8 devstack@n-api.service[105199]: from cryptography.utils import int_from_bytes Oct 19 03:01:04.622713 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 19 03:01:04.623272 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 19 03:01:04.623484 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 19 03:01:04.623729 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 19 03:01:04.624119 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 19 03:01:04.624208 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 19 03:01:04.624891 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 19 03:01:04.624985 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.625073 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 19 03:01:04.625310 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.625462 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 19 03:01:04.625656 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.625745 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 19 03:01:04.625972 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.626061 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.626298 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.626385 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.626606 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.626690 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.626922 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.627007 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.627236 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.627323 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.627559 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.627644 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.627815 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.627921 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.628124 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.628223 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.628444 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-861333-8 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.628530 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.628761 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.628856 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.629063 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.629155 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.629391 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.629479 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-861333-8 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.629706 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.629794 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.630005 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.630096 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.630329 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.630416 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.630635 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.630722 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.630943 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.631184 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.631292 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.632310 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.632445 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.632445 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.632635 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.632732 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.632812 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.632953 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.633038 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.633128 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.633247 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.633400 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.633513 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.633602 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.633676 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.633814 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.633938 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.634128 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.634252 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.634429 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.634537 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.634825 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.635023 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-861333-8 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.635098 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.635164 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.635405 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.635524 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-861333-8 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.635712 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.635825 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.636106 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.636210 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.636411 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.636536 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.636739 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.636853 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.637043 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.637159 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.637340 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.637560 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.637668 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.637772 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.637992 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.638108 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.638306 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.638411 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.638623 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.638729 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.638939 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.639064 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.639297 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.639499 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.639591 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.639764 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.639950 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.640044 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.640182 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.640363 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.640466 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.640542 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.640712 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.640803 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.640976 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.641068 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.641254 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.641356 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.641607 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.641714 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.641923 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.642015 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.642248 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.642446 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.642530 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.642598 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.642761 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.642906 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.643060 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.643147 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.643380 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.643483 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.643645 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.643737 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.643948 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.644043 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.644251 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.644349 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.644554 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.644659 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.645118 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.645298 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.645466 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.645566 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.645743 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.645846 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.646044 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.646136 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.646351 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.646441 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.646656 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.646757 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.646975 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.647171 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.647319 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.647457 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.647596 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.647754 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.647894 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.648044 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.648183 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.648320 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.648464 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.648613 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.648788 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.648943 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.649105 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.649251 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.649435 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.649583 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.649722 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.649866 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.650029 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.650170 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.650318 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.650457 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.650595 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.650739 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.650885 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.651022 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.651180 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.651327 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.651501 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.651647 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.651796 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.651933 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.652085 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.652225 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.652364 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.652587 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.652735 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.652884 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.653038 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.653177 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.653316 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.653503 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.653646 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.653808 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.653949 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.654087 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.654225 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.654382 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.654520 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.654667 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.654814 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.654958 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.655103 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.655241 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.655386 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.655533 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.655690 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.655835 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.655974 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.656112 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.656261 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.656401 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.656539 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.656678 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.656815 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.656960 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.657121 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.657260 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.657426 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.657599 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.657746 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.657892 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.658044 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.658189 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.658328 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.658475 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.658614 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.658752 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.658903 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.659042 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.659188 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.659407 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.659561 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.659699 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.659850 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.659988 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.660126 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.660263 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.660400 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.660538 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.660686 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.660824 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.660962 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.661099 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.661252 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.661409 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.661570 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.661717 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.661857 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.661994 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.662130 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.662268 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.662414 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.662552 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.662692 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.662829 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.662967 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.663124 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.663262 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.663428 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.663574 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.663713 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.663850 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.663996 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.664135 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.664279 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.664420 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.664558 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.664703 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.664852 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.665004 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.665149 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.665288 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.665496 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.665642 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.665797 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.665938 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.666076 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.666221 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.666359 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.666504 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.666652 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.666797 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.666947 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.667087 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.667232 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.667380 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.667542 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.667688 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.667883 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.668030 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:01:04.668195 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.668353 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.668522 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.668670 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.668849 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.668997 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.669160 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.669316 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.669489 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.669654 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.669795 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.669943 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.670092 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.670231 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.670375 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.670513 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.670678 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.670834 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.670981 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.671121 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.671791 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.671943 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.672125 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.672269 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.672434 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.672589 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.672728 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.672866 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.673106 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.673263 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.673479 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.673626 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.673765 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.673926 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.674070 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.674210 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.674363 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.674507 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.674645 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.674783 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.674920 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.675066 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.675228 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.675369 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.675507 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.675654 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.675793 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.675941 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.676079 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.676218 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.676380 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.676525 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.676686 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.676842 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.676982 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.677135 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.677273 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.677439 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.677629 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.677788 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.677928 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.678073 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.678233 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.678378 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.678550 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.678706 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.678846 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.678983 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.679163 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.679309 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.679465 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.679606 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.679766 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.679912 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.680057 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.680205 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.680353 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.680494 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.680657 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.680809 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.680995 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.681142 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.681359 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.681535 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.681675 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.681822 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.681960 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.682098 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.682248 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.682396 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.682535 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.682675 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.682835 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.682993 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.683142 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.683289 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.683429 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.683567 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.683706 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.683858 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.683998 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.684145 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.684284 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.684429 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.684588 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.684740 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.684890 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.685030 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.685169 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.685307 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.685491 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.685645 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.685786 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.685933 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.686080 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.686219 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.686357 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.686510 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.686657 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.687414 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.687570 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.687709 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.687866 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.688007 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.688154 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.688293 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.688439 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.688590 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.688744 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.688884 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.689023 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.689163 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.689321 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.689490 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.689647 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.689789 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.689935 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.690082 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.690222 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.690403 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.690559 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.690722 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.690868 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.691035 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.691203 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.691352 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.691491 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.691658 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.691803 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.691967 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.692124 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.692274 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.692414 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.692582 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.692728 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.692898 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.693044 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.693203 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.693342 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.693530 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.693670 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.693853 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.694013 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.694164 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.694302 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.694440 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.694578 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.694766 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.694922 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.695073 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.695224 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.695362 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.695506 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.695646 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.695801 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.695940 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.696078 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.696223 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.696362 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.696501 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.696650 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.696790 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.696938 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.697076 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.697221 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.697361 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.697548 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.697688 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.697826 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.697965 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.698133 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.698290 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.698431 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.698569 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.698733 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.698896 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.699035 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.699190 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.699330 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.699476 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.699615 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.699762 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.699938 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.700094 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.700234 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.700380 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.700543 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.700690 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.700838 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.700988 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.701128 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.701266 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.701483 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.701631 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.701788 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.701929 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.702121 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.702267 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.702480 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.702634 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.702784 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.702935 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.703075 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.703220 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.703384 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.703548 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.703708 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.703855 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.704000 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.704145 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.704291 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.704443 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.704598 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.704753 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.704925 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.705108 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.705253 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.705439 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.705602 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.705750 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.705896 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.706041 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.706186 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.706340 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.706486 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.706631 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.706788 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.706933 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.707085 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.707245 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.707391 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.707546 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.707700 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.707846 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.707992 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.708146 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.708292 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.708438 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.708583 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.708738 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.708884 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.709039 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.709185 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.709337 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.709546 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.709695 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.709917 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.710066 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.710218 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.710364 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.710510 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.710655 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.710820 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.710967 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.711119 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.711266 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.711410 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.711565 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.711727 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.711873 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.712019 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.712171 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.712317 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.712461 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.712615 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.712772 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.712917 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.713063 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.713208 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.713362 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.713548 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.713695 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.713840 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.713986 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.714139 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.714295 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.714441 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.714586 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.714741 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.714897 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.715043 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.715043 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.715330 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.715475 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.715620 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.715765 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.715909 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.716064 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.716210 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.716355 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.716519 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.716673 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.716829 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.716975 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.717119 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.717264 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.717460 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.717613 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.717770 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.717916 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.718084 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.718234 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.718381 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.718538 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.718692 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.718839 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.718984 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.719129 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.719280 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.719426 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.719611 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.719759 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.719904 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.720049 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.720193 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.720359 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.720571 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.720721 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.720866 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.721011 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.721156 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.721310 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.721483 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.721629 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.721775 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.721920 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.722065 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.722222 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.722368 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.722524 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.722677 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.722823 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.722974 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.723130 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.723276 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.723476 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.723648 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.723796 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.723942 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.724097 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.724243 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.724388 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.724545 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.724691 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.724852 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.725009 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.725155 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.725300 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.725509 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.725658 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.725813 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.725960 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.726105 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.726250 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.726405 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.726550 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.726706 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.726853 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.726998 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.727143 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.727288 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.727434 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.727592 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.727740 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.727892 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.728038 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.728183 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.728347 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.728494 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.728494 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.728780 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.728932 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.729078 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.729233 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.729408 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.729562 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.729708 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.729854 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.729998 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.730171 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.730341 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.730341 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.730619 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.730765 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.730921 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.731074 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.731229 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.731376 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.731520 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.731666 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.731810 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.731973 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.732137 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.732293 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.732439 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.732583 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.732728 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.732879 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.733025 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.733247 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.733539 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.734223 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.734380 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.734526 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.734693 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.734866 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.735014 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.735161 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.735161 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.735449 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.735603 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.735750 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.735904 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.736050 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.736195 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.736339 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.736493 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.736647 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.736810 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.736955 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.737099 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.737245 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.737419 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.737594 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.737741 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.737887 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.738032 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.738185 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.738344 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.738500 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.738646 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.738802 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.738946 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.739101 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.739248 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.739401 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.739547 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.739692 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.739692 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.740021 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.740167 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.740313 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.740457 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.740624 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.740624 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.740910 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.741056 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.741201 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.741353 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.741546 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.741704 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.741857 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.742003 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.742148 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.742294 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.742439 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.742603 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.742749 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.742894 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.743046 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.743199 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.743345 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.743500 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.743646 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.743791 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.743937 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.744081 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.744226 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.744380 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.744537 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.744683 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.744827 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.744972 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.745130 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.745275 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.745478 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.745637 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.745784 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.745929 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.746084 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.746229 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.746374 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.746536 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.746683 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.746827 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.746981 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.747134 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.747279 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.747423 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.747569 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.747715 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.747873 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.748019 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.748164 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.748319 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.748319 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.748603 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.748751 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.748895 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.749047 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.749193 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.749940 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.750104 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.750262 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.750416 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.750570 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.750716 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.750716 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.750716 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.751151 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.751296 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.751441 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.751586 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.751732 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.751887 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.752033 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.752178 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.752322 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.752322 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.752598 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.752763 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.752911 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.752911 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.753185 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.753185 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.753533 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.753682 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.753827 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.753973 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.754125 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.754277 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.754437 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.754584 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.754752 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.754899 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.755046 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.755192 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.755358 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.755510 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.755655 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.755808 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.755961 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.756117 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.756264 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.756410 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.756555 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.756711 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.756864 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.757028 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.757184 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.757330 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.757479 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.757577 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.757662 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.757761 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.757853 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.757939 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.758024 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.758105 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.758183 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.758271 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.758352 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.758430 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.758508 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.758667 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.758788 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.758982 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.759071 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.759286 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.759374 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.759592 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.759687 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.759902 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.759989 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.760203 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.760297 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.760515 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.760616 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.760823 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.760915 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.761133 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.761220 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.761460 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.761639 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.761765 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.761853 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.762086 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.762171 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.762396 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.762494 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.762704 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.762789 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.763022 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.763106 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.763340 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.763427 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.763649 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.763742 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.763953 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.764038 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.764261 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.764348 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.764573 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.764672 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.764947 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.765033 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.765276 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.765382 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.765611 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.765710 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.765919 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.766005 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.766230 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.766316 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.766539 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.766679 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.766850 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.766954 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.767159 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.767251 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.767460 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.767544 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.767767 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.767862 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.768074 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.768161 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.768379 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.768472 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.768691 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.768785 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.768995 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.769080 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.769295 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.769401 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.769649 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.769754 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.770192 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.770287 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.770502 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.770587 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.770804 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.770890 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.771129 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.771215 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.771444 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.771537 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.771752 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.771840 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.772065 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.772151 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.772375 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.772460 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.772690 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.772778 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.773003 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.773113 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.773317 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.773454 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.773645 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.773772 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.774066 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.774159 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.774376 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.774472 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.774688 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.774794 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.774996 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.775083 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.775301 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.775409 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.775601 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.775694 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.775910 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.775997 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.776230 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.776328 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.776531 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.776625 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.776833 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.776919 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.777134 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.777230 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.777479 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.777569 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.777783 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.777880 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.778102 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.778189 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.778442 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.778533 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.778750 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.778843 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.779058 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.779146 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.779367 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.779496 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.779693 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.779806 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.779998 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.780114 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.780323 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.780435 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.780815 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.780907 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.781132 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.781223 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.781477 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.781579 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.781777 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.781870 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.782085 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.782178 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.782407 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.782495 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.782729 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.782814 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.783111 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.783213 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.783423 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.783515 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.783726 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.783813 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.784037 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.784131 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.784351 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.784437 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.784659 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.784758 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.784982 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.785094 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.785298 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.785405 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.785632 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.785718 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.785940 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.786036 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.786266 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.786361 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.786591 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.786676 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.786908 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.786996 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.787218 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.787312 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.787525 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.787641 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.787828 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.787967 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.788131 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.788283 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.788454 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.788606 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.788757 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.788932 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.789067 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.789243 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.789426 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.789581 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.789706 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.789895 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.790009 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.790205 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.790311 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.790513 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.790633 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.790841 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.790926 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.791148 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.791241 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.791464 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.791552 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.791779 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.791864 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.792092 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.792177 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.792401 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.792488 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.792711 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.792806 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.793031 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.793115 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.793337 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.793457 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.793664 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.793750 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.793973 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.794069 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.794303 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.794388 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.794602 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.794688 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.794919 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.795028 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.795243 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.795328 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.795557 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.795641 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.795861 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.795955 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.796675 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.796990 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.797409 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.797706 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.798032 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.798369 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.798510 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.798704 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.798872 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.799017 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.799202 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.799353 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.799520 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.799683 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.799844 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.800004 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.800176 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.800318 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.800487 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.800639 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.800794 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.800967 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.801107 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.801276 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.801442 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.801621 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.801751 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.801935 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.802058 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.802243 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.802368 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.802550 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.802673 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.802857 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.802977 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.803169 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.803279 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.803481 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.803603 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.803787 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.803907 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.804092 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.804230 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.804418 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.804539 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.804726 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.804846 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.805084 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.805180 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.805362 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.805472 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.805696 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.805784 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.806002 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.806087 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.806311 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.806407 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.806657 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.806744 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.806963 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.807049 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.807293 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.807388 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.807606 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.807692 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.807920 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.808005 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.808236 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.808331 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.808552 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.808636 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.808864 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.808948 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.809178 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.809272 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.809508 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.809599 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.809826 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.809925 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.810145 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.810257 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.810453 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.810647 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.810756 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.811078 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.811186 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.811399 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.811499 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.812373 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.812469 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.812697 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.812802 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.813011 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.813104 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.813326 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.813439 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.813665 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.813771 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.813978 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.814071 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.814290 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.814393 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.814601 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.814707 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.814910 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.815012 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.815235 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.815326 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.815550 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.815666 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.815873 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.815965 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.816195 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.816286 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.816512 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.816603 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.816824 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.816917 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.817155 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.817260 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.817473 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.817567 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.817786 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.817879 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.818103 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.818276 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.818422 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.818509 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.818733 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.818822 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.819045 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.819139 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.819370 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.819464 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.819678 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.819772 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.819976 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.820068 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.820287 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.820386 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.820609 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.820726 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.820903 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.820992 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.821210 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.821304 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.821545 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.821657 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.821855 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.821950 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.822165 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.822256 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.822480 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.822583 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.822797 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.822888 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.823108 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.823200 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.823419 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.823520 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.823732 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.823828 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.824058 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.824240 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.824343 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.824550 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.824859 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.824951 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.825176 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.825269 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.825519 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.825612 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.825834 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.825926 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.826148 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.826241 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.826469 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.826561 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.826770 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.826869 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.827073 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.827175 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.827395 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.827492 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.827720 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.827812 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.828025 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.828126 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.828335 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.828427 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.828639 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.828731 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.828943 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.829046 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.829257 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.829356 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.829581 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.829686 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.829901 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.830107 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.830206 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.830451 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.830736 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.830836 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.831071 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.831168 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.831394 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.831500 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.831708 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.831805 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.832012 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.832109 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.832335 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.832438 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.832643 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.832739 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.832974 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.833071 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.833284 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.833406 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.833621 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.833719 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.833932 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.834021 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.834236 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.834324 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.834541 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.834638 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.834843 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.834930 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.835145 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.835233 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.835452 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.835549 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.835757 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.835844 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.836072 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.836163 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.836377 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.836476 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.836679 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.836778 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.836980 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.837070 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.837287 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.837478 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.837617 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.837718 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.837919 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.838009 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.838222 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.838313 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.838522 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.838619 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.838828 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.838916 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.839124 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.839213 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.839429 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.839560 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.839728 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.839859 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.840037 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.840174 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.840344 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.840475 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.840661 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.840790 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.840961 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.841092 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.841282 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.841431 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.841608 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.841753 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.841909 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.842034 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.842221 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.842353 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.842528 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.842668 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.842842 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.842971 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.843660 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.843790 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.843971 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.844116 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.844296 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.844424 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.844612 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.844741 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.844961 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.845137 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.845270 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.845498 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.845819 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.845948 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.846150 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.846282 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.846470 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.846600 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.846778 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.846914 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.847081 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.847212 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.847383 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.847513 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.847704 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.847835 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.848040 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.848178 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.848307 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.848433 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.848597 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.848738 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.848903 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.849034 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.849208 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.849340 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.849526 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.849664 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.849834 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.849966 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.850139 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.850271 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.850444 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.850576 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.850749 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.850879 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.851054 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.851185 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.851358 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.851499 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.851664 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.851795 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.851970 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.852093 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.852276 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.852406 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.852591 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.852721 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.852910 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.853040 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.853220 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.853357 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.853562 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.853694 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.853874 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.854005 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.854179 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.854311 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.854483 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.854615 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.854788 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.854927 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.855092 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.855222 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.855404 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.855535 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.855714 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.855853 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.856025 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.856146 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.856325 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.856455 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.856659 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.856970 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.857100 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.857297 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.857644 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.857775 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.857967 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.858100 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.858278 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.858408 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.858601 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.859309 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.859451 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.859584 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.859783 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.859914 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.860113 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.860243 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.860432 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.860563 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.860759 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.860888 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.861073 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.861215 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.861424 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.861556 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.861755 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.861884 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.862061 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.862195 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.862367 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.862498 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.862664 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.862799 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.862965 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.863106 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.863282 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.863411 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.863586 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.863749 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.863896 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.864025 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.864158 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.864286 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.864468 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.864598 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.864772 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.864930 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.865065 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.865200 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.865363 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.865541 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.865684 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.865826 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.866000 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.866129 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.866273 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.866404 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.866578 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.866713 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.866880 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.867015 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.867177 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.867315 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.867480 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.867608 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.867778 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.867915 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.868081 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.868220 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.868378 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.868508 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.868681 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.868811 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.868984 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.869122 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.869283 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.869432 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.869610 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.869751 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.869912 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.870051 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.870219 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.870350 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.870554 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.870684 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.870874 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.871004 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.871184 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.871314 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.871504 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.871641 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.871813 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.871944 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.872133 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.872298 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.872426 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.872551 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.872750 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.872881 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.873083 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.873222 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.873393 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.873526 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.873702 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.873848 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.874013 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.874144 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.874361 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.874504 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.874680 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.874810 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.874998 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.875128 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.875303 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.875442 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.875613 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.875741 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.875923 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.876054 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.876229 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.876361 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.876554 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.876686 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.876863 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.876998 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.877200 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.877336 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.877486 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.877624 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.877798 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.877942 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.878128 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.878260 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.878436 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.878565 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.878744 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.878872 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.879054 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.879185 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.879363 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.879493 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.879672 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.879814 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.879984 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.880113 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.880288 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.880416 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.880597 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.880740 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.880905 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.881035 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.881213 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.881342 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.881553 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.881696 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.881871 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.882001 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.882174 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.882303 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.882499 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.882630 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.882808 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.882939 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.883136 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.883266 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.883443 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.883573 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.883783 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.883914 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.884107 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.884236 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.884416 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.884552 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.884727 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.884857 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.885030 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.885153 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.885288 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 19 03:01:04.885434 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.885690 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:01:04.885936 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 19 03:01:05.038662 n-d-861333-8 devstack@n-api.service[105200]: INFO dbcounter [None req-97667b65-11bc-45d4-aa32-9c0d2c52f4ae None None] Registered counter for database nova_api Oct 19 03:01:05.038904 n-d-861333-8 devstack@n-api.service[105199]: INFO dbcounter [None req-73e492bd-fa2f-4b6b-965f-17000852be40 None None] Registered counter for database nova_api Oct 19 03:01:05.059980 n-d-861333-8 devstack@n-api.service[105200]: DEBUG oslo_db.sqlalchemy.engines [None req-97667b65-11bc-45d4-aa32-9c0d2c52f4ae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105200) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 03:01:05.062396 n-d-861333-8 devstack@n-api.service[105199]: DEBUG oslo_db.sqlalchemy.engines [None req-73e492bd-fa2f-4b6b-965f-17000852be40 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105199) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 03:01:05.066832 n-d-861333-8 devstack@n-api.service[105200]: DEBUG dbcounter [-] [105200] Writer thread running {{(pid=105200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 03:01:05.068903 n-d-861333-8 devstack@n-api.service[105199]: DEBUG dbcounter [-] [105199] Writer thread running {{(pid=105199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 03:01:05.125757 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.context [None req-73e492bd-fa2f-4b6b-965f-17000852be40 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d204a9a6-30d3-4569-8922-0d4cbe966b78(cell1) {{(pid=105199) load_cells /opt/stack/nova/nova/context.py:464}} Oct 19 03:01:05.125982 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.context [None req-97667b65-11bc-45d4-aa32-9c0d2c52f4ae None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d204a9a6-30d3-4569-8922-0d4cbe966b78(cell1) {{(pid=105200) load_cells /opt/stack/nova/nova/context.py:464}} Oct 19 03:01:05.129618 n-d-861333-8 devstack@n-api.service[105200]: DEBUG oslo_concurrency.lockutils [None req-97667b65-11bc-45d4-aa32-9c0d2c52f4ae None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:01:05.129717 n-d-861333-8 devstack@n-api.service[105199]: DEBUG oslo_concurrency.lockutils [None req-73e492bd-fa2f-4b6b-965f-17000852be40 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:01:05.130089 n-d-861333-8 devstack@n-api.service[105200]: DEBUG oslo_concurrency.lockutils [None req-97667b65-11bc-45d4-aa32-9c0d2c52f4ae None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:01:05.130181 n-d-861333-8 devstack@n-api.service[105199]: DEBUG oslo_concurrency.lockutils [None req-73e492bd-fa2f-4b6b-965f-17000852be40 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:01:05.131652 n-d-861333-8 devstack@n-api.service[105200]: DEBUG oslo_concurrency.lockutils [None req-97667b65-11bc-45d4-aa32-9c0d2c52f4ae None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:01:05.131745 n-d-861333-8 devstack@n-api.service[105199]: DEBUG oslo_concurrency.lockutils [None req-73e492bd-fa2f-4b6b-965f-17000852be40 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:01:05.132371 n-d-861333-8 devstack@n-api.service[105200]: DEBUG oslo_concurrency.lockutils [None req-97667b65-11bc-45d4-aa32-9c0d2c52f4ae None None] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:01:05.132472 n-d-861333-8 devstack@n-api.service[105199]: DEBUG oslo_concurrency.lockutils [None req-73e492bd-fa2f-4b6b-965f-17000852be40 None None] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:01:05.132811 n-d-861333-8 devstack@n-api.service[105200]: DEBUG oslo_concurrency.lockutils [None req-97667b65-11bc-45d4-aa32-9c0d2c52f4ae None None] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:01:05.132902 n-d-861333-8 devstack@n-api.service[105199]: DEBUG oslo_concurrency.lockutils [None req-73e492bd-fa2f-4b6b-965f-17000852be40 None None] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:01:05.134797 n-d-861333-8 devstack@n-api.service[105200]: DEBUG oslo_concurrency.lockutils [None req-97667b65-11bc-45d4-aa32-9c0d2c52f4ae None None] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:01:05.134917 n-d-861333-8 devstack@n-api.service[105199]: DEBUG oslo_concurrency.lockutils [None req-73e492bd-fa2f-4b6b-965f-17000852be40 None None] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:01:05.136773 n-d-861333-8 devstack@n-api.service[105199]: INFO dbcounter [None req-73e492bd-fa2f-4b6b-965f-17000852be40 None None] Registered counter for database nova_cell0 Oct 19 03:01:05.136880 n-d-861333-8 devstack@n-api.service[105200]: INFO dbcounter [None req-97667b65-11bc-45d4-aa32-9c0d2c52f4ae None None] Registered counter for database nova_cell0 Oct 19 03:01:05.140836 n-d-861333-8 devstack@n-api.service[105200]: INFO dbcounter [None req-97667b65-11bc-45d4-aa32-9c0d2c52f4ae None None] Registered counter for database nova_cell1 Oct 19 03:01:05.140943 n-d-861333-8 devstack@n-api.service[105199]: INFO dbcounter [None req-73e492bd-fa2f-4b6b-965f-17000852be40 None None] Registered counter for database nova_cell1 Oct 19 03:01:05.148699 n-d-861333-8 devstack@n-api.service[105200]: DEBUG oslo_db.sqlalchemy.engines [None req-97667b65-11bc-45d4-aa32-9c0d2c52f4ae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105200) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 03:01:05.150364 n-d-861333-8 devstack@n-api.service[105200]: DEBUG oslo_db.sqlalchemy.engines [None req-97667b65-11bc-45d4-aa32-9c0d2c52f4ae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105200) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 03:01:05.152034 n-d-861333-8 devstack@n-api.service[105199]: DEBUG oslo_db.sqlalchemy.engines [None req-73e492bd-fa2f-4b6b-965f-17000852be40 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105199) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 03:01:05.153759 n-d-861333-8 devstack@n-api.service[105199]: DEBUG oslo_db.sqlalchemy.engines [None req-73e492bd-fa2f-4b6b-965f-17000852be40 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105199) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 03:01:05.156621 n-d-861333-8 devstack@n-api.service[105200]: DEBUG dbcounter [-] [105200] Writer thread running {{(pid=105200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 03:01:05.159854 n-d-861333-8 devstack@n-api.service[105199]: DEBUG dbcounter [-] [105199] Writer thread running {{(pid=105199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 03:01:05.160732 n-d-861333-8 devstack@n-api.service[105200]: DEBUG dbcounter [-] [105200] Writer thread running {{(pid=105200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 03:01:05.165096 n-d-861333-8 devstack@n-api.service[105199]: DEBUG dbcounter [-] [105199] Writer thread running {{(pid=105199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 03:01:05.307418 n-d-861333-8 devstack@n-api.service[105200]: INFO dbcounter [None req-97667b65-11bc-45d4-aa32-9c0d2c52f4ae None None] Registered counter for database nova_cell0 Oct 19 03:01:05.308855 n-d-861333-8 devstack@n-api.service[105199]: INFO dbcounter [None req-73e492bd-fa2f-4b6b-965f-17000852be40 None None] Registered counter for database nova_cell0 Oct 19 03:01:05.316026 n-d-861333-8 devstack@n-api.service[105200]: DEBUG oslo_db.sqlalchemy.engines [None req-97667b65-11bc-45d4-aa32-9c0d2c52f4ae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105200) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 03:01:05.319638 n-d-861333-8 devstack@n-api.service[105199]: DEBUG oslo_db.sqlalchemy.engines [None req-73e492bd-fa2f-4b6b-965f-17000852be40 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105199) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 03:01:05.320741 n-d-861333-8 devstack@n-api.service[105200]: DEBUG dbcounter [-] [105200] Writer thread running {{(pid=105200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 03:01:05.324397 n-d-861333-8 devstack@n-api.service[105199]: DEBUG dbcounter [-] [105199] Writer thread running {{(pid=105199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 03:01:05.723293 n-d-861333-8 devstack@n-api.service[105200]: WARNING keystonemiddleware.auth_token [None req-97667b65-11bc-45d4-aa32-9c0d2c52f4ae None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 19 03:01:05.730546 n-d-861333-8 devstack@n-api.service[105200]: WARNING keystonemiddleware.auth_token [None req-97667b65-11bc-45d4-aa32-9c0d2c52f4ae None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 19 03:01:05.751775 n-d-861333-8 devstack@n-api.service[105199]: WARNING keystonemiddleware.auth_token [None req-73e492bd-fa2f-4b6b-965f-17000852be40 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 19 03:01:05.760529 n-d-861333-8 devstack@n-api.service[105199]: WARNING keystonemiddleware.auth_token [None req-73e492bd-fa2f-4b6b-965f-17000852be40 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 19 03:01:06.078791 n-d-861333-8 devstack@n-api.service[105200]: WARNING keystonemiddleware.auth_token [None req-97667b65-11bc-45d4-aa32-9c0d2c52f4ae None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 19 03:01:06.084713 n-d-861333-8 devstack@n-api.service[105200]: WARNING keystonemiddleware.auth_token [None req-97667b65-11bc-45d4-aa32-9c0d2c52f4ae None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 19 03:01:06.090053 n-d-861333-8 devstack@n-api.service[105200]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5589ecfd39c0 pid: 105200 (default app) Oct 19 03:01:06.092126 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi [None req-97667b65-11bc-45d4-aa32-9c0d2c52f4ae None None] Calling method '>' {{(pid=105200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:01:06.093332 n-d-861333-8 devstack@n-api.service[105200]: INFO nova.api.openstack.requestlog [None req-97667b65-11bc-45d4-aa32-9c0d2c52f4ae None None] 10.222.0.52 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001721 Oct 19 03:01:06.093783 n-d-861333-8 devstack@n-api.service[105200]: [pid: 105200|app: 0|req: 1/1] 10.222.0.52 () {50 vars in 788 bytes} [Wed Oct 19 03:01:06 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:01:06.100576 n-d-861333-8 devstack@n-api.service[105199]: WARNING keystonemiddleware.auth_token [None req-73e492bd-fa2f-4b6b-965f-17000852be40 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 19 03:01:06.106554 n-d-861333-8 devstack@n-api.service[105199]: WARNING keystonemiddleware.auth_token [None req-73e492bd-fa2f-4b6b-965f-17000852be40 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 19 03:01:06.112446 n-d-861333-8 devstack@n-api.service[105199]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5589ecfd39c0 pid: 105199 (default app) Oct 19 03:02:30.089629 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi [None req-97667b65-11bc-45d4-aa32-9c0d2c52f4ae None None] Calling method '>' {{(pid=105200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:02:30.090666 n-d-861333-8 devstack@n-api.service[105200]: INFO nova.api.openstack.requestlog [None req-97667b65-11bc-45d4-aa32-9c0d2c52f4ae None None] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001543 Oct 19 03:02:30.091074 n-d-861333-8 devstack@n-api.service[105200]: [pid: 105200|app: 0|req: 2/2] 10.222.0.52 () {54 vars in 931 bytes} [Wed Oct 19 03:02:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:02:30.108701 n-d-861333-8 devstack@n-api.service[105199]: DEBUG dbcounter [-] [105199] Writing DB stats nova_api:SELECT=3 {{(pid=105199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:02:30.109830 n-d-861333-8 devstack@n-api.service[105199]: DEBUG dbcounter [-] [105199] Writing DB stats nova_cell0:SELECT=3 {{(pid=105199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:02:30.110677 n-d-861333-8 devstack@n-api.service[105199]: DEBUG dbcounter [-] [105199] Writing DB stats nova_cell1:SELECT=3 {{(pid=105199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:02:30.111502 n-d-861333-8 devstack@n-api.service[105199]: DEBUG dbcounter [-] [105199] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:02:30.994488 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi [None req-8e3cb6a5-e9b2-42eb-b69b-2f3b60752ab4 admin admin] Calling method '>' {{(pid=105199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:02:31.027219 n-d-861333-8 devstack@n-api.service[105199]: INFO nova.api.openstack.requestlog [None req-8e3cb6a5-e9b2-42eb-b69b-2f3b60752ab4 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.928603 Oct 19 03:02:31.028166 n-d-861333-8 devstack@n-api.service[105199]: [pid: 105199|app: 0|req: 1/3] 10.222.0.52 () {60 vars in 1292 bytes} [Wed Oct 19 03:02:30 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:02:33.668743 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi [None req-97667b65-11bc-45d4-aa32-9c0d2c52f4ae None None] Calling method '>' {{(pid=105200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:02:33.669808 n-d-861333-8 devstack@n-api.service[105200]: INFO nova.api.openstack.requestlog [None req-97667b65-11bc-45d4-aa32-9c0d2c52f4ae None None] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Oct 19 03:02:33.670913 n-d-861333-8 devstack@n-api.service[105200]: [pid: 105200|app: 0|req: 3/4] 10.222.0.52 () {54 vars in 931 bytes} [Wed Oct 19 03:02:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:02:34.123542 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi [None req-36271121-8aad-42ec-8cb3-ec7aaba884a8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "ram": 256, "disk": 1, "name": "cirros256", "swap": 0, "id": "c1"}} {{(pid=105199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:02:34.227778 n-d-861333-8 devstack@n-api.service[105199]: INFO nova.api.openstack.requestlog [None req-36271121-8aad-42ec-8cb3-ec7aaba884a8 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.550703 Oct 19 03:02:34.228663 n-d-861333-8 devstack@n-api.service[105199]: [pid: 105199|app: 0|req: 2/5] 10.222.0.52 () {64 vars in 1283 bytes} [Wed Oct 19 03:02:33 2022] POST /compute/v2.1/flavors => generated 407 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 03:02:34.243195 n-d-861333-8 devstack@n-api.service[105200]: DEBUG dbcounter [-] [105200] Writing DB stats nova_api:SELECT=3 {{(pid=105200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:02:34.245912 n-d-861333-8 devstack@n-api.service[105200]: DEBUG dbcounter [-] [105200] Writing DB stats nova_cell0:SELECT=3 {{(pid=105200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:02:34.246378 n-d-861333-8 devstack@n-api.service[105200]: DEBUG dbcounter [-] [105200] Writing DB stats nova_cell1:SELECT=3 {{(pid=105200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:02:34.247121 n-d-861333-8 devstack@n-api.service[105200]: DEBUG dbcounter [-] [105200] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:02:34.452321 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi [None req-91aec522-b73d-4513-bfdb-0a48e6545955 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:02:34.579849 n-d-861333-8 devstack@n-api.service[105200]: INFO nova.api.openstack.requestlog [None req-91aec522-b73d-4513-bfdb-0a48e6545955 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.342366 Oct 19 03:02:34.580563 n-d-861333-8 devstack@n-api.service[105200]: [pid: 105200|app: 0|req: 4/6] 10.222.0.52 () {64 vars in 1336 bytes} [Wed Oct 19 03:02:34 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:02:37.215035 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi [None req-36271121-8aad-42ec-8cb3-ec7aaba884a8 admin admin] Calling method '>' {{(pid=105199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:02:37.216092 n-d-861333-8 devstack@n-api.service[105199]: INFO nova.api.openstack.requestlog [None req-36271121-8aad-42ec-8cb3-ec7aaba884a8 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001535 Oct 19 03:02:37.216493 n-d-861333-8 devstack@n-api.service[105199]: [pid: 105199|app: 0|req: 3/7] 10.222.0.52 () {54 vars in 931 bytes} [Wed Oct 19 03:02:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:02:38.055304 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi [None req-a0f11780-e761-4b30-be4a-de586d5be98c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "id": "d1", "disk": 5, "ram": 512, "swap": 0, "rxtx_factor": 1.0}} {{(pid=105200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:02:38.210717 n-d-861333-8 devstack@n-api.service[105200]: INFO nova.api.openstack.requestlog [None req-a0f11780-e761-4b30-be4a-de586d5be98c admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.987453 Oct 19 03:02:38.363288 n-d-861333-8 devstack@n-api.service[105200]: [pid: 105200|app: 0|req: 5/8] 10.222.0.52 () {64 vars in 1283 bytes} [Wed Oct 19 03:02:37 2022] POST /compute/v2.1/flavors => generated 404 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 03:02:38.363932 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi [None req-dff99a51-9a3d-46eb-b713-c14793b63d08 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:02:38.473159 n-d-861333-8 devstack@n-api.service[105199]: INFO nova.api.openstack.requestlog [None req-dff99a51-9a3d-46eb-b713-c14793b63d08 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.249595 Oct 19 03:02:38.476172 n-d-861333-8 devstack@n-api.service[105199]: [pid: 105199|app: 0|req: 4/9] 10.222.0.52 () {64 vars in 1336 bytes} [Wed Oct 19 03:02:38 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:02:41.519190 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi [None req-a0f11780-e761-4b30-be4a-de586d5be98c admin admin] Calling method '>' {{(pid=105200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:02:41.520487 n-d-861333-8 devstack@n-api.service[105200]: INFO nova.api.openstack.requestlog [None req-a0f11780-e761-4b30-be4a-de586d5be98c admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001750 Oct 19 03:02:41.520892 n-d-861333-8 devstack@n-api.service[105200]: [pid: 105200|app: 0|req: 6/10] 10.222.0.52 () {54 vars in 931 bytes} [Wed Oct 19 03:02:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:02:41.969022 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi [None req-923200d3-a8ce-425e-a145-3c3bd8e4075c admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2", "name": "ds1G", "rxtx_factor": 1.0, "disk": 10, "ram": 1024, "swap": 0}} {{(pid=105199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:02:42.036213 n-d-861333-8 devstack@n-api.service[105199]: INFO nova.api.openstack.requestlog [None req-923200d3-a8ce-425e-a145-3c3bd8e4075c admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.509206 Oct 19 03:02:42.036870 n-d-861333-8 devstack@n-api.service[105199]: [pid: 105199|app: 0|req: 5/11] 10.222.0.52 () {64 vars in 1283 bytes} [Wed Oct 19 03:02:41 2022] POST /compute/v2.1/flavors => generated 404 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 03:02:42.050064 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi [None req-ddf0cc58-381a-407a-a169-f1a1218f271f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:02:42.154902 n-d-861333-8 devstack@n-api.service[105200]: INFO nova.api.openstack.requestlog [None req-ddf0cc58-381a-407a-a169-f1a1218f271f admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.109326 Oct 19 03:02:42.163945 n-d-861333-8 devstack@n-api.service[105200]: [pid: 105200|app: 0|req: 7/12] 10.222.0.52 () {64 vars in 1336 bytes} [Wed Oct 19 03:02:42 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:02:44.772978 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi [None req-923200d3-a8ce-425e-a145-3c3bd8e4075c admin admin] Calling method '>' {{(pid=105199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:02:44.773975 n-d-861333-8 devstack@n-api.service[105199]: INFO nova.api.openstack.requestlog [None req-923200d3-a8ce-425e-a145-3c3bd8e4075c admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001518 Oct 19 03:02:44.774579 n-d-861333-8 devstack@n-api.service[105199]: [pid: 105199|app: 0|req: 6/13] 10.222.0.52 () {54 vars in 931 bytes} [Wed Oct 19 03:02:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:02:45.245101 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi [None req-ed2f2085-fa85-4023-a697-626f56977dda admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "disk": 10, "id": "d3", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "ds2G", "vcpus": 2, "rxtx_factor": 1.0}} {{(pid=105200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:02:45.344373 n-d-861333-8 devstack@n-api.service[105200]: INFO nova.api.openstack.requestlog [None req-ed2f2085-fa85-4023-a697-626f56977dda admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.562513 Oct 19 03:02:45.344791 n-d-861333-8 devstack@n-api.service[105200]: [pid: 105200|app: 0|req: 8/14] 10.222.0.52 () {64 vars in 1283 bytes} [Wed Oct 19 03:02:44 2022] POST /compute/v2.1/flavors => generated 404 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 03:02:45.358561 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi [None req-fe336462-310b-4eb2-a15a-83ecf968896e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:02:45.427867 n-d-861333-8 devstack@n-api.service[105199]: INFO nova.api.openstack.requestlog [None req-fe336462-310b-4eb2-a15a-83ecf968896e admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.074447 Oct 19 03:02:45.428486 n-d-861333-8 devstack@n-api.service[105199]: [pid: 105199|app: 0|req: 7/15] 10.222.0.52 () {64 vars in 1336 bytes} [Wed Oct 19 03:02:45 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:02:48.174077 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi [None req-ed2f2085-fa85-4023-a697-626f56977dda admin admin] Calling method '>' {{(pid=105200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:02:48.175778 n-d-861333-8 devstack@n-api.service[105200]: INFO nova.api.openstack.requestlog [None req-ed2f2085-fa85-4023-a697-626f56977dda admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002148 Oct 19 03:02:48.176669 n-d-861333-8 devstack@n-api.service[105200]: [pid: 105200|app: 0|req: 9/16] 10.222.0.52 () {54 vars in 931 bytes} [Wed Oct 19 03:02:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:02:48.630575 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi [None req-7742d386-0124-41d0-8fda-991a6ec2db4f admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 4, "name": "ds4G", "ram": 4096, "rxtx_factor": 1.0, "disk": 20}} {{(pid=105199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:02:48.703164 n-d-861333-8 devstack@n-api.service[105199]: INFO nova.api.openstack.requestlog [None req-7742d386-0124-41d0-8fda-991a6ec2db4f admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.520749 Oct 19 03:02:48.716543 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi [None req-06b0633a-44cc-47c9-b936-1ee82b1659ee admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:02:48.717050 n-d-861333-8 devstack@n-api.service[105199]: [pid: 105199|app: 0|req: 8/17] 10.222.0.52 () {64 vars in 1283 bytes} [Wed Oct 19 03:02:48 2022] POST /compute/v2.1/flavors => generated 404 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 03:02:48.800875 n-d-861333-8 devstack@n-api.service[105200]: INFO nova.api.openstack.requestlog [None req-06b0633a-44cc-47c9-b936-1ee82b1659ee admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.087835 Oct 19 03:02:48.815165 n-d-861333-8 devstack@n-api.service[105200]: [pid: 105200|app: 0|req: 10/18] 10.222.0.52 () {64 vars in 1336 bytes} [Wed Oct 19 03:02:48 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:02:51.511927 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi [None req-7742d386-0124-41d0-8fda-991a6ec2db4f admin admin] Calling method '>' {{(pid=105199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:02:51.513216 n-d-861333-8 devstack@n-api.service[105199]: INFO nova.api.openstack.requestlog [None req-7742d386-0124-41d0-8fda-991a6ec2db4f admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002090 Oct 19 03:02:51.513845 n-d-861333-8 devstack@n-api.service[105199]: [pid: 105199|app: 0|req: 9/19] 10.222.0.52 () {54 vars in 931 bytes} [Wed Oct 19 03:02:51 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:02:51.956945 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi [None req-f893efa1-ee21-4bfc-a048-83d7df9fb864 admin admin] Calling method '>' {{(pid=105200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:02:51.986647 n-d-861333-8 devstack@n-api.service[105200]: INFO nova.api.openstack.requestlog [None req-f893efa1-ee21-4bfc-a048-83d7df9fb864 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.465937 Oct 19 03:02:51.987562 n-d-861333-8 devstack@n-api.service[105200]: [pid: 105200|app: 0|req: 11/20] 10.222.0.52 () {60 vars in 1292 bytes} [Wed Oct 19 03:02:51 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:02:54.996856 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi [None req-7742d386-0124-41d0-8fda-991a6ec2db4f admin admin] Calling method '>' {{(pid=105199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:02:54.997896 n-d-861333-8 devstack@n-api.service[105199]: INFO nova.api.openstack.requestlog [None req-7742d386-0124-41d0-8fda-991a6ec2db4f admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001553 Oct 19 03:02:54.998333 n-d-861333-8 devstack@n-api.service[105199]: [pid: 105199|app: 0|req: 10/21] 10.222.0.52 () {54 vars in 931 bytes} [Wed Oct 19 03:02:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:02:55.406660 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi [None req-2a52bed1-2c0d-43c1-b415-0979f74203d6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "swap": 0, "rxtx_factor": 1.0, "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "vcpus": 1, "os-flavor-access:is_public": true, "disk": 1}} {{(pid=105200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:02:55.478360 n-d-861333-8 devstack@n-api.service[105200]: INFO nova.api.openstack.requestlog [None req-2a52bed1-2c0d-43c1-b415-0979f74203d6 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.473223 Oct 19 03:02:55.479014 n-d-861333-8 devstack@n-api.service[105200]: [pid: 105200|app: 0|req: 12/22] 10.222.0.52 () {64 vars in 1283 bytes} [Wed Oct 19 03:02:55 2022] POST /compute/v2.1/flavors => generated 402 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 03:02:55.493393 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi [None req-0a3bf0d0-3ce4-44e6-a483-f4a4a019276f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:02:55.577052 n-d-861333-8 devstack@n-api.service[105199]: INFO nova.api.openstack.requestlog [None req-0a3bf0d0-3ce4-44e6-a483-f4a4a019276f admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.088391 Oct 19 03:02:55.578529 n-d-861333-8 devstack@n-api.service[105199]: [pid: 105199|app: 0|req: 11/23] 10.222.0.52 () {64 vars in 1333 bytes} [Wed Oct 19 03:02:55 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:02:58.182536 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi [None req-2a52bed1-2c0d-43c1-b415-0979f74203d6 admin admin] Calling method '>' {{(pid=105200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:02:58.183583 n-d-861333-8 devstack@n-api.service[105200]: INFO nova.api.openstack.requestlog [None req-2a52bed1-2c0d-43c1-b415-0979f74203d6 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Oct 19 03:02:58.183981 n-d-861333-8 devstack@n-api.service[105200]: [pid: 105200|app: 0|req: 13/24] 10.222.0.52 () {54 vars in 931 bytes} [Wed Oct 19 03:02:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:02:58.587925 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi [None req-32f2ba06-ef5b-4fc9-b3ac-bed7187d870f admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 2048, "disk": 20, "id": "2", "rxtx_factor": 1.0, "name": "m1.small", "swap": 0}} {{(pid=105199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:02:58.650710 n-d-861333-8 devstack@n-api.service[105199]: INFO nova.api.openstack.requestlog [None req-32f2ba06-ef5b-4fc9-b3ac-bed7187d870f admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.460478 Oct 19 03:02:58.651495 n-d-861333-8 devstack@n-api.service[105199]: [pid: 105199|app: 0|req: 12/25] 10.222.0.52 () {64 vars in 1283 bytes} [Wed Oct 19 03:02:58 2022] POST /compute/v2.1/flavors => generated 405 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 03:02:58.664256 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi [None req-58822661-2270-40dc-bbe9-4ac4f65770f9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:02:58.728458 n-d-861333-8 devstack@n-api.service[105200]: INFO nova.api.openstack.requestlog [None req-58822661-2270-40dc-bbe9-4ac4f65770f9 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.067879 Oct 19 03:02:58.729149 n-d-861333-8 devstack@n-api.service[105200]: [pid: 105200|app: 0|req: 14/26] 10.222.0.52 () {64 vars in 1333 bytes} [Wed Oct 19 03:02:58 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:03:01.322441 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi [None req-32f2ba06-ef5b-4fc9-b3ac-bed7187d870f admin admin] Calling method '>' {{(pid=105199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:03:01.323509 n-d-861333-8 devstack@n-api.service[105199]: INFO nova.api.openstack.requestlog [None req-32f2ba06-ef5b-4fc9-b3ac-bed7187d870f admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Oct 19 03:03:01.323918 n-d-861333-8 devstack@n-api.service[105199]: [pid: 105199|app: 0|req: 13/27] 10.222.0.52 () {54 vars in 931 bytes} [Wed Oct 19 03:03:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:03:01.738387 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi [None req-cbfe18aa-c091-4e91-a97b-84ad00d1200c admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "name": "m1.medium", "ram": 4096, "id": "3", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 40}} {{(pid=105200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:03:02.580398 n-d-861333-8 devstack@n-api.service[105200]: INFO nova.api.openstack.requestlog [None req-cbfe18aa-c091-4e91-a97b-84ad00d1200c admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 1.250270 Oct 19 03:03:02.588332 n-d-861333-8 devstack@n-api.service[105200]: [pid: 105200|app: 0|req: 15/28] 10.222.0.52 () {64 vars in 1283 bytes} [Wed Oct 19 03:03:01 2022] POST /compute/v2.1/flavors => generated 406 bytes in 1252 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 03:03:02.593299 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi [None req-acd4b737-772a-4273-b98e-9b8d9be05715 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:03:02.605493 n-d-861333-8 devstack@n-api.service[105199]: DEBUG dbcounter [-] [105199] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=105199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:03:02.809193 n-d-861333-8 devstack@n-api.service[105199]: INFO nova.api.openstack.requestlog [None req-acd4b737-772a-4273-b98e-9b8d9be05715 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.219641 Oct 19 03:03:02.811648 n-d-861333-8 devstack@n-api.service[105199]: [pid: 105199|app: 0|req: 14/29] 10.222.0.52 () {64 vars in 1333 bytes} [Wed Oct 19 03:03:02 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:03:05.402928 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi [None req-cbfe18aa-c091-4e91-a97b-84ad00d1200c admin admin] Calling method '>' {{(pid=105200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:03:05.403939 n-d-861333-8 devstack@n-api.service[105200]: INFO nova.api.openstack.requestlog [None req-cbfe18aa-c091-4e91-a97b-84ad00d1200c admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Oct 19 03:03:05.404366 n-d-861333-8 devstack@n-api.service[105200]: [pid: 105200|app: 0|req: 16/30] 10.222.0.52 () {54 vars in 931 bytes} [Wed Oct 19 03:03:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:03:05.858757 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi [None req-28997728-e7cc-423f-90ae-f0dde08ce65c admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "ram": 8192, "id": "4", "disk": 80, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.large"}} {{(pid=105199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:03:05.929022 n-d-861333-8 devstack@n-api.service[105199]: INFO nova.api.openstack.requestlog [None req-28997728-e7cc-423f-90ae-f0dde08ce65c admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.518346 Oct 19 03:03:05.929628 n-d-861333-8 devstack@n-api.service[105199]: [pid: 105199|app: 0|req: 15/31] 10.222.0.52 () {64 vars in 1283 bytes} [Wed Oct 19 03:03:05 2022] POST /compute/v2.1/flavors => generated 405 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 03:03:05.942152 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi [None req-fe15d668-a114-40a3-9093-638ab3556dfa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:03:06.015391 n-d-861333-8 devstack@n-api.service[105200]: INFO nova.api.openstack.requestlog [None req-fe15d668-a114-40a3-9093-638ab3556dfa admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.077123 Oct 19 03:03:06.016231 n-d-861333-8 devstack@n-api.service[105200]: [pid: 105200|app: 0|req: 17/32] 10.222.0.52 () {64 vars in 1333 bytes} [Wed Oct 19 03:03:05 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:03:08.620114 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi [None req-28997728-e7cc-423f-90ae-f0dde08ce65c admin admin] Calling method '>' {{(pid=105199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:03:08.621496 n-d-861333-8 devstack@n-api.service[105199]: INFO nova.api.openstack.requestlog [None req-28997728-e7cc-423f-90ae-f0dde08ce65c admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001714 Oct 19 03:03:08.621936 n-d-861333-8 devstack@n-api.service[105199]: [pid: 105199|app: 0|req: 16/33] 10.222.0.52 () {54 vars in 931 bytes} [Wed Oct 19 03:03:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:03:09.063690 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi [None req-04067d04-1373-4dc2-8b51-58acbd17b60e admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "m1.xlarge", "disk": 160, "rxtx_factor": 1.0, "swap": 0, "id": "5", "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8}} {{(pid=105200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:03:09.070540 n-d-861333-8 devstack@n-api.service[105200]: DEBUG dbcounter [-] [105200] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=105200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:03:09.150680 n-d-861333-8 devstack@n-api.service[105200]: INFO nova.api.openstack.requestlog [None req-04067d04-1373-4dc2-8b51-58acbd17b60e admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.522233 Oct 19 03:03:09.151497 n-d-861333-8 devstack@n-api.service[105200]: [pid: 105200|app: 0|req: 18/34] 10.222.0.52 () {64 vars in 1283 bytes} [Wed Oct 19 03:03:08 2022] POST /compute/v2.1/flavors => generated 408 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 03:03:09.163859 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi [None req-97694dd1-c92a-42f8-a337-becf1d4024ff admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:03:09.256063 n-d-861333-8 devstack@n-api.service[105199]: INFO nova.api.openstack.requestlog [None req-97694dd1-c92a-42f8-a337-becf1d4024ff admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.095778 Oct 19 03:03:09.256836 n-d-861333-8 devstack@n-api.service[105199]: [pid: 105199|app: 0|req: 17/35] 10.222.0.52 () {64 vars in 1333 bytes} [Wed Oct 19 03:03:09 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:03:28.908941 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi [None req-04067d04-1373-4dc2-8b51-58acbd17b60e admin admin] Calling method '>' {{(pid=105200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:03:28.910032 n-d-861333-8 devstack@n-api.service[105200]: INFO nova.api.openstack.requestlog [None req-04067d04-1373-4dc2-8b51-58acbd17b60e admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001567 Oct 19 03:03:28.910440 n-d-861333-8 devstack@n-api.service[105200]: [pid: 105200|app: 0|req: 19/36] 10.222.0.52 () {54 vars in 931 bytes} [Wed Oct 19 03:03:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:03:28.921242 n-d-861333-8 devstack@n-api.service[105199]: DEBUG dbcounter [-] [105199] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=105199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:03:29.306479 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi [None req-f8647084-ad6d-47e3-ade3-145cddb1bbe5 admin admin] Calling method '>' {{(pid=105199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:03:29.325065 n-d-861333-8 devstack@n-api.service[105199]: INFO nova.api.openstack.requestlog [None req-f8647084-ad6d-47e3-ade3-145cddb1bbe5 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.408550 Oct 19 03:03:29.325641 n-d-861333-8 devstack@n-api.service[105199]: [pid: 105199|app: 0|req: 18/37] 10.222.0.52 () {60 vars in 1292 bytes} [Wed Oct 19 03:03:28 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:03:30.631933 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi [None req-04067d04-1373-4dc2-8b51-58acbd17b60e admin admin] Calling method '>' {{(pid=105200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:03:30.632947 n-d-861333-8 devstack@n-api.service[105200]: INFO nova.api.openstack.requestlog [None req-04067d04-1373-4dc2-8b51-58acbd17b60e admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Oct 19 03:03:30.633349 n-d-861333-8 devstack@n-api.service[105200]: [pid: 105200|app: 0|req: 20/38] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Oct 19 03:03:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:03:31.164506 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi [None req-adce2496-046a-4ac7-9791-aa5012e7d78c admin admin] Calling method '>' {{(pid=105199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:03:31.169863 n-d-861333-8 devstack@n-api.service[105199]: INFO nova.api.openstack.wsgi [None req-adce2496-046a-4ac7-9791-aa5012e7d78c admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 19 03:03:31.173917 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi [None req-adce2496-046a-4ac7-9791-aa5012e7d78c admin admin] Request method failure captured: Oct 19 03:03:31.173917 n-d-861333-8 devstack@n-api.service[105199]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 19 03:03:31.173917 n-d-861333-8 devstack@n-api.service[105199]: Accept: application/json Oct 19 03:03:31.173917 n-d-861333-8 devstack@n-api.service[105199]: Accept-Encoding: gzip, deflate Oct 19 03:03:31.173917 n-d-861333-8 devstack@n-api.service[105199]: Connection: keep-alive Oct 19 03:03:31.173917 n-d-861333-8 devstack@n-api.service[105199]: Content-Length: 0 Oct 19 03:03:31.173917 n-d-861333-8 devstack@n-api.service[105199]: Host: 10.222.0.52 Oct 19 03:03:31.173917 n-d-861333-8 devstack@n-api.service[105199]: Openstack-Api-Version: compute 2.92 Oct 19 03:03:31.173917 n-d-861333-8 devstack@n-api.service[105199]: Openstack-System-Scope: None Oct 19 03:03:31.173917 n-d-861333-8 devstack@n-api.service[105199]: User-Agent: python-novaclient Oct 19 03:03:31.173917 n-d-861333-8 devstack@n-api.service[105199]: X-Auth-Token: gAAAAABjT2kCqiH8a2hA6cxWJSQULUHtabMgk2ycuE0TmCm5giiLk7ZAqDSDVvqUzJG4UjJyN5hXO3X4OKcJUYhOO8T46ZMAx7qhvL3EZZcxBdxrqDUXd2Js7m3NvetX34XJKplVNqTLo9ah9mIZHjFhtOKl6Sp6A6oR_ucWQFxLJBSd1VJyfEQ Oct 19 03:03:31.173917 n-d-861333-8 devstack@n-api.service[105199]: X-Domain-Id: None Oct 19 03:03:31.173917 n-d-861333-8 devstack@n-api.service[105199]: X-Domain-Name: None Oct 19 03:03:31.173917 n-d-861333-8 devstack@n-api.service[105199]: X-Identity-Status: Confirmed Oct 19 03:03:31.173917 n-d-861333-8 devstack@n-api.service[105199]: X-Is-Admin-Project: True Oct 19 03:03:31.173917 n-d-861333-8 devstack@n-api.service[105199]: X-Openstack-Nova-Api-Version: 2.92 Oct 19 03:03:31.173917 n-d-861333-8 devstack@n-api.service[105199]: X-Project-Domain-Id: default Oct 19 03:03:31.173917 n-d-861333-8 devstack@n-api.service[105199]: X-Project-Domain-Name: Default Oct 19 03:03:31.173917 n-d-861333-8 devstack@n-api.service[105199]: X-Project-Id: 8bcd8c1dd2504d8088e1ab66cf6ec8d3 Oct 19 03:03:31.173917 n-d-861333-8 devstack@n-api.service[105199]: X-Project-Name: admin Oct 19 03:03:31.173917 n-d-861333-8 devstack@n-api.service[105199]: X-Role: reader,member,admin Oct 19 03:03:31.173917 n-d-861333-8 devstack@n-api.service[105199]: X-Roles: reader,member,admin Oct 19 03:03:31.175620 n-d-861333-8 devstack@n-api.service[105199]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8bcd8c1dd2504d8088e1ab66cf6ec8d3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8bcd8c1dd2504d8088e1ab66cf6ec8d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8bcd8c1dd2504d8088e1ab66cf6ec8d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8bcd8c1dd2504d8088e1ab66cf6ec8d3", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:03:31.175620 n-d-861333-8 devstack@n-api.service[105199]: X-Tenant: admin Oct 19 03:03:31.175620 n-d-861333-8 devstack@n-api.service[105199]: X-Tenant-Id: 8bcd8c1dd2504d8088e1ab66cf6ec8d3 Oct 19 03:03:31.175620 n-d-861333-8 devstack@n-api.service[105199]: X-Tenant-Name: admin Oct 19 03:03:31.175620 n-d-861333-8 devstack@n-api.service[105199]: X-User: admin Oct 19 03:03:31.175620 n-d-861333-8 devstack@n-api.service[105199]: X-User-Domain-Id: default Oct 19 03:03:31.175620 n-d-861333-8 devstack@n-api.service[105199]: X-User-Domain-Name: Default Oct 19 03:03:31.175620 n-d-861333-8 devstack@n-api.service[105199]: X-User-Id: b9b94148a21a4d8dbf5bab64fdf0159c Oct 19 03:03:31.175620 n-d-861333-8 devstack@n-api.service[105199]: X-User-Name: admin Oct 19 03:03:31.175620 n-d-861333-8 devstack@n-api.service[105199]: method: > Oct 19 03:03:31.175620 n-d-861333-8 devstack@n-api.service[105199]: exception: Flavor 42 could not be found. Oct 19 03:03:31.175620 n-d-861333-8 devstack@n-api.service[105199]: action_args: {'id': '42'} Oct 19 03:03:31.175620 n-d-861333-8 devstack@n-api.service[105199]: {{(pid=105199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:03:31.175620 n-d-861333-8 devstack@n-api.service[105199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:03:31.176713 n-d-861333-8 devstack@n-api.service[105199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 19 03:03:31.176713 n-d-861333-8 devstack@n-api.service[105199]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 19 03:03:31.176713 n-d-861333-8 devstack@n-api.service[105199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 19 03:03:31.176713 n-d-861333-8 devstack@n-api.service[105199]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 19 03:03:31.176713 n-d-861333-8 devstack@n-api.service[105199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 03:03:31.176713 n-d-861333-8 devstack@n-api.service[105199]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 03:03:31.176713 n-d-861333-8 devstack@n-api.service[105199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 19 03:03:31.176713 n-d-861333-8 devstack@n-api.service[105199]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 19 03:03:31.176713 n-d-861333-8 devstack@n-api.service[105199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 19 03:03:31.176713 n-d-861333-8 devstack@n-api.service[105199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:03:31.176713 n-d-861333-8 devstack@n-api.service[105199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 19 03:03:31.176713 n-d-861333-8 devstack@n-api.service[105199]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 19 03:03:31.176713 n-d-861333-8 devstack@n-api.service[105199]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 19 03:03:31.176713 n-d-861333-8 devstack@n-api.service[105199]: ERROR nova.api.openstack.wsgi Oct 19 03:03:31.176713 n-d-861333-8 devstack@n-api.service[105199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:03:31.176713 n-d-861333-8 devstack@n-api.service[105199]: ERROR nova.api.openstack.wsgi Oct 19 03:03:31.176713 n-d-861333-8 devstack@n-api.service[105199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:03:31.176713 n-d-861333-8 devstack@n-api.service[105199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:03:31.176713 n-d-861333-8 devstack@n-api.service[105199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:03:31.178120 n-d-861333-8 devstack@n-api.service[105199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:03:31.178120 n-d-861333-8 devstack@n-api.service[105199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:03:31.178120 n-d-861333-8 devstack@n-api.service[105199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:03:31.178120 n-d-861333-8 devstack@n-api.service[105199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:03:31.178120 n-d-861333-8 devstack@n-api.service[105199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 19 03:03:31.178120 n-d-861333-8 devstack@n-api.service[105199]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:03:31.178120 n-d-861333-8 devstack@n-api.service[105199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 19 03:03:31.178120 n-d-861333-8 devstack@n-api.service[105199]: ERROR nova.api.openstack.wsgi Oct 19 03:03:31.178120 n-d-861333-8 devstack@n-api.service[105199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:03:31.178120 n-d-861333-8 devstack@n-api.service[105199]: ERROR nova.api.openstack.wsgi Oct 19 03:03:31.178120 n-d-861333-8 devstack@n-api.service[105199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:03:31.178120 n-d-861333-8 devstack@n-api.service[105199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:03:31.178120 n-d-861333-8 devstack@n-api.service[105199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:03:31.178120 n-d-861333-8 devstack@n-api.service[105199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:03:31.178120 n-d-861333-8 devstack@n-api.service[105199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:03:31.178120 n-d-861333-8 devstack@n-api.service[105199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 19 03:03:31.178120 n-d-861333-8 devstack@n-api.service[105199]: ERROR nova.api.openstack.wsgi Oct 19 03:03:31.178120 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi [None req-adce2496-046a-4ac7-9791-aa5012e7d78c admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:03:31.179559 n-d-861333-8 devstack@n-api.service[105199]: INFO nova.api.openstack.requestlog [None req-adce2496-046a-4ac7-9791-aa5012e7d78c admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.390396 Oct 19 03:03:31.179559 n-d-861333-8 devstack@n-api.service[105199]: [pid: 105199|app: 0|req: 19/39] 10.222.0.52 () {60 vars in 1190 bytes} [Wed Oct 19 03:03:30 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 391 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 19 03:03:31.185142 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi [None req-c8e6ff23-6f41-4bf3-8ad3-4687b502888c admin admin] Calling method '>' {{(pid=105200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:03:31.211399 n-d-861333-8 devstack@n-api.service[105200]: INFO nova.api.openstack.requestlog [None req-c8e6ff23-6f41-4bf3-8ad3-4687b502888c admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027813 Oct 19 03:03:31.211399 n-d-861333-8 devstack@n-api.service[105200]: [pid: 105200|app: 0|req: 21/40] 10.222.0.52 () {60 vars in 1210 bytes} [Wed Oct 19 03:03:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:03:31.220816 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi [None req-7c77fb28-e708-43c7-a310-db3c52a02b98 admin admin] Calling method '>' {{(pid=105199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:03:31.242513 n-d-861333-8 devstack@n-api.service[105199]: INFO nova.api.openstack.requestlog [None req-7c77fb28-e708-43c7-a310-db3c52a02b98 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026232 Oct 19 03:03:31.243059 n-d-861333-8 devstack@n-api.service[105199]: [pid: 105199|app: 0|req: 20/41] 10.222.0.52 () {60 vars in 1210 bytes} [Wed Oct 19 03:03:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:03:31.253551 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi [None req-e14808dd-4c73-4c2c-9d3f-5dcd21b758b1 admin admin] Calling method '>' {{(pid=105200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:03:31.259299 n-d-861333-8 devstack@n-api.service[105200]: INFO nova.api.openstack.wsgi [None req-e14808dd-4c73-4c2c-9d3f-5dcd21b758b1 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 19 03:03:31.262617 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi [None req-e14808dd-4c73-4c2c-9d3f-5dcd21b758b1 admin admin] Request method failure captured: Oct 19 03:03:31.262617 n-d-861333-8 devstack@n-api.service[105200]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 19 03:03:31.262617 n-d-861333-8 devstack@n-api.service[105200]: Accept: application/json Oct 19 03:03:31.262617 n-d-861333-8 devstack@n-api.service[105200]: Accept-Encoding: gzip, deflate Oct 19 03:03:31.262617 n-d-861333-8 devstack@n-api.service[105200]: Connection: keep-alive Oct 19 03:03:31.262617 n-d-861333-8 devstack@n-api.service[105200]: Content-Length: 0 Oct 19 03:03:31.262617 n-d-861333-8 devstack@n-api.service[105200]: Host: 10.222.0.52 Oct 19 03:03:31.262617 n-d-861333-8 devstack@n-api.service[105200]: Openstack-Api-Version: compute 2.92 Oct 19 03:03:31.262617 n-d-861333-8 devstack@n-api.service[105200]: Openstack-System-Scope: None Oct 19 03:03:31.262617 n-d-861333-8 devstack@n-api.service[105200]: User-Agent: python-novaclient Oct 19 03:03:31.262617 n-d-861333-8 devstack@n-api.service[105200]: X-Auth-Token: gAAAAABjT2kCqiH8a2hA6cxWJSQULUHtabMgk2ycuE0TmCm5giiLk7ZAqDSDVvqUzJG4UjJyN5hXO3X4OKcJUYhOO8T46ZMAx7qhvL3EZZcxBdxrqDUXd2Js7m3NvetX34XJKplVNqTLo9ah9mIZHjFhtOKl6Sp6A6oR_ucWQFxLJBSd1VJyfEQ Oct 19 03:03:31.262617 n-d-861333-8 devstack@n-api.service[105200]: X-Domain-Id: None Oct 19 03:03:31.262617 n-d-861333-8 devstack@n-api.service[105200]: X-Domain-Name: None Oct 19 03:03:31.262617 n-d-861333-8 devstack@n-api.service[105200]: X-Identity-Status: Confirmed Oct 19 03:03:31.262617 n-d-861333-8 devstack@n-api.service[105200]: X-Is-Admin-Project: True Oct 19 03:03:31.262617 n-d-861333-8 devstack@n-api.service[105200]: X-Openstack-Nova-Api-Version: 2.92 Oct 19 03:03:31.262617 n-d-861333-8 devstack@n-api.service[105200]: X-Project-Domain-Id: default Oct 19 03:03:31.262617 n-d-861333-8 devstack@n-api.service[105200]: X-Project-Domain-Name: Default Oct 19 03:03:31.262617 n-d-861333-8 devstack@n-api.service[105200]: X-Project-Id: 8bcd8c1dd2504d8088e1ab66cf6ec8d3 Oct 19 03:03:31.262617 n-d-861333-8 devstack@n-api.service[105200]: X-Project-Name: admin Oct 19 03:03:31.262617 n-d-861333-8 devstack@n-api.service[105200]: X-Role: reader,member,admin Oct 19 03:03:31.262617 n-d-861333-8 devstack@n-api.service[105200]: X-Roles: reader,member,admin Oct 19 03:03:31.270400 n-d-861333-8 devstack@n-api.service[105200]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8bcd8c1dd2504d8088e1ab66cf6ec8d3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8bcd8c1dd2504d8088e1ab66cf6ec8d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8bcd8c1dd2504d8088e1ab66cf6ec8d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8bcd8c1dd2504d8088e1ab66cf6ec8d3", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:03:31.270400 n-d-861333-8 devstack@n-api.service[105200]: X-Tenant: admin Oct 19 03:03:31.270400 n-d-861333-8 devstack@n-api.service[105200]: X-Tenant-Id: 8bcd8c1dd2504d8088e1ab66cf6ec8d3 Oct 19 03:03:31.270400 n-d-861333-8 devstack@n-api.service[105200]: X-Tenant-Name: admin Oct 19 03:03:31.270400 n-d-861333-8 devstack@n-api.service[105200]: X-User: admin Oct 19 03:03:31.270400 n-d-861333-8 devstack@n-api.service[105200]: X-User-Domain-Id: default Oct 19 03:03:31.270400 n-d-861333-8 devstack@n-api.service[105200]: X-User-Domain-Name: Default Oct 19 03:03:31.270400 n-d-861333-8 devstack@n-api.service[105200]: X-User-Id: b9b94148a21a4d8dbf5bab64fdf0159c Oct 19 03:03:31.270400 n-d-861333-8 devstack@n-api.service[105200]: X-User-Name: admin Oct 19 03:03:31.270400 n-d-861333-8 devstack@n-api.service[105200]: method: > Oct 19 03:03:31.270400 n-d-861333-8 devstack@n-api.service[105200]: exception: Flavor 42 could not be found. Oct 19 03:03:31.270400 n-d-861333-8 devstack@n-api.service[105200]: action_args: {'id': '42'} Oct 19 03:03:31.270400 n-d-861333-8 devstack@n-api.service[105200]: {{(pid=105200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:03:31.270400 n-d-861333-8 devstack@n-api.service[105200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:03:31.271307 n-d-861333-8 devstack@n-api.service[105200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 19 03:03:31.271307 n-d-861333-8 devstack@n-api.service[105200]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 19 03:03:31.271307 n-d-861333-8 devstack@n-api.service[105200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 19 03:03:31.271307 n-d-861333-8 devstack@n-api.service[105200]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 19 03:03:31.271307 n-d-861333-8 devstack@n-api.service[105200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 03:03:31.271307 n-d-861333-8 devstack@n-api.service[105200]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 03:03:31.271307 n-d-861333-8 devstack@n-api.service[105200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 19 03:03:31.271307 n-d-861333-8 devstack@n-api.service[105200]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 19 03:03:31.271307 n-d-861333-8 devstack@n-api.service[105200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 19 03:03:31.271307 n-d-861333-8 devstack@n-api.service[105200]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:03:31.271307 n-d-861333-8 devstack@n-api.service[105200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 19 03:03:31.271307 n-d-861333-8 devstack@n-api.service[105200]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 19 03:03:31.271307 n-d-861333-8 devstack@n-api.service[105200]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 19 03:03:31.271307 n-d-861333-8 devstack@n-api.service[105200]: ERROR nova.api.openstack.wsgi Oct 19 03:03:31.271307 n-d-861333-8 devstack@n-api.service[105200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:03:31.271307 n-d-861333-8 devstack@n-api.service[105200]: ERROR nova.api.openstack.wsgi Oct 19 03:03:31.271307 n-d-861333-8 devstack@n-api.service[105200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:03:31.271307 n-d-861333-8 devstack@n-api.service[105200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:03:31.271307 n-d-861333-8 devstack@n-api.service[105200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:03:31.272322 n-d-861333-8 devstack@n-api.service[105200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:03:31.272322 n-d-861333-8 devstack@n-api.service[105200]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:03:31.272322 n-d-861333-8 devstack@n-api.service[105200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:03:31.272322 n-d-861333-8 devstack@n-api.service[105200]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:03:31.272322 n-d-861333-8 devstack@n-api.service[105200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 19 03:03:31.272322 n-d-861333-8 devstack@n-api.service[105200]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:03:31.272322 n-d-861333-8 devstack@n-api.service[105200]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 19 03:03:31.272322 n-d-861333-8 devstack@n-api.service[105200]: ERROR nova.api.openstack.wsgi Oct 19 03:03:31.272322 n-d-861333-8 devstack@n-api.service[105200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:03:31.272322 n-d-861333-8 devstack@n-api.service[105200]: ERROR nova.api.openstack.wsgi Oct 19 03:03:31.272322 n-d-861333-8 devstack@n-api.service[105200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:03:31.272322 n-d-861333-8 devstack@n-api.service[105200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:03:31.272322 n-d-861333-8 devstack@n-api.service[105200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:03:31.272322 n-d-861333-8 devstack@n-api.service[105200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:03:31.272322 n-d-861333-8 devstack@n-api.service[105200]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:03:31.272322 n-d-861333-8 devstack@n-api.service[105200]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 19 03:03:31.272322 n-d-861333-8 devstack@n-api.service[105200]: ERROR nova.api.openstack.wsgi Oct 19 03:03:31.272322 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi [None req-e14808dd-4c73-4c2c-9d3f-5dcd21b758b1 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105200) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:03:31.273278 n-d-861333-8 devstack@n-api.service[105200]: INFO nova.api.openstack.requestlog [None req-e14808dd-4c73-4c2c-9d3f-5dcd21b758b1 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.015257 Oct 19 03:03:31.273278 n-d-861333-8 devstack@n-api.service[105200]: [pid: 105200|app: 0|req: 22/42] 10.222.0.52 () {60 vars in 1190 bytes} [Wed Oct 19 03:03:31 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 19 03:03:32.481089 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi [None req-7c77fb28-e708-43c7-a310-db3c52a02b98 admin admin] Calling method '>' {{(pid=105199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:03:32.482153 n-d-861333-8 devstack@n-api.service[105199]: INFO nova.api.openstack.requestlog [None req-7c77fb28-e708-43c7-a310-db3c52a02b98 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001512 Oct 19 03:03:32.482564 n-d-861333-8 devstack@n-api.service[105199]: [pid: 105199|app: 0|req: 21/43] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Oct 19 03:03:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:03:33.000548 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi [None req-044a72fa-dff2-41c9-b607-af71200955ba admin admin] Calling method '>' {{(pid=105200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:03:33.005683 n-d-861333-8 devstack@n-api.service[105200]: INFO nova.api.openstack.wsgi [None req-044a72fa-dff2-41c9-b607-af71200955ba admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 19 03:03:33.007192 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi [None req-044a72fa-dff2-41c9-b607-af71200955ba admin admin] Request method failure captured: Oct 19 03:03:33.007192 n-d-861333-8 devstack@n-api.service[105200]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 19 03:03:33.007192 n-d-861333-8 devstack@n-api.service[105200]: Accept: application/json Oct 19 03:03:33.007192 n-d-861333-8 devstack@n-api.service[105200]: Accept-Encoding: gzip, deflate Oct 19 03:03:33.007192 n-d-861333-8 devstack@n-api.service[105200]: Connection: keep-alive Oct 19 03:03:33.007192 n-d-861333-8 devstack@n-api.service[105200]: Content-Length: 0 Oct 19 03:03:33.007192 n-d-861333-8 devstack@n-api.service[105200]: Host: 10.222.0.52 Oct 19 03:03:33.007192 n-d-861333-8 devstack@n-api.service[105200]: Openstack-Api-Version: compute 2.92 Oct 19 03:03:33.007192 n-d-861333-8 devstack@n-api.service[105200]: Openstack-System-Scope: None Oct 19 03:03:33.007192 n-d-861333-8 devstack@n-api.service[105200]: User-Agent: python-novaclient Oct 19 03:03:33.007192 n-d-861333-8 devstack@n-api.service[105200]: X-Auth-Token: gAAAAABjT2kEmK4pjuut0e36-68_wYYwvnO691AnSbTHd4mFplxqH64iMbuc_LXi7XxD1NVTGt4ljXlgPZH2WrDuVEi_zZj78yDNqI-ii4qMPktDTToZBIbOhh5ldSTSNnDKKMaU8LmTGuQgkNmG9WPqrXVPVoM_J7oWpimASxQ9DjflY_abz2E Oct 19 03:03:33.007192 n-d-861333-8 devstack@n-api.service[105200]: X-Domain-Id: None Oct 19 03:03:33.007192 n-d-861333-8 devstack@n-api.service[105200]: X-Domain-Name: None Oct 19 03:03:33.007192 n-d-861333-8 devstack@n-api.service[105200]: X-Identity-Status: Confirmed Oct 19 03:03:33.007192 n-d-861333-8 devstack@n-api.service[105200]: X-Is-Admin-Project: True Oct 19 03:03:33.007192 n-d-861333-8 devstack@n-api.service[105200]: X-Openstack-Nova-Api-Version: 2.92 Oct 19 03:03:33.007192 n-d-861333-8 devstack@n-api.service[105200]: X-Project-Domain-Id: default Oct 19 03:03:33.007192 n-d-861333-8 devstack@n-api.service[105200]: X-Project-Domain-Name: Default Oct 19 03:03:33.007192 n-d-861333-8 devstack@n-api.service[105200]: X-Project-Id: 8bcd8c1dd2504d8088e1ab66cf6ec8d3 Oct 19 03:03:33.007192 n-d-861333-8 devstack@n-api.service[105200]: X-Project-Name: admin Oct 19 03:03:33.007192 n-d-861333-8 devstack@n-api.service[105200]: X-Role: reader,member,admin Oct 19 03:03:33.007192 n-d-861333-8 devstack@n-api.service[105200]: X-Roles: reader,member,admin Oct 19 03:03:33.008677 n-d-861333-8 devstack@n-api.service[105200]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8bcd8c1dd2504d8088e1ab66cf6ec8d3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8bcd8c1dd2504d8088e1ab66cf6ec8d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8bcd8c1dd2504d8088e1ab66cf6ec8d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8bcd8c1dd2504d8088e1ab66cf6ec8d3", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:03:33.008677 n-d-861333-8 devstack@n-api.service[105200]: X-Tenant: admin Oct 19 03:03:33.008677 n-d-861333-8 devstack@n-api.service[105200]: X-Tenant-Id: 8bcd8c1dd2504d8088e1ab66cf6ec8d3 Oct 19 03:03:33.008677 n-d-861333-8 devstack@n-api.service[105200]: X-Tenant-Name: admin Oct 19 03:03:33.008677 n-d-861333-8 devstack@n-api.service[105200]: X-User: admin Oct 19 03:03:33.008677 n-d-861333-8 devstack@n-api.service[105200]: X-User-Domain-Id: default Oct 19 03:03:33.008677 n-d-861333-8 devstack@n-api.service[105200]: X-User-Domain-Name: Default Oct 19 03:03:33.008677 n-d-861333-8 devstack@n-api.service[105200]: X-User-Id: b9b94148a21a4d8dbf5bab64fdf0159c Oct 19 03:03:33.008677 n-d-861333-8 devstack@n-api.service[105200]: X-User-Name: admin Oct 19 03:03:33.008677 n-d-861333-8 devstack@n-api.service[105200]: method: > Oct 19 03:03:33.008677 n-d-861333-8 devstack@n-api.service[105200]: exception: Flavor 84 could not be found. Oct 19 03:03:33.008677 n-d-861333-8 devstack@n-api.service[105200]: action_args: {'id': '84'} Oct 19 03:03:33.008677 n-d-861333-8 devstack@n-api.service[105200]: {{(pid=105200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:03:33.008677 n-d-861333-8 devstack@n-api.service[105200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:03:33.009499 n-d-861333-8 devstack@n-api.service[105200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 19 03:03:33.009499 n-d-861333-8 devstack@n-api.service[105200]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 19 03:03:33.009499 n-d-861333-8 devstack@n-api.service[105200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 19 03:03:33.009499 n-d-861333-8 devstack@n-api.service[105200]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 19 03:03:33.009499 n-d-861333-8 devstack@n-api.service[105200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 03:03:33.009499 n-d-861333-8 devstack@n-api.service[105200]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 03:03:33.009499 n-d-861333-8 devstack@n-api.service[105200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 19 03:03:33.009499 n-d-861333-8 devstack@n-api.service[105200]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 19 03:03:33.009499 n-d-861333-8 devstack@n-api.service[105200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 19 03:03:33.009499 n-d-861333-8 devstack@n-api.service[105200]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:03:33.009499 n-d-861333-8 devstack@n-api.service[105200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 19 03:03:33.009499 n-d-861333-8 devstack@n-api.service[105200]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 19 03:03:33.009499 n-d-861333-8 devstack@n-api.service[105200]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 19 03:03:33.009499 n-d-861333-8 devstack@n-api.service[105200]: ERROR nova.api.openstack.wsgi Oct 19 03:03:33.009499 n-d-861333-8 devstack@n-api.service[105200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:03:33.009499 n-d-861333-8 devstack@n-api.service[105200]: ERROR nova.api.openstack.wsgi Oct 19 03:03:33.009499 n-d-861333-8 devstack@n-api.service[105200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:03:33.009499 n-d-861333-8 devstack@n-api.service[105200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:03:33.009499 n-d-861333-8 devstack@n-api.service[105200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:03:33.011016 n-d-861333-8 devstack@n-api.service[105200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:03:33.011016 n-d-861333-8 devstack@n-api.service[105200]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:03:33.011016 n-d-861333-8 devstack@n-api.service[105200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:03:33.011016 n-d-861333-8 devstack@n-api.service[105200]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:03:33.011016 n-d-861333-8 devstack@n-api.service[105200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 19 03:03:33.011016 n-d-861333-8 devstack@n-api.service[105200]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:03:33.011016 n-d-861333-8 devstack@n-api.service[105200]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 19 03:03:33.011016 n-d-861333-8 devstack@n-api.service[105200]: ERROR nova.api.openstack.wsgi Oct 19 03:03:33.011016 n-d-861333-8 devstack@n-api.service[105200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:03:33.011016 n-d-861333-8 devstack@n-api.service[105200]: ERROR nova.api.openstack.wsgi Oct 19 03:03:33.011016 n-d-861333-8 devstack@n-api.service[105200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:03:33.011016 n-d-861333-8 devstack@n-api.service[105200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:03:33.011016 n-d-861333-8 devstack@n-api.service[105200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:03:33.011016 n-d-861333-8 devstack@n-api.service[105200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:03:33.011016 n-d-861333-8 devstack@n-api.service[105200]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:03:33.011016 n-d-861333-8 devstack@n-api.service[105200]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 19 03:03:33.011016 n-d-861333-8 devstack@n-api.service[105200]: ERROR nova.api.openstack.wsgi Oct 19 03:03:33.011016 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi [None req-044a72fa-dff2-41c9-b607-af71200955ba admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105200) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:03:33.012275 n-d-861333-8 devstack@n-api.service[105200]: INFO nova.api.openstack.requestlog [None req-044a72fa-dff2-41c9-b607-af71200955ba admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.388858 Oct 19 03:03:33.012275 n-d-861333-8 devstack@n-api.service[105200]: [pid: 105200|app: 0|req: 23/44] 10.222.0.52 () {60 vars in 1190 bytes} [Wed Oct 19 03:03:32 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 390 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 19 03:03:33.019455 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi [None req-c3935b00-6886-4e53-9077-d8e586da9224 admin admin] Calling method '>' {{(pid=105199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:03:33.034780 n-d-861333-8 devstack@n-api.service[105199]: INFO nova.api.openstack.requestlog [None req-c3935b00-6886-4e53-9077-d8e586da9224 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019405 Oct 19 03:03:33.035309 n-d-861333-8 devstack@n-api.service[105199]: [pid: 105199|app: 0|req: 22/45] 10.222.0.52 () {60 vars in 1210 bytes} [Wed Oct 19 03:03:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:03:33.044401 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi [None req-bfbd50b3-c567-40d4-95ed-7372fde75811 admin admin] Calling method '>' {{(pid=105200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:03:33.059616 n-d-861333-8 devstack@n-api.service[105200]: INFO nova.api.openstack.requestlog [None req-bfbd50b3-c567-40d4-95ed-7372fde75811 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018656 Oct 19 03:03:33.060135 n-d-861333-8 devstack@n-api.service[105200]: [pid: 105200|app: 0|req: 24/46] 10.222.0.52 () {60 vars in 1210 bytes} [Wed Oct 19 03:03:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:03:33.069458 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi [None req-0c555d38-a37e-40d7-88ac-56235dac1845 admin admin] Calling method '>' {{(pid=105199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:03:33.074597 n-d-861333-8 devstack@n-api.service[105199]: INFO nova.api.openstack.wsgi [None req-0c555d38-a37e-40d7-88ac-56235dac1845 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 19 03:03:33.076103 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi [None req-0c555d38-a37e-40d7-88ac-56235dac1845 admin admin] Request method failure captured: Oct 19 03:03:33.076103 n-d-861333-8 devstack@n-api.service[105199]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 19 03:03:33.076103 n-d-861333-8 devstack@n-api.service[105199]: Accept: application/json Oct 19 03:03:33.076103 n-d-861333-8 devstack@n-api.service[105199]: Accept-Encoding: gzip, deflate Oct 19 03:03:33.076103 n-d-861333-8 devstack@n-api.service[105199]: Connection: keep-alive Oct 19 03:03:33.076103 n-d-861333-8 devstack@n-api.service[105199]: Content-Length: 0 Oct 19 03:03:33.076103 n-d-861333-8 devstack@n-api.service[105199]: Host: 10.222.0.52 Oct 19 03:03:33.076103 n-d-861333-8 devstack@n-api.service[105199]: Openstack-Api-Version: compute 2.92 Oct 19 03:03:33.076103 n-d-861333-8 devstack@n-api.service[105199]: Openstack-System-Scope: None Oct 19 03:03:33.076103 n-d-861333-8 devstack@n-api.service[105199]: User-Agent: python-novaclient Oct 19 03:03:33.076103 n-d-861333-8 devstack@n-api.service[105199]: X-Auth-Token: gAAAAABjT2kEmK4pjuut0e36-68_wYYwvnO691AnSbTHd4mFplxqH64iMbuc_LXi7XxD1NVTGt4ljXlgPZH2WrDuVEi_zZj78yDNqI-ii4qMPktDTToZBIbOhh5ldSTSNnDKKMaU8LmTGuQgkNmG9WPqrXVPVoM_J7oWpimASxQ9DjflY_abz2E Oct 19 03:03:33.076103 n-d-861333-8 devstack@n-api.service[105199]: X-Domain-Id: None Oct 19 03:03:33.076103 n-d-861333-8 devstack@n-api.service[105199]: X-Domain-Name: None Oct 19 03:03:33.076103 n-d-861333-8 devstack@n-api.service[105199]: X-Identity-Status: Confirmed Oct 19 03:03:33.076103 n-d-861333-8 devstack@n-api.service[105199]: X-Is-Admin-Project: True Oct 19 03:03:33.076103 n-d-861333-8 devstack@n-api.service[105199]: X-Openstack-Nova-Api-Version: 2.92 Oct 19 03:03:33.076103 n-d-861333-8 devstack@n-api.service[105199]: X-Project-Domain-Id: default Oct 19 03:03:33.076103 n-d-861333-8 devstack@n-api.service[105199]: X-Project-Domain-Name: Default Oct 19 03:03:33.076103 n-d-861333-8 devstack@n-api.service[105199]: X-Project-Id: 8bcd8c1dd2504d8088e1ab66cf6ec8d3 Oct 19 03:03:33.076103 n-d-861333-8 devstack@n-api.service[105199]: X-Project-Name: admin Oct 19 03:03:33.076103 n-d-861333-8 devstack@n-api.service[105199]: X-Role: reader,member,admin Oct 19 03:03:33.076103 n-d-861333-8 devstack@n-api.service[105199]: X-Roles: reader,member,admin Oct 19 03:03:33.078095 n-d-861333-8 devstack@n-api.service[105199]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8bcd8c1dd2504d8088e1ab66cf6ec8d3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8bcd8c1dd2504d8088e1ab66cf6ec8d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8bcd8c1dd2504d8088e1ab66cf6ec8d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8bcd8c1dd2504d8088e1ab66cf6ec8d3", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:03:33.078095 n-d-861333-8 devstack@n-api.service[105199]: X-Tenant: admin Oct 19 03:03:33.078095 n-d-861333-8 devstack@n-api.service[105199]: X-Tenant-Id: 8bcd8c1dd2504d8088e1ab66cf6ec8d3 Oct 19 03:03:33.078095 n-d-861333-8 devstack@n-api.service[105199]: X-Tenant-Name: admin Oct 19 03:03:33.078095 n-d-861333-8 devstack@n-api.service[105199]: X-User: admin Oct 19 03:03:33.078095 n-d-861333-8 devstack@n-api.service[105199]: X-User-Domain-Id: default Oct 19 03:03:33.078095 n-d-861333-8 devstack@n-api.service[105199]: X-User-Domain-Name: Default Oct 19 03:03:33.078095 n-d-861333-8 devstack@n-api.service[105199]: X-User-Id: b9b94148a21a4d8dbf5bab64fdf0159c Oct 19 03:03:33.078095 n-d-861333-8 devstack@n-api.service[105199]: X-User-Name: admin Oct 19 03:03:33.078095 n-d-861333-8 devstack@n-api.service[105199]: method: > Oct 19 03:03:33.078095 n-d-861333-8 devstack@n-api.service[105199]: exception: Flavor 84 could not be found. Oct 19 03:03:33.078095 n-d-861333-8 devstack@n-api.service[105199]: action_args: {'id': '84'} Oct 19 03:03:33.078095 n-d-861333-8 devstack@n-api.service[105199]: {{(pid=105199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:03:33.078095 n-d-861333-8 devstack@n-api.service[105199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:03:33.078988 n-d-861333-8 devstack@n-api.service[105199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 19 03:03:33.078988 n-d-861333-8 devstack@n-api.service[105199]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 19 03:03:33.078988 n-d-861333-8 devstack@n-api.service[105199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 19 03:03:33.078988 n-d-861333-8 devstack@n-api.service[105199]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 19 03:03:33.078988 n-d-861333-8 devstack@n-api.service[105199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 03:03:33.078988 n-d-861333-8 devstack@n-api.service[105199]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 03:03:33.078988 n-d-861333-8 devstack@n-api.service[105199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 19 03:03:33.078988 n-d-861333-8 devstack@n-api.service[105199]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 19 03:03:33.078988 n-d-861333-8 devstack@n-api.service[105199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 19 03:03:33.078988 n-d-861333-8 devstack@n-api.service[105199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:03:33.078988 n-d-861333-8 devstack@n-api.service[105199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 19 03:03:33.078988 n-d-861333-8 devstack@n-api.service[105199]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 19 03:03:33.078988 n-d-861333-8 devstack@n-api.service[105199]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 19 03:03:33.078988 n-d-861333-8 devstack@n-api.service[105199]: ERROR nova.api.openstack.wsgi Oct 19 03:03:33.078988 n-d-861333-8 devstack@n-api.service[105199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:03:33.078988 n-d-861333-8 devstack@n-api.service[105199]: ERROR nova.api.openstack.wsgi Oct 19 03:03:33.078988 n-d-861333-8 devstack@n-api.service[105199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:03:33.078988 n-d-861333-8 devstack@n-api.service[105199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:03:33.078988 n-d-861333-8 devstack@n-api.service[105199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:03:33.080282 n-d-861333-8 devstack@n-api.service[105199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:03:33.080282 n-d-861333-8 devstack@n-api.service[105199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:03:33.080282 n-d-861333-8 devstack@n-api.service[105199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:03:33.080282 n-d-861333-8 devstack@n-api.service[105199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:03:33.080282 n-d-861333-8 devstack@n-api.service[105199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 19 03:03:33.080282 n-d-861333-8 devstack@n-api.service[105199]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:03:33.080282 n-d-861333-8 devstack@n-api.service[105199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 19 03:03:33.080282 n-d-861333-8 devstack@n-api.service[105199]: ERROR nova.api.openstack.wsgi Oct 19 03:03:33.080282 n-d-861333-8 devstack@n-api.service[105199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:03:33.080282 n-d-861333-8 devstack@n-api.service[105199]: ERROR nova.api.openstack.wsgi Oct 19 03:03:33.080282 n-d-861333-8 devstack@n-api.service[105199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:03:33.080282 n-d-861333-8 devstack@n-api.service[105199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:03:33.080282 n-d-861333-8 devstack@n-api.service[105199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:03:33.080282 n-d-861333-8 devstack@n-api.service[105199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:03:33.080282 n-d-861333-8 devstack@n-api.service[105199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:03:33.080282 n-d-861333-8 devstack@n-api.service[105199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 19 03:03:33.080282 n-d-861333-8 devstack@n-api.service[105199]: ERROR nova.api.openstack.wsgi Oct 19 03:03:33.080282 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi [None req-0c555d38-a37e-40d7-88ac-56235dac1845 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:03:33.081536 n-d-861333-8 devstack@n-api.service[105199]: INFO nova.api.openstack.requestlog [None req-0c555d38-a37e-40d7-88ac-56235dac1845 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.012132 Oct 19 03:03:33.081536 n-d-861333-8 devstack@n-api.service[105199]: [pid: 105199|app: 0|req: 23/47] 10.222.0.52 () {60 vars in 1190 bytes} [Wed Oct 19 03:03:33 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 19 03:03:34.294523 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi [None req-bfbd50b3-c567-40d4-95ed-7372fde75811 admin admin] Calling method '>' {{(pid=105200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:03:34.296183 n-d-861333-8 devstack@n-api.service[105200]: INFO nova.api.openstack.requestlog [None req-bfbd50b3-c567-40d4-95ed-7372fde75811 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Oct 19 03:03:34.296582 n-d-861333-8 devstack@n-api.service[105200]: [pid: 105200|app: 0|req: 25/48] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Oct 19 03:03:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:03:34.816036 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi [None req-f3759ee0-4b25-48e4-9214-fe7a86683135 admin admin] Calling method '>' {{(pid=105199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:03:34.821807 n-d-861333-8 devstack@n-api.service[105199]: INFO nova.api.openstack.wsgi [None req-f3759ee0-4b25-48e4-9214-fe7a86683135 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 19 03:03:34.823309 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi [None req-f3759ee0-4b25-48e4-9214-fe7a86683135 admin admin] Request method failure captured: Oct 19 03:03:34.823309 n-d-861333-8 devstack@n-api.service[105199]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 19 03:03:34.823309 n-d-861333-8 devstack@n-api.service[105199]: Accept: application/json Oct 19 03:03:34.823309 n-d-861333-8 devstack@n-api.service[105199]: Accept-Encoding: gzip, deflate Oct 19 03:03:34.823309 n-d-861333-8 devstack@n-api.service[105199]: Connection: keep-alive Oct 19 03:03:34.823309 n-d-861333-8 devstack@n-api.service[105199]: Content-Length: 0 Oct 19 03:03:34.823309 n-d-861333-8 devstack@n-api.service[105199]: Host: 10.222.0.52 Oct 19 03:03:34.823309 n-d-861333-8 devstack@n-api.service[105199]: Openstack-Api-Version: compute 2.92 Oct 19 03:03:34.823309 n-d-861333-8 devstack@n-api.service[105199]: Openstack-System-Scope: None Oct 19 03:03:34.823309 n-d-861333-8 devstack@n-api.service[105199]: User-Agent: python-novaclient Oct 19 03:03:34.823309 n-d-861333-8 devstack@n-api.service[105199]: X-Auth-Token: gAAAAABjT2kGmRtucyJAn6RWn4R8hxhHJmdd2bmkTUlNpL-Uw1Fbh8zB2vl_gPIwBb_QAhUw1K_50f2P_6X3hrGt5LasZgp4utxyC-wHKiLc0FcEe8fKY3zXURk2yyX3Mat85hWI_ibGqAaFxzkexdznQVTuAN1TurcFyDaY39k3-ap5Jgbhxq8 Oct 19 03:03:34.823309 n-d-861333-8 devstack@n-api.service[105199]: X-Domain-Id: None Oct 19 03:03:34.823309 n-d-861333-8 devstack@n-api.service[105199]: X-Domain-Name: None Oct 19 03:03:34.823309 n-d-861333-8 devstack@n-api.service[105199]: X-Identity-Status: Confirmed Oct 19 03:03:34.823309 n-d-861333-8 devstack@n-api.service[105199]: X-Is-Admin-Project: True Oct 19 03:03:34.823309 n-d-861333-8 devstack@n-api.service[105199]: X-Openstack-Nova-Api-Version: 2.92 Oct 19 03:03:34.823309 n-d-861333-8 devstack@n-api.service[105199]: X-Project-Domain-Id: default Oct 19 03:03:34.823309 n-d-861333-8 devstack@n-api.service[105199]: X-Project-Domain-Name: Default Oct 19 03:03:34.823309 n-d-861333-8 devstack@n-api.service[105199]: X-Project-Id: 8bcd8c1dd2504d8088e1ab66cf6ec8d3 Oct 19 03:03:34.823309 n-d-861333-8 devstack@n-api.service[105199]: X-Project-Name: admin Oct 19 03:03:34.823309 n-d-861333-8 devstack@n-api.service[105199]: X-Role: reader,member,admin Oct 19 03:03:34.823309 n-d-861333-8 devstack@n-api.service[105199]: X-Roles: reader,member,admin Oct 19 03:03:34.824832 n-d-861333-8 devstack@n-api.service[105199]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8bcd8c1dd2504d8088e1ab66cf6ec8d3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8bcd8c1dd2504d8088e1ab66cf6ec8d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8bcd8c1dd2504d8088e1ab66cf6ec8d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8bcd8c1dd2504d8088e1ab66cf6ec8d3", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:03:34.824832 n-d-861333-8 devstack@n-api.service[105199]: X-Tenant: admin Oct 19 03:03:34.824832 n-d-861333-8 devstack@n-api.service[105199]: X-Tenant-Id: 8bcd8c1dd2504d8088e1ab66cf6ec8d3 Oct 19 03:03:34.824832 n-d-861333-8 devstack@n-api.service[105199]: X-Tenant-Name: admin Oct 19 03:03:34.824832 n-d-861333-8 devstack@n-api.service[105199]: X-User: admin Oct 19 03:03:34.824832 n-d-861333-8 devstack@n-api.service[105199]: X-User-Domain-Id: default Oct 19 03:03:34.824832 n-d-861333-8 devstack@n-api.service[105199]: X-User-Domain-Name: Default Oct 19 03:03:34.824832 n-d-861333-8 devstack@n-api.service[105199]: X-User-Id: b9b94148a21a4d8dbf5bab64fdf0159c Oct 19 03:03:34.824832 n-d-861333-8 devstack@n-api.service[105199]: X-User-Name: admin Oct 19 03:03:34.824832 n-d-861333-8 devstack@n-api.service[105199]: method: > Oct 19 03:03:34.824832 n-d-861333-8 devstack@n-api.service[105199]: exception: Flavor 451 could not be found. Oct 19 03:03:34.824832 n-d-861333-8 devstack@n-api.service[105199]: action_args: {'id': '451'} Oct 19 03:03:34.824832 n-d-861333-8 devstack@n-api.service[105199]: {{(pid=105199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:03:34.824832 n-d-861333-8 devstack@n-api.service[105199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:03:34.825720 n-d-861333-8 devstack@n-api.service[105199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 19 03:03:34.825720 n-d-861333-8 devstack@n-api.service[105199]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 19 03:03:34.825720 n-d-861333-8 devstack@n-api.service[105199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 19 03:03:34.825720 n-d-861333-8 devstack@n-api.service[105199]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 19 03:03:34.825720 n-d-861333-8 devstack@n-api.service[105199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 03:03:34.825720 n-d-861333-8 devstack@n-api.service[105199]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 03:03:34.825720 n-d-861333-8 devstack@n-api.service[105199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 19 03:03:34.825720 n-d-861333-8 devstack@n-api.service[105199]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 19 03:03:34.825720 n-d-861333-8 devstack@n-api.service[105199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 19 03:03:34.825720 n-d-861333-8 devstack@n-api.service[105199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:03:34.825720 n-d-861333-8 devstack@n-api.service[105199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 19 03:03:34.825720 n-d-861333-8 devstack@n-api.service[105199]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 19 03:03:34.825720 n-d-861333-8 devstack@n-api.service[105199]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 19 03:03:34.825720 n-d-861333-8 devstack@n-api.service[105199]: ERROR nova.api.openstack.wsgi Oct 19 03:03:34.825720 n-d-861333-8 devstack@n-api.service[105199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:03:34.825720 n-d-861333-8 devstack@n-api.service[105199]: ERROR nova.api.openstack.wsgi Oct 19 03:03:34.825720 n-d-861333-8 devstack@n-api.service[105199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:03:34.825720 n-d-861333-8 devstack@n-api.service[105199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:03:34.825720 n-d-861333-8 devstack@n-api.service[105199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:03:34.827388 n-d-861333-8 devstack@n-api.service[105199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:03:34.827388 n-d-861333-8 devstack@n-api.service[105199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:03:34.827388 n-d-861333-8 devstack@n-api.service[105199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:03:34.827388 n-d-861333-8 devstack@n-api.service[105199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:03:34.827388 n-d-861333-8 devstack@n-api.service[105199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 19 03:03:34.827388 n-d-861333-8 devstack@n-api.service[105199]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:03:34.827388 n-d-861333-8 devstack@n-api.service[105199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 19 03:03:34.827388 n-d-861333-8 devstack@n-api.service[105199]: ERROR nova.api.openstack.wsgi Oct 19 03:03:34.827388 n-d-861333-8 devstack@n-api.service[105199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:03:34.827388 n-d-861333-8 devstack@n-api.service[105199]: ERROR nova.api.openstack.wsgi Oct 19 03:03:34.827388 n-d-861333-8 devstack@n-api.service[105199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:03:34.827388 n-d-861333-8 devstack@n-api.service[105199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:03:34.827388 n-d-861333-8 devstack@n-api.service[105199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:03:34.827388 n-d-861333-8 devstack@n-api.service[105199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:03:34.827388 n-d-861333-8 devstack@n-api.service[105199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:03:34.827388 n-d-861333-8 devstack@n-api.service[105199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 19 03:03:34.827388 n-d-861333-8 devstack@n-api.service[105199]: ERROR nova.api.openstack.wsgi Oct 19 03:03:34.827388 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi [None req-f3759ee0-4b25-48e4-9214-fe7a86683135 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:03:34.828499 n-d-861333-8 devstack@n-api.service[105199]: INFO nova.api.openstack.requestlog [None req-f3759ee0-4b25-48e4-9214-fe7a86683135 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.391720 Oct 19 03:03:34.828499 n-d-861333-8 devstack@n-api.service[105199]: [pid: 105199|app: 0|req: 24/49] 10.222.0.52 () {60 vars in 1193 bytes} [Wed Oct 19 03:03:34 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 393 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 19 03:03:34.834887 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi [None req-3862071f-3407-47fe-a972-6dee0305d37b admin admin] Calling method '>' {{(pid=105200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:03:34.850456 n-d-861333-8 devstack@n-api.service[105200]: INFO nova.api.openstack.requestlog [None req-3862071f-3407-47fe-a972-6dee0305d37b admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019120 Oct 19 03:03:34.850981 n-d-861333-8 devstack@n-api.service[105200]: [pid: 105200|app: 0|req: 26/50] 10.222.0.52 () {60 vars in 1210 bytes} [Wed Oct 19 03:03:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:03:34.860679 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi [None req-147485fa-2d81-4a3b-8354-e62d3511cfe9 admin admin] Calling method '>' {{(pid=105199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:03:34.875530 n-d-861333-8 devstack@n-api.service[105199]: INFO nova.api.openstack.requestlog [None req-147485fa-2d81-4a3b-8354-e62d3511cfe9 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018885 Oct 19 03:03:34.876055 n-d-861333-8 devstack@n-api.service[105199]: [pid: 105199|app: 0|req: 25/51] 10.222.0.52 () {60 vars in 1210 bytes} [Wed Oct 19 03:03:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:03:34.885082 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi [None req-7a7f34dc-faa7-42c2-8843-602a5e517436 admin admin] Calling method '>' {{(pid=105200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:03:34.890069 n-d-861333-8 devstack@n-api.service[105200]: INFO nova.api.openstack.wsgi [None req-7a7f34dc-faa7-42c2-8843-602a5e517436 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 19 03:03:34.891573 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi [None req-7a7f34dc-faa7-42c2-8843-602a5e517436 admin admin] Request method failure captured: Oct 19 03:03:34.891573 n-d-861333-8 devstack@n-api.service[105200]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 19 03:03:34.891573 n-d-861333-8 devstack@n-api.service[105200]: Accept: application/json Oct 19 03:03:34.891573 n-d-861333-8 devstack@n-api.service[105200]: Accept-Encoding: gzip, deflate Oct 19 03:03:34.891573 n-d-861333-8 devstack@n-api.service[105200]: Connection: keep-alive Oct 19 03:03:34.891573 n-d-861333-8 devstack@n-api.service[105200]: Content-Length: 0 Oct 19 03:03:34.891573 n-d-861333-8 devstack@n-api.service[105200]: Host: 10.222.0.52 Oct 19 03:03:34.891573 n-d-861333-8 devstack@n-api.service[105200]: Openstack-Api-Version: compute 2.92 Oct 19 03:03:34.891573 n-d-861333-8 devstack@n-api.service[105200]: Openstack-System-Scope: None Oct 19 03:03:34.891573 n-d-861333-8 devstack@n-api.service[105200]: User-Agent: python-novaclient Oct 19 03:03:34.891573 n-d-861333-8 devstack@n-api.service[105200]: X-Auth-Token: gAAAAABjT2kGmRtucyJAn6RWn4R8hxhHJmdd2bmkTUlNpL-Uw1Fbh8zB2vl_gPIwBb_QAhUw1K_50f2P_6X3hrGt5LasZgp4utxyC-wHKiLc0FcEe8fKY3zXURk2yyX3Mat85hWI_ibGqAaFxzkexdznQVTuAN1TurcFyDaY39k3-ap5Jgbhxq8 Oct 19 03:03:34.891573 n-d-861333-8 devstack@n-api.service[105200]: X-Domain-Id: None Oct 19 03:03:34.891573 n-d-861333-8 devstack@n-api.service[105200]: X-Domain-Name: None Oct 19 03:03:34.891573 n-d-861333-8 devstack@n-api.service[105200]: X-Identity-Status: Confirmed Oct 19 03:03:34.891573 n-d-861333-8 devstack@n-api.service[105200]: X-Is-Admin-Project: True Oct 19 03:03:34.891573 n-d-861333-8 devstack@n-api.service[105200]: X-Openstack-Nova-Api-Version: 2.92 Oct 19 03:03:34.891573 n-d-861333-8 devstack@n-api.service[105200]: X-Project-Domain-Id: default Oct 19 03:03:34.891573 n-d-861333-8 devstack@n-api.service[105200]: X-Project-Domain-Name: Default Oct 19 03:03:34.891573 n-d-861333-8 devstack@n-api.service[105200]: X-Project-Id: 8bcd8c1dd2504d8088e1ab66cf6ec8d3 Oct 19 03:03:34.891573 n-d-861333-8 devstack@n-api.service[105200]: X-Project-Name: admin Oct 19 03:03:34.891573 n-d-861333-8 devstack@n-api.service[105200]: X-Role: reader,member,admin Oct 19 03:03:34.891573 n-d-861333-8 devstack@n-api.service[105200]: X-Roles: reader,member,admin Oct 19 03:03:34.893138 n-d-861333-8 devstack@n-api.service[105200]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8bcd8c1dd2504d8088e1ab66cf6ec8d3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8bcd8c1dd2504d8088e1ab66cf6ec8d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8bcd8c1dd2504d8088e1ab66cf6ec8d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8bcd8c1dd2504d8088e1ab66cf6ec8d3", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:03:34.893138 n-d-861333-8 devstack@n-api.service[105200]: X-Tenant: admin Oct 19 03:03:34.893138 n-d-861333-8 devstack@n-api.service[105200]: X-Tenant-Id: 8bcd8c1dd2504d8088e1ab66cf6ec8d3 Oct 19 03:03:34.893138 n-d-861333-8 devstack@n-api.service[105200]: X-Tenant-Name: admin Oct 19 03:03:34.893138 n-d-861333-8 devstack@n-api.service[105200]: X-User: admin Oct 19 03:03:34.893138 n-d-861333-8 devstack@n-api.service[105200]: X-User-Domain-Id: default Oct 19 03:03:34.893138 n-d-861333-8 devstack@n-api.service[105200]: X-User-Domain-Name: Default Oct 19 03:03:34.893138 n-d-861333-8 devstack@n-api.service[105200]: X-User-Id: b9b94148a21a4d8dbf5bab64fdf0159c Oct 19 03:03:34.893138 n-d-861333-8 devstack@n-api.service[105200]: X-User-Name: admin Oct 19 03:03:34.893138 n-d-861333-8 devstack@n-api.service[105200]: method: > Oct 19 03:03:34.893138 n-d-861333-8 devstack@n-api.service[105200]: exception: Flavor 451 could not be found. Oct 19 03:03:34.893138 n-d-861333-8 devstack@n-api.service[105200]: action_args: {'id': '451'} Oct 19 03:03:34.893138 n-d-861333-8 devstack@n-api.service[105200]: {{(pid=105200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:03:34.893138 n-d-861333-8 devstack@n-api.service[105200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:03:34.894402 n-d-861333-8 devstack@n-api.service[105200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 19 03:03:34.894402 n-d-861333-8 devstack@n-api.service[105200]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 19 03:03:34.894402 n-d-861333-8 devstack@n-api.service[105200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 19 03:03:34.894402 n-d-861333-8 devstack@n-api.service[105200]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 19 03:03:34.894402 n-d-861333-8 devstack@n-api.service[105200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 03:03:34.894402 n-d-861333-8 devstack@n-api.service[105200]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 03:03:34.894402 n-d-861333-8 devstack@n-api.service[105200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 19 03:03:34.894402 n-d-861333-8 devstack@n-api.service[105200]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 19 03:03:34.894402 n-d-861333-8 devstack@n-api.service[105200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 19 03:03:34.894402 n-d-861333-8 devstack@n-api.service[105200]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:03:34.894402 n-d-861333-8 devstack@n-api.service[105200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 19 03:03:34.894402 n-d-861333-8 devstack@n-api.service[105200]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 19 03:03:34.894402 n-d-861333-8 devstack@n-api.service[105200]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 19 03:03:34.894402 n-d-861333-8 devstack@n-api.service[105200]: ERROR nova.api.openstack.wsgi Oct 19 03:03:34.894402 n-d-861333-8 devstack@n-api.service[105200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:03:34.894402 n-d-861333-8 devstack@n-api.service[105200]: ERROR nova.api.openstack.wsgi Oct 19 03:03:34.894402 n-d-861333-8 devstack@n-api.service[105200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:03:34.894402 n-d-861333-8 devstack@n-api.service[105200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:03:34.894402 n-d-861333-8 devstack@n-api.service[105200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:03:34.895765 n-d-861333-8 devstack@n-api.service[105200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:03:34.895765 n-d-861333-8 devstack@n-api.service[105200]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:03:34.895765 n-d-861333-8 devstack@n-api.service[105200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:03:34.895765 n-d-861333-8 devstack@n-api.service[105200]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:03:34.895765 n-d-861333-8 devstack@n-api.service[105200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 19 03:03:34.895765 n-d-861333-8 devstack@n-api.service[105200]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:03:34.895765 n-d-861333-8 devstack@n-api.service[105200]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 19 03:03:34.895765 n-d-861333-8 devstack@n-api.service[105200]: ERROR nova.api.openstack.wsgi Oct 19 03:03:34.895765 n-d-861333-8 devstack@n-api.service[105200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:03:34.895765 n-d-861333-8 devstack@n-api.service[105200]: ERROR nova.api.openstack.wsgi Oct 19 03:03:34.895765 n-d-861333-8 devstack@n-api.service[105200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:03:34.895765 n-d-861333-8 devstack@n-api.service[105200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:03:34.895765 n-d-861333-8 devstack@n-api.service[105200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:03:34.895765 n-d-861333-8 devstack@n-api.service[105200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:03:34.895765 n-d-861333-8 devstack@n-api.service[105200]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:03:34.895765 n-d-861333-8 devstack@n-api.service[105200]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 19 03:03:34.895765 n-d-861333-8 devstack@n-api.service[105200]: ERROR nova.api.openstack.wsgi Oct 19 03:03:34.895765 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi [None req-7a7f34dc-faa7-42c2-8843-602a5e517436 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105200) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:03:34.897011 n-d-861333-8 devstack@n-api.service[105200]: INFO nova.api.openstack.requestlog [None req-7a7f34dc-faa7-42c2-8843-602a5e517436 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011461 Oct 19 03:03:34.897011 n-d-861333-8 devstack@n-api.service[105200]: [pid: 105200|app: 0|req: 27/52] 10.222.0.52 () {60 vars in 1193 bytes} [Wed Oct 19 03:03:34 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 19 03:03:36.106273 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi [None req-147485fa-2d81-4a3b-8354-e62d3511cfe9 admin admin] Calling method '>' {{(pid=105199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:03:36.107335 n-d-861333-8 devstack@n-api.service[105199]: INFO nova.api.openstack.requestlog [None req-147485fa-2d81-4a3b-8354-e62d3511cfe9 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Oct 19 03:03:36.107735 n-d-861333-8 devstack@n-api.service[105199]: [pid: 105199|app: 0|req: 26/53] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Oct 19 03:03:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:03:36.625579 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi [None req-50fc55b1-b0f1-4006-880c-90fe8054f40f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:03:36.729111 n-d-861333-8 devstack@n-api.service[105200]: INFO nova.api.openstack.requestlog [None req-50fc55b1-b0f1-4006-880c-90fe8054f40f admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.483245 Oct 19 03:03:36.729690 n-d-861333-8 devstack@n-api.service[105200]: [pid: 105200|app: 0|req: 28/54] 10.222.0.52 () {64 vars in 1235 bytes} [Wed Oct 19 03:03:36 2022] POST /compute/v2.1/flavors => generated 404 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 03:03:37.943606 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi [None req-147485fa-2d81-4a3b-8354-e62d3511cfe9 admin admin] Calling method '>' {{(pid=105199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:03:37.944635 n-d-861333-8 devstack@n-api.service[105199]: INFO nova.api.openstack.requestlog [None req-147485fa-2d81-4a3b-8354-e62d3511cfe9 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Oct 19 03:03:37.945039 n-d-861333-8 devstack@n-api.service[105199]: [pid: 105199|app: 0|req: 27/55] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Oct 19 03:03:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:03:38.459544 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi [None req-0f557f5a-19cd-4e21-9bde-d48fcc515da7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:03:38.533580 n-d-861333-8 devstack@n-api.service[105200]: INFO nova.api.openstack.requestlog [None req-0f557f5a-19cd-4e21-9bde-d48fcc515da7 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.449131 Oct 19 03:03:38.534125 n-d-861333-8 devstack@n-api.service[105200]: [pid: 105200|app: 0|req: 29/56] 10.222.0.52 () {64 vars in 1235 bytes} [Wed Oct 19 03:03:38 2022] POST /compute/v2.1/flavors => generated 405 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 03:03:39.744062 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi [None req-147485fa-2d81-4a3b-8354-e62d3511cfe9 admin admin] Calling method '>' {{(pid=105199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:03:39.745086 n-d-861333-8 devstack@n-api.service[105199]: INFO nova.api.openstack.requestlog [None req-147485fa-2d81-4a3b-8354-e62d3511cfe9 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Oct 19 03:03:39.745604 n-d-861333-8 devstack@n-api.service[105199]: [pid: 105199|app: 0|req: 28/57] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Oct 19 03:03:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:03:40.268570 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi [None req-7c2d5bed-66a8-4461-b450-fe97b010ca89 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:03:40.330361 n-d-861333-8 devstack@n-api.service[105200]: INFO nova.api.openstack.requestlog [None req-7c2d5bed-66a8-4461-b450-fe97b010ca89 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.448530 Oct 19 03:03:40.330839 n-d-861333-8 devstack@n-api.service[105200]: [pid: 105200|app: 0|req: 30/58] 10.222.0.52 () {64 vars in 1235 bytes} [Wed Oct 19 03:03:39 2022] POST /compute/v2.1/flavors => generated 407 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 03:03:41.540278 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi [None req-147485fa-2d81-4a3b-8354-e62d3511cfe9 admin admin] Calling method '>' {{(pid=105199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:03:41.541313 n-d-861333-8 devstack@n-api.service[105199]: INFO nova.api.openstack.requestlog [None req-147485fa-2d81-4a3b-8354-e62d3511cfe9 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Oct 19 03:03:41.541746 n-d-861333-8 devstack@n-api.service[105199]: [pid: 105199|app: 0|req: 29/59] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Oct 19 03:03:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:03:42.061256 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi [None req-74874727-0a1b-4251-b39b-b441e2eacd57 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:03:42.161498 n-d-861333-8 devstack@n-api.service[105200]: INFO nova.api.openstack.requestlog [None req-74874727-0a1b-4251-b39b-b441e2eacd57 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.482969 Oct 19 03:03:42.162076 n-d-861333-8 devstack@n-api.service[105200]: [pid: 105200|app: 0|req: 31/60] 10.222.0.52 () {64 vars in 1235 bytes} [Wed Oct 19 03:03:41 2022] POST /compute/v2.1/flavors => generated 409 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 03:03:43.373455 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi [None req-147485fa-2d81-4a3b-8354-e62d3511cfe9 admin admin] Calling method '>' {{(pid=105199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:03:43.374488 n-d-861333-8 devstack@n-api.service[105199]: INFO nova.api.openstack.requestlog [None req-147485fa-2d81-4a3b-8354-e62d3511cfe9 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001510 Oct 19 03:03:43.374896 n-d-861333-8 devstack@n-api.service[105199]: [pid: 105199|app: 0|req: 30/61] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Oct 19 03:03:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:03:43.890213 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi [None req-f92104bb-3641-4e14-a240-1dd8497aff2e admin admin] Calling method '>' {{(pid=105200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:03:43.910599 n-d-861333-8 devstack@n-api.service[105200]: INFO nova.api.openstack.requestlog [None req-f92104bb-3641-4e14-a240-1dd8497aff2e admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.400252 Oct 19 03:03:43.911139 n-d-861333-8 devstack@n-api.service[105200]: [pid: 105200|app: 0|req: 32/62] 10.222.0.52 () {60 vars in 1202 bytes} [Wed Oct 19 03:03:43 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:04:40.427286 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi [None req-147485fa-2d81-4a3b-8354-e62d3511cfe9 admin admin] Calling method '>' {{(pid=105199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:04:40.428323 n-d-861333-8 devstack@n-api.service[105199]: INFO nova.api.openstack.requestlog [None req-147485fa-2d81-4a3b-8354-e62d3511cfe9 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Oct 19 03:04:40.428729 n-d-861333-8 devstack@n-api.service[105199]: [pid: 105199|app: 0|req: 31/63] 10.222.0.52 () {54 vars in 931 bytes} [Wed Oct 19 03:04:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:04:40.439067 n-d-861333-8 devstack@n-api.service[105200]: DEBUG dbcounter [-] [105200] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=105200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:04:40.818108 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi [None req-232d488a-126f-4485-ab01-5f363594f7e1 admin admin] Calling method '>' {{(pid=105200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:04:40.838940 n-d-861333-8 devstack@n-api.service[105200]: INFO nova.api.openstack.requestlog [None req-232d488a-126f-4485-ab01-5f363594f7e1 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.404310 Oct 19 03:04:40.839475 n-d-861333-8 devstack@n-api.service[105200]: [pid: 105200|app: 0|req: 33/64] 10.222.0.52 () {60 vars in 1292 bytes} [Wed Oct 19 03:04:40 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:04:40.861771 n-d-861333-8 devstack@n-api.service[105199]: DEBUG dbcounter [-] [105199] Writing DB stats nova_api:SELECT=14 {{(pid=105199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:04:40.865542 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi [None req-568141e3-63ee-464c-a9b9-f6d2981298dc admin admin] Calling method '>' {{(pid=105199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:04:40.872993 n-d-861333-8 devstack@n-api.service[105199]: INFO nova.api.openstack.requestlog [None req-568141e3-63ee-464c-a9b9-f6d2981298dc admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012706 Oct 19 03:04:40.873572 n-d-861333-8 devstack@n-api.service[105199]: [pid: 105199|app: 0|req: 32/65] 10.222.0.52 () {60 vars in 1283 bytes} [Wed Oct 19 03:04:40 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:04:40.885101 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi [None req-6f399d8f-e6e6-4a5b-88fc-1d846441d11c admin admin] Calling method '>' {{(pid=105200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:04:40.892348 n-d-861333-8 devstack@n-api.service[105200]: INFO nova.api.openstack.requestlog [None req-6f399d8f-e6e6-4a5b-88fc-1d846441d11c admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010817 Oct 19 03:04:40.892869 n-d-861333-8 devstack@n-api.service[105200]: [pid: 105200|app: 0|req: 34/66] 10.222.0.52 () {60 vars in 1286 bytes} [Wed Oct 19 03:04:40 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:04:40.904654 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi [None req-3f306ab3-6790-4a9d-a42c-5dc5c0dcd6ec admin admin] Calling method '>' {{(pid=105199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:04:40.912211 n-d-861333-8 devstack@n-api.service[105199]: INFO nova.api.openstack.requestlog [None req-3f306ab3-6790-4a9d-a42c-5dc5c0dcd6ec admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011539 Oct 19 03:04:40.912727 n-d-861333-8 devstack@n-api.service[105199]: [pid: 105199|app: 0|req: 33/67] 10.222.0.52 () {60 vars in 1286 bytes} [Wed Oct 19 03:04:40 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:04:40.924552 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi [None req-6d1a73f8-74fb-4ff4-9280-824c355bacb4 admin admin] Calling method '>' {{(pid=105200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:04:40.931559 n-d-861333-8 devstack@n-api.service[105200]: INFO nova.api.openstack.requestlog [None req-6d1a73f8-74fb-4ff4-9280-824c355bacb4 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010586 Oct 19 03:04:40.932070 n-d-861333-8 devstack@n-api.service[105200]: [pid: 105200|app: 0|req: 35/68] 10.222.0.52 () {60 vars in 1283 bytes} [Wed Oct 19 03:04:40 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:10:40.666458 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi [None req-3f306ab3-6790-4a9d-a42c-5dc5c0dcd6ec admin admin] Calling method '>' {{(pid=105199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:10:40.667482 n-d-861333-8 devstack@n-api.service[105199]: INFO nova.api.openstack.requestlog [None req-3f306ab3-6790-4a9d-a42c-5dc5c0dcd6ec admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Oct 19 03:10:40.667879 n-d-861333-8 devstack@n-api.service[105199]: [pid: 105199|app: 0|req: 34/69] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Oct 19 03:10:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:10:40.809289 n-d-861333-8 devstack@n-api.service[105200]: DEBUG dbcounter [-] [105200] Writing DB stats nova_api:SELECT=6 {{(pid=105200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:10:40.952465 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi [None req-3a36b1d7-2604-43cf-aaa1-9d55a37bcd39 admin admin] Calling method '>' {{(pid=105200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:10:40.957820 n-d-861333-8 devstack@n-api.service[105200]: DEBUG oslo_concurrency.lockutils [None req-3a36b1d7-2604-43cf-aaa1-9d55a37bcd39 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:10:40.959457 n-d-861333-8 devstack@n-api.service[105200]: DEBUG oslo_concurrency.lockutils [None req-3a36b1d7-2604-43cf-aaa1-9d55a37bcd39 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:10:40.959457 n-d-861333-8 devstack@n-api.service[105200]: DEBUG oslo_concurrency.lockutils [None req-3a36b1d7-2604-43cf-aaa1-9d55a37bcd39 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:10:40.959457 n-d-861333-8 devstack@n-api.service[105200]: DEBUG oslo_concurrency.lockutils [None req-3a36b1d7-2604-43cf-aaa1-9d55a37bcd39 admin admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:10:40.959850 n-d-861333-8 devstack@n-api.service[105200]: DEBUG oslo_concurrency.lockutils [None req-3a36b1d7-2604-43cf-aaa1-9d55a37bcd39 admin admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:10:40.960269 n-d-861333-8 devstack@n-api.service[105200]: DEBUG oslo_concurrency.lockutils [None req-3a36b1d7-2604-43cf-aaa1-9d55a37bcd39 admin admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:10:40.997952 n-d-861333-8 devstack@n-api.service[105200]: INFO nova.api.openstack.requestlog [None req-3a36b1d7-2604-43cf-aaa1-9d55a37bcd39 admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.189757 Oct 19 03:10:40.998503 n-d-861333-8 devstack@n-api.service[105200]: [pid: 105200|app: 0|req: 36/70] 10.222.0.52 () {60 vars in 1193 bytes} [Wed Oct 19 03:10:40 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:10:42.073894 n-d-861333-8 devstack@n-api.service[105199]: DEBUG nova.api.openstack.wsgi [None req-3f306ab3-6790-4a9d-a42c-5dc5c0dcd6ec admin admin] Calling method '>' {{(pid=105199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:10:42.074981 n-d-861333-8 devstack@n-api.service[105199]: INFO nova.api.openstack.requestlog [None req-3f306ab3-6790-4a9d-a42c-5dc5c0dcd6ec admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001595 Oct 19 03:10:42.075376 n-d-861333-8 devstack@n-api.service[105199]: [pid: 105199|app: 0|req: 35/71] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Oct 19 03:10:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:10:42.266092 n-d-861333-8 devstack@n-api.service[105200]: DEBUG nova.api.openstack.wsgi [None req-29045759-4a11-4130-9dd6-132aa1a977c2 admin admin] Calling method '>' {{(pid=105200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:10:42.270176 n-d-861333-8 devstack@n-api.service[105200]: DEBUG oslo_concurrency.lockutils [None req-29045759-4a11-4130-9dd6-132aa1a977c2 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:10:42.270683 n-d-861333-8 devstack@n-api.service[105200]: DEBUG oslo_concurrency.lockutils [None req-29045759-4a11-4130-9dd6-132aa1a977c2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:10:42.271115 n-d-861333-8 devstack@n-api.service[105200]: DEBUG oslo_concurrency.lockutils [None req-29045759-4a11-4130-9dd6-132aa1a977c2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:10:42.271841 n-d-861333-8 devstack@n-api.service[105200]: DEBUG oslo_concurrency.lockutils [None req-29045759-4a11-4130-9dd6-132aa1a977c2 admin admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:10:42.272283 n-d-861333-8 devstack@n-api.service[105200]: DEBUG oslo_concurrency.lockutils [None req-29045759-4a11-4130-9dd6-132aa1a977c2 admin admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:10:42.272697 n-d-861333-8 devstack@n-api.service[105200]: DEBUG oslo_concurrency.lockutils [None req-29045759-4a11-4130-9dd6-132aa1a977c2 admin admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:10:42.295281 n-d-861333-8 devstack@n-api.service[105200]: INFO nova.api.openstack.requestlog [None req-29045759-4a11-4130-9dd6-132aa1a977c2 admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.082397 Oct 19 03:10:42.295769 n-d-861333-8 devstack@n-api.service[105200]: [pid: 105200|app: 0|req: 37/72] 10.222.0.52 () {60 vars in 1193 bytes} [Wed Oct 19 03:10:42 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:11:27.523793 n-d-861333-8 devstack@n-api.service[105198]: Wed Oct 19 03:11:27 2022 - graceful shutdown triggered... Oct 19 03:11:27.524342 n-d-861333-8 devstack@n-api.service[105199]: Gracefully killing worker 1 (pid: 105199)... Oct 19 03:11:27.523917 n-d-861333-8 systemd[1]: Stopping Devstack devstack@n-api.service... Oct 19 03:11:27.526196 n-d-861333-8 devstack@n-api.service[105200]: Gracefully killing worker 2 (pid: 105200)... Oct 19 03:11:27.655448 n-d-861333-8 devstack@n-api.service[105199]: DEBUG dbcounter [-] [105199] Writing DB stats nova_api:SELECT=4 {{(pid=105199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:11:28.524925 n-d-861333-8 devstack@n-api.service[105198]: worker 1 buried after 1 seconds Oct 19 03:11:28.524925 n-d-861333-8 devstack@n-api.service[105198]: worker 2 buried after 1 seconds Oct 19 03:11:28.524925 n-d-861333-8 devstack@n-api.service[105198]: goodbye to uWSGI. Oct 19 03:11:28.526522 n-d-861333-8 systemd[1]: devstack@n-api.service: Succeeded. Oct 19 03:11:28.527095 n-d-861333-8 systemd[1]: Stopped Devstack devstack@n-api.service. Oct 19 03:11:28.529920 n-d-861333-8 systemd[1]: Starting Devstack devstack@n-api.service... Oct 19 03:11:28.546303 n-d-861333-8 devstack@n-api.service[121122]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 19 03:11:28.561154 n-d-861333-8 devstack@n-api.service[121122]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Oct 19 03:11:28 2022] *** Oct 19 03:11:28.561154 n-d-861333-8 devstack@n-api.service[121122]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 19 03:11:28.561154 n-d-861333-8 devstack@n-api.service[121122]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 19 03:11:28.561154 n-d-861333-8 devstack@n-api.service[121122]: nodename: n-d-861333-8 Oct 19 03:11:28.561154 n-d-861333-8 devstack@n-api.service[121122]: machine: x86_64 Oct 19 03:11:28.561154 n-d-861333-8 devstack@n-api.service[121122]: clock source: unix Oct 19 03:11:28.561154 n-d-861333-8 devstack@n-api.service[121122]: pcre jit disabled Oct 19 03:11:28.561154 n-d-861333-8 devstack@n-api.service[121122]: detected number of CPU cores: 4 Oct 19 03:11:28.561154 n-d-861333-8 devstack@n-api.service[121122]: current working directory: / Oct 19 03:11:28.561154 n-d-861333-8 devstack@n-api.service[121122]: detected binary path: /usr/bin/uwsgi-core Oct 19 03:11:28.561154 n-d-861333-8 devstack@n-api.service[121122]: your processes number limit is 47680 Oct 19 03:11:28.561964 n-d-861333-8 devstack@n-api.service[121122]: your memory page size is 4096 bytes Oct 19 03:11:28.561964 n-d-861333-8 devstack@n-api.service[121122]: detected max file descriptor number: 2048 Oct 19 03:11:28.561964 n-d-861333-8 devstack@n-api.service[121122]: lock engine: pthread robust mutexes Oct 19 03:11:28.561964 n-d-861333-8 devstack@n-api.service[121122]: thunder lock: enabled Oct 19 03:11:28.561964 n-d-861333-8 devstack@n-api.service[121122]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 19 03:11:28.561964 n-d-861333-8 devstack@n-api.service[121122]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 19 03:11:28.604166 n-d-861333-8 devstack@n-api.service[121122]: Python main interpreter initialized at 0x55bc148699c0 Oct 19 03:11:28.604166 n-d-861333-8 devstack@n-api.service[121122]: python threads support enabled Oct 19 03:11:28.604166 n-d-861333-8 devstack@n-api.service[121122]: your server socket listen backlog is limited to 100 connections Oct 19 03:11:28.604166 n-d-861333-8 devstack@n-api.service[121122]: your mercy for graceful operations on workers is 90 seconds Oct 19 03:11:28.604638 n-d-861333-8 devstack@n-api.service[121122]: mapped 403077 bytes (393 KB) for 2 cores Oct 19 03:11:28.604638 n-d-861333-8 devstack@n-api.service[121122]: *** Operational MODE: preforking *** Oct 19 03:11:28.604905 n-d-861333-8 devstack@n-api.service[121122]: *** uWSGI is running in multiple interpreter mode *** Oct 19 03:11:28.604905 n-d-861333-8 devstack@n-api.service[121122]: spawned uWSGI master process (pid: 121122) Oct 19 03:11:28.605108 n-d-861333-8 systemd[1]: Started Devstack devstack@n-api.service. Oct 19 03:11:28.605743 n-d-861333-8 devstack@n-api.service[121122]: spawned uWSGI worker 1 (pid: 121134, cores: 1) Oct 19 03:11:28.606105 n-d-861333-8 devstack@n-api.service[121122]: spawned uWSGI worker 2 (pid: 121135, cores: 1) Oct 19 03:11:28.606262 n-d-861333-8 devstack@n-api.service[121122]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 19 03:11:29.268724 n-d-861333-8 devstack@n-api.service[121135]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 19 03:11:29.270501 n-d-861333-8 devstack@n-api.service[121134]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 19 03:11:30.427983 n-d-861333-8 devstack@n-api.service[121135]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 19 03:11:30.427983 n-d-861333-8 devstack@n-api.service[121135]: from cryptography.utils import int_from_bytes Oct 19 03:11:30.428628 n-d-861333-8 devstack@n-api.service[121135]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 19 03:11:30.428628 n-d-861333-8 devstack@n-api.service[121135]: from cryptography.utils import int_from_bytes Oct 19 03:11:30.438137 n-d-861333-8 devstack@n-api.service[121134]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 19 03:11:30.438137 n-d-861333-8 devstack@n-api.service[121134]: from cryptography.utils import int_from_bytes Oct 19 03:11:30.438684 n-d-861333-8 devstack@n-api.service[121134]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 19 03:11:30.438684 n-d-861333-8 devstack@n-api.service[121134]: from cryptography.utils import int_from_bytes Oct 19 03:11:32.834253 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 19 03:11:32.834821 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 19 03:11:32.835062 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 19 03:11:32.835435 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 19 03:11:32.835694 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 19 03:11:32.836091 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.836423 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.836751 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.837232 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.837601 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.837923 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.838258 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.838585 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.838920 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.839185 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.839513 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.839843 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-861333-8 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.840170 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.840484 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.840801 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.841138 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.841464 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.841795 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.842106 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.842616 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.843073 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.843388 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.843823 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.844050 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.844374 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.844689 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.845018 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.845330 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.845690 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.846045 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.846457 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-861333-8 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.846779 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.847098 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.847414 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.847837 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.848153 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.848468 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.848796 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.849127 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.849461 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.849816 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.850142 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.850467 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.850792 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.851106 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.851421 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.851735 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.852063 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.852374 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.852684 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.852940 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.853254 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.853606 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.853934 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.854041 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 19 03:11:32.854467 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 19 03:11:32.854548 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.854548 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.854728 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 19 03:11:32.854909 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.855065 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.855172 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 19 03:11:32.855333 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 19 03:11:32.855460 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.855693 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.855799 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.856004 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.856108 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.856314 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.856416 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.856626 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.856800 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.856933 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.857136 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.857244 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.857497 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.857620 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.857829 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.857921 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.858154 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.858255 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.858486 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.858587 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.858751 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.858844 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.859079 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.859192 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.859398 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-861333-8 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.859505 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.859742 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.859850 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.860035 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.860126 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.860351 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.860455 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.860672 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.860773 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.860981 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.861072 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.861306 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.861465 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.862167 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.862285 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.862494 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.862993 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.863100 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.863175 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.863256 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.863334 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.863418 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.863592 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.863833 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.863995 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.864130 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.864262 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.864409 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.864549 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.864689 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.864821 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.864951 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.865126 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.865239 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.865481 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.865631 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.865776 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.865916 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.866113 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.866257 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-861333-8 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.866426 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.866520 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.866732 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.866835 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.867044 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.867136 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.867352 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.867490 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.867663 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.867807 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.867974 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.868120 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.868284 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.868445 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.868595 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.868772 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.868902 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.869085 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.869243 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.869571 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.869708 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.869887 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.870291 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.870442 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.870953 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.871086 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.871211 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.871331 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.871450 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.871568 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.871769 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.871905 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.872038 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.872184 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.872411 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.872544 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.872658 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.872776 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.872887 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.873007 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.873127 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.873257 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.873407 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.880509 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.880682 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.880841 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.880988 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.881136 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.881271 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.881551 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.881651 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.881724 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.881724 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.881904 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.881989 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.882079 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.882079 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.882246 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.882246 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.882621 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.882621 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.882791 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.882882 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.882977 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.883062 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.883155 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.883240 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.883322 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.883405 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.883501 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.883592 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.883676 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.883757 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.883840 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.883922 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.884018 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.884104 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.884192 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.884285 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.884375 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.884470 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.884564 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.884660 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.884797 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.884937 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.885077 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.885223 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.885363 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.885510 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.885595 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.885762 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.885859 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.885993 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.886136 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.886234 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.886319 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.886425 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.886766 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.886992 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.887090 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.887175 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.887259 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.887342 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.887433 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.887610 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.887707 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.887792 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.887884 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.887970 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.888115 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.888247 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.888378 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.888515 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.888612 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.888697 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.888790 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.888876 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.889020 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.889110 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.889201 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.889293 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.889412 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.889512 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.889598 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.889687 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.889772 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.889855 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.889954 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.890040 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.890131 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.890258 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.890403 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.890510 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.890598 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.890681 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.890772 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.890856 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.890960 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.891063 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.891200 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.891313 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.891424 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.891535 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.891646 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.891765 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.891879 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.891988 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.892106 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.892225 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.892345 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.892452 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.892570 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.892723 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.892816 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.892968 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.893078 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.893171 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.893255 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.893347 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.893347 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.897807 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.897902 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.898000 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.898097 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.898196 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.898365 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.898510 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.898600 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.898733 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.898823 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.898929 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.899016 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.899100 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.899183 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.899274 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.899358 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.899451 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.899536 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.899625 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.899711 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.899810 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.899909 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.899995 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.900088 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.900173 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.900257 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.900348 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.900481 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.900627 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.900726 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.900812 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.900951 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.901041 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.901133 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.901216 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.901313 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.901416 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.901513 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.901599 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.901683 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.901775 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.901868 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.901952 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.902050 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.902136 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.902228 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.902411 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.902515 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.902644 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.902765 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.902904 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.903036 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.903134 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.903227 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.903312 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.903395 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.903485 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 03:11:32.903579 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.903672 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.903758 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.903840 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.903931 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.904021 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.904115 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.904115 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.904277 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.904361 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.904444 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.904535 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.904631 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.904722 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.904806 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.904896 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.904980 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.905070 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.905167 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.905266 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.905362 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.905501 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.905593 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.905688 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.905773 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.905856 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.905990 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.906086 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.906171 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.906263 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.906348 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.906450 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.906543 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.906635 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.906720 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.906811 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.907011 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.907128 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.907340 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.907454 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.907654 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.907762 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.907979 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.908073 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.908445 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.908620 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.908768 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.908854 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.908999 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.909098 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.909302 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.909431 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.909641 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.909786 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.909953 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.910093 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.910265 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.910410 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.910582 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.910731 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.910892 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.911042 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.911202 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.911359 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.911517 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.911676 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.911820 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.912025 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.912126 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.912344 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.912438 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.912666 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.912759 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.912989 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.913096 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.913307 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.913423 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.913650 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.913742 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.913968 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.914059 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.914953 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.915110 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.915209 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.915303 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.915303 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.915468 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.915566 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.915651 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.915734 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.915824 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.915915 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.916012 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.916216 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.916312 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.916538 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.916629 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.916856 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.916956 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.917175 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.917274 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.917539 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.917653 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.917828 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.917936 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.918147 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.918240 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.918457 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.918549 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.918769 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.918870 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.919080 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.919176 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.919401 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.919540 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.919727 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.919829 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.920040 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.920141 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.920364 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.920482 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.920712 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.920809 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.921054 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.921154 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.921392 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.921500 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.921727 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.921829 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.922046 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.922138 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.922363 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.922456 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.922676 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.922770 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.922993 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.923084 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.923311 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.923412 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.923624 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.923717 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.923946 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.924045 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.924774 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.924930 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.925088 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.925223 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.925430 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.925527 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.925765 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.925874 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.926081 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.926226 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.926404 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.926496 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.926713 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.926813 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.927036 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.927134 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.927376 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.927476 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.927718 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.927821 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.928037 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.928137 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.928358 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.928458 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.928689 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.928792 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.929006 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.929101 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.929321 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.929447 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.929667 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.929769 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.929983 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.930083 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.930297 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.930396 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.930616 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.930726 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.930942 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.931065 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.931283 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.931429 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.931581 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.931714 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.931895 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.932029 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.932206 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.932358 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.932524 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.932667 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.932834 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.932979 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.933143 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.933292 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.933480 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.933627 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.933792 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.933927 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.934103 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.934238 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.934432 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.934604 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.934762 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.934903 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.935104 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.935235 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.935395 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.935501 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.935726 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.935819 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.936045 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.936151 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.936358 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.936450 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.936670 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.936768 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.936982 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.937076 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.937333 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.937961 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.938095 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.938197 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.938297 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.938383 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.938466 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.938549 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.938633 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.938807 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.938951 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.939178 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.939292 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.939437 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.939569 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.939801 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.940498 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.940623 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.940716 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.940943 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.941044 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.941275 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.941396 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.941619 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.941713 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.941952 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.942045 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.942271 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.942372 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.943071 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.943183 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.943326 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.943478 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.943579 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.943721 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.943854 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.943993 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.944142 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.944372 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.944479 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.944575 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.944661 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.944746 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.944829 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.944922 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.945164 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.945318 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.945505 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.945691 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.945826 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.946019 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.946144 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.946350 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.946491 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.946705 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.946845 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.947033 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.947135 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.947372 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.947480 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.947685 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.947801 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.948017 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.948111 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.948329 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.948436 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.948647 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.948743 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.948956 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.949053 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.949264 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.949434 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.949608 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.949759 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.949922 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.950074 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.950233 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.950394 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.950544 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.950715 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.950859 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.951045 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.951168 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.951363 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.951461 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.951679 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.951778 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.951997 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.952151 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.952310 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.952403 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.952624 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.952717 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.952943 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.953044 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.953267 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.953379 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.953617 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.953708 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.955206 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.955342 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.955454 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.955542 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.955634 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.955727 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.955819 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.955912 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.956004 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.956089 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.956180 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.956266 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.956362 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.956462 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.956550 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.956633 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.956724 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.956827 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.956925 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.957018 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.957109 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.957282 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.957418 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.957520 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.957689 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.957784 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.957999 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.958092 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.958307 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.958411 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.958625 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.958729 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.958941 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.959043 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.959252 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.959399 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.959570 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.959665 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.959888 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.959996 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.960200 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.960309 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.960516 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.960616 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.960846 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.960993 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.961145 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.961308 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.961482 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.961661 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.961805 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.961984 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.962129 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.962304 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.962441 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.962635 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.962735 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.962957 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.963062 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.963274 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.963368 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.963595 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.963744 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.963921 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.964063 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.964240 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.964334 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.964561 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.964683 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.964876 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.964996 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.965236 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.965343 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.965529 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.965653 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.965846 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.965949 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.966161 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.966341 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.966469 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.966564 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.966795 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.966893 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.967108 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.967380 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.967474 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.967715 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.967815 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.968031 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.968172 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.968340 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.968441 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.968649 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.968786 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.968965 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.969070 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.969295 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.969424 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.969644 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.969739 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.972431 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.972523 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.972674 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.972769 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.972861 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.972952 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.973091 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.973180 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.973274 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.973394 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.973496 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.973582 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.973680 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.973775 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.973920 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.974010 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.974102 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.974194 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.974285 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.974379 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.974465 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.974548 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.974655 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.974878 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.974974 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.975074 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.975161 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.975245 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.975380 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.975478 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.975564 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.975660 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.975747 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.975837 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.975931 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.976015 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.976113 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.976206 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.976291 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.976374 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.976465 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.976556 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.976660 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.976754 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.976828 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.976908 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.976987 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.977192 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.977425 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.977530 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.977656 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.977866 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.977980 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.978300 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.978420 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.978617 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.978710 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.978929 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.979029 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.979241 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.979342 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.979571 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.979718 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.979883 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.979976 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.980196 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.980291 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.980506 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.980604 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.980824 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.980924 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.981140 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.981233 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.981475 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.981583 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.981791 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.981882 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.982106 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.982213 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.982416 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.982505 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.982813 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.982973 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.983222 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.983357 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.983448 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.983534 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.983645 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.983754 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.984063 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.984305 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.984533 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.984677 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.984766 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.984886 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.984974 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.985058 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.985286 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.985424 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.985627 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.985735 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.985939 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.986033 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.986259 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.986365 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.987065 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.987176 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.987394 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.987489 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.987712 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.987813 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.988024 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.988124 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.988345 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.988451 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.988654 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.988755 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.988977 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.989097 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.989287 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.989455 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.989646 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.989787 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.989966 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.990067 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.990278 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.990382 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.990588 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.990690 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.990904 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.991004 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.991213 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.991312 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.991588 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.991713 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.991839 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.992005 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.992169 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.992325 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.992492 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.992645 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.992823 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.992995 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.993108 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.993249 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.993444 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.993586 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.993759 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.993904 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.994076 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.994234 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.994390 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.994546 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.994698 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.994852 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.995007 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.995152 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.995322 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.995484 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.995631 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.995793 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.995939 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.996120 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.996268 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.996545 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.996646 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.996862 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.996965 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.997173 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.997265 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:32.997515 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.000723 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.000855 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.000992 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.001092 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.001234 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.001332 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.001460 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.001556 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.001655 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.001741 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.001825 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.001917 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.002044 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.002145 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.002887 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.002993 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.003088 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.003174 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.003265 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.003359 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.003455 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.003455 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.003704 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.003798 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.003890 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.003984 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.004078 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.004164 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.004291 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.004392 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.004479 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.004578 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.004665 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.004757 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.004849 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.004849 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.005067 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.005162 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.005248 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.005331 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.005561 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.005670 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.005758 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.005857 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.005945 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.006037 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.006132 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.006224 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.006310 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.006408 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.006494 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.006494 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.006655 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.006746 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.006832 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.006925 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.007004 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.007220 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.007315 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.007536 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.007745 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.007869 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.008012 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.008155 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.008250 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.008476 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.008616 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.008770 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.008871 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.009083 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.009175 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.009410 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.009524 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.009743 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.009835 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.010058 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.010160 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.010371 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.010471 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.010688 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.010784 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.010996 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.011101 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.011326 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.011427 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.011907 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.011999 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.012220 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.012354 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.012533 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.012675 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.012850 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.012995 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.013201 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.013295 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.013537 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.013644 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.013865 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.013960 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.014202 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.014304 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.014536 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.014633 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.014853 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.014946 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.015195 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.015297 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.015527 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.015675 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.015852 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.015944 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.016169 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.016271 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.016481 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.016580 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.016792 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.016893 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.017108 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.017201 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.017442 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.017595 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.017761 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.017904 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.018097 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.018191 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.018405 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.018498 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.018715 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.018819 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.019029 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.019122 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.019336 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.019430 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.019644 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.019752 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.019952 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.020053 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.020280 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.020426 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.020574 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.020777 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.020902 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.021097 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.021200 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.021506 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.021629 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.021839 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.021941 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.022827 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.023016 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.023190 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.023357 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.023493 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.023595 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.023690 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.023783 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.023876 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.023876 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.024078 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.024396 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.024717 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.025039 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.025360 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.025547 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.025703 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.025994 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.026117 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.026329 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.026459 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.026748 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.026891 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.027007 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.027218 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.027340 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.027716 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.027848 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.028002 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.028175 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.028377 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.028527 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.028753 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.028889 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.029105 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.029199 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.029490 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.029604 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.029810 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.029929 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.030127 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.030379 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.030473 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.030748 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.030888 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.031064 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.031211 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.031400 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.031540 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.031720 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.031840 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.032041 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.032163 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.032384 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.032594 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.032710 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.032920 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.033036 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.033256 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.033357 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.033631 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.033732 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.033956 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.034071 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.034391 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.034506 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.034701 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.034802 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.035021 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.035115 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.035343 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.035507 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.035665 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.035868 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.035983 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.036182 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.036298 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.036517 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.036620 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.036870 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.036972 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.037203 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.037296 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.037556 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.037665 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.037868 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.037962 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.038187 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.038291 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.038507 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.038606 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.038847 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.038994 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.039173 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.039275 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.039484 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.039583 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.039802 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.039895 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.040127 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.040230 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.040560 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.040662 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.040958 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.041098 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.041297 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.041423 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.041657 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.041766 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.041988 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.042082 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.042313 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.042410 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.042637 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.042733 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.042976 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.043075 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.043300 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.043395 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.043653 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.043753 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.043971 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.044071 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.044287 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.044381 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.044597 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.044699 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.044924 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.045104 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.045239 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.045401 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.045567 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.045715 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.045917 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.046065 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.046236 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.046341 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.046568 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.046799 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.046923 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.047159 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.047283 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.047484 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.047615 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.047817 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.047939 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.048147 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.048269 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.048457 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.048586 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.048766 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.048898 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.049674 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.049809 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.049943 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.050071 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.050239 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.050380 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.050563 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.050694 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.051196 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.051348 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.051440 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.051541 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.051747 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.051883 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.052050 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.052153 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.052367 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.052535 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.052678 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.052859 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.052996 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.053182 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.053313 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.053615 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.053853 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.053975 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.054170 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.054302 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.054479 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.054610 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.054797 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.054964 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.055286 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.055681 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.055785 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.055915 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.056250 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.056561 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.056934 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.057047 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.057148 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.057237 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.057505 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.057644 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.057840 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.057948 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.058159 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.058253 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.058514 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.058607 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.058829 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.058938 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.059140 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.059253 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.059468 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.059562 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.059776 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.059879 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.060085 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.060186 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.060407 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.060507 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.060723 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.060830 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.061049 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.061228 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.061396 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.061603 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.061732 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.061932 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.062026 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.062255 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.062348 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.062579 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.062886 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.063034 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.063227 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.063321 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.063561 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.063739 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.063889 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.063982 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.064209 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.064302 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.064523 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.064669 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.065433 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.065628 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.065723 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.065952 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.066054 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.066274 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.066369 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.066657 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.066752 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.066977 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.067081 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.067292 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.067387 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.067608 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.067758 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.067925 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.068029 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.068242 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.068343 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.068557 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.068651 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.068871 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.068978 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.069187 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.069362 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.069528 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.069624 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.069843 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.069951 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.070158 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.070252 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.070474 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.070680 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.070836 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.071000 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.071139 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.071425 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.071531 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.071685 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.071837 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.072015 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.072153 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.072338 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.072440 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.072661 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.072769 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.072988 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.073170 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.073275 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.073415 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.073620 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.073717 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.073943 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.074037 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.074280 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.074383 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.074601 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.074703 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.074914 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.075008 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.075275 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.075376 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.075584 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.075686 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.075906 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.076009 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.076248 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.076380 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.076567 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.076867 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.076964 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.077204 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.077324 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.077556 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.077687 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.077881 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.077990 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.078197 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.078293 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.078520 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.078622 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.078831 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.078925 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.079159 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.079251 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.079499 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.079613 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.079806 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.079901 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.080116 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.080219 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.080449 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.080546 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.080759 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.080867 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.081071 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.081199 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.081399 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.081504 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.081711 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.081839 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.082015 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.082140 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.082330 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.082503 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.082655 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.082808 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.082959 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.083118 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.083264 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.083409 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.083560 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.083705 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.083855 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.084000 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.084149 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.084305 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.084456 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.084600 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.084770 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.084913 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.085084 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.085226 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.085381 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.085489 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.085652 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.085743 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.085959 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.086041 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.086277 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.086361 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.086587 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.086681 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.086914 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.086998 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.087227 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.087320 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.087535 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.087624 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.087873 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.087956 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.088201 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.088297 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.088510 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.088599 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.088816 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.088898 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.089132 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.089224 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.089549 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.089657 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.089805 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.089889 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.090121 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.090211 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.090436 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.090519 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.090753 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.090835 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.091072 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.091167 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.091411 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.092488 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.092647 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.092741 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.092839 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.092969 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.093083 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.093225 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.093317 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.093317 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.093498 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.093498 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.093667 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.093752 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.093877 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.093991 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.094167 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.094267 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.094354 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.094511 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.094613 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.094831 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.094961 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.095156 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.095260 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.095469 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.095573 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.095783 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.095879 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.096124 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.096220 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.096439 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.096533 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.096752 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.096847 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.097063 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.097156 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.097426 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.097537 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.097727 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.097858 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.098051 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.098147 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.098363 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.098468 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.098700 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.098837 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.099020 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.099150 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.099375 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.099482 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.099712 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.100039 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.100141 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.100356 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.100466 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.100687 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.100781 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.101055 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.101199 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.101383 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.101531 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.101711 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.101850 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.102037 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.102132 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.102350 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.102637 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.102776 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.102917 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.103017 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.103113 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.103308 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.103441 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.103620 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 19 03:11:33.103751 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.104099 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.104431 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.105023 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.105352 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.105703 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.106039 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.106364 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.106680 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.107003 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.107316 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.107647 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.107990 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.108317 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.108643 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.108950 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.109263 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.109592 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.109907 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.110228 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.110540 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.110847 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.111169 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.111463 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.112284 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.112597 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.112904 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.113207 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.113610 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.113915 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.114224 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.114531 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.114838 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.115145 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.115449 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.115761 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.116064 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.116369 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.116672 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.116978 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.117282 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.117640 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.117978 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.118297 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.118622 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.118935 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.119260 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.119575 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.119900 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.120222 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.120588 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.120852 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.121189 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.121527 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.121842 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.122155 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.122470 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.122783 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.123124 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.123457 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.123786 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.124095 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.124423 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.124741 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.125060 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.125454 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.125711 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.126043 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.126356 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.126669 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.126981 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.127892 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.128210 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.128529 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.128841 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.129172 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.129513 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.129839 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.130169 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.130510 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.130824 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.131151 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.131479 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.131828 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.132139 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.132488 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.132845 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.133386 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.133877 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.134384 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 03:11:33.134806 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 19 03:11:33.168137 n-d-861333-8 devstack@n-api.service[121135]: INFO dbcounter [None req-07ffed50-4cb3-42d5-be66-6c38b018f2b1 None None] Registered counter for database nova_api Oct 19 03:11:33.189068 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_db.sqlalchemy.engines [None req-07ffed50-4cb3-42d5-be66-6c38b018f2b1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121135) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 03:11:33.196656 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writer thread running {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 03:11:33.199011 n-d-861333-8 devstack@n-api.service[121134]: INFO dbcounter [None req-f185c0ba-eb1f-47b3-853a-784e5b9d837b None None] Registered counter for database nova_api Oct 19 03:11:33.220542 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_db.sqlalchemy.engines [None req-f185c0ba-eb1f-47b3-853a-784e5b9d837b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121134) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 03:11:33.229888 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writer thread running {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 03:11:33.253817 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.context [None req-07ffed50-4cb3-42d5-be66-6c38b018f2b1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d204a9a6-30d3-4569-8922-0d4cbe966b78(cell1) {{(pid=121135) load_cells /opt/stack/nova/nova/context.py:464}} Oct 19 03:11:33.257926 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-07ffed50-4cb3-42d5-be66-6c38b018f2b1 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:11:33.258410 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-07ffed50-4cb3-42d5-be66-6c38b018f2b1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:11:33.259983 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-07ffed50-4cb3-42d5-be66-6c38b018f2b1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:11:33.260726 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-07ffed50-4cb3-42d5-be66-6c38b018f2b1 None None] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:11:33.261176 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-07ffed50-4cb3-42d5-be66-6c38b018f2b1 None None] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:11:33.263471 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-07ffed50-4cb3-42d5-be66-6c38b018f2b1 None None] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:11:33.265520 n-d-861333-8 devstack@n-api.service[121135]: INFO dbcounter [None req-07ffed50-4cb3-42d5-be66-6c38b018f2b1 None None] Registered counter for database nova_cell0 Oct 19 03:11:33.269688 n-d-861333-8 devstack@n-api.service[121135]: INFO dbcounter [None req-07ffed50-4cb3-42d5-be66-6c38b018f2b1 None None] Registered counter for database nova_cell1 Oct 19 03:11:33.277308 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_db.sqlalchemy.engines [None req-07ffed50-4cb3-42d5-be66-6c38b018f2b1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121135) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 03:11:33.280675 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_db.sqlalchemy.engines [None req-07ffed50-4cb3-42d5-be66-6c38b018f2b1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121135) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 03:11:33.284161 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writer thread running {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 03:11:33.288903 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.context [None req-f185c0ba-eb1f-47b3-853a-784e5b9d837b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d204a9a6-30d3-4569-8922-0d4cbe966b78(cell1) {{(pid=121134) load_cells /opt/stack/nova/nova/context.py:464}} Oct 19 03:11:33.292981 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f185c0ba-eb1f-47b3-853a-784e5b9d837b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:11:33.293507 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f185c0ba-eb1f-47b3-853a-784e5b9d837b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:11:33.295086 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f185c0ba-eb1f-47b3-853a-784e5b9d837b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:11:33.295841 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f185c0ba-eb1f-47b3-853a-784e5b9d837b None None] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:11:33.296297 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f185c0ba-eb1f-47b3-853a-784e5b9d837b None None] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:11:33.298345 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f185c0ba-eb1f-47b3-853a-784e5b9d837b None None] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:11:33.300955 n-d-861333-8 devstack@n-api.service[121134]: INFO dbcounter [None req-f185c0ba-eb1f-47b3-853a-784e5b9d837b None None] Registered counter for database nova_cell0 Oct 19 03:11:33.305431 n-d-861333-8 devstack@n-api.service[121134]: INFO dbcounter [None req-f185c0ba-eb1f-47b3-853a-784e5b9d837b None None] Registered counter for database nova_cell1 Oct 19 03:11:33.312896 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_db.sqlalchemy.engines [None req-f185c0ba-eb1f-47b3-853a-784e5b9d837b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121134) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 03:11:33.315422 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_db.sqlalchemy.engines [None req-f185c0ba-eb1f-47b3-853a-784e5b9d837b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121134) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 03:11:33.322642 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writer thread running {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 03:11:33.323968 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writer thread running {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 03:11:33.428994 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writer thread running {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 03:11:33.439534 n-d-861333-8 devstack@n-api.service[121135]: INFO dbcounter [None req-07ffed50-4cb3-42d5-be66-6c38b018f2b1 None None] Registered counter for database nova_cell0 Oct 19 03:11:33.448306 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_db.sqlalchemy.engines [None req-07ffed50-4cb3-42d5-be66-6c38b018f2b1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121135) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 03:11:33.453130 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writer thread running {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 03:11:33.494338 n-d-861333-8 devstack@n-api.service[121134]: INFO dbcounter [None req-f185c0ba-eb1f-47b3-853a-784e5b9d837b None None] Registered counter for database nova_cell0 Oct 19 03:11:33.503923 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_db.sqlalchemy.engines [None req-f185c0ba-eb1f-47b3-853a-784e5b9d837b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121134) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 03:11:33.510491 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writer thread running {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 03:11:33.804277 n-d-861333-8 devstack@n-api.service[121135]: WARNING keystonemiddleware.auth_token [None req-07ffed50-4cb3-42d5-be66-6c38b018f2b1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 19 03:11:33.812098 n-d-861333-8 devstack@n-api.service[121135]: WARNING keystonemiddleware.auth_token [None req-07ffed50-4cb3-42d5-be66-6c38b018f2b1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 19 03:11:33.833295 n-d-861333-8 devstack@n-api.service[121134]: WARNING keystonemiddleware.auth_token [None req-f185c0ba-eb1f-47b3-853a-784e5b9d837b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 19 03:11:33.840664 n-d-861333-8 devstack@n-api.service[121134]: WARNING keystonemiddleware.auth_token [None req-f185c0ba-eb1f-47b3-853a-784e5b9d837b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 19 03:11:34.158065 n-d-861333-8 devstack@n-api.service[121135]: WARNING keystonemiddleware.auth_token [None req-07ffed50-4cb3-42d5-be66-6c38b018f2b1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 19 03:11:34.164672 n-d-861333-8 devstack@n-api.service[121135]: WARNING keystonemiddleware.auth_token [None req-07ffed50-4cb3-42d5-be66-6c38b018f2b1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 19 03:11:34.170008 n-d-861333-8 devstack@n-api.service[121135]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55bc148699c0 pid: 121135 (default app) Oct 19 03:11:34.185555 n-d-861333-8 devstack@n-api.service[121134]: WARNING keystonemiddleware.auth_token [None req-f185c0ba-eb1f-47b3-853a-784e5b9d837b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 19 03:11:34.191659 n-d-861333-8 devstack@n-api.service[121134]: WARNING keystonemiddleware.auth_token [None req-f185c0ba-eb1f-47b3-853a-784e5b9d837b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 19 03:11:34.196951 n-d-861333-8 devstack@n-api.service[121134]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55bc148699c0 pid: 121134 (default app) Oct 19 03:12:17.621346 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=3 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:12:17.622277 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=3 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:12:17.623184 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=3 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:12:17.624141 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=3 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:12:17.766030 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=3 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:12:17.767611 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=3 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:12:17.768440 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=3 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:12:17.769181 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=3 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:12:18.792770 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0f838475-b255-4b3b-adb0-08074d424150 tempest-AZAdminV2TestJSON-880622491 tempest-AZAdminV2TestJSON-880622491-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:18.794572 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0f838475-b255-4b3b-adb0-08074d424150 tempest-AZAdminV2TestJSON-880622491 tempest-AZAdminV2TestJSON-880622491-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:18.794963 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0f838475-b255-4b3b-adb0-08074d424150 tempest-AZAdminV2TestJSON-880622491 tempest-AZAdminV2TestJSON-880622491-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:18.795392 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0f838475-b255-4b3b-adb0-08074d424150 tempest-AZAdminV2TestJSON-880622491 tempest-AZAdminV2TestJSON-880622491-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:18.796112 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0f838475-b255-4b3b-adb0-08074d424150 tempest-AZAdminV2TestJSON-880622491 tempest-AZAdminV2TestJSON-880622491-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:18.797095 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0f838475-b255-4b3b-adb0-08074d424150 tempest-AZAdminV2TestJSON-880622491 tempest-AZAdminV2TestJSON-880622491-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:18.797551 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0f838475-b255-4b3b-adb0-08074d424150 tempest-AZAdminV2TestJSON-880622491 tempest-AZAdminV2TestJSON-880622491-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:18.807074 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a804105b-ad58-4bce-8dc8-290d87ca2455 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1380255956", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:12:18.839247 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0f838475-b255-4b3b-adb0-08074d424150 tempest-AZAdminV2TestJSON-880622491 tempest-AZAdminV2TestJSON-880622491-project-admin] 10.222.0.52 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 1.223091 Oct 19 03:12:18.839827 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1/1] 10.222.0.52 () {58 vars in 1164 bytes} [Wed Oct 19 03:12:17 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 03:12:18.953059 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e1de34c2-2d45-4400-a9a2-3a3ba699dee5 tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:18.958686 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e1de34c2-2d45-4400-a9a2-3a3ba699dee5 tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:18.959301 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e1de34c2-2d45-4400-a9a2-3a3ba699dee5 tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:18.959745 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e1de34c2-2d45-4400-a9a2-3a3ba699dee5 tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:18.960506 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e1de34c2-2d45-4400-a9a2-3a3ba699dee5 tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:18.960960 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e1de34c2-2d45-4400-a9a2-3a3ba699dee5 tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:18.961392 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e1de34c2-2d45-4400-a9a2-3a3ba699dee5 tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:18.992277 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e1de34c2-2d45-4400-a9a2-3a3ba699dee5 tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.151318 Oct 19 03:12:18.993157 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2/2] 10.222.0.52 () {58 vars in 1176 bytes} [Wed Oct 19 03:12:18 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:12:19.157338 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-260ea199-9ca0-4387-b978-82bcc9d1ea78 tempest-AggregatesAdminTestV241-1151926969 tempest-AggregatesAdminTestV241-1151926969-project-admin] Calling method '.version_select at 0x7fc132720820>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:19.165555 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-260ea199-9ca0-4387-b978-82bcc9d1ea78 tempest-AggregatesAdminTestV241-1151926969 tempest-AggregatesAdminTestV241-1151926969-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d204a9a6-30d3-4569-8922-0d4cbe966b78(cell1) {{(pid=121135) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 19 03:12:19.166490 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-260ea199-9ca0-4387-b978-82bcc9d1ea78 tempest-AggregatesAdminTestV241-1151926969 tempest-AggregatesAdminTestV241-1151926969-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:19.167154 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-260ea199-9ca0-4387-b978-82bcc9d1ea78 tempest-AggregatesAdminTestV241-1151926969 tempest-AggregatesAdminTestV241-1151926969-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:19.167593 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-260ea199-9ca0-4387-b978-82bcc9d1ea78 tempest-AggregatesAdminTestV241-1151926969 tempest-AggregatesAdminTestV241-1151926969-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:19.194166 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-260ea199-9ca0-4387-b978-82bcc9d1ea78 tempest-AggregatesAdminTestV241-1151926969 tempest-AggregatesAdminTestV241-1151926969-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:19.194661 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-260ea199-9ca0-4387-b978-82bcc9d1ea78 tempest-AggregatesAdminTestV241-1151926969 tempest-AggregatesAdminTestV241-1151926969-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:19.195112 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-260ea199-9ca0-4387-b978-82bcc9d1ea78 tempest-AggregatesAdminTestV241-1151926969 tempest-AggregatesAdminTestV241-1151926969-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:19.207994 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-260ea199-9ca0-4387-b978-82bcc9d1ea78 tempest-AggregatesAdminTestV241-1151926969 tempest-AggregatesAdminTestV241-1151926969-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:19.208800 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-260ea199-9ca0-4387-b978-82bcc9d1ea78 tempest-AggregatesAdminTestV241-1151926969 tempest-AggregatesAdminTestV241-1151926969-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:19.209012 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-260ea199-9ca0-4387-b978-82bcc9d1ea78 tempest-AggregatesAdminTestV241-1151926969 tempest-AggregatesAdminTestV241-1151926969-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:19.216077 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-260ea199-9ca0-4387-b978-82bcc9d1ea78 tempest-AggregatesAdminTestV241-1151926969 tempest-AggregatesAdminTestV241-1151926969-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 0.222087 Oct 19 03:12:19.216643 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3/3] 10.222.0.52 () {60 vars in 1208 bytes} [Wed Oct 19 03:12:18 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:12:19.252503 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-a804105b-ad58-4bce-8dc8-290d87ca2455 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] validate_networks() for None {{(pid=121134) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:12:19.331619 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-321cb3d7-97e7-4518-b356-6ceff70fff5f tempest-AZAdminNegativeTestJSON-528310158 tempest-AZAdminNegativeTestJSON-528310158-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:19.333119 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-321cb3d7-97e7-4518-b356-6ceff70fff5f tempest-AZAdminNegativeTestJSON-528310158 tempest-AZAdminNegativeTestJSON-528310158-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '5c452db24e144922b94acfaab82ab33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ffc9f63e2d4d819aa629de63f0e0ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:12:19.336625 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-321cb3d7-97e7-4518-b356-6ceff70fff5f tempest-AZAdminNegativeTestJSON-528310158 tempest-AZAdminNegativeTestJSON-528310158-project] Request method failure captured: Oct 19 03:12:19.336625 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Oct 19 03:12:19.336625 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:12:19.336625 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:12:19.336625 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:12:19.336625 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:12:19.336625 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:12:19.336625 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:12:19.336625 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:12:19.336625 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:12:19.336625 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2sPezuZTXVWgaQncG712aQqA-ryDRtJBaQg-gS6nVl8UJn7xL7RwVjPLhne1oHEdZ1p-NmidHwwcIUpqgr63FGiazqwck60TA4K2YrIACRTeGaaLu0nHEP4TMVY-Vz3mC9v4rDs-PtchCVIeQ24QJiy6-fcgjznkvSrY6UCavDFOfY Oct 19 03:12:19.336625 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:12:19.336625 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:12:19.336625 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:12:19.336625 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:12:19.336625 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:12:19.336625 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:12:19.336625 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 16ffc9f63e2d4d819aa629de63f0e0ca Oct 19 03:12:19.336625 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-AZAdminNegativeTestJSON-528310158 Oct 19 03:12:19.336625 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:12:19.336625 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:12:19.337687 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/16ffc9f63e2d4d819aa629de63f0e0ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/16ffc9f63e2d4d819aa629de63f0e0ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/16ffc9f63e2d4d819aa629de63f0e0ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_16ffc9f63e2d4d819aa629de63f0e0ca", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:12:19.337687 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-AZAdminNegativeTestJSON-528310158 Oct 19 03:12:19.337687 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 16ffc9f63e2d4d819aa629de63f0e0ca Oct 19 03:12:19.337687 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-528310158 Oct 19 03:12:19.337687 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-AZAdminNegativeTestJSON-528310158-project Oct 19 03:12:19.337687 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:12:19.337687 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:12:19.337687 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 5c452db24e144922b94acfaab82ab33d Oct 19 03:12:19.337687 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-AZAdminNegativeTestJSON-528310158-project Oct 19 03:12:19.337687 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:12:19.337687 n-d-861333-8 devstack@n-api.service[121135]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 19 03:12:19.337687 n-d-861333-8 devstack@n-api.service[121135]: action_args: {} Oct 19 03:12:19.338235 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:12:19.338235 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:12:19.338235 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:12:19.338235 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:12:19.338235 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:12:19.338235 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:12:19.338235 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:12:19.338235 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:12:19.338235 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Oct 19 03:12:19.338235 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Oct 19 03:12:19.338235 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 19 03:12:19.338235 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 19 03:12:19.338235 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 19 03:12:19.338235 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 19 03:12:19.338235 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 03:12:19.338235 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 03:12:19.338235 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 03:12:19.338235 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 03:12:19.338235 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 19 03:12:19.339069 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 19 03:12:19.339069 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 19 03:12:19.339069 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 19 03:12:19.339069 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 19 03:12:19.339069 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 19 03:12:19.339069 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 19 03:12:19.339069 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:12:19.339069 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:12:19.339069 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:12:19.339069 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:12:19.339069 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:12:19.339069 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:12:19.339069 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 19 03:12:19.339069 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 19 03:12:19.339069 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 19 03:12:19.339069 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:12:19.339069 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-321cb3d7-97e7-4518-b356-6ceff70fff5f tempest-AZAdminNegativeTestJSON-528310158 tempest-AZAdminNegativeTestJSON-528310158-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:12:19.339901 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-321cb3d7-97e7-4518-b356-6ceff70fff5f tempest-AZAdminNegativeTestJSON-528310158 tempest-AZAdminNegativeTestJSON-528310158-project] 10.222.0.52 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.121534 Oct 19 03:12:19.339901 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 4/4] 10.222.0.52 () {58 vars in 1185 bytes} [Wed Oct 19 03:12:19 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 122 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:12:19.560767 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-a804105b-ad58-4bce-8dc8-290d87ca2455 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Flavor limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:12:19.561188 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-a804105b-ad58-4bce-8dc8-290d87ca2455 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Image limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:12:19.561687 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-a804105b-ad58-4bce-8dc8-290d87ca2455 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Flavor pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:12:19.562093 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-a804105b-ad58-4bce-8dc8-290d87ca2455 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Image pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:12:19.562600 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-a804105b-ad58-4bce-8dc8-290d87ca2455 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:12:19.578938 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a804105b-ad58-4bce-8dc8-290d87ca2455 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:19.580049 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a804105b-ad58-4bce-8dc8-290d87ca2455 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:19.580495 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a804105b-ad58-4bce-8dc8-290d87ca2455 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:19.581391 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a804105b-ad58-4bce-8dc8-290d87ca2455 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:19.581863 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a804105b-ad58-4bce-8dc8-290d87ca2455 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:19.582301 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a804105b-ad58-4bce-8dc8-290d87ca2455 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:19.613798 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-a804105b-ad58-4bce-8dc8-290d87ca2455 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Getting quotas for project 31ead65f008349329789135966c031d0. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:12:19.619772 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-a804105b-ad58-4bce-8dc8-290d87ca2455 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Getting quotas for user 769928c8ecb643fa83a9d58465dcb263 and project 31ead65f008349329789135966c031d0. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:12:19.630752 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a804105b-ad58-4bce-8dc8-290d87ca2455 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Going to run 1 instances... {{(pid=121134) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:12:19.633771 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a804105b-ad58-4bce-8dc8-290d87ca2455 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] [instance: 7a48466f-9d33-480f-b67a-21777e03d4d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:12:19.656620 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-42790bb1-ff9d-4ebc-b82a-d0c2a530818d tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] Calling method '.version_select at 0x7fc13309eee0>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:19.659835 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-42790bb1-ff9d-4ebc-b82a-d0c2a530818d tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:19.659835 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-42790bb1-ff9d-4ebc-b82a-d0c2a530818d tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:19.659835 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-42790bb1-ff9d-4ebc-b82a-d0c2a530818d tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:19.677038 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-42790bb1-ff9d-4ebc-b82a-d0c2a530818d tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:19.677567 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-42790bb1-ff9d-4ebc-b82a-d0c2a530818d tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:19.678433 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-42790bb1-ff9d-4ebc-b82a-d0c2a530818d tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:19.690865 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-42790bb1-ff9d-4ebc-b82a-d0c2a530818d tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:19.691364 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-42790bb1-ff9d-4ebc-b82a-d0c2a530818d tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:19.691955 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-42790bb1-ff9d-4ebc-b82a-d0c2a530818d tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:19.699132 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-42790bb1-ff9d-4ebc-b82a-d0c2a530818d tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 0.358591 Oct 19 03:12:19.699719 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 5/5] 10.222.0.52 () {58 vars in 1167 bytes} [Wed Oct 19 03:12:19 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:12:19.805558 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a804105b-ad58-4bce-8dc8-290d87ca2455 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.045342 Oct 19 03:12:19.808008 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1/6] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:12:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 2049 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 19 03:12:19.815462 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3ba5bf73-476d-40d1-a843-abd75046c938 tempest-AZAdminV2TestJSON-880622491 tempest-AZAdminV2TestJSON-880622491-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:19.817835 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3ba5bf73-476d-40d1-a843-abd75046c938 tempest-AZAdminV2TestJSON-880622491 tempest-AZAdminV2TestJSON-880622491-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:19.818333 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3ba5bf73-476d-40d1-a843-abd75046c938 tempest-AZAdminV2TestJSON-880622491 tempest-AZAdminV2TestJSON-880622491-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:19.818853 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3ba5bf73-476d-40d1-a843-abd75046c938 tempest-AZAdminV2TestJSON-880622491 tempest-AZAdminV2TestJSON-880622491-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:19.820836 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3ba5bf73-476d-40d1-a843-abd75046c938 tempest-AZAdminV2TestJSON-880622491 tempest-AZAdminV2TestJSON-880622491-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:19.821545 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3ba5bf73-476d-40d1-a843-abd75046c938 tempest-AZAdminV2TestJSON-880622491 tempest-AZAdminV2TestJSON-880622491-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:19.822160 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3ba5bf73-476d-40d1-a843-abd75046c938 tempest-AZAdminV2TestJSON-880622491 tempest-AZAdminV2TestJSON-880622491-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:19.894426 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3ba5bf73-476d-40d1-a843-abd75046c938 tempest-AZAdminV2TestJSON-880622491 tempest-AZAdminV2TestJSON-880622491-project-admin] 10.222.0.52 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.085018 Oct 19 03:12:19.905068 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2/7] 10.222.0.52 () {58 vars in 1185 bytes} [Wed Oct 19 03:12:19 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:12:19.910471 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6f589688-02b1-483b-b960-78d08de80372 tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1560771347"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:12:19.911464 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f682703e-2753-4573-9a04-32c74f3b78b0 tempest-FlavorsAdminTestJSON-1723856304 tempest-FlavorsAdminTestJSON-1723856304-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1500533586", "id": 379823810, "os-flavor-access:is_public": "True"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:12:19.913977 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.aggregate [None req-6f589688-02b1-483b-b960-78d08de80372 tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] Generated uuid d07d3d2a-ae8f-4440-addd-8aac9990ba69 for aggregate {{(pid=121134) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 19 03:12:20.019558 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f682703e-2753-4573-9a04-32c74f3b78b0 tempest-FlavorsAdminTestJSON-1723856304 tempest-FlavorsAdminTestJSON-1723856304-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.318667 Oct 19 03:12:20.020536 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 6/8] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:12:19 2022] POST /compute/v2.1/flavors => generated 427 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:12:20.026141 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c8dde6fe-8d76-48d3-8d5c-e0c12a2a067e tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:20.027112 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c8dde6fe-8d76-48d3-8d5c-e0c12a2a067e tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] [instance: 7a48466f-9d33-480f-b67a-21777e03d4d5] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:12:20.041203 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6f589688-02b1-483b-b960-78d08de80372 tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.134555 Oct 19 03:12:20.050256 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3/9] 10.222.0.52 () {60 vars in 1164 bytes} [Wed Oct 19 03:12:19 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:12:20.056000 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-21a87c93-2f09-4204-b2ef-37368c05252c tempest-FlavorsAdminTestJSON-1723856304 tempest-FlavorsAdminTestJSON-1723856304-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:20.144691 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-21a87c93-2f09-4204-b2ef-37368c05252c tempest-FlavorsAdminTestJSON-1723856304 tempest-FlavorsAdminTestJSON-1723856304-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/379823810" status: 202 len: 0 microversion: 2.1 time: 0.092455 Oct 19 03:12:20.145982 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4/10] 10.222.0.52 () {58 vars in 1158 bytes} [Wed Oct 19 03:12:20 2022] DELETE /compute/v2.1/flavors/379823810 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:12:20.158224 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-61058fab-cdf4-4f59-a8dd-016f93d8e7db tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-861333-8"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:12:20.208255 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-61058fab-cdf4-4f59-a8dd-016f93d8e7db tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:20.209103 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-61058fab-cdf4-4f59-a8dd-016f93d8e7db tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:20.209810 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-61058fab-cdf4-4f59-a8dd-016f93d8e7db tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:20.800492 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c8dde6fe-8d76-48d3-8d5c-e0c12a2a067e tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '769928c8ecb643fa83a9d58465dcb263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ead65f008349329789135966c031d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:12:20.838989 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c8dde6fe-8d76-48d3-8d5c-e0c12a2a067e tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] 10.222.0.52 "GET /compute/v2.1/servers/7a48466f-9d33-480f-b67a-21777e03d4d5" status: 200 len: 1220 microversion: 2.1 time: 0.816353 Oct 19 03:12:20.840337 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 7/11] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:12:20 2022] GET /compute/v2.1/servers/7a48466f-9d33-480f-b67a-21777e03d4d5 => generated 1220 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:12:20.860233 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a78e9068-f6a0-460e-b251-d4816f67c2ab tempest-FlavorsAdminTestJSON-1723856304 tempest-FlavorsAdminTestJSON-1723856304-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:20.916479 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a78e9068-f6a0-460e-b251-d4816f67c2ab tempest-FlavorsAdminTestJSON-1723856304 tempest-FlavorsAdminTestJSON-1723856304-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.074949 Oct 19 03:12:20.931282 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 8/12] 10.222.0.52 () {58 vars in 1146 bytes} [Wed Oct 19 03:12:20 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:12:21.053984 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-33316f11-7713-4d18-accb-3e88c0cb21ff tempest-HypervisorAdminV253TestBase-1269111171 tempest-HypervisorAdminV253TestBase-1269111171-project-admin] Calling method '.version_select at 0x7fc132650820>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:21.057629 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-33316f11-7713-4d18-accb-3e88c0cb21ff tempest-HypervisorAdminV253TestBase-1269111171 tempest-HypervisorAdminV253TestBase-1269111171-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:21.058263 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-33316f11-7713-4d18-accb-3e88c0cb21ff tempest-HypervisorAdminV253TestBase-1269111171 tempest-HypervisorAdminV253TestBase-1269111171-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:21.058709 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-33316f11-7713-4d18-accb-3e88c0cb21ff tempest-HypervisorAdminV253TestBase-1269111171 tempest-HypervisorAdminV253TestBase-1269111171-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:21.088961 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-33316f11-7713-4d18-accb-3e88c0cb21ff tempest-HypervisorAdminV253TestBase-1269111171 tempest-HypervisorAdminV253TestBase-1269111171-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:21.088961 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-33316f11-7713-4d18-accb-3e88c0cb21ff tempest-HypervisorAdminV253TestBase-1269111171 tempest-HypervisorAdminV253TestBase-1269111171-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:21.088961 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-33316f11-7713-4d18-accb-3e88c0cb21ff tempest-HypervisorAdminV253TestBase-1269111171 tempest-HypervisorAdminV253TestBase-1269111171-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:21.089352 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-61058fab-cdf4-4f59-a8dd-016f93d8e7db tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 242 microversion: 2.1 time: 0.929985 Oct 19 03:12:21.089352 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 5/13] 10.222.0.52 () {60 vars in 1191 bytes} [Wed Oct 19 03:12:20 2022] POST /compute/v2.1/os-aggregates/1/action => generated 242 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:12:21.089352 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8ebb2b58-7180-4ca6-aa0e-46fd32fd32cf tempest-FlavorsAdminTestJSON-1723856304 tempest-FlavorsAdminTestJSON-1723856304-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1551655105", "id": 1121588749, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:12:21.160304 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-33316f11-7713-4d18-accb-3e88c0cb21ff tempest-HypervisorAdminV253TestBase-1269111171 tempest-HypervisorAdminV253TestBase-1269111171-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:21.161063 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-33316f11-7713-4d18-accb-3e88c0cb21ff tempest-HypervisorAdminV253TestBase-1269111171 tempest-HypervisorAdminV253TestBase-1269111171-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:21.161697 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-33316f11-7713-4d18-accb-3e88c0cb21ff tempest-HypervisorAdminV253TestBase-1269111171 tempest-HypervisorAdminV253TestBase-1269111171-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:21.177563 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-33316f11-7713-4d18-accb-3e88c0cb21ff tempest-HypervisorAdminV253TestBase-1269111171 tempest-HypervisorAdminV253TestBase-1269111171-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:21.178239 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-33316f11-7713-4d18-accb-3e88c0cb21ff tempest-HypervisorAdminV253TestBase-1269111171 tempest-HypervisorAdminV253TestBase-1269111171-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:21.178909 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-33316f11-7713-4d18-accb-3e88c0cb21ff tempest-HypervisorAdminV253TestBase-1269111171 tempest-HypervisorAdminV253TestBase-1269111171-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:21.187636 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8ebb2b58-7180-4ca6-aa0e-46fd32fd32cf tempest-FlavorsAdminTestJSON-1723856304 tempest-FlavorsAdminTestJSON-1723856304-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 417 microversion: 2.1 time: 0.103592 Oct 19 03:12:21.188512 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 6/14] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:12:21 2022] POST /compute/v2.1/flavors => generated 417 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:12:21.198665 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-33316f11-7713-4d18-accb-3e88c0cb21ff tempest-HypervisorAdminV253TestBase-1269111171 tempest-HypervisorAdminV253TestBase-1269111171-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:21.199101 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5a1a9d57-38f7-40b9-97fd-d01fe3538d8b tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-861333-8"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:12:21.199212 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-33316f11-7713-4d18-accb-3e88c0cb21ff tempest-HypervisorAdminV253TestBase-1269111171 tempest-HypervisorAdminV253TestBase-1269111171-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:21.199626 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-33316f11-7713-4d18-accb-3e88c0cb21ff tempest-HypervisorAdminV253TestBase-1269111171 tempest-HypervisorAdminV253TestBase-1269111171-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:21.207694 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-33316f11-7713-4d18-accb-3e88c0cb21ff tempest-HypervisorAdminV253TestBase-1269111171 tempest-HypervisorAdminV253TestBase-1269111171-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1571 microversion: 2.53 time: 0.275723 Oct 19 03:12:21.208898 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 9/15] 10.222.0.52 () {60 vars in 1243 bytes} [Wed Oct 19 03:12:20 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1571 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:12:21.212868 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5a1a9d57-38f7-40b9-97fd-d01fe3538d8b tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:21.213356 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5a1a9d57-38f7-40b9-97fd-d01fe3538d8b tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:21.225521 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5a1a9d57-38f7-40b9-97fd-d01fe3538d8b tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:21.225663 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-8f277292-d27d-4429-8789-59ba3c0013a5 tempest-FlavorsAdminTestJSON-1723856304 tempest-FlavorsAdminTestJSON-1723856304-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:21.243915 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-8f277292-d27d-4429-8789-59ba3c0013a5 tempest-FlavorsAdminTestJSON-1723856304 tempest-FlavorsAdminTestJSON-1723856304-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5398 microversion: 2.1 time: 0.033173 Oct 19 03:12:21.244499 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 10/16] 10.222.0.52 () {58 vars in 1146 bytes} [Wed Oct 19 03:12:21 2022] GET /compute/v2.1/flavors/detail => generated 5398 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:12:21.249109 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d6e51274-83f1-4220-8028-cce884e60c24 tempest-HypervisorAdminV253TestBase-1269111171 tempest-HypervisorAdminV253TestBase-1269111171-project-admin] Calling method '.version_select at 0x7fc1325aff70>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:21.253151 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d6e51274-83f1-4220-8028-cce884e60c24 tempest-HypervisorAdminV253TestBase-1269111171 tempest-HypervisorAdminV253TestBase-1269111171-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:21.253668 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d6e51274-83f1-4220-8028-cce884e60c24 tempest-HypervisorAdminV253TestBase-1269111171 tempest-HypervisorAdminV253TestBase-1269111171-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:21.254294 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d6e51274-83f1-4220-8028-cce884e60c24 tempest-HypervisorAdminV253TestBase-1269111171 tempest-HypervisorAdminV253TestBase-1269111171-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:21.269594 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d6e51274-83f1-4220-8028-cce884e60c24 tempest-HypervisorAdminV253TestBase-1269111171 tempest-HypervisorAdminV253TestBase-1269111171-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:21.270086 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d6e51274-83f1-4220-8028-cce884e60c24 tempest-HypervisorAdminV253TestBase-1269111171 tempest-HypervisorAdminV253TestBase-1269111171-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:21.270527 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d6e51274-83f1-4220-8028-cce884e60c24 tempest-HypervisorAdminV253TestBase-1269111171 tempest-HypervisorAdminV253TestBase-1269111171-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:21.281284 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-5a1a9d57-38f7-40b9-97fd-d01fe3538d8b tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] HTTP exception thrown: Aggregate 1 already has host n-h2-861333-8. Oct 19 03:12:21.286961 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d6e51274-83f1-4220-8028-cce884e60c24 tempest-HypervisorAdminV253TestBase-1269111171 tempest-HypervisorAdminV253TestBase-1269111171-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:21.287584 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d6e51274-83f1-4220-8028-cce884e60c24 tempest-HypervisorAdminV253TestBase-1269111171 tempest-HypervisorAdminV253TestBase-1269111171-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:21.288106 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d6e51274-83f1-4220-8028-cce884e60c24 tempest-HypervisorAdminV253TestBase-1269111171 tempest-HypervisorAdminV253TestBase-1269111171-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:21.295787 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5a1a9d57-38f7-40b9-97fd-d01fe3538d8b tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] Request method failure captured: Oct 19 03:12:21.295787 n-d-861333-8 devstack@n-api.service[121134]: request: POST /compute/v2.1/os-aggregates/1/action HTTP/1.1 Oct 19 03:12:21.295787 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:12:21.295787 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:12:21.295787 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:12:21.295787 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 39 Oct 19 03:12:21.295787 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:12:21.295787 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:12:21.295787 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:12:21.295787 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:12:21.295787 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT2sSQw-193CFmXE1yZgEnt0B3HgVL-IByl9MkeVBZk-c5KX0vUCmee3Q0oqzDaNKo9zJeIds0ifmz-3fVGnI07Mrtz7rATgZAGe_rfcJbl1B9R7uDkjNChQt8Zzl7L6Y7Y0MAayowWf26ukVUUTqdgL5K-itKe6rSciyrvMsk-0EdJ0 Oct 19 03:12:21.295787 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:12:21.295787 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:12:21.295787 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:12:21.295787 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:12:21.295787 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:12:21.295787 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:12:21.295787 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: de26c267165d46af9fc562fad55e974a Oct 19 03:12:21.295787 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1537588694 Oct 19 03:12:21.295787 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member,admin Oct 19 03:12:21.295787 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member,admin Oct 19 03:12:21.296904 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/de26c267165d46af9fc562fad55e974a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/de26c267165d46af9fc562fad55e974a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/de26c267165d46af9fc562fad55e974a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_de26c267165d46af9fc562fad55e974a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:12:21.296904 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1537588694 Oct 19 03:12:21.296904 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: de26c267165d46af9fc562fad55e974a Oct 19 03:12:21.296904 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1537588694 Oct 19 03:12:21.296904 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin Oct 19 03:12:21.296904 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:12:21.296904 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:12:21.296904 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 182578638f5640fda56795a868e20798 Oct 19 03:12:21.296904 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin Oct 19 03:12:21.296904 n-d-861333-8 devstack@n-api.service[121134]: Oct 19 03:12:21.296904 n-d-861333-8 devstack@n-api.service[121134]: {"add_host": {"host": "n-h2-861333-8"}} Oct 19 03:12:21.296904 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:12:21.296904 n-d-861333-8 devstack@n-api.service[121134]: exception: Aggregate 1 already has host n-h2-861333-8. Oct 19 03:12:21.297604 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '1', 'body': {'add_host': {'host': 'n-h2-861333-8'}}} Oct 19 03:12:21.297604 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:12:21.297604 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:12:21.297604 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 19 03:12:21.297604 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 19 03:12:21.297604 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 19 03:12:21.297604 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 19 03:12:21.297604 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 19 03:12:21.297604 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 19 03:12:21.297604 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 19 03:12:21.297604 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 19 03:12:21.297604 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 19 03:12:21.297604 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 19 03:12:21.297604 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 19 03:12:21.297604 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi result.read() Oct 19 03:12:21.297604 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 19 03:12:21.297604 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 19 03:12:21.297604 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 19 03:12:21.297604 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 19 03:12:21.298508 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 19 03:12:21.298508 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 19 03:12:21.298508 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 19 03:12:21.298508 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 19 03:12:21.298508 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h2-861333-8-1' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 19 03:12:21.298508 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:12:21.298508 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 19 03:12:21.298508 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:12:21.298508 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:12:21.298508 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Oct 19 03:12:21.298508 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Oct 19 03:12:21.298508 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 19 03:12:21.298508 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi session.flush() Oct 19 03:12:21.298508 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 19 03:12:21.298508 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 19 03:12:21.298508 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 19 03:12:21.298508 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 19 03:12:21.298508 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 19 03:12:21.298508 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 19 03:12:21.299698 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 19 03:12:21.299698 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception Oct 19 03:12:21.299698 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 19 03:12:21.299698 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 19 03:12:21.299698 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 19 03:12:21.299698 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 19 03:12:21.299698 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 19 03:12:21.299698 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 19 03:12:21.299698 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 19 03:12:21.299698 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 19 03:12:21.299698 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 19 03:12:21.299698 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 19 03:12:21.299698 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 19 03:12:21.299698 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 19 03:12:21.299698 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 19 03:12:21.299698 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 19 03:12:21.299698 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 19 03:12:21.299698 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 19 03:12:21.300832 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 19 03:12:21.300832 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 19 03:12:21.300832 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 19 03:12:21.300832 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 19 03:12:21.300832 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 19 03:12:21.300832 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception Oct 19 03:12:21.300832 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 19 03:12:21.300832 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 19 03:12:21.300832 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 19 03:12:21.300832 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 19 03:12:21.300832 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 19 03:12:21.300832 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 19 03:12:21.300832 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 19 03:12:21.300832 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 19 03:12:21.300832 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 19 03:12:21.300832 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 19 03:12:21.300832 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 19 03:12:21.300832 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi result.read() Oct 19 03:12:21.302967 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 19 03:12:21.302967 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 19 03:12:21.302967 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 19 03:12:21.302967 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 19 03:12:21.302967 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 19 03:12:21.302967 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 19 03:12:21.302967 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 19 03:12:21.302967 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 19 03:12:21.302967 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h2-861333-8-1' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 19 03:12:21.302967 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Oct 19 03:12:21.302967 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 19, 3, 12, 21, 228404), 'updated_at': None, 'host': 'n-h2-861333-8', 'aggregate_id': 1}] Oct 19 03:12:21.302967 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 19 03:12:21.302967 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:12:21.302967 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:12:21.302967 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:12:21.302967 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:12:21.302967 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 19 03:12:21.304178 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 19 03:12:21.304178 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 19 03:12:21.304178 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 19 03:12:21.304178 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 03:12:21.304178 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 03:12:21.304178 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 03:12:21.304178 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 03:12:21.304178 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 19 03:12:21.304178 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 19 03:12:21.304178 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in add_host_to_aggregate Oct 19 03:12:21.304178 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Oct 19 03:12:21.304178 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 19 03:12:21.304178 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 19 03:12:21.304178 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Oct 19 03:12:21.304178 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Oct 19 03:12:21.304178 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Oct 19 03:12:21.304178 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Oct 19 03:12:21.304178 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 1 already has host n-h2-861333-8. Oct 19 03:12:21.304178 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:12:21.304178 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:12:21.316640 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:12:21.316640 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:12:21.316640 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:12:21.316640 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:12:21.316640 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:12:21.316640 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:12:21.316640 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:12:21.316640 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:12:21.316640 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:12:21.316640 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:12:21.316640 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Oct 19 03:12:21.316640 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 19 03:12:21.316640 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 1 already has host n-h2-861333-8. Oct 19 03:12:21.316640 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:12:21.316640 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:12:21.316640 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:12:21.316640 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:12:21.316640 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:12:21.316640 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:12:21.316640 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:12:21.316640 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:12:21.321145 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 1 already has host n-h2-861333-8. Oct 19 03:12:21.321145 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:12:21.321145 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5a1a9d57-38f7-40b9-97fd-d01fe3538d8b tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] Returning 409 to user: Aggregate 1 already has host n-h2-861333-8. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:12:21.321145 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5a1a9d57-38f7-40b9-97fd-d01fe3538d8b tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/1/action" status: 409 len: 95 microversion: 2.1 time: 0.107600 Oct 19 03:12:21.321145 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 7/17] 10.222.0.52 () {60 vars in 1191 bytes} [Wed Oct 19 03:12:21 2022] POST /compute/v2.1/os-aggregates/1/action => generated 95 bytes in 112 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Oct 19 03:12:21.321888 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d6e51274-83f1-4220-8028-cce884e60c24 tempest-HypervisorAdminV253TestBase-1269111171 tempest-HypervisorAdminV253TestBase-1269111171-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:21.321888 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d6e51274-83f1-4220-8028-cce884e60c24 tempest-HypervisorAdminV253TestBase-1269111171 tempest-HypervisorAdminV253TestBase-1269111171-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:21.321888 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d6e51274-83f1-4220-8028-cce884e60c24 tempest-HypervisorAdminV253TestBase-1269111171 tempest-HypervisorAdminV253TestBase-1269111171-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:21.322281 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-29cec85a-5630-4a10-9139-63e6ff3a71ce tempest-FlavorsAdminTestJSON-1723856304 tempest-FlavorsAdminTestJSON-1723856304-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:21.343883 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d6e51274-83f1-4220-8028-cce884e60c24 tempest-HypervisorAdminV253TestBase-1269111171 tempest-HypervisorAdminV253TestBase-1269111171-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:21.344426 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d6e51274-83f1-4220-8028-cce884e60c24 tempest-HypervisorAdminV253TestBase-1269111171 tempest-HypervisorAdminV253TestBase-1269111171-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:21.344868 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d6e51274-83f1-4220-8028-cce884e60c24 tempest-HypervisorAdminV253TestBase-1269111171 tempest-HypervisorAdminV253TestBase-1269111171-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:21.357692 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d6e51274-83f1-4220-8028-cce884e60c24 tempest-HypervisorAdminV253TestBase-1269111171 tempest-HypervisorAdminV253TestBase-1269111171-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 265 microversion: 2.53 time: 0.105730 Oct 19 03:12:21.357692 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 11/18] 10.222.0.52 () {60 vars in 1222 bytes} [Wed Oct 19 03:12:21 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 265 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 03:12:21.357692 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-521242d9-44b9-434f-8944-c058929b4285 tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-861333-8"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:12:21.385967 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-521242d9-44b9-434f-8944-c058929b4285 tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:21.386723 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-521242d9-44b9-434f-8944-c058929b4285 tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:21.387158 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-521242d9-44b9-434f-8944-c058929b4285 tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:21.417167 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-29cec85a-5630-4a10-9139-63e6ff3a71ce tempest-FlavorsAdminTestJSON-1723856304 tempest-FlavorsAdminTestJSON-1723856304-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/1121588749" status: 202 len: 0 microversion: 2.1 time: 0.114575 Oct 19 03:12:21.420996 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 8/19] 10.222.0.52 () {58 vars in 1161 bytes} [Wed Oct 19 03:12:21 2022] DELETE /compute/v2.1/flavors/1121588749 => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:12:21.424106 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-479387d3-f3c7-449c-912c-f060810f9f00 tempest-HypervisorAdminV253TestBase-1269111171 tempest-HypervisorAdminV253TestBase-1269111171-project-admin] Calling method '.version_select at 0x7fc131a9b790>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:21.433267 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-479387d3-f3c7-449c-912c-f060810f9f00 tempest-HypervisorAdminV253TestBase-1269111171 tempest-HypervisorAdminV253TestBase-1269111171-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d204a9a6-30d3-4569-8922-0d4cbe966b78(cell1) {{(pid=121134) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 19 03:12:21.434195 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-479387d3-f3c7-449c-912c-f060810f9f00 tempest-HypervisorAdminV253TestBase-1269111171 tempest-HypervisorAdminV253TestBase-1269111171-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:21.435118 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-479387d3-f3c7-449c-912c-f060810f9f00 tempest-HypervisorAdminV253TestBase-1269111171 tempest-HypervisorAdminV253TestBase-1269111171-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:21.435118 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-479387d3-f3c7-449c-912c-f060810f9f00 tempest-HypervisorAdminV253TestBase-1269111171 tempest-HypervisorAdminV253TestBase-1269111171-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:21.453084 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-479387d3-f3c7-449c-912c-f060810f9f00 tempest-HypervisorAdminV253TestBase-1269111171 tempest-HypervisorAdminV253TestBase-1269111171-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:21.453622 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-479387d3-f3c7-449c-912c-f060810f9f00 tempest-HypervisorAdminV253TestBase-1269111171 tempest-HypervisorAdminV253TestBase-1269111171-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:21.454057 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-479387d3-f3c7-449c-912c-f060810f9f00 tempest-HypervisorAdminV253TestBase-1269111171 tempest-HypervisorAdminV253TestBase-1269111171-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:21.460249 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-479387d3-f3c7-449c-912c-f060810f9f00 tempest-HypervisorAdminV253TestBase-1269111171 tempest-HypervisorAdminV253TestBase-1269111171-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/f92a8c0e-a175-4b08-9797-7ca5cb9b5737" status: 200 len: 791 microversion: 2.53 time: 0.041084 Oct 19 03:12:21.460989 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 9/20] 10.222.0.52 () {60 vars in 1298 bytes} [Wed Oct 19 03:12:21 2022] GET /compute/v2.1/os-hypervisors/f92a8c0e-a175-4b08-9797-7ca5cb9b5737 => generated 791 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 03:12:21.465547 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-76c2fa31-f5c3-4124-b521-a02864513aaf tempest-FlavorsAdminTestJSON-1723856304 tempest-FlavorsAdminTestJSON-1723856304-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:21.495188 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-76c2fa31-f5c3-4124-b521-a02864513aaf tempest-FlavorsAdminTestJSON-1723856304 tempest-FlavorsAdminTestJSON-1723856304-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.032890 Oct 19 03:12:21.495778 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 10/21] 10.222.0.52 () {58 vars in 1146 bytes} [Wed Oct 19 03:12:21 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:12:21.514959 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-98a2c55a-21b9-46c2-89fe-0ff8133fd581 tempest-FlavorsAdminTestJSON-1723856304 tempest-FlavorsAdminTestJSON-1723856304-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-863356484", "id": 1867534006, "os-flavor-access:is_public": "True"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:12:21.571716 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-98a2c55a-21b9-46c2-89fe-0ff8133fd581 tempest-FlavorsAdminTestJSON-1723856304 tempest-FlavorsAdminTestJSON-1723856304-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.060233 Oct 19 03:12:21.573578 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 11/22] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:12:21 2022] POST /compute/v2.1/flavors => generated 428 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:12:21.587546 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b38d75a2-2eec-4529-a9c9-0bc29d36263e tempest-FlavorsAdminTestJSON-1723856304 tempest-FlavorsAdminTestJSON-1723856304-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:21.709260 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b38d75a2-2eec-4529-a9c9-0bc29d36263e tempest-FlavorsAdminTestJSON-1723856304 tempest-FlavorsAdminTestJSON-1723856304-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/1867534006" status: 202 len: 0 microversion: 2.1 time: 0.127015 Oct 19 03:12:21.710277 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 12/23] 10.222.0.52 () {58 vars in 1161 bytes} [Wed Oct 19 03:12:21 2022] DELETE /compute/v2.1/flavors/1867534006 => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:12:21.719078 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-271fb48e-e245-4aa3-b17e-64f4ce1547bf tempest-FlavorsAdminTestJSON-1723856304 tempest-FlavorsAdminTestJSON-1723856304-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:21.746831 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-271fb48e-e245-4aa3-b17e-64f4ce1547bf tempest-FlavorsAdminTestJSON-1723856304 tempest-FlavorsAdminTestJSON-1723856304-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.032372 Oct 19 03:12:21.747743 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 13/24] 10.222.0.52 () {58 vars in 1146 bytes} [Wed Oct 19 03:12:21 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:12:21.768369 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ca1c6020-4443-4317-9604-288ac23934f2 tempest-FlavorsAdminTestJSON-1723856304 tempest-FlavorsAdminTestJSON-1723856304-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-218243033", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:12:21.846324 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ca1c6020-4443-4317-9604-288ac23934f2 tempest-FlavorsAdminTestJSON-1723856304 tempest-FlavorsAdminTestJSON-1723856304-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.083104 Oct 19 03:12:21.847512 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 14/25] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:12:21 2022] POST /compute/v2.1/flavors => generated 506 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:12:21.860407 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d16339b0-7aae-4101-902b-d4591c2c1139 tempest-FlavorsAdminTestJSON-1723856304 tempest-FlavorsAdminTestJSON-1723856304-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:21.949523 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d16339b0-7aae-4101-902b-d4591c2c1139 tempest-FlavorsAdminTestJSON-1723856304 tempest-FlavorsAdminTestJSON-1723856304-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/a7cdf087-a780-46a5-a97a-324dadc4016f" status: 202 len: 0 microversion: 2.1 time: 0.093952 Oct 19 03:12:21.950702 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 15/26] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:12:21 2022] DELETE /compute/v2.1/flavors/a7cdf087-a780-46a5-a97a-324dadc4016f => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 19 03:12:21.956754 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ffad2960-6772-4c61-a76c-20d12143bd94 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:21.957793 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ffad2960-6772-4c61-a76c-20d12143bd94 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] [instance: 7a48466f-9d33-480f-b67a-21777e03d4d5] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:12:21.970976 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ffad2960-6772-4c61-a76c-20d12143bd94 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:21.971476 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ffad2960-6772-4c61-a76c-20d12143bd94 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:21.971922 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ffad2960-6772-4c61-a76c-20d12143bd94 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:21.972658 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ffad2960-6772-4c61-a76c-20d12143bd94 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:21.973155 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ffad2960-6772-4c61-a76c-20d12143bd94 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:21.973618 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ffad2960-6772-4c61-a76c-20d12143bd94 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:22.128507 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ffad2960-6772-4c61-a76c-20d12143bd94 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '769928c8ecb643fa83a9d58465dcb263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ead65f008349329789135966c031d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:12:22.157488 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ffad2960-6772-4c61-a76c-20d12143bd94 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] 10.222.0.52 "GET /compute/v2.1/servers/7a48466f-9d33-480f-b67a-21777e03d4d5" status: 200 len: 1224 microversion: 2.1 time: 0.205097 Oct 19 03:12:22.158320 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 16/27] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:12:21 2022] GET /compute/v2.1/servers/7a48466f-9d33-480f-b67a-21777e03d4d5 => generated 1224 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:12:22.164877 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7c833489-8f16-42bb-a53c-e7bbc670bbc5 tempest-FlavorsAdminTestJSON-1723856304 tempest-FlavorsAdminTestJSON-1723856304-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:22.199805 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7c833489-8f16-42bb-a53c-e7bbc670bbc5 tempest-FlavorsAdminTestJSON-1723856304 tempest-FlavorsAdminTestJSON-1723856304-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.040061 Oct 19 03:12:22.200404 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 17/28] 10.222.0.52 () {58 vars in 1146 bytes} [Wed Oct 19 03:12:22 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:12:22.228629 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-cf0e0c68-e8cb-45c9-b2a7-c58b78f4b1f2 tempest-FlavorsAdminTestJSON-1723856304 tempest-FlavorsAdminTestJSON-1723856304-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-891805499", "id": "9d1c3d76-f027-4b77-812c-b438eb477911", "os-flavor-access:is_public": "True"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:12:22.331501 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-cf0e0c68-e8cb-45c9-b2a7-c58b78f4b1f2 tempest-FlavorsAdminTestJSON-1723856304 tempest-FlavorsAdminTestJSON-1723856304-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.114528 Oct 19 03:12:22.332635 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 18/29] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:12:22 2022] POST /compute/v2.1/flavors => generated 506 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:12:22.345676 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d50b307d-eaab-4bfa-9370-4eed58cf3915 tempest-FlavorsAdminTestJSON-1723856304 tempest-FlavorsAdminTestJSON-1723856304-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:22.360694 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=10,nova_api:DELETE=14 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:12:22.443096 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-521242d9-44b9-434f-8944-c058929b4285 tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 227 microversion: 2.1 time: 1.089504 Oct 19 03:12:22.444582 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 12/30] 10.222.0.52 () {60 vars in 1191 bytes} [Wed Oct 19 03:12:21 2022] POST /compute/v2.1/os-aggregates/1/action => generated 227 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:12:22.451829 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d50b307d-eaab-4bfa-9370-4eed58cf3915 tempest-FlavorsAdminTestJSON-1723856304 tempest-FlavorsAdminTestJSON-1723856304-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/9d1c3d76-f027-4b77-812c-b438eb477911" status: 202 len: 0 microversion: 2.1 time: 0.110440 Oct 19 03:12:22.452419 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 19/31] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:12:22 2022] DELETE /compute/v2.1/flavors/9d1c3d76-f027-4b77-812c-b438eb477911 => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:12:22.457460 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ddb70002-aa44-40ed-b1a7-b409b5900b6e tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:22.464527 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-eb20a517-0a70-4617-bd55-fe25a8677f2b tempest-FlavorsAdminTestJSON-1723856304 tempest-FlavorsAdminTestJSON-1723856304-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:22.487484 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-eb20a517-0a70-4617-bd55-fe25a8677f2b tempest-FlavorsAdminTestJSON-1723856304 tempest-FlavorsAdminTestJSON-1723856304-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.028235 Oct 19 03:12:22.488059 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 20/32] 10.222.0.52 () {58 vars in 1146 bytes} [Wed Oct 19 03:12:22 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:12:22.516384 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7787ed17-a3c4-47e9-af45-c393aa9b7c7e tempest-FlavorsAdminTestJSON-1723856304 tempest-FlavorsAdminTestJSON-1723856304-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1009586041", "id": 305744887, "os-flavor-access:is_public": "True"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:12:22.580581 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ddb70002-aa44-40ed-b1a7-b409b5900b6e tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.127914 Oct 19 03:12:22.581543 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 13/33] 10.222.0.52 () {58 vars in 1152 bytes} [Wed Oct 19 03:12:22 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 19 03:12:22.592798 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1415ada2-399b-45c6-9e4f-324a2fd4448e tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1195454843"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:12:22.597441 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.aggregate [None req-1415ada2-399b-45c6-9e4f-324a2fd4448e tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] Generated uuid 92b1e4e0-c2d8-4e53-8fbb-15709181c2ab for aggregate {{(pid=121135) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 19 03:12:22.601524 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7787ed17-a3c4-47e9-af45-c393aa9b7c7e tempest-FlavorsAdminTestJSON-1723856304 tempest-FlavorsAdminTestJSON-1723856304-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.091490 Oct 19 03:12:22.610488 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 21/34] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:12:22 2022] POST /compute/v2.1/flavors => generated 411 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:12:22.617918 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-afc40026-43b4-4a83-a05d-4416fc740e66 tempest-AggregatesAdminTestV241-1151926969 tempest-AggregatesAdminTestV241-1151926969-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-304095462"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:12:22.622383 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.aggregate [None req-afc40026-43b4-4a83-a05d-4416fc740e66 tempest-AggregatesAdminTestV241-1151926969 tempest-AggregatesAdminTestV241-1151926969-project-admin] Generated uuid 9b67936b-8109-428f-b3b2-2785c9f97efd for aggregate {{(pid=121134) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 19 03:12:22.679791 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1415ada2-399b-45c6-9e4f-324a2fd4448e tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.086402 Oct 19 03:12:22.685684 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 14/35] 10.222.0.52 () {60 vars in 1164 bytes} [Wed Oct 19 03:12:22 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:12:22.696088 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-928efa0a-cf22-41f8-be02-f9ee3d367e20 tempest-FlavorsAdminTestJSON-1723856304 tempest-FlavorsAdminTestJSON-1723856304-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:22.715923 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-afc40026-43b4-4a83-a05d-4416fc740e66 tempest-AggregatesAdminTestV241-1151926969 tempest-AggregatesAdminTestV241-1151926969-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.41 time: 0.096061 Oct 19 03:12:22.715923 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 22/36] 10.222.0.52 () {62 vars in 1205 bytes} [Wed Oct 19 03:12:22 2022] POST /compute/v2.1/os-aggregates => generated 245 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 03:12:22.732154 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-928efa0a-cf22-41f8-be02-f9ee3d367e20 tempest-FlavorsAdminTestJSON-1723856304 tempest-FlavorsAdminTestJSON-1723856304-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/305744887" status: 200 len: 411 microversion: 2.1 time: 0.041613 Oct 19 03:12:22.733225 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 15/37] 10.222.0.52 () {58 vars in 1155 bytes} [Wed Oct 19 03:12:22 2022] GET /compute/v2.1/flavors/305744887 => generated 411 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:12:22.739612 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-098a66e4-70a5-481e-aee5-7ce6adca895f tempest-AggregatesAdminTestV241-1151926969 tempest-AggregatesAdminTestV241-1151926969-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-233782824"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:12:22.923821 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1035c02b-f036-46bf-8153-ccad29d1beec tempest-AggregatesAdminNegativeTestJSON-1649350433 tempest-AggregatesAdminNegativeTestJSON-1649350433-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-861333-8"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:12:22.927274 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-1035c02b-f036-46bf-8153-ccad29d1beec tempest-AggregatesAdminNegativeTestJSON-1649350433 tempest-AggregatesAdminNegativeTestJSON-1649350433-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': 'b09e6864e9c04d6aaa1d4d210733c3d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f400c62b5a9417b8d0c10047a9e43b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:12:22.930850 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1035c02b-f036-46bf-8153-ccad29d1beec tempest-AggregatesAdminNegativeTestJSON-1649350433 tempest-AggregatesAdminNegativeTestJSON-1649350433-project] Request method failure captured: Oct 19 03:12:22.930850 n-d-861333-8 devstack@n-api.service[121134]: request: POST /compute/v2.1/os-aggregates/2/action HTTP/1.1 Oct 19 03:12:22.930850 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:12:22.930850 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:12:22.930850 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:12:22.930850 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 39 Oct 19 03:12:22.930850 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:12:22.930850 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:12:22.930850 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:12:22.930850 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:12:22.930850 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT2sPwoyuBijUT-jxC0uUUPhVqAwh9DMb8Lx224kKtLAN9vAmcN-d1fZoJb-X6cckijL8297lUWtY71vdBMRABXjXHfUvR_YrhylxKEFRY_Xt_oUCBt65EYiqUhOD7HwX9hSHq-gf5YDnqleXRvIZbTZmK-cAziyRBTBPDAmEwyrHgUY Oct 19 03:12:22.930850 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:12:22.930850 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:12:22.930850 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:12:22.930850 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:12:22.930850 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:12:22.930850 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:12:22.930850 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 4f400c62b5a9417b8d0c10047a9e43b6 Oct 19 03:12:22.930850 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1649350433 Oct 19 03:12:22.930850 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:12:22.930850 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:12:22.932129 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4f400c62b5a9417b8d0c10047a9e43b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4f400c62b5a9417b8d0c10047a9e43b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4f400c62b5a9417b8d0c10047a9e43b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4f400c62b5a9417b8d0c10047a9e43b6", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:12:22.932129 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1649350433 Oct 19 03:12:22.932129 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 4f400c62b5a9417b8d0c10047a9e43b6 Oct 19 03:12:22.932129 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1649350433 Oct 19 03:12:22.932129 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-AggregatesAdminNegativeTestJSON-1649350433-project Oct 19 03:12:22.932129 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:12:22.932129 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:12:22.932129 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: b09e6864e9c04d6aaa1d4d210733c3d8 Oct 19 03:12:22.932129 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1649350433-project Oct 19 03:12:22.932129 n-d-861333-8 devstack@n-api.service[121134]: Oct 19 03:12:22.932129 n-d-861333-8 devstack@n-api.service[121134]: {"add_host": {"host": "n-h2-861333-8"}} Oct 19 03:12:22.932129 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:12:22.932129 n-d-861333-8 devstack@n-api.service[121134]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 19 03:12:22.932957 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '2', 'body': {'add_host': {'host': 'n-h2-861333-8'}}} Oct 19 03:12:22.932957 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:12:22.932957 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:12:22.932957 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:12:22.932957 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:12:22.932957 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:12:22.932957 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:12:22.932957 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:12:22.932957 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:12:22.932957 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:12:22.932957 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:12:22.932957 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Oct 19 03:12:22.932957 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Oct 19 03:12:22.932957 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 19 03:12:22.932957 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 19 03:12:22.932957 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 19 03:12:22.932957 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 19 03:12:22.932957 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 03:12:22.932957 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 03:12:22.934080 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 03:12:22.934080 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 03:12:22.934080 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 19 03:12:22.934080 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 19 03:12:22.934080 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 19 03:12:22.934080 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 19 03:12:22.934080 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 19 03:12:22.934080 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 19 03:12:22.934080 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 19 03:12:22.934080 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:12:22.934080 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:12:22.934080 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:12:22.934080 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:12:22.934080 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:12:22.934080 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:12:22.934080 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 19 03:12:22.934080 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 19 03:12:22.934080 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 19 03:12:22.934080 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:12:22.935082 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1035c02b-f036-46bf-8153-ccad29d1beec tempest-AggregatesAdminNegativeTestJSON-1649350433 tempest-AggregatesAdminNegativeTestJSON-1649350433-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:12:22.935082 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1035c02b-f036-46bf-8153-ccad29d1beec tempest-AggregatesAdminNegativeTestJSON-1649350433 tempest-AggregatesAdminNegativeTestJSON-1649350433-project] 10.222.0.52 "POST /compute/v2.1/os-aggregates/2/action" status: 403 len: 118 microversion: 2.1 time: 0.216181 Oct 19 03:12:22.935082 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 23/38] 10.222.0.52 () {60 vars in 1191 bytes} [Wed Oct 19 03:12:22 2022] POST /compute/v2.1/os-aggregates/2/action => generated 118 bytes in 225 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:12:22.939802 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-098a66e4-70a5-481e-aee5-7ce6adca895f tempest-AggregatesAdminTestV241-1151926969 tempest-AggregatesAdminTestV241-1151926969-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-aggregates/3" status: 200 len: 298 microversion: 2.41 time: 0.204186 Oct 19 03:12:22.940752 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 16/39] 10.222.0.52 () {62 vars in 1210 bytes} [Wed Oct 19 03:12:22 2022] PUT /compute/v2.1/os-aggregates/3 => generated 298 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 03:12:22.949164 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-eb833e01-b923-4eab-aa4f-1e230674272b tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:23.086908 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-eb833e01-b923-4eab-aa4f-1e230674272b tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.144907 Oct 19 03:12:23.088228 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 17/40] 10.222.0.52 () {58 vars in 1152 bytes} [Wed Oct 19 03:12:22 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 19 03:12:23.094911 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2e67649f-5a4d-4a2a-9528-0217c25be4c8 tempest-AggregatesAdminTestV241-1151926969 tempest-AggregatesAdminTestV241-1151926969-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:23.105731 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2e67649f-5a4d-4a2a-9528-0217c25be4c8 tempest-AggregatesAdminTestV241-1151926969 tempest-AggregatesAdminTestV241-1151926969-project-admin] 10.222.0.52 "GET /compute/v2.1/os-aggregates/3" status: 200 len: 298 microversion: 2.41 time: 0.016917 Oct 19 03:12:23.110268 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 18/41] 10.222.0.52 () {60 vars in 1190 bytes} [Wed Oct 19 03:12:23 2022] GET /compute/v2.1/os-aggregates/3 => generated 298 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 03:12:23.116588 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9b85f960-180e-4d78-8434-ad3cc4c16464 tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-799033181"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:12:23.121131 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.aggregate [None req-9b85f960-180e-4d78-8434-ad3cc4c16464 tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] Generated uuid 0608f5af-0eb5-480a-9c56-631ac42196ce for aggregate {{(pid=121135) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 19 03:12:23.196671 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9b85f960-180e-4d78-8434-ad3cc4c16464 tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.082802 Oct 19 03:12:23.205044 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 19/42] 10.222.0.52 () {60 vars in 1164 bytes} [Wed Oct 19 03:12:23 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:12:23.205879 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-82abf7a9-8a28-4603-ae22-1d5681f84d58 tempest-AggregatesAdminTestV241-1151926969 tempest-AggregatesAdminTestV241-1151926969-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-861333-8"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:12:23.228151 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-82abf7a9-8a28-4603-ae22-1d5681f84d58 tempest-AggregatesAdminTestV241-1151926969 tempest-AggregatesAdminTestV241-1151926969-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:23.229748 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-82abf7a9-8a28-4603-ae22-1d5681f84d58 tempest-AggregatesAdminTestV241-1151926969 tempest-AggregatesAdminTestV241-1151926969-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:23.230819 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-82abf7a9-8a28-4603-ae22-1d5681f84d58 tempest-AggregatesAdminTestV241-1151926969 tempest-AggregatesAdminTestV241-1151926969-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:23.342967 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-730436a1-d83f-4dee-863d-795869ecab04 tempest-FlavorsAdminTestJSON-161469764 tempest-FlavorsAdminTestJSON-161469764-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:23.424737 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-730436a1-d83f-4dee-863d-795869ecab04 tempest-FlavorsAdminTestJSON-161469764 tempest-FlavorsAdminTestJSON-161469764-project] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5392 microversion: 2.1 time: 0.488998 Oct 19 03:12:23.425756 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 24/43] 10.222.0.52 () {58 vars in 1146 bytes} [Wed Oct 19 03:12:22 2022] GET /compute/v2.1/flavors/detail => generated 5392 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:12:23.431653 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e5262241-ac05-46f3-bdd9-64f98f27092d tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:23.432550 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e5262241-ac05-46f3-bdd9-64f98f27092d tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] [instance: 7a48466f-9d33-480f-b67a-21777e03d4d5] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:12:23.447885 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e5262241-ac05-46f3-bdd9-64f98f27092d tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:23.447885 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e5262241-ac05-46f3-bdd9-64f98f27092d tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:23.447885 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e5262241-ac05-46f3-bdd9-64f98f27092d tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:23.447885 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e5262241-ac05-46f3-bdd9-64f98f27092d tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:23.448222 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e5262241-ac05-46f3-bdd9-64f98f27092d tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:23.448222 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e5262241-ac05-46f3-bdd9-64f98f27092d tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:23.514238 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e5262241-ac05-46f3-bdd9-64f98f27092d tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '769928c8ecb643fa83a9d58465dcb263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ead65f008349329789135966c031d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:12:23.523661 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e5262241-ac05-46f3-bdd9-64f98f27092d tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] 10.222.0.52 "GET /compute/v2.1/servers/7a48466f-9d33-480f-b67a-21777e03d4d5" status: 200 len: 1280 microversion: 2.1 time: 0.096515 Oct 19 03:12:23.524275 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 25/44] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:12:23 2022] GET /compute/v2.1/servers/7a48466f-9d33-480f-b67a-21777e03d4d5 => generated 1280 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:12:23.530433 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5a3a4777-04a7-43da-a177-cd3753077c39 tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-115088710"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:12:23.541202 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5a3a4777-04a7-43da-a177-cd3753077c39 tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:23.541734 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5a3a4777-04a7-43da-a177-cd3753077c39 tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:23.542185 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5a3a4777-04a7-43da-a177-cd3753077c39 tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:23.549500 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5a3a4777-04a7-43da-a177-cd3753077c39 tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:23.550213 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5a3a4777-04a7-43da-a177-cd3753077c39 tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:23.550871 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5a3a4777-04a7-43da-a177-cd3753077c39 tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:23.560114 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-5a3a4777-04a7-43da-a177-cd3753077c39 tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-115088710 could not be found. Oct 19 03:12:23.564236 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5a3a4777-04a7-43da-a177-cd3753077c39 tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] Request method failure captured: Oct 19 03:12:23.564236 n-d-861333-8 devstack@n-api.service[121134]: request: POST /compute/v2.1/os-aggregates/4/action HTTP/1.1 Oct 19 03:12:23.564236 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:12:23.564236 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:12:23.564236 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:12:23.564236 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 57 Oct 19 03:12:23.564236 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:12:23.564236 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:12:23.564236 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:12:23.564236 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:12:23.564236 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT2sSQw-193CFmXE1yZgEnt0B3HgVL-IByl9MkeVBZk-c5KX0vUCmee3Q0oqzDaNKo9zJeIds0ifmz-3fVGnI07Mrtz7rATgZAGe_rfcJbl1B9R7uDkjNChQt8Zzl7L6Y7Y0MAayowWf26ukVUUTqdgL5K-itKe6rSciyrvMsk-0EdJ0 Oct 19 03:12:23.564236 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:12:23.564236 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:12:23.564236 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:12:23.564236 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:12:23.564236 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:12:23.564236 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:12:23.564236 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: de26c267165d46af9fc562fad55e974a Oct 19 03:12:23.564236 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1537588694 Oct 19 03:12:23.564236 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member,admin Oct 19 03:12:23.564236 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member,admin Oct 19 03:12:23.565287 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/de26c267165d46af9fc562fad55e974a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/de26c267165d46af9fc562fad55e974a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/de26c267165d46af9fc562fad55e974a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_de26c267165d46af9fc562fad55e974a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:12:23.565287 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1537588694 Oct 19 03:12:23.565287 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: de26c267165d46af9fc562fad55e974a Oct 19 03:12:23.565287 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1537588694 Oct 19 03:12:23.565287 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin Oct 19 03:12:23.565287 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:12:23.565287 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:12:23.565287 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 182578638f5640fda56795a868e20798 Oct 19 03:12:23.565287 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin Oct 19 03:12:23.565287 n-d-861333-8 devstack@n-api.service[121134]: Oct 19 03:12:23.565287 n-d-861333-8 devstack@n-api.service[121134]: {"add_host": {"host": "tempest-nonexist_host-115088710"}} Oct 19 03:12:23.565287 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:12:23.565980 n-d-861333-8 devstack@n-api.service[121134]: exception: Compute host tempest-nonexist_host-115088710 could not be found. Oct 19 03:12:23.565980 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '4', 'body': {'add_host': {'host': 'tempest-nonexist_host-115088710'}}} Oct 19 03:12:23.565980 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:12:23.565980 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:12:23.565980 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Oct 19 03:12:23.565980 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 19 03:12:23.565980 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 03:12:23.565980 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 03:12:23.565980 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 19 03:12:23.565980 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 19 03:12:23.565980 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 19 03:12:23.565980 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 19 03:12:23.565980 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 19 03:12:23.565980 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 19 03:12:23.565980 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-115088710' is not mapped to any cell Oct 19 03:12:23.565980 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:12:23.565980 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:12:23.565980 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:12:23.565980 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:12:23.565980 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Oct 19 03:12:23.566978 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 19 03:12:23.566978 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 19 03:12:23.566978 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 19 03:12:23.566978 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 19 03:12:23.566978 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:12:23.566978 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:12:23.566978 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:12:23.566978 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:12:23.566978 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 19 03:12:23.566978 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 19 03:12:23.566978 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 19 03:12:23.566978 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 19 03:12:23.566978 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 03:12:23.566978 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 03:12:23.566978 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 03:12:23.566978 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 03:12:23.566978 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 19 03:12:23.566978 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 19 03:12:23.566978 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6621, in add_host_to_aggregate Oct 19 03:12:23.566978 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Oct 19 03:12:23.568405 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 19 03:12:23.568405 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 19 03:12:23.568405 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-115088710 could not be found. Oct 19 03:12:23.568405 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:12:23.568405 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:12:23.568405 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:12:23.568405 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:12:23.568405 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:12:23.568405 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:12:23.568405 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:12:23.568405 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:12:23.568405 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:12:23.568405 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:12:23.568405 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:12:23.568405 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:12:23.568405 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Oct 19 03:12:23.568405 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:12:23.568405 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-115088710 could not be found. Oct 19 03:12:23.568405 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:12:23.568405 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:12:23.568405 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:12:23.569709 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:12:23.569709 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:12:23.569709 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:12:23.569709 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:12:23.569709 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:12:23.569709 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-115088710 could not be found. Oct 19 03:12:23.569709 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:12:23.570976 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5a3a4777-04a7-43da-a177-cd3753077c39 tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-115088710 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:12:23.572114 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5a3a4777-04a7-43da-a177-cd3753077c39 tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/4/action" status: 404 len: 110 microversion: 2.1 time: 0.046569 Oct 19 03:12:23.572837 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 26/45] 10.222.0.52 () {60 vars in 1191 bytes} [Wed Oct 19 03:12:23 2022] POST /compute/v2.1/os-aggregates/4/action => generated 110 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:12:23.582700 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-82abf7a9-8a28-4603-ae22-1d5681f84d58 tempest-AggregatesAdminTestV241-1151926969 tempest-AggregatesAdminTestV241-1151926969-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 313 microversion: 2.41 time: 0.383456 Oct 19 03:12:23.591279 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 20/46] 10.222.0.52 () {62 vars in 1232 bytes} [Wed Oct 19 03:12:23 2022] POST /compute/v2.1/os-aggregates/3/action => generated 313 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 03:12:23.591495 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2bdf43ec-12ab-4b5b-b250-9f4212cb8e99 tempest-FlavorsAdminTestJSON-1723856304 tempest-FlavorsAdminTestJSON-1723856304-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:23.591640 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-865246ae-3586-405d-8711-f400da2966fa tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:23.664066 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2bdf43ec-12ab-4b5b-b250-9f4212cb8e99 tempest-FlavorsAdminTestJSON-1723856304 tempest-FlavorsAdminTestJSON-1723856304-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/305744887" status: 202 len: 0 microversion: 2.1 time: 0.089246 Oct 19 03:12:23.668761 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 27/47] 10.222.0.52 () {58 vars in 1158 bytes} [Wed Oct 19 03:12:23 2022] DELETE /compute/v2.1/flavors/305744887 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:12:23.674590 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-88ec8985-a91a-4c4b-8964-b05d8dd88bdf tempest-AggregatesAdminTestV241-1151926969 tempest-AggregatesAdminTestV241-1151926969-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-861333-8"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:12:23.695278 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-865246ae-3586-405d-8711-f400da2966fa tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.110276 Oct 19 03:12:23.696600 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 21/48] 10.222.0.52 () {58 vars in 1152 bytes} [Wed Oct 19 03:12:23 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 19 03:12:23.699527 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-88ec8985-a91a-4c4b-8964-b05d8dd88bdf tempest-AggregatesAdminTestV241-1151926969 tempest-AggregatesAdminTestV241-1151926969-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:23.700027 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-88ec8985-a91a-4c4b-8964-b05d8dd88bdf tempest-AggregatesAdminTestV241-1151926969 tempest-AggregatesAdminTestV241-1151926969-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:23.700628 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-88ec8985-a91a-4c4b-8964-b05d8dd88bdf tempest-AggregatesAdminTestV241-1151926969 tempest-AggregatesAdminTestV241-1151926969-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:23.704253 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a05376a0-85c1-4e9c-a1f9-8a9b6e612d63 tempest-FlavorsAdminTestJSON-1723856304 tempest-FlavorsAdminTestJSON-1723856304-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:23.756861 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a05376a0-85c1-4e9c-a1f9-8a9b6e612d63 tempest-FlavorsAdminTestJSON-1723856304 tempest-FlavorsAdminTestJSON-1723856304-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.058877 Oct 19 03:12:23.769814 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 22/49] 10.222.0.52 () {58 vars in 1146 bytes} [Wed Oct 19 03:12:23 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:12:23.781064 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-63677174-7ca8-4d1e-96fc-65024c668d3f tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:12:23.786595 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-63677174-7ca8-4d1e-96fc-65024c668d3f tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] Request method failure captured: Oct 19 03:12:23.786595 n-d-861333-8 devstack@n-api.service[121135]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 19 03:12:23.786595 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:12:23.786595 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:12:23.786595 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:12:23.786595 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 283 Oct 19 03:12:23.786595 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:12:23.786595 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:12:23.786595 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:12:23.786595 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:12:23.786595 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2sSQw-193CFmXE1yZgEnt0B3HgVL-IByl9MkeVBZk-c5KX0vUCmee3Q0oqzDaNKo9zJeIds0ifmz-3fVGnI07Mrtz7rATgZAGe_rfcJbl1B9R7uDkjNChQt8Zzl7L6Y7Y0MAayowWf26ukVUUTqdgL5K-itKe6rSciyrvMsk-0EdJ0 Oct 19 03:12:23.786595 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:12:23.786595 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:12:23.786595 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:12:23.786595 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:12:23.786595 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:12:23.786595 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:12:23.786595 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: de26c267165d46af9fc562fad55e974a Oct 19 03:12:23.786595 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1537588694 Oct 19 03:12:23.786595 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member,admin Oct 19 03:12:23.786595 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member,admin Oct 19 03:12:23.787678 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/de26c267165d46af9fc562fad55e974a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/de26c267165d46af9fc562fad55e974a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/de26c267165d46af9fc562fad55e974a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_de26c267165d46af9fc562fad55e974a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:12:23.787678 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1537588694 Oct 19 03:12:23.787678 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: de26c267165d46af9fc562fad55e974a Oct 19 03:12:23.787678 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1537588694 Oct 19 03:12:23.787678 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin Oct 19 03:12:23.787678 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:12:23.787678 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:12:23.787678 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 182578638f5640fda56795a868e20798 Oct 19 03:12:23.787678 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin Oct 19 03:12:23.787678 n-d-861333-8 devstack@n-api.service[121135]: Oct 19 03:12:23.788151 n-d-861333-8 devstack@n-api.service[121135]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 19 03:12:23.788151 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:12:23.788151 n-d-861333-8 devstack@n-api.service[121135]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 19 03:12:23.788151 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 19 03:12:23.788151 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:12:23.788151 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:12:23.788151 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 03:12:23.788151 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 03:12:23.788151 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 03:12:23.788151 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise error Oct 19 03:12:23.788662 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 19 03:12:23.788662 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:12:23.788662 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Oct 19 03:12:23.788662 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 19 03:12:23.788662 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:12:23.788662 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 19 03:12:23.788662 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 19 03:12:23.788662 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:12:23.788662 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:12:23.788662 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:12:23.788662 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:12:23.788662 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:12:23.788662 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:12:23.788662 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:12:23.788662 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:12:23.788662 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:12:23.788662 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:12:23.789460 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:12:23.789460 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:12:23.789460 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 03:12:23.789460 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 03:12:23.789460 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 03:12:23.789460 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 03:12:23.789460 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 03:12:23.789460 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 03:12:23.789460 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 19 03:12:23.789460 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:12:23.789460 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:12:23.789460 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:12:23.789460 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:12:23.789460 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:12:23.789460 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:12:23.790163 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 03:12:23.790163 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 03:12:23.790163 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 19 03:12:23.790163 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:12:23.792379 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-63677174-7ca8-4d1e-96fc-65024c668d3f tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:12:23.793820 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-63677174-7ca8-4d1e-96fc-65024c668d3f tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.022707 Oct 19 03:12:23.795007 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 23/50] 10.222.0.52 () {60 vars in 1165 bytes} [Wed Oct 19 03:12:23 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 03:12:23.801148 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2c7a648e-a708-4e40-a26f-2c15b38b1e24 tempest-FlavorsAdminTestJSON-1723856304 tempest-FlavorsAdminTestJSON-1723856304-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1618725700", "id": 1357458220, "os-flavor-access:is_public": "False"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:12:23.897098 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=5,nova_api:DELETE=7,nova_api:UPDATE=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:12:23.905793 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2c7a648e-a708-4e40-a26f-2c15b38b1e24 tempest-FlavorsAdminTestJSON-1723856304 tempest-FlavorsAdminTestJSON-1723856304-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.109099 Oct 19 03:12:23.909975 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 24/51] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:12:23 2022] POST /compute/v2.1/flavors => generated 430 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:12:23.915416 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-473da3c1-91d3-41b8-b1eb-7533a2991385 tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:12:23.919425 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-473da3c1-91d3-41b8-b1eb-7533a2991385 tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] Request method failure captured: Oct 19 03:12:23.919425 n-d-861333-8 devstack@n-api.service[121135]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 19 03:12:23.919425 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:12:23.919425 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:12:23.919425 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:12:23.919425 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 27 Oct 19 03:12:23.919425 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:12:23.919425 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:12:23.919425 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:12:23.919425 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:12:23.919425 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2sSQw-193CFmXE1yZgEnt0B3HgVL-IByl9MkeVBZk-c5KX0vUCmee3Q0oqzDaNKo9zJeIds0ifmz-3fVGnI07Mrtz7rATgZAGe_rfcJbl1B9R7uDkjNChQt8Zzl7L6Y7Y0MAayowWf26ukVUUTqdgL5K-itKe6rSciyrvMsk-0EdJ0 Oct 19 03:12:23.919425 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:12:23.919425 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:12:23.919425 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:12:23.919425 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:12:23.919425 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:12:23.919425 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:12:23.919425 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: de26c267165d46af9fc562fad55e974a Oct 19 03:12:23.919425 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1537588694 Oct 19 03:12:23.919425 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member,admin Oct 19 03:12:23.919425 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member,admin Oct 19 03:12:23.923101 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/de26c267165d46af9fc562fad55e974a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/de26c267165d46af9fc562fad55e974a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/de26c267165d46af9fc562fad55e974a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_de26c267165d46af9fc562fad55e974a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:12:23.923101 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1537588694 Oct 19 03:12:23.923101 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: de26c267165d46af9fc562fad55e974a Oct 19 03:12:23.923101 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1537588694 Oct 19 03:12:23.923101 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin Oct 19 03:12:23.923101 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:12:23.923101 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:12:23.923101 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 182578638f5640fda56795a868e20798 Oct 19 03:12:23.923101 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin Oct 19 03:12:23.923101 n-d-861333-8 devstack@n-api.service[121135]: Oct 19 03:12:23.923101 n-d-861333-8 devstack@n-api.service[121135]: {"aggregate": {"name": ""}} Oct 19 03:12:23.923101 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:12:23.923101 n-d-861333-8 devstack@n-api.service[121135]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 19 03:12:23.923737 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'body': {'aggregate': {'name': ''}}} Oct 19 03:12:23.923737 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:12:23.923737 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:12:23.923737 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 03:12:23.923737 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 03:12:23.923737 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 03:12:23.923737 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise error Oct 19 03:12:23.923737 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 19 03:12:23.923737 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:12:23.923737 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Oct 19 03:12:23.923737 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 19 03:12:23.923737 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:12:23.923737 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 19 03:12:23.923737 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi '' Oct 19 03:12:23.923737 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:12:23.923737 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:12:23.923737 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:12:23.923737 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:12:23.923737 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:12:23.923737 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:12:23.923737 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:12:23.923737 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:12:23.923737 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:12:23.924838 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:12:23.924838 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:12:23.924838 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:12:23.924838 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 03:12:23.924838 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 03:12:23.924838 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 03:12:23.924838 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 03:12:23.924838 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 03:12:23.924838 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 03:12:23.924838 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 19 03:12:23.924838 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:12:23.924838 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:12:23.924838 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:12:23.924838 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:12:23.924838 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:12:23.924838 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:12:23.924838 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 03:12:23.924838 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 03:12:23.924838 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 19 03:12:23.924838 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:12:23.926706 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-473da3c1-91d3-41b8-b1eb-7533a2991385 tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:12:23.926706 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-473da3c1-91d3-41b8-b1eb-7533a2991385 tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.011454 Oct 19 03:12:23.926706 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 25/52] 10.222.0.52 () {60 vars in 1164 bytes} [Wed Oct 19 03:12:23 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 03:12:23.928886 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-203033cb-fd49-40c6-b0ee-a7d86c24dff0 tempest-FlavorsAdminTestJSON-161469764 tempest-FlavorsAdminTestJSON-161469764-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "1357458220"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:12:23.948581 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-203033cb-fd49-40c6-b0ee-a7d86c24dff0 tempest-FlavorsAdminTestJSON-161469764 tempest-FlavorsAdminTestJSON-161469764-project] HTTP exception thrown: Flavor 1357458220 could not be found. Oct 19 03:12:23.952196 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-203033cb-fd49-40c6-b0ee-a7d86c24dff0 tempest-FlavorsAdminTestJSON-161469764 tempest-FlavorsAdminTestJSON-161469764-project] Request method failure captured: Oct 19 03:12:23.952196 n-d-861333-8 devstack@n-api.service[121135]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 19 03:12:23.952196 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:12:23.952196 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:12:23.952196 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:12:23.952196 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 107 Oct 19 03:12:23.952196 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:12:23.952196 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:12:23.952196 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:12:23.952196 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:12:23.952196 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2sPJipyOIP27XOZUO1LWpkOZgjgDySgQZNIDSv8aboPl5X2sbi_s4DU6nZm0Livap7-CfXpo0EywUu99BG-6O8p3zTI9A3W7AKLWBe3XQSUIq6TwSGesPrA9Mz0EdSHu0RRzIs9v6ldwHF9u8NkhibfgDptpesSEpfsuZ6u7tuoVrM Oct 19 03:12:23.952196 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:12:23.952196 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:12:23.952196 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:12:23.952196 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:12:23.952196 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:12:23.952196 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:12:23.952196 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: a2dfcb647e754c22b9b504c17b8ed96f Oct 19 03:12:23.952196 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-FlavorsAdminTestJSON-161469764 Oct 19 03:12:23.952196 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:12:23.952196 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:12:23.953456 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a2dfcb647e754c22b9b504c17b8ed96f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a2dfcb647e754c22b9b504c17b8ed96f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a2dfcb647e754c22b9b504c17b8ed96f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a2dfcb647e754c22b9b504c17b8ed96f", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:12:23.953456 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-FlavorsAdminTestJSON-161469764 Oct 19 03:12:23.953456 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: a2dfcb647e754c22b9b504c17b8ed96f Oct 19 03:12:23.953456 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-161469764 Oct 19 03:12:23.953456 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-FlavorsAdminTestJSON-161469764-project Oct 19 03:12:23.953456 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:12:23.953456 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:12:23.953456 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 6d00edfd8fb24451b9428721a1ab69c7 Oct 19 03:12:23.953456 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-FlavorsAdminTestJSON-161469764-project Oct 19 03:12:23.953456 n-d-861333-8 devstack@n-api.service[121135]: Oct 19 03:12:23.953456 n-d-861333-8 devstack@n-api.service[121135]: {"server": {"name": "test", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "1357458220"}} Oct 19 03:12:23.953456 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:12:23.953456 n-d-861333-8 devstack@n-api.service[121135]: exception: Flavor 1357458220 could not be found. Oct 19 03:12:23.954090 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'body': {'server': {'name': 'test', 'imageRef': '9e16d73e-70ea-4421-aee3-047d80396c02', 'flavorRef': '1357458220'}}} Oct 19 03:12:23.954090 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:12:23.954090 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:12:23.954090 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 19 03:12:23.954090 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 19 03:12:23.954090 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 19 03:12:23.954090 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 19 03:12:23.954090 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 03:12:23.954090 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 03:12:23.954090 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 19 03:12:23.954090 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 19 03:12:23.954090 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 19 03:12:23.954090 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:12:23.954090 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 19 03:12:23.954090 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 19 03:12:23.954090 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 1357458220 could not be found. Oct 19 03:12:23.954090 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:12:23.954090 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:12:23.954090 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:12:23.954090 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:12:23.955010 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:12:23.955010 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:12:23.955010 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:12:23.955010 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:12:23.955010 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:12:23.955010 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:12:23.955010 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:12:23.955010 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:12:23.955010 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:12:23.955010 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:12:23.955010 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:12:23.955010 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:12:23.955010 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 19 03:12:23.955010 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 19 03:12:23.955010 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 19 03:12:23.955010 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 1357458220 could not be found. Oct 19 03:12:23.955010 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:12:23.955010 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:12:23.955010 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:12:23.955010 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:12:23.955010 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:12:23.955950 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:12:23.955950 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:12:23.955950 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:12:23.955950 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1357458220 could not be found. Oct 19 03:12:23.955950 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:12:23.955950 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-203033cb-fd49-40c6-b0ee-a7d86c24dff0 tempest-FlavorsAdminTestJSON-161469764 tempest-FlavorsAdminTestJSON-161469764-project] Returning 400 to user: Flavor 1357458220 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:12:23.955950 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-203033cb-fd49-40c6-b0ee-a7d86c24dff0 tempest-FlavorsAdminTestJSON-161469764 tempest-FlavorsAdminTestJSON-161469764-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.029058 Oct 19 03:12:23.955950 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 26/53] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:12:23 2022] POST /compute/v2.1/servers => generated 81 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 19 03:12:23.959409 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-194f6a09-dfdc-4c3d-8524-a6f8b2e00966 tempest-AggregatesAdminNegativeTestJSON-1649350433 tempest-AggregatesAdminNegativeTestJSON-1649350433-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1864454107"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:12:23.962748 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-194f6a09-dfdc-4c3d-8524-a6f8b2e00966 tempest-AggregatesAdminNegativeTestJSON-1649350433 tempest-AggregatesAdminNegativeTestJSON-1649350433-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': 'b09e6864e9c04d6aaa1d4d210733c3d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f400c62b5a9417b8d0c10047a9e43b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:12:23.964553 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-194f6a09-dfdc-4c3d-8524-a6f8b2e00966 tempest-AggregatesAdminNegativeTestJSON-1649350433 tempest-AggregatesAdminNegativeTestJSON-1649350433-project] Request method failure captured: Oct 19 03:12:23.964553 n-d-861333-8 devstack@n-api.service[121135]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 19 03:12:23.964553 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:12:23.964553 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:12:23.964553 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:12:23.964553 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 60 Oct 19 03:12:23.964553 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:12:23.964553 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:12:23.964553 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:12:23.964553 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:12:23.964553 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2sPwoyuBijUT-jxC0uUUPhVqAwh9DMb8Lx224kKtLAN9vAmcN-d1fZoJb-X6cckijL8297lUWtY71vdBMRABXjXHfUvR_YrhylxKEFRY_Xt_oUCBt65EYiqUhOD7HwX9hSHq-gf5YDnqleXRvIZbTZmK-cAziyRBTBPDAmEwyrHgUY Oct 19 03:12:23.964553 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:12:23.964553 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:12:23.964553 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:12:23.964553 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:12:23.964553 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:12:23.964553 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:12:23.964553 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 4f400c62b5a9417b8d0c10047a9e43b6 Oct 19 03:12:23.964553 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1649350433 Oct 19 03:12:23.964553 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:12:23.964553 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:12:23.965806 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4f400c62b5a9417b8d0c10047a9e43b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4f400c62b5a9417b8d0c10047a9e43b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4f400c62b5a9417b8d0c10047a9e43b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4f400c62b5a9417b8d0c10047a9e43b6", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:12:23.965806 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1649350433 Oct 19 03:12:23.965806 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 4f400c62b5a9417b8d0c10047a9e43b6 Oct 19 03:12:23.965806 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1649350433 Oct 19 03:12:23.965806 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-AggregatesAdminNegativeTestJSON-1649350433-project Oct 19 03:12:23.965806 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:12:23.965806 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:12:23.965806 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: b09e6864e9c04d6aaa1d4d210733c3d8 Oct 19 03:12:23.965806 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1649350433-project Oct 19 03:12:23.965806 n-d-861333-8 devstack@n-api.service[121135]: Oct 19 03:12:23.965806 n-d-861333-8 devstack@n-api.service[121135]: {"aggregate": {"name": "tempest-test_aggregate-1864454107"}} Oct 19 03:12:23.965806 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:12:23.965806 n-d-861333-8 devstack@n-api.service[121135]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 19 03:12:23.966519 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1864454107'}}} Oct 19 03:12:23.966519 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:12:23.966519 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:12:23.966519 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:12:23.966519 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:12:23.966519 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:12:23.966519 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:12:23.966519 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:12:23.966519 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:12:23.966519 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:12:23.966519 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:12:23.966519 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:12:23.966519 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:12:23.966519 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Oct 19 03:12:23.966519 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Oct 19 03:12:23.966519 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 19 03:12:23.966519 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 19 03:12:23.966519 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 19 03:12:23.966519 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 19 03:12:23.967427 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 03:12:23.967427 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 03:12:23.967427 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 03:12:23.967427 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 03:12:23.967427 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 19 03:12:23.967427 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 19 03:12:23.967427 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 19 03:12:23.967427 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 19 03:12:23.967427 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 19 03:12:23.967427 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 19 03:12:23.967427 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 19 03:12:23.967427 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:12:23.967427 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:12:23.967427 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:12:23.967427 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:12:23.967427 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:12:23.967427 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:12:23.967427 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 19 03:12:23.967427 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 19 03:12:23.967427 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 19 03:12:23.968761 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:12:23.968761 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-194f6a09-dfdc-4c3d-8524-a6f8b2e00966 tempest-AggregatesAdminNegativeTestJSON-1649350433 tempest-AggregatesAdminNegativeTestJSON-1649350433-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:12:23.968761 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-194f6a09-dfdc-4c3d-8524-a6f8b2e00966 tempest-AggregatesAdminNegativeTestJSON-1649350433 tempest-AggregatesAdminNegativeTestJSON-1649350433-project] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.010863 Oct 19 03:12:23.968761 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 27/54] 10.222.0.52 () {60 vars in 1164 bytes} [Wed Oct 19 03:12:23 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:12:23.972271 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-542122fc-a34f-4ecb-a422-bdc1f616bf6c tempest-FlavorsAdminTestJSON-1723856304 tempest-FlavorsAdminTestJSON-1723856304-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:24.008823 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-88ec8985-a91a-4c4b-8964-b05d8dd88bdf tempest-AggregatesAdminTestV241-1151926969 tempest-AggregatesAdminTestV241-1151926969-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 298 microversion: 2.41 time: 0.337810 Oct 19 03:12:24.014716 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 28/55] 10.222.0.52 () {62 vars in 1232 bytes} [Wed Oct 19 03:12:23 2022] POST /compute/v2.1/os-aggregates/3/action => generated 298 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 03:12:24.021887 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-dd01adcb-4639-4085-99c5-b639b716783f tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1000949178"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:12:24.027338 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.aggregate [None req-dd01adcb-4639-4085-99c5-b639b716783f tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] Generated uuid 5cbb6c1a-6539-456c-b85b-96ed026ffba6 for aggregate {{(pid=121134) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 19 03:12:24.064957 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-542122fc-a34f-4ecb-a422-bdc1f616bf6c tempest-FlavorsAdminTestJSON-1723856304 tempest-FlavorsAdminTestJSON-1723856304-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/1357458220" status: 202 len: 0 microversion: 2.1 time: 0.096768 Oct 19 03:12:24.065917 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 28/56] 10.222.0.52 () {58 vars in 1161 bytes} [Wed Oct 19 03:12:23 2022] DELETE /compute/v2.1/flavors/1357458220 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:12:24.079455 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-74e89fc6-89cf-4503-9500-59e003cbbab9 tempest-AggregatesAdminTestV241-1151926969 tempest-AggregatesAdminTestV241-1151926969-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:24.144225 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-dd01adcb-4639-4085-99c5-b639b716783f tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.126542 Oct 19 03:12:24.145353 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 29/57] 10.222.0.52 () {60 vars in 1164 bytes} [Wed Oct 19 03:12:24 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:12:24.156904 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-45f40c53-b7d4-4c9b-b278-5742d6dc8ad0 tempest-FlavorsAdminTestJSON-1723856304 tempest-FlavorsAdminTestJSON-1723856304-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:24.189064 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-45f40c53-b7d4-4c9b-b278-5742d6dc8ad0 tempest-FlavorsAdminTestJSON-1723856304 tempest-FlavorsAdminTestJSON-1723856304-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.041679 Oct 19 03:12:24.190705 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 30/58] 10.222.0.52 () {58 vars in 1146 bytes} [Wed Oct 19 03:12:24 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:12:24.210644 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-65690c7c-f109-4ded-840a-bda1340f1d7b tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1000949178"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:12:24.214449 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-74e89fc6-89cf-4503-9500-59e003cbbab9 tempest-AggregatesAdminTestV241-1151926969 tempest-AggregatesAdminTestV241-1151926969-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.41 time: 0.144878 Oct 19 03:12:24.223741 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 29/59] 10.222.0.52 () {60 vars in 1193 bytes} [Wed Oct 19 03:12:24 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:12:24.224088 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.aggregate [None req-65690c7c-f109-4ded-840a-bda1340f1d7b tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] Generated uuid b50e95f5-4a48-45af-8a63-a37dbee75409 for aggregate {{(pid=121134) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 19 03:12:24.230859 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3d1f11a7-bb1a-497d-850e-37310dfb32f5 tempest-FlavorsAdminTestJSON-1723856304 tempest-FlavorsAdminTestJSON-1723856304-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1277331632", "id": 1747198282, "os-flavor-access:is_public": "False"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:12:24.246264 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-65690c7c-f109-4ded-840a-bda1340f1d7b tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-1000949178 already exists. Oct 19 03:12:24.250319 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-65690c7c-f109-4ded-840a-bda1340f1d7b tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] Request method failure captured: Oct 19 03:12:24.250319 n-d-861333-8 devstack@n-api.service[121134]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 19 03:12:24.250319 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:12:24.250319 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:12:24.250319 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:12:24.250319 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 60 Oct 19 03:12:24.250319 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:12:24.250319 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:12:24.250319 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:12:24.250319 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:12:24.250319 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT2sSQw-193CFmXE1yZgEnt0B3HgVL-IByl9MkeVBZk-c5KX0vUCmee3Q0oqzDaNKo9zJeIds0ifmz-3fVGnI07Mrtz7rATgZAGe_rfcJbl1B9R7uDkjNChQt8Zzl7L6Y7Y0MAayowWf26ukVUUTqdgL5K-itKe6rSciyrvMsk-0EdJ0 Oct 19 03:12:24.250319 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:12:24.250319 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:12:24.250319 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:12:24.250319 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:12:24.250319 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:12:24.250319 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:12:24.250319 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: de26c267165d46af9fc562fad55e974a Oct 19 03:12:24.250319 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1537588694 Oct 19 03:12:24.250319 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member,admin Oct 19 03:12:24.250319 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member,admin Oct 19 03:12:24.251359 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/de26c267165d46af9fc562fad55e974a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/de26c267165d46af9fc562fad55e974a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/de26c267165d46af9fc562fad55e974a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_de26c267165d46af9fc562fad55e974a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:12:24.251359 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1537588694 Oct 19 03:12:24.251359 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: de26c267165d46af9fc562fad55e974a Oct 19 03:12:24.251359 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1537588694 Oct 19 03:12:24.251359 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin Oct 19 03:12:24.251359 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:12:24.251359 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:12:24.251359 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 182578638f5640fda56795a868e20798 Oct 19 03:12:24.251359 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin Oct 19 03:12:24.251359 n-d-861333-8 devstack@n-api.service[121134]: Oct 19 03:12:24.251359 n-d-861333-8 devstack@n-api.service[121134]: {"aggregate": {"name": "tempest-test_aggregate-1000949178"}} Oct 19 03:12:24.251359 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:12:24.251359 n-d-861333-8 devstack@n-api.service[121134]: exception: Aggregate tempest-test_aggregate-1000949178 already exists. Oct 19 03:12:24.252000 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1000949178'}}} Oct 19 03:12:24.252000 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:12:24.252000 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:12:24.252000 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Oct 19 03:12:24.252000 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Oct 19 03:12:24.252000 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 19 03:12:24.252000 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 19 03:12:24.252000 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 03:12:24.252000 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 03:12:24.252000 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 03:12:24.252000 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 03:12:24.252000 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 19 03:12:24.252000 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 19 03:12:24.252000 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6458, in create_aggregate Oct 19 03:12:24.252000 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi aggregate.create() Oct 19 03:12:24.252000 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 19 03:12:24.252000 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 19 03:12:24.252000 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Oct 19 03:12:24.252000 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Oct 19 03:12:24.252921 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 19 03:12:24.252921 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 19 03:12:24.252921 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Oct 19 03:12:24.252921 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Oct 19 03:12:24.252921 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-1000949178 already exists. Oct 19 03:12:24.252921 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:12:24.252921 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:12:24.252921 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:12:24.252921 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:12:24.252921 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:12:24.252921 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:12:24.252921 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:12:24.252921 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:12:24.252921 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:12:24.252921 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:12:24.252921 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:12:24.252921 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:12:24.252921 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:12:24.252921 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:12:24.252921 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Oct 19 03:12:24.253968 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 19 03:12:24.253968 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-1000949178 already exists. Oct 19 03:12:24.253968 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:12:24.253968 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:12:24.253968 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:12:24.253968 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:12:24.253968 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:12:24.253968 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:12:24.253968 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:12:24.253968 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:12:24.253968 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-1000949178 already exists. Oct 19 03:12:24.253968 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:12:24.256139 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-65690c7c-f109-4ded-840a-bda1340f1d7b tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-1000949178 already exists. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:12:24.257472 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-65690c7c-f109-4ded-840a-bda1340f1d7b tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.065573 Oct 19 03:12:24.262230 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 31/60] 10.222.0.52 () {60 vars in 1164 bytes} [Wed Oct 19 03:12:24 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 71 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 19 03:12:24.268192 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8817561e-083f-4f8f-ad1a-0197e5bbcb03 tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:24.409852 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8817561e-083f-4f8f-ad1a-0197e5bbcb03 tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.134234 Oct 19 03:12:24.409852 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 32/61] 10.222.0.52 () {58 vars in 1152 bytes} [Wed Oct 19 03:12:24 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 19 03:12:24.425389 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-3d1f11a7-bb1a-497d-850e-37310dfb32f5 tempest-FlavorsAdminTestJSON-1723856304 tempest-FlavorsAdminTestJSON-1723856304-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.199721 Oct 19 03:12:24.437430 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 30/62] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:12:24 2022] POST /compute/v2.1/flavors => generated 415 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:12:24.438419 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f33b594b-46dd-46d0-9a26-92025e809cf0 tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-392787927", "name": "tempest-test_aggregate-895848561"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:12:24.445865 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2ea1b1a9-0c8f-40db-a86d-ac4444d068dc tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1524468302"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:12:24.463475 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.aggregate [None req-2ea1b1a9-0c8f-40db-a86d-ac4444d068dc tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] Generated uuid c80166b7-af4b-4257-99b3-73a60beedc2a for aggregate {{(pid=121135) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 19 03:12:24.498341 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.aggregate [None req-f33b594b-46dd-46d0-9a26-92025e809cf0 tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] Generated uuid c4e99454-82c3-4e88-9b23-bfec1b86cc93 for aggregate {{(pid=121134) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 19 03:12:24.558482 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2ea1b1a9-0c8f-40db-a86d-ac4444d068dc tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.114852 Oct 19 03:12:24.560352 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 31/63] 10.222.0.52 () {60 vars in 1164 bytes} [Wed Oct 19 03:12:24 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:12:24.567652 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9f5557cf-d196-4564-93ea-abd42d30be14 tempest-FlavorsAdminTestJSON-1723856304 tempest-FlavorsAdminTestJSON-1723856304-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-187645092", "id": 1812445903, "os-flavor-access:is_public": "True"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:12:24.597428 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f33b594b-46dd-46d0-9a26-92025e809cf0 tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 200 len: 220 microversion: 2.1 time: 0.191984 Oct 19 03:12:24.599851 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 33/64] 10.222.0.52 () {60 vars in 1165 bytes} [Wed Oct 19 03:12:24 2022] POST /compute/v2.1/os-aggregates => generated 220 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:12:24.606474 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ad7877cd-3f3b-4a70-9b80-cd564860ca19 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:24.607141 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ad7877cd-3f3b-4a70-9b80-cd564860ca19 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] [instance: 7a48466f-9d33-480f-b67a-21777e03d4d5] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:12:24.618987 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ad7877cd-3f3b-4a70-9b80-cd564860ca19 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:24.619867 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ad7877cd-3f3b-4a70-9b80-cd564860ca19 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:24.620558 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ad7877cd-3f3b-4a70-9b80-cd564860ca19 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:24.621408 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ad7877cd-3f3b-4a70-9b80-cd564860ca19 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:24.622258 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ad7877cd-3f3b-4a70-9b80-cd564860ca19 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:24.623367 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ad7877cd-3f3b-4a70-9b80-cd564860ca19 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:24.680429 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9f5557cf-d196-4564-93ea-abd42d30be14 tempest-FlavorsAdminTestJSON-1723856304 tempest-FlavorsAdminTestJSON-1723856304-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.118766 Oct 19 03:12:24.681310 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 32/65] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:12:24 2022] POST /compute/v2.1/flavors => generated 413 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:12:24.686388 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d0520ff5-a739-4b83-851a-3bc5ac27b107 tempest-AggregatesAdminNegativeTestJSON-1649350433 tempest-AggregatesAdminNegativeTestJSON-1649350433-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:24.688363 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d0520ff5-a739-4b83-851a-3bc5ac27b107 tempest-AggregatesAdminNegativeTestJSON-1649350433 tempest-AggregatesAdminNegativeTestJSON-1649350433-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': 'b09e6864e9c04d6aaa1d4d210733c3d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f400c62b5a9417b8d0c10047a9e43b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:12:24.690209 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d0520ff5-a739-4b83-851a-3bc5ac27b107 tempest-AggregatesAdminNegativeTestJSON-1649350433 tempest-AggregatesAdminNegativeTestJSON-1649350433-project] Request method failure captured: Oct 19 03:12:24.690209 n-d-861333-8 devstack@n-api.service[121135]: request: DELETE /compute/v2.1/os-aggregates/6 HTTP/1.1 Oct 19 03:12:24.690209 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:12:24.690209 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:12:24.690209 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:12:24.690209 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:12:24.690209 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:12:24.690209 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:12:24.690209 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:12:24.690209 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:12:24.690209 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2sPwoyuBijUT-jxC0uUUPhVqAwh9DMb8Lx224kKtLAN9vAmcN-d1fZoJb-X6cckijL8297lUWtY71vdBMRABXjXHfUvR_YrhylxKEFRY_Xt_oUCBt65EYiqUhOD7HwX9hSHq-gf5YDnqleXRvIZbTZmK-cAziyRBTBPDAmEwyrHgUY Oct 19 03:12:24.690209 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:12:24.690209 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:12:24.690209 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:12:24.690209 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:12:24.690209 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:12:24.690209 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:12:24.690209 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 4f400c62b5a9417b8d0c10047a9e43b6 Oct 19 03:12:24.690209 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1649350433 Oct 19 03:12:24.690209 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:12:24.690209 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:12:24.691243 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4f400c62b5a9417b8d0c10047a9e43b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4f400c62b5a9417b8d0c10047a9e43b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4f400c62b5a9417b8d0c10047a9e43b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4f400c62b5a9417b8d0c10047a9e43b6", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:12:24.691243 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1649350433 Oct 19 03:12:24.691243 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 4f400c62b5a9417b8d0c10047a9e43b6 Oct 19 03:12:24.691243 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1649350433 Oct 19 03:12:24.691243 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-AggregatesAdminNegativeTestJSON-1649350433-project Oct 19 03:12:24.691243 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:12:24.691243 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:12:24.691243 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: b09e6864e9c04d6aaa1d4d210733c3d8 Oct 19 03:12:24.691243 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1649350433-project Oct 19 03:12:24.691243 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:12:24.691243 n-d-861333-8 devstack@n-api.service[121135]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 19 03:12:24.691243 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '6'} Oct 19 03:12:24.691816 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:12:24.691816 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:12:24.691816 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:12:24.691816 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:12:24.691816 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:12:24.691816 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:12:24.691816 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:12:24.691816 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:12:24.691816 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Oct 19 03:12:24.691816 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Oct 19 03:12:24.691816 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 19 03:12:24.691816 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 19 03:12:24.691816 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 19 03:12:24.691816 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 19 03:12:24.691816 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 03:12:24.691816 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 03:12:24.691816 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 03:12:24.691816 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 03:12:24.691816 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 19 03:12:24.696473 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 19 03:12:24.696473 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 19 03:12:24.696473 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 19 03:12:24.696473 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 19 03:12:24.696473 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 19 03:12:24.696473 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 19 03:12:24.696473 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:12:24.696473 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:12:24.696473 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:12:24.696473 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:12:24.696473 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:12:24.696473 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:12:24.696473 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 19 03:12:24.696473 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 19 03:12:24.696473 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 19 03:12:24.696473 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:12:24.696473 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d0520ff5-a739-4b83-851a-3bc5ac27b107 tempest-AggregatesAdminNegativeTestJSON-1649350433 tempest-AggregatesAdminNegativeTestJSON-1649350433-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:12:24.697333 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d0520ff5-a739-4b83-851a-3bc5ac27b107 tempest-AggregatesAdminNegativeTestJSON-1649350433 tempest-AggregatesAdminNegativeTestJSON-1649350433-project] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/6" status: 403 len: 116 microversion: 2.1 time: 0.009001 Oct 19 03:12:24.697333 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 33/66] 10.222.0.52 () {58 vars in 1152 bytes} [Wed Oct 19 03:12:24 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 116 bytes in 10 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:12:24.697333 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4427b1b7-2fbd-48d9-8bec-2c89b447e2aa tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:24.703231 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ad7877cd-3f3b-4a70-9b80-cd564860ca19 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '769928c8ecb643fa83a9d58465dcb263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ead65f008349329789135966c031d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:12:24.713153 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ad7877cd-3f3b-4a70-9b80-cd564860ca19 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] 10.222.0.52 "GET /compute/v2.1/servers/7a48466f-9d33-480f-b67a-21777e03d4d5" status: 200 len: 1278 microversion: 2.1 time: 0.111971 Oct 19 03:12:24.713842 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 34/67] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:12:24 2022] GET /compute/v2.1/servers/7a48466f-9d33-480f-b67a-21777e03d4d5 => generated 1278 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:12:24.725275 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-51b29bb6-d079-4753-80a1-02b8bbe25ab5 tempest-FlavorsAdminTestJSON-1723856304 tempest-FlavorsAdminTestJSON-1723856304-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:24.732848 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4427b1b7-2fbd-48d9-8bec-2c89b447e2aa tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] 10.222.0.52 "GET /compute/v2.1/os-aggregates" status: 200 len: 514 microversion: 2.1 time: 0.039429 Oct 19 03:12:24.733469 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 34/68] 10.222.0.52 () {58 vars in 1143 bytes} [Wed Oct 19 03:12:24 2022] GET /compute/v2.1/os-aggregates => generated 514 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:12:24.747314 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-51b29bb6-d079-4753-80a1-02b8bbe25ab5 tempest-FlavorsAdminTestJSON-1723856304 tempest-FlavorsAdminTestJSON-1723856304-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 418 microversion: 2.1 time: 0.027843 Oct 19 03:12:24.748045 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 35/69] 10.222.0.52 () {58 vars in 1169 bytes} [Wed Oct 19 03:12:24 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 418 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:12:24.754019 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d9013a58-c651-4cea-a7e3-a4782d16fc3b tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-861333-8"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:12:24.757506 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a94fe774-44a0-495e-966e-f2dff5958053 tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:24.773299 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d9013a58-c651-4cea-a7e3-a4782d16fc3b tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:24.774239 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d9013a58-c651-4cea-a7e3-a4782d16fc3b tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:24.774758 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d9013a58-c651-4cea-a7e3-a4782d16fc3b tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:24.875395 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a94fe774-44a0-495e-966e-f2dff5958053 tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.138460 Oct 19 03:12:24.880825 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 35/70] 10.222.0.52 () {58 vars in 1152 bytes} [Wed Oct 19 03:12:24 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 19 03:12:24.882911 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a919df4f-0257-48e3-90cc-aa14ea4318c7 tempest-FlavorsAdminTestJSON-1723856304 tempest-FlavorsAdminTestJSON-1723856304-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:24.907906 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a919df4f-0257-48e3-90cc-aa14ea4318c7 tempest-FlavorsAdminTestJSON-1723856304 tempest-FlavorsAdminTestJSON-1723856304-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 418 microversion: 2.1 time: 0.030349 Oct 19 03:12:24.908725 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 36/71] 10.222.0.52 () {58 vars in 1177 bytes} [Wed Oct 19 03:12:24 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 418 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:12:24.914868 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-21b70501-7630-4166-be2c-d261be56ecec tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:24.957747 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-21b70501-7630-4166-be2c-d261be56ecec tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 19 03:12:24.969542 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-21b70501-7630-4166-be2c-d261be56ecec tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] Request method failure captured: Oct 19 03:12:24.969542 n-d-861333-8 devstack@n-api.service[121135]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 19 03:12:24.969542 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:12:24.969542 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:12:24.969542 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:12:24.969542 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:12:24.969542 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:12:24.969542 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:12:24.969542 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:12:24.969542 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:12:24.969542 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2sSQw-193CFmXE1yZgEnt0B3HgVL-IByl9MkeVBZk-c5KX0vUCmee3Q0oqzDaNKo9zJeIds0ifmz-3fVGnI07Mrtz7rATgZAGe_rfcJbl1B9R7uDkjNChQt8Zzl7L6Y7Y0MAayowWf26ukVUUTqdgL5K-itKe6rSciyrvMsk-0EdJ0 Oct 19 03:12:24.969542 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:12:24.969542 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:12:24.969542 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:12:24.969542 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:12:24.969542 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:12:24.969542 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:12:24.969542 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: de26c267165d46af9fc562fad55e974a Oct 19 03:12:24.969542 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1537588694 Oct 19 03:12:24.969542 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member,admin Oct 19 03:12:24.969542 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member,admin Oct 19 03:12:24.970714 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/de26c267165d46af9fc562fad55e974a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/de26c267165d46af9fc562fad55e974a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/de26c267165d46af9fc562fad55e974a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_de26c267165d46af9fc562fad55e974a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:12:24.970714 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1537588694 Oct 19 03:12:24.970714 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: de26c267165d46af9fc562fad55e974a Oct 19 03:12:24.970714 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1537588694 Oct 19 03:12:24.970714 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin Oct 19 03:12:24.970714 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:12:24.970714 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:12:24.970714 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 182578638f5640fda56795a868e20798 Oct 19 03:12:24.970714 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin Oct 19 03:12:24.970714 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:12:24.970714 n-d-861333-8 devstack@n-api.service[121135]: exception: Aggregate -1 could not be found. Oct 19 03:12:24.970714 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '-1'} Oct 19 03:12:24.971312 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:12:24.971312 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:12:24.971312 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 19 03:12:24.971312 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 19 03:12:24.971312 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 19 03:12:24.971312 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 19 03:12:24.971312 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 03:12:24.971312 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 03:12:24.971312 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 03:12:24.971312 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 03:12:24.971312 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 19 03:12:24.971312 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 19 03:12:24.971312 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 19 03:12:24.971312 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 19 03:12:24.971312 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 03:12:24.971312 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 03:12:24.971312 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 19 03:12:24.971312 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 19 03:12:24.971312 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 19 03:12:24.972204 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 19 03:12:24.972204 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 19 03:12:24.972204 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 19 03:12:24.972204 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 19 03:12:24.972204 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:12:24.972204 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:12:24.972204 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:12:24.972204 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:12:24.972204 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:12:24.972204 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:12:24.972204 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:12:24.972204 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:12:24.972204 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:12:24.972204 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:12:24.972204 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 19 03:12:24.972204 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:12:24.972204 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 19 03:12:24.972204 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:12:24.972204 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:12:24.972204 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:12:24.972204 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:12:24.973292 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:12:24.973292 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:12:24.973292 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:12:24.973292 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:12:24.973292 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 19 03:12:24.973292 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:12:24.973292 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-21b70501-7630-4166-be2c-d261be56ecec tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:12:24.973292 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-21b70501-7630-4166-be2c-d261be56ecec tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.061150 Oct 19 03:12:24.977471 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 37/72] 10.222.0.52 () {58 vars in 1155 bytes} [Wed Oct 19 03:12:24 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 03:12:24.985081 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0813efb5-4524-4e17-a2f6-adfba557ecf5 tempest-FlavorsAdminTestJSON-1723856304 tempest-FlavorsAdminTestJSON-1723856304-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:25.016973 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0813efb5-4524-4e17-a2f6-adfba557ecf5 tempest-FlavorsAdminTestJSON-1723856304 tempest-FlavorsAdminTestJSON-1723856304-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 418 microversion: 2.1 time: 0.039519 Oct 19 03:12:25.018069 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 38/73] 10.222.0.52 () {58 vars in 1171 bytes} [Wed Oct 19 03:12:24 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 418 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:12:25.023384 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-cc61eed1-df16-4e44-96fe-6f689e98db9d tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-848823885"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:12:25.040964 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.aggregate [None req-cc61eed1-df16-4e44-96fe-6f689e98db9d tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] Generated uuid e71d1cc8-de58-4e34-8e28-e71a40bc636e for aggregate {{(pid=121135) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 19 03:12:25.190804 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-cc61eed1-df16-4e44-96fe-6f689e98db9d tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.168877 Oct 19 03:12:25.191457 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 39/74] 10.222.0.52 () {60 vars in 1164 bytes} [Wed Oct 19 03:12:25 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:12:25.200757 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-19112e9e-5f90-411c-b1a8-b6535427ca7e tempest-FlavorsAdminTestJSON-1723856304 tempest-FlavorsAdminTestJSON-1723856304-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:25.208287 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d9013a58-c651-4cea-a7e3-a4782d16fc3b tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/7/action" status: 200 len: 312 microversion: 2.1 time: 0.457865 Oct 19 03:12:25.208835 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 36/75] 10.222.0.52 () {60 vars in 1191 bytes} [Wed Oct 19 03:12:24 2022] POST /compute/v2.1/os-aggregates/7/action => generated 312 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:12:25.226866 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d4fb4d89-44fd-4812-b9e2-5adee0cdd80c tempest-AggregatesAdminNegativeTestJSON-1649350433 tempest-AggregatesAdminNegativeTestJSON-1649350433-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:25.239377 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d4fb4d89-44fd-4812-b9e2-5adee0cdd80c tempest-AggregatesAdminNegativeTestJSON-1649350433 tempest-AggregatesAdminNegativeTestJSON-1649350433-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': 'b09e6864e9c04d6aaa1d4d210733c3d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f400c62b5a9417b8d0c10047a9e43b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:12:25.243095 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d4fb4d89-44fd-4812-b9e2-5adee0cdd80c tempest-AggregatesAdminNegativeTestJSON-1649350433 tempest-AggregatesAdminNegativeTestJSON-1649350433-project] Request method failure captured: Oct 19 03:12:25.243095 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/os-aggregates/8 HTTP/1.1 Oct 19 03:12:25.243095 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:12:25.243095 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:12:25.243095 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:12:25.243095 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:12:25.243095 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:12:25.243095 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:12:25.243095 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:12:25.243095 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:12:25.243095 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT2sPwoyuBijUT-jxC0uUUPhVqAwh9DMb8Lx224kKtLAN9vAmcN-d1fZoJb-X6cckijL8297lUWtY71vdBMRABXjXHfUvR_YrhylxKEFRY_Xt_oUCBt65EYiqUhOD7HwX9hSHq-gf5YDnqleXRvIZbTZmK-cAziyRBTBPDAmEwyrHgUY Oct 19 03:12:25.243095 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:12:25.243095 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:12:25.243095 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:12:25.243095 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:12:25.243095 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:12:25.243095 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:12:25.243095 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 4f400c62b5a9417b8d0c10047a9e43b6 Oct 19 03:12:25.243095 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1649350433 Oct 19 03:12:25.243095 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:12:25.243095 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:12:25.244406 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4f400c62b5a9417b8d0c10047a9e43b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4f400c62b5a9417b8d0c10047a9e43b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4f400c62b5a9417b8d0c10047a9e43b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4f400c62b5a9417b8d0c10047a9e43b6", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:12:25.244406 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1649350433 Oct 19 03:12:25.244406 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 4f400c62b5a9417b8d0c10047a9e43b6 Oct 19 03:12:25.244406 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1649350433 Oct 19 03:12:25.244406 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-AggregatesAdminNegativeTestJSON-1649350433-project Oct 19 03:12:25.244406 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:12:25.244406 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:12:25.244406 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: b09e6864e9c04d6aaa1d4d210733c3d8 Oct 19 03:12:25.244406 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1649350433-project Oct 19 03:12:25.244406 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:12:25.244406 n-d-861333-8 devstack@n-api.service[121134]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 19 03:12:25.244406 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '8'} Oct 19 03:12:25.245130 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:12:25.245130 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:12:25.245130 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:12:25.245130 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:12:25.245130 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:12:25.245130 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:12:25.245130 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:12:25.245130 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:12:25.245130 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Oct 19 03:12:25.245130 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Oct 19 03:12:25.245130 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 19 03:12:25.245130 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 19 03:12:25.245130 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 19 03:12:25.245130 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 19 03:12:25.245130 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 03:12:25.245130 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 03:12:25.245130 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 03:12:25.245130 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 03:12:25.245130 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 19 03:12:25.246564 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 19 03:12:25.246564 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 19 03:12:25.246564 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 19 03:12:25.246564 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 19 03:12:25.246564 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 19 03:12:25.246564 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 19 03:12:25.246564 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:12:25.246564 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:12:25.246564 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:12:25.246564 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:12:25.246564 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:12:25.246564 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:12:25.246564 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 19 03:12:25.246564 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 19 03:12:25.246564 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 19 03:12:25.246564 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:12:25.253889 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-19112e9e-5f90-411c-b1a8-b6535427ca7e tempest-FlavorsAdminTestJSON-1723856304 tempest-FlavorsAdminTestJSON-1723856304-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 418 microversion: 2.1 time: 0.056706 Oct 19 03:12:25.254275 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d4fb4d89-44fd-4812-b9e2-5adee0cdd80c tempest-AggregatesAdminNegativeTestJSON-1649350433 tempest-AggregatesAdminNegativeTestJSON-1649350433-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:12:25.255849 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d4fb4d89-44fd-4812-b9e2-5adee0cdd80c tempest-AggregatesAdminNegativeTestJSON-1649350433 tempest-AggregatesAdminNegativeTestJSON-1649350433-project] 10.222.0.52 "GET /compute/v2.1/os-aggregates/8" status: 403 len: 114 microversion: 2.1 time: 0.043091 Oct 19 03:12:25.257025 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 40/76] 10.222.0.52 () {58 vars in 1169 bytes} [Wed Oct 19 03:12:25 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 418 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:12:25.258804 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 37/77] 10.222.0.52 () {58 vars in 1149 bytes} [Wed Oct 19 03:12:25 2022] GET /compute/v2.1/os-aggregates/8 => generated 114 bytes in 46 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:12:25.267907 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5ddf0bb9-ee8d-4b7b-b430-3ac659605058 tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:25.278418 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c013219d-5021-48f5-a1c9-72944f6eb0e3 tempest-FlavorsAdminTestJSON-1723856304 tempest-FlavorsAdminTestJSON-1723856304-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:25.316696 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c013219d-5021-48f5-a1c9-72944f6eb0e3 tempest-FlavorsAdminTestJSON-1723856304 tempest-FlavorsAdminTestJSON-1723856304-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5394 microversion: 2.1 time: 0.043830 Oct 19 03:12:25.322026 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 38/78] 10.222.0.52 () {58 vars in 1169 bytes} [Wed Oct 19 03:12:25 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5394 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:12:25.345552 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-050b5241-4b4e-4e82-8db1-2f1fead6a30d tempest-FlavorsAdminTestJSON-1723856304 tempest-FlavorsAdminTestJSON-1723856304-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:25.385005 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5ddf0bb9-ee8d-4b7b-b430-3ac659605058 tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.121330 Oct 19 03:12:25.386562 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 41/79] 10.222.0.52 () {58 vars in 1152 bytes} [Wed Oct 19 03:12:25 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 19 03:12:25.396479 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1dab47c3-bdf3-448c-843b-a86fd8ea3461 tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:25.396658 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-050b5241-4b4e-4e82-8db1-2f1fead6a30d tempest-FlavorsAdminTestJSON-1723856304 tempest-FlavorsAdminTestJSON-1723856304-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5394 microversion: 2.1 time: 0.055101 Oct 19 03:12:25.401552 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 39/80] 10.222.0.52 () {58 vars in 1175 bytes} [Wed Oct 19 03:12:25 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5394 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:12:25.430919 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f6f84d55-8370-4dcb-b90c-dc98c1495086 tempest-FlavorsAdminTestJSON-1723856304 tempest-FlavorsAdminTestJSON-1723856304-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:25.435787 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-1dab47c3-bdf3-448c-843b-a86fd8ea3461 tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 19 03:12:25.435787 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1dab47c3-bdf3-448c-843b-a86fd8ea3461 tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] Request method failure captured: Oct 19 03:12:25.435787 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 19 03:12:25.435787 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:12:25.435787 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:12:25.435787 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:12:25.435787 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:12:25.435787 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:12:25.435787 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:12:25.435787 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:12:25.435787 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:12:25.435787 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2sSQw-193CFmXE1yZgEnt0B3HgVL-IByl9MkeVBZk-c5KX0vUCmee3Q0oqzDaNKo9zJeIds0ifmz-3fVGnI07Mrtz7rATgZAGe_rfcJbl1B9R7uDkjNChQt8Zzl7L6Y7Y0MAayowWf26ukVUUTqdgL5K-itKe6rSciyrvMsk-0EdJ0 Oct 19 03:12:25.435787 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:12:25.435787 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:12:25.435787 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:12:25.435787 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:12:25.435787 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:12:25.435787 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:12:25.435787 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: de26c267165d46af9fc562fad55e974a Oct 19 03:12:25.435787 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1537588694 Oct 19 03:12:25.435787 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member,admin Oct 19 03:12:25.435787 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member,admin Oct 19 03:12:25.438059 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/de26c267165d46af9fc562fad55e974a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/de26c267165d46af9fc562fad55e974a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/de26c267165d46af9fc562fad55e974a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_de26c267165d46af9fc562fad55e974a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:12:25.438059 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1537588694 Oct 19 03:12:25.438059 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: de26c267165d46af9fc562fad55e974a Oct 19 03:12:25.438059 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1537588694 Oct 19 03:12:25.438059 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin Oct 19 03:12:25.438059 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:12:25.438059 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:12:25.438059 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 182578638f5640fda56795a868e20798 Oct 19 03:12:25.438059 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin Oct 19 03:12:25.438059 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:12:25.438059 n-d-861333-8 devstack@n-api.service[121135]: exception: Aggregate -1 could not be found. Oct 19 03:12:25.438059 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '-1'} Oct 19 03:12:25.438891 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:12:25.438891 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:12:25.438891 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 19 03:12:25.438891 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 19 03:12:25.438891 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 19 03:12:25.438891 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 19 03:12:25.438891 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 03:12:25.438891 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 03:12:25.438891 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 19 03:12:25.438891 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 19 03:12:25.438891 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 19 03:12:25.438891 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 19 03:12:25.438891 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 19 03:12:25.438891 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 19 03:12:25.438891 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 19 03:12:25.438891 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:12:25.438891 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:12:25.438891 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:12:25.438891 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:12:25.438891 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:12:25.440172 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:12:25.440172 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:12:25.440172 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:12:25.440172 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:12:25.440172 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:12:25.440172 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 19 03:12:25.440172 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:12:25.440172 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 19 03:12:25.440172 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:12:25.440172 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:12:25.440172 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:12:25.440172 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:12:25.440172 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:12:25.440172 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:12:25.440172 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:12:25.440172 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:12:25.440172 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 19 03:12:25.440172 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:12:25.441189 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1dab47c3-bdf3-448c-843b-a86fd8ea3461 tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:12:25.444009 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1dab47c3-bdf3-448c-843b-a86fd8ea3461 tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] 10.222.0.52 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.051898 Oct 19 03:12:25.444917 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 42/81] 10.222.0.52 () {58 vars in 1152 bytes} [Wed Oct 19 03:12:25 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 03:12:25.457309 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4727f307-6a74-466d-b1ba-b66d07f7f70f tempest-AggregatesAdminNegativeTestJSON-1649350433 tempest-AggregatesAdminNegativeTestJSON-1649350433-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:25.471949 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4727f307-6a74-466d-b1ba-b66d07f7f70f tempest-AggregatesAdminNegativeTestJSON-1649350433 tempest-AggregatesAdminNegativeTestJSON-1649350433-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': 'b09e6864e9c04d6aaa1d4d210733c3d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f400c62b5a9417b8d0c10047a9e43b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:12:25.485307 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4727f307-6a74-466d-b1ba-b66d07f7f70f tempest-AggregatesAdminNegativeTestJSON-1649350433 tempest-AggregatesAdminNegativeTestJSON-1649350433-project] Request method failure captured: Oct 19 03:12:25.485307 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Oct 19 03:12:25.485307 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:12:25.485307 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:12:25.485307 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:12:25.485307 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:12:25.485307 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:12:25.485307 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:12:25.485307 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:12:25.485307 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:12:25.485307 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2sPwoyuBijUT-jxC0uUUPhVqAwh9DMb8Lx224kKtLAN9vAmcN-d1fZoJb-X6cckijL8297lUWtY71vdBMRABXjXHfUvR_YrhylxKEFRY_Xt_oUCBt65EYiqUhOD7HwX9hSHq-gf5YDnqleXRvIZbTZmK-cAziyRBTBPDAmEwyrHgUY Oct 19 03:12:25.485307 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:12:25.485307 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:12:25.485307 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:12:25.485307 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:12:25.485307 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:12:25.485307 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:12:25.485307 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 4f400c62b5a9417b8d0c10047a9e43b6 Oct 19 03:12:25.485307 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1649350433 Oct 19 03:12:25.485307 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:12:25.485307 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:12:25.493589 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4f400c62b5a9417b8d0c10047a9e43b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4f400c62b5a9417b8d0c10047a9e43b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4f400c62b5a9417b8d0c10047a9e43b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4f400c62b5a9417b8d0c10047a9e43b6", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:12:25.493589 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1649350433 Oct 19 03:12:25.493589 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 4f400c62b5a9417b8d0c10047a9e43b6 Oct 19 03:12:25.493589 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1649350433 Oct 19 03:12:25.493589 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-AggregatesAdminNegativeTestJSON-1649350433-project Oct 19 03:12:25.493589 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:12:25.493589 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:12:25.493589 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: b09e6864e9c04d6aaa1d4d210733c3d8 Oct 19 03:12:25.493589 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1649350433-project Oct 19 03:12:25.493589 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:12:25.493589 n-d-861333-8 devstack@n-api.service[121135]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 19 03:12:25.493589 n-d-861333-8 devstack@n-api.service[121135]: action_args: {} Oct 19 03:12:25.494216 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:12:25.494216 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:12:25.494216 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:12:25.494216 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:12:25.494216 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:12:25.494216 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:12:25.494216 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:12:25.494216 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:12:25.494216 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Oct 19 03:12:25.494216 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Oct 19 03:12:25.494216 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 19 03:12:25.494216 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 19 03:12:25.494216 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 19 03:12:25.494216 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 19 03:12:25.494216 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 03:12:25.494216 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 03:12:25.494216 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 03:12:25.494216 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 03:12:25.494216 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 19 03:12:25.495366 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 19 03:12:25.495366 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 19 03:12:25.495366 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 19 03:12:25.495366 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 19 03:12:25.495366 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 19 03:12:25.495366 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 19 03:12:25.495366 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:12:25.495366 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:12:25.495366 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:12:25.495366 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:12:25.495366 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:12:25.495366 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:12:25.495366 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 19 03:12:25.495366 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 19 03:12:25.495366 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 19 03:12:25.495366 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:12:25.495366 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4727f307-6a74-466d-b1ba-b66d07f7f70f tempest-AggregatesAdminNegativeTestJSON-1649350433 tempest-AggregatesAdminNegativeTestJSON-1649350433-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:12:25.496223 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4727f307-6a74-466d-b1ba-b66d07f7f70f tempest-AggregatesAdminNegativeTestJSON-1649350433 tempest-AggregatesAdminNegativeTestJSON-1649350433-project] 10.222.0.52 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.035813 Oct 19 03:12:25.505531 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 43/82] 10.222.0.52 () {58 vars in 1143 bytes} [Wed Oct 19 03:12:25 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 55 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:12:25.509723 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f6f84d55-8370-4dcb-b90c-dc98c1495086 tempest-FlavorsAdminTestJSON-1723856304 tempest-FlavorsAdminTestJSON-1723856304-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5394 microversion: 2.1 time: 0.088534 Oct 19 03:12:25.513158 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 40/83] 10.222.0.52 () {58 vars in 1173 bytes} [Wed Oct 19 03:12:25 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5394 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:12:25.532344 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2e461aec-68c5-4b03-b8d1-e09cfb4e2728 tempest-FlavorsAdminTestJSON-1723856304 tempest-FlavorsAdminTestJSON-1723856304-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:25.564225 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2e461aec-68c5-4b03-b8d1-e09cfb4e2728 tempest-FlavorsAdminTestJSON-1723856304 tempest-FlavorsAdminTestJSON-1723856304-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5394 microversion: 2.1 time: 0.035896 Oct 19 03:12:25.579706 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 44/84] 10.222.0.52 () {58 vars in 1169 bytes} [Wed Oct 19 03:12:25 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5394 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:12:25.585491 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-96a0de73-b5a8-4007-978c-f001b654390e tempest-FlavorsAdminTestJSON-1723856304 tempest-FlavorsAdminTestJSON-1723856304-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:25.703091 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-96a0de73-b5a8-4007-978c-f001b654390e tempest-FlavorsAdminTestJSON-1723856304 tempest-FlavorsAdminTestJSON-1723856304-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/1812445903" status: 202 len: 0 microversion: 2.1 time: 0.121063 Oct 19 03:12:25.703711 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 41/85] 10.222.0.52 () {58 vars in 1161 bytes} [Wed Oct 19 03:12:25 2022] DELETE /compute/v2.1/flavors/1812445903 => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:12:25.713694 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e81e8590-4a2d-4b6b-8eda-2bdd1c499596 tempest-FlavorsAdminTestJSON-1723856304 tempest-FlavorsAdminTestJSON-1723856304-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:25.763882 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e81e8590-4a2d-4b6b-8eda-2bdd1c499596 tempest-FlavorsAdminTestJSON-1723856304 tempest-FlavorsAdminTestJSON-1723856304-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.055174 Oct 19 03:12:25.764831 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 42/86] 10.222.0.52 () {58 vars in 1146 bytes} [Wed Oct 19 03:12:25 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:12:25.779112 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-cff2f749-5b96-4771-bdd0-9cf3fcd9ebe5 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:25.779714 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-cff2f749-5b96-4771-bdd0-9cf3fcd9ebe5 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] [instance: 7a48466f-9d33-480f-b67a-21777e03d4d5] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:12:25.795694 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cff2f749-5b96-4771-bdd0-9cf3fcd9ebe5 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:25.797453 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cff2f749-5b96-4771-bdd0-9cf3fcd9ebe5 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:25.798139 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cff2f749-5b96-4771-bdd0-9cf3fcd9ebe5 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:25.799518 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cff2f749-5b96-4771-bdd0-9cf3fcd9ebe5 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:25.800078 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cff2f749-5b96-4771-bdd0-9cf3fcd9ebe5 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:25.801056 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cff2f749-5b96-4771-bdd0-9cf3fcd9ebe5 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:26.261607 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-cff2f749-5b96-4771-bdd0-9cf3fcd9ebe5 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '769928c8ecb643fa83a9d58465dcb263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ead65f008349329789135966c031d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:12:26.261607 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-cff2f749-5b96-4771-bdd0-9cf3fcd9ebe5 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] 10.222.0.52 "GET /compute/v2.1/servers/7a48466f-9d33-480f-b67a-21777e03d4d5" status: 200 len: 1341 microversion: 2.1 time: 0.395649 Oct 19 03:12:26.261607 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 43/87] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:12:25 2022] GET /compute/v2.1/servers/7a48466f-9d33-480f-b67a-21777e03d4d5 => generated 1341 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:12:26.263800 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f429e407-0cc9-4f29-98fb-2a8e669b1c39 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-1797312531", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "availability_zone": "tempest-test_az-392787927"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:12:26.264766 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b0c35e02-ed63-489b-a47c-2a432c90a384 tempest-FlavorsAdminTestJSON-1723856304 tempest-FlavorsAdminTestJSON-1723856304-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:26.265727 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f429e407-0cc9-4f29-98fb-2a8e669b1c39 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:26.265727 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f429e407-0cc9-4f29-98fb-2a8e669b1c39 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:26.265727 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f429e407-0cc9-4f29-98fb-2a8e669b1c39 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:26.265727 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f429e407-0cc9-4f29-98fb-2a8e669b1c39 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:26.266301 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f429e407-0cc9-4f29-98fb-2a8e669b1c39 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:26.266301 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f429e407-0cc9-4f29-98fb-2a8e669b1c39 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:26.312626 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.network.neutron [None req-f429e407-0cc9-4f29-98fb-2a8e669b1c39 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] validate_networks() for None {{(pid=121135) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:12:26.640329 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b0c35e02-ed63-489b-a47c-2a432c90a384 tempest-FlavorsAdminTestJSON-1723856304 tempest-FlavorsAdminTestJSON-1723856304-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/1747198282" status: 202 len: 0 microversion: 2.1 time: 0.476344 Oct 19 03:12:26.640903 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 44/88] 10.222.0.52 () {58 vars in 1161 bytes} [Wed Oct 19 03:12:26 2022] DELETE /compute/v2.1/flavors/1747198282 => generated 0 bytes in 478 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:12:26.649551 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0d29f645-fb32-4c8e-bc36-1f6aef4a3436 tempest-FlavorsAdminTestJSON-1723856304 tempest-FlavorsAdminTestJSON-1723856304-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:26.673910 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0d29f645-fb32-4c8e-bc36-1f6aef4a3436 tempest-FlavorsAdminTestJSON-1723856304 tempest-FlavorsAdminTestJSON-1723856304-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025690 Oct 19 03:12:26.680675 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 45/89] 10.222.0.52 () {58 vars in 1146 bytes} [Wed Oct 19 03:12:26 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:12:26.697717 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1ab7b046-10db-4575-92f6-a807fe963f5e tempest-FlavorsAdminTestJSON-1723856304 tempest-FlavorsAdminTestJSON-1723856304-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1125539107", "id": 1500294640, "os-flavor-access:is_public": "False"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:12:26.706104 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=80,nova_api:DELETE=13,nova_api:INSERT=7 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:12:26.819379 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1ab7b046-10db-4575-92f6-a807fe963f5e tempest-FlavorsAdminTestJSON-1723856304 tempest-FlavorsAdminTestJSON-1723856304-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.124698 Oct 19 03:12:26.828816 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 46/90] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:12:26 2022] POST /compute/v2.1/flavors => generated 415 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:12:26.834371 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ff5b92c9-0e59-4f45-9471-0b43956a6976 tempest-FlavorsAdminTestJSON-1723856304 tempest-FlavorsAdminTestJSON-1723856304-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:26.851936 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-f429e407-0cc9-4f29-98fb-2a8e669b1c39 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Flavor limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:12:26.852357 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-f429e407-0cc9-4f29-98fb-2a8e669b1c39 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Image limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:12:26.853033 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-f429e407-0cc9-4f29-98fb-2a8e669b1c39 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Flavor pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:12:26.853571 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-f429e407-0cc9-4f29-98fb-2a8e669b1c39 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Image pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:12:26.853988 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-f429e407-0cc9-4f29-98fb-2a8e669b1c39 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:12:26.880749 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ff5b92c9-0e59-4f45-9471-0b43956a6976 tempest-FlavorsAdminTestJSON-1723856304 tempest-FlavorsAdminTestJSON-1723856304-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.050528 Oct 19 03:12:26.881360 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 47/91] 10.222.0.52 () {58 vars in 1146 bytes} [Wed Oct 19 03:12:26 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:12:26.896534 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f429e407-0cc9-4f29-98fb-2a8e669b1c39 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:26.897132 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f429e407-0cc9-4f29-98fb-2a8e669b1c39 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:26.897480 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f429e407-0cc9-4f29-98fb-2a8e669b1c39 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:26.898250 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f429e407-0cc9-4f29-98fb-2a8e669b1c39 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:26.905521 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f429e407-0cc9-4f29-98fb-2a8e669b1c39 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:26.905521 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f429e407-0cc9-4f29-98fb-2a8e669b1c39 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:26.914354 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e1c45273-ddf4-4868-9986-db2fb894a3b4 tempest-FlavorsAdminTestJSON-161469764 tempest-FlavorsAdminTestJSON-161469764-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:26.980336 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e1c45273-ddf4-4868-9986-db2fb894a3b4 tempest-FlavorsAdminTestJSON-161469764 tempest-FlavorsAdminTestJSON-161469764-project] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.065417 Oct 19 03:12:26.981305 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 48/92] 10.222.0.52 () {58 vars in 1146 bytes} [Wed Oct 19 03:12:26 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:12:27.002241 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-f429e407-0cc9-4f29-98fb-2a8e669b1c39 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Getting quotas for project d3054afe77df43afa6406ec25b57de65. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:12:27.002409 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2b2c3620-8978-44c1-9d97-d88814896d7c tempest-FlavorsAdminTestJSON-1723856304 tempest-FlavorsAdminTestJSON-1723856304-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:27.015638 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-f429e407-0cc9-4f29-98fb-2a8e669b1c39 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Getting quotas for user f665963909a64c148298b7a6c8e3307a and project d3054afe77df43afa6406ec25b57de65. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:12:27.031600 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f429e407-0cc9-4f29-98fb-2a8e669b1c39 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Going to run 1 instances... {{(pid=121135) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:12:27.038564 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f429e407-0cc9-4f29-98fb-2a8e669b1c39 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] [instance: 44cee120-503c-401f-b046-a638d08df855] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121135) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:12:27.115110 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2b2c3620-8978-44c1-9d97-d88814896d7c tempest-FlavorsAdminTestJSON-1723856304 tempest-FlavorsAdminTestJSON-1723856304-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/1500294640" status: 202 len: 0 microversion: 2.1 time: 0.119342 Oct 19 03:12:27.116212 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 49/93] 10.222.0.52 () {58 vars in 1161 bytes} [Wed Oct 19 03:12:26 2022] DELETE /compute/v2.1/flavors/1500294640 => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 19 03:12:27.132596 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-72b149a9-eb48-4ece-b692-b8ba33027688 tempest-FlavorsAdminTestJSON-1723856304 tempest-FlavorsAdminTestJSON-1723856304-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:27.188638 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-72b149a9-eb48-4ece-b692-b8ba33027688 tempest-FlavorsAdminTestJSON-1723856304 tempest-FlavorsAdminTestJSON-1723856304-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.061060 Oct 19 03:12:27.191203 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 50/94] 10.222.0.52 () {58 vars in 1146 bytes} [Wed Oct 19 03:12:27 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:12:27.191632 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f429e407-0cc9-4f29-98fb-2a8e669b1c39 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.511650 Oct 19 03:12:27.193001 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 45/95] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:12:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1514 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 03:12:27.206313 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8a4cd50f-d4d2-4771-8fdf-25ea7a48a443 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:27.208620 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8a4cd50f-d4d2-4771-8fdf-25ea7a48a443 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] [instance: 44cee120-503c-401f-b046-a638d08df855] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:12:27.225708 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0831c0b5-3413-4377-b8eb-670a61e784e3 tempest-FlavorsAdminTestJSON-1723856304 tempest-FlavorsAdminTestJSON-1723856304-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1522189652", "id": 128097241, "os-flavor-access:is_public": "True"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:12:27.362370 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0831c0b5-3413-4377-b8eb-670a61e784e3 tempest-FlavorsAdminTestJSON-1723856304 tempest-FlavorsAdminTestJSON-1723856304-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.143825 Oct 19 03:12:27.363914 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 46/96] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:12:27 2022] POST /compute/v2.1/flavors => generated 411 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:12:27.380808 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c50acf11-d0ab-4516-ac24-98e261fde9e3 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:27.382828 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c50acf11-d0ab-4516-ac24-98e261fde9e3 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] [instance: 7a48466f-9d33-480f-b67a-21777e03d4d5] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:12:27.414218 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c50acf11-d0ab-4516-ac24-98e261fde9e3 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:27.414218 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c50acf11-d0ab-4516-ac24-98e261fde9e3 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:27.414218 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c50acf11-d0ab-4516-ac24-98e261fde9e3 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:27.414218 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c50acf11-d0ab-4516-ac24-98e261fde9e3 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:27.420271 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c50acf11-d0ab-4516-ac24-98e261fde9e3 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:27.421887 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c50acf11-d0ab-4516-ac24-98e261fde9e3 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:27.562552 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8a4cd50f-d4d2-4771-8fdf-25ea7a48a443 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f665963909a64c148298b7a6c8e3307a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3054afe77df43afa6406ec25b57de65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:12:27.607024 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8a4cd50f-d4d2-4771-8fdf-25ea7a48a443 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] 10.222.0.52 "GET /compute/v2.1/servers/44cee120-503c-401f-b046-a638d08df855" status: 200 len: 1242 microversion: 2.1 time: 0.405387 Oct 19 03:12:27.610621 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 51/97] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:12:27 2022] GET /compute/v2.1/servers/44cee120-503c-401f-b046-a638d08df855 => generated 1242 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:12:27.636221 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-31afe2dc-6e65-4ec3-8297-400c42e0dda2 tempest-FlavorsAdminTestJSON-161469764 tempest-FlavorsAdminTestJSON-161469764-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:27.740388 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-31afe2dc-6e65-4ec3-8297-400c42e0dda2 tempest-FlavorsAdminTestJSON-161469764 tempest-FlavorsAdminTestJSON-161469764-project] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5392 microversion: 2.1 time: 0.125643 Oct 19 03:12:27.750611 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 52/98] 10.222.0.52 () {58 vars in 1146 bytes} [Wed Oct 19 03:12:27 2022] GET /compute/v2.1/flavors/detail => generated 5392 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:12:28.340277 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c50acf11-d0ab-4516-ac24-98e261fde9e3 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '769928c8ecb643fa83a9d58465dcb263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ead65f008349329789135966c031d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:12:28.371386 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c50acf11-d0ab-4516-ac24-98e261fde9e3 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] 10.222.0.52 "GET /compute/v2.1/servers/7a48466f-9d33-480f-b67a-21777e03d4d5" status: 200 len: 1341 microversion: 2.1 time: 1.003094 Oct 19 03:12:28.375323 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 47/99] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:12:27 2022] GET /compute/v2.1/servers/7a48466f-9d33-480f-b67a-21777e03d4d5 => generated 1341 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:12:28.388354 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2eb4b2df-5679-458d-927f-8e3bbc84f4c7 tempest-FlavorsAdminTestJSON-1723856304 tempest-FlavorsAdminTestJSON-1723856304-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:28.453901 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1bef5652-d516-4275-8b2f-dc8c4e367c44 tempest-FlavorMetadataValidation-995570760 tempest-FlavorMetadataValidation-995570760-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-1089012108", "id": 1096487126, "os-flavor-access:is_public": "True"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:12:28.545332 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2eb4b2df-5679-458d-927f-8e3bbc84f4c7 tempest-FlavorsAdminTestJSON-1723856304 tempest-FlavorsAdminTestJSON-1723856304-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/128097241" status: 202 len: 0 microversion: 2.1 time: 0.168627 Oct 19 03:12:28.551034 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 48/100] 10.222.0.52 () {58 vars in 1158 bytes} [Wed Oct 19 03:12:28 2022] DELETE /compute/v2.1/flavors/128097241 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:12:28.572897 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ee9187f5-1f31-4ca2-bec7-d79086e22060 tempest-FlavorsAdminTestJSON-1723856304 tempest-FlavorsAdminTestJSON-1723856304-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:28.577673 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1bef5652-d516-4275-8b2f-dc8c4e367c44 tempest-FlavorMetadataValidation-995570760 tempest-FlavorMetadataValidation-995570760-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 471 microversion: 2.86 time: 0.821330 Oct 19 03:12:28.583609 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 53/101] 10.222.0.52 () {62 vars in 1188 bytes} [Wed Oct 19 03:12:27 2022] POST /compute/v2.1/flavors => generated 471 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 03:12:28.611182 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-423f556a-0570-4c8a-8c87-eb86f4318988 tempest-FlavorMetadataValidation-995570760 tempest-FlavorMetadataValidation-995570760-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:12:28.662364 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ee9187f5-1f31-4ca2-bec7-d79086e22060 tempest-FlavorsAdminTestJSON-1723856304 tempest-FlavorsAdminTestJSON-1723856304-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5413 microversion: 2.1 time: 0.106354 Oct 19 03:12:28.663451 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 49/102] 10.222.0.52 () {58 vars in 1146 bytes} [Wed Oct 19 03:12:28 2022] GET /compute/v2.1/flavors/detail => generated 5413 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:12:28.682923 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-35ff3778-1f31-4787-8322-da986adba26b tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:28.683974 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-35ff3778-1f31-4787-8322-da986adba26b tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] [instance: 44cee120-503c-401f-b046-a638d08df855] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:12:29.451132 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-423f556a-0570-4c8a-8c87-eb86f4318988 tempest-FlavorMetadataValidation-995570760 tempest-FlavorMetadataValidation-995570760-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors/1096487126/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.845155 Oct 19 03:12:29.451132 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 54/103] 10.222.0.52 () {62 vars in 1265 bytes} [Wed Oct 19 03:12:28 2022] POST /compute/v2.1/flavors/1096487126/os-extra_specs => generated 62 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:12:29.456785 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d6b33169-f2e7-44dd-b887-9685acf490de tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:29.457438 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d6b33169-f2e7-44dd-b887-9685acf490de tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] [instance: 7a48466f-9d33-480f-b67a-21777e03d4d5] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:12:29.482205 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d6b33169-f2e7-44dd-b887-9685acf490de tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:29.484447 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d6b33169-f2e7-44dd-b887-9685acf490de tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:29.485109 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d6b33169-f2e7-44dd-b887-9685acf490de tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:29.489845 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d6b33169-f2e7-44dd-b887-9685acf490de tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:29.490907 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d6b33169-f2e7-44dd-b887-9685acf490de tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:29.492821 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d6b33169-f2e7-44dd-b887-9685acf490de tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:29.626833 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-35ff3778-1f31-4787-8322-da986adba26b tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f665963909a64c148298b7a6c8e3307a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3054afe77df43afa6406ec25b57de65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:12:29.637091 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-35ff3778-1f31-4787-8322-da986adba26b tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] 10.222.0.52 "GET /compute/v2.1/servers/44cee120-503c-401f-b046-a638d08df855" status: 200 len: 1242 microversion: 2.1 time: 0.972234 Oct 19 03:12:29.640540 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 50/104] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:12:28 2022] GET /compute/v2.1/servers/44cee120-503c-401f-b046-a638d08df855 => generated 1242 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:12:29.645681 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3bc80df3-28ea-49e4-9925-1cfc580ff94f tempest-FlavorMetadataValidation-995570760 tempest-FlavorMetadataValidation-995570760-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:29.662197 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=80,nova_api:DELETE=12,nova_api:INSERT=8 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:12:29.783901 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-3bc80df3-28ea-49e4-9925-1cfc580ff94f tempest-FlavorMetadataValidation-995570760 tempest-FlavorMetadataValidation-995570760-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/1096487126" status: 202 len: 0 microversion: 2.86 time: 0.141030 Oct 19 03:12:29.790610 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 51/105] 10.222.0.52 () {60 vars in 1202 bytes} [Wed Oct 19 03:12:29 2022] DELETE /compute/v2.1/flavors/1096487126 => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:12:29.809363 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0a2b1b02-8e8a-4255-97d5-821abaae16ab tempest-FlavorMetadataValidation-995570760 tempest-FlavorMetadataValidation-995570760-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:29.910706 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0a2b1b02-8e8a-4255-97d5-821abaae16ab tempest-FlavorMetadataValidation-995570760 tempest-FlavorMetadataValidation-995570760-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.86 time: 0.117877 Oct 19 03:12:29.925297 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 52/106] 10.222.0.52 () {60 vars in 1187 bytes} [Wed Oct 19 03:12:29 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:12:30.239125 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d6b33169-f2e7-44dd-b887-9685acf490de tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '769928c8ecb643fa83a9d58465dcb263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ead65f008349329789135966c031d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:12:30.252792 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d6b33169-f2e7-44dd-b887-9685acf490de tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] 10.222.0.52 "GET /compute/v2.1/servers/7a48466f-9d33-480f-b67a-21777e03d4d5" status: 200 len: 1341 microversion: 2.1 time: 0.805609 Oct 19 03:12:30.255874 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 55/107] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:12:29 2022] GET /compute/v2.1/servers/7a48466f-9d33-480f-b67a-21777e03d4d5 => generated 1341 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:12:30.680813 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-301c3ef9-edc0-40f9-b436-447231ddfa44 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:30.682518 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-301c3ef9-edc0-40f9-b436-447231ddfa44 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] [instance: 44cee120-503c-401f-b046-a638d08df855] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:12:30.697240 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-301c3ef9-edc0-40f9-b436-447231ddfa44 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:30.704365 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-301c3ef9-edc0-40f9-b436-447231ddfa44 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:30.710227 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-301c3ef9-edc0-40f9-b436-447231ddfa44 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:30.717523 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-301c3ef9-edc0-40f9-b436-447231ddfa44 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:30.721202 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-301c3ef9-edc0-40f9-b436-447231ddfa44 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:30.721735 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-301c3ef9-edc0-40f9-b436-447231ddfa44 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:30.880209 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-9bf768d6-fdea-4594-b099-7bc36bf2a4af req-8eaffff5-1fa8-4c69-a4eb-41eb5c0e91e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a48466f-9d33-480f-b67a-21777e03d4d5", "tag": "a519b32a-37d6-4d4b-ad11-3afe261db20f"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:12:30.907735 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-9bf768d6-fdea-4594-b099-7bc36bf2a4af req-8eaffff5-1fa8-4c69-a4eb-41eb5c0e91e9 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:30.908228 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-9bf768d6-fdea-4594-b099-7bc36bf2a4af req-8eaffff5-1fa8-4c69-a4eb-41eb5c0e91e9 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:30.908696 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-9bf768d6-fdea-4594-b099-7bc36bf2a4af req-8eaffff5-1fa8-4c69-a4eb-41eb5c0e91e9 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:30.968834 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-9bf768d6-fdea-4594-b099-7bc36bf2a4af req-8eaffff5-1fa8-4c69-a4eb-41eb5c0e91e9 service nova] Creating event network-changed:a519b32a-37d6-4d4b-ad11-3afe261db20f for instance 7a48466f-9d33-480f-b67a-21777e03d4d5 on n-h2-861333-8 Oct 19 03:12:30.969703 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-9bf768d6-fdea-4594-b099-7bc36bf2a4af req-8eaffff5-1fa8-4c69-a4eb-41eb5c0e91e9 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121135) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 19 03:12:30.974241 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-9bf768d6-fdea-4594-b099-7bc36bf2a4af req-8eaffff5-1fa8-4c69-a4eb-41eb5c0e91e9 service nova] Acquired lock "compute-rpcapi-router" {{(pid=121135) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 19 03:12:30.975668 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-26dcee83-0897-4597-b975-b9641f7bda32 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:30.976629 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-26dcee83-0897-4597-b975-b9641f7bda32 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:30.977254 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-26dcee83-0897-4597-b975-b9641f7bda32 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:30.978188 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-26dcee83-0897-4597-b975-b9641f7bda32 None None] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:30.983220 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-26dcee83-0897-4597-b975-b9641f7bda32 None None] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:30.984424 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-26dcee83-0897-4597-b975-b9641f7bda32 None None] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:31.012370 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.compute.rpcapi [None req-26dcee83-0897-4597-b975-b9641f7bda32 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 19 03:12:31.013152 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-26dcee83-0897-4597-b975-b9641f7bda32 None None] Releasing lock "compute-rpcapi-router" {{(pid=121135) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 19 03:12:31.016061 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-301c3ef9-edc0-40f9-b436-447231ddfa44 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f665963909a64c148298b7a6c8e3307a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3054afe77df43afa6406ec25b57de65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:12:31.038227 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-301c3ef9-edc0-40f9-b436-447231ddfa44 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] 10.222.0.52 "GET /compute/v2.1/servers/44cee120-503c-401f-b046-a638d08df855" status: 200 len: 1234 microversion: 2.1 time: 0.361793 Oct 19 03:12:31.039479 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 56/108] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:12:30 2022] GET /compute/v2.1/servers/44cee120-503c-401f-b046-a638d08df855 => generated 1234 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:12:31.066697 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-26dcee83-0897-4597-b975-b9641f7bda32 None None] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.045881 Oct 19 03:12:31.072248 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 53/109] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:12:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:12:31.277100 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a41d2c3b-fea8-4df4-82e7-1eee5a530311 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:31.278582 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a41d2c3b-fea8-4df4-82e7-1eee5a530311 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] [instance: 7a48466f-9d33-480f-b67a-21777e03d4d5] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:12:31.295960 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a41d2c3b-fea8-4df4-82e7-1eee5a530311 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:31.296718 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a41d2c3b-fea8-4df4-82e7-1eee5a530311 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:31.297596 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a41d2c3b-fea8-4df4-82e7-1eee5a530311 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:31.299064 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a41d2c3b-fea8-4df4-82e7-1eee5a530311 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:31.299848 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a41d2c3b-fea8-4df4-82e7-1eee5a530311 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:31.309623 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a41d2c3b-fea8-4df4-82e7-1eee5a530311 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:31.388643 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ea0ddba0-57c6-4500-acc4-f2602dccf6f8 tempest-HypervisorAdminNegativeUnderV252Test-1899683203 tempest-HypervisorAdminNegativeUnderV252Test-1899683203-project-admin] Calling method '.version_select at 0x7fc131966670>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:31.390490 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ea0ddba0-57c6-4500-acc4-f2602dccf6f8 tempest-HypervisorAdminNegativeUnderV252Test-1899683203 tempest-HypervisorAdminNegativeUnderV252Test-1899683203-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:31.390974 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ea0ddba0-57c6-4500-acc4-f2602dccf6f8 tempest-HypervisorAdminNegativeUnderV252Test-1899683203 tempest-HypervisorAdminNegativeUnderV252Test-1899683203-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:31.391404 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ea0ddba0-57c6-4500-acc4-f2602dccf6f8 tempest-HypervisorAdminNegativeUnderV252Test-1899683203 tempest-HypervisorAdminNegativeUnderV252Test-1899683203-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:31.438607 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ea0ddba0-57c6-4500-acc4-f2602dccf6f8 tempest-HypervisorAdminNegativeUnderV252Test-1899683203 tempest-HypervisorAdminNegativeUnderV252Test-1899683203-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:31.443892 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ea0ddba0-57c6-4500-acc4-f2602dccf6f8 tempest-HypervisorAdminNegativeUnderV252Test-1899683203 tempest-HypervisorAdminNegativeUnderV252Test-1899683203-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:31.446745 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ea0ddba0-57c6-4500-acc4-f2602dccf6f8 tempest-HypervisorAdminNegativeUnderV252Test-1899683203 tempest-HypervisorAdminNegativeUnderV252Test-1899683203-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:31.481246 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ea0ddba0-57c6-4500-acc4-f2602dccf6f8 tempest-HypervisorAdminNegativeUnderV252Test-1899683203 tempest-HypervisorAdminNegativeUnderV252Test-1899683203-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:31.485763 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ea0ddba0-57c6-4500-acc4-f2602dccf6f8 tempest-HypervisorAdminNegativeUnderV252Test-1899683203 tempest-HypervisorAdminNegativeUnderV252Test-1899683203-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:31.485763 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ea0ddba0-57c6-4500-acc4-f2602dccf6f8 tempest-HypervisorAdminNegativeUnderV252Test-1899683203 tempest-HypervisorAdminNegativeUnderV252Test-1899683203-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:31.498401 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ea0ddba0-57c6-4500-acc4-f2602dccf6f8 tempest-HypervisorAdminNegativeUnderV252Test-1899683203 tempest-HypervisorAdminNegativeUnderV252Test-1899683203-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.457424 Oct 19 03:12:31.510128 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 57/110] 10.222.0.52 () {58 vars in 1146 bytes} [Wed Oct 19 03:12:31 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:12:31.753242 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6444c674-03c3-48fc-a414-1ea3d170ec0e tempest-HypervisorAdminNegativeUnderV252Test-956282568 tempest-HypervisorAdminNegativeUnderV252Test-956282568-project] Calling method '.version_select at 0x7fc1318dddc0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:31.760566 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-6444c674-03c3-48fc-a414-1ea3d170ec0e tempest-HypervisorAdminNegativeUnderV252Test-956282568 tempest-HypervisorAdminNegativeUnderV252Test-956282568-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '67dadb3412c442a5a80eca1d14a42c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0e5cbea8594e7c97cff705413a9118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:12:31.765539 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6444c674-03c3-48fc-a414-1ea3d170ec0e tempest-HypervisorAdminNegativeUnderV252Test-956282568 tempest-HypervisorAdminNegativeUnderV252Test-956282568-project] Request method failure captured: Oct 19 03:12:31.765539 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/os-hypervisors/n-h2-861333-8/search HTTP/1.1 Oct 19 03:12:31.765539 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:12:31.765539 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:12:31.765539 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:12:31.765539 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:12:31.765539 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:12:31.765539 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:12:31.765539 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:12:31.765539 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:12:31.765539 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT2sckag_WkQq5anMQtirvyf96IMeg6iIaKdQCoQt4Zj92xT9LFJDF4G9DORLAF7-7CUgPvjprslZdk6BW_cj2flbzbK2a1OKxcRcfq0Nja5h3zq2eyL8Tx5BP7dAIjWLbJD6qzePLRRnqk4V9Ye6WiU_Pc-jAdEmKJLDbY3dryPX448 Oct 19 03:12:31.765539 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:12:31.765539 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:12:31.765539 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:12:31.765539 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:12:31.765539 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:12:31.765539 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:12:31.765539 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: fd0e5cbea8594e7c97cff705413a9118 Oct 19 03:12:31.765539 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-956282568 Oct 19 03:12:31.765539 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:12:31.765539 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:12:31.766944 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/fd0e5cbea8594e7c97cff705413a9118"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fd0e5cbea8594e7c97cff705413a9118"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fd0e5cbea8594e7c97cff705413a9118"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_fd0e5cbea8594e7c97cff705413a9118", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:12:31.766944 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-956282568 Oct 19 03:12:31.766944 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: fd0e5cbea8594e7c97cff705413a9118 Oct 19 03:12:31.766944 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-956282568 Oct 19 03:12:31.766944 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-956282568-project Oct 19 03:12:31.766944 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:12:31.766944 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:12:31.766944 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 67dadb3412c442a5a80eca1d14a42c0c Oct 19 03:12:31.766944 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-956282568-project Oct 19 03:12:31.766944 n-d-861333-8 devstack@n-api.service[121134]: method: Oct 19 03:12:31.766944 n-d-861333-8 devstack@n-api.service[121134]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 19 03:12:31.766944 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': 'n-h2-861333-8'} Oct 19 03:12:31.767669 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:12:31.767669 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:12:31.767669 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:12:31.767669 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:12:31.767669 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:12:31.767669 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:12:31.767669 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 03:12:31.767669 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 03:12:31.767669 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:12:31.767669 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:12:31.767669 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Oct 19 03:12:31.767669 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Oct 19 03:12:31.767669 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 19 03:12:31.767669 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 19 03:12:31.767669 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 19 03:12:31.767669 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 19 03:12:31.767669 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 03:12:31.767669 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 03:12:31.767669 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 03:12:31.768845 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 03:12:31.768845 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 19 03:12:31.768845 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 19 03:12:31.768845 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 19 03:12:31.768845 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 19 03:12:31.768845 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 19 03:12:31.768845 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 19 03:12:31.768845 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 19 03:12:31.768845 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:12:31.768845 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:12:31.768845 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:12:31.768845 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:12:31.768845 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:12:31.768845 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:12:31.768845 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 19 03:12:31.768845 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 19 03:12:31.768845 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 19 03:12:31.768845 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:12:31.769810 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6444c674-03c3-48fc-a414-1ea3d170ec0e tempest-HypervisorAdminNegativeUnderV252Test-956282568 tempest-HypervisorAdminNegativeUnderV252Test-956282568-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:12:31.769810 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6444c674-03c3-48fc-a414-1ea3d170ec0e tempest-HypervisorAdminNegativeUnderV252Test-956282568 tempest-HypervisorAdminNegativeUnderV252Test-956282568-project] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/n-h2-861333-8/search" status: 403 len: 117 microversion: 2.1 time: 0.253586 Oct 19 03:12:31.793897 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 58/111] 10.222.0.52 () {58 vars in 1209 bytes} [Wed Oct 19 03:12:31 2022] GET /compute/v2.1/os-hypervisors/n-h2-861333-8/search => generated 117 bytes in 283 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:12:31.817083 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0e3151cb-abb9-42f9-811e-e673bf252ae8 tempest-HypervisorAdminNegativeUnderV252Test-1899683203 tempest-HypervisorAdminNegativeUnderV252Test-1899683203-project-admin] Calling method '.version_select at 0x7fc1318a1790>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:31.823079 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0e3151cb-abb9-42f9-811e-e673bf252ae8 tempest-HypervisorAdminNegativeUnderV252Test-1899683203 tempest-HypervisorAdminNegativeUnderV252Test-1899683203-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:31.823079 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0e3151cb-abb9-42f9-811e-e673bf252ae8 tempest-HypervisorAdminNegativeUnderV252Test-1899683203 tempest-HypervisorAdminNegativeUnderV252Test-1899683203-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:31.823079 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0e3151cb-abb9-42f9-811e-e673bf252ae8 tempest-HypervisorAdminNegativeUnderV252Test-1899683203 tempest-HypervisorAdminNegativeUnderV252Test-1899683203-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:31.857891 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-0e3151cb-abb9-42f9-811e-e673bf252ae8 tempest-HypervisorAdminNegativeUnderV252Test-1899683203 tempest-HypervisorAdminNegativeUnderV252Test-1899683203-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 19 03:12:31.861561 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0e3151cb-abb9-42f9-811e-e673bf252ae8 tempest-HypervisorAdminNegativeUnderV252Test-1899683203 tempest-HypervisorAdminNegativeUnderV252Test-1899683203-project-admin] Request method failure captured: Oct 19 03:12:31.861561 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Oct 19 03:12:31.861561 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:12:31.861561 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:12:31.861561 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:12:31.861561 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:12:31.861561 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:12:31.861561 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:12:31.861561 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:12:31.861561 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:12:31.861561 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT2seoGytWsGMrhKMaKnXGMVfZNb3rfFBKr5CXcd6n601R8M8oXtelRnamJ_lo7ZSdlOgV57rcgIBc31bknoNBrFfdafxVCfnWNEObP5HV1IQmxUzHF0uRJyzfwu7LCe-yYA1WD9V7YEJKJANbzaxuoXHCmweJnU_yUS2lXaKK1X8FJI Oct 19 03:12:31.861561 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:12:31.861561 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:12:31.861561 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:12:31.861561 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:12:31.861561 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:12:31.861561 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:12:31.861561 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 1ae57c30e2ac4c9e81ac4778e05e7889 Oct 19 03:12:31.861561 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1899683203 Oct 19 03:12:31.861561 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member,admin Oct 19 03:12:31.861561 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member,admin Oct 19 03:12:31.862720 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1ae57c30e2ac4c9e81ac4778e05e7889"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1ae57c30e2ac4c9e81ac4778e05e7889"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1ae57c30e2ac4c9e81ac4778e05e7889"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1ae57c30e2ac4c9e81ac4778e05e7889", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:12:31.862720 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1899683203 Oct 19 03:12:31.862720 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 1ae57c30e2ac4c9e81ac4778e05e7889 Oct 19 03:12:31.862720 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1899683203 Oct 19 03:12:31.862720 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1899683203-project-admin Oct 19 03:12:31.862720 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:12:31.862720 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:12:31.862720 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 3330fec52be64ce69a87e12813a85947 Oct 19 03:12:31.862720 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1899683203-project-admin Oct 19 03:12:31.862720 n-d-861333-8 devstack@n-api.service[121134]: method: Oct 19 03:12:31.862720 n-d-861333-8 devstack@n-api.service[121134]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 19 03:12:31.862720 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': 'nonexistent_hypervisor_name'} Oct 19 03:12:31.863348 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:12:31.863348 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:12:31.863348 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:12:31.863348 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:12:31.863348 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:12:31.863348 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:12:31.863348 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 03:12:31.863348 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 03:12:31.863348 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:12:31.863348 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:12:31.863348 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Oct 19 03:12:31.863348 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 19 03:12:31.863348 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 19 03:12:31.863348 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 19 03:12:31.863348 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 19 03:12:31.863348 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:12:31.863348 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:12:31.863348 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:12:31.863348 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:12:31.863348 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:12:31.864312 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:12:31.864312 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:12:31.864312 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:12:31.864312 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 19 03:12:31.864312 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:12:31.868514 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a41d2c3b-fea8-4df4-82e7-1eee5a530311 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '769928c8ecb643fa83a9d58465dcb263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ead65f008349329789135966c031d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:12:31.875255 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0e3151cb-abb9-42f9-811e-e673bf252ae8 tempest-HypervisorAdminNegativeUnderV252Test-1899683203 tempest-HypervisorAdminNegativeUnderV252Test-1899683203-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:12:31.875255 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0e3151cb-abb9-42f9-811e-e673bf252ae8 tempest-HypervisorAdminNegativeUnderV252Test-1899683203 tempest-HypervisorAdminNegativeUnderV252Test-1899683203-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.063220 Oct 19 03:12:31.875255 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 59/112] 10.222.0.52 () {58 vars in 1251 bytes} [Wed Oct 19 03:12:31 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:12:31.876970 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a41d2c3b-fea8-4df4-82e7-1eee5a530311 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] 10.222.0.52 "GET /compute/v2.1/servers/7a48466f-9d33-480f-b67a-21777e03d4d5" status: 200 len: 1341 microversion: 2.1 time: 0.604314 Oct 19 03:12:31.879536 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 54/113] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:12:31 2022] GET /compute/v2.1/servers/7a48466f-9d33-480f-b67a-21777e03d4d5 => generated 1341 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:12:31.907291 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-21f78780-68c3-41c5-b801-06b39482f637 tempest-HypervisorAdminNegativeUnderV252Test-1899683203 tempest-HypervisorAdminNegativeUnderV252Test-1899683203-project-admin] Calling method '.version_select at 0x7fc1318a1af0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:31.910379 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-21f78780-68c3-41c5-b801-06b39482f637 tempest-HypervisorAdminNegativeUnderV252Test-1899683203 tempest-HypervisorAdminNegativeUnderV252Test-1899683203-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:31.911207 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-21f78780-68c3-41c5-b801-06b39482f637 tempest-HypervisorAdminNegativeUnderV252Test-1899683203 tempest-HypervisorAdminNegativeUnderV252Test-1899683203-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:31.911963 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-21f78780-68c3-41c5-b801-06b39482f637 tempest-HypervisorAdminNegativeUnderV252Test-1899683203 tempest-HypervisorAdminNegativeUnderV252Test-1899683203-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:31.939322 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-21f78780-68c3-41c5-b801-06b39482f637 tempest-HypervisorAdminNegativeUnderV252Test-1899683203 tempest-HypervisorAdminNegativeUnderV252Test-1899683203-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:31.939322 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-21f78780-68c3-41c5-b801-06b39482f637 tempest-HypervisorAdminNegativeUnderV252Test-1899683203 tempest-HypervisorAdminNegativeUnderV252Test-1899683203-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:31.939322 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-21f78780-68c3-41c5-b801-06b39482f637 tempest-HypervisorAdminNegativeUnderV252Test-1899683203 tempest-HypervisorAdminNegativeUnderV252Test-1899683203-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:31.952602 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-21f78780-68c3-41c5-b801-06b39482f637 tempest-HypervisorAdminNegativeUnderV252Test-1899683203 tempest-HypervisorAdminNegativeUnderV252Test-1899683203-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:31.953532 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-21f78780-68c3-41c5-b801-06b39482f637 tempest-HypervisorAdminNegativeUnderV252Test-1899683203 tempest-HypervisorAdminNegativeUnderV252Test-1899683203-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:31.954276 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-21f78780-68c3-41c5-b801-06b39482f637 tempest-HypervisorAdminNegativeUnderV252Test-1899683203 tempest-HypervisorAdminNegativeUnderV252Test-1899683203-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:31.964730 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-21f78780-68c3-41c5-b801-06b39482f637 tempest-HypervisorAdminNegativeUnderV252Test-1899683203 tempest-HypervisorAdminNegativeUnderV252Test-1899683203-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.087325 Oct 19 03:12:31.969665 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 60/114] 10.222.0.52 () {58 vars in 1146 bytes} [Wed Oct 19 03:12:31 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:12:31.979291 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-34632065-0974-4159-a201-fdf560974c21 tempest-HypervisorAdminNegativeUnderV252Test-956282568 tempest-HypervisorAdminNegativeUnderV252Test-956282568-project] Calling method '.version_select at 0x7fc131a3adc0>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:31.982901 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-34632065-0974-4159-a201-fdf560974c21 tempest-HypervisorAdminNegativeUnderV252Test-956282568 tempest-HypervisorAdminNegativeUnderV252Test-956282568-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '67dadb3412c442a5a80eca1d14a42c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0e5cbea8594e7c97cff705413a9118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:12:31.985891 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-34632065-0974-4159-a201-fdf560974c21 tempest-HypervisorAdminNegativeUnderV252Test-956282568 tempest-HypervisorAdminNegativeUnderV252Test-956282568-project] Request method failure captured: Oct 19 03:12:31.985891 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Oct 19 03:12:31.985891 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:12:31.985891 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:12:31.985891 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:12:31.985891 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:12:31.985891 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:12:31.985891 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:12:31.985891 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:12:31.985891 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:12:31.985891 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2sckag_WkQq5anMQtirvyf96IMeg6iIaKdQCoQt4Zj92xT9LFJDF4G9DORLAF7-7CUgPvjprslZdk6BW_cj2flbzbK2a1OKxcRcfq0Nja5h3zq2eyL8Tx5BP7dAIjWLbJD6qzePLRRnqk4V9Ye6WiU_Pc-jAdEmKJLDbY3dryPX448 Oct 19 03:12:31.985891 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:12:31.985891 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:12:31.985891 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:12:31.985891 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:12:31.985891 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:12:31.985891 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:12:31.985891 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: fd0e5cbea8594e7c97cff705413a9118 Oct 19 03:12:31.985891 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-956282568 Oct 19 03:12:31.985891 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:12:31.985891 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:12:31.987006 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/fd0e5cbea8594e7c97cff705413a9118"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fd0e5cbea8594e7c97cff705413a9118"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fd0e5cbea8594e7c97cff705413a9118"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_fd0e5cbea8594e7c97cff705413a9118", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:12:31.987006 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-956282568 Oct 19 03:12:31.987006 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: fd0e5cbea8594e7c97cff705413a9118 Oct 19 03:12:31.987006 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-956282568 Oct 19 03:12:31.987006 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-956282568-project Oct 19 03:12:31.987006 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:12:31.987006 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:12:31.987006 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 67dadb3412c442a5a80eca1d14a42c0c Oct 19 03:12:31.987006 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-956282568-project Oct 19 03:12:31.987006 n-d-861333-8 devstack@n-api.service[121135]: method: Oct 19 03:12:31.987006 n-d-861333-8 devstack@n-api.service[121135]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 19 03:12:31.987006 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '1'} Oct 19 03:12:31.987603 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:12:31.987603 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:12:31.987603 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:12:31.987603 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:12:31.987603 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:12:31.987603 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:12:31.987603 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 03:12:31.987603 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 03:12:31.987603 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:12:31.987603 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:12:31.987603 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Oct 19 03:12:31.987603 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Oct 19 03:12:31.987603 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 19 03:12:31.987603 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 19 03:12:31.987603 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 19 03:12:31.987603 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 19 03:12:31.987603 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 03:12:31.987603 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 03:12:31.987603 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 03:12:31.988530 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 03:12:31.988530 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 19 03:12:31.988530 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 19 03:12:31.988530 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 19 03:12:31.988530 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 19 03:12:31.988530 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 19 03:12:31.988530 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 19 03:12:31.988530 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 19 03:12:31.988530 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:12:31.988530 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:12:31.988530 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:12:31.988530 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:12:31.988530 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:12:31.988530 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:12:31.988530 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 19 03:12:31.988530 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 19 03:12:31.988530 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 19 03:12:31.988530 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:12:31.990733 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-34632065-0974-4159-a201-fdf560974c21 tempest-HypervisorAdminNegativeUnderV252Test-956282568 tempest-HypervisorAdminNegativeUnderV252Test-956282568-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:12:31.993234 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-34632065-0974-4159-a201-fdf560974c21 tempest-HypervisorAdminNegativeUnderV252Test-956282568 tempest-HypervisorAdminNegativeUnderV252Test-956282568-project] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.017998 Oct 19 03:12:31.993234 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 55/115] 10.222.0.52 () {58 vars in 1176 bytes} [Wed Oct 19 03:12:31 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 19 03:12:32.002008 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c90313d7-4783-43fe-ac86-62e90b215745 tempest-HypervisorAdminNegativeUnderV252Test-1899683203 tempest-HypervisorAdminNegativeUnderV252Test-1899683203-project-admin] Calling method '.version_select at 0x7fc1318a1160>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:32.004146 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c90313d7-4783-43fe-ac86-62e90b215745 tempest-HypervisorAdminNegativeUnderV252Test-1899683203 tempest-HypervisorAdminNegativeUnderV252Test-1899683203-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:32.004995 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c90313d7-4783-43fe-ac86-62e90b215745 tempest-HypervisorAdminNegativeUnderV252Test-1899683203 tempest-HypervisorAdminNegativeUnderV252Test-1899683203-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:32.005668 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c90313d7-4783-43fe-ac86-62e90b215745 tempest-HypervisorAdminNegativeUnderV252Test-1899683203 tempest-HypervisorAdminNegativeUnderV252Test-1899683203-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:32.012946 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-c90313d7-4783-43fe-ac86-62e90b215745 tempest-HypervisorAdminNegativeUnderV252Test-1899683203 tempest-HypervisorAdminNegativeUnderV252Test-1899683203-project-admin] HTTP exception thrown: No hypervisor matching '4e0297f1-10c3-41c7-84e3-e958d7e9bd79' could be found. Oct 19 03:12:32.015038 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c90313d7-4783-43fe-ac86-62e90b215745 tempest-HypervisorAdminNegativeUnderV252Test-1899683203 tempest-HypervisorAdminNegativeUnderV252Test-1899683203-project-admin] Request method failure captured: Oct 19 03:12:32.015038 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/os-hypervisors/4e0297f1-10c3-41c7-84e3-e958d7e9bd79/servers HTTP/1.1 Oct 19 03:12:32.015038 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:12:32.015038 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:12:32.015038 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:12:32.015038 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:12:32.015038 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:12:32.015038 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:12:32.015038 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:12:32.015038 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:12:32.015038 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT2seoGytWsGMrhKMaKnXGMVfZNb3rfFBKr5CXcd6n601R8M8oXtelRnamJ_lo7ZSdlOgV57rcgIBc31bknoNBrFfdafxVCfnWNEObP5HV1IQmxUzHF0uRJyzfwu7LCe-yYA1WD9V7YEJKJANbzaxuoXHCmweJnU_yUS2lXaKK1X8FJI Oct 19 03:12:32.015038 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:12:32.015038 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:12:32.015038 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:12:32.015038 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:12:32.015038 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:12:32.015038 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:12:32.015038 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 1ae57c30e2ac4c9e81ac4778e05e7889 Oct 19 03:12:32.015038 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1899683203 Oct 19 03:12:32.015038 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member,admin Oct 19 03:12:32.015038 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member,admin Oct 19 03:12:32.016152 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1ae57c30e2ac4c9e81ac4778e05e7889"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1ae57c30e2ac4c9e81ac4778e05e7889"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1ae57c30e2ac4c9e81ac4778e05e7889"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1ae57c30e2ac4c9e81ac4778e05e7889", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:12:32.016152 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1899683203 Oct 19 03:12:32.016152 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 1ae57c30e2ac4c9e81ac4778e05e7889 Oct 19 03:12:32.016152 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1899683203 Oct 19 03:12:32.016152 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1899683203-project-admin Oct 19 03:12:32.016152 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:12:32.016152 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:12:32.016152 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 3330fec52be64ce69a87e12813a85947 Oct 19 03:12:32.016152 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1899683203-project-admin Oct 19 03:12:32.016152 n-d-861333-8 devstack@n-api.service[121134]: method: Oct 19 03:12:32.016152 n-d-861333-8 devstack@n-api.service[121134]: exception: No hypervisor matching '4e0297f1-10c3-41c7-84e3-e958d7e9bd79' could be found. Oct 19 03:12:32.016152 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '4e0297f1-10c3-41c7-84e3-e958d7e9bd79'} Oct 19 03:12:32.016760 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:12:32.016760 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:12:32.016760 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:12:32.016760 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:12:32.016760 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:12:32.016760 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:12:32.016760 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 03:12:32.016760 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 03:12:32.016760 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:12:32.016760 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:12:32.016760 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Oct 19 03:12:32.016760 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 19 03:12:32.016760 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 19 03:12:32.016760 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 19 03:12:32.016760 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '4e0297f1-10c3-41c7-84e3-e958d7e9bd79' could be found. Oct 19 03:12:32.016760 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:12:32.016760 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:12:32.016760 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:12:32.016760 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:12:32.021533 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:12:32.021533 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:12:32.021533 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:12:32.021533 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:12:32.021533 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '4e0297f1-10c3-41c7-84e3-e958d7e9bd79' could be found. Oct 19 03:12:32.021533 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:12:32.021533 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c90313d7-4783-43fe-ac86-62e90b215745 tempest-HypervisorAdminNegativeUnderV252Test-1899683203 tempest-HypervisorAdminNegativeUnderV252Test-1899683203-project-admin] Returning 404 to user: No hypervisor matching '4e0297f1-10c3-41c7-84e3-e958d7e9bd79' could be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:12:32.021533 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c90313d7-4783-43fe-ac86-62e90b215745 tempest-HypervisorAdminNegativeUnderV252Test-1899683203 tempest-HypervisorAdminNegativeUnderV252Test-1899683203-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/4e0297f1-10c3-41c7-84e3-e958d7e9bd79/servers" status: 404 len: 123 microversion: 2.1 time: 0.021647 Oct 19 03:12:32.021533 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 61/116] 10.222.0.52 () {58 vars in 1281 bytes} [Wed Oct 19 03:12:31 2022] GET /compute/v2.1/os-hypervisors/4e0297f1-10c3-41c7-84e3-e958d7e9bd79/servers => generated 123 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:12:32.073617 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-bed2aa3c-5521-4543-a1da-ebf9d5c8db33 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:32.078765 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-bed2aa3c-5521-4543-a1da-ebf9d5c8db33 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] [instance: 44cee120-503c-401f-b046-a638d08df855] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:12:32.114749 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bed2aa3c-5521-4543-a1da-ebf9d5c8db33 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:32.114749 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bed2aa3c-5521-4543-a1da-ebf9d5c8db33 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:32.114749 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bed2aa3c-5521-4543-a1da-ebf9d5c8db33 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:32.118846 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bed2aa3c-5521-4543-a1da-ebf9d5c8db33 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:32.119352 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bed2aa3c-5521-4543-a1da-ebf9d5c8db33 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:32.119801 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bed2aa3c-5521-4543-a1da-ebf9d5c8db33 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:32.390549 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-bed2aa3c-5521-4543-a1da-ebf9d5c8db33 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f665963909a64c148298b7a6c8e3307a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3054afe77df43afa6406ec25b57de65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:12:32.463690 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-bed2aa3c-5521-4543-a1da-ebf9d5c8db33 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] 10.222.0.52 "GET /compute/v2.1/servers/44cee120-503c-401f-b046-a638d08df855" status: 200 len: 1290 microversion: 2.1 time: 0.403002 Oct 19 03:12:32.470313 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 56/117] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:12:32 2022] GET /compute/v2.1/servers/44cee120-503c-401f-b046-a638d08df855 => generated 1290 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:12:32.904923 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8ee0f254-babe-4ac2-8da6-f3bd5dbcdc75 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:32.906868 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8ee0f254-babe-4ac2-8da6-f3bd5dbcdc75 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] [instance: 7a48466f-9d33-480f-b67a-21777e03d4d5] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:12:32.937488 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8ee0f254-babe-4ac2-8da6-f3bd5dbcdc75 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:32.950676 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8ee0f254-babe-4ac2-8da6-f3bd5dbcdc75 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:32.951642 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8ee0f254-babe-4ac2-8da6-f3bd5dbcdc75 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:32.956883 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8ee0f254-babe-4ac2-8da6-f3bd5dbcdc75 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:32.963710 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8ee0f254-babe-4ac2-8da6-f3bd5dbcdc75 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:32.967461 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8ee0f254-babe-4ac2-8da6-f3bd5dbcdc75 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:33.495767 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6e4beedf-ba35-4520-9ed6-83382ba77789 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:33.497171 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6e4beedf-ba35-4520-9ed6-83382ba77789 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] [instance: 44cee120-503c-401f-b046-a638d08df855] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:12:33.531694 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6e4beedf-ba35-4520-9ed6-83382ba77789 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:33.532492 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6e4beedf-ba35-4520-9ed6-83382ba77789 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:33.534387 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6e4beedf-ba35-4520-9ed6-83382ba77789 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:33.535357 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6e4beedf-ba35-4520-9ed6-83382ba77789 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:33.537980 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6e4beedf-ba35-4520-9ed6-83382ba77789 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:33.540711 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6e4beedf-ba35-4520-9ed6-83382ba77789 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:33.547244 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=6 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:12:33.638260 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8ee0f254-babe-4ac2-8da6-f3bd5dbcdc75 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '769928c8ecb643fa83a9d58465dcb263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ead65f008349329789135966c031d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:12:33.651658 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8ee0f254-babe-4ac2-8da6-f3bd5dbcdc75 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] 10.222.0.52 "GET /compute/v2.1/servers/7a48466f-9d33-480f-b67a-21777e03d4d5" status: 200 len: 1341 microversion: 2.1 time: 0.751131 Oct 19 03:12:33.654335 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 62/118] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:12:32 2022] GET /compute/v2.1/servers/7a48466f-9d33-480f-b67a-21777e03d4d5 => generated 1341 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:12:33.870004 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-6e4beedf-ba35-4520-9ed6-83382ba77789 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f665963909a64c148298b7a6c8e3307a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3054afe77df43afa6406ec25b57de65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:12:33.884503 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6e4beedf-ba35-4520-9ed6-83382ba77789 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] 10.222.0.52 "GET /compute/v2.1/servers/44cee120-503c-401f-b046-a638d08df855" status: 200 len: 1296 microversion: 2.1 time: 0.395673 Oct 19 03:12:33.890813 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 57/119] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:12:33 2022] GET /compute/v2.1/servers/44cee120-503c-401f-b046-a638d08df855 => generated 1296 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:12:34.680702 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-058c4f9e-7d2f-4eaf-869c-0cf44062cc3c tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:34.681330 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-058c4f9e-7d2f-4eaf-869c-0cf44062cc3c tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] [instance: 7a48466f-9d33-480f-b67a-21777e03d4d5] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:12:34.698126 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-058c4f9e-7d2f-4eaf-869c-0cf44062cc3c tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:34.698906 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-058c4f9e-7d2f-4eaf-869c-0cf44062cc3c tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:34.699712 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-058c4f9e-7d2f-4eaf-869c-0cf44062cc3c tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:34.701100 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-058c4f9e-7d2f-4eaf-869c-0cf44062cc3c tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:34.701775 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-058c4f9e-7d2f-4eaf-869c-0cf44062cc3c tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:34.724625 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-058c4f9e-7d2f-4eaf-869c-0cf44062cc3c tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:34.915676 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-eddeca15-3ac3-4d55-baef-bf0c9c2d2c2d tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:34.923909 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-eddeca15-3ac3-4d55-baef-bf0c9c2d2c2d tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] [instance: 44cee120-503c-401f-b046-a638d08df855] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:12:34.937865 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-eddeca15-3ac3-4d55-baef-bf0c9c2d2c2d tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:34.938680 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-eddeca15-3ac3-4d55-baef-bf0c9c2d2c2d tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:34.946518 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-eddeca15-3ac3-4d55-baef-bf0c9c2d2c2d tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:34.947379 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-eddeca15-3ac3-4d55-baef-bf0c9c2d2c2d tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:34.949244 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-eddeca15-3ac3-4d55-baef-bf0c9c2d2c2d tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:34.951975 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-eddeca15-3ac3-4d55-baef-bf0c9c2d2c2d tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:35.152743 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-058c4f9e-7d2f-4eaf-869c-0cf44062cc3c tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '769928c8ecb643fa83a9d58465dcb263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ead65f008349329789135966c031d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:12:35.156452 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-eddeca15-3ac3-4d55-baef-bf0c9c2d2c2d tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f665963909a64c148298b7a6c8e3307a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3054afe77df43afa6406ec25b57de65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:12:35.165519 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-058c4f9e-7d2f-4eaf-869c-0cf44062cc3c tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] 10.222.0.52 "GET /compute/v2.1/servers/7a48466f-9d33-480f-b67a-21777e03d4d5" status: 200 len: 1341 microversion: 2.1 time: 0.489049 Oct 19 03:12:35.168847 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 63/120] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:12:34 2022] GET /compute/v2.1/servers/7a48466f-9d33-480f-b67a-21777e03d4d5 => generated 1341 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:12:35.188264 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-eddeca15-3ac3-4d55-baef-bf0c9c2d2c2d tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] 10.222.0.52 "GET /compute/v2.1/servers/44cee120-503c-401f-b046-a638d08df855" status: 200 len: 1296 microversion: 2.1 time: 0.279139 Oct 19 03:12:35.232358 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 58/121] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:12:34 2022] GET /compute/v2.1/servers/44cee120-503c-401f-b046-a638d08df855 => generated 1296 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:12:35.709979 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-fc229131-d2d7-4ba2-972d-a5eb8150bbf6 tempest-HypervisorAdminUnderV252Test-999306010 tempest-HypervisorAdminUnderV252Test-999306010-project-admin] Calling method '.version_select at 0x7fc13184a8b0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:35.711512 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fc229131-d2d7-4ba2-972d-a5eb8150bbf6 tempest-HypervisorAdminUnderV252Test-999306010 tempest-HypervisorAdminUnderV252Test-999306010-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:35.712671 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fc229131-d2d7-4ba2-972d-a5eb8150bbf6 tempest-HypervisorAdminUnderV252Test-999306010 tempest-HypervisorAdminUnderV252Test-999306010-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:35.713496 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fc229131-d2d7-4ba2-972d-a5eb8150bbf6 tempest-HypervisorAdminUnderV252Test-999306010 tempest-HypervisorAdminUnderV252Test-999306010-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:35.760199 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fc229131-d2d7-4ba2-972d-a5eb8150bbf6 tempest-HypervisorAdminUnderV252Test-999306010 tempest-HypervisorAdminUnderV252Test-999306010-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:35.761181 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fc229131-d2d7-4ba2-972d-a5eb8150bbf6 tempest-HypervisorAdminUnderV252Test-999306010 tempest-HypervisorAdminUnderV252Test-999306010-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:35.761810 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fc229131-d2d7-4ba2-972d-a5eb8150bbf6 tempest-HypervisorAdminUnderV252Test-999306010 tempest-HypervisorAdminUnderV252Test-999306010-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:35.792802 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fc229131-d2d7-4ba2-972d-a5eb8150bbf6 tempest-HypervisorAdminUnderV252Test-999306010 tempest-HypervisorAdminUnderV252Test-999306010-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:35.795222 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fc229131-d2d7-4ba2-972d-a5eb8150bbf6 tempest-HypervisorAdminUnderV252Test-999306010 tempest-HypervisorAdminUnderV252Test-999306010-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:35.801693 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fc229131-d2d7-4ba2-972d-a5eb8150bbf6 tempest-HypervisorAdminUnderV252Test-999306010 tempest-HypervisorAdminUnderV252Test-999306010-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:35.814426 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-fc229131-d2d7-4ba2-972d-a5eb8150bbf6 tempest-HypervisorAdminUnderV252Test-999306010 tempest-HypervisorAdminUnderV252Test-999306010-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.644028 Oct 19 03:12:35.825795 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 64/122] 10.222.0.52 () {58 vars in 1146 bytes} [Wed Oct 19 03:12:35 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:12:35.828632 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e774f50d-6656-4fb2-8012-8828ecad9201 tempest-HypervisorAdminUnderV252Test-999306010 tempest-HypervisorAdminUnderV252Test-999306010-project-admin] Calling method '.version_select at 0x7fc131991820>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:35.831852 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e774f50d-6656-4fb2-8012-8828ecad9201 tempest-HypervisorAdminUnderV252Test-999306010 tempest-HypervisorAdminUnderV252Test-999306010-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:35.832366 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e774f50d-6656-4fb2-8012-8828ecad9201 tempest-HypervisorAdminUnderV252Test-999306010 tempest-HypervisorAdminUnderV252Test-999306010-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:35.832857 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e774f50d-6656-4fb2-8012-8828ecad9201 tempest-HypervisorAdminUnderV252Test-999306010 tempest-HypervisorAdminUnderV252Test-999306010-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:35.902220 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e774f50d-6656-4fb2-8012-8828ecad9201 tempest-HypervisorAdminUnderV252Test-999306010 tempest-HypervisorAdminUnderV252Test-999306010-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:35.903236 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e774f50d-6656-4fb2-8012-8828ecad9201 tempest-HypervisorAdminUnderV252Test-999306010 tempest-HypervisorAdminUnderV252Test-999306010-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:35.903806 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e774f50d-6656-4fb2-8012-8828ecad9201 tempest-HypervisorAdminUnderV252Test-999306010 tempest-HypervisorAdminUnderV252Test-999306010-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:35.970976 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e774f50d-6656-4fb2-8012-8828ecad9201 tempest-HypervisorAdminUnderV252Test-999306010 tempest-HypervisorAdminUnderV252Test-999306010-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:35.972200 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e774f50d-6656-4fb2-8012-8828ecad9201 tempest-HypervisorAdminUnderV252Test-999306010 tempest-HypervisorAdminUnderV252Test-999306010-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:35.973615 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e774f50d-6656-4fb2-8012-8828ecad9201 tempest-HypervisorAdminUnderV252Test-999306010 tempest-HypervisorAdminUnderV252Test-999306010-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:35.989744 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e774f50d-6656-4fb2-8012-8828ecad9201 tempest-HypervisorAdminUnderV252Test-999306010 tempest-HypervisorAdminUnderV252Test-999306010-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/n-h2-861333-8/servers" status: 200 len: 275 microversion: 2.1 time: 0.165739 Oct 19 03:12:35.999708 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 59/123] 10.222.0.52 () {58 vars in 1212 bytes} [Wed Oct 19 03:12:35 2022] GET /compute/v2.1/os-hypervisors/n-h2-861333-8/servers => generated 275 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:12:36.005875 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d0a6a7a6-4fb8-4783-9612-5cc668abc08b tempest-HypervisorAdminUnderV252Test-999306010 tempest-HypervisorAdminUnderV252Test-999306010-project-admin] Calling method '.version_select at 0x7fc13184a700>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:36.009818 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d0a6a7a6-4fb8-4783-9612-5cc668abc08b tempest-HypervisorAdminUnderV252Test-999306010 tempest-HypervisorAdminUnderV252Test-999306010-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:36.010761 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d0a6a7a6-4fb8-4783-9612-5cc668abc08b tempest-HypervisorAdminUnderV252Test-999306010 tempest-HypervisorAdminUnderV252Test-999306010-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:36.011412 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d0a6a7a6-4fb8-4783-9612-5cc668abc08b tempest-HypervisorAdminUnderV252Test-999306010 tempest-HypervisorAdminUnderV252Test-999306010-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:36.036112 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d0a6a7a6-4fb8-4783-9612-5cc668abc08b tempest-HypervisorAdminUnderV252Test-999306010 tempest-HypervisorAdminUnderV252Test-999306010-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:36.037321 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d0a6a7a6-4fb8-4783-9612-5cc668abc08b tempest-HypervisorAdminUnderV252Test-999306010 tempest-HypervisorAdminUnderV252Test-999306010-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:36.038582 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d0a6a7a6-4fb8-4783-9612-5cc668abc08b tempest-HypervisorAdminUnderV252Test-999306010 tempest-HypervisorAdminUnderV252Test-999306010-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:36.054655 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d0a6a7a6-4fb8-4783-9612-5cc668abc08b tempest-HypervisorAdminUnderV252Test-999306010 tempest-HypervisorAdminUnderV252Test-999306010-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:36.055421 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d0a6a7a6-4fb8-4783-9612-5cc668abc08b tempest-HypervisorAdminUnderV252Test-999306010 tempest-HypervisorAdminUnderV252Test-999306010-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:36.056177 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d0a6a7a6-4fb8-4783-9612-5cc668abc08b tempest-HypervisorAdminUnderV252Test-999306010 tempest-HypervisorAdminUnderV252Test-999306010-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:36.061029 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=100 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:12:36.069131 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d0a6a7a6-4fb8-4783-9612-5cc668abc08b tempest-HypervisorAdminUnderV252Test-999306010 tempest-HypervisorAdminUnderV252Test-999306010-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.067715 Oct 19 03:12:36.070496 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 65/124] 10.222.0.52 () {58 vars in 1146 bytes} [Wed Oct 19 03:12:35 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:12:36.084157 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-26f636a2-2b3c-4b17-a390-6193b1f7981d tempest-HypervisorAdminUnderV252Test-999306010 tempest-HypervisorAdminUnderV252Test-999306010-project-admin] Calling method '.version_select at 0x7fc131991160>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:36.086746 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-26f636a2-2b3c-4b17-a390-6193b1f7981d tempest-HypervisorAdminUnderV252Test-999306010 tempest-HypervisorAdminUnderV252Test-999306010-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:36.088636 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-26f636a2-2b3c-4b17-a390-6193b1f7981d tempest-HypervisorAdminUnderV252Test-999306010 tempest-HypervisorAdminUnderV252Test-999306010-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:36.088636 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-26f636a2-2b3c-4b17-a390-6193b1f7981d tempest-HypervisorAdminUnderV252Test-999306010 tempest-HypervisorAdminUnderV252Test-999306010-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:36.113260 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-26f636a2-2b3c-4b17-a390-6193b1f7981d tempest-HypervisorAdminUnderV252Test-999306010 tempest-HypervisorAdminUnderV252Test-999306010-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:36.114284 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-26f636a2-2b3c-4b17-a390-6193b1f7981d tempest-HypervisorAdminUnderV252Test-999306010 tempest-HypervisorAdminUnderV252Test-999306010-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:36.114731 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-26f636a2-2b3c-4b17-a390-6193b1f7981d tempest-HypervisorAdminUnderV252Test-999306010 tempest-HypervisorAdminUnderV252Test-999306010-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:36.122570 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-26f636a2-2b3c-4b17-a390-6193b1f7981d tempest-HypervisorAdminUnderV252Test-999306010 tempest-HypervisorAdminUnderV252Test-999306010-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/n-h2-861333-8/search" status: 200 len: 104 microversion: 2.1 time: 0.045348 Oct 19 03:12:36.123879 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 60/125] 10.222.0.52 () {58 vars in 1209 bytes} [Wed Oct 19 03:12:36 2022] GET /compute/v2.1/os-hypervisors/n-h2-861333-8/search => generated 104 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:12:36.194352 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-fda80efd-d3b0-4a07-a875-f9efe061cdf2 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:36.195745 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-fda80efd-d3b0-4a07-a875-f9efe061cdf2 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] [instance: 7a48466f-9d33-480f-b67a-21777e03d4d5] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:12:36.207037 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fda80efd-d3b0-4a07-a875-f9efe061cdf2 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:36.207965 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fda80efd-d3b0-4a07-a875-f9efe061cdf2 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:36.208549 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fda80efd-d3b0-4a07-a875-f9efe061cdf2 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:36.209513 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fda80efd-d3b0-4a07-a875-f9efe061cdf2 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:36.210111 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fda80efd-d3b0-4a07-a875-f9efe061cdf2 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:36.210754 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fda80efd-d3b0-4a07-a875-f9efe061cdf2 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:36.278270 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6bfb09e7-3f64-40a0-9035-1016af5d7257 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:36.288779 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6bfb09e7-3f64-40a0-9035-1016af5d7257 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] [instance: 44cee120-503c-401f-b046-a638d08df855] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:12:36.306466 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6bfb09e7-3f64-40a0-9035-1016af5d7257 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:36.308382 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6bfb09e7-3f64-40a0-9035-1016af5d7257 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:36.309257 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6bfb09e7-3f64-40a0-9035-1016af5d7257 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:36.310873 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6bfb09e7-3f64-40a0-9035-1016af5d7257 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:36.314035 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6bfb09e7-3f64-40a0-9035-1016af5d7257 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:36.314632 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6bfb09e7-3f64-40a0-9035-1016af5d7257 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:37.135574 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-6bfb09e7-3f64-40a0-9035-1016af5d7257 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f665963909a64c148298b7a6c8e3307a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3054afe77df43afa6406ec25b57de65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:12:37.137222 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=100 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:12:37.145697 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-fda80efd-d3b0-4a07-a875-f9efe061cdf2 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '769928c8ecb643fa83a9d58465dcb263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ead65f008349329789135966c031d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:12:37.149230 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6bfb09e7-3f64-40a0-9035-1016af5d7257 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] 10.222.0.52 "GET /compute/v2.1/servers/44cee120-503c-401f-b046-a638d08df855" status: 200 len: 1338 microversion: 2.1 time: 0.878651 Oct 19 03:12:37.151772 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 61/126] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:12:36 2022] GET /compute/v2.1/servers/44cee120-503c-401f-b046-a638d08df855 => generated 1338 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:12:37.172091 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-fda80efd-d3b0-4a07-a875-f9efe061cdf2 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] 10.222.0.52 "GET /compute/v2.1/servers/7a48466f-9d33-480f-b67a-21777e03d4d5" status: 200 len: 1341 microversion: 2.1 time: 0.980500 Oct 19 03:12:37.173050 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 66/127] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:12:36 2022] GET /compute/v2.1/servers/7a48466f-9d33-480f-b67a-21777e03d4d5 => generated 1341 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:12:38.174185 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a7eea5f1-74b7-4c37-932a-f534861ebe2c tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:38.175425 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a7eea5f1-74b7-4c37-932a-f534861ebe2c tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] [instance: 44cee120-503c-401f-b046-a638d08df855] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:12:38.185862 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a7eea5f1-74b7-4c37-932a-f534861ebe2c tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:38.192536 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a7eea5f1-74b7-4c37-932a-f534861ebe2c tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:38.194793 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a7eea5f1-74b7-4c37-932a-f534861ebe2c tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:38.199727 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-47ff4eea-57eb-4cec-b7e6-ac3ba13eb2d4 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:38.201141 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-47ff4eea-57eb-4cec-b7e6-ac3ba13eb2d4 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] [instance: 7a48466f-9d33-480f-b67a-21777e03d4d5] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:12:38.212471 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a7eea5f1-74b7-4c37-932a-f534861ebe2c tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:38.213412 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=8 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:12:38.216651 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a7eea5f1-74b7-4c37-932a-f534861ebe2c tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:38.217158 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a7eea5f1-74b7-4c37-932a-f534861ebe2c tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:38.221136 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-47ff4eea-57eb-4cec-b7e6-ac3ba13eb2d4 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:38.224483 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-47ff4eea-57eb-4cec-b7e6-ac3ba13eb2d4 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:38.225551 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-47ff4eea-57eb-4cec-b7e6-ac3ba13eb2d4 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:38.230136 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-47ff4eea-57eb-4cec-b7e6-ac3ba13eb2d4 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:38.231554 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-47ff4eea-57eb-4cec-b7e6-ac3ba13eb2d4 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:38.232831 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-47ff4eea-57eb-4cec-b7e6-ac3ba13eb2d4 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:38.759838 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-47ff4eea-57eb-4cec-b7e6-ac3ba13eb2d4 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '769928c8ecb643fa83a9d58465dcb263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ead65f008349329789135966c031d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:12:38.770658 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a7eea5f1-74b7-4c37-932a-f534861ebe2c tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f665963909a64c148298b7a6c8e3307a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3054afe77df43afa6406ec25b57de65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:12:38.781989 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a7eea5f1-74b7-4c37-932a-f534861ebe2c tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] 10.222.0.52 "GET /compute/v2.1/servers/44cee120-503c-401f-b046-a638d08df855" status: 200 len: 1338 microversion: 2.1 time: 0.613018 Oct 19 03:12:38.782500 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-47ff4eea-57eb-4cec-b7e6-ac3ba13eb2d4 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] 10.222.0.52 "GET /compute/v2.1/servers/7a48466f-9d33-480f-b67a-21777e03d4d5" status: 200 len: 1341 microversion: 2.1 time: 0.585038 Oct 19 03:12:38.783442 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 62/128] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:12:38 2022] GET /compute/v2.1/servers/44cee120-503c-401f-b046-a638d08df855 => generated 1338 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:12:38.785876 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 67/129] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:12:38 2022] GET /compute/v2.1/servers/7a48466f-9d33-480f-b67a-21777e03d4d5 => generated 1341 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:12:38.811505 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-3531fb79-2226-49c5-807a-80fdaa1e1c46 req-8066f1a3-41f8-4c77-99ce-0efb04eedc90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44cee120-503c-401f-b046-a638d08df855", "tag": "552220b1-e24d-43aa-babe-fd8198281bae"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:12:38.840987 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-3531fb79-2226-49c5-807a-80fdaa1e1c46 req-8066f1a3-41f8-4c77-99ce-0efb04eedc90 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:38.842233 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-3531fb79-2226-49c5-807a-80fdaa1e1c46 req-8066f1a3-41f8-4c77-99ce-0efb04eedc90 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:38.843410 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-3531fb79-2226-49c5-807a-80fdaa1e1c46 req-8066f1a3-41f8-4c77-99ce-0efb04eedc90 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:38.882971 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-3531fb79-2226-49c5-807a-80fdaa1e1c46 req-8066f1a3-41f8-4c77-99ce-0efb04eedc90 service nova] Creating event network-changed:552220b1-e24d-43aa-babe-fd8198281bae for instance 44cee120-503c-401f-b046-a638d08df855 on n-h2-861333-8 Oct 19 03:12:38.892836 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-3531fb79-2226-49c5-807a-80fdaa1e1c46 req-8066f1a3-41f8-4c77-99ce-0efb04eedc90 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107094 Oct 19 03:12:38.897850 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 63/130] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:12:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:12:39.821937 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8b478c32-1aab-48e0-92ff-f49dd1131679 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:39.821937 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8b478c32-1aab-48e0-92ff-f49dd1131679 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] [instance: 7a48466f-9d33-480f-b67a-21777e03d4d5] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:12:39.822681 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0aade0af-10b5-441d-bd21-a4b06c564192 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:39.822681 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0aade0af-10b5-441d-bd21-a4b06c564192 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] [instance: 44cee120-503c-401f-b046-a638d08df855] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:12:39.822681 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=10 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:12:39.823313 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8b478c32-1aab-48e0-92ff-f49dd1131679 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:39.823313 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8b478c32-1aab-48e0-92ff-f49dd1131679 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:39.823313 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8b478c32-1aab-48e0-92ff-f49dd1131679 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:39.823313 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8b478c32-1aab-48e0-92ff-f49dd1131679 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:39.823668 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0aade0af-10b5-441d-bd21-a4b06c564192 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:39.823795 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8b478c32-1aab-48e0-92ff-f49dd1131679 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:39.823899 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0aade0af-10b5-441d-bd21-a4b06c564192 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:39.823983 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8b478c32-1aab-48e0-92ff-f49dd1131679 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:39.824097 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0aade0af-10b5-441d-bd21-a4b06c564192 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:39.824097 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0aade0af-10b5-441d-bd21-a4b06c564192 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:39.824097 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0aade0af-10b5-441d-bd21-a4b06c564192 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:39.824097 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0aade0af-10b5-441d-bd21-a4b06c564192 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:40.220187 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8b478c32-1aab-48e0-92ff-f49dd1131679 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '769928c8ecb643fa83a9d58465dcb263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ead65f008349329789135966c031d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:12:40.224581 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-0aade0af-10b5-441d-bd21-a4b06c564192 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f665963909a64c148298b7a6c8e3307a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3054afe77df43afa6406ec25b57de65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:12:40.229550 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8b478c32-1aab-48e0-92ff-f49dd1131679 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] 10.222.0.52 "GET /compute/v2.1/servers/7a48466f-9d33-480f-b67a-21777e03d4d5" status: 200 len: 1341 microversion: 2.1 time: 0.426354 Oct 19 03:12:40.230360 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 68/131] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:12:39 2022] GET /compute/v2.1/servers/7a48466f-9d33-480f-b67a-21777e03d4d5 => generated 1341 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:12:40.239992 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0aade0af-10b5-441d-bd21-a4b06c564192 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] 10.222.0.52 "GET /compute/v2.1/servers/44cee120-503c-401f-b046-a638d08df855" status: 200 len: 1338 microversion: 2.1 time: 0.436880 Oct 19 03:12:40.247745 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 64/132] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:12:39 2022] GET /compute/v2.1/servers/44cee120-503c-401f-b046-a638d08df855 => generated 1338 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:12:41.252276 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-990dadc0-40a1-4aae-958e-36949f2028ef tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:41.253094 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-990dadc0-40a1-4aae-958e-36949f2028ef tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] [instance: 7a48466f-9d33-480f-b67a-21777e03d4d5] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:12:41.259828 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-990dadc0-40a1-4aae-958e-36949f2028ef tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:41.260834 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-990dadc0-40a1-4aae-958e-36949f2028ef tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:41.261465 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-990dadc0-40a1-4aae-958e-36949f2028ef tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:41.262398 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-990dadc0-40a1-4aae-958e-36949f2028ef tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:41.263039 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-990dadc0-40a1-4aae-958e-36949f2028ef tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:41.263651 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-990dadc0-40a1-4aae-958e-36949f2028ef tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:41.267110 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-99912dd3-95bc-4166-b61d-00687c1707f4 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:41.267789 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-99912dd3-95bc-4166-b61d-00687c1707f4 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] [instance: 44cee120-503c-401f-b046-a638d08df855] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:12:41.271382 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=10 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:12:41.278264 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-99912dd3-95bc-4166-b61d-00687c1707f4 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:41.279067 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-99912dd3-95bc-4166-b61d-00687c1707f4 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:41.279685 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-99912dd3-95bc-4166-b61d-00687c1707f4 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:41.280854 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-99912dd3-95bc-4166-b61d-00687c1707f4 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:41.282353 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-99912dd3-95bc-4166-b61d-00687c1707f4 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:41.282805 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-99912dd3-95bc-4166-b61d-00687c1707f4 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:41.569225 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-99912dd3-95bc-4166-b61d-00687c1707f4 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f665963909a64c148298b7a6c8e3307a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3054afe77df43afa6406ec25b57de65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:12:41.582511 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-99912dd3-95bc-4166-b61d-00687c1707f4 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] 10.222.0.52 "GET /compute/v2.1/servers/44cee120-503c-401f-b046-a638d08df855" status: 200 len: 1338 microversion: 2.1 time: 0.320480 Oct 19 03:12:41.583584 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 65/133] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:12:41 2022] GET /compute/v2.1/servers/44cee120-503c-401f-b046-a638d08df855 => generated 1338 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:12:41.599205 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-990dadc0-40a1-4aae-958e-36949f2028ef tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '769928c8ecb643fa83a9d58465dcb263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ead65f008349329789135966c031d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:12:41.607077 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-990dadc0-40a1-4aae-958e-36949f2028ef tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] 10.222.0.52 "GET /compute/v2.1/servers/7a48466f-9d33-480f-b67a-21777e03d4d5" status: 200 len: 1341 microversion: 2.1 time: 0.358894 Oct 19 03:12:41.609402 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 69/134] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:12:41 2022] GET /compute/v2.1/servers/7a48466f-9d33-480f-b67a-21777e03d4d5 => generated 1341 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:12:42.615173 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8122142a-1fba-42fe-91cd-a403b50ad5c6 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:42.615808 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8122142a-1fba-42fe-91cd-a403b50ad5c6 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] [instance: 44cee120-503c-401f-b046-a638d08df855] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:12:42.633038 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8122142a-1fba-42fe-91cd-a403b50ad5c6 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:42.633574 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8122142a-1fba-42fe-91cd-a403b50ad5c6 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:42.634224 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8122142a-1fba-42fe-91cd-a403b50ad5c6 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:42.634955 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8122142a-1fba-42fe-91cd-a403b50ad5c6 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:42.636444 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8122142a-1fba-42fe-91cd-a403b50ad5c6 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:42.636938 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8122142a-1fba-42fe-91cd-a403b50ad5c6 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:42.820998 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-529e0a45-a777-4684-b61b-f2cb78202135 tempest-FlavorsAccessTestJSON-2007407118 tempest-FlavorsAccessTestJSON-2007407118-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1413575974", "id": 1803901763, "os-flavor-access:is_public": "False"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:12:42.861525 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8122142a-1fba-42fe-91cd-a403b50ad5c6 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f665963909a64c148298b7a6c8e3307a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3054afe77df43afa6406ec25b57de65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:12:42.875494 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8122142a-1fba-42fe-91cd-a403b50ad5c6 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] 10.222.0.52 "GET /compute/v2.1/servers/44cee120-503c-401f-b046-a638d08df855" status: 200 len: 1338 microversion: 2.1 time: 0.273456 Oct 19 03:12:42.876558 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 70/135] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:12:42 2022] GET /compute/v2.1/servers/44cee120-503c-401f-b046-a638d08df855 => generated 1338 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:12:42.881334 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-fd087d1c-e469-491a-b668-ae17470f4613 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:42.883349 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-fd087d1c-e469-491a-b668-ae17470f4613 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] [instance: 7a48466f-9d33-480f-b67a-21777e03d4d5] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:12:42.892988 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fd087d1c-e469-491a-b668-ae17470f4613 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:42.896262 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fd087d1c-e469-491a-b668-ae17470f4613 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:42.898211 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fd087d1c-e469-491a-b668-ae17470f4613 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:42.898211 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fd087d1c-e469-491a-b668-ae17470f4613 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:42.899347 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fd087d1c-e469-491a-b668-ae17470f4613 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:42.899957 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fd087d1c-e469-491a-b668-ae17470f4613 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:42.927230 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-529e0a45-a777-4684-b61b-f2cb78202135 tempest-FlavorsAccessTestJSON-2007407118 tempest-FlavorsAccessTestJSON-2007407118-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.573946 Oct 19 03:12:42.927832 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 66/136] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:12:42 2022] POST /compute/v2.1/flavors => generated 431 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:12:42.941561 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-198f283f-846e-4c6b-8517-bce28ca61b52 tempest-FlavorsAccessTestJSON-2007407118 tempest-FlavorsAccessTestJSON-2007407118-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "6473d306da4d4d9a91c44cd788cccabe"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:12:43.206217 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-fd087d1c-e469-491a-b668-ae17470f4613 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '769928c8ecb643fa83a9d58465dcb263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ead65f008349329789135966c031d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:12:43.227956 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-fd087d1c-e469-491a-b668-ae17470f4613 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] 10.222.0.52 "GET /compute/v2.1/servers/7a48466f-9d33-480f-b67a-21777e03d4d5" status: 200 len: 1341 microversion: 2.1 time: 0.350055 Oct 19 03:12:43.228573 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 71/137] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:12:42 2022] GET /compute/v2.1/servers/7a48466f-9d33-480f-b67a-21777e03d4d5 => generated 1341 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:12:43.751199 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-198f283f-846e-4c6b-8517-bce28ca61b52 tempest-FlavorsAccessTestJSON-2007407118 tempest-FlavorsAccessTestJSON-2007407118-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors/1803901763/action" status: 200 len: 97 microversion: 2.1 time: 0.811777 Oct 19 03:12:43.751929 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 67/138] 10.222.0.52 () {60 vars in 1200 bytes} [Wed Oct 19 03:12:42 2022] POST /compute/v2.1/flavors/1803901763/action => generated 97 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 03:12:43.771050 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-198f283f-846e-4c6b-8517-bce28ca61b52 tempest-FlavorsAccessTestJSON-2007407118 tempest-FlavorsAccessTestJSON-2007407118-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:43.772032 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-198f283f-846e-4c6b-8517-bce28ca61b52 tempest-FlavorsAccessTestJSON-2007407118 tempest-FlavorsAccessTestJSON-2007407118-project-admin] 10.222.0.52 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001323 Oct 19 03:12:43.772378 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 68/139] 10.222.0.52 () {56 vars in 886 bytes} [Wed Oct 19 03:12:43 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 19 03:12:43.900989 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7acac980-9d5e-44cb-b4a5-e0ce198750d9 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:43.902592 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7acac980-9d5e-44cb-b4a5-e0ce198750d9 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] [instance: 44cee120-503c-401f-b046-a638d08df855] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:12:43.911904 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7acac980-9d5e-44cb-b4a5-e0ce198750d9 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:43.912914 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7acac980-9d5e-44cb-b4a5-e0ce198750d9 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:43.914127 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7acac980-9d5e-44cb-b4a5-e0ce198750d9 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:43.915325 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7acac980-9d5e-44cb-b4a5-e0ce198750d9 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:43.916242 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7acac980-9d5e-44cb-b4a5-e0ce198750d9 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:43.917262 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7acac980-9d5e-44cb-b4a5-e0ce198750d9 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:44.100712 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7acac980-9d5e-44cb-b4a5-e0ce198750d9 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f665963909a64c148298b7a6c8e3307a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3054afe77df43afa6406ec25b57de65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:12:44.102058 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-779e8815-62d4-4269-a8fb-421034e72000 tempest-FlavorsAccessTestJSON-1594215892 tempest-FlavorsAccessTestJSON-1594215892-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:44.108817 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7acac980-9d5e-44cb-b4a5-e0ce198750d9 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] 10.222.0.52 "GET /compute/v2.1/servers/44cee120-503c-401f-b046-a638d08df855" status: 200 len: 1338 microversion: 2.1 time: 0.212351 Oct 19 03:12:44.110185 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 69/140] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:12:43 2022] GET /compute/v2.1/servers/44cee120-503c-401f-b046-a638d08df855 => generated 1338 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:12:44.141325 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-779e8815-62d4-4269-a8fb-421034e72000 tempest-FlavorsAccessTestJSON-1594215892 tempest-FlavorsAccessTestJSON-1594215892-project] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5412 microversion: 2.1 time: 0.384125 Oct 19 03:12:44.142306 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 72/141] 10.222.0.52 () {58 vars in 1146 bytes} [Wed Oct 19 03:12:43 2022] GET /compute/v2.1/flavors/detail => generated 5412 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:12:44.162222 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-195d3a63-ac39-4286-b4bd-8768f8802109 tempest-FlavorsAccessTestJSON-2007407118 tempest-FlavorsAccessTestJSON-2007407118-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "6473d306da4d4d9a91c44cd788cccabe"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:12:44.254029 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d6506ee4-432e-4b24-80ca-b579a9024f3b tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:44.255009 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d6506ee4-432e-4b24-80ca-b579a9024f3b tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] [instance: 7a48466f-9d33-480f-b67a-21777e03d4d5] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:12:44.264019 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d6506ee4-432e-4b24-80ca-b579a9024f3b tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:44.264422 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d6506ee4-432e-4b24-80ca-b579a9024f3b tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:44.264860 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d6506ee4-432e-4b24-80ca-b579a9024f3b tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:44.266361 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d6506ee4-432e-4b24-80ca-b579a9024f3b tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:44.267072 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d6506ee4-432e-4b24-80ca-b579a9024f3b tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:44.267683 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d6506ee4-432e-4b24-80ca-b579a9024f3b tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:44.502687 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d6506ee4-432e-4b24-80ca-b579a9024f3b tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '769928c8ecb643fa83a9d58465dcb263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ead65f008349329789135966c031d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:12:44.514219 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d6506ee4-432e-4b24-80ca-b579a9024f3b tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] 10.222.0.52 "GET /compute/v2.1/servers/7a48466f-9d33-480f-b67a-21777e03d4d5" status: 200 len: 1341 microversion: 2.1 time: 0.265372 Oct 19 03:12:44.515809 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 73/142] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:12:44 2022] GET /compute/v2.1/servers/7a48466f-9d33-480f-b67a-21777e03d4d5 => generated 1341 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:12:45.005577 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-195d3a63-ac39-4286-b4bd-8768f8802109 tempest-FlavorsAccessTestJSON-2007407118 tempest-FlavorsAccessTestJSON-2007407118-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors/1803901763/action" status: 200 len: 21 microversion: 2.1 time: 0.848870 Oct 19 03:12:45.006412 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 70/143] 10.222.0.52 () {60 vars in 1200 bytes} [Wed Oct 19 03:12:44 2022] POST /compute/v2.1/flavors/1803901763/action => generated 21 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 03:12:45.016836 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-93931ea5-4339-4f13-a428-8a5b48c09467 tempest-FlavorsAccessTestJSON-1594215892 tempest-FlavorsAccessTestJSON-1594215892-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:45.049292 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-93931ea5-4339-4f13-a428-8a5b48c09467 tempest-FlavorsAccessTestJSON-1594215892 tempest-FlavorsAccessTestJSON-1594215892-project] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.036599 Oct 19 03:12:45.050275 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 74/144] 10.222.0.52 () {58 vars in 1146 bytes} [Wed Oct 19 03:12:45 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:12:45.074746 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7cf71207-6fc3-4e19-981c-502277f9d000 tempest-FlavorsAccessTestJSON-2007407118 tempest-FlavorsAccessTestJSON-2007407118-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:45.092732 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=4,nova_api:INSERT=3,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:12:45.144561 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7cf71207-6fc3-4e19-981c-502277f9d000 tempest-FlavorsAccessTestJSON-2007407118 tempest-FlavorsAccessTestJSON-2007407118-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/1803901763" status: 202 len: 0 microversion: 2.1 time: 0.077865 Oct 19 03:12:45.152004 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 75/145] 10.222.0.52 () {58 vars in 1161 bytes} [Wed Oct 19 03:12:45 2022] DELETE /compute/v2.1/flavors/1803901763 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:12:45.160766 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b1055c4b-95e8-41a9-8182-3817519488f1 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:45.161698 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b1055c4b-95e8-41a9-8182-3817519488f1 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] [instance: 44cee120-503c-401f-b046-a638d08df855] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:12:45.170702 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b1055c4b-95e8-41a9-8182-3817519488f1 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:45.171873 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b1055c4b-95e8-41a9-8182-3817519488f1 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:45.172667 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b1055c4b-95e8-41a9-8182-3817519488f1 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:45.173685 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b1055c4b-95e8-41a9-8182-3817519488f1 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:45.174947 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b1055c4b-95e8-41a9-8182-3817519488f1 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:45.175562 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b1055c4b-95e8-41a9-8182-3817519488f1 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:45.376491 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3b995bb5-8450-43d4-bab9-b177ade6a156 tempest-InstanceUsageAuditLogTestJSON-1047346607 tempest-InstanceUsageAuditLogTestJSON-1047346607-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:45.410073 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-3b995bb5-8450-43d4-bab9-b177ade6a156 tempest-InstanceUsageAuditLogTestJSON-1047346607 tempest-InstanceUsageAuditLogTestJSON-1047346607-project-admin] 10.222.0.52 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-19 03:12:45" status: 200 len: 318 microversion: 2.1 time: 0.366085 Oct 19 03:12:45.411300 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 71/146] 10.222.0.52 () {58 vars in 1251 bytes} [Wed Oct 19 03:12:45 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-19%2003%3A12%3A45 => generated 318 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:12:45.418344 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-50213ffc-77f8-4147-8750-d31df8949905 tempest-FlavorsAccessTestJSON-2007407118 tempest-FlavorsAccessTestJSON-2007407118-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:45.456852 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-50213ffc-77f8-4147-8750-d31df8949905 tempest-FlavorsAccessTestJSON-2007407118 tempest-FlavorsAccessTestJSON-2007407118-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.044258 Oct 19 03:12:45.458096 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 72/147] 10.222.0.52 () {58 vars in 1146 bytes} [Wed Oct 19 03:12:45 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:12:45.463542 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-370004e0-4543-4a67-8647-6c3e95edad48 tempest-InstanceUsageAuditLogTestJSON-1047346607 tempest-InstanceUsageAuditLogTestJSON-1047346607-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:45.508291 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-370004e0-4543-4a67-8647-6c3e95edad48 tempest-InstanceUsageAuditLogTestJSON-1047346607 tempest-InstanceUsageAuditLogTestJSON-1047346607-project-admin] 10.222.0.52 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.047201 Oct 19 03:12:45.513119 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 73/148] 10.222.0.52 () {58 vars in 1185 bytes} [Wed Oct 19 03:12:45 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:12:45.534626 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-03be6ec5-5f19-4e07-92b6-20f9948d9291 tempest-FlavorsAccessTestJSON-2007407118 tempest-FlavorsAccessTestJSON-2007407118-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1008162592", "id": 491703650, "os-flavor-access:is_public": "False"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:12:45.539938 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b1055c4b-95e8-41a9-8182-3817519488f1 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f665963909a64c148298b7a6c8e3307a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3054afe77df43afa6406ec25b57de65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:12:45.548265 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b1055c4b-95e8-41a9-8182-3817519488f1 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] 10.222.0.52 "GET /compute/v2.1/servers/44cee120-503c-401f-b046-a638d08df855" status: 200 len: 1338 microversion: 2.1 time: 0.394634 Oct 19 03:12:45.566277 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 76/149] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:12:45 2022] GET /compute/v2.1/servers/44cee120-503c-401f-b046-a638d08df855 => generated 1338 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:12:45.577385 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0d28d86c-0711-42e7-b299-dec3fa524352 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:45.578775 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0d28d86c-0711-42e7-b299-dec3fa524352 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] [instance: 7a48466f-9d33-480f-b67a-21777e03d4d5] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:12:45.586881 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0d28d86c-0711-42e7-b299-dec3fa524352 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:45.587597 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0d28d86c-0711-42e7-b299-dec3fa524352 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:45.588113 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0d28d86c-0711-42e7-b299-dec3fa524352 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:45.589025 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0d28d86c-0711-42e7-b299-dec3fa524352 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:45.589732 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0d28d86c-0711-42e7-b299-dec3fa524352 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:45.590761 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0d28d86c-0711-42e7-b299-dec3fa524352 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:45.660899 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-03be6ec5-5f19-4e07-92b6-20f9948d9291 tempest-FlavorsAccessTestJSON-2007407118 tempest-FlavorsAccessTestJSON-2007407118-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.145705 Oct 19 03:12:45.662155 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 74/150] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:12:45 2022] POST /compute/v2.1/flavors => generated 428 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:12:45.682505 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2965c328-960e-4784-ac88-fbbd23f23a83 tempest-FlavorsAccessTestJSON-2007407118 tempest-FlavorsAccessTestJSON-2007407118-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:45.728038 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2965c328-960e-4784-ac88-fbbd23f23a83 tempest-FlavorsAccessTestJSON-2007407118 tempest-FlavorsAccessTestJSON-2007407118-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/491703650/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.057911 Oct 19 03:12:45.734922 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 75/151] 10.222.0.52 () {58 vars in 1206 bytes} [Wed Oct 19 03:12:45 2022] GET /compute/v2.1/flavors/491703650/os-flavor-access => generated 21 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 03:12:45.743852 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1f3aa0ba-625f-4f55-b9db-87fb7c4f1f52 tempest-FlavorsAccessTestJSON-2007407118 tempest-FlavorsAccessTestJSON-2007407118-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:45.845884 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1f3aa0ba-625f-4f55-b9db-87fb7c4f1f52 tempest-FlavorsAccessTestJSON-2007407118 tempest-FlavorsAccessTestJSON-2007407118-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/491703650" status: 202 len: 0 microversion: 2.1 time: 0.105971 Oct 19 03:12:45.847321 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 76/152] 10.222.0.52 () {58 vars in 1158 bytes} [Wed Oct 19 03:12:45 2022] DELETE /compute/v2.1/flavors/491703650 => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:12:45.854651 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ae8ea917-89dd-4171-9bfa-ea85f8bfa30f tempest-FlavorsAccessTestJSON-2007407118 tempest-FlavorsAccessTestJSON-2007407118-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:45.876575 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ae8ea917-89dd-4171-9bfa-ea85f8bfa30f tempest-FlavorsAccessTestJSON-2007407118 tempest-FlavorsAccessTestJSON-2007407118-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025594 Oct 19 03:12:45.877744 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 77/153] 10.222.0.52 () {58 vars in 1146 bytes} [Wed Oct 19 03:12:45 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:12:45.955568 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0d28d86c-0711-42e7-b299-dec3fa524352 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '769928c8ecb643fa83a9d58465dcb263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ead65f008349329789135966c031d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:12:45.970384 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0d28d86c-0711-42e7-b299-dec3fa524352 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] 10.222.0.52 "GET /compute/v2.1/servers/7a48466f-9d33-480f-b67a-21777e03d4d5" status: 200 len: 1341 microversion: 2.1 time: 0.399974 Oct 19 03:12:45.970988 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 77/154] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:12:45 2022] GET /compute/v2.1/servers/7a48466f-9d33-480f-b67a-21777e03d4d5 => generated 1341 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:12:46.577063 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6a7d737d-38db-4a93-9ef0-67cfa94a4918 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:46.577733 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6a7d737d-38db-4a93-9ef0-67cfa94a4918 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] [instance: 44cee120-503c-401f-b046-a638d08df855] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:12:46.610603 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6a7d737d-38db-4a93-9ef0-67cfa94a4918 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:46.614802 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6a7d737d-38db-4a93-9ef0-67cfa94a4918 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:46.617990 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6a7d737d-38db-4a93-9ef0-67cfa94a4918 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:46.619739 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6a7d737d-38db-4a93-9ef0-67cfa94a4918 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:46.623719 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6a7d737d-38db-4a93-9ef0-67cfa94a4918 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:46.625396 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6a7d737d-38db-4a93-9ef0-67cfa94a4918 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:46.864327 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-6a7d737d-38db-4a93-9ef0-67cfa94a4918 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f665963909a64c148298b7a6c8e3307a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3054afe77df43afa6406ec25b57de65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:12:46.877487 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6a7d737d-38db-4a93-9ef0-67cfa94a4918 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] 10.222.0.52 "GET /compute/v2.1/servers/44cee120-503c-401f-b046-a638d08df855" status: 200 len: 1338 microversion: 2.1 time: 0.304479 Oct 19 03:12:46.878884 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 78/155] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:12:46 2022] GET /compute/v2.1/servers/44cee120-503c-401f-b046-a638d08df855 => generated 1338 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:12:46.922502 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a79e3c71-3189-493f-aad6-117ef1bf89d7 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1482446214", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:12:47.000355 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-821006d1-1d56-4994-85ae-6e769eb61b43 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:47.003162 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-821006d1-1d56-4994-85ae-6e769eb61b43 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] [instance: 7a48466f-9d33-480f-b67a-21777e03d4d5] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:12:47.019151 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-821006d1-1d56-4994-85ae-6e769eb61b43 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:47.021044 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-821006d1-1d56-4994-85ae-6e769eb61b43 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:47.021685 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-821006d1-1d56-4994-85ae-6e769eb61b43 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:47.024705 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-821006d1-1d56-4994-85ae-6e769eb61b43 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:47.026358 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-821006d1-1d56-4994-85ae-6e769eb61b43 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:47.028377 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-821006d1-1d56-4994-85ae-6e769eb61b43 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:47.032823 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.network.neutron [None req-a79e3c71-3189-493f-aad6-117ef1bf89d7 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] validate_networks() for None {{(pid=121135) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:12:47.406841 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-821006d1-1d56-4994-85ae-6e769eb61b43 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '769928c8ecb643fa83a9d58465dcb263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ead65f008349329789135966c031d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:12:47.420300 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-821006d1-1d56-4994-85ae-6e769eb61b43 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] 10.222.0.52 "GET /compute/v2.1/servers/7a48466f-9d33-480f-b67a-21777e03d4d5" status: 200 len: 1341 microversion: 2.1 time: 0.426540 Oct 19 03:12:47.423784 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 79/156] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:12:46 2022] GET /compute/v2.1/servers/7a48466f-9d33-480f-b67a-21777e03d4d5 => generated 1341 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:12:47.598908 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-a79e3c71-3189-493f-aad6-117ef1bf89d7 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Flavor limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:12:47.599532 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-a79e3c71-3189-493f-aad6-117ef1bf89d7 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Image limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:12:47.600745 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-a79e3c71-3189-493f-aad6-117ef1bf89d7 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Flavor pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:12:47.601338 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-a79e3c71-3189-493f-aad6-117ef1bf89d7 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Image pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:12:47.601945 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-a79e3c71-3189-493f-aad6-117ef1bf89d7 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:12:47.622057 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a79e3c71-3189-493f-aad6-117ef1bf89d7 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:47.623148 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a79e3c71-3189-493f-aad6-117ef1bf89d7 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:47.623597 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a79e3c71-3189-493f-aad6-117ef1bf89d7 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:47.624347 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a79e3c71-3189-493f-aad6-117ef1bf89d7 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:47.624862 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a79e3c71-3189-493f-aad6-117ef1bf89d7 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:47.627477 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a79e3c71-3189-493f-aad6-117ef1bf89d7 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:47.688669 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-a79e3c71-3189-493f-aad6-117ef1bf89d7 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Getting quotas for project c9a76121a22144499a44f44bb78848bf. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:12:47.694291 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-a79e3c71-3189-493f-aad6-117ef1bf89d7 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Getting quotas for user 9f8493504d9243bc95c9861f4ff76c83 and project c9a76121a22144499a44f44bb78848bf. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:12:47.720117 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a79e3c71-3189-493f-aad6-117ef1bf89d7 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Going to run 1 instances... {{(pid=121135) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:12:47.722899 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a79e3c71-3189-493f-aad6-117ef1bf89d7 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 7b4a8cd9-a238-4bff-a002-497dc807bf3a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121135) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:12:47.876080 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a79e3c71-3189-493f-aad6-117ef1bf89d7 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.658046 Oct 19 03:12:47.877459 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 78/157] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:12:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1660 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 03:12:47.888922 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c2ad1aa0-7c24-4ca2-a463-859e8c43b6f4 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:47.890231 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c2ad1aa0-7c24-4ca2-a463-859e8c43b6f4 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 7b4a8cd9-a238-4bff-a002-497dc807bf3a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:12:47.904267 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-691947f3-b033-4c1f-855f-4e5420922170 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:47.909566 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-691947f3-b033-4c1f-855f-4e5420922170 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] [instance: 44cee120-503c-401f-b046-a638d08df855] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:12:47.925160 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-691947f3-b033-4c1f-855f-4e5420922170 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:47.926272 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-691947f3-b033-4c1f-855f-4e5420922170 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:47.926896 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-691947f3-b033-4c1f-855f-4e5420922170 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:47.927753 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-691947f3-b033-4c1f-855f-4e5420922170 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:47.930025 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-691947f3-b033-4c1f-855f-4e5420922170 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:47.931559 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-691947f3-b033-4c1f-855f-4e5420922170 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:48.089173 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c2ad1aa0-7c24-4ca2-a463-859e8c43b6f4 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:12:48.097804 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c2ad1aa0-7c24-4ca2-a463-859e8c43b6f4 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a" status: 200 len: 1213 microversion: 2.1 time: 0.213197 Oct 19 03:12:48.100661 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 80/158] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:12:47 2022] GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a => generated 1213 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:12:48.255681 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-691947f3-b033-4c1f-855f-4e5420922170 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f665963909a64c148298b7a6c8e3307a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3054afe77df43afa6406ec25b57de65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:12:48.264337 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-691947f3-b033-4c1f-855f-4e5420922170 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] 10.222.0.52 "GET /compute/v2.1/servers/44cee120-503c-401f-b046-a638d08df855" status: 200 len: 1338 microversion: 2.1 time: 0.364316 Oct 19 03:12:48.265125 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 79/159] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:12:47 2022] GET /compute/v2.1/servers/44cee120-503c-401f-b046-a638d08df855 => generated 1338 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:12:48.447885 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-52e2f3e9-cd01-4b1c-810c-6f98527c13f2 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:48.448614 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-52e2f3e9-cd01-4b1c-810c-6f98527c13f2 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] [instance: 7a48466f-9d33-480f-b67a-21777e03d4d5] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:12:48.465311 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-52e2f3e9-cd01-4b1c-810c-6f98527c13f2 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:48.468711 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-52e2f3e9-cd01-4b1c-810c-6f98527c13f2 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:48.470423 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-52e2f3e9-cd01-4b1c-810c-6f98527c13f2 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:48.475574 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-52e2f3e9-cd01-4b1c-810c-6f98527c13f2 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:48.476107 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-52e2f3e9-cd01-4b1c-810c-6f98527c13f2 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:48.477302 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-52e2f3e9-cd01-4b1c-810c-6f98527c13f2 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:48.802431 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-52e2f3e9-cd01-4b1c-810c-6f98527c13f2 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '769928c8ecb643fa83a9d58465dcb263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ead65f008349329789135966c031d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:12:48.811206 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-52e2f3e9-cd01-4b1c-810c-6f98527c13f2 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] 10.222.0.52 "GET /compute/v2.1/servers/7a48466f-9d33-480f-b67a-21777e03d4d5" status: 200 len: 1341 microversion: 2.1 time: 0.368512 Oct 19 03:12:48.815735 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 81/160] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:12:48 2022] GET /compute/v2.1/servers/7a48466f-9d33-480f-b67a-21777e03d4d5 => generated 1341 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:12:49.121181 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7d62f007-c30c-4bb7-bbf8-001eb39b4ef5 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:49.121593 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7d62f007-c30c-4bb7-bbf8-001eb39b4ef5 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 7b4a8cd9-a238-4bff-a002-497dc807bf3a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:12:49.185550 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7d62f007-c30c-4bb7-bbf8-001eb39b4ef5 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:12:49.195265 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7d62f007-c30c-4bb7-bbf8-001eb39b4ef5 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a" status: 200 len: 1213 microversion: 2.1 time: 0.078083 Oct 19 03:12:49.197437 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 80/161] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:12:49 2022] GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a => generated 1213 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:12:49.291417 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-118c6892-8444-4478-94b8-07685add56b2 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:49.293277 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-118c6892-8444-4478-94b8-07685add56b2 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] [instance: 44cee120-503c-401f-b046-a638d08df855] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:12:49.301506 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-118c6892-8444-4478-94b8-07685add56b2 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:49.303058 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-118c6892-8444-4478-94b8-07685add56b2 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:49.306624 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-118c6892-8444-4478-94b8-07685add56b2 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:49.307766 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-118c6892-8444-4478-94b8-07685add56b2 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:49.309763 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-118c6892-8444-4478-94b8-07685add56b2 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:49.310384 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-118c6892-8444-4478-94b8-07685add56b2 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:49.473639 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-118c6892-8444-4478-94b8-07685add56b2 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f665963909a64c148298b7a6c8e3307a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3054afe77df43afa6406ec25b57de65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:12:49.482999 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-118c6892-8444-4478-94b8-07685add56b2 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] 10.222.0.52 "GET /compute/v2.1/servers/44cee120-503c-401f-b046-a638d08df855" status: 200 len: 1338 microversion: 2.1 time: 0.195419 Oct 19 03:12:49.483859 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 82/162] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:12:49 2022] GET /compute/v2.1/servers/44cee120-503c-401f-b046-a638d08df855 => generated 1338 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:12:49.840463 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1ddc3301-92f7-45e7-83a5-0bfbf43987a5 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:49.841107 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1ddc3301-92f7-45e7-83a5-0bfbf43987a5 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] [instance: 7a48466f-9d33-480f-b67a-21777e03d4d5] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:12:49.857133 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1ddc3301-92f7-45e7-83a5-0bfbf43987a5 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:49.859886 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1ddc3301-92f7-45e7-83a5-0bfbf43987a5 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:49.865072 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1ddc3301-92f7-45e7-83a5-0bfbf43987a5 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:49.865903 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1ddc3301-92f7-45e7-83a5-0bfbf43987a5 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:49.866861 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1ddc3301-92f7-45e7-83a5-0bfbf43987a5 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:49.868310 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1ddc3301-92f7-45e7-83a5-0bfbf43987a5 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:49.994394 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-cd68b203-eaa7-4283-87ab-f367598f0e15 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:50.026067 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-cd68b203-eaa7-4283-87ab-f367598f0e15 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] 10.222.0.52 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.360791 Oct 19 03:12:50.029471 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 81/163] 10.222.0.52 () {58 vars in 1137 bytes} [Wed Oct 19 03:12:49 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:12:50.159986 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-1ddc3301-92f7-45e7-83a5-0bfbf43987a5 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '769928c8ecb643fa83a9d58465dcb263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ead65f008349329789135966c031d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:12:50.180794 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1ddc3301-92f7-45e7-83a5-0bfbf43987a5 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] 10.222.0.52 "GET /compute/v2.1/servers/7a48466f-9d33-480f-b67a-21777e03d4d5" status: 200 len: 1341 microversion: 2.1 time: 0.344512 Oct 19 03:12:50.181401 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 83/164] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:12:49 2022] GET /compute/v2.1/servers/7a48466f-9d33-480f-b67a-21777e03d4d5 => generated 1341 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:12:50.384408 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1e32daad-727e-4f39-9ee1-8bfc2cf8809b tempest-ServersWithSpecificFlavorTestJSON-943474520 tempest-ServersWithSpecificFlavorTestJSON-943474520-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-1321327394", "id": 568006541, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:12:50.452021 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:DELETE=7,nova_api:SELECT=86,nova_api:INSERT=7 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:12:50.456812 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1e32daad-727e-4f39-9ee1-8bfc2cf8809b tempest-ServersWithSpecificFlavorTestJSON-943474520 tempest-ServersWithSpecificFlavorTestJSON-943474520-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 422 microversion: 2.1 time: 0.415778 Oct 19 03:12:50.464876 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 82/165] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:12:50 2022] POST /compute/v2.1/flavors => generated 422 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:12:50.470463 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e0f0e3c6-a314-42e3-840e-155995a70056 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:50.471380 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e0f0e3c6-a314-42e3-840e-155995a70056 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 7b4a8cd9-a238-4bff-a002-497dc807bf3a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:12:50.479484 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e0f0e3c6-a314-42e3-840e-155995a70056 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:50.481313 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e0f0e3c6-a314-42e3-840e-155995a70056 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:50.482079 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e0f0e3c6-a314-42e3-840e-155995a70056 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:50.485477 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e0f0e3c6-a314-42e3-840e-155995a70056 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:50.486137 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e0f0e3c6-a314-42e3-840e-155995a70056 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:50.486750 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e0f0e3c6-a314-42e3-840e-155995a70056 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:50.535093 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-1578a830-6fae-47a3-95a7-c89b3f9e65ac req-ecd97614-7de0-48d7-a2a1-fe6c00a0c8f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a48466f-9d33-480f-b67a-21777e03d4d5", "name": "network-vif-plugged", "status": "completed", "tag": "a519b32a-37d6-4d4b-ad11-3afe261db20f"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:12:50.573004 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-e0f0e3c6-a314-42e3-840e-155995a70056 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:12:50.576816 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-1578a830-6fae-47a3-95a7-c89b3f9e65ac req-ecd97614-7de0-48d7-a2a1-fe6c00a0c8f5 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:50.577324 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-1578a830-6fae-47a3-95a7-c89b3f9e65ac req-ecd97614-7de0-48d7-a2a1-fe6c00a0c8f5 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:50.579137 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-1578a830-6fae-47a3-95a7-c89b3f9e65ac req-ecd97614-7de0-48d7-a2a1-fe6c00a0c8f5 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:50.587950 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e0f0e3c6-a314-42e3-840e-155995a70056 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a" status: 200 len: 1265 microversion: 2.1 time: 0.118432 Oct 19 03:12:50.589295 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 83/166] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:12:50 2022] GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a => generated 1265 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:12:50.596404 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e6ba1a7a-131f-4faf-9f1d-0164964cd4ba tempest-ServersWithSpecificFlavorTestJSON-943474520 tempest-ServersWithSpecificFlavorTestJSON-943474520-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:50.606046 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e6ba1a7a-131f-4faf-9f1d-0164964cd4ba tempest-ServersWithSpecificFlavorTestJSON-943474520 tempest-ServersWithSpecificFlavorTestJSON-943474520-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.015499 Oct 19 03:12:50.606913 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 84/167] 10.222.0.52 () {58 vars in 1182 bytes} [Wed Oct 19 03:12:50 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 03:12:50.637962 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4262a884-b375-412f-9f2b-e7c65a4126b9 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:50.641080 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4262a884-b375-412f-9f2b-e7c65a4126b9 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] [instance: 44cee120-503c-401f-b046-a638d08df855] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:12:50.651788 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4262a884-b375-412f-9f2b-e7c65a4126b9 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:50.652621 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4262a884-b375-412f-9f2b-e7c65a4126b9 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:50.653327 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4262a884-b375-412f-9f2b-e7c65a4126b9 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:50.654956 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4262a884-b375-412f-9f2b-e7c65a4126b9 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:50.656140 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4262a884-b375-412f-9f2b-e7c65a4126b9 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:50.657062 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4262a884-b375-412f-9f2b-e7c65a4126b9 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:50.668920 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-1578a830-6fae-47a3-95a7-c89b3f9e65ac req-ecd97614-7de0-48d7-a2a1-fe6c00a0c8f5 service nova] Creating event network-vif-plugged:a519b32a-37d6-4d4b-ad11-3afe261db20f for instance 7a48466f-9d33-480f-b67a-21777e03d4d5 on n-h2-861333-8 Oct 19 03:12:50.674135 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-1578a830-6fae-47a3-95a7-c89b3f9e65ac req-ecd97614-7de0-48d7-a2a1-fe6c00a0c8f5 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121134) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 19 03:12:50.674135 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-1578a830-6fae-47a3-95a7-c89b3f9e65ac req-ecd97614-7de0-48d7-a2a1-fe6c00a0c8f5 service nova] Acquired lock "compute-rpcapi-router" {{(pid=121134) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 19 03:12:50.674135 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-07652fef-ea18-401b-9bbf-ba666fee39d3 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:50.674135 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-07652fef-ea18-401b-9bbf-ba666fee39d3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:50.674135 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-07652fef-ea18-401b-9bbf-ba666fee39d3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:50.674610 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-07652fef-ea18-401b-9bbf-ba666fee39d3 None None] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:50.675957 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-07652fef-ea18-401b-9bbf-ba666fee39d3 None None] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:50.678023 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-07652fef-ea18-401b-9bbf-ba666fee39d3 None None] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:50.697190 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.compute.rpcapi [None req-07652fef-ea18-401b-9bbf-ba666fee39d3 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 19 03:12:50.700881 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-07652fef-ea18-401b-9bbf-ba666fee39d3 None None] Releasing lock "compute-rpcapi-router" {{(pid=121134) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 19 03:12:50.738464 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-07652fef-ea18-401b-9bbf-ba666fee39d3 None None] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.549559 Oct 19 03:12:50.740266 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 84/168] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:12:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:12:50.746142 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-074d620a-85a2-43b8-98df-d394d954bedb tempest-ServersWithSpecificFlavorTestJSON-943474520 tempest-ServersWithSpecificFlavorTestJSON-943474520-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-360465159", "id": 214789776, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:12:50.875098 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-074d620a-85a2-43b8-98df-d394d954bedb tempest-ServersWithSpecificFlavorTestJSON-943474520 tempest-ServersWithSpecificFlavorTestJSON-943474520-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 421 microversion: 2.1 time: 0.132761 Oct 19 03:12:50.878688 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 85/169] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:12:50 2022] POST /compute/v2.1/flavors => generated 421 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:12:50.894574 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-31090a89-5a86-491c-a051-1b55169acb3c tempest-ServersWithSpecificFlavorTestJSON-943474520 tempest-ServersWithSpecificFlavorTestJSON-943474520-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:50.925541 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-31090a89-5a86-491c-a051-1b55169acb3c tempest-ServersWithSpecificFlavorTestJSON-943474520 tempest-ServersWithSpecificFlavorTestJSON-943474520-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.038585 Oct 19 03:12:50.926439 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 86/170] 10.222.0.52 () {58 vars in 1182 bytes} [Wed Oct 19 03:12:50 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 03:12:50.945306 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7bd7c425-8c00-40a2-9c8b-24dfc9cb0ca2 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Action: 'create', calling method: .version_select at 0x7fc1318a10d0>, body: {"keypair": {"name": "tempest-keypair-1415990507", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH2E/va7RmeNYvsFvsjjOek2IOqsSAy47XIE3JDSNEgq+/UlcJqJxdx1WBx/6tuE1MGhXLto64OxN4Igqwfq02xWIO91J971UFmSXA5onlypw9SuzMvN1pwbFfLsVU7MSQ=="}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:12:50.994111 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-7bd7c425-8c00-40a2-9c8b-24dfc9cb0ca2 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Getting quotas for project df99b134b20743eb9b62788706f2705a. Resources: {'key_pairs'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:12:51.005547 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-7bd7c425-8c00-40a2-9c8b-24dfc9cb0ca2 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Getting quotas for user 2cc37ae4bed94a7e85ed70dd5942c2bd and project df99b134b20743eb9b62788706f2705a. Resources: {'key_pairs'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:12:51.080437 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4262a884-b375-412f-9f2b-e7c65a4126b9 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f665963909a64c148298b7a6c8e3307a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3054afe77df43afa6406ec25b57de65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:12:51.103590 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7bd7c425-8c00-40a2-9c8b-24dfc9cb0ca2 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.162105 Oct 19 03:12:51.104730 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 87/171] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Oct 19 03:12:50 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:12:51.107584 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4262a884-b375-412f-9f2b-e7c65a4126b9 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] 10.222.0.52 "GET /compute/v2.1/servers/44cee120-503c-401f-b046-a638d08df855" status: 200 len: 1338 microversion: 2.1 time: 0.475071 Oct 19 03:12:51.112412 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 85/172] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:12:50 2022] GET /compute/v2.1/servers/44cee120-503c-401f-b046-a638d08df855 => generated 1338 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:12:51.204416 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f97543b1-9c50-4941-8a97-b7c7ce11f409 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:51.205086 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f97543b1-9c50-4941-8a97-b7c7ce11f409 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] [instance: 7a48466f-9d33-480f-b67a-21777e03d4d5] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:12:51.214305 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f97543b1-9c50-4941-8a97-b7c7ce11f409 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:51.214305 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f97543b1-9c50-4941-8a97-b7c7ce11f409 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:51.214305 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f97543b1-9c50-4941-8a97-b7c7ce11f409 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:51.214305 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f97543b1-9c50-4941-8a97-b7c7ce11f409 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:51.214579 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f97543b1-9c50-4941-8a97-b7c7ce11f409 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:51.214579 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f97543b1-9c50-4941-8a97-b7c7ce11f409 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:51.438495 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-f97543b1-9c50-4941-8a97-b7c7ce11f409 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '769928c8ecb643fa83a9d58465dcb263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ead65f008349329789135966c031d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:12:51.449154 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f97543b1-9c50-4941-8a97-b7c7ce11f409 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] 10.222.0.52 "GET /compute/v2.1/servers/7a48466f-9d33-480f-b67a-21777e03d4d5" status: 200 len: 1341 microversion: 2.1 time: 0.249065 Oct 19 03:12:51.466158 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 88/173] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:12:51 2022] GET /compute/v2.1/servers/7a48466f-9d33-480f-b67a-21777e03d4d5 => generated 1341 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:12:51.616419 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-506549a7-7deb-46db-9d00-c0862468afd0 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:51.617182 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-506549a7-7deb-46db-9d00-c0862468afd0 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 7b4a8cd9-a238-4bff-a002-497dc807bf3a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:12:51.624074 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-506549a7-7deb-46db-9d00-c0862468afd0 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:51.624611 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-506549a7-7deb-46db-9d00-c0862468afd0 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:51.625306 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-506549a7-7deb-46db-9d00-c0862468afd0 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:51.626279 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-506549a7-7deb-46db-9d00-c0862468afd0 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:51.626822 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-506549a7-7deb-46db-9d00-c0862468afd0 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:51.627463 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-506549a7-7deb-46db-9d00-c0862468afd0 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:51.736472 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-506549a7-7deb-46db-9d00-c0862468afd0 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:12:51.746490 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-506549a7-7deb-46db-9d00-c0862468afd0 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a" status: 200 len: 1271 microversion: 2.1 time: 0.133998 Oct 19 03:12:51.751297 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 86/174] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:12:51 2022] GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a => generated 1271 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:12:52.134345 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5647f77d-4215-480a-a55b-d6c98aaad4dd tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:52.135224 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5647f77d-4215-480a-a55b-d6c98aaad4dd tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] [instance: 44cee120-503c-401f-b046-a638d08df855] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:12:52.146126 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5647f77d-4215-480a-a55b-d6c98aaad4dd tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:52.153661 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5647f77d-4215-480a-a55b-d6c98aaad4dd tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:52.157649 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5647f77d-4215-480a-a55b-d6c98aaad4dd tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:52.157649 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5647f77d-4215-480a-a55b-d6c98aaad4dd tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:52.158017 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5647f77d-4215-480a-a55b-d6c98aaad4dd tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:52.158142 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5647f77d-4215-480a-a55b-d6c98aaad4dd tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:52.407264 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5647f77d-4215-480a-a55b-d6c98aaad4dd tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f665963909a64c148298b7a6c8e3307a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3054afe77df43afa6406ec25b57de65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:12:52.412894 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=100 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:12:52.420277 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5647f77d-4215-480a-a55b-d6c98aaad4dd tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] 10.222.0.52 "GET /compute/v2.1/servers/44cee120-503c-401f-b046-a638d08df855" status: 200 len: 1338 microversion: 2.1 time: 0.289449 Oct 19 03:12:52.425190 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 89/175] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:12:52 2022] GET /compute/v2.1/servers/44cee120-503c-401f-b046-a638d08df855 => generated 1338 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:12:52.484714 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d326c5e7-e0b7-4f94-8d16-293b81e785d3 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:52.485872 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d326c5e7-e0b7-4f94-8d16-293b81e785d3 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] [instance: 7a48466f-9d33-480f-b67a-21777e03d4d5] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:12:52.494397 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d326c5e7-e0b7-4f94-8d16-293b81e785d3 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:52.495062 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d326c5e7-e0b7-4f94-8d16-293b81e785d3 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:52.495551 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d326c5e7-e0b7-4f94-8d16-293b81e785d3 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:52.497347 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d326c5e7-e0b7-4f94-8d16-293b81e785d3 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:52.498410 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d326c5e7-e0b7-4f94-8d16-293b81e785d3 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:52.499136 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d326c5e7-e0b7-4f94-8d16-293b81e785d3 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:52.698687 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d326c5e7-e0b7-4f94-8d16-293b81e785d3 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '769928c8ecb643fa83a9d58465dcb263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ead65f008349329789135966c031d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:12:52.708873 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d326c5e7-e0b7-4f94-8d16-293b81e785d3 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] 10.222.0.52 "GET /compute/v2.1/servers/7a48466f-9d33-480f-b67a-21777e03d4d5" status: 200 len: 1341 microversion: 2.1 time: 0.232612 Oct 19 03:12:52.721399 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 87/176] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:12:52 2022] GET /compute/v2.1/servers/7a48466f-9d33-480f-b67a-21777e03d4d5 => generated 1341 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:12:52.775738 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-42ea3440-b47d-42bc-8c75-55713c672d90 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:52.776359 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-42ea3440-b47d-42bc-8c75-55713c672d90 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 7b4a8cd9-a238-4bff-a002-497dc807bf3a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:12:52.783012 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-42ea3440-b47d-42bc-8c75-55713c672d90 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:52.785331 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-42ea3440-b47d-42bc-8c75-55713c672d90 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:52.785331 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-42ea3440-b47d-42bc-8c75-55713c672d90 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:52.785331 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-42ea3440-b47d-42bc-8c75-55713c672d90 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:52.785661 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-42ea3440-b47d-42bc-8c75-55713c672d90 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:52.786235 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-42ea3440-b47d-42bc-8c75-55713c672d90 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:52.874722 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-42ea3440-b47d-42bc-8c75-55713c672d90 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:12:52.887479 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-42ea3440-b47d-42bc-8c75-55713c672d90 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a" status: 200 len: 1271 microversion: 2.1 time: 0.112812 Oct 19 03:12:52.893885 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 90/177] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:12:52 2022] GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a => generated 1271 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:12:52.898380 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-1c5ee4df-be75-4b79-b57d-0c6f5d2fa226 req-413e8e71-1a6d-48d7-a50c-5e6ea7e1d032 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44cee120-503c-401f-b046-a638d08df855", "name": "network-vif-plugged", "status": "completed", "tag": "552220b1-e24d-43aa-babe-fd8198281bae"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:12:52.927494 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-1c5ee4df-be75-4b79-b57d-0c6f5d2fa226 req-413e8e71-1a6d-48d7-a50c-5e6ea7e1d032 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:52.930688 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-1c5ee4df-be75-4b79-b57d-0c6f5d2fa226 req-413e8e71-1a6d-48d7-a50c-5e6ea7e1d032 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:52.931171 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-1c5ee4df-be75-4b79-b57d-0c6f5d2fa226 req-413e8e71-1a6d-48d7-a50c-5e6ea7e1d032 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:52.953802 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-1c5ee4df-be75-4b79-b57d-0c6f5d2fa226 req-413e8e71-1a6d-48d7-a50c-5e6ea7e1d032 service nova] Creating event network-vif-plugged:552220b1-e24d-43aa-babe-fd8198281bae for instance 44cee120-503c-401f-b046-a638d08df855 on n-h2-861333-8 Oct 19 03:12:52.960515 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-1c5ee4df-be75-4b79-b57d-0c6f5d2fa226 req-413e8e71-1a6d-48d7-a50c-5e6ea7e1d032 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073005 Oct 19 03:12:52.961505 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 88/178] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:12:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:12:53.450913 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-283d0e8a-155f-47ef-87b1-f7e0696d5cb2 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:53.454621 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-283d0e8a-155f-47ef-87b1-f7e0696d5cb2 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] [instance: 44cee120-503c-401f-b046-a638d08df855] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:12:53.474662 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-283d0e8a-155f-47ef-87b1-f7e0696d5cb2 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:53.475171 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-283d0e8a-155f-47ef-87b1-f7e0696d5cb2 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:53.484317 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-283d0e8a-155f-47ef-87b1-f7e0696d5cb2 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:53.486197 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-283d0e8a-155f-47ef-87b1-f7e0696d5cb2 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:53.486910 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-283d0e8a-155f-47ef-87b1-f7e0696d5cb2 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:53.487555 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-283d0e8a-155f-47ef-87b1-f7e0696d5cb2 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:53.737444 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e707d556-0401-495a-9a89-b7dcec57679b tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:53.738963 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e707d556-0401-495a-9a89-b7dcec57679b tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] [instance: 7a48466f-9d33-480f-b67a-21777e03d4d5] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:12:53.759722 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e707d556-0401-495a-9a89-b7dcec57679b tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:53.770955 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e707d556-0401-495a-9a89-b7dcec57679b tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:53.773250 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e707d556-0401-495a-9a89-b7dcec57679b tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:53.775209 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e707d556-0401-495a-9a89-b7dcec57679b tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:53.779703 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e707d556-0401-495a-9a89-b7dcec57679b tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:53.784797 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e707d556-0401-495a-9a89-b7dcec57679b tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:53.854673 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-283d0e8a-155f-47ef-87b1-f7e0696d5cb2 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f665963909a64c148298b7a6c8e3307a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3054afe77df43afa6406ec25b57de65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:12:53.865294 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-283d0e8a-155f-47ef-87b1-f7e0696d5cb2 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] 10.222.0.52 "GET /compute/v2.1/servers/44cee120-503c-401f-b046-a638d08df855" status: 200 len: 1338 microversion: 2.1 time: 0.418544 Oct 19 03:12:53.868020 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 91/179] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:12:53 2022] GET /compute/v2.1/servers/44cee120-503c-401f-b046-a638d08df855 => generated 1338 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:12:53.909344 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-925413a3-518c-4038-a50b-2d6c4c8a7216 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:53.910294 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-925413a3-518c-4038-a50b-2d6c4c8a7216 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 7b4a8cd9-a238-4bff-a002-497dc807bf3a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:12:53.917637 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-925413a3-518c-4038-a50b-2d6c4c8a7216 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:53.928095 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-925413a3-518c-4038-a50b-2d6c4c8a7216 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:53.928908 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-925413a3-518c-4038-a50b-2d6c4c8a7216 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:53.930119 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-925413a3-518c-4038-a50b-2d6c4c8a7216 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:53.930747 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-925413a3-518c-4038-a50b-2d6c4c8a7216 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:53.931359 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-925413a3-518c-4038-a50b-2d6c4c8a7216 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:54.362732 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-e707d556-0401-495a-9a89-b7dcec57679b tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '769928c8ecb643fa83a9d58465dcb263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ead65f008349329789135966c031d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:12:54.395069 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-925413a3-518c-4038-a50b-2d6c4c8a7216 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:12:54.403297 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e707d556-0401-495a-9a89-b7dcec57679b tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] 10.222.0.52 "GET /compute/v2.1/servers/7a48466f-9d33-480f-b67a-21777e03d4d5" status: 200 len: 1341 microversion: 2.1 time: 0.667558 Oct 19 03:12:54.406743 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 89/180] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:12:53 2022] GET /compute/v2.1/servers/7a48466f-9d33-480f-b67a-21777e03d4d5 => generated 1341 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:12:54.415651 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-925413a3-518c-4038-a50b-2d6c4c8a7216 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a" status: 200 len: 1313 microversion: 2.1 time: 0.510658 Oct 19 03:12:54.417036 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 92/181] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:12:53 2022] GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a => generated 1313 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:12:54.890882 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6b6aa3dd-f144-4801-adbe-9df8cd22ee9a tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:54.891663 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6b6aa3dd-f144-4801-adbe-9df8cd22ee9a tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] [instance: 44cee120-503c-401f-b046-a638d08df855] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:12:54.898258 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6b6aa3dd-f144-4801-adbe-9df8cd22ee9a tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:54.908279 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6b6aa3dd-f144-4801-adbe-9df8cd22ee9a tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:54.908818 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6b6aa3dd-f144-4801-adbe-9df8cd22ee9a tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:54.909644 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6b6aa3dd-f144-4801-adbe-9df8cd22ee9a tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:54.910306 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6b6aa3dd-f144-4801-adbe-9df8cd22ee9a tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:54.911100 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6b6aa3dd-f144-4801-adbe-9df8cd22ee9a tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:54.980425 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2e188840-c0ce-4f52-b486-ad220204ba09 tempest-HostsAdminTestJSON-185870490 tempest-HostsAdminTestJSON-185870490-project-admin] Calling method '.version_select at 0x7fc13191b8b0>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:54.985267 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2e188840-c0ce-4f52-b486-ad220204ba09 tempest-HostsAdminTestJSON-185870490 tempest-HostsAdminTestJSON-185870490-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:54.989775 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2e188840-c0ce-4f52-b486-ad220204ba09 tempest-HostsAdminTestJSON-185870490 tempest-HostsAdminTestJSON-185870490-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:54.989775 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2e188840-c0ce-4f52-b486-ad220204ba09 tempest-HostsAdminTestJSON-185870490 tempest-HostsAdminTestJSON-185870490-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:54.989775 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2e188840-c0ce-4f52-b486-ad220204ba09 tempest-HostsAdminTestJSON-185870490 tempest-HostsAdminTestJSON-185870490-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:54.989775 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2e188840-c0ce-4f52-b486-ad220204ba09 tempest-HostsAdminTestJSON-185870490 tempest-HostsAdminTestJSON-185870490-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:54.990130 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2e188840-c0ce-4f52-b486-ad220204ba09 tempest-HostsAdminTestJSON-185870490 tempest-HostsAdminTestJSON-185870490-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:55.021769 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2e188840-c0ce-4f52-b486-ad220204ba09 tempest-HostsAdminTestJSON-185870490 tempest-HostsAdminTestJSON-185870490-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hosts" status: 200 len: 397 microversion: 2.1 time: 0.610571 Oct 19 03:12:55.033155 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 90/182] 10.222.0.52 () {58 vars in 1128 bytes} [Wed Oct 19 03:12:54 2022] GET /compute/v2.1/os-hosts => generated 397 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:12:55.038357 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ad85945f-d8eb-4151-9712-528012b0556e tempest-HostsAdminTestJSON-185870490 tempest-HostsAdminTestJSON-185870490-project-admin] Calling method '.version_select at 0x7fc1319ad820>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:55.042236 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ad85945f-d8eb-4151-9712-528012b0556e tempest-HostsAdminTestJSON-185870490 tempest-HostsAdminTestJSON-185870490-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:55.042954 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ad85945f-d8eb-4151-9712-528012b0556e tempest-HostsAdminTestJSON-185870490 tempest-HostsAdminTestJSON-185870490-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:55.043556 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ad85945f-d8eb-4151-9712-528012b0556e tempest-HostsAdminTestJSON-185870490 tempest-HostsAdminTestJSON-185870490-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:55.044483 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ad85945f-d8eb-4151-9712-528012b0556e tempest-HostsAdminTestJSON-185870490 tempest-HostsAdminTestJSON-185870490-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:55.045120 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ad85945f-d8eb-4151-9712-528012b0556e tempest-HostsAdminTestJSON-185870490 tempest-HostsAdminTestJSON-185870490-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:55.045983 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ad85945f-d8eb-4151-9712-528012b0556e tempest-HostsAdminTestJSON-185870490 tempest-HostsAdminTestJSON-185870490-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:55.084431 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ad85945f-d8eb-4151-9712-528012b0556e tempest-HostsAdminTestJSON-185870490 tempest-HostsAdminTestJSON-185870490-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 397 microversion: 2.1 time: 0.049933 Oct 19 03:12:55.092183 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 91/183] 10.222.0.52 () {58 vars in 1139 bytes} [Wed Oct 19 03:12:55 2022] GET /compute/v2.1/os-hosts?zone= => generated 397 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:12:55.099059 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-42f73e8d-7b67-49d0-87c2-7a8a9d28e924 tempest-HostsAdminTestJSON-185870490 tempest-HostsAdminTestJSON-185870490-project-admin] Calling method '.version_select at 0x7fc1319919d0>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:55.108655 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-42f73e8d-7b67-49d0-87c2-7a8a9d28e924 tempest-HostsAdminTestJSON-185870490 tempest-HostsAdminTestJSON-185870490-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:55.118211 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-42f73e8d-7b67-49d0-87c2-7a8a9d28e924 tempest-HostsAdminTestJSON-185870490 tempest-HostsAdminTestJSON-185870490-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:55.118964 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-42f73e8d-7b67-49d0-87c2-7a8a9d28e924 tempest-HostsAdminTestJSON-185870490 tempest-HostsAdminTestJSON-185870490-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:55.121476 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-42f73e8d-7b67-49d0-87c2-7a8a9d28e924 tempest-HostsAdminTestJSON-185870490 tempest-HostsAdminTestJSON-185870490-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:55.123058 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-42f73e8d-7b67-49d0-87c2-7a8a9d28e924 tempest-HostsAdminTestJSON-185870490 tempest-HostsAdminTestJSON-185870490-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:55.127051 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-42f73e8d-7b67-49d0-87c2-7a8a9d28e924 tempest-HostsAdminTestJSON-185870490 tempest-HostsAdminTestJSON-185870490-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:55.190753 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-42f73e8d-7b67-49d0-87c2-7a8a9d28e924 tempest-HostsAdminTestJSON-185870490 tempest-HostsAdminTestJSON-185870490-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.093443 Oct 19 03:12:55.195705 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 92/184] 10.222.0.52 () {58 vars in 1145 bytes} [Wed Oct 19 03:12:55 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 03:12:55.417801 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-6b6aa3dd-f144-4801-adbe-9df8cd22ee9a tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f665963909a64c148298b7a6c8e3307a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3054afe77df43afa6406ec25b57de65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:12:55.428248 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6b6aa3dd-f144-4801-adbe-9df8cd22ee9a tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] 10.222.0.52 "GET /compute/v2.1/servers/44cee120-503c-401f-b046-a638d08df855" status: 200 len: 1488 microversion: 2.1 time: 0.541098 Oct 19 03:12:55.428837 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 93/185] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:12:54 2022] GET /compute/v2.1/servers/44cee120-503c-401f-b046-a638d08df855 => generated 1488 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:12:55.433918 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-fe6c2afe-e3d9-465c-8637-8fe87619ef5e tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:55.434782 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-fe6c2afe-e3d9-465c-8637-8fe87619ef5e tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] [instance: 7a48466f-9d33-480f-b67a-21777e03d4d5] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:12:55.441699 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fe6c2afe-e3d9-465c-8637-8fe87619ef5e tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:55.442507 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fe6c2afe-e3d9-465c-8637-8fe87619ef5e tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:55.443181 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fe6c2afe-e3d9-465c-8637-8fe87619ef5e tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:55.444137 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fe6c2afe-e3d9-465c-8637-8fe87619ef5e tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:55.444820 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fe6c2afe-e3d9-465c-8637-8fe87619ef5e tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:55.445505 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fe6c2afe-e3d9-465c-8637-8fe87619ef5e tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:55.622885 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-fe6c2afe-e3d9-465c-8637-8fe87619ef5e tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '769928c8ecb643fa83a9d58465dcb263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ead65f008349329789135966c031d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:12:55.634531 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-fe6c2afe-e3d9-465c-8637-8fe87619ef5e tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] 10.222.0.52 "GET /compute/v2.1/servers/7a48466f-9d33-480f-b67a-21777e03d4d5" status: 200 len: 1491 microversion: 2.1 time: 0.204635 Oct 19 03:12:55.636714 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 94/186] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:12:55 2022] GET /compute/v2.1/servers/7a48466f-9d33-480f-b67a-21777e03d4d5 => generated 1491 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:12:55.650548 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-22287dbe-ce3e-4924-ba25-6af09d2e01f7 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:55.651753 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-22287dbe-ce3e-4924-ba25-6af09d2e01f7 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 7b4a8cd9-a238-4bff-a002-497dc807bf3a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:12:55.658382 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9fbd5b2d-3dfb-4d50-81e9-0ac3439e6e8b tempest-FlavorsAccessNegativeTestJSON-1275566317 tempest-FlavorsAccessNegativeTestJSON-1275566317-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-918593221", "id": 796856494, "os-flavor-access:is_public": "False"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:12:55.661227 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-22287dbe-ce3e-4924-ba25-6af09d2e01f7 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:55.661227 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-22287dbe-ce3e-4924-ba25-6af09d2e01f7 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:55.661227 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-22287dbe-ce3e-4924-ba25-6af09d2e01f7 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:55.661227 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-22287dbe-ce3e-4924-ba25-6af09d2e01f7 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:55.661580 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-22287dbe-ce3e-4924-ba25-6af09d2e01f7 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:55.661683 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-22287dbe-ce3e-4924-ba25-6af09d2e01f7 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:55.807078 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-22287dbe-ce3e-4924-ba25-6af09d2e01f7 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:12:55.816402 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9fbd5b2d-3dfb-4d50-81e9-0ac3439e6e8b tempest-FlavorsAccessNegativeTestJSON-1275566317 tempest-FlavorsAccessNegativeTestJSON-1275566317-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.403139 Oct 19 03:12:55.826227 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 93/187] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:12:55 2022] POST /compute/v2.1/flavors => generated 435 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:12:55.834662 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a3a1a097-5a23-407b-927e-2f927eb3bd97 tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:55.838068 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-22287dbe-ce3e-4924-ba25-6af09d2e01f7 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a" status: 200 len: 1313 microversion: 2.1 time: 0.200015 Oct 19 03:12:55.838853 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 95/188] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:12:55 2022] GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a => generated 1313 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:12:55.845404 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ec506e31-e462-42bb-81de-d4c12107b2c1 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1519479451", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "214789776", "adminPass": "***", "networks": [{"uuid": "174199d3-3016-422c-a5ab-ef1cadcbcb20"}], "security_groups": [{"name": "tempest-securitygroup--855962973"}], "key_name": "tempest-keypair-1415990507", "user_data": "}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:12:55.846309 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a3a1a097-5a23-407b-927e-2f927eb3bd97 tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] [instance: 44cee120-503c-401f-b046-a638d08df855] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:12:55.853244 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a3a1a097-5a23-407b-927e-2f927eb3bd97 tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:55.854022 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a3a1a097-5a23-407b-927e-2f927eb3bd97 tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:55.854738 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a3a1a097-5a23-407b-927e-2f927eb3bd97 tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:55.855796 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a3a1a097-5a23-407b-927e-2f927eb3bd97 tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:55.856737 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a3a1a097-5a23-407b-927e-2f927eb3bd97 tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:55.857586 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a3a1a097-5a23-407b-927e-2f927eb3bd97 tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:56.064025 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-ec506e31-e462-42bb-81de-d4c12107b2c1 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] validate_networks() for [('174199d3-3016-422c-a5ab-ef1cadcbcb20', None, None, None, None, None)] {{(pid=121134) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:12:56.792474 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a3a1a097-5a23-407b-927e-2f927eb3bd97 tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/44cee120-503c-401f-b046-a638d08df855" status: 200 len: 1639 microversion: 2.1 time: 0.964696 Oct 19 03:12:56.800243 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 94/189] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:12:55 2022] GET /compute/v2.1/servers/44cee120-503c-401f-b046-a638d08df855 => generated 1639 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:12:56.984975 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a0a234fe-c516-4554-829e-14fbb3221d44 tempest-DeleteServersAdminTestJSON-470644809 tempest-DeleteServersAdminTestJSON-470644809-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:56.986010 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a0a234fe-c516-4554-829e-14fbb3221d44 tempest-DeleteServersAdminTestJSON-470644809 tempest-DeleteServersAdminTestJSON-470644809-project-admin] [instance: 7a48466f-9d33-480f-b67a-21777e03d4d5] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:12:56.994731 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a0a234fe-c516-4554-829e-14fbb3221d44 tempest-DeleteServersAdminTestJSON-470644809 tempest-DeleteServersAdminTestJSON-470644809-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:56.995458 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a0a234fe-c516-4554-829e-14fbb3221d44 tempest-DeleteServersAdminTestJSON-470644809 tempest-DeleteServersAdminTestJSON-470644809-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:56.996080 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a0a234fe-c516-4554-829e-14fbb3221d44 tempest-DeleteServersAdminTestJSON-470644809 tempest-DeleteServersAdminTestJSON-470644809-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:56.997294 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a0a234fe-c516-4554-829e-14fbb3221d44 tempest-DeleteServersAdminTestJSON-470644809 tempest-DeleteServersAdminTestJSON-470644809-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:56.998348 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a0a234fe-c516-4554-829e-14fbb3221d44 tempest-DeleteServersAdminTestJSON-470644809 tempest-DeleteServersAdminTestJSON-470644809-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:56.999154 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a0a234fe-c516-4554-829e-14fbb3221d44 tempest-DeleteServersAdminTestJSON-470644809 tempest-DeleteServersAdminTestJSON-470644809-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:57.034467 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a0a234fe-c516-4554-829e-14fbb3221d44 tempest-DeleteServersAdminTestJSON-470644809 tempest-DeleteServersAdminTestJSON-470644809-project-admin] [instance: 7a48466f-9d33-480f-b67a-21777e03d4d5] Going to try to terminate instance {{(pid=121135) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:12:57.325654 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-ec506e31-e462-42bb-81de-d4c12107b2c1 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Flavor limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:12:57.326897 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-ec506e31-e462-42bb-81de-d4c12107b2c1 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Image limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:12:57.327622 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-ec506e31-e462-42bb-81de-d4c12107b2c1 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Flavor pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:12:57.328266 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-ec506e31-e462-42bb-81de-d4c12107b2c1 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Image pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:12:57.328905 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-ec506e31-e462-42bb-81de-d4c12107b2c1 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:12:57.338972 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ec506e31-e462-42bb-81de-d4c12107b2c1 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:57.343719 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ec506e31-e462-42bb-81de-d4c12107b2c1 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:57.343719 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ec506e31-e462-42bb-81de-d4c12107b2c1 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:57.343719 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ec506e31-e462-42bb-81de-d4c12107b2c1 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:57.343951 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ec506e31-e462-42bb-81de-d4c12107b2c1 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:57.343951 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ec506e31-e462-42bb-81de-d4c12107b2c1 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:57.361255 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-ec506e31-e462-42bb-81de-d4c12107b2c1 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Getting quotas for project df99b134b20743eb9b62788706f2705a. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:12:57.366015 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-ec506e31-e462-42bb-81de-d4c12107b2c1 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Getting quotas for user 2cc37ae4bed94a7e85ed70dd5942c2bd and project df99b134b20743eb9b62788706f2705a. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:12:57.378689 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ec506e31-e462-42bb-81de-d4c12107b2c1 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Going to run 1 instances... {{(pid=121134) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:12:57.381487 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ec506e31-e462-42bb-81de-d4c12107b2c1 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] [instance: f476cc02-1b56-4c61-93a4-c3d36c38792d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:12:57.490954 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a0a234fe-c516-4554-829e-14fbb3221d44 tempest-DeleteServersAdminTestJSON-470644809 tempest-DeleteServersAdminTestJSON-470644809-project-admin] 10.222.0.52 "DELETE /compute/v2.1/servers/7a48466f-9d33-480f-b67a-21777e03d4d5" status: 204 len: 0 microversion: 2.1 time: 0.688324 Oct 19 03:12:57.491817 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 95/190] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:12:56 2022] DELETE /compute/v2.1/servers/7a48466f-9d33-480f-b67a-21777e03d4d5 => generated 0 bytes in 691 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:12:57.497275 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6c6f7b7b-2714-4e3f-b718-971b5827ddee tempest-FlavorsAccessNegativeTestJSON-1275566317 tempest-FlavorsAccessNegativeTestJSON-1275566317-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "5472e77b54a84788ba19b736e676b990"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:12:57.521230 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ec506e31-e462-42bb-81de-d4c12107b2c1 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.681053 Oct 19 03:12:57.522245 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 96/191] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:12:55 2022] POST /compute/v2.1/servers => generated 401 bytes in 1682 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 03:12:57.532576 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d0ee203e-c383-4461-b4b3-a00f758aaaa1 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:57.533077 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d0ee203e-c383-4461-b4b3-a00f758aaaa1 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] [instance: 44cee120-503c-401f-b046-a638d08df855] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:12:57.542217 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d0ee203e-c383-4461-b4b3-a00f758aaaa1 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:57.543069 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d0ee203e-c383-4461-b4b3-a00f758aaaa1 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:57.544180 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d0ee203e-c383-4461-b4b3-a00f758aaaa1 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:57.545495 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d0ee203e-c383-4461-b4b3-a00f758aaaa1 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:57.546355 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d0ee203e-c383-4461-b4b3-a00f758aaaa1 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:57.546956 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d0ee203e-c383-4461-b4b3-a00f758aaaa1 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:57.603231 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d0ee203e-c383-4461-b4b3-a00f758aaaa1 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] [instance: 44cee120-503c-401f-b046-a638d08df855] Going to try to terminate instance {{(pid=121134) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:12:57.658223 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6c6f7b7b-2714-4e3f-b718-971b5827ddee tempest-FlavorsAccessNegativeTestJSON-1275566317 tempest-FlavorsAccessNegativeTestJSON-1275566317-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors/796856494/action" status: 200 len: 96 microversion: 2.1 time: 0.164934 Oct 19 03:12:57.659045 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 96/192] 10.222.0.52 () {60 vars in 1197 bytes} [Wed Oct 19 03:12:57 2022] POST /compute/v2.1/flavors/796856494/action => generated 96 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 03:12:57.664019 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7c1b5827-f315-4054-bf57-2fa43d97ea8b tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:57.666248 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7c1b5827-f315-4054-bf57-2fa43d97ea8b tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 7b4a8cd9-a238-4bff-a002-497dc807bf3a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:12:57.673871 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7c1b5827-f315-4054-bf57-2fa43d97ea8b tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:57.675237 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7c1b5827-f315-4054-bf57-2fa43d97ea8b tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:57.676581 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7c1b5827-f315-4054-bf57-2fa43d97ea8b tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:57.677582 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7c1b5827-f315-4054-bf57-2fa43d97ea8b tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:57.678260 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7c1b5827-f315-4054-bf57-2fa43d97ea8b tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:57.678897 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7c1b5827-f315-4054-bf57-2fa43d97ea8b tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:57.908213 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d0ee203e-c383-4461-b4b3-a00f758aaaa1 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] 10.222.0.52 "DELETE /compute/v2.1/servers/44cee120-503c-401f-b046-a638d08df855" status: 204 len: 0 microversion: 2.1 time: 0.384281 Oct 19 03:12:57.909093 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 97/193] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:12:57 2022] DELETE /compute/v2.1/servers/44cee120-503c-401f-b046-a638d08df855 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:12:57.917432 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1a1f9168-41e5-47d3-9402-59e3368ab420 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:57.922998 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1a1f9168-41e5-47d3-9402-59e3368ab420 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] [instance: 7a48466f-9d33-480f-b67a-21777e03d4d5] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:12:57.934233 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1a1f9168-41e5-47d3-9402-59e3368ab420 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:57.934894 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1a1f9168-41e5-47d3-9402-59e3368ab420 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:57.935334 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1a1f9168-41e5-47d3-9402-59e3368ab420 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:57.936040 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1a1f9168-41e5-47d3-9402-59e3368ab420 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:57.936494 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1a1f9168-41e5-47d3-9402-59e3368ab420 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:57.936971 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1a1f9168-41e5-47d3-9402-59e3368ab420 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:57.971306 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:DELETE=2,nova_api:SELECT=92,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:12:58.256620 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7c1b5827-f315-4054-bf57-2fa43d97ea8b tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:12:58.258856 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-1a1f9168-41e5-47d3-9402-59e3368ab420 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '769928c8ecb643fa83a9d58465dcb263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ead65f008349329789135966c031d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:12:58.268570 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1a1f9168-41e5-47d3-9402-59e3368ab420 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] 10.222.0.52 "GET /compute/v2.1/servers/7a48466f-9d33-480f-b67a-21777e03d4d5" status: 200 len: 1497 microversion: 2.1 time: 0.357717 Oct 19 03:12:58.269595 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 98/194] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:12:57 2022] GET /compute/v2.1/servers/7a48466f-9d33-480f-b67a-21777e03d4d5 => generated 1497 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:12:58.274864 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0c6b6084-ce3f-4b3e-9b97-b985d3b51ae1 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:58.275485 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0c6b6084-ce3f-4b3e-9b97-b985d3b51ae1 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] [instance: f476cc02-1b56-4c61-93a4-c3d36c38792d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:12:58.283611 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:12:58.293313 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7c1b5827-f315-4054-bf57-2fa43d97ea8b tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a" status: 200 len: 1313 microversion: 2.1 time: 0.631839 Oct 19 03:12:58.294457 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 97/195] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:12:57 2022] GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a => generated 1313 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:12:58.300477 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3e774bab-ee7b-4922-9465-38163fb303ea tempest-FlavorsAccessNegativeTestJSON-1275566317 tempest-FlavorsAccessNegativeTestJSON-1275566317-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "5472e77b54a84788ba19b736e676b990"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:12:58.368580 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0c6b6084-ce3f-4b3e-9b97-b985d3b51ae1 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cc37ae4bed94a7e85ed70dd5942c2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df99b134b20743eb9b62788706f2705a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:12:58.378385 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0c6b6084-ce3f-4b3e-9b97-b985d3b51ae1 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] 10.222.0.52 "GET /compute/v2.1/servers/f476cc02-1b56-4c61-93a4-c3d36c38792d" status: 200 len: 1263 microversion: 2.1 time: 0.107311 Oct 19 03:12:58.378891 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 99/196] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:12:58 2022] GET /compute/v2.1/servers/f476cc02-1b56-4c61-93a4-c3d36c38792d => generated 1263 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:12:58.383647 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b7d8b8ec-910d-4c69-b551-c08e45619270 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:58.384548 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b7d8b8ec-910d-4c69-b551-c08e45619270 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] [instance: 44cee120-503c-401f-b046-a638d08df855] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:12:58.391592 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b7d8b8ec-910d-4c69-b551-c08e45619270 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:58.392120 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b7d8b8ec-910d-4c69-b551-c08e45619270 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:58.392981 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b7d8b8ec-910d-4c69-b551-c08e45619270 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:58.393861 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b7d8b8ec-910d-4c69-b551-c08e45619270 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:58.394818 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b7d8b8ec-910d-4c69-b551-c08e45619270 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:58.395384 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b7d8b8ec-910d-4c69-b551-c08e45619270 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:58.421875 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-3e774bab-ee7b-4922-9465-38163fb303ea tempest-FlavorsAccessNegativeTestJSON-1275566317 tempest-FlavorsAccessNegativeTestJSON-1275566317-project-admin] HTTP exception thrown: Flavor access already exists for flavor 31 and project 5472e77b54a84788ba19b736e676b990 combination. Oct 19 03:12:58.439880 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3e774bab-ee7b-4922-9465-38163fb303ea tempest-FlavorsAccessNegativeTestJSON-1275566317 tempest-FlavorsAccessNegativeTestJSON-1275566317-project-admin] Request method failure captured: Oct 19 03:12:58.439880 n-d-861333-8 devstack@n-api.service[121135]: request: POST /compute/v2.1/flavors/796856494/action HTTP/1.1 Oct 19 03:12:58.439880 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:12:58.439880 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:12:58.439880 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:12:58.439880 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 67 Oct 19 03:12:58.439880 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:12:58.439880 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:12:58.439880 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:12:58.439880 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:12:58.439880 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2s2eUcTMDeP3G8ZuiKlQs-5iFnLkjNQBP93QBgwtdYrIXHHSeBs7eZofcN3ktJphqYy8u8hCIeCwjhnxQ83P1llmXq9yKaYKSFeGCR0On6-QE2zeoLrJGJe75gP_T-nZ7lJfixV6kHKwuwrpwB70C4DN90RRuUh2vVO2IUpLU9WG5o Oct 19 03:12:58.439880 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:12:58.439880 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:12:58.439880 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:12:58.439880 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:12:58.439880 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:12:58.439880 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:12:58.439880 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: f381711730204762a3c97eead3a13fb8 Oct 19 03:12:58.439880 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1275566317 Oct 19 03:12:58.439880 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member,admin Oct 19 03:12:58.439880 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member,admin Oct 19 03:12:58.441555 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f381711730204762a3c97eead3a13fb8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f381711730204762a3c97eead3a13fb8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f381711730204762a3c97eead3a13fb8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f381711730204762a3c97eead3a13fb8", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:12:58.441555 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1275566317 Oct 19 03:12:58.441555 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: f381711730204762a3c97eead3a13fb8 Oct 19 03:12:58.441555 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1275566317 Oct 19 03:12:58.441555 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-FlavorsAccessNegativeTestJSON-1275566317-project-admin Oct 19 03:12:58.441555 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:12:58.441555 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:12:58.441555 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 7a4e8c98de3c448480b3586ce046b15b Oct 19 03:12:58.441555 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1275566317-project-admin Oct 19 03:12:58.441555 n-d-861333-8 devstack@n-api.service[121135]: Oct 19 03:12:58.441555 n-d-861333-8 devstack@n-api.service[121135]: {"addTenantAccess": {"tenant": "5472e77b54a84788ba19b736e676b990"}} Oct 19 03:12:58.441555 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:12:58.442317 n-d-861333-8 devstack@n-api.service[121135]: exception: Flavor access already exists for flavor 31 and project 5472e77b54a84788ba19b736e676b990 combination. Oct 19 03:12:58.442317 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '796856494', 'body': {'addTenantAccess': {'tenant': '5472e77b54a84788ba19b736e676b990'}}} Oct 19 03:12:58.442317 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:12:58.442317 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:12:58.442317 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 19 03:12:58.442317 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 19 03:12:58.442317 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 19 03:12:58.442317 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 19 03:12:58.442317 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 19 03:12:58.442317 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 19 03:12:58.442317 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 19 03:12:58.442317 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 19 03:12:58.442317 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 19 03:12:58.442317 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 19 03:12:58.442317 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 19 03:12:58.442317 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi result.read() Oct 19 03:12:58.442317 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 19 03:12:58.442317 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 19 03:12:58.443287 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 19 03:12:58.443287 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 19 03:12:58.443287 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 19 03:12:58.443287 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 19 03:12:58.443287 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 19 03:12:58.443287 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 19 03:12:58.443287 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '31-5472e77b54a84788ba19b736e676b990' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 19 03:12:58.443287 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:12:58.443287 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 19 03:12:58.443287 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:12:58.443287 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:12:58.443287 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Oct 19 03:12:58.443287 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi project.save(context.session) Oct 19 03:12:58.443287 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 19 03:12:58.443287 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi session.flush() Oct 19 03:12:58.443287 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 19 03:12:58.443287 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 19 03:12:58.443287 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 19 03:12:58.443287 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 19 03:12:58.444259 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 19 03:12:58.444259 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 19 03:12:58.444259 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 19 03:12:58.444259 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception Oct 19 03:12:58.444259 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 19 03:12:58.444259 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 19 03:12:58.444259 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 19 03:12:58.444259 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 19 03:12:58.444259 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 19 03:12:58.444259 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 19 03:12:58.444259 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 19 03:12:58.444259 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 19 03:12:58.444259 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 19 03:12:58.444259 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 19 03:12:58.444259 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 19 03:12:58.444259 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 19 03:12:58.444259 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 19 03:12:58.444259 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 19 03:12:58.445216 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 19 03:12:58.445216 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 19 03:12:58.445216 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 19 03:12:58.445216 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 19 03:12:58.445216 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 19 03:12:58.445216 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 19 03:12:58.445216 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 19 03:12:58.445216 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception Oct 19 03:12:58.445216 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 19 03:12:58.445216 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 19 03:12:58.445216 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 19 03:12:58.445216 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 19 03:12:58.445216 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 19 03:12:58.445216 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 19 03:12:58.445216 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 19 03:12:58.445216 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 19 03:12:58.445216 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 19 03:12:58.445216 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 19 03:12:58.449839 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 19 03:12:58.449839 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi result.read() Oct 19 03:12:58.449839 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 19 03:12:58.449839 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 19 03:12:58.449839 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 19 03:12:58.449839 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 19 03:12:58.449839 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 19 03:12:58.449839 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 19 03:12:58.449839 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 19 03:12:58.449839 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 19 03:12:58.449839 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '31-5472e77b54a84788ba19b736e676b990' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 19 03:12:58.449839 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Oct 19 03:12:58.449839 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 19, 3, 12, 58, 377715), 'updated_at': None, 'flavor_id': 31, 'project_id': '5472e77b54a84788ba19b736e676b990'}] Oct 19 03:12:58.449839 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 19 03:12:58.449839 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:12:58.449839 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:12:58.449839 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:12:58.450930 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:12:58.450930 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Oct 19 03:12:58.450930 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Oct 19 03:12:58.450930 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 19 03:12:58.450930 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 19 03:12:58.450930 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Oct 19 03:12:58.450930 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Oct 19 03:12:58.450930 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Oct 19 03:12:58.450930 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Oct 19 03:12:58.450930 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Oct 19 03:12:58.450930 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Oct 19 03:12:58.450930 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 19 03:12:58.450930 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 19 03:12:58.450930 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Oct 19 03:12:58.450930 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Oct 19 03:12:58.450930 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 31 and project 5472e77b54a84788ba19b736e676b990 combination. Oct 19 03:12:58.450930 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:12:58.450930 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:12:58.450930 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:12:58.451959 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:12:58.451959 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:12:58.451959 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:12:58.451959 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:12:58.451959 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:12:58.451959 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:12:58.451959 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:12:58.451959 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:12:58.451959 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:12:58.451959 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Oct 19 03:12:58.451959 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Oct 19 03:12:58.451959 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 31 and project 5472e77b54a84788ba19b736e676b990 combination. Oct 19 03:12:58.451959 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:12:58.451959 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:12:58.451959 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:12:58.451959 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:12:58.451959 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:12:58.451959 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:12:58.451959 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:12:58.451959 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:12:58.454472 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 31 and project 5472e77b54a84788ba19b736e676b990 combination. Oct 19 03:12:58.454472 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:12:58.454472 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3e774bab-ee7b-4922-9465-38163fb303ea tempest-FlavorsAccessNegativeTestJSON-1275566317 tempest-FlavorsAccessNegativeTestJSON-1275566317-project-admin] Returning 409 to user: Flavor access already exists for flavor 31 and project 5472e77b54a84788ba19b736e676b990 combination. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:12:58.454472 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-3e774bab-ee7b-4922-9465-38163fb303ea tempest-FlavorsAccessNegativeTestJSON-1275566317 tempest-FlavorsAccessNegativeTestJSON-1275566317-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors/796856494/action" status: 409 len: 152 microversion: 2.1 time: 0.145890 Oct 19 03:12:58.454472 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 98/197] 10.222.0.52 () {60 vars in 1197 bytes} [Wed Oct 19 03:12:58 2022] POST /compute/v2.1/flavors/796856494/action => generated 152 bytes in 147 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 19 03:12:58.454472 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d97a5c6b-84d2-49ca-bd10-0186dc17d0f8 tempest-FlavorsAccessNegativeTestJSON-1275566317 tempest-FlavorsAccessNegativeTestJSON-1275566317-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "5472e77b54a84788ba19b736e676b990"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:12:58.597325 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b7d8b8ec-910d-4c69-b551-c08e45619270 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f665963909a64c148298b7a6c8e3307a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3054afe77df43afa6406ec25b57de65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:12:58.605094 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b7d8b8ec-910d-4c69-b551-c08e45619270 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] 10.222.0.52 "GET /compute/v2.1/servers/44cee120-503c-401f-b046-a638d08df855" status: 200 len: 1494 microversion: 2.1 time: 0.225261 Oct 19 03:12:58.605691 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 100/198] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:12:58 2022] GET /compute/v2.1/servers/44cee120-503c-401f-b046-a638d08df855 => generated 1494 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:12:58.661731 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d97a5c6b-84d2-49ca-bd10-0186dc17d0f8 tempest-FlavorsAccessNegativeTestJSON-1275566317 tempest-FlavorsAccessNegativeTestJSON-1275566317-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors/796856494/action" status: 200 len: 21 microversion: 2.1 time: 0.215053 Oct 19 03:12:58.663281 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 99/199] 10.222.0.52 () {60 vars in 1197 bytes} [Wed Oct 19 03:12:58 2022] POST /compute/v2.1/flavors/796856494/action => generated 21 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 03:12:58.673200 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2816fcc5-75d7-41f2-a4e6-c15714210d8e tempest-FlavorsAccessNegativeTestJSON-1275566317 tempest-FlavorsAccessNegativeTestJSON-1275566317-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:58.782610 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2816fcc5-75d7-41f2-a4e6-c15714210d8e tempest-FlavorsAccessNegativeTestJSON-1275566317 tempest-FlavorsAccessNegativeTestJSON-1275566317-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/796856494" status: 202 len: 0 microversion: 2.1 time: 0.113948 Oct 19 03:12:58.787764 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 101/200] 10.222.0.52 () {58 vars in 1158 bytes} [Wed Oct 19 03:12:58 2022] DELETE /compute/v2.1/flavors/796856494 => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:12:58.796792 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b99e32f4-da01-4346-ab9b-9b222e991bfd tempest-FlavorsAccessNegativeTestJSON-1275566317 tempest-FlavorsAccessNegativeTestJSON-1275566317-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:58.817469 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b99e32f4-da01-4346-ab9b-9b222e991bfd tempest-FlavorsAccessNegativeTestJSON-1275566317 tempest-FlavorsAccessNegativeTestJSON-1275566317-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.025244 Oct 19 03:12:58.818039 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 100/201] 10.222.0.52 () {58 vars in 1146 bytes} [Wed Oct 19 03:12:58 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:12:58.838324 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7c81b97a-feb4-47ec-bfae-b74b0dd7eb1e tempest-FlavorsAccessNegativeTestJSON-1275566317 tempest-FlavorsAccessNegativeTestJSON-1275566317-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1180360429", "id": 2132299869, "os-flavor-access:is_public": "True"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:12:58.948581 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7c81b97a-feb4-47ec-bfae-b74b0dd7eb1e tempest-FlavorsAccessNegativeTestJSON-1275566317 tempest-FlavorsAccessNegativeTestJSON-1275566317-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.114473 Oct 19 03:12:58.962306 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b96976a5-81eb-4d74-945c-64e1aefc45d5 tempest-FlavorsAccessNegativeTestJSON-1275566317 tempest-FlavorsAccessNegativeTestJSON-1275566317-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:58.966751 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 102/202] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:12:58 2022] POST /compute/v2.1/flavors => generated 438 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:12:58.970988 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-b96976a5-81eb-4d74-945c-64e1aefc45d5 tempest-FlavorsAccessNegativeTestJSON-1275566317 tempest-FlavorsAccessNegativeTestJSON-1275566317-project-admin] HTTP exception thrown: Access list not available for public flavors. Oct 19 03:12:58.972706 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b96976a5-81eb-4d74-945c-64e1aefc45d5 tempest-FlavorsAccessNegativeTestJSON-1275566317 tempest-FlavorsAccessNegativeTestJSON-1275566317-project-admin] Request method failure captured: Oct 19 03:12:58.972706 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/flavors/2132299869/os-flavor-access HTTP/1.1 Oct 19 03:12:58.972706 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:12:58.972706 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:12:58.972706 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:12:58.972706 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:12:58.972706 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:12:58.972706 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:12:58.972706 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:12:58.972706 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:12:58.972706 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2s2eUcTMDeP3G8ZuiKlQs-5iFnLkjNQBP93QBgwtdYrIXHHSeBs7eZofcN3ktJphqYy8u8hCIeCwjhnxQ83P1llmXq9yKaYKSFeGCR0On6-QE2zeoLrJGJe75gP_T-nZ7lJfixV6kHKwuwrpwB70C4DN90RRuUh2vVO2IUpLU9WG5o Oct 19 03:12:58.972706 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:12:58.972706 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:12:58.972706 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:12:58.972706 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:12:58.972706 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:12:58.972706 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:12:58.972706 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: f381711730204762a3c97eead3a13fb8 Oct 19 03:12:58.972706 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1275566317 Oct 19 03:12:58.972706 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member,admin Oct 19 03:12:58.972706 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member,admin Oct 19 03:12:58.974011 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f381711730204762a3c97eead3a13fb8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f381711730204762a3c97eead3a13fb8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f381711730204762a3c97eead3a13fb8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f381711730204762a3c97eead3a13fb8", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:12:58.974011 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1275566317 Oct 19 03:12:58.974011 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: f381711730204762a3c97eead3a13fb8 Oct 19 03:12:58.974011 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1275566317 Oct 19 03:12:58.974011 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-FlavorsAccessNegativeTestJSON-1275566317-project-admin Oct 19 03:12:58.974011 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:12:58.974011 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:12:58.974011 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 7a4e8c98de3c448480b3586ce046b15b Oct 19 03:12:58.974011 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1275566317-project-admin Oct 19 03:12:58.974011 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:12:58.974011 n-d-861333-8 devstack@n-api.service[121135]: exception: Access list not available for public flavors. Oct 19 03:12:58.974011 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'flavor_id': '2132299869'} Oct 19 03:12:58.974778 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:12:58.974778 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:12:58.974778 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:12:58.974778 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:12:58.974778 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:12:58.974778 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:12:58.974778 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:12:58.974778 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:12:58.974778 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Oct 19 03:12:58.974778 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 19 03:12:58.974778 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Oct 19 03:12:58.974778 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:12:58.974778 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:12:58.974778 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:12:58.974778 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:12:58.974778 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:12:58.974778 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:12:58.974778 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:12:58.974778 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:12:58.974778 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Oct 19 03:12:58.974778 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:12:58.976760 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b96976a5-81eb-4d74-945c-64e1aefc45d5 tempest-FlavorsAccessNegativeTestJSON-1275566317 tempest-FlavorsAccessNegativeTestJSON-1275566317-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:12:58.976760 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b96976a5-81eb-4d74-945c-64e1aefc45d5 tempest-FlavorsAccessNegativeTestJSON-1275566317 tempest-FlavorsAccessNegativeTestJSON-1275566317-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/2132299869/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.015671 Oct 19 03:12:58.976760 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 101/203] 10.222.0.52 () {58 vars in 1209 bytes} [Wed Oct 19 03:12:58 2022] GET /compute/v2.1/flavors/2132299869/os-flavor-access => generated 91 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 03:12:58.989443 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c66b4a48-30fc-4625-a5ae-f7db417e6090 tempest-FlavorsAccessNegativeTestJSON-1275566317 tempest-FlavorsAccessNegativeTestJSON-1275566317-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:59.084350 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c66b4a48-30fc-4625-a5ae-f7db417e6090 tempest-FlavorsAccessNegativeTestJSON-1275566317 tempest-FlavorsAccessNegativeTestJSON-1275566317-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/2132299869" status: 202 len: 0 microversion: 2.1 time: 0.098632 Oct 19 03:12:59.085044 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 103/204] 10.222.0.52 () {58 vars in 1161 bytes} [Wed Oct 19 03:12:58 2022] DELETE /compute/v2.1/flavors/2132299869 => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:12:59.094440 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d1be6b0a-f6b6-43db-8466-919d87ff4ade tempest-FlavorsAccessNegativeTestJSON-1275566317 tempest-FlavorsAccessNegativeTestJSON-1275566317-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:59.129287 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d1be6b0a-f6b6-43db-8466-919d87ff4ade tempest-FlavorsAccessNegativeTestJSON-1275566317 tempest-FlavorsAccessNegativeTestJSON-1275566317-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.039755 Oct 19 03:12:59.130211 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 102/205] 10.222.0.52 () {58 vars in 1146 bytes} [Wed Oct 19 03:12:59 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:12:59.154781 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-036e9c33-da94-4fd0-a907-2d3c288182da tempest-FlavorsAccessNegativeTestJSON-1275566317 tempest-FlavorsAccessNegativeTestJSON-1275566317-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-495203418", "id": 2099127087, "os-flavor-access:is_public": "False"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:12:59.265957 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-036e9c33-da94-4fd0-a907-2d3c288182da tempest-FlavorsAccessNegativeTestJSON-1275566317 tempest-FlavorsAccessNegativeTestJSON-1275566317-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.114831 Oct 19 03:12:59.267021 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 104/206] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:12:59 2022] POST /compute/v2.1/flavors => generated 438 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:12:59.282385 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=16 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:12:59.298546 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0e71b9c3-a45d-4310-ba11-a6cdcc7c951d tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:59.299438 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0e71b9c3-a45d-4310-ba11-a6cdcc7c951d tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] [instance: 7a48466f-9d33-480f-b67a-21777e03d4d5] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:12:59.306578 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0e71b9c3-a45d-4310-ba11-a6cdcc7c951d tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:59.307591 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0e71b9c3-a45d-4310-ba11-a6cdcc7c951d tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:59.308171 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0e71b9c3-a45d-4310-ba11-a6cdcc7c951d tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:59.309080 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0e71b9c3-a45d-4310-ba11-a6cdcc7c951d tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:59.309784 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0e71b9c3-a45d-4310-ba11-a6cdcc7c951d tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:59.310354 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0e71b9c3-a45d-4310-ba11-a6cdcc7c951d tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:59.444494 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b82213b1-7de4-46b9-bd1b-05dd44d8ec41 tempest-FlavorsAccessNegativeTestJSON-391144628 tempest-FlavorsAccessNegativeTestJSON-391144628-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "5472e77b54a84788ba19b736e676b990"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:12:59.448501 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b82213b1-7de4-46b9-bd1b-05dd44d8ec41 tempest-FlavorsAccessNegativeTestJSON-391144628 tempest-FlavorsAccessNegativeTestJSON-391144628-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '8f98dbd6db5243f99666d1be2c470694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472e77b54a84788ba19b736e676b990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:12:59.450899 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b82213b1-7de4-46b9-bd1b-05dd44d8ec41 tempest-FlavorsAccessNegativeTestJSON-391144628 tempest-FlavorsAccessNegativeTestJSON-391144628-project] Request method failure captured: Oct 19 03:12:59.450899 n-d-861333-8 devstack@n-api.service[121135]: request: POST /compute/v2.1/flavors/2099127087/action HTTP/1.1 Oct 19 03:12:59.450899 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:12:59.450899 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:12:59.450899 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:12:59.450899 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 67 Oct 19 03:12:59.450899 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:12:59.450899 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:12:59.450899 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:12:59.450899 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:12:59.450899 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2s0kp-lz3rYSln13fYyQ5UTgEby6tCTj5BkOf1gGW6FV_XPeiAWbWtxDtESwaNeMdePM4NgK9Dv8laFfwkxIpuH9Ej3hCZsgARAqivC4fp9EXAwfSG_DtQhXvjCc5Kn9D5n_deFhu5RiVnm6COGdp_jO-R_Uu8EDGQklEQXswmC21k Oct 19 03:12:59.450899 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:12:59.450899 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:12:59.450899 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:12:59.450899 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:12:59.450899 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:12:59.450899 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:12:59.450899 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 5472e77b54a84788ba19b736e676b990 Oct 19 03:12:59.450899 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-391144628 Oct 19 03:12:59.450899 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:12:59.450899 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:12:59.458683 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5472e77b54a84788ba19b736e676b990"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5472e77b54a84788ba19b736e676b990"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5472e77b54a84788ba19b736e676b990"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5472e77b54a84788ba19b736e676b990", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:12:59.458683 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-391144628 Oct 19 03:12:59.458683 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 5472e77b54a84788ba19b736e676b990 Oct 19 03:12:59.458683 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-391144628 Oct 19 03:12:59.458683 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-FlavorsAccessNegativeTestJSON-391144628-project Oct 19 03:12:59.458683 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:12:59.458683 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:12:59.458683 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 8f98dbd6db5243f99666d1be2c470694 Oct 19 03:12:59.458683 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-391144628-project Oct 19 03:12:59.458683 n-d-861333-8 devstack@n-api.service[121135]: Oct 19 03:12:59.458683 n-d-861333-8 devstack@n-api.service[121135]: {"addTenantAccess": {"tenant": "5472e77b54a84788ba19b736e676b990"}} Oct 19 03:12:59.458683 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:12:59.459493 n-d-861333-8 devstack@n-api.service[121135]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 19 03:12:59.459493 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '2099127087', 'body': {'addTenantAccess': {'tenant': '5472e77b54a84788ba19b736e676b990'}}} Oct 19 03:12:59.459493 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:12:59.459493 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:12:59.459493 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:12:59.459493 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:12:59.459493 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:12:59.459493 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:12:59.459493 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:12:59.459493 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:12:59.459493 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:12:59.459493 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:12:59.459493 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Oct 19 03:12:59.459493 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Oct 19 03:12:59.459493 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 19 03:12:59.459493 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 19 03:12:59.459493 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 19 03:12:59.459493 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 19 03:12:59.459493 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 03:12:59.460643 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 03:12:59.460643 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 03:12:59.460643 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 03:12:59.460643 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 19 03:12:59.460643 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 19 03:12:59.460643 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 19 03:12:59.460643 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 19 03:12:59.460643 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 19 03:12:59.460643 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 19 03:12:59.460643 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 19 03:12:59.460643 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:12:59.460643 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:12:59.460643 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:12:59.460643 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:12:59.460643 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:12:59.460643 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:12:59.460643 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 19 03:12:59.460643 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 19 03:12:59.460643 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 19 03:12:59.460643 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:12:59.462241 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b82213b1-7de4-46b9-bd1b-05dd44d8ec41 tempest-FlavorsAccessNegativeTestJSON-391144628 tempest-FlavorsAccessNegativeTestJSON-391144628-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:12:59.462241 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b82213b1-7de4-46b9-bd1b-05dd44d8ec41 tempest-FlavorsAccessNegativeTestJSON-391144628 tempest-FlavorsAccessNegativeTestJSON-391144628-project] 10.222.0.52 "POST /compute/v2.1/flavors/2099127087/action" status: 403 len: 130 microversion: 2.1 time: 0.177129 Oct 19 03:12:59.462241 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 103/207] 10.222.0.52 () {60 vars in 1200 bytes} [Wed Oct 19 03:12:59 2022] POST /compute/v2.1/flavors/2099127087/action => generated 130 bytes in 179 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:12:59.463092 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b0736e13-ce1b-45ce-be27-cf744ecebd32 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:59.463528 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b0736e13-ce1b-45ce-be27-cf744ecebd32 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 7b4a8cd9-a238-4bff-a002-497dc807bf3a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:12:59.473942 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b0736e13-ce1b-45ce-be27-cf744ecebd32 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:59.475337 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b0736e13-ce1b-45ce-be27-cf744ecebd32 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:59.475955 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b0736e13-ce1b-45ce-be27-cf744ecebd32 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:59.477146 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b0736e13-ce1b-45ce-be27-cf744ecebd32 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:59.478676 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b0736e13-ce1b-45ce-be27-cf744ecebd32 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:59.482980 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b0736e13-ce1b-45ce-be27-cf744ecebd32 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:59.729122 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0e71b9c3-a45d-4310-ba11-a6cdcc7c951d tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '769928c8ecb643fa83a9d58465dcb263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ead65f008349329789135966c031d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:12:59.742065 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b0736e13-ce1b-45ce-be27-cf744ecebd32 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:12:59.761812 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b0736e13-ce1b-45ce-be27-cf744ecebd32 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a" status: 200 len: 1313 microversion: 2.1 time: 0.305270 Oct 19 03:12:59.763228 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0e71b9c3-a45d-4310-ba11-a6cdcc7c951d tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] 10.222.0.52 "GET /compute/v2.1/servers/7a48466f-9d33-480f-b67a-21777e03d4d5" status: 200 len: 1497 microversion: 2.1 time: 0.467237 Oct 19 03:12:59.763987 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 104/208] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:12:59 2022] GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a => generated 1313 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:12:59.771864 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 105/209] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:12:59 2022] GET /compute/v2.1/servers/7a48466f-9d33-480f-b67a-21777e03d4d5 => generated 1497 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:12:59.783330 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-234b811d-2170-4220-abda-0b2c0914ba6d tempest-FlavorsAccessNegativeTestJSON-1275566317 tempest-FlavorsAccessNegativeTestJSON-1275566317-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:59.784359 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-26515ae8-d637-4085-8082-95354d1a6c75 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:59.785162 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-26515ae8-d637-4085-8082-95354d1a6c75 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] [instance: f476cc02-1b56-4c61-93a4-c3d36c38792d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:12:59.803207 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-26515ae8-d637-4085-8082-95354d1a6c75 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:59.806398 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-26515ae8-d637-4085-8082-95354d1a6c75 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:59.806897 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-26515ae8-d637-4085-8082-95354d1a6c75 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:59.807629 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-26515ae8-d637-4085-8082-95354d1a6c75 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:59.810523 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-26515ae8-d637-4085-8082-95354d1a6c75 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:59.812982 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-26515ae8-d637-4085-8082-95354d1a6c75 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:59.922930 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-26515ae8-d637-4085-8082-95354d1a6c75 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cc37ae4bed94a7e85ed70dd5942c2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df99b134b20743eb9b62788706f2705a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:12:59.930946 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-26515ae8-d637-4085-8082-95354d1a6c75 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] 10.222.0.52 "GET /compute/v2.1/servers/f476cc02-1b56-4c61-93a4-c3d36c38792d" status: 200 len: 1315 microversion: 2.1 time: 0.159101 Oct 19 03:12:59.931596 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 105/210] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:12:59 2022] GET /compute/v2.1/servers/f476cc02-1b56-4c61-93a4-c3d36c38792d => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:12:59.936072 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d0c0b06d-cb9b-4bb3-88a4-201785fb73ba tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:12:59.936823 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d0c0b06d-cb9b-4bb3-88a4-201785fb73ba tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] [instance: 44cee120-503c-401f-b046-a638d08df855] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:12:59.943294 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-234b811d-2170-4220-abda-0b2c0914ba6d tempest-FlavorsAccessNegativeTestJSON-1275566317 tempest-FlavorsAccessNegativeTestJSON-1275566317-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/2099127087" status: 202 len: 0 microversion: 2.1 time: 0.170106 Oct 19 03:12:59.943520 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d0c0b06d-cb9b-4bb3-88a4-201785fb73ba tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:59.943828 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 106/211] 10.222.0.52 () {58 vars in 1161 bytes} [Wed Oct 19 03:12:59 2022] DELETE /compute/v2.1/flavors/2099127087 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:12:59.944202 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d0c0b06d-cb9b-4bb3-88a4-201785fb73ba tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:59.944740 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d0c0b06d-cb9b-4bb3-88a4-201785fb73ba tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:59.945571 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d0c0b06d-cb9b-4bb3-88a4-201785fb73ba tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:12:59.946079 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d0c0b06d-cb9b-4bb3-88a4-201785fb73ba tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:12:59.946508 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d0c0b06d-cb9b-4bb3-88a4-201785fb73ba tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:12:59.960159 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e19530a9-e34d-483e-b375-a930d5fc523d tempest-FlavorsAccessNegativeTestJSON-1275566317 tempest-FlavorsAccessNegativeTestJSON-1275566317-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:00.185971 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e19530a9-e34d-483e-b375-a930d5fc523d tempest-FlavorsAccessNegativeTestJSON-1275566317 tempest-FlavorsAccessNegativeTestJSON-1275566317-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.229384 Oct 19 03:13:00.207518 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 107/212] 10.222.0.52 () {58 vars in 1146 bytes} [Wed Oct 19 03:12:59 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:13:00.208375 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9f224365-4193-44b5-81ac-07fca62672e4 tempest-FlavorsAccessNegativeTestJSON-1275566317 tempest-FlavorsAccessNegativeTestJSON-1275566317-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-531328297", "id": 503501819, "os-flavor-access:is_public": "False"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:13:00.309535 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9f224365-4193-44b5-81ac-07fca62672e4 tempest-FlavorsAccessNegativeTestJSON-1275566317 tempest-FlavorsAccessNegativeTestJSON-1275566317-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.104872 Oct 19 03:13:00.310145 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 108/213] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:13:00 2022] POST /compute/v2.1/flavors => generated 435 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:13:00.330606 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1f50e0de-c8fd-4989-a5f5-7b8ef4719651 tempest-FlavorsAccessNegativeTestJSON-1275566317 tempest-FlavorsAccessNegativeTestJSON-1275566317-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "5472e77b54a84788ba19b736e676b990"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:13:00.556613 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1f50e0de-c8fd-4989-a5f5-7b8ef4719651 tempest-FlavorsAccessNegativeTestJSON-1275566317 tempest-FlavorsAccessNegativeTestJSON-1275566317-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors/503501819/action" status: 200 len: 96 microversion: 2.1 time: 0.233342 Oct 19 03:13:00.556613 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 109/214] 10.222.0.52 () {60 vars in 1197 bytes} [Wed Oct 19 03:13:00 2022] POST /compute/v2.1/flavors/503501819/action => generated 96 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 03:13:00.576020 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8538d450-9857-4c65-8a4a-410531ddddd5 tempest-FlavorsAccessNegativeTestJSON-391144628 tempest-FlavorsAccessNegativeTestJSON-391144628-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "5472e77b54a84788ba19b736e676b990"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:13:00.581410 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8538d450-9857-4c65-8a4a-410531ddddd5 tempest-FlavorsAccessNegativeTestJSON-391144628 tempest-FlavorsAccessNegativeTestJSON-391144628-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '8f98dbd6db5243f99666d1be2c470694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472e77b54a84788ba19b736e676b990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:00.585455 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8538d450-9857-4c65-8a4a-410531ddddd5 tempest-FlavorsAccessNegativeTestJSON-391144628 tempest-FlavorsAccessNegativeTestJSON-391144628-project] Request method failure captured: Oct 19 03:13:00.585455 n-d-861333-8 devstack@n-api.service[121134]: request: POST /compute/v2.1/flavors/503501819/action HTTP/1.1 Oct 19 03:13:00.585455 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:13:00.585455 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:13:00.585455 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:13:00.585455 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 70 Oct 19 03:13:00.585455 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:13:00.585455 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:13:00.585455 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:13:00.585455 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:13:00.585455 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT2s0kp-lz3rYSln13fYyQ5UTgEby6tCTj5BkOf1gGW6FV_XPeiAWbWtxDtESwaNeMdePM4NgK9Dv8laFfwkxIpuH9Ej3hCZsgARAqivC4fp9EXAwfSG_DtQhXvjCc5Kn9D5n_deFhu5RiVnm6COGdp_jO-R_Uu8EDGQklEQXswmC21k Oct 19 03:13:00.585455 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:13:00.585455 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:13:00.585455 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:13:00.585455 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:13:00.585455 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:13:00.585455 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:13:00.585455 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 5472e77b54a84788ba19b736e676b990 Oct 19 03:13:00.585455 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-391144628 Oct 19 03:13:00.585455 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:13:00.585455 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:13:00.587288 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5472e77b54a84788ba19b736e676b990"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5472e77b54a84788ba19b736e676b990"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5472e77b54a84788ba19b736e676b990"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5472e77b54a84788ba19b736e676b990", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:13:00.587288 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-391144628 Oct 19 03:13:00.587288 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 5472e77b54a84788ba19b736e676b990 Oct 19 03:13:00.587288 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-391144628 Oct 19 03:13:00.587288 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-FlavorsAccessNegativeTestJSON-391144628-project Oct 19 03:13:00.587288 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:13:00.587288 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:13:00.587288 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 8f98dbd6db5243f99666d1be2c470694 Oct 19 03:13:00.587288 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-391144628-project Oct 19 03:13:00.587288 n-d-861333-8 devstack@n-api.service[121134]: Oct 19 03:13:00.587288 n-d-861333-8 devstack@n-api.service[121134]: {"removeTenantAccess": {"tenant": "5472e77b54a84788ba19b736e676b990"}} Oct 19 03:13:00.587288 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:13:00.588309 n-d-861333-8 devstack@n-api.service[121134]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 19 03:13:00.588309 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '503501819', 'body': {'removeTenantAccess': {'tenant': '5472e77b54a84788ba19b736e676b990'}}} Oct 19 03:13:00.588309 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:13:00.588309 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:00.588309 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:13:00.588309 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:13:00.588309 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:13:00.588309 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:13:00.588309 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:13:00.588309 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:13:00.588309 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:13:00.588309 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:13:00.588309 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Oct 19 03:13:00.588309 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi context.can( Oct 19 03:13:00.588309 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 19 03:13:00.588309 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 19 03:13:00.588309 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 19 03:13:00.588309 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 19 03:13:00.588309 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 03:13:00.588309 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 03:13:00.589683 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 03:13:00.589683 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 03:13:00.589683 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 19 03:13:00.589683 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 19 03:13:00.589683 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 19 03:13:00.589683 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 19 03:13:00.589683 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 19 03:13:00.589683 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 19 03:13:00.589683 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 19 03:13:00.589683 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:13:00.589683 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:13:00.589683 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:13:00.589683 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:00.589683 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:13:00.589683 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:13:00.589683 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 19 03:13:00.589683 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 19 03:13:00.589683 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 19 03:13:00.589683 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:13:00.593610 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8538d450-9857-4c65-8a4a-410531ddddd5 tempest-FlavorsAccessNegativeTestJSON-391144628 tempest-FlavorsAccessNegativeTestJSON-391144628-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:13:00.594659 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8538d450-9857-4c65-8a4a-410531ddddd5 tempest-FlavorsAccessNegativeTestJSON-391144628 tempest-FlavorsAccessNegativeTestJSON-391144628-project] 10.222.0.52 "POST /compute/v2.1/flavors/503501819/action" status: 403 len: 133 microversion: 2.1 time: 0.033547 Oct 19 03:13:00.599104 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 110/215] 10.222.0.52 () {60 vars in 1197 bytes} [Wed Oct 19 03:13:00 2022] POST /compute/v2.1/flavors/503501819/action => generated 133 bytes in 38 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:13:00.610526 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b0a2c9d0-6c51-440b-a4e8-160700de2c1a tempest-FlavorsAccessNegativeTestJSON-1275566317 tempest-FlavorsAccessNegativeTestJSON-1275566317-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "5472e77b54a84788ba19b736e676b990"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:13:00.793323 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b0a2c9d0-6c51-440b-a4e8-160700de2c1a tempest-FlavorsAccessNegativeTestJSON-1275566317 tempest-FlavorsAccessNegativeTestJSON-1275566317-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors/503501819/action" status: 200 len: 21 microversion: 2.1 time: 0.190926 Oct 19 03:13:00.806997 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 111/216] 10.222.0.52 () {60 vars in 1197 bytes} [Wed Oct 19 03:13:00 2022] POST /compute/v2.1/flavors/503501819/action => generated 21 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 03:13:00.819137 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9a233f75-9b0e-48ea-a8fc-34f4d1e05567 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:00.821087 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9a233f75-9b0e-48ea-a8fc-34f4d1e05567 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] [instance: 7a48466f-9d33-480f-b67a-21777e03d4d5] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:00.830515 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9a233f75-9b0e-48ea-a8fc-34f4d1e05567 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:00.831387 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9a233f75-9b0e-48ea-a8fc-34f4d1e05567 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:00.832284 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9a233f75-9b0e-48ea-a8fc-34f4d1e05567 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:00.833172 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9a233f75-9b0e-48ea-a8fc-34f4d1e05567 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:00.833890 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9a233f75-9b0e-48ea-a8fc-34f4d1e05567 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:00.834492 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9a233f75-9b0e-48ea-a8fc-34f4d1e05567 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:00.863570 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d0c0b06d-cb9b-4bb3-88a4-201785fb73ba tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f665963909a64c148298b7a6c8e3307a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3054afe77df43afa6406ec25b57de65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:00.871521 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d0c0b06d-cb9b-4bb3-88a4-201785fb73ba tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] 10.222.0.52 "GET /compute/v2.1/servers/44cee120-503c-401f-b046-a638d08df855" status: 200 len: 1494 microversion: 2.1 time: 0.938846 Oct 19 03:13:00.872288 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 106/217] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:12:59 2022] GET /compute/v2.1/servers/44cee120-503c-401f-b046-a638d08df855 => generated 1494 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:13:00.886656 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-df416e27-3f96-4954-9f94-67386a30a7ef tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:00.887935 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-df416e27-3f96-4954-9f94-67386a30a7ef tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 7b4a8cd9-a238-4bff-a002-497dc807bf3a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:00.904882 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-df416e27-3f96-4954-9f94-67386a30a7ef tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:00.905972 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-df416e27-3f96-4954-9f94-67386a30a7ef tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:00.906418 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-df416e27-3f96-4954-9f94-67386a30a7ef tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:00.907133 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-df416e27-3f96-4954-9f94-67386a30a7ef tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:00.907592 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-df416e27-3f96-4954-9f94-67386a30a7ef tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:00.908021 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-df416e27-3f96-4954-9f94-67386a30a7ef tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:01.465404 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-df416e27-3f96-4954-9f94-67386a30a7ef tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:01.475377 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9a233f75-9b0e-48ea-a8fc-34f4d1e05567 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '769928c8ecb643fa83a9d58465dcb263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ead65f008349329789135966c031d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:01.476049 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-df416e27-3f96-4954-9f94-67386a30a7ef tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a" status: 200 len: 1313 microversion: 2.1 time: 0.602897 Oct 19 03:13:01.484594 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9a233f75-9b0e-48ea-a8fc-34f4d1e05567 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] 10.222.0.52 "GET /compute/v2.1/servers/7a48466f-9d33-480f-b67a-21777e03d4d5" status: 200 len: 1497 microversion: 2.1 time: 0.676128 Oct 19 03:13:01.493421 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 112/218] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:13:00 2022] GET /compute/v2.1/servers/7a48466f-9d33-480f-b67a-21777e03d4d5 => generated 1497 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:13:01.504004 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 107/219] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:13:00 2022] GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a => generated 1313 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:13:01.504227 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2690f67f-4d08-4d57-883b-deb283b21dfd tempest-FlavorsAccessNegativeTestJSON-1275566317 tempest-FlavorsAccessNegativeTestJSON-1275566317-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:01.504330 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-978b5ee1-05a4-435c-84b5-fd5f646d6403 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:01.506008 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-978b5ee1-05a4-435c-84b5-fd5f646d6403 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] [instance: f476cc02-1b56-4c61-93a4-c3d36c38792d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:01.516296 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-978b5ee1-05a4-435c-84b5-fd5f646d6403 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:01.517140 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-978b5ee1-05a4-435c-84b5-fd5f646d6403 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:01.517671 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-978b5ee1-05a4-435c-84b5-fd5f646d6403 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:01.518509 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-978b5ee1-05a4-435c-84b5-fd5f646d6403 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:01.519049 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-978b5ee1-05a4-435c-84b5-fd5f646d6403 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:01.519654 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-978b5ee1-05a4-435c-84b5-fd5f646d6403 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:01.673878 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-978b5ee1-05a4-435c-84b5-fd5f646d6403 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cc37ae4bed94a7e85ed70dd5942c2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df99b134b20743eb9b62788706f2705a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:01.684275 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-978b5ee1-05a4-435c-84b5-fd5f646d6403 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] 10.222.0.52 "GET /compute/v2.1/servers/f476cc02-1b56-4c61-93a4-c3d36c38792d" status: 200 len: 1321 microversion: 2.1 time: 0.186545 Oct 19 03:13:01.685646 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 108/220] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:13:01 2022] GET /compute/v2.1/servers/f476cc02-1b56-4c61-93a4-c3d36c38792d => generated 1321 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:13:01.758822 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-3895d8f7-0af5-4fec-b0bd-bf72fc090219 req-4ed70308-dae1-464a-91a1-ebf908ea72f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b4a8cd9-a238-4bff-a002-497dc807bf3a", "tag": "f0926ecc-fbd5-457e-bf81-de5bfd5b6a96"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:13:01.771497 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-3895d8f7-0af5-4fec-b0bd-bf72fc090219 req-4ed70308-dae1-464a-91a1-ebf908ea72f1 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:01.772639 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-3895d8f7-0af5-4fec-b0bd-bf72fc090219 req-4ed70308-dae1-464a-91a1-ebf908ea72f1 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:01.772639 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-3895d8f7-0af5-4fec-b0bd-bf72fc090219 req-4ed70308-dae1-464a-91a1-ebf908ea72f1 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:01.785407 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-3895d8f7-0af5-4fec-b0bd-bf72fc090219 req-4ed70308-dae1-464a-91a1-ebf908ea72f1 service nova] Creating event network-changed:f0926ecc-fbd5-457e-bf81-de5bfd5b6a96 for instance 7b4a8cd9-a238-4bff-a002-497dc807bf3a on n-h1-861333-8 Oct 19 03:13:01.790403 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-3895d8f7-0af5-4fec-b0bd-bf72fc090219 req-4ed70308-dae1-464a-91a1-ebf908ea72f1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102533 Oct 19 03:13:01.791219 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 109/221] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:13:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:13:01.874907 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2690f67f-4d08-4d57-883b-deb283b21dfd tempest-FlavorsAccessNegativeTestJSON-1275566317 tempest-FlavorsAccessNegativeTestJSON-1275566317-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/503501819" status: 202 len: 0 microversion: 2.1 time: 0.383946 Oct 19 03:13:01.875892 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 113/222] 10.222.0.52 () {58 vars in 1158 bytes} [Wed Oct 19 03:13:01 2022] DELETE /compute/v2.1/flavors/503501819 => generated 0 bytes in 386 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:13:01.884527 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0f26fcb8-5a66-4a3f-a454-ddb2af0a40dd tempest-FlavorsAccessNegativeTestJSON-1275566317 tempest-FlavorsAccessNegativeTestJSON-1275566317-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:01.899044 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-fc33a433-ba58-4357-8c40-707d5675250f tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:01.899675 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-fc33a433-ba58-4357-8c40-707d5675250f tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] [instance: 44cee120-503c-401f-b046-a638d08df855] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:01.906732 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fc33a433-ba58-4357-8c40-707d5675250f tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:01.907478 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fc33a433-ba58-4357-8c40-707d5675250f tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:01.908158 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fc33a433-ba58-4357-8c40-707d5675250f tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:01.909598 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fc33a433-ba58-4357-8c40-707d5675250f tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:01.910108 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fc33a433-ba58-4357-8c40-707d5675250f tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:01.910687 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fc33a433-ba58-4357-8c40-707d5675250f tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:01.916935 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0f26fcb8-5a66-4a3f-a454-ddb2af0a40dd tempest-FlavorsAccessNegativeTestJSON-1275566317 tempest-FlavorsAccessNegativeTestJSON-1275566317-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.036528 Oct 19 03:13:01.918497 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 110/223] 10.222.0.52 () {58 vars in 1146 bytes} [Wed Oct 19 03:13:01 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:13:01.938726 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-71bd2dc3-4c6d-4659-be13-69e836031143 tempest-FlavorsAccessNegativeTestJSON-1275566317 tempest-FlavorsAccessNegativeTestJSON-1275566317-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1850622520", "id": 506791151, "os-flavor-access:is_public": "False"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:13:01.996996 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-fc33a433-ba58-4357-8c40-707d5675250f tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f665963909a64c148298b7a6c8e3307a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3054afe77df43afa6406ec25b57de65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:02.025205 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-fc33a433-ba58-4357-8c40-707d5675250f tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] 10.222.0.52 "GET /compute/v2.1/servers/44cee120-503c-401f-b046-a638d08df855" status: 200 len: 1452 microversion: 2.1 time: 0.129911 Oct 19 03:13:02.027364 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 114/224] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:13:01 2022] GET /compute/v2.1/servers/44cee120-503c-401f-b046-a638d08df855 => generated 1452 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:13:02.065886 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-71bd2dc3-4c6d-4659-be13-69e836031143 tempest-FlavorsAccessNegativeTestJSON-1275566317 tempest-FlavorsAccessNegativeTestJSON-1275566317-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.131020 Oct 19 03:13:02.068516 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 111/225] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:13:01 2022] POST /compute/v2.1/flavors => generated 436 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:13:02.084117 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6e792992-d6f2-4e8c-8f5d-4249f78a2026 tempest-FlavorsAccessNegativeTestJSON-1275566317 tempest-FlavorsAccessNegativeTestJSON-1275566317-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "4efff538d51b4338b79a6abb4704b273"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:13:02.184989 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-6e792992-d6f2-4e8c-8f5d-4249f78a2026 tempest-FlavorsAccessNegativeTestJSON-1275566317 tempest-FlavorsAccessNegativeTestJSON-1275566317-project-admin] HTTP exception thrown: Flavor access not found for 35 / 4efff538d51b4338b79a6abb4704b273 combination. Oct 19 03:13:02.187322 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6e792992-d6f2-4e8c-8f5d-4249f78a2026 tempest-FlavorsAccessNegativeTestJSON-1275566317 tempest-FlavorsAccessNegativeTestJSON-1275566317-project-admin] Request method failure captured: Oct 19 03:13:02.187322 n-d-861333-8 devstack@n-api.service[121134]: request: POST /compute/v2.1/flavors/506791151/action HTTP/1.1 Oct 19 03:13:02.187322 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:13:02.187322 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:13:02.187322 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:13:02.187322 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 70 Oct 19 03:13:02.187322 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:13:02.187322 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:13:02.187322 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:13:02.187322 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:13:02.187322 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT2s2eUcTMDeP3G8ZuiKlQs-5iFnLkjNQBP93QBgwtdYrIXHHSeBs7eZofcN3ktJphqYy8u8hCIeCwjhnxQ83P1llmXq9yKaYKSFeGCR0On6-QE2zeoLrJGJe75gP_T-nZ7lJfixV6kHKwuwrpwB70C4DN90RRuUh2vVO2IUpLU9WG5o Oct 19 03:13:02.187322 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:13:02.187322 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:13:02.187322 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:13:02.187322 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:13:02.187322 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:13:02.187322 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:13:02.187322 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: f381711730204762a3c97eead3a13fb8 Oct 19 03:13:02.187322 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1275566317 Oct 19 03:13:02.187322 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member,admin Oct 19 03:13:02.187322 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member,admin Oct 19 03:13:02.188874 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f381711730204762a3c97eead3a13fb8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f381711730204762a3c97eead3a13fb8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f381711730204762a3c97eead3a13fb8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f381711730204762a3c97eead3a13fb8", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:13:02.188874 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1275566317 Oct 19 03:13:02.188874 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: f381711730204762a3c97eead3a13fb8 Oct 19 03:13:02.188874 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1275566317 Oct 19 03:13:02.188874 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-FlavorsAccessNegativeTestJSON-1275566317-project-admin Oct 19 03:13:02.188874 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:13:02.188874 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:13:02.188874 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 7a4e8c98de3c448480b3586ce046b15b Oct 19 03:13:02.188874 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1275566317-project-admin Oct 19 03:13:02.188874 n-d-861333-8 devstack@n-api.service[121134]: Oct 19 03:13:02.188874 n-d-861333-8 devstack@n-api.service[121134]: {"removeTenantAccess": {"tenant": "4efff538d51b4338b79a6abb4704b273"}} Oct 19 03:13:02.188874 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:13:02.189741 n-d-861333-8 devstack@n-api.service[121134]: exception: Flavor access not found for 35 / 4efff538d51b4338b79a6abb4704b273 combination. Oct 19 03:13:02.189741 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '506791151', 'body': {'removeTenantAccess': {'tenant': '4efff538d51b4338b79a6abb4704b273'}}} Oct 19 03:13:02.189741 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:13:02.189741 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:02.189741 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Oct 19 03:13:02.189741 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Oct 19 03:13:02.189741 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 19 03:13:02.189741 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 19 03:13:02.189741 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Oct 19 03:13:02.189741 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Oct 19 03:13:02.189741 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Oct 19 03:13:02.189741 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Oct 19 03:13:02.189741 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Oct 19 03:13:02.189741 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Oct 19 03:13:02.189741 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 19 03:13:02.189741 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 19 03:13:02.189741 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Oct 19 03:13:02.189741 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Oct 19 03:13:02.191719 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 35 / 4efff538d51b4338b79a6abb4704b273 combination. Oct 19 03:13:02.191719 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:13:02.191719 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:13:02.191719 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:13:02.191719 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:02.191719 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:13:02.191719 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:13:02.191719 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:13:02.191719 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:13:02.191719 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:13:02.191719 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:13:02.191719 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:13:02.191719 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:13:02.191719 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Oct 19 03:13:02.191719 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:13:02.191719 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 35 / 4efff538d51b4338b79a6abb4704b273 combination. Oct 19 03:13:02.191719 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:13:02.191719 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:13:02.191719 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:13:02.191719 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:02.193117 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:13:02.193117 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:13:02.193117 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:13:02.193117 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:13:02.193117 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 35 / 4efff538d51b4338b79a6abb4704b273 combination. Oct 19 03:13:02.193117 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:13:02.207775 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6e792992-d6f2-4e8c-8f5d-4249f78a2026 tempest-FlavorsAccessNegativeTestJSON-1275566317 tempest-FlavorsAccessNegativeTestJSON-1275566317-project-admin] Returning 404 to user: Flavor access not found for 35 / 4efff538d51b4338b79a6abb4704b273 combination. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:13:02.209447 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6e792992-d6f2-4e8c-8f5d-4249f78a2026 tempest-FlavorsAccessNegativeTestJSON-1275566317 tempest-FlavorsAccessNegativeTestJSON-1275566317-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors/506791151/action" status: 404 len: 124 microversion: 2.1 time: 0.131451 Oct 19 03:13:02.218714 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 115/226] 10.222.0.52 () {60 vars in 1197 bytes} [Wed Oct 19 03:13:02 2022] POST /compute/v2.1/flavors/506791151/action => generated 124 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:13:02.230280 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c1c51242-51c7-4286-8518-e13168ff18ca tempest-FlavorsAccessNegativeTestJSON-1275566317 tempest-FlavorsAccessNegativeTestJSON-1275566317-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:02.324848 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c1c51242-51c7-4286-8518-e13168ff18ca tempest-FlavorsAccessNegativeTestJSON-1275566317 tempest-FlavorsAccessNegativeTestJSON-1275566317-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/506791151" status: 202 len: 0 microversion: 2.1 time: 0.102062 Oct 19 03:13:02.325454 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 112/227] 10.222.0.52 () {58 vars in 1158 bytes} [Wed Oct 19 03:13:02 2022] DELETE /compute/v2.1/flavors/506791151 => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:13:02.327504 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-cad662a7-760c-4c39-a608-9e130f426212 req-dbacb08a-a54d-44fe-b471-210acecae9e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44cee120-503c-401f-b046-a638d08df855", "name": "network-vif-deleted", "tag": "552220b1-e24d-43aa-babe-fd8198281bae"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:13:02.335198 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b08dc2dc-fc55-4a95-a40f-236fa1f7e738 tempest-FlavorsAccessNegativeTestJSON-1275566317 tempest-FlavorsAccessNegativeTestJSON-1275566317-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:02.349102 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-cad662a7-760c-4c39-a608-9e130f426212 req-dbacb08a-a54d-44fe-b471-210acecae9e6 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:02.349916 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-cad662a7-760c-4c39-a608-9e130f426212 req-dbacb08a-a54d-44fe-b471-210acecae9e6 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:02.350540 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-cad662a7-760c-4c39-a608-9e130f426212 req-dbacb08a-a54d-44fe-b471-210acecae9e6 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:02.380267 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b08dc2dc-fc55-4a95-a40f-236fa1f7e738 tempest-FlavorsAccessNegativeTestJSON-1275566317 tempest-FlavorsAccessNegativeTestJSON-1275566317-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.043466 Oct 19 03:13:02.380977 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 113/228] 10.222.0.52 () {58 vars in 1146 bytes} [Wed Oct 19 03:13:02 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:13:02.403486 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-cad662a7-760c-4c39-a608-9e130f426212 req-dbacb08a-a54d-44fe-b471-210acecae9e6 service nova] Creating event network-vif-deleted:552220b1-e24d-43aa-babe-fd8198281bae for instance 44cee120-503c-401f-b046-a638d08df855 on n-h2-861333-8 Oct 19 03:13:02.412319 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-cad662a7-760c-4c39-a608-9e130f426212 req-dbacb08a-a54d-44fe-b471-210acecae9e6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088384 Oct 19 03:13:02.414685 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 116/229] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:13:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:13:02.511784 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-dd7da9e9-1a6d-4574-b12f-dc1857e83b72 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:02.513543 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-dd7da9e9-1a6d-4574-b12f-dc1857e83b72 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 7b4a8cd9-a238-4bff-a002-497dc807bf3a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:02.518914 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0f3e3ed4-b9c0-49dd-9da6-c817c77bc57c tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:02.518914 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0f3e3ed4-b9c0-49dd-9da6-c817c77bc57c tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] [instance: 7a48466f-9d33-480f-b67a-21777e03d4d5] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:02.528230 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dd7da9e9-1a6d-4574-b12f-dc1857e83b72 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:02.529670 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dd7da9e9-1a6d-4574-b12f-dc1857e83b72 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:02.531009 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dd7da9e9-1a6d-4574-b12f-dc1857e83b72 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:02.532000 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dd7da9e9-1a6d-4574-b12f-dc1857e83b72 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:02.532668 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dd7da9e9-1a6d-4574-b12f-dc1857e83b72 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:02.534269 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dd7da9e9-1a6d-4574-b12f-dc1857e83b72 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:02.536258 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0f3e3ed4-b9c0-49dd-9da6-c817c77bc57c tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:02.536825 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0f3e3ed4-b9c0-49dd-9da6-c817c77bc57c tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:02.537276 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0f3e3ed4-b9c0-49dd-9da6-c817c77bc57c tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:02.540471 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0f3e3ed4-b9c0-49dd-9da6-c817c77bc57c tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:02.540969 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0f3e3ed4-b9c0-49dd-9da6-c817c77bc57c tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:02.541848 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0f3e3ed4-b9c0-49dd-9da6-c817c77bc57c tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:03.055538 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0f3e3ed4-b9c0-49dd-9da6-c817c77bc57c tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '769928c8ecb643fa83a9d58465dcb263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ead65f008349329789135966c031d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:03.064575 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0f3e3ed4-b9c0-49dd-9da6-c817c77bc57c tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] 10.222.0.52 "GET /compute/v2.1/servers/7a48466f-9d33-480f-b67a-21777e03d4d5" status: 200 len: 1455 microversion: 2.1 time: 0.556362 Oct 19 03:13:03.065800 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 117/230] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:13:02 2022] GET /compute/v2.1/servers/7a48466f-9d33-480f-b67a-21777e03d4d5 => generated 1455 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:13:03.070963 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1ea29220-178c-4d5d-be7d-bade5f4ff116 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:03.078522 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1ea29220-178c-4d5d-be7d-bade5f4ff116 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] [instance: f476cc02-1b56-4c61-93a4-c3d36c38792d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:03.078522 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1ea29220-178c-4d5d-be7d-bade5f4ff116 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:03.078522 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1ea29220-178c-4d5d-be7d-bade5f4ff116 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:03.079375 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1ea29220-178c-4d5d-be7d-bade5f4ff116 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:03.080171 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1ea29220-178c-4d5d-be7d-bade5f4ff116 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:03.080728 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1ea29220-178c-4d5d-be7d-bade5f4ff116 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:03.081362 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1ea29220-178c-4d5d-be7d-bade5f4ff116 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:03.255865 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-dd7da9e9-1a6d-4574-b12f-dc1857e83b72 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:03.264393 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-dd7da9e9-1a6d-4574-b12f-dc1857e83b72 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a" status: 200 len: 1313 microversion: 2.1 time: 0.763592 Oct 19 03:13:03.265025 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 114/231] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:13:02 2022] GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a => generated 1313 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:13:03.269582 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-90acd444-1a16-4267-9902-506f779f5205 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:03.270187 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-90acd444-1a16-4267-9902-506f779f5205 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] [instance: 44cee120-503c-401f-b046-a638d08df855] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:03.275798 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-90acd444-1a16-4267-9902-506f779f5205 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:03.276372 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-90acd444-1a16-4267-9902-506f779f5205 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:03.276798 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-90acd444-1a16-4267-9902-506f779f5205 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:03.277508 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-90acd444-1a16-4267-9902-506f779f5205 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:03.278115 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-90acd444-1a16-4267-9902-506f779f5205 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:03.278685 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-90acd444-1a16-4267-9902-506f779f5205 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:03.307571 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=4 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:13:03.311962 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-90acd444-1a16-4267-9902-506f779f5205 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:03.312447 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-90acd444-1a16-4267-9902-506f779f5205 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:03.313052 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-90acd444-1a16-4267-9902-506f779f5205 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:03.313546 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-90acd444-1a16-4267-9902-506f779f5205 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Lazy-loading 'fault' on Instance uuid 44cee120-503c-401f-b046-a638d08df855 {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:13:03.370632 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-90acd444-1a16-4267-9902-506f779f5205 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f665963909a64c148298b7a6c8e3307a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3054afe77df43afa6406ec25b57de65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:03.371598 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-1ea29220-178c-4d5d-be7d-bade5f4ff116 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cc37ae4bed94a7e85ed70dd5942c2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df99b134b20743eb9b62788706f2705a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:03.381519 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1ea29220-178c-4d5d-be7d-bade5f4ff116 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] 10.222.0.52 "GET /compute/v2.1/servers/f476cc02-1b56-4c61-93a4-c3d36c38792d" status: 200 len: 1388 microversion: 2.1 time: 0.314504 Oct 19 03:13:03.382590 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 118/232] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:13:03 2022] GET /compute/v2.1/servers/f476cc02-1b56-4c61-93a4-c3d36c38792d => generated 1388 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:13:03.394510 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-90acd444-1a16-4267-9902-506f779f5205 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] 10.222.0.52 "GET /compute/v2.1/servers/44cee120-503c-401f-b046-a638d08df855" status: 200 len: 1328 microversion: 2.1 time: 0.128398 Oct 19 03:13:03.417807 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 115/233] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:13:03 2022] GET /compute/v2.1/servers/44cee120-503c-401f-b046-a638d08df855 => generated 1328 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:13:04.091304 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-47e84288-252c-4016-873d-62df95b9e924 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:04.091830 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-47e84288-252c-4016-873d-62df95b9e924 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] [instance: 7a48466f-9d33-480f-b67a-21777e03d4d5] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:04.098407 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-47e84288-252c-4016-873d-62df95b9e924 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:04.098982 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-47e84288-252c-4016-873d-62df95b9e924 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:04.099553 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-47e84288-252c-4016-873d-62df95b9e924 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:04.100395 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-47e84288-252c-4016-873d-62df95b9e924 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:04.100934 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-47e84288-252c-4016-873d-62df95b9e924 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:04.101494 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-47e84288-252c-4016-873d-62df95b9e924 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:04.107502 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:13:04.148131 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-47e84288-252c-4016-873d-62df95b9e924 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:04.148833 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-47e84288-252c-4016-873d-62df95b9e924 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:04.149506 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-47e84288-252c-4016-873d-62df95b9e924 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:04.150158 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-47e84288-252c-4016-873d-62df95b9e924 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lazy-loading 'fault' on Instance uuid 7a48466f-9d33-480f-b67a-21777e03d4d5 {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:13:04.221925 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-47e84288-252c-4016-873d-62df95b9e924 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '769928c8ecb643fa83a9d58465dcb263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ead65f008349329789135966c031d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:04.246491 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-47e84288-252c-4016-873d-62df95b9e924 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] 10.222.0.52 "GET /compute/v2.1/servers/7a48466f-9d33-480f-b67a-21777e03d4d5" status: 200 len: 1331 microversion: 2.1 time: 0.159606 Oct 19 03:13:04.247079 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 119/234] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:13:04 2022] GET /compute/v2.1/servers/7a48466f-9d33-480f-b67a-21777e03d4d5 => generated 1331 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:13:04.290267 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1e9473ee-d3f2-4ab9-af93-9ae61732d093 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:04.294892 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1e9473ee-d3f2-4ab9-af93-9ae61732d093 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 7b4a8cd9-a238-4bff-a002-497dc807bf3a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:04.300276 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1e9473ee-d3f2-4ab9-af93-9ae61732d093 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:04.300773 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1e9473ee-d3f2-4ab9-af93-9ae61732d093 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:04.301209 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1e9473ee-d3f2-4ab9-af93-9ae61732d093 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:04.302327 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1e9473ee-d3f2-4ab9-af93-9ae61732d093 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:04.302782 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1e9473ee-d3f2-4ab9-af93-9ae61732d093 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:04.303509 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1e9473ee-d3f2-4ab9-af93-9ae61732d093 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:04.406755 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-99903291-4511-4445-bc30-f62c8cffdff1 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:04.409148 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-99903291-4511-4445-bc30-f62c8cffdff1 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] [instance: f476cc02-1b56-4c61-93a4-c3d36c38792d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:04.417121 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-99903291-4511-4445-bc30-f62c8cffdff1 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:04.417977 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-99903291-4511-4445-bc30-f62c8cffdff1 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:04.418663 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-99903291-4511-4445-bc30-f62c8cffdff1 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:04.420127 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-99903291-4511-4445-bc30-f62c8cffdff1 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:04.420958 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-99903291-4511-4445-bc30-f62c8cffdff1 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:04.422455 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-99903291-4511-4445-bc30-f62c8cffdff1 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:04.571124 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-1e9473ee-d3f2-4ab9-af93-9ae61732d093 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:04.583718 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1e9473ee-d3f2-4ab9-af93-9ae61732d093 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a" status: 200 len: 1313 microversion: 2.1 time: 0.298078 Oct 19 03:13:04.585186 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 116/235] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:13:04 2022] GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a => generated 1313 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:13:04.590037 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0a2134a6-f7ae-4e03-a167-0c71de19334d tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:04.593072 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0a2134a6-f7ae-4e03-a167-0c71de19334d tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] [instance: 44cee120-503c-401f-b046-a638d08df855] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:04.602564 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0a2134a6-f7ae-4e03-a167-0c71de19334d tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:04.603386 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0a2134a6-f7ae-4e03-a167-0c71de19334d tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:04.607480 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0a2134a6-f7ae-4e03-a167-0c71de19334d tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:04.607480 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0a2134a6-f7ae-4e03-a167-0c71de19334d tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:04.607480 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0a2134a6-f7ae-4e03-a167-0c71de19334d tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:04.607480 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0a2134a6-f7ae-4e03-a167-0c71de19334d tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:04.625347 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-0a2134a6-f7ae-4e03-a167-0c71de19334d tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] HTTP exception thrown: Instance 44cee120-503c-401f-b046-a638d08df855 could not be found. Oct 19 03:13:04.627796 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0a2134a6-f7ae-4e03-a167-0c71de19334d tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Request method failure captured: Oct 19 03:13:04.627796 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/44cee120-503c-401f-b046-a638d08df855 HTTP/1.1 Oct 19 03:13:04.627796 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:13:04.627796 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:13:04.627796 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:13:04.627796 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:13:04.627796 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:13:04.627796 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:13:04.627796 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:13:04.627796 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:13:04.627796 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2sPxEudS9vYV4UG5yd8PpOgAJzE6PZ0ObZVjBpBb0wPgbtHu-kDzFU4YNyKompBg6-wJxOiNpIqlFxGKLC4h2z77NNez4V5yttRVfRd5fY-Q4pQPsTMphDYpsSuoJPOLPAomp7AtPOX8HhIBtqWVM5H_SZnz0nRaOtY0jqC83U8BEY Oct 19 03:13:04.627796 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:13:04.627796 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:13:04.627796 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:13:04.627796 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:13:04.627796 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:13:04.627796 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:13:04.627796 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: d3054afe77df43afa6406ec25b57de65 Oct 19 03:13:04.627796 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-AggregatesAdminTestJSON-873493697 Oct 19 03:13:04.627796 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:13:04.627796 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:13:04.628956 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d3054afe77df43afa6406ec25b57de65"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d3054afe77df43afa6406ec25b57de65"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d3054afe77df43afa6406ec25b57de65"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d3054afe77df43afa6406ec25b57de65", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:13:04.628956 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-AggregatesAdminTestJSON-873493697 Oct 19 03:13:04.628956 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: d3054afe77df43afa6406ec25b57de65 Oct 19 03:13:04.628956 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-873493697 Oct 19 03:13:04.628956 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-AggregatesAdminTestJSON-873493697-project Oct 19 03:13:04.628956 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:13:04.628956 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:13:04.628956 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: f665963909a64c148298b7a6c8e3307a Oct 19 03:13:04.628956 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-AggregatesAdminTestJSON-873493697-project Oct 19 03:13:04.628956 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:13:04.628956 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance 44cee120-503c-401f-b046-a638d08df855 could not be found. Oct 19 03:13:04.628956 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '44cee120-503c-401f-b046-a638d08df855'} Oct 19 03:13:04.629789 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:13:04.629789 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:04.629789 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:13:04.629789 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:13:04.629789 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:13:04.629789 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:13:04.629789 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:13:04.629789 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:13:04.629789 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:13:04.629789 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:13:04.629789 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44cee120-503c-401f-b046-a638d08df855 could not be found. Oct 19 03:13:04.629789 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:04.629789 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:13:04.629789 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:04.629789 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:04.629789 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:13:04.629789 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:13:04.629789 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:13:04.629789 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:13:04.629789 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:13:04.630855 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:13:04.630855 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:13:04.630855 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:13:04.630855 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:13:04.630855 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:13:04.630855 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:13:04.630855 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:13:04.630855 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44cee120-503c-401f-b046-a638d08df855 could not be found. Oct 19 03:13:04.630855 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:04.630855 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:13:04.630855 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:04.630855 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:04.630855 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:13:04.630855 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:13:04.630855 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:13:04.630855 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:13:04.630855 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44cee120-503c-401f-b046-a638d08df855 could not be found. Oct 19 03:13:04.630855 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:04.633295 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0a2134a6-f7ae-4e03-a167-0c71de19334d tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Returning 404 to user: Instance 44cee120-503c-401f-b046-a638d08df855 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:13:04.636369 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0a2134a6-f7ae-4e03-a167-0c71de19334d tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] 10.222.0.52 "GET /compute/v2.1/servers/44cee120-503c-401f-b046-a638d08df855" status: 404 len: 111 microversion: 2.1 time: 0.048025 Oct 19 03:13:04.636496 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-99903291-4511-4445-bc30-f62c8cffdff1 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cc37ae4bed94a7e85ed70dd5942c2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df99b134b20743eb9b62788706f2705a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:04.636609 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 117/236] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:13:04 2022] GET /compute/v2.1/servers/44cee120-503c-401f-b046-a638d08df855 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:13:04.642635 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-55937c02-3b56-416d-87cb-5baf164f475b req-b7e36ec3-b105-4ae0-a441-ddce05b96c92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a48466f-9d33-480f-b67a-21777e03d4d5", "name": "network-vif-deleted", "tag": "a519b32a-37d6-4d4b-ad11-3afe261db20f"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:13:04.653182 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-55937c02-3b56-416d-87cb-5baf164f475b req-b7e36ec3-b105-4ae0-a441-ddce05b96c92 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:04.654067 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-55937c02-3b56-416d-87cb-5baf164f475b req-b7e36ec3-b105-4ae0-a441-ddce05b96c92 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:04.654607 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-55937c02-3b56-416d-87cb-5baf164f475b req-b7e36ec3-b105-4ae0-a441-ddce05b96c92 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:04.656751 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-99903291-4511-4445-bc30-f62c8cffdff1 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] 10.222.0.52 "GET /compute/v2.1/servers/f476cc02-1b56-4c61-93a4-c3d36c38792d" status: 200 len: 1388 microversion: 2.1 time: 0.254532 Oct 19 03:13:04.658118 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 120/237] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:13:04 2022] GET /compute/v2.1/servers/f476cc02-1b56-4c61-93a4-c3d36c38792d => generated 1388 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:13:04.665678 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-538840b5-ceec-4f87-9f35-47eee2c60039 tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-861333-8"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:13:04.671484 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-55937c02-3b56-416d-87cb-5baf164f475b req-b7e36ec3-b105-4ae0-a441-ddce05b96c92 service nova] Creating event network-vif-deleted:a519b32a-37d6-4d4b-ad11-3afe261db20f for instance 7a48466f-9d33-480f-b67a-21777e03d4d5 on n-h2-861333-8 Oct 19 03:13:04.677210 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-55937c02-3b56-416d-87cb-5baf164f475b req-b7e36ec3-b105-4ae0-a441-ddce05b96c92 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039077 Oct 19 03:13:04.678154 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 118/238] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:13:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:13:04.683195 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-538840b5-ceec-4f87-9f35-47eee2c60039 tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:04.683769 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-538840b5-ceec-4f87-9f35-47eee2c60039 tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:04.684561 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-538840b5-ceec-4f87-9f35-47eee2c60039 tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:05.058317 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-538840b5-ceec-4f87-9f35-47eee2c60039 tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/7/action" status: 200 len: 297 microversion: 2.1 time: 0.398975 Oct 19 03:13:05.072817 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 121/239] 10.222.0.52 () {60 vars in 1191 bytes} [Wed Oct 19 03:13:04 2022] POST /compute/v2.1/os-aggregates/7/action => generated 297 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:13:05.079456 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-92a7f9ce-1a8f-4f56-9ea1-80753811b978 tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:05.133329 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=8 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:13:05.206484 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-92a7f9ce-1a8f-4f56-9ea1-80753811b978 tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.138004 Oct 19 03:13:05.207195 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 119/240] 10.222.0.52 () {58 vars in 1152 bytes} [Wed Oct 19 03:13:05 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 19 03:13:05.227701 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-545b476f-74ab-426b-bd95-40f0232fee68 tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-678007994"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:13:05.237582 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.aggregate [None req-545b476f-74ab-426b-bd95-40f0232fee68 tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] Generated uuid 6c137ab3-302d-4945-9fbe-7cfde5583a1a for aggregate {{(pid=121134) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 19 03:13:05.270913 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2a0647d7-7776-49d8-8650-b3cd03887bb6 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:05.271716 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-2a0647d7-7776-49d8-8650-b3cd03887bb6 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] [instance: 7a48466f-9d33-480f-b67a-21777e03d4d5] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:05.274465 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=15,nova_api:INSERT=4 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:13:05.288703 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2a0647d7-7776-49d8-8650-b3cd03887bb6 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:05.288703 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2a0647d7-7776-49d8-8650-b3cd03887bb6 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:05.288703 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2a0647d7-7776-49d8-8650-b3cd03887bb6 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:05.291246 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2a0647d7-7776-49d8-8650-b3cd03887bb6 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:05.292344 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2a0647d7-7776-49d8-8650-b3cd03887bb6 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:05.293796 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2a0647d7-7776-49d8-8650-b3cd03887bb6 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:05.326237 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-2a0647d7-7776-49d8-8650-b3cd03887bb6 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] HTTP exception thrown: Instance 7a48466f-9d33-480f-b67a-21777e03d4d5 could not be found. Oct 19 03:13:05.328612 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2a0647d7-7776-49d8-8650-b3cd03887bb6 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Request method failure captured: Oct 19 03:13:05.328612 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/7a48466f-9d33-480f-b67a-21777e03d4d5 HTTP/1.1 Oct 19 03:13:05.328612 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:13:05.328612 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:13:05.328612 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:13:05.328612 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:13:05.328612 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:13:05.328612 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:13:05.328612 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:13:05.328612 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:13:05.328612 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2sOh7nMT0gdBjBdmgpCe4p4VPtOFd54Qq9a22G3ETTZ8BbEzWZuZ5DDznx_vc0SSaUshOB00-DnHmPgJrXSs2dCkN1VgMZw7nLVzclkzSJpO3sHygHs-Gp7MvyOsOOgeIZoA2Ifc-nbqawgWoy0YZKFKnE2e6C2V-XB8SoF032Fbpg Oct 19 03:13:05.328612 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:13:05.328612 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:13:05.328612 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:13:05.328612 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:13:05.328612 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:13:05.328612 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:13:05.328612 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 31ead65f008349329789135966c031d0 Oct 19 03:13:05.328612 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-DeleteServersAdminTestJSON-173664434 Oct 19 03:13:05.328612 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:13:05.328612 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:13:05.330189 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/31ead65f008349329789135966c031d0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/31ead65f008349329789135966c031d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/31ead65f008349329789135966c031d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_31ead65f008349329789135966c031d0", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:13:05.330189 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-DeleteServersAdminTestJSON-173664434 Oct 19 03:13:05.330189 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 31ead65f008349329789135966c031d0 Oct 19 03:13:05.330189 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-173664434 Oct 19 03:13:05.330189 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-DeleteServersAdminTestJSON-173664434-project Oct 19 03:13:05.330189 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:13:05.330189 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:13:05.330189 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 769928c8ecb643fa83a9d58465dcb263 Oct 19 03:13:05.330189 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-DeleteServersAdminTestJSON-173664434-project Oct 19 03:13:05.330189 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:13:05.330189 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance 7a48466f-9d33-480f-b67a-21777e03d4d5 could not be found. Oct 19 03:13:05.330189 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '7a48466f-9d33-480f-b67a-21777e03d4d5'} Oct 19 03:13:05.330999 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:13:05.330999 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:05.330999 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:13:05.330999 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:13:05.330999 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:13:05.330999 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:13:05.330999 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:13:05.330999 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:13:05.330999 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:13:05.330999 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:13:05.330999 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a48466f-9d33-480f-b67a-21777e03d4d5 could not be found. Oct 19 03:13:05.330999 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:05.330999 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:13:05.330999 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:05.330999 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:05.330999 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:13:05.330999 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:13:05.330999 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:13:05.330999 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:13:05.330999 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:13:05.332228 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:13:05.332228 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:13:05.332228 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:13:05.332228 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:13:05.332228 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:13:05.332228 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:13:05.332228 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:13:05.332228 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a48466f-9d33-480f-b67a-21777e03d4d5 could not be found. Oct 19 03:13:05.332228 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:05.332228 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:13:05.332228 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:05.332228 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:05.332228 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:13:05.332228 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:13:05.332228 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:13:05.332228 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:13:05.332228 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a48466f-9d33-480f-b67a-21777e03d4d5 could not be found. Oct 19 03:13:05.332228 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:05.340600 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2a0647d7-7776-49d8-8650-b3cd03887bb6 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Returning 404 to user: Instance 7a48466f-9d33-480f-b67a-21777e03d4d5 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:13:05.340600 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2a0647d7-7776-49d8-8650-b3cd03887bb6 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] 10.222.0.52 "GET /compute/v2.1/servers/7a48466f-9d33-480f-b67a-21777e03d4d5" status: 404 len: 111 microversion: 2.1 time: 0.072672 Oct 19 03:13:05.340600 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 120/241] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:13:05 2022] GET /compute/v2.1/servers/7a48466f-9d33-480f-b67a-21777e03d4d5 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:13:05.373499 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-545b476f-74ab-426b-bd95-40f0232fee68 tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.149215 Oct 19 03:13:05.375421 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 122/242] 10.222.0.52 () {60 vars in 1164 bytes} [Wed Oct 19 03:13:05 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:13:05.386890 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-edf397c9-b01a-45a0-abea-b9dd121df2d2 tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-861333-8"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:13:05.415002 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-edf397c9-b01a-45a0-abea-b9dd121df2d2 tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:05.415557 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-edf397c9-b01a-45a0-abea-b9dd121df2d2 tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:05.416054 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-edf397c9-b01a-45a0-abea-b9dd121df2d2 tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:05.518208 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-cc062c83-a0fc-42fe-86f0-edc77654735e tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1164058216", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:13:05.611685 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-cc062c83-a0fc-42fe-86f0-edc77654735e tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] validate_networks() for None {{(pid=121134) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:13:05.773980 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-edf397c9-b01a-45a0-abea-b9dd121df2d2 tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 241 microversion: 2.1 time: 0.389201 Oct 19 03:13:05.780295 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 121/243] 10.222.0.52 () {60 vars in 1191 bytes} [Wed Oct 19 03:13:05 2022] POST /compute/v2.1/os-aggregates/9/action => generated 241 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:13:05.787286 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2a6d72cc-ada1-4fa0-ac4b-5e2317219337 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:05.790273 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-2a6d72cc-ada1-4fa0-ac4b-5e2317219337 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 7b4a8cd9-a238-4bff-a002-497dc807bf3a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:05.803351 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2a6d72cc-ada1-4fa0-ac4b-5e2317219337 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:05.804181 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2a6d72cc-ada1-4fa0-ac4b-5e2317219337 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:05.804810 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2a6d72cc-ada1-4fa0-ac4b-5e2317219337 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:05.805952 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2a6d72cc-ada1-4fa0-ac4b-5e2317219337 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:05.806649 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2a6d72cc-ada1-4fa0-ac4b-5e2317219337 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:05.807681 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2a6d72cc-ada1-4fa0-ac4b-5e2317219337 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:06.109623 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-cc062c83-a0fc-42fe-86f0-edc77654735e tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Flavor limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:13:06.110256 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-cc062c83-a0fc-42fe-86f0-edc77654735e tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Image limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:13:06.110911 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-cc062c83-a0fc-42fe-86f0-edc77654735e tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Flavor pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:13:06.111534 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-cc062c83-a0fc-42fe-86f0-edc77654735e tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Image pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:13:06.112094 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-cc062c83-a0fc-42fe-86f0-edc77654735e tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:13:06.128720 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cc062c83-a0fc-42fe-86f0-edc77654735e tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:06.129211 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cc062c83-a0fc-42fe-86f0-edc77654735e tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:06.129681 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cc062c83-a0fc-42fe-86f0-edc77654735e tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:06.130408 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cc062c83-a0fc-42fe-86f0-edc77654735e tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:06.130858 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cc062c83-a0fc-42fe-86f0-edc77654735e tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:06.131284 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cc062c83-a0fc-42fe-86f0-edc77654735e tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:06.140980 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-2a6d72cc-ada1-4fa0-ac4b-5e2317219337 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:06.149493 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2a6d72cc-ada1-4fa0-ac4b-5e2317219337 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a" status: 200 len: 1313 microversion: 2.1 time: 0.367520 Oct 19 03:13:06.162259 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-cc062c83-a0fc-42fe-86f0-edc77654735e tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Getting quotas for project 31ead65f008349329789135966c031d0. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:13:06.167008 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-cc062c83-a0fc-42fe-86f0-edc77654735e tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Getting quotas for user 769928c8ecb643fa83a9d58465dcb263 and project 31ead65f008349329789135966c031d0. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:13:06.168743 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 122/244] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:13:05 2022] GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a => generated 1313 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:13:06.180283 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d0b8209a-2e0b-4d78-9c81-3bce5ffb4ab3 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:06.181156 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-cc062c83-a0fc-42fe-86f0-edc77654735e tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Going to run 1 instances... {{(pid=121134) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:13:06.181299 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d0b8209a-2e0b-4d78-9c81-3bce5ffb4ab3 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] [instance: f476cc02-1b56-4c61-93a4-c3d36c38792d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:06.183947 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-cc062c83-a0fc-42fe-86f0-edc77654735e tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] [instance: 6c38df2c-2b90-4a77-b610-8811aa680a81] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:13:06.199555 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d0b8209a-2e0b-4d78-9c81-3bce5ffb4ab3 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:06.200164 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d0b8209a-2e0b-4d78-9c81-3bce5ffb4ab3 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:06.200668 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d0b8209a-2e0b-4d78-9c81-3bce5ffb4ab3 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:06.201593 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d0b8209a-2e0b-4d78-9c81-3bce5ffb4ab3 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:06.202368 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d0b8209a-2e0b-4d78-9c81-3bce5ffb4ab3 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:06.202974 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d0b8209a-2e0b-4d78-9c81-3bce5ffb4ab3 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:06.379200 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d0b8209a-2e0b-4d78-9c81-3bce5ffb4ab3 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cc37ae4bed94a7e85ed70dd5942c2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df99b134b20743eb9b62788706f2705a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:06.388149 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d0b8209a-2e0b-4d78-9c81-3bce5ffb4ab3 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] 10.222.0.52 "GET /compute/v2.1/servers/f476cc02-1b56-4c61-93a4-c3d36c38792d" status: 200 len: 1388 microversion: 2.1 time: 0.217921 Oct 19 03:13:06.392432 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 123/245] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:13:06 2022] GET /compute/v2.1/servers/f476cc02-1b56-4c61-93a4-c3d36c38792d => generated 1388 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:13:06.400547 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-98994dc9-1686-468e-8817-e15f28c91b44 tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:06.423475 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-cc062c83-a0fc-42fe-86f0-edc77654735e tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.909854 Oct 19 03:13:06.424890 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-98994dc9-1686-468e-8817-e15f28c91b44 tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] 10.222.0.52 "GET /compute/v2.1/os-aggregates/9" status: 200 len: 241 microversion: 2.1 time: 0.030101 Oct 19 03:13:06.426388 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 123/246] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:13:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 914 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 19 03:13:06.427908 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 124/247] 10.222.0.52 () {58 vars in 1149 bytes} [Wed Oct 19 03:13:06 2022] GET /compute/v2.1/os-aggregates/9 => generated 241 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:13:06.443862 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-5104b1d6-4f2e-4360-9b2c-644e506905e7 req-ef53c283-ff0c-48a9-a829-58b58895fd83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f476cc02-1b56-4c61-93a4-c3d36c38792d", "tag": "e7234846-076a-4f8d-9318-716ced0a591c"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:13:06.451934 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d5a14a55-6cfe-4910-8df9-a0f13bfaead0 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:06.453481 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d5a14a55-6cfe-4910-8df9-a0f13bfaead0 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] [instance: 6c38df2c-2b90-4a77-b610-8811aa680a81] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:06.454598 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-5104b1d6-4f2e-4360-9b2c-644e506905e7 req-ef53c283-ff0c-48a9-a829-58b58895fd83 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:06.455080 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-5104b1d6-4f2e-4360-9b2c-644e506905e7 req-ef53c283-ff0c-48a9-a829-58b58895fd83 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:06.455510 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-5104b1d6-4f2e-4360-9b2c-644e506905e7 req-ef53c283-ff0c-48a9-a829-58b58895fd83 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:06.491512 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-5104b1d6-4f2e-4360-9b2c-644e506905e7 req-ef53c283-ff0c-48a9-a829-58b58895fd83 service nova] Creating event network-changed:e7234846-076a-4f8d-9318-716ced0a591c for instance f476cc02-1b56-4c61-93a4-c3d36c38792d on n-h1-861333-8 Oct 19 03:13:06.511798 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-5104b1d6-4f2e-4360-9b2c-644e506905e7 req-ef53c283-ff0c-48a9-a829-58b58895fd83 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077393 Oct 19 03:13:06.512404 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 124/248] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:13:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:13:06.531339 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a446c377-ef0a-4abb-9028-9395f8fc3b8c tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-861333-8"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:13:06.557546 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a446c377-ef0a-4abb-9028-9395f8fc3b8c tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:06.558973 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a446c377-ef0a-4abb-9028-9395f8fc3b8c tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:06.558973 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a446c377-ef0a-4abb-9028-9395f8fc3b8c tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:06.566870 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d5a14a55-6cfe-4910-8df9-a0f13bfaead0 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '769928c8ecb643fa83a9d58465dcb263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ead65f008349329789135966c031d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:06.585288 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d5a14a55-6cfe-4910-8df9-a0f13bfaead0 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] 10.222.0.52 "GET /compute/v2.1/servers/6c38df2c-2b90-4a77-b610-8811aa680a81" status: 200 len: 1220 microversion: 2.1 time: 0.139783 Oct 19 03:13:06.605929 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 125/249] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:13:06 2022] GET /compute/v2.1/servers/6c38df2c-2b90-4a77-b610-8811aa680a81 => generated 1220 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:13:06.929592 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a446c377-ef0a-4abb-9028-9395f8fc3b8c tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 226 microversion: 2.1 time: 0.415316 Oct 19 03:13:06.934783 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 125/250] 10.222.0.52 () {60 vars in 1191 bytes} [Wed Oct 19 03:13:06 2022] POST /compute/v2.1/os-aggregates/9/action => generated 226 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:13:06.943860 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ad7ea35c-c9ec-456e-8ce4-751ca042b8d5 tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:07.100744 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ad7ea35c-c9ec-456e-8ce4-751ca042b8d5 tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.161703 Oct 19 03:13:07.107082 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 126/251] 10.222.0.52 () {58 vars in 1152 bytes} [Wed Oct 19 03:13:06 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 19 03:13:07.116924 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d4c89b96-0708-44ca-9761-a95258f4b86c tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-361674839"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:13:07.123451 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.aggregate [None req-d4c89b96-0708-44ca-9761-a95258f4b86c tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] Generated uuid 0194fdf2-a046-402b-aec0-e7258a541182 for aggregate {{(pid=121134) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 19 03:13:07.177613 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2d035f1f-b5da-4551-97b5-dbb73626d6d4 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:07.178237 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-2d035f1f-b5da-4551-97b5-dbb73626d6d4 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 7b4a8cd9-a238-4bff-a002-497dc807bf3a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:07.191953 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2d035f1f-b5da-4551-97b5-dbb73626d6d4 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:07.192440 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2d035f1f-b5da-4551-97b5-dbb73626d6d4 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:07.192872 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2d035f1f-b5da-4551-97b5-dbb73626d6d4 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:07.195189 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2d035f1f-b5da-4551-97b5-dbb73626d6d4 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:07.195827 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2d035f1f-b5da-4551-97b5-dbb73626d6d4 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:07.200967 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2d035f1f-b5da-4551-97b5-dbb73626d6d4 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:07.357007 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d4c89b96-0708-44ca-9761-a95258f4b86c tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.247602 Oct 19 03:13:07.358643 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 126/252] 10.222.0.52 () {60 vars in 1164 bytes} [Wed Oct 19 03:13:07 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:13:07.378068 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e021df8b-438f-4743-8cef-71188efc5a60 tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-861333-8"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:13:07.406212 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e021df8b-438f-4743-8cef-71188efc5a60 tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:07.407045 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e021df8b-438f-4743-8cef-71188efc5a60 tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:07.408924 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e021df8b-438f-4743-8cef-71188efc5a60 tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:07.518484 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-2d035f1f-b5da-4551-97b5-dbb73626d6d4 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:07.539650 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2d035f1f-b5da-4551-97b5-dbb73626d6d4 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a" status: 200 len: 1313 microversion: 2.1 time: 0.365928 Oct 19 03:13:07.540278 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 127/253] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:13:07 2022] GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a => generated 1313 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:13:07.562849 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0546a375-4590-4cca-b67f-31e3cfac86d7 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:07.562849 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0546a375-4590-4cca-b67f-31e3cfac86d7 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] [instance: f476cc02-1b56-4c61-93a4-c3d36c38792d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:07.567977 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0546a375-4590-4cca-b67f-31e3cfac86d7 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:07.568481 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0546a375-4590-4cca-b67f-31e3cfac86d7 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:07.569111 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0546a375-4590-4cca-b67f-31e3cfac86d7 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:07.569905 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0546a375-4590-4cca-b67f-31e3cfac86d7 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:07.570954 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0546a375-4590-4cca-b67f-31e3cfac86d7 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:07.571557 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0546a375-4590-4cca-b67f-31e3cfac86d7 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:07.757031 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e021df8b-438f-4743-8cef-71188efc5a60 tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 242 microversion: 2.1 time: 0.387220 Oct 19 03:13:07.757031 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 127/254] 10.222.0.52 () {60 vars in 1194 bytes} [Wed Oct 19 03:13:07 2022] POST /compute/v2.1/os-aggregates/10/action => generated 242 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:13:07.764311 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-256c9474-2526-4690-b98a-e2a7cbbf760e tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:07.765362 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-256c9474-2526-4690-b98a-e2a7cbbf760e tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] [instance: 6c38df2c-2b90-4a77-b610-8811aa680a81] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:07.771752 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-256c9474-2526-4690-b98a-e2a7cbbf760e tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:07.772800 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-256c9474-2526-4690-b98a-e2a7cbbf760e tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:07.777592 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-256c9474-2526-4690-b98a-e2a7cbbf760e tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:07.779100 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-256c9474-2526-4690-b98a-e2a7cbbf760e tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:07.779633 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-256c9474-2526-4690-b98a-e2a7cbbf760e tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:07.780823 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-256c9474-2526-4690-b98a-e2a7cbbf760e tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:07.866281 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-0546a375-4590-4cca-b67f-31e3cfac86d7 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cc37ae4bed94a7e85ed70dd5942c2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df99b134b20743eb9b62788706f2705a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:07.875758 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0546a375-4590-4cca-b67f-31e3cfac86d7 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] 10.222.0.52 "GET /compute/v2.1/servers/f476cc02-1b56-4c61-93a4-c3d36c38792d" status: 200 len: 1388 microversion: 2.1 time: 0.330564 Oct 19 03:13:07.880378 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 128/255] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:13:07 2022] GET /compute/v2.1/servers/f476cc02-1b56-4c61-93a4-c3d36c38792d => generated 1388 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:13:07.898811 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-616da712-95cc-4c6e-946c-722a29179bfe tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:07.908257 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-256c9474-2526-4690-b98a-e2a7cbbf760e tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '769928c8ecb643fa83a9d58465dcb263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ead65f008349329789135966c031d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:07.917331 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-256c9474-2526-4690-b98a-e2a7cbbf760e tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] 10.222.0.52 "GET /compute/v2.1/servers/6c38df2c-2b90-4a77-b610-8811aa680a81" status: 200 len: 1224 microversion: 2.1 time: 0.160254 Oct 19 03:13:07.918091 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-616da712-95cc-4c6e-946c-722a29179bfe tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] 10.222.0.52 "GET /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.1 time: 0.034299 Oct 19 03:13:07.926222 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 129/256] 10.222.0.52 () {58 vars in 1143 bytes} [Wed Oct 19 03:13:07 2022] GET /compute/v2.1/os-aggregates => generated 245 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:13:07.931361 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f46b4750-1575-434b-83a6-31a87c34e05c tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-861333-8"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:13:07.933915 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 128/257] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:13:07 2022] GET /compute/v2.1/servers/6c38df2c-2b90-4a77-b610-8811aa680a81 => generated 1224 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:13:07.943780 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f46b4750-1575-434b-83a6-31a87c34e05c tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:07.944761 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f46b4750-1575-434b-83a6-31a87c34e05c tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:07.945398 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f46b4750-1575-434b-83a6-31a87c34e05c tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:08.382233 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f46b4750-1575-434b-83a6-31a87c34e05c tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 227 microversion: 2.1 time: 0.454646 Oct 19 03:13:08.382958 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 130/258] 10.222.0.52 () {60 vars in 1194 bytes} [Wed Oct 19 03:13:07 2022] POST /compute/v2.1/os-aggregates/10/action => generated 227 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:13:08.395128 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-140802b6-77a2-4202-a821-5bf9b96467af tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:08.477664 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-140802b6-77a2-4202-a821-5bf9b96467af tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.086078 Oct 19 03:13:08.478323 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 129/259] 10.222.0.52 () {58 vars in 1155 bytes} [Wed Oct 19 03:13:08 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 19 03:13:08.491417 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2a9e716a-1443-4396-8b1f-84008b591fec tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1153610190"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:13:08.495425 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.aggregate [None req-2a9e716a-1443-4396-8b1f-84008b591fec tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] Generated uuid 13ffdb3e-8bfb-4f55-99dd-51b58451acd7 for aggregate {{(pid=121135) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 19 03:13:08.564491 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-86d99ab2-aa4c-4eb3-88f5-63710cd541e7 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:08.565436 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-86d99ab2-aa4c-4eb3-88f5-63710cd541e7 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 7b4a8cd9-a238-4bff-a002-497dc807bf3a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:08.575386 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-86d99ab2-aa4c-4eb3-88f5-63710cd541e7 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:08.575886 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-86d99ab2-aa4c-4eb3-88f5-63710cd541e7 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:08.576320 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-86d99ab2-aa4c-4eb3-88f5-63710cd541e7 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:08.580810 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-86d99ab2-aa4c-4eb3-88f5-63710cd541e7 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:08.581291 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-86d99ab2-aa4c-4eb3-88f5-63710cd541e7 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:08.581767 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-86d99ab2-aa4c-4eb3-88f5-63710cd541e7 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:08.601079 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2a9e716a-1443-4396-8b1f-84008b591fec tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.115385 Oct 19 03:13:08.603078 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 131/260] 10.222.0.52 () {60 vars in 1164 bytes} [Wed Oct 19 03:13:08 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:13:08.622275 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-da378d3f-94c7-4d69-9b00-08e7eac45ffb tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-861333-8"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:13:08.652147 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-da378d3f-94c7-4d69-9b00-08e7eac45ffb tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:08.653077 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-da378d3f-94c7-4d69-9b00-08e7eac45ffb tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:08.659175 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-da378d3f-94c7-4d69-9b00-08e7eac45ffb tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:09.054960 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-da378d3f-94c7-4d69-9b00-08e7eac45ffb tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 243 microversion: 2.1 time: 0.439582 Oct 19 03:13:09.056085 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 132/261] 10.222.0.52 () {60 vars in 1194 bytes} [Wed Oct 19 03:13:08 2022] POST /compute/v2.1/os-aggregates/11/action => generated 243 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:13:09.064928 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-61ea3463-53d6-4041-980c-e3decf828d45 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:09.065883 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-61ea3463-53d6-4041-980c-e3decf828d45 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] [instance: f476cc02-1b56-4c61-93a4-c3d36c38792d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:09.083741 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-61ea3463-53d6-4041-980c-e3decf828d45 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:09.085138 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-61ea3463-53d6-4041-980c-e3decf828d45 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:09.085138 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-61ea3463-53d6-4041-980c-e3decf828d45 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:09.085708 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-61ea3463-53d6-4041-980c-e3decf828d45 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:09.086729 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-61ea3463-53d6-4041-980c-e3decf828d45 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:09.086729 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-61ea3463-53d6-4041-980c-e3decf828d45 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:09.284859 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-86d99ab2-aa4c-4eb3-88f5-63710cd541e7 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:09.293638 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-86d99ab2-aa4c-4eb3-88f5-63710cd541e7 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a" status: 200 len: 1313 microversion: 2.1 time: 0.733530 Oct 19 03:13:09.294224 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 130/262] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:13:08 2022] GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a => generated 1313 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:13:09.302971 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1e7f36fe-ebcf-429e-9fd7-ce0b15569808 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:09.303574 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1e7f36fe-ebcf-429e-9fd7-ce0b15569808 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] [instance: 6c38df2c-2b90-4a77-b610-8811aa680a81] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:09.322955 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1e7f36fe-ebcf-429e-9fd7-ce0b15569808 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:09.323452 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1e7f36fe-ebcf-429e-9fd7-ce0b15569808 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:09.323889 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1e7f36fe-ebcf-429e-9fd7-ce0b15569808 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:09.324603 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1e7f36fe-ebcf-429e-9fd7-ce0b15569808 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:09.325056 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1e7f36fe-ebcf-429e-9fd7-ce0b15569808 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:09.325602 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1e7f36fe-ebcf-429e-9fd7-ce0b15569808 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:09.501540 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-1e7f36fe-ebcf-429e-9fd7-ce0b15569808 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '769928c8ecb643fa83a9d58465dcb263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ead65f008349329789135966c031d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:09.517150 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1e7f36fe-ebcf-429e-9fd7-ce0b15569808 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] 10.222.0.52 "GET /compute/v2.1/servers/6c38df2c-2b90-4a77-b610-8811aa680a81" status: 200 len: 1280 microversion: 2.1 time: 0.221819 Oct 19 03:13:09.517774 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 131/263] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:13:09 2022] GET /compute/v2.1/servers/6c38df2c-2b90-4a77-b610-8811aa680a81 => generated 1280 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:13:09.534093 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-be4e5a7a-300f-4905-8773-53941cef892e tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-861333-8"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:13:09.546041 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-be4e5a7a-300f-4905-8773-53941cef892e tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:09.546925 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-be4e5a7a-300f-4905-8773-53941cef892e tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:09.547827 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-be4e5a7a-300f-4905-8773-53941cef892e tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:09.646504 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-61ea3463-53d6-4041-980c-e3decf828d45 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cc37ae4bed94a7e85ed70dd5942c2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df99b134b20743eb9b62788706f2705a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:09.652147 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=100 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:13:09.659609 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-61ea3463-53d6-4041-980c-e3decf828d45 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] 10.222.0.52 "GET /compute/v2.1/servers/f476cc02-1b56-4c61-93a4-c3d36c38792d" status: 200 len: 1388 microversion: 2.1 time: 0.602095 Oct 19 03:13:09.660776 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 133/264] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:13:09 2022] GET /compute/v2.1/servers/f476cc02-1b56-4c61-93a4-c3d36c38792d => generated 1388 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:13:09.878194 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-be4e5a7a-300f-4905-8773-53941cef892e tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 228 microversion: 2.1 time: 0.357249 Oct 19 03:13:09.879230 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 132/265] 10.222.0.52 () {60 vars in 1194 bytes} [Wed Oct 19 03:13:09 2022] POST /compute/v2.1/os-aggregates/11/action => generated 228 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:13:09.893400 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6ac744ce-7ed3-461a-9c00-85c8ebc1505c tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:09.952326 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6ac744ce-7ed3-461a-9c00-85c8ebc1505c tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.063791 Oct 19 03:13:09.953486 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 134/266] 10.222.0.52 () {58 vars in 1155 bytes} [Wed Oct 19 03:13:09 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 19 03:13:09.964852 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6572704a-0094-41fb-9ab9-46d5b22cb28f tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1954468194"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:13:09.969199 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.aggregate [None req-6572704a-0094-41fb-9ab9-46d5b22cb28f tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] Generated uuid 8b30f998-a17a-4449-887d-ca4fa80bc203 for aggregate {{(pid=121134) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 19 03:13:09.985138 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-37f71f7b-4d3a-415a-a5d5-558ef2753b98 tempest-HostsAdminTestJSON-185870490 tempest-HostsAdminTestJSON-185870490-project-admin] Calling method '.version_select at 0x7fc1316c9dc0>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:09.989595 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-37f71f7b-4d3a-415a-a5d5-558ef2753b98 tempest-HostsAdminTestJSON-185870490 tempest-HostsAdminTestJSON-185870490-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:09.990094 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-37f71f7b-4d3a-415a-a5d5-558ef2753b98 tempest-HostsAdminTestJSON-185870490 tempest-HostsAdminTestJSON-185870490-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:09.990660 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-37f71f7b-4d3a-415a-a5d5-558ef2753b98 tempest-HostsAdminTestJSON-185870490 tempest-HostsAdminTestJSON-185870490-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:09.991568 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-37f71f7b-4d3a-415a-a5d5-558ef2753b98 tempest-HostsAdminTestJSON-185870490 tempest-HostsAdminTestJSON-185870490-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:09.992314 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-37f71f7b-4d3a-415a-a5d5-558ef2753b98 tempest-HostsAdminTestJSON-185870490 tempest-HostsAdminTestJSON-185870490-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:09.993061 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-37f71f7b-4d3a-415a-a5d5-558ef2753b98 tempest-HostsAdminTestJSON-185870490 tempest-HostsAdminTestJSON-185870490-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:10.028845 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-37f71f7b-4d3a-415a-a5d5-558ef2753b98 tempest-HostsAdminTestJSON-185870490 tempest-HostsAdminTestJSON-185870490-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.048628 Oct 19 03:13:10.032176 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 135/267] 10.222.0.52 () {58 vars in 1128 bytes} [Wed Oct 19 03:13:09 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:13:10.042928 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3cedcaae-1369-4fa7-b8c4-8a3e60f05ce8 tempest-HostsAdminTestJSON-185870490 tempest-HostsAdminTestJSON-185870490-project-admin] Calling method '.version_select at 0x7fc131979310>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:10.046494 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3cedcaae-1369-4fa7-b8c4-8a3e60f05ce8 tempest-HostsAdminTestJSON-185870490 tempest-HostsAdminTestJSON-185870490-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:10.047188 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3cedcaae-1369-4fa7-b8c4-8a3e60f05ce8 tempest-HostsAdminTestJSON-185870490 tempest-HostsAdminTestJSON-185870490-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:10.047796 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3cedcaae-1369-4fa7-b8c4-8a3e60f05ce8 tempest-HostsAdminTestJSON-185870490 tempest-HostsAdminTestJSON-185870490-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:10.048679 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3cedcaae-1369-4fa7-b8c4-8a3e60f05ce8 tempest-HostsAdminTestJSON-185870490 tempest-HostsAdminTestJSON-185870490-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:10.049144 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3cedcaae-1369-4fa7-b8c4-8a3e60f05ce8 tempest-HostsAdminTestJSON-185870490 tempest-HostsAdminTestJSON-185870490-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:10.049614 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3cedcaae-1369-4fa7-b8c4-8a3e60f05ce8 tempest-HostsAdminTestJSON-185870490 tempest-HostsAdminTestJSON-185870490-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:10.069967 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6572704a-0094-41fb-9ab9-46d5b22cb28f tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.110899 Oct 19 03:13:10.080413 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 133/268] 10.222.0.52 () {60 vars in 1164 bytes} [Wed Oct 19 03:13:09 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:13:10.087134 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-3cedcaae-1369-4fa7-b8c4-8a3e60f05ce8 tempest-HostsAdminTestJSON-185870490 tempest-HostsAdminTestJSON-185870490-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 236 microversion: 2.1 time: 0.047627 Oct 19 03:13:10.088107 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 136/269] 10.222.0.52 () {58 vars in 1155 bytes} [Wed Oct 19 03:13:10 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 236 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:13:10.094621 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-61b50b17-b375-4097-97ca-9af72af2986e tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:10.163546 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-61b50b17-b375-4097-97ca-9af72af2986e tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.073186 Oct 19 03:13:10.165058 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 137/270] 10.222.0.52 () {58 vars in 1155 bytes} [Wed Oct 19 03:13:10 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 19 03:13:10.171467 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-26a97853-e7fd-42ce-b639-9b1a70bec827 tempest-HostsAdminTestJSON-185870490 tempest-HostsAdminTestJSON-185870490-project-admin] Calling method '.version_select at 0x7fc131979280>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:10.181428 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-26a97853-e7fd-42ce-b639-9b1a70bec827 tempest-HostsAdminTestJSON-185870490 tempest-HostsAdminTestJSON-185870490-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:10.181428 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-26a97853-e7fd-42ce-b639-9b1a70bec827 tempest-HostsAdminTestJSON-185870490 tempest-HostsAdminTestJSON-185870490-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:10.181428 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-26a97853-e7fd-42ce-b639-9b1a70bec827 tempest-HostsAdminTestJSON-185870490 tempest-HostsAdminTestJSON-185870490-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:10.181428 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-26a97853-e7fd-42ce-b639-9b1a70bec827 tempest-HostsAdminTestJSON-185870490 tempest-HostsAdminTestJSON-185870490-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:10.181860 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-26a97853-e7fd-42ce-b639-9b1a70bec827 tempest-HostsAdminTestJSON-185870490 tempest-HostsAdminTestJSON-185870490-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:10.181860 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-26a97853-e7fd-42ce-b639-9b1a70bec827 tempest-HostsAdminTestJSON-185870490 tempest-HostsAdminTestJSON-185870490-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:10.231916 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-26a97853-e7fd-42ce-b639-9b1a70bec827 tempest-HostsAdminTestJSON-185870490 tempest-HostsAdminTestJSON-185870490-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.064797 Oct 19 03:13:10.232876 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 138/271] 10.222.0.52 () {58 vars in 1128 bytes} [Wed Oct 19 03:13:10 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:13:10.238538 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a690a44b-d437-4f46-be5c-b616fc800a38 tempest-FlavorsV255TestJSON-139852347 tempest-FlavorsV255TestJSON-139852347-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-1246648808", "id": 68122436, "os-flavor-access:is_public": "True"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:13:10.239279 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1c44f63b-31dd-421a-9672-9c070ba4569c tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-687568916"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:13:10.242801 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.aggregate [None req-1c44f63b-31dd-421a-9672-9c070ba4569c tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] Generated uuid b7ab0bbc-a166-4778-99bd-5a3157095583 for aggregate {{(pid=121135) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 19 03:13:10.404652 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1c44f63b-31dd-421a-9672-9c070ba4569c tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.169546 Oct 19 03:13:10.406519 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 139/272] 10.222.0.52 () {60 vars in 1164 bytes} [Wed Oct 19 03:13:10 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:13:10.416680 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a690a44b-d437-4f46-be5c-b616fc800a38 tempest-FlavorsV255TestJSON-139852347 tempest-FlavorsV255TestJSON-139852347-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 443 microversion: 2.55 time: 0.334858 Oct 19 03:13:10.420242 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 134/273] 10.222.0.52 () {62 vars in 1188 bytes} [Wed Oct 19 03:13:10 2022] POST /compute/v2.1/flavors => generated 443 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 03:13:10.429426 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3943cbf2-c625-4482-9d54-67b21e69e5cc tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:10.441920 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a9a10488-8c35-4e51-846d-3d1b0374ae66 tempest-HostsAdminTestJSON-185870490 tempest-HostsAdminTestJSON-185870490-project-admin] Calling method '.version_select at 0x7fc1317988b0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:10.450108 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-3943cbf2-c625-4482-9d54-67b21e69e5cc tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] HTTP exception thrown: Aggregate 12 could not be found. Oct 19 03:13:10.455306 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3943cbf2-c625-4482-9d54-67b21e69e5cc tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] Request method failure captured: Oct 19 03:13:10.455306 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/os-aggregates/12 HTTP/1.1 Oct 19 03:13:10.455306 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:13:10.455306 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:13:10.455306 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:13:10.455306 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:13:10.455306 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:13:10.455306 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:13:10.455306 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:13:10.455306 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:13:10.455306 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2sSZNPVF3T8umDX_CSgeB1Zpf9NjCf1xvhaic9ljhPn49OJHNUey5PxJQsLf97cWLeSbff__tI_xtLPbjjVdj1hehSyo8a06h8fqPsGUNBRRKgOupwv4xAiCKQGxvjFEllZMSGqeofk5D1zPmkDzCzhx2kJtIvYfHmLgUk-kwaMqec Oct 19 03:13:10.455306 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:13:10.455306 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:13:10.455306 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:13:10.455306 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:13:10.455306 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:13:10.455306 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:13:10.455306 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 5cb745d432f8475095e5fd1ab901ae2c Oct 19 03:13:10.455306 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-AggregatesAdminTestJSON-1419667209 Oct 19 03:13:10.455306 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member,admin Oct 19 03:13:10.455306 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member,admin Oct 19 03:13:10.468867 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5cb745d432f8475095e5fd1ab901ae2c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5cb745d432f8475095e5fd1ab901ae2c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5cb745d432f8475095e5fd1ab901ae2c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5cb745d432f8475095e5fd1ab901ae2c", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:13:10.468867 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-AggregatesAdminTestJSON-1419667209 Oct 19 03:13:10.468867 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 5cb745d432f8475095e5fd1ab901ae2c Oct 19 03:13:10.468867 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1419667209 Oct 19 03:13:10.468867 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-AggregatesAdminTestJSON-1419667209-project-admin Oct 19 03:13:10.468867 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:13:10.468867 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:13:10.468867 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: b319d0fbf3ca42e2856c09af0ffbd31a Oct 19 03:13:10.468867 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-AggregatesAdminTestJSON-1419667209-project-admin Oct 19 03:13:10.468867 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:13:10.468867 n-d-861333-8 devstack@n-api.service[121135]: exception: Aggregate 12 could not be found. Oct 19 03:13:10.468867 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '12'} Oct 19 03:13:10.468867 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:13:10.470577 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:10.470577 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 19 03:13:10.470577 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 19 03:13:10.470577 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 19 03:13:10.470577 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 19 03:13:10.470577 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 03:13:10.470577 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 03:13:10.470577 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 19 03:13:10.470577 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 19 03:13:10.470577 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 19 03:13:10.470577 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 19 03:13:10.470577 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 19 03:13:10.470577 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 19 03:13:10.470577 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 12 could not be found. Oct 19 03:13:10.470577 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:10.470577 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:13:10.470577 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:10.470577 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:10.470577 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:13:10.472627 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:13:10.472627 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:13:10.472627 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:13:10.472627 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:13:10.472627 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:13:10.472627 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 19 03:13:10.472627 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:13:10.472627 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 12 could not be found. Oct 19 03:13:10.472627 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:10.472627 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:13:10.472627 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:10.472627 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:10.472627 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:13:10.472627 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:13:10.472627 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:13:10.472627 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:13:10.472627 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 12 could not be found. Oct 19 03:13:10.472627 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:10.481944 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3943cbf2-c625-4482-9d54-67b21e69e5cc tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] Returning 404 to user: Aggregate 12 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:13:10.481944 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-3943cbf2-c625-4482-9d54-67b21e69e5cc tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] 10.222.0.52 "GET /compute/v2.1/os-aggregates/12" status: 404 len: 78 microversion: 2.1 time: 0.050067 Oct 19 03:13:10.481944 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 140/274] 10.222.0.52 () {58 vars in 1152 bytes} [Wed Oct 19 03:13:10 2022] GET /compute/v2.1/os-aggregates/12 => generated 78 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 03:13:10.481944 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5c3c9e87-328c-4c27-af0e-429d53f8edcc tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:10.481944 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-5c3c9e87-328c-4c27-af0e-429d53f8edcc tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 7b4a8cd9-a238-4bff-a002-497dc807bf3a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:10.486960 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a9a10488-8c35-4e51-846d-3d1b0374ae66 tempest-HostsAdminTestJSON-185870490 tempest-HostsAdminTestJSON-185870490-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:10.490347 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a9a10488-8c35-4e51-846d-3d1b0374ae66 tempest-HostsAdminTestJSON-185870490 tempest-HostsAdminTestJSON-185870490-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:10.493449 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a9a10488-8c35-4e51-846d-3d1b0374ae66 tempest-HostsAdminTestJSON-185870490 tempest-HostsAdminTestJSON-185870490-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:10.494105 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5c3c9e87-328c-4c27-af0e-429d53f8edcc tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:10.494810 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5c3c9e87-328c-4c27-af0e-429d53f8edcc tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:10.495270 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5c3c9e87-328c-4c27-af0e-429d53f8edcc tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:10.496776 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5c3c9e87-328c-4c27-af0e-429d53f8edcc tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:10.500851 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5c3c9e87-328c-4c27-af0e-429d53f8edcc tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:10.501308 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5c3c9e87-328c-4c27-af0e-429d53f8edcc tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:10.530520 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a9a10488-8c35-4e51-846d-3d1b0374ae66 tempest-HostsAdminTestJSON-185870490 tempest-HostsAdminTestJSON-185870490-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:10.530520 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a9a10488-8c35-4e51-846d-3d1b0374ae66 tempest-HostsAdminTestJSON-185870490 tempest-HostsAdminTestJSON-185870490-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:10.530520 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a9a10488-8c35-4e51-846d-3d1b0374ae66 tempest-HostsAdminTestJSON-185870490 tempest-HostsAdminTestJSON-185870490-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:10.574430 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a9a10488-8c35-4e51-846d-3d1b0374ae66 tempest-HostsAdminTestJSON-185870490 tempest-HostsAdminTestJSON-185870490-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hosts/n-h2-861333-8" status: 200 len: 467 microversion: 2.1 time: 0.143343 Oct 19 03:13:10.575476 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 135/275] 10.222.0.52 () {58 vars in 1170 bytes} [Wed Oct 19 03:13:10 2022] GET /compute/v2.1/os-hosts/n-h2-861333-8 => generated 467 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:13:10.582853 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c8ee7a98-397e-4738-8046-e18cfc9caac9 tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-861333-8"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:13:10.595734 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c8ee7a98-397e-4738-8046-e18cfc9caac9 tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:10.596374 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c8ee7a98-397e-4738-8046-e18cfc9caac9 tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:10.596969 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c8ee7a98-397e-4738-8046-e18cfc9caac9 tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:10.909248 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-5c3c9e87-328c-4c27-af0e-429d53f8edcc tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:10.923007 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5c3c9e87-328c-4c27-af0e-429d53f8edcc tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a" status: 200 len: 1313 microversion: 2.1 time: 0.461277 Oct 19 03:13:10.923670 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 141/276] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:13:10 2022] GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a => generated 1313 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:13:11.063519 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c8ee7a98-397e-4738-8046-e18cfc9caac9 tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 242 microversion: 2.1 time: 0.484476 Oct 19 03:13:11.064814 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 136/277] 10.222.0.52 () {60 vars in 1194 bytes} [Wed Oct 19 03:13:10 2022] POST /compute/v2.1/os-aggregates/13/action => generated 242 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:13:11.073692 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b7ae1292-4568-48aa-97d4-6c09d7986520 tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:11.109398 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-b7ae1292-4568-48aa-97d4-6c09d7986520 tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] HTTP exception thrown: Aggregate 12 could not be found. Oct 19 03:13:11.113174 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b7ae1292-4568-48aa-97d4-6c09d7986520 tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] Request method failure captured: Oct 19 03:13:11.113174 n-d-861333-8 devstack@n-api.service[121134]: request: DELETE /compute/v2.1/os-aggregates/12 HTTP/1.1 Oct 19 03:13:11.113174 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:13:11.113174 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:13:11.113174 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:13:11.113174 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:13:11.113174 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:13:11.113174 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:13:11.113174 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:13:11.113174 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:13:11.113174 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT2sSZNPVF3T8umDX_CSgeB1Zpf9NjCf1xvhaic9ljhPn49OJHNUey5PxJQsLf97cWLeSbff__tI_xtLPbjjVdj1hehSyo8a06h8fqPsGUNBRRKgOupwv4xAiCKQGxvjFEllZMSGqeofk5D1zPmkDzCzhx2kJtIvYfHmLgUk-kwaMqec Oct 19 03:13:11.113174 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:13:11.113174 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:13:11.113174 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:13:11.113174 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:13:11.113174 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:13:11.113174 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:13:11.113174 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 5cb745d432f8475095e5fd1ab901ae2c Oct 19 03:13:11.113174 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-AggregatesAdminTestJSON-1419667209 Oct 19 03:13:11.113174 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member,admin Oct 19 03:13:11.113174 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member,admin Oct 19 03:13:11.119971 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5cb745d432f8475095e5fd1ab901ae2c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5cb745d432f8475095e5fd1ab901ae2c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5cb745d432f8475095e5fd1ab901ae2c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5cb745d432f8475095e5fd1ab901ae2c", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:13:11.119971 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-AggregatesAdminTestJSON-1419667209 Oct 19 03:13:11.119971 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 5cb745d432f8475095e5fd1ab901ae2c Oct 19 03:13:11.119971 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1419667209 Oct 19 03:13:11.119971 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-AggregatesAdminTestJSON-1419667209-project-admin Oct 19 03:13:11.119971 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:13:11.119971 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:13:11.119971 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: b319d0fbf3ca42e2856c09af0ffbd31a Oct 19 03:13:11.119971 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-AggregatesAdminTestJSON-1419667209-project-admin Oct 19 03:13:11.119971 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:13:11.119971 n-d-861333-8 devstack@n-api.service[121134]: exception: Aggregate 12 could not be found. Oct 19 03:13:11.119971 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '12'} Oct 19 03:13:11.119971 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:13:11.120716 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:11.120716 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 19 03:13:11.120716 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 19 03:13:11.120716 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 19 03:13:11.120716 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 19 03:13:11.120716 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 03:13:11.120716 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 03:13:11.120716 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 03:13:11.120716 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 03:13:11.120716 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 19 03:13:11.120716 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 19 03:13:11.120716 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 19 03:13:11.120716 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 19 03:13:11.120716 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 03:13:11.120716 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 03:13:11.120716 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 19 03:13:11.120716 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 19 03:13:11.120716 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 19 03:13:11.120716 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 19 03:13:11.121843 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 19 03:13:11.121843 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 19 03:13:11.121843 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 12 could not be found. Oct 19 03:13:11.121843 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:13:11.121843 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:13:11.121843 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:13:11.121843 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:11.121843 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:13:11.121843 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:13:11.121843 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:13:11.121843 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:13:11.121843 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:13:11.121843 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:13:11.121843 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 19 03:13:11.121843 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:13:11.121843 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 12 could not be found. Oct 19 03:13:11.121843 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:13:11.121843 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:13:11.121843 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:13:11.121843 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:11.121843 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:13:11.123022 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:13:11.123022 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:13:11.123022 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:13:11.123022 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 12 could not be found. Oct 19 03:13:11.123022 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:13:11.123022 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b7ae1292-4568-48aa-97d4-6c09d7986520 tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] Returning 404 to user: Aggregate 12 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:13:11.123022 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b7ae1292-4568-48aa-97d4-6c09d7986520 tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/12" status: 404 len: 78 microversion: 2.1 time: 0.048946 Oct 19 03:13:11.123022 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 137/278] 10.222.0.52 () {58 vars in 1155 bytes} [Wed Oct 19 03:13:11 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 78 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 03:13:11.140523 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3acc63a4-028f-4ed7-8755-5c086c29f4a0 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:11.141493 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3acc63a4-028f-4ed7-8755-5c086c29f4a0 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] [instance: 6c38df2c-2b90-4a77-b610-8811aa680a81] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:11.164880 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3acc63a4-028f-4ed7-8755-5c086c29f4a0 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:11.167564 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3acc63a4-028f-4ed7-8755-5c086c29f4a0 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:11.168400 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3acc63a4-028f-4ed7-8755-5c086c29f4a0 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:11.172547 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3acc63a4-028f-4ed7-8755-5c086c29f4a0 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:11.174060 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3acc63a4-028f-4ed7-8755-5c086c29f4a0 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:11.182224 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-293e3678-8748-490f-b15c-8ac82d635b7e tempest-FlavorsV255TestJSON-319703241 tempest-FlavorsV255TestJSON-319703241-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:11.188916 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3acc63a4-028f-4ed7-8755-5c086c29f4a0 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:11.196970 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-293e3678-8748-490f-b15c-8ac82d635b7e tempest-FlavorsV255TestJSON-319703241 tempest-FlavorsV255TestJSON-319703241-project] 10.222.0.52 "GET /compute/v2.1/flavors/68122436" status: 200 len: 443 microversion: 2.55 time: 0.272209 Oct 19 03:13:11.200358 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 142/279] 10.222.0.52 () {60 vars in 1193 bytes} [Wed Oct 19 03:13:10 2022] GET /compute/v2.1/flavors/68122436 => generated 443 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 03:13:11.210434 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-8d8bc3cd-8465-4487-b7c0-52722a64b85c tempest-HostsAdminTestJSON-185870490 tempest-HostsAdminTestJSON-185870490-project-admin] Calling method '.version_select at 0x7fc131b39550>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:11.230420 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8d8bc3cd-8465-4487-b7c0-52722a64b85c tempest-HostsAdminTestJSON-185870490 tempest-HostsAdminTestJSON-185870490-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:11.231018 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8d8bc3cd-8465-4487-b7c0-52722a64b85c tempest-HostsAdminTestJSON-185870490 tempest-HostsAdminTestJSON-185870490-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:11.231576 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8d8bc3cd-8465-4487-b7c0-52722a64b85c tempest-HostsAdminTestJSON-185870490 tempest-HostsAdminTestJSON-185870490-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:11.259266 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=9,nova_api:INSERT=4 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:13:11.263325 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8d8bc3cd-8465-4487-b7c0-52722a64b85c tempest-HostsAdminTestJSON-185870490 tempest-HostsAdminTestJSON-185870490-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:11.263985 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8d8bc3cd-8465-4487-b7c0-52722a64b85c tempest-HostsAdminTestJSON-185870490 tempest-HostsAdminTestJSON-185870490-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:11.264528 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8d8bc3cd-8465-4487-b7c0-52722a64b85c tempest-HostsAdminTestJSON-185870490 tempest-HostsAdminTestJSON-185870490-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:11.293033 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-8d8bc3cd-8465-4487-b7c0-52722a64b85c tempest-HostsAdminTestJSON-185870490 tempest-HostsAdminTestJSON-185870490-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hosts/n-h1-861333-8" status: 200 len: 598 microversion: 2.1 time: 0.090393 Oct 19 03:13:11.294655 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 143/280] 10.222.0.52 () {58 vars in 1170 bytes} [Wed Oct 19 03:13:11 2022] GET /compute/v2.1/os-hosts/n-h1-861333-8 => generated 598 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:13:11.300363 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f0bbeb5f-f8bf-4a94-a7cb-28adc773e83f tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:11.301640 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f0bbeb5f-f8bf-4a94-a7cb-28adc773e83f tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] [instance: f476cc02-1b56-4c61-93a4-c3d36c38792d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:11.309420 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f0bbeb5f-f8bf-4a94-a7cb-28adc773e83f tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:11.310256 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f0bbeb5f-f8bf-4a94-a7cb-28adc773e83f tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:11.310793 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f0bbeb5f-f8bf-4a94-a7cb-28adc773e83f tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:11.312416 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f0bbeb5f-f8bf-4a94-a7cb-28adc773e83f tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:11.313058 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f0bbeb5f-f8bf-4a94-a7cb-28adc773e83f tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:11.313548 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f0bbeb5f-f8bf-4a94-a7cb-28adc773e83f tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:11.847638 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f0bbeb5f-f8bf-4a94-a7cb-28adc773e83f tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cc37ae4bed94a7e85ed70dd5942c2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df99b134b20743eb9b62788706f2705a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:11.860233 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-3acc63a4-028f-4ed7-8755-5c086c29f4a0 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '769928c8ecb643fa83a9d58465dcb263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ead65f008349329789135966c031d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:11.881487 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f0bbeb5f-f8bf-4a94-a7cb-28adc773e83f tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] 10.222.0.52 "GET /compute/v2.1/servers/f476cc02-1b56-4c61-93a4-c3d36c38792d" status: 200 len: 1388 microversion: 2.1 time: 0.582295 Oct 19 03:13:11.882138 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3acc63a4-028f-4ed7-8755-5c086c29f4a0 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] 10.222.0.52 "GET /compute/v2.1/servers/6c38df2c-2b90-4a77-b610-8811aa680a81" status: 200 len: 1320 microversion: 2.1 time: 0.760643 Oct 19 03:13:11.883517 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 144/281] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:13:11 2022] GET /compute/v2.1/servers/f476cc02-1b56-4c61-93a4-c3d36c38792d => generated 1388 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:13:11.886647 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 138/282] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:13:11 2022] GET /compute/v2.1/servers/6c38df2c-2b90-4a77-b610-8811aa680a81 => generated 1320 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:13:11.909457 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-6ca76b84-3f8d-4a94-8847-ad4ca01e55ca req-c63b2740-83a1-47a6-839e-69e7b67a132c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b4a8cd9-a238-4bff-a002-497dc807bf3a", "name": "network-vif-plugged", "status": "completed", "tag": "f0926ecc-fbd5-457e-bf81-de5bfd5b6a96"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:13:11.914296 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-276a7d70-6570-4423-8c0a-388c6eea202d tempest-AggregatesAdminNegativeTestJSON-1649350433 tempest-AggregatesAdminNegativeTestJSON-1649350433-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-861333-8"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:13:11.928233 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-276a7d70-6570-4423-8c0a-388c6eea202d tempest-AggregatesAdminNegativeTestJSON-1649350433 tempest-AggregatesAdminNegativeTestJSON-1649350433-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': 'b09e6864e9c04d6aaa1d4d210733c3d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f400c62b5a9417b8d0c10047a9e43b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:11.934034 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-276a7d70-6570-4423-8c0a-388c6eea202d tempest-AggregatesAdminNegativeTestJSON-1649350433 tempest-AggregatesAdminNegativeTestJSON-1649350433-project] Request method failure captured: Oct 19 03:13:11.934034 n-d-861333-8 devstack@n-api.service[121134]: request: POST /compute/v2.1/os-aggregates/13/action HTTP/1.1 Oct 19 03:13:11.934034 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:13:11.934034 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:13:11.934034 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:13:11.934034 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 42 Oct 19 03:13:11.934034 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:13:11.934034 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:13:11.934034 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:13:11.934034 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:13:11.934034 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT2sPwoyuBijUT-jxC0uUUPhVqAwh9DMb8Lx224kKtLAN9vAmcN-d1fZoJb-X6cckijL8297lUWtY71vdBMRABXjXHfUvR_YrhylxKEFRY_Xt_oUCBt65EYiqUhOD7HwX9hSHq-gf5YDnqleXRvIZbTZmK-cAziyRBTBPDAmEwyrHgUY Oct 19 03:13:11.934034 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:13:11.934034 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:13:11.934034 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:13:11.934034 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:13:11.934034 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:13:11.934034 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:13:11.934034 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 4f400c62b5a9417b8d0c10047a9e43b6 Oct 19 03:13:11.934034 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1649350433 Oct 19 03:13:11.934034 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:13:11.934034 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:13:11.935373 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4f400c62b5a9417b8d0c10047a9e43b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4f400c62b5a9417b8d0c10047a9e43b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4f400c62b5a9417b8d0c10047a9e43b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4f400c62b5a9417b8d0c10047a9e43b6", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:13:11.935373 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1649350433 Oct 19 03:13:11.935373 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 4f400c62b5a9417b8d0c10047a9e43b6 Oct 19 03:13:11.935373 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1649350433 Oct 19 03:13:11.935373 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-AggregatesAdminNegativeTestJSON-1649350433-project Oct 19 03:13:11.935373 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:13:11.935373 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:13:11.935373 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: b09e6864e9c04d6aaa1d4d210733c3d8 Oct 19 03:13:11.935373 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1649350433-project Oct 19 03:13:11.935373 n-d-861333-8 devstack@n-api.service[121134]: Oct 19 03:13:11.935373 n-d-861333-8 devstack@n-api.service[121134]: {"remove_host": {"host": "n-h2-861333-8"}} Oct 19 03:13:11.935373 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:13:11.935373 n-d-861333-8 devstack@n-api.service[121134]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 19 03:13:11.936197 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '13', 'body': {'remove_host': {'host': 'n-h2-861333-8'}}} Oct 19 03:13:11.936197 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:13:11.936197 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:11.936197 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:13:11.936197 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:13:11.936197 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:13:11.936197 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:13:11.936197 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:13:11.936197 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:13:11.936197 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:13:11.936197 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:13:11.936197 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Oct 19 03:13:11.936197 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Oct 19 03:13:11.936197 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 19 03:13:11.936197 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 19 03:13:11.936197 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 19 03:13:11.936197 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 19 03:13:11.936197 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 03:13:11.936197 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 03:13:11.937303 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 03:13:11.937303 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 03:13:11.937303 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 19 03:13:11.937303 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 19 03:13:11.937303 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 19 03:13:11.937303 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 19 03:13:11.937303 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 19 03:13:11.937303 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 19 03:13:11.937303 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 19 03:13:11.937303 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:13:11.937303 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:13:11.937303 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:13:11.937303 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:11.937303 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:13:11.937303 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:13:11.937303 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 19 03:13:11.937303 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 19 03:13:11.937303 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 19 03:13:11.937303 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:13:11.945959 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-276a7d70-6570-4423-8c0a-388c6eea202d tempest-AggregatesAdminNegativeTestJSON-1649350433 tempest-AggregatesAdminNegativeTestJSON-1649350433-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:13:11.945959 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-276a7d70-6570-4423-8c0a-388c6eea202d tempest-AggregatesAdminNegativeTestJSON-1649350433 tempest-AggregatesAdminNegativeTestJSON-1649350433-project] 10.222.0.52 "POST /compute/v2.1/os-aggregates/13/action" status: 403 len: 121 microversion: 2.1 time: 0.052113 Oct 19 03:13:11.947631 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 139/283] 10.222.0.52 () {60 vars in 1194 bytes} [Wed Oct 19 03:13:11 2022] POST /compute/v2.1/os-aggregates/13/action => generated 121 bytes in 60 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:13:11.956746 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-6ca76b84-3f8d-4a94-8847-ad4ca01e55ca req-c63b2740-83a1-47a6-839e-69e7b67a132c service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:11.957634 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-6ca76b84-3f8d-4a94-8847-ad4ca01e55ca req-c63b2740-83a1-47a6-839e-69e7b67a132c service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:11.958325 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-6ca76b84-3f8d-4a94-8847-ad4ca01e55ca req-c63b2740-83a1-47a6-839e-69e7b67a132c service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:11.966433 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8a0147d3-099c-4c9a-a3cc-2205ed18477e tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1657514858", "name": "tempest-test_aggregate-362789336"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:13:11.973746 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-6ca76b84-3f8d-4a94-8847-ad4ca01e55ca req-c63b2740-83a1-47a6-839e-69e7b67a132c service nova] Creating event network-vif-plugged:f0926ecc-fbd5-457e-bf81-de5bfd5b6a96 for instance 7b4a8cd9-a238-4bff-a002-497dc807bf3a on n-h1-861333-8 Oct 19 03:13:11.980805 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-6ca76b84-3f8d-4a94-8847-ad4ca01e55ca req-c63b2740-83a1-47a6-839e-69e7b67a132c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092184 Oct 19 03:13:11.982084 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 145/284] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:13:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:13:11.988491 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.aggregate [None req-8a0147d3-099c-4c9a-a3cc-2205ed18477e tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] Generated uuid 05b7f2f1-c308-4e46-968d-92a482a52604 for aggregate {{(pid=121134) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 19 03:13:11.990779 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-12028ba7-9714-4aa1-b3e8-bd40054ee8ce tempest-FlavorsV255TestJSON-139852347 tempest-FlavorsV255TestJSON-139852347-project-admin] Action: 'update', calling method: .version_select at 0x7fc132c33d30>, body: {"flavor": {"description": "new"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:13:12.116398 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8a0147d3-099c-4c9a-a3cc-2205ed18477e tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.165936 Oct 19 03:13:12.117135 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 140/285] 10.222.0.52 () {60 vars in 1165 bytes} [Wed Oct 19 03:13:11 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:13:12.130034 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-bf175392-e0eb-4558-8bd1-7e3b834a8dfe tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:12.130648 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-bf175392-e0eb-4558-8bd1-7e3b834a8dfe tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 7b4a8cd9-a238-4bff-a002-497dc807bf3a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:12.148536 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-12028ba7-9714-4aa1-b3e8-bd40054ee8ce tempest-FlavorsV255TestJSON-139852347 tempest-FlavorsV255TestJSON-139852347-project-admin] 10.222.0.52 "PUT /compute/v2.1/flavors/68122436" status: 200 len: 444 microversion: 2.55 time: 0.162624 Oct 19 03:13:12.149132 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 146/286] 10.222.0.52 () {62 vars in 1213 bytes} [Wed Oct 19 03:13:11 2022] PUT /compute/v2.1/flavors/68122436 => generated 444 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 03:13:12.157624 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-768ab38a-6869-4414-b0ec-1cdc6ac4e719 tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-861333-8"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:13:12.161124 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bf175392-e0eb-4558-8bd1-7e3b834a8dfe tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:12.161605 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bf175392-e0eb-4558-8bd1-7e3b834a8dfe tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:12.172012 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bf175392-e0eb-4558-8bd1-7e3b834a8dfe tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:12.173259 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bf175392-e0eb-4558-8bd1-7e3b834a8dfe tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:12.173899 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bf175392-e0eb-4558-8bd1-7e3b834a8dfe tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:12.175250 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bf175392-e0eb-4558-8bd1-7e3b834a8dfe tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:12.206503 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-768ab38a-6869-4414-b0ec-1cdc6ac4e719 tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:12.207005 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-768ab38a-6869-4414-b0ec-1cdc6ac4e719 tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:12.207446 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-768ab38a-6869-4414-b0ec-1cdc6ac4e719 tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:12.535761 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-768ab38a-6869-4414-b0ec-1cdc6ac4e719 tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 227 microversion: 2.1 time: 0.385341 Oct 19 03:13:12.541056 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 147/287] 10.222.0.52 () {60 vars in 1194 bytes} [Wed Oct 19 03:13:12 2022] POST /compute/v2.1/os-aggregates/13/action => generated 227 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:13:12.549282 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d4c6bd6a-690c-4c5c-934b-ec4631bc0b8e tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:12.643625 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d4c6bd6a-690c-4c5c-934b-ec4631bc0b8e tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.099356 Oct 19 03:13:12.644673 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-bf175392-e0eb-4558-8bd1-7e3b834a8dfe tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:12.647042 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 148/288] 10.222.0.52 () {58 vars in 1155 bytes} [Wed Oct 19 03:13:12 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 19 03:13:12.651295 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c0127250-9e95-43d9-85a2-4463c1cbdf7a tempest-FlavorsV255TestJSON-319703241 tempest-FlavorsV255TestJSON-319703241-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:12.652622 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-bf175392-e0eb-4558-8bd1-7e3b834a8dfe tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a" status: 200 len: 1313 microversion: 2.1 time: 0.526382 Oct 19 03:13:12.657110 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 141/289] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:13:12 2022] GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a => generated 1313 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:13:12.667769 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-bda8667c-d1e1-404b-a299-5f28132ae1b6 tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:12.715420 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c0127250-9e95-43d9-85a2-4463c1cbdf7a tempest-FlavorsV255TestJSON-319703241 tempest-FlavorsV255TestJSON-319703241-project] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 6584 microversion: 2.55 time: 0.068888 Oct 19 03:13:12.729395 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 149/290] 10.222.0.52 () {60 vars in 1187 bytes} [Wed Oct 19 03:13:12 2022] GET /compute/v2.1/flavors/detail => generated 6584 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:13:12.729395 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-229a4516-fdd5-4446-8fef-de9d82cdaa35 tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:12.729395 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-229a4516-fdd5-4446-8fef-de9d82cdaa35 tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] HTTP exception thrown: Aggregate 14 could not be found. Oct 19 03:13:12.729395 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-229a4516-fdd5-4446-8fef-de9d82cdaa35 tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] Request method failure captured: Oct 19 03:13:12.729395 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/os-aggregates/14 HTTP/1.1 Oct 19 03:13:12.729395 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:13:12.729395 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:13:12.729395 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:13:12.729395 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:13:12.729395 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:13:12.729395 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:13:12.729395 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:13:12.729395 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:13:12.729395 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2sSZNPVF3T8umDX_CSgeB1Zpf9NjCf1xvhaic9ljhPn49OJHNUey5PxJQsLf97cWLeSbff__tI_xtLPbjjVdj1hehSyo8a06h8fqPsGUNBRRKgOupwv4xAiCKQGxvjFEllZMSGqeofk5D1zPmkDzCzhx2kJtIvYfHmLgUk-kwaMqec Oct 19 03:13:12.729395 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:13:12.729395 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:13:12.729395 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:13:12.729395 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:13:12.729395 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:13:12.729395 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:13:12.729395 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 5cb745d432f8475095e5fd1ab901ae2c Oct 19 03:13:12.729395 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-AggregatesAdminTestJSON-1419667209 Oct 19 03:13:12.729395 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member,admin Oct 19 03:13:12.729395 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member,admin Oct 19 03:13:12.730873 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5cb745d432f8475095e5fd1ab901ae2c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5cb745d432f8475095e5fd1ab901ae2c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5cb745d432f8475095e5fd1ab901ae2c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5cb745d432f8475095e5fd1ab901ae2c", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:13:12.730873 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-AggregatesAdminTestJSON-1419667209 Oct 19 03:13:12.730873 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 5cb745d432f8475095e5fd1ab901ae2c Oct 19 03:13:12.730873 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1419667209 Oct 19 03:13:12.730873 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-AggregatesAdminTestJSON-1419667209-project-admin Oct 19 03:13:12.730873 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:13:12.730873 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:13:12.730873 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: b319d0fbf3ca42e2856c09af0ffbd31a Oct 19 03:13:12.730873 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-AggregatesAdminTestJSON-1419667209-project-admin Oct 19 03:13:12.730873 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:13:12.730873 n-d-861333-8 devstack@n-api.service[121135]: exception: Aggregate 14 could not be found. Oct 19 03:13:12.730873 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '14'} Oct 19 03:13:12.730873 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:13:12.731652 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:12.731652 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 19 03:13:12.731652 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 19 03:13:12.731652 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 19 03:13:12.731652 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 19 03:13:12.731652 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 03:13:12.731652 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 03:13:12.731652 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 19 03:13:12.731652 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 19 03:13:12.731652 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 19 03:13:12.731652 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 19 03:13:12.731652 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 19 03:13:12.731652 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 19 03:13:12.731652 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 14 could not be found. Oct 19 03:13:12.731652 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:12.731652 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:13:12.731652 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:12.731652 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:12.731652 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:13:12.732756 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:13:12.732756 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:13:12.732756 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:13:12.732756 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:13:12.732756 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:13:12.732756 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 19 03:13:12.732756 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:13:12.732756 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 14 could not be found. Oct 19 03:13:12.732756 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:12.732756 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:13:12.732756 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:12.732756 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:12.732756 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:13:12.732756 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:13:12.732756 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:13:12.732756 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:13:12.732756 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 14 could not be found. Oct 19 03:13:12.732756 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:12.737714 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-229a4516-fdd5-4446-8fef-de9d82cdaa35 tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:13:12.737714 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-229a4516-fdd5-4446-8fef-de9d82cdaa35 tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] 10.222.0.52 "GET /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.013222 Oct 19 03:13:12.737714 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 150/291] 10.222.0.52 () {58 vars in 1152 bytes} [Wed Oct 19 03:13:12 2022] GET /compute/v2.1/os-aggregates/14 => generated 78 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 03:13:12.741082 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c80a8051-70c5-4151-9e9a-3e1fb46018dc tempest-FlavorsV255TestJSON-319703241 tempest-FlavorsV255TestJSON-319703241-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:12.765075 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c80a8051-70c5-4151-9e9a-3e1fb46018dc tempest-FlavorsV255TestJSON-319703241 tempest-FlavorsV255TestJSON-319703241-project] 10.222.0.52 "GET /compute/v2.1/flavors" status: 200 len: 3674 microversion: 2.55 time: 0.026977 Oct 19 03:13:12.773456 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 151/292] 10.222.0.52 () {60 vars in 1166 bytes} [Wed Oct 19 03:13:12 2022] GET /compute/v2.1/flavors => generated 3674 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:13:12.773456 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c1fc8aa6-5407-4fc8-bdaa-f0524d6524e7 tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:12.785339 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-c1fc8aa6-5407-4fc8-bdaa-f0524d6524e7 tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] HTTP exception thrown: Aggregate 14 could not be found. Oct 19 03:13:12.787145 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c1fc8aa6-5407-4fc8-bdaa-f0524d6524e7 tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] Request method failure captured: Oct 19 03:13:12.787145 n-d-861333-8 devstack@n-api.service[121135]: request: DELETE /compute/v2.1/os-aggregates/14 HTTP/1.1 Oct 19 03:13:12.787145 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:13:12.787145 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:13:12.787145 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:13:12.787145 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:13:12.787145 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:13:12.787145 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:13:12.787145 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:13:12.787145 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:13:12.787145 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2sSZNPVF3T8umDX_CSgeB1Zpf9NjCf1xvhaic9ljhPn49OJHNUey5PxJQsLf97cWLeSbff__tI_xtLPbjjVdj1hehSyo8a06h8fqPsGUNBRRKgOupwv4xAiCKQGxvjFEllZMSGqeofk5D1zPmkDzCzhx2kJtIvYfHmLgUk-kwaMqec Oct 19 03:13:12.787145 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:13:12.787145 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:13:12.787145 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:13:12.787145 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:13:12.787145 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:13:12.787145 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:13:12.787145 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 5cb745d432f8475095e5fd1ab901ae2c Oct 19 03:13:12.787145 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-AggregatesAdminTestJSON-1419667209 Oct 19 03:13:12.787145 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member,admin Oct 19 03:13:12.787145 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member,admin Oct 19 03:13:12.788587 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5cb745d432f8475095e5fd1ab901ae2c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5cb745d432f8475095e5fd1ab901ae2c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5cb745d432f8475095e5fd1ab901ae2c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5cb745d432f8475095e5fd1ab901ae2c", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:13:12.788587 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-AggregatesAdminTestJSON-1419667209 Oct 19 03:13:12.788587 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 5cb745d432f8475095e5fd1ab901ae2c Oct 19 03:13:12.788587 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1419667209 Oct 19 03:13:12.788587 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-AggregatesAdminTestJSON-1419667209-project-admin Oct 19 03:13:12.788587 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:13:12.788587 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:13:12.788587 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: b319d0fbf3ca42e2856c09af0ffbd31a Oct 19 03:13:12.788587 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-AggregatesAdminTestJSON-1419667209-project-admin Oct 19 03:13:12.788587 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:13:12.788587 n-d-861333-8 devstack@n-api.service[121135]: exception: Aggregate 14 could not be found. Oct 19 03:13:12.788587 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '14'} Oct 19 03:13:12.788587 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:13:12.793581 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:12.793581 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 19 03:13:12.793581 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 19 03:13:12.793581 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 19 03:13:12.793581 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 19 03:13:12.793581 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 03:13:12.793581 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 03:13:12.793581 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 03:13:12.793581 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 03:13:12.793581 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 19 03:13:12.793581 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 19 03:13:12.793581 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 19 03:13:12.793581 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 19 03:13:12.793581 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 03:13:12.793581 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 03:13:12.793581 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 19 03:13:12.793581 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 19 03:13:12.793581 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 19 03:13:12.793581 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 19 03:13:12.794797 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 19 03:13:12.794797 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 19 03:13:12.794797 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 14 could not be found. Oct 19 03:13:12.794797 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:12.794797 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:13:12.794797 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:12.794797 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:12.794797 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:13:12.794797 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:13:12.794797 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:13:12.794797 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:13:12.794797 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:13:12.794797 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:13:12.794797 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 19 03:13:12.794797 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:13:12.794797 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 14 could not be found. Oct 19 03:13:12.794797 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:12.794797 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:13:12.794797 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:12.794797 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:12.794797 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:13:12.795915 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:13:12.795915 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:13:12.795915 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:13:12.795915 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 14 could not be found. Oct 19 03:13:12.795915 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:12.795915 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c1fc8aa6-5407-4fc8-bdaa-f0524d6524e7 tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:13:12.795915 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c1fc8aa6-5407-4fc8-bdaa-f0524d6524e7 tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.020627 Oct 19 03:13:12.795915 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 152/293] 10.222.0.52 () {58 vars in 1155 bytes} [Wed Oct 19 03:13:12 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 78 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 03:13:12.800088 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-79750940-fed5-420f-81d2-51a672a55966 tempest-FlavorsV255TestJSON-139852347 tempest-FlavorsV255TestJSON-139852347-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:12.836528 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-bda8667c-d1e1-404b-a299-5f28132ae1b6 tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.178225 Oct 19 03:13:12.837687 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 142/294] 10.222.0.52 () {58 vars in 1155 bytes} [Wed Oct 19 03:13:12 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 19 03:13:12.844293 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-727609f7-a043-4edc-b691-a5f7127d7a8a tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-146882503"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:13:12.848993 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.aggregate [None req-727609f7-a043-4edc-b691-a5f7127d7a8a tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] Generated uuid eeead9f9-ddb7-4f6a-a69d-a041c0401ad3 for aggregate {{(pid=121134) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 19 03:13:12.859599 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=11,nova_api:DELETE=6 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:13:12.918299 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-79750940-fed5-420f-81d2-51a672a55966 tempest-FlavorsV255TestJSON-139852347 tempest-FlavorsV255TestJSON-139852347-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/68122436" status: 202 len: 0 microversion: 2.55 time: 0.127500 Oct 19 03:13:12.919912 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 153/295] 10.222.0.52 () {60 vars in 1196 bytes} [Wed Oct 19 03:13:12 2022] DELETE /compute/v2.1/flavors/68122436 => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:13:12.933462 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d5786fee-5e97-4e99-96b1-d567d7af910f tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1120253539"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:13:12.940821 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.aggregate [None req-d5786fee-5e97-4e99-96b1-d567d7af910f tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] Generated uuid c83ffb9b-409e-45e3-ab8f-db6b3b3fa6b5 for aggregate {{(pid=121135) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 19 03:13:12.978311 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-727609f7-a043-4edc-b691-a5f7127d7a8a tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.139257 Oct 19 03:13:12.979858 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 143/296] 10.222.0.52 () {60 vars in 1164 bytes} [Wed Oct 19 03:13:12 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:13:12.985976 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d7558b86-3335-41a2-9a04-ae17ef81bfba tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:12.990659 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d7558b86-3335-41a2-9a04-ae17ef81bfba tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] [instance: f476cc02-1b56-4c61-93a4-c3d36c38792d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:13.016623 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d7558b86-3335-41a2-9a04-ae17ef81bfba tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:13.019353 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d7558b86-3335-41a2-9a04-ae17ef81bfba tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:13.019353 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d7558b86-3335-41a2-9a04-ae17ef81bfba tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:13.019353 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d7558b86-3335-41a2-9a04-ae17ef81bfba tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:13.019626 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d7558b86-3335-41a2-9a04-ae17ef81bfba tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:13.019733 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d7558b86-3335-41a2-9a04-ae17ef81bfba tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:13.044420 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d5786fee-5e97-4e99-96b1-d567d7af910f tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.119478 Oct 19 03:13:13.052748 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 154/297] 10.222.0.52 () {60 vars in 1164 bytes} [Wed Oct 19 03:13:12 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:13:13.052748 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0b89ebdf-5488-4779-a3fe-497b1382fcce tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:13.053766 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0b89ebdf-5488-4779-a3fe-497b1382fcce tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] [instance: 6c38df2c-2b90-4a77-b610-8811aa680a81] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:13.077031 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0b89ebdf-5488-4779-a3fe-497b1382fcce tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:13.085647 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0b89ebdf-5488-4779-a3fe-497b1382fcce tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:13.086110 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0b89ebdf-5488-4779-a3fe-497b1382fcce tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:13.086862 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0b89ebdf-5488-4779-a3fe-497b1382fcce tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:13.087387 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0b89ebdf-5488-4779-a3fe-497b1382fcce tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:13.087824 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0b89ebdf-5488-4779-a3fe-497b1382fcce tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:13.540979 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-0b89ebdf-5488-4779-a3fe-497b1382fcce tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '769928c8ecb643fa83a9d58465dcb263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ead65f008349329789135966c031d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:13.547332 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d7558b86-3335-41a2-9a04-ae17ef81bfba tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cc37ae4bed94a7e85ed70dd5942c2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df99b134b20743eb9b62788706f2705a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:13.558363 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0b89ebdf-5488-4779-a3fe-497b1382fcce tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] 10.222.0.52 "GET /compute/v2.1/servers/6c38df2c-2b90-4a77-b610-8811aa680a81" status: 200 len: 1320 microversion: 2.1 time: 0.508933 Oct 19 03:13:13.558363 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 155/298] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:13:13 2022] GET /compute/v2.1/servers/6c38df2c-2b90-4a77-b610-8811aa680a81 => generated 1320 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:13:13.566731 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7c1655b3-09cd-4e16-adeb-d593853fdeda tempest-FlavorsV255TestJSON-139852347 tempest-FlavorsV255TestJSON-139852347-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:13.572963 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d7558b86-3335-41a2-9a04-ae17ef81bfba tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] 10.222.0.52 "GET /compute/v2.1/servers/f476cc02-1b56-4c61-93a4-c3d36c38792d" status: 200 len: 1388 microversion: 2.1 time: 0.575428 Oct 19 03:13:13.573964 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 144/299] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:13:12 2022] GET /compute/v2.1/servers/f476cc02-1b56-4c61-93a4-c3d36c38792d => generated 1388 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:13:13.580321 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a92caa94-5cd1-4d90-a53e-f4375fcccfd9 tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:13.594688 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7c1655b3-09cd-4e16-adeb-d593853fdeda tempest-FlavorsV255TestJSON-139852347 tempest-FlavorsV255TestJSON-139852347-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 6150 microversion: 2.55 time: 0.033199 Oct 19 03:13:13.602927 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a92caa94-5cd1-4d90-a53e-f4375fcccfd9 tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] 10.222.0.52 "GET /compute/v2.1/os-aggregates/15" status: 200 len: 227 microversion: 2.1 time: 0.026377 Oct 19 03:13:13.616662 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 145/300] 10.222.0.52 () {58 vars in 1152 bytes} [Wed Oct 19 03:13:13 2022] GET /compute/v2.1/os-aggregates/15 => generated 227 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:13:13.616760 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 156/301] 10.222.0.52 () {60 vars in 1187 bytes} [Wed Oct 19 03:13:13 2022] GET /compute/v2.1/flavors/detail => generated 6150 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:13:13.616861 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2cc399df-08b5-45e8-8d98-b6fa573d3d4b tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:13:13.627605 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2cc399df-08b5-45e8-8d98-b6fa573d3d4b tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:13.628517 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2cc399df-08b5-45e8-8d98-b6fa573d3d4b tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:13.628966 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2cc399df-08b5-45e8-8d98-b6fa573d3d4b tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:13.634974 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2cc399df-08b5-45e8-8d98-b6fa573d3d4b tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:13.635463 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2cc399df-08b5-45e8-8d98-b6fa573d3d4b tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:13.635906 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2cc399df-08b5-45e8-8d98-b6fa573d3d4b tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:13.636318 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4edd41c1-9237-490b-b528-a33ea8515793 tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:13:13.644814 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.compute.aggregates [None req-2cc399df-08b5-45e8-8d98-b6fa573d3d4b tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] Failed to remove host nonexist_host from aggregate 16. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 19 03:13:13.645339 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-2cc399df-08b5-45e8-8d98-b6fa573d3d4b tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 16 Oct 19 03:13:13.647271 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2cc399df-08b5-45e8-8d98-b6fa573d3d4b tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] Request method failure captured: Oct 19 03:13:13.647271 n-d-861333-8 devstack@n-api.service[121134]: request: POST /compute/v2.1/os-aggregates/16/action HTTP/1.1 Oct 19 03:13:13.647271 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:13:13.647271 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:13:13.647271 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:13:13.647271 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 42 Oct 19 03:13:13.647271 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:13:13.647271 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:13:13.647271 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:13:13.647271 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:13:13.647271 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT2sSQw-193CFmXE1yZgEnt0B3HgVL-IByl9MkeVBZk-c5KX0vUCmee3Q0oqzDaNKo9zJeIds0ifmz-3fVGnI07Mrtz7rATgZAGe_rfcJbl1B9R7uDkjNChQt8Zzl7L6Y7Y0MAayowWf26ukVUUTqdgL5K-itKe6rSciyrvMsk-0EdJ0 Oct 19 03:13:13.647271 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:13:13.647271 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:13:13.647271 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:13:13.647271 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:13:13.647271 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:13:13.647271 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:13:13.647271 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: de26c267165d46af9fc562fad55e974a Oct 19 03:13:13.647271 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1537588694 Oct 19 03:13:13.647271 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member,admin Oct 19 03:13:13.647271 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member,admin Oct 19 03:13:13.648699 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/de26c267165d46af9fc562fad55e974a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/de26c267165d46af9fc562fad55e974a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/de26c267165d46af9fc562fad55e974a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_de26c267165d46af9fc562fad55e974a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:13:13.648699 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1537588694 Oct 19 03:13:13.648699 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: de26c267165d46af9fc562fad55e974a Oct 19 03:13:13.648699 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1537588694 Oct 19 03:13:13.648699 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin Oct 19 03:13:13.648699 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:13:13.648699 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:13:13.648699 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 182578638f5640fda56795a868e20798 Oct 19 03:13:13.648699 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin Oct 19 03:13:13.648699 n-d-861333-8 devstack@n-api.service[121134]: Oct 19 03:13:13.648699 n-d-861333-8 devstack@n-api.service[121134]: {"remove_host": {"host": "nonexist_host"}} Oct 19 03:13:13.648699 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:13:13.648699 n-d-861333-8 devstack@n-api.service[121134]: exception: Cannot remove host nonexist_host in aggregate 16 Oct 19 03:13:13.649662 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '16', 'body': {'remove_host': {'host': 'nonexist_host'}}} Oct 19 03:13:13.649662 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:13:13.649662 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:13.649662 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Oct 19 03:13:13.649662 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 19 03:13:13.649662 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 03:13:13.649662 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 03:13:13.649662 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 19 03:13:13.649662 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 19 03:13:13.649662 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 19 03:13:13.649662 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 19 03:13:13.649662 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 19 03:13:13.649662 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 19 03:13:13.649662 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Oct 19 03:13:13.649662 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:13:13.649662 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:13:13.649662 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:13:13.649662 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:13.649662 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Oct 19 03:13:13.649662 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 19 03:13:13.651065 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 19 03:13:13.651065 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 19 03:13:13.651065 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 19 03:13:13.651065 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:13:13.651065 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:13:13.651065 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:13:13.651065 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:13.651065 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Oct 19 03:13:13.651065 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Oct 19 03:13:13.651065 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 19 03:13:13.651065 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 19 03:13:13.651065 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 03:13:13.651065 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 03:13:13.651065 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 03:13:13.651065 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 03:13:13.651065 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 19 03:13:13.651065 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 19 03:13:13.651065 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6683, in remove_host_from_aggregate Oct 19 03:13:13.651065 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Oct 19 03:13:13.651065 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 19 03:13:13.653259 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 19 03:13:13.653259 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 19 03:13:13.653259 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:13:13.653259 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:13:13.653259 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:13:13.653259 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:13.653259 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:13:13.653259 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:13:13.653259 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:13:13.653259 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:13:13.653259 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:13:13.653259 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:13:13.653259 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:13:13.653259 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:13:13.653259 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Oct 19 03:13:13.653259 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 19 03:13:13.653259 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 16 Oct 19 03:13:13.653259 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:13:13.653259 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:13:13.653259 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:13:13.653259 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:13.655429 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:13:13.655429 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:13:13.655429 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:13:13.655429 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:13:13.655429 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 16 Oct 19 03:13:13.655429 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:13:13.655429 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2cc399df-08b5-45e8-8d98-b6fa573d3d4b tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 16 {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:13:13.655429 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2cc399df-08b5-45e8-8d98-b6fa573d3d4b tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/16/action" status: 404 len: 94 microversion: 2.1 time: 0.042502 Oct 19 03:13:13.655429 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 146/302] 10.222.0.52 () {60 vars in 1194 bytes} [Wed Oct 19 03:13:13 2022] POST /compute/v2.1/os-aggregates/16/action => generated 94 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 03:13:13.662611 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-bfc7faa5-5e18-46d5-b3b7-297d808a800d tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:13.791565 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-bfc7faa5-5e18-46d5-b3b7-297d808a800d tempest-AggregatesAdminNegativeTestJSON-1537588694 tempest-AggregatesAdminNegativeTestJSON-1537588694-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.128728 Oct 19 03:13:13.791565 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 147/303] 10.222.0.52 () {58 vars in 1155 bytes} [Wed Oct 19 03:13:13 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 19 03:13:13.797249 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4edd41c1-9237-490b-b528-a33ea8515793 tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/15/action" status: 200 len: 265 microversion: 2.1 time: 0.169921 Oct 19 03:13:13.802150 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e9677ee7-4950-417d-bbf0-23d795e0c228 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:13.802150 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e9677ee7-4950-417d-bbf0-23d795e0c228 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 7b4a8cd9-a238-4bff-a002-497dc807bf3a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:13.804957 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 157/304] 10.222.0.52 () {60 vars in 1194 bytes} [Wed Oct 19 03:13:13 2022] POST /compute/v2.1/os-aggregates/15/action => generated 265 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:13:13.806912 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e9677ee7-4950-417d-bbf0-23d795e0c228 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:13.808063 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e9677ee7-4950-417d-bbf0-23d795e0c228 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:13.808811 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e9677ee7-4950-417d-bbf0-23d795e0c228 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:13.809558 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e9677ee7-4950-417d-bbf0-23d795e0c228 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:13.810117 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e9677ee7-4950-417d-bbf0-23d795e0c228 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:13.810554 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e9677ee7-4950-417d-bbf0-23d795e0c228 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:13.810684 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-1393e360-5db6-4847-8e36-46f0851c44e8 req-3ddcd972-9699-4a75-9c44-daf9adb347fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c38df2c-2b90-4a77-b610-8811aa680a81", "tag": "ae26118f-2661-4320-94d0-e41fe6dfbb92"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:13:13.830905 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-1393e360-5db6-4847-8e36-46f0851c44e8 req-3ddcd972-9699-4a75-9c44-daf9adb347fb service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:13.831514 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-1393e360-5db6-4847-8e36-46f0851c44e8 req-3ddcd972-9699-4a75-9c44-daf9adb347fb service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:13.832121 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-1393e360-5db6-4847-8e36-46f0851c44e8 req-3ddcd972-9699-4a75-9c44-daf9adb347fb service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:13.845300 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-1393e360-5db6-4847-8e36-46f0851c44e8 req-3ddcd972-9699-4a75-9c44-daf9adb347fb service nova] Creating event network-changed:ae26118f-2661-4320-94d0-e41fe6dfbb92 for instance 6c38df2c-2b90-4a77-b610-8811aa680a81 on n-h2-861333-8 Oct 19 03:13:13.850577 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-1393e360-5db6-4847-8e36-46f0851c44e8 req-3ddcd972-9699-4a75-9c44-daf9adb347fb service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044321 Oct 19 03:13:13.851799 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 158/305] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:13:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:13:13.858613 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1933b2d5-83eb-4f77-9a47-ddbac41a7263 tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:13.866938 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1933b2d5-83eb-4f77-9a47-ddbac41a7263 tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] 10.222.0.52 "GET /compute/v2.1/os-aggregates/15" status: 200 len: 241 microversion: 2.1 time: 0.013613 Oct 19 03:13:13.867902 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 159/306] 10.222.0.52 () {58 vars in 1152 bytes} [Wed Oct 19 03:13:13 2022] GET /compute/v2.1/os-aggregates/15 => generated 241 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:13:13.894845 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-bfbdd4d2-4a2f-4949-956b-8284bd6665bf tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:14.048723 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-bfbdd4d2-4a2f-4949-956b-8284bd6665bf tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.172853 Oct 19 03:13:14.049819 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 160/307] 10.222.0.52 () {58 vars in 1155 bytes} [Wed Oct 19 03:13:13 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 19 03:13:14.058241 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e288ab8e-6fd6-45e6-9d84-755da2db9bcf tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2041200374", "availability_zone": "tempest-test_az-825275013"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:13:14.081426 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.aggregate [None req-e288ab8e-6fd6-45e6-9d84-755da2db9bcf tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] Generated uuid b82b943d-4baf-4da2-bf24-ef89b9e1ccbd for aggregate {{(pid=121135) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 19 03:13:14.205804 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e288ab8e-6fd6-45e6-9d84-755da2db9bcf tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.151114 Oct 19 03:13:14.207914 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 161/308] 10.222.0.52 () {60 vars in 1165 bytes} [Wed Oct 19 03:13:14 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:13:14.216682 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e9677ee7-4950-417d-bbf0-23d795e0c228 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:14.225773 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b5d69f50-73df-4c16-829b-fa2ec936fd08 tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2041200374_new", "availability_zone": "tempest-test_az-825275013_new"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:13:14.233210 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e9677ee7-4950-417d-bbf0-23d795e0c228 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a" status: 200 len: 1313 microversion: 2.1 time: 0.443758 Oct 19 03:13:14.234061 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 148/309] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:13:13 2022] GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a => generated 1313 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:13:14.362274 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b5d69f50-73df-4c16-829b-fa2ec936fd08 tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:14.364754 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b5d69f50-73df-4c16-829b-fa2ec936fd08 tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:14.364754 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b5d69f50-73df-4c16-829b-fa2ec936fd08 tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:14.498659 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b5d69f50-73df-4c16-829b-fa2ec936fd08 tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-aggregates/17" status: 200 len: 335 microversion: 2.1 time: 0.282149 Oct 19 03:13:14.499744 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 162/310] 10.222.0.52 () {60 vars in 1173 bytes} [Wed Oct 19 03:13:14 2022] PUT /compute/v2.1/os-aggregates/17 => generated 335 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:13:14.511072 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b43a4729-519b-4851-9363-a2dc342d4b8b tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:14.571369 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b43a4729-519b-4851-9363-a2dc342d4b8b tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] 10.222.0.52 "GET /compute/v2.1/os-aggregates" status: 200 len: 338 microversion: 2.1 time: 0.061066 Oct 19 03:13:14.572683 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 149/311] 10.222.0.52 () {58 vars in 1143 bytes} [Wed Oct 19 03:13:14 2022] GET /compute/v2.1/os-aggregates => generated 338 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:13:14.584724 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7d89370c-1cbe-4c53-84c3-5c79eafaa070 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:14.585560 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7d89370c-1cbe-4c53-84c3-5c79eafaa070 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] [instance: 6c38df2c-2b90-4a77-b610-8811aa680a81] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:14.616317 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a54688c8-3c2c-4add-b952-218dd5f5dc14 tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:14.624773 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7d89370c-1cbe-4c53-84c3-5c79eafaa070 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:14.625277 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7d89370c-1cbe-4c53-84c3-5c79eafaa070 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:14.626617 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7d89370c-1cbe-4c53-84c3-5c79eafaa070 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:14.635832 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7d89370c-1cbe-4c53-84c3-5c79eafaa070 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:14.636452 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7d89370c-1cbe-4c53-84c3-5c79eafaa070 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:14.636898 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7d89370c-1cbe-4c53-84c3-5c79eafaa070 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:14.755472 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a54688c8-3c2c-4add-b952-218dd5f5dc14 tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.161887 Oct 19 03:13:14.756445 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 150/312] 10.222.0.52 () {58 vars in 1155 bytes} [Wed Oct 19 03:13:14 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 19 03:13:14.777759 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b9705bdb-564c-47f7-8151-7937d6f6aa9b tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:14.779880 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b9705bdb-564c-47f7-8151-7937d6f6aa9b tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] [instance: f476cc02-1b56-4c61-93a4-c3d36c38792d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:14.794026 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b9705bdb-564c-47f7-8151-7937d6f6aa9b tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:14.794841 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b9705bdb-564c-47f7-8151-7937d6f6aa9b tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:14.796180 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b9705bdb-564c-47f7-8151-7937d6f6aa9b tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:14.797423 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b9705bdb-564c-47f7-8151-7937d6f6aa9b tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:14.798341 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b9705bdb-564c-47f7-8151-7937d6f6aa9b tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:14.799881 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b9705bdb-564c-47f7-8151-7937d6f6aa9b tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:15.349696 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7d89370c-1cbe-4c53-84c3-5c79eafaa070 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '769928c8ecb643fa83a9d58465dcb263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ead65f008349329789135966c031d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:15.362975 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7d89370c-1cbe-4c53-84c3-5c79eafaa070 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] 10.222.0.52 "GET /compute/v2.1/servers/6c38df2c-2b90-4a77-b610-8811aa680a81" status: 200 len: 1320 microversion: 2.1 time: 0.786374 Oct 19 03:13:15.364154 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 163/313] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:13:14 2022] GET /compute/v2.1/servers/6c38df2c-2b90-4a77-b610-8811aa680a81 => generated 1320 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:13:15.378206 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2b0d6da8-282f-477c-9583-33b591597a85 tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1991456474"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:13:15.379250 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b9705bdb-564c-47f7-8151-7937d6f6aa9b tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cc37ae4bed94a7e85ed70dd5942c2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df99b134b20743eb9b62788706f2705a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:15.381707 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.aggregate [None req-2b0d6da8-282f-477c-9583-33b591597a85 tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] Generated uuid 1cb19e9e-cb08-4825-8820-9b5242125b3c for aggregate {{(pid=121135) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 19 03:13:15.409218 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b9705bdb-564c-47f7-8151-7937d6f6aa9b tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] 10.222.0.52 "GET /compute/v2.1/servers/f476cc02-1b56-4c61-93a4-c3d36c38792d" status: 200 len: 1388 microversion: 2.1 time: 0.643739 Oct 19 03:13:15.409844 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 151/314] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:13:14 2022] GET /compute/v2.1/servers/f476cc02-1b56-4c61-93a4-c3d36c38792d => generated 1388 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:13:15.417228 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-89d7ec6b-8dce-4b74-834f-0f6e47bbf082 req-3a0d2518-61b4-4b4a-9f30-df4da5a29ff9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f476cc02-1b56-4c61-93a4-c3d36c38792d", "name": "network-vif-plugged", "status": "completed", "tag": "e7234846-076a-4f8d-9318-716ced0a591c"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:13:15.428681 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-89d7ec6b-8dce-4b74-834f-0f6e47bbf082 req-3a0d2518-61b4-4b4a-9f30-df4da5a29ff9 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:15.429166 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-89d7ec6b-8dce-4b74-834f-0f6e47bbf082 req-3a0d2518-61b4-4b4a-9f30-df4da5a29ff9 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:15.429617 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-89d7ec6b-8dce-4b74-834f-0f6e47bbf082 req-3a0d2518-61b4-4b4a-9f30-df4da5a29ff9 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:15.441863 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-89d7ec6b-8dce-4b74-834f-0f6e47bbf082 req-3a0d2518-61b4-4b4a-9f30-df4da5a29ff9 service nova] Creating event network-vif-plugged:e7234846-076a-4f8d-9318-716ced0a591c for instance f476cc02-1b56-4c61-93a4-c3d36c38792d on n-h1-861333-8 Oct 19 03:13:15.447136 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-89d7ec6b-8dce-4b74-834f-0f6e47bbf082 req-3a0d2518-61b4-4b4a-9f30-df4da5a29ff9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033631 Oct 19 03:13:15.448698 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 152/315] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:13:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:13:15.457328 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5b6bd77f-3ece-4ea6-82e0-1b9f6cebb52c tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:15.458361 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5b6bd77f-3ece-4ea6-82e0-1b9f6cebb52c tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 7b4a8cd9-a238-4bff-a002-497dc807bf3a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:15.466701 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5b6bd77f-3ece-4ea6-82e0-1b9f6cebb52c tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:15.467893 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5b6bd77f-3ece-4ea6-82e0-1b9f6cebb52c tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:15.468534 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5b6bd77f-3ece-4ea6-82e0-1b9f6cebb52c tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:15.470824 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5b6bd77f-3ece-4ea6-82e0-1b9f6cebb52c tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:15.471292 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5b6bd77f-3ece-4ea6-82e0-1b9f6cebb52c tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:15.471727 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5b6bd77f-3ece-4ea6-82e0-1b9f6cebb52c tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:15.490832 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2b0d6da8-282f-477c-9583-33b591597a85 tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.124629 Oct 19 03:13:15.491554 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 164/316] 10.222.0.52 () {60 vars in 1164 bytes} [Wed Oct 19 03:13:15 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:13:15.503714 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0834cdbe-322c-4496-a15a-e0df86ffb0b5 tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:15.527233 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0834cdbe-322c-4496-a15a-e0df86ffb0b5 tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] 10.222.0.52 "GET /compute/v2.1/os-aggregates" status: 200 len: 231 microversion: 2.1 time: 0.027253 Oct 19 03:13:15.541840 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 165/317] 10.222.0.52 () {58 vars in 1143 bytes} [Wed Oct 19 03:13:15 2022] GET /compute/v2.1/os-aggregates => generated 231 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:13:15.546369 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2f8f1bb9-faf0-4bfa-b4f4-3adcdaa90cc6 tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:15.660051 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2f8f1bb9-faf0-4bfa-b4f4-3adcdaa90cc6 tempest-AggregatesAdminTestJSON-1419667209 tempest-AggregatesAdminTestJSON-1419667209-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.120005 Oct 19 03:13:15.661284 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 166/318] 10.222.0.52 () {58 vars in 1155 bytes} [Wed Oct 19 03:13:15 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 19 03:13:15.671866 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-8253b59b-9df2-44b1-b4d0-1fc09680ac23 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:15.672379 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-8253b59b-9df2-44b1-b4d0-1fc09680ac23 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] [instance: 44cee120-503c-401f-b046-a638d08df855] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:15.679018 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8253b59b-9df2-44b1-b4d0-1fc09680ac23 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:15.679939 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8253b59b-9df2-44b1-b4d0-1fc09680ac23 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:15.680539 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8253b59b-9df2-44b1-b4d0-1fc09680ac23 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:15.681469 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8253b59b-9df2-44b1-b4d0-1fc09680ac23 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:15.681924 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8253b59b-9df2-44b1-b4d0-1fc09680ac23 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:15.682530 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8253b59b-9df2-44b1-b4d0-1fc09680ac23 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:15.705108 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-8253b59b-9df2-44b1-b4d0-1fc09680ac23 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] HTTP exception thrown: Instance 44cee120-503c-401f-b046-a638d08df855 could not be found. Oct 19 03:13:15.707142 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-8253b59b-9df2-44b1-b4d0-1fc09680ac23 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Request method failure captured: Oct 19 03:13:15.707142 n-d-861333-8 devstack@n-api.service[121135]: request: DELETE /compute/v2.1/servers/44cee120-503c-401f-b046-a638d08df855 HTTP/1.1 Oct 19 03:13:15.707142 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:13:15.707142 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:13:15.707142 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:13:15.707142 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:13:15.707142 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:13:15.707142 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:13:15.707142 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:13:15.707142 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:13:15.707142 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2sPxEudS9vYV4UG5yd8PpOgAJzE6PZ0ObZVjBpBb0wPgbtHu-kDzFU4YNyKompBg6-wJxOiNpIqlFxGKLC4h2z77NNez4V5yttRVfRd5fY-Q4pQPsTMphDYpsSuoJPOLPAomp7AtPOX8HhIBtqWVM5H_SZnz0nRaOtY0jqC83U8BEY Oct 19 03:13:15.707142 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:13:15.707142 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:13:15.707142 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:13:15.707142 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:13:15.707142 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:13:15.707142 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:13:15.707142 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: d3054afe77df43afa6406ec25b57de65 Oct 19 03:13:15.707142 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-AggregatesAdminTestJSON-873493697 Oct 19 03:13:15.707142 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:13:15.707142 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:13:15.708546 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d3054afe77df43afa6406ec25b57de65"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d3054afe77df43afa6406ec25b57de65"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d3054afe77df43afa6406ec25b57de65"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d3054afe77df43afa6406ec25b57de65", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:13:15.708546 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-AggregatesAdminTestJSON-873493697 Oct 19 03:13:15.708546 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: d3054afe77df43afa6406ec25b57de65 Oct 19 03:13:15.708546 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-873493697 Oct 19 03:13:15.708546 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-AggregatesAdminTestJSON-873493697-project Oct 19 03:13:15.708546 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:13:15.708546 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:13:15.708546 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: f665963909a64c148298b7a6c8e3307a Oct 19 03:13:15.708546 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-AggregatesAdminTestJSON-873493697-project Oct 19 03:13:15.708546 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:13:15.708546 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance 44cee120-503c-401f-b046-a638d08df855 could not be found. Oct 19 03:13:15.708546 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '44cee120-503c-401f-b046-a638d08df855'} Oct 19 03:13:15.709461 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:13:15.709461 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:15.709461 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:13:15.709461 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:13:15.709461 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:13:15.709461 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:13:15.709461 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:13:15.709461 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:13:15.709461 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:13:15.709461 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:13:15.709461 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44cee120-503c-401f-b046-a638d08df855 could not be found. Oct 19 03:13:15.709461 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:15.709461 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:13:15.709461 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:15.709461 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:15.709461 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:13:15.709461 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:13:15.709461 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:13:15.709461 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:13:15.709461 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:13:15.711042 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:13:15.711042 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 03:13:15.711042 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 03:13:15.711042 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 03:13:15.711042 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 03:13:15.711042 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:13:15.711042 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:13:15.711042 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:13:15.711042 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:13:15.711042 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44cee120-503c-401f-b046-a638d08df855 could not be found. Oct 19 03:13:15.711042 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:15.711042 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:13:15.711042 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:15.711042 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:15.711042 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:13:15.711042 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:13:15.711042 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:13:15.711042 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:13:15.711042 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44cee120-503c-401f-b046-a638d08df855 could not be found. Oct 19 03:13:15.711042 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:15.713626 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-8253b59b-9df2-44b1-b4d0-1fc09680ac23 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Returning 404 to user: Instance 44cee120-503c-401f-b046-a638d08df855 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:13:15.714816 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-8253b59b-9df2-44b1-b4d0-1fc09680ac23 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] 10.222.0.52 "DELETE /compute/v2.1/servers/44cee120-503c-401f-b046-a638d08df855" status: 404 len: 111 microversion: 2.1 time: 0.048874 Oct 19 03:13:15.721272 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 167/319] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:13:15 2022] DELETE /compute/v2.1/servers/44cee120-503c-401f-b046-a638d08df855 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 03:13:15.728049 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-14d4fa52-471c-49f9-89a8-efb4e06ffca0 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:15.728903 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-14d4fa52-471c-49f9-89a8-efb4e06ffca0 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] [instance: 44cee120-503c-401f-b046-a638d08df855] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:15.735423 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-14d4fa52-471c-49f9-89a8-efb4e06ffca0 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:15.735911 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-14d4fa52-471c-49f9-89a8-efb4e06ffca0 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:15.736347 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-14d4fa52-471c-49f9-89a8-efb4e06ffca0 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:15.737063 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-14d4fa52-471c-49f9-89a8-efb4e06ffca0 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:15.737552 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-14d4fa52-471c-49f9-89a8-efb4e06ffca0 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:15.737977 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-14d4fa52-471c-49f9-89a8-efb4e06ffca0 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:15.758909 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-14d4fa52-471c-49f9-89a8-efb4e06ffca0 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] HTTP exception thrown: Instance 44cee120-503c-401f-b046-a638d08df855 could not be found. Oct 19 03:13:15.760739 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-14d4fa52-471c-49f9-89a8-efb4e06ffca0 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Request method failure captured: Oct 19 03:13:15.760739 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/44cee120-503c-401f-b046-a638d08df855 HTTP/1.1 Oct 19 03:13:15.760739 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:13:15.760739 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:13:15.760739 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:13:15.760739 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:13:15.760739 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:13:15.760739 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:13:15.760739 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:13:15.760739 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:13:15.760739 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2sPxEudS9vYV4UG5yd8PpOgAJzE6PZ0ObZVjBpBb0wPgbtHu-kDzFU4YNyKompBg6-wJxOiNpIqlFxGKLC4h2z77NNez4V5yttRVfRd5fY-Q4pQPsTMphDYpsSuoJPOLPAomp7AtPOX8HhIBtqWVM5H_SZnz0nRaOtY0jqC83U8BEY Oct 19 03:13:15.760739 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:13:15.760739 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:13:15.760739 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:13:15.760739 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:13:15.760739 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:13:15.760739 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:13:15.760739 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: d3054afe77df43afa6406ec25b57de65 Oct 19 03:13:15.760739 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-AggregatesAdminTestJSON-873493697 Oct 19 03:13:15.760739 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:13:15.760739 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:13:15.761915 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d3054afe77df43afa6406ec25b57de65"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d3054afe77df43afa6406ec25b57de65"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d3054afe77df43afa6406ec25b57de65"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d3054afe77df43afa6406ec25b57de65", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:13:15.761915 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-AggregatesAdminTestJSON-873493697 Oct 19 03:13:15.761915 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: d3054afe77df43afa6406ec25b57de65 Oct 19 03:13:15.761915 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-873493697 Oct 19 03:13:15.761915 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-AggregatesAdminTestJSON-873493697-project Oct 19 03:13:15.761915 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:13:15.761915 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:13:15.761915 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: f665963909a64c148298b7a6c8e3307a Oct 19 03:13:15.761915 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-AggregatesAdminTestJSON-873493697-project Oct 19 03:13:15.761915 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:13:15.761915 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance 44cee120-503c-401f-b046-a638d08df855 could not be found. Oct 19 03:13:15.761915 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '44cee120-503c-401f-b046-a638d08df855'} Oct 19 03:13:15.762557 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:13:15.762557 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:15.762557 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:13:15.762557 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:13:15.762557 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:13:15.762557 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:13:15.762557 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:13:15.762557 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:13:15.762557 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:13:15.762557 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:13:15.762557 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44cee120-503c-401f-b046-a638d08df855 could not be found. Oct 19 03:13:15.762557 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:15.762557 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:13:15.762557 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:15.762557 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:15.762557 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:13:15.762557 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:13:15.762557 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:13:15.762557 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:13:15.762557 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:13:15.763620 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:13:15.763620 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:13:15.763620 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:13:15.763620 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:13:15.763620 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:13:15.763620 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:13:15.763620 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:13:15.763620 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44cee120-503c-401f-b046-a638d08df855 could not be found. Oct 19 03:13:15.763620 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:15.763620 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:13:15.763620 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:15.763620 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:15.763620 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:13:15.763620 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:13:15.763620 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:13:15.763620 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:13:15.763620 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44cee120-503c-401f-b046-a638d08df855 could not be found. Oct 19 03:13:15.763620 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:15.764655 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-14d4fa52-471c-49f9-89a8-efb4e06ffca0 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] Returning 404 to user: Instance 44cee120-503c-401f-b046-a638d08df855 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:13:15.764655 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-14d4fa52-471c-49f9-89a8-efb4e06ffca0 tempest-AggregatesAdminTestJSON-873493697 tempest-AggregatesAdminTestJSON-873493697-project] 10.222.0.52 "GET /compute/v2.1/servers/44cee120-503c-401f-b046-a638d08df855" status: 404 len: 111 microversion: 2.1 time: 0.038062 Oct 19 03:13:15.767340 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 168/320] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:13:15 2022] GET /compute/v2.1/servers/44cee120-503c-401f-b046-a638d08df855 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 03:13:15.793152 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5b6bd77f-3ece-4ea6-82e0-1b9f6cebb52c tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:15.797485 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=100 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:13:15.805712 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5b6bd77f-3ece-4ea6-82e0-1b9f6cebb52c tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a" status: 200 len: 1463 microversion: 2.1 time: 0.355466 Oct 19 03:13:15.810621 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 153/321] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:13:15 2022] GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a => generated 1463 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:13:16.387121 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a0a38407-4971-499f-92d4-59f6beb8e605 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:16.388037 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a0a38407-4971-499f-92d4-59f6beb8e605 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] [instance: 6c38df2c-2b90-4a77-b610-8811aa680a81] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:16.390043 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=20 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:13:16.395909 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a0a38407-4971-499f-92d4-59f6beb8e605 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:16.401415 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a0a38407-4971-499f-92d4-59f6beb8e605 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:16.405659 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a0a38407-4971-499f-92d4-59f6beb8e605 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:16.406501 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a0a38407-4971-499f-92d4-59f6beb8e605 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:16.407047 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a0a38407-4971-499f-92d4-59f6beb8e605 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:16.407552 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a0a38407-4971-499f-92d4-59f6beb8e605 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:16.523484 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-71a16d37-60e4-49aa-ade3-470021ea1231 tempest-MigrationsAdminTest-1230104219 tempest-MigrationsAdminTest-1230104219-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:16.524913 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-71a16d37-60e4-49aa-ade3-470021ea1231 tempest-MigrationsAdminTest-1230104219 tempest-MigrationsAdminTest-1230104219-project-admin] [instance: 7b4a8cd9-a238-4bff-a002-497dc807bf3a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:16.531030 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=3,nova_api:DELETE=10,nova_api:INSERT=5 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:13:16.546052 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-71a16d37-60e4-49aa-ade3-470021ea1231 tempest-MigrationsAdminTest-1230104219 tempest-MigrationsAdminTest-1230104219-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:16.549287 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-71a16d37-60e4-49aa-ade3-470021ea1231 tempest-MigrationsAdminTest-1230104219 tempest-MigrationsAdminTest-1230104219-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:16.550803 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-71a16d37-60e4-49aa-ade3-470021ea1231 tempest-MigrationsAdminTest-1230104219 tempest-MigrationsAdminTest-1230104219-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:16.552092 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-71a16d37-60e4-49aa-ade3-470021ea1231 tempest-MigrationsAdminTest-1230104219 tempest-MigrationsAdminTest-1230104219-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:16.555220 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-71a16d37-60e4-49aa-ade3-470021ea1231 tempest-MigrationsAdminTest-1230104219 tempest-MigrationsAdminTest-1230104219-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:16.556236 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-71a16d37-60e4-49aa-ade3-470021ea1231 tempest-MigrationsAdminTest-1230104219 tempest-MigrationsAdminTest-1230104219-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:16.618912 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:13:16.845410 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a0a38407-4971-499f-92d4-59f6beb8e605 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '769928c8ecb643fa83a9d58465dcb263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ead65f008349329789135966c031d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:16.859741 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a0a38407-4971-499f-92d4-59f6beb8e605 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] 10.222.0.52 "GET /compute/v2.1/servers/6c38df2c-2b90-4a77-b610-8811aa680a81" status: 200 len: 1320 microversion: 2.1 time: 0.477061 Oct 19 03:13:16.860328 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 154/322] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:13:16 2022] GET /compute/v2.1/servers/6c38df2c-2b90-4a77-b610-8811aa680a81 => generated 1320 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:13:16.879839 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a2a07916-4d43-4a3b-bcfa-2ea4b99daa9c tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:16.881899 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a2a07916-4d43-4a3b-bcfa-2ea4b99daa9c tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] [instance: f476cc02-1b56-4c61-93a4-c3d36c38792d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:16.896438 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a2a07916-4d43-4a3b-bcfa-2ea4b99daa9c tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:16.896939 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a2a07916-4d43-4a3b-bcfa-2ea4b99daa9c tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:16.897403 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a2a07916-4d43-4a3b-bcfa-2ea4b99daa9c tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:16.898115 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a2a07916-4d43-4a3b-bcfa-2ea4b99daa9c tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:16.898570 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a2a07916-4d43-4a3b-bcfa-2ea4b99daa9c tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:16.899025 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a2a07916-4d43-4a3b-bcfa-2ea4b99daa9c tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:17.244336 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a2a07916-4d43-4a3b-bcfa-2ea4b99daa9c tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cc37ae4bed94a7e85ed70dd5942c2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df99b134b20743eb9b62788706f2705a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:17.260008 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a2a07916-4d43-4a3b-bcfa-2ea4b99daa9c tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] 10.222.0.52 "GET /compute/v2.1/servers/f476cc02-1b56-4c61-93a4-c3d36c38792d" status: 200 len: 1388 microversion: 2.1 time: 0.383618 Oct 19 03:13:17.264957 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 155/323] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:13:16 2022] GET /compute/v2.1/servers/f476cc02-1b56-4c61-93a4-c3d36c38792d => generated 1388 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:13:17.482222 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-71a16d37-60e4-49aa-ade3-470021ea1231 tempest-MigrationsAdminTest-1230104219 tempest-MigrationsAdminTest-1230104219-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a" status: 200 len: 1614 microversion: 2.1 time: 1.654920 Oct 19 03:13:17.486947 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 169/324] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:13:15 2022] GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a => generated 1614 bytes in 1660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:13:17.524090 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-cd616c92-e46b-40cc-af80-adae51e66461 tempest-MigrationsAdminTest-1230104219 tempest-MigrationsAdminTest-1230104219-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:13:17.530533 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-cd616c92-e46b-40cc-af80-adae51e66461 tempest-MigrationsAdminTest-1230104219 tempest-MigrationsAdminTest-1230104219-project-admin] [instance: 7b4a8cd9-a238-4bff-a002-497dc807bf3a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:17.557010 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cd616c92-e46b-40cc-af80-adae51e66461 tempest-MigrationsAdminTest-1230104219 tempest-MigrationsAdminTest-1230104219-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:17.557846 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cd616c92-e46b-40cc-af80-adae51e66461 tempest-MigrationsAdminTest-1230104219 tempest-MigrationsAdminTest-1230104219-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:17.558842 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cd616c92-e46b-40cc-af80-adae51e66461 tempest-MigrationsAdminTest-1230104219 tempest-MigrationsAdminTest-1230104219-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:17.563026 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cd616c92-e46b-40cc-af80-adae51e66461 tempest-MigrationsAdminTest-1230104219 tempest-MigrationsAdminTest-1230104219-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:17.563616 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cd616c92-e46b-40cc-af80-adae51e66461 tempest-MigrationsAdminTest-1230104219 tempest-MigrationsAdminTest-1230104219-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:17.565095 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cd616c92-e46b-40cc-af80-adae51e66461 tempest-MigrationsAdminTest-1230104219 tempest-MigrationsAdminTest-1230104219-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:17.676409 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-cd616c92-e46b-40cc-af80-adae51e66461 tempest-MigrationsAdminTest-1230104219 tempest-MigrationsAdminTest-1230104219-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '19bac702de0146aa9483ed5574fe985a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca11bf1ab70142709ff1fd106df02ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:17.677099 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-cd616c92-e46b-40cc-af80-adae51e66461 tempest-MigrationsAdminTest-1230104219 tempest-MigrationsAdminTest-1230104219-project-admin] [instance: 7b4a8cd9-a238-4bff-a002-497dc807bf3a] flavor_id is None. Assuming migration. {{(pid=121134) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 19 03:13:17.677592 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-cd616c92-e46b-40cc-af80-adae51e66461 tempest-MigrationsAdminTest-1230104219 tempest-MigrationsAdminTest-1230104219-project-admin] [instance: 7b4a8cd9-a238-4bff-a002-497dc807bf3a] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=121134) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 19 03:13:17.889383 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-60819c45-6076-4245-ac5e-a58500d9c67b tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:17.889383 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-60819c45-6076-4245-ac5e-a58500d9c67b tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] [instance: 6c38df2c-2b90-4a77-b610-8811aa680a81] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:17.900424 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-60819c45-6076-4245-ac5e-a58500d9c67b tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:17.901149 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-60819c45-6076-4245-ac5e-a58500d9c67b tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:17.901982 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-60819c45-6076-4245-ac5e-a58500d9c67b tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:17.905199 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-60819c45-6076-4245-ac5e-a58500d9c67b tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:17.905987 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-60819c45-6076-4245-ac5e-a58500d9c67b tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:17.906570 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-60819c45-6076-4245-ac5e-a58500d9c67b tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:18.191303 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-cd616c92-e46b-40cc-af80-adae51e66461 tempest-MigrationsAdminTest-1230104219 tempest-MigrationsAdminTest-1230104219-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a/action" status: 202 len: 0 microversion: 2.1 time: 0.684493 Oct 19 03:13:18.193218 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 156/325] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:13:17 2022] POST /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a/action => generated 0 bytes in 688 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:13:18.200623 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-488f3008-4c82-4936-b797-656187d9f7f4 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:18.213716 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-488f3008-4c82-4936-b797-656187d9f7f4 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 7b4a8cd9-a238-4bff-a002-497dc807bf3a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:18.233138 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-488f3008-4c82-4936-b797-656187d9f7f4 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:18.233961 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-488f3008-4c82-4936-b797-656187d9f7f4 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:18.238513 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-488f3008-4c82-4936-b797-656187d9f7f4 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:18.238513 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-488f3008-4c82-4936-b797-656187d9f7f4 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:18.239254 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-488f3008-4c82-4936-b797-656187d9f7f4 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:18.240413 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-488f3008-4c82-4936-b797-656187d9f7f4 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:18.276474 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-60819c45-6076-4245-ac5e-a58500d9c67b tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '769928c8ecb643fa83a9d58465dcb263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ead65f008349329789135966c031d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:18.292209 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-60819c45-6076-4245-ac5e-a58500d9c67b tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] 10.222.0.52 "GET /compute/v2.1/servers/6c38df2c-2b90-4a77-b610-8811aa680a81" status: 200 len: 1320 microversion: 2.1 time: 0.407200 Oct 19 03:13:18.294052 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 170/326] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:13:17 2022] GET /compute/v2.1/servers/6c38df2c-2b90-4a77-b610-8811aa680a81 => generated 1320 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:13:18.312758 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e1962908-232b-45e2-b197-5c6231647811 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:18.313628 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e1962908-232b-45e2-b197-5c6231647811 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] [instance: f476cc02-1b56-4c61-93a4-c3d36c38792d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:18.331660 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e1962908-232b-45e2-b197-5c6231647811 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:18.333226 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e1962908-232b-45e2-b197-5c6231647811 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:18.334220 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e1962908-232b-45e2-b197-5c6231647811 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:18.335243 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e1962908-232b-45e2-b197-5c6231647811 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:18.337237 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e1962908-232b-45e2-b197-5c6231647811 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:18.338996 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e1962908-232b-45e2-b197-5c6231647811 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:18.789493 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-488f3008-4c82-4936-b797-656187d9f7f4 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:18.798540 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-488f3008-4c82-4936-b797-656187d9f7f4 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a" status: 200 len: 1472 microversion: 2.1 time: 0.601549 Oct 19 03:13:18.799701 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 157/327] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:13:18 2022] GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a => generated 1472 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:13:18.856079 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-e1962908-232b-45e2-b197-5c6231647811 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cc37ae4bed94a7e85ed70dd5942c2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df99b134b20743eb9b62788706f2705a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:18.867913 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e1962908-232b-45e2-b197-5c6231647811 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] 10.222.0.52 "GET /compute/v2.1/servers/f476cc02-1b56-4c61-93a4-c3d36c38792d" status: 200 len: 1587 microversion: 2.1 time: 0.572712 Oct 19 03:13:18.872295 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 171/328] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:13:18 2022] GET /compute/v2.1/servers/f476cc02-1b56-4c61-93a4-c3d36c38792d => generated 1587 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:13:18.905266 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e81edf38-504e-4439-a2f8-232bbe6a89c7 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:18.906080 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e81edf38-504e-4439-a2f8-232bbe6a89c7 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] [instance: f476cc02-1b56-4c61-93a4-c3d36c38792d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:18.920286 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e81edf38-504e-4439-a2f8-232bbe6a89c7 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:18.927035 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e81edf38-504e-4439-a2f8-232bbe6a89c7 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:18.927035 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e81edf38-504e-4439-a2f8-232bbe6a89c7 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:18.927035 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e81edf38-504e-4439-a2f8-232bbe6a89c7 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:18.934252 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e81edf38-504e-4439-a2f8-232bbe6a89c7 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:18.937994 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e81edf38-504e-4439-a2f8-232bbe6a89c7 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:19.304428 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e81edf38-504e-4439-a2f8-232bbe6a89c7 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] 10.222.0.52 "GET /compute/v2.1/servers/f476cc02-1b56-4c61-93a4-c3d36c38792d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.409336 Oct 19 03:13:19.305992 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 158/329] 10.222.0.52 () {58 vars in 1275 bytes} [Wed Oct 19 03:13:18 2022] GET /compute/v2.1/servers/f476cc02-1b56-4c61-93a4-c3d36c38792d/os-interface => generated 284 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:13:19.321522 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ca8d479a-2682-4cf1-91c8-adb60abdc190 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:19.322696 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ca8d479a-2682-4cf1-91c8-adb60abdc190 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] [instance: 6c38df2c-2b90-4a77-b610-8811aa680a81] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:19.330773 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ca8d479a-2682-4cf1-91c8-adb60abdc190 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:19.331270 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ca8d479a-2682-4cf1-91c8-adb60abdc190 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:19.331706 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ca8d479a-2682-4cf1-91c8-adb60abdc190 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:19.332465 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ca8d479a-2682-4cf1-91c8-adb60abdc190 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:19.332860 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ca8d479a-2682-4cf1-91c8-adb60abdc190 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:19.333285 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ca8d479a-2682-4cf1-91c8-adb60abdc190 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:19.707015 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ca8d479a-2682-4cf1-91c8-adb60abdc190 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '769928c8ecb643fa83a9d58465dcb263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ead65f008349329789135966c031d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:19.725344 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ca8d479a-2682-4cf1-91c8-adb60abdc190 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] 10.222.0.52 "GET /compute/v2.1/servers/6c38df2c-2b90-4a77-b610-8811aa680a81" status: 200 len: 1320 microversion: 2.1 time: 0.407557 Oct 19 03:13:19.729970 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 172/330] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:13:19 2022] GET /compute/v2.1/servers/6c38df2c-2b90-4a77-b610-8811aa680a81 => generated 1320 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:13:19.831295 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e0bcc01b-047d-4cb6-b214-33dcd41bc5f2 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:19.831915 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e0bcc01b-047d-4cb6-b214-33dcd41bc5f2 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 7b4a8cd9-a238-4bff-a002-497dc807bf3a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:19.848723 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e0bcc01b-047d-4cb6-b214-33dcd41bc5f2 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:19.848723 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e0bcc01b-047d-4cb6-b214-33dcd41bc5f2 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:19.848723 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e0bcc01b-047d-4cb6-b214-33dcd41bc5f2 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:19.848723 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e0bcc01b-047d-4cb6-b214-33dcd41bc5f2 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:19.857985 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e0bcc01b-047d-4cb6-b214-33dcd41bc5f2 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:19.857985 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e0bcc01b-047d-4cb6-b214-33dcd41bc5f2 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:20.751966 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-53d1524b-cf64-4b23-afa0-7131a6ebde0c tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:20.752670 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-53d1524b-cf64-4b23-afa0-7131a6ebde0c tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] [instance: 6c38df2c-2b90-4a77-b610-8811aa680a81] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:20.771718 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=6 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:13:20.771718 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-53d1524b-cf64-4b23-afa0-7131a6ebde0c tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:20.774095 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-53d1524b-cf64-4b23-afa0-7131a6ebde0c tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:20.774778 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-53d1524b-cf64-4b23-afa0-7131a6ebde0c tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:20.776043 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-53d1524b-cf64-4b23-afa0-7131a6ebde0c tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:20.776574 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-53d1524b-cf64-4b23-afa0-7131a6ebde0c tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:20.779508 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-53d1524b-cf64-4b23-afa0-7131a6ebde0c tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:21.219004 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e0bcc01b-047d-4cb6-b214-33dcd41bc5f2 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:21.228598 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e0bcc01b-047d-4cb6-b214-33dcd41bc5f2 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a" status: 200 len: 1472 microversion: 2.1 time: 1.403199 Oct 19 03:13:21.235632 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 159/331] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:13:19 2022] GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a => generated 1472 bytes in 1411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:13:21.312671 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-53d1524b-cf64-4b23-afa0-7131a6ebde0c tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '769928c8ecb643fa83a9d58465dcb263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ead65f008349329789135966c031d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:21.324394 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-53d1524b-cf64-4b23-afa0-7131a6ebde0c tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] 10.222.0.52 "GET /compute/v2.1/servers/6c38df2c-2b90-4a77-b610-8811aa680a81" status: 200 len: 1320 microversion: 2.1 time: 0.576142 Oct 19 03:13:21.328787 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 173/332] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:13:20 2022] GET /compute/v2.1/servers/6c38df2c-2b90-4a77-b610-8811aa680a81 => generated 1320 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:13:22.264519 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ba406615-59c9-41ca-9fce-a929fe9526f7 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:22.265865 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ba406615-59c9-41ca-9fce-a929fe9526f7 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 7b4a8cd9-a238-4bff-a002-497dc807bf3a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:22.285474 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ba406615-59c9-41ca-9fce-a929fe9526f7 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:22.285953 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ba406615-59c9-41ca-9fce-a929fe9526f7 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:22.286799 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ba406615-59c9-41ca-9fce-a929fe9526f7 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:22.293842 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ba406615-59c9-41ca-9fce-a929fe9526f7 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:22.293842 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ba406615-59c9-41ca-9fce-a929fe9526f7 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:22.293842 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ba406615-59c9-41ca-9fce-a929fe9526f7 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:22.460627 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ee131647-786c-432c-8a7e-9fb52794aec3 tempest-KeyPairsV210TestJSON-1379463860 tempest-KeyPairsV210TestJSON-1379463860-project-admin] Action: 'create', calling method: .version_select at 0x7fc1316a6670>, body: {"keypair": {"name": "tempest-keypair-1255606440", "type": "ssh", "user_id": "e152f571f7ca42cdb6d8c22163f48d17", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGZZHt/NbFbFlhU3csoTN/u08g9wjlmm+YCBTMnrs/xyuDHrRDCLe+KrXY30B/IitDEdcAxCq+ncldL8GmDk3KJVlMhmIHkyk5Wp1Yp1dQ1R4lHmu/9WRZ1MLAR2ILwf3Q=="}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:13:22.479369 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-ee131647-786c-432c-8a7e-9fb52794aec3 tempest-KeyPairsV210TestJSON-1379463860 tempest-KeyPairsV210TestJSON-1379463860-project-admin] Getting quotas for project 6ed47562638c4df09376abfa09231204. Resources: {'key_pairs'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:13:22.484623 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-ee131647-786c-432c-8a7e-9fb52794aec3 tempest-KeyPairsV210TestJSON-1379463860 tempest-KeyPairsV210TestJSON-1379463860-project-admin] Getting quotas for user b668773051714312b5e4625b5b8cfc09 and project 6ed47562638c4df09376abfa09231204. Resources: {'key_pairs'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:13:22.679654 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ee131647-786c-432c-8a7e-9fb52794aec3 tempest-KeyPairsV210TestJSON-1379463860 tempest-KeyPairsV210TestJSON-1379463860-project-admin] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.582336 Oct 19 03:13:22.680602 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 160/333] 10.222.0.52 () {62 vars in 1200 bytes} [Wed Oct 19 03:13:22 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 584 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 19 03:13:22.685150 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d012f9d2-fd13-4270-a162-5563c2ebc8e8 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:22.686298 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d012f9d2-fd13-4270-a162-5563c2ebc8e8 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] [instance: 6c38df2c-2b90-4a77-b610-8811aa680a81] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:22.700125 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d012f9d2-fd13-4270-a162-5563c2ebc8e8 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:22.700626 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d012f9d2-fd13-4270-a162-5563c2ebc8e8 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:22.701715 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d012f9d2-fd13-4270-a162-5563c2ebc8e8 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:22.702428 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d012f9d2-fd13-4270-a162-5563c2ebc8e8 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:22.702897 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d012f9d2-fd13-4270-a162-5563c2ebc8e8 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:22.703329 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d012f9d2-fd13-4270-a162-5563c2ebc8e8 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:22.713532 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ba406615-59c9-41ca-9fce-a929fe9526f7 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:22.722825 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ba406615-59c9-41ca-9fce-a929fe9526f7 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a" status: 200 len: 1472 microversion: 2.1 time: 0.464199 Oct 19 03:13:22.723864 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 174/334] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:13:22 2022] GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a => generated 1472 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:13:22.735513 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-04e1b2ce-b05c-4a27-8569-84e4e33ec243 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:22.736849 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-04e1b2ce-b05c-4a27-8569-84e4e33ec243 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] [instance: f476cc02-1b56-4c61-93a4-c3d36c38792d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:22.750871 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-04e1b2ce-b05c-4a27-8569-84e4e33ec243 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:22.753301 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-04e1b2ce-b05c-4a27-8569-84e4e33ec243 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:22.753786 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-04e1b2ce-b05c-4a27-8569-84e4e33ec243 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:22.754506 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-04e1b2ce-b05c-4a27-8569-84e4e33ec243 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:22.754958 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-04e1b2ce-b05c-4a27-8569-84e4e33ec243 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:22.758339 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-04e1b2ce-b05c-4a27-8569-84e4e33ec243 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:23.163691 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d012f9d2-fd13-4270-a162-5563c2ebc8e8 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '769928c8ecb643fa83a9d58465dcb263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ead65f008349329789135966c031d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:23.203766 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d012f9d2-fd13-4270-a162-5563c2ebc8e8 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] 10.222.0.52 "GET /compute/v2.1/servers/6c38df2c-2b90-4a77-b610-8811aa680a81" status: 200 len: 1320 microversion: 2.1 time: 0.517439 Oct 19 03:13:23.211637 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 161/335] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:13:22 2022] GET /compute/v2.1/servers/6c38df2c-2b90-4a77-b610-8811aa680a81 => generated 1320 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:13:23.241805 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-04e1b2ce-b05c-4a27-8569-84e4e33ec243 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cc37ae4bed94a7e85ed70dd5942c2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df99b134b20743eb9b62788706f2705a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:23.256507 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-7dea9b83-e913-4375-a164-8d3dd0e3081d req-d072228e-9fa5-48e8-a314-db4a2f01db4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f476cc02-1b56-4c61-93a4-c3d36c38792d", "tag": "e7234846-076a-4f8d-9318-716ced0a591c"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:13:23.276938 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-04e1b2ce-b05c-4a27-8569-84e4e33ec243 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] 10.222.0.52 "GET /compute/v2.1/servers/f476cc02-1b56-4c61-93a4-c3d36c38792d" status: 200 len: 1587 microversion: 2.1 time: 0.549065 Oct 19 03:13:23.279916 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 175/336] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:13:22 2022] GET /compute/v2.1/servers/f476cc02-1b56-4c61-93a4-c3d36c38792d => generated 1587 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:13:23.287975 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-7dea9b83-e913-4375-a164-8d3dd0e3081d req-d072228e-9fa5-48e8-a314-db4a2f01db4e service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:23.288252 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-625937ef-6ae2-4c49-94cb-6baaa1bb285e tempest-KeyPairsV210TestJSON-1379463860 tempest-KeyPairsV210TestJSON-1379463860-project-admin] Action: 'create', calling method: .version_select at 0x7fc1316c9430>, body: {"keypair": {"name": "tempest-keypair-1389078870", "type": "ssh", "user_id": "e152f571f7ca42cdb6d8c22163f48d17", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBB90qnofb8BHXD80KA11r7Ra7trcPPidX1Zf3yqrl7fm8T0kV5AaAgRlcdFvjadNTtt80qDgPjgIYqu27+taUqCyPbdYM4Vtlp78LgJOcX1a66LN/xESz0JyIIJm/KEGg=="}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:13:23.290340 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-7dea9b83-e913-4375-a164-8d3dd0e3081d req-d072228e-9fa5-48e8-a314-db4a2f01db4e service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:23.292081 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-7dea9b83-e913-4375-a164-8d3dd0e3081d req-d072228e-9fa5-48e8-a314-db4a2f01db4e service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:23.319357 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-7dea9b83-e913-4375-a164-8d3dd0e3081d req-d072228e-9fa5-48e8-a314-db4a2f01db4e service nova] Creating event network-changed:e7234846-076a-4f8d-9318-716ced0a591c for instance f476cc02-1b56-4c61-93a4-c3d36c38792d on n-h1-861333-8 Oct 19 03:13:23.344869 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-7dea9b83-e913-4375-a164-8d3dd0e3081d req-d072228e-9fa5-48e8-a314-db4a2f01db4e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128917 Oct 19 03:13:23.346867 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 162/337] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:13:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:13:23.386997 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-625937ef-6ae2-4c49-94cb-6baaa1bb285e tempest-KeyPairsV210TestJSON-1379463860 tempest-KeyPairsV210TestJSON-1379463860-project-admin] Getting quotas for project 6ed47562638c4df09376abfa09231204. Resources: {'key_pairs'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:13:23.396577 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-625937ef-6ae2-4c49-94cb-6baaa1bb285e tempest-KeyPairsV210TestJSON-1379463860 tempest-KeyPairsV210TestJSON-1379463860-project-admin] Getting quotas for user b668773051714312b5e4625b5b8cfc09 and project 6ed47562638c4df09376abfa09231204. Resources: {'key_pairs'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:13:23.512342 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-625937ef-6ae2-4c49-94cb-6baaa1bb285e tempest-KeyPairsV210TestJSON-1379463860 tempest-KeyPairsV210TestJSON-1379463860-project-admin] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.227853 Oct 19 03:13:23.517667 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 176/338] 10.222.0.52 () {62 vars in 1200 bytes} [Wed Oct 19 03:13:23 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 235 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 19 03:13:23.526787 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c16a9e2c-e5d0-4ce0-8cd3-6cbeb5d8bac0 tempest-KeyPairsV210TestJSON-1379463860 tempest-KeyPairsV210TestJSON-1379463860-project-admin] Calling method '.version_select at 0x7fc1315b7820>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:23.547804 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c16a9e2c-e5d0-4ce0-8cd3-6cbeb5d8bac0 tempest-KeyPairsV210TestJSON-1379463860 tempest-KeyPairsV210TestJSON-1379463860-project-admin] 10.222.0.52 "GET /compute/v2.1/os-keypairs/tempest-keypair-1255606440?user_id=e152f571f7ca42cdb6d8c22163f48d17" status: 200 len: 512 microversion: 2.10 time: 0.025259 Oct 19 03:13:23.549056 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 163/339] 10.222.0.52 () {60 vars in 1340 bytes} [Wed Oct 19 03:13:23 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1255606440?user_id=e152f571f7ca42cdb6d8c22163f48d17 => generated 512 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 03:13:23.564656 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2f1890ae-a60d-47e8-bb98-9abd5eb9c925 tempest-KeyPairsV210TestJSON-1379463860 tempest-KeyPairsV210TestJSON-1379463860-project-admin] Action: 'create', calling method: .version_select at 0x7fc13162a820>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-578354930", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPC/7exiLoWUYiCgYaRZ05jqwqflDnNQ4DeOmrGvYFp4b3icVMS5/iDuTAUntewvlAHzI9ibpSArmPkMyIaPxTBGqNf86fCn8uiYTF+u52jTTVqGo4SprT7XNiveF7UEqA=="}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:13:23.596879 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-2f1890ae-a60d-47e8-bb98-9abd5eb9c925 tempest-KeyPairsV210TestJSON-1379463860 tempest-KeyPairsV210TestJSON-1379463860-project-admin] Getting quotas for project 6ed47562638c4df09376abfa09231204. Resources: {'key_pairs'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:13:23.606842 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-2f1890ae-a60d-47e8-bb98-9abd5eb9c925 tempest-KeyPairsV210TestJSON-1379463860 tempest-KeyPairsV210TestJSON-1379463860-project-admin] Getting quotas for user b668773051714312b5e4625b5b8cfc09 and project 6ed47562638c4df09376abfa09231204. Resources: {'key_pairs'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:13:23.725646 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2f1890ae-a60d-47e8-bb98-9abd5eb9c925 tempest-KeyPairsV210TestJSON-1379463860 tempest-KeyPairsV210TestJSON-1379463860-project-admin] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.10 time: 0.164764 Oct 19 03:13:23.726596 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 177/340] 10.222.0.52 () {62 vars in 1200 bytes} [Wed Oct 19 03:13:23 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 166 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 19 03:13:23.738671 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2bef13e4-caae-4a26-80f0-a778cb48d278 tempest-KeyPairsV210TestJSON-1379463860 tempest-KeyPairsV210TestJSON-1379463860-project-admin] Calling method '.version_select at 0x7fc1315b71f0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:23.743856 n-d-861333-8 devstack@n-api.service[121134]: WARNING oslo_db.sqlalchemy.utils [None req-2bef13e4-caae-4a26-80f0-a778cb48d278 tempest-KeyPairsV210TestJSON-1379463860 tempest-KeyPairsV210TestJSON-1379463860-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Oct 19 03:13:23.750446 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-8f70c9b8-a777-4524-9e1f-48a60f364439 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:23.751784 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-8f70c9b8-a777-4524-9e1f-48a60f364439 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 7b4a8cd9-a238-4bff-a002-497dc807bf3a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:23.764847 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=8 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:13:23.767775 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8f70c9b8-a777-4524-9e1f-48a60f364439 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:23.771030 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2bef13e4-caae-4a26-80f0-a778cb48d278 tempest-KeyPairsV210TestJSON-1379463860 tempest-KeyPairsV210TestJSON-1379463860-project-admin] 10.222.0.52 "GET /compute/v2.1/os-keypairs?user_id=e152f571f7ca42cdb6d8c22163f48d17" status: 200 len: 726 microversion: 2.10 time: 0.037261 Oct 19 03:13:23.772697 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8f70c9b8-a777-4524-9e1f-48a60f364439 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:23.773606 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8f70c9b8-a777-4524-9e1f-48a60f364439 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:23.774722 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8f70c9b8-a777-4524-9e1f-48a60f364439 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:23.781773 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8f70c9b8-a777-4524-9e1f-48a60f364439 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:23.781773 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8f70c9b8-a777-4524-9e1f-48a60f364439 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:23.782034 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 164/341] 10.222.0.52 () {60 vars in 1259 bytes} [Wed Oct 19 03:13:23 2022] GET /compute/v2.1/os-keypairs?user_id=e152f571f7ca42cdb6d8c22163f48d17 => generated 726 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 03:13:23.789088 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b0a17d79-61a9-4a1a-8a3b-e6415fa143e0 tempest-KeyPairsV210TestJSON-1379463860 tempest-KeyPairsV210TestJSON-1379463860-project-admin] Calling method '.version_select at 0x7fc1316b9ca0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:23.901808 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b0a17d79-61a9-4a1a-8a3b-e6415fa143e0 tempest-KeyPairsV210TestJSON-1379463860 tempest-KeyPairsV210TestJSON-1379463860-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-578354930" status: 204 len: 0 microversion: 2.10 time: 0.118319 Oct 19 03:13:23.902681 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 165/342] 10.222.0.52 () {60 vars in 1322 bytes} [Wed Oct 19 03:13:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-578354930 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 19 03:13:24.144951 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d99b5204-373b-4268-bc59-c6aa27468143 tempest-FlavorsV261TestJSON-1790802581 tempest-FlavorsV261TestJSON-1790802581-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-865193147", "id": 444916912, "os-flavor-access:is_public": "True"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:13:24.236082 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-8f70c9b8-a777-4524-9e1f-48a60f364439 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:24.246698 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-8f70c9b8-a777-4524-9e1f-48a60f364439 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a" status: 200 len: 1472 microversion: 2.1 time: 0.501173 Oct 19 03:13:24.247580 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 178/343] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:13:23 2022] GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a => generated 1472 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:13:24.252411 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ec161b47-f012-41a9-bf1d-4b26050e0cb7 tempest-KeyPairsV210TestJSON-1379463860 tempest-KeyPairsV210TestJSON-1379463860-project-admin] Calling method '.version_select at 0x7fc1316c1c10>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:24.286593 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d99b5204-373b-4268-bc59-c6aa27468143 tempest-FlavorsV261TestJSON-1790802581 tempest-FlavorsV261TestJSON-1790802581-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 464 microversion: 2.61 time: 0.382577 Oct 19 03:13:24.299435 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 166/344] 10.222.0.52 () {62 vars in 1188 bytes} [Wed Oct 19 03:13:23 2022] POST /compute/v2.1/flavors => generated 464 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 03:13:24.304431 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-04422f22-ebd8-4c7c-99c7-1dfcfce2506e req-a5f79acb-388b-4417-b887-2bf5bc99cf00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c38df2c-2b90-4a77-b610-8811aa680a81", "name": "network-vif-plugged", "status": "completed", "tag": "ae26118f-2661-4320-94d0-e41fe6dfbb92"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:13:24.316420 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-04422f22-ebd8-4c7c-99c7-1dfcfce2506e req-a5f79acb-388b-4417-b887-2bf5bc99cf00 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:24.317099 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-04422f22-ebd8-4c7c-99c7-1dfcfce2506e req-a5f79acb-388b-4417-b887-2bf5bc99cf00 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:24.317728 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-04422f22-ebd8-4c7c-99c7-1dfcfce2506e req-a5f79acb-388b-4417-b887-2bf5bc99cf00 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:24.331856 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-04422f22-ebd8-4c7c-99c7-1dfcfce2506e req-a5f79acb-388b-4417-b887-2bf5bc99cf00 service nova] Creating event network-vif-plugged:ae26118f-2661-4320-94d0-e41fe6dfbb92 for instance 6c38df2c-2b90-4a77-b610-8811aa680a81 on n-h2-861333-8 Oct 19 03:13:24.340724 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-04422f22-ebd8-4c7c-99c7-1dfcfce2506e req-a5f79acb-388b-4417-b887-2bf5bc99cf00 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039784 Oct 19 03:13:24.341844 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 167/345] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:13:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:13:24.348487 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-98d4c51d-64c1-445f-b9cc-0e2141117b22 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:24.351090 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-98d4c51d-64c1-445f-b9cc-0e2141117b22 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] [instance: 6c38df2c-2b90-4a77-b610-8811aa680a81] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:24.358677 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-98d4c51d-64c1-445f-b9cc-0e2141117b22 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:24.365467 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ec161b47-f012-41a9-bf1d-4b26050e0cb7 tempest-KeyPairsV210TestJSON-1379463860 tempest-KeyPairsV210TestJSON-1379463860-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1389078870?user_id=e152f571f7ca42cdb6d8c22163f48d17" status: 204 len: 0 microversion: 2.10 time: 0.116053 Oct 19 03:13:24.367678 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 179/346] 10.222.0.52 () {60 vars in 1343 bytes} [Wed Oct 19 03:13:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1389078870?user_id=e152f571f7ca42cdb6d8c22163f48d17 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 19 03:13:24.371306 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-98d4c51d-64c1-445f-b9cc-0e2141117b22 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:24.374062 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-98d4c51d-64c1-445f-b9cc-0e2141117b22 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:24.375001 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-98d4c51d-64c1-445f-b9cc-0e2141117b22 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:24.375634 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-98d4c51d-64c1-445f-b9cc-0e2141117b22 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:24.376219 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-98d4c51d-64c1-445f-b9cc-0e2141117b22 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:24.757798 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-942acadb-03d5-4144-ba7c-429b9d54d4cb tempest-FlavorsV261TestJSON-1405950897 tempest-FlavorsV261TestJSON-1405950897-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:24.769226 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-942acadb-03d5-4144-ba7c-429b9d54d4cb tempest-FlavorsV261TestJSON-1405950897 tempest-FlavorsV261TestJSON-1405950897-project] 10.222.0.52 "GET /compute/v2.1/flavors/444916912" status: 200 len: 464 microversion: 2.61 time: 0.400341 Oct 19 03:13:24.780151 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 180/347] 10.222.0.52 () {60 vars in 1196 bytes} [Wed Oct 19 03:13:24 2022] GET /compute/v2.1/flavors/444916912 => generated 464 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 03:13:24.785413 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6e534e64-26c3-4f8c-b530-c71094b2d21f tempest-KeyPairsV210TestJSON-1379463860 tempest-KeyPairsV210TestJSON-1379463860-project-admin] Calling method '.version_select at 0x7fc1316c9e50>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:24.870390 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6e534e64-26c3-4f8c-b530-c71094b2d21f tempest-KeyPairsV210TestJSON-1379463860 tempest-KeyPairsV210TestJSON-1379463860-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1255606440?user_id=e152f571f7ca42cdb6d8c22163f48d17" status: 204 len: 0 microversion: 2.10 time: 0.088773 Oct 19 03:13:24.871900 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 181/348] 10.222.0.52 () {60 vars in 1343 bytes} [Wed Oct 19 03:13:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1255606440?user_id=e152f571f7ca42cdb6d8c22163f48d17 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 19 03:13:25.016234 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-98d4c51d-64c1-445f-b9cc-0e2141117b22 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '769928c8ecb643fa83a9d58465dcb263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ead65f008349329789135966c031d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:25.022885 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-580534dd-ba03-40f1-a923-b8dc80bb7e4b tempest-FlavorsExtraSpecsNegativeTestJSON-148837358 tempest-FlavorsExtraSpecsNegativeTestJSON-148837358-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-806936010", "ram": 512, "vcpus": 1, "disk": 10, "id": 322413469, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:13:25.040947 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-98d4c51d-64c1-445f-b9cc-0e2141117b22 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] 10.222.0.52 "GET /compute/v2.1/servers/6c38df2c-2b90-4a77-b610-8811aa680a81" status: 200 len: 1320 microversion: 2.1 time: 0.696714 Oct 19 03:13:25.042680 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 168/349] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:13:24 2022] GET /compute/v2.1/servers/6c38df2c-2b90-4a77-b610-8811aa680a81 => generated 1320 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:13:25.054638 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-fa82968c-6282-483f-b072-135809798b77 tempest-FlavorsV261TestJSON-1790802581 tempest-FlavorsV261TestJSON-1790802581-project-admin] Action: 'update', calling method: .version_select at 0x7fc132c31d30>, body: {"flavor": {"description": "new"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:13:25.146880 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-580534dd-ba03-40f1-a923-b8dc80bb7e4b tempest-FlavorsExtraSpecsNegativeTestJSON-148837358 tempest-FlavorsExtraSpecsNegativeTestJSON-148837358-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.271163 Oct 19 03:13:25.148030 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 182/350] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:13:24 2022] POST /compute/v2.1/flavors => generated 412 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:13:25.215678 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-fa82968c-6282-483f-b072-135809798b77 tempest-FlavorsV261TestJSON-1790802581 tempest-FlavorsV261TestJSON-1790802581-project-admin] 10.222.0.52 "PUT /compute/v2.1/flavors/444916912" status: 200 len: 465 microversion: 2.61 time: 0.170972 Oct 19 03:13:25.217677 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 169/351] 10.222.0.52 () {62 vars in 1216 bytes} [Wed Oct 19 03:13:25 2022] PUT /compute/v2.1/flavors/444916912 => generated 465 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 03:13:25.236911 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-bfd7ce9d-c671-462f-8c23-a6c3f15adc69 tempest-FlavorsV261TestJSON-1405950897 tempest-FlavorsV261TestJSON-1405950897-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:25.326216 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-bfd7ce9d-c671-462f-8c23-a6c3f15adc69 tempest-FlavorsV261TestJSON-1405950897 tempest-FlavorsV261TestJSON-1405950897-project] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 7591 microversion: 2.61 time: 0.097313 Oct 19 03:13:25.327136 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 170/352] 10.222.0.52 () {60 vars in 1187 bytes} [Wed Oct 19 03:13:25 2022] GET /compute/v2.1/flavors/detail => generated 7591 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:13:25.342807 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b41e1e7a-1b85-4de9-bf7c-0abc68d51969 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:25.346451 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b41e1e7a-1b85-4de9-bf7c-0abc68d51969 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 7b4a8cd9-a238-4bff-a002-497dc807bf3a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:25.371688 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b41e1e7a-1b85-4de9-bf7c-0abc68d51969 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:25.375500 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b41e1e7a-1b85-4de9-bf7c-0abc68d51969 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:25.375992 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b41e1e7a-1b85-4de9-bf7c-0abc68d51969 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:25.381052 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b41e1e7a-1b85-4de9-bf7c-0abc68d51969 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:25.381052 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b41e1e7a-1b85-4de9-bf7c-0abc68d51969 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:25.381052 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b41e1e7a-1b85-4de9-bf7c-0abc68d51969 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:25.539136 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3b9991da-8899-4b51-949b-21c22504571a tempest-FlavorsExtraSpecsNegativeTestJSON-1966553696 tempest-FlavorsExtraSpecsNegativeTestJSON-1966553696-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:25.558628 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-3b9991da-8899-4b51-949b-21c22504571a tempest-FlavorsExtraSpecsNegativeTestJSON-1966553696 tempest-FlavorsExtraSpecsNegativeTestJSON-1966553696-project] HTTP exception thrown: Flavor 322413469 has no extra specs with key hw:cpu_thread_policy. Oct 19 03:13:25.569626 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3b9991da-8899-4b51-949b-21c22504571a tempest-FlavorsExtraSpecsNegativeTestJSON-1966553696 tempest-FlavorsExtraSpecsNegativeTestJSON-1966553696-project] Request method failure captured: Oct 19 03:13:25.569626 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/flavors/322413469/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 19 03:13:25.569626 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:13:25.569626 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:13:25.569626 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:13:25.569626 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:13:25.569626 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:13:25.569626 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:13:25.569626 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:13:25.569626 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:13:25.569626 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2tTpaxuqk_YvE7_M922vI7-B33HMe_e73mkW85h_XD5DK5NVg_K1-MF682TBWW1TxoQ4Ry6MGMeXqXIiDF1yjifv88224TI59AneR9jd9YWu7Ex23YPLc75Z1NTH16fnMT1U57EJ1wuzHroV12ezM3_iWFS4KkjtVjdrlVyuXwEHV0 Oct 19 03:13:25.569626 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:13:25.569626 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:13:25.569626 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:13:25.569626 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:13:25.569626 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:13:25.569626 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:13:25.569626 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 7d3c36f4a2dc483db8338a85b07e4014 Oct 19 03:13:25.569626 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1966553696 Oct 19 03:13:25.569626 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:13:25.569626 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:13:25.571103 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7d3c36f4a2dc483db8338a85b07e4014"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7d3c36f4a2dc483db8338a85b07e4014"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7d3c36f4a2dc483db8338a85b07e4014"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7d3c36f4a2dc483db8338a85b07e4014", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:13:25.571103 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1966553696 Oct 19 03:13:25.571103 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 7d3c36f4a2dc483db8338a85b07e4014 Oct 19 03:13:25.571103 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1966553696 Oct 19 03:13:25.571103 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1966553696-project Oct 19 03:13:25.571103 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:13:25.571103 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:13:25.571103 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 1f6b041b07a44fbfb76e9d847ed94e50 Oct 19 03:13:25.571103 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1966553696-project Oct 19 03:13:25.571103 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:13:25.571103 n-d-861333-8 devstack@n-api.service[121135]: exception: Flavor 322413469 has no extra specs with key hw:cpu_thread_policy. Oct 19 03:13:25.572253 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'flavor_id': '322413469', 'id': 'hw:cpu_thread_policy'} Oct 19 03:13:25.572253 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:13:25.572253 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:25.572253 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Oct 19 03:13:25.572253 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Oct 19 03:13:25.572253 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 19 03:13:25.572253 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:25.572253 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:13:25.572253 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:25.572253 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:25.572253 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:13:25.572253 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:13:25.572253 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:13:25.572253 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:13:25.572253 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:13:25.572253 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:13:25.572253 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Oct 19 03:13:25.572253 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 19 03:13:25.572253 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 322413469 has no extra specs with key hw:cpu_thread_policy. Oct 19 03:13:25.572253 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:25.572253 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:13:25.572253 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:25.574237 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:25.574237 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:13:25.574237 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:13:25.574237 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:13:25.574237 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:13:25.574237 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 322413469 has no extra specs with key hw:cpu_thread_policy. Oct 19 03:13:25.574237 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:25.575042 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3b9991da-8899-4b51-949b-21c22504571a tempest-FlavorsExtraSpecsNegativeTestJSON-1966553696 tempest-FlavorsExtraSpecsNegativeTestJSON-1966553696-project] Returning 404 to user: Flavor 322413469 has no extra specs with key hw:cpu_thread_policy. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:13:25.580046 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-3b9991da-8899-4b51-949b-21c22504571a tempest-FlavorsExtraSpecsNegativeTestJSON-1966553696 tempest-FlavorsExtraSpecsNegativeTestJSON-1966553696-project] 10.222.0.52 "GET /compute/v2.1/flavors/322413469/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.419548 Oct 19 03:13:25.585292 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 183/353] 10.222.0.52 () {58 vars in 1263 bytes} [Wed Oct 19 03:13:25 2022] GET /compute/v2.1/flavors/322413469/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 424 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:13:25.607867 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-dad41420-bcea-4fd6-8b01-29c7543817b4 tempest-FlavorsV261TestJSON-1405950897 tempest-FlavorsV261TestJSON-1405950897-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:25.699486 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-dad41420-bcea-4fd6-8b01-29c7543817b4 tempest-FlavorsV261TestJSON-1405950897 tempest-FlavorsV261TestJSON-1405950897-project] 10.222.0.52 "GET /compute/v2.1/flavors" status: 200 len: 3925 microversion: 2.61 time: 0.107366 Oct 19 03:13:25.700776 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 184/354] 10.222.0.52 () {60 vars in 1166 bytes} [Wed Oct 19 03:13:25 2022] GET /compute/v2.1/flavors => generated 3925 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:13:25.707386 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-86fb5e8f-e90c-4248-ad66-8951d90820f3 tempest-FlavorsExtraSpecsNegativeTestJSON-1966553696 tempest-FlavorsExtraSpecsNegativeTestJSON-1966553696-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:13:25.712201 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-86fb5e8f-e90c-4248-ad66-8951d90820f3 tempest-FlavorsExtraSpecsNegativeTestJSON-1966553696 tempest-FlavorsExtraSpecsNegativeTestJSON-1966553696-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '1f6b041b07a44fbfb76e9d847ed94e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3c36f4a2dc483db8338a85b07e4014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:25.714411 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-86fb5e8f-e90c-4248-ad66-8951d90820f3 tempest-FlavorsExtraSpecsNegativeTestJSON-1966553696 tempest-FlavorsExtraSpecsNegativeTestJSON-1966553696-project] Request method failure captured: Oct 19 03:13:25.714411 n-d-861333-8 devstack@n-api.service[121135]: request: POST /compute/v2.1/flavors/322413469/os-extra_specs HTTP/1.1 Oct 19 03:13:25.714411 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:13:25.714411 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:13:25.714411 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:13:25.714411 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 66 Oct 19 03:13:25.714411 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:13:25.714411 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:13:25.714411 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:13:25.714411 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:13:25.714411 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2tTpaxuqk_YvE7_M922vI7-B33HMe_e73mkW85h_XD5DK5NVg_K1-MF682TBWW1TxoQ4Ry6MGMeXqXIiDF1yjifv88224TI59AneR9jd9YWu7Ex23YPLc75Z1NTH16fnMT1U57EJ1wuzHroV12ezM3_iWFS4KkjtVjdrlVyuXwEHV0 Oct 19 03:13:25.714411 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:13:25.714411 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:13:25.714411 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:13:25.714411 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:13:25.714411 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:13:25.714411 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:13:25.714411 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 7d3c36f4a2dc483db8338a85b07e4014 Oct 19 03:13:25.714411 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1966553696 Oct 19 03:13:25.714411 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:13:25.714411 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:13:25.718857 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7d3c36f4a2dc483db8338a85b07e4014"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7d3c36f4a2dc483db8338a85b07e4014"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7d3c36f4a2dc483db8338a85b07e4014"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7d3c36f4a2dc483db8338a85b07e4014", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:13:25.718857 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1966553696 Oct 19 03:13:25.718857 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 7d3c36f4a2dc483db8338a85b07e4014 Oct 19 03:13:25.718857 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1966553696 Oct 19 03:13:25.718857 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1966553696-project Oct 19 03:13:25.718857 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:13:25.718857 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:13:25.718857 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 1f6b041b07a44fbfb76e9d847ed94e50 Oct 19 03:13:25.718857 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1966553696-project Oct 19 03:13:25.718857 n-d-861333-8 devstack@n-api.service[121135]: Oct 19 03:13:25.718857 n-d-861333-8 devstack@n-api.service[121135]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Oct 19 03:13:25.718857 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:13:25.719539 n-d-861333-8 devstack@n-api.service[121135]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 19 03:13:25.719539 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'flavor_id': '322413469', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Oct 19 03:13:25.719539 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:13:25.719539 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:25.719539 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:13:25.719539 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:13:25.719539 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:13:25.719539 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:13:25.719539 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:13:25.719539 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:13:25.719539 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:13:25.719539 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:13:25.719539 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Oct 19 03:13:25.719539 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Oct 19 03:13:25.719539 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 19 03:13:25.719539 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 19 03:13:25.719539 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 19 03:13:25.719539 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 19 03:13:25.719539 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 03:13:25.720684 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 03:13:25.720684 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 03:13:25.720684 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 03:13:25.720684 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 19 03:13:25.720684 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 19 03:13:25.720684 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 19 03:13:25.720684 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 19 03:13:25.720684 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 19 03:13:25.720684 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 19 03:13:25.720684 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 19 03:13:25.720684 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:25.720684 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:13:25.720684 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:25.720684 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:25.720684 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:13:25.720684 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:13:25.720684 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 19 03:13:25.720684 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 19 03:13:25.720684 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 19 03:13:25.720684 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:25.721936 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-86fb5e8f-e90c-4248-ad66-8951d90820f3 tempest-FlavorsExtraSpecsNegativeTestJSON-1966553696 tempest-FlavorsExtraSpecsNegativeTestJSON-1966553696-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:13:25.721936 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-86fb5e8f-e90c-4248-ad66-8951d90820f3 tempest-FlavorsExtraSpecsNegativeTestJSON-1966553696 tempest-FlavorsExtraSpecsNegativeTestJSON-1966553696-project] 10.222.0.52 "POST /compute/v2.1/flavors/322413469/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.015744 Oct 19 03:13:25.729496 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 185/355] 10.222.0.52 () {60 vars in 1221 bytes} [Wed Oct 19 03:13:25 2022] POST /compute/v2.1/flavors/322413469/os-extra_specs => generated 124 bytes in 28 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:13:25.734700 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b41e1e7a-1b85-4de9-bf7c-0abc68d51969 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:25.755358 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b41e1e7a-1b85-4de9-bf7c-0abc68d51969 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a" status: 200 len: 1472 microversion: 2.1 time: 0.426719 Oct 19 03:13:25.756301 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 171/356] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:13:25 2022] GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a => generated 1472 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:13:25.759798 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-734677d7-f7af-4a41-b608-df2129075a67 tempest-FlavorsV261TestJSON-1790802581 tempest-FlavorsV261TestJSON-1790802581-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:25.764371 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-cabc4778-d0f0-4b27-9e25-dca677ad48a2 tempest-FlavorsExtraSpecsNegativeTestJSON-148837358 tempest-FlavorsExtraSpecsNegativeTestJSON-148837358-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:13:25.892579 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-734677d7-f7af-4a41-b608-df2129075a67 tempest-FlavorsV261TestJSON-1790802581 tempest-FlavorsV261TestJSON-1790802581-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/444916912" status: 202 len: 0 microversion: 2.61 time: 0.145827 Oct 19 03:13:25.894440 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 186/357] 10.222.0.52 () {60 vars in 1199 bytes} [Wed Oct 19 03:13:25 2022] DELETE /compute/v2.1/flavors/444916912 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:13:25.905732 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-fd305c44-c0f8-4285-9237-5ba0106f7b0c tempest-FlavorsV261TestJSON-1790802581 tempest-FlavorsV261TestJSON-1790802581-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:25.950304 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-fd305c44-c0f8-4285-9237-5ba0106f7b0c tempest-FlavorsV261TestJSON-1790802581 tempest-FlavorsV261TestJSON-1790802581-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 7136 microversion: 2.61 time: 0.051193 Oct 19 03:13:25.952030 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 187/358] 10.222.0.52 () {60 vars in 1187 bytes} [Wed Oct 19 03:13:25 2022] GET /compute/v2.1/flavors/detail => generated 7136 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:13:26.010941 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-cabc4778-d0f0-4b27-9e25-dca677ad48a2 tempest-FlavorsExtraSpecsNegativeTestJSON-148837358 tempest-FlavorsExtraSpecsNegativeTestJSON-148837358-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors/322413469/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.251662 Oct 19 03:13:26.017978 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 172/359] 10.222.0.52 () {60 vars in 1221 bytes} [Wed Oct 19 03:13:25 2022] POST /compute/v2.1/flavors/322413469/os-extra_specs => generated 66 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 03:13:26.024941 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-605349de-6249-409e-a0c4-e8a1b994c1aa tempest-FlavorsExtraSpecsNegativeTestJSON-1966553696 tempest-FlavorsExtraSpecsNegativeTestJSON-1966553696-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:26.027764 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-605349de-6249-409e-a0c4-e8a1b994c1aa tempest-FlavorsExtraSpecsNegativeTestJSON-1966553696 tempest-FlavorsExtraSpecsNegativeTestJSON-1966553696-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '1f6b041b07a44fbfb76e9d847ed94e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3c36f4a2dc483db8338a85b07e4014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:26.032982 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-605349de-6249-409e-a0c4-e8a1b994c1aa tempest-FlavorsExtraSpecsNegativeTestJSON-1966553696 tempest-FlavorsExtraSpecsNegativeTestJSON-1966553696-project] Request method failure captured: Oct 19 03:13:26.032982 n-d-861333-8 devstack@n-api.service[121135]: request: DELETE /compute/v2.1/flavors/322413469/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 19 03:13:26.032982 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:13:26.032982 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:13:26.032982 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:13:26.032982 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:13:26.032982 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:13:26.032982 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:13:26.032982 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:13:26.032982 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:13:26.032982 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2tTpaxuqk_YvE7_M922vI7-B33HMe_e73mkW85h_XD5DK5NVg_K1-MF682TBWW1TxoQ4Ry6MGMeXqXIiDF1yjifv88224TI59AneR9jd9YWu7Ex23YPLc75Z1NTH16fnMT1U57EJ1wuzHroV12ezM3_iWFS4KkjtVjdrlVyuXwEHV0 Oct 19 03:13:26.032982 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:13:26.032982 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:13:26.032982 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:13:26.032982 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:13:26.032982 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:13:26.032982 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:13:26.032982 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 7d3c36f4a2dc483db8338a85b07e4014 Oct 19 03:13:26.032982 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1966553696 Oct 19 03:13:26.032982 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:13:26.032982 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:13:26.034407 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7d3c36f4a2dc483db8338a85b07e4014"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7d3c36f4a2dc483db8338a85b07e4014"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7d3c36f4a2dc483db8338a85b07e4014"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7d3c36f4a2dc483db8338a85b07e4014", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:13:26.034407 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1966553696 Oct 19 03:13:26.034407 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 7d3c36f4a2dc483db8338a85b07e4014 Oct 19 03:13:26.034407 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1966553696 Oct 19 03:13:26.034407 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1966553696-project Oct 19 03:13:26.034407 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:13:26.034407 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:13:26.034407 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 1f6b041b07a44fbfb76e9d847ed94e50 Oct 19 03:13:26.034407 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1966553696-project Oct 19 03:13:26.034407 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:13:26.034407 n-d-861333-8 devstack@n-api.service[121135]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 19 03:13:26.035117 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'flavor_id': '322413469', 'id': 'hw:numa_nodes'} Oct 19 03:13:26.035117 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:13:26.035117 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:26.035117 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:13:26.035117 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:13:26.035117 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:13:26.035117 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:13:26.035117 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:13:26.035117 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:13:26.035117 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Oct 19 03:13:26.035117 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Oct 19 03:13:26.035117 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 19 03:13:26.035117 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 19 03:13:26.035117 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 19 03:13:26.035117 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 19 03:13:26.035117 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 03:13:26.035117 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 03:13:26.035117 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 03:13:26.035117 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 03:13:26.035117 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 19 03:13:26.036160 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 19 03:13:26.036160 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 19 03:13:26.036160 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 19 03:13:26.036160 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 19 03:13:26.036160 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 19 03:13:26.036160 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 19 03:13:26.036160 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:26.036160 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:13:26.036160 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:26.036160 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:26.036160 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:13:26.036160 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:13:26.036160 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 19 03:13:26.036160 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 19 03:13:26.036160 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 19 03:13:26.036160 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:26.039018 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-605349de-6249-409e-a0c4-e8a1b994c1aa tempest-FlavorsExtraSpecsNegativeTestJSON-1966553696 tempest-FlavorsExtraSpecsNegativeTestJSON-1966553696-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:13:26.041327 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-605349de-6249-409e-a0c4-e8a1b994c1aa tempest-FlavorsExtraSpecsNegativeTestJSON-1966553696 tempest-FlavorsExtraSpecsNegativeTestJSON-1966553696-project] 10.222.0.52 "DELETE /compute/v2.1/flavors/322413469/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.021942 Oct 19 03:13:26.045761 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 188/360] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Oct 19 03:13:26 2022] DELETE /compute/v2.1/flavors/322413469/os-extra_specs/hw:numa_nodes => generated 124 bytes in 28 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 19 03:13:26.055068 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c71d5aec-711b-4e65-98f2-f5a85ada4251 tempest-FlavorsExtraSpecsNegativeTestJSON-148837358 tempest-FlavorsExtraSpecsNegativeTestJSON-148837358-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:13:26.067107 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=85,nova_api:DELETE=5,nova_api:UPDATE=1,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:13:26.068097 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-20907535-773d-4e9b-9d6b-c081bef798d5 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:26.070154 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-20907535-773d-4e9b-9d6b-c081bef798d5 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] [instance: 6c38df2c-2b90-4a77-b610-8811aa680a81] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:26.091159 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c71d5aec-711b-4e65-98f2-f5a85ada4251 tempest-FlavorsExtraSpecsNegativeTestJSON-148837358 tempest-FlavorsExtraSpecsNegativeTestJSON-148837358-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors/322413469/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.039711 Oct 19 03:13:26.097939 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 173/361] 10.222.0.52 () {60 vars in 1221 bytes} [Wed Oct 19 03:13:26 2022] POST /compute/v2.1/flavors/322413469/os-extra_specs => generated 66 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 03:13:26.103606 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5978fc96-3f29-4f8a-afe5-5676db6c442c tempest-FlavorsExtraSpecsNegativeTestJSON-1966553696 tempest-FlavorsExtraSpecsNegativeTestJSON-1966553696-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:13:26.105003 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-20907535-773d-4e9b-9d6b-c081bef798d5 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:26.105605 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-20907535-773d-4e9b-9d6b-c081bef798d5 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:26.106244 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-20907535-773d-4e9b-9d6b-c081bef798d5 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:26.108160 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5978fc96-3f29-4f8a-afe5-5676db6c442c tempest-FlavorsExtraSpecsNegativeTestJSON-1966553696 tempest-FlavorsExtraSpecsNegativeTestJSON-1966553696-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '1f6b041b07a44fbfb76e9d847ed94e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3c36f4a2dc483db8338a85b07e4014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:26.110538 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5978fc96-3f29-4f8a-afe5-5676db6c442c tempest-FlavorsExtraSpecsNegativeTestJSON-1966553696 tempest-FlavorsExtraSpecsNegativeTestJSON-1966553696-project] Request method failure captured: Oct 19 03:13:26.110538 n-d-861333-8 devstack@n-api.service[121134]: request: PUT /compute/v2.1/flavors/322413469/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 19 03:13:26.110538 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:13:26.110538 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:13:26.110538 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:13:26.110538 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 22 Oct 19 03:13:26.110538 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:13:26.110538 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:13:26.110538 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:13:26.110538 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:13:26.110538 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT2tTpaxuqk_YvE7_M922vI7-B33HMe_e73mkW85h_XD5DK5NVg_K1-MF682TBWW1TxoQ4Ry6MGMeXqXIiDF1yjifv88224TI59AneR9jd9YWu7Ex23YPLc75Z1NTH16fnMT1U57EJ1wuzHroV12ezM3_iWFS4KkjtVjdrlVyuXwEHV0 Oct 19 03:13:26.110538 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:13:26.110538 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:13:26.110538 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:13:26.110538 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:13:26.110538 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:13:26.110538 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:13:26.110538 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 7d3c36f4a2dc483db8338a85b07e4014 Oct 19 03:13:26.110538 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1966553696 Oct 19 03:13:26.110538 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:13:26.110538 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:13:26.111706 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7d3c36f4a2dc483db8338a85b07e4014"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7d3c36f4a2dc483db8338a85b07e4014"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7d3c36f4a2dc483db8338a85b07e4014"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7d3c36f4a2dc483db8338a85b07e4014", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:13:26.111706 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1966553696 Oct 19 03:13:26.111706 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 7d3c36f4a2dc483db8338a85b07e4014 Oct 19 03:13:26.111706 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1966553696 Oct 19 03:13:26.111706 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1966553696-project Oct 19 03:13:26.111706 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:13:26.111706 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:13:26.111706 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 1f6b041b07a44fbfb76e9d847ed94e50 Oct 19 03:13:26.111706 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1966553696-project Oct 19 03:13:26.111706 n-d-861333-8 devstack@n-api.service[121134]: Oct 19 03:13:26.111706 n-d-861333-8 devstack@n-api.service[121134]: {"hw:numa_nodes": "1"} Oct 19 03:13:26.111706 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:13:26.111706 n-d-861333-8 devstack@n-api.service[121134]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 19 03:13:26.112406 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'flavor_id': '322413469', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Oct 19 03:13:26.112406 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:13:26.112406 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:26.112406 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:13:26.112406 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:13:26.112406 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:13:26.112406 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:13:26.112406 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:13:26.112406 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:13:26.112406 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:13:26.112406 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:13:26.112406 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Oct 19 03:13:26.112406 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Oct 19 03:13:26.112406 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 19 03:13:26.112406 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 19 03:13:26.112406 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 19 03:13:26.112406 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 19 03:13:26.112406 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 03:13:26.112406 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 03:13:26.113468 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 03:13:26.113468 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 03:13:26.113468 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 19 03:13:26.113468 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 19 03:13:26.113468 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 19 03:13:26.113468 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 19 03:13:26.113468 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 19 03:13:26.113468 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 19 03:13:26.113468 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 19 03:13:26.113468 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:13:26.113468 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:13:26.113468 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:13:26.113468 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:26.113468 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:13:26.113468 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:13:26.113468 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 19 03:13:26.113468 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 19 03:13:26.113468 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 19 03:13:26.113468 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:13:26.117139 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5978fc96-3f29-4f8a-afe5-5676db6c442c tempest-FlavorsExtraSpecsNegativeTestJSON-1966553696 tempest-FlavorsExtraSpecsNegativeTestJSON-1966553696-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:13:26.119412 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5978fc96-3f29-4f8a-afe5-5676db6c442c tempest-FlavorsExtraSpecsNegativeTestJSON-1966553696 tempest-FlavorsExtraSpecsNegativeTestJSON-1966553696-project] 10.222.0.52 "PUT /compute/v2.1/flavors/322413469/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.019420 Oct 19 03:13:26.124726 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-20907535-773d-4e9b-9d6b-c081bef798d5 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:26.125468 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-20907535-773d-4e9b-9d6b-c081bef798d5 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:26.126567 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 174/362] 10.222.0.52 () {60 vars in 1262 bytes} [Wed Oct 19 03:13:26 2022] PUT /compute/v2.1/flavors/322413469/os-extra_specs/hw:numa_nodes => generated 124 bytes in 28 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:13:26.133189 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-20907535-773d-4e9b-9d6b-c081bef798d5 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:26.137630 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0eb98381-217e-4598-85f2-bd9aa156a9fc tempest-FlavorsExtraSpecsNegativeTestJSON-148837358 tempest-FlavorsExtraSpecsNegativeTestJSON-148837358-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:26.146293 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=100 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:13:26.155398 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-0eb98381-217e-4598-85f2-bd9aa156a9fc tempest-FlavorsExtraSpecsNegativeTestJSON-148837358 tempest-FlavorsExtraSpecsNegativeTestJSON-148837358-project-admin] HTTP exception thrown: Flavor 322413469 has no extra specs with key hw:cpu_thread_policy. Oct 19 03:13:26.163475 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0eb98381-217e-4598-85f2-bd9aa156a9fc tempest-FlavorsExtraSpecsNegativeTestJSON-148837358 tempest-FlavorsExtraSpecsNegativeTestJSON-148837358-project-admin] Request method failure captured: Oct 19 03:13:26.163475 n-d-861333-8 devstack@n-api.service[121134]: request: DELETE /compute/v2.1/flavors/322413469/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 19 03:13:26.163475 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:13:26.163475 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:13:26.163475 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:13:26.163475 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:13:26.163475 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:13:26.163475 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:13:26.163475 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:13:26.163475 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:13:26.163475 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT2tUjK43wwqonIt6mR125en6tOlyDpY5r1idaunRwYdIm94MUI6lHI6mXMWi1P2y97SRGOIpxysmizjKzDuahn-j2uKNLinqn9WeZ-KCmH44m3qWMj2shLhVVJO-BBgKiZcCJsMmw-AUbn-KlxmFuYnNhMK1l-Rc9eprkhnaQvm62tQ Oct 19 03:13:26.163475 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:13:26.163475 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:13:26.163475 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:13:26.163475 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:13:26.163475 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:13:26.163475 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:13:26.163475 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: cafe1e0d3459476696f329246775e024 Oct 19 03:13:26.163475 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-148837358 Oct 19 03:13:26.163475 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member,admin Oct 19 03:13:26.163475 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member,admin Oct 19 03:13:26.164679 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/cafe1e0d3459476696f329246775e024"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cafe1e0d3459476696f329246775e024"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cafe1e0d3459476696f329246775e024"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_cafe1e0d3459476696f329246775e024", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:13:26.164679 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-148837358 Oct 19 03:13:26.164679 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: cafe1e0d3459476696f329246775e024 Oct 19 03:13:26.164679 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-148837358 Oct 19 03:13:26.164679 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-148837358-project-admin Oct 19 03:13:26.164679 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:13:26.164679 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:13:26.164679 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 4ca9f0c272f446648a3b15cb4f840de1 Oct 19 03:13:26.164679 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-148837358-project-admin Oct 19 03:13:26.164679 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:13:26.164679 n-d-861333-8 devstack@n-api.service[121134]: exception: Flavor 322413469 has no extra specs with key hw:cpu_thread_policy. Oct 19 03:13:26.165341 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'flavor_id': '322413469', 'id': 'hw:cpu_thread_policy'} Oct 19 03:13:26.165341 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:13:26.165341 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:26.165341 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Oct 19 03:13:26.165341 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Oct 19 03:13:26.165341 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 19 03:13:26.165341 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:13:26.165341 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:13:26.165341 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:13:26.165341 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:26.165341 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:13:26.165341 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:13:26.165341 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:13:26.165341 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:13:26.165341 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:13:26.165341 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:13:26.165341 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Oct 19 03:13:26.165341 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 19 03:13:26.165341 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 322413469 has no extra specs with key hw:cpu_thread_policy. Oct 19 03:13:26.165341 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:13:26.165341 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:13:26.165341 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:13:26.167745 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:26.167745 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:13:26.167745 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:13:26.167745 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:13:26.167745 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:13:26.167745 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 322413469 has no extra specs with key hw:cpu_thread_policy. Oct 19 03:13:26.167745 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:13:26.167745 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0eb98381-217e-4598-85f2-bd9aa156a9fc tempest-FlavorsExtraSpecsNegativeTestJSON-148837358 tempest-FlavorsExtraSpecsNegativeTestJSON-148837358-project-admin] Returning 404 to user: Flavor 322413469 has no extra specs with key hw:cpu_thread_policy. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:13:26.167745 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0eb98381-217e-4598-85f2-bd9aa156a9fc tempest-FlavorsExtraSpecsNegativeTestJSON-148837358 tempest-FlavorsExtraSpecsNegativeTestJSON-148837358-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/322413469/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.037512 Oct 19 03:13:26.174129 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 175/363] 10.222.0.52 () {58 vars in 1266 bytes} [Wed Oct 19 03:13:26 2022] DELETE /compute/v2.1/flavors/322413469/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:13:26.184323 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-94c27da4-a89e-4195-ba23-e36f1397e9e3 tempest-FlavorsExtraSpecsNegativeTestJSON-148837358 tempest-FlavorsExtraSpecsNegativeTestJSON-148837358-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:13:26.192502 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-94c27da4-a89e-4195-ba23-e36f1397e9e3 tempest-FlavorsExtraSpecsNegativeTestJSON-148837358 tempest-FlavorsExtraSpecsNegativeTestJSON-148837358-project-admin] HTTP exception thrown: Request body and URI mismatch Oct 19 03:13:26.195408 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-94c27da4-a89e-4195-ba23-e36f1397e9e3 tempest-FlavorsExtraSpecsNegativeTestJSON-148837358 tempest-FlavorsExtraSpecsNegativeTestJSON-148837358-project-admin] Request method failure captured: Oct 19 03:13:26.195408 n-d-861333-8 devstack@n-api.service[121134]: request: PUT /compute/v2.1/flavors/322413469/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 19 03:13:26.195408 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:13:26.195408 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:13:26.195408 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:13:26.195408 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 27 Oct 19 03:13:26.195408 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:13:26.195408 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:13:26.195408 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:13:26.195408 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:13:26.195408 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT2tUjK43wwqonIt6mR125en6tOlyDpY5r1idaunRwYdIm94MUI6lHI6mXMWi1P2y97SRGOIpxysmizjKzDuahn-j2uKNLinqn9WeZ-KCmH44m3qWMj2shLhVVJO-BBgKiZcCJsMmw-AUbn-KlxmFuYnNhMK1l-Rc9eprkhnaQvm62tQ Oct 19 03:13:26.195408 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:13:26.195408 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:13:26.195408 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:13:26.195408 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:13:26.195408 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:13:26.195408 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:13:26.195408 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: cafe1e0d3459476696f329246775e024 Oct 19 03:13:26.195408 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-148837358 Oct 19 03:13:26.195408 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member,admin Oct 19 03:13:26.195408 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member,admin Oct 19 03:13:26.196695 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/cafe1e0d3459476696f329246775e024"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cafe1e0d3459476696f329246775e024"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cafe1e0d3459476696f329246775e024"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_cafe1e0d3459476696f329246775e024", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:13:26.196695 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-148837358 Oct 19 03:13:26.196695 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: cafe1e0d3459476696f329246775e024 Oct 19 03:13:26.196695 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-148837358 Oct 19 03:13:26.196695 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-148837358-project-admin Oct 19 03:13:26.196695 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:13:26.196695 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:13:26.196695 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 4ca9f0c272f446648a3b15cb4f840de1 Oct 19 03:13:26.196695 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-148837358-project-admin Oct 19 03:13:26.196695 n-d-861333-8 devstack@n-api.service[121134]: Oct 19 03:13:26.196695 n-d-861333-8 devstack@n-api.service[121134]: {"hw:cpu_policy": "shared"} Oct 19 03:13:26.196695 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:13:26.196695 n-d-861333-8 devstack@n-api.service[121134]: exception: Request body and URI mismatch Oct 19 03:13:26.197434 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'flavor_id': '322413469', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Oct 19 03:13:26.197434 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:13:26.197434 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:26.197434 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:13:26.197434 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:13:26.197434 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:13:26.197434 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:13:26.197434 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:13:26.197434 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:13:26.197434 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:13:26.197434 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:13:26.197434 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Oct 19 03:13:26.197434 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Oct 19 03:13:26.197434 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Oct 19 03:13:26.197434 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:13:26.197434 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:13:26.197434 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:13:26.197434 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:26.197434 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:13:26.197434 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:13:26.200169 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:13:26.200169 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:13:26.200169 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Oct 19 03:13:26.200169 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:13:26.202473 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-94c27da4-a89e-4195-ba23-e36f1397e9e3 tempest-FlavorsExtraSpecsNegativeTestJSON-148837358 tempest-FlavorsExtraSpecsNegativeTestJSON-148837358-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:13:26.210396 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-94c27da4-a89e-4195-ba23-e36f1397e9e3 tempest-FlavorsExtraSpecsNegativeTestJSON-148837358 tempest-FlavorsExtraSpecsNegativeTestJSON-148837358-project-admin] 10.222.0.52 "PUT /compute/v2.1/flavors/322413469/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.027959 Oct 19 03:13:26.217248 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 176/364] 10.222.0.52 () {60 vars in 1262 bytes} [Wed Oct 19 03:13:26 2022] PUT /compute/v2.1/flavors/322413469/os-extra_specs/hw:numa_nodes => generated 73 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 19 03:13:26.223203 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f922e5e2-4053-48eb-ad28-2ae3c07f190e tempest-FlavorsExtraSpecsNegativeTestJSON-148837358 tempest-FlavorsExtraSpecsNegativeTestJSON-148837358-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:13:26.238039 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f922e5e2-4053-48eb-ad28-2ae3c07f190e tempest-FlavorsExtraSpecsNegativeTestJSON-148837358 tempest-FlavorsExtraSpecsNegativeTestJSON-148837358-project-admin] Request method failure captured: Oct 19 03:13:26.238039 n-d-861333-8 devstack@n-api.service[121134]: request: PUT /compute/v2.1/flavors/322413469/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 19 03:13:26.238039 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:13:26.238039 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:13:26.238039 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:13:26.238039 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 49 Oct 19 03:13:26.238039 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:13:26.238039 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:13:26.238039 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:13:26.238039 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:13:26.238039 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT2tUjK43wwqonIt6mR125en6tOlyDpY5r1idaunRwYdIm94MUI6lHI6mXMWi1P2y97SRGOIpxysmizjKzDuahn-j2uKNLinqn9WeZ-KCmH44m3qWMj2shLhVVJO-BBgKiZcCJsMmw-AUbn-KlxmFuYnNhMK1l-Rc9eprkhnaQvm62tQ Oct 19 03:13:26.238039 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:13:26.238039 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:13:26.238039 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:13:26.238039 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:13:26.238039 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:13:26.238039 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:13:26.238039 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: cafe1e0d3459476696f329246775e024 Oct 19 03:13:26.238039 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-148837358 Oct 19 03:13:26.238039 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member,admin Oct 19 03:13:26.238039 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member,admin Oct 19 03:13:26.239305 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/cafe1e0d3459476696f329246775e024"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cafe1e0d3459476696f329246775e024"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cafe1e0d3459476696f329246775e024"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_cafe1e0d3459476696f329246775e024", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:13:26.239305 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-148837358 Oct 19 03:13:26.239305 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: cafe1e0d3459476696f329246775e024 Oct 19 03:13:26.239305 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-148837358 Oct 19 03:13:26.239305 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-148837358-project-admin Oct 19 03:13:26.239305 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:13:26.239305 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:13:26.239305 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 4ca9f0c272f446648a3b15cb4f840de1 Oct 19 03:13:26.239305 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-148837358-project-admin Oct 19 03:13:26.239305 n-d-861333-8 devstack@n-api.service[121134]: Oct 19 03:13:26.239305 n-d-861333-8 devstack@n-api.service[121134]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Oct 19 03:13:26.239305 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:13:26.239964 n-d-861333-8 devstack@n-api.service[121134]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 19 03:13:26.239964 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'flavor_id': '322413469', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Oct 19 03:13:26.239964 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:13:26.239964 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:26.239964 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 03:13:26.239964 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 03:13:26.239964 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 03:13:26.239964 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise error Oct 19 03:13:26.239964 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 19 03:13:26.239964 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:13:26.239964 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Oct 19 03:13:26.239964 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 19 03:13:26.239964 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Oct 19 03:13:26.239964 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Oct 19 03:13:26.239964 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 19 03:13:26.239964 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi 'type': ['string', Oct 19 03:13:26.239964 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi 'number']}}, Oct 19 03:13:26.239964 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 19 03:13:26.239964 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:13:26.239964 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi On instance: Oct 19 03:13:26.239964 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Oct 19 03:13:26.239964 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:13:26.241175 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:13:26.241175 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:13:26.241175 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:26.241175 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:13:26.241175 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:13:26.241175 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:13:26.241175 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:13:26.241175 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:13:26.241175 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:13:26.241175 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 03:13:26.241175 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 03:13:26.241175 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 03:13:26.241175 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 03:13:26.241175 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 03:13:26.241175 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 03:13:26.241175 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 19 03:13:26.241175 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:13:26.241175 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:13:26.241175 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:13:26.241175 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:26.243609 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:13:26.243609 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:13:26.243609 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 03:13:26.243609 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 03:13:26.243609 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 19 03:13:26.243609 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:13:26.247293 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f922e5e2-4053-48eb-ad28-2ae3c07f190e tempest-FlavorsExtraSpecsNegativeTestJSON-148837358 tempest-FlavorsExtraSpecsNegativeTestJSON-148837358-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:13:26.252432 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f922e5e2-4053-48eb-ad28-2ae3c07f190e tempest-FlavorsExtraSpecsNegativeTestJSON-148837358 tempest-FlavorsExtraSpecsNegativeTestJSON-148837358-project-admin] 10.222.0.52 "PUT /compute/v2.1/flavors/322413469/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.030451 Oct 19 03:13:26.257907 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 177/365] 10.222.0.52 () {60 vars in 1262 bytes} [Wed Oct 19 03:13:26 2022] PUT /compute/v2.1/flavors/322413469/os-extra_specs/hw:numa_nodes => generated 117 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 03:13:26.270265 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a457dc25-0877-4a30-aad2-e620872a649c tempest-FlavorsExtraSpecsNegativeTestJSON-148837358 tempest-FlavorsExtraSpecsNegativeTestJSON-148837358-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:26.377725 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a457dc25-0877-4a30-aad2-e620872a649c tempest-FlavorsExtraSpecsNegativeTestJSON-148837358 tempest-FlavorsExtraSpecsNegativeTestJSON-148837358-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/322413469" status: 202 len: 0 microversion: 2.1 time: 0.118366 Oct 19 03:13:26.379209 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 178/366] 10.222.0.52 () {58 vars in 1158 bytes} [Wed Oct 19 03:13:26 2022] DELETE /compute/v2.1/flavors/322413469 => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:13:26.396313 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ee3aa4dd-e750-4126-8f5c-a15a72d4df44 tempest-FlavorsExtraSpecsNegativeTestJSON-148837358 tempest-FlavorsExtraSpecsNegativeTestJSON-148837358-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:26.425091 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ee3aa4dd-e750-4126-8f5c-a15a72d4df44 tempest-FlavorsExtraSpecsNegativeTestJSON-148837358 tempest-FlavorsExtraSpecsNegativeTestJSON-148837358-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.037295 Oct 19 03:13:26.438802 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 179/367] 10.222.0.52 () {58 vars in 1146 bytes} [Wed Oct 19 03:13:26 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:13:26.605481 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-20907535-773d-4e9b-9d6b-c081bef798d5 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '769928c8ecb643fa83a9d58465dcb263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ead65f008349329789135966c031d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:26.620432 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-20907535-773d-4e9b-9d6b-c081bef798d5 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] 10.222.0.52 "GET /compute/v2.1/servers/6c38df2c-2b90-4a77-b610-8811aa680a81" status: 200 len: 1320 microversion: 2.1 time: 0.559905 Oct 19 03:13:26.621563 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 189/368] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:13:26 2022] GET /compute/v2.1/servers/6c38df2c-2b90-4a77-b610-8811aa680a81 => generated 1320 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:13:26.783073 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-57222853-3eff-4c31-bea6-f308479a0c41 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:26.784315 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-57222853-3eff-4c31-bea6-f308479a0c41 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 7b4a8cd9-a238-4bff-a002-497dc807bf3a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:26.795509 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-57222853-3eff-4c31-bea6-f308479a0c41 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:26.796254 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-57222853-3eff-4c31-bea6-f308479a0c41 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:26.796795 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-57222853-3eff-4c31-bea6-f308479a0c41 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:26.797604 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-57222853-3eff-4c31-bea6-f308479a0c41 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:26.798423 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-57222853-3eff-4c31-bea6-f308479a0c41 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:26.799236 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-57222853-3eff-4c31-bea6-f308479a0c41 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:27.126311 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-57222853-3eff-4c31-bea6-f308479a0c41 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:27.136828 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-57222853-3eff-4c31-bea6-f308479a0c41 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a" status: 200 len: 1472 microversion: 2.1 time: 0.359588 Oct 19 03:13:27.154771 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 180/369] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:13:26 2022] GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a => generated 1472 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:13:27.650980 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-85902884-c30f-49fa-bca1-a49e50e3f7e3 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:27.652202 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-85902884-c30f-49fa-bca1-a49e50e3f7e3 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] [instance: 6c38df2c-2b90-4a77-b610-8811aa680a81] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:27.665972 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-85902884-c30f-49fa-bca1-a49e50e3f7e3 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:27.666727 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-85902884-c30f-49fa-bca1-a49e50e3f7e3 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:27.667334 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-85902884-c30f-49fa-bca1-a49e50e3f7e3 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:27.668054 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-85902884-c30f-49fa-bca1-a49e50e3f7e3 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:27.668514 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-85902884-c30f-49fa-bca1-a49e50e3f7e3 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:27.668947 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-85902884-c30f-49fa-bca1-a49e50e3f7e3 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:28.164809 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-230fe179-cfa6-4247-ae40-391b82456e83 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:28.166035 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-230fe179-cfa6-4247-ae40-391b82456e83 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 7b4a8cd9-a238-4bff-a002-497dc807bf3a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:28.187910 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-230fe179-cfa6-4247-ae40-391b82456e83 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:28.190720 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-230fe179-cfa6-4247-ae40-391b82456e83 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:28.191871 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-85902884-c30f-49fa-bca1-a49e50e3f7e3 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '769928c8ecb643fa83a9d58465dcb263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ead65f008349329789135966c031d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:28.197544 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-230fe179-cfa6-4247-ae40-391b82456e83 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:28.198600 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-230fe179-cfa6-4247-ae40-391b82456e83 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:28.199309 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-230fe179-cfa6-4247-ae40-391b82456e83 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:28.200707 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-230fe179-cfa6-4247-ae40-391b82456e83 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:28.215000 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-85902884-c30f-49fa-bca1-a49e50e3f7e3 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] 10.222.0.52 "GET /compute/v2.1/servers/6c38df2c-2b90-4a77-b610-8811aa680a81" status: 200 len: 1470 microversion: 2.1 time: 0.569066 Oct 19 03:13:28.215936 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 190/370] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:13:27 2022] GET /compute/v2.1/servers/6c38df2c-2b90-4a77-b610-8811aa680a81 => generated 1470 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:13:28.240731 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-52bb732d-58a3-4734-bf3b-103390c69dd0 tempest-DeleteServersAdminTestJSON-470644809 tempest-DeleteServersAdminTestJSON-470644809-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:13:28.243223 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-52bb732d-58a3-4734-bf3b-103390c69dd0 tempest-DeleteServersAdminTestJSON-470644809 tempest-DeleteServersAdminTestJSON-470644809-project-admin] [instance: 6c38df2c-2b90-4a77-b610-8811aa680a81] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:28.257938 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-52bb732d-58a3-4734-bf3b-103390c69dd0 tempest-DeleteServersAdminTestJSON-470644809 tempest-DeleteServersAdminTestJSON-470644809-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:28.260811 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-52bb732d-58a3-4734-bf3b-103390c69dd0 tempest-DeleteServersAdminTestJSON-470644809 tempest-DeleteServersAdminTestJSON-470644809-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:28.261385 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-52bb732d-58a3-4734-bf3b-103390c69dd0 tempest-DeleteServersAdminTestJSON-470644809 tempest-DeleteServersAdminTestJSON-470644809-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:28.263904 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-52bb732d-58a3-4734-bf3b-103390c69dd0 tempest-DeleteServersAdminTestJSON-470644809 tempest-DeleteServersAdminTestJSON-470644809-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:28.264472 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-52bb732d-58a3-4734-bf3b-103390c69dd0 tempest-DeleteServersAdminTestJSON-470644809 tempest-DeleteServersAdminTestJSON-470644809-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:28.269035 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-52bb732d-58a3-4734-bf3b-103390c69dd0 tempest-DeleteServersAdminTestJSON-470644809 tempest-DeleteServersAdminTestJSON-470644809-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:28.679468 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-230fe179-cfa6-4247-ae40-391b82456e83 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:28.700288 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-230fe179-cfa6-4247-ae40-391b82456e83 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a" status: 200 len: 1477 microversion: 2.1 time: 0.537946 Oct 19 03:13:28.704231 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 181/371] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:13:28 2022] GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a => generated 1477 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:13:28.758432 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-52bb732d-58a3-4734-bf3b-103390c69dd0 tempest-DeleteServersAdminTestJSON-470644809 tempest-DeleteServersAdminTestJSON-470644809-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/6c38df2c-2b90-4a77-b610-8811aa680a81/action" status: 202 len: 0 microversion: 2.1 time: 0.524010 Oct 19 03:13:28.759724 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 191/372] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:13:28 2022] POST /compute/v2.1/servers/6c38df2c-2b90-4a77-b610-8811aa680a81/action => generated 0 bytes in 526 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 19 03:13:28.768708 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8774194f-c0cb-4ad2-b60b-1e90c704e429 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:28.771099 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8774194f-c0cb-4ad2-b60b-1e90c704e429 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] [instance: 6c38df2c-2b90-4a77-b610-8811aa680a81] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:28.782702 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8774194f-c0cb-4ad2-b60b-1e90c704e429 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:28.786433 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8774194f-c0cb-4ad2-b60b-1e90c704e429 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:28.787158 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8774194f-c0cb-4ad2-b60b-1e90c704e429 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:28.788165 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8774194f-c0cb-4ad2-b60b-1e90c704e429 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:28.788939 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8774194f-c0cb-4ad2-b60b-1e90c704e429 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:28.789396 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8774194f-c0cb-4ad2-b60b-1e90c704e429 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:28.882311 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8774194f-c0cb-4ad2-b60b-1e90c704e429 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:28.882800 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8774194f-c0cb-4ad2-b60b-1e90c704e429 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:28.883239 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8774194f-c0cb-4ad2-b60b-1e90c704e429 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:28.883682 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-8774194f-c0cb-4ad2-b60b-1e90c704e429 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lazy-loading 'fault' on Instance uuid 6c38df2c-2b90-4a77-b610-8811aa680a81 {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:13:29.111214 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8774194f-c0cb-4ad2-b60b-1e90c704e429 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '769928c8ecb643fa83a9d58465dcb263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ead65f008349329789135966c031d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:29.126119 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8774194f-c0cb-4ad2-b60b-1e90c704e429 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] 10.222.0.52 "GET /compute/v2.1/servers/6c38df2c-2b90-4a77-b610-8811aa680a81" status: 200 len: 1453 microversion: 2.1 time: 0.362290 Oct 19 03:13:29.127706 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 182/373] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:13:28 2022] GET /compute/v2.1/servers/6c38df2c-2b90-4a77-b610-8811aa680a81 => generated 1453 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:13:29.156705 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-754dbb97-51c3-4e2d-8a3e-d2617bd6605e tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:29.157460 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-754dbb97-51c3-4e2d-8a3e-d2617bd6605e tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] [instance: 6c38df2c-2b90-4a77-b610-8811aa680a81] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:29.166510 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-754dbb97-51c3-4e2d-8a3e-d2617bd6605e tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:29.168775 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-754dbb97-51c3-4e2d-8a3e-d2617bd6605e tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:29.170076 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-754dbb97-51c3-4e2d-8a3e-d2617bd6605e tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:29.171338 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-754dbb97-51c3-4e2d-8a3e-d2617bd6605e tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:29.173576 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-754dbb97-51c3-4e2d-8a3e-d2617bd6605e tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:29.174257 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-754dbb97-51c3-4e2d-8a3e-d2617bd6605e tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:29.217436 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-754dbb97-51c3-4e2d-8a3e-d2617bd6605e tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] [instance: 6c38df2c-2b90-4a77-b610-8811aa680a81] Going to try to terminate instance {{(pid=121135) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:13:29.663469 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-754dbb97-51c3-4e2d-8a3e-d2617bd6605e tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] 10.222.0.52 "DELETE /compute/v2.1/servers/6c38df2c-2b90-4a77-b610-8811aa680a81" status: 204 len: 0 microversion: 2.1 time: 0.517316 Oct 19 03:13:29.664304 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 192/374] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:13:29 2022] DELETE /compute/v2.1/servers/6c38df2c-2b90-4a77-b610-8811aa680a81 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:13:29.683683 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e783d359-0f45-4a49-8de7-a95182c42ca8 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:29.686839 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e783d359-0f45-4a49-8de7-a95182c42ca8 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] [instance: 6c38df2c-2b90-4a77-b610-8811aa680a81] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:29.703617 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e783d359-0f45-4a49-8de7-a95182c42ca8 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:29.709956 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e783d359-0f45-4a49-8de7-a95182c42ca8 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:29.715617 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e783d359-0f45-4a49-8de7-a95182c42ca8 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:29.716406 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e783d359-0f45-4a49-8de7-a95182c42ca8 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:29.716954 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e783d359-0f45-4a49-8de7-a95182c42ca8 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:29.717307 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e783d359-0f45-4a49-8de7-a95182c42ca8 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:29.730744 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-cc7ca200-597b-40ec-9dcd-fb7bab841e0d tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:29.731464 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-cc7ca200-597b-40ec-9dcd-fb7bab841e0d tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 7b4a8cd9-a238-4bff-a002-497dc807bf3a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:29.742780 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cc7ca200-597b-40ec-9dcd-fb7bab841e0d tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:29.743275 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cc7ca200-597b-40ec-9dcd-fb7bab841e0d tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:29.745428 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cc7ca200-597b-40ec-9dcd-fb7bab841e0d tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:29.746380 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cc7ca200-597b-40ec-9dcd-fb7bab841e0d tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:29.746846 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cc7ca200-597b-40ec-9dcd-fb7bab841e0d tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:29.747305 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cc7ca200-597b-40ec-9dcd-fb7bab841e0d tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:29.762531 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e783d359-0f45-4a49-8de7-a95182c42ca8 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:29.763077 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e783d359-0f45-4a49-8de7-a95182c42ca8 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:29.763600 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e783d359-0f45-4a49-8de7-a95182c42ca8 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:29.764233 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-e783d359-0f45-4a49-8de7-a95182c42ca8 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lazy-loading 'fault' on Instance uuid 6c38df2c-2b90-4a77-b610-8811aa680a81 {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:13:30.138839 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e783d359-0f45-4a49-8de7-a95182c42ca8 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '769928c8ecb643fa83a9d58465dcb263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ead65f008349329789135966c031d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:30.154144 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e783d359-0f45-4a49-8de7-a95182c42ca8 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] 10.222.0.52 "GET /compute/v2.1/servers/6c38df2c-2b90-4a77-b610-8811aa680a81" status: 200 len: 1459 microversion: 2.1 time: 0.481885 Oct 19 03:13:30.154999 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 183/375] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:13:29 2022] GET /compute/v2.1/servers/6c38df2c-2b90-4a77-b610-8811aa680a81 => generated 1459 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:13:30.332536 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-cc7ca200-597b-40ec-9dcd-fb7bab841e0d tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:30.358289 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-cc7ca200-597b-40ec-9dcd-fb7bab841e0d tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a" status: 200 len: 1477 microversion: 2.1 time: 0.631553 Oct 19 03:13:30.371889 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 193/376] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:13:29 2022] GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a => generated 1477 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:13:31.183785 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7ca7452c-35c6-454c-95b1-cf8f6e4ae3e9 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:31.190792 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7ca7452c-35c6-454c-95b1-cf8f6e4ae3e9 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] [instance: 6c38df2c-2b90-4a77-b610-8811aa680a81] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:31.240179 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7ca7452c-35c6-454c-95b1-cf8f6e4ae3e9 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:31.240179 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7ca7452c-35c6-454c-95b1-cf8f6e4ae3e9 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:31.240179 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7ca7452c-35c6-454c-95b1-cf8f6e4ae3e9 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:31.240179 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7ca7452c-35c6-454c-95b1-cf8f6e4ae3e9 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:31.240730 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7ca7452c-35c6-454c-95b1-cf8f6e4ae3e9 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:31.240730 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7ca7452c-35c6-454c-95b1-cf8f6e4ae3e9 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:31.304443 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7ca7452c-35c6-454c-95b1-cf8f6e4ae3e9 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:31.306854 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7ca7452c-35c6-454c-95b1-cf8f6e4ae3e9 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:31.312078 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7ca7452c-35c6-454c-95b1-cf8f6e4ae3e9 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:31.312832 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-7ca7452c-35c6-454c-95b1-cf8f6e4ae3e9 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lazy-loading 'fault' on Instance uuid 6c38df2c-2b90-4a77-b610-8811aa680a81 {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:13:31.318050 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:13:31.384671 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6bf87aba-fa2b-4f85-90d0-0c706e8b69cd tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:31.385860 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6bf87aba-fa2b-4f85-90d0-0c706e8b69cd tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 7b4a8cd9-a238-4bff-a002-497dc807bf3a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:31.395604 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6bf87aba-fa2b-4f85-90d0-0c706e8b69cd tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:31.398276 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6bf87aba-fa2b-4f85-90d0-0c706e8b69cd tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:31.399277 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6bf87aba-fa2b-4f85-90d0-0c706e8b69cd tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:31.401556 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6bf87aba-fa2b-4f85-90d0-0c706e8b69cd tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:31.411672 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6bf87aba-fa2b-4f85-90d0-0c706e8b69cd tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:31.411672 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6bf87aba-fa2b-4f85-90d0-0c706e8b69cd tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:31.692150 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-7ca7452c-35c6-454c-95b1-cf8f6e4ae3e9 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '769928c8ecb643fa83a9d58465dcb263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ead65f008349329789135966c031d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:31.702584 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7ca7452c-35c6-454c-95b1-cf8f6e4ae3e9 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] 10.222.0.52 "GET /compute/v2.1/servers/6c38df2c-2b90-4a77-b610-8811aa680a81" status: 200 len: 1459 microversion: 2.1 time: 0.522930 Oct 19 03:13:31.703799 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 184/377] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:13:31 2022] GET /compute/v2.1/servers/6c38df2c-2b90-4a77-b610-8811aa680a81 => generated 1459 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:13:31.846367 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-6bf87aba-fa2b-4f85-90d0-0c706e8b69cd tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:31.855064 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6bf87aba-fa2b-4f85-90d0-0c706e8b69cd tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a" status: 200 len: 1477 microversion: 2.1 time: 0.474640 Oct 19 03:13:31.865043 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 194/378] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:13:31 2022] GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a => generated 1477 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:13:32.470526 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-3b056aa2-0ae5-435b-9f33-8bc0787bdbaf req-6d06ac8a-d122-4305-8cdf-9610093aecdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c38df2c-2b90-4a77-b610-8811aa680a81", "name": "network-vif-deleted", "tag": "ae26118f-2661-4320-94d0-e41fe6dfbb92"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:13:32.481018 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-3b056aa2-0ae5-435b-9f33-8bc0787bdbaf req-6d06ac8a-d122-4305-8cdf-9610093aecdf service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:32.482275 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-3b056aa2-0ae5-435b-9f33-8bc0787bdbaf req-6d06ac8a-d122-4305-8cdf-9610093aecdf service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:32.482719 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-3b056aa2-0ae5-435b-9f33-8bc0787bdbaf req-6d06ac8a-d122-4305-8cdf-9610093aecdf service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:32.492743 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=4 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:13:32.495451 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-3b056aa2-0ae5-435b-9f33-8bc0787bdbaf req-6d06ac8a-d122-4305-8cdf-9610093aecdf service nova] Creating event network-vif-deleted:ae26118f-2661-4320-94d0-e41fe6dfbb92 for instance 6c38df2c-2b90-4a77-b610-8811aa680a81 on n-h2-861333-8 Oct 19 03:13:32.500616 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-3b056aa2-0ae5-435b-9f33-8bc0787bdbaf req-6d06ac8a-d122-4305-8cdf-9610093aecdf service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039514 Oct 19 03:13:32.507325 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 185/379] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:13:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:13:32.730261 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f9934e1a-67e3-466b-958e-4f2f7d372634 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:32.731092 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f9934e1a-67e3-466b-958e-4f2f7d372634 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] [instance: 6c38df2c-2b90-4a77-b610-8811aa680a81] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:32.744601 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f9934e1a-67e3-466b-958e-4f2f7d372634 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:32.745685 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f9934e1a-67e3-466b-958e-4f2f7d372634 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:32.747212 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f9934e1a-67e3-466b-958e-4f2f7d372634 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:32.753967 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f9934e1a-67e3-466b-958e-4f2f7d372634 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:32.754445 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f9934e1a-67e3-466b-958e-4f2f7d372634 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:32.754880 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f9934e1a-67e3-466b-958e-4f2f7d372634 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:32.834854 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f9934e1a-67e3-466b-958e-4f2f7d372634 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:32.838004 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f9934e1a-67e3-466b-958e-4f2f7d372634 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:32.838459 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f9934e1a-67e3-466b-958e-4f2f7d372634 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:32.839980 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-f9934e1a-67e3-466b-958e-4f2f7d372634 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lazy-loading 'fault' on Instance uuid 6c38df2c-2b90-4a77-b610-8811aa680a81 {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:13:32.891799 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f62b78f0-3e64-4367-98f2-6ea824b53275 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:32.892509 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f62b78f0-3e64-4367-98f2-6ea824b53275 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 7b4a8cd9-a238-4bff-a002-497dc807bf3a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:32.906667 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f62b78f0-3e64-4367-98f2-6ea824b53275 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:32.907184 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f62b78f0-3e64-4367-98f2-6ea824b53275 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:32.907737 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f62b78f0-3e64-4367-98f2-6ea824b53275 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:32.908332 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f62b78f0-3e64-4367-98f2-6ea824b53275 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:32.908788 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f62b78f0-3e64-4367-98f2-6ea824b53275 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:32.909242 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f62b78f0-3e64-4367-98f2-6ea824b53275 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:32.920120 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f9934e1a-67e3-466b-958e-4f2f7d372634 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '769928c8ecb643fa83a9d58465dcb263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ead65f008349329789135966c031d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:32.930995 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f9934e1a-67e3-466b-958e-4f2f7d372634 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] 10.222.0.52 "GET /compute/v2.1/servers/6c38df2c-2b90-4a77-b610-8811aa680a81" status: 200 len: 1288 microversion: 2.1 time: 0.205117 Oct 19 03:13:32.934335 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 195/380] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:13:32 2022] GET /compute/v2.1/servers/6c38df2c-2b90-4a77-b610-8811aa680a81 => generated 1288 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:13:33.218373 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-f62b78f0-3e64-4367-98f2-6ea824b53275 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:33.229886 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f62b78f0-3e64-4367-98f2-6ea824b53275 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a" status: 200 len: 1477 microversion: 2.1 time: 0.344006 Oct 19 03:13:33.233981 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 186/381] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:13:32 2022] GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a => generated 1477 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:13:33.959532 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a0f5d73f-bcd9-4b0d-aa27-455e63661279 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:33.960892 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a0f5d73f-bcd9-4b0d-aa27-455e63661279 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] [instance: 6c38df2c-2b90-4a77-b610-8811aa680a81] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:33.964182 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=8 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:13:33.969117 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a0f5d73f-bcd9-4b0d-aa27-455e63661279 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:33.969815 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a0f5d73f-bcd9-4b0d-aa27-455e63661279 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:33.970328 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a0f5d73f-bcd9-4b0d-aa27-455e63661279 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:33.971096 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a0f5d73f-bcd9-4b0d-aa27-455e63661279 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:33.971756 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a0f5d73f-bcd9-4b0d-aa27-455e63661279 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:33.972269 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a0f5d73f-bcd9-4b0d-aa27-455e63661279 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:34.003976 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-a0f5d73f-bcd9-4b0d-aa27-455e63661279 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] HTTP exception thrown: Instance 6c38df2c-2b90-4a77-b610-8811aa680a81 could not be found. Oct 19 03:13:34.005909 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a0f5d73f-bcd9-4b0d-aa27-455e63661279 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Request method failure captured: Oct 19 03:13:34.005909 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/6c38df2c-2b90-4a77-b610-8811aa680a81 HTTP/1.1 Oct 19 03:13:34.005909 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:13:34.005909 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:13:34.005909 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:13:34.005909 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:13:34.005909 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:13:34.005909 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:13:34.005909 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:13:34.005909 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:13:34.005909 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2sOh7nMT0gdBjBdmgpCe4p4VPtOFd54Qq9a22G3ETTZ8BbEzWZuZ5DDznx_vc0SSaUshOB00-DnHmPgJrXSs2dCkN1VgMZw7nLVzclkzSJpO3sHygHs-Gp7MvyOsOOgeIZoA2Ifc-nbqawgWoy0YZKFKnE2e6C2V-XB8SoF032Fbpg Oct 19 03:13:34.005909 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:13:34.005909 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:13:34.005909 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:13:34.005909 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:13:34.005909 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:13:34.005909 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:13:34.005909 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 31ead65f008349329789135966c031d0 Oct 19 03:13:34.005909 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-DeleteServersAdminTestJSON-173664434 Oct 19 03:13:34.005909 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:13:34.005909 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:13:34.007079 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/31ead65f008349329789135966c031d0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/31ead65f008349329789135966c031d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/31ead65f008349329789135966c031d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_31ead65f008349329789135966c031d0", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:13:34.007079 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-DeleteServersAdminTestJSON-173664434 Oct 19 03:13:34.007079 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 31ead65f008349329789135966c031d0 Oct 19 03:13:34.007079 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-173664434 Oct 19 03:13:34.007079 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-DeleteServersAdminTestJSON-173664434-project Oct 19 03:13:34.007079 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:13:34.007079 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:13:34.007079 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 769928c8ecb643fa83a9d58465dcb263 Oct 19 03:13:34.007079 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-DeleteServersAdminTestJSON-173664434-project Oct 19 03:13:34.007079 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:13:34.007079 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance 6c38df2c-2b90-4a77-b610-8811aa680a81 could not be found. Oct 19 03:13:34.007079 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '6c38df2c-2b90-4a77-b610-8811aa680a81'} Oct 19 03:13:34.007723 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:13:34.007723 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:34.007723 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:13:34.007723 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:13:34.007723 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:13:34.007723 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:13:34.007723 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:13:34.007723 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:13:34.007723 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:13:34.007723 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:13:34.007723 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c38df2c-2b90-4a77-b610-8811aa680a81 could not be found. Oct 19 03:13:34.007723 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:34.007723 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:13:34.007723 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:34.007723 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:34.007723 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:13:34.007723 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:13:34.007723 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:13:34.007723 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:13:34.007723 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:13:34.008739 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:13:34.008739 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:13:34.008739 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:13:34.008739 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:13:34.008739 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:13:34.008739 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:13:34.008739 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:13:34.008739 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c38df2c-2b90-4a77-b610-8811aa680a81 could not be found. Oct 19 03:13:34.008739 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:34.008739 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:13:34.008739 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:34.008739 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:34.008739 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:13:34.008739 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:13:34.008739 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:13:34.008739 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:13:34.008739 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c38df2c-2b90-4a77-b610-8811aa680a81 could not be found. Oct 19 03:13:34.008739 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:34.011252 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a0f5d73f-bcd9-4b0d-aa27-455e63661279 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Returning 404 to user: Instance 6c38df2c-2b90-4a77-b610-8811aa680a81 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:13:34.012305 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a0f5d73f-bcd9-4b0d-aa27-455e63661279 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] 10.222.0.52 "GET /compute/v2.1/servers/6c38df2c-2b90-4a77-b610-8811aa680a81" status: 404 len: 111 microversion: 2.1 time: 0.056594 Oct 19 03:13:34.019618 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 196/382] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:13:33 2022] GET /compute/v2.1/servers/6c38df2c-2b90-4a77-b610-8811aa680a81 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:13:34.026096 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3102a334-d934-48f4-a5d3-c6941054ea6c tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:34.031676 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-3102a334-d934-48f4-a5d3-c6941054ea6c tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] [instance: 6c38df2c-2b90-4a77-b610-8811aa680a81] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:34.034308 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3102a334-d934-48f4-a5d3-c6941054ea6c tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:34.035043 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3102a334-d934-48f4-a5d3-c6941054ea6c tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:34.036689 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3102a334-d934-48f4-a5d3-c6941054ea6c tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:34.037673 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3102a334-d934-48f4-a5d3-c6941054ea6c tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:34.038342 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3102a334-d934-48f4-a5d3-c6941054ea6c tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:34.039064 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3102a334-d934-48f4-a5d3-c6941054ea6c tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:34.054923 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-3102a334-d934-48f4-a5d3-c6941054ea6c tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] HTTP exception thrown: Instance 6c38df2c-2b90-4a77-b610-8811aa680a81 could not be found. Oct 19 03:13:34.056724 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3102a334-d934-48f4-a5d3-c6941054ea6c tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Request method failure captured: Oct 19 03:13:34.056724 n-d-861333-8 devstack@n-api.service[121135]: request: DELETE /compute/v2.1/servers/6c38df2c-2b90-4a77-b610-8811aa680a81 HTTP/1.1 Oct 19 03:13:34.056724 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:13:34.056724 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:13:34.056724 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:13:34.056724 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:13:34.056724 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:13:34.056724 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:13:34.056724 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:13:34.056724 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:13:34.056724 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2sOh7nMT0gdBjBdmgpCe4p4VPtOFd54Qq9a22G3ETTZ8BbEzWZuZ5DDznx_vc0SSaUshOB00-DnHmPgJrXSs2dCkN1VgMZw7nLVzclkzSJpO3sHygHs-Gp7MvyOsOOgeIZoA2Ifc-nbqawgWoy0YZKFKnE2e6C2V-XB8SoF032Fbpg Oct 19 03:13:34.056724 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:13:34.056724 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:13:34.056724 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:13:34.056724 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:13:34.056724 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:13:34.056724 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:13:34.056724 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 31ead65f008349329789135966c031d0 Oct 19 03:13:34.056724 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-DeleteServersAdminTestJSON-173664434 Oct 19 03:13:34.056724 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:13:34.056724 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:13:34.058570 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/31ead65f008349329789135966c031d0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/31ead65f008349329789135966c031d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/31ead65f008349329789135966c031d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_31ead65f008349329789135966c031d0", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:13:34.058570 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-DeleteServersAdminTestJSON-173664434 Oct 19 03:13:34.058570 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 31ead65f008349329789135966c031d0 Oct 19 03:13:34.058570 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-173664434 Oct 19 03:13:34.058570 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-DeleteServersAdminTestJSON-173664434-project Oct 19 03:13:34.058570 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:13:34.058570 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:13:34.058570 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 769928c8ecb643fa83a9d58465dcb263 Oct 19 03:13:34.058570 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-DeleteServersAdminTestJSON-173664434-project Oct 19 03:13:34.058570 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:13:34.058570 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance 6c38df2c-2b90-4a77-b610-8811aa680a81 could not be found. Oct 19 03:13:34.058570 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '6c38df2c-2b90-4a77-b610-8811aa680a81'} Oct 19 03:13:34.059417 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:13:34.059417 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:34.059417 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:13:34.059417 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:13:34.059417 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:13:34.059417 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:13:34.059417 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:13:34.059417 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:13:34.059417 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:13:34.059417 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:13:34.059417 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c38df2c-2b90-4a77-b610-8811aa680a81 could not be found. Oct 19 03:13:34.059417 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:34.059417 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:13:34.059417 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:34.059417 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:34.059417 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:13:34.059417 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:13:34.059417 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:13:34.059417 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:13:34.059417 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:13:34.060783 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:13:34.060783 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 03:13:34.060783 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 03:13:34.060783 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 03:13:34.060783 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 03:13:34.060783 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:13:34.060783 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:13:34.060783 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:13:34.060783 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:13:34.060783 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c38df2c-2b90-4a77-b610-8811aa680a81 could not be found. Oct 19 03:13:34.060783 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:34.060783 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:13:34.060783 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:34.060783 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:34.060783 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:13:34.060783 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:13:34.060783 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:13:34.060783 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:13:34.060783 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c38df2c-2b90-4a77-b610-8811aa680a81 could not be found. Oct 19 03:13:34.060783 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:34.064515 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3102a334-d934-48f4-a5d3-c6941054ea6c tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Returning 404 to user: Instance 6c38df2c-2b90-4a77-b610-8811aa680a81 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:13:34.064515 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-3102a334-d934-48f4-a5d3-c6941054ea6c tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] 10.222.0.52 "DELETE /compute/v2.1/servers/6c38df2c-2b90-4a77-b610-8811aa680a81" status: 404 len: 111 microversion: 2.1 time: 0.039232 Oct 19 03:13:34.066365 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 197/383] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:13:34 2022] DELETE /compute/v2.1/servers/6c38df2c-2b90-4a77-b610-8811aa680a81 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:13:34.071322 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-51f33a01-a783-432e-8767-20913a4787cb tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:34.072172 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-51f33a01-a783-432e-8767-20913a4787cb tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] [instance: 6c38df2c-2b90-4a77-b610-8811aa680a81] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:34.079434 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-51f33a01-a783-432e-8767-20913a4787cb tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:34.080034 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-51f33a01-a783-432e-8767-20913a4787cb tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:34.080930 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-51f33a01-a783-432e-8767-20913a4787cb tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:34.081727 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-51f33a01-a783-432e-8767-20913a4787cb tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:34.082430 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-51f33a01-a783-432e-8767-20913a4787cb tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:34.083068 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-51f33a01-a783-432e-8767-20913a4787cb tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:34.098546 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-51f33a01-a783-432e-8767-20913a4787cb tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] HTTP exception thrown: Instance 6c38df2c-2b90-4a77-b610-8811aa680a81 could not be found. Oct 19 03:13:34.100125 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-51f33a01-a783-432e-8767-20913a4787cb tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Request method failure captured: Oct 19 03:13:34.100125 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/6c38df2c-2b90-4a77-b610-8811aa680a81 HTTP/1.1 Oct 19 03:13:34.100125 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:13:34.100125 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:13:34.100125 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:13:34.100125 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:13:34.100125 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:13:34.100125 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:13:34.100125 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:13:34.100125 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:13:34.100125 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2sOh7nMT0gdBjBdmgpCe4p4VPtOFd54Qq9a22G3ETTZ8BbEzWZuZ5DDznx_vc0SSaUshOB00-DnHmPgJrXSs2dCkN1VgMZw7nLVzclkzSJpO3sHygHs-Gp7MvyOsOOgeIZoA2Ifc-nbqawgWoy0YZKFKnE2e6C2V-XB8SoF032Fbpg Oct 19 03:13:34.100125 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:13:34.100125 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:13:34.100125 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:13:34.100125 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:13:34.100125 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:13:34.100125 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:13:34.100125 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 31ead65f008349329789135966c031d0 Oct 19 03:13:34.100125 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-DeleteServersAdminTestJSON-173664434 Oct 19 03:13:34.100125 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:13:34.100125 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:13:34.101336 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/31ead65f008349329789135966c031d0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/31ead65f008349329789135966c031d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/31ead65f008349329789135966c031d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_31ead65f008349329789135966c031d0", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:13:34.101336 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-DeleteServersAdminTestJSON-173664434 Oct 19 03:13:34.101336 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 31ead65f008349329789135966c031d0 Oct 19 03:13:34.101336 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-173664434 Oct 19 03:13:34.101336 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-DeleteServersAdminTestJSON-173664434-project Oct 19 03:13:34.101336 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:13:34.101336 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:13:34.101336 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 769928c8ecb643fa83a9d58465dcb263 Oct 19 03:13:34.101336 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-DeleteServersAdminTestJSON-173664434-project Oct 19 03:13:34.101336 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:13:34.101336 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance 6c38df2c-2b90-4a77-b610-8811aa680a81 could not be found. Oct 19 03:13:34.101336 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '6c38df2c-2b90-4a77-b610-8811aa680a81'} Oct 19 03:13:34.102025 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:13:34.102025 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:34.102025 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:13:34.102025 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:13:34.102025 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:13:34.102025 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:13:34.102025 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:13:34.102025 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:13:34.102025 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:13:34.102025 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:13:34.102025 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c38df2c-2b90-4a77-b610-8811aa680a81 could not be found. Oct 19 03:13:34.102025 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:34.102025 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:13:34.102025 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:34.102025 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:34.102025 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:13:34.102025 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:13:34.102025 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:13:34.102025 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:13:34.102025 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:13:34.103782 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:13:34.103782 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:13:34.103782 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:13:34.103782 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:13:34.103782 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:13:34.103782 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:13:34.103782 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:13:34.103782 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c38df2c-2b90-4a77-b610-8811aa680a81 could not be found. Oct 19 03:13:34.103782 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:34.103782 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:13:34.103782 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:34.103782 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:34.103782 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:13:34.103782 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:13:34.103782 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:13:34.103782 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:13:34.103782 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c38df2c-2b90-4a77-b610-8811aa680a81 could not be found. Oct 19 03:13:34.103782 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:34.106338 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-51f33a01-a783-432e-8767-20913a4787cb tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Returning 404 to user: Instance 6c38df2c-2b90-4a77-b610-8811aa680a81 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:13:34.106338 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-51f33a01-a783-432e-8767-20913a4787cb tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] 10.222.0.52 "GET /compute/v2.1/servers/6c38df2c-2b90-4a77-b610-8811aa680a81" status: 404 len: 111 microversion: 2.1 time: 0.034094 Oct 19 03:13:34.106338 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 198/384] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:13:34 2022] GET /compute/v2.1/servers/6c38df2c-2b90-4a77-b610-8811aa680a81 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:13:34.110852 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-10ea3ab6-f717-4ce2-adb0-671ba50124a1 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:34.111360 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-10ea3ab6-f717-4ce2-adb0-671ba50124a1 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] [instance: 7a48466f-9d33-480f-b67a-21777e03d4d5] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:34.118988 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-10ea3ab6-f717-4ce2-adb0-671ba50124a1 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:34.119490 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-10ea3ab6-f717-4ce2-adb0-671ba50124a1 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:34.119926 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-10ea3ab6-f717-4ce2-adb0-671ba50124a1 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:34.121795 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-10ea3ab6-f717-4ce2-adb0-671ba50124a1 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:34.121795 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-10ea3ab6-f717-4ce2-adb0-671ba50124a1 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:34.121795 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-10ea3ab6-f717-4ce2-adb0-671ba50124a1 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:34.138196 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-10ea3ab6-f717-4ce2-adb0-671ba50124a1 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] HTTP exception thrown: Instance 7a48466f-9d33-480f-b67a-21777e03d4d5 could not be found. Oct 19 03:13:34.140007 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-10ea3ab6-f717-4ce2-adb0-671ba50124a1 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Request method failure captured: Oct 19 03:13:34.140007 n-d-861333-8 devstack@n-api.service[121135]: request: DELETE /compute/v2.1/servers/7a48466f-9d33-480f-b67a-21777e03d4d5 HTTP/1.1 Oct 19 03:13:34.140007 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:13:34.140007 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:13:34.140007 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:13:34.140007 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:13:34.140007 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:13:34.140007 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:13:34.140007 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:13:34.140007 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:13:34.140007 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2sOh7nMT0gdBjBdmgpCe4p4VPtOFd54Qq9a22G3ETTZ8BbEzWZuZ5DDznx_vc0SSaUshOB00-DnHmPgJrXSs2dCkN1VgMZw7nLVzclkzSJpO3sHygHs-Gp7MvyOsOOgeIZoA2Ifc-nbqawgWoy0YZKFKnE2e6C2V-XB8SoF032Fbpg Oct 19 03:13:34.140007 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:13:34.140007 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:13:34.140007 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:13:34.140007 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:13:34.140007 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:13:34.140007 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:13:34.140007 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 31ead65f008349329789135966c031d0 Oct 19 03:13:34.140007 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-DeleteServersAdminTestJSON-173664434 Oct 19 03:13:34.140007 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:13:34.140007 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:13:34.141233 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/31ead65f008349329789135966c031d0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/31ead65f008349329789135966c031d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/31ead65f008349329789135966c031d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_31ead65f008349329789135966c031d0", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:13:34.141233 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-DeleteServersAdminTestJSON-173664434 Oct 19 03:13:34.141233 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 31ead65f008349329789135966c031d0 Oct 19 03:13:34.141233 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-173664434 Oct 19 03:13:34.141233 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-DeleteServersAdminTestJSON-173664434-project Oct 19 03:13:34.141233 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:13:34.141233 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:13:34.141233 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 769928c8ecb643fa83a9d58465dcb263 Oct 19 03:13:34.141233 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-DeleteServersAdminTestJSON-173664434-project Oct 19 03:13:34.141233 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:13:34.141233 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance 7a48466f-9d33-480f-b67a-21777e03d4d5 could not be found. Oct 19 03:13:34.141233 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '7a48466f-9d33-480f-b67a-21777e03d4d5'} Oct 19 03:13:34.141964 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:13:34.141964 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:34.141964 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:13:34.141964 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:13:34.141964 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:13:34.141964 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:13:34.141964 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:13:34.141964 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:13:34.141964 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:13:34.141964 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:13:34.141964 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a48466f-9d33-480f-b67a-21777e03d4d5 could not be found. Oct 19 03:13:34.141964 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:34.141964 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:13:34.141964 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:34.141964 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:34.141964 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:13:34.141964 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:13:34.141964 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:13:34.141964 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:13:34.141964 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:13:34.143092 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:13:34.143092 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 03:13:34.143092 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 03:13:34.143092 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 03:13:34.143092 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 03:13:34.143092 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:13:34.143092 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:13:34.143092 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:13:34.143092 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:13:34.143092 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a48466f-9d33-480f-b67a-21777e03d4d5 could not be found. Oct 19 03:13:34.143092 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:34.143092 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:13:34.143092 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:34.143092 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:34.143092 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:13:34.143092 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:13:34.143092 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:13:34.143092 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:13:34.143092 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a48466f-9d33-480f-b67a-21777e03d4d5 could not be found. Oct 19 03:13:34.143092 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:34.144133 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-10ea3ab6-f717-4ce2-adb0-671ba50124a1 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Returning 404 to user: Instance 7a48466f-9d33-480f-b67a-21777e03d4d5 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:13:34.145018 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-10ea3ab6-f717-4ce2-adb0-671ba50124a1 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] 10.222.0.52 "DELETE /compute/v2.1/servers/7a48466f-9d33-480f-b67a-21777e03d4d5" status: 404 len: 111 microversion: 2.1 time: 0.038476 Oct 19 03:13:34.148297 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 199/385] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:13:34 2022] DELETE /compute/v2.1/servers/7a48466f-9d33-480f-b67a-21777e03d4d5 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 03:13:34.157921 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9f15e247-0ca3-485e-99b4-5e633914d8f4 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:34.158539 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9f15e247-0ca3-485e-99b4-5e633914d8f4 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] [instance: 7a48466f-9d33-480f-b67a-21777e03d4d5] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:34.165844 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9f15e247-0ca3-485e-99b4-5e633914d8f4 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:34.167241 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9f15e247-0ca3-485e-99b4-5e633914d8f4 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:34.167611 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9f15e247-0ca3-485e-99b4-5e633914d8f4 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:34.168403 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9f15e247-0ca3-485e-99b4-5e633914d8f4 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:34.168996 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9f15e247-0ca3-485e-99b4-5e633914d8f4 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:34.169472 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9f15e247-0ca3-485e-99b4-5e633914d8f4 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:34.185309 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-9f15e247-0ca3-485e-99b4-5e633914d8f4 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] HTTP exception thrown: Instance 7a48466f-9d33-480f-b67a-21777e03d4d5 could not be found. Oct 19 03:13:34.187176 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9f15e247-0ca3-485e-99b4-5e633914d8f4 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Request method failure captured: Oct 19 03:13:34.187176 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/7a48466f-9d33-480f-b67a-21777e03d4d5 HTTP/1.1 Oct 19 03:13:34.187176 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:13:34.187176 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:13:34.187176 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:13:34.187176 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:13:34.187176 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:13:34.187176 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:13:34.187176 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:13:34.187176 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:13:34.187176 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2sOh7nMT0gdBjBdmgpCe4p4VPtOFd54Qq9a22G3ETTZ8BbEzWZuZ5DDznx_vc0SSaUshOB00-DnHmPgJrXSs2dCkN1VgMZw7nLVzclkzSJpO3sHygHs-Gp7MvyOsOOgeIZoA2Ifc-nbqawgWoy0YZKFKnE2e6C2V-XB8SoF032Fbpg Oct 19 03:13:34.187176 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:13:34.187176 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:13:34.187176 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:13:34.187176 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:13:34.187176 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:13:34.187176 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:13:34.187176 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 31ead65f008349329789135966c031d0 Oct 19 03:13:34.187176 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-DeleteServersAdminTestJSON-173664434 Oct 19 03:13:34.187176 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:13:34.187176 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:13:34.188739 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/31ead65f008349329789135966c031d0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/31ead65f008349329789135966c031d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/31ead65f008349329789135966c031d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_31ead65f008349329789135966c031d0", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:13:34.188739 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-DeleteServersAdminTestJSON-173664434 Oct 19 03:13:34.188739 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 31ead65f008349329789135966c031d0 Oct 19 03:13:34.188739 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-173664434 Oct 19 03:13:34.188739 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-DeleteServersAdminTestJSON-173664434-project Oct 19 03:13:34.188739 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:13:34.188739 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:13:34.188739 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 769928c8ecb643fa83a9d58465dcb263 Oct 19 03:13:34.188739 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-DeleteServersAdminTestJSON-173664434-project Oct 19 03:13:34.188739 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:13:34.188739 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance 7a48466f-9d33-480f-b67a-21777e03d4d5 could not be found. Oct 19 03:13:34.188739 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '7a48466f-9d33-480f-b67a-21777e03d4d5'} Oct 19 03:13:34.189745 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:13:34.189745 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:34.189745 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:13:34.189745 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:13:34.189745 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:13:34.189745 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:13:34.189745 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:13:34.189745 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:13:34.189745 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:13:34.189745 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:13:34.189745 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a48466f-9d33-480f-b67a-21777e03d4d5 could not be found. Oct 19 03:13:34.189745 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:34.189745 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:13:34.189745 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:34.189745 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:34.189745 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:13:34.189745 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:13:34.189745 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:13:34.189745 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:13:34.189745 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:13:34.191050 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:13:34.191050 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:13:34.191050 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:13:34.191050 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:13:34.191050 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:13:34.191050 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:13:34.191050 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:13:34.191050 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a48466f-9d33-480f-b67a-21777e03d4d5 could not be found. Oct 19 03:13:34.191050 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:34.191050 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:13:34.191050 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:34.191050 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:34.191050 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:13:34.191050 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:13:34.191050 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:13:34.191050 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:13:34.191050 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a48466f-9d33-480f-b67a-21777e03d4d5 could not be found. Oct 19 03:13:34.191050 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:34.193035 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9f15e247-0ca3-485e-99b4-5e633914d8f4 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] Returning 404 to user: Instance 7a48466f-9d33-480f-b67a-21777e03d4d5 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:13:34.195590 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9f15e247-0ca3-485e-99b4-5e633914d8f4 tempest-DeleteServersAdminTestJSON-173664434 tempest-DeleteServersAdminTestJSON-173664434-project] 10.222.0.52 "GET /compute/v2.1/servers/7a48466f-9d33-480f-b67a-21777e03d4d5" status: 404 len: 111 microversion: 2.1 time: 0.042971 Oct 19 03:13:34.197424 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 200/386] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:13:34 2022] GET /compute/v2.1/servers/7a48466f-9d33-480f-b67a-21777e03d4d5 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:13:34.275372 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2d272d6c-1639-41c4-9898-ed8320bf29c9 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:34.275992 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-2d272d6c-1639-41c4-9898-ed8320bf29c9 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 7b4a8cd9-a238-4bff-a002-497dc807bf3a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:34.284185 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2d272d6c-1639-41c4-9898-ed8320bf29c9 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:34.284685 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2d272d6c-1639-41c4-9898-ed8320bf29c9 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:34.285129 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2d272d6c-1639-41c4-9898-ed8320bf29c9 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:34.285866 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2d272d6c-1639-41c4-9898-ed8320bf29c9 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:34.288146 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2d272d6c-1639-41c4-9898-ed8320bf29c9 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:34.288610 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2d272d6c-1639-41c4-9898-ed8320bf29c9 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:34.432994 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-2d272d6c-1639-41c4-9898-ed8320bf29c9 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:34.441712 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2d272d6c-1639-41c4-9898-ed8320bf29c9 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a" status: 200 len: 1477 microversion: 2.1 time: 0.170152 Oct 19 03:13:34.443018 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 201/387] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:13:34 2022] GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a => generated 1477 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:13:34.479767 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-15209b7c-1fcf-47b5-a5fc-0604d86c195a tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-703759323", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:13:34.537173 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-15209b7c-1fcf-47b5-a5fc-0604d86c195a tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] validate_networks() for None {{(pid=121134) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:13:34.791160 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-15209b7c-1fcf-47b5-a5fc-0604d86c195a tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Flavor limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:13:34.791742 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-15209b7c-1fcf-47b5-a5fc-0604d86c195a tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Image limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:13:34.792445 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-15209b7c-1fcf-47b5-a5fc-0604d86c195a tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Flavor pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:13:34.793065 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-15209b7c-1fcf-47b5-a5fc-0604d86c195a tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Image pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:13:34.793610 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-15209b7c-1fcf-47b5-a5fc-0604d86c195a tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:13:34.804446 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-15209b7c-1fcf-47b5-a5fc-0604d86c195a tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:34.805456 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-15209b7c-1fcf-47b5-a5fc-0604d86c195a tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:34.806286 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-15209b7c-1fcf-47b5-a5fc-0604d86c195a tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:34.808336 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-15209b7c-1fcf-47b5-a5fc-0604d86c195a tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:34.809315 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-15209b7c-1fcf-47b5-a5fc-0604d86c195a tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:34.810521 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-15209b7c-1fcf-47b5-a5fc-0604d86c195a tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:34.831701 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-15209b7c-1fcf-47b5-a5fc-0604d86c195a tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Getting quotas for project 69e88bbb75184a59b88e533a49d63cd8. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:13:34.836739 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-15209b7c-1fcf-47b5-a5fc-0604d86c195a tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Getting quotas for user e3ff6534c5e74a2eb179044ef833f0c1 and project 69e88bbb75184a59b88e533a49d63cd8. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:13:34.852637 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-15209b7c-1fcf-47b5-a5fc-0604d86c195a tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Going to run 1 instances... {{(pid=121134) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:13:34.855342 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-15209b7c-1fcf-47b5-a5fc-0604d86c195a tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] [instance: f538531d-7829-4f19-bf50-8eea58368871] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:13:34.983388 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-15209b7c-1fcf-47b5-a5fc-0604d86c195a tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.005136 Oct 19 03:13:34.987130 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 187/388] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:13:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1010 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 03:13:35.005990 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e85f109e-7289-41c4-8d2b-e4465c5c0741 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:35.005990 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e85f109e-7289-41c4-8d2b-e4465c5c0741 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] [instance: f538531d-7829-4f19-bf50-8eea58368871] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:35.005990 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3,nova_api:DELETE=5,nova_api:UPDATE=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:13:35.077921 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-e85f109e-7289-41c4-8d2b-e4465c5c0741 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ff6534c5e74a2eb179044ef833f0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e88bbb75184a59b88e533a49d63cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:35.095232 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e85f109e-7289-41c4-8d2b-e4465c5c0741 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] 10.222.0.52 "GET /compute/v2.1/servers/f538531d-7829-4f19-bf50-8eea58368871" status: 200 len: 1218 microversion: 2.1 time: 0.101301 Oct 19 03:13:35.098685 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 202/389] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:13:34 2022] GET /compute/v2.1/servers/f538531d-7829-4f19-bf50-8eea58368871 => generated 1218 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:13:35.465600 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-df39f1bb-5d64-4038-af1d-589421236793 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:35.466986 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-df39f1bb-5d64-4038-af1d-589421236793 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 7b4a8cd9-a238-4bff-a002-497dc807bf3a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:35.473813 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-df39f1bb-5d64-4038-af1d-589421236793 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:35.474487 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-df39f1bb-5d64-4038-af1d-589421236793 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:35.475072 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-df39f1bb-5d64-4038-af1d-589421236793 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:35.476242 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-df39f1bb-5d64-4038-af1d-589421236793 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:35.476869 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-df39f1bb-5d64-4038-af1d-589421236793 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:35.477296 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-df39f1bb-5d64-4038-af1d-589421236793 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:35.664790 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-df39f1bb-5d64-4038-af1d-589421236793 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:35.672485 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-df39f1bb-5d64-4038-af1d-589421236793 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a" status: 200 len: 1477 microversion: 2.1 time: 0.211195 Oct 19 03:13:35.673251 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 188/390] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:13:35 2022] GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a => generated 1477 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:13:36.122760 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-8dcaae6f-e210-49cf-b240-e4e44c78e376 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:36.124241 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-8dcaae6f-e210-49cf-b240-e4e44c78e376 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] [instance: f538531d-7829-4f19-bf50-8eea58368871] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:36.201127 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-8dcaae6f-e210-49cf-b240-e4e44c78e376 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ff6534c5e74a2eb179044ef833f0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e88bbb75184a59b88e533a49d63cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:36.209458 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-8dcaae6f-e210-49cf-b240-e4e44c78e376 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] 10.222.0.52 "GET /compute/v2.1/servers/f538531d-7829-4f19-bf50-8eea58368871" status: 200 len: 1218 microversion: 2.1 time: 0.091950 Oct 19 03:13:36.210497 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 203/391] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:13:36 2022] GET /compute/v2.1/servers/f538531d-7829-4f19-bf50-8eea58368871 => generated 1218 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:13:36.696000 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6126a241-19c2-46a7-9937-97934761518d tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:36.697274 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6126a241-19c2-46a7-9937-97934761518d tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 7b4a8cd9-a238-4bff-a002-497dc807bf3a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:36.708279 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6126a241-19c2-46a7-9937-97934761518d tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:36.710533 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6126a241-19c2-46a7-9937-97934761518d tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:36.713338 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6126a241-19c2-46a7-9937-97934761518d tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:36.714305 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6126a241-19c2-46a7-9937-97934761518d tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:36.717766 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6126a241-19c2-46a7-9937-97934761518d tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:36.718273 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6126a241-19c2-46a7-9937-97934761518d tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:36.946107 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-6126a241-19c2-46a7-9937-97934761518d tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:36.958203 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6126a241-19c2-46a7-9937-97934761518d tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a" status: 200 len: 1477 microversion: 2.1 time: 0.265965 Oct 19 03:13:36.959491 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 189/392] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:13:36 2022] GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a => generated 1477 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:13:37.236102 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-be70d764-e301-4bda-8b39-885807c3d8e2 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:37.236716 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-be70d764-e301-4bda-8b39-885807c3d8e2 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] [instance: f538531d-7829-4f19-bf50-8eea58368871] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:37.250504 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-be70d764-e301-4bda-8b39-885807c3d8e2 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:37.258323 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-be70d764-e301-4bda-8b39-885807c3d8e2 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:37.258323 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-be70d764-e301-4bda-8b39-885807c3d8e2 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:37.258323 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-be70d764-e301-4bda-8b39-885807c3d8e2 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:37.258323 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-be70d764-e301-4bda-8b39-885807c3d8e2 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:37.258797 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-be70d764-e301-4bda-8b39-885807c3d8e2 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:37.341923 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5c791686-e09d-4b07-bafd-15bae383d793 tempest-HypervisorAdminTestJSON-1327652031 tempest-HypervisorAdminTestJSON-1327652031-project-admin] Calling method '.version_select at 0x7fc1315bc1f0>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:37.343738 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5c791686-e09d-4b07-bafd-15bae383d793 tempest-HypervisorAdminTestJSON-1327652031 tempest-HypervisorAdminTestJSON-1327652031-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:37.344230 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5c791686-e09d-4b07-bafd-15bae383d793 tempest-HypervisorAdminTestJSON-1327652031 tempest-HypervisorAdminTestJSON-1327652031-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:37.344727 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5c791686-e09d-4b07-bafd-15bae383d793 tempest-HypervisorAdminTestJSON-1327652031 tempest-HypervisorAdminTestJSON-1327652031-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:37.360681 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5c791686-e09d-4b07-bafd-15bae383d793 tempest-HypervisorAdminTestJSON-1327652031 tempest-HypervisorAdminTestJSON-1327652031-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:37.363129 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5c791686-e09d-4b07-bafd-15bae383d793 tempest-HypervisorAdminTestJSON-1327652031 tempest-HypervisorAdminTestJSON-1327652031-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:37.363925 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5c791686-e09d-4b07-bafd-15bae383d793 tempest-HypervisorAdminTestJSON-1327652031 tempest-HypervisorAdminTestJSON-1327652031-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:37.378552 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5c791686-e09d-4b07-bafd-15bae383d793 tempest-HypervisorAdminTestJSON-1327652031 tempest-HypervisorAdminTestJSON-1327652031-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:37.378904 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-be70d764-e301-4bda-8b39-885807c3d8e2 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ff6534c5e74a2eb179044ef833f0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e88bbb75184a59b88e533a49d63cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:37.379598 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5c791686-e09d-4b07-bafd-15bae383d793 tempest-HypervisorAdminTestJSON-1327652031 tempest-HypervisorAdminTestJSON-1327652031-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:37.380421 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5c791686-e09d-4b07-bafd-15bae383d793 tempest-HypervisorAdminTestJSON-1327652031 tempest-HypervisorAdminTestJSON-1327652031-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:37.388283 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5c791686-e09d-4b07-bafd-15bae383d793 tempest-HypervisorAdminTestJSON-1327652031 tempest-HypervisorAdminTestJSON-1327652031-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.543282 Oct 19 03:13:37.394245 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-be70d764-e301-4bda-8b39-885807c3d8e2 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] 10.222.0.52 "GET /compute/v2.1/servers/f538531d-7829-4f19-bf50-8eea58368871" status: 200 len: 1214 microversion: 2.1 time: 0.162543 Oct 19 03:13:37.397397 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 204/393] 10.222.0.52 () {58 vars in 1146 bytes} [Wed Oct 19 03:13:36 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:13:37.397869 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 190/394] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:13:37 2022] GET /compute/v2.1/servers/f538531d-7829-4f19-bf50-8eea58368871 => generated 1214 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:13:37.409577 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-62fad85c-6bdc-449c-bcc8-4fad6de910da tempest-HypervisorAdminTestJSON-1327652031 tempest-HypervisorAdminTestJSON-1327652031-project-admin] Calling method '.version_select at 0x7fc13166ad30>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:37.415436 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-62fad85c-6bdc-449c-bcc8-4fad6de910da tempest-HypervisorAdminTestJSON-1327652031 tempest-HypervisorAdminTestJSON-1327652031-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:37.418324 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-62fad85c-6bdc-449c-bcc8-4fad6de910da tempest-HypervisorAdminTestJSON-1327652031 tempest-HypervisorAdminTestJSON-1327652031-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:37.420625 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-62fad85c-6bdc-449c-bcc8-4fad6de910da tempest-HypervisorAdminTestJSON-1327652031 tempest-HypervisorAdminTestJSON-1327652031-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:37.437238 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-62fad85c-6bdc-449c-bcc8-4fad6de910da tempest-HypervisorAdminTestJSON-1327652031 tempest-HypervisorAdminTestJSON-1327652031-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:37.438127 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-62fad85c-6bdc-449c-bcc8-4fad6de910da tempest-HypervisorAdminTestJSON-1327652031 tempest-HypervisorAdminTestJSON-1327652031-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:37.438751 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-62fad85c-6bdc-449c-bcc8-4fad6de910da tempest-HypervisorAdminTestJSON-1327652031 tempest-HypervisorAdminTestJSON-1327652031-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:37.452979 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-62fad85c-6bdc-449c-bcc8-4fad6de910da tempest-HypervisorAdminTestJSON-1327652031 tempest-HypervisorAdminTestJSON-1327652031-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:37.454290 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-62fad85c-6bdc-449c-bcc8-4fad6de910da tempest-HypervisorAdminTestJSON-1327652031 tempest-HypervisorAdminTestJSON-1327652031-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:37.454899 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-62fad85c-6bdc-449c-bcc8-4fad6de910da tempest-HypervisorAdminTestJSON-1327652031 tempest-HypervisorAdminTestJSON-1327652031-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:37.462988 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-62fad85c-6bdc-449c-bcc8-4fad6de910da tempest-HypervisorAdminTestJSON-1327652031 tempest-HypervisorAdminTestJSON-1327652031-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1505 microversion: 2.1 time: 0.063431 Oct 19 03:13:37.465040 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 191/395] 10.222.0.52 () {58 vars in 1167 bytes} [Wed Oct 19 03:13:37 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1505 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:13:37.483912 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ec07a757-df6c-4916-8e1f-19c5311b52ff tempest-HypervisorAdminTestJSON-1327652031 tempest-HypervisorAdminTestJSON-1327652031-project-admin] Calling method '.version_select at 0x7fc1316b9c10>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:37.486051 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ec07a757-df6c-4916-8e1f-19c5311b52ff tempest-HypervisorAdminTestJSON-1327652031 tempest-HypervisorAdminTestJSON-1327652031-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:37.486580 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ec07a757-df6c-4916-8e1f-19c5311b52ff tempest-HypervisorAdminTestJSON-1327652031 tempest-HypervisorAdminTestJSON-1327652031-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:37.487076 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ec07a757-df6c-4916-8e1f-19c5311b52ff tempest-HypervisorAdminTestJSON-1327652031 tempest-HypervisorAdminTestJSON-1327652031-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:37.505801 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ec07a757-df6c-4916-8e1f-19c5311b52ff tempest-HypervisorAdminTestJSON-1327652031 tempest-HypervisorAdminTestJSON-1327652031-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:37.506369 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ec07a757-df6c-4916-8e1f-19c5311b52ff tempest-HypervisorAdminTestJSON-1327652031 tempest-HypervisorAdminTestJSON-1327652031-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:37.507458 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ec07a757-df6c-4916-8e1f-19c5311b52ff tempest-HypervisorAdminTestJSON-1327652031 tempest-HypervisorAdminTestJSON-1327652031-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:37.523592 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ec07a757-df6c-4916-8e1f-19c5311b52ff tempest-HypervisorAdminTestJSON-1327652031 tempest-HypervisorAdminTestJSON-1327652031-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:37.524277 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ec07a757-df6c-4916-8e1f-19c5311b52ff tempest-HypervisorAdminTestJSON-1327652031 tempest-HypervisorAdminTestJSON-1327652031-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:37.524710 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ec07a757-df6c-4916-8e1f-19c5311b52ff tempest-HypervisorAdminTestJSON-1327652031 tempest-HypervisorAdminTestJSON-1327652031-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:37.533182 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ec07a757-df6c-4916-8e1f-19c5311b52ff tempest-HypervisorAdminTestJSON-1327652031 tempest-HypervisorAdminTestJSON-1327652031-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.054571 Oct 19 03:13:37.535585 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 192/396] 10.222.0.52 () {58 vars in 1146 bytes} [Wed Oct 19 03:13:37 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:13:37.550803 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0a4e7ea1-8fb1-4af3-ace9-b51b86410bc8 tempest-HypervisorAdminTestJSON-1327652031 tempest-HypervisorAdminTestJSON-1327652031-project-admin] Calling method '.version_select at 0x7fc13155a8b0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:37.552742 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0a4e7ea1-8fb1-4af3-ace9-b51b86410bc8 tempest-HypervisorAdminTestJSON-1327652031 tempest-HypervisorAdminTestJSON-1327652031-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:37.553240 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0a4e7ea1-8fb1-4af3-ace9-b51b86410bc8 tempest-HypervisorAdminTestJSON-1327652031 tempest-HypervisorAdminTestJSON-1327652031-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:37.553705 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0a4e7ea1-8fb1-4af3-ace9-b51b86410bc8 tempest-HypervisorAdminTestJSON-1327652031 tempest-HypervisorAdminTestJSON-1327652031-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:37.572668 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0a4e7ea1-8fb1-4af3-ace9-b51b86410bc8 tempest-HypervisorAdminTestJSON-1327652031 tempest-HypervisorAdminTestJSON-1327652031-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:37.573225 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0a4e7ea1-8fb1-4af3-ace9-b51b86410bc8 tempest-HypervisorAdminTestJSON-1327652031 tempest-HypervisorAdminTestJSON-1327652031-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:37.574598 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0a4e7ea1-8fb1-4af3-ace9-b51b86410bc8 tempest-HypervisorAdminTestJSON-1327652031 tempest-HypervisorAdminTestJSON-1327652031-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:37.582530 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0a4e7ea1-8fb1-4af3-ace9-b51b86410bc8 tempest-HypervisorAdminTestJSON-1327652031 tempest-HypervisorAdminTestJSON-1327652031-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.036908 Oct 19 03:13:37.583717 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 193/397] 10.222.0.52 () {58 vars in 1152 bytes} [Wed Oct 19 03:13:37 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:13:37.599302 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-786124af-7510-4ffc-88e0-121d00bc50f6 tempest-HypervisorAdminTestJSON-1327652031 tempest-HypervisorAdminTestJSON-1327652031-project-admin] Calling method '.version_select at 0x7fc13155aaf0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:37.601327 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-786124af-7510-4ffc-88e0-121d00bc50f6 tempest-HypervisorAdminTestJSON-1327652031 tempest-HypervisorAdminTestJSON-1327652031-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:37.601996 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-786124af-7510-4ffc-88e0-121d00bc50f6 tempest-HypervisorAdminTestJSON-1327652031 tempest-HypervisorAdminTestJSON-1327652031-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:37.602443 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-786124af-7510-4ffc-88e0-121d00bc50f6 tempest-HypervisorAdminTestJSON-1327652031 tempest-HypervisorAdminTestJSON-1327652031-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:37.620677 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-786124af-7510-4ffc-88e0-121d00bc50f6 tempest-HypervisorAdminTestJSON-1327652031 tempest-HypervisorAdminTestJSON-1327652031-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.025625 Oct 19 03:13:37.621359 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 194/398] 10.222.0.52 () {58 vars in 1179 bytes} [Wed Oct 19 03:13:37 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:13:37.634322 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4480f57a-6487-4bc0-a003-02f0e6a12541 tempest-HypervisorAdminTestJSON-1327652031 tempest-HypervisorAdminTestJSON-1327652031-project-admin] Calling method '.version_select at 0x7fc13155a4c0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:37.636460 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4480f57a-6487-4bc0-a003-02f0e6a12541 tempest-HypervisorAdminTestJSON-1327652031 tempest-HypervisorAdminTestJSON-1327652031-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:37.637050 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4480f57a-6487-4bc0-a003-02f0e6a12541 tempest-HypervisorAdminTestJSON-1327652031 tempest-HypervisorAdminTestJSON-1327652031-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:37.638161 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4480f57a-6487-4bc0-a003-02f0e6a12541 tempest-HypervisorAdminTestJSON-1327652031 tempest-HypervisorAdminTestJSON-1327652031-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:37.654243 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4480f57a-6487-4bc0-a003-02f0e6a12541 tempest-HypervisorAdminTestJSON-1327652031 tempest-HypervisorAdminTestJSON-1327652031-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:37.654830 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4480f57a-6487-4bc0-a003-02f0e6a12541 tempest-HypervisorAdminTestJSON-1327652031 tempest-HypervisorAdminTestJSON-1327652031-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:37.655334 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4480f57a-6487-4bc0-a003-02f0e6a12541 tempest-HypervisorAdminTestJSON-1327652031 tempest-HypervisorAdminTestJSON-1327652031-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:37.666304 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4480f57a-6487-4bc0-a003-02f0e6a12541 tempest-HypervisorAdminTestJSON-1327652031 tempest-HypervisorAdminTestJSON-1327652031-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:37.666867 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4480f57a-6487-4bc0-a003-02f0e6a12541 tempest-HypervisorAdminTestJSON-1327652031 tempest-HypervisorAdminTestJSON-1327652031-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:37.667371 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4480f57a-6487-4bc0-a003-02f0e6a12541 tempest-HypervisorAdminTestJSON-1327652031 tempest-HypervisorAdminTestJSON-1327652031-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:37.674462 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4480f57a-6487-4bc0-a003-02f0e6a12541 tempest-HypervisorAdminTestJSON-1327652031 tempest-HypervisorAdminTestJSON-1327652031-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.043574 Oct 19 03:13:37.674829 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 195/399] 10.222.0.52 () {58 vars in 1146 bytes} [Wed Oct 19 03:13:37 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:13:37.691754 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e0f2da6f-ffdc-4f8a-9420-9e97ab5459ee tempest-HypervisorAdminTestJSON-1327652031 tempest-HypervisorAdminTestJSON-1327652031-project-admin] Calling method '.version_select at 0x7fc1316b9ca0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:37.693891 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e0f2da6f-ffdc-4f8a-9420-9e97ab5459ee tempest-HypervisorAdminTestJSON-1327652031 tempest-HypervisorAdminTestJSON-1327652031-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:37.694524 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e0f2da6f-ffdc-4f8a-9420-9e97ab5459ee tempest-HypervisorAdminTestJSON-1327652031 tempest-HypervisorAdminTestJSON-1327652031-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:37.695107 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e0f2da6f-ffdc-4f8a-9420-9e97ab5459ee tempest-HypervisorAdminTestJSON-1327652031 tempest-HypervisorAdminTestJSON-1327652031-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:37.710870 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e0f2da6f-ffdc-4f8a-9420-9e97ab5459ee tempest-HypervisorAdminTestJSON-1327652031 tempest-HypervisorAdminTestJSON-1327652031-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:37.710870 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e0f2da6f-ffdc-4f8a-9420-9e97ab5459ee tempest-HypervisorAdminTestJSON-1327652031 tempest-HypervisorAdminTestJSON-1327652031-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:37.710870 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e0f2da6f-ffdc-4f8a-9420-9e97ab5459ee tempest-HypervisorAdminTestJSON-1327652031 tempest-HypervisorAdminTestJSON-1327652031-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:37.720248 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e0f2da6f-ffdc-4f8a-9420-9e97ab5459ee tempest-HypervisorAdminTestJSON-1327652031 tempest-HypervisorAdminTestJSON-1327652031-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.032320 Oct 19 03:13:37.720943 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 196/400] 10.222.0.52 () {58 vars in 1152 bytes} [Wed Oct 19 03:13:37 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:13:37.737350 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-02fe4d19-ee43-4d3d-92e8-22a48636924d tempest-HypervisorAdminTestJSON-1327652031 tempest-HypervisorAdminTestJSON-1327652031-project-admin] Calling method '.version_select at 0x7fc13155aa60>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:37.739701 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-02fe4d19-ee43-4d3d-92e8-22a48636924d tempest-HypervisorAdminTestJSON-1327652031 tempest-HypervisorAdminTestJSON-1327652031-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:37.740342 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-02fe4d19-ee43-4d3d-92e8-22a48636924d tempest-HypervisorAdminTestJSON-1327652031 tempest-HypervisorAdminTestJSON-1327652031-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:37.740801 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-02fe4d19-ee43-4d3d-92e8-22a48636924d tempest-HypervisorAdminTestJSON-1327652031 tempest-HypervisorAdminTestJSON-1327652031-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:37.755176 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-02fe4d19-ee43-4d3d-92e8-22a48636924d tempest-HypervisorAdminTestJSON-1327652031 tempest-HypervisorAdminTestJSON-1327652031-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:37.755658 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-02fe4d19-ee43-4d3d-92e8-22a48636924d tempest-HypervisorAdminTestJSON-1327652031 tempest-HypervisorAdminTestJSON-1327652031-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:37.756088 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-02fe4d19-ee43-4d3d-92e8-22a48636924d tempest-HypervisorAdminTestJSON-1327652031 tempest-HypervisorAdminTestJSON-1327652031-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:37.763961 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-02fe4d19-ee43-4d3d-92e8-22a48636924d tempest-HypervisorAdminTestJSON-1327652031 tempest-HypervisorAdminTestJSON-1327652031-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 758 microversion: 2.1 time: 0.031395 Oct 19 03:13:37.765053 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 197/401] 10.222.0.52 () {58 vars in 1152 bytes} [Wed Oct 19 03:13:37 2022] GET /compute/v2.1/os-hypervisors/2 => generated 758 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:13:37.789727 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4fd6d2f8-9c2c-4dc5-a6e4-94360c737ebb tempest-HypervisorAdminTestJSON-1327652031 tempest-HypervisorAdminTestJSON-1327652031-project-admin] Calling method '.version_select at 0x7fc1316b9040>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:37.792249 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4fd6d2f8-9c2c-4dc5-a6e4-94360c737ebb tempest-HypervisorAdminTestJSON-1327652031 tempest-HypervisorAdminTestJSON-1327652031-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:37.792915 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4fd6d2f8-9c2c-4dc5-a6e4-94360c737ebb tempest-HypervisorAdminTestJSON-1327652031 tempest-HypervisorAdminTestJSON-1327652031-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:37.793568 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4fd6d2f8-9c2c-4dc5-a6e4-94360c737ebb tempest-HypervisorAdminTestJSON-1327652031 tempest-HypervisorAdminTestJSON-1327652031-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:37.812244 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4fd6d2f8-9c2c-4dc5-a6e4-94360c737ebb tempest-HypervisorAdminTestJSON-1327652031 tempest-HypervisorAdminTestJSON-1327652031-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:37.812974 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4fd6d2f8-9c2c-4dc5-a6e4-94360c737ebb tempest-HypervisorAdminTestJSON-1327652031 tempest-HypervisorAdminTestJSON-1327652031-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:37.813721 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4fd6d2f8-9c2c-4dc5-a6e4-94360c737ebb tempest-HypervisorAdminTestJSON-1327652031 tempest-HypervisorAdminTestJSON-1327652031-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:37.834259 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4fd6d2f8-9c2c-4dc5-a6e4-94360c737ebb tempest-HypervisorAdminTestJSON-1327652031 tempest-HypervisorAdminTestJSON-1327652031-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:37.835100 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4fd6d2f8-9c2c-4dc5-a6e4-94360c737ebb tempest-HypervisorAdminTestJSON-1327652031 tempest-HypervisorAdminTestJSON-1327652031-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:37.836177 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4fd6d2f8-9c2c-4dc5-a6e4-94360c737ebb tempest-HypervisorAdminTestJSON-1327652031 tempest-HypervisorAdminTestJSON-1327652031-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:37.926202 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4fd6d2f8-9c2c-4dc5-a6e4-94360c737ebb tempest-HypervisorAdminTestJSON-1327652031 tempest-HypervisorAdminTestJSON-1327652031-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.143959 Oct 19 03:13:37.926838 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 198/402] 10.222.0.52 () {58 vars in 1173 bytes} [Wed Oct 19 03:13:37 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:13:37.984327 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5723fac8-3624-438b-9ff8-3ca392d65301 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:37.985676 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5723fac8-3624-438b-9ff8-3ca392d65301 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 7b4a8cd9-a238-4bff-a002-497dc807bf3a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:38.005235 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5723fac8-3624-438b-9ff8-3ca392d65301 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:38.008404 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5723fac8-3624-438b-9ff8-3ca392d65301 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:38.009333 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5723fac8-3624-438b-9ff8-3ca392d65301 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:38.011037 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5723fac8-3624-438b-9ff8-3ca392d65301 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:38.011995 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5723fac8-3624-438b-9ff8-3ca392d65301 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:38.012674 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5723fac8-3624-438b-9ff8-3ca392d65301 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:38.206195 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5c77397c-496e-4c49-b901-e1a2da36114c tempest-NetworksTest-2138261684 tempest-NetworksTest-2138261684-project-admin] Calling method '.version_select at 0x7fc1315bc040>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:38.479339 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5723fac8-3624-438b-9ff8-3ca392d65301 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:38.500360 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5723fac8-3624-438b-9ff8-3ca392d65301 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a" status: 200 len: 1477 microversion: 2.1 time: 0.513565 Oct 19 03:13:38.500360 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 199/403] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:13:37 2022] GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a => generated 1477 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:13:38.507252 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-52795b30-f94a-4738-ba73-c94f7bcdb195 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:38.507863 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-52795b30-f94a-4738-ba73-c94f7bcdb195 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] [instance: f538531d-7829-4f19-bf50-8eea58368871] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:38.541525 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-52795b30-f94a-4738-ba73-c94f7bcdb195 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:38.549093 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-52795b30-f94a-4738-ba73-c94f7bcdb195 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:38.550127 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-52795b30-f94a-4738-ba73-c94f7bcdb195 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:38.553104 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-52795b30-f94a-4738-ba73-c94f7bcdb195 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:38.553792 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-52795b30-f94a-4738-ba73-c94f7bcdb195 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:38.556464 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-52795b30-f94a-4738-ba73-c94f7bcdb195 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:38.716734 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5c77397c-496e-4c49-b901-e1a2da36114c tempest-NetworksTest-2138261684 tempest-NetworksTest-2138261684-project-admin] 10.222.0.52 "GET /compute/v2.1/os-networks" status: 200 len: 4709 microversion: 2.1 time: 1.318000 Oct 19 03:13:38.718490 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 205/404] 10.222.0.52 () {58 vars in 1137 bytes} [Wed Oct 19 03:13:37 2022] GET /compute/v2.1/os-networks => generated 4709 bytes in 1320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:13:38.742970 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2dc3bee8-b389-4cff-9b93-092e01892a2e tempest-NetworksTest-2138261684 tempest-NetworksTest-2138261684-project-admin] Calling method '.version_select at 0x7fc13157d040>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:38.750977 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-52795b30-f94a-4738-ba73-c94f7bcdb195 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ff6534c5e74a2eb179044ef833f0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e88bbb75184a59b88e533a49d63cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:38.760332 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-52795b30-f94a-4738-ba73-c94f7bcdb195 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] 10.222.0.52 "GET /compute/v2.1/servers/f538531d-7829-4f19-bf50-8eea58368871" status: 200 len: 1288 microversion: 2.1 time: 0.260665 Oct 19 03:13:38.760905 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 200/405] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:13:38 2022] GET /compute/v2.1/servers/f538531d-7829-4f19-bf50-8eea58368871 => generated 1288 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:13:39.299231 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2dc3bee8-b389-4cff-9b93-092e01892a2e tempest-NetworksTest-2138261684 tempest-NetworksTest-2138261684-project-admin] 10.222.0.52 "GET /compute/v2.1/os-networks/1475da2c-80a2-478b-b6c8-7f7c0e5426d1" status: 200 len: 652 microversion: 2.1 time: 0.575558 Oct 19 03:13:39.300264 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 206/406] 10.222.0.52 () {58 vars in 1248 bytes} [Wed Oct 19 03:13:38 2022] GET /compute/v2.1/os-networks/1475da2c-80a2-478b-b6c8-7f7c0e5426d1 => generated 652 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:13:39.310411 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-601cf538-724e-4ebe-828b-eaffcd88adec tempest-NetworksTest-2138261684 tempest-NetworksTest-2138261684-project-admin] Calling method '.version_select at 0x7fc13157b9d0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:39.486516 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-601cf538-724e-4ebe-828b-eaffcd88adec tempest-NetworksTest-2138261684 tempest-NetworksTest-2138261684-project-admin] 10.222.0.52 "GET /compute/v2.1/os-networks" status: 200 len: 4709 microversion: 2.1 time: 0.180337 Oct 19 03:13:39.487632 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 201/407] 10.222.0.52 () {58 vars in 1137 bytes} [Wed Oct 19 03:13:39 2022] GET /compute/v2.1/os-networks => generated 4709 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:13:39.524391 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-096d2597-901f-44b6-9566-b0009127db7e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:39.525112 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-096d2597-901f-44b6-9566-b0009127db7e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 7b4a8cd9-a238-4bff-a002-497dc807bf3a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:39.540378 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-096d2597-901f-44b6-9566-b0009127db7e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:39.544519 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-096d2597-901f-44b6-9566-b0009127db7e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:39.545317 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-096d2597-901f-44b6-9566-b0009127db7e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:39.546505 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-096d2597-901f-44b6-9566-b0009127db7e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:39.547166 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-096d2597-901f-44b6-9566-b0009127db7e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:39.548911 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-096d2597-901f-44b6-9566-b0009127db7e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:39.758519 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-096d2597-901f-44b6-9566-b0009127db7e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:39.769042 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-096d2597-901f-44b6-9566-b0009127db7e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a" status: 200 len: 1477 microversion: 2.1 time: 0.249010 Oct 19 03:13:39.785540 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 207/408] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:13:39 2022] GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a => generated 1477 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:13:39.785987 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-15546d9c-46ff-4c2e-8e3b-392134e8447a tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:39.785987 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-15546d9c-46ff-4c2e-8e3b-392134e8447a tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] [instance: f538531d-7829-4f19-bf50-8eea58368871] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:39.794860 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-15546d9c-46ff-4c2e-8e3b-392134e8447a tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:39.795359 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-15546d9c-46ff-4c2e-8e3b-392134e8447a tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:39.795978 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-15546d9c-46ff-4c2e-8e3b-392134e8447a tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:39.801298 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-15546d9c-46ff-4c2e-8e3b-392134e8447a tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:39.801899 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-15546d9c-46ff-4c2e-8e3b-392134e8447a tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:39.802406 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-15546d9c-46ff-4c2e-8e3b-392134e8447a tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:39.916303 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-15546d9c-46ff-4c2e-8e3b-392134e8447a tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ff6534c5e74a2eb179044ef833f0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e88bbb75184a59b88e533a49d63cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:39.926797 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-15546d9c-46ff-4c2e-8e3b-392134e8447a tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] 10.222.0.52 "GET /compute/v2.1/servers/f538531d-7829-4f19-bf50-8eea58368871" status: 200 len: 1276 microversion: 2.1 time: 0.146753 Oct 19 03:13:39.927996 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 202/409] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:13:39 2022] GET /compute/v2.1/servers/f538531d-7829-4f19-bf50-8eea58368871 => generated 1276 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:13:40.793545 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-fe55f7b3-f790-4bdc-8d2e-72789d52bab8 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:40.795358 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-fe55f7b3-f790-4bdc-8d2e-72789d52bab8 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 7b4a8cd9-a238-4bff-a002-497dc807bf3a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:40.805793 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fe55f7b3-f790-4bdc-8d2e-72789d52bab8 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:40.805793 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fe55f7b3-f790-4bdc-8d2e-72789d52bab8 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:40.805793 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fe55f7b3-f790-4bdc-8d2e-72789d52bab8 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:40.805793 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fe55f7b3-f790-4bdc-8d2e-72789d52bab8 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:40.806118 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fe55f7b3-f790-4bdc-8d2e-72789d52bab8 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:40.806118 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fe55f7b3-f790-4bdc-8d2e-72789d52bab8 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:40.956395 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-01e5875b-c13d-4355-a5ec-b64ba6c6408f tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:40.957589 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-01e5875b-c13d-4355-a5ec-b64ba6c6408f tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] [instance: f538531d-7829-4f19-bf50-8eea58368871] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:40.970781 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-01e5875b-c13d-4355-a5ec-b64ba6c6408f tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:40.971471 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-01e5875b-c13d-4355-a5ec-b64ba6c6408f tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:40.972055 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-01e5875b-c13d-4355-a5ec-b64ba6c6408f tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:40.972904 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-01e5875b-c13d-4355-a5ec-b64ba6c6408f tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:40.973557 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-01e5875b-c13d-4355-a5ec-b64ba6c6408f tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:40.974305 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-01e5875b-c13d-4355-a5ec-b64ba6c6408f tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:41.270295 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-fe55f7b3-f790-4bdc-8d2e-72789d52bab8 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:41.284372 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-fe55f7b3-f790-4bdc-8d2e-72789d52bab8 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a" status: 200 len: 1477 microversion: 2.1 time: 0.494114 Oct 19 03:13:41.286363 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 208/410] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:13:40 2022] GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a => generated 1477 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:13:41.451123 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-01e5875b-c13d-4355-a5ec-b64ba6c6408f tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ff6534c5e74a2eb179044ef833f0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e88bbb75184a59b88e533a49d63cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:41.462940 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-01e5875b-c13d-4355-a5ec-b64ba6c6408f tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] 10.222.0.52 "GET /compute/v2.1/servers/f538531d-7829-4f19-bf50-8eea58368871" status: 200 len: 1318 microversion: 2.1 time: 0.510416 Oct 19 03:13:41.464008 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 203/411] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:13:40 2022] GET /compute/v2.1/servers/f538531d-7829-4f19-bf50-8eea58368871 => generated 1318 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:13:42.324150 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1641f632-dba4-46b6-bc41-4b86ad1ecb10 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:42.324150 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1641f632-dba4-46b6-bc41-4b86ad1ecb10 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 7b4a8cd9-a238-4bff-a002-497dc807bf3a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:42.326578 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1641f632-dba4-46b6-bc41-4b86ad1ecb10 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:42.327085 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1641f632-dba4-46b6-bc41-4b86ad1ecb10 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:42.327524 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1641f632-dba4-46b6-bc41-4b86ad1ecb10 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:42.330810 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1641f632-dba4-46b6-bc41-4b86ad1ecb10 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:42.331773 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1641f632-dba4-46b6-bc41-4b86ad1ecb10 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:42.332583 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1641f632-dba4-46b6-bc41-4b86ad1ecb10 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:42.490371 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-30d18917-5b7e-4e63-92bb-6d72840c1eb6 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:42.492370 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-30d18917-5b7e-4e63-92bb-6d72840c1eb6 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] [instance: f538531d-7829-4f19-bf50-8eea58368871] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:42.501582 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-30d18917-5b7e-4e63-92bb-6d72840c1eb6 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:42.502512 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-30d18917-5b7e-4e63-92bb-6d72840c1eb6 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:42.502952 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-30d18917-5b7e-4e63-92bb-6d72840c1eb6 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:42.503662 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-30d18917-5b7e-4e63-92bb-6d72840c1eb6 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:42.509558 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-30d18917-5b7e-4e63-92bb-6d72840c1eb6 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:42.510374 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-30d18917-5b7e-4e63-92bb-6d72840c1eb6 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:42.913818 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-1641f632-dba4-46b6-bc41-4b86ad1ecb10 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:42.924608 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:13:42.935405 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1641f632-dba4-46b6-bc41-4b86ad1ecb10 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a" status: 200 len: 1477 microversion: 2.1 time: 0.630601 Oct 19 03:13:42.939306 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 209/412] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:13:42 2022] GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a => generated 1477 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:13:43.008751 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-30d18917-5b7e-4e63-92bb-6d72840c1eb6 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ff6534c5e74a2eb179044ef833f0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e88bbb75184a59b88e533a49d63cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:43.019836 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-30d18917-5b7e-4e63-92bb-6d72840c1eb6 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] 10.222.0.52 "GET /compute/v2.1/servers/f538531d-7829-4f19-bf50-8eea58368871" status: 200 len: 1318 microversion: 2.1 time: 0.533885 Oct 19 03:13:43.021169 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 204/413] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:13:42 2022] GET /compute/v2.1/servers/f538531d-7829-4f19-bf50-8eea58368871 => generated 1318 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:13:43.613005 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-731a09c1-4cfa-4fd1-aed8-f56efa583b22 tempest-QuotasAdminTestV257-1408133864 tempest-QuotasAdminTestV257-1408133864-project-admin] Action: 'update', calling method: .version_select at 0x7fc1316c1f70>, body: {"quota_set": {"ram": "5120"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:13:43.707252 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-6f2fb86b-efff-4202-9eec-81e257efec5a req-64ee2e96-19f0-413d-aad5-d99ccd98b05b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f538531d-7829-4f19-bf50-8eea58368871", "tag": "bc401a65-cfe4-4aae-9ba9-460015bf4371"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:13:43.719672 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-6f2fb86b-efff-4202-9eec-81e257efec5a req-64ee2e96-19f0-413d-aad5-d99ccd98b05b service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:43.720303 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-6f2fb86b-efff-4202-9eec-81e257efec5a req-64ee2e96-19f0-413d-aad5-d99ccd98b05b service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:43.720962 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-6f2fb86b-efff-4202-9eec-81e257efec5a req-64ee2e96-19f0-413d-aad5-d99ccd98b05b service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:43.726485 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=100 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:13:43.735800 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-6f2fb86b-efff-4202-9eec-81e257efec5a req-64ee2e96-19f0-413d-aad5-d99ccd98b05b service nova] Creating event network-changed:bc401a65-cfe4-4aae-9ba9-460015bf4371 for instance f538531d-7829-4f19-bf50-8eea58368871 on n-h2-861333-8 Oct 19 03:13:43.741809 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-6f2fb86b-efff-4202-9eec-81e257efec5a req-64ee2e96-19f0-413d-aad5-d99ccd98b05b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040373 Oct 19 03:13:43.742978 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 205/414] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:13:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:13:43.768251 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-731a09c1-4cfa-4fd1-aed8-f56efa583b22 tempest-QuotasAdminTestV257-1408133864 tempest-QuotasAdminTestV257-1408133864-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:43.769815 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-731a09c1-4cfa-4fd1-aed8-f56efa583b22 tempest-QuotasAdminTestV257-1408133864 tempest-QuotasAdminTestV257-1408133864-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:43.769815 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-731a09c1-4cfa-4fd1-aed8-f56efa583b22 tempest-QuotasAdminTestV257-1408133864 tempest-QuotasAdminTestV257-1408133864-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:43.770027 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-731a09c1-4cfa-4fd1-aed8-f56efa583b22 tempest-QuotasAdminTestV257-1408133864 tempest-QuotasAdminTestV257-1408133864-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:43.770998 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-731a09c1-4cfa-4fd1-aed8-f56efa583b22 tempest-QuotasAdminTestV257-1408133864 tempest-QuotasAdminTestV257-1408133864-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:43.775751 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-731a09c1-4cfa-4fd1-aed8-f56efa583b22 tempest-QuotasAdminTestV257-1408133864 tempest-QuotasAdminTestV257-1408133864-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:43.963095 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ad3ec194-b281-409d-b78c-b15011e2cdd8 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:43.963795 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ad3ec194-b281-409d-b78c-b15011e2cdd8 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 7b4a8cd9-a238-4bff-a002-497dc807bf3a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:43.976330 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ad3ec194-b281-409d-b78c-b15011e2cdd8 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:43.977223 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ad3ec194-b281-409d-b78c-b15011e2cdd8 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:43.977857 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ad3ec194-b281-409d-b78c-b15011e2cdd8 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:43.978996 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ad3ec194-b281-409d-b78c-b15011e2cdd8 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:43.979625 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ad3ec194-b281-409d-b78c-b15011e2cdd8 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:43.980871 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ad3ec194-b281-409d-b78c-b15011e2cdd8 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:43.990282 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-731a09c1-4cfa-4fd1-aed8-f56efa583b22 tempest-QuotasAdminTestV257-1408133864 tempest-QuotasAdminTestV257-1408133864-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-quota-sets/21219dda25dd4d77a1616927663df358" status: 200 len: 148 microversion: 2.57 time: 0.601557 Oct 19 03:13:44.000359 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 210/415] 10.222.0.52 () {62 vars in 1303 bytes} [Wed Oct 19 03:13:43 2022] PUT /compute/v2.1/os-quota-sets/21219dda25dd4d77a1616927663df358 => generated 148 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 03:13:44.008568 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0b3c7e14-49bf-4eb1-96c1-aef4659ee3b7 tempest-QuotasAdminTestV257-1408133864 tempest-QuotasAdminTestV257-1408133864-project-admin] Calling method '.version_select at 0x7fc13157d3a0>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:44.273678 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ad3ec194-b281-409d-b78c-b15011e2cdd8 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:44.286948 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ad3ec194-b281-409d-b78c-b15011e2cdd8 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a" status: 200 len: 1477 microversion: 2.1 time: 0.328336 Oct 19 03:13:44.305811 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 206/416] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:13:43 2022] GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a => generated 1477 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:13:44.305811 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1d5ded21-8e17-4077-9368-2b893f6fb025 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:44.305811 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1d5ded21-8e17-4077-9368-2b893f6fb025 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] [instance: f538531d-7829-4f19-bf50-8eea58368871] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:44.305811 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1d5ded21-8e17-4077-9368-2b893f6fb025 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:44.306147 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1d5ded21-8e17-4077-9368-2b893f6fb025 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:44.306147 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1d5ded21-8e17-4077-9368-2b893f6fb025 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:44.306147 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1d5ded21-8e17-4077-9368-2b893f6fb025 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:44.306147 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1d5ded21-8e17-4077-9368-2b893f6fb025 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:44.306459 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1d5ded21-8e17-4077-9368-2b893f6fb025 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:44.572170 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0b3c7e14-49bf-4eb1-96c1-aef4659ee3b7 tempest-QuotasAdminTestV257-1408133864 tempest-QuotasAdminTestV257-1408133864-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:44.575820 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0b3c7e14-49bf-4eb1-96c1-aef4659ee3b7 tempest-QuotasAdminTestV257-1408133864 tempest-QuotasAdminTestV257-1408133864-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:44.576481 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0b3c7e14-49bf-4eb1-96c1-aef4659ee3b7 tempest-QuotasAdminTestV257-1408133864 tempest-QuotasAdminTestV257-1408133864-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:44.578485 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0b3c7e14-49bf-4eb1-96c1-aef4659ee3b7 tempest-QuotasAdminTestV257-1408133864 tempest-QuotasAdminTestV257-1408133864-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:44.586877 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0b3c7e14-49bf-4eb1-96c1-aef4659ee3b7 tempest-QuotasAdminTestV257-1408133864 tempest-QuotasAdminTestV257-1408133864-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:44.586877 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0b3c7e14-49bf-4eb1-96c1-aef4659ee3b7 tempest-QuotasAdminTestV257-1408133864 tempest-QuotasAdminTestV257-1408133864-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:44.599642 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-1d5ded21-8e17-4077-9368-2b893f6fb025 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ff6534c5e74a2eb179044ef833f0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e88bbb75184a59b88e533a49d63cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:44.610806 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1d5ded21-8e17-4077-9368-2b893f6fb025 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] 10.222.0.52 "GET /compute/v2.1/servers/f538531d-7829-4f19-bf50-8eea58368871" status: 200 len: 1318 microversion: 2.1 time: 0.321327 Oct 19 03:13:44.612925 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 207/417] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:13:44 2022] GET /compute/v2.1/servers/f538531d-7829-4f19-bf50-8eea58368871 => generated 1318 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:13:44.628058 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0b3c7e14-49bf-4eb1-96c1-aef4659ee3b7 tempest-QuotasAdminTestV257-1408133864 tempest-QuotasAdminTestV257-1408133864-project-admin] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/21219dda25dd4d77a1616927663df358/detail" status: 200 len: 463 microversion: 2.57 time: 0.625547 Oct 19 03:13:44.641657 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 211/418] 10.222.0.52 () {60 vars in 1304 bytes} [Wed Oct 19 03:13:44 2022] GET /compute/v2.1/os-quota-sets/21219dda25dd4d77a1616927663df358/detail => generated 463 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 03:13:44.820069 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:13:44.847502 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=6 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:13:45.107182 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2bafd830-a2c1-40a1-a24f-1a74b26b816f tempest-HostsAdminNegativeTestJSON-352891975 tempest-HostsAdminNegativeTestJSON-352891975-project-admin] Calling method '.version_select at 0x7fc1314a4700>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:45.110691 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2bafd830-a2c1-40a1-a24f-1a74b26b816f tempest-HostsAdminNegativeTestJSON-352891975 tempest-HostsAdminNegativeTestJSON-352891975-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:45.111181 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2bafd830-a2c1-40a1-a24f-1a74b26b816f tempest-HostsAdminNegativeTestJSON-352891975 tempest-HostsAdminNegativeTestJSON-352891975-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:45.113658 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2bafd830-a2c1-40a1-a24f-1a74b26b816f tempest-HostsAdminNegativeTestJSON-352891975 tempest-HostsAdminNegativeTestJSON-352891975-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:45.114413 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2bafd830-a2c1-40a1-a24f-1a74b26b816f tempest-HostsAdminNegativeTestJSON-352891975 tempest-HostsAdminNegativeTestJSON-352891975-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:45.114890 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2bafd830-a2c1-40a1-a24f-1a74b26b816f tempest-HostsAdminNegativeTestJSON-352891975 tempest-HostsAdminNegativeTestJSON-352891975-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:45.115323 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2bafd830-a2c1-40a1-a24f-1a74b26b816f tempest-HostsAdminNegativeTestJSON-352891975 tempest-HostsAdminNegativeTestJSON-352891975-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:45.143475 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=90,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:DELETE=3,nova_api:INSERT=3 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:13:45.152440 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2bafd830-a2c1-40a1-a24f-1a74b26b816f tempest-HostsAdminNegativeTestJSON-352891975 tempest-HostsAdminNegativeTestJSON-352891975-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.489010 Oct 19 03:13:45.154128 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 208/419] 10.222.0.52 () {58 vars in 1128 bytes} [Wed Oct 19 03:13:44 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:13:45.493757 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ade96926-36cc-4650-9788-2a4fa3a7dd77 tempest-HostsAdminNegativeTestJSON-943388537 tempest-HostsAdminNegativeTestJSON-943388537-project] Calling method '.version_select at 0x7fc13158e790>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:45.498926 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ade96926-36cc-4650-9788-2a4fa3a7dd77 tempest-HostsAdminNegativeTestJSON-943388537 tempest-HostsAdminNegativeTestJSON-943388537-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '0b48c6d5906945f8b8015fd430816e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d934cbff5154ebf86e8c62b8a7482ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:45.500583 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ade96926-36cc-4650-9788-2a4fa3a7dd77 tempest-HostsAdminNegativeTestJSON-943388537 tempest-HostsAdminNegativeTestJSON-943388537-project] Request method failure captured: Oct 19 03:13:45.500583 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Oct 19 03:13:45.500583 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:13:45.500583 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:13:45.500583 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:13:45.500583 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:13:45.500583 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:13:45.500583 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:13:45.500583 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:13:45.500583 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:13:45.500583 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2tmsHys0FrzvJpyLEFWir0DWoQylgDrEe3RCPjntJDARkj8XgtVNUPN6csoChL6v8v7jyab075vto0R9wkmp2AU5iFhohZGVXYA0HmiKeQBAtMtjpcZz4oBx8DJvS2wkwMDpftJDlLqViVHUoJ5BFehgtVhhPXclayv2jNqv1DGHcU Oct 19 03:13:45.500583 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:13:45.500583 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:13:45.500583 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:13:45.500583 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:13:45.500583 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:13:45.500583 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:13:45.500583 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 9d934cbff5154ebf86e8c62b8a7482ac Oct 19 03:13:45.500583 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-943388537 Oct 19 03:13:45.500583 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:13:45.500583 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:13:45.501917 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9d934cbff5154ebf86e8c62b8a7482ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9d934cbff5154ebf86e8c62b8a7482ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9d934cbff5154ebf86e8c62b8a7482ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9d934cbff5154ebf86e8c62b8a7482ac", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:13:45.501917 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-HostsAdminNegativeTestJSON-943388537 Oct 19 03:13:45.501917 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 9d934cbff5154ebf86e8c62b8a7482ac Oct 19 03:13:45.501917 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-943388537 Oct 19 03:13:45.501917 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-HostsAdminNegativeTestJSON-943388537-project Oct 19 03:13:45.501917 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:13:45.501917 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:13:45.501917 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 0b48c6d5906945f8b8015fd430816e0d Oct 19 03:13:45.501917 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-HostsAdminNegativeTestJSON-943388537-project Oct 19 03:13:45.501917 n-d-861333-8 devstack@n-api.service[121135]: method: Oct 19 03:13:45.501917 n-d-861333-8 devstack@n-api.service[121135]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 19 03:13:45.501917 n-d-861333-8 devstack@n-api.service[121135]: action_args: {} Oct 19 03:13:45.501917 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:13:45.503152 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:45.503152 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:13:45.503152 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:13:45.503152 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:13:45.503152 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:13:45.503152 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 03:13:45.503152 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 03:13:45.503152 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 19 03:13:45.503152 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:13:45.503152 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:13:45.503152 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:13:45.503152 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Oct 19 03:13:45.503152 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Oct 19 03:13:45.503152 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 19 03:13:45.503152 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 19 03:13:45.503152 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 19 03:13:45.503152 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 19 03:13:45.503152 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 03:13:45.503152 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 03:13:45.504456 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 03:13:45.504456 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 03:13:45.504456 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 19 03:13:45.504456 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 19 03:13:45.504456 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 19 03:13:45.504456 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 19 03:13:45.504456 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 19 03:13:45.504456 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 19 03:13:45.504456 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 19 03:13:45.504456 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:45.504456 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:13:45.504456 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:45.504456 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:45.504456 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:13:45.504456 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:13:45.504456 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 19 03:13:45.504456 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 19 03:13:45.504456 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 19 03:13:45.504456 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:45.506740 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ade96926-36cc-4650-9788-2a4fa3a7dd77 tempest-HostsAdminNegativeTestJSON-943388537 tempest-HostsAdminNegativeTestJSON-943388537-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:13:45.507834 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ade96926-36cc-4650-9788-2a4fa3a7dd77 tempest-HostsAdminNegativeTestJSON-943388537 tempest-HostsAdminNegativeTestJSON-943388537-project] 10.222.0.52 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.346543 Oct 19 03:13:45.515051 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 212/420] 10.222.0.52 () {58 vars in 1128 bytes} [Wed Oct 19 03:13:45 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 354 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:13:45.522710 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6c0d8135-30c2-4623-acb4-ec4128ae057c tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:45.525027 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6c0d8135-30c2-4623-acb4-ec4128ae057c tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 7b4a8cd9-a238-4bff-a002-497dc807bf3a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:45.535324 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6c0d8135-30c2-4623-acb4-ec4128ae057c tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:45.535835 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6c0d8135-30c2-4623-acb4-ec4128ae057c tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:45.539241 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6c0d8135-30c2-4623-acb4-ec4128ae057c tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:45.539241 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6c0d8135-30c2-4623-acb4-ec4128ae057c tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:45.539241 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6c0d8135-30c2-4623-acb4-ec4128ae057c tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:45.539241 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6c0d8135-30c2-4623-acb4-ec4128ae057c tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:45.571014 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-58dda82c-306b-436e-bcc4-2cc03578e308 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-2124507911", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "networks": [{"uuid": "ba959db6-6066-4748-89f7-037c7f1d280b"}]}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:13:45.653966 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-58dda82c-306b-436e-bcc4-2cc03578e308 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] validate_networks() for [('ba959db6-6066-4748-89f7-037c7f1d280b', None, None, None, None, None)] {{(pid=121134) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:13:45.807788 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-6c0d8135-30c2-4623-acb4-ec4128ae057c tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:45.816848 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6c0d8135-30c2-4623-acb4-ec4128ae057c tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a" status: 200 len: 1477 microversion: 2.1 time: 0.299119 Oct 19 03:13:45.820365 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 213/421] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:13:45 2022] GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a => generated 1477 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:13:45.821996 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-642547d3-8e1b-49e9-9514-dd4a0630f3fc tempest-HostsAdminNegativeTestJSON-943388537 tempest-HostsAdminNegativeTestJSON-943388537-project] Calling method '.version_select at 0x7fc13158e280>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:45.823773 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-642547d3-8e1b-49e9-9514-dd4a0630f3fc tempest-HostsAdminNegativeTestJSON-943388537 tempest-HostsAdminNegativeTestJSON-943388537-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '0b48c6d5906945f8b8015fd430816e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d934cbff5154ebf86e8c62b8a7482ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:45.825916 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-642547d3-8e1b-49e9-9514-dd4a0630f3fc tempest-HostsAdminNegativeTestJSON-943388537 tempest-HostsAdminNegativeTestJSON-943388537-project] Request method failure captured: Oct 19 03:13:45.825916 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/os-hosts/n-d-861333-8/reboot HTTP/1.1 Oct 19 03:13:45.825916 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:13:45.825916 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:13:45.825916 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:13:45.825916 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:13:45.825916 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:13:45.825916 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:13:45.825916 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:13:45.825916 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:13:45.825916 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2tmsHys0FrzvJpyLEFWir0DWoQylgDrEe3RCPjntJDARkj8XgtVNUPN6csoChL6v8v7jyab075vto0R9wkmp2AU5iFhohZGVXYA0HmiKeQBAtMtjpcZz4oBx8DJvS2wkwMDpftJDlLqViVHUoJ5BFehgtVhhPXclayv2jNqv1DGHcU Oct 19 03:13:45.825916 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:13:45.825916 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:13:45.825916 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:13:45.825916 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:13:45.825916 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:13:45.825916 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:13:45.825916 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 9d934cbff5154ebf86e8c62b8a7482ac Oct 19 03:13:45.825916 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-943388537 Oct 19 03:13:45.825916 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:13:45.825916 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:13:45.828286 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9d934cbff5154ebf86e8c62b8a7482ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9d934cbff5154ebf86e8c62b8a7482ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9d934cbff5154ebf86e8c62b8a7482ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9d934cbff5154ebf86e8c62b8a7482ac", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:13:45.828286 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-HostsAdminNegativeTestJSON-943388537 Oct 19 03:13:45.828286 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 9d934cbff5154ebf86e8c62b8a7482ac Oct 19 03:13:45.828286 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-943388537 Oct 19 03:13:45.828286 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-HostsAdminNegativeTestJSON-943388537-project Oct 19 03:13:45.828286 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:13:45.828286 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:13:45.828286 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 0b48c6d5906945f8b8015fd430816e0d Oct 19 03:13:45.828286 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-HostsAdminNegativeTestJSON-943388537-project Oct 19 03:13:45.828286 n-d-861333-8 devstack@n-api.service[121135]: method: Oct 19 03:13:45.828286 n-d-861333-8 devstack@n-api.service[121135]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 19 03:13:45.828286 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': 'n-d-861333-8'} Oct 19 03:13:45.828286 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:13:45.829929 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:45.829929 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:13:45.829929 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:13:45.829929 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:13:45.829929 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:13:45.829929 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 03:13:45.829929 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 03:13:45.829929 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:13:45.829929 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:13:45.829929 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Oct 19 03:13:45.829929 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Oct 19 03:13:45.829929 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 19 03:13:45.829929 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 19 03:13:45.829929 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 19 03:13:45.829929 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 19 03:13:45.829929 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 03:13:45.829929 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 03:13:45.829929 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 03:13:45.829929 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 03:13:45.831451 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 19 03:13:45.831451 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 19 03:13:45.831451 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 19 03:13:45.831451 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 19 03:13:45.831451 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 19 03:13:45.831451 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 19 03:13:45.831451 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 19 03:13:45.831451 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:45.831451 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:13:45.831451 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:45.831451 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:45.831451 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:13:45.831451 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:13:45.831451 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 19 03:13:45.831451 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 19 03:13:45.831451 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 19 03:13:45.831451 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:45.832985 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-642547d3-8e1b-49e9-9514-dd4a0630f3fc tempest-HostsAdminNegativeTestJSON-943388537 tempest-HostsAdminNegativeTestJSON-943388537-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:13:45.832985 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-642547d3-8e1b-49e9-9514-dd4a0630f3fc tempest-HostsAdminNegativeTestJSON-943388537 tempest-HostsAdminNegativeTestJSON-943388537-project] 10.222.0.52 "GET /compute/v2.1/os-hosts/n-d-861333-8/reboot" status: 403 len: 111 microversion: 2.1 time: 0.008801 Oct 19 03:13:45.833951 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 214/422] 10.222.0.52 () {58 vars in 1188 bytes} [Wed Oct 19 03:13:45 2022] GET /compute/v2.1/os-hosts/n-d-861333-8/reboot => generated 111 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:13:45.837985 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ca63c579-0b4e-41cf-a4d9-5e7f69e4a9e9 tempest-QuotasAdminTestV257-1408133864 tempest-QuotasAdminTestV257-1408133864-project-admin] Action: 'update', calling method: .version_select at 0x7fc1315bc8b0>, body: {"quota_set": {"ram": "2048"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:13:46.108334 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ca63c579-0b4e-41cf-a4d9-5e7f69e4a9e9 tempest-QuotasAdminTestV257-1408133864 tempest-QuotasAdminTestV257-1408133864-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:46.109174 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ca63c579-0b4e-41cf-a4d9-5e7f69e4a9e9 tempest-QuotasAdminTestV257-1408133864 tempest-QuotasAdminTestV257-1408133864-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:46.109958 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ca63c579-0b4e-41cf-a4d9-5e7f69e4a9e9 tempest-QuotasAdminTestV257-1408133864 tempest-QuotasAdminTestV257-1408133864-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:46.111944 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ca63c579-0b4e-41cf-a4d9-5e7f69e4a9e9 tempest-QuotasAdminTestV257-1408133864 tempest-QuotasAdminTestV257-1408133864-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:46.111944 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ca63c579-0b4e-41cf-a4d9-5e7f69e4a9e9 tempest-QuotasAdminTestV257-1408133864 tempest-QuotasAdminTestV257-1408133864-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:46.112269 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ca63c579-0b4e-41cf-a4d9-5e7f69e4a9e9 tempest-QuotasAdminTestV257-1408133864 tempest-QuotasAdminTestV257-1408133864-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:46.159157 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ca63c579-0b4e-41cf-a4d9-5e7f69e4a9e9 tempest-QuotasAdminTestV257-1408133864 tempest-QuotasAdminTestV257-1408133864-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:46.159873 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ca63c579-0b4e-41cf-a4d9-5e7f69e4a9e9 tempest-QuotasAdminTestV257-1408133864 tempest-QuotasAdminTestV257-1408133864-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:46.160474 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ca63c579-0b4e-41cf-a4d9-5e7f69e4a9e9 tempest-QuotasAdminTestV257-1408133864 tempest-QuotasAdminTestV257-1408133864-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:46.161423 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ca63c579-0b4e-41cf-a4d9-5e7f69e4a9e9 tempest-QuotasAdminTestV257-1408133864 tempest-QuotasAdminTestV257-1408133864-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:46.162348 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ca63c579-0b4e-41cf-a4d9-5e7f69e4a9e9 tempest-QuotasAdminTestV257-1408133864 tempest-QuotasAdminTestV257-1408133864-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:46.162982 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ca63c579-0b4e-41cf-a4d9-5e7f69e4a9e9 tempest-QuotasAdminTestV257-1408133864 tempest-QuotasAdminTestV257-1408133864-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:46.250422 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-58dda82c-306b-436e-bcc4-2cc03578e308 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Flavor limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:13:46.252025 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-58dda82c-306b-436e-bcc4-2cc03578e308 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Image limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:13:46.252502 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-58dda82c-306b-436e-bcc4-2cc03578e308 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Flavor pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:13:46.253069 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-58dda82c-306b-436e-bcc4-2cc03578e308 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Image pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:13:46.253679 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-58dda82c-306b-436e-bcc4-2cc03578e308 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:13:46.264298 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-58dda82c-306b-436e-bcc4-2cc03578e308 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:46.267303 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-58dda82c-306b-436e-bcc4-2cc03578e308 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:46.267303 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-58dda82c-306b-436e-bcc4-2cc03578e308 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:46.267303 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-58dda82c-306b-436e-bcc4-2cc03578e308 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:46.267303 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-58dda82c-306b-436e-bcc4-2cc03578e308 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:46.267698 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-58dda82c-306b-436e-bcc4-2cc03578e308 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:46.288281 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ca63c579-0b4e-41cf-a4d9-5e7f69e4a9e9 tempest-QuotasAdminTestV257-1408133864 tempest-QuotasAdminTestV257-1408133864-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-quota-sets/21219dda25dd4d77a1616927663df358?user_id=9cab5a0d02fe46dbb23e6d6b728cb2f7" status: 200 len: 148 microversion: 2.57 time: 0.453818 Oct 19 03:13:46.295412 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-58dda82c-306b-436e-bcc4-2cc03578e308 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Getting quotas for project 86eaac72e51142f795b3e482be19c4f2. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:13:46.295633 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 215/423] 10.222.0.52 () {62 vars in 1384 bytes} [Wed Oct 19 03:13:45 2022] PUT /compute/v2.1/os-quota-sets/21219dda25dd4d77a1616927663df358?user_id=9cab5a0d02fe46dbb23e6d6b728cb2f7 => generated 148 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 03:13:46.296592 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2fb4ddc9-8ad0-4734-8696-532fc29726a2 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:46.297343 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-2fb4ddc9-8ad0-4734-8696-532fc29726a2 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] [instance: f538531d-7829-4f19-bf50-8eea58368871] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:46.301019 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-58dda82c-306b-436e-bcc4-2cc03578e308 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Getting quotas for user 7a453f077dae4dfa8a3cf28c555a9a7c and project 86eaac72e51142f795b3e482be19c4f2. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:13:46.307109 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2fb4ddc9-8ad0-4734-8696-532fc29726a2 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:46.307777 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2fb4ddc9-8ad0-4734-8696-532fc29726a2 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:46.308343 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2fb4ddc9-8ad0-4734-8696-532fc29726a2 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:46.309658 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2fb4ddc9-8ad0-4734-8696-532fc29726a2 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:46.310183 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2fb4ddc9-8ad0-4734-8696-532fc29726a2 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:46.310672 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2fb4ddc9-8ad0-4734-8696-532fc29726a2 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:46.324198 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-58dda82c-306b-436e-bcc4-2cc03578e308 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Going to run 1 instances... {{(pid=121134) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:13:46.326794 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-58dda82c-306b-436e-bcc4-2cc03578e308 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 82f8d22c-99ee-4c2b-8a36-5299c187ace7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:13:46.512864 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-2fb4ddc9-8ad0-4734-8696-532fc29726a2 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ff6534c5e74a2eb179044ef833f0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e88bbb75184a59b88e533a49d63cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:46.522970 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2fb4ddc9-8ad0-4734-8696-532fc29726a2 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] 10.222.0.52 "GET /compute/v2.1/servers/f538531d-7829-4f19-bf50-8eea58368871" status: 200 len: 1318 microversion: 2.1 time: 0.232247 Oct 19 03:13:46.523871 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 216/424] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:13:46 2022] GET /compute/v2.1/servers/f538531d-7829-4f19-bf50-8eea58368871 => generated 1318 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:13:46.528474 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-58dda82c-306b-436e-bcc4-2cc03578e308 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.342686 Oct 19 03:13:46.537122 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 209/425] 10.222.0.52 () {62 vars in 1188 bytes} [Wed Oct 19 03:13:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1352 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 19 03:13:46.552166 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7fca0e2c-25d8-4060-9ec0-7db931c3c45c tempest-QuotasAdminTestV257-1408133864 tempest-QuotasAdminTestV257-1408133864-project-admin] Calling method '.version_select at 0x7fc1314a4af0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:46.553605 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2c9aac18-ebf2-4dc2-b9f6-fa405392a22d tempest-HostsAdminNegativeTestJSON-352891975 tempest-HostsAdminNegativeTestJSON-352891975-project-admin] Calling method '.version_select at 0x7fc13158eaf0>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:46.593744 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-2c9aac18-ebf2-4dc2-b9f6-fa405392a22d tempest-HostsAdminNegativeTestJSON-352891975 tempest-HostsAdminNegativeTestJSON-352891975-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 19 03:13:46.596858 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2c9aac18-ebf2-4dc2-b9f6-fa405392a22d tempest-HostsAdminNegativeTestJSON-352891975 tempest-HostsAdminNegativeTestJSON-352891975-project-admin] Request method failure captured: Oct 19 03:13:46.596858 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Oct 19 03:13:46.596858 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:13:46.596858 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:13:46.596858 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:13:46.596858 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:13:46.596858 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:13:46.596858 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:13:46.596858 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:13:46.596858 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:13:46.596858 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2toWFB9oXmQeKnsVO2oeSaxK0uc_F8r5YnVCjhlBUcXj7fwhehshjeXhexejHz2F6pbO-19ZhdBr92yM02TNqv20lSX0Ng2ZUd1Sx-xb_D_GMHwaYdrZD9cL81ylxGu04ekuG3feItqAKs9oGz8TlU6LOGNeWMRPcKuFd00UQ-efDQ Oct 19 03:13:46.596858 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:13:46.596858 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:13:46.596858 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:13:46.596858 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:13:46.596858 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:13:46.596858 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:13:46.596858 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 5684099113314fa9a67fbf75e3cd3910 Oct 19 03:13:46.596858 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-352891975 Oct 19 03:13:46.596858 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member,admin Oct 19 03:13:46.596858 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member,admin Oct 19 03:13:46.598204 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5684099113314fa9a67fbf75e3cd3910"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5684099113314fa9a67fbf75e3cd3910"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5684099113314fa9a67fbf75e3cd3910"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5684099113314fa9a67fbf75e3cd3910", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:13:46.598204 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-HostsAdminNegativeTestJSON-352891975 Oct 19 03:13:46.598204 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 5684099113314fa9a67fbf75e3cd3910 Oct 19 03:13:46.598204 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-352891975 Oct 19 03:13:46.598204 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-HostsAdminNegativeTestJSON-352891975-project-admin Oct 19 03:13:46.598204 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:13:46.598204 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:13:46.598204 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: a6a491f8a3ef45c381303ebcc4cc9d07 Oct 19 03:13:46.598204 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-HostsAdminNegativeTestJSON-352891975-project-admin Oct 19 03:13:46.598204 n-d-861333-8 devstack@n-api.service[121135]: method: Oct 19 03:13:46.598204 n-d-861333-8 devstack@n-api.service[121135]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 19 03:13:46.598204 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': 'nonexistent_hostname'} Oct 19 03:13:46.598204 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:13:46.599496 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:46.599496 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 19 03:13:46.599496 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 19 03:13:46.599496 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 19 03:13:46.599496 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 19 03:13:46.599496 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 03:13:46.599496 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 03:13:46.599496 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 03:13:46.599496 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 03:13:46.599496 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 19 03:13:46.599496 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 19 03:13:46.599496 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 19 03:13:46.599496 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 19 03:13:46.599496 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 03:13:46.599496 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 03:13:46.599496 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 19 03:13:46.599496 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 19 03:13:46.599496 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 19 03:13:46.599496 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 19 03:13:46.601263 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 19 03:13:46.601263 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 19 03:13:46.601263 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 19 03:13:46.601263 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:46.601263 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:13:46.601263 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:46.601263 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:46.601263 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:13:46.601263 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:13:46.601263 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:13:46.601263 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:13:46.601263 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 03:13:46.601263 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 03:13:46.601263 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:13:46.601263 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:13:46.601263 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Oct 19 03:13:46.601263 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Oct 19 03:13:46.601263 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 19 03:13:46.601263 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:13:46.607265 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 19 03:13:46.607265 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:46.607265 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:13:46.607265 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:46.607265 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:46.607265 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:13:46.607265 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:13:46.607265 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:13:46.607265 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:13:46.607265 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 19 03:13:46.607265 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:46.614265 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2c9aac18-ebf2-4dc2-b9f6-fa405392a22d tempest-HostsAdminNegativeTestJSON-352891975 tempest-HostsAdminNegativeTestJSON-352891975-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:13:46.615511 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2c9aac18-ebf2-4dc2-b9f6-fa405392a22d tempest-HostsAdminNegativeTestJSON-352891975 tempest-HostsAdminNegativeTestJSON-352891975-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.073191 Oct 19 03:13:46.616752 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 217/426] 10.222.0.52 () {58 vars in 1212 bytes} [Wed Oct 19 03:13:46 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 03:13:46.622476 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-812d11f1-1b4a-4310-8142-5c721801764e tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:46.623647 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-812d11f1-1b4a-4310-8142-5c721801764e tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 82f8d22c-99ee-4c2b-8a36-5299c187ace7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:46.695649 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-812d11f1-1b4a-4310-8142-5c721801764e tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:46.706115 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-812d11f1-1b4a-4310-8142-5c721801764e tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:46.708532 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-812d11f1-1b4a-4310-8142-5c721801764e tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:46.709798 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-812d11f1-1b4a-4310-8142-5c721801764e tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/82f8d22c-99ee-4c2b-8a36-5299c187ace7" status: 200 len: 1262 microversion: 2.25 time: 0.091726 Oct 19 03:13:46.713571 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 218/427] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:13:46 2022] GET /compute/v2.1/servers/82f8d22c-99ee-4c2b-8a36-5299c187ace7 => generated 1262 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:13:46.732261 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3c0df32a-ea47-4f88-b8e4-2116acf0ac2c tempest-HostsAdminNegativeTestJSON-943388537 tempest-HostsAdminNegativeTestJSON-943388537-project] Calling method '.version_select at 0x7fc13158e9d0>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:46.732261 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-3c0df32a-ea47-4f88-b8e4-2116acf0ac2c tempest-HostsAdminNegativeTestJSON-943388537 tempest-HostsAdminNegativeTestJSON-943388537-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '0b48c6d5906945f8b8015fd430816e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d934cbff5154ebf86e8c62b8a7482ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:46.732261 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3c0df32a-ea47-4f88-b8e4-2116acf0ac2c tempest-HostsAdminNegativeTestJSON-943388537 tempest-HostsAdminNegativeTestJSON-943388537-project] Request method failure captured: Oct 19 03:13:46.732261 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/os-hosts/n-d-861333-8 HTTP/1.1 Oct 19 03:13:46.732261 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:13:46.732261 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:13:46.732261 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:13:46.732261 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:13:46.732261 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:13:46.732261 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:13:46.732261 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:13:46.732261 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:13:46.732261 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2tmsHys0FrzvJpyLEFWir0DWoQylgDrEe3RCPjntJDARkj8XgtVNUPN6csoChL6v8v7jyab075vto0R9wkmp2AU5iFhohZGVXYA0HmiKeQBAtMtjpcZz4oBx8DJvS2wkwMDpftJDlLqViVHUoJ5BFehgtVhhPXclayv2jNqv1DGHcU Oct 19 03:13:46.732261 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:13:46.732261 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:13:46.732261 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:13:46.732261 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:13:46.733333 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:13:46.733333 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:13:46.733333 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 9d934cbff5154ebf86e8c62b8a7482ac Oct 19 03:13:46.733333 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-943388537 Oct 19 03:13:46.733333 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:13:46.733333 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:13:46.733333 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9d934cbff5154ebf86e8c62b8a7482ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9d934cbff5154ebf86e8c62b8a7482ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9d934cbff5154ebf86e8c62b8a7482ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9d934cbff5154ebf86e8c62b8a7482ac", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:13:46.733333 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-HostsAdminNegativeTestJSON-943388537 Oct 19 03:13:46.733333 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 9d934cbff5154ebf86e8c62b8a7482ac Oct 19 03:13:46.733333 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-943388537 Oct 19 03:13:46.733333 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-HostsAdminNegativeTestJSON-943388537-project Oct 19 03:13:46.733333 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:13:46.733333 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:13:46.733333 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 0b48c6d5906945f8b8015fd430816e0d Oct 19 03:13:46.733333 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-HostsAdminNegativeTestJSON-943388537-project Oct 19 03:13:46.733333 n-d-861333-8 devstack@n-api.service[121135]: method: Oct 19 03:13:46.734497 n-d-861333-8 devstack@n-api.service[121135]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 19 03:13:46.734497 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': 'n-d-861333-8'} Oct 19 03:13:46.734497 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:13:46.734497 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:46.734497 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:13:46.734497 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:13:46.734497 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:13:46.734497 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:13:46.734497 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 03:13:46.734497 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 03:13:46.734497 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:13:46.734497 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:13:46.734497 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Oct 19 03:13:46.734497 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Oct 19 03:13:46.734497 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 19 03:13:46.734497 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 19 03:13:46.734497 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 19 03:13:46.734497 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 19 03:13:46.734497 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 03:13:46.734497 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 03:13:46.735712 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 03:13:46.735712 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 03:13:46.735712 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 19 03:13:46.735712 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 19 03:13:46.735712 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 19 03:13:46.735712 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 19 03:13:46.735712 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 19 03:13:46.735712 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 19 03:13:46.735712 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 19 03:13:46.735712 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:46.735712 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:13:46.735712 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:46.735712 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:46.735712 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:13:46.735712 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:13:46.735712 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 19 03:13:46.735712 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 19 03:13:46.735712 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 19 03:13:46.735712 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:46.736715 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3c0df32a-ea47-4f88-b8e4-2116acf0ac2c tempest-HostsAdminNegativeTestJSON-943388537 tempest-HostsAdminNegativeTestJSON-943388537-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:13:46.736715 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-3c0df32a-ea47-4f88-b8e4-2116acf0ac2c tempest-HostsAdminNegativeTestJSON-943388537 tempest-HostsAdminNegativeTestJSON-943388537-project] 10.222.0.52 "GET /compute/v2.1/os-hosts/n-d-861333-8" status: 403 len: 109 microversion: 2.1 time: 0.009587 Oct 19 03:13:46.736715 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 219/428] 10.222.0.52 () {58 vars in 1167 bytes} [Wed Oct 19 03:13:46 2022] GET /compute/v2.1/os-hosts/n-d-861333-8 => generated 109 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:13:46.770372 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-69f59337-fb6a-443a-9e48-6e5de2e75a03 tempest-HostsAdminNegativeTestJSON-352891975 tempest-HostsAdminNegativeTestJSON-352891975-project-admin] Calling method '.version_select at 0x7fc131526af0>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:46.784697 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-69f59337-fb6a-443a-9e48-6e5de2e75a03 tempest-HostsAdminNegativeTestJSON-352891975 tempest-HostsAdminNegativeTestJSON-352891975-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 19 03:13:46.790804 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-69f59337-fb6a-443a-9e48-6e5de2e75a03 tempest-HostsAdminNegativeTestJSON-352891975 tempest-HostsAdminNegativeTestJSON-352891975-project-admin] Request method failure captured: Oct 19 03:13:46.790804 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 19 03:13:46.790804 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:13:46.790804 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:13:46.790804 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:13:46.790804 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:13:46.790804 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:13:46.790804 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:13:46.790804 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:13:46.790804 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:13:46.790804 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2toWFB9oXmQeKnsVO2oeSaxK0uc_F8r5YnVCjhlBUcXj7fwhehshjeXhexejHz2F6pbO-19ZhdBr92yM02TNqv20lSX0Ng2ZUd1Sx-xb_D_GMHwaYdrZD9cL81ylxGu04ekuG3feItqAKs9oGz8TlU6LOGNeWMRPcKuFd00UQ-efDQ Oct 19 03:13:46.790804 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:13:46.790804 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:13:46.790804 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:13:46.790804 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:13:46.790804 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:13:46.790804 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:13:46.790804 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 5684099113314fa9a67fbf75e3cd3910 Oct 19 03:13:46.790804 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-352891975 Oct 19 03:13:46.790804 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member,admin Oct 19 03:13:46.790804 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member,admin Oct 19 03:13:46.792084 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5684099113314fa9a67fbf75e3cd3910"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5684099113314fa9a67fbf75e3cd3910"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5684099113314fa9a67fbf75e3cd3910"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5684099113314fa9a67fbf75e3cd3910", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:13:46.792084 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-HostsAdminNegativeTestJSON-352891975 Oct 19 03:13:46.792084 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 5684099113314fa9a67fbf75e3cd3910 Oct 19 03:13:46.792084 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-352891975 Oct 19 03:13:46.792084 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-HostsAdminNegativeTestJSON-352891975-project-admin Oct 19 03:13:46.792084 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:13:46.792084 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:13:46.792084 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: a6a491f8a3ef45c381303ebcc4cc9d07 Oct 19 03:13:46.792084 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-HostsAdminNegativeTestJSON-352891975-project-admin Oct 19 03:13:46.792084 n-d-861333-8 devstack@n-api.service[121135]: method: Oct 19 03:13:46.792084 n-d-861333-8 devstack@n-api.service[121135]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 19 03:13:46.792084 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': 'nonexistent_hostname'} Oct 19 03:13:46.792084 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:13:46.792817 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:46.792817 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Oct 19 03:13:46.792817 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 19 03:13:46.792817 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 03:13:46.792817 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 03:13:46.792817 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 19 03:13:46.792817 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 19 03:13:46.792817 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 19 03:13:46.792817 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 19 03:13:46.792817 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 19 03:13:46.792817 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 19 03:13:46.792817 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 19 03:13:46.792817 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:46.792817 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:13:46.792817 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:46.792817 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:46.792817 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:13:46.792817 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:13:46.792817 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:13:46.794394 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:13:46.794394 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 03:13:46.794394 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 03:13:46.794394 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:13:46.794394 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:13:46.794394 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Oct 19 03:13:46.794394 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:13:46.794394 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 19 03:13:46.794394 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:46.794394 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:13:46.794394 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:46.794394 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:46.794394 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:13:46.794394 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:13:46.794394 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:13:46.794394 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:13:46.794394 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 19 03:13:46.794394 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:46.795333 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-69f59337-fb6a-443a-9e48-6e5de2e75a03 tempest-HostsAdminNegativeTestJSON-352891975 tempest-HostsAdminNegativeTestJSON-352891975-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:13:46.796900 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-69f59337-fb6a-443a-9e48-6e5de2e75a03 tempest-HostsAdminNegativeTestJSON-352891975 tempest-HostsAdminNegativeTestJSON-352891975-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.056134 Oct 19 03:13:46.799266 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 220/429] 10.222.0.52 () {58 vars in 1191 bytes} [Wed Oct 19 03:13:46 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 03:13:46.990749 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d9953cfb-d7c9-47c6-bea8-a564e9e0d704 tempest-HypervisorAdminV228Test-477442495 tempest-HypervisorAdminV228Test-477442495-project-admin] Calling method '.version_select at 0x7fc131526af0>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:46.998022 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d9953cfb-d7c9-47c6-bea8-a564e9e0d704 tempest-HypervisorAdminV228Test-477442495 tempest-HypervisorAdminV228Test-477442495-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:46.998789 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d9953cfb-d7c9-47c6-bea8-a564e9e0d704 tempest-HypervisorAdminV228Test-477442495 tempest-HypervisorAdminV228Test-477442495-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:46.999461 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d9953cfb-d7c9-47c6-bea8-a564e9e0d704 tempest-HypervisorAdminV228Test-477442495 tempest-HypervisorAdminV228Test-477442495-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:47.024729 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d9953cfb-d7c9-47c6-bea8-a564e9e0d704 tempest-HypervisorAdminV228Test-477442495 tempest-HypervisorAdminV228Test-477442495-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:47.024729 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d9953cfb-d7c9-47c6-bea8-a564e9e0d704 tempest-HypervisorAdminV228Test-477442495 tempest-HypervisorAdminV228Test-477442495-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:47.024729 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d9953cfb-d7c9-47c6-bea8-a564e9e0d704 tempest-HypervisorAdminV228Test-477442495 tempest-HypervisorAdminV228Test-477442495-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:47.035786 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d9953cfb-d7c9-47c6-bea8-a564e9e0d704 tempest-HypervisorAdminV228Test-477442495 tempest-HypervisorAdminV228Test-477442495-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:47.036285 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d9953cfb-d7c9-47c6-bea8-a564e9e0d704 tempest-HypervisorAdminV228Test-477442495 tempest-HypervisorAdminV228Test-477442495-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:47.036730 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d9953cfb-d7c9-47c6-bea8-a564e9e0d704 tempest-HypervisorAdminV228Test-477442495 tempest-HypervisorAdminV228Test-477442495-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:47.053098 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d9953cfb-d7c9-47c6-bea8-a564e9e0d704 tempest-HypervisorAdminV228Test-477442495 tempest-HypervisorAdminV228Test-477442495-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.251011 Oct 19 03:13:47.054048 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 221/430] 10.222.0.52 () {60 vars in 1187 bytes} [Wed Oct 19 03:13:46 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 03:13:47.064169 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f63710fd-985a-469d-bb25-9c6bdd511b7d tempest-HostsAdminNegativeTestJSON-943388537 tempest-HostsAdminNegativeTestJSON-943388537-project] Calling method '.version_select at 0x7fc13158ee50>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:47.070794 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f63710fd-985a-469d-bb25-9c6bdd511b7d tempest-HostsAdminNegativeTestJSON-943388537 tempest-HostsAdminNegativeTestJSON-943388537-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '0b48c6d5906945f8b8015fd430816e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d934cbff5154ebf86e8c62b8a7482ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:47.072459 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f63710fd-985a-469d-bb25-9c6bdd511b7d tempest-HostsAdminNegativeTestJSON-943388537 tempest-HostsAdminNegativeTestJSON-943388537-project] Request method failure captured: Oct 19 03:13:47.072459 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/os-hosts/n-d-861333-8/shutdown HTTP/1.1 Oct 19 03:13:47.072459 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:13:47.072459 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:13:47.072459 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:13:47.072459 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:13:47.072459 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:13:47.072459 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:13:47.072459 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:13:47.072459 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:13:47.072459 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2tmsHys0FrzvJpyLEFWir0DWoQylgDrEe3RCPjntJDARkj8XgtVNUPN6csoChL6v8v7jyab075vto0R9wkmp2AU5iFhohZGVXYA0HmiKeQBAtMtjpcZz4oBx8DJvS2wkwMDpftJDlLqViVHUoJ5BFehgtVhhPXclayv2jNqv1DGHcU Oct 19 03:13:47.072459 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:13:47.072459 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:13:47.072459 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:13:47.072459 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:13:47.072459 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:13:47.072459 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:13:47.072459 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 9d934cbff5154ebf86e8c62b8a7482ac Oct 19 03:13:47.072459 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-943388537 Oct 19 03:13:47.072459 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:13:47.072459 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:13:47.073773 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9d934cbff5154ebf86e8c62b8a7482ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9d934cbff5154ebf86e8c62b8a7482ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9d934cbff5154ebf86e8c62b8a7482ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9d934cbff5154ebf86e8c62b8a7482ac", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:13:47.073773 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-HostsAdminNegativeTestJSON-943388537 Oct 19 03:13:47.073773 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 9d934cbff5154ebf86e8c62b8a7482ac Oct 19 03:13:47.073773 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-943388537 Oct 19 03:13:47.073773 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-HostsAdminNegativeTestJSON-943388537-project Oct 19 03:13:47.073773 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:13:47.073773 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:13:47.073773 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 0b48c6d5906945f8b8015fd430816e0d Oct 19 03:13:47.073773 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-HostsAdminNegativeTestJSON-943388537-project Oct 19 03:13:47.073773 n-d-861333-8 devstack@n-api.service[121135]: method: Oct 19 03:13:47.073773 n-d-861333-8 devstack@n-api.service[121135]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 19 03:13:47.073773 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': 'n-d-861333-8'} Oct 19 03:13:47.073773 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:13:47.074505 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:47.074505 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:13:47.074505 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:13:47.074505 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:13:47.074505 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:13:47.074505 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 03:13:47.074505 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 03:13:47.074505 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:13:47.074505 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:13:47.074505 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Oct 19 03:13:47.074505 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Oct 19 03:13:47.074505 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 19 03:13:47.074505 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 19 03:13:47.074505 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 19 03:13:47.074505 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 19 03:13:47.074505 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 03:13:47.074505 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 03:13:47.074505 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 03:13:47.074505 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 03:13:47.076405 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 19 03:13:47.076405 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 19 03:13:47.076405 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 19 03:13:47.076405 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 19 03:13:47.076405 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 19 03:13:47.076405 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 19 03:13:47.076405 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 19 03:13:47.076405 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:47.076405 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:13:47.076405 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:47.076405 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:47.076405 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:13:47.076405 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:13:47.076405 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 19 03:13:47.076405 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 19 03:13:47.076405 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 19 03:13:47.076405 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:47.077578 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f63710fd-985a-469d-bb25-9c6bdd511b7d tempest-HostsAdminNegativeTestJSON-943388537 tempest-HostsAdminNegativeTestJSON-943388537-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:13:47.077578 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f63710fd-985a-469d-bb25-9c6bdd511b7d tempest-HostsAdminNegativeTestJSON-943388537 tempest-HostsAdminNegativeTestJSON-943388537-project] 10.222.0.52 "GET /compute/v2.1/os-hosts/n-d-861333-8/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.017985 Oct 19 03:13:47.077578 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 222/431] 10.222.0.52 () {58 vars in 1194 bytes} [Wed Oct 19 03:13:47 2022] GET /compute/v2.1/os-hosts/n-d-861333-8/shutdown => generated 113 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:13:47.085708 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7fca0e2c-25d8-4060-9ec0-7db931c3c45c tempest-QuotasAdminTestV257-1408133864 tempest-QuotasAdminTestV257-1408133864-project-admin] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/21219dda25dd4d77a1616927663df358?user_id=9cab5a0d02fe46dbb23e6d6b728cb2f7" status: 200 len: 190 microversion: 2.57 time: 0.541511 Oct 19 03:13:47.085708 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 210/432] 10.222.0.52 () {60 vars in 1364 bytes} [Wed Oct 19 03:13:46 2022] GET /compute/v2.1/os-quota-sets/21219dda25dd4d77a1616927663df358?user_id=9cab5a0d02fe46dbb23e6d6b728cb2f7 => generated 190 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 03:13:47.085859 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e772ae4c-28ea-4709-bb39-bb7e24d6d658 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:47.085859 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e772ae4c-28ea-4709-bb39-bb7e24d6d658 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 7b4a8cd9-a238-4bff-a002-497dc807bf3a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:47.091688 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e772ae4c-28ea-4709-bb39-bb7e24d6d658 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:47.092383 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e772ae4c-28ea-4709-bb39-bb7e24d6d658 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:47.092873 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e772ae4c-28ea-4709-bb39-bb7e24d6d658 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:47.093579 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e772ae4c-28ea-4709-bb39-bb7e24d6d658 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:47.094239 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e772ae4c-28ea-4709-bb39-bb7e24d6d658 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:47.094683 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e772ae4c-28ea-4709-bb39-bb7e24d6d658 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:47.095635 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e5f6f4b7-dac0-4610-b022-a889b9d5e77b tempest-HypervisorAdminV228Test-477442495 tempest-HypervisorAdminV228Test-477442495-project-admin] Calling method '.version_select at 0x7fc1316a6c10>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:47.098210 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e5f6f4b7-dac0-4610-b022-a889b9d5e77b tempest-HypervisorAdminV228Test-477442495 tempest-HypervisorAdminV228Test-477442495-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:47.098970 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e5f6f4b7-dac0-4610-b022-a889b9d5e77b tempest-HypervisorAdminV228Test-477442495 tempest-HypervisorAdminV228Test-477442495-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:47.113527 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e5f6f4b7-dac0-4610-b022-a889b9d5e77b tempest-HypervisorAdminV228Test-477442495 tempest-HypervisorAdminV228Test-477442495-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:47.139304 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e5f6f4b7-dac0-4610-b022-a889b9d5e77b tempest-HypervisorAdminV228Test-477442495 tempest-HypervisorAdminV228Test-477442495-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:47.139981 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e5f6f4b7-dac0-4610-b022-a889b9d5e77b tempest-HypervisorAdminV228Test-477442495 tempest-HypervisorAdminV228Test-477442495-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:47.140430 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e5f6f4b7-dac0-4610-b022-a889b9d5e77b tempest-HypervisorAdminV228Test-477442495 tempest-HypervisorAdminV228Test-477442495-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:47.148472 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e5f6f4b7-dac0-4610-b022-a889b9d5e77b tempest-HypervisorAdminV228Test-477442495 tempest-HypervisorAdminV228Test-477442495-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.055789 Oct 19 03:13:47.149608 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 211/433] 10.222.0.52 () {60 vars in 1193 bytes} [Wed Oct 19 03:13:47 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 03:13:47.162635 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2c8f66df-1295-4b5d-bef9-60b325f4e552 tempest-HostsAdminNegativeTestJSON-352891975 tempest-HostsAdminNegativeTestJSON-352891975-project-admin] Calling method '.version_select at 0x7fc13158f160>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:47.179042 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-2c8f66df-1295-4b5d-bef9-60b325f4e552 tempest-HostsAdminNegativeTestJSON-352891975 tempest-HostsAdminNegativeTestJSON-352891975-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 19 03:13:47.182632 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2c8f66df-1295-4b5d-bef9-60b325f4e552 tempest-HostsAdminNegativeTestJSON-352891975 tempest-HostsAdminNegativeTestJSON-352891975-project-admin] Request method failure captured: Oct 19 03:13:47.182632 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Oct 19 03:13:47.182632 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:13:47.182632 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:13:47.182632 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:13:47.182632 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:13:47.182632 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:13:47.182632 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:13:47.182632 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:13:47.182632 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:13:47.182632 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT2toWFB9oXmQeKnsVO2oeSaxK0uc_F8r5YnVCjhlBUcXj7fwhehshjeXhexejHz2F6pbO-19ZhdBr92yM02TNqv20lSX0Ng2ZUd1Sx-xb_D_GMHwaYdrZD9cL81ylxGu04ekuG3feItqAKs9oGz8TlU6LOGNeWMRPcKuFd00UQ-efDQ Oct 19 03:13:47.182632 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:13:47.182632 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:13:47.182632 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:13:47.182632 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:13:47.182632 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:13:47.182632 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:13:47.182632 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 5684099113314fa9a67fbf75e3cd3910 Oct 19 03:13:47.182632 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-352891975 Oct 19 03:13:47.182632 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member,admin Oct 19 03:13:47.182632 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member,admin Oct 19 03:13:47.184134 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5684099113314fa9a67fbf75e3cd3910"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5684099113314fa9a67fbf75e3cd3910"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5684099113314fa9a67fbf75e3cd3910"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5684099113314fa9a67fbf75e3cd3910", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:13:47.184134 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-HostsAdminNegativeTestJSON-352891975 Oct 19 03:13:47.184134 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 5684099113314fa9a67fbf75e3cd3910 Oct 19 03:13:47.184134 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-352891975 Oct 19 03:13:47.184134 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-HostsAdminNegativeTestJSON-352891975-project-admin Oct 19 03:13:47.184134 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:13:47.184134 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:13:47.184134 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: a6a491f8a3ef45c381303ebcc4cc9d07 Oct 19 03:13:47.184134 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-HostsAdminNegativeTestJSON-352891975-project-admin Oct 19 03:13:47.184134 n-d-861333-8 devstack@n-api.service[121134]: method: Oct 19 03:13:47.184134 n-d-861333-8 devstack@n-api.service[121134]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 19 03:13:47.184134 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': 'nonexistent_hostname'} Oct 19 03:13:47.184134 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:13:47.184870 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:47.184870 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 19 03:13:47.184870 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 19 03:13:47.184870 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 19 03:13:47.184870 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 19 03:13:47.184870 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 03:13:47.184870 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 03:13:47.184870 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 03:13:47.184870 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 03:13:47.184870 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 19 03:13:47.184870 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 19 03:13:47.184870 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 19 03:13:47.184870 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 19 03:13:47.184870 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 03:13:47.184870 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 03:13:47.184870 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 19 03:13:47.184870 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 19 03:13:47.184870 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 19 03:13:47.184870 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 19 03:13:47.186175 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 19 03:13:47.186175 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 19 03:13:47.186175 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 19 03:13:47.186175 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:13:47.186175 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:13:47.186175 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:13:47.186175 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:47.186175 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:13:47.186175 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:13:47.186175 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:13:47.186175 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:13:47.186175 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 03:13:47.186175 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 03:13:47.186175 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:13:47.186175 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:13:47.186175 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Oct 19 03:13:47.186175 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Oct 19 03:13:47.186175 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 19 03:13:47.186175 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:13:47.187428 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 19 03:13:47.187428 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:13:47.187428 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:13:47.187428 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:13:47.187428 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:47.187428 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:13:47.187428 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:13:47.187428 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:13:47.187428 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:13:47.187428 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 19 03:13:47.187428 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:13:47.187428 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2c8f66df-1295-4b5d-bef9-60b325f4e552 tempest-HostsAdminNegativeTestJSON-352891975 tempest-HostsAdminNegativeTestJSON-352891975-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:13:47.189121 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2c8f66df-1295-4b5d-bef9-60b325f4e552 tempest-HostsAdminNegativeTestJSON-352891975 tempest-HostsAdminNegativeTestJSON-352891975-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.038158 Oct 19 03:13:47.189878 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 212/434] 10.222.0.52 () {58 vars in 1218 bytes} [Wed Oct 19 03:13:47 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 03:13:47.200463 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-472bcd11-fd35-468c-8165-4c756e430501 tempest-HostsAdminNegativeTestJSON-943388537 tempest-HostsAdminNegativeTestJSON-943388537-project] Calling method '.version_select at 0x7fc131a6dee0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:47.205733 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-472bcd11-fd35-468c-8165-4c756e430501 tempest-HostsAdminNegativeTestJSON-943388537 tempest-HostsAdminNegativeTestJSON-943388537-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '0b48c6d5906945f8b8015fd430816e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d934cbff5154ebf86e8c62b8a7482ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:47.205733 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-472bcd11-fd35-468c-8165-4c756e430501 tempest-HostsAdminNegativeTestJSON-943388537 tempest-HostsAdminNegativeTestJSON-943388537-project] Request method failure captured: Oct 19 03:13:47.205733 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/os-hosts/n-d-861333-8/startup HTTP/1.1 Oct 19 03:13:47.205733 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:13:47.205733 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:13:47.205733 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:13:47.205733 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:13:47.205733 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:13:47.205733 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:13:47.205733 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:13:47.205733 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:13:47.205733 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT2tmsHys0FrzvJpyLEFWir0DWoQylgDrEe3RCPjntJDARkj8XgtVNUPN6csoChL6v8v7jyab075vto0R9wkmp2AU5iFhohZGVXYA0HmiKeQBAtMtjpcZz4oBx8DJvS2wkwMDpftJDlLqViVHUoJ5BFehgtVhhPXclayv2jNqv1DGHcU Oct 19 03:13:47.205733 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:13:47.205733 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:13:47.205733 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:13:47.205733 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:13:47.205733 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:13:47.205733 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:13:47.205733 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 9d934cbff5154ebf86e8c62b8a7482ac Oct 19 03:13:47.205733 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-943388537 Oct 19 03:13:47.205733 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:13:47.205733 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:13:47.207026 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9d934cbff5154ebf86e8c62b8a7482ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9d934cbff5154ebf86e8c62b8a7482ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9d934cbff5154ebf86e8c62b8a7482ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9d934cbff5154ebf86e8c62b8a7482ac", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:13:47.207026 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-HostsAdminNegativeTestJSON-943388537 Oct 19 03:13:47.207026 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 9d934cbff5154ebf86e8c62b8a7482ac Oct 19 03:13:47.207026 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-943388537 Oct 19 03:13:47.207026 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-HostsAdminNegativeTestJSON-943388537-project Oct 19 03:13:47.207026 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:13:47.207026 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:13:47.207026 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 0b48c6d5906945f8b8015fd430816e0d Oct 19 03:13:47.207026 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-HostsAdminNegativeTestJSON-943388537-project Oct 19 03:13:47.207026 n-d-861333-8 devstack@n-api.service[121134]: method: Oct 19 03:13:47.207026 n-d-861333-8 devstack@n-api.service[121134]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 19 03:13:47.207026 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': 'n-d-861333-8'} Oct 19 03:13:47.207026 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:13:47.207813 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:47.207813 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:13:47.207813 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:13:47.207813 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:13:47.207813 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:13:47.207813 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 03:13:47.207813 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 03:13:47.207813 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:13:47.207813 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:13:47.207813 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Oct 19 03:13:47.207813 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Oct 19 03:13:47.207813 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 19 03:13:47.207813 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 19 03:13:47.207813 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 19 03:13:47.207813 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 19 03:13:47.207813 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 03:13:47.207813 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 03:13:47.207813 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 03:13:47.207813 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 03:13:47.208854 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 19 03:13:47.208854 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 19 03:13:47.208854 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 19 03:13:47.208854 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 19 03:13:47.208854 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 19 03:13:47.208854 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 19 03:13:47.208854 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 19 03:13:47.208854 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:13:47.208854 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:13:47.208854 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:13:47.208854 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:47.208854 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:13:47.208854 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:13:47.208854 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 19 03:13:47.208854 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 19 03:13:47.208854 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 19 03:13:47.208854 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:13:47.209783 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-472bcd11-fd35-468c-8165-4c756e430501 tempest-HostsAdminNegativeTestJSON-943388537 tempest-HostsAdminNegativeTestJSON-943388537-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:13:47.210626 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-472bcd11-fd35-468c-8165-4c756e430501 tempest-HostsAdminNegativeTestJSON-943388537 tempest-HostsAdminNegativeTestJSON-943388537-project] 10.222.0.52 "GET /compute/v2.1/os-hosts/n-d-861333-8/startup" status: 403 len: 110 microversion: 2.1 time: 0.010306 Oct 19 03:13:47.211553 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 213/435] 10.222.0.52 () {58 vars in 1191 bytes} [Wed Oct 19 03:13:47 2022] GET /compute/v2.1/os-hosts/n-d-861333-8/startup => generated 110 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 19 03:13:47.224229 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8d1e9dae-34a1-4799-9fe5-18d75e2f932d tempest-HostsAdminNegativeTestJSON-352891975 tempest-HostsAdminNegativeTestJSON-352891975-project-admin] Calling method '.version_select at 0x7fc1314a4ee0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:47.239164 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-8d1e9dae-34a1-4799-9fe5-18d75e2f932d tempest-HostsAdminNegativeTestJSON-352891975 tempest-HostsAdminNegativeTestJSON-352891975-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 19 03:13:47.241059 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8d1e9dae-34a1-4799-9fe5-18d75e2f932d tempest-HostsAdminNegativeTestJSON-352891975 tempest-HostsAdminNegativeTestJSON-352891975-project-admin] Request method failure captured: Oct 19 03:13:47.241059 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Oct 19 03:13:47.241059 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:13:47.241059 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:13:47.241059 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:13:47.241059 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:13:47.241059 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:13:47.241059 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:13:47.241059 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:13:47.241059 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:13:47.241059 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT2toWFB9oXmQeKnsVO2oeSaxK0uc_F8r5YnVCjhlBUcXj7fwhehshjeXhexejHz2F6pbO-19ZhdBr92yM02TNqv20lSX0Ng2ZUd1Sx-xb_D_GMHwaYdrZD9cL81ylxGu04ekuG3feItqAKs9oGz8TlU6LOGNeWMRPcKuFd00UQ-efDQ Oct 19 03:13:47.241059 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:13:47.241059 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:13:47.241059 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:13:47.241059 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:13:47.241059 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:13:47.241059 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:13:47.241059 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 5684099113314fa9a67fbf75e3cd3910 Oct 19 03:13:47.241059 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-352891975 Oct 19 03:13:47.241059 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member,admin Oct 19 03:13:47.241059 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member,admin Oct 19 03:13:47.242512 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5684099113314fa9a67fbf75e3cd3910"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5684099113314fa9a67fbf75e3cd3910"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5684099113314fa9a67fbf75e3cd3910"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5684099113314fa9a67fbf75e3cd3910", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:13:47.242512 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-HostsAdminNegativeTestJSON-352891975 Oct 19 03:13:47.242512 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 5684099113314fa9a67fbf75e3cd3910 Oct 19 03:13:47.242512 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-352891975 Oct 19 03:13:47.242512 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-HostsAdminNegativeTestJSON-352891975-project-admin Oct 19 03:13:47.242512 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:13:47.242512 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:13:47.242512 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: a6a491f8a3ef45c381303ebcc4cc9d07 Oct 19 03:13:47.242512 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-HostsAdminNegativeTestJSON-352891975-project-admin Oct 19 03:13:47.242512 n-d-861333-8 devstack@n-api.service[121134]: method: Oct 19 03:13:47.242512 n-d-861333-8 devstack@n-api.service[121134]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 19 03:13:47.242512 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': 'nonexistent_hostname'} Oct 19 03:13:47.242512 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:13:47.243227 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:47.243227 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 19 03:13:47.243227 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 19 03:13:47.243227 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 19 03:13:47.243227 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 19 03:13:47.243227 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 03:13:47.243227 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 03:13:47.243227 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 03:13:47.243227 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 03:13:47.243227 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 19 03:13:47.243227 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 19 03:13:47.243227 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 19 03:13:47.243227 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 19 03:13:47.243227 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 03:13:47.243227 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 03:13:47.243227 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 19 03:13:47.243227 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 19 03:13:47.243227 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 19 03:13:47.243227 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 19 03:13:47.244241 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 19 03:13:47.244241 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 19 03:13:47.244241 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 19 03:13:47.244241 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:13:47.244241 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:13:47.244241 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:13:47.244241 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:47.244241 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:13:47.244241 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:13:47.244241 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:13:47.244241 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:13:47.244241 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 03:13:47.244241 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 03:13:47.244241 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:13:47.244241 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:13:47.244241 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Oct 19 03:13:47.244241 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Oct 19 03:13:47.244241 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 19 03:13:47.244241 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:13:47.245234 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 19 03:13:47.245234 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:13:47.245234 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:13:47.245234 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:13:47.245234 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:47.245234 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:13:47.245234 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:13:47.245234 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:13:47.245234 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:13:47.245234 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 19 03:13:47.245234 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:13:47.247533 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8d1e9dae-34a1-4799-9fe5-18d75e2f932d tempest-HostsAdminNegativeTestJSON-352891975 tempest-HostsAdminNegativeTestJSON-352891975-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:13:47.248420 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8d1e9dae-34a1-4799-9fe5-18d75e2f932d tempest-HostsAdminNegativeTestJSON-352891975 tempest-HostsAdminNegativeTestJSON-352891975-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.029185 Oct 19 03:13:47.248959 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 214/436] 10.222.0.52 () {58 vars in 1215 bytes} [Wed Oct 19 03:13:47 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 03:13:47.259791 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0b9c908c-36cd-4345-93c6-68cb2ee65644 tempest-HostsAdminNegativeTestJSON-352891975 tempest-HostsAdminNegativeTestJSON-352891975-project-admin] Action: 'update', calling method: .version_select at 0x7fc1314a6b80>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:13:47.271264 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0b9c908c-36cd-4345-93c6-68cb2ee65644 tempest-HostsAdminNegativeTestJSON-352891975 tempest-HostsAdminNegativeTestJSON-352891975-project-admin] Request method failure captured: Oct 19 03:13:47.271264 n-d-861333-8 devstack@n-api.service[121134]: request: PUT /compute/v2.1/os-hosts/n-d-861333-8 HTTP/1.1 Oct 19 03:13:47.271264 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:13:47.271264 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:13:47.271264 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:13:47.271264 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 51 Oct 19 03:13:47.271264 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:13:47.271264 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:13:47.271264 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:13:47.271264 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:13:47.271264 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT2toWFB9oXmQeKnsVO2oeSaxK0uc_F8r5YnVCjhlBUcXj7fwhehshjeXhexejHz2F6pbO-19ZhdBr92yM02TNqv20lSX0Ng2ZUd1Sx-xb_D_GMHwaYdrZD9cL81ylxGu04ekuG3feItqAKs9oGz8TlU6LOGNeWMRPcKuFd00UQ-efDQ Oct 19 03:13:47.271264 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:13:47.271264 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:13:47.271264 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:13:47.271264 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:13:47.271264 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:13:47.271264 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:13:47.271264 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 5684099113314fa9a67fbf75e3cd3910 Oct 19 03:13:47.271264 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-352891975 Oct 19 03:13:47.271264 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member,admin Oct 19 03:13:47.271264 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member,admin Oct 19 03:13:47.272585 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5684099113314fa9a67fbf75e3cd3910"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5684099113314fa9a67fbf75e3cd3910"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5684099113314fa9a67fbf75e3cd3910"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5684099113314fa9a67fbf75e3cd3910", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:13:47.272585 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-HostsAdminNegativeTestJSON-352891975 Oct 19 03:13:47.272585 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 5684099113314fa9a67fbf75e3cd3910 Oct 19 03:13:47.272585 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-352891975 Oct 19 03:13:47.272585 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-HostsAdminNegativeTestJSON-352891975-project-admin Oct 19 03:13:47.272585 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:13:47.272585 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:13:47.272585 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: a6a491f8a3ef45c381303ebcc4cc9d07 Oct 19 03:13:47.272585 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-HostsAdminNegativeTestJSON-352891975-project-admin Oct 19 03:13:47.272585 n-d-861333-8 devstack@n-api.service[121134]: Oct 19 03:13:47.272585 n-d-861333-8 devstack@n-api.service[121134]: {"status": "enable", "maintenance_mode": "invalid"} Oct 19 03:13:47.272585 n-d-861333-8 devstack@n-api.service[121134]: method: Oct 19 03:13:47.272585 n-d-861333-8 devstack@n-api.service[121134]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 19 03:13:47.273302 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': 'n-d-861333-8', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Oct 19 03:13:47.273302 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:13:47.273302 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:47.273302 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 03:13:47.273302 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 03:13:47.273302 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 03:13:47.273302 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise error Oct 19 03:13:47.273302 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 19 03:13:47.273302 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:13:47.273302 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Oct 19 03:13:47.273302 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 19 03:13:47.273302 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi 'disable', Oct 19 03:13:47.273302 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi 'Enable', Oct 19 03:13:47.273302 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi 'Disable', Oct 19 03:13:47.273302 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 19 03:13:47.273302 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 19 03:13:47.273302 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 19 03:13:47.273302 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:13:47.273302 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi On instance: Oct 19 03:13:47.273302 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi 'invalid' Oct 19 03:13:47.273302 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:13:47.273302 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:13:47.273302 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:13:47.273302 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:47.273302 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:13:47.274710 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:13:47.274710 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:13:47.274710 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:13:47.274710 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 03:13:47.274710 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 03:13:47.274710 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:13:47.274710 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:13:47.274710 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 03:13:47.274710 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 03:13:47.274710 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 03:13:47.274710 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 03:13:47.274710 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 03:13:47.274710 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 03:13:47.274710 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 19 03:13:47.274710 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:13:47.274710 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:13:47.274710 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:13:47.274710 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:47.274710 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:13:47.275792 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:13:47.275792 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 03:13:47.275792 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 03:13:47.275792 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 19 03:13:47.275792 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:13:47.279264 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0b9c908c-36cd-4345-93c6-68cb2ee65644 tempest-HostsAdminNegativeTestJSON-352891975 tempest-HostsAdminNegativeTestJSON-352891975-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:13:47.280269 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0b9c908c-36cd-4345-93c6-68cb2ee65644 tempest-HostsAdminNegativeTestJSON-352891975 tempest-HostsAdminNegativeTestJSON-352891975-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-hosts/n-d-861333-8" status: 400 len: 199 microversion: 2.1 time: 0.024974 Oct 19 03:13:47.283664 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 215/437] 10.222.0.52 () {60 vars in 1187 bytes} [Wed Oct 19 03:13:47 2022] PUT /compute/v2.1/os-hosts/n-d-861333-8 => generated 199 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 03:13:47.286106 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-e772ae4c-28ea-4709-bb39-bb7e24d6d658 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:47.296862 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e772ae4c-28ea-4709-bb39-bb7e24d6d658 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a" status: 200 len: 1477 microversion: 2.1 time: 0.219365 Oct 19 03:13:47.297717 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2a2544b8-0e21-43f4-994f-a17e103d2e1e tempest-HostsAdminNegativeTestJSON-352891975 tempest-HostsAdminNegativeTestJSON-352891975-project-admin] Action: 'update', calling method: .version_select at 0x7fc13158fca0>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:13:47.298072 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 223/438] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:13:47 2022] GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a => generated 1477 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:13:47.306186 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2a2544b8-0e21-43f4-994f-a17e103d2e1e tempest-HostsAdminNegativeTestJSON-352891975 tempest-HostsAdminNegativeTestJSON-352891975-project-admin] Request method failure captured: Oct 19 03:13:47.306186 n-d-861333-8 devstack@n-api.service[121134]: request: PUT /compute/v2.1/os-hosts/n-d-861333-8 HTTP/1.1 Oct 19 03:13:47.306186 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:13:47.306186 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:13:47.306186 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:13:47.306186 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 51 Oct 19 03:13:47.306186 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:13:47.306186 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:13:47.306186 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:13:47.306186 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:13:47.306186 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT2toWFB9oXmQeKnsVO2oeSaxK0uc_F8r5YnVCjhlBUcXj7fwhehshjeXhexejHz2F6pbO-19ZhdBr92yM02TNqv20lSX0Ng2ZUd1Sx-xb_D_GMHwaYdrZD9cL81ylxGu04ekuG3feItqAKs9oGz8TlU6LOGNeWMRPcKuFd00UQ-efDQ Oct 19 03:13:47.306186 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:13:47.306186 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:13:47.306186 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:13:47.306186 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:13:47.306186 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:13:47.306186 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:13:47.306186 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 5684099113314fa9a67fbf75e3cd3910 Oct 19 03:13:47.306186 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-352891975 Oct 19 03:13:47.306186 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member,admin Oct 19 03:13:47.306186 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member,admin Oct 19 03:13:47.307643 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5684099113314fa9a67fbf75e3cd3910"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5684099113314fa9a67fbf75e3cd3910"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5684099113314fa9a67fbf75e3cd3910"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5684099113314fa9a67fbf75e3cd3910", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:13:47.307643 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-HostsAdminNegativeTestJSON-352891975 Oct 19 03:13:47.307643 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 5684099113314fa9a67fbf75e3cd3910 Oct 19 03:13:47.307643 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-352891975 Oct 19 03:13:47.307643 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-HostsAdminNegativeTestJSON-352891975-project-admin Oct 19 03:13:47.307643 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:13:47.307643 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:13:47.307643 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: a6a491f8a3ef45c381303ebcc4cc9d07 Oct 19 03:13:47.307643 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-HostsAdminNegativeTestJSON-352891975-project-admin Oct 19 03:13:47.307643 n-d-861333-8 devstack@n-api.service[121134]: Oct 19 03:13:47.307643 n-d-861333-8 devstack@n-api.service[121134]: {"status": "invalid", "maintenance_mode": "enable"} Oct 19 03:13:47.307643 n-d-861333-8 devstack@n-api.service[121134]: method: Oct 19 03:13:47.307643 n-d-861333-8 devstack@n-api.service[121134]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 19 03:13:47.308595 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': 'n-d-861333-8', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Oct 19 03:13:47.308595 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:13:47.308595 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:47.308595 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 03:13:47.308595 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 03:13:47.308595 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 03:13:47.308595 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise error Oct 19 03:13:47.308595 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 19 03:13:47.308595 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:13:47.308595 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Oct 19 03:13:47.308595 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 19 03:13:47.308595 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi 'disable', Oct 19 03:13:47.308595 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi 'Enable', Oct 19 03:13:47.308595 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi 'Disable', Oct 19 03:13:47.308595 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 19 03:13:47.308595 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 19 03:13:47.308595 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 19 03:13:47.308595 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:13:47.308595 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi On instance: Oct 19 03:13:47.308595 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi 'invalid' Oct 19 03:13:47.308595 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:13:47.308595 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:13:47.308595 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:13:47.308595 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:47.308595 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:13:47.315995 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:13:47.315995 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:13:47.315995 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:13:47.315995 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 03:13:47.315995 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 03:13:47.315995 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:13:47.315995 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:13:47.315995 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 03:13:47.315995 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 03:13:47.315995 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 03:13:47.315995 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 03:13:47.315995 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 03:13:47.315995 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 03:13:47.315995 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 19 03:13:47.315995 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:13:47.315995 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:13:47.315995 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:13:47.315995 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:47.315995 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:13:47.317430 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:13:47.317430 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 03:13:47.317430 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 03:13:47.317430 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 19 03:13:47.317430 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:13:47.317430 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2a2544b8-0e21-43f4-994f-a17e103d2e1e tempest-HostsAdminNegativeTestJSON-352891975 tempest-HostsAdminNegativeTestJSON-352891975-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:13:47.317430 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2a2544b8-0e21-43f4-994f-a17e103d2e1e tempest-HostsAdminNegativeTestJSON-352891975 tempest-HostsAdminNegativeTestJSON-352891975-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-hosts/n-d-861333-8" status: 400 len: 189 microversion: 2.1 time: 0.023686 Oct 19 03:13:47.317430 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 216/439] 10.222.0.52 () {60 vars in 1187 bytes} [Wed Oct 19 03:13:47 2022] PUT /compute/v2.1/os-hosts/n-d-861333-8 => generated 189 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 19 03:13:47.327704 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f4a61c69-74a3-4173-b317-e2d5bd0300dc tempest-HostsAdminNegativeTestJSON-943388537 tempest-HostsAdminNegativeTestJSON-943388537-project] Action: 'update', calling method: .version_select at 0x7fc13158eaf0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:13:47.333756 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f4a61c69-74a3-4173-b317-e2d5bd0300dc tempest-HostsAdminNegativeTestJSON-943388537 tempest-HostsAdminNegativeTestJSON-943388537-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '0b48c6d5906945f8b8015fd430816e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d934cbff5154ebf86e8c62b8a7482ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:47.335407 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f4a61c69-74a3-4173-b317-e2d5bd0300dc tempest-HostsAdminNegativeTestJSON-943388537 tempest-HostsAdminNegativeTestJSON-943388537-project] Request method failure captured: Oct 19 03:13:47.335407 n-d-861333-8 devstack@n-api.service[121135]: request: PUT /compute/v2.1/os-hosts/n-d-861333-8 HTTP/1.1 Oct 19 03:13:47.335407 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:13:47.335407 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:13:47.335407 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:13:47.335407 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 50 Oct 19 03:13:47.335407 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:13:47.335407 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:13:47.335407 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:13:47.335407 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:13:47.335407 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2tmsHys0FrzvJpyLEFWir0DWoQylgDrEe3RCPjntJDARkj8XgtVNUPN6csoChL6v8v7jyab075vto0R9wkmp2AU5iFhohZGVXYA0HmiKeQBAtMtjpcZz4oBx8DJvS2wkwMDpftJDlLqViVHUoJ5BFehgtVhhPXclayv2jNqv1DGHcU Oct 19 03:13:47.335407 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:13:47.335407 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:13:47.335407 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:13:47.335407 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:13:47.335407 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:13:47.335407 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:13:47.335407 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 9d934cbff5154ebf86e8c62b8a7482ac Oct 19 03:13:47.335407 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-943388537 Oct 19 03:13:47.335407 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:13:47.335407 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:13:47.336771 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9d934cbff5154ebf86e8c62b8a7482ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9d934cbff5154ebf86e8c62b8a7482ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9d934cbff5154ebf86e8c62b8a7482ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9d934cbff5154ebf86e8c62b8a7482ac", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:13:47.336771 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-HostsAdminNegativeTestJSON-943388537 Oct 19 03:13:47.336771 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 9d934cbff5154ebf86e8c62b8a7482ac Oct 19 03:13:47.336771 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-943388537 Oct 19 03:13:47.336771 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-HostsAdminNegativeTestJSON-943388537-project Oct 19 03:13:47.336771 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:13:47.336771 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:13:47.336771 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 0b48c6d5906945f8b8015fd430816e0d Oct 19 03:13:47.336771 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-HostsAdminNegativeTestJSON-943388537-project Oct 19 03:13:47.336771 n-d-861333-8 devstack@n-api.service[121135]: Oct 19 03:13:47.336771 n-d-861333-8 devstack@n-api.service[121135]: {"status": "enable", "maintenance_mode": "enable"} Oct 19 03:13:47.336771 n-d-861333-8 devstack@n-api.service[121135]: method: Oct 19 03:13:47.336771 n-d-861333-8 devstack@n-api.service[121135]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 19 03:13:47.336771 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': 'n-d-861333-8', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 19 03:13:47.347841 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:13:47.347841 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:47.347841 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:13:47.347841 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:13:47.347841 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:13:47.347841 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:13:47.347841 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 03:13:47.347841 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 03:13:47.347841 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:13:47.347841 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:13:47.347841 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:13:47.347841 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:13:47.347841 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Oct 19 03:13:47.347841 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Oct 19 03:13:47.347841 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 19 03:13:47.347841 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 19 03:13:47.347841 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 19 03:13:47.347841 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 19 03:13:47.347841 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 03:13:47.347841 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 03:13:47.349438 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 03:13:47.349438 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 03:13:47.349438 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 19 03:13:47.349438 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 19 03:13:47.349438 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 19 03:13:47.349438 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 19 03:13:47.349438 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 19 03:13:47.349438 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 19 03:13:47.349438 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 19 03:13:47.349438 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:47.349438 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:13:47.349438 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:47.349438 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:47.349438 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:13:47.349438 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:13:47.349438 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 19 03:13:47.349438 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 19 03:13:47.349438 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 19 03:13:47.349438 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:47.350508 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f4a61c69-74a3-4173-b317-e2d5bd0300dc tempest-HostsAdminNegativeTestJSON-943388537 tempest-HostsAdminNegativeTestJSON-943388537-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:13:47.350508 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f4a61c69-74a3-4173-b317-e2d5bd0300dc tempest-HostsAdminNegativeTestJSON-943388537 tempest-HostsAdminNegativeTestJSON-943388537-project] 10.222.0.52 "PUT /compute/v2.1/os-hosts/n-d-861333-8" status: 403 len: 111 microversion: 2.1 time: 0.016088 Oct 19 03:13:47.350508 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 224/440] 10.222.0.52 () {60 vars in 1187 bytes} [Wed Oct 19 03:13:47 2022] PUT /compute/v2.1/os-hosts/n-d-861333-8 => generated 111 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:13:47.356813 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-92bc1203-0d54-44ff-b1ba-ad1eaaefc05d tempest-HostsAdminNegativeTestJSON-352891975 tempest-HostsAdminNegativeTestJSON-352891975-project-admin] Action: 'update', calling method: .version_select at 0x7fc1314ba550>, body: {"status": null, "maintenance_mode": null} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:13:47.361626 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-92bc1203-0d54-44ff-b1ba-ad1eaaefc05d tempest-HostsAdminNegativeTestJSON-352891975 tempest-HostsAdminNegativeTestJSON-352891975-project-admin] Request method failure captured: Oct 19 03:13:47.361626 n-d-861333-8 devstack@n-api.service[121134]: request: PUT /compute/v2.1/os-hosts/n-d-861333-8 HTTP/1.1 Oct 19 03:13:47.361626 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:13:47.361626 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:13:47.361626 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:13:47.361626 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 42 Oct 19 03:13:47.361626 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:13:47.361626 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:13:47.361626 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:13:47.361626 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:13:47.361626 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT2toWFB9oXmQeKnsVO2oeSaxK0uc_F8r5YnVCjhlBUcXj7fwhehshjeXhexejHz2F6pbO-19ZhdBr92yM02TNqv20lSX0Ng2ZUd1Sx-xb_D_GMHwaYdrZD9cL81ylxGu04ekuG3feItqAKs9oGz8TlU6LOGNeWMRPcKuFd00UQ-efDQ Oct 19 03:13:47.361626 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:13:47.361626 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:13:47.361626 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:13:47.361626 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:13:47.361626 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:13:47.361626 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:13:47.361626 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 5684099113314fa9a67fbf75e3cd3910 Oct 19 03:13:47.361626 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-352891975 Oct 19 03:13:47.361626 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member,admin Oct 19 03:13:47.361626 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member,admin Oct 19 03:13:47.363197 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5684099113314fa9a67fbf75e3cd3910"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5684099113314fa9a67fbf75e3cd3910"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5684099113314fa9a67fbf75e3cd3910"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5684099113314fa9a67fbf75e3cd3910", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:13:47.363197 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-HostsAdminNegativeTestJSON-352891975 Oct 19 03:13:47.363197 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 5684099113314fa9a67fbf75e3cd3910 Oct 19 03:13:47.363197 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-352891975 Oct 19 03:13:47.363197 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-HostsAdminNegativeTestJSON-352891975-project-admin Oct 19 03:13:47.363197 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:13:47.363197 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:13:47.363197 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: a6a491f8a3ef45c381303ebcc4cc9d07 Oct 19 03:13:47.363197 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-HostsAdminNegativeTestJSON-352891975-project-admin Oct 19 03:13:47.363197 n-d-861333-8 devstack@n-api.service[121134]: Oct 19 03:13:47.363197 n-d-861333-8 devstack@n-api.service[121134]: {"status": null, "maintenance_mode": null} Oct 19 03:13:47.363197 n-d-861333-8 devstack@n-api.service[121134]: method: Oct 19 03:13:47.363197 n-d-861333-8 devstack@n-api.service[121134]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 19 03:13:47.363197 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': 'n-d-861333-8', 'body': {'status': None, 'maintenance_mode': None}} Oct 19 03:13:47.364102 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:13:47.364102 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:47.364102 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 03:13:47.364102 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 03:13:47.364102 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 03:13:47.364102 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise error Oct 19 03:13:47.364102 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Oct 19 03:13:47.364102 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:13:47.364102 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Oct 19 03:13:47.364102 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 19 03:13:47.364102 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi 'disable', Oct 19 03:13:47.364102 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi 'Enable', Oct 19 03:13:47.364102 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi 'Disable', Oct 19 03:13:47.364102 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 19 03:13:47.364102 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 19 03:13:47.364102 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 19 03:13:47.364102 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:13:47.364102 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi On instance: Oct 19 03:13:47.364102 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi None Oct 19 03:13:47.364102 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:13:47.364102 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:13:47.364102 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:13:47.364102 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:47.364102 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:13:47.364102 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:13:47.366660 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:13:47.366660 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:13:47.366660 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 03:13:47.366660 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 03:13:47.366660 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:13:47.366660 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:13:47.366660 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 03:13:47.366660 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 03:13:47.366660 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 03:13:47.366660 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 03:13:47.366660 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 03:13:47.366660 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 03:13:47.366660 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 19 03:13:47.366660 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:13:47.366660 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:13:47.366660 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:13:47.366660 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:47.366660 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:13:47.366660 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:13:47.369311 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 03:13:47.369311 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 03:13:47.369311 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 19 03:13:47.369311 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:13:47.369311 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-92bc1203-0d54-44ff-b1ba-ad1eaaefc05d tempest-HostsAdminNegativeTestJSON-352891975 tempest-HostsAdminNegativeTestJSON-352891975-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:13:47.369311 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-92bc1203-0d54-44ff-b1ba-ad1eaaefc05d tempest-HostsAdminNegativeTestJSON-352891975 tempest-HostsAdminNegativeTestJSON-352891975-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-hosts/n-d-861333-8" status: 400 len: 127 microversion: 2.1 time: 0.010918 Oct 19 03:13:47.369311 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 217/441] 10.222.0.52 () {60 vars in 1187 bytes} [Wed Oct 19 03:13:47 2022] PUT /compute/v2.1/os-hosts/n-d-861333-8 => generated 127 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 03:13:47.377151 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d5b124f4-ad05-468e-bcb3-d42a7e68c220 tempest-HostsAdminNegativeTestJSON-352891975 tempest-HostsAdminNegativeTestJSON-352891975-project-admin] Action: 'update', calling method: .version_select at 0x7fc1314d48b0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:13:47.381155 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.hosts [None req-d5b124f4-ad05-468e-bcb3-d42a7e68c220 tempest-HostsAdminNegativeTestJSON-352891975 tempest-HostsAdminNegativeTestJSON-352891975-project-admin] Enabling host nonexistent_hostname. Oct 19 03:13:47.392403 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-d5b124f4-ad05-468e-bcb3-d42a7e68c220 tempest-HostsAdminNegativeTestJSON-352891975 tempest-HostsAdminNegativeTestJSON-352891975-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 19 03:13:47.397801 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d5b124f4-ad05-468e-bcb3-d42a7e68c220 tempest-HostsAdminNegativeTestJSON-352891975 tempest-HostsAdminNegativeTestJSON-352891975-project-admin] Request method failure captured: Oct 19 03:13:47.397801 n-d-861333-8 devstack@n-api.service[121135]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 19 03:13:47.397801 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:13:47.397801 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:13:47.397801 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:13:47.397801 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 50 Oct 19 03:13:47.397801 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:13:47.397801 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:13:47.397801 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:13:47.397801 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:13:47.397801 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2toWFB9oXmQeKnsVO2oeSaxK0uc_F8r5YnVCjhlBUcXj7fwhehshjeXhexejHz2F6pbO-19ZhdBr92yM02TNqv20lSX0Ng2ZUd1Sx-xb_D_GMHwaYdrZD9cL81ylxGu04ekuG3feItqAKs9oGz8TlU6LOGNeWMRPcKuFd00UQ-efDQ Oct 19 03:13:47.397801 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:13:47.397801 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:13:47.397801 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:13:47.397801 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:13:47.397801 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:13:47.397801 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:13:47.397801 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 5684099113314fa9a67fbf75e3cd3910 Oct 19 03:13:47.397801 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-352891975 Oct 19 03:13:47.397801 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member,admin Oct 19 03:13:47.397801 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member,admin Oct 19 03:13:47.399125 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5684099113314fa9a67fbf75e3cd3910"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5684099113314fa9a67fbf75e3cd3910"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5684099113314fa9a67fbf75e3cd3910"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5684099113314fa9a67fbf75e3cd3910", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:13:47.399125 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-HostsAdminNegativeTestJSON-352891975 Oct 19 03:13:47.399125 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 5684099113314fa9a67fbf75e3cd3910 Oct 19 03:13:47.399125 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-352891975 Oct 19 03:13:47.399125 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-HostsAdminNegativeTestJSON-352891975-project-admin Oct 19 03:13:47.399125 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:13:47.399125 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:13:47.399125 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: a6a491f8a3ef45c381303ebcc4cc9d07 Oct 19 03:13:47.399125 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-HostsAdminNegativeTestJSON-352891975-project-admin Oct 19 03:13:47.399125 n-d-861333-8 devstack@n-api.service[121135]: Oct 19 03:13:47.399125 n-d-861333-8 devstack@n-api.service[121135]: {"status": "enable", "maintenance_mode": "enable"} Oct 19 03:13:47.399125 n-d-861333-8 devstack@n-api.service[121135]: method: Oct 19 03:13:47.399125 n-d-861333-8 devstack@n-api.service[121135]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 19 03:13:47.399125 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 19 03:13:47.399866 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:13:47.399866 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:47.399866 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Oct 19 03:13:47.399866 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Oct 19 03:13:47.399866 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 19 03:13:47.399866 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 19 03:13:47.399866 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 03:13:47.399866 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 03:13:47.399866 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 03:13:47.399866 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 03:13:47.399866 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 19 03:13:47.399866 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 19 03:13:47.399866 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 19 03:13:47.399866 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 19 03:13:47.399866 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 03:13:47.399866 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 03:13:47.399866 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 19 03:13:47.399866 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 19 03:13:47.400983 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 19 03:13:47.400983 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 19 03:13:47.400983 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 19 03:13:47.400983 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 19 03:13:47.400983 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 19 03:13:47.400983 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:47.400983 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:13:47.400983 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:47.400983 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:47.400983 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:13:47.400983 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:13:47.400983 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:13:47.400983 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:13:47.400983 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 03:13:47.400983 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 03:13:47.400983 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:13:47.400983 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:13:47.400983 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:13:47.400983 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:13:47.400983 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Oct 19 03:13:47.402398 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Oct 19 03:13:47.402398 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Oct 19 03:13:47.402398 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:13:47.402398 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 19 03:13:47.402398 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:47.402398 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:13:47.402398 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:47.402398 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:47.402398 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:13:47.402398 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:13:47.402398 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:13:47.402398 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:13:47.402398 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 19 03:13:47.402398 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:47.402398 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d5b124f4-ad05-468e-bcb3-d42a7e68c220 tempest-HostsAdminNegativeTestJSON-352891975 tempest-HostsAdminNegativeTestJSON-352891975-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:13:47.404064 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d5b124f4-ad05-468e-bcb3-d42a7e68c220 tempest-HostsAdminNegativeTestJSON-352891975 tempest-HostsAdminNegativeTestJSON-352891975-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.022467 Oct 19 03:13:47.404064 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 225/442] 10.222.0.52 () {60 vars in 1211 bytes} [Wed Oct 19 03:13:47 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 03:13:47.545792 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ef7be561-a84f-4c74-9f1e-b340d50f843d tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:47.546416 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ef7be561-a84f-4c74-9f1e-b340d50f843d tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] [instance: f538531d-7829-4f19-bf50-8eea58368871] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:47.552828 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ef7be561-a84f-4c74-9f1e-b340d50f843d tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:47.553465 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ef7be561-a84f-4c74-9f1e-b340d50f843d tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:47.554072 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ef7be561-a84f-4c74-9f1e-b340d50f843d tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:47.554785 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ef7be561-a84f-4c74-9f1e-b340d50f843d tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:47.555251 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ef7be561-a84f-4c74-9f1e-b340d50f843d tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:47.555681 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ef7be561-a84f-4c74-9f1e-b340d50f843d tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:47.713887 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ef7be561-a84f-4c74-9f1e-b340d50f843d tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ff6534c5e74a2eb179044ef833f0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e88bbb75184a59b88e533a49d63cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:47.732215 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ef7be561-a84f-4c74-9f1e-b340d50f843d tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] 10.222.0.52 "GET /compute/v2.1/servers/f538531d-7829-4f19-bf50-8eea58368871" status: 200 len: 1318 microversion: 2.1 time: 0.190241 Oct 19 03:13:47.745905 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 218/443] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:13:47 2022] GET /compute/v2.1/servers/f538531d-7829-4f19-bf50-8eea58368871 => generated 1318 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:13:47.746073 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0be6d9ca-7713-4ec6-a3a9-1ea59c7f3c17 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:47.746073 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0be6d9ca-7713-4ec6-a3a9-1ea59c7f3c17 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 82f8d22c-99ee-4c2b-8a36-5299c187ace7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:47.804885 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-0be6d9ca-7713-4ec6-a3a9-1ea59c7f3c17 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:47.820080 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-0be6d9ca-7713-4ec6-a3a9-1ea59c7f3c17 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:47.821564 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-0be6d9ca-7713-4ec6-a3a9-1ea59c7f3c17 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:47.826062 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0be6d9ca-7713-4ec6-a3a9-1ea59c7f3c17 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/82f8d22c-99ee-4c2b-8a36-5299c187ace7" status: 200 len: 1262 microversion: 2.25 time: 0.087355 Oct 19 03:13:47.826062 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 226/444] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:13:47 2022] GET /compute/v2.1/servers/82f8d22c-99ee-4c2b-8a36-5299c187ace7 => generated 1262 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:13:48.327590 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-be70f60f-fbe6-4d2d-b5bf-935ae878a3fb tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:48.328127 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-be70f60f-fbe6-4d2d-b5bf-935ae878a3fb tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 7b4a8cd9-a238-4bff-a002-497dc807bf3a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:48.334777 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-be70f60f-fbe6-4d2d-b5bf-935ae878a3fb tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:48.335298 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-be70f60f-fbe6-4d2d-b5bf-935ae878a3fb tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:48.335819 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-be70f60f-fbe6-4d2d-b5bf-935ae878a3fb tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:48.336521 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-be70f60f-fbe6-4d2d-b5bf-935ae878a3fb tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:48.337090 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-be70f60f-fbe6-4d2d-b5bf-935ae878a3fb tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:48.337525 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-be70f60f-fbe6-4d2d-b5bf-935ae878a3fb tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:48.476579 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-be70f60f-fbe6-4d2d-b5bf-935ae878a3fb tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:48.485399 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-be70f60f-fbe6-4d2d-b5bf-935ae878a3fb tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a" status: 200 len: 1477 microversion: 2.1 time: 0.161647 Oct 19 03:13:48.487371 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 219/445] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:13:48 2022] GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a => generated 1477 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:13:48.761332 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-82d931d2-f542-4c6c-acbf-832c9b8aa613 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:48.762600 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-82d931d2-f542-4c6c-acbf-832c9b8aa613 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] [instance: f538531d-7829-4f19-bf50-8eea58368871] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:48.773994 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-82d931d2-f542-4c6c-acbf-832c9b8aa613 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:48.774632 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-82d931d2-f542-4c6c-acbf-832c9b8aa613 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:48.774959 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-82d931d2-f542-4c6c-acbf-832c9b8aa613 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:48.778801 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-82d931d2-f542-4c6c-acbf-832c9b8aa613 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:48.779831 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-82d931d2-f542-4c6c-acbf-832c9b8aa613 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:48.780479 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-82d931d2-f542-4c6c-acbf-832c9b8aa613 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:49.005698 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-82d931d2-f542-4c6c-acbf-832c9b8aa613 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ff6534c5e74a2eb179044ef833f0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e88bbb75184a59b88e533a49d63cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:49.016339 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-82d931d2-f542-4c6c-acbf-832c9b8aa613 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] 10.222.0.52 "GET /compute/v2.1/servers/f538531d-7829-4f19-bf50-8eea58368871" status: 200 len: 1318 microversion: 2.1 time: 0.260805 Oct 19 03:13:49.018774 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 220/446] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:13:48 2022] GET /compute/v2.1/servers/f538531d-7829-4f19-bf50-8eea58368871 => generated 1318 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:13:49.024950 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-fd05fa87-452c-4054-acb2-2536200c97cd tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:49.025690 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-fd05fa87-452c-4054-acb2-2536200c97cd tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 82f8d22c-99ee-4c2b-8a36-5299c187ace7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:49.033696 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fd05fa87-452c-4054-acb2-2536200c97cd tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:49.034495 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fd05fa87-452c-4054-acb2-2536200c97cd tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:49.035154 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fd05fa87-452c-4054-acb2-2536200c97cd tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:49.036098 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fd05fa87-452c-4054-acb2-2536200c97cd tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:49.036824 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fd05fa87-452c-4054-acb2-2536200c97cd tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:49.037620 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fd05fa87-452c-4054-acb2-2536200c97cd tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:49.093142 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0d5a4f52-8ace-4258-8c4b-fc3e696a1d14 tempest-QuotasAdminTestV236-136646909 tempest-QuotasAdminTestV236-136646909-project-admin] Action: 'update', calling method: .version_select at 0x7fc1315bc1f0>, body: {"quota_set": {"ram": "5120"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:13:49.129277 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-fd05fa87-452c-4054-acb2-2536200c97cd tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:49.150631 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-fd05fa87-452c-4054-acb2-2536200c97cd tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:49.154373 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-fd05fa87-452c-4054-acb2-2536200c97cd tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:49.180329 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-fd05fa87-452c-4054-acb2-2536200c97cd tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/82f8d22c-99ee-4c2b-8a36-5299c187ace7" status: 200 len: 1314 microversion: 2.25 time: 0.159564 Oct 19 03:13:49.180957 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 221/447] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:13:49 2022] GET /compute/v2.1/servers/82f8d22c-99ee-4c2b-8a36-5299c187ace7 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:13:49.185926 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0d5a4f52-8ace-4258-8c4b-fc3e696a1d14 tempest-QuotasAdminTestV236-136646909 tempest-QuotasAdminTestV236-136646909-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:49.187248 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0d5a4f52-8ace-4258-8c4b-fc3e696a1d14 tempest-QuotasAdminTestV236-136646909 tempest-QuotasAdminTestV236-136646909-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:49.187973 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0d5a4f52-8ace-4258-8c4b-fc3e696a1d14 tempest-QuotasAdminTestV236-136646909 tempest-QuotasAdminTestV236-136646909-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:49.189114 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0d5a4f52-8ace-4258-8c4b-fc3e696a1d14 tempest-QuotasAdminTestV236-136646909 tempest-QuotasAdminTestV236-136646909-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:49.189847 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0d5a4f52-8ace-4258-8c4b-fc3e696a1d14 tempest-QuotasAdminTestV236-136646909 tempest-QuotasAdminTestV236-136646909-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:49.190553 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0d5a4f52-8ace-4258-8c4b-fc3e696a1d14 tempest-QuotasAdminTestV236-136646909 tempest-QuotasAdminTestV236-136646909-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:49.302149 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0d5a4f52-8ace-4258-8c4b-fc3e696a1d14 tempest-QuotasAdminTestV236-136646909 tempest-QuotasAdminTestV236-136646909-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-quota-sets/0320c2f5e5694b71ae947eaaf5e79b35" status: 200 len: 240 microversion: 2.36 time: 0.579642 Oct 19 03:13:49.310438 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 227/448] 10.222.0.52 () {62 vars in 1303 bytes} [Wed Oct 19 03:13:48 2022] PUT /compute/v2.1/os-quota-sets/0320c2f5e5694b71ae947eaaf5e79b35 => generated 240 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 03:13:49.314831 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4f410595-056a-47af-a754-e8a366fb90e8 tempest-QuotasAdminTestV236-136646909 tempest-QuotasAdminTestV236-136646909-project-admin] Calling method '.version_select at 0x7fc13155aa60>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:49.509757 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9c428070-110c-4c4e-8583-e9acf4628d8d tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:49.512203 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9c428070-110c-4c4e-8583-e9acf4628d8d tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 7b4a8cd9-a238-4bff-a002-497dc807bf3a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:49.515981 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:13:49.520604 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9c428070-110c-4c4e-8583-e9acf4628d8d tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:49.521272 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9c428070-110c-4c4e-8583-e9acf4628d8d tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:49.522755 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9c428070-110c-4c4e-8583-e9acf4628d8d tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:49.523477 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9c428070-110c-4c4e-8583-e9acf4628d8d tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:49.523969 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9c428070-110c-4c4e-8583-e9acf4628d8d tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:49.524578 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9c428070-110c-4c4e-8583-e9acf4628d8d tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:49.757344 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-9c428070-110c-4c4e-8583-e9acf4628d8d tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:49.769626 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9c428070-110c-4c4e-8583-e9acf4628d8d tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a" status: 200 len: 1477 microversion: 2.1 time: 0.263091 Oct 19 03:13:49.772250 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 228/449] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:13:49 2022] GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a => generated 1477 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:13:49.919791 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4f410595-056a-47af-a754-e8a366fb90e8 tempest-QuotasAdminTestV236-136646909 tempest-QuotasAdminTestV236-136646909-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:49.921126 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4f410595-056a-47af-a754-e8a366fb90e8 tempest-QuotasAdminTestV236-136646909 tempest-QuotasAdminTestV236-136646909-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:49.922013 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4f410595-056a-47af-a754-e8a366fb90e8 tempest-QuotasAdminTestV236-136646909 tempest-QuotasAdminTestV236-136646909-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:49.923115 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4f410595-056a-47af-a754-e8a366fb90e8 tempest-QuotasAdminTestV236-136646909 tempest-QuotasAdminTestV236-136646909-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:49.923795 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4f410595-056a-47af-a754-e8a366fb90e8 tempest-QuotasAdminTestV236-136646909 tempest-QuotasAdminTestV236-136646909-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:49.924557 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4f410595-056a-47af-a754-e8a366fb90e8 tempest-QuotasAdminTestV236-136646909 tempest-QuotasAdminTestV236-136646909-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:49.974481 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4f410595-056a-47af-a754-e8a366fb90e8 tempest-QuotasAdminTestV236-136646909 tempest-QuotasAdminTestV236-136646909-project-admin] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/0320c2f5e5694b71ae947eaaf5e79b35/detail" status: 200 len: 672 microversion: 2.36 time: 0.663259 Oct 19 03:13:49.987745 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 222/450] 10.222.0.52 () {60 vars in 1304 bytes} [Wed Oct 19 03:13:49 2022] GET /compute/v2.1/os-quota-sets/0320c2f5e5694b71ae947eaaf5e79b35/detail => generated 672 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 03:13:50.042974 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3e655f1e-3477-4fae-b820-db50909d0e02 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:50.044212 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-3e655f1e-3477-4fae-b820-db50909d0e02 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] [instance: f538531d-7829-4f19-bf50-8eea58368871] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:50.054933 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3e655f1e-3477-4fae-b820-db50909d0e02 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:50.057561 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3e655f1e-3477-4fae-b820-db50909d0e02 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:50.058537 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3e655f1e-3477-4fae-b820-db50909d0e02 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:50.059993 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3e655f1e-3477-4fae-b820-db50909d0e02 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:50.061558 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3e655f1e-3477-4fae-b820-db50909d0e02 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:50.062354 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3e655f1e-3477-4fae-b820-db50909d0e02 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:50.206915 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6df46fd3-2f74-4f15-a9a3-d640a276c229 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:50.207978 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6df46fd3-2f74-4f15-a9a3-d640a276c229 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 82f8d22c-99ee-4c2b-8a36-5299c187ace7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:50.214795 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6df46fd3-2f74-4f15-a9a3-d640a276c229 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:50.216134 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6df46fd3-2f74-4f15-a9a3-d640a276c229 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:50.216816 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6df46fd3-2f74-4f15-a9a3-d640a276c229 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:50.217670 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6df46fd3-2f74-4f15-a9a3-d640a276c229 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:50.218201 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6df46fd3-2f74-4f15-a9a3-d640a276c229 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:50.218737 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6df46fd3-2f74-4f15-a9a3-d640a276c229 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:50.501284 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-6df46fd3-2f74-4f15-a9a3-d640a276c229 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:50.523401 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-6df46fd3-2f74-4f15-a9a3-d640a276c229 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:50.527004 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-6df46fd3-2f74-4f15-a9a3-d640a276c229 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:50.529749 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6df46fd3-2f74-4f15-a9a3-d640a276c229 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/82f8d22c-99ee-4c2b-8a36-5299c187ace7" status: 200 len: 1320 microversion: 2.25 time: 0.326596 Oct 19 03:13:50.530822 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 223/451] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:13:50 2022] GET /compute/v2.1/servers/82f8d22c-99ee-4c2b-8a36-5299c187ace7 => generated 1320 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:13:50.708190 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-3e655f1e-3477-4fae-b820-db50909d0e02 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ff6534c5e74a2eb179044ef833f0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e88bbb75184a59b88e533a49d63cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:50.716943 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-3e655f1e-3477-4fae-b820-db50909d0e02 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] 10.222.0.52 "GET /compute/v2.1/servers/f538531d-7829-4f19-bf50-8eea58368871" status: 200 len: 1318 microversion: 2.1 time: 0.679303 Oct 19 03:13:50.717627 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 229/452] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:13:50 2022] GET /compute/v2.1/servers/f538531d-7829-4f19-bf50-8eea58368871 => generated 1318 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:13:50.810030 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-701d56ac-e870-4613-bdc1-2b9f6d82bbd5 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:50.810643 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-701d56ac-e870-4613-bdc1-2b9f6d82bbd5 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 7b4a8cd9-a238-4bff-a002-497dc807bf3a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:50.821580 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-701d56ac-e870-4613-bdc1-2b9f6d82bbd5 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:50.823809 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-701d56ac-e870-4613-bdc1-2b9f6d82bbd5 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:50.825066 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-701d56ac-e870-4613-bdc1-2b9f6d82bbd5 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:50.826482 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-701d56ac-e870-4613-bdc1-2b9f6d82bbd5 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:50.827102 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-701d56ac-e870-4613-bdc1-2b9f6d82bbd5 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:50.827811 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-701d56ac-e870-4613-bdc1-2b9f6d82bbd5 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:50.925879 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-2a662abe-4414-4433-9fc0-4aae00d5e53d req-ec567ec3-d002-43ce-af77-7b7bdc04a193 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b4a8cd9-a238-4bff-a002-497dc807bf3a", "name": "network-vif-unplugged", "status": "completed", "tag": "f0926ecc-fbd5-457e-bf81-de5bfd5b6a96"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:13:50.937936 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-2a662abe-4414-4433-9fc0-4aae00d5e53d req-ec567ec3-d002-43ce-af77-7b7bdc04a193 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:50.938439 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-2a662abe-4414-4433-9fc0-4aae00d5e53d req-ec567ec3-d002-43ce-af77-7b7bdc04a193 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:50.939044 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-2a662abe-4414-4433-9fc0-4aae00d5e53d req-ec567ec3-d002-43ce-af77-7b7bdc04a193 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:50.957281 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-2a662abe-4414-4433-9fc0-4aae00d5e53d req-ec567ec3-d002-43ce-af77-7b7bdc04a193 service nova] Creating event network-vif-unplugged:f0926ecc-fbd5-457e-bf81-de5bfd5b6a96 for instance 7b4a8cd9-a238-4bff-a002-497dc807bf3a on n-h2-861333-8 Oct 19 03:13:50.972153 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [req-2a662abe-4414-4433-9fc0-4aae00d5e53d req-ec567ec3-d002-43ce-af77-7b7bdc04a193 service nova] Instance 7b4a8cd9-a238-4bff-a002-497dc807bf3a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-861333-8', 'n-h1-861333-8'} {{(pid=121135) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 03:13:50.985304 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-2a662abe-4414-4433-9fc0-4aae00d5e53d req-ec567ec3-d002-43ce-af77-7b7bdc04a193 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.063359 Oct 19 03:13:50.986304 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 230/453] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:13:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:13:51.070079 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-701d56ac-e870-4613-bdc1-2b9f6d82bbd5 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:51.081941 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-701d56ac-e870-4613-bdc1-2b9f6d82bbd5 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a" status: 200 len: 1476 microversion: 2.1 time: 0.286090 Oct 19 03:13:51.102424 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 224/454] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:13:50 2022] GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a => generated 1476 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:13:51.361055 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a984fae1-0a9c-4dac-b222-335456134155 tempest-QuotasAdminTestV236-136646909 tempest-QuotasAdminTestV236-136646909-project-admin] Action: 'update', calling method: .version_select at 0x7fc13158e8b0>, body: {"quota_set": {"ram": "2048"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:13:51.556791 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-da418c33-9f5c-48f5-80b9-a113ac741993 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:51.557420 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-da418c33-9f5c-48f5-80b9-a113ac741993 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 82f8d22c-99ee-4c2b-8a36-5299c187ace7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:51.567357 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-da418c33-9f5c-48f5-80b9-a113ac741993 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:51.568153 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-da418c33-9f5c-48f5-80b9-a113ac741993 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:51.569605 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-da418c33-9f5c-48f5-80b9-a113ac741993 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:51.574004 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-da418c33-9f5c-48f5-80b9-a113ac741993 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:51.576150 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-da418c33-9f5c-48f5-80b9-a113ac741993 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:51.576985 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-da418c33-9f5c-48f5-80b9-a113ac741993 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:51.790466 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-da418c33-9f5c-48f5-80b9-a113ac741993 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:51.816699 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-da418c33-9f5c-48f5-80b9-a113ac741993 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:51.840030 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-da418c33-9f5c-48f5-80b9-a113ac741993 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:51.858664 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-da418c33-9f5c-48f5-80b9-a113ac741993 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/82f8d22c-99ee-4c2b-8a36-5299c187ace7" status: 200 len: 1362 microversion: 2.25 time: 0.302620 Oct 19 03:13:51.864855 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a984fae1-0a9c-4dac-b222-335456134155 tempest-QuotasAdminTestV236-136646909 tempest-QuotasAdminTestV236-136646909-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:51.864855 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a984fae1-0a9c-4dac-b222-335456134155 tempest-QuotasAdminTestV236-136646909 tempest-QuotasAdminTestV236-136646909-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:51.874805 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a984fae1-0a9c-4dac-b222-335456134155 tempest-QuotasAdminTestV236-136646909 tempest-QuotasAdminTestV236-136646909-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:51.877586 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a984fae1-0a9c-4dac-b222-335456134155 tempest-QuotasAdminTestV236-136646909 tempest-QuotasAdminTestV236-136646909-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:51.878273 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a984fae1-0a9c-4dac-b222-335456134155 tempest-QuotasAdminTestV236-136646909 tempest-QuotasAdminTestV236-136646909-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:51.878994 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a984fae1-0a9c-4dac-b222-335456134155 tempest-QuotasAdminTestV236-136646909 tempest-QuotasAdminTestV236-136646909-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:51.882150 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 225/455] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:13:51 2022] GET /compute/v2.1/servers/82f8d22c-99ee-4c2b-8a36-5299c187ace7 => generated 1362 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:13:51.888035 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-86e8d474-3afb-4400-93bb-4bafcd2138de tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:51.888946 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-86e8d474-3afb-4400-93bb-4bafcd2138de tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] [instance: f538531d-7829-4f19-bf50-8eea58368871] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:51.897964 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-86e8d474-3afb-4400-93bb-4bafcd2138de tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:51.898856 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-86e8d474-3afb-4400-93bb-4bafcd2138de tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:51.899618 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-86e8d474-3afb-4400-93bb-4bafcd2138de tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:51.901223 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-86e8d474-3afb-4400-93bb-4bafcd2138de tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:51.905860 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-86e8d474-3afb-4400-93bb-4bafcd2138de tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:51.906319 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-86e8d474-3afb-4400-93bb-4bafcd2138de tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:51.952653 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a984fae1-0a9c-4dac-b222-335456134155 tempest-QuotasAdminTestV236-136646909 tempest-QuotasAdminTestV236-136646909-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:51.953138 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a984fae1-0a9c-4dac-b222-335456134155 tempest-QuotasAdminTestV236-136646909 tempest-QuotasAdminTestV236-136646909-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:51.953784 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a984fae1-0a9c-4dac-b222-335456134155 tempest-QuotasAdminTestV236-136646909 tempest-QuotasAdminTestV236-136646909-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:51.954865 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a984fae1-0a9c-4dac-b222-335456134155 tempest-QuotasAdminTestV236-136646909 tempest-QuotasAdminTestV236-136646909-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:51.955747 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a984fae1-0a9c-4dac-b222-335456134155 tempest-QuotasAdminTestV236-136646909 tempest-QuotasAdminTestV236-136646909-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:51.956325 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a984fae1-0a9c-4dac-b222-335456134155 tempest-QuotasAdminTestV236-136646909 tempest-QuotasAdminTestV236-136646909-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:52.080346 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a984fae1-0a9c-4dac-b222-335456134155 tempest-QuotasAdminTestV236-136646909 tempest-QuotasAdminTestV236-136646909-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-quota-sets/0320c2f5e5694b71ae947eaaf5e79b35?user_id=8583ef79a9724ede9351489aa07c6e5b" status: 200 len: 240 microversion: 2.36 time: 0.724112 Oct 19 03:13:52.087439 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 231/456] 10.222.0.52 () {62 vars in 1384 bytes} [Wed Oct 19 03:13:51 2022] PUT /compute/v2.1/os-quota-sets/0320c2f5e5694b71ae947eaaf5e79b35?user_id=8583ef79a9724ede9351489aa07c6e5b => generated 240 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 03:13:52.087439 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-b6caf8c5-1f6c-427a-8862-478aed737574 req-a333fd44-7cc7-493b-8c0b-8b8d2d4c6c5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f538531d-7829-4f19-bf50-8eea58368871", "name": "network-vif-plugged", "status": "completed", "tag": "bc401a65-cfe4-4aae-9ba9-460015bf4371"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:13:52.096240 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-b6caf8c5-1f6c-427a-8862-478aed737574 req-a333fd44-7cc7-493b-8c0b-8b8d2d4c6c5f service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:52.096718 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-b6caf8c5-1f6c-427a-8862-478aed737574 req-a333fd44-7cc7-493b-8c0b-8b8d2d4c6c5f service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:52.097335 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-b6caf8c5-1f6c-427a-8862-478aed737574 req-a333fd44-7cc7-493b-8c0b-8b8d2d4c6c5f service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:52.108890 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-b6caf8c5-1f6c-427a-8862-478aed737574 req-a333fd44-7cc7-493b-8c0b-8b8d2d4c6c5f service nova] Creating event network-vif-plugged:bc401a65-cfe4-4aae-9ba9-460015bf4371 for instance f538531d-7829-4f19-bf50-8eea58368871 on n-h2-861333-8 Oct 19 03:13:52.113995 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-b6caf8c5-1f6c-427a-8862-478aed737574 req-a333fd44-7cc7-493b-8c0b-8b8d2d4c6c5f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031621 Oct 19 03:13:52.114795 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 232/457] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:13:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:13:52.126424 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4fd93e30-8692-403d-a9ea-90cf3abd8e33 tempest-QuotasAdminTestV236-136646909 tempest-QuotasAdminTestV236-136646909-project-admin] Calling method '.version_select at 0x7fc13157dc10>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:52.245184 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-86e8d474-3afb-4400-93bb-4bafcd2138de tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ff6534c5e74a2eb179044ef833f0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e88bbb75184a59b88e533a49d63cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:52.270376 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-86e8d474-3afb-4400-93bb-4bafcd2138de tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] 10.222.0.52 "GET /compute/v2.1/servers/f538531d-7829-4f19-bf50-8eea58368871" status: 200 len: 1318 microversion: 2.1 time: 0.383312 Oct 19 03:13:52.270376 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 226/458] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:13:51 2022] GET /compute/v2.1/servers/f538531d-7829-4f19-bf50-8eea58368871 => generated 1318 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:13:52.287111 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c5a94fa8-a27b-4983-b441-63220d57b87e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:52.288045 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c5a94fa8-a27b-4983-b441-63220d57b87e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 7b4a8cd9-a238-4bff-a002-497dc807bf3a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:52.303668 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c5a94fa8-a27b-4983-b441-63220d57b87e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:52.303668 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c5a94fa8-a27b-4983-b441-63220d57b87e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:52.303668 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c5a94fa8-a27b-4983-b441-63220d57b87e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:52.303668 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c5a94fa8-a27b-4983-b441-63220d57b87e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:52.304306 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c5a94fa8-a27b-4983-b441-63220d57b87e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:52.304306 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c5a94fa8-a27b-4983-b441-63220d57b87e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:52.542149 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c5a94fa8-a27b-4983-b441-63220d57b87e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:52.547465 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4fd93e30-8692-403d-a9ea-90cf3abd8e33 tempest-QuotasAdminTestV236-136646909 tempest-QuotasAdminTestV236-136646909-project-admin] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/0320c2f5e5694b71ae947eaaf5e79b35?user_id=8583ef79a9724ede9351489aa07c6e5b" status: 200 len: 282 microversion: 2.36 time: 0.431627 Oct 19 03:13:52.548032 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 233/459] 10.222.0.52 () {60 vars in 1364 bytes} [Wed Oct 19 03:13:52 2022] GET /compute/v2.1/os-quota-sets/0320c2f5e5694b71ae947eaaf5e79b35?user_id=8583ef79a9724ede9351489aa07c6e5b => generated 282 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 03:13:52.575788 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c5a94fa8-a27b-4983-b441-63220d57b87e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a" status: 200 len: 1476 microversion: 2.1 time: 0.287343 Oct 19 03:13:52.575788 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 227/460] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:13:52 2022] GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a => generated 1476 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:13:52.893657 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-fd1c02e4-ff4b-42c1-94cd-d2bc69697ee2 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:52.893657 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-fd1c02e4-ff4b-42c1-94cd-d2bc69697ee2 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 82f8d22c-99ee-4c2b-8a36-5299c187ace7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:52.903430 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fd1c02e4-ff4b-42c1-94cd-d2bc69697ee2 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:52.904155 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fd1c02e4-ff4b-42c1-94cd-d2bc69697ee2 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:52.904761 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fd1c02e4-ff4b-42c1-94cd-d2bc69697ee2 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:52.905863 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fd1c02e4-ff4b-42c1-94cd-d2bc69697ee2 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:52.906474 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fd1c02e4-ff4b-42c1-94cd-d2bc69697ee2 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:52.907064 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fd1c02e4-ff4b-42c1-94cd-d2bc69697ee2 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:53.009221 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-477b8aee-bd53-4363-a552-2465a0f517f5 req-7cc8fb7c-2465-4612-b59c-07e2e02060d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b4a8cd9-a238-4bff-a002-497dc807bf3a", "tag": "f0926ecc-fbd5-457e-bf81-de5bfd5b6a96"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:13:53.031908 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-477b8aee-bd53-4363-a552-2465a0f517f5 req-7cc8fb7c-2465-4612-b59c-07e2e02060d5 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:53.031908 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-477b8aee-bd53-4363-a552-2465a0f517f5 req-7cc8fb7c-2465-4612-b59c-07e2e02060d5 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:53.031908 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-477b8aee-bd53-4363-a552-2465a0f517f5 req-7cc8fb7c-2465-4612-b59c-07e2e02060d5 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:53.046110 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-477b8aee-bd53-4363-a552-2465a0f517f5 req-7cc8fb7c-2465-4612-b59c-07e2e02060d5 service nova] Creating event network-changed:f0926ecc-fbd5-457e-bf81-de5bfd5b6a96 for instance 7b4a8cd9-a238-4bff-a002-497dc807bf3a on n-h2-861333-8 Oct 19 03:13:53.065446 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [req-477b8aee-bd53-4363-a552-2465a0f517f5 req-7cc8fb7c-2465-4612-b59c-07e2e02060d5 service nova] Instance 7b4a8cd9-a238-4bff-a002-497dc807bf3a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-861333-8', 'n-h1-861333-8'} {{(pid=121134) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 03:13:53.078496 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-477b8aee-bd53-4363-a552-2465a0f517f5 req-7cc8fb7c-2465-4612-b59c-07e2e02060d5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073004 Oct 19 03:13:53.079263 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 228/461] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:13:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:13:53.181571 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-fd1c02e4-ff4b-42c1-94cd-d2bc69697ee2 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:53.192243 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-fd1c02e4-ff4b-42c1-94cd-d2bc69697ee2 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:53.193707 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-fd1c02e4-ff4b-42c1-94cd-d2bc69697ee2 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:53.195366 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-fd1c02e4-ff4b-42c1-94cd-d2bc69697ee2 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/82f8d22c-99ee-4c2b-8a36-5299c187ace7" status: 200 len: 1362 microversion: 2.25 time: 0.310982 Oct 19 03:13:53.196631 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 234/462] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:13:52 2022] GET /compute/v2.1/servers/82f8d22c-99ee-4c2b-8a36-5299c187ace7 => generated 1362 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:13:53.292152 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7a5e1bec-6aee-408b-81e6-8bfb56d9fad2 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:53.293971 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7a5e1bec-6aee-408b-81e6-8bfb56d9fad2 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] [instance: f538531d-7829-4f19-bf50-8eea58368871] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:53.302103 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7a5e1bec-6aee-408b-81e6-8bfb56d9fad2 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:53.302852 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7a5e1bec-6aee-408b-81e6-8bfb56d9fad2 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:53.303606 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7a5e1bec-6aee-408b-81e6-8bfb56d9fad2 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:53.304509 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7a5e1bec-6aee-408b-81e6-8bfb56d9fad2 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:53.305207 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7a5e1bec-6aee-408b-81e6-8bfb56d9fad2 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:53.305884 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7a5e1bec-6aee-408b-81e6-8bfb56d9fad2 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:53.495958 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-7a5e1bec-6aee-408b-81e6-8bfb56d9fad2 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ff6534c5e74a2eb179044ef833f0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e88bbb75184a59b88e533a49d63cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:53.504726 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7a5e1bec-6aee-408b-81e6-8bfb56d9fad2 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] 10.222.0.52 "GET /compute/v2.1/servers/f538531d-7829-4f19-bf50-8eea58368871" status: 200 len: 1318 microversion: 2.1 time: 0.217175 Oct 19 03:13:53.505425 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 229/463] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:13:53 2022] GET /compute/v2.1/servers/f538531d-7829-4f19-bf50-8eea58368871 => generated 1318 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:13:53.612488 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6c36e219-637f-4c45-90b9-ae610861d5d6 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:53.613363 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6c36e219-637f-4c45-90b9-ae610861d5d6 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 7b4a8cd9-a238-4bff-a002-497dc807bf3a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:53.620216 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6c36e219-637f-4c45-90b9-ae610861d5d6 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:53.620885 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6c36e219-637f-4c45-90b9-ae610861d5d6 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:53.622152 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6c36e219-637f-4c45-90b9-ae610861d5d6 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:53.622996 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6c36e219-637f-4c45-90b9-ae610861d5d6 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:53.623641 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6c36e219-637f-4c45-90b9-ae610861d5d6 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:53.624209 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6c36e219-637f-4c45-90b9-ae610861d5d6 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:53.911382 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-6c36e219-637f-4c45-90b9-ae610861d5d6 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:53.920112 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6c36e219-637f-4c45-90b9-ae610861d5d6 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a" status: 200 len: 1476 microversion: 2.1 time: 0.314339 Oct 19 03:13:53.921405 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 235/464] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:13:53 2022] GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a => generated 1476 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:13:54.220667 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7250f634-147a-4edc-8c98-940636d9df5b tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:54.221277 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7250f634-147a-4edc-8c98-940636d9df5b tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 82f8d22c-99ee-4c2b-8a36-5299c187ace7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:54.227758 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7250f634-147a-4edc-8c98-940636d9df5b tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:54.228263 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7250f634-147a-4edc-8c98-940636d9df5b tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:54.228771 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7250f634-147a-4edc-8c98-940636d9df5b tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:54.229493 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7250f634-147a-4edc-8c98-940636d9df5b tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:54.230025 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7250f634-147a-4edc-8c98-940636d9df5b tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:54.230452 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7250f634-147a-4edc-8c98-940636d9df5b tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:54.369689 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-7250f634-147a-4edc-8c98-940636d9df5b tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:54.379672 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-7250f634-147a-4edc-8c98-940636d9df5b tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:54.381321 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-7250f634-147a-4edc-8c98-940636d9df5b tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:54.383066 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7250f634-147a-4edc-8c98-940636d9df5b tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/82f8d22c-99ee-4c2b-8a36-5299c187ace7" status: 200 len: 1362 microversion: 2.25 time: 0.166358 Oct 19 03:13:54.383941 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 230/465] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:13:54 2022] GET /compute/v2.1/servers/82f8d22c-99ee-4c2b-8a36-5299c187ace7 => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:13:54.529602 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3c7378ab-a3c0-43cf-a810-b1b3bbc67dcc tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:54.530334 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-3c7378ab-a3c0-43cf-a810-b1b3bbc67dcc tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] [instance: f538531d-7829-4f19-bf50-8eea58368871] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:54.536304 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3c7378ab-a3c0-43cf-a810-b1b3bbc67dcc tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:54.538107 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3c7378ab-a3c0-43cf-a810-b1b3bbc67dcc tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:54.538107 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3c7378ab-a3c0-43cf-a810-b1b3bbc67dcc tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:54.538291 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3c7378ab-a3c0-43cf-a810-b1b3bbc67dcc tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:54.538626 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3c7378ab-a3c0-43cf-a810-b1b3bbc67dcc tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:54.539016 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3c7378ab-a3c0-43cf-a810-b1b3bbc67dcc tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:54.675783 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-3c7378ab-a3c0-43cf-a810-b1b3bbc67dcc tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ff6534c5e74a2eb179044ef833f0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e88bbb75184a59b88e533a49d63cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:54.687548 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-3c7378ab-a3c0-43cf-a810-b1b3bbc67dcc tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] 10.222.0.52 "GET /compute/v2.1/servers/f538531d-7829-4f19-bf50-8eea58368871" status: 200 len: 1468 microversion: 2.1 time: 0.161093 Oct 19 03:13:54.698152 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 236/466] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:13:54 2022] GET /compute/v2.1/servers/f538531d-7829-4f19-bf50-8eea58368871 => generated 1468 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:13:54.943051 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d74b5edb-d7dc-4c25-a4cb-715b7b0cacf8 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:54.952651 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d74b5edb-d7dc-4c25-a4cb-715b7b0cacf8 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 7b4a8cd9-a238-4bff-a002-497dc807bf3a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:54.959225 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d74b5edb-d7dc-4c25-a4cb-715b7b0cacf8 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:54.961137 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d74b5edb-d7dc-4c25-a4cb-715b7b0cacf8 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:54.962624 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d74b5edb-d7dc-4c25-a4cb-715b7b0cacf8 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:54.966254 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d74b5edb-d7dc-4c25-a4cb-715b7b0cacf8 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:54.966770 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d74b5edb-d7dc-4c25-a4cb-715b7b0cacf8 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:54.967178 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d74b5edb-d7dc-4c25-a4cb-715b7b0cacf8 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:55.004381 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7df83c63-4938-4421-86dd-cb5aad8b256a tempest-LiveMigrationNegativeTest-1867892395 tempest-LiveMigrationNegativeTest-1867892395-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-1919608072", "block_migration": true, "disk_over_commit": false}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:13:55.007179 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7df83c63-4938-4421-86dd-cb5aad8b256a tempest-LiveMigrationNegativeTest-1867892395 tempest-LiveMigrationNegativeTest-1867892395-project-admin] [instance: f538531d-7829-4f19-bf50-8eea58368871] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:55.026578 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7df83c63-4938-4421-86dd-cb5aad8b256a tempest-LiveMigrationNegativeTest-1867892395 tempest-LiveMigrationNegativeTest-1867892395-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:55.026578 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7df83c63-4938-4421-86dd-cb5aad8b256a tempest-LiveMigrationNegativeTest-1867892395 tempest-LiveMigrationNegativeTest-1867892395-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:55.026578 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7df83c63-4938-4421-86dd-cb5aad8b256a tempest-LiveMigrationNegativeTest-1867892395 tempest-LiveMigrationNegativeTest-1867892395-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:55.026578 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7df83c63-4938-4421-86dd-cb5aad8b256a tempest-LiveMigrationNegativeTest-1867892395 tempest-LiveMigrationNegativeTest-1867892395-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:55.027035 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7df83c63-4938-4421-86dd-cb5aad8b256a tempest-LiveMigrationNegativeTest-1867892395 tempest-LiveMigrationNegativeTest-1867892395-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:55.027035 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7df83c63-4938-4421-86dd-cb5aad8b256a tempest-LiveMigrationNegativeTest-1867892395 tempest-LiveMigrationNegativeTest-1867892395-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:55.102988 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-7df83c63-4938-4421-86dd-cb5aad8b256a tempest-LiveMigrationNegativeTest-1867892395 tempest-LiveMigrationNegativeTest-1867892395-project-admin] Lazy-loading 'flavor' on Instance uuid f538531d-7829-4f19-bf50-8eea58368871 {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:13:55.154680 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7df83c63-4938-4421-86dd-cb5aad8b256a tempest-LiveMigrationNegativeTest-1867892395 tempest-LiveMigrationNegativeTest-1867892395-project-admin] [instance: f538531d-7829-4f19-bf50-8eea58368871] Going to try to live migrate instance to tempest-host-1919608072 {{(pid=121134) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 19 03:13:55.159518 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=100 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:13:55.163434 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-7df83c63-4938-4421-86dd-cb5aad8b256a tempest-LiveMigrationNegativeTest-1867892395 tempest-LiveMigrationNegativeTest-1867892395-project-admin] HTTP exception thrown: Compute host tempest-host-1919608072 could not be found. Oct 19 03:13:55.168841 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7df83c63-4938-4421-86dd-cb5aad8b256a tempest-LiveMigrationNegativeTest-1867892395 tempest-LiveMigrationNegativeTest-1867892395-project-admin] Request method failure captured: Oct 19 03:13:55.168841 n-d-861333-8 devstack@n-api.service[121134]: request: POST /compute/v2.1/servers/f538531d-7829-4f19-bf50-8eea58368871/action HTTP/1.1 Oct 19 03:13:55.168841 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:13:55.168841 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:13:55.168841 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:13:55.168841 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 107 Oct 19 03:13:55.168841 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:13:55.168841 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:13:55.168841 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:13:55.168841 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:13:55.168841 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT2tdFi_mTb3o_cBUl2vd67YQI43y3mK1M4qbYvdvuMaO2l3PwBQ7cC0w-scHzr63GSkZ0Bt8ZhMTja9j35ajvIjzvxTcF7oJ3vLReSMJvzw3mdYVTIH6N9jXxt1x0IPTXrUhkcutJ1te6qz-NfSOySPR-t_fRW2caPV6VlR5WyLf3TM Oct 19 03:13:55.168841 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:13:55.168841 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:13:55.168841 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:13:55.168841 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:13:55.168841 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:13:55.168841 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:13:55.168841 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 5c0d451cd3c14d79b9b846c5ae7ae0fe Oct 19 03:13:55.168841 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-LiveMigrationNegativeTest-1867892395 Oct 19 03:13:55.168841 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member,admin Oct 19 03:13:55.168841 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member,admin Oct 19 03:13:55.170340 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5c0d451cd3c14d79b9b846c5ae7ae0fe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5c0d451cd3c14d79b9b846c5ae7ae0fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5c0d451cd3c14d79b9b846c5ae7ae0fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5c0d451cd3c14d79b9b846c5ae7ae0fe", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:13:55.170340 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-LiveMigrationNegativeTest-1867892395 Oct 19 03:13:55.170340 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 5c0d451cd3c14d79b9b846c5ae7ae0fe Oct 19 03:13:55.170340 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1867892395 Oct 19 03:13:55.170340 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-LiveMigrationNegativeTest-1867892395-project-admin Oct 19 03:13:55.170340 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:13:55.170340 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:13:55.170340 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 3495d8cfbdf445fa80d7b5c872f8ffd5 Oct 19 03:13:55.170340 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-LiveMigrationNegativeTest-1867892395-project-admin Oct 19 03:13:55.170340 n-d-861333-8 devstack@n-api.service[121134]: Oct 19 03:13:55.170340 n-d-861333-8 devstack@n-api.service[121134]: {"os-migrateLive": {"host": "tempest-host-1919608072", "block_migration": true, "disk_over_commit": false}} Oct 19 03:13:55.170340 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:13:55.171157 n-d-861333-8 devstack@n-api.service[121134]: exception: Compute host tempest-host-1919608072 could not be found. Oct 19 03:13:55.171157 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': 'f538531d-7829-4f19-bf50-8eea58368871', 'body': {'os-migrateLive': {'host': 'tempest-host-1919608072', 'block_migration': True, 'disk_over_commit': False}}} Oct 19 03:13:55.171157 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:13:55.171157 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:55.171157 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 19 03:13:55.171157 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 19 03:13:55.171157 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 19 03:13:55.171157 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 19 03:13:55.171157 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 19 03:13:55.171157 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 19 03:13:55.171157 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 19 03:13:55.171157 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 19 03:13:55.171157 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 19 03:13:55.171157 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 19 03:13:55.171157 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 19 03:13:55.171157 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 19 03:13:55.171157 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 19 03:13:55.171157 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 19 03:13:55.171157 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 19 03:13:55.172424 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 19 03:13:55.172424 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 19 03:13:55.172424 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 19 03:13:55.172424 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5488, in live_migrate Oct 19 03:13:55.172424 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Oct 19 03:13:55.172424 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 03:13:55.172424 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 03:13:55.172424 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Oct 19 03:13:55.172424 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Oct 19 03:13:55.172424 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Oct 19 03:13:55.172424 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:13:55.172424 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Oct 19 03:13:55.172424 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Oct 19 03:13:55.172424 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Oct 19 03:13:55.172424 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Oct 19 03:13:55.172424 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Oct 19 03:13:55.172424 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Oct 19 03:13:55.172424 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-1919608072 could not be found. Oct 19 03:13:55.172424 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:13:55.173730 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:13:55.173730 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:13:55.173730 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:55.173730 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:13:55.173730 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:13:55.173730 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:13:55.173730 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:13:55.173730 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:13:55.173730 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:13:55.173730 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:13:55.173730 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:13:55.173730 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:13:55.173730 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:13:55.173730 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:13:55.173730 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:13:55.173730 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 19 03:13:55.173730 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Oct 19 03:13:55.173730 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 19 03:13:55.173730 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-1919608072 could not be found. Oct 19 03:13:55.173730 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:13:55.175178 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:13:55.175178 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:13:55.175178 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:55.175178 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:13:55.175178 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:13:55.175178 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:13:55.175178 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:13:55.175178 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-1919608072 could not be found. Oct 19 03:13:55.175178 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:13:55.177048 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7df83c63-4938-4421-86dd-cb5aad8b256a tempest-LiveMigrationNegativeTest-1867892395 tempest-LiveMigrationNegativeTest-1867892395-project-admin] Returning 400 to user: Compute host tempest-host-1919608072 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:13:55.178285 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7df83c63-4938-4421-86dd-cb5aad8b256a tempest-LiveMigrationNegativeTest-1867892395 tempest-LiveMigrationNegativeTest-1867892395-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/f538531d-7829-4f19-bf50-8eea58368871/action" status: 400 len: 100 microversion: 2.1 time: 0.472763 Oct 19 03:13:55.179033 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 231/467] 10.222.0.52 () {60 vars in 1279 bytes} [Wed Oct 19 03:13:54 2022] POST /compute/v2.1/servers/f538531d-7829-4f19-bf50-8eea58368871/action => generated 100 bytes in 474 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 03:13:55.188280 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c7548b4d-d1d3-42ae-aa00-35d68669d9ea tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:55.191432 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c7548b4d-d1d3-42ae-aa00-35d68669d9ea tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] [instance: f538531d-7829-4f19-bf50-8eea58368871] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:55.197079 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c7548b4d-d1d3-42ae-aa00-35d68669d9ea tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:55.197861 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c7548b4d-d1d3-42ae-aa00-35d68669d9ea tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:55.198487 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c7548b4d-d1d3-42ae-aa00-35d68669d9ea tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:55.199226 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c7548b4d-d1d3-42ae-aa00-35d68669d9ea tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:55.200312 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c7548b4d-d1d3-42ae-aa00-35d68669d9ea tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:55.200756 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c7548b4d-d1d3-42ae-aa00-35d68669d9ea tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:55.574981 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d74b5edb-d7dc-4c25-a4cb-715b7b0cacf8 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:55.587412 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d74b5edb-d7dc-4c25-a4cb-715b7b0cacf8 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a" status: 200 len: 1474 microversion: 2.1 time: 0.647190 Oct 19 03:13:55.587412 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 237/468] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:13:54 2022] GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a => generated 1474 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:13:55.607483 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-9127dc99-180f-461e-b6fb-46a3b761f981 req-ed56f095-d7fe-41bc-a652-f30181a8c513 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82f8d22c-99ee-4c2b-8a36-5299c187ace7", "tag": "dfc9deee-726a-4739-85f8-2d1374704cd1"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:13:55.623821 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-9127dc99-180f-461e-b6fb-46a3b761f981 req-ed56f095-d7fe-41bc-a652-f30181a8c513 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:55.624306 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-9127dc99-180f-461e-b6fb-46a3b761f981 req-ed56f095-d7fe-41bc-a652-f30181a8c513 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:55.627294 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-9127dc99-180f-461e-b6fb-46a3b761f981 req-ed56f095-d7fe-41bc-a652-f30181a8c513 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:55.640721 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-9127dc99-180f-461e-b6fb-46a3b761f981 req-ed56f095-d7fe-41bc-a652-f30181a8c513 service nova] Creating event network-changed:dfc9deee-726a-4739-85f8-2d1374704cd1 for instance 82f8d22c-99ee-4c2b-8a36-5299c187ace7 on n-h2-861333-8 Oct 19 03:13:55.647574 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-9127dc99-180f-461e-b6fb-46a3b761f981 req-ed56f095-d7fe-41bc-a652-f30181a8c513 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058960 Oct 19 03:13:55.649015 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 238/469] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:13:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:13:55.656382 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d29e292a-c98e-4cd7-bd8a-d348790d80b7 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:55.657638 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d29e292a-c98e-4cd7-bd8a-d348790d80b7 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 82f8d22c-99ee-4c2b-8a36-5299c187ace7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:55.663976 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d29e292a-c98e-4cd7-bd8a-d348790d80b7 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:55.664864 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d29e292a-c98e-4cd7-bd8a-d348790d80b7 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:55.665491 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d29e292a-c98e-4cd7-bd8a-d348790d80b7 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:55.667186 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d29e292a-c98e-4cd7-bd8a-d348790d80b7 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:55.667807 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d29e292a-c98e-4cd7-bd8a-d348790d80b7 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:55.669184 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d29e292a-c98e-4cd7-bd8a-d348790d80b7 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:55.758799 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c7548b4d-d1d3-42ae-aa00-35d68669d9ea tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ff6534c5e74a2eb179044ef833f0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e88bbb75184a59b88e533a49d63cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:55.768944 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c7548b4d-d1d3-42ae-aa00-35d68669d9ea tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] 10.222.0.52 "GET /compute/v2.1/servers/f538531d-7829-4f19-bf50-8eea58368871" status: 200 len: 1468 microversion: 2.1 time: 0.585228 Oct 19 03:13:55.771424 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 232/470] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:13:55 2022] GET /compute/v2.1/servers/f538531d-7829-4f19-bf50-8eea58368871 => generated 1468 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:13:55.944379 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d29e292a-c98e-4cd7-bd8a-d348790d80b7 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:55.954308 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d29e292a-c98e-4cd7-bd8a-d348790d80b7 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:55.956363 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d29e292a-c98e-4cd7-bd8a-d348790d80b7 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:55.957498 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d29e292a-c98e-4cd7-bd8a-d348790d80b7 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/82f8d22c-99ee-4c2b-8a36-5299c187ace7" status: 200 len: 1362 microversion: 2.25 time: 0.307178 Oct 19 03:13:55.958048 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 239/471] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:13:55 2022] GET /compute/v2.1/servers/82f8d22c-99ee-4c2b-8a36-5299c187ace7 => generated 1362 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:13:56.264058 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b5367272-2ce0-4225-9bb8-31e050bdc475 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-UnshelveToHostMultiNodesTest-server-1599555008", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "networks": "none"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:13:56.311709 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a619a5a3-2070-4eee-9487-9f90dca08485 tempest-HypervisorAdminNegativeTestJSON-1890864920 tempest-HypervisorAdminNegativeTestJSON-1890864920-project] Calling method '.version_select at 0x7fc1314e3ee0>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:56.313880 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a619a5a3-2070-4eee-9487-9f90dca08485 tempest-HypervisorAdminNegativeTestJSON-1890864920 tempest-HypervisorAdminNegativeTestJSON-1890864920-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': '14cb1e38b1314382833d2e8c2221e77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782a876e14be4cc997c748a198bec1f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:56.319615 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a619a5a3-2070-4eee-9487-9f90dca08485 tempest-HypervisorAdminNegativeTestJSON-1890864920 tempest-HypervisorAdminNegativeTestJSON-1890864920-project] Request method failure captured: Oct 19 03:13:56.319615 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Oct 19 03:13:56.319615 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:13:56.319615 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:13:56.319615 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:13:56.319615 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:13:56.319615 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:13:56.319615 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:13:56.319615 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:13:56.319615 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:13:56.319615 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2ty_MEDuW8kPZhOzda4VjcA7QDt8Sxwc6DFcZMbgs4YMkb0X3l33TIhjhf2f3oKdZvsfHRA7S1UIw-p6Dxgep9b_bANcKXdBsKbmmkA6cWxUOAHMrpU_dBGNAm89AIZj_QZx-K-kUhJq0auAehJjzPb9Eqw0D2SZQAdP3gv2ifXvaA Oct 19 03:13:56.319615 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:13:56.319615 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:13:56.319615 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:13:56.319615 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:13:56.319615 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:13:56.319615 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:13:56.319615 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 782a876e14be4cc997c748a198bec1f1 Oct 19 03:13:56.319615 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1890864920 Oct 19 03:13:56.319615 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:13:56.319615 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:13:56.320807 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/782a876e14be4cc997c748a198bec1f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/782a876e14be4cc997c748a198bec1f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/782a876e14be4cc997c748a198bec1f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_782a876e14be4cc997c748a198bec1f1", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:13:56.320807 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1890864920 Oct 19 03:13:56.320807 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 782a876e14be4cc997c748a198bec1f1 Oct 19 03:13:56.320807 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1890864920 Oct 19 03:13:56.320807 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-HypervisorAdminNegativeTestJSON-1890864920-project Oct 19 03:13:56.320807 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:13:56.320807 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:13:56.320807 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 14cb1e38b1314382833d2e8c2221e77f Oct 19 03:13:56.320807 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1890864920-project Oct 19 03:13:56.320807 n-d-861333-8 devstack@n-api.service[121135]: method: Oct 19 03:13:56.320807 n-d-861333-8 devstack@n-api.service[121135]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 19 03:13:56.320807 n-d-861333-8 devstack@n-api.service[121135]: action_args: {} Oct 19 03:13:56.320807 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:13:56.321590 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:56.321590 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:13:56.321590 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:13:56.321590 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:13:56.321590 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:13:56.321590 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 03:13:56.321590 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 03:13:56.321590 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:13:56.321590 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:13:56.321590 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Oct 19 03:13:56.321590 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self._detail(req) Oct 19 03:13:56.321590 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Oct 19 03:13:56.321590 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Oct 19 03:13:56.321590 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 19 03:13:56.321590 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 19 03:13:56.321590 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 19 03:13:56.321590 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 19 03:13:56.321590 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 03:13:56.321590 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 03:13:56.322585 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 03:13:56.322585 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 03:13:56.322585 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 19 03:13:56.322585 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 19 03:13:56.322585 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 19 03:13:56.322585 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 19 03:13:56.322585 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 19 03:13:56.322585 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 19 03:13:56.322585 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 19 03:13:56.322585 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:56.322585 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:13:56.322585 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:56.322585 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:56.322585 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:13:56.322585 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:13:56.322585 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 19 03:13:56.322585 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 19 03:13:56.322585 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 19 03:13:56.322585 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:56.326562 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a619a5a3-2070-4eee-9487-9f90dca08485 tempest-HypervisorAdminNegativeTestJSON-1890864920 tempest-HypervisorAdminNegativeTestJSON-1890864920-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:13:56.327654 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a619a5a3-2070-4eee-9487-9f90dca08485 tempest-HypervisorAdminNegativeTestJSON-1890864920 tempest-HypervisorAdminNegativeTestJSON-1890864920-project] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.368500 Oct 19 03:13:56.328371 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 240/472] 10.222.0.52 () {58 vars in 1167 bytes} [Wed Oct 19 03:13:55 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 370 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:13:56.341426 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d0694f4f-930e-4241-b917-ea6040e77f3e tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-922712587", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:13:56.352602 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-b5367272-2ce0-4225-9bb8-31e050bdc475 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Flavor limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:13:56.353033 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-b5367272-2ce0-4225-9bb8-31e050bdc475 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Image limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:13:56.353809 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-b5367272-2ce0-4225-9bb8-31e050bdc475 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Flavor pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:13:56.355863 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-b5367272-2ce0-4225-9bb8-31e050bdc475 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Image pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:13:56.355863 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-b5367272-2ce0-4225-9bb8-31e050bdc475 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:13:56.364630 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b5367272-2ce0-4225-9bb8-31e050bdc475 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:56.365122 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b5367272-2ce0-4225-9bb8-31e050bdc475 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:56.365612 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b5367272-2ce0-4225-9bb8-31e050bdc475 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:56.366410 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b5367272-2ce0-4225-9bb8-31e050bdc475 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:56.366868 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b5367272-2ce0-4225-9bb8-31e050bdc475 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:56.367490 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b5367272-2ce0-4225-9bb8-31e050bdc475 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:56.389026 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-b5367272-2ce0-4225-9bb8-31e050bdc475 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Getting quotas for project 40f9151d61bc4d32a5aff16ca1a0a912. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:13:56.397362 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-b5367272-2ce0-4225-9bb8-31e050bdc475 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Getting quotas for user 48d53dcc40524d0dba3d737d29a89209 and project 40f9151d61bc4d32a5aff16ca1a0a912. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:13:56.419372 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.network.neutron [None req-d0694f4f-930e-4241-b917-ea6040e77f3e tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] validate_networks() for None {{(pid=121135) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:13:56.421356 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b5367272-2ce0-4225-9bb8-31e050bdc475 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Going to run 1 instances... {{(pid=121134) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:13:56.422379 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b5367272-2ce0-4225-9bb8-31e050bdc475 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:13:56.567972 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b5367272-2ce0-4225-9bb8-31e050bdc475 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.91 time: 0.795126 Oct 19 03:13:56.568617 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 233/473] 10.222.0.52 () {62 vars in 1188 bytes} [Wed Oct 19 03:13:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 796 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 19 03:13:56.573132 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a75b36a6-e78c-4e77-aac6-9e10db765bf3 tempest-HypervisorAdminNegativeTestJSON-1890864920 tempest-HypervisorAdminNegativeTestJSON-1890864920-project] Calling method '.version_select at 0x7fc1314a4670>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:56.575475 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a75b36a6-e78c-4e77-aac6-9e10db765bf3 tempest-HypervisorAdminNegativeTestJSON-1890864920 tempest-HypervisorAdminNegativeTestJSON-1890864920-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': '14cb1e38b1314382833d2e8c2221e77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782a876e14be4cc997c748a198bec1f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:56.577022 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a75b36a6-e78c-4e77-aac6-9e10db765bf3 tempest-HypervisorAdminNegativeTestJSON-1890864920 tempest-HypervisorAdminNegativeTestJSON-1890864920-project] Request method failure captured: Oct 19 03:13:56.577022 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Oct 19 03:13:56.577022 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:13:56.577022 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:13:56.577022 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:13:56.577022 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:13:56.577022 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:13:56.577022 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:13:56.577022 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:13:56.577022 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:13:56.577022 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT2ty_MEDuW8kPZhOzda4VjcA7QDt8Sxwc6DFcZMbgs4YMkb0X3l33TIhjhf2f3oKdZvsfHRA7S1UIw-p6Dxgep9b_bANcKXdBsKbmmkA6cWxUOAHMrpU_dBGNAm89AIZj_QZx-K-kUhJq0auAehJjzPb9Eqw0D2SZQAdP3gv2ifXvaA Oct 19 03:13:56.577022 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:13:56.577022 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:13:56.577022 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:13:56.577022 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:13:56.577022 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:13:56.577022 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:13:56.577022 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 782a876e14be4cc997c748a198bec1f1 Oct 19 03:13:56.577022 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1890864920 Oct 19 03:13:56.577022 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:13:56.577022 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:13:56.578235 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/782a876e14be4cc997c748a198bec1f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/782a876e14be4cc997c748a198bec1f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/782a876e14be4cc997c748a198bec1f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_782a876e14be4cc997c748a198bec1f1", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:13:56.578235 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1890864920 Oct 19 03:13:56.578235 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 782a876e14be4cc997c748a198bec1f1 Oct 19 03:13:56.578235 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1890864920 Oct 19 03:13:56.578235 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-HypervisorAdminNegativeTestJSON-1890864920-project Oct 19 03:13:56.578235 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:13:56.578235 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:13:56.578235 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 14cb1e38b1314382833d2e8c2221e77f Oct 19 03:13:56.578235 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1890864920-project Oct 19 03:13:56.578235 n-d-861333-8 devstack@n-api.service[121134]: method: Oct 19 03:13:56.578235 n-d-861333-8 devstack@n-api.service[121134]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 19 03:13:56.578235 n-d-861333-8 devstack@n-api.service[121134]: action_args: {} Oct 19 03:13:56.578235 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:13:56.578916 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:56.578916 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:13:56.578916 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:13:56.578916 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:13:56.578916 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:13:56.578916 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 03:13:56.578916 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 03:13:56.578916 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:13:56.578916 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:13:56.578916 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Oct 19 03:13:56.578916 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 19 03:13:56.578916 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Oct 19 03:13:56.578916 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Oct 19 03:13:56.578916 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 19 03:13:56.578916 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 19 03:13:56.578916 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 19 03:13:56.578916 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 19 03:13:56.578916 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 03:13:56.578916 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 03:13:56.579893 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 03:13:56.579893 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 03:13:56.579893 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 19 03:13:56.579893 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 19 03:13:56.579893 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 19 03:13:56.579893 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 19 03:13:56.579893 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 19 03:13:56.579893 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 19 03:13:56.579893 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 19 03:13:56.579893 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:13:56.579893 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:13:56.579893 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:13:56.579893 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:56.579893 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:13:56.579893 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:13:56.579893 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 19 03:13:56.579893 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 19 03:13:56.579893 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 19 03:13:56.579893 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:13:56.582481 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a75b36a6-e78c-4e77-aac6-9e10db765bf3 tempest-HypervisorAdminNegativeTestJSON-1890864920 tempest-HypervisorAdminNegativeTestJSON-1890864920-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:13:56.583511 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a75b36a6-e78c-4e77-aac6-9e10db765bf3 tempest-HypervisorAdminNegativeTestJSON-1890864920 tempest-HypervisorAdminNegativeTestJSON-1890864920-project] 10.222.0.52 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.013988 Oct 19 03:13:56.584108 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 234/474] 10.222.0.52 () {58 vars in 1146 bytes} [Wed Oct 19 03:13:56 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:13:56.593612 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-628c8508-50be-46c1-9ce7-5bd060e7631f tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:56.597659 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-628c8508-50be-46c1-9ce7-5bd060e7631f tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:56.698068 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-628c8508-50be-46c1-9ce7-5bd060e7631f tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:56.710097 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-628c8508-50be-46c1-9ce7-5bd060e7631f tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:56.713914 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-d0694f4f-930e-4241-b917-ea6040e77f3e tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Flavor limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:13:56.714437 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-d0694f4f-930e-4241-b917-ea6040e77f3e tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Image limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:13:56.715019 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-d0694f4f-930e-4241-b917-ea6040e77f3e tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Flavor pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:13:56.715503 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-d0694f4f-930e-4241-b917-ea6040e77f3e tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Image pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:13:56.715990 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-d0694f4f-930e-4241-b917-ea6040e77f3e tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:13:56.725533 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-628c8508-50be-46c1-9ce7-5bd060e7631f tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:56.727480 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d0694f4f-930e-4241-b917-ea6040e77f3e tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:56.728067 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d0694f4f-930e-4241-b917-ea6040e77f3e tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:56.728688 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d0694f4f-930e-4241-b917-ea6040e77f3e tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:56.729931 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d0694f4f-930e-4241-b917-ea6040e77f3e tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:56.730397 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d0694f4f-930e-4241-b917-ea6040e77f3e tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:56.731403 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d0694f4f-930e-4241-b917-ea6040e77f3e tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:56.736394 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-628c8508-50be-46c1-9ce7-5bd060e7631f tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1454 microversion: 2.91 time: 0.149684 Oct 19 03:13:56.742861 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 235/475] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:13:56 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1454 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:13:56.762130 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-d0694f4f-930e-4241-b917-ea6040e77f3e tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Getting quotas for project 69e88bbb75184a59b88e533a49d63cd8. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:13:56.762891 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4442ca10-d3fb-4927-8c1f-a6b2564898d4 tempest-HypervisorAdminNegativeTestJSON-1890864920 tempest-HypervisorAdminNegativeTestJSON-1890864920-project] Calling method '.version_select at 0x7fc1316a63a0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:56.763925 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-d0694f4f-930e-4241-b917-ea6040e77f3e tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Getting quotas for user e3ff6534c5e74a2eb179044ef833f0c1 and project 69e88bbb75184a59b88e533a49d63cd8. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:13:56.764139 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-4442ca10-d3fb-4927-8c1f-a6b2564898d4 tempest-HypervisorAdminNegativeTestJSON-1890864920 tempest-HypervisorAdminNegativeTestJSON-1890864920-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': '14cb1e38b1314382833d2e8c2221e77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782a876e14be4cc997c748a198bec1f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:56.764139 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4442ca10-d3fb-4927-8c1f-a6b2564898d4 tempest-HypervisorAdminNegativeTestJSON-1890864920 tempest-HypervisorAdminNegativeTestJSON-1890864920-project] Request method failure captured: Oct 19 03:13:56.764139 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Oct 19 03:13:56.764139 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:13:56.764139 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:13:56.764139 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:13:56.764139 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:13:56.764139 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:13:56.764139 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:13:56.764139 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:13:56.764139 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:13:56.764139 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT2ty_MEDuW8kPZhOzda4VjcA7QDt8Sxwc6DFcZMbgs4YMkb0X3l33TIhjhf2f3oKdZvsfHRA7S1UIw-p6Dxgep9b_bANcKXdBsKbmmkA6cWxUOAHMrpU_dBGNAm89AIZj_QZx-K-kUhJq0auAehJjzPb9Eqw0D2SZQAdP3gv2ifXvaA Oct 19 03:13:56.764139 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:13:56.764139 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:13:56.764139 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:13:56.764139 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:13:56.764139 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:13:56.764139 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:13:56.764139 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 782a876e14be4cc997c748a198bec1f1 Oct 19 03:13:56.764139 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1890864920 Oct 19 03:13:56.764139 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:13:56.764139 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:13:56.765710 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/782a876e14be4cc997c748a198bec1f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/782a876e14be4cc997c748a198bec1f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/782a876e14be4cc997c748a198bec1f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_782a876e14be4cc997c748a198bec1f1", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:13:56.765710 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1890864920 Oct 19 03:13:56.765710 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 782a876e14be4cc997c748a198bec1f1 Oct 19 03:13:56.765710 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1890864920 Oct 19 03:13:56.765710 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-HypervisorAdminNegativeTestJSON-1890864920-project Oct 19 03:13:56.765710 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:13:56.765710 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:13:56.765710 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 14cb1e38b1314382833d2e8c2221e77f Oct 19 03:13:56.765710 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1890864920-project Oct 19 03:13:56.765710 n-d-861333-8 devstack@n-api.service[121134]: method: Oct 19 03:13:56.765710 n-d-861333-8 devstack@n-api.service[121134]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 19 03:13:56.765710 n-d-861333-8 devstack@n-api.service[121134]: action_args: {} Oct 19 03:13:56.765710 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:13:56.767590 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:56.767590 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:13:56.767590 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:13:56.767590 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:13:56.767590 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:13:56.767590 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 03:13:56.767590 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 03:13:56.767590 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:13:56.767590 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:13:56.767590 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Oct 19 03:13:56.767590 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Oct 19 03:13:56.767590 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 19 03:13:56.767590 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 19 03:13:56.767590 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 19 03:13:56.767590 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 19 03:13:56.767590 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 03:13:56.767590 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 03:13:56.767590 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 03:13:56.767590 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 03:13:56.769299 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 19 03:13:56.769299 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 19 03:13:56.769299 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 19 03:13:56.769299 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 19 03:13:56.769299 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 19 03:13:56.769299 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 19 03:13:56.769299 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 19 03:13:56.769299 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:13:56.769299 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:13:56.769299 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:13:56.769299 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:56.769299 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:13:56.769299 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:13:56.769299 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 19 03:13:56.769299 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 19 03:13:56.769299 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 19 03:13:56.769299 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:13:56.770746 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4442ca10-d3fb-4927-8c1f-a6b2564898d4 tempest-HypervisorAdminNegativeTestJSON-1890864920 tempest-HypervisorAdminNegativeTestJSON-1890864920-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:13:56.770746 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4442ca10-d3fb-4927-8c1f-a6b2564898d4 tempest-HypervisorAdminNegativeTestJSON-1890864920 tempest-HypervisorAdminNegativeTestJSON-1890864920-project] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.019643 Oct 19 03:13:56.772243 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 236/476] 10.222.0.52 () {58 vars in 1179 bytes} [Wed Oct 19 03:13:56 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:13:56.774624 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d0694f4f-930e-4241-b917-ea6040e77f3e tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Going to run 1 instances... {{(pid=121135) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:13:56.777061 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d0694f4f-930e-4241-b917-ea6040e77f3e tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] [instance: 0de5edf9-535f-41db-b32a-06d4e9b231c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121135) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:13:56.780765 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-03099f0d-8fa8-479d-a804-57cdd2fd816a tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:56.781449 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-03099f0d-8fa8-479d-a804-57cdd2fd816a tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 7b4a8cd9-a238-4bff-a002-497dc807bf3a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:56.789331 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-03099f0d-8fa8-479d-a804-57cdd2fd816a tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:56.790272 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-03099f0d-8fa8-479d-a804-57cdd2fd816a tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:56.790714 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-03099f0d-8fa8-479d-a804-57cdd2fd816a tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:56.791596 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-03099f0d-8fa8-479d-a804-57cdd2fd816a tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:56.792324 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-03099f0d-8fa8-479d-a804-57cdd2fd816a tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:56.792917 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-03099f0d-8fa8-479d-a804-57cdd2fd816a tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:56.879513 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d0694f4f-930e-4241-b917-ea6040e77f3e tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.544740 Oct 19 03:13:56.880848 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 241/477] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:13:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 548 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 03:13:56.943916 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-03099f0d-8fa8-479d-a804-57cdd2fd816a tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:56.955974 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-03099f0d-8fa8-479d-a804-57cdd2fd816a tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a" status: 200 len: 1471 microversion: 2.1 time: 0.182335 Oct 19 03:13:56.957462 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 237/478] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:13:56 2022] GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a => generated 1471 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:13:57.208892 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ebd12e74-3174-425b-9a33-206e0769255e tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-767117093", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "networks": "none"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:13:57.283094 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3c9868dc-4ce6-4d1d-93c5-175465805334 tempest-HypervisorAdminNegativeTestJSON-1444511128 tempest-HypervisorAdminNegativeTestJSON-1444511128-project-admin] Calling method '.version_select at 0x7fc131415310>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:57.285285 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3c9868dc-4ce6-4d1d-93c5-175465805334 tempest-HypervisorAdminNegativeTestJSON-1444511128 tempest-HypervisorAdminNegativeTestJSON-1444511128-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:57.285952 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3c9868dc-4ce6-4d1d-93c5-175465805334 tempest-HypervisorAdminNegativeTestJSON-1444511128 tempest-HypervisorAdminNegativeTestJSON-1444511128-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:57.286395 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3c9868dc-4ce6-4d1d-93c5-175465805334 tempest-HypervisorAdminNegativeTestJSON-1444511128 tempest-HypervisorAdminNegativeTestJSON-1444511128-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:57.313034 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-ebd12e74-3174-425b-9a33-206e0769255e tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Flavor limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:13:57.313808 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-ebd12e74-3174-425b-9a33-206e0769255e tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Image limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:13:57.314497 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-ebd12e74-3174-425b-9a33-206e0769255e tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Flavor pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:13:57.315120 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-ebd12e74-3174-425b-9a33-206e0769255e tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Image pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:13:57.315837 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-ebd12e74-3174-425b-9a33-206e0769255e tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:13:57.328747 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ebd12e74-3174-425b-9a33-206e0769255e tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:57.328855 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3c9868dc-4ce6-4d1d-93c5-175465805334 tempest-HypervisorAdminNegativeTestJSON-1444511128 tempest-HypervisorAdminNegativeTestJSON-1444511128-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:57.329606 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3c9868dc-4ce6-4d1d-93c5-175465805334 tempest-HypervisorAdminNegativeTestJSON-1444511128 tempest-HypervisorAdminNegativeTestJSON-1444511128-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:57.329889 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ebd12e74-3174-425b-9a33-206e0769255e tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:57.330334 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ebd12e74-3174-425b-9a33-206e0769255e tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:57.330955 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3c9868dc-4ce6-4d1d-93c5-175465805334 tempest-HypervisorAdminNegativeTestJSON-1444511128 tempest-HypervisorAdminNegativeTestJSON-1444511128-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:57.331078 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ebd12e74-3174-425b-9a33-206e0769255e tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:57.331525 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ebd12e74-3174-425b-9a33-206e0769255e tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:57.331954 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ebd12e74-3174-425b-9a33-206e0769255e tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:57.345669 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3c9868dc-4ce6-4d1d-93c5-175465805334 tempest-HypervisorAdminNegativeTestJSON-1444511128 tempest-HypervisorAdminNegativeTestJSON-1444511128-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:57.346388 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3c9868dc-4ce6-4d1d-93c5-175465805334 tempest-HypervisorAdminNegativeTestJSON-1444511128 tempest-HypervisorAdminNegativeTestJSON-1444511128-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:57.347185 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3c9868dc-4ce6-4d1d-93c5-175465805334 tempest-HypervisorAdminNegativeTestJSON-1444511128 tempest-HypervisorAdminNegativeTestJSON-1444511128-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:57.352795 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-ebd12e74-3174-425b-9a33-206e0769255e tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Getting quotas for project 1c09d60b5f254b6d91f4103a1f1245b4. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:13:57.356732 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3c9868dc-4ce6-4d1d-93c5-175465805334 tempest-HypervisorAdminNegativeTestJSON-1444511128 tempest-HypervisorAdminNegativeTestJSON-1444511128-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.397360 Oct 19 03:13:57.358272 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-ebd12e74-3174-425b-9a33-206e0769255e tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Getting quotas for user 1e254209599044d7bcd2503d96152c50 and project 1c09d60b5f254b6d91f4103a1f1245b4. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:13:57.364548 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 238/479] 10.222.0.52 () {58 vars in 1146 bytes} [Wed Oct 19 03:13:56 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:13:57.376097 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d1f66424-f62d-433a-8ae6-f84287509287 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:57.376097 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d1f66424-f62d-433a-8ae6-f84287509287 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] [instance: 0de5edf9-535f-41db-b32a-06d4e9b231c3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:57.376277 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ebd12e74-3174-425b-9a33-206e0769255e tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Going to run 1 instances... {{(pid=121135) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:13:57.376277 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ebd12e74-3174-425b-9a33-206e0769255e tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] [instance: d50976fb-756b-4b12-92f2-cedf87df492d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121135) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:13:57.453568 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d1f66424-f62d-433a-8ae6-f84287509287 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ff6534c5e74a2eb179044ef833f0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e88bbb75184a59b88e533a49d63cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:57.467661 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d1f66424-f62d-433a-8ae6-f84287509287 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] 10.222.0.52 "GET /compute/v2.1/servers/0de5edf9-535f-41db-b32a-06d4e9b231c3" status: 200 len: 1218 microversion: 2.1 time: 0.101932 Oct 19 03:13:57.471989 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 239/480] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:13:57 2022] GET /compute/v2.1/servers/0de5edf9-535f-41db-b32a-06d4e9b231c3 => generated 1218 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:13:57.485204 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5669c377-0301-465a-9517-f0d7d8cafe41 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:13:57.485790 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5669c377-0301-465a-9517-f0d7d8cafe41 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 7b4a8cd9-a238-4bff-a002-497dc807bf3a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:57.499584 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5669c377-0301-465a-9517-f0d7d8cafe41 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:57.500073 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5669c377-0301-465a-9517-f0d7d8cafe41 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:57.503121 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5669c377-0301-465a-9517-f0d7d8cafe41 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:57.504033 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5669c377-0301-465a-9517-f0d7d8cafe41 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:57.504626 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5669c377-0301-465a-9517-f0d7d8cafe41 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:57.504910 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5669c377-0301-465a-9517-f0d7d8cafe41 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:57.588562 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ebd12e74-3174-425b-9a33-206e0769255e tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.704468 Oct 19 03:13:57.589983 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 242/481] 10.222.0.52 () {62 vars in 1188 bytes} [Wed Oct 19 03:13:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 709 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 19 03:13:57.597495 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-da779ac7-3a83-41a3-8ab1-4cc4111741d1 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:57.598591 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-da779ac7-3a83-41a3-8ab1-4cc4111741d1 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 82f8d22c-99ee-4c2b-8a36-5299c187ace7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:57.605293 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-da779ac7-3a83-41a3-8ab1-4cc4111741d1 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:57.606398 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-da779ac7-3a83-41a3-8ab1-4cc4111741d1 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:57.606842 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-da779ac7-3a83-41a3-8ab1-4cc4111741d1 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:57.609834 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-da779ac7-3a83-41a3-8ab1-4cc4111741d1 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:57.609834 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-da779ac7-3a83-41a3-8ab1-4cc4111741d1 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:57.609834 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-da779ac7-3a83-41a3-8ab1-4cc4111741d1 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:57.832240 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5669c377-0301-465a-9517-f0d7d8cafe41 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "POST /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a/action" status: 204 len: 0 microversion: 2.1 time: 0.358810 Oct 19 03:13:57.836200 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 240/482] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:13:57 2022] POST /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a/action => generated 0 bytes in 360 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:13:57.842527 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e3b9c370-6f7f-4196-9804-d4f8a7dce960 tempest-HypervisorAdminNegativeTestJSON-1890864920 tempest-HypervisorAdminNegativeTestJSON-1890864920-project] Calling method '.version_select at 0x7fc131415040>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:57.848842 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-da779ac7-3a83-41a3-8ab1-4cc4111741d1 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:57.852481 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e3b9c370-6f7f-4196-9804-d4f8a7dce960 tempest-HypervisorAdminNegativeTestJSON-1890864920 tempest-HypervisorAdminNegativeTestJSON-1890864920-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': '14cb1e38b1314382833d2e8c2221e77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782a876e14be4cc997c748a198bec1f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:57.854890 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e3b9c370-6f7f-4196-9804-d4f8a7dce960 tempest-HypervisorAdminNegativeTestJSON-1890864920 tempest-HypervisorAdminNegativeTestJSON-1890864920-project] Request method failure captured: Oct 19 03:13:57.854890 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Oct 19 03:13:57.854890 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:13:57.854890 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:13:57.854890 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:13:57.854890 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:13:57.854890 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:13:57.854890 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:13:57.854890 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:13:57.854890 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:13:57.854890 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT2ty_MEDuW8kPZhOzda4VjcA7QDt8Sxwc6DFcZMbgs4YMkb0X3l33TIhjhf2f3oKdZvsfHRA7S1UIw-p6Dxgep9b_bANcKXdBsKbmmkA6cWxUOAHMrpU_dBGNAm89AIZj_QZx-K-kUhJq0auAehJjzPb9Eqw0D2SZQAdP3gv2ifXvaA Oct 19 03:13:57.854890 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:13:57.854890 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:13:57.854890 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:13:57.854890 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:13:57.854890 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:13:57.854890 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:13:57.854890 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 782a876e14be4cc997c748a198bec1f1 Oct 19 03:13:57.854890 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1890864920 Oct 19 03:13:57.854890 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:13:57.854890 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:13:57.863038 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/782a876e14be4cc997c748a198bec1f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/782a876e14be4cc997c748a198bec1f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/782a876e14be4cc997c748a198bec1f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_782a876e14be4cc997c748a198bec1f1", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:13:57.863038 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1890864920 Oct 19 03:13:57.863038 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 782a876e14be4cc997c748a198bec1f1 Oct 19 03:13:57.863038 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1890864920 Oct 19 03:13:57.863038 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-HypervisorAdminNegativeTestJSON-1890864920-project Oct 19 03:13:57.863038 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:13:57.863038 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:13:57.863038 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 14cb1e38b1314382833d2e8c2221e77f Oct 19 03:13:57.863038 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1890864920-project Oct 19 03:13:57.863038 n-d-861333-8 devstack@n-api.service[121134]: method: Oct 19 03:13:57.863038 n-d-861333-8 devstack@n-api.service[121134]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 19 03:13:57.863038 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '1'} Oct 19 03:13:57.863038 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:13:57.863959 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:57.863959 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:13:57.863959 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:13:57.863959 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:13:57.863959 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:13:57.863959 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 03:13:57.863959 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 03:13:57.863959 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:13:57.863959 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:13:57.863959 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Oct 19 03:13:57.863959 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Oct 19 03:13:57.863959 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 19 03:13:57.863959 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 19 03:13:57.863959 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 19 03:13:57.863959 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 19 03:13:57.863959 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 03:13:57.863959 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 03:13:57.863959 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 03:13:57.863959 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 03:13:57.865259 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 19 03:13:57.865259 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 19 03:13:57.865259 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 19 03:13:57.865259 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 19 03:13:57.865259 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 19 03:13:57.865259 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 19 03:13:57.865259 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 19 03:13:57.865259 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:13:57.865259 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:13:57.865259 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:13:57.865259 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:57.865259 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:13:57.865259 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:13:57.865259 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 19 03:13:57.865259 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 19 03:13:57.865259 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 19 03:13:57.865259 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:13:57.866519 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e3b9c370-6f7f-4196-9804-d4f8a7dce960 tempest-HypervisorAdminNegativeTestJSON-1890864920 tempest-HypervisorAdminNegativeTestJSON-1890864920-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:13:57.866519 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e3b9c370-6f7f-4196-9804-d4f8a7dce960 tempest-HypervisorAdminNegativeTestJSON-1890864920 tempest-HypervisorAdminNegativeTestJSON-1890864920-project] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.018786 Oct 19 03:13:57.866519 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 241/483] 10.222.0.52 () {58 vars in 1173 bytes} [Wed Oct 19 03:13:57 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:13:57.866742 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=100 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:13:57.869662 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-da779ac7-3a83-41a3-8ab1-4cc4111741d1 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:57.870382 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e958b13f-9e1d-43ab-928f-5348f7430be3 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:13:57.872994 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-da779ac7-3a83-41a3-8ab1-4cc4111741d1 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:57.874794 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-da779ac7-3a83-41a3-8ab1-4cc4111741d1 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/82f8d22c-99ee-4c2b-8a36-5299c187ace7" status: 200 len: 1362 microversion: 2.25 time: 0.282356 Oct 19 03:13:57.874943 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e958b13f-9e1d-43ab-928f-5348f7430be3 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] [instance: d50976fb-756b-4b12-92f2-cedf87df492d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:57.887696 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 243/484] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:13:57 2022] GET /compute/v2.1/servers/82f8d22c-99ee-4c2b-8a36-5299c187ace7 => generated 1362 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:13:57.888150 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:13:57.899913 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-90dd9317-2e41-472b-a81b-39a2e5ad798a tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:57.899913 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-90dd9317-2e41-472b-a81b-39a2e5ad798a tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:57.908548 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-90dd9317-2e41-472b-a81b-39a2e5ad798a tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:57.909326 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-90dd9317-2e41-472b-a81b-39a2e5ad798a tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:57.910046 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-90dd9317-2e41-472b-a81b-39a2e5ad798a tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:57.911058 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-90dd9317-2e41-472b-a81b-39a2e5ad798a tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:57.911746 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-90dd9317-2e41-472b-a81b-39a2e5ad798a tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:57.912443 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-90dd9317-2e41-472b-a81b-39a2e5ad798a tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:57.972914 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e958b13f-9e1d-43ab-928f-5348f7430be3 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:57.982282 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e958b13f-9e1d-43ab-928f-5348f7430be3 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:57.987049 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e958b13f-9e1d-43ab-928f-5348f7430be3 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:57.999848 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e958b13f-9e1d-43ab-928f-5348f7430be3 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] 10.222.0.52 "PUT /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d" status: 200 len: 1358 microversion: 2.75 time: 0.142008 Oct 19 03:13:58.004252 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 242/485] 10.222.0.52 () {62 vars in 1297 bytes} [Wed Oct 19 03:13:57 2022] PUT /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d => generated 1358 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:13:58.007795 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3ba7a20b-0e7a-4e0b-90bb-ce7d62763bd8 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:58.008714 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3ba7a20b-0e7a-4e0b-90bb-ce7d62763bd8 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 7b4a8cd9-a238-4bff-a002-497dc807bf3a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:58.025471 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3ba7a20b-0e7a-4e0b-90bb-ce7d62763bd8 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:58.026311 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3ba7a20b-0e7a-4e0b-90bb-ce7d62763bd8 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:58.026897 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3ba7a20b-0e7a-4e0b-90bb-ce7d62763bd8 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:58.028586 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3ba7a20b-0e7a-4e0b-90bb-ce7d62763bd8 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:58.029395 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3ba7a20b-0e7a-4e0b-90bb-ce7d62763bd8 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:58.029975 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3ba7a20b-0e7a-4e0b-90bb-ce7d62763bd8 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:58.106276 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-90dd9317-2e41-472b-a81b-39a2e5ad798a tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:58.124904 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-90dd9317-2e41-472b-a81b-39a2e5ad798a tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:58.135154 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-90dd9317-2e41-472b-a81b-39a2e5ad798a tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:58.150647 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-90dd9317-2e41-472b-a81b-39a2e5ad798a tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1458 microversion: 2.91 time: 0.273685 Oct 19 03:13:58.171721 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 244/486] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:13:57 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1458 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:13:58.177075 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-534d94ba-62fe-4a35-be4f-3568204a1118 tempest-HypervisorAdminNegativeTestJSON-1444511128 tempest-HypervisorAdminNegativeTestJSON-1444511128-project-admin] Calling method '.version_select at 0x7fc13158e9d0>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:58.178905 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-534d94ba-62fe-4a35-be4f-3568204a1118 tempest-HypervisorAdminNegativeTestJSON-1444511128 tempest-HypervisorAdminNegativeTestJSON-1444511128-project-admin] HTTP exception thrown: Hypervisor with ID '98b579ea-4091-460d-9d89-d25e094b40cb' could not be found. Oct 19 03:13:58.201841 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-534d94ba-62fe-4a35-be4f-3568204a1118 tempest-HypervisorAdminNegativeTestJSON-1444511128 tempest-HypervisorAdminNegativeTestJSON-1444511128-project-admin] Request method failure captured: Oct 19 03:13:58.201841 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/os-hypervisors/98b579ea-4091-460d-9d89-d25e094b40cb/uptime HTTP/1.1 Oct 19 03:13:58.201841 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:13:58.201841 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:13:58.201841 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:13:58.201841 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:13:58.201841 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:13:58.201841 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:13:58.201841 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:13:58.201841 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:13:58.201841 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2tzZvnMtA5sHmZKBSx0UFGWLjHE0vF8cy-yF_LaYbt39zgjLaLo5XBYAqO1C_mFr-anv9dE_Kcy4RqAMrf1831elbOQ_kFeBD68aWX8LFM7szyluZDOXKxmtS9Q9tERnoDolXOUAs-ORjfNbYITbFeBA58yX5g5Pb2KNcSvUsZOXVU Oct 19 03:13:58.201841 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:13:58.201841 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:13:58.201841 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:13:58.201841 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:13:58.201841 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:13:58.201841 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:13:58.201841 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: faf64d87824947f6a3a41fbef63e17a6 Oct 19 03:13:58.201841 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1444511128 Oct 19 03:13:58.201841 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member,admin Oct 19 03:13:58.201841 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member,admin Oct 19 03:13:58.203137 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/faf64d87824947f6a3a41fbef63e17a6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/faf64d87824947f6a3a41fbef63e17a6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/faf64d87824947f6a3a41fbef63e17a6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_faf64d87824947f6a3a41fbef63e17a6", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:13:58.203137 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1444511128 Oct 19 03:13:58.203137 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: faf64d87824947f6a3a41fbef63e17a6 Oct 19 03:13:58.203137 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1444511128 Oct 19 03:13:58.203137 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-HypervisorAdminNegativeTestJSON-1444511128-project-admin Oct 19 03:13:58.203137 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:13:58.203137 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:13:58.203137 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 6ba8289298ea4f87946c5d21950301d1 Oct 19 03:13:58.203137 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1444511128-project-admin Oct 19 03:13:58.203137 n-d-861333-8 devstack@n-api.service[121135]: method: Oct 19 03:13:58.203137 n-d-861333-8 devstack@n-api.service[121135]: exception: Hypervisor with ID '98b579ea-4091-460d-9d89-d25e094b40cb' could not be found. Oct 19 03:13:58.203137 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '98b579ea-4091-460d-9d89-d25e094b40cb'} Oct 19 03:13:58.204087 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:13:58.204087 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:58.204087 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 19 03:13:58.204087 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 19 03:13:58.204087 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '98b579ea-4091-460d-9d89-d25e094b40cb' Oct 19 03:13:58.204087 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:58.204087 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:13:58.204087 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:58.204087 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:58.204087 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 19 03:13:58.204087 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 19 03:13:58.204087 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 19 03:13:58.204087 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 19 03:13:58.204087 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 19 03:13:58.204087 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:58.204087 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:13:58.204087 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:58.204087 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:58.204087 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 19 03:13:58.204087 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 19 03:13:58.204087 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 19 03:13:58.204087 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 19 03:13:58.205603 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 19 03:13:58.205603 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:58.205603 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:13:58.205603 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:58.205603 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:58.205603 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:13:58.205603 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:13:58.205603 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:13:58.205603 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:13:58.205603 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 03:13:58.205603 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 03:13:58.205603 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:13:58.205603 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:13:58.205603 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Oct 19 03:13:58.205603 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 19 03:13:58.205603 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 19 03:13:58.205603 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 19 03:13:58.205603 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '98b579ea-4091-460d-9d89-d25e094b40cb' could not be found. Oct 19 03:13:58.205603 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:58.205603 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:13:58.205603 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:58.207106 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:58.207106 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:13:58.207106 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:13:58.207106 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:13:58.207106 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:13:58.207106 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '98b579ea-4091-460d-9d89-d25e094b40cb' could not be found. Oct 19 03:13:58.207106 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:58.209769 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-534d94ba-62fe-4a35-be4f-3568204a1118 tempest-HypervisorAdminNegativeTestJSON-1444511128 tempest-HypervisorAdminNegativeTestJSON-1444511128-project-admin] Returning 404 to user: Hypervisor with ID '98b579ea-4091-460d-9d89-d25e094b40cb' could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:13:58.211254 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-534d94ba-62fe-4a35-be4f-3568204a1118 tempest-HypervisorAdminNegativeTestJSON-1444511128 tempest-HypervisorAdminNegativeTestJSON-1444511128-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/98b579ea-4091-460d-9d89-d25e094b40cb/uptime" status: 404 len: 123 microversion: 2.1 time: 0.038175 Oct 19 03:13:58.212045 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 245/487] 10.222.0.52 () {58 vars in 1278 bytes} [Wed Oct 19 03:13:58 2022] GET /compute/v2.1/os-hypervisors/98b579ea-4091-460d-9d89-d25e094b40cb/uptime => generated 123 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:13:58.224106 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5950700e-e502-417e-b408-7aac90c6a776 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:58.227609 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-5950700e-e502-417e-b408-7aac90c6a776 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] [instance: d50976fb-756b-4b12-92f2-cedf87df492d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:58.319181 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-3ba7a20b-0e7a-4e0b-90bb-ce7d62763bd8 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:58.329147 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3ba7a20b-0e7a-4e0b-90bb-ce7d62763bd8 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a" status: 200 len: 1471 microversion: 2.1 time: 0.326785 Oct 19 03:13:58.329883 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 243/488] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:13:58 2022] GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a => generated 1471 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:13:58.335349 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-be1ad906-6029-4947-823f-e38158024710 tempest-HypervisorAdminNegativeTestJSON-1444511128 tempest-HypervisorAdminNegativeTestJSON-1444511128-project-admin] Calling method '.version_select at 0x7fc13136e040>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:58.337850 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-be1ad906-6029-4947-823f-e38158024710 tempest-HypervisorAdminNegativeTestJSON-1444511128 tempest-HypervisorAdminNegativeTestJSON-1444511128-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:58.338876 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-be1ad906-6029-4947-823f-e38158024710 tempest-HypervisorAdminNegativeTestJSON-1444511128 tempest-HypervisorAdminNegativeTestJSON-1444511128-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:58.339356 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-be1ad906-6029-4947-823f-e38158024710 tempest-HypervisorAdminNegativeTestJSON-1444511128 tempest-HypervisorAdminNegativeTestJSON-1444511128-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:58.346873 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-5950700e-e502-417e-b408-7aac90c6a776 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:58.356416 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-5950700e-e502-417e-b408-7aac90c6a776 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:58.358248 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-5950700e-e502-417e-b408-7aac90c6a776 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:58.359037 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-be1ad906-6029-4947-823f-e38158024710 tempest-HypervisorAdminNegativeTestJSON-1444511128 tempest-HypervisorAdminNegativeTestJSON-1444511128-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:58.359733 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-be1ad906-6029-4947-823f-e38158024710 tempest-HypervisorAdminNegativeTestJSON-1444511128 tempest-HypervisorAdminNegativeTestJSON-1444511128-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:58.360174 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-be1ad906-6029-4947-823f-e38158024710 tempest-HypervisorAdminNegativeTestJSON-1444511128 tempest-HypervisorAdminNegativeTestJSON-1444511128-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:58.364726 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5950700e-e502-417e-b408-7aac90c6a776 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] 10.222.0.52 "GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d" status: 200 len: 1358 microversion: 2.75 time: 0.151085 Oct 19 03:13:58.365561 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 246/489] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:13:58 2022] GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:13:58.373169 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-be1ad906-6029-4947-823f-e38158024710 tempest-HypervisorAdminNegativeTestJSON-1444511128 tempest-HypervisorAdminNegativeTestJSON-1444511128-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:58.373682 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-be1ad906-6029-4947-823f-e38158024710 tempest-HypervisorAdminNegativeTestJSON-1444511128 tempest-HypervisorAdminNegativeTestJSON-1444511128-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:58.374118 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-be1ad906-6029-4947-823f-e38158024710 tempest-HypervisorAdminNegativeTestJSON-1444511128 tempest-HypervisorAdminNegativeTestJSON-1444511128-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:58.380921 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-be1ad906-6029-4947-823f-e38158024710 tempest-HypervisorAdminNegativeTestJSON-1444511128 tempest-HypervisorAdminNegativeTestJSON-1444511128-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.049999 Oct 19 03:13:58.381553 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 244/490] 10.222.0.52 () {58 vars in 1146 bytes} [Wed Oct 19 03:13:58 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:13:58.398249 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ba2f68a0-2b7c-4bd6-89b7-fd5f2392708e tempest-HypervisorAdminNegativeTestJSON-1890864920 tempest-HypervisorAdminNegativeTestJSON-1890864920-project] Calling method '.version_select at 0x7fc1315bc1f0>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:58.400649 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ba2f68a0-2b7c-4bd6-89b7-fd5f2392708e tempest-HypervisorAdminNegativeTestJSON-1890864920 tempest-HypervisorAdminNegativeTestJSON-1890864920-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': '14cb1e38b1314382833d2e8c2221e77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782a876e14be4cc997c748a198bec1f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:58.403240 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ba2f68a0-2b7c-4bd6-89b7-fd5f2392708e tempest-HypervisorAdminNegativeTestJSON-1890864920 tempest-HypervisorAdminNegativeTestJSON-1890864920-project] Request method failure captured: Oct 19 03:13:58.403240 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Oct 19 03:13:58.403240 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:13:58.403240 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:13:58.403240 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:13:58.403240 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:13:58.403240 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:13:58.403240 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:13:58.403240 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:13:58.403240 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:13:58.403240 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2ty_MEDuW8kPZhOzda4VjcA7QDt8Sxwc6DFcZMbgs4YMkb0X3l33TIhjhf2f3oKdZvsfHRA7S1UIw-p6Dxgep9b_bANcKXdBsKbmmkA6cWxUOAHMrpU_dBGNAm89AIZj_QZx-K-kUhJq0auAehJjzPb9Eqw0D2SZQAdP3gv2ifXvaA Oct 19 03:13:58.403240 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:13:58.403240 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:13:58.403240 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:13:58.403240 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:13:58.403240 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:13:58.403240 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:13:58.403240 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 782a876e14be4cc997c748a198bec1f1 Oct 19 03:13:58.403240 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1890864920 Oct 19 03:13:58.403240 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:13:58.403240 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:13:58.404682 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/782a876e14be4cc997c748a198bec1f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/782a876e14be4cc997c748a198bec1f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/782a876e14be4cc997c748a198bec1f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_782a876e14be4cc997c748a198bec1f1", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:13:58.404682 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1890864920 Oct 19 03:13:58.404682 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 782a876e14be4cc997c748a198bec1f1 Oct 19 03:13:58.404682 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1890864920 Oct 19 03:13:58.404682 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-HypervisorAdminNegativeTestJSON-1890864920-project Oct 19 03:13:58.404682 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:13:58.404682 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:13:58.404682 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 14cb1e38b1314382833d2e8c2221e77f Oct 19 03:13:58.404682 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1890864920-project Oct 19 03:13:58.404682 n-d-861333-8 devstack@n-api.service[121135]: method: Oct 19 03:13:58.404682 n-d-861333-8 devstack@n-api.service[121135]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 19 03:13:58.404682 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '1'} Oct 19 03:13:58.404682 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:13:58.405413 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:58.405413 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:13:58.405413 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:13:58.405413 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:13:58.405413 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:13:58.405413 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 03:13:58.405413 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 03:13:58.405413 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:13:58.405413 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:13:58.405413 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 19 03:13:58.405413 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 19 03:13:58.405413 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Oct 19 03:13:58.405413 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Oct 19 03:13:58.405413 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 19 03:13:58.405413 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 19 03:13:58.405413 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 19 03:13:58.405413 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 19 03:13:58.405413 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 03:13:58.405413 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 03:13:58.406465 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 03:13:58.406465 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 03:13:58.406465 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 19 03:13:58.406465 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 19 03:13:58.406465 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 19 03:13:58.406465 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 19 03:13:58.406465 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 19 03:13:58.406465 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 19 03:13:58.406465 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 19 03:13:58.406465 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:58.406465 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:13:58.406465 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:58.406465 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:58.406465 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:13:58.406465 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:13:58.406465 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 19 03:13:58.406465 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 19 03:13:58.406465 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 19 03:13:58.406465 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:13:58.408832 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ba2f68a0-2b7c-4bd6-89b7-fd5f2392708e tempest-HypervisorAdminNegativeTestJSON-1890864920 tempest-HypervisorAdminNegativeTestJSON-1890864920-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:13:58.410171 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ba2f68a0-2b7c-4bd6-89b7-fd5f2392708e tempest-HypervisorAdminNegativeTestJSON-1890864920 tempest-HypervisorAdminNegativeTestJSON-1890864920-project] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.016479 Oct 19 03:13:58.415817 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 247/491] 10.222.0.52 () {58 vars in 1152 bytes} [Wed Oct 19 03:13:58 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:13:58.421622 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e40011db-5b19-4079-9d59-f5904d90b7fe tempest-HypervisorAdminNegativeTestJSON-1444511128 tempest-HypervisorAdminNegativeTestJSON-1444511128-project-admin] Calling method '.version_select at 0x7fc13136ec10>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:58.423258 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-e40011db-5b19-4079-9d59-f5904d90b7fe tempest-HypervisorAdminNegativeTestJSON-1444511128 tempest-HypervisorAdminNegativeTestJSON-1444511128-project-admin] HTTP exception thrown: Hypervisor with ID 'd7d2e22b-2132-4363-a77b-abef84769820' could not be found. Oct 19 03:13:58.426260 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e40011db-5b19-4079-9d59-f5904d90b7fe tempest-HypervisorAdminNegativeTestJSON-1444511128 tempest-HypervisorAdminNegativeTestJSON-1444511128-project-admin] Request method failure captured: Oct 19 03:13:58.426260 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/os-hypervisors/d7d2e22b-2132-4363-a77b-abef84769820 HTTP/1.1 Oct 19 03:13:58.426260 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:13:58.426260 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:13:58.426260 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:13:58.426260 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:13:58.426260 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:13:58.426260 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:13:58.426260 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:13:58.426260 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:13:58.426260 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT2tzZvnMtA5sHmZKBSx0UFGWLjHE0vF8cy-yF_LaYbt39zgjLaLo5XBYAqO1C_mFr-anv9dE_Kcy4RqAMrf1831elbOQ_kFeBD68aWX8LFM7szyluZDOXKxmtS9Q9tERnoDolXOUAs-ORjfNbYITbFeBA58yX5g5Pb2KNcSvUsZOXVU Oct 19 03:13:58.426260 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:13:58.426260 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:13:58.426260 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:13:58.426260 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:13:58.426260 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:13:58.426260 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:13:58.426260 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: faf64d87824947f6a3a41fbef63e17a6 Oct 19 03:13:58.426260 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1444511128 Oct 19 03:13:58.426260 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member,admin Oct 19 03:13:58.426260 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member,admin Oct 19 03:13:58.427571 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/faf64d87824947f6a3a41fbef63e17a6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/faf64d87824947f6a3a41fbef63e17a6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/faf64d87824947f6a3a41fbef63e17a6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_faf64d87824947f6a3a41fbef63e17a6", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:13:58.427571 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1444511128 Oct 19 03:13:58.427571 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: faf64d87824947f6a3a41fbef63e17a6 Oct 19 03:13:58.427571 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1444511128 Oct 19 03:13:58.427571 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-HypervisorAdminNegativeTestJSON-1444511128-project-admin Oct 19 03:13:58.427571 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:13:58.427571 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:13:58.427571 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 6ba8289298ea4f87946c5d21950301d1 Oct 19 03:13:58.427571 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1444511128-project-admin Oct 19 03:13:58.427571 n-d-861333-8 devstack@n-api.service[121134]: method: Oct 19 03:13:58.427571 n-d-861333-8 devstack@n-api.service[121134]: exception: Hypervisor with ID 'd7d2e22b-2132-4363-a77b-abef84769820' could not be found. Oct 19 03:13:58.427571 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': 'd7d2e22b-2132-4363-a77b-abef84769820'} Oct 19 03:13:58.428257 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:13:58.428257 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:58.428257 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 19 03:13:58.428257 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 19 03:13:58.428257 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'd7d2e22b-2132-4363-a77b-abef84769820' Oct 19 03:13:58.428257 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:13:58.428257 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:13:58.428257 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:13:58.428257 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:58.428257 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 19 03:13:58.428257 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 19 03:13:58.428257 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 19 03:13:58.428257 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 19 03:13:58.428257 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 19 03:13:58.428257 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:13:58.428257 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:13:58.428257 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:13:58.428257 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:58.428257 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 19 03:13:58.428257 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 19 03:13:58.428257 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 19 03:13:58.428257 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 19 03:13:58.429963 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 19 03:13:58.429963 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:13:58.429963 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:13:58.429963 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:13:58.429963 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:58.429963 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:13:58.429963 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:13:58.429963 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:13:58.429963 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:13:58.429963 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 03:13:58.429963 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 03:13:58.429963 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:13:58.429963 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:13:58.429963 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 19 03:13:58.429963 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 19 03:13:58.429963 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Oct 19 03:13:58.429963 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 19 03:13:58.429963 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 19 03:13:58.429963 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 19 03:13:58.429963 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'd7d2e22b-2132-4363-a77b-abef84769820' could not be found. Oct 19 03:13:58.434367 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:13:58.434367 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:13:58.434367 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:13:58.434367 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:13:58.434367 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:13:58.434367 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:13:58.434367 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:13:58.434367 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:13:58.434367 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'd7d2e22b-2132-4363-a77b-abef84769820' could not be found. Oct 19 03:13:58.434367 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:13:58.434367 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e40011db-5b19-4079-9d59-f5904d90b7fe tempest-HypervisorAdminNegativeTestJSON-1444511128 tempest-HypervisorAdminNegativeTestJSON-1444511128-project-admin] Returning 404 to user: Hypervisor with ID 'd7d2e22b-2132-4363-a77b-abef84769820' could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:13:58.434367 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e40011db-5b19-4079-9d59-f5904d90b7fe tempest-HypervisorAdminNegativeTestJSON-1444511128 tempest-HypervisorAdminNegativeTestJSON-1444511128-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/d7d2e22b-2132-4363-a77b-abef84769820" status: 404 len: 123 microversion: 2.1 time: 0.010897 Oct 19 03:13:58.434367 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 245/492] 10.222.0.52 () {58 vars in 1257 bytes} [Wed Oct 19 03:13:58 2022] GET /compute/v2.1/os-hypervisors/d7d2e22b-2132-4363-a77b-abef84769820 => generated 123 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 03:13:58.492865 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-38801ff4-7ce5-4dc1-8490-91add5f91bf1 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:58.492865 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-38801ff4-7ce5-4dc1-8490-91add5f91bf1 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] [instance: 0de5edf9-535f-41db-b32a-06d4e9b231c3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:58.500539 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-38801ff4-7ce5-4dc1-8490-91add5f91bf1 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:58.506322 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-38801ff4-7ce5-4dc1-8490-91add5f91bf1 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:58.506778 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-38801ff4-7ce5-4dc1-8490-91add5f91bf1 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:58.507522 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-38801ff4-7ce5-4dc1-8490-91add5f91bf1 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:58.509016 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-38801ff4-7ce5-4dc1-8490-91add5f91bf1 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:58.509769 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-38801ff4-7ce5-4dc1-8490-91add5f91bf1 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:58.631086 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-38801ff4-7ce5-4dc1-8490-91add5f91bf1 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ff6534c5e74a2eb179044ef833f0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e88bbb75184a59b88e533a49d63cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:58.644276 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-38801ff4-7ce5-4dc1-8490-91add5f91bf1 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] 10.222.0.52 "GET /compute/v2.1/servers/0de5edf9-535f-41db-b32a-06d4e9b231c3" status: 200 len: 1214 microversion: 2.1 time: 0.155905 Oct 19 03:13:58.645224 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 248/493] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:13:58 2022] GET /compute/v2.1/servers/0de5edf9-535f-41db-b32a-06d4e9b231c3 => generated 1214 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:13:58.906088 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9615e61b-1d22-45e7-ad98-b4f67810a5ad tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:58.906760 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9615e61b-1d22-45e7-ad98-b4f67810a5ad tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 82f8d22c-99ee-4c2b-8a36-5299c187ace7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:58.914673 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9615e61b-1d22-45e7-ad98-b4f67810a5ad tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:58.915263 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9615e61b-1d22-45e7-ad98-b4f67810a5ad tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:58.917622 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9615e61b-1d22-45e7-ad98-b4f67810a5ad tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:58.920292 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9615e61b-1d22-45e7-ad98-b4f67810a5ad tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:58.923799 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9615e61b-1d22-45e7-ad98-b4f67810a5ad tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:58.924621 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9615e61b-1d22-45e7-ad98-b4f67810a5ad tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:59.117116 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9615e61b-1d22-45e7-ad98-b4f67810a5ad tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:59.130304 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9615e61b-1d22-45e7-ad98-b4f67810a5ad tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:59.133351 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9615e61b-1d22-45e7-ad98-b4f67810a5ad tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:59.133351 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9615e61b-1d22-45e7-ad98-b4f67810a5ad tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/82f8d22c-99ee-4c2b-8a36-5299c187ace7" status: 200 len: 1362 microversion: 2.25 time: 0.232440 Oct 19 03:13:59.141136 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 246/494] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:13:58 2022] GET /compute/v2.1/servers/82f8d22c-99ee-4c2b-8a36-5299c187ace7 => generated 1362 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:13:59.179325 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d6f6700d-9034-4269-be82-553b4f691732 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:59.179946 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d6f6700d-9034-4269-be82-553b4f691732 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:59.186337 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d6f6700d-9034-4269-be82-553b4f691732 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:59.186822 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d6f6700d-9034-4269-be82-553b4f691732 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:59.187311 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d6f6700d-9034-4269-be82-553b4f691732 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:59.188406 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d6f6700d-9034-4269-be82-553b4f691732 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:59.188921 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d6f6700d-9034-4269-be82-553b4f691732 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:59.189629 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d6f6700d-9034-4269-be82-553b4f691732 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:59.264175 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d6f6700d-9034-4269-be82-553b4f691732 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:59.272652 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d6f6700d-9034-4269-be82-553b4f691732 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:59.274277 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d6f6700d-9034-4269-be82-553b4f691732 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:59.281499 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d6f6700d-9034-4269-be82-553b4f691732 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1506 microversion: 2.91 time: 0.106249 Oct 19 03:13:59.282496 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 249/495] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:13:59 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1506 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:13:59.352502 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-627bb5c0-08e2-48f6-8194-158a962b1006 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:59.353131 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-627bb5c0-08e2-48f6-8194-158a962b1006 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 7b4a8cd9-a238-4bff-a002-497dc807bf3a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:59.360672 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-627bb5c0-08e2-48f6-8194-158a962b1006 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:59.367911 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-627bb5c0-08e2-48f6-8194-158a962b1006 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:59.368627 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-627bb5c0-08e2-48f6-8194-158a962b1006 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:59.370191 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-627bb5c0-08e2-48f6-8194-158a962b1006 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:59.371829 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-627bb5c0-08e2-48f6-8194-158a962b1006 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:59.373921 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-627bb5c0-08e2-48f6-8194-158a962b1006 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:59.410368 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-bda397b1-cf99-4c2a-ac88-cffef181d6af tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:59.411254 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-bda397b1-cf99-4c2a-ac88-cffef181d6af tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] [instance: d50976fb-756b-4b12-92f2-cedf87df492d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:59.422036 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bda397b1-cf99-4c2a-ac88-cffef181d6af tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:59.422740 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bda397b1-cf99-4c2a-ac88-cffef181d6af tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:59.423227 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bda397b1-cf99-4c2a-ac88-cffef181d6af tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:59.423933 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bda397b1-cf99-4c2a-ac88-cffef181d6af tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:59.424553 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bda397b1-cf99-4c2a-ac88-cffef181d6af tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:59.425122 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bda397b1-cf99-4c2a-ac88-cffef181d6af tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:59.559237 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-bda397b1-cf99-4c2a-ac88-cffef181d6af tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:59.572935 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-bda397b1-cf99-4c2a-ac88-cffef181d6af tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:59.576884 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-bda397b1-cf99-4c2a-ac88-cffef181d6af tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:59.584328 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:13:59.599684 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-627bb5c0-08e2-48f6-8194-158a962b1006 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:59.600862 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-bda397b1-cf99-4c2a-ac88-cffef181d6af tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] 10.222.0.52 "GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d" status: 200 len: 1362 microversion: 2.75 time: 0.186394 Oct 19 03:13:59.603424 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 250/496] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:13:59 2022] GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d => generated 1362 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:13:59.624931 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-627bb5c0-08e2-48f6-8194-158a962b1006 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a" status: 200 len: 1471 microversion: 2.1 time: 0.269507 Oct 19 03:13:59.624931 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 247/497] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:13:59 2022] GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a => generated 1471 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:13:59.673797 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c260c855-70a8-4430-94cd-04bf501c3d60 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:59.674837 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c260c855-70a8-4430-94cd-04bf501c3d60 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] [instance: 0de5edf9-535f-41db-b32a-06d4e9b231c3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:13:59.689615 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c260c855-70a8-4430-94cd-04bf501c3d60 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:59.689615 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c260c855-70a8-4430-94cd-04bf501c3d60 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:59.690317 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c260c855-70a8-4430-94cd-04bf501c3d60 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:59.691057 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c260c855-70a8-4430-94cd-04bf501c3d60 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:59.691514 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c260c855-70a8-4430-94cd-04bf501c3d60 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:59.692042 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c260c855-70a8-4430-94cd-04bf501c3d60 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:59.772191 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c260c855-70a8-4430-94cd-04bf501c3d60 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ff6534c5e74a2eb179044ef833f0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e88bbb75184a59b88e533a49d63cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:13:59.794040 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c260c855-70a8-4430-94cd-04bf501c3d60 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] 10.222.0.52 "GET /compute/v2.1/servers/0de5edf9-535f-41db-b32a-06d4e9b231c3" status: 200 len: 1270 microversion: 2.1 time: 0.115428 Oct 19 03:13:59.798356 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 248/498] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:13:59 2022] GET /compute/v2.1/servers/0de5edf9-535f-41db-b32a-06d4e9b231c3 => generated 1270 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:13:59.804244 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a2941bd8-a75f-4a51-b2f9-d58a7c3e10ae tempest-QuotasAdminNegativeTest-809443552 tempest-QuotasAdminNegativeTest-809443552-project-admin] Calling method '.version_select at 0x7fc131526ee0>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:13:59.923287 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-3690bc5b-3d3b-4240-8976-7fb7e33a791b req-b96e2f9c-85e7-4319-bacd-dd8c16662114 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b4a8cd9-a238-4bff-a002-497dc807bf3a", "name": "network-vif-plugged", "status": "completed", "tag": "f0926ecc-fbd5-457e-bf81-de5bfd5b6a96"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:13:59.931720 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a2941bd8-a75f-4a51-b2f9-d58a7c3e10ae tempest-QuotasAdminNegativeTest-809443552 tempest-QuotasAdminNegativeTest-809443552-project-admin] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/d37b8a49338640779c428043229f47f7" status: 200 len: 371 microversion: 2.1 time: 0.326896 Oct 19 03:13:59.933539 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 251/499] 10.222.0.52 () {58 vars in 1242 bytes} [Wed Oct 19 03:13:59 2022] GET /compute/v2.1/os-quota-sets/d37b8a49338640779c428043229f47f7 => generated 371 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:13:59.934470 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-3690bc5b-3d3b-4240-8976-7fb7e33a791b req-b96e2f9c-85e7-4319-bacd-dd8c16662114 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:13:59.934952 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-3690bc5b-3d3b-4240-8976-7fb7e33a791b req-b96e2f9c-85e7-4319-bacd-dd8c16662114 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:13:59.935386 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-3690bc5b-3d3b-4240-8976-7fb7e33a791b req-b96e2f9c-85e7-4319-bacd-dd8c16662114 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:13:59.945658 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e02a712a-d859-4508-bf3d-c83f6738e204 tempest-QuotasAdminNegativeTest-809443552 tempest-QuotasAdminNegativeTest-809443552-project-admin] Action: 'update', calling method: .version_select at 0x7fc131505a60>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:13:59.949434 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-3690bc5b-3d3b-4240-8976-7fb7e33a791b req-b96e2f9c-85e7-4319-bacd-dd8c16662114 service nova] Creating event network-vif-plugged:f0926ecc-fbd5-457e-bf81-de5bfd5b6a96 for instance 7b4a8cd9-a238-4bff-a002-497dc807bf3a on n-h2-861333-8 Oct 19 03:13:59.958612 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [req-3690bc5b-3d3b-4240-8976-7fb7e33a791b req-b96e2f9c-85e7-4319-bacd-dd8c16662114 service nova] Instance 7b4a8cd9-a238-4bff-a002-497dc807bf3a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-861333-8', 'n-h1-861333-8'} {{(pid=121134) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 03:13:59.973677 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-3690bc5b-3d3b-4240-8976-7fb7e33a791b req-b96e2f9c-85e7-4319-bacd-dd8c16662114 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055694 Oct 19 03:13:59.979365 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 249/500] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:13:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:14:00.047863 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e02a712a-d859-4508-bf3d-c83f6738e204 tempest-QuotasAdminNegativeTest-809443552 tempest-QuotasAdminNegativeTest-809443552-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:00.048465 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e02a712a-d859-4508-bf3d-c83f6738e204 tempest-QuotasAdminNegativeTest-809443552 tempest-QuotasAdminNegativeTest-809443552-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:00.048968 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e02a712a-d859-4508-bf3d-c83f6738e204 tempest-QuotasAdminNegativeTest-809443552 tempest-QuotasAdminNegativeTest-809443552-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:00.049862 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e02a712a-d859-4508-bf3d-c83f6738e204 tempest-QuotasAdminNegativeTest-809443552 tempest-QuotasAdminNegativeTest-809443552-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:00.050387 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e02a712a-d859-4508-bf3d-c83f6738e204 tempest-QuotasAdminNegativeTest-809443552 tempest-QuotasAdminNegativeTest-809443552-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:00.050931 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e02a712a-d859-4508-bf3d-c83f6738e204 tempest-QuotasAdminNegativeTest-809443552 tempest-QuotasAdminNegativeTest-809443552-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:00.165480 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-fe430ee3-ca5e-46fb-95cc-d5e8a69f5264 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:00.166384 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-fe430ee3-ca5e-46fb-95cc-d5e8a69f5264 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 82f8d22c-99ee-4c2b-8a36-5299c187ace7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:00.173196 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fe430ee3-ca5e-46fb-95cc-d5e8a69f5264 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:00.173746 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fe430ee3-ca5e-46fb-95cc-d5e8a69f5264 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:00.174179 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fe430ee3-ca5e-46fb-95cc-d5e8a69f5264 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:00.178528 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fe430ee3-ca5e-46fb-95cc-d5e8a69f5264 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:00.178528 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fe430ee3-ca5e-46fb-95cc-d5e8a69f5264 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:00.178528 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fe430ee3-ca5e-46fb-95cc-d5e8a69f5264 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:00.179714 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e02a712a-d859-4508-bf3d-c83f6738e204 tempest-QuotasAdminNegativeTest-809443552 tempest-QuotasAdminNegativeTest-809443552-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-quota-sets/d37b8a49338640779c428043229f47f7" status: 200 len: 328 microversion: 2.1 time: 0.237966 Oct 19 03:14:00.180353 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 252/501] 10.222.0.52 () {60 vars in 1262 bytes} [Wed Oct 19 03:13:59 2022] PUT /compute/v2.1/os-quota-sets/d37b8a49338640779c428043229f47f7 => generated 328 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:14:00.315039 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-62f5e0df-5590-4a08-86d5-ef328ccfe7d6 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:00.315039 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-62f5e0df-5590-4a08-86d5-ef328ccfe7d6 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:00.325224 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-62f5e0df-5590-4a08-86d5-ef328ccfe7d6 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:00.331690 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-62f5e0df-5590-4a08-86d5-ef328ccfe7d6 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:00.331690 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-62f5e0df-5590-4a08-86d5-ef328ccfe7d6 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:00.332079 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-62f5e0df-5590-4a08-86d5-ef328ccfe7d6 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:00.332629 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-62f5e0df-5590-4a08-86d5-ef328ccfe7d6 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:00.333132 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-62f5e0df-5590-4a08-86d5-ef328ccfe7d6 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:00.374474 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-fe430ee3-ca5e-46fb-95cc-d5e8a69f5264 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:00.382791 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-fe430ee3-ca5e-46fb-95cc-d5e8a69f5264 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:00.384938 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-fe430ee3-ca5e-46fb-95cc-d5e8a69f5264 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:00.386090 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-fe430ee3-ca5e-46fb-95cc-d5e8a69f5264 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/82f8d22c-99ee-4c2b-8a36-5299c187ace7" status: 200 len: 1362 microversion: 2.25 time: 0.224882 Oct 19 03:14:00.386639 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 250/502] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:00 2022] GET /compute/v2.1/servers/82f8d22c-99ee-4c2b-8a36-5299c187ace7 => generated 1362 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:14:00.431791 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-62f5e0df-5590-4a08-86d5-ef328ccfe7d6 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:00.443136 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-62f5e0df-5590-4a08-86d5-ef328ccfe7d6 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:00.444768 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-62f5e0df-5590-4a08-86d5-ef328ccfe7d6 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:00.450057 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-62f5e0df-5590-4a08-86d5-ef328ccfe7d6 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1512 microversion: 2.91 time: 0.143012 Oct 19 03:14:00.450727 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 253/503] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:00 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1512 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:14:00.520155 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-efd94f1f-ca95-4713-a46a-d169d99c6a70 tempest-QuotasAdminNegativeTest-240364843 tempest-QuotasAdminNegativeTest-240364843-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-490600557", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:14:00.580891 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-efd94f1f-ca95-4713-a46a-d169d99c6a70 tempest-QuotasAdminNegativeTest-240364843 tempest-QuotasAdminNegativeTest-240364843-project] validate_networks() for None {{(pid=121134) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:14:00.632752 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ce81bf38-4958-4731-a5d8-244b6aabeb41 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:00.633271 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ce81bf38-4958-4731-a5d8-244b6aabeb41 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] [instance: d50976fb-756b-4b12-92f2-cedf87df492d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:00.639604 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ce81bf38-4958-4731-a5d8-244b6aabeb41 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:00.640099 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ce81bf38-4958-4731-a5d8-244b6aabeb41 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:00.640530 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ce81bf38-4958-4731-a5d8-244b6aabeb41 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:00.641230 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ce81bf38-4958-4731-a5d8-244b6aabeb41 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:00.641680 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ce81bf38-4958-4731-a5d8-244b6aabeb41 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:00.642254 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ce81bf38-4958-4731-a5d8-244b6aabeb41 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:00.740805 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ce81bf38-4958-4731-a5d8-244b6aabeb41 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:00.753219 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ce81bf38-4958-4731-a5d8-244b6aabeb41 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:00.755005 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ce81bf38-4958-4731-a5d8-244b6aabeb41 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:00.766731 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ce81bf38-4958-4731-a5d8-244b6aabeb41 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] 10.222.0.52 "GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d" status: 200 len: 1354 microversion: 2.75 time: 0.138288 Oct 19 03:14:00.767572 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 254/504] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:00 2022] GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d => generated 1354 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:14:00.773003 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ca1692dd-b698-4af9-afd8-f4c837530ba5 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:00.774013 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ca1692dd-b698-4af9-afd8-f4c837530ba5 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 7b4a8cd9-a238-4bff-a002-497dc807bf3a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:00.782830 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ca1692dd-b698-4af9-afd8-f4c837530ba5 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:00.783211 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ca1692dd-b698-4af9-afd8-f4c837530ba5 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:00.783812 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ca1692dd-b698-4af9-afd8-f4c837530ba5 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:00.784771 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ca1692dd-b698-4af9-afd8-f4c837530ba5 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:00.785401 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ca1692dd-b698-4af9-afd8-f4c837530ba5 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:00.786499 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ca1692dd-b698-4af9-afd8-f4c837530ba5 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:00.867308 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-efd94f1f-ca95-4713-a46a-d169d99c6a70 tempest-QuotasAdminNegativeTest-240364843 tempest-QuotasAdminNegativeTest-240364843-project] Flavor limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:14:00.867931 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-efd94f1f-ca95-4713-a46a-d169d99c6a70 tempest-QuotasAdminNegativeTest-240364843 tempest-QuotasAdminNegativeTest-240364843-project] Image limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:14:00.868399 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-efd94f1f-ca95-4713-a46a-d169d99c6a70 tempest-QuotasAdminNegativeTest-240364843 tempest-QuotasAdminNegativeTest-240364843-project] Flavor pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:14:00.868807 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-efd94f1f-ca95-4713-a46a-d169d99c6a70 tempest-QuotasAdminNegativeTest-240364843 tempest-QuotasAdminNegativeTest-240364843-project] Image pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:14:00.869361 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-efd94f1f-ca95-4713-a46a-d169d99c6a70 tempest-QuotasAdminNegativeTest-240364843 tempest-QuotasAdminNegativeTest-240364843-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:14:00.878986 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-efd94f1f-ca95-4713-a46a-d169d99c6a70 tempest-QuotasAdminNegativeTest-240364843 tempest-QuotasAdminNegativeTest-240364843-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:00.879687 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-efd94f1f-ca95-4713-a46a-d169d99c6a70 tempest-QuotasAdminNegativeTest-240364843 tempest-QuotasAdminNegativeTest-240364843-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:00.880275 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-efd94f1f-ca95-4713-a46a-d169d99c6a70 tempest-QuotasAdminNegativeTest-240364843 tempest-QuotasAdminNegativeTest-240364843-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:00.884637 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-efd94f1f-ca95-4713-a46a-d169d99c6a70 tempest-QuotasAdminNegativeTest-240364843 tempest-QuotasAdminNegativeTest-240364843-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:00.884637 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-efd94f1f-ca95-4713-a46a-d169d99c6a70 tempest-QuotasAdminNegativeTest-240364843 tempest-QuotasAdminNegativeTest-240364843-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:00.884637 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-efd94f1f-ca95-4713-a46a-d169d99c6a70 tempest-QuotasAdminNegativeTest-240364843 tempest-QuotasAdminNegativeTest-240364843-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:00.903450 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-efd94f1f-ca95-4713-a46a-d169d99c6a70 tempest-QuotasAdminNegativeTest-240364843 tempest-QuotasAdminNegativeTest-240364843-project] Getting quotas for project d37b8a49338640779c428043229f47f7. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:14:00.907601 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-efd94f1f-ca95-4713-a46a-d169d99c6a70 tempest-QuotasAdminNegativeTest-240364843 tempest-QuotasAdminNegativeTest-240364843-project] Getting quotas for user bc66b39112a745fbb09c74d97cd55732 and project d37b8a49338640779c428043229f47f7. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:14:00.919779 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.utils [None req-efd94f1f-ca95-4713-a46a-d169d99c6a70 tempest-QuotasAdminNegativeTest-240364843 tempest-QuotasAdminNegativeTest-240364843-project] cores quota exceeded for d37b8a49338640779c428043229f47f7, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=121134) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 19 03:14:00.921327 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-efd94f1f-ca95-4713-a46a-d169d99c6a70 tempest-QuotasAdminNegativeTest-240364843 tempest-QuotasAdminNegativeTest-240364843-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 19 03:14:00.925774 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-efd94f1f-ca95-4713-a46a-d169d99c6a70 tempest-QuotasAdminNegativeTest-240364843 tempest-QuotasAdminNegativeTest-240364843-project] Request method failure captured: Oct 19 03:14:00.925774 n-d-861333-8 devstack@n-api.service[121134]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 19 03:14:00.925774 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:14:00.925774 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:14:00.925774 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:14:00.925774 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 144 Oct 19 03:14:00.925774 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:14:00.925774 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:14:00.925774 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:14:00.925774 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:14:00.925774 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT2t2c5ncmUCKJrfA9GnmM0dh0Qn1GPGj85PoJtvOp8pOql6BXa72SBiydLu3Mnx7MXzSF_j6ZiUjR7S4L-N6u_d7NCqJus97nJnpmt-CuZMBNfJdN6C-wbU5ZpAzTNijfrowTZq7cYpd0a71OG4VdQGqsu2_dafzaCVsBhYRwcs9Q2U Oct 19 03:14:00.925774 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:14:00.925774 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:14:00.925774 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:14:00.925774 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:14:00.925774 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:14:00.925774 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:14:00.925774 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: d37b8a49338640779c428043229f47f7 Oct 19 03:14:00.925774 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-QuotasAdminNegativeTest-240364843 Oct 19 03:14:00.925774 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:14:00.925774 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:14:00.927698 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d37b8a49338640779c428043229f47f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d37b8a49338640779c428043229f47f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d37b8a49338640779c428043229f47f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d37b8a49338640779c428043229f47f7", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:14:00.927698 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-QuotasAdminNegativeTest-240364843 Oct 19 03:14:00.927698 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: d37b8a49338640779c428043229f47f7 Oct 19 03:14:00.927698 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-240364843 Oct 19 03:14:00.927698 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-QuotasAdminNegativeTest-240364843-project Oct 19 03:14:00.927698 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:14:00.927698 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:14:00.927698 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: bc66b39112a745fbb09c74d97cd55732 Oct 19 03:14:00.927698 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-QuotasAdminNegativeTest-240364843-project Oct 19 03:14:00.927698 n-d-861333-8 devstack@n-api.service[121134]: Oct 19 03:14:00.927698 n-d-861333-8 devstack@n-api.service[121134]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-490600557", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452"}} Oct 19 03:14:00.927698 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:14:00.928661 n-d-861333-8 devstack@n-api.service[121134]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 19 03:14:00.928661 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-490600557', 'imageRef': '9e16d73e-70ea-4421-aee3-047d80396c02', 'flavorRef': '452'}}} Oct 19 03:14:00.928661 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:14:00.928661 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:14:00.928661 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 19 03:14:00.928661 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 19 03:14:00.928661 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 03:14:00.928661 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 03:14:00.928661 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 19 03:14:00.928661 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc Oct 19 03:14:00.928661 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 19 03:14:00.928661 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 19 03:14:00.928661 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 03:14:00.928661 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 03:14:00.928661 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 19 03:14:00.928661 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 19 03:14:00.928661 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 19 03:14:00.928661 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 19 03:14:00.929950 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 19 03:14:00.929950 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 19 03:14:00.929950 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 19 03:14:00.929950 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:14:00.929950 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:14:00.929950 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:14:00.929950 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:14:00.929950 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 19 03:14:00.929950 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 19 03:14:00.929950 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 19 03:14:00.929950 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 19 03:14:00.929950 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 19 03:14:00.929950 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 19 03:14:00.929950 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 19 03:14:00.929950 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 19 03:14:00.929950 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 19 03:14:00.929950 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 19 03:14:00.929950 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 19 03:14:00.929950 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:14:00.929950 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:14:00.929950 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:14:00.931621 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:14:00.931621 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:14:00.931621 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:14:00.931621 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:14:00.931621 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:14:00.931621 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:14:00.931621 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:14:00.931621 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:14:00.931621 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:14:00.931621 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:14:00.931621 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:14:00.931621 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:14:00.931621 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:14:00.931621 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 19 03:14:00.931621 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 19 03:14:00.931621 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 19 03:14:00.931621 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 19 03:14:00.931621 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:14:00.931621 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:14:00.931621 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:14:00.931621 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:14:00.933255 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:14:00.933255 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:14:00.933255 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:14:00.933255 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:14:00.933255 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 19 03:14:00.933255 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:14:00.935660 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-efd94f1f-ca95-4713-a46a-d169d99c6a70 tempest-QuotasAdminNegativeTest-240364843 tempest-QuotasAdminNegativeTest-240364843-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:14:00.936691 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-efd94f1f-ca95-4713-a46a-d169d99c6a70 tempest-QuotasAdminNegativeTest-240364843 tempest-QuotasAdminNegativeTest-240364843-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 0.548946 Oct 19 03:14:00.941953 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 251/505] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:14:00 2022] POST /compute/v2.1/servers => generated 111 bytes in 554 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:14:00.946189 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c616f81d-f7ce-4d1f-895d-3f730cb10fea tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:00.947063 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c616f81d-f7ce-4d1f-895d-3f730cb10fea tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] [instance: 0de5edf9-535f-41db-b32a-06d4e9b231c3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:00.954173 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c616f81d-f7ce-4d1f-895d-3f730cb10fea tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:00.954652 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c616f81d-f7ce-4d1f-895d-3f730cb10fea tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:00.955098 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c616f81d-f7ce-4d1f-895d-3f730cb10fea tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:00.955801 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c616f81d-f7ce-4d1f-895d-3f730cb10fea tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:00.956253 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c616f81d-f7ce-4d1f-895d-3f730cb10fea tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:00.956679 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c616f81d-f7ce-4d1f-895d-3f730cb10fea tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:00.983362 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ca1692dd-b698-4af9-afd8-f4c837530ba5 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:00.992786 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ca1692dd-b698-4af9-afd8-f4c837530ba5 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a" status: 200 len: 1471 microversion: 2.1 time: 0.223915 Oct 19 03:14:00.995480 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 255/506] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:00 2022] GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a => generated 1471 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:14:00.998770 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f3a858c3-a138-4966-9f35-bc20a49e36b4 tempest-QuotasAdminNegativeTest-809443552 tempest-QuotasAdminNegativeTest-809443552-project-admin] Action: 'update', calling method: .version_select at 0x7fc1314d40d0>, body: {"quota_set": {"cores": 20}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:14:01.032846 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c616f81d-f7ce-4d1f-895d-3f730cb10fea tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ff6534c5e74a2eb179044ef833f0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e88bbb75184a59b88e533a49d63cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:01.042390 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c616f81d-f7ce-4d1f-895d-3f730cb10fea tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] 10.222.0.52 "GET /compute/v2.1/servers/0de5edf9-535f-41db-b32a-06d4e9b231c3" status: 200 len: 1278 microversion: 2.1 time: 0.099338 Oct 19 03:14:01.043640 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 252/507] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:00 2022] GET /compute/v2.1/servers/0de5edf9-535f-41db-b32a-06d4e9b231c3 => generated 1278 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:14:01.219862 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f3a858c3-a138-4966-9f35-bc20a49e36b4 tempest-QuotasAdminNegativeTest-809443552 tempest-QuotasAdminNegativeTest-809443552-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:01.220343 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f3a858c3-a138-4966-9f35-bc20a49e36b4 tempest-QuotasAdminNegativeTest-809443552 tempest-QuotasAdminNegativeTest-809443552-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:01.220768 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f3a858c3-a138-4966-9f35-bc20a49e36b4 tempest-QuotasAdminNegativeTest-809443552 tempest-QuotasAdminNegativeTest-809443552-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:01.221510 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f3a858c3-a138-4966-9f35-bc20a49e36b4 tempest-QuotasAdminNegativeTest-809443552 tempest-QuotasAdminNegativeTest-809443552-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:01.221981 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f3a858c3-a138-4966-9f35-bc20a49e36b4 tempest-QuotasAdminNegativeTest-809443552 tempest-QuotasAdminNegativeTest-809443552-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:01.222439 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f3a858c3-a138-4966-9f35-bc20a49e36b4 tempest-QuotasAdminNegativeTest-809443552 tempest-QuotasAdminNegativeTest-809443552-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:01.396507 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f3a858c3-a138-4966-9f35-bc20a49e36b4 tempest-QuotasAdminNegativeTest-809443552 tempest-QuotasAdminNegativeTest-809443552-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-quota-sets/d37b8a49338640779c428043229f47f7" status: 200 len: 329 microversion: 2.1 time: 0.401936 Oct 19 03:14:01.397221 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 256/508] 10.222.0.52 () {60 vars in 1262 bytes} [Wed Oct 19 03:14:00 2022] PUT /compute/v2.1/os-quota-sets/d37b8a49338640779c428043229f47f7 => generated 329 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:14:01.412130 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ef0e0e0c-c009-498e-80ad-2d1536ead1e7 tempest-QuotasAdminNegativeTest-809443552 tempest-QuotasAdminNegativeTest-809443552-project-admin] Calling method '.version_select at 0x7fc1314ba160>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:01.414420 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0fed1e08-bbe8-4f43-883b-39e009f54d63 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:01.415033 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0fed1e08-bbe8-4f43-883b-39e009f54d63 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 82f8d22c-99ee-4c2b-8a36-5299c187ace7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:01.422641 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0fed1e08-bbe8-4f43-883b-39e009f54d63 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:01.430904 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0fed1e08-bbe8-4f43-883b-39e009f54d63 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:01.430904 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0fed1e08-bbe8-4f43-883b-39e009f54d63 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:01.430904 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0fed1e08-bbe8-4f43-883b-39e009f54d63 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:01.430904 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0fed1e08-bbe8-4f43-883b-39e009f54d63 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:01.431280 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0fed1e08-bbe8-4f43-883b-39e009f54d63 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:01.598949 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ef0e0e0c-c009-498e-80ad-2d1536ead1e7 tempest-QuotasAdminNegativeTest-809443552 tempest-QuotasAdminNegativeTest-809443552-project-admin] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/d37b8a49338640779c428043229f47f7" status: 200 len: 371 microversion: 2.1 time: 0.190676 Oct 19 03:14:01.599545 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 253/509] 10.222.0.52 () {58 vars in 1242 bytes} [Wed Oct 19 03:14:01 2022] GET /compute/v2.1/os-quota-sets/d37b8a49338640779c428043229f47f7 => generated 371 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:14:01.601490 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-0fed1e08-bbe8-4f43-883b-39e009f54d63 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:01.611098 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6e2fae30-636b-4115-9283-ae8b7fb2394a tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:01.611687 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6e2fae30-636b-4115-9283-ae8b7fb2394a tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:01.618068 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6e2fae30-636b-4115-9283-ae8b7fb2394a tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:01.618750 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6e2fae30-636b-4115-9283-ae8b7fb2394a tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:01.619191 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6e2fae30-636b-4115-9283-ae8b7fb2394a tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:01.619327 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-0fed1e08-bbe8-4f43-883b-39e009f54d63 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:01.619891 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6e2fae30-636b-4115-9283-ae8b7fb2394a tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:01.620345 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6e2fae30-636b-4115-9283-ae8b7fb2394a tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:01.620637 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-0fed1e08-bbe8-4f43-883b-39e009f54d63 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:01.620759 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6e2fae30-636b-4115-9283-ae8b7fb2394a tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:01.622338 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0fed1e08-bbe8-4f43-883b-39e009f54d63 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/82f8d22c-99ee-4c2b-8a36-5299c187ace7" status: 200 len: 1362 microversion: 2.25 time: 0.211848 Oct 19 03:14:01.622887 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 257/510] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:01 2022] GET /compute/v2.1/servers/82f8d22c-99ee-4c2b-8a36-5299c187ace7 => generated 1362 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:14:01.636438 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f74c5715-5c06-4840-b86a-6c978cbe6102 tempest-QuotasAdminNegativeTest-809443552 tempest-QuotasAdminNegativeTest-809443552-project-admin] Action: 'update', calling method: .version_select at 0x7fc1314cab80>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:14:01.776585 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-6e2fae30-636b-4115-9283-ae8b7fb2394a tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:01.784828 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-6e2fae30-636b-4115-9283-ae8b7fb2394a tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:01.790756 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-6e2fae30-636b-4115-9283-ae8b7fb2394a tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:01.807884 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6e2fae30-636b-4115-9283-ae8b7fb2394a tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1512 microversion: 2.91 time: 0.201217 Oct 19 03:14:01.822886 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 254/511] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:01 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1512 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:14:01.822886 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-29e4eb79-bde8-4282-839a-03a08e53cba1 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:01.822886 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-29e4eb79-bde8-4282-839a-03a08e53cba1 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] [instance: d50976fb-756b-4b12-92f2-cedf87df492d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:01.841785 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-29e4eb79-bde8-4282-839a-03a08e53cba1 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:01.842617 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-29e4eb79-bde8-4282-839a-03a08e53cba1 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:01.844594 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-29e4eb79-bde8-4282-839a-03a08e53cba1 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:01.845815 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-29e4eb79-bde8-4282-839a-03a08e53cba1 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:01.847354 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-29e4eb79-bde8-4282-839a-03a08e53cba1 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:01.849253 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-29e4eb79-bde8-4282-839a-03a08e53cba1 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:01.866552 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f74c5715-5c06-4840-b86a-6c978cbe6102 tempest-QuotasAdminNegativeTest-809443552 tempest-QuotasAdminNegativeTest-809443552-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:01.867095 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f74c5715-5c06-4840-b86a-6c978cbe6102 tempest-QuotasAdminNegativeTest-809443552 tempest-QuotasAdminNegativeTest-809443552-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:01.867530 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f74c5715-5c06-4840-b86a-6c978cbe6102 tempest-QuotasAdminNegativeTest-809443552 tempest-QuotasAdminNegativeTest-809443552-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:01.872526 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f74c5715-5c06-4840-b86a-6c978cbe6102 tempest-QuotasAdminNegativeTest-809443552 tempest-QuotasAdminNegativeTest-809443552-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:01.872526 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f74c5715-5c06-4840-b86a-6c978cbe6102 tempest-QuotasAdminNegativeTest-809443552 tempest-QuotasAdminNegativeTest-809443552-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:01.872526 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f74c5715-5c06-4840-b86a-6c978cbe6102 tempest-QuotasAdminNegativeTest-809443552 tempest-QuotasAdminNegativeTest-809443552-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:01.943243 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-29e4eb79-bde8-4282-839a-03a08e53cba1 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:01.955492 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-29e4eb79-bde8-4282-839a-03a08e53cba1 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:01.957077 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-29e4eb79-bde8-4282-839a-03a08e53cba1 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:01.962611 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-29e4eb79-bde8-4282-839a-03a08e53cba1 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] 10.222.0.52 "GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d" status: 200 len: 1354 microversion: 2.75 time: 0.152032 Oct 19 03:14:01.963388 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 255/512] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:01 2022] GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d => generated 1354 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:14:01.998165 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-b34ccce3-04b7-43fa-af82-f503d0d28fd0 req-377921e4-b3da-4e01-b9de-106aa5ce97fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82f8d22c-99ee-4c2b-8a36-5299c187ace7", "name": "network-vif-plugged", "status": "completed", "tag": "dfc9deee-726a-4739-85f8-2d1374704cd1"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:14:02.013722 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-b34ccce3-04b7-43fa-af82-f503d0d28fd0 req-377921e4-b3da-4e01-b9de-106aa5ce97fc service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:02.014277 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-b34ccce3-04b7-43fa-af82-f503d0d28fd0 req-377921e4-b3da-4e01-b9de-106aa5ce97fc service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:02.014823 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-b34ccce3-04b7-43fa-af82-f503d0d28fd0 req-377921e4-b3da-4e01-b9de-106aa5ce97fc service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:02.029501 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-b34ccce3-04b7-43fa-af82-f503d0d28fd0 req-377921e4-b3da-4e01-b9de-106aa5ce97fc service nova] Creating event network-vif-plugged:dfc9deee-726a-4739-85f8-2d1374704cd1 for instance 82f8d22c-99ee-4c2b-8a36-5299c187ace7 on n-h2-861333-8 Oct 19 03:14:02.035227 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-b34ccce3-04b7-43fa-af82-f503d0d28fd0 req-377921e4-b3da-4e01-b9de-106aa5ce97fc service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041338 Oct 19 03:14:02.037564 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 256/513] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:14:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:14:02.041623 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c4af178a-235e-491c-b2b5-4c4f618321ad tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:02.042332 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c4af178a-235e-491c-b2b5-4c4f618321ad tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 7b4a8cd9-a238-4bff-a002-497dc807bf3a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:02.049897 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c4af178a-235e-491c-b2b5-4c4f618321ad tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:02.050397 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c4af178a-235e-491c-b2b5-4c4f618321ad tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:02.050840 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c4af178a-235e-491c-b2b5-4c4f618321ad tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:02.051553 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c4af178a-235e-491c-b2b5-4c4f618321ad tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:02.052016 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c4af178a-235e-491c-b2b5-4c4f618321ad tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:02.052452 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c4af178a-235e-491c-b2b5-4c4f618321ad tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:02.058062 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f74c5715-5c06-4840-b86a-6c978cbe6102 tempest-QuotasAdminNegativeTest-809443552 tempest-QuotasAdminNegativeTest-809443552-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-quota-sets/d37b8a49338640779c428043229f47f7" status: 200 len: 328 microversion: 2.1 time: 0.412500 Oct 19 03:14:02.060169 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 258/514] 10.222.0.52 () {60 vars in 1262 bytes} [Wed Oct 19 03:14:01 2022] PUT /compute/v2.1/os-quota-sets/d37b8a49338640779c428043229f47f7 => generated 328 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:14:02.095445 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4839c28d-f92e-47ed-b7ba-36348d5d5431 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:02.098114 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4839c28d-f92e-47ed-b7ba-36348d5d5431 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] [instance: 0de5edf9-535f-41db-b32a-06d4e9b231c3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:02.111976 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4839c28d-f92e-47ed-b7ba-36348d5d5431 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:02.113760 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4839c28d-f92e-47ed-b7ba-36348d5d5431 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:02.113760 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4839c28d-f92e-47ed-b7ba-36348d5d5431 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:02.113760 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4839c28d-f92e-47ed-b7ba-36348d5d5431 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:02.114865 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4839c28d-f92e-47ed-b7ba-36348d5d5431 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:02.115431 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4839c28d-f92e-47ed-b7ba-36348d5d5431 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:02.330170 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c4af178a-235e-491c-b2b5-4c4f618321ad tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:02.332615 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:14:02.338880 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c4af178a-235e-491c-b2b5-4c4f618321ad tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a" status: 200 len: 1471 microversion: 2.1 time: 0.301540 Oct 19 03:14:02.339530 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 257/515] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:02 2022] GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a => generated 1471 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:14:02.345260 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b813b868-9ae3-48e2-af0b-7e19e2d82224 tempest-QuotasAdminNegativeTest-240364843 tempest-QuotasAdminNegativeTest-240364843-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-19474772", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:14:02.349724 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4839c28d-f92e-47ed-b7ba-36348d5d5431 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ff6534c5e74a2eb179044ef833f0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e88bbb75184a59b88e533a49d63cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:02.359573 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4839c28d-f92e-47ed-b7ba-36348d5d5431 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] 10.222.0.52 "GET /compute/v2.1/servers/0de5edf9-535f-41db-b32a-06d4e9b231c3" status: 200 len: 1330 microversion: 2.1 time: 0.279450 Oct 19 03:14:02.360351 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 259/516] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:02 2022] GET /compute/v2.1/servers/0de5edf9-535f-41db-b32a-06d4e9b231c3 => generated 1330 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:14:02.398960 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-b813b868-9ae3-48e2-af0b-7e19e2d82224 tempest-QuotasAdminNegativeTest-240364843 tempest-QuotasAdminNegativeTest-240364843-project] validate_networks() for None {{(pid=121134) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:14:02.596474 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-b813b868-9ae3-48e2-af0b-7e19e2d82224 tempest-QuotasAdminNegativeTest-240364843 tempest-QuotasAdminNegativeTest-240364843-project] Flavor limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:14:02.596951 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-b813b868-9ae3-48e2-af0b-7e19e2d82224 tempest-QuotasAdminNegativeTest-240364843 tempest-QuotasAdminNegativeTest-240364843-project] Image limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:14:02.597396 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-b813b868-9ae3-48e2-af0b-7e19e2d82224 tempest-QuotasAdminNegativeTest-240364843 tempest-QuotasAdminNegativeTest-240364843-project] Flavor pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:14:02.597817 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-b813b868-9ae3-48e2-af0b-7e19e2d82224 tempest-QuotasAdminNegativeTest-240364843 tempest-QuotasAdminNegativeTest-240364843-project] Image pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:14:02.598235 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-b813b868-9ae3-48e2-af0b-7e19e2d82224 tempest-QuotasAdminNegativeTest-240364843 tempest-QuotasAdminNegativeTest-240364843-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:14:02.607010 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b813b868-9ae3-48e2-af0b-7e19e2d82224 tempest-QuotasAdminNegativeTest-240364843 tempest-QuotasAdminNegativeTest-240364843-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:02.607493 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b813b868-9ae3-48e2-af0b-7e19e2d82224 tempest-QuotasAdminNegativeTest-240364843 tempest-QuotasAdminNegativeTest-240364843-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:02.607931 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b813b868-9ae3-48e2-af0b-7e19e2d82224 tempest-QuotasAdminNegativeTest-240364843 tempest-QuotasAdminNegativeTest-240364843-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:02.608659 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b813b868-9ae3-48e2-af0b-7e19e2d82224 tempest-QuotasAdminNegativeTest-240364843 tempest-QuotasAdminNegativeTest-240364843-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:02.609116 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b813b868-9ae3-48e2-af0b-7e19e2d82224 tempest-QuotasAdminNegativeTest-240364843 tempest-QuotasAdminNegativeTest-240364843-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:02.609571 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b813b868-9ae3-48e2-af0b-7e19e2d82224 tempest-QuotasAdminNegativeTest-240364843 tempest-QuotasAdminNegativeTest-240364843-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:02.626165 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-b813b868-9ae3-48e2-af0b-7e19e2d82224 tempest-QuotasAdminNegativeTest-240364843 tempest-QuotasAdminNegativeTest-240364843-project] Getting quotas for project d37b8a49338640779c428043229f47f7. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:14:02.630087 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-b813b868-9ae3-48e2-af0b-7e19e2d82224 tempest-QuotasAdminNegativeTest-240364843 tempest-QuotasAdminNegativeTest-240364843-project] Getting quotas for user bc66b39112a745fbb09c74d97cd55732 and project d37b8a49338640779c428043229f47f7. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:14:02.641528 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.utils [None req-b813b868-9ae3-48e2-af0b-7e19e2d82224 tempest-QuotasAdminNegativeTest-240364843 tempest-QuotasAdminNegativeTest-240364843-project] instances quota exceeded for d37b8a49338640779c428043229f47f7, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=121134) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 19 03:14:02.642070 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-b813b868-9ae3-48e2-af0b-7e19e2d82224 tempest-QuotasAdminNegativeTest-240364843 tempest-QuotasAdminNegativeTest-240364843-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 19 03:14:02.644401 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b813b868-9ae3-48e2-af0b-7e19e2d82224 tempest-QuotasAdminNegativeTest-240364843 tempest-QuotasAdminNegativeTest-240364843-project] Request method failure captured: Oct 19 03:14:02.644401 n-d-861333-8 devstack@n-api.service[121134]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 19 03:14:02.644401 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:14:02.644401 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:14:02.644401 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:14:02.644401 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 143 Oct 19 03:14:02.644401 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:14:02.644401 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:14:02.644401 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:14:02.644401 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:14:02.644401 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT2t2c5ncmUCKJrfA9GnmM0dh0Qn1GPGj85PoJtvOp8pOql6BXa72SBiydLu3Mnx7MXzSF_j6ZiUjR7S4L-N6u_d7NCqJus97nJnpmt-CuZMBNfJdN6C-wbU5ZpAzTNijfrowTZq7cYpd0a71OG4VdQGqsu2_dafzaCVsBhYRwcs9Q2U Oct 19 03:14:02.644401 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:14:02.644401 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:14:02.644401 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:14:02.644401 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:14:02.644401 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:14:02.644401 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:14:02.644401 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: d37b8a49338640779c428043229f47f7 Oct 19 03:14:02.644401 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-QuotasAdminNegativeTest-240364843 Oct 19 03:14:02.644401 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:14:02.644401 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:14:02.646073 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d37b8a49338640779c428043229f47f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d37b8a49338640779c428043229f47f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d37b8a49338640779c428043229f47f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d37b8a49338640779c428043229f47f7", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:14:02.646073 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-QuotasAdminNegativeTest-240364843 Oct 19 03:14:02.646073 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: d37b8a49338640779c428043229f47f7 Oct 19 03:14:02.646073 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-240364843 Oct 19 03:14:02.646073 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-QuotasAdminNegativeTest-240364843-project Oct 19 03:14:02.646073 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:14:02.646073 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:14:02.646073 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: bc66b39112a745fbb09c74d97cd55732 Oct 19 03:14:02.646073 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-QuotasAdminNegativeTest-240364843-project Oct 19 03:14:02.646073 n-d-861333-8 devstack@n-api.service[121134]: Oct 19 03:14:02.646073 n-d-861333-8 devstack@n-api.service[121134]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-19474772", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452"}} Oct 19 03:14:02.646073 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:14:02.646925 n-d-861333-8 devstack@n-api.service[121134]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 19 03:14:02.646925 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-19474772', 'imageRef': '9e16d73e-70ea-4421-aee3-047d80396c02', 'flavorRef': '452'}}} Oct 19 03:14:02.646925 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:14:02.646925 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:14:02.646925 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 19 03:14:02.646925 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 19 03:14:02.646925 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 03:14:02.646925 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 03:14:02.646925 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 19 03:14:02.646925 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc Oct 19 03:14:02.646925 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 19 03:14:02.646925 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 19 03:14:02.646925 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 03:14:02.646925 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 03:14:02.646925 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 19 03:14:02.646925 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 19 03:14:02.646925 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 19 03:14:02.646925 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 19 03:14:02.647981 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 19 03:14:02.647981 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 19 03:14:02.647981 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Oct 19 03:14:02.647981 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:14:02.647981 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:14:02.647981 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:14:02.647981 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:14:02.647981 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 19 03:14:02.647981 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 19 03:14:02.647981 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 19 03:14:02.647981 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 19 03:14:02.647981 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 19 03:14:02.647981 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 19 03:14:02.647981 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 19 03:14:02.647981 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 19 03:14:02.647981 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 19 03:14:02.647981 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 19 03:14:02.647981 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 19 03:14:02.647981 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:14:02.647981 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:14:02.647981 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:14:02.649107 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:14:02.649107 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:14:02.649107 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:14:02.649107 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:14:02.649107 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:14:02.649107 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:14:02.649107 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:14:02.649107 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:14:02.649107 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:14:02.649107 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:14:02.649107 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:14:02.649107 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:14:02.649107 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:14:02.649107 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 19 03:14:02.649107 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 19 03:14:02.649107 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 19 03:14:02.649107 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 19 03:14:02.649107 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:14:02.649107 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:14:02.649107 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:14:02.649107 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:14:02.650299 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:14:02.650299 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:14:02.650299 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:14:02.650299 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:14:02.650299 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 19 03:14:02.650299 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:14:02.650299 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b813b868-9ae3-48e2-af0b-7e19e2d82224 tempest-QuotasAdminNegativeTest-240364843 tempest-QuotasAdminNegativeTest-240364843-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:14:02.650299 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b813b868-9ae3-48e2-af0b-7e19e2d82224 tempest-QuotasAdminNegativeTest-240364843 tempest-QuotasAdminNegativeTest-240364843-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.304743 Oct 19 03:14:02.650299 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 258/517] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:14:02 2022] POST /compute/v2.1/servers => generated 119 bytes in 306 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:14:02.651620 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5f90e844-fdbc-4f9d-b133-0309cd6e4f8c tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:02.652158 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-5f90e844-fdbc-4f9d-b133-0309cd6e4f8c tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 82f8d22c-99ee-4c2b-8a36-5299c187ace7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:02.654654 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1bd34c47-b74a-46aa-aecb-e4872d318acd tempest-QuotasAdminNegativeTest-809443552 tempest-QuotasAdminNegativeTest-809443552-project-admin] Action: 'update', calling method: .version_select at 0x7fc1312ec040>, body: {"quota_set": {"instances": 10}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:14:02.659361 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5f90e844-fdbc-4f9d-b133-0309cd6e4f8c tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:02.659929 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5f90e844-fdbc-4f9d-b133-0309cd6e4f8c tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:02.661030 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5f90e844-fdbc-4f9d-b133-0309cd6e4f8c tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:02.661924 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5f90e844-fdbc-4f9d-b133-0309cd6e4f8c tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:02.662384 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5f90e844-fdbc-4f9d-b133-0309cd6e4f8c tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:02.663022 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5f90e844-fdbc-4f9d-b133-0309cd6e4f8c tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:02.802895 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-5f90e844-fdbc-4f9d-b133-0309cd6e4f8c tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:02.811992 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-5f90e844-fdbc-4f9d-b133-0309cd6e4f8c tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:02.813496 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-5f90e844-fdbc-4f9d-b133-0309cd6e4f8c tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:02.814621 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5f90e844-fdbc-4f9d-b133-0309cd6e4f8c tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/82f8d22c-99ee-4c2b-8a36-5299c187ace7" status: 200 len: 1362 microversion: 2.25 time: 0.170449 Oct 19 03:14:02.815186 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 260/518] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:02 2022] GET /compute/v2.1/servers/82f8d22c-99ee-4c2b-8a36-5299c187ace7 => generated 1362 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:14:02.842616 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-16cb3515-33bd-47d5-a30f-eb15496d4093 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:02.843167 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-16cb3515-33bd-47d5-a30f-eb15496d4093 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:02.849743 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-16cb3515-33bd-47d5-a30f-eb15496d4093 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:02.850239 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-16cb3515-33bd-47d5-a30f-eb15496d4093 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:02.850678 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-16cb3515-33bd-47d5-a30f-eb15496d4093 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:02.851393 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-16cb3515-33bd-47d5-a30f-eb15496d4093 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:02.851852 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-16cb3515-33bd-47d5-a30f-eb15496d4093 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:02.852364 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-16cb3515-33bd-47d5-a30f-eb15496d4093 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:02.856440 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1bd34c47-b74a-46aa-aecb-e4872d318acd tempest-QuotasAdminNegativeTest-809443552 tempest-QuotasAdminNegativeTest-809443552-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:02.856927 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1bd34c47-b74a-46aa-aecb-e4872d318acd tempest-QuotasAdminNegativeTest-809443552 tempest-QuotasAdminNegativeTest-809443552-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:02.858437 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1bd34c47-b74a-46aa-aecb-e4872d318acd tempest-QuotasAdminNegativeTest-809443552 tempest-QuotasAdminNegativeTest-809443552-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:02.858437 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1bd34c47-b74a-46aa-aecb-e4872d318acd tempest-QuotasAdminNegativeTest-809443552 tempest-QuotasAdminNegativeTest-809443552-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:02.863173 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1bd34c47-b74a-46aa-aecb-e4872d318acd tempest-QuotasAdminNegativeTest-809443552 tempest-QuotasAdminNegativeTest-809443552-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:02.863173 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1bd34c47-b74a-46aa-aecb-e4872d318acd tempest-QuotasAdminNegativeTest-809443552 tempest-QuotasAdminNegativeTest-809443552-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:02.923200 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-16cb3515-33bd-47d5-a30f-eb15496d4093 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:02.931514 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-16cb3515-33bd-47d5-a30f-eb15496d4093 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:02.932955 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-16cb3515-33bd-47d5-a30f-eb15496d4093 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:02.937998 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-16cb3515-33bd-47d5-a30f-eb15496d4093 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1512 microversion: 2.91 time: 0.099771 Oct 19 03:14:02.938559 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 261/519] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:02 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1512 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:14:02.991306 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-761840b8-f985-4c4c-a3ab-6b3ef4eda0c0 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:02.991914 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-761840b8-f985-4c4c-a3ab-6b3ef4eda0c0 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] [instance: d50976fb-756b-4b12-92f2-cedf87df492d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:02.998176 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-761840b8-f985-4c4c-a3ab-6b3ef4eda0c0 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:02.998950 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-761840b8-f985-4c4c-a3ab-6b3ef4eda0c0 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:02.999392 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-761840b8-f985-4c4c-a3ab-6b3ef4eda0c0 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:03.000095 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-761840b8-f985-4c4c-a3ab-6b3ef4eda0c0 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:03.000553 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-761840b8-f985-4c4c-a3ab-6b3ef4eda0c0 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:03.000979 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-761840b8-f985-4c4c-a3ab-6b3ef4eda0c0 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:03.064612 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-761840b8-f985-4c4c-a3ab-6b3ef4eda0c0 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:03.072749 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-761840b8-f985-4c4c-a3ab-6b3ef4eda0c0 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:03.074365 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-761840b8-f985-4c4c-a3ab-6b3ef4eda0c0 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:03.079198 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-761840b8-f985-4c4c-a3ab-6b3ef4eda0c0 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] 10.222.0.52 "GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d" status: 200 len: 1354 microversion: 2.75 time: 0.091923 Oct 19 03:14:03.079856 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 262/520] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:02 2022] GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d => generated 1354 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:14:03.112759 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1bd34c47-b74a-46aa-aecb-e4872d318acd tempest-QuotasAdminNegativeTest-809443552 tempest-QuotasAdminNegativeTest-809443552-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-quota-sets/d37b8a49338640779c428043229f47f7" status: 200 len: 329 microversion: 2.1 time: 0.461892 Oct 19 03:14:03.113402 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 259/521] 10.222.0.52 () {60 vars in 1262 bytes} [Wed Oct 19 03:14:02 2022] PUT /compute/v2.1/os-quota-sets/d37b8a49338640779c428043229f47f7 => generated 329 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:14:03.126786 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6ecb1386-47eb-4cc1-8753-8ce4e236ede4 tempest-QuotasAdminNegativeTest-809443552 tempest-QuotasAdminNegativeTest-809443552-project-admin] Calling method '.version_select at 0x7fc1314131f0>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:03.363559 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9d31e8e0-5004-4b84-9523-dbc250a621d7 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:03.364119 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9d31e8e0-5004-4b84-9523-dbc250a621d7 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 7b4a8cd9-a238-4bff-a002-497dc807bf3a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:03.372210 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9d31e8e0-5004-4b84-9523-dbc250a621d7 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:03.372712 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9d31e8e0-5004-4b84-9523-dbc250a621d7 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:03.373156 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9d31e8e0-5004-4b84-9523-dbc250a621d7 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:03.373890 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9d31e8e0-5004-4b84-9523-dbc250a621d7 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:03.374368 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9d31e8e0-5004-4b84-9523-dbc250a621d7 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:03.374775 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9d31e8e0-5004-4b84-9523-dbc250a621d7 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:03.458749 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6ecb1386-47eb-4cc1-8753-8ce4e236ede4 tempest-QuotasAdminNegativeTest-809443552 tempest-QuotasAdminNegativeTest-809443552-project-admin] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/d37b8a49338640779c428043229f47f7" status: 200 len: 371 microversion: 2.1 time: 0.335674 Oct 19 03:14:03.459428 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 263/522] 10.222.0.52 () {58 vars in 1242 bytes} [Wed Oct 19 03:14:03 2022] GET /compute/v2.1/os-quota-sets/d37b8a49338640779c428043229f47f7 => generated 371 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:14:03.464678 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b870a380-7bdb-4ce0-9958-c197328c0b8b tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:03.465593 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b870a380-7bdb-4ce0-9958-c197328c0b8b tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] [instance: 0de5edf9-535f-41db-b32a-06d4e9b231c3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:03.471897 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b870a380-7bdb-4ce0-9958-c197328c0b8b tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:03.472384 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b870a380-7bdb-4ce0-9958-c197328c0b8b tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:03.472818 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b870a380-7bdb-4ce0-9958-c197328c0b8b tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:03.474820 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b870a380-7bdb-4ce0-9958-c197328c0b8b tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:03.474820 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b870a380-7bdb-4ce0-9958-c197328c0b8b tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:03.474820 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b870a380-7bdb-4ce0-9958-c197328c0b8b tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:03.563049 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9d31e8e0-5004-4b84-9523-dbc250a621d7 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:03.572010 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9d31e8e0-5004-4b84-9523-dbc250a621d7 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a" status: 200 len: 1471 microversion: 2.1 time: 0.212706 Oct 19 03:14:03.572784 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 260/523] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:03 2022] GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a => generated 1471 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:14:03.633134 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b870a380-7bdb-4ce0-9958-c197328c0b8b tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ff6534c5e74a2eb179044ef833f0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e88bbb75184a59b88e533a49d63cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:03.648138 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b870a380-7bdb-4ce0-9958-c197328c0b8b tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] 10.222.0.52 "GET /compute/v2.1/servers/0de5edf9-535f-41db-b32a-06d4e9b231c3" status: 200 len: 1318 microversion: 2.1 time: 0.184912 Oct 19 03:14:03.648138 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 264/524] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:03 2022] GET /compute/v2.1/servers/0de5edf9-535f-41db-b32a-06d4e9b231c3 => generated 1318 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:14:03.651230 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6b37b001-c47b-4a13-810e-b07d8305a0b0 tempest-QuotasAdminNegativeTest-809443552 tempest-QuotasAdminNegativeTest-809443552-project-admin] Action: 'update', calling method: .version_select at 0x7fc1314e3f70>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:14:03.724346 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1d4cfac3-a256-4e71-a908-332bd74ca925 tempest-QuotaClassesAdmin257Test-190747904 tempest-QuotaClassesAdmin257Test-190747904-project-admin] Calling method '.version_select at 0x7fc131285160>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:03.739198 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1d4cfac3-a256-4e71-a908-332bd74ca925 tempest-QuotaClassesAdmin257Test-190747904 tempest-QuotaClassesAdmin257Test-190747904-project-admin] 10.222.0.52 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.164411 Oct 19 03:14:03.739842 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 261/525] 10.222.0.52 () {60 vars in 1226 bytes} [Wed Oct 19 03:14:03 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 03:14:03.751692 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-24d05098-9cf9-4d8b-a459-a0a0b377a0ea tempest-QuotaClassesAdmin257Test-190747904 tempest-QuotaClassesAdmin257Test-190747904-project-admin] Action: 'update', calling method: .version_select at 0x7fc1312470d0>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:14:03.758061 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6b37b001-c47b-4a13-810e-b07d8305a0b0 tempest-QuotasAdminNegativeTest-809443552 tempest-QuotasAdminNegativeTest-809443552-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:03.762857 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6b37b001-c47b-4a13-810e-b07d8305a0b0 tempest-QuotasAdminNegativeTest-809443552 tempest-QuotasAdminNegativeTest-809443552-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:03.762857 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6b37b001-c47b-4a13-810e-b07d8305a0b0 tempest-QuotasAdminNegativeTest-809443552 tempest-QuotasAdminNegativeTest-809443552-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:03.762857 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6b37b001-c47b-4a13-810e-b07d8305a0b0 tempest-QuotasAdminNegativeTest-809443552 tempest-QuotasAdminNegativeTest-809443552-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:03.762857 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6b37b001-c47b-4a13-810e-b07d8305a0b0 tempest-QuotasAdminNegativeTest-809443552 tempest-QuotasAdminNegativeTest-809443552-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:03.763165 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6b37b001-c47b-4a13-810e-b07d8305a0b0 tempest-QuotasAdminNegativeTest-809443552 tempest-QuotasAdminNegativeTest-809443552-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:03.792669 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=100 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:14:03.863655 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6b37b001-c47b-4a13-810e-b07d8305a0b0 tempest-QuotasAdminNegativeTest-809443552 tempest-QuotasAdminNegativeTest-809443552-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-quota-sets/d37b8a49338640779c428043229f47f7" status: 200 len: 325 microversion: 2.1 time: 0.215812 Oct 19 03:14:03.869413 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 265/526] 10.222.0.52 () {60 vars in 1262 bytes} [Wed Oct 19 03:14:03 2022] PUT /compute/v2.1/os-quota-sets/d37b8a49338640779c428043229f47f7 => generated 325 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:14:03.869413 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5cb3d86c-76a0-4f11-a604-232fc9e18e19 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:03.869759 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-5cb3d86c-76a0-4f11-a604-232fc9e18e19 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 82f8d22c-99ee-4c2b-8a36-5299c187ace7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:03.876585 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5cb3d86c-76a0-4f11-a604-232fc9e18e19 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:03.877074 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5cb3d86c-76a0-4f11-a604-232fc9e18e19 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:03.877546 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5cb3d86c-76a0-4f11-a604-232fc9e18e19 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:03.878251 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5cb3d86c-76a0-4f11-a604-232fc9e18e19 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:03.878783 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5cb3d86c-76a0-4f11-a604-232fc9e18e19 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:03.879185 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5cb3d86c-76a0-4f11-a604-232fc9e18e19 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:04.001406 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3,nova_api:UPDATE=4 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:14:04.016866 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-5cb3d86c-76a0-4f11-a604-232fc9e18e19 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:04.025270 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-5cb3d86c-76a0-4f11-a604-232fc9e18e19 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:04.032306 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-5cb3d86c-76a0-4f11-a604-232fc9e18e19 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:04.032306 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5cb3d86c-76a0-4f11-a604-232fc9e18e19 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/82f8d22c-99ee-4c2b-8a36-5299c187ace7" status: 200 len: 1556 microversion: 2.25 time: 0.162710 Oct 19 03:14:04.032306 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 266/527] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:03 2022] GET /compute/v2.1/servers/82f8d22c-99ee-4c2b-8a36-5299c187ace7 => generated 1556 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:14:04.033666 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1f87af3a-c248-4e20-b8ec-902a4bc1ce36 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:04.034273 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1f87af3a-c248-4e20-b8ec-902a4bc1ce36 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:04.045567 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1f87af3a-c248-4e20-b8ec-902a4bc1ce36 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:04.046065 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1f87af3a-c248-4e20-b8ec-902a4bc1ce36 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:04.046507 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1f87af3a-c248-4e20-b8ec-902a4bc1ce36 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:04.047209 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1f87af3a-c248-4e20-b8ec-902a4bc1ce36 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:04.047707 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1f87af3a-c248-4e20-b8ec-902a4bc1ce36 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:04.048155 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1f87af3a-c248-4e20-b8ec-902a4bc1ce36 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:04.116004 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-1f87af3a-c248-4e20-b8ec-902a4bc1ce36 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:04.124036 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-1f87af3a-c248-4e20-b8ec-902a4bc1ce36 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:04.125508 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-1f87af3a-c248-4e20-b8ec-902a4bc1ce36 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:04.130257 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1f87af3a-c248-4e20-b8ec-902a4bc1ce36 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1512 microversion: 2.91 time: 0.100189 Oct 19 03:14:04.130815 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 267/528] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:04 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1512 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:14:04.135529 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e97d08df-42a4-49e1-a370-e7a31c6d7f82 tempest-QuotasAdminNegativeTest-240364843 tempest-QuotasAdminNegativeTest-240364843-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-573326369", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:14:04.142598 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:14:04.186987 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.network.neutron [None req-e97d08df-42a4-49e1-a370-e7a31c6d7f82 tempest-QuotasAdminNegativeTest-240364843 tempest-QuotasAdminNegativeTest-240364843-project] validate_networks() for None {{(pid=121135) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:14:04.394968 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-e97d08df-42a4-49e1-a370-e7a31c6d7f82 tempest-QuotasAdminNegativeTest-240364843 tempest-QuotasAdminNegativeTest-240364843-project] Flavor limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:14:04.395407 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-e97d08df-42a4-49e1-a370-e7a31c6d7f82 tempest-QuotasAdminNegativeTest-240364843 tempest-QuotasAdminNegativeTest-240364843-project] Image limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:14:04.395872 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-e97d08df-42a4-49e1-a370-e7a31c6d7f82 tempest-QuotasAdminNegativeTest-240364843 tempest-QuotasAdminNegativeTest-240364843-project] Flavor pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:14:04.396289 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-e97d08df-42a4-49e1-a370-e7a31c6d7f82 tempest-QuotasAdminNegativeTest-240364843 tempest-QuotasAdminNegativeTest-240364843-project] Image pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:14:04.396699 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-e97d08df-42a4-49e1-a370-e7a31c6d7f82 tempest-QuotasAdminNegativeTest-240364843 tempest-QuotasAdminNegativeTest-240364843-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:14:04.406348 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e97d08df-42a4-49e1-a370-e7a31c6d7f82 tempest-QuotasAdminNegativeTest-240364843 tempest-QuotasAdminNegativeTest-240364843-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:04.406754 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e97d08df-42a4-49e1-a370-e7a31c6d7f82 tempest-QuotasAdminNegativeTest-240364843 tempest-QuotasAdminNegativeTest-240364843-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:04.407498 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e97d08df-42a4-49e1-a370-e7a31c6d7f82 tempest-QuotasAdminNegativeTest-240364843 tempest-QuotasAdminNegativeTest-240364843-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:04.408390 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e97d08df-42a4-49e1-a370-e7a31c6d7f82 tempest-QuotasAdminNegativeTest-240364843 tempest-QuotasAdminNegativeTest-240364843-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:04.408731 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e97d08df-42a4-49e1-a370-e7a31c6d7f82 tempest-QuotasAdminNegativeTest-240364843 tempest-QuotasAdminNegativeTest-240364843-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:04.409178 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e97d08df-42a4-49e1-a370-e7a31c6d7f82 tempest-QuotasAdminNegativeTest-240364843 tempest-QuotasAdminNegativeTest-240364843-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:04.416198 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=100 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:14:04.430927 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-e97d08df-42a4-49e1-a370-e7a31c6d7f82 tempest-QuotasAdminNegativeTest-240364843 tempest-QuotasAdminNegativeTest-240364843-project] Getting quotas for project d37b8a49338640779c428043229f47f7. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:14:04.436786 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-e97d08df-42a4-49e1-a370-e7a31c6d7f82 tempest-QuotasAdminNegativeTest-240364843 tempest-QuotasAdminNegativeTest-240364843-project] Getting quotas for user bc66b39112a745fbb09c74d97cd55732 and project d37b8a49338640779c428043229f47f7. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:14:04.451907 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.utils [None req-e97d08df-42a4-49e1-a370-e7a31c6d7f82 tempest-QuotasAdminNegativeTest-240364843 tempest-QuotasAdminNegativeTest-240364843-project] ram quota exceeded for d37b8a49338640779c428043229f47f7, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=121135) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 19 03:14:04.452729 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-e97d08df-42a4-49e1-a370-e7a31c6d7f82 tempest-QuotasAdminNegativeTest-240364843 tempest-QuotasAdminNegativeTest-240364843-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 19 03:14:04.456354 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e97d08df-42a4-49e1-a370-e7a31c6d7f82 tempest-QuotasAdminNegativeTest-240364843 tempest-QuotasAdminNegativeTest-240364843-project] Request method failure captured: Oct 19 03:14:04.456354 n-d-861333-8 devstack@n-api.service[121135]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 19 03:14:04.456354 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:14:04.456354 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:14:04.456354 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:14:04.456354 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 144 Oct 19 03:14:04.456354 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:14:04.456354 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:14:04.456354 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:14:04.456354 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:14:04.456354 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2t2c5ncmUCKJrfA9GnmM0dh0Qn1GPGj85PoJtvOp8pOql6BXa72SBiydLu3Mnx7MXzSF_j6ZiUjR7S4L-N6u_d7NCqJus97nJnpmt-CuZMBNfJdN6C-wbU5ZpAzTNijfrowTZq7cYpd0a71OG4VdQGqsu2_dafzaCVsBhYRwcs9Q2U Oct 19 03:14:04.456354 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:14:04.456354 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:14:04.456354 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:14:04.456354 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:14:04.456354 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:14:04.456354 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:14:04.456354 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: d37b8a49338640779c428043229f47f7 Oct 19 03:14:04.456354 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-QuotasAdminNegativeTest-240364843 Oct 19 03:14:04.456354 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:14:04.456354 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:14:04.462060 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d37b8a49338640779c428043229f47f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d37b8a49338640779c428043229f47f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d37b8a49338640779c428043229f47f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d37b8a49338640779c428043229f47f7", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:14:04.462060 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-QuotasAdminNegativeTest-240364843 Oct 19 03:14:04.462060 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: d37b8a49338640779c428043229f47f7 Oct 19 03:14:04.462060 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-240364843 Oct 19 03:14:04.462060 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-QuotasAdminNegativeTest-240364843-project Oct 19 03:14:04.462060 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:14:04.462060 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:14:04.462060 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: bc66b39112a745fbb09c74d97cd55732 Oct 19 03:14:04.462060 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-QuotasAdminNegativeTest-240364843-project Oct 19 03:14:04.462060 n-d-861333-8 devstack@n-api.service[121135]: Oct 19 03:14:04.462060 n-d-861333-8 devstack@n-api.service[121135]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-573326369", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452"}} Oct 19 03:14:04.462060 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:14:04.462896 n-d-861333-8 devstack@n-api.service[121135]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 19 03:14:04.462896 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-573326369', 'imageRef': '9e16d73e-70ea-4421-aee3-047d80396c02', 'flavorRef': '452'}}} Oct 19 03:14:04.462896 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:14:04.462896 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:14:04.462896 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 19 03:14:04.462896 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 19 03:14:04.462896 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 03:14:04.462896 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 03:14:04.462896 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 19 03:14:04.462896 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc Oct 19 03:14:04.462896 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 19 03:14:04.462896 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 19 03:14:04.462896 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 03:14:04.462896 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 03:14:04.462896 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 19 03:14:04.462896 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 19 03:14:04.462896 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 19 03:14:04.462896 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 19 03:14:04.464231 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 19 03:14:04.464231 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 19 03:14:04.464231 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 19 03:14:04.464231 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:14:04.464231 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:14:04.464231 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:14:04.464231 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:14:04.464231 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 19 03:14:04.464231 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 19 03:14:04.464231 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 19 03:14:04.464231 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 19 03:14:04.464231 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 19 03:14:04.464231 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 19 03:14:04.464231 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 19 03:14:04.464231 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 19 03:14:04.464231 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 19 03:14:04.464231 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 19 03:14:04.464231 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 19 03:14:04.464231 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:14:04.464231 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:14:04.464231 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:14:04.466201 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:14:04.466201 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:14:04.466201 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:14:04.466201 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:14:04.466201 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:14:04.466201 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:14:04.466201 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:14:04.466201 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:14:04.466201 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:14:04.466201 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:14:04.466201 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:14:04.466201 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:14:04.466201 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:14:04.466201 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 19 03:14:04.466201 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 19 03:14:04.466201 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 19 03:14:04.466201 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 19 03:14:04.466201 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:14:04.466201 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:14:04.466201 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:14:04.466201 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:14:04.468680 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:14:04.468680 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:14:04.468680 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:14:04.468680 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:14:04.468680 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 19 03:14:04.468680 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:14:04.468680 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e97d08df-42a4-49e1-a370-e7a31c6d7f82 tempest-QuotasAdminNegativeTest-240364843 tempest-QuotasAdminNegativeTest-240364843-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:14:04.468680 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e97d08df-42a4-49e1-a370-e7a31c6d7f82 tempest-QuotasAdminNegativeTest-240364843 tempest-QuotasAdminNegativeTest-240364843-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.326051 Oct 19 03:14:04.468680 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 268/529] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:14:04 2022] POST /compute/v2.1/servers => generated 110 bytes in 327 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:14:04.469393 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-b8c94d16-3197-46ce-8ba2-57d2f9973cfd req-71c5c49f-1d87-4d3c-a987-008fce2adf1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0de5edf9-535f-41db-b32a-06d4e9b231c3", "tag": "1ac620b0-a502-4413-90af-a2d6fb393e36"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:14:04.473721 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-b8c94d16-3197-46ce-8ba2-57d2f9973cfd req-71c5c49f-1d87-4d3c-a987-008fce2adf1e service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:04.474216 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-b8c94d16-3197-46ce-8ba2-57d2f9973cfd req-71c5c49f-1d87-4d3c-a987-008fce2adf1e service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:04.474647 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-b8c94d16-3197-46ce-8ba2-57d2f9973cfd req-71c5c49f-1d87-4d3c-a987-008fce2adf1e service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:04.487591 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-b8c94d16-3197-46ce-8ba2-57d2f9973cfd req-71c5c49f-1d87-4d3c-a987-008fce2adf1e service nova] Creating event network-changed:1ac620b0-a502-4413-90af-a2d6fb393e36 for instance 0de5edf9-535f-41db-b32a-06d4e9b231c3 on n-h1-861333-8 Oct 19 03:14:04.497482 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-b8c94d16-3197-46ce-8ba2-57d2f9973cfd req-71c5c49f-1d87-4d3c-a987-008fce2adf1e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037821 Oct 19 03:14:04.498257 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 269/530] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:14:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:14:04.503171 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-24d05098-9cf9-4d8b-a459-a0a0b377a0ea tempest-QuotaClassesAdmin257Test-190747904 tempest-QuotaClassesAdmin257Test-190747904-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.755211 Oct 19 03:14:04.503761 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 262/531] 10.222.0.52 () {62 vars in 1247 bytes} [Wed Oct 19 03:14:03 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 03:14:04.508802 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0666e249-f35d-4a4b-8a8e-5a161b6105a2 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:04.510122 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0666e249-f35d-4a4b-8a8e-5a161b6105a2 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] [instance: d50976fb-756b-4b12-92f2-cedf87df492d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:04.517607 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0666e249-f35d-4a4b-8a8e-5a161b6105a2 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:04.518107 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0666e249-f35d-4a4b-8a8e-5a161b6105a2 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:04.518641 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0666e249-f35d-4a4b-8a8e-5a161b6105a2 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:04.519406 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0666e249-f35d-4a4b-8a8e-5a161b6105a2 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:04.519864 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0666e249-f35d-4a4b-8a8e-5a161b6105a2 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:04.520466 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0666e249-f35d-4a4b-8a8e-5a161b6105a2 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:04.609828 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0666e249-f35d-4a4b-8a8e-5a161b6105a2 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:04.618337 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0666e249-f35d-4a4b-8a8e-5a161b6105a2 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:04.624855 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7dc875f2-35c5-41f3-ac2d-01abb84df21d tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:04.625587 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7dc875f2-35c5-41f3-ac2d-01abb84df21d tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] [instance: 82f8d22c-99ee-4c2b-8a36-5299c187ace7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:04.629327 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0666e249-f35d-4a4b-8a8e-5a161b6105a2 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:04.632624 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7dc875f2-35c5-41f3-ac2d-01abb84df21d tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:04.632624 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7dc875f2-35c5-41f3-ac2d-01abb84df21d tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:04.633070 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7dc875f2-35c5-41f3-ac2d-01abb84df21d tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:04.633926 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7dc875f2-35c5-41f3-ac2d-01abb84df21d tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:04.634669 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7dc875f2-35c5-41f3-ac2d-01abb84df21d tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:04.635066 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7dc875f2-35c5-41f3-ac2d-01abb84df21d tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:04.636278 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0666e249-f35d-4a4b-8a8e-5a161b6105a2 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] 10.222.0.52 "GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d" status: 200 len: 1410 microversion: 2.75 time: 0.131523 Oct 19 03:14:04.636906 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 263/532] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:04 2022] GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d => generated 1410 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:14:04.642054 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-96aa30d0-d340-46c6-a3e1-c9808d4aeb5a tempest-QuotasAdminNegativeTest-809443552 tempest-QuotasAdminNegativeTest-809443552-project-admin] Action: 'update', calling method: .version_select at 0x7fc1311fa9d0>, body: {"quota_set": {"ram": 51200}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:14:04.707176 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-96aa30d0-d340-46c6-a3e1-c9808d4aeb5a tempest-QuotasAdminNegativeTest-809443552 tempest-QuotasAdminNegativeTest-809443552-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:04.707656 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-96aa30d0-d340-46c6-a3e1-c9808d4aeb5a tempest-QuotasAdminNegativeTest-809443552 tempest-QuotasAdminNegativeTest-809443552-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:04.708109 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-96aa30d0-d340-46c6-a3e1-c9808d4aeb5a tempest-QuotasAdminNegativeTest-809443552 tempest-QuotasAdminNegativeTest-809443552-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:04.708849 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-96aa30d0-d340-46c6-a3e1-c9808d4aeb5a tempest-QuotasAdminNegativeTest-809443552 tempest-QuotasAdminNegativeTest-809443552-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:04.709303 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-96aa30d0-d340-46c6-a3e1-c9808d4aeb5a tempest-QuotasAdminNegativeTest-809443552 tempest-QuotasAdminNegativeTest-809443552-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:04.710400 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-96aa30d0-d340-46c6-a3e1-c9808d4aeb5a tempest-QuotasAdminNegativeTest-809443552 tempest-QuotasAdminNegativeTest-809443552-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:04.765963 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-7dc875f2-35c5-41f3-ac2d-01abb84df21d tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lazy-loading 'services' on Instance uuid 82f8d22c-99ee-4c2b-8a36-5299c187ace7 {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:14:04.825483 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7dc875f2-35c5-41f3-ac2d-01abb84df21d tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/82f8d22c-99ee-4c2b-8a36-5299c187ace7" status: 200 len: 2049 microversion: 2.25 time: 0.325639 Oct 19 03:14:04.826254 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 270/533] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:04 2022] GET /compute/v2.1/servers/82f8d22c-99ee-4c2b-8a36-5299c187ace7 => generated 2049 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:14:04.830507 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f1db692d-8f94-43ed-9715-4fa637184c67 tempest-QuotaClassesAdmin257Test-190747904 tempest-QuotaClassesAdmin257Test-190747904-project-admin] Calling method '.version_select at 0x7fc1314d40d0>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:04.856345 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f1db692d-8f94-43ed-9715-4fa637184c67 tempest-QuotaClassesAdmin257Test-190747904 tempest-QuotaClassesAdmin257Test-190747904-project-admin] 10.222.0.52 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.028427 Oct 19 03:14:04.857268 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 271/534] 10.222.0.52 () {60 vars in 1226 bytes} [Wed Oct 19 03:14:04 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 03:14:04.864251 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9a35ae5f-b8b6-4985-8fa5-df00b30c01fd tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:04.878041 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9a35ae5f-b8b6-4985-8fa5-df00b30c01fd tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 7b4a8cd9-a238-4bff-a002-497dc807bf3a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:04.878041 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9a35ae5f-b8b6-4985-8fa5-df00b30c01fd tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:04.878041 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9a35ae5f-b8b6-4985-8fa5-df00b30c01fd tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:04.878041 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9a35ae5f-b8b6-4985-8fa5-df00b30c01fd tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:04.878464 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9a35ae5f-b8b6-4985-8fa5-df00b30c01fd tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:04.878464 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9a35ae5f-b8b6-4985-8fa5-df00b30c01fd tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:04.879069 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9a35ae5f-b8b6-4985-8fa5-df00b30c01fd tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:04.881460 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-96aa30d0-d340-46c6-a3e1-c9808d4aeb5a tempest-QuotasAdminNegativeTest-809443552 tempest-QuotasAdminNegativeTest-809443552-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-quota-sets/d37b8a49338640779c428043229f47f7" status: 200 len: 331 microversion: 2.1 time: 0.242780 Oct 19 03:14:04.890990 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 264/535] 10.222.0.52 () {60 vars in 1262 bytes} [Wed Oct 19 03:14:04 2022] PUT /compute/v2.1/os-quota-sets/d37b8a49338640779c428043229f47f7 => generated 331 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:14:04.890990 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d9be1a80-29e1-4544-9e6f-06b86602057c tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:04.890990 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d9be1a80-29e1-4544-9e6f-06b86602057c tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] [instance: 0de5edf9-535f-41db-b32a-06d4e9b231c3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:04.899885 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d9be1a80-29e1-4544-9e6f-06b86602057c tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:04.900500 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d9be1a80-29e1-4544-9e6f-06b86602057c tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:04.900964 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d9be1a80-29e1-4544-9e6f-06b86602057c tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:04.904296 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d9be1a80-29e1-4544-9e6f-06b86602057c tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:04.904774 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d9be1a80-29e1-4544-9e6f-06b86602057c tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:04.905215 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d9be1a80-29e1-4544-9e6f-06b86602057c tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:05.068185 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-9a35ae5f-b8b6-4985-8fa5-df00b30c01fd tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:05.076495 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9a35ae5f-b8b6-4985-8fa5-df00b30c01fd tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a" status: 200 len: 1463 microversion: 2.1 time: 0.218118 Oct 19 03:14:05.077271 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 272/536] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:04 2022] GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a => generated 1463 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:14:05.081468 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-fdcc306f-4d63-450a-a010-a70da436b897 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:05.082070 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-fdcc306f-4d63-450a-a010-a70da436b897 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] [instance: 82f8d22c-99ee-4c2b-8a36-5299c187ace7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:05.090723 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fdcc306f-4d63-450a-a010-a70da436b897 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:05.090723 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fdcc306f-4d63-450a-a010-a70da436b897 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:05.090723 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fdcc306f-4d63-450a-a010-a70da436b897 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:05.090723 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fdcc306f-4d63-450a-a010-a70da436b897 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:05.091103 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fdcc306f-4d63-450a-a010-a70da436b897 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:05.091103 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fdcc306f-4d63-450a-a010-a70da436b897 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:05.091993 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d9be1a80-29e1-4544-9e6f-06b86602057c tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ff6534c5e74a2eb179044ef833f0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e88bbb75184a59b88e533a49d63cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:05.099850 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d9be1a80-29e1-4544-9e6f-06b86602057c tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] 10.222.0.52 "GET /compute/v2.1/servers/0de5edf9-535f-41db-b32a-06d4e9b231c3" status: 200 len: 1318 microversion: 2.1 time: 0.215379 Oct 19 03:14:05.100571 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 265/537] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:04 2022] GET /compute/v2.1/servers/0de5edf9-535f-41db-b32a-06d4e9b231c3 => generated 1318 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:14:05.104917 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-586f4127-5a9d-40d8-b17c-995860c1d6bb tempest-QuotaClassesAdmin257Test-190747904 tempest-QuotaClassesAdmin257Test-190747904-project-admin] Action: 'update', calling method: .version_select at 0x7fc13138bb80>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:14:05.218194 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-fdcc306f-4d63-450a-a010-a70da436b897 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lazy-loading 'services' on Instance uuid 82f8d22c-99ee-4c2b-8a36-5299c187ace7 {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:14:05.230834 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-fdcc306f-4d63-450a-a010-a70da436b897 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/82f8d22c-99ee-4c2b-8a36-5299c187ace7" status: 200 len: 2049 microversion: 2.25 time: 0.152748 Oct 19 03:14:05.231713 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 273/538] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:05 2022] GET /compute/v2.1/servers/82f8d22c-99ee-4c2b-8a36-5299c187ace7 => generated 2049 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:14:05.236098 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-21a67341-ebd9-4bbe-b7dc-c181f2ddb93f tempest-QuotasAdminNegativeTest-240364843 tempest-QuotasAdminNegativeTest-240364843-project] Action: 'update', calling method: .version_select at 0x7fc1316c9af0>, body: {"quota_set": {"ram": 0}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:14:05.241795 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-21a67341-ebd9-4bbe-b7dc-c181f2ddb93f tempest-QuotasAdminNegativeTest-240364843 tempest-QuotasAdminNegativeTest-240364843-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': 'bc66b39112a745fbb09c74d97cd55732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37b8a49338640779c428043229f47f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:05.243004 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-21a67341-ebd9-4bbe-b7dc-c181f2ddb93f tempest-QuotasAdminNegativeTest-240364843 tempest-QuotasAdminNegativeTest-240364843-project] Request method failure captured: Oct 19 03:14:05.243004 n-d-861333-8 devstack@n-api.service[121135]: request: PUT /compute/v2.1/os-quota-sets/d37b8a49338640779c428043229f47f7 HTTP/1.1 Oct 19 03:14:05.243004 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:14:05.243004 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:14:05.243004 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:14:05.243004 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 25 Oct 19 03:14:05.243004 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:14:05.243004 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:14:05.243004 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:14:05.243004 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:14:05.243004 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2t2c5ncmUCKJrfA9GnmM0dh0Qn1GPGj85PoJtvOp8pOql6BXa72SBiydLu3Mnx7MXzSF_j6ZiUjR7S4L-N6u_d7NCqJus97nJnpmt-CuZMBNfJdN6C-wbU5ZpAzTNijfrowTZq7cYpd0a71OG4VdQGqsu2_dafzaCVsBhYRwcs9Q2U Oct 19 03:14:05.243004 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:14:05.243004 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:14:05.243004 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:14:05.243004 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:14:05.243004 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:14:05.243004 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:14:05.243004 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: d37b8a49338640779c428043229f47f7 Oct 19 03:14:05.243004 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-QuotasAdminNegativeTest-240364843 Oct 19 03:14:05.243004 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:14:05.243004 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:14:05.244251 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d37b8a49338640779c428043229f47f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d37b8a49338640779c428043229f47f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d37b8a49338640779c428043229f47f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d37b8a49338640779c428043229f47f7", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:14:05.244251 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-QuotasAdminNegativeTest-240364843 Oct 19 03:14:05.244251 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: d37b8a49338640779c428043229f47f7 Oct 19 03:14:05.244251 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-240364843 Oct 19 03:14:05.244251 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-QuotasAdminNegativeTest-240364843-project Oct 19 03:14:05.244251 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:14:05.244251 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:14:05.244251 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: bc66b39112a745fbb09c74d97cd55732 Oct 19 03:14:05.244251 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-QuotasAdminNegativeTest-240364843-project Oct 19 03:14:05.244251 n-d-861333-8 devstack@n-api.service[121135]: Oct 19 03:14:05.244251 n-d-861333-8 devstack@n-api.service[121135]: {"quota_set": {"ram": 0}} Oct 19 03:14:05.244251 n-d-861333-8 devstack@n-api.service[121135]: method: Oct 19 03:14:05.244251 n-d-861333-8 devstack@n-api.service[121135]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 19 03:14:05.244251 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': 'd37b8a49338640779c428043229f47f7', 'body': {'quota_set': {'ram': 0}}} Oct 19 03:14:05.245058 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:14:05.245058 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:14:05.245058 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:14:05.245058 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:14:05.245058 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:14:05.245058 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:14:05.245058 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 03:14:05.245058 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 03:14:05.245058 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:14:05.245058 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:14:05.245058 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:14:05.245058 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:14:05.245058 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Oct 19 03:14:05.245058 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Oct 19 03:14:05.245058 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 19 03:14:05.245058 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:14:05.245058 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 19 03:14:05.245058 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:14:05.245058 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Oct 19 03:14:05.247230 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Oct 19 03:14:05.247230 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 19 03:14:05.247230 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 19 03:14:05.247230 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 19 03:14:05.247230 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 19 03:14:05.247230 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 03:14:05.247230 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 03:14:05.247230 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 03:14:05.247230 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 03:14:05.247230 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 19 03:14:05.247230 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 19 03:14:05.247230 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 19 03:14:05.247230 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 19 03:14:05.247230 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 19 03:14:05.247230 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 19 03:14:05.247230 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 19 03:14:05.247230 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:14:05.247230 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:14:05.247230 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:14:05.247230 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:14:05.249876 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:14:05.249876 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:14:05.249876 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 19 03:14:05.249876 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 19 03:14:05.249876 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 19 03:14:05.249876 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:14:05.249876 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-21a67341-ebd9-4bbe-b7dc-c181f2ddb93f tempest-QuotasAdminNegativeTest-240364843 tempest-QuotasAdminNegativeTest-240364843-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:14:05.249876 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-21a67341-ebd9-4bbe-b7dc-c181f2ddb93f tempest-QuotasAdminNegativeTest-240364843 tempest-QuotasAdminNegativeTest-240364843-project] 10.222.0.52 "PUT /compute/v2.1/os-quota-sets/d37b8a49338640779c428043229f47f7" status: 403 len: 116 microversion: 2.1 time: 0.012002 Oct 19 03:14:05.249876 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 274/539] 10.222.0.52 () {60 vars in 1262 bytes} [Wed Oct 19 03:14:05 2022] PUT /compute/v2.1/os-quota-sets/d37b8a49338640779c428043229f47f7 => generated 116 bytes in 13 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:14:05.250414 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-be013753-60e0-4c35-89b1-3988c003b44e tempest-MigrationsAdminTest-1230104219 tempest-MigrationsAdminTest-1230104219-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:05.250414 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-be013753-60e0-4c35-89b1-3988c003b44e tempest-MigrationsAdminTest-1230104219 tempest-MigrationsAdminTest-1230104219-project-admin] [instance: 7b4a8cd9-a238-4bff-a002-497dc807bf3a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:05.259244 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-be013753-60e0-4c35-89b1-3988c003b44e tempest-MigrationsAdminTest-1230104219 tempest-MigrationsAdminTest-1230104219-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:05.260310 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-be013753-60e0-4c35-89b1-3988c003b44e tempest-MigrationsAdminTest-1230104219 tempest-MigrationsAdminTest-1230104219-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:05.260912 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-be013753-60e0-4c35-89b1-3988c003b44e tempest-MigrationsAdminTest-1230104219 tempest-MigrationsAdminTest-1230104219-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:05.261925 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-be013753-60e0-4c35-89b1-3988c003b44e tempest-MigrationsAdminTest-1230104219 tempest-MigrationsAdminTest-1230104219-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:05.263039 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-be013753-60e0-4c35-89b1-3988c003b44e tempest-MigrationsAdminTest-1230104219 tempest-MigrationsAdminTest-1230104219-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:05.263668 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-be013753-60e0-4c35-89b1-3988c003b44e tempest-MigrationsAdminTest-1230104219 tempest-MigrationsAdminTest-1230104219-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:05.407198 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-be013753-60e0-4c35-89b1-3988c003b44e tempest-MigrationsAdminTest-1230104219 tempest-MigrationsAdminTest-1230104219-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a" status: 200 len: 1614 microversion: 2.1 time: 0.161203 Oct 19 03:14:05.407839 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 275/540] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:05 2022] GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a => generated 1614 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:14:05.412333 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-342c4b4f-2e5c-4faf-8796-79f83321525a tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:05.412938 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-342c4b4f-2e5c-4faf-8796-79f83321525a tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:05.419292 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-342c4b4f-2e5c-4faf-8796-79f83321525a tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:05.419784 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-342c4b4f-2e5c-4faf-8796-79f83321525a tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:05.420225 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-342c4b4f-2e5c-4faf-8796-79f83321525a tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:05.420911 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-342c4b4f-2e5c-4faf-8796-79f83321525a tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:05.421394 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-342c4b4f-2e5c-4faf-8796-79f83321525a tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:05.421820 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-342c4b4f-2e5c-4faf-8796-79f83321525a tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:05.489194 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-342c4b4f-2e5c-4faf-8796-79f83321525a tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:05.498672 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-342c4b4f-2e5c-4faf-8796-79f83321525a tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:05.503287 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-342c4b4f-2e5c-4faf-8796-79f83321525a tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:05.505587 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-342c4b4f-2e5c-4faf-8796-79f83321525a tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1533 microversion: 2.91 time: 0.096740 Oct 19 03:14:05.506158 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 276/541] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:05 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1533 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:14:05.510987 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1381bead-5e45-45ce-9246-9b585b1b8c3d tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:05.515512 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1381bead-5e45-45ce-9246-9b585b1b8c3d tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:05.515997 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1381bead-5e45-45ce-9246-9b585b1b8c3d tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:05.516433 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1381bead-5e45-45ce-9246-9b585b1b8c3d tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:05.517154 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1381bead-5e45-45ce-9246-9b585b1b8c3d tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:05.517631 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1381bead-5e45-45ce-9246-9b585b1b8c3d tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:05.518248 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1381bead-5e45-45ce-9246-9b585b1b8c3d tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:05.542279 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1381bead-5e45-45ce-9246-9b585b1b8c3d tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.034903 Oct 19 03:14:05.542892 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 277/542] 10.222.0.52 () {60 vars in 1217 bytes} [Wed Oct 19 03:14:05 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 03:14:05.547328 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2704c9e6-a9b0-4df9-8765-26efde9ab77d tempest-MigrationsAdminTest-1230104219 tempest-MigrationsAdminTest-1230104219-project-admin] Calling method '.version_select at 0x7fc1313fb550>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:05.551198 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2704c9e6-a9b0-4df9-8765-26efde9ab77d tempest-MigrationsAdminTest-1230104219 tempest-MigrationsAdminTest-1230104219-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:05.551198 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2704c9e6-a9b0-4df9-8765-26efde9ab77d tempest-MigrationsAdminTest-1230104219 tempest-MigrationsAdminTest-1230104219-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:05.551603 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2704c9e6-a9b0-4df9-8765-26efde9ab77d tempest-MigrationsAdminTest-1230104219 tempest-MigrationsAdminTest-1230104219-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:05.562455 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2704c9e6-a9b0-4df9-8765-26efde9ab77d tempest-MigrationsAdminTest-1230104219 tempest-MigrationsAdminTest-1230104219-project-admin] 10.222.0.52 "GET /compute/v2.1/os-migrations" status: 200 len: 409 microversion: 2.1 time: 0.018525 Oct 19 03:14:05.563028 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 278/543] 10.222.0.52 () {58 vars in 1143 bytes} [Wed Oct 19 03:14:05 2022] GET /compute/v2.1/os-migrations => generated 409 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:14:05.681464 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-19765f18-a756-4407-8aeb-d90f3deab917 tempest-UnshelveToHostMultiNodesTest-1213824820 tempest-UnshelveToHostMultiNodesTest-1213824820-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:05.682330 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-19765f18-a756-4407-8aeb-d90f3deab917 tempest-UnshelveToHostMultiNodesTest-1213824820 tempest-UnshelveToHostMultiNodesTest-1213824820-project-admin] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:05.688057 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-586f4127-5a9d-40d8-b17c-995860c1d6bb tempest-QuotaClassesAdmin257Test-190747904 tempest-QuotaClassesAdmin257Test-190747904-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.586583 Oct 19 03:14:05.692711 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 266/544] 10.222.0.52 () {62 vars in 1247 bytes} [Wed Oct 19 03:14:05 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 03:14:05.692849 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-19765f18-a756-4407-8aeb-d90f3deab917 tempest-UnshelveToHostMultiNodesTest-1213824820 tempest-UnshelveToHostMultiNodesTest-1213824820-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:05.692849 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-19765f18-a756-4407-8aeb-d90f3deab917 tempest-UnshelveToHostMultiNodesTest-1213824820 tempest-UnshelveToHostMultiNodesTest-1213824820-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:05.692849 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-19765f18-a756-4407-8aeb-d90f3deab917 tempest-UnshelveToHostMultiNodesTest-1213824820 tempest-UnshelveToHostMultiNodesTest-1213824820-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:05.692849 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-19765f18-a756-4407-8aeb-d90f3deab917 tempest-UnshelveToHostMultiNodesTest-1213824820 tempest-UnshelveToHostMultiNodesTest-1213824820-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:05.695464 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-19765f18-a756-4407-8aeb-d90f3deab917 tempest-UnshelveToHostMultiNodesTest-1213824820 tempest-UnshelveToHostMultiNodesTest-1213824820-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:05.699061 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-211b7163-00ee-4843-90b7-b05e4298e368 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-861333-8", "block_migration": "auto"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:14:05.702080 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-211b7163-00ee-4843-90b7-b05e4298e368 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] [instance: 82f8d22c-99ee-4c2b-8a36-5299c187ace7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:05.704898 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-19765f18-a756-4407-8aeb-d90f3deab917 tempest-UnshelveToHostMultiNodesTest-1213824820 tempest-UnshelveToHostMultiNodesTest-1213824820-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:05.721953 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-211b7163-00ee-4843-90b7-b05e4298e368 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:05.721953 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-211b7163-00ee-4843-90b7-b05e4298e368 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:05.721953 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-211b7163-00ee-4843-90b7-b05e4298e368 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:05.721953 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-211b7163-00ee-4843-90b7-b05e4298e368 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:05.737550 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-211b7163-00ee-4843-90b7-b05e4298e368 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:05.738155 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-211b7163-00ee-4843-90b7-b05e4298e368 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:05.764104 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-211b7163-00ee-4843-90b7-b05e4298e368 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lazy-loading 'flavor' on Instance uuid 82f8d22c-99ee-4c2b-8a36-5299c187ace7 {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:14:05.778633 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-211b7163-00ee-4843-90b7-b05e4298e368 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] [instance: 82f8d22c-99ee-4c2b-8a36-5299c187ace7] Going to try to live migrate instance to n-h1-861333-8 {{(pid=121134) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 19 03:14:05.921947 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-19765f18-a756-4407-8aeb-d90f3deab917 tempest-UnshelveToHostMultiNodesTest-1213824820 tempest-UnshelveToHostMultiNodesTest-1213824820-project-admin] Lazy-loading 'services' on Instance uuid 84092951-cf52-4077-b954-0babab66565e {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:14:05.941267 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-19765f18-a756-4407-8aeb-d90f3deab917 tempest-UnshelveToHostMultiNodesTest-1213824820 tempest-UnshelveToHostMultiNodesTest-1213824820-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1938 microversion: 2.91 time: 0.377174 Oct 19 03:14:05.945774 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 279/545] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:05 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1938 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:14:05.952275 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e8b69f7b-1772-47e0-9337-9db1d1d189a7 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:05.953070 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e8b69f7b-1772-47e0-9337-9db1d1d189a7 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] [instance: d50976fb-756b-4b12-92f2-cedf87df492d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:05.960797 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e8b69f7b-1772-47e0-9337-9db1d1d189a7 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:05.961357 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e8b69f7b-1772-47e0-9337-9db1d1d189a7 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:05.961870 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e8b69f7b-1772-47e0-9337-9db1d1d189a7 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:05.963988 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e8b69f7b-1772-47e0-9337-9db1d1d189a7 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:05.963988 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e8b69f7b-1772-47e0-9337-9db1d1d189a7 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:05.963988 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e8b69f7b-1772-47e0-9337-9db1d1d189a7 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:06.216175 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-e8b69f7b-1772-47e0-9337-9db1d1d189a7 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:06.234351 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-e8b69f7b-1772-47e0-9337-9db1d1d189a7 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:06.236015 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-e8b69f7b-1772-47e0-9337-9db1d1d189a7 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:06.241885 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e8b69f7b-1772-47e0-9337-9db1d1d189a7 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] 10.222.0.52 "GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d" status: 200 len: 1418 microversion: 2.75 time: 0.298395 Oct 19 03:14:06.257879 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 280/546] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:05 2022] GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d => generated 1418 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:14:06.270557 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5e90b0b5-f6d1-4caf-9b97-1518289d3637 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-666115594", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:14:06.339302 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.network.neutron [None req-5e90b0b5-f6d1-4caf-9b97-1518289d3637 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] validate_networks() for None {{(pid=121135) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:14:06.718020 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-5e90b0b5-f6d1-4caf-9b97-1518289d3637 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Flavor limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:14:06.718564 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-5e90b0b5-f6d1-4caf-9b97-1518289d3637 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Image limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:14:06.719694 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-5e90b0b5-f6d1-4caf-9b97-1518289d3637 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Flavor pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:14:06.720214 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-5e90b0b5-f6d1-4caf-9b97-1518289d3637 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Image pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:14:06.720936 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-5e90b0b5-f6d1-4caf-9b97-1518289d3637 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:14:06.742950 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5e90b0b5-f6d1-4caf-9b97-1518289d3637 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:06.745583 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5e90b0b5-f6d1-4caf-9b97-1518289d3637 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:06.748542 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5e90b0b5-f6d1-4caf-9b97-1518289d3637 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:06.749549 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5e90b0b5-f6d1-4caf-9b97-1518289d3637 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:06.764962 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5e90b0b5-f6d1-4caf-9b97-1518289d3637 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:06.766014 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5e90b0b5-f6d1-4caf-9b97-1518289d3637 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:06.790556 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-5e90b0b5-f6d1-4caf-9b97-1518289d3637 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Getting quotas for project c9a76121a22144499a44f44bb78848bf. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:14:06.798192 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-5e90b0b5-f6d1-4caf-9b97-1518289d3637 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Getting quotas for user 9f8493504d9243bc95c9861f4ff76c83 and project c9a76121a22144499a44f44bb78848bf. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:14:06.811745 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-5e90b0b5-f6d1-4caf-9b97-1518289d3637 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Going to run 1 instances... {{(pid=121135) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:14:06.814359 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-5e90b0b5-f6d1-4caf-9b97-1518289d3637 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121135) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:14:07.019580 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5e90b0b5-f6d1-4caf-9b97-1518289d3637 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.759766 Oct 19 03:14:07.026732 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 281/547] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:14:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 768 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 03:14:07.034309 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6ca55d54-35f7-442d-86bb-bd6298f5d0d2 tempest-UnshelveToHostMultiNodesTest-1213824820 tempest-UnshelveToHostMultiNodesTest-1213824820-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:07.039826 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6ca55d54-35f7-442d-86bb-bd6298f5d0d2 tempest-UnshelveToHostMultiNodesTest-1213824820 tempest-UnshelveToHostMultiNodesTest-1213824820-project-admin] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:07.052078 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6ca55d54-35f7-442d-86bb-bd6298f5d0d2 tempest-UnshelveToHostMultiNodesTest-1213824820 tempest-UnshelveToHostMultiNodesTest-1213824820-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:07.052636 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6ca55d54-35f7-442d-86bb-bd6298f5d0d2 tempest-UnshelveToHostMultiNodesTest-1213824820 tempest-UnshelveToHostMultiNodesTest-1213824820-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:07.058316 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6ca55d54-35f7-442d-86bb-bd6298f5d0d2 tempest-UnshelveToHostMultiNodesTest-1213824820 tempest-UnshelveToHostMultiNodesTest-1213824820-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:07.058316 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6ca55d54-35f7-442d-86bb-bd6298f5d0d2 tempest-UnshelveToHostMultiNodesTest-1213824820 tempest-UnshelveToHostMultiNodesTest-1213824820-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:07.058316 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6ca55d54-35f7-442d-86bb-bd6298f5d0d2 tempest-UnshelveToHostMultiNodesTest-1213824820 tempest-UnshelveToHostMultiNodesTest-1213824820-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:07.058316 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6ca55d54-35f7-442d-86bb-bd6298f5d0d2 tempest-UnshelveToHostMultiNodesTest-1213824820 tempest-UnshelveToHostMultiNodesTest-1213824820-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:07.136311 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-6ca55d54-35f7-442d-86bb-bd6298f5d0d2 tempest-UnshelveToHostMultiNodesTest-1213824820 tempest-UnshelveToHostMultiNodesTest-1213824820-project-admin] Lazy-loading 'services' on Instance uuid 84092951-cf52-4077-b954-0babab66565e {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:14:07.155215 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6ca55d54-35f7-442d-86bb-bd6298f5d0d2 tempest-UnshelveToHostMultiNodesTest-1213824820 tempest-UnshelveToHostMultiNodesTest-1213824820-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1938 microversion: 2.91 time: 0.125918 Oct 19 03:14:07.155799 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 282/548] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:07 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1938 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:14:07.160249 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ec323aa9-62ee-49e1-9e9e-7dbc899f359b tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:07.160860 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ec323aa9-62ee-49e1-9e9e-7dbc899f359b tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] [instance: 0de5edf9-535f-41db-b32a-06d4e9b231c3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:07.166598 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ec323aa9-62ee-49e1-9e9e-7dbc899f359b tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:07.172384 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ec323aa9-62ee-49e1-9e9e-7dbc899f359b tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:07.178925 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ec323aa9-62ee-49e1-9e9e-7dbc899f359b tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:07.179043 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ec323aa9-62ee-49e1-9e9e-7dbc899f359b tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:07.179478 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ec323aa9-62ee-49e1-9e9e-7dbc899f359b tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:07.179926 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ec323aa9-62ee-49e1-9e9e-7dbc899f359b tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:07.321449 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ec323aa9-62ee-49e1-9e9e-7dbc899f359b tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ff6534c5e74a2eb179044ef833f0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e88bbb75184a59b88e533a49d63cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:07.329292 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ec323aa9-62ee-49e1-9e9e-7dbc899f359b tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] 10.222.0.52 "GET /compute/v2.1/servers/0de5edf9-535f-41db-b32a-06d4e9b231c3" status: 200 len: 1318 microversion: 2.1 time: 0.172487 Oct 19 03:14:07.330072 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 283/549] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:07 2022] GET /compute/v2.1/servers/0de5edf9-535f-41db-b32a-06d4e9b231c3 => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:14:07.334824 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7ffdda87-d6e0-4e04-a25e-1fa13401eed2 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:07.335442 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7ffdda87-d6e0-4e04-a25e-1fa13401eed2 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:07.403679 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7ffdda87-d6e0-4e04-a25e-1fa13401eed2 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:07.411437 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7ffdda87-d6e0-4e04-a25e-1fa13401eed2 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667" status: 200 len: 1212 microversion: 2.1 time: 0.080518 Oct 19 03:14:07.412021 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 284/550] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:07 2022] GET /compute/v2.1/servers/ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667 => generated 1212 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:14:07.427625 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f510e539-693e-4cdf-9fb9-7a85855ce3c5 tempest-UnshelveToHostMultiNodesTest-1213824820 tempest-UnshelveToHostMultiNodesTest-1213824820-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:07.431419 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f510e539-693e-4cdf-9fb9-7a85855ce3c5 tempest-UnshelveToHostMultiNodesTest-1213824820 tempest-UnshelveToHostMultiNodesTest-1213824820-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:07.432163 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f510e539-693e-4cdf-9fb9-7a85855ce3c5 tempest-UnshelveToHostMultiNodesTest-1213824820 tempest-UnshelveToHostMultiNodesTest-1213824820-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:07.432399 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f510e539-693e-4cdf-9fb9-7a85855ce3c5 tempest-UnshelveToHostMultiNodesTest-1213824820 tempest-UnshelveToHostMultiNodesTest-1213824820-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:07.433048 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f510e539-693e-4cdf-9fb9-7a85855ce3c5 tempest-UnshelveToHostMultiNodesTest-1213824820 tempest-UnshelveToHostMultiNodesTest-1213824820-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:07.434309 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f510e539-693e-4cdf-9fb9-7a85855ce3c5 tempest-UnshelveToHostMultiNodesTest-1213824820 tempest-UnshelveToHostMultiNodesTest-1213824820-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:07.434309 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f510e539-693e-4cdf-9fb9-7a85855ce3c5 tempest-UnshelveToHostMultiNodesTest-1213824820 tempest-UnshelveToHostMultiNodesTest-1213824820-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:07.458552 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f510e539-693e-4cdf-9fb9-7a85855ce3c5 tempest-UnshelveToHostMultiNodesTest-1213824820 tempest-UnshelveToHostMultiNodesTest-1213824820-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 498 microversion: 2.91 time: 0.036084 Oct 19 03:14:07.459297 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 285/551] 10.222.0.52 () {60 vars in 1217 bytes} [Wed Oct 19 03:14:07 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 498 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 03:14:07.466033 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7c818dbb-4f09-4510-997b-068e16a2a4f6 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:07.466639 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7c818dbb-4f09-4510-997b-068e16a2a4f6 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] [instance: d50976fb-756b-4b12-92f2-cedf87df492d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:07.472425 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7c818dbb-4f09-4510-997b-068e16a2a4f6 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:07.472925 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7c818dbb-4f09-4510-997b-068e16a2a4f6 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:07.473433 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7c818dbb-4f09-4510-997b-068e16a2a4f6 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:07.474126 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7c818dbb-4f09-4510-997b-068e16a2a4f6 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:07.474595 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7c818dbb-4f09-4510-997b-068e16a2a4f6 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:07.475052 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7c818dbb-4f09-4510-997b-068e16a2a4f6 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:07.544112 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7c818dbb-4f09-4510-997b-068e16a2a4f6 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:07.552444 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7c818dbb-4f09-4510-997b-068e16a2a4f6 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:07.554009 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7c818dbb-4f09-4510-997b-068e16a2a4f6 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:07.559463 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7c818dbb-4f09-4510-997b-068e16a2a4f6 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] 10.222.0.52 "GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d" status: 200 len: 1418 microversion: 2.75 time: 0.097139 Oct 19 03:14:07.560335 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 286/552] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:07 2022] GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d => generated 1418 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:14:07.575638 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6540e398-01c9-4ac2-840c-2d5e8528f7c7 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:14:07.576266 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6540e398-01c9-4ac2-840c-2d5e8528f7c7 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:07.582654 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6540e398-01c9-4ac2-840c-2d5e8528f7c7 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:07.583156 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6540e398-01c9-4ac2-840c-2d5e8528f7c7 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:07.583596 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6540e398-01c9-4ac2-840c-2d5e8528f7c7 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:07.584293 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6540e398-01c9-4ac2-840c-2d5e8528f7c7 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:07.584750 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6540e398-01c9-4ac2-840c-2d5e8528f7c7 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:07.585179 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6540e398-01c9-4ac2-840c-2d5e8528f7c7 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:07.608109 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-6540e398-01c9-4ac2-840c-2d5e8528f7c7 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lazy-loading 'flavor' on Instance uuid 84092951-cf52-4077-b954-0babab66565e {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:14:08.213046 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6540e398-01c9-4ac2-840c-2d5e8528f7c7 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "POST /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e/action" status: 202 len: 0 microversion: 2.91 time: 0.642422 Oct 19 03:14:08.215527 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 287/553] 10.222.0.52 () {62 vars in 1319 bytes} [Wed Oct 19 03:14:07 2022] POST /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e/action => generated 0 bytes in 655 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:14:08.224965 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-06d059ec-f91a-484b-9476-cd7381fe49b3 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:08.226095 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-06d059ec-f91a-484b-9476-cd7381fe49b3 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:08.248392 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-06d059ec-f91a-484b-9476-cd7381fe49b3 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:08.249258 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-06d059ec-f91a-484b-9476-cd7381fe49b3 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:08.249871 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-06d059ec-f91a-484b-9476-cd7381fe49b3 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:08.250604 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-06d059ec-f91a-484b-9476-cd7381fe49b3 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:08.254048 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-06d059ec-f91a-484b-9476-cd7381fe49b3 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:08.254487 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-06d059ec-f91a-484b-9476-cd7381fe49b3 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:08.287427 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:14:08.361392 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-06d059ec-f91a-484b-9476-cd7381fe49b3 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:08.370743 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-06d059ec-f91a-484b-9476-cd7381fe49b3 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:08.372268 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-06d059ec-f91a-484b-9476-cd7381fe49b3 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:08.377610 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-06d059ec-f91a-484b-9476-cd7381fe49b3 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1539 microversion: 2.91 time: 0.157066 Oct 19 03:14:08.378510 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 288/554] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:08 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1539 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:14:08.383088 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-df2454ca-c1dc-4182-ad3a-3a3d2a3bd7e2 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:08.384199 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-df2454ca-c1dc-4182-ad3a-3a3d2a3bd7e2 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] [instance: 0de5edf9-535f-41db-b32a-06d4e9b231c3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:08.390454 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-df2454ca-c1dc-4182-ad3a-3a3d2a3bd7e2 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:08.393132 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-df2454ca-c1dc-4182-ad3a-3a3d2a3bd7e2 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:08.393616 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-df2454ca-c1dc-4182-ad3a-3a3d2a3bd7e2 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:08.394482 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-df2454ca-c1dc-4182-ad3a-3a3d2a3bd7e2 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:08.395090 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-df2454ca-c1dc-4182-ad3a-3a3d2a3bd7e2 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:08.395667 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-df2454ca-c1dc-4182-ad3a-3a3d2a3bd7e2 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:08.572409 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-df2454ca-c1dc-4182-ad3a-3a3d2a3bd7e2 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ff6534c5e74a2eb179044ef833f0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e88bbb75184a59b88e533a49d63cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:08.580693 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-df2454ca-c1dc-4182-ad3a-3a3d2a3bd7e2 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] 10.222.0.52 "GET /compute/v2.1/servers/0de5edf9-535f-41db-b32a-06d4e9b231c3" status: 200 len: 1318 microversion: 2.1 time: 0.201104 Oct 19 03:14:08.584114 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 289/555] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:08 2022] GET /compute/v2.1/servers/0de5edf9-535f-41db-b32a-06d4e9b231c3 => generated 1318 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:14:08.591359 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f96b8d4a-20f6-48f8-acf6-d451a44470a8 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:08.592686 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f96b8d4a-20f6-48f8-acf6-d451a44470a8 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:08.599627 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f96b8d4a-20f6-48f8-acf6-d451a44470a8 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:08.600680 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f96b8d4a-20f6-48f8-acf6-d451a44470a8 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:08.601117 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f96b8d4a-20f6-48f8-acf6-d451a44470a8 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:08.601927 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f96b8d4a-20f6-48f8-acf6-d451a44470a8 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:08.602387 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f96b8d4a-20f6-48f8-acf6-d451a44470a8 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:08.602806 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f96b8d4a-20f6-48f8-acf6-d451a44470a8 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:08.698374 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f96b8d4a-20f6-48f8-acf6-d451a44470a8 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:08.707782 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f96b8d4a-20f6-48f8-acf6-d451a44470a8 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667" status: 200 len: 1208 microversion: 2.1 time: 0.121637 Oct 19 03:14:08.708696 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 290/556] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:08 2022] GET /compute/v2.1/servers/ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667 => generated 1208 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:14:08.713787 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b1e9dae9-6492-46f7-9268-2d24590d12db tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:08.714497 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b1e9dae9-6492-46f7-9268-2d24590d12db tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] [instance: d50976fb-756b-4b12-92f2-cedf87df492d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:08.726724 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b1e9dae9-6492-46f7-9268-2d24590d12db tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:08.734907 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b1e9dae9-6492-46f7-9268-2d24590d12db tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:08.735323 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b1e9dae9-6492-46f7-9268-2d24590d12db tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:08.744232 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b1e9dae9-6492-46f7-9268-2d24590d12db tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:08.744232 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b1e9dae9-6492-46f7-9268-2d24590d12db tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:08.744232 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b1e9dae9-6492-46f7-9268-2d24590d12db tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:08.819330 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b1e9dae9-6492-46f7-9268-2d24590d12db tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:08.828438 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b1e9dae9-6492-46f7-9268-2d24590d12db tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:08.829913 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b1e9dae9-6492-46f7-9268-2d24590d12db tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:08.835312 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b1e9dae9-6492-46f7-9268-2d24590d12db tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] 10.222.0.52 "GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d" status: 200 len: 1416 microversion: 2.75 time: 0.125317 Oct 19 03:14:08.836072 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 291/557] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:08 2022] GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d => generated 1416 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:14:09.406348 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c9f74f80-d4f1-4e6b-b968-661b18d793e5 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:09.406983 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c9f74f80-d4f1-4e6b-b968-661b18d793e5 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:09.413415 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c9f74f80-d4f1-4e6b-b968-661b18d793e5 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:09.413906 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c9f74f80-d4f1-4e6b-b968-661b18d793e5 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:09.414340 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c9f74f80-d4f1-4e6b-b968-661b18d793e5 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:09.415028 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c9f74f80-d4f1-4e6b-b968-661b18d793e5 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:09.415478 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c9f74f80-d4f1-4e6b-b968-661b18d793e5 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:09.415909 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c9f74f80-d4f1-4e6b-b968-661b18d793e5 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:09.497330 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c9f74f80-d4f1-4e6b-b968-661b18d793e5 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:09.510098 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c9f74f80-d4f1-4e6b-b968-661b18d793e5 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:09.511834 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c9f74f80-d4f1-4e6b-b968-661b18d793e5 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:09.517647 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c9f74f80-d4f1-4e6b-b968-661b18d793e5 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1539 microversion: 2.91 time: 0.116149 Oct 19 03:14:09.518433 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 292/558] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:09 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1539 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:14:09.606733 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-8472fa20-8d60-4692-b199-97684b1d6ea0 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:09.607355 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-8472fa20-8d60-4692-b199-97684b1d6ea0 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] [instance: 0de5edf9-535f-41db-b32a-06d4e9b231c3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:09.615451 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8472fa20-8d60-4692-b199-97684b1d6ea0 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:09.616141 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8472fa20-8d60-4692-b199-97684b1d6ea0 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:09.616865 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8472fa20-8d60-4692-b199-97684b1d6ea0 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:09.617893 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8472fa20-8d60-4692-b199-97684b1d6ea0 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:09.618385 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8472fa20-8d60-4692-b199-97684b1d6ea0 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:09.618810 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8472fa20-8d60-4692-b199-97684b1d6ea0 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:09.827181 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-211b7163-00ee-4843-90b7-b05e4298e368 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/82f8d22c-99ee-4c2b-8a36-5299c187ace7/action" status: 202 len: 0 microversion: 2.25 time: 4.137168 Oct 19 03:14:09.829183 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 267/559] 10.222.0.52 () {62 vars in 1319 bytes} [Wed Oct 19 03:14:05 2022] POST /compute/v2.1/servers/82f8d22c-99ee-4c2b-8a36-5299c187ace7/action => generated 0 bytes in 4140 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:14:09.838894 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-02e7f2eb-1821-48bf-b4ea-1556a125c9e6 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:09.839511 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-02e7f2eb-1821-48bf-b4ea-1556a125c9e6 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:09.839647 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-8472fa20-8d60-4692-b199-97684b1d6ea0 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ff6534c5e74a2eb179044ef833f0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e88bbb75184a59b88e533a49d63cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:09.848911 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-02e7f2eb-1821-48bf-b4ea-1556a125c9e6 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:09.849466 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-02e7f2eb-1821-48bf-b4ea-1556a125c9e6 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:09.849915 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-02e7f2eb-1821-48bf-b4ea-1556a125c9e6 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:09.850663 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-02e7f2eb-1821-48bf-b4ea-1556a125c9e6 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:09.851129 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-02e7f2eb-1821-48bf-b4ea-1556a125c9e6 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:09.851559 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-02e7f2eb-1821-48bf-b4ea-1556a125c9e6 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:09.853754 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-8472fa20-8d60-4692-b199-97684b1d6ea0 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] 10.222.0.52 "GET /compute/v2.1/servers/0de5edf9-535f-41db-b32a-06d4e9b231c3" status: 200 len: 1318 microversion: 2.1 time: 0.250175 Oct 19 03:14:09.856332 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 293/560] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:09 2022] GET /compute/v2.1/servers/0de5edf9-535f-41db-b32a-06d4e9b231c3 => generated 1318 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:14:09.879859 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6b6809cb-4e43-40a3-b041-0ff3b74df178 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:09.880992 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6b6809cb-4e43-40a3-b041-0ff3b74df178 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 82f8d22c-99ee-4c2b-8a36-5299c187ace7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:09.889160 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6b6809cb-4e43-40a3-b041-0ff3b74df178 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:09.890392 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6b6809cb-4e43-40a3-b041-0ff3b74df178 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:09.891140 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6b6809cb-4e43-40a3-b041-0ff3b74df178 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:09.892133 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6b6809cb-4e43-40a3-b041-0ff3b74df178 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:09.892801 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6b6809cb-4e43-40a3-b041-0ff3b74df178 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:09.893568 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6b6809cb-4e43-40a3-b041-0ff3b74df178 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:10.041416 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-02e7f2eb-1821-48bf-b4ea-1556a125c9e6 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:10.054319 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-02e7f2eb-1821-48bf-b4ea-1556a125c9e6 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667" status: 200 len: 1272 microversion: 2.1 time: 0.220652 Oct 19 03:14:10.055129 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 268/561] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:09 2022] GET /compute/v2.1/servers/ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667 => generated 1272 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:14:10.065234 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-72b5c13c-4ceb-4f7d-bcbc-f9d6a0729ab1 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:10.065895 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-72b5c13c-4ceb-4f7d-bcbc-f9d6a0729ab1 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] [instance: d50976fb-756b-4b12-92f2-cedf87df492d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:10.087831 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-72b5c13c-4ceb-4f7d-bcbc-f9d6a0729ab1 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:10.088555 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-72b5c13c-4ceb-4f7d-bcbc-f9d6a0729ab1 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:10.089144 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-72b5c13c-4ceb-4f7d-bcbc-f9d6a0729ab1 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:10.090151 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-72b5c13c-4ceb-4f7d-bcbc-f9d6a0729ab1 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:10.090756 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-72b5c13c-4ceb-4f7d-bcbc-f9d6a0729ab1 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:10.091332 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-72b5c13c-4ceb-4f7d-bcbc-f9d6a0729ab1 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:10.180451 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-72b5c13c-4ceb-4f7d-bcbc-f9d6a0729ab1 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:10.191976 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-72b5c13c-4ceb-4f7d-bcbc-f9d6a0729ab1 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:10.194035 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-72b5c13c-4ceb-4f7d-bcbc-f9d6a0729ab1 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:10.200383 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-72b5c13c-4ceb-4f7d-bcbc-f9d6a0729ab1 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] 10.222.0.52 "GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d" status: 200 len: 1416 microversion: 2.75 time: 0.142067 Oct 19 03:14:10.201046 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 269/562] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:10 2022] GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d => generated 1416 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:14:10.216479 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-6b6809cb-4e43-40a3-b041-0ff3b74df178 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:10.225862 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-6b6809cb-4e43-40a3-b041-0ff3b74df178 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:10.227309 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-6b6809cb-4e43-40a3-b041-0ff3b74df178 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:10.228477 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6b6809cb-4e43-40a3-b041-0ff3b74df178 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/82f8d22c-99ee-4c2b-8a36-5299c187ace7" status: 200 len: 1566 microversion: 2.25 time: 0.370699 Oct 19 03:14:10.229213 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 294/563] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:09 2022] GET /compute/v2.1/servers/82f8d22c-99ee-4c2b-8a36-5299c187ace7 => generated 1566 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:14:10.548155 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4493abf0-761f-49c6-9780-0ce36651287e tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:10.548736 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4493abf0-761f-49c6-9780-0ce36651287e tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:10.556436 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4493abf0-761f-49c6-9780-0ce36651287e tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:10.556788 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4493abf0-761f-49c6-9780-0ce36651287e tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:10.557226 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4493abf0-761f-49c6-9780-0ce36651287e tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:10.558163 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4493abf0-761f-49c6-9780-0ce36651287e tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:10.558405 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4493abf0-761f-49c6-9780-0ce36651287e tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:10.559522 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4493abf0-761f-49c6-9780-0ce36651287e tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:10.592997 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2cad12e5-17d4-4ab3-b889-2f83cd3c7163 tempest-ServicesAdminNegativeTestJSON-1685290874 tempest-ServicesAdminNegativeTestJSON-1685290874-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:10.596916 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2cad12e5-17d4-4ab3-b889-2f83cd3c7163 tempest-ServicesAdminNegativeTestJSON-1685290874 tempest-ServicesAdminNegativeTestJSON-1685290874-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:10.597527 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2cad12e5-17d4-4ab3-b889-2f83cd3c7163 tempest-ServicesAdminNegativeTestJSON-1685290874 tempest-ServicesAdminNegativeTestJSON-1685290874-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:10.597968 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2cad12e5-17d4-4ab3-b889-2f83cd3c7163 tempest-ServicesAdminNegativeTestJSON-1685290874 tempest-ServicesAdminNegativeTestJSON-1685290874-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:10.598869 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2cad12e5-17d4-4ab3-b889-2f83cd3c7163 tempest-ServicesAdminNegativeTestJSON-1685290874 tempest-ServicesAdminNegativeTestJSON-1685290874-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:10.599325 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2cad12e5-17d4-4ab3-b889-2f83cd3c7163 tempest-ServicesAdminNegativeTestJSON-1685290874 tempest-ServicesAdminNegativeTestJSON-1685290874-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:10.599746 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2cad12e5-17d4-4ab3-b889-2f83cd3c7163 tempest-ServicesAdminNegativeTestJSON-1685290874 tempest-ServicesAdminNegativeTestJSON-1685290874-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:10.647758 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4493abf0-761f-49c6-9780-0ce36651287e tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:10.647941 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2cad12e5-17d4-4ab3-b889-2f83cd3c7163 tempest-ServicesAdminNegativeTestJSON-1685290874 tempest-ServicesAdminNegativeTestJSON-1685290874-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.193332 Oct 19 03:14:10.652148 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 270/564] 10.222.0.52 () {58 vars in 1137 bytes} [Wed Oct 19 03:14:10 2022] GET /compute/v2.1/os-services => generated 944 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:14:10.665261 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-38fba1c3-1bc3-44bc-8324-482e133ccb87 tempest-ServicesAdminNegativeTestJSON-1685290874 tempest-ServicesAdminNegativeTestJSON-1685290874-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:10.665945 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4493abf0-761f-49c6-9780-0ce36651287e tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:10.669321 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-38fba1c3-1bc3-44bc-8324-482e133ccb87 tempest-ServicesAdminNegativeTestJSON-1685290874 tempest-ServicesAdminNegativeTestJSON-1685290874-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:10.670566 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4493abf0-761f-49c6-9780-0ce36651287e tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:10.673524 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-38fba1c3-1bc3-44bc-8324-482e133ccb87 tempest-ServicesAdminNegativeTestJSON-1685290874 tempest-ServicesAdminNegativeTestJSON-1685290874-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:10.673989 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-38fba1c3-1bc3-44bc-8324-482e133ccb87 tempest-ServicesAdminNegativeTestJSON-1685290874 tempest-ServicesAdminNegativeTestJSON-1685290874-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:10.675003 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-38fba1c3-1bc3-44bc-8324-482e133ccb87 tempest-ServicesAdminNegativeTestJSON-1685290874 tempest-ServicesAdminNegativeTestJSON-1685290874-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:10.675532 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-38fba1c3-1bc3-44bc-8324-482e133ccb87 tempest-ServicesAdminNegativeTestJSON-1685290874 tempest-ServicesAdminNegativeTestJSON-1685290874-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:10.676024 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-38fba1c3-1bc3-44bc-8324-482e133ccb87 tempest-ServicesAdminNegativeTestJSON-1685290874 tempest-ServicesAdminNegativeTestJSON-1685290874-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:10.678342 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4493abf0-761f-49c6-9780-0ce36651287e tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1539 microversion: 2.91 time: 0.133908 Oct 19 03:14:10.678920 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 295/565] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:10 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1539 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:14:10.717984 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-38fba1c3-1bc3-44bc-8324-482e133ccb87 tempest-ServicesAdminNegativeTestJSON-1685290874 tempest-ServicesAdminNegativeTestJSON-1685290874-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.057040 Oct 19 03:14:10.718752 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 271/566] 10.222.0.52 () {58 vars in 1170 bytes} [Wed Oct 19 03:14:10 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 944 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:14:10.738226 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-07359b6e-265c-48c4-bcf4-d0a723bc1427 tempest-ServicesAdminNegativeTestJSON-1685290874 tempest-ServicesAdminNegativeTestJSON-1685290874-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:10.742104 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-07359b6e-265c-48c4-bcf4-d0a723bc1427 tempest-ServicesAdminNegativeTestJSON-1685290874 tempest-ServicesAdminNegativeTestJSON-1685290874-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:10.742702 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-07359b6e-265c-48c4-bcf4-d0a723bc1427 tempest-ServicesAdminNegativeTestJSON-1685290874 tempest-ServicesAdminNegativeTestJSON-1685290874-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:10.743209 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-07359b6e-265c-48c4-bcf4-d0a723bc1427 tempest-ServicesAdminNegativeTestJSON-1685290874 tempest-ServicesAdminNegativeTestJSON-1685290874-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:10.744147 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-07359b6e-265c-48c4-bcf4-d0a723bc1427 tempest-ServicesAdminNegativeTestJSON-1685290874 tempest-ServicesAdminNegativeTestJSON-1685290874-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:10.744765 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-07359b6e-265c-48c4-bcf4-d0a723bc1427 tempest-ServicesAdminNegativeTestJSON-1685290874 tempest-ServicesAdminNegativeTestJSON-1685290874-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:10.745795 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-07359b6e-265c-48c4-bcf4-d0a723bc1427 tempest-ServicesAdminNegativeTestJSON-1685290874 tempest-ServicesAdminNegativeTestJSON-1685290874-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:10.758369 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:14:10.777594 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-07359b6e-265c-48c4-bcf4-d0a723bc1427 tempest-ServicesAdminNegativeTestJSON-1685290874 tempest-ServicesAdminNegativeTestJSON-1685290874-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.043198 Oct 19 03:14:10.778787 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 296/567] 10.222.0.52 () {58 vars in 1137 bytes} [Wed Oct 19 03:14:10 2022] GET /compute/v2.1/os-services => generated 944 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:14:10.791636 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6d331bf8-11f4-4c8c-8353-0309c518b9a2 tempest-ServicesAdminNegativeTestJSON-1685290874 tempest-ServicesAdminNegativeTestJSON-1685290874-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:10.796902 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6d331bf8-11f4-4c8c-8353-0309c518b9a2 tempest-ServicesAdminNegativeTestJSON-1685290874 tempest-ServicesAdminNegativeTestJSON-1685290874-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:10.798443 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6d331bf8-11f4-4c8c-8353-0309c518b9a2 tempest-ServicesAdminNegativeTestJSON-1685290874 tempest-ServicesAdminNegativeTestJSON-1685290874-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:10.804478 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6d331bf8-11f4-4c8c-8353-0309c518b9a2 tempest-ServicesAdminNegativeTestJSON-1685290874 tempest-ServicesAdminNegativeTestJSON-1685290874-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:10.804478 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6d331bf8-11f4-4c8c-8353-0309c518b9a2 tempest-ServicesAdminNegativeTestJSON-1685290874 tempest-ServicesAdminNegativeTestJSON-1685290874-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:10.804478 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6d331bf8-11f4-4c8c-8353-0309c518b9a2 tempest-ServicesAdminNegativeTestJSON-1685290874 tempest-ServicesAdminNegativeTestJSON-1685290874-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:10.804478 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6d331bf8-11f4-4c8c-8353-0309c518b9a2 tempest-ServicesAdminNegativeTestJSON-1685290874 tempest-ServicesAdminNegativeTestJSON-1685290874-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:10.860420 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6d331bf8-11f4-4c8c-8353-0309c518b9a2 tempest-ServicesAdminNegativeTestJSON-1685290874 tempest-ServicesAdminNegativeTestJSON-1685290874-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services?host=n-d-861333-8&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.073168 Oct 19 03:14:10.861047 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 272/568] 10.222.0.52 () {58 vars in 1194 bytes} [Wed Oct 19 03:14:10 2022] GET /compute/v2.1/os-services?host=n-d-861333-8&binary=xxx => generated 16 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 03:14:10.877781 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1bc0c49a-6e01-4a97-b992-10d8cac5105e tempest-ServicesAdminNegativeTestJSON-1685290874 tempest-ServicesAdminNegativeTestJSON-1685290874-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:10.878609 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1bc0c49a-6e01-4a97-b992-10d8cac5105e tempest-ServicesAdminNegativeTestJSON-1685290874 tempest-ServicesAdminNegativeTestJSON-1685290874-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:10.879188 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1bc0c49a-6e01-4a97-b992-10d8cac5105e tempest-ServicesAdminNegativeTestJSON-1685290874 tempest-ServicesAdminNegativeTestJSON-1685290874-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:10.880873 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1bc0c49a-6e01-4a97-b992-10d8cac5105e tempest-ServicesAdminNegativeTestJSON-1685290874 tempest-ServicesAdminNegativeTestJSON-1685290874-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:10.881868 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1bc0c49a-6e01-4a97-b992-10d8cac5105e tempest-ServicesAdminNegativeTestJSON-1685290874 tempest-ServicesAdminNegativeTestJSON-1685290874-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:10.885009 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1bc0c49a-6e01-4a97-b992-10d8cac5105e tempest-ServicesAdminNegativeTestJSON-1685290874 tempest-ServicesAdminNegativeTestJSON-1685290874-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:10.886314 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1bc0c49a-6e01-4a97-b992-10d8cac5105e tempest-ServicesAdminNegativeTestJSON-1685290874 tempest-ServicesAdminNegativeTestJSON-1685290874-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:10.893767 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b9ff9786-6622-4111-add0-d6dacd5636f4 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:10.896617 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b9ff9786-6622-4111-add0-d6dacd5636f4 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] [instance: 0de5edf9-535f-41db-b32a-06d4e9b231c3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:10.913283 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b9ff9786-6622-4111-add0-d6dacd5636f4 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:10.915750 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b9ff9786-6622-4111-add0-d6dacd5636f4 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:10.916306 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b9ff9786-6622-4111-add0-d6dacd5636f4 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:10.917859 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b9ff9786-6622-4111-add0-d6dacd5636f4 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:10.919407 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b9ff9786-6622-4111-add0-d6dacd5636f4 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:10.923707 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b9ff9786-6622-4111-add0-d6dacd5636f4 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:10.955483 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1bc0c49a-6e01-4a97-b992-10d8cac5105e tempest-ServicesAdminNegativeTestJSON-1685290874 tempest-ServicesAdminNegativeTestJSON-1685290874-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.085255 Oct 19 03:14:10.968099 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 297/569] 10.222.0.52 () {58 vars in 1137 bytes} [Wed Oct 19 03:14:10 2022] GET /compute/v2.1/os-services => generated 944 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:14:10.985348 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f5a8187c-6f59-4f63-a095-31fd79e90f96 tempest-ServicesAdminNegativeTestJSON-1685290874 tempest-ServicesAdminNegativeTestJSON-1685290874-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:10.988863 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f5a8187c-6f59-4f63-a095-31fd79e90f96 tempest-ServicesAdminNegativeTestJSON-1685290874 tempest-ServicesAdminNegativeTestJSON-1685290874-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:10.989737 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f5a8187c-6f59-4f63-a095-31fd79e90f96 tempest-ServicesAdminNegativeTestJSON-1685290874 tempest-ServicesAdminNegativeTestJSON-1685290874-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:10.990696 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f5a8187c-6f59-4f63-a095-31fd79e90f96 tempest-ServicesAdminNegativeTestJSON-1685290874 tempest-ServicesAdminNegativeTestJSON-1685290874-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:10.993220 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f5a8187c-6f59-4f63-a095-31fd79e90f96 tempest-ServicesAdminNegativeTestJSON-1685290874 tempest-ServicesAdminNegativeTestJSON-1685290874-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:10.994070 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f5a8187c-6f59-4f63-a095-31fd79e90f96 tempest-ServicesAdminNegativeTestJSON-1685290874 tempest-ServicesAdminNegativeTestJSON-1685290874-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:10.994659 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f5a8187c-6f59-4f63-a095-31fd79e90f96 tempest-ServicesAdminNegativeTestJSON-1685290874 tempest-ServicesAdminNegativeTestJSON-1685290874-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:11.034821 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f5a8187c-6f59-4f63-a095-31fd79e90f96 tempest-ServicesAdminNegativeTestJSON-1685290874 tempest-ServicesAdminNegativeTestJSON-1685290874-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.065186 Oct 19 03:14:11.037130 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 298/570] 10.222.0.52 () {58 vars in 1198 bytes} [Wed Oct 19 03:14:10 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 03:14:11.269740 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b9ff9786-6622-4111-add0-d6dacd5636f4 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ff6534c5e74a2eb179044ef833f0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e88bbb75184a59b88e533a49d63cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:11.281092 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b9ff9786-6622-4111-add0-d6dacd5636f4 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] 10.222.0.52 "GET /compute/v2.1/servers/0de5edf9-535f-41db-b32a-06d4e9b231c3" status: 200 len: 1318 microversion: 2.1 time: 0.399947 Oct 19 03:14:11.283012 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 273/571] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:10 2022] GET /compute/v2.1/servers/0de5edf9-535f-41db-b32a-06d4e9b231c3 => generated 1318 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:14:11.288544 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-90765dc2-c894-406d-a11e-4400a99171b1 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:11.289733 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-90765dc2-c894-406d-a11e-4400a99171b1 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:11.297620 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-90765dc2-c894-406d-a11e-4400a99171b1 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:11.298420 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-90765dc2-c894-406d-a11e-4400a99171b1 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:11.298865 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-90765dc2-c894-406d-a11e-4400a99171b1 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:11.299893 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-90765dc2-c894-406d-a11e-4400a99171b1 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:11.300507 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-90765dc2-c894-406d-a11e-4400a99171b1 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:11.301392 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-90765dc2-c894-406d-a11e-4400a99171b1 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:11.379288 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-573b6f33-6ce6-495b-8cd3-c2b3fd50146b tempest-ServicesAdminNegativeTestJSON-1304797334 tempest-ServicesAdminNegativeTestJSON-1304797334-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:11.388125 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-573b6f33-6ce6-495b-8cd3-c2b3fd50146b tempest-ServicesAdminNegativeTestJSON-1304797334 tempest-ServicesAdminNegativeTestJSON-1304797334-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '898f69d53f2041d4b7d6594f1daf1aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2621be4f1464b5092a94cd2751d3cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:11.390295 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-573b6f33-6ce6-495b-8cd3-c2b3fd50146b tempest-ServicesAdminNegativeTestJSON-1304797334 tempest-ServicesAdminNegativeTestJSON-1304797334-project] Request method failure captured: Oct 19 03:14:11.390295 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 19 03:14:11.390295 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:14:11.390295 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:14:11.390295 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:14:11.390295 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:14:11.390295 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:14:11.390295 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:14:11.390295 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:14:11.390295 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:14:11.390295 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2uBE4b1rAI1PS3HNkMebFylIcyVOjAZZlyUtoVAg8OwCsxxmxA2ozG8TN1EJ5cSiPagbvHGsesFo40z4bnyXzyh25TKM3i9OiXyNWd2FrZDqHRVL_VbRaAsCrohDQhHfDGO4ItOSCD3LhaFjMs4_hTtpxqCWUWgGaMvUpESsAIYau8 Oct 19 03:14:11.390295 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:14:11.390295 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:14:11.390295 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:14:11.390295 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:14:11.390295 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:14:11.390295 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:14:11.390295 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: a2621be4f1464b5092a94cd2751d3cf4 Oct 19 03:14:11.390295 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-1304797334 Oct 19 03:14:11.390295 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:14:11.390295 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:14:11.391841 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a2621be4f1464b5092a94cd2751d3cf4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a2621be4f1464b5092a94cd2751d3cf4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a2621be4f1464b5092a94cd2751d3cf4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a2621be4f1464b5092a94cd2751d3cf4", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:14:11.391841 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-1304797334 Oct 19 03:14:11.391841 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: a2621be4f1464b5092a94cd2751d3cf4 Oct 19 03:14:11.391841 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-1304797334 Oct 19 03:14:11.391841 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ServicesAdminNegativeTestJSON-1304797334-project Oct 19 03:14:11.391841 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:14:11.391841 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:14:11.391841 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 898f69d53f2041d4b7d6594f1daf1aab Oct 19 03:14:11.391841 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-1304797334-project Oct 19 03:14:11.391841 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:14:11.391841 n-d-861333-8 devstack@n-api.service[121135]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 19 03:14:11.391841 n-d-861333-8 devstack@n-api.service[121135]: action_args: {} Oct 19 03:14:11.392669 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:14:11.392669 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:14:11.392669 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:14:11.392669 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:14:11.392669 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:14:11.392669 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:14:11.392669 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 19 03:14:11.392669 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:14:11.392669 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 19 03:14:11.392669 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:14:11.392669 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:14:11.392669 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:14:11.392669 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 19 03:14:11.392669 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 19 03:14:11.392669 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 19 03:14:11.392669 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 19 03:14:11.392669 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 19 03:14:11.392669 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 19 03:14:11.392669 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 03:14:11.394045 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 03:14:11.394045 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 03:14:11.394045 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 03:14:11.394045 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 19 03:14:11.394045 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 19 03:14:11.394045 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 19 03:14:11.394045 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 19 03:14:11.394045 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 19 03:14:11.394045 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 19 03:14:11.394045 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 19 03:14:11.394045 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:14:11.394045 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:14:11.394045 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:14:11.394045 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:14:11.394045 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:14:11.394045 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:14:11.394045 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 19 03:14:11.394045 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 19 03:14:11.394045 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 19 03:14:11.394045 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:14:11.396471 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-573b6f33-6ce6-495b-8cd3-c2b3fd50146b tempest-ServicesAdminNegativeTestJSON-1304797334 tempest-ServicesAdminNegativeTestJSON-1304797334-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:14:11.397515 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-573b6f33-6ce6-495b-8cd3-c2b3fd50146b tempest-ServicesAdminNegativeTestJSON-1304797334 tempest-ServicesAdminNegativeTestJSON-1304797334-project] 10.222.0.52 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.350616 Oct 19 03:14:11.398572 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 299/572] 10.222.0.52 () {58 vars in 1137 bytes} [Wed Oct 19 03:14:11 2022] GET /compute/v2.1/os-services => generated 112 bytes in 352 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 19 03:14:11.405351 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0a0e7407-3621-46af-ae5a-06ebfb062dc5 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:11.406980 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0a0e7407-3621-46af-ae5a-06ebfb062dc5 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] [instance: d50976fb-756b-4b12-92f2-cedf87df492d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:11.414502 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0a0e7407-3621-46af-ae5a-06ebfb062dc5 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:11.415232 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0a0e7407-3621-46af-ae5a-06ebfb062dc5 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:11.416253 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0a0e7407-3621-46af-ae5a-06ebfb062dc5 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:11.417120 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0a0e7407-3621-46af-ae5a-06ebfb062dc5 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:11.417818 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0a0e7407-3621-46af-ae5a-06ebfb062dc5 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:11.418953 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0a0e7407-3621-46af-ae5a-06ebfb062dc5 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:11.523266 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-0a0e7407-3621-46af-ae5a-06ebfb062dc5 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:11.538697 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-0a0e7407-3621-46af-ae5a-06ebfb062dc5 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:11.540780 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-0a0e7407-3621-46af-ae5a-06ebfb062dc5 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:11.550133 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0a0e7407-3621-46af-ae5a-06ebfb062dc5 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] 10.222.0.52 "GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d" status: 200 len: 1416 microversion: 2.75 time: 0.149689 Oct 19 03:14:11.552171 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 300/573] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:11 2022] GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d => generated 1416 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:14:11.571406 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-25d2067e-debd-4501-b253-28b2ede49521 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:11.572349 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-25d2067e-debd-4501-b253-28b2ede49521 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 82f8d22c-99ee-4c2b-8a36-5299c187ace7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:11.588044 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-25d2067e-debd-4501-b253-28b2ede49521 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:11.588889 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-25d2067e-debd-4501-b253-28b2ede49521 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:11.590885 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-25d2067e-debd-4501-b253-28b2ede49521 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:11.593287 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-25d2067e-debd-4501-b253-28b2ede49521 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:11.594235 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-25d2067e-debd-4501-b253-28b2ede49521 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:11.595117 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-25d2067e-debd-4501-b253-28b2ede49521 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:11.636517 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-90765dc2-c894-406d-a11e-4400a99171b1 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:11.647491 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-90765dc2-c894-406d-a11e-4400a99171b1 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667" status: 200 len: 1312 microversion: 2.1 time: 0.363231 Oct 19 03:14:11.648649 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 274/574] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:11 2022] GET /compute/v2.1/servers/ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667 => generated 1312 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:14:11.659111 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-8ffccf58-abaf-4dd0-903e-890765e284bd req-2a246539-c757-4a45-857a-48e8fed50871 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0de5edf9-535f-41db-b32a-06d4e9b231c3", "name": "network-vif-plugged", "status": "completed", "tag": "1ac620b0-a502-4413-90af-a2d6fb393e36"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:14:11.699728 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-8ffccf58-abaf-4dd0-903e-890765e284bd req-2a246539-c757-4a45-857a-48e8fed50871 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:11.701021 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-8ffccf58-abaf-4dd0-903e-890765e284bd req-2a246539-c757-4a45-857a-48e8fed50871 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:11.701729 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-8ffccf58-abaf-4dd0-903e-890765e284bd req-2a246539-c757-4a45-857a-48e8fed50871 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:11.720371 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-8ffccf58-abaf-4dd0-903e-890765e284bd req-2a246539-c757-4a45-857a-48e8fed50871 service nova] Creating event network-vif-plugged:1ac620b0-a502-4413-90af-a2d6fb393e36 for instance 0de5edf9-535f-41db-b32a-06d4e9b231c3 on n-h1-861333-8 Oct 19 03:14:11.727376 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-8ffccf58-abaf-4dd0-903e-890765e284bd req-2a246539-c757-4a45-857a-48e8fed50871 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077285 Oct 19 03:14:11.734360 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 275/575] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:14:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:14:11.747855 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-62845c93-7086-4d5b-88f6-15ca3589bc50 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:11.747855 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-62845c93-7086-4d5b-88f6-15ca3589bc50 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:11.755178 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-62845c93-7086-4d5b-88f6-15ca3589bc50 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:11.755718 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-62845c93-7086-4d5b-88f6-15ca3589bc50 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:11.756239 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-62845c93-7086-4d5b-88f6-15ca3589bc50 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:11.757007 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-62845c93-7086-4d5b-88f6-15ca3589bc50 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:11.758486 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-62845c93-7086-4d5b-88f6-15ca3589bc50 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:11.759391 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-62845c93-7086-4d5b-88f6-15ca3589bc50 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:11.865229 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-25d2067e-debd-4501-b253-28b2ede49521 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:11.877299 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-25d2067e-debd-4501-b253-28b2ede49521 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:11.881918 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-25d2067e-debd-4501-b253-28b2ede49521 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:11.888091 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-25d2067e-debd-4501-b253-28b2ede49521 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/82f8d22c-99ee-4c2b-8a36-5299c187ace7" status: 200 len: 1566 microversion: 2.25 time: 0.334268 Oct 19 03:14:11.888857 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 301/576] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:11 2022] GET /compute/v2.1/servers/82f8d22c-99ee-4c2b-8a36-5299c187ace7 => generated 1566 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:14:11.964210 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-62845c93-7086-4d5b-88f6-15ca3589bc50 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:11.980755 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-62845c93-7086-4d5b-88f6-15ca3589bc50 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:11.982511 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-62845c93-7086-4d5b-88f6-15ca3589bc50 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:11.992634 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-62845c93-7086-4d5b-88f6-15ca3589bc50 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1539 microversion: 2.91 time: 0.256611 Oct 19 03:14:11.993232 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 276/577] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:11 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1539 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:14:12.304883 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4a8d2a49-c549-4fa2-bc06-b9f9e7caee32 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:12.305592 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4a8d2a49-c549-4fa2-bc06-b9f9e7caee32 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] [instance: 0de5edf9-535f-41db-b32a-06d4e9b231c3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:12.312512 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4a8d2a49-c549-4fa2-bc06-b9f9e7caee32 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:12.313255 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4a8d2a49-c549-4fa2-bc06-b9f9e7caee32 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:12.313953 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4a8d2a49-c549-4fa2-bc06-b9f9e7caee32 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:12.314822 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4a8d2a49-c549-4fa2-bc06-b9f9e7caee32 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:12.315427 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4a8d2a49-c549-4fa2-bc06-b9f9e7caee32 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:12.316014 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4a8d2a49-c549-4fa2-bc06-b9f9e7caee32 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:12.508698 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4a8d2a49-c549-4fa2-bc06-b9f9e7caee32 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ff6534c5e74a2eb179044ef833f0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e88bbb75184a59b88e533a49d63cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:12.520598 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4a8d2a49-c549-4fa2-bc06-b9f9e7caee32 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] 10.222.0.52 "GET /compute/v2.1/servers/0de5edf9-535f-41db-b32a-06d4e9b231c3" status: 200 len: 1318 microversion: 2.1 time: 0.219560 Oct 19 03:14:12.525972 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 302/578] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:12 2022] GET /compute/v2.1/servers/0de5edf9-535f-41db-b32a-06d4e9b231c3 => generated 1318 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:14:12.533972 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-a19f6e27-8487-4fd2-acd1-c433fcf01105 req-c1807d59-7ff5-4d66-9670-9421fb867823 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667", "tag": "93027c05-97a2-4189-89b6-b07e9d59b6c4"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:14:12.545646 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-a19f6e27-8487-4fd2-acd1-c433fcf01105 req-c1807d59-7ff5-4d66-9670-9421fb867823 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:12.546448 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-a19f6e27-8487-4fd2-acd1-c433fcf01105 req-c1807d59-7ff5-4d66-9670-9421fb867823 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:12.547072 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-a19f6e27-8487-4fd2-acd1-c433fcf01105 req-c1807d59-7ff5-4d66-9670-9421fb867823 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:12.560911 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-a19f6e27-8487-4fd2-acd1-c433fcf01105 req-c1807d59-7ff5-4d66-9670-9421fb867823 service nova] Creating event network-changed:93027c05-97a2-4189-89b6-b07e9d59b6c4 for instance ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667 on n-h2-861333-8 Oct 19 03:14:12.566644 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-a19f6e27-8487-4fd2-acd1-c433fcf01105 req-c1807d59-7ff5-4d66-9670-9421fb867823 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036154 Oct 19 03:14:12.567590 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 277/579] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:14:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:14:12.581847 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-233d700f-d4b7-4740-b777-99cbd6300cc8 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:12.582680 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-233d700f-d4b7-4740-b777-99cbd6300cc8 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] [instance: d50976fb-756b-4b12-92f2-cedf87df492d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:12.591000 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-233d700f-d4b7-4740-b777-99cbd6300cc8 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:12.591909 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-233d700f-d4b7-4740-b777-99cbd6300cc8 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:12.592379 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-233d700f-d4b7-4740-b777-99cbd6300cc8 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:12.593211 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-233d700f-d4b7-4740-b777-99cbd6300cc8 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:12.594454 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-233d700f-d4b7-4740-b777-99cbd6300cc8 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:12.595051 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-233d700f-d4b7-4740-b777-99cbd6300cc8 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:12.674835 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5dcfa94f-3a09-4be2-8eb4-5a1622cbda7b tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:12.676299 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5dcfa94f-3a09-4be2-8eb4-5a1622cbda7b tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:12.684480 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5dcfa94f-3a09-4be2-8eb4-5a1622cbda7b tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:12.685347 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5dcfa94f-3a09-4be2-8eb4-5a1622cbda7b tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:12.686784 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5dcfa94f-3a09-4be2-8eb4-5a1622cbda7b tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:12.687611 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5dcfa94f-3a09-4be2-8eb4-5a1622cbda7b tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:12.688155 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5dcfa94f-3a09-4be2-8eb4-5a1622cbda7b tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:12.688588 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5dcfa94f-3a09-4be2-8eb4-5a1622cbda7b tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:12.716621 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-233d700f-d4b7-4740-b777-99cbd6300cc8 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:12.735986 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-233d700f-d4b7-4740-b777-99cbd6300cc8 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:12.737866 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-233d700f-d4b7-4740-b777-99cbd6300cc8 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:12.744003 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-233d700f-d4b7-4740-b777-99cbd6300cc8 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] 10.222.0.52 "GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d" status: 200 len: 1416 microversion: 2.75 time: 0.167673 Oct 19 03:14:12.745212 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 303/580] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:12 2022] GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d => generated 1416 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:14:12.871712 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5dcfa94f-3a09-4be2-8eb4-5a1622cbda7b tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:12.880426 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5dcfa94f-3a09-4be2-8eb4-5a1622cbda7b tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667" status: 200 len: 1312 microversion: 2.1 time: 0.210730 Oct 19 03:14:12.880902 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 278/581] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:12 2022] GET /compute/v2.1/servers/ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667 => generated 1312 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:14:12.915393 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-717affc1-773b-4511-b3a6-1abf6caa5c85 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:12.916278 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-717affc1-773b-4511-b3a6-1abf6caa5c85 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 82f8d22c-99ee-4c2b-8a36-5299c187ace7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:12.923937 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-717affc1-773b-4511-b3a6-1abf6caa5c85 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:12.924972 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-717affc1-773b-4511-b3a6-1abf6caa5c85 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:12.925673 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-717affc1-773b-4511-b3a6-1abf6caa5c85 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:12.926441 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-717affc1-773b-4511-b3a6-1abf6caa5c85 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:12.926900 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-717affc1-773b-4511-b3a6-1abf6caa5c85 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:12.927513 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-717affc1-773b-4511-b3a6-1abf6caa5c85 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:13.023378 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1328938d-4ddf-485c-97b9-20133780fa67 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:13.024070 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1328938d-4ddf-485c-97b9-20133780fa67 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:13.028937 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=6,nova_api:UPDATE=12 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:14:13.033272 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1328938d-4ddf-485c-97b9-20133780fa67 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:13.033850 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1328938d-4ddf-485c-97b9-20133780fa67 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:13.034298 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1328938d-4ddf-485c-97b9-20133780fa67 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:13.035028 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1328938d-4ddf-485c-97b9-20133780fa67 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:13.035495 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1328938d-4ddf-485c-97b9-20133780fa67 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:13.035924 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1328938d-4ddf-485c-97b9-20133780fa67 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:13.235585 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-1328938d-4ddf-485c-97b9-20133780fa67 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:13.244955 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-1328938d-4ddf-485c-97b9-20133780fa67 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:13.245885 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-1328938d-4ddf-485c-97b9-20133780fa67 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:13.251143 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1328938d-4ddf-485c-97b9-20133780fa67 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1539 microversion: 2.91 time: 0.232332 Oct 19 03:14:13.251791 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 279/582] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:13 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1539 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:14:13.336554 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-717affc1-773b-4511-b3a6-1abf6caa5c85 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:13.345474 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-717affc1-773b-4511-b3a6-1abf6caa5c85 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:13.346913 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-717affc1-773b-4511-b3a6-1abf6caa5c85 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:13.348059 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-717affc1-773b-4511-b3a6-1abf6caa5c85 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/82f8d22c-99ee-4c2b-8a36-5299c187ace7" status: 200 len: 1566 microversion: 2.25 time: 0.437355 Oct 19 03:14:13.348666 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 304/583] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:12 2022] GET /compute/v2.1/servers/82f8d22c-99ee-4c2b-8a36-5299c187ace7 => generated 1566 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:14:13.549805 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a919d712-a99c-43f7-906d-c0023e66d795 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:13.549805 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a919d712-a99c-43f7-906d-c0023e66d795 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] [instance: 0de5edf9-535f-41db-b32a-06d4e9b231c3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:13.554093 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a919d712-a99c-43f7-906d-c0023e66d795 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:13.554882 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a919d712-a99c-43f7-906d-c0023e66d795 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:13.555331 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a919d712-a99c-43f7-906d-c0023e66d795 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:13.556243 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a919d712-a99c-43f7-906d-c0023e66d795 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:13.556741 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a919d712-a99c-43f7-906d-c0023e66d795 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:13.557171 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a919d712-a99c-43f7-906d-c0023e66d795 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:13.774213 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a919d712-a99c-43f7-906d-c0023e66d795 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ff6534c5e74a2eb179044ef833f0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e88bbb75184a59b88e533a49d63cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:13.782433 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-82232756-8b68-4d79-b7ef-b099924b3be2 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:13.782433 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-82232756-8b68-4d79-b7ef-b099924b3be2 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] [instance: d50976fb-756b-4b12-92f2-cedf87df492d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:13.785355 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-82232756-8b68-4d79-b7ef-b099924b3be2 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:13.785996 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-82232756-8b68-4d79-b7ef-b099924b3be2 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:13.786250 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:14:13.786443 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-82232756-8b68-4d79-b7ef-b099924b3be2 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:13.787338 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-82232756-8b68-4d79-b7ef-b099924b3be2 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:13.787971 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-82232756-8b68-4d79-b7ef-b099924b3be2 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:13.788844 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-82232756-8b68-4d79-b7ef-b099924b3be2 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:13.789716 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a919d712-a99c-43f7-906d-c0023e66d795 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] 10.222.0.52 "GET /compute/v2.1/servers/0de5edf9-535f-41db-b32a-06d4e9b231c3" status: 200 len: 1318 microversion: 2.1 time: 0.248302 Oct 19 03:14:13.790775 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 280/584] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:13 2022] GET /compute/v2.1/servers/0de5edf9-535f-41db-b32a-06d4e9b231c3 => generated 1318 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:14:13.906377 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-593aa021-3aa4-4906-a8aa-40962d4a5872 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:13.907298 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-593aa021-3aa4-4906-a8aa-40962d4a5872 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:13.916606 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-593aa021-3aa4-4906-a8aa-40962d4a5872 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:13.917528 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-593aa021-3aa4-4906-a8aa-40962d4a5872 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:13.918157 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-82232756-8b68-4d79-b7ef-b099924b3be2 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:13.918522 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-593aa021-3aa4-4906-a8aa-40962d4a5872 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:13.919527 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-593aa021-3aa4-4906-a8aa-40962d4a5872 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:13.920437 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-593aa021-3aa4-4906-a8aa-40962d4a5872 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:13.921059 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-593aa021-3aa4-4906-a8aa-40962d4a5872 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:13.933021 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-82232756-8b68-4d79-b7ef-b099924b3be2 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:13.938103 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-82232756-8b68-4d79-b7ef-b099924b3be2 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:13.951706 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-82232756-8b68-4d79-b7ef-b099924b3be2 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] 10.222.0.52 "GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d" status: 200 len: 1437 microversion: 2.75 time: 0.183123 Oct 19 03:14:13.954560 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 305/585] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:13 2022] GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d => generated 1437 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:14:13.982467 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d8067bf3-d4a2-4646-8104-a7b76c662bb5 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:14:13.985614 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d8067bf3-d4a2-4646-8104-a7b76c662bb5 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] [instance: d50976fb-756b-4b12-92f2-cedf87df492d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:13.992135 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d8067bf3-d4a2-4646-8104-a7b76c662bb5 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:13.992890 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d8067bf3-d4a2-4646-8104-a7b76c662bb5 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:13.993336 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d8067bf3-d4a2-4646-8104-a7b76c662bb5 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:13.994070 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d8067bf3-d4a2-4646-8104-a7b76c662bb5 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:13.994531 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d8067bf3-d4a2-4646-8104-a7b76c662bb5 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:13.995005 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d8067bf3-d4a2-4646-8104-a7b76c662bb5 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:14.081046 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-593aa021-3aa4-4906-a8aa-40962d4a5872 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:14.089486 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-d8067bf3-d4a2-4646-8104-a7b76c662bb5 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Flavor limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:14:14.090232 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-593aa021-3aa4-4906-a8aa-40962d4a5872 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667" status: 200 len: 1312 microversion: 2.1 time: 0.189454 Oct 19 03:14:14.090718 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-d8067bf3-d4a2-4646-8104-a7b76c662bb5 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Image limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:14:14.091189 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 281/586] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:13 2022] GET /compute/v2.1/servers/ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667 => generated 1312 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:14:14.091519 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-d8067bf3-d4a2-4646-8104-a7b76c662bb5 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Flavor pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:14:14.092175 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-d8067bf3-d4a2-4646-8104-a7b76c662bb5 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Image pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:14:14.092599 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-d8067bf3-d4a2-4646-8104-a7b76c662bb5 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:14:14.237151 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:14:14.280823 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-51251a02-1074-4ed1-91fa-d404febc30b3 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:14.281563 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-51251a02-1074-4ed1-91fa-d404febc30b3 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:14.288689 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-51251a02-1074-4ed1-91fa-d404febc30b3 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:14.290115 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-51251a02-1074-4ed1-91fa-d404febc30b3 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:14.290115 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-51251a02-1074-4ed1-91fa-d404febc30b3 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:14.290707 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-51251a02-1074-4ed1-91fa-d404febc30b3 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:14.291235 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-51251a02-1074-4ed1-91fa-d404febc30b3 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:14.291737 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-51251a02-1074-4ed1-91fa-d404febc30b3 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:14.377774 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-51251a02-1074-4ed1-91fa-d404febc30b3 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:14.386523 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-51251a02-1074-4ed1-91fa-d404febc30b3 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:14.388365 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-51251a02-1074-4ed1-91fa-d404febc30b3 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:14.394437 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-51251a02-1074-4ed1-91fa-d404febc30b3 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1539 microversion: 2.91 time: 0.118135 Oct 19 03:14:14.395026 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 282/587] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:14 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1539 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:14:14.401620 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-611ba874-bca0-4c46-989d-1532afebadd5 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:14.403000 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-611ba874-bca0-4c46-989d-1532afebadd5 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 82f8d22c-99ee-4c2b-8a36-5299c187ace7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:14.414497 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-611ba874-bca0-4c46-989d-1532afebadd5 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:14.414990 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-611ba874-bca0-4c46-989d-1532afebadd5 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:14.415431 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-611ba874-bca0-4c46-989d-1532afebadd5 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:14.416152 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-611ba874-bca0-4c46-989d-1532afebadd5 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:14.416609 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-611ba874-bca0-4c46-989d-1532afebadd5 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:14.417044 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-611ba874-bca0-4c46-989d-1532afebadd5 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:14.432499 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d8067bf3-d4a2-4646-8104-a7b76c662bb5 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] [instance: d50976fb-756b-4b12-92f2-cedf87df492d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:14.446128 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d8067bf3-d4a2-4646-8104-a7b76c662bb5 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:14.446875 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d8067bf3-d4a2-4646-8104-a7b76c662bb5 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:14.447616 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d8067bf3-d4a2-4646-8104-a7b76c662bb5 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:14.448750 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d8067bf3-d4a2-4646-8104-a7b76c662bb5 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:14.450170 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d8067bf3-d4a2-4646-8104-a7b76c662bb5 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:14.450952 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d8067bf3-d4a2-4646-8104-a7b76c662bb5 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:14.548003 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d8067bf3-d4a2-4646-8104-a7b76c662bb5 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:14.557620 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d8067bf3-d4a2-4646-8104-a7b76c662bb5 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:14.559768 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d8067bf3-d4a2-4646-8104-a7b76c662bb5 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:14.566109 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d8067bf3-d4a2-4646-8104-a7b76c662bb5 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] 10.222.0.52 "POST /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d/action" status: 202 len: 1494 microversion: 2.75 time: 0.588554 Oct 19 03:14:14.584259 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 306/588] 10.222.0.52 () {62 vars in 1319 bytes} [Wed Oct 19 03:14:13 2022] POST /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d/action => generated 1494 bytes in 590 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Oct 19 03:14:14.598717 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-fa52c5e7-d770-42cf-82e3-21a4292a0604 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:14.602518 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-fa52c5e7-d770-42cf-82e3-21a4292a0604 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] [instance: d50976fb-756b-4b12-92f2-cedf87df492d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:14.609254 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fa52c5e7-d770-42cf-82e3-21a4292a0604 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:14.611583 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fa52c5e7-d770-42cf-82e3-21a4292a0604 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:14.612707 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fa52c5e7-d770-42cf-82e3-21a4292a0604 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:14.614720 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fa52c5e7-d770-42cf-82e3-21a4292a0604 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:14.616817 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fa52c5e7-d770-42cf-82e3-21a4292a0604 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:14.618420 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fa52c5e7-d770-42cf-82e3-21a4292a0604 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:14.682668 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-611ba874-bca0-4c46-989d-1532afebadd5 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:14.695329 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-611ba874-bca0-4c46-989d-1532afebadd5 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:14.696873 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-611ba874-bca0-4c46-989d-1532afebadd5 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:14.698417 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-611ba874-bca0-4c46-989d-1532afebadd5 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/82f8d22c-99ee-4c2b-8a36-5299c187ace7" status: 200 len: 1566 microversion: 2.25 time: 0.302156 Oct 19 03:14:14.699544 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 283/589] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:14 2022] GET /compute/v2.1/servers/82f8d22c-99ee-4c2b-8a36-5299c187ace7 => generated 1566 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:14:14.715161 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-fa52c5e7-d770-42cf-82e3-21a4292a0604 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:14.725775 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-fa52c5e7-d770-42cf-82e3-21a4292a0604 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:14.727520 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-fa52c5e7-d770-42cf-82e3-21a4292a0604 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:14.733610 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-fa52c5e7-d770-42cf-82e3-21a4292a0604 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] 10.222.0.52 "GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d" status: 200 len: 1446 microversion: 2.75 time: 0.140530 Oct 19 03:14:14.734172 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 307/590] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:14 2022] GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d => generated 1446 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:14:14.815403 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ad693ba8-1b4f-4aa1-95b2-1583a8a2e65e tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:14.816050 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ad693ba8-1b4f-4aa1-95b2-1583a8a2e65e tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] [instance: 0de5edf9-535f-41db-b32a-06d4e9b231c3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:14.821984 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ad693ba8-1b4f-4aa1-95b2-1583a8a2e65e tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:14.822468 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ad693ba8-1b4f-4aa1-95b2-1583a8a2e65e tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:14.822905 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ad693ba8-1b4f-4aa1-95b2-1583a8a2e65e tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:14.823610 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ad693ba8-1b4f-4aa1-95b2-1583a8a2e65e tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:14.824062 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ad693ba8-1b4f-4aa1-95b2-1583a8a2e65e tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:14.824541 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ad693ba8-1b4f-4aa1-95b2-1583a8a2e65e tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:14.977570 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ad693ba8-1b4f-4aa1-95b2-1583a8a2e65e tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ff6534c5e74a2eb179044ef833f0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e88bbb75184a59b88e533a49d63cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:14.985830 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ad693ba8-1b4f-4aa1-95b2-1583a8a2e65e tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] 10.222.0.52 "GET /compute/v2.1/servers/0de5edf9-535f-41db-b32a-06d4e9b231c3" status: 200 len: 1468 microversion: 2.1 time: 0.174176 Oct 19 03:14:14.986605 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 284/591] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:14 2022] GET /compute/v2.1/servers/0de5edf9-535f-41db-b32a-06d4e9b231c3 => generated 1468 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:14:15.008279 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-00646dfc-294c-4832-8431-87f8354e40ec tempest-LiveMigrationNegativeTest-1867892395 tempest-LiveMigrationNegativeTest-1867892395-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:14:15.008881 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-00646dfc-294c-4832-8431-87f8354e40ec tempest-LiveMigrationNegativeTest-1867892395 tempest-LiveMigrationNegativeTest-1867892395-project-admin] [instance: 0de5edf9-535f-41db-b32a-06d4e9b231c3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:15.015881 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-00646dfc-294c-4832-8431-87f8354e40ec tempest-LiveMigrationNegativeTest-1867892395 tempest-LiveMigrationNegativeTest-1867892395-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:15.024164 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-00646dfc-294c-4832-8431-87f8354e40ec tempest-LiveMigrationNegativeTest-1867892395 tempest-LiveMigrationNegativeTest-1867892395-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:15.024164 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-00646dfc-294c-4832-8431-87f8354e40ec tempest-LiveMigrationNegativeTest-1867892395 tempest-LiveMigrationNegativeTest-1867892395-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:15.024164 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-00646dfc-294c-4832-8431-87f8354e40ec tempest-LiveMigrationNegativeTest-1867892395 tempest-LiveMigrationNegativeTest-1867892395-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:15.024164 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-00646dfc-294c-4832-8431-87f8354e40ec tempest-LiveMigrationNegativeTest-1867892395 tempest-LiveMigrationNegativeTest-1867892395-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:15.024670 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-00646dfc-294c-4832-8431-87f8354e40ec tempest-LiveMigrationNegativeTest-1867892395 tempest-LiveMigrationNegativeTest-1867892395-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:15.041888 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-00646dfc-294c-4832-8431-87f8354e40ec tempest-LiveMigrationNegativeTest-1867892395 tempest-LiveMigrationNegativeTest-1867892395-project-admin] Lazy-loading 'flavor' on Instance uuid 0de5edf9-535f-41db-b32a-06d4e9b231c3 {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:14:15.112679 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3a1d6144-d33c-49be-87bc-822a2165e7ac tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:15.113343 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3a1d6144-d33c-49be-87bc-822a2165e7ac tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:15.133304 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3a1d6144-d33c-49be-87bc-822a2165e7ac tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:15.138649 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3a1d6144-d33c-49be-87bc-822a2165e7ac tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:15.141414 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3a1d6144-d33c-49be-87bc-822a2165e7ac tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:15.142393 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3a1d6144-d33c-49be-87bc-822a2165e7ac tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:15.144851 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3a1d6144-d33c-49be-87bc-822a2165e7ac tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:15.147675 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3a1d6144-d33c-49be-87bc-822a2165e7ac tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:15.327977 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-3a1d6144-d33c-49be-87bc-822a2165e7ac tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:15.336212 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3a1d6144-d33c-49be-87bc-822a2165e7ac tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667" status: 200 len: 1312 microversion: 2.1 time: 0.227502 Oct 19 03:14:15.337329 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 285/592] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:15 2022] GET /compute/v2.1/servers/ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667 => generated 1312 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:14:15.342590 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-6cb5a912-b986-4358-a9ac-dfa555318e7f req-8504b7b0-7b3b-47e7-8376-0a0d5f458f97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82f8d22c-99ee-4c2b-8a36-5299c187ace7", "name": "network-vif-unplugged", "status": "completed", "tag": "dfc9deee-726a-4739-85f8-2d1374704cd1"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:14:15.354185 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-6cb5a912-b986-4358-a9ac-dfa555318e7f req-8504b7b0-7b3b-47e7-8376-0a0d5f458f97 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:15.355004 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-6cb5a912-b986-4358-a9ac-dfa555318e7f req-8504b7b0-7b3b-47e7-8376-0a0d5f458f97 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:15.355974 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-6cb5a912-b986-4358-a9ac-dfa555318e7f req-8504b7b0-7b3b-47e7-8376-0a0d5f458f97 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:15.367837 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-6cb5a912-b986-4358-a9ac-dfa555318e7f req-8504b7b0-7b3b-47e7-8376-0a0d5f458f97 service nova] Creating event network-vif-unplugged:dfc9deee-726a-4739-85f8-2d1374704cd1 for instance 82f8d22c-99ee-4c2b-8a36-5299c187ace7 on n-h2-861333-8 Oct 19 03:14:15.375478 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-6cb5a912-b986-4358-a9ac-dfa555318e7f req-8504b7b0-7b3b-47e7-8376-0a0d5f458f97 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036664 Oct 19 03:14:15.377523 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 286/593] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:14:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:14:15.379448 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-00646dfc-294c-4832-8431-87f8354e40ec tempest-LiveMigrationNegativeTest-1867892395 tempest-LiveMigrationNegativeTest-1867892395-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/0de5edf9-535f-41db-b32a-06d4e9b231c3/action" status: 202 len: 0 microversion: 2.1 time: 0.373996 Oct 19 03:14:15.382502 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 308/594] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:14:15 2022] POST /compute/v2.1/servers/0de5edf9-535f-41db-b32a-06d4e9b231c3/action => generated 0 bytes in 376 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:14:15.405256 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a49bd823-8b4a-489f-b46e-5ce572f696c5 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:15.406284 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a49bd823-8b4a-489f-b46e-5ce572f696c5 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] [instance: 0de5edf9-535f-41db-b32a-06d4e9b231c3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:15.413080 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a49bd823-8b4a-489f-b46e-5ce572f696c5 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:15.413635 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a49bd823-8b4a-489f-b46e-5ce572f696c5 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:15.414078 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a49bd823-8b4a-489f-b46e-5ce572f696c5 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:15.414779 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a49bd823-8b4a-489f-b46e-5ce572f696c5 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:15.415402 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a49bd823-8b4a-489f-b46e-5ce572f696c5 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:15.415992 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a49bd823-8b4a-489f-b46e-5ce572f696c5 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:15.431373 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-95fb5145-6f0b-4a6d-ba8b-41d1ac2d445b tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:15.432133 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-95fb5145-6f0b-4a6d-ba8b-41d1ac2d445b tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:15.444275 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-95fb5145-6f0b-4a6d-ba8b-41d1ac2d445b tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:15.445174 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-95fb5145-6f0b-4a6d-ba8b-41d1ac2d445b tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:15.446168 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-95fb5145-6f0b-4a6d-ba8b-41d1ac2d445b tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:15.446958 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-95fb5145-6f0b-4a6d-ba8b-41d1ac2d445b tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:15.447472 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-95fb5145-6f0b-4a6d-ba8b-41d1ac2d445b tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:15.447907 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-95fb5145-6f0b-4a6d-ba8b-41d1ac2d445b tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:15.567058 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-95fb5145-6f0b-4a6d-ba8b-41d1ac2d445b tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:15.577661 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-95fb5145-6f0b-4a6d-ba8b-41d1ac2d445b tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:15.579563 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-95fb5145-6f0b-4a6d-ba8b-41d1ac2d445b tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:15.585447 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-95fb5145-6f0b-4a6d-ba8b-41d1ac2d445b tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1539 microversion: 2.91 time: 0.165420 Oct 19 03:14:15.603113 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 309/595] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:15 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1539 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:14:15.613239 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a49bd823-8b4a-489f-b46e-5ce572f696c5 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ff6534c5e74a2eb179044ef833f0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e88bbb75184a59b88e533a49d63cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:15.621475 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a49bd823-8b4a-489f-b46e-5ce572f696c5 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] 10.222.0.52 "GET /compute/v2.1/servers/0de5edf9-535f-41db-b32a-06d4e9b231c3" status: 200 len: 1476 microversion: 2.1 time: 0.237168 Oct 19 03:14:15.622350 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 287/596] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:15 2022] GET /compute/v2.1/servers/0de5edf9-535f-41db-b32a-06d4e9b231c3 => generated 1476 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:14:15.727619 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-02acc959-1bc0-4c6a-a5e0-0c74f380b3e8 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:15.728300 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-02acc959-1bc0-4c6a-a5e0-0c74f380b3e8 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 82f8d22c-99ee-4c2b-8a36-5299c187ace7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:15.734678 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-02acc959-1bc0-4c6a-a5e0-0c74f380b3e8 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:15.735167 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-02acc959-1bc0-4c6a-a5e0-0c74f380b3e8 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:15.735807 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-02acc959-1bc0-4c6a-a5e0-0c74f380b3e8 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:15.736727 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-02acc959-1bc0-4c6a-a5e0-0c74f380b3e8 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:15.737188 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-02acc959-1bc0-4c6a-a5e0-0c74f380b3e8 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:15.738588 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-02acc959-1bc0-4c6a-a5e0-0c74f380b3e8 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:15.762927 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-eea7c2bc-6bad-4247-9c8b-7fa6d2d4a975 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:15.763666 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-eea7c2bc-6bad-4247-9c8b-7fa6d2d4a975 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] [instance: d50976fb-756b-4b12-92f2-cedf87df492d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:15.765612 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=81,nova_cell0:UPDATE=7 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:14:15.770587 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eea7c2bc-6bad-4247-9c8b-7fa6d2d4a975 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:15.771073 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eea7c2bc-6bad-4247-9c8b-7fa6d2d4a975 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:15.771512 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eea7c2bc-6bad-4247-9c8b-7fa6d2d4a975 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:15.772261 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eea7c2bc-6bad-4247-9c8b-7fa6d2d4a975 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:15.772723 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eea7c2bc-6bad-4247-9c8b-7fa6d2d4a975 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:15.773282 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eea7c2bc-6bad-4247-9c8b-7fa6d2d4a975 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:15.864545 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-eea7c2bc-6bad-4247-9c8b-7fa6d2d4a975 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:15.887976 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-eea7c2bc-6bad-4247-9c8b-7fa6d2d4a975 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:15.892114 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-eea7c2bc-6bad-4247-9c8b-7fa6d2d4a975 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:15.908755 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-eea7c2bc-6bad-4247-9c8b-7fa6d2d4a975 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] 10.222.0.52 "GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d" status: 200 len: 1446 microversion: 2.75 time: 0.148905 Oct 19 03:14:15.913196 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 288/597] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:15 2022] GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d => generated 1446 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:14:15.970350 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-02acc959-1bc0-4c6a-a5e0-0c74f380b3e8 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:15.979422 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-02acc959-1bc0-4c6a-a5e0-0c74f380b3e8 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:15.981617 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-02acc959-1bc0-4c6a-a5e0-0c74f380b3e8 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:15.982780 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-02acc959-1bc0-4c6a-a5e0-0c74f380b3e8 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/82f8d22c-99ee-4c2b-8a36-5299c187ace7" status: 200 len: 1566 microversion: 2.25 time: 0.262085 Oct 19 03:14:15.983698 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 310/598] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:15 2022] GET /compute/v2.1/servers/82f8d22c-99ee-4c2b-8a36-5299c187ace7 => generated 1566 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:14:16.361955 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9b8d9734-5055-46c0-9895-bd59cad5147f tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:16.362565 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9b8d9734-5055-46c0-9895-bd59cad5147f tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:16.370315 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9b8d9734-5055-46c0-9895-bd59cad5147f tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:16.370741 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9b8d9734-5055-46c0-9895-bd59cad5147f tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:16.372052 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9b8d9734-5055-46c0-9895-bd59cad5147f tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:16.372953 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9b8d9734-5055-46c0-9895-bd59cad5147f tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:16.373892 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9b8d9734-5055-46c0-9895-bd59cad5147f tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:16.374328 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9b8d9734-5055-46c0-9895-bd59cad5147f tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:16.533814 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9b8d9734-5055-46c0-9895-bd59cad5147f tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:16.541410 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9b8d9734-5055-46c0-9895-bd59cad5147f tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667" status: 200 len: 1312 microversion: 2.1 time: 0.183332 Oct 19 03:14:16.541981 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 289/599] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:16 2022] GET /compute/v2.1/servers/ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667 => generated 1312 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:14:16.616167 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-695ccd89-2f66-423b-8b9e-008fa48b59e2 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:16.616791 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-695ccd89-2f66-423b-8b9e-008fa48b59e2 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:16.625998 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-695ccd89-2f66-423b-8b9e-008fa48b59e2 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:16.625998 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-695ccd89-2f66-423b-8b9e-008fa48b59e2 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:16.625998 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-695ccd89-2f66-423b-8b9e-008fa48b59e2 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:16.625998 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-695ccd89-2f66-423b-8b9e-008fa48b59e2 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:16.626476 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-695ccd89-2f66-423b-8b9e-008fa48b59e2 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:16.626476 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-695ccd89-2f66-423b-8b9e-008fa48b59e2 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:16.646092 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3f58277f-2473-4009-a5e5-9ac1f1051c5b tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:16.649874 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3f58277f-2473-4009-a5e5-9ac1f1051c5b tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] [instance: 0de5edf9-535f-41db-b32a-06d4e9b231c3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:16.653020 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3f58277f-2473-4009-a5e5-9ac1f1051c5b tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:16.653740 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3f58277f-2473-4009-a5e5-9ac1f1051c5b tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:16.654346 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3f58277f-2473-4009-a5e5-9ac1f1051c5b tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:16.655069 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3f58277f-2473-4009-a5e5-9ac1f1051c5b tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:16.655533 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3f58277f-2473-4009-a5e5-9ac1f1051c5b tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:16.656271 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3f58277f-2473-4009-a5e5-9ac1f1051c5b tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:16.709683 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-695ccd89-2f66-423b-8b9e-008fa48b59e2 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:16.718078 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-695ccd89-2f66-423b-8b9e-008fa48b59e2 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:16.719564 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-695ccd89-2f66-423b-8b9e-008fa48b59e2 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:16.724625 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-695ccd89-2f66-423b-8b9e-008fa48b59e2 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1539 microversion: 2.91 time: 0.112612 Oct 19 03:14:16.725181 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 311/600] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:16 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1539 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:14:16.828554 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-3f58277f-2473-4009-a5e5-9ac1f1051c5b tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ff6534c5e74a2eb179044ef833f0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e88bbb75184a59b88e533a49d63cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:16.831117 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3f58277f-2473-4009-a5e5-9ac1f1051c5b tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] 10.222.0.52 "GET /compute/v2.1/servers/0de5edf9-535f-41db-b32a-06d4e9b231c3" status: 200 len: 1459 microversion: 2.1 time: 0.189249 Oct 19 03:14:16.832175 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 290/601] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:16 2022] GET /compute/v2.1/servers/0de5edf9-535f-41db-b32a-06d4e9b231c3 => generated 1459 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:14:16.853690 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f25102f6-f449-4141-8d92-2782b48f89b9 tempest-LiveMigrationNegativeTest-1867892395 tempest-LiveMigrationNegativeTest-1867892395-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:16.854308 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f25102f6-f449-4141-8d92-2782b48f89b9 tempest-LiveMigrationNegativeTest-1867892395 tempest-LiveMigrationNegativeTest-1867892395-project-admin] [instance: 0de5edf9-535f-41db-b32a-06d4e9b231c3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:16.860865 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f25102f6-f449-4141-8d92-2782b48f89b9 tempest-LiveMigrationNegativeTest-1867892395 tempest-LiveMigrationNegativeTest-1867892395-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:16.861398 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f25102f6-f449-4141-8d92-2782b48f89b9 tempest-LiveMigrationNegativeTest-1867892395 tempest-LiveMigrationNegativeTest-1867892395-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:16.861838 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f25102f6-f449-4141-8d92-2782b48f89b9 tempest-LiveMigrationNegativeTest-1867892395 tempest-LiveMigrationNegativeTest-1867892395-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:16.862540 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f25102f6-f449-4141-8d92-2782b48f89b9 tempest-LiveMigrationNegativeTest-1867892395 tempest-LiveMigrationNegativeTest-1867892395-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:16.862993 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f25102f6-f449-4141-8d92-2782b48f89b9 tempest-LiveMigrationNegativeTest-1867892395 tempest-LiveMigrationNegativeTest-1867892395-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:16.863622 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f25102f6-f449-4141-8d92-2782b48f89b9 tempest-LiveMigrationNegativeTest-1867892395 tempest-LiveMigrationNegativeTest-1867892395-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:16.943554 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-58be6d6a-496f-47a2-9af4-8e4d2736311c tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:16.944691 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-58be6d6a-496f-47a2-9af4-8e4d2736311c tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] [instance: d50976fb-756b-4b12-92f2-cedf87df492d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:16.951928 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-58be6d6a-496f-47a2-9af4-8e4d2736311c tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:16.953192 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-58be6d6a-496f-47a2-9af4-8e4d2736311c tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:16.954121 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-58be6d6a-496f-47a2-9af4-8e4d2736311c tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:16.954949 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-58be6d6a-496f-47a2-9af4-8e4d2736311c tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:16.955574 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-58be6d6a-496f-47a2-9af4-8e4d2736311c tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:16.956057 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-58be6d6a-496f-47a2-9af4-8e4d2736311c tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:17.049237 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-58be6d6a-496f-47a2-9af4-8e4d2736311c tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:17.068045 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-58be6d6a-496f-47a2-9af4-8e4d2736311c tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:17.069779 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-58be6d6a-496f-47a2-9af4-8e4d2736311c tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:17.087254 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-58be6d6a-496f-47a2-9af4-8e4d2736311c tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] 10.222.0.52 "GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d" status: 200 len: 1446 microversion: 2.75 time: 0.142138 Oct 19 03:14:17.087254 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 291/602] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:16 2022] GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d => generated 1446 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:14:17.087254 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2a5c055c-f16f-4e3a-8909-4f97cba895d3 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:17.087555 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2a5c055c-f16f-4e3a-8909-4f97cba895d3 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 82f8d22c-99ee-4c2b-8a36-5299c187ace7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:17.094725 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2a5c055c-f16f-4e3a-8909-4f97cba895d3 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:17.095533 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2a5c055c-f16f-4e3a-8909-4f97cba895d3 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:17.096335 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2a5c055c-f16f-4e3a-8909-4f97cba895d3 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:17.097269 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2a5c055c-f16f-4e3a-8909-4f97cba895d3 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:17.098116 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2a5c055c-f16f-4e3a-8909-4f97cba895d3 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:17.098712 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2a5c055c-f16f-4e3a-8909-4f97cba895d3 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:17.321285 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f25102f6-f449-4141-8d92-2782b48f89b9 tempest-LiveMigrationNegativeTest-1867892395 tempest-LiveMigrationNegativeTest-1867892395-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/0de5edf9-535f-41db-b32a-06d4e9b231c3" status: 200 len: 1610 microversion: 2.1 time: 0.471334 Oct 19 03:14:17.322067 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 312/603] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:16 2022] GET /compute/v2.1/servers/0de5edf9-535f-41db-b32a-06d4e9b231c3 => generated 1610 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:14:17.344814 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e44c7255-164f-4460-9b94-84aa1d8bbdf4 tempest-LiveMigrationNegativeTest-1867892395 tempest-LiveMigrationNegativeTest-1867892395-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:17.349435 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e44c7255-164f-4460-9b94-84aa1d8bbdf4 tempest-LiveMigrationNegativeTest-1867892395 tempest-LiveMigrationNegativeTest-1867892395-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:17.350164 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e44c7255-164f-4460-9b94-84aa1d8bbdf4 tempest-LiveMigrationNegativeTest-1867892395 tempest-LiveMigrationNegativeTest-1867892395-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:17.350856 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e44c7255-164f-4460-9b94-84aa1d8bbdf4 tempest-LiveMigrationNegativeTest-1867892395 tempest-LiveMigrationNegativeTest-1867892395-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:17.352164 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e44c7255-164f-4460-9b94-84aa1d8bbdf4 tempest-LiveMigrationNegativeTest-1867892395 tempest-LiveMigrationNegativeTest-1867892395-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:17.352861 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e44c7255-164f-4460-9b94-84aa1d8bbdf4 tempest-LiveMigrationNegativeTest-1867892395 tempest-LiveMigrationNegativeTest-1867892395-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:17.353513 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e44c7255-164f-4460-9b94-84aa1d8bbdf4 tempest-LiveMigrationNegativeTest-1867892395 tempest-LiveMigrationNegativeTest-1867892395-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:17.360696 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=43 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:14:17.395202 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e44c7255-164f-4460-9b94-84aa1d8bbdf4 tempest-LiveMigrationNegativeTest-1867892395 tempest-LiveMigrationNegativeTest-1867892395-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.054956 Oct 19 03:14:17.395952 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-2a5c055c-f16f-4e3a-8909-4f97cba895d3 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:17.397468 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 313/604] 10.222.0.52 () {58 vars in 1176 bytes} [Wed Oct 19 03:14:17 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:14:17.409432 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-2a5c055c-f16f-4e3a-8909-4f97cba895d3 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:17.409957 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=20 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:14:17.410992 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-2a5c055c-f16f-4e3a-8909-4f97cba895d3 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:17.412276 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2a5c055c-f16f-4e3a-8909-4f97cba895d3 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/82f8d22c-99ee-4c2b-8a36-5299c187ace7" status: 200 len: 1566 microversion: 2.25 time: 0.329641 Oct 19 03:14:17.412711 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 292/605] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:17 2022] GET /compute/v2.1/servers/82f8d22c-99ee-4c2b-8a36-5299c187ace7 => generated 1566 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:14:17.418881 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-86fa6803-8f1f-4b23-8b8d-3ec6c3d944f4 tempest-LiveMigrationNegativeTest-1867892395 tempest-LiveMigrationNegativeTest-1867892395-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-861333-8", "block_migration": true, "disk_over_commit": false}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:14:17.421627 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-86fa6803-8f1f-4b23-8b8d-3ec6c3d944f4 tempest-LiveMigrationNegativeTest-1867892395 tempest-LiveMigrationNegativeTest-1867892395-project-admin] [instance: 0de5edf9-535f-41db-b32a-06d4e9b231c3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:17.430805 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-86fa6803-8f1f-4b23-8b8d-3ec6c3d944f4 tempest-LiveMigrationNegativeTest-1867892395 tempest-LiveMigrationNegativeTest-1867892395-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:17.432774 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-86fa6803-8f1f-4b23-8b8d-3ec6c3d944f4 tempest-LiveMigrationNegativeTest-1867892395 tempest-LiveMigrationNegativeTest-1867892395-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:17.434602 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-86fa6803-8f1f-4b23-8b8d-3ec6c3d944f4 tempest-LiveMigrationNegativeTest-1867892395 tempest-LiveMigrationNegativeTest-1867892395-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:17.436169 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-86fa6803-8f1f-4b23-8b8d-3ec6c3d944f4 tempest-LiveMigrationNegativeTest-1867892395 tempest-LiveMigrationNegativeTest-1867892395-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:17.439012 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-86fa6803-8f1f-4b23-8b8d-3ec6c3d944f4 tempest-LiveMigrationNegativeTest-1867892395 tempest-LiveMigrationNegativeTest-1867892395-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:17.439464 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-86fa6803-8f1f-4b23-8b8d-3ec6c3d944f4 tempest-LiveMigrationNegativeTest-1867892395 tempest-LiveMigrationNegativeTest-1867892395-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:17.478690 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-86fa6803-8f1f-4b23-8b8d-3ec6c3d944f4 tempest-LiveMigrationNegativeTest-1867892395 tempest-LiveMigrationNegativeTest-1867892395-project-admin] Lazy-loading 'flavor' on Instance uuid 0de5edf9-535f-41db-b32a-06d4e9b231c3 {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:14:17.493689 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-86fa6803-8f1f-4b23-8b8d-3ec6c3d944f4 tempest-LiveMigrationNegativeTest-1867892395 tempest-LiveMigrationNegativeTest-1867892395-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 0de5edf9-535f-41db-b32a-06d4e9b231c3 while it is in vm_state suspended Oct 19 03:14:17.497004 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-86fa6803-8f1f-4b23-8b8d-3ec6c3d944f4 tempest-LiveMigrationNegativeTest-1867892395 tempest-LiveMigrationNegativeTest-1867892395-project-admin] Request method failure captured: Oct 19 03:14:17.497004 n-d-861333-8 devstack@n-api.service[121134]: request: POST /compute/v2.1/servers/0de5edf9-535f-41db-b32a-06d4e9b231c3/action HTTP/1.1 Oct 19 03:14:17.497004 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:14:17.497004 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:14:17.497004 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:14:17.497004 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 97 Oct 19 03:14:17.497004 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:14:17.497004 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:14:17.497004 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:14:17.497004 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:14:17.497004 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT2tdFi_mTb3o_cBUl2vd67YQI43y3mK1M4qbYvdvuMaO2l3PwBQ7cC0w-scHzr63GSkZ0Bt8ZhMTja9j35ajvIjzvxTcF7oJ3vLReSMJvzw3mdYVTIH6N9jXxt1x0IPTXrUhkcutJ1te6qz-NfSOySPR-t_fRW2caPV6VlR5WyLf3TM Oct 19 03:14:17.497004 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:14:17.497004 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:14:17.497004 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:14:17.497004 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:14:17.497004 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:14:17.497004 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:14:17.497004 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 5c0d451cd3c14d79b9b846c5ae7ae0fe Oct 19 03:14:17.497004 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-LiveMigrationNegativeTest-1867892395 Oct 19 03:14:17.497004 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member,admin Oct 19 03:14:17.497004 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member,admin Oct 19 03:14:17.507087 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5c0d451cd3c14d79b9b846c5ae7ae0fe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5c0d451cd3c14d79b9b846c5ae7ae0fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5c0d451cd3c14d79b9b846c5ae7ae0fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5c0d451cd3c14d79b9b846c5ae7ae0fe", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:14:17.507087 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-LiveMigrationNegativeTest-1867892395 Oct 19 03:14:17.507087 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 5c0d451cd3c14d79b9b846c5ae7ae0fe Oct 19 03:14:17.507087 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1867892395 Oct 19 03:14:17.507087 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-LiveMigrationNegativeTest-1867892395-project-admin Oct 19 03:14:17.507087 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:14:17.507087 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:14:17.507087 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 3495d8cfbdf445fa80d7b5c872f8ffd5 Oct 19 03:14:17.507087 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-LiveMigrationNegativeTest-1867892395-project-admin Oct 19 03:14:17.507087 n-d-861333-8 devstack@n-api.service[121134]: Oct 19 03:14:17.507087 n-d-861333-8 devstack@n-api.service[121134]: {"os-migrateLive": {"host": "n-h2-861333-8", "block_migration": true, "disk_over_commit": false}} Oct 19 03:14:17.507087 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:14:17.508217 n-d-861333-8 devstack@n-api.service[121134]: exception: Cannot 'os-migrateLive' instance 0de5edf9-535f-41db-b32a-06d4e9b231c3 while it is in vm_state suspended Oct 19 03:14:17.508217 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '0de5edf9-535f-41db-b32a-06d4e9b231c3', 'body': {'os-migrateLive': {'host': 'n-h2-861333-8', 'block_migration': True, 'disk_over_commit': False}}} Oct 19 03:14:17.508217 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:14:17.508217 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:14:17.508217 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 19 03:14:17.508217 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 19 03:14:17.508217 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 19 03:14:17.508217 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 19 03:14:17.508217 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 19 03:14:17.508217 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 19 03:14:17.508217 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 19 03:14:17.508217 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 19 03:14:17.508217 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 19 03:14:17.508217 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 19 03:14:17.508217 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 19 03:14:17.508217 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 19 03:14:17.508217 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 19 03:14:17.508217 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 19 03:14:17.509469 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 19 03:14:17.509469 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 19 03:14:17.509469 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 19 03:14:17.509469 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 19 03:14:17.509469 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0de5edf9-535f-41db-b32a-06d4e9b231c3 in vm_state suspended. Cannot live_migrate while the instance is in this state. Oct 19 03:14:17.509469 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:14:17.509469 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:14:17.509469 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:14:17.509469 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:14:17.509469 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:14:17.509469 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:14:17.509469 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:14:17.509469 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:14:17.509469 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:14:17.509469 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:14:17.509469 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:14:17.509469 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:14:17.509469 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:14:17.509469 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:14:17.509469 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:14:17.511145 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:14:17.511145 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 19 03:14:17.511145 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Oct 19 03:14:17.511145 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 19 03:14:17.511145 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 19 03:14:17.511145 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 19 03:14:17.511145 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance 0de5edf9-535f-41db-b32a-06d4e9b231c3 while it is in vm_state suspended Oct 19 03:14:17.511145 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:14:17.511145 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:14:17.511145 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:14:17.511145 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:14:17.511145 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:14:17.511145 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:14:17.511145 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:14:17.511145 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:14:17.511145 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance 0de5edf9-535f-41db-b32a-06d4e9b231c3 while it is in vm_state suspended Oct 19 03:14:17.511145 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:14:17.512894 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-86fa6803-8f1f-4b23-8b8d-3ec6c3d944f4 tempest-LiveMigrationNegativeTest-1867892395 tempest-LiveMigrationNegativeTest-1867892395-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 0de5edf9-535f-41db-b32a-06d4e9b231c3 while it is in vm_state suspended {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:14:17.512894 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-86fa6803-8f1f-4b23-8b8d-3ec6c3d944f4 tempest-LiveMigrationNegativeTest-1867892395 tempest-LiveMigrationNegativeTest-1867892395-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/0de5edf9-535f-41db-b32a-06d4e9b231c3/action" status: 409 len: 155 microversion: 2.1 time: 0.083960 Oct 19 03:14:17.512894 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 293/606] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:14:17 2022] POST /compute/v2.1/servers/0de5edf9-535f-41db-b32a-06d4e9b231c3/action => generated 155 bytes in 86 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 19 03:14:17.512894 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-930ba613-0295-4174-9a9d-2126e122404e req-d9741656-64fa-40ab-abe6-08cb052a9c8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82f8d22c-99ee-4c2b-8a36-5299c187ace7", "tag": "dfc9deee-726a-4739-85f8-2d1374704cd1"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:14:17.519629 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-930ba613-0295-4174-9a9d-2126e122404e req-d9741656-64fa-40ab-abe6-08cb052a9c8a service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:17.520121 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-930ba613-0295-4174-9a9d-2126e122404e req-d9741656-64fa-40ab-abe6-08cb052a9c8a service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:17.520571 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-930ba613-0295-4174-9a9d-2126e122404e req-d9741656-64fa-40ab-abe6-08cb052a9c8a service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:17.532898 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-930ba613-0295-4174-9a9d-2126e122404e req-d9741656-64fa-40ab-abe6-08cb052a9c8a service nova] Creating event network-changed:dfc9deee-726a-4739-85f8-2d1374704cd1 for instance 82f8d22c-99ee-4c2b-8a36-5299c187ace7 on n-h2-861333-8 Oct 19 03:14:17.538200 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-930ba613-0295-4174-9a9d-2126e122404e req-d9741656-64fa-40ab-abe6-08cb052a9c8a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032716 Oct 19 03:14:17.538902 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 294/607] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:14:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:14:17.544927 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9fae813c-76f3-4010-b867-bd4fca676989 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:17.545559 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9fae813c-76f3-4010-b867-bd4fca676989 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] [instance: 0de5edf9-535f-41db-b32a-06d4e9b231c3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:17.558294 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9fae813c-76f3-4010-b867-bd4fca676989 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:17.559554 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9fae813c-76f3-4010-b867-bd4fca676989 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:17.565874 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9fae813c-76f3-4010-b867-bd4fca676989 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:17.568868 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9fae813c-76f3-4010-b867-bd4fca676989 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:17.569741 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9fae813c-76f3-4010-b867-bd4fca676989 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:17.570346 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9fae813c-76f3-4010-b867-bd4fca676989 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:17.610013 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-71dd0af9-69e2-4529-b67f-54c0eee19831 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-393546064", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:14:17.631129 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9fae813c-76f3-4010-b867-bd4fca676989 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] [instance: 0de5edf9-535f-41db-b32a-06d4e9b231c3] Going to try to terminate instance {{(pid=121134) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:14:17.692202 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.network.neutron [None req-71dd0af9-69e2-4529-b67f-54c0eee19831 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] validate_networks() for None {{(pid=121135) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:14:17.928880 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9fae813c-76f3-4010-b867-bd4fca676989 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] 10.222.0.52 "DELETE /compute/v2.1/servers/0de5edf9-535f-41db-b32a-06d4e9b231c3" status: 204 len: 0 microversion: 2.1 time: 0.388391 Oct 19 03:14:17.929456 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 295/608] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:14:17 2022] DELETE /compute/v2.1/servers/0de5edf9-535f-41db-b32a-06d4e9b231c3 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:14:17.934705 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-74bbfdb3-b50c-49bb-816f-352272c8ced7 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:17.939495 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-74bbfdb3-b50c-49bb-816f-352272c8ced7 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:17.941333 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-74bbfdb3-b50c-49bb-816f-352272c8ced7 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:17.941885 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-74bbfdb3-b50c-49bb-816f-352272c8ced7 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:17.942326 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-74bbfdb3-b50c-49bb-816f-352272c8ced7 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:17.943027 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-74bbfdb3-b50c-49bb-816f-352272c8ced7 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:17.943480 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-74bbfdb3-b50c-49bb-816f-352272c8ced7 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:17.943907 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-74bbfdb3-b50c-49bb-816f-352272c8ced7 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:18.138027 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-71dd0af9-69e2-4529-b67f-54c0eee19831 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Flavor limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:14:18.140257 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-71dd0af9-69e2-4529-b67f-54c0eee19831 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Image limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:14:18.140257 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-71dd0af9-69e2-4529-b67f-54c0eee19831 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Flavor pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:14:18.140257 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-71dd0af9-69e2-4529-b67f-54c0eee19831 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Image pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:14:18.140257 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-71dd0af9-69e2-4529-b67f-54c0eee19831 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:14:18.149822 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-71dd0af9-69e2-4529-b67f-54c0eee19831 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:18.150289 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-71dd0af9-69e2-4529-b67f-54c0eee19831 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:18.150729 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-71dd0af9-69e2-4529-b67f-54c0eee19831 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:18.151672 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-71dd0af9-69e2-4529-b67f-54c0eee19831 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:18.152133 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-71dd0af9-69e2-4529-b67f-54c0eee19831 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:18.153058 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-71dd0af9-69e2-4529-b67f-54c0eee19831 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:18.172967 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-71dd0af9-69e2-4529-b67f-54c0eee19831 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Getting quotas for project 5d909fe7763841d5b452738112b656d3. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:14:18.179846 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-71dd0af9-69e2-4529-b67f-54c0eee19831 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Getting quotas for user 3e4d3ddb3a324d9da51c13701e318955 and project 5d909fe7763841d5b452738112b656d3. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:14:18.199578 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-71dd0af9-69e2-4529-b67f-54c0eee19831 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Going to run 1 instances... {{(pid=121135) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:14:18.202193 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-71dd0af9-69e2-4529-b67f-54c0eee19831 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 2d709051-db69-4ea9-96dc-ffe05e9c9b3a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121135) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:14:18.227162 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-74bbfdb3-b50c-49bb-816f-352272c8ced7 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:18.239120 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-74bbfdb3-b50c-49bb-816f-352272c8ced7 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667" status: 200 len: 1312 microversion: 2.1 time: 0.308386 Oct 19 03:14:18.239885 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 296/609] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:17 2022] GET /compute/v2.1/servers/ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667 => generated 1312 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:14:18.244764 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2ce6df13-4830-4f5f-87c9-c2addf4425a9 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:18.250271 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2ce6df13-4830-4f5f-87c9-c2addf4425a9 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:18.252048 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2ce6df13-4830-4f5f-87c9-c2addf4425a9 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:18.252620 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2ce6df13-4830-4f5f-87c9-c2addf4425a9 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:18.253148 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2ce6df13-4830-4f5f-87c9-c2addf4425a9 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:18.254098 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2ce6df13-4830-4f5f-87c9-c2addf4425a9 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:18.254760 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2ce6df13-4830-4f5f-87c9-c2addf4425a9 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:18.255394 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2ce6df13-4830-4f5f-87c9-c2addf4425a9 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:18.260225 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:14:18.324424 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-71dd0af9-69e2-4529-b67f-54c0eee19831 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.925608 Oct 19 03:14:18.325698 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 314/610] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:14:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 927 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 03:14:18.333710 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-2ce6df13-4830-4f5f-87c9-c2addf4425a9 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:18.347985 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-8ca1dc4a-676f-425b-a7a0-5dc8bb3d9801 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:18.348927 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-2ce6df13-4830-4f5f-87c9-c2addf4425a9 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:18.349056 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-2ce6df13-4830-4f5f-87c9-c2addf4425a9 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:18.352304 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-8ca1dc4a-676f-425b-a7a0-5dc8bb3d9801 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] [instance: 0de5edf9-535f-41db-b32a-06d4e9b231c3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:18.360620 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2ce6df13-4830-4f5f-87c9-c2addf4425a9 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1539 microversion: 2.91 time: 0.119256 Oct 19 03:14:18.362932 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8ca1dc4a-676f-425b-a7a0-5dc8bb3d9801 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:18.363425 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8ca1dc4a-676f-425b-a7a0-5dc8bb3d9801 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:18.363864 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8ca1dc4a-676f-425b-a7a0-5dc8bb3d9801 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:18.364322 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 297/611] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:18 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1539 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:14:18.382367 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8ca1dc4a-676f-425b-a7a0-5dc8bb3d9801 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:18.382850 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8ca1dc4a-676f-425b-a7a0-5dc8bb3d9801 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:18.383908 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8ca1dc4a-676f-425b-a7a0-5dc8bb3d9801 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:18.389069 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1f5f37e7-5923-44b2-8299-f4092bb56afb tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:18.390001 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1f5f37e7-5923-44b2-8299-f4092bb56afb tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] [instance: d50976fb-756b-4b12-92f2-cedf87df492d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:18.412015 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1f5f37e7-5923-44b2-8299-f4092bb56afb tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:18.414140 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1f5f37e7-5923-44b2-8299-f4092bb56afb tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:18.419331 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1f5f37e7-5923-44b2-8299-f4092bb56afb tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:18.419331 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1f5f37e7-5923-44b2-8299-f4092bb56afb tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:18.419331 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1f5f37e7-5923-44b2-8299-f4092bb56afb tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:18.419331 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1f5f37e7-5923-44b2-8299-f4092bb56afb tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:18.548680 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-1f5f37e7-5923-44b2-8299-f4092bb56afb tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:18.560364 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-1f5f37e7-5923-44b2-8299-f4092bb56afb tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:18.561873 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-1f5f37e7-5923-44b2-8299-f4092bb56afb tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:18.580652 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1f5f37e7-5923-44b2-8299-f4092bb56afb tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] 10.222.0.52 "GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d" status: 200 len: 1446 microversion: 2.75 time: 0.215246 Oct 19 03:14:18.581289 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 298/612] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:18 2022] GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d => generated 1446 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:14:18.587814 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4696a166-b10b-4e40-937d-5b8fe0970582 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:18.588734 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4696a166-b10b-4e40-937d-5b8fe0970582 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 2d709051-db69-4ea9-96dc-ffe05e9c9b3a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:18.670665 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-4696a166-b10b-4e40-937d-5b8fe0970582 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:18.679225 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-8ca1dc4a-676f-425b-a7a0-5dc8bb3d9801 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ff6534c5e74a2eb179044ef833f0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e88bbb75184a59b88e533a49d63cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:18.680338 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4696a166-b10b-4e40-937d-5b8fe0970582 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/2d709051-db69-4ea9-96dc-ffe05e9c9b3a" status: 200 len: 1216 microversion: 2.1 time: 0.098007 Oct 19 03:14:18.681659 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 299/613] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:18 2022] GET /compute/v2.1/servers/2d709051-db69-4ea9-96dc-ffe05e9c9b3a => generated 1216 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:14:18.690783 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-8ca1dc4a-676f-425b-a7a0-5dc8bb3d9801 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] 10.222.0.52 "GET /compute/v2.1/servers/0de5edf9-535f-41db-b32a-06d4e9b231c3" status: 200 len: 1465 microversion: 2.1 time: 0.362787 Oct 19 03:14:18.693113 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 315/614] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:18 2022] GET /compute/v2.1/servers/0de5edf9-535f-41db-b32a-06d4e9b231c3 => generated 1465 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:14:18.697965 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3934f19f-4d66-4fe7-83b3-8f7583417a08 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:18.701924 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3934f19f-4d66-4fe7-83b3-8f7583417a08 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 82f8d22c-99ee-4c2b-8a36-5299c187ace7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:18.709443 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3934f19f-4d66-4fe7-83b3-8f7583417a08 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:18.709895 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3934f19f-4d66-4fe7-83b3-8f7583417a08 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:18.710345 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3934f19f-4d66-4fe7-83b3-8f7583417a08 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:18.711300 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3934f19f-4d66-4fe7-83b3-8f7583417a08 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:18.712845 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3934f19f-4d66-4fe7-83b3-8f7583417a08 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:18.713295 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3934f19f-4d66-4fe7-83b3-8f7583417a08 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:18.847742 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-3934f19f-4d66-4fe7-83b3-8f7583417a08 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:18.857019 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-3934f19f-4d66-4fe7-83b3-8f7583417a08 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:18.858525 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-3934f19f-4d66-4fe7-83b3-8f7583417a08 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:18.859681 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3934f19f-4d66-4fe7-83b3-8f7583417a08 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/82f8d22c-99ee-4c2b-8a36-5299c187ace7" status: 200 len: 1566 microversion: 2.25 time: 0.176854 Oct 19 03:14:18.860265 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 300/615] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:18 2022] GET /compute/v2.1/servers/82f8d22c-99ee-4c2b-8a36-5299c187ace7 => generated 1566 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:14:19.262712 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9680f095-ae52-4dd6-8f5a-fcc879103f60 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:19.263432 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9680f095-ae52-4dd6-8f5a-fcc879103f60 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:19.269515 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9680f095-ae52-4dd6-8f5a-fcc879103f60 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:19.270015 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9680f095-ae52-4dd6-8f5a-fcc879103f60 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:19.270484 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9680f095-ae52-4dd6-8f5a-fcc879103f60 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:19.271188 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9680f095-ae52-4dd6-8f5a-fcc879103f60 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:19.271647 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9680f095-ae52-4dd6-8f5a-fcc879103f60 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:19.272077 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9680f095-ae52-4dd6-8f5a-fcc879103f60 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:19.400136 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ae387209-a0a6-496e-ac28-e98ebc9e8651 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:19.401533 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ae387209-a0a6-496e-ac28-e98ebc9e8651 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:19.410043 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ae387209-a0a6-496e-ac28-e98ebc9e8651 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:19.410738 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ae387209-a0a6-496e-ac28-e98ebc9e8651 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:19.411335 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ae387209-a0a6-496e-ac28-e98ebc9e8651 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:19.412224 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ae387209-a0a6-496e-ac28-e98ebc9e8651 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:19.414931 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ae387209-a0a6-496e-ac28-e98ebc9e8651 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:19.416159 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ae387209-a0a6-496e-ac28-e98ebc9e8651 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:19.440240 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-9680f095-ae52-4dd6-8f5a-fcc879103f60 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:19.455497 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9680f095-ae52-4dd6-8f5a-fcc879103f60 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667" status: 200 len: 1312 microversion: 2.1 time: 0.197412 Oct 19 03:14:19.461032 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 316/616] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:19 2022] GET /compute/v2.1/servers/ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667 => generated 1312 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:14:19.506212 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ae387209-a0a6-496e-ac28-e98ebc9e8651 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:19.515654 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ae387209-a0a6-496e-ac28-e98ebc9e8651 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:19.516998 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ae387209-a0a6-496e-ac28-e98ebc9e8651 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:19.522685 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ae387209-a0a6-496e-ac28-e98ebc9e8651 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1539 microversion: 2.91 time: 0.137982 Oct 19 03:14:19.537737 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 301/617] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:19 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1539 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:14:19.616154 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ff0d122c-92ea-40f7-bd3d-3480c486ea03 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:19.622956 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ff0d122c-92ea-40f7-bd3d-3480c486ea03 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] [instance: d50976fb-756b-4b12-92f2-cedf87df492d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:19.645244 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ff0d122c-92ea-40f7-bd3d-3480c486ea03 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:19.645775 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ff0d122c-92ea-40f7-bd3d-3480c486ea03 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:19.646212 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ff0d122c-92ea-40f7-bd3d-3480c486ea03 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:19.646929 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ff0d122c-92ea-40f7-bd3d-3480c486ea03 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:19.647413 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ff0d122c-92ea-40f7-bd3d-3480c486ea03 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:19.647830 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ff0d122c-92ea-40f7-bd3d-3480c486ea03 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:19.704725 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-464da913-7fae-4a92-b5ac-9e637c0f0696 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:19.709867 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-464da913-7fae-4a92-b5ac-9e637c0f0696 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 2d709051-db69-4ea9-96dc-ffe05e9c9b3a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:19.727419 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-464da913-7fae-4a92-b5ac-9e637c0f0696 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:19.727993 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-464da913-7fae-4a92-b5ac-9e637c0f0696 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:19.728447 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-464da913-7fae-4a92-b5ac-9e637c0f0696 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:19.729162 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-464da913-7fae-4a92-b5ac-9e637c0f0696 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:19.729675 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-464da913-7fae-4a92-b5ac-9e637c0f0696 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:19.730105 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-464da913-7fae-4a92-b5ac-9e637c0f0696 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:19.773648 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ff0d122c-92ea-40f7-bd3d-3480c486ea03 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:19.785147 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ff0d122c-92ea-40f7-bd3d-3480c486ea03 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:19.786996 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ff0d122c-92ea-40f7-bd3d-3480c486ea03 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:19.794899 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ff0d122c-92ea-40f7-bd3d-3480c486ea03 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] 10.222.0.52 "GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d" status: 200 len: 1446 microversion: 2.75 time: 0.189028 Oct 19 03:14:19.796392 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 317/618] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:19 2022] GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d => generated 1446 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:14:19.814461 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-05d13c57-89eb-44b5-8fc3-ce574d24dc8b tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:19.815659 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-05d13c57-89eb-44b5-8fc3-ce574d24dc8b tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] [instance: 0de5edf9-535f-41db-b32a-06d4e9b231c3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:19.826808 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-05d13c57-89eb-44b5-8fc3-ce574d24dc8b tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:19.829905 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-05d13c57-89eb-44b5-8fc3-ce574d24dc8b tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:19.831366 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-05d13c57-89eb-44b5-8fc3-ce574d24dc8b tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:19.832761 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-05d13c57-89eb-44b5-8fc3-ce574d24dc8b tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:19.833839 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-05d13c57-89eb-44b5-8fc3-ce574d24dc8b tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:19.835036 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-05d13c57-89eb-44b5-8fc3-ce574d24dc8b tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:19.844378 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-464da913-7fae-4a92-b5ac-9e637c0f0696 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:19.855169 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-464da913-7fae-4a92-b5ac-9e637c0f0696 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/2d709051-db69-4ea9-96dc-ffe05e9c9b3a" status: 200 len: 1220 microversion: 2.1 time: 0.154256 Oct 19 03:14:19.857864 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 302/619] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:19 2022] GET /compute/v2.1/servers/2d709051-db69-4ea9-96dc-ffe05e9c9b3a => generated 1220 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:14:19.889160 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d701016f-dd83-464c-a35e-9c1f2b0c902f tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:19.889160 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d701016f-dd83-464c-a35e-9c1f2b0c902f tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 82f8d22c-99ee-4c2b-8a36-5299c187ace7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:19.896518 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d701016f-dd83-464c-a35e-9c1f2b0c902f tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:19.904286 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d701016f-dd83-464c-a35e-9c1f2b0c902f tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:19.904959 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d701016f-dd83-464c-a35e-9c1f2b0c902f tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:19.906698 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d701016f-dd83-464c-a35e-9c1f2b0c902f tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:19.907383 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d701016f-dd83-464c-a35e-9c1f2b0c902f tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:19.908009 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d701016f-dd83-464c-a35e-9c1f2b0c902f tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:20.086567 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-05d13c57-89eb-44b5-8fc3-ce574d24dc8b tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ff6534c5e74a2eb179044ef833f0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e88bbb75184a59b88e533a49d63cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:20.100803 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-05d13c57-89eb-44b5-8fc3-ce574d24dc8b tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] 10.222.0.52 "GET /compute/v2.1/servers/0de5edf9-535f-41db-b32a-06d4e9b231c3" status: 200 len: 1465 microversion: 2.1 time: 0.303113 Oct 19 03:14:20.102427 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 318/620] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:19 2022] GET /compute/v2.1/servers/0de5edf9-535f-41db-b32a-06d4e9b231c3 => generated 1465 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:14:20.108409 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-0044a252-1462-4405-a24e-fb4e9ac02b08 req-2364f8f4-35ac-4eb9-b1fc-a65b72a3908c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667", "name": "network-vif-plugged", "status": "completed", "tag": "93027c05-97a2-4189-89b6-b07e9d59b6c4"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:14:20.121932 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-0044a252-1462-4405-a24e-fb4e9ac02b08 req-2364f8f4-35ac-4eb9-b1fc-a65b72a3908c service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:20.123153 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-0044a252-1462-4405-a24e-fb4e9ac02b08 req-2364f8f4-35ac-4eb9-b1fc-a65b72a3908c service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:20.123951 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-0044a252-1462-4405-a24e-fb4e9ac02b08 req-2364f8f4-35ac-4eb9-b1fc-a65b72a3908c service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:20.148812 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d701016f-dd83-464c-a35e-9c1f2b0c902f tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:20.155430 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-0044a252-1462-4405-a24e-fb4e9ac02b08 req-2364f8f4-35ac-4eb9-b1fc-a65b72a3908c service nova] Creating event network-vif-plugged:93027c05-97a2-4189-89b6-b07e9d59b6c4 for instance ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667 on n-h2-861333-8 Oct 19 03:14:20.161312 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-0044a252-1462-4405-a24e-fb4e9ac02b08 req-2364f8f4-35ac-4eb9-b1fc-a65b72a3908c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057267 Oct 19 03:14:20.162466 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 319/621] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:14:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:14:20.165076 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d701016f-dd83-464c-a35e-9c1f2b0c902f tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:20.166891 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d701016f-dd83-464c-a35e-9c1f2b0c902f tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:20.168850 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d701016f-dd83-464c-a35e-9c1f2b0c902f tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/82f8d22c-99ee-4c2b-8a36-5299c187ace7" status: 200 len: 1566 microversion: 2.25 time: 0.287007 Oct 19 03:14:20.169453 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 303/622] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:19 2022] GET /compute/v2.1/servers/82f8d22c-99ee-4c2b-8a36-5299c187ace7 => generated 1566 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:14:20.485915 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c736d7fb-9f51-4034-826e-0449b36b978e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:20.492187 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c736d7fb-9f51-4034-826e-0449b36b978e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:20.493076 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c736d7fb-9f51-4034-826e-0449b36b978e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:20.493610 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c736d7fb-9f51-4034-826e-0449b36b978e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:20.494037 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c736d7fb-9f51-4034-826e-0449b36b978e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:20.494733 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c736d7fb-9f51-4034-826e-0449b36b978e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:20.495182 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c736d7fb-9f51-4034-826e-0449b36b978e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:20.495602 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c736d7fb-9f51-4034-826e-0449b36b978e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:20.552079 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-251ff25c-dfc0-40f1-9b23-12dcfc2cb7f4 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:20.553396 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-251ff25c-dfc0-40f1-9b23-12dcfc2cb7f4 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:20.561986 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-251ff25c-dfc0-40f1-9b23-12dcfc2cb7f4 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:20.562459 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-251ff25c-dfc0-40f1-9b23-12dcfc2cb7f4 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:20.565496 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-251ff25c-dfc0-40f1-9b23-12dcfc2cb7f4 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:20.566739 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-251ff25c-dfc0-40f1-9b23-12dcfc2cb7f4 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:20.567019 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-251ff25c-dfc0-40f1-9b23-12dcfc2cb7f4 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:20.567759 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-251ff25c-dfc0-40f1-9b23-12dcfc2cb7f4 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:20.691458 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-251ff25c-dfc0-40f1-9b23-12dcfc2cb7f4 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:20.695956 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c736d7fb-9f51-4034-826e-0449b36b978e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:20.712414 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c736d7fb-9f51-4034-826e-0449b36b978e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667" status: 200 len: 1312 microversion: 2.1 time: 0.230674 Oct 19 03:14:20.713002 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 320/623] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:20 2022] GET /compute/v2.1/servers/ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667 => generated 1312 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:14:20.717347 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-251ff25c-dfc0-40f1-9b23-12dcfc2cb7f4 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:20.719164 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-251ff25c-dfc0-40f1-9b23-12dcfc2cb7f4 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:20.736489 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-251ff25c-dfc0-40f1-9b23-12dcfc2cb7f4 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1539 microversion: 2.91 time: 0.180271 Oct 19 03:14:20.736489 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 304/624] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:20 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1539 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:14:20.829634 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4cd21c61-d641-417c-b1e6-b723e5a7659f tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:20.831114 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4cd21c61-d641-417c-b1e6-b723e5a7659f tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] [instance: d50976fb-756b-4b12-92f2-cedf87df492d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:20.850995 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4cd21c61-d641-417c-b1e6-b723e5a7659f tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:20.857869 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4cd21c61-d641-417c-b1e6-b723e5a7659f tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:20.857869 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4cd21c61-d641-417c-b1e6-b723e5a7659f tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:20.857869 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4cd21c61-d641-417c-b1e6-b723e5a7659f tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:20.857869 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4cd21c61-d641-417c-b1e6-b723e5a7659f tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:20.858560 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4cd21c61-d641-417c-b1e6-b723e5a7659f tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:20.878815 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e7b05d45-0448-4ee6-a7c5-e04e76a8d301 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:20.879789 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e7b05d45-0448-4ee6-a7c5-e04e76a8d301 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 2d709051-db69-4ea9-96dc-ffe05e9c9b3a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:20.881957 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=22 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:14:20.892591 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e7b05d45-0448-4ee6-a7c5-e04e76a8d301 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:20.905022 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e7b05d45-0448-4ee6-a7c5-e04e76a8d301 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:20.906530 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e7b05d45-0448-4ee6-a7c5-e04e76a8d301 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:20.926473 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e7b05d45-0448-4ee6-a7c5-e04e76a8d301 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:20.930770 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e7b05d45-0448-4ee6-a7c5-e04e76a8d301 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:20.941217 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e7b05d45-0448-4ee6-a7c5-e04e76a8d301 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:20.967137 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4cd21c61-d641-417c-b1e6-b723e5a7659f tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:20.987444 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4cd21c61-d641-417c-b1e6-b723e5a7659f tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:20.992770 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4cd21c61-d641-417c-b1e6-b723e5a7659f tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:21.008748 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4cd21c61-d641-417c-b1e6-b723e5a7659f tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] 10.222.0.52 "GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d" status: 200 len: 1446 microversion: 2.75 time: 0.179557 Oct 19 03:14:21.024857 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 321/625] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:20 2022] GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d => generated 1446 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:14:21.051727 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e7b05d45-0448-4ee6-a7c5-e04e76a8d301 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:21.060980 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e7b05d45-0448-4ee6-a7c5-e04e76a8d301 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/2d709051-db69-4ea9-96dc-ffe05e9c9b3a" status: 200 len: 1268 microversion: 2.1 time: 0.186044 Oct 19 03:14:21.065186 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 305/626] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:20 2022] GET /compute/v2.1/servers/2d709051-db69-4ea9-96dc-ffe05e9c9b3a => generated 1268 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:14:21.129826 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e78bfc2d-209e-44f6-9f91-aea593eb58d0 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:21.131273 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e78bfc2d-209e-44f6-9f91-aea593eb58d0 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] [instance: 0de5edf9-535f-41db-b32a-06d4e9b231c3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:21.146233 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e78bfc2d-209e-44f6-9f91-aea593eb58d0 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:21.151186 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e78bfc2d-209e-44f6-9f91-aea593eb58d0 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:21.151907 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e78bfc2d-209e-44f6-9f91-aea593eb58d0 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:21.154106 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e78bfc2d-209e-44f6-9f91-aea593eb58d0 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:21.154916 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e78bfc2d-209e-44f6-9f91-aea593eb58d0 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:21.155547 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e78bfc2d-209e-44f6-9f91-aea593eb58d0 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:21.194244 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-fd1b46d9-9da2-430d-a4b4-bec1ab6caaf3 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:21.195005 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-fd1b46d9-9da2-430d-a4b4-bec1ab6caaf3 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 82f8d22c-99ee-4c2b-8a36-5299c187ace7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:21.213262 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fd1b46d9-9da2-430d-a4b4-bec1ab6caaf3 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:21.216191 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fd1b46d9-9da2-430d-a4b4-bec1ab6caaf3 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:21.216191 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fd1b46d9-9da2-430d-a4b4-bec1ab6caaf3 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:21.216797 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fd1b46d9-9da2-430d-a4b4-bec1ab6caaf3 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:21.217411 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fd1b46d9-9da2-430d-a4b4-bec1ab6caaf3 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:21.217942 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fd1b46d9-9da2-430d-a4b4-bec1ab6caaf3 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:21.981154 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-e78bfc2d-209e-44f6-9f91-aea593eb58d0 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ff6534c5e74a2eb179044ef833f0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e88bbb75184a59b88e533a49d63cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:21.984513 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=96,nova_cell1:UPDATE=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:14:21.993491 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e78bfc2d-209e-44f6-9f91-aea593eb58d0 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] 10.222.0.52 "GET /compute/v2.1/servers/0de5edf9-535f-41db-b32a-06d4e9b231c3" status: 200 len: 1465 microversion: 2.1 time: 0.869272 Oct 19 03:14:21.995326 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 322/627] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:21 2022] GET /compute/v2.1/servers/0de5edf9-535f-41db-b32a-06d4e9b231c3 => generated 1465 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:14:22.001614 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-b5228748-2034-4ef5-abeb-c3ab9460eee7 req-23cc34e0-f1fd-4013-a1cc-eb1fd964dbc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0de5edf9-535f-41db-b32a-06d4e9b231c3", "name": "network-vif-deleted", "tag": "1ac620b0-a502-4413-90af-a2d6fb393e36"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:14:22.013605 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-b5228748-2034-4ef5-abeb-c3ab9460eee7 req-23cc34e0-f1fd-4013-a1cc-eb1fd964dbc7 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:22.014369 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-b5228748-2034-4ef5-abeb-c3ab9460eee7 req-23cc34e0-f1fd-4013-a1cc-eb1fd964dbc7 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:22.015127 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-b5228748-2034-4ef5-abeb-c3ab9460eee7 req-23cc34e0-f1fd-4013-a1cc-eb1fd964dbc7 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:22.025161 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-fd1b46d9-9da2-430d-a4b4-bec1ab6caaf3 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:22.032432 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-b5228748-2034-4ef5-abeb-c3ab9460eee7 req-23cc34e0-f1fd-4013-a1cc-eb1fd964dbc7 service nova] Creating event network-vif-deleted:1ac620b0-a502-4413-90af-a2d6fb393e36 for instance 0de5edf9-535f-41db-b32a-06d4e9b231c3 on n-h1-861333-8 Oct 19 03:14:22.039603 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-b5228748-2034-4ef5-abeb-c3ab9460eee7 req-23cc34e0-f1fd-4013-a1cc-eb1fd964dbc7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041864 Oct 19 03:14:22.040611 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 323/628] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:14:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:14:22.045397 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-fd1b46d9-9da2-430d-a4b4-bec1ab6caaf3 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:22.048340 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6875b047-b4c6-4c74-bbf3-48516de02800 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:22.048668 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-fd1b46d9-9da2-430d-a4b4-bec1ab6caaf3 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:22.049459 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6875b047-b4c6-4c74-bbf3-48516de02800 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:22.050109 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-fd1b46d9-9da2-430d-a4b4-bec1ab6caaf3 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/82f8d22c-99ee-4c2b-8a36-5299c187ace7" status: 200 len: 1566 microversion: 2.25 time: 0.859744 Oct 19 03:14:22.050991 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 306/629] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:21 2022] GET /compute/v2.1/servers/82f8d22c-99ee-4c2b-8a36-5299c187ace7 => generated 1566 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:14:22.058083 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6875b047-b4c6-4c74-bbf3-48516de02800 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:22.059707 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6875b047-b4c6-4c74-bbf3-48516de02800 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:22.060223 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6875b047-b4c6-4c74-bbf3-48516de02800 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:22.061006 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6875b047-b4c6-4c74-bbf3-48516de02800 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:22.061606 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6875b047-b4c6-4c74-bbf3-48516de02800 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:22.062154 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6875b047-b4c6-4c74-bbf3-48516de02800 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:22.068021 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d18586c5-d23f-4399-9c5b-d42cfb55c868 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:22.068642 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d18586c5-d23f-4399-9c5b-d42cfb55c868 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:22.085210 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d18586c5-d23f-4399-9c5b-d42cfb55c868 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:22.085825 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d18586c5-d23f-4399-9c5b-d42cfb55c868 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:22.086217 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d18586c5-d23f-4399-9c5b-d42cfb55c868 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:22.086924 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d18586c5-d23f-4399-9c5b-d42cfb55c868 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:22.087378 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d18586c5-d23f-4399-9c5b-d42cfb55c868 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:22.087801 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d18586c5-d23f-4399-9c5b-d42cfb55c868 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:22.257508 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d18586c5-d23f-4399-9c5b-d42cfb55c868 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:22.266223 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d18586c5-d23f-4399-9c5b-d42cfb55c868 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:22.267790 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d18586c5-d23f-4399-9c5b-d42cfb55c868 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:22.273673 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d18586c5-d23f-4399-9c5b-d42cfb55c868 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1539 microversion: 2.91 time: 0.219987 Oct 19 03:14:22.274650 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 307/630] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:22 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1539 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:14:22.280466 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-21ef9b61-7d9d-47d1-9944-787d39ed0ba7 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:22.281520 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-21ef9b61-7d9d-47d1-9944-787d39ed0ba7 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] [instance: d50976fb-756b-4b12-92f2-cedf87df492d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:22.295258 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-21ef9b61-7d9d-47d1-9944-787d39ed0ba7 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:22.295258 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-21ef9b61-7d9d-47d1-9944-787d39ed0ba7 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:22.295258 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-21ef9b61-7d9d-47d1-9944-787d39ed0ba7 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:22.296112 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-21ef9b61-7d9d-47d1-9944-787d39ed0ba7 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:22.296657 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-21ef9b61-7d9d-47d1-9944-787d39ed0ba7 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:22.297196 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-21ef9b61-7d9d-47d1-9944-787d39ed0ba7 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:22.415612 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-21ef9b61-7d9d-47d1-9944-787d39ed0ba7 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:22.425532 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-21ef9b61-7d9d-47d1-9944-787d39ed0ba7 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:22.427051 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-21ef9b61-7d9d-47d1-9944-787d39ed0ba7 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:22.432235 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-21ef9b61-7d9d-47d1-9944-787d39ed0ba7 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] 10.222.0.52 "GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d" status: 200 len: 1446 microversion: 2.75 time: 0.156259 Oct 19 03:14:22.432811 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 308/631] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:22 2022] GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d => generated 1446 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:14:22.438211 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e43a6283-829d-4ba9-bd64-13ddbfd08cef tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:22.439665 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e43a6283-829d-4ba9-bd64-13ddbfd08cef tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 2d709051-db69-4ea9-96dc-ffe05e9c9b3a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:22.455197 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e43a6283-829d-4ba9-bd64-13ddbfd08cef tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:22.455712 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e43a6283-829d-4ba9-bd64-13ddbfd08cef tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:22.460834 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e43a6283-829d-4ba9-bd64-13ddbfd08cef tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:22.460834 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e43a6283-829d-4ba9-bd64-13ddbfd08cef tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:22.460834 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e43a6283-829d-4ba9-bd64-13ddbfd08cef tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:22.460834 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e43a6283-829d-4ba9-bd64-13ddbfd08cef tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:22.484134 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-6875b047-b4c6-4c74-bbf3-48516de02800 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:22.493129 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6875b047-b4c6-4c74-bbf3-48516de02800 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667" status: 200 len: 1462 microversion: 2.1 time: 0.450681 Oct 19 03:14:22.493951 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 324/632] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:22 2022] GET /compute/v2.1/servers/ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667 => generated 1462 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:14:22.516895 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-81a05ff9-6394-420e-bdbf-686a841eb7ea tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:14:22.519172 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-81a05ff9-6394-420e-bdbf-686a841eb7ea tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:22.522762 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:14:22.528219 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-81a05ff9-6394-420e-bdbf-686a841eb7ea tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:22.528707 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-81a05ff9-6394-420e-bdbf-686a841eb7ea tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:22.529178 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-81a05ff9-6394-420e-bdbf-686a841eb7ea tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:22.529907 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-81a05ff9-6394-420e-bdbf-686a841eb7ea tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:22.534691 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-81a05ff9-6394-420e-bdbf-686a841eb7ea tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:22.534691 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-81a05ff9-6394-420e-bdbf-686a841eb7ea tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:22.581354 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e43a6283-829d-4ba9-bd64-13ddbfd08cef tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:22.593204 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e43a6283-829d-4ba9-bd64-13ddbfd08cef tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/2d709051-db69-4ea9-96dc-ffe05e9c9b3a" status: 200 len: 1274 microversion: 2.1 time: 0.157367 Oct 19 03:14:22.596029 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 309/633] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:22 2022] GET /compute/v2.1/servers/2d709051-db69-4ea9-96dc-ffe05e9c9b3a => generated 1274 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:14:22.857974 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-81a05ff9-6394-420e-bdbf-686a841eb7ea tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:22.863594 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-81a05ff9-6394-420e-bdbf-686a841eb7ea tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667] Old instance type m1.heat2, new instance type m1.heat {{(pid=121135) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 19 03:14:22.876668 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-81a05ff9-6394-420e-bdbf-686a841eb7ea tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Flavor limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:14:22.877091 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-81a05ff9-6394-420e-bdbf-686a841eb7ea tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Image limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:14:22.877596 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-81a05ff9-6394-420e-bdbf-686a841eb7ea tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Flavor pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:14:22.878008 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-81a05ff9-6394-420e-bdbf-686a841eb7ea tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Image pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:14:22.878418 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-81a05ff9-6394-420e-bdbf-686a841eb7ea tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:14:23.019783 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-144194f1-44fe-4d28-92bc-30ae4e4b3167 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:23.020414 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-144194f1-44fe-4d28-92bc-30ae4e4b3167 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] [instance: 0de5edf9-535f-41db-b32a-06d4e9b231c3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:23.028647 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-144194f1-44fe-4d28-92bc-30ae4e4b3167 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:23.029710 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-144194f1-44fe-4d28-92bc-30ae4e4b3167 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:23.029710 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-144194f1-44fe-4d28-92bc-30ae4e4b3167 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:23.030323 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-144194f1-44fe-4d28-92bc-30ae4e4b3167 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:23.030781 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-144194f1-44fe-4d28-92bc-30ae4e4b3167 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:23.031415 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-144194f1-44fe-4d28-92bc-30ae4e4b3167 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:23.065883 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-144194f1-44fe-4d28-92bc-30ae4e4b3167 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:23.066303 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-144194f1-44fe-4d28-92bc-30ae4e4b3167 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:23.066798 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-144194f1-44fe-4d28-92bc-30ae4e4b3167 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:23.067477 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-144194f1-44fe-4d28-92bc-30ae4e4b3167 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lazy-loading 'fault' on Instance uuid 0de5edf9-535f-41db-b32a-06d4e9b231c3 {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:14:23.167906 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-144194f1-44fe-4d28-92bc-30ae4e4b3167 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ff6534c5e74a2eb179044ef833f0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e88bbb75184a59b88e533a49d63cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:23.182376 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-144194f1-44fe-4d28-92bc-30ae4e4b3167 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] 10.222.0.52 "GET /compute/v2.1/servers/0de5edf9-535f-41db-b32a-06d4e9b231c3" status: 200 len: 1308 microversion: 2.1 time: 0.167065 Oct 19 03:14:23.184297 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 310/634] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:23 2022] GET /compute/v2.1/servers/0de5edf9-535f-41db-b32a-06d4e9b231c3 => generated 1308 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:14:23.192053 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-81a05ff9-6394-420e-bdbf-686a841eb7ea tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "POST /compute/v2.1/servers/ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667/action" status: 202 len: 0 microversion: 2.1 time: 0.679028 Oct 19 03:14:23.193921 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 325/635] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:14:22 2022] POST /compute/v2.1/servers/ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667/action => generated 0 bytes in 682 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:14:23.201978 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5181af6c-53d3-4d81-a691-792da28b9058 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:23.202993 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5181af6c-53d3-4d81-a691-792da28b9058 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 82f8d22c-99ee-4c2b-8a36-5299c187ace7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:23.215763 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5181af6c-53d3-4d81-a691-792da28b9058 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:23.216667 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6b4582db-2c59-4351-af81-0a33c6272958 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:23.217883 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6b4582db-2c59-4351-af81-0a33c6272958 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:23.221337 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5181af6c-53d3-4d81-a691-792da28b9058 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:23.226657 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5181af6c-53d3-4d81-a691-792da28b9058 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:23.226657 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5181af6c-53d3-4d81-a691-792da28b9058 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:23.226657 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5181af6c-53d3-4d81-a691-792da28b9058 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:23.226657 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5181af6c-53d3-4d81-a691-792da28b9058 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:23.227176 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6b4582db-2c59-4351-af81-0a33c6272958 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:23.227176 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6b4582db-2c59-4351-af81-0a33c6272958 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:23.227176 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6b4582db-2c59-4351-af81-0a33c6272958 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:23.227599 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6b4582db-2c59-4351-af81-0a33c6272958 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:23.228089 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6b4582db-2c59-4351-af81-0a33c6272958 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:23.228613 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6b4582db-2c59-4351-af81-0a33c6272958 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:23.864383 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5181af6c-53d3-4d81-a691-792da28b9058 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:23.874495 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5181af6c-53d3-4d81-a691-792da28b9058 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:23.876197 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5181af6c-53d3-4d81-a691-792da28b9058 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:23.877584 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5181af6c-53d3-4d81-a691-792da28b9058 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/82f8d22c-99ee-4c2b-8a36-5299c187ace7" status: 200 len: 1566 microversion: 2.25 time: 0.692077 Oct 19 03:14:23.878533 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 311/636] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:23 2022] GET /compute/v2.1/servers/82f8d22c-99ee-4c2b-8a36-5299c187ace7 => generated 1566 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:14:23.883275 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-96179cab-59ab-48a9-a187-64db1ff827ad tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:23.884069 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-96179cab-59ab-48a9-a187-64db1ff827ad tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:23.905327 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-96179cab-59ab-48a9-a187-64db1ff827ad tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:23.905923 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-96179cab-59ab-48a9-a187-64db1ff827ad tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:23.906585 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-96179cab-59ab-48a9-a187-64db1ff827ad tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:23.907402 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-96179cab-59ab-48a9-a187-64db1ff827ad tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:23.908146 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-96179cab-59ab-48a9-a187-64db1ff827ad tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:23.908588 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-96179cab-59ab-48a9-a187-64db1ff827ad tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:23.935827 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-6b4582db-2c59-4351-af81-0a33c6272958 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:23.948051 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6b4582db-2c59-4351-af81-0a33c6272958 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667" status: 200 len: 1471 microversion: 2.1 time: 0.740111 Oct 19 03:14:23.948641 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 326/637] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:23 2022] GET /compute/v2.1/servers/ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667 => generated 1471 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:14:23.957006 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-aef1c647-bd8c-4513-b57d-0b2321153ed2 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:23.957924 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-aef1c647-bd8c-4513-b57d-0b2321153ed2 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] [instance: d50976fb-756b-4b12-92f2-cedf87df492d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:23.964789 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aef1c647-bd8c-4513-b57d-0b2321153ed2 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:23.965286 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aef1c647-bd8c-4513-b57d-0b2321153ed2 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:23.965794 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aef1c647-bd8c-4513-b57d-0b2321153ed2 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:23.966548 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aef1c647-bd8c-4513-b57d-0b2321153ed2 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:23.967007 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aef1c647-bd8c-4513-b57d-0b2321153ed2 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:23.967445 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aef1c647-bd8c-4513-b57d-0b2321153ed2 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:24.085309 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-96179cab-59ab-48a9-a187-64db1ff827ad tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:24.094406 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-96179cab-59ab-48a9-a187-64db1ff827ad tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:24.098250 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-aef1c647-bd8c-4513-b57d-0b2321153ed2 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:24.099526 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-96179cab-59ab-48a9-a187-64db1ff827ad tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:24.106813 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-96179cab-59ab-48a9-a187-64db1ff827ad tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1539 microversion: 2.91 time: 0.226769 Oct 19 03:14:24.107767 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 312/638] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:23 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1539 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:14:24.108440 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-aef1c647-bd8c-4513-b57d-0b2321153ed2 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:24.110281 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-aef1c647-bd8c-4513-b57d-0b2321153ed2 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:24.113265 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7e0f23d9-f689-4f05-a9da-7faea9b88534 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:24.115780 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-aef1c647-bd8c-4513-b57d-0b2321153ed2 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] 10.222.0.52 "GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d" status: 200 len: 1446 microversion: 2.75 time: 0.162678 Oct 19 03:14:24.116338 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 327/639] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:23 2022] GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d => generated 1446 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:14:24.117126 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7e0f23d9-f689-4f05-a9da-7faea9b88534 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 2d709051-db69-4ea9-96dc-ffe05e9c9b3a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:24.120596 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:14:24.128279 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7e0f23d9-f689-4f05-a9da-7faea9b88534 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:24.129637 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7e0f23d9-f689-4f05-a9da-7faea9b88534 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:24.130087 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7e0f23d9-f689-4f05-a9da-7faea9b88534 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:24.130806 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7e0f23d9-f689-4f05-a9da-7faea9b88534 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:24.131264 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7e0f23d9-f689-4f05-a9da-7faea9b88534 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:24.131939 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7e0f23d9-f689-4f05-a9da-7faea9b88534 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:24.214629 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-57acdf5b-2a59-4b4b-93e0-2dbce2ac0f29 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:24.215930 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-57acdf5b-2a59-4b4b-93e0-2dbce2ac0f29 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] [instance: 0de5edf9-535f-41db-b32a-06d4e9b231c3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:24.234562 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-7e0f23d9-f689-4f05-a9da-7faea9b88534 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:24.235973 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-57acdf5b-2a59-4b4b-93e0-2dbce2ac0f29 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:24.236480 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-57acdf5b-2a59-4b4b-93e0-2dbce2ac0f29 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:24.239333 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-57acdf5b-2a59-4b4b-93e0-2dbce2ac0f29 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:24.240230 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-57acdf5b-2a59-4b4b-93e0-2dbce2ac0f29 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:24.242520 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-57acdf5b-2a59-4b4b-93e0-2dbce2ac0f29 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:24.245279 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-57acdf5b-2a59-4b4b-93e0-2dbce2ac0f29 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:24.256944 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7e0f23d9-f689-4f05-a9da-7faea9b88534 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/2d709051-db69-4ea9-96dc-ffe05e9c9b3a" status: 200 len: 1274 microversion: 2.1 time: 0.147374 Oct 19 03:14:24.257731 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 313/640] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:24 2022] GET /compute/v2.1/servers/2d709051-db69-4ea9-96dc-ffe05e9c9b3a => generated 1274 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:14:24.279147 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-57acdf5b-2a59-4b4b-93e0-2dbce2ac0f29 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] HTTP exception thrown: Instance 0de5edf9-535f-41db-b32a-06d4e9b231c3 could not be found. Oct 19 03:14:24.280818 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-57acdf5b-2a59-4b4b-93e0-2dbce2ac0f29 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Request method failure captured: Oct 19 03:14:24.280818 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/0de5edf9-535f-41db-b32a-06d4e9b231c3 HTTP/1.1 Oct 19 03:14:24.280818 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:14:24.280818 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:14:24.280818 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:14:24.280818 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:14:24.280818 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:14:24.280818 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:14:24.280818 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:14:24.280818 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:14:24.280818 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2tbt88srnxQUSMks-xuQPAv6QwU_WlcK_4fEe_tgQwWWdgFldYU8XtWEWzJoIYZsRlyKXnpO9cgztcAaQWcrmoFZqIMsXTvkqA-C-hveiNPyfzfuBttz_tOgNX_ymtWf7HWrJ0iEq8pesaivPDG4qfH3lb0SiQEncBiL6lxaL0fMPU Oct 19 03:14:24.280818 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:14:24.280818 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:14:24.280818 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:14:24.280818 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:14:24.280818 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:14:24.280818 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:14:24.280818 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 69e88bbb75184a59b88e533a49d63cd8 Oct 19 03:14:24.280818 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-LiveMigrationNegativeTest-1567694776 Oct 19 03:14:24.280818 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:14:24.280818 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:14:24.282113 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/69e88bbb75184a59b88e533a49d63cd8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/69e88bbb75184a59b88e533a49d63cd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/69e88bbb75184a59b88e533a49d63cd8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_69e88bbb75184a59b88e533a49d63cd8", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:14:24.282113 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-LiveMigrationNegativeTest-1567694776 Oct 19 03:14:24.282113 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 69e88bbb75184a59b88e533a49d63cd8 Oct 19 03:14:24.282113 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1567694776 Oct 19 03:14:24.282113 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-LiveMigrationNegativeTest-1567694776-project Oct 19 03:14:24.282113 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:14:24.282113 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:14:24.282113 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: e3ff6534c5e74a2eb179044ef833f0c1 Oct 19 03:14:24.282113 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-LiveMigrationNegativeTest-1567694776-project Oct 19 03:14:24.282113 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:14:24.282113 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance 0de5edf9-535f-41db-b32a-06d4e9b231c3 could not be found. Oct 19 03:14:24.282113 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '0de5edf9-535f-41db-b32a-06d4e9b231c3'} Oct 19 03:14:24.282826 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:14:24.282826 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:14:24.282826 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:14:24.282826 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:14:24.282826 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:14:24.282826 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:14:24.282826 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:14:24.282826 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:14:24.282826 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:14:24.282826 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:14:24.282826 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0de5edf9-535f-41db-b32a-06d4e9b231c3 could not be found. Oct 19 03:14:24.282826 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:14:24.282826 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:14:24.282826 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:14:24.282826 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:14:24.282826 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:14:24.282826 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:14:24.282826 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:14:24.282826 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:14:24.282826 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:14:24.283973 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:14:24.283973 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:14:24.283973 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:14:24.283973 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:14:24.283973 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:14:24.283973 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:14:24.283973 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:14:24.283973 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0de5edf9-535f-41db-b32a-06d4e9b231c3 could not be found. Oct 19 03:14:24.283973 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:14:24.283973 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:14:24.283973 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:14:24.283973 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:14:24.283973 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:14:24.283973 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:14:24.283973 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:14:24.283973 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:14:24.283973 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0de5edf9-535f-41db-b32a-06d4e9b231c3 could not be found. Oct 19 03:14:24.283973 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:14:24.285043 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-57acdf5b-2a59-4b4b-93e0-2dbce2ac0f29 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Returning 404 to user: Instance 0de5edf9-535f-41db-b32a-06d4e9b231c3 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:14:24.285043 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-57acdf5b-2a59-4b4b-93e0-2dbce2ac0f29 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] 10.222.0.52 "GET /compute/v2.1/servers/0de5edf9-535f-41db-b32a-06d4e9b231c3" status: 404 len: 111 microversion: 2.1 time: 0.072048 Oct 19 03:14:24.292272 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-fe97dfa3-139e-43ad-b7e1-085ce379a17c tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:24.292272 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-fe97dfa3-139e-43ad-b7e1-085ce379a17c tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] [instance: f538531d-7829-4f19-bf50-8eea58368871] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:24.293774 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 328/641] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:24 2022] GET /compute/v2.1/servers/0de5edf9-535f-41db-b32a-06d4e9b231c3 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 03:14:24.298154 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fe97dfa3-139e-43ad-b7e1-085ce379a17c tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:24.298639 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fe97dfa3-139e-43ad-b7e1-085ce379a17c tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:24.299069 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fe97dfa3-139e-43ad-b7e1-085ce379a17c tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:24.299757 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fe97dfa3-139e-43ad-b7e1-085ce379a17c tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:24.300201 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fe97dfa3-139e-43ad-b7e1-085ce379a17c tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:24.300626 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fe97dfa3-139e-43ad-b7e1-085ce379a17c tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:24.320860 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=100 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:14:24.333909 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-fe97dfa3-139e-43ad-b7e1-085ce379a17c tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] [instance: f538531d-7829-4f19-bf50-8eea58368871] Going to try to terminate instance {{(pid=121134) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:14:24.673538 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-fe97dfa3-139e-43ad-b7e1-085ce379a17c tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] 10.222.0.52 "DELETE /compute/v2.1/servers/f538531d-7829-4f19-bf50-8eea58368871" status: 204 len: 0 microversion: 2.1 time: 0.385921 Oct 19 03:14:24.674128 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 314/642] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:14:24 2022] DELETE /compute/v2.1/servers/f538531d-7829-4f19-bf50-8eea58368871 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:14:24.682511 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-91030a6a-960f-4414-abbd-58b5e6113668 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:24.683136 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-91030a6a-960f-4414-abbd-58b5e6113668 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] [instance: f538531d-7829-4f19-bf50-8eea58368871] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:24.689776 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-91030a6a-960f-4414-abbd-58b5e6113668 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:24.690479 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-91030a6a-960f-4414-abbd-58b5e6113668 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:24.691085 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-91030a6a-960f-4414-abbd-58b5e6113668 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:24.691964 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-91030a6a-960f-4414-abbd-58b5e6113668 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:24.692579 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-91030a6a-960f-4414-abbd-58b5e6113668 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:24.693155 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-91030a6a-960f-4414-abbd-58b5e6113668 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:24.909954 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2669e9be-8822-4b69-a35a-4ba41279548a tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:24.910904 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2669e9be-8822-4b69-a35a-4ba41279548a tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 82f8d22c-99ee-4c2b-8a36-5299c187ace7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:24.917413 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2669e9be-8822-4b69-a35a-4ba41279548a tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:24.918545 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2669e9be-8822-4b69-a35a-4ba41279548a tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:24.919220 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2669e9be-8822-4b69-a35a-4ba41279548a tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:24.920288 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2669e9be-8822-4b69-a35a-4ba41279548a tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:24.920977 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2669e9be-8822-4b69-a35a-4ba41279548a tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:24.921662 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2669e9be-8822-4b69-a35a-4ba41279548a tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:25.244794 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-91030a6a-960f-4414-abbd-58b5e6113668 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ff6534c5e74a2eb179044ef833f0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e88bbb75184a59b88e533a49d63cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:25.253531 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-91030a6a-960f-4414-abbd-58b5e6113668 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] 10.222.0.52 "GET /compute/v2.1/servers/f538531d-7829-4f19-bf50-8eea58368871" status: 200 len: 1474 microversion: 2.1 time: 0.575148 Oct 19 03:14:25.254933 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 329/643] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:24 2022] GET /compute/v2.1/servers/f538531d-7829-4f19-bf50-8eea58368871 => generated 1474 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:14:25.260384 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-50319dee-bc74-4760-9e40-5376c9c44374 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:25.261244 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-50319dee-bc74-4760-9e40-5376c9c44374 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:25.267341 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-50319dee-bc74-4760-9e40-5376c9c44374 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:25.267831 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-50319dee-bc74-4760-9e40-5376c9c44374 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:25.268544 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-50319dee-bc74-4760-9e40-5376c9c44374 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:25.270282 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-50319dee-bc74-4760-9e40-5376c9c44374 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:25.270783 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-50319dee-bc74-4760-9e40-5376c9c44374 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:25.271216 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-50319dee-bc74-4760-9e40-5376c9c44374 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:25.349470 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-2669e9be-8822-4b69-a35a-4ba41279548a tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:25.358207 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-2669e9be-8822-4b69-a35a-4ba41279548a tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:25.359657 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-2669e9be-8822-4b69-a35a-4ba41279548a tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:25.360817 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2669e9be-8822-4b69-a35a-4ba41279548a tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/82f8d22c-99ee-4c2b-8a36-5299c187ace7" status: 200 len: 1566 microversion: 2.25 time: 0.455195 Oct 19 03:14:25.361719 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 315/644] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:24 2022] GET /compute/v2.1/servers/82f8d22c-99ee-4c2b-8a36-5299c187ace7 => generated 1566 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:14:25.366771 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-89b17901-c194-4ea7-9b7c-5260864fca7b tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:25.367587 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-89b17901-c194-4ea7-9b7c-5260864fca7b tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:25.374125 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-89b17901-c194-4ea7-9b7c-5260864fca7b tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:25.374613 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-89b17901-c194-4ea7-9b7c-5260864fca7b tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:25.375048 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-89b17901-c194-4ea7-9b7c-5260864fca7b tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:25.375739 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-89b17901-c194-4ea7-9b7c-5260864fca7b tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:25.376197 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-89b17901-c194-4ea7-9b7c-5260864fca7b tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:25.376626 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-89b17901-c194-4ea7-9b7c-5260864fca7b tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:25.516199 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-89b17901-c194-4ea7-9b7c-5260864fca7b tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:25.521847 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-89b17901-c194-4ea7-9b7c-5260864fca7b tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:25.523379 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-89b17901-c194-4ea7-9b7c-5260864fca7b tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:25.529401 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-89b17901-c194-4ea7-9b7c-5260864fca7b tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1539 microversion: 2.91 time: 0.166506 Oct 19 03:14:25.530049 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 316/645] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:25 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1539 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:14:25.539300 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-fb806f49-1cc8-47fc-9eab-af5996dcb46c tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:25.540289 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-fb806f49-1cc8-47fc-9eab-af5996dcb46c tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] [instance: d50976fb-756b-4b12-92f2-cedf87df492d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:25.547418 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fb806f49-1cc8-47fc-9eab-af5996dcb46c tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:25.548007 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fb806f49-1cc8-47fc-9eab-af5996dcb46c tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:25.548513 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fb806f49-1cc8-47fc-9eab-af5996dcb46c tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:25.549287 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fb806f49-1cc8-47fc-9eab-af5996dcb46c tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:25.549908 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fb806f49-1cc8-47fc-9eab-af5996dcb46c tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:25.550725 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fb806f49-1cc8-47fc-9eab-af5996dcb46c tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:25.672145 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-50319dee-bc74-4760-9e40-5376c9c44374 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:25.677345 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-fb806f49-1cc8-47fc-9eab-af5996dcb46c tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:25.680342 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-50319dee-bc74-4760-9e40-5376c9c44374 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667" status: 200 len: 1471 microversion: 2.1 time: 0.423892 Oct 19 03:14:25.689109 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-fb806f49-1cc8-47fc-9eab-af5996dcb46c tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:25.691786 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-fb806f49-1cc8-47fc-9eab-af5996dcb46c tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:25.696484 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 330/646] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:25 2022] GET /compute/v2.1/servers/ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667 => generated 1471 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:14:25.699450 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-fb806f49-1cc8-47fc-9eab-af5996dcb46c tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] 10.222.0.52 "GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d" status: 200 len: 1446 microversion: 2.75 time: 0.168351 Oct 19 03:14:25.700574 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 317/647] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:25 2022] GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d => generated 1446 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:14:25.703371 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e39b590e-2c6e-4477-afa2-28caffd56a02 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:25.704111 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e39b590e-2c6e-4477-afa2-28caffd56a02 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 2d709051-db69-4ea9-96dc-ffe05e9c9b3a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:25.710222 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e39b590e-2c6e-4477-afa2-28caffd56a02 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:25.710708 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e39b590e-2c6e-4477-afa2-28caffd56a02 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:25.711138 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e39b590e-2c6e-4477-afa2-28caffd56a02 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:25.711827 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e39b590e-2c6e-4477-afa2-28caffd56a02 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:25.712278 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e39b590e-2c6e-4477-afa2-28caffd56a02 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:25.712993 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e39b590e-2c6e-4477-afa2-28caffd56a02 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:25.993849 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-e39b590e-2c6e-4477-afa2-28caffd56a02 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:26.002401 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e39b590e-2c6e-4477-afa2-28caffd56a02 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/2d709051-db69-4ea9-96dc-ffe05e9c9b3a" status: 200 len: 1316 microversion: 2.1 time: 0.304625 Oct 19 03:14:26.003310 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 331/648] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:25 2022] GET /compute/v2.1/servers/2d709051-db69-4ea9-96dc-ffe05e9c9b3a => generated 1316 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:14:26.278518 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-98af978b-4c01-4c27-8e52-bc096f397e56 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:26.279193 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-98af978b-4c01-4c27-8e52-bc096f397e56 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] [instance: f538531d-7829-4f19-bf50-8eea58368871] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:26.287072 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-98af978b-4c01-4c27-8e52-bc096f397e56 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:26.287567 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-98af978b-4c01-4c27-8e52-bc096f397e56 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:26.288741 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-98af978b-4c01-4c27-8e52-bc096f397e56 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:26.289907 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-98af978b-4c01-4c27-8e52-bc096f397e56 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:26.290559 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-98af978b-4c01-4c27-8e52-bc096f397e56 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:26.291253 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-98af978b-4c01-4c27-8e52-bc096f397e56 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:26.388324 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-58272717-2d7b-4b9e-999a-9b11fede5c44 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:26.389976 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-58272717-2d7b-4b9e-999a-9b11fede5c44 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 82f8d22c-99ee-4c2b-8a36-5299c187ace7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:26.399373 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-58272717-2d7b-4b9e-999a-9b11fede5c44 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:26.404999 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-58272717-2d7b-4b9e-999a-9b11fede5c44 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:26.406958 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-58272717-2d7b-4b9e-999a-9b11fede5c44 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:26.407711 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-58272717-2d7b-4b9e-999a-9b11fede5c44 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:26.408179 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-58272717-2d7b-4b9e-999a-9b11fede5c44 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:26.408611 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-58272717-2d7b-4b9e-999a-9b11fede5c44 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:26.752285 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-98af978b-4c01-4c27-8e52-bc096f397e56 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ff6534c5e74a2eb179044ef833f0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e88bbb75184a59b88e533a49d63cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:26.764807 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-98af978b-4c01-4c27-8e52-bc096f397e56 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] 10.222.0.52 "GET /compute/v2.1/servers/f538531d-7829-4f19-bf50-8eea58368871" status: 200 len: 1474 microversion: 2.1 time: 0.491064 Oct 19 03:14:26.766189 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 318/649] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:26 2022] GET /compute/v2.1/servers/f538531d-7829-4f19-bf50-8eea58368871 => generated 1474 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:14:26.773971 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-af4f7283-bc89-4ac8-a1a9-c14288b047d6 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:26.774897 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-af4f7283-bc89-4ac8-a1a9-c14288b047d6 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:26.790784 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-af4f7283-bc89-4ac8-a1a9-c14288b047d6 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:26.792250 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-af4f7283-bc89-4ac8-a1a9-c14288b047d6 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:26.794894 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-af4f7283-bc89-4ac8-a1a9-c14288b047d6 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:26.796742 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-af4f7283-bc89-4ac8-a1a9-c14288b047d6 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:26.797915 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-af4f7283-bc89-4ac8-a1a9-c14288b047d6 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:26.798573 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-af4f7283-bc89-4ac8-a1a9-c14288b047d6 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:26.889947 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-58272717-2d7b-4b9e-999a-9b11fede5c44 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:26.904950 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-58272717-2d7b-4b9e-999a-9b11fede5c44 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:26.915178 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-58272717-2d7b-4b9e-999a-9b11fede5c44 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:26.917443 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-58272717-2d7b-4b9e-999a-9b11fede5c44 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/82f8d22c-99ee-4c2b-8a36-5299c187ace7" status: 200 len: 1566 microversion: 2.25 time: 0.533710 Oct 19 03:14:26.919165 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 332/650] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:26 2022] GET /compute/v2.1/servers/82f8d22c-99ee-4c2b-8a36-5299c187ace7 => generated 1566 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:14:26.928701 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f484d994-2f2b-4f1d-868a-e39a5d9f1e60 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:26.929653 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f484d994-2f2b-4f1d-868a-e39a5d9f1e60 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:26.937884 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f484d994-2f2b-4f1d-868a-e39a5d9f1e60 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:26.938496 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f484d994-2f2b-4f1d-868a-e39a5d9f1e60 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:26.938929 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f484d994-2f2b-4f1d-868a-e39a5d9f1e60 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:26.939991 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f484d994-2f2b-4f1d-868a-e39a5d9f1e60 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:26.940816 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f484d994-2f2b-4f1d-868a-e39a5d9f1e60 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:26.941671 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f484d994-2f2b-4f1d-868a-e39a5d9f1e60 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:26.977076 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-af4f7283-bc89-4ac8-a1a9-c14288b047d6 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:26.993667 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-af4f7283-bc89-4ac8-a1a9-c14288b047d6 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:26.999130 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-af4f7283-bc89-4ac8-a1a9-c14288b047d6 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:27.032290 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-af4f7283-bc89-4ac8-a1a9-c14288b047d6 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1539 microversion: 2.91 time: 0.263955 Oct 19 03:14:27.033389 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 319/651] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:26 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1539 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:14:27.039512 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9b1fed7d-acab-4bd7-8b5a-a8b5c1e40407 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:27.040499 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9b1fed7d-acab-4bd7-8b5a-a8b5c1e40407 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] [instance: d50976fb-756b-4b12-92f2-cedf87df492d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:27.047454 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9b1fed7d-acab-4bd7-8b5a-a8b5c1e40407 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:27.048158 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9b1fed7d-acab-4bd7-8b5a-a8b5c1e40407 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:27.048835 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9b1fed7d-acab-4bd7-8b5a-a8b5c1e40407 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:27.050131 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9b1fed7d-acab-4bd7-8b5a-a8b5c1e40407 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:27.050768 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9b1fed7d-acab-4bd7-8b5a-a8b5c1e40407 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:27.051945 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9b1fed7d-acab-4bd7-8b5a-a8b5c1e40407 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:27.221240 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9b1fed7d-acab-4bd7-8b5a-a8b5c1e40407 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:27.232840 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9b1fed7d-acab-4bd7-8b5a-a8b5c1e40407 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:27.235492 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9b1fed7d-acab-4bd7-8b5a-a8b5c1e40407 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:27.242650 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9b1fed7d-acab-4bd7-8b5a-a8b5c1e40407 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] 10.222.0.52 "GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d" status: 200 len: 1446 microversion: 2.75 time: 0.208018 Oct 19 03:14:27.243625 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 320/652] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:27 2022] GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d => generated 1446 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:14:27.249619 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f87ff47d-a4da-4ec0-87ef-87296df43bce tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:27.250226 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f87ff47d-a4da-4ec0-87ef-87296df43bce tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 2d709051-db69-4ea9-96dc-ffe05e9c9b3a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:27.278130 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f87ff47d-a4da-4ec0-87ef-87296df43bce tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:27.278831 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f87ff47d-a4da-4ec0-87ef-87296df43bce tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:27.279427 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f87ff47d-a4da-4ec0-87ef-87296df43bce tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:27.280311 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f87ff47d-a4da-4ec0-87ef-87296df43bce tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:27.280906 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f87ff47d-a4da-4ec0-87ef-87296df43bce tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:27.281531 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f87ff47d-a4da-4ec0-87ef-87296df43bce tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:27.375343 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f484d994-2f2b-4f1d-868a-e39a5d9f1e60 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:27.386312 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f484d994-2f2b-4f1d-868a-e39a5d9f1e60 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667" status: 200 len: 1471 microversion: 2.1 time: 0.464839 Oct 19 03:14:27.389553 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 333/653] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:26 2022] GET /compute/v2.1/servers/ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667 => generated 1471 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:14:27.606969 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-95fa5797-8a1f-4e7a-9c33-6a67c93d6f2d req-d5f680ad-3c45-43d9-8b57-8e68f1b81e26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f538531d-7829-4f19-bf50-8eea58368871", "name": "network-vif-deleted", "tag": "bc401a65-cfe4-4aae-9ba9-460015bf4371"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:14:27.629103 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-95fa5797-8a1f-4e7a-9c33-6a67c93d6f2d req-d5f680ad-3c45-43d9-8b57-8e68f1b81e26 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:27.629650 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-95fa5797-8a1f-4e7a-9c33-6a67c93d6f2d req-d5f680ad-3c45-43d9-8b57-8e68f1b81e26 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:27.630094 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-95fa5797-8a1f-4e7a-9c33-6a67c93d6f2d req-d5f680ad-3c45-43d9-8b57-8e68f1b81e26 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:27.651944 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-95fa5797-8a1f-4e7a-9c33-6a67c93d6f2d req-d5f680ad-3c45-43d9-8b57-8e68f1b81e26 service nova] Creating event network-vif-deleted:bc401a65-cfe4-4aae-9ba9-460015bf4371 for instance f538531d-7829-4f19-bf50-8eea58368871 on n-h2-861333-8 Oct 19 03:14:27.665076 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-95fa5797-8a1f-4e7a-9c33-6a67c93d6f2d req-d5f680ad-3c45-43d9-8b57-8e68f1b81e26 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062696 Oct 19 03:14:27.669063 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 334/654] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:14:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:14:27.693113 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-f87ff47d-a4da-4ec0-87ef-87296df43bce tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:27.708317 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f87ff47d-a4da-4ec0-87ef-87296df43bce tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/2d709051-db69-4ea9-96dc-ffe05e9c9b3a" status: 200 len: 1316 microversion: 2.1 time: 0.462571 Oct 19 03:14:27.709789 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 321/655] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:27 2022] GET /compute/v2.1/servers/2d709051-db69-4ea9-96dc-ffe05e9c9b3a => generated 1316 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:14:27.790077 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4fef7a86-80e3-433c-b7d9-833c093aa1aa tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:27.791300 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4fef7a86-80e3-433c-b7d9-833c093aa1aa tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] [instance: f538531d-7829-4f19-bf50-8eea58368871] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:27.800726 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4fef7a86-80e3-433c-b7d9-833c093aa1aa tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:27.801626 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4fef7a86-80e3-433c-b7d9-833c093aa1aa tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:27.802701 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4fef7a86-80e3-433c-b7d9-833c093aa1aa tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:27.803875 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4fef7a86-80e3-433c-b7d9-833c093aa1aa tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:27.804221 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4fef7a86-80e3-433c-b7d9-833c093aa1aa tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:27.804823 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4fef7a86-80e3-433c-b7d9-833c093aa1aa tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:27.913926 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4fef7a86-80e3-433c-b7d9-833c093aa1aa tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ff6534c5e74a2eb179044ef833f0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e88bbb75184a59b88e533a49d63cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:27.923159 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4fef7a86-80e3-433c-b7d9-833c093aa1aa tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] 10.222.0.52 "GET /compute/v2.1/servers/f538531d-7829-4f19-bf50-8eea58368871" status: 200 len: 1303 microversion: 2.1 time: 0.137977 Oct 19 03:14:27.924144 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 335/656] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:27 2022] GET /compute/v2.1/servers/f538531d-7829-4f19-bf50-8eea58368871 => generated 1303 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:14:27.957557 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-41cd3e6b-afc4-4db1-81f1-8d99dced580d tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:27.960524 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-41cd3e6b-afc4-4db1-81f1-8d99dced580d tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 82f8d22c-99ee-4c2b-8a36-5299c187ace7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:27.981541 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-41cd3e6b-afc4-4db1-81f1-8d99dced580d tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:27.985548 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-41cd3e6b-afc4-4db1-81f1-8d99dced580d tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:27.986274 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-41cd3e6b-afc4-4db1-81f1-8d99dced580d tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:27.989191 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-41cd3e6b-afc4-4db1-81f1-8d99dced580d tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:27.990349 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-41cd3e6b-afc4-4db1-81f1-8d99dced580d tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:27.991025 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-41cd3e6b-afc4-4db1-81f1-8d99dced580d tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:28.069680 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-afe46302-18df-4f7a-9cc8-0fcea49a4a4f tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:28.070428 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-afe46302-18df-4f7a-9cc8-0fcea49a4a4f tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:28.079659 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-afe46302-18df-4f7a-9cc8-0fcea49a4a4f tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:28.081569 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-afe46302-18df-4f7a-9cc8-0fcea49a4a4f tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:28.082356 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-afe46302-18df-4f7a-9cc8-0fcea49a4a4f tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:28.083300 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-afe46302-18df-4f7a-9cc8-0fcea49a4a4f tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:28.083783 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-afe46302-18df-4f7a-9cc8-0fcea49a4a4f tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:28.084207 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-afe46302-18df-4f7a-9cc8-0fcea49a4a4f tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:28.168212 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=3 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:14:28.188094 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=6 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:14:28.264233 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-afe46302-18df-4f7a-9cc8-0fcea49a4a4f tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:28.284512 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-afe46302-18df-4f7a-9cc8-0fcea49a4a4f tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:28.286104 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-afe46302-18df-4f7a-9cc8-0fcea49a4a4f tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:28.304697 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-afe46302-18df-4f7a-9cc8-0fcea49a4a4f tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1539 microversion: 2.91 time: 0.245410 Oct 19 03:14:28.325920 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 336/657] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:28 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1539 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:14:28.336836 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-26ed0c4b-a6a3-458b-b0be-c3f3875ae8dc tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:28.339399 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-26ed0c4b-a6a3-458b-b0be-c3f3875ae8dc tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] [instance: d50976fb-756b-4b12-92f2-cedf87df492d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:28.354606 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-26ed0c4b-a6a3-458b-b0be-c3f3875ae8dc tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:28.356051 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-26ed0c4b-a6a3-458b-b0be-c3f3875ae8dc tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:28.356501 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-26ed0c4b-a6a3-458b-b0be-c3f3875ae8dc tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:28.357208 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-26ed0c4b-a6a3-458b-b0be-c3f3875ae8dc tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:28.360728 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-26ed0c4b-a6a3-458b-b0be-c3f3875ae8dc tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:28.361309 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-26ed0c4b-a6a3-458b-b0be-c3f3875ae8dc tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:28.467361 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-41cd3e6b-afc4-4db1-81f1-8d99dced580d tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:28.476927 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-41cd3e6b-afc4-4db1-81f1-8d99dced580d tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:28.492853 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-41cd3e6b-afc4-4db1-81f1-8d99dced580d tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:28.494267 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-41cd3e6b-afc4-4db1-81f1-8d99dced580d tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/82f8d22c-99ee-4c2b-8a36-5299c187ace7" status: 200 len: 1566 microversion: 2.25 time: 0.553960 Oct 19 03:14:28.494903 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 322/658] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:27 2022] GET /compute/v2.1/servers/82f8d22c-99ee-4c2b-8a36-5299c187ace7 => generated 1566 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:14:28.499903 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a04996a7-6542-47c6-a281-d4b90ab53b91 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:28.500637 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a04996a7-6542-47c6-a281-d4b90ab53b91 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:28.513183 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a04996a7-6542-47c6-a281-d4b90ab53b91 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:28.513881 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a04996a7-6542-47c6-a281-d4b90ab53b91 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:28.518293 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a04996a7-6542-47c6-a281-d4b90ab53b91 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:28.519504 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a04996a7-6542-47c6-a281-d4b90ab53b91 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:28.520191 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a04996a7-6542-47c6-a281-d4b90ab53b91 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:28.520853 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a04996a7-6542-47c6-a281-d4b90ab53b91 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:28.675879 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:14:28.916915 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-26ed0c4b-a6a3-458b-b0be-c3f3875ae8dc tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:28.929529 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-26ed0c4b-a6a3-458b-b0be-c3f3875ae8dc tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:28.931453 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-26ed0c4b-a6a3-458b-b0be-c3f3875ae8dc tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:28.939719 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-26ed0c4b-a6a3-458b-b0be-c3f3875ae8dc tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] 10.222.0.52 "GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d" status: 200 len: 1446 microversion: 2.75 time: 0.630846 Oct 19 03:14:28.940883 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 337/659] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:28 2022] GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d => generated 1446 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:14:28.972543 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-18eabada-45dc-4213-bfa2-9933363c9155 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:28.978544 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-18eabada-45dc-4213-bfa2-9933363c9155 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 2d709051-db69-4ea9-96dc-ffe05e9c9b3a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:28.987304 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-18eabada-45dc-4213-bfa2-9933363c9155 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:28.988130 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-18eabada-45dc-4213-bfa2-9933363c9155 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:28.988729 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-18eabada-45dc-4213-bfa2-9933363c9155 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:28.989798 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-18eabada-45dc-4213-bfa2-9933363c9155 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:28.990897 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-18eabada-45dc-4213-bfa2-9933363c9155 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:28.993562 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-18eabada-45dc-4213-bfa2-9933363c9155 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:29.117073 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a04996a7-6542-47c6-a281-d4b90ab53b91 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:29.128219 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a04996a7-6542-47c6-a281-d4b90ab53b91 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667" status: 200 len: 1476 microversion: 2.1 time: 0.632135 Oct 19 03:14:29.130218 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 323/660] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:28 2022] GET /compute/v2.1/servers/ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667 => generated 1476 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:14:29.157721 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b6d43d2f-6300-4138-8551-01c4fdd85054 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:29.158360 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b6d43d2f-6300-4138-8551-01c4fdd85054 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] [instance: f538531d-7829-4f19-bf50-8eea58368871] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:29.181616 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b6d43d2f-6300-4138-8551-01c4fdd85054 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:29.182128 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b6d43d2f-6300-4138-8551-01c4fdd85054 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:29.182575 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b6d43d2f-6300-4138-8551-01c4fdd85054 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:29.184307 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b6d43d2f-6300-4138-8551-01c4fdd85054 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:29.189726 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b6d43d2f-6300-4138-8551-01c4fdd85054 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:29.196341 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b6d43d2f-6300-4138-8551-01c4fdd85054 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:29.283610 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b6d43d2f-6300-4138-8551-01c4fdd85054 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:29.284135 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b6d43d2f-6300-4138-8551-01c4fdd85054 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:29.284552 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b6d43d2f-6300-4138-8551-01c4fdd85054 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:29.285010 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-b6d43d2f-6300-4138-8551-01c4fdd85054 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lazy-loading 'fault' on Instance uuid f538531d-7829-4f19-bf50-8eea58368871 {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:14:29.538767 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b6d43d2f-6300-4138-8551-01c4fdd85054 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ff6534c5e74a2eb179044ef833f0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e88bbb75184a59b88e533a49d63cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:29.547006 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b6d43d2f-6300-4138-8551-01c4fdd85054 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] 10.222.0.52 "GET /compute/v2.1/servers/f538531d-7829-4f19-bf50-8eea58368871" status: 200 len: 1308 microversion: 2.1 time: 0.415401 Oct 19 03:14:29.554356 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 324/661] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:29 2022] GET /compute/v2.1/servers/f538531d-7829-4f19-bf50-8eea58368871 => generated 1308 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:14:29.560220 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-00d7c335-fa9b-44fc-9280-210f288c32d6 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:29.568182 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-00d7c335-fa9b-44fc-9280-210f288c32d6 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:29.581065 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-18eabada-45dc-4213-bfa2-9933363c9155 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:29.588096 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-00d7c335-fa9b-44fc-9280-210f288c32d6 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:29.588593 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-00d7c335-fa9b-44fc-9280-210f288c32d6 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:29.589046 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-00d7c335-fa9b-44fc-9280-210f288c32d6 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:29.589167 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-18eabada-45dc-4213-bfa2-9933363c9155 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/2d709051-db69-4ea9-96dc-ffe05e9c9b3a" status: 200 len: 1316 microversion: 2.1 time: 0.624655 Oct 19 03:14:29.593773 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 338/662] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:28 2022] GET /compute/v2.1/servers/2d709051-db69-4ea9-96dc-ffe05e9c9b3a => generated 1316 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:14:29.603900 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c446408e-a9b6-41f1-8843-a72d56fb84e1 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:29.604065 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-00d7c335-fa9b-44fc-9280-210f288c32d6 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:29.604618 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-00d7c335-fa9b-44fc-9280-210f288c32d6 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:29.605076 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-00d7c335-fa9b-44fc-9280-210f288c32d6 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:29.606086 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c446408e-a9b6-41f1-8843-a72d56fb84e1 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 82f8d22c-99ee-4c2b-8a36-5299c187ace7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:29.627249 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c446408e-a9b6-41f1-8843-a72d56fb84e1 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:29.628115 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c446408e-a9b6-41f1-8843-a72d56fb84e1 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:29.628377 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c446408e-a9b6-41f1-8843-a72d56fb84e1 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:29.629341 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c446408e-a9b6-41f1-8843-a72d56fb84e1 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:29.629725 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c446408e-a9b6-41f1-8843-a72d56fb84e1 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:29.630223 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c446408e-a9b6-41f1-8843-a72d56fb84e1 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:29.820623 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-00d7c335-fa9b-44fc-9280-210f288c32d6 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:29.840457 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-00d7c335-fa9b-44fc-9280-210f288c32d6 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:29.853980 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-00d7c335-fa9b-44fc-9280-210f288c32d6 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:29.866252 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-00d7c335-fa9b-44fc-9280-210f288c32d6 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1539 microversion: 2.91 time: 0.310408 Oct 19 03:14:29.867172 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 325/663] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:29 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1539 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:14:29.876724 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-9345f659-0e7b-496c-8ccc-1dc003b84d4b req-bed24186-7392-4857-bb1d-0186177407e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d709051-db69-4ea9-96dc-ffe05e9c9b3a", "tag": "4b4223dc-d902-469d-9459-70a814053f14"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:14:29.903808 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-9345f659-0e7b-496c-8ccc-1dc003b84d4b req-bed24186-7392-4857-bb1d-0186177407e8 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:29.904663 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-9345f659-0e7b-496c-8ccc-1dc003b84d4b req-bed24186-7392-4857-bb1d-0186177407e8 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:29.905826 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-9345f659-0e7b-496c-8ccc-1dc003b84d4b req-bed24186-7392-4857-bb1d-0186177407e8 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:29.927259 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-9345f659-0e7b-496c-8ccc-1dc003b84d4b req-bed24186-7392-4857-bb1d-0186177407e8 service nova] Creating event network-changed:4b4223dc-d902-469d-9459-70a814053f14 for instance 2d709051-db69-4ea9-96dc-ffe05e9c9b3a on n-h2-861333-8 Oct 19 03:14:29.928849 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c446408e-a9b6-41f1-8843-a72d56fb84e1 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:29.942390 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-9345f659-0e7b-496c-8ccc-1dc003b84d4b req-bed24186-7392-4857-bb1d-0186177407e8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072521 Oct 19 03:14:29.942996 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 326/664] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:14:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:14:29.947289 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c446408e-a9b6-41f1-8843-a72d56fb84e1 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:29.948237 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c446408e-a9b6-41f1-8843-a72d56fb84e1 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:29.951379 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c446408e-a9b6-41f1-8843-a72d56fb84e1 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/82f8d22c-99ee-4c2b-8a36-5299c187ace7" status: 200 len: 1556 microversion: 2.25 time: 0.355642 Oct 19 03:14:29.952213 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 339/665] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:29 2022] GET /compute/v2.1/servers/82f8d22c-99ee-4c2b-8a36-5299c187ace7 => generated 1556 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:14:29.971426 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a8d4295c-8248-40ae-9793-7a299ae9e032 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:29.978235 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a8d4295c-8248-40ae-9793-7a299ae9e032 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] [instance: d50976fb-756b-4b12-92f2-cedf87df492d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:29.981074 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7b660cfc-df60-4e8c-8e6e-486dc6deb210 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Calling method '.version_select at 0x7fc1311bc5e0>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:29.985018 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7b660cfc-df60-4e8c-8e6e-486dc6deb210 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:29.985894 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7b660cfc-df60-4e8c-8e6e-486dc6deb210 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:29.986405 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7b660cfc-df60-4e8c-8e6e-486dc6deb210 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:29.989295 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:14:29.993652 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a8d4295c-8248-40ae-9793-7a299ae9e032 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:29.994149 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a8d4295c-8248-40ae-9793-7a299ae9e032 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:29.994583 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a8d4295c-8248-40ae-9793-7a299ae9e032 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:29.995290 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a8d4295c-8248-40ae-9793-7a299ae9e032 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:29.995774 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a8d4295c-8248-40ae-9793-7a299ae9e032 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:29.996737 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a8d4295c-8248-40ae-9793-7a299ae9e032 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:29.997016 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7b660cfc-df60-4e8c-8e6e-486dc6deb210 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] 10.222.0.52 "GET /compute/v2.1/os-migrations" status: 200 len: 1525 microversion: 2.25 time: 0.022944 Oct 19 03:14:29.997989 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 340/666] 10.222.0.52 () {60 vars in 1184 bytes} [Wed Oct 19 03:14:29 2022] GET /compute/v2.1/os-migrations => generated 1525 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:14:30.013264 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-bdeb3184-d990-4ade-8160-73c6bb1a6a4c tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:30.014157 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-bdeb3184-d990-4ade-8160-73c6bb1a6a4c tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] [instance: 82f8d22c-99ee-4c2b-8a36-5299c187ace7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:30.021307 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bdeb3184-d990-4ade-8160-73c6bb1a6a4c tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:30.022361 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bdeb3184-d990-4ade-8160-73c6bb1a6a4c tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:30.022993 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bdeb3184-d990-4ade-8160-73c6bb1a6a4c tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:30.023893 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bdeb3184-d990-4ade-8160-73c6bb1a6a4c tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:30.024497 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bdeb3184-d990-4ade-8160-73c6bb1a6a4c tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:30.025076 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bdeb3184-d990-4ade-8160-73c6bb1a6a4c tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:30.089272 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a8d4295c-8248-40ae-9793-7a299ae9e032 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:30.101200 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a8d4295c-8248-40ae-9793-7a299ae9e032 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:30.104099 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a8d4295c-8248-40ae-9793-7a299ae9e032 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:30.111097 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a8d4295c-8248-40ae-9793-7a299ae9e032 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] 10.222.0.52 "GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d" status: 200 len: 1446 microversion: 2.75 time: 0.146245 Oct 19 03:14:30.120778 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 327/667] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:29 2022] GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d => generated 1446 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:14:30.161460 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-07c89bb6-0bb8-4f40-98b7-6ec74c9f7836 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:30.162151 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-07c89bb6-0bb8-4f40-98b7-6ec74c9f7836 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:30.169219 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-07c89bb6-0bb8-4f40-98b7-6ec74c9f7836 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:30.175585 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-07c89bb6-0bb8-4f40-98b7-6ec74c9f7836 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:30.176046 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-07c89bb6-0bb8-4f40-98b7-6ec74c9f7836 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:30.177137 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-07c89bb6-0bb8-4f40-98b7-6ec74c9f7836 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:30.177792 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-07c89bb6-0bb8-4f40-98b7-6ec74c9f7836 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:30.191419 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-07c89bb6-0bb8-4f40-98b7-6ec74c9f7836 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:30.218863 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-bdeb3184-d990-4ade-8160-73c6bb1a6a4c tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lazy-loading 'services' on Instance uuid 82f8d22c-99ee-4c2b-8a36-5299c187ace7 {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:14:30.238136 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-bdeb3184-d990-4ade-8160-73c6bb1a6a4c tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/82f8d22c-99ee-4c2b-8a36-5299c187ace7" status: 200 len: 2049 microversion: 2.25 time: 0.228585 Oct 19 03:14:30.239674 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 341/668] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:30 2022] GET /compute/v2.1/servers/82f8d22c-99ee-4c2b-8a36-5299c187ace7 => generated 2049 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:14:30.438091 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1f58040d-69ff-4a85-bce5-3f6b51c91605 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-372178838", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "networks": [{"uuid": "ba959db6-6066-4748-89f7-037c7f1d280b"}]}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:14:30.469697 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-07c89bb6-0bb8-4f40-98b7-6ec74c9f7836 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:30.482977 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-07c89bb6-0bb8-4f40-98b7-6ec74c9f7836 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667" status: 200 len: 1476 microversion: 2.1 time: 0.325590 Oct 19 03:14:30.501398 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 328/669] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:30 2022] GET /compute/v2.1/servers/ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667 => generated 1476 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:14:30.531088 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.network.neutron [None req-1f58040d-69ff-4a85-bce5-3f6b51c91605 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] validate_networks() for [('ba959db6-6066-4748-89f7-037c7f1d280b', None, None, None, None, None)] {{(pid=121135) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:14:30.580260 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-fdfa105a-0e6f-4a35-ac4c-256245765cd7 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:30.580958 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-fdfa105a-0e6f-4a35-ac4c-256245765cd7 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] [instance: f538531d-7829-4f19-bf50-8eea58368871] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:30.596320 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fdfa105a-0e6f-4a35-ac4c-256245765cd7 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:30.599370 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fdfa105a-0e6f-4a35-ac4c-256245765cd7 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:30.599370 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fdfa105a-0e6f-4a35-ac4c-256245765cd7 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:30.599370 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fdfa105a-0e6f-4a35-ac4c-256245765cd7 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:30.600435 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fdfa105a-0e6f-4a35-ac4c-256245765cd7 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:30.601095 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fdfa105a-0e6f-4a35-ac4c-256245765cd7 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:30.633533 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-fdfa105a-0e6f-4a35-ac4c-256245765cd7 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] HTTP exception thrown: Instance f538531d-7829-4f19-bf50-8eea58368871 could not be found. Oct 19 03:14:30.641639 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-fdfa105a-0e6f-4a35-ac4c-256245765cd7 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Request method failure captured: Oct 19 03:14:30.641639 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/f538531d-7829-4f19-bf50-8eea58368871 HTTP/1.1 Oct 19 03:14:30.641639 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:14:30.641639 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:14:30.641639 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:14:30.641639 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:14:30.641639 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:14:30.641639 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:14:30.641639 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:14:30.641639 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:14:30.641639 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT2tbt88srnxQUSMks-xuQPAv6QwU_WlcK_4fEe_tgQwWWdgFldYU8XtWEWzJoIYZsRlyKXnpO9cgztcAaQWcrmoFZqIMsXTvkqA-C-hveiNPyfzfuBttz_tOgNX_ymtWf7HWrJ0iEq8pesaivPDG4qfH3lb0SiQEncBiL6lxaL0fMPU Oct 19 03:14:30.641639 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:14:30.641639 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:14:30.641639 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:14:30.641639 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:14:30.641639 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:14:30.641639 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:14:30.641639 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 69e88bbb75184a59b88e533a49d63cd8 Oct 19 03:14:30.641639 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-LiveMigrationNegativeTest-1567694776 Oct 19 03:14:30.641639 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:14:30.641639 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:14:30.643243 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/69e88bbb75184a59b88e533a49d63cd8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/69e88bbb75184a59b88e533a49d63cd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/69e88bbb75184a59b88e533a49d63cd8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_69e88bbb75184a59b88e533a49d63cd8", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:14:30.643243 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-LiveMigrationNegativeTest-1567694776 Oct 19 03:14:30.643243 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 69e88bbb75184a59b88e533a49d63cd8 Oct 19 03:14:30.643243 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1567694776 Oct 19 03:14:30.643243 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-LiveMigrationNegativeTest-1567694776-project Oct 19 03:14:30.643243 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:14:30.643243 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:14:30.643243 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: e3ff6534c5e74a2eb179044ef833f0c1 Oct 19 03:14:30.643243 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-LiveMigrationNegativeTest-1567694776-project Oct 19 03:14:30.643243 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:14:30.643243 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance f538531d-7829-4f19-bf50-8eea58368871 could not be found. Oct 19 03:14:30.643243 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': 'f538531d-7829-4f19-bf50-8eea58368871'} Oct 19 03:14:30.644146 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:14:30.644146 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:14:30.644146 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:14:30.644146 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:14:30.644146 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:14:30.644146 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:14:30.644146 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:14:30.644146 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:14:30.644146 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:14:30.644146 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:14:30.644146 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f538531d-7829-4f19-bf50-8eea58368871 could not be found. Oct 19 03:14:30.644146 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:14:30.644146 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:14:30.644146 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:14:30.644146 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:14:30.644146 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:14:30.644146 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:14:30.644146 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:14:30.644146 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:14:30.644146 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:14:30.645935 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:14:30.645935 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:14:30.645935 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:14:30.645935 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:14:30.645935 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:14:30.645935 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:14:30.645935 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:14:30.645935 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f538531d-7829-4f19-bf50-8eea58368871 could not be found. Oct 19 03:14:30.645935 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:14:30.645935 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:14:30.645935 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:14:30.645935 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:14:30.645935 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:14:30.645935 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:14:30.645935 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:14:30.645935 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:14:30.645935 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f538531d-7829-4f19-bf50-8eea58368871 could not be found. Oct 19 03:14:30.645935 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:14:30.649934 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-fdfa105a-0e6f-4a35-ac4c-256245765cd7 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] Returning 404 to user: Instance f538531d-7829-4f19-bf50-8eea58368871 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:14:30.649934 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-fdfa105a-0e6f-4a35-ac4c-256245765cd7 tempest-LiveMigrationNegativeTest-1567694776 tempest-LiveMigrationNegativeTest-1567694776-project] 10.222.0.52 "GET /compute/v2.1/servers/f538531d-7829-4f19-bf50-8eea58368871" status: 404 len: 111 microversion: 2.1 time: 0.067590 Oct 19 03:14:30.649934 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 329/670] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:30 2022] GET /compute/v2.1/servers/f538531d-7829-4f19-bf50-8eea58368871 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:14:30.655240 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2d3834ce-d07f-44cb-b2c3-20561168dfb7 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:30.662054 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2d3834ce-d07f-44cb-b2c3-20561168dfb7 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 2d709051-db69-4ea9-96dc-ffe05e9c9b3a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:30.674571 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2d3834ce-d07f-44cb-b2c3-20561168dfb7 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:30.675066 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2d3834ce-d07f-44cb-b2c3-20561168dfb7 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:30.682567 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2d3834ce-d07f-44cb-b2c3-20561168dfb7 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:30.683349 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2d3834ce-d07f-44cb-b2c3-20561168dfb7 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:30.684380 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2d3834ce-d07f-44cb-b2c3-20561168dfb7 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:30.684817 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2d3834ce-d07f-44cb-b2c3-20561168dfb7 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:30.714228 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:14:31.159257 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-2d3834ce-d07f-44cb-b2c3-20561168dfb7 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:31.173710 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2d3834ce-d07f-44cb-b2c3-20561168dfb7 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/2d709051-db69-4ea9-96dc-ffe05e9c9b3a" status: 200 len: 1316 microversion: 2.1 time: 0.528534 Oct 19 03:14:31.174438 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 330/671] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:30 2022] GET /compute/v2.1/servers/2d709051-db69-4ea9-96dc-ffe05e9c9b3a => generated 1316 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:14:31.193929 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c96deb89-9c42-4494-9cf2-7bd83bda4f4c tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:31.194691 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c96deb89-9c42-4494-9cf2-7bd83bda4f4c tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:31.202383 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c96deb89-9c42-4494-9cf2-7bd83bda4f4c tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:31.203437 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c96deb89-9c42-4494-9cf2-7bd83bda4f4c tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:31.204284 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c96deb89-9c42-4494-9cf2-7bd83bda4f4c tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:31.205221 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c96deb89-9c42-4494-9cf2-7bd83bda4f4c tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:31.205880 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c96deb89-9c42-4494-9cf2-7bd83bda4f4c tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:31.208015 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c96deb89-9c42-4494-9cf2-7bd83bda4f4c tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:31.368467 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-1f58040d-69ff-4a85-bce5-3f6b51c91605 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Flavor limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:14:31.368975 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-1f58040d-69ff-4a85-bce5-3f6b51c91605 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Image limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:14:31.373621 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-1f58040d-69ff-4a85-bce5-3f6b51c91605 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Flavor pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:14:31.374180 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-1f58040d-69ff-4a85-bce5-3f6b51c91605 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Image pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:14:31.374710 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-1f58040d-69ff-4a85-bce5-3f6b51c91605 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:14:31.399183 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c96deb89-9c42-4494-9cf2-7bd83bda4f4c tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:31.406633 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1f58040d-69ff-4a85-bce5-3f6b51c91605 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:31.409635 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1f58040d-69ff-4a85-bce5-3f6b51c91605 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:31.409635 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1f58040d-69ff-4a85-bce5-3f6b51c91605 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:31.409635 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1f58040d-69ff-4a85-bce5-3f6b51c91605 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:31.409635 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1f58040d-69ff-4a85-bce5-3f6b51c91605 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:31.410842 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1f58040d-69ff-4a85-bce5-3f6b51c91605 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:31.412602 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c96deb89-9c42-4494-9cf2-7bd83bda4f4c tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:31.420977 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c96deb89-9c42-4494-9cf2-7bd83bda4f4c tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:31.427346 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c96deb89-9c42-4494-9cf2-7bd83bda4f4c tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1539 microversion: 2.91 time: 0.251795 Oct 19 03:14:31.438909 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 331/672] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:31 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1539 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:14:31.450113 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9ee05200-a106-43e9-b933-5684eff73f3f tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:31.456088 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9ee05200-a106-43e9-b933-5684eff73f3f tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] [instance: d50976fb-756b-4b12-92f2-cedf87df492d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:31.463601 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9ee05200-a106-43e9-b933-5684eff73f3f tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:31.465983 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9ee05200-a106-43e9-b933-5684eff73f3f tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:31.470764 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9ee05200-a106-43e9-b933-5684eff73f3f tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:31.472623 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9ee05200-a106-43e9-b933-5684eff73f3f tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:31.473658 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9ee05200-a106-43e9-b933-5684eff73f3f tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:31.475357 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9ee05200-a106-43e9-b933-5684eff73f3f tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:31.490170 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-1f58040d-69ff-4a85-bce5-3f6b51c91605 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Getting quotas for project 86eaac72e51142f795b3e482be19c4f2. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:14:31.505313 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-1f58040d-69ff-4a85-bce5-3f6b51c91605 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Getting quotas for user 7a453f077dae4dfa8a3cf28c555a9a7c and project 86eaac72e51142f795b3e482be19c4f2. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:14:31.532226 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1f58040d-69ff-4a85-bce5-3f6b51c91605 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Going to run 1 instances... {{(pid=121135) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:14:31.540000 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1f58040d-69ff-4a85-bce5-3f6b51c91605 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: d67da55c-724e-4305-9960-99d15ecfb23a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121135) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:14:31.633775 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9ee05200-a106-43e9-b933-5684eff73f3f tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:31.643784 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9ee05200-a106-43e9-b933-5684eff73f3f tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:31.645228 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9ee05200-a106-43e9-b933-5684eff73f3f tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:31.651040 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9ee05200-a106-43e9-b933-5684eff73f3f tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] 10.222.0.52 "GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d" status: 200 len: 1446 microversion: 2.75 time: 0.210857 Oct 19 03:14:31.652407 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 332/673] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:31 2022] GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d => generated 1446 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:14:31.658347 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0d020d01-5d0d-4983-ae6a-90bda03fc6f1 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:31.658969 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0d020d01-5d0d-4983-ae6a-90bda03fc6f1 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:31.665631 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0d020d01-5d0d-4983-ae6a-90bda03fc6f1 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:31.666275 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0d020d01-5d0d-4983-ae6a-90bda03fc6f1 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:31.666732 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0d020d01-5d0d-4983-ae6a-90bda03fc6f1 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:31.667579 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0d020d01-5d0d-4983-ae6a-90bda03fc6f1 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:31.668099 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0d020d01-5d0d-4983-ae6a-90bda03fc6f1 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:31.668545 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0d020d01-5d0d-4983-ae6a-90bda03fc6f1 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:31.696565 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1f58040d-69ff-4a85-bce5-3f6b51c91605 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.259054 Oct 19 03:14:31.696565 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 342/674] 10.222.0.52 () {62 vars in 1188 bytes} [Wed Oct 19 03:14:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1262 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 19 03:14:31.702786 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-77a80aa5-c53a-4d82-bde2-e7328cc79010 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:31.703841 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-77a80aa5-c53a-4d82-bde2-e7328cc79010 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: d67da55c-724e-4305-9960-99d15ecfb23a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:31.809663 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-77a80aa5-c53a-4d82-bde2-e7328cc79010 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:31.824721 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-77a80aa5-c53a-4d82-bde2-e7328cc79010 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:31.827154 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-77a80aa5-c53a-4d82-bde2-e7328cc79010 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:31.828511 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-77a80aa5-c53a-4d82-bde2-e7328cc79010 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/d67da55c-724e-4305-9960-99d15ecfb23a" status: 200 len: 1261 microversion: 2.25 time: 0.130231 Oct 19 03:14:31.829553 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 343/675] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:31 2022] GET /compute/v2.1/servers/d67da55c-724e-4305-9960-99d15ecfb23a => generated 1261 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:14:31.941730 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0d020d01-5d0d-4983-ae6a-90bda03fc6f1 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:31.955632 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0d020d01-5d0d-4983-ae6a-90bda03fc6f1 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667" status: 200 len: 1476 microversion: 2.1 time: 0.302064 Oct 19 03:14:31.960467 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 333/676] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:31 2022] GET /compute/v2.1/servers/ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667 => generated 1476 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:14:32.200251 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-783de7d2-0a42-4b59-a526-d47a4111006c tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:32.200873 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-783de7d2-0a42-4b59-a526-d47a4111006c tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 2d709051-db69-4ea9-96dc-ffe05e9c9b3a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:32.207015 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-783de7d2-0a42-4b59-a526-d47a4111006c tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:32.207572 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-783de7d2-0a42-4b59-a526-d47a4111006c tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:32.207936 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-783de7d2-0a42-4b59-a526-d47a4111006c tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:32.208640 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-783de7d2-0a42-4b59-a526-d47a4111006c tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:32.209093 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-783de7d2-0a42-4b59-a526-d47a4111006c tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:32.209555 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-783de7d2-0a42-4b59-a526-d47a4111006c tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:32.375503 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-783de7d2-0a42-4b59-a526-d47a4111006c tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:32.384054 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-783de7d2-0a42-4b59-a526-d47a4111006c tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/2d709051-db69-4ea9-96dc-ffe05e9c9b3a" status: 200 len: 1316 microversion: 2.1 time: 0.187670 Oct 19 03:14:32.406840 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 344/677] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:32 2022] GET /compute/v2.1/servers/2d709051-db69-4ea9-96dc-ffe05e9c9b3a => generated 1316 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:14:32.470353 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-13b80ace-c8aa-4be5-9aba-63b916507414 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:32.471093 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-13b80ace-c8aa-4be5-9aba-63b916507414 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:32.483454 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-13b80ace-c8aa-4be5-9aba-63b916507414 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:32.484072 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-13b80ace-c8aa-4be5-9aba-63b916507414 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:32.485223 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-13b80ace-c8aa-4be5-9aba-63b916507414 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:32.486149 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-13b80ace-c8aa-4be5-9aba-63b916507414 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:32.486901 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-13b80ace-c8aa-4be5-9aba-63b916507414 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:32.487398 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-13b80ace-c8aa-4be5-9aba-63b916507414 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:32.582541 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-13b80ace-c8aa-4be5-9aba-63b916507414 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:32.591619 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-13b80ace-c8aa-4be5-9aba-63b916507414 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:32.593060 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-13b80ace-c8aa-4be5-9aba-63b916507414 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:32.608222 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-13b80ace-c8aa-4be5-9aba-63b916507414 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1539 microversion: 2.91 time: 0.139969 Oct 19 03:14:32.608222 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 334/678] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:32 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1539 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:14:32.681070 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e8bff27d-df5e-4c60-b71c-641fb23b859f tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:32.681981 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e8bff27d-df5e-4c60-b71c-641fb23b859f tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] [instance: d50976fb-756b-4b12-92f2-cedf87df492d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:32.696054 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e8bff27d-df5e-4c60-b71c-641fb23b859f tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:32.696915 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e8bff27d-df5e-4c60-b71c-641fb23b859f tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:32.704646 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e8bff27d-df5e-4c60-b71c-641fb23b859f tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:32.704646 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e8bff27d-df5e-4c60-b71c-641fb23b859f tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:32.704646 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e8bff27d-df5e-4c60-b71c-641fb23b859f tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:32.704646 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e8bff27d-df5e-4c60-b71c-641fb23b859f tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:32.862761 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d0948e40-b9a9-42ef-b5ed-512e3d6e5de5 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:32.863720 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d0948e40-b9a9-42ef-b5ed-512e3d6e5de5 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: d67da55c-724e-4305-9960-99d15ecfb23a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:32.878378 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-e8bff27d-df5e-4c60-b71c-641fb23b859f tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:32.890561 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d0948e40-b9a9-42ef-b5ed-512e3d6e5de5 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:32.891169 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d0948e40-b9a9-42ef-b5ed-512e3d6e5de5 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:32.891629 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d0948e40-b9a9-42ef-b5ed-512e3d6e5de5 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:32.892388 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d0948e40-b9a9-42ef-b5ed-512e3d6e5de5 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:32.892848 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d0948e40-b9a9-42ef-b5ed-512e3d6e5de5 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:32.893279 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d0948e40-b9a9-42ef-b5ed-512e3d6e5de5 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:32.901270 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-e8bff27d-df5e-4c60-b71c-641fb23b859f tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:32.905301 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-e8bff27d-df5e-4c60-b71c-641fb23b859f tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:32.927966 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e8bff27d-df5e-4c60-b71c-641fb23b859f tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] 10.222.0.52 "GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d" status: 200 len: 1446 microversion: 2.75 time: 0.251974 Oct 19 03:14:32.937813 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 345/679] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:32 2022] GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d => generated 1446 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:14:32.987877 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-947c086b-01e8-4f71-8fe9-3c12c21ca787 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:32.988739 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-947c086b-01e8-4f71-8fe9-3c12c21ca787 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:32.995401 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-947c086b-01e8-4f71-8fe9-3c12c21ca787 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:32.999535 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-947c086b-01e8-4f71-8fe9-3c12c21ca787 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:33.002972 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-947c086b-01e8-4f71-8fe9-3c12c21ca787 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:33.003938 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-947c086b-01e8-4f71-8fe9-3c12c21ca787 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:33.004583 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-947c086b-01e8-4f71-8fe9-3c12c21ca787 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:33.005165 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-947c086b-01e8-4f71-8fe9-3c12c21ca787 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:33.104373 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d0948e40-b9a9-42ef-b5ed-512e3d6e5de5 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:33.114311 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d0948e40-b9a9-42ef-b5ed-512e3d6e5de5 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:33.123077 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d0948e40-b9a9-42ef-b5ed-512e3d6e5de5 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:33.124237 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d0948e40-b9a9-42ef-b5ed-512e3d6e5de5 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/d67da55c-724e-4305-9960-99d15ecfb23a" status: 200 len: 1265 microversion: 2.25 time: 0.268707 Oct 19 03:14:33.124809 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 335/680] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:32 2022] GET /compute/v2.1/servers/d67da55c-724e-4305-9960-99d15ecfb23a => generated 1265 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:14:33.359536 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-947c086b-01e8-4f71-8fe9-3c12c21ca787 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:33.369956 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-947c086b-01e8-4f71-8fe9-3c12c21ca787 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667" status: 200 len: 1476 microversion: 2.1 time: 0.386022 Oct 19 03:14:33.370554 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 346/681] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:32 2022] GET /compute/v2.1/servers/ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667 => generated 1476 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:14:33.429632 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4b8e5a5b-377e-4b4e-aa49-f9dab1495e12 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:33.431052 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4b8e5a5b-377e-4b4e-aa49-f9dab1495e12 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 2d709051-db69-4ea9-96dc-ffe05e9c9b3a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:33.439841 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4b8e5a5b-377e-4b4e-aa49-f9dab1495e12 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:33.441479 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4b8e5a5b-377e-4b4e-aa49-f9dab1495e12 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:33.442046 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4b8e5a5b-377e-4b4e-aa49-f9dab1495e12 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:33.443211 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4b8e5a5b-377e-4b4e-aa49-f9dab1495e12 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:33.443940 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4b8e5a5b-377e-4b4e-aa49-f9dab1495e12 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:33.444885 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4b8e5a5b-377e-4b4e-aa49-f9dab1495e12 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:33.639725 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-dbd65f06-5b84-4236-b27d-37e6cec000d8 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:33.641749 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-dbd65f06-5b84-4236-b27d-37e6cec000d8 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:33.654464 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dbd65f06-5b84-4236-b27d-37e6cec000d8 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:33.658133 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dbd65f06-5b84-4236-b27d-37e6cec000d8 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:33.660024 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dbd65f06-5b84-4236-b27d-37e6cec000d8 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:33.662460 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dbd65f06-5b84-4236-b27d-37e6cec000d8 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:33.662951 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dbd65f06-5b84-4236-b27d-37e6cec000d8 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:33.664079 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dbd65f06-5b84-4236-b27d-37e6cec000d8 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:33.672103 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-4b8e5a5b-377e-4b4e-aa49-f9dab1495e12 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:33.683114 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4b8e5a5b-377e-4b4e-aa49-f9dab1495e12 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/2d709051-db69-4ea9-96dc-ffe05e9c9b3a" status: 200 len: 1316 microversion: 2.1 time: 0.260310 Oct 19 03:14:33.700088 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 336/682] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:33 2022] GET /compute/v2.1/servers/2d709051-db69-4ea9-96dc-ffe05e9c9b3a => generated 1316 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:14:33.830304 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-dbd65f06-5b84-4236-b27d-37e6cec000d8 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:33.854183 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-dbd65f06-5b84-4236-b27d-37e6cec000d8 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:33.859961 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-dbd65f06-5b84-4236-b27d-37e6cec000d8 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:33.872349 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-dbd65f06-5b84-4236-b27d-37e6cec000d8 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1539 microversion: 2.91 time: 0.237389 Oct 19 03:14:33.889509 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 347/683] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:33 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1539 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:14:33.957666 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e870ef75-1dc8-4a59-afe0-1e125ddb4af3 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:33.958275 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e870ef75-1dc8-4a59-afe0-1e125ddb4af3 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] [instance: d50976fb-756b-4b12-92f2-cedf87df492d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:33.969809 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e870ef75-1dc8-4a59-afe0-1e125ddb4af3 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:33.971905 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e870ef75-1dc8-4a59-afe0-1e125ddb4af3 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:33.973243 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e870ef75-1dc8-4a59-afe0-1e125ddb4af3 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:33.974052 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e870ef75-1dc8-4a59-afe0-1e125ddb4af3 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:33.974518 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e870ef75-1dc8-4a59-afe0-1e125ddb4af3 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:33.975086 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e870ef75-1dc8-4a59-afe0-1e125ddb4af3 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:34.065527 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e870ef75-1dc8-4a59-afe0-1e125ddb4af3 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:34.074690 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e870ef75-1dc8-4a59-afe0-1e125ddb4af3 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:34.076839 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e870ef75-1dc8-4a59-afe0-1e125ddb4af3 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:34.082682 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e870ef75-1dc8-4a59-afe0-1e125ddb4af3 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] 10.222.0.52 "GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d" status: 200 len: 1446 microversion: 2.75 time: 0.130067 Oct 19 03:14:34.101401 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 337/684] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:33 2022] GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d => generated 1446 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:14:34.154517 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b06b4d79-3523-4c34-9eb3-30b04cd1d4f0 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:34.155135 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b06b4d79-3523-4c34-9eb3-30b04cd1d4f0 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: d67da55c-724e-4305-9960-99d15ecfb23a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:34.169719 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b06b4d79-3523-4c34-9eb3-30b04cd1d4f0 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:34.170310 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b06b4d79-3523-4c34-9eb3-30b04cd1d4f0 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:34.170770 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b06b4d79-3523-4c34-9eb3-30b04cd1d4f0 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:34.171568 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b06b4d79-3523-4c34-9eb3-30b04cd1d4f0 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:34.173826 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b06b4d79-3523-4c34-9eb3-30b04cd1d4f0 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:34.174291 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b06b4d79-3523-4c34-9eb3-30b04cd1d4f0 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:34.398634 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3154c68f-9e80-4b3f-b8b4-11819fe92ddd tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:34.399411 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3154c68f-9e80-4b3f-b8b4-11819fe92ddd tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:34.411737 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3154c68f-9e80-4b3f-b8b4-11819fe92ddd tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:34.421130 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3154c68f-9e80-4b3f-b8b4-11819fe92ddd tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:34.421130 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3154c68f-9e80-4b3f-b8b4-11819fe92ddd tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:34.421972 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3154c68f-9e80-4b3f-b8b4-11819fe92ddd tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:34.423506 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3154c68f-9e80-4b3f-b8b4-11819fe92ddd tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:34.425398 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3154c68f-9e80-4b3f-b8b4-11819fe92ddd tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:34.629602 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b06b4d79-3523-4c34-9eb3-30b04cd1d4f0 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:34.653563 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b06b4d79-3523-4c34-9eb3-30b04cd1d4f0 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:34.653563 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b06b4d79-3523-4c34-9eb3-30b04cd1d4f0 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:34.653563 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b06b4d79-3523-4c34-9eb3-30b04cd1d4f0 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/d67da55c-724e-4305-9960-99d15ecfb23a" status: 200 len: 1313 microversion: 2.25 time: 0.502655 Oct 19 03:14:34.654265 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 348/685] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:34 2022] GET /compute/v2.1/servers/d67da55c-724e-4305-9960-99d15ecfb23a => generated 1313 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:14:34.707710 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1d0bb171-869d-42f1-881c-f92faaf63681 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:34.708325 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1d0bb171-869d-42f1-881c-f92faaf63681 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 2d709051-db69-4ea9-96dc-ffe05e9c9b3a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:34.720591 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1d0bb171-869d-42f1-881c-f92faaf63681 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:34.721112 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1d0bb171-869d-42f1-881c-f92faaf63681 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:34.721588 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1d0bb171-869d-42f1-881c-f92faaf63681 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:34.722340 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1d0bb171-869d-42f1-881c-f92faaf63681 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:34.722789 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1d0bb171-869d-42f1-881c-f92faaf63681 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:34.723214 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1d0bb171-869d-42f1-881c-f92faaf63681 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:35.023830 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-3154c68f-9e80-4b3f-b8b4-11819fe92ddd tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:35.038610 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3154c68f-9e80-4b3f-b8b4-11819fe92ddd tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667" status: 200 len: 1476 microversion: 2.1 time: 0.646256 Oct 19 03:14:35.040831 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 338/686] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:34 2022] GET /compute/v2.1/servers/ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667 => generated 1476 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:14:35.061782 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-19c3ac98-067c-42f9-90c4-aa94651ffba8 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:35.064895 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-19c3ac98-067c-42f9-90c4-aa94651ffba8 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:35.076155 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-19c3ac98-067c-42f9-90c4-aa94651ffba8 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:35.088510 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-19c3ac98-067c-42f9-90c4-aa94651ffba8 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:35.088510 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-19c3ac98-067c-42f9-90c4-aa94651ffba8 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:35.088510 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-19c3ac98-067c-42f9-90c4-aa94651ffba8 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:35.088510 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-19c3ac98-067c-42f9-90c4-aa94651ffba8 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:35.088958 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-19c3ac98-067c-42f9-90c4-aa94651ffba8 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:35.129317 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-1d0bb171-869d-42f1-881c-f92faaf63681 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:35.138598 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1d0bb171-869d-42f1-881c-f92faaf63681 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/2d709051-db69-4ea9-96dc-ffe05e9c9b3a" status: 200 len: 1316 microversion: 2.1 time: 0.435003 Oct 19 03:14:35.157014 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 349/687] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:34 2022] GET /compute/v2.1/servers/2d709051-db69-4ea9-96dc-ffe05e9c9b3a => generated 1316 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:14:35.163921 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a20c9876-41b0-4b5d-9d1a-fa6f35c9ad40 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:35.164594 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a20c9876-41b0-4b5d-9d1a-fa6f35c9ad40 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] [instance: d50976fb-756b-4b12-92f2-cedf87df492d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:35.181602 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a20c9876-41b0-4b5d-9d1a-fa6f35c9ad40 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:35.182109 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a20c9876-41b0-4b5d-9d1a-fa6f35c9ad40 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:35.182552 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a20c9876-41b0-4b5d-9d1a-fa6f35c9ad40 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:35.183271 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a20c9876-41b0-4b5d-9d1a-fa6f35c9ad40 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:35.184403 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a20c9876-41b0-4b5d-9d1a-fa6f35c9ad40 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:35.191742 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a20c9876-41b0-4b5d-9d1a-fa6f35c9ad40 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:35.249688 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-19c3ac98-067c-42f9-90c4-aa94651ffba8 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:35.258780 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-19c3ac98-067c-42f9-90c4-aa94651ffba8 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:35.260495 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-19c3ac98-067c-42f9-90c4-aa94651ffba8 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:35.278367 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-19c3ac98-067c-42f9-90c4-aa94651ffba8 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1539 microversion: 2.91 time: 0.224240 Oct 19 03:14:35.278367 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 339/688] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:35 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1539 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:14:35.288378 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a20c9876-41b0-4b5d-9d1a-fa6f35c9ad40 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:35.298605 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a20c9876-41b0-4b5d-9d1a-fa6f35c9ad40 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:35.302337 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a20c9876-41b0-4b5d-9d1a-fa6f35c9ad40 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:35.314799 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a20c9876-41b0-4b5d-9d1a-fa6f35c9ad40 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] 10.222.0.52 "GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d" status: 200 len: 1446 microversion: 2.75 time: 0.157265 Oct 19 03:14:35.319597 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 350/689] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:35 2022] GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d => generated 1446 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:14:35.680539 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3ec05f3d-bc9e-4e91-b68c-0a7e2394f725 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:35.681154 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3ec05f3d-bc9e-4e91-b68c-0a7e2394f725 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: d67da55c-724e-4305-9960-99d15ecfb23a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:35.688539 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3ec05f3d-bc9e-4e91-b68c-0a7e2394f725 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:35.689253 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3ec05f3d-bc9e-4e91-b68c-0a7e2394f725 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:35.689903 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3ec05f3d-bc9e-4e91-b68c-0a7e2394f725 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:35.690893 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3ec05f3d-bc9e-4e91-b68c-0a7e2394f725 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:35.691513 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3ec05f3d-bc9e-4e91-b68c-0a7e2394f725 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:35.692188 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3ec05f3d-bc9e-4e91-b68c-0a7e2394f725 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:35.897117 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-b5725641-0e9f-4757-b034-bbf19ebbad53 req-cf25deda-384b-4fc7-8246-bbfc6e5aea7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d709051-db69-4ea9-96dc-ffe05e9c9b3a", "name": "network-vif-plugged", "status": "completed", "tag": "4b4223dc-d902-469d-9459-70a814053f14"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:14:35.944225 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-b5725641-0e9f-4757-b034-bbf19ebbad53 req-cf25deda-384b-4fc7-8246-bbfc6e5aea7e service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:35.945226 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-b5725641-0e9f-4757-b034-bbf19ebbad53 req-cf25deda-384b-4fc7-8246-bbfc6e5aea7e service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:35.945888 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-b5725641-0e9f-4757-b034-bbf19ebbad53 req-cf25deda-384b-4fc7-8246-bbfc6e5aea7e service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:35.988746 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-b5725641-0e9f-4757-b034-bbf19ebbad53 req-cf25deda-384b-4fc7-8246-bbfc6e5aea7e service nova] Creating event network-vif-plugged:4b4223dc-d902-469d-9459-70a814053f14 for instance 2d709051-db69-4ea9-96dc-ffe05e9c9b3a on n-h2-861333-8 Oct 19 03:14:36.002696 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-b5725641-0e9f-4757-b034-bbf19ebbad53 req-cf25deda-384b-4fc7-8246-bbfc6e5aea7e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105489 Oct 19 03:14:36.003738 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 351/690] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:14:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:14:36.034867 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-3ec05f3d-bc9e-4e91-b68c-0a7e2394f725 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:36.060659 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-3ec05f3d-bc9e-4e91-b68c-0a7e2394f725 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:36.063590 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-3ec05f3d-bc9e-4e91-b68c-0a7e2394f725 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:36.068734 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-dfd54152-542d-43ae-8752-bc2bfc235a94 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:36.070141 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-dfd54152-542d-43ae-8752-bc2bfc235a94 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:36.081662 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3ec05f3d-bc9e-4e91-b68c-0a7e2394f725 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/d67da55c-724e-4305-9960-99d15ecfb23a" status: 200 len: 1361 microversion: 2.25 time: 0.400938 Oct 19 03:14:36.082299 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 340/691] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:35 2022] GET /compute/v2.1/servers/d67da55c-724e-4305-9960-99d15ecfb23a => generated 1361 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:14:36.088413 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dfd54152-542d-43ae-8752-bc2bfc235a94 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:36.088924 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dfd54152-542d-43ae-8752-bc2bfc235a94 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:36.096440 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dfd54152-542d-43ae-8752-bc2bfc235a94 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:36.097675 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dfd54152-542d-43ae-8752-bc2bfc235a94 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:36.100878 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dfd54152-542d-43ae-8752-bc2bfc235a94 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:36.102711 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dfd54152-542d-43ae-8752-bc2bfc235a94 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:36.163051 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8b197796-1c37-4581-bf34-ed026ec82a9e tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:36.164117 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8b197796-1c37-4581-bf34-ed026ec82a9e tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 2d709051-db69-4ea9-96dc-ffe05e9c9b3a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:36.176871 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8b197796-1c37-4581-bf34-ed026ec82a9e tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:36.177607 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8b197796-1c37-4581-bf34-ed026ec82a9e tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:36.179595 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8b197796-1c37-4581-bf34-ed026ec82a9e tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:36.180943 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8b197796-1c37-4581-bf34-ed026ec82a9e tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:36.182592 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8b197796-1c37-4581-bf34-ed026ec82a9e tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:36.184730 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8b197796-1c37-4581-bf34-ed026ec82a9e tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:36.556338 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-dfd54152-542d-43ae-8752-bc2bfc235a94 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:36.561163 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8b197796-1c37-4581-bf34-ed026ec82a9e tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:36.566744 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-dfd54152-542d-43ae-8752-bc2bfc235a94 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667" status: 200 len: 1476 microversion: 2.1 time: 0.504735 Oct 19 03:14:36.572935 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 352/692] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:36 2022] GET /compute/v2.1/servers/ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667 => generated 1476 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:14:36.573527 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8b197796-1c37-4581-bf34-ed026ec82a9e tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/2d709051-db69-4ea9-96dc-ffe05e9c9b3a" status: 200 len: 1316 microversion: 2.1 time: 0.412260 Oct 19 03:14:36.573527 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 341/693] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:36 2022] GET /compute/v2.1/servers/2d709051-db69-4ea9-96dc-ffe05e9c9b3a => generated 1316 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:14:36.575623 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f71f828e-f624-4bce-b4fe-be4b3dd6a7b4 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:36.576402 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f71f828e-f624-4bce-b4fe-be4b3dd6a7b4 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:36.583368 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f71f828e-f624-4bce-b4fe-be4b3dd6a7b4 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:36.584736 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f71f828e-f624-4bce-b4fe-be4b3dd6a7b4 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:36.585403 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f71f828e-f624-4bce-b4fe-be4b3dd6a7b4 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:36.586406 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f71f828e-f624-4bce-b4fe-be4b3dd6a7b4 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:36.586677 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-69db2f6b-e306-48e9-8b1c-59466dac4a91 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:36.587776 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-69db2f6b-e306-48e9-8b1c-59466dac4a91 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] [instance: d50976fb-756b-4b12-92f2-cedf87df492d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:36.588531 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f71f828e-f624-4bce-b4fe-be4b3dd6a7b4 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:36.589053 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f71f828e-f624-4bce-b4fe-be4b3dd6a7b4 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:36.604586 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-69db2f6b-e306-48e9-8b1c-59466dac4a91 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:36.605093 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-69db2f6b-e306-48e9-8b1c-59466dac4a91 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:36.606093 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-69db2f6b-e306-48e9-8b1c-59466dac4a91 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:36.614043 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-69db2f6b-e306-48e9-8b1c-59466dac4a91 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:36.614533 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-69db2f6b-e306-48e9-8b1c-59466dac4a91 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:36.614976 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-69db2f6b-e306-48e9-8b1c-59466dac4a91 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:36.698892 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f71f828e-f624-4bce-b4fe-be4b3dd6a7b4 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:36.711473 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f71f828e-f624-4bce-b4fe-be4b3dd6a7b4 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:36.722975 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f71f828e-f624-4bce-b4fe-be4b3dd6a7b4 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:36.730011 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f71f828e-f624-4bce-b4fe-be4b3dd6a7b4 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1539 microversion: 2.91 time: 0.160961 Oct 19 03:14:36.732137 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 353/694] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:36 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1539 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:14:36.776099 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-69db2f6b-e306-48e9-8b1c-59466dac4a91 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:36.786546 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-69db2f6b-e306-48e9-8b1c-59466dac4a91 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:36.788983 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-69db2f6b-e306-48e9-8b1c-59466dac4a91 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:36.796763 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-69db2f6b-e306-48e9-8b1c-59466dac4a91 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] 10.222.0.52 "GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d" status: 200 len: 1446 microversion: 2.75 time: 0.224366 Oct 19 03:14:36.805003 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 342/695] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:36 2022] GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d => generated 1446 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:14:36.889863 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6804b409-9f7c-4e09-a46f-f7da8dccf47d tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-439234676", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:14:36.949908 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.network.neutron [None req-6804b409-9f7c-4e09-a46f-f7da8dccf47d tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] validate_networks() for None {{(pid=121135) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:14:37.061858 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6057f305-eec2-4cbe-9ab9-32ebcbe9ebfc tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Action: 'create', calling method: .version_select at 0x7fc1310cc940>, body: {"keypair": {"name": "tempest-keypair-921583109", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG6+0q3OM7aYF1pWXX42+xrvDmdHPbNZsk/UCJYQExJ2YQf2Pugg6GQw8BCbEDJn4WO/rzNgnRCJiHCYkcwxZKxopu7y4sZ8ZUk6Ktsdg9uhL4gsoq/boy6Bb/8bASAHIg=="}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:14:37.079784 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-6057f305-eec2-4cbe-9ab9-32ebcbe9ebfc tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Getting quotas for project 48c12a432bbd43bd8f70ba6e941c28a2. Resources: {'key_pairs'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:14:37.085484 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-6057f305-eec2-4cbe-9ab9-32ebcbe9ebfc tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Getting quotas for user 28072a54d5934ea28e7d3205841c0852 and project 48c12a432bbd43bd8f70ba6e941c28a2. Resources: {'key_pairs'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:14:37.099419 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:14:37.152894 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6057f305-eec2-4cbe-9ab9-32ebcbe9ebfc tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.343918 Oct 19 03:14:37.152894 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 343/696] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Oct 19 03:14:36 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:14:37.161987 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-bfa99ae8-b0e2-4470-98c3-dce062f3ba8b req-6f74ec6d-09cb-46c3-87d8-f8c600cb7ab5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d67da55c-724e-4305-9960-99d15ecfb23a", "tag": "0816439e-71ce-4a08-8fd4-aa143aa0c267"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:14:37.184466 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-bfa99ae8-b0e2-4470-98c3-dce062f3ba8b req-6f74ec6d-09cb-46c3-87d8-f8c600cb7ab5 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:37.184951 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-bfa99ae8-b0e2-4470-98c3-dce062f3ba8b req-6f74ec6d-09cb-46c3-87d8-f8c600cb7ab5 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:37.185434 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-bfa99ae8-b0e2-4470-98c3-dce062f3ba8b req-6f74ec6d-09cb-46c3-87d8-f8c600cb7ab5 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:37.196419 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-bfa99ae8-b0e2-4470-98c3-dce062f3ba8b req-6f74ec6d-09cb-46c3-87d8-f8c600cb7ab5 service nova] Creating event network-changed:0816439e-71ce-4a08-8fd4-aa143aa0c267 for instance d67da55c-724e-4305-9960-99d15ecfb23a on n-h1-861333-8 Oct 19 03:14:37.202827 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-bfa99ae8-b0e2-4470-98c3-dce062f3ba8b req-6f74ec6d-09cb-46c3-87d8-f8c600cb7ab5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050855 Oct 19 03:14:37.203928 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 344/697] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:14:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:14:37.208563 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-6804b409-9f7c-4e09-a46f-f7da8dccf47d tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Flavor limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:14:37.213523 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-6804b409-9f7c-4e09-a46f-f7da8dccf47d tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Image limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:14:37.213643 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3c9c696d-3d68-42f8-a167-e336d02b0132 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:37.213749 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-6804b409-9f7c-4e09-a46f-f7da8dccf47d tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Flavor pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:14:37.213829 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3c9c696d-3d68-42f8-a167-e336d02b0132 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: d67da55c-724e-4305-9960-99d15ecfb23a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:37.213904 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-6804b409-9f7c-4e09-a46f-f7da8dccf47d tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Image pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:14:37.213904 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-6804b409-9f7c-4e09-a46f-f7da8dccf47d tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:14:37.218161 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3c9c696d-3d68-42f8-a167-e336d02b0132 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:37.218878 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3c9c696d-3d68-42f8-a167-e336d02b0132 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:37.219529 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3c9c696d-3d68-42f8-a167-e336d02b0132 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:37.220432 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3c9c696d-3d68-42f8-a167-e336d02b0132 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:37.221065 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3c9c696d-3d68-42f8-a167-e336d02b0132 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:37.221709 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3c9c696d-3d68-42f8-a167-e336d02b0132 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:37.222623 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6804b409-9f7c-4e09-a46f-f7da8dccf47d tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:37.223163 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6804b409-9f7c-4e09-a46f-f7da8dccf47d tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:37.223605 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6804b409-9f7c-4e09-a46f-f7da8dccf47d tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:37.224344 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6804b409-9f7c-4e09-a46f-f7da8dccf47d tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:37.224951 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6804b409-9f7c-4e09-a46f-f7da8dccf47d tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:37.225411 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6804b409-9f7c-4e09-a46f-f7da8dccf47d tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:37.248046 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-6804b409-9f7c-4e09-a46f-f7da8dccf47d tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Getting quotas for project 446866ac21894411965aedd84ceeb8bc. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:14:37.253731 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-6804b409-9f7c-4e09-a46f-f7da8dccf47d tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Getting quotas for user 6a2339bd95b0489ab4ae457b3cd072d5 and project 446866ac21894411965aedd84ceeb8bc. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:14:37.270263 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:14:37.272252 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6804b409-9f7c-4e09-a46f-f7da8dccf47d tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Going to run 1 instances... {{(pid=121135) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:14:37.275423 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6804b409-9f7c-4e09-a46f-f7da8dccf47d tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] [instance: f603dfa8-a2e6-4018-aaeb-639bf5eb24c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121135) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:14:37.389921 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6804b409-9f7c-4e09-a46f-f7da8dccf47d tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.656492 Oct 19 03:14:37.397316 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 354/698] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:14:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 664 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 03:14:37.406253 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-3c9c696d-3d68-42f8-a167-e336d02b0132 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:37.424059 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0279a7cc-b8ea-4bd6-bea5-9b05f7f07f7d tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:37.426857 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0279a7cc-b8ea-4bd6-bea5-9b05f7f07f7d tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] [instance: f603dfa8-a2e6-4018-aaeb-639bf5eb24c6] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:37.431180 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-3c9c696d-3d68-42f8-a167-e336d02b0132 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:37.434858 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-3c9c696d-3d68-42f8-a167-e336d02b0132 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:37.437293 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3c9c696d-3d68-42f8-a167-e336d02b0132 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/d67da55c-724e-4305-9960-99d15ecfb23a" status: 200 len: 1361 microversion: 2.25 time: 0.230855 Oct 19 03:14:37.438866 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 345/699] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:37 2022] GET /compute/v2.1/servers/d67da55c-724e-4305-9960-99d15ecfb23a => generated 1361 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:14:37.507805 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-0279a7cc-b8ea-4bd6-bea5-9b05f7f07f7d tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2339bd95b0489ab4ae457b3cd072d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446866ac21894411965aedd84ceeb8bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:37.523064 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0279a7cc-b8ea-4bd6-bea5-9b05f7f07f7d tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] 10.222.0.52 "GET /compute/v2.1/servers/f603dfa8-a2e6-4018-aaeb-639bf5eb24c6" status: 200 len: 1222 microversion: 2.1 time: 0.124072 Oct 19 03:14:37.534232 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 355/700] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:37 2022] GET /compute/v2.1/servers/f603dfa8-a2e6-4018-aaeb-639bf5eb24c6 => generated 1222 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:14:37.618699 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-25d20e11-e595-4621-821c-b926aa58514f tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:37.619299 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-25d20e11-e595-4621-821c-b926aa58514f tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 2d709051-db69-4ea9-96dc-ffe05e9c9b3a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:37.621474 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0b03ac8b-7f7b-499b-b71d-bf262699799c tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:37.622253 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0b03ac8b-7f7b-499b-b71d-bf262699799c tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:37.642491 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-25d20e11-e595-4621-821c-b926aa58514f tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:37.642995 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-25d20e11-e595-4621-821c-b926aa58514f tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:37.643421 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-25d20e11-e595-4621-821c-b926aa58514f tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:37.644136 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-25d20e11-e595-4621-821c-b926aa58514f tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:37.644694 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-25d20e11-e595-4621-821c-b926aa58514f tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:37.645102 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-25d20e11-e595-4621-821c-b926aa58514f tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:37.650064 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0b03ac8b-7f7b-499b-b71d-bf262699799c tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:37.650858 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0b03ac8b-7f7b-499b-b71d-bf262699799c tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:37.651581 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0b03ac8b-7f7b-499b-b71d-bf262699799c tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:37.655290 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0b03ac8b-7f7b-499b-b71d-bf262699799c tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:37.657002 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0b03ac8b-7f7b-499b-b71d-bf262699799c tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:37.659100 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0b03ac8b-7f7b-499b-b71d-bf262699799c tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:37.890211 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-25d20e11-e595-4621-821c-b926aa58514f tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:37.894517 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0b03ac8b-7f7b-499b-b71d-bf262699799c tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:37.903173 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0b03ac8b-7f7b-499b-b71d-bf262699799c tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667" status: 200 len: 1476 microversion: 2.1 time: 0.296897 Oct 19 03:14:37.906732 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-25d20e11-e595-4621-821c-b926aa58514f tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/2d709051-db69-4ea9-96dc-ffe05e9c9b3a" status: 200 len: 1316 microversion: 2.1 time: 0.294601 Oct 19 03:14:37.908579 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 346/701] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:37 2022] GET /compute/v2.1/servers/ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667 => generated 1476 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:14:37.929539 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 356/702] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:37 2022] GET /compute/v2.1/servers/2d709051-db69-4ea9-96dc-ffe05e9c9b3a => generated 1316 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:14:37.936590 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0ec5b92f-2955-4bf9-ab34-ba08601ac79f tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:37.937707 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0ec5b92f-2955-4bf9-ab34-ba08601ac79f tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:37.940262 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b6a6d2df-3cbe-4bd4-8459-c2abb84461ee tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:37.941075 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b6a6d2df-3cbe-4bd4-8459-c2abb84461ee tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] [instance: d50976fb-756b-4b12-92f2-cedf87df492d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:37.947928 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b6a6d2df-3cbe-4bd4-8459-c2abb84461ee tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:37.948490 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b6a6d2df-3cbe-4bd4-8459-c2abb84461ee tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:37.952766 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b6a6d2df-3cbe-4bd4-8459-c2abb84461ee tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:37.952766 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b6a6d2df-3cbe-4bd4-8459-c2abb84461ee tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:37.952766 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b6a6d2df-3cbe-4bd4-8459-c2abb84461ee tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:37.952766 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b6a6d2df-3cbe-4bd4-8459-c2abb84461ee tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:37.958535 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0ec5b92f-2955-4bf9-ab34-ba08601ac79f tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:37.959038 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0ec5b92f-2955-4bf9-ab34-ba08601ac79f tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:37.959476 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0ec5b92f-2955-4bf9-ab34-ba08601ac79f tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:37.960183 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0ec5b92f-2955-4bf9-ab34-ba08601ac79f tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:37.960769 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0ec5b92f-2955-4bf9-ab34-ba08601ac79f tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:37.961464 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0ec5b92f-2955-4bf9-ab34-ba08601ac79f tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:38.028245 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b6a6d2df-3cbe-4bd4-8459-c2abb84461ee tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:38.038077 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b6a6d2df-3cbe-4bd4-8459-c2abb84461ee tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:38.040048 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b6a6d2df-3cbe-4bd4-8459-c2abb84461ee tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:38.047481 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b6a6d2df-3cbe-4bd4-8459-c2abb84461ee tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] 10.222.0.52 "GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d" status: 200 len: 1446 microversion: 2.75 time: 0.116770 Oct 19 03:14:38.048356 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 357/703] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:37 2022] GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d => generated 1446 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:14:38.078946 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0ec5b92f-2955-4bf9-ab34-ba08601ac79f tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:38.087766 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0ec5b92f-2955-4bf9-ab34-ba08601ac79f tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:38.089530 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0ec5b92f-2955-4bf9-ab34-ba08601ac79f tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:38.094610 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0ec5b92f-2955-4bf9-ab34-ba08601ac79f tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1539 microversion: 2.91 time: 0.184847 Oct 19 03:14:38.095178 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 347/704] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:37 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1539 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:14:38.380725 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b501ab78-bff4-4034-a6a2-c16d50568d1e tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:38.381226 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b501ab78-bff4-4034-a6a2-c16d50568d1e tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] [instance: f476cc02-1b56-4c61-93a4-c3d36c38792d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:38.387820 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b501ab78-bff4-4034-a6a2-c16d50568d1e tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:38.388451 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b501ab78-bff4-4034-a6a2-c16d50568d1e tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:38.388986 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b501ab78-bff4-4034-a6a2-c16d50568d1e tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:38.389913 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b501ab78-bff4-4034-a6a2-c16d50568d1e tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:38.390438 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b501ab78-bff4-4034-a6a2-c16d50568d1e tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:38.390903 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b501ab78-bff4-4034-a6a2-c16d50568d1e tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:38.417196 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b501ab78-bff4-4034-a6a2-c16d50568d1e tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] [instance: f476cc02-1b56-4c61-93a4-c3d36c38792d] Going to try to terminate instance {{(pid=121135) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:14:38.467577 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-cb4c6ac9-6466-44f6-9ca1-905384afc3e9 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:38.468213 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-cb4c6ac9-6466-44f6-9ca1-905384afc3e9 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: d67da55c-724e-4305-9960-99d15ecfb23a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:38.475091 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cb4c6ac9-6466-44f6-9ca1-905384afc3e9 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:38.475578 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cb4c6ac9-6466-44f6-9ca1-905384afc3e9 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:38.476125 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cb4c6ac9-6466-44f6-9ca1-905384afc3e9 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:38.476821 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cb4c6ac9-6466-44f6-9ca1-905384afc3e9 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:38.477281 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cb4c6ac9-6466-44f6-9ca1-905384afc3e9 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:38.477763 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cb4c6ac9-6466-44f6-9ca1-905384afc3e9 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:38.680178 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b501ab78-bff4-4034-a6a2-c16d50568d1e tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] 10.222.0.52 "DELETE /compute/v2.1/servers/f476cc02-1b56-4c61-93a4-c3d36c38792d" status: 204 len: 0 microversion: 2.1 time: 0.302689 Oct 19 03:14:38.691126 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 358/705] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:14:38 2022] DELETE /compute/v2.1/servers/f476cc02-1b56-4c61-93a4-c3d36c38792d => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:14:38.710161 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-cb4c6ac9-6466-44f6-9ca1-905384afc3e9 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:38.713160 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-8b0f8f04-2f53-49fd-a758-d60420bf2676 tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:38.713433 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=100 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:14:38.716985 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-8b0f8f04-2f53-49fd-a758-d60420bf2676 tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] [instance: f603dfa8-a2e6-4018-aaeb-639bf5eb24c6] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:38.720341 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8b0f8f04-2f53-49fd-a758-d60420bf2676 tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:38.720687 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-cb4c6ac9-6466-44f6-9ca1-905384afc3e9 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:38.720949 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8b0f8f04-2f53-49fd-a758-d60420bf2676 tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:38.721420 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8b0f8f04-2f53-49fd-a758-d60420bf2676 tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:38.722133 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8b0f8f04-2f53-49fd-a758-d60420bf2676 tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:38.722430 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-cb4c6ac9-6466-44f6-9ca1-905384afc3e9 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:38.722780 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8b0f8f04-2f53-49fd-a758-d60420bf2676 tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:38.723454 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8b0f8f04-2f53-49fd-a758-d60420bf2676 tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:38.724714 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-cb4c6ac9-6466-44f6-9ca1-905384afc3e9 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/d67da55c-724e-4305-9960-99d15ecfb23a" status: 200 len: 1361 microversion: 2.25 time: 0.261126 Oct 19 03:14:38.738118 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 348/706] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:38 2022] GET /compute/v2.1/servers/d67da55c-724e-4305-9960-99d15ecfb23a => generated 1361 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:14:38.759985 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:14:38.821797 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-8b0f8f04-2f53-49fd-a758-d60420bf2676 tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2339bd95b0489ab4ae457b3cd072d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446866ac21894411965aedd84ceeb8bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:38.831826 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-8b0f8f04-2f53-49fd-a758-d60420bf2676 tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] 10.222.0.52 "GET /compute/v2.1/servers/f603dfa8-a2e6-4018-aaeb-639bf5eb24c6" status: 200 len: 1226 microversion: 2.1 time: 0.140705 Oct 19 03:14:38.832815 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 359/707] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:38 2022] GET /compute/v2.1/servers/f603dfa8-a2e6-4018-aaeb-639bf5eb24c6 => generated 1226 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:14:38.834433 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-59ac1032-c6fa-424c-be05-219c2a2e5fa6 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1911704392", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "568006541", "adminPass": "***", "networks": [{"uuid": "174199d3-3016-422c-a5ab-ef1cadcbcb20"}], "security_groups": [{"name": "tempest-securitygroup--855962973"}], "key_name": "tempest-keypair-1415990507", "user_data": "}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:14:38.950159 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1d62fd3b-8fd5-404b-94af-52e559723a9a tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:38.950755 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1d62fd3b-8fd5-404b-94af-52e559723a9a tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 2d709051-db69-4ea9-96dc-ffe05e9c9b3a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:38.957471 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1d62fd3b-8fd5-404b-94af-52e559723a9a tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:38.958071 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1d62fd3b-8fd5-404b-94af-52e559723a9a tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:38.958533 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1d62fd3b-8fd5-404b-94af-52e559723a9a tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:38.959488 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1d62fd3b-8fd5-404b-94af-52e559723a9a tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:38.965616 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1d62fd3b-8fd5-404b-94af-52e559723a9a tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:38.966489 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1d62fd3b-8fd5-404b-94af-52e559723a9a tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:39.013597 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-59ac1032-c6fa-424c-be05-219c2a2e5fa6 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] validate_networks() for [('174199d3-3016-422c-a5ab-ef1cadcbcb20', None, None, None, None, None)] {{(pid=121134) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:14:39.260630 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-1d62fd3b-8fd5-404b-94af-52e559723a9a tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:39.269805 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1d62fd3b-8fd5-404b-94af-52e559723a9a tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/2d709051-db69-4ea9-96dc-ffe05e9c9b3a" status: 200 len: 1466 microversion: 2.1 time: 0.325496 Oct 19 03:14:39.270667 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 360/708] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:38 2022] GET /compute/v2.1/servers/2d709051-db69-4ea9-96dc-ffe05e9c9b3a => generated 1466 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:14:39.276616 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-86a34166-9adf-4b1d-925d-a17379c30b8a tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:39.277971 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-86a34166-9adf-4b1d-925d-a17379c30b8a tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:39.285119 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-86a34166-9adf-4b1d-925d-a17379c30b8a tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:39.288936 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-86a34166-9adf-4b1d-925d-a17379c30b8a tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:39.289765 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-86a34166-9adf-4b1d-925d-a17379c30b8a tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:39.290851 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-86a34166-9adf-4b1d-925d-a17379c30b8a tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:39.291480 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-86a34166-9adf-4b1d-925d-a17379c30b8a tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:39.292090 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-86a34166-9adf-4b1d-925d-a17379c30b8a tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:39.894088 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-86a34166-9adf-4b1d-925d-a17379c30b8a tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:39.902733 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-86a34166-9adf-4b1d-925d-a17379c30b8a tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667" status: 200 len: 1476 microversion: 2.1 time: 0.630104 Oct 19 03:14:39.903313 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 361/709] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:39 2022] GET /compute/v2.1/servers/ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667 => generated 1476 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:14:39.907817 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-64b08fd3-95c9-42a9-8b63-b47992b0119a tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:39.908431 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-64b08fd3-95c9-42a9-8b63-b47992b0119a tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] [instance: d50976fb-756b-4b12-92f2-cedf87df492d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:39.914435 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-64b08fd3-95c9-42a9-8b63-b47992b0119a tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:39.914945 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-64b08fd3-95c9-42a9-8b63-b47992b0119a tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:39.915369 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-64b08fd3-95c9-42a9-8b63-b47992b0119a tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:39.916063 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-64b08fd3-95c9-42a9-8b63-b47992b0119a tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:39.916519 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-64b08fd3-95c9-42a9-8b63-b47992b0119a tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:39.916948 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-64b08fd3-95c9-42a9-8b63-b47992b0119a tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:40.054523 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-64b08fd3-95c9-42a9-8b63-b47992b0119a tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:40.063269 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-64b08fd3-95c9-42a9-8b63-b47992b0119a tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:40.064968 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-64b08fd3-95c9-42a9-8b63-b47992b0119a tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:40.070362 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-64b08fd3-95c9-42a9-8b63-b47992b0119a tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] 10.222.0.52 "GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d" status: 200 len: 1446 microversion: 2.75 time: 0.166018 Oct 19 03:14:40.070967 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 362/710] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:39 2022] GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d => generated 1446 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:14:40.075969 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c83332f6-895e-4f68-b0c0-0fc99853ad68 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:40.076581 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c83332f6-895e-4f68-b0c0-0fc99853ad68 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:40.082957 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c83332f6-895e-4f68-b0c0-0fc99853ad68 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:40.083691 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c83332f6-895e-4f68-b0c0-0fc99853ad68 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:40.084122 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c83332f6-895e-4f68-b0c0-0fc99853ad68 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:40.084820 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c83332f6-895e-4f68-b0c0-0fc99853ad68 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:40.085464 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c83332f6-895e-4f68-b0c0-0fc99853ad68 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:40.085896 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c83332f6-895e-4f68-b0c0-0fc99853ad68 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:40.198026 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c83332f6-895e-4f68-b0c0-0fc99853ad68 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:40.207599 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c83332f6-895e-4f68-b0c0-0fc99853ad68 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:40.209451 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c83332f6-895e-4f68-b0c0-0fc99853ad68 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:40.214429 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c83332f6-895e-4f68-b0c0-0fc99853ad68 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1539 microversion: 2.91 time: 0.142503 Oct 19 03:14:40.225403 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 363/711] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:40 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1539 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:14:40.261039 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-59ac1032-c6fa-424c-be05-219c2a2e5fa6 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Flavor limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:14:40.262055 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-59ac1032-c6fa-424c-be05-219c2a2e5fa6 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Image limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:14:40.262345 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-59ac1032-c6fa-424c-be05-219c2a2e5fa6 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Flavor pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:14:40.262759 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-59ac1032-c6fa-424c-be05-219c2a2e5fa6 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Image pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:14:40.263173 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-59ac1032-c6fa-424c-be05-219c2a2e5fa6 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:14:40.274049 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-59ac1032-c6fa-424c-be05-219c2a2e5fa6 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:40.274545 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-59ac1032-c6fa-424c-be05-219c2a2e5fa6 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:40.278602 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-59ac1032-c6fa-424c-be05-219c2a2e5fa6 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:40.278602 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-59ac1032-c6fa-424c-be05-219c2a2e5fa6 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:40.278602 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-59ac1032-c6fa-424c-be05-219c2a2e5fa6 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:40.278892 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-59ac1032-c6fa-424c-be05-219c2a2e5fa6 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:40.295313 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-59ac1032-c6fa-424c-be05-219c2a2e5fa6 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Getting quotas for project df99b134b20743eb9b62788706f2705a. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:14:40.301089 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-59ac1032-c6fa-424c-be05-219c2a2e5fa6 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Getting quotas for user 2cc37ae4bed94a7e85ed70dd5942c2bd and project df99b134b20743eb9b62788706f2705a. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:14:40.316980 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-59ac1032-c6fa-424c-be05-219c2a2e5fa6 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Going to run 1 instances... {{(pid=121134) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:14:40.319926 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-59ac1032-c6fa-424c-be05-219c2a2e5fa6 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] [instance: 6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=121134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:14:40.348142 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-10aa5099-6a24-4e08-8943-3c9c38967f82 tempest-ServersOnMultiNodesTest-74681315 tempest-ServersOnMultiNodesTest-74681315-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:40.348790 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-10aa5099-6a24-4e08-8943-3c9c38967f82 tempest-ServersOnMultiNodesTest-74681315 tempest-ServersOnMultiNodesTest-74681315-project-admin] [instance: 2d709051-db69-4ea9-96dc-ffe05e9c9b3a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:40.355074 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-10aa5099-6a24-4e08-8943-3c9c38967f82 tempest-ServersOnMultiNodesTest-74681315 tempest-ServersOnMultiNodesTest-74681315-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:40.355559 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-10aa5099-6a24-4e08-8943-3c9c38967f82 tempest-ServersOnMultiNodesTest-74681315 tempest-ServersOnMultiNodesTest-74681315-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:40.355923 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-10aa5099-6a24-4e08-8943-3c9c38967f82 tempest-ServersOnMultiNodesTest-74681315 tempest-ServersOnMultiNodesTest-74681315-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:40.358863 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-10aa5099-6a24-4e08-8943-3c9c38967f82 tempest-ServersOnMultiNodesTest-74681315 tempest-ServersOnMultiNodesTest-74681315-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:40.358863 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-10aa5099-6a24-4e08-8943-3c9c38967f82 tempest-ServersOnMultiNodesTest-74681315 tempest-ServersOnMultiNodesTest-74681315-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:40.358863 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-10aa5099-6a24-4e08-8943-3c9c38967f82 tempest-ServersOnMultiNodesTest-74681315 tempest-ServersOnMultiNodesTest-74681315-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:40.447332 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-59ac1032-c6fa-424c-be05-219c2a2e5fa6 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.618286 Oct 19 03:14:40.447914 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 349/712] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:14:38 2022] POST /compute/v2.1/servers => generated 401 bytes in 1620 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 19 03:14:40.453647 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ea99dac5-a5fe-4092-80fa-6dabefedc8cf tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:40.454947 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ea99dac5-a5fe-4092-80fa-6dabefedc8cf tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: d67da55c-724e-4305-9960-99d15ecfb23a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:40.462878 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ea99dac5-a5fe-4092-80fa-6dabefedc8cf tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:40.463613 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ea99dac5-a5fe-4092-80fa-6dabefedc8cf tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:40.464206 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ea99dac5-a5fe-4092-80fa-6dabefedc8cf tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:40.469603 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ea99dac5-a5fe-4092-80fa-6dabefedc8cf tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:40.469603 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ea99dac5-a5fe-4092-80fa-6dabefedc8cf tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:40.469603 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ea99dac5-a5fe-4092-80fa-6dabefedc8cf tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:40.846240 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ea99dac5-a5fe-4092-80fa-6dabefedc8cf tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:40.857132 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ea99dac5-a5fe-4092-80fa-6dabefedc8cf tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:40.858925 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ea99dac5-a5fe-4092-80fa-6dabefedc8cf tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:40.860367 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ea99dac5-a5fe-4092-80fa-6dabefedc8cf tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/d67da55c-724e-4305-9960-99d15ecfb23a" status: 200 len: 1361 microversion: 2.25 time: 0.411184 Oct 19 03:14:40.860926 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 350/713] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:40 2022] GET /compute/v2.1/servers/d67da55c-724e-4305-9960-99d15ecfb23a => generated 1361 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:14:40.865980 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e85c4fc9-c615-4a99-b883-ce57886e046c tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:40.866876 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e85c4fc9-c615-4a99-b883-ce57886e046c tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] [instance: f603dfa8-a2e6-4018-aaeb-639bf5eb24c6] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:40.900820 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e85c4fc9-c615-4a99-b883-ce57886e046c tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:40.900820 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e85c4fc9-c615-4a99-b883-ce57886e046c tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:40.901190 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e85c4fc9-c615-4a99-b883-ce57886e046c tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:40.901667 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e85c4fc9-c615-4a99-b883-ce57886e046c tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:40.902232 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e85c4fc9-c615-4a99-b883-ce57886e046c tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:40.902582 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e85c4fc9-c615-4a99-b883-ce57886e046c tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:41.036517 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e85c4fc9-c615-4a99-b883-ce57886e046c tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2339bd95b0489ab4ae457b3cd072d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446866ac21894411965aedd84ceeb8bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:41.044912 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e85c4fc9-c615-4a99-b883-ce57886e046c tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] 10.222.0.52 "GET /compute/v2.1/servers/f603dfa8-a2e6-4018-aaeb-639bf5eb24c6" status: 200 len: 1280 microversion: 2.1 time: 0.182595 Oct 19 03:14:41.058143 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 351/714] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:40 2022] GET /compute/v2.1/servers/f603dfa8-a2e6-4018-aaeb-639bf5eb24c6 => generated 1280 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:14:41.067688 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-83968fd1-75b8-437f-b9c9-9bc9b5ac9bcd tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:41.068325 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-83968fd1-75b8-437f-b9c9-9bc9b5ac9bcd tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] [instance: 6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:41.072110 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-10aa5099-6a24-4e08-8943-3c9c38967f82 tempest-ServersOnMultiNodesTest-74681315 tempest-ServersOnMultiNodesTest-74681315-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/2d709051-db69-4ea9-96dc-ffe05e9c9b3a" status: 200 len: 1617 microversion: 2.1 time: 0.855465 Oct 19 03:14:41.072725 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 364/715] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:40 2022] GET /compute/v2.1/servers/2d709051-db69-4ea9-96dc-ffe05e9c9b3a => generated 1617 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:14:41.077663 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9ca12545-a98b-4e95-8715-bbe5485ea3d7 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:41.084175 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9ca12545-a98b-4e95-8715-bbe5485ea3d7 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:41.095772 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9ca12545-a98b-4e95-8715-bbe5485ea3d7 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:41.096286 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9ca12545-a98b-4e95-8715-bbe5485ea3d7 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:41.096728 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9ca12545-a98b-4e95-8715-bbe5485ea3d7 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:41.097593 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9ca12545-a98b-4e95-8715-bbe5485ea3d7 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:41.098062 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9ca12545-a98b-4e95-8715-bbe5485ea3d7 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:41.098541 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9ca12545-a98b-4e95-8715-bbe5485ea3d7 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:41.182536 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-83968fd1-75b8-437f-b9c9-9bc9b5ac9bcd tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cc37ae4bed94a7e85ed70dd5942c2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df99b134b20743eb9b62788706f2705a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:41.193113 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-83968fd1-75b8-437f-b9c9-9bc9b5ac9bcd tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] 10.222.0.52 "GET /compute/v2.1/servers/6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1" status: 200 len: 1263 microversion: 2.1 time: 0.133200 Oct 19 03:14:41.193801 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 352/716] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:41 2022] GET /compute/v2.1/servers/6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1 => generated 1263 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:14:41.207949 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-22984e03-b46d-4c73-989c-30016eed11c5 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1903411040", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "networks": [{"uuid": "2bf94f1c-ad91-41d1-a997-a3dcf7e5a17f"}], "security_groups": [{"name": "tempest-securitygroup--130773070"}], "key_name": "tempest-keypair-921583109", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:14:41.379478 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-9ca12545-a98b-4e95-8715-bbe5485ea3d7 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:41.384693 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-22984e03-b46d-4c73-989c-30016eed11c5 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] validate_networks() for [('2bf94f1c-ad91-41d1-a997-a3dcf7e5a17f', None, None, None, None, None)] {{(pid=121134) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:14:41.388957 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9ca12545-a98b-4e95-8715-bbe5485ea3d7 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667" status: 200 len: 1476 microversion: 2.1 time: 0.314911 Oct 19 03:14:41.401171 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 365/717] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:41 2022] GET /compute/v2.1/servers/ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667 => generated 1476 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:14:41.401171 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-79b5ac03-d8cb-4370-9961-237f754ff929 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:41.401171 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-79b5ac03-d8cb-4370-9961-237f754ff929 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] [instance: d50976fb-756b-4b12-92f2-cedf87df492d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:41.406753 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-79b5ac03-d8cb-4370-9961-237f754ff929 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:41.407255 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-79b5ac03-d8cb-4370-9961-237f754ff929 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:41.407700 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-79b5ac03-d8cb-4370-9961-237f754ff929 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:41.408410 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-79b5ac03-d8cb-4370-9961-237f754ff929 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:41.408873 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-79b5ac03-d8cb-4370-9961-237f754ff929 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:41.409305 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-79b5ac03-d8cb-4370-9961-237f754ff929 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:41.522052 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-79b5ac03-d8cb-4370-9961-237f754ff929 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:41.531177 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-79b5ac03-d8cb-4370-9961-237f754ff929 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:41.532649 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-79b5ac03-d8cb-4370-9961-237f754ff929 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:41.537857 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-79b5ac03-d8cb-4370-9961-237f754ff929 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] 10.222.0.52 "GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d" status: 200 len: 1446 microversion: 2.75 time: 0.143062 Oct 19 03:14:41.542792 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 366/718] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:41 2022] GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d => generated 1446 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:14:41.542953 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5eec0fe4-c981-49d0-a9c5-860409b7c627 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Action: 'create', calling method: .version_select at 0x7fc13126cb80>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-616720025", "policies": ["affinity"]}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:14:41.564769 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-5eec0fe4-c981-49d0-a9c5-860409b7c627 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Getting quotas for project 5d909fe7763841d5b452738112b656d3. Resources: {'server_groups'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:14:41.569574 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-5eec0fe4-c981-49d0-a9c5-860409b7c627 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Getting quotas for user 3e4d3ddb3a324d9da51c13701e318955 and project 5d909fe7763841d5b452738112b656d3. Resources: {'server_groups'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:14:41.710454 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-5eec0fe4-c981-49d0-a9c5-860409b7c627 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Getting quotas for project 5d909fe7763841d5b452738112b656d3. Resources: {'server_groups'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:14:41.715758 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-5eec0fe4-c981-49d0-a9c5-860409b7c627 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Getting quotas for user 3e4d3ddb3a324d9da51c13701e318955 and project 5d909fe7763841d5b452738112b656d3. Resources: {'server_groups'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:14:41.728321 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5eec0fe4-c981-49d0-a9c5-860409b7c627 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "POST /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.188859 Oct 19 03:14:41.741145 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 367/719] 10.222.0.52 () {60 vars in 1174 bytes} [Wed Oct 19 03:14:41 2022] POST /compute/v2.1/os-server-groups => generated 187 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:14:41.741145 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-16f94edf-508e-4721-be08-502fa706a435 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:41.741145 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-16f94edf-508e-4721-be08-502fa706a435 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:41.741145 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-16f94edf-508e-4721-be08-502fa706a435 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:41.741557 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-16f94edf-508e-4721-be08-502fa706a435 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:41.741557 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-16f94edf-508e-4721-be08-502fa706a435 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:41.741734 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-16f94edf-508e-4721-be08-502fa706a435 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:41.742163 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-16f94edf-508e-4721-be08-502fa706a435 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:41.742624 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-16f94edf-508e-4721-be08-502fa706a435 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:41.826942 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-16f94edf-508e-4721-be08-502fa706a435 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:41.837793 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-16f94edf-508e-4721-be08-502fa706a435 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:41.838019 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-16f94edf-508e-4721-be08-502fa706a435 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:41.844720 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-16f94edf-508e-4721-be08-502fa706a435 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1539 microversion: 2.91 time: 0.114677 Oct 19 03:14:41.845310 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 368/720] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:41 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1539 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:14:41.849803 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-bdd7df6c-db35-429a-93f3-d46b502b4dff tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-17323938", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "6be7c922-3b62-4fd1-9592-afaa18651367"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:14:41.911873 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.network.neutron [None req-bdd7df6c-db35-429a-93f3-d46b502b4dff tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] validate_networks() for None {{(pid=121135) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:14:42.134103 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-22984e03-b46d-4c73-989c-30016eed11c5 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Flavor limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:14:42.134604 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-22984e03-b46d-4c73-989c-30016eed11c5 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Image limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:14:42.136070 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-22984e03-b46d-4c73-989c-30016eed11c5 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Flavor pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:14:42.137157 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-22984e03-b46d-4c73-989c-30016eed11c5 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Image pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:14:42.137692 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-22984e03-b46d-4c73-989c-30016eed11c5 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:14:42.146886 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-22984e03-b46d-4c73-989c-30016eed11c5 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:42.147827 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-22984e03-b46d-4c73-989c-30016eed11c5 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:42.148480 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-22984e03-b46d-4c73-989c-30016eed11c5 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:42.149509 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-22984e03-b46d-4c73-989c-30016eed11c5 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:42.150398 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-22984e03-b46d-4c73-989c-30016eed11c5 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:42.151026 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-22984e03-b46d-4c73-989c-30016eed11c5 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:42.174198 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-22984e03-b46d-4c73-989c-30016eed11c5 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Getting quotas for project 48c12a432bbd43bd8f70ba6e941c28a2. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:14:42.180113 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-22984e03-b46d-4c73-989c-30016eed11c5 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Getting quotas for user 28072a54d5934ea28e7d3205841c0852 and project 48c12a432bbd43bd8f70ba6e941c28a2. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:14:42.209440 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-22984e03-b46d-4c73-989c-30016eed11c5 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Going to run 1 instances... {{(pid=121134) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:14:42.215986 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-22984e03-b46d-4c73-989c-30016eed11c5 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] [instance: 540a7025-b935-49fb-bc51-edf44ac1e0c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:14:42.267819 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-bdd7df6c-db35-429a-93f3-d46b502b4dff tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Flavor limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:14:42.268348 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-bdd7df6c-db35-429a-93f3-d46b502b4dff tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Image limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:14:42.268713 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-bdd7df6c-db35-429a-93f3-d46b502b4dff tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Flavor pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:14:42.269143 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-bdd7df6c-db35-429a-93f3-d46b502b4dff tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Image pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:14:42.269572 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-bdd7df6c-db35-429a-93f3-d46b502b4dff tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:14:42.296593 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bdd7df6c-db35-429a-93f3-d46b502b4dff tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:42.296593 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bdd7df6c-db35-429a-93f3-d46b502b4dff tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:42.296593 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bdd7df6c-db35-429a-93f3-d46b502b4dff tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:42.296593 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bdd7df6c-db35-429a-93f3-d46b502b4dff tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:42.296957 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bdd7df6c-db35-429a-93f3-d46b502b4dff tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:42.297297 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bdd7df6c-db35-429a-93f3-d46b502b4dff tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:42.314759 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-bdd7df6c-db35-429a-93f3-d46b502b4dff tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Getting quotas for project 5d909fe7763841d5b452738112b656d3. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:14:42.319498 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-bdd7df6c-db35-429a-93f3-d46b502b4dff tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Getting quotas for user 3e4d3ddb3a324d9da51c13701e318955 and project 5d909fe7763841d5b452738112b656d3. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:14:42.331357 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-bdd7df6c-db35-429a-93f3-d46b502b4dff tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Going to run 2 instances... {{(pid=121135) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:14:42.333743 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-bdd7df6c-db35-429a-93f3-d46b502b4dff tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 8cb9ad03-e7f9-4d7f-8711-1e2f478b0d17] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121135) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:14:42.390004 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-22984e03-b46d-4c73-989c-30016eed11c5 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.195144 Oct 19 03:14:42.394535 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 353/721] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:14:41 2022] POST /compute/v2.1/servers => generated 405 bytes in 1200 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 03:14:42.400644 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5e6969f7-d681-447a-9b26-4af416cfe79a tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:42.401839 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5e6969f7-d681-447a-9b26-4af416cfe79a tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: d67da55c-724e-4305-9960-99d15ecfb23a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:42.410191 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5e6969f7-d681-447a-9b26-4af416cfe79a tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:42.410668 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5e6969f7-d681-447a-9b26-4af416cfe79a tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:42.411111 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5e6969f7-d681-447a-9b26-4af416cfe79a tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:42.411874 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5e6969f7-d681-447a-9b26-4af416cfe79a tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:42.412330 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5e6969f7-d681-447a-9b26-4af416cfe79a tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:42.412758 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5e6969f7-d681-447a-9b26-4af416cfe79a tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:42.476670 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-bdd7df6c-db35-429a-93f3-d46b502b4dff tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=121135) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 19 03:14:42.496628 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=8,nova_api:UPDATE=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:14:42.504464 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-bdd7df6c-db35-429a-93f3-d46b502b4dff tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Getting quotas for project 5d909fe7763841d5b452738112b656d3. Resources: {'server_group_members'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:14:42.526196 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-bdd7df6c-db35-429a-93f3-d46b502b4dff tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Getting quotas for user 3e4d3ddb3a324d9da51c13701e318955 and project 5d909fe7763841d5b452738112b656d3. Resources: {'server_group_members'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:14:42.911512 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5e6969f7-d681-447a-9b26-4af416cfe79a tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:42.918354 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-bdd7df6c-db35-429a-93f3-d46b502b4dff tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Getting quotas for project 5d909fe7763841d5b452738112b656d3. Resources: {'server_group_members'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:14:42.923449 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5e6969f7-d681-447a-9b26-4af416cfe79a tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:42.924529 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-bdd7df6c-db35-429a-93f3-d46b502b4dff tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Getting quotas for user 3e4d3ddb3a324d9da51c13701e318955 and project 5d909fe7763841d5b452738112b656d3. Resources: {'server_group_members'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:14:42.925397 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5e6969f7-d681-447a-9b26-4af416cfe79a tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:42.926879 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5e6969f7-d681-447a-9b26-4af416cfe79a tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/d67da55c-724e-4305-9960-99d15ecfb23a" status: 200 len: 1361 microversion: 2.25 time: 0.530889 Oct 19 03:14:42.928573 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 354/722] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:42 2022] GET /compute/v2.1/servers/d67da55c-724e-4305-9960-99d15ecfb23a => generated 1361 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:14:42.936463 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-bbfd5d83-7742-491c-81f8-e8fa93577cac tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:42.937318 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-bbfd5d83-7742-491c-81f8-e8fa93577cac tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] [instance: f603dfa8-a2e6-4018-aaeb-639bf5eb24c6] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:42.946170 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bbfd5d83-7742-491c-81f8-e8fa93577cac tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:42.946915 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bbfd5d83-7742-491c-81f8-e8fa93577cac tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:42.947626 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bbfd5d83-7742-491c-81f8-e8fa93577cac tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:42.948178 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-bdd7df6c-db35-429a-93f3-d46b502b4dff tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 393853e1-5f67-4c6b-972d-9f76de928599] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=8cb9ad03-e7f9-4d7f-8711-1e2f478b0d17,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121135) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:14:42.948800 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bbfd5d83-7742-491c-81f8-e8fa93577cac tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:42.950943 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bbfd5d83-7742-491c-81f8-e8fa93577cac tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:42.951395 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bbfd5d83-7742-491c-81f8-e8fa93577cac tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:43.104479 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-bdd7df6c-db35-429a-93f3-d46b502b4dff tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Getting quotas for project 5d909fe7763841d5b452738112b656d3. Resources: {'server_group_members'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:14:43.111626 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-bdd7df6c-db35-429a-93f3-d46b502b4dff tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Getting quotas for user 3e4d3ddb3a324d9da51c13701e318955 and project 5d909fe7763841d5b452738112b656d3. Resources: {'server_group_members'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:14:43.206796 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-bbfd5d83-7742-491c-81f8-e8fa93577cac tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2339bd95b0489ab4ae457b3cd072d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446866ac21894411965aedd84ceeb8bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:43.215275 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-bbfd5d83-7742-491c-81f8-e8fa93577cac tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] 10.222.0.52 "GET /compute/v2.1/servers/f603dfa8-a2e6-4018-aaeb-639bf5eb24c6" status: 200 len: 1322 microversion: 2.1 time: 0.285116 Oct 19 03:14:43.216167 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 355/723] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:42 2022] GET /compute/v2.1/servers/f603dfa8-a2e6-4018-aaeb-639bf5eb24c6 => generated 1322 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:14:43.221280 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1af15bf7-5a5f-4df2-971b-77c16bc6b4cb tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:43.222031 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1af15bf7-5a5f-4df2-971b-77c16bc6b4cb tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] [instance: 6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:43.228799 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1af15bf7-5a5f-4df2-971b-77c16bc6b4cb tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:43.229274 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1af15bf7-5a5f-4df2-971b-77c16bc6b4cb tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:43.229749 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1af15bf7-5a5f-4df2-971b-77c16bc6b4cb tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:43.231027 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1af15bf7-5a5f-4df2-971b-77c16bc6b4cb tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:43.231705 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1af15bf7-5a5f-4df2-971b-77c16bc6b4cb tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:43.232380 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1af15bf7-5a5f-4df2-971b-77c16bc6b4cb tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:43.266151 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-bdd7df6c-db35-429a-93f3-d46b502b4dff tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Getting quotas for project 5d909fe7763841d5b452738112b656d3. Resources: {'server_group_members'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:14:43.272801 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-bdd7df6c-db35-429a-93f3-d46b502b4dff tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Getting quotas for user 3e4d3ddb3a324d9da51c13701e318955 and project 5d909fe7763841d5b452738112b656d3. Resources: {'server_group_members'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:14:43.328677 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-1af15bf7-5a5f-4df2-971b-77c16bc6b4cb tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cc37ae4bed94a7e85ed70dd5942c2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df99b134b20743eb9b62788706f2705a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:43.343285 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1af15bf7-5a5f-4df2-971b-77c16bc6b4cb tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] 10.222.0.52 "GET /compute/v2.1/servers/6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1" status: 200 len: 1315 microversion: 2.1 time: 0.125288 Oct 19 03:14:43.346206 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 356/724] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:43 2022] GET /compute/v2.1/servers/6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1 => generated 1315 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:14:43.347610 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-bdd7df6c-db35-429a-93f3-d46b502b4dff tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.501184 Oct 19 03:14:43.348225 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 369/725] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:14:41 2022] POST /compute/v2.1/servers => generated 32 bytes in 1502 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 19 03:14:43.361387 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0c25e738-919a-4044-b5d6-c40dbb85078b tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:43.361717 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4dc5343c-cce0-4297-9a5e-f9ab8999fad2 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:43.365489 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0c25e738-919a-4044-b5d6-c40dbb85078b tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:43.372764 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4dc5343c-cce0-4297-9a5e-f9ab8999fad2 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] [instance: 540a7025-b935-49fb-bc51-edf44ac1e0c4] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:43.379064 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0c25e738-919a-4044-b5d6-c40dbb85078b tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:43.379568 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0c25e738-919a-4044-b5d6-c40dbb85078b tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:43.380000 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0c25e738-919a-4044-b5d6-c40dbb85078b tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:43.380927 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0c25e738-919a-4044-b5d6-c40dbb85078b tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:43.381573 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0c25e738-919a-4044-b5d6-c40dbb85078b tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:43.382160 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0c25e738-919a-4044-b5d6-c40dbb85078b tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:43.543650 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-4dc5343c-cce0-4297-9a5e-f9ab8999fad2 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28072a54d5934ea28e7d3205841c0852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c12a432bbd43bd8f70ba6e941c28a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:43.567056 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4dc5343c-cce0-4297-9a5e-f9ab8999fad2 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] 10.222.0.52 "GET /compute/v2.1/servers/540a7025-b935-49fb-bc51-edf44ac1e0c4" status: 200 len: 1241 microversion: 2.1 time: 0.218175 Oct 19 03:14:43.569818 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 357/726] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:43 2022] GET /compute/v2.1/servers/540a7025-b935-49fb-bc51-edf44ac1e0c4 => generated 1241 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:14:43.601991 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-07cc24f8-0fc4-4f80-9c43-d98a8b5156f2 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:43.604607 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-07cc24f8-0fc4-4f80-9c43-d98a8b5156f2 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] [instance: d50976fb-756b-4b12-92f2-cedf87df492d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:43.630624 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-07cc24f8-0fc4-4f80-9c43-d98a8b5156f2 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:43.634190 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-07cc24f8-0fc4-4f80-9c43-d98a8b5156f2 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:43.637000 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-07cc24f8-0fc4-4f80-9c43-d98a8b5156f2 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:43.637822 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-07cc24f8-0fc4-4f80-9c43-d98a8b5156f2 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:43.638301 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-07cc24f8-0fc4-4f80-9c43-d98a8b5156f2 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:43.642356 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-07cc24f8-0fc4-4f80-9c43-d98a8b5156f2 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:43.702758 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-0c25e738-919a-4044-b5d6-c40dbb85078b tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:43.702758 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0c25e738-919a-4044-b5d6-c40dbb85078b tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667" status: 200 len: 1476 microversion: 2.1 time: 0.348815 Oct 19 03:14:43.702758 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 370/727] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:43 2022] GET /compute/v2.1/servers/ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667 => generated 1476 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:14:43.705029 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-79ff7145-4553-4922-961c-a7a30dedee23 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:43.705797 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-79ff7145-4553-4922-961c-a7a30dedee23 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:43.731363 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-79ff7145-4553-4922-961c-a7a30dedee23 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:43.732052 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-79ff7145-4553-4922-961c-a7a30dedee23 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:43.732641 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-79ff7145-4553-4922-961c-a7a30dedee23 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:43.734090 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-79ff7145-4553-4922-961c-a7a30dedee23 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:43.735352 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-79ff7145-4553-4922-961c-a7a30dedee23 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:43.747171 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-79ff7145-4553-4922-961c-a7a30dedee23 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:43.875058 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-07cc24f8-0fc4-4f80-9c43-d98a8b5156f2 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:43.875058 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-07cc24f8-0fc4-4f80-9c43-d98a8b5156f2 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:43.875871 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-07cc24f8-0fc4-4f80-9c43-d98a8b5156f2 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:43.879212 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-79ff7145-4553-4922-961c-a7a30dedee23 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:43.889708 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-07cc24f8-0fc4-4f80-9c43-d98a8b5156f2 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] 10.222.0.52 "GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d" status: 200 len: 1446 microversion: 2.75 time: 0.318192 Oct 19 03:14:43.890305 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 358/728] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:43 2022] GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d => generated 1446 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:14:43.891338 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-79ff7145-4553-4922-961c-a7a30dedee23 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:43.892800 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-79ff7145-4553-4922-961c-a7a30dedee23 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:43.897721 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2794e698-74b6-4487-a2b5-4e6669b7be96 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:43.907361 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-2794e698-74b6-4487-a2b5-4e6669b7be96 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:43.909679 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-79ff7145-4553-4922-961c-a7a30dedee23 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1560 microversion: 2.91 time: 0.208716 Oct 19 03:14:43.910590 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 371/729] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:43 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1560 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:14:43.911101 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2794e698-74b6-4487-a2b5-4e6669b7be96 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Searching by: {'deleted': False, 'project_id': '5d909fe7763841d5b452738112b656d3'} {{(pid=121134) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 03:14:43.915379 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-805f2ed9-77ce-4746-aec7-7795a9666c47 req-bd3f6832-d40e-44e5-92e7-a1d886fa2e44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d67da55c-724e-4305-9960-99d15ecfb23a", "name": "network-vif-plugged", "status": "completed", "tag": "0816439e-71ce-4a08-8fd4-aa143aa0c267"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:14:43.932699 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2794e698-74b6-4487-a2b5-4e6669b7be96 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:43.948670 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2794e698-74b6-4487-a2b5-4e6669b7be96 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:43.948670 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2794e698-74b6-4487-a2b5-4e6669b7be96 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:43.948670 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2794e698-74b6-4487-a2b5-4e6669b7be96 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:43.948670 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2794e698-74b6-4487-a2b5-4e6669b7be96 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:43.949564 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-805f2ed9-77ce-4746-aec7-7795a9666c47 req-bd3f6832-d40e-44e5-92e7-a1d886fa2e44 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:43.949671 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2794e698-74b6-4487-a2b5-4e6669b7be96 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:43.949848 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-805f2ed9-77ce-4746-aec7-7795a9666c47 req-bd3f6832-d40e-44e5-92e7-a1d886fa2e44 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:43.949848 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-805f2ed9-77ce-4746-aec7-7795a9666c47 req-bd3f6832-d40e-44e5-92e7-a1d886fa2e44 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:43.960329 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-805f2ed9-77ce-4746-aec7-7795a9666c47 req-bd3f6832-d40e-44e5-92e7-a1d886fa2e44 service nova] Creating event network-vif-plugged:0816439e-71ce-4a08-8fd4-aa143aa0c267 for instance d67da55c-724e-4305-9960-99d15ecfb23a on n-h1-861333-8 Oct 19 03:14:43.975574 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-805f2ed9-77ce-4746-aec7-7795a9666c47 req-bd3f6832-d40e-44e5-92e7-a1d886fa2e44 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063725 Oct 19 03:14:43.978024 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 372/730] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:14:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:14:43.991422 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-6f9bd4bf-6b12-4009-9c6c-70596f08d755 req-dc83ad68-f457-4c1f-a07f-98dcff49eafa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f603dfa8-a2e6-4018-aaeb-639bf5eb24c6", "tag": "3e753133-013e-43f0-a278-9311e3115aa5"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:14:44.002757 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-6f9bd4bf-6b12-4009-9c6c-70596f08d755 req-dc83ad68-f457-4c1f-a07f-98dcff49eafa service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:44.003309 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-6f9bd4bf-6b12-4009-9c6c-70596f08d755 req-dc83ad68-f457-4c1f-a07f-98dcff49eafa service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:44.003749 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-6f9bd4bf-6b12-4009-9c6c-70596f08d755 req-dc83ad68-f457-4c1f-a07f-98dcff49eafa service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:44.015396 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-6f9bd4bf-6b12-4009-9c6c-70596f08d755 req-dc83ad68-f457-4c1f-a07f-98dcff49eafa service nova] Creating event network-changed:3e753133-013e-43f0-a278-9311e3115aa5 for instance f603dfa8-a2e6-4018-aaeb-639bf5eb24c6 on n-h2-861333-8 Oct 19 03:14:44.020934 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-6f9bd4bf-6b12-4009-9c6c-70596f08d755 req-dc83ad68-f457-4c1f-a07f-98dcff49eafa service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038685 Oct 19 03:14:44.021619 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 373/731] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:14:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:14:44.032007 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a9384159-a265-41a0-8114-9ce6fb41da83 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:44.034720 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a9384159-a265-41a0-8114-9ce6fb41da83 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: d67da55c-724e-4305-9960-99d15ecfb23a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:44.053312 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a9384159-a265-41a0-8114-9ce6fb41da83 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:44.053859 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a9384159-a265-41a0-8114-9ce6fb41da83 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:44.054807 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a9384159-a265-41a0-8114-9ce6fb41da83 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:44.055596 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a9384159-a265-41a0-8114-9ce6fb41da83 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:44.056060 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a9384159-a265-41a0-8114-9ce6fb41da83 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:44.056489 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a9384159-a265-41a0-8114-9ce6fb41da83 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:44.067108 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.multi_cell_list [None req-2794e698-74b6-4487-a2b5-4e6669b7be96 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=121134) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 03:14:44.315079 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a9384159-a265-41a0-8114-9ce6fb41da83 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:44.323462 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a9384159-a265-41a0-8114-9ce6fb41da83 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:44.325307 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a9384159-a265-41a0-8114-9ce6fb41da83 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:44.326764 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a9384159-a265-41a0-8114-9ce6fb41da83 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/d67da55c-724e-4305-9960-99d15ecfb23a" status: 200 len: 1361 microversion: 2.25 time: 0.304250 Oct 19 03:14:44.327996 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 374/732] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:44 2022] GET /compute/v2.1/servers/d67da55c-724e-4305-9960-99d15ecfb23a => generated 1361 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:14:44.332546 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ea3d7cc5-381f-43d5-a79a-20009741296f tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:44.333425 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ea3d7cc5-381f-43d5-a79a-20009741296f tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] [instance: f603dfa8-a2e6-4018-aaeb-639bf5eb24c6] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:44.340087 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ea3d7cc5-381f-43d5-a79a-20009741296f tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:44.343536 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ea3d7cc5-381f-43d5-a79a-20009741296f tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:44.343536 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ea3d7cc5-381f-43d5-a79a-20009741296f tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:44.343536 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ea3d7cc5-381f-43d5-a79a-20009741296f tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:44.343536 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ea3d7cc5-381f-43d5-a79a-20009741296f tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:44.343863 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ea3d7cc5-381f-43d5-a79a-20009741296f tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:44.488601 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2794e698-74b6-4487-a2b5-4e6669b7be96 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers" status: 200 len: 999 microversion: 2.1 time: 0.594306 Oct 19 03:14:44.489629 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 359/733] 10.222.0.52 () {58 vars in 1125 bytes} [Wed Oct 19 03:14:43 2022] GET /compute/v2.1/servers => generated 999 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:14:44.497244 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0a05c1f6-a4af-4824-89ee-6a4466a06f33 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:44.498268 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0a05c1f6-a4af-4824-89ee-6a4466a06f33 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] [instance: 6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:44.504872 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0a05c1f6-a4af-4824-89ee-6a4466a06f33 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:44.505583 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0a05c1f6-a4af-4824-89ee-6a4466a06f33 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:44.506237 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0a05c1f6-a4af-4824-89ee-6a4466a06f33 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:44.507312 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0a05c1f6-a4af-4824-89ee-6a4466a06f33 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:44.507928 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0a05c1f6-a4af-4824-89ee-6a4466a06f33 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:44.508731 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0a05c1f6-a4af-4824-89ee-6a4466a06f33 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:44.545528 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ea3d7cc5-381f-43d5-a79a-20009741296f tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2339bd95b0489ab4ae457b3cd072d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446866ac21894411965aedd84ceeb8bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:44.554873 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ea3d7cc5-381f-43d5-a79a-20009741296f tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] 10.222.0.52 "GET /compute/v2.1/servers/f603dfa8-a2e6-4018-aaeb-639bf5eb24c6" status: 200 len: 1322 microversion: 2.1 time: 0.225782 Oct 19 03:14:44.555908 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 375/734] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:44 2022] GET /compute/v2.1/servers/f603dfa8-a2e6-4018-aaeb-639bf5eb24c6 => generated 1322 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:14:44.560744 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-03373774-25b9-48b6-9230-4eac0b7c4da7 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:44.561499 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-03373774-25b9-48b6-9230-4eac0b7c4da7 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 393853e1-5f67-4c6b-972d-9f76de928599] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:44.636693 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0a05c1f6-a4af-4824-89ee-6a4466a06f33 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cc37ae4bed94a7e85ed70dd5942c2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df99b134b20743eb9b62788706f2705a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:44.648362 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0a05c1f6-a4af-4824-89ee-6a4466a06f33 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] 10.222.0.52 "GET /compute/v2.1/servers/6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1" status: 200 len: 1315 microversion: 2.1 time: 0.157338 Oct 19 03:14:44.648952 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 360/735] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:44 2022] GET /compute/v2.1/servers/6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:14:44.670761 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2388719c-a7e0-4526-9721-823770d31e0d tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:44.671790 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2388719c-a7e0-4526-9721-823770d31e0d tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] [instance: 540a7025-b935-49fb-bc51-edf44ac1e0c4] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:44.678358 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2388719c-a7e0-4526-9721-823770d31e0d tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:44.679113 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2388719c-a7e0-4526-9721-823770d31e0d tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:44.679725 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2388719c-a7e0-4526-9721-823770d31e0d tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:44.680670 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2388719c-a7e0-4526-9721-823770d31e0d tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:44.681284 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2388719c-a7e0-4526-9721-823770d31e0d tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:44.681904 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2388719c-a7e0-4526-9721-823770d31e0d tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:44.693146 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-03373774-25b9-48b6-9230-4eac0b7c4da7 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:44.703917 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-03373774-25b9-48b6-9230-4eac0b7c4da7 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/393853e1-5f67-4c6b-972d-9f76de928599" status: 200 len: 1217 microversion: 2.1 time: 0.146942 Oct 19 03:14:44.705292 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 376/736] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:44 2022] GET /compute/v2.1/servers/393853e1-5f67-4c6b-972d-9f76de928599 => generated 1217 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:14:44.722100 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6a1700ee-cbc0-4ae5-9a81-6984217073a3 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:44.724688 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6a1700ee-cbc0-4ae5-9a81-6984217073a3 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:44.735654 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6a1700ee-cbc0-4ae5-9a81-6984217073a3 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:44.736175 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6a1700ee-cbc0-4ae5-9a81-6984217073a3 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:44.736909 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6a1700ee-cbc0-4ae5-9a81-6984217073a3 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:44.739061 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6a1700ee-cbc0-4ae5-9a81-6984217073a3 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:44.739891 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6a1700ee-cbc0-4ae5-9a81-6984217073a3 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:44.740505 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6a1700ee-cbc0-4ae5-9a81-6984217073a3 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:44.896147 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-2388719c-a7e0-4526-9721-823770d31e0d tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28072a54d5934ea28e7d3205841c0852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c12a432bbd43bd8f70ba6e941c28a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:44.909941 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2388719c-a7e0-4526-9721-823770d31e0d tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] 10.222.0.52 "GET /compute/v2.1/servers/540a7025-b935-49fb-bc51-edf44ac1e0c4" status: 200 len: 1245 microversion: 2.1 time: 0.243456 Oct 19 03:14:44.910527 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 361/737] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:44 2022] GET /compute/v2.1/servers/540a7025-b935-49fb-bc51-edf44ac1e0c4 => generated 1245 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:14:44.939814 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-add71ae5-0ff6-4a17-aebd-6eb7307bfd04 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:44.940436 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-add71ae5-0ff6-4a17-aebd-6eb7307bfd04 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] [instance: d50976fb-756b-4b12-92f2-cedf87df492d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:44.946581 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-add71ae5-0ff6-4a17-aebd-6eb7307bfd04 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:44.947314 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-add71ae5-0ff6-4a17-aebd-6eb7307bfd04 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:44.947944 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-add71ae5-0ff6-4a17-aebd-6eb7307bfd04 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:44.948812 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-add71ae5-0ff6-4a17-aebd-6eb7307bfd04 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:44.950060 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-add71ae5-0ff6-4a17-aebd-6eb7307bfd04 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:44.950650 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-add71ae5-0ff6-4a17-aebd-6eb7307bfd04 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:45.144260 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-add71ae5-0ff6-4a17-aebd-6eb7307bfd04 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:45.154152 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-add71ae5-0ff6-4a17-aebd-6eb7307bfd04 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:45.155858 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-add71ae5-0ff6-4a17-aebd-6eb7307bfd04 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:45.161150 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-add71ae5-0ff6-4a17-aebd-6eb7307bfd04 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] 10.222.0.52 "GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d" status: 200 len: 1446 microversion: 2.75 time: 0.225148 Oct 19 03:14:45.162313 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 362/738] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:44 2022] GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d => generated 1446 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:14:45.163097 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-6a1700ee-cbc0-4ae5-9a81-6984217073a3 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:45.174972 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8f4879be-0d9d-4b6f-be36-4f5064a84711 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:45.174972 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8f4879be-0d9d-4b6f-be36-4f5064a84711 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:45.175239 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6a1700ee-cbc0-4ae5-9a81-6984217073a3 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667" status: 200 len: 1476 microversion: 2.1 time: 0.454627 Oct 19 03:14:45.177126 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8f4879be-0d9d-4b6f-be36-4f5064a84711 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:45.178030 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8f4879be-0d9d-4b6f-be36-4f5064a84711 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:45.178647 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8f4879be-0d9d-4b6f-be36-4f5064a84711 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:45.179506 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8f4879be-0d9d-4b6f-be36-4f5064a84711 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:45.180107 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8f4879be-0d9d-4b6f-be36-4f5064a84711 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:45.180691 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8f4879be-0d9d-4b6f-be36-4f5064a84711 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:45.182580 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 377/739] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:44 2022] GET /compute/v2.1/servers/ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667 => generated 1476 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:14:45.196877 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-f5e17666-75b0-48a4-bfe7-aab39e42551c req-ad839097-baea-4b85-a492-755c6ce2210e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f476cc02-1b56-4c61-93a4-c3d36c38792d", "name": "network-vif-deleted", "tag": "e7234846-076a-4f8d-9318-716ced0a591c"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:14:45.210864 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-f5e17666-75b0-48a4-bfe7-aab39e42551c req-ad839097-baea-4b85-a492-755c6ce2210e service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:45.211564 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-f5e17666-75b0-48a4-bfe7-aab39e42551c req-ad839097-baea-4b85-a492-755c6ce2210e service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:45.212139 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-f5e17666-75b0-48a4-bfe7-aab39e42551c req-ad839097-baea-4b85-a492-755c6ce2210e service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:45.236059 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-f5e17666-75b0-48a4-bfe7-aab39e42551c req-ad839097-baea-4b85-a492-755c6ce2210e service nova] Creating event network-vif-deleted:e7234846-076a-4f8d-9318-716ced0a591c for instance f476cc02-1b56-4c61-93a4-c3d36c38792d on n-h1-861333-8 Oct 19 03:14:45.241685 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-f5e17666-75b0-48a4-bfe7-aab39e42551c req-ad839097-baea-4b85-a492-755c6ce2210e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051186 Oct 19 03:14:45.242623 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 378/740] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:14:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:14:45.311539 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8f4879be-0d9d-4b6f-be36-4f5064a84711 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:45.321196 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8f4879be-0d9d-4b6f-be36-4f5064a84711 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:45.322851 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8f4879be-0d9d-4b6f-be36-4f5064a84711 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:45.329309 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8f4879be-0d9d-4b6f-be36-4f5064a84711 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1560 microversion: 2.91 time: 0.165542 Oct 19 03:14:45.334111 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 363/741] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:45 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:14:45.362195 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-bc9ae9cd-d51c-4235-b760-011b808493c1 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:45.366419 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-bc9ae9cd-d51c-4235-b760-011b808493c1 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: d67da55c-724e-4305-9960-99d15ecfb23a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:45.373968 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bc9ae9cd-d51c-4235-b760-011b808493c1 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:45.374500 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bc9ae9cd-d51c-4235-b760-011b808493c1 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:45.374971 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bc9ae9cd-d51c-4235-b760-011b808493c1 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:45.375826 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bc9ae9cd-d51c-4235-b760-011b808493c1 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:45.376316 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bc9ae9cd-d51c-4235-b760-011b808493c1 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:45.377224 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bc9ae9cd-d51c-4235-b760-011b808493c1 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:45.542436 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-bc9ae9cd-d51c-4235-b760-011b808493c1 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:45.552062 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-bc9ae9cd-d51c-4235-b760-011b808493c1 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:45.553602 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-bc9ae9cd-d51c-4235-b760-011b808493c1 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:45.554821 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-bc9ae9cd-d51c-4235-b760-011b808493c1 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/d67da55c-724e-4305-9960-99d15ecfb23a" status: 200 len: 1361 microversion: 2.25 time: 0.202310 Oct 19 03:14:45.555391 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 379/742] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:45 2022] GET /compute/v2.1/servers/d67da55c-724e-4305-9960-99d15ecfb23a => generated 1361 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:14:45.578663 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d22ea780-68d3-42ac-ad07-95e349555c67 tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:45.579820 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d22ea780-68d3-42ac-ad07-95e349555c67 tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] [instance: f603dfa8-a2e6-4018-aaeb-639bf5eb24c6] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:45.586068 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d22ea780-68d3-42ac-ad07-95e349555c67 tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:45.586545 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d22ea780-68d3-42ac-ad07-95e349555c67 tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:45.586992 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d22ea780-68d3-42ac-ad07-95e349555c67 tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:45.587735 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d22ea780-68d3-42ac-ad07-95e349555c67 tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:45.588199 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d22ea780-68d3-42ac-ad07-95e349555c67 tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:45.588630 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d22ea780-68d3-42ac-ad07-95e349555c67 tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:45.674074 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-55b85417-fd7c-48e4-8bae-8dffbc46736a tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:45.674870 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-55b85417-fd7c-48e4-8bae-8dffbc46736a tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] [instance: 6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:45.681262 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-55b85417-fd7c-48e4-8bae-8dffbc46736a tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:45.682074 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-55b85417-fd7c-48e4-8bae-8dffbc46736a tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:45.682760 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-55b85417-fd7c-48e4-8bae-8dffbc46736a tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:45.683705 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-55b85417-fd7c-48e4-8bae-8dffbc46736a tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:45.684312 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-55b85417-fd7c-48e4-8bae-8dffbc46736a tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:45.684885 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-55b85417-fd7c-48e4-8bae-8dffbc46736a tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:45.724803 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d22ea780-68d3-42ac-ad07-95e349555c67 tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2339bd95b0489ab4ae457b3cd072d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446866ac21894411965aedd84ceeb8bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:45.734196 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d22ea780-68d3-42ac-ad07-95e349555c67 tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] 10.222.0.52 "GET /compute/v2.1/servers/f603dfa8-a2e6-4018-aaeb-639bf5eb24c6" status: 200 len: 1322 microversion: 2.1 time: 0.159426 Oct 19 03:14:45.735072 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 364/743] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:45 2022] GET /compute/v2.1/servers/f603dfa8-a2e6-4018-aaeb-639bf5eb24c6 => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:14:45.739822 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-00933efe-da84-4574-af6d-00d76426232c tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:45.740683 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-00933efe-da84-4574-af6d-00d76426232c tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 393853e1-5f67-4c6b-972d-9f76de928599] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:45.766504 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-55b85417-fd7c-48e4-8bae-8dffbc46736a tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cc37ae4bed94a7e85ed70dd5942c2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df99b134b20743eb9b62788706f2705a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:45.768850 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=100 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:14:45.776390 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-55b85417-fd7c-48e4-8bae-8dffbc46736a tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] 10.222.0.52 "GET /compute/v2.1/servers/6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1" status: 200 len: 1323 microversion: 2.1 time: 0.106143 Oct 19 03:14:45.790078 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 380/744] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:45 2022] GET /compute/v2.1/servers/6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1 => generated 1323 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:14:45.806697 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-00933efe-da84-4574-af6d-00d76426232c tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:45.814714 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-00933efe-da84-4574-af6d-00d76426232c tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/393853e1-5f67-4c6b-972d-9f76de928599" status: 200 len: 1217 microversion: 2.1 time: 0.078254 Oct 19 03:14:45.815016 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 365/745] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:45 2022] GET /compute/v2.1/servers/393853e1-5f67-4c6b-972d-9f76de928599 => generated 1217 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:14:45.936420 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-28d4069d-2fad-4521-bdd8-0255550b9862 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:45.937045 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-28d4069d-2fad-4521-bdd8-0255550b9862 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] [instance: 540a7025-b935-49fb-bc51-edf44ac1e0c4] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:45.954559 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-28d4069d-2fad-4521-bdd8-0255550b9862 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:45.955096 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-28d4069d-2fad-4521-bdd8-0255550b9862 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:45.955545 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-28d4069d-2fad-4521-bdd8-0255550b9862 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:45.956266 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-28d4069d-2fad-4521-bdd8-0255550b9862 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:45.956725 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-28d4069d-2fad-4521-bdd8-0255550b9862 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:45.957154 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-28d4069d-2fad-4521-bdd8-0255550b9862 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:46.069434 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-28d4069d-2fad-4521-bdd8-0255550b9862 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28072a54d5934ea28e7d3205841c0852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c12a432bbd43bd8f70ba6e941c28a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:46.078428 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-28d4069d-2fad-4521-bdd8-0255550b9862 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] 10.222.0.52 "GET /compute/v2.1/servers/540a7025-b935-49fb-bc51-edf44ac1e0c4" status: 200 len: 1293 microversion: 2.1 time: 0.147407 Oct 19 03:14:46.079130 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 381/746] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:45 2022] GET /compute/v2.1/servers/540a7025-b935-49fb-bc51-edf44ac1e0c4 => generated 1293 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:14:46.193674 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1346c72b-f5c8-498a-b4e6-eeaedc41e3f1 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:46.194806 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1346c72b-f5c8-498a-b4e6-eeaedc41e3f1 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] [instance: d50976fb-756b-4b12-92f2-cedf87df492d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:46.197570 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7233c9f8-3404-4809-8838-dd0e9e51a74e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:46.198197 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7233c9f8-3404-4809-8838-dd0e9e51a74e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:46.203203 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1346c72b-f5c8-498a-b4e6-eeaedc41e3f1 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:46.203793 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1346c72b-f5c8-498a-b4e6-eeaedc41e3f1 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:46.204471 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1346c72b-f5c8-498a-b4e6-eeaedc41e3f1 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:46.205117 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7233c9f8-3404-4809-8838-dd0e9e51a74e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:46.205260 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1346c72b-f5c8-498a-b4e6-eeaedc41e3f1 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:46.205651 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7233c9f8-3404-4809-8838-dd0e9e51a74e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:46.205920 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1346c72b-f5c8-498a-b4e6-eeaedc41e3f1 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:46.206091 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7233c9f8-3404-4809-8838-dd0e9e51a74e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:46.206944 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1346c72b-f5c8-498a-b4e6-eeaedc41e3f1 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:46.207070 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7233c9f8-3404-4809-8838-dd0e9e51a74e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:46.207421 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7233c9f8-3404-4809-8838-dd0e9e51a74e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:46.207855 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7233c9f8-3404-4809-8838-dd0e9e51a74e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:46.313907 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-1346c72b-f5c8-498a-b4e6-eeaedc41e3f1 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:46.322483 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-1346c72b-f5c8-498a-b4e6-eeaedc41e3f1 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:46.323944 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-1346c72b-f5c8-498a-b4e6-eeaedc41e3f1 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:46.329262 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1346c72b-f5c8-498a-b4e6-eeaedc41e3f1 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] 10.222.0.52 "GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d" status: 200 len: 1446 microversion: 2.75 time: 0.139820 Oct 19 03:14:46.329889 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 366/747] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:46 2022] GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d => generated 1446 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:14:46.356667 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-91ac6cfe-5a9d-4c5c-86be-0333d61d2901 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:46.357288 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-91ac6cfe-5a9d-4c5c-86be-0333d61d2901 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:46.363240 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-91ac6cfe-5a9d-4c5c-86be-0333d61d2901 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:46.368455 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-91ac6cfe-5a9d-4c5c-86be-0333d61d2901 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:46.368455 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-91ac6cfe-5a9d-4c5c-86be-0333d61d2901 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:46.368455 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-91ac6cfe-5a9d-4c5c-86be-0333d61d2901 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:46.368455 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-91ac6cfe-5a9d-4c5c-86be-0333d61d2901 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:46.368862 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-91ac6cfe-5a9d-4c5c-86be-0333d61d2901 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:46.471747 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-91ac6cfe-5a9d-4c5c-86be-0333d61d2901 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:46.479975 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-91ac6cfe-5a9d-4c5c-86be-0333d61d2901 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:46.482075 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-91ac6cfe-5a9d-4c5c-86be-0333d61d2901 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:46.484809 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:14:46.485944 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7233c9f8-3404-4809-8838-dd0e9e51a74e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:46.487633 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-91ac6cfe-5a9d-4c5c-86be-0333d61d2901 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1560 microversion: 2.91 time: 0.135631 Oct 19 03:14:46.488422 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 367/748] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:46 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1560 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:14:46.497474 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7233c9f8-3404-4809-8838-dd0e9e51a74e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667" status: 200 len: 1476 microversion: 2.1 time: 0.303560 Oct 19 03:14:46.498518 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 382/749] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:46 2022] GET /compute/v2.1/servers/ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667 => generated 1476 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:14:46.582088 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9de06845-9eda-44d8-a3e1-bc5999161bdc tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:46.582724 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9de06845-9eda-44d8-a3e1-bc5999161bdc tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: d67da55c-724e-4305-9960-99d15ecfb23a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:46.589342 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9de06845-9eda-44d8-a3e1-bc5999161bdc tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:46.590451 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9de06845-9eda-44d8-a3e1-bc5999161bdc tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:46.590902 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9de06845-9eda-44d8-a3e1-bc5999161bdc tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:46.591614 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9de06845-9eda-44d8-a3e1-bc5999161bdc tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:46.592080 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9de06845-9eda-44d8-a3e1-bc5999161bdc tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:46.592514 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9de06845-9eda-44d8-a3e1-bc5999161bdc tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:46.758093 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-989b0996-97ae-4d9b-9b39-6776189ad612 tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:46.758956 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-989b0996-97ae-4d9b-9b39-6776189ad612 tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] [instance: f603dfa8-a2e6-4018-aaeb-639bf5eb24c6] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:46.763344 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9de06845-9eda-44d8-a3e1-bc5999161bdc tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:46.765927 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-989b0996-97ae-4d9b-9b39-6776189ad612 tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:46.766420 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-989b0996-97ae-4d9b-9b39-6776189ad612 tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:46.768756 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-989b0996-97ae-4d9b-9b39-6776189ad612 tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:46.768756 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-989b0996-97ae-4d9b-9b39-6776189ad612 tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:46.768756 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-989b0996-97ae-4d9b-9b39-6776189ad612 tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:46.768756 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-989b0996-97ae-4d9b-9b39-6776189ad612 tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:46.772230 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9de06845-9eda-44d8-a3e1-bc5999161bdc tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:46.773816 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9de06845-9eda-44d8-a3e1-bc5999161bdc tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:46.774931 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9de06845-9eda-44d8-a3e1-bc5999161bdc tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/d67da55c-724e-4305-9960-99d15ecfb23a" status: 200 len: 1361 microversion: 2.25 time: 0.197061 Oct 19 03:14:46.781448 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 368/750] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:46 2022] GET /compute/v2.1/servers/d67da55c-724e-4305-9960-99d15ecfb23a => generated 1361 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:14:46.811060 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-eae0db80-2e04-4080-a688-620fc2e7c3fc tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:46.811772 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-eae0db80-2e04-4080-a688-620fc2e7c3fc tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] [instance: 6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:46.819384 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eae0db80-2e04-4080-a688-620fc2e7c3fc tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:46.820001 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eae0db80-2e04-4080-a688-620fc2e7c3fc tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:46.820463 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eae0db80-2e04-4080-a688-620fc2e7c3fc tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:46.821175 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eae0db80-2e04-4080-a688-620fc2e7c3fc tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:46.821826 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eae0db80-2e04-4080-a688-620fc2e7c3fc tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:46.822110 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eae0db80-2e04-4080-a688-620fc2e7c3fc tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:46.847474 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=100 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:14:47.079637 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-989b0996-97ae-4d9b-9b39-6776189ad612 tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2339bd95b0489ab4ae457b3cd072d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446866ac21894411965aedd84ceeb8bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:47.089381 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-989b0996-97ae-4d9b-9b39-6776189ad612 tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] 10.222.0.52 "GET /compute/v2.1/servers/f603dfa8-a2e6-4018-aaeb-639bf5eb24c6" status: 200 len: 1322 microversion: 2.1 time: 0.335291 Oct 19 03:14:47.093171 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 383/751] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:46 2022] GET /compute/v2.1/servers/f603dfa8-a2e6-4018-aaeb-639bf5eb24c6 => generated 1322 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:14:47.098536 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6186f802-f604-4b35-a59b-fd3aa9da871c tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:47.099165 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6186f802-f604-4b35-a59b-fd3aa9da871c tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 393853e1-5f67-4c6b-972d-9f76de928599] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:47.102431 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-eae0db80-2e04-4080-a688-620fc2e7c3fc tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cc37ae4bed94a7e85ed70dd5942c2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df99b134b20743eb9b62788706f2705a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:47.109212 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6186f802-f604-4b35-a59b-fd3aa9da871c tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:47.109987 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6186f802-f604-4b35-a59b-fd3aa9da871c tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:47.110217 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6186f802-f604-4b35-a59b-fd3aa9da871c tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:47.115621 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-eae0db80-2e04-4080-a688-620fc2e7c3fc tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] 10.222.0.52 "GET /compute/v2.1/servers/6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1" status: 200 len: 1400 microversion: 2.1 time: 0.309308 Oct 19 03:14:47.121611 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 369/752] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:46 2022] GET /compute/v2.1/servers/6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1 => generated 1400 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:14:47.122254 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6186f802-f604-4b35-a59b-fd3aa9da871c tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:47.122889 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6186f802-f604-4b35-a59b-fd3aa9da871c tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:47.123336 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6186f802-f604-4b35-a59b-fd3aa9da871c tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:47.127248 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7fcdb451-e36a-41b9-a289-477f487ecc5f tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:47.127911 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7fcdb451-e36a-41b9-a289-477f487ecc5f tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] [instance: 540a7025-b935-49fb-bc51-edf44ac1e0c4] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:47.146063 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7fcdb451-e36a-41b9-a289-477f487ecc5f tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:47.146063 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7fcdb451-e36a-41b9-a289-477f487ecc5f tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:47.146063 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7fcdb451-e36a-41b9-a289-477f487ecc5f tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:47.146063 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7fcdb451-e36a-41b9-a289-477f487ecc5f tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:47.146645 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7fcdb451-e36a-41b9-a289-477f487ecc5f tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:47.146645 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7fcdb451-e36a-41b9-a289-477f487ecc5f tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:47.211391 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-6186f802-f604-4b35-a59b-fd3aa9da871c tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:47.220063 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6186f802-f604-4b35-a59b-fd3aa9da871c tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/393853e1-5f67-4c6b-972d-9f76de928599" status: 200 len: 1213 microversion: 2.1 time: 0.125700 Oct 19 03:14:47.223660 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 384/753] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:47 2022] GET /compute/v2.1/servers/393853e1-5f67-4c6b-972d-9f76de928599 => generated 1213 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:14:47.238877 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-7fcdb451-e36a-41b9-a289-477f487ecc5f tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28072a54d5934ea28e7d3205841c0852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c12a432bbd43bd8f70ba6e941c28a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:47.247508 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7fcdb451-e36a-41b9-a289-477f487ecc5f tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] 10.222.0.52 "GET /compute/v2.1/servers/540a7025-b935-49fb-bc51-edf44ac1e0c4" status: 200 len: 1293 microversion: 2.1 time: 0.129950 Oct 19 03:14:47.248116 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 370/754] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:47 2022] GET /compute/v2.1/servers/540a7025-b935-49fb-bc51-edf44ac1e0c4 => generated 1293 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:14:47.360243 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6b433350-62fd-4310-a7a1-b57cff8c1401 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:47.360243 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6b433350-62fd-4310-a7a1-b57cff8c1401 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] [instance: d50976fb-756b-4b12-92f2-cedf87df492d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:47.366766 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6b433350-62fd-4310-a7a1-b57cff8c1401 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:47.367257 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6b433350-62fd-4310-a7a1-b57cff8c1401 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:47.367700 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6b433350-62fd-4310-a7a1-b57cff8c1401 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:47.368462 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6b433350-62fd-4310-a7a1-b57cff8c1401 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:47.368921 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6b433350-62fd-4310-a7a1-b57cff8c1401 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:47.369348 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6b433350-62fd-4310-a7a1-b57cff8c1401 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:47.471223 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-6b433350-62fd-4310-a7a1-b57cff8c1401 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:47.483014 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-6b433350-62fd-4310-a7a1-b57cff8c1401 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:47.484851 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-6b433350-62fd-4310-a7a1-b57cff8c1401 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:47.490880 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6b433350-62fd-4310-a7a1-b57cff8c1401 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] 10.222.0.52 "GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d" status: 200 len: 1446 microversion: 2.75 time: 0.138207 Oct 19 03:14:47.510063 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 385/755] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:47 2022] GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d => generated 1446 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:14:47.520166 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7e7bcb68-de5a-421f-ba6a-b7c884fec2e2 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:47.524195 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7e7bcb68-de5a-421f-ba6a-b7c884fec2e2 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:47.528134 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f15e9ee8-3c40-4ded-8d74-a149d137a315 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:47.530372 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f15e9ee8-3c40-4ded-8d74-a149d137a315 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:47.538919 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f15e9ee8-3c40-4ded-8d74-a149d137a315 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:47.539492 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7e7bcb68-de5a-421f-ba6a-b7c884fec2e2 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:47.539881 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f15e9ee8-3c40-4ded-8d74-a149d137a315 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:47.540474 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7e7bcb68-de5a-421f-ba6a-b7c884fec2e2 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:47.540880 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f15e9ee8-3c40-4ded-8d74-a149d137a315 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:47.541221 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7e7bcb68-de5a-421f-ba6a-b7c884fec2e2 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:47.542585 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f15e9ee8-3c40-4ded-8d74-a149d137a315 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:47.542730 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7e7bcb68-de5a-421f-ba6a-b7c884fec2e2 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:47.543396 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7e7bcb68-de5a-421f-ba6a-b7c884fec2e2 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:47.544636 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7e7bcb68-de5a-421f-ba6a-b7c884fec2e2 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:47.546367 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f15e9ee8-3c40-4ded-8d74-a149d137a315 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:47.547437 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f15e9ee8-3c40-4ded-8d74-a149d137a315 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:47.703245 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-7e7bcb68-de5a-421f-ba6a-b7c884fec2e2 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:47.712367 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-7e7bcb68-de5a-421f-ba6a-b7c884fec2e2 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:47.714040 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-7e7bcb68-de5a-421f-ba6a-b7c884fec2e2 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:47.720257 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7e7bcb68-de5a-421f-ba6a-b7c884fec2e2 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1560 microversion: 2.91 time: 0.207725 Oct 19 03:14:47.720837 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 371/756] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:47 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1560 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:14:47.800593 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1dd465e1-18ca-4397-9423-b4812e34a12a tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:47.801355 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1dd465e1-18ca-4397-9423-b4812e34a12a tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: d67da55c-724e-4305-9960-99d15ecfb23a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:47.807968 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1dd465e1-18ca-4397-9423-b4812e34a12a tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:47.808504 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1dd465e1-18ca-4397-9423-b4812e34a12a tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:47.809168 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1dd465e1-18ca-4397-9423-b4812e34a12a tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:47.809912 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1dd465e1-18ca-4397-9423-b4812e34a12a tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:47.810371 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1dd465e1-18ca-4397-9423-b4812e34a12a tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:47.811010 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1dd465e1-18ca-4397-9423-b4812e34a12a tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:47.907645 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f15e9ee8-3c40-4ded-8d74-a149d137a315 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:47.921905 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f15e9ee8-3c40-4ded-8d74-a149d137a315 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667" status: 200 len: 1476 microversion: 2.1 time: 0.396277 Oct 19 03:14:47.935556 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 386/757] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:47 2022] GET /compute/v2.1/servers/ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667 => generated 1476 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:14:48.020318 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-1dd465e1-18ca-4397-9423-b4812e34a12a tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:48.031348 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-1dd465e1-18ca-4397-9423-b4812e34a12a tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:48.033189 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-1dd465e1-18ca-4397-9423-b4812e34a12a tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:48.034510 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1dd465e1-18ca-4397-9423-b4812e34a12a tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/d67da55c-724e-4305-9960-99d15ecfb23a" status: 200 len: 1555 microversion: 2.25 time: 0.238091 Oct 19 03:14:48.042318 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 372/758] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:47 2022] GET /compute/v2.1/servers/d67da55c-724e-4305-9960-99d15ecfb23a => generated 1555 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:14:48.062753 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-67bfb627-b2c8-4f3c-999b-fbb311e7328c tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:48.063676 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-67bfb627-b2c8-4f3c-999b-fbb311e7328c tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] [instance: d67da55c-724e-4305-9960-99d15ecfb23a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:48.071391 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-67bfb627-b2c8-4f3c-999b-fbb311e7328c tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:48.072147 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-67bfb627-b2c8-4f3c-999b-fbb311e7328c tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:48.073698 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-67bfb627-b2c8-4f3c-999b-fbb311e7328c tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:48.079089 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-67bfb627-b2c8-4f3c-999b-fbb311e7328c tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:48.081838 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-67bfb627-b2c8-4f3c-999b-fbb311e7328c tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:48.082514 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-67bfb627-b2c8-4f3c-999b-fbb311e7328c tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:48.112703 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8a0c56fc-8565-4765-9604-5d6492f5a40d tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:48.113325 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8a0c56fc-8565-4765-9604-5d6492f5a40d tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] [instance: f603dfa8-a2e6-4018-aaeb-639bf5eb24c6] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:48.121818 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8a0c56fc-8565-4765-9604-5d6492f5a40d tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:48.122319 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8a0c56fc-8565-4765-9604-5d6492f5a40d tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:48.125281 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8a0c56fc-8565-4765-9604-5d6492f5a40d tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:48.125281 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8a0c56fc-8565-4765-9604-5d6492f5a40d tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:48.125281 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8a0c56fc-8565-4765-9604-5d6492f5a40d tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:48.125281 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8a0c56fc-8565-4765-9604-5d6492f5a40d tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:48.709811 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-67bfb627-b2c8-4f3c-999b-fbb311e7328c tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lazy-loading 'services' on Instance uuid d67da55c-724e-4305-9960-99d15ecfb23a {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:14:48.716133 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8a0c56fc-8565-4765-9604-5d6492f5a40d tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2339bd95b0489ab4ae457b3cd072d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446866ac21894411965aedd84ceeb8bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:48.724778 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8a0c56fc-8565-4765-9604-5d6492f5a40d tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] 10.222.0.52 "GET /compute/v2.1/servers/f603dfa8-a2e6-4018-aaeb-639bf5eb24c6" status: 200 len: 1322 microversion: 2.1 time: 0.616256 Oct 19 03:14:48.725496 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 373/759] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:48 2022] GET /compute/v2.1/servers/f603dfa8-a2e6-4018-aaeb-639bf5eb24c6 => generated 1322 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:14:48.725654 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-67bfb627-b2c8-4f3c-999b-fbb311e7328c tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d67da55c-724e-4305-9960-99d15ecfb23a" status: 200 len: 2047 microversion: 2.25 time: 0.669319 Oct 19 03:14:48.726232 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 387/760] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:48 2022] GET /compute/v2.1/servers/d67da55c-724e-4305-9960-99d15ecfb23a => generated 2047 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:14:48.741752 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7fe71e86-2fb0-40db-91ab-6597ad758fcf tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:48.741752 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7fe71e86-2fb0-40db-91ab-6597ad758fcf tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 393853e1-5f67-4c6b-972d-9f76de928599] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:48.744315 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7fe71e86-2fb0-40db-91ab-6597ad758fcf tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:48.745098 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7fe71e86-2fb0-40db-91ab-6597ad758fcf tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:48.745688 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7fe71e86-2fb0-40db-91ab-6597ad758fcf tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:48.746850 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7fe71e86-2fb0-40db-91ab-6597ad758fcf tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:48.747328 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7fe71e86-2fb0-40db-91ab-6597ad758fcf tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:48.747764 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7fe71e86-2fb0-40db-91ab-6597ad758fcf tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:48.756910 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3b880457-0815-45f2-9152-d10897affbf4 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:48.760306 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3b880457-0815-45f2-9152-d10897affbf4 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] [instance: 6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:48.766420 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3b880457-0815-45f2-9152-d10897affbf4 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:48.767136 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3b880457-0815-45f2-9152-d10897affbf4 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:48.767876 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3b880457-0815-45f2-9152-d10897affbf4 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:48.768888 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3b880457-0815-45f2-9152-d10897affbf4 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:48.770586 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3b880457-0815-45f2-9152-d10897affbf4 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:48.771552 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3b880457-0815-45f2-9152-d10897affbf4 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:48.901614 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7fe71e86-2fb0-40db-91ab-6597ad758fcf tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:48.909760 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7fe71e86-2fb0-40db-91ab-6597ad758fcf tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/393853e1-5f67-4c6b-972d-9f76de928599" status: 200 len: 1269 microversion: 2.1 time: 0.182314 Oct 19 03:14:48.910685 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 388/761] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:48 2022] GET /compute/v2.1/servers/393853e1-5f67-4c6b-972d-9f76de928599 => generated 1269 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:14:48.915601 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-085c0091-e9c1-47d0-be26-74895b3670e2 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:48.916216 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-085c0091-e9c1-47d0-be26-74895b3670e2 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] [instance: 540a7025-b935-49fb-bc51-edf44ac1e0c4] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:48.922541 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-085c0091-e9c1-47d0-be26-74895b3670e2 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:48.923032 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-085c0091-e9c1-47d0-be26-74895b3670e2 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:48.923469 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-085c0091-e9c1-47d0-be26-74895b3670e2 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:48.924163 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-085c0091-e9c1-47d0-be26-74895b3670e2 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:48.924615 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-085c0091-e9c1-47d0-be26-74895b3670e2 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:48.925340 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-085c0091-e9c1-47d0-be26-74895b3670e2 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:49.085890 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-085c0091-e9c1-47d0-be26-74895b3670e2 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28072a54d5934ea28e7d3205841c0852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c12a432bbd43bd8f70ba6e941c28a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:49.094123 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-085c0091-e9c1-47d0-be26-74895b3670e2 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] 10.222.0.52 "GET /compute/v2.1/servers/540a7025-b935-49fb-bc51-edf44ac1e0c4" status: 200 len: 1311 microversion: 2.1 time: 0.182119 Oct 19 03:14:49.094710 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 389/762] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:48 2022] GET /compute/v2.1/servers/540a7025-b935-49fb-bc51-edf44ac1e0c4 => generated 1311 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:14:49.125202 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-503b6623-dd4a-463b-b5f0-b48647473229 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:49.126680 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-503b6623-dd4a-463b-b5f0-b48647473229 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] [instance: d50976fb-756b-4b12-92f2-cedf87df492d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:49.133049 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-503b6623-dd4a-463b-b5f0-b48647473229 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:49.139000 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-503b6623-dd4a-463b-b5f0-b48647473229 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:49.139000 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-503b6623-dd4a-463b-b5f0-b48647473229 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:49.139000 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-503b6623-dd4a-463b-b5f0-b48647473229 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:49.139000 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-503b6623-dd4a-463b-b5f0-b48647473229 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:49.139386 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-503b6623-dd4a-463b-b5f0-b48647473229 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:49.268571 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-503b6623-dd4a-463b-b5f0-b48647473229 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:49.278481 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-503b6623-dd4a-463b-b5f0-b48647473229 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:49.280437 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-503b6623-dd4a-463b-b5f0-b48647473229 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:49.285787 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-503b6623-dd4a-463b-b5f0-b48647473229 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] 10.222.0.52 "GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d" status: 200 len: 1452 microversion: 2.75 time: 0.169956 Oct 19 03:14:49.286611 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 390/763] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:49 2022] GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d => generated 1452 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:14:49.291352 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-cebe2b2a-6ad8-4278-afc6-9acf389dd136 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:49.292044 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-cebe2b2a-6ad8-4278-afc6-9acf389dd136 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:49.295287 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:14:49.299041 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cebe2b2a-6ad8-4278-afc6-9acf389dd136 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:49.299715 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cebe2b2a-6ad8-4278-afc6-9acf389dd136 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:49.303362 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cebe2b2a-6ad8-4278-afc6-9acf389dd136 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:49.303362 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cebe2b2a-6ad8-4278-afc6-9acf389dd136 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:49.303362 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cebe2b2a-6ad8-4278-afc6-9acf389dd136 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:49.303362 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cebe2b2a-6ad8-4278-afc6-9acf389dd136 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:49.305863 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-3b880457-0815-45f2-9152-d10897affbf4 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cc37ae4bed94a7e85ed70dd5942c2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df99b134b20743eb9b62788706f2705a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:49.315297 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3b880457-0815-45f2-9152-d10897affbf4 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] 10.222.0.52 "GET /compute/v2.1/servers/6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1" status: 200 len: 1388 microversion: 2.1 time: 0.588301 Oct 19 03:14:49.316181 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 374/764] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:48 2022] GET /compute/v2.1/servers/6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1 => generated 1388 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:14:49.320852 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0199663c-b503-49b6-84ec-d34fbd878221 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:49.321680 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0199663c-b503-49b6-84ec-d34fbd878221 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] [instance: d67da55c-724e-4305-9960-99d15ecfb23a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:49.327636 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0199663c-b503-49b6-84ec-d34fbd878221 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:49.337107 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0199663c-b503-49b6-84ec-d34fbd878221 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:49.337107 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0199663c-b503-49b6-84ec-d34fbd878221 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:49.337107 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0199663c-b503-49b6-84ec-d34fbd878221 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:49.337107 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0199663c-b503-49b6-84ec-d34fbd878221 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:49.337564 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0199663c-b503-49b6-84ec-d34fbd878221 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:49.471173 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-cebe2b2a-6ad8-4278-afc6-9acf389dd136 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:49.482794 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-cebe2b2a-6ad8-4278-afc6-9acf389dd136 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:49.484407 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-cebe2b2a-6ad8-4278-afc6-9acf389dd136 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:49.489708 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-cebe2b2a-6ad8-4278-afc6-9acf389dd136 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1560 microversion: 2.91 time: 0.201858 Oct 19 03:14:49.490281 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 391/765] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:49 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1560 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:14:49.495223 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-adcc2370-d031-4199-b0f9-cf26bcde1c87 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:49.495870 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-adcc2370-d031-4199-b0f9-cf26bcde1c87 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:49.502191 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-adcc2370-d031-4199-b0f9-cf26bcde1c87 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:49.502898 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-adcc2370-d031-4199-b0f9-cf26bcde1c87 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:49.503520 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-adcc2370-d031-4199-b0f9-cf26bcde1c87 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:49.504205 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-adcc2370-d031-4199-b0f9-cf26bcde1c87 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:49.504655 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-adcc2370-d031-4199-b0f9-cf26bcde1c87 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:49.505240 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-adcc2370-d031-4199-b0f9-cf26bcde1c87 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:49.823026 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-0199663c-b503-49b6-84ec-d34fbd878221 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lazy-loading 'services' on Instance uuid d67da55c-724e-4305-9960-99d15ecfb23a {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:14:49.884032 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0199663c-b503-49b6-84ec-d34fbd878221 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d67da55c-724e-4305-9960-99d15ecfb23a" status: 200 len: 2047 microversion: 2.25 time: 0.566499 Oct 19 03:14:49.884632 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 375/766] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:49 2022] GET /compute/v2.1/servers/d67da55c-724e-4305-9960-99d15ecfb23a => generated 2047 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:14:49.889929 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-f6b99d9b-f946-4c9b-9571-25457f3fa9e5 req-f2716dc6-4cd2-4ae7-bc38-1d0980f8d9c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1", "tag": "753bfd99-2927-47ca-a7e7-46e77707a12f"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:14:49.899710 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-f6b99d9b-f946-4c9b-9571-25457f3fa9e5 req-f2716dc6-4cd2-4ae7-bc38-1d0980f8d9c9 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:49.900256 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-f6b99d9b-f946-4c9b-9571-25457f3fa9e5 req-f2716dc6-4cd2-4ae7-bc38-1d0980f8d9c9 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:49.900701 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-f6b99d9b-f946-4c9b-9571-25457f3fa9e5 req-f2716dc6-4cd2-4ae7-bc38-1d0980f8d9c9 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:49.911536 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-adcc2370-d031-4199-b0f9-cf26bcde1c87 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:49.921319 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-adcc2370-d031-4199-b0f9-cf26bcde1c87 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667" status: 200 len: 1476 microversion: 2.1 time: 0.429555 Oct 19 03:14:49.922787 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-f6b99d9b-f946-4c9b-9571-25457f3fa9e5 req-f2716dc6-4cd2-4ae7-bc38-1d0980f8d9c9 service nova] Creating event network-changed:753bfd99-2927-47ca-a7e7-46e77707a12f for instance 6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1 on n-h1-861333-8 Oct 19 03:14:49.927195 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 392/767] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:49 2022] GET /compute/v2.1/servers/ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667 => generated 1476 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:14:49.929656 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-f6b99d9b-f946-4c9b-9571-25457f3fa9e5 req-f2716dc6-4cd2-4ae7-bc38-1d0980f8d9c9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043794 Oct 19 03:14:49.930795 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 376/768] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:14:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:14:49.936588 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f50221b7-855f-4c23-905c-4b7ab13f0cbe tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:49.937796 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-97808b50-a42c-46d4-a52f-e5d26b75cc90 tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:49.938419 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-97808b50-a42c-46d4-a52f-e5d26b75cc90 tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] [instance: f603dfa8-a2e6-4018-aaeb-639bf5eb24c6] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:49.941187 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f50221b7-855f-4c23-905c-4b7ab13f0cbe tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:49.941900 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f50221b7-855f-4c23-905c-4b7ab13f0cbe tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:49.942533 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f50221b7-855f-4c23-905c-4b7ab13f0cbe tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:49.943490 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f50221b7-855f-4c23-905c-4b7ab13f0cbe tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:49.944109 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f50221b7-855f-4c23-905c-4b7ab13f0cbe tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:49.944702 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f50221b7-855f-4c23-905c-4b7ab13f0cbe tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:49.947925 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-97808b50-a42c-46d4-a52f-e5d26b75cc90 tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:49.948555 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-97808b50-a42c-46d4-a52f-e5d26b75cc90 tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:49.949654 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-97808b50-a42c-46d4-a52f-e5d26b75cc90 tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:49.951355 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-97808b50-a42c-46d4-a52f-e5d26b75cc90 tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:49.953863 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-97808b50-a42c-46d4-a52f-e5d26b75cc90 tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:49.953863 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-97808b50-a42c-46d4-a52f-e5d26b75cc90 tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:49.973905 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f50221b7-855f-4c23-905c-4b7ab13f0cbe tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.041512 Oct 19 03:14:49.975198 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 377/769] 10.222.0.52 () {60 vars in 1217 bytes} [Wed Oct 19 03:14:49 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 03:14:49.980219 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-78eeb29c-ff85-42b4-8f91-814e56079882 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:49.981524 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-78eeb29c-ff85-42b4-8f91-814e56079882 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 393853e1-5f67-4c6b-972d-9f76de928599] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:49.990386 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-78eeb29c-ff85-42b4-8f91-814e56079882 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:49.991144 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-78eeb29c-ff85-42b4-8f91-814e56079882 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:49.991744 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-78eeb29c-ff85-42b4-8f91-814e56079882 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:49.992613 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-78eeb29c-ff85-42b4-8f91-814e56079882 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:49.993228 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-78eeb29c-ff85-42b4-8f91-814e56079882 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:49.993862 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-78eeb29c-ff85-42b4-8f91-814e56079882 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:50.087821 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-78eeb29c-ff85-42b4-8f91-814e56079882 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:50.096456 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-78eeb29c-ff85-42b4-8f91-814e56079882 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/393853e1-5f67-4c6b-972d-9f76de928599" status: 200 len: 1275 microversion: 2.1 time: 0.119937 Oct 19 03:14:50.097115 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 378/770] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:49 2022] GET /compute/v2.1/servers/393853e1-5f67-4c6b-972d-9f76de928599 => generated 1275 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:14:50.102055 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1c2331ed-04c4-41bf-b611-c66243ab4f2e tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:14:50.102700 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1c2331ed-04c4-41bf-b611-c66243ab4f2e tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] [instance: d67da55c-724e-4305-9960-99d15ecfb23a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:50.109082 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1c2331ed-04c4-41bf-b611-c66243ab4f2e tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:50.110409 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1c2331ed-04c4-41bf-b611-c66243ab4f2e tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:50.110409 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1c2331ed-04c4-41bf-b611-c66243ab4f2e tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:50.111056 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1c2331ed-04c4-41bf-b611-c66243ab4f2e tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:50.112238 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1c2331ed-04c4-41bf-b611-c66243ab4f2e tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:50.112764 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1c2331ed-04c4-41bf-b611-c66243ab4f2e tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:50.249230 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-97808b50-a42c-46d4-a52f-e5d26b75cc90 tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2339bd95b0489ab4ae457b3cd072d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446866ac21894411965aedd84ceeb8bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:50.265777 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-97808b50-a42c-46d4-a52f-e5d26b75cc90 tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] 10.222.0.52 "GET /compute/v2.1/servers/f603dfa8-a2e6-4018-aaeb-639bf5eb24c6" status: 200 len: 1322 microversion: 2.1 time: 0.335867 Oct 19 03:14:50.265777 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 393/771] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:49 2022] GET /compute/v2.1/servers/f603dfa8-a2e6-4018-aaeb-639bf5eb24c6 => generated 1322 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:14:50.269653 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4ee176b6-f428-4b47-9a32-361c933ee410 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:50.270253 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4ee176b6-f428-4b47-9a32-361c933ee410 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] [instance: 540a7025-b935-49fb-bc51-edf44ac1e0c4] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:50.278111 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4ee176b6-f428-4b47-9a32-361c933ee410 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:50.278689 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4ee176b6-f428-4b47-9a32-361c933ee410 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:50.279198 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4ee176b6-f428-4b47-9a32-361c933ee410 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:50.279970 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4ee176b6-f428-4b47-9a32-361c933ee410 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:50.280606 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4ee176b6-f428-4b47-9a32-361c933ee410 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:50.281036 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4ee176b6-f428-4b47-9a32-361c933ee410 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:50.390053 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1c2331ed-04c4-41bf-b611-c66243ab4f2e tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/d67da55c-724e-4305-9960-99d15ecfb23a/action" status: 202 len: 0 microversion: 2.25 time: 0.291381 Oct 19 03:14:50.394892 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 379/772] 10.222.0.52 () {62 vars in 1319 bytes} [Wed Oct 19 03:14:50 2022] POST /compute/v2.1/servers/d67da55c-724e-4305-9960-99d15ecfb23a/action => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:14:50.400666 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6eaa83f9-4ae5-41f7-b7b3-07c2d5e242ec tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:50.401640 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6eaa83f9-4ae5-41f7-b7b3-07c2d5e242ec tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] [instance: d50976fb-756b-4b12-92f2-cedf87df492d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:50.417358 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6eaa83f9-4ae5-41f7-b7b3-07c2d5e242ec tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:50.418728 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6eaa83f9-4ae5-41f7-b7b3-07c2d5e242ec tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:50.419259 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6eaa83f9-4ae5-41f7-b7b3-07c2d5e242ec tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:50.420081 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6eaa83f9-4ae5-41f7-b7b3-07c2d5e242ec tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:50.420619 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6eaa83f9-4ae5-41f7-b7b3-07c2d5e242ec tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:50.421125 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6eaa83f9-4ae5-41f7-b7b3-07c2d5e242ec tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:50.528459 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-6eaa83f9-4ae5-41f7-b7b3-07c2d5e242ec tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:50.536676 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-6eaa83f9-4ae5-41f7-b7b3-07c2d5e242ec tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:50.538147 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-6eaa83f9-4ae5-41f7-b7b3-07c2d5e242ec tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:50.543106 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6eaa83f9-4ae5-41f7-b7b3-07c2d5e242ec tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] 10.222.0.52 "GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d" status: 200 len: 1452 microversion: 2.75 time: 0.146730 Oct 19 03:14:50.543614 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 380/773] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:50 2022] GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d => generated 1452 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:14:50.559856 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-33d92b07-a268-4fa0-8984-b6883f7c0ab0 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:50.560981 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-33d92b07-a268-4fa0-8984-b6883f7c0ab0 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] [instance: 6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:50.567701 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-33d92b07-a268-4fa0-8984-b6883f7c0ab0 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:50.568192 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-33d92b07-a268-4fa0-8984-b6883f7c0ab0 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:50.568635 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-33d92b07-a268-4fa0-8984-b6883f7c0ab0 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:50.569392 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-33d92b07-a268-4fa0-8984-b6883f7c0ab0 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:50.569860 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-33d92b07-a268-4fa0-8984-b6883f7c0ab0 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:50.570321 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-33d92b07-a268-4fa0-8984-b6883f7c0ab0 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:50.648687 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4ee176b6-f428-4b47-9a32-361c933ee410 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28072a54d5934ea28e7d3205841c0852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c12a432bbd43bd8f70ba6e941c28a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:50.657080 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4ee176b6-f428-4b47-9a32-361c933ee410 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] 10.222.0.52 "GET /compute/v2.1/servers/540a7025-b935-49fb-bc51-edf44ac1e0c4" status: 200 len: 1366 microversion: 2.1 time: 0.394275 Oct 19 03:14:50.657710 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 394/774] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:50 2022] GET /compute/v2.1/servers/540a7025-b935-49fb-bc51-edf44ac1e0c4 => generated 1366 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:14:50.662294 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-79cb72b2-a2a4-4762-8dc0-971772e4c896 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:50.662937 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-79cb72b2-a2a4-4762-8dc0-971772e4c896 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] [instance: d67da55c-724e-4305-9960-99d15ecfb23a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:50.668882 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-79cb72b2-a2a4-4762-8dc0-971772e4c896 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:50.669363 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-79cb72b2-a2a4-4762-8dc0-971772e4c896 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:50.669853 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-79cb72b2-a2a4-4762-8dc0-971772e4c896 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:50.670549 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-79cb72b2-a2a4-4762-8dc0-971772e4c896 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:50.671006 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-79cb72b2-a2a4-4762-8dc0-971772e4c896 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:50.671428 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-79cb72b2-a2a4-4762-8dc0-971772e4c896 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:50.928343 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-33d92b07-a268-4fa0-8984-b6883f7c0ab0 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cc37ae4bed94a7e85ed70dd5942c2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df99b134b20743eb9b62788706f2705a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:50.937090 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-33d92b07-a268-4fa0-8984-b6883f7c0ab0 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] 10.222.0.52 "GET /compute/v2.1/servers/6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1" status: 200 len: 1388 microversion: 2.1 time: 0.382507 Oct 19 03:14:50.949796 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 381/775] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:50 2022] GET /compute/v2.1/servers/6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1 => generated 1388 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:14:50.958150 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b41167bb-ae8f-41c7-a914-d8eea6d40eca tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:50.958764 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b41167bb-ae8f-41c7-a914-d8eea6d40eca tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:50.965311 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b41167bb-ae8f-41c7-a914-d8eea6d40eca tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:50.965827 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b41167bb-ae8f-41c7-a914-d8eea6d40eca tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:50.966454 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b41167bb-ae8f-41c7-a914-d8eea6d40eca tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:50.967342 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b41167bb-ae8f-41c7-a914-d8eea6d40eca tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:50.967798 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b41167bb-ae8f-41c7-a914-d8eea6d40eca tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:50.968225 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b41167bb-ae8f-41c7-a914-d8eea6d40eca tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:50.997026 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-79cb72b2-a2a4-4762-8dc0-971772e4c896 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lazy-loading 'services' on Instance uuid d67da55c-724e-4305-9960-99d15ecfb23a {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:14:51.010886 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-79cb72b2-a2a4-4762-8dc0-971772e4c896 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d67da55c-724e-4305-9960-99d15ecfb23a" status: 200 len: 2052 microversion: 2.25 time: 0.351578 Oct 19 03:14:51.012214 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 395/776] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:50 2022] GET /compute/v2.1/servers/d67da55c-724e-4305-9960-99d15ecfb23a => generated 2052 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:14:51.026340 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-387c3b00-ee71-4081-9246-a2d27af05ed4 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:51.028123 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-387c3b00-ee71-4081-9246-a2d27af05ed4 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:51.035434 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-387c3b00-ee71-4081-9246-a2d27af05ed4 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:51.036061 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-387c3b00-ee71-4081-9246-a2d27af05ed4 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:51.036565 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-387c3b00-ee71-4081-9246-a2d27af05ed4 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:51.037404 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-387c3b00-ee71-4081-9246-a2d27af05ed4 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:51.037912 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-387c3b00-ee71-4081-9246-a2d27af05ed4 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:51.038417 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-387c3b00-ee71-4081-9246-a2d27af05ed4 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:51.337592 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b41167bb-ae8f-41c7-a914-d8eea6d40eca tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:51.347995 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b41167bb-ae8f-41c7-a914-d8eea6d40eca tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:51.351862 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b41167bb-ae8f-41c7-a914-d8eea6d40eca tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:51.355745 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b41167bb-ae8f-41c7-a914-d8eea6d40eca tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1560 microversion: 2.91 time: 0.404296 Oct 19 03:14:51.356499 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 382/777] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:50 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1560 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:14:51.361825 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-34cfa9b8-b881-42c0-b9a9-cd32327a0fe8 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:51.362763 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-34cfa9b8-b881-42c0-b9a9-cd32327a0fe8 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 393853e1-5f67-4c6b-972d-9f76de928599] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:51.369446 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-34cfa9b8-b881-42c0-b9a9-cd32327a0fe8 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:51.370134 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-34cfa9b8-b881-42c0-b9a9-cd32327a0fe8 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:51.370601 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-34cfa9b8-b881-42c0-b9a9-cd32327a0fe8 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:51.371979 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-34cfa9b8-b881-42c0-b9a9-cd32327a0fe8 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:51.372428 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-34cfa9b8-b881-42c0-b9a9-cd32327a0fe8 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:51.373140 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-34cfa9b8-b881-42c0-b9a9-cd32327a0fe8 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:51.587342 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-387c3b00-ee71-4081-9246-a2d27af05ed4 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:51.589763 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=100 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:14:51.615350 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-387c3b00-ee71-4081-9246-a2d27af05ed4 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667" status: 200 len: 1476 microversion: 2.1 time: 0.601731 Oct 19 03:14:51.619548 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 396/778] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:51 2022] GET /compute/v2.1/servers/ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667 => generated 1476 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:14:51.632707 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-738d5a37-900c-4542-a3d9-b44d89028d71 tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:51.633329 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-738d5a37-900c-4542-a3d9-b44d89028d71 tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] [instance: f603dfa8-a2e6-4018-aaeb-639bf5eb24c6] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:51.647079 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-738d5a37-900c-4542-a3d9-b44d89028d71 tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:51.647593 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-738d5a37-900c-4542-a3d9-b44d89028d71 tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:51.648043 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-738d5a37-900c-4542-a3d9-b44d89028d71 tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:51.650977 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-738d5a37-900c-4542-a3d9-b44d89028d71 tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:51.651510 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-738d5a37-900c-4542-a3d9-b44d89028d71 tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:51.653227 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-738d5a37-900c-4542-a3d9-b44d89028d71 tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:51.695317 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-34cfa9b8-b881-42c0-b9a9-cd32327a0fe8 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:51.706714 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-34cfa9b8-b881-42c0-b9a9-cd32327a0fe8 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/393853e1-5f67-4c6b-972d-9f76de928599" status: 200 len: 1317 microversion: 2.1 time: 0.348866 Oct 19 03:14:51.729107 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 383/779] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:51 2022] GET /compute/v2.1/servers/393853e1-5f67-4c6b-972d-9f76de928599 => generated 1317 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:14:51.763943 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-163f5839-e3b0-4198-8f7b-27c0d3ac5e81 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:51.769826 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-163f5839-e3b0-4198-8f7b-27c0d3ac5e81 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] [instance: d50976fb-756b-4b12-92f2-cedf87df492d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:51.789591 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-163f5839-e3b0-4198-8f7b-27c0d3ac5e81 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:51.789591 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-163f5839-e3b0-4198-8f7b-27c0d3ac5e81 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:51.789591 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-163f5839-e3b0-4198-8f7b-27c0d3ac5e81 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:51.789591 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-163f5839-e3b0-4198-8f7b-27c0d3ac5e81 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:51.789894 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-163f5839-e3b0-4198-8f7b-27c0d3ac5e81 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:51.789894 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-163f5839-e3b0-4198-8f7b-27c0d3ac5e81 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:52.080673 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-163f5839-e3b0-4198-8f7b-27c0d3ac5e81 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:52.089168 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-163f5839-e3b0-4198-8f7b-27c0d3ac5e81 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:52.090702 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-163f5839-e3b0-4198-8f7b-27c0d3ac5e81 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:52.095820 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-163f5839-e3b0-4198-8f7b-27c0d3ac5e81 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] 10.222.0.52 "GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d" status: 200 len: 1452 microversion: 2.75 time: 0.365203 Oct 19 03:14:52.096398 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 384/780] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:51 2022] GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d => generated 1452 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:14:52.101048 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4db26d77-3e99-4275-a443-bde79d139a78 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:52.101900 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4db26d77-3e99-4275-a443-bde79d139a78 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] [instance: 540a7025-b935-49fb-bc51-edf44ac1e0c4] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:52.108333 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4db26d77-3e99-4275-a443-bde79d139a78 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:52.109043 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4db26d77-3e99-4275-a443-bde79d139a78 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:52.109688 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4db26d77-3e99-4275-a443-bde79d139a78 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:52.110563 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4db26d77-3e99-4275-a443-bde79d139a78 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:52.111180 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4db26d77-3e99-4275-a443-bde79d139a78 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:52.111770 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4db26d77-3e99-4275-a443-bde79d139a78 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:52.126268 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-738d5a37-900c-4542-a3d9-b44d89028d71 tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2339bd95b0489ab4ae457b3cd072d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446866ac21894411965aedd84ceeb8bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:52.133775 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-738d5a37-900c-4542-a3d9-b44d89028d71 tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] 10.222.0.52 "GET /compute/v2.1/servers/f603dfa8-a2e6-4018-aaeb-639bf5eb24c6" status: 200 len: 1322 microversion: 2.1 time: 0.512898 Oct 19 03:14:52.134370 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 397/781] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:51 2022] GET /compute/v2.1/servers/f603dfa8-a2e6-4018-aaeb-639bf5eb24c6 => generated 1322 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:14:52.141080 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-dd28d48e-914c-41df-8555-71e1c5e8f51b tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:52.141930 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-dd28d48e-914c-41df-8555-71e1c5e8f51b tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] [instance: 6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:52.148170 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dd28d48e-914c-41df-8555-71e1c5e8f51b tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:52.149569 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dd28d48e-914c-41df-8555-71e1c5e8f51b tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:52.150246 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dd28d48e-914c-41df-8555-71e1c5e8f51b tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:52.151607 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dd28d48e-914c-41df-8555-71e1c5e8f51b tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:52.152361 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dd28d48e-914c-41df-8555-71e1c5e8f51b tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:52.158123 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dd28d48e-914c-41df-8555-71e1c5e8f51b tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:52.304224 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=6 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:14:52.617286 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-4db26d77-3e99-4275-a443-bde79d139a78 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28072a54d5934ea28e7d3205841c0852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c12a432bbd43bd8f70ba6e941c28a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:52.628566 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4db26d77-3e99-4275-a443-bde79d139a78 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] 10.222.0.52 "GET /compute/v2.1/servers/540a7025-b935-49fb-bc51-edf44ac1e0c4" status: 200 len: 1366 microversion: 2.1 time: 0.530923 Oct 19 03:14:52.632706 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 385/782] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:52 2022] GET /compute/v2.1/servers/540a7025-b935-49fb-bc51-edf44ac1e0c4 => generated 1366 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:14:52.643598 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6bc11d3e-f2e9-43fd-a0c2-34006a4ffeb9 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:52.646763 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6bc11d3e-f2e9-43fd-a0c2-34006a4ffeb9 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] [instance: d67da55c-724e-4305-9960-99d15ecfb23a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:52.661558 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6bc11d3e-f2e9-43fd-a0c2-34006a4ffeb9 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:52.661558 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6bc11d3e-f2e9-43fd-a0c2-34006a4ffeb9 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:52.661558 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6bc11d3e-f2e9-43fd-a0c2-34006a4ffeb9 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:52.661558 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6bc11d3e-f2e9-43fd-a0c2-34006a4ffeb9 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:52.661944 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6bc11d3e-f2e9-43fd-a0c2-34006a4ffeb9 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:52.661944 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6bc11d3e-f2e9-43fd-a0c2-34006a4ffeb9 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:52.668915 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:14:52.672094 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-dd28d48e-914c-41df-8555-71e1c5e8f51b tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cc37ae4bed94a7e85ed70dd5942c2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df99b134b20743eb9b62788706f2705a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:52.685332 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-dd28d48e-914c-41df-8555-71e1c5e8f51b tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] 10.222.0.52 "GET /compute/v2.1/servers/6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1" status: 200 len: 1388 microversion: 2.1 time: 0.549907 Oct 19 03:14:52.690048 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 398/783] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:52 2022] GET /compute/v2.1/servers/6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1 => generated 1388 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:14:52.696439 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-23f9cdb7-a161-406f-a470-751eed0e1e42 req-8fff4e8f-d9f0-4c9b-b79c-8253250bdb41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f603dfa8-a2e6-4018-aaeb-639bf5eb24c6", "name": "network-vif-plugged", "status": "completed", "tag": "3e753133-013e-43f0-a278-9311e3115aa5"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:14:52.711247 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-23f9cdb7-a161-406f-a470-751eed0e1e42 req-8fff4e8f-d9f0-4c9b-b79c-8253250bdb41 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:52.711678 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-23f9cdb7-a161-406f-a470-751eed0e1e42 req-8fff4e8f-d9f0-4c9b-b79c-8253250bdb41 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:52.712108 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-23f9cdb7-a161-406f-a470-751eed0e1e42 req-8fff4e8f-d9f0-4c9b-b79c-8253250bdb41 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:52.724311 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-23f9cdb7-a161-406f-a470-751eed0e1e42 req-8fff4e8f-d9f0-4c9b-b79c-8253250bdb41 service nova] Creating event network-vif-plugged:3e753133-013e-43f0-a278-9311e3115aa5 for instance f603dfa8-a2e6-4018-aaeb-639bf5eb24c6 on n-h2-861333-8 Oct 19 03:14:52.730019 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-23f9cdb7-a161-406f-a470-751eed0e1e42 req-8fff4e8f-d9f0-4c9b-b79c-8253250bdb41 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040165 Oct 19 03:14:52.731242 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 399/784] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:14:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:14:52.739975 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-907784e6-9e29-4222-ac06-301f64a24223 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:52.741995 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-907784e6-9e29-4222-ac06-301f64a24223 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:52.748364 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-907784e6-9e29-4222-ac06-301f64a24223 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:52.748897 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-907784e6-9e29-4222-ac06-301f64a24223 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:52.749609 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-907784e6-9e29-4222-ac06-301f64a24223 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:52.750476 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-907784e6-9e29-4222-ac06-301f64a24223 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:52.751114 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-907784e6-9e29-4222-ac06-301f64a24223 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:52.751695 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-907784e6-9e29-4222-ac06-301f64a24223 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:52.924485 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-907784e6-9e29-4222-ac06-301f64a24223 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:52.933836 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-907784e6-9e29-4222-ac06-301f64a24223 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:52.935416 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-907784e6-9e29-4222-ac06-301f64a24223 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:52.941563 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-907784e6-9e29-4222-ac06-301f64a24223 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1555 microversion: 2.91 time: 0.207206 Oct 19 03:14:52.942150 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 400/785] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:52 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1555 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:14:52.954119 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-67298765-1bb3-460d-901c-20694a36b954 req-2928c28b-2168-4fdc-9307-21cdff0daa4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "540a7025-b935-49fb-bc51-edf44ac1e0c4", "tag": "e54cc460-46ae-45ff-9a37-9bdfc282d2aa"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:14:52.964117 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-67298765-1bb3-460d-901c-20694a36b954 req-2928c28b-2168-4fdc-9307-21cdff0daa4c service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:52.965821 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-67298765-1bb3-460d-901c-20694a36b954 req-2928c28b-2168-4fdc-9307-21cdff0daa4c service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:52.971892 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-67298765-1bb3-460d-901c-20694a36b954 req-2928c28b-2168-4fdc-9307-21cdff0daa4c service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:52.987409 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-67298765-1bb3-460d-901c-20694a36b954 req-2928c28b-2168-4fdc-9307-21cdff0daa4c service nova] Creating event network-changed:e54cc460-46ae-45ff-9a37-9bdfc282d2aa for instance 540a7025-b935-49fb-bc51-edf44ac1e0c4 on n-h1-861333-8 Oct 19 03:14:52.995069 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-67298765-1bb3-460d-901c-20694a36b954 req-2928c28b-2168-4fdc-9307-21cdff0daa4c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044170 Oct 19 03:14:52.996253 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 401/786] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:14:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:14:53.004181 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-42f60934-1c9a-4798-9b03-995f84279f7e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:53.005349 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-42f60934-1c9a-4798-9b03-995f84279f7e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:53.013515 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-42f60934-1c9a-4798-9b03-995f84279f7e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:53.016960 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-42f60934-1c9a-4798-9b03-995f84279f7e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:53.016960 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-42f60934-1c9a-4798-9b03-995f84279f7e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:53.016960 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-42f60934-1c9a-4798-9b03-995f84279f7e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:53.016960 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-42f60934-1c9a-4798-9b03-995f84279f7e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:53.017298 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-42f60934-1c9a-4798-9b03-995f84279f7e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:53.192589 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-6bc11d3e-f2e9-43fd-a0c2-34006a4ffeb9 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lazy-loading 'services' on Instance uuid d67da55c-724e-4305-9960-99d15ecfb23a {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:14:53.223075 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6bc11d3e-f2e9-43fd-a0c2-34006a4ffeb9 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d67da55c-724e-4305-9960-99d15ecfb23a" status: 200 len: 2032 microversion: 2.25 time: 0.588998 Oct 19 03:14:53.227240 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 386/787] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:52 2022] GET /compute/v2.1/servers/d67da55c-724e-4305-9960-99d15ecfb23a => generated 2032 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:14:53.237751 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4325988b-97e7-4f58-9fab-124837624fd8 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:53.240850 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4325988b-97e7-4f58-9fab-124837624fd8 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 393853e1-5f67-4c6b-972d-9f76de928599] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:53.255177 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4325988b-97e7-4f58-9fab-124837624fd8 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:53.255780 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4325988b-97e7-4f58-9fab-124837624fd8 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:53.256330 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4325988b-97e7-4f58-9fab-124837624fd8 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:53.257345 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4325988b-97e7-4f58-9fab-124837624fd8 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:53.257997 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4325988b-97e7-4f58-9fab-124837624fd8 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:53.258496 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4325988b-97e7-4f58-9fab-124837624fd8 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:53.465184 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-42f60934-1c9a-4798-9b03-995f84279f7e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:53.507928 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-42f60934-1c9a-4798-9b03-995f84279f7e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667" status: 200 len: 1476 microversion: 2.1 time: 0.481565 Oct 19 03:14:53.507928 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 402/788] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:52 2022] GET /compute/v2.1/servers/ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667 => generated 1476 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:14:53.507928 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-db74ae89-6a3c-4df7-968d-c776608d4e49 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:53.507928 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-db74ae89-6a3c-4df7-968d-c776608d4e49 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] [instance: d50976fb-756b-4b12-92f2-cedf87df492d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:53.521562 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-db74ae89-6a3c-4df7-968d-c776608d4e49 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:53.522059 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-db74ae89-6a3c-4df7-968d-c776608d4e49 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:53.522525 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-db74ae89-6a3c-4df7-968d-c776608d4e49 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:53.523497 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-db74ae89-6a3c-4df7-968d-c776608d4e49 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:53.524026 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-db74ae89-6a3c-4df7-968d-c776608d4e49 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:53.524667 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-db74ae89-6a3c-4df7-968d-c776608d4e49 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:53.674786 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-db74ae89-6a3c-4df7-968d-c776608d4e49 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:53.686654 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-db74ae89-6a3c-4df7-968d-c776608d4e49 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:53.688552 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-db74ae89-6a3c-4df7-968d-c776608d4e49 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:53.694285 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-db74ae89-6a3c-4df7-968d-c776608d4e49 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] 10.222.0.52 "GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d" status: 200 len: 1452 microversion: 2.75 time: 0.212342 Oct 19 03:14:53.694869 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 403/789] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:53 2022] GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d => generated 1452 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:14:53.703417 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ecc973ec-59b7-4b1b-9e86-9349cbb7ebe2 tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:53.706495 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ecc973ec-59b7-4b1b-9e86-9349cbb7ebe2 tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] [instance: f603dfa8-a2e6-4018-aaeb-639bf5eb24c6] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:53.719197 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ecc973ec-59b7-4b1b-9e86-9349cbb7ebe2 tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:53.721409 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ecc973ec-59b7-4b1b-9e86-9349cbb7ebe2 tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:53.721945 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ecc973ec-59b7-4b1b-9e86-9349cbb7ebe2 tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:53.727495 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ecc973ec-59b7-4b1b-9e86-9349cbb7ebe2 tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:53.728065 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ecc973ec-59b7-4b1b-9e86-9349cbb7ebe2 tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:53.728574 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ecc973ec-59b7-4b1b-9e86-9349cbb7ebe2 tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:53.811734 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-4325988b-97e7-4f58-9fab-124837624fd8 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:53.823589 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4325988b-97e7-4f58-9fab-124837624fd8 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/393853e1-5f67-4c6b-972d-9f76de928599" status: 200 len: 1317 microversion: 2.1 time: 0.595191 Oct 19 03:14:53.843206 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 387/790] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:53 2022] GET /compute/v2.1/servers/393853e1-5f67-4c6b-972d-9f76de928599 => generated 1317 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:14:53.843206 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4a51af93-5ecf-4967-9e94-733bc74d551f tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-861333-8", "block_migration": "auto"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:14:53.843206 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4a51af93-5ecf-4967-9e94-733bc74d551f tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] [instance: d67da55c-724e-4305-9960-99d15ecfb23a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:53.852193 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4a51af93-5ecf-4967-9e94-733bc74d551f tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:53.852193 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4a51af93-5ecf-4967-9e94-733bc74d551f tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:53.852193 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4a51af93-5ecf-4967-9e94-733bc74d551f tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:53.852193 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4a51af93-5ecf-4967-9e94-733bc74d551f tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:53.856620 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4a51af93-5ecf-4967-9e94-733bc74d551f tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:53.856620 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4a51af93-5ecf-4967-9e94-733bc74d551f tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:53.895639 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-4a51af93-5ecf-4967-9e94-733bc74d551f tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lazy-loading 'flavor' on Instance uuid d67da55c-724e-4305-9960-99d15ecfb23a {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:14:53.919026 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4a51af93-5ecf-4967-9e94-733bc74d551f tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] [instance: d67da55c-724e-4305-9960-99d15ecfb23a] Going to try to live migrate instance to n-h2-861333-8 {{(pid=121134) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 19 03:14:54.172761 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ecc973ec-59b7-4b1b-9e86-9349cbb7ebe2 tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2339bd95b0489ab4ae457b3cd072d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446866ac21894411965aedd84ceeb8bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:54.185199 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ecc973ec-59b7-4b1b-9e86-9349cbb7ebe2 tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] 10.222.0.52 "GET /compute/v2.1/servers/f603dfa8-a2e6-4018-aaeb-639bf5eb24c6" status: 200 len: 1322 microversion: 2.1 time: 0.488053 Oct 19 03:14:54.185848 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 404/791] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:53 2022] GET /compute/v2.1/servers/f603dfa8-a2e6-4018-aaeb-639bf5eb24c6 => generated 1322 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:14:54.196324 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-89854b89-d5de-4b45-b530-12311ef1b89b req-80ef9b98-4b47-41f1-bf4c-5c88d36d3f4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cb9ad03-e7f9-4d7f-8711-1e2f478b0d17", "tag": "e1bbec00-8519-4f02-b46d-c4664396ed43"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:14:54.216533 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-89854b89-d5de-4b45-b530-12311ef1b89b req-80ef9b98-4b47-41f1-bf4c-5c88d36d3f4c service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:54.217315 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-89854b89-d5de-4b45-b530-12311ef1b89b req-80ef9b98-4b47-41f1-bf4c-5c88d36d3f4c service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:54.217938 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-89854b89-d5de-4b45-b530-12311ef1b89b req-80ef9b98-4b47-41f1-bf4c-5c88d36d3f4c service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:54.246425 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-89854b89-d5de-4b45-b530-12311ef1b89b req-80ef9b98-4b47-41f1-bf4c-5c88d36d3f4c service nova] Creating event network-changed:e1bbec00-8519-4f02-b46d-c4664396ed43 for instance 8cb9ad03-e7f9-4d7f-8711-1e2f478b0d17 on n-h2-861333-8 Oct 19 03:14:54.256331 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-89854b89-d5de-4b45-b530-12311ef1b89b req-80ef9b98-4b47-41f1-bf4c-5c88d36d3f4c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069221 Oct 19 03:14:54.259327 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 405/792] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:14:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:14:54.267432 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-253ef612-4bcf-4aef-accd-bd7fd65e8398 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:54.268340 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-253ef612-4bcf-4aef-accd-bd7fd65e8398 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] [instance: 540a7025-b935-49fb-bc51-edf44ac1e0c4] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:54.276673 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-253ef612-4bcf-4aef-accd-bd7fd65e8398 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:54.278684 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-253ef612-4bcf-4aef-accd-bd7fd65e8398 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:54.279481 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-253ef612-4bcf-4aef-accd-bd7fd65e8398 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:54.280485 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-253ef612-4bcf-4aef-accd-bd7fd65e8398 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:54.281188 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-253ef612-4bcf-4aef-accd-bd7fd65e8398 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:54.281913 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-253ef612-4bcf-4aef-accd-bd7fd65e8398 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:54.698490 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=48 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:14:54.783362 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-253ef612-4bcf-4aef-accd-bd7fd65e8398 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28072a54d5934ea28e7d3205841c0852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c12a432bbd43bd8f70ba6e941c28a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:54.795572 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-253ef612-4bcf-4aef-accd-bd7fd65e8398 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] 10.222.0.52 "GET /compute/v2.1/servers/540a7025-b935-49fb-bc51-edf44ac1e0c4" status: 200 len: 1366 microversion: 2.1 time: 0.534151 Oct 19 03:14:54.796858 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 406/793] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:54 2022] GET /compute/v2.1/servers/540a7025-b935-49fb-bc51-edf44ac1e0c4 => generated 1366 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:14:54.805207 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3aacb049-5869-4c1f-b246-da3e514484fb tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:54.807798 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-3aacb049-5869-4c1f-b246-da3e514484fb tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] [instance: 6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:54.818218 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3aacb049-5869-4c1f-b246-da3e514484fb tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:54.818564 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3aacb049-5869-4c1f-b246-da3e514484fb tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:54.819010 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3aacb049-5869-4c1f-b246-da3e514484fb tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:54.819791 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3aacb049-5869-4c1f-b246-da3e514484fb tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:54.820265 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3aacb049-5869-4c1f-b246-da3e514484fb tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:54.820725 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3aacb049-5869-4c1f-b246-da3e514484fb tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:55.007528 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-3aacb049-5869-4c1f-b246-da3e514484fb tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cc37ae4bed94a7e85ed70dd5942c2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df99b134b20743eb9b62788706f2705a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:55.020113 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-3aacb049-5869-4c1f-b246-da3e514484fb tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] 10.222.0.52 "GET /compute/v2.1/servers/6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1" status: 200 len: 1388 microversion: 2.1 time: 0.221129 Oct 19 03:14:55.020936 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 407/794] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:54 2022] GET /compute/v2.1/servers/6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1 => generated 1388 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:14:55.029854 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e89906c7-328c-41cf-883c-796818608e17 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:55.033928 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e89906c7-328c-41cf-883c-796818608e17 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:55.039729 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e89906c7-328c-41cf-883c-796818608e17 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:55.040228 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e89906c7-328c-41cf-883c-796818608e17 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:55.040697 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e89906c7-328c-41cf-883c-796818608e17 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:55.041559 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e89906c7-328c-41cf-883c-796818608e17 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:55.042044 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e89906c7-328c-41cf-883c-796818608e17 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:55.042982 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e89906c7-328c-41cf-883c-796818608e17 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:55.122400 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-e89906c7-328c-41cf-883c-796818608e17 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:55.143095 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-e89906c7-328c-41cf-883c-796818608e17 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:55.148386 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-e89906c7-328c-41cf-883c-796818608e17 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:55.151639 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e89906c7-328c-41cf-883c-796818608e17 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1555 microversion: 2.91 time: 0.128806 Oct 19 03:14:55.172336 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 408/795] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:55 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1555 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:14:55.180164 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3c87b3bb-f854-4384-90f2-a1e077d46ed9 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:55.180880 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-3c87b3bb-f854-4384-90f2-a1e077d46ed9 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:55.188695 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3c87b3bb-f854-4384-90f2-a1e077d46ed9 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:55.189396 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3c87b3bb-f854-4384-90f2-a1e077d46ed9 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:55.189903 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3c87b3bb-f854-4384-90f2-a1e077d46ed9 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:55.190554 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3c87b3bb-f854-4384-90f2-a1e077d46ed9 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:55.191013 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3c87b3bb-f854-4384-90f2-a1e077d46ed9 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:55.191440 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3c87b3bb-f854-4384-90f2-a1e077d46ed9 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:55.537581 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-3c87b3bb-f854-4384-90f2-a1e077d46ed9 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:55.554335 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-3c87b3bb-f854-4384-90f2-a1e077d46ed9 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667" status: 200 len: 1476 microversion: 2.1 time: 0.380733 Oct 19 03:14:55.556230 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 409/796] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:55 2022] GET /compute/v2.1/servers/ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667 => generated 1476 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:14:55.565734 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4a1ab04e-9f10-478d-8f97-302e866721b7 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:55.566453 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4a1ab04e-9f10-478d-8f97-302e866721b7 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] [instance: d50976fb-756b-4b12-92f2-cedf87df492d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:55.573877 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4a1ab04e-9f10-478d-8f97-302e866721b7 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:55.574409 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4a1ab04e-9f10-478d-8f97-302e866721b7 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:55.574850 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4a1ab04e-9f10-478d-8f97-302e866721b7 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:55.575688 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4a1ab04e-9f10-478d-8f97-302e866721b7 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:55.576135 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4a1ab04e-9f10-478d-8f97-302e866721b7 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:55.576562 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4a1ab04e-9f10-478d-8f97-302e866721b7 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:55.705266 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4a1ab04e-9f10-478d-8f97-302e866721b7 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:55.716711 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4a1ab04e-9f10-478d-8f97-302e866721b7 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:55.720079 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4a1ab04e-9f10-478d-8f97-302e866721b7 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:55.725333 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4a1ab04e-9f10-478d-8f97-302e866721b7 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] 10.222.0.52 "GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d" status: 200 len: 1437 microversion: 2.75 time: 0.167993 Oct 19 03:14:55.726570 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 410/797] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:55 2022] GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d => generated 1437 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:14:55.733061 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b571a6b3-d9af-4f28-bd78-975dea8c4f1e tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:55.734709 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b571a6b3-d9af-4f28-bd78-975dea8c4f1e tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 393853e1-5f67-4c6b-972d-9f76de928599] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:55.741731 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b571a6b3-d9af-4f28-bd78-975dea8c4f1e tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:55.742541 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b571a6b3-d9af-4f28-bd78-975dea8c4f1e tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:55.743364 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b571a6b3-d9af-4f28-bd78-975dea8c4f1e tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:55.745150 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b571a6b3-d9af-4f28-bd78-975dea8c4f1e tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:55.745904 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b571a6b3-d9af-4f28-bd78-975dea8c4f1e tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:55.746564 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b571a6b3-d9af-4f28-bd78-975dea8c4f1e tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:55.812156 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=22 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:14:55.976868 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b571a6b3-d9af-4f28-bd78-975dea8c4f1e tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:55.987481 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b571a6b3-d9af-4f28-bd78-975dea8c4f1e tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/393853e1-5f67-4c6b-972d-9f76de928599" status: 200 len: 1317 microversion: 2.1 time: 0.259557 Oct 19 03:14:56.001953 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 411/798] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:55 2022] GET /compute/v2.1/servers/393853e1-5f67-4c6b-972d-9f76de928599 => generated 1317 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:14:56.008816 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1c979ca5-01d0-4a9d-881a-a867ea34f65d tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:56.009654 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1c979ca5-01d0-4a9d-881a-a867ea34f65d tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] [instance: f603dfa8-a2e6-4018-aaeb-639bf5eb24c6] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:56.016493 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1c979ca5-01d0-4a9d-881a-a867ea34f65d tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:56.017133 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1c979ca5-01d0-4a9d-881a-a867ea34f65d tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:56.017723 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1c979ca5-01d0-4a9d-881a-a867ea34f65d tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:56.018540 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1c979ca5-01d0-4a9d-881a-a867ea34f65d tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:56.019107 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1c979ca5-01d0-4a9d-881a-a867ea34f65d tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:56.019646 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1c979ca5-01d0-4a9d-881a-a867ea34f65d tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:56.219944 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-1c979ca5-01d0-4a9d-881a-a867ea34f65d tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2339bd95b0489ab4ae457b3cd072d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446866ac21894411965aedd84ceeb8bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:56.228577 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1c979ca5-01d0-4a9d-881a-a867ea34f65d tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] 10.222.0.52 "GET /compute/v2.1/servers/f603dfa8-a2e6-4018-aaeb-639bf5eb24c6" status: 200 len: 1471 microversion: 2.1 time: 0.225432 Oct 19 03:14:56.249549 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 412/799] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:56 2022] GET /compute/v2.1/servers/f603dfa8-a2e6-4018-aaeb-639bf5eb24c6 => generated 1471 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:14:56.379140 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d6427a7c-5bf9-462f-92c7-a500ae762a38 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:14:56.382779 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d6427a7c-5bf9-462f-92c7-a500ae762a38 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] [instance: d50976fb-756b-4b12-92f2-cedf87df492d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:56.389786 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d6427a7c-5bf9-462f-92c7-a500ae762a38 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:56.390711 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d6427a7c-5bf9-462f-92c7-a500ae762a38 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:56.391205 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d6427a7c-5bf9-462f-92c7-a500ae762a38 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:56.392088 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d6427a7c-5bf9-462f-92c7-a500ae762a38 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:56.392956 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d6427a7c-5bf9-462f-92c7-a500ae762a38 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:56.393580 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d6427a7c-5bf9-462f-92c7-a500ae762a38 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:56.484382 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-d6427a7c-5bf9-462f-92c7-a500ae762a38 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Flavor limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:14:56.484813 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-d6427a7c-5bf9-462f-92c7-a500ae762a38 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Image limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:14:56.485292 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-d6427a7c-5bf9-462f-92c7-a500ae762a38 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Flavor pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:14:56.485905 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-d6427a7c-5bf9-462f-92c7-a500ae762a38 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Image pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:14:56.486326 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-d6427a7c-5bf9-462f-92c7-a500ae762a38 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:14:56.703729 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d6427a7c-5bf9-462f-92c7-a500ae762a38 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] [instance: d50976fb-756b-4b12-92f2-cedf87df492d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:56.720773 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d6427a7c-5bf9-462f-92c7-a500ae762a38 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:56.721511 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d6427a7c-5bf9-462f-92c7-a500ae762a38 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:56.721851 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d6427a7c-5bf9-462f-92c7-a500ae762a38 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:56.722573 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d6427a7c-5bf9-462f-92c7-a500ae762a38 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:56.723030 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d6427a7c-5bf9-462f-92c7-a500ae762a38 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:56.723457 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d6427a7c-5bf9-462f-92c7-a500ae762a38 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:56.728199 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:14:56.804572 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-d6427a7c-5bf9-462f-92c7-a500ae762a38 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lazy-loading 'services' on Instance uuid d50976fb-756b-4b12-92f2-cedf87df492d {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:14:56.827970 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d6427a7c-5bf9-462f-92c7-a500ae762a38 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d/action" status: 202 len: 1940 microversion: 2.75 time: 0.576735 Oct 19 03:14:56.828641 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 413/800] 10.222.0.52 () {62 vars in 1319 bytes} [Wed Oct 19 03:14:56 2022] POST /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d/action => generated 1940 bytes in 578 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 19 03:14:56.833845 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-60649219-40be-4fb0-b705-e7c20c5bdd42 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:56.834330 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-60649219-40be-4fb0-b705-e7c20c5bdd42 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] [instance: 540a7025-b935-49fb-bc51-edf44ac1e0c4] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:56.847095 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-60649219-40be-4fb0-b705-e7c20c5bdd42 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:56.847681 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-60649219-40be-4fb0-b705-e7c20c5bdd42 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:56.848349 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-60649219-40be-4fb0-b705-e7c20c5bdd42 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:56.859460 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-60649219-40be-4fb0-b705-e7c20c5bdd42 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:56.859460 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-60649219-40be-4fb0-b705-e7c20c5bdd42 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:56.859460 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-60649219-40be-4fb0-b705-e7c20c5bdd42 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:56.993107 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-60649219-40be-4fb0-b705-e7c20c5bdd42 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28072a54d5934ea28e7d3205841c0852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c12a432bbd43bd8f70ba6e941c28a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:57.001548 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-60649219-40be-4fb0-b705-e7c20c5bdd42 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] 10.222.0.52 "GET /compute/v2.1/servers/540a7025-b935-49fb-bc51-edf44ac1e0c4" status: 200 len: 1366 microversion: 2.1 time: 0.171874 Oct 19 03:14:57.002117 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 414/801] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:56 2022] GET /compute/v2.1/servers/540a7025-b935-49fb-bc51-edf44ac1e0c4 => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:14:57.006612 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-661fcfdf-aded-4fef-bd86-3a0205ced2d7 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:57.007257 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-661fcfdf-aded-4fef-bd86-3a0205ced2d7 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] [instance: 6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:57.013804 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-661fcfdf-aded-4fef-bd86-3a0205ced2d7 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:57.014293 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-661fcfdf-aded-4fef-bd86-3a0205ced2d7 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:57.014767 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-661fcfdf-aded-4fef-bd86-3a0205ced2d7 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:57.015463 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-661fcfdf-aded-4fef-bd86-3a0205ced2d7 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:57.015920 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-661fcfdf-aded-4fef-bd86-3a0205ced2d7 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:57.016348 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-661fcfdf-aded-4fef-bd86-3a0205ced2d7 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:57.142671 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-661fcfdf-aded-4fef-bd86-3a0205ced2d7 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cc37ae4bed94a7e85ed70dd5942c2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df99b134b20743eb9b62788706f2705a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:57.150692 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-661fcfdf-aded-4fef-bd86-3a0205ced2d7 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] 10.222.0.52 "GET /compute/v2.1/servers/6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1" status: 200 len: 1388 microversion: 2.1 time: 0.147619 Oct 19 03:14:57.151264 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 415/802] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:57 2022] GET /compute/v2.1/servers/6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1 => generated 1388 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:14:57.155755 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6671fd22-41d2-4aee-8807-f81c7f0cf051 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:57.156354 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6671fd22-41d2-4aee-8807-f81c7f0cf051 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:57.162272 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6671fd22-41d2-4aee-8807-f81c7f0cf051 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:57.162779 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6671fd22-41d2-4aee-8807-f81c7f0cf051 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:57.163320 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6671fd22-41d2-4aee-8807-f81c7f0cf051 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:57.164029 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6671fd22-41d2-4aee-8807-f81c7f0cf051 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:57.164614 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6671fd22-41d2-4aee-8807-f81c7f0cf051 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:57.165054 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6671fd22-41d2-4aee-8807-f81c7f0cf051 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:57.228691 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-6671fd22-41d2-4aee-8807-f81c7f0cf051 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:57.236789 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-6671fd22-41d2-4aee-8807-f81c7f0cf051 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:57.238271 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-6671fd22-41d2-4aee-8807-f81c7f0cf051 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:57.243279 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6671fd22-41d2-4aee-8807-f81c7f0cf051 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1555 microversion: 2.91 time: 0.091007 Oct 19 03:14:57.243793 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 416/803] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:57 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1555 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:14:57.248703 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-cffa2f6a-be86-484a-92a8-26844de227df tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:57.249207 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-cffa2f6a-be86-484a-92a8-26844de227df tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] [instance: f603dfa8-a2e6-4018-aaeb-639bf5eb24c6] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:57.254757 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cffa2f6a-be86-484a-92a8-26844de227df tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:57.255248 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cffa2f6a-be86-484a-92a8-26844de227df tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:57.255690 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cffa2f6a-be86-484a-92a8-26844de227df tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:57.256387 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cffa2f6a-be86-484a-92a8-26844de227df tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:57.256847 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cffa2f6a-be86-484a-92a8-26844de227df tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:57.257281 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cffa2f6a-be86-484a-92a8-26844de227df tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:57.279924 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-cffa2f6a-be86-484a-92a8-26844de227df tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '6a2339bd95b0489ab4ae457b3cd072d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446866ac21894411965aedd84ceeb8bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:57.281807 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-cffa2f6a-be86-484a-92a8-26844de227df tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Request method failure captured: Oct 19 03:14:57.281807 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/f603dfa8-a2e6-4018-aaeb-639bf5eb24c6/diagnostics HTTP/1.1 Oct 19 03:14:57.281807 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:14:57.281807 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:14:57.281807 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:14:57.281807 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:14:57.281807 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:14:57.281807 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:14:57.281807 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:14:57.281807 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:14:57.281807 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2ua6kDuC8H3A7wkshnEZXRJ1MVvFlOa251_XplsVnJVpL3nHHU-psdQshicJFN3g4qtz4CSVsww6FQvekM-6hkKsLf5LwmLz9o9138ygAd0pLhuVXx1G8upk3oFX6rtkDeGEIcK1v6QiY9eDwRHTvMCzUO1qsh5h8e_QVXIns1kkz0 Oct 19 03:14:57.281807 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:14:57.281807 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:14:57.281807 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:14:57.281807 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:14:57.281807 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:14:57.281807 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:14:57.281807 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 446866ac21894411965aedd84ceeb8bc Oct 19 03:14:57.281807 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-853356359 Oct 19 03:14:57.281807 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:14:57.281807 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:14:57.283433 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/446866ac21894411965aedd84ceeb8bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/446866ac21894411965aedd84ceeb8bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/446866ac21894411965aedd84ceeb8bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_446866ac21894411965aedd84ceeb8bc", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:14:57.283433 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-853356359 Oct 19 03:14:57.283433 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 446866ac21894411965aedd84ceeb8bc Oct 19 03:14:57.283433 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-853356359 Oct 19 03:14:57.283433 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ServerDiagnosticsNegativeTest-853356359-project Oct 19 03:14:57.283433 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:14:57.283433 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:14:57.283433 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 6a2339bd95b0489ab4ae457b3cd072d5 Oct 19 03:14:57.283433 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-853356359-project Oct 19 03:14:57.283433 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:14:57.283433 n-d-861333-8 devstack@n-api.service[121135]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 19 03:14:57.284272 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'server_id': 'f603dfa8-a2e6-4018-aaeb-639bf5eb24c6'} Oct 19 03:14:57.284272 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:14:57.284272 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:14:57.284272 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:14:57.284272 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:14:57.284272 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:14:57.284272 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:14:57.284272 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:14:57.284272 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:14:57.284272 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Oct 19 03:14:57.284272 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Oct 19 03:14:57.284272 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 19 03:14:57.284272 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 19 03:14:57.284272 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 19 03:14:57.284272 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 19 03:14:57.284272 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 03:14:57.284272 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 03:14:57.284272 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 03:14:57.284272 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 03:14:57.284272 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 19 03:14:57.285762 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 19 03:14:57.285762 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 19 03:14:57.285762 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 19 03:14:57.285762 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 19 03:14:57.285762 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 19 03:14:57.285762 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 19 03:14:57.285762 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:14:57.285762 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:14:57.285762 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:14:57.285762 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:14:57.285762 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:14:57.285762 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:14:57.285762 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 19 03:14:57.285762 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 19 03:14:57.285762 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 19 03:14:57.285762 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:14:57.285762 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-cffa2f6a-be86-484a-92a8-26844de227df tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:14:57.287451 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-cffa2f6a-be86-484a-92a8-26844de227df tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] 10.222.0.52 "GET /compute/v2.1/servers/f603dfa8-a2e6-4018-aaeb-639bf5eb24c6/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.038477 Oct 19 03:14:57.287451 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 417/804] 10.222.0.52 () {58 vars in 1272 bytes} [Wed Oct 19 03:14:57 2022] GET /compute/v2.1/servers/f603dfa8-a2e6-4018-aaeb-639bf5eb24c6/diagnostics => generated 117 bytes in 39 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:14:57.290643 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-37cbd336-8c79-4a36-b03b-66f7f26f87cc req-df480a3a-bbdc-4723-9731-ab01d0f6a8a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "393853e1-5f67-4c6b-972d-9f76de928599", "tag": "d5510f98-8a30-4512-b93a-37d0c22020ba"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:14:57.300997 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-37cbd336-8c79-4a36-b03b-66f7f26f87cc req-df480a3a-bbdc-4723-9731-ab01d0f6a8a7 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:57.301505 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-37cbd336-8c79-4a36-b03b-66f7f26f87cc req-df480a3a-bbdc-4723-9731-ab01d0f6a8a7 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:57.303988 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-37cbd336-8c79-4a36-b03b-66f7f26f87cc req-df480a3a-bbdc-4723-9731-ab01d0f6a8a7 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:57.313486 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-37cbd336-8c79-4a36-b03b-66f7f26f87cc req-df480a3a-bbdc-4723-9731-ab01d0f6a8a7 service nova] Creating event network-changed:d5510f98-8a30-4512-b93a-37d0c22020ba for instance 393853e1-5f67-4c6b-972d-9f76de928599 on n-h2-861333-8 Oct 19 03:14:57.318276 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-37cbd336-8c79-4a36-b03b-66f7f26f87cc req-df480a3a-bbdc-4723-9731-ab01d0f6a8a7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033513 Oct 19 03:14:57.318867 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 418/805] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:14:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:14:57.325525 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-85d5ba71-1185-4d02-b71d-dc068607727e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:57.326276 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-85d5ba71-1185-4d02-b71d-dc068607727e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:57.332778 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-85d5ba71-1185-4d02-b71d-dc068607727e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:57.333237 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-85d5ba71-1185-4d02-b71d-dc068607727e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:57.333793 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-85d5ba71-1185-4d02-b71d-dc068607727e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:57.334390 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-85d5ba71-1185-4d02-b71d-dc068607727e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:57.334843 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-85d5ba71-1185-4d02-b71d-dc068607727e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:57.335308 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-85d5ba71-1185-4d02-b71d-dc068607727e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:57.556413 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-85d5ba71-1185-4d02-b71d-dc068607727e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:57.565554 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-85d5ba71-1185-4d02-b71d-dc068607727e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667" status: 200 len: 1475 microversion: 2.1 time: 0.243971 Oct 19 03:14:57.566139 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 419/806] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:57 2022] GET /compute/v2.1/servers/ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667 => generated 1475 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:14:57.571607 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e1d92b46-4329-4ea9-a12a-be2777f90041 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:57.572234 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e1d92b46-4329-4ea9-a12a-be2777f90041 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] [instance: d50976fb-756b-4b12-92f2-cedf87df492d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:57.598777 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e1d92b46-4329-4ea9-a12a-be2777f90041 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:57.598777 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e1d92b46-4329-4ea9-a12a-be2777f90041 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:57.599053 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e1d92b46-4329-4ea9-a12a-be2777f90041 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:57.599816 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e1d92b46-4329-4ea9-a12a-be2777f90041 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:57.600287 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e1d92b46-4329-4ea9-a12a-be2777f90041 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:57.600723 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e1d92b46-4329-4ea9-a12a-be2777f90041 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:57.723749 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-e1d92b46-4329-4ea9-a12a-be2777f90041 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lazy-loading 'services' on Instance uuid d50976fb-756b-4b12-92f2-cedf87df492d {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:14:57.743972 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e1d92b46-4329-4ea9-a12a-be2777f90041 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d" status: 200 len: 1927 microversion: 2.75 time: 0.176778 Oct 19 03:14:57.744941 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 420/807] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:57 2022] GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d => generated 1927 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:14:57.752588 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9c56a15e-1583-40af-a71f-42dc71c386a3 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:57.753297 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9c56a15e-1583-40af-a71f-42dc71c386a3 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 393853e1-5f67-4c6b-972d-9f76de928599] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:57.771318 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9c56a15e-1583-40af-a71f-42dc71c386a3 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:57.774678 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9c56a15e-1583-40af-a71f-42dc71c386a3 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:57.775880 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9c56a15e-1583-40af-a71f-42dc71c386a3 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:57.776788 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9c56a15e-1583-40af-a71f-42dc71c386a3 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:57.777552 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9c56a15e-1583-40af-a71f-42dc71c386a3 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:57.778162 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9c56a15e-1583-40af-a71f-42dc71c386a3 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:57.956143 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-9c56a15e-1583-40af-a71f-42dc71c386a3 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:57.965206 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9c56a15e-1583-40af-a71f-42dc71c386a3 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/393853e1-5f67-4c6b-972d-9f76de928599" status: 200 len: 1317 microversion: 2.1 time: 0.217714 Oct 19 03:14:57.967064 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 421/808] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:57 2022] GET /compute/v2.1/servers/393853e1-5f67-4c6b-972d-9f76de928599 => generated 1317 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:14:57.972295 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-00726f77-7a80-48e4-bae5-46de6b50ff66 tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:57.972914 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-00726f77-7a80-48e4-bae5-46de6b50ff66 tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] [instance: f603dfa8-a2e6-4018-aaeb-639bf5eb24c6] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:57.979526 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-00726f77-7a80-48e4-bae5-46de6b50ff66 tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:57.981625 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-00726f77-7a80-48e4-bae5-46de6b50ff66 tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:57.981625 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-00726f77-7a80-48e4-bae5-46de6b50ff66 tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:57.983140 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-00726f77-7a80-48e4-bae5-46de6b50ff66 tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:57.983140 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-00726f77-7a80-48e4-bae5-46de6b50ff66 tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:57.983140 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-00726f77-7a80-48e4-bae5-46de6b50ff66 tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:58.012308 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-00726f77-7a80-48e4-bae5-46de6b50ff66 tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] [instance: f603dfa8-a2e6-4018-aaeb-639bf5eb24c6] Going to try to terminate instance {{(pid=121135) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:14:58.347070 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-00726f77-7a80-48e4-bae5-46de6b50ff66 tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] 10.222.0.52 "DELETE /compute/v2.1/servers/f603dfa8-a2e6-4018-aaeb-639bf5eb24c6" status: 204 len: 0 microversion: 2.1 time: 0.378474 Oct 19 03:14:58.351820 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 422/809] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:14:57 2022] DELETE /compute/v2.1/servers/f603dfa8-a2e6-4018-aaeb-639bf5eb24c6 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:14:58.358287 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ab44d07d-1d84-4be8-8f23-0e1df4536ba6 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:58.359061 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ab44d07d-1d84-4be8-8f23-0e1df4536ba6 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] [instance: 540a7025-b935-49fb-bc51-edf44ac1e0c4] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:58.365749 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ab44d07d-1d84-4be8-8f23-0e1df4536ba6 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:58.366331 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ab44d07d-1d84-4be8-8f23-0e1df4536ba6 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:58.366737 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ab44d07d-1d84-4be8-8f23-0e1df4536ba6 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:58.367450 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ab44d07d-1d84-4be8-8f23-0e1df4536ba6 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:58.367903 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ab44d07d-1d84-4be8-8f23-0e1df4536ba6 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:58.368334 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ab44d07d-1d84-4be8-8f23-0e1df4536ba6 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:58.636945 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ab44d07d-1d84-4be8-8f23-0e1df4536ba6 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28072a54d5934ea28e7d3205841c0852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c12a432bbd43bd8f70ba6e941c28a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:58.645532 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ab44d07d-1d84-4be8-8f23-0e1df4536ba6 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] 10.222.0.52 "GET /compute/v2.1/servers/540a7025-b935-49fb-bc51-edf44ac1e0c4" status: 200 len: 1366 microversion: 2.1 time: 0.292337 Oct 19 03:14:58.646361 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 423/810] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:58 2022] GET /compute/v2.1/servers/540a7025-b935-49fb-bc51-edf44ac1e0c4 => generated 1366 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:14:58.651133 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-8d931a21-a740-49b8-8e4b-28be928ccb75 req-056acfad-f8e1-45ea-8ea3-b7554b6c4b8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667", "name": "network-vif-unplugged", "status": "completed", "tag": "93027c05-97a2-4189-89b6-b07e9d59b6c4"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:14:58.664977 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-8d931a21-a740-49b8-8e4b-28be928ccb75 req-056acfad-f8e1-45ea-8ea3-b7554b6c4b8b service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:58.665922 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-8d931a21-a740-49b8-8e4b-28be928ccb75 req-056acfad-f8e1-45ea-8ea3-b7554b6c4b8b service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:58.666171 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-8d931a21-a740-49b8-8e4b-28be928ccb75 req-056acfad-f8e1-45ea-8ea3-b7554b6c4b8b service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:58.681999 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-8d931a21-a740-49b8-8e4b-28be928ccb75 req-056acfad-f8e1-45ea-8ea3-b7554b6c4b8b service nova] Creating event network-vif-unplugged:93027c05-97a2-4189-89b6-b07e9d59b6c4 for instance ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667 on n-h1-861333-8 Oct 19 03:14:58.688677 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [req-8d931a21-a740-49b8-8e4b-28be928ccb75 req-056acfad-f8e1-45ea-8ea3-b7554b6c4b8b service nova] Instance ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-861333-8', 'n-h1-861333-8'} {{(pid=121135) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 03:14:58.701692 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-8d931a21-a740-49b8-8e4b-28be928ccb75 req-056acfad-f8e1-45ea-8ea3-b7554b6c4b8b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054003 Oct 19 03:14:58.709139 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 424/811] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:14:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:14:58.710997 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0782ee42-044a-4153-998a-693d0accf5ae tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:58.711809 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0782ee42-044a-4153-998a-693d0accf5ae tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] [instance: 6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:58.720060 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0782ee42-044a-4153-998a-693d0accf5ae tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:58.721135 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0782ee42-044a-4153-998a-693d0accf5ae tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:58.721838 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0782ee42-044a-4153-998a-693d0accf5ae tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:58.722783 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0782ee42-044a-4153-998a-693d0accf5ae tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:58.723477 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0782ee42-044a-4153-998a-693d0accf5ae tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:58.724035 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0782ee42-044a-4153-998a-693d0accf5ae tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:58.902856 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-0782ee42-044a-4153-998a-693d0accf5ae tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cc37ae4bed94a7e85ed70dd5942c2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df99b134b20743eb9b62788706f2705a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:58.930680 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0782ee42-044a-4153-998a-693d0accf5ae tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] 10.222.0.52 "GET /compute/v2.1/servers/6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1" status: 200 len: 1388 microversion: 2.1 time: 0.225664 Oct 19 03:14:58.931300 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 425/812] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:58 2022] GET /compute/v2.1/servers/6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1 => generated 1388 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:14:58.938595 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-73e02337-c2b0-4237-9627-738671c2b43f tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:58.939201 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-73e02337-c2b0-4237-9627-738671c2b43f tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:58.950292 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-73e02337-c2b0-4237-9627-738671c2b43f tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:58.950857 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-73e02337-c2b0-4237-9627-738671c2b43f tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:58.951228 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-73e02337-c2b0-4237-9627-738671c2b43f tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:58.951937 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-73e02337-c2b0-4237-9627-738671c2b43f tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:58.952387 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-73e02337-c2b0-4237-9627-738671c2b43f tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:58.952818 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-73e02337-c2b0-4237-9627-738671c2b43f tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:59.044205 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-73e02337-c2b0-4237-9627-738671c2b43f tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:59.055658 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-73e02337-c2b0-4237-9627-738671c2b43f tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:59.057813 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-73e02337-c2b0-4237-9627-738671c2b43f tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:59.063459 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-73e02337-c2b0-4237-9627-738671c2b43f tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1555 microversion: 2.91 time: 0.131166 Oct 19 03:14:59.064338 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 426/813] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:58 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1555 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:14:59.071147 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-abdaa7ac-a43e-4173-acda-66c8be4792a0 tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:59.071911 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-abdaa7ac-a43e-4173-acda-66c8be4792a0 tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] [instance: f603dfa8-a2e6-4018-aaeb-639bf5eb24c6] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:59.079412 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:14:59.080976 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-abdaa7ac-a43e-4173-acda-66c8be4792a0 tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:59.081494 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-abdaa7ac-a43e-4173-acda-66c8be4792a0 tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:59.081937 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-abdaa7ac-a43e-4173-acda-66c8be4792a0 tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:59.082640 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-abdaa7ac-a43e-4173-acda-66c8be4792a0 tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:59.083102 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-abdaa7ac-a43e-4173-acda-66c8be4792a0 tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:59.083515 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-abdaa7ac-a43e-4173-acda-66c8be4792a0 tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:59.242134 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-abdaa7ac-a43e-4173-acda-66c8be4792a0 tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2339bd95b0489ab4ae457b3cd072d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446866ac21894411965aedd84ceeb8bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:59.252156 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-abdaa7ac-a43e-4173-acda-66c8be4792a0 tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] 10.222.0.52 "GET /compute/v2.1/servers/f603dfa8-a2e6-4018-aaeb-639bf5eb24c6" status: 200 len: 1477 microversion: 2.1 time: 0.186762 Oct 19 03:14:59.256080 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 427/814] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:59 2022] GET /compute/v2.1/servers/f603dfa8-a2e6-4018-aaeb-639bf5eb24c6 => generated 1477 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:14:59.266897 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-510273b7-48b8-4b63-9abe-567c446c8045 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:59.266897 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-510273b7-48b8-4b63-9abe-567c446c8045 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:59.277110 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-510273b7-48b8-4b63-9abe-567c446c8045 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:59.277764 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-510273b7-48b8-4b63-9abe-567c446c8045 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:59.278215 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-510273b7-48b8-4b63-9abe-567c446c8045 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:59.278926 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-510273b7-48b8-4b63-9abe-567c446c8045 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:59.279388 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-510273b7-48b8-4b63-9abe-567c446c8045 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:59.279817 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-510273b7-48b8-4b63-9abe-567c446c8045 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:59.440485 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-510273b7-48b8-4b63-9abe-567c446c8045 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:14:59.443419 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:14:59.451142 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-510273b7-48b8-4b63-9abe-567c446c8045 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667" status: 200 len: 1475 microversion: 2.1 time: 0.193928 Oct 19 03:14:59.463406 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 428/815] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:59 2022] GET /compute/v2.1/servers/ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667 => generated 1475 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:14:59.478651 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-be03e051-713d-497c-a19d-427b437a5b34 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:59.479718 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-be03e051-713d-497c-a19d-427b437a5b34 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] [instance: d50976fb-756b-4b12-92f2-cedf87df492d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:59.491827 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-be03e051-713d-497c-a19d-427b437a5b34 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:59.492329 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-be03e051-713d-497c-a19d-427b437a5b34 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:59.492817 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-be03e051-713d-497c-a19d-427b437a5b34 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:59.493565 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-be03e051-713d-497c-a19d-427b437a5b34 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:59.494060 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-be03e051-713d-497c-a19d-427b437a5b34 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:59.494447 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-be03e051-713d-497c-a19d-427b437a5b34 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:59.583559 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-be03e051-713d-497c-a19d-427b437a5b34 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lazy-loading 'services' on Instance uuid d50976fb-756b-4b12-92f2-cedf87df492d {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:14:59.635639 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-be03e051-713d-497c-a19d-427b437a5b34 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d" status: 200 len: 1927 microversion: 2.75 time: 0.169738 Oct 19 03:14:59.652265 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 429/816] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:14:59 2022] GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d => generated 1927 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:14:59.661451 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c7753aff-7a43-4b8d-a2d5-a54ed4d57cd8 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:14:59.671181 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c7753aff-7a43-4b8d-a2d5-a54ed4d57cd8 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 393853e1-5f67-4c6b-972d-9f76de928599] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:14:59.679504 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c7753aff-7a43-4b8d-a2d5-a54ed4d57cd8 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:59.680405 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c7753aff-7a43-4b8d-a2d5-a54ed4d57cd8 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:59.681149 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c7753aff-7a43-4b8d-a2d5-a54ed4d57cd8 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:59.682223 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c7753aff-7a43-4b8d-a2d5-a54ed4d57cd8 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:14:59.682799 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c7753aff-7a43-4b8d-a2d5-a54ed4d57cd8 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:14:59.684229 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c7753aff-7a43-4b8d-a2d5-a54ed4d57cd8 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:14:59.955234 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=8 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:15:00.045470 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c7753aff-7a43-4b8d-a2d5-a54ed4d57cd8 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:00.053167 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c7753aff-7a43-4b8d-a2d5-a54ed4d57cd8 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/393853e1-5f67-4c6b-972d-9f76de928599" status: 200 len: 1317 microversion: 2.1 time: 0.400222 Oct 19 03:15:00.069511 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 430/817] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:14:59 2022] GET /compute/v2.1/servers/393853e1-5f67-4c6b-972d-9f76de928599 => generated 1317 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:15:00.070625 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d87f3b84-a9fa-46e0-b810-bcbc4561681e tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:00.071238 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d87f3b84-a9fa-46e0-b810-bcbc4561681e tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] [instance: 540a7025-b935-49fb-bc51-edf44ac1e0c4] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:00.086383 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d87f3b84-a9fa-46e0-b810-bcbc4561681e tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:00.087206 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d87f3b84-a9fa-46e0-b810-bcbc4561681e tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:00.087647 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d87f3b84-a9fa-46e0-b810-bcbc4561681e tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:00.088350 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d87f3b84-a9fa-46e0-b810-bcbc4561681e tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:00.089514 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d87f3b84-a9fa-46e0-b810-bcbc4561681e tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:00.089514 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d87f3b84-a9fa-46e0-b810-bcbc4561681e tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:00.422271 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d87f3b84-a9fa-46e0-b810-bcbc4561681e tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28072a54d5934ea28e7d3205841c0852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c12a432bbd43bd8f70ba6e941c28a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:00.430080 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d87f3b84-a9fa-46e0-b810-bcbc4561681e tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] 10.222.0.52 "GET /compute/v2.1/servers/540a7025-b935-49fb-bc51-edf44ac1e0c4" status: 200 len: 1366 microversion: 2.1 time: 0.363110 Oct 19 03:15:00.430669 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 431/818] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:00 2022] GET /compute/v2.1/servers/540a7025-b935-49fb-bc51-edf44ac1e0c4 => generated 1366 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:15:00.451029 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f57127e9-5e63-40b5-87c4-e6fe8afba139 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:00.451697 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f57127e9-5e63-40b5-87c4-e6fe8afba139 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] [instance: 6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:00.462498 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f57127e9-5e63-40b5-87c4-e6fe8afba139 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:00.462498 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f57127e9-5e63-40b5-87c4-e6fe8afba139 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:00.462498 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f57127e9-5e63-40b5-87c4-e6fe8afba139 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:00.463156 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f57127e9-5e63-40b5-87c4-e6fe8afba139 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:00.467328 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f57127e9-5e63-40b5-87c4-e6fe8afba139 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:00.467817 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f57127e9-5e63-40b5-87c4-e6fe8afba139 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:00.719165 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f57127e9-5e63-40b5-87c4-e6fe8afba139 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cc37ae4bed94a7e85ed70dd5942c2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df99b134b20743eb9b62788706f2705a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:00.730421 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f57127e9-5e63-40b5-87c4-e6fe8afba139 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] 10.222.0.52 "GET /compute/v2.1/servers/6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1" status: 200 len: 1388 microversion: 2.1 time: 0.283771 Oct 19 03:15:00.736408 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 432/819] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:00 2022] GET /compute/v2.1/servers/6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1 => generated 1388 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:15:00.742108 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4e024430-2075-4387-b4cf-cacb6f65a7d9 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:00.754738 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4e024430-2075-4387-b4cf-cacb6f65a7d9 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:00.772736 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4e024430-2075-4387-b4cf-cacb6f65a7d9 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:00.773849 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4e024430-2075-4387-b4cf-cacb6f65a7d9 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:00.774597 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4e024430-2075-4387-b4cf-cacb6f65a7d9 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:00.779912 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4e024430-2075-4387-b4cf-cacb6f65a7d9 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:00.779912 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4e024430-2075-4387-b4cf-cacb6f65a7d9 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:00.779912 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4e024430-2075-4387-b4cf-cacb6f65a7d9 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:00.852773 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4e024430-2075-4387-b4cf-cacb6f65a7d9 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:00.863504 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4e024430-2075-4387-b4cf-cacb6f65a7d9 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:00.867055 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4e024430-2075-4387-b4cf-cacb6f65a7d9 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:00.872380 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4e024430-2075-4387-b4cf-cacb6f65a7d9 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1555 microversion: 2.91 time: 0.134631 Oct 19 03:15:00.873607 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 433/820] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:00 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1555 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:15:00.878788 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-317956ae-1f89-4885-b7a3-711f064f1299 tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:00.879657 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-317956ae-1f89-4885-b7a3-711f064f1299 tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] [instance: f603dfa8-a2e6-4018-aaeb-639bf5eb24c6] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:00.927690 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-317956ae-1f89-4885-b7a3-711f064f1299 tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:00.928204 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-317956ae-1f89-4885-b7a3-711f064f1299 tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:00.928652 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-317956ae-1f89-4885-b7a3-711f064f1299 tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:00.929407 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-317956ae-1f89-4885-b7a3-711f064f1299 tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:00.930634 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-317956ae-1f89-4885-b7a3-711f064f1299 tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:00.931125 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-317956ae-1f89-4885-b7a3-711f064f1299 tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:01.033419 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-317956ae-1f89-4885-b7a3-711f064f1299 tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2339bd95b0489ab4ae457b3cd072d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446866ac21894411965aedd84ceeb8bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:01.044740 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-317956ae-1f89-4885-b7a3-711f064f1299 tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] 10.222.0.52 "GET /compute/v2.1/servers/f603dfa8-a2e6-4018-aaeb-639bf5eb24c6" status: 200 len: 1435 microversion: 2.1 time: 0.169856 Oct 19 03:15:01.061916 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 434/821] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:00 2022] GET /compute/v2.1/servers/f603dfa8-a2e6-4018-aaeb-639bf5eb24c6 => generated 1435 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:15:01.066013 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f48213be-9c5d-4c17-8293-22ba9dcdbb1e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:01.066647 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f48213be-9c5d-4c17-8293-22ba9dcdbb1e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:01.073072 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f48213be-9c5d-4c17-8293-22ba9dcdbb1e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:01.073622 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f48213be-9c5d-4c17-8293-22ba9dcdbb1e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:01.074372 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f48213be-9c5d-4c17-8293-22ba9dcdbb1e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:01.075105 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f48213be-9c5d-4c17-8293-22ba9dcdbb1e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:01.075564 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f48213be-9c5d-4c17-8293-22ba9dcdbb1e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:01.076295 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f48213be-9c5d-4c17-8293-22ba9dcdbb1e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:01.229108 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f48213be-9c5d-4c17-8293-22ba9dcdbb1e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:01.237631 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f48213be-9c5d-4c17-8293-22ba9dcdbb1e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667" status: 200 len: 1475 microversion: 2.1 time: 0.191157 Oct 19 03:15:01.238407 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 435/822] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:01 2022] GET /compute/v2.1/servers/ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667 => generated 1475 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:15:01.253645 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-175565bc-9a23-4ff9-bbf5-dec21f987c68 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:01.254397 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-175565bc-9a23-4ff9-bbf5-dec21f987c68 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] [instance: d50976fb-756b-4b12-92f2-cedf87df492d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:01.260747 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-175565bc-9a23-4ff9-bbf5-dec21f987c68 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:01.261622 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-175565bc-9a23-4ff9-bbf5-dec21f987c68 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:01.262102 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-175565bc-9a23-4ff9-bbf5-dec21f987c68 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:01.262857 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-175565bc-9a23-4ff9-bbf5-dec21f987c68 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:01.263336 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-175565bc-9a23-4ff9-bbf5-dec21f987c68 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:01.263756 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-175565bc-9a23-4ff9-bbf5-dec21f987c68 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:01.341856 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-175565bc-9a23-4ff9-bbf5-dec21f987c68 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lazy-loading 'services' on Instance uuid d50976fb-756b-4b12-92f2-cedf87df492d {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:15:01.360332 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-175565bc-9a23-4ff9-bbf5-dec21f987c68 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d" status: 200 len: 1927 microversion: 2.75 time: 0.110380 Oct 19 03:15:01.361109 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 436/823] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:01 2022] GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d => generated 1927 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:15:01.365618 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-7892912f-0513-4dc3-86ab-4c791d951cad req-21b76522-074c-4e13-95fd-c46282efa36f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667", "tag": "93027c05-97a2-4189-89b6-b07e9d59b6c4"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:15:01.375518 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-7892912f-0513-4dc3-86ab-4c791d951cad req-21b76522-074c-4e13-95fd-c46282efa36f service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:01.376046 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-7892912f-0513-4dc3-86ab-4c791d951cad req-21b76522-074c-4e13-95fd-c46282efa36f service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:01.376477 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-7892912f-0513-4dc3-86ab-4c791d951cad req-21b76522-074c-4e13-95fd-c46282efa36f service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:01.388142 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-7892912f-0513-4dc3-86ab-4c791d951cad req-21b76522-074c-4e13-95fd-c46282efa36f service nova] Creating event network-changed:93027c05-97a2-4189-89b6-b07e9d59b6c4 for instance ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667 on n-h1-861333-8 Oct 19 03:15:01.393536 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [req-7892912f-0513-4dc3-86ab-4c791d951cad req-21b76522-074c-4e13-95fd-c46282efa36f service nova] Instance ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-861333-8', 'n-h1-861333-8'} {{(pid=121135) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 03:15:01.404623 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-7892912f-0513-4dc3-86ab-4c791d951cad req-21b76522-074c-4e13-95fd-c46282efa36f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042454 Oct 19 03:15:01.405444 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 437/824] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:15:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:15:01.412638 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-40347655-d8ac-4993-861c-5f85395c0287 req-90d2c795-f9ff-447b-8731-27b974cc8473 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f603dfa8-a2e6-4018-aaeb-639bf5eb24c6", "name": "network-vif-deleted", "tag": "3e753133-013e-43f0-a278-9311e3115aa5"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:15:01.422970 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-40347655-d8ac-4993-861c-5f85395c0287 req-90d2c795-f9ff-447b-8731-27b974cc8473 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:01.423454 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-40347655-d8ac-4993-861c-5f85395c0287 req-90d2c795-f9ff-447b-8731-27b974cc8473 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:01.423915 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-40347655-d8ac-4993-861c-5f85395c0287 req-90d2c795-f9ff-447b-8731-27b974cc8473 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:01.434852 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-40347655-d8ac-4993-861c-5f85395c0287 req-90d2c795-f9ff-447b-8731-27b974cc8473 service nova] Creating event network-vif-deleted:3e753133-013e-43f0-a278-9311e3115aa5 for instance f603dfa8-a2e6-4018-aaeb-639bf5eb24c6 on n-h2-861333-8 Oct 19 03:15:01.441416 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-40347655-d8ac-4993-861c-5f85395c0287 req-90d2c795-f9ff-447b-8731-27b974cc8473 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032582 Oct 19 03:15:01.442085 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 438/825] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:15:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:15:01.447247 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-471161fa-d136-4660-b13e-ce6d1eb45e49 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:01.447948 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-471161fa-d136-4660-b13e-ce6d1eb45e49 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 393853e1-5f67-4c6b-972d-9f76de928599] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:01.455971 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-471161fa-d136-4660-b13e-ce6d1eb45e49 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:01.456478 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-471161fa-d136-4660-b13e-ce6d1eb45e49 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:01.456919 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-471161fa-d136-4660-b13e-ce6d1eb45e49 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:01.457650 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-471161fa-d136-4660-b13e-ce6d1eb45e49 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:01.458110 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-471161fa-d136-4660-b13e-ce6d1eb45e49 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:01.458537 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-471161fa-d136-4660-b13e-ce6d1eb45e49 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:01.730279 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-471161fa-d136-4660-b13e-ce6d1eb45e49 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:01.740575 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-471161fa-d136-4660-b13e-ce6d1eb45e49 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/393853e1-5f67-4c6b-972d-9f76de928599" status: 200 len: 1317 microversion: 2.1 time: 0.297218 Oct 19 03:15:01.758816 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 439/826] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:01 2022] GET /compute/v2.1/servers/393853e1-5f67-4c6b-972d-9f76de928599 => generated 1317 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:15:01.769793 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-161b3978-eba8-4c06-a2ec-d6fef1f89cca tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:01.770785 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-161b3978-eba8-4c06-a2ec-d6fef1f89cca tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] [instance: 540a7025-b935-49fb-bc51-edf44ac1e0c4] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:01.779160 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-161b3978-eba8-4c06-a2ec-d6fef1f89cca tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:01.780393 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-161b3978-eba8-4c06-a2ec-d6fef1f89cca tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:01.781035 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-161b3978-eba8-4c06-a2ec-d6fef1f89cca tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:01.781990 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-161b3978-eba8-4c06-a2ec-d6fef1f89cca tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:01.783093 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-161b3978-eba8-4c06-a2ec-d6fef1f89cca tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:01.783761 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-161b3978-eba8-4c06-a2ec-d6fef1f89cca tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:02.167151 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-161b3978-eba8-4c06-a2ec-d6fef1f89cca tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28072a54d5934ea28e7d3205841c0852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c12a432bbd43bd8f70ba6e941c28a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:02.189526 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-161b3978-eba8-4c06-a2ec-d6fef1f89cca tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] 10.222.0.52 "GET /compute/v2.1/servers/540a7025-b935-49fb-bc51-edf44ac1e0c4" status: 200 len: 1366 microversion: 2.1 time: 0.417275 Oct 19 03:15:02.189526 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 440/827] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:01 2022] GET /compute/v2.1/servers/540a7025-b935-49fb-bc51-edf44ac1e0c4 => generated 1366 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:15:02.191066 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f8554793-505b-4307-89f4-404f96c89c90 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:02.191672 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f8554793-505b-4307-89f4-404f96c89c90 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] [instance: 6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:02.210617 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f8554793-505b-4307-89f4-404f96c89c90 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:02.214188 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f8554793-505b-4307-89f4-404f96c89c90 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:02.214188 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f8554793-505b-4307-89f4-404f96c89c90 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:02.214188 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f8554793-505b-4307-89f4-404f96c89c90 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:02.215024 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f8554793-505b-4307-89f4-404f96c89c90 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:02.215024 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f8554793-505b-4307-89f4-404f96c89c90 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:02.841525 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f8554793-505b-4307-89f4-404f96c89c90 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cc37ae4bed94a7e85ed70dd5942c2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df99b134b20743eb9b62788706f2705a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:02.850102 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f8554793-505b-4307-89f4-404f96c89c90 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] 10.222.0.52 "GET /compute/v2.1/servers/6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1" status: 200 len: 1388 microversion: 2.1 time: 0.669628 Oct 19 03:15:02.852020 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 441/828] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:02 2022] GET /compute/v2.1/servers/6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1 => generated 1388 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:15:02.857405 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-70f4d649-e686-4623-b8ad-91f5e90b992c tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:02.858260 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-70f4d649-e686-4623-b8ad-91f5e90b992c tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:02.865529 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-70f4d649-e686-4623-b8ad-91f5e90b992c tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:02.866309 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-70f4d649-e686-4623-b8ad-91f5e90b992c tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:02.866945 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-70f4d649-e686-4623-b8ad-91f5e90b992c tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:02.867837 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-70f4d649-e686-4623-b8ad-91f5e90b992c tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:02.868487 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-70f4d649-e686-4623-b8ad-91f5e90b992c tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:02.868990 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-70f4d649-e686-4623-b8ad-91f5e90b992c tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:02.976496 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-70f4d649-e686-4623-b8ad-91f5e90b992c tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:02.988599 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-70f4d649-e686-4623-b8ad-91f5e90b992c tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:02.996205 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-70f4d649-e686-4623-b8ad-91f5e90b992c tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:03.006748 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-70f4d649-e686-4623-b8ad-91f5e90b992c tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1555 microversion: 2.91 time: 0.153430 Oct 19 03:15:03.009315 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 442/829] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:02 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1555 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:15:03.014680 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c0baada9-dd78-4f01-8803-fbd2c8407b37 tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:03.015872 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c0baada9-dd78-4f01-8803-fbd2c8407b37 tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] [instance: f603dfa8-a2e6-4018-aaeb-639bf5eb24c6] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:03.029962 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c0baada9-dd78-4f01-8803-fbd2c8407b37 tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:03.035021 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c0baada9-dd78-4f01-8803-fbd2c8407b37 tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:03.035021 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c0baada9-dd78-4f01-8803-fbd2c8407b37 tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:03.035021 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c0baada9-dd78-4f01-8803-fbd2c8407b37 tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:03.035021 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c0baada9-dd78-4f01-8803-fbd2c8407b37 tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:03.035371 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c0baada9-dd78-4f01-8803-fbd2c8407b37 tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:03.062793 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-c0baada9-dd78-4f01-8803-fbd2c8407b37 tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] HTTP exception thrown: Instance f603dfa8-a2e6-4018-aaeb-639bf5eb24c6 could not be found. Oct 19 03:15:03.064670 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c0baada9-dd78-4f01-8803-fbd2c8407b37 tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Request method failure captured: Oct 19 03:15:03.064670 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/f603dfa8-a2e6-4018-aaeb-639bf5eb24c6 HTTP/1.1 Oct 19 03:15:03.064670 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:15:03.064670 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:15:03.064670 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:15:03.064670 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:15:03.064670 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:15:03.064670 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:15:03.064670 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:15:03.064670 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:15:03.064670 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2ua6kDuC8H3A7wkshnEZXRJ1MVvFlOa251_XplsVnJVpL3nHHU-psdQshicJFN3g4qtz4CSVsww6FQvekM-6hkKsLf5LwmLz9o9138ygAd0pLhuVXx1G8upk3oFX6rtkDeGEIcK1v6QiY9eDwRHTvMCzUO1qsh5h8e_QVXIns1kkz0 Oct 19 03:15:03.064670 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:15:03.064670 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:15:03.064670 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:15:03.064670 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:15:03.064670 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:15:03.064670 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:15:03.064670 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 446866ac21894411965aedd84ceeb8bc Oct 19 03:15:03.064670 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-853356359 Oct 19 03:15:03.064670 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:15:03.064670 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:15:03.065985 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/446866ac21894411965aedd84ceeb8bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/446866ac21894411965aedd84ceeb8bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/446866ac21894411965aedd84ceeb8bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_446866ac21894411965aedd84ceeb8bc", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:15:03.065985 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-853356359 Oct 19 03:15:03.065985 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 446866ac21894411965aedd84ceeb8bc Oct 19 03:15:03.065985 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-853356359 Oct 19 03:15:03.065985 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ServerDiagnosticsNegativeTest-853356359-project Oct 19 03:15:03.065985 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:15:03.065985 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:15:03.065985 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 6a2339bd95b0489ab4ae457b3cd072d5 Oct 19 03:15:03.065985 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-853356359-project Oct 19 03:15:03.065985 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:15:03.065985 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance f603dfa8-a2e6-4018-aaeb-639bf5eb24c6 could not be found. Oct 19 03:15:03.065985 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': 'f603dfa8-a2e6-4018-aaeb-639bf5eb24c6'} Oct 19 03:15:03.066746 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:15:03.066746 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:15:03.066746 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:15:03.066746 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:15:03.066746 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:15:03.066746 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:15:03.066746 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:15:03.066746 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:15:03.066746 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:15:03.066746 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:15:03.066746 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f603dfa8-a2e6-4018-aaeb-639bf5eb24c6 could not be found. Oct 19 03:15:03.066746 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:15:03.066746 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:15:03.066746 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:15:03.066746 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:15:03.066746 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:15:03.066746 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:15:03.066746 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:15:03.066746 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:15:03.066746 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:15:03.068003 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:15:03.068003 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:15:03.068003 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:15:03.068003 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:15:03.068003 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:15:03.068003 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:15:03.068003 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:15:03.068003 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f603dfa8-a2e6-4018-aaeb-639bf5eb24c6 could not be found. Oct 19 03:15:03.068003 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:15:03.068003 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:15:03.068003 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:15:03.068003 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:15:03.068003 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:15:03.068003 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:15:03.068003 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:15:03.068003 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:15:03.068003 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f603dfa8-a2e6-4018-aaeb-639bf5eb24c6 could not be found. Oct 19 03:15:03.068003 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:15:03.069155 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c0baada9-dd78-4f01-8803-fbd2c8407b37 tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] Returning 404 to user: Instance f603dfa8-a2e6-4018-aaeb-639bf5eb24c6 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:15:03.069155 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c0baada9-dd78-4f01-8803-fbd2c8407b37 tempest-ServerDiagnosticsNegativeTest-853356359 tempest-ServerDiagnosticsNegativeTest-853356359-project] 10.222.0.52 "GET /compute/v2.1/servers/f603dfa8-a2e6-4018-aaeb-639bf5eb24c6" status: 404 len: 111 microversion: 2.1 time: 0.056162 Oct 19 03:15:03.070506 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 443/830] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:03 2022] GET /compute/v2.1/servers/f603dfa8-a2e6-4018-aaeb-639bf5eb24c6 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:15:03.076269 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f174024a-bde1-4fde-a3cf-b9179a751436 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:03.076883 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f174024a-bde1-4fde-a3cf-b9179a751436 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:03.083784 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f174024a-bde1-4fde-a3cf-b9179a751436 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:03.084400 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f174024a-bde1-4fde-a3cf-b9179a751436 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:03.084840 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f174024a-bde1-4fde-a3cf-b9179a751436 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:03.085589 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f174024a-bde1-4fde-a3cf-b9179a751436 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:03.086120 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f174024a-bde1-4fde-a3cf-b9179a751436 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:03.092494 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f174024a-bde1-4fde-a3cf-b9179a751436 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:03.092648 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4a51af93-5ecf-4967-9e94-733bc74d551f tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/d67da55c-724e-4305-9960-99d15ecfb23a/action" status: 202 len: 0 microversion: 2.25 time: 9.254771 Oct 19 03:15:03.092648 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 388/831] 10.222.0.52 () {62 vars in 1319 bytes} [Wed Oct 19 03:14:53 2022] POST /compute/v2.1/servers/d67da55c-724e-4305-9960-99d15ecfb23a/action => generated 0 bytes in 9256 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:15:03.100879 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-c9b6bcc4-1df3-48e0-90d9-c0cf57cc9454 req-420eb2aa-7826-415f-bea2-45efc45f63ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "540a7025-b935-49fb-bc51-edf44ac1e0c4", "name": "network-vif-plugged", "status": "completed", "tag": "e54cc460-46ae-45ff-9a37-9bdfc282d2aa"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:15:03.147092 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-c9b6bcc4-1df3-48e0-90d9-c0cf57cc9454 req-420eb2aa-7826-415f-bea2-45efc45f63ea service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:03.153940 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-c9b6bcc4-1df3-48e0-90d9-c0cf57cc9454 req-420eb2aa-7826-415f-bea2-45efc45f63ea service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:03.154804 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-c9b6bcc4-1df3-48e0-90d9-c0cf57cc9454 req-420eb2aa-7826-415f-bea2-45efc45f63ea service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:03.207279 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-c9b6bcc4-1df3-48e0-90d9-c0cf57cc9454 req-420eb2aa-7826-415f-bea2-45efc45f63ea service nova] Creating event network-vif-plugged:e54cc460-46ae-45ff-9a37-9bdfc282d2aa for instance 540a7025-b935-49fb-bc51-edf44ac1e0c4 on n-h1-861333-8 Oct 19 03:15:03.231244 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-c9b6bcc4-1df3-48e0-90d9-c0cf57cc9454 req-420eb2aa-7826-415f-bea2-45efc45f63ea service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139383 Oct 19 03:15:03.236598 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 389/832] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:15:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:15:03.242879 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-32a2aebe-b864-468c-9b97-f8caf0ea90bc tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:03.243881 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-32a2aebe-b864-468c-9b97-f8caf0ea90bc tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] [instance: d50976fb-756b-4b12-92f2-cedf87df492d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:03.251703 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-32a2aebe-b864-468c-9b97-f8caf0ea90bc tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:03.252966 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-32a2aebe-b864-468c-9b97-f8caf0ea90bc tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:03.253593 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-32a2aebe-b864-468c-9b97-f8caf0ea90bc tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:03.259181 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-32a2aebe-b864-468c-9b97-f8caf0ea90bc tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:03.259181 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-32a2aebe-b864-468c-9b97-f8caf0ea90bc tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:03.259181 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-32a2aebe-b864-468c-9b97-f8caf0ea90bc tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:03.341992 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f174024a-bde1-4fde-a3cf-b9179a751436 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:03.351487 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f174024a-bde1-4fde-a3cf-b9179a751436 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667" status: 200 len: 1475 microversion: 2.1 time: 0.279712 Oct 19 03:15:03.352573 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 444/833] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:03 2022] GET /compute/v2.1/servers/ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667 => generated 1475 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:15:03.358955 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9b7f177c-be6a-4e1c-8764-0a59d17698f0 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:03.359676 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9b7f177c-be6a-4e1c-8764-0a59d17698f0 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 393853e1-5f67-4c6b-972d-9f76de928599] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:03.368080 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9b7f177c-be6a-4e1c-8764-0a59d17698f0 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:03.368638 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9b7f177c-be6a-4e1c-8764-0a59d17698f0 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:03.369858 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9b7f177c-be6a-4e1c-8764-0a59d17698f0 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:03.371233 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9b7f177c-be6a-4e1c-8764-0a59d17698f0 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:03.371698 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9b7f177c-be6a-4e1c-8764-0a59d17698f0 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:03.372747 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9b7f177c-be6a-4e1c-8764-0a59d17698f0 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:03.463747 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-32a2aebe-b864-468c-9b97-f8caf0ea90bc tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lazy-loading 'services' on Instance uuid d50976fb-756b-4b12-92f2-cedf87df492d {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:15:03.511558 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-32a2aebe-b864-468c-9b97-f8caf0ea90bc tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d" status: 200 len: 1927 microversion: 2.75 time: 0.271896 Oct 19 03:15:03.512569 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 390/834] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:03 2022] GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d => generated 1927 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:15:03.521032 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-37e52514-9a6d-4636-9716-ae1151faf774 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:03.521966 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-37e52514-9a6d-4636-9716-ae1151faf774 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: d67da55c-724e-4305-9960-99d15ecfb23a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:03.530938 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-37e52514-9a6d-4636-9716-ae1151faf774 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:03.531427 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-37e52514-9a6d-4636-9716-ae1151faf774 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:03.531868 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-37e52514-9a6d-4636-9716-ae1151faf774 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:03.532572 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-37e52514-9a6d-4636-9716-ae1151faf774 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:03.533043 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-37e52514-9a6d-4636-9716-ae1151faf774 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:03.533494 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-37e52514-9a6d-4636-9716-ae1151faf774 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:03.605121 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-9b7f177c-be6a-4e1c-8764-0a59d17698f0 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:03.617096 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9b7f177c-be6a-4e1c-8764-0a59d17698f0 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/393853e1-5f67-4c6b-972d-9f76de928599" status: 200 len: 1317 microversion: 2.1 time: 0.262780 Oct 19 03:15:03.647542 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 445/835] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:03 2022] GET /compute/v2.1/servers/393853e1-5f67-4c6b-972d-9f76de928599 => generated 1317 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:15:03.658336 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-17c7ba99-c8cb-4045-a3c7-50ab474a1ff5 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:03.664660 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-17c7ba99-c8cb-4045-a3c7-50ab474a1ff5 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] [instance: 540a7025-b935-49fb-bc51-edf44ac1e0c4] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:03.678805 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-17c7ba99-c8cb-4045-a3c7-50ab474a1ff5 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:03.679611 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-17c7ba99-c8cb-4045-a3c7-50ab474a1ff5 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:03.680268 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-17c7ba99-c8cb-4045-a3c7-50ab474a1ff5 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:03.681274 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-17c7ba99-c8cb-4045-a3c7-50ab474a1ff5 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:03.681959 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-17c7ba99-c8cb-4045-a3c7-50ab474a1ff5 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:03.682605 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-17c7ba99-c8cb-4045-a3c7-50ab474a1ff5 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:03.702763 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=100 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:15:03.748098 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-37e52514-9a6d-4636-9716-ae1151faf774 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:03.762684 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-37e52514-9a6d-4636-9716-ae1151faf774 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:03.765005 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-37e52514-9a6d-4636-9716-ae1151faf774 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:03.772253 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-37e52514-9a6d-4636-9716-ae1151faf774 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/d67da55c-724e-4305-9960-99d15ecfb23a" status: 200 len: 1565 microversion: 2.25 time: 0.258183 Oct 19 03:15:03.775545 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 391/836] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:03 2022] GET /compute/v2.1/servers/d67da55c-724e-4305-9960-99d15ecfb23a => generated 1565 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:15:03.879210 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d6c079d2-f65c-4245-ac4d-bd176095bcfd tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:03.880122 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d6c079d2-f65c-4245-ac4d-bd176095bcfd tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] [instance: 6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:03.888602 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d6c079d2-f65c-4245-ac4d-bd176095bcfd tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:03.892546 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d6c079d2-f65c-4245-ac4d-bd176095bcfd tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:03.893212 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d6c079d2-f65c-4245-ac4d-bd176095bcfd tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:03.894122 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d6c079d2-f65c-4245-ac4d-bd176095bcfd tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:03.896932 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d6c079d2-f65c-4245-ac4d-bd176095bcfd tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:03.897415 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d6c079d2-f65c-4245-ac4d-bd176095bcfd tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:03.952241 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-17c7ba99-c8cb-4045-a3c7-50ab474a1ff5 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28072a54d5934ea28e7d3205841c0852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c12a432bbd43bd8f70ba6e941c28a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:03.968376 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-17c7ba99-c8cb-4045-a3c7-50ab474a1ff5 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] 10.222.0.52 "GET /compute/v2.1/servers/540a7025-b935-49fb-bc51-edf44ac1e0c4" status: 200 len: 1366 microversion: 2.1 time: 0.315314 Oct 19 03:15:03.969010 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 446/837] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:03 2022] GET /compute/v2.1/servers/540a7025-b935-49fb-bc51-edf44ac1e0c4 => generated 1366 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:15:04.040508 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7c5b366d-07e9-4542-859b-38f9fefde33e tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:04.041339 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7c5b366d-07e9-4542-859b-38f9fefde33e tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:04.050793 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7c5b366d-07e9-4542-859b-38f9fefde33e tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:04.054958 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7c5b366d-07e9-4542-859b-38f9fefde33e tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:04.055154 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7c5b366d-07e9-4542-859b-38f9fefde33e tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:04.055851 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7c5b366d-07e9-4542-859b-38f9fefde33e tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:04.056337 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7c5b366d-07e9-4542-859b-38f9fefde33e tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:04.056748 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7c5b366d-07e9-4542-859b-38f9fefde33e tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:04.070692 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d6c079d2-f65c-4245-ac4d-bd176095bcfd tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cc37ae4bed94a7e85ed70dd5942c2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df99b134b20743eb9b62788706f2705a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:04.080796 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d6c079d2-f65c-4245-ac4d-bd176095bcfd tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] 10.222.0.52 "GET /compute/v2.1/servers/6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1" status: 200 len: 1388 microversion: 2.1 time: 0.205338 Oct 19 03:15:04.081673 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 392/838] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:03 2022] GET /compute/v2.1/servers/6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1 => generated 1388 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:15:04.159128 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7c5b366d-07e9-4542-859b-38f9fefde33e tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:04.169934 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7c5b366d-07e9-4542-859b-38f9fefde33e tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:04.172144 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7c5b366d-07e9-4542-859b-38f9fefde33e tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:04.178267 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7c5b366d-07e9-4542-859b-38f9fefde33e tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1555 microversion: 2.91 time: 0.141641 Oct 19 03:15:04.179517 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 447/839] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:04 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1555 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:15:04.375626 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f8d25a93-9a8f-4a73-9ab8-144841e5045b tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:04.376204 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f8d25a93-9a8f-4a73-9ab8-144841e5045b tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:04.405732 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f8d25a93-9a8f-4a73-9ab8-144841e5045b tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:04.406444 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f8d25a93-9a8f-4a73-9ab8-144841e5045b tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:04.407054 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f8d25a93-9a8f-4a73-9ab8-144841e5045b tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:04.407921 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f8d25a93-9a8f-4a73-9ab8-144841e5045b tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:04.408531 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f8d25a93-9a8f-4a73-9ab8-144841e5045b tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:04.409639 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f8d25a93-9a8f-4a73-9ab8-144841e5045b tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:04.545987 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f7a6da70-0561-46cb-8f42-e1ed63a3e63b tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:04.546820 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f7a6da70-0561-46cb-8f42-e1ed63a3e63b tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] [instance: d50976fb-756b-4b12-92f2-cedf87df492d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:04.557221 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f7a6da70-0561-46cb-8f42-e1ed63a3e63b tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:04.559769 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f7a6da70-0561-46cb-8f42-e1ed63a3e63b tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:04.560289 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f7a6da70-0561-46cb-8f42-e1ed63a3e63b tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:04.562105 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f7a6da70-0561-46cb-8f42-e1ed63a3e63b tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:04.563480 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-f8d25a93-9a8f-4a73-9ab8-144841e5045b tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:04.564035 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f7a6da70-0561-46cb-8f42-e1ed63a3e63b tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:04.564539 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f7a6da70-0561-46cb-8f42-e1ed63a3e63b tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:04.574712 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f8d25a93-9a8f-4a73-9ab8-144841e5045b tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667" status: 200 len: 1473 microversion: 2.1 time: 0.203168 Oct 19 03:15:04.575404 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 393/840] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:04 2022] GET /compute/v2.1/servers/ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667 => generated 1473 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:15:04.646084 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-96e4cf8c-edbb-4c0c-8e1a-a55ee265b2ce tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:04.646949 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-96e4cf8c-edbb-4c0c-8e1a-a55ee265b2ce tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 393853e1-5f67-4c6b-972d-9f76de928599] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:04.655374 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-96e4cf8c-edbb-4c0c-8e1a-a55ee265b2ce tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:04.656114 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-96e4cf8c-edbb-4c0c-8e1a-a55ee265b2ce tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:04.657068 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-96e4cf8c-edbb-4c0c-8e1a-a55ee265b2ce tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:04.669357 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-96e4cf8c-edbb-4c0c-8e1a-a55ee265b2ce tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:04.670009 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-96e4cf8c-edbb-4c0c-8e1a-a55ee265b2ce tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:04.670158 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-f7a6da70-0561-46cb-8f42-e1ed63a3e63b tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lazy-loading 'services' on Instance uuid d50976fb-756b-4b12-92f2-cedf87df492d {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:15:04.673716 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-96e4cf8c-edbb-4c0c-8e1a-a55ee265b2ce tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:04.693708 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f7a6da70-0561-46cb-8f42-e1ed63a3e63b tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d" status: 200 len: 1927 microversion: 2.75 time: 0.153860 Oct 19 03:15:04.712553 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 448/841] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:04 2022] GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d => generated 1927 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:15:04.801813 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-76916472-3b0d-4bb4-a3e8-fac74f880df5 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:04.802545 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-76916472-3b0d-4bb4-a3e8-fac74f880df5 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: d67da55c-724e-4305-9960-99d15ecfb23a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:04.813849 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-76916472-3b0d-4bb4-a3e8-fac74f880df5 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:04.817690 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-76916472-3b0d-4bb4-a3e8-fac74f880df5 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:04.818347 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-76916472-3b0d-4bb4-a3e8-fac74f880df5 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:04.820990 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-76916472-3b0d-4bb4-a3e8-fac74f880df5 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:04.821506 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-76916472-3b0d-4bb4-a3e8-fac74f880df5 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:04.821947 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-76916472-3b0d-4bb4-a3e8-fac74f880df5 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:04.904319 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-96e4cf8c-edbb-4c0c-8e1a-a55ee265b2ce tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:04.915221 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-96e4cf8c-edbb-4c0c-8e1a-a55ee265b2ce tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/393853e1-5f67-4c6b-972d-9f76de928599" status: 200 len: 1317 microversion: 2.1 time: 0.272839 Oct 19 03:15:04.930450 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 394/842] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:04 2022] GET /compute/v2.1/servers/393853e1-5f67-4c6b-972d-9f76de928599 => generated 1317 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:15:04.987904 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-76916472-3b0d-4bb4-a3e8-fac74f880df5 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:04.998956 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-76916472-3b0d-4bb4-a3e8-fac74f880df5 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:05.000475 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-76916472-3b0d-4bb4-a3e8-fac74f880df5 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:05.001671 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-76916472-3b0d-4bb4-a3e8-fac74f880df5 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/d67da55c-724e-4305-9960-99d15ecfb23a" status: 200 len: 1565 microversion: 2.25 time: 0.204081 Oct 19 03:15:05.002583 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 449/843] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:04 2022] GET /compute/v2.1/servers/d67da55c-724e-4305-9960-99d15ecfb23a => generated 1565 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:15:05.006685 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-89132eeb-5111-491d-bd99-4e3d2e8731ee tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:05.007403 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-89132eeb-5111-491d-bd99-4e3d2e8731ee tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] [instance: 540a7025-b935-49fb-bc51-edf44ac1e0c4] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:05.014823 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-89132eeb-5111-491d-bd99-4e3d2e8731ee tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:05.015318 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-89132eeb-5111-491d-bd99-4e3d2e8731ee tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:05.020488 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-89132eeb-5111-491d-bd99-4e3d2e8731ee tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:05.020488 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-89132eeb-5111-491d-bd99-4e3d2e8731ee tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:05.020488 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-89132eeb-5111-491d-bd99-4e3d2e8731ee tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:05.020488 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-89132eeb-5111-491d-bd99-4e3d2e8731ee tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:05.104317 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c06ec9a6-e2bc-4af1-8c68-68842bdb970e tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:05.105407 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c06ec9a6-e2bc-4af1-8c68-68842bdb970e tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] [instance: 6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:05.122678 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c06ec9a6-e2bc-4af1-8c68-68842bdb970e tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:05.123183 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c06ec9a6-e2bc-4af1-8c68-68842bdb970e tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:05.123629 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c06ec9a6-e2bc-4af1-8c68-68842bdb970e tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:05.124350 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c06ec9a6-e2bc-4af1-8c68-68842bdb970e tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:05.124805 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c06ec9a6-e2bc-4af1-8c68-68842bdb970e tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:05.125462 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c06ec9a6-e2bc-4af1-8c68-68842bdb970e tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:05.177265 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-89132eeb-5111-491d-bd99-4e3d2e8731ee tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28072a54d5934ea28e7d3205841c0852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c12a432bbd43bd8f70ba6e941c28a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:05.186907 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-89132eeb-5111-491d-bd99-4e3d2e8731ee tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] 10.222.0.52 "GET /compute/v2.1/servers/540a7025-b935-49fb-bc51-edf44ac1e0c4" status: 200 len: 1366 microversion: 2.1 time: 0.198695 Oct 19 03:15:05.187500 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 395/844] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:04 2022] GET /compute/v2.1/servers/540a7025-b935-49fb-bc51-edf44ac1e0c4 => generated 1366 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:15:05.219609 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9ba6473f-b7ff-428a-9432-73a2c24da766 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:05.220240 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9ba6473f-b7ff-428a-9432-73a2c24da766 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:05.226835 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9ba6473f-b7ff-428a-9432-73a2c24da766 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:05.227391 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9ba6473f-b7ff-428a-9432-73a2c24da766 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:05.227840 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9ba6473f-b7ff-428a-9432-73a2c24da766 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:05.228557 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9ba6473f-b7ff-428a-9432-73a2c24da766 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:05.229039 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9ba6473f-b7ff-428a-9432-73a2c24da766 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:05.229530 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9ba6473f-b7ff-428a-9432-73a2c24da766 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:05.315537 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9ba6473f-b7ff-428a-9432-73a2c24da766 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:05.334598 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c06ec9a6-e2bc-4af1-8c68-68842bdb970e tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cc37ae4bed94a7e85ed70dd5942c2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df99b134b20743eb9b62788706f2705a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:05.342087 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9ba6473f-b7ff-428a-9432-73a2c24da766 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:05.344449 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c06ec9a6-e2bc-4af1-8c68-68842bdb970e tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] 10.222.0.52 "GET /compute/v2.1/servers/6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1" status: 200 len: 1388 microversion: 2.1 time: 0.244167 Oct 19 03:15:05.345600 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 450/845] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:05 2022] GET /compute/v2.1/servers/6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1 => generated 1388 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:15:05.347616 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9ba6473f-b7ff-428a-9432-73a2c24da766 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:05.350731 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-1632cdcc-23b3-4b49-80dd-09e17d61cd0b req-ea8066a7-c3a0-4590-8de7-0659218fa866 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "393853e1-5f67-4c6b-972d-9f76de928599", "name": "network-vif-plugged", "status": "completed", "tag": "d5510f98-8a30-4512-b93a-37d0c22020ba"}, {"server_uuid": "8cb9ad03-e7f9-4d7f-8711-1e2f478b0d17", "name": "network-vif-plugged", "status": "completed", "tag": "e1bbec00-8519-4f02-b46d-c4664396ed43"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:15:05.360169 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9ba6473f-b7ff-428a-9432-73a2c24da766 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1555 microversion: 2.91 time: 0.145091 Oct 19 03:15:05.363592 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 396/846] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:05 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1555 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:15:05.365028 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-1632cdcc-23b3-4b49-80dd-09e17d61cd0b req-ea8066a7-c3a0-4590-8de7-0659218fa866 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:05.365699 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-1632cdcc-23b3-4b49-80dd-09e17d61cd0b req-ea8066a7-c3a0-4590-8de7-0659218fa866 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:05.366320 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-1632cdcc-23b3-4b49-80dd-09e17d61cd0b req-ea8066a7-c3a0-4590-8de7-0659218fa866 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:05.379981 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-1632cdcc-23b3-4b49-80dd-09e17d61cd0b req-ea8066a7-c3a0-4590-8de7-0659218fa866 service nova] Creating event network-vif-plugged:d5510f98-8a30-4512-b93a-37d0c22020ba for instance 393853e1-5f67-4c6b-972d-9f76de928599 on n-h2-861333-8 Oct 19 03:15:05.380751 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-1632cdcc-23b3-4b49-80dd-09e17d61cd0b req-ea8066a7-c3a0-4590-8de7-0659218fa866 service nova] Creating event network-vif-plugged:e1bbec00-8519-4f02-b46d-c4664396ed43 for instance 8cb9ad03-e7f9-4d7f-8711-1e2f478b0d17 on n-h2-861333-8 Oct 19 03:15:05.397508 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-1632cdcc-23b3-4b49-80dd-09e17d61cd0b req-ea8066a7-c3a0-4590-8de7-0659218fa866 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.050381 Oct 19 03:15:05.405411 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 451/847] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:15:05 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:15:05.605946 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ed6e1f86-a821-4e7d-aaf7-fa8caf3d67c4 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:05.611475 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ed6e1f86-a821-4e7d-aaf7-fa8caf3d67c4 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:05.619799 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ed6e1f86-a821-4e7d-aaf7-fa8caf3d67c4 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:05.620311 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ed6e1f86-a821-4e7d-aaf7-fa8caf3d67c4 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:05.621286 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ed6e1f86-a821-4e7d-aaf7-fa8caf3d67c4 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:05.626022 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ed6e1f86-a821-4e7d-aaf7-fa8caf3d67c4 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:05.626521 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ed6e1f86-a821-4e7d-aaf7-fa8caf3d67c4 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:05.626969 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ed6e1f86-a821-4e7d-aaf7-fa8caf3d67c4 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:05.723491 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5ba4e1bb-56b2-4def-90f2-f97101c64259 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:05.724462 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-5ba4e1bb-56b2-4def-90f2-f97101c64259 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] [instance: d50976fb-756b-4b12-92f2-cedf87df492d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:05.736254 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5ba4e1bb-56b2-4def-90f2-f97101c64259 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:05.737041 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5ba4e1bb-56b2-4def-90f2-f97101c64259 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:05.737677 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5ba4e1bb-56b2-4def-90f2-f97101c64259 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:05.746216 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5ba4e1bb-56b2-4def-90f2-f97101c64259 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:05.746618 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5ba4e1bb-56b2-4def-90f2-f97101c64259 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:05.747065 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5ba4e1bb-56b2-4def-90f2-f97101c64259 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:05.887093 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-5ba4e1bb-56b2-4def-90f2-f97101c64259 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lazy-loading 'services' on Instance uuid d50976fb-756b-4b12-92f2-cedf87df492d {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:15:05.904933 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ed6e1f86-a821-4e7d-aaf7-fa8caf3d67c4 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:05.917981 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ed6e1f86-a821-4e7d-aaf7-fa8caf3d67c4 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667" status: 200 len: 1473 microversion: 2.1 time: 0.314169 Oct 19 03:15:05.922051 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 397/848] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:05 2022] GET /compute/v2.1/servers/ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667 => generated 1473 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:15:05.926257 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5ba4e1bb-56b2-4def-90f2-f97101c64259 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d" status: 200 len: 1927 microversion: 2.75 time: 0.204259 Oct 19 03:15:05.926257 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 452/849] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:05 2022] GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d => generated 1927 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:15:05.944335 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b6d13a8e-a4b8-4cd2-90e4-7fc10c750cbb tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:05.945447 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b6d13a8e-a4b8-4cd2-90e4-7fc10c750cbb tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 393853e1-5f67-4c6b-972d-9f76de928599] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:05.954425 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b6d13a8e-a4b8-4cd2-90e4-7fc10c750cbb tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:05.954926 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b6d13a8e-a4b8-4cd2-90e4-7fc10c750cbb tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:05.955369 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b6d13a8e-a4b8-4cd2-90e4-7fc10c750cbb tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:05.956119 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b6d13a8e-a4b8-4cd2-90e4-7fc10c750cbb tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:05.956566 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b6d13a8e-a4b8-4cd2-90e4-7fc10c750cbb tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:05.956984 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b6d13a8e-a4b8-4cd2-90e4-7fc10c750cbb tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:06.033618 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-70c4a73c-1d83-4a7d-aac4-9e7d9d236984 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:06.034560 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-70c4a73c-1d83-4a7d-aac4-9e7d9d236984 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: d67da55c-724e-4305-9960-99d15ecfb23a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:06.042608 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-70c4a73c-1d83-4a7d-aac4-9e7d9d236984 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:06.043323 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-70c4a73c-1d83-4a7d-aac4-9e7d9d236984 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:06.043963 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-70c4a73c-1d83-4a7d-aac4-9e7d9d236984 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:06.044843 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-70c4a73c-1d83-4a7d-aac4-9e7d9d236984 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:06.045497 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-70c4a73c-1d83-4a7d-aac4-9e7d9d236984 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:06.046129 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-70c4a73c-1d83-4a7d-aac4-9e7d9d236984 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:06.211326 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b6d13a8e-a4b8-4cd2-90e4-7fc10c750cbb tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:06.219610 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b6d13a8e-a4b8-4cd2-90e4-7fc10c750cbb tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/393853e1-5f67-4c6b-972d-9f76de928599" status: 200 len: 1317 microversion: 2.1 time: 0.283162 Oct 19 03:15:06.234476 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 398/850] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:05 2022] GET /compute/v2.1/servers/393853e1-5f67-4c6b-972d-9f76de928599 => generated 1317 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:15:06.242272 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5c30e122-d2ce-47fb-908c-667d00371fd2 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:06.242896 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5c30e122-d2ce-47fb-908c-667d00371fd2 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] [instance: 540a7025-b935-49fb-bc51-edf44ac1e0c4] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:06.250832 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5c30e122-d2ce-47fb-908c-667d00371fd2 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:06.255930 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5c30e122-d2ce-47fb-908c-667d00371fd2 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:06.255930 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5c30e122-d2ce-47fb-908c-667d00371fd2 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:06.255930 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5c30e122-d2ce-47fb-908c-667d00371fd2 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:06.255930 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5c30e122-d2ce-47fb-908c-667d00371fd2 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:06.256491 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5c30e122-d2ce-47fb-908c-667d00371fd2 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:06.320100 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-70c4a73c-1d83-4a7d-aac4-9e7d9d236984 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:06.331425 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-70c4a73c-1d83-4a7d-aac4-9e7d9d236984 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:06.333496 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-70c4a73c-1d83-4a7d-aac4-9e7d9d236984 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:06.335130 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-70c4a73c-1d83-4a7d-aac4-9e7d9d236984 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/d67da55c-724e-4305-9960-99d15ecfb23a" status: 200 len: 1565 microversion: 2.25 time: 0.311380 Oct 19 03:15:06.350333 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 453/851] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:06 2022] GET /compute/v2.1/servers/d67da55c-724e-4305-9960-99d15ecfb23a => generated 1565 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:15:06.375356 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-df03c474-9f5b-45b4-bee4-a619dece108c tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:06.376246 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-df03c474-9f5b-45b4-bee4-a619dece108c tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] [instance: 6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:06.383296 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-df03c474-9f5b-45b4-bee4-a619dece108c tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:06.384059 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-df03c474-9f5b-45b4-bee4-a619dece108c tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:06.384710 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-df03c474-9f5b-45b4-bee4-a619dece108c tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:06.385667 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-df03c474-9f5b-45b4-bee4-a619dece108c tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:06.386613 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-df03c474-9f5b-45b4-bee4-a619dece108c tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:06.387185 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-df03c474-9f5b-45b4-bee4-a619dece108c tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:06.532698 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5c30e122-d2ce-47fb-908c-667d00371fd2 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28072a54d5934ea28e7d3205841c0852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c12a432bbd43bd8f70ba6e941c28a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:06.544678 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5c30e122-d2ce-47fb-908c-667d00371fd2 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] 10.222.0.52 "GET /compute/v2.1/servers/540a7025-b935-49fb-bc51-edf44ac1e0c4" status: 200 len: 1366 microversion: 2.1 time: 0.308890 Oct 19 03:15:06.558081 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 399/852] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:06 2022] GET /compute/v2.1/servers/540a7025-b935-49fb-bc51-edf44ac1e0c4 => generated 1366 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:15:06.566326 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-087cdaea-9319-4ac1-8eb9-28f845bc29a1 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:06.566940 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-087cdaea-9319-4ac1-8eb9-28f845bc29a1 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:06.573109 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-087cdaea-9319-4ac1-8eb9-28f845bc29a1 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:06.573731 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-087cdaea-9319-4ac1-8eb9-28f845bc29a1 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:06.574206 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-087cdaea-9319-4ac1-8eb9-28f845bc29a1 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:06.574904 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-087cdaea-9319-4ac1-8eb9-28f845bc29a1 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:06.575363 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-087cdaea-9319-4ac1-8eb9-28f845bc29a1 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:06.575790 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-087cdaea-9319-4ac1-8eb9-28f845bc29a1 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:06.643294 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-df03c474-9f5b-45b4-bee4-a619dece108c tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cc37ae4bed94a7e85ed70dd5942c2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df99b134b20743eb9b62788706f2705a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:06.652989 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-df03c474-9f5b-45b4-bee4-a619dece108c tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] 10.222.0.52 "GET /compute/v2.1/servers/6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1" status: 200 len: 1388 microversion: 2.1 time: 0.281958 Oct 19 03:15:06.654301 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 454/853] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:06 2022] GET /compute/v2.1/servers/6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1 => generated 1388 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:15:06.689274 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-087cdaea-9319-4ac1-8eb9-28f845bc29a1 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:06.691677 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:15:06.699533 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-087cdaea-9319-4ac1-8eb9-28f845bc29a1 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:06.702448 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-087cdaea-9319-4ac1-8eb9-28f845bc29a1 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:06.707844 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-087cdaea-9319-4ac1-8eb9-28f845bc29a1 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1555 microversion: 2.91 time: 0.148717 Oct 19 03:15:06.708505 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 400/854] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:06 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1555 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:15:06.945188 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d8258117-4ff0-4df6-ad16-b573116adfac tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:06.946491 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d8258117-4ff0-4df6-ad16-b573116adfac tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:06.956128 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-26c74735-50c5-44f5-9fa1-76e8b6c0b34b tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:06.956812 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d8258117-4ff0-4df6-ad16-b573116adfac tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:06.956941 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-26c74735-50c5-44f5-9fa1-76e8b6c0b34b tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] [instance: d50976fb-756b-4b12-92f2-cedf87df492d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:06.957318 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d8258117-4ff0-4df6-ad16-b573116adfac tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:06.957865 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d8258117-4ff0-4df6-ad16-b573116adfac tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:06.958573 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d8258117-4ff0-4df6-ad16-b573116adfac tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:06.959026 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d8258117-4ff0-4df6-ad16-b573116adfac tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:06.959651 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d8258117-4ff0-4df6-ad16-b573116adfac tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:06.963856 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-26c74735-50c5-44f5-9fa1-76e8b6c0b34b tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:06.964532 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-26c74735-50c5-44f5-9fa1-76e8b6c0b34b tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:06.965181 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-26c74735-50c5-44f5-9fa1-76e8b6c0b34b tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:06.966035 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-26c74735-50c5-44f5-9fa1-76e8b6c0b34b tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:06.966639 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-26c74735-50c5-44f5-9fa1-76e8b6c0b34b tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:06.967298 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-26c74735-50c5-44f5-9fa1-76e8b6c0b34b tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:07.144561 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-26c74735-50c5-44f5-9fa1-76e8b6c0b34b tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lazy-loading 'services' on Instance uuid d50976fb-756b-4b12-92f2-cedf87df492d {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:15:07.208685 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-26c74735-50c5-44f5-9fa1-76e8b6c0b34b tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d" status: 200 len: 1927 microversion: 2.75 time: 0.260199 Oct 19 03:15:07.209727 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 401/855] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:06 2022] GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d => generated 1927 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:15:07.227321 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d8258117-4ff0-4df6-ad16-b573116adfac tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:07.243617 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d8258117-4ff0-4df6-ad16-b573116adfac tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667" status: 200 len: 1473 microversion: 2.1 time: 0.300775 Oct 19 03:15:07.251211 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-42a16806-c6e8-483e-9ff6-35b73a395060 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:07.252357 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-42a16806-c6e8-483e-9ff6-35b73a395060 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 393853e1-5f67-4c6b-972d-9f76de928599] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:07.256940 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 455/856] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:06 2022] GET /compute/v2.1/servers/ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667 => generated 1473 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:15:07.259700 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-42a16806-c6e8-483e-9ff6-35b73a395060 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:07.260367 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-42a16806-c6e8-483e-9ff6-35b73a395060 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:07.261210 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-42a16806-c6e8-483e-9ff6-35b73a395060 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:07.266224 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-42a16806-c6e8-483e-9ff6-35b73a395060 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:07.266224 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-42a16806-c6e8-483e-9ff6-35b73a395060 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:07.266224 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-42a16806-c6e8-483e-9ff6-35b73a395060 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:07.363779 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2cc7fe36-9e54-47b4-8a47-62b58866af41 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:07.364517 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-2cc7fe36-9e54-47b4-8a47-62b58866af41 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: d67da55c-724e-4305-9960-99d15ecfb23a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:07.373344 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2cc7fe36-9e54-47b4-8a47-62b58866af41 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:07.373979 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2cc7fe36-9e54-47b4-8a47-62b58866af41 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:07.374880 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2cc7fe36-9e54-47b4-8a47-62b58866af41 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:07.375638 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2cc7fe36-9e54-47b4-8a47-62b58866af41 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:07.376324 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2cc7fe36-9e54-47b4-8a47-62b58866af41 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:07.377058 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2cc7fe36-9e54-47b4-8a47-62b58866af41 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:07.507751 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-42a16806-c6e8-483e-9ff6-35b73a395060 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:07.521436 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-42a16806-c6e8-483e-9ff6-35b73a395060 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/393853e1-5f67-4c6b-972d-9f76de928599" status: 200 len: 1317 microversion: 2.1 time: 0.273090 Oct 19 03:15:07.522695 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 402/857] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:07 2022] GET /compute/v2.1/servers/393853e1-5f67-4c6b-972d-9f76de928599 => generated 1317 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:15:07.534803 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-6f7b1121-943e-4c8a-af60-eaafbe25ed8b req-554488b1-c75b-4831-80a2-fb9abb09fd6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1", "name": "network-vif-plugged", "status": "completed", "tag": "753bfd99-2927-47ca-a7e7-46e77707a12f"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:15:07.555002 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-6f7b1121-943e-4c8a-af60-eaafbe25ed8b req-554488b1-c75b-4831-80a2-fb9abb09fd6b service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:07.557136 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-6f7b1121-943e-4c8a-af60-eaafbe25ed8b req-554488b1-c75b-4831-80a2-fb9abb09fd6b service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:07.559424 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-6f7b1121-943e-4c8a-af60-eaafbe25ed8b req-554488b1-c75b-4831-80a2-fb9abb09fd6b service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:07.581066 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-6f7b1121-943e-4c8a-af60-eaafbe25ed8b req-554488b1-c75b-4831-80a2-fb9abb09fd6b service nova] Creating event network-vif-plugged:753bfd99-2927-47ca-a7e7-46e77707a12f for instance 6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1 on n-h1-861333-8 Oct 19 03:15:07.588599 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-6f7b1121-943e-4c8a-af60-eaafbe25ed8b req-554488b1-c75b-4831-80a2-fb9abb09fd6b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064396 Oct 19 03:15:07.594763 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 403/858] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:15:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:15:07.603186 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-56a0cb19-76b1-4c64-8ad5-5ba88aab4fb2 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:07.606131 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-56a0cb19-76b1-4c64-8ad5-5ba88aab4fb2 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] [instance: 540a7025-b935-49fb-bc51-edf44ac1e0c4] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:07.613742 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-56a0cb19-76b1-4c64-8ad5-5ba88aab4fb2 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:07.614882 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-56a0cb19-76b1-4c64-8ad5-5ba88aab4fb2 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:07.615566 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-56a0cb19-76b1-4c64-8ad5-5ba88aab4fb2 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:07.616480 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-56a0cb19-76b1-4c64-8ad5-5ba88aab4fb2 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:07.617095 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-56a0cb19-76b1-4c64-8ad5-5ba88aab4fb2 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:07.617998 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-56a0cb19-76b1-4c64-8ad5-5ba88aab4fb2 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:07.628436 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-2cc7fe36-9e54-47b4-8a47-62b58866af41 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:07.639030 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-2cc7fe36-9e54-47b4-8a47-62b58866af41 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:07.647244 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-2cc7fe36-9e54-47b4-8a47-62b58866af41 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:07.651101 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2cc7fe36-9e54-47b4-8a47-62b58866af41 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/d67da55c-724e-4305-9960-99d15ecfb23a" status: 200 len: 1565 microversion: 2.25 time: 0.291066 Oct 19 03:15:07.656238 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 456/859] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:07 2022] GET /compute/v2.1/servers/d67da55c-724e-4305-9960-99d15ecfb23a => generated 1565 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:15:07.810015 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3f7845c2-472c-42f3-b531-cb0df145328e tempest-FlavorsV2NegativeTest-1842946823 tempest-FlavorsV2NegativeTest-1842946823-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:07.818522 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-3f7845c2-472c-42f3-b531-cb0df145328e tempest-FlavorsV2NegativeTest-1842946823 tempest-FlavorsV2NegativeTest-1842946823-project] 10.222.0.52 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.160823 Oct 19 03:15:07.829469 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 457/860] 10.222.0.52 () {58 vars in 1137 bytes} [Wed Oct 19 03:15:07 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:15:07.829469 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-fc86877e-fb03-4f2f-bc9f-729b73538324 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:07.829469 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-fc86877e-fb03-4f2f-bc9f-729b73538324 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] [instance: 6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:07.847012 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fc86877e-fb03-4f2f-bc9f-729b73538324 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:07.850322 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fc86877e-fb03-4f2f-bc9f-729b73538324 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:07.851150 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fc86877e-fb03-4f2f-bc9f-729b73538324 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:07.854336 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fc86877e-fb03-4f2f-bc9f-729b73538324 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:07.856179 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fc86877e-fb03-4f2f-bc9f-729b73538324 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:07.856796 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fc86877e-fb03-4f2f-bc9f-729b73538324 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:07.975899 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-56a0cb19-76b1-4c64-8ad5-5ba88aab4fb2 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28072a54d5934ea28e7d3205841c0852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c12a432bbd43bd8f70ba6e941c28a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:07.984833 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-56a0cb19-76b1-4c64-8ad5-5ba88aab4fb2 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] 10.222.0.52 "GET /compute/v2.1/servers/540a7025-b935-49fb-bc51-edf44ac1e0c4" status: 200 len: 1366 microversion: 2.1 time: 0.388309 Oct 19 03:15:07.997590 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 404/861] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:07 2022] GET /compute/v2.1/servers/540a7025-b935-49fb-bc51-edf44ac1e0c4 => generated 1366 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:15:08.006191 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ec8cfb03-d131-434e-ac9e-ef227651cefe tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:08.007319 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ec8cfb03-d131-434e-ac9e-ef227651cefe tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:08.014770 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ec8cfb03-d131-434e-ac9e-ef227651cefe tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:08.014932 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ec8cfb03-d131-434e-ac9e-ef227651cefe tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:08.015330 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ec8cfb03-d131-434e-ac9e-ef227651cefe tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:08.016314 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ec8cfb03-d131-434e-ac9e-ef227651cefe tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:08.016484 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ec8cfb03-d131-434e-ac9e-ef227651cefe tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:08.016908 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ec8cfb03-d131-434e-ac9e-ef227651cefe tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:08.123978 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ec8cfb03-d131-434e-ac9e-ef227651cefe tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:08.133132 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ec8cfb03-d131-434e-ac9e-ef227651cefe tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:08.134642 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ec8cfb03-d131-434e-ac9e-ef227651cefe tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:08.141606 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ec8cfb03-d131-434e-ac9e-ef227651cefe tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1555 microversion: 2.91 time: 0.142605 Oct 19 03:15:08.142416 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 405/862] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:07 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1555 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:15:08.159395 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-fc86877e-fb03-4f2f-bc9f-729b73538324 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cc37ae4bed94a7e85ed70dd5942c2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df99b134b20743eb9b62788706f2705a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:08.182583 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-fc86877e-fb03-4f2f-bc9f-729b73538324 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] 10.222.0.52 "GET /compute/v2.1/servers/6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1" status: 200 len: 1388 microversion: 2.1 time: 0.362071 Oct 19 03:15:08.185251 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 458/863] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:07 2022] GET /compute/v2.1/servers/6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1 => generated 1388 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:15:08.236848 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-414de15c-7fc4-48b2-9641-4196927c6d61 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:08.237841 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-414de15c-7fc4-48b2-9641-4196927c6d61 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] [instance: d50976fb-756b-4b12-92f2-cedf87df492d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:08.243551 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=100 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:15:08.245212 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-414de15c-7fc4-48b2-9641-4196927c6d61 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:08.246738 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-414de15c-7fc4-48b2-9641-4196927c6d61 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:08.247444 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-414de15c-7fc4-48b2-9641-4196927c6d61 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:08.248545 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-414de15c-7fc4-48b2-9641-4196927c6d61 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:08.249225 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-414de15c-7fc4-48b2-9641-4196927c6d61 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:08.249913 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-414de15c-7fc4-48b2-9641-4196927c6d61 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:08.273597 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5a4dfe3c-db8d-451f-9320-a0f0b31d7d5c tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:08.274280 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-5a4dfe3c-db8d-451f-9320-a0f0b31d7d5c tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:08.280956 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5a4dfe3c-db8d-451f-9320-a0f0b31d7d5c tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:08.283472 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5a4dfe3c-db8d-451f-9320-a0f0b31d7d5c tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:08.289086 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5a4dfe3c-db8d-451f-9320-a0f0b31d7d5c tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:08.290161 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5a4dfe3c-db8d-451f-9320-a0f0b31d7d5c tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:08.290880 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5a4dfe3c-db8d-451f-9320-a0f0b31d7d5c tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:08.291764 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5a4dfe3c-db8d-451f-9320-a0f0b31d7d5c tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:08.377065 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-414de15c-7fc4-48b2-9641-4196927c6d61 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lazy-loading 'services' on Instance uuid d50976fb-756b-4b12-92f2-cedf87df492d {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:15:08.399940 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-414de15c-7fc4-48b2-9641-4196927c6d61 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d" status: 200 len: 1927 microversion: 2.75 time: 0.166599 Oct 19 03:15:08.413549 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 406/864] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:08 2022] GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d => generated 1927 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:15:08.541744 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-5a4dfe3c-db8d-451f-9320-a0f0b31d7d5c tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:08.544542 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-336d4f0d-b4e4-4171-998b-59e6ce81e9d4 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:08.550120 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-336d4f0d-b4e4-4171-998b-59e6ce81e9d4 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 393853e1-5f67-4c6b-972d-9f76de928599] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:08.550295 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5a4dfe3c-db8d-451f-9320-a0f0b31d7d5c tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667" status: 200 len: 1470 microversion: 2.1 time: 0.281062 Oct 19 03:15:08.550864 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 459/865] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:08 2022] GET /compute/v2.1/servers/ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667 => generated 1470 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:15:08.570045 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-336d4f0d-b4e4-4171-998b-59e6ce81e9d4 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:08.570629 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-336d4f0d-b4e4-4171-998b-59e6ce81e9d4 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:08.571135 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-336d4f0d-b4e4-4171-998b-59e6ce81e9d4 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:08.571848 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-336d4f0d-b4e4-4171-998b-59e6ce81e9d4 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:08.572301 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-336d4f0d-b4e4-4171-998b-59e6ce81e9d4 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:08.572765 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-336d4f0d-b4e4-4171-998b-59e6ce81e9d4 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:08.574521 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-77c68db6-d0dd-4453-8418-f286df62f515 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:15:08.575059 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-77c68db6-d0dd-4453-8418-f286df62f515 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:08.580902 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-77c68db6-d0dd-4453-8418-f286df62f515 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:08.581411 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-77c68db6-d0dd-4453-8418-f286df62f515 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:08.581848 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-77c68db6-d0dd-4453-8418-f286df62f515 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:08.582548 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-77c68db6-d0dd-4453-8418-f286df62f515 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:08.583004 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-77c68db6-d0dd-4453-8418-f286df62f515 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:08.583431 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-77c68db6-d0dd-4453-8418-f286df62f515 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:08.771382 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-77c68db6-d0dd-4453-8418-f286df62f515 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "POST /compute/v2.1/servers/ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667/action" status: 204 len: 0 microversion: 2.1 time: 0.201548 Oct 19 03:15:08.772703 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 460/866] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:15:08 2022] POST /compute/v2.1/servers/ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667/action => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 19 03:15:08.778669 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-16472689-e632-4da9-af51-9405fcc0341c tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:08.779467 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-16472689-e632-4da9-af51-9405fcc0341c tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: d67da55c-724e-4305-9960-99d15ecfb23a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:08.786111 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-16472689-e632-4da9-af51-9405fcc0341c tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:08.786614 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-16472689-e632-4da9-af51-9405fcc0341c tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:08.787253 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-16472689-e632-4da9-af51-9405fcc0341c tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:08.788349 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-16472689-e632-4da9-af51-9405fcc0341c tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:08.788812 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-16472689-e632-4da9-af51-9405fcc0341c tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:08.789441 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-16472689-e632-4da9-af51-9405fcc0341c tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:08.790383 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-336d4f0d-b4e4-4171-998b-59e6ce81e9d4 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:08.810536 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-336d4f0d-b4e4-4171-998b-59e6ce81e9d4 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/393853e1-5f67-4c6b-972d-9f76de928599" status: 200 len: 1467 microversion: 2.1 time: 0.267385 Oct 19 03:15:08.825907 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 407/867] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:08 2022] GET /compute/v2.1/servers/393853e1-5f67-4c6b-972d-9f76de928599 => generated 1467 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:15:08.841158 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9fb11eda-49d8-4d24-ac31-633ea3169f42 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:08.841835 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9fb11eda-49d8-4d24-ac31-633ea3169f42 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:08.848986 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9fb11eda-49d8-4d24-ac31-633ea3169f42 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:08.849516 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9fb11eda-49d8-4d24-ac31-633ea3169f42 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:08.849987 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9fb11eda-49d8-4d24-ac31-633ea3169f42 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:08.850702 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9fb11eda-49d8-4d24-ac31-633ea3169f42 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:08.851160 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9fb11eda-49d8-4d24-ac31-633ea3169f42 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:08.851890 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9fb11eda-49d8-4d24-ac31-633ea3169f42 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:09.152507 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-16472689-e632-4da9-af51-9405fcc0341c tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:09.160641 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-16472689-e632-4da9-af51-9405fcc0341c tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:09.162298 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-16472689-e632-4da9-af51-9405fcc0341c tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:09.163593 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-16472689-e632-4da9-af51-9405fcc0341c tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/d67da55c-724e-4305-9960-99d15ecfb23a" status: 200 len: 1565 microversion: 2.25 time: 0.389408 Oct 19 03:15:09.164239 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 461/868] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:08 2022] GET /compute/v2.1/servers/d67da55c-724e-4305-9960-99d15ecfb23a => generated 1565 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:15:09.186056 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-95367423-283e-4a60-aff0-102b545de39f tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:09.186680 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-95367423-283e-4a60-aff0-102b545de39f tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 8cb9ad03-e7f9-4d7f-8711-1e2f478b0d17] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:09.192803 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-95367423-283e-4a60-aff0-102b545de39f tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:09.193383 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-95367423-283e-4a60-aff0-102b545de39f tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:09.193841 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-95367423-283e-4a60-aff0-102b545de39f tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:09.194545 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-95367423-283e-4a60-aff0-102b545de39f tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:09.195003 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-95367423-283e-4a60-aff0-102b545de39f tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:09.195490 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-95367423-283e-4a60-aff0-102b545de39f tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:09.289299 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9fb11eda-49d8-4d24-ac31-633ea3169f42 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:09.298164 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9fb11eda-49d8-4d24-ac31-633ea3169f42 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667" status: 200 len: 1470 microversion: 2.1 time: 0.471144 Oct 19 03:15:09.299271 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 408/869] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:08 2022] GET /compute/v2.1/servers/ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667 => generated 1470 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:15:09.303933 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3dfff504-09c0-45f7-b496-8fdcd52c92df tempest-FlavorsV2NegativeTest-1842946823 tempest-FlavorsV2NegativeTest-1842946823-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-995290397", "imageRef": "e3e1f943-18ce-4179-916d-94e6843f1d7a", "flavorRef": "452"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:15:09.363664 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-3dfff504-09c0-45f7-b496-8fdcd52c92df tempest-FlavorsV2NegativeTest-1842946823 tempest-FlavorsV2NegativeTest-1842946823-project] validate_networks() for None {{(pid=121134) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:15:09.490934 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-95367423-283e-4a60-aff0-102b545de39f tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:09.494598 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:15:09.499168 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-95367423-283e-4a60-aff0-102b545de39f tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/8cb9ad03-e7f9-4d7f-8711-1e2f478b0d17" status: 200 len: 1466 microversion: 2.1 time: 0.333819 Oct 19 03:15:09.509590 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 462/870] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:09 2022] GET /compute/v2.1/servers/8cb9ad03-e7f9-4d7f-8711-1e2f478b0d17 => generated 1466 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:15:09.509590 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-daaeb90c-17f6-448c-9440-cbcece8b3fbc tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:09.509590 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-daaeb90c-17f6-448c-9440-cbcece8b3fbc tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] [instance: 540a7025-b935-49fb-bc51-edf44ac1e0c4] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:09.510844 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-daaeb90c-17f6-448c-9440-cbcece8b3fbc tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:09.511595 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-daaeb90c-17f6-448c-9440-cbcece8b3fbc tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:09.512043 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-daaeb90c-17f6-448c-9440-cbcece8b3fbc tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:09.512753 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-daaeb90c-17f6-448c-9440-cbcece8b3fbc tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:09.513215 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-daaeb90c-17f6-448c-9440-cbcece8b3fbc tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:09.513674 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-daaeb90c-17f6-448c-9440-cbcece8b3fbc tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:10.166088 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-daaeb90c-17f6-448c-9440-cbcece8b3fbc tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28072a54d5934ea28e7d3205841c0852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c12a432bbd43bd8f70ba6e941c28a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:10.175861 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-daaeb90c-17f6-448c-9440-cbcece8b3fbc tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] 10.222.0.52 "GET /compute/v2.1/servers/540a7025-b935-49fb-bc51-edf44ac1e0c4" status: 200 len: 1557 microversion: 2.1 time: 0.675027 Oct 19 03:15:10.176766 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 463/871] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:09 2022] GET /compute/v2.1/servers/540a7025-b935-49fb-bc51-edf44ac1e0c4 => generated 1557 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:15:10.190413 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0655327d-099d-4ba7-801d-2343b148d405 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:10.191550 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0655327d-099d-4ba7-801d-2343b148d405 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:10.202257 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-3dfff504-09c0-45f7-b496-8fdcd52c92df tempest-FlavorsV2NegativeTest-1842946823 tempest-FlavorsV2NegativeTest-1842946823-project] HTTP exception thrown: Flavor's memory is too small for requested image. Oct 19 03:15:10.205731 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3dfff504-09c0-45f7-b496-8fdcd52c92df tempest-FlavorsV2NegativeTest-1842946823 tempest-FlavorsV2NegativeTest-1842946823-project] Request method failure captured: Oct 19 03:15:10.205731 n-d-861333-8 devstack@n-api.service[121134]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 19 03:15:10.205731 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:15:10.205731 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:15:10.205731 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:15:10.205731 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 142 Oct 19 03:15:10.205731 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:15:10.205731 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:15:10.205731 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:15:10.205731 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:15:10.205731 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT2u7FTDWyO62-fmTJxz5yPhSLbivbcgPleQqszzm0QpqFhP1Uiy2uZyjY7Ibd40ldnsZsCg7XTq8fV-NwHmPJacSLbIrsc3P4X_Q475b_XDZZ9jZRFw0Ey4mu7BefXzm33n5TGe5Dq4mftmSwjEz4NXXuO7tWML2qBemFawzfiUfzbw Oct 19 03:15:10.205731 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:15:10.205731 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:15:10.205731 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:15:10.205731 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:15:10.205731 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:15:10.205731 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:15:10.205731 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: f5176f317d704e3f8f406a45fec3218b Oct 19 03:15:10.205731 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-FlavorsV2NegativeTest-1842946823 Oct 19 03:15:10.205731 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:15:10.205731 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:15:10.207064 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f5176f317d704e3f8f406a45fec3218b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f5176f317d704e3f8f406a45fec3218b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f5176f317d704e3f8f406a45fec3218b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f5176f317d704e3f8f406a45fec3218b", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:15:10.207064 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-FlavorsV2NegativeTest-1842946823 Oct 19 03:15:10.207064 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: f5176f317d704e3f8f406a45fec3218b Oct 19 03:15:10.207064 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-1842946823 Oct 19 03:15:10.207064 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-FlavorsV2NegativeTest-1842946823-project Oct 19 03:15:10.207064 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:15:10.207064 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:15:10.207064 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: db71d19166f0457f8136da72b93fc60a Oct 19 03:15:10.207064 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-FlavorsV2NegativeTest-1842946823-project Oct 19 03:15:10.207064 n-d-861333-8 devstack@n-api.service[121134]: Oct 19 03:15:10.207064 n-d-861333-8 devstack@n-api.service[121134]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-995290397", "imageRef": "e3e1f943-18ce-4179-916d-94e6843f1d7a", "flavorRef": "452"}} Oct 19 03:15:10.207064 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:15:10.207849 n-d-861333-8 devstack@n-api.service[121134]: exception: Flavor's memory is too small for requested image. Oct 19 03:15:10.207849 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-995290397', 'imageRef': 'e3e1f943-18ce-4179-916d-94e6843f1d7a', 'flavorRef': '452'}}} Oct 19 03:15:10.207849 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:15:10.207849 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:15:10.207849 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 19 03:15:10.207849 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 19 03:15:10.207849 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 19 03:15:10.207849 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 19 03:15:10.207849 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 19 03:15:10.207849 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 19 03:15:10.207849 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Oct 19 03:15:10.207849 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Oct 19 03:15:10.207849 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Oct 19 03:15:10.207849 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Oct 19 03:15:10.207849 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Oct 19 03:15:10.207849 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Oct 19 03:15:10.207849 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Oct 19 03:15:10.207849 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:15:10.207849 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:15:10.207849 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:15:10.209016 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:15:10.209016 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:15:10.209016 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:15:10.209016 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:15:10.209016 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:15:10.209016 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:15:10.209016 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:15:10.209016 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:15:10.209016 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:15:10.209016 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:15:10.209016 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:15:10.209016 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:15:10.209016 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:15:10.209016 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 19 03:15:10.209016 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Oct 19 03:15:10.209016 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 19 03:15:10.209016 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Oct 19 03:15:10.209016 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:15:10.209016 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:15:10.209016 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:15:10.209016 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:15:10.210360 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:15:10.210360 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:15:10.210360 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:15:10.210360 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:15:10.210360 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Oct 19 03:15:10.210360 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:15:10.214392 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3dfff504-09c0-45f7-b496-8fdcd52c92df tempest-FlavorsV2NegativeTest-1842946823 tempest-FlavorsV2NegativeTest-1842946823-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:15:10.216159 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3dfff504-09c0-45f7-b496-8fdcd52c92df tempest-FlavorsV2NegativeTest-1842946823 tempest-FlavorsV2NegativeTest-1842946823-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.915341 Oct 19 03:15:10.217180 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 409/872] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:15:09 2022] POST /compute/v2.1/servers => generated 93 bytes in 917 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 19 03:15:10.230252 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0655327d-099d-4ba7-801d-2343b148d405 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:10.231109 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0655327d-099d-4ba7-801d-2343b148d405 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:10.231953 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0655327d-099d-4ba7-801d-2343b148d405 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:10.234099 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0655327d-099d-4ba7-801d-2343b148d405 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:10.236673 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0655327d-099d-4ba7-801d-2343b148d405 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:10.237355 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0655327d-099d-4ba7-801d-2343b148d405 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:10.238060 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-af7ff2af-0d79-4456-be23-39d8b4cd21a1 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:10.239405 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-af7ff2af-0d79-4456-be23-39d8b4cd21a1 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] [instance: 6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:10.266859 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-af7ff2af-0d79-4456-be23-39d8b4cd21a1 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:10.273522 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-af7ff2af-0d79-4456-be23-39d8b4cd21a1 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:10.274211 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-af7ff2af-0d79-4456-be23-39d8b4cd21a1 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:10.275170 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-af7ff2af-0d79-4456-be23-39d8b4cd21a1 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:10.279496 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-af7ff2af-0d79-4456-be23-39d8b4cd21a1 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:10.280139 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-af7ff2af-0d79-4456-be23-39d8b4cd21a1 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:10.403112 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-0655327d-099d-4ba7-801d-2343b148d405 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:10.426416 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-0655327d-099d-4ba7-801d-2343b148d405 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:10.428011 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-0655327d-099d-4ba7-801d-2343b148d405 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:10.435042 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0655327d-099d-4ba7-801d-2343b148d405 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1555 microversion: 2.91 time: 0.256361 Oct 19 03:15:10.436286 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 464/873] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:10 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1555 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:15:10.471147 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-442be56e-d8fd-42d2-bfcc-55952da1a5ca tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:10.471967 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-442be56e-d8fd-42d2-bfcc-55952da1a5ca tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] [instance: d50976fb-756b-4b12-92f2-cedf87df492d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:10.480983 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-442be56e-d8fd-42d2-bfcc-55952da1a5ca tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:10.482055 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-442be56e-d8fd-42d2-bfcc-55952da1a5ca tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:10.483526 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-442be56e-d8fd-42d2-bfcc-55952da1a5ca tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:10.484445 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-442be56e-d8fd-42d2-bfcc-55952da1a5ca tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:10.485089 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-442be56e-d8fd-42d2-bfcc-55952da1a5ca tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:10.486713 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-442be56e-d8fd-42d2-bfcc-55952da1a5ca tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:10.623048 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-442be56e-d8fd-42d2-bfcc-55952da1a5ca tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lazy-loading 'services' on Instance uuid d50976fb-756b-4b12-92f2-cedf87df492d {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:15:10.633174 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-af7ff2af-0d79-4456-be23-39d8b4cd21a1 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cc37ae4bed94a7e85ed70dd5942c2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df99b134b20743eb9b62788706f2705a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:10.651111 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-af7ff2af-0d79-4456-be23-39d8b4cd21a1 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] 10.222.0.52 "GET /compute/v2.1/servers/6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1" status: 200 len: 1388 microversion: 2.1 time: 0.431691 Oct 19 03:15:10.665658 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 410/874] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:10 2022] GET /compute/v2.1/servers/6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1 => generated 1388 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:15:10.666284 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2904358d-28a3-42ce-a328-2364e83999eb tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:10.675793 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-442be56e-d8fd-42d2-bfcc-55952da1a5ca tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d" status: 200 len: 1927 microversion: 2.75 time: 0.219827 Oct 19 03:15:10.677531 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-2904358d-28a3-42ce-a328-2364e83999eb tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:10.678450 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2904358d-28a3-42ce-a328-2364e83999eb tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Searching by: {'reservation_id': 'r-f09kzq80', 'deleted': False, 'project_id': '5d909fe7763841d5b452738112b656d3'} {{(pid=121134) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 03:15:10.680338 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 465/875] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:10 2022] GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d => generated 1927 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:15:10.692137 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2904358d-28a3-42ce-a328-2364e83999eb tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:10.692811 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-4149fdb5-2434-4ebb-b7f2-df49167e09bc req-d2b06c0f-12ae-4d43-a72d-eedb2b941943 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d67da55c-724e-4305-9960-99d15ecfb23a", "name": "network-vif-unplugged", "status": "completed", "tag": "0816439e-71ce-4a08-8fd4-aa143aa0c267"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:15:10.699167 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2904358d-28a3-42ce-a328-2364e83999eb tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:10.700851 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2904358d-28a3-42ce-a328-2364e83999eb tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:10.701901 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2904358d-28a3-42ce-a328-2364e83999eb tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:10.702505 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2904358d-28a3-42ce-a328-2364e83999eb tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:10.703832 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2904358d-28a3-42ce-a328-2364e83999eb tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:10.716546 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-4149fdb5-2434-4ebb-b7f2-df49167e09bc req-d2b06c0f-12ae-4d43-a72d-eedb2b941943 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:10.720517 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-4149fdb5-2434-4ebb-b7f2-df49167e09bc req-d2b06c0f-12ae-4d43-a72d-eedb2b941943 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:10.721640 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-4149fdb5-2434-4ebb-b7f2-df49167e09bc req-d2b06c0f-12ae-4d43-a72d-eedb2b941943 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:10.743071 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-4149fdb5-2434-4ebb-b7f2-df49167e09bc req-d2b06c0f-12ae-4d43-a72d-eedb2b941943 service nova] Creating event network-vif-unplugged:0816439e-71ce-4a08-8fd4-aa143aa0c267 for instance d67da55c-724e-4305-9960-99d15ecfb23a on n-h1-861333-8 Oct 19 03:15:10.749757 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-4149fdb5-2434-4ebb-b7f2-df49167e09bc req-d2b06c0f-12ae-4d43-a72d-eedb2b941943 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.068126 Oct 19 03:15:10.751168 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 466/876] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:15:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:15:10.775866 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9f2c505d-f30c-43b8-a54a-61f0db5602a2 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:10.780132 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9f2c505d-f30c-43b8-a54a-61f0db5602a2 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: d67da55c-724e-4305-9960-99d15ecfb23a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:10.797941 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9f2c505d-f30c-43b8-a54a-61f0db5602a2 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:10.801686 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9f2c505d-f30c-43b8-a54a-61f0db5602a2 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:10.802508 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9f2c505d-f30c-43b8-a54a-61f0db5602a2 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:10.804380 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9f2c505d-f30c-43b8-a54a-61f0db5602a2 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:10.807689 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9f2c505d-f30c-43b8-a54a-61f0db5602a2 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:10.809089 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9f2c505d-f30c-43b8-a54a-61f0db5602a2 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:10.979465 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.multi_cell_list [None req-2904358d-28a3-42ce-a328-2364e83999eb tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=121134) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 03:15:11.073867 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-2904358d-28a3-42ce-a328-2364e83999eb tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:11.083172 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2904358d-28a3-42ce-a328-2364e83999eb tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:11.083878 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2904358d-28a3-42ce-a328-2364e83999eb tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:11.084472 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2904358d-28a3-42ce-a328-2364e83999eb tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:11.088698 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-9f2c505d-f30c-43b8-a54a-61f0db5602a2 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:11.099686 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-9f2c505d-f30c-43b8-a54a-61f0db5602a2 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:11.101668 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-9f2c505d-f30c-43b8-a54a-61f0db5602a2 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:11.103349 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9f2c505d-f30c-43b8-a54a-61f0db5602a2 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/d67da55c-724e-4305-9960-99d15ecfb23a" status: 200 len: 1565 microversion: 2.25 time: 0.348289 Oct 19 03:15:11.104494 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 467/877] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:10 2022] GET /compute/v2.1/servers/d67da55c-724e-4305-9960-99d15ecfb23a => generated 1565 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:15:11.111231 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-971d3845-9c71-475d-afc7-f0dc18c11442 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:11.112023 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-971d3845-9c71-475d-afc7-f0dc18c11442 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] [instance: 540a7025-b935-49fb-bc51-edf44ac1e0c4] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:11.115326 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=100 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:15:11.119369 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-971d3845-9c71-475d-afc7-f0dc18c11442 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:11.120149 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-971d3845-9c71-475d-afc7-f0dc18c11442 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:11.121255 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-971d3845-9c71-475d-afc7-f0dc18c11442 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:11.122214 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-971d3845-9c71-475d-afc7-f0dc18c11442 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:11.122880 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-971d3845-9c71-475d-afc7-f0dc18c11442 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:11.123517 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-971d3845-9c71-475d-afc7-f0dc18c11442 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:11.250026 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-971d3845-9c71-475d-afc7-f0dc18c11442 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] 10.222.0.52 "GET /compute/v2.1/servers/540a7025-b935-49fb-bc51-edf44ac1e0c4/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.141895 Oct 19 03:15:11.250730 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 468/878] 10.222.0.52 () {58 vars in 1275 bytes} [Wed Oct 19 03:15:11 2022] GET /compute/v2.1/servers/540a7025-b935-49fb-bc51-edf44ac1e0c4/os-interface => generated 285 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:15:11.257266 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-8899f6f4-c22b-47c5-b20a-263bfd9ad9db tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:11.267219 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2904358d-28a3-42ce-a328-2364e83999eb tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/detail?reservation_id=r-f09kzq80" status: 200 len: 2926 microversion: 2.1 time: 0.611311 Oct 19 03:15:11.268283 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 411/879] 10.222.0.52 () {58 vars in 1197 bytes} [Wed Oct 19 03:15:10 2022] GET /compute/v2.1/servers/detail?reservation_id=r-f09kzq80 => generated 2926 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:15:11.269429 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-8899f6f4-c22b-47c5-b20a-263bfd9ad9db tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:11.283423 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8899f6f4-c22b-47c5-b20a-263bfd9ad9db tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:11.286584 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-2b1bdcd2-0b96-4189-bee9-027d8a69cbda req-5a6a04d2-b7b0-463c-b945-9b12d506d5c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667", "name": "network-vif-plugged", "status": "completed", "tag": "93027c05-97a2-4189-89b6-b07e9d59b6c4"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:15:11.287099 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8899f6f4-c22b-47c5-b20a-263bfd9ad9db tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:11.287765 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8899f6f4-c22b-47c5-b20a-263bfd9ad9db tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:11.292966 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8899f6f4-c22b-47c5-b20a-263bfd9ad9db tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:11.298048 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8899f6f4-c22b-47c5-b20a-263bfd9ad9db tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:11.298869 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-2b1bdcd2-0b96-4189-bee9-027d8a69cbda req-5a6a04d2-b7b0-463c-b945-9b12d506d5c1 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:11.298980 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8899f6f4-c22b-47c5-b20a-263bfd9ad9db tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:11.299191 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-2b1bdcd2-0b96-4189-bee9-027d8a69cbda req-5a6a04d2-b7b0-463c-b945-9b12d506d5c1 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:11.300166 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-2b1bdcd2-0b96-4189-bee9-027d8a69cbda req-5a6a04d2-b7b0-463c-b945-9b12d506d5c1 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:11.315233 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-2b1bdcd2-0b96-4189-bee9-027d8a69cbda req-5a6a04d2-b7b0-463c-b945-9b12d506d5c1 service nova] Creating event network-vif-plugged:93027c05-97a2-4189-89b6-b07e9d59b6c4 for instance ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667 on n-h1-861333-8 Oct 19 03:15:11.322069 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [req-2b1bdcd2-0b96-4189-bee9-027d8a69cbda req-5a6a04d2-b7b0-463c-b945-9b12d506d5c1 service nova] Instance ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-861333-8', 'n-h1-861333-8'} {{(pid=121134) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 03:15:11.334425 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-2b1bdcd2-0b96-4189-bee9-027d8a69cbda req-5a6a04d2-b7b0-463c-b945-9b12d506d5c1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062165 Oct 19 03:15:11.335406 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 412/880] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:15:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:15:11.340856 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-dc37aca1-2391-4968-bad4-40b4e06c3386 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:11.376970 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.compute.server_groups [None req-dc37aca1-2391-4968-bad4-40b4e06c3386 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Querying cell d204a9a6-30d3-4569-8922-0d4cbe966b78(cell1) for 2 instances {{(pid=121134) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 19 03:15:11.377803 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dc37aca1-2391-4968-bad4-40b4e06c3386 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:11.378200 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dc37aca1-2391-4968-bad4-40b4e06c3386 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:11.378691 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dc37aca1-2391-4968-bad4-40b4e06c3386 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:11.446476 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-dc37aca1-2391-4968-bad4-40b4e06c3386 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/os-server-groups/6be7c922-3b62-4fd1-9592-afaa18651367" status: 200 len: 265 microversion: 2.1 time: 0.109771 Oct 19 03:15:11.453045 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 413/881] 10.222.0.52 () {58 vars in 1263 bytes} [Wed Oct 19 03:15:11 2022] GET /compute/v2.1/os-server-groups/6be7c922-3b62-4fd1-9592-afaa18651367 => generated 265 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:15:11.459852 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-802bf036-1486-48be-9024-f1dbea0978b7 tempest-ServersOnMultiNodesTest-74681315 tempest-ServersOnMultiNodesTest-74681315-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:11.461094 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-802bf036-1486-48be-9024-f1dbea0978b7 tempest-ServersOnMultiNodesTest-74681315 tempest-ServersOnMultiNodesTest-74681315-project-admin] [instance: 393853e1-5f67-4c6b-972d-9f76de928599] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:11.477919 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-802bf036-1486-48be-9024-f1dbea0978b7 tempest-ServersOnMultiNodesTest-74681315 tempest-ServersOnMultiNodesTest-74681315-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:11.482740 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-802bf036-1486-48be-9024-f1dbea0978b7 tempest-ServersOnMultiNodesTest-74681315 tempest-ServersOnMultiNodesTest-74681315-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:11.485184 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-802bf036-1486-48be-9024-f1dbea0978b7 tempest-ServersOnMultiNodesTest-74681315 tempest-ServersOnMultiNodesTest-74681315-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:11.486495 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-802bf036-1486-48be-9024-f1dbea0978b7 tempest-ServersOnMultiNodesTest-74681315 tempest-ServersOnMultiNodesTest-74681315-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:11.491533 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-802bf036-1486-48be-9024-f1dbea0978b7 tempest-ServersOnMultiNodesTest-74681315 tempest-ServersOnMultiNodesTest-74681315-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:11.494960 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-802bf036-1486-48be-9024-f1dbea0978b7 tempest-ServersOnMultiNodesTest-74681315 tempest-ServersOnMultiNodesTest-74681315-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:11.531124 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-8899f6f4-c22b-47c5-b20a-263bfd9ad9db tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:11.542063 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-8899f6f4-c22b-47c5-b20a-263bfd9ad9db tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667" status: 200 len: 1470 microversion: 2.1 time: 0.290044 Oct 19 03:15:11.564014 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 469/882] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:11 2022] GET /compute/v2.1/servers/ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667 => generated 1470 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:15:11.578098 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d5f3e6bd-d634-47e2-ae2d-4b3c2036c5d4 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:11.578793 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d5f3e6bd-d634-47e2-ae2d-4b3c2036c5d4 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:11.597030 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d5f3e6bd-d634-47e2-ae2d-4b3c2036c5d4 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:11.597617 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d5f3e6bd-d634-47e2-ae2d-4b3c2036c5d4 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:11.599405 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d5f3e6bd-d634-47e2-ae2d-4b3c2036c5d4 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:11.600902 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d5f3e6bd-d634-47e2-ae2d-4b3c2036c5d4 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:11.607312 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d5f3e6bd-d634-47e2-ae2d-4b3c2036c5d4 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:11.608377 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d5f3e6bd-d634-47e2-ae2d-4b3c2036c5d4 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:11.735527 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d5f3e6bd-d634-47e2-ae2d-4b3c2036c5d4 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:11.745208 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d5f3e6bd-d634-47e2-ae2d-4b3c2036c5d4 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:11.747848 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d5f3e6bd-d634-47e2-ae2d-4b3c2036c5d4 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:11.754924 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d5f3e6bd-d634-47e2-ae2d-4b3c2036c5d4 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1537 microversion: 2.91 time: 0.188052 Oct 19 03:15:11.756124 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 470/883] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:11 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1537 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:15:11.762599 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-45f060c2-61ea-4ecd-b77c-615eb061bbc0 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:11.763425 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-45f060c2-61ea-4ecd-b77c-615eb061bbc0 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] [instance: 6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:11.772194 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-45f060c2-61ea-4ecd-b77c-615eb061bbc0 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:11.773153 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-45f060c2-61ea-4ecd-b77c-615eb061bbc0 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:11.773784 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-45f060c2-61ea-4ecd-b77c-615eb061bbc0 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:11.774758 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-45f060c2-61ea-4ecd-b77c-615eb061bbc0 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:11.776005 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-45f060c2-61ea-4ecd-b77c-615eb061bbc0 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:11.782209 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-45f060c2-61ea-4ecd-b77c-615eb061bbc0 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:11.809432 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-802bf036-1486-48be-9024-f1dbea0978b7 tempest-ServersOnMultiNodesTest-74681315 tempest-ServersOnMultiNodesTest-74681315-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/393853e1-5f67-4c6b-972d-9f76de928599" status: 200 len: 1618 microversion: 2.1 time: 0.354401 Oct 19 03:15:11.811968 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 414/884] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:11 2022] GET /compute/v2.1/servers/393853e1-5f67-4c6b-972d-9f76de928599 => generated 1618 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:15:11.820691 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-66b5b4ab-6b28-4d1d-9a73-0d118a59eb20 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:11.827000 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-66b5b4ab-6b28-4d1d-9a73-0d118a59eb20 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] [instance: d50976fb-756b-4b12-92f2-cedf87df492d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:11.837128 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-66b5b4ab-6b28-4d1d-9a73-0d118a59eb20 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:11.837882 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-66b5b4ab-6b28-4d1d-9a73-0d118a59eb20 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:11.838492 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-66b5b4ab-6b28-4d1d-9a73-0d118a59eb20 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:11.839372 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-66b5b4ab-6b28-4d1d-9a73-0d118a59eb20 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:11.839990 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-66b5b4ab-6b28-4d1d-9a73-0d118a59eb20 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:11.840566 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-66b5b4ab-6b28-4d1d-9a73-0d118a59eb20 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:11.952479 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-66b5b4ab-6b28-4d1d-9a73-0d118a59eb20 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lazy-loading 'services' on Instance uuid d50976fb-756b-4b12-92f2-cedf87df492d {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:15:11.978682 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-66b5b4ab-6b28-4d1d-9a73-0d118a59eb20 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d" status: 200 len: 1927 microversion: 2.75 time: 0.162990 Oct 19 03:15:11.979862 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 415/885] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:11 2022] GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d => generated 1927 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:15:11.985494 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-789daa46-4b0c-46cb-8e6f-f1aed7997d12 tempest-ServersOnMultiNodesTest-74681315 tempest-ServersOnMultiNodesTest-74681315-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:11.986433 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-789daa46-4b0c-46cb-8e6f-f1aed7997d12 tempest-ServersOnMultiNodesTest-74681315 tempest-ServersOnMultiNodesTest-74681315-project-admin] [instance: 8cb9ad03-e7f9-4d7f-8711-1e2f478b0d17] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:11.993087 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-789daa46-4b0c-46cb-8e6f-f1aed7997d12 tempest-ServersOnMultiNodesTest-74681315 tempest-ServersOnMultiNodesTest-74681315-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:11.994867 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-789daa46-4b0c-46cb-8e6f-f1aed7997d12 tempest-ServersOnMultiNodesTest-74681315 tempest-ServersOnMultiNodesTest-74681315-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:11.995535 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-789daa46-4b0c-46cb-8e6f-f1aed7997d12 tempest-ServersOnMultiNodesTest-74681315 tempest-ServersOnMultiNodesTest-74681315-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:11.996615 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-789daa46-4b0c-46cb-8e6f-f1aed7997d12 tempest-ServersOnMultiNodesTest-74681315 tempest-ServersOnMultiNodesTest-74681315-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:11.997512 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-789daa46-4b0c-46cb-8e6f-f1aed7997d12 tempest-ServersOnMultiNodesTest-74681315 tempest-ServersOnMultiNodesTest-74681315-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:11.998320 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-789daa46-4b0c-46cb-8e6f-f1aed7997d12 tempest-ServersOnMultiNodesTest-74681315 tempest-ServersOnMultiNodesTest-74681315-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:12.048825 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-45f060c2-61ea-4ecd-b77c-615eb061bbc0 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cc37ae4bed94a7e85ed70dd5942c2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df99b134b20743eb9b62788706f2705a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:12.059735 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-45f060c2-61ea-4ecd-b77c-615eb061bbc0 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] 10.222.0.52 "GET /compute/v2.1/servers/6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1" status: 200 len: 1587 microversion: 2.1 time: 0.301975 Oct 19 03:15:12.061492 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 471/886] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:11 2022] GET /compute/v2.1/servers/6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1 => generated 1587 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:15:12.091173 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-999d71c8-9cf7-42d6-a348-082ca5d88edf tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:12.107057 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-999d71c8-9cf7-42d6-a348-082ca5d88edf tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] [instance: 6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:12.107057 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-999d71c8-9cf7-42d6-a348-082ca5d88edf tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:12.107057 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-999d71c8-9cf7-42d6-a348-082ca5d88edf tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:12.107057 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-999d71c8-9cf7-42d6-a348-082ca5d88edf tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:12.107602 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-999d71c8-9cf7-42d6-a348-082ca5d88edf tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:12.107602 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-999d71c8-9cf7-42d6-a348-082ca5d88edf tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:12.107602 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-999d71c8-9cf7-42d6-a348-082ca5d88edf tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:12.206338 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-789daa46-4b0c-46cb-8e6f-f1aed7997d12 tempest-ServersOnMultiNodesTest-74681315 tempest-ServersOnMultiNodesTest-74681315-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/8cb9ad03-e7f9-4d7f-8711-1e2f478b0d17" status: 200 len: 1617 microversion: 2.1 time: 0.224435 Oct 19 03:15:12.207485 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 416/887] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:11 2022] GET /compute/v2.1/servers/8cb9ad03-e7f9-4d7f-8711-1e2f478b0d17 => generated 1617 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:15:12.213313 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-180fa643-22c4-4f57-93d9-4a12a13d1ff2 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:12.214045 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-180fa643-22c4-4f57-93d9-4a12a13d1ff2 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: d67da55c-724e-4305-9960-99d15ecfb23a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:12.222226 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-180fa643-22c4-4f57-93d9-4a12a13d1ff2 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:12.222801 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-180fa643-22c4-4f57-93d9-4a12a13d1ff2 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:12.228017 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-180fa643-22c4-4f57-93d9-4a12a13d1ff2 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:12.228017 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-180fa643-22c4-4f57-93d9-4a12a13d1ff2 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:12.228017 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-180fa643-22c4-4f57-93d9-4a12a13d1ff2 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:12.228017 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-180fa643-22c4-4f57-93d9-4a12a13d1ff2 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:12.265974 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-999d71c8-9cf7-42d6-a348-082ca5d88edf tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] 10.222.0.52 "GET /compute/v2.1/servers/6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.185282 Oct 19 03:15:12.267505 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 472/888] 10.222.0.52 () {58 vars in 1275 bytes} [Wed Oct 19 03:15:12 2022] GET /compute/v2.1/servers/6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1/os-interface => generated 284 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:15:12.283910 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5ff7d368-4396-4859-b9da-d2471aa56d3e tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Action: 'create', calling method: .version_select at 0x7fc1311bc8b0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1392329751", "policies": ["anti-affinity"]}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:15:12.306924 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-5ff7d368-4396-4859-b9da-d2471aa56d3e tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Getting quotas for project 5d909fe7763841d5b452738112b656d3. Resources: {'server_groups'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:15:12.312967 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-5ff7d368-4396-4859-b9da-d2471aa56d3e tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Getting quotas for user 3e4d3ddb3a324d9da51c13701e318955 and project 5d909fe7763841d5b452738112b656d3. Resources: {'server_groups'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:15:12.426123 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-5ff7d368-4396-4859-b9da-d2471aa56d3e tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Getting quotas for project 5d909fe7763841d5b452738112b656d3. Resources: {'server_groups'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:15:12.430697 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-5ff7d368-4396-4859-b9da-d2471aa56d3e tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Getting quotas for user 3e4d3ddb3a324d9da51c13701e318955 and project 5d909fe7763841d5b452738112b656d3. Resources: {'server_groups'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:15:12.444990 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5ff7d368-4396-4859-b9da-d2471aa56d3e tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.176254 Oct 19 03:15:12.445900 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 473/889] 10.222.0.52 () {60 vars in 1174 bytes} [Wed Oct 19 03:15:12 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:15:12.562783 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b2bbbc2d-3729-460e-891e-ca1580a84975 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-630869417", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "99c091b4-fcf8-4b85-ba19-1004305c9cf8"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:15:12.587307 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-180fa643-22c4-4f57-93d9-4a12a13d1ff2 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:12.608031 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-180fa643-22c4-4f57-93d9-4a12a13d1ff2 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:12.609603 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-180fa643-22c4-4f57-93d9-4a12a13d1ff2 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:12.613398 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-180fa643-22c4-4f57-93d9-4a12a13d1ff2 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/d67da55c-724e-4305-9960-99d15ecfb23a" status: 200 len: 1565 microversion: 2.25 time: 0.401958 Oct 19 03:15:12.625760 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 417/890] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:12 2022] GET /compute/v2.1/servers/d67da55c-724e-4305-9960-99d15ecfb23a => generated 1565 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:15:12.631828 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.network.neutron [None req-b2bbbc2d-3729-460e-891e-ca1580a84975 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] validate_networks() for None {{(pid=121135) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:15:12.634155 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1a2e6649-14d0-4a99-81fd-fc8c9639b4dd tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:12.634778 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1a2e6649-14d0-4a99-81fd-fc8c9639b4dd tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:12.641999 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1a2e6649-14d0-4a99-81fd-fc8c9639b4dd tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:12.642696 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1a2e6649-14d0-4a99-81fd-fc8c9639b4dd tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:12.643338 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1a2e6649-14d0-4a99-81fd-fc8c9639b4dd tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:12.644045 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1a2e6649-14d0-4a99-81fd-fc8c9639b4dd tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:12.644506 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1a2e6649-14d0-4a99-81fd-fc8c9639b4dd tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:12.644934 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1a2e6649-14d0-4a99-81fd-fc8c9639b4dd tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:12.649358 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=100 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:15:13.135248 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-1a2e6649-14d0-4a99-81fd-fc8c9639b4dd tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:13.151576 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1a2e6649-14d0-4a99-81fd-fc8c9639b4dd tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667" status: 200 len: 1462 microversion: 2.1 time: 0.524639 Oct 19 03:15:13.153097 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 418/891] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:12 2022] GET /compute/v2.1/servers/ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667 => generated 1462 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:15:13.167191 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-c6b4deee-3e7d-4b89-b061-eba769ce36ff req-f280947f-72f7-4b69-8d9d-fe12d5718e73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d67da55c-724e-4305-9960-99d15ecfb23a", "tag": "0816439e-71ce-4a08-8fd4-aa143aa0c267"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:15:13.184125 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-c6b4deee-3e7d-4b89-b061-eba769ce36ff req-f280947f-72f7-4b69-8d9d-fe12d5718e73 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:13.184966 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-c6b4deee-3e7d-4b89-b061-eba769ce36ff req-f280947f-72f7-4b69-8d9d-fe12d5718e73 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:13.185615 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-c6b4deee-3e7d-4b89-b061-eba769ce36ff req-f280947f-72f7-4b69-8d9d-fe12d5718e73 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:13.217544 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-c6b4deee-3e7d-4b89-b061-eba769ce36ff req-f280947f-72f7-4b69-8d9d-fe12d5718e73 service nova] Creating event network-changed:0816439e-71ce-4a08-8fd4-aa143aa0c267 for instance d67da55c-724e-4305-9960-99d15ecfb23a on n-h1-861333-8 Oct 19 03:15:13.223757 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-c6b4deee-3e7d-4b89-b061-eba769ce36ff req-f280947f-72f7-4b69-8d9d-fe12d5718e73 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068259 Oct 19 03:15:13.223984 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 419/892] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:15:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:15:13.235362 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-21514e98-e84c-49cd-ba48-fdc89222ee1c tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:13.235362 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-21514e98-e84c-49cd-ba48-fdc89222ee1c tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:13.239999 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-21514e98-e84c-49cd-ba48-fdc89222ee1c tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:13.240137 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-21514e98-e84c-49cd-ba48-fdc89222ee1c tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:13.240878 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-21514e98-e84c-49cd-ba48-fdc89222ee1c tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:13.241680 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-21514e98-e84c-49cd-ba48-fdc89222ee1c tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:13.242267 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-21514e98-e84c-49cd-ba48-fdc89222ee1c tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:13.242769 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-21514e98-e84c-49cd-ba48-fdc89222ee1c tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:13.594243 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-21514e98-e84c-49cd-ba48-fdc89222ee1c tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:13.602892 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-21514e98-e84c-49cd-ba48-fdc89222ee1c tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:13.604348 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-21514e98-e84c-49cd-ba48-fdc89222ee1c tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:13.610653 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-21514e98-e84c-49cd-ba48-fdc89222ee1c tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1537 microversion: 2.91 time: 0.385404 Oct 19 03:15:13.626223 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 420/893] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:13 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1537 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:15:13.641157 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-f9e6964a-4ed6-4f77-969e-1a08ffe1718a req-20d1c14f-bfe8-4a7a-89da-137d918998a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "540a7025-b935-49fb-bc51-edf44ac1e0c4", "tag": "e54cc460-46ae-45ff-9a37-9bdfc282d2aa"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:15:13.647180 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-b2bbbc2d-3729-460e-891e-ca1580a84975 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Flavor limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:15:13.647661 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-b2bbbc2d-3729-460e-891e-ca1580a84975 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Image limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:15:13.648069 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-b2bbbc2d-3729-460e-891e-ca1580a84975 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Flavor pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:15:13.648471 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-b2bbbc2d-3729-460e-891e-ca1580a84975 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Image pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:15:13.649119 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-b2bbbc2d-3729-460e-891e-ca1580a84975 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:15:13.671608 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-f9e6964a-4ed6-4f77-969e-1a08ffe1718a req-20d1c14f-bfe8-4a7a-89da-137d918998a0 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:13.676074 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-f9e6964a-4ed6-4f77-969e-1a08ffe1718a req-20d1c14f-bfe8-4a7a-89da-137d918998a0 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:13.676521 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-f9e6964a-4ed6-4f77-969e-1a08ffe1718a req-20d1c14f-bfe8-4a7a-89da-137d918998a0 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:13.680873 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b2bbbc2d-3729-460e-891e-ca1580a84975 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:13.681523 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b2bbbc2d-3729-460e-891e-ca1580a84975 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:13.686021 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b2bbbc2d-3729-460e-891e-ca1580a84975 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:13.686021 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b2bbbc2d-3729-460e-891e-ca1580a84975 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:13.686021 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b2bbbc2d-3729-460e-891e-ca1580a84975 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:13.686021 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b2bbbc2d-3729-460e-891e-ca1580a84975 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:13.692554 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-f9e6964a-4ed6-4f77-969e-1a08ffe1718a req-20d1c14f-bfe8-4a7a-89da-137d918998a0 service nova] Creating event network-changed:e54cc460-46ae-45ff-9a37-9bdfc282d2aa for instance 540a7025-b935-49fb-bc51-edf44ac1e0c4 on n-h1-861333-8 Oct 19 03:15:13.697842 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-f9e6964a-4ed6-4f77-969e-1a08ffe1718a req-20d1c14f-bfe8-4a7a-89da-137d918998a0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070400 Oct 19 03:15:13.698682 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 421/894] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:15:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:15:13.705822 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e2556059-9547-4b6f-9ab7-8a3eeb380251 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:13.708990 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-b2bbbc2d-3729-460e-891e-ca1580a84975 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Getting quotas for project 5d909fe7763841d5b452738112b656d3. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:15:13.711136 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e2556059-9547-4b6f-9ab7-8a3eeb380251 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] [instance: d50976fb-756b-4b12-92f2-cedf87df492d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:13.720579 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-b2bbbc2d-3729-460e-891e-ca1580a84975 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Getting quotas for user 3e4d3ddb3a324d9da51c13701e318955 and project 5d909fe7763841d5b452738112b656d3. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:15:13.720687 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e2556059-9547-4b6f-9ab7-8a3eeb380251 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:13.720687 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e2556059-9547-4b6f-9ab7-8a3eeb380251 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:13.720687 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e2556059-9547-4b6f-9ab7-8a3eeb380251 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:13.721063 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e2556059-9547-4b6f-9ab7-8a3eeb380251 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:13.721308 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e2556059-9547-4b6f-9ab7-8a3eeb380251 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:13.722001 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e2556059-9547-4b6f-9ab7-8a3eeb380251 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:13.744693 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b2bbbc2d-3729-460e-891e-ca1580a84975 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Going to run 2 instances... {{(pid=121135) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:15:13.749727 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b2bbbc2d-3729-460e-891e-ca1580a84975 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 46e24c0c-6e9f-4a51-a10e-dcb68ebf6f9d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121135) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:15:13.831160 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-e2556059-9547-4b6f-9ab7-8a3eeb380251 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lazy-loading 'services' on Instance uuid d50976fb-756b-4b12-92f2-cedf87df492d {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:15:13.851716 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e2556059-9547-4b6f-9ab7-8a3eeb380251 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d" status: 200 len: 1927 microversion: 2.75 time: 0.150921 Oct 19 03:15:13.852911 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 422/895] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:13 2022] GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d => generated 1927 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:15:13.863137 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8f2c5448-1e9f-4d6e-8bc5-4eff89726db5 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:13.864697 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8f2c5448-1e9f-4d6e-8bc5-4eff89726db5 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:13.871291 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8f2c5448-1e9f-4d6e-8bc5-4eff89726db5 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:13.875668 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8f2c5448-1e9f-4d6e-8bc5-4eff89726db5 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:13.875668 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8f2c5448-1e9f-4d6e-8bc5-4eff89726db5 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:13.875668 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8f2c5448-1e9f-4d6e-8bc5-4eff89726db5 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:13.875668 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8f2c5448-1e9f-4d6e-8bc5-4eff89726db5 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:13.876019 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8f2c5448-1e9f-4d6e-8bc5-4eff89726db5 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:13.938991 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-b2bbbc2d-3729-460e-891e-ca1580a84975 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Getting quotas for project 5d909fe7763841d5b452738112b656d3. Resources: {'server_group_members'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:15:13.944482 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-b2bbbc2d-3729-460e-891e-ca1580a84975 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Getting quotas for user 3e4d3ddb3a324d9da51c13701e318955 and project 5d909fe7763841d5b452738112b656d3. Resources: {'server_group_members'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:15:14.076010 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-b2bbbc2d-3729-460e-891e-ca1580a84975 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Getting quotas for project 5d909fe7763841d5b452738112b656d3. Resources: {'server_group_members'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:15:14.082053 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-b2bbbc2d-3729-460e-891e-ca1580a84975 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Getting quotas for user 3e4d3ddb3a324d9da51c13701e318955 and project 5d909fe7763841d5b452738112b656d3. Resources: {'server_group_members'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:15:14.097826 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b2bbbc2d-3729-460e-891e-ca1580a84975 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 88b09b16-f667-4ab9-89ca-a26dc86967ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=46e24c0c-6e9f-4a51-a10e-dcb68ebf6f9d,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121135) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:15:14.137301 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8f2c5448-1e9f-4d6e-8bc5-4eff89726db5 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:14.145664 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8f2c5448-1e9f-4d6e-8bc5-4eff89726db5 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667" status: 200 len: 1462 microversion: 2.1 time: 0.290833 Oct 19 03:15:14.149974 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 423/896] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:13 2022] GET /compute/v2.1/servers/ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667 => generated 1462 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:15:14.150860 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-17d66abb-7d83-489f-b32f-54da1ebb75e0 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:14.152668 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-17d66abb-7d83-489f-b32f-54da1ebb75e0 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: d67da55c-724e-4305-9960-99d15ecfb23a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:14.159946 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-17d66abb-7d83-489f-b32f-54da1ebb75e0 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:14.160443 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-17d66abb-7d83-489f-b32f-54da1ebb75e0 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:14.161010 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-17d66abb-7d83-489f-b32f-54da1ebb75e0 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:14.162356 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-17d66abb-7d83-489f-b32f-54da1ebb75e0 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:14.162822 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-17d66abb-7d83-489f-b32f-54da1ebb75e0 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:14.163779 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-17d66abb-7d83-489f-b32f-54da1ebb75e0 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:14.225114 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-b2bbbc2d-3729-460e-891e-ca1580a84975 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Getting quotas for project 5d909fe7763841d5b452738112b656d3. Resources: {'server_group_members'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:15:14.231590 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-b2bbbc2d-3729-460e-891e-ca1580a84975 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Getting quotas for user 3e4d3ddb3a324d9da51c13701e318955 and project 5d909fe7763841d5b452738112b656d3. Resources: {'server_group_members'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:15:14.409219 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:15:14.414618 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-b2bbbc2d-3729-460e-891e-ca1580a84975 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Getting quotas for project 5d909fe7763841d5b452738112b656d3. Resources: {'server_group_members'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:15:14.430544 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-b2bbbc2d-3729-460e-891e-ca1580a84975 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Getting quotas for user 3e4d3ddb3a324d9da51c13701e318955 and project 5d909fe7763841d5b452738112b656d3. Resources: {'server_group_members'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:15:14.449237 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-17d66abb-7d83-489f-b32f-54da1ebb75e0 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:14.457498 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-17d66abb-7d83-489f-b32f-54da1ebb75e0 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:14.463063 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-17d66abb-7d83-489f-b32f-54da1ebb75e0 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:14.463063 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-17d66abb-7d83-489f-b32f-54da1ebb75e0 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/d67da55c-724e-4305-9960-99d15ecfb23a" status: 200 len: 1565 microversion: 2.25 time: 0.312971 Oct 19 03:15:14.474124 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 424/897] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:14 2022] GET /compute/v2.1/servers/d67da55c-724e-4305-9960-99d15ecfb23a => generated 1565 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:15:14.492724 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b2bbbc2d-3729-460e-891e-ca1580a84975 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.935154 Oct 19 03:15:14.496085 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 474/898] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:15:12 2022] POST /compute/v2.1/servers => generated 32 bytes in 1939 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 19 03:15:14.510152 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7d37b305-ae81-4310-af17-5ee672eb1be3 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Action: 'create', calling method: .version_select at 0x7fc13138c1f0>, body: {"keypair": {"name": "tempest-keypair-659779218", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP9C+N1psKPlaWIWCz6djjDFgu/M2h1mE2zY/Wlg03Q2Oa4/mpP9LdlpWolNbznA7MaVT3bZnjHr34FY+DcPs/Bbhti26Iyr0/CDdjWJYa5zajSy2BZcL4yaAJKjrJAX0g=="}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:15:14.572309 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-7d37b305-ae81-4310-af17-5ee672eb1be3 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Getting quotas for project c9a76121a22144499a44f44bb78848bf. Resources: {'key_pairs'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:15:14.587472 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-7d37b305-ae81-4310-af17-5ee672eb1be3 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Getting quotas for user 9f8493504d9243bc95c9861f4ff76c83 and project c9a76121a22144499a44f44bb78848bf. Resources: {'key_pairs'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:15:14.670137 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4cfe31b8-4665-4a82-bd69-d376e9e572e5 tempest-ListImagesTestJSON-77589868 tempest-ListImagesTestJSON-77589868-project] Calling method '.version_select at 0x7fc1312ecee0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:14.684939 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7d37b305-ae81-4310-af17-5ee672eb1be3 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.185186 Oct 19 03:15:14.690587 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 475/899] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Oct 19 03:15:14 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:15:14.698583 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-408ad589-ae6c-44b2-a826-2a6198c147e0 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:14.715562 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-408ad589-ae6c-44b2-a826-2a6198c147e0 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:14.716346 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-408ad589-ae6c-44b2-a826-2a6198c147e0 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Searching by: {'deleted': False, 'project_id': '5d909fe7763841d5b452738112b656d3'} {{(pid=121135) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 03:15:14.730328 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4cfe31b8-4665-4a82-bd69-d376e9e572e5 tempest-ListImagesTestJSON-77589868 tempest-ListImagesTestJSON-77589868-project] 10.222.0.52 "GET /compute/v2.1/images/9e16d73e-70ea-4421-aee3-047d80396c02" status: 200 len: 784 microversion: 2.1 time: 0.255028 Oct 19 03:15:14.731043 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 425/900] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:15:14 2022] GET /compute/v2.1/images/9e16d73e-70ea-4421-aee3-047d80396c02 => generated 784 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:15:14.744014 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d6421723-c359-4b34-aed6-b42ca17c77cf tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:14.744832 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d6421723-c359-4b34-aed6-b42ca17c77cf tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:14.746369 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-408ad589-ae6c-44b2-a826-2a6198c147e0 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:14.747065 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-408ad589-ae6c-44b2-a826-2a6198c147e0 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:14.747674 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-408ad589-ae6c-44b2-a826-2a6198c147e0 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:14.748602 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-408ad589-ae6c-44b2-a826-2a6198c147e0 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:14.749352 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-408ad589-ae6c-44b2-a826-2a6198c147e0 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:14.750015 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-408ad589-ae6c-44b2-a826-2a6198c147e0 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:14.778059 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d6421723-c359-4b34-aed6-b42ca17c77cf tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:14.778059 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d6421723-c359-4b34-aed6-b42ca17c77cf tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:14.778059 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d6421723-c359-4b34-aed6-b42ca17c77cf tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:14.778059 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d6421723-c359-4b34-aed6-b42ca17c77cf tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:14.778758 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d6421723-c359-4b34-aed6-b42ca17c77cf tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:14.778758 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d6421723-c359-4b34-aed6-b42ca17c77cf tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:14.891095 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.multi_cell_list [None req-408ad589-ae6c-44b2-a826-2a6198c147e0 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=121135) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 03:15:14.922691 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d6421723-c359-4b34-aed6-b42ca17c77cf tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:14.934490 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d6421723-c359-4b34-aed6-b42ca17c77cf tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:14.938470 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d6421723-c359-4b34-aed6-b42ca17c77cf tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:14.951119 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d6421723-c359-4b34-aed6-b42ca17c77cf tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1540 microversion: 2.91 time: 0.218878 Oct 19 03:15:14.952998 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 426/901] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:14 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1540 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:15:14.972635 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b22a871c-e67d-40fd-b043-69ec1370b79a tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:14.973746 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b22a871c-e67d-40fd-b043-69ec1370b79a tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] [instance: 6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:14.985119 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b22a871c-e67d-40fd-b043-69ec1370b79a tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:14.986270 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b22a871c-e67d-40fd-b043-69ec1370b79a tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:14.987280 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b22a871c-e67d-40fd-b043-69ec1370b79a tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:14.990585 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b22a871c-e67d-40fd-b043-69ec1370b79a tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:14.991473 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b22a871c-e67d-40fd-b043-69ec1370b79a tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:14.993382 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b22a871c-e67d-40fd-b043-69ec1370b79a tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:15.102994 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-408ad589-ae6c-44b2-a826-2a6198c147e0 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers" status: 200 len: 1659 microversion: 2.1 time: 0.409198 Oct 19 03:15:15.103611 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 476/902] 10.222.0.52 () {58 vars in 1125 bytes} [Wed Oct 19 03:15:14 2022] GET /compute/v2.1/servers => generated 1659 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:15:15.116343 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-142382bd-1357-4b2f-a578-ad41a6946eeb tempest-ListImagesTestJSON-77589868 tempest-ListImagesTestJSON-77589868-project] Calling method '.version_select at 0x7fc1312e9b80>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:15.241707 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-142382bd-1357-4b2f-a578-ad41a6946eeb tempest-ListImagesTestJSON-77589868 tempest-ListImagesTestJSON-77589868-project] 10.222.0.52 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.132070 Oct 19 03:15:15.243232 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 477/903] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Oct 19 03:15:15 2022] GET /compute/v2.1/images => generated 445 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:15:15.251983 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2639cf71-f479-4657-88ac-e0d1f9506c1f tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:15.252653 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-2639cf71-f479-4657-88ac-e0d1f9506c1f tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] [instance: d50976fb-756b-4b12-92f2-cedf87df492d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:15.266413 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2639cf71-f479-4657-88ac-e0d1f9506c1f tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:15.275514 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2639cf71-f479-4657-88ac-e0d1f9506c1f tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:15.286690 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2639cf71-f479-4657-88ac-e0d1f9506c1f tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:15.286690 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2639cf71-f479-4657-88ac-e0d1f9506c1f tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:15.286927 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b22a871c-e67d-40fd-b043-69ec1370b79a tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cc37ae4bed94a7e85ed70dd5942c2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df99b134b20743eb9b62788706f2705a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:15.287367 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2639cf71-f479-4657-88ac-e0d1f9506c1f tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:15.287367 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2639cf71-f479-4657-88ac-e0d1f9506c1f tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:15.301070 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b22a871c-e67d-40fd-b043-69ec1370b79a tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] 10.222.0.52 "GET /compute/v2.1/servers/6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1" status: 200 len: 1587 microversion: 2.1 time: 0.346233 Oct 19 03:15:15.304022 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 427/904] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:14 2022] GET /compute/v2.1/servers/6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1 => generated 1587 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:15:15.320580 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f78bfd46-1a47-46ec-b704-7d71abe673a5 tempest-UnshelveToHostMultiNodesTest-1213824820 tempest-UnshelveToHostMultiNodesTest-1213824820-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h1-861333-8"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:15:15.330088 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f78bfd46-1a47-46ec-b704-7d71abe673a5 tempest-UnshelveToHostMultiNodesTest-1213824820 tempest-UnshelveToHostMultiNodesTest-1213824820-project-admin] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:15.338816 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f78bfd46-1a47-46ec-b704-7d71abe673a5 tempest-UnshelveToHostMultiNodesTest-1213824820 tempest-UnshelveToHostMultiNodesTest-1213824820-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:15.339348 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f78bfd46-1a47-46ec-b704-7d71abe673a5 tempest-UnshelveToHostMultiNodesTest-1213824820 tempest-UnshelveToHostMultiNodesTest-1213824820-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:15.339788 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f78bfd46-1a47-46ec-b704-7d71abe673a5 tempest-UnshelveToHostMultiNodesTest-1213824820 tempest-UnshelveToHostMultiNodesTest-1213824820-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:15.340502 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f78bfd46-1a47-46ec-b704-7d71abe673a5 tempest-UnshelveToHostMultiNodesTest-1213824820 tempest-UnshelveToHostMultiNodesTest-1213824820-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:15.340949 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f78bfd46-1a47-46ec-b704-7d71abe673a5 tempest-UnshelveToHostMultiNodesTest-1213824820 tempest-UnshelveToHostMultiNodesTest-1213824820-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:15.341509 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f78bfd46-1a47-46ec-b704-7d71abe673a5 tempest-UnshelveToHostMultiNodesTest-1213824820 tempest-UnshelveToHostMultiNodesTest-1213824820-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:15.377533 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-2639cf71-f479-4657-88ac-e0d1f9506c1f tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lazy-loading 'services' on Instance uuid d50976fb-756b-4b12-92f2-cedf87df492d {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:15:15.405157 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2639cf71-f479-4657-88ac-e0d1f9506c1f tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d" status: 200 len: 1927 microversion: 2.75 time: 0.160496 Oct 19 03:15:15.406962 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 478/905] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:15 2022] GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d => generated 1927 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:15:15.410620 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e0fe2dda-c0a1-41cd-a628-103e69b301a0 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:15.411306 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e0fe2dda-c0a1-41cd-a628-103e69b301a0 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 88b09b16-f667-4ab9-89ca-a26dc86967ae] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:15.452654 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f78bfd46-1a47-46ec-b704-7d71abe673a5 tempest-UnshelveToHostMultiNodesTest-1213824820 tempest-UnshelveToHostMultiNodesTest-1213824820-project-admin] [instance: 84092951-cf52-4077-b954-0babab66565e] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h1-861333-8". {{(pid=121134) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 19 03:15:15.469641 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-e0fe2dda-c0a1-41cd-a628-103e69b301a0 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:15.477408 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e0fe2dda-c0a1-41cd-a628-103e69b301a0 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/88b09b16-f667-4ab9-89ca-a26dc86967ae" status: 200 len: 1218 microversion: 2.1 time: 0.070370 Oct 19 03:15:15.478104 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 479/906] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:15 2022] GET /compute/v2.1/servers/88b09b16-f667-4ab9-89ca-a26dc86967ae => generated 1218 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:15:15.484794 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-1265ad44-c305-416b-906f-5316de548650 req-4e7175da-9159-44ba-b4c3-6aa96d15c157 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1", "tag": "753bfd99-2927-47ca-a7e7-46e77707a12f"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:15:15.496032 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-1265ad44-c305-416b-906f-5316de548650 req-4e7175da-9159-44ba-b4c3-6aa96d15c157 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:15.496617 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-1265ad44-c305-416b-906f-5316de548650 req-4e7175da-9159-44ba-b4c3-6aa96d15c157 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:15.497128 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-1265ad44-c305-416b-906f-5316de548650 req-4e7175da-9159-44ba-b4c3-6aa96d15c157 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:15.508125 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-1265ad44-c305-416b-906f-5316de548650 req-4e7175da-9159-44ba-b4c3-6aa96d15c157 service nova] Creating event network-changed:753bfd99-2927-47ca-a7e7-46e77707a12f for instance 6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1 on n-h1-861333-8 Oct 19 03:15:15.513443 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-1265ad44-c305-416b-906f-5316de548650 req-4e7175da-9159-44ba-b4c3-6aa96d15c157 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034088 Oct 19 03:15:15.514305 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 480/907] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:15:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:15:15.519632 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0e615a24-28a7-43c4-9137-dcfe189d40cf tempest-ListImagesTestJSON-77589868 tempest-ListImagesTestJSON-77589868-project] Calling method '.version_select at 0x7fc131413940>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:15.572286 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0e615a24-28a7-43c4-9137-dcfe189d40cf tempest-ListImagesTestJSON-77589868 tempest-ListImagesTestJSON-77589868-project] 10.222.0.52 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.056951 Oct 19 03:15:15.580906 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 481/908] 10.222.0.52 () {58 vars in 1143 bytes} [Wed Oct 19 03:15:15 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:15:15.601704 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f3f8e9ae-72f9-4e46-b130-3a548958be71 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:15.602477 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f3f8e9ae-72f9-4e46-b130-3a548958be71 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: d67da55c-724e-4305-9960-99d15ecfb23a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:15.609362 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f3f8e9ae-72f9-4e46-b130-3a548958be71 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:15.610169 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f3f8e9ae-72f9-4e46-b130-3a548958be71 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:15.610337 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f3f8e9ae-72f9-4e46-b130-3a548958be71 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:15.611037 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f3f8e9ae-72f9-4e46-b130-3a548958be71 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:15.611498 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f3f8e9ae-72f9-4e46-b130-3a548958be71 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:15.611927 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f3f8e9ae-72f9-4e46-b130-3a548958be71 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:15.773133 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f3f8e9ae-72f9-4e46-b130-3a548958be71 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:15.798641 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f3f8e9ae-72f9-4e46-b130-3a548958be71 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:15.800723 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f3f8e9ae-72f9-4e46-b130-3a548958be71 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:15.802813 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f3f8e9ae-72f9-4e46-b130-3a548958be71 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/d67da55c-724e-4305-9960-99d15ecfb23a" status: 200 len: 1565 microversion: 2.25 time: 0.221380 Oct 19 03:15:15.805963 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 482/909] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:15 2022] GET /compute/v2.1/servers/d67da55c-724e-4305-9960-99d15ecfb23a => generated 1565 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:15:15.843239 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f78bfd46-1a47-46ec-b704-7d71abe673a5 tempest-UnshelveToHostMultiNodesTest-1213824820 tempest-UnshelveToHostMultiNodesTest-1213824820-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e/action" status: 202 len: 0 microversion: 2.91 time: 0.538029 Oct 19 03:15:15.847817 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 428/910] 10.222.0.52 () {62 vars in 1319 bytes} [Wed Oct 19 03:15:15 2022] POST /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e/action => generated 0 bytes in 543 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:15:15.852920 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f2300ceb-0b5d-4111-935f-08b967dc0aea tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:15.853876 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f2300ceb-0b5d-4111-935f-08b967dc0aea tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:15.864881 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f2300ceb-0b5d-4111-935f-08b967dc0aea tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:15.869274 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f2300ceb-0b5d-4111-935f-08b967dc0aea tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:15.869274 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f2300ceb-0b5d-4111-935f-08b967dc0aea tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:15.869274 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f2300ceb-0b5d-4111-935f-08b967dc0aea tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:15.869274 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f2300ceb-0b5d-4111-935f-08b967dc0aea tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:15.869652 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f2300ceb-0b5d-4111-935f-08b967dc0aea tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:16.036633 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f2300ceb-0b5d-4111-935f-08b967dc0aea tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:16.050569 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f2300ceb-0b5d-4111-935f-08b967dc0aea tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:16.053787 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f2300ceb-0b5d-4111-935f-08b967dc0aea tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:16.066859 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f2300ceb-0b5d-4111-935f-08b967dc0aea tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1548 microversion: 2.91 time: 0.218229 Oct 19 03:15:16.068379 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 483/911] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:15 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1548 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:15:16.459746 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c3d726ed-06fe-4628-8fb1-d73b8abcdadf tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:16.463312 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c3d726ed-06fe-4628-8fb1-d73b8abcdadf tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] [instance: d50976fb-756b-4b12-92f2-cedf87df492d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:16.482350 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c3d726ed-06fe-4628-8fb1-d73b8abcdadf tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:16.487306 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c3d726ed-06fe-4628-8fb1-d73b8abcdadf tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:16.487306 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c3d726ed-06fe-4628-8fb1-d73b8abcdadf tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:16.502398 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9d9e95a7-6264-48ce-93d1-b6ae153ea1e3 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:16.503571 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9d9e95a7-6264-48ce-93d1-b6ae153ea1e3 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 88b09b16-f667-4ab9-89ca-a26dc86967ae] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:16.504322 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c3d726ed-06fe-4628-8fb1-d73b8abcdadf tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:16.505833 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c3d726ed-06fe-4628-8fb1-d73b8abcdadf tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:16.506658 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c3d726ed-06fe-4628-8fb1-d73b8abcdadf tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:16.608173 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-9d9e95a7-6264-48ce-93d1-b6ae153ea1e3 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:16.622278 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9d9e95a7-6264-48ce-93d1-b6ae153ea1e3 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/88b09b16-f667-4ab9-89ca-a26dc86967ae" status: 200 len: 1218 microversion: 2.1 time: 0.123467 Oct 19 03:15:16.623678 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 484/912] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:16 2022] GET /compute/v2.1/servers/88b09b16-f667-4ab9-89ca-a26dc86967ae => generated 1218 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:15:16.701747 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-c3d726ed-06fe-4628-8fb1-d73b8abcdadf tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lazy-loading 'services' on Instance uuid d50976fb-756b-4b12-92f2-cedf87df492d {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:15:16.724362 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c3d726ed-06fe-4628-8fb1-d73b8abcdadf tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d" status: 200 len: 1927 microversion: 2.75 time: 0.286102 Oct 19 03:15:16.725555 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 429/913] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:16 2022] GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d => generated 1927 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:15:16.831165 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3aeea85f-923c-4f5e-b2b9-9795a50bf17b tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:16.831781 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-3aeea85f-923c-4f5e-b2b9-9795a50bf17b tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: d67da55c-724e-4305-9960-99d15ecfb23a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:16.837984 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3aeea85f-923c-4f5e-b2b9-9795a50bf17b tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:16.838483 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3aeea85f-923c-4f5e-b2b9-9795a50bf17b tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:16.838917 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3aeea85f-923c-4f5e-b2b9-9795a50bf17b tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:16.839652 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3aeea85f-923c-4f5e-b2b9-9795a50bf17b tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:16.840295 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3aeea85f-923c-4f5e-b2b9-9795a50bf17b tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:16.840723 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3aeea85f-923c-4f5e-b2b9-9795a50bf17b tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:17.096770 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b45163a1-aeeb-480f-b314-35426e80cbf8 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:17.105124 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b45163a1-aeeb-480f-b314-35426e80cbf8 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:17.105124 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b45163a1-aeeb-480f-b314-35426e80cbf8 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:17.105124 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b45163a1-aeeb-480f-b314-35426e80cbf8 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:17.105433 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b45163a1-aeeb-480f-b314-35426e80cbf8 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:17.106312 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b45163a1-aeeb-480f-b314-35426e80cbf8 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:17.106771 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b45163a1-aeeb-480f-b314-35426e80cbf8 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:17.107201 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b45163a1-aeeb-480f-b314-35426e80cbf8 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:17.128383 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-3aeea85f-923c-4f5e-b2b9-9795a50bf17b tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:17.135811 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-3aeea85f-923c-4f5e-b2b9-9795a50bf17b tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:17.138210 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-3aeea85f-923c-4f5e-b2b9-9795a50bf17b tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:17.139639 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-3aeea85f-923c-4f5e-b2b9-9795a50bf17b tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/d67da55c-724e-4305-9960-99d15ecfb23a" status: 200 len: 1565 microversion: 2.25 time: 0.312702 Oct 19 03:15:17.140729 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 485/914] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:16 2022] GET /compute/v2.1/servers/d67da55c-724e-4305-9960-99d15ecfb23a => generated 1565 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:15:17.239014 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b45163a1-aeeb-480f-b314-35426e80cbf8 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:17.251856 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b45163a1-aeeb-480f-b314-35426e80cbf8 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:17.256972 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b45163a1-aeeb-480f-b314-35426e80cbf8 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:17.276086 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b45163a1-aeeb-480f-b314-35426e80cbf8 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1488 microversion: 2.91 time: 0.182452 Oct 19 03:15:17.293922 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 430/915] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:17 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1488 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:15:17.646698 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-265f6fc6-ec36-4771-94f4-1643fe9e0f00 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:17.647349 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-265f6fc6-ec36-4771-94f4-1643fe9e0f00 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 88b09b16-f667-4ab9-89ca-a26dc86967ae] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:17.653236 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-265f6fc6-ec36-4771-94f4-1643fe9e0f00 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:17.653979 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-265f6fc6-ec36-4771-94f4-1643fe9e0f00 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:17.654827 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-265f6fc6-ec36-4771-94f4-1643fe9e0f00 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:17.655696 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-265f6fc6-ec36-4771-94f4-1643fe9e0f00 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:17.656147 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-265f6fc6-ec36-4771-94f4-1643fe9e0f00 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:17.656826 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-265f6fc6-ec36-4771-94f4-1643fe9e0f00 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:17.722550 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-265f6fc6-ec36-4771-94f4-1643fe9e0f00 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:17.733697 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-265f6fc6-ec36-4771-94f4-1643fe9e0f00 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/88b09b16-f667-4ab9-89ca-a26dc86967ae" status: 200 len: 1214 microversion: 2.1 time: 0.090674 Oct 19 03:15:17.734763 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 486/916] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:17 2022] GET /compute/v2.1/servers/88b09b16-f667-4ab9-89ca-a26dc86967ae => generated 1214 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:15:17.752757 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e3ed73ad-7270-41c9-9f35-c1842e30db18 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:17.753398 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e3ed73ad-7270-41c9-9f35-c1842e30db18 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] [instance: d50976fb-756b-4b12-92f2-cedf87df492d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:17.765068 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e3ed73ad-7270-41c9-9f35-c1842e30db18 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:17.765602 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e3ed73ad-7270-41c9-9f35-c1842e30db18 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:17.768592 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e3ed73ad-7270-41c9-9f35-c1842e30db18 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:17.771625 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e3ed73ad-7270-41c9-9f35-c1842e30db18 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:17.779557 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e3ed73ad-7270-41c9-9f35-c1842e30db18 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:17.779557 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e3ed73ad-7270-41c9-9f35-c1842e30db18 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:17.872168 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-cf3ffe25-002e-49d1-b6c6-7461944f38ac tempest-MigrationsAdminTest-1230104219 tempest-MigrationsAdminTest-1230104219-project-admin] Calling method '.version_select at 0x7fc131287310>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:17.875963 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cf3ffe25-002e-49d1-b6c6-7461944f38ac tempest-MigrationsAdminTest-1230104219 tempest-MigrationsAdminTest-1230104219-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:17.876739 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cf3ffe25-002e-49d1-b6c6-7461944f38ac tempest-MigrationsAdminTest-1230104219 tempest-MigrationsAdminTest-1230104219-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:17.877190 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cf3ffe25-002e-49d1-b6c6-7461944f38ac tempest-MigrationsAdminTest-1230104219 tempest-MigrationsAdminTest-1230104219-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:17.880285 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=100 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:15:17.887537 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-cf3ffe25-002e-49d1-b6c6-7461944f38ac tempest-MigrationsAdminTest-1230104219 tempest-MigrationsAdminTest-1230104219-project-admin] 10.222.0.52 "GET /compute/v2.1/os-migrations" status: 200 len: 1568 microversion: 2.1 time: 0.019447 Oct 19 03:15:17.888470 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 487/917] 10.222.0.52 () {58 vars in 1143 bytes} [Wed Oct 19 03:15:17 2022] GET /compute/v2.1/os-migrations => generated 1568 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:15:17.911090 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-da4d3306-5e49-4f5f-b850-ef7385bbbc18 tempest-MigrationsAdminTest-1230104219 tempest-MigrationsAdminTest-1230104219-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:17.918417 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-da4d3306-5e49-4f5f-b850-ef7385bbbc18 tempest-MigrationsAdminTest-1230104219 tempest-MigrationsAdminTest-1230104219-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.010682 Oct 19 03:15:17.921601 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 488/918] 10.222.0.52 () {58 vars in 1137 bytes} [Wed Oct 19 03:15:17 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:15:17.925724 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-e3ed73ad-7270-41c9-9f35-c1842e30db18 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lazy-loading 'services' on Instance uuid d50976fb-756b-4b12-92f2-cedf87df492d {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:15:17.931028 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ecc72cd5-bdf1-4a94-b936-08f410fe50b7 tempest-MigrationsAdminTest-1230104219 tempest-MigrationsAdminTest-1230104219-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-2123663760", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:15:17.945285 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e3ed73ad-7270-41c9-9f35-c1842e30db18 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d" status: 200 len: 1927 microversion: 2.75 time: 0.196302 Oct 19 03:15:17.946000 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 431/919] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:17 2022] GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d => generated 1927 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:15:18.069257 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ecc72cd5-bdf1-4a94-b936-08f410fe50b7 tempest-MigrationsAdminTest-1230104219 tempest-MigrationsAdminTest-1230104219-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 499 microversion: 2.1 time: 0.140903 Oct 19 03:15:18.069257 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 489/920] 10.222.0.52 () {60 vars in 1146 bytes} [Wed Oct 19 03:15:17 2022] POST /compute/v2.1/flavors => generated 499 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:15:18.083946 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-cf8902ff-5568-4586-bac6-603f146548f9 tempest-MigrationsAdminTest-1230104219 tempest-MigrationsAdminTest-1230104219-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:18.092845 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-cf8902ff-5568-4586-bac6-603f146548f9 tempest-MigrationsAdminTest-1230104219 tempest-MigrationsAdminTest-1230104219-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.014123 Oct 19 03:15:18.093326 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 432/921] 10.222.0.52 () {58 vars in 1182 bytes} [Wed Oct 19 03:15:18 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 03:15:18.166571 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-22270b3d-c01b-46d3-ba58-4aee0a1847fd tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:18.167595 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-22270b3d-c01b-46d3-ba58-4aee0a1847fd tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: d67da55c-724e-4305-9960-99d15ecfb23a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:18.174414 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-22270b3d-c01b-46d3-ba58-4aee0a1847fd tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:18.175182 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-22270b3d-c01b-46d3-ba58-4aee0a1847fd tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:18.175688 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-22270b3d-c01b-46d3-ba58-4aee0a1847fd tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:18.176620 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-22270b3d-c01b-46d3-ba58-4aee0a1847fd tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:18.177290 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-22270b3d-c01b-46d3-ba58-4aee0a1847fd tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:18.178105 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-22270b3d-c01b-46d3-ba58-4aee0a1847fd tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:18.210377 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-531e9383-92da-4414-80aa-7838193f1a26 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-775841310", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "ecf81ec0-4740-4050-9a00-ee71c25338fa"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:15:18.271976 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-531e9383-92da-4414-80aa-7838193f1a26 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] validate_networks() for None {{(pid=121134) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:15:18.837349 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-22270b3d-c01b-46d3-ba58-4aee0a1847fd tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:18.852717 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-22270b3d-c01b-46d3-ba58-4aee0a1847fd tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:18.856063 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-22270b3d-c01b-46d3-ba58-4aee0a1847fd tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:18.857537 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-22270b3d-c01b-46d3-ba58-4aee0a1847fd tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/d67da55c-724e-4305-9960-99d15ecfb23a" status: 200 len: 1565 microversion: 2.25 time: 0.695226 Oct 19 03:15:18.878556 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 490/922] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:18 2022] GET /compute/v2.1/servers/d67da55c-724e-4305-9960-99d15ecfb23a => generated 1565 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:15:18.887023 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0ee8f604-20d0-4fc7-a6f8-af60352dacd6 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:18.888827 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0ee8f604-20d0-4fc7-a6f8-af60352dacd6 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:18.895183 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0ee8f604-20d0-4fc7-a6f8-af60352dacd6 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:18.895900 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0ee8f604-20d0-4fc7-a6f8-af60352dacd6 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:18.896354 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0ee8f604-20d0-4fc7-a6f8-af60352dacd6 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:18.897130 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0ee8f604-20d0-4fc7-a6f8-af60352dacd6 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:18.898480 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0ee8f604-20d0-4fc7-a6f8-af60352dacd6 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:18.899729 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0ee8f604-20d0-4fc7-a6f8-af60352dacd6 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:19.019740 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-0ee8f604-20d0-4fc7-a6f8-af60352dacd6 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:19.027336 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-531e9383-92da-4414-80aa-7838193f1a26 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Flavor limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:15:19.028408 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-531e9383-92da-4414-80aa-7838193f1a26 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Image limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:15:19.029694 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-531e9383-92da-4414-80aa-7838193f1a26 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Flavor pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:15:19.030658 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-531e9383-92da-4414-80aa-7838193f1a26 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Image pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:15:19.033037 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-531e9383-92da-4414-80aa-7838193f1a26 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:15:19.037142 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-0ee8f604-20d0-4fc7-a6f8-af60352dacd6 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:19.044466 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-0ee8f604-20d0-4fc7-a6f8-af60352dacd6 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:19.048610 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-531e9383-92da-4414-80aa-7838193f1a26 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:19.049522 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-531e9383-92da-4414-80aa-7838193f1a26 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:19.050378 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-531e9383-92da-4414-80aa-7838193f1a26 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:19.053161 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-531e9383-92da-4414-80aa-7838193f1a26 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:19.054295 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-531e9383-92da-4414-80aa-7838193f1a26 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:19.055229 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-531e9383-92da-4414-80aa-7838193f1a26 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:19.057669 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0ee8f604-20d0-4fc7-a6f8-af60352dacd6 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1490 microversion: 2.91 time: 0.176911 Oct 19 03:15:19.058833 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 491/923] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:18 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1490 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:15:19.063849 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6acbda62-cf5f-4e2d-99b3-960a1596b8a8 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:19.064458 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6acbda62-cf5f-4e2d-99b3-960a1596b8a8 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 88b09b16-f667-4ab9-89ca-a26dc86967ae] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:19.070872 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6acbda62-cf5f-4e2d-99b3-960a1596b8a8 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:19.071604 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6acbda62-cf5f-4e2d-99b3-960a1596b8a8 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:19.072204 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6acbda62-cf5f-4e2d-99b3-960a1596b8a8 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:19.073087 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6acbda62-cf5f-4e2d-99b3-960a1596b8a8 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:19.074398 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6acbda62-cf5f-4e2d-99b3-960a1596b8a8 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:19.074991 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6acbda62-cf5f-4e2d-99b3-960a1596b8a8 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:19.102399 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-531e9383-92da-4414-80aa-7838193f1a26 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Getting quotas for project c9a76121a22144499a44f44bb78848bf. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:15:19.108633 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-531e9383-92da-4414-80aa-7838193f1a26 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Getting quotas for user 9f8493504d9243bc95c9861f4ff76c83 and project c9a76121a22144499a44f44bb78848bf. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:15:19.124801 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-531e9383-92da-4414-80aa-7838193f1a26 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Going to run 1 instances... {{(pid=121134) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:15:19.127519 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-531e9383-92da-4414-80aa-7838193f1a26 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 9daa020d-efe7-4033-a479-cb5dadbc3ad7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:15:19.192709 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-6acbda62-cf5f-4e2d-99b3-960a1596b8a8 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:19.202492 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6acbda62-cf5f-4e2d-99b3-960a1596b8a8 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/88b09b16-f667-4ab9-89ca-a26dc86967ae" status: 200 len: 1270 microversion: 2.1 time: 0.142535 Oct 19 03:15:19.203098 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 492/924] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:19 2022] GET /compute/v2.1/servers/88b09b16-f667-4ab9-89ca-a26dc86967ae => generated 1270 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:15:19.207817 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-fd83545f-0d29-4910-97d6-17bf2c1c1d05 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:19.208431 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-fd83545f-0d29-4910-97d6-17bf2c1c1d05 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] [instance: d50976fb-756b-4b12-92f2-cedf87df492d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:19.215089 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fd83545f-0d29-4910-97d6-17bf2c1c1d05 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:19.215791 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fd83545f-0d29-4910-97d6-17bf2c1c1d05 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:19.216394 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fd83545f-0d29-4910-97d6-17bf2c1c1d05 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:19.217253 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fd83545f-0d29-4910-97d6-17bf2c1c1d05 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:19.217928 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fd83545f-0d29-4910-97d6-17bf2c1c1d05 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:19.218537 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fd83545f-0d29-4910-97d6-17bf2c1c1d05 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:19.263776 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-531e9383-92da-4414-80aa-7838193f1a26 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.057550 Oct 19 03:15:19.267026 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 433/925] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:15:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1062 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 19 03:15:19.295249 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1c76ca16-0cf4-42e6-a39b-fde468f7daab tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:19.299116 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1c76ca16-0cf4-42e6-a39b-fde468f7daab tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 9daa020d-efe7-4033-a479-cb5dadbc3ad7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:19.340461 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-fd83545f-0d29-4910-97d6-17bf2c1c1d05 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lazy-loading 'services' on Instance uuid d50976fb-756b-4b12-92f2-cedf87df492d {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:15:19.419291 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-fd83545f-0d29-4910-97d6-17bf2c1c1d05 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d" status: 200 len: 1927 microversion: 2.75 time: 0.214919 Oct 19 03:15:19.420087 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 493/926] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:19 2022] GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d => generated 1927 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:15:19.460009 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-1c76ca16-0cf4-42e6-a39b-fde468f7daab tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:19.476035 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1c76ca16-0cf4-42e6-a39b-fde468f7daab tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7" status: 200 len: 1278 microversion: 2.1 time: 0.191206 Oct 19 03:15:19.476911 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 434/927] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:19 2022] GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7 => generated 1278 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:15:19.891811 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ed4eb571-8fdc-49ba-a494-cf0811ad191b tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:19.892676 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ed4eb571-8fdc-49ba-a494-cf0811ad191b tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: d67da55c-724e-4305-9960-99d15ecfb23a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:19.912054 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ed4eb571-8fdc-49ba-a494-cf0811ad191b tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:19.913544 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ed4eb571-8fdc-49ba-a494-cf0811ad191b tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:19.914141 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ed4eb571-8fdc-49ba-a494-cf0811ad191b tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:19.915205 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ed4eb571-8fdc-49ba-a494-cf0811ad191b tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:19.922146 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ed4eb571-8fdc-49ba-a494-cf0811ad191b tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:19.925614 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ed4eb571-8fdc-49ba-a494-cf0811ad191b tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:20.095895 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-020eeec1-0ae1-4d5b-a6f9-c3931a145dd7 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:20.096601 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-020eeec1-0ae1-4d5b-a6f9-c3931a145dd7 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:20.108875 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-020eeec1-0ae1-4d5b-a6f9-c3931a145dd7 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:20.109396 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-020eeec1-0ae1-4d5b-a6f9-c3931a145dd7 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:20.109870 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-020eeec1-0ae1-4d5b-a6f9-c3931a145dd7 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:20.110582 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-020eeec1-0ae1-4d5b-a6f9-c3931a145dd7 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:20.111096 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-020eeec1-0ae1-4d5b-a6f9-c3931a145dd7 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:20.111472 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-020eeec1-0ae1-4d5b-a6f9-c3931a145dd7 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:20.281974 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-020eeec1-0ae1-4d5b-a6f9-c3931a145dd7 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:20.291448 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-020eeec1-0ae1-4d5b-a6f9-c3931a145dd7 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:20.302281 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-020eeec1-0ae1-4d5b-a6f9-c3931a145dd7 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:20.319271 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-020eeec1-0ae1-4d5b-a6f9-c3931a145dd7 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1546 microversion: 2.91 time: 0.227557 Oct 19 03:15:20.322642 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 435/928] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:20 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1546 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:15:20.331244 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d568a09c-faeb-40e0-9e76-642a53726966 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:20.332852 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d568a09c-faeb-40e0-9e76-642a53726966 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 88b09b16-f667-4ab9-89ca-a26dc86967ae] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:20.338595 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:15:20.340636 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d568a09c-faeb-40e0-9e76-642a53726966 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:20.342365 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d568a09c-faeb-40e0-9e76-642a53726966 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:20.342365 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d568a09c-faeb-40e0-9e76-642a53726966 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:20.343070 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d568a09c-faeb-40e0-9e76-642a53726966 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:20.343747 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d568a09c-faeb-40e0-9e76-642a53726966 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:20.344498 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d568a09c-faeb-40e0-9e76-642a53726966 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:20.540325 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ed4eb571-8fdc-49ba-a494-cf0811ad191b tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:20.549582 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ed4eb571-8fdc-49ba-a494-cf0811ad191b tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:20.551637 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ed4eb571-8fdc-49ba-a494-cf0811ad191b tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:20.553089 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ed4eb571-8fdc-49ba-a494-cf0811ad191b tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/d67da55c-724e-4305-9960-99d15ecfb23a" status: 200 len: 1565 microversion: 2.25 time: 0.672708 Oct 19 03:15:20.553861 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 494/929] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:19 2022] GET /compute/v2.1/servers/d67da55c-724e-4305-9960-99d15ecfb23a => generated 1565 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:15:20.558735 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7b874707-d4cd-41a4-9e7c-a8011923f2b3 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:20.559706 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7b874707-d4cd-41a4-9e7c-a8011923f2b3 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] [instance: d50976fb-756b-4b12-92f2-cedf87df492d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:20.571386 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7b874707-d4cd-41a4-9e7c-a8011923f2b3 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:20.572122 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7b874707-d4cd-41a4-9e7c-a8011923f2b3 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:20.579863 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7b874707-d4cd-41a4-9e7c-a8011923f2b3 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:20.584263 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7b874707-d4cd-41a4-9e7c-a8011923f2b3 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:20.584994 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7b874707-d4cd-41a4-9e7c-a8011923f2b3 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:20.585461 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7b874707-d4cd-41a4-9e7c-a8011923f2b3 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:20.760053 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-7b874707-d4cd-41a4-9e7c-a8011923f2b3 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lazy-loading 'services' on Instance uuid d50976fb-756b-4b12-92f2-cedf87df492d {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:15:20.778144 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7b874707-d4cd-41a4-9e7c-a8011923f2b3 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d" status: 200 len: 1927 microversion: 2.75 time: 0.223077 Oct 19 03:15:20.779358 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 495/930] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:20 2022] GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d => generated 1927 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:15:20.785055 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-8e6cd1db-dc21-4d23-a6b2-433ae00bf300 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:20.785860 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-8e6cd1db-dc21-4d23-a6b2-433ae00bf300 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 9daa020d-efe7-4033-a479-cb5dadbc3ad7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:20.792827 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8e6cd1db-dc21-4d23-a6b2-433ae00bf300 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:20.793689 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8e6cd1db-dc21-4d23-a6b2-433ae00bf300 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:20.794321 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8e6cd1db-dc21-4d23-a6b2-433ae00bf300 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:20.795286 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8e6cd1db-dc21-4d23-a6b2-433ae00bf300 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:20.796044 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8e6cd1db-dc21-4d23-a6b2-433ae00bf300 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:20.796661 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8e6cd1db-dc21-4d23-a6b2-433ae00bf300 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:20.858448 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d568a09c-faeb-40e0-9e76-642a53726966 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:20.875202 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d568a09c-faeb-40e0-9e76-642a53726966 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/88b09b16-f667-4ab9-89ca-a26dc86967ae" status: 200 len: 1318 microversion: 2.1 time: 0.551132 Oct 19 03:15:20.876097 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 436/931] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:20 2022] GET /compute/v2.1/servers/88b09b16-f667-4ab9-89ca-a26dc86967ae => generated 1318 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:15:20.967997 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-8e6cd1db-dc21-4d23-a6b2-433ae00bf300 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:20.998084 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-8e6cd1db-dc21-4d23-a6b2-433ae00bf300 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7" status: 200 len: 1282 microversion: 2.1 time: 0.217399 Oct 19 03:15:21.019185 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 496/932] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:20 2022] GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7 => generated 1282 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:15:21.354973 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0779b66f-1827-4680-89a6-0cba394b6dce tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:21.356354 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0779b66f-1827-4680-89a6-0cba394b6dce tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:21.369005 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0779b66f-1827-4680-89a6-0cba394b6dce tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:21.370109 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0779b66f-1827-4680-89a6-0cba394b6dce tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:21.374242 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0779b66f-1827-4680-89a6-0cba394b6dce tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:21.376664 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0779b66f-1827-4680-89a6-0cba394b6dce tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:21.377576 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0779b66f-1827-4680-89a6-0cba394b6dce tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:21.379589 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0779b66f-1827-4680-89a6-0cba394b6dce tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:21.416609 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:15:21.508492 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0779b66f-1827-4680-89a6-0cba394b6dce tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:21.517605 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0779b66f-1827-4680-89a6-0cba394b6dce tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:21.519331 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0779b66f-1827-4680-89a6-0cba394b6dce tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:21.525133 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0779b66f-1827-4680-89a6-0cba394b6dce tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1546 microversion: 2.91 time: 0.177761 Oct 19 03:15:21.526442 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 437/933] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:21 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1546 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:15:21.580538 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-cfbc288a-2ed4-47e5-8c76-b97b6a049daa tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:21.581164 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-cfbc288a-2ed4-47e5-8c76-b97b6a049daa tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: d67da55c-724e-4305-9960-99d15ecfb23a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:21.587285 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cfbc288a-2ed4-47e5-8c76-b97b6a049daa tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:21.587988 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cfbc288a-2ed4-47e5-8c76-b97b6a049daa tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:21.588596 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cfbc288a-2ed4-47e5-8c76-b97b6a049daa tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:21.589755 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cfbc288a-2ed4-47e5-8c76-b97b6a049daa tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:21.591163 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cfbc288a-2ed4-47e5-8c76-b97b6a049daa tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:21.591801 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cfbc288a-2ed4-47e5-8c76-b97b6a049daa tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:21.658528 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-7f4774d5-c574-450b-abd2-92f35cef33d1 req-b97114e7-5dbc-47bc-8916-498271dbc284 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88b09b16-f667-4ab9-89ca-a26dc86967ae", "tag": "c6cc7e90-cc90-44c2-82b6-4af34dfad284"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:15:21.670355 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-7f4774d5-c574-450b-abd2-92f35cef33d1 req-b97114e7-5dbc-47bc-8916-498271dbc284 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:21.672041 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-7f4774d5-c574-450b-abd2-92f35cef33d1 req-b97114e7-5dbc-47bc-8916-498271dbc284 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:21.672927 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-7f4774d5-c574-450b-abd2-92f35cef33d1 req-b97114e7-5dbc-47bc-8916-498271dbc284 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:21.717706 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-7f4774d5-c574-450b-abd2-92f35cef33d1 req-b97114e7-5dbc-47bc-8916-498271dbc284 service nova] Creating event network-changed:c6cc7e90-cc90-44c2-82b6-4af34dfad284 for instance 88b09b16-f667-4ab9-89ca-a26dc86967ae on n-h1-861333-8 Oct 19 03:15:21.722918 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-7f4774d5-c574-450b-abd2-92f35cef33d1 req-b97114e7-5dbc-47bc-8916-498271dbc284 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068755 Oct 19 03:15:21.723515 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 438/934] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:15:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:15:21.810027 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e0978ec8-08a8-4f91-a38f-b67afbc2746d tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:21.811055 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e0978ec8-08a8-4f91-a38f-b67afbc2746d tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] [instance: d50976fb-756b-4b12-92f2-cedf87df492d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:21.819454 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e0978ec8-08a8-4f91-a38f-b67afbc2746d tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:21.819949 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e0978ec8-08a8-4f91-a38f-b67afbc2746d tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:21.820749 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e0978ec8-08a8-4f91-a38f-b67afbc2746d tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:21.821740 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e0978ec8-08a8-4f91-a38f-b67afbc2746d tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:21.822356 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e0978ec8-08a8-4f91-a38f-b67afbc2746d tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:21.822950 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e0978ec8-08a8-4f91-a38f-b67afbc2746d tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:21.890202 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-cfbc288a-2ed4-47e5-8c76-b97b6a049daa tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:21.910739 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-cfbc288a-2ed4-47e5-8c76-b97b6a049daa tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:21.920135 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-cfbc288a-2ed4-47e5-8c76-b97b6a049daa tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:21.921661 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-cfbc288a-2ed4-47e5-8c76-b97b6a049daa tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/d67da55c-724e-4305-9960-99d15ecfb23a" status: 200 len: 1565 microversion: 2.25 time: 0.345343 Oct 19 03:15:21.927609 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 497/935] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:21 2022] GET /compute/v2.1/servers/d67da55c-724e-4305-9960-99d15ecfb23a => generated 1565 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:15:21.955484 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b7dfa481-6f4c-4b1d-92e5-e69b5aa74604 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:21.958273 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b7dfa481-6f4c-4b1d-92e5-e69b5aa74604 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 88b09b16-f667-4ab9-89ca-a26dc86967ae] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:21.969356 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b7dfa481-6f4c-4b1d-92e5-e69b5aa74604 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:21.970097 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b7dfa481-6f4c-4b1d-92e5-e69b5aa74604 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:21.970498 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b7dfa481-6f4c-4b1d-92e5-e69b5aa74604 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:21.971297 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b7dfa481-6f4c-4b1d-92e5-e69b5aa74604 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:21.971820 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b7dfa481-6f4c-4b1d-92e5-e69b5aa74604 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:21.973488 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b7dfa481-6f4c-4b1d-92e5-e69b5aa74604 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:21.977151 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-e0978ec8-08a8-4f91-a38f-b67afbc2746d tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lazy-loading 'services' on Instance uuid d50976fb-756b-4b12-92f2-cedf87df492d {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:15:22.010660 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e0978ec8-08a8-4f91-a38f-b67afbc2746d tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d" status: 200 len: 1927 microversion: 2.75 time: 0.205909 Oct 19 03:15:22.011285 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 439/936] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:21 2022] GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d => generated 1927 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:15:22.029652 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-54b5d955-acad-4634-8017-646208932b25 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:22.030512 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-54b5d955-acad-4634-8017-646208932b25 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 9daa020d-efe7-4033-a479-cb5dadbc3ad7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:22.039441 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-54b5d955-acad-4634-8017-646208932b25 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:22.039931 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-54b5d955-acad-4634-8017-646208932b25 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:22.040371 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-54b5d955-acad-4634-8017-646208932b25 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:22.041119 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-54b5d955-acad-4634-8017-646208932b25 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:22.041615 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-54b5d955-acad-4634-8017-646208932b25 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:22.046921 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-54b5d955-acad-4634-8017-646208932b25 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:22.643092 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-54b5d955-acad-4634-8017-646208932b25 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:22.658463 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-54b5d955-acad-4634-8017-646208932b25 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7" status: 200 len: 1330 microversion: 2.1 time: 0.633042 Oct 19 03:15:22.663672 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 440/937] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:22 2022] GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7 => generated 1330 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:15:22.672552 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-bbdc9f4c-1e6b-4de0-b8f5-f08e0d9fd94c tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:22.677072 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-bbdc9f4c-1e6b-4de0-b8f5-f08e0d9fd94c tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:22.692285 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bbdc9f4c-1e6b-4de0-b8f5-f08e0d9fd94c tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:22.693539 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bbdc9f4c-1e6b-4de0-b8f5-f08e0d9fd94c tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:22.698686 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bbdc9f4c-1e6b-4de0-b8f5-f08e0d9fd94c tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:22.698686 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bbdc9f4c-1e6b-4de0-b8f5-f08e0d9fd94c tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:22.698686 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bbdc9f4c-1e6b-4de0-b8f5-f08e0d9fd94c tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:22.698686 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bbdc9f4c-1e6b-4de0-b8f5-f08e0d9fd94c tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:22.882890 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-bbdc9f4c-1e6b-4de0-b8f5-f08e0d9fd94c tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:22.903485 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-bbdc9f4c-1e6b-4de0-b8f5-f08e0d9fd94c tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:22.906353 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-bbdc9f4c-1e6b-4de0-b8f5-f08e0d9fd94c tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:22.913172 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-bbdc9f4c-1e6b-4de0-b8f5-f08e0d9fd94c tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1546 microversion: 2.91 time: 0.247932 Oct 19 03:15:22.914373 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 441/938] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:22 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1546 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:15:22.958045 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f0e7ae56-5387-48cc-ae62-501ebc45407c tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:22.959124 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f0e7ae56-5387-48cc-ae62-501ebc45407c tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: d67da55c-724e-4305-9960-99d15ecfb23a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:22.975622 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f0e7ae56-5387-48cc-ae62-501ebc45407c tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:22.978221 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f0e7ae56-5387-48cc-ae62-501ebc45407c tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:22.985971 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f0e7ae56-5387-48cc-ae62-501ebc45407c tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:22.988090 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f0e7ae56-5387-48cc-ae62-501ebc45407c tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:22.990203 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f0e7ae56-5387-48cc-ae62-501ebc45407c tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:22.992527 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f0e7ae56-5387-48cc-ae62-501ebc45407c tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:23.103720 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b7dfa481-6f4c-4b1d-92e5-e69b5aa74604 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:23.113906 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b7dfa481-6f4c-4b1d-92e5-e69b5aa74604 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/88b09b16-f667-4ab9-89ca-a26dc86967ae" status: 200 len: 1318 microversion: 2.1 time: 1.184970 Oct 19 03:15:23.117861 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 498/939] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:21 2022] GET /compute/v2.1/servers/88b09b16-f667-4ab9-89ca-a26dc86967ae => generated 1318 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:15:23.128352 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4932f0ec-7bef-4a1a-b203-267bdb68fce8 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:23.129618 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4932f0ec-7bef-4a1a-b203-267bdb68fce8 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] [instance: d50976fb-756b-4b12-92f2-cedf87df492d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:23.147352 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4932f0ec-7bef-4a1a-b203-267bdb68fce8 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:23.148317 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4932f0ec-7bef-4a1a-b203-267bdb68fce8 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:23.153108 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4932f0ec-7bef-4a1a-b203-267bdb68fce8 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:23.154120 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4932f0ec-7bef-4a1a-b203-267bdb68fce8 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:23.154797 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4932f0ec-7bef-4a1a-b203-267bdb68fce8 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:23.158016 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4932f0ec-7bef-4a1a-b203-267bdb68fce8 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:23.442133 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-4932f0ec-7bef-4a1a-b203-267bdb68fce8 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lazy-loading 'services' on Instance uuid d50976fb-756b-4b12-92f2-cedf87df492d {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:15:23.484445 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4932f0ec-7bef-4a1a-b203-267bdb68fce8 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d" status: 200 len: 1927 microversion: 2.75 time: 0.366208 Oct 19 03:15:23.492306 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 499/940] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:23 2022] GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d => generated 1927 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:15:23.523487 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-1070fd0b-692c-4f78-9682-3f094ef643b1 req-e8277d83-4ae9-4c31-bdd2-9e09794981aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46e24c0c-6e9f-4a51-a10e-dcb68ebf6f9d", "tag": "24ff5b68-bf87-4f37-9228-f1c21d3cc33a"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:15:23.555422 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-1070fd0b-692c-4f78-9682-3f094ef643b1 req-e8277d83-4ae9-4c31-bdd2-9e09794981aa service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:23.556267 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-1070fd0b-692c-4f78-9682-3f094ef643b1 req-e8277d83-4ae9-4c31-bdd2-9e09794981aa service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:23.557022 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-1070fd0b-692c-4f78-9682-3f094ef643b1 req-e8277d83-4ae9-4c31-bdd2-9e09794981aa service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:23.580839 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-1070fd0b-692c-4f78-9682-3f094ef643b1 req-e8277d83-4ae9-4c31-bdd2-9e09794981aa service nova] Creating event network-changed:24ff5b68-bf87-4f37-9228-f1c21d3cc33a for instance 46e24c0c-6e9f-4a51-a10e-dcb68ebf6f9d on n-h2-861333-8 Oct 19 03:15:23.587040 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-1070fd0b-692c-4f78-9682-3f094ef643b1 req-e8277d83-4ae9-4c31-bdd2-9e09794981aa service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067225 Oct 19 03:15:23.588289 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 500/941] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:15:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:15:23.698933 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e0f231ca-dcf7-4af3-bccb-b405366510e7 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:23.704458 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e0f231ca-dcf7-4af3-bccb-b405366510e7 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 9daa020d-efe7-4033-a479-cb5dadbc3ad7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:23.716161 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e0f231ca-dcf7-4af3-bccb-b405366510e7 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:23.717005 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e0f231ca-dcf7-4af3-bccb-b405366510e7 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:23.717821 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e0f231ca-dcf7-4af3-bccb-b405366510e7 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:23.718955 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e0f231ca-dcf7-4af3-bccb-b405366510e7 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:23.719631 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e0f231ca-dcf7-4af3-bccb-b405366510e7 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:23.720344 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e0f231ca-dcf7-4af3-bccb-b405366510e7 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:23.735873 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-f0e7ae56-5387-48cc-ae62-501ebc45407c tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:23.751428 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-f0e7ae56-5387-48cc-ae62-501ebc45407c tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:23.753099 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-f0e7ae56-5387-48cc-ae62-501ebc45407c tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:23.754502 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f0e7ae56-5387-48cc-ae62-501ebc45407c tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/d67da55c-724e-4305-9960-99d15ecfb23a" status: 200 len: 1565 microversion: 2.25 time: 0.802241 Oct 19 03:15:23.757598 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 442/942] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:22 2022] GET /compute/v2.1/servers/d67da55c-724e-4305-9960-99d15ecfb23a => generated 1565 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:15:23.915748 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-e0f231ca-dcf7-4af3-bccb-b405366510e7 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:23.925247 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e0f231ca-dcf7-4af3-bccb-b405366510e7 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7" status: 200 len: 1336 microversion: 2.1 time: 0.239029 Oct 19 03:15:23.942565 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 501/943] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:23 2022] GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7 => generated 1336 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:15:23.945733 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1033cc98-fd15-4325-8a58-d7bc8cabccd5 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:23.946470 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1033cc98-fd15-4325-8a58-d7bc8cabccd5 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:23.958925 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1033cc98-fd15-4325-8a58-d7bc8cabccd5 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:23.961690 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1033cc98-fd15-4325-8a58-d7bc8cabccd5 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:23.961690 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1033cc98-fd15-4325-8a58-d7bc8cabccd5 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:23.961690 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1033cc98-fd15-4325-8a58-d7bc8cabccd5 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:23.961690 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1033cc98-fd15-4325-8a58-d7bc8cabccd5 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:23.966896 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1033cc98-fd15-4325-8a58-d7bc8cabccd5 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:24.140345 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a0ea1656-75bf-476b-8b42-d923d61aab92 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:24.141282 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a0ea1656-75bf-476b-8b42-d923d61aab92 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 88b09b16-f667-4ab9-89ca-a26dc86967ae] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:24.154706 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a0ea1656-75bf-476b-8b42-d923d61aab92 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:24.155256 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a0ea1656-75bf-476b-8b42-d923d61aab92 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:24.155699 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a0ea1656-75bf-476b-8b42-d923d61aab92 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:24.156449 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a0ea1656-75bf-476b-8b42-d923d61aab92 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:24.156917 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a0ea1656-75bf-476b-8b42-d923d61aab92 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:24.157357 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a0ea1656-75bf-476b-8b42-d923d61aab92 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:24.428981 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-1033cc98-fd15-4325-8a58-d7bc8cabccd5 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:24.446989 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-1033cc98-fd15-4325-8a58-d7bc8cabccd5 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:24.449156 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-1033cc98-fd15-4325-8a58-d7bc8cabccd5 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:24.468162 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1033cc98-fd15-4325-8a58-d7bc8cabccd5 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1546 microversion: 2.91 time: 0.526229 Oct 19 03:15:24.489159 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 443/944] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:23 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1546 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:15:24.520324 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ff9fa7fd-c787-4eff-81e8-9e7915ce47c4 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:24.521264 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ff9fa7fd-c787-4eff-81e8-9e7915ce47c4 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] [instance: d50976fb-756b-4b12-92f2-cedf87df492d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:24.544598 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ff9fa7fd-c787-4eff-81e8-9e7915ce47c4 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:24.552208 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ff9fa7fd-c787-4eff-81e8-9e7915ce47c4 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:24.558767 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ff9fa7fd-c787-4eff-81e8-9e7915ce47c4 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:24.560738 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ff9fa7fd-c787-4eff-81e8-9e7915ce47c4 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:24.560872 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ff9fa7fd-c787-4eff-81e8-9e7915ce47c4 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:24.561236 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ff9fa7fd-c787-4eff-81e8-9e7915ce47c4 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:24.796664 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=4 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:15:24.836240 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-ff9fa7fd-c787-4eff-81e8-9e7915ce47c4 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lazy-loading 'services' on Instance uuid d50976fb-756b-4b12-92f2-cedf87df492d {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:15:24.878407 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ff9fa7fd-c787-4eff-81e8-9e7915ce47c4 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d" status: 200 len: 1927 microversion: 2.75 time: 0.362042 Oct 19 03:15:24.879268 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 444/945] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:24 2022] GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d => generated 1927 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:15:24.884764 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-73ebe267-a548-493f-a125-ffaeaee27a4e tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:24.890240 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-73ebe267-a548-493f-a125-ffaeaee27a4e tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: d67da55c-724e-4305-9960-99d15ecfb23a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:24.902399 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-73ebe267-a548-493f-a125-ffaeaee27a4e tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:24.904374 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-73ebe267-a548-493f-a125-ffaeaee27a4e tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:24.904374 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-73ebe267-a548-493f-a125-ffaeaee27a4e tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:24.908413 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-73ebe267-a548-493f-a125-ffaeaee27a4e tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:24.909163 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-73ebe267-a548-493f-a125-ffaeaee27a4e tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:24.909943 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-73ebe267-a548-493f-a125-ffaeaee27a4e tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:24.970764 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a0ea1656-75bf-476b-8b42-d923d61aab92 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:24.985031 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a0ea1656-75bf-476b-8b42-d923d61aab92 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/88b09b16-f667-4ab9-89ca-a26dc86967ae" status: 200 len: 1318 microversion: 2.1 time: 0.845293 Oct 19 03:15:24.993562 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 502/946] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:24 2022] GET /compute/v2.1/servers/88b09b16-f667-4ab9-89ca-a26dc86967ae => generated 1318 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:15:25.041394 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-543b6d70-0151-4d9f-a73b-62db5abd85ba tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:25.043218 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-543b6d70-0151-4d9f-a73b-62db5abd85ba tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 9daa020d-efe7-4033-a479-cb5dadbc3ad7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:25.065005 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-543b6d70-0151-4d9f-a73b-62db5abd85ba tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:25.068171 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-543b6d70-0151-4d9f-a73b-62db5abd85ba tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:25.068171 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-543b6d70-0151-4d9f-a73b-62db5abd85ba tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:25.072631 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-543b6d70-0151-4d9f-a73b-62db5abd85ba tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:25.074366 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-543b6d70-0151-4d9f-a73b-62db5abd85ba tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:25.075775 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-543b6d70-0151-4d9f-a73b-62db5abd85ba tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:25.730978 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-73ebe267-a548-493f-a125-ffaeaee27a4e tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:25.751384 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-543b6d70-0151-4d9f-a73b-62db5abd85ba tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:25.764754 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-73ebe267-a548-493f-a125-ffaeaee27a4e tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:25.766254 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-73ebe267-a548-493f-a125-ffaeaee27a4e tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:25.767615 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-73ebe267-a548-493f-a125-ffaeaee27a4e tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/d67da55c-724e-4305-9960-99d15ecfb23a" status: 200 len: 1540 microversion: 2.25 time: 0.887086 Oct 19 03:15:25.778984 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 445/947] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:24 2022] GET /compute/v2.1/servers/d67da55c-724e-4305-9960-99d15ecfb23a => generated 1540 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:15:25.781546 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-543b6d70-0151-4d9f-a73b-62db5abd85ba tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7" status: 200 len: 1378 microversion: 2.1 time: 0.779565 Oct 19 03:15:25.785059 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 503/948] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:24 2022] GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7 => generated 1378 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:15:25.791175 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a0e43fba-d93c-4b5e-a1fc-c5bc9feddb70 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:25.791800 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a0e43fba-d93c-4b5e-a1fc-c5bc9feddb70 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:25.800868 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a0e43fba-d93c-4b5e-a1fc-c5bc9feddb70 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:25.801404 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a0e43fba-d93c-4b5e-a1fc-c5bc9feddb70 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:25.801882 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a0e43fba-d93c-4b5e-a1fc-c5bc9feddb70 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:25.802773 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a0e43fba-d93c-4b5e-a1fc-c5bc9feddb70 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:25.803235 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a0e43fba-d93c-4b5e-a1fc-c5bc9feddb70 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:25.803660 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a0e43fba-d93c-4b5e-a1fc-c5bc9feddb70 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:25.812603 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-34779457-71f2-47b6-a055-b43cfdd92230 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Calling method '.version_select at 0x7fc13138c5e0>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:25.820153 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-34779457-71f2-47b6-a055-b43cfdd92230 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:25.820954 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-34779457-71f2-47b6-a055-b43cfdd92230 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:25.822540 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-34779457-71f2-47b6-a055-b43cfdd92230 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:25.840796 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-34779457-71f2-47b6-a055-b43cfdd92230 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] 10.222.0.52 "GET /compute/v2.1/os-migrations" status: 200 len: 1945 microversion: 2.25 time: 0.045264 Oct 19 03:15:25.844820 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 504/949] 10.222.0.52 () {60 vars in 1184 bytes} [Wed Oct 19 03:15:25 2022] GET /compute/v2.1/os-migrations => generated 1945 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:15:25.858621 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-991078f0-46d5-4b54-9d1f-ca4058cc1d91 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:25.859730 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-991078f0-46d5-4b54-9d1f-ca4058cc1d91 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] [instance: d67da55c-724e-4305-9960-99d15ecfb23a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:25.875650 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-991078f0-46d5-4b54-9d1f-ca4058cc1d91 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:25.875650 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-991078f0-46d5-4b54-9d1f-ca4058cc1d91 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:25.875650 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-991078f0-46d5-4b54-9d1f-ca4058cc1d91 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:25.876382 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-991078f0-46d5-4b54-9d1f-ca4058cc1d91 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:25.877052 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-991078f0-46d5-4b54-9d1f-ca4058cc1d91 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:25.877755 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-991078f0-46d5-4b54-9d1f-ca4058cc1d91 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:25.950182 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a0e43fba-d93c-4b5e-a1fc-c5bc9feddb70 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:25.963312 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a0e43fba-d93c-4b5e-a1fc-c5bc9feddb70 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:25.971516 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a0e43fba-d93c-4b5e-a1fc-c5bc9feddb70 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:25.984090 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a0e43fba-d93c-4b5e-a1fc-c5bc9feddb70 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1546 microversion: 2.91 time: 0.204767 Oct 19 03:15:25.985201 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 446/950] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:25 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1546 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:15:25.990856 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-cd34b656-4786-44f8-a514-01b4b2270102 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:25.991755 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-cd34b656-4786-44f8-a514-01b4b2270102 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] [instance: d50976fb-756b-4b12-92f2-cedf87df492d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:26.017610 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cd34b656-4786-44f8-a514-01b4b2270102 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:26.018562 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cd34b656-4786-44f8-a514-01b4b2270102 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:26.019182 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cd34b656-4786-44f8-a514-01b4b2270102 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:26.020082 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cd34b656-4786-44f8-a514-01b4b2270102 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:26.020811 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cd34b656-4786-44f8-a514-01b4b2270102 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:26.022765 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cd34b656-4786-44f8-a514-01b4b2270102 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:26.160172 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-991078f0-46d5-4b54-9d1f-ca4058cc1d91 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lazy-loading 'services' on Instance uuid d67da55c-724e-4305-9960-99d15ecfb23a {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:15:26.176220 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-991078f0-46d5-4b54-9d1f-ca4058cc1d91 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d67da55c-724e-4305-9960-99d15ecfb23a" status: 200 len: 2032 microversion: 2.25 time: 0.321527 Oct 19 03:15:26.176808 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 505/951] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:25 2022] GET /compute/v2.1/servers/d67da55c-724e-4305-9960-99d15ecfb23a => generated 2032 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:15:26.185615 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-994aca82-cf3b-4901-bd67-26a019ab299b tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:26.185876 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-cd34b656-4786-44f8-a514-01b4b2270102 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lazy-loading 'services' on Instance uuid d50976fb-756b-4b12-92f2-cedf87df492d {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:15:26.186670 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-994aca82-cf3b-4901-bd67-26a019ab299b tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 88b09b16-f667-4ab9-89ca-a26dc86967ae] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:26.193704 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-994aca82-cf3b-4901-bd67-26a019ab299b tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:26.194750 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-994aca82-cf3b-4901-bd67-26a019ab299b tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:26.195468 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-994aca82-cf3b-4901-bd67-26a019ab299b tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:26.198015 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-994aca82-cf3b-4901-bd67-26a019ab299b tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:26.199250 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-994aca82-cf3b-4901-bd67-26a019ab299b tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:26.200129 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-994aca82-cf3b-4901-bd67-26a019ab299b tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:26.220528 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-cd34b656-4786-44f8-a514-01b4b2270102 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d" status: 200 len: 1927 microversion: 2.75 time: 0.233702 Oct 19 03:15:26.223226 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=100 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:15:26.236006 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 447/952] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:25 2022] GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d => generated 1927 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:15:26.247787 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-bb5f037c-ec54-4666-b2a5-169a61cbb508 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Action: 'create', calling method: .version_select at 0x7fc1310575e0>, body: {"keypair": {"name": "tempest-keypair-509612903", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCaoht78bZ1MAM045hcOgtQXPScw+17laCKSR1j5A4c2qx0CojQH4rgGKxbCL/zFRBMiKifOHqL8ouxltTfsDJ7KUQb2qo6QON0vAA1S9y4VjzjS+OAGI5U7sEDbAu1xXQ=="}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:15:26.275222 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-bb5f037c-ec54-4666-b2a5-169a61cbb508 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Getting quotas for project 86eaac72e51142f795b3e482be19c4f2. Resources: {'key_pairs'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:15:26.281764 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-bb5f037c-ec54-4666-b2a5-169a61cbb508 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Getting quotas for user 7a453f077dae4dfa8a3cf28c555a9a7c and project 86eaac72e51142f795b3e482be19c4f2. Resources: {'key_pairs'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:15:26.422430 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-bb5f037c-ec54-4666-b2a5-169a61cbb508 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.25 time: 0.184495 Oct 19 03:15:26.423003 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 448/953] 10.222.0.52 () {62 vars in 1200 bytes} [Wed Oct 19 03:15:26 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 186 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 19 03:15:26.424820 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-994aca82-cf3b-4901-bd67-26a019ab299b tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:26.435688 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-994aca82-cf3b-4901-bd67-26a019ab299b tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/88b09b16-f667-4ab9-89ca-a26dc86967ae" status: 200 len: 1318 microversion: 2.1 time: 0.257559 Oct 19 03:15:26.439184 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 506/954] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:26 2022] GET /compute/v2.1/servers/88b09b16-f667-4ab9-89ca-a26dc86967ae => generated 1318 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:15:26.604474 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-49d92b5f-7c9c-4ee0-82d8-263de125b902 req-d842894f-1fb4-4041-8828-f49c821e6788 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9daa020d-efe7-4033-a479-cb5dadbc3ad7", "tag": "ffc480f5-b5eb-49ea-81a9-00c3c1562f19"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:15:26.630285 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-49d92b5f-7c9c-4ee0-82d8-263de125b902 req-d842894f-1fb4-4041-8828-f49c821e6788 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:26.633434 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-49d92b5f-7c9c-4ee0-82d8-263de125b902 req-d842894f-1fb4-4041-8828-f49c821e6788 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:26.634112 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-49d92b5f-7c9c-4ee0-82d8-263de125b902 req-d842894f-1fb4-4041-8828-f49c821e6788 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:26.662648 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-49d92b5f-7c9c-4ee0-82d8-263de125b902 req-d842894f-1fb4-4041-8828-f49c821e6788 service nova] Creating event network-changed:ffc480f5-b5eb-49ea-81a9-00c3c1562f19 for instance 9daa020d-efe7-4033-a479-cb5dadbc3ad7 on n-h2-861333-8 Oct 19 03:15:26.673098 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-49d92b5f-7c9c-4ee0-82d8-263de125b902 req-d842894f-1fb4-4041-8828-f49c821e6788 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072760 Oct 19 03:15:26.678018 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 449/955] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:15:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:15:26.817084 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6882ab41-6a9f-4bc9-9f13-076b4eb1e7a9 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:26.817763 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6882ab41-6a9f-4bc9-9f13-076b4eb1e7a9 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 9daa020d-efe7-4033-a479-cb5dadbc3ad7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:26.829998 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=38 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:15:26.837062 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6882ab41-6a9f-4bc9-9f13-076b4eb1e7a9 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:26.838698 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6882ab41-6a9f-4bc9-9f13-076b4eb1e7a9 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:26.839400 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6882ab41-6a9f-4bc9-9f13-076b4eb1e7a9 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:26.840335 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6882ab41-6a9f-4bc9-9f13-076b4eb1e7a9 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:26.841993 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6882ab41-6a9f-4bc9-9f13-076b4eb1e7a9 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:26.843107 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6882ab41-6a9f-4bc9-9f13-076b4eb1e7a9 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:27.020920 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-38553121-0176-4765-9710-4447acb51796 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:27.022554 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-38553121-0176-4765-9710-4447acb51796 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:27.050621 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-38553121-0176-4765-9710-4447acb51796 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:27.051507 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-38553121-0176-4765-9710-4447acb51796 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:27.054176 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-38553121-0176-4765-9710-4447acb51796 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:27.058457 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-38553121-0176-4765-9710-4447acb51796 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:27.063565 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-38553121-0176-4765-9710-4447acb51796 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:27.065241 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-38553121-0176-4765-9710-4447acb51796 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:27.250968 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-38553121-0176-4765-9710-4447acb51796 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:27.260067 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-38553121-0176-4765-9710-4447acb51796 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:27.267922 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-38553121-0176-4765-9710-4447acb51796 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:27.279612 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-38553121-0176-4765-9710-4447acb51796 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1546 microversion: 2.91 time: 0.266720 Oct 19 03:15:27.288962 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 450/956] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:27 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1546 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:15:27.294719 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6299bbe6-4aad-4582-b419-89ae9c8880ff tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:27.295720 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6299bbe6-4aad-4582-b419-89ae9c8880ff tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] [instance: d50976fb-756b-4b12-92f2-cedf87df492d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:27.315995 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6299bbe6-4aad-4582-b419-89ae9c8880ff tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:27.316890 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6299bbe6-4aad-4582-b419-89ae9c8880ff tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:27.317781 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6299bbe6-4aad-4582-b419-89ae9c8880ff tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:27.318803 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6299bbe6-4aad-4582-b419-89ae9c8880ff tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:27.320100 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6299bbe6-4aad-4582-b419-89ae9c8880ff tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:27.320779 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6299bbe6-4aad-4582-b419-89ae9c8880ff tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:27.556928 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-6299bbe6-4aad-4582-b419-89ae9c8880ff tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lazy-loading 'services' on Instance uuid d50976fb-756b-4b12-92f2-cedf87df492d {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:15:27.602244 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6299bbe6-4aad-4582-b419-89ae9c8880ff tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d" status: 200 len: 1927 microversion: 2.75 time: 0.311633 Oct 19 03:15:27.603157 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 451/957] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:27 2022] GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d => generated 1927 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:15:27.608082 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-19915136-a2ab-4972-a417-c5abd82abd8a tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:27.608698 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-19915136-a2ab-4972-a417-c5abd82abd8a tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 88b09b16-f667-4ab9-89ca-a26dc86967ae] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:27.618108 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-19915136-a2ab-4972-a417-c5abd82abd8a tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:27.618660 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-19915136-a2ab-4972-a417-c5abd82abd8a tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:27.619269 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-19915136-a2ab-4972-a417-c5abd82abd8a tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:27.633031 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-19915136-a2ab-4972-a417-c5abd82abd8a tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:27.634241 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-19915136-a2ab-4972-a417-c5abd82abd8a tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:27.635701 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-19915136-a2ab-4972-a417-c5abd82abd8a tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:27.802866 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-6882ab41-6a9f-4bc9-9f13-076b4eb1e7a9 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:27.819740 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6882ab41-6a9f-4bc9-9f13-076b4eb1e7a9 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7" status: 200 len: 1378 microversion: 2.1 time: 1.008368 Oct 19 03:15:27.820792 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 507/958] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:26 2022] GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7 => generated 1378 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:15:28.211381 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-19915136-a2ab-4972-a417-c5abd82abd8a tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:28.234576 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-19915136-a2ab-4972-a417-c5abd82abd8a tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/88b09b16-f667-4ab9-89ca-a26dc86967ae" status: 200 len: 1318 microversion: 2.1 time: 0.630235 Oct 19 03:15:28.238307 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 452/959] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:27 2022] GET /compute/v2.1/servers/88b09b16-f667-4ab9-89ca-a26dc86967ae => generated 1318 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:15:28.320648 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-aaf16bb8-b244-440e-bb7b-6a09e519b2e0 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:28.321256 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-aaf16bb8-b244-440e-bb7b-6a09e519b2e0 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:28.327775 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aaf16bb8-b244-440e-bb7b-6a09e519b2e0 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:28.328278 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aaf16bb8-b244-440e-bb7b-6a09e519b2e0 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:28.328716 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aaf16bb8-b244-440e-bb7b-6a09e519b2e0 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:28.331220 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aaf16bb8-b244-440e-bb7b-6a09e519b2e0 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:28.331766 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aaf16bb8-b244-440e-bb7b-6a09e519b2e0 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:28.332151 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aaf16bb8-b244-440e-bb7b-6a09e519b2e0 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:28.632901 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-58cd5a9a-67c9-4b38-9a69-a9e73854a34b tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:28.635537 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-58cd5a9a-67c9-4b38-9a69-a9e73854a34b tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] [instance: d50976fb-756b-4b12-92f2-cedf87df492d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:28.660486 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-58cd5a9a-67c9-4b38-9a69-a9e73854a34b tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:28.660993 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-58cd5a9a-67c9-4b38-9a69-a9e73854a34b tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:28.662459 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-58cd5a9a-67c9-4b38-9a69-a9e73854a34b tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:28.663316 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-58cd5a9a-67c9-4b38-9a69-a9e73854a34b tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:28.663793 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-58cd5a9a-67c9-4b38-9a69-a9e73854a34b tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:28.664478 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-58cd5a9a-67c9-4b38-9a69-a9e73854a34b tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:28.779194 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-aaf16bb8-b244-440e-bb7b-6a09e519b2e0 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:28.791412 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-aaf16bb8-b244-440e-bb7b-6a09e519b2e0 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:28.804592 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-aaf16bb8-b244-440e-bb7b-6a09e519b2e0 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:28.814854 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-aaf16bb8-b244-440e-bb7b-6a09e519b2e0 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1546 microversion: 2.91 time: 0.498001 Oct 19 03:15:28.816032 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 508/960] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:28 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1546 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:15:28.849933 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-58cd5a9a-67c9-4b38-9a69-a9e73854a34b tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lazy-loading 'services' on Instance uuid d50976fb-756b-4b12-92f2-cedf87df492d {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:15:28.868509 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-dd8305c6-a04e-44b7-8d16-36ada05c4c36 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:28.869232 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-dd8305c6-a04e-44b7-8d16-36ada05c4c36 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 9daa020d-efe7-4033-a479-cb5dadbc3ad7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:28.884105 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-58cd5a9a-67c9-4b38-9a69-a9e73854a34b tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d" status: 200 len: 1927 microversion: 2.75 time: 0.255371 Oct 19 03:15:28.884699 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 453/961] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:28 2022] GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d => generated 1927 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:15:28.893462 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dd8305c6-a04e-44b7-8d16-36ada05c4c36 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:28.895460 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dd8305c6-a04e-44b7-8d16-36ada05c4c36 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:28.896090 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dd8305c6-a04e-44b7-8d16-36ada05c4c36 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:28.897002 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dd8305c6-a04e-44b7-8d16-36ada05c4c36 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:28.897657 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dd8305c6-a04e-44b7-8d16-36ada05c4c36 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:28.898252 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dd8305c6-a04e-44b7-8d16-36ada05c4c36 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:29.264056 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c8eda01c-9d0f-4b90-9258-9c5350ffe48a tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:29.280589 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c8eda01c-9d0f-4b90-9258-9c5350ffe48a tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 88b09b16-f667-4ab9-89ca-a26dc86967ae] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:29.293858 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=4 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:15:29.333299 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c8eda01c-9d0f-4b90-9258-9c5350ffe48a tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:29.333299 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c8eda01c-9d0f-4b90-9258-9c5350ffe48a tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:29.333299 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c8eda01c-9d0f-4b90-9258-9c5350ffe48a tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:29.333299 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c8eda01c-9d0f-4b90-9258-9c5350ffe48a tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:29.333720 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c8eda01c-9d0f-4b90-9258-9c5350ffe48a tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:29.333720 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c8eda01c-9d0f-4b90-9258-9c5350ffe48a tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:29.815534 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-dd8305c6-a04e-44b7-8d16-36ada05c4c36 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:29.831123 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-dd8305c6-a04e-44b7-8d16-36ada05c4c36 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7" status: 200 len: 1378 microversion: 2.1 time: 0.981918 Oct 19 03:15:29.835357 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 509/962] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:28 2022] GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7 => generated 1378 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:15:29.848738 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2370dc68-1dca-433d-8dde-1f77fdb8abb6 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:29.855008 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-2370dc68-1dca-433d-8dde-1f77fdb8abb6 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:29.871130 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:15:29.882946 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2370dc68-1dca-433d-8dde-1f77fdb8abb6 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:29.883462 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2370dc68-1dca-433d-8dde-1f77fdb8abb6 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:29.883908 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2370dc68-1dca-433d-8dde-1f77fdb8abb6 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:29.891037 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2370dc68-1dca-433d-8dde-1f77fdb8abb6 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:29.891640 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2370dc68-1dca-433d-8dde-1f77fdb8abb6 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:29.892104 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2370dc68-1dca-433d-8dde-1f77fdb8abb6 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:29.953393 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c8eda01c-9d0f-4b90-9258-9c5350ffe48a tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:29.956617 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=100 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:15:29.966450 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c8eda01c-9d0f-4b90-9258-9c5350ffe48a tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/88b09b16-f667-4ab9-89ca-a26dc86967ae" status: 200 len: 1318 microversion: 2.1 time: 0.707607 Oct 19 03:15:29.967415 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 454/963] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:29 2022] GET /compute/v2.1/servers/88b09b16-f667-4ab9-89ca-a26dc86967ae => generated 1318 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:15:29.972471 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-86f0db7e-3c09-4560-8c39-ce212fe35817 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:29.973078 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-86f0db7e-3c09-4560-8c39-ce212fe35817 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] [instance: d50976fb-756b-4b12-92f2-cedf87df492d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:29.993032 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-86f0db7e-3c09-4560-8c39-ce212fe35817 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:29.993676 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-86f0db7e-3c09-4560-8c39-ce212fe35817 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:29.994127 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-86f0db7e-3c09-4560-8c39-ce212fe35817 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:29.994851 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-86f0db7e-3c09-4560-8c39-ce212fe35817 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:29.995909 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-86f0db7e-3c09-4560-8c39-ce212fe35817 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:29.996363 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-86f0db7e-3c09-4560-8c39-ce212fe35817 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:30.157697 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-2370dc68-1dca-433d-8dde-1f77fdb8abb6 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:30.172037 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-2370dc68-1dca-433d-8dde-1f77fdb8abb6 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:30.175380 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-2370dc68-1dca-433d-8dde-1f77fdb8abb6 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:30.178851 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-86f0db7e-3c09-4560-8c39-ce212fe35817 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lazy-loading 'services' on Instance uuid d50976fb-756b-4b12-92f2-cedf87df492d {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:15:30.190801 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2370dc68-1dca-433d-8dde-1f77fdb8abb6 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1546 microversion: 2.91 time: 0.348113 Oct 19 03:15:30.191523 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 510/964] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:29 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1546 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:15:30.231008 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-86f0db7e-3c09-4560-8c39-ce212fe35817 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d" status: 200 len: 1927 microversion: 2.75 time: 0.262343 Oct 19 03:15:30.231672 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 455/965] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:29 2022] GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d => generated 1927 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:15:30.845843 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-36dd1e02-eae5-45dd-bb44-eca907d5b275 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1752832707", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "networks": [{"uuid": "ba959db6-6066-4748-89f7-037c7f1d280b"}], "security_groups": [{"name": "tempest-securitygroup--184088372"}], "key_name": "tempest-keypair-509612903", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:15:30.867802 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-72d09db2-e340-4956-8b86-f609f5b3fe87 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:30.871036 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-72d09db2-e340-4956-8b86-f609f5b3fe87 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 9daa020d-efe7-4033-a479-cb5dadbc3ad7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:30.882144 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-72d09db2-e340-4956-8b86-f609f5b3fe87 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:30.896189 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-72d09db2-e340-4956-8b86-f609f5b3fe87 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:30.896189 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-72d09db2-e340-4956-8b86-f609f5b3fe87 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:30.896189 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-72d09db2-e340-4956-8b86-f609f5b3fe87 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:30.896189 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-72d09db2-e340-4956-8b86-f609f5b3fe87 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:30.896743 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-72d09db2-e340-4956-8b86-f609f5b3fe87 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:31.261082 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.network.neutron [None req-36dd1e02-eae5-45dd-bb44-eca907d5b275 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] validate_networks() for [('ba959db6-6066-4748-89f7-037c7f1d280b', None, None, None, None, None)] {{(pid=121135) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:15:31.360208 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-72d09db2-e340-4956-8b86-f609f5b3fe87 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:31.382532 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-72d09db2-e340-4956-8b86-f609f5b3fe87 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7" status: 200 len: 1378 microversion: 2.1 time: 0.524981 Oct 19 03:15:31.383927 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 456/966] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:30 2022] GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7 => generated 1378 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:15:31.399622 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7a9e652b-f219-489d-a5c5-0deda8050ec1 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:31.402301 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7a9e652b-f219-489d-a5c5-0deda8050ec1 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 88b09b16-f667-4ab9-89ca-a26dc86967ae] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:31.414134 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7a9e652b-f219-489d-a5c5-0deda8050ec1 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:31.414644 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7a9e652b-f219-489d-a5c5-0deda8050ec1 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:31.415091 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7a9e652b-f219-489d-a5c5-0deda8050ec1 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:31.415811 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7a9e652b-f219-489d-a5c5-0deda8050ec1 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:31.416272 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7a9e652b-f219-489d-a5c5-0deda8050ec1 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:31.416703 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7a9e652b-f219-489d-a5c5-0deda8050ec1 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:31.743481 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-7a9e652b-f219-489d-a5c5-0deda8050ec1 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:31.752362 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7a9e652b-f219-489d-a5c5-0deda8050ec1 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/88b09b16-f667-4ab9-89ca-a26dc86967ae" status: 200 len: 1318 microversion: 2.1 time: 0.367131 Oct 19 03:15:31.755494 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 457/967] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:31 2022] GET /compute/v2.1/servers/88b09b16-f667-4ab9-89ca-a26dc86967ae => generated 1318 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:15:31.769537 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-df911de1-4dd2-4aab-8f81-65ad0538723d tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:31.769537 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-df911de1-4dd2-4aab-8f81-65ad0538723d tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:31.779392 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-df911de1-4dd2-4aab-8f81-65ad0538723d tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:31.788010 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-df911de1-4dd2-4aab-8f81-65ad0538723d tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:31.788010 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-df911de1-4dd2-4aab-8f81-65ad0538723d tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:31.788010 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-df911de1-4dd2-4aab-8f81-65ad0538723d tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:31.788010 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-df911de1-4dd2-4aab-8f81-65ad0538723d tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:31.788393 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-df911de1-4dd2-4aab-8f81-65ad0538723d tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:31.891447 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-df911de1-4dd2-4aab-8f81-65ad0538723d tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:31.903689 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-df911de1-4dd2-4aab-8f81-65ad0538723d tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:31.905597 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-df911de1-4dd2-4aab-8f81-65ad0538723d tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:31.911059 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-df911de1-4dd2-4aab-8f81-65ad0538723d tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1546 microversion: 2.91 time: 0.156929 Oct 19 03:15:31.911635 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 458/968] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:31 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1546 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:15:31.916270 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e08cdd43-df6c-464f-bd8c-e60ffc48e5ea tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:31.917696 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e08cdd43-df6c-464f-bd8c-e60ffc48e5ea tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] [instance: d50976fb-756b-4b12-92f2-cedf87df492d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:31.924242 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e08cdd43-df6c-464f-bd8c-e60ffc48e5ea tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:31.924983 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e08cdd43-df6c-464f-bd8c-e60ffc48e5ea tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:31.925747 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e08cdd43-df6c-464f-bd8c-e60ffc48e5ea tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:31.926890 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e08cdd43-df6c-464f-bd8c-e60ffc48e5ea tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:31.928588 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e08cdd43-df6c-464f-bd8c-e60ffc48e5ea tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:31.929364 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e08cdd43-df6c-464f-bd8c-e60ffc48e5ea tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:32.031263 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-e08cdd43-df6c-464f-bd8c-e60ffc48e5ea tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lazy-loading 'services' on Instance uuid d50976fb-756b-4b12-92f2-cedf87df492d {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:15:32.077130 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e08cdd43-df6c-464f-bd8c-e60ffc48e5ea tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d" status: 200 len: 1927 microversion: 2.75 time: 0.163989 Oct 19 03:15:32.077645 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 459/969] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:31 2022] GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d => generated 1927 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:15:32.166714 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-36dd1e02-eae5-45dd-bb44-eca907d5b275 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Flavor limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:15:32.167467 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-36dd1e02-eae5-45dd-bb44-eca907d5b275 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Image limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:15:32.168173 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-36dd1e02-eae5-45dd-bb44-eca907d5b275 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Flavor pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:15:32.169407 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-36dd1e02-eae5-45dd-bb44-eca907d5b275 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Image pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:15:32.170067 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-36dd1e02-eae5-45dd-bb44-eca907d5b275 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:15:32.185271 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-36dd1e02-eae5-45dd-bb44-eca907d5b275 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:32.191317 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-36dd1e02-eae5-45dd-bb44-eca907d5b275 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:32.191317 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-36dd1e02-eae5-45dd-bb44-eca907d5b275 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:32.191317 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-36dd1e02-eae5-45dd-bb44-eca907d5b275 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:32.191317 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-36dd1e02-eae5-45dd-bb44-eca907d5b275 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:32.191730 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-36dd1e02-eae5-45dd-bb44-eca907d5b275 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:32.213075 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-36dd1e02-eae5-45dd-bb44-eca907d5b275 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Getting quotas for project 86eaac72e51142f795b3e482be19c4f2. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:15:32.220572 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-36dd1e02-eae5-45dd-bb44-eca907d5b275 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Getting quotas for user 7a453f077dae4dfa8a3cf28c555a9a7c and project 86eaac72e51142f795b3e482be19c4f2. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:15:32.239595 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-36dd1e02-eae5-45dd-bb44-eca907d5b275 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Going to run 1 instances... {{(pid=121135) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:15:32.242812 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-36dd1e02-eae5-45dd-bb44-eca907d5b275 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 62133546-4a75-4532-81ab-0c49c9252e85] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121135) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:15:32.336800 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-eea233a5-270e-427b-b4ee-ccbb7838ca8c tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Action: 'create', calling method: .version_select at 0x7fc1318d1b80>, body: {"keypair": {"name": "tempest-keypair-1276665942", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPHCol3g057z9ZlAoN20cVfAmJUCiQTC4Swkaf3SveIVa2qjEhLbUayBhsPTdkJoYrEY5KscNauVfOsMJf7VEMfGYncALxGzFxghleGN+btJ24tXXh5LWuFirRu8nBE6kQ=="}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:15:32.354072 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-eea233a5-270e-427b-b4ee-ccbb7838ca8c tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Getting quotas for project f8e388d05eac4f2babf180c0709fdc58. Resources: {'key_pairs'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:15:32.361219 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-eea233a5-270e-427b-b4ee-ccbb7838ca8c tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Getting quotas for user 439c1401b92c44228bd6e80dd3b786ce and project f8e388d05eac4f2babf180c0709fdc58. Resources: {'key_pairs'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:15:32.384281 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-36dd1e02-eae5-45dd-bb44-eca907d5b275 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.25 time: 1.542444 Oct 19 03:15:32.392732 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 511/970] 10.222.0.52 () {62 vars in 1188 bytes} [Wed Oct 19 03:15:30 2022] POST /compute/v2.1/servers => generated 405 bytes in 1552 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 19 03:15:32.398074 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c780a711-4784-4dce-a950-c9c6a398b74a tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:32.399041 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c780a711-4784-4dce-a950-c9c6a398b74a tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 62133546-4a75-4532-81ab-0c49c9252e85] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:32.496303 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c780a711-4784-4dce-a950-c9c6a398b74a tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:32.507491 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-eea233a5-270e-427b-b4ee-ccbb7838ca8c tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.361207 Oct 19 03:15:32.508287 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 460/971] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Oct 19 03:15:32 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:15:32.515947 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c780a711-4784-4dce-a950-c9c6a398b74a tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:32.518251 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c780a711-4784-4dce-a950-c9c6a398b74a tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:32.534289 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-17a48d46-f014-4016-bf21-d4d0e785cf96 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:32.535883 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c780a711-4784-4dce-a950-c9c6a398b74a tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85" status: 200 len: 1285 microversion: 2.25 time: 0.140887 Oct 19 03:15:32.538152 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 512/972] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:32 2022] GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85 => generated 1285 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:15:32.539486 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-17a48d46-f014-4016-bf21-d4d0e785cf96 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 9daa020d-efe7-4033-a479-cb5dadbc3ad7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:32.549621 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-17a48d46-f014-4016-bf21-d4d0e785cf96 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:32.550000 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-17a48d46-f014-4016-bf21-d4d0e785cf96 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:32.552689 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-17a48d46-f014-4016-bf21-d4d0e785cf96 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:32.553463 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-17a48d46-f014-4016-bf21-d4d0e785cf96 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:32.553932 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-17a48d46-f014-4016-bf21-d4d0e785cf96 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:32.554363 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-17a48d46-f014-4016-bf21-d4d0e785cf96 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:32.735360 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-db303989-f4f8-4254-a972-3e549cd7a087 req-5a05c83a-fe3c-40e8-a5f9-5cd0bac17db4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46e24c0c-6e9f-4a51-a10e-dcb68ebf6f9d", "name": "network-vif-plugged", "status": "completed", "tag": "24ff5b68-bf87-4f37-9228-f1c21d3cc33a"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:15:32.749852 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-17a48d46-f014-4016-bf21-d4d0e785cf96 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:32.754396 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-db303989-f4f8-4254-a972-3e549cd7a087 req-5a05c83a-fe3c-40e8-a5f9-5cd0bac17db4 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:32.758449 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-17a48d46-f014-4016-bf21-d4d0e785cf96 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7" status: 200 len: 1378 microversion: 2.1 time: 0.229170 Oct 19 03:15:32.759468 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-db303989-f4f8-4254-a972-3e549cd7a087 req-5a05c83a-fe3c-40e8-a5f9-5cd0bac17db4 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:32.762665 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-db303989-f4f8-4254-a972-3e549cd7a087 req-5a05c83a-fe3c-40e8-a5f9-5cd0bac17db4 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:32.772683 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 461/973] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:32 2022] GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7 => generated 1378 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:15:32.782464 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-27fc04f8-e4c6-45ed-9201-669ced659c89 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:32.783515 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-27fc04f8-e4c6-45ed-9201-669ced659c89 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 88b09b16-f667-4ab9-89ca-a26dc86967ae] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:32.791530 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-27fc04f8-e4c6-45ed-9201-669ced659c89 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:32.792427 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-27fc04f8-e4c6-45ed-9201-669ced659c89 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:32.792626 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-db303989-f4f8-4254-a972-3e549cd7a087 req-5a05c83a-fe3c-40e8-a5f9-5cd0bac17db4 service nova] Creating event network-vif-plugged:24ff5b68-bf87-4f37-9228-f1c21d3cc33a for instance 46e24c0c-6e9f-4a51-a10e-dcb68ebf6f9d on n-h2-861333-8 Oct 19 03:15:32.800547 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-27fc04f8-e4c6-45ed-9201-669ced659c89 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:32.801888 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-27fc04f8-e4c6-45ed-9201-669ced659c89 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:32.802393 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-27fc04f8-e4c6-45ed-9201-669ced659c89 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:32.807542 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-27fc04f8-e4c6-45ed-9201-669ced659c89 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:32.808228 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-db303989-f4f8-4254-a972-3e549cd7a087 req-5a05c83a-fe3c-40e8-a5f9-5cd0bac17db4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078863 Oct 19 03:15:32.812885 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 513/974] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:15:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:15:32.945683 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4ec05717-fbe8-4cc5-8498-3da4ed2183b8 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:32.946676 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4ec05717-fbe8-4cc5-8498-3da4ed2183b8 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:32.971304 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4ec05717-fbe8-4cc5-8498-3da4ed2183b8 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:32.974178 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4ec05717-fbe8-4cc5-8498-3da4ed2183b8 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:32.974178 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4ec05717-fbe8-4cc5-8498-3da4ed2183b8 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:32.974178 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4ec05717-fbe8-4cc5-8498-3da4ed2183b8 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:32.974178 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4ec05717-fbe8-4cc5-8498-3da4ed2183b8 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:32.974505 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4ec05717-fbe8-4cc5-8498-3da4ed2183b8 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:33.088101 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-27fc04f8-e4c6-45ed-9201-669ced659c89 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:33.098309 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-27fc04f8-e4c6-45ed-9201-669ced659c89 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/88b09b16-f667-4ab9-89ca-a26dc86967ae" status: 200 len: 1318 microversion: 2.1 time: 0.323542 Oct 19 03:15:33.113809 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 462/975] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:32 2022] GET /compute/v2.1/servers/88b09b16-f667-4ab9-89ca-a26dc86967ae => generated 1318 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:15:33.127674 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8835a7b9-3892-4893-bb06-9f60deb1abca tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:33.128350 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8835a7b9-3892-4893-bb06-9f60deb1abca tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] [instance: d50976fb-756b-4b12-92f2-cedf87df492d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:33.130234 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:15:33.135231 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8835a7b9-3892-4893-bb06-9f60deb1abca tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:33.135778 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8835a7b9-3892-4893-bb06-9f60deb1abca tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:33.136472 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8835a7b9-3892-4893-bb06-9f60deb1abca tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:33.137715 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8835a7b9-3892-4893-bb06-9f60deb1abca tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:33.138443 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8835a7b9-3892-4893-bb06-9f60deb1abca tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:33.139159 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8835a7b9-3892-4893-bb06-9f60deb1abca tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:33.175556 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4ec05717-fbe8-4cc5-8498-3da4ed2183b8 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:33.196355 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4ec05717-fbe8-4cc5-8498-3da4ed2183b8 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:33.198219 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4ec05717-fbe8-4cc5-8498-3da4ed2183b8 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:33.205689 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4ec05717-fbe8-4cc5-8498-3da4ed2183b8 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1546 microversion: 2.91 time: 0.265146 Oct 19 03:15:33.206920 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 514/976] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:32 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1546 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:15:33.257583 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-8835a7b9-3892-4893-bb06-9f60deb1abca tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lazy-loading 'services' on Instance uuid d50976fb-756b-4b12-92f2-cedf87df492d {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:15:33.281830 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8835a7b9-3892-4893-bb06-9f60deb1abca tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d" status: 200 len: 1927 microversion: 2.75 time: 0.166514 Oct 19 03:15:33.287012 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 463/977] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:33 2022] GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d => generated 1927 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:15:33.568823 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9737129e-943e-4e96-8b71-33d94204ef8e tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:33.569635 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9737129e-943e-4e96-8b71-33d94204ef8e tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 62133546-4a75-4532-81ab-0c49c9252e85] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:33.641553 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-9737129e-943e-4e96-8b71-33d94204ef8e tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:33.663145 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-9737129e-943e-4e96-8b71-33d94204ef8e tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:33.669116 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-9737129e-943e-4e96-8b71-33d94204ef8e tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:33.672923 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9737129e-943e-4e96-8b71-33d94204ef8e tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85" status: 200 len: 1285 microversion: 2.25 time: 0.105977 Oct 19 03:15:33.673558 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 515/978] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:33 2022] GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85 => generated 1285 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:15:33.786989 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-17f98946-29a4-459a-8025-0e533be53b99 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:33.787982 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-17f98946-29a4-459a-8025-0e533be53b99 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 9daa020d-efe7-4033-a479-cb5dadbc3ad7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:33.795277 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-17f98946-29a4-459a-8025-0e533be53b99 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:33.795774 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-17f98946-29a4-459a-8025-0e533be53b99 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:33.796215 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-17f98946-29a4-459a-8025-0e533be53b99 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:33.796951 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-17f98946-29a4-459a-8025-0e533be53b99 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:33.797433 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-17f98946-29a4-459a-8025-0e533be53b99 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:33.797867 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-17f98946-29a4-459a-8025-0e533be53b99 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:33.983223 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-17f98946-29a4-459a-8025-0e533be53b99 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:33.994161 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-17f98946-29a4-459a-8025-0e533be53b99 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7" status: 200 len: 1378 microversion: 2.1 time: 0.212106 Oct 19 03:15:33.996058 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 464/979] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:33 2022] GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7 => generated 1378 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:15:34.135216 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-23c87d1f-37d1-4321-b494-500b42053620 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:34.137049 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-23c87d1f-37d1-4321-b494-500b42053620 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 88b09b16-f667-4ab9-89ca-a26dc86967ae] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:34.143844 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-23c87d1f-37d1-4321-b494-500b42053620 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:34.147236 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-23c87d1f-37d1-4321-b494-500b42053620 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:34.147236 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-23c87d1f-37d1-4321-b494-500b42053620 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:34.147236 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-23c87d1f-37d1-4321-b494-500b42053620 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:34.147236 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-23c87d1f-37d1-4321-b494-500b42053620 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:34.147625 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-23c87d1f-37d1-4321-b494-500b42053620 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:34.237091 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-bee34153-88a7-49ad-8cce-090496e660fa tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:34.238440 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-bee34153-88a7-49ad-8cce-090496e660fa tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:34.244507 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bee34153-88a7-49ad-8cce-090496e660fa tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:34.245003 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bee34153-88a7-49ad-8cce-090496e660fa tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:34.246281 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bee34153-88a7-49ad-8cce-090496e660fa tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:34.247197 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bee34153-88a7-49ad-8cce-090496e660fa tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:34.247850 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bee34153-88a7-49ad-8cce-090496e660fa tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:34.248489 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bee34153-88a7-49ad-8cce-090496e660fa tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:34.345899 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-bee34153-88a7-49ad-8cce-090496e660fa tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:34.359057 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-bee34153-88a7-49ad-8cce-090496e660fa tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:34.359211 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-23c87d1f-37d1-4321-b494-500b42053620 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:34.361134 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-bee34153-88a7-49ad-8cce-090496e660fa tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:34.368480 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-bee34153-88a7-49ad-8cce-090496e660fa tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1546 microversion: 2.91 time: 0.135564 Oct 19 03:15:34.372553 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-23c87d1f-37d1-4321-b494-500b42053620 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/88b09b16-f667-4ab9-89ca-a26dc86967ae" status: 200 len: 1318 microversion: 2.1 time: 0.240335 Oct 19 03:15:34.372671 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 465/980] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:34 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1546 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:15:34.375098 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-cbb82047-3f8a-47b6-89b1-64fcbef06d51 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:34.376199 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-cbb82047-3f8a-47b6-89b1-64fcbef06d51 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] [instance: d50976fb-756b-4b12-92f2-cedf87df492d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:34.383108 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cbb82047-3f8a-47b6-89b1-64fcbef06d51 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:34.383812 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cbb82047-3f8a-47b6-89b1-64fcbef06d51 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:34.384432 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cbb82047-3f8a-47b6-89b1-64fcbef06d51 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:34.387229 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cbb82047-3f8a-47b6-89b1-64fcbef06d51 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:34.388361 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cbb82047-3f8a-47b6-89b1-64fcbef06d51 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:34.389000 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cbb82047-3f8a-47b6-89b1-64fcbef06d51 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:34.395438 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 516/981] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:34 2022] GET /compute/v2.1/servers/88b09b16-f667-4ab9-89ca-a26dc86967ae => generated 1318 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:15:34.532883 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-cbb82047-3f8a-47b6-89b1-64fcbef06d51 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lazy-loading 'services' on Instance uuid d50976fb-756b-4b12-92f2-cedf87df492d {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:15:34.556337 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-cbb82047-3f8a-47b6-89b1-64fcbef06d51 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d" status: 200 len: 1927 microversion: 2.75 time: 0.185113 Oct 19 03:15:34.556912 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 466/982] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:34 2022] GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d => generated 1927 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:15:34.704672 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-275163c6-ed95-4c4a-abe3-f66e99ff0027 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:34.706297 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-275163c6-ed95-4c4a-abe3-f66e99ff0027 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 62133546-4a75-4532-81ab-0c49c9252e85] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:34.720566 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-275163c6-ed95-4c4a-abe3-f66e99ff0027 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:34.720566 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-275163c6-ed95-4c4a-abe3-f66e99ff0027 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:34.720566 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-275163c6-ed95-4c4a-abe3-f66e99ff0027 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:34.720566 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-275163c6-ed95-4c4a-abe3-f66e99ff0027 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:34.720963 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-275163c6-ed95-4c4a-abe3-f66e99ff0027 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:34.720963 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-275163c6-ed95-4c4a-abe3-f66e99ff0027 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:34.790231 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-275163c6-ed95-4c4a-abe3-f66e99ff0027 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:34.804347 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-275163c6-ed95-4c4a-abe3-f66e99ff0027 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:34.805915 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-275163c6-ed95-4c4a-abe3-f66e99ff0027 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:34.808940 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-275163c6-ed95-4c4a-abe3-f66e99ff0027 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85" status: 200 len: 1289 microversion: 2.25 time: 0.107814 Oct 19 03:15:34.811022 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 517/983] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:34 2022] GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85 => generated 1289 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:15:35.023296 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-70e4d92a-8210-44bf-a42c-555d8b44a75d tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:35.024169 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-70e4d92a-8210-44bf-a42c-555d8b44a75d tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 9daa020d-efe7-4033-a479-cb5dadbc3ad7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:35.032234 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-70e4d92a-8210-44bf-a42c-555d8b44a75d tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:35.032946 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-70e4d92a-8210-44bf-a42c-555d8b44a75d tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:35.033722 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-70e4d92a-8210-44bf-a42c-555d8b44a75d tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:35.034660 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-70e4d92a-8210-44bf-a42c-555d8b44a75d tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:35.035278 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-70e4d92a-8210-44bf-a42c-555d8b44a75d tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:35.035865 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-70e4d92a-8210-44bf-a42c-555d8b44a75d tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:35.190290 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-70e4d92a-8210-44bf-a42c-555d8b44a75d tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:35.200109 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-70e4d92a-8210-44bf-a42c-555d8b44a75d tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7" status: 200 len: 1378 microversion: 2.1 time: 0.185454 Oct 19 03:15:35.200885 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 467/984] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:35 2022] GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7 => generated 1378 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:15:35.257708 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f9fe8265-0c4b-49ea-82d4-fe25aae3b827 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-260465061", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "5ad3d6bc-0026-4969-8091-7be978b09ee2"}], "security_groups": [{"name": "tempest-securitygroup--1884161950"}], "key_name": "tempest-keypair-1276665942", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:15:35.374430 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.network.neutron [None req-f9fe8265-0c4b-49ea-82d4-fe25aae3b827 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] validate_networks() for [('5ad3d6bc-0026-4969-8091-7be978b09ee2', None, None, None, None, None)] {{(pid=121135) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:15:35.392236 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3bbb3902-8b07-4f20-8086-b4d42123d222 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:35.392982 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3bbb3902-8b07-4f20-8086-b4d42123d222 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 88b09b16-f667-4ab9-89ca-a26dc86967ae] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:35.400891 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3bbb3902-8b07-4f20-8086-b4d42123d222 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:35.401941 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3bbb3902-8b07-4f20-8086-b4d42123d222 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:35.402584 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3bbb3902-8b07-4f20-8086-b4d42123d222 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:35.403462 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3bbb3902-8b07-4f20-8086-b4d42123d222 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:35.404079 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3bbb3902-8b07-4f20-8086-b4d42123d222 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:35.404956 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3bbb3902-8b07-4f20-8086-b4d42123d222 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:35.601758 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-3bbb3902-8b07-4f20-8086-b4d42123d222 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:35.610645 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3bbb3902-8b07-4f20-8086-b4d42123d222 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/88b09b16-f667-4ab9-89ca-a26dc86967ae" status: 200 len: 1318 microversion: 2.1 time: 0.222086 Oct 19 03:15:35.611237 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 468/985] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:35 2022] GET /compute/v2.1/servers/88b09b16-f667-4ab9-89ca-a26dc86967ae => generated 1318 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:15:35.617283 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-46178d10-ab28-4599-a24a-98780bf91b9a tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:35.618805 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-46178d10-ab28-4599-a24a-98780bf91b9a tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:35.627678 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-46178d10-ab28-4599-a24a-98780bf91b9a tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:35.628198 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-46178d10-ab28-4599-a24a-98780bf91b9a tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:35.628779 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-46178d10-ab28-4599-a24a-98780bf91b9a tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:35.629533 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-46178d10-ab28-4599-a24a-98780bf91b9a tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:35.629999 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-46178d10-ab28-4599-a24a-98780bf91b9a tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:35.630439 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-46178d10-ab28-4599-a24a-98780bf91b9a tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:35.727187 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-46178d10-ab28-4599-a24a-98780bf91b9a tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:35.736716 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-46178d10-ab28-4599-a24a-98780bf91b9a tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:35.738248 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-46178d10-ab28-4599-a24a-98780bf91b9a tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:35.743352 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-46178d10-ab28-4599-a24a-98780bf91b9a tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1546 microversion: 2.91 time: 0.131019 Oct 19 03:15:35.744114 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 469/986] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:35 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1546 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:15:35.749527 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-bd731545-5ec2-465d-b94f-7546e40bfad7 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:35.750332 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-bd731545-5ec2-465d-b94f-7546e40bfad7 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] [instance: d50976fb-756b-4b12-92f2-cedf87df492d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:35.756146 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bd731545-5ec2-465d-b94f-7546e40bfad7 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:35.756637 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bd731545-5ec2-465d-b94f-7546e40bfad7 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:35.757079 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bd731545-5ec2-465d-b94f-7546e40bfad7 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:35.757811 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bd731545-5ec2-465d-b94f-7546e40bfad7 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:35.758275 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bd731545-5ec2-465d-b94f-7546e40bfad7 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:35.759080 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bd731545-5ec2-465d-b94f-7546e40bfad7 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:35.857207 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-bd731545-5ec2-465d-b94f-7546e40bfad7 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lazy-loading 'services' on Instance uuid d50976fb-756b-4b12-92f2-cedf87df492d {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:15:35.860428 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=100 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:15:35.879627 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-bd731545-5ec2-465d-b94f-7546e40bfad7 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d" status: 200 len: 1927 microversion: 2.75 time: 0.133869 Oct 19 03:15:35.897916 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 470/987] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:35 2022] GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d => generated 1927 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:15:35.897916 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ecc0ca2f-b98c-4eac-83b5-5625bf067695 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:35.897916 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ecc0ca2f-b98c-4eac-83b5-5625bf067695 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 62133546-4a75-4532-81ab-0c49c9252e85] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:35.898999 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-f9fe8265-0c4b-49ea-82d4-fe25aae3b827 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Getting quotas for project f8e388d05eac4f2babf180c0709fdc58. Resources: dict_keys(['metadata_items']) {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:15:35.901924 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-f9fe8265-0c4b-49ea-82d4-fe25aae3b827 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Getting quotas for user 439c1401b92c44228bd6e80dd3b786ce and project f8e388d05eac4f2babf180c0709fdc58. Resources: dict_keys(['metadata_items']) {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:15:35.907961 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ecc0ca2f-b98c-4eac-83b5-5625bf067695 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:35.908747 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ecc0ca2f-b98c-4eac-83b5-5625bf067695 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:35.909521 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ecc0ca2f-b98c-4eac-83b5-5625bf067695 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:35.910540 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ecc0ca2f-b98c-4eac-83b5-5625bf067695 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:35.911097 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ecc0ca2f-b98c-4eac-83b5-5625bf067695 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:35.911626 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ecc0ca2f-b98c-4eac-83b5-5625bf067695 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:35.933951 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-f9fe8265-0c4b-49ea-82d4-fe25aae3b827 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Flavor limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:15:35.934816 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-f9fe8265-0c4b-49ea-82d4-fe25aae3b827 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Image limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:15:35.935488 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-f9fe8265-0c4b-49ea-82d4-fe25aae3b827 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Flavor pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:15:35.936015 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-f9fe8265-0c4b-49ea-82d4-fe25aae3b827 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Image pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:15:35.936530 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-f9fe8265-0c4b-49ea-82d4-fe25aae3b827 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:15:35.945980 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f9fe8265-0c4b-49ea-82d4-fe25aae3b827 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:35.946525 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f9fe8265-0c4b-49ea-82d4-fe25aae3b827 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:35.946964 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f9fe8265-0c4b-49ea-82d4-fe25aae3b827 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:35.947685 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f9fe8265-0c4b-49ea-82d4-fe25aae3b827 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:35.948155 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f9fe8265-0c4b-49ea-82d4-fe25aae3b827 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:35.949394 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f9fe8265-0c4b-49ea-82d4-fe25aae3b827 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:35.969528 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-f9fe8265-0c4b-49ea-82d4-fe25aae3b827 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Getting quotas for project f8e388d05eac4f2babf180c0709fdc58. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:15:35.974264 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-f9fe8265-0c4b-49ea-82d4-fe25aae3b827 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Getting quotas for user 439c1401b92c44228bd6e80dd3b786ce and project f8e388d05eac4f2babf180c0709fdc58. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:15:35.978363 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ecc0ca2f-b98c-4eac-83b5-5625bf067695 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:35.986783 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ecc0ca2f-b98c-4eac-83b5-5625bf067695 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:35.986966 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f9fe8265-0c4b-49ea-82d4-fe25aae3b827 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Going to run 1 instances... {{(pid=121135) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:15:35.988222 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ecc0ca2f-b98c-4eac-83b5-5625bf067695 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:35.989342 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ecc0ca2f-b98c-4eac-83b5-5625bf067695 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85" status: 200 len: 1289 microversion: 2.25 time: 0.105053 Oct 19 03:15:35.989492 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f9fe8265-0c4b-49ea-82d4-fe25aae3b827 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] [instance: b18ae860-ed77-4ddc-b9fa-a2aa773c2614] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121135) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:15:35.989921 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 471/988] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:35 2022] GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85 => generated 1289 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:15:36.224343 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-063346a5-c683-4181-af84-624506fe5232 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:36.224977 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-063346a5-c683-4181-af84-624506fe5232 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 9daa020d-efe7-4033-a479-cb5dadbc3ad7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:36.231759 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-063346a5-c683-4181-af84-624506fe5232 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:36.232176 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-063346a5-c683-4181-af84-624506fe5232 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:36.232606 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-063346a5-c683-4181-af84-624506fe5232 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:36.233292 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-063346a5-c683-4181-af84-624506fe5232 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:36.233767 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-063346a5-c683-4181-af84-624506fe5232 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:36.234189 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-063346a5-c683-4181-af84-624506fe5232 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:36.364332 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-063346a5-c683-4181-af84-624506fe5232 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:36.372553 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-063346a5-c683-4181-af84-624506fe5232 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7" status: 200 len: 1378 microversion: 2.1 time: 0.152408 Oct 19 03:15:36.373131 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 472/989] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:36 2022] GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7 => generated 1378 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:15:36.407610 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f9fe8265-0c4b-49ea-82d4-fe25aae3b827 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.154224 Oct 19 03:15:36.410893 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 518/990] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:15:35 2022] POST /compute/v2.1/servers => generated 407 bytes in 1159 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 03:15:36.419475 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-523a4c73-eea6-4bd7-be5b-5acd42a846b5 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:36.420101 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-523a4c73-eea6-4bd7-be5b-5acd42a846b5 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] [instance: b18ae860-ed77-4ddc-b9fa-a2aa773c2614] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:36.462608 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-531fac10-21e5-44da-898d-1ecf84827066 req-70a74742-cccf-42da-a577-4ab791b568e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9daa020d-efe7-4033-a479-cb5dadbc3ad7", "name": "network-vif-plugged", "status": "completed", "tag": "ffc480f5-b5eb-49ea-81a9-00c3c1562f19"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:15:36.486043 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-531fac10-21e5-44da-898d-1ecf84827066 req-70a74742-cccf-42da-a577-4ab791b568e5 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:36.486498 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-531fac10-21e5-44da-898d-1ecf84827066 req-70a74742-cccf-42da-a577-4ab791b568e5 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:36.486899 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-531fac10-21e5-44da-898d-1ecf84827066 req-70a74742-cccf-42da-a577-4ab791b568e5 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:36.492052 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-523a4c73-eea6-4bd7-be5b-5acd42a846b5 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c1401b92c44228bd6e80dd3b786ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e388d05eac4f2babf180c0709fdc58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:36.494281 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=19 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:15:36.498416 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-531fac10-21e5-44da-898d-1ecf84827066 req-70a74742-cccf-42da-a577-4ab791b568e5 service nova] Creating event network-vif-plugged:ffc480f5-b5eb-49ea-81a9-00c3c1562f19 for instance 9daa020d-efe7-4033-a479-cb5dadbc3ad7 on n-h2-861333-8 Oct 19 03:15:36.500281 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-523a4c73-eea6-4bd7-be5b-5acd42a846b5 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] 10.222.0.52 "GET /compute/v2.1/servers/b18ae860-ed77-4ddc-b9fa-a2aa773c2614" status: 200 len: 1269 microversion: 2.1 time: 0.084624 Oct 19 03:15:36.500860 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 473/991] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:36 2022] GET /compute/v2.1/servers/b18ae860-ed77-4ddc-b9fa-a2aa773c2614 => generated 1269 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:15:36.512839 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-531fac10-21e5-44da-898d-1ecf84827066 req-70a74742-cccf-42da-a577-4ab791b568e5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053644 Oct 19 03:15:36.513740 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 519/992] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:15:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:15:36.633624 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c93a086f-212d-49a8-93c9-9a54c9cfc85e tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:36.634242 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c93a086f-212d-49a8-93c9-9a54c9cfc85e tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 88b09b16-f667-4ab9-89ca-a26dc86967ae] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:36.644207 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c93a086f-212d-49a8-93c9-9a54c9cfc85e tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:36.644820 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c93a086f-212d-49a8-93c9-9a54c9cfc85e tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:36.645621 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c93a086f-212d-49a8-93c9-9a54c9cfc85e tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:36.646436 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c93a086f-212d-49a8-93c9-9a54c9cfc85e tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:36.647054 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c93a086f-212d-49a8-93c9-9a54c9cfc85e tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:36.647575 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c93a086f-212d-49a8-93c9-9a54c9cfc85e tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:36.771774 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6f5704a6-b033-430e-8358-721dff8df8e2 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:36.772516 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6f5704a6-b033-430e-8358-721dff8df8e2 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:36.779094 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6f5704a6-b033-430e-8358-721dff8df8e2 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:36.779609 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6f5704a6-b033-430e-8358-721dff8df8e2 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:36.780037 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6f5704a6-b033-430e-8358-721dff8df8e2 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:36.780742 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6f5704a6-b033-430e-8358-721dff8df8e2 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:36.781194 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6f5704a6-b033-430e-8358-721dff8df8e2 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:36.781638 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6f5704a6-b033-430e-8358-721dff8df8e2 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:36.800129 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c93a086f-212d-49a8-93c9-9a54c9cfc85e tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:36.808846 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c93a086f-212d-49a8-93c9-9a54c9cfc85e tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/88b09b16-f667-4ab9-89ca-a26dc86967ae" status: 200 len: 1318 microversion: 2.1 time: 0.178185 Oct 19 03:15:36.809508 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 474/993] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:36 2022] GET /compute/v2.1/servers/88b09b16-f667-4ab9-89ca-a26dc86967ae => generated 1318 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:15:36.854549 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-6f5704a6-b033-430e-8358-721dff8df8e2 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:36.862863 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-6f5704a6-b033-430e-8358-721dff8df8e2 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:36.864447 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-6f5704a6-b033-430e-8358-721dff8df8e2 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:36.872123 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6f5704a6-b033-430e-8358-721dff8df8e2 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1546 microversion: 2.91 time: 0.101857 Oct 19 03:15:36.872123 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 520/994] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:36 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1546 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:15:36.929622 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ed1780db-ff6e-4f54-80dd-82af4adfade5 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:36.930233 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ed1780db-ff6e-4f54-80dd-82af4adfade5 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] [instance: d50976fb-756b-4b12-92f2-cedf87df492d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:36.937963 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ed1780db-ff6e-4f54-80dd-82af4adfade5 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:36.951730 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ed1780db-ff6e-4f54-80dd-82af4adfade5 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:36.951730 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ed1780db-ff6e-4f54-80dd-82af4adfade5 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:36.951730 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ed1780db-ff6e-4f54-80dd-82af4adfade5 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:36.951730 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ed1780db-ff6e-4f54-80dd-82af4adfade5 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:36.952672 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ed1780db-ff6e-4f54-80dd-82af4adfade5 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:37.012622 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-ed1780db-ff6e-4f54-80dd-82af4adfade5 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lazy-loading 'services' on Instance uuid d50976fb-756b-4b12-92f2-cedf87df492d {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:15:37.027674 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2373c97f-24e0-4bfb-9b51-0ba90109b3aa tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:37.033038 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-2373c97f-24e0-4bfb-9b51-0ba90109b3aa tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 62133546-4a75-4532-81ab-0c49c9252e85] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:37.033184 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ed1780db-ff6e-4f54-80dd-82af4adfade5 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d" status: 200 len: 1927 microversion: 2.75 time: 0.104474 Oct 19 03:15:37.033184 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 475/995] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:36 2022] GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d => generated 1927 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:15:37.036771 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2373c97f-24e0-4bfb-9b51-0ba90109b3aa tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:37.037541 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2373c97f-24e0-4bfb-9b51-0ba90109b3aa tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:37.038206 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2373c97f-24e0-4bfb-9b51-0ba90109b3aa tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:37.039169 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2373c97f-24e0-4bfb-9b51-0ba90109b3aa tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:37.039694 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2373c97f-24e0-4bfb-9b51-0ba90109b3aa tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:37.040368 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2373c97f-24e0-4bfb-9b51-0ba90109b3aa tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:37.100911 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-2373c97f-24e0-4bfb-9b51-0ba90109b3aa tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:37.109585 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-2373c97f-24e0-4bfb-9b51-0ba90109b3aa tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:37.111037 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-2373c97f-24e0-4bfb-9b51-0ba90109b3aa tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:37.113544 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2373c97f-24e0-4bfb-9b51-0ba90109b3aa tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85" status: 200 len: 1289 microversion: 2.25 time: 0.089385 Oct 19 03:15:37.113544 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 521/996] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:37 2022] GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85 => generated 1289 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:15:37.396453 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6b2079f6-70d9-4401-be90-498eb77c2cba tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:37.397047 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6b2079f6-70d9-4401-be90-498eb77c2cba tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 9daa020d-efe7-4033-a479-cb5dadbc3ad7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:37.404631 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6b2079f6-70d9-4401-be90-498eb77c2cba tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:37.405100 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6b2079f6-70d9-4401-be90-498eb77c2cba tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:37.405567 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6b2079f6-70d9-4401-be90-498eb77c2cba tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:37.406293 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6b2079f6-70d9-4401-be90-498eb77c2cba tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:37.406742 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6b2079f6-70d9-4401-be90-498eb77c2cba tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:37.407169 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6b2079f6-70d9-4401-be90-498eb77c2cba tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:37.525034 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f2a25fc0-ea1c-4032-9a47-1507c7f8659e tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:37.525795 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f2a25fc0-ea1c-4032-9a47-1507c7f8659e tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] [instance: b18ae860-ed77-4ddc-b9fa-a2aa773c2614] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:37.532713 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f2a25fc0-ea1c-4032-9a47-1507c7f8659e tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:37.533308 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f2a25fc0-ea1c-4032-9a47-1507c7f8659e tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:37.533875 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f2a25fc0-ea1c-4032-9a47-1507c7f8659e tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:37.534675 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f2a25fc0-ea1c-4032-9a47-1507c7f8659e tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:37.535205 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f2a25fc0-ea1c-4032-9a47-1507c7f8659e tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:37.535643 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f2a25fc0-ea1c-4032-9a47-1507c7f8659e tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:37.803282 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f2a25fc0-ea1c-4032-9a47-1507c7f8659e tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c1401b92c44228bd6e80dd3b786ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e388d05eac4f2babf180c0709fdc58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:37.811510 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f2a25fc0-ea1c-4032-9a47-1507c7f8659e tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] 10.222.0.52 "GET /compute/v2.1/servers/b18ae860-ed77-4ddc-b9fa-a2aa773c2614" status: 200 len: 1273 microversion: 2.1 time: 0.290401 Oct 19 03:15:37.812089 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 522/997] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:37 2022] GET /compute/v2.1/servers/b18ae860-ed77-4ddc-b9fa-a2aa773c2614 => generated 1273 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:15:37.824645 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-6b2079f6-70d9-4401-be90-498eb77c2cba tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:37.832318 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-054a5ecc-a3fd-4462-8374-cc02c8c458f3 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:37.832937 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-054a5ecc-a3fd-4462-8374-cc02c8c458f3 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 88b09b16-f667-4ab9-89ca-a26dc86967ae] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:37.833493 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6b2079f6-70d9-4401-be90-498eb77c2cba tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7" status: 200 len: 1378 microversion: 2.1 time: 0.440898 Oct 19 03:15:37.834352 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 476/998] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:37 2022] GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7 => generated 1378 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:15:37.839726 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-054a5ecc-a3fd-4462-8374-cc02c8c458f3 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:37.840214 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-054a5ecc-a3fd-4462-8374-cc02c8c458f3 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:37.840649 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-054a5ecc-a3fd-4462-8374-cc02c8c458f3 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:37.841349 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-054a5ecc-a3fd-4462-8374-cc02c8c458f3 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:37.841827 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-054a5ecc-a3fd-4462-8374-cc02c8c458f3 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:37.842255 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-054a5ecc-a3fd-4462-8374-cc02c8c458f3 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:37.898391 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b436ec56-da9c-4aa2-a927-dd79c5ac5e27 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:37.898991 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b436ec56-da9c-4aa2-a927-dd79c5ac5e27 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:37.905360 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b436ec56-da9c-4aa2-a927-dd79c5ac5e27 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:37.905867 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b436ec56-da9c-4aa2-a927-dd79c5ac5e27 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:37.906301 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b436ec56-da9c-4aa2-a927-dd79c5ac5e27 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:37.906986 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b436ec56-da9c-4aa2-a927-dd79c5ac5e27 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:37.907440 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b436ec56-da9c-4aa2-a927-dd79c5ac5e27 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:37.907861 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b436ec56-da9c-4aa2-a927-dd79c5ac5e27 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:37.988028 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b436ec56-da9c-4aa2-a927-dd79c5ac5e27 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:37.996206 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b436ec56-da9c-4aa2-a927-dd79c5ac5e27 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:37.997662 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b436ec56-da9c-4aa2-a927-dd79c5ac5e27 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:37.999484 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-054a5ecc-a3fd-4462-8374-cc02c8c458f3 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:38.002627 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b436ec56-da9c-4aa2-a927-dd79c5ac5e27 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1546 microversion: 2.91 time: 0.108261 Oct 19 03:15:38.003377 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 477/999] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:37 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1546 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:15:38.009528 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-054a5ecc-a3fd-4462-8374-cc02c8c458f3 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/88b09b16-f667-4ab9-89ca-a26dc86967ae" status: 200 len: 1318 microversion: 2.1 time: 0.180898 Oct 19 03:15:38.010101 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 523/1000] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:37 2022] GET /compute/v2.1/servers/88b09b16-f667-4ab9-89ca-a26dc86967ae => generated 1318 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:15:38.058864 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-315cc25e-7166-434b-a0cd-df09cbb7c55e tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:38.059382 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-315cc25e-7166-434b-a0cd-df09cbb7c55e tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] [instance: d50976fb-756b-4b12-92f2-cedf87df492d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:38.065268 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-315cc25e-7166-434b-a0cd-df09cbb7c55e tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:38.065782 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-315cc25e-7166-434b-a0cd-df09cbb7c55e tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:38.066217 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-315cc25e-7166-434b-a0cd-df09cbb7c55e tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:38.066904 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-315cc25e-7166-434b-a0cd-df09cbb7c55e tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:38.067356 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-315cc25e-7166-434b-a0cd-df09cbb7c55e tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:38.067781 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-315cc25e-7166-434b-a0cd-df09cbb7c55e tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:38.137751 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-88e23065-e70c-4edb-a307-82a9cee67389 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:38.138464 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-88e23065-e70c-4edb-a307-82a9cee67389 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 62133546-4a75-4532-81ab-0c49c9252e85] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:38.139038 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-315cc25e-7166-434b-a0cd-df09cbb7c55e tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lazy-loading 'services' on Instance uuid d50976fb-756b-4b12-92f2-cedf87df492d {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:15:38.144445 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-88e23065-e70c-4edb-a307-82a9cee67389 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:38.144933 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-88e23065-e70c-4edb-a307-82a9cee67389 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:38.145389 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-88e23065-e70c-4edb-a307-82a9cee67389 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:38.146091 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-88e23065-e70c-4edb-a307-82a9cee67389 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:38.146543 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-88e23065-e70c-4edb-a307-82a9cee67389 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:38.146963 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-88e23065-e70c-4edb-a307-82a9cee67389 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:38.156125 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-315cc25e-7166-434b-a0cd-df09cbb7c55e tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d" status: 200 len: 1927 microversion: 2.75 time: 0.101134 Oct 19 03:15:38.156705 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 478/1001] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:38 2022] GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d => generated 1927 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:15:38.210410 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-88e23065-e70c-4edb-a307-82a9cee67389 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:38.219442 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-88e23065-e70c-4edb-a307-82a9cee67389 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:38.220869 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-88e23065-e70c-4edb-a307-82a9cee67389 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:38.222001 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-88e23065-e70c-4edb-a307-82a9cee67389 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85" status: 200 len: 1289 microversion: 2.25 time: 0.088587 Oct 19 03:15:38.222570 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 524/1002] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:38 2022] GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85 => generated 1289 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:15:38.834691 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-438d4d20-1b36-4f37-8fed-9e0f986b80b2 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:38.835296 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-438d4d20-1b36-4f37-8fed-9e0f986b80b2 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] [instance: b18ae860-ed77-4ddc-b9fa-a2aa773c2614] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:38.841697 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-438d4d20-1b36-4f37-8fed-9e0f986b80b2 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:38.842184 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-438d4d20-1b36-4f37-8fed-9e0f986b80b2 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:38.842626 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-438d4d20-1b36-4f37-8fed-9e0f986b80b2 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:38.843710 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-438d4d20-1b36-4f37-8fed-9e0f986b80b2 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:38.844179 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-438d4d20-1b36-4f37-8fed-9e0f986b80b2 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:38.844758 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-438d4d20-1b36-4f37-8fed-9e0f986b80b2 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:38.857615 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-fae18fc0-e1e3-4c8e-8fe9-1353e34e013a tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:38.858350 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-fae18fc0-e1e3-4c8e-8fe9-1353e34e013a tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 9daa020d-efe7-4033-a479-cb5dadbc3ad7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:38.864401 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fae18fc0-e1e3-4c8e-8fe9-1353e34e013a tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:38.864872 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fae18fc0-e1e3-4c8e-8fe9-1353e34e013a tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:38.865311 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fae18fc0-e1e3-4c8e-8fe9-1353e34e013a tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:38.866038 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fae18fc0-e1e3-4c8e-8fe9-1353e34e013a tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:38.866497 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fae18fc0-e1e3-4c8e-8fe9-1353e34e013a tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:38.866925 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fae18fc0-e1e3-4c8e-8fe9-1353e34e013a tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:38.908062 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-438d4d20-1b36-4f37-8fed-9e0f986b80b2 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c1401b92c44228bd6e80dd3b786ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e388d05eac4f2babf180c0709fdc58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:38.916016 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-438d4d20-1b36-4f37-8fed-9e0f986b80b2 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] 10.222.0.52 "GET /compute/v2.1/servers/b18ae860-ed77-4ddc-b9fa-a2aa773c2614" status: 200 len: 1273 microversion: 2.1 time: 0.085543 Oct 19 03:15:38.916594 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 479/1003] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:38 2022] GET /compute/v2.1/servers/b18ae860-ed77-4ddc-b9fa-a2aa773c2614 => generated 1273 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:15:39.005008 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-fae18fc0-e1e3-4c8e-8fe9-1353e34e013a tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:39.013129 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-fae18fc0-e1e3-4c8e-8fe9-1353e34e013a tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7" status: 200 len: 1528 microversion: 2.1 time: 0.159349 Oct 19 03:15:39.013740 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 525/1004] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:38 2022] GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7 => generated 1528 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:15:39.030410 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8aee3e44-e45d-4e95-bb7b-86a7a233ee2a tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:39.031024 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8aee3e44-e45d-4e95-bb7b-86a7a233ee2a tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:39.031555 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ff1c4a72-561a-43ac-9828-f166747899a0 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:39.032228 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ff1c4a72-561a-43ac-9828-f166747899a0 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 88b09b16-f667-4ab9-89ca-a26dc86967ae] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:39.037169 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8aee3e44-e45d-4e95-bb7b-86a7a233ee2a tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:39.037696 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8aee3e44-e45d-4e95-bb7b-86a7a233ee2a tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:39.038119 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ff1c4a72-561a-43ac-9828-f166747899a0 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:39.038235 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8aee3e44-e45d-4e95-bb7b-86a7a233ee2a tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:39.038620 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ff1c4a72-561a-43ac-9828-f166747899a0 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:39.038826 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8aee3e44-e45d-4e95-bb7b-86a7a233ee2a tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:39.039075 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ff1c4a72-561a-43ac-9828-f166747899a0 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:39.039288 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8aee3e44-e45d-4e95-bb7b-86a7a233ee2a tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:39.039719 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8aee3e44-e45d-4e95-bb7b-86a7a233ee2a tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:39.039818 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ff1c4a72-561a-43ac-9828-f166747899a0 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:39.040219 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ff1c4a72-561a-43ac-9828-f166747899a0 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:39.040649 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ff1c4a72-561a-43ac-9828-f166747899a0 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:39.128140 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8aee3e44-e45d-4e95-bb7b-86a7a233ee2a tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:39.136473 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8aee3e44-e45d-4e95-bb7b-86a7a233ee2a tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:39.138363 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8aee3e44-e45d-4e95-bb7b-86a7a233ee2a tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:39.143010 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8aee3e44-e45d-4e95-bb7b-86a7a233ee2a tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1546 microversion: 2.91 time: 0.116813 Oct 19 03:15:39.143812 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 480/1005] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:39 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1546 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:15:39.147946 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ae975c47-7232-4757-b9ad-2cc0478ce7b4 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:39.148556 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ae975c47-7232-4757-b9ad-2cc0478ce7b4 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 9daa020d-efe7-4033-a479-cb5dadbc3ad7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:39.154431 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ae975c47-7232-4757-b9ad-2cc0478ce7b4 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:39.160861 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ae975c47-7232-4757-b9ad-2cc0478ce7b4 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:39.160861 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ae975c47-7232-4757-b9ad-2cc0478ce7b4 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:39.160861 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ae975c47-7232-4757-b9ad-2cc0478ce7b4 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:39.160861 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ae975c47-7232-4757-b9ad-2cc0478ce7b4 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:39.161184 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ae975c47-7232-4757-b9ad-2cc0478ce7b4 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:39.195534 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ff1c4a72-561a-43ac-9828-f166747899a0 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:39.203059 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ff1c4a72-561a-43ac-9828-f166747899a0 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/88b09b16-f667-4ab9-89ca-a26dc86967ae" status: 200 len: 1318 microversion: 2.1 time: 0.175130 Oct 19 03:15:39.203641 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 526/1006] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:39 2022] GET /compute/v2.1/servers/88b09b16-f667-4ab9-89ca-a26dc86967ae => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:15:39.208024 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a10f854c-d012-4976-9418-39b8d32ab1a3 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:39.208628 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a10f854c-d012-4976-9418-39b8d32ab1a3 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] [instance: d50976fb-756b-4b12-92f2-cedf87df492d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:39.215344 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a10f854c-d012-4976-9418-39b8d32ab1a3 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:39.215344 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a10f854c-d012-4976-9418-39b8d32ab1a3 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:39.215642 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a10f854c-d012-4976-9418-39b8d32ab1a3 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:39.216188 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a10f854c-d012-4976-9418-39b8d32ab1a3 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:39.216638 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a10f854c-d012-4976-9418-39b8d32ab1a3 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:39.217066 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a10f854c-d012-4976-9418-39b8d32ab1a3 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:39.301976 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=100 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:15:39.307103 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-a10f854c-d012-4976-9418-39b8d32ab1a3 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lazy-loading 'services' on Instance uuid d50976fb-756b-4b12-92f2-cedf87df492d {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:15:39.323867 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a10f854c-d012-4976-9418-39b8d32ab1a3 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d" status: 200 len: 1927 microversion: 2.75 time: 0.119192 Oct 19 03:15:39.324456 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 527/1007] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:39 2022] GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d => generated 1927 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:15:39.329062 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-17aa3323-a7fe-4a61-9071-d4d2f8b20959 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:39.329709 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-17aa3323-a7fe-4a61-9071-d4d2f8b20959 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 62133546-4a75-4532-81ab-0c49c9252e85] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:39.341824 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-17aa3323-a7fe-4a61-9071-d4d2f8b20959 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:39.342411 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-17aa3323-a7fe-4a61-9071-d4d2f8b20959 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:39.342925 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-17aa3323-a7fe-4a61-9071-d4d2f8b20959 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:39.343708 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-17aa3323-a7fe-4a61-9071-d4d2f8b20959 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:39.344265 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-17aa3323-a7fe-4a61-9071-d4d2f8b20959 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:39.344703 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-17aa3323-a7fe-4a61-9071-d4d2f8b20959 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:39.356755 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ae975c47-7232-4757-b9ad-2cc0478ce7b4 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:39.364432 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ae975c47-7232-4757-b9ad-2cc0478ce7b4 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7" status: 200 len: 1528 microversion: 2.1 time: 0.219900 Oct 19 03:15:39.365006 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 481/1008] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:39 2022] GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7 => generated 1528 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:15:39.385855 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1acd172f-85ae-42c6-9558-d490a3e88760 tempest-MigrationsAdminTest-1230104219 tempest-MigrationsAdminTest-1230104219-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:39.407192 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-17aa3323-a7fe-4a61-9071-d4d2f8b20959 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:39.415434 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-17aa3323-a7fe-4a61-9071-d4d2f8b20959 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:39.416900 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-17aa3323-a7fe-4a61-9071-d4d2f8b20959 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:39.418684 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-17aa3323-a7fe-4a61-9071-d4d2f8b20959 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85" status: 200 len: 1289 microversion: 2.25 time: 0.093297 Oct 19 03:15:39.419249 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 528/1009] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:39 2022] GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85 => generated 1289 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:15:39.460495 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1acd172f-85ae-42c6-9558-d490a3e88760 tempest-MigrationsAdminTest-1230104219 tempest-MigrationsAdminTest-1230104219-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/ecf81ec0-4740-4050-9a00-ee71c25338fa" status: 202 len: 0 microversion: 2.1 time: 0.078283 Oct 19 03:15:39.461094 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 482/1010] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:15:39 2022] DELETE /compute/v2.1/flavors/ecf81ec0-4740-4050-9a00-ee71c25338fa => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 19 03:15:39.469634 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5a1f58a0-1f34-41e1-801b-494be6d104ab tempest-MigrationsAdminTest-1230104219 tempest-MigrationsAdminTest-1230104219-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:39.491049 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5a1f58a0-1f34-41e1-801b-494be6d104ab tempest-MigrationsAdminTest-1230104219 tempest-MigrationsAdminTest-1230104219-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.025301 Oct 19 03:15:39.491892 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 529/1011] 10.222.0.52 () {58 vars in 1146 bytes} [Wed Oct 19 03:15:39 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:15:39.510506 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8e94c771-20cf-4d83-a0c3-06511f41c50d tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:15:39.513171 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8e94c771-20cf-4d83-a0c3-06511f41c50d tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 9daa020d-efe7-4033-a479-cb5dadbc3ad7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:39.519154 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8e94c771-20cf-4d83-a0c3-06511f41c50d tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:39.519635 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8e94c771-20cf-4d83-a0c3-06511f41c50d tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:39.520069 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8e94c771-20cf-4d83-a0c3-06511f41c50d tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:39.520750 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8e94c771-20cf-4d83-a0c3-06511f41c50d tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:39.521200 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8e94c771-20cf-4d83-a0c3-06511f41c50d tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:39.521644 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8e94c771-20cf-4d83-a0c3-06511f41c50d tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:39.607550 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8e94c771-20cf-4d83-a0c3-06511f41c50d tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:39.613236 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8e94c771-20cf-4d83-a0c3-06511f41c50d tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 9daa020d-efe7-4033-a479-cb5dadbc3ad7] Old instance type tempest-test_resize_flavor_-2123663760, new instance type m1.heat {{(pid=121134) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 19 03:15:39.619572 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-8e94c771-20cf-4d83-a0c3-06511f41c50d tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Flavor limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:15:39.620011 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-8e94c771-20cf-4d83-a0c3-06511f41c50d tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Image limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:15:39.620483 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-8e94c771-20cf-4d83-a0c3-06511f41c50d tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Flavor pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:15:39.620887 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-8e94c771-20cf-4d83-a0c3-06511f41c50d tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Image pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:15:39.621290 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-8e94c771-20cf-4d83-a0c3-06511f41c50d tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:15:39.812732 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8e94c771-20cf-4d83-a0c3-06511f41c50d tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "POST /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7/action" status: 202 len: 0 microversion: 2.1 time: 0.306008 Oct 19 03:15:39.813340 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 483/1012] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:15:39 2022] POST /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7/action => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:15:39.821640 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-27bb288b-fb91-487c-90ba-eb15a93bcc4d tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:39.822303 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-27bb288b-fb91-487c-90ba-eb15a93bcc4d tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 9daa020d-efe7-4033-a479-cb5dadbc3ad7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:39.828637 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-27bb288b-fb91-487c-90ba-eb15a93bcc4d tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:39.829134 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-27bb288b-fb91-487c-90ba-eb15a93bcc4d tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:39.829614 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-27bb288b-fb91-487c-90ba-eb15a93bcc4d tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:39.830341 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-27bb288b-fb91-487c-90ba-eb15a93bcc4d tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:39.830858 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-27bb288b-fb91-487c-90ba-eb15a93bcc4d tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:39.831234 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-27bb288b-fb91-487c-90ba-eb15a93bcc4d tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:39.940684 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-358ee5eb-7901-473d-8666-7f01f0842c4f tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:39.941294 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-358ee5eb-7901-473d-8666-7f01f0842c4f tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] [instance: b18ae860-ed77-4ddc-b9fa-a2aa773c2614] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:39.947675 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-358ee5eb-7901-473d-8666-7f01f0842c4f tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:39.953650 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-358ee5eb-7901-473d-8666-7f01f0842c4f tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:39.953650 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-358ee5eb-7901-473d-8666-7f01f0842c4f tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:39.953650 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-358ee5eb-7901-473d-8666-7f01f0842c4f tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:39.953650 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-358ee5eb-7901-473d-8666-7f01f0842c4f tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:39.953987 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-358ee5eb-7901-473d-8666-7f01f0842c4f tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:39.963879 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-27bb288b-fb91-487c-90ba-eb15a93bcc4d tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:39.972500 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-27bb288b-fb91-487c-90ba-eb15a93bcc4d tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7" status: 200 len: 1537 microversion: 2.1 time: 0.154902 Oct 19 03:15:39.985524 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 530/1013] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:39 2022] GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7 => generated 1537 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:15:40.038588 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-358ee5eb-7901-473d-8666-7f01f0842c4f tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c1401b92c44228bd6e80dd3b786ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e388d05eac4f2babf180c0709fdc58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:40.046466 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-358ee5eb-7901-473d-8666-7f01f0842c4f tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] 10.222.0.52 "GET /compute/v2.1/servers/b18ae860-ed77-4ddc-b9fa-a2aa773c2614" status: 200 len: 1273 microversion: 2.1 time: 0.111370 Oct 19 03:15:40.047229 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 484/1014] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:39 2022] GET /compute/v2.1/servers/b18ae860-ed77-4ddc-b9fa-a2aa773c2614 => generated 1273 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:15:40.170861 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f12e9118-b5ba-4b1d-af33-1f69bcb5d4d8 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:40.171609 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f12e9118-b5ba-4b1d-af33-1f69bcb5d4d8 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:40.177655 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f12e9118-b5ba-4b1d-af33-1f69bcb5d4d8 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:40.178146 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f12e9118-b5ba-4b1d-af33-1f69bcb5d4d8 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:40.178587 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f12e9118-b5ba-4b1d-af33-1f69bcb5d4d8 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:40.179287 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f12e9118-b5ba-4b1d-af33-1f69bcb5d4d8 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:40.179740 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f12e9118-b5ba-4b1d-af33-1f69bcb5d4d8 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:40.180196 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f12e9118-b5ba-4b1d-af33-1f69bcb5d4d8 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:40.226669 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8bad7e22-25ec-4411-ae67-c30fbfdbaea7 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:40.227293 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8bad7e22-25ec-4411-ae67-c30fbfdbaea7 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 88b09b16-f667-4ab9-89ca-a26dc86967ae] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:40.234975 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8bad7e22-25ec-4411-ae67-c30fbfdbaea7 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:40.235688 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8bad7e22-25ec-4411-ae67-c30fbfdbaea7 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:40.236135 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8bad7e22-25ec-4411-ae67-c30fbfdbaea7 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:40.236840 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8bad7e22-25ec-4411-ae67-c30fbfdbaea7 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:40.237299 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8bad7e22-25ec-4411-ae67-c30fbfdbaea7 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:40.237752 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8bad7e22-25ec-4411-ae67-c30fbfdbaea7 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:40.252450 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f12e9118-b5ba-4b1d-af33-1f69bcb5d4d8 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:40.266569 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f12e9118-b5ba-4b1d-af33-1f69bcb5d4d8 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:40.268327 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f12e9118-b5ba-4b1d-af33-1f69bcb5d4d8 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:40.274158 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f12e9118-b5ba-4b1d-af33-1f69bcb5d4d8 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1546 microversion: 2.91 time: 0.107144 Oct 19 03:15:40.274750 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 531/1015] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:40 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1546 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:15:40.351841 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7f3368c1-6d4c-4715-9aec-7113f648e5b1 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:40.352469 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7f3368c1-6d4c-4715-9aec-7113f648e5b1 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] [instance: d50976fb-756b-4b12-92f2-cedf87df492d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:40.358561 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7f3368c1-6d4c-4715-9aec-7113f648e5b1 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:40.359061 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7f3368c1-6d4c-4715-9aec-7113f648e5b1 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:40.359491 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7f3368c1-6d4c-4715-9aec-7113f648e5b1 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:40.360188 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7f3368c1-6d4c-4715-9aec-7113f648e5b1 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:40.361324 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7f3368c1-6d4c-4715-9aec-7113f648e5b1 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:40.361324 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7f3368c1-6d4c-4715-9aec-7113f648e5b1 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:40.371905 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8bad7e22-25ec-4411-ae67-c30fbfdbaea7 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:40.379633 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8bad7e22-25ec-4411-ae67-c30fbfdbaea7 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/88b09b16-f667-4ab9-89ca-a26dc86967ae" status: 200 len: 1318 microversion: 2.1 time: 0.156929 Oct 19 03:15:40.380215 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 485/1016] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:40 2022] GET /compute/v2.1/servers/88b09b16-f667-4ab9-89ca-a26dc86967ae => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:15:40.438826 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-7f3368c1-6d4c-4715-9aec-7113f648e5b1 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lazy-loading 'services' on Instance uuid d50976fb-756b-4b12-92f2-cedf87df492d {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:15:40.443150 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-cad6d27b-0fd0-4cc3-97eb-5a9debdfde14 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:40.443759 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-cad6d27b-0fd0-4cc3-97eb-5a9debdfde14 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 62133546-4a75-4532-81ab-0c49c9252e85] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:40.449782 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cad6d27b-0fd0-4cc3-97eb-5a9debdfde14 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:40.450211 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cad6d27b-0fd0-4cc3-97eb-5a9debdfde14 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:40.450648 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cad6d27b-0fd0-4cc3-97eb-5a9debdfde14 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:40.451391 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cad6d27b-0fd0-4cc3-97eb-5a9debdfde14 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:40.451905 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cad6d27b-0fd0-4cc3-97eb-5a9debdfde14 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:40.452334 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cad6d27b-0fd0-4cc3-97eb-5a9debdfde14 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:40.452687 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:15:40.456566 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7f3368c1-6d4c-4715-9aec-7113f648e5b1 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d" status: 200 len: 1927 microversion: 2.75 time: 0.109052 Oct 19 03:15:40.457339 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 532/1017] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:40 2022] GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d => generated 1927 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:15:40.519679 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-cad6d27b-0fd0-4cc3-97eb-5a9debdfde14 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:40.527852 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-cad6d27b-0fd0-4cc3-97eb-5a9debdfde14 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:40.529321 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-cad6d27b-0fd0-4cc3-97eb-5a9debdfde14 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:40.530440 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-cad6d27b-0fd0-4cc3-97eb-5a9debdfde14 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85" status: 200 len: 1289 microversion: 2.25 time: 0.091277 Oct 19 03:15:40.531277 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 486/1018] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:40 2022] GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85 => generated 1289 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:15:40.995999 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5083c8e9-0ab3-46b6-9ffd-7fe922dd3007 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:40.996625 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-5083c8e9-0ab3-46b6-9ffd-7fe922dd3007 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 9daa020d-efe7-4033-a479-cb5dadbc3ad7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:41.003340 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5083c8e9-0ab3-46b6-9ffd-7fe922dd3007 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:41.003846 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5083c8e9-0ab3-46b6-9ffd-7fe922dd3007 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:41.004286 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5083c8e9-0ab3-46b6-9ffd-7fe922dd3007 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:41.004986 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5083c8e9-0ab3-46b6-9ffd-7fe922dd3007 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:41.005477 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5083c8e9-0ab3-46b6-9ffd-7fe922dd3007 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:41.005913 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5083c8e9-0ab3-46b6-9ffd-7fe922dd3007 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:41.069580 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-876004c3-6aff-49b0-8d2d-406918900056 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:41.070178 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-876004c3-6aff-49b0-8d2d-406918900056 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] [instance: b18ae860-ed77-4ddc-b9fa-a2aa773c2614] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:41.077066 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-876004c3-6aff-49b0-8d2d-406918900056 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:41.077599 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-876004c3-6aff-49b0-8d2d-406918900056 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:41.078042 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-876004c3-6aff-49b0-8d2d-406918900056 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:41.078745 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-876004c3-6aff-49b0-8d2d-406918900056 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:41.079207 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-876004c3-6aff-49b0-8d2d-406918900056 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:41.079635 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-876004c3-6aff-49b0-8d2d-406918900056 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:41.095107 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:15:41.150598 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-876004c3-6aff-49b0-8d2d-406918900056 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c1401b92c44228bd6e80dd3b786ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e388d05eac4f2babf180c0709fdc58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:41.158544 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-876004c3-6aff-49b0-8d2d-406918900056 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] 10.222.0.52 "GET /compute/v2.1/servers/b18ae860-ed77-4ddc-b9fa-a2aa773c2614" status: 200 len: 1273 microversion: 2.1 time: 0.092831 Oct 19 03:15:41.159118 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 487/1019] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:41 2022] GET /compute/v2.1/servers/b18ae860-ed77-4ddc-b9fa-a2aa773c2614 => generated 1273 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:15:41.162333 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-5083c8e9-0ab3-46b6-9ffd-7fe922dd3007 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:41.170759 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5083c8e9-0ab3-46b6-9ffd-7fe922dd3007 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7" status: 200 len: 1537 microversion: 2.1 time: 0.178702 Oct 19 03:15:41.171328 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 533/1020] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:40 2022] GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7 => generated 1537 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:15:41.302293 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a824ddf0-76dd-4f3d-95a1-9f8e4f54d26f tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:41.302822 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a824ddf0-76dd-4f3d-95a1-9f8e4f54d26f tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:41.309981 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a824ddf0-76dd-4f3d-95a1-9f8e4f54d26f tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:41.310456 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a824ddf0-76dd-4f3d-95a1-9f8e4f54d26f tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:41.310904 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a824ddf0-76dd-4f3d-95a1-9f8e4f54d26f tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:41.311597 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a824ddf0-76dd-4f3d-95a1-9f8e4f54d26f tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:41.312060 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a824ddf0-76dd-4f3d-95a1-9f8e4f54d26f tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:41.312491 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a824ddf0-76dd-4f3d-95a1-9f8e4f54d26f tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:41.379357 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a824ddf0-76dd-4f3d-95a1-9f8e4f54d26f tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:41.388270 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a824ddf0-76dd-4f3d-95a1-9f8e4f54d26f tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:41.389732 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a824ddf0-76dd-4f3d-95a1-9f8e4f54d26f tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:41.395067 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a824ddf0-76dd-4f3d-95a1-9f8e4f54d26f tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1546 microversion: 2.91 time: 0.097072 Oct 19 03:15:41.395650 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 488/1021] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:41 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1546 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:15:41.403691 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5ab532bc-8efc-4f7a-94b2-232d39a31d7b tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:41.404306 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-5ab532bc-8efc-4f7a-94b2-232d39a31d7b tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 88b09b16-f667-4ab9-89ca-a26dc86967ae] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:41.410520 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5ab532bc-8efc-4f7a-94b2-232d39a31d7b tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:41.411006 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5ab532bc-8efc-4f7a-94b2-232d39a31d7b tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:41.411438 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5ab532bc-8efc-4f7a-94b2-232d39a31d7b tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:41.412131 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5ab532bc-8efc-4f7a-94b2-232d39a31d7b tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:41.412583 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5ab532bc-8efc-4f7a-94b2-232d39a31d7b tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:41.413004 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5ab532bc-8efc-4f7a-94b2-232d39a31d7b tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:41.486245 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b04df366-86ed-4c1d-b57d-a602d220c2f1 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:41.486861 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b04df366-86ed-4c1d-b57d-a602d220c2f1 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] [instance: d50976fb-756b-4b12-92f2-cedf87df492d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:41.499784 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b04df366-86ed-4c1d-b57d-a602d220c2f1 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:41.500280 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b04df366-86ed-4c1d-b57d-a602d220c2f1 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:41.500725 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b04df366-86ed-4c1d-b57d-a602d220c2f1 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:41.501681 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b04df366-86ed-4c1d-b57d-a602d220c2f1 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:41.502145 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b04df366-86ed-4c1d-b57d-a602d220c2f1 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:41.502576 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b04df366-86ed-4c1d-b57d-a602d220c2f1 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:41.558420 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-5ab532bc-8efc-4f7a-94b2-232d39a31d7b tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:41.571461 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5ab532bc-8efc-4f7a-94b2-232d39a31d7b tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/88b09b16-f667-4ab9-89ca-a26dc86967ae" status: 200 len: 1318 microversion: 2.1 time: 0.171432 Oct 19 03:15:41.572165 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 534/1022] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:41 2022] GET /compute/v2.1/servers/88b09b16-f667-4ab9-89ca-a26dc86967ae => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:15:41.578416 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2be59056-dd06-4507-a5ff-17c3747bad65 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:41.579337 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-2be59056-dd06-4507-a5ff-17c3747bad65 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 62133546-4a75-4532-81ab-0c49c9252e85] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:41.584369 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-b04df366-86ed-4c1d-b57d-a602d220c2f1 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lazy-loading 'services' on Instance uuid d50976fb-756b-4b12-92f2-cedf87df492d {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:15:41.586251 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2be59056-dd06-4507-a5ff-17c3747bad65 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:41.587020 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2be59056-dd06-4507-a5ff-17c3747bad65 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:41.587649 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2be59056-dd06-4507-a5ff-17c3747bad65 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:41.588635 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2be59056-dd06-4507-a5ff-17c3747bad65 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:41.589246 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2be59056-dd06-4507-a5ff-17c3747bad65 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:41.589862 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2be59056-dd06-4507-a5ff-17c3747bad65 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:41.602567 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b04df366-86ed-4c1d-b57d-a602d220c2f1 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d" status: 200 len: 1927 microversion: 2.75 time: 0.120031 Oct 19 03:15:41.603156 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 489/1023] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:41 2022] GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d => generated 1927 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:15:41.657051 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-2be59056-dd06-4507-a5ff-17c3747bad65 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:41.667583 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-2be59056-dd06-4507-a5ff-17c3747bad65 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:41.669497 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-2be59056-dd06-4507-a5ff-17c3747bad65 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:41.670862 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2be59056-dd06-4507-a5ff-17c3747bad65 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85" status: 200 len: 1289 microversion: 2.25 time: 0.097592 Oct 19 03:15:41.671565 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 535/1024] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:41 2022] GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85 => generated 1289 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:15:42.181100 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ab191642-ef19-4a30-952f-f8e707bd7277 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:42.181737 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ab191642-ef19-4a30-952f-f8e707bd7277 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] [instance: b18ae860-ed77-4ddc-b9fa-a2aa773c2614] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:42.189777 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ab191642-ef19-4a30-952f-f8e707bd7277 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:42.190380 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ab191642-ef19-4a30-952f-f8e707bd7277 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:42.190824 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ab191642-ef19-4a30-952f-f8e707bd7277 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:42.191518 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ab191642-ef19-4a30-952f-f8e707bd7277 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:42.191973 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ab191642-ef19-4a30-952f-f8e707bd7277 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:42.192398 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ab191642-ef19-4a30-952f-f8e707bd7277 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:42.193535 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0d9dd827-fb0c-404b-90ae-f52975c162e0 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:42.194155 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0d9dd827-fb0c-404b-90ae-f52975c162e0 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 9daa020d-efe7-4033-a479-cb5dadbc3ad7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:42.200269 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0d9dd827-fb0c-404b-90ae-f52975c162e0 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:42.200957 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0d9dd827-fb0c-404b-90ae-f52975c162e0 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:42.201430 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0d9dd827-fb0c-404b-90ae-f52975c162e0 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:42.202132 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0d9dd827-fb0c-404b-90ae-f52975c162e0 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:42.202593 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0d9dd827-fb0c-404b-90ae-f52975c162e0 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:42.203024 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0d9dd827-fb0c-404b-90ae-f52975c162e0 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:42.267748 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ab191642-ef19-4a30-952f-f8e707bd7277 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c1401b92c44228bd6e80dd3b786ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e388d05eac4f2babf180c0709fdc58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:42.275537 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ab191642-ef19-4a30-952f-f8e707bd7277 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] 10.222.0.52 "GET /compute/v2.1/servers/b18ae860-ed77-4ddc-b9fa-a2aa773c2614" status: 200 len: 1273 microversion: 2.1 time: 0.098393 Oct 19 03:15:42.276115 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 490/1025] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:42 2022] GET /compute/v2.1/servers/b18ae860-ed77-4ddc-b9fa-a2aa773c2614 => generated 1273 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:15:42.350507 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-0d9dd827-fb0c-404b-90ae-f52975c162e0 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:42.358805 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0d9dd827-fb0c-404b-90ae-f52975c162e0 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7" status: 200 len: 1537 microversion: 2.1 time: 0.169203 Oct 19 03:15:42.359374 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 536/1026] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:42 2022] GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7 => generated 1537 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:15:42.423338 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0ee207d5-3e23-469c-9369-f14fa7d72ebb tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:42.423948 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0ee207d5-3e23-469c-9369-f14fa7d72ebb tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:42.429968 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0ee207d5-3e23-469c-9369-f14fa7d72ebb tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:42.430455 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0ee207d5-3e23-469c-9369-f14fa7d72ebb tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:42.430900 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0ee207d5-3e23-469c-9369-f14fa7d72ebb tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:42.431646 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0ee207d5-3e23-469c-9369-f14fa7d72ebb tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:42.432053 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0ee207d5-3e23-469c-9369-f14fa7d72ebb tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:42.432561 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0ee207d5-3e23-469c-9369-f14fa7d72ebb tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:42.495801 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0ee207d5-3e23-469c-9369-f14fa7d72ebb tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:42.503897 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0ee207d5-3e23-469c-9369-f14fa7d72ebb tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:42.505341 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0ee207d5-3e23-469c-9369-f14fa7d72ebb tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:42.510217 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0ee207d5-3e23-469c-9369-f14fa7d72ebb tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1546 microversion: 2.91 time: 0.090868 Oct 19 03:15:42.510793 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 491/1027] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:42 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1546 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:15:42.595681 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e1b6bb5c-f0e2-4c39-a822-e10f2f1e4d38 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:42.596301 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e1b6bb5c-f0e2-4c39-a822-e10f2f1e4d38 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 88b09b16-f667-4ab9-89ca-a26dc86967ae] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:42.602297 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e1b6bb5c-f0e2-4c39-a822-e10f2f1e4d38 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:42.602780 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e1b6bb5c-f0e2-4c39-a822-e10f2f1e4d38 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:42.603216 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e1b6bb5c-f0e2-4c39-a822-e10f2f1e4d38 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:42.603890 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e1b6bb5c-f0e2-4c39-a822-e10f2f1e4d38 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:42.604349 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e1b6bb5c-f0e2-4c39-a822-e10f2f1e4d38 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:42.605395 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e1b6bb5c-f0e2-4c39-a822-e10f2f1e4d38 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:42.630694 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-af8022d5-8e3d-44ff-9116-034855cef44c tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:42.631394 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-af8022d5-8e3d-44ff-9116-034855cef44c tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] [instance: d50976fb-756b-4b12-92f2-cedf87df492d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:42.638122 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-af8022d5-8e3d-44ff-9116-034855cef44c tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:42.638684 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-af8022d5-8e3d-44ff-9116-034855cef44c tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:42.639182 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-af8022d5-8e3d-44ff-9116-034855cef44c tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:42.639955 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-af8022d5-8e3d-44ff-9116-034855cef44c tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:42.640478 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-af8022d5-8e3d-44ff-9116-034855cef44c tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:42.640969 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-af8022d5-8e3d-44ff-9116-034855cef44c tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:42.723803 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-af8022d5-8e3d-44ff-9116-034855cef44c tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lazy-loading 'services' on Instance uuid d50976fb-756b-4b12-92f2-cedf87df492d {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:15:42.740004 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-af8022d5-8e3d-44ff-9116-034855cef44c tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d" status: 200 len: 1927 microversion: 2.75 time: 0.113005 Oct 19 03:15:42.740586 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 492/1028] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:42 2022] GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d => generated 1927 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:15:42.757172 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-74b2596b-260f-40eb-acac-9a3031d42dbf tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:42.757802 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-74b2596b-260f-40eb-acac-9a3031d42dbf tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 62133546-4a75-4532-81ab-0c49c9252e85] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:42.758016 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-e1b6bb5c-f0e2-4c39-a822-e10f2f1e4d38 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:42.764415 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-74b2596b-260f-40eb-acac-9a3031d42dbf tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:42.764896 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-74b2596b-260f-40eb-acac-9a3031d42dbf tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:42.765330 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-74b2596b-260f-40eb-acac-9a3031d42dbf tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:42.766044 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-74b2596b-260f-40eb-acac-9a3031d42dbf tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:42.766493 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-74b2596b-260f-40eb-acac-9a3031d42dbf tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:42.766911 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e1b6bb5c-f0e2-4c39-a822-e10f2f1e4d38 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/88b09b16-f667-4ab9-89ca-a26dc86967ae" status: 200 len: 1318 microversion: 2.1 time: 0.175073 Oct 19 03:15:42.767030 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-74b2596b-260f-40eb-acac-9a3031d42dbf tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:42.767488 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 537/1029] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:42 2022] GET /compute/v2.1/servers/88b09b16-f667-4ab9-89ca-a26dc86967ae => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:15:42.831291 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-74b2596b-260f-40eb-acac-9a3031d42dbf tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:42.839612 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-74b2596b-260f-40eb-acac-9a3031d42dbf tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:42.841030 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-74b2596b-260f-40eb-acac-9a3031d42dbf tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:42.842217 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-74b2596b-260f-40eb-acac-9a3031d42dbf tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85" status: 200 len: 1289 microversion: 2.25 time: 0.100731 Oct 19 03:15:42.842797 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 493/1030] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:42 2022] GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85 => generated 1289 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:15:43.299811 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f7086da1-79de-416a-8c30-b88d5772c056 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:43.300806 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f7086da1-79de-416a-8c30-b88d5772c056 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] [instance: b18ae860-ed77-4ddc-b9fa-a2aa773c2614] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:43.306819 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f7086da1-79de-416a-8c30-b88d5772c056 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:43.307311 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f7086da1-79de-416a-8c30-b88d5772c056 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:43.307751 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f7086da1-79de-416a-8c30-b88d5772c056 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:43.308447 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f7086da1-79de-416a-8c30-b88d5772c056 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:43.308902 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f7086da1-79de-416a-8c30-b88d5772c056 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:43.309328 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f7086da1-79de-416a-8c30-b88d5772c056 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:43.381846 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3de730ec-5e74-490f-95bc-dfca1c370d53 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:43.382444 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3de730ec-5e74-490f-95bc-dfca1c370d53 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 9daa020d-efe7-4033-a479-cb5dadbc3ad7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:43.383369 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f7086da1-79de-416a-8c30-b88d5772c056 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c1401b92c44228bd6e80dd3b786ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e388d05eac4f2babf180c0709fdc58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:43.389229 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=3 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:15:43.391040 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3de730ec-5e74-490f-95bc-dfca1c370d53 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:43.391933 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3de730ec-5e74-490f-95bc-dfca1c370d53 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:43.392159 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3de730ec-5e74-490f-95bc-dfca1c370d53 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:43.393538 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3de730ec-5e74-490f-95bc-dfca1c370d53 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:43.394043 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3de730ec-5e74-490f-95bc-dfca1c370d53 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:43.394535 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3de730ec-5e74-490f-95bc-dfca1c370d53 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:43.399482 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f7086da1-79de-416a-8c30-b88d5772c056 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] 10.222.0.52 "GET /compute/v2.1/servers/b18ae860-ed77-4ddc-b9fa-a2aa773c2614" status: 200 len: 1273 microversion: 2.1 time: 0.103962 Oct 19 03:15:43.402013 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 538/1031] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:43 2022] GET /compute/v2.1/servers/b18ae860-ed77-4ddc-b9fa-a2aa773c2614 => generated 1273 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:15:43.542649 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-43ca4e8b-e271-4447-932b-5b2eb683b926 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:43.542649 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-43ca4e8b-e271-4447-932b-5b2eb683b926 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:43.549093 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-3de730ec-5e74-490f-95bc-dfca1c370d53 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:43.550111 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-43ca4e8b-e271-4447-932b-5b2eb683b926 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:43.550828 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-43ca4e8b-e271-4447-932b-5b2eb683b926 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:43.551279 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-43ca4e8b-e271-4447-932b-5b2eb683b926 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:43.551993 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-43ca4e8b-e271-4447-932b-5b2eb683b926 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:43.552452 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-43ca4e8b-e271-4447-932b-5b2eb683b926 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:43.552881 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-43ca4e8b-e271-4447-932b-5b2eb683b926 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:43.558303 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3de730ec-5e74-490f-95bc-dfca1c370d53 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7" status: 200 len: 1537 microversion: 2.1 time: 0.179977 Oct 19 03:15:43.558965 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 494/1032] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:43 2022] GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7 => generated 1537 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:15:43.618961 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-43ca4e8b-e271-4447-932b-5b2eb683b926 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:43.628635 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-43ca4e8b-e271-4447-932b-5b2eb683b926 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:43.629945 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-43ca4e8b-e271-4447-932b-5b2eb683b926 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:43.640437 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-43ca4e8b-e271-4447-932b-5b2eb683b926 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1546 microversion: 2.91 time: 0.104605 Oct 19 03:15:43.641033 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 539/1033] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:43 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1546 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:15:43.767693 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1916e9c6-a469-4518-8677-25fd19d02e20 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:43.768332 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1916e9c6-a469-4518-8677-25fd19d02e20 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] [instance: d50976fb-756b-4b12-92f2-cedf87df492d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:43.775684 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1916e9c6-a469-4518-8677-25fd19d02e20 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:43.778667 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1916e9c6-a469-4518-8677-25fd19d02e20 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:43.778667 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1916e9c6-a469-4518-8677-25fd19d02e20 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:43.778667 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1916e9c6-a469-4518-8677-25fd19d02e20 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:43.778667 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1916e9c6-a469-4518-8677-25fd19d02e20 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:43.779032 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1916e9c6-a469-4518-8677-25fd19d02e20 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:43.846269 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f176848d-d8e9-4248-8e1f-17dd25d637d0 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:43.846899 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f176848d-d8e9-4248-8e1f-17dd25d637d0 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 88b09b16-f667-4ab9-89ca-a26dc86967ae] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:43.851151 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-1916e9c6-a469-4518-8677-25fd19d02e20 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lazy-loading 'services' on Instance uuid d50976fb-756b-4b12-92f2-cedf87df492d {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:15:43.853232 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f176848d-d8e9-4248-8e1f-17dd25d637d0 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:43.853449 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f176848d-d8e9-4248-8e1f-17dd25d637d0 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:43.853901 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f176848d-d8e9-4248-8e1f-17dd25d637d0 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:43.855176 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f176848d-d8e9-4248-8e1f-17dd25d637d0 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:43.855636 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f176848d-d8e9-4248-8e1f-17dd25d637d0 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:43.856066 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f176848d-d8e9-4248-8e1f-17dd25d637d0 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:43.869134 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1916e9c6-a469-4518-8677-25fd19d02e20 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d" status: 200 len: 1933 microversion: 2.75 time: 0.105429 Oct 19 03:15:43.869953 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 495/1034] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:43 2022] GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d => generated 1933 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:15:43.874761 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-fd20a3b2-cd24-4c8f-9952-b005a46a912b tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:43.876303 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-fd20a3b2-cd24-4c8f-9952-b005a46a912b tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 62133546-4a75-4532-81ab-0c49c9252e85] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:43.880572 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fd20a3b2-cd24-4c8f-9952-b005a46a912b tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:43.881097 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fd20a3b2-cd24-4c8f-9952-b005a46a912b tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:43.881580 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fd20a3b2-cd24-4c8f-9952-b005a46a912b tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:43.882283 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fd20a3b2-cd24-4c8f-9952-b005a46a912b tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:43.882743 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fd20a3b2-cd24-4c8f-9952-b005a46a912b tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:43.883173 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fd20a3b2-cd24-4c8f-9952-b005a46a912b tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:43.957133 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-fd20a3b2-cd24-4c8f-9952-b005a46a912b tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:43.967163 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-fd20a3b2-cd24-4c8f-9952-b005a46a912b tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:43.968679 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-fd20a3b2-cd24-4c8f-9952-b005a46a912b tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:43.969818 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-fd20a3b2-cd24-4c8f-9952-b005a46a912b tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85" status: 200 len: 1281 microversion: 2.25 time: 0.098986 Oct 19 03:15:43.970383 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 496/1035] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:43 2022] GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85 => generated 1281 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:15:44.013591 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f176848d-d8e9-4248-8e1f-17dd25d637d0 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:44.021256 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f176848d-d8e9-4248-8e1f-17dd25d637d0 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/88b09b16-f667-4ab9-89ca-a26dc86967ae" status: 200 len: 1318 microversion: 2.1 time: 0.178818 Oct 19 03:15:44.021860 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 540/1036] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:43 2022] GET /compute/v2.1/servers/88b09b16-f667-4ab9-89ca-a26dc86967ae => generated 1318 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:15:44.427328 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1219c6d7-daf9-4ba7-b6a6-6f02d8d41f68 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:44.427888 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1219c6d7-daf9-4ba7-b6a6-6f02d8d41f68 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] [instance: b18ae860-ed77-4ddc-b9fa-a2aa773c2614] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:44.438972 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1219c6d7-daf9-4ba7-b6a6-6f02d8d41f68 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:44.439492 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1219c6d7-daf9-4ba7-b6a6-6f02d8d41f68 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:44.439909 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1219c6d7-daf9-4ba7-b6a6-6f02d8d41f68 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:44.440650 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1219c6d7-daf9-4ba7-b6a6-6f02d8d41f68 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:44.441115 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1219c6d7-daf9-4ba7-b6a6-6f02d8d41f68 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:44.441581 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1219c6d7-daf9-4ba7-b6a6-6f02d8d41f68 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:44.504481 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-1219c6d7-daf9-4ba7-b6a6-6f02d8d41f68 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c1401b92c44228bd6e80dd3b786ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e388d05eac4f2babf180c0709fdc58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:44.512566 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1219c6d7-daf9-4ba7-b6a6-6f02d8d41f68 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] 10.222.0.52 "GET /compute/v2.1/servers/b18ae860-ed77-4ddc-b9fa-a2aa773c2614" status: 200 len: 1265 microversion: 2.1 time: 0.089248 Oct 19 03:15:44.513139 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 497/1037] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:44 2022] GET /compute/v2.1/servers/b18ae860-ed77-4ddc-b9fa-a2aa773c2614 => generated 1265 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:15:44.581858 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1c3d4008-37d9-434e-b72d-2f75b7315163 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:44.582463 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1c3d4008-37d9-434e-b72d-2f75b7315163 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 9daa020d-efe7-4033-a479-cb5dadbc3ad7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:44.589592 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1c3d4008-37d9-434e-b72d-2f75b7315163 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:44.590079 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1c3d4008-37d9-434e-b72d-2f75b7315163 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:44.590519 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1c3d4008-37d9-434e-b72d-2f75b7315163 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:44.591207 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1c3d4008-37d9-434e-b72d-2f75b7315163 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:44.591660 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1c3d4008-37d9-434e-b72d-2f75b7315163 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:44.592083 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1c3d4008-37d9-434e-b72d-2f75b7315163 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:44.668587 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d532cf2d-e4b2-4b91-8936-03c33d2adfb9 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:44.669199 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d532cf2d-e4b2-4b91-8936-03c33d2adfb9 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:44.675532 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d532cf2d-e4b2-4b91-8936-03c33d2adfb9 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:44.676060 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d532cf2d-e4b2-4b91-8936-03c33d2adfb9 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:44.676530 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d532cf2d-e4b2-4b91-8936-03c33d2adfb9 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:44.677469 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d532cf2d-e4b2-4b91-8936-03c33d2adfb9 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:44.677881 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d532cf2d-e4b2-4b91-8936-03c33d2adfb9 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:44.678318 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d532cf2d-e4b2-4b91-8936-03c33d2adfb9 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:44.734978 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-1c3d4008-37d9-434e-b72d-2f75b7315163 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:44.742811 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1c3d4008-37d9-434e-b72d-2f75b7315163 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7" status: 200 len: 1537 microversion: 2.1 time: 0.164905 Oct 19 03:15:44.743383 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 541/1038] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:44 2022] GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7 => generated 1537 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:15:44.750676 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d532cf2d-e4b2-4b91-8936-03c33d2adfb9 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:44.758985 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d532cf2d-e4b2-4b91-8936-03c33d2adfb9 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:44.760457 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d532cf2d-e4b2-4b91-8936-03c33d2adfb9 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:44.765831 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d532cf2d-e4b2-4b91-8936-03c33d2adfb9 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1546 microversion: 2.91 time: 0.101748 Oct 19 03:15:44.766400 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 498/1039] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:44 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1546 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:15:44.897017 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9a98b71a-1dc1-4c81-9bc1-143310b97c50 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:44.897656 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9a98b71a-1dc1-4c81-9bc1-143310b97c50 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] [instance: d50976fb-756b-4b12-92f2-cedf87df492d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:44.903738 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9a98b71a-1dc1-4c81-9bc1-143310b97c50 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:44.904227 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9a98b71a-1dc1-4c81-9bc1-143310b97c50 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:44.904668 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9a98b71a-1dc1-4c81-9bc1-143310b97c50 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:44.905361 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9a98b71a-1dc1-4c81-9bc1-143310b97c50 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:44.905847 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9a98b71a-1dc1-4c81-9bc1-143310b97c50 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:44.906278 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9a98b71a-1dc1-4c81-9bc1-143310b97c50 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:44.976053 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-9a98b71a-1dc1-4c81-9bc1-143310b97c50 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lazy-loading 'services' on Instance uuid d50976fb-756b-4b12-92f2-cedf87df492d {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:15:44.992763 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9a98b71a-1dc1-4c81-9bc1-143310b97c50 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d" status: 200 len: 1933 microversion: 2.75 time: 0.099422 Oct 19 03:15:44.993335 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 542/1040] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:44 2022] GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d => generated 1933 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:15:44.996124 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b946a434-ce4e-42f7-bffb-d0f5b304aa9a tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:44.996733 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b946a434-ce4e-42f7-bffb-d0f5b304aa9a tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 62133546-4a75-4532-81ab-0c49c9252e85] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:45.002785 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b946a434-ce4e-42f7-bffb-d0f5b304aa9a tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:45.003278 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b946a434-ce4e-42f7-bffb-d0f5b304aa9a tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:45.003720 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b946a434-ce4e-42f7-bffb-d0f5b304aa9a tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:45.004447 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b946a434-ce4e-42f7-bffb-d0f5b304aa9a tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:45.004905 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b946a434-ce4e-42f7-bffb-d0f5b304aa9a tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:45.005335 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b946a434-ce4e-42f7-bffb-d0f5b304aa9a tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:45.044557 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e519645d-02e1-43a0-9140-29c1a5da58cd tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:45.045180 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e519645d-02e1-43a0-9140-29c1a5da58cd tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 88b09b16-f667-4ab9-89ca-a26dc86967ae] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:45.051212 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e519645d-02e1-43a0-9140-29c1a5da58cd tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:45.051707 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e519645d-02e1-43a0-9140-29c1a5da58cd tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:45.052151 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e519645d-02e1-43a0-9140-29c1a5da58cd tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:45.052853 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e519645d-02e1-43a0-9140-29c1a5da58cd tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:45.053312 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e519645d-02e1-43a0-9140-29c1a5da58cd tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:45.053774 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e519645d-02e1-43a0-9140-29c1a5da58cd tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:45.067472 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b946a434-ce4e-42f7-bffb-d0f5b304aa9a tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:45.076653 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b946a434-ce4e-42f7-bffb-d0f5b304aa9a tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:45.078219 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b946a434-ce4e-42f7-bffb-d0f5b304aa9a tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:45.079326 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b946a434-ce4e-42f7-bffb-d0f5b304aa9a tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85" status: 200 len: 1281 microversion: 2.25 time: 0.087822 Oct 19 03:15:45.079886 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 499/1041] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:44 2022] GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85 => generated 1281 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:15:45.187290 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-e519645d-02e1-43a0-9140-29c1a5da58cd tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:45.195350 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e519645d-02e1-43a0-9140-29c1a5da58cd tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/88b09b16-f667-4ab9-89ca-a26dc86967ae" status: 200 len: 1318 microversion: 2.1 time: 0.155125 Oct 19 03:15:45.196042 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 543/1042] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:45 2022] GET /compute/v2.1/servers/88b09b16-f667-4ab9-89ca-a26dc86967ae => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:15:45.535127 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8c36d203-d043-408c-a3ce-a66c3b096f7e tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:45.535657 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8c36d203-d043-408c-a3ce-a66c3b096f7e tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] [instance: b18ae860-ed77-4ddc-b9fa-a2aa773c2614] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:45.543124 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8c36d203-d043-408c-a3ce-a66c3b096f7e tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:45.543599 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8c36d203-d043-408c-a3ce-a66c3b096f7e tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:45.544035 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8c36d203-d043-408c-a3ce-a66c3b096f7e tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:45.544711 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8c36d203-d043-408c-a3ce-a66c3b096f7e tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:45.545166 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8c36d203-d043-408c-a3ce-a66c3b096f7e tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:45.545621 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8c36d203-d043-408c-a3ce-a66c3b096f7e tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:45.607982 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8c36d203-d043-408c-a3ce-a66c3b096f7e tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c1401b92c44228bd6e80dd3b786ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e388d05eac4f2babf180c0709fdc58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:45.615552 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8c36d203-d043-408c-a3ce-a66c3b096f7e tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] 10.222.0.52 "GET /compute/v2.1/servers/b18ae860-ed77-4ddc-b9fa-a2aa773c2614" status: 200 len: 1265 microversion: 2.1 time: 0.084402 Oct 19 03:15:45.616120 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 500/1043] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:45 2022] GET /compute/v2.1/servers/b18ae860-ed77-4ddc-b9fa-a2aa773c2614 => generated 1265 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:15:45.767211 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ac58cd1b-0003-41b0-bc61-1a7f8fa5acf8 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:45.767829 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ac58cd1b-0003-41b0-bc61-1a7f8fa5acf8 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 9daa020d-efe7-4033-a479-cb5dadbc3ad7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:45.773889 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ac58cd1b-0003-41b0-bc61-1a7f8fa5acf8 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:45.774380 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ac58cd1b-0003-41b0-bc61-1a7f8fa5acf8 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:45.774817 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ac58cd1b-0003-41b0-bc61-1a7f8fa5acf8 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:45.775502 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ac58cd1b-0003-41b0-bc61-1a7f8fa5acf8 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:45.775955 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ac58cd1b-0003-41b0-bc61-1a7f8fa5acf8 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:45.777056 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ac58cd1b-0003-41b0-bc61-1a7f8fa5acf8 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:45.794047 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-88c0c085-4aa0-4612-8d22-c695c7a1527d tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:45.794622 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-88c0c085-4aa0-4612-8d22-c695c7a1527d tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:45.795379 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=100 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:15:45.800709 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-88c0c085-4aa0-4612-8d22-c695c7a1527d tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:45.807005 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-88c0c085-4aa0-4612-8d22-c695c7a1527d tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:45.807005 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-88c0c085-4aa0-4612-8d22-c695c7a1527d tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:45.807005 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-88c0c085-4aa0-4612-8d22-c695c7a1527d tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:45.807005 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-88c0c085-4aa0-4612-8d22-c695c7a1527d tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:45.807375 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-88c0c085-4aa0-4612-8d22-c695c7a1527d tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:45.870888 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-88c0c085-4aa0-4612-8d22-c695c7a1527d tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:45.878888 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-88c0c085-4aa0-4612-8d22-c695c7a1527d tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:45.880368 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-88c0c085-4aa0-4612-8d22-c695c7a1527d tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:45.887292 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-88c0c085-4aa0-4612-8d22-c695c7a1527d tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1546 microversion: 2.91 time: 0.097382 Oct 19 03:15:45.888121 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 501/1044] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:45 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1546 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:15:45.934837 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ac58cd1b-0003-41b0-bc61-1a7f8fa5acf8 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:45.942573 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ac58cd1b-0003-41b0-bc61-1a7f8fa5acf8 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7" status: 200 len: 1537 microversion: 2.1 time: 0.179200 Oct 19 03:15:45.943141 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 544/1045] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:45 2022] GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7 => generated 1537 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:15:46.020754 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-bdb64740-0c90-46a6-a4fc-1271067a9905 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:46.021362 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-bdb64740-0c90-46a6-a4fc-1271067a9905 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] [instance: d50976fb-756b-4b12-92f2-cedf87df492d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:46.027825 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bdb64740-0c90-46a6-a4fc-1271067a9905 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:46.028308 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bdb64740-0c90-46a6-a4fc-1271067a9905 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:46.028744 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bdb64740-0c90-46a6-a4fc-1271067a9905 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:46.029463 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bdb64740-0c90-46a6-a4fc-1271067a9905 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:46.029920 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bdb64740-0c90-46a6-a4fc-1271067a9905 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:46.030346 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bdb64740-0c90-46a6-a4fc-1271067a9905 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:46.100029 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-bdb64740-0c90-46a6-a4fc-1271067a9905 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lazy-loading 'services' on Instance uuid d50976fb-756b-4b12-92f2-cedf87df492d {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:15:46.103189 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=100 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:15:46.103784 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7507caf9-2707-4242-a2c5-d216d70267d9 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:46.104498 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7507caf9-2707-4242-a2c5-d216d70267d9 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 62133546-4a75-4532-81ab-0c49c9252e85] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:46.106384 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=4 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:15:46.107071 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=20 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:15:46.111863 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7507caf9-2707-4242-a2c5-d216d70267d9 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:46.114191 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7507caf9-2707-4242-a2c5-d216d70267d9 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:46.114191 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7507caf9-2707-4242-a2c5-d216d70267d9 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:46.114191 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7507caf9-2707-4242-a2c5-d216d70267d9 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:46.114191 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7507caf9-2707-4242-a2c5-d216d70267d9 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:46.114653 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7507caf9-2707-4242-a2c5-d216d70267d9 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:46.116797 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-bdb64740-0c90-46a6-a4fc-1271067a9905 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d" status: 200 len: 1933 microversion: 2.75 time: 0.099688 Oct 19 03:15:46.117391 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 502/1046] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:46 2022] GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d => generated 1933 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:15:46.175512 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7507caf9-2707-4242-a2c5-d216d70267d9 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:46.184551 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7507caf9-2707-4242-a2c5-d216d70267d9 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:46.186137 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7507caf9-2707-4242-a2c5-d216d70267d9 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:46.187195 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7507caf9-2707-4242-a2c5-d216d70267d9 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85" status: 200 len: 1281 microversion: 2.25 time: 0.087570 Oct 19 03:15:46.187754 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 545/1047] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:46 2022] GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85 => generated 1281 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:15:46.218458 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c50c16a9-ae30-4bd4-8de0-605e42510629 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:46.219101 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c50c16a9-ae30-4bd4-8de0-605e42510629 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 88b09b16-f667-4ab9-89ca-a26dc86967ae] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:46.225121 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c50c16a9-ae30-4bd4-8de0-605e42510629 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:46.225655 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c50c16a9-ae30-4bd4-8de0-605e42510629 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:46.226873 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c50c16a9-ae30-4bd4-8de0-605e42510629 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:46.226873 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c50c16a9-ae30-4bd4-8de0-605e42510629 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:46.227244 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c50c16a9-ae30-4bd4-8de0-605e42510629 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:46.227674 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c50c16a9-ae30-4bd4-8de0-605e42510629 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:46.353507 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c50c16a9-ae30-4bd4-8de0-605e42510629 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:46.361008 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c50c16a9-ae30-4bd4-8de0-605e42510629 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/88b09b16-f667-4ab9-89ca-a26dc86967ae" status: 200 len: 1318 microversion: 2.1 time: 0.146728 Oct 19 03:15:46.361600 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 503/1048] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:46 2022] GET /compute/v2.1/servers/88b09b16-f667-4ab9-89ca-a26dc86967ae => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:15:46.639606 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-90af5f37-b12e-48d8-b23e-883a66ef6ce3 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:46.640340 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-90af5f37-b12e-48d8-b23e-883a66ef6ce3 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] [instance: b18ae860-ed77-4ddc-b9fa-a2aa773c2614] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:46.646351 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-90af5f37-b12e-48d8-b23e-883a66ef6ce3 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:46.647043 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-90af5f37-b12e-48d8-b23e-883a66ef6ce3 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:46.647675 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-90af5f37-b12e-48d8-b23e-883a66ef6ce3 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:46.648545 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-90af5f37-b12e-48d8-b23e-883a66ef6ce3 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:46.649172 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-90af5f37-b12e-48d8-b23e-883a66ef6ce3 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:46.649793 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-90af5f37-b12e-48d8-b23e-883a66ef6ce3 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:46.694913 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-21b205c3-91fb-4eb6-be38-9624f23890df req-59f6d42a-bf03-4943-ac7c-1f561f467ef9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88b09b16-f667-4ab9-89ca-a26dc86967ae", "name": "network-vif-plugged", "status": "completed", "tag": "c6cc7e90-cc90-44c2-82b6-4af34dfad284"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:15:46.707506 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:15:46.714732 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-90af5f37-b12e-48d8-b23e-883a66ef6ce3 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c1401b92c44228bd6e80dd3b786ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e388d05eac4f2babf180c0709fdc58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:46.724867 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-90af5f37-b12e-48d8-b23e-883a66ef6ce3 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] 10.222.0.52 "GET /compute/v2.1/servers/b18ae860-ed77-4ddc-b9fa-a2aa773c2614" status: 200 len: 1265 microversion: 2.1 time: 0.089947 Oct 19 03:15:46.725886 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 546/1049] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:46 2022] GET /compute/v2.1/servers/b18ae860-ed77-4ddc-b9fa-a2aa773c2614 => generated 1265 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:15:46.728405 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-21b205c3-91fb-4eb6-be38-9624f23890df req-59f6d42a-bf03-4943-ac7c-1f561f467ef9 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:46.728902 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-21b205c3-91fb-4eb6-be38-9624f23890df req-59f6d42a-bf03-4943-ac7c-1f561f467ef9 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:46.729896 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-21b205c3-91fb-4eb6-be38-9624f23890df req-59f6d42a-bf03-4943-ac7c-1f561f467ef9 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:46.740871 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-21b205c3-91fb-4eb6-be38-9624f23890df req-59f6d42a-bf03-4943-ac7c-1f561f467ef9 service nova] Creating event network-vif-plugged:c6cc7e90-cc90-44c2-82b6-4af34dfad284 for instance 88b09b16-f667-4ab9-89ca-a26dc86967ae on n-h1-861333-8 Oct 19 03:15:46.746947 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-21b205c3-91fb-4eb6-be38-9624f23890df req-59f6d42a-bf03-4943-ac7c-1f561f467ef9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059482 Oct 19 03:15:46.760200 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 504/1050] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:15:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:15:46.914350 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-253a0421-446f-4d3a-abbf-b4ca69b2a3f5 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:46.915064 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-253a0421-446f-4d3a-abbf-b4ca69b2a3f5 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:46.921741 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-253a0421-446f-4d3a-abbf-b4ca69b2a3f5 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:46.922234 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-253a0421-446f-4d3a-abbf-b4ca69b2a3f5 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:46.922680 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-253a0421-446f-4d3a-abbf-b4ca69b2a3f5 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:46.923379 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-253a0421-446f-4d3a-abbf-b4ca69b2a3f5 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:46.923841 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-253a0421-446f-4d3a-abbf-b4ca69b2a3f5 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:46.924270 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-253a0421-446f-4d3a-abbf-b4ca69b2a3f5 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:46.966974 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7b6b02b8-ea1f-4fcd-bcb3-8aac0520432f tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:46.967681 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7b6b02b8-ea1f-4fcd-bcb3-8aac0520432f tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 9daa020d-efe7-4033-a479-cb5dadbc3ad7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:46.974321 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7b6b02b8-ea1f-4fcd-bcb3-8aac0520432f tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:46.974809 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7b6b02b8-ea1f-4fcd-bcb3-8aac0520432f tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:46.975250 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7b6b02b8-ea1f-4fcd-bcb3-8aac0520432f tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:46.976015 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7b6b02b8-ea1f-4fcd-bcb3-8aac0520432f tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:46.976479 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7b6b02b8-ea1f-4fcd-bcb3-8aac0520432f tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:46.976907 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7b6b02b8-ea1f-4fcd-bcb3-8aac0520432f tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:46.989291 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-253a0421-446f-4d3a-abbf-b4ca69b2a3f5 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:46.997481 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-253a0421-446f-4d3a-abbf-b4ca69b2a3f5 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:46.998923 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-253a0421-446f-4d3a-abbf-b4ca69b2a3f5 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:47.003827 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-253a0421-446f-4d3a-abbf-b4ca69b2a3f5 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1546 microversion: 2.91 time: 0.093377 Oct 19 03:15:47.004397 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 547/1051] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:46 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1546 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:15:47.104122 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-7b6b02b8-ea1f-4fcd-bcb3-8aac0520432f tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:47.112513 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7b6b02b8-ea1f-4fcd-bcb3-8aac0520432f tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7" status: 200 len: 1537 microversion: 2.1 time: 0.150275 Oct 19 03:15:47.113085 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 505/1052] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:46 2022] GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7 => generated 1537 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:15:47.145688 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c9960569-6f2a-49a1-93b4-1b0cd73bee80 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:47.146310 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c9960569-6f2a-49a1-93b4-1b0cd73bee80 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] [instance: d50976fb-756b-4b12-92f2-cedf87df492d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:47.152793 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c9960569-6f2a-49a1-93b4-1b0cd73bee80 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:47.153276 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c9960569-6f2a-49a1-93b4-1b0cd73bee80 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:47.157048 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c9960569-6f2a-49a1-93b4-1b0cd73bee80 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:47.157048 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c9960569-6f2a-49a1-93b4-1b0cd73bee80 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:47.157048 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c9960569-6f2a-49a1-93b4-1b0cd73bee80 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:47.157048 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c9960569-6f2a-49a1-93b4-1b0cd73bee80 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:47.212758 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ca70bbac-17bf-4adc-a168-9b984110440d tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:47.213364 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ca70bbac-17bf-4adc-a168-9b984110440d tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 62133546-4a75-4532-81ab-0c49c9252e85] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:47.220286 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ca70bbac-17bf-4adc-a168-9b984110440d tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:47.220544 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ca70bbac-17bf-4adc-a168-9b984110440d tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:47.220979 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ca70bbac-17bf-4adc-a168-9b984110440d tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:47.221705 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ca70bbac-17bf-4adc-a168-9b984110440d tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:47.222159 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ca70bbac-17bf-4adc-a168-9b984110440d tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:47.222587 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ca70bbac-17bf-4adc-a168-9b984110440d tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:47.229012 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-c9960569-6f2a-49a1-93b4-1b0cd73bee80 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lazy-loading 'services' on Instance uuid d50976fb-756b-4b12-92f2-cedf87df492d {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:15:47.245853 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c9960569-6f2a-49a1-93b4-1b0cd73bee80 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d" status: 200 len: 1933 microversion: 2.75 time: 0.103935 Oct 19 03:15:47.246438 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 548/1053] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:47 2022] GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d => generated 1933 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:15:47.287333 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ca70bbac-17bf-4adc-a168-9b984110440d tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:47.296023 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ca70bbac-17bf-4adc-a168-9b984110440d tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:47.297479 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ca70bbac-17bf-4adc-a168-9b984110440d tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:47.298571 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ca70bbac-17bf-4adc-a168-9b984110440d tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85" status: 200 len: 1281 microversion: 2.25 time: 0.089900 Oct 19 03:15:47.299134 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 506/1054] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:47 2022] GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85 => generated 1281 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:15:47.384188 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a133f105-baac-4081-9ba9-e1a479be553e tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:47.385729 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a133f105-baac-4081-9ba9-e1a479be553e tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 88b09b16-f667-4ab9-89ca-a26dc86967ae] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:47.392160 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a133f105-baac-4081-9ba9-e1a479be553e tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:47.394375 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a133f105-baac-4081-9ba9-e1a479be553e tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:47.394375 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a133f105-baac-4081-9ba9-e1a479be553e tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:47.394375 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a133f105-baac-4081-9ba9-e1a479be553e tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:47.394375 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a133f105-baac-4081-9ba9-e1a479be553e tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:47.394757 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a133f105-baac-4081-9ba9-e1a479be553e tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:47.524962 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a133f105-baac-4081-9ba9-e1a479be553e tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:47.533336 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a133f105-baac-4081-9ba9-e1a479be553e tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/88b09b16-f667-4ab9-89ca-a26dc86967ae" status: 200 len: 1318 microversion: 2.1 time: 0.153089 Oct 19 03:15:47.533935 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 549/1055] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:47 2022] GET /compute/v2.1/servers/88b09b16-f667-4ab9-89ca-a26dc86967ae => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:15:47.748038 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c8d5dc8f-cd94-406b-bcf1-53e302b1aa26 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:47.748645 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c8d5dc8f-cd94-406b-bcf1-53e302b1aa26 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] [instance: b18ae860-ed77-4ddc-b9fa-a2aa773c2614] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:47.755418 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c8d5dc8f-cd94-406b-bcf1-53e302b1aa26 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:47.755896 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c8d5dc8f-cd94-406b-bcf1-53e302b1aa26 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:47.756330 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c8d5dc8f-cd94-406b-bcf1-53e302b1aa26 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:47.757008 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c8d5dc8f-cd94-406b-bcf1-53e302b1aa26 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:47.757498 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c8d5dc8f-cd94-406b-bcf1-53e302b1aa26 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:47.757934 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c8d5dc8f-cd94-406b-bcf1-53e302b1aa26 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:47.817927 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c8d5dc8f-cd94-406b-bcf1-53e302b1aa26 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c1401b92c44228bd6e80dd3b786ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e388d05eac4f2babf180c0709fdc58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:47.825522 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c8d5dc8f-cd94-406b-bcf1-53e302b1aa26 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] 10.222.0.52 "GET /compute/v2.1/servers/b18ae860-ed77-4ddc-b9fa-a2aa773c2614" status: 200 len: 1265 microversion: 2.1 time: 0.081431 Oct 19 03:15:47.826081 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 507/1056] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:47 2022] GET /compute/v2.1/servers/b18ae860-ed77-4ddc-b9fa-a2aa773c2614 => generated 1265 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:15:48.031788 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-748ace3d-1778-4b66-b6a7-c5f288535238 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:48.032321 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-748ace3d-1778-4b66-b6a7-c5f288535238 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:48.038434 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-748ace3d-1778-4b66-b6a7-c5f288535238 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:48.038926 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-748ace3d-1778-4b66-b6a7-c5f288535238 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:48.039376 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-748ace3d-1778-4b66-b6a7-c5f288535238 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:48.040072 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-748ace3d-1778-4b66-b6a7-c5f288535238 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:48.040534 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-748ace3d-1778-4b66-b6a7-c5f288535238 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:48.040964 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-748ace3d-1778-4b66-b6a7-c5f288535238 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:48.107567 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-748ace3d-1778-4b66-b6a7-c5f288535238 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:48.115647 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-748ace3d-1778-4b66-b6a7-c5f288535238 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:48.117096 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-748ace3d-1778-4b66-b6a7-c5f288535238 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:48.122045 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-748ace3d-1778-4b66-b6a7-c5f288535238 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1546 microversion: 2.91 time: 0.094265 Oct 19 03:15:48.122618 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 550/1057] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:48 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1546 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:15:48.135147 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-17b90c23-5626-4c57-a057-2494c69d473a tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:48.136313 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-17b90c23-5626-4c57-a057-2494c69d473a tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 9daa020d-efe7-4033-a479-cb5dadbc3ad7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:48.142528 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-17b90c23-5626-4c57-a057-2494c69d473a tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:48.149122 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-17b90c23-5626-4c57-a057-2494c69d473a tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:48.149122 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-17b90c23-5626-4c57-a057-2494c69d473a tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:48.149122 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-17b90c23-5626-4c57-a057-2494c69d473a tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:48.149122 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-17b90c23-5626-4c57-a057-2494c69d473a tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:48.149533 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-17b90c23-5626-4c57-a057-2494c69d473a tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:48.273938 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-17b90c23-5626-4c57-a057-2494c69d473a tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:48.274203 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0b7b5844-fe38-4e0a-96f7-c2810c747b3c tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:48.274820 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0b7b5844-fe38-4e0a-96f7-c2810c747b3c tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] [instance: d50976fb-756b-4b12-92f2-cedf87df492d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:48.281323 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0b7b5844-fe38-4e0a-96f7-c2810c747b3c tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:48.281901 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0b7b5844-fe38-4e0a-96f7-c2810c747b3c tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:48.282286 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0b7b5844-fe38-4e0a-96f7-c2810c747b3c tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:48.283890 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-17b90c23-5626-4c57-a057-2494c69d473a tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7" status: 200 len: 1537 microversion: 2.1 time: 0.150955 Oct 19 03:15:48.283890 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 508/1058] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:48 2022] GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7 => generated 1537 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:15:48.284043 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0b7b5844-fe38-4e0a-96f7-c2810c747b3c tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:48.284043 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0b7b5844-fe38-4e0a-96f7-c2810c747b3c tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:48.284279 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0b7b5844-fe38-4e0a-96f7-c2810c747b3c tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:48.324776 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-92701bf0-8d81-49e5-967d-22087ed74de0 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:48.325405 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-92701bf0-8d81-49e5-967d-22087ed74de0 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 62133546-4a75-4532-81ab-0c49c9252e85] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:48.331540 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-92701bf0-8d81-49e5-967d-22087ed74de0 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:48.332037 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-92701bf0-8d81-49e5-967d-22087ed74de0 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:48.332480 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-92701bf0-8d81-49e5-967d-22087ed74de0 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:48.333188 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-92701bf0-8d81-49e5-967d-22087ed74de0 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:48.333673 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-92701bf0-8d81-49e5-967d-22087ed74de0 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:48.334107 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-92701bf0-8d81-49e5-967d-22087ed74de0 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:48.358023 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-0b7b5844-fe38-4e0a-96f7-c2810c747b3c tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lazy-loading 'services' on Instance uuid d50976fb-756b-4b12-92f2-cedf87df492d {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:15:48.375840 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0b7b5844-fe38-4e0a-96f7-c2810c747b3c tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d" status: 200 len: 1933 microversion: 2.75 time: 0.105350 Oct 19 03:15:48.376431 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 551/1059] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:48 2022] GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d => generated 1933 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:15:48.400192 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-92701bf0-8d81-49e5-967d-22087ed74de0 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:48.408117 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-92701bf0-8d81-49e5-967d-22087ed74de0 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:48.409587 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-92701bf0-8d81-49e5-967d-22087ed74de0 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:48.410717 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-92701bf0-8d81-49e5-967d-22087ed74de0 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85" status: 200 len: 1281 microversion: 2.25 time: 0.090424 Oct 19 03:15:48.411277 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 509/1060] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:48 2022] GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85 => generated 1281 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:15:48.556880 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-fee51c22-e70d-4256-b167-398d84271e4a tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:48.558097 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-fee51c22-e70d-4256-b167-398d84271e4a tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 88b09b16-f667-4ab9-89ca-a26dc86967ae] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:48.564088 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fee51c22-e70d-4256-b167-398d84271e4a tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:48.564577 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fee51c22-e70d-4256-b167-398d84271e4a tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:48.565018 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fee51c22-e70d-4256-b167-398d84271e4a tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:48.565751 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fee51c22-e70d-4256-b167-398d84271e4a tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:48.566208 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fee51c22-e70d-4256-b167-398d84271e4a tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:48.566639 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fee51c22-e70d-4256-b167-398d84271e4a tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:48.696225 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-fee51c22-e70d-4256-b167-398d84271e4a tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:48.704020 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-fee51c22-e70d-4256-b167-398d84271e4a tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/88b09b16-f667-4ab9-89ca-a26dc86967ae" status: 200 len: 1318 microversion: 2.1 time: 0.151340 Oct 19 03:15:48.704639 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 552/1061] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:48 2022] GET /compute/v2.1/servers/88b09b16-f667-4ab9-89ca-a26dc86967ae => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:15:48.848801 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c78c088a-9c17-4bc5-8997-2791b9669ab5 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:48.849341 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c78c088a-9c17-4bc5-8997-2791b9669ab5 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] [instance: b18ae860-ed77-4ddc-b9fa-a2aa773c2614] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:48.856702 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c78c088a-9c17-4bc5-8997-2791b9669ab5 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:48.857189 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c78c088a-9c17-4bc5-8997-2791b9669ab5 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:48.857735 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c78c088a-9c17-4bc5-8997-2791b9669ab5 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:48.858476 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c78c088a-9c17-4bc5-8997-2791b9669ab5 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:48.858923 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c78c088a-9c17-4bc5-8997-2791b9669ab5 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:48.859372 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c78c088a-9c17-4bc5-8997-2791b9669ab5 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:48.922064 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c78c088a-9c17-4bc5-8997-2791b9669ab5 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c1401b92c44228bd6e80dd3b786ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e388d05eac4f2babf180c0709fdc58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:48.932035 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c78c088a-9c17-4bc5-8997-2791b9669ab5 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] 10.222.0.52 "GET /compute/v2.1/servers/b18ae860-ed77-4ddc-b9fa-a2aa773c2614" status: 200 len: 1265 microversion: 2.1 time: 0.087137 Oct 19 03:15:48.934097 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 510/1062] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:48 2022] GET /compute/v2.1/servers/b18ae860-ed77-4ddc-b9fa-a2aa773c2614 => generated 1265 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:15:49.149900 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4ee10886-4b01-48de-b718-38e1f7c3526f tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:49.150436 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4ee10886-4b01-48de-b718-38e1f7c3526f tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:49.157014 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4ee10886-4b01-48de-b718-38e1f7c3526f tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:49.157561 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4ee10886-4b01-48de-b718-38e1f7c3526f tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:49.157980 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4ee10886-4b01-48de-b718-38e1f7c3526f tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:49.158673 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4ee10886-4b01-48de-b718-38e1f7c3526f tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:49.159143 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4ee10886-4b01-48de-b718-38e1f7c3526f tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:49.159576 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4ee10886-4b01-48de-b718-38e1f7c3526f tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:49.226458 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4ee10886-4b01-48de-b718-38e1f7c3526f tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:49.235516 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4ee10886-4b01-48de-b718-38e1f7c3526f tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:49.236968 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4ee10886-4b01-48de-b718-38e1f7c3526f tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:49.241802 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4ee10886-4b01-48de-b718-38e1f7c3526f tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1546 microversion: 2.91 time: 0.095987 Oct 19 03:15:49.242371 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 553/1063] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:49 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1546 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:15:49.305275 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7de4e54d-533a-47bf-bdd5-459ff9784a3e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:49.305935 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7de4e54d-533a-47bf-bdd5-459ff9784a3e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 9daa020d-efe7-4033-a479-cb5dadbc3ad7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:49.312054 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7de4e54d-533a-47bf-bdd5-459ff9784a3e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:49.312544 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7de4e54d-533a-47bf-bdd5-459ff9784a3e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:49.312994 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7de4e54d-533a-47bf-bdd5-459ff9784a3e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:49.313716 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7de4e54d-533a-47bf-bdd5-459ff9784a3e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:49.314176 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7de4e54d-533a-47bf-bdd5-459ff9784a3e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:49.314605 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7de4e54d-533a-47bf-bdd5-459ff9784a3e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:49.404986 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-af5ff5fb-80d5-4176-bd05-a2aae8031564 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:49.405580 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-af5ff5fb-80d5-4176-bd05-a2aae8031564 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] [instance: d50976fb-756b-4b12-92f2-cedf87df492d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:49.411516 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-af5ff5fb-80d5-4176-bd05-a2aae8031564 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:49.412299 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-af5ff5fb-80d5-4176-bd05-a2aae8031564 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:49.412463 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-af5ff5fb-80d5-4176-bd05-a2aae8031564 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:49.413154 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-af5ff5fb-80d5-4176-bd05-a2aae8031564 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:49.413646 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-af5ff5fb-80d5-4176-bd05-a2aae8031564 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:49.414082 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-af5ff5fb-80d5-4176-bd05-a2aae8031564 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:49.441734 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-7de4e54d-533a-47bf-bdd5-459ff9784a3e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:49.449973 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7de4e54d-533a-47bf-bdd5-459ff9784a3e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7" status: 200 len: 1537 microversion: 2.1 time: 0.148552 Oct 19 03:15:49.450550 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 511/1064] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:49 2022] GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7 => generated 1537 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:15:49.461550 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-56a2e33c-bc71-49f5-9a84-27ab74759ec4 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:49.461550 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-56a2e33c-bc71-49f5-9a84-27ab74759ec4 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 62133546-4a75-4532-81ab-0c49c9252e85] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:49.461550 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-56a2e33c-bc71-49f5-9a84-27ab74759ec4 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:49.461911 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-56a2e33c-bc71-49f5-9a84-27ab74759ec4 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:49.462354 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-56a2e33c-bc71-49f5-9a84-27ab74759ec4 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:49.463060 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-56a2e33c-bc71-49f5-9a84-27ab74759ec4 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:49.463515 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-56a2e33c-bc71-49f5-9a84-27ab74759ec4 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:49.464568 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-56a2e33c-bc71-49f5-9a84-27ab74759ec4 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:49.485553 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-af5ff5fb-80d5-4176-bd05-a2aae8031564 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lazy-loading 'services' on Instance uuid d50976fb-756b-4b12-92f2-cedf87df492d {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:15:49.502089 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-af5ff5fb-80d5-4176-bd05-a2aae8031564 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d" status: 200 len: 1933 microversion: 2.75 time: 0.101823 Oct 19 03:15:49.502673 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 554/1065] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:49 2022] GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d => generated 1933 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:15:49.524982 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-56a2e33c-bc71-49f5-9a84-27ab74759ec4 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:49.533748 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-56a2e33c-bc71-49f5-9a84-27ab74759ec4 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:49.535199 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-56a2e33c-bc71-49f5-9a84-27ab74759ec4 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:49.536300 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-56a2e33c-bc71-49f5-9a84-27ab74759ec4 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85" status: 200 len: 1281 microversion: 2.25 time: 0.084834 Oct 19 03:15:49.536867 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 512/1066] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:49 2022] GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85 => generated 1281 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:15:49.725831 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-93249067-4924-4bd1-9ecf-887843fb6b8b tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:49.726466 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-93249067-4924-4bd1-9ecf-887843fb6b8b tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 88b09b16-f667-4ab9-89ca-a26dc86967ae] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:49.732491 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-93249067-4924-4bd1-9ecf-887843fb6b8b tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:49.732973 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-93249067-4924-4bd1-9ecf-887843fb6b8b tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:49.733461 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-93249067-4924-4bd1-9ecf-887843fb6b8b tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:49.734124 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-93249067-4924-4bd1-9ecf-887843fb6b8b tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:49.734572 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-93249067-4924-4bd1-9ecf-887843fb6b8b tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:49.734994 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-93249067-4924-4bd1-9ecf-887843fb6b8b tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:49.863797 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-93249067-4924-4bd1-9ecf-887843fb6b8b tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:49.871954 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-93249067-4924-4bd1-9ecf-887843fb6b8b tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/88b09b16-f667-4ab9-89ca-a26dc86967ae" status: 200 len: 1318 microversion: 2.1 time: 0.149991 Oct 19 03:15:49.872522 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 555/1067] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:49 2022] GET /compute/v2.1/servers/88b09b16-f667-4ab9-89ca-a26dc86967ae => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:15:49.955317 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-95e38cc9-6ce0-4013-b6aa-8f6b2b1a30c7 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:49.955930 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-95e38cc9-6ce0-4013-b6aa-8f6b2b1a30c7 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] [instance: b18ae860-ed77-4ddc-b9fa-a2aa773c2614] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:49.962773 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-95e38cc9-6ce0-4013-b6aa-8f6b2b1a30c7 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:49.963261 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-95e38cc9-6ce0-4013-b6aa-8f6b2b1a30c7 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:49.963700 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-95e38cc9-6ce0-4013-b6aa-8f6b2b1a30c7 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:49.964396 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-95e38cc9-6ce0-4013-b6aa-8f6b2b1a30c7 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:49.964851 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-95e38cc9-6ce0-4013-b6aa-8f6b2b1a30c7 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:49.965281 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-95e38cc9-6ce0-4013-b6aa-8f6b2b1a30c7 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:50.025593 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-95e38cc9-6ce0-4013-b6aa-8f6b2b1a30c7 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c1401b92c44228bd6e80dd3b786ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e388d05eac4f2babf180c0709fdc58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:50.033359 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-95e38cc9-6ce0-4013-b6aa-8f6b2b1a30c7 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] 10.222.0.52 "GET /compute/v2.1/servers/b18ae860-ed77-4ddc-b9fa-a2aa773c2614" status: 200 len: 1265 microversion: 2.1 time: 0.081886 Oct 19 03:15:50.034143 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 513/1068] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:49 2022] GET /compute/v2.1/servers/b18ae860-ed77-4ddc-b9fa-a2aa773c2614 => generated 1265 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:15:50.269639 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-cedf6b1d-3c5a-42e4-9dec-a44d36ab2a20 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:50.270254 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-cedf6b1d-3c5a-42e4-9dec-a44d36ab2a20 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:50.276281 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cedf6b1d-3c5a-42e4-9dec-a44d36ab2a20 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:50.276710 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cedf6b1d-3c5a-42e4-9dec-a44d36ab2a20 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:50.277152 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cedf6b1d-3c5a-42e4-9dec-a44d36ab2a20 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:50.277884 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cedf6b1d-3c5a-42e4-9dec-a44d36ab2a20 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:50.278338 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cedf6b1d-3c5a-42e4-9dec-a44d36ab2a20 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:50.278766 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cedf6b1d-3c5a-42e4-9dec-a44d36ab2a20 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:50.342660 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-cedf6b1d-3c5a-42e4-9dec-a44d36ab2a20 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:50.350900 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-cedf6b1d-3c5a-42e4-9dec-a44d36ab2a20 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:50.352345 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-cedf6b1d-3c5a-42e4-9dec-a44d36ab2a20 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:50.357631 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-cedf6b1d-3c5a-42e4-9dec-a44d36ab2a20 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1546 microversion: 2.91 time: 0.092122 Oct 19 03:15:50.358204 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 556/1069] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:50 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1546 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:15:50.474625 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ed33931d-2a36-4016-92ec-8ce18ad2ac05 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:50.475240 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ed33931d-2a36-4016-92ec-8ce18ad2ac05 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 9daa020d-efe7-4033-a479-cb5dadbc3ad7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:50.481976 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ed33931d-2a36-4016-92ec-8ce18ad2ac05 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:50.482615 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ed33931d-2a36-4016-92ec-8ce18ad2ac05 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:50.483056 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ed33931d-2a36-4016-92ec-8ce18ad2ac05 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:50.483760 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ed33931d-2a36-4016-92ec-8ce18ad2ac05 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:50.484220 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ed33931d-2a36-4016-92ec-8ce18ad2ac05 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:50.484651 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ed33931d-2a36-4016-92ec-8ce18ad2ac05 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:50.530324 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f22dcd4b-8eca-4b5c-b2db-0caf388cf3e8 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:50.530836 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f22dcd4b-8eca-4b5c-b2db-0caf388cf3e8 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] [instance: d50976fb-756b-4b12-92f2-cedf87df492d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:50.536812 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f22dcd4b-8eca-4b5c-b2db-0caf388cf3e8 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:50.537298 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f22dcd4b-8eca-4b5c-b2db-0caf388cf3e8 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:50.537785 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f22dcd4b-8eca-4b5c-b2db-0caf388cf3e8 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:50.538481 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f22dcd4b-8eca-4b5c-b2db-0caf388cf3e8 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:50.538939 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f22dcd4b-8eca-4b5c-b2db-0caf388cf3e8 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:50.539366 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f22dcd4b-8eca-4b5c-b2db-0caf388cf3e8 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:50.619171 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-f22dcd4b-8eca-4b5c-b2db-0caf388cf3e8 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lazy-loading 'services' on Instance uuid d50976fb-756b-4b12-92f2-cedf87df492d {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:15:50.635620 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f22dcd4b-8eca-4b5c-b2db-0caf388cf3e8 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d" status: 200 len: 1933 microversion: 2.75 time: 0.109596 Oct 19 03:15:50.641579 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ed33931d-2a36-4016-92ec-8ce18ad2ac05 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:50.646251 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 557/1070] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:50 2022] GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d => generated 1933 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:15:50.650083 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ed33931d-2a36-4016-92ec-8ce18ad2ac05 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7" status: 200 len: 1537 microversion: 2.1 time: 0.179394 Oct 19 03:15:50.650793 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 514/1071] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:50 2022] GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7 => generated 1537 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:15:50.651788 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4f2c4f5e-ada5-400c-a042-7a63bebb82d1 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:50.652468 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4f2c4f5e-ada5-400c-a042-7a63bebb82d1 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 62133546-4a75-4532-81ab-0c49c9252e85] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:50.658522 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4f2c4f5e-ada5-400c-a042-7a63bebb82d1 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:50.658999 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4f2c4f5e-ada5-400c-a042-7a63bebb82d1 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:50.659437 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4f2c4f5e-ada5-400c-a042-7a63bebb82d1 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:50.660125 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4f2c4f5e-ada5-400c-a042-7a63bebb82d1 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:50.660579 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4f2c4f5e-ada5-400c-a042-7a63bebb82d1 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:50.661005 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4f2c4f5e-ada5-400c-a042-7a63bebb82d1 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:50.722607 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4f2c4f5e-ada5-400c-a042-7a63bebb82d1 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:50.731116 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4f2c4f5e-ada5-400c-a042-7a63bebb82d1 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:50.732542 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4f2c4f5e-ada5-400c-a042-7a63bebb82d1 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:50.733653 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4f2c4f5e-ada5-400c-a042-7a63bebb82d1 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85" status: 200 len: 1281 microversion: 2.25 time: 0.086349 Oct 19 03:15:50.734210 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 558/1072] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:50 2022] GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85 => generated 1281 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:15:50.895559 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-75d61380-1a48-477d-8e45-1b10f1c815d3 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:50.896092 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-75d61380-1a48-477d-8e45-1b10f1c815d3 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 88b09b16-f667-4ab9-89ca-a26dc86967ae] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:50.902818 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-75d61380-1a48-477d-8e45-1b10f1c815d3 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:50.903308 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-75d61380-1a48-477d-8e45-1b10f1c815d3 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:50.903751 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-75d61380-1a48-477d-8e45-1b10f1c815d3 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:50.904472 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-75d61380-1a48-477d-8e45-1b10f1c815d3 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:50.904926 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-75d61380-1a48-477d-8e45-1b10f1c815d3 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:50.905498 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-75d61380-1a48-477d-8e45-1b10f1c815d3 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:51.035162 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-75d61380-1a48-477d-8e45-1b10f1c815d3 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:51.042706 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-75d61380-1a48-477d-8e45-1b10f1c815d3 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/88b09b16-f667-4ab9-89ca-a26dc86967ae" status: 200 len: 1318 microversion: 2.1 time: 0.151048 Oct 19 03:15:51.043283 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 515/1073] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:50 2022] GET /compute/v2.1/servers/88b09b16-f667-4ab9-89ca-a26dc86967ae => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:15:51.055496 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c488a2ba-213d-401c-a280-8735a779ffc4 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:51.056222 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c488a2ba-213d-401c-a280-8735a779ffc4 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] [instance: b18ae860-ed77-4ddc-b9fa-a2aa773c2614] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:51.062229 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c488a2ba-213d-401c-a280-8735a779ffc4 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:51.062717 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c488a2ba-213d-401c-a280-8735a779ffc4 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:51.063160 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c488a2ba-213d-401c-a280-8735a779ffc4 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:51.063892 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c488a2ba-213d-401c-a280-8735a779ffc4 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:51.064346 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c488a2ba-213d-401c-a280-8735a779ffc4 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:51.064777 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c488a2ba-213d-401c-a280-8735a779ffc4 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:51.124871 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c488a2ba-213d-401c-a280-8735a779ffc4 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c1401b92c44228bd6e80dd3b786ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e388d05eac4f2babf180c0709fdc58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:51.128277 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=100 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:15:51.132780 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c488a2ba-213d-401c-a280-8735a779ffc4 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] 10.222.0.52 "GET /compute/v2.1/servers/b18ae860-ed77-4ddc-b9fa-a2aa773c2614" status: 200 len: 1265 microversion: 2.1 time: 0.081238 Oct 19 03:15:51.133354 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 559/1074] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:51 2022] GET /compute/v2.1/servers/b18ae860-ed77-4ddc-b9fa-a2aa773c2614 => generated 1265 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:15:51.386335 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2e8bf0da-fb1d-4180-91e0-8fe77e8b8247 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:51.386947 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2e8bf0da-fb1d-4180-91e0-8fe77e8b8247 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:51.393227 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2e8bf0da-fb1d-4180-91e0-8fe77e8b8247 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:51.393739 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2e8bf0da-fb1d-4180-91e0-8fe77e8b8247 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:51.394172 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2e8bf0da-fb1d-4180-91e0-8fe77e8b8247 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:51.394872 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2e8bf0da-fb1d-4180-91e0-8fe77e8b8247 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:51.395316 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2e8bf0da-fb1d-4180-91e0-8fe77e8b8247 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:51.395738 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2e8bf0da-fb1d-4180-91e0-8fe77e8b8247 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:51.461907 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-2e8bf0da-fb1d-4180-91e0-8fe77e8b8247 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:51.469868 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-2e8bf0da-fb1d-4180-91e0-8fe77e8b8247 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:51.471295 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-2e8bf0da-fb1d-4180-91e0-8fe77e8b8247 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:51.475934 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2e8bf0da-fb1d-4180-91e0-8fe77e8b8247 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1546 microversion: 2.91 time: 0.094173 Oct 19 03:15:51.476500 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 516/1075] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:51 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1546 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:15:51.664619 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6c9e04cd-9adc-4a1a-aa59-29fd386f37d8 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:51.665271 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6c9e04cd-9adc-4a1a-aa59-29fd386f37d8 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] [instance: d50976fb-756b-4b12-92f2-cedf87df492d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:51.671980 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6c9e04cd-9adc-4a1a-aa59-29fd386f37d8 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:51.672469 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6c9e04cd-9adc-4a1a-aa59-29fd386f37d8 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:51.672902 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6c9e04cd-9adc-4a1a-aa59-29fd386f37d8 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:51.673621 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6c9e04cd-9adc-4a1a-aa59-29fd386f37d8 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:51.673817 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-edb4f126-3241-4c42-9454-746217b01bb6 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:51.674076 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6c9e04cd-9adc-4a1a-aa59-29fd386f37d8 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:51.674438 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-edb4f126-3241-4c42-9454-746217b01bb6 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 9daa020d-efe7-4033-a479-cb5dadbc3ad7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:51.674559 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6c9e04cd-9adc-4a1a-aa59-29fd386f37d8 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:51.680296 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-edb4f126-3241-4c42-9454-746217b01bb6 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:51.680783 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-edb4f126-3241-4c42-9454-746217b01bb6 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:51.681228 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-edb4f126-3241-4c42-9454-746217b01bb6 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:51.681949 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-edb4f126-3241-4c42-9454-746217b01bb6 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:51.683085 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-edb4f126-3241-4c42-9454-746217b01bb6 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:51.683516 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-edb4f126-3241-4c42-9454-746217b01bb6 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:51.775245 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-6c9e04cd-9adc-4a1a-aa59-29fd386f37d8 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lazy-loading 'services' on Instance uuid d50976fb-756b-4b12-92f2-cedf87df492d {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:15:51.794131 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6c9e04cd-9adc-4a1a-aa59-29fd386f37d8 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d" status: 200 len: 1933 microversion: 2.75 time: 0.133057 Oct 19 03:15:51.794913 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 560/1076] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:51 2022] GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d => generated 1933 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:15:51.819636 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b489945d-5d42-473f-8f0e-50af436e9cab tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:51.820556 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b489945d-5d42-473f-8f0e-50af436e9cab tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 62133546-4a75-4532-81ab-0c49c9252e85] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:51.831647 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b489945d-5d42-473f-8f0e-50af436e9cab tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:51.832246 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b489945d-5d42-473f-8f0e-50af436e9cab tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:51.832948 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b489945d-5d42-473f-8f0e-50af436e9cab tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:51.833941 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b489945d-5d42-473f-8f0e-50af436e9cab tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:51.834613 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b489945d-5d42-473f-8f0e-50af436e9cab tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:51.835150 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b489945d-5d42-473f-8f0e-50af436e9cab tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:51.852363 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-edb4f126-3241-4c42-9454-746217b01bb6 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:51.861685 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-edb4f126-3241-4c42-9454-746217b01bb6 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7" status: 200 len: 1537 microversion: 2.1 time: 0.191819 Oct 19 03:15:51.862456 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 517/1077] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:51 2022] GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7 => generated 1537 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:15:51.902539 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b489945d-5d42-473f-8f0e-50af436e9cab tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:51.910706 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b489945d-5d42-473f-8f0e-50af436e9cab tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:51.912321 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b489945d-5d42-473f-8f0e-50af436e9cab tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:51.913460 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b489945d-5d42-473f-8f0e-50af436e9cab tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85" status: 200 len: 1281 microversion: 2.25 time: 0.104265 Oct 19 03:15:51.914029 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 561/1078] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:51 2022] GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85 => generated 1281 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:15:52.065466 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d130d8bb-c210-4b9d-b0bf-3784fc9a7d7d tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:52.066188 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d130d8bb-c210-4b9d-b0bf-3784fc9a7d7d tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 88b09b16-f667-4ab9-89ca-a26dc86967ae] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:52.072947 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d130d8bb-c210-4b9d-b0bf-3784fc9a7d7d tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:52.073490 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d130d8bb-c210-4b9d-b0bf-3784fc9a7d7d tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:52.073931 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d130d8bb-c210-4b9d-b0bf-3784fc9a7d7d tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:52.074869 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d130d8bb-c210-4b9d-b0bf-3784fc9a7d7d tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:52.075067 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d130d8bb-c210-4b9d-b0bf-3784fc9a7d7d tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:52.075498 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d130d8bb-c210-4b9d-b0bf-3784fc9a7d7d tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:52.157683 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a4f6219b-1d06-4c10-840b-180a1a8b2835 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:52.158429 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a4f6219b-1d06-4c10-840b-180a1a8b2835 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] [instance: b18ae860-ed77-4ddc-b9fa-a2aa773c2614] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:52.165431 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a4f6219b-1d06-4c10-840b-180a1a8b2835 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:52.166040 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a4f6219b-1d06-4c10-840b-180a1a8b2835 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:52.167382 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a4f6219b-1d06-4c10-840b-180a1a8b2835 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:52.168183 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a4f6219b-1d06-4c10-840b-180a1a8b2835 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:52.168711 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a4f6219b-1d06-4c10-840b-180a1a8b2835 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:52.169209 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a4f6219b-1d06-4c10-840b-180a1a8b2835 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:52.222268 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d130d8bb-c210-4b9d-b0bf-3784fc9a7d7d tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:52.231773 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d130d8bb-c210-4b9d-b0bf-3784fc9a7d7d tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/88b09b16-f667-4ab9-89ca-a26dc86967ae" status: 200 len: 1318 microversion: 2.1 time: 0.170102 Oct 19 03:15:52.232299 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 518/1079] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:52 2022] GET /compute/v2.1/servers/88b09b16-f667-4ab9-89ca-a26dc86967ae => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:15:52.239227 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a4f6219b-1d06-4c10-840b-180a1a8b2835 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c1401b92c44228bd6e80dd3b786ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e388d05eac4f2babf180c0709fdc58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:52.247309 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a4f6219b-1d06-4c10-840b-180a1a8b2835 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] 10.222.0.52 "GET /compute/v2.1/servers/b18ae860-ed77-4ddc-b9fa-a2aa773c2614" status: 200 len: 1265 microversion: 2.1 time: 0.094087 Oct 19 03:15:52.247932 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 562/1080] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:52 2022] GET /compute/v2.1/servers/b18ae860-ed77-4ddc-b9fa-a2aa773c2614 => generated 1265 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:15:52.503539 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-10eb6cbe-23e8-488f-a77c-60b7176f4af4 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:52.504150 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-10eb6cbe-23e8-488f-a77c-60b7176f4af4 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:52.510217 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-10eb6cbe-23e8-488f-a77c-60b7176f4af4 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:52.511196 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-10eb6cbe-23e8-488f-a77c-60b7176f4af4 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:52.514042 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-10eb6cbe-23e8-488f-a77c-60b7176f4af4 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:52.514042 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-10eb6cbe-23e8-488f-a77c-60b7176f4af4 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:52.514042 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-10eb6cbe-23e8-488f-a77c-60b7176f4af4 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:52.514042 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-10eb6cbe-23e8-488f-a77c-60b7176f4af4 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:52.578460 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-10eb6cbe-23e8-488f-a77c-60b7176f4af4 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:52.586619 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-10eb6cbe-23e8-488f-a77c-60b7176f4af4 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:52.588076 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-10eb6cbe-23e8-488f-a77c-60b7176f4af4 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:52.593532 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-10eb6cbe-23e8-488f-a77c-60b7176f4af4 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1546 microversion: 2.91 time: 0.093913 Oct 19 03:15:52.594125 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 519/1081] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:52 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1546 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:15:52.826921 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2de51881-b44b-4d38-ad9b-b6dd73e2c269 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:52.827543 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-2de51881-b44b-4d38-ad9b-b6dd73e2c269 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] [instance: d50976fb-756b-4b12-92f2-cedf87df492d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:52.833519 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2de51881-b44b-4d38-ad9b-b6dd73e2c269 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:52.834008 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2de51881-b44b-4d38-ad9b-b6dd73e2c269 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:52.834440 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2de51881-b44b-4d38-ad9b-b6dd73e2c269 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:52.835136 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2de51881-b44b-4d38-ad9b-b6dd73e2c269 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:52.835591 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2de51881-b44b-4d38-ad9b-b6dd73e2c269 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:52.836017 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2de51881-b44b-4d38-ad9b-b6dd73e2c269 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:52.884888 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c748e38d-90b0-450c-aba7-68edd2b893f2 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:52.886088 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c748e38d-90b0-450c-aba7-68edd2b893f2 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 9daa020d-efe7-4033-a479-cb5dadbc3ad7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:52.892368 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c748e38d-90b0-450c-aba7-68edd2b893f2 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:52.892859 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c748e38d-90b0-450c-aba7-68edd2b893f2 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:52.893298 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c748e38d-90b0-450c-aba7-68edd2b893f2 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:52.894017 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c748e38d-90b0-450c-aba7-68edd2b893f2 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:52.894474 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c748e38d-90b0-450c-aba7-68edd2b893f2 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:52.894901 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c748e38d-90b0-450c-aba7-68edd2b893f2 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:52.897601 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=100 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:15:52.908631 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-2de51881-b44b-4d38-ad9b-b6dd73e2c269 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lazy-loading 'services' on Instance uuid d50976fb-756b-4b12-92f2-cedf87df492d {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:15:52.925161 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2de51881-b44b-4d38-ad9b-b6dd73e2c269 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d" status: 200 len: 1933 microversion: 2.75 time: 0.102583 Oct 19 03:15:52.925773 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 563/1082] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:52 2022] GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d => generated 1933 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:15:52.943562 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b4b845a2-38c3-4dd6-a2ea-f68c764a38f6 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:52.944186 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b4b845a2-38c3-4dd6-a2ea-f68c764a38f6 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 62133546-4a75-4532-81ab-0c49c9252e85] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:52.950853 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b4b845a2-38c3-4dd6-a2ea-f68c764a38f6 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:52.951345 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b4b845a2-38c3-4dd6-a2ea-f68c764a38f6 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:52.951795 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b4b845a2-38c3-4dd6-a2ea-f68c764a38f6 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:52.952481 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b4b845a2-38c3-4dd6-a2ea-f68c764a38f6 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:52.952939 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b4b845a2-38c3-4dd6-a2ea-f68c764a38f6 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:52.953462 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b4b845a2-38c3-4dd6-a2ea-f68c764a38f6 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:53.026848 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b4b845a2-38c3-4dd6-a2ea-f68c764a38f6 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:53.035112 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b4b845a2-38c3-4dd6-a2ea-f68c764a38f6 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:53.036555 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b4b845a2-38c3-4dd6-a2ea-f68c764a38f6 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:53.037757 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b4b845a2-38c3-4dd6-a2ea-f68c764a38f6 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85" status: 200 len: 1281 microversion: 2.25 time: 0.102751 Oct 19 03:15:53.038522 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 564/1083] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:52 2022] GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85 => generated 1281 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:15:53.058641 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c748e38d-90b0-450c-aba7-68edd2b893f2 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:53.066498 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c748e38d-90b0-450c-aba7-68edd2b893f2 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7" status: 200 len: 1537 microversion: 2.1 time: 0.185769 Oct 19 03:15:53.067119 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 520/1084] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:52 2022] GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7 => generated 1537 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:15:53.255045 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-23d0a157-e6ad-4765-afb2-048cd6597ef3 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:53.255668 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-23d0a157-e6ad-4765-afb2-048cd6597ef3 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 88b09b16-f667-4ab9-89ca-a26dc86967ae] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:53.261750 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-23d0a157-e6ad-4765-afb2-048cd6597ef3 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:53.262490 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-23d0a157-e6ad-4765-afb2-048cd6597ef3 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:53.262939 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-23d0a157-e6ad-4765-afb2-048cd6597ef3 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:53.263675 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-23d0a157-e6ad-4765-afb2-048cd6597ef3 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:53.264135 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-23d0a157-e6ad-4765-afb2-048cd6597ef3 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:53.264562 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-23d0a157-e6ad-4765-afb2-048cd6597ef3 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:53.269487 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7482bccf-c008-41e2-850d-efc3e24cbd83 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:53.270102 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7482bccf-c008-41e2-850d-efc3e24cbd83 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] [instance: b18ae860-ed77-4ddc-b9fa-a2aa773c2614] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:53.276814 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7482bccf-c008-41e2-850d-efc3e24cbd83 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:53.277296 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7482bccf-c008-41e2-850d-efc3e24cbd83 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:53.277752 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7482bccf-c008-41e2-850d-efc3e24cbd83 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:53.278445 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7482bccf-c008-41e2-850d-efc3e24cbd83 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:53.278893 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7482bccf-c008-41e2-850d-efc3e24cbd83 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:53.279318 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7482bccf-c008-41e2-850d-efc3e24cbd83 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:53.361725 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-7482bccf-c008-41e2-850d-efc3e24cbd83 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c1401b92c44228bd6e80dd3b786ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e388d05eac4f2babf180c0709fdc58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:53.377126 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7482bccf-c008-41e2-850d-efc3e24cbd83 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] 10.222.0.52 "GET /compute/v2.1/servers/b18ae860-ed77-4ddc-b9fa-a2aa773c2614" status: 200 len: 1265 microversion: 2.1 time: 0.103770 Oct 19 03:15:53.377126 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 521/1085] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:53 2022] GET /compute/v2.1/servers/b18ae860-ed77-4ddc-b9fa-a2aa773c2614 => generated 1265 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:15:53.427557 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-23d0a157-e6ad-4765-afb2-048cd6597ef3 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:53.436345 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-23d0a157-e6ad-4765-afb2-048cd6597ef3 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/88b09b16-f667-4ab9-89ca-a26dc86967ae" status: 200 len: 1468 microversion: 2.1 time: 0.185146 Oct 19 03:15:53.436932 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 565/1086] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:53 2022] GET /compute/v2.1/servers/88b09b16-f667-4ab9-89ca-a26dc86967ae => generated 1468 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:15:53.458650 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b2785792-1d99-47a7-936f-a88b2f3f9257 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:53.459288 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b2785792-1d99-47a7-936f-a88b2f3f9257 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 46e24c0c-6e9f-4a51-a10e-dcb68ebf6f9d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:53.465252 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b2785792-1d99-47a7-936f-a88b2f3f9257 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:53.471137 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b2785792-1d99-47a7-936f-a88b2f3f9257 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:53.471137 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b2785792-1d99-47a7-936f-a88b2f3f9257 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:53.471137 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b2785792-1d99-47a7-936f-a88b2f3f9257 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:53.471137 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b2785792-1d99-47a7-936f-a88b2f3f9257 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:53.471557 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b2785792-1d99-47a7-936f-a88b2f3f9257 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:53.596160 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b2785792-1d99-47a7-936f-a88b2f3f9257 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:53.603846 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b2785792-1d99-47a7-936f-a88b2f3f9257 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/46e24c0c-6e9f-4a51-a10e-dcb68ebf6f9d" status: 200 len: 1467 microversion: 2.1 time: 0.149142 Oct 19 03:15:53.605042 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 522/1087] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:53 2022] GET /compute/v2.1/servers/46e24c0c-6e9f-4a51-a10e-dcb68ebf6f9d => generated 1467 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:15:53.621392 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-34ac3917-cf96-45a7-b9a0-f59a4b520c4d tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:53.622087 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-34ac3917-cf96-45a7-b9a0-f59a4b520c4d tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:53.626007 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-54a48f21-120e-411b-b4c6-33d14d8f108d tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:53.628080 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-34ac3917-cf96-45a7-b9a0-f59a4b520c4d tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:53.628563 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-34ac3917-cf96-45a7-b9a0-f59a4b520c4d tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:53.628998 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-34ac3917-cf96-45a7-b9a0-f59a4b520c4d tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:53.629712 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-34ac3917-cf96-45a7-b9a0-f59a4b520c4d tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:53.630163 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-34ac3917-cf96-45a7-b9a0-f59a4b520c4d tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:53.630590 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-34ac3917-cf96-45a7-b9a0-f59a4b520c4d tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:53.631080 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-54a48f21-120e-411b-b4c6-33d14d8f108d tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:53.631952 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-54a48f21-120e-411b-b4c6-33d14d8f108d tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Searching by: {'reservation_id': 'r-ownmapmv', 'deleted': False, 'project_id': '5d909fe7763841d5b452738112b656d3'} {{(pid=121134) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 03:15:53.637459 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-54a48f21-120e-411b-b4c6-33d14d8f108d tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:53.637943 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-54a48f21-120e-411b-b4c6-33d14d8f108d tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:53.638381 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-54a48f21-120e-411b-b4c6-33d14d8f108d tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:53.639105 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-54a48f21-120e-411b-b4c6-33d14d8f108d tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:53.639569 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-54a48f21-120e-411b-b4c6-33d14d8f108d tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:53.639992 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-54a48f21-120e-411b-b4c6-33d14d8f108d tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:53.695457 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-34ac3917-cf96-45a7-b9a0-f59a4b520c4d tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:53.703964 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-34ac3917-cf96-45a7-b9a0-f59a4b520c4d tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:53.705525 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-34ac3917-cf96-45a7-b9a0-f59a4b520c4d tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:53.710429 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-34ac3917-cf96-45a7-b9a0-f59a4b520c4d tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1533 microversion: 2.91 time: 0.093336 Oct 19 03:15:53.711091 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 566/1088] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:53 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1533 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:15:53.734920 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.multi_cell_list [None req-54a48f21-120e-411b-b4c6-33d14d8f108d tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=121134) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 03:15:53.738180 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9eb4d780-70c8-4a8b-a520-dc99729885c5 tempest-UnshelveToHostMultiNodesTest-1213824820 tempest-UnshelveToHostMultiNodesTest-1213824820-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:53.738838 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9eb4d780-70c8-4a8b-a520-dc99729885c5 tempest-UnshelveToHostMultiNodesTest-1213824820 tempest-UnshelveToHostMultiNodesTest-1213824820-project-admin] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:53.745450 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9eb4d780-70c8-4a8b-a520-dc99729885c5 tempest-UnshelveToHostMultiNodesTest-1213824820 tempest-UnshelveToHostMultiNodesTest-1213824820-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:53.746095 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9eb4d780-70c8-4a8b-a520-dc99729885c5 tempest-UnshelveToHostMultiNodesTest-1213824820 tempest-UnshelveToHostMultiNodesTest-1213824820-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:53.746656 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9eb4d780-70c8-4a8b-a520-dc99729885c5 tempest-UnshelveToHostMultiNodesTest-1213824820 tempest-UnshelveToHostMultiNodesTest-1213824820-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:53.747480 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9eb4d780-70c8-4a8b-a520-dc99729885c5 tempest-UnshelveToHostMultiNodesTest-1213824820 tempest-UnshelveToHostMultiNodesTest-1213824820-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:53.748532 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9eb4d780-70c8-4a8b-a520-dc99729885c5 tempest-UnshelveToHostMultiNodesTest-1213824820 tempest-UnshelveToHostMultiNodesTest-1213824820-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:53.748532 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9eb4d780-70c8-4a8b-a520-dc99729885c5 tempest-UnshelveToHostMultiNodesTest-1213824820 tempest-UnshelveToHostMultiNodesTest-1213824820-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:53.802541 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-54a48f21-120e-411b-b4c6-33d14d8f108d tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:53.809483 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-54a48f21-120e-411b-b4c6-33d14d8f108d tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:53.809974 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-54a48f21-120e-411b-b4c6-33d14d8f108d tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:53.814556 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-54a48f21-120e-411b-b4c6-33d14d8f108d tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:53.826744 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-9eb4d780-70c8-4a8b-a520-dc99729885c5 tempest-UnshelveToHostMultiNodesTest-1213824820 tempest-UnshelveToHostMultiNodesTest-1213824820-project-admin] Lazy-loading 'services' on Instance uuid 84092951-cf52-4077-b954-0babab66565e {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:15:53.844609 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9eb4d780-70c8-4a8b-a520-dc99729885c5 tempest-UnshelveToHostMultiNodesTest-1213824820 tempest-UnshelveToHostMultiNodesTest-1213824820-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1938 microversion: 2.91 time: 0.109946 Oct 19 03:15:53.845618 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 567/1089] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:53 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1938 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:15:53.872901 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-941aeaab-d914-4eeb-805a-16490e3fffd8 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:15:53.873516 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-941aeaab-d914-4eeb-805a-16490e3fffd8 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:53.878684 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=100 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:15:53.880525 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-941aeaab-d914-4eeb-805a-16490e3fffd8 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:53.881231 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-941aeaab-d914-4eeb-805a-16490e3fffd8 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:53.881853 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-941aeaab-d914-4eeb-805a-16490e3fffd8 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:53.882620 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-941aeaab-d914-4eeb-805a-16490e3fffd8 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:53.883265 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-941aeaab-d914-4eeb-805a-16490e3fffd8 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:53.883634 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-941aeaab-d914-4eeb-805a-16490e3fffd8 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:53.910442 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-941aeaab-d914-4eeb-805a-16490e3fffd8 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lazy-loading 'flavor' on Instance uuid 84092951-cf52-4077-b954-0babab66565e {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:15:53.943041 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-54a48f21-120e-411b-b4c6-33d14d8f108d tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/detail?reservation_id=r-ownmapmv" status: 200 len: 2928 microversion: 2.1 time: 0.320658 Oct 19 03:15:53.943852 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 523/1090] 10.222.0.52 () {58 vars in 1197 bytes} [Wed Oct 19 03:15:53 2022] GET /compute/v2.1/servers/detail?reservation_id=r-ownmapmv => generated 2928 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:15:53.954434 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5e4bab79-fccb-4477-8866-d78a5c649747 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:53.960979 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5e4bab79-fccb-4477-8866-d78a5c649747 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] [instance: d50976fb-756b-4b12-92f2-cedf87df492d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:53.961678 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5e4bab79-fccb-4477-8866-d78a5c649747 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:53.961937 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5e4bab79-fccb-4477-8866-d78a5c649747 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:53.962379 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5e4bab79-fccb-4477-8866-d78a5c649747 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:53.963075 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5e4bab79-fccb-4477-8866-d78a5c649747 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:53.964275 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5e4bab79-fccb-4477-8866-d78a5c649747 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:53.964729 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5e4bab79-fccb-4477-8866-d78a5c649747 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:54.039834 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-5e4bab79-fccb-4477-8866-d78a5c649747 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lazy-loading 'services' on Instance uuid d50976fb-756b-4b12-92f2-cedf87df492d {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:15:54.056726 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5e4bab79-fccb-4477-8866-d78a5c649747 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d" status: 200 len: 1933 microversion: 2.75 time: 0.105895 Oct 19 03:15:54.057618 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 524/1091] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:53 2022] GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d => generated 1933 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:15:54.062015 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7fb465f3-e923-4d60-83f1-456c762a4cd9 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:54.077897 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.compute.server_groups [None req-7fb465f3-e923-4d60-83f1-456c762a4cd9 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Querying cell d204a9a6-30d3-4569-8922-0d4cbe966b78(cell1) for 2 instances {{(pid=121134) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 19 03:15:54.078610 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7fb465f3-e923-4d60-83f1-456c762a4cd9 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:54.079100 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7fb465f3-e923-4d60-83f1-456c762a4cd9 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:54.079584 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7fb465f3-e923-4d60-83f1-456c762a4cd9 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:54.100872 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7fb465f3-e923-4d60-83f1-456c762a4cd9 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/os-server-groups/99c091b4-fcf8-4b85-ba19-1004305c9cf8" status: 200 len: 271 microversion: 2.1 time: 0.042222 Oct 19 03:15:54.101460 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 525/1092] 10.222.0.52 () {58 vars in 1263 bytes} [Wed Oct 19 03:15:54 2022] GET /compute/v2.1/os-server-groups/99c091b4-fcf8-4b85-ba19-1004305c9cf8 => generated 271 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:15:54.106080 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-46aff252-5232-4443-ab3c-d382d1a1d128 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:54.106689 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-46aff252-5232-4443-ab3c-d382d1a1d128 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 62133546-4a75-4532-81ab-0c49c9252e85] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:54.112249 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-46aff252-5232-4443-ab3c-d382d1a1d128 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:54.112731 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-46aff252-5232-4443-ab3c-d382d1a1d128 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:54.113173 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-46aff252-5232-4443-ab3c-d382d1a1d128 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:54.113895 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-46aff252-5232-4443-ab3c-d382d1a1d128 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:54.114354 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-46aff252-5232-4443-ab3c-d382d1a1d128 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:54.114859 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-46aff252-5232-4443-ab3c-d382d1a1d128 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:54.179207 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-46aff252-5232-4443-ab3c-d382d1a1d128 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:54.187251 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-46aff252-5232-4443-ab3c-d382d1a1d128 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:54.188698 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-46aff252-5232-4443-ab3c-d382d1a1d128 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:54.189883 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-46aff252-5232-4443-ab3c-d382d1a1d128 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85" status: 200 len: 1281 microversion: 2.25 time: 0.087477 Oct 19 03:15:54.195043 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 526/1093] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:54 2022] GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85 => generated 1281 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:15:54.195043 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b7c19dd2-5c43-4d50-a18b-aa6a57f7e57b tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:54.195299 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b7c19dd2-5c43-4d50-a18b-aa6a57f7e57b tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 9daa020d-efe7-4033-a479-cb5dadbc3ad7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:54.201815 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b7c19dd2-5c43-4d50-a18b-aa6a57f7e57b tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:54.202367 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b7c19dd2-5c43-4d50-a18b-aa6a57f7e57b tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:54.202798 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b7c19dd2-5c43-4d50-a18b-aa6a57f7e57b tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:54.203481 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b7c19dd2-5c43-4d50-a18b-aa6a57f7e57b tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:54.203926 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b7c19dd2-5c43-4d50-a18b-aa6a57f7e57b tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:54.204351 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b7c19dd2-5c43-4d50-a18b-aa6a57f7e57b tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:54.339703 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b7c19dd2-5c43-4d50-a18b-aa6a57f7e57b tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:54.348100 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b7c19dd2-5c43-4d50-a18b-aa6a57f7e57b tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7" status: 200 len: 1537 microversion: 2.1 time: 0.156699 Oct 19 03:15:54.348933 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 527/1094] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:54 2022] GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7 => generated 1537 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:15:54.353889 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d92bdfd9-4f44-4476-bb5b-2db70363e784 tempest-ServersOnMultiNodesTest-74681315 tempest-ServersOnMultiNodesTest-74681315-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:54.354765 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d92bdfd9-4f44-4476-bb5b-2db70363e784 tempest-ServersOnMultiNodesTest-74681315 tempest-ServersOnMultiNodesTest-74681315-project-admin] [instance: 88b09b16-f667-4ab9-89ca-a26dc86967ae] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:54.360856 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d92bdfd9-4f44-4476-bb5b-2db70363e784 tempest-ServersOnMultiNodesTest-74681315 tempest-ServersOnMultiNodesTest-74681315-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:54.361482 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d92bdfd9-4f44-4476-bb5b-2db70363e784 tempest-ServersOnMultiNodesTest-74681315 tempest-ServersOnMultiNodesTest-74681315-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:54.362036 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d92bdfd9-4f44-4476-bb5b-2db70363e784 tempest-ServersOnMultiNodesTest-74681315 tempest-ServersOnMultiNodesTest-74681315-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:54.362909 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d92bdfd9-4f44-4476-bb5b-2db70363e784 tempest-ServersOnMultiNodesTest-74681315 tempest-ServersOnMultiNodesTest-74681315-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:54.363463 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d92bdfd9-4f44-4476-bb5b-2db70363e784 tempest-ServersOnMultiNodesTest-74681315 tempest-ServersOnMultiNodesTest-74681315-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:54.363996 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d92bdfd9-4f44-4476-bb5b-2db70363e784 tempest-ServersOnMultiNodesTest-74681315 tempest-ServersOnMultiNodesTest-74681315-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:54.433217 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-941aeaab-d914-4eeb-805a-16490e3fffd8 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "POST /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e/action" status: 202 len: 0 microversion: 2.91 time: 0.558861 Oct 19 03:15:54.443544 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 568/1095] 10.222.0.52 () {62 vars in 1319 bytes} [Wed Oct 19 03:15:53 2022] POST /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e/action => generated 0 bytes in 575 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 19 03:15:54.459320 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-bdc304f9-4c79-44a3-8025-4c1b1e67ddb3 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:54.460039 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-bdc304f9-4c79-44a3-8025-4c1b1e67ddb3 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] [instance: b18ae860-ed77-4ddc-b9fa-a2aa773c2614] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:54.467432 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bdc304f9-4c79-44a3-8025-4c1b1e67ddb3 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:54.467935 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bdc304f9-4c79-44a3-8025-4c1b1e67ddb3 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:54.468372 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bdc304f9-4c79-44a3-8025-4c1b1e67ddb3 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:54.469077 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bdc304f9-4c79-44a3-8025-4c1b1e67ddb3 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:54.469583 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bdc304f9-4c79-44a3-8025-4c1b1e67ddb3 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:54.470019 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bdc304f9-4c79-44a3-8025-4c1b1e67ddb3 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:54.506894 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d92bdfd9-4f44-4476-bb5b-2db70363e784 tempest-ServersOnMultiNodesTest-74681315 tempest-ServersOnMultiNodesTest-74681315-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/88b09b16-f667-4ab9-89ca-a26dc86967ae" status: 200 len: 1619 microversion: 2.1 time: 0.156709 Oct 19 03:15:54.511333 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 528/1096] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:54 2022] GET /compute/v2.1/servers/88b09b16-f667-4ab9-89ca-a26dc86967ae => generated 1619 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:15:54.513017 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-979c0865-e04e-4c71-bd38-411598949377 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:54.513689 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-979c0865-e04e-4c71-bd38-411598949377 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:54.526231 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-979c0865-e04e-4c71-bd38-411598949377 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:54.527018 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-979c0865-e04e-4c71-bd38-411598949377 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:54.527575 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-979c0865-e04e-4c71-bd38-411598949377 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:54.528766 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-979c0865-e04e-4c71-bd38-411598949377 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:54.529326 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-979c0865-e04e-4c71-bd38-411598949377 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:54.529878 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-979c0865-e04e-4c71-bd38-411598949377 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:54.550041 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-bdc304f9-4c79-44a3-8025-4c1b1e67ddb3 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c1401b92c44228bd6e80dd3b786ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e388d05eac4f2babf180c0709fdc58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:54.559637 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-bdc304f9-4c79-44a3-8025-4c1b1e67ddb3 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] 10.222.0.52 "GET /compute/v2.1/servers/b18ae860-ed77-4ddc-b9fa-a2aa773c2614" status: 200 len: 1321 microversion: 2.1 time: 0.110554 Oct 19 03:15:54.560422 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 569/1097] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:54 2022] GET /compute/v2.1/servers/b18ae860-ed77-4ddc-b9fa-a2aa773c2614 => generated 1321 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:15:54.570099 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b03ce367-7add-409b-b7f0-92a531ee7464 tempest-ServersOnMultiNodesTest-74681315 tempest-ServersOnMultiNodesTest-74681315-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:54.575480 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b03ce367-7add-409b-b7f0-92a531ee7464 tempest-ServersOnMultiNodesTest-74681315 tempest-ServersOnMultiNodesTest-74681315-project-admin] [instance: 46e24c0c-6e9f-4a51-a10e-dcb68ebf6f9d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:54.579521 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b03ce367-7add-409b-b7f0-92a531ee7464 tempest-ServersOnMultiNodesTest-74681315 tempest-ServersOnMultiNodesTest-74681315-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:54.580021 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b03ce367-7add-409b-b7f0-92a531ee7464 tempest-ServersOnMultiNodesTest-74681315 tempest-ServersOnMultiNodesTest-74681315-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:54.580465 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b03ce367-7add-409b-b7f0-92a531ee7464 tempest-ServersOnMultiNodesTest-74681315 tempest-ServersOnMultiNodesTest-74681315-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:54.581174 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b03ce367-7add-409b-b7f0-92a531ee7464 tempest-ServersOnMultiNodesTest-74681315 tempest-ServersOnMultiNodesTest-74681315-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:54.581802 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b03ce367-7add-409b-b7f0-92a531ee7464 tempest-ServersOnMultiNodesTest-74681315 tempest-ServersOnMultiNodesTest-74681315-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:54.582242 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b03ce367-7add-409b-b7f0-92a531ee7464 tempest-ServersOnMultiNodesTest-74681315 tempest-ServersOnMultiNodesTest-74681315-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:54.609803 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-979c0865-e04e-4c71-bd38-411598949377 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:54.617858 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-979c0865-e04e-4c71-bd38-411598949377 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:54.619294 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-979c0865-e04e-4c71-bd38-411598949377 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:54.624587 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-979c0865-e04e-4c71-bd38-411598949377 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1539 microversion: 2.91 time: 0.116159 Oct 19 03:15:54.625312 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 529/1098] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:54 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1539 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:15:54.707425 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b03ce367-7add-409b-b7f0-92a531ee7464 tempest-ServersOnMultiNodesTest-74681315 tempest-ServersOnMultiNodesTest-74681315-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/46e24c0c-6e9f-4a51-a10e-dcb68ebf6f9d" status: 200 len: 1618 microversion: 2.1 time: 0.140868 Oct 19 03:15:54.707979 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 570/1099] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:54 2022] GET /compute/v2.1/servers/46e24c0c-6e9f-4a51-a10e-dcb68ebf6f9d => generated 1618 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:15:54.820391 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b2e0bbb3-807b-41d1-ab3d-957653789638 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1873280163", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "2d709051-db69-4ea9-96dc-ffe05e9c9b3a"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:15:54.871505 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-b2e0bbb3-807b-41d1-ab3d-957653789638 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] validate_networks() for None {{(pid=121134) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:15:55.084419 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-b2e0bbb3-807b-41d1-ab3d-957653789638 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Flavor limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:15:55.085037 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-b2e0bbb3-807b-41d1-ab3d-957653789638 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Image limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:15:55.085317 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-b2e0bbb3-807b-41d1-ab3d-957653789638 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Flavor pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:15:55.085500 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-65117d66-7638-426a-a3c9-e98d417d46f0 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:55.086027 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-65117d66-7638-426a-a3c9-e98d417d46f0 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] [instance: d50976fb-756b-4b12-92f2-cedf87df492d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:55.086375 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-b2e0bbb3-807b-41d1-ab3d-957653789638 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Image pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:15:55.086800 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-b2e0bbb3-807b-41d1-ab3d-957653789638 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:15:55.092557 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-65117d66-7638-426a-a3c9-e98d417d46f0 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:55.093058 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-65117d66-7638-426a-a3c9-e98d417d46f0 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:55.093534 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-65117d66-7638-426a-a3c9-e98d417d46f0 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:55.094240 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-65117d66-7638-426a-a3c9-e98d417d46f0 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:55.094702 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-65117d66-7638-426a-a3c9-e98d417d46f0 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:55.095349 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-65117d66-7638-426a-a3c9-e98d417d46f0 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:55.097429 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b2e0bbb3-807b-41d1-ab3d-957653789638 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:55.097930 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b2e0bbb3-807b-41d1-ab3d-957653789638 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:55.098464 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b2e0bbb3-807b-41d1-ab3d-957653789638 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:55.099204 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b2e0bbb3-807b-41d1-ab3d-957653789638 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:55.099663 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b2e0bbb3-807b-41d1-ab3d-957653789638 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:55.100092 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b2e0bbb3-807b-41d1-ab3d-957653789638 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:55.119334 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-b2e0bbb3-807b-41d1-ab3d-957653789638 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Getting quotas for project 5d909fe7763841d5b452738112b656d3. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:15:55.128620 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-b2e0bbb3-807b-41d1-ab3d-957653789638 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Getting quotas for user 3e4d3ddb3a324d9da51c13701e318955 and project 5d909fe7763841d5b452738112b656d3. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:15:55.128620 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=100 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:15:55.136459 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b2e0bbb3-807b-41d1-ab3d-957653789638 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Going to run 1 instances... {{(pid=121134) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:15:55.139100 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b2e0bbb3-807b-41d1-ab3d-957653789638 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 1ee8c251-b609-4eeb-9406-ede7977b3f92] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:15:55.174739 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-65117d66-7638-426a-a3c9-e98d417d46f0 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] Lazy-loading 'services' on Instance uuid d50976fb-756b-4b12-92f2-cedf87df492d {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:15:55.191410 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-65117d66-7638-426a-a3c9-e98d417d46f0 tempest-ServersAdmin275Test-2036718337 tempest-ServersAdmin275Test-2036718337-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d" status: 200 len: 1918 microversion: 2.75 time: 0.109737 Oct 19 03:15:55.192005 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 571/1100] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:55 2022] GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d => generated 1918 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:15:55.215891 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-588aef74-8e71-496e-b625-462549111fe2 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:55.216612 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-588aef74-8e71-496e-b625-462549111fe2 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 62133546-4a75-4532-81ab-0c49c9252e85] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:55.222756 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-588aef74-8e71-496e-b625-462549111fe2 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:55.223242 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-588aef74-8e71-496e-b625-462549111fe2 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:55.223679 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-588aef74-8e71-496e-b625-462549111fe2 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:55.224366 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-588aef74-8e71-496e-b625-462549111fe2 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:55.224816 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-588aef74-8e71-496e-b625-462549111fe2 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:55.225245 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-588aef74-8e71-496e-b625-462549111fe2 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:55.291186 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-588aef74-8e71-496e-b625-462549111fe2 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:55.298482 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b2e0bbb3-807b-41d1-ab3d-957653789638 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.481778 Oct 19 03:15:55.299471 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 530/1101] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:15:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 483 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 03:15:55.309341 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ab9806d4-693e-42c5-8fa7-00d0ec87f6c2 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:55.309943 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ab9806d4-693e-42c5-8fa7-00d0ec87f6c2 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] [instance: d50976fb-756b-4b12-92f2-cedf87df492d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:55.313179 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-588aef74-8e71-496e-b625-462549111fe2 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:55.314705 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-588aef74-8e71-496e-b625-462549111fe2 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:55.315871 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-588aef74-8e71-496e-b625-462549111fe2 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85" status: 200 len: 1281 microversion: 2.25 time: 0.104394 Oct 19 03:15:55.316443 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 572/1102] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:55 2022] GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85 => generated 1281 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:15:55.329545 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ab9806d4-693e-42c5-8fa7-00d0ec87f6c2 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:55.329545 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ab9806d4-693e-42c5-8fa7-00d0ec87f6c2 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:55.329545 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ab9806d4-693e-42c5-8fa7-00d0ec87f6c2 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:55.329545 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ab9806d4-693e-42c5-8fa7-00d0ec87f6c2 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:55.329946 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ab9806d4-693e-42c5-8fa7-00d0ec87f6c2 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:55.329946 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ab9806d4-693e-42c5-8fa7-00d0ec87f6c2 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:55.330177 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-01b0ab93-9a99-4e31-875b-f89966752442 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:55.330177 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-01b0ab93-9a99-4e31-875b-f89966752442 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 1ee8c251-b609-4eeb-9406-ede7977b3f92] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:55.346556 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ab9806d4-693e-42c5-8fa7-00d0ec87f6c2 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] [instance: d50976fb-756b-4b12-92f2-cedf87df492d] Going to try to terminate instance {{(pid=121134) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:15:55.412295 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-01b0ab93-9a99-4e31-875b-f89966752442 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:55.420024 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-01b0ab93-9a99-4e31-875b-f89966752442 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/1ee8c251-b609-4eeb-9406-ede7977b3f92" status: 200 len: 1217 microversion: 2.1 time: 0.098061 Oct 19 03:15:55.420602 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 573/1103] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:55 2022] GET /compute/v2.1/servers/1ee8c251-b609-4eeb-9406-ede7977b3f92 => generated 1217 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:15:55.425508 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4b00cb20-408b-4ce9-bc28-d713c0b9ce49 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:55.426525 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4b00cb20-408b-4ce9-bc28-d713c0b9ce49 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 9daa020d-efe7-4033-a479-cb5dadbc3ad7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:55.433209 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4b00cb20-408b-4ce9-bc28-d713c0b9ce49 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:55.433945 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4b00cb20-408b-4ce9-bc28-d713c0b9ce49 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:55.434542 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4b00cb20-408b-4ce9-bc28-d713c0b9ce49 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:55.435411 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4b00cb20-408b-4ce9-bc28-d713c0b9ce49 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:55.435936 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4b00cb20-408b-4ce9-bc28-d713c0b9ce49 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:55.436363 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4b00cb20-408b-4ce9-bc28-d713c0b9ce49 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:55.442520 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:15:55.590959 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4b00cb20-408b-4ce9-bc28-d713c0b9ce49 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:55.611175 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4b00cb20-408b-4ce9-bc28-d713c0b9ce49 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7" status: 200 len: 1537 microversion: 2.1 time: 0.189363 Oct 19 03:15:55.611951 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 574/1104] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:55 2022] GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7 => generated 1537 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:15:55.617055 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4ddce953-82eb-44a7-8a2a-8d1e72a975d0 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:55.617732 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4ddce953-82eb-44a7-8a2a-8d1e72a975d0 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] [instance: b18ae860-ed77-4ddc-b9fa-a2aa773c2614] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:55.633045 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4ddce953-82eb-44a7-8a2a-8d1e72a975d0 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:55.633587 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4ddce953-82eb-44a7-8a2a-8d1e72a975d0 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:55.636225 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4ddce953-82eb-44a7-8a2a-8d1e72a975d0 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:55.636225 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4ddce953-82eb-44a7-8a2a-8d1e72a975d0 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:55.640370 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4ddce953-82eb-44a7-8a2a-8d1e72a975d0 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:55.640905 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4ddce953-82eb-44a7-8a2a-8d1e72a975d0 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:55.726073 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4ddce953-82eb-44a7-8a2a-8d1e72a975d0 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c1401b92c44228bd6e80dd3b786ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e388d05eac4f2babf180c0709fdc58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:55.738063 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4ddce953-82eb-44a7-8a2a-8d1e72a975d0 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] 10.222.0.52 "GET /compute/v2.1/servers/b18ae860-ed77-4ddc-b9fa-a2aa773c2614" status: 200 len: 1329 microversion: 2.1 time: 0.125239 Oct 19 03:15:55.745335 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 575/1105] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:55 2022] GET /compute/v2.1/servers/b18ae860-ed77-4ddc-b9fa-a2aa773c2614 => generated 1329 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:15:55.745335 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7fd98e3a-c3f9-4de3-b432-1cee777c4c8a tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:55.745335 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7fd98e3a-c3f9-4de3-b432-1cee777c4c8a tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:55.757607 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7fd98e3a-c3f9-4de3-b432-1cee777c4c8a tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:55.758694 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7fd98e3a-c3f9-4de3-b432-1cee777c4c8a tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:55.759214 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7fd98e3a-c3f9-4de3-b432-1cee777c4c8a tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:55.760021 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7fd98e3a-c3f9-4de3-b432-1cee777c4c8a tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:55.761811 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7fd98e3a-c3f9-4de3-b432-1cee777c4c8a tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:55.762584 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7fd98e3a-c3f9-4de3-b432-1cee777c4c8a tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:55.766349 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ab9806d4-693e-42c5-8fa7-00d0ec87f6c2 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] 10.222.0.52 "DELETE /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d" status: 204 len: 0 microversion: 2.75 time: 0.465293 Oct 19 03:15:55.769329 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 531/1106] 10.222.0.52 () {60 vars in 1280 bytes} [Wed Oct 19 03:15:55 2022] DELETE /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d => generated 0 bytes in 468 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 19 03:15:55.783134 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a6ac3dbe-ba56-415f-8a8d-df7fe20fd118 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:55.783678 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a6ac3dbe-ba56-415f-8a8d-df7fe20fd118 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] [instance: d50976fb-756b-4b12-92f2-cedf87df492d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:55.790349 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a6ac3dbe-ba56-415f-8a8d-df7fe20fd118 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:55.790855 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a6ac3dbe-ba56-415f-8a8d-df7fe20fd118 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:55.791297 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a6ac3dbe-ba56-415f-8a8d-df7fe20fd118 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:55.792068 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a6ac3dbe-ba56-415f-8a8d-df7fe20fd118 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:55.792526 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a6ac3dbe-ba56-415f-8a8d-df7fe20fd118 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:55.792956 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a6ac3dbe-ba56-415f-8a8d-df7fe20fd118 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:55.896637 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7fd98e3a-c3f9-4de3-b432-1cee777c4c8a tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:55.905984 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7fd98e3a-c3f9-4de3-b432-1cee777c4c8a tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:55.907621 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7fd98e3a-c3f9-4de3-b432-1cee777c4c8a tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:55.915217 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7fd98e3a-c3f9-4de3-b432-1cee777c4c8a tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1539 microversion: 2.91 time: 0.174796 Oct 19 03:15:55.915899 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a6ac3dbe-ba56-415f-8a8d-df7fe20fd118 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:55.927381 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a6ac3dbe-ba56-415f-8a8d-df7fe20fd118 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:55.929296 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a6ac3dbe-ba56-415f-8a8d-df7fe20fd118 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:55.931260 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 576/1107] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:55 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1539 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:15:55.939369 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a6ac3dbe-ba56-415f-8a8d-df7fe20fd118 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] 10.222.0.52 "GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d" status: 200 len: 1443 microversion: 2.75 time: 0.161285 Oct 19 03:15:55.940119 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 532/1108] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:55 2022] GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d => generated 1443 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:15:56.345674 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-68bd0cf9-1ebb-4eba-a7b7-341c9c2bb81b tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:56.346954 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-68bd0cf9-1ebb-4eba-a7b7-341c9c2bb81b tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 62133546-4a75-4532-81ab-0c49c9252e85] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:56.353585 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-68bd0cf9-1ebb-4eba-a7b7-341c9c2bb81b tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:56.354071 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-68bd0cf9-1ebb-4eba-a7b7-341c9c2bb81b tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:56.354988 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-68bd0cf9-1ebb-4eba-a7b7-341c9c2bb81b tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:56.355678 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-68bd0cf9-1ebb-4eba-a7b7-341c9c2bb81b tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:56.356127 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-68bd0cf9-1ebb-4eba-a7b7-341c9c2bb81b tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:56.356547 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-68bd0cf9-1ebb-4eba-a7b7-341c9c2bb81b tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:56.421950 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-68bd0cf9-1ebb-4eba-a7b7-341c9c2bb81b tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:56.430957 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-68bd0cf9-1ebb-4eba-a7b7-341c9c2bb81b tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:56.433083 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-68bd0cf9-1ebb-4eba-a7b7-341c9c2bb81b tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:56.434222 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-68bd0cf9-1ebb-4eba-a7b7-341c9c2bb81b tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85" status: 200 len: 1281 microversion: 2.25 time: 0.092607 Oct 19 03:15:56.434797 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 577/1109] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:56 2022] GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85 => generated 1281 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:15:56.443440 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2d92af64-dab9-4aff-85b8-86bd2f87115d tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:56.444059 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2d92af64-dab9-4aff-85b8-86bd2f87115d tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 1ee8c251-b609-4eeb-9406-ede7977b3f92] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:56.452503 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2d92af64-dab9-4aff-85b8-86bd2f87115d tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:56.453399 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2d92af64-dab9-4aff-85b8-86bd2f87115d tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:56.453840 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2d92af64-dab9-4aff-85b8-86bd2f87115d tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:56.454544 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2d92af64-dab9-4aff-85b8-86bd2f87115d tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:56.455171 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2d92af64-dab9-4aff-85b8-86bd2f87115d tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:56.455603 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2d92af64-dab9-4aff-85b8-86bd2f87115d tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:56.524046 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-2d92af64-dab9-4aff-85b8-86bd2f87115d tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:56.532522 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2d92af64-dab9-4aff-85b8-86bd2f87115d tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/1ee8c251-b609-4eeb-9406-ede7977b3f92" status: 200 len: 1221 microversion: 2.1 time: 0.093390 Oct 19 03:15:56.533418 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 533/1110] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:56 2022] GET /compute/v2.1/servers/1ee8c251-b609-4eeb-9406-ede7977b3f92 => generated 1221 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:15:56.634417 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-23263c29-7494-4cce-b47f-51cbe0e53341 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:56.635323 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-23263c29-7494-4cce-b47f-51cbe0e53341 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 9daa020d-efe7-4033-a479-cb5dadbc3ad7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:56.647583 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-23263c29-7494-4cce-b47f-51cbe0e53341 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:56.648279 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-23263c29-7494-4cce-b47f-51cbe0e53341 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:56.649421 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-23263c29-7494-4cce-b47f-51cbe0e53341 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:56.653046 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-23263c29-7494-4cce-b47f-51cbe0e53341 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:56.653568 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-23263c29-7494-4cce-b47f-51cbe0e53341 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:56.654230 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-23263c29-7494-4cce-b47f-51cbe0e53341 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:56.762015 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ddc3ea32-dde2-47f5-b8dc-f71ebc7c81bb tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:56.762994 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ddc3ea32-dde2-47f5-b8dc-f71ebc7c81bb tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] [instance: b18ae860-ed77-4ddc-b9fa-a2aa773c2614] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:56.769156 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ddc3ea32-dde2-47f5-b8dc-f71ebc7c81bb tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:56.769684 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ddc3ea32-dde2-47f5-b8dc-f71ebc7c81bb tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:56.770122 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ddc3ea32-dde2-47f5-b8dc-f71ebc7c81bb tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:56.771020 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ddc3ea32-dde2-47f5-b8dc-f71ebc7c81bb tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:56.771481 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ddc3ea32-dde2-47f5-b8dc-f71ebc7c81bb tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:56.771911 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ddc3ea32-dde2-47f5-b8dc-f71ebc7c81bb tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:56.908271 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-23263c29-7494-4cce-b47f-51cbe0e53341 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:56.916011 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-23263c29-7494-4cce-b47f-51cbe0e53341 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7" status: 200 len: 1537 microversion: 2.1 time: 0.285668 Oct 19 03:15:56.916585 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 578/1111] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:56 2022] GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7 => generated 1537 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:15:56.945714 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-21b6b3af-5ca8-451e-9728-be1c7b581ba9 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:56.946333 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-21b6b3af-5ca8-451e-9728-be1c7b581ba9 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:56.952660 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-21b6b3af-5ca8-451e-9728-be1c7b581ba9 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:56.953193 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-21b6b3af-5ca8-451e-9728-be1c7b581ba9 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:56.953624 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-21b6b3af-5ca8-451e-9728-be1c7b581ba9 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:56.954316 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-21b6b3af-5ca8-451e-9728-be1c7b581ba9 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:56.954771 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-21b6b3af-5ca8-451e-9728-be1c7b581ba9 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:56.955200 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-21b6b3af-5ca8-451e-9728-be1c7b581ba9 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:57.050020 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ddc3ea32-dde2-47f5-b8dc-f71ebc7c81bb tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c1401b92c44228bd6e80dd3b786ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e388d05eac4f2babf180c0709fdc58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:57.054080 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-21b6b3af-5ca8-451e-9728-be1c7b581ba9 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:57.058266 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ddc3ea32-dde2-47f5-b8dc-f71ebc7c81bb tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] 10.222.0.52 "GET /compute/v2.1/servers/b18ae860-ed77-4ddc-b9fa-a2aa773c2614" status: 200 len: 1395 microversion: 2.1 time: 0.300244 Oct 19 03:15:57.058852 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 534/1112] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:56 2022] GET /compute/v2.1/servers/b18ae860-ed77-4ddc-b9fa-a2aa773c2614 => generated 1395 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:15:57.062508 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-21b6b3af-5ca8-451e-9728-be1c7b581ba9 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:57.063422 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-226899be-0388-4f19-a634-da15819deb42 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:57.064024 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-226899be-0388-4f19-a634-da15819deb42 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] [instance: d50976fb-756b-4b12-92f2-cedf87df492d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:57.064675 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-21b6b3af-5ca8-451e-9728-be1c7b581ba9 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:57.070265 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-226899be-0388-4f19-a634-da15819deb42 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:57.070426 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-21b6b3af-5ca8-451e-9728-be1c7b581ba9 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1539 microversion: 2.91 time: 0.128377 Oct 19 03:15:57.071061 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-226899be-0388-4f19-a634-da15819deb42 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:57.071659 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-226899be-0388-4f19-a634-da15819deb42 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:57.072511 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-226899be-0388-4f19-a634-da15819deb42 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:57.073748 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-226899be-0388-4f19-a634-da15819deb42 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:57.074330 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-226899be-0388-4f19-a634-da15819deb42 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:57.074439 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 579/1113] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:56 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1539 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:15:57.079393 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:15:57.145123 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-226899be-0388-4f19-a634-da15819deb42 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:57.154634 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-226899be-0388-4f19-a634-da15819deb42 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:57.155569 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-226899be-0388-4f19-a634-da15819deb42 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:57.160440 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-226899be-0388-4f19-a634-da15819deb42 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] 10.222.0.52 "GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d" status: 200 len: 1443 microversion: 2.75 time: 0.100596 Oct 19 03:15:57.161016 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 535/1114] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:57 2022] GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d => generated 1443 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:15:57.462205 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-352a7683-812d-422f-ba0c-2e323a42f0e3 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:57.462830 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-352a7683-812d-422f-ba0c-2e323a42f0e3 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 62133546-4a75-4532-81ab-0c49c9252e85] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:57.468843 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-352a7683-812d-422f-ba0c-2e323a42f0e3 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:57.469337 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-352a7683-812d-422f-ba0c-2e323a42f0e3 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:57.469813 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-352a7683-812d-422f-ba0c-2e323a42f0e3 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:57.470533 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-352a7683-812d-422f-ba0c-2e323a42f0e3 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:57.471018 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-352a7683-812d-422f-ba0c-2e323a42f0e3 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:57.471445 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-352a7683-812d-422f-ba0c-2e323a42f0e3 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:57.532795 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-352a7683-812d-422f-ba0c-2e323a42f0e3 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:57.541206 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-352a7683-812d-422f-ba0c-2e323a42f0e3 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:57.542644 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-352a7683-812d-422f-ba0c-2e323a42f0e3 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:57.543984 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-352a7683-812d-422f-ba0c-2e323a42f0e3 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85" status: 200 len: 1337 microversion: 2.25 time: 0.085497 Oct 19 03:15:57.544565 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 580/1115] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:57 2022] GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85 => generated 1337 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:15:57.555911 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-dad95d14-630a-4afd-b863-7e67a7c96aef tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:57.557098 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-dad95d14-630a-4afd-b863-7e67a7c96aef tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 1ee8c251-b609-4eeb-9406-ede7977b3f92] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:57.564466 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dad95d14-630a-4afd-b863-7e67a7c96aef tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:57.566472 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dad95d14-630a-4afd-b863-7e67a7c96aef tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:57.566472 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dad95d14-630a-4afd-b863-7e67a7c96aef tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:57.566472 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dad95d14-630a-4afd-b863-7e67a7c96aef tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:57.567174 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dad95d14-630a-4afd-b863-7e67a7c96aef tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:57.567615 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dad95d14-630a-4afd-b863-7e67a7c96aef tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:57.630795 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-dad95d14-630a-4afd-b863-7e67a7c96aef tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:57.639669 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-dad95d14-630a-4afd-b863-7e67a7c96aef tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/1ee8c251-b609-4eeb-9406-ede7977b3f92" status: 200 len: 1221 microversion: 2.1 time: 0.087610 Oct 19 03:15:57.646731 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 536/1116] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:57 2022] GET /compute/v2.1/servers/1ee8c251-b609-4eeb-9406-ede7977b3f92 => generated 1221 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:15:57.939498 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1b001e0d-29fa-4515-9441-6f1825181484 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:57.940094 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1b001e0d-29fa-4515-9441-6f1825181484 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 9daa020d-efe7-4033-a479-cb5dadbc3ad7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:57.946353 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1b001e0d-29fa-4515-9441-6f1825181484 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:57.946845 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1b001e0d-29fa-4515-9441-6f1825181484 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:57.947287 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1b001e0d-29fa-4515-9441-6f1825181484 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:57.947989 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1b001e0d-29fa-4515-9441-6f1825181484 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:57.948445 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1b001e0d-29fa-4515-9441-6f1825181484 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:57.948873 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1b001e0d-29fa-4515-9441-6f1825181484 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:58.083269 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c559a5ef-6a02-4463-a606-a02137256028 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:58.085332 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c559a5ef-6a02-4463-a606-a02137256028 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] [instance: b18ae860-ed77-4ddc-b9fa-a2aa773c2614] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:58.100351 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c559a5ef-6a02-4463-a606-a02137256028 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:58.101839 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-1b001e0d-29fa-4515-9441-6f1825181484 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:58.102521 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c559a5ef-6a02-4463-a606-a02137256028 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:58.103174 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c559a5ef-6a02-4463-a606-a02137256028 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:58.106057 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c559a5ef-6a02-4463-a606-a02137256028 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:58.110107 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c559a5ef-6a02-4463-a606-a02137256028 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:58.111997 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c559a5ef-6a02-4463-a606-a02137256028 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:58.113149 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1b001e0d-29fa-4515-9441-6f1825181484 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7" status: 200 len: 1542 microversion: 2.1 time: 0.177516 Oct 19 03:15:58.122205 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 581/1117] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:57 2022] GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7 => generated 1542 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:15:58.128577 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-76ec5dfe-c8e2-4801-940d-636c2f03c788 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:58.129680 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-76ec5dfe-c8e2-4801-940d-636c2f03c788 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:58.137655 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-76ec5dfe-c8e2-4801-940d-636c2f03c788 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:58.138420 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-76ec5dfe-c8e2-4801-940d-636c2f03c788 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:58.138936 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-76ec5dfe-c8e2-4801-940d-636c2f03c788 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:58.139840 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-76ec5dfe-c8e2-4801-940d-636c2f03c788 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:58.140423 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-76ec5dfe-c8e2-4801-940d-636c2f03c788 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:58.140977 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-76ec5dfe-c8e2-4801-940d-636c2f03c788 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:58.240652 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-76ec5dfe-c8e2-4801-940d-636c2f03c788 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:58.253067 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-76ec5dfe-c8e2-4801-940d-636c2f03c788 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:58.254957 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-76ec5dfe-c8e2-4801-940d-636c2f03c788 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:58.261086 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-76ec5dfe-c8e2-4801-940d-636c2f03c788 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1539 microversion: 2.91 time: 0.137486 Oct 19 03:15:58.261729 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 582/1118] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:58 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1539 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:15:58.270682 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-58a0a9ba-c456-4586-b84f-d918b142a5aa tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:58.271327 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-58a0a9ba-c456-4586-b84f-d918b142a5aa tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] [instance: d50976fb-756b-4b12-92f2-cedf87df492d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:58.278158 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-58a0a9ba-c456-4586-b84f-d918b142a5aa tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:58.278749 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-58a0a9ba-c456-4586-b84f-d918b142a5aa tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:58.279331 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-58a0a9ba-c456-4586-b84f-d918b142a5aa tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:58.280030 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-58a0a9ba-c456-4586-b84f-d918b142a5aa tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:58.280487 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-58a0a9ba-c456-4586-b84f-d918b142a5aa tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:58.281022 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-58a0a9ba-c456-4586-b84f-d918b142a5aa tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:58.358698 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-58a0a9ba-c456-4586-b84f-d918b142a5aa tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:58.365846 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c559a5ef-6a02-4463-a606-a02137256028 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c1401b92c44228bd6e80dd3b786ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e388d05eac4f2babf180c0709fdc58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:58.368225 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-58a0a9ba-c456-4586-b84f-d918b142a5aa tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:58.369803 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-58a0a9ba-c456-4586-b84f-d918b142a5aa tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:58.375233 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-58a0a9ba-c456-4586-b84f-d918b142a5aa tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] 10.222.0.52 "GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d" status: 200 len: 1443 microversion: 2.75 time: 0.112227 Oct 19 03:15:58.375850 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 583/1119] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:58 2022] GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d => generated 1443 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:15:58.377001 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c559a5ef-6a02-4463-a606-a02137256028 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] 10.222.0.52 "GET /compute/v2.1/servers/b18ae860-ed77-4ddc-b9fa-a2aa773c2614" status: 200 len: 1395 microversion: 2.1 time: 0.299141 Oct 19 03:15:58.389525 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 537/1120] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:58 2022] GET /compute/v2.1/servers/b18ae860-ed77-4ddc-b9fa-a2aa773c2614 => generated 1395 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:15:58.389667 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-df7e4c83-0fe9-4720-b3c2-d13aba2213c3 req-e6ee1dcb-e02c-4e35-b7e4-f8d7412c5034 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b18ae860-ed77-4ddc-b9fa-a2aa773c2614", "tag": "a42ed099-3fb2-4b70-8cb8-870751bbcc54"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:15:58.393528 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-df7e4c83-0fe9-4720-b3c2-d13aba2213c3 req-e6ee1dcb-e02c-4e35-b7e4-f8d7412c5034 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:58.394095 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-df7e4c83-0fe9-4720-b3c2-d13aba2213c3 req-e6ee1dcb-e02c-4e35-b7e4-f8d7412c5034 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:58.394550 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-df7e4c83-0fe9-4720-b3c2-d13aba2213c3 req-e6ee1dcb-e02c-4e35-b7e4-f8d7412c5034 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:58.412343 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-df7e4c83-0fe9-4720-b3c2-d13aba2213c3 req-e6ee1dcb-e02c-4e35-b7e4-f8d7412c5034 service nova] Creating event network-changed:a42ed099-3fb2-4b70-8cb8-870751bbcc54 for instance b18ae860-ed77-4ddc-b9fa-a2aa773c2614 on n-h1-861333-8 Oct 19 03:15:58.417333 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-df7e4c83-0fe9-4720-b3c2-d13aba2213c3 req-e6ee1dcb-e02c-4e35-b7e4-f8d7412c5034 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040363 Oct 19 03:15:58.417945 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 584/1121] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:15:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:15:58.569716 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-962ab843-402a-450c-be56-5f63da0d0f6a tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:58.570334 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-962ab843-402a-450c-be56-5f63da0d0f6a tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 62133546-4a75-4532-81ab-0c49c9252e85] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:58.577657 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-962ab843-402a-450c-be56-5f63da0d0f6a tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:58.578146 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-962ab843-402a-450c-be56-5f63da0d0f6a tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:58.578587 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-962ab843-402a-450c-be56-5f63da0d0f6a tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:58.579285 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-962ab843-402a-450c-be56-5f63da0d0f6a tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:58.579746 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-962ab843-402a-450c-be56-5f63da0d0f6a tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:58.580174 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-962ab843-402a-450c-be56-5f63da0d0f6a tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:58.640847 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-962ab843-402a-450c-be56-5f63da0d0f6a tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:58.649183 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-962ab843-402a-450c-be56-5f63da0d0f6a tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:58.650652 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-962ab843-402a-450c-be56-5f63da0d0f6a tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:58.652438 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-962ab843-402a-450c-be56-5f63da0d0f6a tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85" status: 200 len: 1337 microversion: 2.25 time: 0.086757 Oct 19 03:15:58.653004 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 538/1122] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:58 2022] GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85 => generated 1337 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:15:58.663564 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9e82ab8e-73bf-479c-b448-9d3f0b38173f tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:58.664348 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9e82ab8e-73bf-479c-b448-9d3f0b38173f tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 1ee8c251-b609-4eeb-9406-ede7977b3f92] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:58.670575 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9e82ab8e-73bf-479c-b448-9d3f0b38173f tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:58.671064 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9e82ab8e-73bf-479c-b448-9d3f0b38173f tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:58.671511 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9e82ab8e-73bf-479c-b448-9d3f0b38173f tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:58.672208 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9e82ab8e-73bf-479c-b448-9d3f0b38173f tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:58.672668 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9e82ab8e-73bf-479c-b448-9d3f0b38173f tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:58.673135 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9e82ab8e-73bf-479c-b448-9d3f0b38173f tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:58.734786 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-9e82ab8e-73bf-479c-b448-9d3f0b38173f tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:58.742251 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9e82ab8e-73bf-479c-b448-9d3f0b38173f tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/1ee8c251-b609-4eeb-9406-ede7977b3f92" status: 200 len: 1213 microversion: 2.1 time: 0.082870 Oct 19 03:15:58.742823 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 585/1123] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:58 2022] GET /compute/v2.1/servers/1ee8c251-b609-4eeb-9406-ede7977b3f92 => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:15:59.138257 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8be8cb1c-c0ed-4c91-a16e-ec7c40350793 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:59.139033 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8be8cb1c-c0ed-4c91-a16e-ec7c40350793 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 9daa020d-efe7-4033-a479-cb5dadbc3ad7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:59.145295 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8be8cb1c-c0ed-4c91-a16e-ec7c40350793 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:59.146157 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8be8cb1c-c0ed-4c91-a16e-ec7c40350793 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:59.146788 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8be8cb1c-c0ed-4c91-a16e-ec7c40350793 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:59.147647 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8be8cb1c-c0ed-4c91-a16e-ec7c40350793 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:59.148255 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8be8cb1c-c0ed-4c91-a16e-ec7c40350793 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:59.148961 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8be8cb1c-c0ed-4c91-a16e-ec7c40350793 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:59.290157 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3e3e6b98-f54a-4848-8a5c-54a000559c8b tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:59.291183 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-3e3e6b98-f54a-4848-8a5c-54a000559c8b tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:59.298724 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3e3e6b98-f54a-4848-8a5c-54a000559c8b tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:59.299486 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3e3e6b98-f54a-4848-8a5c-54a000559c8b tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:59.300099 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3e3e6b98-f54a-4848-8a5c-54a000559c8b tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:59.301198 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3e3e6b98-f54a-4848-8a5c-54a000559c8b tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:59.301854 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3e3e6b98-f54a-4848-8a5c-54a000559c8b tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:59.302458 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3e3e6b98-f54a-4848-8a5c-54a000559c8b tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:59.569234 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-3e3e6b98-f54a-4848-8a5c-54a000559c8b tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:59.579068 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-3e3e6b98-f54a-4848-8a5c-54a000559c8b tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:59.580246 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-3e3e6b98-f54a-4848-8a5c-54a000559c8b tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:59.585987 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-3e3e6b98-f54a-4848-8a5c-54a000559c8b tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1539 microversion: 2.91 time: 0.300319 Oct 19 03:15:59.586961 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 586/1124] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:59 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1539 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:15:59.592444 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b14e1d34-ff4e-47e3-afdb-425ddee762ff tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:59.593129 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b14e1d34-ff4e-47e3-afdb-425ddee762ff tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] [instance: b18ae860-ed77-4ddc-b9fa-a2aa773c2614] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:59.599395 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b14e1d34-ff4e-47e3-afdb-425ddee762ff tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:59.600119 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b14e1d34-ff4e-47e3-afdb-425ddee762ff tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:59.600637 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b14e1d34-ff4e-47e3-afdb-425ddee762ff tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:59.601719 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b14e1d34-ff4e-47e3-afdb-425ddee762ff tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:59.602247 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b14e1d34-ff4e-47e3-afdb-425ddee762ff tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:59.602788 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b14e1d34-ff4e-47e3-afdb-425ddee762ff tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:59.734106 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8be8cb1c-c0ed-4c91-a16e-ec7c40350793 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:59.740097 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8be8cb1c-c0ed-4c91-a16e-ec7c40350793 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7" status: 200 len: 1542 microversion: 2.1 time: 0.606784 Oct 19 03:15:59.751436 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 539/1125] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:59 2022] GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7 => generated 1542 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:15:59.758024 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ee34f689-e268-47e0-9d68-1e11da46a583 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:59.761865 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ee34f689-e268-47e0-9d68-1e11da46a583 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] [instance: d50976fb-756b-4b12-92f2-cedf87df492d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:59.770285 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ee34f689-e268-47e0-9d68-1e11da46a583 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:59.770789 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ee34f689-e268-47e0-9d68-1e11da46a583 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:59.771269 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ee34f689-e268-47e0-9d68-1e11da46a583 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:59.771929 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ee34f689-e268-47e0-9d68-1e11da46a583 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:59.772384 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ee34f689-e268-47e0-9d68-1e11da46a583 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:59.772819 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ee34f689-e268-47e0-9d68-1e11da46a583 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:59.820303 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ee34f689-e268-47e0-9d68-1e11da46a583 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:59.820972 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ee34f689-e268-47e0-9d68-1e11da46a583 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:59.821838 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ee34f689-e268-47e0-9d68-1e11da46a583 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:59.822321 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-ee34f689-e268-47e0-9d68-1e11da46a583 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lazy-loading 'fault' on Instance uuid d50976fb-756b-4b12-92f2-cedf87df492d {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:15:59.882251 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b14e1d34-ff4e-47e3-afdb-425ddee762ff tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c1401b92c44228bd6e80dd3b786ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e388d05eac4f2babf180c0709fdc58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:59.885046 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ee34f689-e268-47e0-9d68-1e11da46a583 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:59.891064 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b14e1d34-ff4e-47e3-afdb-425ddee762ff tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] 10.222.0.52 "GET /compute/v2.1/servers/b18ae860-ed77-4ddc-b9fa-a2aa773c2614" status: 200 len: 1395 microversion: 2.1 time: 0.303134 Oct 19 03:15:59.891947 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 587/1126] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:59 2022] GET /compute/v2.1/servers/b18ae860-ed77-4ddc-b9fa-a2aa773c2614 => generated 1395 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:15:59.895922 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ee34f689-e268-47e0-9d68-1e11da46a583 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:59.896503 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f23d33e2-97d1-4799-8c4a-c727677f4c35 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:59.900231 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f23d33e2-97d1-4799-8c4a-c727677f4c35 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 62133546-4a75-4532-81ab-0c49c9252e85] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:59.900344 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ee34f689-e268-47e0-9d68-1e11da46a583 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:15:59.904463 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f23d33e2-97d1-4799-8c4a-c727677f4c35 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:59.904973 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ee34f689-e268-47e0-9d68-1e11da46a583 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] 10.222.0.52 "GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d" status: 200 len: 1448 microversion: 2.75 time: 0.151530 Oct 19 03:15:59.905439 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f23d33e2-97d1-4799-8c4a-c727677f4c35 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:59.905897 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f23d33e2-97d1-4799-8c4a-c727677f4c35 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:59.906583 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 540/1127] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:59 2022] GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d => generated 1448 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:15:59.912280 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-226dbd4a-4a33-4d7c-adf9-4f215ba598aa tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:15:59.912989 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-226dbd4a-4a33-4d7c-adf9-4f215ba598aa tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 1ee8c251-b609-4eeb-9406-ede7977b3f92] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:15:59.913933 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f23d33e2-97d1-4799-8c4a-c727677f4c35 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:59.914934 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f23d33e2-97d1-4799-8c4a-c727677f4c35 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:59.915594 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f23d33e2-97d1-4799-8c4a-c727677f4c35 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:59.920187 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-226dbd4a-4a33-4d7c-adf9-4f215ba598aa tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:59.921202 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-226dbd4a-4a33-4d7c-adf9-4f215ba598aa tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:59.921753 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-226dbd4a-4a33-4d7c-adf9-4f215ba598aa tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:15:59.922661 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-226dbd4a-4a33-4d7c-adf9-4f215ba598aa tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:15:59.923939 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-226dbd4a-4a33-4d7c-adf9-4f215ba598aa tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:15:59.924603 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-226dbd4a-4a33-4d7c-adf9-4f215ba598aa tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:00.016523 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-226dbd4a-4a33-4d7c-adf9-4f215ba598aa tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:00.032331 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-226dbd4a-4a33-4d7c-adf9-4f215ba598aa tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/1ee8c251-b609-4eeb-9406-ede7977b3f92" status: 200 len: 1269 microversion: 2.1 time: 0.124374 Oct 19 03:16:00.033101 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 541/1128] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:15:59 2022] GET /compute/v2.1/servers/1ee8c251-b609-4eeb-9406-ede7977b3f92 => generated 1269 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:16:00.195172 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f23d33e2-97d1-4799-8c4a-c727677f4c35 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:00.209552 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f23d33e2-97d1-4799-8c4a-c727677f4c35 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:00.211568 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f23d33e2-97d1-4799-8c4a-c727677f4c35 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:00.214788 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f23d33e2-97d1-4799-8c4a-c727677f4c35 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85" status: 200 len: 1410 microversion: 2.25 time: 0.320033 Oct 19 03:16:00.229423 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 588/1129] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:15:59 2022] GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85 => generated 1410 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:16:00.622978 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ba8dc6b4-af71-4f79-b352-f7aa4e1a0495 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:00.623702 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ba8dc6b4-af71-4f79-b352-f7aa4e1a0495 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:00.632695 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ba8dc6b4-af71-4f79-b352-f7aa4e1a0495 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:00.633441 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ba8dc6b4-af71-4f79-b352-f7aa4e1a0495 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:00.633907 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ba8dc6b4-af71-4f79-b352-f7aa4e1a0495 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:00.634738 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ba8dc6b4-af71-4f79-b352-f7aa4e1a0495 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:00.636146 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ba8dc6b4-af71-4f79-b352-f7aa4e1a0495 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:00.636914 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ba8dc6b4-af71-4f79-b352-f7aa4e1a0495 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:00.703932 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ba8dc6b4-af71-4f79-b352-f7aa4e1a0495 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:00.712090 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ba8dc6b4-af71-4f79-b352-f7aa4e1a0495 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:00.713627 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ba8dc6b4-af71-4f79-b352-f7aa4e1a0495 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:00.718384 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ba8dc6b4-af71-4f79-b352-f7aa4e1a0495 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1539 microversion: 2.91 time: 0.099894 Oct 19 03:16:00.719245 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 542/1130] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:16:00 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1539 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:16:00.764597 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2d877470-249d-48bd-873e-209b0b6d82e3 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:00.765509 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-2d877470-249d-48bd-873e-209b0b6d82e3 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 9daa020d-efe7-4033-a479-cb5dadbc3ad7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:00.771724 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2d877470-249d-48bd-873e-209b0b6d82e3 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:00.772221 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2d877470-249d-48bd-873e-209b0b6d82e3 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:00.772659 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2d877470-249d-48bd-873e-209b0b6d82e3 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:00.773533 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2d877470-249d-48bd-873e-209b0b6d82e3 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:00.773995 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2d877470-249d-48bd-873e-209b0b6d82e3 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:00.774430 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2d877470-249d-48bd-873e-209b0b6d82e3 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:00.850080 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-2c462fac-00e9-4d69-9f1b-9b2a39eb19d3 req-5fbdad05-f938-4f05-ba52-d8df7aef1b52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62133546-4a75-4532-81ab-0c49c9252e85", "tag": "00532cca-3534-4784-9094-66d340359b0e"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:16:00.860922 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-2c462fac-00e9-4d69-9f1b-9b2a39eb19d3 req-5fbdad05-f938-4f05-ba52-d8df7aef1b52 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:00.862127 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-2c462fac-00e9-4d69-9f1b-9b2a39eb19d3 req-5fbdad05-f938-4f05-ba52-d8df7aef1b52 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:00.862638 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-2c462fac-00e9-4d69-9f1b-9b2a39eb19d3 req-5fbdad05-f938-4f05-ba52-d8df7aef1b52 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:00.875684 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-2c462fac-00e9-4d69-9f1b-9b2a39eb19d3 req-5fbdad05-f938-4f05-ba52-d8df7aef1b52 service nova] Creating event network-changed:00532cca-3534-4784-9094-66d340359b0e for instance 62133546-4a75-4532-81ab-0c49c9252e85 on n-h1-861333-8 Oct 19 03:16:00.881046 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-2c462fac-00e9-4d69-9f1b-9b2a39eb19d3 req-5fbdad05-f938-4f05-ba52-d8df7aef1b52 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034705 Oct 19 03:16:00.881928 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 543/1131] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:16:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:16:00.906512 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-2d877470-249d-48bd-873e-209b0b6d82e3 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:00.914627 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2d877470-249d-48bd-873e-209b0b6d82e3 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7" status: 200 len: 1542 microversion: 2.1 time: 0.155937 Oct 19 03:16:00.921887 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 589/1132] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:00 2022] GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7 => generated 1542 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:16:00.922007 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-235ffd6e-5566-4518-9bef-669cc8daaf26 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:00.922007 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-235ffd6e-5566-4518-9bef-669cc8daaf26 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] [instance: b18ae860-ed77-4ddc-b9fa-a2aa773c2614] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:00.924469 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-235ffd6e-5566-4518-9bef-669cc8daaf26 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:00.924956 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-235ffd6e-5566-4518-9bef-669cc8daaf26 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:00.925423 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-235ffd6e-5566-4518-9bef-669cc8daaf26 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:00.926123 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-235ffd6e-5566-4518-9bef-669cc8daaf26 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:00.926579 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-235ffd6e-5566-4518-9bef-669cc8daaf26 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:00.927007 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-235ffd6e-5566-4518-9bef-669cc8daaf26 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:00.936313 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-340327f2-dc2f-4bf5-b3ba-fec61b0db453 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:00.940370 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-340327f2-dc2f-4bf5-b3ba-fec61b0db453 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] [instance: d50976fb-756b-4b12-92f2-cedf87df492d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:00.943305 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-340327f2-dc2f-4bf5-b3ba-fec61b0db453 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:00.943830 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-340327f2-dc2f-4bf5-b3ba-fec61b0db453 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:00.944269 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-340327f2-dc2f-4bf5-b3ba-fec61b0db453 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:00.944997 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-340327f2-dc2f-4bf5-b3ba-fec61b0db453 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:00.945476 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-340327f2-dc2f-4bf5-b3ba-fec61b0db453 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:00.945903 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-340327f2-dc2f-4bf5-b3ba-fec61b0db453 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:00.980314 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-340327f2-dc2f-4bf5-b3ba-fec61b0db453 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:00.980839 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-340327f2-dc2f-4bf5-b3ba-fec61b0db453 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:00.981277 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-340327f2-dc2f-4bf5-b3ba-fec61b0db453 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:00.981800 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-340327f2-dc2f-4bf5-b3ba-fec61b0db453 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lazy-loading 'fault' on Instance uuid d50976fb-756b-4b12-92f2-cedf87df492d {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:16:01.030650 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-340327f2-dc2f-4bf5-b3ba-fec61b0db453 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:01.038810 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-340327f2-dc2f-4bf5-b3ba-fec61b0db453 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:01.040265 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-340327f2-dc2f-4bf5-b3ba-fec61b0db453 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:01.045254 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-340327f2-dc2f-4bf5-b3ba-fec61b0db453 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] 10.222.0.52 "GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d" status: 200 len: 1448 microversion: 2.75 time: 0.113452 Oct 19 03:16:01.045902 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 590/1133] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:16:00 2022] GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d => generated 1448 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:16:01.059546 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-71a87225-1a27-4282-bce8-02aba65e79bf tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:01.060198 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-71a87225-1a27-4282-bce8-02aba65e79bf tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 1ee8c251-b609-4eeb-9406-ede7977b3f92] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:01.066268 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-71a87225-1a27-4282-bce8-02aba65e79bf tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:01.066761 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-71a87225-1a27-4282-bce8-02aba65e79bf tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:01.067203 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-71a87225-1a27-4282-bce8-02aba65e79bf tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:01.067896 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-71a87225-1a27-4282-bce8-02aba65e79bf tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:01.068354 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-71a87225-1a27-4282-bce8-02aba65e79bf tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:01.068785 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-71a87225-1a27-4282-bce8-02aba65e79bf tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:01.072949 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=100 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:16:01.087029 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-235ffd6e-5566-4518-9bef-669cc8daaf26 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c1401b92c44228bd6e80dd3b786ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e388d05eac4f2babf180c0709fdc58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:01.095456 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-235ffd6e-5566-4518-9bef-669cc8daaf26 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] 10.222.0.52 "GET /compute/v2.1/servers/b18ae860-ed77-4ddc-b9fa-a2aa773c2614" status: 200 len: 1395 microversion: 2.1 time: 0.182758 Oct 19 03:16:01.095966 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 544/1134] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:00 2022] GET /compute/v2.1/servers/b18ae860-ed77-4ddc-b9fa-a2aa773c2614 => generated 1395 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:16:01.130691 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-71a87225-1a27-4282-bce8-02aba65e79bf tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:01.139152 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-71a87225-1a27-4282-bce8-02aba65e79bf tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/1ee8c251-b609-4eeb-9406-ede7977b3f92" status: 200 len: 1277 microversion: 2.1 time: 0.083796 Oct 19 03:16:01.139726 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 591/1135] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:01 2022] GET /compute/v2.1/servers/1ee8c251-b609-4eeb-9406-ede7977b3f92 => generated 1277 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:16:01.240071 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a4e8bb4e-60f3-454a-bc39-82e9602244d2 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:01.240687 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a4e8bb4e-60f3-454a-bc39-82e9602244d2 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 62133546-4a75-4532-81ab-0c49c9252e85] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:01.247265 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a4e8bb4e-60f3-454a-bc39-82e9602244d2 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:01.247750 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a4e8bb4e-60f3-454a-bc39-82e9602244d2 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:01.248192 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a4e8bb4e-60f3-454a-bc39-82e9602244d2 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:01.248881 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a4e8bb4e-60f3-454a-bc39-82e9602244d2 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:01.249337 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a4e8bb4e-60f3-454a-bc39-82e9602244d2 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:01.249795 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a4e8bb4e-60f3-454a-bc39-82e9602244d2 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:01.377232 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a4e8bb4e-60f3-454a-bc39-82e9602244d2 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:01.385237 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a4e8bb4e-60f3-454a-bc39-82e9602244d2 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:01.387916 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a4e8bb4e-60f3-454a-bc39-82e9602244d2 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:01.389026 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a4e8bb4e-60f3-454a-bc39-82e9602244d2 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85" status: 200 len: 1410 microversion: 2.25 time: 0.152926 Oct 19 03:16:01.389615 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 545/1136] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:16:01 2022] GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85 => generated 1410 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:16:01.746972 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-70a56e1d-33cb-46c6-bbab-3cf7a729f061 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:01.747591 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-70a56e1d-33cb-46c6-bbab-3cf7a729f061 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:01.753601 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-70a56e1d-33cb-46c6-bbab-3cf7a729f061 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:01.754126 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-70a56e1d-33cb-46c6-bbab-3cf7a729f061 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:01.754569 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-70a56e1d-33cb-46c6-bbab-3cf7a729f061 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:01.755263 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-70a56e1d-33cb-46c6-bbab-3cf7a729f061 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:01.755722 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-70a56e1d-33cb-46c6-bbab-3cf7a729f061 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:01.756157 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-70a56e1d-33cb-46c6-bbab-3cf7a729f061 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:01.819989 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-70a56e1d-33cb-46c6-bbab-3cf7a729f061 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:01.828150 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-70a56e1d-33cb-46c6-bbab-3cf7a729f061 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:01.829624 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-70a56e1d-33cb-46c6-bbab-3cf7a729f061 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:01.834404 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-70a56e1d-33cb-46c6-bbab-3cf7a729f061 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1539 microversion: 2.91 time: 0.092046 Oct 19 03:16:01.835049 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 592/1137] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:16:01 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1539 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:16:01.938179 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3b963cf9-ddce-4438-bf79-0842b3d03c52 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:01.938792 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3b963cf9-ddce-4438-bf79-0842b3d03c52 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 9daa020d-efe7-4033-a479-cb5dadbc3ad7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:01.945540 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3b963cf9-ddce-4438-bf79-0842b3d03c52 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:01.946026 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3b963cf9-ddce-4438-bf79-0842b3d03c52 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:01.946465 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3b963cf9-ddce-4438-bf79-0842b3d03c52 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:01.947162 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3b963cf9-ddce-4438-bf79-0842b3d03c52 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:01.947617 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3b963cf9-ddce-4438-bf79-0842b3d03c52 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:01.948046 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3b963cf9-ddce-4438-bf79-0842b3d03c52 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:02.072199 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-61bb5424-0558-4af9-b77d-e7ab58cb154a tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:02.074173 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-61bb5424-0558-4af9-b77d-e7ab58cb154a tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] [instance: d50976fb-756b-4b12-92f2-cedf87df492d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:02.076341 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-3b963cf9-ddce-4438-bf79-0842b3d03c52 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:02.079839 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-61bb5424-0558-4af9-b77d-e7ab58cb154a tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:02.080333 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-61bb5424-0558-4af9-b77d-e7ab58cb154a tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:02.080775 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-61bb5424-0558-4af9-b77d-e7ab58cb154a tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:02.081733 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-61bb5424-0558-4af9-b77d-e7ab58cb154a tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:02.082189 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-61bb5424-0558-4af9-b77d-e7ab58cb154a tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:02.082617 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-61bb5424-0558-4af9-b77d-e7ab58cb154a tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:02.084488 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3b963cf9-ddce-4438-bf79-0842b3d03c52 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7" status: 200 len: 1542 microversion: 2.1 time: 0.150176 Oct 19 03:16:02.085444 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 546/1138] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:01 2022] GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7 => generated 1542 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:16:02.117840 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a3509872-e7a6-488a-bc87-d6278a238964 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:02.118082 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-61bb5424-0558-4af9-b77d-e7ab58cb154a tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:02.118459 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a3509872-e7a6-488a-bc87-d6278a238964 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] [instance: b18ae860-ed77-4ddc-b9fa-a2aa773c2614] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:02.118573 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-61bb5424-0558-4af9-b77d-e7ab58cb154a tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:02.118993 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-61bb5424-0558-4af9-b77d-e7ab58cb154a tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:02.119438 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-61bb5424-0558-4af9-b77d-e7ab58cb154a tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lazy-loading 'fault' on Instance uuid d50976fb-756b-4b12-92f2-cedf87df492d {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:16:02.124824 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a3509872-e7a6-488a-bc87-d6278a238964 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:02.125310 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a3509872-e7a6-488a-bc87-d6278a238964 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:02.125782 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a3509872-e7a6-488a-bc87-d6278a238964 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:02.126473 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a3509872-e7a6-488a-bc87-d6278a238964 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:02.126923 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a3509872-e7a6-488a-bc87-d6278a238964 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:02.127352 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a3509872-e7a6-488a-bc87-d6278a238964 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:02.175366 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-61bb5424-0558-4af9-b77d-e7ab58cb154a tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:02.184054 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-61bb5424-0558-4af9-b77d-e7ab58cb154a tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:02.185514 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-61bb5424-0558-4af9-b77d-e7ab58cb154a tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:02.190468 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-61bb5424-0558-4af9-b77d-e7ab58cb154a tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] 10.222.0.52 "GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d" status: 200 len: 1448 microversion: 2.75 time: 0.122232 Oct 19 03:16:02.191052 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 593/1139] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:16:02 2022] GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d => generated 1448 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:16:02.195945 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-34de57bf-bd41-44cc-911b-c2804e17c2c3 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:02.200112 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-34de57bf-bd41-44cc-911b-c2804e17c2c3 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 1ee8c251-b609-4eeb-9406-ede7977b3f92] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:02.202439 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-34de57bf-bd41-44cc-911b-c2804e17c2c3 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:02.202930 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-34de57bf-bd41-44cc-911b-c2804e17c2c3 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:02.203363 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-34de57bf-bd41-44cc-911b-c2804e17c2c3 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:02.204063 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-34de57bf-bd41-44cc-911b-c2804e17c2c3 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:02.204567 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-34de57bf-bd41-44cc-911b-c2804e17c2c3 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:02.204994 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-34de57bf-bd41-44cc-911b-c2804e17c2c3 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:02.272308 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-34de57bf-bd41-44cc-911b-c2804e17c2c3 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:02.279993 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-34de57bf-bd41-44cc-911b-c2804e17c2c3 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/1ee8c251-b609-4eeb-9406-ede7977b3f92" status: 200 len: 1277 microversion: 2.1 time: 0.087913 Oct 19 03:16:02.282760 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 594/1140] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:02 2022] GET /compute/v2.1/servers/1ee8c251-b609-4eeb-9406-ede7977b3f92 => generated 1277 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:16:02.283387 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a3509872-e7a6-488a-bc87-d6278a238964 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c1401b92c44228bd6e80dd3b786ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e388d05eac4f2babf180c0709fdc58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:02.291252 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a3509872-e7a6-488a-bc87-d6278a238964 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] 10.222.0.52 "GET /compute/v2.1/servers/b18ae860-ed77-4ddc-b9fa-a2aa773c2614" status: 200 len: 1395 microversion: 2.1 time: 0.177399 Oct 19 03:16:02.292406 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 547/1141] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:02 2022] GET /compute/v2.1/servers/b18ae860-ed77-4ddc-b9fa-a2aa773c2614 => generated 1395 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:16:02.413675 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d3eca27b-1703-475d-aad6-a1c28f17a9ba tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:02.414287 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d3eca27b-1703-475d-aad6-a1c28f17a9ba tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 62133546-4a75-4532-81ab-0c49c9252e85] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:02.420985 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d3eca27b-1703-475d-aad6-a1c28f17a9ba tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:02.421506 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d3eca27b-1703-475d-aad6-a1c28f17a9ba tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:02.421948 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d3eca27b-1703-475d-aad6-a1c28f17a9ba tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:02.422644 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d3eca27b-1703-475d-aad6-a1c28f17a9ba tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:02.423103 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d3eca27b-1703-475d-aad6-a1c28f17a9ba tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:02.423533 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d3eca27b-1703-475d-aad6-a1c28f17a9ba tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:02.554352 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d3eca27b-1703-475d-aad6-a1c28f17a9ba tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:02.562515 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d3eca27b-1703-475d-aad6-a1c28f17a9ba tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:02.564025 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d3eca27b-1703-475d-aad6-a1c28f17a9ba tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:02.565138 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d3eca27b-1703-475d-aad6-a1c28f17a9ba tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85" status: 200 len: 1410 microversion: 2.25 time: 0.155443 Oct 19 03:16:02.565742 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 595/1142] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:16:02 2022] GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85 => generated 1410 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:16:02.863223 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-65cb31c3-1f5f-4ea7-90ac-9c5d93d00830 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:02.863819 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-65cb31c3-1f5f-4ea7-90ac-9c5d93d00830 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:02.869875 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-65cb31c3-1f5f-4ea7-90ac-9c5d93d00830 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:02.870362 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-65cb31c3-1f5f-4ea7-90ac-9c5d93d00830 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:02.870803 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-65cb31c3-1f5f-4ea7-90ac-9c5d93d00830 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:02.871494 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-65cb31c3-1f5f-4ea7-90ac-9c5d93d00830 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:02.871949 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-65cb31c3-1f5f-4ea7-90ac-9c5d93d00830 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:02.872377 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-65cb31c3-1f5f-4ea7-90ac-9c5d93d00830 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:02.937275 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-65cb31c3-1f5f-4ea7-90ac-9c5d93d00830 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:02.946328 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-65cb31c3-1f5f-4ea7-90ac-9c5d93d00830 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:02.948304 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-65cb31c3-1f5f-4ea7-90ac-9c5d93d00830 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:02.953199 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-65cb31c3-1f5f-4ea7-90ac-9c5d93d00830 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1539 microversion: 2.91 time: 0.093985 Oct 19 03:16:02.953809 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 548/1143] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:16:02 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1539 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:16:03.107864 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c85f344f-3ce9-49fb-8b33-15d2093c0f28 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:03.108481 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c85f344f-3ce9-49fb-8b33-15d2093c0f28 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 9daa020d-efe7-4033-a479-cb5dadbc3ad7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:03.114564 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c85f344f-3ce9-49fb-8b33-15d2093c0f28 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:03.114998 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c85f344f-3ce9-49fb-8b33-15d2093c0f28 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:03.115445 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c85f344f-3ce9-49fb-8b33-15d2093c0f28 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:03.116142 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c85f344f-3ce9-49fb-8b33-15d2093c0f28 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:03.116602 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c85f344f-3ce9-49fb-8b33-15d2093c0f28 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:03.117034 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c85f344f-3ce9-49fb-8b33-15d2093c0f28 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:03.218649 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e0211a00-2a85-45e2-8518-c709aecd290a tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:03.219331 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e0211a00-2a85-45e2-8518-c709aecd290a tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] [instance: d50976fb-756b-4b12-92f2-cedf87df492d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:03.225203 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e0211a00-2a85-45e2-8518-c709aecd290a tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:03.225728 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e0211a00-2a85-45e2-8518-c709aecd290a tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:03.226167 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e0211a00-2a85-45e2-8518-c709aecd290a tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:03.226884 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e0211a00-2a85-45e2-8518-c709aecd290a tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:03.227339 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e0211a00-2a85-45e2-8518-c709aecd290a tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:03.227764 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e0211a00-2a85-45e2-8518-c709aecd290a tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:03.246141 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c85f344f-3ce9-49fb-8b33-15d2093c0f28 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:03.253795 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c85f344f-3ce9-49fb-8b33-15d2093c0f28 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7" status: 200 len: 1542 microversion: 2.1 time: 0.149894 Oct 19 03:16:03.254386 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 596/1144] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:03 2022] GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7 => generated 1542 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:16:03.261487 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e0211a00-2a85-45e2-8518-c709aecd290a tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:03.261954 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e0211a00-2a85-45e2-8518-c709aecd290a tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:03.262659 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e0211a00-2a85-45e2-8518-c709aecd290a tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:03.263106 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-e0211a00-2a85-45e2-8518-c709aecd290a tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lazy-loading 'fault' on Instance uuid d50976fb-756b-4b12-92f2-cedf87df492d {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:16:03.303454 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2fd6f669-05ac-4062-a43c-2103e80667e7 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:03.304113 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-2fd6f669-05ac-4062-a43c-2103e80667e7 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 1ee8c251-b609-4eeb-9406-ede7977b3f92] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:03.306931 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e0211a00-2a85-45e2-8518-c709aecd290a tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:03.310895 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2fd6f669-05ac-4062-a43c-2103e80667e7 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:03.311392 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2fd6f669-05ac-4062-a43c-2103e80667e7 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:03.311860 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2fd6f669-05ac-4062-a43c-2103e80667e7 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:03.312593 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2fd6f669-05ac-4062-a43c-2103e80667e7 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:03.313051 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2fd6f669-05ac-4062-a43c-2103e80667e7 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:03.313505 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2fd6f669-05ac-4062-a43c-2103e80667e7 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:03.315450 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e0211a00-2a85-45e2-8518-c709aecd290a tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:03.316966 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e0211a00-2a85-45e2-8518-c709aecd290a tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:03.321822 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e0211a00-2a85-45e2-8518-c709aecd290a tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] 10.222.0.52 "GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d" status: 200 len: 1448 microversion: 2.75 time: 0.108371 Oct 19 03:16:03.322401 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 549/1145] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:16:03 2022] GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d => generated 1448 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:16:03.327311 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-80715a4d-7ce9-48da-b577-876c6d9f5d76 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:03.327921 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-80715a4d-7ce9-48da-b577-876c6d9f5d76 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] [instance: b18ae860-ed77-4ddc-b9fa-a2aa773c2614] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:03.333537 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-80715a4d-7ce9-48da-b577-876c6d9f5d76 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:03.334032 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-80715a4d-7ce9-48da-b577-876c6d9f5d76 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:03.334478 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-80715a4d-7ce9-48da-b577-876c6d9f5d76 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:03.335227 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-80715a4d-7ce9-48da-b577-876c6d9f5d76 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:03.335688 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-80715a4d-7ce9-48da-b577-876c6d9f5d76 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:03.336119 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-80715a4d-7ce9-48da-b577-876c6d9f5d76 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:03.377086 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-2fd6f669-05ac-4062-a43c-2103e80667e7 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:03.385342 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2fd6f669-05ac-4062-a43c-2103e80667e7 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/1ee8c251-b609-4eeb-9406-ede7977b3f92" status: 200 len: 1277 microversion: 2.1 time: 0.085584 Oct 19 03:16:03.386723 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 597/1146] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:03 2022] GET /compute/v2.1/servers/1ee8c251-b609-4eeb-9406-ede7977b3f92 => generated 1277 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:16:03.475872 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-80715a4d-7ce9-48da-b577-876c6d9f5d76 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c1401b92c44228bd6e80dd3b786ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e388d05eac4f2babf180c0709fdc58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:03.483680 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-80715a4d-7ce9-48da-b577-876c6d9f5d76 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] 10.222.0.52 "GET /compute/v2.1/servers/b18ae860-ed77-4ddc-b9fa-a2aa773c2614" status: 200 len: 1395 microversion: 2.1 time: 0.159766 Oct 19 03:16:03.484290 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 550/1147] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:03 2022] GET /compute/v2.1/servers/b18ae860-ed77-4ddc-b9fa-a2aa773c2614 => generated 1395 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:16:03.589698 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-cd359f0a-1168-4c66-bca2-0c06d5864e02 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:03.592631 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-cd359f0a-1168-4c66-bca2-0c06d5864e02 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 62133546-4a75-4532-81ab-0c49c9252e85] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:03.603330 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cd359f0a-1168-4c66-bca2-0c06d5864e02 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:03.605236 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cd359f0a-1168-4c66-bca2-0c06d5864e02 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:03.608613 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cd359f0a-1168-4c66-bca2-0c06d5864e02 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:03.609819 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cd359f0a-1168-4c66-bca2-0c06d5864e02 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:03.612252 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cd359f0a-1168-4c66-bca2-0c06d5864e02 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:03.612731 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cd359f0a-1168-4c66-bca2-0c06d5864e02 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:03.835064 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-cd359f0a-1168-4c66-bca2-0c06d5864e02 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:03.844218 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-cd359f0a-1168-4c66-bca2-0c06d5864e02 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:03.845768 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-cd359f0a-1168-4c66-bca2-0c06d5864e02 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:03.846888 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-cd359f0a-1168-4c66-bca2-0c06d5864e02 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85" status: 200 len: 1410 microversion: 2.25 time: 0.261344 Oct 19 03:16:03.848667 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 598/1148] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:16:03 2022] GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85 => generated 1410 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:16:03.980018 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e0f25893-356e-43df-a22f-6dfdde0f7d99 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:03.981336 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e0f25893-356e-43df-a22f-6dfdde0f7d99 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:03.990476 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e0f25893-356e-43df-a22f-6dfdde0f7d99 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:03.991325 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e0f25893-356e-43df-a22f-6dfdde0f7d99 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:03.992250 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e0f25893-356e-43df-a22f-6dfdde0f7d99 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:03.993208 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e0f25893-356e-43df-a22f-6dfdde0f7d99 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:03.994041 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e0f25893-356e-43df-a22f-6dfdde0f7d99 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:03.994677 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e0f25893-356e-43df-a22f-6dfdde0f7d99 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:04.064933 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e0f25893-356e-43df-a22f-6dfdde0f7d99 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:04.067270 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=100 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:16:04.074349 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e0f25893-356e-43df-a22f-6dfdde0f7d99 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:04.075802 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e0f25893-356e-43df-a22f-6dfdde0f7d99 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:04.080669 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e0f25893-356e-43df-a22f-6dfdde0f7d99 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1539 microversion: 2.91 time: 0.104646 Oct 19 03:16:04.081243 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 551/1149] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:16:03 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1539 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:16:04.277995 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-502ede89-163e-4e06-bb71-6201a9374707 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:04.278624 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-502ede89-163e-4e06-bb71-6201a9374707 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 9daa020d-efe7-4033-a479-cb5dadbc3ad7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:04.284888 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-502ede89-163e-4e06-bb71-6201a9374707 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:04.285399 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-502ede89-163e-4e06-bb71-6201a9374707 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:04.285862 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-502ede89-163e-4e06-bb71-6201a9374707 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:04.287555 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-502ede89-163e-4e06-bb71-6201a9374707 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:04.288032 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-502ede89-163e-4e06-bb71-6201a9374707 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:04.288466 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-502ede89-163e-4e06-bb71-6201a9374707 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:04.351025 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-293a3a12-30aa-4624-99c3-472007d04f86 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:04.351932 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-293a3a12-30aa-4624-99c3-472007d04f86 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] [instance: d50976fb-756b-4b12-92f2-cedf87df492d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:04.360337 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-293a3a12-30aa-4624-99c3-472007d04f86 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:04.361146 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-293a3a12-30aa-4624-99c3-472007d04f86 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:04.361964 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-293a3a12-30aa-4624-99c3-472007d04f86 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:04.362860 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-293a3a12-30aa-4624-99c3-472007d04f86 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:04.363461 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-293a3a12-30aa-4624-99c3-472007d04f86 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:04.364031 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-293a3a12-30aa-4624-99c3-472007d04f86 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:04.418055 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-293a3a12-30aa-4624-99c3-472007d04f86 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:04.424767 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-293a3a12-30aa-4624-99c3-472007d04f86 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:04.425428 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-293a3a12-30aa-4624-99c3-472007d04f86 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:04.426219 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-293a3a12-30aa-4624-99c3-472007d04f86 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lazy-loading 'fault' on Instance uuid d50976fb-756b-4b12-92f2-cedf87df492d {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:16:04.492817 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-293a3a12-30aa-4624-99c3-472007d04f86 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:04.502982 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-293a3a12-30aa-4624-99c3-472007d04f86 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:04.504757 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-293a3a12-30aa-4624-99c3-472007d04f86 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e254209599044d7bcd2503d96152c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09d60b5f254b6d91f4103a1f1245b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:04.520312 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-293a3a12-30aa-4624-99c3-472007d04f86 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] 10.222.0.52 "GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d" status: 200 len: 1448 microversion: 2.75 time: 0.173141 Oct 19 03:16:04.526123 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 552/1150] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:16:04 2022] GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d => generated 1448 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:16:04.526123 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d00da3c4-b1d0-4364-b479-11c08bc75692 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:04.526796 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d00da3c4-b1d0-4364-b479-11c08bc75692 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 1ee8c251-b609-4eeb-9406-ede7977b3f92] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:04.536380 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d00da3c4-b1d0-4364-b479-11c08bc75692 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:04.536958 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d00da3c4-b1d0-4364-b479-11c08bc75692 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:04.541041 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d00da3c4-b1d0-4364-b479-11c08bc75692 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:04.541041 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d00da3c4-b1d0-4364-b479-11c08bc75692 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:04.541041 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d00da3c4-b1d0-4364-b479-11c08bc75692 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:04.541041 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d00da3c4-b1d0-4364-b479-11c08bc75692 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:04.584182 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-502ede89-163e-4e06-bb71-6201a9374707 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:04.630090 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-502ede89-163e-4e06-bb71-6201a9374707 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7" status: 200 len: 1542 microversion: 2.1 time: 0.337849 Oct 19 03:16:04.637085 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 599/1151] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:04 2022] GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7 => generated 1542 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:16:04.664560 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-fdeebf6f-5008-4b00-8a76-d339d7077da7 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:04.665699 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-fdeebf6f-5008-4b00-8a76-d339d7077da7 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] [instance: b18ae860-ed77-4ddc-b9fa-a2aa773c2614] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:04.673604 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fdeebf6f-5008-4b00-8a76-d339d7077da7 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:04.674710 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fdeebf6f-5008-4b00-8a76-d339d7077da7 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:04.675385 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fdeebf6f-5008-4b00-8a76-d339d7077da7 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:04.676493 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fdeebf6f-5008-4b00-8a76-d339d7077da7 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:04.677234 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fdeebf6f-5008-4b00-8a76-d339d7077da7 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:04.677848 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fdeebf6f-5008-4b00-8a76-d339d7077da7 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:04.892856 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d00da3c4-b1d0-4364-b479-11c08bc75692 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:04.908899 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d00da3c4-b1d0-4364-b479-11c08bc75692 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/1ee8c251-b609-4eeb-9406-ede7977b3f92" status: 200 len: 1317 microversion: 2.1 time: 0.386399 Oct 19 03:16:04.910180 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 553/1152] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:04 2022] GET /compute/v2.1/servers/1ee8c251-b609-4eeb-9406-ede7977b3f92 => generated 1317 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:16:04.916338 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-bd0ec73b-bb67-416f-aa3b-2e73c3359baf tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:04.917296 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-bd0ec73b-bb67-416f-aa3b-2e73c3359baf tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 62133546-4a75-4532-81ab-0c49c9252e85] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:04.928099 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bd0ec73b-bb67-416f-aa3b-2e73c3359baf tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:04.928633 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bd0ec73b-bb67-416f-aa3b-2e73c3359baf tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:04.929078 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bd0ec73b-bb67-416f-aa3b-2e73c3359baf tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:04.929861 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bd0ec73b-bb67-416f-aa3b-2e73c3359baf tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:04.930325 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bd0ec73b-bb67-416f-aa3b-2e73c3359baf tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:04.930755 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bd0ec73b-bb67-416f-aa3b-2e73c3359baf tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:05.002159 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-fdeebf6f-5008-4b00-8a76-d339d7077da7 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c1401b92c44228bd6e80dd3b786ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e388d05eac4f2babf180c0709fdc58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:05.010996 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-fdeebf6f-5008-4b00-8a76-d339d7077da7 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] 10.222.0.52 "GET /compute/v2.1/servers/b18ae860-ed77-4ddc-b9fa-a2aa773c2614" status: 200 len: 1395 microversion: 2.1 time: 0.351677 Oct 19 03:16:05.011835 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 600/1153] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:04 2022] GET /compute/v2.1/servers/b18ae860-ed77-4ddc-b9fa-a2aa773c2614 => generated 1395 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:16:05.109017 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3627a72c-8edd-4aec-a293-dbd8ec68e8ca tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:05.109633 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=4 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:16:05.110259 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-3627a72c-8edd-4aec-a293-dbd8ec68e8ca tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:05.117008 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3627a72c-8edd-4aec-a293-dbd8ec68e8ca tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:05.118999 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3627a72c-8edd-4aec-a293-dbd8ec68e8ca tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:05.118999 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3627a72c-8edd-4aec-a293-dbd8ec68e8ca tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:05.119424 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3627a72c-8edd-4aec-a293-dbd8ec68e8ca tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:05.120365 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3627a72c-8edd-4aec-a293-dbd8ec68e8ca tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:05.120984 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3627a72c-8edd-4aec-a293-dbd8ec68e8ca tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:05.131556 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=8 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:16:05.225985 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-3627a72c-8edd-4aec-a293-dbd8ec68e8ca tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:05.230443 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-bd0ec73b-bb67-416f-aa3b-2e73c3359baf tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:05.237121 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-3627a72c-8edd-4aec-a293-dbd8ec68e8ca tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:05.239007 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-3627a72c-8edd-4aec-a293-dbd8ec68e8ca tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:05.244146 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-bd0ec73b-bb67-416f-aa3b-2e73c3359baf tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:05.246336 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-3627a72c-8edd-4aec-a293-dbd8ec68e8ca tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1539 microversion: 2.91 time: 0.141823 Oct 19 03:16:05.246863 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-bd0ec73b-bb67-416f-aa3b-2e73c3359baf tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:05.247931 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 601/1154] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:16:05 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1539 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:16:05.248676 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-bd0ec73b-bb67-416f-aa3b-2e73c3359baf tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85" status: 200 len: 1410 microversion: 2.25 time: 0.337214 Oct 19 03:16:05.249841 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 554/1155] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:16:04 2022] GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85 => generated 1410 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:16:05.551345 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6e59e987-ecf3-43da-bd32-d17bb1273a24 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:05.551951 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6e59e987-ecf3-43da-bd32-d17bb1273a24 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] [instance: d50976fb-756b-4b12-92f2-cedf87df492d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:05.553818 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:16:05.559337 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6e59e987-ecf3-43da-bd32-d17bb1273a24 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:05.559932 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6e59e987-ecf3-43da-bd32-d17bb1273a24 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:05.560365 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6e59e987-ecf3-43da-bd32-d17bb1273a24 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:05.561084 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6e59e987-ecf3-43da-bd32-d17bb1273a24 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:05.561576 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6e59e987-ecf3-43da-bd32-d17bb1273a24 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:05.561996 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6e59e987-ecf3-43da-bd32-d17bb1273a24 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:05.576678 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-6e59e987-ecf3-43da-bd32-d17bb1273a24 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] HTTP exception thrown: Instance d50976fb-756b-4b12-92f2-cedf87df492d could not be found. Oct 19 03:16:05.583701 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6e59e987-ecf3-43da-bd32-d17bb1273a24 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Request method failure captured: Oct 19 03:16:05.583701 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d HTTP/1.1 Oct 19 03:16:05.583701 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:16:05.583701 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:16:05.583701 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:16:05.583701 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:16:05.583701 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:16:05.583701 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:16:05.583701 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:16:05.583701 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:16:05.583701 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2tyIj4XJqQnYa56npwpNh7_W0YiJdyn--qMD2c5fQF9YMGvVgrfwUY1TSsR7E6IWAh4hl2E8xcP1VmX8rEzcG-BWf32F4LY0oRJbx0rXuI8PR2mb4Dhnp0xsv9le0wZin9qboUYKMkLP9fbNhODmnmzazuLkMMfRBQuDIFhM04-J74 Oct 19 03:16:05.583701 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:16:05.583701 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:16:05.583701 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:16:05.583701 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:16:05.583701 n-d-861333-8 devstack@n-api.service[121135]: X-Openstack-Nova-Api-Version: 2.75 Oct 19 03:16:05.583701 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:16:05.583701 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:16:05.583701 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 1c09d60b5f254b6d91f4103a1f1245b4 Oct 19 03:16:05.583701 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ServersAdmin275Test-775369522 Oct 19 03:16:05.583701 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:16:05.583701 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:16:05.585488 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1c09d60b5f254b6d91f4103a1f1245b4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1c09d60b5f254b6d91f4103a1f1245b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1c09d60b5f254b6d91f4103a1f1245b4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1c09d60b5f254b6d91f4103a1f1245b4", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:16:05.585488 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ServersAdmin275Test-775369522 Oct 19 03:16:05.585488 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 1c09d60b5f254b6d91f4103a1f1245b4 Oct 19 03:16:05.585488 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ServersAdmin275Test-775369522 Oct 19 03:16:05.585488 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ServersAdmin275Test-775369522-project Oct 19 03:16:05.585488 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:16:05.585488 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:16:05.585488 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 1e254209599044d7bcd2503d96152c50 Oct 19 03:16:05.585488 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ServersAdmin275Test-775369522-project Oct 19 03:16:05.585488 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:16:05.585488 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance d50976fb-756b-4b12-92f2-cedf87df492d could not be found. Oct 19 03:16:05.585488 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': 'd50976fb-756b-4b12-92f2-cedf87df492d'} Oct 19 03:16:05.586415 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:16:05.586415 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:16:05.586415 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:16:05.586415 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:16:05.586415 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:16:05.586415 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:16:05.586415 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:16:05.586415 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:16:05.586415 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:16:05.586415 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:16:05.586415 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d50976fb-756b-4b12-92f2-cedf87df492d could not be found. Oct 19 03:16:05.586415 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:16:05.586415 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:16:05.586415 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:16:05.586415 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:16:05.586415 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:16:05.586415 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:16:05.586415 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:16:05.586415 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:16:05.586415 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:16:05.588274 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:16:05.588274 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:16:05.588274 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:16:05.588274 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:16:05.588274 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:16:05.588274 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:16:05.588274 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:16:05.588274 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d50976fb-756b-4b12-92f2-cedf87df492d could not be found. Oct 19 03:16:05.588274 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:16:05.588274 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:16:05.588274 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:16:05.588274 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:16:05.588274 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:16:05.588274 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:16:05.588274 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:16:05.588274 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:16:05.588274 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d50976fb-756b-4b12-92f2-cedf87df492d could not be found. Oct 19 03:16:05.588274 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:16:05.590155 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6e59e987-ecf3-43da-bd32-d17bb1273a24 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] Returning 404 to user: Instance d50976fb-756b-4b12-92f2-cedf87df492d could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:16:05.590155 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6e59e987-ecf3-43da-bd32-d17bb1273a24 tempest-ServersAdmin275Test-775369522 tempest-ServersAdmin275Test-775369522-project] 10.222.0.52 "GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d" status: 404 len: 111 microversion: 2.75 time: 0.032790 Oct 19 03:16:05.590155 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 602/1156] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:16:05 2022] GET /compute/v2.1/servers/d50976fb-756b-4b12-92f2-cedf87df492d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 19 03:16:05.659736 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4a54438e-351d-4e3b-928d-d2b2df3a4aed tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:05.660360 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4a54438e-351d-4e3b-928d-d2b2df3a4aed tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 9daa020d-efe7-4033-a479-cb5dadbc3ad7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:05.667457 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4a54438e-351d-4e3b-928d-d2b2df3a4aed tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:05.667949 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4a54438e-351d-4e3b-928d-d2b2df3a4aed tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:05.668394 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4a54438e-351d-4e3b-928d-d2b2df3a4aed tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:05.669098 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4a54438e-351d-4e3b-928d-d2b2df3a4aed tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:05.669648 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4a54438e-351d-4e3b-928d-d2b2df3a4aed tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:05.670079 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4a54438e-351d-4e3b-928d-d2b2df3a4aed tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:05.760948 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-124f8029-35b9-46d0-8352-aaa4b6232ea1 req-06ecb7cf-d4b6-4695-8eec-ff413c41e74c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ee8c251-b609-4eeb-9406-ede7977b3f92", "tag": "00715d2d-0cc6-4f47-a5c6-da7f988d8c1f"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:16:05.778613 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-124f8029-35b9-46d0-8352-aaa4b6232ea1 req-06ecb7cf-d4b6-4695-8eec-ff413c41e74c service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:05.779107 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-124f8029-35b9-46d0-8352-aaa4b6232ea1 req-06ecb7cf-d4b6-4695-8eec-ff413c41e74c service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:05.779857 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-124f8029-35b9-46d0-8352-aaa4b6232ea1 req-06ecb7cf-d4b6-4695-8eec-ff413c41e74c service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:05.793190 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-124f8029-35b9-46d0-8352-aaa4b6232ea1 req-06ecb7cf-d4b6-4695-8eec-ff413c41e74c service nova] Creating event network-changed:00715d2d-0cc6-4f47-a5c6-da7f988d8c1f for instance 1ee8c251-b609-4eeb-9406-ede7977b3f92 on n-h1-861333-8 Oct 19 03:16:05.799531 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-124f8029-35b9-46d0-8352-aaa4b6232ea1 req-06ecb7cf-d4b6-4695-8eec-ff413c41e74c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043205 Oct 19 03:16:05.800433 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 603/1157] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:16:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:16:05.858090 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-4a54438e-351d-4e3b-928d-d2b2df3a4aed tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:05.866578 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4a54438e-351d-4e3b-928d-d2b2df3a4aed tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7" status: 200 len: 1542 microversion: 2.1 time: 0.211314 Oct 19 03:16:05.867151 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 555/1158] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:05 2022] GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7 => generated 1542 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:16:05.935933 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d6fdb57e-8183-4f2a-9cbb-b20133636a64 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:05.936653 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d6fdb57e-8183-4f2a-9cbb-b20133636a64 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 1ee8c251-b609-4eeb-9406-ede7977b3f92] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:05.942734 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d6fdb57e-8183-4f2a-9cbb-b20133636a64 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:05.943215 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d6fdb57e-8183-4f2a-9cbb-b20133636a64 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:05.943668 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d6fdb57e-8183-4f2a-9cbb-b20133636a64 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:05.944353 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d6fdb57e-8183-4f2a-9cbb-b20133636a64 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:05.944801 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d6fdb57e-8183-4f2a-9cbb-b20133636a64 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:05.945219 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d6fdb57e-8183-4f2a-9cbb-b20133636a64 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:06.034884 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-cdb2b49d-4ada-4e73-a748-5222656ae635 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:06.035415 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-cdb2b49d-4ada-4e73-a748-5222656ae635 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] [instance: b18ae860-ed77-4ddc-b9fa-a2aa773c2614] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:06.042714 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cdb2b49d-4ada-4e73-a748-5222656ae635 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:06.043434 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cdb2b49d-4ada-4e73-a748-5222656ae635 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:06.044037 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cdb2b49d-4ada-4e73-a748-5222656ae635 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:06.044897 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cdb2b49d-4ada-4e73-a748-5222656ae635 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:06.045543 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cdb2b49d-4ada-4e73-a748-5222656ae635 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:06.046130 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cdb2b49d-4ada-4e73-a748-5222656ae635 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:06.109360 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d6fdb57e-8183-4f2a-9cbb-b20133636a64 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:06.120727 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d6fdb57e-8183-4f2a-9cbb-b20133636a64 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/1ee8c251-b609-4eeb-9406-ede7977b3f92" status: 200 len: 1317 microversion: 2.1 time: 0.187507 Oct 19 03:16:06.122106 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 604/1159] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:05 2022] GET /compute/v2.1/servers/1ee8c251-b609-4eeb-9406-ede7977b3f92 => generated 1317 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:16:06.218343 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-cdb2b49d-4ada-4e73-a748-5222656ae635 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c1401b92c44228bd6e80dd3b786ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e388d05eac4f2babf180c0709fdc58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:06.225853 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-cdb2b49d-4ada-4e73-a748-5222656ae635 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] 10.222.0.52 "GET /compute/v2.1/servers/b18ae860-ed77-4ddc-b9fa-a2aa773c2614" status: 200 len: 1395 microversion: 2.1 time: 0.194880 Oct 19 03:16:06.226421 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 556/1160] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:06 2022] GET /compute/v2.1/servers/b18ae860-ed77-4ddc-b9fa-a2aa773c2614 => generated 1395 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:16:06.279422 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b24efd4c-ad6f-49e4-a488-6a26dd337cac tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:06.280199 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b24efd4c-ad6f-49e4-a488-6a26dd337cac tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:06.282091 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-fc0f14c0-91f3-48d4-907f-7c28be5f4ce1 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:06.282747 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-fc0f14c0-91f3-48d4-907f-7c28be5f4ce1 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 62133546-4a75-4532-81ab-0c49c9252e85] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:06.283542 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=100 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:16:06.287863 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b24efd4c-ad6f-49e4-a488-6a26dd337cac tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:06.288414 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b24efd4c-ad6f-49e4-a488-6a26dd337cac tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:06.288961 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b24efd4c-ad6f-49e4-a488-6a26dd337cac tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:06.289089 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fc0f14c0-91f3-48d4-907f-7c28be5f4ce1 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:06.289600 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fc0f14c0-91f3-48d4-907f-7c28be5f4ce1 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:06.290003 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b24efd4c-ad6f-49e4-a488-6a26dd337cac tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:06.290105 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fc0f14c0-91f3-48d4-907f-7c28be5f4ce1 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:06.290682 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b24efd4c-ad6f-49e4-a488-6a26dd337cac tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:06.290799 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fc0f14c0-91f3-48d4-907f-7c28be5f4ce1 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:06.291171 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fc0f14c0-91f3-48d4-907f-7c28be5f4ce1 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:06.291591 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b24efd4c-ad6f-49e4-a488-6a26dd337cac tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:06.292191 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fc0f14c0-91f3-48d4-907f-7c28be5f4ce1 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:06.381556 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b24efd4c-ad6f-49e4-a488-6a26dd337cac tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:06.391238 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b24efd4c-ad6f-49e4-a488-6a26dd337cac tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:06.392723 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b24efd4c-ad6f-49e4-a488-6a26dd337cac tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:06.398274 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b24efd4c-ad6f-49e4-a488-6a26dd337cac tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1539 microversion: 2.91 time: 0.123329 Oct 19 03:16:06.400090 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 605/1161] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:16:06 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1539 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:16:06.513665 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-fc0f14c0-91f3-48d4-907f-7c28be5f4ce1 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:06.521751 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-fc0f14c0-91f3-48d4-907f-7c28be5f4ce1 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:06.523196 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-fc0f14c0-91f3-48d4-907f-7c28be5f4ce1 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:06.524312 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-fc0f14c0-91f3-48d4-907f-7c28be5f4ce1 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85" status: 200 len: 1410 microversion: 2.25 time: 0.246127 Oct 19 03:16:06.524880 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 557/1162] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:16:06 2022] GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85 => generated 1410 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:16:06.890090 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0f00895e-4ae0-4b38-8fd4-1f603e0ddf96 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:06.890703 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0f00895e-4ae0-4b38-8fd4-1f603e0ddf96 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 9daa020d-efe7-4033-a479-cb5dadbc3ad7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:06.896530 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0f00895e-4ae0-4b38-8fd4-1f603e0ddf96 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:06.897056 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0f00895e-4ae0-4b38-8fd4-1f603e0ddf96 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:06.897729 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0f00895e-4ae0-4b38-8fd4-1f603e0ddf96 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:06.898592 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0f00895e-4ae0-4b38-8fd4-1f603e0ddf96 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:06.899061 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0f00895e-4ae0-4b38-8fd4-1f603e0ddf96 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:06.899476 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0f00895e-4ae0-4b38-8fd4-1f603e0ddf96 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:07.028007 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-0f00895e-4ae0-4b38-8fd4-1f603e0ddf96 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:07.035829 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0f00895e-4ae0-4b38-8fd4-1f603e0ddf96 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7" status: 200 len: 1542 microversion: 2.1 time: 0.150445 Oct 19 03:16:07.036402 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 606/1163] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:06 2022] GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7 => generated 1542 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:16:07.148006 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-36088f08-a468-4d4c-a707-f67ffa6df093 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:07.148624 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-36088f08-a468-4d4c-a707-f67ffa6df093 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 1ee8c251-b609-4eeb-9406-ede7977b3f92] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:07.155743 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-36088f08-a468-4d4c-a707-f67ffa6df093 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:07.156333 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-36088f08-a468-4d4c-a707-f67ffa6df093 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:07.156879 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-36088f08-a468-4d4c-a707-f67ffa6df093 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:07.157694 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-36088f08-a468-4d4c-a707-f67ffa6df093 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:07.158251 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-36088f08-a468-4d4c-a707-f67ffa6df093 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:07.158751 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-36088f08-a468-4d4c-a707-f67ffa6df093 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:07.250300 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7bea53a7-09af-45ca-ba7c-17ea804c2f41 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:07.250924 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7bea53a7-09af-45ca-ba7c-17ea804c2f41 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] [instance: b18ae860-ed77-4ddc-b9fa-a2aa773c2614] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:07.257101 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7bea53a7-09af-45ca-ba7c-17ea804c2f41 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:07.257577 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7bea53a7-09af-45ca-ba7c-17ea804c2f41 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:07.258031 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7bea53a7-09af-45ca-ba7c-17ea804c2f41 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:07.258728 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7bea53a7-09af-45ca-ba7c-17ea804c2f41 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:07.259188 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7bea53a7-09af-45ca-ba7c-17ea804c2f41 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:07.259620 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7bea53a7-09af-45ca-ba7c-17ea804c2f41 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:07.356549 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-36088f08-a468-4d4c-a707-f67ffa6df093 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:07.364424 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-36088f08-a468-4d4c-a707-f67ffa6df093 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/1ee8c251-b609-4eeb-9406-ede7977b3f92" status: 200 len: 1317 microversion: 2.1 time: 0.220222 Oct 19 03:16:07.365018 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 558/1164] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:07 2022] GET /compute/v2.1/servers/1ee8c251-b609-4eeb-9406-ede7977b3f92 => generated 1317 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:16:07.430395 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-fe12ecf6-1377-4aec-b631-937e49f92117 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:07.431100 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-fe12ecf6-1377-4aec-b631-937e49f92117 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:07.431451 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7bea53a7-09af-45ca-ba7c-17ea804c2f41 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c1401b92c44228bd6e80dd3b786ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e388d05eac4f2babf180c0709fdc58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:07.438317 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fe12ecf6-1377-4aec-b631-937e49f92117 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:07.438805 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fe12ecf6-1377-4aec-b631-937e49f92117 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:07.439326 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fe12ecf6-1377-4aec-b631-937e49f92117 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:07.440220 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fe12ecf6-1377-4aec-b631-937e49f92117 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:07.440356 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7bea53a7-09af-45ca-ba7c-17ea804c2f41 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] 10.222.0.52 "GET /compute/v2.1/servers/b18ae860-ed77-4ddc-b9fa-a2aa773c2614" status: 200 len: 1395 microversion: 2.1 time: 0.194072 Oct 19 03:16:07.440705 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fe12ecf6-1377-4aec-b631-937e49f92117 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:07.441771 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 607/1165] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:07 2022] GET /compute/v2.1/servers/b18ae860-ed77-4ddc-b9fa-a2aa773c2614 => generated 1395 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:16:07.441953 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fe12ecf6-1377-4aec-b631-937e49f92117 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:07.516551 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-fe12ecf6-1377-4aec-b631-937e49f92117 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:07.525562 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-fe12ecf6-1377-4aec-b631-937e49f92117 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:07.527142 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-fe12ecf6-1377-4aec-b631-937e49f92117 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:07.532135 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-fe12ecf6-1377-4aec-b631-937e49f92117 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1539 microversion: 2.91 time: 0.108671 Oct 19 03:16:07.532872 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 559/1166] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:16:07 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1539 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:16:07.551662 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0d3a2ce9-6465-4591-ae66-6a666774c980 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:07.553337 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0d3a2ce9-6465-4591-ae66-6a666774c980 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 62133546-4a75-4532-81ab-0c49c9252e85] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:07.565202 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0d3a2ce9-6465-4591-ae66-6a666774c980 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:07.565791 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0d3a2ce9-6465-4591-ae66-6a666774c980 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:07.566721 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0d3a2ce9-6465-4591-ae66-6a666774c980 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:07.567617 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0d3a2ce9-6465-4591-ae66-6a666774c980 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:07.568204 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0d3a2ce9-6465-4591-ae66-6a666774c980 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:07.568545 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0d3a2ce9-6465-4591-ae66-6a666774c980 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:07.725708 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-0d3a2ce9-6465-4591-ae66-6a666774c980 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:07.730165 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=100 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:16:07.736635 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-0d3a2ce9-6465-4591-ae66-6a666774c980 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:07.740355 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-0d3a2ce9-6465-4591-ae66-6a666774c980 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:07.740355 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0d3a2ce9-6465-4591-ae66-6a666774c980 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85" status: 200 len: 1410 microversion: 2.25 time: 0.193284 Oct 19 03:16:07.740905 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 608/1167] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:16:07 2022] GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85 => generated 1410 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:16:07.744601 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-08b97156-c270-40d5-b27f-ed1b1c09791b req-4cca1680-7c2d-428c-a6e3-d751d2d75492 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b18ae860-ed77-4ddc-b9fa-a2aa773c2614", "name": "network-vif-plugged", "status": "completed", "tag": "a42ed099-3fb2-4b70-8cb8-870751bbcc54"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:16:07.759461 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-08b97156-c270-40d5-b27f-ed1b1c09791b req-4cca1680-7c2d-428c-a6e3-d751d2d75492 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:07.759953 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-08b97156-c270-40d5-b27f-ed1b1c09791b req-4cca1680-7c2d-428c-a6e3-d751d2d75492 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:07.760472 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-08b97156-c270-40d5-b27f-ed1b1c09791b req-4cca1680-7c2d-428c-a6e3-d751d2d75492 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:07.772930 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-08b97156-c270-40d5-b27f-ed1b1c09791b req-4cca1680-7c2d-428c-a6e3-d751d2d75492 service nova] Creating event network-vif-plugged:a42ed099-3fb2-4b70-8cb8-870751bbcc54 for instance b18ae860-ed77-4ddc-b9fa-a2aa773c2614 on n-h1-861333-8 Oct 19 03:16:07.778897 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-08b97156-c270-40d5-b27f-ed1b1c09791b req-4cca1680-7c2d-428c-a6e3-d751d2d75492 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042490 Oct 19 03:16:07.779511 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 560/1168] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:16:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:16:08.061091 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-37edaa95-5f55-46da-9cd7-47acbec8f798 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:08.062343 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-37edaa95-5f55-46da-9cd7-47acbec8f798 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 9daa020d-efe7-4033-a479-cb5dadbc3ad7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:08.068512 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-37edaa95-5f55-46da-9cd7-47acbec8f798 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:08.069215 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-37edaa95-5f55-46da-9cd7-47acbec8f798 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:08.071182 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-37edaa95-5f55-46da-9cd7-47acbec8f798 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:08.071182 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-37edaa95-5f55-46da-9cd7-47acbec8f798 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:08.071182 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-37edaa95-5f55-46da-9cd7-47acbec8f798 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:08.071480 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-37edaa95-5f55-46da-9cd7-47acbec8f798 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:08.294268 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-37edaa95-5f55-46da-9cd7-47acbec8f798 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:08.302527 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-37edaa95-5f55-46da-9cd7-47acbec8f798 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7" status: 200 len: 1542 microversion: 2.1 time: 0.246208 Oct 19 03:16:08.303188 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 609/1169] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:08 2022] GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7 => generated 1542 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:16:08.391099 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0355bf80-e8f8-411f-869d-38423f2b3e7c tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:08.391829 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0355bf80-e8f8-411f-869d-38423f2b3e7c tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 1ee8c251-b609-4eeb-9406-ede7977b3f92] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:08.400283 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0355bf80-e8f8-411f-869d-38423f2b3e7c tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:08.400815 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0355bf80-e8f8-411f-869d-38423f2b3e7c tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:08.401945 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0355bf80-e8f8-411f-869d-38423f2b3e7c tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:08.402662 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0355bf80-e8f8-411f-869d-38423f2b3e7c tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:08.403122 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0355bf80-e8f8-411f-869d-38423f2b3e7c tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:08.403559 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0355bf80-e8f8-411f-869d-38423f2b3e7c tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:08.463189 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6d9875f2-36c2-4322-a585-442a9198cffd tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:08.464352 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6d9875f2-36c2-4322-a585-442a9198cffd tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] [instance: b18ae860-ed77-4ddc-b9fa-a2aa773c2614] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:08.471226 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6d9875f2-36c2-4322-a585-442a9198cffd tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:08.471735 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6d9875f2-36c2-4322-a585-442a9198cffd tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:08.472181 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6d9875f2-36c2-4322-a585-442a9198cffd tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:08.472894 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6d9875f2-36c2-4322-a585-442a9198cffd tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:08.473356 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6d9875f2-36c2-4322-a585-442a9198cffd tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:08.473850 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6d9875f2-36c2-4322-a585-442a9198cffd tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:08.586794 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0355bf80-e8f8-411f-869d-38423f2b3e7c tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:08.594628 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0355bf80-e8f8-411f-869d-38423f2b3e7c tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/1ee8c251-b609-4eeb-9406-ede7977b3f92" status: 200 len: 1317 microversion: 2.1 time: 0.210697 Oct 19 03:16:08.595238 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 561/1170] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:08 2022] GET /compute/v2.1/servers/1ee8c251-b609-4eeb-9406-ede7977b3f92 => generated 1317 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:16:08.599711 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-18799c1d-b425-48af-acb1-24f8926220af tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:08.600317 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-18799c1d-b425-48af-acb1-24f8926220af tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:08.612081 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:16:08.616143 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-18799c1d-b425-48af-acb1-24f8926220af tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:08.616721 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-18799c1d-b425-48af-acb1-24f8926220af tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:08.617359 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-18799c1d-b425-48af-acb1-24f8926220af tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:08.618168 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-18799c1d-b425-48af-acb1-24f8926220af tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:08.618584 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-18799c1d-b425-48af-acb1-24f8926220af tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:08.619012 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-18799c1d-b425-48af-acb1-24f8926220af tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:08.637156 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-6d9875f2-36c2-4322-a585-442a9198cffd tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c1401b92c44228bd6e80dd3b786ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e388d05eac4f2babf180c0709fdc58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:08.646001 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6d9875f2-36c2-4322-a585-442a9198cffd tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] 10.222.0.52 "GET /compute/v2.1/servers/b18ae860-ed77-4ddc-b9fa-a2aa773c2614" status: 200 len: 1395 microversion: 2.1 time: 0.186565 Oct 19 03:16:08.662007 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 610/1171] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:08 2022] GET /compute/v2.1/servers/b18ae860-ed77-4ddc-b9fa-a2aa773c2614 => generated 1395 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:16:08.702505 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-18799c1d-b425-48af-acb1-24f8926220af tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:08.710616 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-18799c1d-b425-48af-acb1-24f8926220af tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:08.712071 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-18799c1d-b425-48af-acb1-24f8926220af tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:08.717031 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-18799c1d-b425-48af-acb1-24f8926220af tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1539 microversion: 2.91 time: 0.120817 Oct 19 03:16:08.717637 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 562/1172] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:16:08 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1539 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:16:08.767086 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-029d36da-75f9-4a8f-85ad-18886e2ad3dd tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:08.767520 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-029d36da-75f9-4a8f-85ad-18886e2ad3dd tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 62133546-4a75-4532-81ab-0c49c9252e85] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:08.773923 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-029d36da-75f9-4a8f-85ad-18886e2ad3dd tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:08.774029 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-029d36da-75f9-4a8f-85ad-18886e2ad3dd tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:08.774454 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-029d36da-75f9-4a8f-85ad-18886e2ad3dd tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:08.775133 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-029d36da-75f9-4a8f-85ad-18886e2ad3dd tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:08.775580 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-029d36da-75f9-4a8f-85ad-18886e2ad3dd tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:08.776018 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-029d36da-75f9-4a8f-85ad-18886e2ad3dd tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:08.940526 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-029d36da-75f9-4a8f-85ad-18886e2ad3dd tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:08.949116 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-029d36da-75f9-4a8f-85ad-18886e2ad3dd tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:08.950744 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-029d36da-75f9-4a8f-85ad-18886e2ad3dd tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:08.951924 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-029d36da-75f9-4a8f-85ad-18886e2ad3dd tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85" status: 200 len: 1410 microversion: 2.25 time: 0.188823 Oct 19 03:16:08.952490 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 611/1173] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:16:08 2022] GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85 => generated 1410 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:16:09.325531 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ddf161e0-add4-4d29-8cd9-33c0f1160308 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:09.326181 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ddf161e0-add4-4d29-8cd9-33c0f1160308 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 9daa020d-efe7-4033-a479-cb5dadbc3ad7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:09.332417 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ddf161e0-add4-4d29-8cd9-33c0f1160308 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:09.332905 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ddf161e0-add4-4d29-8cd9-33c0f1160308 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:09.333347 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ddf161e0-add4-4d29-8cd9-33c0f1160308 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:09.334062 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ddf161e0-add4-4d29-8cd9-33c0f1160308 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:09.334522 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ddf161e0-add4-4d29-8cd9-33c0f1160308 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:09.334951 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ddf161e0-add4-4d29-8cd9-33c0f1160308 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:09.468821 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ddf161e0-add4-4d29-8cd9-33c0f1160308 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:09.477475 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ddf161e0-add4-4d29-8cd9-33c0f1160308 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7" status: 200 len: 1542 microversion: 2.1 time: 0.155948 Oct 19 03:16:09.478089 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 563/1174] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:09 2022] GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7 => generated 1542 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:16:09.617723 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ebfa046a-299f-4590-9a11-98c732c6f37c tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:09.619009 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ebfa046a-299f-4590-9a11-98c732c6f37c tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 1ee8c251-b609-4eeb-9406-ede7977b3f92] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:09.626152 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ebfa046a-299f-4590-9a11-98c732c6f37c tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:09.626766 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ebfa046a-299f-4590-9a11-98c732c6f37c tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:09.627333 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ebfa046a-299f-4590-9a11-98c732c6f37c tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:09.628204 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ebfa046a-299f-4590-9a11-98c732c6f37c tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:09.628767 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ebfa046a-299f-4590-9a11-98c732c6f37c tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:09.629630 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ebfa046a-299f-4590-9a11-98c732c6f37c tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:09.671177 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-88b17b94-c1df-4354-b0f1-edf481e8165d tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:09.671927 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-88b17b94-c1df-4354-b0f1-edf481e8165d tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] [instance: b18ae860-ed77-4ddc-b9fa-a2aa773c2614] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:09.681584 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-88b17b94-c1df-4354-b0f1-edf481e8165d tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:09.682398 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-88b17b94-c1df-4354-b0f1-edf481e8165d tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:09.688869 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-88b17b94-c1df-4354-b0f1-edf481e8165d tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:09.688869 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-88b17b94-c1df-4354-b0f1-edf481e8165d tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:09.688869 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-88b17b94-c1df-4354-b0f1-edf481e8165d tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:09.688869 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-88b17b94-c1df-4354-b0f1-edf481e8165d tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:10.270441 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ebfa046a-299f-4590-9a11-98c732c6f37c tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:10.278362 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ebfa046a-299f-4590-9a11-98c732c6f37c tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/1ee8c251-b609-4eeb-9406-ede7977b3f92" status: 200 len: 1317 microversion: 2.1 time: 0.664604 Oct 19 03:16:10.278995 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 612/1175] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:09 2022] GET /compute/v2.1/servers/1ee8c251-b609-4eeb-9406-ede7977b3f92 => generated 1317 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:16:10.283610 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5a98ba5e-bb86-4ba1-80b4-c0a77a8a38f4 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:10.284248 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-5a98ba5e-bb86-4ba1-80b4-c0a77a8a38f4 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:10.296931 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5a98ba5e-bb86-4ba1-80b4-c0a77a8a38f4 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:10.303717 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5a98ba5e-bb86-4ba1-80b4-c0a77a8a38f4 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:10.303717 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5a98ba5e-bb86-4ba1-80b4-c0a77a8a38f4 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:10.303717 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5a98ba5e-bb86-4ba1-80b4-c0a77a8a38f4 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:10.303717 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5a98ba5e-bb86-4ba1-80b4-c0a77a8a38f4 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:10.304326 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5a98ba5e-bb86-4ba1-80b4-c0a77a8a38f4 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:10.324279 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-88b17b94-c1df-4354-b0f1-edf481e8165d tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c1401b92c44228bd6e80dd3b786ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e388d05eac4f2babf180c0709fdc58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:10.334704 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-88b17b94-c1df-4354-b0f1-edf481e8165d tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] 10.222.0.52 "GET /compute/v2.1/servers/b18ae860-ed77-4ddc-b9fa-a2aa773c2614" status: 200 len: 1395 microversion: 2.1 time: 0.667752 Oct 19 03:16:10.338486 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 564/1176] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:09 2022] GET /compute/v2.1/servers/b18ae860-ed77-4ddc-b9fa-a2aa773c2614 => generated 1395 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:16:10.430743 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-5a98ba5e-bb86-4ba1-80b4-c0a77a8a38f4 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:10.441120 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-5a98ba5e-bb86-4ba1-80b4-c0a77a8a38f4 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:10.442994 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-5a98ba5e-bb86-4ba1-80b4-c0a77a8a38f4 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:10.448796 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5a98ba5e-bb86-4ba1-80b4-c0a77a8a38f4 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1539 microversion: 2.91 time: 0.168806 Oct 19 03:16:10.449881 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 613/1177] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:16:10 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1539 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:16:10.478714 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-66116acb-4847-4492-bff9-2640dfc90f75 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:10.480166 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-66116acb-4847-4492-bff9-2640dfc90f75 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 62133546-4a75-4532-81ab-0c49c9252e85] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:10.486483 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-66116acb-4847-4492-bff9-2640dfc90f75 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:10.487200 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-66116acb-4847-4492-bff9-2640dfc90f75 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:10.487840 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-66116acb-4847-4492-bff9-2640dfc90f75 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:10.488854 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-66116acb-4847-4492-bff9-2640dfc90f75 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:10.489568 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-66116acb-4847-4492-bff9-2640dfc90f75 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:10.490334 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-66116acb-4847-4492-bff9-2640dfc90f75 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:10.506894 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4a75b8cf-c7ab-4ba8-be9e-8b86bc369711 tempest-ServicesAdminNegativeV253TestJSON-216803440 tempest-ServicesAdminNegativeV253TestJSON-216803440-project-admin] Action: 'update', calling method: .version_select at 0x7fc130b4a430>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:16:10.510719 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4a75b8cf-c7ab-4ba8-be9e-8b86bc369711 tempest-ServicesAdminNegativeV253TestJSON-216803440 tempest-ServicesAdminNegativeV253TestJSON-216803440-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:10.511145 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4a75b8cf-c7ab-4ba8-be9e-8b86bc369711 tempest-ServicesAdminNegativeV253TestJSON-216803440 tempest-ServicesAdminNegativeV253TestJSON-216803440-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:10.512020 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4a75b8cf-c7ab-4ba8-be9e-8b86bc369711 tempest-ServicesAdminNegativeV253TestJSON-216803440 tempest-ServicesAdminNegativeV253TestJSON-216803440-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:10.520244 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4a75b8cf-c7ab-4ba8-be9e-8b86bc369711 tempest-ServicesAdminNegativeV253TestJSON-216803440 tempest-ServicesAdminNegativeV253TestJSON-216803440-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:10.520737 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4a75b8cf-c7ab-4ba8-be9e-8b86bc369711 tempest-ServicesAdminNegativeV253TestJSON-216803440 tempest-ServicesAdminNegativeV253TestJSON-216803440-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:10.524237 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4a75b8cf-c7ab-4ba8-be9e-8b86bc369711 tempest-ServicesAdminNegativeV253TestJSON-216803440 tempest-ServicesAdminNegativeV253TestJSON-216803440-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:10.533787 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-4a75b8cf-c7ab-4ba8-be9e-8b86bc369711 tempest-ServicesAdminNegativeV253TestJSON-216803440 tempest-ServicesAdminNegativeV253TestJSON-216803440-project-admin] HTTP exception thrown: Service 9b041cd9-ddd1-41cc-8302-4c2627aaa2a8 could not be found. Oct 19 03:16:10.536584 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4a75b8cf-c7ab-4ba8-be9e-8b86bc369711 tempest-ServicesAdminNegativeV253TestJSON-216803440 tempest-ServicesAdminNegativeV253TestJSON-216803440-project-admin] Request method failure captured: Oct 19 03:16:10.536584 n-d-861333-8 devstack@n-api.service[121134]: request: PUT /compute/v2.1/os-services/9b041cd9-ddd1-41cc-8302-4c2627aaa2a8 HTTP/1.1 Oct 19 03:16:10.536584 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:16:10.536584 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:16:10.536584 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:16:10.536584 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 56 Oct 19 03:16:10.536584 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:16:10.536584 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:16:10.536584 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:16:10.536584 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:16:10.536584 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT2v5u88ud6yHRKEHx17CWqw1WF6YLfjoQs_8iAeBEH_q6x2tEZHc1UhzOQDz9yQFvteTN0ZtU-hXn0tspMjBsFHuThQH37GpCvGLaQpvpXwkBpibEHGKLdJMXlmi8gp0aj9F_6v_fApdX_iJE3GNudrfYsl8hiZvSIIUaoz_Rmq0gHY Oct 19 03:16:10.536584 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:16:10.536584 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:16:10.536584 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:16:10.536584 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:16:10.536584 n-d-861333-8 devstack@n-api.service[121134]: X-Openstack-Nova-Api-Version: 2.53 Oct 19 03:16:10.536584 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:16:10.536584 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:16:10.536584 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: efa8812376f14d1baa6605f8b4fab8ad Oct 19 03:16:10.536584 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-216803440 Oct 19 03:16:10.536584 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member,admin Oct 19 03:16:10.536584 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member,admin Oct 19 03:16:10.546014 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/efa8812376f14d1baa6605f8b4fab8ad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/efa8812376f14d1baa6605f8b4fab8ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/efa8812376f14d1baa6605f8b4fab8ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_efa8812376f14d1baa6605f8b4fab8ad", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:16:10.546014 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-216803440 Oct 19 03:16:10.546014 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: efa8812376f14d1baa6605f8b4fab8ad Oct 19 03:16:10.546014 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-216803440 Oct 19 03:16:10.546014 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ServicesAdminNegativeV253TestJSON-216803440-project-admin Oct 19 03:16:10.546014 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:16:10.546014 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:16:10.546014 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: b031429b4efe415e9d1707e8083ad930 Oct 19 03:16:10.546014 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-216803440-project-admin Oct 19 03:16:10.546014 n-d-861333-8 devstack@n-api.service[121134]: Oct 19 03:16:10.546014 n-d-861333-8 devstack@n-api.service[121134]: {"status": "disabled", "disabled_reason": "maintenance"} Oct 19 03:16:10.546014 n-d-861333-8 devstack@n-api.service[121134]: method: Oct 19 03:16:10.546014 n-d-861333-8 devstack@n-api.service[121134]: exception: Service 9b041cd9-ddd1-41cc-8302-4c2627aaa2a8 could not be found. Oct 19 03:16:10.547067 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '9b041cd9-ddd1-41cc-8302-4c2627aaa2a8', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Oct 19 03:16:10.547067 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:16:10.547067 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:16:10.547067 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 19 03:16:10.547067 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 19 03:16:10.547067 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 19 03:16:10.547067 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 19 03:16:10.547067 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 19 03:16:10.547067 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:16:10.547067 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:16:10.547067 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:16:10.547067 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:16:10.547067 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 19 03:16:10.547067 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 19 03:16:10.547067 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 19 03:16:10.547067 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 19 03:16:10.547067 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 9b041cd9-ddd1-41cc-8302-4c2627aaa2a8 could not be found. Oct 19 03:16:10.547067 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:16:10.547067 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:16:10.547067 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:16:10.547067 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:16:10.548618 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:16:10.548618 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:16:10.548618 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:16:10.548618 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:16:10.548618 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 03:16:10.548618 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 03:16:10.548618 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:16:10.548618 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:16:10.548618 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:16:10.548618 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:16:10.548618 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 19 03:16:10.548618 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:16:10.548618 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 9b041cd9-ddd1-41cc-8302-4c2627aaa2a8 could not be found. Oct 19 03:16:10.548618 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:16:10.548618 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:16:10.548618 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:16:10.548618 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:16:10.548618 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:16:10.548618 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:16:10.548618 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:16:10.551127 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:16:10.551127 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 9b041cd9-ddd1-41cc-8302-4c2627aaa2a8 could not be found. Oct 19 03:16:10.551127 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:16:10.551127 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4a75b8cf-c7ab-4ba8-be9e-8b86bc369711 tempest-ServicesAdminNegativeV253TestJSON-216803440 tempest-ServicesAdminNegativeV253TestJSON-216803440-project-admin] Returning 404 to user: Service 9b041cd9-ddd1-41cc-8302-4c2627aaa2a8 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:16:10.551127 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4a75b8cf-c7ab-4ba8-be9e-8b86bc369711 tempest-ServicesAdminNegativeV253TestJSON-216803440 tempest-ServicesAdminNegativeV253TestJSON-216803440-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-services/9b041cd9-ddd1-41cc-8302-4c2627aaa2a8" status: 404 len: 110 microversion: 2.53 time: 0.199786 Oct 19 03:16:10.551127 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 565/1178] 10.222.0.52 () {62 vars in 1309 bytes} [Wed Oct 19 03:16:10 2022] PUT /compute/v2.1/os-services/9b041cd9-ddd1-41cc-8302-4c2627aaa2a8 => generated 110 bytes in 201 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 19 03:16:10.551127 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ad2a9dc6-4d49-4996-bc66-50c72040dfb7 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:10.551930 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ad2a9dc6-4d49-4996-bc66-50c72040dfb7 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 9daa020d-efe7-4033-a479-cb5dadbc3ad7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:10.553554 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ad2a9dc6-4d49-4996-bc66-50c72040dfb7 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:10.556500 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ad2a9dc6-4d49-4996-bc66-50c72040dfb7 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:10.556500 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ad2a9dc6-4d49-4996-bc66-50c72040dfb7 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:10.556500 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ad2a9dc6-4d49-4996-bc66-50c72040dfb7 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:10.556500 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ad2a9dc6-4d49-4996-bc66-50c72040dfb7 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:10.557074 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ad2a9dc6-4d49-4996-bc66-50c72040dfb7 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:10.786670 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-66116acb-4847-4492-bff9-2640dfc90f75 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:10.795990 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-66116acb-4847-4492-bff9-2640dfc90f75 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:10.797493 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-66116acb-4847-4492-bff9-2640dfc90f75 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:10.798623 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-66116acb-4847-4492-bff9-2640dfc90f75 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85" status: 200 len: 1410 microversion: 2.25 time: 0.331564 Oct 19 03:16:10.799183 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 614/1179] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:16:10 2022] GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85 => generated 1410 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:16:10.803884 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e9fe67f6-334e-4954-987d-38b98aaf92d7 tempest-ServicesAdminNegativeV253TestJSON-216803440 tempest-ServicesAdminNegativeV253TestJSON-216803440-project-admin] Action: 'update', calling method: .version_select at 0x7fc1310f6a60>, body: {"status": "disabled"} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:16:10.807569 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e9fe67f6-334e-4954-987d-38b98aaf92d7 tempest-ServicesAdminNegativeV253TestJSON-216803440 tempest-ServicesAdminNegativeV253TestJSON-216803440-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:10.808258 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e9fe67f6-334e-4954-987d-38b98aaf92d7 tempest-ServicesAdminNegativeV253TestJSON-216803440 tempest-ServicesAdminNegativeV253TestJSON-216803440-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:10.808866 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e9fe67f6-334e-4954-987d-38b98aaf92d7 tempest-ServicesAdminNegativeV253TestJSON-216803440 tempest-ServicesAdminNegativeV253TestJSON-216803440-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:10.816784 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e9fe67f6-334e-4954-987d-38b98aaf92d7 tempest-ServicesAdminNegativeV253TestJSON-216803440 tempest-ServicesAdminNegativeV253TestJSON-216803440-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:10.817270 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e9fe67f6-334e-4954-987d-38b98aaf92d7 tempest-ServicesAdminNegativeV253TestJSON-216803440 tempest-ServicesAdminNegativeV253TestJSON-216803440-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:10.817742 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e9fe67f6-334e-4954-987d-38b98aaf92d7 tempest-ServicesAdminNegativeV253TestJSON-216803440 tempest-ServicesAdminNegativeV253TestJSON-216803440-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:10.824157 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-e9fe67f6-334e-4954-987d-38b98aaf92d7 tempest-ServicesAdminNegativeV253TestJSON-216803440 tempest-ServicesAdminNegativeV253TestJSON-216803440-project-admin] HTTP exception thrown: Service 9b041cd9-ddd1-41cc-8302-4c2627aaa2a8 could not be found. Oct 19 03:16:10.827834 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e9fe67f6-334e-4954-987d-38b98aaf92d7 tempest-ServicesAdminNegativeV253TestJSON-216803440 tempest-ServicesAdminNegativeV253TestJSON-216803440-project-admin] Request method failure captured: Oct 19 03:16:10.827834 n-d-861333-8 devstack@n-api.service[121135]: request: PUT /compute/v2.1/os-services/9b041cd9-ddd1-41cc-8302-4c2627aaa2a8 HTTP/1.1 Oct 19 03:16:10.827834 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:16:10.827834 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:16:10.827834 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:16:10.827834 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 22 Oct 19 03:16:10.827834 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:16:10.827834 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:16:10.827834 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:16:10.827834 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:16:10.827834 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2v5u88ud6yHRKEHx17CWqw1WF6YLfjoQs_8iAeBEH_q6x2tEZHc1UhzOQDz9yQFvteTN0ZtU-hXn0tspMjBsFHuThQH37GpCvGLaQpvpXwkBpibEHGKLdJMXlmi8gp0aj9F_6v_fApdX_iJE3GNudrfYsl8hiZvSIIUaoz_Rmq0gHY Oct 19 03:16:10.827834 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:16:10.827834 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:16:10.827834 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:16:10.827834 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:16:10.827834 n-d-861333-8 devstack@n-api.service[121135]: X-Openstack-Nova-Api-Version: 2.53 Oct 19 03:16:10.827834 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:16:10.827834 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:16:10.827834 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: efa8812376f14d1baa6605f8b4fab8ad Oct 19 03:16:10.827834 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-216803440 Oct 19 03:16:10.827834 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member,admin Oct 19 03:16:10.827834 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member,admin Oct 19 03:16:10.829500 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/efa8812376f14d1baa6605f8b4fab8ad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/efa8812376f14d1baa6605f8b4fab8ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/efa8812376f14d1baa6605f8b4fab8ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_efa8812376f14d1baa6605f8b4fab8ad", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:16:10.829500 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-216803440 Oct 19 03:16:10.829500 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: efa8812376f14d1baa6605f8b4fab8ad Oct 19 03:16:10.829500 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-216803440 Oct 19 03:16:10.829500 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ServicesAdminNegativeV253TestJSON-216803440-project-admin Oct 19 03:16:10.829500 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:16:10.829500 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:16:10.829500 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: b031429b4efe415e9d1707e8083ad930 Oct 19 03:16:10.829500 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-216803440-project-admin Oct 19 03:16:10.829500 n-d-861333-8 devstack@n-api.service[121135]: Oct 19 03:16:10.829500 n-d-861333-8 devstack@n-api.service[121135]: {"status": "disabled"} Oct 19 03:16:10.829500 n-d-861333-8 devstack@n-api.service[121135]: method: Oct 19 03:16:10.829500 n-d-861333-8 devstack@n-api.service[121135]: exception: Service 9b041cd9-ddd1-41cc-8302-4c2627aaa2a8 could not be found. Oct 19 03:16:10.829500 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '9b041cd9-ddd1-41cc-8302-4c2627aaa2a8', 'body': {'status': 'disabled'}} Oct 19 03:16:10.830535 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:16:10.830535 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:16:10.830535 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 19 03:16:10.830535 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 19 03:16:10.830535 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 19 03:16:10.830535 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 19 03:16:10.830535 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 19 03:16:10.830535 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:16:10.830535 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:16:10.830535 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:16:10.830535 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:16:10.830535 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 19 03:16:10.830535 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 19 03:16:10.830535 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 19 03:16:10.830535 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 19 03:16:10.830535 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 9b041cd9-ddd1-41cc-8302-4c2627aaa2a8 could not be found. Oct 19 03:16:10.830535 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:16:10.830535 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:16:10.830535 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:16:10.830535 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:16:10.830535 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:16:10.831949 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:16:10.831949 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:16:10.831949 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:16:10.831949 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 03:16:10.831949 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 03:16:10.831949 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:16:10.831949 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:16:10.831949 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:16:10.831949 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:16:10.831949 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 19 03:16:10.831949 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:16:10.831949 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 9b041cd9-ddd1-41cc-8302-4c2627aaa2a8 could not be found. Oct 19 03:16:10.831949 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:16:10.831949 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:16:10.831949 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:16:10.831949 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:16:10.831949 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:16:10.831949 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:16:10.831949 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:16:10.831949 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:16:10.833290 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 9b041cd9-ddd1-41cc-8302-4c2627aaa2a8 could not be found. Oct 19 03:16:10.833290 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:16:10.833290 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e9fe67f6-334e-4954-987d-38b98aaf92d7 tempest-ServicesAdminNegativeV253TestJSON-216803440 tempest-ServicesAdminNegativeV253TestJSON-216803440-project-admin] Returning 404 to user: Service 9b041cd9-ddd1-41cc-8302-4c2627aaa2a8 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:16:10.833290 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e9fe67f6-334e-4954-987d-38b98aaf92d7 tempest-ServicesAdminNegativeV253TestJSON-216803440 tempest-ServicesAdminNegativeV253TestJSON-216803440-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-services/9b041cd9-ddd1-41cc-8302-4c2627aaa2a8" status: 404 len: 110 microversion: 2.53 time: 0.027563 Oct 19 03:16:10.833290 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 615/1180] 10.222.0.52 () {62 vars in 1309 bytes} [Wed Oct 19 03:16:10 2022] PUT /compute/v2.1/os-services/9b041cd9-ddd1-41cc-8302-4c2627aaa2a8 => generated 110 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 19 03:16:10.839967 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d466c4dd-c4d3-4f03-b044-afa5c84ec0dd tempest-ServicesAdminNegativeV253TestJSON-216803440 tempest-ServicesAdminNegativeV253TestJSON-216803440-project-admin] Action: 'update', calling method: .version_select at 0x7fc131446040>, body: {"status": "enabled"} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:16:10.843751 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d466c4dd-c4d3-4f03-b044-afa5c84ec0dd tempest-ServicesAdminNegativeV253TestJSON-216803440 tempest-ServicesAdminNegativeV253TestJSON-216803440-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:10.844251 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d466c4dd-c4d3-4f03-b044-afa5c84ec0dd tempest-ServicesAdminNegativeV253TestJSON-216803440 tempest-ServicesAdminNegativeV253TestJSON-216803440-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:10.844801 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d466c4dd-c4d3-4f03-b044-afa5c84ec0dd tempest-ServicesAdminNegativeV253TestJSON-216803440 tempest-ServicesAdminNegativeV253TestJSON-216803440-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:10.850670 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d466c4dd-c4d3-4f03-b044-afa5c84ec0dd tempest-ServicesAdminNegativeV253TestJSON-216803440 tempest-ServicesAdminNegativeV253TestJSON-216803440-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:10.851269 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d466c4dd-c4d3-4f03-b044-afa5c84ec0dd tempest-ServicesAdminNegativeV253TestJSON-216803440 tempest-ServicesAdminNegativeV253TestJSON-216803440-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:10.852252 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d466c4dd-c4d3-4f03-b044-afa5c84ec0dd tempest-ServicesAdminNegativeV253TestJSON-216803440 tempest-ServicesAdminNegativeV253TestJSON-216803440-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:10.857295 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-d466c4dd-c4d3-4f03-b044-afa5c84ec0dd tempest-ServicesAdminNegativeV253TestJSON-216803440 tempest-ServicesAdminNegativeV253TestJSON-216803440-project-admin] HTTP exception thrown: Service 9b041cd9-ddd1-41cc-8302-4c2627aaa2a8 could not be found. Oct 19 03:16:10.858967 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d466c4dd-c4d3-4f03-b044-afa5c84ec0dd tempest-ServicesAdminNegativeV253TestJSON-216803440 tempest-ServicesAdminNegativeV253TestJSON-216803440-project-admin] Request method failure captured: Oct 19 03:16:10.858967 n-d-861333-8 devstack@n-api.service[121135]: request: PUT /compute/v2.1/os-services/9b041cd9-ddd1-41cc-8302-4c2627aaa2a8 HTTP/1.1 Oct 19 03:16:10.858967 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:16:10.858967 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:16:10.858967 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:16:10.858967 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 21 Oct 19 03:16:10.858967 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:16:10.858967 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:16:10.858967 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:16:10.858967 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:16:10.858967 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2v5u88ud6yHRKEHx17CWqw1WF6YLfjoQs_8iAeBEH_q6x2tEZHc1UhzOQDz9yQFvteTN0ZtU-hXn0tspMjBsFHuThQH37GpCvGLaQpvpXwkBpibEHGKLdJMXlmi8gp0aj9F_6v_fApdX_iJE3GNudrfYsl8hiZvSIIUaoz_Rmq0gHY Oct 19 03:16:10.858967 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:16:10.858967 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:16:10.858967 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:16:10.858967 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:16:10.858967 n-d-861333-8 devstack@n-api.service[121135]: X-Openstack-Nova-Api-Version: 2.53 Oct 19 03:16:10.858967 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:16:10.858967 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:16:10.858967 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: efa8812376f14d1baa6605f8b4fab8ad Oct 19 03:16:10.858967 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-216803440 Oct 19 03:16:10.858967 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member,admin Oct 19 03:16:10.858967 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member,admin Oct 19 03:16:10.860692 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/efa8812376f14d1baa6605f8b4fab8ad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/efa8812376f14d1baa6605f8b4fab8ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/efa8812376f14d1baa6605f8b4fab8ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_efa8812376f14d1baa6605f8b4fab8ad", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:16:10.860692 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-216803440 Oct 19 03:16:10.860692 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: efa8812376f14d1baa6605f8b4fab8ad Oct 19 03:16:10.860692 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-216803440 Oct 19 03:16:10.860692 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ServicesAdminNegativeV253TestJSON-216803440-project-admin Oct 19 03:16:10.860692 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:16:10.860692 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:16:10.860692 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: b031429b4efe415e9d1707e8083ad930 Oct 19 03:16:10.860692 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-216803440-project-admin Oct 19 03:16:10.860692 n-d-861333-8 devstack@n-api.service[121135]: Oct 19 03:16:10.860692 n-d-861333-8 devstack@n-api.service[121135]: {"status": "enabled"} Oct 19 03:16:10.860692 n-d-861333-8 devstack@n-api.service[121135]: method: Oct 19 03:16:10.860692 n-d-861333-8 devstack@n-api.service[121135]: exception: Service 9b041cd9-ddd1-41cc-8302-4c2627aaa2a8 could not be found. Oct 19 03:16:10.860692 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '9b041cd9-ddd1-41cc-8302-4c2627aaa2a8', 'body': {'status': 'enabled'}} Oct 19 03:16:10.861579 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:16:10.861579 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:16:10.861579 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 19 03:16:10.861579 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 19 03:16:10.861579 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 19 03:16:10.861579 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 19 03:16:10.861579 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 19 03:16:10.861579 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:16:10.861579 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:16:10.861579 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:16:10.861579 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:16:10.861579 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 19 03:16:10.861579 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 19 03:16:10.861579 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 19 03:16:10.861579 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 19 03:16:10.861579 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 9b041cd9-ddd1-41cc-8302-4c2627aaa2a8 could not be found. Oct 19 03:16:10.861579 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:16:10.861579 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:16:10.861579 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:16:10.861579 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:16:10.861579 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:16:10.862817 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:16:10.862817 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:16:10.862817 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:16:10.862817 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 03:16:10.862817 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 03:16:10.862817 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:16:10.862817 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:16:10.862817 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:16:10.862817 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:16:10.862817 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 19 03:16:10.862817 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:16:10.862817 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 9b041cd9-ddd1-41cc-8302-4c2627aaa2a8 could not be found. Oct 19 03:16:10.862817 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:16:10.862817 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:16:10.862817 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:16:10.862817 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:16:10.862817 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:16:10.862817 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:16:10.862817 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:16:10.862817 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:16:10.863981 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 9b041cd9-ddd1-41cc-8302-4c2627aaa2a8 could not be found. Oct 19 03:16:10.863981 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:16:10.863981 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d466c4dd-c4d3-4f03-b044-afa5c84ec0dd tempest-ServicesAdminNegativeV253TestJSON-216803440 tempest-ServicesAdminNegativeV253TestJSON-216803440-project-admin] Returning 404 to user: Service 9b041cd9-ddd1-41cc-8302-4c2627aaa2a8 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:16:10.863981 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d466c4dd-c4d3-4f03-b044-afa5c84ec0dd tempest-ServicesAdminNegativeV253TestJSON-216803440 tempest-ServicesAdminNegativeV253TestJSON-216803440-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-services/9b041cd9-ddd1-41cc-8302-4c2627aaa2a8" status: 404 len: 110 microversion: 2.53 time: 0.025715 Oct 19 03:16:10.866876 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 616/1181] 10.222.0.52 () {62 vars in 1309 bytes} [Wed Oct 19 03:16:10 2022] PUT /compute/v2.1/os-services/9b041cd9-ddd1-41cc-8302-4c2627aaa2a8 => generated 110 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 19 03:16:10.869091 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ad2a9dc6-4d49-4996-bc66-50c72040dfb7 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:10.874026 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3eed606a-f339-468c-849f-941310cd70a3 tempest-ServicesAdminNegativeV253TestJSON-216803440 tempest-ServicesAdminNegativeV253TestJSON-216803440-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:10.878335 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3eed606a-f339-468c-849f-941310cd70a3 tempest-ServicesAdminNegativeV253TestJSON-216803440 tempest-ServicesAdminNegativeV253TestJSON-216803440-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:10.878772 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3eed606a-f339-468c-849f-941310cd70a3 tempest-ServicesAdminNegativeV253TestJSON-216803440 tempest-ServicesAdminNegativeV253TestJSON-216803440-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:10.879125 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ad2a9dc6-4d49-4996-bc66-50c72040dfb7 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7" status: 200 len: 1542 microversion: 2.1 time: 0.338365 Oct 19 03:16:10.879242 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3eed606a-f339-468c-849f-941310cd70a3 tempest-ServicesAdminNegativeV253TestJSON-216803440 tempest-ServicesAdminNegativeV253TestJSON-216803440-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:10.881406 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3eed606a-f339-468c-849f-941310cd70a3 tempest-ServicesAdminNegativeV253TestJSON-216803440 tempest-ServicesAdminNegativeV253TestJSON-216803440-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:10.881553 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 566/1182] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:10 2022] GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7 => generated 1542 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:16:10.881729 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3eed606a-f339-468c-849f-941310cd70a3 tempest-ServicesAdminNegativeV253TestJSON-216803440 tempest-ServicesAdminNegativeV253TestJSON-216803440-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:10.881729 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3eed606a-f339-468c-849f-941310cd70a3 tempest-ServicesAdminNegativeV253TestJSON-216803440 tempest-ServicesAdminNegativeV253TestJSON-216803440-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:10.907247 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-3eed606a-f339-468c-849f-941310cd70a3 tempest-ServicesAdminNegativeV253TestJSON-216803440 tempest-ServicesAdminNegativeV253TestJSON-216803440-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.036966 Oct 19 03:16:10.908187 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 617/1183] 10.222.0.52 () {60 vars in 1178 bytes} [Wed Oct 19 03:16:10 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:16:10.921996 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-13c0f57a-f50b-4440-9527-47e17eeeb7a2 tempest-ServicesAdminNegativeV253TestJSON-216803440 tempest-ServicesAdminNegativeV253TestJSON-216803440-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:10.925805 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-13c0f57a-f50b-4440-9527-47e17eeeb7a2 tempest-ServicesAdminNegativeV253TestJSON-216803440 tempest-ServicesAdminNegativeV253TestJSON-216803440-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:10.926295 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-13c0f57a-f50b-4440-9527-47e17eeeb7a2 tempest-ServicesAdminNegativeV253TestJSON-216803440 tempest-ServicesAdminNegativeV253TestJSON-216803440-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:10.926737 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-13c0f57a-f50b-4440-9527-47e17eeeb7a2 tempest-ServicesAdminNegativeV253TestJSON-216803440 tempest-ServicesAdminNegativeV253TestJSON-216803440-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:10.927461 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-13c0f57a-f50b-4440-9527-47e17eeeb7a2 tempest-ServicesAdminNegativeV253TestJSON-216803440 tempest-ServicesAdminNegativeV253TestJSON-216803440-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:10.927916 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-13c0f57a-f50b-4440-9527-47e17eeeb7a2 tempest-ServicesAdminNegativeV253TestJSON-216803440 tempest-ServicesAdminNegativeV253TestJSON-216803440-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:10.928342 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-13c0f57a-f50b-4440-9527-47e17eeeb7a2 tempest-ServicesAdminNegativeV253TestJSON-216803440 tempest-ServicesAdminNegativeV253TestJSON-216803440-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:10.954088 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-13c0f57a-f50b-4440-9527-47e17eeeb7a2 tempest-ServicesAdminNegativeV253TestJSON-216803440 tempest-ServicesAdminNegativeV253TestJSON-216803440-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.036365 Oct 19 03:16:10.954710 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 567/1184] 10.222.0.52 () {60 vars in 1211 bytes} [Wed Oct 19 03:16:10 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1239 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:16:10.968792 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-031aa16a-dd76-4901-baee-1d80903f5e66 tempest-ServicesAdminNegativeV253TestJSON-216803440 tempest-ServicesAdminNegativeV253TestJSON-216803440-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:10.973612 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-031aa16a-dd76-4901-baee-1d80903f5e66 tempest-ServicesAdminNegativeV253TestJSON-216803440 tempest-ServicesAdminNegativeV253TestJSON-216803440-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:10.974114 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-031aa16a-dd76-4901-baee-1d80903f5e66 tempest-ServicesAdminNegativeV253TestJSON-216803440 tempest-ServicesAdminNegativeV253TestJSON-216803440-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:10.974706 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-031aa16a-dd76-4901-baee-1d80903f5e66 tempest-ServicesAdminNegativeV253TestJSON-216803440 tempest-ServicesAdminNegativeV253TestJSON-216803440-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:10.975448 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-031aa16a-dd76-4901-baee-1d80903f5e66 tempest-ServicesAdminNegativeV253TestJSON-216803440 tempest-ServicesAdminNegativeV253TestJSON-216803440-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:10.975902 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-031aa16a-dd76-4901-baee-1d80903f5e66 tempest-ServicesAdminNegativeV253TestJSON-216803440 tempest-ServicesAdminNegativeV253TestJSON-216803440-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:10.976506 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-031aa16a-dd76-4901-baee-1d80903f5e66 tempest-ServicesAdminNegativeV253TestJSON-216803440 tempest-ServicesAdminNegativeV253TestJSON-216803440-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:11.001704 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-031aa16a-dd76-4901-baee-1d80903f5e66 tempest-ServicesAdminNegativeV253TestJSON-216803440 tempest-ServicesAdminNegativeV253TestJSON-216803440-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.036528 Oct 19 03:16:11.002469 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 618/1185] 10.222.0.52 () {60 vars in 1178 bytes} [Wed Oct 19 03:16:10 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:16:11.014831 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d1998d7f-0dc0-430e-822a-63830c3fbf58 tempest-ServicesAdminNegativeV253TestJSON-216803440 tempest-ServicesAdminNegativeV253TestJSON-216803440-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:11.018795 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d1998d7f-0dc0-430e-822a-63830c3fbf58 tempest-ServicesAdminNegativeV253TestJSON-216803440 tempest-ServicesAdminNegativeV253TestJSON-216803440-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:11.019289 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d1998d7f-0dc0-430e-822a-63830c3fbf58 tempest-ServicesAdminNegativeV253TestJSON-216803440 tempest-ServicesAdminNegativeV253TestJSON-216803440-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:11.019733 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d1998d7f-0dc0-430e-822a-63830c3fbf58 tempest-ServicesAdminNegativeV253TestJSON-216803440 tempest-ServicesAdminNegativeV253TestJSON-216803440-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:11.020460 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d1998d7f-0dc0-430e-822a-63830c3fbf58 tempest-ServicesAdminNegativeV253TestJSON-216803440 tempest-ServicesAdminNegativeV253TestJSON-216803440-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:11.021118 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d1998d7f-0dc0-430e-822a-63830c3fbf58 tempest-ServicesAdminNegativeV253TestJSON-216803440 tempest-ServicesAdminNegativeV253TestJSON-216803440-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:11.021576 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d1998d7f-0dc0-430e-822a-63830c3fbf58 tempest-ServicesAdminNegativeV253TestJSON-216803440 tempest-ServicesAdminNegativeV253TestJSON-216803440-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:11.047431 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d1998d7f-0dc0-430e-822a-63830c3fbf58 tempest-ServicesAdminNegativeV253TestJSON-216803440 tempest-ServicesAdminNegativeV253TestJSON-216803440-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services?host=n-d-861333-8&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.036357 Oct 19 03:16:11.047962 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 568/1186] 10.222.0.52 () {60 vars in 1235 bytes} [Wed Oct 19 03:16:11 2022] GET /compute/v2.1/os-services?host=n-d-861333-8&binary=xxx => generated 16 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:16:11.060647 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0f6ec773-c715-4cea-b6a5-96fd2372eb23 tempest-ServicesAdminNegativeV253TestJSON-216803440 tempest-ServicesAdminNegativeV253TestJSON-216803440-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:11.064208 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0f6ec773-c715-4cea-b6a5-96fd2372eb23 tempest-ServicesAdminNegativeV253TestJSON-216803440 tempest-ServicesAdminNegativeV253TestJSON-216803440-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:11.064700 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0f6ec773-c715-4cea-b6a5-96fd2372eb23 tempest-ServicesAdminNegativeV253TestJSON-216803440 tempest-ServicesAdminNegativeV253TestJSON-216803440-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:11.065142 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0f6ec773-c715-4cea-b6a5-96fd2372eb23 tempest-ServicesAdminNegativeV253TestJSON-216803440 tempest-ServicesAdminNegativeV253TestJSON-216803440-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:11.065899 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0f6ec773-c715-4cea-b6a5-96fd2372eb23 tempest-ServicesAdminNegativeV253TestJSON-216803440 tempest-ServicesAdminNegativeV253TestJSON-216803440-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:11.066574 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0f6ec773-c715-4cea-b6a5-96fd2372eb23 tempest-ServicesAdminNegativeV253TestJSON-216803440 tempest-ServicesAdminNegativeV253TestJSON-216803440-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:11.067009 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0f6ec773-c715-4cea-b6a5-96fd2372eb23 tempest-ServicesAdminNegativeV253TestJSON-216803440 tempest-ServicesAdminNegativeV253TestJSON-216803440-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:11.091988 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0f6ec773-c715-4cea-b6a5-96fd2372eb23 tempest-ServicesAdminNegativeV253TestJSON-216803440 tempest-ServicesAdminNegativeV253TestJSON-216803440-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.035626 Oct 19 03:16:11.092611 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 619/1187] 10.222.0.52 () {60 vars in 1178 bytes} [Wed Oct 19 03:16:11 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:16:11.105670 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1166053d-6dc7-4de7-a84c-492f459c487b tempest-ServicesAdminNegativeV253TestJSON-216803440 tempest-ServicesAdminNegativeV253TestJSON-216803440-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:11.109283 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1166053d-6dc7-4de7-a84c-492f459c487b tempest-ServicesAdminNegativeV253TestJSON-216803440 tempest-ServicesAdminNegativeV253TestJSON-216803440-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:11.109912 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1166053d-6dc7-4de7-a84c-492f459c487b tempest-ServicesAdminNegativeV253TestJSON-216803440 tempest-ServicesAdminNegativeV253TestJSON-216803440-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:11.110359 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1166053d-6dc7-4de7-a84c-492f459c487b tempest-ServicesAdminNegativeV253TestJSON-216803440 tempest-ServicesAdminNegativeV253TestJSON-216803440-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:11.111092 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1166053d-6dc7-4de7-a84c-492f459c487b tempest-ServicesAdminNegativeV253TestJSON-216803440 tempest-ServicesAdminNegativeV253TestJSON-216803440-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:11.111557 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1166053d-6dc7-4de7-a84c-492f459c487b tempest-ServicesAdminNegativeV253TestJSON-216803440 tempest-ServicesAdminNegativeV253TestJSON-216803440-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:11.111982 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1166053d-6dc7-4de7-a84c-492f459c487b tempest-ServicesAdminNegativeV253TestJSON-216803440 tempest-ServicesAdminNegativeV253TestJSON-216803440-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:11.134809 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1166053d-6dc7-4de7-a84c-492f459c487b tempest-ServicesAdminNegativeV253TestJSON-216803440 tempest-ServicesAdminNegativeV253TestJSON-216803440-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.033582 Oct 19 03:16:11.135929 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 569/1188] 10.222.0.52 () {60 vars in 1239 bytes} [Wed Oct 19 03:16:11 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:16:11.254757 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7d367097-a36e-45f1-9be0-81a443578e25 tempest-ServicesAdminNegativeV253TestJSON-957789947 tempest-ServicesAdminNegativeV253TestJSON-957789947-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:11.258252 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7d367097-a36e-45f1-9be0-81a443578e25 tempest-ServicesAdminNegativeV253TestJSON-957789947 tempest-ServicesAdminNegativeV253TestJSON-957789947-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '6d076ac00e814aee973bd3270f524c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d36fe2be0de46eca22aca691716de85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:11.259854 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7d367097-a36e-45f1-9be0-81a443578e25 tempest-ServicesAdminNegativeV253TestJSON-957789947 tempest-ServicesAdminNegativeV253TestJSON-957789947-project] Request method failure captured: Oct 19 03:16:11.259854 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 19 03:16:11.259854 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:16:11.259854 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:16:11.259854 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:16:11.259854 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:16:11.259854 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:16:11.259854 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:16:11.259854 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:16:11.259854 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:16:11.259854 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2v4fvHm2ZdKXwJrBCuyN6-dlLb0jQZ8q_bZm2x7Y093VpKa8uIqWFNEXvwiDYp7BQozDym8h0UD8T_xd_3tVNxxmMB_KtE0NDG2xCydFsM8CHAlYU4qQJNqr4E6mvUcuFN2zdbE2HXjBY-zv0saZ0wpuRe62jFaLlUK9VigRfELnGo Oct 19 03:16:11.259854 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:16:11.259854 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:16:11.259854 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:16:11.259854 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:16:11.259854 n-d-861333-8 devstack@n-api.service[121135]: X-Openstack-Nova-Api-Version: 2.53 Oct 19 03:16:11.259854 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:16:11.259854 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:16:11.259854 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 9d36fe2be0de46eca22aca691716de85 Oct 19 03:16:11.259854 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-957789947 Oct 19 03:16:11.259854 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:16:11.259854 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:16:11.261980 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9d36fe2be0de46eca22aca691716de85"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9d36fe2be0de46eca22aca691716de85"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9d36fe2be0de46eca22aca691716de85"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9d36fe2be0de46eca22aca691716de85", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:16:11.261980 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-957789947 Oct 19 03:16:11.261980 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 9d36fe2be0de46eca22aca691716de85 Oct 19 03:16:11.261980 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-957789947 Oct 19 03:16:11.261980 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ServicesAdminNegativeV253TestJSON-957789947-project Oct 19 03:16:11.261980 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:16:11.261980 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:16:11.261980 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 6d076ac00e814aee973bd3270f524c02 Oct 19 03:16:11.261980 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-957789947-project Oct 19 03:16:11.261980 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:16:11.261980 n-d-861333-8 devstack@n-api.service[121135]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 19 03:16:11.261980 n-d-861333-8 devstack@n-api.service[121135]: action_args: {} Oct 19 03:16:11.263217 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:16:11.263217 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:16:11.263217 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:16:11.263217 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:16:11.263217 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:16:11.263217 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:16:11.263217 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 19 03:16:11.263217 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:16:11.263217 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 19 03:16:11.263217 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:16:11.263217 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:16:11.263217 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:16:11.263217 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 19 03:16:11.263217 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 19 03:16:11.263217 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 19 03:16:11.263217 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 19 03:16:11.263217 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 19 03:16:11.263217 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 19 03:16:11.263217 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 03:16:11.264612 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 03:16:11.264612 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 03:16:11.264612 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 03:16:11.264612 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 19 03:16:11.264612 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 19 03:16:11.264612 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 19 03:16:11.264612 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 19 03:16:11.264612 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 19 03:16:11.264612 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 19 03:16:11.264612 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 19 03:16:11.264612 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:16:11.264612 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:16:11.264612 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:16:11.264612 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:16:11.264612 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:16:11.264612 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:16:11.264612 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 19 03:16:11.264612 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 19 03:16:11.264612 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 19 03:16:11.264612 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:16:11.265890 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7d367097-a36e-45f1-9be0-81a443578e25 tempest-ServicesAdminNegativeV253TestJSON-957789947 tempest-ServicesAdminNegativeV253TestJSON-957789947-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:16:11.265890 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7d367097-a36e-45f1-9be0-81a443578e25 tempest-ServicesAdminNegativeV253TestJSON-957789947 tempest-ServicesAdminNegativeV253TestJSON-957789947-project] 10.222.0.52 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.117362 Oct 19 03:16:11.265890 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 620/1189] 10.222.0.52 () {60 vars in 1178 bytes} [Wed Oct 19 03:16:11 2022] GET /compute/v2.1/os-services => generated 112 bytes in 118 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Oct 19 03:16:11.301346 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-501ff7b0-db34-4375-aee0-875a8c004b86 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:11.302009 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-501ff7b0-db34-4375-aee0-875a8c004b86 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 1ee8c251-b609-4eeb-9406-ede7977b3f92] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:11.308554 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-501ff7b0-db34-4375-aee0-875a8c004b86 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:11.309136 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-501ff7b0-db34-4375-aee0-875a8c004b86 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:11.310039 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-501ff7b0-db34-4375-aee0-875a8c004b86 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:11.311300 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-501ff7b0-db34-4375-aee0-875a8c004b86 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:11.311841 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-501ff7b0-db34-4375-aee0-875a8c004b86 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:11.312276 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-501ff7b0-db34-4375-aee0-875a8c004b86 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:11.363443 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-303801bd-5fae-47e2-a202-1e9151ea282c tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:11.364540 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-303801bd-5fae-47e2-a202-1e9151ea282c tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] [instance: b18ae860-ed77-4ddc-b9fa-a2aa773c2614] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:11.372700 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-303801bd-5fae-47e2-a202-1e9151ea282c tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:11.373454 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-303801bd-5fae-47e2-a202-1e9151ea282c tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:11.374330 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-303801bd-5fae-47e2-a202-1e9151ea282c tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:11.375210 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-303801bd-5fae-47e2-a202-1e9151ea282c tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:11.375823 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-303801bd-5fae-47e2-a202-1e9151ea282c tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:11.376410 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-303801bd-5fae-47e2-a202-1e9151ea282c tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:11.547242 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-501ff7b0-db34-4375-aee0-875a8c004b86 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:11.560188 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-501ff7b0-db34-4375-aee0-875a8c004b86 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/1ee8c251-b609-4eeb-9406-ede7977b3f92" status: 200 len: 1317 microversion: 2.1 time: 0.262619 Oct 19 03:16:11.560783 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 570/1190] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:11 2022] GET /compute/v2.1/servers/1ee8c251-b609-4eeb-9406-ede7977b3f92 => generated 1317 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:16:11.572853 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e4f56658-a8b5-4f2b-b3ce-52e5348937b0 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:11.574020 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e4f56658-a8b5-4f2b-b3ce-52e5348937b0 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:11.581063 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e4f56658-a8b5-4f2b-b3ce-52e5348937b0 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:11.581772 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e4f56658-a8b5-4f2b-b3ce-52e5348937b0 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:11.592857 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e4f56658-a8b5-4f2b-b3ce-52e5348937b0 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:11.592857 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e4f56658-a8b5-4f2b-b3ce-52e5348937b0 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:11.592857 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e4f56658-a8b5-4f2b-b3ce-52e5348937b0 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:11.592857 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e4f56658-a8b5-4f2b-b3ce-52e5348937b0 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:11.593616 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-303801bd-5fae-47e2-a202-1e9151ea282c tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c1401b92c44228bd6e80dd3b786ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e388d05eac4f2babf180c0709fdc58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:11.602842 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=100 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:16:11.606387 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-303801bd-5fae-47e2-a202-1e9151ea282c tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] 10.222.0.52 "GET /compute/v2.1/servers/b18ae860-ed77-4ddc-b9fa-a2aa773c2614" status: 200 len: 1575 microversion: 2.1 time: 0.246702 Oct 19 03:16:11.613886 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 621/1191] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:11 2022] GET /compute/v2.1/servers/b18ae860-ed77-4ddc-b9fa-a2aa773c2614 => generated 1575 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:16:11.634320 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9ad31422-5a2b-4ba4-90a5-88c9290fadaa tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:11.634967 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9ad31422-5a2b-4ba4-90a5-88c9290fadaa tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] [instance: b18ae860-ed77-4ddc-b9fa-a2aa773c2614] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:11.644608 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9ad31422-5a2b-4ba4-90a5-88c9290fadaa tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:11.644608 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9ad31422-5a2b-4ba4-90a5-88c9290fadaa tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:11.644608 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9ad31422-5a2b-4ba4-90a5-88c9290fadaa tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:11.645179 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9ad31422-5a2b-4ba4-90a5-88c9290fadaa tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:11.645898 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9ad31422-5a2b-4ba4-90a5-88c9290fadaa tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:11.646538 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9ad31422-5a2b-4ba4-90a5-88c9290fadaa tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:11.669808 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e4f56658-a8b5-4f2b-b3ce-52e5348937b0 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:11.683059 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e4f56658-a8b5-4f2b-b3ce-52e5348937b0 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:11.686891 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e4f56658-a8b5-4f2b-b3ce-52e5348937b0 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:11.696705 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e4f56658-a8b5-4f2b-b3ce-52e5348937b0 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1539 microversion: 2.91 time: 0.134040 Oct 19 03:16:11.697282 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 571/1192] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:16:11 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1539 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:16:11.756295 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9ad31422-5a2b-4ba4-90a5-88c9290fadaa tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] 10.222.0.52 "GET /compute/v2.1/servers/b18ae860-ed77-4ddc-b9fa-a2aa773c2614/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.126077 Oct 19 03:16:11.759166 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 622/1193] 10.222.0.52 () {58 vars in 1275 bytes} [Wed Oct 19 03:16:11 2022] GET /compute/v2.1/servers/b18ae860-ed77-4ddc-b9fa-a2aa773c2614/os-interface => generated 284 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:16:11.823299 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6c111787-4771-4686-8bd1-e7b6b3021923 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:11.824215 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6c111787-4771-4686-8bd1-e7b6b3021923 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 62133546-4a75-4532-81ab-0c49c9252e85] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:11.836398 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6c111787-4771-4686-8bd1-e7b6b3021923 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:11.837119 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6c111787-4771-4686-8bd1-e7b6b3021923 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:11.837759 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6c111787-4771-4686-8bd1-e7b6b3021923 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:11.839159 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6c111787-4771-4686-8bd1-e7b6b3021923 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:11.839904 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6c111787-4771-4686-8bd1-e7b6b3021923 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:11.840545 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6c111787-4771-4686-8bd1-e7b6b3021923 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:11.908442 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-06126233-96ff-49c3-890c-88525204cb12 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:11.909066 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-06126233-96ff-49c3-890c-88525204cb12 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 9daa020d-efe7-4033-a479-cb5dadbc3ad7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:11.929836 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-06126233-96ff-49c3-890c-88525204cb12 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:11.930840 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-06126233-96ff-49c3-890c-88525204cb12 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:11.932685 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-06126233-96ff-49c3-890c-88525204cb12 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:11.938763 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-06126233-96ff-49c3-890c-88525204cb12 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:11.940486 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-06126233-96ff-49c3-890c-88525204cb12 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:11.941289 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-06126233-96ff-49c3-890c-88525204cb12 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:12.044042 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-6c111787-4771-4686-8bd1-e7b6b3021923 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:12.057074 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-6c111787-4771-4686-8bd1-e7b6b3021923 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:12.059392 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-6c111787-4771-4686-8bd1-e7b6b3021923 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:12.065747 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6c111787-4771-4686-8bd1-e7b6b3021923 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85" status: 200 len: 1410 microversion: 2.25 time: 0.246248 Oct 19 03:16:12.067551 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 572/1194] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:16:11 2022] GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85 => generated 1410 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:16:12.196860 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-06126233-96ff-49c3-890c-88525204cb12 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:12.210675 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-06126233-96ff-49c3-890c-88525204cb12 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7" status: 200 len: 1542 microversion: 2.1 time: 0.311374 Oct 19 03:16:12.211294 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 623/1195] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:11 2022] GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7 => generated 1542 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:16:12.323313 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-bbc78357-5f34-4100-b858-7b55364f6cbd req-3f4ce8d8-7106-4b8d-b3e3-1ab3e7f2e796 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62133546-4a75-4532-81ab-0c49c9252e85", "name": "network-vif-plugged", "status": "completed", "tag": "00532cca-3534-4784-9094-66d340359b0e"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:16:12.332950 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-bbc78357-5f34-4100-b858-7b55364f6cbd req-3f4ce8d8-7106-4b8d-b3e3-1ab3e7f2e796 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:12.333453 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-bbc78357-5f34-4100-b858-7b55364f6cbd req-3f4ce8d8-7106-4b8d-b3e3-1ab3e7f2e796 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:12.333888 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-bbc78357-5f34-4100-b858-7b55364f6cbd req-3f4ce8d8-7106-4b8d-b3e3-1ab3e7f2e796 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:12.345870 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-bbc78357-5f34-4100-b858-7b55364f6cbd req-3f4ce8d8-7106-4b8d-b3e3-1ab3e7f2e796 service nova] Creating event network-vif-plugged:00532cca-3534-4784-9094-66d340359b0e for instance 62133546-4a75-4532-81ab-0c49c9252e85 on n-h1-861333-8 Oct 19 03:16:12.350716 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-bbc78357-5f34-4100-b858-7b55364f6cbd req-3f4ce8d8-7106-4b8d-b3e3-1ab3e7f2e796 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031951 Oct 19 03:16:12.351496 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 573/1196] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:16:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:16:12.583687 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9a9c4e25-dfde-4e8e-94a5-9cdf738901fc tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:12.584373 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9a9c4e25-dfde-4e8e-94a5-9cdf738901fc tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 1ee8c251-b609-4eeb-9406-ede7977b3f92] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:12.591273 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9a9c4e25-dfde-4e8e-94a5-9cdf738901fc tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:12.591775 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9a9c4e25-dfde-4e8e-94a5-9cdf738901fc tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:12.592220 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9a9c4e25-dfde-4e8e-94a5-9cdf738901fc tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:12.593066 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9a9c4e25-dfde-4e8e-94a5-9cdf738901fc tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:12.593563 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9a9c4e25-dfde-4e8e-94a5-9cdf738901fc tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:12.593991 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9a9c4e25-dfde-4e8e-94a5-9cdf738901fc tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:12.734360 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c0474b6a-7704-4987-844e-0127b7be3023 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:12.735073 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c0474b6a-7704-4987-844e-0127b7be3023 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:12.741031 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-9a9c4e25-dfde-4e8e-94a5-9cdf738901fc tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:12.742675 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c0474b6a-7704-4987-844e-0127b7be3023 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:12.743190 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c0474b6a-7704-4987-844e-0127b7be3023 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:12.743625 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c0474b6a-7704-4987-844e-0127b7be3023 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:12.744424 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c0474b6a-7704-4987-844e-0127b7be3023 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:12.744836 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c0474b6a-7704-4987-844e-0127b7be3023 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:12.745259 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c0474b6a-7704-4987-844e-0127b7be3023 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:12.748983 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9a9c4e25-dfde-4e8e-94a5-9cdf738901fc tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/1ee8c251-b609-4eeb-9406-ede7977b3f92" status: 200 len: 1317 microversion: 2.1 time: 0.169149 Oct 19 03:16:12.750072 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 624/1197] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:12 2022] GET /compute/v2.1/servers/1ee8c251-b609-4eeb-9406-ede7977b3f92 => generated 1317 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:16:12.823593 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c0474b6a-7704-4987-844e-0127b7be3023 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:12.832782 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c0474b6a-7704-4987-844e-0127b7be3023 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:12.834333 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c0474b6a-7704-4987-844e-0127b7be3023 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:12.841400 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c0474b6a-7704-4987-844e-0127b7be3023 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1539 microversion: 2.91 time: 0.112614 Oct 19 03:16:12.842201 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 574/1198] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:16:12 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1539 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:16:12.986008 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-2bd5e65f-fcde-4209-8562-ed8701330590 req-44c8e176-a5d9-42f9-a993-d93acc6fc01d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b18ae860-ed77-4ddc-b9fa-a2aa773c2614", "tag": "a42ed099-3fb2-4b70-8cb8-870751bbcc54"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:16:12.986946 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-8ffe3175-96da-4dc3-afe7-79f65ff9bf2c tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:12.988065 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-8ffe3175-96da-4dc3-afe7-79f65ff9bf2c tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] [instance: b18ae860-ed77-4ddc-b9fa-a2aa773c2614] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:12.993798 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8ffe3175-96da-4dc3-afe7-79f65ff9bf2c tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:12.994717 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8ffe3175-96da-4dc3-afe7-79f65ff9bf2c tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:12.994867 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8ffe3175-96da-4dc3-afe7-79f65ff9bf2c tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:12.995520 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8ffe3175-96da-4dc3-afe7-79f65ff9bf2c tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:12.995977 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8ffe3175-96da-4dc3-afe7-79f65ff9bf2c tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:12.996697 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8ffe3175-96da-4dc3-afe7-79f65ff9bf2c tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:12.997427 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-2bd5e65f-fcde-4209-8562-ed8701330590 req-44c8e176-a5d9-42f9-a993-d93acc6fc01d service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:12.997946 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-2bd5e65f-fcde-4209-8562-ed8701330590 req-44c8e176-a5d9-42f9-a993-d93acc6fc01d service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:12.998391 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-2bd5e65f-fcde-4209-8562-ed8701330590 req-44c8e176-a5d9-42f9-a993-d93acc6fc01d service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:13.012770 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-2bd5e65f-fcde-4209-8562-ed8701330590 req-44c8e176-a5d9-42f9-a993-d93acc6fc01d service nova] Creating event network-changed:a42ed099-3fb2-4b70-8cb8-870751bbcc54 for instance b18ae860-ed77-4ddc-b9fa-a2aa773c2614 on n-h1-861333-8 Oct 19 03:16:13.018234 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-2bd5e65f-fcde-4209-8562-ed8701330590 req-44c8e176-a5d9-42f9-a993-d93acc6fc01d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035743 Oct 19 03:16:13.018844 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 575/1199] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:16:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:16:13.094110 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-017834ba-42dc-4137-be9f-026165bb8088 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:13.102847 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-017834ba-42dc-4137-be9f-026165bb8088 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 62133546-4a75-4532-81ab-0c49c9252e85] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:13.102847 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-017834ba-42dc-4137-be9f-026165bb8088 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:13.102847 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-017834ba-42dc-4137-be9f-026165bb8088 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:13.102847 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-017834ba-42dc-4137-be9f-026165bb8088 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:13.103269 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-017834ba-42dc-4137-be9f-026165bb8088 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:13.103269 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-017834ba-42dc-4137-be9f-026165bb8088 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:13.103600 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-017834ba-42dc-4137-be9f-026165bb8088 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:13.141795 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-8ffe3175-96da-4dc3-afe7-79f65ff9bf2c tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c1401b92c44228bd6e80dd3b786ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e388d05eac4f2babf180c0709fdc58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:13.153784 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-8ffe3175-96da-4dc3-afe7-79f65ff9bf2c tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] 10.222.0.52 "GET /compute/v2.1/servers/b18ae860-ed77-4ddc-b9fa-a2aa773c2614" status: 200 len: 1575 microversion: 2.1 time: 0.175052 Oct 19 03:16:13.154379 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 625/1200] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:12 2022] GET /compute/v2.1/servers/b18ae860-ed77-4ddc-b9fa-a2aa773c2614 => generated 1575 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:16:13.236470 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-dd61d0c2-b582-459a-8a23-337aa67fd0aa tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:13.237399 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-dd61d0c2-b582-459a-8a23-337aa67fd0aa tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 9daa020d-efe7-4033-a479-cb5dadbc3ad7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:13.245180 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dd61d0c2-b582-459a-8a23-337aa67fd0aa tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:13.245700 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dd61d0c2-b582-459a-8a23-337aa67fd0aa tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:13.246146 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dd61d0c2-b582-459a-8a23-337aa67fd0aa tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:13.246948 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dd61d0c2-b582-459a-8a23-337aa67fd0aa tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:13.247410 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dd61d0c2-b582-459a-8a23-337aa67fd0aa tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:13.247840 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dd61d0c2-b582-459a-8a23-337aa67fd0aa tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:13.253963 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-017834ba-42dc-4137-be9f-026165bb8088 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:13.265330 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-017834ba-42dc-4137-be9f-026165bb8088 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:13.266897 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-017834ba-42dc-4137-be9f-026165bb8088 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:13.267935 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-017834ba-42dc-4137-be9f-026165bb8088 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85" status: 200 len: 1410 microversion: 2.25 time: 0.178213 Oct 19 03:16:13.273526 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 576/1201] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:16:13 2022] GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85 => generated 1410 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:16:13.451439 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-dd61d0c2-b582-459a-8a23-337aa67fd0aa tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:13.461475 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-dd61d0c2-b582-459a-8a23-337aa67fd0aa tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7" status: 200 len: 1542 microversion: 2.1 time: 0.229326 Oct 19 03:16:13.473177 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 626/1202] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:13 2022] GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7 => generated 1542 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:16:13.772807 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3ed36ea8-fb9d-48b1-b373-01edae9e07b0 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:13.774124 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3ed36ea8-fb9d-48b1-b373-01edae9e07b0 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 1ee8c251-b609-4eeb-9406-ede7977b3f92] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:13.781956 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3ed36ea8-fb9d-48b1-b373-01edae9e07b0 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:13.782452 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3ed36ea8-fb9d-48b1-b373-01edae9e07b0 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:13.782895 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3ed36ea8-fb9d-48b1-b373-01edae9e07b0 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:13.783604 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3ed36ea8-fb9d-48b1-b373-01edae9e07b0 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:13.784089 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3ed36ea8-fb9d-48b1-b373-01edae9e07b0 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:13.784526 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3ed36ea8-fb9d-48b1-b373-01edae9e07b0 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:13.874351 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-478fc7e8-58d3-41b1-995c-ac02630da655 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:13.874982 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-478fc7e8-58d3-41b1-995c-ac02630da655 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:13.889219 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-478fc7e8-58d3-41b1-995c-ac02630da655 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:13.889765 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-478fc7e8-58d3-41b1-995c-ac02630da655 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:13.893845 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-478fc7e8-58d3-41b1-995c-ac02630da655 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:13.894616 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-478fc7e8-58d3-41b1-995c-ac02630da655 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:13.895094 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-478fc7e8-58d3-41b1-995c-ac02630da655 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:13.895531 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-478fc7e8-58d3-41b1-995c-ac02630da655 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:14.020806 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-478fc7e8-58d3-41b1-995c-ac02630da655 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:14.024325 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-3ed36ea8-fb9d-48b1-b373-01edae9e07b0 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:14.038375 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-478fc7e8-58d3-41b1-995c-ac02630da655 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:14.040425 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3ed36ea8-fb9d-48b1-b373-01edae9e07b0 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/1ee8c251-b609-4eeb-9406-ede7977b3f92" status: 200 len: 1317 microversion: 2.1 time: 0.271916 Oct 19 03:16:14.041063 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 577/1203] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:13 2022] GET /compute/v2.1/servers/1ee8c251-b609-4eeb-9406-ede7977b3f92 => generated 1317 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:16:14.041261 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-478fc7e8-58d3-41b1-995c-ac02630da655 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:14.048354 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-478fc7e8-58d3-41b1-995c-ac02630da655 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1539 microversion: 2.91 time: 0.183847 Oct 19 03:16:14.063918 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 627/1204] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:16:13 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1539 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:16:14.292691 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-662084b2-d3e8-4389-becb-dcb9ee3832b2 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:14.293312 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-662084b2-d3e8-4389-becb-dcb9ee3832b2 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 62133546-4a75-4532-81ab-0c49c9252e85] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:14.299863 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-662084b2-d3e8-4389-becb-dcb9ee3832b2 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:14.300233 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-662084b2-d3e8-4389-becb-dcb9ee3832b2 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:14.300728 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-662084b2-d3e8-4389-becb-dcb9ee3832b2 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:14.301936 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-662084b2-d3e8-4389-becb-dcb9ee3832b2 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:14.302837 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-662084b2-d3e8-4389-becb-dcb9ee3832b2 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:14.303430 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-662084b2-d3e8-4389-becb-dcb9ee3832b2 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:14.473434 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-662084b2-d3e8-4389-becb-dcb9ee3832b2 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:14.483360 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-662084b2-d3e8-4389-becb-dcb9ee3832b2 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:14.485002 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-662084b2-d3e8-4389-becb-dcb9ee3832b2 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:14.486175 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-662084b2-d3e8-4389-becb-dcb9ee3832b2 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85" status: 200 len: 1410 microversion: 2.25 time: 0.198103 Oct 19 03:16:14.490480 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-8769860c-cf53-40f6-9b43-a231ad57c3b4 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:14.490616 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 578/1205] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:16:14 2022] GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85 => generated 1410 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:16:14.490722 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-8769860c-cf53-40f6-9b43-a231ad57c3b4 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 9daa020d-efe7-4033-a479-cb5dadbc3ad7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:14.494528 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8769860c-cf53-40f6-9b43-a231ad57c3b4 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:14.494528 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8769860c-cf53-40f6-9b43-a231ad57c3b4 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:14.496122 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8769860c-cf53-40f6-9b43-a231ad57c3b4 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:14.496828 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8769860c-cf53-40f6-9b43-a231ad57c3b4 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:14.497355 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8769860c-cf53-40f6-9b43-a231ad57c3b4 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:14.497810 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8769860c-cf53-40f6-9b43-a231ad57c3b4 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:14.684309 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-8769860c-cf53-40f6-9b43-a231ad57c3b4 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:14.691946 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-8769860c-cf53-40f6-9b43-a231ad57c3b4 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7" status: 200 len: 1542 microversion: 2.1 time: 0.209519 Oct 19 03:16:14.692637 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 628/1206] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:14 2022] GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7 => generated 1542 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:16:15.063417 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a8843462-70a9-41c3-ae9b-c3af93909983 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:15.064015 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a8843462-70a9-41c3-ae9b-c3af93909983 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 1ee8c251-b609-4eeb-9406-ede7977b3f92] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:15.070999 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a8843462-70a9-41c3-ae9b-c3af93909983 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:15.074883 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a8843462-70a9-41c3-ae9b-c3af93909983 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:15.075333 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a8843462-70a9-41c3-ae9b-c3af93909983 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:15.076114 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a8843462-70a9-41c3-ae9b-c3af93909983 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:15.076569 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a8843462-70a9-41c3-ae9b-c3af93909983 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:15.076995 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a8843462-70a9-41c3-ae9b-c3af93909983 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:15.077136 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b1920aa2-84b2-4226-8fd4-bf1d33e05cb8 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:15.078319 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b1920aa2-84b2-4226-8fd4-bf1d33e05cb8 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:15.089549 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b1920aa2-84b2-4226-8fd4-bf1d33e05cb8 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:15.089549 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b1920aa2-84b2-4226-8fd4-bf1d33e05cb8 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:15.089549 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b1920aa2-84b2-4226-8fd4-bf1d33e05cb8 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:15.089549 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b1920aa2-84b2-4226-8fd4-bf1d33e05cb8 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:15.089977 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b1920aa2-84b2-4226-8fd4-bf1d33e05cb8 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:15.089977 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b1920aa2-84b2-4226-8fd4-bf1d33e05cb8 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:15.160979 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b1920aa2-84b2-4226-8fd4-bf1d33e05cb8 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:15.170246 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b1920aa2-84b2-4226-8fd4-bf1d33e05cb8 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:15.171725 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b1920aa2-84b2-4226-8fd4-bf1d33e05cb8 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:15.178150 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b1920aa2-84b2-4226-8fd4-bf1d33e05cb8 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1539 microversion: 2.91 time: 0.105712 Oct 19 03:16:15.178749 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 629/1207] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:16:15 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1539 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:16:15.415628 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a8843462-70a9-41c3-ae9b-c3af93909983 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:15.424162 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a8843462-70a9-41c3-ae9b-c3af93909983 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/1ee8c251-b609-4eeb-9406-ede7977b3f92" status: 200 len: 1317 microversion: 2.1 time: 0.364298 Oct 19 03:16:15.424578 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 579/1208] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:15 2022] GET /compute/v2.1/servers/1ee8c251-b609-4eeb-9406-ede7977b3f92 => generated 1317 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:16:15.512951 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3f574834-1fc6-4a3a-86db-72295d72cede tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:15.513757 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-3f574834-1fc6-4a3a-86db-72295d72cede tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 62133546-4a75-4532-81ab-0c49c9252e85] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:15.519976 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3f574834-1fc6-4a3a-86db-72295d72cede tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:15.520634 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3f574834-1fc6-4a3a-86db-72295d72cede tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:15.521176 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3f574834-1fc6-4a3a-86db-72295d72cede tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:15.521966 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3f574834-1fc6-4a3a-86db-72295d72cede tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:15.522483 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3f574834-1fc6-4a3a-86db-72295d72cede tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:15.522968 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3f574834-1fc6-4a3a-86db-72295d72cede tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:15.528966 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=100 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:16:15.729979 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-3f574834-1fc6-4a3a-86db-72295d72cede tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:15.738439 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-3f574834-1fc6-4a3a-86db-72295d72cede tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:15.739894 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-3f574834-1fc6-4a3a-86db-72295d72cede tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:15.741009 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-3f574834-1fc6-4a3a-86db-72295d72cede tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85" status: 200 len: 1410 microversion: 2.25 time: 0.233330 Oct 19 03:16:15.747351 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 630/1209] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:16:15 2022] GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85 => generated 1410 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:16:15.751804 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5af46845-4dcb-4a30-9934-ee06ba2da691 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:15.752539 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-5af46845-4dcb-4a30-9934-ee06ba2da691 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 9daa020d-efe7-4033-a479-cb5dadbc3ad7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:15.760045 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5af46845-4dcb-4a30-9934-ee06ba2da691 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:15.760673 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5af46845-4dcb-4a30-9934-ee06ba2da691 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:15.761187 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5af46845-4dcb-4a30-9934-ee06ba2da691 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:15.761980 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5af46845-4dcb-4a30-9934-ee06ba2da691 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:15.762760 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5af46845-4dcb-4a30-9934-ee06ba2da691 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:15.763247 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5af46845-4dcb-4a30-9934-ee06ba2da691 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:15.775357 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-464f7ba7-8e37-41f7-8bdf-f63608bc4739 tempest-TenantUsagesNegativeTestJSON-707743001 tempest-TenantUsagesNegativeTestJSON-707743001-project-admin] 10.222.0.52 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-18T03%3A16%3A15.648268&end=2022-10-20T03%3A16%3A15.648268" status: 404 len: 112 microversion: - time: 0.123334 Oct 19 03:16:15.775874 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 580/1210] 10.222.0.52 () {58 vars in 1316 bytes} [Wed Oct 19 03:16:15 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-18T03%3A16%3A15.648268&end=2022-10-20T03%3A16%3A15.648268 => generated 112 bytes in 125 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Oct 19 03:16:15.785878 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c98a3aa5-b0f6-4828-b61c-6e0c85d0da52 tempest-TenantUsagesNegativeTestJSON-707743001 tempest-TenantUsagesNegativeTestJSON-707743001-project-admin] Calling method '.version_select at 0x7fc130b4e550>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:15.792794 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-c98a3aa5-b0f6-4828-b61c-6e0c85d0da52 tempest-TenantUsagesNegativeTestJSON-707743001 tempest-TenantUsagesNegativeTestJSON-707743001-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Oct 19 03:16:15.794627 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c98a3aa5-b0f6-4828-b61c-6e0c85d0da52 tempest-TenantUsagesNegativeTestJSON-707743001 tempest-TenantUsagesNegativeTestJSON-707743001-project-admin] Request method failure captured: Oct 19 03:16:15.794627 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/os-simple-tenant-usage/563208671fbd4782b21d00057611dcb3?start=2022-10-20T03%3A16%3A15.648268&end=2022-10-18T03%3A16%3A15.648268 HTTP/1.1 Oct 19 03:16:15.794627 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:16:15.794627 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:16:15.794627 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:16:15.794627 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:16:15.794627 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:16:15.794627 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:16:15.794627 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:16:15.794627 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:16:15.794627 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT2v_rRlLhmX1Vn72wI64qkTKGst6fynslR5pg_vdO6IGiu0Jq2NvuFDXraOT1AkLdN3etmO78ki2_tt9H4WWUkJRw78lPIBmrKh3vTSPp7AcnRnFnmv4yE8DrVkxh7ueTifYdrbvxswH83O6XZSSvNDX5T854RTNOW7X-jWoZn94wYY Oct 19 03:16:15.794627 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:16:15.794627 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:16:15.794627 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:16:15.794627 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:16:15.794627 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:16:15.794627 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:16:15.794627 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 3296196b24374e67ad2eaa83b0db60ed Oct 19 03:16:15.794627 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-707743001 Oct 19 03:16:15.794627 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member,admin Oct 19 03:16:15.794627 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member,admin Oct 19 03:16:15.796216 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/3296196b24374e67ad2eaa83b0db60ed"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3296196b24374e67ad2eaa83b0db60ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3296196b24374e67ad2eaa83b0db60ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_3296196b24374e67ad2eaa83b0db60ed", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:16:15.796216 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-707743001 Oct 19 03:16:15.796216 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 3296196b24374e67ad2eaa83b0db60ed Oct 19 03:16:15.796216 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-707743001 Oct 19 03:16:15.796216 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-TenantUsagesNegativeTestJSON-707743001-project-admin Oct 19 03:16:15.796216 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:16:15.796216 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:16:15.796216 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 170ae194edec45d9a9a9cafe3934bf6c Oct 19 03:16:15.796216 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-707743001-project-admin Oct 19 03:16:15.796216 n-d-861333-8 devstack@n-api.service[121134]: method: Oct 19 03:16:15.796216 n-d-861333-8 devstack@n-api.service[121134]: exception: Invalid start time. The start time cannot occur after the end time. Oct 19 03:16:15.796216 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '563208671fbd4782b21d00057611dcb3'} Oct 19 03:16:15.797119 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:16:15.797119 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:16:15.797119 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:16:15.797119 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:16:15.797119 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:16:15.797119 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:16:15.797119 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 03:16:15.797119 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 03:16:15.797119 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 19 03:16:15.797119 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:16:15.797119 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:16:15.797119 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:16:15.797119 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Oct 19 03:16:15.797119 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 19 03:16:15.797119 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Oct 19 03:16:15.797119 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Oct 19 03:16:15.797119 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Oct 19 03:16:15.797119 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 19 03:16:15.797119 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Oct 19 03:16:15.798541 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:16:15.798541 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:16:15.798541 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:16:15.798541 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:16:15.798541 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:16:15.798541 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:16:15.798541 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:16:15.798541 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:16:15.798541 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Oct 19 03:16:15.798541 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:16:15.799956 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c98a3aa5-b0f6-4828-b61c-6e0c85d0da52 tempest-TenantUsagesNegativeTestJSON-707743001 tempest-TenantUsagesNegativeTestJSON-707743001-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:16:15.800777 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c98a3aa5-b0f6-4828-b61c-6e0c85d0da52 tempest-TenantUsagesNegativeTestJSON-707743001 tempest-TenantUsagesNegativeTestJSON-707743001-project-admin] 10.222.0.52 "GET /compute/v2.1/os-simple-tenant-usage/563208671fbd4782b21d00057611dcb3?start=2022-10-20T03%3A16%3A15.648268&end=2022-10-18T03%3A16%3A15.648268" status: 400 len: 111 microversion: 2.1 time: 0.018437 Oct 19 03:16:15.801305 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 581/1211] 10.222.0.52 () {58 vars in 1412 bytes} [Wed Oct 19 03:16:15 2022] GET /compute/v2.1/os-simple-tenant-usage/563208671fbd4782b21d00057611dcb3?start=2022-10-20T03%3A16%3A15.648268&end=2022-10-18T03%3A16%3A15.648268 => generated 111 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 03:16:15.915159 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5910227f-abe8-4ff2-86c3-1481247b8b76 tempest-TenantUsagesNegativeTestJSON-1814290278 tempest-TenantUsagesNegativeTestJSON-1814290278-project] Calling method '.version_select at 0x7fc130b8b700>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:15.919975 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5910227f-abe8-4ff2-86c3-1481247b8b76 tempest-TenantUsagesNegativeTestJSON-1814290278 tempest-TenantUsagesNegativeTestJSON-1814290278-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '3d277fdbdbe44fc5b783b8f4886e11f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563208671fbd4782b21d00057611dcb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:15.921601 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5910227f-abe8-4ff2-86c3-1481247b8b76 tempest-TenantUsagesNegativeTestJSON-1814290278 tempest-TenantUsagesNegativeTestJSON-1814290278-project] Request method failure captured: Oct 19 03:16:15.921601 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-18T03%3A16%3A15.648268&end=2022-10-20T03%3A16%3A15.648268&detailed=1 HTTP/1.1 Oct 19 03:16:15.921601 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:16:15.921601 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:16:15.921601 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:16:15.921601 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:16:15.921601 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:16:15.921601 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:16:15.921601 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:16:15.921601 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:16:15.921601 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT2v-KAjfhk4gjiVG5ASrgX55vnH7pnZB3-yOB7FBnKLjiYQ9J5TauVKA5LTodiZNYkhsw3SYtgWUnH9cdym5NNxl1cHhEOdg5CbAgbUyYAk0kPgjKh7EHuOMnXtoQqieJeC-f6FkTG8MVTo2xk_63-MN3DE6wxDlYNKUPahZWyU60CE Oct 19 03:16:15.921601 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:16:15.921601 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:16:15.921601 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:16:15.921601 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:16:15.921601 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:16:15.921601 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:16:15.921601 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 563208671fbd4782b21d00057611dcb3 Oct 19 03:16:15.921601 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1814290278 Oct 19 03:16:15.921601 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:16:15.921601 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:16:15.923192 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/563208671fbd4782b21d00057611dcb3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/563208671fbd4782b21d00057611dcb3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/563208671fbd4782b21d00057611dcb3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_563208671fbd4782b21d00057611dcb3", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:16:15.923192 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1814290278 Oct 19 03:16:15.923192 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 563208671fbd4782b21d00057611dcb3 Oct 19 03:16:15.923192 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1814290278 Oct 19 03:16:15.923192 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-TenantUsagesNegativeTestJSON-1814290278-project Oct 19 03:16:15.923192 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:16:15.923192 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:16:15.923192 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 3d277fdbdbe44fc5b783b8f4886e11f4 Oct 19 03:16:15.923192 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1814290278-project Oct 19 03:16:15.923192 n-d-861333-8 devstack@n-api.service[121134]: method: Oct 19 03:16:15.923192 n-d-861333-8 devstack@n-api.service[121134]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 19 03:16:15.923192 n-d-861333-8 devstack@n-api.service[121134]: action_args: {} Oct 19 03:16:15.923192 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:16:15.924238 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:16:15.924238 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:16:15.924238 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:16:15.924238 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:16:15.924238 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:16:15.924238 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 03:16:15.924238 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 03:16:15.924238 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 19 03:16:15.924238 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:16:15.924238 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:16:15.924238 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:16:15.924238 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Oct 19 03:16:15.924238 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 19 03:16:15.924238 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Oct 19 03:16:15.924238 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Oct 19 03:16:15.924238 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 19 03:16:15.924238 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 19 03:16:15.924238 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 19 03:16:15.924238 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 19 03:16:15.925655 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 03:16:15.925655 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 03:16:15.925655 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 03:16:15.925655 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 03:16:15.925655 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 19 03:16:15.925655 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 19 03:16:15.925655 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 19 03:16:15.925655 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 19 03:16:15.925655 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 19 03:16:15.925655 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 19 03:16:15.925655 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 19 03:16:15.925655 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:16:15.925655 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:16:15.925655 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:16:15.925655 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:16:15.925655 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:16:15.925655 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:16:15.925655 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 19 03:16:15.925655 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 19 03:16:15.927528 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 19 03:16:15.927528 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:16:15.927528 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5910227f-abe8-4ff2-86c3-1481247b8b76 tempest-TenantUsagesNegativeTestJSON-1814290278 tempest-TenantUsagesNegativeTestJSON-1814290278-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:16:15.927528 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5910227f-abe8-4ff2-86c3-1481247b8b76 tempest-TenantUsagesNegativeTestJSON-1814290278 tempest-TenantUsagesNegativeTestJSON-1814290278-project] 10.222.0.52 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-18T03%3A16%3A15.648268&end=2022-10-20T03%3A16%3A15.648268&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.115915 Oct 19 03:16:15.927857 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-5af46845-4dcb-4a30-9934-ee06ba2da691 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:15.927973 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 582/1212] 10.222.0.52 () {58 vars in 1335 bytes} [Wed Oct 19 03:16:15 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-18T03%3A16%3A15.648268&end=2022-10-20T03%3A16%3A15.648268&detailed=1 => generated 123 bytes in 119 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 19 03:16:15.933819 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5af46845-4dcb-4a30-9934-ee06ba2da691 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7" status: 200 len: 1542 microversion: 2.1 time: 0.191113 Oct 19 03:16:15.934618 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 631/1213] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:15 2022] GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7 => generated 1542 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:16:16.207682 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-dfd3aeb2-76b9-4e8f-b62d-5fcda4d7758b tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:16.208319 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-dfd3aeb2-76b9-4e8f-b62d-5fcda4d7758b tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:16.214854 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dfd3aeb2-76b9-4e8f-b62d-5fcda4d7758b tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:16.215340 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dfd3aeb2-76b9-4e8f-b62d-5fcda4d7758b tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:16.215780 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dfd3aeb2-76b9-4e8f-b62d-5fcda4d7758b tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:16.221711 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dfd3aeb2-76b9-4e8f-b62d-5fcda4d7758b tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:16.221711 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dfd3aeb2-76b9-4e8f-b62d-5fcda4d7758b tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:16.221711 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dfd3aeb2-76b9-4e8f-b62d-5fcda4d7758b tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:16.284772 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-dfd3aeb2-76b9-4e8f-b62d-5fcda4d7758b tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:16.293719 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-dfd3aeb2-76b9-4e8f-b62d-5fcda4d7758b tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:16.295146 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-dfd3aeb2-76b9-4e8f-b62d-5fcda4d7758b tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:16.300274 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-dfd3aeb2-76b9-4e8f-b62d-5fcda4d7758b tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1539 microversion: 2.91 time: 0.097425 Oct 19 03:16:16.300830 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 583/1214] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:16:16 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1539 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:16:16.448121 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c9037d91-380f-4da7-af3f-574ace1ab6db tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:16.448656 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c9037d91-380f-4da7-af3f-574ace1ab6db tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 1ee8c251-b609-4eeb-9406-ede7977b3f92] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:16.455509 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c9037d91-380f-4da7-af3f-574ace1ab6db tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:16.456337 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c9037d91-380f-4da7-af3f-574ace1ab6db tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:16.456780 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c9037d91-380f-4da7-af3f-574ace1ab6db tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:16.457498 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c9037d91-380f-4da7-af3f-574ace1ab6db tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:16.457950 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c9037d91-380f-4da7-af3f-574ace1ab6db tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:16.458368 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c9037d91-380f-4da7-af3f-574ace1ab6db tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:16.614353 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c9037d91-380f-4da7-af3f-574ace1ab6db tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:16.622455 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c9037d91-380f-4da7-af3f-574ace1ab6db tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/1ee8c251-b609-4eeb-9406-ede7977b3f92" status: 200 len: 1317 microversion: 2.1 time: 0.178891 Oct 19 03:16:16.625970 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 632/1215] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:16 2022] GET /compute/v2.1/servers/1ee8c251-b609-4eeb-9406-ede7977b3f92 => generated 1317 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:16:16.767091 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5760b18b-c2bc-416d-8141-e74580b1e991 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:16.767700 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5760b18b-c2bc-416d-8141-e74580b1e991 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 62133546-4a75-4532-81ab-0c49c9252e85] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:16.774016 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5760b18b-c2bc-416d-8141-e74580b1e991 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:16.774502 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5760b18b-c2bc-416d-8141-e74580b1e991 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:16.774931 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5760b18b-c2bc-416d-8141-e74580b1e991 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:16.776406 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5760b18b-c2bc-416d-8141-e74580b1e991 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:16.777032 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5760b18b-c2bc-416d-8141-e74580b1e991 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:16.777492 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5760b18b-c2bc-416d-8141-e74580b1e991 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:16.920917 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5760b18b-c2bc-416d-8141-e74580b1e991 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:16.929028 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5760b18b-c2bc-416d-8141-e74580b1e991 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:16.930507 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5760b18b-c2bc-416d-8141-e74580b1e991 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:16.931672 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5760b18b-c2bc-416d-8141-e74580b1e991 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85" status: 200 len: 1604 microversion: 2.25 time: 0.168803 Oct 19 03:16:16.933034 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 584/1216] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:16:16 2022] GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85 => generated 1604 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:16:16.957953 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e33a24b7-7f5c-412f-8586-77d81ac82e37 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:16.958272 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-71f0c361-a9ea-42ed-b586-44158489607c tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:16.958831 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e33a24b7-7f5c-412f-8586-77d81ac82e37 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 9daa020d-efe7-4033-a479-cb5dadbc3ad7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:16.958999 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-71f0c361-a9ea-42ed-b586-44158489607c tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 62133546-4a75-4532-81ab-0c49c9252e85] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:16.965169 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e33a24b7-7f5c-412f-8586-77d81ac82e37 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:16.965402 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-71f0c361-a9ea-42ed-b586-44158489607c tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:16.965668 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e33a24b7-7f5c-412f-8586-77d81ac82e37 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:16.965801 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-71f0c361-a9ea-42ed-b586-44158489607c tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:16.966108 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e33a24b7-7f5c-412f-8586-77d81ac82e37 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:16.966414 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-71f0c361-a9ea-42ed-b586-44158489607c tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:16.967057 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e33a24b7-7f5c-412f-8586-77d81ac82e37 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:16.967352 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-71f0c361-a9ea-42ed-b586-44158489607c tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:16.967520 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e33a24b7-7f5c-412f-8586-77d81ac82e37 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:16.967808 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-71f0c361-a9ea-42ed-b586-44158489607c tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:16.967984 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e33a24b7-7f5c-412f-8586-77d81ac82e37 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:16.968242 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-71f0c361-a9ea-42ed-b586-44158489607c tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:17.086980 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-71f0c361-a9ea-42ed-b586-44158489607c tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85/os-interface" status: 200 len: 284 microversion: 2.25 time: 0.133048 Oct 19 03:16:17.087688 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 585/1217] 10.222.0.52 () {60 vars in 1316 bytes} [Wed Oct 19 03:16:16 2022] GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85/os-interface => generated 284 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 03:16:17.099193 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-b268b2db-0ad2-49ab-a17c-b17a55b3075c req-2dc36ede-6abf-4a31-9232-69be77b92961 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ee8c251-b609-4eeb-9406-ede7977b3f92", "name": "network-vif-plugged", "status": "completed", "tag": "00715d2d-0cc6-4f47-a5c6-da7f988d8c1f"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:16:17.127729 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-b268b2db-0ad2-49ab-a17c-b17a55b3075c req-2dc36ede-6abf-4a31-9232-69be77b92961 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:17.128218 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-b268b2db-0ad2-49ab-a17c-b17a55b3075c req-2dc36ede-6abf-4a31-9232-69be77b92961 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:17.128643 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-b268b2db-0ad2-49ab-a17c-b17a55b3075c req-2dc36ede-6abf-4a31-9232-69be77b92961 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:17.152090 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-b268b2db-0ad2-49ab-a17c-b17a55b3075c req-2dc36ede-6abf-4a31-9232-69be77b92961 service nova] Creating event network-vif-plugged:00715d2d-0cc6-4f47-a5c6-da7f988d8c1f for instance 1ee8c251-b609-4eeb-9406-ede7977b3f92 on n-h1-861333-8 Oct 19 03:16:17.160200 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-e33a24b7-7f5c-412f-8586-77d81ac82e37 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:17.163842 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e33a24b7-7f5c-412f-8586-77d81ac82e37 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7" status: 200 len: 1542 microversion: 2.1 time: 0.209863 Oct 19 03:16:17.164425 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 633/1218] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:16 2022] GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7 => generated 1542 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:16:17.167420 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-b268b2db-0ad2-49ab-a17c-b17a55b3075c req-2dc36ede-6abf-4a31-9232-69be77b92961 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077156 Oct 19 03:16:17.168170 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 586/1219] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:16:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:16:17.328307 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-db498915-8ba0-4734-a52f-e812bac86d22 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:17.329029 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-db498915-8ba0-4734-a52f-e812bac86d22 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:17.335493 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-db498915-8ba0-4734-a52f-e812bac86d22 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:17.336223 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-db498915-8ba0-4734-a52f-e812bac86d22 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:17.337051 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-db498915-8ba0-4734-a52f-e812bac86d22 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:17.338208 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-db498915-8ba0-4734-a52f-e812bac86d22 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:17.338663 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-db498915-8ba0-4734-a52f-e812bac86d22 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:17.339332 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-db498915-8ba0-4734-a52f-e812bac86d22 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:17.420211 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-db498915-8ba0-4734-a52f-e812bac86d22 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:17.429860 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-db498915-8ba0-4734-a52f-e812bac86d22 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:17.431491 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-db498915-8ba0-4734-a52f-e812bac86d22 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:17.437804 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-db498915-8ba0-4734-a52f-e812bac86d22 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1539 microversion: 2.91 time: 0.113868 Oct 19 03:16:17.441461 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 634/1220] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:16:17 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1539 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:16:17.647663 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-668a5312-4928-4dc2-b74c-27f38fdaf2c3 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:17.648362 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-668a5312-4928-4dc2-b74c-27f38fdaf2c3 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 1ee8c251-b609-4eeb-9406-ede7977b3f92] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:17.655210 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-668a5312-4928-4dc2-b74c-27f38fdaf2c3 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:17.655699 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-668a5312-4928-4dc2-b74c-27f38fdaf2c3 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:17.656138 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-668a5312-4928-4dc2-b74c-27f38fdaf2c3 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:17.656833 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-668a5312-4928-4dc2-b74c-27f38fdaf2c3 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:17.657288 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-668a5312-4928-4dc2-b74c-27f38fdaf2c3 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:17.657775 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-668a5312-4928-4dc2-b74c-27f38fdaf2c3 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:17.876976 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-668a5312-4928-4dc2-b74c-27f38fdaf2c3 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:17.885723 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-668a5312-4928-4dc2-b74c-27f38fdaf2c3 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/1ee8c251-b609-4eeb-9406-ede7977b3f92" status: 200 len: 1317 microversion: 2.1 time: 0.242669 Oct 19 03:16:17.886524 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 587/1221] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:17 2022] GET /compute/v2.1/servers/1ee8c251-b609-4eeb-9406-ede7977b3f92 => generated 1317 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:16:18.134685 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-9d19777d-daae-4ea5-ac96-5576cff578f7 req-4d2af6ec-ec95-4ca7-b453-300e39832c73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62133546-4a75-4532-81ab-0c49c9252e85", "tag": "00532cca-3534-4784-9094-66d340359b0e"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:16:18.146999 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-9d19777d-daae-4ea5-ac96-5576cff578f7 req-4d2af6ec-ec95-4ca7-b453-300e39832c73 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:18.147545 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-9d19777d-daae-4ea5-ac96-5576cff578f7 req-4d2af6ec-ec95-4ca7-b453-300e39832c73 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:18.147993 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-9d19777d-daae-4ea5-ac96-5576cff578f7 req-4d2af6ec-ec95-4ca7-b453-300e39832c73 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:18.162685 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-9d19777d-daae-4ea5-ac96-5576cff578f7 req-4d2af6ec-ec95-4ca7-b453-300e39832c73 service nova] Creating event network-changed:00532cca-3534-4784-9094-66d340359b0e for instance 62133546-4a75-4532-81ab-0c49c9252e85 on n-h1-861333-8 Oct 19 03:16:18.169235 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-9d19777d-daae-4ea5-ac96-5576cff578f7 req-4d2af6ec-ec95-4ca7-b453-300e39832c73 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038543 Oct 19 03:16:18.173024 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 635/1222] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:16:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:16:18.189934 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7260337f-83fc-42e7-8700-63a3dc778cf8 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:18.190772 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7260337f-83fc-42e7-8700-63a3dc778cf8 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 9daa020d-efe7-4033-a479-cb5dadbc3ad7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:18.198235 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7260337f-83fc-42e7-8700-63a3dc778cf8 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:18.199060 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7260337f-83fc-42e7-8700-63a3dc778cf8 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:18.199501 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7260337f-83fc-42e7-8700-63a3dc778cf8 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:18.200231 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7260337f-83fc-42e7-8700-63a3dc778cf8 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:18.200689 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7260337f-83fc-42e7-8700-63a3dc778cf8 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:18.201795 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7260337f-83fc-42e7-8700-63a3dc778cf8 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:18.354639 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-7260337f-83fc-42e7-8700-63a3dc778cf8 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:18.363014 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7260337f-83fc-42e7-8700-63a3dc778cf8 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7" status: 200 len: 1542 microversion: 2.1 time: 0.178862 Oct 19 03:16:18.363838 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 588/1223] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:18 2022] GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7 => generated 1542 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:16:18.465757 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-74778984-cf94-4da5-a0f5-38e558d967ec tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:18.466454 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-74778984-cf94-4da5-a0f5-38e558d967ec tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:18.473158 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-74778984-cf94-4da5-a0f5-38e558d967ec tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:18.473917 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-74778984-cf94-4da5-a0f5-38e558d967ec tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:18.474338 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-74778984-cf94-4da5-a0f5-38e558d967ec tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:18.475115 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-74778984-cf94-4da5-a0f5-38e558d967ec tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:18.475632 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-74778984-cf94-4da5-a0f5-38e558d967ec tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:18.476119 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-74778984-cf94-4da5-a0f5-38e558d967ec tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:18.550925 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-74778984-cf94-4da5-a0f5-38e558d967ec tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:18.559962 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-74778984-cf94-4da5-a0f5-38e558d967ec tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:18.566664 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-74778984-cf94-4da5-a0f5-38e558d967ec tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:18.566664 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-74778984-cf94-4da5-a0f5-38e558d967ec tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1539 microversion: 2.91 time: 0.104711 Oct 19 03:16:18.567047 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 636/1224] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:16:18 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1539 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:16:18.910579 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-082aac78-8ca0-461c-9378-3933be44246e tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:18.911901 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-082aac78-8ca0-461c-9378-3933be44246e tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 1ee8c251-b609-4eeb-9406-ede7977b3f92] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:18.920344 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-082aac78-8ca0-461c-9378-3933be44246e tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:18.921151 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-082aac78-8ca0-461c-9378-3933be44246e tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:18.921930 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-082aac78-8ca0-461c-9378-3933be44246e tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:18.922657 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-082aac78-8ca0-461c-9378-3933be44246e tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:18.923118 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-082aac78-8ca0-461c-9378-3933be44246e tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:18.923866 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-082aac78-8ca0-461c-9378-3933be44246e tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:19.088001 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-082aac78-8ca0-461c-9378-3933be44246e tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:19.097927 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-082aac78-8ca0-461c-9378-3933be44246e tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/1ee8c251-b609-4eeb-9406-ede7977b3f92" status: 200 len: 1317 microversion: 2.1 time: 0.191731 Oct 19 03:16:19.101446 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 589/1225] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:18 2022] GET /compute/v2.1/servers/1ee8c251-b609-4eeb-9406-ede7977b3f92 => generated 1317 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:16:19.293944 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0c32d36a-4174-4db6-83b2-8fa5f9de5664 tempest-KeyPairsV2TestJSON-1757845830 tempest-KeyPairsV2TestJSON-1757845830-project] Action: 'create', calling method: .version_select at 0x7fc1310f6a60>, body: {"keypair": {"name": "tempest-keypair-1390257348", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCTqBMz01H898sfbivElbgihmLxDwGKFARkooviHQeLoqYa8TSJQbacwIZSXQaeprArr0/68wC9uhZ6WVa73DHSROltE+olFGqaf4NowS9GcMhMGj0xVeTwJdgP0lpt+Mg=="}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:16:19.309162 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-0c32d36a-4174-4db6-83b2-8fa5f9de5664 tempest-KeyPairsV2TestJSON-1757845830 tempest-KeyPairsV2TestJSON-1757845830-project] Getting quotas for project 234933b0f9df4f5eb5b7dfc63571ab64. Resources: {'key_pairs'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:16:19.313706 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-0c32d36a-4174-4db6-83b2-8fa5f9de5664 tempest-KeyPairsV2TestJSON-1757845830 tempest-KeyPairsV2TestJSON-1757845830-project] Getting quotas for user 9248895fab674ebfb1660d8d7ae68b99 and project 234933b0f9df4f5eb5b7dfc63571ab64. Resources: {'key_pairs'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:16:19.387022 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-31d36755-9222-4a79-811c-6fd742bd949b tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:19.387944 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-31d36755-9222-4a79-811c-6fd742bd949b tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 9daa020d-efe7-4033-a479-cb5dadbc3ad7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:19.394428 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-31d36755-9222-4a79-811c-6fd742bd949b tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:19.394934 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-31d36755-9222-4a79-811c-6fd742bd949b tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:19.395444 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-31d36755-9222-4a79-811c-6fd742bd949b tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:19.396341 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-31d36755-9222-4a79-811c-6fd742bd949b tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:19.396793 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-31d36755-9222-4a79-811c-6fd742bd949b tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:19.397218 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-31d36755-9222-4a79-811c-6fd742bd949b tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:19.421502 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0c32d36a-4174-4db6-83b2-8fa5f9de5664 tempest-KeyPairsV2TestJSON-1757845830 tempest-KeyPairsV2TestJSON-1757845830-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.261775 Oct 19 03:16:19.422106 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 637/1226] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Oct 19 03:16:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:16:19.432529 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-de51a29f-aa90-4aba-8bdf-6a91a8d1979a tempest-KeyPairsV2TestJSON-1757845830 tempest-KeyPairsV2TestJSON-1757845830-project] Calling method '.version_select at 0x7fc130ec1e50>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:19.441012 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-de51a29f-aa90-4aba-8bdf-6a91a8d1979a tempest-KeyPairsV2TestJSON-1757845830 tempest-KeyPairsV2TestJSON-1757845830-project] 10.222.0.52 "GET /compute/v2.1/os-keypairs/tempest-keypair-1390257348" status: 200 len: 497 microversion: 2.1 time: 0.012089 Oct 19 03:16:19.441602 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 638/1227] 10.222.0.52 () {58 vars in 1218 bytes} [Wed Oct 19 03:16:19 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1390257348 => generated 497 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:16:19.456072 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-fc65576b-9643-45ac-b622-948986d6f414 tempest-KeyPairsV2TestJSON-1757845830 tempest-KeyPairsV2TestJSON-1757845830-project] Calling method '.version_select at 0x7fc130e6fb80>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:19.536264 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-31d36755-9222-4a79-811c-6fd742bd949b tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:19.541177 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-fc65576b-9643-45ac-b622-948986d6f414 tempest-KeyPairsV2TestJSON-1757845830 tempest-KeyPairsV2TestJSON-1757845830-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1390257348" status: 202 len: 0 microversion: 2.1 time: 0.088582 Oct 19 03:16:19.542159 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 639/1228] 10.222.0.52 () {58 vars in 1221 bytes} [Wed Oct 19 03:16:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1390257348 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 19 03:16:19.544614 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-31d36755-9222-4a79-811c-6fd742bd949b tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7" status: 200 len: 1542 microversion: 2.1 time: 0.161645 Oct 19 03:16:19.546044 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 590/1229] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:19 2022] GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7 => generated 1542 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:16:19.553746 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d80dd4f4-648a-4a1d-aab2-ed927e9a51c7 tempest-KeyPairsV2TestJSON-1757845830 tempest-KeyPairsV2TestJSON-1757845830-project] Action: 'create', calling method: .version_select at 0x7fc130e69a60>, body: {"keypair": {"name": "tempest-keypair-2137045522", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDDcMYTB4xEDxRlLc9NkPVg4L3qdUnWwJc1O2V9uoV2Y7ViRZCLbkyJ2SfAwaCmLakYFXvsO8rfeqZ2BR+szHh2nxy3m+kgeKO5wd40/w+VoRMrFPsdL3vxccUUAD09iaw=="}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:16:19.569452 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-d80dd4f4-648a-4a1d-aab2-ed927e9a51c7 tempest-KeyPairsV2TestJSON-1757845830 tempest-KeyPairsV2TestJSON-1757845830-project] Getting quotas for project 234933b0f9df4f5eb5b7dfc63571ab64. Resources: {'key_pairs'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:16:19.574525 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-d80dd4f4-648a-4a1d-aab2-ed927e9a51c7 tempest-KeyPairsV2TestJSON-1757845830 tempest-KeyPairsV2TestJSON-1757845830-project] Getting quotas for user 9248895fab674ebfb1660d8d7ae68b99 and project 234933b0f9df4f5eb5b7dfc63571ab64. Resources: {'key_pairs'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:16:19.576906 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:16:19.594311 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1f2bdbcf-0ab7-4cc5-b341-e08365a1386f tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:19.594919 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1f2bdbcf-0ab7-4cc5-b341-e08365a1386f tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:19.600840 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1f2bdbcf-0ab7-4cc5-b341-e08365a1386f tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:19.601569 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1f2bdbcf-0ab7-4cc5-b341-e08365a1386f tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:19.602003 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1f2bdbcf-0ab7-4cc5-b341-e08365a1386f tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:19.602696 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1f2bdbcf-0ab7-4cc5-b341-e08365a1386f tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:19.603155 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1f2bdbcf-0ab7-4cc5-b341-e08365a1386f tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:19.605433 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1f2bdbcf-0ab7-4cc5-b341-e08365a1386f tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:19.656699 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d80dd4f4-648a-4a1d-aab2-ed927e9a51c7 tempest-KeyPairsV2TestJSON-1757845830 tempest-KeyPairsV2TestJSON-1757845830-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.106676 Oct 19 03:16:19.657606 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 640/1230] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Oct 19 03:16:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:16:19.668203 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-613a4eec-f9cc-4c9b-ae0e-bf94a770183d tempest-KeyPairsV2TestJSON-1757845830 tempest-KeyPairsV2TestJSON-1757845830-project] Calling method '.version_select at 0x7fc13110e5e0>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:19.700402 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-1f2bdbcf-0ab7-4cc5-b341-e08365a1386f tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:19.709580 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-1f2bdbcf-0ab7-4cc5-b341-e08365a1386f tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:19.711288 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-1f2bdbcf-0ab7-4cc5-b341-e08365a1386f tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:19.717844 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1f2bdbcf-0ab7-4cc5-b341-e08365a1386f tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1539 microversion: 2.91 time: 0.127372 Oct 19 03:16:19.718736 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 591/1231] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:16:19 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1539 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:16:19.771230 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-613a4eec-f9cc-4c9b-ae0e-bf94a770183d tempest-KeyPairsV2TestJSON-1757845830 tempest-KeyPairsV2TestJSON-1757845830-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2137045522" status: 202 len: 0 microversion: 2.1 time: 0.107049 Oct 19 03:16:19.776938 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 641/1232] 10.222.0.52 () {58 vars in 1221 bytes} [Wed Oct 19 03:16:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2137045522 => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 19 03:16:19.784518 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6d39edb9-4df2-42a6-8bed-30dfb48da605 tempest-KeyPairsV2TestJSON-1757845830 tempest-KeyPairsV2TestJSON-1757845830-project] Action: 'create', calling method: .version_select at 0x7fc130b693a0>, body: {"keypair": {"name": "tempest-keypair-953058126", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:16:19.805488 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-6d39edb9-4df2-42a6-8bed-30dfb48da605 tempest-KeyPairsV2TestJSON-1757845830 tempest-KeyPairsV2TestJSON-1757845830-project] Getting quotas for project 234933b0f9df4f5eb5b7dfc63571ab64. Resources: {'key_pairs'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:16:19.807872 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-6d39edb9-4df2-42a6-8bed-30dfb48da605 tempest-KeyPairsV2TestJSON-1757845830 tempest-KeyPairsV2TestJSON-1757845830-project] Getting quotas for user 9248895fab674ebfb1660d8d7ae68b99 and project 234933b0f9df4f5eb5b7dfc63571ab64. Resources: {'key_pairs'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:16:19.897957 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6d39edb9-4df2-42a6-8bed-30dfb48da605 tempest-KeyPairsV2TestJSON-1757845830 tempest-KeyPairsV2TestJSON-1757845830-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 573 microversion: 2.1 time: 0.118117 Oct 19 03:16:19.899306 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 592/1233] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Oct 19 03:16:19 2022] POST /compute/v2.1/os-keypairs => generated 573 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:16:19.909952 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-29d8ab9d-d08d-497f-a025-544ba2e66f67 tempest-KeyPairsV2TestJSON-1757845830 tempest-KeyPairsV2TestJSON-1757845830-project] Calling method '.version_select at 0x7fc1310f64c0>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:20.005659 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-29d8ab9d-d08d-497f-a025-544ba2e66f67 tempest-KeyPairsV2TestJSON-1757845830 tempest-KeyPairsV2TestJSON-1757845830-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-953058126" status: 202 len: 0 microversion: 2.1 time: 0.099507 Oct 19 03:16:20.006685 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 642/1234] 10.222.0.52 () {58 vars in 1218 bytes} [Wed Oct 19 03:16:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-953058126 => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:16:20.019522 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-143895a7-1b6c-45b8-968c-f4753a242038 tempest-KeyPairsV2TestJSON-1757845830 tempest-KeyPairsV2TestJSON-1757845830-project] Action: 'create', calling method: .version_select at 0x7fc130b4e820>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1478733638", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFieK42RfSWfMcgpYGfV8+sXhFLtU013m/mnqwnjzuDmoUaR+zJ0S31uwOmvBsa5VwMQO+QMwrzCSEesaKKXEEG8MDWMiU1uEsVh7zv6JNj1tZ6FldMMzrNWHPEPWBglNw=="}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:16:20.035582 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-143895a7-1b6c-45b8-968c-f4753a242038 tempest-KeyPairsV2TestJSON-1757845830 tempest-KeyPairsV2TestJSON-1757845830-project] Getting quotas for project 234933b0f9df4f5eb5b7dfc63571ab64. Resources: {'key_pairs'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:16:20.040507 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-143895a7-1b6c-45b8-968c-f4753a242038 tempest-KeyPairsV2TestJSON-1757845830 tempest-KeyPairsV2TestJSON-1757845830-project] Getting quotas for user 9248895fab674ebfb1660d8d7ae68b99 and project 234933b0f9df4f5eb5b7dfc63571ab64. Resources: {'key_pairs'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:16:20.101786 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-143895a7-1b6c-45b8-968c-f4753a242038 tempest-KeyPairsV2TestJSON-1757845830 tempest-KeyPairsV2TestJSON-1757845830-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.086866 Oct 19 03:16:20.102400 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 593/1235] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Oct 19 03:16:20 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:16:20.115596 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-047b2a0e-bc3d-4c63-9a56-e75e86ff0461 tempest-KeyPairsV2TestJSON-1757845830 tempest-KeyPairsV2TestJSON-1757845830-project] Action: 'create', calling method: .version_select at 0x7fc130ed80d0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1531922752", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEkdBM+fxfTfFFuHFhsIon4P57Bmp+o+aIU3NaDzfxHaogyfOLnRZ1dIb7oYz3weDvSYKNM3A7IMhtvLeM2ZddH2WUZiJ8CQhZ9UYr6VCXE2dRpoVAeIP2K50hN0dsp17A=="}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:16:20.124220 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-637aa0cb-a83d-449f-b5ca-fc7e0050f10e tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:20.124929 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-637aa0cb-a83d-449f-b5ca-fc7e0050f10e tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 1ee8c251-b609-4eeb-9406-ede7977b3f92] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:20.131291 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-637aa0cb-a83d-449f-b5ca-fc7e0050f10e tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:20.131810 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-637aa0cb-a83d-449f-b5ca-fc7e0050f10e tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:20.132675 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-637aa0cb-a83d-449f-b5ca-fc7e0050f10e tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:20.133597 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-637aa0cb-a83d-449f-b5ca-fc7e0050f10e tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:20.134298 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-637aa0cb-a83d-449f-b5ca-fc7e0050f10e tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:20.134716 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-047b2a0e-bc3d-4c63-9a56-e75e86ff0461 tempest-KeyPairsV2TestJSON-1757845830 tempest-KeyPairsV2TestJSON-1757845830-project] Getting quotas for project 234933b0f9df4f5eb5b7dfc63571ab64. Resources: {'key_pairs'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:16:20.134840 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-637aa0cb-a83d-449f-b5ca-fc7e0050f10e tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:20.141418 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-047b2a0e-bc3d-4c63-9a56-e75e86ff0461 tempest-KeyPairsV2TestJSON-1757845830 tempest-KeyPairsV2TestJSON-1757845830-project] Getting quotas for user 9248895fab674ebfb1660d8d7ae68b99 and project 234933b0f9df4f5eb5b7dfc63571ab64. Resources: {'key_pairs'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:16:20.244274 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-047b2a0e-bc3d-4c63-9a56-e75e86ff0461 tempest-KeyPairsV2TestJSON-1757845830 tempest-KeyPairsV2TestJSON-1757845830-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.132563 Oct 19 03:16:20.245713 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 643/1236] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Oct 19 03:16:20 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:16:20.258663 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1e71e7e6-02ec-4b02-b730-83841e014f05 tempest-KeyPairsV2TestJSON-1757845830 tempest-KeyPairsV2TestJSON-1757845830-project] Action: 'create', calling method: .version_select at 0x7fc130f0e9d0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1294917610", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFpKvqUc48MnH/Qpx42oQogoiR1C5l++033FE/oQ6PMaW0yKXMhZlsukg0S/WuCFFqoA8fh+bHSPCR6WkHy9Qz7QRxIZOwi5hvg00ORTZ118IlJeKG0jRlbWD2LPRZHNwA=="}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:16:20.274982 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-1e71e7e6-02ec-4b02-b730-83841e014f05 tempest-KeyPairsV2TestJSON-1757845830 tempest-KeyPairsV2TestJSON-1757845830-project] Getting quotas for project 234933b0f9df4f5eb5b7dfc63571ab64. Resources: {'key_pairs'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:16:20.279631 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-1e71e7e6-02ec-4b02-b730-83841e014f05 tempest-KeyPairsV2TestJSON-1757845830 tempest-KeyPairsV2TestJSON-1757845830-project] Getting quotas for user 9248895fab674ebfb1660d8d7ae68b99 and project 234933b0f9df4f5eb5b7dfc63571ab64. Resources: {'key_pairs'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:16:20.283577 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-637aa0cb-a83d-449f-b5ca-fc7e0050f10e tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:20.292044 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-637aa0cb-a83d-449f-b5ca-fc7e0050f10e tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/1ee8c251-b609-4eeb-9406-ede7977b3f92" status: 200 len: 1467 microversion: 2.1 time: 0.171256 Oct 19 03:16:20.292614 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 594/1237] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:20 2022] GET /compute/v2.1/servers/1ee8c251-b609-4eeb-9406-ede7977b3f92 => generated 1467 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:16:20.315563 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0d002403-705c-40d4-b505-a43e4bb60e7e tempest-ServersOnMultiNodesTest-74681315 tempest-ServersOnMultiNodesTest-74681315-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:20.316191 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0d002403-705c-40d4-b505-a43e4bb60e7e tempest-ServersOnMultiNodesTest-74681315 tempest-ServersOnMultiNodesTest-74681315-project-admin] [instance: 1ee8c251-b609-4eeb-9406-ede7977b3f92] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:20.322330 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0d002403-705c-40d4-b505-a43e4bb60e7e tempest-ServersOnMultiNodesTest-74681315 tempest-ServersOnMultiNodesTest-74681315-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:20.322885 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0d002403-705c-40d4-b505-a43e4bb60e7e tempest-ServersOnMultiNodesTest-74681315 tempest-ServersOnMultiNodesTest-74681315-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:20.323288 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0d002403-705c-40d4-b505-a43e4bb60e7e tempest-ServersOnMultiNodesTest-74681315 tempest-ServersOnMultiNodesTest-74681315-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:20.324002 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0d002403-705c-40d4-b505-a43e4bb60e7e tempest-ServersOnMultiNodesTest-74681315 tempest-ServersOnMultiNodesTest-74681315-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:20.324519 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0d002403-705c-40d4-b505-a43e4bb60e7e tempest-ServersOnMultiNodesTest-74681315 tempest-ServersOnMultiNodesTest-74681315-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:20.324902 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0d002403-705c-40d4-b505-a43e4bb60e7e tempest-ServersOnMultiNodesTest-74681315 tempest-ServersOnMultiNodesTest-74681315-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:20.339556 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=100 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:16:20.399612 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1e71e7e6-02ec-4b02-b730-83841e014f05 tempest-KeyPairsV2TestJSON-1757845830 tempest-KeyPairsV2TestJSON-1757845830-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.144880 Oct 19 03:16:20.400215 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 644/1238] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Oct 19 03:16:20 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:16:20.414776 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5b261e59-28f2-4ab9-9a4d-825e9eed4655 tempest-KeyPairsV2TestJSON-1757845830 tempest-KeyPairsV2TestJSON-1757845830-project] Calling method '.version_select at 0x7fc130e6f9d0>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:20.419186 n-d-861333-8 devstack@n-api.service[121135]: WARNING oslo_db.sqlalchemy.utils [None req-5b261e59-28f2-4ab9-9a4d-825e9eed4655 tempest-KeyPairsV2TestJSON-1757845830 tempest-KeyPairsV2TestJSON-1757845830-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 19 03:16:20.426600 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5b261e59-28f2-4ab9-9a4d-825e9eed4655 tempest-KeyPairsV2TestJSON-1757845830 tempest-KeyPairsV2TestJSON-1757845830-project] 10.222.0.52 "GET /compute/v2.1/os-keypairs" status: 200 len: 1094 microversion: 2.1 time: 0.015645 Oct 19 03:16:20.427149 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 645/1239] 10.222.0.52 () {58 vars in 1137 bytes} [Wed Oct 19 03:16:20 2022] GET /compute/v2.1/os-keypairs => generated 1094 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:16:20.442935 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3197c9fb-b72d-46a6-8e39-17a95974e09b tempest-KeyPairsV2TestJSON-1757845830 tempest-KeyPairsV2TestJSON-1757845830-project] Calling method '.version_select at 0x7fc130e69040>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:20.452049 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0d002403-705c-40d4-b505-a43e4bb60e7e tempest-ServersOnMultiNodesTest-74681315 tempest-ServersOnMultiNodesTest-74681315-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/1ee8c251-b609-4eeb-9406-ede7977b3f92" status: 200 len: 1618 microversion: 2.1 time: 0.139956 Oct 19 03:16:20.452620 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 595/1240] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:20 2022] GET /compute/v2.1/servers/1ee8c251-b609-4eeb-9406-ede7977b3f92 => generated 1618 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:16:20.523939 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-3197c9fb-b72d-46a6-8e39-17a95974e09b tempest-KeyPairsV2TestJSON-1757845830 tempest-KeyPairsV2TestJSON-1757845830-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1294917610" status: 202 len: 0 microversion: 2.1 time: 0.085258 Oct 19 03:16:20.524575 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 646/1241] 10.222.0.52 () {58 vars in 1278 bytes} [Wed Oct 19 03:16:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1294917610 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 19 03:16:20.534033 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b9c86381-31ea-484a-ad52-6784b594fb80 tempest-KeyPairsV2TestJSON-1757845830 tempest-KeyPairsV2TestJSON-1757845830-project] Calling method '.version_select at 0x7fc130d033a0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:20.568785 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-dd251238-0420-4bb8-ba59-8f75b60f3fff tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:20.569730 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-dd251238-0420-4bb8-ba59-8f75b60f3fff tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 9daa020d-efe7-4033-a479-cb5dadbc3ad7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:20.579792 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dd251238-0420-4bb8-ba59-8f75b60f3fff tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:20.581480 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dd251238-0420-4bb8-ba59-8f75b60f3fff tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:20.581480 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dd251238-0420-4bb8-ba59-8f75b60f3fff tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:20.581676 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dd251238-0420-4bb8-ba59-8f75b60f3fff tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:20.581994 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dd251238-0420-4bb8-ba59-8f75b60f3fff tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:20.582454 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dd251238-0420-4bb8-ba59-8f75b60f3fff tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:20.662609 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b9c86381-31ea-484a-ad52-6784b594fb80 tempest-KeyPairsV2TestJSON-1757845830 tempest-KeyPairsV2TestJSON-1757845830-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1531922752" status: 202 len: 0 microversion: 2.1 time: 0.133073 Oct 19 03:16:20.668265 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 596/1242] 10.222.0.52 () {58 vars in 1278 bytes} [Wed Oct 19 03:16:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1531922752 => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:16:20.673427 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-95277036-4fe0-47c2-9eca-4b95dcb58214 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-985074776", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["2d709051-db69-4ea9-96dc-ffe05e9c9b3a"]}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:16:20.683397 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:16:20.732861 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-95277036-4fe0-47c2-9eca-4b95dcb58214 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] validate_networks() for None {{(pid=121134) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:16:20.779904 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-dd251238-0420-4bb8-ba59-8f75b60f3fff tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:20.788872 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-dd251238-0420-4bb8-ba59-8f75b60f3fff tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7" status: 200 len: 1541 microversion: 2.1 time: 0.224405 Oct 19 03:16:20.789799 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 647/1243] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:20 2022] GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7 => generated 1541 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:16:20.794849 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-95b9d109-c669-4972-b220-239765521813 tempest-KeyPairsV2TestJSON-1757845830 tempest-KeyPairsV2TestJSON-1757845830-project] Calling method '.version_select at 0x7fc130e6f8b0>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:20.867485 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-95b9d109-c669-4972-b220-239765521813 tempest-KeyPairsV2TestJSON-1757845830 tempest-KeyPairsV2TestJSON-1757845830-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1478733638" status: 202 len: 0 microversion: 2.1 time: 0.076789 Oct 19 03:16:20.868081 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 648/1244] 10.222.0.52 () {58 vars in 1278 bytes} [Wed Oct 19 03:16:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1478733638 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:16:20.873352 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7c5529ea-4e3a-41f1-8a8c-173471f3ae48 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:20.874054 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7c5529ea-4e3a-41f1-8a8c-173471f3ae48 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:20.881164 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7c5529ea-4e3a-41f1-8a8c-173471f3ae48 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:20.881700 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7c5529ea-4e3a-41f1-8a8c-173471f3ae48 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:20.882150 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7c5529ea-4e3a-41f1-8a8c-173471f3ae48 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:20.882892 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7c5529ea-4e3a-41f1-8a8c-173471f3ae48 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:20.883717 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7c5529ea-4e3a-41f1-8a8c-173471f3ae48 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:20.884162 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7c5529ea-4e3a-41f1-8a8c-173471f3ae48 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:20.979464 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7c5529ea-4e3a-41f1-8a8c-173471f3ae48 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:20.989339 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7c5529ea-4e3a-41f1-8a8c-173471f3ae48 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:20.996005 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7c5529ea-4e3a-41f1-8a8c-173471f3ae48 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:20.997255 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7c5529ea-4e3a-41f1-8a8c-173471f3ae48 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1539 microversion: 2.91 time: 0.128156 Oct 19 03:16:20.998123 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 649/1245] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:16:20 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1539 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:16:21.117038 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=8 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:16:21.152662 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-95277036-4fe0-47c2-9eca-4b95dcb58214 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Flavor limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:16:21.154096 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-95277036-4fe0-47c2-9eca-4b95dcb58214 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Image limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:16:21.154721 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-95277036-4fe0-47c2-9eca-4b95dcb58214 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Flavor pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:16:21.155141 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-95277036-4fe0-47c2-9eca-4b95dcb58214 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Image pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:16:21.156369 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-95277036-4fe0-47c2-9eca-4b95dcb58214 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:16:21.168169 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-95277036-4fe0-47c2-9eca-4b95dcb58214 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:21.169040 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-95277036-4fe0-47c2-9eca-4b95dcb58214 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:21.170229 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-95277036-4fe0-47c2-9eca-4b95dcb58214 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:21.171135 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-95277036-4fe0-47c2-9eca-4b95dcb58214 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:21.171970 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-95277036-4fe0-47c2-9eca-4b95dcb58214 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:21.172587 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-95277036-4fe0-47c2-9eca-4b95dcb58214 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:21.193488 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-95277036-4fe0-47c2-9eca-4b95dcb58214 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Getting quotas for project 5d909fe7763841d5b452738112b656d3. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:16:21.198925 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-95277036-4fe0-47c2-9eca-4b95dcb58214 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Getting quotas for user 3e4d3ddb3a324d9da51c13701e318955 and project 5d909fe7763841d5b452738112b656d3. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:16:21.212596 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-95277036-4fe0-47c2-9eca-4b95dcb58214 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Going to run 1 instances... {{(pid=121134) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:16:21.216690 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-95277036-4fe0-47c2-9eca-4b95dcb58214 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 0843e340-11a3-4a88-b9a6-b0024d3b3152] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:16:21.332065 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-95277036-4fe0-47c2-9eca-4b95dcb58214 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.662413 Oct 19 03:16:21.333064 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 597/1246] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:16:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 664 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 03:16:21.344903 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c97b6bbb-7348-417e-877f-85e7c9c4bbbf tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:21.349039 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c97b6bbb-7348-417e-877f-85e7c9c4bbbf tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 0843e340-11a3-4a88-b9a6-b0024d3b3152] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:21.349039 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=10 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:16:21.349282 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-ed17b103-b9c2-41b9-bb08-c3d8d5b770c7 req-4fb1f96f-f4f4-47e1-aa49-3e0b184d09cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9daa020d-efe7-4033-a479-cb5dadbc3ad7", "name": "network-vif-unplugged", "status": "completed", "tag": "ffc480f5-b5eb-49ea-81a9-00c3c1562f19"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:16:21.361001 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-ed17b103-b9c2-41b9-bb08-c3d8d5b770c7 req-4fb1f96f-f4f4-47e1-aa49-3e0b184d09cd service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:21.361618 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-ed17b103-b9c2-41b9-bb08-c3d8d5b770c7 req-4fb1f96f-f4f4-47e1-aa49-3e0b184d09cd service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:21.362123 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-ed17b103-b9c2-41b9-bb08-c3d8d5b770c7 req-4fb1f96f-f4f4-47e1-aa49-3e0b184d09cd service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:21.377290 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-ed17b103-b9c2-41b9-bb08-c3d8d5b770c7 req-4fb1f96f-f4f4-47e1-aa49-3e0b184d09cd service nova] Creating event network-vif-unplugged:ffc480f5-b5eb-49ea-81a9-00c3c1562f19 for instance 9daa020d-efe7-4033-a479-cb5dadbc3ad7 on n-h1-861333-8 Oct 19 03:16:21.384102 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [req-ed17b103-b9c2-41b9-bb08-c3d8d5b770c7 req-4fb1f96f-f4f4-47e1-aa49-3e0b184d09cd service nova] Instance 9daa020d-efe7-4033-a479-cb5dadbc3ad7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-861333-8', 'n-h1-861333-8'} {{(pid=121134) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 03:16:21.396880 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-ed17b103-b9c2-41b9-bb08-c3d8d5b770c7 req-4fb1f96f-f4f4-47e1-aa49-3e0b184d09cd service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053858 Oct 19 03:16:21.398393 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 598/1247] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:16:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:16:21.532422 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c97b6bbb-7348-417e-877f-85e7c9c4bbbf tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:21.532422 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c97b6bbb-7348-417e-877f-85e7c9c4bbbf tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/0843e340-11a3-4a88-b9a6-b0024d3b3152" status: 200 len: 1216 microversion: 2.1 time: 0.129623 Oct 19 03:16:21.532422 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 650/1248] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:21 2022] GET /compute/v2.1/servers/0843e340-11a3-4a88-b9a6-b0024d3b3152 => generated 1216 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:16:21.815647 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a3fd2291-83b7-4d85-ab75-2a8c2fd277e9 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:21.816440 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a3fd2291-83b7-4d85-ab75-2a8c2fd277e9 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 9daa020d-efe7-4033-a479-cb5dadbc3ad7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:21.823393 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a3fd2291-83b7-4d85-ab75-2a8c2fd277e9 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:21.823950 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a3fd2291-83b7-4d85-ab75-2a8c2fd277e9 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:21.824453 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a3fd2291-83b7-4d85-ab75-2a8c2fd277e9 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:21.825238 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a3fd2291-83b7-4d85-ab75-2a8c2fd277e9 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:21.825779 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a3fd2291-83b7-4d85-ab75-2a8c2fd277e9 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:21.826268 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a3fd2291-83b7-4d85-ab75-2a8c2fd277e9 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:22.017970 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a3fd2291-83b7-4d85-ab75-2a8c2fd277e9 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:22.028231 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2239797b-4d67-4486-8b33-9dadbcdf9eb6 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:22.028723 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a3fd2291-83b7-4d85-ab75-2a8c2fd277e9 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7" status: 200 len: 1541 microversion: 2.1 time: 0.218218 Oct 19 03:16:22.028858 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-2239797b-4d67-4486-8b33-9dadbcdf9eb6 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:22.029302 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 599/1249] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:21 2022] GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7 => generated 1541 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:16:22.035210 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2239797b-4d67-4486-8b33-9dadbcdf9eb6 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:22.035697 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2239797b-4d67-4486-8b33-9dadbcdf9eb6 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:22.036140 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2239797b-4d67-4486-8b33-9dadbcdf9eb6 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:22.036841 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2239797b-4d67-4486-8b33-9dadbcdf9eb6 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:22.037298 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2239797b-4d67-4486-8b33-9dadbcdf9eb6 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:22.037756 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2239797b-4d67-4486-8b33-9dadbcdf9eb6 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:22.136214 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-2239797b-4d67-4486-8b33-9dadbcdf9eb6 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:22.147377 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-2239797b-4d67-4486-8b33-9dadbcdf9eb6 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:22.148828 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-2239797b-4d67-4486-8b33-9dadbcdf9eb6 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:22.154522 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2239797b-4d67-4486-8b33-9dadbcdf9eb6 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1539 microversion: 2.91 time: 0.131474 Oct 19 03:16:22.155115 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 651/1250] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:16:22 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1539 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:16:22.496499 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-faed71dc-d4e9-484f-abf8-5e882a10c9a0 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:22.497218 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-faed71dc-d4e9-484f-abf8-5e882a10c9a0 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 0843e340-11a3-4a88-b9a6-b0024d3b3152] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:22.505238 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-faed71dc-d4e9-484f-abf8-5e882a10c9a0 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:22.506078 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-faed71dc-d4e9-484f-abf8-5e882a10c9a0 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:22.506709 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-faed71dc-d4e9-484f-abf8-5e882a10c9a0 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:22.507426 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-faed71dc-d4e9-484f-abf8-5e882a10c9a0 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:22.508051 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-faed71dc-d4e9-484f-abf8-5e882a10c9a0 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:22.508666 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-faed71dc-d4e9-484f-abf8-5e882a10c9a0 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:22.616287 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-faed71dc-d4e9-484f-abf8-5e882a10c9a0 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:22.629390 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-faed71dc-d4e9-484f-abf8-5e882a10c9a0 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/0843e340-11a3-4a88-b9a6-b0024d3b3152" status: 200 len: 1220 microversion: 2.1 time: 0.137607 Oct 19 03:16:22.630504 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 600/1251] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:22 2022] GET /compute/v2.1/servers/0843e340-11a3-4a88-b9a6-b0024d3b3152 => generated 1220 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:16:23.052183 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-963f925e-28db-48cd-ad73-95567fea60b5 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:23.052826 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-963f925e-28db-48cd-ad73-95567fea60b5 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 9daa020d-efe7-4033-a479-cb5dadbc3ad7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:23.059840 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-963f925e-28db-48cd-ad73-95567fea60b5 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:23.060401 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-963f925e-28db-48cd-ad73-95567fea60b5 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:23.061002 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-963f925e-28db-48cd-ad73-95567fea60b5 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:23.061794 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-963f925e-28db-48cd-ad73-95567fea60b5 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:23.062331 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-963f925e-28db-48cd-ad73-95567fea60b5 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:23.062814 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-963f925e-28db-48cd-ad73-95567fea60b5 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:23.184328 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6f8dcef1-72c2-4fd7-a96e-0310463db5f2 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:23.186068 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6f8dcef1-72c2-4fd7-a96e-0310463db5f2 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:23.197530 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6f8dcef1-72c2-4fd7-a96e-0310463db5f2 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:23.199083 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6f8dcef1-72c2-4fd7-a96e-0310463db5f2 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:23.199083 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6f8dcef1-72c2-4fd7-a96e-0310463db5f2 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:23.199839 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6f8dcef1-72c2-4fd7-a96e-0310463db5f2 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:23.200494 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6f8dcef1-72c2-4fd7-a96e-0310463db5f2 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:23.201274 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6f8dcef1-72c2-4fd7-a96e-0310463db5f2 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:23.213354 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-963f925e-28db-48cd-ad73-95567fea60b5 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:23.223455 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-963f925e-28db-48cd-ad73-95567fea60b5 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7" status: 200 len: 1473 microversion: 2.1 time: 0.175148 Oct 19 03:16:23.226570 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 652/1252] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:23 2022] GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7 => generated 1473 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:16:23.281659 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-6f8dcef1-72c2-4fd7-a96e-0310463db5f2 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:23.289851 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-6f8dcef1-72c2-4fd7-a96e-0310463db5f2 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:23.292204 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-6f8dcef1-72c2-4fd7-a96e-0310463db5f2 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:23.297550 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6f8dcef1-72c2-4fd7-a96e-0310463db5f2 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1539 microversion: 2.91 time: 0.119088 Oct 19 03:16:23.298125 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 601/1253] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:16:23 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1539 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:16:23.351701 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e37eebb6-703f-47ee-9650-b0177e6b9cab tempest-AZV2TestJSON-79393028 tempest-AZV2TestJSON-79393028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:23.353518 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e37eebb6-703f-47ee-9650-b0177e6b9cab tempest-AZV2TestJSON-79393028 tempest-AZV2TestJSON-79393028-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:23.354542 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e37eebb6-703f-47ee-9650-b0177e6b9cab tempest-AZV2TestJSON-79393028 tempest-AZV2TestJSON-79393028-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:23.354981 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e37eebb6-703f-47ee-9650-b0177e6b9cab tempest-AZV2TestJSON-79393028 tempest-AZV2TestJSON-79393028-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:23.355708 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e37eebb6-703f-47ee-9650-b0177e6b9cab tempest-AZV2TestJSON-79393028 tempest-AZV2TestJSON-79393028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:23.356167 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e37eebb6-703f-47ee-9650-b0177e6b9cab tempest-AZV2TestJSON-79393028 tempest-AZV2TestJSON-79393028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:23.356592 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e37eebb6-703f-47ee-9650-b0177e6b9cab tempest-AZV2TestJSON-79393028 tempest-AZV2TestJSON-79393028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:23.381775 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e37eebb6-703f-47ee-9650-b0177e6b9cab tempest-AZV2TestJSON-79393028 tempest-AZV2TestJSON-79393028-project] 10.222.0.52 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.151000 Oct 19 03:16:23.382344 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 653/1254] 10.222.0.52 () {58 vars in 1164 bytes} [Wed Oct 19 03:16:23 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 03:16:23.412289 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-dee4d4f7-9c78-471b-90a1-1b63d5b9705a req-5a67d658-5575-4619-b872-995af086e674 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9daa020d-efe7-4033-a479-cb5dadbc3ad7", "tag": "ffc480f5-b5eb-49ea-81a9-00c3c1562f19"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:16:23.423315 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-dee4d4f7-9c78-471b-90a1-1b63d5b9705a req-5a67d658-5575-4619-b872-995af086e674 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:23.424244 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-dee4d4f7-9c78-471b-90a1-1b63d5b9705a req-5a67d658-5575-4619-b872-995af086e674 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:23.424747 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-dee4d4f7-9c78-471b-90a1-1b63d5b9705a req-5a67d658-5575-4619-b872-995af086e674 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:23.437318 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-dee4d4f7-9c78-471b-90a1-1b63d5b9705a req-5a67d658-5575-4619-b872-995af086e674 service nova] Creating event network-changed:ffc480f5-b5eb-49ea-81a9-00c3c1562f19 for instance 9daa020d-efe7-4033-a479-cb5dadbc3ad7 on n-h1-861333-8 Oct 19 03:16:23.442826 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [req-dee4d4f7-9c78-471b-90a1-1b63d5b9705a req-5a67d658-5575-4619-b872-995af086e674 service nova] Instance 9daa020d-efe7-4033-a479-cb5dadbc3ad7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-861333-8', 'n-h1-861333-8'} {{(pid=121134) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 03:16:23.454328 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-dee4d4f7-9c78-471b-90a1-1b63d5b9705a req-5a67d658-5575-4619-b872-995af086e674 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045900 Oct 19 03:16:23.454936 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 602/1255] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:16:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:16:23.655699 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4866ef9a-3f64-4641-b80b-ddcf19bc7fff tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:23.656530 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4866ef9a-3f64-4641-b80b-ddcf19bc7fff tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 0843e340-11a3-4a88-b9a6-b0024d3b3152] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:23.663269 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4866ef9a-3f64-4641-b80b-ddcf19bc7fff tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:23.663829 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4866ef9a-3f64-4641-b80b-ddcf19bc7fff tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:23.664546 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4866ef9a-3f64-4641-b80b-ddcf19bc7fff tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:23.665363 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4866ef9a-3f64-4641-b80b-ddcf19bc7fff tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:23.665948 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4866ef9a-3f64-4641-b80b-ddcf19bc7fff tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:23.667122 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4866ef9a-3f64-4641-b80b-ddcf19bc7fff tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:23.876185 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4866ef9a-3f64-4641-b80b-ddcf19bc7fff tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:23.885957 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4866ef9a-3f64-4641-b80b-ddcf19bc7fff tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/0843e340-11a3-4a88-b9a6-b0024d3b3152" status: 200 len: 1268 microversion: 2.1 time: 0.235192 Oct 19 03:16:23.886522 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 654/1256] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:23 2022] GET /compute/v2.1/servers/0843e340-11a3-4a88-b9a6-b0024d3b3152 => generated 1268 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:16:24.256415 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-35fbc91b-dc9a-42ee-a37b-1e6128bd43b2 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:24.257655 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-35fbc91b-dc9a-42ee-a37b-1e6128bd43b2 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 9daa020d-efe7-4033-a479-cb5dadbc3ad7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:24.265995 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-35fbc91b-dc9a-42ee-a37b-1e6128bd43b2 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:24.266844 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-35fbc91b-dc9a-42ee-a37b-1e6128bd43b2 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:24.266985 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-35fbc91b-dc9a-42ee-a37b-1e6128bd43b2 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:24.267735 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-35fbc91b-dc9a-42ee-a37b-1e6128bd43b2 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:24.268771 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-35fbc91b-dc9a-42ee-a37b-1e6128bd43b2 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:24.269216 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-35fbc91b-dc9a-42ee-a37b-1e6128bd43b2 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:24.329216 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f9521e25-1dfa-4a2b-834f-911a00c68f79 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:24.329890 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f9521e25-1dfa-4a2b-834f-911a00c68f79 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:24.336199 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f9521e25-1dfa-4a2b-834f-911a00c68f79 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:24.336690 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f9521e25-1dfa-4a2b-834f-911a00c68f79 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:24.337132 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f9521e25-1dfa-4a2b-834f-911a00c68f79 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:24.337904 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f9521e25-1dfa-4a2b-834f-911a00c68f79 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:24.338389 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f9521e25-1dfa-4a2b-834f-911a00c68f79 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:24.338989 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f9521e25-1dfa-4a2b-834f-911a00c68f79 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:24.421030 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f9521e25-1dfa-4a2b-834f-911a00c68f79 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:24.429769 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f9521e25-1dfa-4a2b-834f-911a00c68f79 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:24.432297 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f9521e25-1dfa-4a2b-834f-911a00c68f79 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:24.437095 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f9521e25-1dfa-4a2b-834f-911a00c68f79 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1539 microversion: 2.91 time: 0.115449 Oct 19 03:16:24.437914 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 655/1257] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:16:24 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1539 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:16:24.452092 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-35fbc91b-dc9a-42ee-a37b-1e6128bd43b2 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:24.459959 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-35fbc91b-dc9a-42ee-a37b-1e6128bd43b2 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7" status: 200 len: 1473 microversion: 2.1 time: 0.208383 Oct 19 03:16:24.461849 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 603/1258] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:24 2022] GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7 => generated 1473 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:16:24.909970 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-8aeb0147-4bc7-454e-bfee-7ebc13e9a1a1 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:24.910670 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-8aeb0147-4bc7-454e-bfee-7ebc13e9a1a1 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 0843e340-11a3-4a88-b9a6-b0024d3b3152] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:24.917111 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8aeb0147-4bc7-454e-bfee-7ebc13e9a1a1 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:24.917638 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8aeb0147-4bc7-454e-bfee-7ebc13e9a1a1 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:24.918081 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8aeb0147-4bc7-454e-bfee-7ebc13e9a1a1 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:24.918778 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8aeb0147-4bc7-454e-bfee-7ebc13e9a1a1 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:24.919235 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8aeb0147-4bc7-454e-bfee-7ebc13e9a1a1 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:24.919665 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8aeb0147-4bc7-454e-bfee-7ebc13e9a1a1 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:24.987298 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-8aeb0147-4bc7-454e-bfee-7ebc13e9a1a1 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:24.995650 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-8aeb0147-4bc7-454e-bfee-7ebc13e9a1a1 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/0843e340-11a3-4a88-b9a6-b0024d3b3152" status: 200 len: 1268 microversion: 2.1 time: 0.089591 Oct 19 03:16:24.996212 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 656/1259] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:24 2022] GET /compute/v2.1/servers/0843e340-11a3-4a88-b9a6-b0024d3b3152 => generated 1268 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:16:25.465994 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d003d83a-9a99-4559-8d0f-db80179d40e0 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:25.466816 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d003d83a-9a99-4559-8d0f-db80179d40e0 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:25.473774 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d003d83a-9a99-4559-8d0f-db80179d40e0 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:25.474258 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d003d83a-9a99-4559-8d0f-db80179d40e0 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:25.474760 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d003d83a-9a99-4559-8d0f-db80179d40e0 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:25.475464 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d003d83a-9a99-4559-8d0f-db80179d40e0 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:25.475920 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d003d83a-9a99-4559-8d0f-db80179d40e0 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:25.476343 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d003d83a-9a99-4559-8d0f-db80179d40e0 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:25.482947 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a0818a1c-cd1f-4566-a2a9-9afba45194ed tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:25.483643 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a0818a1c-cd1f-4566-a2a9-9afba45194ed tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 9daa020d-efe7-4033-a479-cb5dadbc3ad7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:25.490258 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a0818a1c-cd1f-4566-a2a9-9afba45194ed tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:25.490976 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a0818a1c-cd1f-4566-a2a9-9afba45194ed tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:25.491483 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a0818a1c-cd1f-4566-a2a9-9afba45194ed tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:25.492184 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a0818a1c-cd1f-4566-a2a9-9afba45194ed tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:25.492643 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a0818a1c-cd1f-4566-a2a9-9afba45194ed tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:25.493123 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a0818a1c-cd1f-4566-a2a9-9afba45194ed tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:25.558733 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d003d83a-9a99-4559-8d0f-db80179d40e0 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:25.567003 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d003d83a-9a99-4559-8d0f-db80179d40e0 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:25.568443 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d003d83a-9a99-4559-8d0f-db80179d40e0 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:25.573916 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d003d83a-9a99-4559-8d0f-db80179d40e0 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1539 microversion: 2.91 time: 0.113253 Oct 19 03:16:25.574661 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 604/1260] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:16:25 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1539 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:16:25.665765 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a0818a1c-cd1f-4566-a2a9-9afba45194ed tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:25.673501 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a0818a1c-cd1f-4566-a2a9-9afba45194ed tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7" status: 200 len: 1473 microversion: 2.1 time: 0.195019 Oct 19 03:16:25.675394 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 657/1261] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:25 2022] GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7 => generated 1473 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:16:26.020295 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-efc30dc0-4dec-4209-9184-d7ac68828faf tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:26.020955 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-efc30dc0-4dec-4209-9184-d7ac68828faf tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 0843e340-11a3-4a88-b9a6-b0024d3b3152] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:26.027283 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-efc30dc0-4dec-4209-9184-d7ac68828faf tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:26.027797 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-efc30dc0-4dec-4209-9184-d7ac68828faf tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:26.028244 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-efc30dc0-4dec-4209-9184-d7ac68828faf tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:26.028979 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-efc30dc0-4dec-4209-9184-d7ac68828faf tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:26.029596 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-efc30dc0-4dec-4209-9184-d7ac68828faf tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:26.030035 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-efc30dc0-4dec-4209-9184-d7ac68828faf tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:26.092043 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-efc30dc0-4dec-4209-9184-d7ac68828faf tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:26.102050 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-efc30dc0-4dec-4209-9184-d7ac68828faf tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/0843e340-11a3-4a88-b9a6-b0024d3b3152" status: 200 len: 1268 microversion: 2.1 time: 0.085851 Oct 19 03:16:26.102050 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 605/1262] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:26 2022] GET /compute/v2.1/servers/0843e340-11a3-4a88-b9a6-b0024d3b3152 => generated 1268 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:16:26.601922 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-aaf41315-bea8-4ebe-9ba8-878dd7040555 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:26.604417 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-aaf41315-bea8-4ebe-9ba8-878dd7040555 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:26.609682 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aaf41315-bea8-4ebe-9ba8-878dd7040555 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:26.610169 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aaf41315-bea8-4ebe-9ba8-878dd7040555 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:26.610604 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aaf41315-bea8-4ebe-9ba8-878dd7040555 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:26.611306 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aaf41315-bea8-4ebe-9ba8-878dd7040555 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:26.611762 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aaf41315-bea8-4ebe-9ba8-878dd7040555 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:26.612194 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aaf41315-bea8-4ebe-9ba8-878dd7040555 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:26.676955 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-aaf41315-bea8-4ebe-9ba8-878dd7040555 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:26.685257 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-aaf41315-bea8-4ebe-9ba8-878dd7040555 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:26.686725 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-aaf41315-bea8-4ebe-9ba8-878dd7040555 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:26.691469 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-aaf41315-bea8-4ebe-9ba8-878dd7040555 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1539 microversion: 2.91 time: 0.093537 Oct 19 03:16:26.692028 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 658/1263] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:16:26 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1539 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:16:26.696350 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-621119ae-ba6d-4b35-b18b-2f1cafc6e69e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:26.701587 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-621119ae-ba6d-4b35-b18b-2f1cafc6e69e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 9daa020d-efe7-4033-a479-cb5dadbc3ad7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:26.703857 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-621119ae-ba6d-4b35-b18b-2f1cafc6e69e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:26.704309 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-621119ae-ba6d-4b35-b18b-2f1cafc6e69e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:26.704742 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-621119ae-ba6d-4b35-b18b-2f1cafc6e69e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:26.705452 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-621119ae-ba6d-4b35-b18b-2f1cafc6e69e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:26.705906 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-621119ae-ba6d-4b35-b18b-2f1cafc6e69e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:26.706329 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-621119ae-ba6d-4b35-b18b-2f1cafc6e69e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:26.863208 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-621119ae-ba6d-4b35-b18b-2f1cafc6e69e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:26.871055 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-621119ae-ba6d-4b35-b18b-2f1cafc6e69e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7" status: 200 len: 1473 microversion: 2.1 time: 0.178820 Oct 19 03:16:26.874793 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 606/1264] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:26 2022] GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7 => generated 1473 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:16:27.123737 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c0709075-594f-4592-8ada-37da3cb12d0b tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:27.124394 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c0709075-594f-4592-8ada-37da3cb12d0b tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 0843e340-11a3-4a88-b9a6-b0024d3b3152] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:27.130366 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c0709075-594f-4592-8ada-37da3cb12d0b tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:27.131579 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c0709075-594f-4592-8ada-37da3cb12d0b tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:27.131579 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c0709075-594f-4592-8ada-37da3cb12d0b tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:27.132021 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c0709075-594f-4592-8ada-37da3cb12d0b tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:27.132496 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c0709075-594f-4592-8ada-37da3cb12d0b tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:27.132967 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c0709075-594f-4592-8ada-37da3cb12d0b tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:27.235487 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c0709075-594f-4592-8ada-37da3cb12d0b tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:27.241778 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c0709075-594f-4592-8ada-37da3cb12d0b tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/0843e340-11a3-4a88-b9a6-b0024d3b3152" status: 200 len: 1268 microversion: 2.1 time: 0.121181 Oct 19 03:16:27.242526 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 659/1265] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:27 2022] GET /compute/v2.1/servers/0843e340-11a3-4a88-b9a6-b0024d3b3152 => generated 1268 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:16:27.719447 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b740eb54-4c87-4e1b-81b8-f54127adcdea tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:27.724596 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b740eb54-4c87-4e1b-81b8-f54127adcdea tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:27.735793 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b740eb54-4c87-4e1b-81b8-f54127adcdea tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:27.737772 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b740eb54-4c87-4e1b-81b8-f54127adcdea tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:27.740757 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b740eb54-4c87-4e1b-81b8-f54127adcdea tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:27.741795 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b740eb54-4c87-4e1b-81b8-f54127adcdea tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:27.742571 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b740eb54-4c87-4e1b-81b8-f54127adcdea tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:27.743107 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b740eb54-4c87-4e1b-81b8-f54127adcdea tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:27.846376 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b740eb54-4c87-4e1b-81b8-f54127adcdea tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:27.856700 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b740eb54-4c87-4e1b-81b8-f54127adcdea tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:27.858316 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b740eb54-4c87-4e1b-81b8-f54127adcdea tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:27.863369 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b740eb54-4c87-4e1b-81b8-f54127adcdea tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1539 microversion: 2.91 time: 0.147950 Oct 19 03:16:27.863946 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 607/1266] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:16:27 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1539 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:16:27.895800 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-955b6999-6f44-41fd-b911-0dfc969cc2a1 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:27.896966 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-955b6999-6f44-41fd-b911-0dfc969cc2a1 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 9daa020d-efe7-4033-a479-cb5dadbc3ad7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:27.904325 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-955b6999-6f44-41fd-b911-0dfc969cc2a1 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:27.905022 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-955b6999-6f44-41fd-b911-0dfc969cc2a1 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:27.905492 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-955b6999-6f44-41fd-b911-0dfc969cc2a1 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:27.906204 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-955b6999-6f44-41fd-b911-0dfc969cc2a1 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:27.906663 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-955b6999-6f44-41fd-b911-0dfc969cc2a1 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:27.907096 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-955b6999-6f44-41fd-b911-0dfc969cc2a1 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:27.911622 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=100 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:16:28.094899 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-955b6999-6f44-41fd-b911-0dfc969cc2a1 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:28.103096 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-955b6999-6f44-41fd-b911-0dfc969cc2a1 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7" status: 200 len: 1473 microversion: 2.1 time: 0.211744 Oct 19 03:16:28.104332 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 660/1267] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:27 2022] GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7 => generated 1473 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:16:28.264611 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f5a2ce8b-ec0e-48e4-9fb7-c8c63864d30b tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:28.265234 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f5a2ce8b-ec0e-48e4-9fb7-c8c63864d30b tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 0843e340-11a3-4a88-b9a6-b0024d3b3152] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:28.272084 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f5a2ce8b-ec0e-48e4-9fb7-c8c63864d30b tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:28.274793 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f5a2ce8b-ec0e-48e4-9fb7-c8c63864d30b tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:28.274793 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f5a2ce8b-ec0e-48e4-9fb7-c8c63864d30b tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:28.274793 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f5a2ce8b-ec0e-48e4-9fb7-c8c63864d30b tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:28.274793 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f5a2ce8b-ec0e-48e4-9fb7-c8c63864d30b tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:28.275200 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f5a2ce8b-ec0e-48e4-9fb7-c8c63864d30b tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:28.356080 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-f5a2ce8b-ec0e-48e4-9fb7-c8c63864d30b tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:28.364090 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f5a2ce8b-ec0e-48e4-9fb7-c8c63864d30b tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/0843e340-11a3-4a88-b9a6-b0024d3b3152" status: 200 len: 1268 microversion: 2.1 time: 0.103701 Oct 19 03:16:28.364748 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 608/1268] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:28 2022] GET /compute/v2.1/servers/0843e340-11a3-4a88-b9a6-b0024d3b3152 => generated 1268 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:16:28.892644 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ea2648d6-0ce8-4af5-bb4e-d40a14b44ab8 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:28.893668 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ea2648d6-0ce8-4af5-bb4e-d40a14b44ab8 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:28.900090 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ea2648d6-0ce8-4af5-bb4e-d40a14b44ab8 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:28.900766 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ea2648d6-0ce8-4af5-bb4e-d40a14b44ab8 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:28.902816 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ea2648d6-0ce8-4af5-bb4e-d40a14b44ab8 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:28.902816 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ea2648d6-0ce8-4af5-bb4e-d40a14b44ab8 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:28.902816 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ea2648d6-0ce8-4af5-bb4e-d40a14b44ab8 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:28.903112 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ea2648d6-0ce8-4af5-bb4e-d40a14b44ab8 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:28.987271 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ea2648d6-0ce8-4af5-bb4e-d40a14b44ab8 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:28.999725 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ea2648d6-0ce8-4af5-bb4e-d40a14b44ab8 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:29.000838 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ea2648d6-0ce8-4af5-bb4e-d40a14b44ab8 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:29.006382 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ea2648d6-0ce8-4af5-bb4e-d40a14b44ab8 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1560 microversion: 2.91 time: 0.117675 Oct 19 03:16:29.007147 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 661/1269] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:16:28 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1560 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:16:29.127535 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e86d454f-4a09-4c0d-93ba-c4950b61913b tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:29.128728 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e86d454f-4a09-4c0d-93ba-c4950b61913b tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 9daa020d-efe7-4033-a479-cb5dadbc3ad7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:29.145113 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e86d454f-4a09-4c0d-93ba-c4950b61913b tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:29.145999 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e86d454f-4a09-4c0d-93ba-c4950b61913b tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:29.146621 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e86d454f-4a09-4c0d-93ba-c4950b61913b tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:29.147973 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e86d454f-4a09-4c0d-93ba-c4950b61913b tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:29.150287 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e86d454f-4a09-4c0d-93ba-c4950b61913b tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:29.150945 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e86d454f-4a09-4c0d-93ba-c4950b61913b tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:29.387367 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-39ee5296-9353-492c-9544-9f4b6ca1fe20 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:29.388498 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-39ee5296-9353-492c-9544-9f4b6ca1fe20 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 0843e340-11a3-4a88-b9a6-b0024d3b3152] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:29.400912 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-39ee5296-9353-492c-9544-9f4b6ca1fe20 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:29.401065 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-39ee5296-9353-492c-9544-9f4b6ca1fe20 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:29.414213 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-39ee5296-9353-492c-9544-9f4b6ca1fe20 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:29.415360 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-39ee5296-9353-492c-9544-9f4b6ca1fe20 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:29.416608 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-39ee5296-9353-492c-9544-9f4b6ca1fe20 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:29.417355 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-39ee5296-9353-492c-9544-9f4b6ca1fe20 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:29.534149 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-39ee5296-9353-492c-9544-9f4b6ca1fe20 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:29.543379 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e86d454f-4a09-4c0d-93ba-c4950b61913b tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:29.556247 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-39ee5296-9353-492c-9544-9f4b6ca1fe20 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/0843e340-11a3-4a88-b9a6-b0024d3b3152" status: 200 len: 1286 microversion: 2.1 time: 0.166821 Oct 19 03:16:29.556247 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 662/1270] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:29 2022] GET /compute/v2.1/servers/0843e340-11a3-4a88-b9a6-b0024d3b3152 => generated 1286 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:16:29.564207 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e86d454f-4a09-4c0d-93ba-c4950b61913b tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7" status: 200 len: 1470 microversion: 2.1 time: 0.440605 Oct 19 03:16:29.564807 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 609/1271] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:29 2022] GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7 => generated 1470 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:16:29.587425 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2eaeb4a5-5277-4aee-a0c0-dbe8103089e4 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:16:29.588917 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-2eaeb4a5-5277-4aee-a0c0-dbe8103089e4 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 9daa020d-efe7-4033-a479-cb5dadbc3ad7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:29.595534 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2eaeb4a5-5277-4aee-a0c0-dbe8103089e4 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:29.596383 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2eaeb4a5-5277-4aee-a0c0-dbe8103089e4 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:29.597046 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2eaeb4a5-5277-4aee-a0c0-dbe8103089e4 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:29.598062 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2eaeb4a5-5277-4aee-a0c0-dbe8103089e4 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:29.598744 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2eaeb4a5-5277-4aee-a0c0-dbe8103089e4 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:29.599416 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2eaeb4a5-5277-4aee-a0c0-dbe8103089e4 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:29.649200 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2eaeb4a5-5277-4aee-a0c0-dbe8103089e4 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:29.650017 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2eaeb4a5-5277-4aee-a0c0-dbe8103089e4 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:29.651168 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2eaeb4a5-5277-4aee-a0c0-dbe8103089e4 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:29.652071 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2eaeb4a5-5277-4aee-a0c0-dbe8103089e4 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:29.653064 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2eaeb4a5-5277-4aee-a0c0-dbe8103089e4 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:29.653881 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2eaeb4a5-5277-4aee-a0c0-dbe8103089e4 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:29.683613 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-2eaeb4a5-5277-4aee-a0c0-dbe8103089e4 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Getting quotas for project c9a76121a22144499a44f44bb78848bf. Resources: {'cores', 'ram'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:16:29.690904 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-2eaeb4a5-5277-4aee-a0c0-dbe8103089e4 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Getting quotas for user 9f8493504d9243bc95c9861f4ff76c83 and project c9a76121a22144499a44f44bb78848bf. Resources: {'cores', 'ram'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:16:29.694868 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3,nova_api:DELETE=4 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:16:30.039672 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-008a0d22-43da-4e2f-ad62-75f7d163a991 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:30.040146 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-008a0d22-43da-4e2f-ad62-75f7d163a991 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:30.050220 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-008a0d22-43da-4e2f-ad62-75f7d163a991 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:30.051140 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-008a0d22-43da-4e2f-ad62-75f7d163a991 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:30.051804 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-008a0d22-43da-4e2f-ad62-75f7d163a991 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:30.052990 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-008a0d22-43da-4e2f-ad62-75f7d163a991 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:30.053702 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-008a0d22-43da-4e2f-ad62-75f7d163a991 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:30.054374 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-008a0d22-43da-4e2f-ad62-75f7d163a991 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:30.216736 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-008a0d22-43da-4e2f-ad62-75f7d163a991 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:30.229617 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2eaeb4a5-5277-4aee-a0c0-dbe8103089e4 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "POST /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7/action" status: 202 len: 0 microversion: 2.1 time: 0.643876 Oct 19 03:16:30.236449 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 663/1272] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:16:29 2022] POST /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7/action => generated 0 bytes in 654 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:16:30.242514 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-008a0d22-43da-4e2f-ad62-75f7d163a991 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:30.251647 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-008a0d22-43da-4e2f-ad62-75f7d163a991 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:30.253447 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a01a8b9f-e109-4906-a827-cc7f22f21384 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:30.258653 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a01a8b9f-e109-4906-a827-cc7f22f21384 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 9daa020d-efe7-4033-a479-cb5dadbc3ad7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:30.269073 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-008a0d22-43da-4e2f-ad62-75f7d163a991 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1560 microversion: 2.91 time: 0.235288 Oct 19 03:16:30.272422 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 610/1273] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:16:30 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1560 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:16:30.280364 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a01a8b9f-e109-4906-a827-cc7f22f21384 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:30.281214 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a01a8b9f-e109-4906-a827-cc7f22f21384 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:30.281965 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a01a8b9f-e109-4906-a827-cc7f22f21384 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:30.283710 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a01a8b9f-e109-4906-a827-cc7f22f21384 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:30.287141 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a01a8b9f-e109-4906-a827-cc7f22f21384 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:30.287838 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a01a8b9f-e109-4906-a827-cc7f22f21384 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:30.580094 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b9f1757e-bb11-4d26-9edd-7021176949ff tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:30.581174 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b9f1757e-bb11-4d26-9edd-7021176949ff tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 0843e340-11a3-4a88-b9a6-b0024d3b3152] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:30.593082 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b9f1757e-bb11-4d26-9edd-7021176949ff tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:30.593914 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b9f1757e-bb11-4d26-9edd-7021176949ff tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:30.598543 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b9f1757e-bb11-4d26-9edd-7021176949ff tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:30.599851 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b9f1757e-bb11-4d26-9edd-7021176949ff tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:30.600850 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b9f1757e-bb11-4d26-9edd-7021176949ff tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:30.601636 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b9f1757e-bb11-4d26-9edd-7021176949ff tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:30.660014 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a01a8b9f-e109-4906-a827-cc7f22f21384 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:30.672526 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a01a8b9f-e109-4906-a827-cc7f22f21384 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7" status: 200 len: 1469 microversion: 2.1 time: 0.434030 Oct 19 03:16:30.689860 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 664/1274] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:30 2022] GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7 => generated 1469 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:16:30.962225 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b9f1757e-bb11-4d26-9edd-7021176949ff tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:30.971977 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b9f1757e-bb11-4d26-9edd-7021176949ff tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/0843e340-11a3-4a88-b9a6-b0024d3b3152" status: 200 len: 1316 microversion: 2.1 time: 0.396539 Oct 19 03:16:30.975923 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 611/1275] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:30 2022] GET /compute/v2.1/servers/0843e340-11a3-4a88-b9a6-b0024d3b3152 => generated 1316 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:16:31.301258 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ffa1f212-9cab-4b53-b790-277730d7b05a tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:31.302056 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ffa1f212-9cab-4b53-b790-277730d7b05a tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:31.312570 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ffa1f212-9cab-4b53-b790-277730d7b05a tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:31.313064 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ffa1f212-9cab-4b53-b790-277730d7b05a tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:31.314145 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ffa1f212-9cab-4b53-b790-277730d7b05a tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:31.317493 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ffa1f212-9cab-4b53-b790-277730d7b05a tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:31.318220 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ffa1f212-9cab-4b53-b790-277730d7b05a tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:31.318845 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ffa1f212-9cab-4b53-b790-277730d7b05a tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:31.467040 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=18 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:16:31.472201 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ffa1f212-9cab-4b53-b790-277730d7b05a tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:31.489678 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ffa1f212-9cab-4b53-b790-277730d7b05a tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:31.491532 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ffa1f212-9cab-4b53-b790-277730d7b05a tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:31.500528 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ffa1f212-9cab-4b53-b790-277730d7b05a tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1560 microversion: 2.91 time: 0.202803 Oct 19 03:16:31.501635 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 665/1276] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:16:31 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1560 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:16:31.708765 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2e6d0d27-5f55-4c90-a8bf-6f3c5f2c1aa6 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:31.708765 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2e6d0d27-5f55-4c90-a8bf-6f3c5f2c1aa6 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 9daa020d-efe7-4033-a479-cb5dadbc3ad7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:31.709628 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=14 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:16:31.710331 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:16:31.712019 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2e6d0d27-5f55-4c90-a8bf-6f3c5f2c1aa6 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:31.712801 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2e6d0d27-5f55-4c90-a8bf-6f3c5f2c1aa6 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:31.713355 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2e6d0d27-5f55-4c90-a8bf-6f3c5f2c1aa6 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:31.714549 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2e6d0d27-5f55-4c90-a8bf-6f3c5f2c1aa6 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:31.715071 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2e6d0d27-5f55-4c90-a8bf-6f3c5f2c1aa6 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:31.715514 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2e6d0d27-5f55-4c90-a8bf-6f3c5f2c1aa6 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:31.819340 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-8f26e3c3-b11e-498a-bfd0-9198caf761cd req-29147def-967c-4e71-9b1d-93bd1e9ebb4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0843e340-11a3-4a88-b9a6-b0024d3b3152", "tag": "3a470bff-91c4-48d9-a7eb-7dfbe4bd64c3"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:16:31.824160 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-8f26e3c3-b11e-498a-bfd0-9198caf761cd req-29147def-967c-4e71-9b1d-93bd1e9ebb4c service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:31.826560 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-8f26e3c3-b11e-498a-bfd0-9198caf761cd req-29147def-967c-4e71-9b1d-93bd1e9ebb4c service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:31.827316 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-8f26e3c3-b11e-498a-bfd0-9198caf761cd req-29147def-967c-4e71-9b1d-93bd1e9ebb4c service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:31.866755 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-8f26e3c3-b11e-498a-bfd0-9198caf761cd req-29147def-967c-4e71-9b1d-93bd1e9ebb4c service nova] Creating event network-changed:3a470bff-91c4-48d9-a7eb-7dfbe4bd64c3 for instance 0843e340-11a3-4a88-b9a6-b0024d3b3152 on n-h1-861333-8 Oct 19 03:16:31.873121 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-8f26e3c3-b11e-498a-bfd0-9198caf761cd req-29147def-967c-4e71-9b1d-93bd1e9ebb4c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069092 Oct 19 03:16:31.874990 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 666/1277] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:16:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:16:32.008139 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d1b7bfee-aef9-4950-af1d-f7267bc9bf18 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:32.010463 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d1b7bfee-aef9-4950-af1d-f7267bc9bf18 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 0843e340-11a3-4a88-b9a6-b0024d3b3152] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:32.020109 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-2e6d0d27-5f55-4c90-a8bf-6f3c5f2c1aa6 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:32.022312 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d1b7bfee-aef9-4950-af1d-f7267bc9bf18 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:32.026737 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d1b7bfee-aef9-4950-af1d-f7267bc9bf18 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:32.028008 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d1b7bfee-aef9-4950-af1d-f7267bc9bf18 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:32.030557 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2e6d0d27-5f55-4c90-a8bf-6f3c5f2c1aa6 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7" status: 200 len: 1469 microversion: 2.1 time: 0.337275 Oct 19 03:16:32.031303 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d1b7bfee-aef9-4950-af1d-f7267bc9bf18 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:32.031838 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d1b7bfee-aef9-4950-af1d-f7267bc9bf18 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:32.032228 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 612/1278] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:31 2022] GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7 => generated 1469 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:16:32.046050 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d1b7bfee-aef9-4950-af1d-f7267bc9bf18 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:32.301167 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d1b7bfee-aef9-4950-af1d-f7267bc9bf18 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:32.313469 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d1b7bfee-aef9-4950-af1d-f7267bc9bf18 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/0843e340-11a3-4a88-b9a6-b0024d3b3152" status: 200 len: 1316 microversion: 2.1 time: 0.312699 Oct 19 03:16:32.315001 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 667/1279] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:31 2022] GET /compute/v2.1/servers/0843e340-11a3-4a88-b9a6-b0024d3b3152 => generated 1316 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:16:32.532028 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3d2bbf51-e9c3-42d8-80a4-8201bbf96a80 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:32.532647 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3d2bbf51-e9c3-42d8-80a4-8201bbf96a80 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:32.539080 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3d2bbf51-e9c3-42d8-80a4-8201bbf96a80 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:32.539826 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3d2bbf51-e9c3-42d8-80a4-8201bbf96a80 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:32.540455 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3d2bbf51-e9c3-42d8-80a4-8201bbf96a80 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:32.540932 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-00f59092-01e5-40e8-85d6-464a8fd0edd1 req-77bd3969-d088-4e3d-a660-1a75c60db7c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9daa020d-efe7-4033-a479-cb5dadbc3ad7", "name": "network-vif-plugged", "status": "completed", "tag": "ffc480f5-b5eb-49ea-81a9-00c3c1562f19"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:16:32.541747 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3d2bbf51-e9c3-42d8-80a4-8201bbf96a80 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:32.542387 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3d2bbf51-e9c3-42d8-80a4-8201bbf96a80 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:32.542985 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3d2bbf51-e9c3-42d8-80a4-8201bbf96a80 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:32.556485 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-00f59092-01e5-40e8-85d6-464a8fd0edd1 req-77bd3969-d088-4e3d-a660-1a75c60db7c0 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:32.557070 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-00f59092-01e5-40e8-85d6-464a8fd0edd1 req-77bd3969-d088-4e3d-a660-1a75c60db7c0 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:32.557993 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-00f59092-01e5-40e8-85d6-464a8fd0edd1 req-77bd3969-d088-4e3d-a660-1a75c60db7c0 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:32.573574 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-00f59092-01e5-40e8-85d6-464a8fd0edd1 req-77bd3969-d088-4e3d-a660-1a75c60db7c0 service nova] Creating event network-vif-plugged:ffc480f5-b5eb-49ea-81a9-00c3c1562f19 for instance 9daa020d-efe7-4033-a479-cb5dadbc3ad7 on n-h1-861333-8 Oct 19 03:16:32.579504 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [req-00f59092-01e5-40e8-85d6-464a8fd0edd1 req-77bd3969-d088-4e3d-a660-1a75c60db7c0 service nova] Instance 9daa020d-efe7-4033-a479-cb5dadbc3ad7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-861333-8', 'n-h1-861333-8'} {{(pid=121135) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 03:16:32.590864 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-00f59092-01e5-40e8-85d6-464a8fd0edd1 req-77bd3969-d088-4e3d-a660-1a75c60db7c0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055150 Oct 19 03:16:32.591531 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 668/1280] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:16:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:16:32.622360 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-3d2bbf51-e9c3-42d8-80a4-8201bbf96a80 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:32.631143 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-3d2bbf51-e9c3-42d8-80a4-8201bbf96a80 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:32.632588 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-3d2bbf51-e9c3-42d8-80a4-8201bbf96a80 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:32.639773 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3d2bbf51-e9c3-42d8-80a4-8201bbf96a80 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1560 microversion: 2.91 time: 0.111113 Oct 19 03:16:32.640756 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 613/1281] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:16:32 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1560 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:16:33.062023 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4efe1782-7011-456a-b86f-972c36ee987f tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:33.063077 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4efe1782-7011-456a-b86f-972c36ee987f tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 9daa020d-efe7-4033-a479-cb5dadbc3ad7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:33.071992 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4efe1782-7011-456a-b86f-972c36ee987f tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:33.073038 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4efe1782-7011-456a-b86f-972c36ee987f tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:33.073722 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4efe1782-7011-456a-b86f-972c36ee987f tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:33.077554 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4efe1782-7011-456a-b86f-972c36ee987f tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:33.078219 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4efe1782-7011-456a-b86f-972c36ee987f tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:33.078753 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4efe1782-7011-456a-b86f-972c36ee987f tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:33.246406 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4efe1782-7011-456a-b86f-972c36ee987f tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:33.255950 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4efe1782-7011-456a-b86f-972c36ee987f tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7" status: 200 len: 1469 microversion: 2.1 time: 0.200426 Oct 19 03:16:33.257407 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 669/1282] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:33 2022] GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7 => generated 1469 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:16:33.337360 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-189c807d-6bad-4403-9ae5-ce1f0de63082 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:33.338634 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-189c807d-6bad-4403-9ae5-ce1f0de63082 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 0843e340-11a3-4a88-b9a6-b0024d3b3152] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:33.345515 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-189c807d-6bad-4403-9ae5-ce1f0de63082 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:33.346009 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-189c807d-6bad-4403-9ae5-ce1f0de63082 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:33.346450 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-189c807d-6bad-4403-9ae5-ce1f0de63082 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:33.347160 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-189c807d-6bad-4403-9ae5-ce1f0de63082 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:33.347796 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-189c807d-6bad-4403-9ae5-ce1f0de63082 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:33.349056 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-189c807d-6bad-4403-9ae5-ce1f0de63082 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:33.368090 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=100 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:16:33.568879 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-189c807d-6bad-4403-9ae5-ce1f0de63082 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:33.577234 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-189c807d-6bad-4403-9ae5-ce1f0de63082 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/0843e340-11a3-4a88-b9a6-b0024d3b3152" status: 200 len: 1316 microversion: 2.1 time: 0.243798 Oct 19 03:16:33.577852 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 614/1283] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:33 2022] GET /compute/v2.1/servers/0843e340-11a3-4a88-b9a6-b0024d3b3152 => generated 1316 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:16:33.668251 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-98ab5abf-a6dd-4915-a345-e467f04b5743 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:33.669499 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-98ab5abf-a6dd-4915-a345-e467f04b5743 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:33.676142 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-98ab5abf-a6dd-4915-a345-e467f04b5743 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:33.677076 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-98ab5abf-a6dd-4915-a345-e467f04b5743 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:33.678670 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-98ab5abf-a6dd-4915-a345-e467f04b5743 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:33.680039 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-98ab5abf-a6dd-4915-a345-e467f04b5743 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:33.680659 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-98ab5abf-a6dd-4915-a345-e467f04b5743 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:33.681349 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-98ab5abf-a6dd-4915-a345-e467f04b5743 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:33.770046 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-98ab5abf-a6dd-4915-a345-e467f04b5743 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:33.782271 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-98ab5abf-a6dd-4915-a345-e467f04b5743 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:33.785045 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-98ab5abf-a6dd-4915-a345-e467f04b5743 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:33.794057 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-98ab5abf-a6dd-4915-a345-e467f04b5743 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1560 microversion: 2.91 time: 0.129653 Oct 19 03:16:33.797850 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 670/1284] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:16:33 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1560 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:16:34.279813 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5ef1562a-f0ab-4ae2-af13-21afd7825c1d tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:34.280425 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5ef1562a-f0ab-4ae2-af13-21afd7825c1d tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 9daa020d-efe7-4033-a479-cb5dadbc3ad7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:34.286315 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5ef1562a-f0ab-4ae2-af13-21afd7825c1d tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:34.286795 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5ef1562a-f0ab-4ae2-af13-21afd7825c1d tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:34.287230 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5ef1562a-f0ab-4ae2-af13-21afd7825c1d tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:34.287920 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5ef1562a-f0ab-4ae2-af13-21afd7825c1d tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:34.288369 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5ef1562a-f0ab-4ae2-af13-21afd7825c1d tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:34.288794 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5ef1562a-f0ab-4ae2-af13-21afd7825c1d tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:34.457792 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5ef1562a-f0ab-4ae2-af13-21afd7825c1d tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:34.467091 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5ef1562a-f0ab-4ae2-af13-21afd7825c1d tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7" status: 200 len: 1469 microversion: 2.1 time: 0.190752 Oct 19 03:16:34.467758 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 615/1285] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:34 2022] GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7 => generated 1469 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:16:34.600029 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f78ba473-c485-4c2c-82f5-7cbecf3b719b tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:34.600751 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f78ba473-c485-4c2c-82f5-7cbecf3b719b tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 0843e340-11a3-4a88-b9a6-b0024d3b3152] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:34.607473 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f78ba473-c485-4c2c-82f5-7cbecf3b719b tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:34.607895 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f78ba473-c485-4c2c-82f5-7cbecf3b719b tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:34.608363 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f78ba473-c485-4c2c-82f5-7cbecf3b719b tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:34.609060 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f78ba473-c485-4c2c-82f5-7cbecf3b719b tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:34.609546 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f78ba473-c485-4c2c-82f5-7cbecf3b719b tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:34.609970 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f78ba473-c485-4c2c-82f5-7cbecf3b719b tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:34.781923 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f78ba473-c485-4c2c-82f5-7cbecf3b719b tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:34.798818 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f78ba473-c485-4c2c-82f5-7cbecf3b719b tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/0843e340-11a3-4a88-b9a6-b0024d3b3152" status: 200 len: 1316 microversion: 2.1 time: 0.202514 Oct 19 03:16:34.813649 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 671/1286] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:34 2022] GET /compute/v2.1/servers/0843e340-11a3-4a88-b9a6-b0024d3b3152 => generated 1316 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:16:34.825780 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8c8b7d93-199b-457e-b12f-7587ce9293ca tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:34.826491 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8c8b7d93-199b-457e-b12f-7587ce9293ca tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:34.832857 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8c8b7d93-199b-457e-b12f-7587ce9293ca tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:34.833518 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8c8b7d93-199b-457e-b12f-7587ce9293ca tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:34.834065 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8c8b7d93-199b-457e-b12f-7587ce9293ca tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:34.834872 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8c8b7d93-199b-457e-b12f-7587ce9293ca tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:34.835429 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8c8b7d93-199b-457e-b12f-7587ce9293ca tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:34.835955 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8c8b7d93-199b-457e-b12f-7587ce9293ca tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:34.905670 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8c8b7d93-199b-457e-b12f-7587ce9293ca tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:34.913915 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8c8b7d93-199b-457e-b12f-7587ce9293ca tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:34.915376 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8c8b7d93-199b-457e-b12f-7587ce9293ca tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:34.920398 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8c8b7d93-199b-457e-b12f-7587ce9293ca tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1560 microversion: 2.91 time: 0.099183 Oct 19 03:16:34.920901 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 616/1287] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:16:34 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1560 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:16:35.492430 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f90c5858-adc4-4b6d-b85a-0ee25678bac3 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:35.493048 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f90c5858-adc4-4b6d-b85a-0ee25678bac3 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 9daa020d-efe7-4033-a479-cb5dadbc3ad7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:35.500556 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f90c5858-adc4-4b6d-b85a-0ee25678bac3 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:35.501053 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f90c5858-adc4-4b6d-b85a-0ee25678bac3 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:35.501543 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f90c5858-adc4-4b6d-b85a-0ee25678bac3 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:35.502544 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f90c5858-adc4-4b6d-b85a-0ee25678bac3 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:35.503229 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f90c5858-adc4-4b6d-b85a-0ee25678bac3 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:35.503428 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f90c5858-adc4-4b6d-b85a-0ee25678bac3 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:35.619243 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-be8a584a-92c9-4c51-b8fb-be8cdf69dc9c tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1152561021", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "networks": [{"uuid": "2b1c6cf9-fefa-464b-a053-29a0bc9110e0"}, {"uuid": "1117bf9f-ba18-41ad-915b-32f78b9ad8ac"}, {"uuid": "2b1c6cf9-fefa-464b-a053-29a0bc9110e0"}]}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:16:35.679849 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f90c5858-adc4-4b6d-b85a-0ee25678bac3 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:35.684988 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-be8a584a-92c9-4c51-b8fb-be8cdf69dc9c tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] validate_networks() for [('2b1c6cf9-fefa-464b-a053-29a0bc9110e0', None, None, None, None, None), ('1117bf9f-ba18-41ad-915b-32f78b9ad8ac', None, None, None, None, None), ('2b1c6cf9-fefa-464b-a053-29a0bc9110e0', None, None, None, None, None)] {{(pid=121134) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:16:35.690341 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f90c5858-adc4-4b6d-b85a-0ee25678bac3 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7" status: 200 len: 1469 microversion: 2.1 time: 0.201685 Oct 19 03:16:35.693162 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 672/1288] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:35 2022] GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7 => generated 1469 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:16:35.830292 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-26f407cd-3baf-4680-ac74-8d592a2183cf tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:35.831009 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-26f407cd-3baf-4680-ac74-8d592a2183cf tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 0843e340-11a3-4a88-b9a6-b0024d3b3152] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:35.838329 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-26f407cd-3baf-4680-ac74-8d592a2183cf tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:35.839165 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-26f407cd-3baf-4680-ac74-8d592a2183cf tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:35.839847 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-26f407cd-3baf-4680-ac74-8d592a2183cf tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:35.840889 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-26f407cd-3baf-4680-ac74-8d592a2183cf tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:35.841619 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-26f407cd-3baf-4680-ac74-8d592a2183cf tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:35.842261 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-26f407cd-3baf-4680-ac74-8d592a2183cf tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:36.088819 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-26f407cd-3baf-4680-ac74-8d592a2183cf tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:36.109154 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-26f407cd-3baf-4680-ac74-8d592a2183cf tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/0843e340-11a3-4a88-b9a6-b0024d3b3152" status: 200 len: 1316 microversion: 2.1 time: 0.286474 Oct 19 03:16:36.123085 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 673/1289] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:35 2022] GET /compute/v2.1/servers/0843e340-11a3-4a88-b9a6-b0024d3b3152 => generated 1316 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:16:36.135325 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3c18620d-4b3e-4aad-acf2-91f1622a8fde tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:36.135906 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-3c18620d-4b3e-4aad-acf2-91f1622a8fde tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:36.143759 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3c18620d-4b3e-4aad-acf2-91f1622a8fde tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:36.144556 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3c18620d-4b3e-4aad-acf2-91f1622a8fde tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:36.145158 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3c18620d-4b3e-4aad-acf2-91f1622a8fde tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:36.147223 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3c18620d-4b3e-4aad-acf2-91f1622a8fde tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:36.147891 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3c18620d-4b3e-4aad-acf2-91f1622a8fde tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:36.149467 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3c18620d-4b3e-4aad-acf2-91f1622a8fde tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:36.258527 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-3c18620d-4b3e-4aad-acf2-91f1622a8fde tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:36.270540 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:16:36.278261 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-3c18620d-4b3e-4aad-acf2-91f1622a8fde tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:36.278261 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-3c18620d-4b3e-4aad-acf2-91f1622a8fde tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:36.285566 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-3c18620d-4b3e-4aad-acf2-91f1622a8fde tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1560 microversion: 2.91 time: 0.161181 Oct 19 03:16:36.298966 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 674/1290] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:16:36 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1560 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:16:36.715849 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-896b5833-e0dd-4a20-a36b-4a9b586f437b tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:36.716564 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-896b5833-e0dd-4a20-a36b-4a9b586f437b tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 9daa020d-efe7-4033-a479-cb5dadbc3ad7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:36.725601 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-896b5833-e0dd-4a20-a36b-4a9b586f437b tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:36.726414 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-896b5833-e0dd-4a20-a36b-4a9b586f437b tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:36.727069 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-896b5833-e0dd-4a20-a36b-4a9b586f437b tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:36.727981 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-896b5833-e0dd-4a20-a36b-4a9b586f437b tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:36.729440 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-896b5833-e0dd-4a20-a36b-4a9b586f437b tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:36.730352 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-896b5833-e0dd-4a20-a36b-4a9b586f437b tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:36.748982 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-be8a584a-92c9-4c51-b8fb-be8cdf69dc9c tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Flavor limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:16:36.749999 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-be8a584a-92c9-4c51-b8fb-be8cdf69dc9c tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Image limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:16:36.750667 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-be8a584a-92c9-4c51-b8fb-be8cdf69dc9c tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Flavor pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:16:36.751287 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-be8a584a-92c9-4c51-b8fb-be8cdf69dc9c tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Image pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:16:36.751676 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-be8a584a-92c9-4c51-b8fb-be8cdf69dc9c tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:16:36.762026 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-be8a584a-92c9-4c51-b8fb-be8cdf69dc9c tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:36.763405 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-be8a584a-92c9-4c51-b8fb-be8cdf69dc9c tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:36.763841 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-be8a584a-92c9-4c51-b8fb-be8cdf69dc9c tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:36.765068 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-be8a584a-92c9-4c51-b8fb-be8cdf69dc9c tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:36.765708 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-be8a584a-92c9-4c51-b8fb-be8cdf69dc9c tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:36.766156 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-be8a584a-92c9-4c51-b8fb-be8cdf69dc9c tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:36.824752 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-be8a584a-92c9-4c51-b8fb-be8cdf69dc9c tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Getting quotas for project 0fcd49d68a3947249016cc5dbe910efc. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:16:36.831047 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-be8a584a-92c9-4c51-b8fb-be8cdf69dc9c tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Getting quotas for user d3c35b71372843d69f9a6c6be04b154f and project 0fcd49d68a3947249016cc5dbe910efc. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:16:36.850556 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-be8a584a-92c9-4c51-b8fb-be8cdf69dc9c tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Going to run 1 instances... {{(pid=121134) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:16:36.855941 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-be8a584a-92c9-4c51-b8fb-be8cdf69dc9c tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] [instance: fef11301-8524-4f9b-bf6f-e525fca3237d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:16:36.945585 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-896b5833-e0dd-4a20-a36b-4a9b586f437b tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:36.956872 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-896b5833-e0dd-4a20-a36b-4a9b586f437b tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7" status: 200 len: 1469 microversion: 2.1 time: 0.245164 Oct 19 03:16:36.958736 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 675/1291] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:36 2022] GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7 => generated 1469 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:16:37.020095 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-be8a584a-92c9-4c51-b8fb-be8cdf69dc9c tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.404667 Oct 19 03:16:37.021285 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 617/1292] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:16:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1407 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 03:16:37.034541 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6fbed0d8-db35-4d32-8650-1843e3170cb7 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:37.035679 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6fbed0d8-db35-4d32-8650-1843e3170cb7 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] [instance: fef11301-8524-4f9b-bf6f-e525fca3237d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:37.118647 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-6fbed0d8-db35-4d32-8650-1843e3170cb7 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c35b71372843d69f9a6c6be04b154f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcd49d68a3947249016cc5dbe910efc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:37.128799 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6fbed0d8-db35-4d32-8650-1843e3170cb7 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] 10.222.0.52 "GET /compute/v2.1/servers/fef11301-8524-4f9b-bf6f-e525fca3237d" status: 200 len: 1213 microversion: 2.1 time: 0.097554 Oct 19 03:16:37.128799 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 676/1293] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:37 2022] GET /compute/v2.1/servers/fef11301-8524-4f9b-bf6f-e525fca3237d => generated 1213 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:16:37.135979 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-20442b6c-86db-4452-81d4-903ba34be199 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:37.136826 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-20442b6c-86db-4452-81d4-903ba34be199 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 0843e340-11a3-4a88-b9a6-b0024d3b3152] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:37.146279 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-20442b6c-86db-4452-81d4-903ba34be199 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:37.147021 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-20442b6c-86db-4452-81d4-903ba34be199 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:37.147619 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-20442b6c-86db-4452-81d4-903ba34be199 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:37.148484 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-20442b6c-86db-4452-81d4-903ba34be199 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:37.149117 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-20442b6c-86db-4452-81d4-903ba34be199 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:37.149705 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-20442b6c-86db-4452-81d4-903ba34be199 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:37.322321 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-20442b6c-86db-4452-81d4-903ba34be199 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:37.329075 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5ad90a9e-0159-4fda-a5a7-fed1b8ab16ea tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:37.329075 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-5ad90a9e-0159-4fda-a5a7-fed1b8ab16ea tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:37.331777 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-20442b6c-86db-4452-81d4-903ba34be199 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/0843e340-11a3-4a88-b9a6-b0024d3b3152" status: 200 len: 1316 microversion: 2.1 time: 0.199912 Oct 19 03:16:37.332504 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 618/1294] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:37 2022] GET /compute/v2.1/servers/0843e340-11a3-4a88-b9a6-b0024d3b3152 => generated 1316 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:16:37.334777 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5ad90a9e-0159-4fda-a5a7-fed1b8ab16ea tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:37.335277 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5ad90a9e-0159-4fda-a5a7-fed1b8ab16ea tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:37.335705 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5ad90a9e-0159-4fda-a5a7-fed1b8ab16ea tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:37.336590 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5ad90a9e-0159-4fda-a5a7-fed1b8ab16ea tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:37.337041 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5ad90a9e-0159-4fda-a5a7-fed1b8ab16ea tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:37.337516 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5ad90a9e-0159-4fda-a5a7-fed1b8ab16ea tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:37.417904 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-5ad90a9e-0159-4fda-a5a7-fed1b8ab16ea tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:37.424793 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-5ad90a9e-0159-4fda-a5a7-fed1b8ab16ea tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:37.426302 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-5ad90a9e-0159-4fda-a5a7-fed1b8ab16ea tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:37.432409 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5ad90a9e-0159-4fda-a5a7-fed1b8ab16ea tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1560 microversion: 2.91 time: 0.116806 Oct 19 03:16:37.432999 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 677/1295] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:16:37 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1560 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:16:37.988607 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5c170c08-60f5-447d-9e89-4cb09fff774b tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:37.989243 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5c170c08-60f5-447d-9e89-4cb09fff774b tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 9daa020d-efe7-4033-a479-cb5dadbc3ad7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:38.002696 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5c170c08-60f5-447d-9e89-4cb09fff774b tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:38.003186 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5c170c08-60f5-447d-9e89-4cb09fff774b tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:38.003625 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5c170c08-60f5-447d-9e89-4cb09fff774b tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:38.009441 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5c170c08-60f5-447d-9e89-4cb09fff774b tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:38.011751 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5c170c08-60f5-447d-9e89-4cb09fff774b tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:38.012170 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5c170c08-60f5-447d-9e89-4cb09fff774b tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:38.158160 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-daa3cc13-735b-4cbb-a26f-e5557d82b340 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:38.159900 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-daa3cc13-735b-4cbb-a26f-e5557d82b340 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] [instance: fef11301-8524-4f9b-bf6f-e525fca3237d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:38.524288 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5c170c08-60f5-447d-9e89-4cb09fff774b tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:38.535860 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-daa3cc13-735b-4cbb-a26f-e5557d82b340 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c35b71372843d69f9a6c6be04b154f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcd49d68a3947249016cc5dbe910efc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:38.546261 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-daa3cc13-735b-4cbb-a26f-e5557d82b340 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] 10.222.0.52 "GET /compute/v2.1/servers/fef11301-8524-4f9b-bf6f-e525fca3237d" status: 200 len: 1213 microversion: 2.1 time: 0.397368 Oct 19 03:16:38.557538 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 678/1296] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:38 2022] GET /compute/v2.1/servers/fef11301-8524-4f9b-bf6f-e525fca3237d => generated 1213 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:16:38.557690 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5c170c08-60f5-447d-9e89-4cb09fff774b tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7" status: 200 len: 1469 microversion: 2.1 time: 0.570432 Oct 19 03:16:38.557796 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9ab448c2-4409-49e5-a4c5-a928cd8b0449 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:38.557796 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9ab448c2-4409-49e5-a4c5-a928cd8b0449 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 0843e340-11a3-4a88-b9a6-b0024d3b3152] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:38.557973 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 619/1297] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:37 2022] GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7 => generated 1469 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:16:38.563704 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d39e9aec-f473-43ca-b200-80387091f0ab tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:38.564563 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d39e9aec-f473-43ca-b200-80387091f0ab tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:38.573101 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9ab448c2-4409-49e5-a4c5-a928cd8b0449 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:38.573717 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9ab448c2-4409-49e5-a4c5-a928cd8b0449 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:38.574404 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9ab448c2-4409-49e5-a4c5-a928cd8b0449 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:38.575191 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9ab448c2-4409-49e5-a4c5-a928cd8b0449 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:38.575647 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9ab448c2-4409-49e5-a4c5-a928cd8b0449 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:38.576070 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9ab448c2-4409-49e5-a4c5-a928cd8b0449 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:38.580356 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d39e9aec-f473-43ca-b200-80387091f0ab tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:38.581016 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d39e9aec-f473-43ca-b200-80387091f0ab tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:38.581644 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d39e9aec-f473-43ca-b200-80387091f0ab tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:38.582641 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d39e9aec-f473-43ca-b200-80387091f0ab tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:38.583400 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d39e9aec-f473-43ca-b200-80387091f0ab tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:38.583980 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d39e9aec-f473-43ca-b200-80387091f0ab tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:38.710013 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d39e9aec-f473-43ca-b200-80387091f0ab tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:38.724125 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d39e9aec-f473-43ca-b200-80387091f0ab tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:38.737440 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d39e9aec-f473-43ca-b200-80387091f0ab tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:38.754748 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d39e9aec-f473-43ca-b200-80387091f0ab tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1555 microversion: 2.91 time: 0.198407 Oct 19 03:16:38.782915 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 620/1298] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:16:38 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1555 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:16:38.795022 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-aab9f816-5303-462f-8dd1-4be080a2d733 req-07be296e-c5b9-405b-9a00-a364eca87594 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9daa020d-efe7-4033-a479-cb5dadbc3ad7", "name": "network-vif-unplugged", "status": "completed", "tag": "ffc480f5-b5eb-49ea-81a9-00c3c1562f19"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:16:38.824106 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-aab9f816-5303-462f-8dd1-4be080a2d733 req-07be296e-c5b9-405b-9a00-a364eca87594 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:38.824632 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-aab9f816-5303-462f-8dd1-4be080a2d733 req-07be296e-c5b9-405b-9a00-a364eca87594 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:38.825176 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-aab9f816-5303-462f-8dd1-4be080a2d733 req-07be296e-c5b9-405b-9a00-a364eca87594 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:38.846249 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-aab9f816-5303-462f-8dd1-4be080a2d733 req-07be296e-c5b9-405b-9a00-a364eca87594 service nova] Creating event network-vif-unplugged:ffc480f5-b5eb-49ea-81a9-00c3c1562f19 for instance 9daa020d-efe7-4033-a479-cb5dadbc3ad7 on n-h1-861333-8 Oct 19 03:16:38.857507 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [req-aab9f816-5303-462f-8dd1-4be080a2d733 req-07be296e-c5b9-405b-9a00-a364eca87594 service nova] Instance 9daa020d-efe7-4033-a479-cb5dadbc3ad7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-861333-8', 'n-h1-861333-8'} {{(pid=121134) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 03:16:38.867277 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-9ab448c2-4409-49e5-a4c5-a928cd8b0449 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:38.882904 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9ab448c2-4409-49e5-a4c5-a928cd8b0449 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/0843e340-11a3-4a88-b9a6-b0024d3b3152" status: 200 len: 1316 microversion: 2.1 time: 0.334231 Oct 19 03:16:38.883517 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 679/1299] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:38 2022] GET /compute/v2.1/servers/0843e340-11a3-4a88-b9a6-b0024d3b3152 => generated 1316 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:16:38.903481 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-aab9f816-5303-462f-8dd1-4be080a2d733 req-07be296e-c5b9-405b-9a00-a364eca87594 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.118911 Oct 19 03:16:38.904330 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 621/1300] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:16:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:16:39.578975 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-18a6615d-c0c6-4110-b2fd-514ef4246425 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:39.582079 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-18a6615d-c0c6-4110-b2fd-514ef4246425 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] [instance: fef11301-8524-4f9b-bf6f-e525fca3237d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:39.586044 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-eded7437-521e-4f4b-b294-8787c61ae478 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:39.587293 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-eded7437-521e-4f4b-b294-8787c61ae478 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 9daa020d-efe7-4033-a479-cb5dadbc3ad7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:39.593946 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-18a6615d-c0c6-4110-b2fd-514ef4246425 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:39.594443 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-18a6615d-c0c6-4110-b2fd-514ef4246425 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:39.594886 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-18a6615d-c0c6-4110-b2fd-514ef4246425 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:39.608755 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-18a6615d-c0c6-4110-b2fd-514ef4246425 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:39.609549 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-18a6615d-c0c6-4110-b2fd-514ef4246425 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:39.610177 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-18a6615d-c0c6-4110-b2fd-514ef4246425 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:39.612188 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eded7437-521e-4f4b-b294-8787c61ae478 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:39.612717 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eded7437-521e-4f4b-b294-8787c61ae478 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:39.613156 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eded7437-521e-4f4b-b294-8787c61ae478 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:39.613923 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eded7437-521e-4f4b-b294-8787c61ae478 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:39.614377 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eded7437-521e-4f4b-b294-8787c61ae478 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:39.615003 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eded7437-521e-4f4b-b294-8787c61ae478 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:39.671452 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=5 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:16:39.723332 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-18a6615d-c0c6-4110-b2fd-514ef4246425 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c35b71372843d69f9a6c6be04b154f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcd49d68a3947249016cc5dbe910efc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:39.744621 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-18a6615d-c0c6-4110-b2fd-514ef4246425 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] 10.222.0.52 "GET /compute/v2.1/servers/fef11301-8524-4f9b-bf6f-e525fca3237d" status: 200 len: 1265 microversion: 2.1 time: 0.174921 Oct 19 03:16:39.745820 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 680/1301] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:39 2022] GET /compute/v2.1/servers/fef11301-8524-4f9b-bf6f-e525fca3237d => generated 1265 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:16:39.790331 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9a666b0d-b0d3-4c29-ab9d-d6f00a5b9f4b tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:39.791741 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9a666b0d-b0d3-4c29-ab9d-d6f00a5b9f4b tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:39.798944 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9a666b0d-b0d3-4c29-ab9d-d6f00a5b9f4b tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:39.799750 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9a666b0d-b0d3-4c29-ab9d-d6f00a5b9f4b tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:39.801821 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9a666b0d-b0d3-4c29-ab9d-d6f00a5b9f4b tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:39.801821 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9a666b0d-b0d3-4c29-ab9d-d6f00a5b9f4b tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:39.801821 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9a666b0d-b0d3-4c29-ab9d-d6f00a5b9f4b tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:39.801821 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9a666b0d-b0d3-4c29-ab9d-d6f00a5b9f4b tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:39.961072 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-9a666b0d-b0d3-4c29-ab9d-d6f00a5b9f4b tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:39.982442 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-eded7437-521e-4f4b-b294-8787c61ae478 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:39.987066 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-9a666b0d-b0d3-4c29-ab9d-d6f00a5b9f4b tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:39.993993 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-9a666b0d-b0d3-4c29-ab9d-d6f00a5b9f4b tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:39.996067 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-eded7437-521e-4f4b-b294-8787c61ae478 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7" status: 200 len: 1535 microversion: 2.1 time: 0.423735 Oct 19 03:16:40.001783 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 622/1302] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:39 2022] GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7 => generated 1535 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:16:40.005875 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9a666b0d-b0d3-4c29-ab9d-d6f00a5b9f4b tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1555 microversion: 2.91 time: 0.220012 Oct 19 03:16:40.015783 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8e338b1b-7825-4c2c-886a-dd57757fa705 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:40.016672 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8e338b1b-7825-4c2c-886a-dd57757fa705 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 0843e340-11a3-4a88-b9a6-b0024d3b3152] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:40.023781 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8e338b1b-7825-4c2c-886a-dd57757fa705 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:40.024227 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 681/1303] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:16:39 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1555 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:16:40.024838 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8e338b1b-7825-4c2c-886a-dd57757fa705 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:40.026156 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8e338b1b-7825-4c2c-886a-dd57757fa705 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:40.027123 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8e338b1b-7825-4c2c-886a-dd57757fa705 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:40.027733 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8e338b1b-7825-4c2c-886a-dd57757fa705 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:40.028363 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8e338b1b-7825-4c2c-886a-dd57757fa705 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:40.217149 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8e338b1b-7825-4c2c-886a-dd57757fa705 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:40.225876 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8e338b1b-7825-4c2c-886a-dd57757fa705 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/0843e340-11a3-4a88-b9a6-b0024d3b3152" status: 200 len: 1316 microversion: 2.1 time: 0.222389 Oct 19 03:16:40.231757 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 623/1304] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:40 2022] GET /compute/v2.1/servers/0843e340-11a3-4a88-b9a6-b0024d3b3152 => generated 1316 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:16:40.783497 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7dd6d3c6-5eb9-44fd-88ae-4e3bfd9b35c0 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:40.784040 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7dd6d3c6-5eb9-44fd-88ae-4e3bfd9b35c0 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] [instance: fef11301-8524-4f9b-bf6f-e525fca3237d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:40.799914 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7dd6d3c6-5eb9-44fd-88ae-4e3bfd9b35c0 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:40.800445 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7dd6d3c6-5eb9-44fd-88ae-4e3bfd9b35c0 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:40.800889 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7dd6d3c6-5eb9-44fd-88ae-4e3bfd9b35c0 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:40.801622 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7dd6d3c6-5eb9-44fd-88ae-4e3bfd9b35c0 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:40.802073 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7dd6d3c6-5eb9-44fd-88ae-4e3bfd9b35c0 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:40.802550 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7dd6d3c6-5eb9-44fd-88ae-4e3bfd9b35c0 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:40.928361 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7dd6d3c6-5eb9-44fd-88ae-4e3bfd9b35c0 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c35b71372843d69f9a6c6be04b154f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcd49d68a3947249016cc5dbe910efc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:40.950843 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-c00e8d6d-409e-42bf-a736-d1a5d3c1115b req-cb74a229-e386-416d-ac55-93a562582d60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9daa020d-efe7-4033-a479-cb5dadbc3ad7", "tag": "ffc480f5-b5eb-49ea-81a9-00c3c1562f19"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:16:40.953651 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7dd6d3c6-5eb9-44fd-88ae-4e3bfd9b35c0 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] 10.222.0.52 "GET /compute/v2.1/servers/fef11301-8524-4f9b-bf6f-e525fca3237d" status: 200 len: 1271 microversion: 2.1 time: 0.174086 Oct 19 03:16:40.954581 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 682/1305] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:40 2022] GET /compute/v2.1/servers/fef11301-8524-4f9b-bf6f-e525fca3237d => generated 1271 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:16:40.966520 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-c00e8d6d-409e-42bf-a736-d1a5d3c1115b req-cb74a229-e386-416d-ac55-93a562582d60 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:40.967006 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-c00e8d6d-409e-42bf-a736-d1a5d3c1115b req-cb74a229-e386-416d-ac55-93a562582d60 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:40.967429 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-c00e8d6d-409e-42bf-a736-d1a5d3c1115b req-cb74a229-e386-416d-ac55-93a562582d60 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:40.980906 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-c00e8d6d-409e-42bf-a736-d1a5d3c1115b req-cb74a229-e386-416d-ac55-93a562582d60 service nova] Creating event network-changed:ffc480f5-b5eb-49ea-81a9-00c3c1562f19 for instance 9daa020d-efe7-4033-a479-cb5dadbc3ad7 on n-h2-861333-8 Oct 19 03:16:40.988945 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [req-c00e8d6d-409e-42bf-a736-d1a5d3c1115b req-cb74a229-e386-416d-ac55-93a562582d60 service nova] Instance 9daa020d-efe7-4033-a479-cb5dadbc3ad7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-861333-8', 'n-h1-861333-8'} {{(pid=121134) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 03:16:41.004144 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-c00e8d6d-409e-42bf-a736-d1a5d3c1115b req-cb74a229-e386-416d-ac55-93a562582d60 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057481 Oct 19 03:16:41.005521 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 624/1306] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:16:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:16:41.020957 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-553828a9-0bd3-4cf1-99d1-ea03b4f97ff6 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:41.023782 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-553828a9-0bd3-4cf1-99d1-ea03b4f97ff6 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 9daa020d-efe7-4033-a479-cb5dadbc3ad7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:41.033106 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-553828a9-0bd3-4cf1-99d1-ea03b4f97ff6 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:41.041151 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f63a6fd7-0724-494d-ba66-1baf9c66d8e7 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:41.042334 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f63a6fd7-0724-494d-ba66-1baf9c66d8e7 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:41.044961 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-553828a9-0bd3-4cf1-99d1-ea03b4f97ff6 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:41.046157 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-553828a9-0bd3-4cf1-99d1-ea03b4f97ff6 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:41.049823 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-553828a9-0bd3-4cf1-99d1-ea03b4f97ff6 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:41.050709 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-553828a9-0bd3-4cf1-99d1-ea03b4f97ff6 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:41.052811 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-553828a9-0bd3-4cf1-99d1-ea03b4f97ff6 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:41.069861 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f63a6fd7-0724-494d-ba66-1baf9c66d8e7 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:41.071799 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f63a6fd7-0724-494d-ba66-1baf9c66d8e7 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:41.072991 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f63a6fd7-0724-494d-ba66-1baf9c66d8e7 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:41.074513 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f63a6fd7-0724-494d-ba66-1baf9c66d8e7 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:41.075384 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f63a6fd7-0724-494d-ba66-1baf9c66d8e7 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:41.076419 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f63a6fd7-0724-494d-ba66-1baf9c66d8e7 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:41.234969 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-f63a6fd7-0724-494d-ba66-1baf9c66d8e7 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:41.267304 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-f63a6fd7-0724-494d-ba66-1baf9c66d8e7 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:41.269733 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-f63a6fd7-0724-494d-ba66-1baf9c66d8e7 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:41.285626 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:16:41.287780 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f63a6fd7-0724-494d-ba66-1baf9c66d8e7 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1555 microversion: 2.91 time: 0.250772 Oct 19 03:16:41.313223 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 625/1307] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:16:41 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1555 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:16:41.318729 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-941ecbf7-fae5-47c7-a0e1-fb869d723147 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:41.319703 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-941ecbf7-fae5-47c7-a0e1-fb869d723147 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 0843e340-11a3-4a88-b9a6-b0024d3b3152] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:41.336420 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-941ecbf7-fae5-47c7-a0e1-fb869d723147 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:41.336420 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-941ecbf7-fae5-47c7-a0e1-fb869d723147 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:41.336420 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-941ecbf7-fae5-47c7-a0e1-fb869d723147 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:41.336420 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-941ecbf7-fae5-47c7-a0e1-fb869d723147 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:41.336748 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-941ecbf7-fae5-47c7-a0e1-fb869d723147 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:41.336748 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-941ecbf7-fae5-47c7-a0e1-fb869d723147 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:41.578079 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-553828a9-0bd3-4cf1-99d1-ea03b4f97ff6 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:41.591651 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-553828a9-0bd3-4cf1-99d1-ea03b4f97ff6 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7" status: 200 len: 1535 microversion: 2.1 time: 0.575102 Oct 19 03:16:41.596186 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 683/1308] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:41 2022] GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7 => generated 1535 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:16:41.799200 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-941ecbf7-fae5-47c7-a0e1-fb869d723147 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:41.811382 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-941ecbf7-fae5-47c7-a0e1-fb869d723147 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/0843e340-11a3-4a88-b9a6-b0024d3b3152" status: 200 len: 1316 microversion: 2.1 time: 0.495852 Oct 19 03:16:41.815060 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 626/1309] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:41 2022] GET /compute/v2.1/servers/0843e340-11a3-4a88-b9a6-b0024d3b3152 => generated 1316 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:16:41.869709 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-efb3c6e8-c0c8-4a86-8bde-05551d141972 req-eae60bf9-61b2-4f57-96c2-ee13e814e5c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0843e340-11a3-4a88-b9a6-b0024d3b3152", "name": "network-vif-plugged", "status": "completed", "tag": "3a470bff-91c4-48d9-a7eb-7dfbe4bd64c3"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:16:41.906521 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-efb3c6e8-c0c8-4a86-8bde-05551d141972 req-eae60bf9-61b2-4f57-96c2-ee13e814e5c3 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:41.906521 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-efb3c6e8-c0c8-4a86-8bde-05551d141972 req-eae60bf9-61b2-4f57-96c2-ee13e814e5c3 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:41.906521 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-efb3c6e8-c0c8-4a86-8bde-05551d141972 req-eae60bf9-61b2-4f57-96c2-ee13e814e5c3 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:41.942820 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-efb3c6e8-c0c8-4a86-8bde-05551d141972 req-eae60bf9-61b2-4f57-96c2-ee13e814e5c3 service nova] Creating event network-vif-plugged:3a470bff-91c4-48d9-a7eb-7dfbe4bd64c3 for instance 0843e340-11a3-4a88-b9a6-b0024d3b3152 on n-h1-861333-8 Oct 19 03:16:41.951136 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-efb3c6e8-c0c8-4a86-8bde-05551d141972 req-eae60bf9-61b2-4f57-96c2-ee13e814e5c3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086530 Oct 19 03:16:41.953072 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 684/1310] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:16:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:16:41.980280 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4321ce40-1395-4b47-b571-6b04c2fba96f tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:41.980903 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4321ce40-1395-4b47-b571-6b04c2fba96f tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] [instance: fef11301-8524-4f9b-bf6f-e525fca3237d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:41.989959 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4321ce40-1395-4b47-b571-6b04c2fba96f tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:41.990455 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4321ce40-1395-4b47-b571-6b04c2fba96f tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:41.990897 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4321ce40-1395-4b47-b571-6b04c2fba96f tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:41.991800 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4321ce40-1395-4b47-b571-6b04c2fba96f tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:41.992388 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4321ce40-1395-4b47-b571-6b04c2fba96f tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:41.992700 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4321ce40-1395-4b47-b571-6b04c2fba96f tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:42.225528 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-4321ce40-1395-4b47-b571-6b04c2fba96f tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c35b71372843d69f9a6c6be04b154f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcd49d68a3947249016cc5dbe910efc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:42.235499 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4321ce40-1395-4b47-b571-6b04c2fba96f tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] 10.222.0.52 "GET /compute/v2.1/servers/fef11301-8524-4f9b-bf6f-e525fca3237d" status: 200 len: 1313 microversion: 2.1 time: 0.259107 Oct 19 03:16:42.236327 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 627/1311] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:41 2022] GET /compute/v2.1/servers/fef11301-8524-4f9b-bf6f-e525fca3237d => generated 1313 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:16:42.320998 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0d8f1740-37e7-4420-9013-7da71899a5b7 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:42.321901 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0d8f1740-37e7-4420-9013-7da71899a5b7 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:42.333585 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0d8f1740-37e7-4420-9013-7da71899a5b7 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:42.334405 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0d8f1740-37e7-4420-9013-7da71899a5b7 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:42.335062 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0d8f1740-37e7-4420-9013-7da71899a5b7 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:42.336275 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0d8f1740-37e7-4420-9013-7da71899a5b7 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:42.336947 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0d8f1740-37e7-4420-9013-7da71899a5b7 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:42.337651 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0d8f1740-37e7-4420-9013-7da71899a5b7 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:42.425984 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-0d8f1740-37e7-4420-9013-7da71899a5b7 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:42.438425 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-0d8f1740-37e7-4420-9013-7da71899a5b7 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:42.440465 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-0d8f1740-37e7-4420-9013-7da71899a5b7 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:42.446232 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0d8f1740-37e7-4420-9013-7da71899a5b7 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1555 microversion: 2.91 time: 0.129587 Oct 19 03:16:42.447954 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 685/1312] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:16:42 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1555 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:16:42.622068 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a79727ce-257d-4264-9eb6-49384f3447aa tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:42.625587 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a79727ce-257d-4264-9eb6-49384f3447aa tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 9daa020d-efe7-4033-a479-cb5dadbc3ad7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:42.633973 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a79727ce-257d-4264-9eb6-49384f3447aa tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:42.635462 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a79727ce-257d-4264-9eb6-49384f3447aa tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:42.636246 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a79727ce-257d-4264-9eb6-49384f3447aa tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:42.637350 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a79727ce-257d-4264-9eb6-49384f3447aa tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:42.641644 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a79727ce-257d-4264-9eb6-49384f3447aa tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:42.641644 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a79727ce-257d-4264-9eb6-49384f3447aa tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:42.827316 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a79727ce-257d-4264-9eb6-49384f3447aa tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:42.834718 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5e68318f-e5de-4961-b9a8-5660de05af4d tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:42.835638 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-5e68318f-e5de-4961-b9a8-5660de05af4d tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 0843e340-11a3-4a88-b9a6-b0024d3b3152] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:42.844220 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5e68318f-e5de-4961-b9a8-5660de05af4d tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:42.844637 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5e68318f-e5de-4961-b9a8-5660de05af4d tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:42.845090 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5e68318f-e5de-4961-b9a8-5660de05af4d tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:42.860161 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a79727ce-257d-4264-9eb6-49384f3447aa tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7" status: 200 len: 1535 microversion: 2.1 time: 0.243596 Oct 19 03:16:42.860765 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 628/1313] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:42 2022] GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7 => generated 1535 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:16:42.873650 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5e68318f-e5de-4961-b9a8-5660de05af4d tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:42.873650 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5e68318f-e5de-4961-b9a8-5660de05af4d tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:42.873650 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5e68318f-e5de-4961-b9a8-5660de05af4d tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:43.052651 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-5e68318f-e5de-4961-b9a8-5660de05af4d tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:43.061229 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5e68318f-e5de-4961-b9a8-5660de05af4d tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/0843e340-11a3-4a88-b9a6-b0024d3b3152" status: 200 len: 1316 microversion: 2.1 time: 0.230281 Oct 19 03:16:43.062357 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 686/1314] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:42 2022] GET /compute/v2.1/servers/0843e340-11a3-4a88-b9a6-b0024d3b3152 => generated 1316 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:16:43.260624 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d3057323-7e49-4cae-90da-d92ff2aba097 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:43.261242 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d3057323-7e49-4cae-90da-d92ff2aba097 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] [instance: fef11301-8524-4f9b-bf6f-e525fca3237d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:43.268360 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d3057323-7e49-4cae-90da-d92ff2aba097 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:43.268846 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d3057323-7e49-4cae-90da-d92ff2aba097 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:43.269287 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d3057323-7e49-4cae-90da-d92ff2aba097 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:43.270009 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d3057323-7e49-4cae-90da-d92ff2aba097 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:43.270532 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d3057323-7e49-4cae-90da-d92ff2aba097 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:43.271038 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d3057323-7e49-4cae-90da-d92ff2aba097 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:43.441680 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d3057323-7e49-4cae-90da-d92ff2aba097 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c35b71372843d69f9a6c6be04b154f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcd49d68a3947249016cc5dbe910efc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:43.451553 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d3057323-7e49-4cae-90da-d92ff2aba097 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] 10.222.0.52 "GET /compute/v2.1/servers/fef11301-8524-4f9b-bf6f-e525fca3237d" status: 200 len: 1334 microversion: 2.1 time: 0.195078 Oct 19 03:16:43.452879 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 629/1315] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:43 2022] GET /compute/v2.1/servers/fef11301-8524-4f9b-bf6f-e525fca3237d => generated 1334 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:16:43.474926 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-dc2b0193-0dbb-4fbf-9b4e-d42b362fa084 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:43.493679 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-dc2b0193-0dbb-4fbf-9b4e-d42b362fa084 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:43.493679 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dc2b0193-0dbb-4fbf-9b4e-d42b362fa084 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:43.493679 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dc2b0193-0dbb-4fbf-9b4e-d42b362fa084 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:43.493679 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dc2b0193-0dbb-4fbf-9b4e-d42b362fa084 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:43.494660 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dc2b0193-0dbb-4fbf-9b4e-d42b362fa084 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:43.494660 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dc2b0193-0dbb-4fbf-9b4e-d42b362fa084 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:43.494660 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dc2b0193-0dbb-4fbf-9b4e-d42b362fa084 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:43.553783 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-dc2b0193-0dbb-4fbf-9b4e-d42b362fa084 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:43.562744 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-dc2b0193-0dbb-4fbf-9b4e-d42b362fa084 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:43.564197 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-dc2b0193-0dbb-4fbf-9b4e-d42b362fa084 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:43.569188 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-dc2b0193-0dbb-4fbf-9b4e-d42b362fa084 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1555 microversion: 2.91 time: 0.098224 Oct 19 03:16:43.569806 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 687/1316] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:16:43 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1555 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:16:43.884339 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5f99252e-780a-4245-82c8-d7e8093c7e01 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:43.884986 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5f99252e-780a-4245-82c8-d7e8093c7e01 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 9daa020d-efe7-4033-a479-cb5dadbc3ad7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:43.891335 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5f99252e-780a-4245-82c8-d7e8093c7e01 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:43.891822 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5f99252e-780a-4245-82c8-d7e8093c7e01 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:43.892257 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5f99252e-780a-4245-82c8-d7e8093c7e01 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:43.892947 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5f99252e-780a-4245-82c8-d7e8093c7e01 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:43.893412 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5f99252e-780a-4245-82c8-d7e8093c7e01 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:43.893844 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5f99252e-780a-4245-82c8-d7e8093c7e01 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:44.086526 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a4f87d70-a73c-4150-ae2a-fa0e87cb1395 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:44.087135 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a4f87d70-a73c-4150-ae2a-fa0e87cb1395 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 0843e340-11a3-4a88-b9a6-b0024d3b3152] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:44.099697 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a4f87d70-a73c-4150-ae2a-fa0e87cb1395 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:44.100756 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a4f87d70-a73c-4150-ae2a-fa0e87cb1395 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:44.101361 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a4f87d70-a73c-4150-ae2a-fa0e87cb1395 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:44.108948 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a4f87d70-a73c-4150-ae2a-fa0e87cb1395 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:44.109715 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a4f87d70-a73c-4150-ae2a-fa0e87cb1395 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:44.110419 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a4f87d70-a73c-4150-ae2a-fa0e87cb1395 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:44.141692 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5f99252e-780a-4245-82c8-d7e8093c7e01 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:44.178799 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5f99252e-780a-4245-82c8-d7e8093c7e01 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7" status: 200 len: 1535 microversion: 2.1 time: 0.298315 Oct 19 03:16:44.193713 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 630/1317] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:43 2022] GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7 => generated 1535 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:16:44.430575 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a4f87d70-a73c-4150-ae2a-fa0e87cb1395 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:44.465713 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a4f87d70-a73c-4150-ae2a-fa0e87cb1395 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/0843e340-11a3-4a88-b9a6-b0024d3b3152" status: 200 len: 1316 microversion: 2.1 time: 0.370476 Oct 19 03:16:44.481432 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 688/1318] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:44 2022] GET /compute/v2.1/servers/0843e340-11a3-4a88-b9a6-b0024d3b3152 => generated 1316 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:16:44.481656 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d540f08c-c175-41f6-93f4-d928d3dae37c tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:44.481656 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d540f08c-c175-41f6-93f4-d928d3dae37c tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] [instance: fef11301-8524-4f9b-bf6f-e525fca3237d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:44.486283 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d540f08c-c175-41f6-93f4-d928d3dae37c tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:44.487053 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d540f08c-c175-41f6-93f4-d928d3dae37c tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:44.488226 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d540f08c-c175-41f6-93f4-d928d3dae37c tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:44.489095 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d540f08c-c175-41f6-93f4-d928d3dae37c tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:44.489755 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d540f08c-c175-41f6-93f4-d928d3dae37c tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:44.490875 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d540f08c-c175-41f6-93f4-d928d3dae37c tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:44.598627 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f0912b14-75c1-432a-84c3-3fb397a09103 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:44.599620 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f0912b14-75c1-432a-84c3-3fb397a09103 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:44.609980 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f0912b14-75c1-432a-84c3-3fb397a09103 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:44.610988 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f0912b14-75c1-432a-84c3-3fb397a09103 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:44.611675 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f0912b14-75c1-432a-84c3-3fb397a09103 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:44.612785 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f0912b14-75c1-432a-84c3-3fb397a09103 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:44.618191 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f0912b14-75c1-432a-84c3-3fb397a09103 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:44.618191 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f0912b14-75c1-432a-84c3-3fb397a09103 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:44.847382 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d540f08c-c175-41f6-93f4-d928d3dae37c tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c35b71372843d69f9a6c6be04b154f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcd49d68a3947249016cc5dbe910efc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:44.860035 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f0912b14-75c1-432a-84c3-3fb397a09103 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:44.876038 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d540f08c-c175-41f6-93f4-d928d3dae37c tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] 10.222.0.52 "GET /compute/v2.1/servers/fef11301-8524-4f9b-bf6f-e525fca3237d" status: 200 len: 1355 microversion: 2.1 time: 0.398315 Oct 19 03:16:44.876038 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 631/1319] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:44 2022] GET /compute/v2.1/servers/fef11301-8524-4f9b-bf6f-e525fca3237d => generated 1355 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:16:44.876339 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f0912b14-75c1-432a-84c3-3fb397a09103 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:44.878431 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f0912b14-75c1-432a-84c3-3fb397a09103 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:44.886023 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f0912b14-75c1-432a-84c3-3fb397a09103 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1555 microversion: 2.91 time: 0.292495 Oct 19 03:16:44.886893 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 689/1320] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:16:44 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1555 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:16:45.206633 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-38ccad9b-954f-4246-b109-952c351b0a31 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:45.207630 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-38ccad9b-954f-4246-b109-952c351b0a31 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 9daa020d-efe7-4033-a479-cb5dadbc3ad7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:45.216966 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-38ccad9b-954f-4246-b109-952c351b0a31 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:45.218793 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-38ccad9b-954f-4246-b109-952c351b0a31 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:45.218793 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-38ccad9b-954f-4246-b109-952c351b0a31 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:45.218793 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-38ccad9b-954f-4246-b109-952c351b0a31 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:45.219254 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-38ccad9b-954f-4246-b109-952c351b0a31 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:45.219875 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-38ccad9b-954f-4246-b109-952c351b0a31 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:45.252157 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=100 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:16:45.432768 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-38ccad9b-954f-4246-b109-952c351b0a31 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:45.444482 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-38ccad9b-954f-4246-b109-952c351b0a31 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7" status: 200 len: 1528 microversion: 2.1 time: 0.242025 Oct 19 03:16:45.445478 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 632/1321] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:45 2022] GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7 => generated 1528 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:16:45.473284 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d38f7498-d934-4f47-9efb-c4011334d015 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:45.474683 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d38f7498-d934-4f47-9efb-c4011334d015 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 9daa020d-efe7-4033-a479-cb5dadbc3ad7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:45.483397 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d38f7498-d934-4f47-9efb-c4011334d015 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:45.484280 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d38f7498-d934-4f47-9efb-c4011334d015 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:45.485263 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d38f7498-d934-4f47-9efb-c4011334d015 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:45.486167 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d38f7498-d934-4f47-9efb-c4011334d015 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:45.487121 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d38f7498-d934-4f47-9efb-c4011334d015 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:45.487942 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d38f7498-d934-4f47-9efb-c4011334d015 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:45.497241 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c347e30d-5b95-402c-8114-00bb78ef4477 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:45.498431 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c347e30d-5b95-402c-8114-00bb78ef4477 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 0843e340-11a3-4a88-b9a6-b0024d3b3152] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:45.508690 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c347e30d-5b95-402c-8114-00bb78ef4477 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:45.511711 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c347e30d-5b95-402c-8114-00bb78ef4477 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:45.512372 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c347e30d-5b95-402c-8114-00bb78ef4477 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:45.518006 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c347e30d-5b95-402c-8114-00bb78ef4477 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:45.518691 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c347e30d-5b95-402c-8114-00bb78ef4477 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:45.519447 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c347e30d-5b95-402c-8114-00bb78ef4477 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:45.750867 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c347e30d-5b95-402c-8114-00bb78ef4477 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:45.751133 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d38f7498-d934-4f47-9efb-c4011334d015 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:45.759689 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c347e30d-5b95-402c-8114-00bb78ef4477 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/0843e340-11a3-4a88-b9a6-b0024d3b3152" status: 200 len: 1465 microversion: 2.1 time: 0.267393 Oct 19 03:16:45.760784 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 633/1322] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:45 2022] GET /compute/v2.1/servers/0843e340-11a3-4a88-b9a6-b0024d3b3152 => generated 1465 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:16:45.765864 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-49650c5a-1b3f-4509-898e-08ff6da42e00 req-e00fe23a-08a3-45ec-89b5-8d4e9e09cf61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fef11301-8524-4f9b-bf6f-e525fca3237d", "tag": "a956b9e6-07b8-4d6e-9436-0782855cb789"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:16:45.767411 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d38f7498-d934-4f47-9efb-c4011334d015 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7" status: 200 len: 1528 microversion: 2.1 time: 0.298091 Oct 19 03:16:45.767989 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 690/1323] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:45 2022] GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7 => generated 1528 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:16:45.776658 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-49650c5a-1b3f-4509-898e-08ff6da42e00 req-e00fe23a-08a3-45ec-89b5-8d4e9e09cf61 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:45.777526 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-49650c5a-1b3f-4509-898e-08ff6da42e00 req-e00fe23a-08a3-45ec-89b5-8d4e9e09cf61 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:45.778209 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-49650c5a-1b3f-4509-898e-08ff6da42e00 req-e00fe23a-08a3-45ec-89b5-8d4e9e09cf61 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:45.789581 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1584fd07-a4cf-4073-a066-963e408530d0 tempest-ServersOnMultiNodesTest-74681315 tempest-ServersOnMultiNodesTest-74681315-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:45.791515 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1584fd07-a4cf-4073-a066-963e408530d0 tempest-ServersOnMultiNodesTest-74681315 tempest-ServersOnMultiNodesTest-74681315-project-admin] [instance: 0843e340-11a3-4a88-b9a6-b0024d3b3152] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:45.791815 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-49650c5a-1b3f-4509-898e-08ff6da42e00 req-e00fe23a-08a3-45ec-89b5-8d4e9e09cf61 service nova] Creating event network-changed:a956b9e6-07b8-4d6e-9436-0782855cb789 for instance fef11301-8524-4f9b-bf6f-e525fca3237d on n-h2-861333-8 Oct 19 03:16:45.796985 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-49650c5a-1b3f-4509-898e-08ff6da42e00 req-e00fe23a-08a3-45ec-89b5-8d4e9e09cf61 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034780 Oct 19 03:16:45.797659 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1584fd07-a4cf-4073-a066-963e408530d0 tempest-ServersOnMultiNodesTest-74681315 tempest-ServersOnMultiNodesTest-74681315-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:45.798158 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1584fd07-a4cf-4073-a066-963e408530d0 tempest-ServersOnMultiNodesTest-74681315 tempest-ServersOnMultiNodesTest-74681315-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:45.798586 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1584fd07-a4cf-4073-a066-963e408530d0 tempest-ServersOnMultiNodesTest-74681315 tempest-ServersOnMultiNodesTest-74681315-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:45.798824 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 634/1324] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:16:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:16:45.799661 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1584fd07-a4cf-4073-a066-963e408530d0 tempest-ServersOnMultiNodesTest-74681315 tempest-ServersOnMultiNodesTest-74681315-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:45.800278 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1584fd07-a4cf-4073-a066-963e408530d0 tempest-ServersOnMultiNodesTest-74681315 tempest-ServersOnMultiNodesTest-74681315-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:45.800854 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1584fd07-a4cf-4073-a066-963e408530d0 tempest-ServersOnMultiNodesTest-74681315 tempest-ServersOnMultiNodesTest-74681315-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:45.804393 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-86d3a5c3-8a64-4576-ab85-b1352bf6d5f6 tempest-MigrationsAdminTest-1230104219 tempest-MigrationsAdminTest-1230104219-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:45.812949 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-86d3a5c3-8a64-4576-ab85-b1352bf6d5f6 tempest-MigrationsAdminTest-1230104219 tempest-MigrationsAdminTest-1230104219-project-admin] HTTP exception thrown: Flavor ecf81ec0-4740-4050-9a00-ee71c25338fa could not be found. Oct 19 03:16:45.815257 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-86d3a5c3-8a64-4576-ab85-b1352bf6d5f6 tempest-MigrationsAdminTest-1230104219 tempest-MigrationsAdminTest-1230104219-project-admin] Request method failure captured: Oct 19 03:16:45.815257 n-d-861333-8 devstack@n-api.service[121134]: request: DELETE /compute/v2.1/flavors/ecf81ec0-4740-4050-9a00-ee71c25338fa HTTP/1.1 Oct 19 03:16:45.815257 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:16:45.815257 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:16:45.815257 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:16:45.815257 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:16:45.815257 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:16:45.815257 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:16:45.815257 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:16:45.815257 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:16:45.815257 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT2stzF4xE2rjwl1C8iAcI9yDdwfklipfWcmfB_oAzu-mswxPweWAj4AyRZbFwwr5tW4G-Bs27o3atKiwXPxCBXSJt2YGB9daxq5y6e0PYuG2vpQuDh94ghOROzU2P7bwCOtlDUNvIAbS4UjiwVNmuXcUZr_Fd3DqnuB0Ncxo6SjfzsU Oct 19 03:16:45.815257 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:16:45.815257 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:16:45.815257 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:16:45.815257 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:16:45.815257 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:16:45.815257 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:16:45.815257 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: ca11bf1ab70142709ff1fd106df02ba0 Oct 19 03:16:45.815257 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-MigrationsAdminTest-1230104219 Oct 19 03:16:45.815257 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member,admin Oct 19 03:16:45.815257 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member,admin Oct 19 03:16:45.816667 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ca11bf1ab70142709ff1fd106df02ba0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ca11bf1ab70142709ff1fd106df02ba0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ca11bf1ab70142709ff1fd106df02ba0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ca11bf1ab70142709ff1fd106df02ba0", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:16:45.816667 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-MigrationsAdminTest-1230104219 Oct 19 03:16:45.816667 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: ca11bf1ab70142709ff1fd106df02ba0 Oct 19 03:16:45.816667 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-MigrationsAdminTest-1230104219 Oct 19 03:16:45.816667 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-MigrationsAdminTest-1230104219-project-admin Oct 19 03:16:45.816667 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:16:45.816667 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:16:45.816667 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 19bac702de0146aa9483ed5574fe985a Oct 19 03:16:45.816667 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-MigrationsAdminTest-1230104219-project-admin Oct 19 03:16:45.816667 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:16:45.816667 n-d-861333-8 devstack@n-api.service[121134]: exception: Flavor ecf81ec0-4740-4050-9a00-ee71c25338fa could not be found. Oct 19 03:16:45.816667 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': 'ecf81ec0-4740-4050-9a00-ee71c25338fa'} Oct 19 03:16:45.817502 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:16:45.817502 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:16:45.817502 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Oct 19 03:16:45.817502 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi flavor.destroy() Oct 19 03:16:45.817502 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 19 03:16:45.817502 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 19 03:16:45.817502 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Oct 19 03:16:45.817502 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Oct 19 03:16:45.817502 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Oct 19 03:16:45.817502 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Oct 19 03:16:45.817502 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 19 03:16:45.817502 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 19 03:16:45.817502 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Oct 19 03:16:45.817502 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Oct 19 03:16:45.817502 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor ecf81ec0-4740-4050-9a00-ee71c25338fa could not be found. Oct 19 03:16:45.817502 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:16:45.817502 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:16:45.817502 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:16:45.817502 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:16:45.817502 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:16:45.818804 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:16:45.818804 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:16:45.818804 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:16:45.818804 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:16:45.818804 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:16:45.818804 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Oct 19 03:16:45.818804 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:16:45.818804 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor ecf81ec0-4740-4050-9a00-ee71c25338fa could not be found. Oct 19 03:16:45.818804 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:16:45.818804 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:16:45.818804 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:16:45.818804 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:16:45.818804 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:16:45.818804 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:16:45.818804 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:16:45.818804 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:16:45.818804 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor ecf81ec0-4740-4050-9a00-ee71c25338fa could not be found. Oct 19 03:16:45.818804 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:16:45.822365 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-86d3a5c3-8a64-4576-ab85-b1352bf6d5f6 tempest-MigrationsAdminTest-1230104219 tempest-MigrationsAdminTest-1230104219-project-admin] Returning 404 to user: Flavor ecf81ec0-4740-4050-9a00-ee71c25338fa could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:16:45.823495 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-86d3a5c3-8a64-4576-ab85-b1352bf6d5f6 tempest-MigrationsAdminTest-1230104219 tempest-MigrationsAdminTest-1230104219-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/ecf81ec0-4740-4050-9a00-ee71c25338fa" status: 404 len: 109 microversion: 2.1 time: 0.023456 Oct 19 03:16:45.826117 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 635/1325] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:16:45 2022] DELETE /compute/v2.1/flavors/ecf81ec0-4740-4050-9a00-ee71c25338fa => generated 109 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:16:45.905026 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d35e6b60-5117-4386-8975-121ccdded524 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:45.906304 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d35e6b60-5117-4386-8975-121ccdded524 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] [instance: fef11301-8524-4f9b-bf6f-e525fca3237d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:45.920533 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d35e6b60-5117-4386-8975-121ccdded524 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:45.921750 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d35e6b60-5117-4386-8975-121ccdded524 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:45.924611 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d35e6b60-5117-4386-8975-121ccdded524 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:45.925690 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d35e6b60-5117-4386-8975-121ccdded524 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:45.927235 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d35e6b60-5117-4386-8975-121ccdded524 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:45.927939 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d35e6b60-5117-4386-8975-121ccdded524 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:46.272700 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1584fd07-a4cf-4073-a066-963e408530d0 tempest-ServersOnMultiNodesTest-74681315 tempest-ServersOnMultiNodesTest-74681315-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/0843e340-11a3-4a88-b9a6-b0024d3b3152" status: 200 len: 1616 microversion: 2.1 time: 0.487026 Oct 19 03:16:46.276755 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d35e6b60-5117-4386-8975-121ccdded524 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c35b71372843d69f9a6c6be04b154f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcd49d68a3947249016cc5dbe910efc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:46.279159 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 691/1326] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:45 2022] GET /compute/v2.1/servers/0843e340-11a3-4a88-b9a6-b0024d3b3152 => generated 1616 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:16:46.284664 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d35e6b60-5117-4386-8975-121ccdded524 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] 10.222.0.52 "GET /compute/v2.1/servers/fef11301-8524-4f9b-bf6f-e525fca3237d" status: 200 len: 1355 microversion: 2.1 time: 0.387867 Oct 19 03:16:46.286472 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d19026ec-0b47-47a0-9bb2-d5ec8f9fc6a5 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:46.287251 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d19026ec-0b47-47a0-9bb2-d5ec8f9fc6a5 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:46.300219 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d19026ec-0b47-47a0-9bb2-d5ec8f9fc6a5 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:46.302452 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 636/1327] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:45 2022] GET /compute/v2.1/servers/fef11301-8524-4f9b-bf6f-e525fca3237d => generated 1355 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:16:46.306889 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d19026ec-0b47-47a0-9bb2-d5ec8f9fc6a5 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:46.307584 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d19026ec-0b47-47a0-9bb2-d5ec8f9fc6a5 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:46.308769 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d19026ec-0b47-47a0-9bb2-d5ec8f9fc6a5 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:46.309565 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d19026ec-0b47-47a0-9bb2-d5ec8f9fc6a5 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:46.314095 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0422f95f-1590-4345-a396-d1b87b0f95af tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-847285611", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:16:46.317723 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d19026ec-0b47-47a0-9bb2-d5ec8f9fc6a5 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:46.421039 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-0422f95f-1590-4345-a396-d1b87b0f95af tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] validate_networks() for None {{(pid=121134) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:16:46.448578 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d19026ec-0b47-47a0-9bb2-d5ec8f9fc6a5 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:46.459669 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d19026ec-0b47-47a0-9bb2-d5ec8f9fc6a5 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:46.461283 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d19026ec-0b47-47a0-9bb2-d5ec8f9fc6a5 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:46.468815 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d19026ec-0b47-47a0-9bb2-d5ec8f9fc6a5 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1555 microversion: 2.91 time: 0.188291 Oct 19 03:16:46.470340 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 692/1328] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:16:46 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1555 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:16:46.505753 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-05aaf8a6-b515-49e0-9318-196e051bc14c tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-945186565", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "2d709051-db69-4ea9-96dc-ffe05e9c9b3a"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:16:46.578719 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.network.neutron [None req-05aaf8a6-b515-49e0-9318-196e051bc14c tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] validate_networks() for None {{(pid=121135) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:16:46.798193 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:16:46.843990 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=6 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:16:47.308857 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-0422f95f-1590-4345-a396-d1b87b0f95af tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Flavor limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:16:47.309278 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-0422f95f-1590-4345-a396-d1b87b0f95af tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Image limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:16:47.309902 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-0422f95f-1590-4345-a396-d1b87b0f95af tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Flavor pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:16:47.310310 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-0422f95f-1590-4345-a396-d1b87b0f95af tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Image pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:16:47.315340 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-0422f95f-1590-4345-a396-d1b87b0f95af tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:16:47.327077 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0422f95f-1590-4345-a396-d1b87b0f95af tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:47.328565 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0422f95f-1590-4345-a396-d1b87b0f95af tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:47.329576 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0422f95f-1590-4345-a396-d1b87b0f95af tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:47.331311 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0422f95f-1590-4345-a396-d1b87b0f95af tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:47.331970 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0422f95f-1590-4345-a396-d1b87b0f95af tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:47.332405 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0422f95f-1590-4345-a396-d1b87b0f95af tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:47.355914 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-0422f95f-1590-4345-a396-d1b87b0f95af tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Getting quotas for project c9a76121a22144499a44f44bb78848bf. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:16:47.361926 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-0422f95f-1590-4345-a396-d1b87b0f95af tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Getting quotas for user 9f8493504d9243bc95c9861f4ff76c83 and project c9a76121a22144499a44f44bb78848bf. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:16:47.376689 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0422f95f-1590-4345-a396-d1b87b0f95af tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Going to run 1 instances... {{(pid=121134) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:16:47.379389 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0422f95f-1590-4345-a396-d1b87b0f95af tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 84774cfc-79b4-42db-acfd-c4daac86d196] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:16:47.426314 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-05aaf8a6-b515-49e0-9318-196e051bc14c tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Flavor limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:16:47.426744 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-05aaf8a6-b515-49e0-9318-196e051bc14c tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Image limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:16:47.427410 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-05aaf8a6-b515-49e0-9318-196e051bc14c tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Flavor pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:16:47.427834 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-05aaf8a6-b515-49e0-9318-196e051bc14c tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Image pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:16:47.429146 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-05aaf8a6-b515-49e0-9318-196e051bc14c tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:16:47.454348 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-05aaf8a6-b515-49e0-9318-196e051bc14c tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:47.456195 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-05aaf8a6-b515-49e0-9318-196e051bc14c tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:47.456660 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-05aaf8a6-b515-49e0-9318-196e051bc14c tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:47.458793 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-05aaf8a6-b515-49e0-9318-196e051bc14c tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:47.459972 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-05aaf8a6-b515-49e0-9318-196e051bc14c tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:47.460472 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-05aaf8a6-b515-49e0-9318-196e051bc14c tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:47.497306 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-05aaf8a6-b515-49e0-9318-196e051bc14c tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Getting quotas for project 5d909fe7763841d5b452738112b656d3. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:16:47.503808 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-05aaf8a6-b515-49e0-9318-196e051bc14c tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Getting quotas for user 3e4d3ddb3a324d9da51c13701e318955 and project 5d909fe7763841d5b452738112b656d3. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:16:47.520227 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:16:47.522460 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-05aaf8a6-b515-49e0-9318-196e051bc14c tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Going to run 1 instances... {{(pid=121135) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:16:47.525942 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-05aaf8a6-b515-49e0-9318-196e051bc14c tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: f03fef0e-680b-45bd-87a9-a3df948181cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121135) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:16:47.528027 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0422f95f-1590-4345-a396-d1b87b0f95af tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.224274 Oct 19 03:16:47.535298 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 637/1329] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:16:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1226 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 03:16:47.538895 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-cf70256e-26b7-4ee0-be6f-9920d89404b5 req-9d141385-70e3-45c2-93e3-692c836c6e9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9daa020d-efe7-4033-a479-cb5dadbc3ad7", "name": "network-vif-plugged", "status": "completed", "tag": "ffc480f5-b5eb-49ea-81a9-00c3c1562f19"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:16:47.555972 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-cf70256e-26b7-4ee0-be6f-9920d89404b5 req-9d141385-70e3-45c2-93e3-692c836c6e9a service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:47.557174 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-cf70256e-26b7-4ee0-be6f-9920d89404b5 req-9d141385-70e3-45c2-93e3-692c836c6e9a service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:47.558169 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-cf70256e-26b7-4ee0-be6f-9920d89404b5 req-9d141385-70e3-45c2-93e3-692c836c6e9a service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:47.571958 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-cf70256e-26b7-4ee0-be6f-9920d89404b5 req-9d141385-70e3-45c2-93e3-692c836c6e9a service nova] Creating event network-vif-plugged:ffc480f5-b5eb-49ea-81a9-00c3c1562f19 for instance 9daa020d-efe7-4033-a479-cb5dadbc3ad7 on n-h2-861333-8 Oct 19 03:16:47.579447 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-cf70256e-26b7-4ee0-be6f-9920d89404b5 req-9d141385-70e3-45c2-93e3-692c836c6e9a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048535 Oct 19 03:16:47.581138 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 638/1330] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:16:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:16:47.586904 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-be046f1b-d6d8-4f76-b954-e93a7f6c7a8a tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:47.588545 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-be046f1b-d6d8-4f76-b954-e93a7f6c7a8a tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] [instance: fef11301-8524-4f9b-bf6f-e525fca3237d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:47.596172 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-be046f1b-d6d8-4f76-b954-e93a7f6c7a8a tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:47.596937 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-be046f1b-d6d8-4f76-b954-e93a7f6c7a8a tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:47.597649 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-be046f1b-d6d8-4f76-b954-e93a7f6c7a8a tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:47.603156 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-be046f1b-d6d8-4f76-b954-e93a7f6c7a8a tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:47.603156 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-be046f1b-d6d8-4f76-b954-e93a7f6c7a8a tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:47.603156 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-be046f1b-d6d8-4f76-b954-e93a7f6c7a8a tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:47.678693 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-05aaf8a6-b515-49e0-9318-196e051bc14c tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.176749 Oct 19 03:16:47.683133 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 693/1331] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:16:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1182 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 03:16:47.688104 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-72827b0b-9743-4ea6-9c9d-50bf21872237 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:47.695702 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-72827b0b-9743-4ea6-9c9d-50bf21872237 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:47.708446 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-72827b0b-9743-4ea6-9c9d-50bf21872237 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:47.713457 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-72827b0b-9743-4ea6-9c9d-50bf21872237 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:47.714129 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-72827b0b-9743-4ea6-9c9d-50bf21872237 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:47.717083 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-72827b0b-9743-4ea6-9c9d-50bf21872237 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:47.717767 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-72827b0b-9743-4ea6-9c9d-50bf21872237 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:47.720364 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-72827b0b-9743-4ea6-9c9d-50bf21872237 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:47.792835 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-be046f1b-d6d8-4f76-b954-e93a7f6c7a8a tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c35b71372843d69f9a6c6be04b154f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcd49d68a3947249016cc5dbe910efc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:47.803724 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-be046f1b-d6d8-4f76-b954-e93a7f6c7a8a tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] 10.222.0.52 "GET /compute/v2.1/servers/fef11301-8524-4f9b-bf6f-e525fca3237d" status: 200 len: 1355 microversion: 2.1 time: 0.220568 Oct 19 03:16:47.819373 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 639/1332] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:47 2022] GET /compute/v2.1/servers/fef11301-8524-4f9b-bf6f-e525fca3237d => generated 1355 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:16:47.834257 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-31115273-24ef-4b73-a45e-c5bea3b381a9 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:47.834836 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-31115273-24ef-4b73-a45e-c5bea3b381a9 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 84774cfc-79b4-42db-acfd-c4daac86d196] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:47.872289 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-72827b0b-9743-4ea6-9c9d-50bf21872237 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:47.876008 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=100 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:16:47.882028 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-72827b0b-9743-4ea6-9c9d-50bf21872237 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:47.883675 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-72827b0b-9743-4ea6-9c9d-50bf21872237 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:47.903647 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-72827b0b-9743-4ea6-9c9d-50bf21872237 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1555 microversion: 2.91 time: 0.219326 Oct 19 03:16:47.908880 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 694/1333] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:16:47 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1555 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:16:47.913716 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5674f4e3-3b0a-42e2-a0c0-34ba02a56acb tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:47.918120 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-5674f4e3-3b0a-42e2-a0c0-34ba02a56acb tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: f03fef0e-680b-45bd-87a9-a3df948181cf] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:47.946100 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-31115273-24ef-4b73-a45e-c5bea3b381a9 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:47.958382 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-31115273-24ef-4b73-a45e-c5bea3b381a9 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196" status: 200 len: 1212 microversion: 2.1 time: 0.134512 Oct 19 03:16:47.971298 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 640/1334] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:47 2022] GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196 => generated 1212 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:16:47.992840 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-c1490e0c-7bd1-4069-9a4f-5ce89ba93862 req-d431aedf-6649-4d38-aca4-72c75c874e6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fef11301-8524-4f9b-bf6f-e525fca3237d", "tag": "5e4e8744-671e-4d44-b07b-fd602e080024"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:16:48.012662 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-c1490e0c-7bd1-4069-9a4f-5ce89ba93862 req-d431aedf-6649-4d38-aca4-72c75c874e6d service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:48.012662 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-c1490e0c-7bd1-4069-9a4f-5ce89ba93862 req-d431aedf-6649-4d38-aca4-72c75c874e6d service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:48.012662 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-c1490e0c-7bd1-4069-9a4f-5ce89ba93862 req-d431aedf-6649-4d38-aca4-72c75c874e6d service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:48.033500 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-5674f4e3-3b0a-42e2-a0c0-34ba02a56acb tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:48.042050 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5674f4e3-3b0a-42e2-a0c0-34ba02a56acb tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/f03fef0e-680b-45bd-87a9-a3df948181cf" status: 200 len: 1216 microversion: 2.1 time: 0.131885 Oct 19 03:16:48.057282 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-c1490e0c-7bd1-4069-9a4f-5ce89ba93862 req-d431aedf-6649-4d38-aca4-72c75c874e6d service nova] Creating event network-changed:5e4e8744-671e-4d44-b07b-fd602e080024 for instance fef11301-8524-4f9b-bf6f-e525fca3237d on n-h2-861333-8 Oct 19 03:16:48.057721 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 695/1335] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:47 2022] GET /compute/v2.1/servers/f03fef0e-680b-45bd-87a9-a3df948181cf => generated 1216 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:16:48.060713 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-c1490e0c-7bd1-4069-9a4f-5ce89ba93862 req-d431aedf-6649-4d38-aca4-72c75c874e6d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084341 Oct 19 03:16:48.061789 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 641/1336] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:16:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:16:48.830395 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-fbcf877e-ecd1-4777-83a6-42607c2d0a43 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:48.835446 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-fbcf877e-ecd1-4777-83a6-42607c2d0a43 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] [instance: fef11301-8524-4f9b-bf6f-e525fca3237d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:48.837051 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fbcf877e-ecd1-4777-83a6-42607c2d0a43 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:48.837580 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fbcf877e-ecd1-4777-83a6-42607c2d0a43 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:48.838021 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fbcf877e-ecd1-4777-83a6-42607c2d0a43 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:48.838719 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fbcf877e-ecd1-4777-83a6-42607c2d0a43 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:48.839180 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fbcf877e-ecd1-4777-83a6-42607c2d0a43 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:48.839608 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fbcf877e-ecd1-4777-83a6-42607c2d0a43 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:48.939723 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-19d42ad6-9417-459a-8d5e-1da278e90560 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:48.940449 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-19d42ad6-9417-459a-8d5e-1da278e90560 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:48.946833 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-19d42ad6-9417-459a-8d5e-1da278e90560 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:48.947354 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-19d42ad6-9417-459a-8d5e-1da278e90560 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:48.947805 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-19d42ad6-9417-459a-8d5e-1da278e90560 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:48.948516 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-19d42ad6-9417-459a-8d5e-1da278e90560 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:48.948978 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-19d42ad6-9417-459a-8d5e-1da278e90560 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:48.949439 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-19d42ad6-9417-459a-8d5e-1da278e90560 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:49.002440 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-fbcf877e-ecd1-4777-83a6-42607c2d0a43 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c35b71372843d69f9a6c6be04b154f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcd49d68a3947249016cc5dbe910efc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:49.016786 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-fbcf877e-ecd1-4777-83a6-42607c2d0a43 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] 10.222.0.52 "GET /compute/v2.1/servers/fef11301-8524-4f9b-bf6f-e525fca3237d" status: 200 len: 1355 microversion: 2.1 time: 0.190631 Oct 19 03:16:49.018566 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 696/1337] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:48 2022] GET /compute/v2.1/servers/fef11301-8524-4f9b-bf6f-e525fca3237d => generated 1355 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:16:49.024708 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-19d42ad6-9417-459a-8d5e-1da278e90560 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:49.033392 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-bda9b92c-495b-4279-b63c-adbb188fd070 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:49.037941 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-bda9b92c-495b-4279-b63c-adbb188fd070 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 84774cfc-79b4-42db-acfd-c4daac86d196] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:49.040299 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-19d42ad6-9417-459a-8d5e-1da278e90560 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:49.042710 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-19d42ad6-9417-459a-8d5e-1da278e90560 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:49.048120 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-19d42ad6-9417-459a-8d5e-1da278e90560 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1555 microversion: 2.91 time: 0.113664 Oct 19 03:16:49.049127 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 642/1338] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:16:48 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1555 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:16:49.076897 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-15b98de1-8884-48f6-afbd-a1a6841733f7 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:49.077557 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-15b98de1-8884-48f6-afbd-a1a6841733f7 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: f03fef0e-680b-45bd-87a9-a3df948181cf] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:49.117588 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-bda9b92c-495b-4279-b63c-adbb188fd070 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:49.123592 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-bda9b92c-495b-4279-b63c-adbb188fd070 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196" status: 200 len: 1212 microversion: 2.1 time: 0.096737 Oct 19 03:16:49.124671 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 697/1339] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:49 2022] GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196 => generated 1212 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:16:49.154235 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-15b98de1-8884-48f6-afbd-a1a6841733f7 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:49.161695 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-15b98de1-8884-48f6-afbd-a1a6841733f7 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/f03fef0e-680b-45bd-87a9-a3df948181cf" status: 200 len: 1216 microversion: 2.1 time: 0.090782 Oct 19 03:16:49.162898 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 643/1340] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:49 2022] GET /compute/v2.1/servers/f03fef0e-680b-45bd-87a9-a3df948181cf => generated 1216 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:16:50.042090 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d8673d66-6e3a-4407-b347-3528a5f3bd1a tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:50.042817 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d8673d66-6e3a-4407-b347-3528a5f3bd1a tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] [instance: fef11301-8524-4f9b-bf6f-e525fca3237d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:50.049285 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d8673d66-6e3a-4407-b347-3528a5f3bd1a tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:50.054601 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d8673d66-6e3a-4407-b347-3528a5f3bd1a tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:50.055285 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d8673d66-6e3a-4407-b347-3528a5f3bd1a tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:50.056223 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d8673d66-6e3a-4407-b347-3528a5f3bd1a tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:50.056879 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d8673d66-6e3a-4407-b347-3528a5f3bd1a tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:50.057527 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d8673d66-6e3a-4407-b347-3528a5f3bd1a tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:50.085002 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ed56b485-973f-45fc-828a-e67ee73e46c6 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:50.086272 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ed56b485-973f-45fc-828a-e67ee73e46c6 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:50.098635 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ed56b485-973f-45fc-828a-e67ee73e46c6 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:50.100282 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ed56b485-973f-45fc-828a-e67ee73e46c6 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:50.100947 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ed56b485-973f-45fc-828a-e67ee73e46c6 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:50.103008 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ed56b485-973f-45fc-828a-e67ee73e46c6 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:50.104380 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ed56b485-973f-45fc-828a-e67ee73e46c6 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:50.104995 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ed56b485-973f-45fc-828a-e67ee73e46c6 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:50.217905 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ed56b485-973f-45fc-828a-e67ee73e46c6 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:50.233568 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ed56b485-973f-45fc-828a-e67ee73e46c6 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:50.235431 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ed56b485-973f-45fc-828a-e67ee73e46c6 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:50.243041 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ed56b485-973f-45fc-828a-e67ee73e46c6 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1555 microversion: 2.91 time: 0.163272 Oct 19 03:16:50.258443 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 644/1341] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:16:50 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1555 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:16:50.271512 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-ee1671b0-0b62-4370-b117-fe17b999df7b req-0a3225eb-5def-48bb-9d4c-72739c8ada1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fef11301-8524-4f9b-bf6f-e525fca3237d", "tag": "d48e4e1e-3f96-4bc7-948c-2124ef6f0ba5"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:16:50.282460 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-ee1671b0-0b62-4370-b117-fe17b999df7b req-0a3225eb-5def-48bb-9d4c-72739c8ada1e service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:50.283231 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-ee1671b0-0b62-4370-b117-fe17b999df7b req-0a3225eb-5def-48bb-9d4c-72739c8ada1e service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:50.283864 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-ee1671b0-0b62-4370-b117-fe17b999df7b req-0a3225eb-5def-48bb-9d4c-72739c8ada1e service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:50.308584 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-ee1671b0-0b62-4370-b117-fe17b999df7b req-0a3225eb-5def-48bb-9d4c-72739c8ada1e service nova] Creating event network-changed:d48e4e1e-3f96-4bc7-948c-2124ef6f0ba5 for instance fef11301-8524-4f9b-bf6f-e525fca3237d on n-h2-861333-8 Oct 19 03:16:50.321706 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-ee1671b0-0b62-4370-b117-fe17b999df7b req-0a3225eb-5def-48bb-9d4c-72739c8ada1e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061687 Oct 19 03:16:50.322663 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 645/1342] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:16:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:16:50.328128 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b9263d53-aaf8-4658-8310-75ceb6e8c5eb tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:50.328849 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b9263d53-aaf8-4658-8310-75ceb6e8c5eb tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 84774cfc-79b4-42db-acfd-c4daac86d196] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:50.336064 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b9263d53-aaf8-4658-8310-75ceb6e8c5eb tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:50.336572 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b9263d53-aaf8-4658-8310-75ceb6e8c5eb tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:50.337029 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b9263d53-aaf8-4658-8310-75ceb6e8c5eb tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:50.337914 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b9263d53-aaf8-4658-8310-75ceb6e8c5eb tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:50.338361 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b9263d53-aaf8-4658-8310-75ceb6e8c5eb tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:50.339006 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b9263d53-aaf8-4658-8310-75ceb6e8c5eb tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:50.348371 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d8673d66-6e3a-4407-b347-3528a5f3bd1a tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c35b71372843d69f9a6c6be04b154f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcd49d68a3947249016cc5dbe910efc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:50.366053 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d8673d66-6e3a-4407-b347-3528a5f3bd1a tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] 10.222.0.52 "GET /compute/v2.1/servers/fef11301-8524-4f9b-bf6f-e525fca3237d" status: 200 len: 1355 microversion: 2.1 time: 0.328349 Oct 19 03:16:50.375779 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 698/1343] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:50 2022] GET /compute/v2.1/servers/fef11301-8524-4f9b-bf6f-e525fca3237d => generated 1355 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:16:50.413524 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1032a9c2-7d8e-4313-87f1-6cd10a8fda93 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:50.414429 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1032a9c2-7d8e-4313-87f1-6cd10a8fda93 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: f03fef0e-680b-45bd-87a9-a3df948181cf] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:50.436867 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1032a9c2-7d8e-4313-87f1-6cd10a8fda93 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:50.437454 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1032a9c2-7d8e-4313-87f1-6cd10a8fda93 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:50.437897 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1032a9c2-7d8e-4313-87f1-6cd10a8fda93 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:50.438660 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1032a9c2-7d8e-4313-87f1-6cd10a8fda93 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:50.439111 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1032a9c2-7d8e-4313-87f1-6cd10a8fda93 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:50.439535 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1032a9c2-7d8e-4313-87f1-6cd10a8fda93 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:50.483628 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b9263d53-aaf8-4658-8310-75ceb6e8c5eb tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:50.502232 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b9263d53-aaf8-4658-8310-75ceb6e8c5eb tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196" status: 200 len: 1264 microversion: 2.1 time: 0.176123 Oct 19 03:16:50.505137 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 646/1344] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:50 2022] GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196 => generated 1264 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:16:50.578448 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-1032a9c2-7d8e-4313-87f1-6cd10a8fda93 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:50.593649 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1032a9c2-7d8e-4313-87f1-6cd10a8fda93 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/f03fef0e-680b-45bd-87a9-a3df948181cf" status: 200 len: 1268 microversion: 2.1 time: 0.216636 Oct 19 03:16:50.598517 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 699/1345] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:50 2022] GET /compute/v2.1/servers/f03fef0e-680b-45bd-87a9-a3df948181cf => generated 1268 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:16:51.276630 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-dd35e509-21f8-403d-abcd-a7e6fc858ffd tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:51.277270 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-dd35e509-21f8-403d-abcd-a7e6fc858ffd tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:51.284796 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dd35e509-21f8-403d-abcd-a7e6fc858ffd tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:51.285313 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dd35e509-21f8-403d-abcd-a7e6fc858ffd tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:51.285776 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dd35e509-21f8-403d-abcd-a7e6fc858ffd tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:51.286510 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dd35e509-21f8-403d-abcd-a7e6fc858ffd tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:51.286980 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dd35e509-21f8-403d-abcd-a7e6fc858ffd tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:51.287649 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dd35e509-21f8-403d-abcd-a7e6fc858ffd tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:51.361423 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-dd35e509-21f8-403d-abcd-a7e6fc858ffd tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:51.370348 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-dd35e509-21f8-403d-abcd-a7e6fc858ffd tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:51.371791 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-dd35e509-21f8-403d-abcd-a7e6fc858ffd tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:51.378272 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-dd35e509-21f8-403d-abcd-a7e6fc858ffd tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1555 microversion: 2.91 time: 0.106105 Oct 19 03:16:51.381401 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 647/1346] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:16:51 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1555 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:16:51.400495 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-cfa3003e-0133-4b89-9a67-4f14d9f1241d tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:51.401171 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-cfa3003e-0133-4b89-9a67-4f14d9f1241d tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] [instance: fef11301-8524-4f9b-bf6f-e525fca3237d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:51.409747 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cfa3003e-0133-4b89-9a67-4f14d9f1241d tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:51.411221 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cfa3003e-0133-4b89-9a67-4f14d9f1241d tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:51.411669 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cfa3003e-0133-4b89-9a67-4f14d9f1241d tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:51.412550 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cfa3003e-0133-4b89-9a67-4f14d9f1241d tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:51.413996 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cfa3003e-0133-4b89-9a67-4f14d9f1241d tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:51.413996 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cfa3003e-0133-4b89-9a67-4f14d9f1241d tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:51.529916 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-dd7dd58e-bbb9-4393-be34-a384d93ba507 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:51.530450 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-dd7dd58e-bbb9-4393-be34-a384d93ba507 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 84774cfc-79b4-42db-acfd-c4daac86d196] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:51.543624 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dd7dd58e-bbb9-4393-be34-a384d93ba507 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:51.544225 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dd7dd58e-bbb9-4393-be34-a384d93ba507 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:51.544680 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dd7dd58e-bbb9-4393-be34-a384d93ba507 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:51.549427 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dd7dd58e-bbb9-4393-be34-a384d93ba507 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:51.550925 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dd7dd58e-bbb9-4393-be34-a384d93ba507 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:51.556814 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dd7dd58e-bbb9-4393-be34-a384d93ba507 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:51.691707 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-dd7dd58e-bbb9-4393-be34-a384d93ba507 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:51.705967 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-dd7dd58e-bbb9-4393-be34-a384d93ba507 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196" status: 200 len: 1272 microversion: 2.1 time: 0.180691 Oct 19 03:16:51.706857 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 648/1347] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:51 2022] GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196 => generated 1272 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:16:51.722664 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-cfa3003e-0133-4b89-9a67-4f14d9f1241d tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c35b71372843d69f9a6c6be04b154f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcd49d68a3947249016cc5dbe910efc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:51.730203 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-faf93414-5da8-4eec-b16d-648d24b7a9cc tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:51.730881 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-faf93414-5da8-4eec-b16d-648d24b7a9cc tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: f03fef0e-680b-45bd-87a9-a3df948181cf] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:51.738427 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-faf93414-5da8-4eec-b16d-648d24b7a9cc tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:51.738648 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-cfa3003e-0133-4b89-9a67-4f14d9f1241d tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] 10.222.0.52 "GET /compute/v2.1/servers/fef11301-8524-4f9b-bf6f-e525fca3237d" status: 200 len: 1355 microversion: 2.1 time: 0.343211 Oct 19 03:16:51.749564 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-faf93414-5da8-4eec-b16d-648d24b7a9cc tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:51.749564 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-faf93414-5da8-4eec-b16d-648d24b7a9cc tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:51.749855 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 700/1348] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:51 2022] GET /compute/v2.1/servers/fef11301-8524-4f9b-bf6f-e525fca3237d => generated 1355 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:16:51.749966 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-faf93414-5da8-4eec-b16d-648d24b7a9cc tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:51.749966 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-faf93414-5da8-4eec-b16d-648d24b7a9cc tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:51.749966 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-faf93414-5da8-4eec-b16d-648d24b7a9cc tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:51.870634 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-faf93414-5da8-4eec-b16d-648d24b7a9cc tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:51.891195 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-faf93414-5da8-4eec-b16d-648d24b7a9cc tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/f03fef0e-680b-45bd-87a9-a3df948181cf" status: 200 len: 1268 microversion: 2.1 time: 0.165658 Oct 19 03:16:51.915416 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 649/1349] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:51 2022] GET /compute/v2.1/servers/f03fef0e-680b-45bd-87a9-a3df948181cf => generated 1268 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:16:52.409610 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-810727eb-9ae2-41e6-b93f-d896ea7fa541 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:52.410887 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-810727eb-9ae2-41e6-b93f-d896ea7fa541 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:52.418709 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-810727eb-9ae2-41e6-b93f-d896ea7fa541 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:52.419207 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-810727eb-9ae2-41e6-b93f-d896ea7fa541 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:52.419686 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-810727eb-9ae2-41e6-b93f-d896ea7fa541 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:52.420521 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-810727eb-9ae2-41e6-b93f-d896ea7fa541 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:52.420978 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-810727eb-9ae2-41e6-b93f-d896ea7fa541 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:52.421433 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-810727eb-9ae2-41e6-b93f-d896ea7fa541 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:52.520230 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-810727eb-9ae2-41e6-b93f-d896ea7fa541 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:52.530465 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-810727eb-9ae2-41e6-b93f-d896ea7fa541 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:52.533665 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-810727eb-9ae2-41e6-b93f-d896ea7fa541 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:52.539434 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-810727eb-9ae2-41e6-b93f-d896ea7fa541 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1555 microversion: 2.91 time: 0.135902 Oct 19 03:16:52.540261 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 701/1350] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:16:52 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1555 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:16:52.730790 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5637bc82-3f42-4d9a-a101-20d88d9cb4dc tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:52.731398 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5637bc82-3f42-4d9a-a101-20d88d9cb4dc tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 84774cfc-79b4-42db-acfd-c4daac86d196] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:52.738353 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5637bc82-3f42-4d9a-a101-20d88d9cb4dc tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:52.738834 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5637bc82-3f42-4d9a-a101-20d88d9cb4dc tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:52.739268 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5637bc82-3f42-4d9a-a101-20d88d9cb4dc tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:52.739994 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5637bc82-3f42-4d9a-a101-20d88d9cb4dc tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:52.740453 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5637bc82-3f42-4d9a-a101-20d88d9cb4dc tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:52.740874 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5637bc82-3f42-4d9a-a101-20d88d9cb4dc tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:52.766178 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c2c4771b-d939-4e40-a24e-7ed1e003963c tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:52.766795 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c2c4771b-d939-4e40-a24e-7ed1e003963c tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] [instance: fef11301-8524-4f9b-bf6f-e525fca3237d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:52.772639 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c2c4771b-d939-4e40-a24e-7ed1e003963c tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:52.773122 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c2c4771b-d939-4e40-a24e-7ed1e003963c tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:52.773598 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c2c4771b-d939-4e40-a24e-7ed1e003963c tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:52.774295 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c2c4771b-d939-4e40-a24e-7ed1e003963c tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:52.774747 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c2c4771b-d939-4e40-a24e-7ed1e003963c tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:52.775673 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c2c4771b-d939-4e40-a24e-7ed1e003963c tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:52.807219 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5637bc82-3f42-4d9a-a101-20d88d9cb4dc tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:52.814936 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5637bc82-3f42-4d9a-a101-20d88d9cb4dc tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196" status: 200 len: 1270 microversion: 2.1 time: 0.088619 Oct 19 03:16:52.815582 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 650/1351] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:52 2022] GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196 => generated 1270 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:16:52.930558 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a486a25f-ad8f-4e7a-9726-53945d58f381 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:52.931622 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a486a25f-ad8f-4e7a-9726-53945d58f381 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: f03fef0e-680b-45bd-87a9-a3df948181cf] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:52.942918 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a486a25f-ad8f-4e7a-9726-53945d58f381 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:52.944594 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a486a25f-ad8f-4e7a-9726-53945d58f381 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:52.945206 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a486a25f-ad8f-4e7a-9726-53945d58f381 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:52.947161 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a486a25f-ad8f-4e7a-9726-53945d58f381 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:52.947831 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a486a25f-ad8f-4e7a-9726-53945d58f381 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:52.949174 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a486a25f-ad8f-4e7a-9726-53945d58f381 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:53.030866 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c2c4771b-d939-4e40-a24e-7ed1e003963c tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c35b71372843d69f9a6c6be04b154f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcd49d68a3947249016cc5dbe910efc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:53.048146 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c2c4771b-d939-4e40-a24e-7ed1e003963c tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] 10.222.0.52 "GET /compute/v2.1/servers/fef11301-8524-4f9b-bf6f-e525fca3237d" status: 200 len: 1355 microversion: 2.1 time: 0.285975 Oct 19 03:16:53.057987 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 702/1352] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:52 2022] GET /compute/v2.1/servers/fef11301-8524-4f9b-bf6f-e525fca3237d => generated 1355 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:16:53.094237 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a486a25f-ad8f-4e7a-9726-53945d58f381 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:53.102925 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a486a25f-ad8f-4e7a-9726-53945d58f381 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/f03fef0e-680b-45bd-87a9-a3df948181cf" status: 200 len: 1276 microversion: 2.1 time: 0.178706 Oct 19 03:16:53.112306 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 651/1353] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:52 2022] GET /compute/v2.1/servers/f03fef0e-680b-45bd-87a9-a3df948181cf => generated 1276 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:16:53.568263 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-405f77ba-3ac7-459f-aadb-928c55e51c31 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:53.568863 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-405f77ba-3ac7-459f-aadb-928c55e51c31 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:53.587286 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-405f77ba-3ac7-459f-aadb-928c55e51c31 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:53.588656 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-405f77ba-3ac7-459f-aadb-928c55e51c31 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:53.589296 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-405f77ba-3ac7-459f-aadb-928c55e51c31 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:53.590044 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-405f77ba-3ac7-459f-aadb-928c55e51c31 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:53.590499 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-405f77ba-3ac7-459f-aadb-928c55e51c31 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:53.590927 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-405f77ba-3ac7-459f-aadb-928c55e51c31 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:53.684691 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-405f77ba-3ac7-459f-aadb-928c55e51c31 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:53.695530 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-405f77ba-3ac7-459f-aadb-928c55e51c31 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:53.697339 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-405f77ba-3ac7-459f-aadb-928c55e51c31 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:53.703235 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-405f77ba-3ac7-459f-aadb-928c55e51c31 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1555 microversion: 2.91 time: 0.138878 Oct 19 03:16:53.703869 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 703/1354] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:16:53 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1555 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:16:53.844682 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-49a468e3-7837-4478-90f2-677801bb9251 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:53.845409 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-49a468e3-7837-4478-90f2-677801bb9251 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 84774cfc-79b4-42db-acfd-c4daac86d196] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:53.852568 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-49a468e3-7837-4478-90f2-677801bb9251 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:53.853809 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-49a468e3-7837-4478-90f2-677801bb9251 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:53.854139 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-49a468e3-7837-4478-90f2-677801bb9251 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:53.854835 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-49a468e3-7837-4478-90f2-677801bb9251 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:53.855288 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-49a468e3-7837-4478-90f2-677801bb9251 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:53.855719 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-49a468e3-7837-4478-90f2-677801bb9251 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:54.079558 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-49a468e3-7837-4478-90f2-677801bb9251 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:54.081702 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c5c9ef89-20f1-4f6d-a12f-2261e170d5ca tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:54.082622 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c5c9ef89-20f1-4f6d-a12f-2261e170d5ca tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] [instance: fef11301-8524-4f9b-bf6f-e525fca3237d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:54.090568 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-49a468e3-7837-4478-90f2-677801bb9251 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196" status: 200 len: 1312 microversion: 2.1 time: 0.246790 Oct 19 03:16:54.092763 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c5c9ef89-20f1-4f6d-a12f-2261e170d5ca tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:54.092763 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c5c9ef89-20f1-4f6d-a12f-2261e170d5ca tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:54.093230 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c5c9ef89-20f1-4f6d-a12f-2261e170d5ca tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:54.094182 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c5c9ef89-20f1-4f6d-a12f-2261e170d5ca tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:54.095041 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c5c9ef89-20f1-4f6d-a12f-2261e170d5ca tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:54.095966 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c5c9ef89-20f1-4f6d-a12f-2261e170d5ca tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:54.102583 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 652/1355] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:53 2022] GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196 => generated 1312 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:16:54.139145 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-718fe9a5-36e4-4846-8629-ba756183f022 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:54.144380 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-718fe9a5-36e4-4846-8629-ba756183f022 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: f03fef0e-680b-45bd-87a9-a3df948181cf] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:54.147965 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-718fe9a5-36e4-4846-8629-ba756183f022 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:54.148649 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-718fe9a5-36e4-4846-8629-ba756183f022 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:54.149346 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-718fe9a5-36e4-4846-8629-ba756183f022 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:54.150958 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-718fe9a5-36e4-4846-8629-ba756183f022 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:54.152142 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-718fe9a5-36e4-4846-8629-ba756183f022 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:54.152913 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-718fe9a5-36e4-4846-8629-ba756183f022 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:54.426113 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c5c9ef89-20f1-4f6d-a12f-2261e170d5ca tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c35b71372843d69f9a6c6be04b154f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcd49d68a3947249016cc5dbe910efc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:54.435206 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c5c9ef89-20f1-4f6d-a12f-2261e170d5ca tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] 10.222.0.52 "GET /compute/v2.1/servers/fef11301-8524-4f9b-bf6f-e525fca3237d" status: 200 len: 1355 microversion: 2.1 time: 0.358632 Oct 19 03:16:54.440822 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 704/1356] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:54 2022] GET /compute/v2.1/servers/fef11301-8524-4f9b-bf6f-e525fca3237d => generated 1355 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:16:54.463396 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-718fe9a5-36e4-4846-8629-ba756183f022 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:54.476405 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-718fe9a5-36e4-4846-8629-ba756183f022 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/f03fef0e-680b-45bd-87a9-a3df948181cf" status: 200 len: 1316 microversion: 2.1 time: 0.344188 Oct 19 03:16:54.478628 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 653/1357] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:54 2022] GET /compute/v2.1/servers/f03fef0e-680b-45bd-87a9-a3df948181cf => generated 1316 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:16:54.587716 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-10963c00-a0d5-40f5-a5f1-2ed6a64b00de req-3ee81773-3c87-4f9a-ad8c-05b68aa4f85d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84774cfc-79b4-42db-acfd-c4daac86d196", "tag": "349ffeb3-81a2-44f2-9775-65ddf0c3a896"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:16:54.599892 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-10963c00-a0d5-40f5-a5f1-2ed6a64b00de req-3ee81773-3c87-4f9a-ad8c-05b68aa4f85d service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:54.600690 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-10963c00-a0d5-40f5-a5f1-2ed6a64b00de req-3ee81773-3c87-4f9a-ad8c-05b68aa4f85d service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:54.601358 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-10963c00-a0d5-40f5-a5f1-2ed6a64b00de req-3ee81773-3c87-4f9a-ad8c-05b68aa4f85d service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:54.613970 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-10963c00-a0d5-40f5-a5f1-2ed6a64b00de req-3ee81773-3c87-4f9a-ad8c-05b68aa4f85d service nova] Creating event network-changed:349ffeb3-81a2-44f2-9775-65ddf0c3a896 for instance 84774cfc-79b4-42db-acfd-c4daac86d196 on n-h1-861333-8 Oct 19 03:16:54.620788 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-10963c00-a0d5-40f5-a5f1-2ed6a64b00de req-3ee81773-3c87-4f9a-ad8c-05b68aa4f85d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041829 Oct 19 03:16:54.622075 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 705/1358] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:16:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:16:54.738000 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0e16f64c-5804-4d14-a9f4-e89a6c770396 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:54.738617 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0e16f64c-5804-4d14-a9f4-e89a6c770396 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:54.757733 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0e16f64c-5804-4d14-a9f4-e89a6c770396 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:54.758616 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0e16f64c-5804-4d14-a9f4-e89a6c770396 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:54.759083 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0e16f64c-5804-4d14-a9f4-e89a6c770396 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:54.760510 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0e16f64c-5804-4d14-a9f4-e89a6c770396 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:54.760775 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0e16f64c-5804-4d14-a9f4-e89a6c770396 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:54.761468 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0e16f64c-5804-4d14-a9f4-e89a6c770396 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:54.831753 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0e16f64c-5804-4d14-a9f4-e89a6c770396 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:54.841553 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0e16f64c-5804-4d14-a9f4-e89a6c770396 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:54.843020 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0e16f64c-5804-4d14-a9f4-e89a6c770396 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:54.848070 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0e16f64c-5804-4d14-a9f4-e89a6c770396 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1555 microversion: 2.91 time: 0.114202 Oct 19 03:16:54.852924 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 654/1359] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:16:54 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1555 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:16:55.114776 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3e1938dd-355c-49aa-96bd-a00074f7d491 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:55.115648 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-3e1938dd-355c-49aa-96bd-a00074f7d491 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 84774cfc-79b4-42db-acfd-c4daac86d196] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:55.122825 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3e1938dd-355c-49aa-96bd-a00074f7d491 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:55.123459 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3e1938dd-355c-49aa-96bd-a00074f7d491 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:55.124246 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3e1938dd-355c-49aa-96bd-a00074f7d491 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:55.125068 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3e1938dd-355c-49aa-96bd-a00074f7d491 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:55.125702 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3e1938dd-355c-49aa-96bd-a00074f7d491 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:55.126234 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3e1938dd-355c-49aa-96bd-a00074f7d491 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:55.355064 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-3e1938dd-355c-49aa-96bd-a00074f7d491 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:55.365878 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-3e1938dd-355c-49aa-96bd-a00074f7d491 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196" status: 200 len: 1312 microversion: 2.1 time: 0.255320 Oct 19 03:16:55.377395 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-c874970c-fe31-4674-9d36-071543cb6711 req-3f8d7616-283c-42e2-bd5a-cdef334b5d94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f03fef0e-680b-45bd-87a9-a3df948181cf", "tag": "6e9a5918-2f60-411c-8ab7-8e2f61d6894d"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:16:55.377603 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 706/1360] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:55 2022] GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196 => generated 1312 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:16:55.383465 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-c874970c-fe31-4674-9d36-071543cb6711 req-3f8d7616-283c-42e2-bd5a-cdef334b5d94 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:55.384325 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-c874970c-fe31-4674-9d36-071543cb6711 req-3f8d7616-283c-42e2-bd5a-cdef334b5d94 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:55.385584 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-c874970c-fe31-4674-9d36-071543cb6711 req-3f8d7616-283c-42e2-bd5a-cdef334b5d94 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:55.398764 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-c874970c-fe31-4674-9d36-071543cb6711 req-3f8d7616-283c-42e2-bd5a-cdef334b5d94 service nova] Creating event network-changed:6e9a5918-2f60-411c-8ab7-8e2f61d6894d for instance f03fef0e-680b-45bd-87a9-a3df948181cf on n-h2-861333-8 Oct 19 03:16:55.404884 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-c874970c-fe31-4674-9d36-071543cb6711 req-3f8d7616-283c-42e2-bd5a-cdef334b5d94 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039004 Oct 19 03:16:55.405961 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 655/1361] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:16:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:16:55.461901 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-197d44e8-a030-4754-9288-112e5386b48f tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:55.462552 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-197d44e8-a030-4754-9288-112e5386b48f tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] [instance: fef11301-8524-4f9b-bf6f-e525fca3237d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:55.468674 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-197d44e8-a030-4754-9288-112e5386b48f tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:55.469163 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-197d44e8-a030-4754-9288-112e5386b48f tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:55.469851 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-197d44e8-a030-4754-9288-112e5386b48f tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:55.470548 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-197d44e8-a030-4754-9288-112e5386b48f tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:55.470998 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-197d44e8-a030-4754-9288-112e5386b48f tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:55.471421 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-197d44e8-a030-4754-9288-112e5386b48f tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:55.507094 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6ae00e3c-a49f-4ab3-89e1-b0229104afaa tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:55.507794 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6ae00e3c-a49f-4ab3-89e1-b0229104afaa tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: f03fef0e-680b-45bd-87a9-a3df948181cf] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:55.514414 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6ae00e3c-a49f-4ab3-89e1-b0229104afaa tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:55.514921 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6ae00e3c-a49f-4ab3-89e1-b0229104afaa tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:55.515394 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6ae00e3c-a49f-4ab3-89e1-b0229104afaa tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:55.516083 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6ae00e3c-a49f-4ab3-89e1-b0229104afaa tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:55.516778 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6ae00e3c-a49f-4ab3-89e1-b0229104afaa tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:55.517218 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6ae00e3c-a49f-4ab3-89e1-b0229104afaa tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:55.521715 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=100 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:16:55.821189 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-6ae00e3c-a49f-4ab3-89e1-b0229104afaa tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:55.841251 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6ae00e3c-a49f-4ab3-89e1-b0229104afaa tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/f03fef0e-680b-45bd-87a9-a3df948181cf" status: 200 len: 1316 microversion: 2.1 time: 0.331615 Oct 19 03:16:55.841251 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 656/1362] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:55 2022] GET /compute/v2.1/servers/f03fef0e-680b-45bd-87a9-a3df948181cf => generated 1316 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:16:55.841462 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-197d44e8-a030-4754-9288-112e5386b48f tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c35b71372843d69f9a6c6be04b154f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcd49d68a3947249016cc5dbe910efc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:55.849394 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-197d44e8-a030-4754-9288-112e5386b48f tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] 10.222.0.52 "GET /compute/v2.1/servers/fef11301-8524-4f9b-bf6f-e525fca3237d" status: 200 len: 1355 microversion: 2.1 time: 0.391498 Oct 19 03:16:55.851478 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 707/1363] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:55 2022] GET /compute/v2.1/servers/fef11301-8524-4f9b-bf6f-e525fca3237d => generated 1355 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:16:55.875871 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7f365def-690a-4b8e-91de-ad105defc476 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:55.876496 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7f365def-690a-4b8e-91de-ad105defc476 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:55.882588 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7f365def-690a-4b8e-91de-ad105defc476 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:55.883078 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7f365def-690a-4b8e-91de-ad105defc476 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:55.886121 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7f365def-690a-4b8e-91de-ad105defc476 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:55.886121 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7f365def-690a-4b8e-91de-ad105defc476 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:55.886121 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7f365def-690a-4b8e-91de-ad105defc476 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:55.886121 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7f365def-690a-4b8e-91de-ad105defc476 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:55.958652 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-7f365def-690a-4b8e-91de-ad105defc476 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:55.970563 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-7f365def-690a-4b8e-91de-ad105defc476 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:55.973916 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-7f365def-690a-4b8e-91de-ad105defc476 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:55.980317 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7f365def-690a-4b8e-91de-ad105defc476 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1537 microversion: 2.91 time: 0.107679 Oct 19 03:16:55.989603 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 657/1364] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:16:55 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1537 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:16:56.391099 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-abfebe33-6add-4f5c-a8ff-8fd2de04598e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:56.391721 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-abfebe33-6add-4f5c-a8ff-8fd2de04598e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 84774cfc-79b4-42db-acfd-c4daac86d196] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:56.398014 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-abfebe33-6add-4f5c-a8ff-8fd2de04598e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:56.398504 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-abfebe33-6add-4f5c-a8ff-8fd2de04598e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:56.399356 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-abfebe33-6add-4f5c-a8ff-8fd2de04598e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:56.399630 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-abfebe33-6add-4f5c-a8ff-8fd2de04598e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:56.401656 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-abfebe33-6add-4f5c-a8ff-8fd2de04598e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:56.401656 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-abfebe33-6add-4f5c-a8ff-8fd2de04598e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:56.537654 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-abfebe33-6add-4f5c-a8ff-8fd2de04598e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:56.552808 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-abfebe33-6add-4f5c-a8ff-8fd2de04598e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196" status: 200 len: 1312 microversion: 2.1 time: 0.165811 Oct 19 03:16:56.553580 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 708/1365] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:56 2022] GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196 => generated 1312 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:16:56.858716 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b45aa7ac-6b6d-49c4-8028-67b0a273de7b tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:56.859257 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b45aa7ac-6b6d-49c4-8028-67b0a273de7b tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: f03fef0e-680b-45bd-87a9-a3df948181cf] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:56.866093 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b45aa7ac-6b6d-49c4-8028-67b0a273de7b tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:56.866573 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b45aa7ac-6b6d-49c4-8028-67b0a273de7b tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:56.867009 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b45aa7ac-6b6d-49c4-8028-67b0a273de7b tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:56.867698 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b45aa7ac-6b6d-49c4-8028-67b0a273de7b tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:56.868150 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b45aa7ac-6b6d-49c4-8028-67b0a273de7b tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:56.869925 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b45aa7ac-6b6d-49c4-8028-67b0a273de7b tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:56.875260 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-55f9c412-d61e-4bdb-94fe-211fd09784d2 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:56.876081 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-55f9c412-d61e-4bdb-94fe-211fd09784d2 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] [instance: fef11301-8524-4f9b-bf6f-e525fca3237d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:56.882261 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-55f9c412-d61e-4bdb-94fe-211fd09784d2 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:56.882751 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-55f9c412-d61e-4bdb-94fe-211fd09784d2 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:56.883432 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-55f9c412-d61e-4bdb-94fe-211fd09784d2 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:56.883890 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-55f9c412-d61e-4bdb-94fe-211fd09784d2 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:56.885007 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-55f9c412-d61e-4bdb-94fe-211fd09784d2 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:56.885482 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-55f9c412-d61e-4bdb-94fe-211fd09784d2 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:57.092900 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b45aa7ac-6b6d-49c4-8028-67b0a273de7b tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:57.097340 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-55f9c412-d61e-4bdb-94fe-211fd09784d2 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c35b71372843d69f9a6c6be04b154f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcd49d68a3947249016cc5dbe910efc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:57.108396 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b45aa7ac-6b6d-49c4-8028-67b0a273de7b tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/f03fef0e-680b-45bd-87a9-a3df948181cf" status: 200 len: 1316 microversion: 2.1 time: 0.253629 Oct 19 03:16:57.113122 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-55f9c412-d61e-4bdb-94fe-211fd09784d2 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] 10.222.0.52 "GET /compute/v2.1/servers/fef11301-8524-4f9b-bf6f-e525fca3237d" status: 200 len: 1355 microversion: 2.1 time: 0.241771 Oct 19 03:16:57.114381 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 709/1366] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:56 2022] GET /compute/v2.1/servers/fef11301-8524-4f9b-bf6f-e525fca3237d => generated 1355 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:16:57.114877 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 658/1367] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:56 2022] GET /compute/v2.1/servers/f03fef0e-680b-45bd-87a9-a3df948181cf => generated 1316 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:16:57.119629 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f9766623-57f6-41bf-a2ca-d46a0a5cca1d tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:57.120802 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f9766623-57f6-41bf-a2ca-d46a0a5cca1d tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:57.127139 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f9766623-57f6-41bf-a2ca-d46a0a5cca1d tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:57.127813 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f9766623-57f6-41bf-a2ca-d46a0a5cca1d tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:57.128417 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f9766623-57f6-41bf-a2ca-d46a0a5cca1d tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:57.129265 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f9766623-57f6-41bf-a2ca-d46a0a5cca1d tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:57.129955 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f9766623-57f6-41bf-a2ca-d46a0a5cca1d tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:57.130552 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f9766623-57f6-41bf-a2ca-d46a0a5cca1d tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:57.199526 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f9766623-57f6-41bf-a2ca-d46a0a5cca1d tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:57.208296 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f9766623-57f6-41bf-a2ca-d46a0a5cca1d tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:57.209975 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f9766623-57f6-41bf-a2ca-d46a0a5cca1d tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:57.216609 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f9766623-57f6-41bf-a2ca-d46a0a5cca1d tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1537 microversion: 2.91 time: 0.100580 Oct 19 03:16:57.218456 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 710/1368] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:16:57 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1537 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:16:57.576344 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e18d8d1f-d85b-4796-99c6-a1860468a660 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:57.577014 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e18d8d1f-d85b-4796-99c6-a1860468a660 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 84774cfc-79b4-42db-acfd-c4daac86d196] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:57.578933 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:16:57.583941 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e18d8d1f-d85b-4796-99c6-a1860468a660 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:57.584424 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e18d8d1f-d85b-4796-99c6-a1860468a660 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:57.584856 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e18d8d1f-d85b-4796-99c6-a1860468a660 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:57.585736 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e18d8d1f-d85b-4796-99c6-a1860468a660 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:57.586182 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e18d8d1f-d85b-4796-99c6-a1860468a660 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:57.586606 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e18d8d1f-d85b-4796-99c6-a1860468a660 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:57.721468 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e18d8d1f-d85b-4796-99c6-a1860468a660 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:57.730339 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e18d8d1f-d85b-4796-99c6-a1860468a660 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196" status: 200 len: 1312 microversion: 2.1 time: 0.158759 Oct 19 03:16:57.730935 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 659/1369] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:57 2022] GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196 => generated 1312 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:16:58.137577 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3e71aef6-63cc-4008-aa68-bf7f41e8d0fb tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:58.138124 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5ee40ef8-ac87-4700-8e6f-f89cdc4f19b2 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:58.138777 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5ee40ef8-ac87-4700-8e6f-f89cdc4f19b2 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] [instance: fef11301-8524-4f9b-bf6f-e525fca3237d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:58.138889 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-3e71aef6-63cc-4008-aa68-bf7f41e8d0fb tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: f03fef0e-680b-45bd-87a9-a3df948181cf] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:58.140473 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:16:58.145420 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3e71aef6-63cc-4008-aa68-bf7f41e8d0fb tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:58.145573 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5ee40ef8-ac87-4700-8e6f-f89cdc4f19b2 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:58.145994 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3e71aef6-63cc-4008-aa68-bf7f41e8d0fb tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:58.146118 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5ee40ef8-ac87-4700-8e6f-f89cdc4f19b2 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:58.146351 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3e71aef6-63cc-4008-aa68-bf7f41e8d0fb tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:58.146462 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5ee40ef8-ac87-4700-8e6f-f89cdc4f19b2 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:58.147052 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3e71aef6-63cc-4008-aa68-bf7f41e8d0fb tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:58.147159 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5ee40ef8-ac87-4700-8e6f-f89cdc4f19b2 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:58.147557 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5ee40ef8-ac87-4700-8e6f-f89cdc4f19b2 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:58.147706 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3e71aef6-63cc-4008-aa68-bf7f41e8d0fb tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:58.147996 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3e71aef6-63cc-4008-aa68-bf7f41e8d0fb tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:58.148273 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5ee40ef8-ac87-4700-8e6f-f89cdc4f19b2 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:58.363357 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-3e71aef6-63cc-4008-aa68-bf7f41e8d0fb tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:58.365028 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5ee40ef8-ac87-4700-8e6f-f89cdc4f19b2 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c35b71372843d69f9a6c6be04b154f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcd49d68a3947249016cc5dbe910efc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:58.372120 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-3e71aef6-63cc-4008-aa68-bf7f41e8d0fb tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/f03fef0e-680b-45bd-87a9-a3df948181cf" status: 200 len: 1316 microversion: 2.1 time: 0.238466 Oct 19 03:16:58.372900 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 711/1370] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:58 2022] GET /compute/v2.1/servers/f03fef0e-680b-45bd-87a9-a3df948181cf => generated 1316 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:16:58.374699 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5ee40ef8-ac87-4700-8e6f-f89cdc4f19b2 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] 10.222.0.52 "GET /compute/v2.1/servers/fef11301-8524-4f9b-bf6f-e525fca3237d" status: 200 len: 1355 microversion: 2.1 time: 0.241028 Oct 19 03:16:58.375354 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 660/1371] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:58 2022] GET /compute/v2.1/servers/fef11301-8524-4f9b-bf6f-e525fca3237d => generated 1355 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:16:58.378051 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a09a3a18-460e-44e4-824e-9923db41b924 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:58.378652 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a09a3a18-460e-44e4-824e-9923db41b924 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:58.385193 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a09a3a18-460e-44e4-824e-9923db41b924 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:58.385896 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a09a3a18-460e-44e4-824e-9923db41b924 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:58.386522 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a09a3a18-460e-44e4-824e-9923db41b924 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:58.387408 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a09a3a18-460e-44e4-824e-9923db41b924 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:58.388054 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a09a3a18-460e-44e4-824e-9923db41b924 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:58.388913 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a09a3a18-460e-44e4-824e-9923db41b924 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:58.464773 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a09a3a18-460e-44e4-824e-9923db41b924 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:58.472996 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a09a3a18-460e-44e4-824e-9923db41b924 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:58.474475 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a09a3a18-460e-44e4-824e-9923db41b924 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:58.479379 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a09a3a18-460e-44e4-824e-9923db41b924 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1537 microversion: 2.91 time: 0.105312 Oct 19 03:16:58.479955 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 712/1372] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:16:58 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1537 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:16:58.754748 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-779b4d55-2694-4ff0-89fb-cdeef257812f tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:58.755392 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-779b4d55-2694-4ff0-89fb-cdeef257812f tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 84774cfc-79b4-42db-acfd-c4daac86d196] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:58.758426 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:16:58.762457 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-779b4d55-2694-4ff0-89fb-cdeef257812f tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:58.762940 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-779b4d55-2694-4ff0-89fb-cdeef257812f tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:58.763651 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-779b4d55-2694-4ff0-89fb-cdeef257812f tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:58.764342 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-779b4d55-2694-4ff0-89fb-cdeef257812f tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:58.764791 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-779b4d55-2694-4ff0-89fb-cdeef257812f tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:58.765213 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-779b4d55-2694-4ff0-89fb-cdeef257812f tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:58.897481 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-779b4d55-2694-4ff0-89fb-cdeef257812f tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:58.905390 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-779b4d55-2694-4ff0-89fb-cdeef257812f tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196" status: 200 len: 1312 microversion: 2.1 time: 0.154772 Oct 19 03:16:58.905965 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 661/1373] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:58 2022] GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196 => generated 1312 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:16:59.397898 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1667cd08-5876-4bbc-956e-758c2944411b tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:59.398413 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f6f9d653-37ef-474e-af78-6b86e6e58b57 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:59.398817 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1667cd08-5876-4bbc-956e-758c2944411b tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: f03fef0e-680b-45bd-87a9-a3df948181cf] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:59.399000 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f6f9d653-37ef-474e-af78-6b86e6e58b57 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] [instance: fef11301-8524-4f9b-bf6f-e525fca3237d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:59.400578 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=14 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:16:59.402732 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=10 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:16:59.405664 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1667cd08-5876-4bbc-956e-758c2944411b tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:59.406223 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1667cd08-5876-4bbc-956e-758c2944411b tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:59.406326 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f6f9d653-37ef-474e-af78-6b86e6e58b57 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:59.406733 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f6f9d653-37ef-474e-af78-6b86e6e58b57 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:59.407124 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1667cd08-5876-4bbc-956e-758c2944411b tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:59.407245 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f6f9d653-37ef-474e-af78-6b86e6e58b57 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:59.407863 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1667cd08-5876-4bbc-956e-758c2944411b tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:59.408010 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f6f9d653-37ef-474e-af78-6b86e6e58b57 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:59.408321 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1667cd08-5876-4bbc-956e-758c2944411b tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:59.408425 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f6f9d653-37ef-474e-af78-6b86e6e58b57 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:59.408748 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1667cd08-5876-4bbc-956e-758c2944411b tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:59.408849 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f6f9d653-37ef-474e-af78-6b86e6e58b57 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:59.608998 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-1667cd08-5876-4bbc-956e-758c2944411b tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:59.616628 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1667cd08-5876-4bbc-956e-758c2944411b tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/f03fef0e-680b-45bd-87a9-a3df948181cf" status: 200 len: 1316 microversion: 2.1 time: 0.222561 Oct 19 03:16:59.617857 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 713/1374] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:59 2022] GET /compute/v2.1/servers/f03fef0e-680b-45bd-87a9-a3df948181cf => generated 1316 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:16:59.632506 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-f6f9d653-37ef-474e-af78-6b86e6e58b57 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c35b71372843d69f9a6c6be04b154f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcd49d68a3947249016cc5dbe910efc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:59.632690 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-8fc0c3d2-4e4e-4185-bc68-2025ddc3b814 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:59.632690 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-8fc0c3d2-4e4e-4185-bc68-2025ddc3b814 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:59.632873 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f6f9d653-37ef-474e-af78-6b86e6e58b57 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] 10.222.0.52 "GET /compute/v2.1/servers/fef11301-8524-4f9b-bf6f-e525fca3237d" status: 200 len: 1355 microversion: 2.1 time: 0.233074 Oct 19 03:16:59.632873 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 662/1375] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:59 2022] GET /compute/v2.1/servers/fef11301-8524-4f9b-bf6f-e525fca3237d => generated 1355 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:16:59.633049 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8fc0c3d2-4e4e-4185-bc68-2025ddc3b814 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:59.633049 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8fc0c3d2-4e4e-4185-bc68-2025ddc3b814 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:59.633049 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8fc0c3d2-4e4e-4185-bc68-2025ddc3b814 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:59.633049 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8fc0c3d2-4e4e-4185-bc68-2025ddc3b814 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:59.633430 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8fc0c3d2-4e4e-4185-bc68-2025ddc3b814 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:59.633430 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8fc0c3d2-4e4e-4185-bc68-2025ddc3b814 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:59.635797 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=100 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:16:59.698253 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-8fc0c3d2-4e4e-4185-bc68-2025ddc3b814 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:59.706181 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-8fc0c3d2-4e4e-4185-bc68-2025ddc3b814 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:59.707605 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-8fc0c3d2-4e4e-4185-bc68-2025ddc3b814 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:16:59.713292 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-8fc0c3d2-4e4e-4185-bc68-2025ddc3b814 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1537 microversion: 2.91 time: 0.094407 Oct 19 03:16:59.713902 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 714/1376] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:16:59 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1537 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:16:59.826599 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d76483a2-2749-43e0-a63f-d48ec0208902 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7917a793-2e5e-409e-9f52-f81fb832856d"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:16:59.829077 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d76483a2-2749-43e0-a63f-d48ec0208902 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] [instance: 540a7025-b935-49fb-bc51-edf44ac1e0c4] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:59.835068 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d76483a2-2749-43e0-a63f-d48ec0208902 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:59.835561 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d76483a2-2749-43e0-a63f-d48ec0208902 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:59.836006 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d76483a2-2749-43e0-a63f-d48ec0208902 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:59.836716 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d76483a2-2749-43e0-a63f-d48ec0208902 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:59.837169 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d76483a2-2749-43e0-a63f-d48ec0208902 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:59.838118 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d76483a2-2749-43e0-a63f-d48ec0208902 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:59.927178 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ea646173-f304-4302-b7e4-6f344b767020 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:16:59.927855 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ea646173-f304-4302-b7e4-6f344b767020 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 84774cfc-79b4-42db-acfd-c4daac86d196] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:16:59.933925 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ea646173-f304-4302-b7e4-6f344b767020 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:59.934402 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ea646173-f304-4302-b7e4-6f344b767020 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:59.934836 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ea646173-f304-4302-b7e4-6f344b767020 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:16:59.935521 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ea646173-f304-4302-b7e4-6f344b767020 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:16:59.935967 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ea646173-f304-4302-b7e4-6f344b767020 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:16:59.936383 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ea646173-f304-4302-b7e4-6f344b767020 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:00.067635 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ea646173-f304-4302-b7e4-6f344b767020 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:00.075948 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ea646173-f304-4302-b7e4-6f344b767020 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196" status: 200 len: 1312 microversion: 2.1 time: 0.152550 Oct 19 03:17:00.076514 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 715/1377] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:16:59 2022] GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196 => generated 1312 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:17:00.232211 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-03d08667-c6ca-4cbe-8e37-f06de2afb23a req-1f522907-b70a-4c36-8cb3-fc8fef6a9dbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fef11301-8524-4f9b-bf6f-e525fca3237d", "name": "network-vif-plugged", "status": "completed", "tag": "a956b9e6-07b8-4d6e-9436-0782855cb789"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:17:00.242348 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-03d08667-c6ca-4cbe-8e37-f06de2afb23a req-1f522907-b70a-4c36-8cb3-fc8fef6a9dbe service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:00.242833 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-03d08667-c6ca-4cbe-8e37-f06de2afb23a req-1f522907-b70a-4c36-8cb3-fc8fef6a9dbe service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:00.243268 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-03d08667-c6ca-4cbe-8e37-f06de2afb23a req-1f522907-b70a-4c36-8cb3-fc8fef6a9dbe service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:00.255626 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-03d08667-c6ca-4cbe-8e37-f06de2afb23a req-1f522907-b70a-4c36-8cb3-fc8fef6a9dbe service nova] Creating event network-vif-plugged:a956b9e6-07b8-4d6e-9436-0782855cb789 for instance fef11301-8524-4f9b-bf6f-e525fca3237d on n-h2-861333-8 Oct 19 03:17:00.261495 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-03d08667-c6ca-4cbe-8e37-f06de2afb23a req-1f522907-b70a-4c36-8cb3-fc8fef6a9dbe service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032899 Oct 19 03:17:00.262112 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 716/1378] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:17:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:17:00.641926 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d18e9d16-152b-4ee5-bca2-140044b99626 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:00.642660 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d18e9d16-152b-4ee5-bca2-140044b99626 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: f03fef0e-680b-45bd-87a9-a3df948181cf] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:00.649594 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d18e9d16-152b-4ee5-bca2-140044b99626 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:00.650216 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d18e9d16-152b-4ee5-bca2-140044b99626 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:00.650666 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d18e9d16-152b-4ee5-bca2-140044b99626 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:00.651369 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d18e9d16-152b-4ee5-bca2-140044b99626 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:00.651830 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d18e9d16-152b-4ee5-bca2-140044b99626 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:00.652260 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d18e9d16-152b-4ee5-bca2-140044b99626 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:00.784553 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d18e9d16-152b-4ee5-bca2-140044b99626 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:00.794193 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d18e9d16-152b-4ee5-bca2-140044b99626 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/f03fef0e-680b-45bd-87a9-a3df948181cf" status: 200 len: 1316 microversion: 2.1 time: 0.157054 Oct 19 03:17:00.794771 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 717/1379] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:00 2022] GET /compute/v2.1/servers/f03fef0e-680b-45bd-87a9-a3df948181cf => generated 1316 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:17:00.799781 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d300ade4-84a4-4d1a-b628-d2ee96860e34 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:00.800597 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d300ade4-84a4-4d1a-b628-d2ee96860e34 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] [instance: fef11301-8524-4f9b-bf6f-e525fca3237d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:00.807319 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d300ade4-84a4-4d1a-b628-d2ee96860e34 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:00.808025 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d300ade4-84a4-4d1a-b628-d2ee96860e34 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:00.808621 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d300ade4-84a4-4d1a-b628-d2ee96860e34 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:00.809503 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d300ade4-84a4-4d1a-b628-d2ee96860e34 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:00.810135 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d300ade4-84a4-4d1a-b628-d2ee96860e34 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:00.810718 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d300ade4-84a4-4d1a-b628-d2ee96860e34 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:00.954527 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d300ade4-84a4-4d1a-b628-d2ee96860e34 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c35b71372843d69f9a6c6be04b154f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcd49d68a3947249016cc5dbe910efc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:00.962329 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d300ade4-84a4-4d1a-b628-d2ee96860e34 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] 10.222.0.52 "GET /compute/v2.1/servers/fef11301-8524-4f9b-bf6f-e525fca3237d" status: 200 len: 1355 microversion: 2.1 time: 0.166299 Oct 19 03:17:00.962894 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 718/1380] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:00 2022] GET /compute/v2.1/servers/fef11301-8524-4f9b-bf6f-e525fca3237d => generated 1355 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:00.967425 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5875d2c6-c946-4150-9269-fbe4a14ed038 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:00.968027 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-5875d2c6-c946-4150-9269-fbe4a14ed038 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:00.973607 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5875d2c6-c946-4150-9269-fbe4a14ed038 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:00.974089 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5875d2c6-c946-4150-9269-fbe4a14ed038 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:00.974525 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5875d2c6-c946-4150-9269-fbe4a14ed038 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:00.975207 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5875d2c6-c946-4150-9269-fbe4a14ed038 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:00.975656 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5875d2c6-c946-4150-9269-fbe4a14ed038 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:00.976074 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5875d2c6-c946-4150-9269-fbe4a14ed038 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:01.046226 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-5875d2c6-c946-4150-9269-fbe4a14ed038 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:01.054449 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-5875d2c6-c946-4150-9269-fbe4a14ed038 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:01.056032 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-5875d2c6-c946-4150-9269-fbe4a14ed038 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:01.060891 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5875d2c6-c946-4150-9269-fbe4a14ed038 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1537 microversion: 2.91 time: 0.097002 Oct 19 03:17:01.061486 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 719/1381] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:17:00 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1537 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:17:01.099329 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3cbc086c-a414-47a8-ad2a-2112f11b772e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:01.100127 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-3cbc086c-a414-47a8-ad2a-2112f11b772e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 84774cfc-79b4-42db-acfd-c4daac86d196] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:01.106686 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3cbc086c-a414-47a8-ad2a-2112f11b772e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:01.107171 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3cbc086c-a414-47a8-ad2a-2112f11b772e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:01.107606 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3cbc086c-a414-47a8-ad2a-2112f11b772e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:01.108292 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3cbc086c-a414-47a8-ad2a-2112f11b772e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:01.108739 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3cbc086c-a414-47a8-ad2a-2112f11b772e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:01.109157 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3cbc086c-a414-47a8-ad2a-2112f11b772e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:01.240896 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-3cbc086c-a414-47a8-ad2a-2112f11b772e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:01.249079 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-3cbc086c-a414-47a8-ad2a-2112f11b772e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196" status: 200 len: 1312 microversion: 2.1 time: 0.153527 Oct 19 03:17:01.249684 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 720/1382] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:01 2022] GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196 => generated 1312 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:17:01.817659 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f63bfdb8-eb18-4d94-8f1f-ac720ce5095c tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:01.819107 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f63bfdb8-eb18-4d94-8f1f-ac720ce5095c tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: f03fef0e-680b-45bd-87a9-a3df948181cf] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:01.826516 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f63bfdb8-eb18-4d94-8f1f-ac720ce5095c tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:01.827012 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f63bfdb8-eb18-4d94-8f1f-ac720ce5095c tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:01.829739 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f63bfdb8-eb18-4d94-8f1f-ac720ce5095c tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:01.829739 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f63bfdb8-eb18-4d94-8f1f-ac720ce5095c tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:01.829739 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f63bfdb8-eb18-4d94-8f1f-ac720ce5095c tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:01.829739 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f63bfdb8-eb18-4d94-8f1f-ac720ce5095c tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:01.964414 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f63bfdb8-eb18-4d94-8f1f-ac720ce5095c tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:01.974259 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f63bfdb8-eb18-4d94-8f1f-ac720ce5095c tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/f03fef0e-680b-45bd-87a9-a3df948181cf" status: 200 len: 1316 microversion: 2.1 time: 0.159857 Oct 19 03:17:01.974259 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 721/1383] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:01 2022] GET /compute/v2.1/servers/f03fef0e-680b-45bd-87a9-a3df948181cf => generated 1316 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:01.986400 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a731d4bf-b1c1-43e6-836e-d6c0ab9b5099 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:01.987139 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a731d4bf-b1c1-43e6-836e-d6c0ab9b5099 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] [instance: fef11301-8524-4f9b-bf6f-e525fca3237d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:01.993252 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a731d4bf-b1c1-43e6-836e-d6c0ab9b5099 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:01.994360 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a731d4bf-b1c1-43e6-836e-d6c0ab9b5099 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:01.994805 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a731d4bf-b1c1-43e6-836e-d6c0ab9b5099 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:01.995509 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a731d4bf-b1c1-43e6-836e-d6c0ab9b5099 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:01.995964 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a731d4bf-b1c1-43e6-836e-d6c0ab9b5099 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:01.996395 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a731d4bf-b1c1-43e6-836e-d6c0ab9b5099 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:02.019689 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d76483a2-2749-43e0-a63f-d48ec0208902 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] 10.222.0.52 "POST /compute/v2.1/servers/540a7025-b935-49fb-bc51-edf44ac1e0c4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.196389 Oct 19 03:17:02.026847 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 663/1384] 10.222.0.52 () {60 vars in 1323 bytes} [Wed Oct 19 03:16:59 2022] POST /compute/v2.1/servers/540a7025-b935-49fb-bc51-edf44ac1e0c4/os-volume_attachments => generated 194 bytes in 2199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:17:02.088472 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-591727f7-c81e-4d03-8e58-c29293faf626 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:02.089174 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-591727f7-c81e-4d03-8e58-c29293faf626 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:02.095489 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-591727f7-c81e-4d03-8e58-c29293faf626 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:02.096059 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-591727f7-c81e-4d03-8e58-c29293faf626 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:02.096505 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-591727f7-c81e-4d03-8e58-c29293faf626 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:02.097210 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-591727f7-c81e-4d03-8e58-c29293faf626 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:02.097694 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-591727f7-c81e-4d03-8e58-c29293faf626 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:02.098126 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-591727f7-c81e-4d03-8e58-c29293faf626 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:02.175225 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a731d4bf-b1c1-43e6-836e-d6c0ab9b5099 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c35b71372843d69f9a6c6be04b154f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcd49d68a3947249016cc5dbe910efc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:02.176853 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-591727f7-c81e-4d03-8e58-c29293faf626 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:02.183642 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a731d4bf-b1c1-43e6-836e-d6c0ab9b5099 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] 10.222.0.52 "GET /compute/v2.1/servers/fef11301-8524-4f9b-bf6f-e525fca3237d" status: 200 len: 1355 microversion: 2.1 time: 0.202085 Oct 19 03:17:02.184253 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 722/1385] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:01 2022] GET /compute/v2.1/servers/fef11301-8524-4f9b-bf6f-e525fca3237d => generated 1355 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:17:02.189129 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-591727f7-c81e-4d03-8e58-c29293faf626 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:02.192072 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-591727f7-c81e-4d03-8e58-c29293faf626 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:02.200965 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-591727f7-c81e-4d03-8e58-c29293faf626 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1540 microversion: 2.91 time: 0.116376 Oct 19 03:17:02.206217 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 664/1386] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:17:02 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1540 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:17:02.231630 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-53f8c85c-adf0-4c83-85de-7ea1aec9907e tempest-UnshelveToHostMultiNodesTest-1213824820 tempest-UnshelveToHostMultiNodesTest-1213824820-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h2-861333-8"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:17:02.234203 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-53f8c85c-adf0-4c83-85de-7ea1aec9907e tempest-UnshelveToHostMultiNodesTest-1213824820 tempest-UnshelveToHostMultiNodesTest-1213824820-project-admin] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:02.240308 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-53f8c85c-adf0-4c83-85de-7ea1aec9907e tempest-UnshelveToHostMultiNodesTest-1213824820 tempest-UnshelveToHostMultiNodesTest-1213824820-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:02.240793 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-53f8c85c-adf0-4c83-85de-7ea1aec9907e tempest-UnshelveToHostMultiNodesTest-1213824820 tempest-UnshelveToHostMultiNodesTest-1213824820-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:02.241233 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-53f8c85c-adf0-4c83-85de-7ea1aec9907e tempest-UnshelveToHostMultiNodesTest-1213824820 tempest-UnshelveToHostMultiNodesTest-1213824820-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:02.241949 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-53f8c85c-adf0-4c83-85de-7ea1aec9907e tempest-UnshelveToHostMultiNodesTest-1213824820 tempest-UnshelveToHostMultiNodesTest-1213824820-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:02.242400 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-53f8c85c-adf0-4c83-85de-7ea1aec9907e tempest-UnshelveToHostMultiNodesTest-1213824820 tempest-UnshelveToHostMultiNodesTest-1213824820-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:02.242826 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-53f8c85c-adf0-4c83-85de-7ea1aec9907e tempest-UnshelveToHostMultiNodesTest-1213824820 tempest-UnshelveToHostMultiNodesTest-1213824820-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:02.272757 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d2c60671-0d65-4272-96f9-88c0c6d3331d tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:02.273466 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d2c60671-0d65-4272-96f9-88c0c6d3331d tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 84774cfc-79b4-42db-acfd-c4daac86d196] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:02.279411 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d2c60671-0d65-4272-96f9-88c0c6d3331d tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:02.279894 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d2c60671-0d65-4272-96f9-88c0c6d3331d tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:02.280327 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d2c60671-0d65-4272-96f9-88c0c6d3331d tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:02.281050 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d2c60671-0d65-4272-96f9-88c0c6d3331d tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:02.281531 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d2c60671-0d65-4272-96f9-88c0c6d3331d tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:02.281955 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d2c60671-0d65-4272-96f9-88c0c6d3331d tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:02.292007 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-53f8c85c-adf0-4c83-85de-7ea1aec9907e tempest-UnshelveToHostMultiNodesTest-1213824820 tempest-UnshelveToHostMultiNodesTest-1213824820-project-admin] [instance: 84092951-cf52-4077-b954-0babab66565e] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h2-861333-8". {{(pid=121135) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 19 03:17:02.413591 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d2c60671-0d65-4272-96f9-88c0c6d3331d tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:02.421866 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d2c60671-0d65-4272-96f9-88c0c6d3331d tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196" status: 200 len: 1312 microversion: 2.1 time: 0.153446 Oct 19 03:17:02.423283 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 665/1387] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:02 2022] GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196 => generated 1312 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:02.426852 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-eb4a0eb0-49a1-44d5-aea7-29df4e081841 req-f5cce640-d8d9-4c49-8f7d-29e5d1bbae5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fef11301-8524-4f9b-bf6f-e525fca3237d", "name": "network-vif-plugged", "status": "completed", "tag": "5e4e8744-671e-4d44-b07b-fd602e080024"}, {"server_uuid": "fef11301-8524-4f9b-bf6f-e525fca3237d", "name": "network-vif-plugged", "status": "completed", "tag": "d48e4e1e-3f96-4bc7-948c-2124ef6f0ba5"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:17:02.436808 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-eb4a0eb0-49a1-44d5-aea7-29df4e081841 req-f5cce640-d8d9-4c49-8f7d-29e5d1bbae5d service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:02.437285 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-eb4a0eb0-49a1-44d5-aea7-29df4e081841 req-f5cce640-d8d9-4c49-8f7d-29e5d1bbae5d service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:02.437738 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-eb4a0eb0-49a1-44d5-aea7-29df4e081841 req-f5cce640-d8d9-4c49-8f7d-29e5d1bbae5d service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:02.449089 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-eb4a0eb0-49a1-44d5-aea7-29df4e081841 req-f5cce640-d8d9-4c49-8f7d-29e5d1bbae5d service nova] Creating event network-vif-plugged:5e4e8744-671e-4d44-b07b-fd602e080024 for instance fef11301-8524-4f9b-bf6f-e525fca3237d on n-h2-861333-8 Oct 19 03:17:02.449627 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-eb4a0eb0-49a1-44d5-aea7-29df4e081841 req-f5cce640-d8d9-4c49-8f7d-29e5d1bbae5d service nova] Creating event network-vif-plugged:d48e4e1e-3f96-4bc7-948c-2124ef6f0ba5 for instance fef11301-8524-4f9b-bf6f-e525fca3237d on n-h2-861333-8 Oct 19 03:17:02.454798 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-eb4a0eb0-49a1-44d5-aea7-29df4e081841 req-f5cce640-d8d9-4c49-8f7d-29e5d1bbae5d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031301 Oct 19 03:17:02.455374 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 666/1388] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:17:02 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:17:02.560774 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-53f8c85c-adf0-4c83-85de-7ea1aec9907e tempest-UnshelveToHostMultiNodesTest-1213824820 tempest-UnshelveToHostMultiNodesTest-1213824820-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e/action" status: 202 len: 0 microversion: 2.91 time: 0.333441 Oct 19 03:17:02.564902 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 723/1389] 10.222.0.52 () {62 vars in 1319 bytes} [Wed Oct 19 03:17:02 2022] POST /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e/action => generated 0 bytes in 335 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:17:02.571778 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-941875e7-39c7-476c-bbdd-d32138bbc7bf tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:02.572657 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-941875e7-39c7-476c-bbdd-d32138bbc7bf tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:02.581355 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-941875e7-39c7-476c-bbdd-d32138bbc7bf tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:02.581878 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-941875e7-39c7-476c-bbdd-d32138bbc7bf tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:02.582311 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-941875e7-39c7-476c-bbdd-d32138bbc7bf tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:02.583090 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-941875e7-39c7-476c-bbdd-d32138bbc7bf tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:02.583549 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-941875e7-39c7-476c-bbdd-d32138bbc7bf tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:02.583996 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-941875e7-39c7-476c-bbdd-d32138bbc7bf tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:02.657086 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-941875e7-39c7-476c-bbdd-d32138bbc7bf tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:02.668783 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-941875e7-39c7-476c-bbdd-d32138bbc7bf tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:02.670367 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-941875e7-39c7-476c-bbdd-d32138bbc7bf tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:02.677456 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-941875e7-39c7-476c-bbdd-d32138bbc7bf tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1548 microversion: 2.91 time: 0.110077 Oct 19 03:17:02.677456 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 667/1390] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:17:02 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1548 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:17:02.996243 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c03d275f-f4bf-44f4-9427-933f53089e6d tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:02.996870 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c03d275f-f4bf-44f4-9427-933f53089e6d tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: f03fef0e-680b-45bd-87a9-a3df948181cf] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:03.003132 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c03d275f-f4bf-44f4-9427-933f53089e6d tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:03.003621 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c03d275f-f4bf-44f4-9427-933f53089e6d tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:03.004084 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c03d275f-f4bf-44f4-9427-933f53089e6d tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:03.004760 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c03d275f-f4bf-44f4-9427-933f53089e6d tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:03.005312 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c03d275f-f4bf-44f4-9427-933f53089e6d tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:03.005769 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c03d275f-f4bf-44f4-9427-933f53089e6d tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:03.204642 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c03d275f-f4bf-44f4-9427-933f53089e6d tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:03.214167 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c03d275f-f4bf-44f4-9427-933f53089e6d tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/f03fef0e-680b-45bd-87a9-a3df948181cf" status: 200 len: 1316 microversion: 2.1 time: 0.221896 Oct 19 03:17:03.215003 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 724/1391] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:02 2022] GET /compute/v2.1/servers/f03fef0e-680b-45bd-87a9-a3df948181cf => generated 1316 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:03.225226 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-87578f6c-f497-44e3-88cd-b1a3984670bc tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:03.225226 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-87578f6c-f497-44e3-88cd-b1a3984670bc tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] [instance: fef11301-8524-4f9b-bf6f-e525fca3237d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:03.236965 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-87578f6c-f497-44e3-88cd-b1a3984670bc tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:03.237502 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-87578f6c-f497-44e3-88cd-b1a3984670bc tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:03.237947 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-87578f6c-f497-44e3-88cd-b1a3984670bc tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:03.238840 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-87578f6c-f497-44e3-88cd-b1a3984670bc tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:03.239329 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-87578f6c-f497-44e3-88cd-b1a3984670bc tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:03.239761 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-87578f6c-f497-44e3-88cd-b1a3984670bc tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:03.407799 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-87578f6c-f497-44e3-88cd-b1a3984670bc tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c35b71372843d69f9a6c6be04b154f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcd49d68a3947249016cc5dbe910efc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:03.417075 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-87578f6c-f497-44e3-88cd-b1a3984670bc tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] 10.222.0.52 "GET /compute/v2.1/servers/fef11301-8524-4f9b-bf6f-e525fca3237d" status: 200 len: 1355 microversion: 2.1 time: 0.204650 Oct 19 03:17:03.417701 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 668/1392] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:03 2022] GET /compute/v2.1/servers/fef11301-8524-4f9b-bf6f-e525fca3237d => generated 1355 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:17:03.444503 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-332c3354-dc84-4132-9131-d476cfc70535 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:03.445118 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-332c3354-dc84-4132-9131-d476cfc70535 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 84774cfc-79b4-42db-acfd-c4daac86d196] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:03.451244 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-332c3354-dc84-4132-9131-d476cfc70535 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:03.451733 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-332c3354-dc84-4132-9131-d476cfc70535 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:03.452174 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-332c3354-dc84-4132-9131-d476cfc70535 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:03.452870 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-332c3354-dc84-4132-9131-d476cfc70535 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:03.453554 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-332c3354-dc84-4132-9131-d476cfc70535 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:03.453986 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-332c3354-dc84-4132-9131-d476cfc70535 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:03.596818 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-332c3354-dc84-4132-9131-d476cfc70535 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:03.608344 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-332c3354-dc84-4132-9131-d476cfc70535 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196" status: 200 len: 1312 microversion: 2.1 time: 0.167695 Oct 19 03:17:03.609164 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 725/1393] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:03 2022] GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196 => generated 1312 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:03.704033 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ed0f72c4-b9eb-432a-a5f6-aee141094edf tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:03.704650 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ed0f72c4-b9eb-432a-a5f6-aee141094edf tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:03.711233 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ed0f72c4-b9eb-432a-a5f6-aee141094edf tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:03.711735 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ed0f72c4-b9eb-432a-a5f6-aee141094edf tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:03.712168 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ed0f72c4-b9eb-432a-a5f6-aee141094edf tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:03.713555 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ed0f72c4-b9eb-432a-a5f6-aee141094edf tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:03.714012 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ed0f72c4-b9eb-432a-a5f6-aee141094edf tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:03.714619 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ed0f72c4-b9eb-432a-a5f6-aee141094edf tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:03.782556 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ed0f72c4-b9eb-432a-a5f6-aee141094edf tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:03.791501 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ed0f72c4-b9eb-432a-a5f6-aee141094edf tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:03.792957 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ed0f72c4-b9eb-432a-a5f6-aee141094edf tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:03.798640 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ed0f72c4-b9eb-432a-a5f6-aee141094edf tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1490 microversion: 2.91 time: 0.098647 Oct 19 03:17:03.799235 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 669/1394] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:17:03 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1490 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:17:04.238957 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-935f8546-d3e3-48da-8f69-80806e536a5f tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:04.239562 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-935f8546-d3e3-48da-8f69-80806e536a5f tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: f03fef0e-680b-45bd-87a9-a3df948181cf] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:04.247164 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-935f8546-d3e3-48da-8f69-80806e536a5f tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:04.247664 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-935f8546-d3e3-48da-8f69-80806e536a5f tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:04.248132 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-935f8546-d3e3-48da-8f69-80806e536a5f tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:04.248874 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-935f8546-d3e3-48da-8f69-80806e536a5f tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:04.249616 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-935f8546-d3e3-48da-8f69-80806e536a5f tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:04.250221 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-935f8546-d3e3-48da-8f69-80806e536a5f tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:04.392582 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-935f8546-d3e3-48da-8f69-80806e536a5f tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:04.404877 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-935f8546-d3e3-48da-8f69-80806e536a5f tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/f03fef0e-680b-45bd-87a9-a3df948181cf" status: 200 len: 1316 microversion: 2.1 time: 0.170210 Oct 19 03:17:04.405750 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 726/1395] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:04 2022] GET /compute/v2.1/servers/f03fef0e-680b-45bd-87a9-a3df948181cf => generated 1316 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:04.438998 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-76e1cd78-f1cb-4f46-9732-53cde305e579 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:04.440189 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-76e1cd78-f1cb-4f46-9732-53cde305e579 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] [instance: fef11301-8524-4f9b-bf6f-e525fca3237d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:04.450205 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-76e1cd78-f1cb-4f46-9732-53cde305e579 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:04.453997 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-76e1cd78-f1cb-4f46-9732-53cde305e579 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:04.453997 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-76e1cd78-f1cb-4f46-9732-53cde305e579 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:04.453997 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-76e1cd78-f1cb-4f46-9732-53cde305e579 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:04.453997 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-76e1cd78-f1cb-4f46-9732-53cde305e579 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:04.454696 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-76e1cd78-f1cb-4f46-9732-53cde305e579 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:04.471388 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-484f1715-585d-4efa-90fa-b1d46cecfa88 req-8cbcf7ee-10ca-4af4-b152-3cc14b4a4866 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f03fef0e-680b-45bd-87a9-a3df948181cf", "name": "network-vif-plugged", "status": "completed", "tag": "6e9a5918-2f60-411c-8ab7-8e2f61d6894d"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:17:04.484472 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-484f1715-585d-4efa-90fa-b1d46cecfa88 req-8cbcf7ee-10ca-4af4-b152-3cc14b4a4866 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:04.485197 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-484f1715-585d-4efa-90fa-b1d46cecfa88 req-8cbcf7ee-10ca-4af4-b152-3cc14b4a4866 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:04.485854 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-484f1715-585d-4efa-90fa-b1d46cecfa88 req-8cbcf7ee-10ca-4af4-b152-3cc14b4a4866 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:04.510394 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-484f1715-585d-4efa-90fa-b1d46cecfa88 req-8cbcf7ee-10ca-4af4-b152-3cc14b4a4866 service nova] Creating event network-vif-plugged:6e9a5918-2f60-411c-8ab7-8e2f61d6894d for instance f03fef0e-680b-45bd-87a9-a3df948181cf on n-h2-861333-8 Oct 19 03:17:04.516157 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-484f1715-585d-4efa-90fa-b1d46cecfa88 req-8cbcf7ee-10ca-4af4-b152-3cc14b4a4866 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048722 Oct 19 03:17:04.516931 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 727/1396] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:17:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:17:04.611560 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-76e1cd78-f1cb-4f46-9732-53cde305e579 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c35b71372843d69f9a6c6be04b154f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcd49d68a3947249016cc5dbe910efc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:04.619979 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-76e1cd78-f1cb-4f46-9732-53cde305e579 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] 10.222.0.52 "GET /compute/v2.1/servers/fef11301-8524-4f9b-bf6f-e525fca3237d" status: 200 len: 1806 microversion: 2.1 time: 0.184780 Oct 19 03:17:04.620555 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 670/1397] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:04 2022] GET /compute/v2.1/servers/fef11301-8524-4f9b-bf6f-e525fca3237d => generated 1806 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:04.632054 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-df53b0d6-27f1-4362-a970-7e10b2beee45 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:04.632752 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-df53b0d6-27f1-4362-a970-7e10b2beee45 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 84774cfc-79b4-42db-acfd-c4daac86d196] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:04.643138 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-df53b0d6-27f1-4362-a970-7e10b2beee45 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:04.643621 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-df53b0d6-27f1-4362-a970-7e10b2beee45 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:04.644052 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-df53b0d6-27f1-4362-a970-7e10b2beee45 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:04.644182 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-97426ac7-5300-4f4c-b830-3a32ff97ca7a tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:04.644581 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-97426ac7-5300-4f4c-b830-3a32ff97ca7a tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] [instance: fef11301-8524-4f9b-bf6f-e525fca3237d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:04.644741 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-df53b0d6-27f1-4362-a970-7e10b2beee45 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:04.645188 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-df53b0d6-27f1-4362-a970-7e10b2beee45 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:04.645696 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-df53b0d6-27f1-4362-a970-7e10b2beee45 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:04.650602 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-97426ac7-5300-4f4c-b830-3a32ff97ca7a tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:04.651084 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-97426ac7-5300-4f4c-b830-3a32ff97ca7a tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:04.651696 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-97426ac7-5300-4f4c-b830-3a32ff97ca7a tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:04.652396 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-97426ac7-5300-4f4c-b830-3a32ff97ca7a tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:04.652851 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-97426ac7-5300-4f4c-b830-3a32ff97ca7a tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:04.653279 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-97426ac7-5300-4f4c-b830-3a32ff97ca7a tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:04.678876 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-97426ac7-5300-4f4c-b830-3a32ff97ca7a tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] 10.222.0.52 "GET /compute/v2.1/servers/fef11301-8524-4f9b-bf6f-e525fca3237d/ips" status: 200 len: 219 microversion: 2.1 time: 0.038563 Oct 19 03:17:04.679469 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 671/1398] 10.222.0.52 () {58 vars in 1248 bytes} [Wed Oct 19 03:17:04 2022] GET /compute/v2.1/servers/fef11301-8524-4f9b-bf6f-e525fca3237d/ips => generated 219 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:17:04.694460 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-06f25eb3-ef1c-4509-8778-33a98dcce9da tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:04.694460 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-06f25eb3-ef1c-4509-8778-33a98dcce9da tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] [instance: fef11301-8524-4f9b-bf6f-e525fca3237d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:04.700233 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-06f25eb3-ef1c-4509-8778-33a98dcce9da tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:04.700741 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-06f25eb3-ef1c-4509-8778-33a98dcce9da tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:04.701415 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-06f25eb3-ef1c-4509-8778-33a98dcce9da tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:04.702295 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-06f25eb3-ef1c-4509-8778-33a98dcce9da tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:04.702770 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-06f25eb3-ef1c-4509-8778-33a98dcce9da tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:04.703208 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-06f25eb3-ef1c-4509-8778-33a98dcce9da tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:04.720158 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:17:04.733254 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-06f25eb3-ef1c-4509-8778-33a98dcce9da tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] [instance: fef11301-8524-4f9b-bf6f-e525fca3237d] Going to try to terminate instance {{(pid=121134) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:17:04.820440 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-df53b0d6-27f1-4362-a970-7e10b2beee45 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:04.828814 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-df53b0d6-27f1-4362-a970-7e10b2beee45 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196" status: 200 len: 1312 microversion: 2.1 time: 0.201059 Oct 19 03:17:04.830147 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 728/1399] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:04 2022] GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196 => generated 1312 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:04.835683 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b24a7ce9-341c-4119-9bcb-4e208c178478 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:04.836561 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b24a7ce9-341c-4119-9bcb-4e208c178478 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:04.843498 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b24a7ce9-341c-4119-9bcb-4e208c178478 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:04.844187 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b24a7ce9-341c-4119-9bcb-4e208c178478 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:04.845114 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b24a7ce9-341c-4119-9bcb-4e208c178478 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:04.845852 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b24a7ce9-341c-4119-9bcb-4e208c178478 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:04.848062 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b24a7ce9-341c-4119-9bcb-4e208c178478 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:04.848515 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b24a7ce9-341c-4119-9bcb-4e208c178478 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:05.112723 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-06f25eb3-ef1c-4509-8778-33a98dcce9da tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] 10.222.0.52 "DELETE /compute/v2.1/servers/fef11301-8524-4f9b-bf6f-e525fca3237d" status: 204 len: 0 microversion: 2.1 time: 0.424406 Oct 19 03:17:05.114004 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 672/1400] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:17:04 2022] DELETE /compute/v2.1/servers/fef11301-8524-4f9b-bf6f-e525fca3237d => generated 0 bytes in 427 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 19 03:17:05.126593 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7e995455-b5e2-4bbb-a503-c3b6fc7d6d1f tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:05.127801 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7e995455-b5e2-4bbb-a503-c3b6fc7d6d1f tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] [instance: fef11301-8524-4f9b-bf6f-e525fca3237d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:05.135824 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7e995455-b5e2-4bbb-a503-c3b6fc7d6d1f tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:05.136562 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7e995455-b5e2-4bbb-a503-c3b6fc7d6d1f tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:05.137204 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7e995455-b5e2-4bbb-a503-c3b6fc7d6d1f tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:05.138245 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7e995455-b5e2-4bbb-a503-c3b6fc7d6d1f tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:05.139571 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7e995455-b5e2-4bbb-a503-c3b6fc7d6d1f tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:05.140209 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7e995455-b5e2-4bbb-a503-c3b6fc7d6d1f tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:05.209244 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b24a7ce9-341c-4119-9bcb-4e208c178478 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:05.221156 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b24a7ce9-341c-4119-9bcb-4e208c178478 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:05.223198 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b24a7ce9-341c-4119-9bcb-4e208c178478 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:05.228266 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:17:05.230653 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b24a7ce9-341c-4119-9bcb-4e208c178478 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1546 microversion: 2.91 time: 0.398998 Oct 19 03:17:05.266015 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 729/1401] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:17:04 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1546 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:17:05.334561 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-7e995455-b5e2-4bbb-a503-c3b6fc7d6d1f tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c35b71372843d69f9a6c6be04b154f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcd49d68a3947249016cc5dbe910efc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:05.343307 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7e995455-b5e2-4bbb-a503-c3b6fc7d6d1f tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] 10.222.0.52 "GET /compute/v2.1/servers/fef11301-8524-4f9b-bf6f-e525fca3237d" status: 200 len: 1812 microversion: 2.1 time: 0.222960 Oct 19 03:17:05.344121 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 673/1402] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:05 2022] GET /compute/v2.1/servers/fef11301-8524-4f9b-bf6f-e525fca3237d => generated 1812 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:05.428225 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e5b0a150-bec6-492a-b4e3-c737412e5db3 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:05.428982 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e5b0a150-bec6-492a-b4e3-c737412e5db3 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: f03fef0e-680b-45bd-87a9-a3df948181cf] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:05.436069 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e5b0a150-bec6-492a-b4e3-c737412e5db3 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:05.436716 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e5b0a150-bec6-492a-b4e3-c737412e5db3 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:05.437153 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e5b0a150-bec6-492a-b4e3-c737412e5db3 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:05.437883 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e5b0a150-bec6-492a-b4e3-c737412e5db3 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:05.438332 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e5b0a150-bec6-492a-b4e3-c737412e5db3 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:05.438754 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e5b0a150-bec6-492a-b4e3-c737412e5db3 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:05.575129 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-e5b0a150-bec6-492a-b4e3-c737412e5db3 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:05.578699 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:17:05.583460 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e5b0a150-bec6-492a-b4e3-c737412e5db3 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/f03fef0e-680b-45bd-87a9-a3df948181cf" status: 200 len: 1316 microversion: 2.1 time: 0.159219 Oct 19 03:17:05.584046 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 730/1403] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:05 2022] GET /compute/v2.1/servers/f03fef0e-680b-45bd-87a9-a3df948181cf => generated 1316 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:05.854298 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-bbce8a67-08fc-4873-960f-db5fcb3bd0e5 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:05.854857 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-bbce8a67-08fc-4873-960f-db5fcb3bd0e5 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 84774cfc-79b4-42db-acfd-c4daac86d196] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:05.861803 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bbce8a67-08fc-4873-960f-db5fcb3bd0e5 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:05.862283 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bbce8a67-08fc-4873-960f-db5fcb3bd0e5 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:05.862721 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bbce8a67-08fc-4873-960f-db5fcb3bd0e5 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:05.863412 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bbce8a67-08fc-4873-960f-db5fcb3bd0e5 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:05.863867 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bbce8a67-08fc-4873-960f-db5fcb3bd0e5 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:05.864286 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bbce8a67-08fc-4873-960f-db5fcb3bd0e5 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:05.998239 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-bbce8a67-08fc-4873-960f-db5fcb3bd0e5 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:06.005848 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-bbce8a67-08fc-4873-960f-db5fcb3bd0e5 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196" status: 200 len: 1312 microversion: 2.1 time: 0.155578 Oct 19 03:17:06.006450 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 674/1404] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:05 2022] GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196 => generated 1312 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:06.268381 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ab0e36aa-4c92-4e38-ba0c-ddb60ab49b69 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:06.268988 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ab0e36aa-4c92-4e38-ba0c-ddb60ab49b69 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:06.276112 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ab0e36aa-4c92-4e38-ba0c-ddb60ab49b69 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:06.276613 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ab0e36aa-4c92-4e38-ba0c-ddb60ab49b69 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:06.277044 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ab0e36aa-4c92-4e38-ba0c-ddb60ab49b69 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:06.277751 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ab0e36aa-4c92-4e38-ba0c-ddb60ab49b69 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:06.278201 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ab0e36aa-4c92-4e38-ba0c-ddb60ab49b69 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:06.278623 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ab0e36aa-4c92-4e38-ba0c-ddb60ab49b69 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:06.354327 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ab0e36aa-4c92-4e38-ba0c-ddb60ab49b69 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:06.363721 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ab0e36aa-4c92-4e38-ba0c-ddb60ab49b69 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:06.365690 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ab0e36aa-4c92-4e38-ba0c-ddb60ab49b69 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:06.369424 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ebdc576b-a08b-4108-97b0-12266695a1d0 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:06.370568 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ebdc576b-a08b-4108-97b0-12266695a1d0 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] [instance: fef11301-8524-4f9b-bf6f-e525fca3237d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:06.373223 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ab0e36aa-4c92-4e38-ba0c-ddb60ab49b69 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1546 microversion: 2.91 time: 0.108262 Oct 19 03:17:06.374836 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 731/1405] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:17:06 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1546 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:17:06.378592 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ebdc576b-a08b-4108-97b0-12266695a1d0 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:06.379243 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ebdc576b-a08b-4108-97b0-12266695a1d0 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:06.379825 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ebdc576b-a08b-4108-97b0-12266695a1d0 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:06.380641 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ebdc576b-a08b-4108-97b0-12266695a1d0 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:06.381203 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ebdc576b-a08b-4108-97b0-12266695a1d0 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:06.381778 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ebdc576b-a08b-4108-97b0-12266695a1d0 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:06.532794 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-5ba2e9e5-fc00-4a80-82b9-fecef69dd395 req-c61ad0d0-9421-437a-b6bf-455e60a97044 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84774cfc-79b4-42db-acfd-c4daac86d196", "name": "network-vif-plugged", "status": "completed", "tag": "349ffeb3-81a2-44f2-9775-65ddf0c3a896"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:17:06.548509 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-5ba2e9e5-fc00-4a80-82b9-fecef69dd395 req-c61ad0d0-9421-437a-b6bf-455e60a97044 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:06.550755 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-5ba2e9e5-fc00-4a80-82b9-fecef69dd395 req-c61ad0d0-9421-437a-b6bf-455e60a97044 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:06.551388 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-5ba2e9e5-fc00-4a80-82b9-fecef69dd395 req-c61ad0d0-9421-437a-b6bf-455e60a97044 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:06.570515 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-5ba2e9e5-fc00-4a80-82b9-fecef69dd395 req-c61ad0d0-9421-437a-b6bf-455e60a97044 service nova] Creating event network-vif-plugged:349ffeb3-81a2-44f2-9775-65ddf0c3a896 for instance 84774cfc-79b4-42db-acfd-c4daac86d196 on n-h1-861333-8 Oct 19 03:17:06.576182 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-5ba2e9e5-fc00-4a80-82b9-fecef69dd395 req-c61ad0d0-9421-437a-b6bf-455e60a97044 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046842 Oct 19 03:17:06.579866 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 732/1406] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:17:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:17:06.596417 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ebdc576b-a08b-4108-97b0-12266695a1d0 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c35b71372843d69f9a6c6be04b154f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcd49d68a3947249016cc5dbe910efc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:06.607429 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ebdc576b-a08b-4108-97b0-12266695a1d0 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] 10.222.0.52 "GET /compute/v2.1/servers/fef11301-8524-4f9b-bf6f-e525fca3237d" status: 200 len: 1812 microversion: 2.1 time: 0.244062 Oct 19 03:17:06.617465 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a0e1829b-a0cd-4e93-bb82-aba460bf058d tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:06.617650 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 675/1407] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:06 2022] GET /compute/v2.1/servers/fef11301-8524-4f9b-bf6f-e525fca3237d => generated 1812 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:06.617755 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a0e1829b-a0cd-4e93-bb82-aba460bf058d tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: f03fef0e-680b-45bd-87a9-a3df948181cf] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:06.617755 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a0e1829b-a0cd-4e93-bb82-aba460bf058d tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:06.617755 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a0e1829b-a0cd-4e93-bb82-aba460bf058d tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:06.617755 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a0e1829b-a0cd-4e93-bb82-aba460bf058d tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:06.621453 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a0e1829b-a0cd-4e93-bb82-aba460bf058d tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:06.621453 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a0e1829b-a0cd-4e93-bb82-aba460bf058d tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:06.621453 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a0e1829b-a0cd-4e93-bb82-aba460bf058d tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:06.778826 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a0e1829b-a0cd-4e93-bb82-aba460bf058d tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:06.787139 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a0e1829b-a0cd-4e93-bb82-aba460bf058d tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/f03fef0e-680b-45bd-87a9-a3df948181cf" status: 200 len: 1316 microversion: 2.1 time: 0.184244 Oct 19 03:17:06.787713 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 733/1408] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:06 2022] GET /compute/v2.1/servers/f03fef0e-680b-45bd-87a9-a3df948181cf => generated 1316 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:17:07.028628 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ef330658-b0b2-4e40-892e-48b6a7de41e1 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:07.029953 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ef330658-b0b2-4e40-892e-48b6a7de41e1 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 84774cfc-79b4-42db-acfd-c4daac86d196] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:07.039189 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ef330658-b0b2-4e40-892e-48b6a7de41e1 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:07.042571 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ef330658-b0b2-4e40-892e-48b6a7de41e1 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:07.043072 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ef330658-b0b2-4e40-892e-48b6a7de41e1 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:07.043802 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ef330658-b0b2-4e40-892e-48b6a7de41e1 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:07.044267 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ef330658-b0b2-4e40-892e-48b6a7de41e1 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:07.044691 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ef330658-b0b2-4e40-892e-48b6a7de41e1 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:07.246815 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ef330658-b0b2-4e40-892e-48b6a7de41e1 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:07.255795 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ef330658-b0b2-4e40-892e-48b6a7de41e1 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196" status: 200 len: 1312 microversion: 2.1 time: 0.231352 Oct 19 03:17:07.256789 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 676/1409] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:07 2022] GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196 => generated 1312 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:07.402236 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-fe502ad0-d6bf-41fb-8b4c-ba09cdd5985d tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:07.402887 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-fe502ad0-d6bf-41fb-8b4c-ba09cdd5985d tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:07.417298 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fe502ad0-d6bf-41fb-8b4c-ba09cdd5985d tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:07.418033 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fe502ad0-d6bf-41fb-8b4c-ba09cdd5985d tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:07.418272 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fe502ad0-d6bf-41fb-8b4c-ba09cdd5985d tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:07.418989 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fe502ad0-d6bf-41fb-8b4c-ba09cdd5985d tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:07.419441 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fe502ad0-d6bf-41fb-8b4c-ba09cdd5985d tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:07.419864 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fe502ad0-d6bf-41fb-8b4c-ba09cdd5985d tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:07.540091 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-fe502ad0-d6bf-41fb-8b4c-ba09cdd5985d tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:07.551461 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-fe502ad0-d6bf-41fb-8b4c-ba09cdd5985d tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:07.553115 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-fe502ad0-d6bf-41fb-8b4c-ba09cdd5985d tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:07.559285 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-fe502ad0-d6bf-41fb-8b4c-ba09cdd5985d tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1546 microversion: 2.91 time: 0.161795 Oct 19 03:17:07.560740 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 734/1410] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:17:07 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1546 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:17:07.633095 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-efe7861a-046b-4569-bdb0-41b2994a9656 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:07.634249 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-efe7861a-046b-4569-bdb0-41b2994a9656 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] [instance: fef11301-8524-4f9b-bf6f-e525fca3237d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:07.642124 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-efe7861a-046b-4569-bdb0-41b2994a9656 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:07.642532 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-efe7861a-046b-4569-bdb0-41b2994a9656 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:07.642966 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-efe7861a-046b-4569-bdb0-41b2994a9656 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:07.643666 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-efe7861a-046b-4569-bdb0-41b2994a9656 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:07.644115 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-efe7861a-046b-4569-bdb0-41b2994a9656 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:07.644538 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-efe7861a-046b-4569-bdb0-41b2994a9656 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:07.810283 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2537559e-acc3-4f2b-a6c9-cbc1e82d83d8 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:07.811195 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-2537559e-acc3-4f2b-a6c9-cbc1e82d83d8 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: f03fef0e-680b-45bd-87a9-a3df948181cf] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:07.821750 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2537559e-acc3-4f2b-a6c9-cbc1e82d83d8 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:07.822674 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2537559e-acc3-4f2b-a6c9-cbc1e82d83d8 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:07.823382 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2537559e-acc3-4f2b-a6c9-cbc1e82d83d8 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:07.824325 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2537559e-acc3-4f2b-a6c9-cbc1e82d83d8 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:07.825003 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2537559e-acc3-4f2b-a6c9-cbc1e82d83d8 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:07.825728 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2537559e-acc3-4f2b-a6c9-cbc1e82d83d8 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:07.848016 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-efe7861a-046b-4569-bdb0-41b2994a9656 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c35b71372843d69f9a6c6be04b154f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcd49d68a3947249016cc5dbe910efc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:07.856706 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-efe7861a-046b-4569-bdb0-41b2994a9656 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] 10.222.0.52 "GET /compute/v2.1/servers/fef11301-8524-4f9b-bf6f-e525fca3237d" status: 200 len: 1812 microversion: 2.1 time: 0.228157 Oct 19 03:17:07.874024 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 677/1411] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:07 2022] GET /compute/v2.1/servers/fef11301-8524-4f9b-bf6f-e525fca3237d => generated 1812 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:07.991064 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-2537559e-acc3-4f2b-a6c9-cbc1e82d83d8 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:08.003515 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2537559e-acc3-4f2b-a6c9-cbc1e82d83d8 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/f03fef0e-680b-45bd-87a9-a3df948181cf" status: 200 len: 1316 microversion: 2.1 time: 0.197193 Oct 19 03:17:08.010178 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 735/1412] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:07 2022] GET /compute/v2.1/servers/f03fef0e-680b-45bd-87a9-a3df948181cf => generated 1316 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:17:08.287630 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7c196f83-e089-47bd-aa4e-cae93a89d89c tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:08.289075 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7c196f83-e089-47bd-aa4e-cae93a89d89c tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 84774cfc-79b4-42db-acfd-c4daac86d196] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:08.301833 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7c196f83-e089-47bd-aa4e-cae93a89d89c tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:08.302340 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7c196f83-e089-47bd-aa4e-cae93a89d89c tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:08.302796 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7c196f83-e089-47bd-aa4e-cae93a89d89c tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:08.303529 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7c196f83-e089-47bd-aa4e-cae93a89d89c tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:08.303992 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7c196f83-e089-47bd-aa4e-cae93a89d89c tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:08.304429 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7c196f83-e089-47bd-aa4e-cae93a89d89c tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:08.460644 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-7c196f83-e089-47bd-aa4e-cae93a89d89c tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:08.468993 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7c196f83-e089-47bd-aa4e-cae93a89d89c tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196" status: 200 len: 1312 microversion: 2.1 time: 0.186446 Oct 19 03:17:08.469811 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 678/1413] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:08 2022] GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196 => generated 1312 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:08.589205 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b70a630a-d19e-4971-b1c3-a6a06733da1a tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:08.591543 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b70a630a-d19e-4971-b1c3-a6a06733da1a tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:08.600741 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b70a630a-d19e-4971-b1c3-a6a06733da1a tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:08.601754 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b70a630a-d19e-4971-b1c3-a6a06733da1a tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:08.602376 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b70a630a-d19e-4971-b1c3-a6a06733da1a tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:08.603434 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b70a630a-d19e-4971-b1c3-a6a06733da1a tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:08.603901 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b70a630a-d19e-4971-b1c3-a6a06733da1a tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:08.604351 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b70a630a-d19e-4971-b1c3-a6a06733da1a tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:08.681882 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b70a630a-d19e-4971-b1c3-a6a06733da1a tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:08.690829 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b70a630a-d19e-4971-b1c3-a6a06733da1a tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:08.692262 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b70a630a-d19e-4971-b1c3-a6a06733da1a tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:08.698465 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b70a630a-d19e-4971-b1c3-a6a06733da1a tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1546 microversion: 2.91 time: 0.113142 Oct 19 03:17:08.699354 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 736/1414] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:17:08 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1546 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:17:08.889087 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9a0c6150-eb5d-4843-bed3-d61618e982b0 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:08.890086 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9a0c6150-eb5d-4843-bed3-d61618e982b0 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] [instance: fef11301-8524-4f9b-bf6f-e525fca3237d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:08.896787 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9a0c6150-eb5d-4843-bed3-d61618e982b0 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:08.897407 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9a0c6150-eb5d-4843-bed3-d61618e982b0 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:08.897837 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9a0c6150-eb5d-4843-bed3-d61618e982b0 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:08.898543 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9a0c6150-eb5d-4843-bed3-d61618e982b0 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:08.899022 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9a0c6150-eb5d-4843-bed3-d61618e982b0 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:08.899417 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9a0c6150-eb5d-4843-bed3-d61618e982b0 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:09.027255 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1c33ca77-d8d6-49e4-84d5-16266089c903 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:09.028174 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1c33ca77-d8d6-49e4-84d5-16266089c903 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: f03fef0e-680b-45bd-87a9-a3df948181cf] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:09.035831 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1c33ca77-d8d6-49e4-84d5-16266089c903 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:09.037329 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1c33ca77-d8d6-49e4-84d5-16266089c903 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:09.038038 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1c33ca77-d8d6-49e4-84d5-16266089c903 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:09.039094 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1c33ca77-d8d6-49e4-84d5-16266089c903 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:09.040805 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1c33ca77-d8d6-49e4-84d5-16266089c903 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:09.041253 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1c33ca77-d8d6-49e4-84d5-16266089c903 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:09.087502 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9a0c6150-eb5d-4843-bed3-d61618e982b0 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c35b71372843d69f9a6c6be04b154f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcd49d68a3947249016cc5dbe910efc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:09.097511 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9a0c6150-eb5d-4843-bed3-d61618e982b0 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] 10.222.0.52 "GET /compute/v2.1/servers/fef11301-8524-4f9b-bf6f-e525fca3237d" status: 200 len: 1812 microversion: 2.1 time: 0.213825 Oct 19 03:17:09.109422 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 679/1415] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:08 2022] GET /compute/v2.1/servers/fef11301-8524-4f9b-bf6f-e525fca3237d => generated 1812 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:09.109422 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b4133821-dd31-4126-9105-f47589716684 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:09.109422 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b4133821-dd31-4126-9105-f47589716684 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] [instance: 6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:09.115479 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b4133821-dd31-4126-9105-f47589716684 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:09.116629 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b4133821-dd31-4126-9105-f47589716684 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:09.117628 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b4133821-dd31-4126-9105-f47589716684 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:09.119255 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b4133821-dd31-4126-9105-f47589716684 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:09.119924 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b4133821-dd31-4126-9105-f47589716684 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:09.120630 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b4133821-dd31-4126-9105-f47589716684 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:09.160984 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b4133821-dd31-4126-9105-f47589716684 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] [instance: 6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1] Going to try to terminate instance {{(pid=121134) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:17:09.238901 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-1c33ca77-d8d6-49e4-84d5-16266089c903 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:09.248620 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1c33ca77-d8d6-49e4-84d5-16266089c903 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/f03fef0e-680b-45bd-87a9-a3df948181cf" status: 200 len: 1316 microversion: 2.1 time: 0.225207 Oct 19 03:17:09.257077 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 737/1416] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:09 2022] GET /compute/v2.1/servers/f03fef0e-680b-45bd-87a9-a3df948181cf => generated 1316 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:09.494166 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-78c52c68-ebad-4df4-9021-4ab3bff4a75f tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:09.494897 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-78c52c68-ebad-4df4-9021-4ab3bff4a75f tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 84774cfc-79b4-42db-acfd-c4daac86d196] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:09.501409 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-78c52c68-ebad-4df4-9021-4ab3bff4a75f tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:09.502909 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-78c52c68-ebad-4df4-9021-4ab3bff4a75f tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:09.502909 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-78c52c68-ebad-4df4-9021-4ab3bff4a75f tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:09.503203 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-78c52c68-ebad-4df4-9021-4ab3bff4a75f tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:09.503911 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-78c52c68-ebad-4df4-9021-4ab3bff4a75f tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:09.504432 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-78c52c68-ebad-4df4-9021-4ab3bff4a75f tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:09.564245 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b4133821-dd31-4126-9105-f47589716684 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] 10.222.0.52 "DELETE /compute/v2.1/servers/6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1" status: 204 len: 0 microversion: 2.1 time: 0.464177 Oct 19 03:17:09.565941 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 680/1417] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:17:09 2022] DELETE /compute/v2.1/servers/6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:17:09.577675 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f35a8bba-a14e-4589-8032-7fe298b0b2ff tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:09.579777 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f35a8bba-a14e-4589-8032-7fe298b0b2ff tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] [instance: 6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:09.586104 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f35a8bba-a14e-4589-8032-7fe298b0b2ff tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:09.586828 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f35a8bba-a14e-4589-8032-7fe298b0b2ff tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:09.587997 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f35a8bba-a14e-4589-8032-7fe298b0b2ff tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:09.589029 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f35a8bba-a14e-4589-8032-7fe298b0b2ff tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:09.589683 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f35a8bba-a14e-4589-8032-7fe298b0b2ff tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:09.590300 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f35a8bba-a14e-4589-8032-7fe298b0b2ff tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:09.754431 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-78c52c68-ebad-4df4-9021-4ab3bff4a75f tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:09.754431 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-78c52c68-ebad-4df4-9021-4ab3bff4a75f tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196" status: 200 len: 1461 microversion: 2.1 time: 0.263877 Oct 19 03:17:09.755041 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 738/1418] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:09 2022] GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196 => generated 1461 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:17:09.760466 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3acc7ddb-1abe-4136-b7fb-669213720d35 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:09.761072 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-3acc7ddb-1abe-4136-b7fb-669213720d35 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:09.768281 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3acc7ddb-1abe-4136-b7fb-669213720d35 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:09.768281 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3acc7ddb-1abe-4136-b7fb-669213720d35 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:09.768281 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3acc7ddb-1abe-4136-b7fb-669213720d35 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:09.768742 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3acc7ddb-1abe-4136-b7fb-669213720d35 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:09.769112 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3acc7ddb-1abe-4136-b7fb-669213720d35 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:09.769569 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3acc7ddb-1abe-4136-b7fb-669213720d35 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:09.801540 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-f35a8bba-a14e-4589-8032-7fe298b0b2ff tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cc37ae4bed94a7e85ed70dd5942c2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df99b134b20743eb9b62788706f2705a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:09.807329 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f35a8bba-a14e-4589-8032-7fe298b0b2ff tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] 10.222.0.52 "GET /compute/v2.1/servers/6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1" status: 200 len: 1712 microversion: 2.1 time: 0.236376 Oct 19 03:17:09.808226 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 681/1419] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:09 2022] GET /compute/v2.1/servers/6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1 => generated 1712 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:09.822606 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-128d25cb-def3-4567-aa86-12010c8446db tempest-MigrationsAdminTest-1230104219 tempest-MigrationsAdminTest-1230104219-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:09.823312 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-128d25cb-def3-4567-aa86-12010c8446db tempest-MigrationsAdminTest-1230104219 tempest-MigrationsAdminTest-1230104219-project-admin] [instance: 84774cfc-79b4-42db-acfd-c4daac86d196] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:09.836035 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-128d25cb-def3-4567-aa86-12010c8446db tempest-MigrationsAdminTest-1230104219 tempest-MigrationsAdminTest-1230104219-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:09.836546 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-128d25cb-def3-4567-aa86-12010c8446db tempest-MigrationsAdminTest-1230104219 tempest-MigrationsAdminTest-1230104219-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:09.836992 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-128d25cb-def3-4567-aa86-12010c8446db tempest-MigrationsAdminTest-1230104219 tempest-MigrationsAdminTest-1230104219-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:09.838301 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-128d25cb-def3-4567-aa86-12010c8446db tempest-MigrationsAdminTest-1230104219 tempest-MigrationsAdminTest-1230104219-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:09.838764 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-128d25cb-def3-4567-aa86-12010c8446db tempest-MigrationsAdminTest-1230104219 tempest-MigrationsAdminTest-1230104219-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:09.839201 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-128d25cb-def3-4567-aa86-12010c8446db tempest-MigrationsAdminTest-1230104219 tempest-MigrationsAdminTest-1230104219-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:09.868637 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-3acc7ddb-1abe-4136-b7fb-669213720d35 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:09.877555 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-3acc7ddb-1abe-4136-b7fb-669213720d35 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:09.879081 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-3acc7ddb-1abe-4136-b7fb-669213720d35 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:09.884971 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-3acc7ddb-1abe-4136-b7fb-669213720d35 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1546 microversion: 2.91 time: 0.129206 Oct 19 03:17:09.897392 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 739/1420] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:17:09 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1546 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:17:09.990380 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-128d25cb-def3-4567-aa86-12010c8446db tempest-MigrationsAdminTest-1230104219 tempest-MigrationsAdminTest-1230104219-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196" status: 200 len: 1612 microversion: 2.1 time: 0.181306 Oct 19 03:17:09.991185 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 682/1421] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:09 2022] GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196 => generated 1612 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:10.014664 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1df75d66-a702-42d1-9acd-0498d9f5b4d9 tempest-MigrationsAdminTest-1230104219 tempest-MigrationsAdminTest-1230104219-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:17:10.015594 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1df75d66-a702-42d1-9acd-0498d9f5b4d9 tempest-MigrationsAdminTest-1230104219 tempest-MigrationsAdminTest-1230104219-project-admin] [instance: 84774cfc-79b4-42db-acfd-c4daac86d196] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:10.021893 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1df75d66-a702-42d1-9acd-0498d9f5b4d9 tempest-MigrationsAdminTest-1230104219 tempest-MigrationsAdminTest-1230104219-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:10.022548 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1df75d66-a702-42d1-9acd-0498d9f5b4d9 tempest-MigrationsAdminTest-1230104219 tempest-MigrationsAdminTest-1230104219-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:10.022989 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1df75d66-a702-42d1-9acd-0498d9f5b4d9 tempest-MigrationsAdminTest-1230104219 tempest-MigrationsAdminTest-1230104219-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:10.023690 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1df75d66-a702-42d1-9acd-0498d9f5b4d9 tempest-MigrationsAdminTest-1230104219 tempest-MigrationsAdminTest-1230104219-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:10.024140 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1df75d66-a702-42d1-9acd-0498d9f5b4d9 tempest-MigrationsAdminTest-1230104219 tempest-MigrationsAdminTest-1230104219-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:10.025152 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1df75d66-a702-42d1-9acd-0498d9f5b4d9 tempest-MigrationsAdminTest-1230104219 tempest-MigrationsAdminTest-1230104219-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:10.118221 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-1df75d66-a702-42d1-9acd-0498d9f5b4d9 tempest-MigrationsAdminTest-1230104219 tempest-MigrationsAdminTest-1230104219-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '19bac702de0146aa9483ed5574fe985a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca11bf1ab70142709ff1fd106df02ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:10.119376 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1df75d66-a702-42d1-9acd-0498d9f5b4d9 tempest-MigrationsAdminTest-1230104219 tempest-MigrationsAdminTest-1230104219-project-admin] [instance: 84774cfc-79b4-42db-acfd-c4daac86d196] flavor_id is None. Assuming migration. {{(pid=121135) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 19 03:17:10.119811 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1df75d66-a702-42d1-9acd-0498d9f5b4d9 tempest-MigrationsAdminTest-1230104219 tempest-MigrationsAdminTest-1230104219-project-admin] [instance: 84774cfc-79b4-42db-acfd-c4daac86d196] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=121135) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 19 03:17:10.145010 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2d379acd-11a7-4d46-b432-cf9a6bd1a713 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:10.146013 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2d379acd-11a7-4d46-b432-cf9a6bd1a713 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] [instance: fef11301-8524-4f9b-bf6f-e525fca3237d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:10.152799 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2d379acd-11a7-4d46-b432-cf9a6bd1a713 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:10.153575 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2d379acd-11a7-4d46-b432-cf9a6bd1a713 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:10.154197 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2d379acd-11a7-4d46-b432-cf9a6bd1a713 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:10.155067 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2d379acd-11a7-4d46-b432-cf9a6bd1a713 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:10.155665 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2d379acd-11a7-4d46-b432-cf9a6bd1a713 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:10.156245 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2d379acd-11a7-4d46-b432-cf9a6bd1a713 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:10.335618 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-2d379acd-11a7-4d46-b432-cf9a6bd1a713 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c35b71372843d69f9a6c6be04b154f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcd49d68a3947249016cc5dbe910efc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:10.343887 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2d379acd-11a7-4d46-b432-cf9a6bd1a713 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] 10.222.0.52 "GET /compute/v2.1/servers/fef11301-8524-4f9b-bf6f-e525fca3237d" status: 200 len: 1812 microversion: 2.1 time: 0.202538 Oct 19 03:17:10.344494 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 683/1422] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:10 2022] GET /compute/v2.1/servers/fef11301-8524-4f9b-bf6f-e525fca3237d => generated 1812 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:17:10.349063 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b9e32eb9-7335-419e-a23e-1c2e4b346f77 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:10.349796 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b9e32eb9-7335-419e-a23e-1c2e4b346f77 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: f03fef0e-680b-45bd-87a9-a3df948181cf] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:10.358387 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b9e32eb9-7335-419e-a23e-1c2e4b346f77 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:10.359111 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b9e32eb9-7335-419e-a23e-1c2e4b346f77 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:10.359588 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b9e32eb9-7335-419e-a23e-1c2e4b346f77 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:10.360295 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b9e32eb9-7335-419e-a23e-1c2e4b346f77 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:10.360809 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b9e32eb9-7335-419e-a23e-1c2e4b346f77 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:10.361242 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b9e32eb9-7335-419e-a23e-1c2e4b346f77 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:10.454315 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1df75d66-a702-42d1-9acd-0498d9f5b4d9 tempest-MigrationsAdminTest-1230104219 tempest-MigrationsAdminTest-1230104219-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196/action" status: 202 len: 0 microversion: 2.1 time: 0.443717 Oct 19 03:17:10.454984 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 740/1423] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:17:10 2022] POST /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196/action => generated 0 bytes in 446 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:17:10.464340 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ce5c12db-65dd-4c80-86b9-10f501bc38d4 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:10.464926 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ce5c12db-65dd-4c80-86b9-10f501bc38d4 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 84774cfc-79b4-42db-acfd-c4daac86d196] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:10.471509 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ce5c12db-65dd-4c80-86b9-10f501bc38d4 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:10.471997 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ce5c12db-65dd-4c80-86b9-10f501bc38d4 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:10.472424 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ce5c12db-65dd-4c80-86b9-10f501bc38d4 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:10.473114 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ce5c12db-65dd-4c80-86b9-10f501bc38d4 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:10.473594 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ce5c12db-65dd-4c80-86b9-10f501bc38d4 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:10.474015 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ce5c12db-65dd-4c80-86b9-10f501bc38d4 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:10.582643 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b9e32eb9-7335-419e-a23e-1c2e4b346f77 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:10.591497 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b9e32eb9-7335-419e-a23e-1c2e4b346f77 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/f03fef0e-680b-45bd-87a9-a3df948181cf" status: 200 len: 1316 microversion: 2.1 time: 0.245923 Oct 19 03:17:10.599129 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 684/1424] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:10 2022] GET /compute/v2.1/servers/f03fef0e-680b-45bd-87a9-a3df948181cf => generated 1316 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:10.661377 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ce5c12db-65dd-4c80-86b9-10f501bc38d4 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:10.673471 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ce5c12db-65dd-4c80-86b9-10f501bc38d4 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196" status: 200 len: 1470 microversion: 2.1 time: 0.209892 Oct 19 03:17:10.673471 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 741/1425] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:10 2022] GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196 => generated 1470 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:10.832454 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-66f838e4-d3b2-4de2-ba05-8458a5e08107 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:10.833000 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-66f838e4-d3b2-4de2-ba05-8458a5e08107 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] [instance: 6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:10.839330 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-66f838e4-d3b2-4de2-ba05-8458a5e08107 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:10.839830 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-66f838e4-d3b2-4de2-ba05-8458a5e08107 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:10.840273 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-66f838e4-d3b2-4de2-ba05-8458a5e08107 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:10.840996 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-66f838e4-d3b2-4de2-ba05-8458a5e08107 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:10.841525 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-66f838e4-d3b2-4de2-ba05-8458a5e08107 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:10.841965 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-66f838e4-d3b2-4de2-ba05-8458a5e08107 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:10.915502 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-345783fc-71c5-4313-b1c3-ac3ea63283ce tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:10.917108 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-345783fc-71c5-4313-b1c3-ac3ea63283ce tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:10.922778 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-345783fc-71c5-4313-b1c3-ac3ea63283ce tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:10.923564 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-345783fc-71c5-4313-b1c3-ac3ea63283ce tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:10.943649 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-345783fc-71c5-4313-b1c3-ac3ea63283ce tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:10.943897 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-345783fc-71c5-4313-b1c3-ac3ea63283ce tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:10.944383 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-345783fc-71c5-4313-b1c3-ac3ea63283ce tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:10.944829 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-345783fc-71c5-4313-b1c3-ac3ea63283ce tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:11.041097 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-345783fc-71c5-4313-b1c3-ac3ea63283ce tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:11.058317 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-345783fc-71c5-4313-b1c3-ac3ea63283ce tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:11.059774 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-345783fc-71c5-4313-b1c3-ac3ea63283ce tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:11.078009 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-345783fc-71c5-4313-b1c3-ac3ea63283ce tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1546 microversion: 2.91 time: 0.162468 Oct 19 03:17:11.078681 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 742/1426] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:17:10 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1546 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:17:11.132557 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-66f838e4-d3b2-4de2-ba05-8458a5e08107 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cc37ae4bed94a7e85ed70dd5942c2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df99b134b20743eb9b62788706f2705a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:11.140417 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:17:11.154682 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-66f838e4-d3b2-4de2-ba05-8458a5e08107 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] 10.222.0.52 "GET /compute/v2.1/servers/6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1" status: 200 len: 1712 microversion: 2.1 time: 0.326011 Oct 19 03:17:11.165796 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 685/1427] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:10 2022] GET /compute/v2.1/servers/6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1 => generated 1712 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:11.254081 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-7c28690e-bea0-419e-b029-86f091a9f5fc req-85d71d7a-6ec5-4f48-ac05-73956c794a3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fef11301-8524-4f9b-bf6f-e525fca3237d", "name": "network-vif-unplugged", "status": "completed", "tag": "d48e4e1e-3f96-4bc7-948c-2124ef6f0ba5"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:17:11.265205 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-7c28690e-bea0-419e-b029-86f091a9f5fc req-85d71d7a-6ec5-4f48-ac05-73956c794a3a service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:11.266418 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-7c28690e-bea0-419e-b029-86f091a9f5fc req-85d71d7a-6ec5-4f48-ac05-73956c794a3a service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:11.266418 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-7c28690e-bea0-419e-b029-86f091a9f5fc req-85d71d7a-6ec5-4f48-ac05-73956c794a3a service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:11.278532 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-7c28690e-bea0-419e-b029-86f091a9f5fc req-85d71d7a-6ec5-4f48-ac05-73956c794a3a service nova] Creating event network-vif-unplugged:d48e4e1e-3f96-4bc7-948c-2124ef6f0ba5 for instance fef11301-8524-4f9b-bf6f-e525fca3237d on n-h2-861333-8 Oct 19 03:17:11.283922 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-7c28690e-bea0-419e-b029-86f091a9f5fc req-85d71d7a-6ec5-4f48-ac05-73956c794a3a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033423 Oct 19 03:17:11.284929 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 743/1428] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:17:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:17:11.369114 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-027e2f96-6443-4167-8d3b-a90174d22a08 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:11.370249 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-027e2f96-6443-4167-8d3b-a90174d22a08 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] [instance: fef11301-8524-4f9b-bf6f-e525fca3237d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:11.380377 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-027e2f96-6443-4167-8d3b-a90174d22a08 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:11.381362 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-027e2f96-6443-4167-8d3b-a90174d22a08 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:11.382043 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-027e2f96-6443-4167-8d3b-a90174d22a08 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:11.383182 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-027e2f96-6443-4167-8d3b-a90174d22a08 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:11.383897 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-027e2f96-6443-4167-8d3b-a90174d22a08 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:11.384573 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-027e2f96-6443-4167-8d3b-a90174d22a08 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:11.625396 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a50eb805-a13e-4086-b377-a2e01a9aae12 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:11.626153 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a50eb805-a13e-4086-b377-a2e01a9aae12 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: f03fef0e-680b-45bd-87a9-a3df948181cf] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:11.639460 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-027e2f96-6443-4167-8d3b-a90174d22a08 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c35b71372843d69f9a6c6be04b154f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcd49d68a3947249016cc5dbe910efc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:11.643256 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a50eb805-a13e-4086-b377-a2e01a9aae12 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:11.643808 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a50eb805-a13e-4086-b377-a2e01a9aae12 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:11.644370 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a50eb805-a13e-4086-b377-a2e01a9aae12 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:11.644983 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a50eb805-a13e-4086-b377-a2e01a9aae12 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:11.645467 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a50eb805-a13e-4086-b377-a2e01a9aae12 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:11.645901 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a50eb805-a13e-4086-b377-a2e01a9aae12 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:11.647609 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-027e2f96-6443-4167-8d3b-a90174d22a08 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] 10.222.0.52 "GET /compute/v2.1/servers/fef11301-8524-4f9b-bf6f-e525fca3237d" status: 200 len: 1812 microversion: 2.1 time: 0.283520 Oct 19 03:17:11.648984 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 686/1429] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:11 2022] GET /compute/v2.1/servers/fef11301-8524-4f9b-bf6f-e525fca3237d => generated 1812 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:17:11.703405 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e58773c8-f102-4181-b6d0-1f3ec1307d72 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:11.704046 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e58773c8-f102-4181-b6d0-1f3ec1307d72 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 84774cfc-79b4-42db-acfd-c4daac86d196] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:11.723506 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e58773c8-f102-4181-b6d0-1f3ec1307d72 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:11.724024 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e58773c8-f102-4181-b6d0-1f3ec1307d72 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:11.724476 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e58773c8-f102-4181-b6d0-1f3ec1307d72 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:11.725195 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e58773c8-f102-4181-b6d0-1f3ec1307d72 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:11.725689 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e58773c8-f102-4181-b6d0-1f3ec1307d72 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:11.726122 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e58773c8-f102-4181-b6d0-1f3ec1307d72 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:12.019759 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a50eb805-a13e-4086-b377-a2e01a9aae12 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:12.027728 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a50eb805-a13e-4086-b377-a2e01a9aae12 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/f03fef0e-680b-45bd-87a9-a3df948181cf" status: 200 len: 1316 microversion: 2.1 time: 0.406998 Oct 19 03:17:12.028327 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 744/1430] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:11 2022] GET /compute/v2.1/servers/f03fef0e-680b-45bd-87a9-a3df948181cf => generated 1316 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:12.082088 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e58773c8-f102-4181-b6d0-1f3ec1307d72 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:12.091066 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e58773c8-f102-4181-b6d0-1f3ec1307d72 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196" status: 200 len: 1470 microversion: 2.1 time: 0.392595 Oct 19 03:17:12.092038 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 687/1431] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:11 2022] GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196 => generated 1470 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:17:12.109295 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5af0a5f0-4452-4c31-8f4c-ddb28a265580 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:12.113668 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-5af0a5f0-4452-4c31-8f4c-ddb28a265580 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:12.119210 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5af0a5f0-4452-4c31-8f4c-ddb28a265580 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:12.119710 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5af0a5f0-4452-4c31-8f4c-ddb28a265580 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:12.120147 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5af0a5f0-4452-4c31-8f4c-ddb28a265580 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:12.121415 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5af0a5f0-4452-4c31-8f4c-ddb28a265580 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:12.121888 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5af0a5f0-4452-4c31-8f4c-ddb28a265580 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:12.122538 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5af0a5f0-4452-4c31-8f4c-ddb28a265580 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:12.180694 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-dfb91fcd-ceb4-4c55-a6b6-4225df319c37 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:12.181916 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-dfb91fcd-ceb4-4c55-a6b6-4225df319c37 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] [instance: 6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:12.200554 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dfb91fcd-ceb4-4c55-a6b6-4225df319c37 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:12.201064 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dfb91fcd-ceb4-4c55-a6b6-4225df319c37 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:12.201537 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dfb91fcd-ceb4-4c55-a6b6-4225df319c37 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:12.202319 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dfb91fcd-ceb4-4c55-a6b6-4225df319c37 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:12.202779 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dfb91fcd-ceb4-4c55-a6b6-4225df319c37 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:12.203210 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dfb91fcd-ceb4-4c55-a6b6-4225df319c37 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:12.287374 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-5af0a5f0-4452-4c31-8f4c-ddb28a265580 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:12.297092 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-5af0a5f0-4452-4c31-8f4c-ddb28a265580 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:12.299949 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-5af0a5f0-4452-4c31-8f4c-ddb28a265580 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:12.305926 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5af0a5f0-4452-4c31-8f4c-ddb28a265580 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1546 microversion: 2.91 time: 0.202200 Oct 19 03:17:12.308728 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 745/1432] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:17:12 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1546 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:17:12.554060 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-dfb91fcd-ceb4-4c55-a6b6-4225df319c37 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cc37ae4bed94a7e85ed70dd5942c2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df99b134b20743eb9b62788706f2705a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:12.563829 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-dfb91fcd-ceb4-4c55-a6b6-4225df319c37 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] 10.222.0.52 "GET /compute/v2.1/servers/6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1" status: 200 len: 1712 microversion: 2.1 time: 0.388188 Oct 19 03:17:12.564670 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 688/1433] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:12 2022] GET /compute/v2.1/servers/6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1 => generated 1712 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:17:12.671489 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4b6672ce-6a61-4363-946f-ffabf0387d51 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:12.672105 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4b6672ce-6a61-4363-946f-ffabf0387d51 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] [instance: fef11301-8524-4f9b-bf6f-e525fca3237d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:12.681765 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4b6672ce-6a61-4363-946f-ffabf0387d51 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:12.682182 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4b6672ce-6a61-4363-946f-ffabf0387d51 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:12.682611 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4b6672ce-6a61-4363-946f-ffabf0387d51 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:12.683350 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4b6672ce-6a61-4363-946f-ffabf0387d51 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:12.683798 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4b6672ce-6a61-4363-946f-ffabf0387d51 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:12.684219 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4b6672ce-6a61-4363-946f-ffabf0387d51 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:12.934290 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4b6672ce-6a61-4363-946f-ffabf0387d51 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c35b71372843d69f9a6c6be04b154f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcd49d68a3947249016cc5dbe910efc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:12.943539 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4b6672ce-6a61-4363-946f-ffabf0387d51 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] 10.222.0.52 "GET /compute/v2.1/servers/fef11301-8524-4f9b-bf6f-e525fca3237d" status: 200 len: 1812 microversion: 2.1 time: 0.275126 Oct 19 03:17:12.957587 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 746/1434] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:12 2022] GET /compute/v2.1/servers/fef11301-8524-4f9b-bf6f-e525fca3237d => generated 1812 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:13.052218 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7a8fb780-6ff3-4307-8ccc-dfcdfb574586 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:13.053843 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7a8fb780-6ff3-4307-8ccc-dfcdfb574586 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: f03fef0e-680b-45bd-87a9-a3df948181cf] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:13.062052 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7a8fb780-6ff3-4307-8ccc-dfcdfb574586 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:13.063798 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7a8fb780-6ff3-4307-8ccc-dfcdfb574586 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:13.063798 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7a8fb780-6ff3-4307-8ccc-dfcdfb574586 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:13.064072 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7a8fb780-6ff3-4307-8ccc-dfcdfb574586 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:13.065953 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7a8fb780-6ff3-4307-8ccc-dfcdfb574586 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:13.065953 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7a8fb780-6ff3-4307-8ccc-dfcdfb574586 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:13.116366 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-af89df2f-af89-4528-9076-5b907d0785d6 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:13.118017 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-af89df2f-af89-4528-9076-5b907d0785d6 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 84774cfc-79b4-42db-acfd-c4daac86d196] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:13.125597 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-af89df2f-af89-4528-9076-5b907d0785d6 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:13.126460 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-af89df2f-af89-4528-9076-5b907d0785d6 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:13.127128 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-af89df2f-af89-4528-9076-5b907d0785d6 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:13.128224 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-af89df2f-af89-4528-9076-5b907d0785d6 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:13.128889 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-af89df2f-af89-4528-9076-5b907d0785d6 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:13.129533 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-af89df2f-af89-4528-9076-5b907d0785d6 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:13.154885 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:17:13.360424 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-7a8fb780-6ff3-4307-8ccc-dfcdfb574586 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:13.372885 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7a8fb780-6ff3-4307-8ccc-dfcdfb574586 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/f03fef0e-680b-45bd-87a9-a3df948181cf" status: 200 len: 1316 microversion: 2.1 time: 0.323341 Oct 19 03:17:13.372885 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 689/1435] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:13 2022] GET /compute/v2.1/servers/f03fef0e-680b-45bd-87a9-a3df948181cf => generated 1316 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:13.383284 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-644611a7-45d5-4812-9cd6-e774d3ca6390 req-7c76eedc-34e8-489a-8f23-c30746480dae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fef11301-8524-4f9b-bf6f-e525fca3237d", "name": "network-vif-deleted", "tag": "d48e4e1e-3f96-4bc7-948c-2124ef6f0ba5"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:17:13.436081 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-644611a7-45d5-4812-9cd6-e774d3ca6390 req-7c76eedc-34e8-489a-8f23-c30746480dae service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:13.436081 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-644611a7-45d5-4812-9cd6-e774d3ca6390 req-7c76eedc-34e8-489a-8f23-c30746480dae service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:13.436081 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-644611a7-45d5-4812-9cd6-e774d3ca6390 req-7c76eedc-34e8-489a-8f23-c30746480dae service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:13.480407 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-af89df2f-af89-4528-9076-5b907d0785d6 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:13.494171 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-644611a7-45d5-4812-9cd6-e774d3ca6390 req-7c76eedc-34e8-489a-8f23-c30746480dae service nova] Creating event network-vif-deleted:d48e4e1e-3f96-4bc7-948c-2124ef6f0ba5 for instance fef11301-8524-4f9b-bf6f-e525fca3237d on n-h2-861333-8 Oct 19 03:17:13.494287 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-af89df2f-af89-4528-9076-5b907d0785d6 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196" status: 200 len: 1470 microversion: 2.1 time: 0.379004 Oct 19 03:17:13.494287 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 747/1436] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:13 2022] GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196 => generated 1470 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:13.495767 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-644611a7-45d5-4812-9cd6-e774d3ca6390 req-7c76eedc-34e8-489a-8f23-c30746480dae service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121088 Oct 19 03:17:13.496826 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 690/1437] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:17:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:17:13.502177 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-456e1228-d569-4965-b096-dac0053a0bfb tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:13.509526 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-69329acc-4c81-4bf4-a191-6aa783c87c50 req-6aa22324-357e-4f14-b4fa-d9fd93a464de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fef11301-8524-4f9b-bf6f-e525fca3237d", "name": "network-vif-unplugged", "status": "completed", "tag": "5e4e8744-671e-4d44-b07b-fd602e080024"}, {"server_uuid": "fef11301-8524-4f9b-bf6f-e525fca3237d", "name": "network-vif-unplugged", "status": "completed", "tag": "a956b9e6-07b8-4d6e-9436-0782855cb789"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:17:13.511313 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-456e1228-d569-4965-b096-dac0053a0bfb tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:13.519024 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-456e1228-d569-4965-b096-dac0053a0bfb tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:13.519852 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-456e1228-d569-4965-b096-dac0053a0bfb tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:13.521148 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-456e1228-d569-4965-b096-dac0053a0bfb tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:13.522172 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-456e1228-d569-4965-b096-dac0053a0bfb tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:13.522856 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-456e1228-d569-4965-b096-dac0053a0bfb tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:13.523471 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-456e1228-d569-4965-b096-dac0053a0bfb tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:13.534089 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-69329acc-4c81-4bf4-a191-6aa783c87c50 req-6aa22324-357e-4f14-b4fa-d9fd93a464de service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:13.534572 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-69329acc-4c81-4bf4-a191-6aa783c87c50 req-6aa22324-357e-4f14-b4fa-d9fd93a464de service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:13.535206 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-69329acc-4c81-4bf4-a191-6aa783c87c50 req-6aa22324-357e-4f14-b4fa-d9fd93a464de service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:13.555843 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-69329acc-4c81-4bf4-a191-6aa783c87c50 req-6aa22324-357e-4f14-b4fa-d9fd93a464de service nova] Creating event network-vif-unplugged:5e4e8744-671e-4d44-b07b-fd602e080024 for instance fef11301-8524-4f9b-bf6f-e525fca3237d on n-h2-861333-8 Oct 19 03:17:13.558148 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-69329acc-4c81-4bf4-a191-6aa783c87c50 req-6aa22324-357e-4f14-b4fa-d9fd93a464de service nova] Creating event network-vif-unplugged:a956b9e6-07b8-4d6e-9436-0782855cb789 for instance fef11301-8524-4f9b-bf6f-e525fca3237d on n-h2-861333-8 Oct 19 03:17:13.575332 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-69329acc-4c81-4bf4-a191-6aa783c87c50 req-6aa22324-357e-4f14-b4fa-d9fd93a464de service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.071335 Oct 19 03:17:13.581206 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 748/1438] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:17:13 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:17:13.588202 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-388109ba-fea4-4288-a374-325bb9029938 req-1041fa73-ebf5-4c4b-b373-114f182955b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1", "name": "network-vif-deleted", "tag": "753bfd99-2927-47ca-a7e7-46e77707a12f"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:17:13.625250 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-388109ba-fea4-4288-a374-325bb9029938 req-1041fa73-ebf5-4c4b-b373-114f182955b9 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:13.625848 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-388109ba-fea4-4288-a374-325bb9029938 req-1041fa73-ebf5-4c4b-b373-114f182955b9 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:13.626278 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-388109ba-fea4-4288-a374-325bb9029938 req-1041fa73-ebf5-4c4b-b373-114f182955b9 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:13.640125 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-456e1228-d569-4965-b096-dac0053a0bfb tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:13.644433 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-388109ba-fea4-4288-a374-325bb9029938 req-1041fa73-ebf5-4c4b-b373-114f182955b9 service nova] Creating event network-vif-deleted:753bfd99-2927-47ca-a7e7-46e77707a12f for instance 6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1 on n-h1-861333-8 Oct 19 03:17:13.650330 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-388109ba-fea4-4288-a374-325bb9029938 req-1041fa73-ebf5-4c4b-b373-114f182955b9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072837 Oct 19 03:17:13.650885 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 749/1439] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:17:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:17:13.656377 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7c0e76dd-42fc-43e2-b912-8f42b66f4afa tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:13.657085 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7c0e76dd-42fc-43e2-b912-8f42b66f4afa tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] [instance: 6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:13.663698 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7c0e76dd-42fc-43e2-b912-8f42b66f4afa tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:13.664192 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7c0e76dd-42fc-43e2-b912-8f42b66f4afa tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:13.664685 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7c0e76dd-42fc-43e2-b912-8f42b66f4afa tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:13.666132 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7c0e76dd-42fc-43e2-b912-8f42b66f4afa tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:13.666689 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7c0e76dd-42fc-43e2-b912-8f42b66f4afa tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:13.667226 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7c0e76dd-42fc-43e2-b912-8f42b66f4afa tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:13.668810 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-456e1228-d569-4965-b096-dac0053a0bfb tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:13.691298 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-456e1228-d569-4965-b096-dac0053a0bfb tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:13.709733 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-456e1228-d569-4965-b096-dac0053a0bfb tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1546 microversion: 2.91 time: 0.211365 Oct 19 03:17:13.710249 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 691/1440] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:17:13 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1546 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:17:13.809222 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7c0e76dd-42fc-43e2-b912-8f42b66f4afa tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cc37ae4bed94a7e85ed70dd5942c2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df99b134b20743eb9b62788706f2705a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:13.818527 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7c0e76dd-42fc-43e2-b912-8f42b66f4afa tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] 10.222.0.52 "GET /compute/v2.1/servers/6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1" status: 200 len: 1348 microversion: 2.1 time: 0.166164 Oct 19 03:17:13.835971 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 750/1441] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:13 2022] GET /compute/v2.1/servers/6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1 => generated 1348 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:13.971173 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-66cb61b9-9170-495f-8205-ff8a8dfaf362 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:13.983674 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-66cb61b9-9170-495f-8205-ff8a8dfaf362 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] [instance: fef11301-8524-4f9b-bf6f-e525fca3237d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:13.998255 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-66cb61b9-9170-495f-8205-ff8a8dfaf362 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:13.998963 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-66cb61b9-9170-495f-8205-ff8a8dfaf362 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:13.999718 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-66cb61b9-9170-495f-8205-ff8a8dfaf362 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:14.000676 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-66cb61b9-9170-495f-8205-ff8a8dfaf362 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:14.001198 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-66cb61b9-9170-495f-8205-ff8a8dfaf362 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:14.001802 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-66cb61b9-9170-495f-8205-ff8a8dfaf362 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:14.402987 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-66cb61b9-9170-495f-8205-ff8a8dfaf362 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c35b71372843d69f9a6c6be04b154f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcd49d68a3947249016cc5dbe910efc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:14.404496 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3dd2ecb6-1a3f-4f7b-9d38-6451f533f591 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:14.405335 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-3dd2ecb6-1a3f-4f7b-9d38-6451f533f591 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: f03fef0e-680b-45bd-87a9-a3df948181cf] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:14.420386 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-66cb61b9-9170-495f-8205-ff8a8dfaf362 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] 10.222.0.52 "GET /compute/v2.1/servers/fef11301-8524-4f9b-bf6f-e525fca3237d" status: 200 len: 1676 microversion: 2.1 time: 0.453586 Oct 19 03:17:14.435775 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3dd2ecb6-1a3f-4f7b-9d38-6451f533f591 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:14.435775 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3dd2ecb6-1a3f-4f7b-9d38-6451f533f591 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:14.435775 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3dd2ecb6-1a3f-4f7b-9d38-6451f533f591 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:14.435775 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3dd2ecb6-1a3f-4f7b-9d38-6451f533f591 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:14.436317 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3dd2ecb6-1a3f-4f7b-9d38-6451f533f591 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:14.436317 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3dd2ecb6-1a3f-4f7b-9d38-6451f533f591 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:14.464394 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 692/1442] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:13 2022] GET /compute/v2.1/servers/fef11301-8524-4f9b-bf6f-e525fca3237d => generated 1676 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:14.518534 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-01000a38-c56f-4d9d-b277-0e2159c1dfae tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:14.519547 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-01000a38-c56f-4d9d-b277-0e2159c1dfae tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 84774cfc-79b4-42db-acfd-c4daac86d196] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:14.548560 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-01000a38-c56f-4d9d-b277-0e2159c1dfae tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:14.550331 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-01000a38-c56f-4d9d-b277-0e2159c1dfae tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:14.555147 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-01000a38-c56f-4d9d-b277-0e2159c1dfae tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:14.557256 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-01000a38-c56f-4d9d-b277-0e2159c1dfae tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:14.568580 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-01000a38-c56f-4d9d-b277-0e2159c1dfae tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:14.578549 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-01000a38-c56f-4d9d-b277-0e2159c1dfae tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:14.833607 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-3dd2ecb6-1a3f-4f7b-9d38-6451f533f591 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:14.842318 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-3dd2ecb6-1a3f-4f7b-9d38-6451f533f591 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/f03fef0e-680b-45bd-87a9-a3df948181cf" status: 200 len: 1465 microversion: 2.1 time: 0.445936 Oct 19 03:17:14.843822 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 751/1443] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:14 2022] GET /compute/v2.1/servers/f03fef0e-680b-45bd-87a9-a3df948181cf => generated 1465 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:17:14.848638 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9930cd78-dbcc-45b1-a593-57e413e4e674 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:14.851198 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9930cd78-dbcc-45b1-a593-57e413e4e674 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:14.861788 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9930cd78-dbcc-45b1-a593-57e413e4e674 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:14.862586 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9930cd78-dbcc-45b1-a593-57e413e4e674 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:14.863214 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9930cd78-dbcc-45b1-a593-57e413e4e674 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:14.864111 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9930cd78-dbcc-45b1-a593-57e413e4e674 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:14.864743 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9930cd78-dbcc-45b1-a593-57e413e4e674 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:14.865174 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9930cd78-dbcc-45b1-a593-57e413e4e674 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:14.908994 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-01000a38-c56f-4d9d-b277-0e2159c1dfae tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:14.917692 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-01000a38-c56f-4d9d-b277-0e2159c1dfae tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196" status: 200 len: 1470 microversion: 2.1 time: 0.403703 Oct 19 03:17:14.921569 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 693/1444] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:14 2022] GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196 => generated 1470 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:14.932880 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-85926b9f-2330-4843-83f3-6e5672e37c69 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:14.937404 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-85926b9f-2330-4843-83f3-6e5672e37c69 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] [instance: 6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:14.946985 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-85926b9f-2330-4843-83f3-6e5672e37c69 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:14.946985 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-85926b9f-2330-4843-83f3-6e5672e37c69 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:14.946985 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-85926b9f-2330-4843-83f3-6e5672e37c69 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:14.946985 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-85926b9f-2330-4843-83f3-6e5672e37c69 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:14.947504 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-85926b9f-2330-4843-83f3-6e5672e37c69 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:14.947504 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-85926b9f-2330-4843-83f3-6e5672e37c69 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:14.994069 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-85926b9f-2330-4843-83f3-6e5672e37c69 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:14.995675 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-9930cd78-dbcc-45b1-a593-57e413e4e674 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:14.999842 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-85926b9f-2330-4843-83f3-6e5672e37c69 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:15.004920 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-9930cd78-dbcc-45b1-a593-57e413e4e674 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:15.005819 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-85926b9f-2330-4843-83f3-6e5672e37c69 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:15.009028 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-85926b9f-2330-4843-83f3-6e5672e37c69 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lazy-loading 'fault' on Instance uuid 6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1 {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:17:15.014581 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-9930cd78-dbcc-45b1-a593-57e413e4e674 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:15.028505 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9930cd78-dbcc-45b1-a593-57e413e4e674 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1546 microversion: 2.91 time: 0.183239 Oct 19 03:17:15.029326 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 752/1445] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:17:14 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1546 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:17:15.043507 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-db342a6d-6881-4ea1-a866-4bd0d2672d46 tempest-ServersOnMultiNodesTest-74681315 tempest-ServersOnMultiNodesTest-74681315-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:15.044686 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-db342a6d-6881-4ea1-a866-4bd0d2672d46 tempest-ServersOnMultiNodesTest-74681315 tempest-ServersOnMultiNodesTest-74681315-project-admin] [instance: f03fef0e-680b-45bd-87a9-a3df948181cf] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:15.051725 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-db342a6d-6881-4ea1-a866-4bd0d2672d46 tempest-ServersOnMultiNodesTest-74681315 tempest-ServersOnMultiNodesTest-74681315-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:15.052556 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-db342a6d-6881-4ea1-a866-4bd0d2672d46 tempest-ServersOnMultiNodesTest-74681315 tempest-ServersOnMultiNodesTest-74681315-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:15.053108 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-db342a6d-6881-4ea1-a866-4bd0d2672d46 tempest-ServersOnMultiNodesTest-74681315 tempest-ServersOnMultiNodesTest-74681315-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:15.053981 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-db342a6d-6881-4ea1-a866-4bd0d2672d46 tempest-ServersOnMultiNodesTest-74681315 tempest-ServersOnMultiNodesTest-74681315-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:15.054549 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-db342a6d-6881-4ea1-a866-4bd0d2672d46 tempest-ServersOnMultiNodesTest-74681315 tempest-ServersOnMultiNodesTest-74681315-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:15.055083 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-db342a6d-6881-4ea1-a866-4bd0d2672d46 tempest-ServersOnMultiNodesTest-74681315 tempest-ServersOnMultiNodesTest-74681315-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:15.082371 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-85926b9f-2330-4843-83f3-6e5672e37c69 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cc37ae4bed94a7e85ed70dd5942c2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df99b134b20743eb9b62788706f2705a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:15.092587 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-85926b9f-2330-4843-83f3-6e5672e37c69 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] 10.222.0.52 "GET /compute/v2.1/servers/6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1" status: 200 len: 1353 microversion: 2.1 time: 0.169926 Oct 19 03:17:15.101160 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 694/1446] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:14 2022] GET /compute/v2.1/servers/6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1 => generated 1353 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:15.410408 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-db342a6d-6881-4ea1-a866-4bd0d2672d46 tempest-ServersOnMultiNodesTest-74681315 tempest-ServersOnMultiNodesTest-74681315-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/f03fef0e-680b-45bd-87a9-a3df948181cf" status: 200 len: 1616 microversion: 2.1 time: 0.371726 Oct 19 03:17:15.412055 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 753/1447] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:15 2022] GET /compute/v2.1/servers/f03fef0e-680b-45bd-87a9-a3df948181cf => generated 1616 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:15.443393 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-454880fd-e3ba-4a7d-9449-88485c4f49db tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:15.444124 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-454880fd-e3ba-4a7d-9449-88485c4f49db tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: f03fef0e-680b-45bd-87a9-a3df948181cf] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:15.463688 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-454880fd-e3ba-4a7d-9449-88485c4f49db tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:15.464205 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-454880fd-e3ba-4a7d-9449-88485c4f49db tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:15.464657 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-454880fd-e3ba-4a7d-9449-88485c4f49db tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:15.465411 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-454880fd-e3ba-4a7d-9449-88485c4f49db tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:15.465873 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-454880fd-e3ba-4a7d-9449-88485c4f49db tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:15.468252 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-454880fd-e3ba-4a7d-9449-88485c4f49db tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:15.473240 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-237cb760-b038-4f99-af7e-1cfde3be5433 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:15.474452 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-237cb760-b038-4f99-af7e-1cfde3be5433 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] [instance: fef11301-8524-4f9b-bf6f-e525fca3237d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:15.481313 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-237cb760-b038-4f99-af7e-1cfde3be5433 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:15.481865 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-237cb760-b038-4f99-af7e-1cfde3be5433 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:15.482555 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-237cb760-b038-4f99-af7e-1cfde3be5433 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:15.483469 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-237cb760-b038-4f99-af7e-1cfde3be5433 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:15.484277 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-237cb760-b038-4f99-af7e-1cfde3be5433 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:15.484899 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-237cb760-b038-4f99-af7e-1cfde3be5433 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:15.507820 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-454880fd-e3ba-4a7d-9449-88485c4f49db tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: f03fef0e-680b-45bd-87a9-a3df948181cf] Going to try to terminate instance {{(pid=121134) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:17:15.653961 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-237cb760-b038-4f99-af7e-1cfde3be5433 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c35b71372843d69f9a6c6be04b154f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcd49d68a3947249016cc5dbe910efc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:15.655205 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-237cb760-b038-4f99-af7e-1cfde3be5433 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] 10.222.0.52 "GET /compute/v2.1/servers/fef11301-8524-4f9b-bf6f-e525fca3237d" status: 200 len: 1655 microversion: 2.1 time: 0.187795 Oct 19 03:17:15.655772 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 754/1448] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:15 2022] GET /compute/v2.1/servers/fef11301-8524-4f9b-bf6f-e525fca3237d => generated 1655 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:15.660233 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-7f6761c5-0b96-4bd8-b09a-ffe5db1ef9ef req-54a888af-72e7-415e-b136-3c55bb9641c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fef11301-8524-4f9b-bf6f-e525fca3237d", "name": "network-vif-deleted", "tag": "a956b9e6-07b8-4d6e-9436-0782855cb789"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:17:15.672599 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-7f6761c5-0b96-4bd8-b09a-ffe5db1ef9ef req-54a888af-72e7-415e-b136-3c55bb9641c8 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:15.673230 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-7f6761c5-0b96-4bd8-b09a-ffe5db1ef9ef req-54a888af-72e7-415e-b136-3c55bb9641c8 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:15.673725 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-7f6761c5-0b96-4bd8-b09a-ffe5db1ef9ef req-54a888af-72e7-415e-b136-3c55bb9641c8 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:15.686313 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-7f6761c5-0b96-4bd8-b09a-ffe5db1ef9ef req-54a888af-72e7-415e-b136-3c55bb9641c8 service nova] Creating event network-vif-deleted:a956b9e6-07b8-4d6e-9436-0782855cb789 for instance fef11301-8524-4f9b-bf6f-e525fca3237d on n-h2-861333-8 Oct 19 03:17:15.692092 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-7f6761c5-0b96-4bd8-b09a-ffe5db1ef9ef req-54a888af-72e7-415e-b136-3c55bb9641c8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035198 Oct 19 03:17:15.696314 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 755/1449] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:17:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:17:15.843304 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-454880fd-e3ba-4a7d-9449-88485c4f49db tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "DELETE /compute/v2.1/servers/f03fef0e-680b-45bd-87a9-a3df948181cf" status: 204 len: 0 microversion: 2.1 time: 0.403447 Oct 19 03:17:15.843938 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 695/1450] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:17:15 2022] DELETE /compute/v2.1/servers/f03fef0e-680b-45bd-87a9-a3df948181cf => generated 0 bytes in 405 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:17:15.852308 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e91f4bc6-46f2-424b-9d22-82d37aadbfb2 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:15.853566 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e91f4bc6-46f2-424b-9d22-82d37aadbfb2 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: f03fef0e-680b-45bd-87a9-a3df948181cf] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:15.859692 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e91f4bc6-46f2-424b-9d22-82d37aadbfb2 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:15.860179 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e91f4bc6-46f2-424b-9d22-82d37aadbfb2 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:15.860615 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e91f4bc6-46f2-424b-9d22-82d37aadbfb2 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:15.861304 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e91f4bc6-46f2-424b-9d22-82d37aadbfb2 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:15.861788 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e91f4bc6-46f2-424b-9d22-82d37aadbfb2 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:15.862213 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e91f4bc6-46f2-424b-9d22-82d37aadbfb2 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:15.942146 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6a644322-98e6-4615-8f20-b4abb40f0d1f tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:15.943039 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6a644322-98e6-4615-8f20-b4abb40f0d1f tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 84774cfc-79b4-42db-acfd-c4daac86d196] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:15.949000 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6a644322-98e6-4615-8f20-b4abb40f0d1f tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:15.949623 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6a644322-98e6-4615-8f20-b4abb40f0d1f tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:15.950490 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6a644322-98e6-4615-8f20-b4abb40f0d1f tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:15.951394 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6a644322-98e6-4615-8f20-b4abb40f0d1f tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:15.951854 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6a644322-98e6-4615-8f20-b4abb40f0d1f tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:15.952286 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6a644322-98e6-4615-8f20-b4abb40f0d1f tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:16.003159 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-e91f4bc6-46f2-424b-9d22-82d37aadbfb2 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:16.011080 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e91f4bc6-46f2-424b-9d22-82d37aadbfb2 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/f03fef0e-680b-45bd-87a9-a3df948181cf" status: 200 len: 1471 microversion: 2.1 time: 0.162907 Oct 19 03:17:16.011664 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 756/1451] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:15 2022] GET /compute/v2.1/servers/f03fef0e-680b-45bd-87a9-a3df948181cf => generated 1471 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:16.056154 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6238fd9f-873c-4963-8dde-a23d1d275287 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:16.056795 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6238fd9f-873c-4963-8dde-a23d1d275287 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:16.063285 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6238fd9f-873c-4963-8dde-a23d1d275287 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:16.063782 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6238fd9f-873c-4963-8dde-a23d1d275287 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:16.064227 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6238fd9f-873c-4963-8dde-a23d1d275287 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:16.064960 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6238fd9f-873c-4963-8dde-a23d1d275287 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:16.065442 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6238fd9f-873c-4963-8dde-a23d1d275287 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:16.065878 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6238fd9f-873c-4963-8dde-a23d1d275287 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:16.089501 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-6a644322-98e6-4615-8f20-b4abb40f0d1f tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:16.098037 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6a644322-98e6-4615-8f20-b4abb40f0d1f tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196" status: 200 len: 1470 microversion: 2.1 time: 0.159954 Oct 19 03:17:16.098548 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 696/1452] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:15 2022] GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196 => generated 1470 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:17:16.135673 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8b8300f7-2ee2-4082-85b5-f54ac705b824 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:16.136293 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8b8300f7-2ee2-4082-85b5-f54ac705b824 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] [instance: 6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:16.144177 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:17:16.146469 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8b8300f7-2ee2-4082-85b5-f54ac705b824 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:16.147173 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8b8300f7-2ee2-4082-85b5-f54ac705b824 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:16.147940 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8b8300f7-2ee2-4082-85b5-f54ac705b824 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:16.148836 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8b8300f7-2ee2-4082-85b5-f54ac705b824 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:16.150011 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8b8300f7-2ee2-4082-85b5-f54ac705b824 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:16.150640 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8b8300f7-2ee2-4082-85b5-f54ac705b824 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:16.213269 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8b8300f7-2ee2-4082-85b5-f54ac705b824 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:16.214132 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8b8300f7-2ee2-4082-85b5-f54ac705b824 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:16.214805 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8b8300f7-2ee2-4082-85b5-f54ac705b824 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:16.215472 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-8b8300f7-2ee2-4082-85b5-f54ac705b824 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lazy-loading 'fault' on Instance uuid 6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1 {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:17:16.272504 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8b8300f7-2ee2-4082-85b5-f54ac705b824 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cc37ae4bed94a7e85ed70dd5942c2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df99b134b20743eb9b62788706f2705a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:16.296976 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8b8300f7-2ee2-4082-85b5-f54ac705b824 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] 10.222.0.52 "GET /compute/v2.1/servers/6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1" status: 200 len: 1353 microversion: 2.1 time: 0.167580 Oct 19 03:17:16.302620 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 697/1453] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:16 2022] GET /compute/v2.1/servers/6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1 => generated 1353 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:16.406263 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-6238fd9f-873c-4963-8dde-a23d1d275287 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:16.420290 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-6238fd9f-873c-4963-8dde-a23d1d275287 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:16.425634 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-6238fd9f-873c-4963-8dde-a23d1d275287 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:16.432229 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6238fd9f-873c-4963-8dde-a23d1d275287 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1546 microversion: 2.91 time: 0.379925 Oct 19 03:17:16.434986 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 757/1454] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:17:16 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1546 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:17:16.678498 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ea0f2489-1205-4e06-9cc8-dcf03fcc55a6 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:16.679109 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ea0f2489-1205-4e06-9cc8-dcf03fcc55a6 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] [instance: fef11301-8524-4f9b-bf6f-e525fca3237d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:16.686298 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ea0f2489-1205-4e06-9cc8-dcf03fcc55a6 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:16.686767 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ea0f2489-1205-4e06-9cc8-dcf03fcc55a6 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:16.687201 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ea0f2489-1205-4e06-9cc8-dcf03fcc55a6 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:16.687889 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ea0f2489-1205-4e06-9cc8-dcf03fcc55a6 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:16.688340 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ea0f2489-1205-4e06-9cc8-dcf03fcc55a6 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:16.688764 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ea0f2489-1205-4e06-9cc8-dcf03fcc55a6 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:16.790717 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ea0f2489-1205-4e06-9cc8-dcf03fcc55a6 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c35b71372843d69f9a6c6be04b154f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcd49d68a3947249016cc5dbe910efc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:16.799812 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ea0f2489-1205-4e06-9cc8-dcf03fcc55a6 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] 10.222.0.52 "GET /compute/v2.1/servers/fef11301-8524-4f9b-bf6f-e525fca3237d" status: 200 len: 1455 microversion: 2.1 time: 0.125431 Oct 19 03:17:16.801271 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 698/1455] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:16 2022] GET /compute/v2.1/servers/fef11301-8524-4f9b-bf6f-e525fca3237d => generated 1455 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:17.035077 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c98fc42d-cc5f-41f8-a43e-cb2c850d2d7a tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:17.035620 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c98fc42d-cc5f-41f8-a43e-cb2c850d2d7a tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: f03fef0e-680b-45bd-87a9-a3df948181cf] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:17.042249 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c98fc42d-cc5f-41f8-a43e-cb2c850d2d7a tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:17.042736 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c98fc42d-cc5f-41f8-a43e-cb2c850d2d7a tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:17.043178 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c98fc42d-cc5f-41f8-a43e-cb2c850d2d7a tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:17.043867 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c98fc42d-cc5f-41f8-a43e-cb2c850d2d7a tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:17.044326 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c98fc42d-cc5f-41f8-a43e-cb2c850d2d7a tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:17.044754 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c98fc42d-cc5f-41f8-a43e-cb2c850d2d7a tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:17.121647 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d10f3410-77d2-46f8-95cc-ab5d6778b6f7 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:17.122289 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d10f3410-77d2-46f8-95cc-ab5d6778b6f7 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 84774cfc-79b4-42db-acfd-c4daac86d196] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:17.129078 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d10f3410-77d2-46f8-95cc-ab5d6778b6f7 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:17.129592 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d10f3410-77d2-46f8-95cc-ab5d6778b6f7 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:17.130028 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d10f3410-77d2-46f8-95cc-ab5d6778b6f7 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:17.130836 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d10f3410-77d2-46f8-95cc-ab5d6778b6f7 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:17.131285 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d10f3410-77d2-46f8-95cc-ab5d6778b6f7 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:17.131705 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d10f3410-77d2-46f8-95cc-ab5d6778b6f7 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:17.182040 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c98fc42d-cc5f-41f8-a43e-cb2c850d2d7a tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:17.189958 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c98fc42d-cc5f-41f8-a43e-cb2c850d2d7a tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/f03fef0e-680b-45bd-87a9-a3df948181cf" status: 200 len: 1471 microversion: 2.1 time: 0.158838 Oct 19 03:17:17.190530 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 758/1456] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:17 2022] GET /compute/v2.1/servers/f03fef0e-680b-45bd-87a9-a3df948181cf => generated 1471 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:17.265869 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d10f3410-77d2-46f8-95cc-ab5d6778b6f7 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:17.273507 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d10f3410-77d2-46f8-95cc-ab5d6778b6f7 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196" status: 200 len: 1470 microversion: 2.1 time: 0.155760 Oct 19 03:17:17.274087 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 699/1457] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:17 2022] GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196 => generated 1470 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:17:17.327005 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0dcbbb2f-25c5-48d2-9ac0-4e97774b97ba tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:17.328218 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0dcbbb2f-25c5-48d2-9ac0-4e97774b97ba tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] [instance: 6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:17.335256 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0dcbbb2f-25c5-48d2-9ac0-4e97774b97ba tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:17.335846 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0dcbbb2f-25c5-48d2-9ac0-4e97774b97ba tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:17.336350 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0dcbbb2f-25c5-48d2-9ac0-4e97774b97ba tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:17.338249 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0dcbbb2f-25c5-48d2-9ac0-4e97774b97ba tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:17.338769 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0dcbbb2f-25c5-48d2-9ac0-4e97774b97ba tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:17.339219 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0dcbbb2f-25c5-48d2-9ac0-4e97774b97ba tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:17.369662 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0dcbbb2f-25c5-48d2-9ac0-4e97774b97ba tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:17.370153 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0dcbbb2f-25c5-48d2-9ac0-4e97774b97ba tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:17.370592 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0dcbbb2f-25c5-48d2-9ac0-4e97774b97ba tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:17.371039 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-0dcbbb2f-25c5-48d2-9ac0-4e97774b97ba tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lazy-loading 'fault' on Instance uuid 6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1 {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:17:17.416384 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-0dcbbb2f-25c5-48d2-9ac0-4e97774b97ba tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cc37ae4bed94a7e85ed70dd5942c2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df99b134b20743eb9b62788706f2705a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:17.425585 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0dcbbb2f-25c5-48d2-9ac0-4e97774b97ba tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] 10.222.0.52 "GET /compute/v2.1/servers/6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1" status: 200 len: 1353 microversion: 2.1 time: 0.103863 Oct 19 03:17:17.426186 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 759/1458] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:17 2022] GET /compute/v2.1/servers/6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1 => generated 1353 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:17.466968 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-bf926793-665d-4e9c-ac0c-ac0970234da2 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:17.468433 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-bf926793-665d-4e9c-ac0c-ac0970234da2 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:17.476229 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bf926793-665d-4e9c-ac0c-ac0970234da2 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:17.477039 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bf926793-665d-4e9c-ac0c-ac0970234da2 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:17.477589 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bf926793-665d-4e9c-ac0c-ac0970234da2 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:17.478418 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bf926793-665d-4e9c-ac0c-ac0970234da2 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:17.478946 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bf926793-665d-4e9c-ac0c-ac0970234da2 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:17.479446 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bf926793-665d-4e9c-ac0c-ac0970234da2 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:17.555631 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-bf926793-665d-4e9c-ac0c-ac0970234da2 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:17.558582 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:17:17.565405 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-bf926793-665d-4e9c-ac0c-ac0970234da2 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:17.567065 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-bf926793-665d-4e9c-ac0c-ac0970234da2 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:17.573177 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-bf926793-665d-4e9c-ac0c-ac0970234da2 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1546 microversion: 2.91 time: 0.109800 Oct 19 03:17:17.574983 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 700/1459] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:17:17 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1546 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:17:17.706653 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-bf65b459-e9f0-4d7a-9acd-c0c61517ea60 req-d134e265-ab91-4d32-8161-fdbcc9b47ea4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fef11301-8524-4f9b-bf6f-e525fca3237d", "name": "network-vif-deleted", "tag": "5e4e8744-671e-4d44-b07b-fd602e080024"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:17:17.717536 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-bf65b459-e9f0-4d7a-9acd-c0c61517ea60 req-d134e265-ab91-4d32-8161-fdbcc9b47ea4 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:17.717895 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-bf65b459-e9f0-4d7a-9acd-c0c61517ea60 req-d134e265-ab91-4d32-8161-fdbcc9b47ea4 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:17.718253 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-bf65b459-e9f0-4d7a-9acd-c0c61517ea60 req-d134e265-ab91-4d32-8161-fdbcc9b47ea4 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:17.731008 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-bf65b459-e9f0-4d7a-9acd-c0c61517ea60 req-d134e265-ab91-4d32-8161-fdbcc9b47ea4 service nova] Creating event network-vif-deleted:5e4e8744-671e-4d44-b07b-fd602e080024 for instance fef11301-8524-4f9b-bf6f-e525fca3237d on n-h2-861333-8 Oct 19 03:17:17.736011 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-bf65b459-e9f0-4d7a-9acd-c0c61517ea60 req-d134e265-ab91-4d32-8161-fdbcc9b47ea4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033064 Oct 19 03:17:17.736607 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 701/1460] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:17:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:17:17.801165 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0ee7e174-9d23-482f-86d0-56ad1c98fe5f tempest-VolumesAdminNegativeTest-1555198755 tempest-VolumesAdminNegativeTest-1555198755-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "8ab3f2e8-445e-40c2-afff-1283c37ce6fe"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:17:17.803575 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0ee7e174-9d23-482f-86d0-56ad1c98fe5f tempest-VolumesAdminNegativeTest-1555198755 tempest-VolumesAdminNegativeTest-1555198755-project-admin] [instance: 540a7025-b935-49fb-bc51-edf44ac1e0c4] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:17.810140 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0ee7e174-9d23-482f-86d0-56ad1c98fe5f tempest-VolumesAdminNegativeTest-1555198755 tempest-VolumesAdminNegativeTest-1555198755-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:17.810624 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0ee7e174-9d23-482f-86d0-56ad1c98fe5f tempest-VolumesAdminNegativeTest-1555198755 tempest-VolumesAdminNegativeTest-1555198755-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:17.811076 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0ee7e174-9d23-482f-86d0-56ad1c98fe5f tempest-VolumesAdminNegativeTest-1555198755 tempest-VolumesAdminNegativeTest-1555198755-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:17.811753 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0ee7e174-9d23-482f-86d0-56ad1c98fe5f tempest-VolumesAdminNegativeTest-1555198755 tempest-VolumesAdminNegativeTest-1555198755-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:17.812203 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0ee7e174-9d23-482f-86d0-56ad1c98fe5f tempest-VolumesAdminNegativeTest-1555198755 tempest-VolumesAdminNegativeTest-1555198755-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:17.812624 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0ee7e174-9d23-482f-86d0-56ad1c98fe5f tempest-VolumesAdminNegativeTest-1555198755 tempest-VolumesAdminNegativeTest-1555198755-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:17.824455 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e8c600f3-a94d-4d65-a475-dd2161344f3f tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:17.825185 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e8c600f3-a94d-4d65-a475-dd2161344f3f tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] [instance: fef11301-8524-4f9b-bf6f-e525fca3237d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:17.832073 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e8c600f3-a94d-4d65-a475-dd2161344f3f tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:17.832562 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e8c600f3-a94d-4d65-a475-dd2161344f3f tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:17.833006 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e8c600f3-a94d-4d65-a475-dd2161344f3f tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:17.833739 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e8c600f3-a94d-4d65-a475-dd2161344f3f tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:17.834195 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e8c600f3-a94d-4d65-a475-dd2161344f3f tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:17.834628 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e8c600f3-a94d-4d65-a475-dd2161344f3f tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:17.898787 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e8c600f3-a94d-4d65-a475-dd2161344f3f tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c35b71372843d69f9a6c6be04b154f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcd49d68a3947249016cc5dbe910efc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:17.906520 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e8c600f3-a94d-4d65-a475-dd2161344f3f tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] 10.222.0.52 "GET /compute/v2.1/servers/fef11301-8524-4f9b-bf6f-e525fca3237d" status: 200 len: 1455 microversion: 2.1 time: 0.086886 Oct 19 03:17:17.907085 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 702/1461] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:17 2022] GET /compute/v2.1/servers/fef11301-8524-4f9b-bf6f-e525fca3237d => generated 1455 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:17:18.000877 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-0ee7e174-9d23-482f-86d0-56ad1c98fe5f tempest-VolumesAdminNegativeTest-1555198755 tempest-VolumesAdminNegativeTest-1555198755-project-admin] HTTP exception thrown: Volume 8ab3f2e8-445e-40c2-afff-1283c37ce6fe could not be found. Oct 19 03:17:18.004561 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0ee7e174-9d23-482f-86d0-56ad1c98fe5f tempest-VolumesAdminNegativeTest-1555198755 tempest-VolumesAdminNegativeTest-1555198755-project-admin] Request method failure captured: Oct 19 03:17:18.004561 n-d-861333-8 devstack@n-api.service[121135]: request: PUT /compute/v2.1/servers/540a7025-b935-49fb-bc51-edf44ac1e0c4/os-volume_attachments/7917a793-2e5e-409e-9f52-f81fb832856d HTTP/1.1 Oct 19 03:17:18.004561 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:17:18.004561 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:17:18.004561 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:17:18.004561 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 74 Oct 19 03:17:18.004561 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:17:18.004561 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:17:18.004561 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:17:18.004561 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:17:18.004561 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2ucL7M0II0d3qyRHse5xL-8eSin09x8d0u7cTaLPYmbbiY8finLVOYIB6rGnEe7mf6Xy3_G7R-eIeUEJU-1D6KAVRH93A-DbDGPGXWPQ40Y65KU97F5fHow-sD5UZx8F73Do7oBI6uM0TfMS3TmPxoDmjr08XD9Biwe4yvsHg2Vz_o Oct 19 03:17:18.004561 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:17:18.004561 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:17:18.004561 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:17:18.004561 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:17:18.004561 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:17:18.004561 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:17:18.004561 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 0d83724498b541ddaaec01ce9a4a69f1 Oct 19 03:17:18.004561 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-VolumesAdminNegativeTest-1555198755 Oct 19 03:17:18.004561 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member,admin Oct 19 03:17:18.004561 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member,admin Oct 19 03:17:18.006385 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/0d83724498b541ddaaec01ce9a4a69f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0d83724498b541ddaaec01ce9a4a69f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0d83724498b541ddaaec01ce9a4a69f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_0d83724498b541ddaaec01ce9a4a69f1", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:17:18.006385 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-VolumesAdminNegativeTest-1555198755 Oct 19 03:17:18.006385 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 0d83724498b541ddaaec01ce9a4a69f1 Oct 19 03:17:18.006385 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1555198755 Oct 19 03:17:18.006385 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-VolumesAdminNegativeTest-1555198755-project-admin Oct 19 03:17:18.006385 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:17:18.006385 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:17:18.006385 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 27fe14951b8e44ada99e0347c8d9d318 Oct 19 03:17:18.006385 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-VolumesAdminNegativeTest-1555198755-project-admin Oct 19 03:17:18.006385 n-d-861333-8 devstack@n-api.service[121135]: Oct 19 03:17:18.006385 n-d-861333-8 devstack@n-api.service[121135]: {"volumeAttachment": {"volumeId": "8ab3f2e8-445e-40c2-afff-1283c37ce6fe"}} Oct 19 03:17:18.006385 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:17:18.006385 n-d-861333-8 devstack@n-api.service[121135]: exception: Volume 8ab3f2e8-445e-40c2-afff-1283c37ce6fe could not be found. Oct 19 03:17:18.007390 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'server_id': '540a7025-b935-49fb-bc51-edf44ac1e0c4', 'id': '7917a793-2e5e-409e-9f52-f81fb832856d', 'body': {'volumeAttachment': {'volumeId': '8ab3f2e8-445e-40c2-afff-1283c37ce6fe'}}} Oct 19 03:17:18.007390 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:17:18.007390 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:17:18.007390 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 03:17:18.007390 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 03:17:18.007390 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 19 03:17:18.007390 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 19 03:17:18.007390 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 19 03:17:18.007390 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 19 03:17:18.007390 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 19 03:17:18.007390 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 19 03:17:18.007390 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 19 03:17:18.007390 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 19 03:17:18.007390 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 03:17:18.007390 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 03:17:18.007390 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 03:17:18.007390 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 03:17:18.008720 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8ab3f2e8-445e-40c2-afff-1283c37ce6fe could not be found. (HTTP 404) (Request-ID: req-706c8d1f-d3ae-472d-9a46-3c2535a5a4bf) Oct 19 03:17:18.008720 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:17:18.008720 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:17:18.008720 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:17:18.008720 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:17:18.008720 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Oct 19 03:17:18.008720 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Oct 19 03:17:18.008720 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 19 03:17:18.008720 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 19 03:17:18.008720 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 19 03:17:18.008720 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 19 03:17:18.008720 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 19 03:17:18.008720 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 19 03:17:18.008720 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 03:17:18.008720 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 03:17:18.008720 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 19 03:17:18.008720 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 19 03:17:18.008720 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 19 03:17:18.008720 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 19 03:17:18.010243 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 19 03:17:18.010243 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 19 03:17:18.010243 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 19 03:17:18.010243 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 19 03:17:18.010243 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 03:17:18.010243 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 03:17:18.010243 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 03:17:18.010243 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 03:17:18.010243 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8ab3f2e8-445e-40c2-afff-1283c37ce6fe could not be found. Oct 19 03:17:18.010243 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:17:18.010243 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:17:18.010243 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:17:18.010243 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:17:18.010243 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:17:18.010243 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:17:18.010243 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:17:18.010243 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:17:18.010243 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:17:18.010243 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:17:18.011636 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:17:18.011636 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:17:18.011636 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:17:18.011636 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:17:18.011636 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 19 03:17:18.011636 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 19 03:17:18.011636 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Oct 19 03:17:18.011636 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 19 03:17:18.011636 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 8ab3f2e8-445e-40c2-afff-1283c37ce6fe could not be found. Oct 19 03:17:18.011636 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:17:18.011636 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:17:18.011636 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:17:18.011636 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:17:18.011636 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:17:18.011636 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:17:18.011636 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:17:18.011636 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:17:18.011636 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8ab3f2e8-445e-40c2-afff-1283c37ce6fe could not be found. Oct 19 03:17:18.011636 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:17:18.013211 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0ee7e174-9d23-482f-86d0-56ad1c98fe5f tempest-VolumesAdminNegativeTest-1555198755 tempest-VolumesAdminNegativeTest-1555198755-project-admin] Returning 400 to user: Volume 8ab3f2e8-445e-40c2-afff-1283c37ce6fe could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:17:18.013211 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0ee7e174-9d23-482f-86d0-56ad1c98fe5f tempest-VolumesAdminNegativeTest-1555198755 tempest-VolumesAdminNegativeTest-1555198755-project-admin] 10.222.0.52 "PUT /compute/v2.1/servers/540a7025-b935-49fb-bc51-edf44ac1e0c4/os-volume_attachments/7917a793-2e5e-409e-9f52-f81fb832856d" status: 400 len: 107 microversion: 2.1 time: 0.377126 Oct 19 03:17:18.013211 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 760/1462] 10.222.0.52 () {60 vars in 1433 bytes} [Wed Oct 19 03:17:17 2022] PUT /compute/v2.1/servers/540a7025-b935-49fb-bc51-edf44ac1e0c4/os-volume_attachments/7917a793-2e5e-409e-9f52-f81fb832856d => generated 107 bytes in 378 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 03:17:18.071147 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c472ae2f-d0f2-46d9-a3fc-52c9dfe5434c tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:18.071639 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c472ae2f-d0f2-46d9-a3fc-52c9dfe5434c tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] [instance: 540a7025-b935-49fb-bc51-edf44ac1e0c4] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:18.077631 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c472ae2f-d0f2-46d9-a3fc-52c9dfe5434c tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:18.078108 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c472ae2f-d0f2-46d9-a3fc-52c9dfe5434c tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:18.078541 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c472ae2f-d0f2-46d9-a3fc-52c9dfe5434c tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:18.079227 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c472ae2f-d0f2-46d9-a3fc-52c9dfe5434c tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:18.079672 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c472ae2f-d0f2-46d9-a3fc-52c9dfe5434c tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:18.080097 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c472ae2f-d0f2-46d9-a3fc-52c9dfe5434c tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:18.200949 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-c472ae2f-d0f2-46d9-a3fc-52c9dfe5434c tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lazy-loading 'services' on Instance uuid 540a7025-b935-49fb-bc51-edf44ac1e0c4 {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:17:18.213885 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d55bb8ac-df10-40b5-850c-38ed53cf7320 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:18.214494 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d55bb8ac-df10-40b5-850c-38ed53cf7320 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: f03fef0e-680b-45bd-87a9-a3df948181cf] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:18.221045 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d55bb8ac-df10-40b5-850c-38ed53cf7320 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:18.221580 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d55bb8ac-df10-40b5-850c-38ed53cf7320 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:18.222015 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d55bb8ac-df10-40b5-850c-38ed53cf7320 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:18.222702 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d55bb8ac-df10-40b5-850c-38ed53cf7320 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:18.223374 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d55bb8ac-df10-40b5-850c-38ed53cf7320 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:18.223799 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d55bb8ac-df10-40b5-850c-38ed53cf7320 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:18.357735 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d55bb8ac-df10-40b5-850c-38ed53cf7320 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:18.365670 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d55bb8ac-df10-40b5-850c-38ed53cf7320 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/f03fef0e-680b-45bd-87a9-a3df948181cf" status: 200 len: 1471 microversion: 2.1 time: 0.155814 Oct 19 03:17:18.366233 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 761/1463] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:18 2022] GET /compute/v2.1/servers/f03fef0e-680b-45bd-87a9-a3df948181cf => generated 1471 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:17:18.370743 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d3603d25-6aca-4500-82ae-243a07f3314b tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:18.371355 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d3603d25-6aca-4500-82ae-243a07f3314b tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 84774cfc-79b4-42db-acfd-c4daac86d196] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:18.377266 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d3603d25-6aca-4500-82ae-243a07f3314b tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:18.382648 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d3603d25-6aca-4500-82ae-243a07f3314b tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:18.382648 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d3603d25-6aca-4500-82ae-243a07f3314b tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:18.382648 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d3603d25-6aca-4500-82ae-243a07f3314b tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:18.382648 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d3603d25-6aca-4500-82ae-243a07f3314b tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:18.383038 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d3603d25-6aca-4500-82ae-243a07f3314b tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:18.440139 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c472ae2f-d0f2-46d9-a3fc-52c9dfe5434c tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] 10.222.0.52 "DELETE /compute/v2.1/servers/540a7025-b935-49fb-bc51-edf44ac1e0c4/os-volume_attachments/7917a793-2e5e-409e-9f52-f81fb832856d" status: 202 len: 0 microversion: 2.1 time: 0.372612 Oct 19 03:17:18.440881 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 703/1464] 10.222.0.52 () {58 vars in 1416 bytes} [Wed Oct 19 03:17:18 2022] DELETE /compute/v2.1/servers/540a7025-b935-49fb-bc51-edf44ac1e0c4/os-volume_attachments/7917a793-2e5e-409e-9f52-f81fb832856d => generated 0 bytes in 374 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:17:18.450698 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c003fd51-d85a-4feb-85d0-3260d57fd2ce tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:18.451444 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c003fd51-d85a-4feb-85d0-3260d57fd2ce tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] [instance: 6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:18.458989 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c003fd51-d85a-4feb-85d0-3260d57fd2ce tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:18.459493 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c003fd51-d85a-4feb-85d0-3260d57fd2ce tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:18.460168 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c003fd51-d85a-4feb-85d0-3260d57fd2ce tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:18.460907 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c003fd51-d85a-4feb-85d0-3260d57fd2ce tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:18.461356 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c003fd51-d85a-4feb-85d0-3260d57fd2ce tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:18.462038 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c003fd51-d85a-4feb-85d0-3260d57fd2ce tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:18.481047 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-c003fd51-d85a-4feb-85d0-3260d57fd2ce tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] HTTP exception thrown: Instance 6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1 could not be found. Oct 19 03:17:18.489599 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c003fd51-d85a-4feb-85d0-3260d57fd2ce tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Request method failure captured: Oct 19 03:17:18.489599 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1 HTTP/1.1 Oct 19 03:17:18.489599 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:17:18.489599 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:17:18.489599 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:17:18.489599 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:17:18.489599 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:17:18.489599 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:17:18.489599 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:17:18.489599 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:17:18.489599 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT2smH4Kc1-uSe7C0Z7t2DhigeC94XIsuadJrSic8X8t8KsS8n3ls_W0iazznmuf0f2bYTrElb8gsZFTWKaaDehji_uYTpF9SxhgOUkVzWW4LUI1AnnLWieM3JRGgGUXySqpYFIXrQ8nyIB7YETyDoBQnFZcFbjkvBO469dKOcvOf-G4 Oct 19 03:17:18.489599 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:17:18.489599 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:17:18.489599 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:17:18.489599 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:17:18.489599 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:17:18.489599 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:17:18.489599 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: df99b134b20743eb9b62788706f2705a Oct 19 03:17:18.489599 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1921827065 Oct 19 03:17:18.489599 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:17:18.489599 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:17:18.491050 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/df99b134b20743eb9b62788706f2705a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/df99b134b20743eb9b62788706f2705a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/df99b134b20743eb9b62788706f2705a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_df99b134b20743eb9b62788706f2705a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:17:18.491050 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1921827065 Oct 19 03:17:18.491050 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: df99b134b20743eb9b62788706f2705a Oct 19 03:17:18.491050 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1921827065 Oct 19 03:17:18.491050 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1921827065-project Oct 19 03:17:18.491050 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:17:18.491050 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:17:18.491050 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 2cc37ae4bed94a7e85ed70dd5942c2bd Oct 19 03:17:18.491050 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1921827065-project Oct 19 03:17:18.491050 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:17:18.491050 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance 6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1 could not be found. Oct 19 03:17:18.491050 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1'} Oct 19 03:17:18.491849 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:17:18.491849 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:17:18.491849 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:17:18.491849 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:17:18.491849 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:17:18.491849 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:17:18.491849 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:17:18.491849 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:17:18.491849 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:17:18.491849 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:17:18.491849 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1 could not be found. Oct 19 03:17:18.491849 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:17:18.491849 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:17:18.491849 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:17:18.491849 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:17:18.491849 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:17:18.491849 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:17:18.491849 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:17:18.491849 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:17:18.491849 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:17:18.493434 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:17:18.493434 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:17:18.493434 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:17:18.493434 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:17:18.493434 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:17:18.493434 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:17:18.493434 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:17:18.493434 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1 could not be found. Oct 19 03:17:18.493434 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:17:18.493434 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:17:18.493434 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:17:18.493434 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:17:18.493434 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:17:18.493434 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:17:18.493434 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:17:18.493434 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:17:18.493434 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1 could not be found. Oct 19 03:17:18.493434 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:17:18.495295 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c003fd51-d85a-4feb-85d0-3260d57fd2ce tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Returning 404 to user: Instance 6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:17:18.495295 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c003fd51-d85a-4feb-85d0-3260d57fd2ce tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] 10.222.0.52 "GET /compute/v2.1/servers/6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1" status: 404 len: 111 microversion: 2.1 time: 0.049281 Oct 19 03:17:18.495714 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 704/1465] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:18 2022] GET /compute/v2.1/servers/6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 03:17:18.502773 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d1b36f83-af87-4897-b354-fd9951758948 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:18.505017 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d1b36f83-af87-4897-b354-fd9951758948 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] [instance: 540a7025-b935-49fb-bc51-edf44ac1e0c4] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:18.512597 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d1b36f83-af87-4897-b354-fd9951758948 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:18.514035 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d1b36f83-af87-4897-b354-fd9951758948 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:18.514505 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d1b36f83-af87-4897-b354-fd9951758948 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:18.515407 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d1b36f83-af87-4897-b354-fd9951758948 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:18.517388 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d1b36f83-af87-4897-b354-fd9951758948 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:18.517838 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d1b36f83-af87-4897-b354-fd9951758948 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:18.536290 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d3603d25-6aca-4500-82ae-243a07f3314b tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:18.546455 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d3603d25-6aca-4500-82ae-243a07f3314b tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196" status: 200 len: 1470 microversion: 2.1 time: 0.179203 Oct 19 03:17:18.547028 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 762/1466] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:18 2022] GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196 => generated 1470 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:18.552266 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-40527f2d-efdb-485a-ae54-2b8853de901f tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:18.552955 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-40527f2d-efdb-485a-ae54-2b8853de901f tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] [instance: f476cc02-1b56-4c61-93a4-c3d36c38792d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:18.555034 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d1b36f83-af87-4897-b354-fd9951758948 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] 10.222.0.52 "GET /compute/v2.1/servers/540a7025-b935-49fb-bc51-edf44ac1e0c4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058390 Oct 19 03:17:18.555574 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 705/1467] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Oct 19 03:17:18 2022] GET /compute/v2.1/servers/540a7025-b935-49fb-bc51-edf44ac1e0c4/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:17:18.560964 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-40527f2d-efdb-485a-ae54-2b8853de901f tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:18.561956 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-40527f2d-efdb-485a-ae54-2b8853de901f tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:18.562408 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-40527f2d-efdb-485a-ae54-2b8853de901f tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:18.563153 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-40527f2d-efdb-485a-ae54-2b8853de901f tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:18.563587 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-40527f2d-efdb-485a-ae54-2b8853de901f tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:18.564020 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-40527f2d-efdb-485a-ae54-2b8853de901f tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:18.579854 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-40527f2d-efdb-485a-ae54-2b8853de901f tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] HTTP exception thrown: Instance f476cc02-1b56-4c61-93a4-c3d36c38792d could not be found. Oct 19 03:17:18.583595 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-40527f2d-efdb-485a-ae54-2b8853de901f tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Request method failure captured: Oct 19 03:17:18.583595 n-d-861333-8 devstack@n-api.service[121135]: request: DELETE /compute/v2.1/servers/f476cc02-1b56-4c61-93a4-c3d36c38792d HTTP/1.1 Oct 19 03:17:18.583595 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:17:18.583595 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:17:18.583595 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:17:18.583595 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:17:18.583595 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:17:18.583595 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:17:18.583595 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:17:18.583595 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:17:18.583595 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2smH4Kc1-uSe7C0Z7t2DhigeC94XIsuadJrSic8X8t8KsS8n3ls_W0iazznmuf0f2bYTrElb8gsZFTWKaaDehji_uYTpF9SxhgOUkVzWW4LUI1AnnLWieM3JRGgGUXySqpYFIXrQ8nyIB7YETyDoBQnFZcFbjkvBO469dKOcvOf-G4 Oct 19 03:17:18.583595 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:17:18.583595 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:17:18.583595 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:17:18.583595 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:17:18.583595 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:17:18.583595 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:17:18.583595 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: df99b134b20743eb9b62788706f2705a Oct 19 03:17:18.583595 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1921827065 Oct 19 03:17:18.583595 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:17:18.583595 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:17:18.585298 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/df99b134b20743eb9b62788706f2705a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/df99b134b20743eb9b62788706f2705a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/df99b134b20743eb9b62788706f2705a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_df99b134b20743eb9b62788706f2705a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:17:18.585298 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1921827065 Oct 19 03:17:18.585298 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: df99b134b20743eb9b62788706f2705a Oct 19 03:17:18.585298 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1921827065 Oct 19 03:17:18.585298 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1921827065-project Oct 19 03:17:18.585298 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:17:18.585298 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:17:18.585298 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 2cc37ae4bed94a7e85ed70dd5942c2bd Oct 19 03:17:18.585298 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1921827065-project Oct 19 03:17:18.585298 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:17:18.585298 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance f476cc02-1b56-4c61-93a4-c3d36c38792d could not be found. Oct 19 03:17:18.585298 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': 'f476cc02-1b56-4c61-93a4-c3d36c38792d'} Oct 19 03:17:18.586302 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:17:18.586302 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:17:18.586302 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:17:18.586302 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:17:18.586302 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:17:18.586302 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:17:18.586302 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:17:18.586302 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:17:18.586302 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:17:18.586302 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:17:18.586302 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f476cc02-1b56-4c61-93a4-c3d36c38792d could not be found. Oct 19 03:17:18.586302 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:17:18.586302 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:17:18.586302 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:17:18.586302 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:17:18.586302 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:17:18.586302 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:17:18.586302 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:17:18.586302 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:17:18.586302 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:17:18.588303 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:17:18.588303 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 03:17:18.588303 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 03:17:18.588303 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 03:17:18.588303 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 03:17:18.588303 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:17:18.588303 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:17:18.588303 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:17:18.588303 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:17:18.588303 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f476cc02-1b56-4c61-93a4-c3d36c38792d could not be found. Oct 19 03:17:18.588303 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:17:18.588303 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:17:18.588303 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:17:18.588303 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:17:18.588303 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:17:18.588303 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:17:18.588303 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:17:18.588303 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:17:18.588303 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f476cc02-1b56-4c61-93a4-c3d36c38792d could not be found. Oct 19 03:17:18.588303 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:17:18.589826 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-40527f2d-efdb-485a-ae54-2b8853de901f tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Returning 404 to user: Instance f476cc02-1b56-4c61-93a4-c3d36c38792d could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:17:18.589826 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-40527f2d-efdb-485a-ae54-2b8853de901f tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] 10.222.0.52 "DELETE /compute/v2.1/servers/f476cc02-1b56-4c61-93a4-c3d36c38792d" status: 404 len: 111 microversion: 2.1 time: 0.034730 Oct 19 03:17:18.589826 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 763/1468] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:17:18 2022] DELETE /compute/v2.1/servers/f476cc02-1b56-4c61-93a4-c3d36c38792d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:17:18.593253 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3e463909-167b-417d-b5ce-0e5c4207bfc3 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:18.593907 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3e463909-167b-417d-b5ce-0e5c4207bfc3 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] [instance: f476cc02-1b56-4c61-93a4-c3d36c38792d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:18.600431 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3e463909-167b-417d-b5ce-0e5c4207bfc3 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:18.600937 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3e463909-167b-417d-b5ce-0e5c4207bfc3 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:18.601430 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3e463909-167b-417d-b5ce-0e5c4207bfc3 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:18.601578 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-90587eb3-2f73-4452-a682-0307c19bced2 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:18.602102 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3e463909-167b-417d-b5ce-0e5c4207bfc3 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:18.602353 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-90587eb3-2f73-4452-a682-0307c19bced2 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:18.602559 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3e463909-167b-417d-b5ce-0e5c4207bfc3 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:18.604106 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3e463909-167b-417d-b5ce-0e5c4207bfc3 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:18.609697 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-90587eb3-2f73-4452-a682-0307c19bced2 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:18.612282 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-90587eb3-2f73-4452-a682-0307c19bced2 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:18.612282 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-90587eb3-2f73-4452-a682-0307c19bced2 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:18.612282 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-90587eb3-2f73-4452-a682-0307c19bced2 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:18.612282 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-90587eb3-2f73-4452-a682-0307c19bced2 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:18.612668 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-90587eb3-2f73-4452-a682-0307c19bced2 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:18.620978 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-3e463909-167b-417d-b5ce-0e5c4207bfc3 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] HTTP exception thrown: Instance f476cc02-1b56-4c61-93a4-c3d36c38792d could not be found. Oct 19 03:17:18.623780 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3e463909-167b-417d-b5ce-0e5c4207bfc3 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Request method failure captured: Oct 19 03:17:18.623780 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/f476cc02-1b56-4c61-93a4-c3d36c38792d HTTP/1.1 Oct 19 03:17:18.623780 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:17:18.623780 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:17:18.623780 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:17:18.623780 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:17:18.623780 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:17:18.623780 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:17:18.623780 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:17:18.623780 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:17:18.623780 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT2smH4Kc1-uSe7C0Z7t2DhigeC94XIsuadJrSic8X8t8KsS8n3ls_W0iazznmuf0f2bYTrElb8gsZFTWKaaDehji_uYTpF9SxhgOUkVzWW4LUI1AnnLWieM3JRGgGUXySqpYFIXrQ8nyIB7YETyDoBQnFZcFbjkvBO469dKOcvOf-G4 Oct 19 03:17:18.623780 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:17:18.623780 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:17:18.623780 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:17:18.623780 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:17:18.623780 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:17:18.623780 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:17:18.623780 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: df99b134b20743eb9b62788706f2705a Oct 19 03:17:18.623780 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1921827065 Oct 19 03:17:18.623780 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:17:18.623780 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:17:18.626247 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/df99b134b20743eb9b62788706f2705a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/df99b134b20743eb9b62788706f2705a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/df99b134b20743eb9b62788706f2705a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_df99b134b20743eb9b62788706f2705a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:17:18.626247 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1921827065 Oct 19 03:17:18.626247 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: df99b134b20743eb9b62788706f2705a Oct 19 03:17:18.626247 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1921827065 Oct 19 03:17:18.626247 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1921827065-project Oct 19 03:17:18.626247 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:17:18.626247 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:17:18.626247 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 2cc37ae4bed94a7e85ed70dd5942c2bd Oct 19 03:17:18.626247 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1921827065-project Oct 19 03:17:18.626247 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:17:18.626247 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance f476cc02-1b56-4c61-93a4-c3d36c38792d could not be found. Oct 19 03:17:18.626247 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': 'f476cc02-1b56-4c61-93a4-c3d36c38792d'} Oct 19 03:17:18.627304 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:17:18.627304 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:17:18.627304 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:17:18.627304 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:17:18.627304 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:17:18.627304 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:17:18.627304 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:17:18.627304 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:17:18.627304 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:17:18.627304 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:17:18.627304 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f476cc02-1b56-4c61-93a4-c3d36c38792d could not be found. Oct 19 03:17:18.627304 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:17:18.627304 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:17:18.627304 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:17:18.627304 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:17:18.627304 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:17:18.627304 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:17:18.627304 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:17:18.627304 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:17:18.627304 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:17:18.628806 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:17:18.628806 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:17:18.628806 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:17:18.628806 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:17:18.628806 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:17:18.628806 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:17:18.628806 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:17:18.628806 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f476cc02-1b56-4c61-93a4-c3d36c38792d could not be found. Oct 19 03:17:18.628806 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:17:18.628806 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:17:18.628806 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:17:18.628806 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:17:18.628806 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:17:18.628806 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:17:18.628806 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:17:18.628806 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:17:18.628806 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f476cc02-1b56-4c61-93a4-c3d36c38792d could not be found. Oct 19 03:17:18.628806 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:17:18.630706 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3e463909-167b-417d-b5ce-0e5c4207bfc3 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Returning 404 to user: Instance f476cc02-1b56-4c61-93a4-c3d36c38792d could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:17:18.630706 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3e463909-167b-417d-b5ce-0e5c4207bfc3 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] 10.222.0.52 "GET /compute/v2.1/servers/f476cc02-1b56-4c61-93a4-c3d36c38792d" status: 404 len: 111 microversion: 2.1 time: 0.037817 Oct 19 03:17:18.630706 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 706/1469] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:18 2022] GET /compute/v2.1/servers/f476cc02-1b56-4c61-93a4-c3d36c38792d => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:17:18.636875 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-677f0824-cf57-462b-9768-8ccaffd0e9d7 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Calling method '.version_select at 0x7fc130b57700>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:18.702758 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-90587eb3-2f73-4452-a682-0307c19bced2 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:18.716642 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-90587eb3-2f73-4452-a682-0307c19bced2 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:18.718340 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-90587eb3-2f73-4452-a682-0307c19bced2 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:18.723892 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-90587eb3-2f73-4452-a682-0307c19bced2 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1546 microversion: 2.91 time: 0.127059 Oct 19 03:17:18.731766 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 764/1470] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:17:18 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1546 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:17:18.753185 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-677f0824-cf57-462b-9768-8ccaffd0e9d7 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1415990507" status: 202 len: 0 microversion: 2.1 time: 0.121838 Oct 19 03:17:18.753887 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 707/1471] 10.222.0.52 () {58 vars in 1221 bytes} [Wed Oct 19 03:17:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1415990507 => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:17:18.929720 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-60b18b36-eb39-43d7-ae57-0f43b732309e tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:18.930367 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-60b18b36-eb39-43d7-ae57-0f43b732309e tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] [instance: fef11301-8524-4f9b-bf6f-e525fca3237d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:18.936308 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-60b18b36-eb39-43d7-ae57-0f43b732309e tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:18.936800 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-60b18b36-eb39-43d7-ae57-0f43b732309e tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:18.937242 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-60b18b36-eb39-43d7-ae57-0f43b732309e tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:18.938107 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-60b18b36-eb39-43d7-ae57-0f43b732309e tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:18.938564 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-60b18b36-eb39-43d7-ae57-0f43b732309e tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:18.938995 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-60b18b36-eb39-43d7-ae57-0f43b732309e tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:18.976117 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-60b18b36-eb39-43d7-ae57-0f43b732309e tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:18.976861 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-60b18b36-eb39-43d7-ae57-0f43b732309e tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:18.977142 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-60b18b36-eb39-43d7-ae57-0f43b732309e tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:18.977633 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-60b18b36-eb39-43d7-ae57-0f43b732309e tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lazy-loading 'fault' on Instance uuid fef11301-8524-4f9b-bf6f-e525fca3237d {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:17:19.089600 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-60b18b36-eb39-43d7-ae57-0f43b732309e tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c35b71372843d69f9a6c6be04b154f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcd49d68a3947249016cc5dbe910efc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:19.099882 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-60b18b36-eb39-43d7-ae57-0f43b732309e tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] 10.222.0.52 "GET /compute/v2.1/servers/fef11301-8524-4f9b-bf6f-e525fca3237d" status: 200 len: 1303 microversion: 2.1 time: 0.174057 Oct 19 03:17:19.100789 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 765/1472] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:18 2022] GET /compute/v2.1/servers/fef11301-8524-4f9b-bf6f-e525fca3237d => generated 1303 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:19.389709 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a5ac3536-d060-448f-982e-1723c00bf77a tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:19.390332 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a5ac3536-d060-448f-982e-1723c00bf77a tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: f03fef0e-680b-45bd-87a9-a3df948181cf] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:19.398708 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a5ac3536-d060-448f-982e-1723c00bf77a tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:19.399509 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a5ac3536-d060-448f-982e-1723c00bf77a tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:19.401043 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a5ac3536-d060-448f-982e-1723c00bf77a tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:19.402009 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a5ac3536-d060-448f-982e-1723c00bf77a tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:19.402642 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a5ac3536-d060-448f-982e-1723c00bf77a tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:19.403240 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a5ac3536-d060-448f-982e-1723c00bf77a tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:19.567750 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e81eda64-7924-4ee6-bd8e-804ca510b738 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:19.570111 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e81eda64-7924-4ee6-bd8e-804ca510b738 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] [instance: 540a7025-b935-49fb-bc51-edf44ac1e0c4] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:19.583028 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e81eda64-7924-4ee6-bd8e-804ca510b738 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:19.583649 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e81eda64-7924-4ee6-bd8e-804ca510b738 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:19.584031 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e81eda64-7924-4ee6-bd8e-804ca510b738 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:19.585331 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e81eda64-7924-4ee6-bd8e-804ca510b738 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:19.585811 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e81eda64-7924-4ee6-bd8e-804ca510b738 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:19.586245 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e81eda64-7924-4ee6-bd8e-804ca510b738 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:19.595148 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=100 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:17:19.729170 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e81eda64-7924-4ee6-bd8e-804ca510b738 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] 10.222.0.52 "GET /compute/v2.1/servers/540a7025-b935-49fb-bc51-edf44ac1e0c4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.165185 Oct 19 03:17:19.733492 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 766/1473] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Oct 19 03:17:19 2022] GET /compute/v2.1/servers/540a7025-b935-49fb-bc51-edf44ac1e0c4/os-volume_attachments => generated 197 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:17:19.738700 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6e7a80f1-5fe5-4378-bd19-e43df82110bb tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:19.740074 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6e7a80f1-5fe5-4378-bd19-e43df82110bb tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 84774cfc-79b4-42db-acfd-c4daac86d196] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:19.749591 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=100 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:17:19.753624 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6e7a80f1-5fe5-4378-bd19-e43df82110bb tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:19.755131 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6e7a80f1-5fe5-4378-bd19-e43df82110bb tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:19.758042 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6e7a80f1-5fe5-4378-bd19-e43df82110bb tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:19.758882 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6e7a80f1-5fe5-4378-bd19-e43df82110bb tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:19.761905 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6e7a80f1-5fe5-4378-bd19-e43df82110bb tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:19.767174 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6e7a80f1-5fe5-4378-bd19-e43df82110bb tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:20.150617 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a5ac3536-d060-448f-982e-1723c00bf77a tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:20.160102 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a5ac3536-d060-448f-982e-1723c00bf77a tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/f03fef0e-680b-45bd-87a9-a3df948181cf" status: 200 len: 1471 microversion: 2.1 time: 0.775719 Oct 19 03:17:20.172094 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 708/1474] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:19 2022] GET /compute/v2.1/servers/f03fef0e-680b-45bd-87a9-a3df948181cf => generated 1471 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:20.172094 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7522733b-ea46-4bf1-8a00-43770642281d tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:20.172094 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7522733b-ea46-4bf1-8a00-43770642281d tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:20.172756 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7522733b-ea46-4bf1-8a00-43770642281d tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:20.173206 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7522733b-ea46-4bf1-8a00-43770642281d tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:20.173676 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7522733b-ea46-4bf1-8a00-43770642281d tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:20.174374 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7522733b-ea46-4bf1-8a00-43770642281d tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:20.174996 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7522733b-ea46-4bf1-8a00-43770642281d tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:20.175421 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7522733b-ea46-4bf1-8a00-43770642281d tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:20.203613 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-6e7a80f1-5fe5-4378-bd19-e43df82110bb tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:20.225702 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6e7a80f1-5fe5-4378-bd19-e43df82110bb tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196" status: 200 len: 1470 microversion: 2.1 time: 0.491118 Oct 19 03:17:20.238322 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 767/1475] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:19 2022] GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196 => generated 1470 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:20.247617 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0f74ac2f-4672-4d1f-b321-4645d794bbd1 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:20.249208 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0f74ac2f-4672-4d1f-b321-4645d794bbd1 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] [instance: fef11301-8524-4f9b-bf6f-e525fca3237d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:20.257641 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0f74ac2f-4672-4d1f-b321-4645d794bbd1 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:20.258940 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0f74ac2f-4672-4d1f-b321-4645d794bbd1 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:20.260529 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0f74ac2f-4672-4d1f-b321-4645d794bbd1 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:20.261539 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0f74ac2f-4672-4d1f-b321-4645d794bbd1 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:20.262640 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0f74ac2f-4672-4d1f-b321-4645d794bbd1 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:20.263285 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0f74ac2f-4672-4d1f-b321-4645d794bbd1 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:20.300695 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0f74ac2f-4672-4d1f-b321-4645d794bbd1 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:20.301646 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0f74ac2f-4672-4d1f-b321-4645d794bbd1 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:20.302302 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0f74ac2f-4672-4d1f-b321-4645d794bbd1 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:20.302764 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-0f74ac2f-4672-4d1f-b321-4645d794bbd1 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lazy-loading 'fault' on Instance uuid fef11301-8524-4f9b-bf6f-e525fca3237d {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:17:20.361323 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-7522733b-ea46-4bf1-8a00-43770642281d tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:20.369208 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-7522733b-ea46-4bf1-8a00-43770642281d tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:20.371083 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-7522733b-ea46-4bf1-8a00-43770642281d tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:20.376662 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7522733b-ea46-4bf1-8a00-43770642281d tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1546 microversion: 2.91 time: 0.214755 Oct 19 03:17:20.378177 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 709/1476] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:17:20 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1546 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:17:20.390497 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-0f74ac2f-4672-4d1f-b321-4645d794bbd1 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c35b71372843d69f9a6c6be04b154f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcd49d68a3947249016cc5dbe910efc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:20.401059 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0f74ac2f-4672-4d1f-b321-4645d794bbd1 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] 10.222.0.52 "GET /compute/v2.1/servers/fef11301-8524-4f9b-bf6f-e525fca3237d" status: 200 len: 1303 microversion: 2.1 time: 0.161508 Oct 19 03:17:20.401771 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 768/1477] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:20 2022] GET /compute/v2.1/servers/fef11301-8524-4f9b-bf6f-e525fca3237d => generated 1303 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:20.559239 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-5682e211-ddf2-4c8c-92e7-50018aa01619 req-5b905814-bd9f-4c9a-940c-bde071765095 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f03fef0e-680b-45bd-87a9-a3df948181cf", "name": "network-vif-deleted", "tag": "6e9a5918-2f60-411c-8ab7-8e2f61d6894d"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:17:20.581861 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-5682e211-ddf2-4c8c-92e7-50018aa01619 req-5b905814-bd9f-4c9a-940c-bde071765095 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:20.582348 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-5682e211-ddf2-4c8c-92e7-50018aa01619 req-5b905814-bd9f-4c9a-940c-bde071765095 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:20.582775 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-5682e211-ddf2-4c8c-92e7-50018aa01619 req-5b905814-bd9f-4c9a-940c-bde071765095 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:20.633350 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-5682e211-ddf2-4c8c-92e7-50018aa01619 req-5b905814-bd9f-4c9a-940c-bde071765095 service nova] Creating event network-vif-deleted:6e9a5918-2f60-411c-8ab7-8e2f61d6894d for instance f03fef0e-680b-45bd-87a9-a3df948181cf on n-h2-861333-8 Oct 19 03:17:20.649267 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f775b184-c5a9-49ab-9c63-7cfafa18229c tempest-ServersWithSpecificFlavorTestJSON-943474520 tempest-ServersWithSpecificFlavorTestJSON-943474520-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:20.660416 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-5682e211-ddf2-4c8c-92e7-50018aa01619 req-5b905814-bd9f-4c9a-940c-bde071765095 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111893 Oct 19 03:17:20.661416 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 710/1478] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:17:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:17:20.744406 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5575c028-48d6-4488-84ac-cf42b97478e7 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:20.746668 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5575c028-48d6-4488-84ac-cf42b97478e7 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] [instance: 540a7025-b935-49fb-bc51-edf44ac1e0c4] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:20.753982 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5575c028-48d6-4488-84ac-cf42b97478e7 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:20.754469 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5575c028-48d6-4488-84ac-cf42b97478e7 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:20.760136 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f775b184-c5a9-49ab-9c63-7cfafa18229c tempest-ServersWithSpecificFlavorTestJSON-943474520 tempest-ServersWithSpecificFlavorTestJSON-943474520-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/214789776" status: 202 len: 0 microversion: 2.1 time: 0.116223 Oct 19 03:17:20.761449 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 769/1479] 10.222.0.52 () {58 vars in 1158 bytes} [Wed Oct 19 03:17:20 2022] DELETE /compute/v2.1/flavors/214789776 => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 19 03:17:20.766734 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5575c028-48d6-4488-84ac-cf42b97478e7 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:20.769603 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-55633413-286b-4f09-9daa-6d722bf829b5 tempest-ServersWithSpecificFlavorTestJSON-943474520 tempest-ServersWithSpecificFlavorTestJSON-943474520-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:20.781484 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5575c028-48d6-4488-84ac-cf42b97478e7 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:20.781895 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5575c028-48d6-4488-84ac-cf42b97478e7 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:20.782374 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5575c028-48d6-4488-84ac-cf42b97478e7 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:20.816162 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-55633413-286b-4f09-9daa-6d722bf829b5 tempest-ServersWithSpecificFlavorTestJSON-943474520 tempest-ServersWithSpecificFlavorTestJSON-943474520-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5403 microversion: 2.1 time: 0.049995 Oct 19 03:17:20.830484 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 770/1480] 10.222.0.52 () {58 vars in 1146 bytes} [Wed Oct 19 03:17:20 2022] GET /compute/v2.1/flavors/detail => generated 5403 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:20.838863 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f168f642-3224-4d78-8d92-b46f72bb3f1b tempest-ServersWithSpecificFlavorTestJSON-943474520 tempest-ServersWithSpecificFlavorTestJSON-943474520-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:20.872188 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5575c028-48d6-4488-84ac-cf42b97478e7 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] 10.222.0.52 "GET /compute/v2.1/servers/540a7025-b935-49fb-bc51-edf44ac1e0c4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.132267 Oct 19 03:17:20.874984 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 711/1481] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Oct 19 03:17:20 2022] GET /compute/v2.1/servers/540a7025-b935-49fb-bc51-edf44ac1e0c4/os-volume_attachments => generated 197 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:17:20.963880 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f168f642-3224-4d78-8d92-b46f72bb3f1b tempest-ServersWithSpecificFlavorTestJSON-943474520 tempest-ServersWithSpecificFlavorTestJSON-943474520-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/568006541" status: 202 len: 0 microversion: 2.1 time: 0.128966 Oct 19 03:17:20.968221 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 771/1482] 10.222.0.52 () {58 vars in 1158 bytes} [Wed Oct 19 03:17:20 2022] DELETE /compute/v2.1/flavors/568006541 => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:17:20.977702 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-53c45d55-cc7c-4c23-a6f1-e27b6fbef83b tempest-ServersWithSpecificFlavorTestJSON-943474520 tempest-ServersWithSpecificFlavorTestJSON-943474520-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:21.003276 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-53c45d55-cc7c-4c23-a6f1-e27b6fbef83b tempest-ServersWithSpecificFlavorTestJSON-943474520 tempest-ServersWithSpecificFlavorTestJSON-943474520-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.033704 Oct 19 03:17:21.004398 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 712/1483] 10.222.0.52 () {58 vars in 1146 bytes} [Wed Oct 19 03:17:20 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:17:21.052041 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-98e9468a-1829-40be-a188-8c97fe37d299 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:21.054306 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-98e9468a-1829-40be-a188-8c97fe37d299 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] [instance: 6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:21.068515 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-98e9468a-1829-40be-a188-8c97fe37d299 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:21.069346 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-98e9468a-1829-40be-a188-8c97fe37d299 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:21.070366 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-98e9468a-1829-40be-a188-8c97fe37d299 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:21.072453 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-98e9468a-1829-40be-a188-8c97fe37d299 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:21.075481 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-98e9468a-1829-40be-a188-8c97fe37d299 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:21.077416 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-98e9468a-1829-40be-a188-8c97fe37d299 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:21.101750 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-98e9468a-1829-40be-a188-8c97fe37d299 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] HTTP exception thrown: Instance 6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1 could not be found. Oct 19 03:17:21.104220 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-98e9468a-1829-40be-a188-8c97fe37d299 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Request method failure captured: Oct 19 03:17:21.104220 n-d-861333-8 devstack@n-api.service[121135]: request: DELETE /compute/v2.1/servers/6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1 HTTP/1.1 Oct 19 03:17:21.104220 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:17:21.104220 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:17:21.104220 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:17:21.104220 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:17:21.104220 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:17:21.104220 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:17:21.104220 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:17:21.104220 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:17:21.104220 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2smH4Kc1-uSe7C0Z7t2DhigeC94XIsuadJrSic8X8t8KsS8n3ls_W0iazznmuf0f2bYTrElb8gsZFTWKaaDehji_uYTpF9SxhgOUkVzWW4LUI1AnnLWieM3JRGgGUXySqpYFIXrQ8nyIB7YETyDoBQnFZcFbjkvBO469dKOcvOf-G4 Oct 19 03:17:21.104220 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:17:21.104220 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:17:21.104220 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:17:21.104220 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:17:21.104220 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:17:21.104220 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:17:21.104220 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: df99b134b20743eb9b62788706f2705a Oct 19 03:17:21.104220 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1921827065 Oct 19 03:17:21.104220 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:17:21.104220 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:17:21.112304 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/df99b134b20743eb9b62788706f2705a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/df99b134b20743eb9b62788706f2705a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/df99b134b20743eb9b62788706f2705a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_df99b134b20743eb9b62788706f2705a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:17:21.112304 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1921827065 Oct 19 03:17:21.112304 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: df99b134b20743eb9b62788706f2705a Oct 19 03:17:21.112304 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1921827065 Oct 19 03:17:21.112304 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1921827065-project Oct 19 03:17:21.112304 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:17:21.112304 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:17:21.112304 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 2cc37ae4bed94a7e85ed70dd5942c2bd Oct 19 03:17:21.112304 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1921827065-project Oct 19 03:17:21.112304 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:17:21.112304 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance 6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1 could not be found. Oct 19 03:17:21.112304 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1'} Oct 19 03:17:21.113134 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:17:21.113134 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:17:21.113134 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:17:21.113134 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:17:21.113134 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:17:21.113134 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:17:21.113134 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:17:21.113134 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:17:21.113134 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:17:21.113134 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:17:21.113134 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1 could not be found. Oct 19 03:17:21.113134 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:17:21.113134 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:17:21.113134 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:17:21.113134 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:17:21.113134 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:17:21.113134 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:17:21.113134 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:17:21.113134 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:17:21.113134 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:17:21.114381 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:17:21.114381 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 03:17:21.114381 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 03:17:21.114381 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 03:17:21.114381 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 03:17:21.114381 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:17:21.114381 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:17:21.114381 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:17:21.114381 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:17:21.114381 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1 could not be found. Oct 19 03:17:21.114381 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:17:21.114381 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:17:21.114381 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:17:21.114381 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:17:21.114381 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:17:21.114381 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:17:21.114381 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:17:21.114381 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:17:21.114381 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1 could not be found. Oct 19 03:17:21.114381 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:17:21.116408 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-98e9468a-1829-40be-a188-8c97fe37d299 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Returning 404 to user: Instance 6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:17:21.116408 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-98e9468a-1829-40be-a188-8c97fe37d299 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] 10.222.0.52 "DELETE /compute/v2.1/servers/6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1" status: 404 len: 111 microversion: 2.1 time: 0.069778 Oct 19 03:17:21.116408 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 772/1484] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:17:21 2022] DELETE /compute/v2.1/servers/6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:17:21.121984 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-96b43b04-4f83-4587-9d96-060f8f4a8478 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:21.122624 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-96b43b04-4f83-4587-9d96-060f8f4a8478 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] [instance: 6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:21.129802 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-96b43b04-4f83-4587-9d96-060f8f4a8478 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:21.131279 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-96b43b04-4f83-4587-9d96-060f8f4a8478 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:21.131856 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-96b43b04-4f83-4587-9d96-060f8f4a8478 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:21.132643 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-96b43b04-4f83-4587-9d96-060f8f4a8478 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:21.133113 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-96b43b04-4f83-4587-9d96-060f8f4a8478 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:21.133776 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-96b43b04-4f83-4587-9d96-060f8f4a8478 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:21.149128 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-96b43b04-4f83-4587-9d96-060f8f4a8478 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] HTTP exception thrown: Instance 6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1 could not be found. Oct 19 03:17:21.151266 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-96b43b04-4f83-4587-9d96-060f8f4a8478 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Request method failure captured: Oct 19 03:17:21.151266 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1 HTTP/1.1 Oct 19 03:17:21.151266 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:17:21.151266 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:17:21.151266 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:17:21.151266 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:17:21.151266 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:17:21.151266 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:17:21.151266 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:17:21.151266 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:17:21.151266 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT2smH4Kc1-uSe7C0Z7t2DhigeC94XIsuadJrSic8X8t8KsS8n3ls_W0iazznmuf0f2bYTrElb8gsZFTWKaaDehji_uYTpF9SxhgOUkVzWW4LUI1AnnLWieM3JRGgGUXySqpYFIXrQ8nyIB7YETyDoBQnFZcFbjkvBO469dKOcvOf-G4 Oct 19 03:17:21.151266 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:17:21.151266 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:17:21.151266 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:17:21.151266 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:17:21.151266 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:17:21.151266 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:17:21.151266 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: df99b134b20743eb9b62788706f2705a Oct 19 03:17:21.151266 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1921827065 Oct 19 03:17:21.151266 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:17:21.151266 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:17:21.153333 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/df99b134b20743eb9b62788706f2705a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/df99b134b20743eb9b62788706f2705a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/df99b134b20743eb9b62788706f2705a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_df99b134b20743eb9b62788706f2705a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:17:21.153333 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1921827065 Oct 19 03:17:21.153333 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: df99b134b20743eb9b62788706f2705a Oct 19 03:17:21.153333 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1921827065 Oct 19 03:17:21.153333 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1921827065-project Oct 19 03:17:21.153333 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:17:21.153333 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:17:21.153333 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 2cc37ae4bed94a7e85ed70dd5942c2bd Oct 19 03:17:21.153333 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1921827065-project Oct 19 03:17:21.153333 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:17:21.153333 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance 6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1 could not be found. Oct 19 03:17:21.153333 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1'} Oct 19 03:17:21.154300 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:17:21.154300 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:17:21.154300 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:17:21.154300 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:17:21.154300 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:17:21.154300 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:17:21.154300 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:17:21.154300 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:17:21.154300 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:17:21.154300 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:17:21.154300 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1 could not be found. Oct 19 03:17:21.154300 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:17:21.154300 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:17:21.154300 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:17:21.154300 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:17:21.154300 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:17:21.154300 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:17:21.154300 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:17:21.154300 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:17:21.154300 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:17:21.155725 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:17:21.155725 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:17:21.155725 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:17:21.155725 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:17:21.155725 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:17:21.155725 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:17:21.155725 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:17:21.155725 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1 could not be found. Oct 19 03:17:21.155725 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:17:21.155725 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:17:21.155725 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:17:21.155725 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:17:21.155725 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:17:21.155725 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:17:21.155725 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:17:21.155725 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:17:21.155725 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1 could not be found. Oct 19 03:17:21.155725 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:17:21.157118 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-96b43b04-4f83-4587-9d96-060f8f4a8478 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Returning 404 to user: Instance 6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:17:21.157118 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-96b43b04-4f83-4587-9d96-060f8f4a8478 tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] 10.222.0.52 "GET /compute/v2.1/servers/6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1" status: 404 len: 111 microversion: 2.1 time: 0.040717 Oct 19 03:17:21.163679 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7f8d6347-ae54-404b-84e8-b7871dc88eeb tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:21.163679 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7f8d6347-ae54-404b-84e8-b7871dc88eeb tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] [instance: f476cc02-1b56-4c61-93a4-c3d36c38792d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:21.166290 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 713/1485] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:21 2022] GET /compute/v2.1/servers/6f2e40ef-ba8c-47a8-9d4a-b62d4f8303b1 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:17:21.169953 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7f8d6347-ae54-404b-84e8-b7871dc88eeb tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:21.170820 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7f8d6347-ae54-404b-84e8-b7871dc88eeb tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:21.171272 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7f8d6347-ae54-404b-84e8-b7871dc88eeb tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:21.171984 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7f8d6347-ae54-404b-84e8-b7871dc88eeb tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:21.172443 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7f8d6347-ae54-404b-84e8-b7871dc88eeb tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:21.172935 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7f8d6347-ae54-404b-84e8-b7871dc88eeb tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:21.188427 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f5170387-f2ce-455e-8661-f34526db8908 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:21.189731 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f5170387-f2ce-455e-8661-f34526db8908 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: f03fef0e-680b-45bd-87a9-a3df948181cf] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:21.197314 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f5170387-f2ce-455e-8661-f34526db8908 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:21.198064 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f5170387-f2ce-455e-8661-f34526db8908 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:21.199335 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f5170387-f2ce-455e-8661-f34526db8908 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:21.200382 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-7f8d6347-ae54-404b-84e8-b7871dc88eeb tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] HTTP exception thrown: Instance f476cc02-1b56-4c61-93a4-c3d36c38792d could not be found. Oct 19 03:17:21.201399 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f5170387-f2ce-455e-8661-f34526db8908 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:21.202105 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f5170387-f2ce-455e-8661-f34526db8908 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:21.202780 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f5170387-f2ce-455e-8661-f34526db8908 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:21.218672 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7f8d6347-ae54-404b-84e8-b7871dc88eeb tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Request method failure captured: Oct 19 03:17:21.218672 n-d-861333-8 devstack@n-api.service[121135]: request: DELETE /compute/v2.1/servers/f476cc02-1b56-4c61-93a4-c3d36c38792d HTTP/1.1 Oct 19 03:17:21.218672 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:17:21.218672 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:17:21.218672 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:17:21.218672 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:17:21.218672 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:17:21.218672 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:17:21.218672 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:17:21.218672 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:17:21.218672 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2smH4Kc1-uSe7C0Z7t2DhigeC94XIsuadJrSic8X8t8KsS8n3ls_W0iazznmuf0f2bYTrElb8gsZFTWKaaDehji_uYTpF9SxhgOUkVzWW4LUI1AnnLWieM3JRGgGUXySqpYFIXrQ8nyIB7YETyDoBQnFZcFbjkvBO469dKOcvOf-G4 Oct 19 03:17:21.218672 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:17:21.218672 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:17:21.218672 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:17:21.218672 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:17:21.218672 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:17:21.218672 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:17:21.218672 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: df99b134b20743eb9b62788706f2705a Oct 19 03:17:21.218672 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1921827065 Oct 19 03:17:21.218672 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:17:21.218672 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:17:21.220135 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/df99b134b20743eb9b62788706f2705a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/df99b134b20743eb9b62788706f2705a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/df99b134b20743eb9b62788706f2705a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_df99b134b20743eb9b62788706f2705a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:17:21.220135 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1921827065 Oct 19 03:17:21.220135 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: df99b134b20743eb9b62788706f2705a Oct 19 03:17:21.220135 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1921827065 Oct 19 03:17:21.220135 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1921827065-project Oct 19 03:17:21.220135 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:17:21.220135 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:17:21.220135 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 2cc37ae4bed94a7e85ed70dd5942c2bd Oct 19 03:17:21.220135 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1921827065-project Oct 19 03:17:21.220135 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:17:21.220135 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance f476cc02-1b56-4c61-93a4-c3d36c38792d could not be found. Oct 19 03:17:21.220135 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': 'f476cc02-1b56-4c61-93a4-c3d36c38792d'} Oct 19 03:17:21.220884 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:17:21.220884 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:17:21.220884 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:17:21.220884 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:17:21.220884 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:17:21.220884 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:17:21.220884 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:17:21.220884 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:17:21.220884 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:17:21.220884 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:17:21.220884 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f476cc02-1b56-4c61-93a4-c3d36c38792d could not be found. Oct 19 03:17:21.220884 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:17:21.220884 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:17:21.220884 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:17:21.220884 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:17:21.220884 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:17:21.220884 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:17:21.220884 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:17:21.220884 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:17:21.220884 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:17:21.222158 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:17:21.222158 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 03:17:21.222158 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 03:17:21.222158 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 03:17:21.222158 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 03:17:21.222158 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:17:21.222158 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:17:21.222158 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:17:21.222158 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:17:21.222158 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f476cc02-1b56-4c61-93a4-c3d36c38792d could not be found. Oct 19 03:17:21.222158 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:17:21.222158 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:17:21.222158 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:17:21.222158 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:17:21.222158 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:17:21.222158 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:17:21.222158 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:17:21.222158 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:17:21.222158 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f476cc02-1b56-4c61-93a4-c3d36c38792d could not be found. Oct 19 03:17:21.222158 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:17:21.226373 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7f8d6347-ae54-404b-84e8-b7871dc88eeb tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Returning 404 to user: Instance f476cc02-1b56-4c61-93a4-c3d36c38792d could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:17:21.228975 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7f8d6347-ae54-404b-84e8-b7871dc88eeb tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] 10.222.0.52 "DELETE /compute/v2.1/servers/f476cc02-1b56-4c61-93a4-c3d36c38792d" status: 404 len: 111 microversion: 2.1 time: 0.070182 Oct 19 03:17:21.236175 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 773/1486] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:17:21 2022] DELETE /compute/v2.1/servers/f476cc02-1b56-4c61-93a4-c3d36c38792d => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:17:21.247899 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2a704a2e-3a43-4b91-aecc-c2da0315cdfc tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:21.249084 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-2a704a2e-3a43-4b91-aecc-c2da0315cdfc tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] [instance: f476cc02-1b56-4c61-93a4-c3d36c38792d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:21.261294 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2a704a2e-3a43-4b91-aecc-c2da0315cdfc tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:21.266859 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2a704a2e-3a43-4b91-aecc-c2da0315cdfc tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:21.267700 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2a704a2e-3a43-4b91-aecc-c2da0315cdfc tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:21.270677 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2a704a2e-3a43-4b91-aecc-c2da0315cdfc tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:21.270677 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2a704a2e-3a43-4b91-aecc-c2da0315cdfc tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:21.270677 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2a704a2e-3a43-4b91-aecc-c2da0315cdfc tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:21.274040 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f5170387-f2ce-455e-8661-f34526db8908 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:21.275591 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f5170387-f2ce-455e-8661-f34526db8908 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:21.277264 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f5170387-f2ce-455e-8661-f34526db8908 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:21.277936 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-f5170387-f2ce-455e-8661-f34526db8908 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lazy-loading 'fault' on Instance uuid f03fef0e-680b-45bd-87a9-a3df948181cf {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:17:21.308792 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-2a704a2e-3a43-4b91-aecc-c2da0315cdfc tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] HTTP exception thrown: Instance f476cc02-1b56-4c61-93a4-c3d36c38792d could not be found. Oct 19 03:17:21.310944 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2a704a2e-3a43-4b91-aecc-c2da0315cdfc tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Request method failure captured: Oct 19 03:17:21.310944 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/f476cc02-1b56-4c61-93a4-c3d36c38792d HTTP/1.1 Oct 19 03:17:21.310944 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:17:21.310944 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:17:21.310944 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:17:21.310944 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:17:21.310944 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:17:21.310944 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:17:21.310944 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:17:21.310944 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:17:21.310944 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2smH4Kc1-uSe7C0Z7t2DhigeC94XIsuadJrSic8X8t8KsS8n3ls_W0iazznmuf0f2bYTrElb8gsZFTWKaaDehji_uYTpF9SxhgOUkVzWW4LUI1AnnLWieM3JRGgGUXySqpYFIXrQ8nyIB7YETyDoBQnFZcFbjkvBO469dKOcvOf-G4 Oct 19 03:17:21.310944 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:17:21.310944 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:17:21.310944 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:17:21.310944 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:17:21.310944 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:17:21.310944 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:17:21.310944 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: df99b134b20743eb9b62788706f2705a Oct 19 03:17:21.310944 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1921827065 Oct 19 03:17:21.310944 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:17:21.310944 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:17:21.312490 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/df99b134b20743eb9b62788706f2705a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/df99b134b20743eb9b62788706f2705a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/df99b134b20743eb9b62788706f2705a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_df99b134b20743eb9b62788706f2705a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:17:21.312490 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1921827065 Oct 19 03:17:21.312490 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: df99b134b20743eb9b62788706f2705a Oct 19 03:17:21.312490 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1921827065 Oct 19 03:17:21.312490 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1921827065-project Oct 19 03:17:21.312490 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:17:21.312490 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:17:21.312490 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 2cc37ae4bed94a7e85ed70dd5942c2bd Oct 19 03:17:21.312490 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1921827065-project Oct 19 03:17:21.312490 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:17:21.312490 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance f476cc02-1b56-4c61-93a4-c3d36c38792d could not be found. Oct 19 03:17:21.312490 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': 'f476cc02-1b56-4c61-93a4-c3d36c38792d'} Oct 19 03:17:21.313453 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:17:21.313453 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:17:21.313453 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:17:21.313453 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:17:21.313453 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:17:21.313453 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:17:21.313453 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:17:21.313453 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:17:21.313453 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:17:21.313453 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:17:21.313453 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f476cc02-1b56-4c61-93a4-c3d36c38792d could not be found. Oct 19 03:17:21.313453 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:17:21.313453 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:17:21.313453 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:17:21.313453 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:17:21.313453 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:17:21.313453 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:17:21.313453 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:17:21.313453 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:17:21.313453 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:17:21.315450 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:17:21.315450 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:17:21.315450 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:17:21.315450 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:17:21.315450 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:17:21.315450 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:17:21.315450 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:17:21.315450 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f476cc02-1b56-4c61-93a4-c3d36c38792d could not be found. Oct 19 03:17:21.315450 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:17:21.315450 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:17:21.315450 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:17:21.315450 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:17:21.315450 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:17:21.315450 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:17:21.315450 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:17:21.315450 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:17:21.315450 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f476cc02-1b56-4c61-93a4-c3d36c38792d could not be found. Oct 19 03:17:21.315450 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:17:21.318312 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2a704a2e-3a43-4b91-aecc-c2da0315cdfc tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] Returning 404 to user: Instance f476cc02-1b56-4c61-93a4-c3d36c38792d could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:17:21.323583 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2a704a2e-3a43-4b91-aecc-c2da0315cdfc tempest-ServersWithSpecificFlavorTestJSON-1921827065 tempest-ServersWithSpecificFlavorTestJSON-1921827065-project] 10.222.0.52 "GET /compute/v2.1/servers/f476cc02-1b56-4c61-93a4-c3d36c38792d" status: 404 len: 111 microversion: 2.1 time: 0.083400 Oct 19 03:17:21.323583 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 774/1487] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:21 2022] GET /compute/v2.1/servers/f476cc02-1b56-4c61-93a4-c3d36c38792d => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:17:21.329035 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-f5170387-f2ce-455e-8661-f34526db8908 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:21.332801 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4c7be1bc-9dc7-4936-ad3a-4796a9d9525b tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:21.333771 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4c7be1bc-9dc7-4936-ad3a-4796a9d9525b tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 84774cfc-79b4-42db-acfd-c4daac86d196] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:21.340528 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f5170387-f2ce-455e-8661-f34526db8908 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/f03fef0e-680b-45bd-87a9-a3df948181cf" status: 200 len: 1306 microversion: 2.1 time: 0.155943 Oct 19 03:17:21.341650 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 714/1488] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:21 2022] GET /compute/v2.1/servers/f03fef0e-680b-45bd-87a9-a3df948181cf => generated 1306 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:17:21.347143 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4c7be1bc-9dc7-4936-ad3a-4796a9d9525b tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:21.347653 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4c7be1bc-9dc7-4936-ad3a-4796a9d9525b tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:21.348099 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4c7be1bc-9dc7-4936-ad3a-4796a9d9525b tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:21.348824 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4c7be1bc-9dc7-4936-ad3a-4796a9d9525b tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:21.349282 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4c7be1bc-9dc7-4936-ad3a-4796a9d9525b tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:21.349744 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4c7be1bc-9dc7-4936-ad3a-4796a9d9525b tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:21.414050 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-48d424d3-8518-4f7d-bab8-b3230836888e tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:21.414858 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-48d424d3-8518-4f7d-bab8-b3230836888e tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:21.427932 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-48d424d3-8518-4f7d-bab8-b3230836888e tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:21.433599 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-48d424d3-8518-4f7d-bab8-b3230836888e tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:21.433599 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-48d424d3-8518-4f7d-bab8-b3230836888e tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:21.433599 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-48d424d3-8518-4f7d-bab8-b3230836888e tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:21.433599 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-48d424d3-8518-4f7d-bab8-b3230836888e tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:21.434177 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-48d424d3-8518-4f7d-bab8-b3230836888e tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:21.580870 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-48d424d3-8518-4f7d-bab8-b3230836888e tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:21.594344 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-48d424d3-8518-4f7d-bab8-b3230836888e tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:21.600833 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-48d424d3-8518-4f7d-bab8-b3230836888e tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:21.651616 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-48d424d3-8518-4f7d-bab8-b3230836888e tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1546 microversion: 2.91 time: 0.224524 Oct 19 03:17:21.654407 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 715/1489] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:17:21 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1546 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:17:21.676272 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2a84adf8-78f8-4528-a4f8-0818680e3d75 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:21.683157 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2a84adf8-78f8-4528-a4f8-0818680e3d75 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] [instance: fef11301-8524-4f9b-bf6f-e525fca3237d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:21.700591 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2a84adf8-78f8-4528-a4f8-0818680e3d75 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:21.702974 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2a84adf8-78f8-4528-a4f8-0818680e3d75 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:21.703417 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2a84adf8-78f8-4528-a4f8-0818680e3d75 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:21.705266 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2a84adf8-78f8-4528-a4f8-0818680e3d75 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:21.705972 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2a84adf8-78f8-4528-a4f8-0818680e3d75 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:21.706667 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2a84adf8-78f8-4528-a4f8-0818680e3d75 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:21.746658 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2a84adf8-78f8-4528-a4f8-0818680e3d75 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:21.747479 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2a84adf8-78f8-4528-a4f8-0818680e3d75 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:21.748146 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2a84adf8-78f8-4528-a4f8-0818680e3d75 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:21.749160 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-2a84adf8-78f8-4528-a4f8-0818680e3d75 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lazy-loading 'fault' on Instance uuid fef11301-8524-4f9b-bf6f-e525fca3237d {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:17:21.750735 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4c7be1bc-9dc7-4936-ad3a-4796a9d9525b tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:21.763540 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4c7be1bc-9dc7-4936-ad3a-4796a9d9525b tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196" status: 200 len: 1470 microversion: 2.1 time: 0.441009 Oct 19 03:17:21.764587 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 775/1490] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:21 2022] GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196 => generated 1470 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:21.799044 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-2a84adf8-78f8-4528-a4f8-0818680e3d75 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c35b71372843d69f9a6c6be04b154f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcd49d68a3947249016cc5dbe910efc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:21.810120 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2a84adf8-78f8-4528-a4f8-0818680e3d75 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] 10.222.0.52 "GET /compute/v2.1/servers/fef11301-8524-4f9b-bf6f-e525fca3237d" status: 200 len: 1303 microversion: 2.1 time: 0.148919 Oct 19 03:17:21.810817 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 716/1491] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:21 2022] GET /compute/v2.1/servers/fef11301-8524-4f9b-bf6f-e525fca3237d => generated 1303 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:21.889053 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-fb959914-2013-496d-9a9a-b345b021581e tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:21.891292 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-fb959914-2013-496d-9a9a-b345b021581e tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] [instance: 540a7025-b935-49fb-bc51-edf44ac1e0c4] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:21.898404 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fb959914-2013-496d-9a9a-b345b021581e tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:21.903540 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fb959914-2013-496d-9a9a-b345b021581e tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:21.903540 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fb959914-2013-496d-9a9a-b345b021581e tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:21.903540 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fb959914-2013-496d-9a9a-b345b021581e tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:21.903540 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fb959914-2013-496d-9a9a-b345b021581e tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:21.903867 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fb959914-2013-496d-9a9a-b345b021581e tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:21.941526 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-fb959914-2013-496d-9a9a-b345b021581e tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] 10.222.0.52 "GET /compute/v2.1/servers/540a7025-b935-49fb-bc51-edf44ac1e0c4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056834 Oct 19 03:17:21.951782 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 776/1492] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Oct 19 03:17:21 2022] GET /compute/v2.1/servers/540a7025-b935-49fb-bc51-edf44ac1e0c4/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:17:22.364460 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4f142b3b-267d-4ca4-a167-5ecbc0d588e6 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:22.366730 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4f142b3b-267d-4ca4-a167-5ecbc0d588e6 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: f03fef0e-680b-45bd-87a9-a3df948181cf] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:22.375221 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4f142b3b-267d-4ca4-a167-5ecbc0d588e6 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:22.375840 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4f142b3b-267d-4ca4-a167-5ecbc0d588e6 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:22.376387 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4f142b3b-267d-4ca4-a167-5ecbc0d588e6 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:22.377203 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4f142b3b-267d-4ca4-a167-5ecbc0d588e6 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:22.377902 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4f142b3b-267d-4ca4-a167-5ecbc0d588e6 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:22.378623 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4f142b3b-267d-4ca4-a167-5ecbc0d588e6 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:22.419892 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4f142b3b-267d-4ca4-a167-5ecbc0d588e6 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:22.420828 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4f142b3b-267d-4ca4-a167-5ecbc0d588e6 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:22.421752 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4f142b3b-267d-4ca4-a167-5ecbc0d588e6 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:22.422283 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-4f142b3b-267d-4ca4-a167-5ecbc0d588e6 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lazy-loading 'fault' on Instance uuid f03fef0e-680b-45bd-87a9-a3df948181cf {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:17:22.468339 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-4f142b3b-267d-4ca4-a167-5ecbc0d588e6 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:22.478331 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4f142b3b-267d-4ca4-a167-5ecbc0d588e6 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/f03fef0e-680b-45bd-87a9-a3df948181cf" status: 200 len: 1306 microversion: 2.1 time: 0.117563 Oct 19 03:17:22.489464 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 717/1493] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:22 2022] GET /compute/v2.1/servers/f03fef0e-680b-45bd-87a9-a3df948181cf => generated 1306 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:17:22.686531 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-abfa101e-f07d-464f-8c34-7a60b77dd456 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:22.687564 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-abfa101e-f07d-464f-8c34-7a60b77dd456 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:22.701682 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-abfa101e-f07d-464f-8c34-7a60b77dd456 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:22.704722 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-abfa101e-f07d-464f-8c34-7a60b77dd456 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:22.704722 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-abfa101e-f07d-464f-8c34-7a60b77dd456 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:22.709133 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-abfa101e-f07d-464f-8c34-7a60b77dd456 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:22.710236 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-abfa101e-f07d-464f-8c34-7a60b77dd456 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:22.710958 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-abfa101e-f07d-464f-8c34-7a60b77dd456 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:22.792309 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b99027a1-b6fe-4b38-80ff-1279bc1742fc tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:22.792985 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b99027a1-b6fe-4b38-80ff-1279bc1742fc tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 84774cfc-79b4-42db-acfd-c4daac86d196] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:22.795333 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-abfa101e-f07d-464f-8c34-7a60b77dd456 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:22.805226 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-abfa101e-f07d-464f-8c34-7a60b77dd456 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:22.807301 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-abfa101e-f07d-464f-8c34-7a60b77dd456 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:22.812719 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-abfa101e-f07d-464f-8c34-7a60b77dd456 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1533 microversion: 2.91 time: 0.131324 Oct 19 03:17:22.816483 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 777/1494] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:17:22 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1533 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:17:22.818946 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b99027a1-b6fe-4b38-80ff-1279bc1742fc tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:22.819651 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b99027a1-b6fe-4b38-80ff-1279bc1742fc tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:22.822476 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b99027a1-b6fe-4b38-80ff-1279bc1742fc tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:22.824191 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b99027a1-b6fe-4b38-80ff-1279bc1742fc tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:22.824820 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b99027a1-b6fe-4b38-80ff-1279bc1742fc tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:22.828711 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b99027a1-b6fe-4b38-80ff-1279bc1742fc tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:22.834356 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e4ea8cee-4c33-4980-a168-74060c759933 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:22.835292 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e4ea8cee-4c33-4980-a168-74060c759933 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] [instance: fef11301-8524-4f9b-bf6f-e525fca3237d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:22.843191 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e4ea8cee-4c33-4980-a168-74060c759933 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:22.843915 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e4ea8cee-4c33-4980-a168-74060c759933 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:22.844360 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e4ea8cee-4c33-4980-a168-74060c759933 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:22.845084 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e4ea8cee-4c33-4980-a168-74060c759933 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:22.845636 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e4ea8cee-4c33-4980-a168-74060c759933 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:22.846446 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e4ea8cee-4c33-4980-a168-74060c759933 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:22.862812 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-e4ea8cee-4c33-4980-a168-74060c759933 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] HTTP exception thrown: Instance fef11301-8524-4f9b-bf6f-e525fca3237d could not be found. Oct 19 03:17:22.864430 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e4ea8cee-4c33-4980-a168-74060c759933 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Request method failure captured: Oct 19 03:17:22.864430 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/fef11301-8524-4f9b-bf6f-e525fca3237d HTTP/1.1 Oct 19 03:17:22.864430 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:17:22.864430 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:17:22.864430 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:17:22.864430 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:17:22.864430 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:17:22.864430 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:17:22.864430 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:17:22.864430 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:17:22.864430 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2wRGEgYhAdPsgc7mEIDXrdPW4JwqYu1MFCRMWCDsXcKjxkHFT1VoJipXbbUg2wfFTgPSaTND8ANvmvXBbh_VcZiPRiOiOyyyOWkSDVD8anQKzoySXT9c8aNAT4O4UZ5kRq3Qlkx_fDPQls23gexwMFV2EY3yHLkKn1iQsrIizdgtLc Oct 19 03:17:22.864430 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:17:22.864430 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:17:22.864430 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:17:22.864430 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:17:22.864430 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:17:22.864430 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:17:22.864430 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 0fcd49d68a3947249016cc5dbe910efc Oct 19 03:17:22.864430 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ServersTestMultiNic-1638692278 Oct 19 03:17:22.864430 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:17:22.864430 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:17:22.866093 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/0fcd49d68a3947249016cc5dbe910efc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0fcd49d68a3947249016cc5dbe910efc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0fcd49d68a3947249016cc5dbe910efc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_0fcd49d68a3947249016cc5dbe910efc", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:17:22.866093 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ServersTestMultiNic-1638692278 Oct 19 03:17:22.866093 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 0fcd49d68a3947249016cc5dbe910efc Oct 19 03:17:22.866093 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ServersTestMultiNic-1638692278 Oct 19 03:17:22.866093 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ServersTestMultiNic-1638692278-project Oct 19 03:17:22.866093 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:17:22.866093 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:17:22.866093 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: d3c35b71372843d69f9a6c6be04b154f Oct 19 03:17:22.866093 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ServersTestMultiNic-1638692278-project Oct 19 03:17:22.866093 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:17:22.866093 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance fef11301-8524-4f9b-bf6f-e525fca3237d could not be found. Oct 19 03:17:22.866093 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': 'fef11301-8524-4f9b-bf6f-e525fca3237d'} Oct 19 03:17:22.866869 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:17:22.866869 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:17:22.866869 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:17:22.866869 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:17:22.866869 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:17:22.866869 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:17:22.866869 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:17:22.866869 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:17:22.866869 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:17:22.866869 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:17:22.866869 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fef11301-8524-4f9b-bf6f-e525fca3237d could not be found. Oct 19 03:17:22.866869 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:17:22.866869 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:17:22.866869 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:17:22.866869 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:17:22.866869 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:17:22.866869 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:17:22.866869 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:17:22.866869 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:17:22.866869 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:17:22.868092 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:17:22.868092 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:17:22.868092 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:17:22.868092 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:17:22.868092 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:17:22.868092 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:17:22.868092 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:17:22.868092 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fef11301-8524-4f9b-bf6f-e525fca3237d could not be found. Oct 19 03:17:22.868092 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:17:22.868092 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:17:22.868092 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:17:22.868092 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:17:22.868092 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:17:22.868092 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:17:22.868092 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:17:22.868092 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:17:22.868092 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fef11301-8524-4f9b-bf6f-e525fca3237d could not be found. Oct 19 03:17:22.868092 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:17:22.871787 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e4ea8cee-4c33-4980-a168-74060c759933 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Returning 404 to user: Instance fef11301-8524-4f9b-bf6f-e525fca3237d could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:17:22.871787 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e4ea8cee-4c33-4980-a168-74060c759933 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] 10.222.0.52 "GET /compute/v2.1/servers/fef11301-8524-4f9b-bf6f-e525fca3237d" status: 404 len: 111 microversion: 2.1 time: 0.035738 Oct 19 03:17:22.871787 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 778/1495] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:22 2022] GET /compute/v2.1/servers/fef11301-8524-4f9b-bf6f-e525fca3237d => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:17:22.884069 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c0d9398c-d9a1-431a-9d83-ff1ff7538d65 tempest-UnshelveToHostMultiNodesTest-1213824820 tempest-UnshelveToHostMultiNodesTest-1213824820-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:22.887213 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c0d9398c-d9a1-431a-9d83-ff1ff7538d65 tempest-UnshelveToHostMultiNodesTest-1213824820 tempest-UnshelveToHostMultiNodesTest-1213824820-project-admin] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:22.902588 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c0d9398c-d9a1-431a-9d83-ff1ff7538d65 tempest-UnshelveToHostMultiNodesTest-1213824820 tempest-UnshelveToHostMultiNodesTest-1213824820-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:22.903090 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c0d9398c-d9a1-431a-9d83-ff1ff7538d65 tempest-UnshelveToHostMultiNodesTest-1213824820 tempest-UnshelveToHostMultiNodesTest-1213824820-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:22.907266 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c0d9398c-d9a1-431a-9d83-ff1ff7538d65 tempest-UnshelveToHostMultiNodesTest-1213824820 tempest-UnshelveToHostMultiNodesTest-1213824820-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:22.908388 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c0d9398c-d9a1-431a-9d83-ff1ff7538d65 tempest-UnshelveToHostMultiNodesTest-1213824820 tempest-UnshelveToHostMultiNodesTest-1213824820-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:22.909021 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c0d9398c-d9a1-431a-9d83-ff1ff7538d65 tempest-UnshelveToHostMultiNodesTest-1213824820 tempest-UnshelveToHostMultiNodesTest-1213824820-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:22.909653 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c0d9398c-d9a1-431a-9d83-ff1ff7538d65 tempest-UnshelveToHostMultiNodesTest-1213824820 tempest-UnshelveToHostMultiNodesTest-1213824820-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:23.028283 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-c0d9398c-d9a1-431a-9d83-ff1ff7538d65 tempest-UnshelveToHostMultiNodesTest-1213824820 tempest-UnshelveToHostMultiNodesTest-1213824820-project-admin] Lazy-loading 'services' on Instance uuid 84092951-cf52-4077-b954-0babab66565e {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:17:23.063856 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c0d9398c-d9a1-431a-9d83-ff1ff7538d65 tempest-UnshelveToHostMultiNodesTest-1213824820 tempest-UnshelveToHostMultiNodesTest-1213824820-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1938 microversion: 2.91 time: 0.196101 Oct 19 03:17:23.067051 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 779/1496] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:17:22 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1938 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:17:23.077325 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-8cffbd47-bdac-4ac4-a069-fc162e43b83e tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:23.079516 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-8cffbd47-bdac-4ac4-a069-fc162e43b83e tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] [instance: 540a7025-b935-49fb-bc51-edf44ac1e0c4] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:23.107085 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8cffbd47-bdac-4ac4-a069-fc162e43b83e tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:23.112411 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8cffbd47-bdac-4ac4-a069-fc162e43b83e tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:23.112888 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8cffbd47-bdac-4ac4-a069-fc162e43b83e tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:23.113619 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8cffbd47-bdac-4ac4-a069-fc162e43b83e tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:23.114070 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8cffbd47-bdac-4ac4-a069-fc162e43b83e tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:23.114689 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8cffbd47-bdac-4ac4-a069-fc162e43b83e tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:23.115678 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b99027a1-b6fe-4b38-80ff-1279bc1742fc tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:23.140241 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b99027a1-b6fe-4b38-80ff-1279bc1742fc tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196" status: 200 len: 1475 microversion: 2.1 time: 0.352875 Oct 19 03:17:23.157329 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 718/1497] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:22 2022] GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196 => generated 1475 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:17:23.171200 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-218e7906-75ae-4aec-b61e-71cdb2981d43 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:23.171863 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-218e7906-75ae-4aec-b61e-71cdb2981d43 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:23.188057 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-8cffbd47-bdac-4ac4-a069-fc162e43b83e tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] 10.222.0.52 "GET /compute/v2.1/servers/540a7025-b935-49fb-bc51-edf44ac1e0c4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.118382 Oct 19 03:17:23.190145 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 780/1498] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Oct 19 03:17:23 2022] GET /compute/v2.1/servers/540a7025-b935-49fb-bc51-edf44ac1e0c4/os-volume_attachments => generated 197 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:17:23.191135 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-218e7906-75ae-4aec-b61e-71cdb2981d43 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:23.191729 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-218e7906-75ae-4aec-b61e-71cdb2981d43 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:23.192379 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-218e7906-75ae-4aec-b61e-71cdb2981d43 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:23.194194 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-218e7906-75ae-4aec-b61e-71cdb2981d43 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:23.195004 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-218e7906-75ae-4aec-b61e-71cdb2981d43 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:23.195574 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-218e7906-75ae-4aec-b61e-71cdb2981d43 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:23.230639 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-218e7906-75ae-4aec-b61e-71cdb2981d43 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Going to try to terminate instance {{(pid=121134) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:17:23.347909 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:17:23.502171 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-626ecd40-6592-44ea-bb05-f470b1a689f1 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:23.503137 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-626ecd40-6592-44ea-bb05-f470b1a689f1 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: f03fef0e-680b-45bd-87a9-a3df948181cf] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:23.510553 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-626ecd40-6592-44ea-bb05-f470b1a689f1 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:23.511355 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-626ecd40-6592-44ea-bb05-f470b1a689f1 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:23.511987 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-626ecd40-6592-44ea-bb05-f470b1a689f1 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:23.512858 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-626ecd40-6592-44ea-bb05-f470b1a689f1 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:23.514075 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-626ecd40-6592-44ea-bb05-f470b1a689f1 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:23.516761 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-626ecd40-6592-44ea-bb05-f470b1a689f1 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:23.531324 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-626ecd40-6592-44ea-bb05-f470b1a689f1 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] HTTP exception thrown: Instance f03fef0e-680b-45bd-87a9-a3df948181cf could not be found. Oct 19 03:17:23.533450 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-626ecd40-6592-44ea-bb05-f470b1a689f1 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Request method failure captured: Oct 19 03:17:23.533450 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/f03fef0e-680b-45bd-87a9-a3df948181cf HTTP/1.1 Oct 19 03:17:23.533450 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:17:23.533450 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:17:23.533450 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:17:23.533450 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:17:23.533450 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:17:23.533450 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:17:23.533450 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:17:23.533450 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:17:23.533450 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2uIr9BvDBnYtOjXORgJ4Qqr6WVLdD9ouG3lYgYuVISlRlRaYBhavBD01rVROkCZkxR9XYWXexaYSEKOFD-WoO2VI67daMYqFdJq0nC95Vi4iLXZzLBKOlmG6HfkRin4f0jmmyKXjHfeDMSqeFm88QUaNhEk881S74x65hVUOW0qpCY Oct 19 03:17:23.533450 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:17:23.533450 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:17:23.533450 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:17:23.533450 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:17:23.533450 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:17:23.533450 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:17:23.533450 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 5d909fe7763841d5b452738112b656d3 Oct 19 03:17:23.533450 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ServersOnMultiNodesTest-1737645722 Oct 19 03:17:23.533450 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:17:23.533450 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:17:23.535073 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5d909fe7763841d5b452738112b656d3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5d909fe7763841d5b452738112b656d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5d909fe7763841d5b452738112b656d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5d909fe7763841d5b452738112b656d3", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:17:23.535073 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ServersOnMultiNodesTest-1737645722 Oct 19 03:17:23.535073 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 5d909fe7763841d5b452738112b656d3 Oct 19 03:17:23.535073 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1737645722 Oct 19 03:17:23.535073 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ServersOnMultiNodesTest-1737645722-project Oct 19 03:17:23.535073 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:17:23.535073 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:17:23.535073 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 3e4d3ddb3a324d9da51c13701e318955 Oct 19 03:17:23.535073 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ServersOnMultiNodesTest-1737645722-project Oct 19 03:17:23.535073 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:17:23.535073 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance f03fef0e-680b-45bd-87a9-a3df948181cf could not be found. Oct 19 03:17:23.535073 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': 'f03fef0e-680b-45bd-87a9-a3df948181cf'} Oct 19 03:17:23.538976 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:17:23.538976 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:17:23.538976 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:17:23.538976 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:17:23.538976 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:17:23.538976 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:17:23.538976 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:17:23.538976 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:17:23.538976 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:17:23.538976 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:17:23.538976 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f03fef0e-680b-45bd-87a9-a3df948181cf could not be found. Oct 19 03:17:23.538976 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:17:23.538976 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:17:23.538976 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:17:23.538976 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:17:23.538976 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:17:23.538976 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:17:23.538976 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:17:23.538976 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:17:23.538976 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:17:23.540403 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:17:23.540403 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:17:23.540403 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:17:23.540403 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:17:23.540403 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:17:23.540403 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:17:23.540403 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:17:23.540403 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f03fef0e-680b-45bd-87a9-a3df948181cf could not be found. Oct 19 03:17:23.540403 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:17:23.540403 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:17:23.540403 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:17:23.540403 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:17:23.540403 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:17:23.540403 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:17:23.540403 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:17:23.540403 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:17:23.540403 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f03fef0e-680b-45bd-87a9-a3df948181cf could not be found. Oct 19 03:17:23.540403 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:17:23.543927 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-626ecd40-6592-44ea-bb05-f470b1a689f1 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Returning 404 to user: Instance f03fef0e-680b-45bd-87a9-a3df948181cf could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:17:23.543927 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-626ecd40-6592-44ea-bb05-f470b1a689f1 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/f03fef0e-680b-45bd-87a9-a3df948181cf" status: 404 len: 111 microversion: 2.1 time: 0.036936 Oct 19 03:17:23.543927 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 781/1499] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:23 2022] GET /compute/v2.1/servers/f03fef0e-680b-45bd-87a9-a3df948181cf => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 03:17:23.550078 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b135e46b-1a38-46f5-bf39-07f6d0818ff5 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:23.553665 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b135e46b-1a38-46f5-bf39-07f6d0818ff5 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 0843e340-11a3-4a88-b9a6-b0024d3b3152] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:23.568966 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b135e46b-1a38-46f5-bf39-07f6d0818ff5 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:23.569509 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b135e46b-1a38-46f5-bf39-07f6d0818ff5 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:23.569955 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b135e46b-1a38-46f5-bf39-07f6d0818ff5 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:23.570673 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b135e46b-1a38-46f5-bf39-07f6d0818ff5 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:23.571128 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b135e46b-1a38-46f5-bf39-07f6d0818ff5 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:23.571615 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b135e46b-1a38-46f5-bf39-07f6d0818ff5 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:23.575158 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-218e7906-75ae-4aec-b61e-71cdb2981d43 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "DELETE /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 204 len: 0 microversion: 2.91 time: 0.416322 Oct 19 03:17:23.579035 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 719/1500] 10.222.0.52 () {60 vars in 1280 bytes} [Wed Oct 19 03:17:23 2022] DELETE /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 0 bytes in 418 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 19 03:17:23.588208 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e0e1b1f6-1407-49c8-9c38-effeadf36730 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:23.589555 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e0e1b1f6-1407-49c8-9c38-effeadf36730 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:23.596442 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e0e1b1f6-1407-49c8-9c38-effeadf36730 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:23.597291 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e0e1b1f6-1407-49c8-9c38-effeadf36730 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:23.598025 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e0e1b1f6-1407-49c8-9c38-effeadf36730 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:23.600652 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e0e1b1f6-1407-49c8-9c38-effeadf36730 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:23.601595 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e0e1b1f6-1407-49c8-9c38-effeadf36730 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:23.602260 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e0e1b1f6-1407-49c8-9c38-effeadf36730 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:23.619910 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b135e46b-1a38-46f5-bf39-07f6d0818ff5 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 0843e340-11a3-4a88-b9a6-b0024d3b3152] Going to try to terminate instance {{(pid=121135) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:17:23.720890 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e0e1b1f6-1407-49c8-9c38-effeadf36730 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:23.740653 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e0e1b1f6-1407-49c8-9c38-effeadf36730 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:23.742539 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e0e1b1f6-1407-49c8-9c38-effeadf36730 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:23.752374 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e0e1b1f6-1407-49c8-9c38-effeadf36730 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1539 microversion: 2.91 time: 0.170531 Oct 19 03:17:23.765405 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 720/1501] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:17:23 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1539 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:17:23.992660 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b135e46b-1a38-46f5-bf39-07f6d0818ff5 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "DELETE /compute/v2.1/servers/0843e340-11a3-4a88-b9a6-b0024d3b3152" status: 204 len: 0 microversion: 2.1 time: 0.450563 Oct 19 03:17:23.994367 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 782/1502] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:17:23 2022] DELETE /compute/v2.1/servers/0843e340-11a3-4a88-b9a6-b0024d3b3152 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:17:24.004052 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1af9e926-20b4-478a-beaf-1e91af05940f tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:24.006466 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1af9e926-20b4-478a-beaf-1e91af05940f tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 0843e340-11a3-4a88-b9a6-b0024d3b3152] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:24.018521 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1af9e926-20b4-478a-beaf-1e91af05940f tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:24.018521 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1af9e926-20b4-478a-beaf-1e91af05940f tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:24.018521 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1af9e926-20b4-478a-beaf-1e91af05940f tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:24.018521 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1af9e926-20b4-478a-beaf-1e91af05940f tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:24.023281 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1af9e926-20b4-478a-beaf-1e91af05940f tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:24.023910 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1af9e926-20b4-478a-beaf-1e91af05940f tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:24.168399 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4d892f7e-40b8-481e-ada6-12bc2aa47e80 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:24.169275 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4d892f7e-40b8-481e-ada6-12bc2aa47e80 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 84774cfc-79b4-42db-acfd-c4daac86d196] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:24.185464 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4d892f7e-40b8-481e-ada6-12bc2aa47e80 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:24.186126 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4d892f7e-40b8-481e-ada6-12bc2aa47e80 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:24.186722 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4d892f7e-40b8-481e-ada6-12bc2aa47e80 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:24.187646 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4d892f7e-40b8-481e-ada6-12bc2aa47e80 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:24.188213 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4d892f7e-40b8-481e-ada6-12bc2aa47e80 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:24.188744 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4d892f7e-40b8-481e-ada6-12bc2aa47e80 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:24.477923 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-1af9e926-20b4-478a-beaf-1e91af05940f tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:24.501780 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1af9e926-20b4-478a-beaf-1e91af05940f tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/0843e340-11a3-4a88-b9a6-b0024d3b3152" status: 200 len: 1471 microversion: 2.1 time: 0.502705 Oct 19 03:17:24.502691 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 721/1503] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:23 2022] GET /compute/v2.1/servers/0843e340-11a3-4a88-b9a6-b0024d3b3152 => generated 1471 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:24.509125 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-42fa04b4-68a0-4ea0-8feb-55ec2873b932 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:24.516481 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-42fa04b4-68a0-4ea0-8feb-55ec2873b932 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] [instance: 540a7025-b935-49fb-bc51-edf44ac1e0c4] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:24.530347 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-42fa04b4-68a0-4ea0-8feb-55ec2873b932 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:24.531140 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-42fa04b4-68a0-4ea0-8feb-55ec2873b932 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:24.531748 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-42fa04b4-68a0-4ea0-8feb-55ec2873b932 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:24.532642 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-42fa04b4-68a0-4ea0-8feb-55ec2873b932 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:24.540030 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-42fa04b4-68a0-4ea0-8feb-55ec2873b932 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:24.541410 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-42fa04b4-68a0-4ea0-8feb-55ec2873b932 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:24.597623 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4d892f7e-40b8-481e-ada6-12bc2aa47e80 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:24.598803 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-42fa04b4-68a0-4ea0-8feb-55ec2873b932 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] 10.222.0.52 "GET /compute/v2.1/servers/540a7025-b935-49fb-bc51-edf44ac1e0c4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094769 Oct 19 03:17:24.600227 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 722/1504] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Oct 19 03:17:24 2022] GET /compute/v2.1/servers/540a7025-b935-49fb-bc51-edf44ac1e0c4/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:17:24.609402 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4d892f7e-40b8-481e-ada6-12bc2aa47e80 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196" status: 200 len: 1475 microversion: 2.1 time: 0.445470 Oct 19 03:17:24.624292 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 783/1505] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:24 2022] GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196 => generated 1475 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:17:24.787695 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-018c4944-af4d-4b68-8e99-a6fbd577070d tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:24.788348 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-018c4944-af4d-4b68-8e99-a6fbd577070d tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:24.803306 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-018c4944-af4d-4b68-8e99-a6fbd577070d tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:24.803881 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-018c4944-af4d-4b68-8e99-a6fbd577070d tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:24.804338 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-018c4944-af4d-4b68-8e99-a6fbd577070d tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:24.818380 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-018c4944-af4d-4b68-8e99-a6fbd577070d tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:24.825977 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-018c4944-af4d-4b68-8e99-a6fbd577070d tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:24.826479 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-018c4944-af4d-4b68-8e99-a6fbd577070d tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:24.965900 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-018c4944-af4d-4b68-8e99-a6fbd577070d tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:24.980361 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-018c4944-af4d-4b68-8e99-a6fbd577070d tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:24.985756 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-018c4944-af4d-4b68-8e99-a6fbd577070d tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:24.997870 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-018c4944-af4d-4b68-8e99-a6fbd577070d tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1539 microversion: 2.91 time: 0.214027 Oct 19 03:17:24.998485 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 723/1506] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:17:24 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1539 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:17:25.525468 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3ae5b9ce-8f67-43eb-87a8-c42feca7e205 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:25.526251 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-3ae5b9ce-8f67-43eb-87a8-c42feca7e205 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 0843e340-11a3-4a88-b9a6-b0024d3b3152] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:25.538551 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3ae5b9ce-8f67-43eb-87a8-c42feca7e205 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:25.539094 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3ae5b9ce-8f67-43eb-87a8-c42feca7e205 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:25.539830 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3ae5b9ce-8f67-43eb-87a8-c42feca7e205 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:25.540717 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3ae5b9ce-8f67-43eb-87a8-c42feca7e205 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:25.541413 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3ae5b9ce-8f67-43eb-87a8-c42feca7e205 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:25.541847 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3ae5b9ce-8f67-43eb-87a8-c42feca7e205 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:25.613762 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-53364549-4eda-40d2-acaf-775fa1a93760 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:25.616749 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-53364549-4eda-40d2-acaf-775fa1a93760 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] [instance: 540a7025-b935-49fb-bc51-edf44ac1e0c4] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:25.625975 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-53364549-4eda-40d2-acaf-775fa1a93760 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:25.628486 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-53364549-4eda-40d2-acaf-775fa1a93760 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:25.628486 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-53364549-4eda-40d2-acaf-775fa1a93760 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:25.628486 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-53364549-4eda-40d2-acaf-775fa1a93760 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:25.628486 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-53364549-4eda-40d2-acaf-775fa1a93760 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:25.628867 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-53364549-4eda-40d2-acaf-775fa1a93760 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:25.669490 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-53364549-4eda-40d2-acaf-775fa1a93760 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] 10.222.0.52 "GET /compute/v2.1/servers/540a7025-b935-49fb-bc51-edf44ac1e0c4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.060760 Oct 19 03:17:25.670414 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 724/1507] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Oct 19 03:17:25 2022] GET /compute/v2.1/servers/540a7025-b935-49fb-bc51-edf44ac1e0c4/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 03:17:25.677117 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7f738c23-66a3-424a-9ddd-5717bc7f9b3c tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:25.679908 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7f738c23-66a3-424a-9ddd-5717bc7f9b3c tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 84774cfc-79b4-42db-acfd-c4daac86d196] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:25.689326 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7f738c23-66a3-424a-9ddd-5717bc7f9b3c tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:25.689729 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7f738c23-66a3-424a-9ddd-5717bc7f9b3c tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:25.690386 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7f738c23-66a3-424a-9ddd-5717bc7f9b3c tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:25.691913 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7f738c23-66a3-424a-9ddd-5717bc7f9b3c tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:25.692596 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7f738c23-66a3-424a-9ddd-5717bc7f9b3c tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:25.693196 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7f738c23-66a3-424a-9ddd-5717bc7f9b3c tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:25.765624 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-3ae5b9ce-8f67-43eb-87a8-c42feca7e205 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:25.781907 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-3ae5b9ce-8f67-43eb-87a8-c42feca7e205 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/0843e340-11a3-4a88-b9a6-b0024d3b3152" status: 200 len: 1471 microversion: 2.1 time: 0.260916 Oct 19 03:17:25.793478 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 784/1508] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:25 2022] GET /compute/v2.1/servers/0843e340-11a3-4a88-b9a6-b0024d3b3152 => generated 1471 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:25.930753 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-45a841cd-b747-4d0d-800a-dc94858cc1a7 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-409674801", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "networks": [{"uuid": "2bf94f1c-ad91-41d1-a997-a3dcf7e5a17f"}]}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:17:25.966100 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-7f738c23-66a3-424a-9ddd-5717bc7f9b3c tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:25.976506 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7f738c23-66a3-424a-9ddd-5717bc7f9b3c tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196" status: 200 len: 1475 microversion: 2.1 time: 0.304484 Oct 19 03:17:25.977491 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 725/1509] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:25 2022] GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196 => generated 1475 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:26.022958 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.network.neutron [None req-45a841cd-b747-4d0d-800a-dc94858cc1a7 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] validate_networks() for [('2bf94f1c-ad91-41d1-a997-a3dcf7e5a17f', None, None, None, None, None)] {{(pid=121135) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:17:26.043840 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b1d0d2a4-cf61-451d-bb61-dc08f66e3212 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:26.044775 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b1d0d2a4-cf61-451d-bb61-dc08f66e3212 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:26.051854 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b1d0d2a4-cf61-451d-bb61-dc08f66e3212 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:26.052401 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b1d0d2a4-cf61-451d-bb61-dc08f66e3212 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:26.052892 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b1d0d2a4-cf61-451d-bb61-dc08f66e3212 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:26.053700 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b1d0d2a4-cf61-451d-bb61-dc08f66e3212 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:26.054224 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b1d0d2a4-cf61-451d-bb61-dc08f66e3212 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:26.054719 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b1d0d2a4-cf61-451d-bb61-dc08f66e3212 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:26.098912 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b1d0d2a4-cf61-451d-bb61-dc08f66e3212 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:26.100122 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b1d0d2a4-cf61-451d-bb61-dc08f66e3212 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:26.100122 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b1d0d2a4-cf61-451d-bb61-dc08f66e3212 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:26.100660 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-b1d0d2a4-cf61-451d-bb61-dc08f66e3212 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lazy-loading 'fault' on Instance uuid 84092951-cf52-4077-b954-0babab66565e {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:17:26.158646 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b1d0d2a4-cf61-451d-bb61-dc08f66e3212 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:26.171984 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b1d0d2a4-cf61-451d-bb61-dc08f66e3212 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:26.173721 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b1d0d2a4-cf61-451d-bb61-dc08f66e3212 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:26.182690 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b1d0d2a4-cf61-451d-bb61-dc08f66e3212 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1544 microversion: 2.91 time: 0.144473 Oct 19 03:17:26.183947 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 726/1510] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:17:26 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1544 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:17:26.582442 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-45a841cd-b747-4d0d-800a-dc94858cc1a7 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Flavor limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:17:26.583011 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-45a841cd-b747-4d0d-800a-dc94858cc1a7 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Image limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:17:26.583389 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-45a841cd-b747-4d0d-800a-dc94858cc1a7 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Flavor pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:17:26.583811 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-45a841cd-b747-4d0d-800a-dc94858cc1a7 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Image pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:17:26.584223 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-45a841cd-b747-4d0d-800a-dc94858cc1a7 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:17:26.595102 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-45a841cd-b747-4d0d-800a-dc94858cc1a7 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:26.596213 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-45a841cd-b747-4d0d-800a-dc94858cc1a7 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:26.597094 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-45a841cd-b747-4d0d-800a-dc94858cc1a7 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:26.598243 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-45a841cd-b747-4d0d-800a-dc94858cc1a7 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:26.598891 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-45a841cd-b747-4d0d-800a-dc94858cc1a7 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:26.599354 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-45a841cd-b747-4d0d-800a-dc94858cc1a7 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:26.620261 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-45a841cd-b747-4d0d-800a-dc94858cc1a7 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Getting quotas for project 48c12a432bbd43bd8f70ba6e941c28a2. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:17:26.625086 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-45a841cd-b747-4d0d-800a-dc94858cc1a7 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Getting quotas for user 28072a54d5934ea28e7d3205841c0852 and project 48c12a432bbd43bd8f70ba6e941c28a2. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:17:26.642248 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-45a841cd-b747-4d0d-800a-dc94858cc1a7 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Going to run 1 instances... {{(pid=121135) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:17:26.644867 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-45a841cd-b747-4d0d-800a-dc94858cc1a7 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] [instance: 90f71ec9-e698-4159-9458-2099c1fbfaf3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121135) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:17:26.768650 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-45a841cd-b747-4d0d-800a-dc94858cc1a7 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.842215 Oct 19 03:17:26.770059 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 785/1511] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:17:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 845 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 03:17:26.782620 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a5d15063-26cc-4bd8-a715-7247c605bf90 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:26.783959 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a5d15063-26cc-4bd8-a715-7247c605bf90 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] [instance: 90f71ec9-e698-4159-9458-2099c1fbfaf3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:26.812354 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9b2557b7-9331-47c2-bb4f-f01c8e2a1a56 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:26.813242 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9b2557b7-9331-47c2-bb4f-f01c8e2a1a56 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 0843e340-11a3-4a88-b9a6-b0024d3b3152] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:26.830089 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9b2557b7-9331-47c2-bb4f-f01c8e2a1a56 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:26.830586 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9b2557b7-9331-47c2-bb4f-f01c8e2a1a56 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:26.831026 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9b2557b7-9331-47c2-bb4f-f01c8e2a1a56 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:26.831736 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9b2557b7-9331-47c2-bb4f-f01c8e2a1a56 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:26.832185 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9b2557b7-9331-47c2-bb4f-f01c8e2a1a56 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:26.832609 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9b2557b7-9331-47c2-bb4f-f01c8e2a1a56 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:26.943593 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a5d15063-26cc-4bd8-a715-7247c605bf90 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28072a54d5934ea28e7d3205841c0852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c12a432bbd43bd8f70ba6e941c28a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:26.952679 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a5d15063-26cc-4bd8-a715-7247c605bf90 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] 10.222.0.52 "GET /compute/v2.1/servers/90f71ec9-e698-4159-9458-2099c1fbfaf3" status: 200 len: 1217 microversion: 2.1 time: 0.175333 Oct 19 03:17:26.953538 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 727/1512] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:26 2022] GET /compute/v2.1/servers/90f71ec9-e698-4159-9458-2099c1fbfaf3 => generated 1217 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:26.988909 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-9b2557b7-9331-47c2-bb4f-f01c8e2a1a56 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:27.001585 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3e9ea033-2041-4d77-a2a8-473d96466cba tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:27.002740 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3e9ea033-2041-4d77-a2a8-473d96466cba tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 84774cfc-79b4-42db-acfd-c4daac86d196] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:27.012624 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3e9ea033-2041-4d77-a2a8-473d96466cba tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:27.018315 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3e9ea033-2041-4d77-a2a8-473d96466cba tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:27.018315 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3e9ea033-2041-4d77-a2a8-473d96466cba tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:27.018315 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3e9ea033-2041-4d77-a2a8-473d96466cba tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:27.018315 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3e9ea033-2041-4d77-a2a8-473d96466cba tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:27.019561 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3e9ea033-2041-4d77-a2a8-473d96466cba tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:27.030096 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9b2557b7-9331-47c2-bb4f-f01c8e2a1a56 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/0843e340-11a3-4a88-b9a6-b0024d3b3152" status: 200 len: 1429 microversion: 2.1 time: 0.219093 Oct 19 03:17:27.032526 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 786/1513] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:26 2022] GET /compute/v2.1/servers/0843e340-11a3-4a88-b9a6-b0024d3b3152 => generated 1429 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:17:27.199964 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-da7a7089-fcd4-475c-8ac8-08eb4fd88752 req-937183b3-cc30-4eb1-8acc-7016e5478b46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0843e340-11a3-4a88-b9a6-b0024d3b3152", "name": "network-vif-deleted", "tag": "3a470bff-91c4-48d9-a7eb-7dfbe4bd64c3"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:17:27.214802 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-da7a7089-fcd4-475c-8ac8-08eb4fd88752 req-937183b3-cc30-4eb1-8acc-7016e5478b46 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:27.217638 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-da7a7089-fcd4-475c-8ac8-08eb4fd88752 req-937183b3-cc30-4eb1-8acc-7016e5478b46 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:27.217638 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-da7a7089-fcd4-475c-8ac8-08eb4fd88752 req-937183b3-cc30-4eb1-8acc-7016e5478b46 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:27.246804 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-da7a7089-fcd4-475c-8ac8-08eb4fd88752 req-937183b3-cc30-4eb1-8acc-7016e5478b46 service nova] Creating event network-vif-deleted:3a470bff-91c4-48d9-a7eb-7dfbe4bd64c3 for instance 0843e340-11a3-4a88-b9a6-b0024d3b3152 on n-h1-861333-8 Oct 19 03:17:27.256780 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-da7a7089-fcd4-475c-8ac8-08eb4fd88752 req-937183b3-cc30-4eb1-8acc-7016e5478b46 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066116 Oct 19 03:17:27.259086 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 787/1514] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:17:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:17:27.267585 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-30136d68-4977-4921-ab6b-a1d8ed54f761 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:27.269157 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-30136d68-4977-4921-ab6b-a1d8ed54f761 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:27.277905 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-30136d68-4977-4921-ab6b-a1d8ed54f761 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:27.278751 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-30136d68-4977-4921-ab6b-a1d8ed54f761 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:27.279370 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-30136d68-4977-4921-ab6b-a1d8ed54f761 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:27.284733 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-30136d68-4977-4921-ab6b-a1d8ed54f761 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:27.285276 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-30136d68-4977-4921-ab6b-a1d8ed54f761 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:27.286318 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-30136d68-4977-4921-ab6b-a1d8ed54f761 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:27.333806 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-3e9ea033-2041-4d77-a2a8-473d96466cba tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:27.349220 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3e9ea033-2041-4d77-a2a8-473d96466cba tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196" status: 200 len: 1475 microversion: 2.1 time: 0.352633 Oct 19 03:17:27.350113 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 728/1515] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:26 2022] GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196 => generated 1475 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:17:27.364687 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:17:27.418214 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-30136d68-4977-4921-ab6b-a1d8ed54f761 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:27.418214 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-30136d68-4977-4921-ab6b-a1d8ed54f761 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:27.418214 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-30136d68-4977-4921-ab6b-a1d8ed54f761 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:27.418214 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-30136d68-4977-4921-ab6b-a1d8ed54f761 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lazy-loading 'fault' on Instance uuid 84092951-cf52-4077-b954-0babab66565e {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:17:27.546337 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-30136d68-4977-4921-ab6b-a1d8ed54f761 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:27.573620 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-30136d68-4977-4921-ab6b-a1d8ed54f761 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:27.583905 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-30136d68-4977-4921-ab6b-a1d8ed54f761 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48d53dcc40524d0dba3d737d29a89209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f9151d61bc4d32a5aff16ca1a0a912', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:27.604719 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-30136d68-4977-4921-ab6b-a1d8ed54f761 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 200 len: 1544 microversion: 2.91 time: 0.339260 Oct 19 03:17:27.605009 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 788/1516] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:17:27 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 1544 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:17:27.980859 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3473204e-bad0-4169-a1cd-6f40c2e888cf tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:27.981818 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3473204e-bad0-4169-a1cd-6f40c2e888cf tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] [instance: 90f71ec9-e698-4159-9458-2099c1fbfaf3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:28.053608 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-3473204e-bad0-4169-a1cd-6f40c2e888cf tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28072a54d5934ea28e7d3205841c0852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c12a432bbd43bd8f70ba6e941c28a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:28.059418 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9c409e8f-a514-4663-b3d8-761dbfd358e1 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:28.060344 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9c409e8f-a514-4663-b3d8-761dbfd358e1 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 0843e340-11a3-4a88-b9a6-b0024d3b3152] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:28.068196 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3473204e-bad0-4169-a1cd-6f40c2e888cf tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] 10.222.0.52 "GET /compute/v2.1/servers/90f71ec9-e698-4159-9458-2099c1fbfaf3" status: 200 len: 1217 microversion: 2.1 time: 0.085358 Oct 19 03:17:28.081140 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 729/1517] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:27 2022] GET /compute/v2.1/servers/90f71ec9-e698-4159-9458-2099c1fbfaf3 => generated 1217 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:28.086264 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9c409e8f-a514-4663-b3d8-761dbfd358e1 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:28.086264 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9c409e8f-a514-4663-b3d8-761dbfd358e1 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:28.086264 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9c409e8f-a514-4663-b3d8-761dbfd358e1 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:28.086264 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9c409e8f-a514-4663-b3d8-761dbfd358e1 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:28.086721 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9c409e8f-a514-4663-b3d8-761dbfd358e1 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:28.086976 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9c409e8f-a514-4663-b3d8-761dbfd358e1 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:28.152941 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9c409e8f-a514-4663-b3d8-761dbfd358e1 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:28.153736 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9c409e8f-a514-4663-b3d8-761dbfd358e1 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:28.154408 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9c409e8f-a514-4663-b3d8-761dbfd358e1 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:28.155724 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-9c409e8f-a514-4663-b3d8-761dbfd358e1 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lazy-loading 'fault' on Instance uuid 0843e340-11a3-4a88-b9a6-b0024d3b3152 {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:17:28.259890 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-9c409e8f-a514-4663-b3d8-761dbfd358e1 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:28.269722 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9c409e8f-a514-4663-b3d8-761dbfd358e1 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/0843e340-11a3-4a88-b9a6-b0024d3b3152" status: 200 len: 1306 microversion: 2.1 time: 0.214966 Oct 19 03:17:28.282751 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 789/1518] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:28 2022] GET /compute/v2.1/servers/0843e340-11a3-4a88-b9a6-b0024d3b3152 => generated 1306 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:17:28.376186 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f078c878-9f38-46dd-8819-89d1c72099a2 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:28.376780 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f078c878-9f38-46dd-8819-89d1c72099a2 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 84774cfc-79b4-42db-acfd-c4daac86d196] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:28.386771 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:17:28.388249 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f078c878-9f38-46dd-8819-89d1c72099a2 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:28.389023 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f078c878-9f38-46dd-8819-89d1c72099a2 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:28.403512 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f078c878-9f38-46dd-8819-89d1c72099a2 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:28.404353 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f078c878-9f38-46dd-8819-89d1c72099a2 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:28.404843 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f078c878-9f38-46dd-8819-89d1c72099a2 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:28.405576 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f078c878-9f38-46dd-8819-89d1c72099a2 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:28.630801 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-cf279cdf-dffc-466a-b858-a5ed5ef78300 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:28.631401 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-cf279cdf-dffc-466a-b858-a5ed5ef78300 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] [instance: 84092951-cf52-4077-b954-0babab66565e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:28.639112 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cf279cdf-dffc-466a-b858-a5ed5ef78300 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:28.639851 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cf279cdf-dffc-466a-b858-a5ed5ef78300 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:28.640458 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cf279cdf-dffc-466a-b858-a5ed5ef78300 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:28.641509 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cf279cdf-dffc-466a-b858-a5ed5ef78300 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:28.642210 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cf279cdf-dffc-466a-b858-a5ed5ef78300 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:28.648302 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cf279cdf-dffc-466a-b858-a5ed5ef78300 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:28.657014 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-f078c878-9f38-46dd-8819-89d1c72099a2 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:28.666710 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f078c878-9f38-46dd-8819-89d1c72099a2 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196" status: 200 len: 1475 microversion: 2.1 time: 0.294332 Oct 19 03:17:28.668241 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 730/1519] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:28 2022] GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196 => generated 1475 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:28.678350 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-cf279cdf-dffc-466a-b858-a5ed5ef78300 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] HTTP exception thrown: Instance 84092951-cf52-4077-b954-0babab66565e could not be found. Oct 19 03:17:28.687379 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-cf279cdf-dffc-466a-b858-a5ed5ef78300 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Request method failure captured: Oct 19 03:17:28.687379 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e HTTP/1.1 Oct 19 03:17:28.687379 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:17:28.687379 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:17:28.687379 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:17:28.687379 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:17:28.687379 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:17:28.687379 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:17:28.687379 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:17:28.687379 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:17:28.687379 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2tw8rt6Co2M928rFiSz7OKgMvNQImhAYShrhBgmoSNO_qBbzVtSPIRuxwxSi5ERdGbAfHGwvOU6Sb1fbtUkohW38OIMFua5i3sdtEppPrPTu6-AQeP47DOuEeyLhfErgP3g_RqI9vifX6LwggOrB_xwMqMhkglTLEb5Bfy7NXQQO0Y Oct 19 03:17:28.687379 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:17:28.687379 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:17:28.687379 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:17:28.687379 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:17:28.687379 n-d-861333-8 devstack@n-api.service[121135]: X-Openstack-Nova-Api-Version: 2.91 Oct 19 03:17:28.687379 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:17:28.687379 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:17:28.687379 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 40f9151d61bc4d32a5aff16ca1a0a912 Oct 19 03:17:28.687379 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-UnshelveToHostMultiNodesTest-1530496713 Oct 19 03:17:28.687379 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:17:28.687379 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:17:28.689025 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/40f9151d61bc4d32a5aff16ca1a0a912"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/40f9151d61bc4d32a5aff16ca1a0a912"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/40f9151d61bc4d32a5aff16ca1a0a912"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_40f9151d61bc4d32a5aff16ca1a0a912", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:17:28.689025 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-UnshelveToHostMultiNodesTest-1530496713 Oct 19 03:17:28.689025 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 40f9151d61bc4d32a5aff16ca1a0a912 Oct 19 03:17:28.689025 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-UnshelveToHostMultiNodesTest-1530496713 Oct 19 03:17:28.689025 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-UnshelveToHostMultiNodesTest-1530496713-project Oct 19 03:17:28.689025 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:17:28.689025 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:17:28.689025 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 48d53dcc40524d0dba3d737d29a89209 Oct 19 03:17:28.689025 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-UnshelveToHostMultiNodesTest-1530496713-project Oct 19 03:17:28.689025 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:17:28.689025 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance 84092951-cf52-4077-b954-0babab66565e could not be found. Oct 19 03:17:28.689025 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '84092951-cf52-4077-b954-0babab66565e'} Oct 19 03:17:28.689966 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:17:28.689966 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:17:28.689966 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:17:28.689966 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:17:28.689966 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:17:28.689966 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:17:28.689966 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:17:28.689966 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:17:28.689966 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:17:28.689966 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:17:28.689966 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84092951-cf52-4077-b954-0babab66565e could not be found. Oct 19 03:17:28.689966 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:17:28.689966 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:17:28.689966 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:17:28.689966 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:17:28.689966 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:17:28.689966 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:17:28.689966 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:17:28.689966 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:17:28.689966 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:17:28.691363 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:17:28.691363 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:17:28.691363 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:17:28.691363 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:17:28.691363 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:17:28.691363 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:17:28.691363 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:17:28.691363 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84092951-cf52-4077-b954-0babab66565e could not be found. Oct 19 03:17:28.691363 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:17:28.691363 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:17:28.691363 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:17:28.691363 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:17:28.691363 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:17:28.691363 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:17:28.691363 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:17:28.691363 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:17:28.691363 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84092951-cf52-4077-b954-0babab66565e could not be found. Oct 19 03:17:28.691363 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:17:28.693232 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-cf279cdf-dffc-466a-b858-a5ed5ef78300 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] Returning 404 to user: Instance 84092951-cf52-4077-b954-0babab66565e could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:17:28.694360 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-cf279cdf-dffc-466a-b858-a5ed5ef78300 tempest-UnshelveToHostMultiNodesTest-1530496713 tempest-UnshelveToHostMultiNodesTest-1530496713-project] 10.222.0.52 "GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e" status: 404 len: 111 microversion: 2.91 time: 0.067804 Oct 19 03:17:28.699604 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 790/1520] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:17:28 2022] GET /compute/v2.1/servers/84092951-cf52-4077-b954-0babab66565e => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 19 03:17:29.094258 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-df156f07-e365-4891-8e59-ba12ff5899b9 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:29.096154 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-df156f07-e365-4891-8e59-ba12ff5899b9 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] [instance: 90f71ec9-e698-4159-9458-2099c1fbfaf3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:29.108301 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-df156f07-e365-4891-8e59-ba12ff5899b9 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:29.109209 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-df156f07-e365-4891-8e59-ba12ff5899b9 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:29.109900 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-df156f07-e365-4891-8e59-ba12ff5899b9 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:29.111484 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-df156f07-e365-4891-8e59-ba12ff5899b9 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:29.112486 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-df156f07-e365-4891-8e59-ba12ff5899b9 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:29.113397 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-df156f07-e365-4891-8e59-ba12ff5899b9 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:29.275996 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-df156f07-e365-4891-8e59-ba12ff5899b9 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28072a54d5934ea28e7d3205841c0852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c12a432bbd43bd8f70ba6e941c28a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:29.286359 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-df156f07-e365-4891-8e59-ba12ff5899b9 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] 10.222.0.52 "GET /compute/v2.1/servers/90f71ec9-e698-4159-9458-2099c1fbfaf3" status: 200 len: 1269 microversion: 2.1 time: 0.197088 Oct 19 03:17:29.296992 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 731/1521] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:29 2022] GET /compute/v2.1/servers/90f71ec9-e698-4159-9458-2099c1fbfaf3 => generated 1269 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:29.312996 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-af525647-9e5e-479b-aa25-a614f7ec053f tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:29.313980 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-af525647-9e5e-479b-aa25-a614f7ec053f tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 0843e340-11a3-4a88-b9a6-b0024d3b3152] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:29.334290 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-af525647-9e5e-479b-aa25-a614f7ec053f tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:29.337740 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-af525647-9e5e-479b-aa25-a614f7ec053f tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:29.338449 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-af525647-9e5e-479b-aa25-a614f7ec053f tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:29.339378 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-af525647-9e5e-479b-aa25-a614f7ec053f tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:29.339825 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-af525647-9e5e-479b-aa25-a614f7ec053f tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:29.340261 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-af525647-9e5e-479b-aa25-a614f7ec053f tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:29.371198 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-af525647-9e5e-479b-aa25-a614f7ec053f tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] HTTP exception thrown: Instance 0843e340-11a3-4a88-b9a6-b0024d3b3152 could not be found. Oct 19 03:17:29.377340 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-af525647-9e5e-479b-aa25-a614f7ec053f tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Request method failure captured: Oct 19 03:17:29.377340 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/0843e340-11a3-4a88-b9a6-b0024d3b3152 HTTP/1.1 Oct 19 03:17:29.377340 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:17:29.377340 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:17:29.377340 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:17:29.377340 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:17:29.377340 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:17:29.377340 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:17:29.377340 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:17:29.377340 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:17:29.377340 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2uIr9BvDBnYtOjXORgJ4Qqr6WVLdD9ouG3lYgYuVISlRlRaYBhavBD01rVROkCZkxR9XYWXexaYSEKOFD-WoO2VI67daMYqFdJq0nC95Vi4iLXZzLBKOlmG6HfkRin4f0jmmyKXjHfeDMSqeFm88QUaNhEk881S74x65hVUOW0qpCY Oct 19 03:17:29.377340 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:17:29.377340 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:17:29.377340 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:17:29.377340 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:17:29.377340 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:17:29.377340 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:17:29.377340 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 5d909fe7763841d5b452738112b656d3 Oct 19 03:17:29.377340 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ServersOnMultiNodesTest-1737645722 Oct 19 03:17:29.377340 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:17:29.377340 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:17:29.379469 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5d909fe7763841d5b452738112b656d3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5d909fe7763841d5b452738112b656d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5d909fe7763841d5b452738112b656d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5d909fe7763841d5b452738112b656d3", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:17:29.379469 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ServersOnMultiNodesTest-1737645722 Oct 19 03:17:29.379469 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 5d909fe7763841d5b452738112b656d3 Oct 19 03:17:29.379469 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1737645722 Oct 19 03:17:29.379469 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ServersOnMultiNodesTest-1737645722-project Oct 19 03:17:29.379469 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:17:29.379469 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:17:29.379469 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 3e4d3ddb3a324d9da51c13701e318955 Oct 19 03:17:29.379469 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ServersOnMultiNodesTest-1737645722-project Oct 19 03:17:29.379469 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:17:29.379469 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance 0843e340-11a3-4a88-b9a6-b0024d3b3152 could not be found. Oct 19 03:17:29.379469 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '0843e340-11a3-4a88-b9a6-b0024d3b3152'} Oct 19 03:17:29.380219 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:17:29.380219 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:17:29.380219 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:17:29.380219 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:17:29.380219 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:17:29.380219 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:17:29.380219 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:17:29.380219 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:17:29.380219 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:17:29.380219 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:17:29.380219 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0843e340-11a3-4a88-b9a6-b0024d3b3152 could not be found. Oct 19 03:17:29.380219 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:17:29.380219 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:17:29.380219 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:17:29.380219 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:17:29.380219 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:17:29.380219 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:17:29.380219 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:17:29.380219 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:17:29.380219 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:17:29.381474 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:17:29.381474 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:17:29.381474 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:17:29.381474 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:17:29.381474 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:17:29.381474 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:17:29.381474 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:17:29.381474 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0843e340-11a3-4a88-b9a6-b0024d3b3152 could not be found. Oct 19 03:17:29.381474 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:17:29.381474 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:17:29.381474 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:17:29.381474 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:17:29.381474 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:17:29.381474 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:17:29.381474 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:17:29.381474 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:17:29.381474 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0843e340-11a3-4a88-b9a6-b0024d3b3152 could not be found. Oct 19 03:17:29.381474 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:17:29.382554 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-af525647-9e5e-479b-aa25-a614f7ec053f tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Returning 404 to user: Instance 0843e340-11a3-4a88-b9a6-b0024d3b3152 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:17:29.382554 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-af525647-9e5e-479b-aa25-a614f7ec053f tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/0843e340-11a3-4a88-b9a6-b0024d3b3152" status: 404 len: 111 microversion: 2.1 time: 0.072145 Oct 19 03:17:29.382554 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 791/1522] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:29 2022] GET /compute/v2.1/servers/0843e340-11a3-4a88-b9a6-b0024d3b3152 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:17:29.388055 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4fc65c2b-39f4-43aa-ba08-090185c28822 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:29.389482 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4fc65c2b-39f4-43aa-ba08-090185c28822 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 1ee8c251-b609-4eeb-9406-ede7977b3f92] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:29.409056 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4fc65c2b-39f4-43aa-ba08-090185c28822 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:29.409056 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4fc65c2b-39f4-43aa-ba08-090185c28822 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:29.409056 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4fc65c2b-39f4-43aa-ba08-090185c28822 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:29.410367 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4fc65c2b-39f4-43aa-ba08-090185c28822 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:29.410907 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4fc65c2b-39f4-43aa-ba08-090185c28822 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:29.411480 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4fc65c2b-39f4-43aa-ba08-090185c28822 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:29.439467 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4fc65c2b-39f4-43aa-ba08-090185c28822 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 1ee8c251-b609-4eeb-9406-ede7977b3f92] Going to try to terminate instance {{(pid=121134) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:17:29.692402 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-8350b4ef-45b4-4f46-8b8a-4d0b19dc1d91 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:29.694044 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-8350b4ef-45b4-4f46-8b8a-4d0b19dc1d91 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 84774cfc-79b4-42db-acfd-c4daac86d196] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:29.705073 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8350b4ef-45b4-4f46-8b8a-4d0b19dc1d91 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:29.706389 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8350b4ef-45b4-4f46-8b8a-4d0b19dc1d91 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:29.707138 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8350b4ef-45b4-4f46-8b8a-4d0b19dc1d91 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:29.708116 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8350b4ef-45b4-4f46-8b8a-4d0b19dc1d91 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:29.709223 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8350b4ef-45b4-4f46-8b8a-4d0b19dc1d91 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:29.710099 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8350b4ef-45b4-4f46-8b8a-4d0b19dc1d91 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:29.827077 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4fc65c2b-39f4-43aa-ba08-090185c28822 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1ee8c251-b609-4eeb-9406-ede7977b3f92" status: 204 len: 0 microversion: 2.1 time: 0.446465 Oct 19 03:17:29.828333 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 732/1523] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:17:29 2022] DELETE /compute/v2.1/servers/1ee8c251-b609-4eeb-9406-ede7977b3f92 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:17:29.837970 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-bd65552d-5723-4b30-b204-7edf5fb83bed tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:29.838679 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-bd65552d-5723-4b30-b204-7edf5fb83bed tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 1ee8c251-b609-4eeb-9406-ede7977b3f92] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:29.845280 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bd65552d-5723-4b30-b204-7edf5fb83bed tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:29.845823 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bd65552d-5723-4b30-b204-7edf5fb83bed tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:29.846256 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bd65552d-5723-4b30-b204-7edf5fb83bed tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:29.847406 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bd65552d-5723-4b30-b204-7edf5fb83bed tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:29.848053 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bd65552d-5723-4b30-b204-7edf5fb83bed tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:29.848685 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bd65552d-5723-4b30-b204-7edf5fb83bed tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:30.607877 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-8350b4ef-45b4-4f46-8b8a-4d0b19dc1d91 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:30.620691 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-8350b4ef-45b4-4f46-8b8a-4d0b19dc1d91 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196" status: 200 len: 1475 microversion: 2.1 time: 0.933304 Oct 19 03:17:30.621633 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 792/1524] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:29 2022] GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196 => generated 1475 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:30.632694 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-012286a8-7fda-4283-9d00-fda57dd66bf9 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:30.633635 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-012286a8-7fda-4283-9d00-fda57dd66bf9 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] [instance: 90f71ec9-e698-4159-9458-2099c1fbfaf3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:30.644383 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-012286a8-7fda-4283-9d00-fda57dd66bf9 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:30.646402 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-012286a8-7fda-4283-9d00-fda57dd66bf9 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:30.647377 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-012286a8-7fda-4283-9d00-fda57dd66bf9 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:30.648806 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-012286a8-7fda-4283-9d00-fda57dd66bf9 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:30.649649 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-012286a8-7fda-4283-9d00-fda57dd66bf9 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:30.650321 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-012286a8-7fda-4283-9d00-fda57dd66bf9 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:30.799207 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-bd65552d-5723-4b30-b204-7edf5fb83bed tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:30.814222 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-bd65552d-5723-4b30-b204-7edf5fb83bed tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/1ee8c251-b609-4eeb-9406-ede7977b3f92" status: 200 len: 1473 microversion: 2.1 time: 0.980646 Oct 19 03:17:30.815202 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 733/1525] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:29 2022] GET /compute/v2.1/servers/1ee8c251-b609-4eeb-9406-ede7977b3f92 => generated 1473 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:17:30.907616 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-012286a8-7fda-4283-9d00-fda57dd66bf9 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28072a54d5934ea28e7d3205841c0852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c12a432bbd43bd8f70ba6e941c28a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:30.924968 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-012286a8-7fda-4283-9d00-fda57dd66bf9 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] 10.222.0.52 "GET /compute/v2.1/servers/90f71ec9-e698-4159-9458-2099c1fbfaf3" status: 200 len: 1287 microversion: 2.1 time: 0.301748 Oct 19 03:17:30.925627 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 793/1526] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:30 2022] GET /compute/v2.1/servers/90f71ec9-e698-4159-9458-2099c1fbfaf3 => generated 1287 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:31.151041 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3c2e5707-d3cf-4689-a4ee-61c924063a19 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1368543653", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "networks": [{"uuid": "677c5323-0b52-4960-9b25-9df1b430880a"}, {"uuid": "37a46c79-7abe-43c5-b669-8e72dcc6c008"}]}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:17:31.213800 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-3c2e5707-d3cf-4689-a4ee-61c924063a19 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] validate_networks() for [('677c5323-0b52-4960-9b25-9df1b430880a', None, None, None, None, None), ('37a46c79-7abe-43c5-b669-8e72dcc6c008', None, None, None, None, None)] {{(pid=121134) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:17:31.644848 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6820ee76-48c1-4348-90c9-6aa69a7bfc35 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:31.645508 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6820ee76-48c1-4348-90c9-6aa69a7bfc35 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 84774cfc-79b4-42db-acfd-c4daac86d196] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:31.653064 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6820ee76-48c1-4348-90c9-6aa69a7bfc35 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:31.653829 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6820ee76-48c1-4348-90c9-6aa69a7bfc35 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:31.654433 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6820ee76-48c1-4348-90c9-6aa69a7bfc35 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:31.655316 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6820ee76-48c1-4348-90c9-6aa69a7bfc35 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:31.655963 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6820ee76-48c1-4348-90c9-6aa69a7bfc35 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:31.656556 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6820ee76-48c1-4348-90c9-6aa69a7bfc35 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:32.095901 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-6820ee76-48c1-4348-90c9-6aa69a7bfc35 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:32.132514 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6820ee76-48c1-4348-90c9-6aa69a7bfc35 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196" status: 200 len: 1475 microversion: 2.1 time: 0.491495 Oct 19 03:17:32.133673 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 794/1527] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:31 2022] GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196 => generated 1475 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:17:32.159644 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2414b660-8005-43d0-ace9-2cb3273135aa tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:32.160273 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-2414b660-8005-43d0-ace9-2cb3273135aa tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 1ee8c251-b609-4eeb-9406-ede7977b3f92] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:32.167907 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2414b660-8005-43d0-ace9-2cb3273135aa tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:32.168411 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2414b660-8005-43d0-ace9-2cb3273135aa tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:32.168858 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2414b660-8005-43d0-ace9-2cb3273135aa tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:32.169608 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2414b660-8005-43d0-ace9-2cb3273135aa tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:32.170110 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2414b660-8005-43d0-ace9-2cb3273135aa tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:32.170537 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2414b660-8005-43d0-ace9-2cb3273135aa tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:32.717271 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-2414b660-8005-43d0-ace9-2cb3273135aa tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:32.730050 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2414b660-8005-43d0-ace9-2cb3273135aa tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/1ee8c251-b609-4eeb-9406-ede7977b3f92" status: 200 len: 1473 microversion: 2.1 time: 0.577549 Oct 19 03:17:32.730907 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 795/1528] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:32 2022] GET /compute/v2.1/servers/1ee8c251-b609-4eeb-9406-ede7977b3f92 => generated 1473 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:32.736334 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-8ff260f7-93ef-4210-ba71-a452369149ed tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:32.737735 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-8ff260f7-93ef-4210-ba71-a452369149ed tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] [instance: 90f71ec9-e698-4159-9458-2099c1fbfaf3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:32.746345 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=6,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:17:32.751102 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8ff260f7-93ef-4210-ba71-a452369149ed tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:32.752002 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8ff260f7-93ef-4210-ba71-a452369149ed tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:32.752790 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8ff260f7-93ef-4210-ba71-a452369149ed tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:32.754165 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8ff260f7-93ef-4210-ba71-a452369149ed tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:32.754952 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8ff260f7-93ef-4210-ba71-a452369149ed tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:32.755871 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8ff260f7-93ef-4210-ba71-a452369149ed tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:33.197920 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-3c2e5707-d3cf-4689-a4ee-61c924063a19 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Flavor limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:17:33.198419 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-3c2e5707-d3cf-4689-a4ee-61c924063a19 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Image limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:17:33.198812 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-3c2e5707-d3cf-4689-a4ee-61c924063a19 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Flavor pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:17:33.199237 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-3c2e5707-d3cf-4689-a4ee-61c924063a19 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Image pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:17:33.201421 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-3c2e5707-d3cf-4689-a4ee-61c924063a19 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:17:33.222392 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3c2e5707-d3cf-4689-a4ee-61c924063a19 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:33.222900 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3c2e5707-d3cf-4689-a4ee-61c924063a19 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:33.223381 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3c2e5707-d3cf-4689-a4ee-61c924063a19 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:33.224138 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3c2e5707-d3cf-4689-a4ee-61c924063a19 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:33.230834 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3c2e5707-d3cf-4689-a4ee-61c924063a19 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:33.232978 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3c2e5707-d3cf-4689-a4ee-61c924063a19 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:33.239426 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-8ff260f7-93ef-4210-ba71-a452369149ed tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28072a54d5934ea28e7d3205841c0852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c12a432bbd43bd8f70ba6e941c28a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:33.253576 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-8ff260f7-93ef-4210-ba71-a452369149ed tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] 10.222.0.52 "GET /compute/v2.1/servers/90f71ec9-e698-4159-9458-2099c1fbfaf3" status: 200 len: 1317 microversion: 2.1 time: 0.521186 Oct 19 03:17:33.254926 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 796/1529] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:32 2022] GET /compute/v2.1/servers/90f71ec9-e698-4159-9458-2099c1fbfaf3 => generated 1317 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:33.261887 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-3bf03a49-cc1b-4e73-9bba-22f7cbdf3646 req-028426cb-d506-4f63-9f84-942671057325 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ee8c251-b609-4eeb-9406-ede7977b3f92", "name": "network-vif-deleted", "tag": "00715d2d-0cc6-4f47-a5c6-da7f988d8c1f"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:17:33.276664 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-3bf03a49-cc1b-4e73-9bba-22f7cbdf3646 req-028426cb-d506-4f63-9f84-942671057325 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:33.277750 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-3bf03a49-cc1b-4e73-9bba-22f7cbdf3646 req-028426cb-d506-4f63-9f84-942671057325 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:33.278375 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-3bf03a49-cc1b-4e73-9bba-22f7cbdf3646 req-028426cb-d506-4f63-9f84-942671057325 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:33.287095 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-3c2e5707-d3cf-4689-a4ee-61c924063a19 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Getting quotas for project 0fcd49d68a3947249016cc5dbe910efc. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:17:33.299181 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-3c2e5707-d3cf-4689-a4ee-61c924063a19 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Getting quotas for user d3c35b71372843d69f9a6c6be04b154f and project 0fcd49d68a3947249016cc5dbe910efc. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:17:33.304291 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-3bf03a49-cc1b-4e73-9bba-22f7cbdf3646 req-028426cb-d506-4f63-9f84-942671057325 service nova] Creating event network-vif-deleted:00715d2d-0cc6-4f47-a5c6-da7f988d8c1f for instance 1ee8c251-b609-4eeb-9406-ede7977b3f92 on n-h1-861333-8 Oct 19 03:17:33.312754 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-3bf03a49-cc1b-4e73-9bba-22f7cbdf3646 req-028426cb-d506-4f63-9f84-942671057325 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053206 Oct 19 03:17:33.312754 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 797/1530] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:17:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:17:33.317594 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d1599a64-b9e5-4ce9-8e23-54daf46deec1 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:33.318675 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d1599a64-b9e5-4ce9-8e23-54daf46deec1 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 84774cfc-79b4-42db-acfd-c4daac86d196] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:33.326269 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d1599a64-b9e5-4ce9-8e23-54daf46deec1 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:33.326979 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d1599a64-b9e5-4ce9-8e23-54daf46deec1 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:33.327478 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d1599a64-b9e5-4ce9-8e23-54daf46deec1 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:33.328821 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d1599a64-b9e5-4ce9-8e23-54daf46deec1 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:33.330048 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d1599a64-b9e5-4ce9-8e23-54daf46deec1 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:33.330808 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d1599a64-b9e5-4ce9-8e23-54daf46deec1 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:33.349605 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3c2e5707-d3cf-4689-a4ee-61c924063a19 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Going to run 1 instances... {{(pid=121134) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:17:33.356713 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3c2e5707-d3cf-4689-a4ee-61c924063a19 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] [instance: 64d3b78b-7953-40fc-ab53-b35f9d105901] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:17:33.561570 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3c2e5707-d3cf-4689-a4ee-61c924063a19 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.415550 Oct 19 03:17:33.562367 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 734/1531] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:17:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 2417 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 03:17:33.575719 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9378b96a-d016-4623-83cb-ed347b17c042 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:33.576600 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9378b96a-d016-4623-83cb-ed347b17c042 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] [instance: 64d3b78b-7953-40fc-ab53-b35f9d105901] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:33.729720 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9378b96a-d016-4623-83cb-ed347b17c042 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c35b71372843d69f9a6c6be04b154f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcd49d68a3947249016cc5dbe910efc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:33.736954 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9378b96a-d016-4623-83cb-ed347b17c042 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] 10.222.0.52 "GET /compute/v2.1/servers/64d3b78b-7953-40fc-ab53-b35f9d105901" status: 200 len: 1213 microversion: 2.1 time: 0.166654 Oct 19 03:17:33.741561 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 735/1532] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:33 2022] GET /compute/v2.1/servers/64d3b78b-7953-40fc-ab53-b35f9d105901 => generated 1213 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:33.760764 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b6ed6878-b265-4644-867a-077556fbed12 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:33.765666 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b6ed6878-b265-4644-867a-077556fbed12 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 1ee8c251-b609-4eeb-9406-ede7977b3f92] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:33.767990 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d1599a64-b9e5-4ce9-8e23-54daf46deec1 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:33.787013 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d1599a64-b9e5-4ce9-8e23-54daf46deec1 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196" status: 200 len: 1475 microversion: 2.1 time: 0.467823 Oct 19 03:17:33.787013 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 798/1533] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:33 2022] GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196 => generated 1475 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:33.787538 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b6ed6878-b265-4644-867a-077556fbed12 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:33.787538 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b6ed6878-b265-4644-867a-077556fbed12 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:33.807125 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b6ed6878-b265-4644-867a-077556fbed12 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:33.810657 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b6ed6878-b265-4644-867a-077556fbed12 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:33.811105 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b6ed6878-b265-4644-867a-077556fbed12 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:33.811740 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b6ed6878-b265-4644-867a-077556fbed12 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:33.876694 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b6ed6878-b265-4644-867a-077556fbed12 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:33.877185 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b6ed6878-b265-4644-867a-077556fbed12 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:33.881902 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b6ed6878-b265-4644-867a-077556fbed12 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:33.882499 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-b6ed6878-b265-4644-867a-077556fbed12 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lazy-loading 'fault' on Instance uuid 1ee8c251-b609-4eeb-9406-ede7977b3f92 {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:17:34.156678 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b6ed6878-b265-4644-867a-077556fbed12 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:34.179978 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b6ed6878-b265-4644-867a-077556fbed12 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/1ee8c251-b609-4eeb-9406-ede7977b3f92" status: 200 len: 1307 microversion: 2.1 time: 0.427294 Oct 19 03:17:34.184314 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 736/1534] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:33 2022] GET /compute/v2.1/servers/1ee8c251-b609-4eeb-9406-ede7977b3f92 => generated 1307 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:34.284315 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c5eb9ce7-a4f5-470d-89c7-50e44b79c343 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:34.285315 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c5eb9ce7-a4f5-470d-89c7-50e44b79c343 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] [instance: 90f71ec9-e698-4159-9458-2099c1fbfaf3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:34.292536 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c5eb9ce7-a4f5-470d-89c7-50e44b79c343 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:34.293038 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c5eb9ce7-a4f5-470d-89c7-50e44b79c343 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:34.293691 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c5eb9ce7-a4f5-470d-89c7-50e44b79c343 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:34.294572 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c5eb9ce7-a4f5-470d-89c7-50e44b79c343 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:34.295748 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c5eb9ce7-a4f5-470d-89c7-50e44b79c343 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:34.297261 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c5eb9ce7-a4f5-470d-89c7-50e44b79c343 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:34.572193 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c5eb9ce7-a4f5-470d-89c7-50e44b79c343 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28072a54d5934ea28e7d3205841c0852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c12a432bbd43bd8f70ba6e941c28a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:34.584274 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c5eb9ce7-a4f5-470d-89c7-50e44b79c343 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] 10.222.0.52 "GET /compute/v2.1/servers/90f71ec9-e698-4159-9458-2099c1fbfaf3" status: 200 len: 1317 microversion: 2.1 time: 0.304166 Oct 19 03:17:34.588557 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 799/1535] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:34 2022] GET /compute/v2.1/servers/90f71ec9-e698-4159-9458-2099c1fbfaf3 => generated 1317 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:34.657043 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9bae5cc8-9bb8-424f-9765-a2f1f11a21f7 tempest-FlavorsV2TestJSON-1219044963 tempest-FlavorsV2TestJSON-1219044963-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:34.672871 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9bae5cc8-9bb8-424f-9765-a2f1f11a21f7 tempest-FlavorsV2TestJSON-1219044963 tempest-FlavorsV2TestJSON-1219044963-project] 10.222.0.52 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.261806 Oct 19 03:17:34.673714 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 737/1536] 10.222.0.52 () {58 vars in 1137 bytes} [Wed Oct 19 03:17:34 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:17:34.689271 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-54e767eb-24e7-44d9-b275-178e862f92c3 tempest-FlavorsV2TestJSON-1219044963 tempest-FlavorsV2TestJSON-1219044963-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:34.726011 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-54e767eb-24e7-44d9-b275-178e862f92c3 tempest-FlavorsV2TestJSON-1219044963 tempest-FlavorsV2TestJSON-1219044963-project] 10.222.0.52 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.026784 Oct 19 03:17:34.726011 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 800/1537] 10.222.0.52 () {58 vars in 1125 bytes} [Wed Oct 19 03:17:34 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:34.733864 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8f649d66-0592-4b6e-978c-acff5c1ef7a8 tempest-FlavorsV2TestJSON-1219044963 tempest-FlavorsV2TestJSON-1219044963-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:34.757671 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8f649d66-0592-4b6e-978c-acff5c1ef7a8 tempest-FlavorsV2TestJSON-1219044963 tempest-FlavorsV2TestJSON-1219044963-project] 10.222.0.52 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.029670 Oct 19 03:17:34.758356 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 738/1538] 10.222.0.52 () {58 vars in 1137 bytes} [Wed Oct 19 03:17:34 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:17:34.772344 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0e145354-ce54-494b-83aa-7206a383225d tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:34.780793 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0e145354-ce54-494b-83aa-7206a383225d tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] [instance: 64d3b78b-7953-40fc-ab53-b35f9d105901] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:34.811818 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9aff0616-5afb-45b5-bf0d-3e148228cf2a tempest-FlavorsV2TestJSON-1219044963 tempest-FlavorsV2TestJSON-1219044963-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:34.831417 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0e145354-ce54-494b-83aa-7206a383225d tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:34.831672 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0e145354-ce54-494b-83aa-7206a383225d tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:34.832180 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0e145354-ce54-494b-83aa-7206a383225d tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:34.837310 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9aff0616-5afb-45b5-bf0d-3e148228cf2a tempest-FlavorsV2TestJSON-1219044963 tempest-FlavorsV2TestJSON-1219044963-project] 10.222.0.52 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.047456 Oct 19 03:17:34.837704 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0e145354-ce54-494b-83aa-7206a383225d tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:34.838348 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0e145354-ce54-494b-83aa-7206a383225d tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:34.839111 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 739/1539] 10.222.0.52 () {58 vars in 1137 bytes} [Wed Oct 19 03:17:34 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:17:34.839954 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0e145354-ce54-494b-83aa-7206a383225d tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:34.844922 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-56c3bf17-5bd2-4be1-a547-47c73b2ad498 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:34.850452 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-56c3bf17-5bd2-4be1-a547-47c73b2ad498 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 84774cfc-79b4-42db-acfd-c4daac86d196] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:34.870724 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-56c3bf17-5bd2-4be1-a547-47c73b2ad498 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:34.871461 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-56c3bf17-5bd2-4be1-a547-47c73b2ad498 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:34.871791 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-56c3bf17-5bd2-4be1-a547-47c73b2ad498 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:34.872654 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-56c3bf17-5bd2-4be1-a547-47c73b2ad498 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:34.873850 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-56c3bf17-5bd2-4be1-a547-47c73b2ad498 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:34.875684 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-56c3bf17-5bd2-4be1-a547-47c73b2ad498 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:34.906738 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:17:34.936944 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-0e145354-ce54-494b-83aa-7206a383225d tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c35b71372843d69f9a6c6be04b154f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcd49d68a3947249016cc5dbe910efc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:34.947362 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0e145354-ce54-494b-83aa-7206a383225d tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] 10.222.0.52 "GET /compute/v2.1/servers/64d3b78b-7953-40fc-ab53-b35f9d105901" status: 200 len: 1217 microversion: 2.1 time: 0.186080 Oct 19 03:17:34.953763 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 801/1540] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:34 2022] GET /compute/v2.1/servers/64d3b78b-7953-40fc-ab53-b35f9d105901 => generated 1217 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:34.961141 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2f92359a-2a11-45ef-a228-ad11d709fcbd tempest-FlavorsV2TestJSON-1219044963 tempest-FlavorsV2TestJSON-1219044963-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:34.998746 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2f92359a-2a11-45ef-a228-ad11d709fcbd tempest-FlavorsV2TestJSON-1219044963 tempest-FlavorsV2TestJSON-1219044963-project] 10.222.0.52 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.041777 Oct 19 03:17:34.999457 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 802/1541] 10.222.0.52 () {58 vars in 1165 bytes} [Wed Oct 19 03:17:34 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:35.029140 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d2dd7f11-c153-4508-a64d-45f9f64815a9 tempest-FlavorsV2TestJSON-1219044963 tempest-FlavorsV2TestJSON-1219044963-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:35.038384 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d2dd7f11-c153-4508-a64d-45f9f64815a9 tempest-FlavorsV2TestJSON-1219044963 tempest-FlavorsV2TestJSON-1219044963-project] 10.222.0.52 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.022110 Oct 19 03:17:35.039127 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 803/1542] 10.222.0.52 () {58 vars in 1137 bytes} [Wed Oct 19 03:17:35 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:17:35.052067 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5c25a9e6-05f0-40bd-b76b-261b8c5c2a40 tempest-FlavorsV2TestJSON-1219044963 tempest-FlavorsV2TestJSON-1219044963-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:35.083829 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5c25a9e6-05f0-40bd-b76b-261b8c5c2a40 tempest-FlavorsV2TestJSON-1219044963 tempest-FlavorsV2TestJSON-1219044963-project] 10.222.0.52 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.036210 Oct 19 03:17:35.084376 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 804/1543] 10.222.0.52 () {58 vars in 1169 bytes} [Wed Oct 19 03:17:35 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:17:35.100635 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1e653141-5109-457c-9bb9-e1fa08d2cb48 tempest-FlavorsV2TestJSON-1219044963 tempest-FlavorsV2TestJSON-1219044963-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:35.115302 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1e653141-5109-457c-9bb9-e1fa08d2cb48 tempest-FlavorsV2TestJSON-1219044963 tempest-FlavorsV2TestJSON-1219044963-project] 10.222.0.52 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.018459 Oct 19 03:17:35.115888 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 805/1544] 10.222.0.52 () {58 vars in 1161 bytes} [Wed Oct 19 03:17:35 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:17:35.132333 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c19963db-4b04-4d67-9eec-463edd9ab9d5 tempest-FlavorsV2TestJSON-1219044963 tempest-FlavorsV2TestJSON-1219044963-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:35.142394 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c19963db-4b04-4d67-9eec-463edd9ab9d5 tempest-FlavorsV2TestJSON-1219044963 tempest-FlavorsV2TestJSON-1219044963-project] 10.222.0.52 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014342 Oct 19 03:17:35.143003 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 806/1545] 10.222.0.52 () {58 vars in 1137 bytes} [Wed Oct 19 03:17:35 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:17:35.156036 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-405cede5-b235-41c6-8fc9-6a23ecfa6c7a tempest-FlavorsV2TestJSON-1219044963 tempest-FlavorsV2TestJSON-1219044963-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:35.202841 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-405cede5-b235-41c6-8fc9-6a23ecfa6c7a tempest-FlavorsV2TestJSON-1219044963 tempest-FlavorsV2TestJSON-1219044963-project] 10.222.0.52 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.050973 Oct 19 03:17:35.203960 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 807/1546] 10.222.0.52 () {58 vars in 1167 bytes} [Wed Oct 19 03:17:35 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:17:35.220299 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3b4f6394-ab5d-451f-8604-3f8dcf863131 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:35.221252 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-3b4f6394-ab5d-451f-8604-3f8dcf863131 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 1ee8c251-b609-4eeb-9406-ede7977b3f92] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:35.228657 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3b4f6394-ab5d-451f-8604-3f8dcf863131 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:35.229152 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3b4f6394-ab5d-451f-8604-3f8dcf863131 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:35.229707 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3b4f6394-ab5d-451f-8604-3f8dcf863131 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:35.230422 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3b4f6394-ab5d-451f-8604-3f8dcf863131 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:35.230898 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3b4f6394-ab5d-451f-8604-3f8dcf863131 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:35.231312 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3b4f6394-ab5d-451f-8604-3f8dcf863131 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:35.248019 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-3b4f6394-ab5d-451f-8604-3f8dcf863131 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] HTTP exception thrown: Instance 1ee8c251-b609-4eeb-9406-ede7977b3f92 could not be found. Oct 19 03:17:35.250019 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3b4f6394-ab5d-451f-8604-3f8dcf863131 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Request method failure captured: Oct 19 03:17:35.250019 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/1ee8c251-b609-4eeb-9406-ede7977b3f92 HTTP/1.1 Oct 19 03:17:35.250019 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:17:35.250019 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:17:35.250019 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:17:35.250019 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:17:35.250019 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:17:35.250019 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:17:35.250019 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:17:35.250019 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:17:35.250019 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2uIr9BvDBnYtOjXORgJ4Qqr6WVLdD9ouG3lYgYuVISlRlRaYBhavBD01rVROkCZkxR9XYWXexaYSEKOFD-WoO2VI67daMYqFdJq0nC95Vi4iLXZzLBKOlmG6HfkRin4f0jmmyKXjHfeDMSqeFm88QUaNhEk881S74x65hVUOW0qpCY Oct 19 03:17:35.250019 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:17:35.250019 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:17:35.250019 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:17:35.250019 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:17:35.250019 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:17:35.250019 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:17:35.250019 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 5d909fe7763841d5b452738112b656d3 Oct 19 03:17:35.250019 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ServersOnMultiNodesTest-1737645722 Oct 19 03:17:35.250019 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:17:35.250019 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:17:35.251698 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5d909fe7763841d5b452738112b656d3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5d909fe7763841d5b452738112b656d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5d909fe7763841d5b452738112b656d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5d909fe7763841d5b452738112b656d3", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:17:35.251698 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ServersOnMultiNodesTest-1737645722 Oct 19 03:17:35.251698 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 5d909fe7763841d5b452738112b656d3 Oct 19 03:17:35.251698 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1737645722 Oct 19 03:17:35.251698 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ServersOnMultiNodesTest-1737645722-project Oct 19 03:17:35.251698 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:17:35.251698 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:17:35.251698 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 3e4d3ddb3a324d9da51c13701e318955 Oct 19 03:17:35.251698 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ServersOnMultiNodesTest-1737645722-project Oct 19 03:17:35.251698 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:17:35.251698 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance 1ee8c251-b609-4eeb-9406-ede7977b3f92 could not be found. Oct 19 03:17:35.251698 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '1ee8c251-b609-4eeb-9406-ede7977b3f92'} Oct 19 03:17:35.252602 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:17:35.252602 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:17:35.252602 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:17:35.252602 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:17:35.252602 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:17:35.252602 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:17:35.252602 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:17:35.252602 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:17:35.252602 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:17:35.252602 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:17:35.252602 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ee8c251-b609-4eeb-9406-ede7977b3f92 could not be found. Oct 19 03:17:35.252602 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:17:35.252602 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:17:35.252602 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:17:35.252602 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:17:35.252602 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:17:35.252602 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:17:35.252602 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:17:35.252602 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:17:35.252602 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:17:35.254094 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:17:35.254094 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:17:35.254094 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:17:35.254094 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:17:35.254094 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:17:35.254094 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:17:35.254094 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:17:35.254094 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ee8c251-b609-4eeb-9406-ede7977b3f92 could not be found. Oct 19 03:17:35.254094 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:17:35.254094 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:17:35.254094 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:17:35.254094 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:17:35.254094 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:17:35.254094 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:17:35.254094 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:17:35.254094 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:17:35.254094 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ee8c251-b609-4eeb-9406-ede7977b3f92 could not be found. Oct 19 03:17:35.254094 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:17:35.256236 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3b4f6394-ab5d-451f-8604-3f8dcf863131 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Returning 404 to user: Instance 1ee8c251-b609-4eeb-9406-ede7977b3f92 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:17:35.257514 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-3b4f6394-ab5d-451f-8604-3f8dcf863131 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/1ee8c251-b609-4eeb-9406-ede7977b3f92" status: 404 len: 111 microversion: 2.1 time: 0.043786 Oct 19 03:17:35.258112 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 808/1547] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:35 2022] GET /compute/v2.1/servers/1ee8c251-b609-4eeb-9406-ede7977b3f92 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:17:35.263750 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-efb0db1b-6eaa-4d46-9474-95508faf8e00 tempest-FlavorsV2TestJSON-1219044963 tempest-FlavorsV2TestJSON-1219044963-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:35.273245 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-efb0db1b-6eaa-4d46-9474-95508faf8e00 tempest-FlavorsV2TestJSON-1219044963 tempest-FlavorsV2TestJSON-1219044963-project] 10.222.0.52 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013332 Oct 19 03:17:35.274194 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 809/1548] 10.222.0.52 () {58 vars in 1137 bytes} [Wed Oct 19 03:17:35 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:17:35.287239 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-838107e3-76a8-467e-aa07-1b68bf470226 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:35.288584 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-838107e3-76a8-467e-aa07-1b68bf470226 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 46e24c0c-6e9f-4a51-a10e-dcb68ebf6f9d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:35.299006 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-838107e3-76a8-467e-aa07-1b68bf470226 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:35.299822 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-838107e3-76a8-467e-aa07-1b68bf470226 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:35.301362 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-838107e3-76a8-467e-aa07-1b68bf470226 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:35.302691 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-838107e3-76a8-467e-aa07-1b68bf470226 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:35.303320 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-838107e3-76a8-467e-aa07-1b68bf470226 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:35.303984 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-838107e3-76a8-467e-aa07-1b68bf470226 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:35.336930 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-838107e3-76a8-467e-aa07-1b68bf470226 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 46e24c0c-6e9f-4a51-a10e-dcb68ebf6f9d] Going to try to terminate instance {{(pid=121135) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:17:35.412162 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-56c3bf17-5bd2-4be1-a547-47c73b2ad498 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:35.421749 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-56c3bf17-5bd2-4be1-a547-47c73b2ad498 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196" status: 200 len: 1475 microversion: 2.1 time: 0.580566 Oct 19 03:17:35.429539 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 740/1549] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:34 2022] GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196 => generated 1475 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:35.429539 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8e0c5458-5618-41c1-bb97-5ebcd2a2a5c5 tempest-FlavorsV2TestJSON-1219044963 tempest-FlavorsV2TestJSON-1219044963-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:35.465354 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8e0c5458-5618-41c1-bb97-5ebcd2a2a5c5 tempest-FlavorsV2TestJSON-1219044963 tempest-FlavorsV2TestJSON-1219044963-project] 10.222.0.52 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.041420 Oct 19 03:17:35.466290 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 741/1550] 10.222.0.52 () {58 vars in 1144 bytes} [Wed Oct 19 03:17:35 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:35.545740 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-f99881ad-a3c8-44df-bd4a-90ff437ab8c1 req-568639fd-9a76-474c-8805-740bd09f59c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90f71ec9-e698-4159-9458-2099c1fbfaf3", "tag": "dd90515a-2014-4fa0-a26c-9f9741b8ce8c"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:17:35.549753 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-f99881ad-a3c8-44df-bd4a-90ff437ab8c1 req-568639fd-9a76-474c-8805-740bd09f59c2 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:35.550359 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-f99881ad-a3c8-44df-bd4a-90ff437ab8c1 req-568639fd-9a76-474c-8805-740bd09f59c2 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:35.550897 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-f99881ad-a3c8-44df-bd4a-90ff437ab8c1 req-568639fd-9a76-474c-8805-740bd09f59c2 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:35.564293 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-f99881ad-a3c8-44df-bd4a-90ff437ab8c1 req-568639fd-9a76-474c-8805-740bd09f59c2 service nova] Creating event network-changed:dd90515a-2014-4fa0-a26c-9f9741b8ce8c for instance 90f71ec9-e698-4159-9458-2099c1fbfaf3 on n-h2-861333-8 Oct 19 03:17:35.569311 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-f99881ad-a3c8-44df-bd4a-90ff437ab8c1 req-568639fd-9a76-474c-8805-740bd09f59c2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101839 Oct 19 03:17:35.570371 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 742/1551] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:17:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:17:35.577010 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7469dec2-6ccb-406f-a738-65b06884608e tempest-FlavorsV2TestJSON-1219044963 tempest-FlavorsV2TestJSON-1219044963-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:35.583828 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7469dec2-6ccb-406f-a738-65b06884608e tempest-FlavorsV2TestJSON-1219044963 tempest-FlavorsV2TestJSON-1219044963-project] 10.222.0.52 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012260 Oct 19 03:17:35.584412 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 743/1552] 10.222.0.52 () {58 vars in 1137 bytes} [Wed Oct 19 03:17:35 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:17:35.597135 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c779ae94-0084-4439-9f88-1aeabd983c43 tempest-FlavorsV2TestJSON-1219044963 tempest-FlavorsV2TestJSON-1219044963-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:35.626231 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c779ae94-0084-4439-9f88-1aeabd983c43 tempest-FlavorsV2TestJSON-1219044963 tempest-FlavorsV2TestJSON-1219044963-project] 10.222.0.52 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.033050 Oct 19 03:17:35.633551 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 744/1553] 10.222.0.52 () {58 vars in 1148 bytes} [Wed Oct 19 03:17:35 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:17:35.645055 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-798276a1-45b6-493b-9c39-67bb69c3f7a2 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:35.648841 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-798276a1-45b6-493b-9c39-67bb69c3f7a2 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] [instance: 90f71ec9-e698-4159-9458-2099c1fbfaf3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:35.658259 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-798276a1-45b6-493b-9c39-67bb69c3f7a2 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:35.658950 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-798276a1-45b6-493b-9c39-67bb69c3f7a2 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:35.659447 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-798276a1-45b6-493b-9c39-67bb69c3f7a2 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:35.660464 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-798276a1-45b6-493b-9c39-67bb69c3f7a2 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:35.661149 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-798276a1-45b6-493b-9c39-67bb69c3f7a2 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:35.661840 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-798276a1-45b6-493b-9c39-67bb69c3f7a2 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:35.731031 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-838107e3-76a8-467e-aa07-1b68bf470226 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "DELETE /compute/v2.1/servers/46e24c0c-6e9f-4a51-a10e-dcb68ebf6f9d" status: 204 len: 0 microversion: 2.1 time: 0.450927 Oct 19 03:17:35.732198 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 810/1554] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:17:35 2022] DELETE /compute/v2.1/servers/46e24c0c-6e9f-4a51-a10e-dcb68ebf6f9d => generated 0 bytes in 457 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:17:35.738877 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4cad9b9d-8eef-4a33-a239-ade8f5a0bd8b tempest-FlavorsV2TestJSON-1219044963 tempest-FlavorsV2TestJSON-1219044963-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:35.757463 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4cad9b9d-8eef-4a33-a239-ade8f5a0bd8b tempest-FlavorsV2TestJSON-1219044963 tempest-FlavorsV2TestJSON-1219044963-project] 10.222.0.52 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.023305 Oct 19 03:17:35.758047 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 811/1555] 10.222.0.52 () {58 vars in 1140 bytes} [Wed Oct 19 03:17:35 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:17:35.762611 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-14bcf197-f080-418f-b913-5579fbd934af tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:35.763214 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-14bcf197-f080-418f-b913-5579fbd934af tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 88b09b16-f667-4ab9-89ca-a26dc86967ae] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:35.770069 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-14bcf197-f080-418f-b913-5579fbd934af tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:35.770570 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-14bcf197-f080-418f-b913-5579fbd934af tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:35.773007 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-14bcf197-f080-418f-b913-5579fbd934af tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:35.773007 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-14bcf197-f080-418f-b913-5579fbd934af tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:35.773007 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-14bcf197-f080-418f-b913-5579fbd934af tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:35.773007 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-14bcf197-f080-418f-b913-5579fbd934af tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:35.809199 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-14bcf197-f080-418f-b913-5579fbd934af tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 88b09b16-f667-4ab9-89ca-a26dc86967ae] Going to try to terminate instance {{(pid=121135) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:17:35.919262 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-798276a1-45b6-493b-9c39-67bb69c3f7a2 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28072a54d5934ea28e7d3205841c0852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c12a432bbd43bd8f70ba6e941c28a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:35.927272 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-798276a1-45b6-493b-9c39-67bb69c3f7a2 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] 10.222.0.52 "GET /compute/v2.1/servers/90f71ec9-e698-4159-9458-2099c1fbfaf3" status: 200 len: 1317 microversion: 2.1 time: 0.291822 Oct 19 03:17:35.927931 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 745/1556] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:35 2022] GET /compute/v2.1/servers/90f71ec9-e698-4159-9458-2099c1fbfaf3 => generated 1317 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:35.933119 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5f4ecfc1-c3a4-4cd7-8231-1bda4421583a tempest-FlavorsV2TestJSON-1219044963 tempest-FlavorsV2TestJSON-1219044963-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:35.946225 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5f4ecfc1-c3a4-4cd7-8231-1bda4421583a tempest-FlavorsV2TestJSON-1219044963 tempest-FlavorsV2TestJSON-1219044963-project] 10.222.0.52 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017215 Oct 19 03:17:35.952045 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 746/1557] 10.222.0.52 () {58 vars in 1137 bytes} [Wed Oct 19 03:17:35 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:17:35.972940 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d14ea34f-7637-443f-abcf-40128e3b2809 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:35.973764 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d14ea34f-7637-443f-abcf-40128e3b2809 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] [instance: 64d3b78b-7953-40fc-ab53-b35f9d105901] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:35.981986 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d14ea34f-7637-443f-abcf-40128e3b2809 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:35.984443 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d14ea34f-7637-443f-abcf-40128e3b2809 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:35.985920 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d14ea34f-7637-443f-abcf-40128e3b2809 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:35.986824 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d14ea34f-7637-443f-abcf-40128e3b2809 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:35.989166 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d14ea34f-7637-443f-abcf-40128e3b2809 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:35.990512 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d14ea34f-7637-443f-abcf-40128e3b2809 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:35.996720 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:17:36.131773 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d14ea34f-7637-443f-abcf-40128e3b2809 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c35b71372843d69f9a6c6be04b154f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcd49d68a3947249016cc5dbe910efc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:36.142299 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d14ea34f-7637-443f-abcf-40128e3b2809 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] 10.222.0.52 "GET /compute/v2.1/servers/64d3b78b-7953-40fc-ab53-b35f9d105901" status: 200 len: 1265 microversion: 2.1 time: 0.174018 Oct 19 03:17:36.143606 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 747/1558] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:35 2022] GET /compute/v2.1/servers/64d3b78b-7953-40fc-ab53-b35f9d105901 => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:36.150391 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7e09ff4f-a95c-471a-b47f-1d311e501ba7 tempest-FlavorsV2TestJSON-1219044963 tempest-FlavorsV2TestJSON-1219044963-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:36.220747 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7e09ff4f-a95c-471a-b47f-1d311e501ba7 tempest-FlavorsV2TestJSON-1219044963 tempest-FlavorsV2TestJSON-1219044963-project] 10.222.0.52 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.075258 Oct 19 03:17:36.221347 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 748/1559] 10.222.0.52 () {58 vars in 1146 bytes} [Wed Oct 19 03:17:36 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:36.226738 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-14bcf197-f080-418f-b913-5579fbd934af tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "DELETE /compute/v2.1/servers/88b09b16-f667-4ab9-89ca-a26dc86967ae" status: 204 len: 0 microversion: 2.1 time: 0.467444 Oct 19 03:17:36.227390 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 812/1560] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:17:35 2022] DELETE /compute/v2.1/servers/88b09b16-f667-4ab9-89ca-a26dc86967ae => generated 0 bytes in 469 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:17:36.239367 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-03b811bd-ca87-4eb2-8864-43c84b2d20c9 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:36.239878 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-70afe109-d2dd-4690-b3e9-b1123c30347d tempest-FlavorsV2TestJSON-1219044963 tempest-FlavorsV2TestJSON-1219044963-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:36.240044 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-03b811bd-ca87-4eb2-8864-43c84b2d20c9 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 46e24c0c-6e9f-4a51-a10e-dcb68ebf6f9d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:36.251326 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-03b811bd-ca87-4eb2-8864-43c84b2d20c9 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:36.251833 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-03b811bd-ca87-4eb2-8864-43c84b2d20c9 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:36.252416 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-03b811bd-ca87-4eb2-8864-43c84b2d20c9 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:36.258046 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-03b811bd-ca87-4eb2-8864-43c84b2d20c9 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:36.258046 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-03b811bd-ca87-4eb2-8864-43c84b2d20c9 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:36.258046 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-03b811bd-ca87-4eb2-8864-43c84b2d20c9 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:36.265763 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-70afe109-d2dd-4690-b3e9-b1123c30347d tempest-FlavorsV2TestJSON-1219044963 tempest-FlavorsV2TestJSON-1219044963-project] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.029293 Oct 19 03:17:36.266636 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 813/1561] 10.222.0.52 () {58 vars in 1146 bytes} [Wed Oct 19 03:17:36 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:36.308774 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0337ad95-1cc9-4c85-9612-2c4b4dd2e110 tempest-FlavorsV2TestJSON-1219044963 tempest-FlavorsV2TestJSON-1219044963-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:36.321931 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0337ad95-1cc9-4c85-9612-2c4b4dd2e110 tempest-FlavorsV2TestJSON-1219044963 tempest-FlavorsV2TestJSON-1219044963-project] 10.222.0.52 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.035233 Oct 19 03:17:36.326864 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 814/1562] 10.222.0.52 () {58 vars in 1137 bytes} [Wed Oct 19 03:17:36 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:17:36.451105 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-03b811bd-ca87-4eb2-8864-43c84b2d20c9 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:36.452474 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-06541720-a6ca-4581-a362-a2e9b11b8696 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:36.453401 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-06541720-a6ca-4581-a362-a2e9b11b8696 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 84774cfc-79b4-42db-acfd-c4daac86d196] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:36.460802 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-03b811bd-ca87-4eb2-8864-43c84b2d20c9 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/46e24c0c-6e9f-4a51-a10e-dcb68ebf6f9d" status: 200 len: 1473 microversion: 2.1 time: 0.225268 Oct 19 03:17:36.463469 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-06541720-a6ca-4581-a362-a2e9b11b8696 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:36.464172 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-06541720-a6ca-4581-a362-a2e9b11b8696 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:36.464827 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-06541720-a6ca-4581-a362-a2e9b11b8696 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:36.465753 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-06541720-a6ca-4581-a362-a2e9b11b8696 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:36.466351 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-06541720-a6ca-4581-a362-a2e9b11b8696 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:36.466915 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-06541720-a6ca-4581-a362-a2e9b11b8696 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:36.470121 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 749/1563] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:36 2022] GET /compute/v2.1/servers/46e24c0c-6e9f-4a51-a10e-dcb68ebf6f9d => generated 1473 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:36.606244 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:17:36.627742 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-06541720-a6ca-4581-a362-a2e9b11b8696 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:36.636405 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-06541720-a6ca-4581-a362-a2e9b11b8696 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196" status: 200 len: 1475 microversion: 2.1 time: 0.189915 Oct 19 03:17:36.636990 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 815/1564] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:36 2022] GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196 => generated 1475 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:17:36.952898 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-370f73c8-f418-4ace-b6be-de73af9ce615 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:36.954179 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-370f73c8-f418-4ace-b6be-de73af9ce615 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] [instance: 90f71ec9-e698-4159-9458-2099c1fbfaf3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:36.961649 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-370f73c8-f418-4ace-b6be-de73af9ce615 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:36.963183 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-370f73c8-f418-4ace-b6be-de73af9ce615 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:36.964048 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-370f73c8-f418-4ace-b6be-de73af9ce615 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:36.965098 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-370f73c8-f418-4ace-b6be-de73af9ce615 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:36.965731 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-370f73c8-f418-4ace-b6be-de73af9ce615 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:36.966309 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-370f73c8-f418-4ace-b6be-de73af9ce615 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:37.174586 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2e43862a-3041-4d4b-8e53-ff2327c7c683 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:37.175283 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-2e43862a-3041-4d4b-8e53-ff2327c7c683 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] [instance: 64d3b78b-7953-40fc-ab53-b35f9d105901] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:37.178091 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=6 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:17:37.185466 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2e43862a-3041-4d4b-8e53-ff2327c7c683 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:37.186008 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2e43862a-3041-4d4b-8e53-ff2327c7c683 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:37.186686 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2e43862a-3041-4d4b-8e53-ff2327c7c683 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:37.187698 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2e43862a-3041-4d4b-8e53-ff2327c7c683 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:37.188675 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2e43862a-3041-4d4b-8e53-ff2327c7c683 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:37.189338 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2e43862a-3041-4d4b-8e53-ff2327c7c683 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:37.221482 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-370f73c8-f418-4ace-b6be-de73af9ce615 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28072a54d5934ea28e7d3205841c0852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c12a432bbd43bd8f70ba6e941c28a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:37.253854 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-370f73c8-f418-4ace-b6be-de73af9ce615 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] 10.222.0.52 "GET /compute/v2.1/servers/90f71ec9-e698-4159-9458-2099c1fbfaf3" status: 200 len: 1317 microversion: 2.1 time: 0.305006 Oct 19 03:17:37.254928 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 750/1565] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:36 2022] GET /compute/v2.1/servers/90f71ec9-e698-4159-9458-2099c1fbfaf3 => generated 1317 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:37.309336 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-2e43862a-3041-4d4b-8e53-ff2327c7c683 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c35b71372843d69f9a6c6be04b154f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcd49d68a3947249016cc5dbe910efc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:37.326465 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2e43862a-3041-4d4b-8e53-ff2327c7c683 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] 10.222.0.52 "GET /compute/v2.1/servers/64d3b78b-7953-40fc-ab53-b35f9d105901" status: 200 len: 1265 microversion: 2.1 time: 0.157298 Oct 19 03:17:37.327061 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 816/1566] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:37 2022] GET /compute/v2.1/servers/64d3b78b-7953-40fc-ab53-b35f9d105901 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:17:37.487126 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b5603a71-7a9f-4eb9-a7fb-3ee7224999b2 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:37.487855 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b5603a71-7a9f-4eb9-a7fb-3ee7224999b2 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 46e24c0c-6e9f-4a51-a10e-dcb68ebf6f9d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:37.502619 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b5603a71-7a9f-4eb9-a7fb-3ee7224999b2 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:37.503414 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b5603a71-7a9f-4eb9-a7fb-3ee7224999b2 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:37.504029 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b5603a71-7a9f-4eb9-a7fb-3ee7224999b2 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:37.504999 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b5603a71-7a9f-4eb9-a7fb-3ee7224999b2 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:37.505900 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b5603a71-7a9f-4eb9-a7fb-3ee7224999b2 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:37.506500 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b5603a71-7a9f-4eb9-a7fb-3ee7224999b2 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:37.660985 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-37053de9-e93a-4b90-be01-71e6ae0a5839 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:37.661656 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-37053de9-e93a-4b90-be01-71e6ae0a5839 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 84774cfc-79b4-42db-acfd-c4daac86d196] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:37.673451 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-37053de9-e93a-4b90-be01-71e6ae0a5839 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:37.673948 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-37053de9-e93a-4b90-be01-71e6ae0a5839 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:37.674377 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-37053de9-e93a-4b90-be01-71e6ae0a5839 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:37.675320 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-37053de9-e93a-4b90-be01-71e6ae0a5839 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:37.676021 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-37053de9-e93a-4b90-be01-71e6ae0a5839 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:37.676667 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-37053de9-e93a-4b90-be01-71e6ae0a5839 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:37.716207 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b5603a71-7a9f-4eb9-a7fb-3ee7224999b2 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:37.724419 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b5603a71-7a9f-4eb9-a7fb-3ee7224999b2 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/46e24c0c-6e9f-4a51-a10e-dcb68ebf6f9d" status: 200 len: 1473 microversion: 2.1 time: 0.241690 Oct 19 03:17:37.740837 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 751/1567] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:37 2022] GET /compute/v2.1/servers/46e24c0c-6e9f-4a51-a10e-dcb68ebf6f9d => generated 1473 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:37.830910 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-37053de9-e93a-4b90-be01-71e6ae0a5839 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:37.836740 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-37053de9-e93a-4b90-be01-71e6ae0a5839 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196" status: 200 len: 1475 microversion: 2.1 time: 0.179576 Oct 19 03:17:37.837351 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 817/1568] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:37 2022] GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196 => generated 1475 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:17:38.278552 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-25d26a44-a3bc-472d-b877-7cf43f30e3e9 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:38.279158 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-25d26a44-a3bc-472d-b877-7cf43f30e3e9 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] [instance: 90f71ec9-e698-4159-9458-2099c1fbfaf3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:38.285446 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-25d26a44-a3bc-472d-b877-7cf43f30e3e9 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:38.291330 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-25d26a44-a3bc-472d-b877-7cf43f30e3e9 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:38.291330 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-25d26a44-a3bc-472d-b877-7cf43f30e3e9 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:38.291330 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-25d26a44-a3bc-472d-b877-7cf43f30e3e9 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:38.291330 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-25d26a44-a3bc-472d-b877-7cf43f30e3e9 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:38.291878 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-25d26a44-a3bc-472d-b877-7cf43f30e3e9 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:38.349474 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-fbef08a7-df43-411a-b2cb-f9a9048f7023 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:38.350148 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-fbef08a7-df43-411a-b2cb-f9a9048f7023 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] [instance: 64d3b78b-7953-40fc-ab53-b35f9d105901] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:38.357239 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fbef08a7-df43-411a-b2cb-f9a9048f7023 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:38.357760 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fbef08a7-df43-411a-b2cb-f9a9048f7023 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:38.358204 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fbef08a7-df43-411a-b2cb-f9a9048f7023 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:38.358909 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fbef08a7-df43-411a-b2cb-f9a9048f7023 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:38.359367 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fbef08a7-df43-411a-b2cb-f9a9048f7023 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:38.359795 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fbef08a7-df43-411a-b2cb-f9a9048f7023 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:38.458578 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-25d26a44-a3bc-472d-b877-7cf43f30e3e9 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28072a54d5934ea28e7d3205841c0852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c12a432bbd43bd8f70ba6e941c28a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:38.459055 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-fbef08a7-df43-411a-b2cb-f9a9048f7023 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c35b71372843d69f9a6c6be04b154f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcd49d68a3947249016cc5dbe910efc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:38.480330 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-25d26a44-a3bc-472d-b877-7cf43f30e3e9 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] 10.222.0.52 "GET /compute/v2.1/servers/90f71ec9-e698-4159-9458-2099c1fbfaf3" status: 200 len: 1317 microversion: 2.1 time: 0.202480 Oct 19 03:17:38.481603 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 752/1569] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:38 2022] GET /compute/v2.1/servers/90f71ec9-e698-4159-9458-2099c1fbfaf3 => generated 1317 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:38.495287 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-fbef08a7-df43-411a-b2cb-f9a9048f7023 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] 10.222.0.52 "GET /compute/v2.1/servers/64d3b78b-7953-40fc-ab53-b35f9d105901" status: 200 len: 1265 microversion: 2.1 time: 0.137602 Oct 19 03:17:38.498786 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 818/1570] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:38 2022] GET /compute/v2.1/servers/64d3b78b-7953-40fc-ab53-b35f9d105901 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:17:38.747971 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-235b6a3e-a8e0-4869-b142-66e42ca23eb9 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:38.748815 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-235b6a3e-a8e0-4869-b142-66e42ca23eb9 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 46e24c0c-6e9f-4a51-a10e-dcb68ebf6f9d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:38.756706 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-235b6a3e-a8e0-4869-b142-66e42ca23eb9 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:38.757205 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-235b6a3e-a8e0-4869-b142-66e42ca23eb9 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:38.757677 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-235b6a3e-a8e0-4869-b142-66e42ca23eb9 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:38.758402 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-235b6a3e-a8e0-4869-b142-66e42ca23eb9 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:38.758906 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-235b6a3e-a8e0-4869-b142-66e42ca23eb9 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:38.759343 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-235b6a3e-a8e0-4869-b142-66e42ca23eb9 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:38.863431 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1f6ae494-629c-40b3-a988-54b85a1170b9 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:38.864415 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1f6ae494-629c-40b3-a988-54b85a1170b9 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 84774cfc-79b4-42db-acfd-c4daac86d196] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:38.873122 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1f6ae494-629c-40b3-a988-54b85a1170b9 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:38.873947 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1f6ae494-629c-40b3-a988-54b85a1170b9 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:38.874540 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1f6ae494-629c-40b3-a988-54b85a1170b9 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:38.875493 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1f6ae494-629c-40b3-a988-54b85a1170b9 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:38.876151 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1f6ae494-629c-40b3-a988-54b85a1170b9 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:38.880250 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1f6ae494-629c-40b3-a988-54b85a1170b9 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:39.335243 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-235b6a3e-a8e0-4869-b142-66e42ca23eb9 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:39.365144 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-235b6a3e-a8e0-4869-b142-66e42ca23eb9 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/46e24c0c-6e9f-4a51-a10e-dcb68ebf6f9d" status: 200 len: 1473 microversion: 2.1 time: 0.620772 Oct 19 03:17:39.368821 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 753/1571] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:38 2022] GET /compute/v2.1/servers/46e24c0c-6e9f-4a51-a10e-dcb68ebf6f9d => generated 1473 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:39.488315 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-1f6ae494-629c-40b3-a988-54b85a1170b9 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:39.498386 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1f6ae494-629c-40b3-a988-54b85a1170b9 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196" status: 200 len: 1475 microversion: 2.1 time: 0.639536 Oct 19 03:17:39.507466 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3095a21f-cf8f-4c65-9ba5-1bcafe283d51 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:39.508315 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3095a21f-cf8f-4c65-9ba5-1bcafe283d51 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] [instance: 90f71ec9-e698-4159-9458-2099c1fbfaf3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:39.533341 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3095a21f-cf8f-4c65-9ba5-1bcafe283d51 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:39.537739 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 819/1572] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:38 2022] GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196 => generated 1475 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:39.542674 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3095a21f-cf8f-4c65-9ba5-1bcafe283d51 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:39.545348 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-cc4953d9-b193-41fa-8033-a256cf042b08 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:39.545348 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-cc4953d9-b193-41fa-8033-a256cf042b08 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] [instance: 64d3b78b-7953-40fc-ab53-b35f9d105901] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:39.546414 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3095a21f-cf8f-4c65-9ba5-1bcafe283d51 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:39.547195 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3095a21f-cf8f-4c65-9ba5-1bcafe283d51 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:39.551867 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3095a21f-cf8f-4c65-9ba5-1bcafe283d51 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:39.552559 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3095a21f-cf8f-4c65-9ba5-1bcafe283d51 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:39.552996 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cc4953d9-b193-41fa-8033-a256cf042b08 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:39.553798 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cc4953d9-b193-41fa-8033-a256cf042b08 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:39.554673 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cc4953d9-b193-41fa-8033-a256cf042b08 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:39.556196 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cc4953d9-b193-41fa-8033-a256cf042b08 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:39.557303 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cc4953d9-b193-41fa-8033-a256cf042b08 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:39.558023 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cc4953d9-b193-41fa-8033-a256cf042b08 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:39.696010 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-cc4953d9-b193-41fa-8033-a256cf042b08 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c35b71372843d69f9a6c6be04b154f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcd49d68a3947249016cc5dbe910efc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:39.723789 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-cc4953d9-b193-41fa-8033-a256cf042b08 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] 10.222.0.52 "GET /compute/v2.1/servers/64d3b78b-7953-40fc-ab53-b35f9d105901" status: 200 len: 1271 microversion: 2.1 time: 0.182207 Oct 19 03:17:39.724987 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 820/1573] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:39 2022] GET /compute/v2.1/servers/64d3b78b-7953-40fc-ab53-b35f9d105901 => generated 1271 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:39.737958 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-3aaf4320-9205-4183-8cc5-581690b68f65 req-63db1a05-fa89-469b-888e-79376459e472 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88b09b16-f667-4ab9-89ca-a26dc86967ae", "name": "network-vif-deleted", "tag": "c6cc7e90-cc90-44c2-82b6-4af34dfad284"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:17:39.755591 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-3aaf4320-9205-4183-8cc5-581690b68f65 req-63db1a05-fa89-469b-888e-79376459e472 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:39.757071 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-3aaf4320-9205-4183-8cc5-581690b68f65 req-63db1a05-fa89-469b-888e-79376459e472 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:39.757978 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-3aaf4320-9205-4183-8cc5-581690b68f65 req-63db1a05-fa89-469b-888e-79376459e472 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:39.776406 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-3aaf4320-9205-4183-8cc5-581690b68f65 req-63db1a05-fa89-469b-888e-79376459e472 service nova] Creating event network-vif-deleted:c6cc7e90-cc90-44c2-82b6-4af34dfad284 for instance 88b09b16-f667-4ab9-89ca-a26dc86967ae on n-h1-861333-8 Oct 19 03:17:39.789117 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-3aaf4320-9205-4183-8cc5-581690b68f65 req-63db1a05-fa89-469b-888e-79376459e472 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062147 Oct 19 03:17:39.790647 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 821/1574] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:17:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:17:39.994954 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-6e321d31-f16a-45a7-9117-03f3150de0fa req-2b1b84c8-74be-4d29-9eba-cc14f498fb84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46e24c0c-6e9f-4a51-a10e-dcb68ebf6f9d", "name": "network-vif-deleted", "tag": "24ff5b68-bf87-4f37-9228-f1c21d3cc33a"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:17:40.019069 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-6e321d31-f16a-45a7-9117-03f3150de0fa req-2b1b84c8-74be-4d29-9eba-cc14f498fb84 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:40.020655 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-6e321d31-f16a-45a7-9117-03f3150de0fa req-2b1b84c8-74be-4d29-9eba-cc14f498fb84 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:40.021722 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-6e321d31-f16a-45a7-9117-03f3150de0fa req-2b1b84c8-74be-4d29-9eba-cc14f498fb84 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:40.032402 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-3095a21f-cf8f-4c65-9ba5-1bcafe283d51 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28072a54d5934ea28e7d3205841c0852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c12a432bbd43bd8f70ba6e941c28a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:40.050495 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3095a21f-cf8f-4c65-9ba5-1bcafe283d51 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] 10.222.0.52 "GET /compute/v2.1/servers/90f71ec9-e698-4159-9458-2099c1fbfaf3" status: 200 len: 1317 microversion: 2.1 time: 0.547565 Oct 19 03:17:40.050495 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 754/1575] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:39 2022] GET /compute/v2.1/servers/90f71ec9-e698-4159-9458-2099c1fbfaf3 => generated 1317 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:17:40.066818 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-6e321d31-f16a-45a7-9117-03f3150de0fa req-2b1b84c8-74be-4d29-9eba-cc14f498fb84 service nova] Creating event network-vif-deleted:24ff5b68-bf87-4f37-9228-f1c21d3cc33a for instance 46e24c0c-6e9f-4a51-a10e-dcb68ebf6f9d on n-h2-861333-8 Oct 19 03:17:40.079678 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-6e321d31-f16a-45a7-9117-03f3150de0fa req-2b1b84c8-74be-4d29-9eba-cc14f498fb84 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089739 Oct 19 03:17:40.081542 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 822/1576] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:17:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:17:40.279717 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2f86a03c-37c0-486b-8cea-266c2f334baa tempest-FlavorsExtraSpecsTestJSON-1269106258 tempest-FlavorsExtraSpecsTestJSON-1269106258-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-921464998", "ram": 512, "vcpus": 1, "disk": 10, "id": 1025583483, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:17:40.405972 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1226033d-5c85-4c93-866e-8bc9bd808873 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:40.406915 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1226033d-5c85-4c93-866e-8bc9bd808873 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 46e24c0c-6e9f-4a51-a10e-dcb68ebf6f9d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:40.409542 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2f86a03c-37c0-486b-8cea-266c2f334baa tempest-FlavorsExtraSpecsTestJSON-1269106258 tempest-FlavorsExtraSpecsTestJSON-1269106258-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.270636 Oct 19 03:17:40.410588 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 755/1577] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:17:40 2022] POST /compute/v2.1/flavors => generated 415 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:17:40.423731 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3d525520-3d1a-4853-9ad1-40b137e1daf8 tempest-FlavorsExtraSpecsTestJSON-1269106258 tempest-FlavorsExtraSpecsTestJSON-1269106258-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:17:40.428320 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1226033d-5c85-4c93-866e-8bc9bd808873 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:40.429408 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1226033d-5c85-4c93-866e-8bc9bd808873 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:40.430024 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1226033d-5c85-4c93-866e-8bc9bd808873 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:40.431370 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1226033d-5c85-4c93-866e-8bc9bd808873 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:40.432002 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1226033d-5c85-4c93-866e-8bc9bd808873 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:40.432596 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1226033d-5c85-4c93-866e-8bc9bd808873 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:40.515035 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1226033d-5c85-4c93-866e-8bc9bd808873 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:40.515855 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1226033d-5c85-4c93-866e-8bc9bd808873 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:40.515855 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1226033d-5c85-4c93-866e-8bc9bd808873 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:40.516333 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-1226033d-5c85-4c93-866e-8bc9bd808873 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lazy-loading 'fault' on Instance uuid 46e24c0c-6e9f-4a51-a10e-dcb68ebf6f9d {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:17:40.587785 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3d525520-3d1a-4853-9ad1-40b137e1daf8 tempest-FlavorsExtraSpecsTestJSON-1269106258 tempest-FlavorsExtraSpecsTestJSON-1269106258-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors/1025583483/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.167194 Oct 19 03:17:40.588769 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 756/1578] 10.222.0.52 () {60 vars in 1224 bytes} [Wed Oct 19 03:17:40 2022] POST /compute/v2.1/flavors/1025583483/os-extra_specs => generated 66 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 19 03:17:40.594687 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-182d2736-1851-4d8c-8dc2-4e1d6d8f2e27 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:40.595655 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-182d2736-1851-4d8c-8dc2-4e1d6d8f2e27 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 84774cfc-79b4-42db-acfd-c4daac86d196] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:40.598948 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-1226033d-5c85-4c93-866e-8bc9bd808873 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:40.602479 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-182d2736-1851-4d8c-8dc2-4e1d6d8f2e27 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:40.603317 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-182d2736-1851-4d8c-8dc2-4e1d6d8f2e27 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:40.603665 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-182d2736-1851-4d8c-8dc2-4e1d6d8f2e27 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:40.604470 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-182d2736-1851-4d8c-8dc2-4e1d6d8f2e27 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:40.604867 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-182d2736-1851-4d8c-8dc2-4e1d6d8f2e27 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:40.605291 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-182d2736-1851-4d8c-8dc2-4e1d6d8f2e27 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:40.607986 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1226033d-5c85-4c93-866e-8bc9bd808873 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/46e24c0c-6e9f-4a51-a10e-dcb68ebf6f9d" status: 200 len: 1308 microversion: 2.1 time: 0.212142 Oct 19 03:17:40.608579 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 823/1579] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:40 2022] GET /compute/v2.1/servers/46e24c0c-6e9f-4a51-a10e-dcb68ebf6f9d => generated 1308 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:40.769648 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e00c3c3f-b7de-4895-b4da-41de781a84bd tempest-FlavorsExtraSpecsTestJSON-1221540394 tempest-FlavorsExtraSpecsTestJSON-1221540394-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:40.779581 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e00c3c3f-b7de-4895-b4da-41de781a84bd tempest-FlavorsExtraSpecsTestJSON-1221540394 tempest-FlavorsExtraSpecsTestJSON-1221540394-project] 10.222.0.52 "GET /compute/v2.1/flavors/1025583483/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.169477 Oct 19 03:17:40.780675 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 824/1580] 10.222.0.52 () {58 vars in 1203 bytes} [Wed Oct 19 03:17:40 2022] GET /compute/v2.1/flavors/1025583483/os-extra_specs => generated 66 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 03:17:40.785453 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-286a16f9-5a4c-481d-89f7-91fb7fe8caff tempest-ImagesMetadataTestJSON-1383802925 tempest-ImagesMetadataTestJSON-1383802925-project] Calling method '.version_select at 0x7fc130ede940>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:40.855042 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-286a16f9-5a4c-481d-89f7-91fb7fe8caff tempest-ImagesMetadataTestJSON-1383802925 tempest-ImagesMetadataTestJSON-1383802925-project] 10.222.0.52 "GET /compute/v2.1/images/4537563b-9353-4822-84df-8e9725d179e0" status: 200 len: 637 microversion: 2.1 time: 0.073088 Oct 19 03:17:40.855755 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 825/1581] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:17:40 2022] GET /compute/v2.1/images/4537563b-9353-4822-84df-8e9725d179e0 => generated 637 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:17:40.861236 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-af0df1b7-ef94-4260-b888-44a44cda7fb6 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:40.862007 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-af0df1b7-ef94-4260-b888-44a44cda7fb6 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] [instance: 64d3b78b-7953-40fc-ab53-b35f9d105901] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:40.870578 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-af0df1b7-ef94-4260-b888-44a44cda7fb6 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:40.871449 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-af0df1b7-ef94-4260-b888-44a44cda7fb6 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:40.872038 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-af0df1b7-ef94-4260-b888-44a44cda7fb6 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:40.873007 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-af0df1b7-ef94-4260-b888-44a44cda7fb6 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:40.873705 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-af0df1b7-ef94-4260-b888-44a44cda7fb6 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:40.874350 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-af0df1b7-ef94-4260-b888-44a44cda7fb6 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:40.906364 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-182d2736-1851-4d8c-8dc2-4e1d6d8f2e27 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:40.914832 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-182d2736-1851-4d8c-8dc2-4e1d6d8f2e27 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196" status: 200 len: 1475 microversion: 2.1 time: 0.324859 Oct 19 03:17:40.919437 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 757/1582] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:40 2022] GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196 => generated 1475 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:40.935941 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d7f3540b-6709-4246-99c1-7a5ca2dfbadf tempest-FlavorsExtraSpecsTestJSON-1269106258 tempest-FlavorsExtraSpecsTestJSON-1269106258-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:17:40.975424 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1,nova_api:INSERT=6,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:17:40.977735 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d7f3540b-6709-4246-99c1-7a5ca2dfbadf tempest-FlavorsExtraSpecsTestJSON-1269106258 tempest-FlavorsExtraSpecsTestJSON-1269106258-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors/1025583483/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.057056 Oct 19 03:17:40.982667 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 758/1583] 10.222.0.52 () {60 vars in 1224 bytes} [Wed Oct 19 03:17:40 2022] POST /compute/v2.1/flavors/1025583483/os-extra_specs => generated 66 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 03:17:40.987812 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-04c7b50a-c847-4511-ae4d-0ca9f6f03f56 tempest-ImagesMetadataTestJSON-1383802925 tempest-ImagesMetadataTestJSON-1383802925-project] Action: 'update_all', calling method: .version_select at 0x7fc1350d5160>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:17:41.057166 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-04c7b50a-c847-4511-ae4d-0ca9f6f03f56 tempest-ImagesMetadataTestJSON-1383802925 tempest-ImagesMetadataTestJSON-1383802925-project] Getting quotas for project 00d043b2cb4a47ef977a9c1b91a4ccdc. Resources: dict_keys(['metadata_items']) {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:17:41.062651 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-04c7b50a-c847-4511-ae4d-0ca9f6f03f56 tempest-ImagesMetadataTestJSON-1383802925 tempest-ImagesMetadataTestJSON-1383802925-project] Getting quotas for user 435fa4aab96c4750bac42388e02f0ab9 and project 00d043b2cb4a47ef977a9c1b91a4ccdc. Resources: dict_keys(['metadata_items']) {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:17:41.081900 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-af0df1b7-ef94-4260-b888-44a44cda7fb6 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c35b71372843d69f9a6c6be04b154f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcd49d68a3947249016cc5dbe910efc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:41.096725 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-af0df1b7-ef94-4260-b888-44a44cda7fb6 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] 10.222.0.52 "GET /compute/v2.1/servers/64d3b78b-7953-40fc-ab53-b35f9d105901" status: 200 len: 1313 microversion: 2.1 time: 0.239635 Oct 19 03:17:41.098069 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 826/1584] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:40 2022] GET /compute/v2.1/servers/64d3b78b-7953-40fc-ab53-b35f9d105901 => generated 1313 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:41.103480 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-62d42e28-4d6b-4d69-af57-368b44de5639 tempest-FlavorsExtraSpecsTestJSON-1221540394 tempest-FlavorsExtraSpecsTestJSON-1221540394-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:41.115081 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-62d42e28-4d6b-4d69-af57-368b44de5639 tempest-FlavorsExtraSpecsTestJSON-1221540394 tempest-FlavorsExtraSpecsTestJSON-1221540394-project] 10.222.0.52 "GET /compute/v2.1/flavors/1025583483/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.015708 Oct 19 03:17:41.122482 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 827/1585] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Oct 19 03:17:41 2022] GET /compute/v2.1/flavors/1025583483/os-extra_specs/hw:numa_nodes => generated 22 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 03:17:41.129022 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7151be92-5a1e-4b35-8146-3dc2014e60d2 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:41.131660 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7151be92-5a1e-4b35-8146-3dc2014e60d2 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] [instance: 90f71ec9-e698-4159-9458-2099c1fbfaf3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:41.145105 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7151be92-5a1e-4b35-8146-3dc2014e60d2 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:41.145861 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7151be92-5a1e-4b35-8146-3dc2014e60d2 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:41.147495 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7151be92-5a1e-4b35-8146-3dc2014e60d2 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:41.148634 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7151be92-5a1e-4b35-8146-3dc2014e60d2 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:41.149081 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7151be92-5a1e-4b35-8146-3dc2014e60d2 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:41.149579 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7151be92-5a1e-4b35-8146-3dc2014e60d2 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:41.354994 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7151be92-5a1e-4b35-8146-3dc2014e60d2 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28072a54d5934ea28e7d3205841c0852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c12a432bbd43bd8f70ba6e941c28a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:41.365630 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7151be92-5a1e-4b35-8146-3dc2014e60d2 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] 10.222.0.52 "GET /compute/v2.1/servers/90f71ec9-e698-4159-9458-2099c1fbfaf3" status: 200 len: 1317 microversion: 2.1 time: 0.240966 Oct 19 03:17:41.366557 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 828/1586] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:41 2022] GET /compute/v2.1/servers/90f71ec9-e698-4159-9458-2099c1fbfaf3 => generated 1317 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:41.380286 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f86fc0b9-6b28-47f6-9070-9dde27b8a9a3 tempest-FlavorsExtraSpecsTestJSON-1269106258 tempest-FlavorsExtraSpecsTestJSON-1269106258-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:17:41.409414 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f86fc0b9-6b28-47f6-9070-9dde27b8a9a3 tempest-FlavorsExtraSpecsTestJSON-1269106258 tempest-FlavorsExtraSpecsTestJSON-1269106258-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors/1025583483/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.041122 Oct 19 03:17:41.410099 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 829/1587] 10.222.0.52 () {60 vars in 1224 bytes} [Wed Oct 19 03:17:41 2022] POST /compute/v2.1/flavors/1025583483/os-extra_specs => generated 66 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 03:17:41.420042 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4fce14ac-e932-44f4-8a2a-6826020495c7 tempest-FlavorsExtraSpecsTestJSON-1269106258 tempest-FlavorsExtraSpecsTestJSON-1269106258-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:41.427647 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4fce14ac-e932-44f4-8a2a-6826020495c7 tempest-FlavorsExtraSpecsTestJSON-1269106258 tempest-FlavorsExtraSpecsTestJSON-1269106258-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/1025583483/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.011463 Oct 19 03:17:41.428262 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 830/1588] 10.222.0.52 () {58 vars in 1203 bytes} [Wed Oct 19 03:17:41 2022] GET /compute/v2.1/flavors/1025583483/os-extra_specs => generated 66 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 19 03:17:41.438235 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4bd26a75-9fa5-40b5-a87a-7e3a9d80050b tempest-FlavorsExtraSpecsTestJSON-1269106258 tempest-FlavorsExtraSpecsTestJSON-1269106258-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:17:41.528493 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-04c7b50a-c847-4511-ae4d-0ca9f6f03f56 tempest-ImagesMetadataTestJSON-1383802925 tempest-ImagesMetadataTestJSON-1383802925-project] 10.222.0.52 "PUT /compute/v2.1/images/4537563b-9353-4822-84df-8e9725d179e0/metadata" status: 200 len: 61 microversion: 2.1 time: 0.544502 Oct 19 03:17:41.529224 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 759/1589] 10.222.0.52 () {60 vars in 1280 bytes} [Wed Oct 19 03:17:40 2022] PUT /compute/v2.1/images/4537563b-9353-4822-84df-8e9725d179e0/metadata => generated 61 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 03:17:41.538544 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ab797ea0-6f7d-4cec-8a81-8ef197a3b2c0 tempest-ImagesMetadataTestJSON-1383802925 tempest-ImagesMetadataTestJSON-1383802925-project] Calling method '.version_select at 0x7fc1350831f0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:41.569041 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=3,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:17:41.576332 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4bd26a75-9fa5-40b5-a87a-7e3a9d80050b tempest-FlavorsExtraSpecsTestJSON-1269106258 tempest-FlavorsExtraSpecsTestJSON-1269106258-project-admin] 10.222.0.52 "PUT /compute/v2.1/flavors/1025583483/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.141752 Oct 19 03:17:41.577294 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 831/1590] 10.222.0.52 () {60 vars in 1265 bytes} [Wed Oct 19 03:17:41 2022] PUT /compute/v2.1/flavors/1025583483/os-extra_specs/hw:numa_nodes => generated 22 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 03:17:41.588620 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5fa2401e-1400-490e-81e7-68e6dc9cb863 tempest-FlavorsExtraSpecsTestJSON-1269106258 tempest-FlavorsExtraSpecsTestJSON-1269106258-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:41.597694 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5fa2401e-1400-490e-81e7-68e6dc9cb863 tempest-FlavorsExtraSpecsTestJSON-1269106258 tempest-FlavorsExtraSpecsTestJSON-1269106258-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/1025583483/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.013812 Oct 19 03:17:41.598467 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 832/1591] 10.222.0.52 () {58 vars in 1203 bytes} [Wed Oct 19 03:17:41 2022] GET /compute/v2.1/flavors/1025583483/os-extra_specs => generated 66 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 03:17:41.611344 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-70b4f554-2e69-4ab3-8070-0e2e9371c742 tempest-FlavorsExtraSpecsTestJSON-1269106258 tempest-FlavorsExtraSpecsTestJSON-1269106258-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:41.745840 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-70b4f554-2e69-4ab3-8070-0e2e9371c742 tempest-FlavorsExtraSpecsTestJSON-1269106258 tempest-FlavorsExtraSpecsTestJSON-1269106258-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/1025583483/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.140942 Oct 19 03:17:41.749750 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 833/1592] 10.222.0.52 () {58 vars in 1248 bytes} [Wed Oct 19 03:17:41 2022] DELETE /compute/v2.1/flavors/1025583483/os-extra_specs/hw:numa_nodes => generated 0 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 19 03:17:41.755034 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5cdca460-d649-4fb8-a2e7-06d2ec923def tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:41.755667 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-5cdca460-d649-4fb8-a2e7-06d2ec923def tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 46e24c0c-6e9f-4a51-a10e-dcb68ebf6f9d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:41.761848 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5cdca460-d649-4fb8-a2e7-06d2ec923def tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:41.762615 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5cdca460-d649-4fb8-a2e7-06d2ec923def tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:41.763061 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5cdca460-d649-4fb8-a2e7-06d2ec923def tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:41.763793 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5cdca460-d649-4fb8-a2e7-06d2ec923def tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:41.764500 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5cdca460-d649-4fb8-a2e7-06d2ec923def tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:41.764929 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5cdca460-d649-4fb8-a2e7-06d2ec923def tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:41.780267 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-5cdca460-d649-4fb8-a2e7-06d2ec923def tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] HTTP exception thrown: Instance 46e24c0c-6e9f-4a51-a10e-dcb68ebf6f9d could not be found. Oct 19 03:17:41.782271 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5cdca460-d649-4fb8-a2e7-06d2ec923def tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Request method failure captured: Oct 19 03:17:41.782271 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/46e24c0c-6e9f-4a51-a10e-dcb68ebf6f9d HTTP/1.1 Oct 19 03:17:41.782271 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:17:41.782271 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:17:41.782271 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:17:41.782271 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:17:41.782271 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:17:41.782271 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:17:41.782271 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:17:41.782271 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:17:41.782271 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2uIr9BvDBnYtOjXORgJ4Qqr6WVLdD9ouG3lYgYuVISlRlRaYBhavBD01rVROkCZkxR9XYWXexaYSEKOFD-WoO2VI67daMYqFdJq0nC95Vi4iLXZzLBKOlmG6HfkRin4f0jmmyKXjHfeDMSqeFm88QUaNhEk881S74x65hVUOW0qpCY Oct 19 03:17:41.782271 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:17:41.782271 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:17:41.782271 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:17:41.782271 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:17:41.782271 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:17:41.782271 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:17:41.782271 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 5d909fe7763841d5b452738112b656d3 Oct 19 03:17:41.782271 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ServersOnMultiNodesTest-1737645722 Oct 19 03:17:41.782271 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:17:41.782271 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:17:41.783974 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5d909fe7763841d5b452738112b656d3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5d909fe7763841d5b452738112b656d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5d909fe7763841d5b452738112b656d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5d909fe7763841d5b452738112b656d3", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:17:41.783974 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ServersOnMultiNodesTest-1737645722 Oct 19 03:17:41.783974 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 5d909fe7763841d5b452738112b656d3 Oct 19 03:17:41.783974 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1737645722 Oct 19 03:17:41.783974 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ServersOnMultiNodesTest-1737645722-project Oct 19 03:17:41.783974 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:17:41.783974 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:17:41.783974 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 3e4d3ddb3a324d9da51c13701e318955 Oct 19 03:17:41.783974 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ServersOnMultiNodesTest-1737645722-project Oct 19 03:17:41.783974 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:17:41.783974 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance 46e24c0c-6e9f-4a51-a10e-dcb68ebf6f9d could not be found. Oct 19 03:17:41.783974 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '46e24c0c-6e9f-4a51-a10e-dcb68ebf6f9d'} Oct 19 03:17:41.784910 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:17:41.784910 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:17:41.784910 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:17:41.784910 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:17:41.784910 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:17:41.784910 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:17:41.784910 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:17:41.784910 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:17:41.784910 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:17:41.784910 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:17:41.784910 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46e24c0c-6e9f-4a51-a10e-dcb68ebf6f9d could not be found. Oct 19 03:17:41.784910 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:17:41.784910 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:17:41.784910 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:17:41.784910 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:17:41.784910 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:17:41.784910 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:17:41.784910 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:17:41.784910 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:17:41.784910 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:17:41.786647 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:17:41.786647 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:17:41.786647 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:17:41.786647 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:17:41.786647 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:17:41.786647 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:17:41.786647 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:17:41.786647 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46e24c0c-6e9f-4a51-a10e-dcb68ebf6f9d could not be found. Oct 19 03:17:41.786647 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:17:41.786647 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:17:41.786647 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:17:41.786647 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:17:41.786647 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:17:41.786647 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:17:41.786647 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:17:41.786647 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:17:41.786647 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46e24c0c-6e9f-4a51-a10e-dcb68ebf6f9d could not be found. Oct 19 03:17:41.786647 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:17:41.787936 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5cdca460-d649-4fb8-a2e7-06d2ec923def tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Returning 404 to user: Instance 46e24c0c-6e9f-4a51-a10e-dcb68ebf6f9d could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:17:41.787936 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5cdca460-d649-4fb8-a2e7-06d2ec923def tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/46e24c0c-6e9f-4a51-a10e-dcb68ebf6f9d" status: 404 len: 111 microversion: 2.1 time: 0.032792 Oct 19 03:17:41.787936 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 834/1593] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:41 2022] GET /compute/v2.1/servers/46e24c0c-6e9f-4a51-a10e-dcb68ebf6f9d => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:17:41.792684 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-433d9139-8848-494c-abf3-31df8d7129a1 tempest-FlavorsExtraSpecsTestJSON-1269106258 tempest-FlavorsExtraSpecsTestJSON-1269106258-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:41.921654 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-433d9139-8848-494c-abf3-31df8d7129a1 tempest-FlavorsExtraSpecsTestJSON-1269106258 tempest-FlavorsExtraSpecsTestJSON-1269106258-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/1025583483/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.128955 Oct 19 03:17:41.921654 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 835/1594] 10.222.0.52 () {58 vars in 1248 bytes} [Wed Oct 19 03:17:41 2022] DELETE /compute/v2.1/flavors/1025583483/os-extra_specs/hw:cpu_policy => generated 0 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 19 03:17:41.923408 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2397b0a2-7ad6-4dba-b271-75d4f2556320 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:41.924744 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-2397b0a2-7ad6-4dba-b271-75d4f2556320 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 88b09b16-f667-4ab9-89ca-a26dc86967ae] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:41.933183 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2397b0a2-7ad6-4dba-b271-75d4f2556320 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:41.933844 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2397b0a2-7ad6-4dba-b271-75d4f2556320 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:41.934828 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2397b0a2-7ad6-4dba-b271-75d4f2556320 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:41.935726 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2397b0a2-7ad6-4dba-b271-75d4f2556320 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:41.936376 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2397b0a2-7ad6-4dba-b271-75d4f2556320 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:41.936957 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2397b0a2-7ad6-4dba-b271-75d4f2556320 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:41.943535 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ab797ea0-6f7d-4cec-8a81-8ef197a3b2c0 tempest-ImagesMetadataTestJSON-1383802925 tempest-ImagesMetadataTestJSON-1383802925-project] 10.222.0.52 "DELETE /compute/v2.1/images/4537563b-9353-4822-84df-8e9725d179e0/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.408790 Oct 19 03:17:41.944118 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 760/1595] 10.222.0.52 () {58 vars in 1296 bytes} [Wed Oct 19 03:17:41 2022] DELETE /compute/v2.1/images/4537563b-9353-4822-84df-8e9725d179e0/metadata/os_version => generated 0 bytes in 410 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 19 03:17:41.949687 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1a7142b3-fca7-4a08-849f-30487aceade5 tempest-FlavorsExtraSpecsTestJSON-1269106258 tempest-FlavorsExtraSpecsTestJSON-1269106258-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:41.952085 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-2397b0a2-7ad6-4dba-b271-75d4f2556320 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] HTTP exception thrown: Instance 88b09b16-f667-4ab9-89ca-a26dc86967ae could not be found. Oct 19 03:17:41.953672 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2397b0a2-7ad6-4dba-b271-75d4f2556320 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Request method failure captured: Oct 19 03:17:41.953672 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/88b09b16-f667-4ab9-89ca-a26dc86967ae HTTP/1.1 Oct 19 03:17:41.953672 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:17:41.953672 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:17:41.953672 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:17:41.953672 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:17:41.953672 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:17:41.953672 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:17:41.953672 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:17:41.953672 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:17:41.953672 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2uIr9BvDBnYtOjXORgJ4Qqr6WVLdD9ouG3lYgYuVISlRlRaYBhavBD01rVROkCZkxR9XYWXexaYSEKOFD-WoO2VI67daMYqFdJq0nC95Vi4iLXZzLBKOlmG6HfkRin4f0jmmyKXjHfeDMSqeFm88QUaNhEk881S74x65hVUOW0qpCY Oct 19 03:17:41.953672 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:17:41.953672 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:17:41.953672 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:17:41.953672 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:17:41.953672 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:17:41.953672 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:17:41.953672 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 5d909fe7763841d5b452738112b656d3 Oct 19 03:17:41.953672 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ServersOnMultiNodesTest-1737645722 Oct 19 03:17:41.953672 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:17:41.953672 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:17:41.955294 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5d909fe7763841d5b452738112b656d3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5d909fe7763841d5b452738112b656d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5d909fe7763841d5b452738112b656d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5d909fe7763841d5b452738112b656d3", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:17:41.955294 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ServersOnMultiNodesTest-1737645722 Oct 19 03:17:41.955294 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 5d909fe7763841d5b452738112b656d3 Oct 19 03:17:41.955294 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1737645722 Oct 19 03:17:41.955294 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ServersOnMultiNodesTest-1737645722-project Oct 19 03:17:41.955294 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:17:41.955294 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:17:41.955294 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 3e4d3ddb3a324d9da51c13701e318955 Oct 19 03:17:41.955294 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ServersOnMultiNodesTest-1737645722-project Oct 19 03:17:41.955294 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:17:41.955294 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance 88b09b16-f667-4ab9-89ca-a26dc86967ae could not be found. Oct 19 03:17:41.955294 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '88b09b16-f667-4ab9-89ca-a26dc86967ae'} Oct 19 03:17:41.956100 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:17:41.956100 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:17:41.956100 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:17:41.956100 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:17:41.956100 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:17:41.956100 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:17:41.956100 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:17:41.956100 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:17:41.956100 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:17:41.956100 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:17:41.956100 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88b09b16-f667-4ab9-89ca-a26dc86967ae could not be found. Oct 19 03:17:41.956100 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:17:41.956100 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:17:41.956100 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:17:41.956100 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:17:41.956100 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:17:41.956100 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:17:41.956100 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:17:41.956100 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:17:41.956100 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:17:41.957397 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:17:41.957397 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:17:41.957397 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:17:41.957397 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:17:41.957397 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:17:41.957397 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:17:41.957397 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:17:41.957397 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88b09b16-f667-4ab9-89ca-a26dc86967ae could not be found. Oct 19 03:17:41.957397 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:17:41.957397 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:17:41.957397 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:17:41.957397 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:17:41.957397 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:17:41.957397 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:17:41.957397 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:17:41.957397 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:17:41.957397 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88b09b16-f667-4ab9-89ca-a26dc86967ae could not be found. Oct 19 03:17:41.957397 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:17:41.958648 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2397b0a2-7ad6-4dba-b271-75d4f2556320 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Returning 404 to user: Instance 88b09b16-f667-4ab9-89ca-a26dc86967ae could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:17:41.960958 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2397b0a2-7ad6-4dba-b271-75d4f2556320 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/88b09b16-f667-4ab9-89ca-a26dc86967ae" status: 404 len: 111 microversion: 2.1 time: 0.041630 Oct 19 03:17:41.961634 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 836/1596] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:41 2022] GET /compute/v2.1/servers/88b09b16-f667-4ab9-89ca-a26dc86967ae => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:17:41.965456 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1a7142b3-fca7-4a08-849f-30487aceade5 tempest-FlavorsExtraSpecsTestJSON-1269106258 tempest-FlavorsExtraSpecsTestJSON-1269106258-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/1025583483/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.020175 Oct 19 03:17:41.966039 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 761/1597] 10.222.0.52 () {58 vars in 1203 bytes} [Wed Oct 19 03:17:41 2022] GET /compute/v2.1/flavors/1025583483/os-extra_specs => generated 19 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 03:17:41.969612 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-8a84ae55-f974-4803-8051-ebe50ad4120e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:41.970227 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-8a84ae55-f974-4803-8051-ebe50ad4120e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 84774cfc-79b4-42db-acfd-c4daac86d196] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:41.975963 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a38e3d21-8202-46ab-bcaf-47bf264a797b tempest-ImagesMetadataTestJSON-1383802925 tempest-ImagesMetadataTestJSON-1383802925-project] Calling method '.version_select at 0x7fc1350150d0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:41.978201 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8a84ae55-f974-4803-8051-ebe50ad4120e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:41.985441 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8a84ae55-f974-4803-8051-ebe50ad4120e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:41.985441 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8a84ae55-f974-4803-8051-ebe50ad4120e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:41.985441 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8a84ae55-f974-4803-8051-ebe50ad4120e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:41.985441 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8a84ae55-f974-4803-8051-ebe50ad4120e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:41.986285 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8a84ae55-f974-4803-8051-ebe50ad4120e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:42.028207 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a38e3d21-8202-46ab-bcaf-47bf264a797b tempest-ImagesMetadataTestJSON-1383802925 tempest-ImagesMetadataTestJSON-1383802925-project] 10.222.0.52 "GET /compute/v2.1/images/4537563b-9353-4822-84df-8e9725d179e0/metadata" status: 200 len: 37 microversion: 2.1 time: 0.058684 Oct 19 03:17:42.028886 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 762/1598] 10.222.0.52 () {58 vars in 1260 bytes} [Wed Oct 19 03:17:41 2022] GET /compute/v2.1/images/4537563b-9353-4822-84df-8e9725d179e0/metadata => generated 37 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 03:17:42.034002 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2a5391f0-1f42-4f8b-beca-8cb1eaea9eb8 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:42.124768 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2a5391f0-1f42-4f8b-beca-8cb1eaea9eb8 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "DELETE /compute/v2.1/os-server-groups/99c091b4-fcf8-4b85-ba19-1004305c9cf8" status: 204 len: 0 microversion: 2.1 time: 0.094684 Oct 19 03:17:42.125524 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 763/1599] 10.222.0.52 () {58 vars in 1266 bytes} [Wed Oct 19 03:17:42 2022] DELETE /compute/v2.1/os-server-groups/99c091b4-fcf8-4b85-ba19-1004305c9cf8 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:17:42.130949 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3469cdfe-f9ae-4efd-97a7-a96993cc7b03 tempest-FlavorsExtraSpecsTestJSON-1269106258 tempest-FlavorsExtraSpecsTestJSON-1269106258-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:42.201564 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-8a84ae55-f974-4803-8051-ebe50ad4120e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:42.210215 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-8a84ae55-f974-4803-8051-ebe50ad4120e tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196" status: 200 len: 1475 microversion: 2.1 time: 0.245700 Oct 19 03:17:42.220857 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 837/1600] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:41 2022] GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196 => generated 1475 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:42.220857 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-67344b5d-0fa8-4e05-873a-0a678b5fa3a0 tempest-ImagesMetadataTestJSON-1383802925 tempest-ImagesMetadataTestJSON-1383802925-project] Action: 'update_all', calling method: .version_select at 0x7fc130ee1a60>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:17:42.237264 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3469cdfe-f9ae-4efd-97a7-a96993cc7b03 tempest-FlavorsExtraSpecsTestJSON-1269106258 tempest-FlavorsExtraSpecsTestJSON-1269106258-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/1025583483" status: 202 len: 0 microversion: 2.1 time: 0.105943 Oct 19 03:17:42.237264 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 764/1601] 10.222.0.52 () {58 vars in 1161 bytes} [Wed Oct 19 03:17:42 2022] DELETE /compute/v2.1/flavors/1025583483 => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:17:42.237872 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6383fd5d-7041-4c14-9c68-d0fc91439db2 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:42.238553 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6383fd5d-7041-4c14-9c68-d0fc91439db2 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] [instance: 64d3b78b-7953-40fc-ab53-b35f9d105901] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:42.248874 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6383fd5d-7041-4c14-9c68-d0fc91439db2 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:42.249784 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6383fd5d-7041-4c14-9c68-d0fc91439db2 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:42.250389 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6383fd5d-7041-4c14-9c68-d0fc91439db2 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:42.252409 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6383fd5d-7041-4c14-9c68-d0fc91439db2 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:42.253244 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6383fd5d-7041-4c14-9c68-d0fc91439db2 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:42.256346 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6383fd5d-7041-4c14-9c68-d0fc91439db2 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:42.275373 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-67344b5d-0fa8-4e05-873a-0a678b5fa3a0 tempest-ImagesMetadataTestJSON-1383802925 tempest-ImagesMetadataTestJSON-1383802925-project] Getting quotas for project 00d043b2cb4a47ef977a9c1b91a4ccdc. Resources: dict_keys(['metadata_items']) {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:17:42.281442 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-67344b5d-0fa8-4e05-873a-0a678b5fa3a0 tempest-ImagesMetadataTestJSON-1383802925 tempest-ImagesMetadataTestJSON-1383802925-project] Getting quotas for user 435fa4aab96c4750bac42388e02f0ab9 and project 00d043b2cb4a47ef977a9c1b91a4ccdc. Resources: dict_keys(['metadata_items']) {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:17:42.410499 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-6383fd5d-7041-4c14-9c68-d0fc91439db2 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c35b71372843d69f9a6c6be04b154f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcd49d68a3947249016cc5dbe910efc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:42.418579 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6383fd5d-7041-4c14-9c68-d0fc91439db2 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] 10.222.0.52 "GET /compute/v2.1/servers/64d3b78b-7953-40fc-ab53-b35f9d105901" status: 200 len: 1334 microversion: 2.1 time: 0.184414 Oct 19 03:17:42.419549 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 765/1602] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:42 2022] GET /compute/v2.1/servers/64d3b78b-7953-40fc-ab53-b35f9d105901 => generated 1334 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:42.438760 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-34b0c1c7-7f8d-4b79-94cd-8bacdc35a1e3 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:42.439358 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-34b0c1c7-7f8d-4b79-94cd-8bacdc35a1e3 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 8cb9ad03-e7f9-4d7f-8711-1e2f478b0d17] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:42.447042 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-34b0c1c7-7f8d-4b79-94cd-8bacdc35a1e3 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:42.447777 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-34b0c1c7-7f8d-4b79-94cd-8bacdc35a1e3 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:42.448289 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-34b0c1c7-7f8d-4b79-94cd-8bacdc35a1e3 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:42.449155 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-34b0c1c7-7f8d-4b79-94cd-8bacdc35a1e3 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:42.449889 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-34b0c1c7-7f8d-4b79-94cd-8bacdc35a1e3 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:42.450542 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-34b0c1c7-7f8d-4b79-94cd-8bacdc35a1e3 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:42.477108 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-34b0c1c7-7f8d-4b79-94cd-8bacdc35a1e3 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 8cb9ad03-e7f9-4d7f-8711-1e2f478b0d17] Going to try to terminate instance {{(pid=121134) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:17:42.634480 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-67344b5d-0fa8-4e05-873a-0a678b5fa3a0 tempest-ImagesMetadataTestJSON-1383802925 tempest-ImagesMetadataTestJSON-1383802925-project] 10.222.0.52 "PUT /compute/v2.1/images/4537563b-9353-4822-84df-8e9725d179e0/metadata" status: 200 len: 61 microversion: 2.1 time: 0.420631 Oct 19 03:17:42.635082 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 838/1603] 10.222.0.52 () {60 vars in 1280 bytes} [Wed Oct 19 03:17:42 2022] PUT /compute/v2.1/images/4537563b-9353-4822-84df-8e9725d179e0/metadata => generated 61 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 03:17:42.641186 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-05b5d50b-830b-495e-bec6-d02dd0b8d6e6 tempest-FlavorsExtraSpecsTestJSON-1269106258 tempest-FlavorsExtraSpecsTestJSON-1269106258-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:42.664207 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-05b5d50b-830b-495e-bec6-d02dd0b8d6e6 tempest-FlavorsExtraSpecsTestJSON-1269106258 tempest-FlavorsExtraSpecsTestJSON-1269106258-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.027454 Oct 19 03:17:42.665924 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 839/1604] 10.222.0.52 () {58 vars in 1146 bytes} [Wed Oct 19 03:17:42 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:42.670757 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5fc2d110-cb54-4cd7-af02-cfd74c9af683 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:42.671686 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-5fc2d110-cb54-4cd7-af02-cfd74c9af683 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] [instance: 90f71ec9-e698-4159-9458-2099c1fbfaf3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:42.679413 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5fc2d110-cb54-4cd7-af02-cfd74c9af683 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:42.679909 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5fc2d110-cb54-4cd7-af02-cfd74c9af683 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:42.680351 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5fc2d110-cb54-4cd7-af02-cfd74c9af683 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:42.681771 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5fc2d110-cb54-4cd7-af02-cfd74c9af683 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:42.682259 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5fc2d110-cb54-4cd7-af02-cfd74c9af683 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:42.682942 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5fc2d110-cb54-4cd7-af02-cfd74c9af683 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:42.884113 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-34b0c1c7-7f8d-4b79-94cd-8bacdc35a1e3 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "DELETE /compute/v2.1/servers/8cb9ad03-e7f9-4d7f-8711-1e2f478b0d17" status: 204 len: 0 microversion: 2.1 time: 0.463610 Oct 19 03:17:42.885451 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 766/1605] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:17:42 2022] DELETE /compute/v2.1/servers/8cb9ad03-e7f9-4d7f-8711-1e2f478b0d17 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:17:42.892468 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-42440a8c-89da-449d-a0d4-a7530b14b91e tempest-ImagesMetadataTestJSON-1383802925 tempest-ImagesMetadataTestJSON-1383802925-project] Calling method '.version_select at 0x7fc135026040>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:42.934730 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-42440a8c-89da-449d-a0d4-a7530b14b91e tempest-ImagesMetadataTestJSON-1383802925 tempest-ImagesMetadataTestJSON-1383802925-project] 10.222.0.52 "GET /compute/v2.1/images/4537563b-9353-4822-84df-8e9725d179e0/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.047283 Oct 19 03:17:42.935316 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 767/1606] 10.222.0.52 () {58 vars in 1290 bytes} [Wed Oct 19 03:17:42 2022] GET /compute/v2.1/images/4537563b-9353-4822-84df-8e9725d179e0/metadata/os_distro => generated 33 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 03:17:42.940940 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d27f61b5-4040-4561-b368-cf982ab313a6 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:42.940940 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d27f61b5-4040-4561-b368-cf982ab313a6 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 393853e1-5f67-4c6b-972d-9f76de928599] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:42.946759 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d27f61b5-4040-4561-b368-cf982ab313a6 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:42.947247 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d27f61b5-4040-4561-b368-cf982ab313a6 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:42.947686 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d27f61b5-4040-4561-b368-cf982ab313a6 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:42.948389 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d27f61b5-4040-4561-b368-cf982ab313a6 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:42.948843 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d27f61b5-4040-4561-b368-cf982ab313a6 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:42.949586 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d27f61b5-4040-4561-b368-cf982ab313a6 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:42.976695 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d27f61b5-4040-4561-b368-cf982ab313a6 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 393853e1-5f67-4c6b-972d-9f76de928599] Going to try to terminate instance {{(pid=121134) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:17:43.129729 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-5fc2d110-cb54-4cd7-af02-cfd74c9af683 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28072a54d5934ea28e7d3205841c0852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c12a432bbd43bd8f70ba6e941c28a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:43.138139 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5fc2d110-cb54-4cd7-af02-cfd74c9af683 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] 10.222.0.52 "GET /compute/v2.1/servers/90f71ec9-e698-4159-9458-2099c1fbfaf3" status: 200 len: 1317 microversion: 2.1 time: 0.470970 Oct 19 03:17:43.149850 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 840/1607] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:42 2022] GET /compute/v2.1/servers/90f71ec9-e698-4159-9458-2099c1fbfaf3 => generated 1317 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:43.149850 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1f3d225f-7f93-4408-8886-dd2df8e1e61c tempest-ImagesMetadataTestJSON-1383802925 tempest-ImagesMetadataTestJSON-1383802925-project] Action: 'update_all', calling method: .version_select at 0x7fc130cef940>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:17:43.206332 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-1f3d225f-7f93-4408-8886-dd2df8e1e61c tempest-ImagesMetadataTestJSON-1383802925 tempest-ImagesMetadataTestJSON-1383802925-project] Getting quotas for project 00d043b2cb4a47ef977a9c1b91a4ccdc. Resources: dict_keys(['metadata_items']) {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:17:43.211547 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-1f3d225f-7f93-4408-8886-dd2df8e1e61c tempest-ImagesMetadataTestJSON-1383802925 tempest-ImagesMetadataTestJSON-1383802925-project] Getting quotas for user 435fa4aab96c4750bac42388e02f0ab9 and project 00d043b2cb4a47ef977a9c1b91a4ccdc. Resources: dict_keys(['metadata_items']) {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:17:43.233497 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d27f61b5-4040-4561-b368-cf982ab313a6 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "DELETE /compute/v2.1/servers/393853e1-5f67-4c6b-972d-9f76de928599" status: 204 len: 0 microversion: 2.1 time: 0.296854 Oct 19 03:17:43.234185 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 768/1608] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:17:42 2022] DELETE /compute/v2.1/servers/393853e1-5f67-4c6b-972d-9f76de928599 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:17:43.239499 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-32f099a6-43d4-4203-a1e1-e69e3c8754fc req-0b3d3e21-4ef4-4410-9cce-d08bd4711d66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64d3b78b-7953-40fc-ab53-b35f9d105901", "tag": "9eff7474-efea-4e0c-ad56-d68e07689737"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:17:43.248950 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-32f099a6-43d4-4203-a1e1-e69e3c8754fc req-0b3d3e21-4ef4-4410-9cce-d08bd4711d66 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:43.249786 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-32f099a6-43d4-4203-a1e1-e69e3c8754fc req-0b3d3e21-4ef4-4410-9cce-d08bd4711d66 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:43.249933 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-32f099a6-43d4-4203-a1e1-e69e3c8754fc req-0b3d3e21-4ef4-4410-9cce-d08bd4711d66 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:43.254394 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:17:43.266475 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-32f099a6-43d4-4203-a1e1-e69e3c8754fc req-0b3d3e21-4ef4-4410-9cce-d08bd4711d66 service nova] Creating event network-changed:9eff7474-efea-4e0c-ad56-d68e07689737 for instance 64d3b78b-7953-40fc-ab53-b35f9d105901 on n-h1-861333-8 Oct 19 03:17:43.271748 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-32f099a6-43d4-4203-a1e1-e69e3c8754fc req-0b3d3e21-4ef4-4410-9cce-d08bd4711d66 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035970 Oct 19 03:17:43.272499 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 769/1609] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:17:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:17:43.279507 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7436ff9d-4bb6-49a7-ba1d-905281b4f39f tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:43.280038 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7436ff9d-4bb6-49a7-ba1d-905281b4f39f tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 84774cfc-79b4-42db-acfd-c4daac86d196] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:43.287206 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7436ff9d-4bb6-49a7-ba1d-905281b4f39f tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:43.287781 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7436ff9d-4bb6-49a7-ba1d-905281b4f39f tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:43.288293 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7436ff9d-4bb6-49a7-ba1d-905281b4f39f tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:43.289060 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7436ff9d-4bb6-49a7-ba1d-905281b4f39f tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:43.290554 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7436ff9d-4bb6-49a7-ba1d-905281b4f39f tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:43.291092 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7436ff9d-4bb6-49a7-ba1d-905281b4f39f tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:43.297162 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:17:43.450965 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1f3d225f-7f93-4408-8886-dd2df8e1e61c tempest-ImagesMetadataTestJSON-1383802925 tempest-ImagesMetadataTestJSON-1383802925-project] 10.222.0.52 "PUT /compute/v2.1/images/4537563b-9353-4822-84df-8e9725d179e0/metadata" status: 200 len: 61 microversion: 2.1 time: 0.310737 Oct 19 03:17:43.452106 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 841/1610] 10.222.0.52 () {60 vars in 1280 bytes} [Wed Oct 19 03:17:43 2022] PUT /compute/v2.1/images/4537563b-9353-4822-84df-8e9725d179e0/metadata => generated 61 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 03:17:43.457964 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-fc63704e-d9c2-4e31-b847-272d30ac1139 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:43.459375 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-fc63704e-d9c2-4e31-b847-272d30ac1139 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 8cb9ad03-e7f9-4d7f-8711-1e2f478b0d17] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:43.469872 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fc63704e-d9c2-4e31-b847-272d30ac1139 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:43.470780 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fc63704e-d9c2-4e31-b847-272d30ac1139 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:43.471383 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fc63704e-d9c2-4e31-b847-272d30ac1139 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:43.474961 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fc63704e-d9c2-4e31-b847-272d30ac1139 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:43.474961 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fc63704e-d9c2-4e31-b847-272d30ac1139 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:43.474961 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fc63704e-d9c2-4e31-b847-272d30ac1139 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:43.561940 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-7436ff9d-4bb6-49a7-ba1d-905281b4f39f tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:43.569591 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7436ff9d-4bb6-49a7-ba1d-905281b4f39f tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196" status: 200 len: 1475 microversion: 2.1 time: 0.295593 Oct 19 03:17:43.581767 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 770/1611] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:43 2022] GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196 => generated 1475 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:43.581767 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1e641b9f-a985-4ba2-90a7-99a4675ef5b2 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:43.581767 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1e641b9f-a985-4ba2-90a7-99a4675ef5b2 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] [instance: 64d3b78b-7953-40fc-ab53-b35f9d105901] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:43.587785 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1e641b9f-a985-4ba2-90a7-99a4675ef5b2 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:43.587785 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1e641b9f-a985-4ba2-90a7-99a4675ef5b2 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:43.587785 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1e641b9f-a985-4ba2-90a7-99a4675ef5b2 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:43.587785 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1e641b9f-a985-4ba2-90a7-99a4675ef5b2 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:43.588160 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1e641b9f-a985-4ba2-90a7-99a4675ef5b2 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:43.588160 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1e641b9f-a985-4ba2-90a7-99a4675ef5b2 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:43.787275 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-fc63704e-d9c2-4e31-b847-272d30ac1139 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:43.795170 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-fc63704e-d9c2-4e31-b847-272d30ac1139 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/8cb9ad03-e7f9-4d7f-8711-1e2f478b0d17" status: 200 len: 1472 microversion: 2.1 time: 0.341400 Oct 19 03:17:43.795753 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 842/1612] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:43 2022] GET /compute/v2.1/servers/8cb9ad03-e7f9-4d7f-8711-1e2f478b0d17 => generated 1472 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:43.800324 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-df4fc775-3236-4bff-8d9a-affbd9fa39dc tempest-ImagesMetadataTestJSON-1383802925 tempest-ImagesMetadataTestJSON-1383802925-project] Calling method '.version_select at 0x7fc130cd3ee0>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:43.841645 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-df4fc775-3236-4bff-8d9a-affbd9fa39dc tempest-ImagesMetadataTestJSON-1383802925 tempest-ImagesMetadataTestJSON-1383802925-project] 10.222.0.52 "GET /compute/v2.1/images/4537563b-9353-4822-84df-8e9725d179e0/metadata" status: 200 len: 61 microversion: 2.1 time: 0.044761 Oct 19 03:17:43.842384 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 843/1613] 10.222.0.52 () {58 vars in 1260 bytes} [Wed Oct 19 03:17:43 2022] GET /compute/v2.1/images/4537563b-9353-4822-84df-8e9725d179e0/metadata => generated 61 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 03:17:43.845344 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-1e641b9f-a985-4ba2-90a7-99a4675ef5b2 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c35b71372843d69f9a6c6be04b154f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcd49d68a3947249016cc5dbe910efc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:43.854778 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1e641b9f-a985-4ba2-90a7-99a4675ef5b2 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] 10.222.0.52 "GET /compute/v2.1/servers/64d3b78b-7953-40fc-ab53-b35f9d105901" status: 200 len: 1334 microversion: 2.1 time: 0.283331 Oct 19 03:17:43.855010 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d7f1b148-c682-404f-8679-136e6b2f1cbe tempest-ImagesMetadataTestJSON-1383802925 tempest-ImagesMetadataTestJSON-1383802925-project] Action: 'update_all', calling method: .version_select at 0x7fc130cef1f0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:17:43.855661 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 771/1614] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:43 2022] GET /compute/v2.1/servers/64d3b78b-7953-40fc-ab53-b35f9d105901 => generated 1334 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:43.934507 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-d7f1b148-c682-404f-8679-136e6b2f1cbe tempest-ImagesMetadataTestJSON-1383802925 tempest-ImagesMetadataTestJSON-1383802925-project] Getting quotas for project 00d043b2cb4a47ef977a9c1b91a4ccdc. Resources: dict_keys(['metadata_items']) {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:17:43.939721 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-d7f1b148-c682-404f-8679-136e6b2f1cbe tempest-ImagesMetadataTestJSON-1383802925 tempest-ImagesMetadataTestJSON-1383802925-project] Getting quotas for user 435fa4aab96c4750bac42388e02f0ab9 and project 00d043b2cb4a47ef977a9c1b91a4ccdc. Resources: dict_keys(['metadata_items']) {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:17:44.107269 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d7f1b148-c682-404f-8679-136e6b2f1cbe tempest-ImagesMetadataTestJSON-1383802925 tempest-ImagesMetadataTestJSON-1383802925-project] 10.222.0.52 "PUT /compute/v2.1/images/4537563b-9353-4822-84df-8e9725d179e0/metadata" status: 200 len: 61 microversion: 2.1 time: 0.258038 Oct 19 03:17:44.109421 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 844/1615] 10.222.0.52 () {60 vars in 1280 bytes} [Wed Oct 19 03:17:43 2022] PUT /compute/v2.1/images/4537563b-9353-4822-84df-8e9725d179e0/metadata => generated 61 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 19 03:17:44.117757 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-bf8eda71-ba62-410d-a336-db66ae177ec9 tempest-ImagesMetadataTestJSON-1383802925 tempest-ImagesMetadataTestJSON-1383802925-project] Action: 'update_all', calling method: .version_select at 0x7fc130fad9d0>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:17:44.138657 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-67261e25-9722-4fcb-8065-94039fe5591a req-a4cb291a-6ee5-4020-b713-62dd5250de10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90f71ec9-e698-4159-9458-2099c1fbfaf3", "name": "network-vif-plugged", "status": "completed", "tag": "dd90515a-2014-4fa0-a26c-9f9741b8ce8c"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:17:44.163426 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-67261e25-9722-4fcb-8065-94039fe5591a req-a4cb291a-6ee5-4020-b713-62dd5250de10 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:44.164055 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-67261e25-9722-4fcb-8065-94039fe5591a req-a4cb291a-6ee5-4020-b713-62dd5250de10 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:44.164665 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-67261e25-9722-4fcb-8065-94039fe5591a req-a4cb291a-6ee5-4020-b713-62dd5250de10 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:44.181844 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-67261e25-9722-4fcb-8065-94039fe5591a req-a4cb291a-6ee5-4020-b713-62dd5250de10 service nova] Creating event network-vif-plugged:dd90515a-2014-4fa0-a26c-9f9741b8ce8c for instance 90f71ec9-e698-4159-9458-2099c1fbfaf3 on n-h2-861333-8 Oct 19 03:17:44.186910 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-67261e25-9722-4fcb-8065-94039fe5591a req-a4cb291a-6ee5-4020-b713-62dd5250de10 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057421 Oct 19 03:17:44.187814 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 845/1616] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:17:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:17:44.192978 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d4174168-36fb-4733-b24e-92cd205ca21f tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:44.193712 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d4174168-36fb-4733-b24e-92cd205ca21f tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] [instance: 90f71ec9-e698-4159-9458-2099c1fbfaf3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:44.196951 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-bf8eda71-ba62-410d-a336-db66ae177ec9 tempest-ImagesMetadataTestJSON-1383802925 tempest-ImagesMetadataTestJSON-1383802925-project] Getting quotas for project 00d043b2cb4a47ef977a9c1b91a4ccdc. Resources: dict_keys(['metadata_items']) {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:17:44.201208 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d4174168-36fb-4733-b24e-92cd205ca21f tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:44.201938 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d4174168-36fb-4733-b24e-92cd205ca21f tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:44.202475 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d4174168-36fb-4733-b24e-92cd205ca21f tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:44.203417 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d4174168-36fb-4733-b24e-92cd205ca21f tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:44.203811 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-bf8eda71-ba62-410d-a336-db66ae177ec9 tempest-ImagesMetadataTestJSON-1383802925 tempest-ImagesMetadataTestJSON-1383802925-project] Getting quotas for user 435fa4aab96c4750bac42388e02f0ab9 and project 00d043b2cb4a47ef977a9c1b91a4ccdc. Resources: dict_keys(['metadata_items']) {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:17:44.204164 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d4174168-36fb-4733-b24e-92cd205ca21f tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:44.204757 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d4174168-36fb-4733-b24e-92cd205ca21f tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:44.454415 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d4174168-36fb-4733-b24e-92cd205ca21f tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28072a54d5934ea28e7d3205841c0852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c12a432bbd43bd8f70ba6e941c28a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:44.462999 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d4174168-36fb-4733-b24e-92cd205ca21f tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] 10.222.0.52 "GET /compute/v2.1/servers/90f71ec9-e698-4159-9458-2099c1fbfaf3" status: 200 len: 1317 microversion: 2.1 time: 0.274000 Oct 19 03:17:44.463574 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 846/1617] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:44 2022] GET /compute/v2.1/servers/90f71ec9-e698-4159-9458-2099c1fbfaf3 => generated 1317 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:44.602421 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-75ad7157-68c8-4cfa-a84d-3f14d3425c93 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:44.605927 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-75ad7157-68c8-4cfa-a84d-3f14d3425c93 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 84774cfc-79b4-42db-acfd-c4daac86d196] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:44.612809 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-bf8eda71-ba62-410d-a336-db66ae177ec9 tempest-ImagesMetadataTestJSON-1383802925 tempest-ImagesMetadataTestJSON-1383802925-project] 10.222.0.52 "PUT /compute/v2.1/images/4537563b-9353-4822-84df-8e9725d179e0/metadata" status: 200 len: 64 microversion: 2.1 time: 0.499307 Oct 19 03:17:44.614749 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 772/1618] 10.222.0.52 () {60 vars in 1280 bytes} [Wed Oct 19 03:17:44 2022] PUT /compute/v2.1/images/4537563b-9353-4822-84df-8e9725d179e0/metadata => generated 64 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 03:17:44.624237 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-75ad7157-68c8-4cfa-a84d-3f14d3425c93 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:44.630450 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-75ad7157-68c8-4cfa-a84d-3f14d3425c93 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:44.630816 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e86afc09-9dde-4f1e-8e0c-a36d722bcf68 tempest-ImagesMetadataTestJSON-1383802925 tempest-ImagesMetadataTestJSON-1383802925-project] Calling method '.version_select at 0x7fc1350d5ca0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:44.631060 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-75ad7157-68c8-4cfa-a84d-3f14d3425c93 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:44.631060 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-75ad7157-68c8-4cfa-a84d-3f14d3425c93 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:44.631060 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-75ad7157-68c8-4cfa-a84d-3f14d3425c93 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:44.631060 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-75ad7157-68c8-4cfa-a84d-3f14d3425c93 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:44.683539 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e86afc09-9dde-4f1e-8e0c-a36d722bcf68 tempest-ImagesMetadataTestJSON-1383802925 tempest-ImagesMetadataTestJSON-1383802925-project] 10.222.0.52 "GET /compute/v2.1/images/4537563b-9353-4822-84df-8e9725d179e0/metadata" status: 200 len: 64 microversion: 2.1 time: 0.061836 Oct 19 03:17:44.683675 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 773/1619] 10.222.0.52 () {58 vars in 1260 bytes} [Wed Oct 19 03:17:44 2022] GET /compute/v2.1/images/4537563b-9353-4822-84df-8e9725d179e0/metadata => generated 64 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 19 03:17:44.696689 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d6ca00f4-c08a-4bb0-b7cb-00220a70a151 tempest-ImagesMetadataTestJSON-1383802925 tempest-ImagesMetadataTestJSON-1383802925-project] Action: 'update_all', calling method: .version_select at 0x7fc135015f70>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:17:44.754737 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-d6ca00f4-c08a-4bb0-b7cb-00220a70a151 tempest-ImagesMetadataTestJSON-1383802925 tempest-ImagesMetadataTestJSON-1383802925-project] Getting quotas for project 00d043b2cb4a47ef977a9c1b91a4ccdc. Resources: dict_keys(['metadata_items']) {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:17:44.760263 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-d6ca00f4-c08a-4bb0-b7cb-00220a70a151 tempest-ImagesMetadataTestJSON-1383802925 tempest-ImagesMetadataTestJSON-1383802925-project] Getting quotas for user 435fa4aab96c4750bac42388e02f0ab9 and project 00d043b2cb4a47ef977a9c1b91a4ccdc. Resources: dict_keys(['metadata_items']) {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:17:44.878608 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-75ad7157-68c8-4cfa-a84d-3f14d3425c93 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:44.887269 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-75ad7157-68c8-4cfa-a84d-3f14d3425c93 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196" status: 200 len: 1475 microversion: 2.1 time: 0.295045 Oct 19 03:17:44.897757 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 847/1620] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:44 2022] GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196 => generated 1475 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:17:44.908873 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-efc62257-10a0-4f41-b7db-6b3b4319bd69 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:44.909526 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-efc62257-10a0-4f41-b7db-6b3b4319bd69 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 8cb9ad03-e7f9-4d7f-8711-1e2f478b0d17] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:44.916405 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-efc62257-10a0-4f41-b7db-6b3b4319bd69 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:44.916889 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-efc62257-10a0-4f41-b7db-6b3b4319bd69 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:44.917326 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-efc62257-10a0-4f41-b7db-6b3b4319bd69 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:44.918060 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-efc62257-10a0-4f41-b7db-6b3b4319bd69 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:44.918513 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-efc62257-10a0-4f41-b7db-6b3b4319bd69 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:44.918938 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-efc62257-10a0-4f41-b7db-6b3b4319bd69 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:44.923167 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:17:45.138493 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-efc62257-10a0-4f41-b7db-6b3b4319bd69 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:45.147039 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-efc62257-10a0-4f41-b7db-6b3b4319bd69 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/8cb9ad03-e7f9-4d7f-8711-1e2f478b0d17" status: 200 len: 1472 microversion: 2.1 time: 0.247850 Oct 19 03:17:45.147621 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 848/1621] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:44 2022] GET /compute/v2.1/servers/8cb9ad03-e7f9-4d7f-8711-1e2f478b0d17 => generated 1472 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:45.153538 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a3bc2777-dee8-41fa-b6dd-00dc3cf7a2b8 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:45.154419 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a3bc2777-dee8-41fa-b6dd-00dc3cf7a2b8 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] [instance: 64d3b78b-7953-40fc-ab53-b35f9d105901] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:45.160845 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a3bc2777-dee8-41fa-b6dd-00dc3cf7a2b8 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:45.161364 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a3bc2777-dee8-41fa-b6dd-00dc3cf7a2b8 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:45.161819 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a3bc2777-dee8-41fa-b6dd-00dc3cf7a2b8 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:45.162515 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a3bc2777-dee8-41fa-b6dd-00dc3cf7a2b8 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:45.162969 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a3bc2777-dee8-41fa-b6dd-00dc3cf7a2b8 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:45.163391 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a3bc2777-dee8-41fa-b6dd-00dc3cf7a2b8 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:45.225885 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d6ca00f4-c08a-4bb0-b7cb-00220a70a151 tempest-ImagesMetadataTestJSON-1383802925 tempest-ImagesMetadataTestJSON-1383802925-project] 10.222.0.52 "PUT /compute/v2.1/images/4537563b-9353-4822-84df-8e9725d179e0/metadata" status: 200 len: 61 microversion: 2.1 time: 0.535074 Oct 19 03:17:45.226646 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 774/1622] 10.222.0.52 () {60 vars in 1280 bytes} [Wed Oct 19 03:17:44 2022] PUT /compute/v2.1/images/4537563b-9353-4822-84df-8e9725d179e0/metadata => generated 61 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 19 03:17:45.239730 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e14eaf58-1bb3-4561-8a10-f596a75da70f tempest-ImagesMetadataTestJSON-1383802925 tempest-ImagesMetadataTestJSON-1383802925-project] Action: 'update', calling method: .version_select at 0x7fc1350d5160>, body: {"meta": {"os_version": "alt"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:17:45.314371 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-e14eaf58-1bb3-4561-8a10-f596a75da70f tempest-ImagesMetadataTestJSON-1383802925 tempest-ImagesMetadataTestJSON-1383802925-project] Getting quotas for project 00d043b2cb4a47ef977a9c1b91a4ccdc. Resources: dict_keys(['metadata_items']) {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:17:45.319286 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-e14eaf58-1bb3-4561-8a10-f596a75da70f tempest-ImagesMetadataTestJSON-1383802925 tempest-ImagesMetadataTestJSON-1383802925-project] Getting quotas for user 435fa4aab96c4750bac42388e02f0ab9 and project 00d043b2cb4a47ef977a9c1b91a4ccdc. Resources: dict_keys(['metadata_items']) {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:17:45.331649 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a3bc2777-dee8-41fa-b6dd-00dc3cf7a2b8 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c35b71372843d69f9a6c6be04b154f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcd49d68a3947249016cc5dbe910efc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:45.340523 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a3bc2777-dee8-41fa-b6dd-00dc3cf7a2b8 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] 10.222.0.52 "GET /compute/v2.1/servers/64d3b78b-7953-40fc-ab53-b35f9d105901" status: 200 len: 1334 microversion: 2.1 time: 0.191623 Oct 19 03:17:45.345139 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 849/1623] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:45 2022] GET /compute/v2.1/servers/64d3b78b-7953-40fc-ab53-b35f9d105901 => generated 1334 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:45.346020 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-5d0cf49a-8b87-4800-bc40-cd99de8f76a8 req-9891d578-2c92-405a-bcc6-c5f28673850b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64d3b78b-7953-40fc-ab53-b35f9d105901", "tag": "e05f0fbb-41ba-40b6-8c55-8a23a1c1e929"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:17:45.357006 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-5d0cf49a-8b87-4800-bc40-cd99de8f76a8 req-9891d578-2c92-405a-bcc6-c5f28673850b service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:45.357530 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-5d0cf49a-8b87-4800-bc40-cd99de8f76a8 req-9891d578-2c92-405a-bcc6-c5f28673850b service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:45.357964 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-5d0cf49a-8b87-4800-bc40-cd99de8f76a8 req-9891d578-2c92-405a-bcc6-c5f28673850b service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:45.375819 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-5d0cf49a-8b87-4800-bc40-cd99de8f76a8 req-9891d578-2c92-405a-bcc6-c5f28673850b service nova] Creating event network-changed:e05f0fbb-41ba-40b6-8c55-8a23a1c1e929 for instance 64d3b78b-7953-40fc-ab53-b35f9d105901 on n-h1-861333-8 Oct 19 03:17:45.380766 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-5d0cf49a-8b87-4800-bc40-cd99de8f76a8 req-9891d578-2c92-405a-bcc6-c5f28673850b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037968 Oct 19 03:17:45.381590 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 850/1624] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:17:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:17:45.497037 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-cea9224a-dc34-4df4-b37d-e50b1dac27ed tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:45.497037 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-cea9224a-dc34-4df4-b37d-e50b1dac27ed tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] [instance: 90f71ec9-e698-4159-9458-2099c1fbfaf3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:45.502814 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cea9224a-dc34-4df4-b37d-e50b1dac27ed tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:45.503955 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cea9224a-dc34-4df4-b37d-e50b1dac27ed tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:45.504517 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cea9224a-dc34-4df4-b37d-e50b1dac27ed tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:45.505336 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cea9224a-dc34-4df4-b37d-e50b1dac27ed tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:45.506099 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cea9224a-dc34-4df4-b37d-e50b1dac27ed tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:45.506860 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cea9224a-dc34-4df4-b37d-e50b1dac27ed tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:45.815595 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e14eaf58-1bb3-4561-8a10-f596a75da70f tempest-ImagesMetadataTestJSON-1383802925 tempest-ImagesMetadataTestJSON-1383802925-project] 10.222.0.52 "PUT /compute/v2.1/images/4537563b-9353-4822-84df-8e9725d179e0/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.580520 Oct 19 03:17:45.816595 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 775/1625] 10.222.0.52 () {60 vars in 1313 bytes} [Wed Oct 19 03:17:45 2022] PUT /compute/v2.1/images/4537563b-9353-4822-84df-8e9725d179e0/metadata/os_version => generated 31 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 03:17:45.828920 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f90b0055-54e1-47df-b5ce-4c6bb06aaeba tempest-ImagesMetadataTestJSON-1383802925 tempest-ImagesMetadataTestJSON-1383802925-project] Calling method '.version_select at 0x7fc1350150d0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:45.857886 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-cea9224a-dc34-4df4-b37d-e50b1dac27ed tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28072a54d5934ea28e7d3205841c0852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c12a432bbd43bd8f70ba6e941c28a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:45.877847 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f90b0055-54e1-47df-b5ce-4c6bb06aaeba tempest-ImagesMetadataTestJSON-1383802925 tempest-ImagesMetadataTestJSON-1383802925-project] 10.222.0.52 "GET /compute/v2.1/images/4537563b-9353-4822-84df-8e9725d179e0/metadata" status: 200 len: 58 microversion: 2.1 time: 0.054784 Oct 19 03:17:45.878801 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 776/1626] 10.222.0.52 () {58 vars in 1260 bytes} [Wed Oct 19 03:17:45 2022] GET /compute/v2.1/images/4537563b-9353-4822-84df-8e9725d179e0/metadata => generated 58 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 03:17:45.879386 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-cea9224a-dc34-4df4-b37d-e50b1dac27ed tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] 10.222.0.52 "GET /compute/v2.1/servers/90f71ec9-e698-4159-9458-2099c1fbfaf3" status: 200 len: 1317 microversion: 2.1 time: 0.394605 Oct 19 03:17:45.879983 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 851/1627] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:45 2022] GET /compute/v2.1/servers/90f71ec9-e698-4159-9458-2099c1fbfaf3 => generated 1317 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:45.909712 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-29d9638f-c725-4deb-ab18-9046a96767bf tempest-ImagesMetadataTestJSON-1383802925 tempest-ImagesMetadataTestJSON-1383802925-project] Action: 'update_all', calling method: .version_select at 0x7fc135030c10>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:17:45.993083 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-29d9638f-c725-4deb-ab18-9046a96767bf tempest-ImagesMetadataTestJSON-1383802925 tempest-ImagesMetadataTestJSON-1383802925-project] Getting quotas for project 00d043b2cb4a47ef977a9c1b91a4ccdc. Resources: dict_keys(['metadata_items']) {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:17:45.999963 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-29d9638f-c725-4deb-ab18-9046a96767bf tempest-ImagesMetadataTestJSON-1383802925 tempest-ImagesMetadataTestJSON-1383802925-project] Getting quotas for user 435fa4aab96c4750bac42388e02f0ab9 and project 00d043b2cb4a47ef977a9c1b91a4ccdc. Resources: dict_keys(['metadata_items']) {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:17:46.388456 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9b6ff6ec-5d30-4248-8954-f4b8f25e25a2 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:46.389735 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9b6ff6ec-5d30-4248-8954-f4b8f25e25a2 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 84774cfc-79b4-42db-acfd-c4daac86d196] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:46.396600 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9b6ff6ec-5d30-4248-8954-f4b8f25e25a2 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:46.397901 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9b6ff6ec-5d30-4248-8954-f4b8f25e25a2 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:46.398618 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9b6ff6ec-5d30-4248-8954-f4b8f25e25a2 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:46.399582 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9b6ff6ec-5d30-4248-8954-f4b8f25e25a2 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:46.400280 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9b6ff6ec-5d30-4248-8954-f4b8f25e25a2 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:46.400918 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9b6ff6ec-5d30-4248-8954-f4b8f25e25a2 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:46.461878 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-29d9638f-c725-4deb-ab18-9046a96767bf tempest-ImagesMetadataTestJSON-1383802925 tempest-ImagesMetadataTestJSON-1383802925-project] 10.222.0.52 "PUT /compute/v2.1/images/4537563b-9353-4822-84df-8e9725d179e0/metadata" status: 200 len: 61 microversion: 2.1 time: 0.559320 Oct 19 03:17:46.462469 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 777/1628] 10.222.0.52 () {60 vars in 1280 bytes} [Wed Oct 19 03:17:45 2022] PUT /compute/v2.1/images/4537563b-9353-4822-84df-8e9725d179e0/metadata => generated 61 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 03:17:46.467036 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ab847c46-2f8c-48a8-85c2-2c8e67d517d6 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:46.467679 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ab847c46-2f8c-48a8-85c2-2c8e67d517d6 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 8cb9ad03-e7f9-4d7f-8711-1e2f478b0d17] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:46.473945 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ab847c46-2f8c-48a8-85c2-2c8e67d517d6 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:46.479520 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ab847c46-2f8c-48a8-85c2-2c8e67d517d6 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:46.479520 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ab847c46-2f8c-48a8-85c2-2c8e67d517d6 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:46.479520 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ab847c46-2f8c-48a8-85c2-2c8e67d517d6 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:46.479520 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ab847c46-2f8c-48a8-85c2-2c8e67d517d6 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:46.480358 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ab847c46-2f8c-48a8-85c2-2c8e67d517d6 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:46.588121 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ab847c46-2f8c-48a8-85c2-2c8e67d517d6 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:46.613395 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ab847c46-2f8c-48a8-85c2-2c8e67d517d6 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/8cb9ad03-e7f9-4d7f-8711-1e2f478b0d17" status: 200 len: 1430 microversion: 2.1 time: 0.149343 Oct 19 03:17:46.615579 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 778/1629] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:46 2022] GET /compute/v2.1/servers/8cb9ad03-e7f9-4d7f-8711-1e2f478b0d17 => generated 1430 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:46.627374 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-e0068b9f-1069-4a46-96f8-1b4d6396b638 req-ba3c60e4-b0eb-4c97-89d2-8680f99751c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84774cfc-79b4-42db-acfd-c4daac86d196", "name": "network-vif-unplugged", "status": "completed", "tag": "349ffeb3-81a2-44f2-9775-65ddf0c3a896"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:17:46.637734 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-e0068b9f-1069-4a46-96f8-1b4d6396b638 req-ba3c60e4-b0eb-4c97-89d2-8680f99751c4 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:46.638703 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-e0068b9f-1069-4a46-96f8-1b4d6396b638 req-ba3c60e4-b0eb-4c97-89d2-8680f99751c4 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:46.640229 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-e0068b9f-1069-4a46-96f8-1b4d6396b638 req-ba3c60e4-b0eb-4c97-89d2-8680f99751c4 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:46.657389 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-e0068b9f-1069-4a46-96f8-1b4d6396b638 req-ba3c60e4-b0eb-4c97-89d2-8680f99751c4 service nova] Creating event network-vif-unplugged:349ffeb3-81a2-44f2-9775-65ddf0c3a896 for instance 84774cfc-79b4-42db-acfd-c4daac86d196 on n-h2-861333-8 Oct 19 03:17:46.664116 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [req-e0068b9f-1069-4a46-96f8-1b4d6396b638 req-ba3c60e4-b0eb-4c97-89d2-8680f99751c4 service nova] Instance 84774cfc-79b4-42db-acfd-c4daac86d196 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-861333-8', 'n-h1-861333-8'} {{(pid=121134) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 03:17:46.693474 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-e0068b9f-1069-4a46-96f8-1b4d6396b638 req-ba3c60e4-b0eb-4c97-89d2-8680f99751c4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.075689 Oct 19 03:17:46.694425 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 779/1630] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:17:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:17:46.704507 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-9b6ff6ec-5d30-4248-8954-f4b8f25e25a2 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:46.705401 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-cf915344-fcc3-402c-a164-ad5063f13fe5 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:46.707630 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-cf915344-fcc3-402c-a164-ad5063f13fe5 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] [instance: 64d3b78b-7953-40fc-ab53-b35f9d105901] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:46.715930 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9b6ff6ec-5d30-4248-8954-f4b8f25e25a2 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196" status: 200 len: 1474 microversion: 2.1 time: 0.804409 Oct 19 03:17:46.716352 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cf915344-fcc3-402c-a164-ad5063f13fe5 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:46.716516 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 852/1631] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:45 2022] GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196 => generated 1474 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:46.717301 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cf915344-fcc3-402c-a164-ad5063f13fe5 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:46.718123 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cf915344-fcc3-402c-a164-ad5063f13fe5 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:46.719077 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cf915344-fcc3-402c-a164-ad5063f13fe5 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:46.719821 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cf915344-fcc3-402c-a164-ad5063f13fe5 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:46.720603 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cf915344-fcc3-402c-a164-ad5063f13fe5 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:46.729261 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ef917381-1c5f-4824-bb71-18750e83e71e tempest-ImagesMetadataTestJSON-1383802925 tempest-ImagesMetadataTestJSON-1383802925-project] Action: 'create', calling method: .version_select at 0x7fc130e4ca60>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:17:46.819035 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-ef917381-1c5f-4824-bb71-18750e83e71e tempest-ImagesMetadataTestJSON-1383802925 tempest-ImagesMetadataTestJSON-1383802925-project] Getting quotas for project 00d043b2cb4a47ef977a9c1b91a4ccdc. Resources: dict_keys(['metadata_items']) {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:17:46.827780 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-ef917381-1c5f-4824-bb71-18750e83e71e tempest-ImagesMetadataTestJSON-1383802925 tempest-ImagesMetadataTestJSON-1383802925-project] Getting quotas for user 435fa4aab96c4750bac42388e02f0ab9 and project 00d043b2cb4a47ef977a9c1b91a4ccdc. Resources: dict_keys(['metadata_items']) {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:17:46.963879 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-cf915344-fcc3-402c-a164-ad5063f13fe5 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c35b71372843d69f9a6c6be04b154f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcd49d68a3947249016cc5dbe910efc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:46.979435 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-cf915344-fcc3-402c-a164-ad5063f13fe5 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] 10.222.0.52 "GET /compute/v2.1/servers/64d3b78b-7953-40fc-ab53-b35f9d105901" status: 200 len: 1334 microversion: 2.1 time: 0.282320 Oct 19 03:17:46.980515 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 780/1632] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:46 2022] GET /compute/v2.1/servers/64d3b78b-7953-40fc-ab53-b35f9d105901 => generated 1334 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:46.986929 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-bec437e2-9d99-4a41-ae98-151fbcf55fad tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:46.987939 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-bec437e2-9d99-4a41-ae98-151fbcf55fad tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] [instance: 90f71ec9-e698-4159-9458-2099c1fbfaf3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:46.994783 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bec437e2-9d99-4a41-ae98-151fbcf55fad tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:46.995658 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bec437e2-9d99-4a41-ae98-151fbcf55fad tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:46.996553 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bec437e2-9d99-4a41-ae98-151fbcf55fad tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:46.997533 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bec437e2-9d99-4a41-ae98-151fbcf55fad tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:46.998241 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bec437e2-9d99-4a41-ae98-151fbcf55fad tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:46.998893 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bec437e2-9d99-4a41-ae98-151fbcf55fad tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:47.217580 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-bec437e2-9d99-4a41-ae98-151fbcf55fad tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28072a54d5934ea28e7d3205841c0852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c12a432bbd43bd8f70ba6e941c28a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:47.237766 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-bec437e2-9d99-4a41-ae98-151fbcf55fad tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] 10.222.0.52 "GET /compute/v2.1/servers/90f71ec9-e698-4159-9458-2099c1fbfaf3" status: 200 len: 1317 microversion: 2.1 time: 0.251940 Oct 19 03:17:47.240239 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 781/1633] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:46 2022] GET /compute/v2.1/servers/90f71ec9-e698-4159-9458-2099c1fbfaf3 => generated 1317 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:47.417491 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-a9a19b9a-ea3f-4114-a8bb-4140f4f8700b req-cab963d0-a771-413d-85be-c2e631d82285 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cb9ad03-e7f9-4d7f-8711-1e2f478b0d17", "name": "network-vif-deleted", "tag": "e1bbec00-8519-4f02-b46d-c4664396ed43"}, {"server_uuid": "393853e1-5f67-4c6b-972d-9f76de928599", "name": "network-vif-deleted", "tag": "d5510f98-8a30-4512-b93a-37d0c22020ba"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:17:47.436628 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-a9a19b9a-ea3f-4114-a8bb-4140f4f8700b req-cab963d0-a771-413d-85be-c2e631d82285 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:47.437102 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-a9a19b9a-ea3f-4114-a8bb-4140f4f8700b req-cab963d0-a771-413d-85be-c2e631d82285 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:47.437580 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-a9a19b9a-ea3f-4114-a8bb-4140f4f8700b req-cab963d0-a771-413d-85be-c2e631d82285 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:47.448868 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ef917381-1c5f-4824-bb71-18750e83e71e tempest-ImagesMetadataTestJSON-1383802925 tempest-ImagesMetadataTestJSON-1383802925-project] 10.222.0.52 "POST /compute/v2.1/images/4537563b-9353-4822-84df-8e9725d179e0/metadata" status: 200 len: 85 microversion: 2.1 time: 0.727664 Oct 19 03:17:47.451018 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 853/1634] 10.222.0.52 () {60 vars in 1281 bytes} [Wed Oct 19 03:17:46 2022] POST /compute/v2.1/images/4537563b-9353-4822-84df-8e9725d179e0/metadata => generated 85 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 03:17:47.451904 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-a9a19b9a-ea3f-4114-a8bb-4140f4f8700b req-cab963d0-a771-413d-85be-c2e631d82285 service nova] Creating event network-vif-deleted:e1bbec00-8519-4f02-b46d-c4664396ed43 for instance 8cb9ad03-e7f9-4d7f-8711-1e2f478b0d17 on n-h2-861333-8 Oct 19 03:17:47.452426 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-a9a19b9a-ea3f-4114-a8bb-4140f4f8700b req-cab963d0-a771-413d-85be-c2e631d82285 service nova] Creating event network-vif-deleted:d5510f98-8a30-4512-b93a-37d0c22020ba for instance 393853e1-5f67-4c6b-972d-9f76de928599 on n-h2-861333-8 Oct 19 03:17:47.459507 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-a9a19b9a-ea3f-4114-a8bb-4140f4f8700b req-cab963d0-a771-413d-85be-c2e631d82285 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.047260 Oct 19 03:17:47.460446 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 782/1635] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:17:47 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:17:47.460941 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-311b5dac-1273-4ce6-b830-135593906288 tempest-ImagesMetadataTestJSON-1383802925 tempest-ImagesMetadataTestJSON-1383802925-project] Calling method '.version_select at 0x7fc130ca9a60>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:47.521937 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-311b5dac-1273-4ce6-b830-135593906288 tempest-ImagesMetadataTestJSON-1383802925 tempest-ImagesMetadataTestJSON-1383802925-project] 10.222.0.52 "GET /compute/v2.1/images/4537563b-9353-4822-84df-8e9725d179e0/metadata" status: 200 len: 85 microversion: 2.1 time: 0.065728 Oct 19 03:17:47.522775 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 854/1636] 10.222.0.52 () {58 vars in 1260 bytes} [Wed Oct 19 03:17:47 2022] GET /compute/v2.1/images/4537563b-9353-4822-84df-8e9725d179e0/metadata => generated 85 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 03:17:47.644079 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-682deb88-cf94-4214-910c-cfbf905f70d0 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:47.645634 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-682deb88-cf94-4214-910c-cfbf905f70d0 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 8cb9ad03-e7f9-4d7f-8711-1e2f478b0d17] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:47.657394 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-682deb88-cf94-4214-910c-cfbf905f70d0 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:47.658084 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-682deb88-cf94-4214-910c-cfbf905f70d0 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:47.658626 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-682deb88-cf94-4214-910c-cfbf905f70d0 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:47.659471 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-682deb88-cf94-4214-910c-cfbf905f70d0 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:47.659997 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-682deb88-cf94-4214-910c-cfbf905f70d0 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:47.660497 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-682deb88-cf94-4214-910c-cfbf905f70d0 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:47.747370 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6dbd4250-da9e-4dca-be05-36731f2e9301 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:47.748432 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6dbd4250-da9e-4dca-be05-36731f2e9301 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 84774cfc-79b4-42db-acfd-c4daac86d196] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:47.762274 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6dbd4250-da9e-4dca-be05-36731f2e9301 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:47.762777 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6dbd4250-da9e-4dca-be05-36731f2e9301 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:47.763219 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6dbd4250-da9e-4dca-be05-36731f2e9301 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:47.764206 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6dbd4250-da9e-4dca-be05-36731f2e9301 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:47.764661 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6dbd4250-da9e-4dca-be05-36731f2e9301 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:47.765083 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6dbd4250-da9e-4dca-be05-36731f2e9301 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:47.783049 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-682deb88-cf94-4214-910c-cfbf905f70d0 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:47.786963 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-682deb88-cf94-4214-910c-cfbf905f70d0 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:47.787481 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-682deb88-cf94-4214-910c-cfbf905f70d0 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:47.787953 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-682deb88-cf94-4214-910c-cfbf905f70d0 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lazy-loading 'fault' on Instance uuid 8cb9ad03-e7f9-4d7f-8711-1e2f478b0d17 {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:17:47.858710 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-682deb88-cf94-4214-910c-cfbf905f70d0 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:47.867374 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-682deb88-cf94-4214-910c-cfbf905f70d0 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/8cb9ad03-e7f9-4d7f-8711-1e2f478b0d17" status: 200 len: 1307 microversion: 2.1 time: 0.228081 Oct 19 03:17:47.868468 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 783/1637] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:47 2022] GET /compute/v2.1/servers/8cb9ad03-e7f9-4d7f-8711-1e2f478b0d17 => generated 1307 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:47.956679 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-6dbd4250-da9e-4dca-be05-36731f2e9301 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:47.965982 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6dbd4250-da9e-4dca-be05-36731f2e9301 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196" status: 200 len: 1474 microversion: 2.1 time: 0.223187 Oct 19 03:17:47.966984 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 855/1638] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:47 2022] GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196 => generated 1474 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:48.007081 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-498312a3-e139-46ce-8cbb-364cefa28933 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:48.007712 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-498312a3-e139-46ce-8cbb-364cefa28933 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] [instance: 64d3b78b-7953-40fc-ab53-b35f9d105901] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:48.014233 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-498312a3-e139-46ce-8cbb-364cefa28933 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:48.014732 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-498312a3-e139-46ce-8cbb-364cefa28933 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:48.015180 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-498312a3-e139-46ce-8cbb-364cefa28933 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:48.015903 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-498312a3-e139-46ce-8cbb-364cefa28933 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:48.016350 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-498312a3-e139-46ce-8cbb-364cefa28933 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:48.016786 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-498312a3-e139-46ce-8cbb-364cefa28933 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:48.186169 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-498312a3-e139-46ce-8cbb-364cefa28933 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c35b71372843d69f9a6c6be04b154f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcd49d68a3947249016cc5dbe910efc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:48.196326 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-498312a3-e139-46ce-8cbb-364cefa28933 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] 10.222.0.52 "GET /compute/v2.1/servers/64d3b78b-7953-40fc-ab53-b35f9d105901" status: 200 len: 1334 microversion: 2.1 time: 0.193297 Oct 19 03:17:48.197285 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 784/1639] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:48 2022] GET /compute/v2.1/servers/64d3b78b-7953-40fc-ab53-b35f9d105901 => generated 1334 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:48.260754 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7baf3675-7d01-458e-b512-e186c3c4903f tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:48.261523 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7baf3675-7d01-458e-b512-e186c3c4903f tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] [instance: 90f71ec9-e698-4159-9458-2099c1fbfaf3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:48.264813 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=6,nova_api:UPDATE=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:17:48.268183 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7baf3675-7d01-458e-b512-e186c3c4903f tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:48.268666 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7baf3675-7d01-458e-b512-e186c3c4903f tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:48.269103 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7baf3675-7d01-458e-b512-e186c3c4903f tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:48.269826 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7baf3675-7d01-458e-b512-e186c3c4903f tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:48.270284 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7baf3675-7d01-458e-b512-e186c3c4903f tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:48.270715 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7baf3675-7d01-458e-b512-e186c3c4903f tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:48.424625 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-522219b2-e2d2-4506-b1bc-bc5f6dcb7ebc tempest-InstanceUsageAuditLogNegativeTestJSON-818931843 tempest-InstanceUsageAuditLogNegativeTestJSON-818931843-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:48.426440 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-522219b2-e2d2-4506-b1bc-bc5f6dcb7ebc tempest-InstanceUsageAuditLogNegativeTestJSON-818931843 tempest-InstanceUsageAuditLogNegativeTestJSON-818931843-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Oct 19 03:17:48.442900 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-522219b2-e2d2-4506-b1bc-bc5f6dcb7ebc tempest-InstanceUsageAuditLogNegativeTestJSON-818931843 tempest-InstanceUsageAuditLogNegativeTestJSON-818931843-project-admin] Request method failure captured: Oct 19 03:17:48.442900 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Oct 19 03:17:48.442900 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:17:48.442900 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:17:48.442900 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:17:48.442900 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:17:48.442900 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:17:48.442900 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:17:48.442900 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:17:48.442900 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:17:48.442900 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2xcFAayqXst88uKYuWoBJslkjjkm7AP_NmlCFDP9HbTxYvya6H9FgQpfKa8FYyM6gAvsL4hTtpWvgijivyHMfLt-w2mYn7Ww_bodwWJjocj3o1oTWUd8XaK676JpOavzEjHglLT3VrBMDxMz18qL2r0Gaayg0226z44w_W-jKCQdRQ Oct 19 03:17:48.442900 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:17:48.442900 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:17:48.442900 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:17:48.442900 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:17:48.442900 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:17:48.442900 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:17:48.442900 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 4507cbe756b442178f7dd02af59dcde9 Oct 19 03:17:48.442900 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-818931843 Oct 19 03:17:48.442900 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member,admin Oct 19 03:17:48.442900 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member,admin Oct 19 03:17:48.444782 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4507cbe756b442178f7dd02af59dcde9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4507cbe756b442178f7dd02af59dcde9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4507cbe756b442178f7dd02af59dcde9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4507cbe756b442178f7dd02af59dcde9", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:17:48.444782 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-818931843 Oct 19 03:17:48.444782 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 4507cbe756b442178f7dd02af59dcde9 Oct 19 03:17:48.444782 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-818931843 Oct 19 03:17:48.444782 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-818931843-project-admin Oct 19 03:17:48.444782 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:17:48.444782 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:17:48.444782 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 0b95d6982a654f3fbe3ebe7fdfe90636 Oct 19 03:17:48.444782 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-818931843-project-admin Oct 19 03:17:48.444782 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:17:48.444782 n-d-861333-8 devstack@n-api.service[121135]: exception: Invalid timestamp for date invalid_time Oct 19 03:17:48.445704 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': 'invalid_time'} Oct 19 03:17:48.445704 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:17:48.445704 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:17:48.445704 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Oct 19 03:17:48.445704 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Oct 19 03:17:48.445704 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Oct 19 03:17:48.445704 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Oct 19 03:17:48.445704 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Oct 19 03:17:48.445704 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Oct 19 03:17:48.445704 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Oct 19 03:17:48.445704 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:17:48.445704 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:17:48.445704 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:17:48.445704 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:17:48.445704 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:17:48.445704 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:17:48.445704 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:17:48.445704 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:17:48.445704 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:17:48.445704 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:17:48.447701 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Oct 19 03:17:48.447701 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Oct 19 03:17:48.447701 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Oct 19 03:17:48.447701 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:17:48.447701 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:17:48.447701 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:17:48.447701 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:17:48.447701 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:17:48.447701 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:17:48.447701 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:17:48.447701 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:17:48.447701 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Oct 19 03:17:48.447701 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:17:48.452938 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-522219b2-e2d2-4506-b1bc-bc5f6dcb7ebc tempest-InstanceUsageAuditLogNegativeTestJSON-818931843 tempest-InstanceUsageAuditLogNegativeTestJSON-818931843-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:17:48.455189 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-522219b2-e2d2-4506-b1bc-bc5f6dcb7ebc tempest-InstanceUsageAuditLogNegativeTestJSON-818931843 tempest-InstanceUsageAuditLogNegativeTestJSON-818931843-project-admin] 10.222.0.52 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.219807 Oct 19 03:17:48.456954 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 856/1640] 10.222.0.52 () {58 vars in 1224 bytes} [Wed Oct 19 03:17:48 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 222 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 19 03:17:48.464980 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-7baf3675-7d01-458e-b512-e186c3c4903f tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28072a54d5934ea28e7d3205841c0852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c12a432bbd43bd8f70ba6e941c28a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:48.474500 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7baf3675-7d01-458e-b512-e186c3c4903f tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] 10.222.0.52 "GET /compute/v2.1/servers/90f71ec9-e698-4159-9458-2099c1fbfaf3" status: 200 len: 1507 microversion: 2.1 time: 0.217831 Oct 19 03:17:48.475191 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 785/1641] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:48 2022] GET /compute/v2.1/servers/90f71ec9-e698-4159-9458-2099c1fbfaf3 => generated 1507 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:17:48.571608 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7627f67b-202c-40b3-9d28-727746313b01 tempest-InstanceUsageAuditLogNegativeTestJSON-1081101980 tempest-InstanceUsageAuditLogNegativeTestJSON-1081101980-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:48.573562 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7627f67b-202c-40b3-9d28-727746313b01 tempest-InstanceUsageAuditLogNegativeTestJSON-1081101980 tempest-InstanceUsageAuditLogNegativeTestJSON-1081101980-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': 'b86b899b3c58476d9c38a47addf5739e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b27e9d49984e1d9db507d2e15b34d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:48.575462 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7627f67b-202c-40b3-9d28-727746313b01 tempest-InstanceUsageAuditLogNegativeTestJSON-1081101980 tempest-InstanceUsageAuditLogNegativeTestJSON-1081101980-project] Request method failure captured: Oct 19 03:17:48.575462 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Oct 19 03:17:48.575462 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:17:48.575462 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:17:48.575462 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:17:48.575462 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:17:48.575462 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:17:48.575462 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:17:48.575462 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:17:48.575462 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:17:48.575462 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2xb0qqPa0sSKHm5fCMwnBMi5RGeMHIGYtGrpxVPvyK7xwZxrtWiHW-O-_aHFDDxsjY6EE56UOd8BtUWyu_3Ve9gAf2E97aWJUsM1zy_HNUuY7ys2S3Q3bv5SSKCDOhA3WIeClXR3n-HTw41ly62H7ubeHvuuNjUKfDaOWzZxIz0R-g Oct 19 03:17:48.575462 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:17:48.575462 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:17:48.575462 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:17:48.575462 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:17:48.575462 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:17:48.575462 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:17:48.575462 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: e4b27e9d49984e1d9db507d2e15b34d5 Oct 19 03:17:48.575462 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1081101980 Oct 19 03:17:48.575462 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:17:48.575462 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:17:48.576965 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e4b27e9d49984e1d9db507d2e15b34d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e4b27e9d49984e1d9db507d2e15b34d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e4b27e9d49984e1d9db507d2e15b34d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e4b27e9d49984e1d9db507d2e15b34d5", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:17:48.576965 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1081101980 Oct 19 03:17:48.576965 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: e4b27e9d49984e1d9db507d2e15b34d5 Oct 19 03:17:48.576965 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1081101980 Oct 19 03:17:48.576965 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1081101980-project Oct 19 03:17:48.576965 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:17:48.576965 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:17:48.576965 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: b86b899b3c58476d9c38a47addf5739e Oct 19 03:17:48.576965 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1081101980-project Oct 19 03:17:48.576965 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:17:48.585595 n-d-861333-8 devstack@n-api.service[121135]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 19 03:17:48.585595 n-d-861333-8 devstack@n-api.service[121135]: action_args: {} Oct 19 03:17:48.585595 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:17:48.585595 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:17:48.585595 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:17:48.585595 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:17:48.585595 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:17:48.585595 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:17:48.585595 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:17:48.585595 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:17:48.585595 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Oct 19 03:17:48.585595 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Oct 19 03:17:48.585595 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 19 03:17:48.585595 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 19 03:17:48.585595 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 19 03:17:48.585595 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 19 03:17:48.585595 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 03:17:48.585595 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 03:17:48.585595 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 03:17:48.585595 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 03:17:48.587740 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 19 03:17:48.587740 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 19 03:17:48.587740 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 19 03:17:48.587740 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 19 03:17:48.587740 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 19 03:17:48.587740 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 19 03:17:48.587740 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 19 03:17:48.587740 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:17:48.587740 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:17:48.587740 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:17:48.587740 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:17:48.587740 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:17:48.587740 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:17:48.587740 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 19 03:17:48.587740 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 19 03:17:48.587740 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 19 03:17:48.587740 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:17:48.589043 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7627f67b-202c-40b3-9d28-727746313b01 tempest-InstanceUsageAuditLogNegativeTestJSON-1081101980 tempest-InstanceUsageAuditLogNegativeTestJSON-1081101980-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:17:48.589043 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7627f67b-202c-40b3-9d28-727746313b01 tempest-InstanceUsageAuditLogNegativeTestJSON-1081101980 tempest-InstanceUsageAuditLogNegativeTestJSON-1081101980-project] 10.222.0.52 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.113811 Oct 19 03:17:48.589043 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 857/1642] 10.222.0.52 () {58 vars in 1185 bytes} [Wed Oct 19 03:17:48 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 115 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:17:48.589798 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6db0a343-c4cf-4667-adb6-ea03a938a3a3 tempest-InstanceUsageAuditLogNegativeTestJSON-1081101980 tempest-InstanceUsageAuditLogNegativeTestJSON-1081101980-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:48.589798 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-6db0a343-c4cf-4667-adb6-ea03a938a3a3 tempest-InstanceUsageAuditLogNegativeTestJSON-1081101980 tempest-InstanceUsageAuditLogNegativeTestJSON-1081101980-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': 'b86b899b3c58476d9c38a47addf5739e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b27e9d49984e1d9db507d2e15b34d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:48.590884 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6db0a343-c4cf-4667-adb6-ea03a938a3a3 tempest-InstanceUsageAuditLogNegativeTestJSON-1081101980 tempest-InstanceUsageAuditLogNegativeTestJSON-1081101980-project] Request method failure captured: Oct 19 03:17:48.590884 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-10-19%2003:17:48 HTTP/1.1 Oct 19 03:17:48.590884 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:17:48.590884 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:17:48.590884 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:17:48.590884 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:17:48.590884 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:17:48.590884 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:17:48.590884 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:17:48.590884 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:17:48.590884 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT2xb0qqPa0sSKHm5fCMwnBMi5RGeMHIGYtGrpxVPvyK7xwZxrtWiHW-O-_aHFDDxsjY6EE56UOd8BtUWyu_3Ve9gAf2E97aWJUsM1zy_HNUuY7ys2S3Q3bv5SSKCDOhA3WIeClXR3n-HTw41ly62H7ubeHvuuNjUKfDaOWzZxIz0R-g Oct 19 03:17:48.590884 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:17:48.590884 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:17:48.590884 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:17:48.590884 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:17:48.590884 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:17:48.590884 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:17:48.590884 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: e4b27e9d49984e1d9db507d2e15b34d5 Oct 19 03:17:48.590884 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1081101980 Oct 19 03:17:48.590884 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:17:48.590884 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:17:48.592319 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e4b27e9d49984e1d9db507d2e15b34d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e4b27e9d49984e1d9db507d2e15b34d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e4b27e9d49984e1d9db507d2e15b34d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e4b27e9d49984e1d9db507d2e15b34d5", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:17:48.592319 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1081101980 Oct 19 03:17:48.592319 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: e4b27e9d49984e1d9db507d2e15b34d5 Oct 19 03:17:48.592319 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1081101980 Oct 19 03:17:48.592319 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1081101980-project Oct 19 03:17:48.592319 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:17:48.592319 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:17:48.592319 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: b86b899b3c58476d9c38a47addf5739e Oct 19 03:17:48.592319 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1081101980-project Oct 19 03:17:48.592319 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:17:48.592957 n-d-861333-8 devstack@n-api.service[121134]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 19 03:17:48.592957 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '2022-10-19 03:17:48'} Oct 19 03:17:48.592957 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:17:48.592957 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:17:48.592957 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:17:48.592957 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:17:48.592957 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:17:48.592957 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:17:48.592957 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:17:48.592957 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:17:48.592957 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Oct 19 03:17:48.592957 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Oct 19 03:17:48.592957 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 19 03:17:48.592957 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 19 03:17:48.592957 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 19 03:17:48.592957 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 19 03:17:48.592957 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 03:17:48.592957 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 03:17:48.592957 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 03:17:48.592957 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 03:17:48.594520 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 19 03:17:48.594520 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 19 03:17:48.594520 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 19 03:17:48.594520 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 19 03:17:48.594520 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 19 03:17:48.594520 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 19 03:17:48.594520 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 19 03:17:48.594520 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:17:48.594520 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:17:48.594520 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:17:48.594520 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:17:48.594520 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:17:48.594520 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:17:48.594520 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 19 03:17:48.594520 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 19 03:17:48.594520 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 19 03:17:48.594520 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:17:48.596087 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6db0a343-c4cf-4667-adb6-ea03a938a3a3 tempest-InstanceUsageAuditLogNegativeTestJSON-1081101980 tempest-InstanceUsageAuditLogNegativeTestJSON-1081101980-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:17:48.596087 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6db0a343-c4cf-4667-adb6-ea03a938a3a3 tempest-InstanceUsageAuditLogNegativeTestJSON-1081101980 tempest-InstanceUsageAuditLogNegativeTestJSON-1081101980-project] 10.222.0.52 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-19 03:17:48" status: 403 len: 128 microversion: 2.1 time: 0.010046 Oct 19 03:17:48.596087 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 786/1643] 10.222.0.52 () {58 vars in 1251 bytes} [Wed Oct 19 03:17:48 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-19%2003%3A17%3A48 => generated 128 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 19 03:17:48.751010 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-a2af5fb7-5410-4ade-9562-c2dd61528bc1 req-48fc48d6-c6d3-481f-a62a-895ebe79e009 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84774cfc-79b4-42db-acfd-c4daac86d196", "tag": "349ffeb3-81a2-44f2-9775-65ddf0c3a896"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:17:48.769623 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-a2af5fb7-5410-4ade-9562-c2dd61528bc1 req-48fc48d6-c6d3-481f-a62a-895ebe79e009 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:48.772189 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-a2af5fb7-5410-4ade-9562-c2dd61528bc1 req-48fc48d6-c6d3-481f-a62a-895ebe79e009 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:48.772189 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-a2af5fb7-5410-4ade-9562-c2dd61528bc1 req-48fc48d6-c6d3-481f-a62a-895ebe79e009 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:48.783018 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-a2af5fb7-5410-4ade-9562-c2dd61528bc1 req-48fc48d6-c6d3-481f-a62a-895ebe79e009 service nova] Creating event network-changed:349ffeb3-81a2-44f2-9775-65ddf0c3a896 for instance 84774cfc-79b4-42db-acfd-c4daac86d196 on n-h2-861333-8 Oct 19 03:17:48.790069 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [req-a2af5fb7-5410-4ade-9562-c2dd61528bc1 req-48fc48d6-c6d3-481f-a62a-895ebe79e009 service nova] Instance 84774cfc-79b4-42db-acfd-c4daac86d196 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-861333-8', 'n-h1-861333-8'} {{(pid=121135) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 03:17:48.805021 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-a2af5fb7-5410-4ade-9562-c2dd61528bc1 req-48fc48d6-c6d3-481f-a62a-895ebe79e009 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064602 Oct 19 03:17:48.806404 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 858/1644] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:17:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:17:48.896952 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a85a6e3c-203c-464e-801f-ff715a5cd794 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:48.896952 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a85a6e3c-203c-464e-801f-ff715a5cd794 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 8cb9ad03-e7f9-4d7f-8711-1e2f478b0d17] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:48.903536 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a85a6e3c-203c-464e-801f-ff715a5cd794 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:48.904022 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a85a6e3c-203c-464e-801f-ff715a5cd794 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:48.904456 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a85a6e3c-203c-464e-801f-ff715a5cd794 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:48.905157 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a85a6e3c-203c-464e-801f-ff715a5cd794 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:48.905660 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a85a6e3c-203c-464e-801f-ff715a5cd794 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:48.906086 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a85a6e3c-203c-464e-801f-ff715a5cd794 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:48.919187 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-a85a6e3c-203c-464e-801f-ff715a5cd794 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] HTTP exception thrown: Instance 8cb9ad03-e7f9-4d7f-8711-1e2f478b0d17 could not be found. Oct 19 03:17:48.920768 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a85a6e3c-203c-464e-801f-ff715a5cd794 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Request method failure captured: Oct 19 03:17:48.920768 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/8cb9ad03-e7f9-4d7f-8711-1e2f478b0d17 HTTP/1.1 Oct 19 03:17:48.920768 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:17:48.920768 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:17:48.920768 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:17:48.920768 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:17:48.920768 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:17:48.920768 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:17:48.920768 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:17:48.920768 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:17:48.920768 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT2uIr9BvDBnYtOjXORgJ4Qqr6WVLdD9ouG3lYgYuVISlRlRaYBhavBD01rVROkCZkxR9XYWXexaYSEKOFD-WoO2VI67daMYqFdJq0nC95Vi4iLXZzLBKOlmG6HfkRin4f0jmmyKXjHfeDMSqeFm88QUaNhEk881S74x65hVUOW0qpCY Oct 19 03:17:48.920768 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:17:48.920768 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:17:48.920768 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:17:48.920768 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:17:48.920768 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:17:48.920768 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:17:48.920768 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 5d909fe7763841d5b452738112b656d3 Oct 19 03:17:48.920768 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ServersOnMultiNodesTest-1737645722 Oct 19 03:17:48.920768 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:17:48.920768 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:17:48.926028 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5d909fe7763841d5b452738112b656d3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5d909fe7763841d5b452738112b656d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5d909fe7763841d5b452738112b656d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5d909fe7763841d5b452738112b656d3", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:17:48.926028 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ServersOnMultiNodesTest-1737645722 Oct 19 03:17:48.926028 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 5d909fe7763841d5b452738112b656d3 Oct 19 03:17:48.926028 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1737645722 Oct 19 03:17:48.926028 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ServersOnMultiNodesTest-1737645722-project Oct 19 03:17:48.926028 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:17:48.926028 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:17:48.926028 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 3e4d3ddb3a324d9da51c13701e318955 Oct 19 03:17:48.926028 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ServersOnMultiNodesTest-1737645722-project Oct 19 03:17:48.926028 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:17:48.926028 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance 8cb9ad03-e7f9-4d7f-8711-1e2f478b0d17 could not be found. Oct 19 03:17:48.926028 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '8cb9ad03-e7f9-4d7f-8711-1e2f478b0d17'} Oct 19 03:17:48.926969 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:17:48.926969 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:17:48.926969 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:17:48.926969 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:17:48.926969 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:17:48.926969 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:17:48.926969 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:17:48.926969 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:17:48.926969 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:17:48.926969 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:17:48.926969 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cb9ad03-e7f9-4d7f-8711-1e2f478b0d17 could not be found. Oct 19 03:17:48.926969 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:17:48.926969 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:17:48.926969 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:17:48.926969 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:17:48.926969 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:17:48.926969 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:17:48.926969 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:17:48.926969 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:17:48.926969 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:17:48.928513 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:17:48.928513 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:17:48.928513 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:17:48.928513 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:17:48.928513 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:17:48.928513 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:17:48.928513 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:17:48.928513 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cb9ad03-e7f9-4d7f-8711-1e2f478b0d17 could not be found. Oct 19 03:17:48.928513 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:17:48.928513 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:17:48.928513 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:17:48.928513 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:17:48.928513 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:17:48.928513 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:17:48.928513 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:17:48.928513 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:17:48.928513 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cb9ad03-e7f9-4d7f-8711-1e2f478b0d17 could not be found. Oct 19 03:17:48.928513 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:17:48.929923 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a85a6e3c-203c-464e-801f-ff715a5cd794 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Returning 404 to user: Instance 8cb9ad03-e7f9-4d7f-8711-1e2f478b0d17 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:17:48.929923 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a85a6e3c-203c-464e-801f-ff715a5cd794 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/8cb9ad03-e7f9-4d7f-8711-1e2f478b0d17" status: 404 len: 111 microversion: 2.1 time: 0.033774 Oct 19 03:17:48.929923 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 787/1645] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:48 2022] GET /compute/v2.1/servers/8cb9ad03-e7f9-4d7f-8711-1e2f478b0d17 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:17:48.935940 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-db29323f-4f26-4493-a226-b42baa1316cb tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:48.936657 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-db29323f-4f26-4493-a226-b42baa1316cb tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 393853e1-5f67-4c6b-972d-9f76de928599] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:48.942695 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-db29323f-4f26-4493-a226-b42baa1316cb tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:48.943268 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-db29323f-4f26-4493-a226-b42baa1316cb tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:48.943903 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-db29323f-4f26-4493-a226-b42baa1316cb tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:48.944748 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-db29323f-4f26-4493-a226-b42baa1316cb tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:48.945309 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-db29323f-4f26-4493-a226-b42baa1316cb tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:48.946799 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-db29323f-4f26-4493-a226-b42baa1316cb tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:48.981614 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-db29323f-4f26-4493-a226-b42baa1316cb tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:48.982295 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-db29323f-4f26-4493-a226-b42baa1316cb tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:48.982904 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-db29323f-4f26-4493-a226-b42baa1316cb tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:48.985547 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-db29323f-4f26-4493-a226-b42baa1316cb tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lazy-loading 'fault' on Instance uuid 393853e1-5f67-4c6b-972d-9f76de928599 {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:17:48.993651 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-912d66ef-f778-4341-8ca1-8e7860117e85 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:48.994578 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-912d66ef-f778-4341-8ca1-8e7860117e85 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 84774cfc-79b4-42db-acfd-c4daac86d196] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:49.000726 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-912d66ef-f778-4341-8ca1-8e7860117e85 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:49.007916 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-912d66ef-f778-4341-8ca1-8e7860117e85 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:49.008943 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-912d66ef-f778-4341-8ca1-8e7860117e85 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:49.009760 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-912d66ef-f778-4341-8ca1-8e7860117e85 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:49.010291 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-912d66ef-f778-4341-8ca1-8e7860117e85 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:49.010790 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-912d66ef-f778-4341-8ca1-8e7860117e85 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:49.059281 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-db29323f-4f26-4493-a226-b42baa1316cb tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:49.067947 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-db29323f-4f26-4493-a226-b42baa1316cb tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/393853e1-5f67-4c6b-972d-9f76de928599" status: 200 len: 1307 microversion: 2.1 time: 0.136200 Oct 19 03:17:49.069157 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 859/1646] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:48 2022] GET /compute/v2.1/servers/393853e1-5f67-4c6b-972d-9f76de928599 => generated 1307 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:49.209281 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-912d66ef-f778-4341-8ca1-8e7860117e85 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:49.219166 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9360d4df-c3c9-4bb3-9174-4777945360d7 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:49.221910 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9360d4df-c3c9-4bb3-9174-4777945360d7 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] [instance: 64d3b78b-7953-40fc-ab53-b35f9d105901] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:49.222141 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-912d66ef-f778-4341-8ca1-8e7860117e85 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196" status: 200 len: 1472 microversion: 2.1 time: 0.233418 Oct 19 03:17:49.222141 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 788/1647] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:48 2022] GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196 => generated 1472 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:17:49.226182 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9360d4df-c3c9-4bb3-9174-4777945360d7 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:49.226671 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9360d4df-c3c9-4bb3-9174-4777945360d7 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:49.227108 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9360d4df-c3c9-4bb3-9174-4777945360d7 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:49.228017 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9360d4df-c3c9-4bb3-9174-4777945360d7 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:49.228476 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9360d4df-c3c9-4bb3-9174-4777945360d7 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:49.228901 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9360d4df-c3c9-4bb3-9174-4777945360d7 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:49.454757 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-9360d4df-c3c9-4bb3-9174-4777945360d7 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c35b71372843d69f9a6c6be04b154f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcd49d68a3947249016cc5dbe910efc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:49.469140 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9360d4df-c3c9-4bb3-9174-4777945360d7 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] 10.222.0.52 "GET /compute/v2.1/servers/64d3b78b-7953-40fc-ab53-b35f9d105901" status: 200 len: 1334 microversion: 2.1 time: 0.254042 Oct 19 03:17:49.485463 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 860/1648] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:49 2022] GET /compute/v2.1/servers/64d3b78b-7953-40fc-ab53-b35f9d105901 => generated 1334 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:17:50.092477 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1dd2e901-f2e7-4fb7-9071-8e6e5cb3468e tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:50.093415 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1dd2e901-f2e7-4fb7-9071-8e6e5cb3468e tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 393853e1-5f67-4c6b-972d-9f76de928599] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:50.101355 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1dd2e901-f2e7-4fb7-9071-8e6e5cb3468e tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:50.101884 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1dd2e901-f2e7-4fb7-9071-8e6e5cb3468e tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:50.102329 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1dd2e901-f2e7-4fb7-9071-8e6e5cb3468e tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:50.103232 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1dd2e901-f2e7-4fb7-9071-8e6e5cb3468e tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:50.103945 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1dd2e901-f2e7-4fb7-9071-8e6e5cb3468e tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:50.104380 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1dd2e901-f2e7-4fb7-9071-8e6e5cb3468e tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:50.141278 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1dd2e901-f2e7-4fb7-9071-8e6e5cb3468e tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:50.142075 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1dd2e901-f2e7-4fb7-9071-8e6e5cb3468e tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:50.142842 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1dd2e901-f2e7-4fb7-9071-8e6e5cb3468e tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:50.143455 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-1dd2e901-f2e7-4fb7-9071-8e6e5cb3468e tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lazy-loading 'fault' on Instance uuid 393853e1-5f67-4c6b-972d-9f76de928599 {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:17:50.226108 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-1dd2e901-f2e7-4fb7-9071-8e6e5cb3468e tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:50.236185 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1dd2e901-f2e7-4fb7-9071-8e6e5cb3468e tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/393853e1-5f67-4c6b-972d-9f76de928599" status: 200 len: 1307 microversion: 2.1 time: 0.147919 Oct 19 03:17:50.244535 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-891483aa-86b0-422e-aef3-d537f2356731 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:50.245417 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-891483aa-86b0-422e-aef3-d537f2356731 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 84774cfc-79b4-42db-acfd-c4daac86d196] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:50.250892 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 789/1649] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:50 2022] GET /compute/v2.1/servers/393853e1-5f67-4c6b-972d-9f76de928599 => generated 1307 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:50.255485 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-891483aa-86b0-422e-aef3-d537f2356731 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:50.266099 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-891483aa-86b0-422e-aef3-d537f2356731 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:50.266099 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-891483aa-86b0-422e-aef3-d537f2356731 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:50.266099 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-891483aa-86b0-422e-aef3-d537f2356731 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:50.266099 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-891483aa-86b0-422e-aef3-d537f2356731 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:50.266478 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-891483aa-86b0-422e-aef3-d537f2356731 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:50.495070 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a2cc0a2d-c99e-4ca7-900e-86866079ad96 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:50.495840 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a2cc0a2d-c99e-4ca7-900e-86866079ad96 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] [instance: 64d3b78b-7953-40fc-ab53-b35f9d105901] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:50.510245 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a2cc0a2d-c99e-4ca7-900e-86866079ad96 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:50.510996 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a2cc0a2d-c99e-4ca7-900e-86866079ad96 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:50.511621 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a2cc0a2d-c99e-4ca7-900e-86866079ad96 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:50.512536 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a2cc0a2d-c99e-4ca7-900e-86866079ad96 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:50.513198 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a2cc0a2d-c99e-4ca7-900e-86866079ad96 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:50.513917 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a2cc0a2d-c99e-4ca7-900e-86866079ad96 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:50.534503 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-891483aa-86b0-422e-aef3-d537f2356731 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:50.556619 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-891483aa-86b0-422e-aef3-d537f2356731 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196" status: 200 len: 1472 microversion: 2.1 time: 0.313649 Oct 19 03:17:50.560027 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 861/1650] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:50 2022] GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196 => generated 1472 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:50.753961 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a2cc0a2d-c99e-4ca7-900e-86866079ad96 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c35b71372843d69f9a6c6be04b154f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcd49d68a3947249016cc5dbe910efc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:50.763059 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a2cc0a2d-c99e-4ca7-900e-86866079ad96 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] 10.222.0.52 "GET /compute/v2.1/servers/64d3b78b-7953-40fc-ab53-b35f9d105901" status: 200 len: 1334 microversion: 2.1 time: 0.274484 Oct 19 03:17:50.778377 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 790/1651] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:50 2022] GET /compute/v2.1/servers/64d3b78b-7953-40fc-ab53-b35f9d105901 => generated 1334 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:17:51.263607 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f2fb0aa8-fb3f-42a3-9c42-3f4c2085a9a4 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:51.264478 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f2fb0aa8-fb3f-42a3-9c42-3f4c2085a9a4 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 393853e1-5f67-4c6b-972d-9f76de928599] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:51.270514 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f2fb0aa8-fb3f-42a3-9c42-3f4c2085a9a4 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:51.273017 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f2fb0aa8-fb3f-42a3-9c42-3f4c2085a9a4 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:51.273017 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f2fb0aa8-fb3f-42a3-9c42-3f4c2085a9a4 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:51.273017 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f2fb0aa8-fb3f-42a3-9c42-3f4c2085a9a4 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:51.273017 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f2fb0aa8-fb3f-42a3-9c42-3f4c2085a9a4 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:51.273441 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f2fb0aa8-fb3f-42a3-9c42-3f4c2085a9a4 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:51.286806 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-f2fb0aa8-fb3f-42a3-9c42-3f4c2085a9a4 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] HTTP exception thrown: Instance 393853e1-5f67-4c6b-972d-9f76de928599 could not be found. Oct 19 03:17:51.288440 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f2fb0aa8-fb3f-42a3-9c42-3f4c2085a9a4 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Request method failure captured: Oct 19 03:17:51.288440 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/393853e1-5f67-4c6b-972d-9f76de928599 HTTP/1.1 Oct 19 03:17:51.288440 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:17:51.288440 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:17:51.288440 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:17:51.288440 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:17:51.288440 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:17:51.288440 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:17:51.288440 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:17:51.288440 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:17:51.288440 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2uIr9BvDBnYtOjXORgJ4Qqr6WVLdD9ouG3lYgYuVISlRlRaYBhavBD01rVROkCZkxR9XYWXexaYSEKOFD-WoO2VI67daMYqFdJq0nC95Vi4iLXZzLBKOlmG6HfkRin4f0jmmyKXjHfeDMSqeFm88QUaNhEk881S74x65hVUOW0qpCY Oct 19 03:17:51.288440 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:17:51.288440 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:17:51.288440 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:17:51.288440 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:17:51.288440 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:17:51.288440 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:17:51.288440 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 5d909fe7763841d5b452738112b656d3 Oct 19 03:17:51.288440 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ServersOnMultiNodesTest-1737645722 Oct 19 03:17:51.288440 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:17:51.288440 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:17:51.290828 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5d909fe7763841d5b452738112b656d3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5d909fe7763841d5b452738112b656d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5d909fe7763841d5b452738112b656d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5d909fe7763841d5b452738112b656d3", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:17:51.290828 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ServersOnMultiNodesTest-1737645722 Oct 19 03:17:51.290828 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 5d909fe7763841d5b452738112b656d3 Oct 19 03:17:51.290828 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1737645722 Oct 19 03:17:51.290828 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ServersOnMultiNodesTest-1737645722-project Oct 19 03:17:51.290828 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:17:51.290828 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:17:51.290828 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 3e4d3ddb3a324d9da51c13701e318955 Oct 19 03:17:51.290828 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ServersOnMultiNodesTest-1737645722-project Oct 19 03:17:51.290828 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:17:51.290828 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance 393853e1-5f67-4c6b-972d-9f76de928599 could not be found. Oct 19 03:17:51.290828 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '393853e1-5f67-4c6b-972d-9f76de928599'} Oct 19 03:17:51.291607 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:17:51.291607 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:17:51.291607 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:17:51.291607 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:17:51.291607 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:17:51.291607 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:17:51.291607 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:17:51.291607 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:17:51.291607 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:17:51.291607 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:17:51.291607 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 393853e1-5f67-4c6b-972d-9f76de928599 could not be found. Oct 19 03:17:51.291607 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:17:51.291607 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:17:51.291607 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:17:51.291607 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:17:51.291607 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:17:51.291607 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:17:51.291607 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:17:51.291607 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:17:51.291607 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:17:51.292862 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:17:51.292862 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:17:51.292862 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:17:51.292862 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:17:51.292862 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:17:51.292862 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:17:51.292862 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:17:51.292862 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 393853e1-5f67-4c6b-972d-9f76de928599 could not be found. Oct 19 03:17:51.292862 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:17:51.292862 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:17:51.292862 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:17:51.292862 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:17:51.292862 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:17:51.292862 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:17:51.292862 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:17:51.292862 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:17:51.292862 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 393853e1-5f67-4c6b-972d-9f76de928599 could not be found. Oct 19 03:17:51.292862 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:17:51.294017 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f2fb0aa8-fb3f-42a3-9c42-3f4c2085a9a4 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Returning 404 to user: Instance 393853e1-5f67-4c6b-972d-9f76de928599 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:17:51.294017 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f2fb0aa8-fb3f-42a3-9c42-3f4c2085a9a4 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/393853e1-5f67-4c6b-972d-9f76de928599" status: 404 len: 111 microversion: 2.1 time: 0.031449 Oct 19 03:17:51.294017 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 862/1652] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:51 2022] GET /compute/v2.1/servers/393853e1-5f67-4c6b-972d-9f76de928599 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:17:51.299565 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-54fec9c6-6d1f-45b1-aaa3-e580c19de04c tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:51.392964 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-54fec9c6-6d1f-45b1-aaa3-e580c19de04c tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "DELETE /compute/v2.1/os-server-groups/6be7c922-3b62-4fd1-9592-afaa18651367" status: 204 len: 0 microversion: 2.1 time: 0.097500 Oct 19 03:17:51.393723 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 791/1653] 10.222.0.52 () {58 vars in 1266 bytes} [Wed Oct 19 03:17:51 2022] DELETE /compute/v2.1/os-server-groups/6be7c922-3b62-4fd1-9592-afaa18651367 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:17:51.402093 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ba851144-2cf7-43fe-85b2-2eb76287f4b6 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:51.405435 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ba851144-2cf7-43fe-85b2-2eb76287f4b6 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 2d709051-db69-4ea9-96dc-ffe05e9c9b3a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:51.411298 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ba851144-2cf7-43fe-85b2-2eb76287f4b6 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:51.411820 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ba851144-2cf7-43fe-85b2-2eb76287f4b6 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:51.412248 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ba851144-2cf7-43fe-85b2-2eb76287f4b6 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:51.412944 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ba851144-2cf7-43fe-85b2-2eb76287f4b6 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:51.413594 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ba851144-2cf7-43fe-85b2-2eb76287f4b6 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:51.414023 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ba851144-2cf7-43fe-85b2-2eb76287f4b6 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:51.459353 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ba851144-2cf7-43fe-85b2-2eb76287f4b6 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 2d709051-db69-4ea9-96dc-ffe05e9c9b3a] Going to try to terminate instance {{(pid=121135) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:17:51.581354 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-fd4896a8-0ba9-4759-a742-b3de1cf71533 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:51.582203 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-fd4896a8-0ba9-4759-a742-b3de1cf71533 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 84774cfc-79b4-42db-acfd-c4daac86d196] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:51.593423 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fd4896a8-0ba9-4759-a742-b3de1cf71533 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:51.596222 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fd4896a8-0ba9-4759-a742-b3de1cf71533 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:51.596222 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fd4896a8-0ba9-4759-a742-b3de1cf71533 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:51.596222 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fd4896a8-0ba9-4759-a742-b3de1cf71533 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:51.596222 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fd4896a8-0ba9-4759-a742-b3de1cf71533 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:51.596698 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fd4896a8-0ba9-4759-a742-b3de1cf71533 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:51.708544 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=95,nova_api:SAVEPOINT=1,nova_api:RELEASE=1,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:17:51.750759 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-fd4896a8-0ba9-4759-a742-b3de1cf71533 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:51.759666 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-fd4896a8-0ba9-4759-a742-b3de1cf71533 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196" status: 200 len: 1469 microversion: 2.1 time: 0.183436 Oct 19 03:17:51.781745 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 792/1654] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:51 2022] GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196 => generated 1469 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:51.820669 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ba851144-2cf7-43fe-85b2-2eb76287f4b6 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "DELETE /compute/v2.1/servers/2d709051-db69-4ea9-96dc-ffe05e9c9b3a" status: 204 len: 0 microversion: 2.1 time: 0.422641 Oct 19 03:17:51.821330 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 863/1655] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:17:51 2022] DELETE /compute/v2.1/servers/2d709051-db69-4ea9-96dc-ffe05e9c9b3a => generated 0 bytes in 424 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 19 03:17:51.826854 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9637e786-f58d-4bd3-b5e4-ece6b051abfa tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:17:51.827492 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9637e786-f58d-4bd3-b5e4-ece6b051abfa tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 84774cfc-79b4-42db-acfd-c4daac86d196] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:51.833967 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9637e786-f58d-4bd3-b5e4-ece6b051abfa tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:51.834536 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9637e786-f58d-4bd3-b5e4-ece6b051abfa tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:51.834951 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9637e786-f58d-4bd3-b5e4-ece6b051abfa tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:51.835653 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9637e786-f58d-4bd3-b5e4-ece6b051abfa tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:51.836106 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9637e786-f58d-4bd3-b5e4-ece6b051abfa tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:51.836561 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9637e786-f58d-4bd3-b5e4-ece6b051abfa tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:52.051941 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2bd16b9c-5563-4d5e-ab28-0172b876f9d7 tempest-ImagesDeleteNegativeTestJSON-1428883222 tempest-ImagesDeleteNegativeTestJSON-1428883222-project] 10.222.0.52 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.275988 Oct 19 03:17:52.052604 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 793/1656] 10.222.0.52 () {58 vars in 1128 bytes} [Wed Oct 19 03:17:51 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 19 03:17:52.063057 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-589d3a18-e779-4126-bee8-8f2fd0e333d8 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:52.063682 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-589d3a18-e779-4126-bee8-8f2fd0e333d8 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] [instance: 64d3b78b-7953-40fc-ab53-b35f9d105901] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:52.078487 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-589d3a18-e779-4126-bee8-8f2fd0e333d8 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:52.079189 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-589d3a18-e779-4126-bee8-8f2fd0e333d8 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:52.079919 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-589d3a18-e779-4126-bee8-8f2fd0e333d8 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:52.081035 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-589d3a18-e779-4126-bee8-8f2fd0e333d8 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:52.082001 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-589d3a18-e779-4126-bee8-8f2fd0e333d8 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:52.082445 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-589d3a18-e779-4126-bee8-8f2fd0e333d8 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:52.231989 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-589d3a18-e779-4126-bee8-8f2fd0e333d8 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c35b71372843d69f9a6c6be04b154f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcd49d68a3947249016cc5dbe910efc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:52.243723 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-589d3a18-e779-4126-bee8-8f2fd0e333d8 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] 10.222.0.52 "GET /compute/v2.1/servers/64d3b78b-7953-40fc-ab53-b35f9d105901" status: 200 len: 1334 microversion: 2.1 time: 0.188995 Oct 19 03:17:52.244751 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 794/1657] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:52 2022] GET /compute/v2.1/servers/64d3b78b-7953-40fc-ab53-b35f9d105901 => generated 1334 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:52.252798 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4e4b4256-e66f-4452-a457-98a21298e014 tempest-VolumesAdminNegativeTest-1555198755 tempest-VolumesAdminNegativeTest-1555198755-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "5f7b7c1b-a712-45c5-93f1-f991e526fa90"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:17:52.256074 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4e4b4256-e66f-4452-a457-98a21298e014 tempest-VolumesAdminNegativeTest-1555198755 tempest-VolumesAdminNegativeTest-1555198755-project-admin] [instance: 90f71ec9-e698-4159-9458-2099c1fbfaf3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:52.264759 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4e4b4256-e66f-4452-a457-98a21298e014 tempest-VolumesAdminNegativeTest-1555198755 tempest-VolumesAdminNegativeTest-1555198755-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:52.265336 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4e4b4256-e66f-4452-a457-98a21298e014 tempest-VolumesAdminNegativeTest-1555198755 tempest-VolumesAdminNegativeTest-1555198755-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:52.265808 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4e4b4256-e66f-4452-a457-98a21298e014 tempest-VolumesAdminNegativeTest-1555198755 tempest-VolumesAdminNegativeTest-1555198755-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:52.266520 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4e4b4256-e66f-4452-a457-98a21298e014 tempest-VolumesAdminNegativeTest-1555198755 tempest-VolumesAdminNegativeTest-1555198755-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:52.266980 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4e4b4256-e66f-4452-a457-98a21298e014 tempest-VolumesAdminNegativeTest-1555198755 tempest-VolumesAdminNegativeTest-1555198755-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:52.267413 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4e4b4256-e66f-4452-a457-98a21298e014 tempest-VolumesAdminNegativeTest-1555198755 tempest-VolumesAdminNegativeTest-1555198755-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:52.287272 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9637e786-f58d-4bd3-b5e4-ece6b051abfa tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "POST /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196/action" status: 202 len: 0 microversion: 2.1 time: 0.464541 Oct 19 03:17:52.287944 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 864/1658] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:17:51 2022] POST /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196/action => generated 0 bytes in 466 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:17:52.293034 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4ab63c85-ff12-4809-b821-ca79d40506d3 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:52.293781 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4ab63c85-ff12-4809-b821-ca79d40506d3 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 2d709051-db69-4ea9-96dc-ffe05e9c9b3a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:52.300361 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4ab63c85-ff12-4809-b821-ca79d40506d3 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:52.300745 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4ab63c85-ff12-4809-b821-ca79d40506d3 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:52.301253 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4ab63c85-ff12-4809-b821-ca79d40506d3 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:52.302010 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4ab63c85-ff12-4809-b821-ca79d40506d3 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:52.302467 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4ab63c85-ff12-4809-b821-ca79d40506d3 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:52.302926 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4ab63c85-ff12-4809-b821-ca79d40506d3 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:52.324461 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-4e4b4256-e66f-4452-a457-98a21298e014 tempest-VolumesAdminNegativeTest-1555198755 tempest-VolumesAdminNegativeTest-1555198755-project-admin] HTTP exception thrown: Volume 7b8c47c3-d0d1-4595-82b3-193ab557383d could not be found. Oct 19 03:17:52.328619 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4e4b4256-e66f-4452-a457-98a21298e014 tempest-VolumesAdminNegativeTest-1555198755 tempest-VolumesAdminNegativeTest-1555198755-project-admin] Request method failure captured: Oct 19 03:17:52.328619 n-d-861333-8 devstack@n-api.service[121134]: request: PUT /compute/v2.1/servers/90f71ec9-e698-4159-9458-2099c1fbfaf3/os-volume_attachments/7b8c47c3-d0d1-4595-82b3-193ab557383d HTTP/1.1 Oct 19 03:17:52.328619 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:17:52.328619 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:17:52.328619 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:17:52.328619 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 74 Oct 19 03:17:52.328619 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:17:52.328619 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:17:52.328619 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:17:52.328619 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:17:52.328619 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT2ucL7M0II0d3qyRHse5xL-8eSin09x8d0u7cTaLPYmbbiY8finLVOYIB6rGnEe7mf6Xy3_G7R-eIeUEJU-1D6KAVRH93A-DbDGPGXWPQ40Y65KU97F5fHow-sD5UZx8F73Do7oBI6uM0TfMS3TmPxoDmjr08XD9Biwe4yvsHg2Vz_o Oct 19 03:17:52.328619 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:17:52.328619 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:17:52.328619 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:17:52.328619 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:17:52.328619 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:17:52.328619 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:17:52.328619 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 0d83724498b541ddaaec01ce9a4a69f1 Oct 19 03:17:52.328619 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-VolumesAdminNegativeTest-1555198755 Oct 19 03:17:52.328619 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member,admin Oct 19 03:17:52.328619 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member,admin Oct 19 03:17:52.330082 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/0d83724498b541ddaaec01ce9a4a69f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0d83724498b541ddaaec01ce9a4a69f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0d83724498b541ddaaec01ce9a4a69f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_0d83724498b541ddaaec01ce9a4a69f1", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:17:52.330082 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-VolumesAdminNegativeTest-1555198755 Oct 19 03:17:52.330082 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 0d83724498b541ddaaec01ce9a4a69f1 Oct 19 03:17:52.330082 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1555198755 Oct 19 03:17:52.330082 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-VolumesAdminNegativeTest-1555198755-project-admin Oct 19 03:17:52.330082 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:17:52.330082 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:17:52.330082 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 27fe14951b8e44ada99e0347c8d9d318 Oct 19 03:17:52.330082 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-VolumesAdminNegativeTest-1555198755-project-admin Oct 19 03:17:52.330082 n-d-861333-8 devstack@n-api.service[121134]: Oct 19 03:17:52.330082 n-d-861333-8 devstack@n-api.service[121134]: {"volumeAttachment": {"volumeId": "5f7b7c1b-a712-45c5-93f1-f991e526fa90"}} Oct 19 03:17:52.330082 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:17:52.330082 n-d-861333-8 devstack@n-api.service[121134]: exception: Volume 7b8c47c3-d0d1-4595-82b3-193ab557383d could not be found. Oct 19 03:17:52.330933 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'server_id': '90f71ec9-e698-4159-9458-2099c1fbfaf3', 'id': '7b8c47c3-d0d1-4595-82b3-193ab557383d', 'body': {'volumeAttachment': {'volumeId': '5f7b7c1b-a712-45c5-93f1-f991e526fa90'}}} Oct 19 03:17:52.330933 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:17:52.330933 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:17:52.330933 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 03:17:52.330933 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 03:17:52.330933 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 19 03:17:52.330933 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 19 03:17:52.330933 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 19 03:17:52.330933 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 19 03:17:52.330933 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 19 03:17:52.330933 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 19 03:17:52.330933 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 19 03:17:52.330933 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 19 03:17:52.330933 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 03:17:52.330933 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 03:17:52.330933 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 03:17:52.330933 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 03:17:52.332094 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7b8c47c3-d0d1-4595-82b3-193ab557383d could not be found. (HTTP 404) (Request-ID: req-3e0013ad-b397-4c44-8344-6d3f20865530) Oct 19 03:17:52.332094 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:17:52.332094 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:17:52.332094 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:17:52.332094 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:17:52.332094 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Oct 19 03:17:52.332094 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Oct 19 03:17:52.332094 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 19 03:17:52.332094 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 19 03:17:52.332094 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 19 03:17:52.332094 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 19 03:17:52.332094 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 19 03:17:52.332094 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 19 03:17:52.332094 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 03:17:52.332094 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 03:17:52.332094 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 19 03:17:52.332094 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 19 03:17:52.332094 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 19 03:17:52.332094 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 19 03:17:52.333277 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 19 03:17:52.333277 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 19 03:17:52.333277 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 19 03:17:52.333277 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 19 03:17:52.333277 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 03:17:52.333277 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 03:17:52.333277 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 03:17:52.333277 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 03:17:52.333277 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7b8c47c3-d0d1-4595-82b3-193ab557383d could not be found. Oct 19 03:17:52.333277 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:17:52.333277 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:17:52.333277 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:17:52.333277 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:17:52.333277 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:17:52.333277 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:17:52.333277 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:17:52.333277 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:17:52.333277 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:17:52.333277 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:17:52.334457 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:17:52.334457 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:17:52.334457 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:17:52.334457 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:17:52.334457 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 19 03:17:52.334457 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 19 03:17:52.334457 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Oct 19 03:17:52.334457 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:17:52.334457 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7b8c47c3-d0d1-4595-82b3-193ab557383d could not be found. Oct 19 03:17:52.334457 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:17:52.334457 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:17:52.334457 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:17:52.334457 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:17:52.334457 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:17:52.334457 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:17:52.334457 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:17:52.334457 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:17:52.334457 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7b8c47c3-d0d1-4595-82b3-193ab557383d could not be found. Oct 19 03:17:52.334457 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:17:52.335809 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4e4b4256-e66f-4452-a457-98a21298e014 tempest-VolumesAdminNegativeTest-1555198755 tempest-VolumesAdminNegativeTest-1555198755-project-admin] Returning 404 to user: Volume 7b8c47c3-d0d1-4595-82b3-193ab557383d could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:17:52.335809 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4e4b4256-e66f-4452-a457-98a21298e014 tempest-VolumesAdminNegativeTest-1555198755 tempest-VolumesAdminNegativeTest-1555198755-project-admin] 10.222.0.52 "PUT /compute/v2.1/servers/90f71ec9-e698-4159-9458-2099c1fbfaf3/os-volume_attachments/7b8c47c3-d0d1-4595-82b3-193ab557383d" status: 404 len: 109 microversion: 2.1 time: 0.084228 Oct 19 03:17:52.335809 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 795/1659] 10.222.0.52 () {60 vars in 1433 bytes} [Wed Oct 19 03:17:52 2022] PUT /compute/v2.1/servers/90f71ec9-e698-4159-9458-2099c1fbfaf3/os-volume_attachments/7b8c47c3-d0d1-4595-82b3-193ab557383d => generated 109 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:17:52.422555 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-5bf6a9d3-9353-4e7d-896c-ab166394d83b req-9cbb6b46-f8bb-4907-ace2-6f9abfdca701 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64d3b78b-7953-40fc-ab53-b35f9d105901", "name": "network-vif-plugged", "status": "completed", "tag": "9eff7474-efea-4e0c-ad56-d68e07689737"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:17:52.438505 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-5bf6a9d3-9353-4e7d-896c-ab166394d83b req-9cbb6b46-f8bb-4907-ace2-6f9abfdca701 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:52.439309 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-5bf6a9d3-9353-4e7d-896c-ab166394d83b req-9cbb6b46-f8bb-4907-ace2-6f9abfdca701 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:52.439736 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-5bf6a9d3-9353-4e7d-896c-ab166394d83b req-9cbb6b46-f8bb-4907-ace2-6f9abfdca701 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:52.456613 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-5bf6a9d3-9353-4e7d-896c-ab166394d83b req-9cbb6b46-f8bb-4907-ace2-6f9abfdca701 service nova] Creating event network-vif-plugged:9eff7474-efea-4e0c-ad56-d68e07689737 for instance 64d3b78b-7953-40fc-ab53-b35f9d105901 on n-h1-861333-8 Oct 19 03:17:52.464922 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-5bf6a9d3-9353-4e7d-896c-ab166394d83b req-9cbb6b46-f8bb-4907-ace2-6f9abfdca701 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130829 Oct 19 03:17:52.465923 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 796/1660] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:17:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:17:52.472662 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8ab93c6e-c71f-4dd3-acd5-213b3d6ecbf5 tempest-ImagesDeleteNegativeTestJSON-1428883222 tempest-ImagesDeleteNegativeTestJSON-1428883222-project] Calling method '.version_select at 0x7fc13500f3a0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:52.486712 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4ab63c85-ff12-4809-b821-ca79d40506d3 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:52.501851 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4ab63c85-ff12-4809-b821-ca79d40506d3 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/2d709051-db69-4ea9-96dc-ffe05e9c9b3a" status: 200 len: 1472 microversion: 2.1 time: 0.211188 Oct 19 03:17:52.502688 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 865/1661] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:52 2022] GET /compute/v2.1/servers/2d709051-db69-4ea9-96dc-ffe05e9c9b3a => generated 1472 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:52.510507 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ec468680-4d73-4448-a7b3-3c2326f81e4c tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:52.511816 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ec468680-4d73-4448-a7b3-3c2326f81e4c tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 84774cfc-79b4-42db-acfd-c4daac86d196] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:52.519225 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ec468680-4d73-4448-a7b3-3c2326f81e4c tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:52.520015 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ec468680-4d73-4448-a7b3-3c2326f81e4c tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:52.520446 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ec468680-4d73-4448-a7b3-3c2326f81e4c tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:52.521230 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ec468680-4d73-4448-a7b3-3c2326f81e4c tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:52.521775 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ec468680-4d73-4448-a7b3-3c2326f81e4c tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:52.522298 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ec468680-4d73-4448-a7b3-3c2326f81e4c tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:52.542119 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-8ab93c6e-c71f-4dd3-acd5-213b3d6ecbf5 tempest-ImagesDeleteNegativeTestJSON-1428883222 tempest-ImagesDeleteNegativeTestJSON-1428883222-project] HTTP exception thrown: Image not found. Oct 19 03:17:52.553886 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8ab93c6e-c71f-4dd3-acd5-213b3d6ecbf5 tempest-ImagesDeleteNegativeTestJSON-1428883222 tempest-ImagesDeleteNegativeTestJSON-1428883222-project] Request method failure captured: Oct 19 03:17:52.553886 n-d-861333-8 devstack@n-api.service[121134]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Oct 19 03:17:52.553886 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:17:52.553886 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:17:52.553886 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:17:52.553886 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:17:52.553886 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:17:52.553886 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:17:52.553886 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:17:52.553886 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:17:52.553886 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT2xfkES71UXXqNct1mnV5A7OBWWUOPe2WVW9rpBiMl7Q87pUsxiY3q06lnvwHgRaF6OsKnbEgAyyP_2p1UwR2iMKo12KXVASZWQfv7mt6VDksIG5Fy0XOObWrEz0t3zc6eB-0dp6IywFfBouMGZTazkgefmfQ02g_SxSBurF0QzKeMM Oct 19 03:17:52.553886 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:17:52.553886 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:17:52.553886 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:17:52.553886 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:17:52.553886 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:17:52.553886 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:17:52.553886 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 47ebda401bed41948252eecaff697444 Oct 19 03:17:52.553886 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1428883222 Oct 19 03:17:52.553886 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:17:52.553886 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:17:52.555974 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/47ebda401bed41948252eecaff697444"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/47ebda401bed41948252eecaff697444"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/47ebda401bed41948252eecaff697444"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_47ebda401bed41948252eecaff697444", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:17:52.555974 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1428883222 Oct 19 03:17:52.555974 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 47ebda401bed41948252eecaff697444 Oct 19 03:17:52.555974 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1428883222 Oct 19 03:17:52.555974 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ImagesDeleteNegativeTestJSON-1428883222-project Oct 19 03:17:52.555974 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:17:52.555974 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:17:52.555974 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: ba2aafdb709940c5b4ad8c9aa8f448f2 Oct 19 03:17:52.555974 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1428883222-project Oct 19 03:17:52.555974 n-d-861333-8 devstack@n-api.service[121134]: method: Oct 19 03:17:52.555974 n-d-861333-8 devstack@n-api.service[121134]: exception: Image not found. Oct 19 03:17:52.555974 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '-1'} Oct 19 03:17:52.555974 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:17:52.555974 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:17:52.556892 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 19 03:17:52.556892 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 19 03:17:52.556892 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 19 03:17:52.556892 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 19 03:17:52.556892 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 19 03:17:52.556892 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 19 03:17:52.556892 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 19 03:17:52.556892 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 19 03:17:52.556892 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 19 03:17:52.556892 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 19 03:17:52.556892 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 19 03:17:52.556892 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 19 03:17:52.556892 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 19 03:17:52.556892 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 19 03:17:52.556892 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Oct 19 03:17:52.556892 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:17:52.556892 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:17:52.556892 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:17:52.556892 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:17:52.558141 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 19 03:17:52.558141 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 19 03:17:52.558141 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 19 03:17:52.558141 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 19 03:17:52.558141 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 19 03:17:52.558141 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 19 03:17:52.558141 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Oct 19 03:17:52.558141 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:17:52.558141 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:17:52.558141 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:17:52.558141 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:17:52.558141 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:17:52.558141 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:17:52.558141 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:17:52.558141 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:17:52.558141 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 03:17:52.558141 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 03:17:52.558141 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:17:52.558141 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:17:52.558141 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 19 03:17:52.560453 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 19 03:17:52.560453 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 19 03:17:52.560453 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:17:52.560453 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:17:52.560453 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:17:52.560453 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:17:52.560453 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:17:52.560453 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:17:52.560453 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:17:52.560453 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:17:52.560453 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 19 03:17:52.560453 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:17:52.560453 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8ab93c6e-c71f-4dd3-acd5-213b3d6ecbf5 tempest-ImagesDeleteNegativeTestJSON-1428883222 tempest-ImagesDeleteNegativeTestJSON-1428883222-project] Returning 404 to user: Image not found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:17:52.560453 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8ab93c6e-c71f-4dd3-acd5-213b3d6ecbf5 tempest-ImagesDeleteNegativeTestJSON-1428883222 tempest-ImagesDeleteNegativeTestJSON-1428883222-project] 10.222.0.52 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.087951 Oct 19 03:17:52.565834 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 797/1662] 10.222.0.52 () {58 vars in 1134 bytes} [Wed Oct 19 03:17:52 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 03:17:52.572622 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-088f7840-2d94-457e-9405-77f8c7c4b042 tempest-ImagesDeleteNegativeTestJSON-1428883222 tempest-ImagesDeleteNegativeTestJSON-1428883222-project] Calling method '.version_select at 0x7fc135015b80>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:52.619062 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-088f7840-2d94-457e-9405-77f8c7c4b042 tempest-ImagesDeleteNegativeTestJSON-1428883222 tempest-ImagesDeleteNegativeTestJSON-1428883222-project] HTTP exception thrown: Image not found. Oct 19 03:17:52.625878 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-088f7840-2d94-457e-9405-77f8c7c4b042 tempest-ImagesDeleteNegativeTestJSON-1428883222 tempest-ImagesDeleteNegativeTestJSON-1428883222-project] Request method failure captured: Oct 19 03:17:52.625878 n-d-861333-8 devstack@n-api.service[121134]: request: DELETE /compute/v2.1/images/5715d730-a5b6-4639-b04c-09424836d3aj HTTP/1.1 Oct 19 03:17:52.625878 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:17:52.625878 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:17:52.625878 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:17:52.625878 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:17:52.625878 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:17:52.625878 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:17:52.625878 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:17:52.625878 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:17:52.625878 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT2xfkES71UXXqNct1mnV5A7OBWWUOPe2WVW9rpBiMl7Q87pUsxiY3q06lnvwHgRaF6OsKnbEgAyyP_2p1UwR2iMKo12KXVASZWQfv7mt6VDksIG5Fy0XOObWrEz0t3zc6eB-0dp6IywFfBouMGZTazkgefmfQ02g_SxSBurF0QzKeMM Oct 19 03:17:52.625878 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:17:52.625878 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:17:52.625878 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:17:52.625878 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:17:52.625878 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:17:52.625878 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:17:52.625878 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 47ebda401bed41948252eecaff697444 Oct 19 03:17:52.625878 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1428883222 Oct 19 03:17:52.625878 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:17:52.625878 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:17:52.627388 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/47ebda401bed41948252eecaff697444"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/47ebda401bed41948252eecaff697444"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/47ebda401bed41948252eecaff697444"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_47ebda401bed41948252eecaff697444", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:17:52.627388 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1428883222 Oct 19 03:17:52.627388 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 47ebda401bed41948252eecaff697444 Oct 19 03:17:52.627388 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1428883222 Oct 19 03:17:52.627388 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ImagesDeleteNegativeTestJSON-1428883222-project Oct 19 03:17:52.627388 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:17:52.627388 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:17:52.627388 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: ba2aafdb709940c5b4ad8c9aa8f448f2 Oct 19 03:17:52.627388 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1428883222-project Oct 19 03:17:52.627388 n-d-861333-8 devstack@n-api.service[121134]: method: Oct 19 03:17:52.627388 n-d-861333-8 devstack@n-api.service[121134]: exception: Image not found. Oct 19 03:17:52.627388 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '5715d730-a5b6-4639-b04c-09424836d3aj'} Oct 19 03:17:52.627388 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:17:52.628182 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:17:52.628182 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 19 03:17:52.628182 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 19 03:17:52.628182 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 19 03:17:52.628182 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 19 03:17:52.628182 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 19 03:17:52.628182 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 19 03:17:52.628182 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 19 03:17:52.628182 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 19 03:17:52.628182 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 19 03:17:52.628182 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 19 03:17:52.628182 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 19 03:17:52.628182 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 19 03:17:52.628182 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 19 03:17:52.628182 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 19 03:17:52.628182 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 5715d730-a5b6-4639-b04c-09424836d3aj to delete Oct 19 03:17:52.628182 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:17:52.628182 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:17:52.628182 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:17:52.630304 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:17:52.630304 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 19 03:17:52.630304 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 19 03:17:52.630304 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 19 03:17:52.630304 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 19 03:17:52.630304 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 19 03:17:52.630304 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 19 03:17:52.630304 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5715d730-a5b6-4639-b04c-09424836d3aj could not be found. Oct 19 03:17:52.630304 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:17:52.630304 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:17:52.630304 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:17:52.630304 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:17:52.630304 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:17:52.630304 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:17:52.630304 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:17:52.630304 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:17:52.630304 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 03:17:52.630304 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 03:17:52.630304 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:17:52.630304 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:17:52.633156 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 19 03:17:52.633156 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 19 03:17:52.633156 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 19 03:17:52.633156 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:17:52.633156 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:17:52.633156 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:17:52.633156 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:17:52.633156 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:17:52.633156 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:17:52.633156 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:17:52.633156 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:17:52.633156 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 19 03:17:52.633156 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:17:52.633156 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-088f7840-2d94-457e-9405-77f8c7c4b042 tempest-ImagesDeleteNegativeTestJSON-1428883222 tempest-ImagesDeleteNegativeTestJSON-1428883222-project] Returning 404 to user: Image not found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:17:52.633156 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-088f7840-2d94-457e-9405-77f8c7c4b042 tempest-ImagesDeleteNegativeTestJSON-1428883222 tempest-ImagesDeleteNegativeTestJSON-1428883222-project] 10.222.0.52 "DELETE /compute/v2.1/images/5715d730-a5b6-4639-b04c-09424836d3aj" status: 404 len: 62 microversion: 2.1 time: 0.056535 Oct 19 03:17:52.634568 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 798/1663] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:52 2022] DELETE /compute/v2.1/images/5715d730-a5b6-4639-b04c-09424836d3aj => generated 62 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 03:17:52.639361 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-83c5d74c-2d23-4f88-87d1-f6384b010aa7 tempest-ImagesDeleteNegativeTestJSON-1428883222 tempest-ImagesDeleteNegativeTestJSON-1428883222-project] Calling method '.version_select at 0x7fc13500f670>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:52.666340 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-83c5d74c-2d23-4f88-87d1-f6384b010aa7 tempest-ImagesDeleteNegativeTestJSON-1428883222 tempest-ImagesDeleteNegativeTestJSON-1428883222-project] HTTP exception thrown: Image not found. Oct 19 03:17:52.666340 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-83c5d74c-2d23-4f88-87d1-f6384b010aa7 tempest-ImagesDeleteNegativeTestJSON-1428883222 tempest-ImagesDeleteNegativeTestJSON-1428883222-project] Request method failure captured: Oct 19 03:17:52.666340 n-d-861333-8 devstack@n-api.service[121134]: request: DELETE /compute/v2.1/images/1907c43c-4414-4291-9350-a0259372b63f1 HTTP/1.1 Oct 19 03:17:52.666340 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:17:52.666340 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:17:52.666340 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:17:52.666340 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:17:52.666340 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:17:52.666340 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:17:52.666340 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:17:52.666340 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:17:52.666340 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT2xfkES71UXXqNct1mnV5A7OBWWUOPe2WVW9rpBiMl7Q87pUsxiY3q06lnvwHgRaF6OsKnbEgAyyP_2p1UwR2iMKo12KXVASZWQfv7mt6VDksIG5Fy0XOObWrEz0t3zc6eB-0dp6IywFfBouMGZTazkgefmfQ02g_SxSBurF0QzKeMM Oct 19 03:17:52.666340 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:17:52.666340 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:17:52.666340 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:17:52.666340 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:17:52.666340 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:17:52.666340 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:17:52.666340 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 47ebda401bed41948252eecaff697444 Oct 19 03:17:52.666340 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1428883222 Oct 19 03:17:52.666340 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:17:52.666340 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:17:52.668008 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/47ebda401bed41948252eecaff697444"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/47ebda401bed41948252eecaff697444"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/47ebda401bed41948252eecaff697444"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_47ebda401bed41948252eecaff697444", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:17:52.668008 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1428883222 Oct 19 03:17:52.668008 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 47ebda401bed41948252eecaff697444 Oct 19 03:17:52.668008 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1428883222 Oct 19 03:17:52.668008 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ImagesDeleteNegativeTestJSON-1428883222-project Oct 19 03:17:52.668008 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:17:52.668008 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:17:52.668008 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: ba2aafdb709940c5b4ad8c9aa8f448f2 Oct 19 03:17:52.668008 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1428883222-project Oct 19 03:17:52.668008 n-d-861333-8 devstack@n-api.service[121134]: method: Oct 19 03:17:52.668008 n-d-861333-8 devstack@n-api.service[121134]: exception: Image not found. Oct 19 03:17:52.668008 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '1907c43c-4414-4291-9350-a0259372b63f1'} Oct 19 03:17:52.668008 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:17:52.668811 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:17:52.668811 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 19 03:17:52.668811 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 19 03:17:52.668811 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 19 03:17:52.668811 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 19 03:17:52.668811 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 19 03:17:52.668811 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 19 03:17:52.668811 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 19 03:17:52.668811 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 19 03:17:52.668811 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 19 03:17:52.668811 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 19 03:17:52.668811 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 19 03:17:52.668811 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 19 03:17:52.668811 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 19 03:17:52.668811 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 19 03:17:52.668811 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 1907c43c-4414-4291-9350-a0259372b63f1 to delete Oct 19 03:17:52.668811 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:17:52.668811 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:17:52.668811 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:17:52.681759 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:17:52.681759 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 19 03:17:52.681759 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 19 03:17:52.681759 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 19 03:17:52.681759 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 19 03:17:52.681759 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 19 03:17:52.681759 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 19 03:17:52.681759 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 1907c43c-4414-4291-9350-a0259372b63f1 could not be found. Oct 19 03:17:52.681759 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:17:52.681759 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:17:52.681759 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:17:52.681759 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:17:52.681759 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:17:52.681759 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:17:52.681759 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:17:52.681759 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:17:52.681759 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 03:17:52.681759 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 03:17:52.681759 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:17:52.681759 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:17:52.683105 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 19 03:17:52.683105 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 19 03:17:52.683105 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 19 03:17:52.683105 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:17:52.683105 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:17:52.683105 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:17:52.683105 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:17:52.683105 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:17:52.683105 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:17:52.683105 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:17:52.683105 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:17:52.683105 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 19 03:17:52.683105 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:17:52.683105 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-83c5d74c-2d23-4f88-87d1-f6384b010aa7 tempest-ImagesDeleteNegativeTestJSON-1428883222 tempest-ImagesDeleteNegativeTestJSON-1428883222-project] Returning 404 to user: Image not found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:17:52.683105 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-83c5d74c-2d23-4f88-87d1-f6384b010aa7 tempest-ImagesDeleteNegativeTestJSON-1428883222 tempest-ImagesDeleteNegativeTestJSON-1428883222-project] 10.222.0.52 "DELETE /compute/v2.1/images/1907c43c-4414-4291-9350-a0259372b63f1" status: 404 len: 62 microversion: 2.1 time: 0.033641 Oct 19 03:17:52.684048 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 799/1664] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:17:52 2022] DELETE /compute/v2.1/images/1907c43c-4414-4291-9350-a0259372b63f1 => generated 62 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 03:17:52.687863 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-dd486e82-124f-4a1e-8ae1-8251ab9be09f tempest-ImagesDeleteNegativeTestJSON-1428883222 tempest-ImagesDeleteNegativeTestJSON-1428883222-project] Calling method '.version_select at 0x7fc1350159d0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:52.719630 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-dd486e82-124f-4a1e-8ae1-8251ab9be09f tempest-ImagesDeleteNegativeTestJSON-1428883222 tempest-ImagesDeleteNegativeTestJSON-1428883222-project] HTTP exception thrown: Image not found. Oct 19 03:17:52.723812 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-dd486e82-124f-4a1e-8ae1-8251ab9be09f tempest-ImagesDeleteNegativeTestJSON-1428883222 tempest-ImagesDeleteNegativeTestJSON-1428883222-project] Request method failure captured: Oct 19 03:17:52.723812 n-d-861333-8 devstack@n-api.service[121134]: request: DELETE /compute/v2.1/images/tempest-invalid-964124571 HTTP/1.1 Oct 19 03:17:52.723812 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:17:52.723812 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:17:52.723812 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:17:52.723812 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:17:52.723812 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:17:52.723812 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:17:52.723812 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:17:52.723812 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:17:52.723812 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT2xfkES71UXXqNct1mnV5A7OBWWUOPe2WVW9rpBiMl7Q87pUsxiY3q06lnvwHgRaF6OsKnbEgAyyP_2p1UwR2iMKo12KXVASZWQfv7mt6VDksIG5Fy0XOObWrEz0t3zc6eB-0dp6IywFfBouMGZTazkgefmfQ02g_SxSBurF0QzKeMM Oct 19 03:17:52.723812 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:17:52.723812 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:17:52.723812 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:17:52.723812 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:17:52.723812 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:17:52.723812 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:17:52.723812 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 47ebda401bed41948252eecaff697444 Oct 19 03:17:52.723812 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1428883222 Oct 19 03:17:52.723812 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:17:52.723812 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:17:52.725186 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/47ebda401bed41948252eecaff697444"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/47ebda401bed41948252eecaff697444"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/47ebda401bed41948252eecaff697444"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_47ebda401bed41948252eecaff697444", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:17:52.725186 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1428883222 Oct 19 03:17:52.725186 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 47ebda401bed41948252eecaff697444 Oct 19 03:17:52.725186 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1428883222 Oct 19 03:17:52.725186 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ImagesDeleteNegativeTestJSON-1428883222-project Oct 19 03:17:52.725186 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:17:52.725186 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:17:52.725186 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: ba2aafdb709940c5b4ad8c9aa8f448f2 Oct 19 03:17:52.725186 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1428883222-project Oct 19 03:17:52.725186 n-d-861333-8 devstack@n-api.service[121134]: method: Oct 19 03:17:52.725186 n-d-861333-8 devstack@n-api.service[121134]: exception: Image not found. Oct 19 03:17:52.725186 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': 'tempest-invalid-964124571'} Oct 19 03:17:52.725186 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:17:52.726113 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:17:52.726113 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 19 03:17:52.726113 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 19 03:17:52.726113 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 19 03:17:52.726113 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 19 03:17:52.726113 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 19 03:17:52.726113 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 19 03:17:52.726113 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 19 03:17:52.726113 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 19 03:17:52.726113 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 19 03:17:52.726113 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 19 03:17:52.726113 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 19 03:17:52.726113 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 19 03:17:52.726113 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 19 03:17:52.726113 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 19 03:17:52.726113 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-964124571 to delete Oct 19 03:17:52.726113 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:17:52.726113 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:17:52.726113 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:17:52.727995 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:17:52.727995 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 19 03:17:52.727995 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 19 03:17:52.727995 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 19 03:17:52.727995 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 19 03:17:52.727995 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 19 03:17:52.727995 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 19 03:17:52.727995 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-964124571 could not be found. Oct 19 03:17:52.727995 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:17:52.727995 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:17:52.727995 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:17:52.727995 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:17:52.727995 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:17:52.727995 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:17:52.727995 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:17:52.727995 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:17:52.727995 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 03:17:52.727995 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 03:17:52.727995 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:17:52.727995 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:17:52.729228 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 19 03:17:52.729228 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 19 03:17:52.729228 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 19 03:17:52.729228 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:17:52.729228 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:17:52.729228 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:17:52.729228 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:17:52.729228 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:17:52.729228 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:17:52.729228 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:17:52.729228 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:17:52.729228 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 19 03:17:52.729228 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:17:52.734458 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-dd486e82-124f-4a1e-8ae1-8251ab9be09f tempest-ImagesDeleteNegativeTestJSON-1428883222 tempest-ImagesDeleteNegativeTestJSON-1428883222-project] Returning 404 to user: Image not found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:17:52.735711 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-dd486e82-124f-4a1e-8ae1-8251ab9be09f tempest-ImagesDeleteNegativeTestJSON-1428883222 tempest-ImagesDeleteNegativeTestJSON-1428883222-project] 10.222.0.52 "DELETE /compute/v2.1/images/tempest-invalid-964124571" status: 404 len: 62 microversion: 2.1 time: 0.056604 Oct 19 03:17:52.736714 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 800/1665] 10.222.0.52 () {58 vars in 1203 bytes} [Wed Oct 19 03:17:52 2022] DELETE /compute/v2.1/images/tempest-invalid-964124571 => generated 62 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 03:17:52.756594 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-dda69003-a5c9-4f7d-bc81-eb45e260133e tempest-ImagesDeleteNegativeTestJSON-1428883222 tempest-ImagesDeleteNegativeTestJSON-1428883222-project] Calling method '.version_select at 0x7fc13500f4c0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:52.819111 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-dda69003-a5c9-4f7d-bc81-eb45e260133e tempest-ImagesDeleteNegativeTestJSON-1428883222 tempest-ImagesDeleteNegativeTestJSON-1428883222-project] HTTP exception thrown: Image not found. Oct 19 03:17:52.820706 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ec468680-4d73-4448-a7b3-3c2326f81e4c tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:52.822014 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-dda69003-a5c9-4f7d-bc81-eb45e260133e tempest-ImagesDeleteNegativeTestJSON-1428883222 tempest-ImagesDeleteNegativeTestJSON-1428883222-project] Request method failure captured: Oct 19 03:17:52.822014 n-d-861333-8 devstack@n-api.service[121134]: request: DELETE /compute/v2.1/images/8aab4f29-dce2-417c-acb5-2f62af010728 HTTP/1.1 Oct 19 03:17:52.822014 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:17:52.822014 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:17:52.822014 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:17:52.822014 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:17:52.822014 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:17:52.822014 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:17:52.822014 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:17:52.822014 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:17:52.822014 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT2xfkES71UXXqNct1mnV5A7OBWWUOPe2WVW9rpBiMl7Q87pUsxiY3q06lnvwHgRaF6OsKnbEgAyyP_2p1UwR2iMKo12KXVASZWQfv7mt6VDksIG5Fy0XOObWrEz0t3zc6eB-0dp6IywFfBouMGZTazkgefmfQ02g_SxSBurF0QzKeMM Oct 19 03:17:52.822014 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:17:52.822014 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:17:52.822014 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:17:52.822014 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:17:52.822014 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:17:52.822014 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:17:52.822014 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 47ebda401bed41948252eecaff697444 Oct 19 03:17:52.822014 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1428883222 Oct 19 03:17:52.822014 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:17:52.822014 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:17:52.825997 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/47ebda401bed41948252eecaff697444"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/47ebda401bed41948252eecaff697444"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/47ebda401bed41948252eecaff697444"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_47ebda401bed41948252eecaff697444", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:17:52.825997 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1428883222 Oct 19 03:17:52.825997 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 47ebda401bed41948252eecaff697444 Oct 19 03:17:52.825997 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1428883222 Oct 19 03:17:52.825997 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ImagesDeleteNegativeTestJSON-1428883222-project Oct 19 03:17:52.825997 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:17:52.825997 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:17:52.825997 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: ba2aafdb709940c5b4ad8c9aa8f448f2 Oct 19 03:17:52.825997 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1428883222-project Oct 19 03:17:52.825997 n-d-861333-8 devstack@n-api.service[121134]: method: Oct 19 03:17:52.825997 n-d-861333-8 devstack@n-api.service[121134]: exception: Image not found. Oct 19 03:17:52.825997 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '8aab4f29-dce2-417c-acb5-2f62af010728'} Oct 19 03:17:52.825997 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:17:52.826934 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:17:52.826934 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 19 03:17:52.826934 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 19 03:17:52.826934 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 19 03:17:52.826934 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 19 03:17:52.826934 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 19 03:17:52.826934 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 19 03:17:52.826934 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 19 03:17:52.826934 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 19 03:17:52.826934 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 19 03:17:52.826934 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 19 03:17:52.826934 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 19 03:17:52.826934 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 19 03:17:52.826934 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 19 03:17:52.826934 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 19 03:17:52.826934 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 8aab4f29-dce2-417c-acb5-2f62af010728 to delete Oct 19 03:17:52.826934 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:17:52.826934 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:17:52.826934 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:17:52.828163 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:17:52.828163 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 19 03:17:52.828163 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 19 03:17:52.828163 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 19 03:17:52.828163 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 19 03:17:52.828163 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 19 03:17:52.828163 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 19 03:17:52.828163 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8aab4f29-dce2-417c-acb5-2f62af010728 could not be found. Oct 19 03:17:52.828163 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:17:52.828163 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:17:52.828163 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:17:52.828163 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:17:52.828163 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:17:52.828163 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:17:52.828163 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:17:52.828163 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:17:52.828163 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 03:17:52.828163 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 03:17:52.828163 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:17:52.828163 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:17:52.830470 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 19 03:17:52.830470 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 19 03:17:52.830470 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 19 03:17:52.830470 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:17:52.830470 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:17:52.830470 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:17:52.830470 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:17:52.830470 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:17:52.830470 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:17:52.830470 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:17:52.830470 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:17:52.830470 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 19 03:17:52.830470 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:17:52.830470 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-dda69003-a5c9-4f7d-bc81-eb45e260133e tempest-ImagesDeleteNegativeTestJSON-1428883222 tempest-ImagesDeleteNegativeTestJSON-1428883222-project] Returning 404 to user: Image not found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:17:52.830470 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-dda69003-a5c9-4f7d-bc81-eb45e260133e tempest-ImagesDeleteNegativeTestJSON-1428883222 tempest-ImagesDeleteNegativeTestJSON-1428883222-project] 10.222.0.52 "DELETE /compute/v2.1/images/8aab4f29-dce2-417c-acb5-2f62af010728" status: 404 len: 62 microversion: 2.1 time: 0.075209 Oct 19 03:17:52.832163 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:17:52.832443 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 801/1666] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:52 2022] DELETE /compute/v2.1/images/8aab4f29-dce2-417c-acb5-2f62af010728 => generated 62 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 03:17:52.843438 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ec468680-4d73-4448-a7b3-3c2326f81e4c tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196" status: 200 len: 1468 microversion: 2.1 time: 0.338255 Oct 19 03:17:52.844459 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 866/1667] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:52 2022] GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196 => generated 1468 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:53.272492 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ee4f0f9c-3ff8-41d2-ac00-7f7e93a010aa tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:53.273603 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ee4f0f9c-3ff8-41d2-ac00-7f7e93a010aa tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] [instance: 64d3b78b-7953-40fc-ab53-b35f9d105901] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:53.284236 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ee4f0f9c-3ff8-41d2-ac00-7f7e93a010aa tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:53.287185 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ee4f0f9c-3ff8-41d2-ac00-7f7e93a010aa tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:53.287872 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ee4f0f9c-3ff8-41d2-ac00-7f7e93a010aa tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:53.288816 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ee4f0f9c-3ff8-41d2-ac00-7f7e93a010aa tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:53.289458 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ee4f0f9c-3ff8-41d2-ac00-7f7e93a010aa tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:53.290797 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ee4f0f9c-3ff8-41d2-ac00-7f7e93a010aa tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:53.536884 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-00d555c4-5cf8-4e3f-a3ae-cac24a169fa2 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:53.538156 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-00d555c4-5cf8-4e3f-a3ae-cac24a169fa2 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 2d709051-db69-4ea9-96dc-ffe05e9c9b3a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:53.548723 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-00d555c4-5cf8-4e3f-a3ae-cac24a169fa2 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:53.549243 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-00d555c4-5cf8-4e3f-a3ae-cac24a169fa2 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:53.549886 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-00d555c4-5cf8-4e3f-a3ae-cac24a169fa2 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:53.550612 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-00d555c4-5cf8-4e3f-a3ae-cac24a169fa2 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:53.551087 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-00d555c4-5cf8-4e3f-a3ae-cac24a169fa2 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:53.551649 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-00d555c4-5cf8-4e3f-a3ae-cac24a169fa2 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:53.642353 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ee4f0f9c-3ff8-41d2-ac00-7f7e93a010aa tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c35b71372843d69f9a6c6be04b154f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcd49d68a3947249016cc5dbe910efc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:53.655121 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=100 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:17:53.674004 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ee4f0f9c-3ff8-41d2-ac00-7f7e93a010aa tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] 10.222.0.52 "GET /compute/v2.1/servers/64d3b78b-7953-40fc-ab53-b35f9d105901" status: 200 len: 1334 microversion: 2.1 time: 0.406582 Oct 19 03:17:53.674613 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 802/1668] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:53 2022] GET /compute/v2.1/servers/64d3b78b-7953-40fc-ab53-b35f9d105901 => generated 1334 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:53.815497 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-00d555c4-5cf8-4e3f-a3ae-cac24a169fa2 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:53.826086 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-00d555c4-5cf8-4e3f-a3ae-cac24a169fa2 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/2d709051-db69-4ea9-96dc-ffe05e9c9b3a" status: 200 len: 1472 microversion: 2.1 time: 0.302202 Oct 19 03:17:53.831112 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 867/1669] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:53 2022] GET /compute/v2.1/servers/2d709051-db69-4ea9-96dc-ffe05e9c9b3a => generated 1472 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:53.874175 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4176fd8e-6514-45b9-8159-fa6b8f6787ef tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:53.875237 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4176fd8e-6514-45b9-8159-fa6b8f6787ef tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 84774cfc-79b4-42db-acfd-c4daac86d196] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:53.887370 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4176fd8e-6514-45b9-8159-fa6b8f6787ef tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:53.888282 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4176fd8e-6514-45b9-8159-fa6b8f6787ef tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:53.890828 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4176fd8e-6514-45b9-8159-fa6b8f6787ef tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:53.891721 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4176fd8e-6514-45b9-8159-fa6b8f6787ef tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:53.892650 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4176fd8e-6514-45b9-8159-fa6b8f6787ef tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:53.894304 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4176fd8e-6514-45b9-8159-fa6b8f6787ef tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:54.158414 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-4176fd8e-6514-45b9-8159-fa6b8f6787ef tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:54.171888 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4176fd8e-6514-45b9-8159-fa6b8f6787ef tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196" status: 200 len: 1468 microversion: 2.1 time: 0.303001 Oct 19 03:17:54.172948 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 803/1670] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:53 2022] GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196 => generated 1468 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:54.401018 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-73d5f4eb-9ba2-43a1-ac43-314a4612e4b0 req-9cf39c9d-9bd3-42c0-b37e-b4bdf80b9306 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d709051-db69-4ea9-96dc-ffe05e9c9b3a", "name": "network-vif-deleted", "tag": "4b4223dc-d902-469d-9459-70a814053f14"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:17:54.414347 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-73d5f4eb-9ba2-43a1-ac43-314a4612e4b0 req-9cf39c9d-9bd3-42c0-b37e-b4bdf80b9306 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:54.415420 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-73d5f4eb-9ba2-43a1-ac43-314a4612e4b0 req-9cf39c9d-9bd3-42c0-b37e-b4bdf80b9306 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:54.415855 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-73d5f4eb-9ba2-43a1-ac43-314a4612e4b0 req-9cf39c9d-9bd3-42c0-b37e-b4bdf80b9306 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:54.433681 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-73d5f4eb-9ba2-43a1-ac43-314a4612e4b0 req-9cf39c9d-9bd3-42c0-b37e-b4bdf80b9306 service nova] Creating event network-vif-deleted:4b4223dc-d902-469d-9459-70a814053f14 for instance 2d709051-db69-4ea9-96dc-ffe05e9c9b3a on n-h2-861333-8 Oct 19 03:17:54.442464 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-73d5f4eb-9ba2-43a1-ac43-314a4612e4b0 req-9cf39c9d-9bd3-42c0-b37e-b4bdf80b9306 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045604 Oct 19 03:17:54.444322 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 804/1671] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:17:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:17:54.509124 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-733536bd-51c8-4df5-9317-9438e38449b1 tempest-QuotaClassesAdminTestJSON-1332757932 tempest-QuotaClassesAdminTestJSON-1332757932-project-admin] Calling method '.version_select at 0x7fc130cd3ca0>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:54.527732 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-733536bd-51c8-4df5-9317-9438e38449b1 tempest-QuotaClassesAdminTestJSON-1332757932 tempest-QuotaClassesAdminTestJSON-1332757932-project-admin] 10.222.0.52 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.222813 Oct 19 03:17:54.529077 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 868/1672] 10.222.0.52 () {58 vars in 1185 bytes} [Wed Oct 19 03:17:54 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:17:54.543825 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e99e6809-18a0-4869-8da1-b3046d54cbf9 tempest-QuotaClassesAdminTestJSON-1332757932 tempest-QuotaClassesAdminTestJSON-1332757932-project-admin] Action: 'update', calling method: .version_select at 0x7fc135015700>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:17:54.618252 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-1960713a-2366-466f-889c-56c8db796ebe req-d7541b65-c953-452a-b992-79eb79ec3435 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84774cfc-79b4-42db-acfd-c4daac86d196", "name": "network-vif-plugged", "status": "completed", "tag": "349ffeb3-81a2-44f2-9775-65ddf0c3a896"}, {"server_uuid": "64d3b78b-7953-40fc-ab53-b35f9d105901", "name": "network-vif-plugged", "status": "completed", "tag": "e05f0fbb-41ba-40b6-8c55-8a23a1c1e929"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:17:54.627767 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=33 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:17:54.630375 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-1960713a-2366-466f-889c-56c8db796ebe req-d7541b65-c953-452a-b992-79eb79ec3435 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:54.631121 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-1960713a-2366-466f-889c-56c8db796ebe req-d7541b65-c953-452a-b992-79eb79ec3435 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:54.631814 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-1960713a-2366-466f-889c-56c8db796ebe req-d7541b65-c953-452a-b992-79eb79ec3435 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:54.652568 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-1960713a-2366-466f-889c-56c8db796ebe req-d7541b65-c953-452a-b992-79eb79ec3435 service nova] Creating event network-vif-plugged:349ffeb3-81a2-44f2-9775-65ddf0c3a896 for instance 84774cfc-79b4-42db-acfd-c4daac86d196 on n-h2-861333-8 Oct 19 03:17:54.657163 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-1960713a-2366-466f-889c-56c8db796ebe req-d7541b65-c953-452a-b992-79eb79ec3435 service nova] Creating event network-vif-plugged:e05f0fbb-41ba-40b6-8c55-8a23a1c1e929 for instance 64d3b78b-7953-40fc-ab53-b35f9d105901 on n-h1-861333-8 Oct 19 03:17:54.664730 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [req-1960713a-2366-466f-889c-56c8db796ebe req-d7541b65-c953-452a-b992-79eb79ec3435 service nova] Instance 84774cfc-79b4-42db-acfd-c4daac86d196 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-861333-8', 'n-h1-861333-8'} {{(pid=121135) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 03:17:54.679482 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-1960713a-2366-466f-889c-56c8db796ebe req-d7541b65-c953-452a-b992-79eb79ec3435 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.065150 Oct 19 03:17:54.680546 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 869/1673] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:17:54 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:17:54.697862 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7f1c58ad-d339-49d1-b802-25f02e3445ac tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:54.698815 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7f1c58ad-d339-49d1-b802-25f02e3445ac tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] [instance: 64d3b78b-7953-40fc-ab53-b35f9d105901] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:54.707392 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7f1c58ad-d339-49d1-b802-25f02e3445ac tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:54.712256 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7f1c58ad-d339-49d1-b802-25f02e3445ac tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:54.712256 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7f1c58ad-d339-49d1-b802-25f02e3445ac tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:54.712256 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7f1c58ad-d339-49d1-b802-25f02e3445ac tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:54.712256 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7f1c58ad-d339-49d1-b802-25f02e3445ac tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:54.712644 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7f1c58ad-d339-49d1-b802-25f02e3445ac tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:54.949747 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7f1c58ad-d339-49d1-b802-25f02e3445ac tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c35b71372843d69f9a6c6be04b154f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcd49d68a3947249016cc5dbe910efc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:54.958009 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7f1c58ad-d339-49d1-b802-25f02e3445ac tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] 10.222.0.52 "GET /compute/v2.1/servers/64d3b78b-7953-40fc-ab53-b35f9d105901" status: 200 len: 1334 microversion: 2.1 time: 0.265393 Oct 19 03:17:54.958848 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 870/1674] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:54 2022] GET /compute/v2.1/servers/64d3b78b-7953-40fc-ab53-b35f9d105901 => generated 1334 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:17:54.977250 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c6e90c22-03a7-446a-bb30-bcb3aeca14aa tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:54.977920 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c6e90c22-03a7-446a-bb30-bcb3aeca14aa tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 2d709051-db69-4ea9-96dc-ffe05e9c9b3a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:54.987129 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c6e90c22-03a7-446a-bb30-bcb3aeca14aa tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:54.987940 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c6e90c22-03a7-446a-bb30-bcb3aeca14aa tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:54.989036 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c6e90c22-03a7-446a-bb30-bcb3aeca14aa tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:54.990244 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c6e90c22-03a7-446a-bb30-bcb3aeca14aa tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:54.990903 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c6e90c22-03a7-446a-bb30-bcb3aeca14aa tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:54.992308 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c6e90c22-03a7-446a-bb30-bcb3aeca14aa tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:55.067602 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c6e90c22-03a7-446a-bb30-bcb3aeca14aa tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:55.079154 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c6e90c22-03a7-446a-bb30-bcb3aeca14aa tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/2d709051-db69-4ea9-96dc-ffe05e9c9b3a" status: 200 len: 1430 microversion: 2.1 time: 0.118684 Oct 19 03:17:55.081387 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 871/1675] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:54 2022] GET /compute/v2.1/servers/2d709051-db69-4ea9-96dc-ffe05e9c9b3a => generated 1430 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:55.198802 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-919b855b-0848-4672-bc5c-00dd1f3bb52a tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:55.199420 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-919b855b-0848-4672-bc5c-00dd1f3bb52a tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 84774cfc-79b4-42db-acfd-c4daac86d196] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:55.205330 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-919b855b-0848-4672-bc5c-00dd1f3bb52a tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:55.205875 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-919b855b-0848-4672-bc5c-00dd1f3bb52a tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:55.206315 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-919b855b-0848-4672-bc5c-00dd1f3bb52a tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:55.207007 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-919b855b-0848-4672-bc5c-00dd1f3bb52a tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:55.207459 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-919b855b-0848-4672-bc5c-00dd1f3bb52a tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:55.207884 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-919b855b-0848-4672-bc5c-00dd1f3bb52a tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:55.345839 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-919b855b-0848-4672-bc5c-00dd1f3bb52a tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:55.358043 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-919b855b-0848-4672-bc5c-00dd1f3bb52a tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196" status: 200 len: 1468 microversion: 2.1 time: 0.160302 Oct 19 03:17:55.358043 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 872/1676] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:55 2022] GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196 => generated 1468 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:17:55.798688 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e99e6809-18a0-4869-8da1-b3046d54cbf9 tempest-QuotaClassesAdminTestJSON-1332757932 tempest-QuotaClassesAdminTestJSON-1332757932-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 1.260416 Oct 19 03:17:55.799680 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 805/1677] 10.222.0.52 () {60 vars in 1206 bytes} [Wed Oct 19 03:17:54 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 1263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:17:55.812763 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-120ae092-e4e3-4db0-9209-2e992aada815 tempest-QuotaClassesAdminTestJSON-1332757932 tempest-QuotaClassesAdminTestJSON-1332757932-project-admin] Calling method '.version_select at 0x7fc130eded30>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:55.827710 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-120ae092-e4e3-4db0-9209-2e992aada815 tempest-QuotaClassesAdminTestJSON-1332757932 tempest-QuotaClassesAdminTestJSON-1332757932-project-admin] 10.222.0.52 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.019506 Oct 19 03:17:55.829063 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 873/1678] 10.222.0.52 () {58 vars in 1185 bytes} [Wed Oct 19 03:17:55 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:17:55.840973 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1f7e7c3b-948f-4c82-b6b4-5cc7cdd0d756 tempest-QuotaClassesAdminTestJSON-1332757932 tempest-QuotaClassesAdminTestJSON-1332757932-project-admin] Action: 'update', calling method: .version_select at 0x7fc1310578b0>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:17:55.922463 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f000b272-22ea-437e-8dfe-315ea14d2630 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:55.922974 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f000b272-22ea-437e-8dfe-315ea14d2630 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] [instance: 90f71ec9-e698-4159-9458-2099c1fbfaf3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:55.932663 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f000b272-22ea-437e-8dfe-315ea14d2630 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:55.933284 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f000b272-22ea-437e-8dfe-315ea14d2630 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:55.933845 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f000b272-22ea-437e-8dfe-315ea14d2630 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:55.934631 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f000b272-22ea-437e-8dfe-315ea14d2630 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:55.935162 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f000b272-22ea-437e-8dfe-315ea14d2630 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:55.935710 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f000b272-22ea-437e-8dfe-315ea14d2630 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:55.963296 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f000b272-22ea-437e-8dfe-315ea14d2630 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] [instance: 90f71ec9-e698-4159-9458-2099c1fbfaf3] Going to try to terminate instance {{(pid=121135) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:17:56.317828 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f000b272-22ea-437e-8dfe-315ea14d2630 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] 10.222.0.52 "DELETE /compute/v2.1/servers/90f71ec9-e698-4159-9458-2099c1fbfaf3" status: 204 len: 0 microversion: 2.1 time: 0.398929 Oct 19 03:17:56.318447 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 874/1679] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:17:55 2022] DELETE /compute/v2.1/servers/90f71ec9-e698-4159-9458-2099c1fbfaf3 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 19 03:17:56.324394 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9d139d65-2119-4d67-bef6-338716387873 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:56.325151 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9d139d65-2119-4d67-bef6-338716387873 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] [instance: 64d3b78b-7953-40fc-ab53-b35f9d105901] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:56.331167 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9d139d65-2119-4d67-bef6-338716387873 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:56.331650 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9d139d65-2119-4d67-bef6-338716387873 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:56.332082 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9d139d65-2119-4d67-bef6-338716387873 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:56.332773 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9d139d65-2119-4d67-bef6-338716387873 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:56.333221 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9d139d65-2119-4d67-bef6-338716387873 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:56.333666 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9d139d65-2119-4d67-bef6-338716387873 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:56.499106 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-9d139d65-2119-4d67-bef6-338716387873 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c35b71372843d69f9a6c6be04b154f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcd49d68a3947249016cc5dbe910efc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:56.514359 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9d139d65-2119-4d67-bef6-338716387873 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] 10.222.0.52 "GET /compute/v2.1/servers/64d3b78b-7953-40fc-ab53-b35f9d105901" status: 200 len: 1334 microversion: 2.1 time: 0.194317 Oct 19 03:17:56.521383 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 875/1680] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:56 2022] GET /compute/v2.1/servers/64d3b78b-7953-40fc-ab53-b35f9d105901 => generated 1334 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:56.541705 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-284944b4-14ee-47bd-8bc1-fa390839af11 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:56.542858 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-284944b4-14ee-47bd-8bc1-fa390839af11 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 2d709051-db69-4ea9-96dc-ffe05e9c9b3a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:56.549285 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-284944b4-14ee-47bd-8bc1-fa390839af11 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:56.550060 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-284944b4-14ee-47bd-8bc1-fa390839af11 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:56.550670 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-284944b4-14ee-47bd-8bc1-fa390839af11 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:56.552677 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-284944b4-14ee-47bd-8bc1-fa390839af11 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:56.552677 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-284944b4-14ee-47bd-8bc1-fa390839af11 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:56.552677 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-284944b4-14ee-47bd-8bc1-fa390839af11 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:56.587933 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-284944b4-14ee-47bd-8bc1-fa390839af11 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:56.588424 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-284944b4-14ee-47bd-8bc1-fa390839af11 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:56.588862 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-284944b4-14ee-47bd-8bc1-fa390839af11 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:56.589392 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-284944b4-14ee-47bd-8bc1-fa390839af11 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lazy-loading 'fault' on Instance uuid 2d709051-db69-4ea9-96dc-ffe05e9c9b3a {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:17:56.650120 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-284944b4-14ee-47bd-8bc1-fa390839af11 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:56.652882 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-284944b4-14ee-47bd-8bc1-fa390839af11 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/2d709051-db69-4ea9-96dc-ffe05e9c9b3a" status: 200 len: 1306 microversion: 2.1 time: 0.130229 Oct 19 03:17:56.653669 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 876/1681] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:56 2022] GET /compute/v2.1/servers/2d709051-db69-4ea9-96dc-ffe05e9c9b3a => generated 1306 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:56.658288 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b6ec863f-285e-40fc-963e-5ec5d9b43175 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:56.658983 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b6ec863f-285e-40fc-963e-5ec5d9b43175 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] [instance: 90f71ec9-e698-4159-9458-2099c1fbfaf3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:56.665625 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b6ec863f-285e-40fc-963e-5ec5d9b43175 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:56.666192 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b6ec863f-285e-40fc-963e-5ec5d9b43175 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:56.666715 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b6ec863f-285e-40fc-963e-5ec5d9b43175 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:56.667475 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b6ec863f-285e-40fc-963e-5ec5d9b43175 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:56.668055 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b6ec863f-285e-40fc-963e-5ec5d9b43175 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:56.668543 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b6ec863f-285e-40fc-963e-5ec5d9b43175 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:56.782423 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=68,nova_api:DELETE=3,nova_api:UPDATE=22,nova_api:INSERT=7 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:17:56.844720 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b6ec863f-285e-40fc-963e-5ec5d9b43175 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28072a54d5934ea28e7d3205841c0852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c12a432bbd43bd8f70ba6e941c28a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:56.853251 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b6ec863f-285e-40fc-963e-5ec5d9b43175 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] 10.222.0.52 "GET /compute/v2.1/servers/90f71ec9-e698-4159-9458-2099c1fbfaf3" status: 200 len: 1513 microversion: 2.1 time: 0.198593 Oct 19 03:17:56.853857 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 877/1682] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:56 2022] GET /compute/v2.1/servers/90f71ec9-e698-4159-9458-2099c1fbfaf3 => generated 1513 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:56.862638 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2fa1d2f5-d65b-45bb-aeec-734206e0c2da tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:56.863301 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-2fa1d2f5-d65b-45bb-aeec-734206e0c2da tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 84774cfc-79b4-42db-acfd-c4daac86d196] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:56.869316 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2fa1d2f5-d65b-45bb-aeec-734206e0c2da tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:56.869853 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2fa1d2f5-d65b-45bb-aeec-734206e0c2da tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:56.870293 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2fa1d2f5-d65b-45bb-aeec-734206e0c2da tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:56.871270 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2fa1d2f5-d65b-45bb-aeec-734206e0c2da tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:56.871764 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2fa1d2f5-d65b-45bb-aeec-734206e0c2da tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:56.872170 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2fa1d2f5-d65b-45bb-aeec-734206e0c2da tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:56.910502 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1f7e7c3b-948f-4c82-b6b4-5cc7cdd0d756 tempest-QuotaClassesAdminTestJSON-1332757932 tempest-QuotaClassesAdminTestJSON-1332757932-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 1.073286 Oct 19 03:17:56.911387 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 806/1683] 10.222.0.52 () {60 vars in 1206 bytes} [Wed Oct 19 03:17:55 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:17:57.018236 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-2fa1d2f5-d65b-45bb-aeec-734206e0c2da tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:57.026782 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2fa1d2f5-d65b-45bb-aeec-734206e0c2da tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196" status: 200 len: 1468 microversion: 2.1 time: 0.171916 Oct 19 03:17:57.027363 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 878/1684] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:56 2022] GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196 => generated 1468 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:57.546917 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a596b98c-24b0-448e-ab35-51f008154037 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:57.547545 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a596b98c-24b0-448e-ab35-51f008154037 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] [instance: 64d3b78b-7953-40fc-ab53-b35f9d105901] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:57.557662 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a596b98c-24b0-448e-ab35-51f008154037 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:57.560971 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a596b98c-24b0-448e-ab35-51f008154037 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:57.561732 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a596b98c-24b0-448e-ab35-51f008154037 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:57.563314 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a596b98c-24b0-448e-ab35-51f008154037 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:57.563787 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a596b98c-24b0-448e-ab35-51f008154037 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:57.564247 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a596b98c-24b0-448e-ab35-51f008154037 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:57.687197 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ed822a25-c062-4462-8586-036891e4d1f6 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:57.688241 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ed822a25-c062-4462-8586-036891e4d1f6 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 2d709051-db69-4ea9-96dc-ffe05e9c9b3a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:57.696765 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ed822a25-c062-4462-8586-036891e4d1f6 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:57.697784 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ed822a25-c062-4462-8586-036891e4d1f6 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:57.698479 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ed822a25-c062-4462-8586-036891e4d1f6 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:57.699379 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ed822a25-c062-4462-8586-036891e4d1f6 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:57.700071 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ed822a25-c062-4462-8586-036891e4d1f6 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:57.700985 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ed822a25-c062-4462-8586-036891e4d1f6 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:57.754589 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a596b98c-24b0-448e-ab35-51f008154037 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c35b71372843d69f9a6c6be04b154f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcd49d68a3947249016cc5dbe910efc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:57.768461 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ed822a25-c062-4462-8586-036891e4d1f6 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:57.768951 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ed822a25-c062-4462-8586-036891e4d1f6 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:57.769399 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ed822a25-c062-4462-8586-036891e4d1f6 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:57.770046 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-ed822a25-c062-4462-8586-036891e4d1f6 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lazy-loading 'fault' on Instance uuid 2d709051-db69-4ea9-96dc-ffe05e9c9b3a {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:17:57.779991 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a596b98c-24b0-448e-ab35-51f008154037 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] 10.222.0.52 "GET /compute/v2.1/servers/64d3b78b-7953-40fc-ab53-b35f9d105901" status: 200 len: 1668 microversion: 2.1 time: 0.237306 Oct 19 03:17:57.782082 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 807/1685] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:57 2022] GET /compute/v2.1/servers/64d3b78b-7953-40fc-ab53-b35f9d105901 => generated 1668 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:57.804878 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-79373679-f57e-48f2-a460-1b43f19f63b3 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:57.806479 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-79373679-f57e-48f2-a460-1b43f19f63b3 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] [instance: 64d3b78b-7953-40fc-ab53-b35f9d105901] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:57.819664 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-79373679-f57e-48f2-a460-1b43f19f63b3 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:57.825359 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-79373679-f57e-48f2-a460-1b43f19f63b3 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:57.825359 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-79373679-f57e-48f2-a460-1b43f19f63b3 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:57.825359 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-79373679-f57e-48f2-a460-1b43f19f63b3 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:57.825359 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-79373679-f57e-48f2-a460-1b43f19f63b3 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:57.825751 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-79373679-f57e-48f2-a460-1b43f19f63b3 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:57.825831 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ed822a25-c062-4462-8586-036891e4d1f6 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:57.833448 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ed822a25-c062-4462-8586-036891e4d1f6 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/2d709051-db69-4ea9-96dc-ffe05e9c9b3a" status: 200 len: 1306 microversion: 2.1 time: 0.161239 Oct 19 03:17:57.838874 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 879/1686] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:57 2022] GET /compute/v2.1/servers/2d709051-db69-4ea9-96dc-ffe05e9c9b3a => generated 1306 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:17:57.856916 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-79373679-f57e-48f2-a460-1b43f19f63b3 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] 10.222.0.52 "GET /compute/v2.1/servers/64d3b78b-7953-40fc-ab53-b35f9d105901/ips" status: 200 len: 178 microversion: 2.1 time: 0.055937 Oct 19 03:17:57.865442 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 808/1687] 10.222.0.52 () {58 vars in 1248 bytes} [Wed Oct 19 03:17:57 2022] GET /compute/v2.1/servers/64d3b78b-7953-40fc-ab53-b35f9d105901/ips => generated 178 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:17:57.877903 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1a30a3ef-a5de-4471-876c-24cf4d15d2ac tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:57.878418 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1a30a3ef-a5de-4471-876c-24cf4d15d2ac tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] [instance: 64d3b78b-7953-40fc-ab53-b35f9d105901] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:57.879373 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-63a8101c-2b91-4d87-ad81-5f68178eb830 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:57.880359 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-63a8101c-2b91-4d87-ad81-5f68178eb830 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] [instance: 90f71ec9-e698-4159-9458-2099c1fbfaf3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:57.889487 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-63a8101c-2b91-4d87-ad81-5f68178eb830 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:57.890267 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-63a8101c-2b91-4d87-ad81-5f68178eb830 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:57.890764 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-63a8101c-2b91-4d87-ad81-5f68178eb830 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:57.891419 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-63a8101c-2b91-4d87-ad81-5f68178eb830 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:57.891848 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-63a8101c-2b91-4d87-ad81-5f68178eb830 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:57.893813 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-63a8101c-2b91-4d87-ad81-5f68178eb830 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:57.902346 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1a30a3ef-a5de-4471-876c-24cf4d15d2ac tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:57.903085 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1a30a3ef-a5de-4471-876c-24cf4d15d2ac tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:57.922217 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1a30a3ef-a5de-4471-876c-24cf4d15d2ac tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:57.923392 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1a30a3ef-a5de-4471-876c-24cf4d15d2ac tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:57.927112 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1a30a3ef-a5de-4471-876c-24cf4d15d2ac tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:57.929944 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1a30a3ef-a5de-4471-876c-24cf4d15d2ac tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:57.969943 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1a30a3ef-a5de-4471-876c-24cf4d15d2ac tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] [instance: 64d3b78b-7953-40fc-ab53-b35f9d105901] Going to try to terminate instance {{(pid=121135) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:17:58.136430 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-63a8101c-2b91-4d87-ad81-5f68178eb830 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28072a54d5934ea28e7d3205841c0852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c12a432bbd43bd8f70ba6e941c28a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:58.145903 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-63a8101c-2b91-4d87-ad81-5f68178eb830 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] 10.222.0.52 "GET /compute/v2.1/servers/90f71ec9-e698-4159-9458-2099c1fbfaf3" status: 200 len: 1513 microversion: 2.1 time: 0.273369 Oct 19 03:17:58.146542 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 809/1688] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:57 2022] GET /compute/v2.1/servers/90f71ec9-e698-4159-9458-2099c1fbfaf3 => generated 1513 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:58.161106 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-247f6491-d180-4e50-8b0e-346e15815a2f tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:58.161875 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-247f6491-d180-4e50-8b0e-346e15815a2f tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 84774cfc-79b4-42db-acfd-c4daac86d196] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:58.175504 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-247f6491-d180-4e50-8b0e-346e15815a2f tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:58.176755 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-247f6491-d180-4e50-8b0e-346e15815a2f tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:58.176755 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-247f6491-d180-4e50-8b0e-346e15815a2f tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:58.177717 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-247f6491-d180-4e50-8b0e-346e15815a2f tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:58.178318 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-247f6491-d180-4e50-8b0e-346e15815a2f tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:58.183487 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-247f6491-d180-4e50-8b0e-346e15815a2f tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:58.318929 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1a30a3ef-a5de-4471-876c-24cf4d15d2ac tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] 10.222.0.52 "DELETE /compute/v2.1/servers/64d3b78b-7953-40fc-ab53-b35f9d105901" status: 204 len: 0 microversion: 2.1 time: 0.451682 Oct 19 03:17:58.320184 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 880/1689] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:17:57 2022] DELETE /compute/v2.1/servers/64d3b78b-7953-40fc-ab53-b35f9d105901 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:17:58.329298 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-1fe2031d-06ef-420e-8ef3-7ccb75bc5800 req-41ca0ff1-d0d0-4f71-87f5-de6a95542f24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84774cfc-79b4-42db-acfd-c4daac86d196", "name": "network-vif-unplugged", "status": "completed", "tag": "349ffeb3-81a2-44f2-9775-65ddf0c3a896"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:17:58.362279 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-1fe2031d-06ef-420e-8ef3-7ccb75bc5800 req-41ca0ff1-d0d0-4f71-87f5-de6a95542f24 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:58.363387 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-1fe2031d-06ef-420e-8ef3-7ccb75bc5800 req-41ca0ff1-d0d0-4f71-87f5-de6a95542f24 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:58.364673 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-1fe2031d-06ef-420e-8ef3-7ccb75bc5800 req-41ca0ff1-d0d0-4f71-87f5-de6a95542f24 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:58.400308 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-1fe2031d-06ef-420e-8ef3-7ccb75bc5800 req-41ca0ff1-d0d0-4f71-87f5-de6a95542f24 service nova] Creating event network-vif-unplugged:349ffeb3-81a2-44f2-9775-65ddf0c3a896 for instance 84774cfc-79b4-42db-acfd-c4daac86d196 on n-h1-861333-8 Oct 19 03:17:58.421547 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [req-1fe2031d-06ef-420e-8ef3-7ccb75bc5800 req-41ca0ff1-d0d0-4f71-87f5-de6a95542f24 service nova] Instance 84774cfc-79b4-42db-acfd-c4daac86d196 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-861333-8', 'n-h1-861333-8'} {{(pid=121135) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 03:17:58.454497 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-1fe2031d-06ef-420e-8ef3-7ccb75bc5800 req-41ca0ff1-d0d0-4f71-87f5-de6a95542f24 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.131412 Oct 19 03:17:58.460144 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 881/1690] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:17:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:17:58.463540 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ee4f4f7c-16d8-4ff0-a41e-2c82fe64cc18 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:58.464996 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ee4f4f7c-16d8-4ff0-a41e-2c82fe64cc18 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] [instance: 64d3b78b-7953-40fc-ab53-b35f9d105901] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:58.480194 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ee4f4f7c-16d8-4ff0-a41e-2c82fe64cc18 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:58.481597 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ee4f4f7c-16d8-4ff0-a41e-2c82fe64cc18 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:58.483590 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ee4f4f7c-16d8-4ff0-a41e-2c82fe64cc18 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:58.489029 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ee4f4f7c-16d8-4ff0-a41e-2c82fe64cc18 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:58.489029 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ee4f4f7c-16d8-4ff0-a41e-2c82fe64cc18 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:58.489029 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ee4f4f7c-16d8-4ff0-a41e-2c82fe64cc18 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:58.495367 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:17:58.864997 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-247f6491-d180-4e50-8b0e-346e15815a2f tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:58.877687 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-247f6491-d180-4e50-8b0e-346e15815a2f tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196" status: 200 len: 1468 microversion: 2.1 time: 0.726281 Oct 19 03:17:58.881717 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 810/1691] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:58 2022] GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196 => generated 1468 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:58.906398 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-fa213d5b-50fa-41dd-9066-63b7da24eecd tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:58.908702 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-fa213d5b-50fa-41dd-9066-63b7da24eecd tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 2d709051-db69-4ea9-96dc-ffe05e9c9b3a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:58.913706 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fa213d5b-50fa-41dd-9066-63b7da24eecd tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:58.914535 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fa213d5b-50fa-41dd-9066-63b7da24eecd tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:58.915676 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fa213d5b-50fa-41dd-9066-63b7da24eecd tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:58.916602 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fa213d5b-50fa-41dd-9066-63b7da24eecd tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:58.917953 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fa213d5b-50fa-41dd-9066-63b7da24eecd tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:58.918584 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fa213d5b-50fa-41dd-9066-63b7da24eecd tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:58.957101 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fa213d5b-50fa-41dd-9066-63b7da24eecd tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:58.957678 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fa213d5b-50fa-41dd-9066-63b7da24eecd tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:58.958316 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fa213d5b-50fa-41dd-9066-63b7da24eecd tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:58.958952 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-fa213d5b-50fa-41dd-9066-63b7da24eecd tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lazy-loading 'fault' on Instance uuid 2d709051-db69-4ea9-96dc-ffe05e9c9b3a {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:17:58.989418 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ee4f4f7c-16d8-4ff0-a41e-2c82fe64cc18 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c35b71372843d69f9a6c6be04b154f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcd49d68a3947249016cc5dbe910efc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:58.999062 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ee4f4f7c-16d8-4ff0-a41e-2c82fe64cc18 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] 10.222.0.52 "GET /compute/v2.1/servers/64d3b78b-7953-40fc-ab53-b35f9d105901" status: 200 len: 1674 microversion: 2.1 time: 0.542322 Oct 19 03:17:59.002734 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 882/1692] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:58 2022] GET /compute/v2.1/servers/64d3b78b-7953-40fc-ab53-b35f9d105901 => generated 1674 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:59.048233 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-fa213d5b-50fa-41dd-9066-63b7da24eecd tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4d3ddb3a324d9da51c13701e318955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d909fe7763841d5b452738112b656d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:59.056437 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-fa213d5b-50fa-41dd-9066-63b7da24eecd tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/2d709051-db69-4ea9-96dc-ffe05e9c9b3a" status: 200 len: 1306 microversion: 2.1 time: 0.172326 Oct 19 03:17:59.057566 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 811/1693] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:58 2022] GET /compute/v2.1/servers/2d709051-db69-4ea9-96dc-ffe05e9c9b3a => generated 1306 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:59.171577 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7589107a-3b80-44aa-ba29-d4d05469db6b tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:59.172274 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7589107a-3b80-44aa-ba29-d4d05469db6b tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] [instance: 90f71ec9-e698-4159-9458-2099c1fbfaf3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:59.178771 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7589107a-3b80-44aa-ba29-d4d05469db6b tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:59.179270 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7589107a-3b80-44aa-ba29-d4d05469db6b tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:59.179711 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7589107a-3b80-44aa-ba29-d4d05469db6b tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:59.180446 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7589107a-3b80-44aa-ba29-d4d05469db6b tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:59.180912 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7589107a-3b80-44aa-ba29-d4d05469db6b tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:59.181343 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7589107a-3b80-44aa-ba29-d4d05469db6b tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:59.285922 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7ae5cf4e-3762-49cd-90fa-340991292993 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:59.291327 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-7ae5cf4e-3762-49cd-90fa-340991292993 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '439c1401b92c44228bd6e80dd3b786ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e388d05eac4f2babf180c0709fdc58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:59.294386 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7ae5cf4e-3762-49cd-90fa-340991292993 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Searching by: {'deleted': False, 'project_id': 'f8e388d05eac4f2babf180c0709fdc58'} {{(pid=121134) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 03:17:59.306488 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7ae5cf4e-3762-49cd-90fa-340991292993 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:59.306980 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7ae5cf4e-3762-49cd-90fa-340991292993 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:59.307419 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7ae5cf4e-3762-49cd-90fa-340991292993 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:59.308150 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7ae5cf4e-3762-49cd-90fa-340991292993 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:59.308611 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7ae5cf4e-3762-49cd-90fa-340991292993 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:59.309038 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7ae5cf4e-3762-49cd-90fa-340991292993 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:59.366441 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.multi_cell_list [None req-7ae5cf4e-3762-49cd-90fa-340991292993 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121134) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 03:17:59.427342 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7589107a-3b80-44aa-ba29-d4d05469db6b tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28072a54d5934ea28e7d3205841c0852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c12a432bbd43bd8f70ba6e941c28a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:59.430067 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7ae5cf4e-3762-49cd-90fa-340991292993 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] 10.222.0.52 "GET /compute/v2.1/servers" status: 200 len: 333 microversion: 2.1 time: 0.143990 Oct 19 03:17:59.431048 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 812/1694] 10.222.0.52 () {58 vars in 1125 bytes} [Wed Oct 19 03:17:59 2022] GET /compute/v2.1/servers => generated 333 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:17:59.443508 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a40daefb-7306-4ad5-a728-e3f8e9378b03 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:59.445219 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7589107a-3b80-44aa-ba29-d4d05469db6b tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] 10.222.0.52 "GET /compute/v2.1/servers/90f71ec9-e698-4159-9458-2099c1fbfaf3" status: 200 len: 1513 microversion: 2.1 time: 0.277462 Oct 19 03:17:59.447692 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 883/1695] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:59 2022] GET /compute/v2.1/servers/90f71ec9-e698-4159-9458-2099c1fbfaf3 => generated 1513 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:17:59.457628 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a40daefb-7306-4ad5-a728-e3f8e9378b03 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '439c1401b92c44228bd6e80dd3b786ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e388d05eac4f2babf180c0709fdc58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:59.457628 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a40daefb-7306-4ad5-a728-e3f8e9378b03 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Searching by: {'deleted': False, 'project_id': 'f8e388d05eac4f2babf180c0709fdc58'} {{(pid=121134) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 03:17:59.469065 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a40daefb-7306-4ad5-a728-e3f8e9378b03 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:59.469743 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a40daefb-7306-4ad5-a728-e3f8e9378b03 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:59.470193 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a40daefb-7306-4ad5-a728-e3f8e9378b03 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:59.470924 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a40daefb-7306-4ad5-a728-e3f8e9378b03 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:59.473587 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a40daefb-7306-4ad5-a728-e3f8e9378b03 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:59.474056 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a40daefb-7306-4ad5-a728-e3f8e9378b03 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:59.519538 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-e4b41b2a-f2b6-441f-882b-12a806f0d9b3 req-7532dfc3-9648-4b3b-8177-f952e13ebcb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90f71ec9-e698-4159-9458-2099c1fbfaf3", "name": "network-vif-deleted", "tag": "dd90515a-2014-4fa0-a26c-9f9741b8ce8c"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:17:59.534101 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-e4b41b2a-f2b6-441f-882b-12a806f0d9b3 req-7532dfc3-9648-4b3b-8177-f952e13ebcb3 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:59.534663 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-e4b41b2a-f2b6-441f-882b-12a806f0d9b3 req-7532dfc3-9648-4b3b-8177-f952e13ebcb3 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:59.535175 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-e4b41b2a-f2b6-441f-882b-12a806f0d9b3 req-7532dfc3-9648-4b3b-8177-f952e13ebcb3 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:59.552130 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-e4b41b2a-f2b6-441f-882b-12a806f0d9b3 req-7532dfc3-9648-4b3b-8177-f952e13ebcb3 service nova] Creating event network-vif-deleted:dd90515a-2014-4fa0-a26c-9f9741b8ce8c for instance 90f71ec9-e698-4159-9458-2099c1fbfaf3 on n-h2-861333-8 Oct 19 03:17:59.558724 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-e4b41b2a-f2b6-441f-882b-12a806f0d9b3 req-7532dfc3-9648-4b3b-8177-f952e13ebcb3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044026 Oct 19 03:17:59.563496 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 884/1696] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:17:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:17:59.603709 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.multi_cell_list [None req-a40daefb-7306-4ad5-a728-e3f8e9378b03 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121134) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 03:17:59.693907 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a40daefb-7306-4ad5-a728-e3f8e9378b03 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c1401b92c44228bd6e80dd3b786ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e388d05eac4f2babf180c0709fdc58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:17:59.706079 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a40daefb-7306-4ad5-a728-e3f8e9378b03 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:59.706783 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a40daefb-7306-4ad5-a728-e3f8e9378b03 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:59.707564 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a40daefb-7306-4ad5-a728-e3f8e9378b03 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:59.892122 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a40daefb-7306-4ad5-a728-e3f8e9378b03 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] 10.222.0.52 "GET /compute/v2.1/servers/detail" status: 200 len: 1696 microversion: 2.1 time: 0.452540 Oct 19 03:17:59.892866 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 813/1697] 10.222.0.52 () {58 vars in 1146 bytes} [Wed Oct 19 03:17:59 2022] GET /compute/v2.1/servers/detail => generated 1696 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:17:59.912367 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-20560a4a-737c-46a6-90ec-1c776b63ee26 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:59.913331 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-20560a4a-737c-46a6-90ec-1c776b63ee26 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 84774cfc-79b4-42db-acfd-c4daac86d196] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:17:59.920326 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1a59bb40-2953-410b-9c5e-bca2e8b2b929 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:17:59.921683 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-20560a4a-737c-46a6-90ec-1c776b63ee26 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:59.922385 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-20560a4a-737c-46a6-90ec-1c776b63ee26 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:59.922991 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-20560a4a-737c-46a6-90ec-1c776b63ee26 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:59.923986 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-20560a4a-737c-46a6-90ec-1c776b63ee26 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:17:59.924629 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-20560a4a-737c-46a6-90ec-1c776b63ee26 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:17:59.925238 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-20560a4a-737c-46a6-90ec-1c776b63ee26 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:17:59.929413 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1a59bb40-2953-410b-9c5e-bca2e8b2b929 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] 10.222.0.52 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012993 Oct 19 03:17:59.930775 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 814/1698] 10.222.0.52 () {58 vars in 1137 bytes} [Wed Oct 19 03:17:59 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:18:00.029089 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-78ed4b7c-7c69-4601-8652-ca33dd49b090 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:00.030566 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-78ed4b7c-7c69-4601-8652-ca33dd49b090 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] [instance: 64d3b78b-7953-40fc-ab53-b35f9d105901] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:18:00.046063 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-78ed4b7c-7c69-4601-8652-ca33dd49b090 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:00.046848 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-78ed4b7c-7c69-4601-8652-ca33dd49b090 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:00.047684 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-78ed4b7c-7c69-4601-8652-ca33dd49b090 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:00.050718 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-78ed4b7c-7c69-4601-8652-ca33dd49b090 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:00.051428 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-78ed4b7c-7c69-4601-8652-ca33dd49b090 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:00.052059 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-78ed4b7c-7c69-4601-8652-ca33dd49b090 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:00.197703 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-20560a4a-737c-46a6-90ec-1c776b63ee26 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:18:00.235358 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-20560a4a-737c-46a6-90ec-1c776b63ee26 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196" status: 200 len: 1468 microversion: 2.1 time: 0.328954 Oct 19 03:18:00.245963 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 885/1699] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:17:59 2022] GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196 => generated 1468 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:18:00.261538 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a313f67f-9f03-4138-ab56-b50be2df93a4 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:00.262478 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a313f67f-9f03-4138-ab56-b50be2df93a4 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] [instance: 2d709051-db69-4ea9-96dc-ffe05e9c9b3a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:18:00.272731 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a313f67f-9f03-4138-ab56-b50be2df93a4 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:00.273563 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a313f67f-9f03-4138-ab56-b50be2df93a4 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:00.275158 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a313f67f-9f03-4138-ab56-b50be2df93a4 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:00.277424 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a313f67f-9f03-4138-ab56-b50be2df93a4 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:00.278102 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a313f67f-9f03-4138-ab56-b50be2df93a4 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:00.279055 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a313f67f-9f03-4138-ab56-b50be2df93a4 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:00.297362 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-a313f67f-9f03-4138-ab56-b50be2df93a4 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] HTTP exception thrown: Instance 2d709051-db69-4ea9-96dc-ffe05e9c9b3a could not be found. Oct 19 03:18:00.301060 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a313f67f-9f03-4138-ab56-b50be2df93a4 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Request method failure captured: Oct 19 03:18:00.301060 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/2d709051-db69-4ea9-96dc-ffe05e9c9b3a HTTP/1.1 Oct 19 03:18:00.301060 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:18:00.301060 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:18:00.301060 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:18:00.301060 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:18:00.301060 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:18:00.301060 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:18:00.301060 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:18:00.301060 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:18:00.301060 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2uIr9BvDBnYtOjXORgJ4Qqr6WVLdD9ouG3lYgYuVISlRlRaYBhavBD01rVROkCZkxR9XYWXexaYSEKOFD-WoO2VI67daMYqFdJq0nC95Vi4iLXZzLBKOlmG6HfkRin4f0jmmyKXjHfeDMSqeFm88QUaNhEk881S74x65hVUOW0qpCY Oct 19 03:18:00.301060 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:18:00.301060 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:18:00.301060 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:18:00.301060 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:18:00.301060 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:18:00.301060 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:18:00.301060 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 5d909fe7763841d5b452738112b656d3 Oct 19 03:18:00.301060 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ServersOnMultiNodesTest-1737645722 Oct 19 03:18:00.301060 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:18:00.301060 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:18:00.303064 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5d909fe7763841d5b452738112b656d3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5d909fe7763841d5b452738112b656d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5d909fe7763841d5b452738112b656d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5d909fe7763841d5b452738112b656d3", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:18:00.303064 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ServersOnMultiNodesTest-1737645722 Oct 19 03:18:00.303064 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 5d909fe7763841d5b452738112b656d3 Oct 19 03:18:00.303064 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1737645722 Oct 19 03:18:00.303064 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ServersOnMultiNodesTest-1737645722-project Oct 19 03:18:00.303064 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:18:00.303064 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:18:00.303064 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 3e4d3ddb3a324d9da51c13701e318955 Oct 19 03:18:00.303064 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ServersOnMultiNodesTest-1737645722-project Oct 19 03:18:00.303064 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:18:00.303064 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance 2d709051-db69-4ea9-96dc-ffe05e9c9b3a could not be found. Oct 19 03:18:00.303064 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '2d709051-db69-4ea9-96dc-ffe05e9c9b3a'} Oct 19 03:18:00.303822 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:18:00.303822 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:18:00.303822 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:18:00.303822 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:18:00.303822 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:18:00.303822 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:18:00.303822 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:18:00.303822 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:18:00.303822 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:18:00.303822 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:18:00.303822 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d709051-db69-4ea9-96dc-ffe05e9c9b3a could not be found. Oct 19 03:18:00.303822 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:18:00.303822 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:18:00.303822 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:18:00.303822 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:18:00.303822 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:18:00.303822 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:18:00.303822 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:18:00.303822 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:18:00.303822 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:18:00.305579 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:18:00.305579 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:18:00.305579 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:18:00.305579 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:18:00.305579 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:18:00.305579 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:18:00.305579 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:18:00.305579 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d709051-db69-4ea9-96dc-ffe05e9c9b3a could not be found. Oct 19 03:18:00.305579 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:18:00.305579 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:18:00.305579 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:18:00.305579 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:18:00.305579 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:18:00.305579 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:18:00.305579 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:18:00.305579 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:18:00.305579 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d709051-db69-4ea9-96dc-ffe05e9c9b3a could not be found. Oct 19 03:18:00.305579 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:18:00.308276 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a313f67f-9f03-4138-ab56-b50be2df93a4 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] Returning 404 to user: Instance 2d709051-db69-4ea9-96dc-ffe05e9c9b3a could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:18:00.309751 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a313f67f-9f03-4138-ab56-b50be2df93a4 tempest-ServersOnMultiNodesTest-1737645722 tempest-ServersOnMultiNodesTest-1737645722-project] 10.222.0.52 "GET /compute/v2.1/servers/2d709051-db69-4ea9-96dc-ffe05e9c9b3a" status: 404 len: 111 microversion: 2.1 time: 0.061650 Oct 19 03:18:00.311465 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 886/1700] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:18:00 2022] GET /compute/v2.1/servers/2d709051-db69-4ea9-96dc-ffe05e9c9b3a => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:18:00.374627 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-78ed4b7c-7c69-4601-8652-ca33dd49b090 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c35b71372843d69f9a6c6be04b154f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcd49d68a3947249016cc5dbe910efc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:18:00.382624 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-78ed4b7c-7c69-4601-8652-ca33dd49b090 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] 10.222.0.52 "GET /compute/v2.1/servers/64d3b78b-7953-40fc-ab53-b35f9d105901" status: 200 len: 1674 microversion: 2.1 time: 0.360414 Oct 19 03:18:00.397714 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 815/1701] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:18:00 2022] GET /compute/v2.1/servers/64d3b78b-7953-40fc-ab53-b35f9d105901 => generated 1674 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:18:00.485585 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-04172586-92e4-4ada-b4d1-1a3037a969c8 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:00.487467 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-04172586-92e4-4ada-b4d1-1a3037a969c8 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] [instance: 90f71ec9-e698-4159-9458-2099c1fbfaf3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:18:00.500933 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-04172586-92e4-4ada-b4d1-1a3037a969c8 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:00.505031 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-04172586-92e4-4ada-b4d1-1a3037a969c8 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:00.507503 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-04172586-92e4-4ada-b4d1-1a3037a969c8 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:00.511501 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-04172586-92e4-4ada-b4d1-1a3037a969c8 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:00.514728 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-04172586-92e4-4ada-b4d1-1a3037a969c8 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:00.517972 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-04172586-92e4-4ada-b4d1-1a3037a969c8 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:00.554460 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-af9464f5-204e-4e44-b5b6-6e890f98cf22 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:00.559182 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-af9464f5-204e-4e44-b5b6-6e890f98cf22 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] [instance: b18ae860-ed77-4ddc-b9fa-a2aa773c2614] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:18:00.580737 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-af9464f5-204e-4e44-b5b6-6e890f98cf22 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:00.581251 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-af9464f5-204e-4e44-b5b6-6e890f98cf22 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:00.583509 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-af9464f5-204e-4e44-b5b6-6e890f98cf22 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:00.587057 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-af9464f5-204e-4e44-b5b6-6e890f98cf22 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:00.587571 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-af9464f5-204e-4e44-b5b6-6e890f98cf22 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:00.590717 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-af9464f5-204e-4e44-b5b6-6e890f98cf22 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:00.639528 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-04172586-92e4-4ada-b4d1-1a3037a969c8 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:00.642957 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-04172586-92e4-4ada-b4d1-1a3037a969c8 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:00.644849 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-04172586-92e4-4ada-b4d1-1a3037a969c8 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:00.647095 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-04172586-92e4-4ada-b4d1-1a3037a969c8 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lazy-loading 'fault' on Instance uuid 90f71ec9-e698-4159-9458-2099c1fbfaf3 {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:18:00.684088 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-af9464f5-204e-4e44-b5b6-6e890f98cf22 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] [instance: b18ae860-ed77-4ddc-b9fa-a2aa773c2614] Going to try to terminate instance {{(pid=121134) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:18:00.796200 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-04172586-92e4-4ada-b4d1-1a3037a969c8 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28072a54d5934ea28e7d3205841c0852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c12a432bbd43bd8f70ba6e941c28a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:18:00.812240 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-04172586-92e4-4ada-b4d1-1a3037a969c8 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] 10.222.0.52 "GET /compute/v2.1/servers/90f71ec9-e698-4159-9458-2099c1fbfaf3" status: 200 len: 1307 microversion: 2.1 time: 0.335257 Oct 19 03:18:00.831971 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 887/1702] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:18:00 2022] GET /compute/v2.1/servers/90f71ec9-e698-4159-9458-2099c1fbfaf3 => generated 1307 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:18:01.089866 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-af9464f5-204e-4e44-b5b6-6e890f98cf22 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] 10.222.0.52 "DELETE /compute/v2.1/servers/b18ae860-ed77-4ddc-b9fa-a2aa773c2614" status: 204 len: 0 microversion: 2.1 time: 0.542250 Oct 19 03:18:01.090668 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 816/1703] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:18:00 2022] DELETE /compute/v2.1/servers/b18ae860-ed77-4ddc-b9fa-a2aa773c2614 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:18:01.100774 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4251bc75-f90e-46c8-8379-558dd9c6c4cd tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:01.102637 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4251bc75-f90e-46c8-8379-558dd9c6c4cd tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] [instance: b18ae860-ed77-4ddc-b9fa-a2aa773c2614] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:18:01.126003 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4251bc75-f90e-46c8-8379-558dd9c6c4cd tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:01.126508 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4251bc75-f90e-46c8-8379-558dd9c6c4cd tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:01.126962 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4251bc75-f90e-46c8-8379-558dd9c6c4cd tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:01.129327 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4251bc75-f90e-46c8-8379-558dd9c6c4cd tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:01.129836 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4251bc75-f90e-46c8-8379-558dd9c6c4cd tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:01.132313 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4251bc75-f90e-46c8-8379-558dd9c6c4cd tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:01.264986 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-33099d48-51cc-4d13-8612-0945ba721c2c tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:01.266115 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-33099d48-51cc-4d13-8612-0945ba721c2c tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 84774cfc-79b4-42db-acfd-c4daac86d196] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:18:01.284841 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-33099d48-51cc-4d13-8612-0945ba721c2c tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:01.285694 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-33099d48-51cc-4d13-8612-0945ba721c2c tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:01.287223 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-33099d48-51cc-4d13-8612-0945ba721c2c tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:01.288192 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-33099d48-51cc-4d13-8612-0945ba721c2c tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:01.288878 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-33099d48-51cc-4d13-8612-0945ba721c2c tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:01.290132 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-33099d48-51cc-4d13-8612-0945ba721c2c tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:01.546414 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4251bc75-f90e-46c8-8379-558dd9c6c4cd tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c1401b92c44228bd6e80dd3b786ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e388d05eac4f2babf180c0709fdc58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:18:01.562095 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4251bc75-f90e-46c8-8379-558dd9c6c4cd tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] 10.222.0.52 "GET /compute/v2.1/servers/b18ae860-ed77-4ddc-b9fa-a2aa773c2614" status: 200 len: 1699 microversion: 2.1 time: 0.462003 Oct 19 03:18:01.563045 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 888/1704] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:18:01 2022] GET /compute/v2.1/servers/b18ae860-ed77-4ddc-b9fa-a2aa773c2614 => generated 1699 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:18:01.574217 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-87d1cc80-bfc7-4ac6-a831-37255c474624 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:01.574854 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-87d1cc80-bfc7-4ac6-a831-37255c474624 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] [instance: 64d3b78b-7953-40fc-ab53-b35f9d105901] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:18:01.588828 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-87d1cc80-bfc7-4ac6-a831-37255c474624 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:01.589491 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-87d1cc80-bfc7-4ac6-a831-37255c474624 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:01.589954 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-87d1cc80-bfc7-4ac6-a831-37255c474624 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:01.590687 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-87d1cc80-bfc7-4ac6-a831-37255c474624 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:01.591163 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-87d1cc80-bfc7-4ac6-a831-37255c474624 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:01.591704 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-87d1cc80-bfc7-4ac6-a831-37255c474624 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:01.689265 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-33099d48-51cc-4d13-8612-0945ba721c2c tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:18:01.702719 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-33099d48-51cc-4d13-8612-0945ba721c2c tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196" status: 200 len: 1468 microversion: 2.1 time: 0.444567 Oct 19 03:18:01.704120 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 817/1705] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:18:01 2022] GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196 => generated 1468 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:18:01.844218 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-cf5e9ee2-43c2-4752-b85d-c3b73d603183 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:01.846172 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-cf5e9ee2-43c2-4752-b85d-c3b73d603183 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] [instance: 90f71ec9-e698-4159-9458-2099c1fbfaf3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:18:01.859007 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cf5e9ee2-43c2-4752-b85d-c3b73d603183 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:01.870402 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cf5e9ee2-43c2-4752-b85d-c3b73d603183 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:01.872012 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cf5e9ee2-43c2-4752-b85d-c3b73d603183 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:01.873003 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cf5e9ee2-43c2-4752-b85d-c3b73d603183 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:01.875179 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cf5e9ee2-43c2-4752-b85d-c3b73d603183 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:01.876646 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cf5e9ee2-43c2-4752-b85d-c3b73d603183 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:01.913156 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-cf5e9ee2-43c2-4752-b85d-c3b73d603183 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] HTTP exception thrown: Instance 90f71ec9-e698-4159-9458-2099c1fbfaf3 could not be found. Oct 19 03:18:01.918081 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-cf5e9ee2-43c2-4752-b85d-c3b73d603183 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Request method failure captured: Oct 19 03:18:01.918081 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/90f71ec9-e698-4159-9458-2099c1fbfaf3 HTTP/1.1 Oct 19 03:18:01.918081 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:18:01.918081 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:18:01.918081 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:18:01.918081 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:18:01.918081 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:18:01.918081 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:18:01.918081 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:18:01.918081 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:18:01.918081 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT2uSQ4aghED04QqDPHM1OP-O1PqvSJpkMhOvA7VLgxP4WrhSrQTweV4O6rqjt5wURK2xyXYJZ-SGScyc10Jion_2V1__oTHDWkLSRY_EKfcKBBvcRXZ-A_jVQfVZ3xH7n5g8FZqV34ufD4Ki_71ccq5JWT4fy4EL_1jaMvecF_TX2vU Oct 19 03:18:01.918081 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:18:01.918081 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:18:01.918081 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:18:01.918081 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:18:01.918081 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:18:01.918081 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:18:01.918081 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 48c12a432bbd43bd8f70ba6e941c28a2 Oct 19 03:18:01.918081 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-VolumesAdminNegativeTest-1529332028 Oct 19 03:18:01.918081 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:18:01.918081 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:18:01.919759 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/48c12a432bbd43bd8f70ba6e941c28a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/48c12a432bbd43bd8f70ba6e941c28a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/48c12a432bbd43bd8f70ba6e941c28a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_48c12a432bbd43bd8f70ba6e941c28a2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:18:01.919759 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-VolumesAdminNegativeTest-1529332028 Oct 19 03:18:01.919759 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 48c12a432bbd43bd8f70ba6e941c28a2 Oct 19 03:18:01.919759 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1529332028 Oct 19 03:18:01.919759 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-VolumesAdminNegativeTest-1529332028-project Oct 19 03:18:01.919759 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:18:01.919759 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:18:01.919759 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 28072a54d5934ea28e7d3205841c0852 Oct 19 03:18:01.919759 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-VolumesAdminNegativeTest-1529332028-project Oct 19 03:18:01.919759 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:18:01.919759 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance 90f71ec9-e698-4159-9458-2099c1fbfaf3 could not be found. Oct 19 03:18:01.919759 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '90f71ec9-e698-4159-9458-2099c1fbfaf3'} Oct 19 03:18:01.920746 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:18:01.920746 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:18:01.920746 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:18:01.920746 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:18:01.920746 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:18:01.920746 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:18:01.920746 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:18:01.920746 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:18:01.920746 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:18:01.920746 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:18:01.920746 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90f71ec9-e698-4159-9458-2099c1fbfaf3 could not be found. Oct 19 03:18:01.920746 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:18:01.920746 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:18:01.920746 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:18:01.920746 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:18:01.920746 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:18:01.920746 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:18:01.920746 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:18:01.920746 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:18:01.920746 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:18:01.922253 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:18:01.922253 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:18:01.922253 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:18:01.922253 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:18:01.922253 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:18:01.922253 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:18:01.922253 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:18:01.922253 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90f71ec9-e698-4159-9458-2099c1fbfaf3 could not be found. Oct 19 03:18:01.922253 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:18:01.922253 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:18:01.922253 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:18:01.922253 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:18:01.922253 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:18:01.922253 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:18:01.922253 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:18:01.922253 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:18:01.922253 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90f71ec9-e698-4159-9458-2099c1fbfaf3 could not be found. Oct 19 03:18:01.922253 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:18:01.924921 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-cf5e9ee2-43c2-4752-b85d-c3b73d603183 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Returning 404 to user: Instance 90f71ec9-e698-4159-9458-2099c1fbfaf3 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:18:01.930348 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-cf5e9ee2-43c2-4752-b85d-c3b73d603183 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] 10.222.0.52 "GET /compute/v2.1/servers/90f71ec9-e698-4159-9458-2099c1fbfaf3" status: 404 len: 111 microversion: 2.1 time: 0.087340 Oct 19 03:18:01.934646 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 818/1706] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:18:01 2022] GET /compute/v2.1/servers/90f71ec9-e698-4159-9458-2099c1fbfaf3 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 03:18:02.031846 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-6cdfe5e9-352c-4395-b417-5166d048b6fa req-759db357-a760-4f41-8a26-dbdcd71f15e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64d3b78b-7953-40fc-ab53-b35f9d105901", "name": "network-vif-deleted", "tag": "9eff7474-efea-4e0c-ad56-d68e07689737"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:18:02.032401 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-87d1cc80-bfc7-4ac6-a831-37255c474624 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c35b71372843d69f9a6c6be04b154f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcd49d68a3947249016cc5dbe910efc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:18:02.043363 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-87d1cc80-bfc7-4ac6-a831-37255c474624 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] 10.222.0.52 "GET /compute/v2.1/servers/64d3b78b-7953-40fc-ab53-b35f9d105901" status: 200 len: 1674 microversion: 2.1 time: 0.479193 Oct 19 03:18:02.044390 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 889/1707] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:18:01 2022] GET /compute/v2.1/servers/64d3b78b-7953-40fc-ab53-b35f9d105901 => generated 1674 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:18:02.069806 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-6cdfe5e9-352c-4395-b417-5166d048b6fa req-759db357-a760-4f41-8a26-dbdcd71f15e7 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:02.070312 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-6cdfe5e9-352c-4395-b417-5166d048b6fa req-759db357-a760-4f41-8a26-dbdcd71f15e7 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:02.070795 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-6cdfe5e9-352c-4395-b417-5166d048b6fa req-759db357-a760-4f41-8a26-dbdcd71f15e7 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:02.087053 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-6cdfe5e9-352c-4395-b417-5166d048b6fa req-759db357-a760-4f41-8a26-dbdcd71f15e7 service nova] Creating event network-vif-deleted:9eff7474-efea-4e0c-ad56-d68e07689737 for instance 64d3b78b-7953-40fc-ab53-b35f9d105901 on n-h1-861333-8 Oct 19 03:18:02.093284 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-6cdfe5e9-352c-4395-b417-5166d048b6fa req-759db357-a760-4f41-8a26-dbdcd71f15e7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065465 Oct 19 03:18:02.094665 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 819/1708] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:18:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:18:02.588574 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-95cda91e-2162-48bc-8b6b-6aedebfc2737 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:02.590349 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-95cda91e-2162-48bc-8b6b-6aedebfc2737 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] [instance: b18ae860-ed77-4ddc-b9fa-a2aa773c2614] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:18:02.605465 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-95cda91e-2162-48bc-8b6b-6aedebfc2737 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:02.606297 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-95cda91e-2162-48bc-8b6b-6aedebfc2737 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:02.606920 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-95cda91e-2162-48bc-8b6b-6aedebfc2737 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:02.607815 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-95cda91e-2162-48bc-8b6b-6aedebfc2737 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:02.608430 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-95cda91e-2162-48bc-8b6b-6aedebfc2737 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:02.609017 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-95cda91e-2162-48bc-8b6b-6aedebfc2737 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:02.732977 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f795c222-3550-4a8b-80bd-293837f34a3c tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:02.733731 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f795c222-3550-4a8b-80bd-293837f34a3c tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 84774cfc-79b4-42db-acfd-c4daac86d196] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:18:02.786898 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f795c222-3550-4a8b-80bd-293837f34a3c tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:02.789163 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f795c222-3550-4a8b-80bd-293837f34a3c tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:02.793150 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f795c222-3550-4a8b-80bd-293837f34a3c tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:02.795828 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f795c222-3550-4a8b-80bd-293837f34a3c tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:02.796321 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f795c222-3550-4a8b-80bd-293837f34a3c tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:02.800065 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f795c222-3550-4a8b-80bd-293837f34a3c tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:03.121568 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-95cda91e-2162-48bc-8b6b-6aedebfc2737 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c1401b92c44228bd6e80dd3b786ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e388d05eac4f2babf180c0709fdc58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:18:03.125083 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-95cda91e-2162-48bc-8b6b-6aedebfc2737 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] 10.222.0.52 "GET /compute/v2.1/servers/b18ae860-ed77-4ddc-b9fa-a2aa773c2614" status: 200 len: 1699 microversion: 2.1 time: 0.540879 Oct 19 03:18:03.127126 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 890/1709] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:18:02 2022] GET /compute/v2.1/servers/b18ae860-ed77-4ddc-b9fa-a2aa773c2614 => generated 1699 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:18:03.255650 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-f795c222-3550-4a8b-80bd-293837f34a3c tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:18:03.272926 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f795c222-3550-4a8b-80bd-293837f34a3c tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196" status: 200 len: 1468 microversion: 2.1 time: 0.546108 Oct 19 03:18:03.275318 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 820/1710] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:18:02 2022] GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196 => generated 1468 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:18:03.285709 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-772f327e-32a9-4dc8-b6ff-bbdf75649d6b tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:03.289061 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-772f327e-32a9-4dc8-b6ff-bbdf75649d6b tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] [instance: 64d3b78b-7953-40fc-ab53-b35f9d105901] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:18:03.311550 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-772f327e-32a9-4dc8-b6ff-bbdf75649d6b tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:03.312889 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-772f327e-32a9-4dc8-b6ff-bbdf75649d6b tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:03.313744 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-772f327e-32a9-4dc8-b6ff-bbdf75649d6b tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:03.315320 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-772f327e-32a9-4dc8-b6ff-bbdf75649d6b tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:03.318589 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-772f327e-32a9-4dc8-b6ff-bbdf75649d6b tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:03.323302 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-772f327e-32a9-4dc8-b6ff-bbdf75649d6b tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:03.497357 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-68c7b20e-edd4-450f-8f78-cec59dd30fd7 req-f4056042-b50a-4e3c-9f18-f72406653234 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84774cfc-79b4-42db-acfd-c4daac86d196", "tag": "349ffeb3-81a2-44f2-9775-65ddf0c3a896"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:18:03.532823 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-68c7b20e-edd4-450f-8f78-cec59dd30fd7 req-f4056042-b50a-4e3c-9f18-f72406653234 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:03.533319 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-68c7b20e-edd4-450f-8f78-cec59dd30fd7 req-f4056042-b50a-4e3c-9f18-f72406653234 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:03.533787 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-68c7b20e-edd4-450f-8f78-cec59dd30fd7 req-f4056042-b50a-4e3c-9f18-f72406653234 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:03.580933 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-68c7b20e-edd4-450f-8f78-cec59dd30fd7 req-f4056042-b50a-4e3c-9f18-f72406653234 service nova] Creating event network-changed:349ffeb3-81a2-44f2-9775-65ddf0c3a896 for instance 84774cfc-79b4-42db-acfd-c4daac86d196 on n-h1-861333-8 Oct 19 03:18:03.598088 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [req-68c7b20e-edd4-450f-8f78-cec59dd30fd7 req-f4056042-b50a-4e3c-9f18-f72406653234 service nova] Instance 84774cfc-79b4-42db-acfd-c4daac86d196 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-861333-8', 'n-h1-861333-8'} {{(pid=121135) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 03:18:03.632431 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-68c7b20e-edd4-450f-8f78-cec59dd30fd7 req-f4056042-b50a-4e3c-9f18-f72406653234 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.501522 Oct 19 03:18:03.637236 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 891/1711] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:18:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:18:03.653929 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-fb5c4d7b-df00-4832-af38-9b4153069556 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:03.654663 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-fb5c4d7b-df00-4832-af38-9b4153069556 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] [instance: 62133546-4a75-4532-81ab-0c49c9252e85] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:18:03.678783 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fb5c4d7b-df00-4832-af38-9b4153069556 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:03.678783 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fb5c4d7b-df00-4832-af38-9b4153069556 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:03.678783 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fb5c4d7b-df00-4832-af38-9b4153069556 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:03.678783 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fb5c4d7b-df00-4832-af38-9b4153069556 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:03.679200 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fb5c4d7b-df00-4832-af38-9b4153069556 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:03.679200 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fb5c4d7b-df00-4832-af38-9b4153069556 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:04.103965 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-772f327e-32a9-4dc8-b6ff-bbdf75649d6b tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c35b71372843d69f9a6c6be04b154f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcd49d68a3947249016cc5dbe910efc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:18:04.106476 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:18:04.124480 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-772f327e-32a9-4dc8-b6ff-bbdf75649d6b tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] 10.222.0.52 "GET /compute/v2.1/servers/64d3b78b-7953-40fc-ab53-b35f9d105901" status: 200 len: 1496 microversion: 2.1 time: 0.845023 Oct 19 03:18:04.125760 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 821/1712] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:18:03 2022] GET /compute/v2.1/servers/64d3b78b-7953-40fc-ab53-b35f9d105901 => generated 1496 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:18:04.150490 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-f1ee5a1b-8fd1-4e6e-b371-8db65ef90950 req-b201093c-aef8-41b2-9ce5-4d50029a24b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64d3b78b-7953-40fc-ab53-b35f9d105901", "name": "network-vif-deleted", "tag": "e05f0fbb-41ba-40b6-8c55-8a23a1c1e929"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:18:04.164492 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-f1ee5a1b-8fd1-4e6e-b371-8db65ef90950 req-b201093c-aef8-41b2-9ce5-4d50029a24b4 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:04.164987 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-f1ee5a1b-8fd1-4e6e-b371-8db65ef90950 req-b201093c-aef8-41b2-9ce5-4d50029a24b4 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:04.166677 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-f1ee5a1b-8fd1-4e6e-b371-8db65ef90950 req-b201093c-aef8-41b2-9ce5-4d50029a24b4 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:04.196518 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-f1ee5a1b-8fd1-4e6e-b371-8db65ef90950 req-b201093c-aef8-41b2-9ce5-4d50029a24b4 service nova] Creating event network-vif-deleted:e05f0fbb-41ba-40b6-8c55-8a23a1c1e929 for instance 64d3b78b-7953-40fc-ab53-b35f9d105901 on n-h1-861333-8 Oct 19 03:18:04.203029 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-f1ee5a1b-8fd1-4e6e-b371-8db65ef90950 req-b201093c-aef8-41b2-9ce5-4d50029a24b4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060297 Oct 19 03:18:04.204597 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 822/1713] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:18:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:18:04.210407 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c9f059f7-24a3-4dc2-b7bc-4e220b7d8be6 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:04.211634 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c9f059f7-24a3-4dc2-b7bc-4e220b7d8be6 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] [instance: b18ae860-ed77-4ddc-b9fa-a2aa773c2614] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:18:04.219339 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c9f059f7-24a3-4dc2-b7bc-4e220b7d8be6 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:04.220063 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c9f059f7-24a3-4dc2-b7bc-4e220b7d8be6 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:04.220668 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c9f059f7-24a3-4dc2-b7bc-4e220b7d8be6 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:04.221757 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c9f059f7-24a3-4dc2-b7bc-4e220b7d8be6 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:04.222592 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c9f059f7-24a3-4dc2-b7bc-4e220b7d8be6 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:04.223182 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c9f059f7-24a3-4dc2-b7bc-4e220b7d8be6 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:04.271315 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-fb5c4d7b-df00-4832-af38-9b4153069556 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lazy-loading 'services' on Instance uuid 62133546-4a75-4532-81ab-0c49c9252e85 {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:18:04.302768 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-fb5c4d7b-df00-4832-af38-9b4153069556 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85" status: 200 len: 2341 microversion: 2.25 time: 0.658613 Oct 19 03:18:04.302768 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 892/1714] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:18:03 2022] GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85 => generated 2341 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:18:04.333705 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-310af07c-8f17-4b09-bb65-f9f75e16bf07 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:04.334690 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-310af07c-8f17-4b09-bb65-f9f75e16bf07 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 84774cfc-79b4-42db-acfd-c4daac86d196] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:18:04.342586 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-310af07c-8f17-4b09-bb65-f9f75e16bf07 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:04.344005 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-310af07c-8f17-4b09-bb65-f9f75e16bf07 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:04.344620 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-310af07c-8f17-4b09-bb65-f9f75e16bf07 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:04.345619 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-310af07c-8f17-4b09-bb65-f9f75e16bf07 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:04.346239 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-310af07c-8f17-4b09-bb65-f9f75e16bf07 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:04.346831 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-310af07c-8f17-4b09-bb65-f9f75e16bf07 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:04.656107 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c9f059f7-24a3-4dc2-b7bc-4e220b7d8be6 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c1401b92c44228bd6e80dd3b786ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e388d05eac4f2babf180c0709fdc58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:18:04.665993 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c9f059f7-24a3-4dc2-b7bc-4e220b7d8be6 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] 10.222.0.52 "GET /compute/v2.1/servers/b18ae860-ed77-4ddc-b9fa-a2aa773c2614" status: 200 len: 1699 microversion: 2.1 time: 0.458275 Oct 19 03:18:04.666595 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 823/1715] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:18:04 2022] GET /compute/v2.1/servers/b18ae860-ed77-4ddc-b9fa-a2aa773c2614 => generated 1699 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:18:04.677225 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b5e6349c-1d0a-44a2-b4d6-b175f954b63b tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:04.687644 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b5e6349c-1d0a-44a2-b4d6-b175f954b63b tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:04.687644 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b5e6349c-1d0a-44a2-b4d6-b175f954b63b tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:04.687644 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b5e6349c-1d0a-44a2-b4d6-b175f954b63b tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:04.689638 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b5e6349c-1d0a-44a2-b4d6-b175f954b63b tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:04.690128 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b5e6349c-1d0a-44a2-b4d6-b175f954b63b tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:04.690570 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b5e6349c-1d0a-44a2-b4d6-b175f954b63b tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:04.781303 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b5e6349c-1d0a-44a2-b4d6-b175f954b63b tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.113263 Oct 19 03:18:04.785401 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 824/1716] 10.222.0.52 () {60 vars in 1217 bytes} [Wed Oct 19 03:18:04 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 03:18:05.016264 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-310af07c-8f17-4b09-bb65-f9f75e16bf07 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:18:05.030386 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-310af07c-8f17-4b09-bb65-f9f75e16bf07 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196" status: 200 len: 1468 microversion: 2.1 time: 0.710701 Oct 19 03:18:05.045877 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 893/1717] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:18:04 2022] GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196 => generated 1468 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:18:05.155456 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4a584cb1-6128-40b5-9835-3cde3d5615cb tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:05.156099 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4a584cb1-6128-40b5-9835-3cde3d5615cb tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] [instance: 64d3b78b-7953-40fc-ab53-b35f9d105901] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:18:05.172311 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4a584cb1-6128-40b5-9835-3cde3d5615cb tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:05.172842 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4a584cb1-6128-40b5-9835-3cde3d5615cb tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:05.175690 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4a584cb1-6128-40b5-9835-3cde3d5615cb tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:05.196549 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4a584cb1-6128-40b5-9835-3cde3d5615cb tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:05.199854 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4a584cb1-6128-40b5-9835-3cde3d5615cb tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:05.206421 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4a584cb1-6128-40b5-9835-3cde3d5615cb tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:05.386463 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4a584cb1-6128-40b5-9835-3cde3d5615cb tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:05.388528 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4a584cb1-6128-40b5-9835-3cde3d5615cb tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:05.391226 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4a584cb1-6128-40b5-9835-3cde3d5615cb tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:05.391743 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-4a584cb1-6128-40b5-9835-3cde3d5615cb tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lazy-loading 'fault' on Instance uuid 64d3b78b-7953-40fc-ab53-b35f9d105901 {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:18:05.411037 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-556aeb7d-084f-478b-b0b4-e357c4eea415 tempest-QuotasAdminTestJSON-122121752 tempest-QuotasAdminTestJSON-122121752-project-admin] Calling method '.version_select at 0x7fc135015700>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:05.555806 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4a584cb1-6128-40b5-9835-3cde3d5615cb tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c35b71372843d69f9a6c6be04b154f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcd49d68a3947249016cc5dbe910efc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:18:05.565304 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4a584cb1-6128-40b5-9835-3cde3d5615cb tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] 10.222.0.52 "GET /compute/v2.1/servers/64d3b78b-7953-40fc-ab53-b35f9d105901" status: 200 len: 1303 microversion: 2.1 time: 0.416807 Oct 19 03:18:05.565967 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 894/1718] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:18:05 2022] GET /compute/v2.1/servers/64d3b78b-7953-40fc-ab53-b35f9d105901 => generated 1303 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:18:05.628099 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-556aeb7d-084f-478b-b0b4-e357c4eea415 tempest-QuotasAdminTestJSON-122121752 tempest-QuotasAdminTestJSON-122121752-project-admin] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/4d617361034041039f66b1a1fd283b44" status: 200 len: 371 microversion: 2.1 time: 0.841253 Oct 19 03:18:05.630167 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 825/1719] 10.222.0.52 () {58 vars in 1242 bytes} [Wed Oct 19 03:18:04 2022] GET /compute/v2.1/os-quota-sets/4d617361034041039f66b1a1fd283b44 => generated 371 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:18:05.641460 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d6eace24-cea0-4a9e-9f52-0bcd98e64eb3 tempest-QuotasAdminTestJSON-122121752 tempest-QuotasAdminTestJSON-122121752-project-admin] Action: 'update', calling method: .version_select at 0x7fc1310ccc10>, body: {"quota_set": {"ram": "5120"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:18:05.692020 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-44cbedb1-ac44-4f2d-b821-02018ace8d2c tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:05.692599 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-44cbedb1-ac44-4f2d-b821-02018ace8d2c tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] [instance: b18ae860-ed77-4ddc-b9fa-a2aa773c2614] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:18:05.702970 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-44cbedb1-ac44-4f2d-b821-02018ace8d2c tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:05.703511 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-44cbedb1-ac44-4f2d-b821-02018ace8d2c tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:05.703954 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-44cbedb1-ac44-4f2d-b821-02018ace8d2c tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:05.704670 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-44cbedb1-ac44-4f2d-b821-02018ace8d2c tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:05.705121 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-44cbedb1-ac44-4f2d-b821-02018ace8d2c tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:05.705578 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-44cbedb1-ac44-4f2d-b821-02018ace8d2c tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:05.755692 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d6eace24-cea0-4a9e-9f52-0bcd98e64eb3 tempest-QuotasAdminTestJSON-122121752 tempest-QuotasAdminTestJSON-122121752-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:05.756169 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d6eace24-cea0-4a9e-9f52-0bcd98e64eb3 tempest-QuotasAdminTestJSON-122121752 tempest-QuotasAdminTestJSON-122121752-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:05.760033 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d6eace24-cea0-4a9e-9f52-0bcd98e64eb3 tempest-QuotasAdminTestJSON-122121752 tempest-QuotasAdminTestJSON-122121752-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:05.761199 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d6eace24-cea0-4a9e-9f52-0bcd98e64eb3 tempest-QuotasAdminTestJSON-122121752 tempest-QuotasAdminTestJSON-122121752-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:05.761954 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d6eace24-cea0-4a9e-9f52-0bcd98e64eb3 tempest-QuotasAdminTestJSON-122121752 tempest-QuotasAdminTestJSON-122121752-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:05.762543 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d6eace24-cea0-4a9e-9f52-0bcd98e64eb3 tempest-QuotasAdminTestJSON-122121752 tempest-QuotasAdminTestJSON-122121752-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:05.798540 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-44cbedb1-ac44-4f2d-b821-02018ace8d2c tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c1401b92c44228bd6e80dd3b786ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e388d05eac4f2babf180c0709fdc58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:18:05.811579 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-44cbedb1-ac44-4f2d-b821-02018ace8d2c tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] 10.222.0.52 "GET /compute/v2.1/servers/b18ae860-ed77-4ddc-b9fa-a2aa773c2614" status: 200 len: 1631 microversion: 2.1 time: 0.123146 Oct 19 03:18:05.826759 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 826/1720] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:18:05 2022] GET /compute/v2.1/servers/b18ae860-ed77-4ddc-b9fa-a2aa773c2614 => generated 1631 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:18:05.939728 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:18:05.945613 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d6eace24-cea0-4a9e-9f52-0bcd98e64eb3 tempest-QuotasAdminTestJSON-122121752 tempest-QuotasAdminTestJSON-122121752-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-quota-sets/4d617361034041039f66b1a1fd283b44" status: 200 len: 328 microversion: 2.1 time: 0.308362 Oct 19 03:18:05.946572 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 895/1721] 10.222.0.52 () {60 vars in 1262 bytes} [Wed Oct 19 03:18:05 2022] PUT /compute/v2.1/os-quota-sets/4d617361034041039f66b1a1fd283b44 => generated 328 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:18:05.959165 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-26b05af9-01c2-4d6e-af94-3f78ae4ba9d2 tempest-QuotasAdminTestJSON-122121752 tempest-QuotasAdminTestJSON-122121752-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:06.061641 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-043970e1-1614-4a86-ad4f-693152913476 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:06.061641 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-043970e1-1614-4a86-ad4f-693152913476 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 84774cfc-79b4-42db-acfd-c4daac86d196] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:18:06.066120 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-043970e1-1614-4a86-ad4f-693152913476 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:06.066622 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-043970e1-1614-4a86-ad4f-693152913476 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:06.067066 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-043970e1-1614-4a86-ad4f-693152913476 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:06.067848 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-043970e1-1614-4a86-ad4f-693152913476 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:06.068305 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-043970e1-1614-4a86-ad4f-693152913476 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:06.068742 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-043970e1-1614-4a86-ad4f-693152913476 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:06.082557 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-26b05af9-01c2-4d6e-af94-3f78ae4ba9d2 tempest-QuotasAdminTestJSON-122121752 tempest-QuotasAdminTestJSON-122121752-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-quota-sets/4d617361034041039f66b1a1fd283b44" status: 202 len: 0 microversion: 2.1 time: 0.127739 Oct 19 03:18:06.083412 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 827/1722] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Oct 19 03:18:05 2022] DELETE /compute/v2.1/os-quota-sets/4d617361034041039f66b1a1fd283b44 => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:18:06.094433 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-fa57e748-cca0-4cf9-bb22-c5947529266f tempest-QuotasAdminTestJSON-122121752 tempest-QuotasAdminTestJSON-122121752-project-admin] Calling method '.version_select at 0x7fc134f25b80>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:06.312449 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-043970e1-1614-4a86-ad4f-693152913476 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:18:06.324492 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-043970e1-1614-4a86-ad4f-693152913476 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196" status: 200 len: 1468 microversion: 2.1 time: 0.269948 Oct 19 03:18:06.325123 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 896/1723] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:18:06 2022] GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196 => generated 1468 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:18:06.536968 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-fa57e748-cca0-4cf9-bb22-c5947529266f tempest-QuotasAdminTestJSON-122121752 tempest-QuotasAdminTestJSON-122121752-project-admin] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/4d617361034041039f66b1a1fd283b44" status: 200 len: 371 microversion: 2.1 time: 0.447559 Oct 19 03:18:06.540522 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 828/1724] 10.222.0.52 () {58 vars in 1242 bytes} [Wed Oct 19 03:18:06 2022] GET /compute/v2.1/os-quota-sets/4d617361034041039f66b1a1fd283b44 => generated 371 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:18:06.590474 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5cb99dba-ede3-402e-8e1c-8a3dcaaa528a tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:06.591366 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-5cb99dba-ede3-402e-8e1c-8a3dcaaa528a tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] [instance: 64d3b78b-7953-40fc-ab53-b35f9d105901] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:18:06.607431 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5cb99dba-ede3-402e-8e1c-8a3dcaaa528a tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:06.608320 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5cb99dba-ede3-402e-8e1c-8a3dcaaa528a tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:06.632916 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5cb99dba-ede3-402e-8e1c-8a3dcaaa528a tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:06.640111 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5cb99dba-ede3-402e-8e1c-8a3dcaaa528a tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:06.641667 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5cb99dba-ede3-402e-8e1c-8a3dcaaa528a tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:06.642385 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5cb99dba-ede3-402e-8e1c-8a3dcaaa528a tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:06.748431 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5cb99dba-ede3-402e-8e1c-8a3dcaaa528a tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:06.749744 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5cb99dba-ede3-402e-8e1c-8a3dcaaa528a tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:06.750461 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5cb99dba-ede3-402e-8e1c-8a3dcaaa528a tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:06.751203 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-5cb99dba-ede3-402e-8e1c-8a3dcaaa528a tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lazy-loading 'fault' on Instance uuid 64d3b78b-7953-40fc-ab53-b35f9d105901 {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:18:06.823727 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-7dd24922-0a9f-4a88-97e0-26dcc63bd607 req-9ddacadd-26e0-4b31-be69-a1c18d9ca3ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b18ae860-ed77-4ddc-b9fa-a2aa773c2614", "name": "network-vif-deleted", "tag": "a42ed099-3fb2-4b70-8cb8-870751bbcc54"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:18:06.824444 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-5cb99dba-ede3-402e-8e1c-8a3dcaaa528a tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c35b71372843d69f9a6c6be04b154f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcd49d68a3947249016cc5dbe910efc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:18:06.834574 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5cb99dba-ede3-402e-8e1c-8a3dcaaa528a tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] 10.222.0.52 "GET /compute/v2.1/servers/64d3b78b-7953-40fc-ab53-b35f9d105901" status: 200 len: 1303 microversion: 2.1 time: 0.249412 Oct 19 03:18:06.840429 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 897/1725] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:18:06 2022] GET /compute/v2.1/servers/64d3b78b-7953-40fc-ab53-b35f9d105901 => generated 1303 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:18:06.845606 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5becb492-934c-4b52-8edc-551734e63691 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:06.854649 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-5becb492-934c-4b52-8edc-551734e63691 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] [instance: b18ae860-ed77-4ddc-b9fa-a2aa773c2614] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:18:06.872186 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-7dd24922-0a9f-4a88-97e0-26dcc63bd607 req-9ddacadd-26e0-4b31-be69-a1c18d9ca3ca service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:06.872186 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-7dd24922-0a9f-4a88-97e0-26dcc63bd607 req-9ddacadd-26e0-4b31-be69-a1c18d9ca3ca service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:06.872368 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5becb492-934c-4b52-8edc-551734e63691 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:06.872368 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5becb492-934c-4b52-8edc-551734e63691 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:06.872538 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-7dd24922-0a9f-4a88-97e0-26dcc63bd607 req-9ddacadd-26e0-4b31-be69-a1c18d9ca3ca service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:06.872619 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5becb492-934c-4b52-8edc-551734e63691 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:06.872619 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5becb492-934c-4b52-8edc-551734e63691 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:06.873715 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5becb492-934c-4b52-8edc-551734e63691 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:06.874462 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5becb492-934c-4b52-8edc-551734e63691 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:06.916233 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-7dd24922-0a9f-4a88-97e0-26dcc63bd607 req-9ddacadd-26e0-4b31-be69-a1c18d9ca3ca service nova] Creating event network-vif-deleted:a42ed099-3fb2-4b70-8cb8-870751bbcc54 for instance b18ae860-ed77-4ddc-b9fa-a2aa773c2614 on n-h1-861333-8 Oct 19 03:18:06.933306 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-7dd24922-0a9f-4a88-97e0-26dcc63bd607 req-9ddacadd-26e0-4b31-be69-a1c18d9ca3ca service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113927 Oct 19 03:18:06.938176 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 829/1726] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:18:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:18:06.946976 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3bfba7c6-aef3-4d2c-b0a6-571ecd33a86f tempest-QuotasAdminTestJSON-122121752 tempest-QuotasAdminTestJSON-122121752-project-admin] Calling method '.version_select at 0x7fc13057bf70>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:06.968959 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-5becb492-934c-4b52-8edc-551734e63691 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c1401b92c44228bd6e80dd3b786ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e388d05eac4f2babf180c0709fdc58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:18:06.977711 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5becb492-934c-4b52-8edc-551734e63691 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] 10.222.0.52 "GET /compute/v2.1/servers/b18ae860-ed77-4ddc-b9fa-a2aa773c2614" status: 200 len: 1631 microversion: 2.1 time: 0.135900 Oct 19 03:18:06.997878 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 898/1727] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:18:06 2022] GET /compute/v2.1/servers/b18ae860-ed77-4ddc-b9fa-a2aa773c2614 => generated 1631 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:18:07.443058 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-fba1b6f2-033c-4e21-b6cb-8ebc847b0fa0 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Action: 'create', calling method: .version_select at 0x7fc130ede700>, body: {"keypair": {"name": "tempest-keypair-1307991980", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIvYMINmQUdeTJI1O3DyyQtLimCaaex6pOBPtPlWGNsMsFXvGpJW66hBdoMQ/nGKINjPmCZus3Q/C4DhW9YDonC/aHeacqb83OIUYjPeVvXIKykFiAQ/qXxWZKTRMLf94A=="}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:18:07.487696 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-fba1b6f2-033c-4e21-b6cb-8ebc847b0fa0 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Getting quotas for project ce8d13fab4fe4725a4759519818113f0. Resources: {'key_pairs'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:18:07.500655 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-fba1b6f2-033c-4e21-b6cb-8ebc847b0fa0 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Getting quotas for user 28ec45c74dcd448e924be40b1abfbc4a and project ce8d13fab4fe4725a4759519818113f0. Resources: {'key_pairs'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:18:07.593699 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3bfba7c6-aef3-4d2c-b0a6-571ecd33a86f tempest-QuotasAdminTestJSON-122121752 tempest-QuotasAdminTestJSON-122121752-project-admin] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/c5d97a25e1314c90af449604c79ab228/defaults" status: 200 len: 371 microversion: 2.1 time: 0.654103 Oct 19 03:18:07.594650 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 830/1728] 10.222.0.52 () {58 vars in 1269 bytes} [Wed Oct 19 03:18:06 2022] GET /compute/v2.1/os-quota-sets/c5d97a25e1314c90af449604c79ab228/defaults => generated 371 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:18:07.603159 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-fba1b6f2-033c-4e21-b6cb-8ebc847b0fa0 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.484304 Oct 19 03:18:07.604195 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 899/1729] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Oct 19 03:18:07 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:18:07.627554 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7d8560df-f753-44cc-95ac-b9782f4ed2c3 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:07.630191 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7d8560df-f753-44cc-95ac-b9782f4ed2c3 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 84774cfc-79b4-42db-acfd-c4daac86d196] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:18:07.669534 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7d8560df-f753-44cc-95ac-b9782f4ed2c3 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:07.670048 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7d8560df-f753-44cc-95ac-b9782f4ed2c3 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:07.670498 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7d8560df-f753-44cc-95ac-b9782f4ed2c3 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:07.671219 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7d8560df-f753-44cc-95ac-b9782f4ed2c3 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:07.674319 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7d8560df-f753-44cc-95ac-b9782f4ed2c3 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:07.685103 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7d8560df-f753-44cc-95ac-b9782f4ed2c3 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:07.869251 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-28bbbc8b-e747-4ecc-af21-77ac8055926f tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:07.870111 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-28bbbc8b-e747-4ecc-af21-77ac8055926f tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] [instance: 64d3b78b-7953-40fc-ab53-b35f9d105901] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:18:07.883638 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-28bbbc8b-e747-4ecc-af21-77ac8055926f tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:07.884140 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-28bbbc8b-e747-4ecc-af21-77ac8055926f tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:07.887696 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-28bbbc8b-e747-4ecc-af21-77ac8055926f tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:07.888530 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-28bbbc8b-e747-4ecc-af21-77ac8055926f tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:07.889030 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-28bbbc8b-e747-4ecc-af21-77ac8055926f tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:07.889756 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-28bbbc8b-e747-4ecc-af21-77ac8055926f tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:07.961882 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-28bbbc8b-e747-4ecc-af21-77ac8055926f tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:07.962483 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-28bbbc8b-e747-4ecc-af21-77ac8055926f tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:07.966831 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-28bbbc8b-e747-4ecc-af21-77ac8055926f tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:07.967619 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-28bbbc8b-e747-4ecc-af21-77ac8055926f tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lazy-loading 'fault' on Instance uuid 64d3b78b-7953-40fc-ab53-b35f9d105901 {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:18:07.978868 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=100 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:18:08.229628 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-28bbbc8b-e747-4ecc-af21-77ac8055926f tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c35b71372843d69f9a6c6be04b154f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcd49d68a3947249016cc5dbe910efc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:18:08.251919 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-28bbbc8b-e747-4ecc-af21-77ac8055926f tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] 10.222.0.52 "GET /compute/v2.1/servers/64d3b78b-7953-40fc-ab53-b35f9d105901" status: 200 len: 1303 microversion: 2.1 time: 0.382293 Oct 19 03:18:08.256239 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 900/1730] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:18:07 2022] GET /compute/v2.1/servers/64d3b78b-7953-40fc-ab53-b35f9d105901 => generated 1303 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:18:08.269066 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-96499b16-cfd6-4108-9df8-d4ad036c0fc7 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:08.272562 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-96499b16-cfd6-4108-9df8-d4ad036c0fc7 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] [instance: b18ae860-ed77-4ddc-b9fa-a2aa773c2614] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:18:08.311291 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-96499b16-cfd6-4108-9df8-d4ad036c0fc7 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:08.316686 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-96499b16-cfd6-4108-9df8-d4ad036c0fc7 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:08.321187 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-96499b16-cfd6-4108-9df8-d4ad036c0fc7 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:08.326851 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-96499b16-cfd6-4108-9df8-d4ad036c0fc7 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:08.329270 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-96499b16-cfd6-4108-9df8-d4ad036c0fc7 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:08.329762 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-96499b16-cfd6-4108-9df8-d4ad036c0fc7 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:08.407356 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-7d8560df-f753-44cc-95ac-b9782f4ed2c3 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:18:08.411332 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-96499b16-cfd6-4108-9df8-d4ad036c0fc7 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:08.411744 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-96499b16-cfd6-4108-9df8-d4ad036c0fc7 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:08.412235 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-96499b16-cfd6-4108-9df8-d4ad036c0fc7 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:08.412692 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-96499b16-cfd6-4108-9df8-d4ad036c0fc7 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lazy-loading 'fault' on Instance uuid b18ae860-ed77-4ddc-b9fa-a2aa773c2614 {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:18:08.418541 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7d8560df-f753-44cc-95ac-b9782f4ed2c3 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196" status: 200 len: 1468 microversion: 2.1 time: 0.813205 Oct 19 03:18:08.424177 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 831/1731] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:18:07 2022] GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196 => generated 1468 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:18:08.444867 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-91e2e8bb-f3db-4051-85d5-7b93f989ae89 tempest-QuotasAdminTestJSON-122121752 tempest-QuotasAdminTestJSON-122121752-project-admin] Action: 'update', calling method: .version_select at 0x7fc13057be50>, body: {"quota_set": {"ram": "5120"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:18:08.549699 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-96499b16-cfd6-4108-9df8-d4ad036c0fc7 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c1401b92c44228bd6e80dd3b786ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e388d05eac4f2babf180c0709fdc58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:18:08.565139 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-96499b16-cfd6-4108-9df8-d4ad036c0fc7 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] 10.222.0.52 "GET /compute/v2.1/servers/b18ae860-ed77-4ddc-b9fa-a2aa773c2614" status: 200 len: 1359 microversion: 2.1 time: 0.305846 Oct 19 03:18:08.567841 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 901/1732] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:18:08 2022] GET /compute/v2.1/servers/b18ae860-ed77-4ddc-b9fa-a2aa773c2614 => generated 1359 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:18:08.583660 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-17f6938f-51ce-4ea4-8010-c2f29939bd1c tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "17b87dbc-6669-4eea-8547-0fdfea7ce804", "device": "/dev/xvdb"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:18:08.599151 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-17f6938f-51ce-4ea4-8010-c2f29939bd1c tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 62133546-4a75-4532-81ab-0c49c9252e85] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:18:08.613053 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-17f6938f-51ce-4ea4-8010-c2f29939bd1c tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:08.613582 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-17f6938f-51ce-4ea4-8010-c2f29939bd1c tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:08.614029 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-17f6938f-51ce-4ea4-8010-c2f29939bd1c tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:08.614891 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-17f6938f-51ce-4ea4-8010-c2f29939bd1c tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:08.618336 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-17f6938f-51ce-4ea4-8010-c2f29939bd1c tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:08.618796 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-17f6938f-51ce-4ea4-8010-c2f29939bd1c tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:08.944956 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-91e2e8bb-f3db-4051-85d5-7b93f989ae89 tempest-QuotasAdminTestJSON-122121752 tempest-QuotasAdminTestJSON-122121752-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:08.945523 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-91e2e8bb-f3db-4051-85d5-7b93f989ae89 tempest-QuotasAdminTestJSON-122121752 tempest-QuotasAdminTestJSON-122121752-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:08.945930 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-91e2e8bb-f3db-4051-85d5-7b93f989ae89 tempest-QuotasAdminTestJSON-122121752 tempest-QuotasAdminTestJSON-122121752-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:08.946671 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-91e2e8bb-f3db-4051-85d5-7b93f989ae89 tempest-QuotasAdminTestJSON-122121752 tempest-QuotasAdminTestJSON-122121752-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:08.947126 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-91e2e8bb-f3db-4051-85d5-7b93f989ae89 tempest-QuotasAdminTestJSON-122121752 tempest-QuotasAdminTestJSON-122121752-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:08.947548 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-91e2e8bb-f3db-4051-85d5-7b93f989ae89 tempest-QuotasAdminTestJSON-122121752 tempest-QuotasAdminTestJSON-122121752-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:09.151158 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-91e2e8bb-f3db-4051-85d5-7b93f989ae89 tempest-QuotasAdminTestJSON-122121752 tempest-QuotasAdminTestJSON-122121752-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-quota-sets/2dd4bb9adce8469e8af53c8c716a20b7" status: 200 len: 328 microversion: 2.1 time: 0.726302 Oct 19 03:18:09.153123 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 832/1733] 10.222.0.52 () {60 vars in 1262 bytes} [Wed Oct 19 03:18:08 2022] PUT /compute/v2.1/os-quota-sets/2dd4bb9adce8469e8af53c8c716a20b7 => generated 328 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:18:09.270903 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-09ad4b9c-5476-4ad8-9d3f-51ab0f1f25bd tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-462268554", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:18:09.346579 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-09ad4b9c-5476-4ad8-9d3f-51ab0f1f25bd tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] validate_networks() for None {{(pid=121134) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:18:09.708057 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-09ad4b9c-5476-4ad8-9d3f-51ab0f1f25bd tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Flavor limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:18:09.708481 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-09ad4b9c-5476-4ad8-9d3f-51ab0f1f25bd tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Image limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:18:09.708962 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-09ad4b9c-5476-4ad8-9d3f-51ab0f1f25bd tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Flavor pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:18:09.709593 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-09ad4b9c-5476-4ad8-9d3f-51ab0f1f25bd tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Image pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:18:09.710160 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-09ad4b9c-5476-4ad8-9d3f-51ab0f1f25bd tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:18:09.725011 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-09ad4b9c-5476-4ad8-9d3f-51ab0f1f25bd tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:09.726048 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-09ad4b9c-5476-4ad8-9d3f-51ab0f1f25bd tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:09.726504 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-09ad4b9c-5476-4ad8-9d3f-51ab0f1f25bd tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:09.727283 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-09ad4b9c-5476-4ad8-9d3f-51ab0f1f25bd tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:09.727746 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-09ad4b9c-5476-4ad8-9d3f-51ab0f1f25bd tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:09.728177 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-09ad4b9c-5476-4ad8-9d3f-51ab0f1f25bd tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:09.749742 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-09ad4b9c-5476-4ad8-9d3f-51ab0f1f25bd tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Getting quotas for project 84273e394171452c947ec32bf639054d. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:18:09.755902 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-09ad4b9c-5476-4ad8-9d3f-51ab0f1f25bd tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Getting quotas for user cffa4ce5ed5743a09717ab06218e73bc and project 84273e394171452c947ec32bf639054d. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:18:09.771796 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-09ad4b9c-5476-4ad8-9d3f-51ab0f1f25bd tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Going to run 1 instances... {{(pid=121134) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:18:09.775253 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-09ad4b9c-5476-4ad8-9d3f-51ab0f1f25bd tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] [instance: 1c904d5d-95bc-43ef-9826-22311512565c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:18:09.790515 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:UPDATE=3,nova_api:SELECT=93,nova_api:DELETE=2,nova_api:INSERT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:18:09.971416 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-17f6938f-51ce-4ea4-8010-c2f29939bd1c tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "POST /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 1.401452 Oct 19 03:18:09.983946 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 902/1734] 10.222.0.52 () {62 vars in 1364 bytes} [Wed Oct 19 03:18:08 2022] POST /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85/os-volume_attachments => generated 194 bytes in 1415 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 03:18:10.015482 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5d3c844e-c4e3-4afc-be1d-6ea301d69acc tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:10.020078 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-5d3c844e-c4e3-4afc-be1d-6ea301d69acc tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] [instance: 540a7025-b935-49fb-bc51-edf44ac1e0c4] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:18:10.026976 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-09ad4b9c-5476-4ad8-9d3f-51ab0f1f25bd tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.871988 Oct 19 03:18:10.038519 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 833/1735] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:18:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 878 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 03:18:10.045148 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-60104f3b-4385-4062-aa3b-d94965a1985c tempest-QuotasAdminTestJSON-122121752 tempest-QuotasAdminTestJSON-122121752-project-admin] Calling method '.version_select at 0x7fc13056f670>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:10.045580 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5d3c844e-c4e3-4afc-be1d-6ea301d69acc tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:10.050016 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5d3c844e-c4e3-4afc-be1d-6ea301d69acc tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:10.050482 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5d3c844e-c4e3-4afc-be1d-6ea301d69acc tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:10.057800 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5d3c844e-c4e3-4afc-be1d-6ea301d69acc tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:10.058329 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5d3c844e-c4e3-4afc-be1d-6ea301d69acc tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:10.058784 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5d3c844e-c4e3-4afc-be1d-6ea301d69acc tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:10.099968 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-5d3c844e-c4e3-4afc-be1d-6ea301d69acc tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] [instance: 540a7025-b935-49fb-bc51-edf44ac1e0c4] Going to try to terminate instance {{(pid=121135) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:18:10.240817 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-60104f3b-4385-4062-aa3b-d94965a1985c tempest-QuotasAdminTestJSON-122121752 tempest-QuotasAdminTestJSON-122121752-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:10.249973 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-60104f3b-4385-4062-aa3b-d94965a1985c tempest-QuotasAdminTestJSON-122121752 tempest-QuotasAdminTestJSON-122121752-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:10.250462 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-60104f3b-4385-4062-aa3b-d94965a1985c tempest-QuotasAdminTestJSON-122121752 tempest-QuotasAdminTestJSON-122121752-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:10.264063 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-60104f3b-4385-4062-aa3b-d94965a1985c tempest-QuotasAdminTestJSON-122121752 tempest-QuotasAdminTestJSON-122121752-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:10.264211 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-60104f3b-4385-4062-aa3b-d94965a1985c tempest-QuotasAdminTestJSON-122121752 tempest-QuotasAdminTestJSON-122121752-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:10.266459 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-60104f3b-4385-4062-aa3b-d94965a1985c tempest-QuotasAdminTestJSON-122121752 tempest-QuotasAdminTestJSON-122121752-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:10.340413 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-60104f3b-4385-4062-aa3b-d94965a1985c tempest-QuotasAdminTestJSON-122121752 tempest-QuotasAdminTestJSON-122121752-project-admin] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/2dd4bb9adce8469e8af53c8c716a20b7/detail" status: 200 len: 916 microversion: 2.1 time: 0.305334 Oct 19 03:18:10.347895 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 834/1736] 10.222.0.52 () {58 vars in 1263 bytes} [Wed Oct 19 03:18:10 2022] GET /compute/v2.1/os-quota-sets/2dd4bb9adce8469e8af53c8c716a20b7/detail => generated 916 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:18:10.364887 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ae90f8c2-865a-4ca3-9820-6b17ff48df51 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:10.366374 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ae90f8c2-865a-4ca3-9820-6b17ff48df51 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] [instance: 64d3b78b-7953-40fc-ab53-b35f9d105901] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:18:10.382177 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ae90f8c2-865a-4ca3-9820-6b17ff48df51 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:10.397135 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ae90f8c2-865a-4ca3-9820-6b17ff48df51 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:10.399844 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ae90f8c2-865a-4ca3-9820-6b17ff48df51 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:10.404524 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ae90f8c2-865a-4ca3-9820-6b17ff48df51 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:10.406751 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ae90f8c2-865a-4ca3-9820-6b17ff48df51 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:10.414953 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ae90f8c2-865a-4ca3-9820-6b17ff48df51 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:10.481705 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-ae90f8c2-865a-4ca3-9820-6b17ff48df51 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] HTTP exception thrown: Instance 64d3b78b-7953-40fc-ab53-b35f9d105901 could not be found. Oct 19 03:18:10.489122 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ae90f8c2-865a-4ca3-9820-6b17ff48df51 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Request method failure captured: Oct 19 03:18:10.489122 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/64d3b78b-7953-40fc-ab53-b35f9d105901 HTTP/1.1 Oct 19 03:18:10.489122 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:18:10.489122 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:18:10.489122 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:18:10.489122 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:18:10.489122 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:18:10.489122 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:18:10.489122 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:18:10.489122 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:18:10.489122 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT2wRGEgYhAdPsgc7mEIDXrdPW4JwqYu1MFCRMWCDsXcKjxkHFT1VoJipXbbUg2wfFTgPSaTND8ANvmvXBbh_VcZiPRiOiOyyyOWkSDVD8anQKzoySXT9c8aNAT4O4UZ5kRq3Qlkx_fDPQls23gexwMFV2EY3yHLkKn1iQsrIizdgtLc Oct 19 03:18:10.489122 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:18:10.489122 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:18:10.489122 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:18:10.489122 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:18:10.489122 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:18:10.489122 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:18:10.489122 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 0fcd49d68a3947249016cc5dbe910efc Oct 19 03:18:10.489122 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ServersTestMultiNic-1638692278 Oct 19 03:18:10.489122 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:18:10.489122 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:18:10.495857 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/0fcd49d68a3947249016cc5dbe910efc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0fcd49d68a3947249016cc5dbe910efc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0fcd49d68a3947249016cc5dbe910efc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_0fcd49d68a3947249016cc5dbe910efc", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:18:10.495857 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ServersTestMultiNic-1638692278 Oct 19 03:18:10.495857 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 0fcd49d68a3947249016cc5dbe910efc Oct 19 03:18:10.495857 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ServersTestMultiNic-1638692278 Oct 19 03:18:10.495857 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ServersTestMultiNic-1638692278-project Oct 19 03:18:10.495857 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:18:10.495857 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:18:10.495857 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: d3c35b71372843d69f9a6c6be04b154f Oct 19 03:18:10.495857 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ServersTestMultiNic-1638692278-project Oct 19 03:18:10.495857 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:18:10.495857 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance 64d3b78b-7953-40fc-ab53-b35f9d105901 could not be found. Oct 19 03:18:10.495857 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '64d3b78b-7953-40fc-ab53-b35f9d105901'} Oct 19 03:18:10.496632 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:18:10.496632 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:18:10.496632 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:18:10.496632 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:18:10.496632 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:18:10.496632 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:18:10.496632 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:18:10.496632 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:18:10.496632 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:18:10.496632 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:18:10.496632 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64d3b78b-7953-40fc-ab53-b35f9d105901 could not be found. Oct 19 03:18:10.496632 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:18:10.496632 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:18:10.496632 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:18:10.496632 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:18:10.496632 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:18:10.496632 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:18:10.496632 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:18:10.496632 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:18:10.496632 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:18:10.499839 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:18:10.499839 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:18:10.499839 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:18:10.499839 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:18:10.499839 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:18:10.499839 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:18:10.499839 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:18:10.499839 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64d3b78b-7953-40fc-ab53-b35f9d105901 could not be found. Oct 19 03:18:10.499839 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:18:10.499839 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:18:10.499839 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:18:10.499839 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:18:10.499839 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:18:10.499839 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:18:10.499839 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:18:10.499839 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:18:10.499839 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64d3b78b-7953-40fc-ab53-b35f9d105901 could not be found. Oct 19 03:18:10.499839 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:18:10.502208 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ae90f8c2-865a-4ca3-9820-6b17ff48df51 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Returning 404 to user: Instance 64d3b78b-7953-40fc-ab53-b35f9d105901 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:18:10.502208 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ae90f8c2-865a-4ca3-9820-6b17ff48df51 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] 10.222.0.52 "GET /compute/v2.1/servers/64d3b78b-7953-40fc-ab53-b35f9d105901" status: 404 len: 111 microversion: 2.1 time: 0.141461 Oct 19 03:18:10.502208 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 835/1737] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:18:10 2022] GET /compute/v2.1/servers/64d3b78b-7953-40fc-ab53-b35f9d105901 => generated 111 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:18:10.520350 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b2a13970-b556-4a69-8bcd-7e64e0e1bf82 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:10.520350 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b2a13970-b556-4a69-8bcd-7e64e0e1bf82 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 84774cfc-79b4-42db-acfd-c4daac86d196] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:18:10.545065 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b2a13970-b556-4a69-8bcd-7e64e0e1bf82 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:10.549648 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b2a13970-b556-4a69-8bcd-7e64e0e1bf82 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:10.550138 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b2a13970-b556-4a69-8bcd-7e64e0e1bf82 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:10.550888 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b2a13970-b556-4a69-8bcd-7e64e0e1bf82 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:10.551365 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b2a13970-b556-4a69-8bcd-7e64e0e1bf82 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:10.551803 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b2a13970-b556-4a69-8bcd-7e64e0e1bf82 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:10.614910 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5d3c844e-c4e3-4afc-be1d-6ea301d69acc tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] 10.222.0.52 "DELETE /compute/v2.1/servers/540a7025-b935-49fb-bc51-edf44ac1e0c4" status: 204 len: 0 microversion: 2.1 time: 0.623085 Oct 19 03:18:10.614910 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 903/1738] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:18:09 2022] DELETE /compute/v2.1/servers/540a7025-b935-49fb-bc51-edf44ac1e0c4 => generated 0 bytes in 625 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:18:10.618028 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-13f836dd-f1fb-49fa-bb52-9219914431d0 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:10.619418 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-13f836dd-f1fb-49fa-bb52-9219914431d0 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] [instance: b18ae860-ed77-4ddc-b9fa-a2aa773c2614] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:18:10.635867 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-13f836dd-f1fb-49fa-bb52-9219914431d0 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:10.638504 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-13f836dd-f1fb-49fa-bb52-9219914431d0 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:10.638504 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-13f836dd-f1fb-49fa-bb52-9219914431d0 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:10.641614 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-13f836dd-f1fb-49fa-bb52-9219914431d0 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:10.642159 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-13f836dd-f1fb-49fa-bb52-9219914431d0 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:10.642706 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-13f836dd-f1fb-49fa-bb52-9219914431d0 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:10.671772 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-13f836dd-f1fb-49fa-bb52-9219914431d0 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] HTTP exception thrown: Instance b18ae860-ed77-4ddc-b9fa-a2aa773c2614 could not be found. Oct 19 03:18:10.682003 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-13f836dd-f1fb-49fa-bb52-9219914431d0 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Request method failure captured: Oct 19 03:18:10.682003 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/b18ae860-ed77-4ddc-b9fa-a2aa773c2614 HTTP/1.1 Oct 19 03:18:10.682003 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:18:10.682003 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:18:10.682003 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:18:10.682003 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:18:10.682003 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:18:10.682003 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:18:10.682003 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:18:10.682003 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:18:10.682003 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2vU-ixyYS6j9LIu_8FlZPBCfxHAGoSeQSuVl8QxvD8KukBBmYWbysDH4Uz8eagOII9oWEnlNgDiL_HgydvjTo7D0Ji4_cxw3F-1abIeCyKEdW5pEwKAVCrcDi0bqXHmopr4oBnRZ5ZrfbaWeOXBq7YcmFbuSAmIODN59RmtV4m9Wqs Oct 19 03:18:10.682003 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:18:10.682003 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:18:10.682003 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:18:10.682003 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:18:10.682003 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:18:10.682003 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:18:10.682003 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: f8e388d05eac4f2babf180c0709fdc58 Oct 19 03:18:10.682003 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ServersTestJSON-867930494 Oct 19 03:18:10.682003 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:18:10.682003 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:18:10.683723 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f8e388d05eac4f2babf180c0709fdc58"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f8e388d05eac4f2babf180c0709fdc58"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f8e388d05eac4f2babf180c0709fdc58"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f8e388d05eac4f2babf180c0709fdc58", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:18:10.683723 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ServersTestJSON-867930494 Oct 19 03:18:10.683723 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: f8e388d05eac4f2babf180c0709fdc58 Oct 19 03:18:10.683723 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ServersTestJSON-867930494 Oct 19 03:18:10.683723 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ServersTestJSON-867930494-project Oct 19 03:18:10.683723 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:18:10.683723 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:18:10.683723 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 439c1401b92c44228bd6e80dd3b786ce Oct 19 03:18:10.683723 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ServersTestJSON-867930494-project Oct 19 03:18:10.683723 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:18:10.683723 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance b18ae860-ed77-4ddc-b9fa-a2aa773c2614 could not be found. Oct 19 03:18:10.683723 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': 'b18ae860-ed77-4ddc-b9fa-a2aa773c2614'} Oct 19 03:18:10.684590 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:18:10.684590 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:18:10.684590 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:18:10.684590 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:18:10.684590 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:18:10.684590 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:18:10.684590 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:18:10.684590 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:18:10.684590 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:18:10.684590 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:18:10.684590 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b18ae860-ed77-4ddc-b9fa-a2aa773c2614 could not be found. Oct 19 03:18:10.684590 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:18:10.684590 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:18:10.684590 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:18:10.684590 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:18:10.684590 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:18:10.684590 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:18:10.684590 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:18:10.684590 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:18:10.684590 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:18:10.685981 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:18:10.685981 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:18:10.685981 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:18:10.685981 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:18:10.685981 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:18:10.685981 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:18:10.685981 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:18:10.685981 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b18ae860-ed77-4ddc-b9fa-a2aa773c2614 could not be found. Oct 19 03:18:10.685981 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:18:10.685981 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:18:10.685981 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:18:10.685981 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:18:10.685981 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:18:10.685981 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:18:10.685981 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:18:10.685981 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:18:10.685981 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b18ae860-ed77-4ddc-b9fa-a2aa773c2614 could not be found. Oct 19 03:18:10.685981 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:18:10.687145 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-13f836dd-f1fb-49fa-bb52-9219914431d0 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Returning 404 to user: Instance b18ae860-ed77-4ddc-b9fa-a2aa773c2614 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:18:10.687145 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-13f836dd-f1fb-49fa-bb52-9219914431d0 tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] 10.222.0.52 "GET /compute/v2.1/servers/b18ae860-ed77-4ddc-b9fa-a2aa773c2614" status: 404 len: 111 microversion: 2.1 time: 0.071889 Oct 19 03:18:10.687145 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 904/1739] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:18:10 2022] GET /compute/v2.1/servers/b18ae860-ed77-4ddc-b9fa-a2aa773c2614 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:18:10.698126 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3f635bc0-d61f-48f2-9ed9-471c5145b1a0 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:10.701046 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-3f635bc0-d61f-48f2-9ed9-471c5145b1a0 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] [instance: 1c904d5d-95bc-43ef-9826-22311512565c] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:18:10.873797 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-3f635bc0-d61f-48f2-9ed9-471c5145b1a0 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffa4ce5ed5743a09717ab06218e73bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84273e394171452c947ec32bf639054d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:18:10.877203 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=33 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:18:10.884068 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-3f635bc0-d61f-48f2-9ed9-471c5145b1a0 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] 10.222.0.52 "GET /compute/v2.1/servers/1c904d5d-95bc-43ef-9826-22311512565c" status: 200 len: 1213 microversion: 2.1 time: 0.198567 Oct 19 03:18:10.885537 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 905/1740] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:18:10 2022] GET /compute/v2.1/servers/1c904d5d-95bc-43ef-9826-22311512565c => generated 1213 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:18:10.905932 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2be3ad9c-b736-4e45-b37b-82bce9d4b62d tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:10.921587 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-2be3ad9c-b736-4e45-b37b-82bce9d4b62d tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] [instance: 540a7025-b935-49fb-bc51-edf44ac1e0c4] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:18:10.928068 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2be3ad9c-b736-4e45-b37b-82bce9d4b62d tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:10.928564 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2be3ad9c-b736-4e45-b37b-82bce9d4b62d tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:10.929003 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2be3ad9c-b736-4e45-b37b-82bce9d4b62d tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:10.929737 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2be3ad9c-b736-4e45-b37b-82bce9d4b62d tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:10.930708 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2be3ad9c-b736-4e45-b37b-82bce9d4b62d tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:10.931137 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2be3ad9c-b736-4e45-b37b-82bce9d4b62d tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:11.004025 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b2a13970-b556-4a69-8bcd-7e64e0e1bf82 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:18:11.021690 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b2a13970-b556-4a69-8bcd-7e64e0e1bf82 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196" status: 200 len: 1461 microversion: 2.1 time: 0.515146 Oct 19 03:18:11.022278 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 836/1741] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:18:10 2022] GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196 => generated 1461 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:18:11.048357 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f3b919a8-1562-45d7-8e1b-1caeb5301e0c tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] Calling method '.version_select at 0x7fc135111d30>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:11.159054 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f3b919a8-1562-45d7-8e1b-1caeb5301e0c tempest-ServersTestJSON-867930494 tempest-ServersTestJSON-867930494-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1276665942" status: 202 len: 0 microversion: 2.1 time: 0.130072 Oct 19 03:18:11.160020 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 837/1742] 10.222.0.52 () {58 vars in 1221 bytes} [Wed Oct 19 03:18:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1276665942 => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:18:11.166586 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6a496a26-2400-48f6-9a90-8aa356140413 tempest-QuotasAdminTestJSON-122121752 tempest-QuotasAdminTestJSON-122121752-project-admin] Action: 'update', calling method: .version_select at 0x7fc13500fee0>, body: {"quota_set": {"ram": "2048"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:18:11.319536 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6a496a26-2400-48f6-9a90-8aa356140413 tempest-QuotasAdminTestJSON-122121752 tempest-QuotasAdminTestJSON-122121752-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:11.320025 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6a496a26-2400-48f6-9a90-8aa356140413 tempest-QuotasAdminTestJSON-122121752 tempest-QuotasAdminTestJSON-122121752-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:11.321031 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6a496a26-2400-48f6-9a90-8aa356140413 tempest-QuotasAdminTestJSON-122121752 tempest-QuotasAdminTestJSON-122121752-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:11.327306 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6a496a26-2400-48f6-9a90-8aa356140413 tempest-QuotasAdminTestJSON-122121752 tempest-QuotasAdminTestJSON-122121752-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:11.332726 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6a496a26-2400-48f6-9a90-8aa356140413 tempest-QuotasAdminTestJSON-122121752 tempest-QuotasAdminTestJSON-122121752-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:11.332726 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6a496a26-2400-48f6-9a90-8aa356140413 tempest-QuotasAdminTestJSON-122121752 tempest-QuotasAdminTestJSON-122121752-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:11.454020 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-2be3ad9c-b736-4e45-b37b-82bce9d4b62d tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28072a54d5934ea28e7d3205841c0852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c12a432bbd43bd8f70ba6e941c28a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:18:11.463343 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6a496a26-2400-48f6-9a90-8aa356140413 tempest-QuotasAdminTestJSON-122121752 tempest-QuotasAdminTestJSON-122121752-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:11.464531 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6a496a26-2400-48f6-9a90-8aa356140413 tempest-QuotasAdminTestJSON-122121752 tempest-QuotasAdminTestJSON-122121752-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:11.465129 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6a496a26-2400-48f6-9a90-8aa356140413 tempest-QuotasAdminTestJSON-122121752 tempest-QuotasAdminTestJSON-122121752-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:11.466060 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6a496a26-2400-48f6-9a90-8aa356140413 tempest-QuotasAdminTestJSON-122121752 tempest-QuotasAdminTestJSON-122121752-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:11.466674 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6a496a26-2400-48f6-9a90-8aa356140413 tempest-QuotasAdminTestJSON-122121752 tempest-QuotasAdminTestJSON-122121752-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:11.467257 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6a496a26-2400-48f6-9a90-8aa356140413 tempest-QuotasAdminTestJSON-122121752 tempest-QuotasAdminTestJSON-122121752-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:11.468213 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2be3ad9c-b736-4e45-b37b-82bce9d4b62d tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] 10.222.0.52 "GET /compute/v2.1/servers/540a7025-b935-49fb-bc51-edf44ac1e0c4" status: 200 len: 1682 microversion: 2.1 time: 0.577843 Oct 19 03:18:11.469142 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 906/1743] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:18:10 2022] GET /compute/v2.1/servers/540a7025-b935-49fb-bc51-edf44ac1e0c4 => generated 1682 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:18:11.492620 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ed8e2287-8a9a-4292-a4ba-c8aa4f51880a tempest-MigrationsAdminTest-1230104219 tempest-MigrationsAdminTest-1230104219-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:11.494785 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ed8e2287-8a9a-4292-a4ba-c8aa4f51880a tempest-MigrationsAdminTest-1230104219 tempest-MigrationsAdminTest-1230104219-project-admin] [instance: 84774cfc-79b4-42db-acfd-c4daac86d196] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:18:11.527851 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ed8e2287-8a9a-4292-a4ba-c8aa4f51880a tempest-MigrationsAdminTest-1230104219 tempest-MigrationsAdminTest-1230104219-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:11.529009 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ed8e2287-8a9a-4292-a4ba-c8aa4f51880a tempest-MigrationsAdminTest-1230104219 tempest-MigrationsAdminTest-1230104219-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:11.530779 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ed8e2287-8a9a-4292-a4ba-c8aa4f51880a tempest-MigrationsAdminTest-1230104219 tempest-MigrationsAdminTest-1230104219-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:11.534466 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ed8e2287-8a9a-4292-a4ba-c8aa4f51880a tempest-MigrationsAdminTest-1230104219 tempest-MigrationsAdminTest-1230104219-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:11.534981 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ed8e2287-8a9a-4292-a4ba-c8aa4f51880a tempest-MigrationsAdminTest-1230104219 tempest-MigrationsAdminTest-1230104219-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:11.536761 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ed8e2287-8a9a-4292-a4ba-c8aa4f51880a tempest-MigrationsAdminTest-1230104219 tempest-MigrationsAdminTest-1230104219-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:11.730746 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6a496a26-2400-48f6-9a90-8aa356140413 tempest-QuotasAdminTestJSON-122121752 tempest-QuotasAdminTestJSON-122121752-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-quota-sets/2dd4bb9adce8469e8af53c8c716a20b7?user_id=c7f1fcc97b7d428498f2fb7461ac49d8" status: 200 len: 328 microversion: 2.1 time: 0.567581 Oct 19 03:18:11.733537 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 838/1744] 10.222.0.52 () {60 vars in 1343 bytes} [Wed Oct 19 03:18:11 2022] PUT /compute/v2.1/os-quota-sets/2dd4bb9adce8469e8af53c8c716a20b7?user_id=c7f1fcc97b7d428498f2fb7461ac49d8 => generated 328 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:18:11.746244 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e8f93356-986f-4bf0-b3d9-806fb8cbebe2 tempest-QuotasAdminTestJSON-122121752 tempest-QuotasAdminTestJSON-122121752-project-admin] Calling method '.version_select at 0x7fc13057b040>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:11.915644 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e8f93356-986f-4bf0-b3d9-806fb8cbebe2 tempest-QuotasAdminTestJSON-122121752 tempest-QuotasAdminTestJSON-122121752-project-admin] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/2dd4bb9adce8469e8af53c8c716a20b7?user_id=c7f1fcc97b7d428498f2fb7461ac49d8" status: 200 len: 370 microversion: 2.1 time: 0.174020 Oct 19 03:18:11.919051 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 839/1745] 10.222.0.52 () {58 vars in 1323 bytes} [Wed Oct 19 03:18:11 2022] GET /compute/v2.1/os-quota-sets/2dd4bb9adce8469e8af53c8c716a20b7?user_id=c7f1fcc97b7d428498f2fb7461ac49d8 => generated 370 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:18:11.937072 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ea54f75d-14d0-4a10-b8e7-ab92fa4fef50 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:11.948244 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ea54f75d-14d0-4a10-b8e7-ab92fa4fef50 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] [instance: 1c904d5d-95bc-43ef-9826-22311512565c] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:18:11.950542 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ea54f75d-14d0-4a10-b8e7-ab92fa4fef50 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:11.954039 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ea54f75d-14d0-4a10-b8e7-ab92fa4fef50 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:11.954690 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ea54f75d-14d0-4a10-b8e7-ab92fa4fef50 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:11.955904 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ea54f75d-14d0-4a10-b8e7-ab92fa4fef50 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:11.956542 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ea54f75d-14d0-4a10-b8e7-ab92fa4fef50 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:11.957215 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ea54f75d-14d0-4a10-b8e7-ab92fa4fef50 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:12.465009 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ea54f75d-14d0-4a10-b8e7-ab92fa4fef50 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffa4ce5ed5743a09717ab06218e73bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84273e394171452c947ec32bf639054d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:18:12.475511 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ea54f75d-14d0-4a10-b8e7-ab92fa4fef50 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] 10.222.0.52 "GET /compute/v2.1/servers/1c904d5d-95bc-43ef-9826-22311512565c" status: 200 len: 1217 microversion: 2.1 time: 0.556473 Oct 19 03:18:12.484084 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 840/1746] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:18:11 2022] GET /compute/v2.1/servers/1c904d5d-95bc-43ef-9826-22311512565c => generated 1217 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:18:12.498213 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5205823c-335b-4850-bf96-be8470e84a85 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:12.509121 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5205823c-335b-4850-bf96-be8470e84a85 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] [instance: 540a7025-b935-49fb-bc51-edf44ac1e0c4] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:18:12.538976 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5205823c-335b-4850-bf96-be8470e84a85 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:12.540058 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ed8e2287-8a9a-4292-a4ba-c8aa4f51880a tempest-MigrationsAdminTest-1230104219 tempest-MigrationsAdminTest-1230104219-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196" status: 200 len: 1612 microversion: 2.1 time: 1.068890 Oct 19 03:18:12.540621 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5205823c-335b-4850-bf96-be8470e84a85 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:12.540771 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5205823c-335b-4850-bf96-be8470e84a85 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:12.545893 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5205823c-335b-4850-bf96-be8470e84a85 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:12.546590 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5205823c-335b-4850-bf96-be8470e84a85 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:12.548055 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5205823c-335b-4850-bf96-be8470e84a85 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:12.567297 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 907/1747] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:18:11 2022] GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196 => generated 1612 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:18:12.583369 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0854863a-1233-47e8-8b24-038c39bc226a tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:12.584359 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0854863a-1233-47e8-8b24-038c39bc226a tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 84774cfc-79b4-42db-acfd-c4daac86d196] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:18:12.595703 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0854863a-1233-47e8-8b24-038c39bc226a tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:12.595703 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0854863a-1233-47e8-8b24-038c39bc226a tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:12.598272 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0854863a-1233-47e8-8b24-038c39bc226a tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:12.599515 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0854863a-1233-47e8-8b24-038c39bc226a tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:12.601729 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0854863a-1233-47e8-8b24-038c39bc226a tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:12.603523 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0854863a-1233-47e8-8b24-038c39bc226a tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:12.665409 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0854863a-1233-47e8-8b24-038c39bc226a tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 84774cfc-79b4-42db-acfd-c4daac86d196] Going to try to terminate instance {{(pid=121135) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:18:13.100442 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0854863a-1233-47e8-8b24-038c39bc226a tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "DELETE /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196" status: 204 len: 0 microversion: 2.1 time: 0.521550 Oct 19 03:18:13.104852 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 908/1748] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:18:12 2022] DELETE /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 19 03:18:13.110297 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-d724050c-5317-4fbe-ae09-37d3e2101f2d req-db37dcd1-cc71-41f9-a579-e2e587d7b3c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84774cfc-79b4-42db-acfd-c4daac86d196", "name": "network-vif-plugged", "status": "completed", "tag": "349ffeb3-81a2-44f2-9775-65ddf0c3a896"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:18:13.143708 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-d724050c-5317-4fbe-ae09-37d3e2101f2d req-db37dcd1-cc71-41f9-a579-e2e587d7b3c4 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:13.144255 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-d724050c-5317-4fbe-ae09-37d3e2101f2d req-db37dcd1-cc71-41f9-a579-e2e587d7b3c4 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:13.144680 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-d724050c-5317-4fbe-ae09-37d3e2101f2d req-db37dcd1-cc71-41f9-a579-e2e587d7b3c4 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:13.178398 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-d724050c-5317-4fbe-ae09-37d3e2101f2d req-db37dcd1-cc71-41f9-a579-e2e587d7b3c4 service nova] Creating event network-vif-plugged:349ffeb3-81a2-44f2-9775-65ddf0c3a896 for instance 84774cfc-79b4-42db-acfd-c4daac86d196 on n-h1-861333-8 Oct 19 03:18:13.195895 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-d724050c-5317-4fbe-ae09-37d3e2101f2d req-db37dcd1-cc71-41f9-a579-e2e587d7b3c4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086670 Oct 19 03:18:13.195895 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 909/1749] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:18:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:18:13.213156 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-39c3c882-8bc1-4b33-9305-f71729209778 tempest-QuotasAdminTestJSON-122121752 tempest-QuotasAdminTestJSON-122121752-project-admin] Calling method '.version_select at 0x7fc130c5a9d0>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:13.708863 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-39c3c882-8bc1-4b33-9305-f71729209778 tempest-QuotasAdminTestJSON-122121752 tempest-QuotasAdminTestJSON-122121752-project-admin] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/c5d97a25e1314c90af449604c79ab228/defaults" status: 200 len: 371 microversion: 2.1 time: 0.513804 Oct 19 03:18:13.710194 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 910/1750] 10.222.0.52 () {58 vars in 1269 bytes} [Wed Oct 19 03:18:13 2022] GET /compute/v2.1/os-quota-sets/c5d97a25e1314c90af449604c79ab228/defaults => generated 371 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:18:13.724429 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-be352c18-31b4-4bd1-b232-48244c35d988 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:13.730705 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-be352c18-31b4-4bd1-b232-48244c35d988 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 84774cfc-79b4-42db-acfd-c4daac86d196] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:18:13.762828 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-be352c18-31b4-4bd1-b232-48244c35d988 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:13.768527 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-be352c18-31b4-4bd1-b232-48244c35d988 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:13.769010 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-be352c18-31b4-4bd1-b232-48244c35d988 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:13.776047 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-be352c18-31b4-4bd1-b232-48244c35d988 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:13.776573 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-be352c18-31b4-4bd1-b232-48244c35d988 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:13.777013 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-be352c18-31b4-4bd1-b232-48244c35d988 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:13.999427 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5205823c-335b-4850-bf96-be8470e84a85 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28072a54d5934ea28e7d3205841c0852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c12a432bbd43bd8f70ba6e941c28a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:18:14.007927 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5205823c-335b-4850-bf96-be8470e84a85 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] 10.222.0.52 "GET /compute/v2.1/servers/540a7025-b935-49fb-bc51-edf44ac1e0c4" status: 200 len: 1682 microversion: 2.1 time: 1.516544 Oct 19 03:18:14.014050 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 841/1751] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:18:12 2022] GET /compute/v2.1/servers/540a7025-b935-49fb-bc51-edf44ac1e0c4 => generated 1682 bytes in 1523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:18:14.032846 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-62a113cc-1042-448f-aa2b-3134dd0f8fb6 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:14.033630 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-62a113cc-1042-448f-aa2b-3134dd0f8fb6 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] [instance: 1c904d5d-95bc-43ef-9826-22311512565c] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:18:14.041539 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-62a113cc-1042-448f-aa2b-3134dd0f8fb6 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:14.042792 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-62a113cc-1042-448f-aa2b-3134dd0f8fb6 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:14.043397 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-62a113cc-1042-448f-aa2b-3134dd0f8fb6 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:14.044403 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-62a113cc-1042-448f-aa2b-3134dd0f8fb6 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:14.045090 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-62a113cc-1042-448f-aa2b-3134dd0f8fb6 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:14.048208 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-62a113cc-1042-448f-aa2b-3134dd0f8fb6 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:14.167506 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-62a113cc-1042-448f-aa2b-3134dd0f8fb6 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffa4ce5ed5743a09717ab06218e73bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84273e394171452c947ec32bf639054d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:18:14.199595 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-62a113cc-1042-448f-aa2b-3134dd0f8fb6 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] 10.222.0.52 "GET /compute/v2.1/servers/1c904d5d-95bc-43ef-9826-22311512565c" status: 200 len: 1265 microversion: 2.1 time: 0.183379 Oct 19 03:18:14.200783 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 842/1752] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:18:14 2022] GET /compute/v2.1/servers/1c904d5d-95bc-43ef-9826-22311512565c => generated 1265 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:18:14.209956 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e0c7331c-9139-4fef-a37b-f5e7b32e2911 tempest-QuotasAdminTestJSON-122121752 tempest-QuotasAdminTestJSON-122121752-project-admin] Action: 'update', calling method: .version_select at 0x7fc134f25dc0>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:18:14.340096 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e0c7331c-9139-4fef-a37b-f5e7b32e2911 tempest-QuotasAdminTestJSON-122121752 tempest-QuotasAdminTestJSON-122121752-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:14.340914 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e0c7331c-9139-4fef-a37b-f5e7b32e2911 tempest-QuotasAdminTestJSON-122121752 tempest-QuotasAdminTestJSON-122121752-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:14.341927 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e0c7331c-9139-4fef-a37b-f5e7b32e2911 tempest-QuotasAdminTestJSON-122121752 tempest-QuotasAdminTestJSON-122121752-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:14.343326 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e0c7331c-9139-4fef-a37b-f5e7b32e2911 tempest-QuotasAdminTestJSON-122121752 tempest-QuotasAdminTestJSON-122121752-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:14.343913 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e0c7331c-9139-4fef-a37b-f5e7b32e2911 tempest-QuotasAdminTestJSON-122121752 tempest-QuotasAdminTestJSON-122121752-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:14.344409 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e0c7331c-9139-4fef-a37b-f5e7b32e2911 tempest-QuotasAdminTestJSON-122121752 tempest-QuotasAdminTestJSON-122121752-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:14.428729 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-be352c18-31b4-4bd1-b232-48244c35d988 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:18:14.447392 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-be352c18-31b4-4bd1-b232-48244c35d988 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196" status: 200 len: 1467 microversion: 2.1 time: 0.733487 Oct 19 03:18:14.448011 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 911/1753] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:18:13 2022] GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196 => generated 1467 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:18:14.600653 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-804c4c72-2218-4df8-9cca-3788534c8386 req-23a1f88b-c2e0-489b-9c3a-69b98d9d97aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "540a7025-b935-49fb-bc51-edf44ac1e0c4", "name": "network-vif-deleted", "tag": "e54cc460-46ae-45ff-9a37-9bdfc282d2aa"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:18:14.612915 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-804c4c72-2218-4df8-9cca-3788534c8386 req-23a1f88b-c2e0-489b-9c3a-69b98d9d97aa service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:14.613482 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-804c4c72-2218-4df8-9cca-3788534c8386 req-23a1f88b-c2e0-489b-9c3a-69b98d9d97aa service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:14.613919 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-804c4c72-2218-4df8-9cca-3788534c8386 req-23a1f88b-c2e0-489b-9c3a-69b98d9d97aa service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:14.636038 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-804c4c72-2218-4df8-9cca-3788534c8386 req-23a1f88b-c2e0-489b-9c3a-69b98d9d97aa service nova] Creating event network-vif-deleted:e54cc460-46ae-45ff-9a37-9bdfc282d2aa for instance 540a7025-b935-49fb-bc51-edf44ac1e0c4 on n-h1-861333-8 Oct 19 03:18:14.642583 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-804c4c72-2218-4df8-9cca-3788534c8386 req-23a1f88b-c2e0-489b-9c3a-69b98d9d97aa service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045460 Oct 19 03:18:14.646801 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 912/1754] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:18:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:18:15.043006 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1b37b825-6a94-4d6d-adf4-790a65d6f89e tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:15.043965 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1b37b825-6a94-4d6d-adf4-790a65d6f89e tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] [instance: 540a7025-b935-49fb-bc51-edf44ac1e0c4] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:18:15.094271 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1b37b825-6a94-4d6d-adf4-790a65d6f89e tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:15.098052 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1b37b825-6a94-4d6d-adf4-790a65d6f89e tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:15.098052 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1b37b825-6a94-4d6d-adf4-790a65d6f89e tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:15.098052 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1b37b825-6a94-4d6d-adf4-790a65d6f89e tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:15.108252 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1b37b825-6a94-4d6d-adf4-790a65d6f89e tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:15.113602 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1b37b825-6a94-4d6d-adf4-790a65d6f89e tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:15.339108 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-1b37b825-6a94-4d6d-adf4-790a65d6f89e tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28072a54d5934ea28e7d3205841c0852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c12a432bbd43bd8f70ba6e941c28a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:18:15.348584 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1b37b825-6a94-4d6d-adf4-790a65d6f89e tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] 10.222.0.52 "GET /compute/v2.1/servers/540a7025-b935-49fb-bc51-edf44ac1e0c4" status: 200 len: 1326 microversion: 2.1 time: 0.312725 Oct 19 03:18:15.350623 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 913/1755] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:18:15 2022] GET /compute/v2.1/servers/540a7025-b935-49fb-bc51-edf44ac1e0c4 => generated 1326 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:18:15.357949 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-20c526bf-374e-47c5-a41d-0bf25e2b166b tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:15.360442 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-20c526bf-374e-47c5-a41d-0bf25e2b166b tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] [instance: 1c904d5d-95bc-43ef-9826-22311512565c] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:18:15.370948 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-20c526bf-374e-47c5-a41d-0bf25e2b166b tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:15.371819 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-20c526bf-374e-47c5-a41d-0bf25e2b166b tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:15.372465 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-20c526bf-374e-47c5-a41d-0bf25e2b166b tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:15.373489 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-20c526bf-374e-47c5-a41d-0bf25e2b166b tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:15.374148 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-20c526bf-374e-47c5-a41d-0bf25e2b166b tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:15.375067 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-20c526bf-374e-47c5-a41d-0bf25e2b166b tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:15.606092 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-20c526bf-374e-47c5-a41d-0bf25e2b166b tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffa4ce5ed5743a09717ab06218e73bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84273e394171452c947ec32bf639054d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:18:15.625975 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-20c526bf-374e-47c5-a41d-0bf25e2b166b tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] 10.222.0.52 "GET /compute/v2.1/servers/1c904d5d-95bc-43ef-9826-22311512565c" status: 200 len: 1271 microversion: 2.1 time: 0.273488 Oct 19 03:18:15.626574 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 914/1756] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:18:15 2022] GET /compute/v2.1/servers/1c904d5d-95bc-43ef-9826-22311512565c => generated 1271 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:18:15.650773 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-cafe3889-5214-40ca-a5ff-d55fd04c3e28 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:15.651514 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-cafe3889-5214-40ca-a5ff-d55fd04c3e28 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 84774cfc-79b4-42db-acfd-c4daac86d196] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:18:15.683711 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cafe3889-5214-40ca-a5ff-d55fd04c3e28 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:15.686604 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cafe3889-5214-40ca-a5ff-d55fd04c3e28 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:15.688028 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cafe3889-5214-40ca-a5ff-d55fd04c3e28 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:15.691842 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cafe3889-5214-40ca-a5ff-d55fd04c3e28 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:15.693737 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cafe3889-5214-40ca-a5ff-d55fd04c3e28 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:15.699844 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cafe3889-5214-40ca-a5ff-d55fd04c3e28 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:15.789740 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:18:15.855751 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:UPDATE=7,nova_cell0:SELECT=93 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:18:15.988632 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e0c7331c-9139-4fef-a37b-f5e7b32e2911 tempest-QuotasAdminTestJSON-122121752 tempest-QuotasAdminTestJSON-122121752-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-quota-sets/c5d97a25e1314c90af449604c79ab228" status: 200 len: 329 microversion: 2.1 time: 1.784578 Oct 19 03:18:15.992750 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 843/1757] 10.222.0.52 () {60 vars in 1263 bytes} [Wed Oct 19 03:18:14 2022] PUT /compute/v2.1/os-quota-sets/c5d97a25e1314c90af449604c79ab228 => generated 329 bytes in 1790 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:18:16.008760 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5844a5cd-baef-43d9-b1ae-493ffaa3d7f3 tempest-QuotasAdminTestJSON-122121752 tempest-QuotasAdminTestJSON-122121752-project-admin] Action: 'update', calling method: .version_select at 0x7fc130549d30>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:18:16.102462 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5844a5cd-baef-43d9-b1ae-493ffaa3d7f3 tempest-QuotasAdminTestJSON-122121752 tempest-QuotasAdminTestJSON-122121752-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:16.106651 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5844a5cd-baef-43d9-b1ae-493ffaa3d7f3 tempest-QuotasAdminTestJSON-122121752 tempest-QuotasAdminTestJSON-122121752-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:16.106651 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5844a5cd-baef-43d9-b1ae-493ffaa3d7f3 tempest-QuotasAdminTestJSON-122121752 tempest-QuotasAdminTestJSON-122121752-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:16.106651 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5844a5cd-baef-43d9-b1ae-493ffaa3d7f3 tempest-QuotasAdminTestJSON-122121752 tempest-QuotasAdminTestJSON-122121752-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:16.106651 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5844a5cd-baef-43d9-b1ae-493ffaa3d7f3 tempest-QuotasAdminTestJSON-122121752 tempest-QuotasAdminTestJSON-122121752-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:16.107050 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5844a5cd-baef-43d9-b1ae-493ffaa3d7f3 tempest-QuotasAdminTestJSON-122121752 tempest-QuotasAdminTestJSON-122121752-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:16.194448 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:INSERT=17,nova_api:SELECT=82,nova_api:DELETE=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:18:16.455361 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-cafe3889-5214-40ca-a5ff-d55fd04c3e28 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:18:16.480091 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-cafe3889-5214-40ca-a5ff-d55fd04c3e28 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196" status: 200 len: 1467 microversion: 2.1 time: 0.852339 Oct 19 03:18:16.480975 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 915/1758] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:18:15 2022] GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196 => generated 1467 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:18:16.491108 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b132b2b4-50e2-474b-8ccd-6fa2d9a2e724 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:16.491767 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b132b2b4-50e2-474b-8ccd-6fa2d9a2e724 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] [instance: 540a7025-b935-49fb-bc51-edf44ac1e0c4] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:18:16.520086 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b132b2b4-50e2-474b-8ccd-6fa2d9a2e724 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:16.520596 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b132b2b4-50e2-474b-8ccd-6fa2d9a2e724 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:16.521044 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b132b2b4-50e2-474b-8ccd-6fa2d9a2e724 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:16.521790 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b132b2b4-50e2-474b-8ccd-6fa2d9a2e724 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:16.522223 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b132b2b4-50e2-474b-8ccd-6fa2d9a2e724 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:16.531936 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b132b2b4-50e2-474b-8ccd-6fa2d9a2e724 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:16.535030 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:18:16.635819 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b132b2b4-50e2-474b-8ccd-6fa2d9a2e724 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:16.641889 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b132b2b4-50e2-474b-8ccd-6fa2d9a2e724 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:16.642671 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b132b2b4-50e2-474b-8ccd-6fa2d9a2e724 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:16.643144 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-b132b2b4-50e2-474b-8ccd-6fa2d9a2e724 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lazy-loading 'fault' on Instance uuid 540a7025-b935-49fb-bc51-edf44ac1e0c4 {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:18:16.926392 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b132b2b4-50e2-474b-8ccd-6fa2d9a2e724 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28072a54d5934ea28e7d3205841c0852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c12a432bbd43bd8f70ba6e941c28a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:18:16.939699 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b132b2b4-50e2-474b-8ccd-6fa2d9a2e724 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] 10.222.0.52 "GET /compute/v2.1/servers/540a7025-b935-49fb-bc51-edf44ac1e0c4" status: 200 len: 1331 microversion: 2.1 time: 0.455694 Oct 19 03:18:16.940955 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 916/1759] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:18:16 2022] GET /compute/v2.1/servers/540a7025-b935-49fb-bc51-edf44ac1e0c4 => generated 1331 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:18:16.965733 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-79e26e0e-8660-4f35-9746-b4f7e34f4992 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:16.967702 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-79e26e0e-8660-4f35-9746-b4f7e34f4992 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] [instance: 1c904d5d-95bc-43ef-9826-22311512565c] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:18:16.987535 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-79e26e0e-8660-4f35-9746-b4f7e34f4992 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:16.994796 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-79e26e0e-8660-4f35-9746-b4f7e34f4992 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:16.995640 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-79e26e0e-8660-4f35-9746-b4f7e34f4992 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:16.996599 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-79e26e0e-8660-4f35-9746-b4f7e34f4992 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:16.998991 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-79e26e0e-8660-4f35-9746-b4f7e34f4992 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:16.999442 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-79e26e0e-8660-4f35-9746-b4f7e34f4992 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:17.157222 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-79e26e0e-8660-4f35-9746-b4f7e34f4992 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffa4ce5ed5743a09717ab06218e73bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84273e394171452c947ec32bf639054d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:18:17.182423 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-79e26e0e-8660-4f35-9746-b4f7e34f4992 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] 10.222.0.52 "GET /compute/v2.1/servers/1c904d5d-95bc-43ef-9826-22311512565c" status: 200 len: 1271 microversion: 2.1 time: 0.232164 Oct 19 03:18:17.182423 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 917/1760] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:18:16 2022] GET /compute/v2.1/servers/1c904d5d-95bc-43ef-9826-22311512565c => generated 1271 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:18:17.191012 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-2215a35f-6dcd-45d7-8a99-15dbba742b73 req-f41f65bf-94c7-4fb0-8bad-cd7c9136a77b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84774cfc-79b4-42db-acfd-c4daac86d196", "name": "network-vif-deleted", "tag": "349ffeb3-81a2-44f2-9775-65ddf0c3a896"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:18:17.228498 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-2215a35f-6dcd-45d7-8a99-15dbba742b73 req-f41f65bf-94c7-4fb0-8bad-cd7c9136a77b service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:17.236454 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-2215a35f-6dcd-45d7-8a99-15dbba742b73 req-f41f65bf-94c7-4fb0-8bad-cd7c9136a77b service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:17.241468 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-2215a35f-6dcd-45d7-8a99-15dbba742b73 req-f41f65bf-94c7-4fb0-8bad-cd7c9136a77b service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:17.291952 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-2215a35f-6dcd-45d7-8a99-15dbba742b73 req-f41f65bf-94c7-4fb0-8bad-cd7c9136a77b service nova] Creating event network-vif-deleted:349ffeb3-81a2-44f2-9775-65ddf0c3a896 for instance 84774cfc-79b4-42db-acfd-c4daac86d196 on n-h1-861333-8 Oct 19 03:18:17.312188 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-2215a35f-6dcd-45d7-8a99-15dbba742b73 req-f41f65bf-94c7-4fb0-8bad-cd7c9136a77b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130510 Oct 19 03:18:17.316286 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 918/1761] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:18:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:18:17.507772 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-27c2e9da-83ed-4772-8356-eddf91df0103 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:17.508894 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-27c2e9da-83ed-4772-8356-eddf91df0103 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 84774cfc-79b4-42db-acfd-c4daac86d196] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:18:17.533300 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-27c2e9da-83ed-4772-8356-eddf91df0103 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:17.542895 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-27c2e9da-83ed-4772-8356-eddf91df0103 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:17.547726 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-27c2e9da-83ed-4772-8356-eddf91df0103 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:17.547726 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-27c2e9da-83ed-4772-8356-eddf91df0103 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:17.548242 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-27c2e9da-83ed-4772-8356-eddf91df0103 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:17.549510 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-27c2e9da-83ed-4772-8356-eddf91df0103 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:17.639733 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-27c2e9da-83ed-4772-8356-eddf91df0103 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:17.640522 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-27c2e9da-83ed-4772-8356-eddf91df0103 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:17.641131 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-27c2e9da-83ed-4772-8356-eddf91df0103 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:17.641619 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-27c2e9da-83ed-4772-8356-eddf91df0103 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lazy-loading 'fault' on Instance uuid 84774cfc-79b4-42db-acfd-c4daac86d196 {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:18:17.852351 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-27c2e9da-83ed-4772-8356-eddf91df0103 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:18:17.877191 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-27c2e9da-83ed-4772-8356-eddf91df0103 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196" status: 200 len: 1302 microversion: 2.1 time: 0.376163 Oct 19 03:18:17.880349 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 919/1762] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:18:17 2022] GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196 => generated 1302 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:18:17.885968 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c683687f-9b82-4fce-b063-f93043044e60 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:17.886851 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c683687f-9b82-4fce-b063-f93043044e60 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] [instance: 64d3b78b-7953-40fc-ab53-b35f9d105901] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:18:17.896609 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c683687f-9b82-4fce-b063-f93043044e60 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:17.896609 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c683687f-9b82-4fce-b063-f93043044e60 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:17.896609 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c683687f-9b82-4fce-b063-f93043044e60 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:17.896609 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c683687f-9b82-4fce-b063-f93043044e60 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:17.897096 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c683687f-9b82-4fce-b063-f93043044e60 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:17.897709 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c683687f-9b82-4fce-b063-f93043044e60 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:17.913762 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-c683687f-9b82-4fce-b063-f93043044e60 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] HTTP exception thrown: Instance 64d3b78b-7953-40fc-ab53-b35f9d105901 could not be found. Oct 19 03:18:17.916350 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c683687f-9b82-4fce-b063-f93043044e60 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Request method failure captured: Oct 19 03:18:17.916350 n-d-861333-8 devstack@n-api.service[121135]: request: DELETE /compute/v2.1/servers/64d3b78b-7953-40fc-ab53-b35f9d105901 HTTP/1.1 Oct 19 03:18:17.916350 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:18:17.916350 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:18:17.916350 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:18:17.916350 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:18:17.916350 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:18:17.916350 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:18:17.916350 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:18:17.916350 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:18:17.916350 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2wRGEgYhAdPsgc7mEIDXrdPW4JwqYu1MFCRMWCDsXcKjxkHFT1VoJipXbbUg2wfFTgPSaTND8ANvmvXBbh_VcZiPRiOiOyyyOWkSDVD8anQKzoySXT9c8aNAT4O4UZ5kRq3Qlkx_fDPQls23gexwMFV2EY3yHLkKn1iQsrIizdgtLc Oct 19 03:18:17.916350 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:18:17.916350 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:18:17.916350 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:18:17.916350 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:18:17.916350 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:18:17.916350 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:18:17.916350 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 0fcd49d68a3947249016cc5dbe910efc Oct 19 03:18:17.916350 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ServersTestMultiNic-1638692278 Oct 19 03:18:17.916350 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:18:17.916350 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:18:17.918104 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/0fcd49d68a3947249016cc5dbe910efc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0fcd49d68a3947249016cc5dbe910efc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0fcd49d68a3947249016cc5dbe910efc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_0fcd49d68a3947249016cc5dbe910efc", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:18:17.918104 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ServersTestMultiNic-1638692278 Oct 19 03:18:17.918104 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 0fcd49d68a3947249016cc5dbe910efc Oct 19 03:18:17.918104 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ServersTestMultiNic-1638692278 Oct 19 03:18:17.918104 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ServersTestMultiNic-1638692278-project Oct 19 03:18:17.918104 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:18:17.918104 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:18:17.918104 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: d3c35b71372843d69f9a6c6be04b154f Oct 19 03:18:17.918104 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ServersTestMultiNic-1638692278-project Oct 19 03:18:17.918104 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:18:17.918104 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance 64d3b78b-7953-40fc-ab53-b35f9d105901 could not be found. Oct 19 03:18:17.918104 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '64d3b78b-7953-40fc-ab53-b35f9d105901'} Oct 19 03:18:17.919049 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:18:17.919049 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:18:17.919049 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:18:17.919049 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:18:17.919049 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:18:17.919049 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:18:17.919049 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:18:17.919049 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:18:17.919049 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:18:17.919049 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:18:17.919049 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64d3b78b-7953-40fc-ab53-b35f9d105901 could not be found. Oct 19 03:18:17.919049 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:18:17.919049 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:18:17.919049 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:18:17.919049 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:18:17.919049 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:18:17.919049 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:18:17.919049 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:18:17.919049 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:18:17.919049 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:18:17.920600 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:18:17.920600 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 03:18:17.920600 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 03:18:17.920600 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 03:18:17.920600 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 03:18:17.920600 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:18:17.920600 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:18:17.920600 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:18:17.920600 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:18:17.920600 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64d3b78b-7953-40fc-ab53-b35f9d105901 could not be found. Oct 19 03:18:17.920600 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:18:17.920600 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:18:17.920600 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:18:17.920600 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:18:17.920600 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:18:17.920600 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:18:17.920600 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:18:17.920600 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:18:17.920600 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64d3b78b-7953-40fc-ab53-b35f9d105901 could not be found. Oct 19 03:18:17.920600 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:18:17.926068 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c683687f-9b82-4fce-b063-f93043044e60 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Returning 404 to user: Instance 64d3b78b-7953-40fc-ab53-b35f9d105901 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:18:17.926068 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c683687f-9b82-4fce-b063-f93043044e60 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] 10.222.0.52 "DELETE /compute/v2.1/servers/64d3b78b-7953-40fc-ab53-b35f9d105901" status: 404 len: 111 microversion: 2.1 time: 0.041394 Oct 19 03:18:17.926068 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 920/1763] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:18:17 2022] DELETE /compute/v2.1/servers/64d3b78b-7953-40fc-ab53-b35f9d105901 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:18:17.932407 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-540d0940-e281-4d16-8b24-f0ba228947bd tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:17.933442 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-540d0940-e281-4d16-8b24-f0ba228947bd tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] [instance: 64d3b78b-7953-40fc-ab53-b35f9d105901] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:18:17.940032 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-540d0940-e281-4d16-8b24-f0ba228947bd tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:17.940735 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-540d0940-e281-4d16-8b24-f0ba228947bd tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:17.941357 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-540d0940-e281-4d16-8b24-f0ba228947bd tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:17.942287 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-540d0940-e281-4d16-8b24-f0ba228947bd tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:17.942919 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-540d0940-e281-4d16-8b24-f0ba228947bd tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:17.943656 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-540d0940-e281-4d16-8b24-f0ba228947bd tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:17.961421 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-540d0940-e281-4d16-8b24-f0ba228947bd tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] HTTP exception thrown: Instance 64d3b78b-7953-40fc-ab53-b35f9d105901 could not be found. Oct 19 03:18:17.963496 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-540d0940-e281-4d16-8b24-f0ba228947bd tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Request method failure captured: Oct 19 03:18:17.963496 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/64d3b78b-7953-40fc-ab53-b35f9d105901 HTTP/1.1 Oct 19 03:18:17.963496 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:18:17.963496 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:18:17.963496 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:18:17.963496 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:18:17.963496 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:18:17.963496 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:18:17.963496 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:18:17.963496 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:18:17.963496 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2wRGEgYhAdPsgc7mEIDXrdPW4JwqYu1MFCRMWCDsXcKjxkHFT1VoJipXbbUg2wfFTgPSaTND8ANvmvXBbh_VcZiPRiOiOyyyOWkSDVD8anQKzoySXT9c8aNAT4O4UZ5kRq3Qlkx_fDPQls23gexwMFV2EY3yHLkKn1iQsrIizdgtLc Oct 19 03:18:17.963496 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:18:17.963496 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:18:17.963496 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:18:17.963496 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:18:17.963496 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:18:17.963496 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:18:17.963496 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 0fcd49d68a3947249016cc5dbe910efc Oct 19 03:18:17.963496 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ServersTestMultiNic-1638692278 Oct 19 03:18:17.963496 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:18:17.963496 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:18:17.964943 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/0fcd49d68a3947249016cc5dbe910efc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0fcd49d68a3947249016cc5dbe910efc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0fcd49d68a3947249016cc5dbe910efc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_0fcd49d68a3947249016cc5dbe910efc", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:18:17.964943 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ServersTestMultiNic-1638692278 Oct 19 03:18:17.964943 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 0fcd49d68a3947249016cc5dbe910efc Oct 19 03:18:17.964943 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ServersTestMultiNic-1638692278 Oct 19 03:18:17.964943 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ServersTestMultiNic-1638692278-project Oct 19 03:18:17.964943 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:18:17.964943 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:18:17.964943 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: d3c35b71372843d69f9a6c6be04b154f Oct 19 03:18:17.964943 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ServersTestMultiNic-1638692278-project Oct 19 03:18:17.964943 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:18:17.964943 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance 64d3b78b-7953-40fc-ab53-b35f9d105901 could not be found. Oct 19 03:18:17.964943 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '64d3b78b-7953-40fc-ab53-b35f9d105901'} Oct 19 03:18:17.965843 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:18:17.965843 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:18:17.965843 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:18:17.965843 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:18:17.965843 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:18:17.965843 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:18:17.965843 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:18:17.965843 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:18:17.965843 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:18:17.965843 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:18:17.965843 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64d3b78b-7953-40fc-ab53-b35f9d105901 could not be found. Oct 19 03:18:17.965843 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:18:17.965843 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:18:17.965843 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:18:17.965843 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:18:17.965843 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:18:17.965843 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:18:17.965843 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:18:17.965843 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:18:17.965843 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:18:17.967099 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:18:17.967099 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:18:17.967099 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:18:17.967099 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:18:17.967099 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:18:17.967099 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:18:17.967099 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:18:17.967099 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64d3b78b-7953-40fc-ab53-b35f9d105901 could not be found. Oct 19 03:18:17.967099 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:18:17.967099 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:18:17.967099 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:18:17.967099 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:18:17.967099 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:18:17.967099 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:18:17.967099 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:18:17.967099 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:18:17.967099 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64d3b78b-7953-40fc-ab53-b35f9d105901 could not be found. Oct 19 03:18:17.967099 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:18:17.969434 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-540d0940-e281-4d16-8b24-f0ba228947bd tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Returning 404 to user: Instance 64d3b78b-7953-40fc-ab53-b35f9d105901 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:18:17.970493 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-540d0940-e281-4d16-8b24-f0ba228947bd tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] 10.222.0.52 "GET /compute/v2.1/servers/64d3b78b-7953-40fc-ab53-b35f9d105901" status: 404 len: 111 microversion: 2.1 time: 0.042366 Oct 19 03:18:17.971566 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 921/1764] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:18:17 2022] GET /compute/v2.1/servers/64d3b78b-7953-40fc-ab53-b35f9d105901 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:18:17.977120 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-be16affd-f7fe-4d60-8382-87d1c459fe47 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:17.978031 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-be16affd-f7fe-4d60-8382-87d1c459fe47 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] [instance: 540a7025-b935-49fb-bc51-edf44ac1e0c4] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:18:17.984149 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-be16affd-f7fe-4d60-8382-87d1c459fe47 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:17.992862 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-be16affd-f7fe-4d60-8382-87d1c459fe47 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:17.992862 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-be16affd-f7fe-4d60-8382-87d1c459fe47 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:17.992862 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-be16affd-f7fe-4d60-8382-87d1c459fe47 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:17.992862 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-be16affd-f7fe-4d60-8382-87d1c459fe47 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:17.993502 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-be16affd-f7fe-4d60-8382-87d1c459fe47 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:18.004604 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-be16affd-f7fe-4d60-8382-87d1c459fe47 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] HTTP exception thrown: Instance 540a7025-b935-49fb-bc51-edf44ac1e0c4 could not be found. Oct 19 03:18:18.006219 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-be16affd-f7fe-4d60-8382-87d1c459fe47 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Request method failure captured: Oct 19 03:18:18.006219 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/540a7025-b935-49fb-bc51-edf44ac1e0c4 HTTP/1.1 Oct 19 03:18:18.006219 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:18:18.006219 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:18:18.006219 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:18:18.006219 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:18:18.006219 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:18:18.006219 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:18:18.006219 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:18:18.006219 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:18:18.006219 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2uSQ4aghED04QqDPHM1OP-O1PqvSJpkMhOvA7VLgxP4WrhSrQTweV4O6rqjt5wURK2xyXYJZ-SGScyc10Jion_2V1__oTHDWkLSRY_EKfcKBBvcRXZ-A_jVQfVZ3xH7n5g8FZqV34ufD4Ki_71ccq5JWT4fy4EL_1jaMvecF_TX2vU Oct 19 03:18:18.006219 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:18:18.006219 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:18:18.006219 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:18:18.006219 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:18:18.006219 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:18:18.006219 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:18:18.006219 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 48c12a432bbd43bd8f70ba6e941c28a2 Oct 19 03:18:18.006219 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-VolumesAdminNegativeTest-1529332028 Oct 19 03:18:18.006219 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:18:18.006219 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:18:18.007938 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/48c12a432bbd43bd8f70ba6e941c28a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/48c12a432bbd43bd8f70ba6e941c28a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/48c12a432bbd43bd8f70ba6e941c28a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_48c12a432bbd43bd8f70ba6e941c28a2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:18:18.007938 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-VolumesAdminNegativeTest-1529332028 Oct 19 03:18:18.007938 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 48c12a432bbd43bd8f70ba6e941c28a2 Oct 19 03:18:18.007938 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1529332028 Oct 19 03:18:18.007938 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-VolumesAdminNegativeTest-1529332028-project Oct 19 03:18:18.007938 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:18:18.007938 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:18:18.007938 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 28072a54d5934ea28e7d3205841c0852 Oct 19 03:18:18.007938 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-VolumesAdminNegativeTest-1529332028-project Oct 19 03:18:18.007938 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:18:18.007938 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance 540a7025-b935-49fb-bc51-edf44ac1e0c4 could not be found. Oct 19 03:18:18.007938 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '540a7025-b935-49fb-bc51-edf44ac1e0c4'} Oct 19 03:18:18.008947 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:18:18.008947 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:18:18.008947 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:18:18.008947 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:18:18.008947 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:18:18.008947 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:18:18.008947 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:18:18.008947 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:18:18.008947 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:18:18.008947 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:18:18.008947 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 540a7025-b935-49fb-bc51-edf44ac1e0c4 could not be found. Oct 19 03:18:18.008947 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:18:18.008947 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:18:18.008947 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:18:18.008947 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:18:18.008947 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:18:18.008947 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:18:18.008947 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:18:18.008947 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:18:18.008947 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:18:18.010634 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:18:18.010634 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:18:18.010634 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:18:18.010634 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:18:18.010634 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:18:18.010634 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:18:18.010634 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:18:18.010634 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 540a7025-b935-49fb-bc51-edf44ac1e0c4 could not be found. Oct 19 03:18:18.010634 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:18:18.010634 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:18:18.010634 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:18:18.010634 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:18:18.010634 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:18:18.010634 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:18:18.010634 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:18:18.010634 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:18:18.010634 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 540a7025-b935-49fb-bc51-edf44ac1e0c4 could not be found. Oct 19 03:18:18.010634 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:18:18.012000 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-be16affd-f7fe-4d60-8382-87d1c459fe47 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Returning 404 to user: Instance 540a7025-b935-49fb-bc51-edf44ac1e0c4 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:18:18.012000 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-be16affd-f7fe-4d60-8382-87d1c459fe47 tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] 10.222.0.52 "GET /compute/v2.1/servers/540a7025-b935-49fb-bc51-edf44ac1e0c4" status: 404 len: 111 microversion: 2.1 time: 0.034841 Oct 19 03:18:18.012000 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 922/1765] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:18:17 2022] GET /compute/v2.1/servers/540a7025-b935-49fb-bc51-edf44ac1e0c4 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:18:18.012631 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-10789dc9-dec4-4caa-b4bc-09facfbd4f90 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:18.013515 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-10789dc9-dec4-4caa-b4bc-09facfbd4f90 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] [instance: fef11301-8524-4f9b-bf6f-e525fca3237d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:18:18.024180 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-10789dc9-dec4-4caa-b4bc-09facfbd4f90 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:18.025021 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-10789dc9-dec4-4caa-b4bc-09facfbd4f90 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:18.028672 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-10789dc9-dec4-4caa-b4bc-09facfbd4f90 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:18.028672 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-10789dc9-dec4-4caa-b4bc-09facfbd4f90 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:18.028672 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-10789dc9-dec4-4caa-b4bc-09facfbd4f90 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:18.028672 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-10789dc9-dec4-4caa-b4bc-09facfbd4f90 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:18.045529 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-10789dc9-dec4-4caa-b4bc-09facfbd4f90 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] HTTP exception thrown: Instance fef11301-8524-4f9b-bf6f-e525fca3237d could not be found. Oct 19 03:18:18.047501 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-10789dc9-dec4-4caa-b4bc-09facfbd4f90 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Request method failure captured: Oct 19 03:18:18.047501 n-d-861333-8 devstack@n-api.service[121135]: request: DELETE /compute/v2.1/servers/fef11301-8524-4f9b-bf6f-e525fca3237d HTTP/1.1 Oct 19 03:18:18.047501 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:18:18.047501 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:18:18.047501 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:18:18.047501 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:18:18.047501 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:18:18.047501 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:18:18.047501 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:18:18.047501 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:18:18.047501 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2wRGEgYhAdPsgc7mEIDXrdPW4JwqYu1MFCRMWCDsXcKjxkHFT1VoJipXbbUg2wfFTgPSaTND8ANvmvXBbh_VcZiPRiOiOyyyOWkSDVD8anQKzoySXT9c8aNAT4O4UZ5kRq3Qlkx_fDPQls23gexwMFV2EY3yHLkKn1iQsrIizdgtLc Oct 19 03:18:18.047501 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:18:18.047501 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:18:18.047501 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:18:18.047501 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:18:18.047501 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:18:18.047501 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:18:18.047501 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 0fcd49d68a3947249016cc5dbe910efc Oct 19 03:18:18.047501 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ServersTestMultiNic-1638692278 Oct 19 03:18:18.047501 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:18:18.047501 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:18:18.048847 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/0fcd49d68a3947249016cc5dbe910efc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0fcd49d68a3947249016cc5dbe910efc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0fcd49d68a3947249016cc5dbe910efc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_0fcd49d68a3947249016cc5dbe910efc", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:18:18.048847 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ServersTestMultiNic-1638692278 Oct 19 03:18:18.048847 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 0fcd49d68a3947249016cc5dbe910efc Oct 19 03:18:18.048847 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ServersTestMultiNic-1638692278 Oct 19 03:18:18.048847 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ServersTestMultiNic-1638692278-project Oct 19 03:18:18.048847 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:18:18.048847 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:18:18.048847 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: d3c35b71372843d69f9a6c6be04b154f Oct 19 03:18:18.048847 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ServersTestMultiNic-1638692278-project Oct 19 03:18:18.048847 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:18:18.048847 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance fef11301-8524-4f9b-bf6f-e525fca3237d could not be found. Oct 19 03:18:18.048847 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': 'fef11301-8524-4f9b-bf6f-e525fca3237d'} Oct 19 03:18:18.049665 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:18:18.049665 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:18:18.049665 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:18:18.049665 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:18:18.049665 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:18:18.049665 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:18:18.049665 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:18:18.049665 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:18:18.049665 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:18:18.049665 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:18:18.049665 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fef11301-8524-4f9b-bf6f-e525fca3237d could not be found. Oct 19 03:18:18.049665 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:18:18.049665 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:18:18.049665 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:18:18.049665 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:18:18.049665 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:18:18.049665 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:18:18.049665 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:18:18.049665 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:18:18.049665 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:18:18.050885 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:18:18.050885 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 03:18:18.050885 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 03:18:18.050885 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 03:18:18.050885 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 03:18:18.050885 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:18:18.050885 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:18:18.050885 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:18:18.050885 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:18:18.050885 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fef11301-8524-4f9b-bf6f-e525fca3237d could not be found. Oct 19 03:18:18.050885 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:18:18.050885 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:18:18.050885 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:18:18.050885 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:18:18.050885 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:18:18.050885 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:18:18.050885 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:18:18.050885 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:18:18.050885 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fef11301-8524-4f9b-bf6f-e525fca3237d could not be found. Oct 19 03:18:18.050885 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:18:18.053788 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-10789dc9-dec4-4caa-b4bc-09facfbd4f90 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Returning 404 to user: Instance fef11301-8524-4f9b-bf6f-e525fca3237d could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:18:18.055488 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-10789dc9-dec4-4caa-b4bc-09facfbd4f90 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] 10.222.0.52 "DELETE /compute/v2.1/servers/fef11301-8524-4f9b-bf6f-e525fca3237d" status: 404 len: 111 microversion: 2.1 time: 0.046241 Oct 19 03:18:18.056891 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 923/1766] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:18:18 2022] DELETE /compute/v2.1/servers/fef11301-8524-4f9b-bf6f-e525fca3237d => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:18:18.063148 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4616feb0-241b-42ee-8a99-3f2aa93ae42f tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] Calling method '.version_select at 0x7fc130c663a0>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:18.175152 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4616feb0-241b-42ee-8a99-3f2aa93ae42f tempest-VolumesAdminNegativeTest-1529332028 tempest-VolumesAdminNegativeTest-1529332028-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-921583109" status: 202 len: 0 microversion: 2.1 time: 0.116881 Oct 19 03:18:18.178027 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 924/1767] 10.222.0.52 () {58 vars in 1218 bytes} [Wed Oct 19 03:18:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-921583109 => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:18:18.201613 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-eaf9fb28-751d-459c-a3e1-6f885c1b1ef4 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:18.202474 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-eaf9fb28-751d-459c-a3e1-6f885c1b1ef4 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] [instance: fef11301-8524-4f9b-bf6f-e525fca3237d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:18:18.220979 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-eaf9fb28-751d-459c-a3e1-6f885c1b1ef4 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:18.227985 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-eaf9fb28-751d-459c-a3e1-6f885c1b1ef4 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:18.228804 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-eaf9fb28-751d-459c-a3e1-6f885c1b1ef4 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:18.229802 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-eaf9fb28-751d-459c-a3e1-6f885c1b1ef4 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:18.230483 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-eaf9fb28-751d-459c-a3e1-6f885c1b1ef4 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:18.231149 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-eaf9fb28-751d-459c-a3e1-6f885c1b1ef4 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:18.267273 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-eaf9fb28-751d-459c-a3e1-6f885c1b1ef4 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] HTTP exception thrown: Instance fef11301-8524-4f9b-bf6f-e525fca3237d could not be found. Oct 19 03:18:18.268946 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-eaf9fb28-751d-459c-a3e1-6f885c1b1ef4 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Request method failure captured: Oct 19 03:18:18.268946 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/fef11301-8524-4f9b-bf6f-e525fca3237d HTTP/1.1 Oct 19 03:18:18.268946 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:18:18.268946 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:18:18.268946 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:18:18.268946 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:18:18.268946 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:18:18.268946 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:18:18.268946 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:18:18.268946 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:18:18.268946 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2wRGEgYhAdPsgc7mEIDXrdPW4JwqYu1MFCRMWCDsXcKjxkHFT1VoJipXbbUg2wfFTgPSaTND8ANvmvXBbh_VcZiPRiOiOyyyOWkSDVD8anQKzoySXT9c8aNAT4O4UZ5kRq3Qlkx_fDPQls23gexwMFV2EY3yHLkKn1iQsrIizdgtLc Oct 19 03:18:18.268946 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:18:18.268946 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:18:18.268946 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:18:18.268946 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:18:18.268946 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:18:18.268946 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:18:18.268946 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 0fcd49d68a3947249016cc5dbe910efc Oct 19 03:18:18.268946 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ServersTestMultiNic-1638692278 Oct 19 03:18:18.268946 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:18:18.268946 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:18:18.277777 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/0fcd49d68a3947249016cc5dbe910efc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0fcd49d68a3947249016cc5dbe910efc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0fcd49d68a3947249016cc5dbe910efc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_0fcd49d68a3947249016cc5dbe910efc", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:18:18.277777 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ServersTestMultiNic-1638692278 Oct 19 03:18:18.277777 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 0fcd49d68a3947249016cc5dbe910efc Oct 19 03:18:18.277777 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ServersTestMultiNic-1638692278 Oct 19 03:18:18.277777 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ServersTestMultiNic-1638692278-project Oct 19 03:18:18.277777 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:18:18.277777 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:18:18.277777 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: d3c35b71372843d69f9a6c6be04b154f Oct 19 03:18:18.277777 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ServersTestMultiNic-1638692278-project Oct 19 03:18:18.277777 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:18:18.277777 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance fef11301-8524-4f9b-bf6f-e525fca3237d could not be found. Oct 19 03:18:18.277777 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': 'fef11301-8524-4f9b-bf6f-e525fca3237d'} Oct 19 03:18:18.278545 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:18:18.278545 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:18:18.278545 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:18:18.278545 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:18:18.278545 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:18:18.278545 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:18:18.278545 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:18:18.278545 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:18:18.278545 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:18:18.278545 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:18:18.278545 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fef11301-8524-4f9b-bf6f-e525fca3237d could not be found. Oct 19 03:18:18.278545 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:18:18.278545 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:18:18.278545 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:18:18.278545 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:18:18.278545 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:18:18.278545 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:18:18.278545 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:18:18.278545 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:18:18.278545 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:18:18.279802 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:18:18.279802 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:18:18.279802 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:18:18.279802 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:18:18.279802 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:18:18.279802 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:18:18.279802 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:18:18.279802 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fef11301-8524-4f9b-bf6f-e525fca3237d could not be found. Oct 19 03:18:18.279802 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:18:18.279802 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:18:18.279802 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:18:18.279802 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:18:18.279802 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:18:18.279802 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:18:18.279802 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:18:18.279802 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:18:18.279802 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fef11301-8524-4f9b-bf6f-e525fca3237d could not be found. Oct 19 03:18:18.279802 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:18:18.280991 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-eaf9fb28-751d-459c-a3e1-6f885c1b1ef4 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] Returning 404 to user: Instance fef11301-8524-4f9b-bf6f-e525fca3237d could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:18:18.280991 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-eaf9fb28-751d-459c-a3e1-6f885c1b1ef4 tempest-ServersTestMultiNic-1638692278 tempest-ServersTestMultiNic-1638692278-project] 10.222.0.52 "GET /compute/v2.1/servers/fef11301-8524-4f9b-bf6f-e525fca3237d" status: 404 len: 111 microversion: 2.1 time: 0.087088 Oct 19 03:18:18.280991 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 925/1768] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:18:18 2022] GET /compute/v2.1/servers/fef11301-8524-4f9b-bf6f-e525fca3237d => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:18:18.280991 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9742cd2c-439e-4681-88fa-054404001ce2 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:18.280991 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9742cd2c-439e-4681-88fa-054404001ce2 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] [instance: 1c904d5d-95bc-43ef-9826-22311512565c] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:18:18.285274 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9742cd2c-439e-4681-88fa-054404001ce2 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:18.285945 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9742cd2c-439e-4681-88fa-054404001ce2 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:18.286602 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9742cd2c-439e-4681-88fa-054404001ce2 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:18.287597 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9742cd2c-439e-4681-88fa-054404001ce2 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:18.288155 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9742cd2c-439e-4681-88fa-054404001ce2 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:18.288684 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9742cd2c-439e-4681-88fa-054404001ce2 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:18.700332 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5844a5cd-baef-43d9-b1ae-493ffaa3d7f3 tempest-QuotasAdminTestJSON-122121752 tempest-QuotasAdminTestJSON-122121752-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-quota-sets/c5d97a25e1314c90af449604c79ab228" status: 200 len: 329 microversion: 2.1 time: 2.699333 Oct 19 03:18:18.702018 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 844/1769] 10.222.0.52 () {60 vars in 1263 bytes} [Wed Oct 19 03:18:15 2022] PUT /compute/v2.1/os-quota-sets/c5d97a25e1314c90af449604c79ab228 => generated 329 bytes in 2702 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:18:18.912049 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-947d7b03-fed3-45dd-8073-26d5c315d295 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:18.913828 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-947d7b03-fed3-45dd-8073-26d5c315d295 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 84774cfc-79b4-42db-acfd-c4daac86d196] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:18:18.922283 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-947d7b03-fed3-45dd-8073-26d5c315d295 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:18.924952 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-947d7b03-fed3-45dd-8073-26d5c315d295 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:18.925758 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-947d7b03-fed3-45dd-8073-26d5c315d295 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:18.927914 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-947d7b03-fed3-45dd-8073-26d5c315d295 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:18.929194 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-947d7b03-fed3-45dd-8073-26d5c315d295 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:18.930171 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-947d7b03-fed3-45dd-8073-26d5c315d295 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:18.954916 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-947d7b03-fed3-45dd-8073-26d5c315d295 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] HTTP exception thrown: Instance 84774cfc-79b4-42db-acfd-c4daac86d196 could not be found. Oct 19 03:18:18.962120 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-947d7b03-fed3-45dd-8073-26d5c315d295 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Request method failure captured: Oct 19 03:18:18.962120 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196 HTTP/1.1 Oct 19 03:18:18.962120 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:18:18.962120 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:18:18.962120 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:18:18.962120 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:18:18.962120 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:18:18.962120 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:18:18.962120 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:18:18.962120 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:18:18.962120 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT2ss0iGCXMKYXn1LmX_Zah9P9JAZ0VzppWJ3XBCTgfwVfv8VpGmP6w3yrAHdAbQksEAF5M1eFR6MmeOAkJSbToLcyX3U8OGqVCM_RJPznFl7wHwm8WUzMg1M4ltCr3QRzOEzqbq9S-yiRaL0fdU3qrc9oTISIJkq3dvw2wj9zi5CERw Oct 19 03:18:18.962120 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:18:18.962120 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:18:18.962120 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:18:18.962120 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:18:18.962120 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:18:18.962120 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:18:18.962120 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: c9a76121a22144499a44f44bb78848bf Oct 19 03:18:18.962120 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-MigrationsAdminTest-460511763 Oct 19 03:18:18.962120 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:18:18.962120 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:18:18.964702 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c9a76121a22144499a44f44bb78848bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c9a76121a22144499a44f44bb78848bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c9a76121a22144499a44f44bb78848bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c9a76121a22144499a44f44bb78848bf", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:18:18.964702 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-MigrationsAdminTest-460511763 Oct 19 03:18:18.964702 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: c9a76121a22144499a44f44bb78848bf Oct 19 03:18:18.964702 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-MigrationsAdminTest-460511763 Oct 19 03:18:18.964702 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-MigrationsAdminTest-460511763-project Oct 19 03:18:18.964702 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:18:18.964702 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:18:18.964702 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 9f8493504d9243bc95c9861f4ff76c83 Oct 19 03:18:18.964702 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-MigrationsAdminTest-460511763-project Oct 19 03:18:18.964702 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:18:18.964702 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance 84774cfc-79b4-42db-acfd-c4daac86d196 could not be found. Oct 19 03:18:18.964702 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '84774cfc-79b4-42db-acfd-c4daac86d196'} Oct 19 03:18:18.965678 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:18:18.965678 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:18:18.965678 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:18:18.965678 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:18:18.965678 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:18:18.965678 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:18:18.965678 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:18:18.965678 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:18:18.965678 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:18:18.965678 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:18:18.965678 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84774cfc-79b4-42db-acfd-c4daac86d196 could not be found. Oct 19 03:18:18.965678 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:18:18.965678 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:18:18.965678 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:18:18.965678 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:18:18.965678 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:18:18.965678 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:18:18.965678 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:18:18.965678 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:18:18.965678 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:18:18.967607 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:18:18.967607 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:18:18.967607 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:18:18.967607 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:18:18.967607 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:18:18.967607 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:18:18.967607 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:18:18.967607 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84774cfc-79b4-42db-acfd-c4daac86d196 could not be found. Oct 19 03:18:18.967607 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:18:18.967607 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:18:18.967607 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:18:18.967607 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:18:18.967607 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:18:18.967607 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:18:18.967607 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:18:18.967607 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:18:18.967607 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84774cfc-79b4-42db-acfd-c4daac86d196 could not be found. Oct 19 03:18:18.967607 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:18:18.969610 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-947d7b03-fed3-45dd-8073-26d5c315d295 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Returning 404 to user: Instance 84774cfc-79b4-42db-acfd-c4daac86d196 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:18:18.970802 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-947d7b03-fed3-45dd-8073-26d5c315d295 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196" status: 404 len: 111 microversion: 2.1 time: 0.068059 Oct 19 03:18:18.971650 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 845/1770] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:18:18 2022] GET /compute/v2.1/servers/84774cfc-79b4-42db-acfd-c4daac86d196 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 03:18:18.986936 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9f8a0b98-9430-4835-9635-fbc27c866263 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:18.992340 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9f8a0b98-9430-4835-9635-fbc27c866263 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 9daa020d-efe7-4033-a479-cb5dadbc3ad7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:18:19.015781 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9f8a0b98-9430-4835-9635-fbc27c866263 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:19.020811 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9f8a0b98-9430-4835-9635-fbc27c866263 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:19.020811 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9f8a0b98-9430-4835-9635-fbc27c866263 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:19.020811 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9f8a0b98-9430-4835-9635-fbc27c866263 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:19.020811 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9f8a0b98-9430-4835-9635-fbc27c866263 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:19.021201 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9f8a0b98-9430-4835-9635-fbc27c866263 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:19.032688 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-9742cd2c-439e-4681-88fa-054404001ce2 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffa4ce5ed5743a09717ab06218e73bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84273e394171452c947ec32bf639054d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:18:19.053629 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9742cd2c-439e-4681-88fa-054404001ce2 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] 10.222.0.52 "GET /compute/v2.1/servers/1c904d5d-95bc-43ef-9826-22311512565c" status: 200 len: 1313 microversion: 2.1 time: 0.780563 Oct 19 03:18:19.055519 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 926/1771] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:18:18 2022] GET /compute/v2.1/servers/1c904d5d-95bc-43ef-9826-22311512565c => generated 1313 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:18:19.101190 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9f8a0b98-9430-4835-9635-fbc27c866263 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 9daa020d-efe7-4033-a479-cb5dadbc3ad7] Going to try to terminate instance {{(pid=121134) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:18:19.620564 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9f8a0b98-9430-4835-9635-fbc27c866263 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "DELETE /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7" status: 204 len: 0 microversion: 2.1 time: 0.639610 Oct 19 03:18:19.623272 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 846/1772] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:18:18 2022] DELETE /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7 => generated 0 bytes in 641 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:18:19.631038 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5519e76d-1147-47fd-a038-1116aebb85f9 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:19.631666 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-5519e76d-1147-47fd-a038-1116aebb85f9 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 9daa020d-efe7-4033-a479-cb5dadbc3ad7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:18:19.634452 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=1,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:18:19.650310 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5519e76d-1147-47fd-a038-1116aebb85f9 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:19.656016 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5519e76d-1147-47fd-a038-1116aebb85f9 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:19.656016 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5519e76d-1147-47fd-a038-1116aebb85f9 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:19.656016 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5519e76d-1147-47fd-a038-1116aebb85f9 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:19.656016 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5519e76d-1147-47fd-a038-1116aebb85f9 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:19.656381 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5519e76d-1147-47fd-a038-1116aebb85f9 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:20.080825 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-28bf28f7-02f4-4f7a-870c-ac5365a94af4 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:20.081722 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-28bf28f7-02f4-4f7a-870c-ac5365a94af4 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] [instance: 1c904d5d-95bc-43ef-9826-22311512565c] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:18:20.089799 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-28bf28f7-02f4-4f7a-870c-ac5365a94af4 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:20.090624 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-28bf28f7-02f4-4f7a-870c-ac5365a94af4 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:20.091081 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-28bf28f7-02f4-4f7a-870c-ac5365a94af4 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:20.093658 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-28bf28f7-02f4-4f7a-870c-ac5365a94af4 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:20.094150 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-28bf28f7-02f4-4f7a-870c-ac5365a94af4 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:20.094833 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-28bf28f7-02f4-4f7a-870c-ac5365a94af4 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:20.280853 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-5519e76d-1147-47fd-a038-1116aebb85f9 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:18:20.298344 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5519e76d-1147-47fd-a038-1116aebb85f9 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7" status: 200 len: 1534 microversion: 2.1 time: 0.671798 Oct 19 03:18:20.299584 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 927/1773] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:18:19 2022] GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7 => generated 1534 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:18:20.652451 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-28bf28f7-02f4-4f7a-870c-ac5365a94af4 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffa4ce5ed5743a09717ab06218e73bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84273e394171452c947ec32bf639054d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:18:20.673575 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-28bf28f7-02f4-4f7a-870c-ac5365a94af4 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] 10.222.0.52 "GET /compute/v2.1/servers/1c904d5d-95bc-43ef-9826-22311512565c" status: 200 len: 1313 microversion: 2.1 time: 0.598032 Oct 19 03:18:20.675663 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 847/1774] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:18:20 2022] GET /compute/v2.1/servers/1c904d5d-95bc-43ef-9826-22311512565c => generated 1313 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:18:21.235673 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-4858ead5-dac3-43db-a963-b94e8d0356ea req-b5304f97-bc4a-49f5-83ee-ab5f4535eb4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c904d5d-95bc-43ef-9826-22311512565c", "tag": "02461c32-e37f-4632-8ecf-7b5e90a14b36"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:18:21.256410 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-4858ead5-dac3-43db-a963-b94e8d0356ea req-b5304f97-bc4a-49f5-83ee-ab5f4535eb4a service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:21.259508 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-4858ead5-dac3-43db-a963-b94e8d0356ea req-b5304f97-bc4a-49f5-83ee-ab5f4535eb4a service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:21.263376 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-4858ead5-dac3-43db-a963-b94e8d0356ea req-b5304f97-bc4a-49f5-83ee-ab5f4535eb4a service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:21.294371 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-4858ead5-dac3-43db-a963-b94e8d0356ea req-b5304f97-bc4a-49f5-83ee-ab5f4535eb4a service nova] Creating event network-changed:02461c32-e37f-4632-8ecf-7b5e90a14b36 for instance 1c904d5d-95bc-43ef-9826-22311512565c on n-h2-861333-8 Oct 19 03:18:21.309698 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-4858ead5-dac3-43db-a963-b94e8d0356ea req-b5304f97-bc4a-49f5-83ee-ab5f4535eb4a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079483 Oct 19 03:18:21.310393 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 928/1775] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:18:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:18:21.327862 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-43652f83-a66f-4546-a0df-c02f80f03869 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:21.330528 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-43652f83-a66f-4546-a0df-c02f80f03869 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 9daa020d-efe7-4033-a479-cb5dadbc3ad7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:18:21.343862 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-43652f83-a66f-4546-a0df-c02f80f03869 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:21.346531 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-43652f83-a66f-4546-a0df-c02f80f03869 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:21.349428 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-43652f83-a66f-4546-a0df-c02f80f03869 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:21.354964 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-43652f83-a66f-4546-a0df-c02f80f03869 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:21.354964 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-43652f83-a66f-4546-a0df-c02f80f03869 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:21.354964 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-43652f83-a66f-4546-a0df-c02f80f03869 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:21.700149 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c21ca60f-b19a-4344-bf5a-bc77ec1e356f tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:21.701286 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c21ca60f-b19a-4344-bf5a-bc77ec1e356f tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] [instance: 1c904d5d-95bc-43ef-9826-22311512565c] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:18:21.705740 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:18:21.717751 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c21ca60f-b19a-4344-bf5a-bc77ec1e356f tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:21.718260 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c21ca60f-b19a-4344-bf5a-bc77ec1e356f tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:21.718697 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c21ca60f-b19a-4344-bf5a-bc77ec1e356f tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:21.719409 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c21ca60f-b19a-4344-bf5a-bc77ec1e356f tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:21.724171 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c21ca60f-b19a-4344-bf5a-bc77ec1e356f tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:21.724823 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c21ca60f-b19a-4344-bf5a-bc77ec1e356f tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:22.526679 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-43652f83-a66f-4546-a0df-c02f80f03869 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:18:22.546551 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-43652f83-a66f-4546-a0df-c02f80f03869 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7" status: 200 len: 1534 microversion: 2.1 time: 1.224171 Oct 19 03:18:22.547439 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 848/1776] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:18:21 2022] GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7 => generated 1534 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:18:22.819580 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c21ca60f-b19a-4344-bf5a-bc77ec1e356f tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffa4ce5ed5743a09717ab06218e73bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84273e394171452c947ec32bf639054d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:18:22.837807 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c21ca60f-b19a-4344-bf5a-bc77ec1e356f tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] 10.222.0.52 "GET /compute/v2.1/servers/1c904d5d-95bc-43ef-9826-22311512565c" status: 200 len: 1313 microversion: 2.1 time: 1.141215 Oct 19 03:18:22.852619 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 929/1777] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:18:21 2022] GET /compute/v2.1/servers/1c904d5d-95bc-43ef-9826-22311512565c => generated 1313 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:18:23.501286 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-94ba39eb-6601-4bad-9000-562b89701375 req-1924bb27-510f-4cc5-aa73-8308826d2101 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9daa020d-efe7-4033-a479-cb5dadbc3ad7", "name": "network-vif-deleted", "tag": "ffc480f5-b5eb-49ea-81a9-00c3c1562f19"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:18:23.527174 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-94ba39eb-6601-4bad-9000-562b89701375 req-1924bb27-510f-4cc5-aa73-8308826d2101 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:23.528394 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-94ba39eb-6601-4bad-9000-562b89701375 req-1924bb27-510f-4cc5-aa73-8308826d2101 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:23.528993 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-94ba39eb-6601-4bad-9000-562b89701375 req-1924bb27-510f-4cc5-aa73-8308826d2101 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:23.556952 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-94ba39eb-6601-4bad-9000-562b89701375 req-1924bb27-510f-4cc5-aa73-8308826d2101 service nova] Creating event network-vif-deleted:ffc480f5-b5eb-49ea-81a9-00c3c1562f19 for instance 9daa020d-efe7-4033-a479-cb5dadbc3ad7 on n-h2-861333-8 Oct 19 03:18:23.566741 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-94ba39eb-6601-4bad-9000-562b89701375 req-1924bb27-510f-4cc5-aa73-8308826d2101 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068997 Oct 19 03:18:23.567979 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 849/1778] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:18:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:18:23.592929 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-fbc02141-7987-46e9-8572-5627ab823742 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:23.595163 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-fbc02141-7987-46e9-8572-5627ab823742 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 9daa020d-efe7-4033-a479-cb5dadbc3ad7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:18:23.656510 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fbc02141-7987-46e9-8572-5627ab823742 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:23.669900 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fbc02141-7987-46e9-8572-5627ab823742 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:23.670545 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fbc02141-7987-46e9-8572-5627ab823742 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:23.671325 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fbc02141-7987-46e9-8572-5627ab823742 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:23.680575 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fbc02141-7987-46e9-8572-5627ab823742 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:23.681772 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fbc02141-7987-46e9-8572-5627ab823742 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:23.866053 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4dc3f538-11d7-45fb-a935-1ee615739608 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:23.867440 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4dc3f538-11d7-45fb-a935-1ee615739608 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] [instance: 1c904d5d-95bc-43ef-9826-22311512565c] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:18:23.881028 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4dc3f538-11d7-45fb-a935-1ee615739608 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:23.881631 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4dc3f538-11d7-45fb-a935-1ee615739608 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:23.892771 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4dc3f538-11d7-45fb-a935-1ee615739608 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:23.893608 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4dc3f538-11d7-45fb-a935-1ee615739608 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:23.894278 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4dc3f538-11d7-45fb-a935-1ee615739608 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:23.894904 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4dc3f538-11d7-45fb-a935-1ee615739608 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:23.899887 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:18:23.930638 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-fbc02141-7987-46e9-8572-5627ab823742 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:18:23.940979 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-fbc02141-7987-46e9-8572-5627ab823742 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7" status: 200 len: 1492 microversion: 2.1 time: 0.369775 Oct 19 03:18:23.944011 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 930/1779] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:18:23 2022] GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7 => generated 1492 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:18:24.479540 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-4dc3f538-11d7-45fb-a935-1ee615739608 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffa4ce5ed5743a09717ab06218e73bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84273e394171452c947ec32bf639054d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:18:24.493246 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4dc3f538-11d7-45fb-a935-1ee615739608 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] 10.222.0.52 "GET /compute/v2.1/servers/1c904d5d-95bc-43ef-9826-22311512565c" status: 200 len: 1313 microversion: 2.1 time: 0.630628 Oct 19 03:18:24.494972 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 850/1780] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:18:23 2022] GET /compute/v2.1/servers/1c904d5d-95bc-43ef-9826-22311512565c => generated 1313 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:18:24.969586 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1b4d75de-bf96-4921-99d5-7065afb8bad4 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:24.972165 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1b4d75de-bf96-4921-99d5-7065afb8bad4 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 9daa020d-efe7-4033-a479-cb5dadbc3ad7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:18:24.989312 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1b4d75de-bf96-4921-99d5-7065afb8bad4 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:24.990209 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1b4d75de-bf96-4921-99d5-7065afb8bad4 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:24.992808 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1b4d75de-bf96-4921-99d5-7065afb8bad4 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:24.995224 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1b4d75de-bf96-4921-99d5-7065afb8bad4 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:24.997381 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1b4d75de-bf96-4921-99d5-7065afb8bad4 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:25.003714 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1b4d75de-bf96-4921-99d5-7065afb8bad4 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:25.133689 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1b4d75de-bf96-4921-99d5-7065afb8bad4 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:25.136618 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1b4d75de-bf96-4921-99d5-7065afb8bad4 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:25.137324 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1b4d75de-bf96-4921-99d5-7065afb8bad4 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:25.142766 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-1b4d75de-bf96-4921-99d5-7065afb8bad4 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lazy-loading 'fault' on Instance uuid 9daa020d-efe7-4033-a479-cb5dadbc3ad7 {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:18:25.283695 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-1b4d75de-bf96-4921-99d5-7065afb8bad4 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:18:25.306293 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1b4d75de-bf96-4921-99d5-7065afb8bad4 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7" status: 200 len: 1368 microversion: 2.1 time: 0.341133 Oct 19 03:18:25.327129 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 931/1781] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:18:24 2022] GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7 => generated 1368 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:18:25.520954 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3efe2412-dc53-471e-bc70-55c72ac4947d tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:25.521609 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3efe2412-dc53-471e-bc70-55c72ac4947d tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] [instance: 1c904d5d-95bc-43ef-9826-22311512565c] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:18:25.554042 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3efe2412-dc53-471e-bc70-55c72ac4947d tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:25.554818 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3efe2412-dc53-471e-bc70-55c72ac4947d tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:25.555438 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3efe2412-dc53-471e-bc70-55c72ac4947d tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:25.556575 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3efe2412-dc53-471e-bc70-55c72ac4947d tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:25.557390 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3efe2412-dc53-471e-bc70-55c72ac4947d tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:25.557996 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3efe2412-dc53-471e-bc70-55c72ac4947d tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:25.878949 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-3efe2412-dc53-471e-bc70-55c72ac4947d tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffa4ce5ed5743a09717ab06218e73bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84273e394171452c947ec32bf639054d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:18:25.896239 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3efe2412-dc53-471e-bc70-55c72ac4947d tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] 10.222.0.52 "GET /compute/v2.1/servers/1c904d5d-95bc-43ef-9826-22311512565c" status: 200 len: 1313 microversion: 2.1 time: 0.379596 Oct 19 03:18:25.909775 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 851/1782] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:18:25 2022] GET /compute/v2.1/servers/1c904d5d-95bc-43ef-9826-22311512565c => generated 1313 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:18:26.336353 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d6a61624-e56e-48e3-8bf5-10f25244c4e8 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:26.340934 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d6a61624-e56e-48e3-8bf5-10f25244c4e8 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 9daa020d-efe7-4033-a479-cb5dadbc3ad7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:18:26.352651 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d6a61624-e56e-48e3-8bf5-10f25244c4e8 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:26.354378 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d6a61624-e56e-48e3-8bf5-10f25244c4e8 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:26.356613 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d6a61624-e56e-48e3-8bf5-10f25244c4e8 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:26.359983 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d6a61624-e56e-48e3-8bf5-10f25244c4e8 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:26.362196 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d6a61624-e56e-48e3-8bf5-10f25244c4e8 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:26.363927 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d6a61624-e56e-48e3-8bf5-10f25244c4e8 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:26.394372 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-d6a61624-e56e-48e3-8bf5-10f25244c4e8 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] HTTP exception thrown: Instance 9daa020d-efe7-4033-a479-cb5dadbc3ad7 could not be found. Oct 19 03:18:26.398125 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d6a61624-e56e-48e3-8bf5-10f25244c4e8 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Request method failure captured: Oct 19 03:18:26.398125 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7 HTTP/1.1 Oct 19 03:18:26.398125 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:18:26.398125 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:18:26.398125 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:18:26.398125 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:18:26.398125 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:18:26.398125 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:18:26.398125 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:18:26.398125 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:18:26.398125 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2ss0iGCXMKYXn1LmX_Zah9P9JAZ0VzppWJ3XBCTgfwVfv8VpGmP6w3yrAHdAbQksEAF5M1eFR6MmeOAkJSbToLcyX3U8OGqVCM_RJPznFl7wHwm8WUzMg1M4ltCr3QRzOEzqbq9S-yiRaL0fdU3qrc9oTISIJkq3dvw2wj9zi5CERw Oct 19 03:18:26.398125 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:18:26.398125 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:18:26.398125 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:18:26.398125 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:18:26.398125 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:18:26.398125 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:18:26.398125 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: c9a76121a22144499a44f44bb78848bf Oct 19 03:18:26.398125 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-MigrationsAdminTest-460511763 Oct 19 03:18:26.398125 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:18:26.398125 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:18:26.399577 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c9a76121a22144499a44f44bb78848bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c9a76121a22144499a44f44bb78848bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c9a76121a22144499a44f44bb78848bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c9a76121a22144499a44f44bb78848bf", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:18:26.399577 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-MigrationsAdminTest-460511763 Oct 19 03:18:26.399577 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: c9a76121a22144499a44f44bb78848bf Oct 19 03:18:26.399577 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-MigrationsAdminTest-460511763 Oct 19 03:18:26.399577 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-MigrationsAdminTest-460511763-project Oct 19 03:18:26.399577 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:18:26.399577 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:18:26.399577 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 9f8493504d9243bc95c9861f4ff76c83 Oct 19 03:18:26.399577 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-MigrationsAdminTest-460511763-project Oct 19 03:18:26.399577 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:18:26.399577 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance 9daa020d-efe7-4033-a479-cb5dadbc3ad7 could not be found. Oct 19 03:18:26.399577 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '9daa020d-efe7-4033-a479-cb5dadbc3ad7'} Oct 19 03:18:26.400402 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:18:26.400402 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:18:26.400402 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:18:26.400402 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:18:26.400402 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:18:26.400402 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:18:26.400402 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:18:26.400402 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:18:26.400402 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:18:26.400402 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:18:26.400402 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9daa020d-efe7-4033-a479-cb5dadbc3ad7 could not be found. Oct 19 03:18:26.400402 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:18:26.400402 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:18:26.400402 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:18:26.400402 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:18:26.400402 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:18:26.400402 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:18:26.400402 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:18:26.400402 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:18:26.400402 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:18:26.402411 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:18:26.402411 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:18:26.402411 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:18:26.402411 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:18:26.402411 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:18:26.402411 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:18:26.402411 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:18:26.402411 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9daa020d-efe7-4033-a479-cb5dadbc3ad7 could not be found. Oct 19 03:18:26.402411 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:18:26.402411 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:18:26.402411 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:18:26.402411 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:18:26.402411 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:18:26.402411 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:18:26.402411 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:18:26.402411 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:18:26.402411 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9daa020d-efe7-4033-a479-cb5dadbc3ad7 could not be found. Oct 19 03:18:26.402411 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:18:26.404698 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d6a61624-e56e-48e3-8bf5-10f25244c4e8 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Returning 404 to user: Instance 9daa020d-efe7-4033-a479-cb5dadbc3ad7 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:18:26.405325 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d6a61624-e56e-48e3-8bf5-10f25244c4e8 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7" status: 404 len: 111 microversion: 2.1 time: 0.076864 Oct 19 03:18:26.414391 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 932/1783] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:18:26 2022] GET /compute/v2.1/servers/9daa020d-efe7-4033-a479-cb5dadbc3ad7 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:18:26.419552 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-759f7b1f-0d30-4989-86de-4a65ffad4df4 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '.version_select at 0x7fc1304de700>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:26.452765 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=21 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:18:26.640037 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-759f7b1f-0d30-4989-86de-4a65ffad4df4 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-659779218" status: 202 len: 0 microversion: 2.1 time: 0.223884 Oct 19 03:18:26.640872 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 852/1784] 10.222.0.52 () {58 vars in 1218 bytes} [Wed Oct 19 03:18:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-659779218 => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:18:26.933308 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-416bec58-7dc4-4514-a74a-19eab5dfce72 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:26.934214 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-416bec58-7dc4-4514-a74a-19eab5dfce72 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] [instance: 1c904d5d-95bc-43ef-9826-22311512565c] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:18:26.948958 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-416bec58-7dc4-4514-a74a-19eab5dfce72 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:26.949798 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-416bec58-7dc4-4514-a74a-19eab5dfce72 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:26.950496 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-416bec58-7dc4-4514-a74a-19eab5dfce72 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:26.952726 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-416bec58-7dc4-4514-a74a-19eab5dfce72 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:26.960151 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-416bec58-7dc4-4514-a74a-19eab5dfce72 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:26.960923 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-416bec58-7dc4-4514-a74a-19eab5dfce72 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:27.487609 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ba6ca76c-3aad-4c45-af7a-81dd1256ef7f tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:27.488529 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ba6ca76c-3aad-4c45-af7a-81dd1256ef7f tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] [instance: 62133546-4a75-4532-81ab-0c49c9252e85] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:18:27.503750 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ba6ca76c-3aad-4c45-af7a-81dd1256ef7f tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:27.511119 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ba6ca76c-3aad-4c45-af7a-81dd1256ef7f tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:27.515373 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ba6ca76c-3aad-4c45-af7a-81dd1256ef7f tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:27.516470 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ba6ca76c-3aad-4c45-af7a-81dd1256ef7f tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:27.519653 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ba6ca76c-3aad-4c45-af7a-81dd1256ef7f tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:27.520588 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ba6ca76c-3aad-4c45-af7a-81dd1256ef7f tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:27.843627 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-416bec58-7dc4-4514-a74a-19eab5dfce72 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffa4ce5ed5743a09717ab06218e73bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84273e394171452c947ec32bf639054d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:18:27.876628 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-416bec58-7dc4-4514-a74a-19eab5dfce72 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] 10.222.0.52 "GET /compute/v2.1/servers/1c904d5d-95bc-43ef-9826-22311512565c" status: 200 len: 1313 microversion: 2.1 time: 0.947878 Oct 19 03:18:27.878259 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 933/1785] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:18:26 2022] GET /compute/v2.1/servers/1c904d5d-95bc-43ef-9826-22311512565c => generated 1313 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:18:27.958121 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-ba6ca76c-3aad-4c45-af7a-81dd1256ef7f tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lazy-loading 'services' on Instance uuid 62133546-4a75-4532-81ab-0c49c9252e85 {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:18:27.973830 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ba6ca76c-3aad-4c45-af7a-81dd1256ef7f tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85" status: 200 len: 2419 microversion: 2.25 time: 0.490626 Oct 19 03:18:27.974582 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 853/1786] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:18:27 2022] GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85 => generated 2419 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:18:28.014029 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-dc0eb7d0-e971-4d2d-b289-9d0909a12d09 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-861333-8", "block_migration": "auto"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:18:28.016676 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-dc0eb7d0-e971-4d2d-b289-9d0909a12d09 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] [instance: 62133546-4a75-4532-81ab-0c49c9252e85] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:18:28.025860 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dc0eb7d0-e971-4d2d-b289-9d0909a12d09 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:28.026365 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dc0eb7d0-e971-4d2d-b289-9d0909a12d09 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:28.026810 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dc0eb7d0-e971-4d2d-b289-9d0909a12d09 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:28.027519 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dc0eb7d0-e971-4d2d-b289-9d0909a12d09 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:28.027997 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dc0eb7d0-e971-4d2d-b289-9d0909a12d09 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:28.028430 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dc0eb7d0-e971-4d2d-b289-9d0909a12d09 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:28.095426 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-dc0eb7d0-e971-4d2d-b289-9d0909a12d09 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lazy-loading 'flavor' on Instance uuid 62133546-4a75-4532-81ab-0c49c9252e85 {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:18:28.108483 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-dc0eb7d0-e971-4d2d-b289-9d0909a12d09 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] [instance: 62133546-4a75-4532-81ab-0c49c9252e85] Going to try to live migrate instance to n-h2-861333-8 {{(pid=121135) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 19 03:18:28.901488 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4be9e911-9d43-4653-adc7-9b28a3e5f6bf tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:28.902623 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4be9e911-9d43-4653-adc7-9b28a3e5f6bf tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] [instance: 1c904d5d-95bc-43ef-9826-22311512565c] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:18:28.905697 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=37 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:18:28.910806 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4be9e911-9d43-4653-adc7-9b28a3e5f6bf tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:28.911682 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4be9e911-9d43-4653-adc7-9b28a3e5f6bf tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:28.912725 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4be9e911-9d43-4653-adc7-9b28a3e5f6bf tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:28.913718 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4be9e911-9d43-4653-adc7-9b28a3e5f6bf tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:28.914391 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4be9e911-9d43-4653-adc7-9b28a3e5f6bf tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:28.915025 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4be9e911-9d43-4653-adc7-9b28a3e5f6bf tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:29.103290 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-4be9e911-9d43-4653-adc7-9b28a3e5f6bf tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffa4ce5ed5743a09717ab06218e73bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84273e394171452c947ec32bf639054d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:18:29.111878 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4be9e911-9d43-4653-adc7-9b28a3e5f6bf tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] 10.222.0.52 "GET /compute/v2.1/servers/1c904d5d-95bc-43ef-9826-22311512565c" status: 200 len: 1313 microversion: 2.1 time: 0.214735 Oct 19 03:18:29.112541 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 854/1787] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:18:28 2022] GET /compute/v2.1/servers/1c904d5d-95bc-43ef-9826-22311512565c => generated 1313 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:18:29.469398 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7a2fb012-7cd6-4b11-926a-bdacf805f378 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:29.469935 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7a2fb012-7cd6-4b11-926a-bdacf805f378 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:18:29.479287 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7a2fb012-7cd6-4b11-926a-bdacf805f378 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:29.480052 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7a2fb012-7cd6-4b11-926a-bdacf805f378 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:29.480648 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7a2fb012-7cd6-4b11-926a-bdacf805f378 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:29.481603 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7a2fb012-7cd6-4b11-926a-bdacf805f378 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:29.482233 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7a2fb012-7cd6-4b11-926a-bdacf805f378 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:29.482831 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7a2fb012-7cd6-4b11-926a-bdacf805f378 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:29.539535 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7a2fb012-7cd6-4b11-926a-bdacf805f378 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667] Going to try to terminate instance {{(pid=121134) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:18:29.946937 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7a2fb012-7cd6-4b11-926a-bdacf805f378 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667" status: 204 len: 0 microversion: 2.1 time: 0.481707 Oct 19 03:18:29.947880 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 855/1788] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:18:29 2022] DELETE /compute/v2.1/servers/ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:18:29.958394 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6ad2dd99-30d4-4ee0-a010-ab06fdf72cef tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:29.959123 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6ad2dd99-30d4-4ee0-a010-ab06fdf72cef tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:18:29.971643 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6ad2dd99-30d4-4ee0-a010-ab06fdf72cef tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:29.972212 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6ad2dd99-30d4-4ee0-a010-ab06fdf72cef tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:29.972657 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6ad2dd99-30d4-4ee0-a010-ab06fdf72cef tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:29.978897 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6ad2dd99-30d4-4ee0-a010-ab06fdf72cef tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:29.979406 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6ad2dd99-30d4-4ee0-a010-ab06fdf72cef tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:29.985177 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6ad2dd99-30d4-4ee0-a010-ab06fdf72cef tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:30.356168 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-6ad2dd99-30d4-4ee0-a010-ab06fdf72cef tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:18:30.403885 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6ad2dd99-30d4-4ee0-a010-ab06fdf72cef tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667" status: 200 len: 1468 microversion: 2.1 time: 0.449637 Oct 19 03:18:30.407291 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 856/1789] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:18:29 2022] GET /compute/v2.1/servers/ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667 => generated 1468 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:18:30.417020 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7fd8360b-3432-43b4-a4bf-a872ad3765e8 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:30.431019 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7fd8360b-3432-43b4-a4bf-a872ad3765e8 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] [instance: 1c904d5d-95bc-43ef-9826-22311512565c] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:18:30.450828 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7fd8360b-3432-43b4-a4bf-a872ad3765e8 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:30.451340 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7fd8360b-3432-43b4-a4bf-a872ad3765e8 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:30.453987 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7fd8360b-3432-43b4-a4bf-a872ad3765e8 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:30.457999 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7fd8360b-3432-43b4-a4bf-a872ad3765e8 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:30.458493 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7fd8360b-3432-43b4-a4bf-a872ad3765e8 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:30.459092 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7fd8360b-3432-43b4-a4bf-a872ad3765e8 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:30.958596 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-7fd8360b-3432-43b4-a4bf-a872ad3765e8 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffa4ce5ed5743a09717ab06218e73bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84273e394171452c947ec32bf639054d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:18:30.968532 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7fd8360b-3432-43b4-a4bf-a872ad3765e8 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] 10.222.0.52 "GET /compute/v2.1/servers/1c904d5d-95bc-43ef-9826-22311512565c" status: 200 len: 1313 microversion: 2.1 time: 0.558268 Oct 19 03:18:30.972800 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 857/1790] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:18:30 2022] GET /compute/v2.1/servers/1c904d5d-95bc-43ef-9826-22311512565c => generated 1313 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:18:31.000880 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-58f8a112-b702-487e-9a54-52e235da2bc1 req-45fd1826-1d4b-40ff-9adf-d97f293aec33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c904d5d-95bc-43ef-9826-22311512565c", "name": "network-vif-plugged", "status": "completed", "tag": "02461c32-e37f-4632-8ecf-7b5e90a14b36"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:18:31.019231 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:INSERT=14,nova_api:SELECT=69,nova_api:UPDATE=16,nova_api:DELETE=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:18:31.034987 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-58f8a112-b702-487e-9a54-52e235da2bc1 req-45fd1826-1d4b-40ff-9adf-d97f293aec33 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:31.035476 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-58f8a112-b702-487e-9a54-52e235da2bc1 req-45fd1826-1d4b-40ff-9adf-d97f293aec33 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:31.035917 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-58f8a112-b702-487e-9a54-52e235da2bc1 req-45fd1826-1d4b-40ff-9adf-d97f293aec33 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:31.096303 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-58f8a112-b702-487e-9a54-52e235da2bc1 req-45fd1826-1d4b-40ff-9adf-d97f293aec33 service nova] Creating event network-vif-plugged:02461c32-e37f-4632-8ecf-7b5e90a14b36 for instance 1c904d5d-95bc-43ef-9826-22311512565c on n-h2-861333-8 Oct 19 03:18:31.114528 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-58f8a112-b702-487e-9a54-52e235da2bc1 req-45fd1826-1d4b-40ff-9adf-d97f293aec33 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137249 Oct 19 03:18:31.115546 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 858/1791] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:18:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:18:31.434392 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-142cb795-322b-44c8-816a-06629e5274d3 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:31.448002 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-142cb795-322b-44c8-816a-06629e5274d3 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:18:31.460781 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-142cb795-322b-44c8-816a-06629e5274d3 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:31.461556 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-142cb795-322b-44c8-816a-06629e5274d3 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:31.462172 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-142cb795-322b-44c8-816a-06629e5274d3 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:31.463072 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-142cb795-322b-44c8-816a-06629e5274d3 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:31.463678 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-142cb795-322b-44c8-816a-06629e5274d3 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:31.464501 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-142cb795-322b-44c8-816a-06629e5274d3 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:31.980467 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-142cb795-322b-44c8-816a-06629e5274d3 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:18:31.989195 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-142cb795-322b-44c8-816a-06629e5274d3 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667" status: 200 len: 1468 microversion: 2.1 time: 0.560863 Oct 19 03:18:31.994770 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 859/1792] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:18:31 2022] GET /compute/v2.1/servers/ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667 => generated 1468 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:18:32.013292 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7402f51f-1afc-4cd0-a783-4ffa354f88ef tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:32.014313 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7402f51f-1afc-4cd0-a783-4ffa354f88ef tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] [instance: 1c904d5d-95bc-43ef-9826-22311512565c] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:18:32.026924 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7402f51f-1afc-4cd0-a783-4ffa354f88ef tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:32.027937 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7402f51f-1afc-4cd0-a783-4ffa354f88ef tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:32.029444 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7402f51f-1afc-4cd0-a783-4ffa354f88ef tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:32.030409 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7402f51f-1afc-4cd0-a783-4ffa354f88ef tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:32.033191 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7402f51f-1afc-4cd0-a783-4ffa354f88ef tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:32.034275 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7402f51f-1afc-4cd0-a783-4ffa354f88ef tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:32.320447 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-7402f51f-1afc-4cd0-a783-4ffa354f88ef tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffa4ce5ed5743a09717ab06218e73bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84273e394171452c947ec32bf639054d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:18:32.347959 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7402f51f-1afc-4cd0-a783-4ffa354f88ef tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] 10.222.0.52 "GET /compute/v2.1/servers/1c904d5d-95bc-43ef-9826-22311512565c" status: 200 len: 1313 microversion: 2.1 time: 0.346156 Oct 19 03:18:32.347959 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 860/1793] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:18:31 2022] GET /compute/v2.1/servers/1c904d5d-95bc-43ef-9826-22311512565c => generated 1313 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:18:32.752829 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-be0b3d36-9f22-4550-8fb1-4393561772a1 req-c78de40e-8ad0-4bf2-90f9-71e6f6a9982a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667", "name": "network-vif-deleted", "tag": "93027c05-97a2-4189-89b6-b07e9d59b6c4"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:18:32.771735 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-be0b3d36-9f22-4550-8fb1-4393561772a1 req-c78de40e-8ad0-4bf2-90f9-71e6f6a9982a service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:32.772555 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-be0b3d36-9f22-4550-8fb1-4393561772a1 req-c78de40e-8ad0-4bf2-90f9-71e6f6a9982a service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:32.774016 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-be0b3d36-9f22-4550-8fb1-4393561772a1 req-c78de40e-8ad0-4bf2-90f9-71e6f6a9982a service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:32.802468 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-be0b3d36-9f22-4550-8fb1-4393561772a1 req-c78de40e-8ad0-4bf2-90f9-71e6f6a9982a service nova] Creating event network-vif-deleted:93027c05-97a2-4189-89b6-b07e9d59b6c4 for instance ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667 on n-h1-861333-8 Oct 19 03:18:32.811087 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-be0b3d36-9f22-4550-8fb1-4393561772a1 req-c78de40e-8ad0-4bf2-90f9-71e6f6a9982a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063010 Oct 19 03:18:32.815355 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 861/1794] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:18:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:18:33.036843 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5233a037-3a84-422a-8184-c37256823009 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:33.036843 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5233a037-3a84-422a-8184-c37256823009 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:18:33.063083 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5233a037-3a84-422a-8184-c37256823009 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:33.063659 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5233a037-3a84-422a-8184-c37256823009 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:33.064110 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5233a037-3a84-422a-8184-c37256823009 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:33.068658 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5233a037-3a84-422a-8184-c37256823009 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:33.071877 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5233a037-3a84-422a-8184-c37256823009 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:33.072329 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5233a037-3a84-422a-8184-c37256823009 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:33.243155 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5233a037-3a84-422a-8184-c37256823009 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:18:33.261356 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5233a037-3a84-422a-8184-c37256823009 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667" status: 200 len: 1297 microversion: 2.1 time: 0.248153 Oct 19 03:18:33.276855 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 862/1795] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:18:33 2022] GET /compute/v2.1/servers/ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667 => generated 1297 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:18:33.369792 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-307ad0fa-0a67-4401-9293-0fb2194fcd28 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:33.370868 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-307ad0fa-0a67-4401-9293-0fb2194fcd28 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] [instance: 1c904d5d-95bc-43ef-9826-22311512565c] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:18:33.383967 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-307ad0fa-0a67-4401-9293-0fb2194fcd28 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:33.385018 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-307ad0fa-0a67-4401-9293-0fb2194fcd28 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:33.386795 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-307ad0fa-0a67-4401-9293-0fb2194fcd28 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:33.393207 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-307ad0fa-0a67-4401-9293-0fb2194fcd28 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:33.393207 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-307ad0fa-0a67-4401-9293-0fb2194fcd28 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:33.393207 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-307ad0fa-0a67-4401-9293-0fb2194fcd28 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:33.876225 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-307ad0fa-0a67-4401-9293-0fb2194fcd28 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffa4ce5ed5743a09717ab06218e73bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84273e394171452c947ec32bf639054d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:18:33.892936 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-307ad0fa-0a67-4401-9293-0fb2194fcd28 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] 10.222.0.52 "GET /compute/v2.1/servers/1c904d5d-95bc-43ef-9826-22311512565c" status: 200 len: 1463 microversion: 2.1 time: 0.529348 Oct 19 03:18:33.893287 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 863/1796] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:18:33 2022] GET /compute/v2.1/servers/1c904d5d-95bc-43ef-9826-22311512565c => generated 1463 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:18:34.385301 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-dc0eb7d0-e971-4d2d-b289-9d0909a12d09 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85/action" status: 202 len: 0 microversion: 2.25 time: 6.375855 Oct 19 03:18:34.392279 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 934/1797] 10.222.0.52 () {62 vars in 1319 bytes} [Wed Oct 19 03:18:28 2022] POST /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85/action => generated 0 bytes in 6383 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:18:34.399671 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0ae7fa93-86cd-4d1d-a82e-ecce51590b38 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:34.402043 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0ae7fa93-86cd-4d1d-a82e-ecce51590b38 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:18:34.416713 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0ae7fa93-86cd-4d1d-a82e-ecce51590b38 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:34.417784 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0ae7fa93-86cd-4d1d-a82e-ecce51590b38 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:34.418750 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0ae7fa93-86cd-4d1d-a82e-ecce51590b38 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:34.419682 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0ae7fa93-86cd-4d1d-a82e-ecce51590b38 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:34.420607 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0ae7fa93-86cd-4d1d-a82e-ecce51590b38 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:34.421247 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0ae7fa93-86cd-4d1d-a82e-ecce51590b38 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:34.446401 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-0ae7fa93-86cd-4d1d-a82e-ecce51590b38 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] HTTP exception thrown: Instance ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667 could not be found. Oct 19 03:18:34.448055 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0ae7fa93-86cd-4d1d-a82e-ecce51590b38 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Request method failure captured: Oct 19 03:18:34.448055 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667 HTTP/1.1 Oct 19 03:18:34.448055 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:18:34.448055 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:18:34.448055 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:18:34.448055 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:18:34.448055 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:18:34.448055 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:18:34.448055 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:18:34.448055 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:18:34.448055 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2ss0iGCXMKYXn1LmX_Zah9P9JAZ0VzppWJ3XBCTgfwVfv8VpGmP6w3yrAHdAbQksEAF5M1eFR6MmeOAkJSbToLcyX3U8OGqVCM_RJPznFl7wHwm8WUzMg1M4ltCr3QRzOEzqbq9S-yiRaL0fdU3qrc9oTISIJkq3dvw2wj9zi5CERw Oct 19 03:18:34.448055 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:18:34.448055 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:18:34.448055 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:18:34.448055 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:18:34.448055 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:18:34.448055 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:18:34.448055 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: c9a76121a22144499a44f44bb78848bf Oct 19 03:18:34.448055 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-MigrationsAdminTest-460511763 Oct 19 03:18:34.448055 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:18:34.448055 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:18:34.449941 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c9a76121a22144499a44f44bb78848bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c9a76121a22144499a44f44bb78848bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c9a76121a22144499a44f44bb78848bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c9a76121a22144499a44f44bb78848bf", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:18:34.449941 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-MigrationsAdminTest-460511763 Oct 19 03:18:34.449941 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: c9a76121a22144499a44f44bb78848bf Oct 19 03:18:34.449941 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-MigrationsAdminTest-460511763 Oct 19 03:18:34.449941 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-MigrationsAdminTest-460511763-project Oct 19 03:18:34.449941 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:18:34.449941 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:18:34.449941 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 9f8493504d9243bc95c9861f4ff76c83 Oct 19 03:18:34.449941 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-MigrationsAdminTest-460511763-project Oct 19 03:18:34.449941 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:18:34.449941 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667 could not be found. Oct 19 03:18:34.449941 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': 'ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667'} Oct 19 03:18:34.450913 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:18:34.450913 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:18:34.450913 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:18:34.450913 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:18:34.450913 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:18:34.450913 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:18:34.450913 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:18:34.450913 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:18:34.450913 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:18:34.450913 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:18:34.450913 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667 could not be found. Oct 19 03:18:34.450913 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:18:34.450913 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:18:34.450913 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:18:34.450913 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:18:34.450913 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:18:34.450913 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:18:34.450913 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:18:34.450913 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:18:34.450913 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:18:34.452566 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:18:34.452566 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:18:34.452566 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:18:34.452566 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:18:34.452566 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:18:34.452566 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:18:34.452566 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:18:34.452566 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667 could not be found. Oct 19 03:18:34.452566 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:18:34.452566 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:18:34.452566 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:18:34.452566 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:18:34.452566 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:18:34.452566 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:18:34.452566 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:18:34.452566 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:18:34.452566 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667 could not be found. Oct 19 03:18:34.452566 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:18:34.454368 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0ae7fa93-86cd-4d1d-a82e-ecce51590b38 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Returning 404 to user: Instance ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:18:34.454368 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0ae7fa93-86cd-4d1d-a82e-ecce51590b38 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667" status: 404 len: 111 microversion: 2.1 time: 0.058454 Oct 19 03:18:34.458292 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 935/1798] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:18:34 2022] GET /compute/v2.1/servers/ed376aa6-6e6a-4fdd-9fac-b8fb8f2f1667 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:18:34.467337 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f728e380-881e-4c34-89c7-c6fa7dde5798 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:34.467337 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f728e380-881e-4c34-89c7-c6fa7dde5798 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 62133546-4a75-4532-81ab-0c49c9252e85] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:18:34.478137 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f728e380-881e-4c34-89c7-c6fa7dde5798 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:34.480827 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f728e380-881e-4c34-89c7-c6fa7dde5798 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:34.482494 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f728e380-881e-4c34-89c7-c6fa7dde5798 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:34.484148 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f728e380-881e-4c34-89c7-c6fa7dde5798 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:34.486507 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f728e380-881e-4c34-89c7-c6fa7dde5798 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:34.490793 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f728e380-881e-4c34-89c7-c6fa7dde5798 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:34.553499 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-83fa5758-4c68-4135-a1b1-d825afe4a5d3 tempest-TenantUsagesTestJSON-1003043044 tempest-TenantUsagesTestJSON-1003043044-project-admin] Calling method '.version_select at 0x7fc13056fa60>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:34.582728 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-83fa5758-4c68-4135-a1b1-d825afe4a5d3 tempest-TenantUsagesTestJSON-1003043044 tempest-TenantUsagesTestJSON-1003043044-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:34.583486 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-83fa5758-4c68-4135-a1b1-d825afe4a5d3 tempest-TenantUsagesTestJSON-1003043044 tempest-TenantUsagesTestJSON-1003043044-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:34.584461 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-83fa5758-4c68-4135-a1b1-d825afe4a5d3 tempest-TenantUsagesTestJSON-1003043044 tempest-TenantUsagesTestJSON-1003043044-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:34.608428 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-83fa5758-4c68-4135-a1b1-d825afe4a5d3 tempest-TenantUsagesTestJSON-1003043044 tempest-TenantUsagesTestJSON-1003043044-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:34.610961 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-83fa5758-4c68-4135-a1b1-d825afe4a5d3 tempest-TenantUsagesTestJSON-1003043044 tempest-TenantUsagesTestJSON-1003043044-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:34.610961 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-83fa5758-4c68-4135-a1b1-d825afe4a5d3 tempest-TenantUsagesTestJSON-1003043044 tempest-TenantUsagesTestJSON-1003043044-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:34.641125 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-83fa5758-4c68-4135-a1b1-d825afe4a5d3 tempest-TenantUsagesTestJSON-1003043044 tempest-TenantUsagesTestJSON-1003043044-project-admin] 10.222.0.52 "GET /compute/v2.1/os-simple-tenant-usage/84273e394171452c947ec32bf639054d?start=2022-10-18T03%3A18%3A33.909545&end=2022-10-20T03%3A18%3A33.909545" status: 200 len: 694 microversion: 2.1 time: 0.724991 Oct 19 03:18:34.645502 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 864/1799] 10.222.0.52 () {58 vars in 1412 bytes} [Wed Oct 19 03:18:33 2022] GET /compute/v2.1/os-simple-tenant-usage/84273e394171452c947ec32bf639054d?start=2022-10-18T03%3A18%3A33.909545&end=2022-10-20T03%3A18%3A33.909545 => generated 694 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:18:34.657212 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d73bc7f5-1bfb-4ac3-bafe-6f96b0716a40 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:34.657834 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d73bc7f5-1bfb-4ac3-bafe-6f96b0716a40 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 7b4a8cd9-a238-4bff-a002-497dc807bf3a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:18:34.668581 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d73bc7f5-1bfb-4ac3-bafe-6f96b0716a40 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:34.670585 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d73bc7f5-1bfb-4ac3-bafe-6f96b0716a40 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:34.671824 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d73bc7f5-1bfb-4ac3-bafe-6f96b0716a40 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:34.674872 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d73bc7f5-1bfb-4ac3-bafe-6f96b0716a40 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:34.675423 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d73bc7f5-1bfb-4ac3-bafe-6f96b0716a40 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:34.687373 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d73bc7f5-1bfb-4ac3-bafe-6f96b0716a40 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:34.736935 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d73bc7f5-1bfb-4ac3-bafe-6f96b0716a40 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 7b4a8cd9-a238-4bff-a002-497dc807bf3a] Going to try to terminate instance {{(pid=121134) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:18:34.812454 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f728e380-881e-4c34-89c7-c6fa7dde5798 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:18:34.819329 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:18:34.845760 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f728e380-881e-4c34-89c7-c6fa7dde5798 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:18:34.853319 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f728e380-881e-4c34-89c7-c6fa7dde5798 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:18:34.857180 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f728e380-881e-4c34-89c7-c6fa7dde5798 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85" status: 200 len: 1810 microversion: 2.25 time: 0.397287 Oct 19 03:18:34.865758 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 936/1800] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:18:34 2022] GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85 => generated 1810 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:18:34.884041 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-874e4a7b-9c13-4ac6-a61e-9925a2a2245a tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Calling method '.version_select at 0x7fc130c661f0>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:34.908178 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-874e4a7b-9c13-4ac6-a61e-9925a2a2245a tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:34.911460 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-874e4a7b-9c13-4ac6-a61e-9925a2a2245a tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:34.912085 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-874e4a7b-9c13-4ac6-a61e-9925a2a2245a tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:34.949255 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-874e4a7b-9c13-4ac6-a61e-9925a2a2245a tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:34.950098 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-874e4a7b-9c13-4ac6-a61e-9925a2a2245a tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:34.958043 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-874e4a7b-9c13-4ac6-a61e-9925a2a2245a tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:35.004715 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-874e4a7b-9c13-4ac6-a61e-9925a2a2245a tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] 10.222.0.52 "GET /compute/v2.1/os-simple-tenant-usage/84273e394171452c947ec32bf639054d?start=2022-10-18T03%3A18%3A33.909545&end=2022-10-20T03%3A18%3A33.909545" status: 200 len: 694 microversion: 2.1 time: 0.137426 Oct 19 03:18:35.005323 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 937/1801] 10.222.0.52 () {58 vars in 1412 bytes} [Wed Oct 19 03:18:34 2022] GET /compute/v2.1/os-simple-tenant-usage/84273e394171452c947ec32bf639054d?start=2022-10-18T03%3A18%3A33.909545&end=2022-10-20T03%3A18%3A33.909545 => generated 694 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:18:35.027346 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7dc38aa4-1fc2-4e2d-9b91-610ffd92cdca tempest-TenantUsagesTestJSON-1003043044 tempest-TenantUsagesTestJSON-1003043044-project-admin] Calling method '.version_select at 0x7fc130cef5e0>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:35.046124 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7dc38aa4-1fc2-4e2d-9b91-610ffd92cdca tempest-TenantUsagesTestJSON-1003043044 tempest-TenantUsagesTestJSON-1003043044-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:35.046548 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7dc38aa4-1fc2-4e2d-9b91-610ffd92cdca tempest-TenantUsagesTestJSON-1003043044 tempest-TenantUsagesTestJSON-1003043044-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:35.047318 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7dc38aa4-1fc2-4e2d-9b91-610ffd92cdca tempest-TenantUsagesTestJSON-1003043044 tempest-TenantUsagesTestJSON-1003043044-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:35.085346 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7dc38aa4-1fc2-4e2d-9b91-610ffd92cdca tempest-TenantUsagesTestJSON-1003043044 tempest-TenantUsagesTestJSON-1003043044-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:35.086471 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7dc38aa4-1fc2-4e2d-9b91-610ffd92cdca tempest-TenantUsagesTestJSON-1003043044 tempest-TenantUsagesTestJSON-1003043044-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:35.086910 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7dc38aa4-1fc2-4e2d-9b91-610ffd92cdca tempest-TenantUsagesTestJSON-1003043044 tempest-TenantUsagesTestJSON-1003043044-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:35.217425 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7dc38aa4-1fc2-4e2d-9b91-610ffd92cdca tempest-TenantUsagesTestJSON-1003043044 tempest-TenantUsagesTestJSON-1003043044-project-admin] 10.222.0.52 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-18T03%3A18%3A33.909545&end=2022-10-20T03%3A18%3A33.909545&detailed=1" status: 200 len: 16333 microversion: 2.1 time: 0.194220 Oct 19 03:18:35.218641 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 938/1802] 10.222.0.52 () {58 vars in 1335 bytes} [Wed Oct 19 03:18:35 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-18T03%3A18%3A33.909545&end=2022-10-20T03%3A18%3A33.909545&detailed=1 => generated 16333 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 03:18:35.235164 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d73bc7f5-1bfb-4ac3-bafe-6f96b0716a40 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "DELETE /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a" status: 204 len: 0 microversion: 2.1 time: 0.587017 Oct 19 03:18:35.235840 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 865/1803] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:18:34 2022] DELETE /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a => generated 0 bytes in 590 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:18:35.258952 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1e1820e1-c350-4c11-a565-fb738b152d74 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:35.259600 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1e1820e1-c350-4c11-a565-fb738b152d74 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 7b4a8cd9-a238-4bff-a002-497dc807bf3a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:18:35.266496 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-14614e83-ba00-49f3-93cc-ae7b0907a2f4 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:35.282099 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-14614e83-ba00-49f3-93cc-ae7b0907a2f4 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] [instance: 1c904d5d-95bc-43ef-9826-22311512565c] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:18:35.290205 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1e1820e1-c350-4c11-a565-fb738b152d74 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:35.290704 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1e1820e1-c350-4c11-a565-fb738b152d74 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:35.291146 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1e1820e1-c350-4c11-a565-fb738b152d74 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:35.291856 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1e1820e1-c350-4c11-a565-fb738b152d74 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:35.292301 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1e1820e1-c350-4c11-a565-fb738b152d74 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:35.292731 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1e1820e1-c350-4c11-a565-fb738b152d74 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:35.296767 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-14614e83-ba00-49f3-93cc-ae7b0907a2f4 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:35.297617 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-14614e83-ba00-49f3-93cc-ae7b0907a2f4 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:35.313307 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-14614e83-ba00-49f3-93cc-ae7b0907a2f4 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:35.316404 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-14614e83-ba00-49f3-93cc-ae7b0907a2f4 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:35.317875 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-14614e83-ba00-49f3-93cc-ae7b0907a2f4 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:35.321949 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-14614e83-ba00-49f3-93cc-ae7b0907a2f4 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:35.336531 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:18:35.409220 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-14614e83-ba00-49f3-93cc-ae7b0907a2f4 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] [instance: 1c904d5d-95bc-43ef-9826-22311512565c] Going to try to terminate instance {{(pid=121134) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:18:35.691625 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-1e1820e1-c350-4c11-a565-fb738b152d74 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:18:35.731107 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1e1820e1-c350-4c11-a565-fb738b152d74 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a" status: 200 len: 1469 microversion: 2.1 time: 0.478028 Oct 19 03:18:35.753344 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 939/1804] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:18:35 2022] GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a => generated 1469 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:18:35.845188 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-14614e83-ba00-49f3-93cc-ae7b0907a2f4 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1c904d5d-95bc-43ef-9826-22311512565c" status: 204 len: 0 microversion: 2.1 time: 0.590119 Oct 19 03:18:35.855020 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 866/1805] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:18:35 2022] DELETE /compute/v2.1/servers/1c904d5d-95bc-43ef-9826-22311512565c => generated 0 bytes in 592 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:18:35.855296 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-bcba3bd3-9477-4304-af53-94f4712621a4 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:35.855296 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-bcba3bd3-9477-4304-af53-94f4712621a4 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] [instance: 1c904d5d-95bc-43ef-9826-22311512565c] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:18:35.862945 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bcba3bd3-9477-4304-af53-94f4712621a4 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:35.863720 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bcba3bd3-9477-4304-af53-94f4712621a4 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:35.864495 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bcba3bd3-9477-4304-af53-94f4712621a4 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:35.865538 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bcba3bd3-9477-4304-af53-94f4712621a4 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:35.866542 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bcba3bd3-9477-4304-af53-94f4712621a4 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:35.867696 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bcba3bd3-9477-4304-af53-94f4712621a4 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:35.909752 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-17ecc993-203e-4c79-86fa-a718f9213848 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:35.910511 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-17ecc993-203e-4c79-86fa-a718f9213848 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 62133546-4a75-4532-81ab-0c49c9252e85] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:18:35.921766 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-17ecc993-203e-4c79-86fa-a718f9213848 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:35.922269 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-17ecc993-203e-4c79-86fa-a718f9213848 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:35.923953 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-17ecc993-203e-4c79-86fa-a718f9213848 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:35.924845 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-17ecc993-203e-4c79-86fa-a718f9213848 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:35.925308 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-17ecc993-203e-4c79-86fa-a718f9213848 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:35.930036 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-17ecc993-203e-4c79-86fa-a718f9213848 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:36.314351 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-bcba3bd3-9477-4304-af53-94f4712621a4 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffa4ce5ed5743a09717ab06218e73bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84273e394171452c947ec32bf639054d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:18:36.326898 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-17ecc993-203e-4c79-86fa-a718f9213848 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:18:36.328885 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-bcba3bd3-9477-4304-af53-94f4712621a4 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] 10.222.0.52 "GET /compute/v2.1/servers/1c904d5d-95bc-43ef-9826-22311512565c" status: 200 len: 1469 microversion: 2.1 time: 0.478386 Oct 19 03:18:36.329881 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 940/1806] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:18:35 2022] GET /compute/v2.1/servers/1c904d5d-95bc-43ef-9826-22311512565c => generated 1469 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:18:36.348169 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-17ecc993-203e-4c79-86fa-a718f9213848 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:18:36.349796 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-17ecc993-203e-4c79-86fa-a718f9213848 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:18:36.351686 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-17ecc993-203e-4c79-86fa-a718f9213848 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85" status: 200 len: 1810 microversion: 2.25 time: 0.447189 Oct 19 03:18:36.352520 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 867/1807] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:18:35 2022] GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85 => generated 1810 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:18:36.761702 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-045d17ed-3fb5-40eb-a839-963a3ae858db tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:36.762304 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-045d17ed-3fb5-40eb-a839-963a3ae858db tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 7b4a8cd9-a238-4bff-a002-497dc807bf3a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:18:36.777923 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-045d17ed-3fb5-40eb-a839-963a3ae858db tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:36.778425 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-045d17ed-3fb5-40eb-a839-963a3ae858db tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:36.778868 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-045d17ed-3fb5-40eb-a839-963a3ae858db tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:36.779574 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-045d17ed-3fb5-40eb-a839-963a3ae858db tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:36.780037 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-045d17ed-3fb5-40eb-a839-963a3ae858db tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:36.780463 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-045d17ed-3fb5-40eb-a839-963a3ae858db tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:37.319286 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-045d17ed-3fb5-40eb-a839-963a3ae858db tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:18:37.331073 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-045d17ed-3fb5-40eb-a839-963a3ae858db tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a" status: 200 len: 1469 microversion: 2.1 time: 0.573412 Oct 19 03:18:37.331679 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 941/1808] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:18:36 2022] GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a => generated 1469 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:18:37.353653 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8e988d47-7d22-4467-b8f9-2712dad6aec2 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:37.356092 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8e988d47-7d22-4467-b8f9-2712dad6aec2 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] [instance: 1c904d5d-95bc-43ef-9826-22311512565c] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:18:37.378064 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8e988d47-7d22-4467-b8f9-2712dad6aec2 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:37.408065 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1696ce0f-6d8d-4dc6-b574-19e4c29eef79 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:37.410277 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1696ce0f-6d8d-4dc6-b574-19e4c29eef79 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 62133546-4a75-4532-81ab-0c49c9252e85] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:18:37.418066 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8e988d47-7d22-4467-b8f9-2712dad6aec2 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.043s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:37.423328 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8e988d47-7d22-4467-b8f9-2712dad6aec2 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:37.423328 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8e988d47-7d22-4467-b8f9-2712dad6aec2 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:37.423328 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8e988d47-7d22-4467-b8f9-2712dad6aec2 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:37.423328 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8e988d47-7d22-4467-b8f9-2712dad6aec2 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:37.427887 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1696ce0f-6d8d-4dc6-b574-19e4c29eef79 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:37.430861 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1696ce0f-6d8d-4dc6-b574-19e4c29eef79 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:37.431666 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1696ce0f-6d8d-4dc6-b574-19e4c29eef79 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:37.434557 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1696ce0f-6d8d-4dc6-b574-19e4c29eef79 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:37.435354 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1696ce0f-6d8d-4dc6-b574-19e4c29eef79 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:37.442126 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1696ce0f-6d8d-4dc6-b574-19e4c29eef79 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:38.981009 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-1696ce0f-6d8d-4dc6-b574-19e4c29eef79 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:18:38.992302 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-1696ce0f-6d8d-4dc6-b574-19e4c29eef79 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:18:38.994140 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-1696ce0f-6d8d-4dc6-b574-19e4c29eef79 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:18:38.996173 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1696ce0f-6d8d-4dc6-b574-19e4c29eef79 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85" status: 200 len: 1810 microversion: 2.25 time: 1.615565 Oct 19 03:18:38.997324 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 942/1809] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:18:37 2022] GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85 => generated 1810 bytes in 1617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:18:39.003034 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1b6e7756-f0b5-45ad-8f69-4d56f1267908 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:39.003857 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1b6e7756-f0b5-45ad-8f69-4d56f1267908 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 7b4a8cd9-a238-4bff-a002-497dc807bf3a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:18:39.011023 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1b6e7756-f0b5-45ad-8f69-4d56f1267908 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:39.011745 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1b6e7756-f0b5-45ad-8f69-4d56f1267908 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:39.012492 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1b6e7756-f0b5-45ad-8f69-4d56f1267908 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:39.013567 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1b6e7756-f0b5-45ad-8f69-4d56f1267908 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:39.014229 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1b6e7756-f0b5-45ad-8f69-4d56f1267908 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:39.015099 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1b6e7756-f0b5-45ad-8f69-4d56f1267908 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:39.312593 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8e988d47-7d22-4467-b8f9-2712dad6aec2 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffa4ce5ed5743a09717ab06218e73bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84273e394171452c947ec32bf639054d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:18:39.329977 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8e988d47-7d22-4467-b8f9-2712dad6aec2 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] 10.222.0.52 "GET /compute/v2.1/servers/1c904d5d-95bc-43ef-9826-22311512565c" status: 200 len: 1469 microversion: 2.1 time: 1.978641 Oct 19 03:18:39.331853 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 868/1810] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:18:37 2022] GET /compute/v2.1/servers/1c904d5d-95bc-43ef-9826-22311512565c => generated 1469 bytes in 1983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:18:39.443269 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-1b6e7756-f0b5-45ad-8f69-4d56f1267908 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:18:39.452007 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1b6e7756-f0b5-45ad-8f69-4d56f1267908 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a" status: 200 len: 1427 microversion: 2.1 time: 0.453303 Oct 19 03:18:39.455428 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 943/1811] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:18:38 2022] GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a => generated 1427 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:18:39.996313 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-028b3ba7-29ac-486a-aa2e-30b762b87882 req-2a2c8d01-e836-48dc-a7cd-c6d28f858e1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b4a8cd9-a238-4bff-a002-497dc807bf3a", "name": "network-vif-deleted", "tag": "f0926ecc-fbd5-457e-bf81-de5bfd5b6a96"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:18:40.031069 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-028b3ba7-29ac-486a-aa2e-30b762b87882 req-2a2c8d01-e836-48dc-a7cd-c6d28f858e1f service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:40.034541 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d4bd56da-6847-471e-9aa8-cf1b44f745c5 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:40.037838 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d4bd56da-6847-471e-9aa8-cf1b44f745c5 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 62133546-4a75-4532-81ab-0c49c9252e85] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:18:40.038757 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-028b3ba7-29ac-486a-aa2e-30b762b87882 req-2a2c8d01-e836-48dc-a7cd-c6d28f858e1f service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:40.039409 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-028b3ba7-29ac-486a-aa2e-30b762b87882 req-2a2c8d01-e836-48dc-a7cd-c6d28f858e1f service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:40.059703 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d4bd56da-6847-471e-9aa8-cf1b44f745c5 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:40.063809 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d4bd56da-6847-471e-9aa8-cf1b44f745c5 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:40.064312 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d4bd56da-6847-471e-9aa8-cf1b44f745c5 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:40.065080 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d4bd56da-6847-471e-9aa8-cf1b44f745c5 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:40.065595 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d4bd56da-6847-471e-9aa8-cf1b44f745c5 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:40.066863 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d4bd56da-6847-471e-9aa8-cf1b44f745c5 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:40.075363 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-028b3ba7-29ac-486a-aa2e-30b762b87882 req-2a2c8d01-e836-48dc-a7cd-c6d28f858e1f service nova] Creating event network-vif-deleted:f0926ecc-fbd5-457e-bf81-de5bfd5b6a96 for instance 7b4a8cd9-a238-4bff-a002-497dc807bf3a on n-h2-861333-8 Oct 19 03:18:40.092344 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-028b3ba7-29ac-486a-aa2e-30b762b87882 req-2a2c8d01-e836-48dc-a7cd-c6d28f858e1f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103449 Oct 19 03:18:40.093739 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 869/1812] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:18:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:18:40.360858 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e6631f77-c493-4d1b-9faf-771fc73cfee3 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:40.362581 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e6631f77-c493-4d1b-9faf-771fc73cfee3 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] [instance: 1c904d5d-95bc-43ef-9826-22311512565c] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:18:40.380645 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e6631f77-c493-4d1b-9faf-771fc73cfee3 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:40.384573 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e6631f77-c493-4d1b-9faf-771fc73cfee3 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:40.384855 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e6631f77-c493-4d1b-9faf-771fc73cfee3 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:40.385940 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e6631f77-c493-4d1b-9faf-771fc73cfee3 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:40.388359 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e6631f77-c493-4d1b-9faf-771fc73cfee3 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:40.390031 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e6631f77-c493-4d1b-9faf-771fc73cfee3 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:41.095425 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e6631f77-c493-4d1b-9faf-771fc73cfee3 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffa4ce5ed5743a09717ab06218e73bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84273e394171452c947ec32bf639054d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:18:41.108730 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e6631f77-c493-4d1b-9faf-771fc73cfee3 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] 10.222.0.52 "GET /compute/v2.1/servers/1c904d5d-95bc-43ef-9826-22311512565c" status: 200 len: 1427 microversion: 2.1 time: 0.752300 Oct 19 03:18:41.112417 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 870/1813] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:18:40 2022] GET /compute/v2.1/servers/1c904d5d-95bc-43ef-9826-22311512565c => generated 1427 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:18:41.122097 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3d6a9ff1-21fc-45ee-8bac-b2ba138d0d70 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:41.122749 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3d6a9ff1-21fc-45ee-8bac-b2ba138d0d70 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 7b4a8cd9-a238-4bff-a002-497dc807bf3a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:18:41.152307 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3d6a9ff1-21fc-45ee-8bac-b2ba138d0d70 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:41.152810 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3d6a9ff1-21fc-45ee-8bac-b2ba138d0d70 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:41.153256 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3d6a9ff1-21fc-45ee-8bac-b2ba138d0d70 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:41.163234 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3d6a9ff1-21fc-45ee-8bac-b2ba138d0d70 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:41.164505 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3d6a9ff1-21fc-45ee-8bac-b2ba138d0d70 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:41.165238 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3d6a9ff1-21fc-45ee-8bac-b2ba138d0d70 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:41.237990 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3d6a9ff1-21fc-45ee-8bac-b2ba138d0d70 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:41.238719 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3d6a9ff1-21fc-45ee-8bac-b2ba138d0d70 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:41.239335 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3d6a9ff1-21fc-45ee-8bac-b2ba138d0d70 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:41.239962 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-3d6a9ff1-21fc-45ee-8bac-b2ba138d0d70 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lazy-loading 'fault' on Instance uuid 7b4a8cd9-a238-4bff-a002-497dc807bf3a {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:18:41.657192 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-3d6a9ff1-21fc-45ee-8bac-b2ba138d0d70 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8493504d9243bc95c9861f4ff76c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a76121a22144499a44f44bb78848bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:18:41.686701 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3d6a9ff1-21fc-45ee-8bac-b2ba138d0d70 tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a" status: 200 len: 1303 microversion: 2.1 time: 0.556658 Oct 19 03:18:41.686701 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 871/1814] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:18:41 2022] GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a => generated 1303 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:18:41.767950 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-598dd161-e784-4fd5-9de8-8bc3b4b5c6b6 req-b3f00be6-d5f2-4acd-8b55-8ddf0cb69ee6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c904d5d-95bc-43ef-9826-22311512565c", "name": "network-vif-deleted", "tag": "02461c32-e37f-4632-8ecf-7b5e90a14b36"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:18:41.791110 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-598dd161-e784-4fd5-9de8-8bc3b4b5c6b6 req-b3f00be6-d5f2-4acd-8b55-8ddf0cb69ee6 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:41.791598 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-598dd161-e784-4fd5-9de8-8bc3b4b5c6b6 req-b3f00be6-d5f2-4acd-8b55-8ddf0cb69ee6 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:41.796637 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-598dd161-e784-4fd5-9de8-8bc3b4b5c6b6 req-b3f00be6-d5f2-4acd-8b55-8ddf0cb69ee6 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:41.849727 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-598dd161-e784-4fd5-9de8-8bc3b4b5c6b6 req-b3f00be6-d5f2-4acd-8b55-8ddf0cb69ee6 service nova] Creating event network-vif-deleted:02461c32-e37f-4632-8ecf-7b5e90a14b36 for instance 1c904d5d-95bc-43ef-9826-22311512565c on n-h2-861333-8 Oct 19 03:18:41.868973 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-598dd161-e784-4fd5-9de8-8bc3b4b5c6b6 req-b3f00be6-d5f2-4acd-8b55-8ddf0cb69ee6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102820 Oct 19 03:18:41.872468 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 872/1815] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:18:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:18:42.134884 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-486b7032-fb3c-4307-b3a0-cfa62fa06d2c tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:42.135851 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-486b7032-fb3c-4307-b3a0-cfa62fa06d2c tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] [instance: 1c904d5d-95bc-43ef-9826-22311512565c] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:18:42.150256 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-486b7032-fb3c-4307-b3a0-cfa62fa06d2c tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:42.151033 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-486b7032-fb3c-4307-b3a0-cfa62fa06d2c tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:42.151649 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-486b7032-fb3c-4307-b3a0-cfa62fa06d2c tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:42.152546 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-486b7032-fb3c-4307-b3a0-cfa62fa06d2c tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:42.154732 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-486b7032-fb3c-4307-b3a0-cfa62fa06d2c tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:42.155417 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-486b7032-fb3c-4307-b3a0-cfa62fa06d2c tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:42.224683 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d4bd56da-6847-471e-9aa8-cf1b44f745c5 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:18:42.251196 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d4bd56da-6847-471e-9aa8-cf1b44f745c5 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:18:42.258004 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d4bd56da-6847-471e-9aa8-cf1b44f745c5 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:18:42.258004 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d4bd56da-6847-471e-9aa8-cf1b44f745c5 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85" status: 200 len: 1810 microversion: 2.25 time: 2.232574 Oct 19 03:18:42.258004 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 944/1816] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:18:40 2022] GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85 => generated 1810 bytes in 2234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:18:42.341544 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-486b7032-fb3c-4307-b3a0-cfa62fa06d2c tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffa4ce5ed5743a09717ab06218e73bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84273e394171452c947ec32bf639054d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:18:42.348224 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-486b7032-fb3c-4307-b3a0-cfa62fa06d2c tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] 10.222.0.52 "GET /compute/v2.1/servers/1c904d5d-95bc-43ef-9826-22311512565c" status: 200 len: 1298 microversion: 2.1 time: 0.219563 Oct 19 03:18:42.360475 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 873/1817] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:18:42 2022] GET /compute/v2.1/servers/1c904d5d-95bc-43ef-9826-22311512565c => generated 1298 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:18:42.701322 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-51dd89a4-9181-4918-843f-b72ae833d66c tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:42.702235 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-51dd89a4-9181-4918-843f-b72ae833d66c tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] [instance: 7b4a8cd9-a238-4bff-a002-497dc807bf3a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:18:42.718092 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-51dd89a4-9181-4918-843f-b72ae833d66c tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:42.719107 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-51dd89a4-9181-4918-843f-b72ae833d66c tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:42.720469 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-51dd89a4-9181-4918-843f-b72ae833d66c tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:42.725191 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-51dd89a4-9181-4918-843f-b72ae833d66c tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:42.727083 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-51dd89a4-9181-4918-843f-b72ae833d66c tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:42.729677 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-51dd89a4-9181-4918-843f-b72ae833d66c tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:42.797350 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-51dd89a4-9181-4918-843f-b72ae833d66c tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] HTTP exception thrown: Instance 7b4a8cd9-a238-4bff-a002-497dc807bf3a could not be found. Oct 19 03:18:42.799081 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-51dd89a4-9181-4918-843f-b72ae833d66c tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Request method failure captured: Oct 19 03:18:42.799081 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a HTTP/1.1 Oct 19 03:18:42.799081 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:18:42.799081 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:18:42.799081 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:18:42.799081 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:18:42.799081 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:18:42.799081 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:18:42.799081 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:18:42.799081 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:18:42.799081 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2ss0iGCXMKYXn1LmX_Zah9P9JAZ0VzppWJ3XBCTgfwVfv8VpGmP6w3yrAHdAbQksEAF5M1eFR6MmeOAkJSbToLcyX3U8OGqVCM_RJPznFl7wHwm8WUzMg1M4ltCr3QRzOEzqbq9S-yiRaL0fdU3qrc9oTISIJkq3dvw2wj9zi5CERw Oct 19 03:18:42.799081 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:18:42.799081 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:18:42.799081 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:18:42.799081 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:18:42.799081 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:18:42.799081 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:18:42.799081 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: c9a76121a22144499a44f44bb78848bf Oct 19 03:18:42.799081 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-MigrationsAdminTest-460511763 Oct 19 03:18:42.799081 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:18:42.799081 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:18:42.801248 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c9a76121a22144499a44f44bb78848bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c9a76121a22144499a44f44bb78848bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c9a76121a22144499a44f44bb78848bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c9a76121a22144499a44f44bb78848bf", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:18:42.801248 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-MigrationsAdminTest-460511763 Oct 19 03:18:42.801248 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: c9a76121a22144499a44f44bb78848bf Oct 19 03:18:42.801248 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-MigrationsAdminTest-460511763 Oct 19 03:18:42.801248 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-MigrationsAdminTest-460511763-project Oct 19 03:18:42.801248 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:18:42.801248 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:18:42.801248 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 9f8493504d9243bc95c9861f4ff76c83 Oct 19 03:18:42.801248 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-MigrationsAdminTest-460511763-project Oct 19 03:18:42.801248 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:18:42.801248 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance 7b4a8cd9-a238-4bff-a002-497dc807bf3a could not be found. Oct 19 03:18:42.801248 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '7b4a8cd9-a238-4bff-a002-497dc807bf3a'} Oct 19 03:18:42.802306 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:18:42.802306 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:18:42.802306 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:18:42.802306 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:18:42.802306 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:18:42.802306 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:18:42.802306 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:18:42.802306 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:18:42.802306 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:18:42.802306 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:18:42.802306 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b4a8cd9-a238-4bff-a002-497dc807bf3a could not be found. Oct 19 03:18:42.802306 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:18:42.802306 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:18:42.802306 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:18:42.802306 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:18:42.802306 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:18:42.802306 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:18:42.802306 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:18:42.802306 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:18:42.802306 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:18:42.804047 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:18:42.804047 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:18:42.804047 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:18:42.804047 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:18:42.804047 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:18:42.804047 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:18:42.804047 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:18:42.804047 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b4a8cd9-a238-4bff-a002-497dc807bf3a could not be found. Oct 19 03:18:42.804047 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:18:42.804047 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:18:42.804047 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:18:42.804047 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:18:42.804047 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:18:42.804047 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:18:42.804047 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:18:42.804047 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:18:42.804047 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b4a8cd9-a238-4bff-a002-497dc807bf3a could not be found. Oct 19 03:18:42.804047 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:18:42.806052 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-51dd89a4-9181-4918-843f-b72ae833d66c tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] Returning 404 to user: Instance 7b4a8cd9-a238-4bff-a002-497dc807bf3a could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:18:42.806197 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-51dd89a4-9181-4918-843f-b72ae833d66c tempest-MigrationsAdminTest-460511763 tempest-MigrationsAdminTest-460511763-project] 10.222.0.52 "GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a" status: 404 len: 111 microversion: 2.1 time: 0.108599 Oct 19 03:18:42.807041 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 945/1818] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:18:42 2022] GET /compute/v2.1/servers/7b4a8cd9-a238-4bff-a002-497dc807bf3a => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:18:43.291786 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-26938491-0518-450c-a703-861152ea6ce4 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:43.291786 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-26938491-0518-450c-a703-861152ea6ce4 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 62133546-4a75-4532-81ab-0c49c9252e85] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:18:43.307401 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-26938491-0518-450c-a703-861152ea6ce4 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:43.308054 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-26938491-0518-450c-a703-861152ea6ce4 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:43.308542 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-26938491-0518-450c-a703-861152ea6ce4 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:43.310338 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-26938491-0518-450c-a703-861152ea6ce4 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:43.311448 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-26938491-0518-450c-a703-861152ea6ce4 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:43.312281 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-26938491-0518-450c-a703-861152ea6ce4 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:43.388187 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-893a3749-ca3c-4026-ac12-2b2479deaaf2 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:43.389484 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-893a3749-ca3c-4026-ac12-2b2479deaaf2 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] [instance: 1c904d5d-95bc-43ef-9826-22311512565c] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:18:43.414198 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-893a3749-ca3c-4026-ac12-2b2479deaaf2 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:43.419929 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-893a3749-ca3c-4026-ac12-2b2479deaaf2 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:43.420526 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-893a3749-ca3c-4026-ac12-2b2479deaaf2 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:43.422330 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-893a3749-ca3c-4026-ac12-2b2479deaaf2 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:43.426314 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-893a3749-ca3c-4026-ac12-2b2479deaaf2 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:43.429760 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-893a3749-ca3c-4026-ac12-2b2479deaaf2 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:43.494730 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-893a3749-ca3c-4026-ac12-2b2479deaaf2 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:43.495339 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-893a3749-ca3c-4026-ac12-2b2479deaaf2 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:43.496010 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-893a3749-ca3c-4026-ac12-2b2479deaaf2 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:43.497042 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-893a3749-ca3c-4026-ac12-2b2479deaaf2 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Lazy-loading 'fault' on Instance uuid 1c904d5d-95bc-43ef-9826-22311512565c {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:18:44.302170 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-893a3749-ca3c-4026-ac12-2b2479deaaf2 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffa4ce5ed5743a09717ab06218e73bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84273e394171452c947ec32bf639054d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:18:44.310047 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-893a3749-ca3c-4026-ac12-2b2479deaaf2 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] 10.222.0.52 "GET /compute/v2.1/servers/1c904d5d-95bc-43ef-9826-22311512565c" status: 200 len: 1303 microversion: 2.1 time: 0.926692 Oct 19 03:18:44.315726 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 946/1819] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:18:43 2022] GET /compute/v2.1/servers/1c904d5d-95bc-43ef-9826-22311512565c => generated 1303 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:18:44.572149 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-26938491-0518-450c-a703-861152ea6ce4 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:18:44.588893 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-26938491-0518-450c-a703-861152ea6ce4 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:18:44.591867 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-26938491-0518-450c-a703-861152ea6ce4 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:18:44.593411 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-26938491-0518-450c-a703-861152ea6ce4 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85" status: 200 len: 1810 microversion: 2.25 time: 1.313102 Oct 19 03:18:44.594492 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 874/1820] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:18:43 2022] GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85 => generated 1810 bytes in 1315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:18:44.635439 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-484616a4-7407-4b84-99c6-af9fe664933e tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-838761288", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "networks": [{"uuid": "6b3013ab-5e3b-4dca-bc82-37c6dc5721e3"}]}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:18:44.739177 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.network.neutron [None req-484616a4-7407-4b84-99c6-af9fe664933e tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] validate_networks() for [('6b3013ab-5e3b-4dca-bc82-37c6dc5721e3', None, None, None, None, None)] {{(pid=121135) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:18:45.084989 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=4 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:18:45.339340 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5df3461e-2394-4b88-8aea-b659d62fa402 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:45.340969 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5df3461e-2394-4b88-8aea-b659d62fa402 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] [instance: 1c904d5d-95bc-43ef-9826-22311512565c] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:18:45.359771 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:18:45.408025 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5df3461e-2394-4b88-8aea-b659d62fa402 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:45.408597 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5df3461e-2394-4b88-8aea-b659d62fa402 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.045s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:45.412135 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5df3461e-2394-4b88-8aea-b659d62fa402 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:45.413856 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5df3461e-2394-4b88-8aea-b659d62fa402 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:45.416487 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5df3461e-2394-4b88-8aea-b659d62fa402 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:45.417124 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5df3461e-2394-4b88-8aea-b659d62fa402 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:45.445222 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-5df3461e-2394-4b88-8aea-b659d62fa402 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] HTTP exception thrown: Instance 1c904d5d-95bc-43ef-9826-22311512565c could not be found. Oct 19 03:18:45.447669 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5df3461e-2394-4b88-8aea-b659d62fa402 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Request method failure captured: Oct 19 03:18:45.447669 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/1c904d5d-95bc-43ef-9826-22311512565c HTTP/1.1 Oct 19 03:18:45.447669 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:18:45.447669 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:18:45.447669 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:18:45.447669 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:18:45.447669 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:18:45.447669 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:18:45.447669 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:18:45.447669 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:18:45.447669 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT2xuAm4C26e7Qkw98YF_mDEMUKxDokggQ3WkVf8l8WYC8jKtW1Ev5QOwCE-3wW7yYp5qOSejebaqiV9cE1tupwRUpFd6UCmIKQ961jPFNGvit8mDQJoil3axqRScFzUeIK7W0Aq0IcVVIozD8wut1Kf8kCcTOg8Wd5OR1FPQS3KZwU0 Oct 19 03:18:45.447669 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:18:45.447669 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:18:45.447669 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:18:45.447669 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:18:45.447669 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:18:45.447669 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:18:45.447669 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 84273e394171452c947ec32bf639054d Oct 19 03:18:45.447669 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-TenantUsagesTestJSON-416358666 Oct 19 03:18:45.447669 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:18:45.447669 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:18:45.449399 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/84273e394171452c947ec32bf639054d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/84273e394171452c947ec32bf639054d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/84273e394171452c947ec32bf639054d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_84273e394171452c947ec32bf639054d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:18:45.449399 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-TenantUsagesTestJSON-416358666 Oct 19 03:18:45.449399 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 84273e394171452c947ec32bf639054d Oct 19 03:18:45.449399 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-TenantUsagesTestJSON-416358666 Oct 19 03:18:45.449399 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-TenantUsagesTestJSON-416358666-project Oct 19 03:18:45.449399 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:18:45.449399 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:18:45.449399 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: cffa4ce5ed5743a09717ab06218e73bc Oct 19 03:18:45.449399 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-TenantUsagesTestJSON-416358666-project Oct 19 03:18:45.449399 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:18:45.449399 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance 1c904d5d-95bc-43ef-9826-22311512565c could not be found. Oct 19 03:18:45.449399 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '1c904d5d-95bc-43ef-9826-22311512565c'} Oct 19 03:18:45.451872 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:18:45.451872 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:18:45.451872 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:18:45.451872 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:18:45.451872 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:18:45.451872 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:18:45.451872 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:18:45.451872 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:18:45.451872 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:18:45.451872 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:18:45.451872 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c904d5d-95bc-43ef-9826-22311512565c could not be found. Oct 19 03:18:45.451872 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:18:45.451872 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:18:45.451872 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:18:45.451872 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:18:45.451872 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:18:45.451872 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:18:45.451872 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:18:45.451872 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:18:45.451872 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:18:45.453508 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:18:45.453508 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:18:45.453508 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:18:45.453508 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:18:45.453508 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:18:45.453508 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:18:45.453508 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:18:45.453508 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c904d5d-95bc-43ef-9826-22311512565c could not be found. Oct 19 03:18:45.453508 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:18:45.453508 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:18:45.453508 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:18:45.453508 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:18:45.453508 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:18:45.453508 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:18:45.453508 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:18:45.453508 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:18:45.453508 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c904d5d-95bc-43ef-9826-22311512565c could not be found. Oct 19 03:18:45.453508 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:18:45.455712 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5df3461e-2394-4b88-8aea-b659d62fa402 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] Returning 404 to user: Instance 1c904d5d-95bc-43ef-9826-22311512565c could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:18:45.456797 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5df3461e-2394-4b88-8aea-b659d62fa402 tempest-TenantUsagesTestJSON-416358666 tempest-TenantUsagesTestJSON-416358666-project] 10.222.0.52 "GET /compute/v2.1/servers/1c904d5d-95bc-43ef-9826-22311512565c" status: 404 len: 111 microversion: 2.1 time: 0.124441 Oct 19 03:18:45.457919 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 875/1821] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:18:45 2022] GET /compute/v2.1/servers/1c904d5d-95bc-43ef-9826-22311512565c => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:18:46.723152 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-869b68e5-d28a-4e29-810d-a6c1e9c829ed tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:46.723849 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-869b68e5-d28a-4e29-810d-a6c1e9c829ed tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 62133546-4a75-4532-81ab-0c49c9252e85] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:18:46.748154 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-869b68e5-d28a-4e29-810d-a6c1e9c829ed tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:46.748685 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-869b68e5-d28a-4e29-810d-a6c1e9c829ed tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:46.749138 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-869b68e5-d28a-4e29-810d-a6c1e9c829ed tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:46.751111 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-869b68e5-d28a-4e29-810d-a6c1e9c829ed tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:46.761145 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-869b68e5-d28a-4e29-810d-a6c1e9c829ed tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:46.762941 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-869b68e5-d28a-4e29-810d-a6c1e9c829ed tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:47.311317 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-484616a4-7407-4b84-99c6-af9fe664933e tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Flavor limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:18:47.312307 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-484616a4-7407-4b84-99c6-af9fe664933e tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Image limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:18:47.312965 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-484616a4-7407-4b84-99c6-af9fe664933e tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Flavor pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:18:47.313565 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-484616a4-7407-4b84-99c6-af9fe664933e tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Image pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:18:47.314796 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-484616a4-7407-4b84-99c6-af9fe664933e tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:18:47.328367 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-869b68e5-d28a-4e29-810d-a6c1e9c829ed tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:18:47.337098 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-484616a4-7407-4b84-99c6-af9fe664933e tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:47.340126 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-869b68e5-d28a-4e29-810d-a6c1e9c829ed tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:18:47.340855 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-484616a4-7407-4b84-99c6-af9fe664933e tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:47.341503 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-484616a4-7407-4b84-99c6-af9fe664933e tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:47.342495 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-484616a4-7407-4b84-99c6-af9fe664933e tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:47.344450 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-484616a4-7407-4b84-99c6-af9fe664933e tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:47.345186 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-484616a4-7407-4b84-99c6-af9fe664933e tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:47.357789 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-869b68e5-d28a-4e29-810d-a6c1e9c829ed tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:18:47.359304 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-869b68e5-d28a-4e29-810d-a6c1e9c829ed tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85" status: 200 len: 1810 microversion: 2.25 time: 1.743041 Oct 19 03:18:47.360024 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 876/1822] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:18:45 2022] GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85 => generated 1810 bytes in 1744 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:18:47.421104 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-484616a4-7407-4b84-99c6-af9fe664933e tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Getting quotas for project 0e5d239ae4b24b7e978935fe9b3458cf. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:18:47.442415 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-484616a4-7407-4b84-99c6-af9fe664933e tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Getting quotas for user ac711151c0334c62958e7f2ec431d860 and project 0e5d239ae4b24b7e978935fe9b3458cf. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:18:47.499291 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-484616a4-7407-4b84-99c6-af9fe664933e tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Going to run 1 instances... {{(pid=121135) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:18:47.510997 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-484616a4-7407-4b84-99c6-af9fe664933e tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] [instance: bcf14e6a-ecdc-40c0-b76b-678a1bb14828] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121135) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:18:47.719253 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-484616a4-7407-4b84-99c6-af9fe664933e tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.401990 Oct 19 03:18:47.721814 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 947/1823] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:18:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 3405 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 03:18:47.736016 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2d3cf873-b96f-482c-a1ee-f461df7f9039 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:47.736643 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2d3cf873-b96f-482c-a1ee-f461df7f9039 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] [instance: bcf14e6a-ecdc-40c0-b76b-678a1bb14828] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:18:47.947984 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-2d3cf873-b96f-482c-a1ee-f461df7f9039 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac711151c0334c62958e7f2ec431d860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5d239ae4b24b7e978935fe9b3458cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:18:47.999972 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2d3cf873-b96f-482c-a1ee-f461df7f9039 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] 10.222.0.52 "GET /compute/v2.1/servers/bcf14e6a-ecdc-40c0-b76b-678a1bb14828" status: 200 len: 1223 microversion: 2.1 time: 0.241255 Oct 19 03:18:48.003920 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 877/1824] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:18:47 2022] GET /compute/v2.1/servers/bcf14e6a-ecdc-40c0-b76b-678a1bb14828 => generated 1223 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:18:48.392592 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-094ec038-28aa-4c65-984a-31afebbcf42d tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:48.394046 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-094ec038-28aa-4c65-984a-31afebbcf42d tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 62133546-4a75-4532-81ab-0c49c9252e85] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:18:48.414948 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-094ec038-28aa-4c65-984a-31afebbcf42d tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:48.414948 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-094ec038-28aa-4c65-984a-31afebbcf42d tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:48.414948 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-094ec038-28aa-4c65-984a-31afebbcf42d tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:48.415617 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-094ec038-28aa-4c65-984a-31afebbcf42d tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:48.416410 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-094ec038-28aa-4c65-984a-31afebbcf42d tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:48.417014 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-094ec038-28aa-4c65-984a-31afebbcf42d tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:48.730933 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-094ec038-28aa-4c65-984a-31afebbcf42d tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:18:48.744814 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-094ec038-28aa-4c65-984a-31afebbcf42d tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:18:48.757199 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-094ec038-28aa-4c65-984a-31afebbcf42d tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:18:48.758793 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-094ec038-28aa-4c65-984a-31afebbcf42d tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85" status: 200 len: 1810 microversion: 2.25 time: 0.370541 Oct 19 03:18:48.759351 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 948/1825] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:18:48 2022] GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85 => generated 1810 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:18:49.031253 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5f5975f1-f578-4a0a-95ca-e41edf1e22d0 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:49.031897 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5f5975f1-f578-4a0a-95ca-e41edf1e22d0 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] [instance: bcf14e6a-ecdc-40c0-b76b-678a1bb14828] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:18:49.243363 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5f5975f1-f578-4a0a-95ca-e41edf1e22d0 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac711151c0334c62958e7f2ec431d860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5d239ae4b24b7e978935fe9b3458cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:18:49.270873 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5f5975f1-f578-4a0a-95ca-e41edf1e22d0 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] 10.222.0.52 "GET /compute/v2.1/servers/bcf14e6a-ecdc-40c0-b76b-678a1bb14828" status: 200 len: 1223 microversion: 2.1 time: 0.244452 Oct 19 03:18:49.272189 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 878/1826] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:18:49 2022] GET /compute/v2.1/servers/bcf14e6a-ecdc-40c0-b76b-678a1bb14828 => generated 1223 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:18:49.792040 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-fc2c243f-a640-4419-ab3a-bab438628bde tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:49.792691 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-fc2c243f-a640-4419-ab3a-bab438628bde tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 62133546-4a75-4532-81ab-0c49c9252e85] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:18:49.811066 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fc2c243f-a640-4419-ab3a-bab438628bde tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:49.812722 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fc2c243f-a640-4419-ab3a-bab438628bde tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:49.824101 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fc2c243f-a640-4419-ab3a-bab438628bde tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:49.826249 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fc2c243f-a640-4419-ab3a-bab438628bde tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:49.826738 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fc2c243f-a640-4419-ab3a-bab438628bde tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:49.827179 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fc2c243f-a640-4419-ab3a-bab438628bde tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:50.295112 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-aade1d8b-833a-41d4-83b7-54d4d450d063 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:50.295844 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-aade1d8b-833a-41d4-83b7-54d4d450d063 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] [instance: bcf14e6a-ecdc-40c0-b76b-678a1bb14828] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:18:50.319010 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-aade1d8b-833a-41d4-83b7-54d4d450d063 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:50.319727 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-aade1d8b-833a-41d4-83b7-54d4d450d063 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:50.320287 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-aade1d8b-833a-41d4-83b7-54d4d450d063 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:50.321112 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-aade1d8b-833a-41d4-83b7-54d4d450d063 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:50.321705 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-aade1d8b-833a-41d4-83b7-54d4d450d063 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:50.330040 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-aade1d8b-833a-41d4-83b7-54d4d450d063 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:50.616617 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-fc2c243f-a640-4419-ab3a-bab438628bde tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:18:50.622706 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-aade1d8b-833a-41d4-83b7-54d4d450d063 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac711151c0334c62958e7f2ec431d860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5d239ae4b24b7e978935fe9b3458cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:18:50.633238 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-aade1d8b-833a-41d4-83b7-54d4d450d063 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] 10.222.0.52 "GET /compute/v2.1/servers/bcf14e6a-ecdc-40c0-b76b-678a1bb14828" status: 200 len: 1227 microversion: 2.1 time: 0.342164 Oct 19 03:18:50.639241 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 879/1827] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:18:50 2022] GET /compute/v2.1/servers/bcf14e6a-ecdc-40c0-b76b-678a1bb14828 => generated 1227 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:18:50.646435 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-fc2c243f-a640-4419-ab3a-bab438628bde tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:18:50.674404 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-fc2c243f-a640-4419-ab3a-bab438628bde tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:18:50.675657 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-fc2c243f-a640-4419-ab3a-bab438628bde tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85" status: 200 len: 1810 microversion: 2.25 time: 0.890386 Oct 19 03:18:50.680474 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 949/1828] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:18:49 2022] GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85 => generated 1810 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:18:51.667002 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-364aaa73-55a7-465d-954d-f2f9d804d029 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:51.668351 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-364aaa73-55a7-465d-954d-f2f9d804d029 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] [instance: bcf14e6a-ecdc-40c0-b76b-678a1bb14828] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:18:51.679701 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-364aaa73-55a7-465d-954d-f2f9d804d029 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:51.680301 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-364aaa73-55a7-465d-954d-f2f9d804d029 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:51.680744 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-364aaa73-55a7-465d-954d-f2f9d804d029 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:51.686070 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-364aaa73-55a7-465d-954d-f2f9d804d029 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:51.689202 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-364aaa73-55a7-465d-954d-f2f9d804d029 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:51.689923 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-364aaa73-55a7-465d-954d-f2f9d804d029 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:51.711466 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f07b8809-ea9f-4793-9683-23c7db5aa60a tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:51.712187 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f07b8809-ea9f-4793-9683-23c7db5aa60a tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 62133546-4a75-4532-81ab-0c49c9252e85] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:18:51.720545 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:18:51.761826 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f07b8809-ea9f-4793-9683-23c7db5aa60a tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:51.762562 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f07b8809-ea9f-4793-9683-23c7db5aa60a tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:51.763020 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f07b8809-ea9f-4793-9683-23c7db5aa60a tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:51.763922 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f07b8809-ea9f-4793-9683-23c7db5aa60a tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:51.764221 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f07b8809-ea9f-4793-9683-23c7db5aa60a tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:51.764652 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f07b8809-ea9f-4793-9683-23c7db5aa60a tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:51.988094 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-364aaa73-55a7-465d-954d-f2f9d804d029 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac711151c0334c62958e7f2ec431d860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5d239ae4b24b7e978935fe9b3458cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:18:52.007543 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-364aaa73-55a7-465d-954d-f2f9d804d029 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] 10.222.0.52 "GET /compute/v2.1/servers/bcf14e6a-ecdc-40c0-b76b-678a1bb14828" status: 200 len: 1275 microversion: 2.1 time: 0.344132 Oct 19 03:18:52.008140 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 880/1829] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:18:51 2022] GET /compute/v2.1/servers/bcf14e6a-ecdc-40c0-b76b-678a1bb14828 => generated 1275 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:18:52.313285 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f07b8809-ea9f-4793-9683-23c7db5aa60a tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:18:52.323880 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f07b8809-ea9f-4793-9683-23c7db5aa60a tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:18:52.334288 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f07b8809-ea9f-4793-9683-23c7db5aa60a tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:18:52.335888 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f07b8809-ea9f-4793-9683-23c7db5aa60a tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85" status: 200 len: 1810 microversion: 2.25 time: 0.628925 Oct 19 03:18:52.340235 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 950/1830] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:18:51 2022] GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85 => generated 1810 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:18:53.035120 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d767f50e-cacc-4144-bbb4-9d1672c42584 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:53.035720 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d767f50e-cacc-4144-bbb4-9d1672c42584 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] [instance: bcf14e6a-ecdc-40c0-b76b-678a1bb14828] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:18:53.044876 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d767f50e-cacc-4144-bbb4-9d1672c42584 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:53.045392 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d767f50e-cacc-4144-bbb4-9d1672c42584 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:53.051601 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d767f50e-cacc-4144-bbb4-9d1672c42584 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:53.052673 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d767f50e-cacc-4144-bbb4-9d1672c42584 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:53.053320 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d767f50e-cacc-4144-bbb4-9d1672c42584 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:53.055291 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d767f50e-cacc-4144-bbb4-9d1672c42584 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:53.385752 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-09eadccc-1a53-44c0-a871-65e70b92a980 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:53.387239 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-09eadccc-1a53-44c0-a871-65e70b92a980 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 62133546-4a75-4532-81ab-0c49c9252e85] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:18:53.424814 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-09eadccc-1a53-44c0-a871-65e70b92a980 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:53.430197 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-09eadccc-1a53-44c0-a871-65e70b92a980 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:53.431785 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-09eadccc-1a53-44c0-a871-65e70b92a980 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:53.435408 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-09eadccc-1a53-44c0-a871-65e70b92a980 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:53.436230 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-09eadccc-1a53-44c0-a871-65e70b92a980 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:53.437709 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-09eadccc-1a53-44c0-a871-65e70b92a980 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:53.855256 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d767f50e-cacc-4144-bbb4-9d1672c42584 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac711151c0334c62958e7f2ec431d860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5d239ae4b24b7e978935fe9b3458cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:18:53.861704 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d767f50e-cacc-4144-bbb4-9d1672c42584 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] 10.222.0.52 "GET /compute/v2.1/servers/bcf14e6a-ecdc-40c0-b76b-678a1bb14828" status: 200 len: 1281 microversion: 2.1 time: 0.830368 Oct 19 03:18:53.867434 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 881/1831] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:18:53 2022] GET /compute/v2.1/servers/bcf14e6a-ecdc-40c0-b76b-678a1bb14828 => generated 1281 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:18:54.144341 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-09eadccc-1a53-44c0-a871-65e70b92a980 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:18:54.166268 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-09eadccc-1a53-44c0-a871-65e70b92a980 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:18:54.184736 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-09eadccc-1a53-44c0-a871-65e70b92a980 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:18:54.186002 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-09eadccc-1a53-44c0-a871-65e70b92a980 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85" status: 200 len: 1810 microversion: 2.25 time: 0.818616 Oct 19 03:18:54.186615 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 951/1832] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:18:53 2022] GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85 => generated 1810 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:18:55.067878 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-455a8aa4-2b99-4fe4-b9bb-70ea836582f0 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Action: 'create', calling method: .version_select at 0x7fc1304634c0>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-1083803811", "policies": ["affinity"]}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:18:55.104154 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-455a8aa4-2b99-4fe4-b9bb-70ea836582f0 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Getting quotas for project facc0913093743d1a5c4c0eb673ce532. Resources: {'server_groups'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:18:55.104414 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d3627095-6515-4fde-a0b0-ac9f1b3d8fe1 tempest-ImagesMetadataNegativeTestJSON-1695273665 tempest-ImagesMetadataNegativeTestJSON-1695273665-project] Calling method '.version_select at 0x7fc130baadc0>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:55.116392 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-455a8aa4-2b99-4fe4-b9bb-70ea836582f0 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Getting quotas for user 8d696202812644f3b1bcb8825fc57420 and project facc0913093743d1a5c4c0eb673ce532. Resources: {'server_groups'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:18:55.130488 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-d3627095-6515-4fde-a0b0-ac9f1b3d8fe1 tempest-ImagesMetadataNegativeTestJSON-1695273665 tempest-ImagesMetadataNegativeTestJSON-1695273665-project] HTTP exception thrown: Image not found. Oct 19 03:18:55.133756 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d3627095-6515-4fde-a0b0-ac9f1b3d8fe1 tempest-ImagesMetadataNegativeTestJSON-1695273665 tempest-ImagesMetadataNegativeTestJSON-1695273665-project] Request method failure captured: Oct 19 03:18:55.133756 n-d-861333-8 devstack@n-api.service[121135]: request: DELETE /compute/v2.1/images/4e682e1d-1386-4b8d-adbe-f64b9d8b4ae3/metadata/os_distro HTTP/1.1 Oct 19 03:18:55.133756 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:18:55.133756 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:18:55.133756 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:18:55.133756 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:18:55.133756 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:18:55.133756 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:18:55.133756 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:18:55.133756 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:18:55.133756 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2yexMNLtiFEafppWdEu_89ZuvFAJzr-hAalF-EHPv-i3ijajXMFpDSck8Y2AhqJua5WNL6945psnKyxzcVx9L3YM9dqM8GA01YkkaC3pUY-NIERQN0Cx9B24bWvqGtvZBfX0Y8afLF6DJAMq_eRn2a98UDi7QHlirUkB1bvzZZ0EcM Oct 19 03:18:55.133756 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:18:55.133756 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:18:55.133756 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:18:55.133756 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:18:55.133756 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:18:55.133756 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:18:55.133756 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: a9deb77ae5b04e50bd65d817e7cdbd38 Oct 19 03:18:55.133756 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1695273665 Oct 19 03:18:55.133756 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:18:55.133756 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:18:55.135283 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a9deb77ae5b04e50bd65d817e7cdbd38"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a9deb77ae5b04e50bd65d817e7cdbd38"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a9deb77ae5b04e50bd65d817e7cdbd38"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a9deb77ae5b04e50bd65d817e7cdbd38", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:18:55.135283 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1695273665 Oct 19 03:18:55.135283 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: a9deb77ae5b04e50bd65d817e7cdbd38 Oct 19 03:18:55.135283 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1695273665 Oct 19 03:18:55.135283 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ImagesMetadataNegativeTestJSON-1695273665-project Oct 19 03:18:55.135283 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:18:55.135283 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:18:55.135283 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: bddc35ab82774b8ebecf5719a7d61785 Oct 19 03:18:55.135283 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1695273665-project Oct 19 03:18:55.135283 n-d-861333-8 devstack@n-api.service[121135]: method: Oct 19 03:18:55.135283 n-d-861333-8 devstack@n-api.service[121135]: exception: Image not found. Oct 19 03:18:55.135283 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'image_id': '4e682e1d-1386-4b8d-adbe-f64b9d8b4ae3', 'id': 'os_distro'} Oct 19 03:18:55.135283 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:18:55.136247 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:18:55.136247 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 19 03:18:55.136247 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 19 03:18:55.136247 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 19 03:18:55.136247 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 19 03:18:55.136247 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 19 03:18:55.136247 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 19 03:18:55.136247 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 19 03:18:55.136247 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 19 03:18:55.136247 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 19 03:18:55.136247 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 19 03:18:55.136247 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 19 03:18:55.136247 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 19 03:18:55.136247 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 19 03:18:55.136247 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 19 03:18:55.136247 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 19 03:18:55.136247 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 19 03:18:55.136247 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 4e682e1d-1386-4b8d-adbe-f64b9d8b4ae3 Oct 19 03:18:55.138771 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:18:55.138771 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:18:55.138771 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:18:55.138771 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:18:55.138771 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 19 03:18:55.138771 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 19 03:18:55.138771 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 19 03:18:55.138771 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 19 03:18:55.138771 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 19 03:18:55.138771 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 19 03:18:55.138771 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 19 03:18:55.138771 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 19 03:18:55.138771 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 19 03:18:55.138771 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 19 03:18:55.138771 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 19 03:18:55.138771 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 19 03:18:55.138771 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 19 03:18:55.138771 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 19 03:18:55.138771 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 19 03:18:55.138771 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 19 03:18:55.142250 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 19 03:18:55.142250 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 19 03:18:55.142250 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 19 03:18:55.142250 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 19 03:18:55.142250 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 19 03:18:55.142250 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 19 03:18:55.142250 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 19 03:18:55.142250 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 19 03:18:55.142250 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 4e682e1d-1386-4b8d-adbe-f64b9d8b4ae3 could not be found. Oct 19 03:18:55.142250 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:18:55.142250 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:18:55.142250 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:18:55.142250 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:18:55.142250 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:18:55.142250 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:18:55.142250 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:18:55.142250 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:18:55.142250 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 03:18:55.142250 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 03:18:55.145019 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:18:55.145019 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:18:55.145019 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Oct 19 03:18:55.145019 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 19 03:18:55.145019 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 19 03:18:55.145019 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 19 03:18:55.145019 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 19 03:18:55.145019 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:18:55.145019 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:18:55.145019 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:18:55.145019 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:18:55.145019 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:18:55.145019 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:18:55.145019 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:18:55.145019 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:18:55.145019 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 19 03:18:55.145019 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:18:55.145019 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d3627095-6515-4fde-a0b0-ac9f1b3d8fe1 tempest-ImagesMetadataNegativeTestJSON-1695273665 tempest-ImagesMetadataNegativeTestJSON-1695273665-project] Returning 404 to user: Image not found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:18:55.151048 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d3627095-6515-4fde-a0b0-ac9f1b3d8fe1 tempest-ImagesMetadataNegativeTestJSON-1695273665 tempest-ImagesMetadataNegativeTestJSON-1695273665-project] 10.222.0.52 "DELETE /compute/v2.1/images/4e682e1d-1386-4b8d-adbe-f64b9d8b4ae3/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.509560 Oct 19 03:18:55.151048 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 952/1833] 10.222.0.52 () {58 vars in 1293 bytes} [Wed Oct 19 03:18:54 2022] DELETE /compute/v2.1/images/4e682e1d-1386-4b8d-adbe-f64b9d8b4ae3/metadata/os_distro => generated 62 bytes in 522 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 03:18:55.157884 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-43458672-5d66-4b04-a963-ecad123fcc55 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:55.159396 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-43458672-5d66-4b04-a963-ecad123fcc55 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] [instance: bcf14e6a-ecdc-40c0-b76b-678a1bb14828] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:18:55.210743 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-43458672-5d66-4b04-a963-ecad123fcc55 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:55.211251 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-43458672-5d66-4b04-a963-ecad123fcc55 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:55.211715 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-43458672-5d66-4b04-a963-ecad123fcc55 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:55.228926 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-43458672-5d66-4b04-a963-ecad123fcc55 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:55.229480 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-43458672-5d66-4b04-a963-ecad123fcc55 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:55.229934 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-43458672-5d66-4b04-a963-ecad123fcc55 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:55.396439 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-455a8aa4-2b99-4fe4-b9bb-70ea836582f0 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Getting quotas for project facc0913093743d1a5c4c0eb673ce532. Resources: {'server_groups'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:18:55.404160 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-455a8aa4-2b99-4fe4-b9bb-70ea836582f0 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Getting quotas for user 8d696202812644f3b1bcb8825fc57420 and project facc0913093743d1a5c4c0eb673ce532. Resources: {'server_groups'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:18:55.439682 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-455a8aa4-2b99-4fe4-b9bb-70ea836582f0 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] 10.222.0.52 "POST /compute/v2.1/os-server-groups" status: 200 len: 184 microversion: 2.1 time: 1.035086 Oct 19 03:18:55.449795 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 882/1834] 10.222.0.52 () {60 vars in 1174 bytes} [Wed Oct 19 03:18:54 2022] POST /compute/v2.1/os-server-groups => generated 184 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:18:55.452751 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3330ab43-fa75-457d-99f9-5b55d2c53ade tempest-ImagesMetadataNegativeTestJSON-1695273665 tempest-ImagesMetadataNegativeTestJSON-1695273665-project] Calling method '.version_select at 0x7fc130503790>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:55.492210 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-3330ab43-fa75-457d-99f9-5b55d2c53ade tempest-ImagesMetadataNegativeTestJSON-1695273665 tempest-ImagesMetadataNegativeTestJSON-1695273665-project] HTTP exception thrown: Image not found. Oct 19 03:18:55.494479 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3330ab43-fa75-457d-99f9-5b55d2c53ade tempest-ImagesMetadataNegativeTestJSON-1695273665 tempest-ImagesMetadataNegativeTestJSON-1695273665-project] Request method failure captured: Oct 19 03:18:55.494479 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/images/afe78d72-e7d4-4d41-8093-26c17c82337c/metadata/os_version HTTP/1.1 Oct 19 03:18:55.494479 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:18:55.494479 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:18:55.494479 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:18:55.494479 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:18:55.494479 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:18:55.494479 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:18:55.494479 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:18:55.494479 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:18:55.494479 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT2yexMNLtiFEafppWdEu_89ZuvFAJzr-hAalF-EHPv-i3ijajXMFpDSck8Y2AhqJua5WNL6945psnKyxzcVx9L3YM9dqM8GA01YkkaC3pUY-NIERQN0Cx9B24bWvqGtvZBfX0Y8afLF6DJAMq_eRn2a98UDi7QHlirUkB1bvzZZ0EcM Oct 19 03:18:55.494479 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:18:55.494479 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:18:55.494479 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:18:55.494479 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:18:55.494479 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:18:55.494479 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:18:55.494479 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: a9deb77ae5b04e50bd65d817e7cdbd38 Oct 19 03:18:55.494479 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1695273665 Oct 19 03:18:55.494479 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:18:55.494479 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:18:55.496222 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a9deb77ae5b04e50bd65d817e7cdbd38"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a9deb77ae5b04e50bd65d817e7cdbd38"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a9deb77ae5b04e50bd65d817e7cdbd38"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a9deb77ae5b04e50bd65d817e7cdbd38", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:18:55.496222 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1695273665 Oct 19 03:18:55.496222 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: a9deb77ae5b04e50bd65d817e7cdbd38 Oct 19 03:18:55.496222 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1695273665 Oct 19 03:18:55.496222 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ImagesMetadataNegativeTestJSON-1695273665-project Oct 19 03:18:55.496222 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:18:55.496222 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:18:55.496222 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: bddc35ab82774b8ebecf5719a7d61785 Oct 19 03:18:55.496222 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1695273665-project Oct 19 03:18:55.496222 n-d-861333-8 devstack@n-api.service[121134]: method: Oct 19 03:18:55.496222 n-d-861333-8 devstack@n-api.service[121134]: exception: Image not found. Oct 19 03:18:55.496222 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'image_id': 'afe78d72-e7d4-4d41-8093-26c17c82337c', 'id': 'os_version'} Oct 19 03:18:55.496222 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:18:55.497270 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:18:55.497270 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 19 03:18:55.497270 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 19 03:18:55.497270 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 19 03:18:55.497270 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 19 03:18:55.497270 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 19 03:18:55.497270 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 19 03:18:55.497270 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 19 03:18:55.497270 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 19 03:18:55.497270 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 19 03:18:55.497270 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 19 03:18:55.497270 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 19 03:18:55.497270 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 19 03:18:55.497270 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 19 03:18:55.497270 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 19 03:18:55.497270 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 19 03:18:55.497270 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 19 03:18:55.497270 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID afe78d72-e7d4-4d41-8093-26c17c82337c Oct 19 03:18:55.498755 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:18:55.498755 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:18:55.498755 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:18:55.498755 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:18:55.498755 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 19 03:18:55.498755 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 19 03:18:55.498755 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 19 03:18:55.498755 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 19 03:18:55.498755 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 19 03:18:55.498755 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 19 03:18:55.498755 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 19 03:18:55.498755 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 19 03:18:55.498755 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 19 03:18:55.498755 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 19 03:18:55.498755 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 19 03:18:55.498755 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 19 03:18:55.498755 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 19 03:18:55.498755 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 19 03:18:55.498755 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 19 03:18:55.498755 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 19 03:18:55.500445 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 19 03:18:55.500445 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 19 03:18:55.500445 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 19 03:18:55.500445 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 19 03:18:55.500445 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 19 03:18:55.500445 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 19 03:18:55.500445 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 19 03:18:55.500445 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 19 03:18:55.500445 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image afe78d72-e7d4-4d41-8093-26c17c82337c could not be found. Oct 19 03:18:55.500445 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:18:55.500445 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:18:55.500445 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:18:55.500445 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:18:55.500445 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:18:55.500445 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:18:55.500445 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:18:55.500445 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:18:55.500445 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 03:18:55.500445 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 03:18:55.502048 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:18:55.502048 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:18:55.502048 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Oct 19 03:18:55.502048 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 19 03:18:55.502048 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 19 03:18:55.502048 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 19 03:18:55.502048 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 19 03:18:55.502048 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:18:55.502048 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:18:55.502048 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:18:55.502048 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:18:55.502048 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:18:55.502048 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:18:55.502048 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:18:55.502048 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:18:55.502048 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 19 03:18:55.502048 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:18:55.506463 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3330ab43-fa75-457d-99f9-5b55d2c53ade tempest-ImagesMetadataNegativeTestJSON-1695273665 tempest-ImagesMetadataNegativeTestJSON-1695273665-project] Returning 404 to user: Image not found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:18:55.506463 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3330ab43-fa75-457d-99f9-5b55d2c53ade tempest-ImagesMetadataNegativeTestJSON-1695273665 tempest-ImagesMetadataNegativeTestJSON-1695273665-project] 10.222.0.52 "GET /compute/v2.1/images/afe78d72-e7d4-4d41-8093-26c17c82337c/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.056176 Oct 19 03:18:55.507803 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 883/1835] 10.222.0.52 () {58 vars in 1293 bytes} [Wed Oct 19 03:18:55 2022] GET /compute/v2.1/images/afe78d72-e7d4-4d41-8093-26c17c82337c/metadata/os_version => generated 62 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 03:18:55.518071 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b870e719-566c-45e0-8966-1d375976f6a7 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:55.518071 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b870e719-566c-45e0-8966-1d375976f6a7 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 62133546-4a75-4532-81ab-0c49c9252e85] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:18:55.523119 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b870e719-566c-45e0-8966-1d375976f6a7 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:55.523968 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b870e719-566c-45e0-8966-1d375976f6a7 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:55.524650 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b870e719-566c-45e0-8966-1d375976f6a7 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:55.525725 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b870e719-566c-45e0-8966-1d375976f6a7 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:55.526407 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b870e719-566c-45e0-8966-1d375976f6a7 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:55.527109 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b870e719-566c-45e0-8966-1d375976f6a7 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:56.132867 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-43458672-5d66-4b04-a963-ecad123fcc55 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac711151c0334c62958e7f2ec431d860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5d239ae4b24b7e978935fe9b3458cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:18:56.145361 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-43458672-5d66-4b04-a963-ecad123fcc55 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] 10.222.0.52 "GET /compute/v2.1/servers/bcf14e6a-ecdc-40c0-b76b-678a1bb14828" status: 200 len: 1323 microversion: 2.1 time: 0.996324 Oct 19 03:18:56.146559 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 953/1836] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:18:55 2022] GET /compute/v2.1/servers/bcf14e6a-ecdc-40c0-b76b-678a1bb14828 => generated 1323 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:18:56.312041 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-87209e7b-3237-424e-aa08-f9600f074d43 tempest-SecurityGroupsTestAdminJSON-831517812 tempest-SecurityGroupsTestAdminJSON-831517812-project] Action: 'create', calling method: .version_select at 0x7fc130baa9d0>, body: {"security_group": {"name": "tempest-securitygroup-1743184699", "description": "tempest-description-1395024762"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:18:56.342461 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b870e719-566c-45e0-8966-1d375976f6a7 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:18:56.356140 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b870e719-566c-45e0-8966-1d375976f6a7 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:18:56.358277 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b870e719-566c-45e0-8966-1d375976f6a7 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:18:56.362179 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b870e719-566c-45e0-8966-1d375976f6a7 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85" status: 200 len: 1810 microversion: 2.25 time: 0.851954 Oct 19 03:18:56.364005 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 884/1837] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:18:55 2022] GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85 => generated 1810 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:18:56.380129 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-71e18c27-20e9-4cfb-93ff-0bb105620f03 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Action: 'create', calling method: .version_select at 0x7fc130505160>, body: {"server_group": {"name": "tempest-server-group-1949484399", "policies": ["affinity"]}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:18:56.403656 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-71e18c27-20e9-4cfb-93ff-0bb105620f03 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Getting quotas for project facc0913093743d1a5c4c0eb673ce532. Resources: {'server_groups'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:18:56.410223 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:INSERT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:18:56.413640 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-71e18c27-20e9-4cfb-93ff-0bb105620f03 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Getting quotas for user 8d696202812644f3b1bcb8825fc57420 and project facc0913093743d1a5c4c0eb673ce532. Resources: {'server_groups'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:18:56.581631 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-71e18c27-20e9-4cfb-93ff-0bb105620f03 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Getting quotas for project facc0913093743d1a5c4c0eb673ce532. Resources: {'server_groups'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:18:56.600826 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-71e18c27-20e9-4cfb-93ff-0bb105620f03 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Getting quotas for user 8d696202812644f3b1bcb8825fc57420 and project facc0913093743d1a5c4c0eb673ce532. Resources: {'server_groups'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:18:56.624499 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-71e18c27-20e9-4cfb-93ff-0bb105620f03 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] 10.222.0.52 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.258940 Oct 19 03:18:56.625266 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 885/1838] 10.222.0.52 () {60 vars in 1173 bytes} [Wed Oct 19 03:18:56 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:18:56.638533 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1163ac39-318f-4256-8b70-382b84ddecd2 tempest-ImagesMetadataNegativeTestJSON-1695273665 tempest-ImagesMetadataNegativeTestJSON-1695273665-project] Calling method '.version_select at 0x7fc1304b8e50>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:56.682738 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-1163ac39-318f-4256-8b70-382b84ddecd2 tempest-ImagesMetadataNegativeTestJSON-1695273665 tempest-ImagesMetadataNegativeTestJSON-1695273665-project] HTTP exception thrown: Image not found. Oct 19 03:18:56.685472 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1163ac39-318f-4256-8b70-382b84ddecd2 tempest-ImagesMetadataNegativeTestJSON-1695273665 tempest-ImagesMetadataNegativeTestJSON-1695273665-project] Request method failure captured: Oct 19 03:18:56.685472 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/images/860a4e50-6954-4b23-8b83-daed4f669aff/metadata HTTP/1.1 Oct 19 03:18:56.685472 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:18:56.685472 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:18:56.685472 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:18:56.685472 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:18:56.685472 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:18:56.685472 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:18:56.685472 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:18:56.685472 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:18:56.685472 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT2yexMNLtiFEafppWdEu_89ZuvFAJzr-hAalF-EHPv-i3ijajXMFpDSck8Y2AhqJua5WNL6945psnKyxzcVx9L3YM9dqM8GA01YkkaC3pUY-NIERQN0Cx9B24bWvqGtvZBfX0Y8afLF6DJAMq_eRn2a98UDi7QHlirUkB1bvzZZ0EcM Oct 19 03:18:56.685472 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:18:56.685472 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:18:56.685472 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:18:56.685472 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:18:56.685472 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:18:56.685472 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:18:56.685472 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: a9deb77ae5b04e50bd65d817e7cdbd38 Oct 19 03:18:56.685472 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1695273665 Oct 19 03:18:56.685472 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:18:56.685472 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:18:56.687604 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a9deb77ae5b04e50bd65d817e7cdbd38"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a9deb77ae5b04e50bd65d817e7cdbd38"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a9deb77ae5b04e50bd65d817e7cdbd38"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a9deb77ae5b04e50bd65d817e7cdbd38", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:18:56.687604 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1695273665 Oct 19 03:18:56.687604 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: a9deb77ae5b04e50bd65d817e7cdbd38 Oct 19 03:18:56.687604 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1695273665 Oct 19 03:18:56.687604 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ImagesMetadataNegativeTestJSON-1695273665-project Oct 19 03:18:56.687604 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:18:56.687604 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:18:56.687604 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: bddc35ab82774b8ebecf5719a7d61785 Oct 19 03:18:56.687604 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1695273665-project Oct 19 03:18:56.687604 n-d-861333-8 devstack@n-api.service[121134]: method: Oct 19 03:18:56.687604 n-d-861333-8 devstack@n-api.service[121134]: exception: Image not found. Oct 19 03:18:56.687604 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'image_id': '860a4e50-6954-4b23-8b83-daed4f669aff'} Oct 19 03:18:56.687604 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:18:56.688763 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:18:56.688763 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 19 03:18:56.688763 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 19 03:18:56.688763 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 19 03:18:56.688763 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 19 03:18:56.688763 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 19 03:18:56.688763 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 19 03:18:56.688763 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 19 03:18:56.688763 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 19 03:18:56.688763 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 19 03:18:56.688763 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 19 03:18:56.688763 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 19 03:18:56.688763 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 19 03:18:56.688763 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 19 03:18:56.688763 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 19 03:18:56.688763 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 19 03:18:56.688763 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 19 03:18:56.688763 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 860a4e50-6954-4b23-8b83-daed4f669aff Oct 19 03:18:56.691852 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:18:56.691852 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:18:56.691852 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:18:56.691852 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:18:56.691852 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 19 03:18:56.691852 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 19 03:18:56.691852 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 19 03:18:56.691852 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 19 03:18:56.691852 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 19 03:18:56.691852 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 19 03:18:56.691852 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 19 03:18:56.691852 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 19 03:18:56.691852 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 19 03:18:56.691852 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 19 03:18:56.691852 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 19 03:18:56.691852 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 19 03:18:56.691852 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 19 03:18:56.691852 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 19 03:18:56.691852 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 19 03:18:56.691852 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 19 03:18:56.695613 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 19 03:18:56.695613 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 19 03:18:56.695613 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 19 03:18:56.695613 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 19 03:18:56.695613 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 19 03:18:56.695613 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 19 03:18:56.695613 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 19 03:18:56.695613 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 19 03:18:56.695613 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 860a4e50-6954-4b23-8b83-daed4f669aff could not be found. Oct 19 03:18:56.695613 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:18:56.695613 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:18:56.695613 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:18:56.695613 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:18:56.695613 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:18:56.695613 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:18:56.695613 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:18:56.695613 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:18:56.695613 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 03:18:56.695613 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 03:18:56.701017 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:18:56.701017 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:18:56.701017 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Oct 19 03:18:56.701017 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 19 03:18:56.701017 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 19 03:18:56.701017 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 19 03:18:56.701017 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 19 03:18:56.701017 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:18:56.701017 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:18:56.701017 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:18:56.701017 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:18:56.701017 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:18:56.701017 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:18:56.701017 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:18:56.701017 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:18:56.701017 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 19 03:18:56.701017 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:18:56.703656 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1163ac39-318f-4256-8b70-382b84ddecd2 tempest-ImagesMetadataNegativeTestJSON-1695273665 tempest-ImagesMetadataNegativeTestJSON-1695273665-project] Returning 404 to user: Image not found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:18:56.703656 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1163ac39-318f-4256-8b70-382b84ddecd2 tempest-ImagesMetadataNegativeTestJSON-1695273665 tempest-ImagesMetadataNegativeTestJSON-1695273665-project] 10.222.0.52 "GET /compute/v2.1/images/860a4e50-6954-4b23-8b83-daed4f669aff/metadata" status: 404 len: 62 microversion: 2.1 time: 0.076223 Oct 19 03:18:56.707173 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 886/1839] 10.222.0.52 () {58 vars in 1260 bytes} [Wed Oct 19 03:18:56 2022] GET /compute/v2.1/images/860a4e50-6954-4b23-8b83-daed4f669aff/metadata => generated 62 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 03:18:56.716478 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-08f13802-74f5-44b4-b704-6c47fdeba206 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Action: 'create', calling method: .version_select at 0x7fc130505430>, body: {"server_group": {"name": "tempest-server-group-1949484399", "policies": ["affinity"]}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:18:56.766071 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-08f13802-74f5-44b4-b704-6c47fdeba206 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Getting quotas for project facc0913093743d1a5c4c0eb673ce532. Resources: {'server_groups'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:18:56.783099 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-08f13802-74f5-44b4-b704-6c47fdeba206 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Getting quotas for user 8d696202812644f3b1bcb8825fc57420 and project facc0913093743d1a5c4c0eb673ce532. Resources: {'server_groups'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:18:56.976368 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-08f13802-74f5-44b4-b704-6c47fdeba206 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Getting quotas for project facc0913093743d1a5c4c0eb673ce532. Resources: {'server_groups'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:18:56.984028 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-08f13802-74f5-44b4-b704-6c47fdeba206 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Getting quotas for user 8d696202812644f3b1bcb8825fc57420 and project facc0913093743d1a5c4c0eb673ce532. Resources: {'server_groups'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:18:57.003455 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-08f13802-74f5-44b4-b704-6c47fdeba206 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] 10.222.0.52 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.295072 Oct 19 03:18:57.009652 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 887/1840] 10.222.0.52 () {60 vars in 1173 bytes} [Wed Oct 19 03:18:56 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:18:57.010895 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ae749057-af80-465a-ad90-de97dfb2bb07 tempest-ImagesMetadataNegativeTestJSON-1695273665 tempest-ImagesMetadataNegativeTestJSON-1695273665-project] Action: 'update_all', calling method: .version_select at 0x7fc13046d550>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:18:57.037461 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-ae749057-af80-465a-ad90-de97dfb2bb07 tempest-ImagesMetadataNegativeTestJSON-1695273665 tempest-ImagesMetadataNegativeTestJSON-1695273665-project] HTTP exception thrown: Image not found. Oct 19 03:18:57.040292 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ae749057-af80-465a-ad90-de97dfb2bb07 tempest-ImagesMetadataNegativeTestJSON-1695273665 tempest-ImagesMetadataNegativeTestJSON-1695273665-project] Request method failure captured: Oct 19 03:18:57.040292 n-d-861333-8 devstack@n-api.service[121134]: request: PUT /compute/v2.1/images/5a2b2af9-03f2-48db-bf83-cb20a422b558/metadata HTTP/1.1 Oct 19 03:18:57.040292 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:18:57.040292 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:18:57.040292 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:18:57.040292 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 57 Oct 19 03:18:57.040292 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:18:57.040292 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:18:57.040292 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:18:57.040292 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:18:57.040292 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT2yexMNLtiFEafppWdEu_89ZuvFAJzr-hAalF-EHPv-i3ijajXMFpDSck8Y2AhqJua5WNL6945psnKyxzcVx9L3YM9dqM8GA01YkkaC3pUY-NIERQN0Cx9B24bWvqGtvZBfX0Y8afLF6DJAMq_eRn2a98UDi7QHlirUkB1bvzZZ0EcM Oct 19 03:18:57.040292 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:18:57.040292 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:18:57.040292 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:18:57.040292 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:18:57.040292 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:18:57.040292 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:18:57.040292 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: a9deb77ae5b04e50bd65d817e7cdbd38 Oct 19 03:18:57.040292 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1695273665 Oct 19 03:18:57.040292 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:18:57.040292 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:18:57.041872 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a9deb77ae5b04e50bd65d817e7cdbd38"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a9deb77ae5b04e50bd65d817e7cdbd38"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a9deb77ae5b04e50bd65d817e7cdbd38"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a9deb77ae5b04e50bd65d817e7cdbd38", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:18:57.041872 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1695273665 Oct 19 03:18:57.041872 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: a9deb77ae5b04e50bd65d817e7cdbd38 Oct 19 03:18:57.041872 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1695273665 Oct 19 03:18:57.041872 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ImagesMetadataNegativeTestJSON-1695273665-project Oct 19 03:18:57.041872 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:18:57.041872 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:18:57.041872 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: bddc35ab82774b8ebecf5719a7d61785 Oct 19 03:18:57.041872 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1695273665-project Oct 19 03:18:57.041872 n-d-861333-8 devstack@n-api.service[121134]: Oct 19 03:18:57.041872 n-d-861333-8 devstack@n-api.service[121134]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 19 03:18:57.041872 n-d-861333-8 devstack@n-api.service[121134]: method: Oct 19 03:18:57.041872 n-d-861333-8 devstack@n-api.service[121134]: exception: Image not found. Oct 19 03:18:57.043928 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'image_id': '5a2b2af9-03f2-48db-bf83-cb20a422b558', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 19 03:18:57.043928 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:18:57.043928 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:18:57.043928 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 19 03:18:57.043928 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 19 03:18:57.043928 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 19 03:18:57.043928 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 19 03:18:57.043928 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 19 03:18:57.043928 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 19 03:18:57.043928 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 19 03:18:57.043928 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 19 03:18:57.043928 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 19 03:18:57.043928 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 19 03:18:57.043928 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 19 03:18:57.043928 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 19 03:18:57.043928 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 19 03:18:57.043928 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 19 03:18:57.043928 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 19 03:18:57.045108 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 19 03:18:57.045108 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 5a2b2af9-03f2-48db-bf83-cb20a422b558 Oct 19 03:18:57.045108 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:18:57.045108 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:18:57.045108 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:18:57.045108 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:18:57.045108 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 19 03:18:57.045108 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 19 03:18:57.045108 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 19 03:18:57.045108 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 19 03:18:57.045108 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 19 03:18:57.045108 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 19 03:18:57.045108 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 19 03:18:57.045108 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 19 03:18:57.045108 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 19 03:18:57.045108 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 19 03:18:57.045108 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 19 03:18:57.045108 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 19 03:18:57.045108 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 19 03:18:57.045108 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 19 03:18:57.050635 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 19 03:18:57.050635 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 19 03:18:57.050635 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 19 03:18:57.050635 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 19 03:18:57.050635 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 19 03:18:57.050635 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 19 03:18:57.050635 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 19 03:18:57.050635 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 19 03:18:57.050635 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 19 03:18:57.050635 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 19 03:18:57.050635 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5a2b2af9-03f2-48db-bf83-cb20a422b558 could not be found. Oct 19 03:18:57.050635 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:18:57.050635 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:18:57.050635 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:18:57.050635 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:18:57.050635 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:18:57.050635 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:18:57.050635 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:18:57.050635 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:18:57.053619 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 03:18:57.053619 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 03:18:57.053619 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:18:57.053619 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:18:57.053619 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:18:57.053619 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:18:57.053619 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Oct 19 03:18:57.053619 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 19 03:18:57.053619 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 19 03:18:57.053619 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 19 03:18:57.053619 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 19 03:18:57.053619 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:18:57.053619 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:18:57.053619 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:18:57.053619 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:18:57.053619 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:18:57.053619 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:18:57.053619 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:18:57.053619 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:18:57.053619 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 19 03:18:57.053619 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:18:57.058818 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ae749057-af80-465a-ad90-de97dfb2bb07 tempest-ImagesMetadataNegativeTestJSON-1695273665 tempest-ImagesMetadataNegativeTestJSON-1695273665-project] Returning 404 to user: Image not found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:18:57.058818 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ae749057-af80-465a-ad90-de97dfb2bb07 tempest-ImagesMetadataNegativeTestJSON-1695273665 tempest-ImagesMetadataNegativeTestJSON-1695273665-project] 10.222.0.52 "PUT /compute/v2.1/images/5a2b2af9-03f2-48db-bf83-cb20a422b558/metadata" status: 404 len: 62 microversion: 2.1 time: 0.035881 Oct 19 03:18:57.058818 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 888/1841] 10.222.0.52 () {60 vars in 1280 bytes} [Wed Oct 19 03:18:57 2022] PUT /compute/v2.1/images/5a2b2af9-03f2-48db-bf83-cb20a422b558/metadata => generated 62 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 03:18:57.058818 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-95c5c46d-3333-4983-a99a-bef99e8ce814 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:57.281671 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-95c5c46d-3333-4983-a99a-bef99e8ce814 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] 10.222.0.52 "DELETE /compute/v2.1/os-server-groups/fd9f3cf5-88f8-4944-8141-acc17c34f226" status: 204 len: 0 microversion: 2.1 time: 0.235770 Oct 19 03:18:57.282943 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 889/1842] 10.222.0.52 () {58 vars in 1266 bytes} [Wed Oct 19 03:18:57 2022] DELETE /compute/v2.1/os-server-groups/fd9f3cf5-88f8-4944-8141-acc17c34f226 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:18:57.330734 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-309d60e5-6d97-482e-9f6d-5fcf1db30744 tempest-ImagesMetadataNegativeTestJSON-1695273665 tempest-ImagesMetadataNegativeTestJSON-1695273665-project] Action: 'update', calling method: .version_select at 0x7fc1304b8700>, body: {"meta": {"os_distro": "alt"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:18:57.360764 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-309d60e5-6d97-482e-9f6d-5fcf1db30744 tempest-ImagesMetadataNegativeTestJSON-1695273665 tempest-ImagesMetadataNegativeTestJSON-1695273665-project] HTTP exception thrown: Image not found. Oct 19 03:18:57.363789 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-309d60e5-6d97-482e-9f6d-5fcf1db30744 tempest-ImagesMetadataNegativeTestJSON-1695273665 tempest-ImagesMetadataNegativeTestJSON-1695273665-project] Request method failure captured: Oct 19 03:18:57.363789 n-d-861333-8 devstack@n-api.service[121134]: request: PUT /compute/v2.1/images/5fed3dd0-763e-49d4-9830-4aad333d0c9e/metadata/os_distro HTTP/1.1 Oct 19 03:18:57.363789 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:18:57.363789 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:18:57.363789 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:18:57.363789 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 30 Oct 19 03:18:57.363789 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:18:57.363789 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:18:57.363789 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:18:57.363789 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:18:57.363789 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT2yexMNLtiFEafppWdEu_89ZuvFAJzr-hAalF-EHPv-i3ijajXMFpDSck8Y2AhqJua5WNL6945psnKyxzcVx9L3YM9dqM8GA01YkkaC3pUY-NIERQN0Cx9B24bWvqGtvZBfX0Y8afLF6DJAMq_eRn2a98UDi7QHlirUkB1bvzZZ0EcM Oct 19 03:18:57.363789 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:18:57.363789 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:18:57.363789 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:18:57.363789 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:18:57.363789 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:18:57.363789 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:18:57.363789 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: a9deb77ae5b04e50bd65d817e7cdbd38 Oct 19 03:18:57.363789 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1695273665 Oct 19 03:18:57.363789 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:18:57.363789 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:18:57.365286 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a9deb77ae5b04e50bd65d817e7cdbd38"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a9deb77ae5b04e50bd65d817e7cdbd38"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a9deb77ae5b04e50bd65d817e7cdbd38"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a9deb77ae5b04e50bd65d817e7cdbd38", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:18:57.365286 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1695273665 Oct 19 03:18:57.365286 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: a9deb77ae5b04e50bd65d817e7cdbd38 Oct 19 03:18:57.365286 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1695273665 Oct 19 03:18:57.365286 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ImagesMetadataNegativeTestJSON-1695273665-project Oct 19 03:18:57.365286 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:18:57.365286 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:18:57.365286 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: bddc35ab82774b8ebecf5719a7d61785 Oct 19 03:18:57.365286 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1695273665-project Oct 19 03:18:57.365286 n-d-861333-8 devstack@n-api.service[121134]: Oct 19 03:18:57.365286 n-d-861333-8 devstack@n-api.service[121134]: {"meta": {"os_distro": "alt"}} Oct 19 03:18:57.365286 n-d-861333-8 devstack@n-api.service[121134]: method: Oct 19 03:18:57.365286 n-d-861333-8 devstack@n-api.service[121134]: exception: Image not found. Oct 19 03:18:57.365286 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'image_id': '5fed3dd0-763e-49d4-9830-4aad333d0c9e', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Oct 19 03:18:57.367539 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:18:57.367539 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:18:57.367539 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 19 03:18:57.367539 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 19 03:18:57.367539 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 19 03:18:57.367539 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 19 03:18:57.367539 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 19 03:18:57.367539 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 19 03:18:57.367539 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 19 03:18:57.367539 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 19 03:18:57.367539 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 19 03:18:57.367539 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 19 03:18:57.367539 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 19 03:18:57.367539 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 19 03:18:57.367539 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 19 03:18:57.367539 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 19 03:18:57.367539 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 19 03:18:57.367539 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 19 03:18:57.372156 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 5fed3dd0-763e-49d4-9830-4aad333d0c9e Oct 19 03:18:57.372156 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:18:57.372156 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:18:57.372156 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:18:57.372156 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:18:57.372156 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 19 03:18:57.372156 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 19 03:18:57.372156 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 19 03:18:57.372156 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 19 03:18:57.372156 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 19 03:18:57.372156 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 19 03:18:57.372156 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 19 03:18:57.372156 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 19 03:18:57.372156 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 19 03:18:57.372156 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 19 03:18:57.372156 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 19 03:18:57.372156 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 19 03:18:57.372156 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 19 03:18:57.372156 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 19 03:18:57.379086 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 19 03:18:57.379086 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 19 03:18:57.379086 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 19 03:18:57.379086 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 19 03:18:57.379086 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 19 03:18:57.379086 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 19 03:18:57.379086 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 19 03:18:57.379086 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 19 03:18:57.379086 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 19 03:18:57.379086 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 19 03:18:57.379086 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5fed3dd0-763e-49d4-9830-4aad333d0c9e could not be found. Oct 19 03:18:57.379086 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:18:57.379086 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:18:57.379086 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:18:57.379086 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:18:57.379086 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:18:57.379086 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:18:57.379086 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:18:57.379086 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:18:57.380536 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 03:18:57.380536 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 03:18:57.380536 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:18:57.380536 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:18:57.380536 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:18:57.380536 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:18:57.380536 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Oct 19 03:18:57.380536 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 19 03:18:57.380536 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 19 03:18:57.380536 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 19 03:18:57.380536 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 19 03:18:57.380536 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:18:57.380536 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:18:57.380536 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:18:57.380536 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:18:57.380536 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:18:57.380536 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:18:57.380536 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:18:57.380536 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:18:57.380536 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 19 03:18:57.380536 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:18:57.385713 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-309d60e5-6d97-482e-9f6d-5fcf1db30744 tempest-ImagesMetadataNegativeTestJSON-1695273665 tempest-ImagesMetadataNegativeTestJSON-1695273665-project] Returning 404 to user: Image not found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:18:57.385713 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-309d60e5-6d97-482e-9f6d-5fcf1db30744 tempest-ImagesMetadataNegativeTestJSON-1695273665 tempest-ImagesMetadataNegativeTestJSON-1695273665-project] 10.222.0.52 "PUT /compute/v2.1/images/5fed3dd0-763e-49d4-9830-4aad333d0c9e/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.045066 Oct 19 03:18:57.385713 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 890/1843] 10.222.0.52 () {60 vars in 1310 bytes} [Wed Oct 19 03:18:57 2022] PUT /compute/v2.1/images/5fed3dd0-763e-49d4-9830-4aad333d0c9e/metadata/os_distro => generated 62 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 03:18:57.385713 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2008ae4a-712b-4a25-bbb4-de1ebe594f0d tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:57.385713 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2008ae4a-712b-4a25-bbb4-de1ebe594f0d tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] [instance: bcf14e6a-ecdc-40c0-b76b-678a1bb14828] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:18:57.387568 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:18:57.397330 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2008ae4a-712b-4a25-bbb4-de1ebe594f0d tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:57.397330 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2008ae4a-712b-4a25-bbb4-de1ebe594f0d tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:57.397330 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2008ae4a-712b-4a25-bbb4-de1ebe594f0d tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:57.397330 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2008ae4a-712b-4a25-bbb4-de1ebe594f0d tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:57.398493 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2008ae4a-712b-4a25-bbb4-de1ebe594f0d tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:57.398493 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2008ae4a-712b-4a25-bbb4-de1ebe594f0d tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:57.479269 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=6 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:18:57.707111 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-87209e7b-3237-424e-aa08-f9600f074d43 tempest-SecurityGroupsTestAdminJSON-831517812 tempest-SecurityGroupsTestAdminJSON-831517812-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 1.557914 Oct 19 03:18:57.710847 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 954/1844] 10.222.0.52 () {60 vars in 1180 bytes} [Wed Oct 19 03:18:56 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 1563 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:18:57.716157 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d35973de-6890-462c-b588-8f6b02a5bfbd tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:57.752138 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d35973de-6890-462c-b588-8f6b02a5bfbd tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] 10.222.0.52 "GET /compute/v2.1/os-server-groups" status: 200 len: 335 microversion: 2.1 time: 0.040003 Oct 19 03:18:57.753165 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 955/1845] 10.222.0.52 () {58 vars in 1152 bytes} [Wed Oct 19 03:18:57 2022] GET /compute/v2.1/os-server-groups => generated 335 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:18:57.758787 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-274f474c-215a-4525-a0c3-ce59de2046b9 tempest-ImagesMetadataNegativeTestJSON-1695273665 tempest-ImagesMetadataNegativeTestJSON-1695273665-project] Action: 'create', calling method: .version_select at 0x7fc130bcd310>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:18:57.785777 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-274f474c-215a-4525-a0c3-ce59de2046b9 tempest-ImagesMetadataNegativeTestJSON-1695273665 tempest-ImagesMetadataNegativeTestJSON-1695273665-project] HTTP exception thrown: Image not found. Oct 19 03:18:57.791137 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-274f474c-215a-4525-a0c3-ce59de2046b9 tempest-ImagesMetadataNegativeTestJSON-1695273665 tempest-ImagesMetadataNegativeTestJSON-1695273665-project] Request method failure captured: Oct 19 03:18:57.791137 n-d-861333-8 devstack@n-api.service[121135]: request: POST /compute/v2.1/images/9a2c534c-ec74-47f5-8fc1-15e5b8587c09/metadata HTTP/1.1 Oct 19 03:18:57.791137 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:18:57.791137 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:18:57.791137 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:18:57.791137 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 57 Oct 19 03:18:57.791137 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:18:57.791137 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:18:57.791137 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:18:57.791137 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:18:57.791137 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2yexMNLtiFEafppWdEu_89ZuvFAJzr-hAalF-EHPv-i3ijajXMFpDSck8Y2AhqJua5WNL6945psnKyxzcVx9L3YM9dqM8GA01YkkaC3pUY-NIERQN0Cx9B24bWvqGtvZBfX0Y8afLF6DJAMq_eRn2a98UDi7QHlirUkB1bvzZZ0EcM Oct 19 03:18:57.791137 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:18:57.791137 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:18:57.791137 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:18:57.791137 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:18:57.791137 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:18:57.791137 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:18:57.791137 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: a9deb77ae5b04e50bd65d817e7cdbd38 Oct 19 03:18:57.791137 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1695273665 Oct 19 03:18:57.791137 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:18:57.791137 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:18:57.794851 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a9deb77ae5b04e50bd65d817e7cdbd38"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a9deb77ae5b04e50bd65d817e7cdbd38"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a9deb77ae5b04e50bd65d817e7cdbd38"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a9deb77ae5b04e50bd65d817e7cdbd38", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:18:57.794851 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1695273665 Oct 19 03:18:57.794851 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: a9deb77ae5b04e50bd65d817e7cdbd38 Oct 19 03:18:57.794851 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1695273665 Oct 19 03:18:57.794851 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ImagesMetadataNegativeTestJSON-1695273665-project Oct 19 03:18:57.794851 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:18:57.794851 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:18:57.794851 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: bddc35ab82774b8ebecf5719a7d61785 Oct 19 03:18:57.794851 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1695273665-project Oct 19 03:18:57.794851 n-d-861333-8 devstack@n-api.service[121135]: Oct 19 03:18:57.794851 n-d-861333-8 devstack@n-api.service[121135]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 19 03:18:57.794851 n-d-861333-8 devstack@n-api.service[121135]: method: Oct 19 03:18:57.794851 n-d-861333-8 devstack@n-api.service[121135]: exception: Image not found. Oct 19 03:18:57.794851 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'image_id': '9a2c534c-ec74-47f5-8fc1-15e5b8587c09', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 19 03:18:57.795972 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:18:57.795972 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:18:57.795972 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 19 03:18:57.795972 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 19 03:18:57.795972 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 19 03:18:57.795972 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 19 03:18:57.795972 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 19 03:18:57.795972 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 19 03:18:57.795972 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 19 03:18:57.795972 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 19 03:18:57.795972 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 19 03:18:57.795972 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 19 03:18:57.795972 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 19 03:18:57.795972 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 19 03:18:57.795972 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 19 03:18:57.795972 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 19 03:18:57.795972 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 19 03:18:57.795972 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 19 03:18:57.797729 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 9a2c534c-ec74-47f5-8fc1-15e5b8587c09 Oct 19 03:18:57.797729 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:18:57.797729 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:18:57.797729 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:18:57.797729 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:18:57.797729 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 19 03:18:57.797729 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 19 03:18:57.797729 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 19 03:18:57.797729 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 19 03:18:57.797729 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 19 03:18:57.797729 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 19 03:18:57.797729 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 19 03:18:57.797729 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 19 03:18:57.797729 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 19 03:18:57.797729 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 19 03:18:57.797729 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 19 03:18:57.797729 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 19 03:18:57.797729 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 19 03:18:57.797729 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 19 03:18:57.801286 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 19 03:18:57.801286 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 19 03:18:57.801286 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 19 03:18:57.801286 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 19 03:18:57.801286 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 19 03:18:57.801286 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 19 03:18:57.801286 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 19 03:18:57.801286 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 19 03:18:57.801286 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 19 03:18:57.801286 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 19 03:18:57.801286 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9a2c534c-ec74-47f5-8fc1-15e5b8587c09 could not be found. Oct 19 03:18:57.801286 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:18:57.801286 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:18:57.801286 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:18:57.801286 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:18:57.801286 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:18:57.801286 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:18:57.801286 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:18:57.801286 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:18:57.806257 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 03:18:57.806257 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 03:18:57.806257 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:18:57.806257 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:18:57.806257 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:18:57.806257 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:18:57.806257 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Oct 19 03:18:57.806257 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 19 03:18:57.806257 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 19 03:18:57.806257 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 19 03:18:57.806257 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 19 03:18:57.806257 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:18:57.806257 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:18:57.806257 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:18:57.806257 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:18:57.806257 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:18:57.806257 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:18:57.806257 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:18:57.806257 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:18:57.806257 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 19 03:18:57.806257 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:18:57.818436 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-274f474c-215a-4525-a0c3-ce59de2046b9 tempest-ImagesMetadataNegativeTestJSON-1695273665 tempest-ImagesMetadataNegativeTestJSON-1695273665-project] Returning 404 to user: Image not found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:18:57.819511 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-274f474c-215a-4525-a0c3-ce59de2046b9 tempest-ImagesMetadataNegativeTestJSON-1695273665 tempest-ImagesMetadataNegativeTestJSON-1695273665-project] 10.222.0.52 "POST /compute/v2.1/images/9a2c534c-ec74-47f5-8fc1-15e5b8587c09/metadata" status: 404 len: 62 microversion: 2.1 time: 0.065058 Oct 19 03:18:57.827291 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 956/1846] 10.222.0.52 () {60 vars in 1281 bytes} [Wed Oct 19 03:18:57 2022] POST /compute/v2.1/images/9a2c534c-ec74-47f5-8fc1-15e5b8587c09/metadata => generated 62 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 03:18:57.834882 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-afb44a16-d446-4dad-b03f-798e8c046dec tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:57.836197 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-afb44a16-d446-4dad-b03f-798e8c046dec tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 62133546-4a75-4532-81ab-0c49c9252e85] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:18:57.844172 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-afb44a16-d446-4dad-b03f-798e8c046dec tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:57.844688 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-afb44a16-d446-4dad-b03f-798e8c046dec tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:57.845139 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-afb44a16-d446-4dad-b03f-798e8c046dec tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:57.845903 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-afb44a16-d446-4dad-b03f-798e8c046dec tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:57.846502 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-afb44a16-d446-4dad-b03f-798e8c046dec tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:57.846792 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-afb44a16-d446-4dad-b03f-798e8c046dec tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:58.039602 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-2008ae4a-712b-4a25-bbb4-de1ebe594f0d tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac711151c0334c62958e7f2ec431d860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5d239ae4b24b7e978935fe9b3458cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:18:58.048870 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2008ae4a-712b-4a25-bbb4-de1ebe594f0d tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] 10.222.0.52 "GET /compute/v2.1/servers/bcf14e6a-ecdc-40c0-b76b-678a1bb14828" status: 200 len: 1323 microversion: 2.1 time: 0.680296 Oct 19 03:18:58.053771 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 891/1847] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:18:57 2022] GET /compute/v2.1/servers/bcf14e6a-ecdc-40c0-b76b-678a1bb14828 => generated 1323 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:18:58.065281 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9abda9f9-6a22-40ec-b2f4-d3b4062ef8de tempest-SecurityGroupsTestAdminJSON-831517812 tempest-SecurityGroupsTestAdminJSON-831517812-project] Action: 'create', calling method: .version_select at 0x7fc1304b8b80>, body: {"security_group": {"name": "tempest-securitygroup-265443705", "description": "tempest-description-836610168"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:18:58.311934 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-afb44a16-d446-4dad-b03f-798e8c046dec tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:18:58.328826 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-afb44a16-d446-4dad-b03f-798e8c046dec tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:18:58.335855 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-afb44a16-d446-4dad-b03f-798e8c046dec tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:18:58.339307 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-afb44a16-d446-4dad-b03f-798e8c046dec tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85" status: 200 len: 1810 microversion: 2.25 time: 0.509871 Oct 19 03:18:58.339900 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 957/1848] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:18:57 2022] GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85 => generated 1810 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:18:58.354274 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-df5133d9-79b6-44df-982f-aaa412c25e68 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:58.532096 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-df5133d9-79b6-44df-982f-aaa412c25e68 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] 10.222.0.52 "DELETE /compute/v2.1/os-server-groups/ae09a148-dc6f-48d6-bdba-a75ad88290de" status: 204 len: 0 microversion: 2.1 time: 0.188431 Oct 19 03:18:58.562004 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 958/1849] 10.222.0.52 () {58 vars in 1266 bytes} [Wed Oct 19 03:18:58 2022] DELETE /compute/v2.1/os-server-groups/ae09a148-dc6f-48d6-bdba-a75ad88290de => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:18:58.562004 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-55e88a0a-9736-46ac-aef0-555dbc92cd44 req-03545c0d-3149-4130-aff2-54e3e52d0b49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bcf14e6a-ecdc-40c0-b76b-678a1bb14828", "tag": "2e33b971-5f4b-4979-8038-bf99f7338ba3"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:18:58.567069 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-55e88a0a-9736-46ac-aef0-555dbc92cd44 req-03545c0d-3149-4130-aff2-54e3e52d0b49 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:58.568000 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-55e88a0a-9736-46ac-aef0-555dbc92cd44 req-03545c0d-3149-4130-aff2-54e3e52d0b49 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:58.568849 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-55e88a0a-9736-46ac-aef0-555dbc92cd44 req-03545c0d-3149-4130-aff2-54e3e52d0b49 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:58.586969 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-55e88a0a-9736-46ac-aef0-555dbc92cd44 req-03545c0d-3149-4130-aff2-54e3e52d0b49 service nova] Creating event network-changed:2e33b971-5f4b-4979-8038-bf99f7338ba3 for instance bcf14e6a-ecdc-40c0-b76b-678a1bb14828 on n-h2-861333-8 Oct 19 03:18:58.598087 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-55e88a0a-9736-46ac-aef0-555dbc92cd44 req-03545c0d-3149-4130-aff2-54e3e52d0b49 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058389 Oct 19 03:18:58.599277 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 959/1850] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:18:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:18:58.615939 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d330fa2b-bc07-46d8-9ff4-be7f19ae5794 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:58.638102 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d330fa2b-bc07-46d8-9ff4-be7f19ae5794 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] 10.222.0.52 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.027688 Oct 19 03:18:58.646465 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 960/1851] 10.222.0.52 () {58 vars in 1152 bytes} [Wed Oct 19 03:18:58 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:18:58.653202 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-bb2bb661-ca82-4844-896b-e16bca01275d tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Action: 'create', calling method: .version_select at 0x7fc130c5f160>, body: {"server_group": {"name": "tempest-server-group-1425501558", "policies": ["affinity"]}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:18:58.681166 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-bb2bb661-ca82-4844-896b-e16bca01275d tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Getting quotas for project facc0913093743d1a5c4c0eb673ce532. Resources: {'server_groups'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:18:58.687746 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-bb2bb661-ca82-4844-896b-e16bca01275d tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Getting quotas for user 8d696202812644f3b1bcb8825fc57420 and project facc0913093743d1a5c4c0eb673ce532. Resources: {'server_groups'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:18:58.920108 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-bb2bb661-ca82-4844-896b-e16bca01275d tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Getting quotas for project facc0913093743d1a5c4c0eb673ce532. Resources: {'server_groups'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:18:58.935819 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-bb2bb661-ca82-4844-896b-e16bca01275d tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Getting quotas for user 8d696202812644f3b1bcb8825fc57420 and project facc0913093743d1a5c4c0eb673ce532. Resources: {'server_groups'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:18:58.960159 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-bb2bb661-ca82-4844-896b-e16bca01275d tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] 10.222.0.52 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.311641 Oct 19 03:18:58.967644 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 961/1852] 10.222.0.52 () {60 vars in 1173 bytes} [Wed Oct 19 03:18:58 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:18:58.976246 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-657c5151-ea17-41a1-b878-6e49c6792c7c tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:59.187518 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-657c5151-ea17-41a1-b878-6e49c6792c7c tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] 10.222.0.52 "DELETE /compute/v2.1/os-server-groups/2933b5bd-6e9e-4e3b-b3fb-8e0861d5db60" status: 204 len: 0 microversion: 2.1 time: 0.214973 Oct 19 03:18:59.188678 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 962/1853] 10.222.0.52 () {58 vars in 1266 bytes} [Wed Oct 19 03:18:58 2022] DELETE /compute/v2.1/os-server-groups/2933b5bd-6e9e-4e3b-b3fb-8e0861d5db60 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:18:59.224532 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1acc9035-d730-475a-b4da-cabde941a75f tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:59.224532 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1acc9035-d730-475a-b4da-cabde941a75f tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] [instance: bcf14e6a-ecdc-40c0-b76b-678a1bb14828] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:18:59.224532 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1acc9035-d730-475a-b4da-cabde941a75f tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:59.224532 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1acc9035-d730-475a-b4da-cabde941a75f tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:59.226682 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1acc9035-d730-475a-b4da-cabde941a75f tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:59.226682 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1acc9035-d730-475a-b4da-cabde941a75f tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:59.226682 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1acc9035-d730-475a-b4da-cabde941a75f tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:59.226682 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1acc9035-d730-475a-b4da-cabde941a75f tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:59.500476 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9abda9f9-6a22-40ec-b2f4-d3b4062ef8de tempest-SecurityGroupsTestAdminJSON-831517812 tempest-SecurityGroupsTestAdminJSON-831517812-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 1.435427 Oct 19 03:18:59.500476 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 892/1854] 10.222.0.52 () {60 vars in 1180 bytes} [Wed Oct 19 03:18:58 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 1443 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:18:59.511216 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-037cfbc0-8767-47b5-a1e1-610165f11dc6 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:59.546287 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-037cfbc0-8767-47b5-a1e1-610165f11dc6 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] 10.222.0.52 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.039002 Oct 19 03:18:59.546882 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 893/1855] 10.222.0.52 () {58 vars in 1152 bytes} [Wed Oct 19 03:18:59 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:18:59.559599 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-fe853f1f-0102-42b7-99fb-dda7628f222f tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:18:59.686021 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-fe853f1f-0102-42b7-99fb-dda7628f222f tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 62133546-4a75-4532-81ab-0c49c9252e85] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:18:59.686021 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fe853f1f-0102-42b7-99fb-dda7628f222f tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:59.686021 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fe853f1f-0102-42b7-99fb-dda7628f222f tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:59.686021 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fe853f1f-0102-42b7-99fb-dda7628f222f tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:59.688302 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fe853f1f-0102-42b7-99fb-dda7628f222f tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:18:59.688302 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fe853f1f-0102-42b7-99fb-dda7628f222f tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:18:59.688302 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fe853f1f-0102-42b7-99fb-dda7628f222f tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:18:59.733129 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-1acc9035-d730-475a-b4da-cabde941a75f tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac711151c0334c62958e7f2ec431d860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5d239ae4b24b7e978935fe9b3458cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:18:59.752712 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1acc9035-d730-475a-b4da-cabde941a75f tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] 10.222.0.52 "GET /compute/v2.1/servers/bcf14e6a-ecdc-40c0-b76b-678a1bb14828" status: 200 len: 1323 microversion: 2.1 time: 0.562562 Oct 19 03:18:59.753877 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 963/1856] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:18:59 2022] GET /compute/v2.1/servers/bcf14e6a-ecdc-40c0-b76b-678a1bb14828 => generated 1323 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:18:59.906720 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-fe853f1f-0102-42b7-99fb-dda7628f222f tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:18:59.910864 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:18:59.920636 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-fe853f1f-0102-42b7-99fb-dda7628f222f tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:18:59.921104 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-fe853f1f-0102-42b7-99fb-dda7628f222f tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:18:59.924200 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-fe853f1f-0102-42b7-99fb-dda7628f222f tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85" status: 200 len: 1810 microversion: 2.25 time: 0.373671 Oct 19 03:18:59.930422 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 894/1857] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:18:59 2022] GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85 => generated 1810 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:18:59.937309 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b4f763bc-3f2f-44af-b68e-eb23419c9cbc tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Action: 'create', calling method: .version_select at 0x7fc1304b8d30>, body: {"server_group": {"name": "tempest-server-group-387692726", "policies": ["anti-affinity"]}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:18:59.976449 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-b4f763bc-3f2f-44af-b68e-eb23419c9cbc tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Getting quotas for project facc0913093743d1a5c4c0eb673ce532. Resources: {'server_groups'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:18:59.984119 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-b4f763bc-3f2f-44af-b68e-eb23419c9cbc tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Getting quotas for user 8d696202812644f3b1bcb8825fc57420 and project facc0913093743d1a5c4c0eb673ce532. Resources: {'server_groups'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:19:00.053711 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-100a9628-ec1c-4008-a135-c296037ea9db tempest-SecurityGroupsTestAdminJSON-2112335573 tempest-SecurityGroupsTestAdminJSON-2112335573-project-admin] Action: 'create', calling method: .version_select at 0x7fc130cef940>, body: {"security_group": {"name": "tempest-securitygroup-987864472", "description": "tempest-description-17635709"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:19:00.377964 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-b4f763bc-3f2f-44af-b68e-eb23419c9cbc tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Getting quotas for project facc0913093743d1a5c4c0eb673ce532. Resources: {'server_groups'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:19:00.395966 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-b4f763bc-3f2f-44af-b68e-eb23419c9cbc tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Getting quotas for user 8d696202812644f3b1bcb8825fc57420 and project facc0913093743d1a5c4c0eb673ce532. Resources: {'server_groups'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:19:00.415385 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b4f763bc-3f2f-44af-b68e-eb23419c9cbc tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] 10.222.0.52 "POST /compute/v2.1/os-server-groups" status: 200 len: 168 microversion: 2.1 time: 0.483592 Oct 19 03:19:00.421767 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 895/1858] 10.222.0.52 () {60 vars in 1173 bytes} [Wed Oct 19 03:18:59 2022] POST /compute/v2.1/os-server-groups => generated 168 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:19:00.430498 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d036b191-69ec-48a9-a7aa-9503154a6e99 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:00.581931 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d036b191-69ec-48a9-a7aa-9503154a6e99 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] 10.222.0.52 "DELETE /compute/v2.1/os-server-groups/93d5cdfb-fbf5-4a43-9700-627ad8780c6f" status: 204 len: 0 microversion: 2.1 time: 0.158645 Oct 19 03:19:00.583798 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 896/1859] 10.222.0.52 () {58 vars in 1266 bytes} [Wed Oct 19 03:19:00 2022] DELETE /compute/v2.1/os-server-groups/93d5cdfb-fbf5-4a43-9700-627ad8780c6f => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:19:00.598092 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-cb1aabbd-cfec-4d56-a8aa-20a67812f032 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:00.638176 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-cb1aabbd-cfec-4d56-a8aa-20a67812f032 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] 10.222.0.52 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.047086 Oct 19 03:19:00.641861 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 897/1860] 10.222.0.52 () {58 vars in 1152 bytes} [Wed Oct 19 03:19:00 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:19:00.794135 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-283f16ca-ed81-4c34-b0ab-09589cab8668 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:00.795182 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-283f16ca-ed81-4c34-b0ab-09589cab8668 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] [instance: bcf14e6a-ecdc-40c0-b76b-678a1bb14828] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:19:00.798799 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=6,nova_api:DELETE=6 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:19:00.823558 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-283f16ca-ed81-4c34-b0ab-09589cab8668 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:00.824090 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-283f16ca-ed81-4c34-b0ab-09589cab8668 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:00.825724 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-283f16ca-ed81-4c34-b0ab-09589cab8668 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:00.828073 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-283f16ca-ed81-4c34-b0ab-09589cab8668 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:00.828651 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-283f16ca-ed81-4c34-b0ab-09589cab8668 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:00.829307 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-283f16ca-ed81-4c34-b0ab-09589cab8668 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:02.051202 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-283f16ca-ed81-4c34-b0ab-09589cab8668 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac711151c0334c62958e7f2ec431d860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5d239ae4b24b7e978935fe9b3458cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:19:02.066384 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-283f16ca-ed81-4c34-b0ab-09589cab8668 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] 10.222.0.52 "GET /compute/v2.1/servers/bcf14e6a-ecdc-40c0-b76b-678a1bb14828" status: 200 len: 1323 microversion: 2.1 time: 1.284302 Oct 19 03:19:02.067996 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 898/1861] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:19:00 2022] GET /compute/v2.1/servers/bcf14e6a-ecdc-40c0-b76b-678a1bb14828 => generated 1323 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:19:02.086749 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-dc39dd39-f893-4c3a-ad30-3f8a811ed4a9 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-1244098141", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "networks": [{"uuid": "42dffcc6-c0ac-457b-af5b-43c0ee6f50c1"}]}, "os:scheduler_hints": {"group": "ace44ace-7b31-4c74-a514-9477f4bf86cd"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:19:02.175394 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-dc39dd39-f893-4c3a-ad30-3f8a811ed4a9 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] validate_networks() for [('42dffcc6-c0ac-457b-af5b-43c0ee6f50c1', None, None, None, None, None)] {{(pid=121134) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:19:02.701054 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-100a9628-ec1c-4008-a135-c296037ea9db tempest-SecurityGroupsTestAdminJSON-2112335573 tempest-SecurityGroupsTestAdminJSON-2112335573-project-admin] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 218 microversion: 2.1 time: 2.946055 Oct 19 03:19:02.703061 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 964/1862] 10.222.0.52 () {60 vars in 1180 bytes} [Wed Oct 19 03:18:59 2022] POST /compute/v2.1/os-security-groups => generated 218 bytes in 2948 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:19:02.709300 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a3615200-5a37-4459-a110-ad8ababda6f3 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:02.711434 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a3615200-5a37-4459-a110-ad8ababda6f3 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 62133546-4a75-4532-81ab-0c49c9252e85] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:19:02.734115 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a3615200-5a37-4459-a110-ad8ababda6f3 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:02.735166 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a3615200-5a37-4459-a110-ad8ababda6f3 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:02.736057 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a3615200-5a37-4459-a110-ad8ababda6f3 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:02.739385 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a3615200-5a37-4459-a110-ad8ababda6f3 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:02.740259 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a3615200-5a37-4459-a110-ad8ababda6f3 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:02.744466 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a3615200-5a37-4459-a110-ad8ababda6f3 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:02.783863 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=100 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:19:03.608143 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a3615200-5a37-4459-a110-ad8ababda6f3 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:19:03.624215 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a3615200-5a37-4459-a110-ad8ababda6f3 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:19:03.625711 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a3615200-5a37-4459-a110-ad8ababda6f3 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:19:03.627036 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a3615200-5a37-4459-a110-ad8ababda6f3 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85" status: 200 len: 1810 microversion: 2.25 time: 0.922598 Oct 19 03:19:03.649731 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 965/1863] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:19:02 2022] GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85 => generated 1810 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:19:03.657116 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-544b9fee-297f-48af-a47c-3d7d6e4d5beb req-8cf00cd2-e904-4b8d-847d-ae3b1a09f447 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62133546-4a75-4532-81ab-0c49c9252e85", "name": "network-vif-unplugged", "status": "completed", "tag": "00532cca-3534-4784-9094-66d340359b0e"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:19:03.685590 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-544b9fee-297f-48af-a47c-3d7d6e4d5beb req-8cf00cd2-e904-4b8d-847d-ae3b1a09f447 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:03.686078 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-544b9fee-297f-48af-a47c-3d7d6e4d5beb req-8cf00cd2-e904-4b8d-847d-ae3b1a09f447 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:03.686526 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-544b9fee-297f-48af-a47c-3d7d6e4d5beb req-8cf00cd2-e904-4b8d-847d-ae3b1a09f447 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:03.723351 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-544b9fee-297f-48af-a47c-3d7d6e4d5beb req-8cf00cd2-e904-4b8d-847d-ae3b1a09f447 service nova] Creating event network-vif-unplugged:00532cca-3534-4784-9094-66d340359b0e for instance 62133546-4a75-4532-81ab-0c49c9252e85 on n-h1-861333-8 Oct 19 03:19:03.729425 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-544b9fee-297f-48af-a47c-3d7d6e4d5beb req-8cf00cd2-e904-4b8d-847d-ae3b1a09f447 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078156 Oct 19 03:19:03.733505 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 966/1864] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:19:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:19:03.743791 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d1ef5c7d-ce04-4895-b663-4fdddf9d4e00 tempest-SecurityGroupsTestAdminJSON-2112335573 tempest-SecurityGroupsTestAdminJSON-2112335573-project-admin] Action: 'create', calling method: .version_select at 0x7fc130bcd8b0>, body: {"security_group": {"name": "tempest-securitygroup-1948565706", "description": "tempest-description-312456202"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:19:04.372884 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-dc39dd39-f893-4c3a-ad30-3f8a811ed4a9 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Flavor limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:19:04.373761 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-dc39dd39-f893-4c3a-ad30-3f8a811ed4a9 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Image limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:19:04.374297 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-dc39dd39-f893-4c3a-ad30-3f8a811ed4a9 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Flavor pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:19:04.374647 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-dc39dd39-f893-4c3a-ad30-3f8a811ed4a9 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Image pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:19:04.375266 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-dc39dd39-f893-4c3a-ad30-3f8a811ed4a9 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:19:04.437657 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dc39dd39-f893-4c3a-ad30-3f8a811ed4a9 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:04.440678 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dc39dd39-f893-4c3a-ad30-3f8a811ed4a9 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:04.441327 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dc39dd39-f893-4c3a-ad30-3f8a811ed4a9 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:04.442961 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dc39dd39-f893-4c3a-ad30-3f8a811ed4a9 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:04.446977 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dc39dd39-f893-4c3a-ad30-3f8a811ed4a9 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:04.446977 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dc39dd39-f893-4c3a-ad30-3f8a811ed4a9 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:04.524763 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-dc39dd39-f893-4c3a-ad30-3f8a811ed4a9 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Getting quotas for project facc0913093743d1a5c4c0eb673ce532. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:19:04.540286 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-dc39dd39-f893-4c3a-ad30-3f8a811ed4a9 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Getting quotas for user 8d696202812644f3b1bcb8825fc57420 and project facc0913093743d1a5c4c0eb673ce532. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:19:04.557735 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-dc39dd39-f893-4c3a-ad30-3f8a811ed4a9 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Going to run 1 instances... {{(pid=121134) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:19:04.561652 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-dc39dd39-f893-4c3a-ad30-3f8a811ed4a9 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] [instance: e6c35da0-28b7-4556-b4de-32fbfa213265] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:19:04.681873 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-dc39dd39-f893-4c3a-ad30-3f8a811ed4a9 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=121134) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 19 03:19:04.714931 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-dc39dd39-f893-4c3a-ad30-3f8a811ed4a9 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Getting quotas for project facc0913093743d1a5c4c0eb673ce532. Resources: {'server_group_members'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:19:04.732940 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-dc39dd39-f893-4c3a-ad30-3f8a811ed4a9 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Getting quotas for user 8d696202812644f3b1bcb8825fc57420 and project facc0913093743d1a5c4c0eb673ce532. Resources: {'server_group_members'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:19:04.776027 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d1ef5c7d-ce04-4895-b663-4fdddf9d4e00 tempest-SecurityGroupsTestAdminJSON-2112335573 tempest-SecurityGroupsTestAdminJSON-2112335573-project-admin] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.041204 Oct 19 03:19:04.776634 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 967/1865] 10.222.0.52 () {60 vars in 1180 bytes} [Wed Oct 19 03:19:03 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:19:04.781245 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2c5bcc01-1b7b-4b42-a45c-8fe39d5e3cb5 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:04.782013 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-2c5bcc01-1b7b-4b42-a45c-8fe39d5e3cb5 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] [instance: bcf14e6a-ecdc-40c0-b76b-678a1bb14828] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:19:04.793106 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2c5bcc01-1b7b-4b42-a45c-8fe39d5e3cb5 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:04.801935 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2c5bcc01-1b7b-4b42-a45c-8fe39d5e3cb5 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:04.801935 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2c5bcc01-1b7b-4b42-a45c-8fe39d5e3cb5 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:04.801935 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2c5bcc01-1b7b-4b42-a45c-8fe39d5e3cb5 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:04.801935 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2c5bcc01-1b7b-4b42-a45c-8fe39d5e3cb5 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:04.802455 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2c5bcc01-1b7b-4b42-a45c-8fe39d5e3cb5 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:04.898219 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-dc39dd39-f893-4c3a-ad30-3f8a811ed4a9 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Getting quotas for project facc0913093743d1a5c4c0eb673ce532. Resources: {'server_group_members'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:19:04.917032 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-dc39dd39-f893-4c3a-ad30-3f8a811ed4a9 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Getting quotas for user 8d696202812644f3b1bcb8825fc57420 and project facc0913093743d1a5c4c0eb673ce532. Resources: {'server_group_members'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:19:05.015787 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-dc39dd39-f893-4c3a-ad30-3f8a811ed4a9 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.945748 Oct 19 03:19:05.018936 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 899/1866] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:19:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 2950 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 03:19:05.034318 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6bb8eadc-7f50-4f76-a278-24cb1a99177c tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-1336581010", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "05e006a9-28cc-481f-99f7-f3a81bb7aa8b"}], "security_groups": [{"name": "tempest-securitygroup--854626796"}], "key_name": "tempest-keypair-1307991980", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "e0b415e5-a26f-467d-adfb-b051f51a6469", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:19:05.369205 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-2c5bcc01-1b7b-4b42-a45c-8fe39d5e3cb5 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac711151c0334c62958e7f2ec431d860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5d239ae4b24b7e978935fe9b3458cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:19:05.370817 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-6bb8eadc-7f50-4f76-a278-24cb1a99177c tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] validate_networks() for [('05e006a9-28cc-481f-99f7-f3a81bb7aa8b', None, None, None, None, None)] {{(pid=121134) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:19:05.413515 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2c5bcc01-1b7b-4b42-a45c-8fe39d5e3cb5 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] 10.222.0.52 "GET /compute/v2.1/servers/bcf14e6a-ecdc-40c0-b76b-678a1bb14828" status: 200 len: 1323 microversion: 2.1 time: 0.635701 Oct 19 03:19:05.415539 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 968/1867] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:19:04 2022] GET /compute/v2.1/servers/bcf14e6a-ecdc-40c0-b76b-678a1bb14828 => generated 1323 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:19:05.424512 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b254707c-85cf-4c5b-92f9-b77bcb19eadd tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:05.425134 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b254707c-85cf-4c5b-92f9-b77bcb19eadd tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 62133546-4a75-4532-81ab-0c49c9252e85] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:19:05.458812 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b254707c-85cf-4c5b-92f9-b77bcb19eadd tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:05.459657 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b254707c-85cf-4c5b-92f9-b77bcb19eadd tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:05.461681 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b254707c-85cf-4c5b-92f9-b77bcb19eadd tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:05.462670 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b254707c-85cf-4c5b-92f9-b77bcb19eadd tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:05.463313 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b254707c-85cf-4c5b-92f9-b77bcb19eadd tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:05.468563 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b254707c-85cf-4c5b-92f9-b77bcb19eadd tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:06.120542 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b254707c-85cf-4c5b-92f9-b77bcb19eadd tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:19:06.142358 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b254707c-85cf-4c5b-92f9-b77bcb19eadd tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:19:06.153589 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b254707c-85cf-4c5b-92f9-b77bcb19eadd tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:19:06.164477 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b254707c-85cf-4c5b-92f9-b77bcb19eadd tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85" status: 200 len: 1810 microversion: 2.25 time: 0.747772 Oct 19 03:19:06.165099 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 969/1868] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:19:05 2022] GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85 => generated 1810 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:19:06.169635 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c612b843-a4b7-481c-b93a-a75a1c172c6f tempest-SecurityGroupsTestAdminJSON-2112335573 tempest-SecurityGroupsTestAdminJSON-2112335573-project-admin] Calling method '.version_select at 0x7fc130c39040>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:06.862025 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-6bb8eadc-7f50-4f76-a278-24cb1a99177c tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Getting quotas for project ce8d13fab4fe4725a4759519818113f0. Resources: dict_keys(['metadata_items']) {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:19:06.876093 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-6bb8eadc-7f50-4f76-a278-24cb1a99177c tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Getting quotas for user 28ec45c74dcd448e924be40b1abfbc4a and project ce8d13fab4fe4725a4759519818113f0. Resources: dict_keys(['metadata_items']) {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:19:06.914363 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-6bb8eadc-7f50-4f76-a278-24cb1a99177c tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Flavor limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:19:06.917986 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-6bb8eadc-7f50-4f76-a278-24cb1a99177c tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Image limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:19:06.918776 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-6bb8eadc-7f50-4f76-a278-24cb1a99177c tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Flavor pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:19:06.919369 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-6bb8eadc-7f50-4f76-a278-24cb1a99177c tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Image pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:19:06.919893 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-6bb8eadc-7f50-4f76-a278-24cb1a99177c tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:19:06.929978 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6bb8eadc-7f50-4f76-a278-24cb1a99177c tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:06.933071 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6bb8eadc-7f50-4f76-a278-24cb1a99177c tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:06.933962 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6bb8eadc-7f50-4f76-a278-24cb1a99177c tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:06.935037 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6bb8eadc-7f50-4f76-a278-24cb1a99177c tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:06.936273 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6bb8eadc-7f50-4f76-a278-24cb1a99177c tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:06.937008 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6bb8eadc-7f50-4f76-a278-24cb1a99177c tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:06.975843 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-6bb8eadc-7f50-4f76-a278-24cb1a99177c tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Getting quotas for project ce8d13fab4fe4725a4759519818113f0. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:19:06.982208 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-6bb8eadc-7f50-4f76-a278-24cb1a99177c tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Getting quotas for user 28ec45c74dcd448e924be40b1abfbc4a and project ce8d13fab4fe4725a4759519818113f0. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:19:07.085386 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6bb8eadc-7f50-4f76-a278-24cb1a99177c tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Going to run 1 instances... {{(pid=121134) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:19:07.087784 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6bb8eadc-7f50-4f76-a278-24cb1a99177c tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] [instance: 951e236c-943a-4f8c-956d-ac7bbbf0e0e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e0b415e5-a26f-467d-adfb-b051f51a6469',volume_size=None,volume_type=None)] {{(pid=121134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:19:07.734727 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6bb8eadc-7f50-4f76-a278-24cb1a99177c tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.714628 Oct 19 03:19:07.736730 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 900/1869] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:19:05 2022] POST /compute/v2.1/servers => generated 406 bytes in 2717 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 03:19:07.746295 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-00f22140-6019-4321-aa45-0cef7fc531f8 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:07.747322 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-00f22140-6019-4321-aa45-0cef7fc531f8 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] [instance: e6c35da0-28b7-4556-b4de-32fbfa213265] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:19:07.756575 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-00f22140-6019-4321-aa45-0cef7fc531f8 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:07.757493 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-00f22140-6019-4321-aa45-0cef7fc531f8 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:07.758172 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-00f22140-6019-4321-aa45-0cef7fc531f8 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:07.759485 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-00f22140-6019-4321-aa45-0cef7fc531f8 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:07.760178 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-00f22140-6019-4321-aa45-0cef7fc531f8 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:07.760865 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-00f22140-6019-4321-aa45-0cef7fc531f8 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:07.883114 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-00f22140-6019-4321-aa45-0cef7fc531f8 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d696202812644f3b1bcb8825fc57420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facc0913093743d1a5c4c0eb673ce532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:19:07.901510 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-00f22140-6019-4321-aa45-0cef7fc531f8 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] 10.222.0.52 "GET /compute/v2.1/servers/e6c35da0-28b7-4556-b4de-32fbfa213265" status: 200 len: 1265 microversion: 2.1 time: 0.154415 Oct 19 03:19:07.923652 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 901/1870] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:19:07 2022] GET /compute/v2.1/servers/e6c35da0-28b7-4556-b4de-32fbfa213265 => generated 1265 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:19:07.937040 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-c969dc59-625d-45dc-8b34-1addb854ed27 req-419c8bce-224d-4599-bb63-e84bedf3067d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62133546-4a75-4532-81ab-0c49c9252e85", "tag": "00532cca-3534-4784-9094-66d340359b0e"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:19:07.967881 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-c969dc59-625d-45dc-8b34-1addb854ed27 req-419c8bce-224d-4599-bb63-e84bedf3067d service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:07.968724 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-c969dc59-625d-45dc-8b34-1addb854ed27 req-419c8bce-224d-4599-bb63-e84bedf3067d service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:07.973122 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-c969dc59-625d-45dc-8b34-1addb854ed27 req-419c8bce-224d-4599-bb63-e84bedf3067d service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:08.001730 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-c969dc59-625d-45dc-8b34-1addb854ed27 req-419c8bce-224d-4599-bb63-e84bedf3067d service nova] Creating event network-changed:00532cca-3534-4784-9094-66d340359b0e for instance 62133546-4a75-4532-81ab-0c49c9252e85 on n-h1-861333-8 Oct 19 03:19:08.022556 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-c969dc59-625d-45dc-8b34-1addb854ed27 req-419c8bce-224d-4599-bb63-e84bedf3067d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101445 Oct 19 03:19:08.023743 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 902/1871] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:19:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:19:08.033732 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-05888ac6-f5e7-46f9-b0b6-7dbc72e98029 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:08.034667 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-05888ac6-f5e7-46f9-b0b6-7dbc72e98029 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] [instance: bcf14e6a-ecdc-40c0-b76b-678a1bb14828] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:19:08.072360 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-05888ac6-f5e7-46f9-b0b6-7dbc72e98029 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:08.074036 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-05888ac6-f5e7-46f9-b0b6-7dbc72e98029 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:08.076642 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-05888ac6-f5e7-46f9-b0b6-7dbc72e98029 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:08.077881 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-05888ac6-f5e7-46f9-b0b6-7dbc72e98029 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:08.082205 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-05888ac6-f5e7-46f9-b0b6-7dbc72e98029 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:08.082944 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-05888ac6-f5e7-46f9-b0b6-7dbc72e98029 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:08.383266 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-05888ac6-f5e7-46f9-b0b6-7dbc72e98029 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac711151c0334c62958e7f2ec431d860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5d239ae4b24b7e978935fe9b3458cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:19:08.434487 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-05888ac6-f5e7-46f9-b0b6-7dbc72e98029 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] 10.222.0.52 "GET /compute/v2.1/servers/bcf14e6a-ecdc-40c0-b76b-678a1bb14828" status: 200 len: 1323 microversion: 2.1 time: 0.409201 Oct 19 03:19:08.458757 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 903/1872] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:19:08 2022] GET /compute/v2.1/servers/bcf14e6a-ecdc-40c0-b76b-678a1bb14828 => generated 1323 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:19:08.765837 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8587fccb-0b9c-48a3-9216-6f277b44d2de tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-2074062708", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "networks": [{"uuid": "6eca3c34-0678-44d9-9b9a-0e414ced6160"}]}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:19:08.910135 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-8587fccb-0b9c-48a3-9216-6f277b44d2de tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] validate_networks() for [('6eca3c34-0678-44d9-9b9a-0e414ced6160', None, None, None, None, None)] {{(pid=121134) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:19:08.951111 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=8 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:19:10.436586 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-8587fccb-0b9c-48a3-9216-6f277b44d2de tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Flavor limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:19:10.437668 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-8587fccb-0b9c-48a3-9216-6f277b44d2de tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Image limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:19:10.438054 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-8587fccb-0b9c-48a3-9216-6f277b44d2de tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Flavor pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:19:10.438731 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-8587fccb-0b9c-48a3-9216-6f277b44d2de tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Image pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:19:10.439327 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-8587fccb-0b9c-48a3-9216-6f277b44d2de tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:19:10.452732 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=61 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:19:10.463244 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8587fccb-0b9c-48a3-9216-6f277b44d2de tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:10.466693 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8587fccb-0b9c-48a3-9216-6f277b44d2de tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:10.467353 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8587fccb-0b9c-48a3-9216-6f277b44d2de tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:10.473487 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8587fccb-0b9c-48a3-9216-6f277b44d2de tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:10.481402 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8587fccb-0b9c-48a3-9216-6f277b44d2de tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:10.481402 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8587fccb-0b9c-48a3-9216-6f277b44d2de tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:10.558137 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-8587fccb-0b9c-48a3-9216-6f277b44d2de tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Getting quotas for project be25c3ef65114ccc83b335b938743e90. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:19:10.576376 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-8587fccb-0b9c-48a3-9216-6f277b44d2de tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Getting quotas for user 8920755dc8594da4b57f3ecc920db95d and project be25c3ef65114ccc83b335b938743e90. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:19:10.632413 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8587fccb-0b9c-48a3-9216-6f277b44d2de tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Going to run 1 instances... {{(pid=121134) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:19:10.635409 n-d-861333-8 devstack@n-api.service[121134]: WARNING nova.utils [None req-8587fccb-0b9c-48a3-9216-6f277b44d2de tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Hostname tempest-FloatingIPsAssociationNegativeTestJSON-server-2074062708 is longer than 63, truncate it to tempest-FloatingIPsAssociationNegativeTestJSON-server-207406270 Oct 19 03:19:10.637979 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8587fccb-0b9c-48a3-9216-6f277b44d2de tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] [instance: c6e2a8e3-4589-4037-b0d8-032541d043e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:19:10.728461 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c612b843-a4b7-481c-b93a-a75a1c172c6f tempest-SecurityGroupsTestAdminJSON-2112335573 tempest-SecurityGroupsTestAdminJSON-2112335573-project-admin] 10.222.0.52 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 11671 microversion: 2.1 time: 4.562036 Oct 19 03:19:10.729477 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 970/1873] 10.222.0.52 () {58 vars in 1191 bytes} [Wed Oct 19 03:19:06 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 11671 bytes in 4564 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 03:19:10.734101 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3eeffd86-3c41-455e-86bb-9615be495022 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:10.734718 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-3eeffd86-3c41-455e-86bb-9615be495022 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 62133546-4a75-4532-81ab-0c49c9252e85] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:19:10.762133 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3eeffd86-3c41-455e-86bb-9615be495022 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:10.764840 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3eeffd86-3c41-455e-86bb-9615be495022 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:10.768942 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3eeffd86-3c41-455e-86bb-9615be495022 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:10.770206 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3eeffd86-3c41-455e-86bb-9615be495022 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:10.770906 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3eeffd86-3c41-455e-86bb-9615be495022 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:10.773487 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3eeffd86-3c41-455e-86bb-9615be495022 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:10.873339 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8587fccb-0b9c-48a3-9216-6f277b44d2de tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.412432 Oct 19 03:19:10.878811 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 904/1874] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:19:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 2419 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 03:19:10.894558 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5c767dd5-2b6c-417b-a6d6-76c115eb4844 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:10.898105 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5c767dd5-2b6c-417b-a6d6-76c115eb4844 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] [instance: 951e236c-943a-4f8c-956d-ac7bbbf0e0e1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:19:10.933622 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5c767dd5-2b6c-417b-a6d6-76c115eb4844 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:10.935111 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5c767dd5-2b6c-417b-a6d6-76c115eb4844 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:10.935742 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5c767dd5-2b6c-417b-a6d6-76c115eb4844 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:10.936642 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5c767dd5-2b6c-417b-a6d6-76c115eb4844 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:10.938085 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5c767dd5-2b6c-417b-a6d6-76c115eb4844 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:10.940225 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5c767dd5-2b6c-417b-a6d6-76c115eb4844 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:11.281101 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5c767dd5-2b6c-417b-a6d6-76c115eb4844 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ec45c74dcd448e924be40b1abfbc4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce8d13fab4fe4725a4759519818113f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:19:11.299427 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5c767dd5-2b6c-417b-a6d6-76c115eb4844 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] 10.222.0.52 "GET /compute/v2.1/servers/951e236c-943a-4f8c-956d-ac7bbbf0e0e1" status: 200 len: 1220 microversion: 2.1 time: 0.414096 Oct 19 03:19:11.300099 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 905/1875] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:19:10 2022] GET /compute/v2.1/servers/951e236c-943a-4f8c-956d-ac7bbbf0e0e1 => generated 1220 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:19:11.320885 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c1cfd162-b08d-404b-a745-9f66967f1252 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:11.322205 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-3eeffd86-3c41-455e-86bb-9615be495022 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:19:11.323334 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c1cfd162-b08d-404b-a745-9f66967f1252 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] [instance: e6c35da0-28b7-4556-b4de-32fbfa213265] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:19:11.339353 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-3eeffd86-3c41-455e-86bb-9615be495022 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:19:11.345627 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-3eeffd86-3c41-455e-86bb-9615be495022 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:19:11.348847 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c1cfd162-b08d-404b-a745-9f66967f1252 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:11.351255 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-3eeffd86-3c41-455e-86bb-9615be495022 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85" status: 200 len: 1810 microversion: 2.25 time: 0.619572 Oct 19 03:19:11.351676 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c1cfd162-b08d-404b-a745-9f66967f1252 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:11.352149 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c1cfd162-b08d-404b-a745-9f66967f1252 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:11.352901 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c1cfd162-b08d-404b-a745-9f66967f1252 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:11.353355 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c1cfd162-b08d-404b-a745-9f66967f1252 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:11.353527 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 971/1876] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:19:10 2022] GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85 => generated 1810 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:19:11.354804 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c1cfd162-b08d-404b-a745-9f66967f1252 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:11.370085 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9545cd5e-2a92-46de-ae6a-ee2ab522ef9f tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:11.370862 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9545cd5e-2a92-46de-ae6a-ee2ab522ef9f tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] [instance: bcf14e6a-ecdc-40c0-b76b-678a1bb14828] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:19:11.414211 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9545cd5e-2a92-46de-ae6a-ee2ab522ef9f tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:11.415585 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9545cd5e-2a92-46de-ae6a-ee2ab522ef9f tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:11.416284 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9545cd5e-2a92-46de-ae6a-ee2ab522ef9f tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:11.417179 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9545cd5e-2a92-46de-ae6a-ee2ab522ef9f tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:11.417980 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9545cd5e-2a92-46de-ae6a-ee2ab522ef9f tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:11.418699 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9545cd5e-2a92-46de-ae6a-ee2ab522ef9f tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:11.800870 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c1cfd162-b08d-404b-a745-9f66967f1252 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d696202812644f3b1bcb8825fc57420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facc0913093743d1a5c4c0eb673ce532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:19:11.814429 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c1cfd162-b08d-404b-a745-9f66967f1252 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] 10.222.0.52 "GET /compute/v2.1/servers/e6c35da0-28b7-4556-b4de-32fbfa213265" status: 200 len: 1271 microversion: 2.1 time: 0.505624 Oct 19 03:19:11.819611 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 906/1877] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:19:11 2022] GET /compute/v2.1/servers/e6c35da0-28b7-4556-b4de-32fbfa213265 => generated 1271 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:19:11.832629 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-40994b68-2cf5-4d37-88f8-d2ec9600d21f tempest-SecurityGroupsTestAdminJSON-831517812 tempest-SecurityGroupsTestAdminJSON-831517812-project] Calling method '.version_select at 0x7fc1305059d0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:12.494026 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-9545cd5e-2a92-46de-ae6a-ee2ab522ef9f tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac711151c0334c62958e7f2ec431d860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5d239ae4b24b7e978935fe9b3458cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:19:12.516086 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9545cd5e-2a92-46de-ae6a-ee2ab522ef9f tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] 10.222.0.52 "GET /compute/v2.1/servers/bcf14e6a-ecdc-40c0-b76b-678a1bb14828" status: 200 len: 1323 microversion: 2.1 time: 1.153960 Oct 19 03:19:12.536082 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 972/1878] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:19:11 2022] GET /compute/v2.1/servers/bcf14e6a-ecdc-40c0-b76b-678a1bb14828 => generated 1323 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:19:12.562704 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-63139398-593c-4172-8b13-42d59a26a1c0 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:12.568591 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-63139398-593c-4172-8b13-42d59a26a1c0 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] [instance: c6e2a8e3-4589-4037-b0d8-032541d043e3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:19:12.786878 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-63139398-593c-4172-8b13-42d59a26a1c0 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8920755dc8594da4b57f3ecc920db95d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be25c3ef65114ccc83b335b938743e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:19:12.799369 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-63139398-593c-4172-8b13-42d59a26a1c0 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] 10.222.0.52 "GET /compute/v2.1/servers/c6e2a8e3-4589-4037-b0d8-032541d043e3" status: 200 len: 1232 microversion: 2.1 time: 0.272988 Oct 19 03:19:12.825880 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 973/1879] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:19:12 2022] GET /compute/v2.1/servers/c6e2a8e3-4589-4037-b0d8-032541d043e3 => generated 1232 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:19:12.849875 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-199c3b1d-b683-4062-8e13-d50a36b01f18 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:12.851313 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-199c3b1d-b683-4062-8e13-d50a36b01f18 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] [instance: 951e236c-943a-4f8c-956d-ac7bbbf0e0e1] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:19:12.878170 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-199c3b1d-b683-4062-8e13-d50a36b01f18 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:12.884701 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-199c3b1d-b683-4062-8e13-d50a36b01f18 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:12.885582 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-199c3b1d-b683-4062-8e13-d50a36b01f18 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:12.886663 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-199c3b1d-b683-4062-8e13-d50a36b01f18 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:12.887355 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-199c3b1d-b683-4062-8e13-d50a36b01f18 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:12.888203 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-199c3b1d-b683-4062-8e13-d50a36b01f18 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:14.210248 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-199c3b1d-b683-4062-8e13-d50a36b01f18 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ec45c74dcd448e924be40b1abfbc4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce8d13fab4fe4725a4759519818113f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:19:14.222145 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-199c3b1d-b683-4062-8e13-d50a36b01f18 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] 10.222.0.52 "GET /compute/v2.1/servers/951e236c-943a-4f8c-956d-ac7bbbf0e0e1" status: 200 len: 1238 microversion: 2.1 time: 1.393598 Oct 19 03:19:14.222746 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 974/1880] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:19:12 2022] GET /compute/v2.1/servers/951e236c-943a-4f8c-956d-ac7bbbf0e0e1 => generated 1238 bytes in 1395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:19:14.234044 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6b1edba5-87f1-4d4f-8574-3b81029981f2 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:14.248787 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6b1edba5-87f1-4d4f-8574-3b81029981f2 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 62133546-4a75-4532-81ab-0c49c9252e85] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:19:14.263727 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6b1edba5-87f1-4d4f-8574-3b81029981f2 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:14.264247 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6b1edba5-87f1-4d4f-8574-3b81029981f2 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:14.264681 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6b1edba5-87f1-4d4f-8574-3b81029981f2 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:14.268208 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6b1edba5-87f1-4d4f-8574-3b81029981f2 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:14.279935 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6b1edba5-87f1-4d4f-8574-3b81029981f2 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:14.280668 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6b1edba5-87f1-4d4f-8574-3b81029981f2 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:14.313031 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-40994b68-2cf5-4d37-88f8-d2ec9600d21f tempest-SecurityGroupsTestAdminJSON-831517812 tempest-SecurityGroupsTestAdminJSON-831517812-project] 10.222.0.52 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1111 microversion: 2.1 time: 2.491776 Oct 19 03:19:14.313853 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 907/1881] 10.222.0.52 () {58 vars in 1191 bytes} [Wed Oct 19 03:19:11 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1111 bytes in 2493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:19:14.321806 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c00ef0a7-116e-47b6-ac9f-35dd3625d299 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:14.322992 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c00ef0a7-116e-47b6-ac9f-35dd3625d299 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] [instance: e6c35da0-28b7-4556-b4de-32fbfa213265] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:19:14.346087 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c00ef0a7-116e-47b6-ac9f-35dd3625d299 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:14.347407 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c00ef0a7-116e-47b6-ac9f-35dd3625d299 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:14.351110 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c00ef0a7-116e-47b6-ac9f-35dd3625d299 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:14.353216 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c00ef0a7-116e-47b6-ac9f-35dd3625d299 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:14.355031 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c00ef0a7-116e-47b6-ac9f-35dd3625d299 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:14.356078 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c00ef0a7-116e-47b6-ac9f-35dd3625d299 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:15.078396 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-6b1edba5-87f1-4d4f-8574-3b81029981f2 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:19:15.092489 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-6b1edba5-87f1-4d4f-8574-3b81029981f2 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:19:15.104048 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-6b1edba5-87f1-4d4f-8574-3b81029981f2 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:19:15.114525 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6b1edba5-87f1-4d4f-8574-3b81029981f2 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85" status: 200 len: 1810 microversion: 2.25 time: 0.879792 Oct 19 03:19:15.120694 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 975/1882] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:19:14 2022] GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85 => generated 1810 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:19:15.136782 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0db82001-ecd9-4df4-bf1c-47259bf744ef tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:15.140363 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0db82001-ecd9-4df4-bf1c-47259bf744ef tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] [instance: bcf14e6a-ecdc-40c0-b76b-678a1bb14828] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:19:15.167988 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0db82001-ecd9-4df4-bf1c-47259bf744ef tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:15.169251 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0db82001-ecd9-4df4-bf1c-47259bf744ef tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:15.171345 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0db82001-ecd9-4df4-bf1c-47259bf744ef tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:15.174473 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0db82001-ecd9-4df4-bf1c-47259bf744ef tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:15.178909 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0db82001-ecd9-4df4-bf1c-47259bf744ef tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:15.184229 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0db82001-ecd9-4df4-bf1c-47259bf744ef tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:15.261218 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c00ef0a7-116e-47b6-ac9f-35dd3625d299 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d696202812644f3b1bcb8825fc57420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facc0913093743d1a5c4c0eb673ce532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:19:15.278019 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c00ef0a7-116e-47b6-ac9f-35dd3625d299 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] 10.222.0.52 "GET /compute/v2.1/servers/e6c35da0-28b7-4556-b4de-32fbfa213265" status: 200 len: 1313 microversion: 2.1 time: 0.962489 Oct 19 03:19:15.280884 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 908/1883] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:19:14 2022] GET /compute/v2.1/servers/e6c35da0-28b7-4556-b4de-32fbfa213265 => generated 1313 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:19:15.301860 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1bbf8ff4-c888-4095-81b8-aae31a0c6f10 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:15.302804 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1bbf8ff4-c888-4095-81b8-aae31a0c6f10 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] [instance: c6e2a8e3-4589-4037-b0d8-032541d043e3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:19:15.325874 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:19:15.331366 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1bbf8ff4-c888-4095-81b8-aae31a0c6f10 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:15.335071 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1bbf8ff4-c888-4095-81b8-aae31a0c6f10 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:15.336266 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1bbf8ff4-c888-4095-81b8-aae31a0c6f10 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:15.339352 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1bbf8ff4-c888-4095-81b8-aae31a0c6f10 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:15.341447 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1bbf8ff4-c888-4095-81b8-aae31a0c6f10 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:15.342099 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1bbf8ff4-c888-4095-81b8-aae31a0c6f10 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:15.667979 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-1bbf8ff4-c888-4095-81b8-aae31a0c6f10 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8920755dc8594da4b57f3ecc920db95d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be25c3ef65114ccc83b335b938743e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:19:15.684106 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1bbf8ff4-c888-4095-81b8-aae31a0c6f10 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] 10.222.0.52 "GET /compute/v2.1/servers/c6e2a8e3-4589-4037-b0d8-032541d043e3" status: 200 len: 1292 microversion: 2.1 time: 0.399434 Oct 19 03:19:15.688016 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 909/1884] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:19:15 2022] GET /compute/v2.1/servers/c6e2a8e3-4589-4037-b0d8-032541d043e3 => generated 1292 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:19:15.710552 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-be0287ca-5efa-4832-b1f3-9bf321e9e273 tempest-SecurityGroupsTestAdminJSON-2112335573 tempest-SecurityGroupsTestAdminJSON-2112335573-project-admin] Calling method '.version_select at 0x7fc1305499d0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:15.790743 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-0db82001-ecd9-4df4-bf1c-47259bf744ef tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac711151c0334c62958e7f2ec431d860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5d239ae4b24b7e978935fe9b3458cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:19:15.802100 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0db82001-ecd9-4df4-bf1c-47259bf744ef tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] 10.222.0.52 "GET /compute/v2.1/servers/bcf14e6a-ecdc-40c0-b76b-678a1bb14828" status: 200 len: 1323 microversion: 2.1 time: 0.680000 Oct 19 03:19:15.812599 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 976/1885] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:19:15 2022] GET /compute/v2.1/servers/bcf14e6a-ecdc-40c0-b76b-678a1bb14828 => generated 1323 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:19:15.823868 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-73b84c38-2445-49c5-8f4c-9aa219551dd3 req-486a57a3-347d-47db-8f69-033d79f8fad1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcf14e6a-ecdc-40c0-b76b-678a1bb14828", "name": "network-vif-plugged", "status": "completed", "tag": "2e33b971-5f4b-4979-8038-bf99f7338ba3"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:19:15.860004 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-73b84c38-2445-49c5-8f4c-9aa219551dd3 req-486a57a3-347d-47db-8f69-033d79f8fad1 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:15.862259 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-73b84c38-2445-49c5-8f4c-9aa219551dd3 req-486a57a3-347d-47db-8f69-033d79f8fad1 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:15.863618 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-73b84c38-2445-49c5-8f4c-9aa219551dd3 req-486a57a3-347d-47db-8f69-033d79f8fad1 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:15.902207 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-73b84c38-2445-49c5-8f4c-9aa219551dd3 req-486a57a3-347d-47db-8f69-033d79f8fad1 service nova] Creating event network-vif-plugged:2e33b971-5f4b-4979-8038-bf99f7338ba3 for instance bcf14e6a-ecdc-40c0-b76b-678a1bb14828 on n-h2-861333-8 Oct 19 03:19:15.917932 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-73b84c38-2445-49c5-8f4c-9aa219551dd3 req-486a57a3-347d-47db-8f69-033d79f8fad1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102169 Oct 19 03:19:15.922607 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 977/1886] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:19:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:19:15.957931 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f2d2fdc5-5988-46ef-bb6d-ce584cd7520c tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:15.965289 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f2d2fdc5-5988-46ef-bb6d-ce584cd7520c tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] [instance: 951e236c-943a-4f8c-956d-ac7bbbf0e0e1] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:19:15.984082 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f2d2fdc5-5988-46ef-bb6d-ce584cd7520c tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:15.985113 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f2d2fdc5-5988-46ef-bb6d-ce584cd7520c tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:15.986265 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f2d2fdc5-5988-46ef-bb6d-ce584cd7520c tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:15.987774 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f2d2fdc5-5988-46ef-bb6d-ce584cd7520c tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:16.003831 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f2d2fdc5-5988-46ef-bb6d-ce584cd7520c tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:16.004608 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f2d2fdc5-5988-46ef-bb6d-ce584cd7520c tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:16.692919 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f2d2fdc5-5988-46ef-bb6d-ce584cd7520c tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ec45c74dcd448e924be40b1abfbc4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce8d13fab4fe4725a4759519818113f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:19:16.712954 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f2d2fdc5-5988-46ef-bb6d-ce584cd7520c tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] 10.222.0.52 "GET /compute/v2.1/servers/951e236c-943a-4f8c-956d-ac7bbbf0e0e1" status: 200 len: 1305 microversion: 2.1 time: 0.766057 Oct 19 03:19:16.712954 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 978/1887] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:19:15 2022] GET /compute/v2.1/servers/951e236c-943a-4f8c-956d-ac7bbbf0e0e1 => generated 1305 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:19:16.716741 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-076f131b-4626-43c1-a19e-0e470643495c tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:16.722029 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-be0287ca-5efa-4832-b1f3-9bf321e9e273 tempest-SecurityGroupsTestAdminJSON-2112335573 tempest-SecurityGroupsTestAdminJSON-2112335573-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/5a756bca-b59d-4328-803f-ed019ca8fe58" status: 202 len: 0 microversion: 2.1 time: 1.030034 Oct 19 03:19:16.722870 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 910/1888] 10.222.0.52 () {58 vars in 1272 bytes} [Wed Oct 19 03:19:15 2022] DELETE /compute/v2.1/os-security-groups/5a756bca-b59d-4328-803f-ed019ca8fe58 => generated 0 bytes in 1032 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:19:16.727068 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-076f131b-4626-43c1-a19e-0e470643495c tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 62133546-4a75-4532-81ab-0c49c9252e85] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:19:16.730302 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e5149179-f78b-4484-9ed1-8164419a674d tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:16.731080 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e5149179-f78b-4484-9ed1-8164419a674d tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] [instance: e6c35da0-28b7-4556-b4de-32fbfa213265] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:19:16.758393 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-076f131b-4626-43c1-a19e-0e470643495c tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:16.760588 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-076f131b-4626-43c1-a19e-0e470643495c tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:16.763105 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-076f131b-4626-43c1-a19e-0e470643495c tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:16.768309 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e5149179-f78b-4484-9ed1-8164419a674d tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:16.769560 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-076f131b-4626-43c1-a19e-0e470643495c tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:16.771348 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-076f131b-4626-43c1-a19e-0e470643495c tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:16.772987 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e5149179-f78b-4484-9ed1-8164419a674d tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:16.774398 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-076f131b-4626-43c1-a19e-0e470643495c tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:16.775656 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e5149179-f78b-4484-9ed1-8164419a674d tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:16.780721 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e5149179-f78b-4484-9ed1-8164419a674d tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:16.781649 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e5149179-f78b-4484-9ed1-8164419a674d tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:16.782895 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e5149179-f78b-4484-9ed1-8164419a674d tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:17.485122 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e5149179-f78b-4484-9ed1-8164419a674d tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d696202812644f3b1bcb8825fc57420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facc0913093743d1a5c4c0eb673ce532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:19:17.495145 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e5149179-f78b-4484-9ed1-8164419a674d tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] 10.222.0.52 "GET /compute/v2.1/servers/e6c35da0-28b7-4556-b4de-32fbfa213265" status: 200 len: 1313 microversion: 2.1 time: 0.770941 Oct 19 03:19:17.497663 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 911/1889] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:19:16 2022] GET /compute/v2.1/servers/e6c35da0-28b7-4556-b4de-32fbfa213265 => generated 1313 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:19:17.504954 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-567cd93b-b736-459a-abf2-bca819bf0470 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:17.505613 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-567cd93b-b736-459a-abf2-bca819bf0470 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] [instance: c6e2a8e3-4589-4037-b0d8-032541d043e3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:19:17.525114 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-076f131b-4626-43c1-a19e-0e470643495c tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:19:17.533684 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-567cd93b-b736-459a-abf2-bca819bf0470 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:17.534446 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-567cd93b-b736-459a-abf2-bca819bf0470 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:17.535093 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-567cd93b-b736-459a-abf2-bca819bf0470 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:17.536132 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-567cd93b-b736-459a-abf2-bca819bf0470 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:17.536760 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-567cd93b-b736-459a-abf2-bca819bf0470 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:17.538037 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-567cd93b-b736-459a-abf2-bca819bf0470 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:17.540346 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-076f131b-4626-43c1-a19e-0e470643495c tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:19:17.543545 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-076f131b-4626-43c1-a19e-0e470643495c tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:19:17.546357 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-076f131b-4626-43c1-a19e-0e470643495c tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85" status: 200 len: 1810 microversion: 2.25 time: 0.835977 Oct 19 03:19:17.558689 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 979/1890] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:19:16 2022] GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85 => generated 1810 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:19:17.574335 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d05df930-0e92-4249-8173-ca5548160a32 tempest-SecurityGroupsTestAdminJSON-2112335573 tempest-SecurityGroupsTestAdminJSON-2112335573-project-admin] Calling method '.version_select at 0x7fc130c3d1f0>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:17.704506 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-567cd93b-b736-459a-abf2-bca819bf0470 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8920755dc8594da4b57f3ecc920db95d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be25c3ef65114ccc83b335b938743e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:19:17.714373 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-567cd93b-b736-459a-abf2-bca819bf0470 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] 10.222.0.52 "GET /compute/v2.1/servers/c6e2a8e3-4589-4037-b0d8-032541d043e3" status: 200 len: 1290 microversion: 2.1 time: 0.215602 Oct 19 03:19:17.730363 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 912/1891] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:19:17 2022] GET /compute/v2.1/servers/c6e2a8e3-4589-4037-b0d8-032541d043e3 => generated 1290 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:19:17.745721 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-fba1f3e3-299a-45d1-9be7-0eba66fd0286 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:17.754683 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-fba1f3e3-299a-45d1-9be7-0eba66fd0286 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] [instance: bcf14e6a-ecdc-40c0-b76b-678a1bb14828] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:19:17.782710 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fba1f3e3-299a-45d1-9be7-0eba66fd0286 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:17.783274 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fba1f3e3-299a-45d1-9be7-0eba66fd0286 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:17.783726 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fba1f3e3-299a-45d1-9be7-0eba66fd0286 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:17.784470 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fba1f3e3-299a-45d1-9be7-0eba66fd0286 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:17.786159 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fba1f3e3-299a-45d1-9be7-0eba66fd0286 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:17.786605 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fba1f3e3-299a-45d1-9be7-0eba66fd0286 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:18.563336 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-fba1f3e3-299a-45d1-9be7-0eba66fd0286 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac711151c0334c62958e7f2ec431d860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5d239ae4b24b7e978935fe9b3458cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:19:18.583144 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-fba1f3e3-299a-45d1-9be7-0eba66fd0286 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] 10.222.0.52 "GET /compute/v2.1/servers/bcf14e6a-ecdc-40c0-b76b-678a1bb14828" status: 200 len: 1323 microversion: 2.1 time: 0.848575 Oct 19 03:19:18.586985 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 913/1892] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:19:17 2022] GET /compute/v2.1/servers/bcf14e6a-ecdc-40c0-b76b-678a1bb14828 => generated 1323 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:19:18.599014 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ad83f341-1119-48dd-a42d-03cf9eacb3c1 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:18.599651 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ad83f341-1119-48dd-a42d-03cf9eacb3c1 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] [instance: 951e236c-943a-4f8c-956d-ac7bbbf0e0e1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:19:18.620495 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ad83f341-1119-48dd-a42d-03cf9eacb3c1 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:18.620990 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ad83f341-1119-48dd-a42d-03cf9eacb3c1 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:18.621459 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ad83f341-1119-48dd-a42d-03cf9eacb3c1 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:18.622179 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ad83f341-1119-48dd-a42d-03cf9eacb3c1 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:18.622631 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ad83f341-1119-48dd-a42d-03cf9eacb3c1 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:18.623059 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ad83f341-1119-48dd-a42d-03cf9eacb3c1 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:19.540944 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ad83f341-1119-48dd-a42d-03cf9eacb3c1 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ec45c74dcd448e924be40b1abfbc4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce8d13fab4fe4725a4759519818113f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:19:19.556926 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ad83f341-1119-48dd-a42d-03cf9eacb3c1 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] 10.222.0.52 "GET /compute/v2.1/servers/951e236c-943a-4f8c-956d-ac7bbbf0e0e1" status: 200 len: 1305 microversion: 2.1 time: 0.968664 Oct 19 03:19:19.558719 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 914/1893] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:19:18 2022] GET /compute/v2.1/servers/951e236c-943a-4f8c-956d-ac7bbbf0e0e1 => generated 1305 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:19:19.586654 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-f99ae3ec-42b7-4efd-bb78-5243ad355727 req-9b5ce47c-0702-480f-af43-8f6afdd4df7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6c35da0-28b7-4556-b4de-32fbfa213265", "tag": "55ef4d1c-7d52-4a39-a1bb-4b98c02200e7"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:19:19.598563 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-f99ae3ec-42b7-4efd-bb78-5243ad355727 req-9b5ce47c-0702-480f-af43-8f6afdd4df7f service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:19.599056 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-f99ae3ec-42b7-4efd-bb78-5243ad355727 req-9b5ce47c-0702-480f-af43-8f6afdd4df7f service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:19.600271 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-f99ae3ec-42b7-4efd-bb78-5243ad355727 req-9b5ce47c-0702-480f-af43-8f6afdd4df7f service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:19.628741 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-f99ae3ec-42b7-4efd-bb78-5243ad355727 req-9b5ce47c-0702-480f-af43-8f6afdd4df7f service nova] Creating event network-changed:55ef4d1c-7d52-4a39-a1bb-4b98c02200e7 for instance e6c35da0-28b7-4556-b4de-32fbfa213265 on n-h1-861333-8 Oct 19 03:19:19.643647 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-f99ae3ec-42b7-4efd-bb78-5243ad355727 req-9b5ce47c-0702-480f-af43-8f6afdd4df7f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077502 Oct 19 03:19:19.645467 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 915/1894] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:19:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:19:19.662806 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-93e1f316-5774-49ef-9976-1eea370ae3c7 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:19.666272 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-93e1f316-5774-49ef-9976-1eea370ae3c7 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] [instance: e6c35da0-28b7-4556-b4de-32fbfa213265] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:19:19.687265 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-93e1f316-5774-49ef-9976-1eea370ae3c7 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:19.690109 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-93e1f316-5774-49ef-9976-1eea370ae3c7 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:19.690631 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-93e1f316-5774-49ef-9976-1eea370ae3c7 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:19.691393 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-93e1f316-5774-49ef-9976-1eea370ae3c7 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:19.691857 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-93e1f316-5774-49ef-9976-1eea370ae3c7 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:19.694936 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-93e1f316-5774-49ef-9976-1eea370ae3c7 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:19.927185 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d05df930-0e92-4249-8173-ca5548160a32 tempest-SecurityGroupsTestAdminJSON-2112335573 tempest-SecurityGroupsTestAdminJSON-2112335573-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/ab48cb51-5ef3-4ae1-97ed-d9e021174996" status: 202 len: 0 microversion: 2.1 time: 2.367132 Oct 19 03:19:19.928993 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 980/1895] 10.222.0.52 () {58 vars in 1272 bytes} [Wed Oct 19 03:19:17 2022] DELETE /compute/v2.1/os-security-groups/ab48cb51-5ef3-4ae1-97ed-d9e021174996 => generated 0 bytes in 2370 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:19:19.935617 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4137635e-b0f6-48bb-8c34-156138961c51 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:19.938695 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4137635e-b0f6-48bb-8c34-156138961c51 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 62133546-4a75-4532-81ab-0c49c9252e85] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:19:19.964986 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4137635e-b0f6-48bb-8c34-156138961c51 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:19.974033 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4137635e-b0f6-48bb-8c34-156138961c51 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:19.974505 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4137635e-b0f6-48bb-8c34-156138961c51 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:19.975826 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4137635e-b0f6-48bb-8c34-156138961c51 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:19.986376 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4137635e-b0f6-48bb-8c34-156138961c51 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:19.989104 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4137635e-b0f6-48bb-8c34-156138961c51 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:20.346933 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-93e1f316-5774-49ef-9976-1eea370ae3c7 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d696202812644f3b1bcb8825fc57420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facc0913093743d1a5c4c0eb673ce532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:19:20.356517 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-93e1f316-5774-49ef-9976-1eea370ae3c7 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] 10.222.0.52 "GET /compute/v2.1/servers/e6c35da0-28b7-4556-b4de-32fbfa213265" status: 200 len: 1313 microversion: 2.1 time: 0.707186 Oct 19 03:19:20.373395 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 916/1896] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:19:19 2022] GET /compute/v2.1/servers/e6c35da0-28b7-4556-b4de-32fbfa213265 => generated 1313 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:19:20.373395 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-814e05f9-12d9-45d2-820e-61973bccc054 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:20.373395 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-814e05f9-12d9-45d2-820e-61973bccc054 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] [instance: c6e2a8e3-4589-4037-b0d8-032541d043e3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:19:20.387437 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-814e05f9-12d9-45d2-820e-61973bccc054 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:20.387958 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-814e05f9-12d9-45d2-820e-61973bccc054 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:20.388386 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-814e05f9-12d9-45d2-820e-61973bccc054 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:20.389109 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-814e05f9-12d9-45d2-820e-61973bccc054 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:20.395485 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-814e05f9-12d9-45d2-820e-61973bccc054 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:20.396057 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-814e05f9-12d9-45d2-820e-61973bccc054 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:20.516723 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=6 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:19:20.935078 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-814e05f9-12d9-45d2-820e-61973bccc054 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8920755dc8594da4b57f3ecc920db95d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be25c3ef65114ccc83b335b938743e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:19:20.949087 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-814e05f9-12d9-45d2-820e-61973bccc054 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] 10.222.0.52 "GET /compute/v2.1/servers/c6e2a8e3-4589-4037-b0d8-032541d043e3" status: 200 len: 1332 microversion: 2.1 time: 0.586861 Oct 19 03:19:20.974420 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 917/1897] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:19:20 2022] GET /compute/v2.1/servers/c6e2a8e3-4589-4037-b0d8-032541d043e3 => generated 1332 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:19:20.994366 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-561274a5-04d6-4ad7-ba49-2c2db5ca4012 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:21.001491 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-561274a5-04d6-4ad7-ba49-2c2db5ca4012 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] [instance: bcf14e6a-ecdc-40c0-b76b-678a1bb14828] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:19:21.008031 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=5 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:19:21.023821 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4137635e-b0f6-48bb-8c34-156138961c51 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:19:21.042628 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4137635e-b0f6-48bb-8c34-156138961c51 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:19:21.044287 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-561274a5-04d6-4ad7-ba49-2c2db5ca4012 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:21.047849 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4137635e-b0f6-48bb-8c34-156138961c51 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:19:21.049307 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-561274a5-04d6-4ad7-ba49-2c2db5ca4012 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:21.049982 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-561274a5-04d6-4ad7-ba49-2c2db5ca4012 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:21.051155 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-561274a5-04d6-4ad7-ba49-2c2db5ca4012 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:21.053220 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4137635e-b0f6-48bb-8c34-156138961c51 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85" status: 200 len: 1810 microversion: 2.25 time: 1.122097 Oct 19 03:19:21.053957 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-561274a5-04d6-4ad7-ba49-2c2db5ca4012 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:21.056949 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-561274a5-04d6-4ad7-ba49-2c2db5ca4012 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:21.057834 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 981/1898] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:19:19 2022] GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85 => generated 1810 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:19:21.069495 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-40df2417-ba9c-4fdc-966f-146c0b74c523 tempest-SecurityGroupsTestAdminJSON-831517812 tempest-SecurityGroupsTestAdminJSON-831517812-project] Calling method '.version_select at 0x7fc130b34c10>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:21.688810 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-561274a5-04d6-4ad7-ba49-2c2db5ca4012 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac711151c0334c62958e7f2ec431d860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5d239ae4b24b7e978935fe9b3458cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:19:21.749130 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-561274a5-04d6-4ad7-ba49-2c2db5ca4012 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] 10.222.0.52 "GET /compute/v2.1/servers/bcf14e6a-ecdc-40c0-b76b-678a1bb14828" status: 200 len: 1519 microversion: 2.1 time: 0.767956 Oct 19 03:19:21.749949 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 918/1899] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:19:20 2022] GET /compute/v2.1/servers/bcf14e6a-ecdc-40c0-b76b-678a1bb14828 => generated 1519 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:19:21.778654 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c5610440-4242-4b81-9377-dbd4026abc2d tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:21.779454 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c5610440-4242-4b81-9377-dbd4026abc2d tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] [instance: 951e236c-943a-4f8c-956d-ac7bbbf0e0e1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:19:21.796149 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c5610440-4242-4b81-9377-dbd4026abc2d tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:21.796746 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c5610440-4242-4b81-9377-dbd4026abc2d tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:21.800906 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c5610440-4242-4b81-9377-dbd4026abc2d tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:21.800906 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c5610440-4242-4b81-9377-dbd4026abc2d tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:21.800906 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c5610440-4242-4b81-9377-dbd4026abc2d tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:21.800906 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c5610440-4242-4b81-9377-dbd4026abc2d tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:22.023123 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-40df2417-ba9c-4fdc-966f-146c0b74c523 tempest-SecurityGroupsTestAdminJSON-831517812 tempest-SecurityGroupsTestAdminJSON-831517812-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/38b594f8-8a26-4a48-972c-e37e2885e41e" status: 202 len: 0 microversion: 2.1 time: 0.959500 Oct 19 03:19:22.023933 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 982/1900] 10.222.0.52 () {58 vars in 1272 bytes} [Wed Oct 19 03:19:21 2022] DELETE /compute/v2.1/os-security-groups/38b594f8-8a26-4a48-972c-e37e2885e41e => generated 0 bytes in 961 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:19:22.029457 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-da1e79bc-a23c-404e-9d08-8e6916a8c022 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:22.030385 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-da1e79bc-a23c-404e-9d08-8e6916a8c022 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] [instance: e6c35da0-28b7-4556-b4de-32fbfa213265] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:19:22.067083 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-da1e79bc-a23c-404e-9d08-8e6916a8c022 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:22.075483 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-da1e79bc-a23c-404e-9d08-8e6916a8c022 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:22.076528 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-da1e79bc-a23c-404e-9d08-8e6916a8c022 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:22.078386 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-da1e79bc-a23c-404e-9d08-8e6916a8c022 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:22.081030 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-da1e79bc-a23c-404e-9d08-8e6916a8c022 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:22.084006 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-da1e79bc-a23c-404e-9d08-8e6916a8c022 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:22.803234 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:19:22.930981 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c5610440-4242-4b81-9377-dbd4026abc2d tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ec45c74dcd448e924be40b1abfbc4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce8d13fab4fe4725a4759519818113f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:19:22.942456 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=100 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:19:22.946559 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c5610440-4242-4b81-9377-dbd4026abc2d tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] 10.222.0.52 "GET /compute/v2.1/servers/951e236c-943a-4f8c-956d-ac7bbbf0e0e1" status: 200 len: 1305 microversion: 2.1 time: 1.185414 Oct 19 03:19:22.947730 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 919/1901] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:19:21 2022] GET /compute/v2.1/servers/951e236c-943a-4f8c-956d-ac7bbbf0e0e1 => generated 1305 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:19:23.025329 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3021be20-f6cb-48e8-8e95-74134f01f550 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-892955914", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "networks": [{"uuid": "2f96d8a2-32f5-44b2-88f4-374c3b78e3c5"}]}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:19:23.072067 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-da1e79bc-a23c-404e-9d08-8e6916a8c022 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d696202812644f3b1bcb8825fc57420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facc0913093743d1a5c4c0eb673ce532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:19:23.081354 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-da1e79bc-a23c-404e-9d08-8e6916a8c022 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] 10.222.0.52 "GET /compute/v2.1/servers/e6c35da0-28b7-4556-b4de-32fbfa213265" status: 200 len: 1313 microversion: 2.1 time: 1.055750 Oct 19 03:19:23.082641 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 983/1902] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:19:22 2022] GET /compute/v2.1/servers/e6c35da0-28b7-4556-b4de-32fbfa213265 => generated 1313 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:19:23.088345 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9a28beeb-1418-4d87-b819-e3d26496a73d tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Action: 'create', calling method: .version_select at 0x7fc130bbcdc0>, body: {"pool": null} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:19:23.132505 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-3021be20-f6cb-48e8-8e95-74134f01f550 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] validate_networks() for [('2f96d8a2-32f5-44b2-88f4-374c3b78e3c5', None, None, None, None, None)] {{(pid=121134) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:19:24.756806 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-3021be20-f6cb-48e8-8e95-74134f01f550 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Flavor limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:19:24.757929 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-3021be20-f6cb-48e8-8e95-74134f01f550 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Image limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:19:24.758599 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-3021be20-f6cb-48e8-8e95-74134f01f550 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Flavor pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:19:24.759191 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-3021be20-f6cb-48e8-8e95-74134f01f550 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Image pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:19:24.759828 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-3021be20-f6cb-48e8-8e95-74134f01f550 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:19:24.769684 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3021be20-f6cb-48e8-8e95-74134f01f550 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:24.770462 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3021be20-f6cb-48e8-8e95-74134f01f550 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:24.771531 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3021be20-f6cb-48e8-8e95-74134f01f550 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:24.772694 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3021be20-f6cb-48e8-8e95-74134f01f550 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:24.773823 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3021be20-f6cb-48e8-8e95-74134f01f550 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:24.777164 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3021be20-f6cb-48e8-8e95-74134f01f550 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:24.796208 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-3021be20-f6cb-48e8-8e95-74134f01f550 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Getting quotas for project f9e436373e9e45efa03f08b33da619e8. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:19:24.804684 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-3021be20-f6cb-48e8-8e95-74134f01f550 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Getting quotas for user 8824f20e6a1f478a99f90e1ba8f028fe and project f9e436373e9e45efa03f08b33da619e8. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:19:24.839129 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3021be20-f6cb-48e8-8e95-74134f01f550 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Going to run 1 instances... {{(pid=121134) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:19:24.841936 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3021be20-f6cb-48e8-8e95-74134f01f550 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] [instance: d6d507e4-3a53-4734-bb88-8fc38efa4d9b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:19:25.000176 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3021be20-f6cb-48e8-8e95-74134f01f550 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.051151 Oct 19 03:19:25.009290 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 920/1903] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:19:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 2061 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 03:19:25.016823 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-debc6ccd-a1bb-42f5-baba-f3df426aca9b tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:25.019038 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-debc6ccd-a1bb-42f5-baba-f3df426aca9b tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] [instance: c6e2a8e3-4589-4037-b0d8-032541d043e3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:19:25.030879 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-debc6ccd-a1bb-42f5-baba-f3df426aca9b tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:25.032181 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-debc6ccd-a1bb-42f5-baba-f3df426aca9b tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:25.033490 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-debc6ccd-a1bb-42f5-baba-f3df426aca9b tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:25.036078 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-debc6ccd-a1bb-42f5-baba-f3df426aca9b tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:25.036756 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-debc6ccd-a1bb-42f5-baba-f3df426aca9b tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:25.038910 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-debc6ccd-a1bb-42f5-baba-f3df426aca9b tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:25.286032 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-debc6ccd-a1bb-42f5-baba-f3df426aca9b tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8920755dc8594da4b57f3ecc920db95d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be25c3ef65114ccc83b335b938743e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:19:25.296881 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-debc6ccd-a1bb-42f5-baba-f3df426aca9b tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] 10.222.0.52 "GET /compute/v2.1/servers/c6e2a8e3-4589-4037-b0d8-032541d043e3" status: 200 len: 1332 microversion: 2.1 time: 0.286023 Oct 19 03:19:25.305433 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 921/1904] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:19:25 2022] GET /compute/v2.1/servers/c6e2a8e3-4589-4037-b0d8-032541d043e3 => generated 1332 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:19:25.305433 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ea886843-bf70-4b0e-b8c4-b3614bb67cbf tempest-SecurityGroupsTestAdminJSON-831517812 tempest-SecurityGroupsTestAdminJSON-831517812-project] Calling method '.version_select at 0x7fc13051b3a0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:26.062066 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ea886843-bf70-4b0e-b8c4-b3614bb67cbf tempest-SecurityGroupsTestAdminJSON-831517812 tempest-SecurityGroupsTestAdminJSON-831517812-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/2b52f27b-8ca8-44ac-92af-004e6b790060" status: 202 len: 0 microversion: 2.1 time: 0.762232 Oct 19 03:19:26.063998 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 922/1905] 10.222.0.52 () {58 vars in 1272 bytes} [Wed Oct 19 03:19:25 2022] DELETE /compute/v2.1/os-security-groups/2b52f27b-8ca8-44ac-92af-004e6b790060 => generated 0 bytes in 765 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:19:26.076448 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ccc0dabe-021a-4519-81af-a751df0f76e7 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:26.077478 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ccc0dabe-021a-4519-81af-a751df0f76e7 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 62133546-4a75-4532-81ab-0c49c9252e85] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:19:26.102005 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ccc0dabe-021a-4519-81af-a751df0f76e7 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:26.106498 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ccc0dabe-021a-4519-81af-a751df0f76e7 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:26.108021 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ccc0dabe-021a-4519-81af-a751df0f76e7 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:26.110737 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ccc0dabe-021a-4519-81af-a751df0f76e7 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:26.112689 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ccc0dabe-021a-4519-81af-a751df0f76e7 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:26.123358 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ccc0dabe-021a-4519-81af-a751df0f76e7 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:26.812103 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ccc0dabe-021a-4519-81af-a751df0f76e7 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:19:26.822531 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ccc0dabe-021a-4519-81af-a751df0f76e7 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:19:26.824271 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ccc0dabe-021a-4519-81af-a751df0f76e7 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:19:26.826089 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ccc0dabe-021a-4519-81af-a751df0f76e7 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85" status: 200 len: 1800 microversion: 2.25 time: 0.760553 Oct 19 03:19:26.827232 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 923/1906] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:19:26 2022] GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85 => generated 1800 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:19:26.857170 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-1011051d-9a9a-4754-9a01-9829e9756b8d req-c29f08d2-1c4e-47df-92c0-f810a071c5f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "951e236c-943a-4f8c-956d-ac7bbbf0e0e1", "tag": "d95bdec8-e9af-43f6-8904-996c4e694095"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:19:26.876984 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-1011051d-9a9a-4754-9a01-9829e9756b8d req-c29f08d2-1c4e-47df-92c0-f810a071c5f4 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:26.879827 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-1011051d-9a9a-4754-9a01-9829e9756b8d req-c29f08d2-1c4e-47df-92c0-f810a071c5f4 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:26.879827 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-1011051d-9a9a-4754-9a01-9829e9756b8d req-c29f08d2-1c4e-47df-92c0-f810a071c5f4 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:26.892618 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-1011051d-9a9a-4754-9a01-9829e9756b8d req-c29f08d2-1c4e-47df-92c0-f810a071c5f4 service nova] Creating event network-changed:d95bdec8-e9af-43f6-8904-996c4e694095 for instance 951e236c-943a-4f8c-956d-ac7bbbf0e0e1 on n-h2-861333-8 Oct 19 03:19:26.899342 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-1011051d-9a9a-4754-9a01-9829e9756b8d req-c29f08d2-1c4e-47df-92c0-f810a071c5f4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070532 Oct 19 03:19:26.900512 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 924/1907] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:19:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:19:26.908487 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-2cc7cf21-da44-431d-b991-28a90b03038f req-2c44e347-7b0d-4a88-b5f2-b63215694d4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6e2a8e3-4589-4037-b0d8-032541d043e3", "tag": "b8014d15-27b1-4267-af57-17ae32c38543"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:19:26.919378 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-2cc7cf21-da44-431d-b991-28a90b03038f req-2c44e347-7b0d-4a88-b5f2-b63215694d4f service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:26.920373 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-2cc7cf21-da44-431d-b991-28a90b03038f req-2c44e347-7b0d-4a88-b5f2-b63215694d4f service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:26.921131 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-2cc7cf21-da44-431d-b991-28a90b03038f req-2c44e347-7b0d-4a88-b5f2-b63215694d4f service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:26.935506 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-2cc7cf21-da44-431d-b991-28a90b03038f req-2c44e347-7b0d-4a88-b5f2-b63215694d4f service nova] Creating event network-changed:b8014d15-27b1-4267-af57-17ae32c38543 for instance c6e2a8e3-4589-4037-b0d8-032541d043e3 on n-h1-861333-8 Oct 19 03:19:26.942891 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-2cc7cf21-da44-431d-b991-28a90b03038f req-2c44e347-7b0d-4a88-b5f2-b63215694d4f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038988 Oct 19 03:19:26.942891 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 925/1908] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:19:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:19:26.948791 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-64d19429-8248-4f77-9437-dbbd76d813d8 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:26.949640 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-64d19429-8248-4f77-9437-dbbd76d813d8 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] [instance: 951e236c-943a-4f8c-956d-ac7bbbf0e0e1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:19:26.955891 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-64d19429-8248-4f77-9437-dbbd76d813d8 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:26.956632 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-64d19429-8248-4f77-9437-dbbd76d813d8 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:26.957263 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-64d19429-8248-4f77-9437-dbbd76d813d8 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:26.958325 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-64d19429-8248-4f77-9437-dbbd76d813d8 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:26.959052 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-64d19429-8248-4f77-9437-dbbd76d813d8 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:26.959685 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-64d19429-8248-4f77-9437-dbbd76d813d8 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:27.663065 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-64d19429-8248-4f77-9437-dbbd76d813d8 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ec45c74dcd448e924be40b1abfbc4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce8d13fab4fe4725a4759519818113f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:19:27.687982 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-64d19429-8248-4f77-9437-dbbd76d813d8 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] 10.222.0.52 "GET /compute/v2.1/servers/951e236c-943a-4f8c-956d-ac7bbbf0e0e1" status: 200 len: 1293 microversion: 2.1 time: 0.743248 Oct 19 03:19:27.689165 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 926/1909] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:19:26 2022] GET /compute/v2.1/servers/951e236c-943a-4f8c-956d-ac7bbbf0e0e1 => generated 1293 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:19:27.696188 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d0c5bc36-e802-4665-acfa-819e49564316 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:27.697056 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d0c5bc36-e802-4665-acfa-819e49564316 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] [instance: e6c35da0-28b7-4556-b4de-32fbfa213265] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:19:27.722896 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d0c5bc36-e802-4665-acfa-819e49564316 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:27.723598 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d0c5bc36-e802-4665-acfa-819e49564316 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:27.724221 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d0c5bc36-e802-4665-acfa-819e49564316 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:27.725998 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d0c5bc36-e802-4665-acfa-819e49564316 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:27.726616 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d0c5bc36-e802-4665-acfa-819e49564316 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:27.727223 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d0c5bc36-e802-4665-acfa-819e49564316 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:28.045644 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9a28beeb-1418-4d87-b819-e3d26496a73d tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] 10.222.0.52 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.961216 Oct 19 03:19:28.046745 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 984/1910] 10.222.0.52 () {60 vars in 1170 bytes} [Wed Oct 19 03:19:23 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4963 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:19:28.051854 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9d229b10-01f0-4094-ac7b-acccbb550f8a tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:28.053865 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9d229b10-01f0-4094-ac7b-acccbb550f8a tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] [instance: d6d507e4-3a53-4734-bb88-8fc38efa4d9b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:19:28.064227 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=83,nova_api:DELETE=6,nova_api:INSERT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:19:28.070364 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9d229b10-01f0-4094-ac7b-acccbb550f8a tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:28.071178 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9d229b10-01f0-4094-ac7b-acccbb550f8a tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:28.072176 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9d229b10-01f0-4094-ac7b-acccbb550f8a tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:28.073263 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9d229b10-01f0-4094-ac7b-acccbb550f8a tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:28.077588 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9d229b10-01f0-4094-ac7b-acccbb550f8a tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:28.078518 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9d229b10-01f0-4094-ac7b-acccbb550f8a tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:28.161332 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d0c5bc36-e802-4665-acfa-819e49564316 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d696202812644f3b1bcb8825fc57420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facc0913093743d1a5c4c0eb673ce532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:19:28.171429 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d0c5bc36-e802-4665-acfa-819e49564316 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] 10.222.0.52 "GET /compute/v2.1/servers/e6c35da0-28b7-4556-b4de-32fbfa213265" status: 200 len: 1313 microversion: 2.1 time: 0.480985 Oct 19 03:19:28.182844 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 927/1911] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:19:27 2022] GET /compute/v2.1/servers/e6c35da0-28b7-4556-b4de-32fbfa213265 => generated 1313 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:19:28.192737 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-56d92aa5-9cc3-4d19-ba7f-610b1e5f12f5 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:28.194377 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-56d92aa5-9cc3-4d19-ba7f-610b1e5f12f5 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] [instance: c6e2a8e3-4589-4037-b0d8-032541d043e3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:19:28.211976 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-56d92aa5-9cc3-4d19-ba7f-610b1e5f12f5 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:28.215096 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-56d92aa5-9cc3-4d19-ba7f-610b1e5f12f5 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:28.215774 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-56d92aa5-9cc3-4d19-ba7f-610b1e5f12f5 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:28.216516 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-56d92aa5-9cc3-4d19-ba7f-610b1e5f12f5 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:28.216987 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-56d92aa5-9cc3-4d19-ba7f-610b1e5f12f5 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:28.217427 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-56d92aa5-9cc3-4d19-ba7f-610b1e5f12f5 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:28.367049 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-9d229b10-01f0-4094-ac7b-acccbb550f8a tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8824f20e6a1f478a99f90e1ba8f028fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e436373e9e45efa03f08b33da619e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:19:28.378752 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9d229b10-01f0-4094-ac7b-acccbb550f8a tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] 10.222.0.52 "GET /compute/v2.1/servers/d6d507e4-3a53-4734-bb88-8fc38efa4d9b" status: 200 len: 1276 microversion: 2.1 time: 0.330880 Oct 19 03:19:28.380224 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 985/1912] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:19:28 2022] GET /compute/v2.1/servers/d6d507e4-3a53-4734-bb88-8fc38efa4d9b => generated 1276 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:19:28.404797 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-cf63ef30-bd6b-4d38-a9f8-f3b35ffc83d8 req-0eeaf51d-1e5c-4d94-a980-67fa2fcc2db0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6c35da0-28b7-4556-b4de-32fbfa213265", "name": "network-vif-plugged", "status": "completed", "tag": "55ef4d1c-7d52-4a39-a1bb-4b98c02200e7"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:19:28.428850 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-cf63ef30-bd6b-4d38-a9f8-f3b35ffc83d8 req-0eeaf51d-1e5c-4d94-a980-67fa2fcc2db0 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:28.431660 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-cf63ef30-bd6b-4d38-a9f8-f3b35ffc83d8 req-0eeaf51d-1e5c-4d94-a980-67fa2fcc2db0 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:28.435341 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-cf63ef30-bd6b-4d38-a9f8-f3b35ffc83d8 req-0eeaf51d-1e5c-4d94-a980-67fa2fcc2db0 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:28.465235 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-cf63ef30-bd6b-4d38-a9f8-f3b35ffc83d8 req-0eeaf51d-1e5c-4d94-a980-67fa2fcc2db0 service nova] Creating event network-vif-plugged:55ef4d1c-7d52-4a39-a1bb-4b98c02200e7 for instance e6c35da0-28b7-4556-b4de-32fbfa213265 on n-h1-861333-8 Oct 19 03:19:28.471569 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-cf63ef30-bd6b-4d38-a9f8-f3b35ffc83d8 req-0eeaf51d-1e5c-4d94-a980-67fa2fcc2db0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089402 Oct 19 03:19:28.474928 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 986/1913] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:19:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:19:28.482376 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a42bed42-7936-40e2-8bd4-b4712617415b tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Calling method '.version_select at 0x7fc13191bd30>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:28.486827 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a42bed42-7936-40e2-8bd4-b4712617415b tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:28.487547 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a42bed42-7936-40e2-8bd4-b4712617415b tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:28.488163 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a42bed42-7936-40e2-8bd4-b4712617415b tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:28.498166 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a42bed42-7936-40e2-8bd4-b4712617415b tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] 10.222.0.52 "GET /compute/v2.1/os-migrations" status: 200 len: 1276 microversion: 2.25 time: 0.024016 Oct 19 03:19:28.510083 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 987/1914] 10.222.0.52 () {60 vars in 1184 bytes} [Wed Oct 19 03:19:28 2022] GET /compute/v2.1/os-migrations => generated 1276 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:19:28.520949 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2cb929f0-ff13-47d2-9f90-772cb3d2af7a tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1660490483", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "networks": [{"uuid": "6b3013ab-5e3b-4dca-bc82-37c6dc5721e3"}]}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:19:28.647081 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.network.neutron [None req-2cb929f0-ff13-47d2-9f90-772cb3d2af7a tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] validate_networks() for [('6b3013ab-5e3b-4dca-bc82-37c6dc5721e3', None, None, None, None, None)] {{(pid=121135) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:19:28.778546 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-56d92aa5-9cc3-4d19-ba7f-610b1e5f12f5 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8920755dc8594da4b57f3ecc920db95d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be25c3ef65114ccc83b335b938743e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:19:28.790788 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-56d92aa5-9cc3-4d19-ba7f-610b1e5f12f5 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] 10.222.0.52 "GET /compute/v2.1/servers/c6e2a8e3-4589-4037-b0d8-032541d043e3" status: 200 len: 1332 microversion: 2.1 time: 0.606290 Oct 19 03:19:28.793718 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 928/1915] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:19:28 2022] GET /compute/v2.1/servers/c6e2a8e3-4589-4037-b0d8-032541d043e3 => generated 1332 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:19:28.800550 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a7518613-6280-4dae-8039-68a7e5cacf97 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:28.801279 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a7518613-6280-4dae-8039-68a7e5cacf97 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] [instance: 62133546-4a75-4532-81ab-0c49c9252e85] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:19:28.822642 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a7518613-6280-4dae-8039-68a7e5cacf97 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:28.823231 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a7518613-6280-4dae-8039-68a7e5cacf97 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:28.823985 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a7518613-6280-4dae-8039-68a7e5cacf97 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:28.825961 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a7518613-6280-4dae-8039-68a7e5cacf97 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:28.827706 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a7518613-6280-4dae-8039-68a7e5cacf97 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:28.828169 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a7518613-6280-4dae-8039-68a7e5cacf97 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:29.353790 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-a7518613-6280-4dae-8039-68a7e5cacf97 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lazy-loading 'services' on Instance uuid 62133546-4a75-4532-81ab-0c49c9252e85 {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:19:29.405447 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a7518613-6280-4dae-8039-68a7e5cacf97 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85" status: 200 len: 2419 microversion: 2.25 time: 0.612037 Oct 19 03:19:29.406571 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 929/1916] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:19:28 2022] GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85 => generated 2419 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:19:29.417945 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d9d62431-563f-46db-9694-f82eeaf2d313 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:29.417945 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d9d62431-563f-46db-9694-f82eeaf2d313 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] [instance: 951e236c-943a-4f8c-956d-ac7bbbf0e0e1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:19:29.434677 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d9d62431-563f-46db-9694-f82eeaf2d313 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:29.435445 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d9d62431-563f-46db-9694-f82eeaf2d313 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:29.436102 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d9d62431-563f-46db-9694-f82eeaf2d313 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:29.437678 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d9d62431-563f-46db-9694-f82eeaf2d313 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:29.438372 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d9d62431-563f-46db-9694-f82eeaf2d313 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:29.439271 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d9d62431-563f-46db-9694-f82eeaf2d313 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:29.665262 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d9d62431-563f-46db-9694-f82eeaf2d313 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ec45c74dcd448e924be40b1abfbc4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce8d13fab4fe4725a4759519818113f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:19:29.675323 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d9d62431-563f-46db-9694-f82eeaf2d313 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] 10.222.0.52 "GET /compute/v2.1/servers/951e236c-943a-4f8c-956d-ac7bbbf0e0e1" status: 200 len: 1293 microversion: 2.1 time: 0.267694 Oct 19 03:19:29.689458 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 930/1917] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:19:29 2022] GET /compute/v2.1/servers/951e236c-943a-4f8c-956d-ac7bbbf0e0e1 => generated 1293 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:19:29.689458 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-88510049-f7ff-4ebb-bd91-456eed23dcfe tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:29.689458 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-88510049-f7ff-4ebb-bd91-456eed23dcfe tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] [instance: e6c35da0-28b7-4556-b4de-32fbfa213265] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:19:29.699468 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-88510049-f7ff-4ebb-bd91-456eed23dcfe tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:29.699468 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-88510049-f7ff-4ebb-bd91-456eed23dcfe tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:29.699468 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-88510049-f7ff-4ebb-bd91-456eed23dcfe tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:29.699468 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-88510049-f7ff-4ebb-bd91-456eed23dcfe tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:29.700073 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-88510049-f7ff-4ebb-bd91-456eed23dcfe tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:29.700073 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-88510049-f7ff-4ebb-bd91-456eed23dcfe tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:29.886462 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-2cb929f0-ff13-47d2-9f90-772cb3d2af7a tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Flavor limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:19:29.886986 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-2cb929f0-ff13-47d2-9f90-772cb3d2af7a tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Image limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:19:29.887351 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-2cb929f0-ff13-47d2-9f90-772cb3d2af7a tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Flavor pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:19:29.888016 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-2cb929f0-ff13-47d2-9f90-772cb3d2af7a tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Image pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:19:29.888429 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-2cb929f0-ff13-47d2-9f90-772cb3d2af7a tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:19:29.898032 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2cb929f0-ff13-47d2-9f90-772cb3d2af7a tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:29.898521 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2cb929f0-ff13-47d2-9f90-772cb3d2af7a tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:29.899440 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2cb929f0-ff13-47d2-9f90-772cb3d2af7a tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:29.900406 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2cb929f0-ff13-47d2-9f90-772cb3d2af7a tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:29.900860 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2cb929f0-ff13-47d2-9f90-772cb3d2af7a tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:29.901515 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2cb929f0-ff13-47d2-9f90-772cb3d2af7a tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:29.920364 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-2cb929f0-ff13-47d2-9f90-772cb3d2af7a tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Getting quotas for project 0e5d239ae4b24b7e978935fe9b3458cf. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:19:29.926495 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-2cb929f0-ff13-47d2-9f90-772cb3d2af7a tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Getting quotas for user ac711151c0334c62958e7f2ec431d860 and project 0e5d239ae4b24b7e978935fe9b3458cf. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:19:29.940881 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-2cb929f0-ff13-47d2-9f90-772cb3d2af7a tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Going to run 1 instances... {{(pid=121135) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:19:29.943361 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-2cb929f0-ff13-47d2-9f90-772cb3d2af7a tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] [instance: b97f61ab-18fc-4cf6-bc15-ec08ac4750fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121135) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:19:29.954004 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-88510049-f7ff-4ebb-bd91-456eed23dcfe tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d696202812644f3b1bcb8825fc57420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facc0913093743d1a5c4c0eb673ce532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:19:29.964816 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-88510049-f7ff-4ebb-bd91-456eed23dcfe tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] 10.222.0.52 "GET /compute/v2.1/servers/e6c35da0-28b7-4556-b4de-32fbfa213265" status: 200 len: 1313 microversion: 2.1 time: 0.279772 Oct 19 03:19:29.968117 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 931/1918] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:19:29 2022] GET /compute/v2.1/servers/e6c35da0-28b7-4556-b4de-32fbfa213265 => generated 1313 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:19:29.981565 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-10f35234-b584-4b0a-a3b0-5b1330f0164a tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:29.982194 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-10f35234-b584-4b0a-a3b0-5b1330f0164a tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] [instance: d6d507e4-3a53-4734-bb88-8fc38efa4d9b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:19:29.993114 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-10f35234-b584-4b0a-a3b0-5b1330f0164a tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:29.994011 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-10f35234-b584-4b0a-a3b0-5b1330f0164a tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:29.994472 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-10f35234-b584-4b0a-a3b0-5b1330f0164a tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:29.995193 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-10f35234-b584-4b0a-a3b0-5b1330f0164a tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:29.995659 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-10f35234-b584-4b0a-a3b0-5b1330f0164a tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:29.996096 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-10f35234-b584-4b0a-a3b0-5b1330f0164a tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:30.125474 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2cb929f0-ff13-47d2-9f90-772cb3d2af7a tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.613853 Oct 19 03:19:30.126152 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 988/1919] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:19:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1615 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 03:19:30.133250 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4106147d-3c66-491f-abd5-3d1b375bc8b5 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:30.137765 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4106147d-3c66-491f-abd5-3d1b375bc8b5 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] [instance: 62133546-4a75-4532-81ab-0c49c9252e85] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:19:30.152524 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4106147d-3c66-491f-abd5-3d1b375bc8b5 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:30.153269 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4106147d-3c66-491f-abd5-3d1b375bc8b5 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:30.154728 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4106147d-3c66-491f-abd5-3d1b375bc8b5 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:30.155688 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4106147d-3c66-491f-abd5-3d1b375bc8b5 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:30.156377 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4106147d-3c66-491f-abd5-3d1b375bc8b5 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:30.157655 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4106147d-3c66-491f-abd5-3d1b375bc8b5 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:30.420288 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-10f35234-b584-4b0a-a3b0-5b1330f0164a tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8824f20e6a1f478a99f90e1ba8f028fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e436373e9e45efa03f08b33da619e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:19:30.430813 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-10f35234-b584-4b0a-a3b0-5b1330f0164a tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] 10.222.0.52 "GET /compute/v2.1/servers/d6d507e4-3a53-4734-bb88-8fc38efa4d9b" status: 200 len: 1282 microversion: 2.1 time: 0.461583 Oct 19 03:19:30.431632 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 932/1920] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:19:29 2022] GET /compute/v2.1/servers/d6d507e4-3a53-4734-bb88-8fc38efa4d9b => generated 1282 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:19:30.436504 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d5598ed7-533a-4205-8819-f9e87723008d tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:30.437187 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d5598ed7-533a-4205-8819-f9e87723008d tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] [instance: c6e2a8e3-4589-4037-b0d8-032541d043e3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:19:30.450192 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d5598ed7-533a-4205-8819-f9e87723008d tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:30.451163 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d5598ed7-533a-4205-8819-f9e87723008d tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:30.451934 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d5598ed7-533a-4205-8819-f9e87723008d tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:30.452935 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d5598ed7-533a-4205-8819-f9e87723008d tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:30.453874 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d5598ed7-533a-4205-8819-f9e87723008d tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:30.454546 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d5598ed7-533a-4205-8819-f9e87723008d tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:30.644540 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-4106147d-3c66-491f-abd5-3d1b375bc8b5 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lazy-loading 'services' on Instance uuid 62133546-4a75-4532-81ab-0c49c9252e85 {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:19:30.660047 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4106147d-3c66-491f-abd5-3d1b375bc8b5 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85" status: 200 len: 2419 microversion: 2.25 time: 0.531241 Oct 19 03:19:30.660647 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 989/1921] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:19:30 2022] GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85 => generated 2419 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:19:30.667826 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7209b702-a156-499b-a567-86a10653fc30 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:30.668664 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7209b702-a156-499b-a567-86a10653fc30 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] [instance: b97f61ab-18fc-4cf6-bc15-ec08ac4750fd] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:19:30.723871 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d5598ed7-533a-4205-8819-f9e87723008d tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8920755dc8594da4b57f3ecc920db95d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be25c3ef65114ccc83b335b938743e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:19:30.733958 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d5598ed7-533a-4205-8819-f9e87723008d tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] 10.222.0.52 "GET /compute/v2.1/servers/c6e2a8e3-4589-4037-b0d8-032541d043e3" status: 200 len: 1332 microversion: 2.1 time: 0.301028 Oct 19 03:19:30.735849 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 933/1922] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:19:30 2022] GET /compute/v2.1/servers/c6e2a8e3-4589-4037-b0d8-032541d043e3 => generated 1332 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:19:30.754801 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7209b702-a156-499b-a567-86a10653fc30 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac711151c0334c62958e7f2ec431d860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5d239ae4b24b7e978935fe9b3458cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:19:30.756831 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1d007fae-7972-49dd-a7e5-2558e34a5623 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:30.757492 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1d007fae-7972-49dd-a7e5-2558e34a5623 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] [instance: 951e236c-943a-4f8c-956d-ac7bbbf0e0e1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:19:30.764761 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1d007fae-7972-49dd-a7e5-2558e34a5623 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:30.765926 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1d007fae-7972-49dd-a7e5-2558e34a5623 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:30.766562 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1d007fae-7972-49dd-a7e5-2558e34a5623 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:30.766988 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7209b702-a156-499b-a567-86a10653fc30 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] 10.222.0.52 "GET /compute/v2.1/servers/b97f61ab-18fc-4cf6-bc15-ec08ac4750fd" status: 200 len: 1224 microversion: 2.1 time: 0.104837 Oct 19 03:19:30.767590 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 990/1923] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:19:30 2022] GET /compute/v2.1/servers/b97f61ab-18fc-4cf6-bc15-ec08ac4750fd => generated 1224 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:19:30.767795 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1d007fae-7972-49dd-a7e5-2558e34a5623 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:30.768423 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1d007fae-7972-49dd-a7e5-2558e34a5623 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:30.769009 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1d007fae-7972-49dd-a7e5-2558e34a5623 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:30.772389 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-af8f7e87-457b-48e0-8658-bd3ae4ec0796 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:30.772893 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-af8f7e87-457b-48e0-8658-bd3ae4ec0796 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 62133546-4a75-4532-81ab-0c49c9252e85] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:19:30.791159 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-af8f7e87-457b-48e0-8658-bd3ae4ec0796 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:30.791657 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-af8f7e87-457b-48e0-8658-bd3ae4ec0796 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:30.793791 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-af8f7e87-457b-48e0-8658-bd3ae4ec0796 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:30.794526 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-af8f7e87-457b-48e0-8658-bd3ae4ec0796 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:30.799161 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-af8f7e87-457b-48e0-8658-bd3ae4ec0796 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:30.799631 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-af8f7e87-457b-48e0-8658-bd3ae4ec0796 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:30.991584 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-1d007fae-7972-49dd-a7e5-2558e34a5623 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ec45c74dcd448e924be40b1abfbc4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce8d13fab4fe4725a4759519818113f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:19:31.004875 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1d007fae-7972-49dd-a7e5-2558e34a5623 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] 10.222.0.52 "GET /compute/v2.1/servers/951e236c-943a-4f8c-956d-ac7bbbf0e0e1" status: 200 len: 1293 microversion: 2.1 time: 0.267661 Oct 19 03:19:31.014685 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 934/1924] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:19:30 2022] GET /compute/v2.1/servers/951e236c-943a-4f8c-956d-ac7bbbf0e0e1 => generated 1293 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:19:31.039953 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-af8f7e87-457b-48e0-8658-bd3ae4ec0796 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lazy-loading 'services' on Instance uuid 62133546-4a75-4532-81ab-0c49c9252e85 {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:19:31.042045 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d7791ed6-a6bd-4eb2-a5cb-ad52cb93cca8 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:31.060130 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d7791ed6-a6bd-4eb2-a5cb-ad52cb93cca8 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] [instance: e6c35da0-28b7-4556-b4de-32fbfa213265] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:19:31.063991 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d7791ed6-a6bd-4eb2-a5cb-ad52cb93cca8 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:31.064690 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d7791ed6-a6bd-4eb2-a5cb-ad52cb93cca8 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:31.065317 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d7791ed6-a6bd-4eb2-a5cb-ad52cb93cca8 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:31.066352 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d7791ed6-a6bd-4eb2-a5cb-ad52cb93cca8 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:31.067037 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d7791ed6-a6bd-4eb2-a5cb-ad52cb93cca8 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:31.067647 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d7791ed6-a6bd-4eb2-a5cb-ad52cb93cca8 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:31.120644 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=100 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:19:31.355286 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d7791ed6-a6bd-4eb2-a5cb-ad52cb93cca8 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d696202812644f3b1bcb8825fc57420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facc0913093743d1a5c4c0eb673ce532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:19:31.371697 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d7791ed6-a6bd-4eb2-a5cb-ad52cb93cca8 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] 10.222.0.52 "GET /compute/v2.1/servers/e6c35da0-28b7-4556-b4de-32fbfa213265" status: 200 len: 1497 microversion: 2.1 time: 0.337913 Oct 19 03:19:31.379684 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 935/1925] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:19:31 2022] GET /compute/v2.1/servers/e6c35da0-28b7-4556-b4de-32fbfa213265 => generated 1497 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:19:31.396960 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-bb9fc0fa-87b9-486e-9b2f-cadb76e117c3 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:31.433605 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.compute.server_groups [None req-bb9fc0fa-87b9-486e-9b2f-cadb76e117c3 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Querying cell d204a9a6-30d3-4569-8922-0d4cbe966b78(cell1) for 1 instances {{(pid=121134) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 19 03:19:31.433605 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bb9fc0fa-87b9-486e-9b2f-cadb76e117c3 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:31.433605 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bb9fc0fa-87b9-486e-9b2f-cadb76e117c3 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:31.433605 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bb9fc0fa-87b9-486e-9b2f-cadb76e117c3 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:31.470968 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-bb9fc0fa-87b9-486e-9b2f-cadb76e117c3 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] 10.222.0.52 "GET /compute/v2.1/os-server-groups/ace44ace-7b31-4c74-a514-9477f4bf86cd" status: 200 len: 222 microversion: 2.1 time: 0.074943 Oct 19 03:19:31.483543 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 936/1926] 10.222.0.52 () {58 vars in 1263 bytes} [Wed Oct 19 03:19:31 2022] GET /compute/v2.1/os-server-groups/ace44ace-7b31-4c74-a514-9477f4bf86cd => generated 222 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:19:31.491110 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-690648a0-8599-46ff-a157-2db7eebac5f9 req-e976db95-55ac-4c03-9f9b-a77980b259e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6e2a8e3-4589-4037-b0d8-032541d043e3", "name": "network-vif-plugged", "status": "completed", "tag": "b8014d15-27b1-4267-af57-17ae32c38543"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:19:31.511053 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-af8f7e87-457b-48e0-8658-bd3ae4ec0796 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "DELETE /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85/os-volume_attachments/17b87dbc-6669-4eea-8547-0fdfea7ce804" status: 202 len: 0 microversion: 2.25 time: 0.740216 Oct 19 03:19:31.514214 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 991/1927] 10.222.0.52 () {60 vars in 1457 bytes} [Wed Oct 19 03:19:30 2022] DELETE /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85/os-volume_attachments/17b87dbc-6669-4eea-8547-0fdfea7ce804 => generated 0 bytes in 745 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:19:31.523776 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-398fb279-450d-4b19-aa13-66900673576e tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:31.528809 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-398fb279-450d-4b19-aa13-66900673576e tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] [instance: d6d507e4-3a53-4734-bb88-8fc38efa4d9b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:19:31.533485 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-690648a0-8599-46ff-a157-2db7eebac5f9 req-e976db95-55ac-4c03-9f9b-a77980b259e0 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:31.536770 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-690648a0-8599-46ff-a157-2db7eebac5f9 req-e976db95-55ac-4c03-9f9b-a77980b259e0 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:31.536770 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-690648a0-8599-46ff-a157-2db7eebac5f9 req-e976db95-55ac-4c03-9f9b-a77980b259e0 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:31.542823 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-398fb279-450d-4b19-aa13-66900673576e tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:31.544346 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-398fb279-450d-4b19-aa13-66900673576e tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:31.544798 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-398fb279-450d-4b19-aa13-66900673576e tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:31.546953 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-398fb279-450d-4b19-aa13-66900673576e tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:31.549680 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-398fb279-450d-4b19-aa13-66900673576e tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:31.551421 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-398fb279-450d-4b19-aa13-66900673576e tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:31.555437 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-690648a0-8599-46ff-a157-2db7eebac5f9 req-e976db95-55ac-4c03-9f9b-a77980b259e0 service nova] Creating event network-vif-plugged:b8014d15-27b1-4267-af57-17ae32c38543 for instance c6e2a8e3-4589-4037-b0d8-032541d043e3 on n-h1-861333-8 Oct 19 03:19:31.572514 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-690648a0-8599-46ff-a157-2db7eebac5f9 req-e976db95-55ac-4c03-9f9b-a77980b259e0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087132 Oct 19 03:19:31.576937 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 937/1928] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:19:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:19:31.607174 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e9347401-f0b4-42f0-bff9-4b2ae34e6296 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:31.624980 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e9347401-f0b4-42f0-bff9-4b2ae34e6296 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] [instance: e6c35da0-28b7-4556-b4de-32fbfa213265] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:19:31.660008 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e9347401-f0b4-42f0-bff9-4b2ae34e6296 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:31.660513 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e9347401-f0b4-42f0-bff9-4b2ae34e6296 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:31.660953 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e9347401-f0b4-42f0-bff9-4b2ae34e6296 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:31.661693 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e9347401-f0b4-42f0-bff9-4b2ae34e6296 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:31.662430 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e9347401-f0b4-42f0-bff9-4b2ae34e6296 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:31.662863 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e9347401-f0b4-42f0-bff9-4b2ae34e6296 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:31.706959 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e9347401-f0b4-42f0-bff9-4b2ae34e6296 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] [instance: e6c35da0-28b7-4556-b4de-32fbfa213265] Going to try to terminate instance {{(pid=121134) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:19:31.798108 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-398fb279-450d-4b19-aa13-66900673576e tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8824f20e6a1f478a99f90e1ba8f028fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e436373e9e45efa03f08b33da619e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:19:31.823276 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-398fb279-450d-4b19-aa13-66900673576e tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] 10.222.0.52 "GET /compute/v2.1/servers/d6d507e4-3a53-4734-bb88-8fc38efa4d9b" status: 200 len: 1324 microversion: 2.1 time: 0.301335 Oct 19 03:19:31.823276 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 992/1929] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:19:31 2022] GET /compute/v2.1/servers/d6d507e4-3a53-4734-bb88-8fc38efa4d9b => generated 1324 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:19:31.823529 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-61b6fda8-8eb5-4a5a-8df1-5bb0522e38e3 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:31.826010 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-61b6fda8-8eb5-4a5a-8df1-5bb0522e38e3 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 62133546-4a75-4532-81ab-0c49c9252e85] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:19:31.833516 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-61b6fda8-8eb5-4a5a-8df1-5bb0522e38e3 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:31.834429 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-61b6fda8-8eb5-4a5a-8df1-5bb0522e38e3 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:31.835132 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-61b6fda8-8eb5-4a5a-8df1-5bb0522e38e3 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:31.836095 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-61b6fda8-8eb5-4a5a-8df1-5bb0522e38e3 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:31.836781 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-61b6fda8-8eb5-4a5a-8df1-5bb0522e38e3 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:31.837487 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-61b6fda8-8eb5-4a5a-8df1-5bb0522e38e3 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:31.873909 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:19:31.885801 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-61b6fda8-8eb5-4a5a-8df1-5bb0522e38e3 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.067118 Oct 19 03:19:31.888619 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 993/1930] 10.222.0.52 () {60 vars in 1343 bytes} [Wed Oct 19 03:19:31 2022] GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 03:19:31.896952 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-78d27ed7-2f20-4073-9cce-92c6e36e88bb tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:31.898069 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-78d27ed7-2f20-4073-9cce-92c6e36e88bb tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] [instance: c6e2a8e3-4589-4037-b0d8-032541d043e3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:19:31.904462 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-78d27ed7-2f20-4073-9cce-92c6e36e88bb tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:31.909829 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-78d27ed7-2f20-4073-9cce-92c6e36e88bb tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:31.909829 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-78d27ed7-2f20-4073-9cce-92c6e36e88bb tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:31.909829 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-78d27ed7-2f20-4073-9cce-92c6e36e88bb tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:31.910152 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-78d27ed7-2f20-4073-9cce-92c6e36e88bb tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:31.910152 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-78d27ed7-2f20-4073-9cce-92c6e36e88bb tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:32.071845 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e9347401-f0b4-42f0-bff9-4b2ae34e6296 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] 10.222.0.52 "DELETE /compute/v2.1/servers/e6c35da0-28b7-4556-b4de-32fbfa213265" status: 204 len: 0 microversion: 2.1 time: 0.495462 Oct 19 03:19:32.072828 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 938/1931] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:19:31 2022] DELETE /compute/v2.1/servers/e6c35da0-28b7-4556-b4de-32fbfa213265 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:19:32.079693 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-29fa6386-7afd-4a5e-935c-d5010ca8fd43 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:32.083020 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-29fa6386-7afd-4a5e-935c-d5010ca8fd43 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] [instance: b97f61ab-18fc-4cf6-bc15-ec08ac4750fd] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:19:32.096905 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-29fa6386-7afd-4a5e-935c-d5010ca8fd43 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:32.097427 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-29fa6386-7afd-4a5e-935c-d5010ca8fd43 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:32.097872 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-29fa6386-7afd-4a5e-935c-d5010ca8fd43 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:32.098594 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-29fa6386-7afd-4a5e-935c-d5010ca8fd43 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:32.099052 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-29fa6386-7afd-4a5e-935c-d5010ca8fd43 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:32.100099 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-29fa6386-7afd-4a5e-935c-d5010ca8fd43 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:32.196824 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-29fa6386-7afd-4a5e-935c-d5010ca8fd43 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac711151c0334c62958e7f2ec431d860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5d239ae4b24b7e978935fe9b3458cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:19:32.202501 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-78d27ed7-2f20-4073-9cce-92c6e36e88bb tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8920755dc8594da4b57f3ecc920db95d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be25c3ef65114ccc83b335b938743e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:19:32.206065 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-29fa6386-7afd-4a5e-935c-d5010ca8fd43 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] 10.222.0.52 "GET /compute/v2.1/servers/b97f61ab-18fc-4cf6-bc15-ec08ac4750fd" status: 200 len: 1228 microversion: 2.1 time: 0.130996 Oct 19 03:19:32.217694 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-78d27ed7-2f20-4073-9cce-92c6e36e88bb tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] 10.222.0.52 "GET /compute/v2.1/servers/c6e2a8e3-4589-4037-b0d8-032541d043e3" status: 200 len: 1332 microversion: 2.1 time: 0.326823 Oct 19 03:19:32.221536 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 939/1932] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:19:32 2022] GET /compute/v2.1/servers/b97f61ab-18fc-4cf6-bc15-ec08ac4750fd => generated 1228 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:19:32.226357 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 994/1933] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:19:31 2022] GET /compute/v2.1/servers/c6e2a8e3-4589-4037-b0d8-032541d043e3 => generated 1332 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:19:32.227179 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-afae11fd-cca5-4a0a-b8e3-b235a6313308 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:32.228064 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-afae11fd-cca5-4a0a-b8e3-b235a6313308 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] [instance: 951e236c-943a-4f8c-956d-ac7bbbf0e0e1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:19:32.236198 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0111e74d-6796-4bc0-9f12-2d91d0bcf8ff tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:32.240405 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0111e74d-6796-4bc0-9f12-2d91d0bcf8ff tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] [instance: e6c35da0-28b7-4556-b4de-32fbfa213265] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:19:32.251662 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0111e74d-6796-4bc0-9f12-2d91d0bcf8ff tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:32.251818 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-afae11fd-cca5-4a0a-b8e3-b235a6313308 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:32.252593 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-afae11fd-cca5-4a0a-b8e3-b235a6313308 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:32.253279 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-afae11fd-cca5-4a0a-b8e3-b235a6313308 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:32.254590 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-afae11fd-cca5-4a0a-b8e3-b235a6313308 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:32.255297 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-afae11fd-cca5-4a0a-b8e3-b235a6313308 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:32.256464 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0111e74d-6796-4bc0-9f12-2d91d0bcf8ff tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:32.256908 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-afae11fd-cca5-4a0a-b8e3-b235a6313308 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:32.257072 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0111e74d-6796-4bc0-9f12-2d91d0bcf8ff tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:32.258235 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0111e74d-6796-4bc0-9f12-2d91d0bcf8ff tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:32.258867 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0111e74d-6796-4bc0-9f12-2d91d0bcf8ff tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:32.262227 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0111e74d-6796-4bc0-9f12-2d91d0bcf8ff tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:32.644942 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-afae11fd-cca5-4a0a-b8e3-b235a6313308 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ec45c74dcd448e924be40b1abfbc4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce8d13fab4fe4725a4759519818113f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:19:32.648883 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-0111e74d-6796-4bc0-9f12-2d91d0bcf8ff tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d696202812644f3b1bcb8825fc57420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facc0913093743d1a5c4c0eb673ce532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:19:32.654820 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-afae11fd-cca5-4a0a-b8e3-b235a6313308 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] 10.222.0.52 "GET /compute/v2.1/servers/951e236c-943a-4f8c-956d-ac7bbbf0e0e1" status: 200 len: 1293 microversion: 2.1 time: 0.431305 Oct 19 03:19:32.656511 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 940/1934] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:19:32 2022] GET /compute/v2.1/servers/951e236c-943a-4f8c-956d-ac7bbbf0e0e1 => generated 1293 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:19:32.659404 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0111e74d-6796-4bc0-9f12-2d91d0bcf8ff tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] 10.222.0.52 "GET /compute/v2.1/servers/e6c35da0-28b7-4556-b4de-32fbfa213265" status: 200 len: 1503 microversion: 2.1 time: 0.431957 Oct 19 03:19:32.659987 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 995/1935] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:19:32 2022] GET /compute/v2.1/servers/e6c35da0-28b7-4556-b4de-32fbfa213265 => generated 1503 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:19:32.845419 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-645147f4-7c46-43f0-9ca2-ead674f70293 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:32.846456 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-645147f4-7c46-43f0-9ca2-ead674f70293 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] [instance: d6d507e4-3a53-4734-bb88-8fc38efa4d9b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:19:32.855694 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-645147f4-7c46-43f0-9ca2-ead674f70293 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:32.861505 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-645147f4-7c46-43f0-9ca2-ead674f70293 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:32.861505 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-645147f4-7c46-43f0-9ca2-ead674f70293 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:32.861505 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-645147f4-7c46-43f0-9ca2-ead674f70293 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:32.861505 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-645147f4-7c46-43f0-9ca2-ead674f70293 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:32.861933 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-645147f4-7c46-43f0-9ca2-ead674f70293 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:32.903190 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-08f56b6a-36a4-4e95-838f-85c4d273b652 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:32.905319 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-08f56b6a-36a4-4e95-838f-85c4d273b652 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 62133546-4a75-4532-81ab-0c49c9252e85] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:19:32.916201 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-08f56b6a-36a4-4e95-838f-85c4d273b652 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:32.916690 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-08f56b6a-36a4-4e95-838f-85c4d273b652 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:32.917128 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-08f56b6a-36a4-4e95-838f-85c4d273b652 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:32.917856 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-08f56b6a-36a4-4e95-838f-85c4d273b652 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:32.918304 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-08f56b6a-36a4-4e95-838f-85c4d273b652 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:32.918723 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-08f56b6a-36a4-4e95-838f-85c4d273b652 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:32.986513 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-08f56b6a-36a4-4e95-838f-85c4d273b652 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.087203 Oct 19 03:19:32.989715 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 996/1936] 10.222.0.52 () {60 vars in 1343 bytes} [Wed Oct 19 03:19:32 2022] GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 03:19:33.168855 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-645147f4-7c46-43f0-9ca2-ead674f70293 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8824f20e6a1f478a99f90e1ba8f028fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e436373e9e45efa03f08b33da619e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:19:33.176800 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-645147f4-7c46-43f0-9ca2-ead674f70293 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] 10.222.0.52 "GET /compute/v2.1/servers/d6d507e4-3a53-4734-bb88-8fc38efa4d9b" status: 200 len: 1324 microversion: 2.1 time: 0.337535 Oct 19 03:19:33.190057 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 941/1937] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:19:32 2022] GET /compute/v2.1/servers/d6d507e4-3a53-4734-bb88-8fc38efa4d9b => generated 1324 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:19:33.232271 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d348376c-43ed-482d-a636-c4594ab63214 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:33.233124 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d348376c-43ed-482d-a636-c4594ab63214 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] [instance: b97f61ab-18fc-4cf6-bc15-ec08ac4750fd] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:19:33.244387 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d348376c-43ed-482d-a636-c4594ab63214 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:33.245152 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d348376c-43ed-482d-a636-c4594ab63214 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:33.245973 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d348376c-43ed-482d-a636-c4594ab63214 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:33.246921 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d348376c-43ed-482d-a636-c4594ab63214 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:33.247569 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d348376c-43ed-482d-a636-c4594ab63214 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:33.248155 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d348376c-43ed-482d-a636-c4594ab63214 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:33.359831 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d348376c-43ed-482d-a636-c4594ab63214 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac711151c0334c62958e7f2ec431d860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5d239ae4b24b7e978935fe9b3458cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:19:33.376155 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d348376c-43ed-482d-a636-c4594ab63214 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] 10.222.0.52 "GET /compute/v2.1/servers/b97f61ab-18fc-4cf6-bc15-ec08ac4750fd" status: 200 len: 1220 microversion: 2.1 time: 0.147852 Oct 19 03:19:33.377678 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 942/1938] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:19:33 2022] GET /compute/v2.1/servers/b97f61ab-18fc-4cf6-bc15-ec08ac4750fd => generated 1220 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:19:33.403655 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-54471fcc-870e-4079-a795-e8eed6f7976f tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:33.412010 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-54471fcc-870e-4079-a795-e8eed6f7976f tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] [instance: c6e2a8e3-4589-4037-b0d8-032541d043e3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:19:33.425235 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-54471fcc-870e-4079-a795-e8eed6f7976f tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:33.426392 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-54471fcc-870e-4079-a795-e8eed6f7976f tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:33.426748 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-54471fcc-870e-4079-a795-e8eed6f7976f tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:33.428021 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-54471fcc-870e-4079-a795-e8eed6f7976f tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:33.435259 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-54471fcc-870e-4079-a795-e8eed6f7976f tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:33.435891 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-54471fcc-870e-4079-a795-e8eed6f7976f tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:33.452293 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a9b63875-de3e-49ca-a129-c47baf644322 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1908201195", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:19:33.519085 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.network.neutron [None req-a9b63875-de3e-49ca-a129-c47baf644322 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] validate_networks() for None {{(pid=121135) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:19:33.751318 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-54471fcc-870e-4079-a795-e8eed6f7976f tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8920755dc8594da4b57f3ecc920db95d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be25c3ef65114ccc83b335b938743e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:19:33.775772 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-54471fcc-870e-4079-a795-e8eed6f7976f tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] 10.222.0.52 "GET /compute/v2.1/servers/c6e2a8e3-4589-4037-b0d8-032541d043e3" status: 200 len: 1332 microversion: 2.1 time: 0.382192 Oct 19 03:19:33.778019 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 943/1939] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:19:33 2022] GET /compute/v2.1/servers/c6e2a8e3-4589-4037-b0d8-032541d043e3 => generated 1332 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:19:33.784395 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-82a2eb21-c30e-42ae-80a9-c384a8497e2a req-7ab63009-17cb-467a-ae6f-a9dc5d61b13a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6d507e4-3a53-4734-bb88-8fc38efa4d9b", "tag": "c233e8b9-5426-4564-90a1-f4bfcb4d3a76"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:19:33.799089 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-82a2eb21-c30e-42ae-80a9-c384a8497e2a req-7ab63009-17cb-467a-ae6f-a9dc5d61b13a service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:33.799984 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-82a2eb21-c30e-42ae-80a9-c384a8497e2a req-7ab63009-17cb-467a-ae6f-a9dc5d61b13a service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:33.800664 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-82a2eb21-c30e-42ae-80a9-c384a8497e2a req-7ab63009-17cb-467a-ae6f-a9dc5d61b13a service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:33.818058 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-82a2eb21-c30e-42ae-80a9-c384a8497e2a req-7ab63009-17cb-467a-ae6f-a9dc5d61b13a service nova] Creating event network-changed:c233e8b9-5426-4564-90a1-f4bfcb4d3a76 for instance d6d507e4-3a53-4734-bb88-8fc38efa4d9b on n-h2-861333-8 Oct 19 03:19:33.825857 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-82a2eb21-c30e-42ae-80a9-c384a8497e2a req-7ab63009-17cb-467a-ae6f-a9dc5d61b13a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045953 Oct 19 03:19:33.827652 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 944/1940] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:19:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:19:33.836667 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-54b30a8d-6500-40cd-b509-9f5f09acf1ef tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:33.838746 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-54b30a8d-6500-40cd-b509-9f5f09acf1ef tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] [instance: 951e236c-943a-4f8c-956d-ac7bbbf0e0e1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:19:33.850814 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-54b30a8d-6500-40cd-b509-9f5f09acf1ef tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:33.851551 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-54b30a8d-6500-40cd-b509-9f5f09acf1ef tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:33.852219 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-54b30a8d-6500-40cd-b509-9f5f09acf1ef tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:33.853268 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-54b30a8d-6500-40cd-b509-9f5f09acf1ef tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:33.853967 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-54b30a8d-6500-40cd-b509-9f5f09acf1ef tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:33.854505 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-54b30a8d-6500-40cd-b509-9f5f09acf1ef tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:33.875113 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-a9b63875-de3e-49ca-a129-c47baf644322 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Flavor limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:19:33.875964 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-a9b63875-de3e-49ca-a129-c47baf644322 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Image limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:19:33.876609 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-a9b63875-de3e-49ca-a129-c47baf644322 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Flavor pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:19:33.877204 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-a9b63875-de3e-49ca-a129-c47baf644322 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Image pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:19:33.877825 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-a9b63875-de3e-49ca-a129-c47baf644322 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:19:33.888209 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a9b63875-de3e-49ca-a129-c47baf644322 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:33.888958 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a9b63875-de3e-49ca-a129-c47baf644322 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:33.889612 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a9b63875-de3e-49ca-a129-c47baf644322 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:33.890797 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a9b63875-de3e-49ca-a129-c47baf644322 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:33.891413 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a9b63875-de3e-49ca-a129-c47baf644322 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:33.892032 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a9b63875-de3e-49ca-a129-c47baf644322 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:33.911266 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-a9b63875-de3e-49ca-a129-c47baf644322 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Getting quotas for project c9a495ccfced47f29cb928d1ded20d85. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:19:33.917550 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-a9b63875-de3e-49ca-a129-c47baf644322 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Getting quotas for user ce4c5e4123c44508a5d4911a17c44231 and project c9a495ccfced47f29cb928d1ded20d85. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:19:33.934828 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a9b63875-de3e-49ca-a129-c47baf644322 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Going to run 1 instances... {{(pid=121135) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:19:33.938387 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a9b63875-de3e-49ca-a129-c47baf644322 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] [instance: 6888c8db-82ba-4072-b431-8d4fcf5f03e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121135) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:19:34.095610 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a9b63875-de3e-49ca-a129-c47baf644322 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.873481 Oct 19 03:19:34.109549 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-54b30a8d-6500-40cd-b509-9f5f09acf1ef tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ec45c74dcd448e924be40b1abfbc4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce8d13fab4fe4725a4759519818113f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:19:34.110456 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 997/1941] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:19:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 879 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 03:19:34.129018 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0ce5d5ba-b787-4397-876a-339494c70bca tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:34.133797 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-54b30a8d-6500-40cd-b509-9f5f09acf1ef tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] 10.222.0.52 "GET /compute/v2.1/servers/951e236c-943a-4f8c-956d-ac7bbbf0e0e1" status: 200 len: 1293 microversion: 2.1 time: 0.304618 Oct 19 03:19:34.136492 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 945/1942] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:19:33 2022] GET /compute/v2.1/servers/951e236c-943a-4f8c-956d-ac7bbbf0e0e1 => generated 1293 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:19:34.146754 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0ce5d5ba-b787-4397-876a-339494c70bca tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] [instance: e6c35da0-28b7-4556-b4de-32fbfa213265] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:19:34.154433 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7889ef4c-7718-4d69-bc6c-1b859ecfa0e2 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:34.170605 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0ce5d5ba-b787-4397-876a-339494c70bca tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:34.171147 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0ce5d5ba-b787-4397-876a-339494c70bca tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:34.171591 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0ce5d5ba-b787-4397-876a-339494c70bca tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:34.172298 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0ce5d5ba-b787-4397-876a-339494c70bca tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:34.172751 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0ce5d5ba-b787-4397-876a-339494c70bca tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:34.173516 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7889ef4c-7718-4d69-bc6c-1b859ecfa0e2 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 62133546-4a75-4532-81ab-0c49c9252e85] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:19:34.182947 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0ce5d5ba-b787-4397-876a-339494c70bca tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:34.183535 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7889ef4c-7718-4d69-bc6c-1b859ecfa0e2 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:34.184034 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7889ef4c-7718-4d69-bc6c-1b859ecfa0e2 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:34.184469 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7889ef4c-7718-4d69-bc6c-1b859ecfa0e2 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:34.190528 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7889ef4c-7718-4d69-bc6c-1b859ecfa0e2 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:34.192897 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7889ef4c-7718-4d69-bc6c-1b859ecfa0e2 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:34.193940 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7889ef4c-7718-4d69-bc6c-1b859ecfa0e2 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:34.269060 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7889ef4c-7718-4d69-bc6c-1b859ecfa0e2 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.129286 Oct 19 03:19:34.270632 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 946/1943] 10.222.0.52 () {60 vars in 1343 bytes} [Wed Oct 19 03:19:34 2022] GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85/os-volume_attachments => generated 197 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 03:19:34.281192 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5c77d60c-08b3-43b3-baa3-fe0bb5d7f61a tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1134745684", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:19:34.458613 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-5c77d60c-08b3-43b3-baa3-fe0bb5d7f61a tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] validate_networks() for None {{(pid=121134) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:19:34.494317 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-0ce5d5ba-b787-4397-876a-339494c70bca tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d696202812644f3b1bcb8825fc57420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facc0913093743d1a5c4c0eb673ce532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:19:34.502752 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0ce5d5ba-b787-4397-876a-339494c70bca tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] 10.222.0.52 "GET /compute/v2.1/servers/e6c35da0-28b7-4556-b4de-32fbfa213265" status: 200 len: 1503 microversion: 2.1 time: 0.401335 Oct 19 03:19:34.518617 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 998/1944] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:19:34 2022] GET /compute/v2.1/servers/e6c35da0-28b7-4556-b4de-32fbfa213265 => generated 1503 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:19:34.531514 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ec67eee3-606f-4020-a946-1b6ea104725d tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:34.532128 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ec67eee3-606f-4020-a946-1b6ea104725d tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] [instance: d6d507e4-3a53-4734-bb88-8fc38efa4d9b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:19:34.549925 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ec67eee3-606f-4020-a946-1b6ea104725d tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:34.550430 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ec67eee3-606f-4020-a946-1b6ea104725d tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:34.552413 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ec67eee3-606f-4020-a946-1b6ea104725d tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:34.552413 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ec67eee3-606f-4020-a946-1b6ea104725d tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:34.552413 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ec67eee3-606f-4020-a946-1b6ea104725d tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:34.552413 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ec67eee3-606f-4020-a946-1b6ea104725d tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:34.784560 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:19:34.825712 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=6 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:19:34.953757 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ec67eee3-606f-4020-a946-1b6ea104725d tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8824f20e6a1f478a99f90e1ba8f028fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e436373e9e45efa03f08b33da619e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:19:34.962967 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ec67eee3-606f-4020-a946-1b6ea104725d tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] 10.222.0.52 "GET /compute/v2.1/servers/d6d507e4-3a53-4734-bb88-8fc38efa4d9b" status: 200 len: 1324 microversion: 2.1 time: 0.443753 Oct 19 03:19:34.973637 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 999/1945] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:19:34 2022] GET /compute/v2.1/servers/d6d507e4-3a53-4734-bb88-8fc38efa4d9b => generated 1324 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:19:34.985147 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1966bcf3-3d8c-4121-ad5a-e1e5e9ebff90 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:34.985996 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1966bcf3-3d8c-4121-ad5a-e1e5e9ebff90 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] [instance: b97f61ab-18fc-4cf6-bc15-ec08ac4750fd] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:19:34.994049 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1966bcf3-3d8c-4121-ad5a-e1e5e9ebff90 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:34.994876 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1966bcf3-3d8c-4121-ad5a-e1e5e9ebff90 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:34.995552 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1966bcf3-3d8c-4121-ad5a-e1e5e9ebff90 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:34.996496 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1966bcf3-3d8c-4121-ad5a-e1e5e9ebff90 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:34.996968 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1966bcf3-3d8c-4121-ad5a-e1e5e9ebff90 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:34.997431 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1966bcf3-3d8c-4121-ad5a-e1e5e9ebff90 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:35.103094 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-1966bcf3-3d8c-4121-ad5a-e1e5e9ebff90 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac711151c0334c62958e7f2ec431d860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5d239ae4b24b7e978935fe9b3458cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:19:35.104231 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-5c77d60c-08b3-43b3-baa3-fe0bb5d7f61a tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Flavor limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:19:35.105246 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-5c77d60c-08b3-43b3-baa3-fe0bb5d7f61a tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Image limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:19:35.107292 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-5c77d60c-08b3-43b3-baa3-fe0bb5d7f61a tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Flavor pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:19:35.107786 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-5c77d60c-08b3-43b3-baa3-fe0bb5d7f61a tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Image pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:19:35.108709 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-5c77d60c-08b3-43b3-baa3-fe0bb5d7f61a tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:19:35.111089 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1966bcf3-3d8c-4121-ad5a-e1e5e9ebff90 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] 10.222.0.52 "GET /compute/v2.1/servers/b97f61ab-18fc-4cf6-bc15-ec08ac4750fd" status: 200 len: 1276 microversion: 2.1 time: 0.135547 Oct 19 03:19:35.111721 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1000/1946] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:19:34 2022] GET /compute/v2.1/servers/b97f61ab-18fc-4cf6-bc15-ec08ac4750fd => generated 1276 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:19:35.117076 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-df20851a-0329-426b-abd1-0aec20da1142 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:35.117971 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-df20851a-0329-426b-abd1-0aec20da1142 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] [instance: c6e2a8e3-4589-4037-b0d8-032541d043e3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:19:35.133006 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-df20851a-0329-426b-abd1-0aec20da1142 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:35.133833 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-df20851a-0329-426b-abd1-0aec20da1142 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:35.134342 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-df20851a-0329-426b-abd1-0aec20da1142 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:35.135285 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-df20851a-0329-426b-abd1-0aec20da1142 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:35.136102 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-df20851a-0329-426b-abd1-0aec20da1142 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:35.136534 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-df20851a-0329-426b-abd1-0aec20da1142 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:35.136822 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5c77d60c-08b3-43b3-baa3-fe0bb5d7f61a tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:35.137334 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5c77d60c-08b3-43b3-baa3-fe0bb5d7f61a tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:35.137801 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5c77d60c-08b3-43b3-baa3-fe0bb5d7f61a tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:35.145634 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5c77d60c-08b3-43b3-baa3-fe0bb5d7f61a tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:35.146339 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5c77d60c-08b3-43b3-baa3-fe0bb5d7f61a tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:35.146682 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5c77d60c-08b3-43b3-baa3-fe0bb5d7f61a tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:35.197421 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-5c77d60c-08b3-43b3-baa3-fe0bb5d7f61a tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Getting quotas for project c9a495ccfced47f29cb928d1ded20d85. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:19:35.199022 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:19:35.211771 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-5c77d60c-08b3-43b3-baa3-fe0bb5d7f61a tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Getting quotas for user ce4c5e4123c44508a5d4911a17c44231 and project c9a495ccfced47f29cb928d1ded20d85. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:19:35.239853 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5c77d60c-08b3-43b3-baa3-fe0bb5d7f61a tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Going to run 1 instances... {{(pid=121134) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:19:35.242775 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5c77d60c-08b3-43b3-baa3-fe0bb5d7f61a tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] [instance: 19fbcbe2-9039-4d18-94ef-51ce58cb6365] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:19:35.440183 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5c77d60c-08b3-43b3-baa3-fe0bb5d7f61a tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.168100 Oct 19 03:19:35.447467 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 947/1947] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:19:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1176 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 03:19:35.452888 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3eb33c3b-435b-494a-ae9f-1320786389a4 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:35.453758 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3eb33c3b-435b-494a-ae9f-1320786389a4 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] [instance: 951e236c-943a-4f8c-956d-ac7bbbf0e0e1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:19:35.478397 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3eb33c3b-435b-494a-ae9f-1320786389a4 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:35.480800 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3eb33c3b-435b-494a-ae9f-1320786389a4 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:35.481485 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3eb33c3b-435b-494a-ae9f-1320786389a4 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:35.484192 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3eb33c3b-435b-494a-ae9f-1320786389a4 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:35.484873 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3eb33c3b-435b-494a-ae9f-1320786389a4 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:35.487828 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3eb33c3b-435b-494a-ae9f-1320786389a4 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:35.547000 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-df20851a-0329-426b-abd1-0aec20da1142 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8920755dc8594da4b57f3ecc920db95d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be25c3ef65114ccc83b335b938743e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:19:35.563003 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-df20851a-0329-426b-abd1-0aec20da1142 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] 10.222.0.52 "GET /compute/v2.1/servers/c6e2a8e3-4589-4037-b0d8-032541d043e3" status: 200 len: 1536 microversion: 2.1 time: 0.450255 Oct 19 03:19:35.591822 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1001/1948] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:19:35 2022] GET /compute/v2.1/servers/c6e2a8e3-4589-4037-b0d8-032541d043e3 => generated 1536 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:19:35.597582 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-920f63f1-d1f5-4676-b98f-c4d8ad0870c9 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:35.600849 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-920f63f1-d1f5-4676-b98f-c4d8ad0870c9 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 62133546-4a75-4532-81ab-0c49c9252e85] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:19:35.608291 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-920f63f1-d1f5-4676-b98f-c4d8ad0870c9 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:35.609074 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-920f63f1-d1f5-4676-b98f-c4d8ad0870c9 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:35.609874 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-920f63f1-d1f5-4676-b98f-c4d8ad0870c9 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:35.611450 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-920f63f1-d1f5-4676-b98f-c4d8ad0870c9 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:35.612154 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-920f63f1-d1f5-4676-b98f-c4d8ad0870c9 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:35.612817 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-920f63f1-d1f5-4676-b98f-c4d8ad0870c9 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:35.678360 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-920f63f1-d1f5-4676-b98f-c4d8ad0870c9 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.084819 Oct 19 03:19:35.684378 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1002/1949] 10.222.0.52 () {60 vars in 1343 bytes} [Wed Oct 19 03:19:35 2022] GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 03:19:35.689395 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-59087953-f4fe-4f74-9283-385fae066297 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:35.694985 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-59087953-f4fe-4f74-9283-385fae066297 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] [instance: 19fbcbe2-9039-4d18-94ef-51ce58cb6365] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:19:35.726885 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-3eb33c3b-435b-494a-ae9f-1320786389a4 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ec45c74dcd448e924be40b1abfbc4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce8d13fab4fe4725a4759519818113f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:19:35.739730 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3eb33c3b-435b-494a-ae9f-1320786389a4 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] 10.222.0.52 "GET /compute/v2.1/servers/951e236c-943a-4f8c-956d-ac7bbbf0e0e1" status: 200 len: 1293 microversion: 2.1 time: 0.290829 Oct 19 03:19:35.741206 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 948/1950] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:19:35 2022] GET /compute/v2.1/servers/951e236c-943a-4f8c-956d-ac7bbbf0e0e1 => generated 1293 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:19:35.757228 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5bd88006-14e4-4434-82bf-6f2b3e824452 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:35.758182 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5bd88006-14e4-4434-82bf-6f2b3e824452 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] [instance: e6c35da0-28b7-4556-b4de-32fbfa213265] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:19:35.782024 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5bd88006-14e4-4434-82bf-6f2b3e824452 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:35.788953 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5bd88006-14e4-4434-82bf-6f2b3e824452 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:35.794741 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5bd88006-14e4-4434-82bf-6f2b3e824452 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:35.795817 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5bd88006-14e4-4434-82bf-6f2b3e824452 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:35.801783 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5bd88006-14e4-4434-82bf-6f2b3e824452 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:35.808701 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5bd88006-14e4-4434-82bf-6f2b3e824452 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:35.875771 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-59087953-f4fe-4f74-9283-385fae066297 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4c5e4123c44508a5d4911a17c44231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a495ccfced47f29cb928d1ded20d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:19:35.887100 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-59087953-f4fe-4f74-9283-385fae066297 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] 10.222.0.52 "GET /compute/v2.1/servers/19fbcbe2-9039-4d18-94ef-51ce58cb6365" status: 200 len: 1214 microversion: 2.1 time: 0.198126 Oct 19 03:19:35.893596 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1003/1951] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:19:35 2022] GET /compute/v2.1/servers/19fbcbe2-9039-4d18-94ef-51ce58cb6365 => generated 1214 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:19:35.902102 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6fa7229c-5544-4d41-b4df-ec1cc5d7be0a tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Action: 'create', calling method: .version_select at 0x7fc130bbcc10>, body: {"pool": "1475da2c-80a2-478b-b6c8-7f7c0e5426d1"} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:19:35.983408 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5bd88006-14e4-4434-82bf-6f2b3e824452 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d696202812644f3b1bcb8825fc57420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facc0913093743d1a5c4c0eb673ce532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:19:35.996540 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5bd88006-14e4-4434-82bf-6f2b3e824452 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] 10.222.0.52 "GET /compute/v2.1/servers/e6c35da0-28b7-4556-b4de-32fbfa213265" status: 200 len: 1461 microversion: 2.1 time: 0.253945 Oct 19 03:19:35.997393 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 949/1952] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:19:35 2022] GET /compute/v2.1/servers/e6c35da0-28b7-4556-b4de-32fbfa213265 => generated 1461 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:19:36.008068 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-f6d51b73-2896-48df-8f38-dbf22046557e req-70eb3721-a2d7-4865-b27a-6308dc8145e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6c35da0-28b7-4556-b4de-32fbfa213265", "name": "network-vif-deleted", "tag": "55ef4d1c-7d52-4a39-a1bb-4b98c02200e7"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:19:36.032937 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-f6d51b73-2896-48df-8f38-dbf22046557e req-70eb3721-a2d7-4865-b27a-6308dc8145e7 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:36.033341 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-f6d51b73-2896-48df-8f38-dbf22046557e req-70eb3721-a2d7-4865-b27a-6308dc8145e7 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:36.034963 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-f6d51b73-2896-48df-8f38-dbf22046557e req-70eb3721-a2d7-4865-b27a-6308dc8145e7 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:36.065071 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-f6d51b73-2896-48df-8f38-dbf22046557e req-70eb3721-a2d7-4865-b27a-6308dc8145e7 service nova] Creating event network-vif-deleted:55ef4d1c-7d52-4a39-a1bb-4b98c02200e7 for instance e6c35da0-28b7-4556-b4de-32fbfa213265 on n-h1-861333-8 Oct 19 03:19:36.101933 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-f6d51b73-2896-48df-8f38-dbf22046557e req-70eb3721-a2d7-4865-b27a-6308dc8145e7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100390 Oct 19 03:19:36.103878 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 950/1953] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:19:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:19:36.112416 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-df514abe-5ccd-4299-8c0a-f25df28af870 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:36.113650 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-df514abe-5ccd-4299-8c0a-f25df28af870 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] [instance: d6d507e4-3a53-4734-bb88-8fc38efa4d9b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:19:36.120619 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-df514abe-5ccd-4299-8c0a-f25df28af870 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:36.121337 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-df514abe-5ccd-4299-8c0a-f25df28af870 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:36.122074 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-df514abe-5ccd-4299-8c0a-f25df28af870 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:36.122973 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-df514abe-5ccd-4299-8c0a-f25df28af870 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:36.123598 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-df514abe-5ccd-4299-8c0a-f25df28af870 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:36.124192 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-df514abe-5ccd-4299-8c0a-f25df28af870 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:37.057941 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-df514abe-5ccd-4299-8c0a-f25df28af870 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8824f20e6a1f478a99f90e1ba8f028fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e436373e9e45efa03f08b33da619e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:19:37.067862 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-df514abe-5ccd-4299-8c0a-f25df28af870 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] 10.222.0.52 "GET /compute/v2.1/servers/d6d507e4-3a53-4734-bb88-8fc38efa4d9b" status: 200 len: 1324 microversion: 2.1 time: 0.961246 Oct 19 03:19:37.070011 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 951/1954] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:19:36 2022] GET /compute/v2.1/servers/d6d507e4-3a53-4734-bb88-8fc38efa4d9b => generated 1324 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:19:37.085715 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-31815901-797b-45b2-b04c-b09b63dec911 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:37.086285 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-31815901-797b-45b2-b04c-b09b63dec911 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] [instance: b97f61ab-18fc-4cf6-bc15-ec08ac4750fd] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:19:37.096417 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-31815901-797b-45b2-b04c-b09b63dec911 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:37.101164 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-31815901-797b-45b2-b04c-b09b63dec911 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:37.102154 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-31815901-797b-45b2-b04c-b09b63dec911 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:37.102474 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-31815901-797b-45b2-b04c-b09b63dec911 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:37.103219 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-31815901-797b-45b2-b04c-b09b63dec911 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:37.103815 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-31815901-797b-45b2-b04c-b09b63dec911 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:37.314318 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-31815901-797b-45b2-b04c-b09b63dec911 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac711151c0334c62958e7f2ec431d860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5d239ae4b24b7e978935fe9b3458cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:19:37.328969 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-31815901-797b-45b2-b04c-b09b63dec911 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] 10.222.0.52 "GET /compute/v2.1/servers/b97f61ab-18fc-4cf6-bc15-ec08ac4750fd" status: 200 len: 1282 microversion: 2.1 time: 0.254303 Oct 19 03:19:37.330989 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 952/1955] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:19:37 2022] GET /compute/v2.1/servers/b97f61ab-18fc-4cf6-bc15-ec08ac4750fd => generated 1282 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:19:37.341473 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-ffbc2b16-a1d3-4364-8664-e84a3303365c req-8cd85444-6ec9-4a2f-84df-d428909ea402 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "951e236c-943a-4f8c-956d-ac7bbbf0e0e1", "name": "network-vif-plugged", "status": "completed", "tag": "d95bdec8-e9af-43f6-8904-996c4e694095"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:19:37.355582 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-ffbc2b16-a1d3-4364-8664-e84a3303365c req-8cd85444-6ec9-4a2f-84df-d428909ea402 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:37.388110 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-ffbc2b16-a1d3-4364-8664-e84a3303365c req-8cd85444-6ec9-4a2f-84df-d428909ea402 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:37.389012 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-ffbc2b16-a1d3-4364-8664-e84a3303365c req-8cd85444-6ec9-4a2f-84df-d428909ea402 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.033s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:37.423571 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-ffbc2b16-a1d3-4364-8664-e84a3303365c req-8cd85444-6ec9-4a2f-84df-d428909ea402 service nova] Creating event network-vif-plugged:d95bdec8-e9af-43f6-8904-996c4e694095 for instance 951e236c-943a-4f8c-956d-ac7bbbf0e0e1 on n-h2-861333-8 Oct 19 03:19:37.447480 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-ffbc2b16-a1d3-4364-8664-e84a3303365c req-8cd85444-6ec9-4a2f-84df-d428909ea402 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114285 Oct 19 03:19:37.452500 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 953/1956] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:19:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:19:37.480441 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-acace917-3412-45f3-9f20-2a3e478b4493 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:37.487602 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-acace917-3412-45f3-9f20-2a3e478b4493 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 62133546-4a75-4532-81ab-0c49c9252e85] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:19:37.508487 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-acace917-3412-45f3-9f20-2a3e478b4493 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:37.509155 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-acace917-3412-45f3-9f20-2a3e478b4493 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:37.509787 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-acace917-3412-45f3-9f20-2a3e478b4493 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:37.511647 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-acace917-3412-45f3-9f20-2a3e478b4493 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:37.513494 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-acace917-3412-45f3-9f20-2a3e478b4493 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:37.514216 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-acace917-3412-45f3-9f20-2a3e478b4493 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:37.622237 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-acace917-3412-45f3-9f20-2a3e478b4493 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.163571 Oct 19 03:19:37.628698 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 954/1957] 10.222.0.52 () {60 vars in 1343 bytes} [Wed Oct 19 03:19:37 2022] GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85/os-volume_attachments => generated 197 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 03:19:37.640762 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2cec5fdb-8fe4-4729-9039-a77cdb465a14 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:37.644030 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2cec5fdb-8fe4-4729-9039-a77cdb465a14 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] [instance: 951e236c-943a-4f8c-956d-ac7bbbf0e0e1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:19:37.672693 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2cec5fdb-8fe4-4729-9039-a77cdb465a14 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:37.676046 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2cec5fdb-8fe4-4729-9039-a77cdb465a14 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:37.685653 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2cec5fdb-8fe4-4729-9039-a77cdb465a14 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:37.686674 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2cec5fdb-8fe4-4729-9039-a77cdb465a14 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:37.696823 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2cec5fdb-8fe4-4729-9039-a77cdb465a14 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:37.700747 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2cec5fdb-8fe4-4729-9039-a77cdb465a14 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:38.501703 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-2cec5fdb-8fe4-4729-9039-a77cdb465a14 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ec45c74dcd448e924be40b1abfbc4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce8d13fab4fe4725a4759519818113f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:19:38.512662 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2cec5fdb-8fe4-4729-9039-a77cdb465a14 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] 10.222.0.52 "GET /compute/v2.1/servers/951e236c-943a-4f8c-956d-ac7bbbf0e0e1" status: 200 len: 1293 microversion: 2.1 time: 0.882612 Oct 19 03:19:38.513548 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 955/1958] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:19:37 2022] GET /compute/v2.1/servers/951e236c-943a-4f8c-956d-ac7bbbf0e0e1 => generated 1293 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:19:38.525130 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-382bef0f-516c-48c3-87db-caf7898c500c tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:38.525799 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-382bef0f-516c-48c3-87db-caf7898c500c tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] [instance: 19fbcbe2-9039-4d18-94ef-51ce58cb6365] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:19:38.554312 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-382bef0f-516c-48c3-87db-caf7898c500c tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:38.554912 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-382bef0f-516c-48c3-87db-caf7898c500c tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:38.555377 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-382bef0f-516c-48c3-87db-caf7898c500c tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:38.572800 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-382bef0f-516c-48c3-87db-caf7898c500c tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:38.573321 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-382bef0f-516c-48c3-87db-caf7898c500c tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:38.573802 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-382bef0f-516c-48c3-87db-caf7898c500c tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:38.727521 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-382bef0f-516c-48c3-87db-caf7898c500c tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4c5e4123c44508a5d4911a17c44231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a495ccfced47f29cb928d1ded20d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:19:38.737429 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-382bef0f-516c-48c3-87db-caf7898c500c tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] 10.222.0.52 "GET /compute/v2.1/servers/19fbcbe2-9039-4d18-94ef-51ce58cb6365" status: 200 len: 1266 microversion: 2.1 time: 0.221033 Oct 19 03:19:38.738041 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 956/1959] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:19:38 2022] GET /compute/v2.1/servers/19fbcbe2-9039-4d18-94ef-51ce58cb6365 => generated 1266 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:19:38.743978 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ee17c707-d292-4b2a-9614-377d149625e8 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:38.744606 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ee17c707-d292-4b2a-9614-377d149625e8 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] [instance: e6c35da0-28b7-4556-b4de-32fbfa213265] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:19:38.752980 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ee17c707-d292-4b2a-9614-377d149625e8 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:38.753963 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ee17c707-d292-4b2a-9614-377d149625e8 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:38.754591 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ee17c707-d292-4b2a-9614-377d149625e8 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:38.756188 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ee17c707-d292-4b2a-9614-377d149625e8 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:38.756986 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ee17c707-d292-4b2a-9614-377d149625e8 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:38.757966 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ee17c707-d292-4b2a-9614-377d149625e8 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:38.779934 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-ee17c707-d292-4b2a-9614-377d149625e8 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] HTTP exception thrown: Instance e6c35da0-28b7-4556-b4de-32fbfa213265 could not be found. Oct 19 03:19:38.782211 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ee17c707-d292-4b2a-9614-377d149625e8 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Request method failure captured: Oct 19 03:19:38.782211 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/e6c35da0-28b7-4556-b4de-32fbfa213265 HTTP/1.1 Oct 19 03:19:38.782211 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:19:38.782211 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:19:38.782211 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:19:38.782211 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:19:38.782211 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:19:38.782211 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:19:38.782211 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:19:38.782211 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:19:38.782211 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT2ye5hJjpkfHg5URnNEz5b65GDgjKSUozqv5AWCIKOK4GGiQopk5NivbkEiGT8Nc6GsZarz9tkqzNuJ2VVfHrp2Vq292bHl134U9vQWSMkI75jGXRTxH4KRFSCf4wzRpqdpPO0v5ZuMb4rYVdlK1nxmiPHYnf1AE5hiMc5UswIQr0Ug Oct 19 03:19:38.782211 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:19:38.782211 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:19:38.782211 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:19:38.782211 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:19:38.782211 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:19:38.782211 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:19:38.782211 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: facc0913093743d1a5c4c0eb673ce532 Oct 19 03:19:38.782211 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ServerGroupTestJSON-914819200 Oct 19 03:19:38.782211 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:19:38.782211 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:19:38.784137 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/facc0913093743d1a5c4c0eb673ce532"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/facc0913093743d1a5c4c0eb673ce532"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/facc0913093743d1a5c4c0eb673ce532"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_facc0913093743d1a5c4c0eb673ce532", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:19:38.784137 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ServerGroupTestJSON-914819200 Oct 19 03:19:38.784137 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: facc0913093743d1a5c4c0eb673ce532 Oct 19 03:19:38.784137 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ServerGroupTestJSON-914819200 Oct 19 03:19:38.784137 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ServerGroupTestJSON-914819200-project Oct 19 03:19:38.784137 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:19:38.784137 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:19:38.784137 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 8d696202812644f3b1bcb8825fc57420 Oct 19 03:19:38.784137 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ServerGroupTestJSON-914819200-project Oct 19 03:19:38.784137 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:19:38.784137 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance e6c35da0-28b7-4556-b4de-32fbfa213265 could not be found. Oct 19 03:19:38.784137 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': 'e6c35da0-28b7-4556-b4de-32fbfa213265'} Oct 19 03:19:38.785190 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:19:38.785190 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:19:38.785190 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:19:38.785190 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:19:38.785190 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:19:38.785190 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:19:38.785190 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:19:38.785190 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:19:38.785190 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:19:38.785190 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:19:38.785190 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6c35da0-28b7-4556-b4de-32fbfa213265 could not be found. Oct 19 03:19:38.785190 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:19:38.785190 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:19:38.785190 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:19:38.785190 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:19:38.785190 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:19:38.785190 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:19:38.785190 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:19:38.785190 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:19:38.785190 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:19:38.787092 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:19:38.787092 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:19:38.787092 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:19:38.787092 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:19:38.787092 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:19:38.787092 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:19:38.787092 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:19:38.787092 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6c35da0-28b7-4556-b4de-32fbfa213265 could not be found. Oct 19 03:19:38.787092 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:19:38.787092 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:19:38.787092 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:19:38.787092 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:19:38.787092 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:19:38.787092 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:19:38.787092 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:19:38.787092 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:19:38.787092 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6c35da0-28b7-4556-b4de-32fbfa213265 could not be found. Oct 19 03:19:38.787092 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:19:38.803830 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ee17c707-d292-4b2a-9614-377d149625e8 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Returning 404 to user: Instance e6c35da0-28b7-4556-b4de-32fbfa213265 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:19:38.804771 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ee17c707-d292-4b2a-9614-377d149625e8 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] 10.222.0.52 "GET /compute/v2.1/servers/e6c35da0-28b7-4556-b4de-32fbfa213265" status: 404 len: 111 microversion: 2.1 time: 0.065103 Oct 19 03:19:38.806397 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 957/1960] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:19:38 2022] GET /compute/v2.1/servers/e6c35da0-28b7-4556-b4de-32fbfa213265 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:19:38.826811 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e3c362f2-0477-481b-b0e2-1cbc06d1001c tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:38.834182 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e3c362f2-0477-481b-b0e2-1cbc06d1001c tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] [instance: d6d507e4-3a53-4734-bb88-8fc38efa4d9b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:19:38.835996 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e3c362f2-0477-481b-b0e2-1cbc06d1001c tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:38.836507 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e3c362f2-0477-481b-b0e2-1cbc06d1001c tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:38.837120 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e3c362f2-0477-481b-b0e2-1cbc06d1001c tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:38.838049 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e3c362f2-0477-481b-b0e2-1cbc06d1001c tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:38.839078 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e3c362f2-0477-481b-b0e2-1cbc06d1001c tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:38.839837 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e3c362f2-0477-481b-b0e2-1cbc06d1001c tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:38.871906 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:19:39.159935 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e3c362f2-0477-481b-b0e2-1cbc06d1001c tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8824f20e6a1f478a99f90e1ba8f028fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e436373e9e45efa03f08b33da619e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:19:39.168107 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e3c362f2-0477-481b-b0e2-1cbc06d1001c tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] 10.222.0.52 "GET /compute/v2.1/servers/d6d507e4-3a53-4734-bb88-8fc38efa4d9b" status: 200 len: 1324 microversion: 2.1 time: 0.360605 Oct 19 03:19:39.168694 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 958/1961] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:19:38 2022] GET /compute/v2.1/servers/d6d507e4-3a53-4734-bb88-8fc38efa4d9b => generated 1324 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:19:39.174055 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6cc19318-decb-4943-ba8f-d3eca56750cb tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:39.174879 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6cc19318-decb-4943-ba8f-d3eca56750cb tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] [instance: b97f61ab-18fc-4cf6-bc15-ec08ac4750fd] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:19:39.182309 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6cc19318-decb-4943-ba8f-d3eca56750cb tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:39.183128 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6cc19318-decb-4943-ba8f-d3eca56750cb tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:39.184123 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6cc19318-decb-4943-ba8f-d3eca56750cb tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:39.185036 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6cc19318-decb-4943-ba8f-d3eca56750cb tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:39.186288 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6cc19318-decb-4943-ba8f-d3eca56750cb tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:39.186940 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6cc19318-decb-4943-ba8f-d3eca56750cb tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:39.360235 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-6cc19318-decb-4943-ba8f-d3eca56750cb tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac711151c0334c62958e7f2ec431d860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5d239ae4b24b7e978935fe9b3458cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:19:39.368907 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6cc19318-decb-4943-ba8f-d3eca56750cb tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] 10.222.0.52 "GET /compute/v2.1/servers/b97f61ab-18fc-4cf6-bc15-ec08ac4750fd" status: 200 len: 1324 microversion: 2.1 time: 0.199105 Oct 19 03:19:39.394190 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 959/1962] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:19:39 2022] GET /compute/v2.1/servers/b97f61ab-18fc-4cf6-bc15-ec08ac4750fd => generated 1324 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:19:39.400422 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e4bc136e-c416-45d0-92f4-61be700af647 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:39.402745 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e4bc136e-c416-45d0-92f4-61be700af647 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 62133546-4a75-4532-81ab-0c49c9252e85] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:19:39.408852 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e4bc136e-c416-45d0-92f4-61be700af647 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:39.409341 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e4bc136e-c416-45d0-92f4-61be700af647 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:39.409974 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e4bc136e-c416-45d0-92f4-61be700af647 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:39.410895 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e4bc136e-c416-45d0-92f4-61be700af647 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:39.411354 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e4bc136e-c416-45d0-92f4-61be700af647 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:39.412432 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e4bc136e-c416-45d0-92f4-61be700af647 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:39.444670 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e4bc136e-c416-45d0-92f4-61be700af647 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.048926 Oct 19 03:19:39.445522 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 960/1963] 10.222.0.52 () {60 vars in 1343 bytes} [Wed Oct 19 03:19:39 2022] GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:19:39.449995 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-15fdc968-b1f2-4009-aee1-f45a37041e55 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:39.469818 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.compute.server_groups [None req-15fdc968-b1f2-4009-aee1-f45a37041e55 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Querying cell d204a9a6-30d3-4569-8922-0d4cbe966b78(cell1) for 1 instances {{(pid=121134) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 19 03:19:39.470550 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-15fdc968-b1f2-4009-aee1-f45a37041e55 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:39.471657 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-15fdc968-b1f2-4009-aee1-f45a37041e55 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:39.472152 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-15fdc968-b1f2-4009-aee1-f45a37041e55 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:39.485362 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-15fdc968-b1f2-4009-aee1-f45a37041e55 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] 10.222.0.52 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.038767 Oct 19 03:19:39.494326 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 961/1964] 10.222.0.52 () {58 vars in 1152 bytes} [Wed Oct 19 03:19:39 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:19:39.500514 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-cc619371-696d-4535-81d7-590df1251725 req-b09456ff-2929-4953-ae2e-b618d7915065 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b97f61ab-18fc-4cf6-bc15-ec08ac4750fd", "tag": "bcf93ca2-3c93-402b-9421-7ee5460dace0"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:19:39.512712 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-cc619371-696d-4535-81d7-590df1251725 req-b09456ff-2929-4953-ae2e-b618d7915065 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:39.512712 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-cc619371-696d-4535-81d7-590df1251725 req-b09456ff-2929-4953-ae2e-b618d7915065 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:39.513980 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-cc619371-696d-4535-81d7-590df1251725 req-b09456ff-2929-4953-ae2e-b618d7915065 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:39.557822 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-cc619371-696d-4535-81d7-590df1251725 req-b09456ff-2929-4953-ae2e-b618d7915065 service nova] Creating event network-changed:bcf93ca2-3c93-402b-9421-7ee5460dace0 for instance b97f61ab-18fc-4cf6-bc15-ec08ac4750fd on n-h1-861333-8 Oct 19 03:19:39.564149 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-cc619371-696d-4535-81d7-590df1251725 req-b09456ff-2929-4953-ae2e-b618d7915065 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068015 Oct 19 03:19:39.565328 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 962/1965] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:19:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:19:39.570180 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-eb7bb838-150b-45c0-899b-579906a1af65 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:39.586695 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.compute.server_groups [None req-eb7bb838-150b-45c0-899b-579906a1af65 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Querying cell d204a9a6-30d3-4569-8922-0d4cbe966b78(cell1) for 1 instances {{(pid=121134) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 19 03:19:39.587130 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eb7bb838-150b-45c0-899b-579906a1af65 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:39.587812 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eb7bb838-150b-45c0-899b-579906a1af65 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:39.588422 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eb7bb838-150b-45c0-899b-579906a1af65 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:39.600473 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-eb7bb838-150b-45c0-899b-579906a1af65 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] 10.222.0.52 "GET /compute/v2.1/os-server-groups/ace44ace-7b31-4c74-a514-9477f4bf86cd" status: 200 len: 184 microversion: 2.1 time: 0.033654 Oct 19 03:19:39.605474 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 963/1966] 10.222.0.52 () {58 vars in 1263 bytes} [Wed Oct 19 03:19:39 2022] GET /compute/v2.1/os-server-groups/ace44ace-7b31-4c74-a514-9477f4bf86cd => generated 184 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:19:39.608474 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-92ee65c0-286e-4d29-93f7-dc389ea8b8c4 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:39.609243 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-92ee65c0-286e-4d29-93f7-dc389ea8b8c4 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] [instance: 951e236c-943a-4f8c-956d-ac7bbbf0e0e1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:19:39.616247 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-92ee65c0-286e-4d29-93f7-dc389ea8b8c4 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:39.616994 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-92ee65c0-286e-4d29-93f7-dc389ea8b8c4 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:39.617580 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-92ee65c0-286e-4d29-93f7-dc389ea8b8c4 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:39.618306 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-92ee65c0-286e-4d29-93f7-dc389ea8b8c4 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:39.618786 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-92ee65c0-286e-4d29-93f7-dc389ea8b8c4 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:39.619448 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-92ee65c0-286e-4d29-93f7-dc389ea8b8c4 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:39.918746 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-92ee65c0-286e-4d29-93f7-dc389ea8b8c4 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ec45c74dcd448e924be40b1abfbc4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce8d13fab4fe4725a4759519818113f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:19:39.935305 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-92ee65c0-286e-4d29-93f7-dc389ea8b8c4 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] 10.222.0.52 "GET /compute/v2.1/servers/951e236c-943a-4f8c-956d-ac7bbbf0e0e1" status: 200 len: 1293 microversion: 2.1 time: 0.332358 Oct 19 03:19:39.936481 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 964/1967] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:19:39 2022] GET /compute/v2.1/servers/951e236c-943a-4f8c-956d-ac7bbbf0e0e1 => generated 1293 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:19:39.952030 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3d70b06c-197c-4627-991a-44609a391a36 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:39.952969 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3d70b06c-197c-4627-991a-44609a391a36 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] [instance: e6c35da0-28b7-4556-b4de-32fbfa213265] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:19:39.969897 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3d70b06c-197c-4627-991a-44609a391a36 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:39.971458 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3d70b06c-197c-4627-991a-44609a391a36 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:39.973264 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3d70b06c-197c-4627-991a-44609a391a36 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:39.974104 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3d70b06c-197c-4627-991a-44609a391a36 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:39.979214 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3d70b06c-197c-4627-991a-44609a391a36 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:39.980061 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3d70b06c-197c-4627-991a-44609a391a36 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:39.996871 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-3d70b06c-197c-4627-991a-44609a391a36 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] HTTP exception thrown: Instance e6c35da0-28b7-4556-b4de-32fbfa213265 could not be found. Oct 19 03:19:40.001483 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3d70b06c-197c-4627-991a-44609a391a36 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Request method failure captured: Oct 19 03:19:40.001483 n-d-861333-8 devstack@n-api.service[121134]: request: DELETE /compute/v2.1/servers/e6c35da0-28b7-4556-b4de-32fbfa213265 HTTP/1.1 Oct 19 03:19:40.001483 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:19:40.001483 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:19:40.001483 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:19:40.001483 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:19:40.001483 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:19:40.001483 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:19:40.001483 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:19:40.001483 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:19:40.001483 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT2ye5hJjpkfHg5URnNEz5b65GDgjKSUozqv5AWCIKOK4GGiQopk5NivbkEiGT8Nc6GsZarz9tkqzNuJ2VVfHrp2Vq292bHl134U9vQWSMkI75jGXRTxH4KRFSCf4wzRpqdpPO0v5ZuMb4rYVdlK1nxmiPHYnf1AE5hiMc5UswIQr0Ug Oct 19 03:19:40.001483 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:19:40.001483 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:19:40.001483 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:19:40.001483 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:19:40.001483 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:19:40.001483 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:19:40.001483 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: facc0913093743d1a5c4c0eb673ce532 Oct 19 03:19:40.001483 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ServerGroupTestJSON-914819200 Oct 19 03:19:40.001483 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:19:40.001483 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:19:40.003061 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/facc0913093743d1a5c4c0eb673ce532"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/facc0913093743d1a5c4c0eb673ce532"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/facc0913093743d1a5c4c0eb673ce532"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_facc0913093743d1a5c4c0eb673ce532", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:19:40.003061 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ServerGroupTestJSON-914819200 Oct 19 03:19:40.003061 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: facc0913093743d1a5c4c0eb673ce532 Oct 19 03:19:40.003061 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ServerGroupTestJSON-914819200 Oct 19 03:19:40.003061 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ServerGroupTestJSON-914819200-project Oct 19 03:19:40.003061 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:19:40.003061 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:19:40.003061 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 8d696202812644f3b1bcb8825fc57420 Oct 19 03:19:40.003061 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ServerGroupTestJSON-914819200-project Oct 19 03:19:40.003061 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:19:40.003061 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance e6c35da0-28b7-4556-b4de-32fbfa213265 could not be found. Oct 19 03:19:40.003061 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': 'e6c35da0-28b7-4556-b4de-32fbfa213265'} Oct 19 03:19:40.003916 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:19:40.003916 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:19:40.003916 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:19:40.003916 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:19:40.003916 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:19:40.003916 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:19:40.003916 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:19:40.003916 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:19:40.003916 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:19:40.003916 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:19:40.003916 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6c35da0-28b7-4556-b4de-32fbfa213265 could not be found. Oct 19 03:19:40.003916 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:19:40.003916 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:19:40.003916 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:19:40.003916 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:19:40.003916 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:19:40.003916 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:19:40.003916 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:19:40.003916 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:19:40.003916 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:19:40.005673 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:19:40.005673 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 03:19:40.005673 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 03:19:40.005673 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 03:19:40.005673 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 03:19:40.005673 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:19:40.005673 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:19:40.005673 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:19:40.005673 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:19:40.005673 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6c35da0-28b7-4556-b4de-32fbfa213265 could not be found. Oct 19 03:19:40.005673 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:19:40.005673 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:19:40.005673 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:19:40.005673 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:19:40.005673 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:19:40.005673 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:19:40.005673 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:19:40.005673 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:19:40.005673 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6c35da0-28b7-4556-b4de-32fbfa213265 could not be found. Oct 19 03:19:40.005673 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:19:40.007399 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3d70b06c-197c-4627-991a-44609a391a36 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Returning 404 to user: Instance e6c35da0-28b7-4556-b4de-32fbfa213265 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:19:40.007399 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3d70b06c-197c-4627-991a-44609a391a36 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] 10.222.0.52 "DELETE /compute/v2.1/servers/e6c35da0-28b7-4556-b4de-32fbfa213265" status: 404 len: 111 microversion: 2.1 time: 0.062524 Oct 19 03:19:40.007399 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 965/1968] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:19:39 2022] DELETE /compute/v2.1/servers/e6c35da0-28b7-4556-b4de-32fbfa213265 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:19:40.012033 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-77a7f88a-b82f-4177-9455-93981bbacecd tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:40.012649 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-77a7f88a-b82f-4177-9455-93981bbacecd tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] [instance: 19fbcbe2-9039-4d18-94ef-51ce58cb6365] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:19:40.019138 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-77a7f88a-b82f-4177-9455-93981bbacecd tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:40.019940 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-77a7f88a-b82f-4177-9455-93981bbacecd tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:40.020592 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-77a7f88a-b82f-4177-9455-93981bbacecd tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:40.022102 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-77a7f88a-b82f-4177-9455-93981bbacecd tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:40.022770 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-77a7f88a-b82f-4177-9455-93981bbacecd tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:40.023411 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-77a7f88a-b82f-4177-9455-93981bbacecd tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:40.166783 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-77a7f88a-b82f-4177-9455-93981bbacecd tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4c5e4123c44508a5d4911a17c44231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a495ccfced47f29cb928d1ded20d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:19:40.175423 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-77a7f88a-b82f-4177-9455-93981bbacecd tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] 10.222.0.52 "GET /compute/v2.1/servers/19fbcbe2-9039-4d18-94ef-51ce58cb6365" status: 200 len: 1284 microversion: 2.1 time: 0.173651 Oct 19 03:19:40.176423 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 966/1969] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:19:40 2022] GET /compute/v2.1/servers/19fbcbe2-9039-4d18-94ef-51ce58cb6365 => generated 1284 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:19:40.183360 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c153631d-f45e-4af7-aa93-b01bee5b64e7 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:40.184375 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c153631d-f45e-4af7-aa93-b01bee5b64e7 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] [instance: e6c35da0-28b7-4556-b4de-32fbfa213265] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:19:40.191430 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c153631d-f45e-4af7-aa93-b01bee5b64e7 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:40.192242 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c153631d-f45e-4af7-aa93-b01bee5b64e7 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:40.193051 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c153631d-f45e-4af7-aa93-b01bee5b64e7 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:40.200108 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c153631d-f45e-4af7-aa93-b01bee5b64e7 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:40.200108 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c153631d-f45e-4af7-aa93-b01bee5b64e7 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:40.200108 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c153631d-f45e-4af7-aa93-b01bee5b64e7 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:40.212038 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-c153631d-f45e-4af7-aa93-b01bee5b64e7 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] HTTP exception thrown: Instance e6c35da0-28b7-4556-b4de-32fbfa213265 could not be found. Oct 19 03:19:40.214196 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c153631d-f45e-4af7-aa93-b01bee5b64e7 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Request method failure captured: Oct 19 03:19:40.214196 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/e6c35da0-28b7-4556-b4de-32fbfa213265 HTTP/1.1 Oct 19 03:19:40.214196 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:19:40.214196 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:19:40.214196 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:19:40.214196 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:19:40.214196 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:19:40.214196 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:19:40.214196 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:19:40.214196 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:19:40.214196 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT2ye5hJjpkfHg5URnNEz5b65GDgjKSUozqv5AWCIKOK4GGiQopk5NivbkEiGT8Nc6GsZarz9tkqzNuJ2VVfHrp2Vq292bHl134U9vQWSMkI75jGXRTxH4KRFSCf4wzRpqdpPO0v5ZuMb4rYVdlK1nxmiPHYnf1AE5hiMc5UswIQr0Ug Oct 19 03:19:40.214196 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:19:40.214196 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:19:40.214196 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:19:40.214196 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:19:40.214196 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:19:40.214196 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:19:40.214196 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: facc0913093743d1a5c4c0eb673ce532 Oct 19 03:19:40.214196 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ServerGroupTestJSON-914819200 Oct 19 03:19:40.214196 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:19:40.214196 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:19:40.215709 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/facc0913093743d1a5c4c0eb673ce532"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/facc0913093743d1a5c4c0eb673ce532"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/facc0913093743d1a5c4c0eb673ce532"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_facc0913093743d1a5c4c0eb673ce532", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:19:40.215709 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ServerGroupTestJSON-914819200 Oct 19 03:19:40.215709 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: facc0913093743d1a5c4c0eb673ce532 Oct 19 03:19:40.215709 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ServerGroupTestJSON-914819200 Oct 19 03:19:40.215709 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ServerGroupTestJSON-914819200-project Oct 19 03:19:40.215709 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:19:40.215709 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:19:40.215709 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 8d696202812644f3b1bcb8825fc57420 Oct 19 03:19:40.215709 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ServerGroupTestJSON-914819200-project Oct 19 03:19:40.215709 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:19:40.215709 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance e6c35da0-28b7-4556-b4de-32fbfa213265 could not be found. Oct 19 03:19:40.215709 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': 'e6c35da0-28b7-4556-b4de-32fbfa213265'} Oct 19 03:19:40.216596 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:19:40.216596 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:19:40.216596 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:19:40.216596 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:19:40.216596 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:19:40.216596 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:19:40.216596 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:19:40.216596 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:19:40.216596 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:19:40.216596 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:19:40.216596 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6c35da0-28b7-4556-b4de-32fbfa213265 could not be found. Oct 19 03:19:40.216596 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:19:40.216596 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:19:40.216596 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:19:40.216596 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:19:40.216596 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:19:40.216596 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:19:40.216596 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:19:40.216596 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:19:40.216596 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:19:40.218068 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:19:40.218068 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:19:40.218068 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:19:40.218068 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:19:40.218068 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:19:40.218068 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:19:40.218068 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:19:40.218068 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6c35da0-28b7-4556-b4de-32fbfa213265 could not be found. Oct 19 03:19:40.218068 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:19:40.218068 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:19:40.218068 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:19:40.218068 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:19:40.218068 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:19:40.218068 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:19:40.218068 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:19:40.218068 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:19:40.218068 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6c35da0-28b7-4556-b4de-32fbfa213265 could not be found. Oct 19 03:19:40.218068 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:19:40.219358 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c153631d-f45e-4af7-aa93-b01bee5b64e7 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Returning 404 to user: Instance e6c35da0-28b7-4556-b4de-32fbfa213265 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:19:40.220058 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c153631d-f45e-4af7-aa93-b01bee5b64e7 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] 10.222.0.52 "GET /compute/v2.1/servers/e6c35da0-28b7-4556-b4de-32fbfa213265" status: 404 len: 111 microversion: 2.1 time: 0.042451 Oct 19 03:19:40.225412 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 967/1970] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:19:40 2022] GET /compute/v2.1/servers/e6c35da0-28b7-4556-b4de-32fbfa213265 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:19:40.230344 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a3e7ebb3-5d48-4286-8768-8b26132f68b8 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:40.230997 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a3e7ebb3-5d48-4286-8768-8b26132f68b8 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] [instance: d6d507e4-3a53-4734-bb88-8fc38efa4d9b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:19:40.238433 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a3e7ebb3-5d48-4286-8768-8b26132f68b8 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:40.239308 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a3e7ebb3-5d48-4286-8768-8b26132f68b8 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:40.240252 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a3e7ebb3-5d48-4286-8768-8b26132f68b8 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:40.240981 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a3e7ebb3-5d48-4286-8768-8b26132f68b8 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:40.241484 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a3e7ebb3-5d48-4286-8768-8b26132f68b8 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:40.242165 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a3e7ebb3-5d48-4286-8768-8b26132f68b8 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:40.467749 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a3e7ebb3-5d48-4286-8768-8b26132f68b8 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8824f20e6a1f478a99f90e1ba8f028fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e436373e9e45efa03f08b33da619e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:19:40.476708 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a3e7ebb3-5d48-4286-8768-8b26132f68b8 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] 10.222.0.52 "GET /compute/v2.1/servers/d6d507e4-3a53-4734-bb88-8fc38efa4d9b" status: 200 len: 1324 microversion: 2.1 time: 0.250318 Oct 19 03:19:40.477430 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 968/1971] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:19:40 2022] GET /compute/v2.1/servers/d6d507e4-3a53-4734-bb88-8fc38efa4d9b => generated 1324 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:19:40.482398 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8262b7db-56b5-46e5-9333-8ec1f5fddd8a tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:40.488644 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-8262b7db-56b5-46e5-9333-8ec1f5fddd8a tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] HTTP exception thrown: Instance group 93d5cdfb-fbf5-4a43-9700-627ad8780c6f could not be found. Oct 19 03:19:40.491515 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8262b7db-56b5-46e5-9333-8ec1f5fddd8a tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Request method failure captured: Oct 19 03:19:40.491515 n-d-861333-8 devstack@n-api.service[121134]: request: DELETE /compute/v2.1/os-server-groups/93d5cdfb-fbf5-4a43-9700-627ad8780c6f HTTP/1.1 Oct 19 03:19:40.491515 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:19:40.491515 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:19:40.491515 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:19:40.491515 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:19:40.491515 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:19:40.491515 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:19:40.491515 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:19:40.491515 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:19:40.491515 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT2ye5hJjpkfHg5URnNEz5b65GDgjKSUozqv5AWCIKOK4GGiQopk5NivbkEiGT8Nc6GsZarz9tkqzNuJ2VVfHrp2Vq292bHl134U9vQWSMkI75jGXRTxH4KRFSCf4wzRpqdpPO0v5ZuMb4rYVdlK1nxmiPHYnf1AE5hiMc5UswIQr0Ug Oct 19 03:19:40.491515 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:19:40.491515 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:19:40.491515 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:19:40.491515 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:19:40.491515 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:19:40.491515 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:19:40.491515 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: facc0913093743d1a5c4c0eb673ce532 Oct 19 03:19:40.491515 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ServerGroupTestJSON-914819200 Oct 19 03:19:40.491515 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:19:40.491515 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:19:40.493056 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/facc0913093743d1a5c4c0eb673ce532"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/facc0913093743d1a5c4c0eb673ce532"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/facc0913093743d1a5c4c0eb673ce532"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_facc0913093743d1a5c4c0eb673ce532", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:19:40.493056 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ServerGroupTestJSON-914819200 Oct 19 03:19:40.493056 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: facc0913093743d1a5c4c0eb673ce532 Oct 19 03:19:40.493056 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ServerGroupTestJSON-914819200 Oct 19 03:19:40.493056 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ServerGroupTestJSON-914819200-project Oct 19 03:19:40.493056 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:19:40.493056 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:19:40.493056 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 8d696202812644f3b1bcb8825fc57420 Oct 19 03:19:40.493056 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ServerGroupTestJSON-914819200-project Oct 19 03:19:40.493056 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:19:40.493056 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance group 93d5cdfb-fbf5-4a43-9700-627ad8780c6f could not be found. Oct 19 03:19:40.493056 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '93d5cdfb-fbf5-4a43-9700-627ad8780c6f'} Oct 19 03:19:40.493912 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:19:40.493912 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:19:40.493912 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 19 03:19:40.493912 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 19 03:19:40.493912 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 03:19:40.493912 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 03:19:40.493912 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 19 03:19:40.493912 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 19 03:19:40.493912 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 19 03:19:40.493912 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 19 03:19:40.493912 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 19 03:19:40.493912 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 19 03:19:40.493912 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 93d5cdfb-fbf5-4a43-9700-627ad8780c6f could not be found. Oct 19 03:19:40.493912 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:19:40.493912 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:19:40.493912 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:19:40.493912 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:19:40.493912 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:19:40.493912 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:19:40.495247 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:19:40.495247 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:19:40.495247 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:19:40.495247 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:19:40.495247 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 19 03:19:40.495247 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:19:40.495247 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 93d5cdfb-fbf5-4a43-9700-627ad8780c6f could not be found. Oct 19 03:19:40.495247 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:19:40.495247 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:19:40.495247 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:19:40.495247 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:19:40.495247 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:19:40.495247 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:19:40.495247 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:19:40.495247 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:19:40.495247 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 93d5cdfb-fbf5-4a43-9700-627ad8780c6f could not be found. Oct 19 03:19:40.495247 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:19:40.496396 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8262b7db-56b5-46e5-9333-8ec1f5fddd8a tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Returning 404 to user: Instance group 93d5cdfb-fbf5-4a43-9700-627ad8780c6f could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:19:40.496396 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8262b7db-56b5-46e5-9333-8ec1f5fddd8a tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] 10.222.0.52 "DELETE /compute/v2.1/os-server-groups/93d5cdfb-fbf5-4a43-9700-627ad8780c6f" status: 404 len: 117 microversion: 2.1 time: 0.014337 Oct 19 03:19:40.496704 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 969/1972] 10.222.0.52 () {58 vars in 1266 bytes} [Wed Oct 19 03:19:40 2022] DELETE /compute/v2.1/os-server-groups/93d5cdfb-fbf5-4a43-9700-627ad8780c6f => generated 117 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:19:40.501650 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-f1b99121-dca4-48af-9adb-19b6c6ddf275 req-1523c2aa-bf86-4951-81cf-c421e70b5d71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6d507e4-3a53-4734-bb88-8fc38efa4d9b", "name": "network-vif-plugged", "status": "completed", "tag": "c233e8b9-5426-4564-90a1-f4bfcb4d3a76"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:19:40.513992 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-f1b99121-dca4-48af-9adb-19b6c6ddf275 req-1523c2aa-bf86-4951-81cf-c421e70b5d71 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:40.514614 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-f1b99121-dca4-48af-9adb-19b6c6ddf275 req-1523c2aa-bf86-4951-81cf-c421e70b5d71 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:40.514919 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-f1b99121-dca4-48af-9adb-19b6c6ddf275 req-1523c2aa-bf86-4951-81cf-c421e70b5d71 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:40.534403 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-f1b99121-dca4-48af-9adb-19b6c6ddf275 req-1523c2aa-bf86-4951-81cf-c421e70b5d71 service nova] Creating event network-vif-plugged:c233e8b9-5426-4564-90a1-f4bfcb4d3a76 for instance d6d507e4-3a53-4734-bb88-8fc38efa4d9b on n-h2-861333-8 Oct 19 03:19:40.540896 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-f1b99121-dca4-48af-9adb-19b6c6ddf275 req-1523c2aa-bf86-4951-81cf-c421e70b5d71 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042727 Oct 19 03:19:40.541868 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 970/1973] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:19:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:19:40.549144 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-dc7a07d4-fdda-4203-b0eb-1ceb03f0e10c tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:40.550317 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-dc7a07d4-fdda-4203-b0eb-1ceb03f0e10c tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] [instance: b97f61ab-18fc-4cf6-bc15-ec08ac4750fd] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:19:40.559358 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dc7a07d4-fdda-4203-b0eb-1ceb03f0e10c tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:40.560143 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dc7a07d4-fdda-4203-b0eb-1ceb03f0e10c tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:40.560540 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dc7a07d4-fdda-4203-b0eb-1ceb03f0e10c tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:40.561332 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dc7a07d4-fdda-4203-b0eb-1ceb03f0e10c tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:40.561872 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dc7a07d4-fdda-4203-b0eb-1ceb03f0e10c tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:40.568953 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dc7a07d4-fdda-4203-b0eb-1ceb03f0e10c tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:40.793529 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6fa7229c-5544-4d41-b4df-ec1cc5d7be0a tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] 10.222.0.52 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.898437 Oct 19 03:19:40.794426 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1004/1974] 10.222.0.52 () {60 vars in 1170 bytes} [Wed Oct 19 03:19:35 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4900 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:19:40.799142 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-8ca93f99-6adb-4980-a2dc-393349c0cf0c tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:40.812572 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-8ca93f99-6adb-4980-a2dc-393349c0cf0c tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] HTTP exception thrown: Instance group 2933b5bd-6e9e-4e3b-b3fb-8e0861d5db60 could not be found. Oct 19 03:19:40.814802 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-8ca93f99-6adb-4980-a2dc-393349c0cf0c tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Request method failure captured: Oct 19 03:19:40.814802 n-d-861333-8 devstack@n-api.service[121135]: request: DELETE /compute/v2.1/os-server-groups/2933b5bd-6e9e-4e3b-b3fb-8e0861d5db60 HTTP/1.1 Oct 19 03:19:40.814802 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:19:40.814802 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:19:40.814802 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:19:40.814802 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:19:40.814802 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:19:40.814802 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:19:40.814802 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:19:40.814802 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:19:40.814802 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2ye5hJjpkfHg5URnNEz5b65GDgjKSUozqv5AWCIKOK4GGiQopk5NivbkEiGT8Nc6GsZarz9tkqzNuJ2VVfHrp2Vq292bHl134U9vQWSMkI75jGXRTxH4KRFSCf4wzRpqdpPO0v5ZuMb4rYVdlK1nxmiPHYnf1AE5hiMc5UswIQr0Ug Oct 19 03:19:40.814802 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:19:40.814802 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:19:40.814802 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:19:40.814802 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:19:40.814802 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:19:40.814802 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:19:40.814802 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: facc0913093743d1a5c4c0eb673ce532 Oct 19 03:19:40.814802 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ServerGroupTestJSON-914819200 Oct 19 03:19:40.814802 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:19:40.814802 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:19:40.816275 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/facc0913093743d1a5c4c0eb673ce532"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/facc0913093743d1a5c4c0eb673ce532"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/facc0913093743d1a5c4c0eb673ce532"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_facc0913093743d1a5c4c0eb673ce532", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:19:40.816275 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ServerGroupTestJSON-914819200 Oct 19 03:19:40.816275 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: facc0913093743d1a5c4c0eb673ce532 Oct 19 03:19:40.816275 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ServerGroupTestJSON-914819200 Oct 19 03:19:40.816275 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ServerGroupTestJSON-914819200-project Oct 19 03:19:40.816275 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:19:40.816275 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:19:40.816275 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 8d696202812644f3b1bcb8825fc57420 Oct 19 03:19:40.816275 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ServerGroupTestJSON-914819200-project Oct 19 03:19:40.816275 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:19:40.816275 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance group 2933b5bd-6e9e-4e3b-b3fb-8e0861d5db60 could not be found. Oct 19 03:19:40.816275 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '2933b5bd-6e9e-4e3b-b3fb-8e0861d5db60'} Oct 19 03:19:40.817183 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:19:40.817183 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:19:40.817183 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 19 03:19:40.817183 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 19 03:19:40.817183 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 03:19:40.817183 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 03:19:40.817183 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 19 03:19:40.817183 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 19 03:19:40.817183 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 19 03:19:40.817183 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 19 03:19:40.817183 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 19 03:19:40.817183 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 19 03:19:40.817183 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 2933b5bd-6e9e-4e3b-b3fb-8e0861d5db60 could not be found. Oct 19 03:19:40.817183 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:19:40.817183 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:19:40.817183 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:19:40.817183 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:19:40.817183 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:19:40.817183 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:19:40.819102 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:19:40.819102 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:19:40.819102 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:19:40.819102 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:19:40.819102 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 19 03:19:40.819102 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:19:40.819102 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 2933b5bd-6e9e-4e3b-b3fb-8e0861d5db60 could not be found. Oct 19 03:19:40.819102 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:19:40.819102 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:19:40.819102 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:19:40.819102 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:19:40.819102 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:19:40.819102 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:19:40.819102 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:19:40.819102 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:19:40.819102 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 2933b5bd-6e9e-4e3b-b3fb-8e0861d5db60 could not be found. Oct 19 03:19:40.819102 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:19:40.820225 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-8ca93f99-6adb-4980-a2dc-393349c0cf0c tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Returning 404 to user: Instance group 2933b5bd-6e9e-4e3b-b3fb-8e0861d5db60 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:19:40.820225 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-8ca93f99-6adb-4980-a2dc-393349c0cf0c tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] 10.222.0.52 "DELETE /compute/v2.1/os-server-groups/2933b5bd-6e9e-4e3b-b3fb-8e0861d5db60" status: 404 len: 117 microversion: 2.1 time: 0.020794 Oct 19 03:19:40.831209 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1005/1975] 10.222.0.52 () {58 vars in 1266 bytes} [Wed Oct 19 03:19:40 2022] DELETE /compute/v2.1/os-server-groups/2933b5bd-6e9e-4e3b-b3fb-8e0861d5db60 => generated 117 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:19:40.832589 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0d3c5a1c-0195-448a-a028-ce84c9c5e864 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Action: 'action', calling method: .version_select at 0x7fc132ab73a0>, body: {"addFloatingIp": {"address": "172.25.7.234"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:19:40.836523 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0d3c5a1c-0195-448a-a028-ce84c9c5e864 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] [instance: c6e2a8e3-4589-4037-b0d8-032541d043e3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:19:40.843007 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0d3c5a1c-0195-448a-a028-ce84c9c5e864 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:40.843632 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0d3c5a1c-0195-448a-a028-ce84c9c5e864 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:40.844151 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0d3c5a1c-0195-448a-a028-ce84c9c5e864 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:40.844931 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0d3c5a1c-0195-448a-a028-ce84c9c5e864 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:40.845733 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0d3c5a1c-0195-448a-a028-ce84c9c5e864 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:40.846427 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0d3c5a1c-0195-448a-a028-ce84c9c5e864 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:40.925315 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0d3c5a1c-0195-448a-a028-ce84c9c5e864 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Acquiring lock "refresh_cache-c6e2a8e3-4589-4037-b0d8-032541d043e3" {{(pid=121135) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 19 03:19:40.925850 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0d3c5a1c-0195-448a-a028-ce84c9c5e864 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Acquired lock "refresh_cache-c6e2a8e3-4589-4037-b0d8-032541d043e3" {{(pid=121135) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 19 03:19:40.934535 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-dc7a07d4-fdda-4203-b0eb-1ceb03f0e10c tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac711151c0334c62958e7f2ec431d860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5d239ae4b24b7e978935fe9b3458cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:19:40.946887 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-dc7a07d4-fdda-4203-b0eb-1ceb03f0e10c tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] 10.222.0.52 "GET /compute/v2.1/servers/b97f61ab-18fc-4cf6-bc15-ec08ac4750fd" status: 200 len: 1324 microversion: 2.1 time: 0.402404 Oct 19 03:19:40.957968 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 971/1976] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:19:40 2022] GET /compute/v2.1/servers/b97f61ab-18fc-4cf6-bc15-ec08ac4750fd => generated 1324 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:19:40.970388 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-31958a40-4005-4bbb-aac9-af3f86eada6d tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:40.980069 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-31958a40-4005-4bbb-aac9-af3f86eada6d tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] HTTP exception thrown: Instance group ae09a148-dc6f-48d6-bdba-a75ad88290de could not be found. Oct 19 03:19:40.980069 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-31958a40-4005-4bbb-aac9-af3f86eada6d tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Request method failure captured: Oct 19 03:19:40.980069 n-d-861333-8 devstack@n-api.service[121134]: request: DELETE /compute/v2.1/os-server-groups/ae09a148-dc6f-48d6-bdba-a75ad88290de HTTP/1.1 Oct 19 03:19:40.980069 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:19:40.980069 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:19:40.980069 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:19:40.980069 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:19:40.980069 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:19:40.980069 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:19:40.980069 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:19:40.980069 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:19:40.980069 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT2ye5hJjpkfHg5URnNEz5b65GDgjKSUozqv5AWCIKOK4GGiQopk5NivbkEiGT8Nc6GsZarz9tkqzNuJ2VVfHrp2Vq292bHl134U9vQWSMkI75jGXRTxH4KRFSCf4wzRpqdpPO0v5ZuMb4rYVdlK1nxmiPHYnf1AE5hiMc5UswIQr0Ug Oct 19 03:19:40.980069 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:19:40.980069 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:19:40.980069 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:19:40.980069 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:19:40.980069 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:19:40.980069 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:19:40.980069 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: facc0913093743d1a5c4c0eb673ce532 Oct 19 03:19:40.980069 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ServerGroupTestJSON-914819200 Oct 19 03:19:40.980069 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:19:40.980069 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:19:40.982138 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/facc0913093743d1a5c4c0eb673ce532"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/facc0913093743d1a5c4c0eb673ce532"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/facc0913093743d1a5c4c0eb673ce532"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_facc0913093743d1a5c4c0eb673ce532", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:19:40.982138 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ServerGroupTestJSON-914819200 Oct 19 03:19:40.982138 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: facc0913093743d1a5c4c0eb673ce532 Oct 19 03:19:40.982138 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ServerGroupTestJSON-914819200 Oct 19 03:19:40.982138 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ServerGroupTestJSON-914819200-project Oct 19 03:19:40.982138 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:19:40.982138 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:19:40.982138 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 8d696202812644f3b1bcb8825fc57420 Oct 19 03:19:40.982138 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ServerGroupTestJSON-914819200-project Oct 19 03:19:40.982138 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:19:40.982138 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance group ae09a148-dc6f-48d6-bdba-a75ad88290de could not be found. Oct 19 03:19:40.982138 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': 'ae09a148-dc6f-48d6-bdba-a75ad88290de'} Oct 19 03:19:40.983617 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:19:40.983617 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:19:40.983617 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 19 03:19:40.983617 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 19 03:19:40.983617 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 03:19:40.983617 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 03:19:40.983617 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 19 03:19:40.983617 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 19 03:19:40.983617 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 19 03:19:40.983617 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 19 03:19:40.983617 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 19 03:19:40.983617 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 19 03:19:40.983617 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group ae09a148-dc6f-48d6-bdba-a75ad88290de could not be found. Oct 19 03:19:40.983617 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:19:40.983617 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:19:40.983617 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:19:40.983617 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:19:40.983617 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:19:40.983617 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:19:40.984893 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:19:40.984893 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:19:40.984893 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:19:40.984893 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:19:40.984893 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 19 03:19:40.984893 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:19:40.984893 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group ae09a148-dc6f-48d6-bdba-a75ad88290de could not be found. Oct 19 03:19:40.984893 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:19:40.984893 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:19:40.984893 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:19:40.984893 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:19:40.984893 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:19:40.984893 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:19:40.984893 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:19:40.984893 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:19:40.984893 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group ae09a148-dc6f-48d6-bdba-a75ad88290de could not be found. Oct 19 03:19:40.984893 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:19:40.989427 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-31958a40-4005-4bbb-aac9-af3f86eada6d tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Returning 404 to user: Instance group ae09a148-dc6f-48d6-bdba-a75ad88290de could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:19:40.989427 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-31958a40-4005-4bbb-aac9-af3f86eada6d tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] 10.222.0.52 "DELETE /compute/v2.1/os-server-groups/ae09a148-dc6f-48d6-bdba-a75ad88290de" status: 404 len: 117 microversion: 2.1 time: 0.014475 Oct 19 03:19:40.989427 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 972/1977] 10.222.0.52 () {58 vars in 1266 bytes} [Wed Oct 19 03:19:40 2022] DELETE /compute/v2.1/os-server-groups/ae09a148-dc6f-48d6-bdba-a75ad88290de => generated 117 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:19:40.989427 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-89dbf514-ed25-412a-a35c-9bd6f308bd3b tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:40.989427 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-89dbf514-ed25-412a-a35c-9bd6f308bd3b tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] [instance: 951e236c-943a-4f8c-956d-ac7bbbf0e0e1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:19:40.996117 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-89dbf514-ed25-412a-a35c-9bd6f308bd3b tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:40.997020 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-89dbf514-ed25-412a-a35c-9bd6f308bd3b tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:40.997681 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-89dbf514-ed25-412a-a35c-9bd6f308bd3b tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:40.998399 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-89dbf514-ed25-412a-a35c-9bd6f308bd3b tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:40.998864 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-89dbf514-ed25-412a-a35c-9bd6f308bd3b tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:40.999299 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-89dbf514-ed25-412a-a35c-9bd6f308bd3b tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:41.291351 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-89dbf514-ed25-412a-a35c-9bd6f308bd3b tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ec45c74dcd448e924be40b1abfbc4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce8d13fab4fe4725a4759519818113f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:19:41.299997 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-89dbf514-ed25-412a-a35c-9bd6f308bd3b tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] 10.222.0.52 "GET /compute/v2.1/servers/951e236c-943a-4f8c-956d-ac7bbbf0e0e1" status: 200 len: 1483 microversion: 2.1 time: 0.315490 Oct 19 03:19:41.300608 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 973/1978] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:19:40 2022] GET /compute/v2.1/servers/951e236c-943a-4f8c-956d-ac7bbbf0e0e1 => generated 1483 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:19:41.318430 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-214606e3-7ce5-4d22-a9b6-5bb5a051ee92 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:41.324647 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-214606e3-7ce5-4d22-a9b6-5bb5a051ee92 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] HTTP exception thrown: Instance group fd9f3cf5-88f8-4944-8141-acc17c34f226 could not be found. Oct 19 03:19:41.330387 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-214606e3-7ce5-4d22-a9b6-5bb5a051ee92 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Request method failure captured: Oct 19 03:19:41.330387 n-d-861333-8 devstack@n-api.service[121134]: request: DELETE /compute/v2.1/os-server-groups/fd9f3cf5-88f8-4944-8141-acc17c34f226 HTTP/1.1 Oct 19 03:19:41.330387 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:19:41.330387 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:19:41.330387 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:19:41.330387 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:19:41.330387 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:19:41.330387 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:19:41.330387 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:19:41.330387 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:19:41.330387 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT2ye5hJjpkfHg5URnNEz5b65GDgjKSUozqv5AWCIKOK4GGiQopk5NivbkEiGT8Nc6GsZarz9tkqzNuJ2VVfHrp2Vq292bHl134U9vQWSMkI75jGXRTxH4KRFSCf4wzRpqdpPO0v5ZuMb4rYVdlK1nxmiPHYnf1AE5hiMc5UswIQr0Ug Oct 19 03:19:41.330387 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:19:41.330387 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:19:41.330387 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:19:41.330387 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:19:41.330387 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:19:41.330387 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:19:41.330387 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: facc0913093743d1a5c4c0eb673ce532 Oct 19 03:19:41.330387 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ServerGroupTestJSON-914819200 Oct 19 03:19:41.330387 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:19:41.330387 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:19:41.333566 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/facc0913093743d1a5c4c0eb673ce532"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/facc0913093743d1a5c4c0eb673ce532"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/facc0913093743d1a5c4c0eb673ce532"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_facc0913093743d1a5c4c0eb673ce532", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:19:41.333566 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ServerGroupTestJSON-914819200 Oct 19 03:19:41.333566 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: facc0913093743d1a5c4c0eb673ce532 Oct 19 03:19:41.333566 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ServerGroupTestJSON-914819200 Oct 19 03:19:41.333566 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ServerGroupTestJSON-914819200-project Oct 19 03:19:41.333566 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:19:41.333566 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:19:41.333566 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 8d696202812644f3b1bcb8825fc57420 Oct 19 03:19:41.333566 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ServerGroupTestJSON-914819200-project Oct 19 03:19:41.333566 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:19:41.333566 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance group fd9f3cf5-88f8-4944-8141-acc17c34f226 could not be found. Oct 19 03:19:41.333566 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': 'fd9f3cf5-88f8-4944-8141-acc17c34f226'} Oct 19 03:19:41.335049 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:19:41.335049 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:19:41.335049 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 19 03:19:41.335049 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 19 03:19:41.335049 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 03:19:41.335049 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 03:19:41.335049 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 19 03:19:41.335049 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 19 03:19:41.335049 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 19 03:19:41.335049 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 19 03:19:41.335049 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 19 03:19:41.335049 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 19 03:19:41.335049 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group fd9f3cf5-88f8-4944-8141-acc17c34f226 could not be found. Oct 19 03:19:41.335049 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:19:41.335049 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:19:41.335049 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:19:41.335049 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:19:41.335049 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:19:41.335049 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:19:41.336492 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:19:41.336492 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:19:41.336492 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:19:41.336492 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:19:41.336492 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 19 03:19:41.336492 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:19:41.336492 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group fd9f3cf5-88f8-4944-8141-acc17c34f226 could not be found. Oct 19 03:19:41.336492 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:19:41.336492 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:19:41.336492 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:19:41.336492 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:19:41.336492 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:19:41.336492 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:19:41.336492 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:19:41.336492 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:19:41.336492 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group fd9f3cf5-88f8-4944-8141-acc17c34f226 could not be found. Oct 19 03:19:41.336492 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:19:41.338095 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-214606e3-7ce5-4d22-a9b6-5bb5a051ee92 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Returning 404 to user: Instance group fd9f3cf5-88f8-4944-8141-acc17c34f226 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:19:41.338095 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-214606e3-7ce5-4d22-a9b6-5bb5a051ee92 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] 10.222.0.52 "DELETE /compute/v2.1/os-server-groups/fd9f3cf5-88f8-4944-8141-acc17c34f226" status: 404 len: 117 microversion: 2.1 time: 0.019750 Oct 19 03:19:41.338095 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 974/1979] 10.222.0.52 () {58 vars in 1266 bytes} [Wed Oct 19 03:19:41 2022] DELETE /compute/v2.1/os-server-groups/fd9f3cf5-88f8-4944-8141-acc17c34f226 => generated 117 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:19:41.340216 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-bc775b86-b389-4e39-9e93-6ef359984f7a tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:41.340697 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-bc775b86-b389-4e39-9e93-6ef359984f7a tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] [instance: 19fbcbe2-9039-4d18-94ef-51ce58cb6365] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:19:41.349875 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bc775b86-b389-4e39-9e93-6ef359984f7a tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:41.350412 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bc775b86-b389-4e39-9e93-6ef359984f7a tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:41.350817 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bc775b86-b389-4e39-9e93-6ef359984f7a tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:41.351692 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bc775b86-b389-4e39-9e93-6ef359984f7a tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:41.351968 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bc775b86-b389-4e39-9e93-6ef359984f7a tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:41.352428 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bc775b86-b389-4e39-9e93-6ef359984f7a tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:41.562203 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-bc775b86-b389-4e39-9e93-6ef359984f7a tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4c5e4123c44508a5d4911a17c44231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a495ccfced47f29cb928d1ded20d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:19:41.580791 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-bc775b86-b389-4e39-9e93-6ef359984f7a tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] 10.222.0.52 "GET /compute/v2.1/servers/19fbcbe2-9039-4d18-94ef-51ce58cb6365" status: 200 len: 1314 microversion: 2.1 time: 0.245986 Oct 19 03:19:41.581420 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 975/1980] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:19:41 2022] GET /compute/v2.1/servers/19fbcbe2-9039-4d18-94ef-51ce58cb6365 => generated 1314 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:19:41.592667 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0ec743dc-8096-46f8-92ca-991d0a74508c tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:41.592667 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0ec743dc-8096-46f8-92ca-991d0a74508c tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] [instance: 951e236c-943a-4f8c-956d-ac7bbbf0e0e1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:19:41.595443 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0ec743dc-8096-46f8-92ca-991d0a74508c tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:41.596453 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0ec743dc-8096-46f8-92ca-991d0a74508c tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:41.597279 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0ec743dc-8096-46f8-92ca-991d0a74508c tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:41.598072 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0ec743dc-8096-46f8-92ca-991d0a74508c tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:41.598552 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0ec743dc-8096-46f8-92ca-991d0a74508c tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:41.599214 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0ec743dc-8096-46f8-92ca-991d0a74508c tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:41.718196 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0ec743dc-8096-46f8-92ca-991d0a74508c tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] 10.222.0.52 "GET /compute/v2.1/servers/951e236c-943a-4f8c-956d-ac7bbbf0e0e1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.134821 Oct 19 03:19:41.718791 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 976/1981] 10.222.0.52 () {58 vars in 1275 bytes} [Wed Oct 19 03:19:41 2022] GET /compute/v2.1/servers/951e236c-943a-4f8c-956d-ac7bbbf0e0e1/os-interface => generated 284 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:19:41.723651 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-52a500f9-1bbe-47bd-a9ed-c58098b74769 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:41.837612 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-52a500f9-1bbe-47bd-a9ed-c58098b74769 tempest-ServerGroupTestJSON-914819200 tempest-ServerGroupTestJSON-914819200-project] 10.222.0.52 "DELETE /compute/v2.1/os-server-groups/ace44ace-7b31-4c74-a514-9477f4bf86cd" status: 204 len: 0 microversion: 2.1 time: 0.117726 Oct 19 03:19:41.838927 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 977/1982] 10.222.0.52 () {58 vars in 1266 bytes} [Wed Oct 19 03:19:41 2022] DELETE /compute/v2.1/os-server-groups/ace44ace-7b31-4c74-a514-9477f4bf86cd => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:19:41.847567 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2694dc09-797b-45a5-be09-4150114e121c tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:41.847567 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2694dc09-797b-45a5-be09-4150114e121c tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] [instance: d6d507e4-3a53-4734-bb88-8fc38efa4d9b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:19:41.858258 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2694dc09-797b-45a5-be09-4150114e121c tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:41.858888 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2694dc09-797b-45a5-be09-4150114e121c tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:41.859708 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2694dc09-797b-45a5-be09-4150114e121c tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:41.860506 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2694dc09-797b-45a5-be09-4150114e121c tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:41.861058 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2694dc09-797b-45a5-be09-4150114e121c tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:41.861622 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2694dc09-797b-45a5-be09-4150114e121c tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:42.140769 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-2694dc09-797b-45a5-be09-4150114e121c tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8824f20e6a1f478a99f90e1ba8f028fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e436373e9e45efa03f08b33da619e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:19:42.152726 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2694dc09-797b-45a5-be09-4150114e121c tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] 10.222.0.52 "GET /compute/v2.1/servers/d6d507e4-3a53-4734-bb88-8fc38efa4d9b" status: 200 len: 1324 microversion: 2.1 time: 0.312126 Oct 19 03:19:42.153877 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 978/1983] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:19:41 2022] GET /compute/v2.1/servers/d6d507e4-3a53-4734-bb88-8fc38efa4d9b => generated 1324 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:19:42.176654 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4be93755-d878-435b-a9cf-2626ee2844c6 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:42.178185 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4be93755-d878-435b-a9cf-2626ee2844c6 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] [instance: b97f61ab-18fc-4cf6-bc15-ec08ac4750fd] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:19:42.205985 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4be93755-d878-435b-a9cf-2626ee2844c6 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:42.207371 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4be93755-d878-435b-a9cf-2626ee2844c6 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:42.207828 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4be93755-d878-435b-a9cf-2626ee2844c6 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:42.208604 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4be93755-d878-435b-a9cf-2626ee2844c6 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:42.213832 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4be93755-d878-435b-a9cf-2626ee2844c6 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:42.213832 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4be93755-d878-435b-a9cf-2626ee2844c6 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:42.959664 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-4be93755-d878-435b-a9cf-2626ee2844c6 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac711151c0334c62958e7f2ec431d860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5d239ae4b24b7e978935fe9b3458cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:19:42.969992 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4be93755-d878-435b-a9cf-2626ee2844c6 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] 10.222.0.52 "GET /compute/v2.1/servers/b97f61ab-18fc-4cf6-bc15-ec08ac4750fd" status: 200 len: 1324 microversion: 2.1 time: 0.801957 Oct 19 03:19:42.970672 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 979/1984] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:19:42 2022] GET /compute/v2.1/servers/b97f61ab-18fc-4cf6-bc15-ec08ac4750fd => generated 1324 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:19:42.977424 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0487fa4e-6e1c-4e8a-b1a6-ec17349c35af tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:42.978059 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0487fa4e-6e1c-4e8a-b1a6-ec17349c35af tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] [instance: 19fbcbe2-9039-4d18-94ef-51ce58cb6365] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:19:42.987842 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0487fa4e-6e1c-4e8a-b1a6-ec17349c35af tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:42.988752 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0487fa4e-6e1c-4e8a-b1a6-ec17349c35af tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:42.989398 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0487fa4e-6e1c-4e8a-b1a6-ec17349c35af tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:42.991553 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0487fa4e-6e1c-4e8a-b1a6-ec17349c35af tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:42.992210 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0487fa4e-6e1c-4e8a-b1a6-ec17349c35af tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:42.993080 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0487fa4e-6e1c-4e8a-b1a6-ec17349c35af tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:43.379114 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0487fa4e-6e1c-4e8a-b1a6-ec17349c35af tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4c5e4123c44508a5d4911a17c44231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a495ccfced47f29cb928d1ded20d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:19:43.402978 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0487fa4e-6e1c-4e8a-b1a6-ec17349c35af tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] 10.222.0.52 "GET /compute/v2.1/servers/19fbcbe2-9039-4d18-94ef-51ce58cb6365" status: 200 len: 1314 microversion: 2.1 time: 0.424810 Oct 19 03:19:43.403863 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 980/1985] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:19:42 2022] GET /compute/v2.1/servers/19fbcbe2-9039-4d18-94ef-51ce58cb6365 => generated 1314 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:19:43.421278 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.network.neutron [None req-0d3c5a1c-0195-448a-a028-ce84c9c5e864 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] [instance: c6e2a8e3-4589-4037-b0d8-032541d043e3] Building network info cache for instance {{(pid=121135) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 19 03:19:43.423325 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-09b2b682-712d-4e83-af7a-77c64a72586a tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:43.424134 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-09b2b682-712d-4e83-af7a-77c64a72586a tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] [instance: d6d507e4-3a53-4734-bb88-8fc38efa4d9b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:19:43.435941 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-09b2b682-712d-4e83-af7a-77c64a72586a tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:43.436643 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-09b2b682-712d-4e83-af7a-77c64a72586a tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:43.437324 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-09b2b682-712d-4e83-af7a-77c64a72586a tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:43.438275 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-09b2b682-712d-4e83-af7a-77c64a72586a tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:43.438898 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-09b2b682-712d-4e83-af7a-77c64a72586a tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:43.441505 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-09b2b682-712d-4e83-af7a-77c64a72586a tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:43.902379 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=4 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:19:43.934043 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-09b2b682-712d-4e83-af7a-77c64a72586a tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8824f20e6a1f478a99f90e1ba8f028fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e436373e9e45efa03f08b33da619e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:19:43.950840 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-09b2b682-712d-4e83-af7a-77c64a72586a tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] 10.222.0.52 "GET /compute/v2.1/servers/d6d507e4-3a53-4734-bb88-8fc38efa4d9b" status: 200 len: 1521 microversion: 2.1 time: 0.540938 Oct 19 03:19:43.968967 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 981/1986] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:19:43 2022] GET /compute/v2.1/servers/d6d507e4-3a53-4734-bb88-8fc38efa4d9b => generated 1521 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:19:43.980913 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-c573f02a-0b5d-4c3e-a989-0a70ff75f735 req-7bc4b02b-e7dc-4cb5-8cf3-b6fa0e72f269 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6e2a8e3-4589-4037-b0d8-032541d043e3", "tag": "b8014d15-27b1-4267-af57-17ae32c38543"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:19:43.998915 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-c573f02a-0b5d-4c3e-a989-0a70ff75f735 req-7bc4b02b-e7dc-4cb5-8cf3-b6fa0e72f269 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:44.000721 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-c573f02a-0b5d-4c3e-a989-0a70ff75f735 req-7bc4b02b-e7dc-4cb5-8cf3-b6fa0e72f269 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:44.001434 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-c573f02a-0b5d-4c3e-a989-0a70ff75f735 req-7bc4b02b-e7dc-4cb5-8cf3-b6fa0e72f269 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:44.020323 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-c573f02a-0b5d-4c3e-a989-0a70ff75f735 req-7bc4b02b-e7dc-4cb5-8cf3-b6fa0e72f269 service nova] Creating event network-changed:b8014d15-27b1-4267-af57-17ae32c38543 for instance c6e2a8e3-4589-4037-b0d8-032541d043e3 on n-h1-861333-8 Oct 19 03:19:44.028664 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-c573f02a-0b5d-4c3e-a989-0a70ff75f735 req-7bc4b02b-e7dc-4cb5-8cf3-b6fa0e72f269 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057132 Oct 19 03:19:44.030316 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 982/1987] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:19:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:19:44.039314 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-49b69f7d-d2f1-44ea-a9b5-1b509af8926f tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:44.042514 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-49b69f7d-d2f1-44ea-a9b5-1b509af8926f tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] [instance: d6d507e4-3a53-4734-bb88-8fc38efa4d9b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:19:44.051420 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-49b69f7d-d2f1-44ea-a9b5-1b509af8926f tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:44.053230 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-49b69f7d-d2f1-44ea-a9b5-1b509af8926f tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:44.054021 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-49b69f7d-d2f1-44ea-a9b5-1b509af8926f tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:44.055455 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-49b69f7d-d2f1-44ea-a9b5-1b509af8926f tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:44.056421 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-49b69f7d-d2f1-44ea-a9b5-1b509af8926f tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:44.057077 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-49b69f7d-d2f1-44ea-a9b5-1b509af8926f tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:44.626290 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-49b69f7d-d2f1-44ea-a9b5-1b509af8926f tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8824f20e6a1f478a99f90e1ba8f028fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e436373e9e45efa03f08b33da619e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:19:44.649518 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-49b69f7d-d2f1-44ea-a9b5-1b509af8926f tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] 10.222.0.52 "GET /compute/v2.1/servers/d6d507e4-3a53-4734-bb88-8fc38efa4d9b" status: 200 len: 1521 microversion: 2.1 time: 0.610704 Oct 19 03:19:44.655459 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 983/1988] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:19:44 2022] GET /compute/v2.1/servers/d6d507e4-3a53-4734-bb88-8fc38efa4d9b => generated 1521 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:19:44.666655 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3633e224-bc6c-4939-8f8e-9c49d5d77eb1 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:44.669441 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3633e224-bc6c-4939-8f8e-9c49d5d77eb1 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] [instance: b97f61ab-18fc-4cf6-bc15-ec08ac4750fd] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:19:44.695117 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3633e224-bc6c-4939-8f8e-9c49d5d77eb1 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:44.695783 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3633e224-bc6c-4939-8f8e-9c49d5d77eb1 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:44.696238 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3633e224-bc6c-4939-8f8e-9c49d5d77eb1 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:44.696964 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3633e224-bc6c-4939-8f8e-9c49d5d77eb1 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:44.697452 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3633e224-bc6c-4939-8f8e-9c49d5d77eb1 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:44.697891 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3633e224-bc6c-4939-8f8e-9c49d5d77eb1 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:44.710810 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=100 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:19:45.105794 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.network.neutron [None req-0d3c5a1c-0195-448a-a028-ce84c9c5e864 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] [instance: c6e2a8e3-4589-4037-b0d8-032541d043e3] Updating instance_info_cache with network_info: [{"id": "b8014d15-27b1-4267-af57-17ae32c38543", "address": "fa:16:3e:69:98:73", "network": {"id": "6eca3c34-0678-44d9-9b9a-0e414ced6160", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1455367799-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.7.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "be25c3ef65114ccc83b335b938743e90", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapb8014d15-27", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=121135) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 19 03:19:45.171970 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-3633e224-bc6c-4939-8f8e-9c49d5d77eb1 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac711151c0334c62958e7f2ec431d860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5d239ae4b24b7e978935fe9b3458cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:19:45.174643 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:19:45.200875 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3633e224-bc6c-4939-8f8e-9c49d5d77eb1 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] 10.222.0.52 "GET /compute/v2.1/servers/b97f61ab-18fc-4cf6-bc15-ec08ac4750fd" status: 200 len: 1324 microversion: 2.1 time: 0.544531 Oct 19 03:19:45.201818 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 984/1989] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:19:44 2022] GET /compute/v2.1/servers/b97f61ab-18fc-4cf6-bc15-ec08ac4750fd => generated 1324 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:19:45.206925 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1e02dc81-aba3-40ea-84ff-299cb78f68e6 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:45.207551 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1e02dc81-aba3-40ea-84ff-299cb78f68e6 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] [instance: 19fbcbe2-9039-4d18-94ef-51ce58cb6365] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:19:45.217178 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1e02dc81-aba3-40ea-84ff-299cb78f68e6 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:45.217724 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1e02dc81-aba3-40ea-84ff-299cb78f68e6 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:45.218178 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1e02dc81-aba3-40ea-84ff-299cb78f68e6 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:45.218984 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1e02dc81-aba3-40ea-84ff-299cb78f68e6 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:45.219448 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1e02dc81-aba3-40ea-84ff-299cb78f68e6 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:45.219882 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1e02dc81-aba3-40ea-84ff-299cb78f68e6 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:45.230772 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=6 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:19:45.270011 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0d3c5a1c-0195-448a-a028-ce84c9c5e864 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Releasing lock "refresh_cache-c6e2a8e3-4589-4037-b0d8-032541d043e3" {{(pid=121135) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 19 03:19:45.271624 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0d3c5a1c-0195-448a-a028-ce84c9c5e864 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] 10.222.0.52 "POST /compute/v2.1/servers/c6e2a8e3-4589-4037-b0d8-032541d043e3/action" status: 202 len: 0 microversion: 2.1 time: 4.443335 Oct 19 03:19:45.272614 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1006/1990] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:19:40 2022] POST /compute/v2.1/servers/c6e2a8e3-4589-4037-b0d8-032541d043e3/action => generated 0 bytes in 4445 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 19 03:19:45.286011 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0893599b-867b-411d-aa03-3856105f04b1 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:45.286011 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0893599b-867b-411d-aa03-3856105f04b1 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] [instance: 951e236c-943a-4f8c-956d-ac7bbbf0e0e1] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:19:45.294491 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0893599b-867b-411d-aa03-3856105f04b1 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:45.297709 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0893599b-867b-411d-aa03-3856105f04b1 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:45.298292 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0893599b-867b-411d-aa03-3856105f04b1 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:45.299127 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0893599b-867b-411d-aa03-3856105f04b1 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:45.299676 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0893599b-867b-411d-aa03-3856105f04b1 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:45.305404 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0893599b-867b-411d-aa03-3856105f04b1 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:45.801578 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-0893599b-867b-411d-aa03-3856105f04b1 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ec45c74dcd448e924be40b1abfbc4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce8d13fab4fe4725a4759519818113f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:19:45.808112 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-1e02dc81-aba3-40ea-84ff-299cb78f68e6 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4c5e4123c44508a5d4911a17c44231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a495ccfced47f29cb928d1ded20d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:19:45.832351 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1e02dc81-aba3-40ea-84ff-299cb78f68e6 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] 10.222.0.52 "GET /compute/v2.1/servers/19fbcbe2-9039-4d18-94ef-51ce58cb6365" status: 200 len: 1314 microversion: 2.1 time: 0.628997 Oct 19 03:19:45.833120 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0893599b-867b-411d-aa03-3856105f04b1 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] 10.222.0.52 "GET /compute/v2.1/servers/951e236c-943a-4f8c-956d-ac7bbbf0e0e1" status: 200 len: 1483 microversion: 2.1 time: 0.555215 Oct 19 03:19:45.835570 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1007/1991] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:19:45 2022] GET /compute/v2.1/servers/951e236c-943a-4f8c-956d-ac7bbbf0e0e1 => generated 1483 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:19:45.852999 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 985/1992] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:19:45 2022] GET /compute/v2.1/servers/19fbcbe2-9039-4d18-94ef-51ce58cb6365 => generated 1314 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:19:45.882145 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-b21e754a-2103-4f09-86be-5481adeaf550 req-3f9769aa-5994-4291-8803-402629d1ec46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "951e236c-943a-4f8c-956d-ac7bbbf0e0e1", "tag": "d95bdec8-e9af-43f6-8904-996c4e694095"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:19:45.884841 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-55c89166-281f-4997-ad68-6c185b4dc65f tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-6572325", "metadata": {"": ""}}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:19:45.894260 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-55c89166-281f-4997-ad68-6c185b4dc65f tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Request method failure captured: Oct 19 03:19:45.894260 n-d-861333-8 devstack@n-api.service[121134]: request: POST /compute/v2.1/servers/d6d507e4-3a53-4734-bb88-8fc38efa4d9b/action HTTP/1.1 Oct 19 03:19:45.894260 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:19:45.894260 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:19:45.894260 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:19:45.894260 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 104 Oct 19 03:19:45.894260 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:19:45.894260 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:19:45.894260 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:19:45.894260 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:19:45.894260 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT2y5QS5fGXOCh8dCARu_-t2vnckF3uwZtfqi9DmHed6pMoXibNoREyH_7cDYk3t8P2qbQ1u564D6Sq50msRMl2YQVddoWmeJm48OR72Wl7OECfXwMpGVDHULH4PSkCmyy31jkBvdZSxqyCmIGP32xNgLbjMxF4SrMQTDektLd28zxNg Oct 19 03:19:45.894260 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:19:45.894260 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:19:45.894260 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:19:45.894260 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:19:45.894260 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:19:45.894260 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:19:45.894260 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: f9e436373e9e45efa03f08b33da619e8 Oct 19 03:19:45.894260 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1767182949 Oct 19 03:19:45.894260 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:19:45.894260 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:19:45.895961 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f9e436373e9e45efa03f08b33da619e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f9e436373e9e45efa03f08b33da619e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f9e436373e9e45efa03f08b33da619e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f9e436373e9e45efa03f08b33da619e8", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:19:45.895961 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1767182949 Oct 19 03:19:45.895961 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: f9e436373e9e45efa03f08b33da619e8 Oct 19 03:19:45.895961 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1767182949 Oct 19 03:19:45.895961 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ImagesOneServerNegativeTestJSON-1767182949-project Oct 19 03:19:45.895961 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:19:45.895961 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:19:45.895961 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 8824f20e6a1f478a99f90e1ba8f028fe Oct 19 03:19:45.895961 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1767182949-project Oct 19 03:19:45.895961 n-d-861333-8 devstack@n-api.service[121134]: Oct 19 03:19:45.895961 n-d-861333-8 devstack@n-api.service[121134]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-6572325", "metadata": {"": ""}}} Oct 19 03:19:45.895961 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:19:45.904234 n-d-861333-8 devstack@n-api.service[121134]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 19 03:19:45.904234 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': 'd6d507e4-3a53-4734-bb88-8fc38efa4d9b', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-6572325', 'metadata': {'': ''}}}} Oct 19 03:19:45.904234 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:19:45.904234 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:19:45.904234 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 03:19:45.904234 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 03:19:45.904234 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 03:19:45.904234 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise error Oct 19 03:19:45.904234 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 19 03:19:45.904234 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:19:45.904234 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 19 03:19:45.904234 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 19 03:19:45.904234 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 19 03:19:45.904234 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 19 03:19:45.904234 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 19 03:19:45.904234 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:19:45.904234 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 19 03:19:45.904234 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi {'': ''} Oct 19 03:19:45.904234 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:19:45.904234 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:19:45.904234 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:19:45.905819 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:19:45.905819 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:19:45.905819 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:19:45.905819 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:19:45.905819 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:19:45.905819 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:19:45.905819 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:19:45.905819 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:19:45.905819 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:19:45.905819 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 03:19:45.905819 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 03:19:45.905819 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 03:19:45.905819 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 03:19:45.905819 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 03:19:45.905819 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 03:19:45.905819 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 19 03:19:45.905819 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:19:45.905819 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:19:45.905819 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:19:45.905819 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:19:45.907221 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:19:45.907221 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:19:45.907221 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 03:19:45.907221 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 03:19:45.907221 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 19 03:19:45.907221 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:19:45.907221 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-55c89166-281f-4997-ad68-6c185b4dc65f tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:19:45.907221 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-55c89166-281f-4997-ad68-6c185b4dc65f tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] 10.222.0.52 "POST /compute/v2.1/servers/d6d507e4-3a53-4734-bb88-8fc38efa4d9b/action" status: 400 len: 170 microversion: 2.1 time: 0.042379 Oct 19 03:19:45.907221 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 986/1993] 10.222.0.52 () {60 vars in 1279 bytes} [Wed Oct 19 03:19:45 2022] POST /compute/v2.1/servers/d6d507e4-3a53-4734-bb88-8fc38efa4d9b/action => generated 170 bytes in 44 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 03:19:45.907919 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=16 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:19:45.908966 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-b21e754a-2103-4f09-86be-5481adeaf550 req-3f9769aa-5994-4291-8803-402629d1ec46 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:45.912471 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-b21e754a-2103-4f09-86be-5481adeaf550 req-3f9769aa-5994-4291-8803-402629d1ec46 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:45.913279 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-b21e754a-2103-4f09-86be-5481adeaf550 req-3f9769aa-5994-4291-8803-402629d1ec46 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:45.927326 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-44ae9210-c172-4a3e-8e24-af6d794bb72b tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Action: 'create', calling method: .version_select at 0x7fc1350153a0>, body: {"pool": "1475da2c-80a2-478b-b6c8-7f7c0e5426d1"} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:19:45.960161 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-b21e754a-2103-4f09-86be-5481adeaf550 req-3f9769aa-5994-4291-8803-402629d1ec46 service nova] Creating event network-changed:d95bdec8-e9af-43f6-8904-996c4e694095 for instance 951e236c-943a-4f8c-956d-ac7bbbf0e0e1 on n-h2-861333-8 Oct 19 03:19:45.970367 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-b21e754a-2103-4f09-86be-5481adeaf550 req-3f9769aa-5994-4291-8803-402629d1ec46 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107377 Oct 19 03:19:45.971479 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1008/1994] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:19:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:19:46.007869 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-893767f1-908a-43f6-a506-ebe3ce0f448c tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:46.007869 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-893767f1-908a-43f6-a506-ebe3ce0f448c tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] [instance: d6d507e4-3a53-4734-bb88-8fc38efa4d9b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:19:46.012664 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-893767f1-908a-43f6-a506-ebe3ce0f448c tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:46.013468 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-893767f1-908a-43f6-a506-ebe3ce0f448c tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:46.014182 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-893767f1-908a-43f6-a506-ebe3ce0f448c tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:46.015063 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-893767f1-908a-43f6-a506-ebe3ce0f448c tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:46.016044 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-893767f1-908a-43f6-a506-ebe3ce0f448c tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:46.016486 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-893767f1-908a-43f6-a506-ebe3ce0f448c tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:46.572528 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-893767f1-908a-43f6-a506-ebe3ce0f448c tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8824f20e6a1f478a99f90e1ba8f028fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e436373e9e45efa03f08b33da619e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:19:46.583602 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-893767f1-908a-43f6-a506-ebe3ce0f448c tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] 10.222.0.52 "GET /compute/v2.1/servers/d6d507e4-3a53-4734-bb88-8fc38efa4d9b" status: 200 len: 1521 microversion: 2.1 time: 0.610800 Oct 19 03:19:46.586871 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1009/1995] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:19:45 2022] GET /compute/v2.1/servers/d6d507e4-3a53-4734-bb88-8fc38efa4d9b => generated 1521 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:19:46.608315 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-852f7748-9f9e-4a40-91a9-2cc0141890af req-294ca80c-e22c-4682-9d22-28f2c449b12c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6888c8db-82ba-4072-b431-8d4fcf5f03e0", "tag": "7d06606b-5258-42bd-89b9-3f972fa9dcda"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:19:46.648038 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-852f7748-9f9e-4a40-91a9-2cc0141890af req-294ca80c-e22c-4682-9d22-28f2c449b12c service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:46.650037 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-852f7748-9f9e-4a40-91a9-2cc0141890af req-294ca80c-e22c-4682-9d22-28f2c449b12c service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:46.650658 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-852f7748-9f9e-4a40-91a9-2cc0141890af req-294ca80c-e22c-4682-9d22-28f2c449b12c service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:46.691454 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-852f7748-9f9e-4a40-91a9-2cc0141890af req-294ca80c-e22c-4682-9d22-28f2c449b12c service nova] Creating event network-changed:7d06606b-5258-42bd-89b9-3f972fa9dcda for instance 6888c8db-82ba-4072-b431-8d4fcf5f03e0 on n-h1-861333-8 Oct 19 03:19:46.705987 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-852f7748-9f9e-4a40-91a9-2cc0141890af req-294ca80c-e22c-4682-9d22-28f2c449b12c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114203 Oct 19 03:19:46.708141 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1010/1996] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:19:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:19:46.733059 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9d377c29-32ba-4a86-b157-b994677b9fe1 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:46.733814 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9d377c29-32ba-4a86-b157-b994677b9fe1 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] [instance: b97f61ab-18fc-4cf6-bc15-ec08ac4750fd] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:19:46.748997 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9d377c29-32ba-4a86-b157-b994677b9fe1 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:46.755444 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9d377c29-32ba-4a86-b157-b994677b9fe1 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:46.756253 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9d377c29-32ba-4a86-b157-b994677b9fe1 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:46.757447 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9d377c29-32ba-4a86-b157-b994677b9fe1 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:46.758149 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9d377c29-32ba-4a86-b157-b994677b9fe1 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:46.758787 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9d377c29-32ba-4a86-b157-b994677b9fe1 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:47.272131 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-9d377c29-32ba-4a86-b157-b994677b9fe1 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac711151c0334c62958e7f2ec431d860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5d239ae4b24b7e978935fe9b3458cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:19:47.287641 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9d377c29-32ba-4a86-b157-b994677b9fe1 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] 10.222.0.52 "GET /compute/v2.1/servers/b97f61ab-18fc-4cf6-bc15-ec08ac4750fd" status: 200 len: 1324 microversion: 2.1 time: 0.577134 Oct 19 03:19:47.302674 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1011/1997] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:19:46 2022] GET /compute/v2.1/servers/b97f61ab-18fc-4cf6-bc15-ec08ac4750fd => generated 1324 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:19:47.311382 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-57a510b0-6fc1-40f7-8bf8-7d5b392b08f5 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:47.312005 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-57a510b0-6fc1-40f7-8bf8-7d5b392b08f5 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] [instance: d6d507e4-3a53-4734-bb88-8fc38efa4d9b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:19:47.330962 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-57a510b0-6fc1-40f7-8bf8-7d5b392b08f5 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:47.331723 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-57a510b0-6fc1-40f7-8bf8-7d5b392b08f5 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:47.333053 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-57a510b0-6fc1-40f7-8bf8-7d5b392b08f5 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:47.333983 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-57a510b0-6fc1-40f7-8bf8-7d5b392b08f5 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:47.334611 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-57a510b0-6fc1-40f7-8bf8-7d5b392b08f5 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:47.335415 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-57a510b0-6fc1-40f7-8bf8-7d5b392b08f5 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:47.340982 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:19:47.711562 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-57a510b0-6fc1-40f7-8bf8-7d5b392b08f5 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8824f20e6a1f478a99f90e1ba8f028fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e436373e9e45efa03f08b33da619e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:19:47.722390 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-57a510b0-6fc1-40f7-8bf8-7d5b392b08f5 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] 10.222.0.52 "GET /compute/v2.1/servers/d6d507e4-3a53-4734-bb88-8fc38efa4d9b" status: 200 len: 1521 microversion: 2.1 time: 0.414795 Oct 19 03:19:47.726227 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1012/1998] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:19:47 2022] GET /compute/v2.1/servers/d6d507e4-3a53-4734-bb88-8fc38efa4d9b => generated 1521 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:19:47.733418 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4c396b65-fa85-4f3a-937f-3fcd8473e663 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:47.734437 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4c396b65-fa85-4f3a-937f-3fcd8473e663 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] [instance: 19fbcbe2-9039-4d18-94ef-51ce58cb6365] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:19:47.756998 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4c396b65-fa85-4f3a-937f-3fcd8473e663 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:47.765782 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4c396b65-fa85-4f3a-937f-3fcd8473e663 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:47.766319 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4c396b65-fa85-4f3a-937f-3fcd8473e663 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:47.770018 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4c396b65-fa85-4f3a-937f-3fcd8473e663 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:47.770631 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4c396b65-fa85-4f3a-937f-3fcd8473e663 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:47.771621 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4c396b65-fa85-4f3a-937f-3fcd8473e663 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:48.352584 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4c396b65-fa85-4f3a-937f-3fcd8473e663 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4c5e4123c44508a5d4911a17c44231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a495ccfced47f29cb928d1ded20d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:19:48.362670 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4c396b65-fa85-4f3a-937f-3fcd8473e663 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] 10.222.0.52 "GET /compute/v2.1/servers/19fbcbe2-9039-4d18-94ef-51ce58cb6365" status: 200 len: 1314 microversion: 2.1 time: 0.634829 Oct 19 03:19:48.363927 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1013/1999] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:19:47 2022] GET /compute/v2.1/servers/19fbcbe2-9039-4d18-94ef-51ce58cb6365 => generated 1314 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:19:48.371735 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-ff4120bc-8b30-4109-8e73-fd69c07c671d req-4691f668-038a-44da-b2e4-69c44572c7f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b97f61ab-18fc-4cf6-bc15-ec08ac4750fd", "name": "network-vif-plugged", "status": "completed", "tag": "bcf93ca2-3c93-402b-9421-7ee5460dace0"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:19:48.384982 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-ff4120bc-8b30-4109-8e73-fd69c07c671d req-4691f668-038a-44da-b2e4-69c44572c7f9 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:48.385494 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-ff4120bc-8b30-4109-8e73-fd69c07c671d req-4691f668-038a-44da-b2e4-69c44572c7f9 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:48.385934 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-ff4120bc-8b30-4109-8e73-fd69c07c671d req-4691f668-038a-44da-b2e4-69c44572c7f9 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:48.399344 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-ff4120bc-8b30-4109-8e73-fd69c07c671d req-4691f668-038a-44da-b2e4-69c44572c7f9 service nova] Creating event network-vif-plugged:bcf93ca2-3c93-402b-9421-7ee5460dace0 for instance b97f61ab-18fc-4cf6-bc15-ec08ac4750fd on n-h1-861333-8 Oct 19 03:19:48.406195 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-ff4120bc-8b30-4109-8e73-fd69c07c671d req-4691f668-038a-44da-b2e4-69c44572c7f9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039934 Oct 19 03:19:48.407251 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1014/2000] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:19:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:19:48.417029 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-73a5e14f-98da-403b-b8dd-476df0e689c0 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1391968217", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:19:48.422091 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-73a5e14f-98da-403b-b8dd-476df0e689c0 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Request method failure captured: Oct 19 03:19:48.422091 n-d-861333-8 devstack@n-api.service[121135]: request: POST /compute/v2.1/servers/d6d507e4-3a53-4734-bb88-8fc38efa4d9b/action HTTP/1.1 Oct 19 03:19:48.422091 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:19:48.422091 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:19:48.422091 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:19:48.422091 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 619 Oct 19 03:19:48.422091 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:19:48.422091 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:19:48.422091 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:19:48.422091 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:19:48.422091 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2y5QS5fGXOCh8dCARu_-t2vnckF3uwZtfqi9DmHed6pMoXibNoREyH_7cDYk3t8P2qbQ1u564D6Sq50msRMl2YQVddoWmeJm48OR72Wl7OECfXwMpGVDHULH4PSkCmyy31jkBvdZSxqyCmIGP32xNgLbjMxF4SrMQTDektLd28zxNg Oct 19 03:19:48.422091 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:19:48.422091 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:19:48.422091 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:19:48.422091 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:19:48.422091 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:19:48.422091 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:19:48.422091 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: f9e436373e9e45efa03f08b33da619e8 Oct 19 03:19:48.422091 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1767182949 Oct 19 03:19:48.422091 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:19:48.422091 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:19:48.423952 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f9e436373e9e45efa03f08b33da619e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f9e436373e9e45efa03f08b33da619e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f9e436373e9e45efa03f08b33da619e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f9e436373e9e45efa03f08b33da619e8", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:19:48.423952 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1767182949 Oct 19 03:19:48.423952 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: f9e436373e9e45efa03f08b33da619e8 Oct 19 03:19:48.423952 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1767182949 Oct 19 03:19:48.423952 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ImagesOneServerNegativeTestJSON-1767182949-project Oct 19 03:19:48.423952 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:19:48.423952 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:19:48.423952 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 8824f20e6a1f478a99f90e1ba8f028fe Oct 19 03:19:48.423952 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1767182949-project Oct 19 03:19:48.423952 n-d-861333-8 devstack@n-api.service[121135]: Oct 19 03:19:48.424851 n-d-861333-8 devstack@n-api.service[121135]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1391968217", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Oct 19 03:19:48.424851 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:19:48.424851 n-d-861333-8 devstack@n-api.service[121135]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 19 03:19:48.425159 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': 'd6d507e4-3a53-4734-bb88-8fc38efa4d9b', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1391968217', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Oct 19 03:19:48.425159 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:19:48.425159 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:19:48.425159 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 03:19:48.425159 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 03:19:48.425159 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 03:19:48.425159 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise error Oct 19 03:19:48.425159 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 19 03:19:48.425159 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:19:48.425159 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 19 03:19:48.425159 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 19 03:19:48.426159 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 19 03:19:48.426159 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 19 03:19:48.426159 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 19 03:19:48.426159 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:19:48.426159 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 19 03:19:48.426159 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Oct 19 03:19:48.426159 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:19:48.426159 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:19:48.426159 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:19:48.426159 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:19:48.426159 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:19:48.426159 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:19:48.426159 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:19:48.426159 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:19:48.426159 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:19:48.426159 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:19:48.426159 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:19:48.427990 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:19:48.427990 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 03:19:48.427990 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 03:19:48.427990 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 03:19:48.427990 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 03:19:48.427990 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 03:19:48.427990 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 03:19:48.427990 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 19 03:19:48.427990 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:19:48.427990 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:19:48.427990 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:19:48.427990 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:19:48.428882 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:19:48.428882 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:19:48.428882 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 03:19:48.428882 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 03:19:48.428882 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 19 03:19:48.428882 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:19:48.429342 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-73a5e14f-98da-403b-b8dd-476df0e689c0 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:19:48.429342 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-73a5e14f-98da-403b-b8dd-476df0e689c0 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] 10.222.0.52 "POST /compute/v2.1/servers/d6d507e4-3a53-4734-bb88-8fc38efa4d9b/action" status: 400 len: 938 microversion: 2.1 time: 0.016356 Oct 19 03:19:48.429342 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1015/2001] 10.222.0.52 () {60 vars in 1279 bytes} [Wed Oct 19 03:19:48 2022] POST /compute/v2.1/servers/d6d507e4-3a53-4734-bb88-8fc38efa4d9b/action => generated 938 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 03:19:48.433022 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-62ab1bce-eeee-40bf-ad9b-578ab1ef3532 req-4bf922ef-9f5f-42a0-8fa8-bcf06c652ed1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19fbcbe2-9039-4d18-94ef-51ce58cb6365", "tag": "9630ac60-448c-49d9-b986-9926a85b1f58"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:19:48.445171 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-62ab1bce-eeee-40bf-ad9b-578ab1ef3532 req-4bf922ef-9f5f-42a0-8fa8-bcf06c652ed1 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:48.446051 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-62ab1bce-eeee-40bf-ad9b-578ab1ef3532 req-4bf922ef-9f5f-42a0-8fa8-bcf06c652ed1 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:48.447028 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-62ab1bce-eeee-40bf-ad9b-578ab1ef3532 req-4bf922ef-9f5f-42a0-8fa8-bcf06c652ed1 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:48.459276 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-62ab1bce-eeee-40bf-ad9b-578ab1ef3532 req-4bf922ef-9f5f-42a0-8fa8-bcf06c652ed1 service nova] Creating event network-changed:9630ac60-448c-49d9-b986-9926a85b1f58 for instance 19fbcbe2-9039-4d18-94ef-51ce58cb6365 on n-h1-861333-8 Oct 19 03:19:48.464405 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-62ab1bce-eeee-40bf-ad9b-578ab1ef3532 req-4bf922ef-9f5f-42a0-8fa8-bcf06c652ed1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035571 Oct 19 03:19:48.465712 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1016/2002] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:19:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:19:48.471067 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b57ac134-32dc-4a8c-b4ca-c3991d9e9317 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:48.471984 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b57ac134-32dc-4a8c-b4ca-c3991d9e9317 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] [instance: b97f61ab-18fc-4cf6-bc15-ec08ac4750fd] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:19:48.478975 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b57ac134-32dc-4a8c-b4ca-c3991d9e9317 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:48.480027 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b57ac134-32dc-4a8c-b4ca-c3991d9e9317 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:48.480519 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b57ac134-32dc-4a8c-b4ca-c3991d9e9317 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:48.481236 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b57ac134-32dc-4a8c-b4ca-c3991d9e9317 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:48.487107 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b57ac134-32dc-4a8c-b4ca-c3991d9e9317 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:48.487585 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b57ac134-32dc-4a8c-b4ca-c3991d9e9317 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:48.754684 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b57ac134-32dc-4a8c-b4ca-c3991d9e9317 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac711151c0334c62958e7f2ec431d860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5d239ae4b24b7e978935fe9b3458cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:19:48.764918 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b57ac134-32dc-4a8c-b4ca-c3991d9e9317 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] 10.222.0.52 "GET /compute/v2.1/servers/b97f61ab-18fc-4cf6-bc15-ec08ac4750fd" status: 200 len: 1324 microversion: 2.1 time: 0.297844 Oct 19 03:19:48.766144 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1017/2003] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:19:48 2022] GET /compute/v2.1/servers/b97f61ab-18fc-4cf6-bc15-ec08ac4750fd => generated 1324 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:19:48.771660 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5f4eaa90-bb96-4a85-8694-7dd76cd379ba tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:48.772785 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-5f4eaa90-bb96-4a85-8694-7dd76cd379ba tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] [instance: d6d507e4-3a53-4734-bb88-8fc38efa4d9b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:19:48.783111 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5f4eaa90-bb96-4a85-8694-7dd76cd379ba tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:48.784337 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5f4eaa90-bb96-4a85-8694-7dd76cd379ba tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:48.784975 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5f4eaa90-bb96-4a85-8694-7dd76cd379ba tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:48.785922 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5f4eaa90-bb96-4a85-8694-7dd76cd379ba tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:48.786912 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5f4eaa90-bb96-4a85-8694-7dd76cd379ba tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:48.787396 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5f4eaa90-bb96-4a85-8694-7dd76cd379ba tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:49.163906 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-5f4eaa90-bb96-4a85-8694-7dd76cd379ba tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8824f20e6a1f478a99f90e1ba8f028fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e436373e9e45efa03f08b33da619e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:19:49.178982 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5f4eaa90-bb96-4a85-8694-7dd76cd379ba tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] 10.222.0.52 "GET /compute/v2.1/servers/d6d507e4-3a53-4734-bb88-8fc38efa4d9b" status: 200 len: 1521 microversion: 2.1 time: 0.411087 Oct 19 03:19:49.179992 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1018/2004] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:19:48 2022] GET /compute/v2.1/servers/d6d507e4-3a53-4734-bb88-8fc38efa4d9b => generated 1521 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:19:49.206605 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b9b77d49-3b33-4efa-b9cf-49ad384816b6 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:49.207643 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b9b77d49-3b33-4efa-b9cf-49ad384816b6 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] [instance: d6d507e4-3a53-4734-bb88-8fc38efa4d9b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:19:49.215057 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b9b77d49-3b33-4efa-b9cf-49ad384816b6 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:49.216179 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b9b77d49-3b33-4efa-b9cf-49ad384816b6 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:49.217240 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b9b77d49-3b33-4efa-b9cf-49ad384816b6 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:49.217988 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b9b77d49-3b33-4efa-b9cf-49ad384816b6 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:49.218875 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b9b77d49-3b33-4efa-b9cf-49ad384816b6 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:49.219346 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b9b77d49-3b33-4efa-b9cf-49ad384816b6 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:49.623655 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b9b77d49-3b33-4efa-b9cf-49ad384816b6 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8824f20e6a1f478a99f90e1ba8f028fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e436373e9e45efa03f08b33da619e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:19:49.654137 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b9b77d49-3b33-4efa-b9cf-49ad384816b6 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] 10.222.0.52 "GET /compute/v2.1/servers/d6d507e4-3a53-4734-bb88-8fc38efa4d9b" status: 200 len: 1521 microversion: 2.1 time: 0.439837 Oct 19 03:19:49.655258 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1019/2005] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:19:49 2022] GET /compute/v2.1/servers/d6d507e4-3a53-4734-bb88-8fc38efa4d9b => generated 1521 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:19:49.677104 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-099de2bf-a36d-44ad-9e73-a21307d1d65f tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:49.677104 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-099de2bf-a36d-44ad-9e73-a21307d1d65f tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] [instance: 19fbcbe2-9039-4d18-94ef-51ce58cb6365] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:19:49.680062 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-099de2bf-a36d-44ad-9e73-a21307d1d65f tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:49.680743 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-099de2bf-a36d-44ad-9e73-a21307d1d65f tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:49.681498 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-099de2bf-a36d-44ad-9e73-a21307d1d65f tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:49.682442 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-099de2bf-a36d-44ad-9e73-a21307d1d65f tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:49.683116 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-099de2bf-a36d-44ad-9e73-a21307d1d65f tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:49.683756 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-099de2bf-a36d-44ad-9e73-a21307d1d65f tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:50.067525 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-099de2bf-a36d-44ad-9e73-a21307d1d65f tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4c5e4123c44508a5d4911a17c44231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a495ccfced47f29cb928d1ded20d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:19:50.076611 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-099de2bf-a36d-44ad-9e73-a21307d1d65f tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] 10.222.0.52 "GET /compute/v2.1/servers/19fbcbe2-9039-4d18-94ef-51ce58cb6365" status: 200 len: 1314 microversion: 2.1 time: 0.419496 Oct 19 03:19:50.077510 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1020/2006] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:19:49 2022] GET /compute/v2.1/servers/19fbcbe2-9039-4d18-94ef-51ce58cb6365 => generated 1314 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:19:50.086050 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-cf4bd068-8a04-4f56-92d7-1c3e7fa56a9d tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:19:50.091571 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-cf4bd068-8a04-4f56-92d7-1c3e7fa56a9d tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Request method failure captured: Oct 19 03:19:50.091571 n-d-861333-8 devstack@n-api.service[121135]: request: POST /compute/v2.1/servers/d6d507e4-3a53-4734-bb88-8fc38efa4d9b/action HTTP/1.1 Oct 19 03:19:50.091571 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:19:50.091571 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:19:50.091571 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:19:50.091571 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 285 Oct 19 03:19:50.091571 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:19:50.091571 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:19:50.091571 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:19:50.091571 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:19:50.091571 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2y5QS5fGXOCh8dCARu_-t2vnckF3uwZtfqi9DmHed6pMoXibNoREyH_7cDYk3t8P2qbQ1u564D6Sq50msRMl2YQVddoWmeJm48OR72Wl7OECfXwMpGVDHULH4PSkCmyy31jkBvdZSxqyCmIGP32xNgLbjMxF4SrMQTDektLd28zxNg Oct 19 03:19:50.091571 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:19:50.091571 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:19:50.091571 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:19:50.091571 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:19:50.091571 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:19:50.091571 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:19:50.091571 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: f9e436373e9e45efa03f08b33da619e8 Oct 19 03:19:50.091571 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1767182949 Oct 19 03:19:50.091571 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:19:50.091571 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:19:50.093058 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f9e436373e9e45efa03f08b33da619e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f9e436373e9e45efa03f08b33da619e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f9e436373e9e45efa03f08b33da619e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f9e436373e9e45efa03f08b33da619e8", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:19:50.093058 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1767182949 Oct 19 03:19:50.093058 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: f9e436373e9e45efa03f08b33da619e8 Oct 19 03:19:50.093058 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1767182949 Oct 19 03:19:50.093058 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ImagesOneServerNegativeTestJSON-1767182949-project Oct 19 03:19:50.093058 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:19:50.093058 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:19:50.093058 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 8824f20e6a1f478a99f90e1ba8f028fe Oct 19 03:19:50.093058 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1767182949-project Oct 19 03:19:50.093058 n-d-861333-8 devstack@n-api.service[121135]: Oct 19 03:19:50.093058 n-d-861333-8 devstack@n-api.service[121135]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 19 03:19:50.093908 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:19:50.093908 n-d-861333-8 devstack@n-api.service[121135]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 19 03:19:50.093908 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': 'd6d507e4-3a53-4734-bb88-8fc38efa4d9b', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 19 03:19:50.093908 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:19:50.093908 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:19:50.093908 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 03:19:50.093908 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 03:19:50.093908 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 03:19:50.093908 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise error Oct 19 03:19:50.093908 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 19 03:19:50.094606 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:19:50.094606 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Oct 19 03:19:50.094606 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 19 03:19:50.094606 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:19:50.094606 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 19 03:19:50.094606 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 19 03:19:50.094606 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:19:50.094606 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:19:50.094606 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:19:50.094606 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:19:50.094606 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:19:50.094606 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:19:50.094606 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:19:50.094606 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:19:50.094606 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:19:50.094606 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:19:50.094606 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:19:50.094606 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:19:50.094606 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 03:19:50.094606 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 03:19:50.095968 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 03:19:50.095968 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 03:19:50.095968 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 03:19:50.095968 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 03:19:50.095968 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 19 03:19:50.095968 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:19:50.095968 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:19:50.095968 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:19:50.095968 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:19:50.095968 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:19:50.095968 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:19:50.095968 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 03:19:50.095968 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 03:19:50.096894 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 19 03:19:50.096894 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:19:50.098025 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-cf4bd068-8a04-4f56-92d7-1c3e7fa56a9d tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:19:50.098939 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-cf4bd068-8a04-4f56-92d7-1c3e7fa56a9d tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] 10.222.0.52 "POST /compute/v2.1/servers/d6d507e4-3a53-4734-bb88-8fc38efa4d9b/action" status: 400 len: 619 microversion: 2.1 time: 0.018516 Oct 19 03:19:50.099691 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1021/2007] 10.222.0.52 () {60 vars in 1279 bytes} [Wed Oct 19 03:19:50 2022] POST /compute/v2.1/servers/d6d507e4-3a53-4734-bb88-8fc38efa4d9b/action => generated 619 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 03:19:50.106059 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c461ca67-8ebc-43c2-b8fb-7e1479874368 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:50.106874 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c461ca67-8ebc-43c2-b8fb-7e1479874368 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] [instance: b97f61ab-18fc-4cf6-bc15-ec08ac4750fd] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:19:50.116492 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c461ca67-8ebc-43c2-b8fb-7e1479874368 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:50.123739 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c461ca67-8ebc-43c2-b8fb-7e1479874368 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:50.123739 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c461ca67-8ebc-43c2-b8fb-7e1479874368 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:50.123739 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c461ca67-8ebc-43c2-b8fb-7e1479874368 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:50.123739 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c461ca67-8ebc-43c2-b8fb-7e1479874368 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:50.124170 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c461ca67-8ebc-43c2-b8fb-7e1479874368 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:50.373253 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-44ae9210-c172-4a3e-8e24-af6d794bb72b tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] 10.222.0.52 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.461648 Oct 19 03:19:50.375644 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 987/2008] 10.222.0.52 () {60 vars in 1170 bytes} [Wed Oct 19 03:19:45 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4472 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:19:50.382328 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-76992606-6cff-4ada-b7a6-ff3293fd518e tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:50.388156 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-76992606-6cff-4ada-b7a6-ff3293fd518e tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] [instance: d6d507e4-3a53-4734-bb88-8fc38efa4d9b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:19:50.405178 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-76992606-6cff-4ada-b7a6-ff3293fd518e tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:50.406113 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-76992606-6cff-4ada-b7a6-ff3293fd518e tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:50.407287 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-76992606-6cff-4ada-b7a6-ff3293fd518e tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:50.412188 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-76992606-6cff-4ada-b7a6-ff3293fd518e tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:50.412188 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-76992606-6cff-4ada-b7a6-ff3293fd518e tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:50.412188 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-76992606-6cff-4ada-b7a6-ff3293fd518e tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:50.523922 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c461ca67-8ebc-43c2-b8fb-7e1479874368 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac711151c0334c62958e7f2ec431d860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5d239ae4b24b7e978935fe9b3458cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:19:50.538216 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c461ca67-8ebc-43c2-b8fb-7e1479874368 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] 10.222.0.52 "GET /compute/v2.1/servers/b97f61ab-18fc-4cf6-bc15-ec08ac4750fd" status: 200 len: 1324 microversion: 2.1 time: 0.435884 Oct 19 03:19:50.539308 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1022/2009] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:19:50 2022] GET /compute/v2.1/servers/b97f61ab-18fc-4cf6-bc15-ec08ac4750fd => generated 1324 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:19:50.545149 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5005b4b3-f8d0-4dd4-9b67-772adba19500 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.7.179"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:19:50.547562 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-5005b4b3-f8d0-4dd4-9b67-772adba19500 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] [instance: c6e2a8e3-4589-4037-b0d8-032541d043e3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:19:50.554746 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:19:50.556540 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5005b4b3-f8d0-4dd4-9b67-772adba19500 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:50.560868 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5005b4b3-f8d0-4dd4-9b67-772adba19500 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:50.560868 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5005b4b3-f8d0-4dd4-9b67-772adba19500 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:50.560868 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5005b4b3-f8d0-4dd4-9b67-772adba19500 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:50.561197 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5005b4b3-f8d0-4dd4-9b67-772adba19500 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:50.561197 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5005b4b3-f8d0-4dd4-9b67-772adba19500 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:50.634439 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5005b4b3-f8d0-4dd4-9b67-772adba19500 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Acquiring lock "refresh_cache-c6e2a8e3-4589-4037-b0d8-032541d043e3" {{(pid=121135) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 19 03:19:50.636652 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5005b4b3-f8d0-4dd4-9b67-772adba19500 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Acquired lock "refresh_cache-c6e2a8e3-4589-4037-b0d8-032541d043e3" {{(pid=121135) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 19 03:19:50.753655 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-76992606-6cff-4ada-b7a6-ff3293fd518e tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8824f20e6a1f478a99f90e1ba8f028fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e436373e9e45efa03f08b33da619e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:19:50.762130 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-76992606-6cff-4ada-b7a6-ff3293fd518e tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] 10.222.0.52 "GET /compute/v2.1/servers/d6d507e4-3a53-4734-bb88-8fc38efa4d9b" status: 200 len: 1521 microversion: 2.1 time: 0.384874 Oct 19 03:19:50.762717 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 988/2010] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:19:50 2022] GET /compute/v2.1/servers/d6d507e4-3a53-4734-bb88-8fc38efa4d9b => generated 1521 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:19:50.786468 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c36251c6-3a78-448d-b4b2-866c95dce251 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:50.787824 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c36251c6-3a78-448d-b4b2-866c95dce251 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] [instance: d6d507e4-3a53-4734-bb88-8fc38efa4d9b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:19:50.794537 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c36251c6-3a78-448d-b4b2-866c95dce251 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:50.795479 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c36251c6-3a78-448d-b4b2-866c95dce251 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:50.796105 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c36251c6-3a78-448d-b4b2-866c95dce251 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:50.797111 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c36251c6-3a78-448d-b4b2-866c95dce251 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:50.797769 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c36251c6-3a78-448d-b4b2-866c95dce251 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:50.798511 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c36251c6-3a78-448d-b4b2-866c95dce251 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:51.257779 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c36251c6-3a78-448d-b4b2-866c95dce251 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8824f20e6a1f478a99f90e1ba8f028fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e436373e9e45efa03f08b33da619e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:19:51.269868 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c36251c6-3a78-448d-b4b2-866c95dce251 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] 10.222.0.52 "GET /compute/v2.1/servers/d6d507e4-3a53-4734-bb88-8fc38efa4d9b" status: 200 len: 1521 microversion: 2.1 time: 0.487562 Oct 19 03:19:51.272414 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 989/2011] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:19:50 2022] GET /compute/v2.1/servers/d6d507e4-3a53-4734-bb88-8fc38efa4d9b => generated 1521 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:19:51.278438 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3f472d02-5886-44b2-8d59-a23823efd173 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:51.279281 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3f472d02-5886-44b2-8d59-a23823efd173 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] [instance: 19fbcbe2-9039-4d18-94ef-51ce58cb6365] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:19:51.285933 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:DELETE=3 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:19:51.287805 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3f472d02-5886-44b2-8d59-a23823efd173 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:51.288606 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3f472d02-5886-44b2-8d59-a23823efd173 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:51.289424 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3f472d02-5886-44b2-8d59-a23823efd173 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:51.291522 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3f472d02-5886-44b2-8d59-a23823efd173 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:51.292264 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3f472d02-5886-44b2-8d59-a23823efd173 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:51.292858 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3f472d02-5886-44b2-8d59-a23823efd173 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:51.357467 n-d-861333-8 devstack@n-api.service[121135]: DEBUG neutronclient.v2_0.client [None req-5005b4b3-f8d0-4dd4-9b67-772adba19500 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.7.179 (17debcd6-d435-4ec6-8dc4-275d858add0b) with port b8014d15-27b1-4267-af57-17ae32c38543 using fixed IP 172.20.0.9, as that fixed IP already has a floating IP on external network 1475da2c-80a2-478b-b6c8-7f7c0e5426d1.", "detail": ""}} {{(pid=121135) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 19 03:19:51.358730 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5005b4b3-f8d0-4dd4-9b67-772adba19500 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Releasing lock "refresh_cache-c6e2a8e3-4589-4037-b0d8-032541d043e3" {{(pid=121135) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 19 03:19:51.360302 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-5005b4b3-f8d0-4dd4-9b67-772adba19500 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] HTTP exception thrown: Cannot associate floating IP 172.25.7.179 (17debcd6-d435-4ec6-8dc4-275d858add0b) with port b8014d15-27b1-4267-af57-17ae32c38543 using fixed IP 172.20.0.9, as that fixed IP already has a floating IP on external network 1475da2c-80a2-478b-b6c8-7f7c0e5426d1. Oct 19 03:19:51.360302 n-d-861333-8 devstack@n-api.service[121135]: Neutron server returns request_ids: ['req-6ab70d58-865f-46fa-9c98-901880cdc569'] Oct 19 03:19:51.393389 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5005b4b3-f8d0-4dd4-9b67-772adba19500 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Request method failure captured: Oct 19 03:19:51.393389 n-d-861333-8 devstack@n-api.service[121135]: request: POST /compute/v2.1/servers/c6e2a8e3-4589-4037-b0d8-032541d043e3/action HTTP/1.1 Oct 19 03:19:51.393389 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:19:51.393389 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:19:51.393389 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:19:51.393389 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 46 Oct 19 03:19:51.393389 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:19:51.393389 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:19:51.393389 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:19:51.393389 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:19:51.393389 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2yqaPaGcq-c15urVLpzfs3V-94tJdAtgMccdDwNmTmV7vHTHa8WU0sLqvoI7rKWiP2_3WB8q0vcFNFjKDpYt1dXYsgfK3sYsFptkNYuLZNDPlJITSYq6jhHbNPpGkFAhjLQbIvGlt-oy7vmVBShPfosqaJSH2-YWR_EWj-vYwvb_qk Oct 19 03:19:51.393389 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:19:51.393389 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:19:51.393389 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:19:51.393389 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:19:51.393389 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:19:51.393389 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:19:51.393389 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: be25c3ef65114ccc83b335b938743e90 Oct 19 03:19:51.393389 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 Oct 19 03:19:51.393389 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:19:51.393389 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:19:51.395249 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/be25c3ef65114ccc83b335b938743e90"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/be25c3ef65114ccc83b335b938743e90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/be25c3ef65114ccc83b335b938743e90"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_be25c3ef65114ccc83b335b938743e90", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:19:51.395249 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 Oct 19 03:19:51.395249 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: be25c3ef65114ccc83b335b938743e90 Oct 19 03:19:51.395249 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 Oct 19 03:19:51.395249 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project Oct 19 03:19:51.395249 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:19:51.395249 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:19:51.395249 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 8920755dc8594da4b57f3ecc920db95d Oct 19 03:19:51.395249 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project Oct 19 03:19:51.395249 n-d-861333-8 devstack@n-api.service[121135]: Oct 19 03:19:51.395249 n-d-861333-8 devstack@n-api.service[121135]: {"addFloatingIp": {"address": "172.25.7.179"}} Oct 19 03:19:51.395249 n-d-861333-8 devstack@n-api.service[121135]: method: Oct 19 03:19:51.397028 n-d-861333-8 devstack@n-api.service[121135]: exception: Cannot associate floating IP 172.25.7.179 (17debcd6-d435-4ec6-8dc4-275d858add0b) with port b8014d15-27b1-4267-af57-17ae32c38543 using fixed IP 172.20.0.9, as that fixed IP already has a floating IP on external network 1475da2c-80a2-478b-b6c8-7f7c0e5426d1. Oct 19 03:19:51.397028 n-d-861333-8 devstack@n-api.service[121135]: Neutron server returns request_ids: ['req-6ab70d58-865f-46fa-9c98-901880cdc569'] Oct 19 03:19:51.397028 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': 'c6e2a8e3-4589-4037-b0d8-032541d043e3', 'body': {'addFloatingIp': {'address': '172.25.7.179'}}} Oct 19 03:19:51.397028 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:19:51.397028 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:19:51.397028 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2703, in associate_floating_ip Oct 19 03:19:51.397028 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Oct 19 03:19:51.397028 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:19:51.397028 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:19:51.397028 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1016, in update_floatingip Oct 19 03:19:51.397028 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Oct 19 03:19:51.397028 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:19:51.397028 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:19:51.397028 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2548, in _update_resource Oct 19 03:19:51.397028 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Oct 19 03:19:51.397028 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:19:51.397028 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:19:51.398570 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Oct 19 03:19:51.398570 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Oct 19 03:19:51.398570 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:19:51.398570 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:19:51.398570 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 19 03:19:51.398570 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 19 03:19:51.398570 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:19:51.398570 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:19:51.398570 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 19 03:19:51.398570 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 19 03:19:51.398570 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:19:51.398570 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:19:51.398570 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 19 03:19:51.398570 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 19 03:19:51.398570 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 19 03:19:51.398570 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 19 03:19:51.400772 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.7.179 (17debcd6-d435-4ec6-8dc4-275d858add0b) with port b8014d15-27b1-4267-af57-17ae32c38543 using fixed IP 172.20.0.9, as that fixed IP already has a floating IP on external network 1475da2c-80a2-478b-b6c8-7f7c0e5426d1. Oct 19 03:19:51.400772 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6ab70d58-865f-46fa-9c98-901880cdc569'] Oct 19 03:19:51.400772 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:19:51.400772 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:19:51.400772 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:19:51.400772 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:19:51.400772 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 19 03:19:51.400772 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 19 03:19:51.400772 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 19 03:19:51.400772 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 19 03:19:51.400772 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2705, in associate_floating_ip Oct 19 03:19:51.400772 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Oct 19 03:19:51.400772 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.7.179 (17debcd6-d435-4ec6-8dc4-275d858add0b) with port b8014d15-27b1-4267-af57-17ae32c38543 using fixed IP 172.20.0.9, as that fixed IP already has a floating IP on external network 1475da2c-80a2-478b-b6c8-7f7c0e5426d1. Oct 19 03:19:51.400772 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6ab70d58-865f-46fa-9c98-901880cdc569'] Oct 19 03:19:51.400772 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:19:51.400772 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:19:51.403049 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:19:51.403049 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:19:51.403049 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:19:51.403049 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:19:51.403049 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:19:51.403049 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:19:51.403049 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 03:19:51.403049 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 03:19:51.403049 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:19:51.403049 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:19:51.403049 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:19:51.403049 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:19:51.403049 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Oct 19 03:19:51.403049 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Oct 19 03:19:51.403049 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.7.179 (17debcd6-d435-4ec6-8dc4-275d858add0b) with port b8014d15-27b1-4267-af57-17ae32c38543 using fixed IP 172.20.0.9, as that fixed IP already has a floating IP on external network 1475da2c-80a2-478b-b6c8-7f7c0e5426d1. Oct 19 03:19:51.403049 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6ab70d58-865f-46fa-9c98-901880cdc569'] Oct 19 03:19:51.403049 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:19:51.403049 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:19:51.406155 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:19:51.406155 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:19:51.406155 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:19:51.406155 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:19:51.406155 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:19:51.406155 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:19:51.406155 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.7.179 (17debcd6-d435-4ec6-8dc4-275d858add0b) with port b8014d15-27b1-4267-af57-17ae32c38543 using fixed IP 172.20.0.9, as that fixed IP already has a floating IP on external network 1475da2c-80a2-478b-b6c8-7f7c0e5426d1. Oct 19 03:19:51.406155 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6ab70d58-865f-46fa-9c98-901880cdc569'] Oct 19 03:19:51.406155 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:19:51.406155 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5005b4b3-f8d0-4dd4-9b67-772adba19500 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Returning 400 to user: Cannot associate floating IP 172.25.7.179 (17debcd6-d435-4ec6-8dc4-275d858add0b) with port b8014d15-27b1-4267-af57-17ae32c38543 using fixed IP 172.20.0.9, as that fixed IP already has a floating IP on external network 1475da2c-80a2-478b-b6c8-7f7c0e5426d1. Oct 19 03:19:51.406155 n-d-861333-8 devstack@n-api.service[121135]: Neutron server returns request_ids: ['req-6ab70d58-865f-46fa-9c98-901880cdc569'] {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:19:51.407835 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5005b4b3-f8d0-4dd4-9b67-772adba19500 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] 10.222.0.52 "POST /compute/v2.1/servers/c6e2a8e3-4589-4037-b0d8-032541d043e3/action" status: 400 len: 381 microversion: 2.1 time: 0.854859 Oct 19 03:19:51.407835 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1023/2012] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:19:50 2022] POST /compute/v2.1/servers/c6e2a8e3-4589-4037-b0d8-032541d043e3/action => generated 381 bytes in 857 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 03:19:51.407835 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9e8e90e5-be1c-4489-8bf5-3588a5fc5d68 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1386844403"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:19:51.407835 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9e8e90e5-be1c-4489-8bf5-3588a5fc5d68 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] [instance: d6d507e4-3a53-4734-bb88-8fc38efa4d9b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:19:51.424882 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9e8e90e5-be1c-4489-8bf5-3588a5fc5d68 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:51.426673 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9e8e90e5-be1c-4489-8bf5-3588a5fc5d68 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:51.426673 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9e8e90e5-be1c-4489-8bf5-3588a5fc5d68 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:51.427958 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9e8e90e5-be1c-4489-8bf5-3588a5fc5d68 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:51.437933 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9e8e90e5-be1c-4489-8bf5-3588a5fc5d68 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:51.438589 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9e8e90e5-be1c-4489-8bf5-3588a5fc5d68 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:51.529398 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-3f472d02-5886-44b2-8d59-a23823efd173 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4c5e4123c44508a5d4911a17c44231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a495ccfced47f29cb928d1ded20d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:19:51.538206 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3f472d02-5886-44b2-8d59-a23823efd173 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] 10.222.0.52 "GET /compute/v2.1/servers/19fbcbe2-9039-4d18-94ef-51ce58cb6365" status: 200 len: 1314 microversion: 2.1 time: 0.263925 Oct 19 03:19:51.540757 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 990/2013] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:19:51 2022] GET /compute/v2.1/servers/19fbcbe2-9039-4d18-94ef-51ce58cb6365 => generated 1314 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:19:51.546361 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e237d689-0b37-4cdc-a229-a2ff45fd38f3 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Calling method '.version_select at 0x7fc134f25940>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:52.034732 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9e8e90e5-be1c-4489-8bf5-3588a5fc5d68 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] 10.222.0.52 "POST /compute/v2.1/servers/d6d507e4-3a53-4734-bb88-8fc38efa4d9b/action" status: 202 len: 0 microversion: 2.1 time: 0.636656 Oct 19 03:19:52.044104 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1024/2014] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:19:51 2022] POST /compute/v2.1/servers/d6d507e4-3a53-4734-bb88-8fc38efa4d9b/action => generated 0 bytes in 645 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 19 03:19:52.066904 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1b57608e-6591-4c01-a899-660fc8caabcf tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:52.068259 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1b57608e-6591-4c01-a899-660fc8caabcf tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] [instance: b97f61ab-18fc-4cf6-bc15-ec08ac4750fd] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:19:52.076056 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1b57608e-6591-4c01-a899-660fc8caabcf tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:52.076551 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1b57608e-6591-4c01-a899-660fc8caabcf tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:52.077054 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1b57608e-6591-4c01-a899-660fc8caabcf tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:52.078004 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1b57608e-6591-4c01-a899-660fc8caabcf tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:52.078795 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1b57608e-6591-4c01-a899-660fc8caabcf tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:52.079392 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1b57608e-6591-4c01-a899-660fc8caabcf tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:52.405316 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-1b57608e-6591-4c01-a899-660fc8caabcf tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac711151c0334c62958e7f2ec431d860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5d239ae4b24b7e978935fe9b3458cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:19:52.415586 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1b57608e-6591-4c01-a899-660fc8caabcf tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] 10.222.0.52 "GET /compute/v2.1/servers/b97f61ab-18fc-4cf6-bc15-ec08ac4750fd" status: 200 len: 1519 microversion: 2.1 time: 0.367859 Oct 19 03:19:52.430132 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1025/2015] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:19:52 2022] GET /compute/v2.1/servers/b97f61ab-18fc-4cf6-bc15-ec08ac4750fd => generated 1519 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:19:52.442084 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-84e442d7-9fd6-4744-9347-fdecc60e0506 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1121217125"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:19:52.444874 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-84e442d7-9fd6-4744-9347-fdecc60e0506 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] [instance: d6d507e4-3a53-4734-bb88-8fc38efa4d9b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:19:52.452614 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-84e442d7-9fd6-4744-9347-fdecc60e0506 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:52.453456 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-84e442d7-9fd6-4744-9347-fdecc60e0506 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:52.454324 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-84e442d7-9fd6-4744-9347-fdecc60e0506 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:52.455507 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-84e442d7-9fd6-4744-9347-fdecc60e0506 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:52.456171 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-84e442d7-9fd6-4744-9347-fdecc60e0506 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:52.457081 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-84e442d7-9fd6-4744-9347-fdecc60e0506 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:52.500004 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-84e442d7-9fd6-4744-9347-fdecc60e0506 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] HTTP exception thrown: Cannot 'createImage' instance d6d507e4-3a53-4734-bb88-8fc38efa4d9b while it is in task_state image_snapshot Oct 19 03:19:52.502784 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-84e442d7-9fd6-4744-9347-fdecc60e0506 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Request method failure captured: Oct 19 03:19:52.502784 n-d-861333-8 devstack@n-api.service[121135]: request: POST /compute/v2.1/servers/d6d507e4-3a53-4734-bb88-8fc38efa4d9b/action HTTP/1.1 Oct 19 03:19:52.502784 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:19:52.502784 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:19:52.502784 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:19:52.502784 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 85 Oct 19 03:19:52.502784 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:19:52.502784 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:19:52.502784 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:19:52.502784 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:19:52.502784 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2y5QS5fGXOCh8dCARu_-t2vnckF3uwZtfqi9DmHed6pMoXibNoREyH_7cDYk3t8P2qbQ1u564D6Sq50msRMl2YQVddoWmeJm48OR72Wl7OECfXwMpGVDHULH4PSkCmyy31jkBvdZSxqyCmIGP32xNgLbjMxF4SrMQTDektLd28zxNg Oct 19 03:19:52.502784 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:19:52.502784 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:19:52.502784 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:19:52.502784 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:19:52.502784 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:19:52.502784 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:19:52.502784 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: f9e436373e9e45efa03f08b33da619e8 Oct 19 03:19:52.502784 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1767182949 Oct 19 03:19:52.502784 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:19:52.502784 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:19:52.510762 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f9e436373e9e45efa03f08b33da619e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f9e436373e9e45efa03f08b33da619e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f9e436373e9e45efa03f08b33da619e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f9e436373e9e45efa03f08b33da619e8", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:19:52.510762 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1767182949 Oct 19 03:19:52.510762 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: f9e436373e9e45efa03f08b33da619e8 Oct 19 03:19:52.510762 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1767182949 Oct 19 03:19:52.510762 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ImagesOneServerNegativeTestJSON-1767182949-project Oct 19 03:19:52.510762 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:19:52.510762 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:19:52.510762 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 8824f20e6a1f478a99f90e1ba8f028fe Oct 19 03:19:52.510762 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1767182949-project Oct 19 03:19:52.510762 n-d-861333-8 devstack@n-api.service[121135]: Oct 19 03:19:52.510762 n-d-861333-8 devstack@n-api.service[121135]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1121217125"}} Oct 19 03:19:52.510762 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:19:52.513691 n-d-861333-8 devstack@n-api.service[121135]: exception: Cannot 'createImage' instance d6d507e4-3a53-4734-bb88-8fc38efa4d9b while it is in task_state image_snapshot Oct 19 03:19:52.513691 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': 'd6d507e4-3a53-4734-bb88-8fc38efa4d9b', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1121217125'}}} Oct 19 03:19:52.513691 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:19:52.513691 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:19:52.513691 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1349, in _action_create_image Oct 19 03:19:52.513691 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Oct 19 03:19:52.513691 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Oct 19 03:19:52.513691 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 19 03:19:52.513691 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d6d507e4-3a53-4734-bb88-8fc38efa4d9b in task_state image_snapshot. Cannot snapshot while the instance is in this state. Oct 19 03:19:52.513691 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:19:52.513691 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:19:52.513691 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:19:52.513691 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:19:52.513691 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:19:52.513691 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:19:52.513691 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:19:52.513691 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:19:52.513691 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:19:52.513691 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:19:52.518087 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:19:52.518087 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:19:52.518087 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:19:52.518087 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:19:52.518087 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1354, in _action_create_image Oct 19 03:19:52.518087 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 19 03:19:52.518087 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 19 03:19:52.518087 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 19 03:19:52.518087 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance d6d507e4-3a53-4734-bb88-8fc38efa4d9b while it is in task_state image_snapshot Oct 19 03:19:52.518087 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:19:52.518087 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:19:52.518087 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:19:52.518087 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:19:52.518087 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:19:52.518087 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:19:52.518087 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:19:52.518087 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:19:52.518087 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance d6d507e4-3a53-4734-bb88-8fc38efa4d9b while it is in task_state image_snapshot Oct 19 03:19:52.518087 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:19:52.523194 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-84e442d7-9fd6-4744-9347-fdecc60e0506 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Returning 409 to user: Cannot 'createImage' instance d6d507e4-3a53-4734-bb88-8fc38efa4d9b while it is in task_state image_snapshot {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:19:52.523194 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-84e442d7-9fd6-4744-9347-fdecc60e0506 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] 10.222.0.52 "POST /compute/v2.1/servers/d6d507e4-3a53-4734-bb88-8fc38efa4d9b/action" status: 409 len: 159 microversion: 2.1 time: 0.074595 Oct 19 03:19:52.523194 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1026/2016] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:19:52 2022] POST /compute/v2.1/servers/d6d507e4-3a53-4734-bb88-8fc38efa4d9b/action => generated 159 bytes in 79 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 19 03:19:52.523194 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-29e20ea1-1b51-46cf-ba9e-c7252d6f099a tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.7.89"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:19:52.523194 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-29e20ea1-1b51-46cf-ba9e-c7252d6f099a tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] [instance: bcf14e6a-ecdc-40c0-b76b-678a1bb14828] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:19:52.529676 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-29e20ea1-1b51-46cf-ba9e-c7252d6f099a tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:52.530501 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-29e20ea1-1b51-46cf-ba9e-c7252d6f099a tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:52.531169 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-29e20ea1-1b51-46cf-ba9e-c7252d6f099a tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:52.532279 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-29e20ea1-1b51-46cf-ba9e-c7252d6f099a tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:52.532963 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-29e20ea1-1b51-46cf-ba9e-c7252d6f099a tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:52.533629 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-29e20ea1-1b51-46cf-ba9e-c7252d6f099a tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:52.567780 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-29e20ea1-1b51-46cf-ba9e-c7252d6f099a tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Acquiring lock "refresh_cache-bcf14e6a-ecdc-40c0-b76b-678a1bb14828" {{(pid=121135) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 19 03:19:52.568338 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-29e20ea1-1b51-46cf-ba9e-c7252d6f099a tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Acquired lock "refresh_cache-bcf14e6a-ecdc-40c0-b76b-678a1bb14828" {{(pid=121135) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 19 03:19:52.805006 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e237d689-0b37-4cdc-a229-a2ff45fd38f3 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] 10.222.0.52 "DELETE /compute/v2.1/os-floating-ips/17debcd6-d435-4ec6-8dc4-275d858add0b" status: 202 len: 0 microversion: 2.1 time: 1.262615 Oct 19 03:19:52.805657 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 991/2017] 10.222.0.52 () {58 vars in 1263 bytes} [Wed Oct 19 03:19:51 2022] DELETE /compute/v2.1/os-floating-ips/17debcd6-d435-4ec6-8dc4-275d858add0b => generated 0 bytes in 1264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:19:52.810223 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4da60f03-a153-4ec5-b49e-1e876a351cb4 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Calling method '.version_select at 0x7fc13046dc10>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:53.218842 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4da60f03-a153-4ec5-b49e-1e876a351cb4 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] 10.222.0.52 "DELETE /compute/v2.1/images/31a2644c-05b4-42cc-bf8c-f710e426fc62" status: 204 len: 0 microversion: 2.1 time: 0.412115 Oct 19 03:19:53.219609 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 992/2018] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:19:52 2022] DELETE /compute/v2.1/images/31a2644c-05b4-42cc-bf8c-f710e426fc62 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:19:53.235258 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f1e71631-2209-40ac-bf35-0b68f881b374 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:53.235957 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f1e71631-2209-40ac-bf35-0b68f881b374 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] [instance: 19fbcbe2-9039-4d18-94ef-51ce58cb6365] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:19:53.249186 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f1e71631-2209-40ac-bf35-0b68f881b374 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:53.250825 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f1e71631-2209-40ac-bf35-0b68f881b374 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:53.253317 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f1e71631-2209-40ac-bf35-0b68f881b374 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:53.256518 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f1e71631-2209-40ac-bf35-0b68f881b374 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:53.257028 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f1e71631-2209-40ac-bf35-0b68f881b374 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:53.257525 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f1e71631-2209-40ac-bf35-0b68f881b374 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:53.899056 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-f1e71631-2209-40ac-bf35-0b68f881b374 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4c5e4123c44508a5d4911a17c44231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a495ccfced47f29cb928d1ded20d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:19:53.908846 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f1e71631-2209-40ac-bf35-0b68f881b374 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] 10.222.0.52 "GET /compute/v2.1/servers/19fbcbe2-9039-4d18-94ef-51ce58cb6365" status: 200 len: 1314 microversion: 2.1 time: 0.688147 Oct 19 03:19:53.910291 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 993/2019] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:19:53 2022] GET /compute/v2.1/servers/19fbcbe2-9039-4d18-94ef-51ce58cb6365 => generated 1314 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:19:53.938244 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2c23e806-a23c-47a8-8363-47a142eeb646 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Action: 'action', calling method: .version_select at 0x7fc132ab5820>, body: {"removeFloatingIp": {"address": "172.25.7.234"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:19:54.272532 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2c23e806-a23c-47a8-8363-47a142eeb646 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] [instance: c6e2a8e3-4589-4037-b0d8-032541d043e3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:19:54.280334 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2c23e806-a23c-47a8-8363-47a142eeb646 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:54.280977 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2c23e806-a23c-47a8-8363-47a142eeb646 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:54.281549 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2c23e806-a23c-47a8-8363-47a142eeb646 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:54.282782 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2c23e806-a23c-47a8-8363-47a142eeb646 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:54.283621 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2c23e806-a23c-47a8-8363-47a142eeb646 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:54.284228 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2c23e806-a23c-47a8-8363-47a142eeb646 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:54.712149 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2c23e806-a23c-47a8-8363-47a142eeb646 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Acquiring lock "refresh_cache-c6e2a8e3-4589-4037-b0d8-032541d043e3" {{(pid=121134) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 19 03:19:54.712149 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2c23e806-a23c-47a8-8363-47a142eeb646 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Acquired lock "refresh_cache-c6e2a8e3-4589-4037-b0d8-032541d043e3" {{(pid=121134) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 19 03:19:54.816859 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.network.neutron [None req-29e20ea1-1b51-46cf-ba9e-c7252d6f099a tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] [instance: bcf14e6a-ecdc-40c0-b76b-678a1bb14828] Building network info cache for instance {{(pid=121135) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 19 03:19:56.187464 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.network.neutron [None req-29e20ea1-1b51-46cf-ba9e-c7252d6f099a tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] [instance: bcf14e6a-ecdc-40c0-b76b-678a1bb14828] Updating instance_info_cache with network_info: [{"id": "2e33b971-5f4b-4979-8038-bf99f7338ba3", "address": "fa:16:3e:02:c8:80", "network": {"id": "6b3013ab-5e3b-4dca-bc82-37c6dc5721e3", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-694479142-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.7.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "0e5d239ae4b24b7e978935fe9b3458cf", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap2e33b971-5f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=121135) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 19 03:19:56.225089 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-2c23e806-a23c-47a8-8363-47a142eeb646 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] [instance: c6e2a8e3-4589-4037-b0d8-032541d043e3] Building network info cache for instance {{(pid=121134) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 19 03:19:56.540245 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-29e20ea1-1b51-46cf-ba9e-c7252d6f099a tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Releasing lock "refresh_cache-bcf14e6a-ecdc-40c0-b76b-678a1bb14828" {{(pid=121135) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 19 03:19:56.541162 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-29e20ea1-1b51-46cf-ba9e-c7252d6f099a tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] 10.222.0.52 "POST /compute/v2.1/servers/bcf14e6a-ecdc-40c0-b76b-678a1bb14828/action" status: 202 len: 0 microversion: 2.1 time: 4.029854 Oct 19 03:19:56.542088 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1027/2020] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:19:52 2022] POST /compute/v2.1/servers/bcf14e6a-ecdc-40c0-b76b-678a1bb14828/action => generated 0 bytes in 4031 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 19 03:19:56.560670 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e0b32dd5-15fd-4025-a943-7fb5b8f9250d tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:56.560670 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e0b32dd5-15fd-4025-a943-7fb5b8f9250d tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] [instance: d6d507e4-3a53-4734-bb88-8fc38efa4d9b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:19:56.570832 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e0b32dd5-15fd-4025-a943-7fb5b8f9250d tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:56.573001 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e0b32dd5-15fd-4025-a943-7fb5b8f9250d tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:56.582874 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e0b32dd5-15fd-4025-a943-7fb5b8f9250d tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:56.585237 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e0b32dd5-15fd-4025-a943-7fb5b8f9250d tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:56.595269 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e0b32dd5-15fd-4025-a943-7fb5b8f9250d tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:56.595269 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e0b32dd5-15fd-4025-a943-7fb5b8f9250d tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:57.054242 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-e0b32dd5-15fd-4025-a943-7fb5b8f9250d tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8824f20e6a1f478a99f90e1ba8f028fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e436373e9e45efa03f08b33da619e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:19:57.076112 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e0b32dd5-15fd-4025-a943-7fb5b8f9250d tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] 10.222.0.52 "GET /compute/v2.1/servers/d6d507e4-3a53-4734-bb88-8fc38efa4d9b" status: 200 len: 1521 microversion: 2.1 time: 0.529023 Oct 19 03:19:57.095254 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1028/2021] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:19:56 2022] GET /compute/v2.1/servers/d6d507e4-3a53-4734-bb88-8fc38efa4d9b => generated 1521 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:19:57.114317 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-5ee7a29e-904c-47ea-8238-1783cf263711 req-2a872b4c-debb-4f26-9d4a-dff0bab8ecc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6888c8db-82ba-4072-b431-8d4fcf5f03e0", "name": "network-vif-plugged", "status": "completed", "tag": "7d06606b-5258-42bd-89b9-3f972fa9dcda"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:19:57.141897 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-5ee7a29e-904c-47ea-8238-1783cf263711 req-2a872b4c-debb-4f26-9d4a-dff0bab8ecc7 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:57.142673 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-5ee7a29e-904c-47ea-8238-1783cf263711 req-2a872b4c-debb-4f26-9d4a-dff0bab8ecc7 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:57.143184 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-5ee7a29e-904c-47ea-8238-1783cf263711 req-2a872b4c-debb-4f26-9d4a-dff0bab8ecc7 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:57.171787 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-5ee7a29e-904c-47ea-8238-1783cf263711 req-2a872b4c-debb-4f26-9d4a-dff0bab8ecc7 service nova] Creating event network-vif-plugged:7d06606b-5258-42bd-89b9-3f972fa9dcda for instance 6888c8db-82ba-4072-b431-8d4fcf5f03e0 on n-h1-861333-8 Oct 19 03:19:57.179081 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-5ee7a29e-904c-47ea-8238-1783cf263711 req-2a872b4c-debb-4f26-9d4a-dff0bab8ecc7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074051 Oct 19 03:19:57.179857 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1029/2022] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:19:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:19:57.198585 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-954af4d6-91d0-4fff-b035-88c1ee266074 req-e7d8097b-c2e0-43a6-8594-bc23d335071f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bcf14e6a-ecdc-40c0-b76b-678a1bb14828", "tag": "2e33b971-5f4b-4979-8038-bf99f7338ba3"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:19:57.259621 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-954af4d6-91d0-4fff-b035-88c1ee266074 req-e7d8097b-c2e0-43a6-8594-bc23d335071f service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:57.261918 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-954af4d6-91d0-4fff-b035-88c1ee266074 req-e7d8097b-c2e0-43a6-8594-bc23d335071f service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:57.263144 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-954af4d6-91d0-4fff-b035-88c1ee266074 req-e7d8097b-c2e0-43a6-8594-bc23d335071f service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:57.313053 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-954af4d6-91d0-4fff-b035-88c1ee266074 req-e7d8097b-c2e0-43a6-8594-bc23d335071f service nova] Creating event network-changed:2e33b971-5f4b-4979-8038-bf99f7338ba3 for instance bcf14e6a-ecdc-40c0-b76b-678a1bb14828 on n-h2-861333-8 Oct 19 03:19:57.331431 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-954af4d6-91d0-4fff-b035-88c1ee266074 req-e7d8097b-c2e0-43a6-8594-bc23d335071f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.149915 Oct 19 03:19:57.332893 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1030/2023] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:19:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:19:57.339586 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c7b773da-ac63-4aa5-9038-d82d3f89d1b3 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:57.345319 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c7b773da-ac63-4aa5-9038-d82d3f89d1b3 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] [instance: 19fbcbe2-9039-4d18-94ef-51ce58cb6365] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:19:57.354393 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c7b773da-ac63-4aa5-9038-d82d3f89d1b3 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:57.358809 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c7b773da-ac63-4aa5-9038-d82d3f89d1b3 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:57.359514 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c7b773da-ac63-4aa5-9038-d82d3f89d1b3 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:57.362760 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-2c23e806-a23c-47a8-8363-47a142eeb646 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] [instance: c6e2a8e3-4589-4037-b0d8-032541d043e3] Updating instance_info_cache with network_info: [{"id": "b8014d15-27b1-4267-af57-17ae32c38543", "address": "fa:16:3e:69:98:73", "network": {"id": "6eca3c34-0678-44d9-9b9a-0e414ced6160", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1455367799-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "be25c3ef65114ccc83b335b938743e90", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapb8014d15-27", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=121134) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 19 03:19:57.369203 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c7b773da-ac63-4aa5-9038-d82d3f89d1b3 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:57.369203 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c7b773da-ac63-4aa5-9038-d82d3f89d1b3 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:57.369203 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c7b773da-ac63-4aa5-9038-d82d3f89d1b3 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:57.482298 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2c23e806-a23c-47a8-8363-47a142eeb646 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Releasing lock "refresh_cache-c6e2a8e3-4589-4037-b0d8-032541d043e3" {{(pid=121134) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 19 03:19:57.484531 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2c23e806-a23c-47a8-8363-47a142eeb646 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] 10.222.0.52 "POST /compute/v2.1/servers/c6e2a8e3-4589-4037-b0d8-032541d043e3/action" status: 202 len: 0 microversion: 2.1 time: 3.572518 Oct 19 03:19:57.485905 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 994/2024] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:19:53 2022] POST /compute/v2.1/servers/c6e2a8e3-4589-4037-b0d8-032541d043e3/action => generated 0 bytes in 3575 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 19 03:19:57.493563 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a6892b7c-7536-4170-b06d-af408a9e2b02 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Action: 'action', calling method: .version_select at 0x7fc132ab53a0>, body: {"addFloatingIp": {"address": "172.25.7.89"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:19:57.499220 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a6892b7c-7536-4170-b06d-af408a9e2b02 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] [instance: b97f61ab-18fc-4cf6-bc15-ec08ac4750fd] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:19:57.530603 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a6892b7c-7536-4170-b06d-af408a9e2b02 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:57.531576 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a6892b7c-7536-4170-b06d-af408a9e2b02 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:57.532364 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a6892b7c-7536-4170-b06d-af408a9e2b02 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:57.534536 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a6892b7c-7536-4170-b06d-af408a9e2b02 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:57.535352 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a6892b7c-7536-4170-b06d-af408a9e2b02 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:57.537120 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a6892b7c-7536-4170-b06d-af408a9e2b02 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:57.590915 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a6892b7c-7536-4170-b06d-af408a9e2b02 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Acquiring lock "refresh_cache-b97f61ab-18fc-4cf6-bc15-ec08ac4750fd" {{(pid=121134) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 19 03:19:57.591992 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a6892b7c-7536-4170-b06d-af408a9e2b02 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Acquired lock "refresh_cache-b97f61ab-18fc-4cf6-bc15-ec08ac4750fd" {{(pid=121134) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 19 03:19:57.935512 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c7b773da-ac63-4aa5-9038-d82d3f89d1b3 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4c5e4123c44508a5d4911a17c44231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a495ccfced47f29cb928d1ded20d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:19:57.943668 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:19:57.946987 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c7b773da-ac63-4aa5-9038-d82d3f89d1b3 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] 10.222.0.52 "GET /compute/v2.1/servers/19fbcbe2-9039-4d18-94ef-51ce58cb6365" status: 200 len: 1314 microversion: 2.1 time: 0.612173 Oct 19 03:19:57.962245 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1031/2025] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:19:57 2022] GET /compute/v2.1/servers/19fbcbe2-9039-4d18-94ef-51ce58cb6365 => generated 1314 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:19:57.962245 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-90dd6739-1be2-4402-96a0-0dd3aa403960 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:19:57.962245 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-90dd6739-1be2-4402-96a0-0dd3aa403960 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] [instance: d6d507e4-3a53-4734-bb88-8fc38efa4d9b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:19:57.962245 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-90dd6739-1be2-4402-96a0-0dd3aa403960 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:57.963388 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-90dd6739-1be2-4402-96a0-0dd3aa403960 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:57.963388 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-90dd6739-1be2-4402-96a0-0dd3aa403960 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:57.963388 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-90dd6739-1be2-4402-96a0-0dd3aa403960 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:19:57.963388 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-90dd6739-1be2-4402-96a0-0dd3aa403960 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:19:57.964880 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-90dd6739-1be2-4402-96a0-0dd3aa403960 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:19:58.000907 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-90dd6739-1be2-4402-96a0-0dd3aa403960 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] [instance: d6d507e4-3a53-4734-bb88-8fc38efa4d9b] Going to try to terminate instance {{(pid=121135) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:19:58.363942 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-90dd6739-1be2-4402-96a0-0dd3aa403960 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] 10.222.0.52 "DELETE /compute/v2.1/servers/d6d507e4-3a53-4734-bb88-8fc38efa4d9b" status: 204 len: 0 microversion: 2.1 time: 0.413867 Oct 19 03:19:58.365007 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1032/2026] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:19:57 2022] DELETE /compute/v2.1/servers/d6d507e4-3a53-4734-bb88-8fc38efa4d9b => generated 0 bytes in 416 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:19:58.372465 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-04d72802-39fd-4414-864f-81ef733d54e6 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Calling method '.version_select at 0x7fc134f743a0>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:20:00.794612 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-04d72802-39fd-4414-864f-81ef733d54e6 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] 10.222.0.52 "DELETE /compute/v2.1/os-floating-ips/2780b8a2-178f-4ef6-98fe-a5447f08e528" status: 202 len: 0 microversion: 2.1 time: 2.427742 Oct 19 03:20:00.795896 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1033/2027] 10.222.0.52 () {58 vars in 1263 bytes} [Wed Oct 19 03:19:58 2022] DELETE /compute/v2.1/os-floating-ips/2780b8a2-178f-4ef6-98fe-a5447f08e528 => generated 0 bytes in 2430 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:20:00.808786 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f7db6937-e544-4570-8a8b-4f804c78d666 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:20:00.812429 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f7db6937-e544-4570-8a8b-4f804c78d666 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] [instance: d6d507e4-3a53-4734-bb88-8fc38efa4d9b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:20:00.827758 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f7db6937-e544-4570-8a8b-4f804c78d666 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:00.829696 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f7db6937-e544-4570-8a8b-4f804c78d666 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:00.830264 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f7db6937-e544-4570-8a8b-4f804c78d666 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:00.831065 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f7db6937-e544-4570-8a8b-4f804c78d666 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:00.831529 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f7db6937-e544-4570-8a8b-4f804c78d666 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:00.832046 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f7db6937-e544-4570-8a8b-4f804c78d666 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:01.253818 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f7db6937-e544-4570-8a8b-4f804c78d666 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8824f20e6a1f478a99f90e1ba8f028fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e436373e9e45efa03f08b33da619e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:01.268741 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f7db6937-e544-4570-8a8b-4f804c78d666 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] 10.222.0.52 "GET /compute/v2.1/servers/d6d507e4-3a53-4734-bb88-8fc38efa4d9b" status: 200 len: 1527 microversion: 2.1 time: 0.465603 Oct 19 03:20:01.270222 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1034/2028] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:20:00 2022] GET /compute/v2.1/servers/d6d507e4-3a53-4734-bb88-8fc38efa4d9b => generated 1527 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:20:01.278035 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-719a717b-3cc9-42d6-9f12-102e0f3b792e tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:20:01.279420 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-719a717b-3cc9-42d6-9f12-102e0f3b792e tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] [instance: 19fbcbe2-9039-4d18-94ef-51ce58cb6365] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:20:01.293597 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-719a717b-3cc9-42d6-9f12-102e0f3b792e tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:01.294336 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-719a717b-3cc9-42d6-9f12-102e0f3b792e tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:01.302519 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-719a717b-3cc9-42d6-9f12-102e0f3b792e tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:01.303689 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-719a717b-3cc9-42d6-9f12-102e0f3b792e tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:01.304343 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-719a717b-3cc9-42d6-9f12-102e0f3b792e tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:01.304950 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-719a717b-3cc9-42d6-9f12-102e0f3b792e tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:01.941691 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-719a717b-3cc9-42d6-9f12-102e0f3b792e tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4c5e4123c44508a5d4911a17c44231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a495ccfced47f29cb928d1ded20d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:01.951782 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-719a717b-3cc9-42d6-9f12-102e0f3b792e tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] 10.222.0.52 "GET /compute/v2.1/servers/19fbcbe2-9039-4d18-94ef-51ce58cb6365" status: 200 len: 1314 microversion: 2.1 time: 0.679970 Oct 19 03:20:01.953092 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1035/2029] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:20:01 2022] GET /compute/v2.1/servers/19fbcbe2-9039-4d18-94ef-51ce58cb6365 => generated 1314 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:20:01.986242 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-a0df2eaf-f840-4f90-8a02-14c8df76b9af req-c84669cb-bc7e-4e42-922e-ff1af6248082 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19fbcbe2-9039-4d18-94ef-51ce58cb6365", "name": "network-vif-plugged", "status": "completed", "tag": "9630ac60-448c-49d9-b986-9926a85b1f58"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:20:02.017214 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-a0df2eaf-f840-4f90-8a02-14c8df76b9af req-c84669cb-bc7e-4e42-922e-ff1af6248082 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:02.018247 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-a0df2eaf-f840-4f90-8a02-14c8df76b9af req-c84669cb-bc7e-4e42-922e-ff1af6248082 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:02.019200 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-a0df2eaf-f840-4f90-8a02-14c8df76b9af req-c84669cb-bc7e-4e42-922e-ff1af6248082 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:02.078537 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-a0df2eaf-f840-4f90-8a02-14c8df76b9af req-c84669cb-bc7e-4e42-922e-ff1af6248082 service nova] Creating event network-vif-plugged:9630ac60-448c-49d9-b986-9926a85b1f58 for instance 19fbcbe2-9039-4d18-94ef-51ce58cb6365 on n-h1-861333-8 Oct 19 03:20:02.090226 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-a0df2eaf-f840-4f90-8a02-14c8df76b9af req-c84669cb-bc7e-4e42-922e-ff1af6248082 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129720 Oct 19 03:20:02.095455 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1036/2030] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:20:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:20:02.103705 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.network.neutron [None req-a6892b7c-7536-4170-b06d-af408a9e2b02 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] [instance: b97f61ab-18fc-4cf6-bc15-ec08ac4750fd] re-assign floating IP 172.25.7.89 from instance bcf14e6a-ecdc-40c0-b76b-678a1bb14828 Oct 19 03:20:02.109638 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-fc442e53-7ac5-4c44-9d84-7254ba84493b req-d782e29a-ec6a-4dc9-9e93-a0b3f73becc1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6e2a8e3-4589-4037-b0d8-032541d043e3", "tag": "b8014d15-27b1-4267-af57-17ae32c38543"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:20:02.135191 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-fc442e53-7ac5-4c44-9d84-7254ba84493b req-d782e29a-ec6a-4dc9-9e93-a0b3f73becc1 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:02.137119 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-fc442e53-7ac5-4c44-9d84-7254ba84493b req-d782e29a-ec6a-4dc9-9e93-a0b3f73becc1 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:02.138813 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-fc442e53-7ac5-4c44-9d84-7254ba84493b req-d782e29a-ec6a-4dc9-9e93-a0b3f73becc1 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:02.199781 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-fc442e53-7ac5-4c44-9d84-7254ba84493b req-d782e29a-ec6a-4dc9-9e93-a0b3f73becc1 service nova] Creating event network-changed:b8014d15-27b1-4267-af57-17ae32c38543 for instance c6e2a8e3-4589-4037-b0d8-032541d043e3 on n-h1-861333-8 Oct 19 03:20:02.216308 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-a6892b7c-7536-4170-b06d-af408a9e2b02 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] [instance: bcf14e6a-ecdc-40c0-b76b-678a1bb14828] Building network info cache for instance {{(pid=121134) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 19 03:20:02.236378 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-fc442e53-7ac5-4c44-9d84-7254ba84493b req-d782e29a-ec6a-4dc9-9e93-a0b3f73becc1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.143494 Oct 19 03:20:02.239663 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1037/2031] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:20:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:20:02.253297 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5a44b57f-7924-49cd-a6e3-8a8c09e8b2cb tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:20:02.260562 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5a44b57f-7924-49cd-a6e3-8a8c09e8b2cb tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Request method failure captured: Oct 19 03:20:02.260562 n-d-861333-8 devstack@n-api.service[121135]: request: POST /compute/v2.1/servers/c6e2a8e3-4589-4037-b0d8-032541d043e3/action HTTP/1.1 Oct 19 03:20:02.260562 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:20:02.260562 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:20:02.260562 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:20:02.260562 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 34 Oct 19 03:20:02.260562 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:20:02.260562 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:20:02.260562 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:20:02.260562 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:20:02.260562 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2yqaPaGcq-c15urVLpzfs3V-94tJdAtgMccdDwNmTmV7vHTHa8WU0sLqvoI7rKWiP2_3WB8q0vcFNFjKDpYt1dXYsgfK3sYsFptkNYuLZNDPlJITSYq6jhHbNPpGkFAhjLQbIvGlt-oy7vmVBShPfosqaJSH2-YWR_EWj-vYwvb_qk Oct 19 03:20:02.260562 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:20:02.260562 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:20:02.260562 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:20:02.260562 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:20:02.260562 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:20:02.260562 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:20:02.260562 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: be25c3ef65114ccc83b335b938743e90 Oct 19 03:20:02.260562 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 Oct 19 03:20:02.260562 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:20:02.260562 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:20:02.263156 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/be25c3ef65114ccc83b335b938743e90"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/be25c3ef65114ccc83b335b938743e90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/be25c3ef65114ccc83b335b938743e90"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_be25c3ef65114ccc83b335b938743e90", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:20:02.263156 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 Oct 19 03:20:02.263156 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: be25c3ef65114ccc83b335b938743e90 Oct 19 03:20:02.263156 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 Oct 19 03:20:02.263156 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project Oct 19 03:20:02.263156 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:20:02.263156 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:20:02.263156 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 8920755dc8594da4b57f3ecc920db95d Oct 19 03:20:02.263156 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project Oct 19 03:20:02.263156 n-d-861333-8 devstack@n-api.service[121135]: Oct 19 03:20:02.263156 n-d-861333-8 devstack@n-api.service[121135]: {"addFloatingIp": {"address": ""}} Oct 19 03:20:02.263156 n-d-861333-8 devstack@n-api.service[121135]: method: Oct 19 03:20:02.263156 n-d-861333-8 devstack@n-api.service[121135]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 19 03:20:02.264964 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': 'c6e2a8e3-4589-4037-b0d8-032541d043e3', 'body': {'addFloatingIp': {'address': ''}}} Oct 19 03:20:02.264964 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:20:02.264964 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:20:02.264964 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 03:20:02.264964 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 03:20:02.264964 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 03:20:02.264964 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise error Oct 19 03:20:02.264964 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Oct 19 03:20:02.264964 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:20:02.264964 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Oct 19 03:20:02.264964 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Oct 19 03:20:02.264964 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:20:02.264964 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Oct 19 03:20:02.264964 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi '' Oct 19 03:20:02.264964 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:20:02.264964 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:20:02.264964 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:20:02.264964 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:20:02.264964 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:20:02.264964 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:20:02.264964 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:20:02.264964 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:20:02.278069 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 03:20:02.278069 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 03:20:02.278069 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:20:02.278069 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:20:02.278069 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 03:20:02.278069 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 03:20:02.278069 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 03:20:02.278069 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 03:20:02.278069 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 03:20:02.278069 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 03:20:02.278069 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 19 03:20:02.278069 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:20:02.278069 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:20:02.278069 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:20:02.278069 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:20:02.278069 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:20:02.278069 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:20:02.278069 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 03:20:02.278069 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 03:20:02.280288 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 19 03:20:02.280288 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:20:02.280288 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5a44b57f-7924-49cd-a6e3-8a8c09e8b2cb tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:20:02.280288 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5a44b57f-7924-49cd-a6e3-8a8c09e8b2cb tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] 10.222.0.52 "POST /compute/v2.1/servers/c6e2a8e3-4589-4037-b0d8-032541d043e3/action" status: 400 len: 142 microversion: 2.1 time: 0.024226 Oct 19 03:20:02.280288 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1038/2032] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:20:02 2022] POST /compute/v2.1/servers/c6e2a8e3-4589-4037-b0d8-032541d043e3/action => generated 142 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 03:20:02.293344 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-725101e9-abc5-4e68-bf46-5a5e741d6b66 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:20:02.308291 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-725101e9-abc5-4e68-bf46-5a5e741d6b66 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] [instance: c6e2a8e3-4589-4037-b0d8-032541d043e3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:20:02.330243 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-725101e9-abc5-4e68-bf46-5a5e741d6b66 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:02.331699 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-725101e9-abc5-4e68-bf46-5a5e741d6b66 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:02.332178 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-725101e9-abc5-4e68-bf46-5a5e741d6b66 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:02.334861 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-725101e9-abc5-4e68-bf46-5a5e741d6b66 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:02.337065 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-725101e9-abc5-4e68-bf46-5a5e741d6b66 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:02.338297 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-725101e9-abc5-4e68-bf46-5a5e741d6b66 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:02.458718 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-725101e9-abc5-4e68-bf46-5a5e741d6b66 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Acquiring lock "refresh_cache-c6e2a8e3-4589-4037-b0d8-032541d043e3" {{(pid=121135) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 19 03:20:02.458996 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-725101e9-abc5-4e68-bf46-5a5e741d6b66 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Acquired lock "refresh_cache-c6e2a8e3-4589-4037-b0d8-032541d043e3" {{(pid=121135) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 19 03:20:03.124879 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-725101e9-abc5-4e68-bf46-5a5e741d6b66 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Releasing lock "refresh_cache-c6e2a8e3-4589-4037-b0d8-032541d043e3" {{(pid=121135) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 19 03:20:03.124879 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-725101e9-abc5-4e68-bf46-5a5e741d6b66 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] HTTP exception thrown: floating IP not found Oct 19 03:20:03.124879 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-725101e9-abc5-4e68-bf46-5a5e741d6b66 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Request method failure captured: Oct 19 03:20:03.124879 n-d-861333-8 devstack@n-api.service[121135]: request: POST /compute/v2.1/servers/c6e2a8e3-4589-4037-b0d8-032541d043e3/action HTTP/1.1 Oct 19 03:20:03.124879 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:20:03.124879 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:20:03.124879 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:20:03.124879 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 41 Oct 19 03:20:03.124879 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:20:03.124879 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:20:03.124879 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:20:03.124879 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:20:03.124879 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2yqaPaGcq-c15urVLpzfs3V-94tJdAtgMccdDwNmTmV7vHTHa8WU0sLqvoI7rKWiP2_3WB8q0vcFNFjKDpYt1dXYsgfK3sYsFptkNYuLZNDPlJITSYq6jhHbNPpGkFAhjLQbIvGlt-oy7vmVBShPfosqaJSH2-YWR_EWj-vYwvb_qk Oct 19 03:20:03.124879 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:20:03.124879 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:20:03.124879 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:20:03.124879 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:20:03.124879 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:20:03.124879 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:20:03.124879 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: be25c3ef65114ccc83b335b938743e90 Oct 19 03:20:03.124879 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 Oct 19 03:20:03.124879 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:20:03.124879 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:20:03.127036 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/be25c3ef65114ccc83b335b938743e90"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/be25c3ef65114ccc83b335b938743e90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/be25c3ef65114ccc83b335b938743e90"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_be25c3ef65114ccc83b335b938743e90", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:20:03.127036 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 Oct 19 03:20:03.127036 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: be25c3ef65114ccc83b335b938743e90 Oct 19 03:20:03.127036 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 Oct 19 03:20:03.127036 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project Oct 19 03:20:03.127036 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:20:03.127036 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:20:03.127036 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 8920755dc8594da4b57f3ecc920db95d Oct 19 03:20:03.127036 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project Oct 19 03:20:03.127036 n-d-861333-8 devstack@n-api.service[121135]: Oct 19 03:20:03.127036 n-d-861333-8 devstack@n-api.service[121135]: {"addFloatingIp": {"address": "0.0.0.0"}} Oct 19 03:20:03.127036 n-d-861333-8 devstack@n-api.service[121135]: method: Oct 19 03:20:03.127036 n-d-861333-8 devstack@n-api.service[121135]: exception: floating IP not found Oct 19 03:20:03.127958 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': 'c6e2a8e3-4589-4037-b0d8-032541d043e3', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Oct 19 03:20:03.127958 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:20:03.127958 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:20:03.127958 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 19 03:20:03.127958 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 19 03:20:03.127958 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 19 03:20:03.127958 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 19 03:20:03.127958 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2699, in associate_floating_ip Oct 19 03:20:03.127958 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Oct 19 03:20:03.127958 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 19 03:20:03.127958 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 19 03:20:03.127958 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 19 03:20:03.127958 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:20:03.127958 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:20:03.127958 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:20:03.127958 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:20:03.127958 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:20:03.127958 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:20:03.127958 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:20:03.129324 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:20:03.129324 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 03:20:03.129324 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 03:20:03.129324 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:20:03.129324 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:20:03.129324 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:20:03.129324 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:20:03.129324 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Oct 19 03:20:03.129324 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 19 03:20:03.129324 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Oct 19 03:20:03.129324 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:20:03.129324 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:20:03.129324 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:20:03.129324 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:20:03.129324 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:20:03.129324 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:20:03.129324 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:20:03.129324 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:20:03.129324 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Oct 19 03:20:03.129324 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:20:03.131359 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-725101e9-abc5-4e68-bf46-5a5e741d6b66 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Returning 404 to user: floating IP not found {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:20:03.131359 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-725101e9-abc5-4e68-bf46-5a5e741d6b66 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] 10.222.0.52 "POST /compute/v2.1/servers/c6e2a8e3-4589-4037-b0d8-032541d043e3/action" status: 404 len: 67 microversion: 2.1 time: 0.850127 Oct 19 03:20:03.131359 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1039/2033] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:20:02 2022] POST /compute/v2.1/servers/c6e2a8e3-4589-4037-b0d8-032541d043e3/action => generated 67 bytes in 851 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 03:20:03.134330 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6bddb068-e137-4ad1-9ae9-6b7dd2378b75 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:20:03.134330 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6bddb068-e137-4ad1-9ae9-6b7dd2378b75 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] [instance: d6d507e4-3a53-4734-bb88-8fc38efa4d9b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:20:03.151031 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6bddb068-e137-4ad1-9ae9-6b7dd2378b75 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:03.151538 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6bddb068-e137-4ad1-9ae9-6b7dd2378b75 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:03.151987 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6bddb068-e137-4ad1-9ae9-6b7dd2378b75 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:03.155267 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6bddb068-e137-4ad1-9ae9-6b7dd2378b75 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:03.155762 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6bddb068-e137-4ad1-9ae9-6b7dd2378b75 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:03.168257 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6bddb068-e137-4ad1-9ae9-6b7dd2378b75 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:03.269703 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6bddb068-e137-4ad1-9ae9-6b7dd2378b75 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:03.271075 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6bddb068-e137-4ad1-9ae9-6b7dd2378b75 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:03.271882 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6bddb068-e137-4ad1-9ae9-6b7dd2378b75 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:03.272564 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-6bddb068-e137-4ad1-9ae9-6b7dd2378b75 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lazy-loading 'fault' on Instance uuid d6d507e4-3a53-4734-bb88-8fc38efa4d9b {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:20:03.440302 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-6bddb068-e137-4ad1-9ae9-6b7dd2378b75 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8824f20e6a1f478a99f90e1ba8f028fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e436373e9e45efa03f08b33da619e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:03.454375 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6bddb068-e137-4ad1-9ae9-6b7dd2378b75 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] 10.222.0.52 "GET /compute/v2.1/servers/d6d507e4-3a53-4734-bb88-8fc38efa4d9b" status: 200 len: 1314 microversion: 2.1 time: 0.326508 Oct 19 03:20:03.459324 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1040/2034] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:20:03 2022] GET /compute/v2.1/servers/d6d507e4-3a53-4734-bb88-8fc38efa4d9b => generated 1314 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:20:03.472162 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a7b2e358-d652-4f40-af36-e4f43d5a0515 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:20:03.474279 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a7b2e358-d652-4f40-af36-e4f43d5a0515 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] [instance: 19fbcbe2-9039-4d18-94ef-51ce58cb6365] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:20:03.488186 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a7b2e358-d652-4f40-af36-e4f43d5a0515 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:03.488937 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a7b2e358-d652-4f40-af36-e4f43d5a0515 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:03.490265 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a7b2e358-d652-4f40-af36-e4f43d5a0515 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:03.492360 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a7b2e358-d652-4f40-af36-e4f43d5a0515 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:03.494045 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a7b2e358-d652-4f40-af36-e4f43d5a0515 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:03.494564 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a7b2e358-d652-4f40-af36-e4f43d5a0515 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:04.242782 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a7b2e358-d652-4f40-af36-e4f43d5a0515 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4c5e4123c44508a5d4911a17c44231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a495ccfced47f29cb928d1ded20d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:04.246362 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a7b2e358-d652-4f40-af36-e4f43d5a0515 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] 10.222.0.52 "GET /compute/v2.1/servers/19fbcbe2-9039-4d18-94ef-51ce58cb6365" status: 200 len: 1314 microversion: 2.1 time: 0.785668 Oct 19 03:20:04.249864 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1041/2035] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:20:03 2022] GET /compute/v2.1/servers/19fbcbe2-9039-4d18-94ef-51ce58cb6365 => generated 1314 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:20:04.255863 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1538e354-6453-4d78-9bc7-886b02469dc3 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Action: 'action', calling method: .version_select at 0x7fc132ab7820>, body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:20:04.410527 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-1538e354-6453-4d78-9bc7-886b02469dc3 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Oct 19 03:20:04.412742 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1538e354-6453-4d78-9bc7-886b02469dc3 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Request method failure captured: Oct 19 03:20:04.412742 n-d-861333-8 devstack@n-api.service[121135]: request: POST /compute/v2.1/servers/c6e2a8e3-4589-4037-b0d8-032541d043e3/action HTTP/1.1 Oct 19 03:20:04.412742 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:20:04.412742 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:20:04.412742 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:20:04.412742 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 44 Oct 19 03:20:04.412742 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:20:04.412742 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:20:04.412742 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:20:04.412742 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:20:04.412742 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2yqaPaGcq-c15urVLpzfs3V-94tJdAtgMccdDwNmTmV7vHTHa8WU0sLqvoI7rKWiP2_3WB8q0vcFNFjKDpYt1dXYsgfK3sYsFptkNYuLZNDPlJITSYq6jhHbNPpGkFAhjLQbIvGlt-oy7vmVBShPfosqaJSH2-YWR_EWj-vYwvb_qk Oct 19 03:20:04.412742 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:20:04.412742 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:20:04.412742 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:20:04.412742 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:20:04.412742 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:20:04.412742 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:20:04.412742 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: be25c3ef65114ccc83b335b938743e90 Oct 19 03:20:04.412742 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 Oct 19 03:20:04.412742 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:20:04.412742 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:20:04.414325 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/be25c3ef65114ccc83b335b938743e90"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/be25c3ef65114ccc83b335b938743e90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/be25c3ef65114ccc83b335b938743e90"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_be25c3ef65114ccc83b335b938743e90", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:20:04.414325 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 Oct 19 03:20:04.414325 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: be25c3ef65114ccc83b335b938743e90 Oct 19 03:20:04.414325 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 Oct 19 03:20:04.414325 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project Oct 19 03:20:04.414325 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:20:04.414325 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:20:04.414325 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 8920755dc8594da4b57f3ecc920db95d Oct 19 03:20:04.414325 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project Oct 19 03:20:04.414325 n-d-861333-8 devstack@n-api.service[121135]: Oct 19 03:20:04.414325 n-d-861333-8 devstack@n-api.service[121135]: {"removeFloatingIp": {"address": "0.0.0.0"}} Oct 19 03:20:04.414325 n-d-861333-8 devstack@n-api.service[121135]: method: Oct 19 03:20:04.414325 n-d-861333-8 devstack@n-api.service[121135]: exception: Floating IP not found for address 0.0.0.0. Oct 19 03:20:04.415309 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': 'c6e2a8e3-4589-4037-b0d8-032541d043e3', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Oct 19 03:20:04.415309 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:20:04.415309 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:20:04.415309 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Oct 19 03:20:04.415309 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Oct 19 03:20:04.415309 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2927, in get_instance_id_by_floating_address Oct 19 03:20:04.415309 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Oct 19 03:20:04.415309 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 19 03:20:04.415309 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 19 03:20:04.415309 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 19 03:20:04.415309 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:20:04.415309 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:20:04.415309 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:20:04.415309 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:20:04.415309 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:20:04.415309 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:20:04.415309 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:20:04.415309 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:20:04.415309 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 03:20:04.417324 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 03:20:04.417324 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:20:04.417324 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:20:04.417324 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:20:04.417324 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:20:04.417324 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Oct 19 03:20:04.417324 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Oct 19 03:20:04.417324 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Oct 19 03:20:04.417324 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Oct 19 03:20:04.417324 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Oct 19 03:20:04.417324 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:20:04.417324 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:20:04.417324 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:20:04.417324 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:20:04.417324 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:20:04.417324 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:20:04.417324 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:20:04.417324 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:20:04.417324 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Oct 19 03:20:04.417324 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:20:04.419672 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1538e354-6453-4d78-9bc7-886b02469dc3 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:20:04.419672 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1538e354-6453-4d78-9bc7-886b02469dc3 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] 10.222.0.52 "POST /compute/v2.1/servers/c6e2a8e3-4589-4037-b0d8-032541d043e3/action" status: 404 len: 88 microversion: 2.1 time: 0.163252 Oct 19 03:20:04.419672 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1042/2036] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:20:04 2022] POST /compute/v2.1/servers/c6e2a8e3-4589-4037-b0d8-032541d043e3/action => generated 88 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 03:20:04.420461 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-4f748966-c02f-4818-9648-16152b787e63 req-5ae65066-1386-4965-8cd9-c1a1cb49a43d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bcf14e6a-ecdc-40c0-b76b-678a1bb14828", "tag": "2e33b971-5f4b-4979-8038-bf99f7338ba3"}, {"name": "network-changed", "server_uuid": "b97f61ab-18fc-4cf6-bc15-ec08ac4750fd", "tag": "bcf93ca2-3c93-402b-9421-7ee5460dace0"}, {"server_uuid": "d6d507e4-3a53-4734-bb88-8fc38efa4d9b", "name": "network-vif-deleted", "tag": "c233e8b9-5426-4564-90a1-f4bfcb4d3a76"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:20:04.450446 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-4f748966-c02f-4818-9648-16152b787e63 req-5ae65066-1386-4965-8cd9-c1a1cb49a43d service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:04.453711 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-4f748966-c02f-4818-9648-16152b787e63 req-5ae65066-1386-4965-8cd9-c1a1cb49a43d service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:04.454530 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-4f748966-c02f-4818-9648-16152b787e63 req-5ae65066-1386-4965-8cd9-c1a1cb49a43d service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:04.461799 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-a6892b7c-7536-4170-b06d-af408a9e2b02 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] [instance: bcf14e6a-ecdc-40c0-b76b-678a1bb14828] Updating instance_info_cache with network_info: [{"id": "2e33b971-5f4b-4979-8038-bf99f7338ba3", "address": "fa:16:3e:02:c8:80", "network": {"id": "6b3013ab-5e3b-4dca-bc82-37c6dc5721e3", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-694479142-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "0e5d239ae4b24b7e978935fe9b3458cf", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap2e33b971-5f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=121134) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 19 03:20:04.494638 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-4f748966-c02f-4818-9648-16152b787e63 req-5ae65066-1386-4965-8cd9-c1a1cb49a43d service nova] Creating event network-changed:2e33b971-5f4b-4979-8038-bf99f7338ba3 for instance bcf14e6a-ecdc-40c0-b76b-678a1bb14828 on n-h2-861333-8 Oct 19 03:20:04.495934 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-4f748966-c02f-4818-9648-16152b787e63 req-5ae65066-1386-4965-8cd9-c1a1cb49a43d service nova] Creating event network-changed:bcf93ca2-3c93-402b-9421-7ee5460dace0 for instance b97f61ab-18fc-4cf6-bc15-ec08ac4750fd on n-h1-861333-8 Oct 19 03:20:04.496645 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-4f748966-c02f-4818-9648-16152b787e63 req-5ae65066-1386-4965-8cd9-c1a1cb49a43d service nova] Creating event network-vif-deleted:c233e8b9-5426-4564-90a1-f4bfcb4d3a76 for instance d6d507e4-3a53-4734-bb88-8fc38efa4d9b on n-h2-861333-8 Oct 19 03:20:04.518701 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-4f748966-c02f-4818-9648-16152b787e63 req-5ae65066-1386-4965-8cd9-c1a1cb49a43d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 517 microversion: 2.1 time: 0.102007 Oct 19 03:20:04.527130 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1043/2037] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:20:04 2022] POST /compute/v2.1/os-server-external-events => generated 517 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:20:04.542100 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3dea78b0-4b91-4e9f-b1f4-1bde6d0f3483 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:20:04.544134 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-3dea78b0-4b91-4e9f-b1f4-1bde6d0f3483 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] [instance: c6e2a8e3-4589-4037-b0d8-032541d043e3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:20:04.560613 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-a6892b7c-7536-4170-b06d-af408a9e2b02 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] [instance: b97f61ab-18fc-4cf6-bc15-ec08ac4750fd] Building network info cache for instance {{(pid=121134) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 19 03:20:04.584827 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3dea78b0-4b91-4e9f-b1f4-1bde6d0f3483 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:04.589494 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3dea78b0-4b91-4e9f-b1f4-1bde6d0f3483 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:04.591343 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3dea78b0-4b91-4e9f-b1f4-1bde6d0f3483 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:04.595554 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3dea78b0-4b91-4e9f-b1f4-1bde6d0f3483 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:04.596325 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3dea78b0-4b91-4e9f-b1f4-1bde6d0f3483 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:04.596947 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3dea78b0-4b91-4e9f-b1f4-1bde6d0f3483 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:04.666905 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-3dea78b0-4b91-4e9f-b1f4-1bde6d0f3483 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] [instance: c6e2a8e3-4589-4037-b0d8-032541d043e3] Going to try to terminate instance {{(pid=121135) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:20:05.110826 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-3dea78b0-4b91-4e9f-b1f4-1bde6d0f3483 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] 10.222.0.52 "DELETE /compute/v2.1/servers/c6e2a8e3-4589-4037-b0d8-032541d043e3" status: 204 len: 0 microversion: 2.1 time: 0.581938 Oct 19 03:20:05.112139 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1044/2038] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:20:04 2022] DELETE /compute/v2.1/servers/c6e2a8e3-4589-4037-b0d8-032541d043e3 => generated 0 bytes in 584 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:20:05.122766 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-42900a12-61f0-4a33-bbde-ed3453522a2e tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:20:05.122766 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-42900a12-61f0-4a33-bbde-ed3453522a2e tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] [instance: d6d507e4-3a53-4734-bb88-8fc38efa4d9b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:20:05.158255 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-42900a12-61f0-4a33-bbde-ed3453522a2e tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:05.164113 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-42900a12-61f0-4a33-bbde-ed3453522a2e tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:05.169177 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-42900a12-61f0-4a33-bbde-ed3453522a2e tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:05.171367 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-42900a12-61f0-4a33-bbde-ed3453522a2e tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:05.174616 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-42900a12-61f0-4a33-bbde-ed3453522a2e tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:05.175479 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-42900a12-61f0-4a33-bbde-ed3453522a2e tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:05.248949 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-42900a12-61f0-4a33-bbde-ed3453522a2e tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] HTTP exception thrown: Instance d6d507e4-3a53-4734-bb88-8fc38efa4d9b could not be found. Oct 19 03:20:05.258504 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-42900a12-61f0-4a33-bbde-ed3453522a2e tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Request method failure captured: Oct 19 03:20:05.258504 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/d6d507e4-3a53-4734-bb88-8fc38efa4d9b HTTP/1.1 Oct 19 03:20:05.258504 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:20:05.258504 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:20:05.258504 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:20:05.258504 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:20:05.258504 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:20:05.258504 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:20:05.258504 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:20:05.258504 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:20:05.258504 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2y5QS5fGXOCh8dCARu_-t2vnckF3uwZtfqi9DmHed6pMoXibNoREyH_7cDYk3t8P2qbQ1u564D6Sq50msRMl2YQVddoWmeJm48OR72Wl7OECfXwMpGVDHULH4PSkCmyy31jkBvdZSxqyCmIGP32xNgLbjMxF4SrMQTDektLd28zxNg Oct 19 03:20:05.258504 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:20:05.258504 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:20:05.258504 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:20:05.258504 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:20:05.258504 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:20:05.258504 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:20:05.258504 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: f9e436373e9e45efa03f08b33da619e8 Oct 19 03:20:05.258504 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1767182949 Oct 19 03:20:05.258504 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:20:05.258504 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:20:05.260265 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f9e436373e9e45efa03f08b33da619e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f9e436373e9e45efa03f08b33da619e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f9e436373e9e45efa03f08b33da619e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f9e436373e9e45efa03f08b33da619e8", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:20:05.260265 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1767182949 Oct 19 03:20:05.260265 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: f9e436373e9e45efa03f08b33da619e8 Oct 19 03:20:05.260265 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1767182949 Oct 19 03:20:05.260265 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ImagesOneServerNegativeTestJSON-1767182949-project Oct 19 03:20:05.260265 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:20:05.260265 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:20:05.260265 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 8824f20e6a1f478a99f90e1ba8f028fe Oct 19 03:20:05.260265 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1767182949-project Oct 19 03:20:05.260265 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:20:05.260265 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance d6d507e4-3a53-4734-bb88-8fc38efa4d9b could not be found. Oct 19 03:20:05.260265 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': 'd6d507e4-3a53-4734-bb88-8fc38efa4d9b'} Oct 19 03:20:05.261155 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:20:05.261155 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:20:05.261155 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:20:05.261155 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:20:05.261155 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:20:05.261155 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:20:05.261155 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:20:05.261155 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:20:05.261155 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:20:05.261155 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:20:05.261155 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6d507e4-3a53-4734-bb88-8fc38efa4d9b could not be found. Oct 19 03:20:05.261155 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:20:05.261155 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:20:05.261155 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:20:05.261155 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:20:05.261155 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:20:05.261155 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:20:05.261155 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:20:05.261155 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:20:05.261155 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:20:05.262666 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:20:05.262666 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:20:05.262666 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:20:05.262666 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:20:05.262666 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:20:05.262666 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:20:05.262666 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:20:05.262666 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6d507e4-3a53-4734-bb88-8fc38efa4d9b could not be found. Oct 19 03:20:05.262666 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:20:05.262666 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:20:05.262666 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:20:05.262666 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:20:05.262666 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:20:05.262666 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:20:05.262666 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:20:05.262666 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:20:05.262666 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6d507e4-3a53-4734-bb88-8fc38efa4d9b could not be found. Oct 19 03:20:05.262666 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:20:05.281273 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-42900a12-61f0-4a33-bbde-ed3453522a2e tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Returning 404 to user: Instance d6d507e4-3a53-4734-bb88-8fc38efa4d9b could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:20:05.281273 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-42900a12-61f0-4a33-bbde-ed3453522a2e tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] 10.222.0.52 "GET /compute/v2.1/servers/d6d507e4-3a53-4734-bb88-8fc38efa4d9b" status: 404 len: 111 microversion: 2.1 time: 0.159712 Oct 19 03:20:05.281273 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1045/2039] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:20:05 2022] GET /compute/v2.1/servers/d6d507e4-3a53-4734-bb88-8fc38efa4d9b => generated 111 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:20:05.285459 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-bdadd681-e3bf-48c7-ad3a-224fd9363c8e tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:20:05.298619 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-bdadd681-e3bf-48c7-ad3a-224fd9363c8e tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] [instance: c6e2a8e3-4589-4037-b0d8-032541d043e3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:20:05.319904 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bdadd681-e3bf-48c7-ad3a-224fd9363c8e tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:05.322004 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bdadd681-e3bf-48c7-ad3a-224fd9363c8e tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:05.322463 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bdadd681-e3bf-48c7-ad3a-224fd9363c8e tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:05.323216 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bdadd681-e3bf-48c7-ad3a-224fd9363c8e tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:05.323687 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bdadd681-e3bf-48c7-ad3a-224fd9363c8e tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:05.324128 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bdadd681-e3bf-48c7-ad3a-224fd9363c8e tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:06.733063 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-bdadd681-e3bf-48c7-ad3a-224fd9363c8e tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8920755dc8594da4b57f3ecc920db95d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be25c3ef65114ccc83b335b938743e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:06.754096 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-bdadd681-e3bf-48c7-ad3a-224fd9363c8e tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] 10.222.0.52 "GET /compute/v2.1/servers/c6e2a8e3-4589-4037-b0d8-032541d043e3" status: 200 len: 1542 microversion: 2.1 time: 1.473273 Oct 19 03:20:06.766369 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1046/2040] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:20:05 2022] GET /compute/v2.1/servers/c6e2a8e3-4589-4037-b0d8-032541d043e3 => generated 1542 bytes in 1479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:20:06.771261 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-771707be-ade2-42cb-81c4-e24fbed898ef tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:20:06.775081 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-771707be-ade2-42cb-81c4-e24fbed898ef tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] [instance: 19fbcbe2-9039-4d18-94ef-51ce58cb6365] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:20:06.799457 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-771707be-ade2-42cb-81c4-e24fbed898ef tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:06.800395 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-771707be-ade2-42cb-81c4-e24fbed898ef tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:06.801027 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-771707be-ade2-42cb-81c4-e24fbed898ef tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:06.802345 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-771707be-ade2-42cb-81c4-e24fbed898ef tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:06.803118 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-771707be-ade2-42cb-81c4-e24fbed898ef tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:06.803796 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-771707be-ade2-42cb-81c4-e24fbed898ef tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:07.463247 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-771707be-ade2-42cb-81c4-e24fbed898ef tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4c5e4123c44508a5d4911a17c44231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a495ccfced47f29cb928d1ded20d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:07.482550 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-771707be-ade2-42cb-81c4-e24fbed898ef tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] 10.222.0.52 "GET /compute/v2.1/servers/19fbcbe2-9039-4d18-94ef-51ce58cb6365" status: 200 len: 1464 microversion: 2.1 time: 0.723491 Oct 19 03:20:07.485954 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1047/2041] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:20:06 2022] GET /compute/v2.1/servers/19fbcbe2-9039-4d18-94ef-51ce58cb6365 => generated 1464 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:20:07.506629 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=7 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:20:07.508385 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c1a036c8-c92e-4fd4-9038-5bd3693a2219 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Action: 'create', calling method: .version_select at 0x7fc134f74790>, body: {"keypair": {"name": "tempest-keypair-287929124", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJeODbNpCyVrEFUwUcOjg/t6k7Zrz9KsBRkW5UpZmMBCH+BqZzf0XvXdDEKJ+8vrRy9obUMezXlI8CFYOvOWqqEea31gZZ5pOgm4QmTmrAezJ7P5k9fdouUBYvVt0Jyagw=="}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:20:07.539002 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-c1a036c8-c92e-4fd4-9038-5bd3693a2219 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Getting quotas for project f9e436373e9e45efa03f08b33da619e8. Resources: {'key_pairs'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:20:07.545671 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-c1a036c8-c92e-4fd4-9038-5bd3693a2219 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Getting quotas for user 8824f20e6a1f478a99f90e1ba8f028fe and project f9e436373e9e45efa03f08b33da619e8. Resources: {'key_pairs'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:20:07.644780 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c1a036c8-c92e-4fd4-9038-5bd3693a2219 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.157552 Oct 19 03:20:07.646963 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1048/2042] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Oct 19 03:20:07 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:20:07.654364 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c4d8d3da-39af-409a-bbc9-6a1949e35885 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:20:07.658930 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c4d8d3da-39af-409a-bbc9-6a1949e35885 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] [instance: 6888c8db-82ba-4072-b431-8d4fcf5f03e0] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:20:07.678027 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c4d8d3da-39af-409a-bbc9-6a1949e35885 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:07.679971 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c4d8d3da-39af-409a-bbc9-6a1949e35885 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:07.680607 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c4d8d3da-39af-409a-bbc9-6a1949e35885 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:07.683943 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c4d8d3da-39af-409a-bbc9-6a1949e35885 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:07.684644 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c4d8d3da-39af-409a-bbc9-6a1949e35885 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:07.685361 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c4d8d3da-39af-409a-bbc9-6a1949e35885 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:08.229318 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-a6892b7c-7536-4170-b06d-af408a9e2b02 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] [instance: b97f61ab-18fc-4cf6-bc15-ec08ac4750fd] Updating instance_info_cache with network_info: [{"id": "bcf93ca2-3c93-402b-9421-7ee5460dace0", "address": "fa:16:3e:3c:b7:12", "network": {"id": "6b3013ab-5e3b-4dca-bc82-37c6dc5721e3", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-694479142-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.7.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "0e5d239ae4b24b7e978935fe9b3458cf", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapbcf93ca2-3c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=121134) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 19 03:20:08.241434 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a6892b7c-7536-4170-b06d-af408a9e2b02 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Releasing lock "refresh_cache-b97f61ab-18fc-4cf6-bc15-ec08ac4750fd" {{(pid=121134) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 19 03:20:08.242696 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a6892b7c-7536-4170-b06d-af408a9e2b02 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] 10.222.0.52 "POST /compute/v2.1/servers/b97f61ab-18fc-4cf6-bc15-ec08ac4750fd/action" status: 202 len: 0 microversion: 2.1 time: 10.755335 Oct 19 03:20:08.243540 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 995/2043] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:19:57 2022] POST /compute/v2.1/servers/b97f61ab-18fc-4cf6-bc15-ec08ac4750fd/action => generated 0 bytes in 10757 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 19 03:20:08.479811 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-929a4cc9-29a7-499d-9455-e7570d68a17a tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-1920894097", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:20:08.495615 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c4d8d3da-39af-409a-bbc9-6a1949e35885 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4c5e4123c44508a5d4911a17c44231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a495ccfced47f29cb928d1ded20d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:08.511967 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c4d8d3da-39af-409a-bbc9-6a1949e35885 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] 10.222.0.52 "GET /compute/v2.1/servers/6888c8db-82ba-4072-b431-8d4fcf5f03e0" status: 200 len: 1463 microversion: 2.1 time: 0.863604 Oct 19 03:20:08.515904 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1049/2044] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:20:07 2022] GET /compute/v2.1/servers/6888c8db-82ba-4072-b431-8d4fcf5f03e0 => generated 1463 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:20:08.528081 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7b460a8d-0537-4338-bec8-2afa7854428c tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:20:08.531745 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7b460a8d-0537-4338-bec8-2afa7854428c tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] [instance: c6e2a8e3-4589-4037-b0d8-032541d043e3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:20:08.555647 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7b460a8d-0537-4338-bec8-2afa7854428c tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:08.556372 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7b460a8d-0537-4338-bec8-2afa7854428c tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:08.557455 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7b460a8d-0537-4338-bec8-2afa7854428c tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:08.558502 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7b460a8d-0537-4338-bec8-2afa7854428c tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:08.559131 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7b460a8d-0537-4338-bec8-2afa7854428c tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:08.560298 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7b460a8d-0537-4338-bec8-2afa7854428c tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:08.619637 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-929a4cc9-29a7-499d-9455-e7570d68a17a tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] validate_networks() for [('da8b6b16-8818-4cf4-9bf0-ca13bd9544a1', None, None, None, None, None)] {{(pid=121134) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:20:08.859067 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7b460a8d-0537-4338-bec8-2afa7854428c tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8920755dc8594da4b57f3ecc920db95d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be25c3ef65114ccc83b335b938743e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:08.873613 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7b460a8d-0537-4338-bec8-2afa7854428c tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] 10.222.0.52 "GET /compute/v2.1/servers/c6e2a8e3-4589-4037-b0d8-032541d043e3" status: 200 len: 1500 microversion: 2.1 time: 0.354830 Oct 19 03:20:08.877066 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1050/2045] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:20:08 2022] GET /compute/v2.1/servers/c6e2a8e3-4589-4037-b0d8-032541d043e3 => generated 1500 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:20:08.905281 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-dae640b0-d24f-4c08-a607-c131a72dd61d tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.7.89"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:20:09.271060 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-dae640b0-d24f-4c08-a607-c131a72dd61d tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] [instance: b97f61ab-18fc-4cf6-bc15-ec08ac4750fd] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:20:09.277341 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dae640b0-d24f-4c08-a607-c131a72dd61d tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:09.278340 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dae640b0-d24f-4c08-a607-c131a72dd61d tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:09.279021 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dae640b0-d24f-4c08-a607-c131a72dd61d tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:09.280000 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dae640b0-d24f-4c08-a607-c131a72dd61d tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:09.280690 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dae640b0-d24f-4c08-a607-c131a72dd61d tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:09.281309 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dae640b0-d24f-4c08-a607-c131a72dd61d tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:09.681983 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-dae640b0-d24f-4c08-a607-c131a72dd61d tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] HTTP exception thrown: Floating IP 172.25.7.89 is not associated with instance bcf14e6a-ecdc-40c0-b76b-678a1bb14828. Oct 19 03:20:09.683843 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-dae640b0-d24f-4c08-a607-c131a72dd61d tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Request method failure captured: Oct 19 03:20:09.683843 n-d-861333-8 devstack@n-api.service[121135]: request: POST /compute/v2.1/servers/bcf14e6a-ecdc-40c0-b76b-678a1bb14828/action HTTP/1.1 Oct 19 03:20:09.683843 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:20:09.683843 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:20:09.683843 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:20:09.683843 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 48 Oct 19 03:20:09.683843 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:20:09.683843 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:20:09.683843 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:20:09.683843 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:20:09.683843 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2yU1TiVmMJOqJlwwAmlZEHt8wZDze_VxtD76CDF0CRASzSv6EqHKs-qeX7CTJr89jfwreZvEdY2ZOcsOrxEZ2ZvISug5RObJXrJKifdcx-MBjw_GmiXD_1PDZUclA0I62TyajaKDzJZdah6fGSqyEgjIEtJlX0kwL-pOeCwZsXEoRI Oct 19 03:20:09.683843 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:20:09.683843 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:20:09.683843 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:20:09.683843 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:20:09.683843 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:20:09.683843 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:20:09.683843 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 0e5d239ae4b24b7e978935fe9b3458cf Oct 19 03:20:09.683843 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-140638534 Oct 19 03:20:09.683843 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:20:09.683843 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:20:09.685792 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/0e5d239ae4b24b7e978935fe9b3458cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0e5d239ae4b24b7e978935fe9b3458cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0e5d239ae4b24b7e978935fe9b3458cf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_0e5d239ae4b24b7e978935fe9b3458cf", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:20:09.685792 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-140638534 Oct 19 03:20:09.685792 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 0e5d239ae4b24b7e978935fe9b3458cf Oct 19 03:20:09.685792 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-140638534 Oct 19 03:20:09.685792 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-FloatingIPsAssociationTestJSON-140638534-project Oct 19 03:20:09.685792 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:20:09.685792 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:20:09.685792 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: ac711151c0334c62958e7f2ec431d860 Oct 19 03:20:09.685792 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-140638534-project Oct 19 03:20:09.685792 n-d-861333-8 devstack@n-api.service[121135]: Oct 19 03:20:09.685792 n-d-861333-8 devstack@n-api.service[121135]: {"removeFloatingIp": {"address": "172.25.7.89"}} Oct 19 03:20:09.685792 n-d-861333-8 devstack@n-api.service[121135]: method: Oct 19 03:20:09.685792 n-d-861333-8 devstack@n-api.service[121135]: exception: Floating IP 172.25.7.89 is not associated with instance bcf14e6a-ecdc-40c0-b76b-678a1bb14828. Oct 19 03:20:09.687133 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': 'bcf14e6a-ecdc-40c0-b76b-678a1bb14828', 'body': {'removeFloatingIp': {'address': '172.25.7.89'}}} Oct 19 03:20:09.687133 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:20:09.687133 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:20:09.687133 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:20:09.687133 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:20:09.687133 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:20:09.687133 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:20:09.687133 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 03:20:09.687133 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 03:20:09.687133 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:20:09.687133 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:20:09.687133 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:20:09.687133 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:20:09.687133 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Oct 19 03:20:09.687133 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 19 03:20:09.687133 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.7.89 is not associated with instance bcf14e6a-ecdc-40c0-b76b-678a1bb14828. Oct 19 03:20:09.687133 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:20:09.687133 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:20:09.687133 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:20:09.687133 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:20:09.688828 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:20:09.688828 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:20:09.688828 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:20:09.688828 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:20:09.688828 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.7.89 is not associated with instance bcf14e6a-ecdc-40c0-b76b-678a1bb14828. Oct 19 03:20:09.688828 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:20:09.688828 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-dae640b0-d24f-4c08-a607-c131a72dd61d tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Returning 409 to user: Floating IP 172.25.7.89 is not associated with instance bcf14e6a-ecdc-40c0-b76b-678a1bb14828. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:20:09.688828 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-dae640b0-d24f-4c08-a607-c131a72dd61d tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] 10.222.0.52 "POST /compute/v2.1/servers/bcf14e6a-ecdc-40c0-b76b-678a1bb14828/action" status: 409 len: 145 microversion: 2.1 time: 0.806284 Oct 19 03:20:09.688828 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1051/2046] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:20:08 2022] POST /compute/v2.1/servers/bcf14e6a-ecdc-40c0-b76b-678a1bb14828/action => generated 145 bytes in 808 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 19 03:20:09.695268 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-96b96af5-4e4c-48e2-9d0e-07e729c1ae1a req-a8558890-2c69-4adb-b326-c90c720591f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6e2a8e3-4589-4037-b0d8-032541d043e3", "name": "network-vif-deleted", "tag": "b8014d15-27b1-4267-af57-17ae32c38543"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:20:09.710061 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-96b96af5-4e4c-48e2-9d0e-07e729c1ae1a req-a8558890-2c69-4adb-b326-c90c720591f0 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:09.711010 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-96b96af5-4e4c-48e2-9d0e-07e729c1ae1a req-a8558890-2c69-4adb-b326-c90c720591f0 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:09.711877 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-96b96af5-4e4c-48e2-9d0e-07e729c1ae1a req-a8558890-2c69-4adb-b326-c90c720591f0 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:09.716867 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:20:09.725701 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-96b96af5-4e4c-48e2-9d0e-07e729c1ae1a req-a8558890-2c69-4adb-b326-c90c720591f0 service nova] Creating event network-vif-deleted:b8014d15-27b1-4267-af57-17ae32c38543 for instance c6e2a8e3-4589-4037-b0d8-032541d043e3 on n-h1-861333-8 Oct 19 03:20:09.737098 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-929a4cc9-29a7-499d-9455-e7570d68a17a tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Flavor limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:20:09.737699 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-929a4cc9-29a7-499d-9455-e7570d68a17a tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Image limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:20:09.738036 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-929a4cc9-29a7-499d-9455-e7570d68a17a tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Flavor pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:20:09.738454 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-929a4cc9-29a7-499d-9455-e7570d68a17a tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Image pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:20:09.738910 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-929a4cc9-29a7-499d-9455-e7570d68a17a tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:20:09.743308 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-96b96af5-4e4c-48e2-9d0e-07e729c1ae1a req-a8558890-2c69-4adb-b326-c90c720591f0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055993 Oct 19 03:20:09.744210 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1052/2047] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:20:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:20:09.753680 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-929a4cc9-29a7-499d-9455-e7570d68a17a tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:09.753680 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-929a4cc9-29a7-499d-9455-e7570d68a17a tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:09.756539 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-929a4cc9-29a7-499d-9455-e7570d68a17a tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:09.757567 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-929a4cc9-29a7-499d-9455-e7570d68a17a tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:09.763017 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-929a4cc9-29a7-499d-9455-e7570d68a17a tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:09.764927 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-929a4cc9-29a7-499d-9455-e7570d68a17a tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:09.783579 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ed09d683-5b3c-4755-b25f-4cead1888bdb tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-210787412", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "6888c8db-82ba-4072-b431-8d4fcf5f03e0"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:20:09.805294 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-929a4cc9-29a7-499d-9455-e7570d68a17a tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Getting quotas for project 1606da859950484e9aa949e5c59c0a65. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:20:09.813884 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-929a4cc9-29a7-499d-9455-e7570d68a17a tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Getting quotas for user 152fa52a83b14c71bf86b22d77a73625 and project 1606da859950484e9aa949e5c59c0a65. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:20:09.829403 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-929a4cc9-29a7-499d-9455-e7570d68a17a tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Going to run 1 instances... {{(pid=121134) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:20:09.834884 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-929a4cc9-29a7-499d-9455-e7570d68a17a tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] [instance: fee1d282-ae3a-4792-ba8f-a19e498c8853] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:20:09.845063 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.network.neutron [None req-ed09d683-5b3c-4755-b25f-4cead1888bdb tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] validate_networks() for None {{(pid=121135) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:20:09.990974 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-929a4cc9-29a7-499d-9455-e7570d68a17a tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.745554 Oct 19 03:20:09.998781 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 996/2048] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:20:08 2022] POST /compute/v2.1/servers => generated 383 bytes in 1754 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 03:20:10.004085 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-bd8ebedc-c5fe-42cc-8434-3a33e9c41b33 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Action: 'create', calling method: .version_select at 0x7fc135137af0>, body: {"keypair": {"name": "tempest-keypair-1702125918", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCly377JmvVNiWHMCP/6JCC/lZ9iKHaEGHCBr/mOjftbVqid5HHV+gDdZiu0840Jo083wN6cPEfTu1YZNinQWcbctGi24X6isxh4kTwqZfcxAYgVY/m/mxcp9q1lbJ/pGQ=="}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:20:10.021817 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-bd8ebedc-c5fe-42cc-8434-3a33e9c41b33 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Getting quotas for project b8bf3e0ec0b34e2bb80b1d09877c3fd0. Resources: {'key_pairs'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:20:10.027616 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-bd8ebedc-c5fe-42cc-8434-3a33e9c41b33 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Getting quotas for user ca9e45a223244d29976d3bcf6f06a1d2 and project b8bf3e0ec0b34e2bb80b1d09877c3fd0. Resources: {'key_pairs'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:20:10.230808 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-bd8ebedc-c5fe-42cc-8434-3a33e9c41b33 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.230631 Oct 19 03:20:10.231609 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 997/2049] 10.222.0.52 () {62 vars in 1200 bytes} [Wed Oct 19 03:20:09 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 232 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 19 03:20:10.238000 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b75e6c18-00c1-428e-85de-a6038c84d5ff tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.7.89"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:20:10.532132 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-ed09d683-5b3c-4755-b25f-4cead1888bdb tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Flavor limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:20:10.532572 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-ed09d683-5b3c-4755-b25f-4cead1888bdb tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Image limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:20:10.533049 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-ed09d683-5b3c-4755-b25f-4cead1888bdb tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Flavor pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:20:10.533491 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-ed09d683-5b3c-4755-b25f-4cead1888bdb tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Image pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:20:10.534258 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-ed09d683-5b3c-4755-b25f-4cead1888bdb tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:20:10.543974 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ed09d683-5b3c-4755-b25f-4cead1888bdb tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:10.544830 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ed09d683-5b3c-4755-b25f-4cead1888bdb tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:10.545333 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ed09d683-5b3c-4755-b25f-4cead1888bdb tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:10.546120 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ed09d683-5b3c-4755-b25f-4cead1888bdb tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:10.546588 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ed09d683-5b3c-4755-b25f-4cead1888bdb tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:10.547029 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ed09d683-5b3c-4755-b25f-4cead1888bdb tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:10.574951 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-ed09d683-5b3c-4755-b25f-4cead1888bdb tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Getting quotas for project c9a495ccfced47f29cb928d1ded20d85. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:20:10.580898 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-ed09d683-5b3c-4755-b25f-4cead1888bdb tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Getting quotas for user ce4c5e4123c44508a5d4911a17c44231 and project c9a495ccfced47f29cb928d1ded20d85. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:20:10.600818 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ed09d683-5b3c-4755-b25f-4cead1888bdb tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Going to run 1 instances... {{(pid=121135) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:20:10.603623 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ed09d683-5b3c-4755-b25f-4cead1888bdb tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] [instance: b1acb084-c2bd-49b1-b38a-5e7630389abd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121135) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:20:10.697356 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b75e6c18-00c1-428e-85de-a6038c84d5ff tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] [instance: b97f61ab-18fc-4cf6-bc15-ec08ac4750fd] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:20:10.709999 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b75e6c18-00c1-428e-85de-a6038c84d5ff tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:10.709999 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b75e6c18-00c1-428e-85de-a6038c84d5ff tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:10.709999 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b75e6c18-00c1-428e-85de-a6038c84d5ff tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:10.709999 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b75e6c18-00c1-428e-85de-a6038c84d5ff tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:10.710517 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b75e6c18-00c1-428e-85de-a6038c84d5ff tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:10.710517 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b75e6c18-00c1-428e-85de-a6038c84d5ff tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:10.857028 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ed09d683-5b3c-4755-b25f-4cead1888bdb tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.108816 Oct 19 03:20:10.868540 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1053/2050] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:20:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1123 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 03:20:10.873937 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-cc6f6247-0d34-4238-b79c-eafae92be8df tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:20:10.874821 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-cc6f6247-0d34-4238-b79c-eafae92be8df tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] [instance: c6e2a8e3-4589-4037-b0d8-032541d043e3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:20:10.886980 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cc6f6247-0d34-4238-b79c-eafae92be8df tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:10.887725 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cc6f6247-0d34-4238-b79c-eafae92be8df tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:10.888347 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cc6f6247-0d34-4238-b79c-eafae92be8df tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:10.889629 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cc6f6247-0d34-4238-b79c-eafae92be8df tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:10.890573 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cc6f6247-0d34-4238-b79c-eafae92be8df tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:10.891182 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cc6f6247-0d34-4238-b79c-eafae92be8df tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:10.916639 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-cc6f6247-0d34-4238-b79c-eafae92be8df tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] HTTP exception thrown: Instance c6e2a8e3-4589-4037-b0d8-032541d043e3 could not be found. Oct 19 03:20:10.918865 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-cc6f6247-0d34-4238-b79c-eafae92be8df tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Request method failure captured: Oct 19 03:20:10.918865 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/c6e2a8e3-4589-4037-b0d8-032541d043e3 HTTP/1.1 Oct 19 03:20:10.918865 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:20:10.918865 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:20:10.918865 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:20:10.918865 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:20:10.918865 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:20:10.918865 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:20:10.918865 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:20:10.918865 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:20:10.918865 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2yqaPaGcq-c15urVLpzfs3V-94tJdAtgMccdDwNmTmV7vHTHa8WU0sLqvoI7rKWiP2_3WB8q0vcFNFjKDpYt1dXYsgfK3sYsFptkNYuLZNDPlJITSYq6jhHbNPpGkFAhjLQbIvGlt-oy7vmVBShPfosqaJSH2-YWR_EWj-vYwvb_qk Oct 19 03:20:10.918865 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:20:10.918865 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:20:10.918865 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:20:10.918865 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:20:10.918865 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:20:10.918865 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:20:10.918865 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: be25c3ef65114ccc83b335b938743e90 Oct 19 03:20:10.918865 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 Oct 19 03:20:10.918865 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:20:10.918865 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:20:10.920425 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/be25c3ef65114ccc83b335b938743e90"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/be25c3ef65114ccc83b335b938743e90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/be25c3ef65114ccc83b335b938743e90"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_be25c3ef65114ccc83b335b938743e90", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:20:10.920425 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 Oct 19 03:20:10.920425 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: be25c3ef65114ccc83b335b938743e90 Oct 19 03:20:10.920425 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 Oct 19 03:20:10.920425 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project Oct 19 03:20:10.920425 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:20:10.920425 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:20:10.920425 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 8920755dc8594da4b57f3ecc920db95d Oct 19 03:20:10.920425 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project Oct 19 03:20:10.920425 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:20:10.920425 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance c6e2a8e3-4589-4037-b0d8-032541d043e3 could not be found. Oct 19 03:20:10.921192 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': 'c6e2a8e3-4589-4037-b0d8-032541d043e3'} Oct 19 03:20:10.921192 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:20:10.921192 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:20:10.921192 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:20:10.921192 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:20:10.921192 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:20:10.921192 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:20:10.921192 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:20:10.921192 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:20:10.921192 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:20:10.921192 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:20:10.921192 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6e2a8e3-4589-4037-b0d8-032541d043e3 could not be found. Oct 19 03:20:10.921192 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:20:10.921192 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:20:10.921192 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:20:10.921192 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:20:10.921192 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:20:10.921192 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:20:10.921192 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:20:10.921192 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:20:10.922760 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:20:10.922760 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:20:10.922760 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:20:10.922760 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:20:10.922760 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:20:10.922760 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:20:10.922760 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:20:10.922760 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:20:10.922760 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6e2a8e3-4589-4037-b0d8-032541d043e3 could not be found. Oct 19 03:20:10.922760 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:20:10.922760 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:20:10.922760 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:20:10.922760 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:20:10.922760 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:20:10.922760 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:20:10.922760 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:20:10.922760 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:20:10.922760 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6e2a8e3-4589-4037-b0d8-032541d043e3 could not be found. Oct 19 03:20:10.922760 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:20:10.925978 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-cc6f6247-0d34-4238-b79c-eafae92be8df tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] Returning 404 to user: Instance c6e2a8e3-4589-4037-b0d8-032541d043e3 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:20:10.928595 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-cc6f6247-0d34-4238-b79c-eafae92be8df tempest-FloatingIPsAssociationNegativeTestJSON-1091143353 tempest-FloatingIPsAssociationNegativeTestJSON-1091143353-project] 10.222.0.52 "GET /compute/v2.1/servers/c6e2a8e3-4589-4037-b0d8-032541d043e3" status: 404 len: 111 microversion: 2.1 time: 0.058746 Oct 19 03:20:10.929735 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1054/2051] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:20:10 2022] GET /compute/v2.1/servers/c6e2a8e3-4589-4037-b0d8-032541d043e3 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:20:10.935682 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7a779c75-f0eb-4f83-bb00-fcf3ccc543da tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:20:10.936306 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7a779c75-f0eb-4f83-bb00-fcf3ccc543da tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] [instance: fee1d282-ae3a-4792-ba8f-a19e498c8853] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:20:11.170121 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b75e6c18-00c1-428e-85de-a6038c84d5ff tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Acquiring lock "refresh_cache-b97f61ab-18fc-4cf6-bc15-ec08ac4750fd" {{(pid=121134) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 19 03:20:11.171194 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b75e6c18-00c1-428e-85de-a6038c84d5ff tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Acquired lock "refresh_cache-b97f61ab-18fc-4cf6-bc15-ec08ac4750fd" {{(pid=121134) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 19 03:20:11.289945 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7a779c75-f0eb-4f83-bb00-fcf3ccc543da tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '152fa52a83b14c71bf86b22d77a73625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1606da859950484e9aa949e5c59c0a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:11.307036 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7a779c75-f0eb-4f83-bb00-fcf3ccc543da tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] 10.222.0.52 "GET /compute/v2.1/servers/fee1d282-ae3a-4792-ba8f-a19e498c8853" status: 200 len: 1223 microversion: 2.1 time: 0.375708 Oct 19 03:20:11.308569 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1055/2052] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:20:10 2022] GET /compute/v2.1/servers/fee1d282-ae3a-4792-ba8f-a19e498c8853 => generated 1223 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:20:11.314446 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a66ffea5-8527-43f2-a0c3-520fd4415707 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:20:11.315584 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a66ffea5-8527-43f2-a0c3-520fd4415707 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] [instance: b1acb084-c2bd-49b1-b38a-5e7630389abd] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:20:11.323045 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:20:11.537679 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a66ffea5-8527-43f2-a0c3-520fd4415707 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4c5e4123c44508a5d4911a17c44231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a495ccfced47f29cb928d1ded20d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:11.548976 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a66ffea5-8527-43f2-a0c3-520fd4415707 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] 10.222.0.52 "GET /compute/v2.1/servers/b1acb084-c2bd-49b1-b38a-5e7630389abd" status: 200 len: 1213 microversion: 2.1 time: 0.238906 Oct 19 03:20:11.565540 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1056/2053] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:20:11 2022] GET /compute/v2.1/servers/b1acb084-c2bd-49b1-b38a-5e7630389abd => generated 1213 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:20:12.331704 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b5c4a870-8caa-41e6-bb40-0cf6577fc211 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:20:12.333262 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b5c4a870-8caa-41e6-bb40-0cf6577fc211 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] [instance: fee1d282-ae3a-4792-ba8f-a19e498c8853] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:20:12.344358 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b5c4a870-8caa-41e6-bb40-0cf6577fc211 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:12.346078 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b5c4a870-8caa-41e6-bb40-0cf6577fc211 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:12.347623 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b5c4a870-8caa-41e6-bb40-0cf6577fc211 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:12.350478 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b5c4a870-8caa-41e6-bb40-0cf6577fc211 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:12.351168 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b5c4a870-8caa-41e6-bb40-0cf6577fc211 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:12.352364 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b5c4a870-8caa-41e6-bb40-0cf6577fc211 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:12.669880 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b5c4a870-8caa-41e6-bb40-0cf6577fc211 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '152fa52a83b14c71bf86b22d77a73625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1606da859950484e9aa949e5c59c0a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:12.688005 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b5c4a870-8caa-41e6-bb40-0cf6577fc211 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] 10.222.0.52 "GET /compute/v2.1/servers/fee1d282-ae3a-4792-ba8f-a19e498c8853" status: 200 len: 1227 microversion: 2.1 time: 0.360102 Oct 19 03:20:12.691621 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1057/2054] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:20:12 2022] GET /compute/v2.1/servers/fee1d282-ae3a-4792-ba8f-a19e498c8853 => generated 1227 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:20:12.705071 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-57433a37-c442-4de4-904d-2d1497016bcd tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:20:12.705761 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-57433a37-c442-4de4-904d-2d1497016bcd tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] [instance: b1acb084-c2bd-49b1-b38a-5e7630389abd] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:20:12.726933 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-57433a37-c442-4de4-904d-2d1497016bcd tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:12.728562 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-57433a37-c442-4de4-904d-2d1497016bcd tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:12.729030 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-57433a37-c442-4de4-904d-2d1497016bcd tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:12.731265 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-57433a37-c442-4de4-904d-2d1497016bcd tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:12.732063 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-57433a37-c442-4de4-904d-2d1497016bcd tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:12.732553 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-57433a37-c442-4de4-904d-2d1497016bcd tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:12.886128 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-57433a37-c442-4de4-904d-2d1497016bcd tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4c5e4123c44508a5d4911a17c44231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a495ccfced47f29cb928d1ded20d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:12.905914 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-57433a37-c442-4de4-904d-2d1497016bcd tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] 10.222.0.52 "GET /compute/v2.1/servers/b1acb084-c2bd-49b1-b38a-5e7630389abd" status: 200 len: 1217 microversion: 2.1 time: 0.213139 Oct 19 03:20:12.906508 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1058/2055] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:20:12 2022] GET /compute/v2.1/servers/b1acb084-c2bd-49b1-b38a-5e7630389abd => generated 1217 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:20:13.515703 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-b75e6c18-00c1-428e-85de-a6038c84d5ff tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] [instance: b97f61ab-18fc-4cf6-bc15-ec08ac4750fd] Building network info cache for instance {{(pid=121134) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 19 03:20:13.527842 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-624d23a9-2bf3-49ae-971e-6886deb5ccb0 req-eba9a00c-f67c-49ac-8f1b-7bfbd6586c72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b97f61ab-18fc-4cf6-bc15-ec08ac4750fd", "tag": "bcf93ca2-3c93-402b-9421-7ee5460dace0"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:20:13.556653 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-624d23a9-2bf3-49ae-971e-6886deb5ccb0 req-eba9a00c-f67c-49ac-8f1b-7bfbd6586c72 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:13.558108 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-624d23a9-2bf3-49ae-971e-6886deb5ccb0 req-eba9a00c-f67c-49ac-8f1b-7bfbd6586c72 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:13.559476 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-624d23a9-2bf3-49ae-971e-6886deb5ccb0 req-eba9a00c-f67c-49ac-8f1b-7bfbd6586c72 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:13.596437 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-624d23a9-2bf3-49ae-971e-6886deb5ccb0 req-eba9a00c-f67c-49ac-8f1b-7bfbd6586c72 service nova] Creating event network-changed:bcf93ca2-3c93-402b-9421-7ee5460dace0 for instance b97f61ab-18fc-4cf6-bc15-ec08ac4750fd on n-h1-861333-8 Oct 19 03:20:13.608802 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-624d23a9-2bf3-49ae-971e-6886deb5ccb0 req-eba9a00c-f67c-49ac-8f1b-7bfbd6586c72 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086544 Oct 19 03:20:13.613463 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1059/2056] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:20:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:20:13.714236 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9d5931f3-77c3-42eb-aae3-7e0a9765d054 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:20:13.715340 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9d5931f3-77c3-42eb-aae3-7e0a9765d054 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] [instance: fee1d282-ae3a-4792-ba8f-a19e498c8853] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:20:13.729800 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9d5931f3-77c3-42eb-aae3-7e0a9765d054 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:13.730715 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9d5931f3-77c3-42eb-aae3-7e0a9765d054 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:13.733549 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9d5931f3-77c3-42eb-aae3-7e0a9765d054 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:13.737546 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9d5931f3-77c3-42eb-aae3-7e0a9765d054 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:13.739522 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9d5931f3-77c3-42eb-aae3-7e0a9765d054 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:13.741606 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9d5931f3-77c3-42eb-aae3-7e0a9765d054 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:13.928794 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-9d5931f3-77c3-42eb-aae3-7e0a9765d054 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '152fa52a83b14c71bf86b22d77a73625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1606da859950484e9aa949e5c59c0a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:13.965699 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9d5931f3-77c3-42eb-aae3-7e0a9765d054 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] 10.222.0.52 "GET /compute/v2.1/servers/fee1d282-ae3a-4792-ba8f-a19e498c8853" status: 200 len: 1275 microversion: 2.1 time: 0.256346 Oct 19 03:20:13.969964 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1060/2057] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:20:13 2022] GET /compute/v2.1/servers/fee1d282-ae3a-4792-ba8f-a19e498c8853 => generated 1275 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:20:13.978025 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5aa46da2-1163-47d0-a783-c709664b8c86 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:20:13.982988 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-5aa46da2-1163-47d0-a783-c709664b8c86 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] [instance: b1acb084-c2bd-49b1-b38a-5e7630389abd] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:20:13.994303 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5aa46da2-1163-47d0-a783-c709664b8c86 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:13.995093 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5aa46da2-1163-47d0-a783-c709664b8c86 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:14.002438 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5aa46da2-1163-47d0-a783-c709664b8c86 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:14.006604 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5aa46da2-1163-47d0-a783-c709664b8c86 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:14.011129 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5aa46da2-1163-47d0-a783-c709664b8c86 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:14.012737 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5aa46da2-1163-47d0-a783-c709664b8c86 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:14.240846 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-5aa46da2-1163-47d0-a783-c709664b8c86 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4c5e4123c44508a5d4911a17c44231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a495ccfced47f29cb928d1ded20d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:14.251076 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5aa46da2-1163-47d0-a783-c709664b8c86 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] 10.222.0.52 "GET /compute/v2.1/servers/b1acb084-c2bd-49b1-b38a-5e7630389abd" status: 200 len: 1265 microversion: 2.1 time: 0.279632 Oct 19 03:20:14.255584 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1061/2058] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:20:13 2022] GET /compute/v2.1/servers/b1acb084-c2bd-49b1-b38a-5e7630389abd => generated 1265 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:20:14.337738 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-53c1fcad-34da-4c08-8e58-62bf7fd8ece0 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-201646653", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:20:14.459361 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.network.neutron [None req-53c1fcad-34da-4c08-8e58-62bf7fd8ece0 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] validate_networks() for [('2f96d8a2-32f5-44b2-88f4-374c3b78e3c5', None, None, None, None, None)] {{(pid=121135) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:20:15.619004 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-b75e6c18-00c1-428e-85de-a6038c84d5ff tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] [instance: b97f61ab-18fc-4cf6-bc15-ec08ac4750fd] Updating instance_info_cache with network_info: [{"id": "bcf93ca2-3c93-402b-9421-7ee5460dace0", "address": "fa:16:3e:3c:b7:12", "network": {"id": "6b3013ab-5e3b-4dca-bc82-37c6dc5721e3", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-694479142-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "0e5d239ae4b24b7e978935fe9b3458cf", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapbcf93ca2-3c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=121134) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 19 03:20:15.621418 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=65,nova_cell1:SAVEPOINT=3,nova_cell1:UPDATE=2,nova_cell1:RELEASE=3 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:20:15.823955 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b75e6c18-00c1-428e-85de-a6038c84d5ff tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Releasing lock "refresh_cache-b97f61ab-18fc-4cf6-bc15-ec08ac4750fd" {{(pid=121134) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 19 03:20:15.823955 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b75e6c18-00c1-428e-85de-a6038c84d5ff tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] 10.222.0.52 "POST /compute/v2.1/servers/b97f61ab-18fc-4cf6-bc15-ec08ac4750fd/action" status: 202 len: 0 microversion: 2.1 time: 5.587451 Oct 19 03:20:15.823955 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 998/2059] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:20:10 2022] POST /compute/v2.1/servers/b97f61ab-18fc-4cf6-bc15-ec08ac4750fd/action => generated 0 bytes in 5588 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 19 03:20:15.827545 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4800318f-f04c-4d5a-b8bc-e6f01ec6252e tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:20:15.828146 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4800318f-f04c-4d5a-b8bc-e6f01ec6252e tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] [instance: fee1d282-ae3a-4792-ba8f-a19e498c8853] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:20:15.835012 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4800318f-f04c-4d5a-b8bc-e6f01ec6252e tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:15.835748 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4800318f-f04c-4d5a-b8bc-e6f01ec6252e tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:15.836396 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4800318f-f04c-4d5a-b8bc-e6f01ec6252e tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:15.837287 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4800318f-f04c-4d5a-b8bc-e6f01ec6252e tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:15.837935 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4800318f-f04c-4d5a-b8bc-e6f01ec6252e tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:15.838562 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4800318f-f04c-4d5a-b8bc-e6f01ec6252e tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:15.977978 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-4800318f-f04c-4d5a-b8bc-e6f01ec6252e tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '152fa52a83b14c71bf86b22d77a73625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1606da859950484e9aa949e5c59c0a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:15.986132 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4800318f-f04c-4d5a-b8bc-e6f01ec6252e tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] 10.222.0.52 "GET /compute/v2.1/servers/fee1d282-ae3a-4792-ba8f-a19e498c8853" status: 200 len: 1293 microversion: 2.1 time: 0.164298 Oct 19 03:20:15.986722 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 999/2060] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:20:15 2022] GET /compute/v2.1/servers/fee1d282-ae3a-4792-ba8f-a19e498c8853 => generated 1293 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:20:15.991454 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f15f9e5d-4dfc-44f9-9890-cc01558f46cd tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:20:15.992980 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f15f9e5d-4dfc-44f9-9890-cc01558f46cd tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] [instance: b1acb084-c2bd-49b1-b38a-5e7630389abd] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:20:16.000726 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f15f9e5d-4dfc-44f9-9890-cc01558f46cd tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:16.001647 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f15f9e5d-4dfc-44f9-9890-cc01558f46cd tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:16.002420 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f15f9e5d-4dfc-44f9-9890-cc01558f46cd tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:16.003420 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f15f9e5d-4dfc-44f9-9890-cc01558f46cd tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:16.004094 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f15f9e5d-4dfc-44f9-9890-cc01558f46cd tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:16.005093 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f15f9e5d-4dfc-44f9-9890-cc01558f46cd tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:16.045155 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-53c1fcad-34da-4c08-8e58-62bf7fd8ece0 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Flavor limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:20:16.046163 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-53c1fcad-34da-4c08-8e58-62bf7fd8ece0 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Image limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:20:16.046882 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-53c1fcad-34da-4c08-8e58-62bf7fd8ece0 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Flavor pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:20:16.047486 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-53c1fcad-34da-4c08-8e58-62bf7fd8ece0 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Image pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:20:16.048145 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-53c1fcad-34da-4c08-8e58-62bf7fd8ece0 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:20:16.060750 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-53c1fcad-34da-4c08-8e58-62bf7fd8ece0 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:16.064910 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-53c1fcad-34da-4c08-8e58-62bf7fd8ece0 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:16.065645 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-53c1fcad-34da-4c08-8e58-62bf7fd8ece0 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:16.066621 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-53c1fcad-34da-4c08-8e58-62bf7fd8ece0 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:16.067922 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-53c1fcad-34da-4c08-8e58-62bf7fd8ece0 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:16.068535 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-53c1fcad-34da-4c08-8e58-62bf7fd8ece0 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:16.098431 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-f15f9e5d-4dfc-44f9-9890-cc01558f46cd tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4c5e4123c44508a5d4911a17c44231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a495ccfced47f29cb928d1ded20d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:16.109665 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-53c1fcad-34da-4c08-8e58-62bf7fd8ece0 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Getting quotas for project f9e436373e9e45efa03f08b33da619e8. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:20:16.109876 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f15f9e5d-4dfc-44f9-9890-cc01558f46cd tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] 10.222.0.52 "GET /compute/v2.1/servers/b1acb084-c2bd-49b1-b38a-5e7630389abd" status: 200 len: 1271 microversion: 2.1 time: 0.121268 Oct 19 03:20:16.109985 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-53c1fcad-34da-4c08-8e58-62bf7fd8ece0 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Getting quotas for user 8824f20e6a1f478a99f90e1ba8f028fe and project f9e436373e9e45efa03f08b33da619e8. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:20:16.111111 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1000/2061] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:20:15 2022] GET /compute/v2.1/servers/b1acb084-c2bd-49b1-b38a-5e7630389abd => generated 1271 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:20:16.134934 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-32e991c4-33b7-4ca5-a163-a9d46b7c1bc2 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:20:16.137037 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-32e991c4-33b7-4ca5-a163-a9d46b7c1bc2 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] [instance: b97f61ab-18fc-4cf6-bc15-ec08ac4750fd] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:20:16.149438 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-32e991c4-33b7-4ca5-a163-a9d46b7c1bc2 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:16.150331 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-53c1fcad-34da-4c08-8e58-62bf7fd8ece0 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Going to run 1 instances... {{(pid=121135) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:20:16.152040 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-32e991c4-33b7-4ca5-a163-a9d46b7c1bc2 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:16.153143 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-53c1fcad-34da-4c08-8e58-62bf7fd8ece0 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] [instance: 245ae0c1-c202-41c0-8f85-d5d99549f3ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121135) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:20:16.153868 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-32e991c4-33b7-4ca5-a163-a9d46b7c1bc2 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:16.155863 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-32e991c4-33b7-4ca5-a163-a9d46b7c1bc2 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:16.158333 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-32e991c4-33b7-4ca5-a163-a9d46b7c1bc2 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:16.158884 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-32e991c4-33b7-4ca5-a163-a9d46b7c1bc2 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:16.234574 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-32e991c4-33b7-4ca5-a163-a9d46b7c1bc2 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] [instance: b97f61ab-18fc-4cf6-bc15-ec08ac4750fd] Going to try to terminate instance {{(pid=121134) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:20:16.397059 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-53c1fcad-34da-4c08-8e58-62bf7fd8ece0 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.063713 Oct 19 03:20:16.398643 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1062/2062] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:20:14 2022] POST /compute/v2.1/servers => generated 383 bytes in 2066 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 03:20:16.406729 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e120adfd-6b20-4bd8-8546-2e0b08ae216b tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-896174806", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "265ac5c4-32db-4379-9c17-1f0cf4b13988"}, {"port": "bad825e5-2050-4f8e-b26b-6ce95f019585", "tag": "port-1"}, {"port": "79d980c0-7663-46a5-9ee8-792d242f6019", "tag": "port-2"}, {"uuid": "cd5f062f-32ef-4a3e-8baf-01ad39c60009", "tag": "net-1"}, {"uuid": "cd5f062f-32ef-4a3e-8baf-01ad39c60009"}, {"uuid": "3db7c942-fb75-4e01-bf9a-5192a75afd50", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "3db7c942-fb75-4e01-bf9a-5192a75afd50", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "28ce37d8-cc78-415a-b4de-32ec791a7b5e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "fbb675f3-fed6-43de-a395-1dd47c8ae57e", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "46ee699c-dd0e-40d5-acac-0bf103d364b0", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--310594775"}], "key_name": "tempest-keypair-1702125918", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:20:16.576568 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.network.neutron [None req-e120adfd-6b20-4bd8-8546-2e0b08ae216b tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] validate_networks() for [('265ac5c4-32db-4379-9c17-1f0cf4b13988', None, None, None, None, None), (None, None, 'bad825e5-2050-4f8e-b26b-6ce95f019585', None, None, None), (None, None, '79d980c0-7663-46a5-9ee8-792d242f6019', None, None, None), ('cd5f062f-32ef-4a3e-8baf-01ad39c60009', None, None, None, None, None), ('cd5f062f-32ef-4a3e-8baf-01ad39c60009', None, None, None, None, None), ('3db7c942-fb75-4e01-bf9a-5192a75afd50', '10.2.2.100', None, None, None, None), ('3db7c942-fb75-4e01-bf9a-5192a75afd50', '10.2.2.200', None, None, None, None)] {{(pid=121135) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:20:16.745424 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-32e991c4-33b7-4ca5-a163-a9d46b7c1bc2 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] 10.222.0.52 "DELETE /compute/v2.1/servers/b97f61ab-18fc-4cf6-bc15-ec08ac4750fd" status: 204 len: 0 microversion: 2.1 time: 0.626974 Oct 19 03:20:16.747065 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1001/2063] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:20:16 2022] DELETE /compute/v2.1/servers/b97f61ab-18fc-4cf6-bc15-ec08ac4750fd => generated 0 bytes in 635 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:20:16.752941 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-833dc52c-51ab-40e3-880b-963d9498bf5b tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:20:16.753986 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-833dc52c-51ab-40e3-880b-963d9498bf5b tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] [instance: 245ae0c1-c202-41c0-8f85-d5d99549f3ae] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:20:16.977279 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-833dc52c-51ab-40e3-880b-963d9498bf5b tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8824f20e6a1f478a99f90e1ba8f028fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e436373e9e45efa03f08b33da619e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:16.987235 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-833dc52c-51ab-40e3-880b-963d9498bf5b tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] 10.222.0.52 "GET /compute/v2.1/servers/245ae0c1-c202-41c0-8f85-d5d99549f3ae" status: 200 len: 1224 microversion: 2.1 time: 0.238669 Oct 19 03:20:16.989123 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1002/2064] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:20:16 2022] GET /compute/v2.1/servers/245ae0c1-c202-41c0-8f85-d5d99549f3ae => generated 1224 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:20:16.994929 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3f0d5654-8367-4e81-9028-1877bcec8220 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.7.89"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:20:16.998122 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3f0d5654-8367-4e81-9028-1877bcec8220 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] [instance: bcf14e6a-ecdc-40c0-b76b-678a1bb14828] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:20:17.005255 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3f0d5654-8367-4e81-9028-1877bcec8220 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:17.006441 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3f0d5654-8367-4e81-9028-1877bcec8220 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:17.006985 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3f0d5654-8367-4e81-9028-1877bcec8220 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:17.007934 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3f0d5654-8367-4e81-9028-1877bcec8220 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:17.008496 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3f0d5654-8367-4e81-9028-1877bcec8220 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:17.009065 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3f0d5654-8367-4e81-9028-1877bcec8220 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:17.037809 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3f0d5654-8367-4e81-9028-1877bcec8220 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Acquiring lock "refresh_cache-bcf14e6a-ecdc-40c0-b76b-678a1bb14828" {{(pid=121134) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 19 03:20:17.038607 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3f0d5654-8367-4e81-9028-1877bcec8220 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Acquired lock "refresh_cache-bcf14e6a-ecdc-40c0-b76b-678a1bb14828" {{(pid=121134) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 19 03:20:19.797009 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:20:20.989001 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-3f0d5654-8367-4e81-9028-1877bcec8220 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] [instance: bcf14e6a-ecdc-40c0-b76b-678a1bb14828] Building network info cache for instance {{(pid=121134) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 19 03:20:22.850206 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-3f0d5654-8367-4e81-9028-1877bcec8220 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] [instance: bcf14e6a-ecdc-40c0-b76b-678a1bb14828] Updating instance_info_cache with network_info: [{"id": "2e33b971-5f4b-4979-8038-bf99f7338ba3", "address": "fa:16:3e:02:c8:80", "network": {"id": "6b3013ab-5e3b-4dca-bc82-37c6dc5721e3", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-694479142-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.7.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "0e5d239ae4b24b7e978935fe9b3458cf", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap2e33b971-5f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=121134) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 19 03:20:23.006823 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3f0d5654-8367-4e81-9028-1877bcec8220 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Releasing lock "refresh_cache-bcf14e6a-ecdc-40c0-b76b-678a1bb14828" {{(pid=121134) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 19 03:20:23.006823 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3f0d5654-8367-4e81-9028-1877bcec8220 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] 10.222.0.52 "POST /compute/v2.1/servers/bcf14e6a-ecdc-40c0-b76b-678a1bb14828/action" status: 202 len: 0 microversion: 2.1 time: 6.014170 Oct 19 03:20:23.006823 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1003/2065] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:20:16 2022] POST /compute/v2.1/servers/bcf14e6a-ecdc-40c0-b76b-678a1bb14828/action => generated 0 bytes in 6015 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 19 03:20:23.022334 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-86eff70b-d12a-4cdf-a554-dd6e6013b783 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:20:23.022956 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-86eff70b-d12a-4cdf-a554-dd6e6013b783 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] [instance: fee1d282-ae3a-4792-ba8f-a19e498c8853] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:20:23.047676 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-86eff70b-d12a-4cdf-a554-dd6e6013b783 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:23.048268 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-86eff70b-d12a-4cdf-a554-dd6e6013b783 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:23.048767 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-86eff70b-d12a-4cdf-a554-dd6e6013b783 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:23.049703 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-86eff70b-d12a-4cdf-a554-dd6e6013b783 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:23.050287 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-86eff70b-d12a-4cdf-a554-dd6e6013b783 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:23.050869 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-86eff70b-d12a-4cdf-a554-dd6e6013b783 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:23.272069 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-86eff70b-d12a-4cdf-a554-dd6e6013b783 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '152fa52a83b14c71bf86b22d77a73625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1606da859950484e9aa949e5c59c0a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:23.280020 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-86eff70b-d12a-4cdf-a554-dd6e6013b783 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] 10.222.0.52 "GET /compute/v2.1/servers/fee1d282-ae3a-4792-ba8f-a19e498c8853" status: 200 len: 1323 microversion: 2.1 time: 0.273753 Oct 19 03:20:23.280609 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1004/2066] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:20:23 2022] GET /compute/v2.1/servers/fee1d282-ae3a-4792-ba8f-a19e498c8853 => generated 1323 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:20:23.285100 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b25b6ff8-9cda-4265-b930-8c507742a770 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:20:23.285740 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b25b6ff8-9cda-4265-b930-8c507742a770 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] [instance: b1acb084-c2bd-49b1-b38a-5e7630389abd] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:20:23.291897 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b25b6ff8-9cda-4265-b930-8c507742a770 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:23.292395 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b25b6ff8-9cda-4265-b930-8c507742a770 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:23.292842 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b25b6ff8-9cda-4265-b930-8c507742a770 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:23.296980 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b25b6ff8-9cda-4265-b930-8c507742a770 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:23.296980 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b25b6ff8-9cda-4265-b930-8c507742a770 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:23.296980 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b25b6ff8-9cda-4265-b930-8c507742a770 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:23.458632 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-e120adfd-6b20-4bd8-8546-2e0b08ae216b tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Flavor limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:20:23.459914 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-e120adfd-6b20-4bd8-8546-2e0b08ae216b tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Image limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:20:23.460674 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-e120adfd-6b20-4bd8-8546-2e0b08ae216b tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Flavor pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:20:23.461410 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-e120adfd-6b20-4bd8-8546-2e0b08ae216b tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Image pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:20:23.465520 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-e120adfd-6b20-4bd8-8546-2e0b08ae216b tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:20:23.475903 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e120adfd-6b20-4bd8-8546-2e0b08ae216b tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:23.476417 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e120adfd-6b20-4bd8-8546-2e0b08ae216b tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:23.476840 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e120adfd-6b20-4bd8-8546-2e0b08ae216b tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:23.477612 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e120adfd-6b20-4bd8-8546-2e0b08ae216b tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:23.478250 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e120adfd-6b20-4bd8-8546-2e0b08ae216b tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:23.478684 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e120adfd-6b20-4bd8-8546-2e0b08ae216b tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:23.493243 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b25b6ff8-9cda-4265-b930-8c507742a770 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4c5e4123c44508a5d4911a17c44231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a495ccfced47f29cb928d1ded20d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:23.497880 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b25b6ff8-9cda-4265-b930-8c507742a770 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] 10.222.0.52 "GET /compute/v2.1/servers/b1acb084-c2bd-49b1-b38a-5e7630389abd" status: 200 len: 1313 microversion: 2.1 time: 0.215754 Oct 19 03:20:23.498804 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-e120adfd-6b20-4bd8-8546-2e0b08ae216b tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Getting quotas for project b8bf3e0ec0b34e2bb80b1d09877c3fd0. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:20:23.504982 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-e120adfd-6b20-4bd8-8546-2e0b08ae216b tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Getting quotas for user ca9e45a223244d29976d3bcf6f06a1d2 and project b8bf3e0ec0b34e2bb80b1d09877c3fd0. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:20:23.513495 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1005/2067] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:20:23 2022] GET /compute/v2.1/servers/b1acb084-c2bd-49b1-b38a-5e7630389abd => generated 1313 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:20:23.520987 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-78b470e6-61a8-4b43-8c60-7e8960241f1f tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:20:23.521752 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-78b470e6-61a8-4b43-8c60-7e8960241f1f tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] [instance: 245ae0c1-c202-41c0-8f85-d5d99549f3ae] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:20:23.528181 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-78b470e6-61a8-4b43-8c60-7e8960241f1f tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:23.528745 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-78b470e6-61a8-4b43-8c60-7e8960241f1f tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:23.529265 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-78b470e6-61a8-4b43-8c60-7e8960241f1f tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:23.530137 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-78b470e6-61a8-4b43-8c60-7e8960241f1f tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:23.530874 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-78b470e6-61a8-4b43-8c60-7e8960241f1f tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:23.531292 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-78b470e6-61a8-4b43-8c60-7e8960241f1f tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:23.665684 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e120adfd-6b20-4bd8-8546-2e0b08ae216b tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Going to run 1 instances... {{(pid=121135) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:20:23.668458 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e120adfd-6b20-4bd8-8546-2e0b08ae216b tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] [instance: 4adec402-e94f-4a41-ac77-68f6091b87f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='28ce37d8-cc78-415a-b4de-32ec791a7b5e',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='fbb675f3-fed6-43de-a395-1dd47c8ae57e',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='46ee699c-dd0e-40d5-acac-0bf103d364b0',volume_size=None,volume_type=None)] {{(pid=121135) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:20:23.683395 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-78b470e6-61a8-4b43-8c60-7e8960241f1f tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8824f20e6a1f478a99f90e1ba8f028fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e436373e9e45efa03f08b33da619e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:23.687616 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-78b470e6-61a8-4b43-8c60-7e8960241f1f tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] 10.222.0.52 "GET /compute/v2.1/servers/245ae0c1-c202-41c0-8f85-d5d99549f3ae" status: 200 len: 1324 microversion: 2.1 time: 0.172030 Oct 19 03:20:23.688306 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1006/2068] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:20:23 2022] GET /compute/v2.1/servers/245ae0c1-c202-41c0-8f85-d5d99549f3ae => generated 1324 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:20:23.694368 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-911595a3-6a2c-4edf-89da-15a55f9e7075 req-befe4033-9d5f-4ecc-bf88-0375f9e520c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1acb084-c2bd-49b1-b38a-5e7630389abd", "tag": "4f0a4fb9-fac6-42f2-b204-c5448efc4ee9"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:20:23.704022 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-911595a3-6a2c-4edf-89da-15a55f9e7075 req-befe4033-9d5f-4ecc-bf88-0375f9e520c7 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:23.704823 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-911595a3-6a2c-4edf-89da-15a55f9e7075 req-befe4033-9d5f-4ecc-bf88-0375f9e520c7 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:23.705253 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-911595a3-6a2c-4edf-89da-15a55f9e7075 req-befe4033-9d5f-4ecc-bf88-0375f9e520c7 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:23.716859 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-911595a3-6a2c-4edf-89da-15a55f9e7075 req-befe4033-9d5f-4ecc-bf88-0375f9e520c7 service nova] Creating event network-changed:4f0a4fb9-fac6-42f2-b204-c5448efc4ee9 for instance b1acb084-c2bd-49b1-b38a-5e7630389abd on n-h1-861333-8 Oct 19 03:20:23.721987 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-911595a3-6a2c-4edf-89da-15a55f9e7075 req-befe4033-9d5f-4ecc-bf88-0375f9e520c7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032165 Oct 19 03:20:23.722593 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1007/2069] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:20:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:20:23.727896 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-454dc6bc-c03c-49a0-9e4d-b50aef9c9394 req-6deb6959-f8cb-408c-b444-0403e36e6f05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bcf14e6a-ecdc-40c0-b76b-678a1bb14828", "tag": "2e33b971-5f4b-4979-8038-bf99f7338ba3"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:20:23.737693 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-454dc6bc-c03c-49a0-9e4d-b50aef9c9394 req-6deb6959-f8cb-408c-b444-0403e36e6f05 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:23.740894 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-454dc6bc-c03c-49a0-9e4d-b50aef9c9394 req-6deb6959-f8cb-408c-b444-0403e36e6f05 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:23.740894 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-454dc6bc-c03c-49a0-9e4d-b50aef9c9394 req-6deb6959-f8cb-408c-b444-0403e36e6f05 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:23.749917 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-454dc6bc-c03c-49a0-9e4d-b50aef9c9394 req-6deb6959-f8cb-408c-b444-0403e36e6f05 service nova] Creating event network-changed:2e33b971-5f4b-4979-8038-bf99f7338ba3 for instance bcf14e6a-ecdc-40c0-b76b-678a1bb14828 on n-h2-861333-8 Oct 19 03:20:23.756523 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-454dc6bc-c03c-49a0-9e4d-b50aef9c9394 req-6deb6959-f8cb-408c-b444-0403e36e6f05 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032259 Oct 19 03:20:23.757136 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1008/2070] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:20:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:20:23.762308 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-910ff184-20a1-4a18-bb34-657562cd924c tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Calling method '.version_select at 0x7fc135015c10>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:20:24.430552 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-910ff184-20a1-4a18-bb34-657562cd924c tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] 10.222.0.52 "GET /compute/v2.1/os-floating-ips/1ee12215-2114-435c-bef8-069797c3dd90" status: 200 len: 184 microversion: 2.1 time: 0.672023 Oct 19 03:20:24.432661 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1009/2071] 10.222.0.52 () {58 vars in 1260 bytes} [Wed Oct 19 03:20:23 2022] GET /compute/v2.1/os-floating-ips/1ee12215-2114-435c-bef8-069797c3dd90 => generated 184 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:20:24.448437 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5256ab50-8540-49d5-bf98-bf9a0fa8d022 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:20:24.451633 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5256ab50-8540-49d5-bf98-bf9a0fa8d022 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] [instance: fee1d282-ae3a-4792-ba8f-a19e498c8853] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:20:24.458097 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5256ab50-8540-49d5-bf98-bf9a0fa8d022 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:24.458598 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5256ab50-8540-49d5-bf98-bf9a0fa8d022 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:24.459043 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5256ab50-8540-49d5-bf98-bf9a0fa8d022 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:24.459757 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5256ab50-8540-49d5-bf98-bf9a0fa8d022 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:24.460213 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5256ab50-8540-49d5-bf98-bf9a0fa8d022 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:24.460696 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5256ab50-8540-49d5-bf98-bf9a0fa8d022 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:24.904879 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5256ab50-8540-49d5-bf98-bf9a0fa8d022 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '152fa52a83b14c71bf86b22d77a73625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1606da859950484e9aa949e5c59c0a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:24.914335 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5256ab50-8540-49d5-bf98-bf9a0fa8d022 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] 10.222.0.52 "GET /compute/v2.1/servers/fee1d282-ae3a-4792-ba8f-a19e498c8853" status: 200 len: 1323 microversion: 2.1 time: 0.471139 Oct 19 03:20:24.933469 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1010/2072] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:20:24 2022] GET /compute/v2.1/servers/fee1d282-ae3a-4792-ba8f-a19e498c8853 => generated 1323 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:20:24.936825 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-81bee506-d94d-40c1-8011-e5443e9dc4bc tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.7.89"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:20:25.551619 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e120adfd-6b20-4bd8-8546-2e0b08ae216b tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.32 time: 9.150979 Oct 19 03:20:25.552904 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1063/2073] 10.222.0.52 () {62 vars in 1189 bytes} [Wed Oct 19 03:20:16 2022] POST /compute/v2.1/servers => generated 405 bytes in 9153 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 19 03:20:25.565918 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-287cb552-b988-4fc6-9964-f97a39b86b48 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:20:25.566802 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-287cb552-b988-4fc6-9964-f97a39b86b48 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] [instance: b1acb084-c2bd-49b1-b38a-5e7630389abd] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:20:25.578843 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-287cb552-b988-4fc6-9964-f97a39b86b48 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:25.578843 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-287cb552-b988-4fc6-9964-f97a39b86b48 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:25.578843 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-287cb552-b988-4fc6-9964-f97a39b86b48 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:25.578843 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-287cb552-b988-4fc6-9964-f97a39b86b48 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:25.579247 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-287cb552-b988-4fc6-9964-f97a39b86b48 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:25.579247 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-287cb552-b988-4fc6-9964-f97a39b86b48 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:25.584813 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-81bee506-d94d-40c1-8011-e5443e9dc4bc tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] [instance: bcf14e6a-ecdc-40c0-b76b-678a1bb14828] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:20:25.610960 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-81bee506-d94d-40c1-8011-e5443e9dc4bc tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:25.616901 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-81bee506-d94d-40c1-8011-e5443e9dc4bc tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:25.618843 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-81bee506-d94d-40c1-8011-e5443e9dc4bc tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:25.628141 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-81bee506-d94d-40c1-8011-e5443e9dc4bc tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:25.628918 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-81bee506-d94d-40c1-8011-e5443e9dc4bc tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:25.649475 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-81bee506-d94d-40c1-8011-e5443e9dc4bc tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:26.156900 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-287cb552-b988-4fc6-9964-f97a39b86b48 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4c5e4123c44508a5d4911a17c44231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a495ccfced47f29cb928d1ded20d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:26.169364 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-287cb552-b988-4fc6-9964-f97a39b86b48 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] 10.222.0.52 "GET /compute/v2.1/servers/b1acb084-c2bd-49b1-b38a-5e7630389abd" status: 200 len: 1313 microversion: 2.1 time: 0.613086 Oct 19 03:20:26.172281 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1064/2074] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:20:25 2022] GET /compute/v2.1/servers/b1acb084-c2bd-49b1-b38a-5e7630389abd => generated 1313 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:20:26.187492 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d9127175-4de4-4fb4-b22a-0c8aa9e829d3 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:20:26.189874 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d9127175-4de4-4fb4-b22a-0c8aa9e829d3 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] [instance: 245ae0c1-c202-41c0-8f85-d5d99549f3ae] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:20:26.212485 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d9127175-4de4-4fb4-b22a-0c8aa9e829d3 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:26.213053 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d9127175-4de4-4fb4-b22a-0c8aa9e829d3 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:26.213546 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d9127175-4de4-4fb4-b22a-0c8aa9e829d3 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:26.214275 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d9127175-4de4-4fb4-b22a-0c8aa9e829d3 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:26.214935 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d9127175-4de4-4fb4-b22a-0c8aa9e829d3 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:26.215544 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d9127175-4de4-4fb4-b22a-0c8aa9e829d3 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:26.406569 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-81bee506-d94d-40c1-8011-e5443e9dc4bc tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Acquiring lock "refresh_cache-bcf14e6a-ecdc-40c0-b76b-678a1bb14828" {{(pid=121134) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 19 03:20:26.407397 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-81bee506-d94d-40c1-8011-e5443e9dc4bc tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Acquired lock "refresh_cache-bcf14e6a-ecdc-40c0-b76b-678a1bb14828" {{(pid=121134) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 19 03:20:26.688020 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d9127175-4de4-4fb4-b22a-0c8aa9e829d3 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8824f20e6a1f478a99f90e1ba8f028fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e436373e9e45efa03f08b33da619e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:26.697232 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d9127175-4de4-4fb4-b22a-0c8aa9e829d3 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] 10.222.0.52 "GET /compute/v2.1/servers/245ae0c1-c202-41c0-8f85-d5d99549f3ae" status: 200 len: 1324 microversion: 2.1 time: 0.523814 Oct 19 03:20:26.698118 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1065/2075] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:20:26 2022] GET /compute/v2.1/servers/245ae0c1-c202-41c0-8f85-d5d99549f3ae => generated 1324 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:20:26.703076 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-dfb22c2b-3aac-4714-ae35-ad211435019c tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:20:26.704069 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-dfb22c2b-3aac-4714-ae35-ad211435019c tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] [instance: 4adec402-e94f-4a41-ac77-68f6091b87f7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:20:26.888240 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-dfb22c2b-3aac-4714-ae35-ad211435019c tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:26.915401 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-dfb22c2b-3aac-4714-ae35-ad211435019c tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:26.923756 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-dfb22c2b-3aac-4714-ae35-ad211435019c tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:26.930732 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-dfb22c2b-3aac-4714-ae35-ad211435019c tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] 10.222.0.52 "GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7" status: 200 len: 1285 microversion: 2.32 time: 0.226681 Oct 19 03:20:26.948978 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1066/2076] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:20:26 2022] GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7 => generated 1285 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:20:26.948978 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-b2a18b8a-5c7e-4220-86d5-d1ad10910c6a req-8b749a43-1b87-4ae6-ae50-5ac695835b8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b97f61ab-18fc-4cf6-bc15-ec08ac4750fd", "name": "network-vif-deleted", "tag": "bcf93ca2-3c93-402b-9421-7ee5460dace0"}, {"name": "network-changed", "server_uuid": "fee1d282-ae3a-4792-ba8f-a19e498c8853", "tag": "a0fe25a1-1468-4c11-9af9-8321e13e7e0f"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:20:26.955618 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-b2a18b8a-5c7e-4220-86d5-d1ad10910c6a req-8b749a43-1b87-4ae6-ae50-5ac695835b8d service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:26.956112 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-b2a18b8a-5c7e-4220-86d5-d1ad10910c6a req-8b749a43-1b87-4ae6-ae50-5ac695835b8d service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:26.956604 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-b2a18b8a-5c7e-4220-86d5-d1ad10910c6a req-8b749a43-1b87-4ae6-ae50-5ac695835b8d service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:26.972460 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-b2a18b8a-5c7e-4220-86d5-d1ad10910c6a req-8b749a43-1b87-4ae6-ae50-5ac695835b8d service nova] Creating event network-vif-deleted:bcf93ca2-3c93-402b-9421-7ee5460dace0 for instance b97f61ab-18fc-4cf6-bc15-ec08ac4750fd on n-h1-861333-8 Oct 19 03:20:26.973586 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-b2a18b8a-5c7e-4220-86d5-d1ad10910c6a req-8b749a43-1b87-4ae6-ae50-5ac695835b8d service nova] Creating event network-changed:a0fe25a1-1468-4c11-9af9-8321e13e7e0f for instance fee1d282-ae3a-4792-ba8f-a19e498c8853 on n-h2-861333-8 Oct 19 03:20:26.982537 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=12 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:20:26.983250 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-b2a18b8a-5c7e-4220-86d5-d1ad10910c6a req-8b749a43-1b87-4ae6-ae50-5ac695835b8d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.049262 Oct 19 03:20:26.984391 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1067/2077] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:20:26 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:20:26.994852 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-87dda693-ce04-4672-ba44-3be879ed7568 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:20:26.996292 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-87dda693-ce04-4672-ba44-3be879ed7568 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] [instance: fee1d282-ae3a-4792-ba8f-a19e498c8853] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:20:27.006254 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-87dda693-ce04-4672-ba44-3be879ed7568 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:27.007112 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-87dda693-ce04-4672-ba44-3be879ed7568 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:27.007911 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-87dda693-ce04-4672-ba44-3be879ed7568 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:27.009046 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-87dda693-ce04-4672-ba44-3be879ed7568 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:27.009844 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-87dda693-ce04-4672-ba44-3be879ed7568 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:27.011148 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-87dda693-ce04-4672-ba44-3be879ed7568 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:27.936482 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-87dda693-ce04-4672-ba44-3be879ed7568 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '152fa52a83b14c71bf86b22d77a73625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1606da859950484e9aa949e5c59c0a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:27.954027 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-87dda693-ce04-4672-ba44-3be879ed7568 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] 10.222.0.52 "GET /compute/v2.1/servers/fee1d282-ae3a-4792-ba8f-a19e498c8853" status: 200 len: 1323 microversion: 2.1 time: 0.960820 Oct 19 03:20:27.954027 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1068/2078] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:20:26 2022] GET /compute/v2.1/servers/fee1d282-ae3a-4792-ba8f-a19e498c8853 => generated 1323 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:20:27.963200 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-cb7af88e-7b67-45e3-9fc8-b6084d6ca4fc req-b202f655-de25-4474-8407-e7c53e737865 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1acb084-c2bd-49b1-b38a-5e7630389abd", "name": "network-vif-plugged", "status": "completed", "tag": "4f0a4fb9-fac6-42f2-b204-c5448efc4ee9"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:20:27.975445 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-cb7af88e-7b67-45e3-9fc8-b6084d6ca4fc req-b202f655-de25-4474-8407-e7c53e737865 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:27.977100 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-cb7af88e-7b67-45e3-9fc8-b6084d6ca4fc req-b202f655-de25-4474-8407-e7c53e737865 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:27.977580 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-cb7af88e-7b67-45e3-9fc8-b6084d6ca4fc req-b202f655-de25-4474-8407-e7c53e737865 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:28.002741 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-cb7af88e-7b67-45e3-9fc8-b6084d6ca4fc req-b202f655-de25-4474-8407-e7c53e737865 service nova] Creating event network-vif-plugged:4f0a4fb9-fac6-42f2-b204-c5448efc4ee9 for instance b1acb084-c2bd-49b1-b38a-5e7630389abd on n-h1-861333-8 Oct 19 03:20:28.020191 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-cb7af88e-7b67-45e3-9fc8-b6084d6ca4fc req-b202f655-de25-4474-8407-e7c53e737865 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071192 Oct 19 03:20:28.021075 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1069/2079] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:20:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:20:28.030162 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d0b76fd0-fef5-4edd-9e72-4afff0c8c8d9 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:20:28.031142 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d0b76fd0-fef5-4edd-9e72-4afff0c8c8d9 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] [instance: b1acb084-c2bd-49b1-b38a-5e7630389abd] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:20:28.049134 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d0b76fd0-fef5-4edd-9e72-4afff0c8c8d9 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:28.051439 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d0b76fd0-fef5-4edd-9e72-4afff0c8c8d9 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:28.051439 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d0b76fd0-fef5-4edd-9e72-4afff0c8c8d9 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:28.051439 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d0b76fd0-fef5-4edd-9e72-4afff0c8c8d9 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:28.051938 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d0b76fd0-fef5-4edd-9e72-4afff0c8c8d9 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:28.052522 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d0b76fd0-fef5-4edd-9e72-4afff0c8c8d9 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:28.622196 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d0b76fd0-fef5-4edd-9e72-4afff0c8c8d9 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4c5e4123c44508a5d4911a17c44231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a495ccfced47f29cb928d1ded20d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:28.638207 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d0b76fd0-fef5-4edd-9e72-4afff0c8c8d9 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] 10.222.0.52 "GET /compute/v2.1/servers/b1acb084-c2bd-49b1-b38a-5e7630389abd" status: 200 len: 1313 microversion: 2.1 time: 0.615683 Oct 19 03:20:28.639131 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1070/2080] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:20:28 2022] GET /compute/v2.1/servers/b1acb084-c2bd-49b1-b38a-5e7630389abd => generated 1313 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:20:28.644377 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ed890d26-e31c-451d-bb25-1a4f1deda2f1 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:20:28.645785 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ed890d26-e31c-451d-bb25-1a4f1deda2f1 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] [instance: 245ae0c1-c202-41c0-8f85-d5d99549f3ae] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:20:28.651992 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ed890d26-e31c-451d-bb25-1a4f1deda2f1 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:28.652683 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ed890d26-e31c-451d-bb25-1a4f1deda2f1 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:28.653313 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ed890d26-e31c-451d-bb25-1a4f1deda2f1 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:28.654198 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ed890d26-e31c-451d-bb25-1a4f1deda2f1 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:28.654804 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ed890d26-e31c-451d-bb25-1a4f1deda2f1 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:28.655385 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ed890d26-e31c-451d-bb25-1a4f1deda2f1 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:29.191056 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ed890d26-e31c-451d-bb25-1a4f1deda2f1 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8824f20e6a1f478a99f90e1ba8f028fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e436373e9e45efa03f08b33da619e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:29.199937 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ed890d26-e31c-451d-bb25-1a4f1deda2f1 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] 10.222.0.52 "GET /compute/v2.1/servers/245ae0c1-c202-41c0-8f85-d5d99549f3ae" status: 200 len: 1324 microversion: 2.1 time: 0.559782 Oct 19 03:20:29.201054 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1071/2081] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:20:28 2022] GET /compute/v2.1/servers/245ae0c1-c202-41c0-8f85-d5d99549f3ae => generated 1324 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:20:29.206759 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f3c4ebad-3d32-433c-9f0d-6a6d0f8ba036 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:20:29.207531 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f3c4ebad-3d32-433c-9f0d-6a6d0f8ba036 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] [instance: 4adec402-e94f-4a41-ac77-68f6091b87f7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:20:29.219651 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f3c4ebad-3d32-433c-9f0d-6a6d0f8ba036 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:29.220150 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f3c4ebad-3d32-433c-9f0d-6a6d0f8ba036 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:29.220587 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f3c4ebad-3d32-433c-9f0d-6a6d0f8ba036 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:29.221293 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f3c4ebad-3d32-433c-9f0d-6a6d0f8ba036 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:29.221768 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f3c4ebad-3d32-433c-9f0d-6a6d0f8ba036 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:29.222258 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f3c4ebad-3d32-433c-9f0d-6a6d0f8ba036 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:29.358610 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-81bee506-d94d-40c1-8011-e5443e9dc4bc tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] [instance: bcf14e6a-ecdc-40c0-b76b-678a1bb14828] Building network info cache for instance {{(pid=121134) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 19 03:20:29.456831 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f3c4ebad-3d32-433c-9f0d-6a6d0f8ba036 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:29.471593 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f3c4ebad-3d32-433c-9f0d-6a6d0f8ba036 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:29.474939 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f3c4ebad-3d32-433c-9f0d-6a6d0f8ba036 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:29.476117 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f3c4ebad-3d32-433c-9f0d-6a6d0f8ba036 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] 10.222.0.52 "GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7" status: 200 len: 1575 microversion: 2.32 time: 0.273655 Oct 19 03:20:29.477186 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1072/2082] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:20:29 2022] GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7 => generated 1575 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:20:29.483905 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a89cb060-5b48-48f2-bb36-530cf86b2297 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:20:29.484937 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a89cb060-5b48-48f2-bb36-530cf86b2297 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] [instance: fee1d282-ae3a-4792-ba8f-a19e498c8853] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:20:29.493056 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a89cb060-5b48-48f2-bb36-530cf86b2297 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:29.494561 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a89cb060-5b48-48f2-bb36-530cf86b2297 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:29.495503 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a89cb060-5b48-48f2-bb36-530cf86b2297 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:29.503768 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a89cb060-5b48-48f2-bb36-530cf86b2297 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:29.503768 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a89cb060-5b48-48f2-bb36-530cf86b2297 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:29.503768 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a89cb060-5b48-48f2-bb36-530cf86b2297 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:29.843464 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a89cb060-5b48-48f2-bb36-530cf86b2297 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '152fa52a83b14c71bf86b22d77a73625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1606da859950484e9aa949e5c59c0a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:29.852704 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a89cb060-5b48-48f2-bb36-530cf86b2297 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] 10.222.0.52 "GET /compute/v2.1/servers/fee1d282-ae3a-4792-ba8f-a19e498c8853" status: 200 len: 1323 microversion: 2.1 time: 0.373463 Oct 19 03:20:29.861516 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1073/2083] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:20:29 2022] GET /compute/v2.1/servers/fee1d282-ae3a-4792-ba8f-a19e498c8853 => generated 1323 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:20:29.870407 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-3d15c08a-1789-4a88-9f6e-bb4274914980 req-aeb85751-71eb-485a-8e99-1d98980e5839 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "245ae0c1-c202-41c0-8f85-d5d99549f3ae", "tag": "59e53e31-1407-44d1-8ec2-153ae5c03e55"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:20:29.887318 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-3d15c08a-1789-4a88-9f6e-bb4274914980 req-aeb85751-71eb-485a-8e99-1d98980e5839 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:29.888028 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-3d15c08a-1789-4a88-9f6e-bb4274914980 req-aeb85751-71eb-485a-8e99-1d98980e5839 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:29.888641 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-3d15c08a-1789-4a88-9f6e-bb4274914980 req-aeb85751-71eb-485a-8e99-1d98980e5839 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:29.909541 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-3d15c08a-1789-4a88-9f6e-bb4274914980 req-aeb85751-71eb-485a-8e99-1d98980e5839 service nova] Creating event network-changed:59e53e31-1407-44d1-8ec2-153ae5c03e55 for instance 245ae0c1-c202-41c0-8f85-d5d99549f3ae on n-h2-861333-8 Oct 19 03:20:29.921345 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-3d15c08a-1789-4a88-9f6e-bb4274914980 req-aeb85751-71eb-485a-8e99-1d98980e5839 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054368 Oct 19 03:20:29.925769 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1074/2084] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:20:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:20:29.937019 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-89593119-3d5d-4176-a8a1-33ca9bbb9b25 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-909245531", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "ba959db6-6066-4748-89f7-037c7f1d280b"}], "block_device_mapping_v2": [{"uuid": "ce589be6-457e-4db3-86a3-063effd93f24", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:20:30.063474 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.network.neutron [None req-89593119-3d5d-4176-a8a1-33ca9bbb9b25 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] validate_networks() for [('ba959db6-6066-4748-89f7-037c7f1d280b', None, None, None, None, None)] {{(pid=121135) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:20:30.966799 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-81bee506-d94d-40c1-8011-e5443e9dc4bc tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] [instance: bcf14e6a-ecdc-40c0-b76b-678a1bb14828] Updating instance_info_cache with network_info: [{"id": "2e33b971-5f4b-4979-8038-bf99f7338ba3", "address": "fa:16:3e:02:c8:80", "network": {"id": "6b3013ab-5e3b-4dca-bc82-37c6dc5721e3", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-694479142-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "0e5d239ae4b24b7e978935fe9b3458cf", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap2e33b971-5f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=121134) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 19 03:20:31.061863 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-89593119-3d5d-4176-a8a1-33ca9bbb9b25 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Flavor limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:20:31.062384 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-89593119-3d5d-4176-a8a1-33ca9bbb9b25 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Image limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:20:31.063218 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-89593119-3d5d-4176-a8a1-33ca9bbb9b25 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Flavor pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:20:31.063827 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-89593119-3d5d-4176-a8a1-33ca9bbb9b25 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Image pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:20:31.064360 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-89593119-3d5d-4176-a8a1-33ca9bbb9b25 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:20:31.082913 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-89593119-3d5d-4176-a8a1-33ca9bbb9b25 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:31.083776 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-89593119-3d5d-4176-a8a1-33ca9bbb9b25 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:31.084230 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-89593119-3d5d-4176-a8a1-33ca9bbb9b25 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:31.084979 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-89593119-3d5d-4176-a8a1-33ca9bbb9b25 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:31.085561 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-89593119-3d5d-4176-a8a1-33ca9bbb9b25 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:31.086001 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-89593119-3d5d-4176-a8a1-33ca9bbb9b25 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:31.106131 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-89593119-3d5d-4176-a8a1-33ca9bbb9b25 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Getting quotas for project 86eaac72e51142f795b3e482be19c4f2. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:20:31.111904 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-89593119-3d5d-4176-a8a1-33ca9bbb9b25 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Getting quotas for user 7a453f077dae4dfa8a3cf28c555a9a7c and project 86eaac72e51142f795b3e482be19c4f2. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:20:31.208443 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-89593119-3d5d-4176-a8a1-33ca9bbb9b25 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Going to run 1 instances... {{(pid=121135) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:20:31.210850 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-89593119-3d5d-4176-a8a1-33ca9bbb9b25 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 074f3469-3bbd-46df-8286-3a57f91798e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ce589be6-457e-4db3-86a3-063effd93f24',volume_size=None,volume_type=None)] {{(pid=121135) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:20:31.291420 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-81bee506-d94d-40c1-8011-e5443e9dc4bc tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Releasing lock "refresh_cache-bcf14e6a-ecdc-40c0-b76b-678a1bb14828" {{(pid=121134) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 19 03:20:31.292317 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-81bee506-d94d-40c1-8011-e5443e9dc4bc tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] 10.222.0.52 "POST /compute/v2.1/servers/bcf14e6a-ecdc-40c0-b76b-678a1bb14828/action" status: 202 len: 0 microversion: 2.1 time: 6.360305 Oct 19 03:20:31.293234 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1011/2085] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:20:24 2022] POST /compute/v2.1/servers/bcf14e6a-ecdc-40c0-b76b-678a1bb14828/action => generated 0 bytes in 6362 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 19 03:20:31.300366 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9cc8efdb-3ffc-441b-bcd8-2bfac6bd7616 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:20:31.300366 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9cc8efdb-3ffc-441b-bcd8-2bfac6bd7616 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] [instance: b1acb084-c2bd-49b1-b38a-5e7630389abd] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:20:31.314567 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9cc8efdb-3ffc-441b-bcd8-2bfac6bd7616 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:31.316113 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9cc8efdb-3ffc-441b-bcd8-2bfac6bd7616 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:31.317328 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9cc8efdb-3ffc-441b-bcd8-2bfac6bd7616 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:31.318515 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9cc8efdb-3ffc-441b-bcd8-2bfac6bd7616 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:31.319157 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9cc8efdb-3ffc-441b-bcd8-2bfac6bd7616 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:31.319823 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9cc8efdb-3ffc-441b-bcd8-2bfac6bd7616 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:31.588242 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9cc8efdb-3ffc-441b-bcd8-2bfac6bd7616 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4c5e4123c44508a5d4911a17c44231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a495ccfced47f29cb928d1ded20d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:31.603384 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9cc8efdb-3ffc-441b-bcd8-2bfac6bd7616 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] 10.222.0.52 "GET /compute/v2.1/servers/b1acb084-c2bd-49b1-b38a-5e7630389abd" status: 200 len: 1463 microversion: 2.1 time: 0.308589 Oct 19 03:20:31.604238 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1012/2086] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:20:31 2022] GET /compute/v2.1/servers/b1acb084-c2bd-49b1-b38a-5e7630389abd => generated 1463 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:20:31.612598 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-e2295b35-b7ec-4b61-825c-9847412eaa60 req-658e400e-c5d7-4b89-893a-57e846a346d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fee1d282-ae3a-4792-ba8f-a19e498c8853", "name": "network-vif-plugged", "status": "completed", "tag": "a0fe25a1-1468-4c11-9af9-8321e13e7e0f"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:20:31.630655 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-e2295b35-b7ec-4b61-825c-9847412eaa60 req-658e400e-c5d7-4b89-893a-57e846a346d9 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:31.634412 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-e2295b35-b7ec-4b61-825c-9847412eaa60 req-658e400e-c5d7-4b89-893a-57e846a346d9 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:31.634412 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-e2295b35-b7ec-4b61-825c-9847412eaa60 req-658e400e-c5d7-4b89-893a-57e846a346d9 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:31.644928 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-e2295b35-b7ec-4b61-825c-9847412eaa60 req-658e400e-c5d7-4b89-893a-57e846a346d9 service nova] Creating event network-vif-plugged:a0fe25a1-1468-4c11-9af9-8321e13e7e0f for instance fee1d282-ae3a-4792-ba8f-a19e498c8853 on n-h2-861333-8 Oct 19 03:20:31.651088 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-e2295b35-b7ec-4b61-825c-9847412eaa60 req-658e400e-c5d7-4b89-893a-57e846a346d9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045489 Oct 19 03:20:31.652062 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1013/2087] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:20:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:20:31.754570 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-89593119-3d5d-4176-a8a1-33ca9bbb9b25 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.826592 Oct 19 03:20:31.755968 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1075/2088] 10.222.0.52 () {62 vars in 1188 bytes} [Wed Oct 19 03:20:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1829 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 19 03:20:31.761357 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-394551e6-8351-4669-bba4-036c4670555f tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:20:31.762508 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-394551e6-8351-4669-bba4-036c4670555f tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] [instance: 245ae0c1-c202-41c0-8f85-d5d99549f3ae] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:20:31.770429 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-394551e6-8351-4669-bba4-036c4670555f tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:31.771262 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-394551e6-8351-4669-bba4-036c4670555f tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:31.772135 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-394551e6-8351-4669-bba4-036c4670555f tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:31.773303 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-394551e6-8351-4669-bba4-036c4670555f tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:31.774020 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-394551e6-8351-4669-bba4-036c4670555f tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:31.775133 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-394551e6-8351-4669-bba4-036c4670555f tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:31.832383 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-45db789e-b735-4738-b9b3-16c406579a1c tempest-FloatingIPDetailsTestJSON-1662489570 tempest-FloatingIPDetailsTestJSON-1662489570-project] Action: 'create', calling method: .version_select at 0x7fc1350fee50>, body: {"pool": null} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:20:32.360002 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-394551e6-8351-4669-bba4-036c4670555f tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8824f20e6a1f478a99f90e1ba8f028fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e436373e9e45efa03f08b33da619e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:32.367938 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-394551e6-8351-4669-bba4-036c4670555f tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] 10.222.0.52 "GET /compute/v2.1/servers/245ae0c1-c202-41c0-8f85-d5d99549f3ae" status: 200 len: 1324 microversion: 2.1 time: 0.610637 Oct 19 03:20:32.368539 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1076/2089] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:20:31 2022] GET /compute/v2.1/servers/245ae0c1-c202-41c0-8f85-d5d99549f3ae => generated 1324 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:20:32.373144 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1884b51d-2e48-492e-bced-811bc26be220 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:20:32.373779 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1884b51d-2e48-492e-bced-811bc26be220 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] [instance: 4adec402-e94f-4a41-ac77-68f6091b87f7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:20:32.380189 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1884b51d-2e48-492e-bced-811bc26be220 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:32.380680 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1884b51d-2e48-492e-bced-811bc26be220 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:32.381118 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1884b51d-2e48-492e-bced-811bc26be220 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:32.381881 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1884b51d-2e48-492e-bced-811bc26be220 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:32.382298 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1884b51d-2e48-492e-bced-811bc26be220 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:32.382725 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1884b51d-2e48-492e-bced-811bc26be220 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:32.466186 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-1884b51d-2e48-492e-bced-811bc26be220 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:32.481169 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-1884b51d-2e48-492e-bced-811bc26be220 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:32.483259 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-1884b51d-2e48-492e-bced-811bc26be220 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:32.484936 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1884b51d-2e48-492e-bced-811bc26be220 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] 10.222.0.52 "GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7" status: 200 len: 1583 microversion: 2.32 time: 0.115266 Oct 19 03:20:32.486310 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1077/2090] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:20:32 2022] GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7 => generated 1583 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:20:32.497522 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4d731ad6-5285-48dc-972a-5d04dc78f6f2 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:20:32.497522 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4d731ad6-5285-48dc-972a-5d04dc78f6f2 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] [instance: fee1d282-ae3a-4792-ba8f-a19e498c8853] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:20:32.500187 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4d731ad6-5285-48dc-972a-5d04dc78f6f2 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:32.500688 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4d731ad6-5285-48dc-972a-5d04dc78f6f2 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:32.501143 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4d731ad6-5285-48dc-972a-5d04dc78f6f2 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:32.501854 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4d731ad6-5285-48dc-972a-5d04dc78f6f2 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:32.502315 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4d731ad6-5285-48dc-972a-5d04dc78f6f2 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:32.502746 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4d731ad6-5285-48dc-972a-5d04dc78f6f2 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:32.520860 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=100 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:20:32.769670 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4d731ad6-5285-48dc-972a-5d04dc78f6f2 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '152fa52a83b14c71bf86b22d77a73625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1606da859950484e9aa949e5c59c0a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:32.778181 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4d731ad6-5285-48dc-972a-5d04dc78f6f2 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] 10.222.0.52 "GET /compute/v2.1/servers/fee1d282-ae3a-4792-ba8f-a19e498c8853" status: 200 len: 1323 microversion: 2.1 time: 0.288911 Oct 19 03:20:32.788818 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1078/2091] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:20:32 2022] GET /compute/v2.1/servers/fee1d282-ae3a-4792-ba8f-a19e498c8853 => generated 1323 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:20:32.788818 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5579b5e8-85f8-4811-9478-40d5ba12b955 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:20:32.788818 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-5579b5e8-85f8-4811-9478-40d5ba12b955 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] [instance: b97f61ab-18fc-4cf6-bc15-ec08ac4750fd] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:20:32.790217 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5579b5e8-85f8-4811-9478-40d5ba12b955 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:32.790707 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5579b5e8-85f8-4811-9478-40d5ba12b955 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:32.791205 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5579b5e8-85f8-4811-9478-40d5ba12b955 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:32.791915 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5579b5e8-85f8-4811-9478-40d5ba12b955 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:32.792367 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5579b5e8-85f8-4811-9478-40d5ba12b955 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:32.792790 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5579b5e8-85f8-4811-9478-40d5ba12b955 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:32.812899 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-5579b5e8-85f8-4811-9478-40d5ba12b955 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] HTTP exception thrown: Instance b97f61ab-18fc-4cf6-bc15-ec08ac4750fd could not be found. Oct 19 03:20:32.815169 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5579b5e8-85f8-4811-9478-40d5ba12b955 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Request method failure captured: Oct 19 03:20:32.815169 n-d-861333-8 devstack@n-api.service[121135]: request: DELETE /compute/v2.1/servers/b97f61ab-18fc-4cf6-bc15-ec08ac4750fd HTTP/1.1 Oct 19 03:20:32.815169 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:20:32.815169 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:20:32.815169 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:20:32.815169 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:20:32.815169 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:20:32.815169 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:20:32.815169 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:20:32.815169 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:20:32.815169 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2yU1TiVmMJOqJlwwAmlZEHt8wZDze_VxtD76CDF0CRASzSv6EqHKs-qeX7CTJr89jfwreZvEdY2ZOcsOrxEZ2ZvISug5RObJXrJKifdcx-MBjw_GmiXD_1PDZUclA0I62TyajaKDzJZdah6fGSqyEgjIEtJlX0kwL-pOeCwZsXEoRI Oct 19 03:20:32.815169 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:20:32.815169 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:20:32.815169 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:20:32.815169 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:20:32.815169 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:20:32.815169 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:20:32.815169 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 0e5d239ae4b24b7e978935fe9b3458cf Oct 19 03:20:32.815169 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-140638534 Oct 19 03:20:32.815169 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:20:32.815169 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:20:32.817694 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/0e5d239ae4b24b7e978935fe9b3458cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0e5d239ae4b24b7e978935fe9b3458cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0e5d239ae4b24b7e978935fe9b3458cf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_0e5d239ae4b24b7e978935fe9b3458cf", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:20:32.817694 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-140638534 Oct 19 03:20:32.817694 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 0e5d239ae4b24b7e978935fe9b3458cf Oct 19 03:20:32.817694 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-140638534 Oct 19 03:20:32.817694 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-FloatingIPsAssociationTestJSON-140638534-project Oct 19 03:20:32.817694 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:20:32.817694 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:20:32.817694 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: ac711151c0334c62958e7f2ec431d860 Oct 19 03:20:32.817694 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-140638534-project Oct 19 03:20:32.817694 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:20:32.817694 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance b97f61ab-18fc-4cf6-bc15-ec08ac4750fd could not be found. Oct 19 03:20:32.817694 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': 'b97f61ab-18fc-4cf6-bc15-ec08ac4750fd'} Oct 19 03:20:32.818741 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:20:32.818741 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:20:32.818741 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:20:32.818741 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:20:32.818741 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:20:32.818741 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:20:32.818741 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:20:32.818741 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:20:32.818741 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:20:32.818741 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:20:32.818741 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b97f61ab-18fc-4cf6-bc15-ec08ac4750fd could not be found. Oct 19 03:20:32.818741 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:20:32.818741 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:20:32.818741 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:20:32.818741 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:20:32.818741 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:20:32.818741 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:20:32.818741 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:20:32.818741 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:20:32.818741 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:20:32.820541 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:20:32.820541 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 03:20:32.820541 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 03:20:32.820541 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 03:20:32.820541 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 03:20:32.820541 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:20:32.820541 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:20:32.820541 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:20:32.820541 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:20:32.820541 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b97f61ab-18fc-4cf6-bc15-ec08ac4750fd could not be found. Oct 19 03:20:32.820541 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:20:32.820541 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:20:32.820541 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:20:32.820541 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:20:32.820541 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:20:32.820541 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:20:32.820541 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:20:32.820541 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:20:32.820541 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b97f61ab-18fc-4cf6-bc15-ec08ac4750fd could not be found. Oct 19 03:20:32.820541 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:20:32.823268 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5579b5e8-85f8-4811-9478-40d5ba12b955 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Returning 404 to user: Instance b97f61ab-18fc-4cf6-bc15-ec08ac4750fd could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:20:32.823504 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5579b5e8-85f8-4811-9478-40d5ba12b955 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] 10.222.0.52 "DELETE /compute/v2.1/servers/b97f61ab-18fc-4cf6-bc15-ec08ac4750fd" status: 404 len: 111 microversion: 2.1 time: 0.041210 Oct 19 03:20:32.824771 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1079/2092] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:20:32 2022] DELETE /compute/v2.1/servers/b97f61ab-18fc-4cf6-bc15-ec08ac4750fd => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:20:33.022732 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f098786a-0d12-40fe-b4e5-3d51c82abc15 tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:20:33.032910 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f098786a-0d12-40fe-b4e5-3d51c82abc15 tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Searching by: {'deleted': False, 'project_id': '94561439644343ebbb72d4759213f799'} {{(pid=121135) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 03:20:33.061609 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f098786a-0d12-40fe-b4e5-3d51c82abc15 tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:33.062364 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f098786a-0d12-40fe-b4e5-3d51c82abc15 tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:33.062906 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f098786a-0d12-40fe-b4e5-3d51c82abc15 tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:33.063751 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f098786a-0d12-40fe-b4e5-3d51c82abc15 tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:33.064530 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f098786a-0d12-40fe-b4e5-3d51c82abc15 tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:33.065162 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f098786a-0d12-40fe-b4e5-3d51c82abc15 tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:33.210328 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f098786a-0d12-40fe-b4e5-3d51c82abc15 tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.384284 Oct 19 03:20:33.221384 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1080/2093] 10.222.0.52 () {58 vars in 1146 bytes} [Wed Oct 19 03:20:32 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 03:20:33.235281 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7951f656-f01d-43b8-b63c-c93b52072906 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:20:33.236324 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7951f656-f01d-43b8-b63c-c93b52072906 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 074f3469-3bbd-46df-8286-3a57f91798e2] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:20:33.243075 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:20:33.245591 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7951f656-f01d-43b8-b63c-c93b52072906 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:33.252641 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7951f656-f01d-43b8-b63c-c93b52072906 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:33.252641 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7951f656-f01d-43b8-b63c-c93b52072906 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:33.252641 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7951f656-f01d-43b8-b63c-c93b52072906 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:33.252641 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7951f656-f01d-43b8-b63c-c93b52072906 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:33.253189 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7951f656-f01d-43b8-b63c-c93b52072906 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:33.423459 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7951f656-f01d-43b8-b63c-c93b52072906 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:33.434009 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7951f656-f01d-43b8-b63c-c93b52072906 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:33.439697 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7951f656-f01d-43b8-b63c-c93b52072906 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:33.444408 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7951f656-f01d-43b8-b63c-c93b52072906 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/074f3469-3bbd-46df-8286-3a57f91798e2" status: 200 len: 1184 microversion: 2.25 time: 0.220771 Oct 19 03:20:33.445074 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1081/2094] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:20:33 2022] GET /compute/v2.1/servers/074f3469-3bbd-46df-8286-3a57f91798e2 => generated 1184 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:20:33.455184 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-015057dc-ffd5-48e9-9242-d1d78baf576a req-340f5843-337a-479e-b134-8619f5ab8cec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bcf14e6a-ecdc-40c0-b76b-678a1bb14828", "tag": "2e33b971-5f4b-4979-8038-bf99f7338ba3"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:20:33.483632 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-015057dc-ffd5-48e9-9242-d1d78baf576a req-340f5843-337a-479e-b134-8619f5ab8cec service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:33.484121 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-015057dc-ffd5-48e9-9242-d1d78baf576a req-340f5843-337a-479e-b134-8619f5ab8cec service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:33.484551 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-015057dc-ffd5-48e9-9242-d1d78baf576a req-340f5843-337a-479e-b134-8619f5ab8cec service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:33.512646 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-015057dc-ffd5-48e9-9242-d1d78baf576a req-340f5843-337a-479e-b134-8619f5ab8cec service nova] Creating event network-changed:2e33b971-5f4b-4979-8038-bf99f7338ba3 for instance bcf14e6a-ecdc-40c0-b76b-678a1bb14828 on n-h2-861333-8 Oct 19 03:20:33.521160 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-015057dc-ffd5-48e9-9242-d1d78baf576a req-340f5843-337a-479e-b134-8619f5ab8cec service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073493 Oct 19 03:20:33.522490 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1082/2095] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:20:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:20:33.528411 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-159fa872-2089-47e4-a83a-e0db41dedcf1 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:20:33.529393 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-159fa872-2089-47e4-a83a-e0db41dedcf1 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] [instance: b97f61ab-18fc-4cf6-bc15-ec08ac4750fd] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:20:33.538166 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-159fa872-2089-47e4-a83a-e0db41dedcf1 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:33.542366 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-159fa872-2089-47e4-a83a-e0db41dedcf1 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:33.542366 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-159fa872-2089-47e4-a83a-e0db41dedcf1 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:33.543536 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-159fa872-2089-47e4-a83a-e0db41dedcf1 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:33.544196 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-159fa872-2089-47e4-a83a-e0db41dedcf1 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:33.545444 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-159fa872-2089-47e4-a83a-e0db41dedcf1 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:33.580404 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-159fa872-2089-47e4-a83a-e0db41dedcf1 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] HTTP exception thrown: Instance b97f61ab-18fc-4cf6-bc15-ec08ac4750fd could not be found. Oct 19 03:20:33.588722 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-159fa872-2089-47e4-a83a-e0db41dedcf1 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Request method failure captured: Oct 19 03:20:33.588722 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/b97f61ab-18fc-4cf6-bc15-ec08ac4750fd HTTP/1.1 Oct 19 03:20:33.588722 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:20:33.588722 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:20:33.588722 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:20:33.588722 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:20:33.588722 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:20:33.588722 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:20:33.588722 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:20:33.588722 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:20:33.588722 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2yU1TiVmMJOqJlwwAmlZEHt8wZDze_VxtD76CDF0CRASzSv6EqHKs-qeX7CTJr89jfwreZvEdY2ZOcsOrxEZ2ZvISug5RObJXrJKifdcx-MBjw_GmiXD_1PDZUclA0I62TyajaKDzJZdah6fGSqyEgjIEtJlX0kwL-pOeCwZsXEoRI Oct 19 03:20:33.588722 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:20:33.588722 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:20:33.588722 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:20:33.588722 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:20:33.588722 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:20:33.588722 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:20:33.588722 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 0e5d239ae4b24b7e978935fe9b3458cf Oct 19 03:20:33.588722 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-140638534 Oct 19 03:20:33.588722 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:20:33.588722 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:20:33.590597 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/0e5d239ae4b24b7e978935fe9b3458cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0e5d239ae4b24b7e978935fe9b3458cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0e5d239ae4b24b7e978935fe9b3458cf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_0e5d239ae4b24b7e978935fe9b3458cf", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:20:33.590597 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-140638534 Oct 19 03:20:33.590597 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 0e5d239ae4b24b7e978935fe9b3458cf Oct 19 03:20:33.590597 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-140638534 Oct 19 03:20:33.590597 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-FloatingIPsAssociationTestJSON-140638534-project Oct 19 03:20:33.590597 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:20:33.590597 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:20:33.590597 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: ac711151c0334c62958e7f2ec431d860 Oct 19 03:20:33.590597 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-140638534-project Oct 19 03:20:33.590597 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:20:33.590597 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance b97f61ab-18fc-4cf6-bc15-ec08ac4750fd could not be found. Oct 19 03:20:33.590597 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': 'b97f61ab-18fc-4cf6-bc15-ec08ac4750fd'} Oct 19 03:20:33.591606 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:20:33.591606 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:20:33.591606 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:20:33.591606 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:20:33.591606 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:20:33.591606 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:20:33.591606 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:20:33.591606 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:20:33.591606 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:20:33.591606 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:20:33.591606 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b97f61ab-18fc-4cf6-bc15-ec08ac4750fd could not be found. Oct 19 03:20:33.591606 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:20:33.591606 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:20:33.591606 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:20:33.591606 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:20:33.591606 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:20:33.591606 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:20:33.591606 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:20:33.591606 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:20:33.591606 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:20:33.593221 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:20:33.593221 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:20:33.593221 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:20:33.593221 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:20:33.593221 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:20:33.593221 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:20:33.593221 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:20:33.593221 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b97f61ab-18fc-4cf6-bc15-ec08ac4750fd could not be found. Oct 19 03:20:33.593221 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:20:33.593221 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:20:33.593221 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:20:33.593221 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:20:33.593221 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:20:33.593221 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:20:33.593221 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:20:33.593221 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:20:33.593221 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b97f61ab-18fc-4cf6-bc15-ec08ac4750fd could not be found. Oct 19 03:20:33.593221 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:20:33.594811 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-159fa872-2089-47e4-a83a-e0db41dedcf1 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Returning 404 to user: Instance b97f61ab-18fc-4cf6-bc15-ec08ac4750fd could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:20:33.595461 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-159fa872-2089-47e4-a83a-e0db41dedcf1 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] 10.222.0.52 "GET /compute/v2.1/servers/b97f61ab-18fc-4cf6-bc15-ec08ac4750fd" status: 404 len: 111 microversion: 2.1 time: 0.071651 Oct 19 03:20:33.596132 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1083/2096] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:20:33 2022] GET /compute/v2.1/servers/b97f61ab-18fc-4cf6-bc15-ec08ac4750fd => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:20:33.601910 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-93c8b0a7-a187-443b-a0b9-f8a4fac27633 tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:20:33.608299 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-93c8b0a7-a187-443b-a0b9-f8a4fac27633 tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Searching by: {'deleted': False} {{(pid=121135) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 03:20:33.615638 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-93c8b0a7-a187-443b-a0b9-f8a4fac27633 tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:33.616541 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-93c8b0a7-a187-443b-a0b9-f8a4fac27633 tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:33.617311 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-93c8b0a7-a187-443b-a0b9-f8a4fac27633 tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:33.618419 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-93c8b0a7-a187-443b-a0b9-f8a4fac27633 tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:33.622856 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-93c8b0a7-a187-443b-a0b9-f8a4fac27633 tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:33.622856 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-93c8b0a7-a187-443b-a0b9-f8a4fac27633 tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:33.783426 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.multi_cell_list [None req-93c8b0a7-a187-443b-a0b9-f8a4fac27633 tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Listed batch of 12 results from cell out of 1000 limit. Returned 12 total so far. {{(pid=121135) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 03:20:33.907179 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-93c8b0a7-a187-443b-a0b9-f8a4fac27633 tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:33.907851 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-93c8b0a7-a187-443b-a0b9-f8a4fac27633 tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:33.908547 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-93c8b0a7-a187-443b-a0b9-f8a4fac27633 tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:35.529947 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-93c8b0a7-a187-443b-a0b9-f8a4fac27633 tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 19294 microversion: 2.1 time: 1.932363 Oct 19 03:20:35.531650 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1084/2097] 10.222.0.52 () {58 vars in 1171 bytes} [Wed Oct 19 03:20:33 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 19294 bytes in 1935 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 03:20:35.537073 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-538aa843-1135-413c-9d92-9fc66518c585 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:20:35.542135 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-538aa843-1135-413c-9d92-9fc66518c585 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] [instance: 245ae0c1-c202-41c0-8f85-d5d99549f3ae] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:20:35.550341 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-538aa843-1135-413c-9d92-9fc66518c585 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:35.550898 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-538aa843-1135-413c-9d92-9fc66518c585 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:35.551342 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-538aa843-1135-413c-9d92-9fc66518c585 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:35.562468 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-538aa843-1135-413c-9d92-9fc66518c585 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:35.562927 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-538aa843-1135-413c-9d92-9fc66518c585 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:35.563557 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-538aa843-1135-413c-9d92-9fc66518c585 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:35.819158 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-45db789e-b735-4738-b9b3-16c406579a1c tempest-FloatingIPDetailsTestJSON-1662489570 tempest-FloatingIPDetailsTestJSON-1662489570-project] 10.222.0.52 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.163734 Oct 19 03:20:35.820519 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1014/2098] 10.222.0.52 () {60 vars in 1170 bytes} [Wed Oct 19 03:20:31 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:20:35.830616 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5f6e0bbb-9239-4f38-b9ab-c80f843dced0 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:20:35.838111 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5f6e0bbb-9239-4f38-b9ab-c80f843dced0 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] [instance: 4adec402-e94f-4a41-ac77-68f6091b87f7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:20:35.852295 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5f6e0bbb-9239-4f38-b9ab-c80f843dced0 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:35.854413 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5f6e0bbb-9239-4f38-b9ab-c80f843dced0 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:35.855087 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5f6e0bbb-9239-4f38-b9ab-c80f843dced0 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:35.856186 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5f6e0bbb-9239-4f38-b9ab-c80f843dced0 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:35.857217 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5f6e0bbb-9239-4f38-b9ab-c80f843dced0 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:35.858155 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5f6e0bbb-9239-4f38-b9ab-c80f843dced0 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:35.993849 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-538aa843-1135-413c-9d92-9fc66518c585 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8824f20e6a1f478a99f90e1ba8f028fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e436373e9e45efa03f08b33da619e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:36.026769 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-538aa843-1135-413c-9d92-9fc66518c585 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] 10.222.0.52 "GET /compute/v2.1/servers/245ae0c1-c202-41c0-8f85-d5d99549f3ae" status: 200 len: 1324 microversion: 2.1 time: 0.493487 Oct 19 03:20:36.028159 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1085/2099] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:20:35 2022] GET /compute/v2.1/servers/245ae0c1-c202-41c0-8f85-d5d99549f3ae => generated 1324 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:20:36.038570 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ba8949ee-2ef4-4b49-97b0-9ed87fecab21 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Calling method '.version_select at 0x7fc134f19550>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:20:36.565536 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5f6e0bbb-9239-4f38-b9ab-c80f843dced0 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:36.580993 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5f6e0bbb-9239-4f38-b9ab-c80f843dced0 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:36.583338 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5f6e0bbb-9239-4f38-b9ab-c80f843dced0 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:36.584923 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5f6e0bbb-9239-4f38-b9ab-c80f843dced0 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] 10.222.0.52 "GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7" status: 200 len: 1660 microversion: 2.32 time: 0.763090 Oct 19 03:20:36.585524 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1015/2100] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:20:35 2022] GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7 => generated 1660 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:20:36.590458 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-337cdfc6-877f-4d3b-8490-c4904de7fc9a tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:20:36.591138 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-337cdfc6-877f-4d3b-8490-c4904de7fc9a tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] [instance: fee1d282-ae3a-4792-ba8f-a19e498c8853] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:20:36.599029 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-337cdfc6-877f-4d3b-8490-c4904de7fc9a tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:36.599862 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-337cdfc6-877f-4d3b-8490-c4904de7fc9a tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:36.601467 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-337cdfc6-877f-4d3b-8490-c4904de7fc9a tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:36.602440 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-337cdfc6-877f-4d3b-8490-c4904de7fc9a tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:36.603138 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-337cdfc6-877f-4d3b-8490-c4904de7fc9a tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:36.603807 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-337cdfc6-877f-4d3b-8490-c4904de7fc9a tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:36.623943 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=89,nova_cell1:SAVEPOINT=3,nova_cell1:UPDATE=4,nova_cell1:RELEASE=3,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:20:36.966877 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-337cdfc6-877f-4d3b-8490-c4904de7fc9a tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '152fa52a83b14c71bf86b22d77a73625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1606da859950484e9aa949e5c59c0a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:36.976116 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-337cdfc6-877f-4d3b-8490-c4904de7fc9a tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] 10.222.0.52 "GET /compute/v2.1/servers/fee1d282-ae3a-4792-ba8f-a19e498c8853" status: 200 len: 1518 microversion: 2.1 time: 0.389198 Oct 19 03:20:36.977068 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1016/2101] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:20:36 2022] GET /compute/v2.1/servers/fee1d282-ae3a-4792-ba8f-a19e498c8853 => generated 1518 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:20:36.982532 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-88fe4aab-6bbc-455a-b01f-eacd202ba630 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:20:36.983414 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-88fe4aab-6bbc-455a-b01f-eacd202ba630 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 074f3469-3bbd-46df-8286-3a57f91798e2] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:20:36.990680 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-88fe4aab-6bbc-455a-b01f-eacd202ba630 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:36.991578 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-88fe4aab-6bbc-455a-b01f-eacd202ba630 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:36.992263 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-88fe4aab-6bbc-455a-b01f-eacd202ba630 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:36.998610 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-88fe4aab-6bbc-455a-b01f-eacd202ba630 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:36.999435 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-88fe4aab-6bbc-455a-b01f-eacd202ba630 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:37.000130 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-88fe4aab-6bbc-455a-b01f-eacd202ba630 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:37.360691 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-88fe4aab-6bbc-455a-b01f-eacd202ba630 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:37.370560 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-88fe4aab-6bbc-455a-b01f-eacd202ba630 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:37.372003 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-88fe4aab-6bbc-455a-b01f-eacd202ba630 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:37.373485 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-88fe4aab-6bbc-455a-b01f-eacd202ba630 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/074f3469-3bbd-46df-8286-3a57f91798e2" status: 200 len: 1250 microversion: 2.25 time: 0.395123 Oct 19 03:20:37.374059 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1017/2102] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:20:36 2022] GET /compute/v2.1/servers/074f3469-3bbd-46df-8286-3a57f91798e2 => generated 1250 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:20:37.379993 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-38fa777f-ad4e-450b-861f-b2a49cc8ce93 req-98e1f98c-495a-4e46-8d69-2ca01a86c29d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "245ae0c1-c202-41c0-8f85-d5d99549f3ae", "name": "network-vif-plugged", "status": "completed", "tag": "59e53e31-1407-44d1-8ec2-153ae5c03e55"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:20:37.404036 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-38fa777f-ad4e-450b-861f-b2a49cc8ce93 req-98e1f98c-495a-4e46-8d69-2ca01a86c29d service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:37.404569 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-38fa777f-ad4e-450b-861f-b2a49cc8ce93 req-98e1f98c-495a-4e46-8d69-2ca01a86c29d service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:37.405053 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-38fa777f-ad4e-450b-861f-b2a49cc8ce93 req-98e1f98c-495a-4e46-8d69-2ca01a86c29d service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:37.419565 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-38fa777f-ad4e-450b-861f-b2a49cc8ce93 req-98e1f98c-495a-4e46-8d69-2ca01a86c29d service nova] Creating event network-vif-plugged:59e53e31-1407-44d1-8ec2-153ae5c03e55 for instance 245ae0c1-c202-41c0-8f85-d5d99549f3ae on n-h2-861333-8 Oct 19 03:20:37.424909 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-38fa777f-ad4e-450b-861f-b2a49cc8ce93 req-98e1f98c-495a-4e46-8d69-2ca01a86c29d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049194 Oct 19 03:20:37.426663 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1018/2103] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:20:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:20:37.435758 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-501bf0ec-616d-4952-88ca-98faf89d3cbd tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:20:37.441623 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-501bf0ec-616d-4952-88ca-98faf89d3cbd tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Searching by: {'deleted': False, 'project_id': '94561439644343ebbb72d4759213f799'} {{(pid=121134) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 03:20:37.447713 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-501bf0ec-616d-4952-88ca-98faf89d3cbd tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:37.448206 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-501bf0ec-616d-4952-88ca-98faf89d3cbd tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:37.449008 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-501bf0ec-616d-4952-88ca-98faf89d3cbd tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:37.449440 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-501bf0ec-616d-4952-88ca-98faf89d3cbd tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:37.449923 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-501bf0ec-616d-4952-88ca-98faf89d3cbd tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:37.450412 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-501bf0ec-616d-4952-88ca-98faf89d3cbd tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:37.503705 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-501bf0ec-616d-4952-88ca-98faf89d3cbd tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/detail?tenant_id=c9a495ccfced47f29cb928d1ded20d85" status: 200 len: 15 microversion: 2.1 time: 0.072982 Oct 19 03:20:37.517942 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1019/2104] 10.222.0.52 () {58 vars in 1231 bytes} [Wed Oct 19 03:20:37 2022] GET /compute/v2.1/servers/detail?tenant_id=c9a495ccfced47f29cb928d1ded20d85 => generated 15 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 03:20:37.517942 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5074aa30-f9ae-4844-9e93-be2338cc7e23 tempest-FloatingIPDetailsTestJSON-1662489570 tempest-FloatingIPDetailsTestJSON-1662489570-project] Action: 'create', calling method: .version_select at 0x7fc1303e3dc0>, body: {"pool": null} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:20:38.643728 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ba8949ee-2ef4-4b49-97b0-9ed87fecab21 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] 10.222.0.52 "DELETE /compute/v2.1/os-floating-ips/1ee12215-2114-435c-bef8-069797c3dd90" status: 202 len: 0 microversion: 2.1 time: 2.611847 Oct 19 03:20:38.643728 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1086/2105] 10.222.0.52 () {58 vars in 1263 bytes} [Wed Oct 19 03:20:36 2022] DELETE /compute/v2.1/os-floating-ips/1ee12215-2114-435c-bef8-069797c3dd90 => generated 0 bytes in 2613 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:20:38.649928 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f031a70f-7034-43d3-be9d-ded7e08a2a68 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:20:38.652224 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f031a70f-7034-43d3-be9d-ded7e08a2a68 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] [instance: fee1d282-ae3a-4792-ba8f-a19e498c8853] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:20:38.658412 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f031a70f-7034-43d3-be9d-ded7e08a2a68 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:38.659317 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f031a70f-7034-43d3-be9d-ded7e08a2a68 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:38.660108 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f031a70f-7034-43d3-be9d-ded7e08a2a68 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:38.661989 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f031a70f-7034-43d3-be9d-ded7e08a2a68 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:38.662672 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f031a70f-7034-43d3-be9d-ded7e08a2a68 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:38.666127 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f031a70f-7034-43d3-be9d-ded7e08a2a68 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:38.695814 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-f031a70f-7034-43d3-be9d-ded7e08a2a68 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lazy-loading 'flavor' on Instance uuid fee1d282-ae3a-4792-ba8f-a19e498c8853 {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:20:39.056356 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f031a70f-7034-43d3-be9d-ded7e08a2a68 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] 10.222.0.52 "POST /compute/v2.1/servers/fee1d282-ae3a-4792-ba8f-a19e498c8853/action" status: 200 len: 32 microversion: 2.1 time: 0.410642 Oct 19 03:20:39.057080 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1087/2106] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:20:38 2022] POST /compute/v2.1/servers/fee1d282-ae3a-4792-ba8f-a19e498c8853/action => generated 32 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 03:20:39.062655 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0c024539-8d17-48c4-ae3f-e3fedb534660 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:20:39.064908 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0c024539-8d17-48c4-ae3f-e3fedb534660 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] [instance: 245ae0c1-c202-41c0-8f85-d5d99549f3ae] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:20:39.072027 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0c024539-8d17-48c4-ae3f-e3fedb534660 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:39.072929 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0c024539-8d17-48c4-ae3f-e3fedb534660 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:39.073682 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0c024539-8d17-48c4-ae3f-e3fedb534660 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:39.074617 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0c024539-8d17-48c4-ae3f-e3fedb534660 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:39.075288 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0c024539-8d17-48c4-ae3f-e3fedb534660 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:39.075952 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0c024539-8d17-48c4-ae3f-e3fedb534660 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:39.363596 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-0c024539-8d17-48c4-ae3f-e3fedb534660 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8824f20e6a1f478a99f90e1ba8f028fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e436373e9e45efa03f08b33da619e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:39.373200 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0c024539-8d17-48c4-ae3f-e3fedb534660 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] 10.222.0.52 "GET /compute/v2.1/servers/245ae0c1-c202-41c0-8f85-d5d99549f3ae" status: 200 len: 1324 microversion: 2.1 time: 0.314463 Oct 19 03:20:39.386822 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1088/2107] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:20:39 2022] GET /compute/v2.1/servers/245ae0c1-c202-41c0-8f85-d5d99549f3ae => generated 1324 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:20:39.397090 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4cfb73d8-7b82-479b-90b8-8fad22e9f616 tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:20:39.407007 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4cfb73d8-7b82-479b-90b8-8fad22e9f616 tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Searching by: {'tenant_id': 'c9a495ccfced47f29cb928d1ded20d85', 'deleted': False} {{(pid=121135) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 03:20:39.413558 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4cfb73d8-7b82-479b-90b8-8fad22e9f616 tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:39.414489 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4cfb73d8-7b82-479b-90b8-8fad22e9f616 tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:39.415348 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4cfb73d8-7b82-479b-90b8-8fad22e9f616 tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:39.416467 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4cfb73d8-7b82-479b-90b8-8fad22e9f616 tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:39.417406 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4cfb73d8-7b82-479b-90b8-8fad22e9f616 tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:39.418096 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4cfb73d8-7b82-479b-90b8-8fad22e9f616 tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:39.423728 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=13 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:20:39.455388 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.multi_cell_list [None req-4cfb73d8-7b82-479b-90b8-8fad22e9f616 tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=121135) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 03:20:39.798864 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=37 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:20:39.817493 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4cfb73d8-7b82-479b-90b8-8fad22e9f616 tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:39.818570 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4cfb73d8-7b82-479b-90b8-8fad22e9f616 tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:39.819306 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4cfb73d8-7b82-479b-90b8-8fad22e9f616 tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:40.239138 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4cfb73d8-7b82-479b-90b8-8fad22e9f616 tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=c9a495ccfced47f29cb928d1ded20d85" status: 200 len: 4826 microversion: 2.1 time: 0.849840 Oct 19 03:20:40.251038 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1089/2108] 10.222.0.52 () {58 vars in 1257 bytes} [Wed Oct 19 03:20:39 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=c9a495ccfced47f29cb928d1ded20d85 => generated 4826 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:20:40.251038 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d7be5d0f-e932-4746-9247-9824db631bc4 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:20:40.251038 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d7be5d0f-e932-4746-9247-9824db631bc4 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] [instance: 4adec402-e94f-4a41-ac77-68f6091b87f7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:20:40.254618 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d7be5d0f-e932-4746-9247-9824db631bc4 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:40.255355 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d7be5d0f-e932-4746-9247-9824db631bc4 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:40.256481 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d7be5d0f-e932-4746-9247-9824db631bc4 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:40.257261 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d7be5d0f-e932-4746-9247-9824db631bc4 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:40.257855 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d7be5d0f-e932-4746-9247-9824db631bc4 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:40.258381 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d7be5d0f-e932-4746-9247-9824db631bc4 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:40.572414 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d7be5d0f-e932-4746-9247-9824db631bc4 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:40.582875 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d7be5d0f-e932-4746-9247-9824db631bc4 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:40.584260 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d7be5d0f-e932-4746-9247-9824db631bc4 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:40.586023 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d7be5d0f-e932-4746-9247-9824db631bc4 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] 10.222.0.52 "GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7" status: 200 len: 1752 microversion: 2.32 time: 0.344662 Oct 19 03:20:40.586175 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1090/2109] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:20:40 2022] GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7 => generated 1752 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:20:40.590858 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6d00af6c-12cf-418b-8b7a-30e09890c4f7 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:20:40.591587 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6d00af6c-12cf-418b-8b7a-30e09890c4f7 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 074f3469-3bbd-46df-8286-3a57f91798e2] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:20:40.598164 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6d00af6c-12cf-418b-8b7a-30e09890c4f7 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:40.598660 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6d00af6c-12cf-418b-8b7a-30e09890c4f7 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:40.599098 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6d00af6c-12cf-418b-8b7a-30e09890c4f7 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:40.599888 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6d00af6c-12cf-418b-8b7a-30e09890c4f7 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:40.600340 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6d00af6c-12cf-418b-8b7a-30e09890c4f7 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:40.600772 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6d00af6c-12cf-418b-8b7a-30e09890c4f7 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:41.015402 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-6d00af6c-12cf-418b-8b7a-30e09890c4f7 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:41.025516 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-6d00af6c-12cf-418b-8b7a-30e09890c4f7 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:41.027213 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-6d00af6c-12cf-418b-8b7a-30e09890c4f7 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:41.028937 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6d00af6c-12cf-418b-8b7a-30e09890c4f7 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/074f3469-3bbd-46df-8286-3a57f91798e2" status: 200 len: 1292 microversion: 2.25 time: 0.441349 Oct 19 03:20:41.042260 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1091/2110] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:20:40 2022] GET /compute/v2.1/servers/074f3469-3bbd-46df-8286-3a57f91798e2 => generated 1292 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:20:41.047753 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-73d8cdec-b70a-4b75-a123-d7f11cbc9da0 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:20:41.048327 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-73d8cdec-b70a-4b75-a123-d7f11cbc9da0 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] [instance: bcf14e6a-ecdc-40c0-b76b-678a1bb14828] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:20:41.054773 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-73d8cdec-b70a-4b75-a123-d7f11cbc9da0 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:41.055275 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-73d8cdec-b70a-4b75-a123-d7f11cbc9da0 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:41.055725 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-73d8cdec-b70a-4b75-a123-d7f11cbc9da0 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:41.058203 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-73d8cdec-b70a-4b75-a123-d7f11cbc9da0 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:41.058812 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-73d8cdec-b70a-4b75-a123-d7f11cbc9da0 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:41.059263 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-73d8cdec-b70a-4b75-a123-d7f11cbc9da0 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:41.087410 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-73d8cdec-b70a-4b75-a123-d7f11cbc9da0 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] [instance: bcf14e6a-ecdc-40c0-b76b-678a1bb14828] Going to try to terminate instance {{(pid=121135) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:20:41.505518 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-73d8cdec-b70a-4b75-a123-d7f11cbc9da0 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] 10.222.0.52 "DELETE /compute/v2.1/servers/bcf14e6a-ecdc-40c0-b76b-678a1bb14828" status: 204 len: 0 microversion: 2.1 time: 0.461722 Oct 19 03:20:41.509540 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1092/2111] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:20:41 2022] DELETE /compute/v2.1/servers/bcf14e6a-ecdc-40c0-b76b-678a1bb14828 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:20:41.509979 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5074aa30-f9ae-4844-9e93-be2338cc7e23 tempest-FloatingIPDetailsTestJSON-1662489570 tempest-FloatingIPDetailsTestJSON-1662489570-project] 10.222.0.52 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.003407 Oct 19 03:20:41.510768 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1020/2112] 10.222.0.52 () {60 vars in 1170 bytes} [Wed Oct 19 03:20:37 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4005 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:20:41.515320 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-bb02d6e0-513e-4b07-88a6-31b3b80e8338 tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:20:41.520958 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-97ecbeb4-00e2-49e5-addb-394a4b1dd1ac tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:20:41.521929 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-97ecbeb4-00e2-49e5-addb-394a4b1dd1ac tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] [instance: fee1d282-ae3a-4792-ba8f-a19e498c8853] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:20:41.522251 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-bb02d6e0-513e-4b07-88a6-31b3b80e8338 tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Searching by: {'tenant_id': '94561439644343ebbb72d4759213f799', 'deleted': False} {{(pid=121134) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 03:20:41.523969 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:20:41.528322 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bb02d6e0-513e-4b07-88a6-31b3b80e8338 tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:41.530398 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bb02d6e0-513e-4b07-88a6-31b3b80e8338 tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:41.530398 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bb02d6e0-513e-4b07-88a6-31b3b80e8338 tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:41.530398 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bb02d6e0-513e-4b07-88a6-31b3b80e8338 tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:41.530725 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bb02d6e0-513e-4b07-88a6-31b3b80e8338 tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:41.531205 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bb02d6e0-513e-4b07-88a6-31b3b80e8338 tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:41.531362 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-97ecbeb4-00e2-49e5-addb-394a4b1dd1ac tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:41.532081 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-97ecbeb4-00e2-49e5-addb-394a4b1dd1ac tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:41.532522 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-97ecbeb4-00e2-49e5-addb-394a4b1dd1ac tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:41.533261 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-97ecbeb4-00e2-49e5-addb-394a4b1dd1ac tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:41.533756 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-97ecbeb4-00e2-49e5-addb-394a4b1dd1ac tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:41.534189 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-97ecbeb4-00e2-49e5-addb-394a4b1dd1ac tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:41.566978 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-bb02d6e0-513e-4b07-88a6-31b3b80e8338 tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=94561439644343ebbb72d4759213f799" status: 200 len: 15 microversion: 2.1 time: 0.054433 Oct 19 03:20:41.567911 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1021/2113] 10.222.0.52 () {58 vars in 1257 bytes} [Wed Oct 19 03:20:41 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=94561439644343ebbb72d4759213f799 => generated 15 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 03:20:41.573296 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9d11b8a9-10c5-49c2-9c00-013e789fdb15 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:20:41.574420 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9d11b8a9-10c5-49c2-9c00-013e789fdb15 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] [instance: 245ae0c1-c202-41c0-8f85-d5d99549f3ae] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:20:41.582127 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9d11b8a9-10c5-49c2-9c00-013e789fdb15 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:41.583014 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9d11b8a9-10c5-49c2-9c00-013e789fdb15 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:41.593639 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9d11b8a9-10c5-49c2-9c00-013e789fdb15 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:41.594826 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9d11b8a9-10c5-49c2-9c00-013e789fdb15 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:41.595853 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9d11b8a9-10c5-49c2-9c00-013e789fdb15 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:41.595853 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9d11b8a9-10c5-49c2-9c00-013e789fdb15 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:42.191355 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-97ecbeb4-00e2-49e5-addb-394a4b1dd1ac tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '152fa52a83b14c71bf86b22d77a73625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1606da859950484e9aa949e5c59c0a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:42.195183 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:20:42.200476 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9d11b8a9-10c5-49c2-9c00-013e789fdb15 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8824f20e6a1f478a99f90e1ba8f028fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e436373e9e45efa03f08b33da619e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:42.203659 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-97ecbeb4-00e2-49e5-addb-394a4b1dd1ac tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] 10.222.0.52 "GET /compute/v2.1/servers/fee1d282-ae3a-4792-ba8f-a19e498c8853" status: 200 len: 1524 microversion: 2.1 time: 0.695258 Oct 19 03:20:42.211894 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9d11b8a9-10c5-49c2-9c00-013e789fdb15 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] 10.222.0.52 "GET /compute/v2.1/servers/245ae0c1-c202-41c0-8f85-d5d99549f3ae" status: 200 len: 1520 microversion: 2.1 time: 0.642022 Oct 19 03:20:42.217939 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1093/2114] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:20:41 2022] GET /compute/v2.1/servers/fee1d282-ae3a-4792-ba8f-a19e498c8853 => generated 1524 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:20:42.228229 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1022/2115] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:20:41 2022] GET /compute/v2.1/servers/245ae0c1-c202-41c0-8f85-d5d99549f3ae => generated 1520 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:20:42.229000 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-bfeeb775-38cc-404e-8150-299f945fa9f5 req-b94df5c4-f10f-4d5a-b9a2-d1ada6d4ae6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "074f3469-3bbd-46df-8286-3a57f91798e2", "tag": "44f53eb4-50b1-4764-8a1c-143764a0a324"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:20:42.237320 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-42472798-e9fa-4632-91b3-2c818a61b736 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:20:42.240263 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-42472798-e9fa-4632-91b3-2c818a61b736 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] [instance: bcf14e6a-ecdc-40c0-b76b-678a1bb14828] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:20:42.246525 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-bfeeb775-38cc-404e-8150-299f945fa9f5 req-b94df5c4-f10f-4d5a-b9a2-d1ada6d4ae6d service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:42.247447 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-42472798-e9fa-4632-91b3-2c818a61b736 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:42.247582 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-bfeeb775-38cc-404e-8150-299f945fa9f5 req-b94df5c4-f10f-4d5a-b9a2-d1ada6d4ae6d service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:42.248159 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-bfeeb775-38cc-404e-8150-299f945fa9f5 req-b94df5c4-f10f-4d5a-b9a2-d1ada6d4ae6d service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:42.248333 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-42472798-e9fa-4632-91b3-2c818a61b736 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:42.248867 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-42472798-e9fa-4632-91b3-2c818a61b736 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:42.249686 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-42472798-e9fa-4632-91b3-2c818a61b736 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:42.250213 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-42472798-e9fa-4632-91b3-2c818a61b736 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:42.250862 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-42472798-e9fa-4632-91b3-2c818a61b736 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:42.263607 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-bfeeb775-38cc-404e-8150-299f945fa9f5 req-b94df5c4-f10f-4d5a-b9a2-d1ada6d4ae6d service nova] Creating event network-changed:44f53eb4-50b1-4764-8a1c-143764a0a324 for instance 074f3469-3bbd-46df-8286-3a57f91798e2 on n-h1-861333-8 Oct 19 03:20:42.270427 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-bfeeb775-38cc-404e-8150-299f945fa9f5 req-b94df5c4-f10f-4d5a-b9a2-d1ada6d4ae6d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051173 Oct 19 03:20:42.271454 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1094/2116] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:20:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:20:42.278882 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5ae6f835-7077-42a2-a1a0-9c62d9ab4798 tempest-FloatingIPDetailsTestJSON-1662489570 tempest-FloatingIPDetailsTestJSON-1662489570-project] Action: 'create', calling method: .version_select at 0x7fc1305f4430>, body: {"pool": null} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:20:42.579392 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-42472798-e9fa-4632-91b3-2c818a61b736 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac711151c0334c62958e7f2ec431d860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5d239ae4b24b7e978935fe9b3458cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:42.587639 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-42472798-e9fa-4632-91b3-2c818a61b736 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] 10.222.0.52 "GET /compute/v2.1/servers/bcf14e6a-ecdc-40c0-b76b-678a1bb14828" status: 200 len: 1525 microversion: 2.1 time: 0.358213 Oct 19 03:20:42.588493 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1023/2117] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:20:42 2022] GET /compute/v2.1/servers/bcf14e6a-ecdc-40c0-b76b-678a1bb14828 => generated 1525 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:20:42.593646 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6de88b00-2ed3-4fea-9ac8-90c57a998d96 tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:20:42.599549 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6de88b00-2ed3-4fea-9ac8-90c57a998d96 tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.009775 Oct 19 03:20:42.600780 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1024/2118] 10.222.0.52 () {58 vars in 1189 bytes} [Wed Oct 19 03:20:42 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 03:20:42.606282 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5f91e035-e0c4-4b51-9a8d-0fd0e9e54126 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:20:42.609574 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5f91e035-e0c4-4b51-9a8d-0fd0e9e54126 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] [instance: 4adec402-e94f-4a41-ac77-68f6091b87f7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:20:42.614556 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5f91e035-e0c4-4b51-9a8d-0fd0e9e54126 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:42.615405 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5f91e035-e0c4-4b51-9a8d-0fd0e9e54126 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:42.616095 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5f91e035-e0c4-4b51-9a8d-0fd0e9e54126 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:42.617062 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5f91e035-e0c4-4b51-9a8d-0fd0e9e54126 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:42.617791 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5f91e035-e0c4-4b51-9a8d-0fd0e9e54126 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:42.618452 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5f91e035-e0c4-4b51-9a8d-0fd0e9e54126 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:43.018096 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5f91e035-e0c4-4b51-9a8d-0fd0e9e54126 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:43.028311 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5f91e035-e0c4-4b51-9a8d-0fd0e9e54126 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:43.030611 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5f91e035-e0c4-4b51-9a8d-0fd0e9e54126 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:43.032030 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5f91e035-e0c4-4b51-9a8d-0fd0e9e54126 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] 10.222.0.52 "GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7" status: 200 len: 1798 microversion: 2.32 time: 0.429834 Oct 19 03:20:43.033441 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1025/2119] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:20:42 2022] GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7 => generated 1798 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:20:43.038578 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-bab6aaa3-76a0-4121-9295-91ed2d3203d9 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:20:43.039458 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-bab6aaa3-76a0-4121-9295-91ed2d3203d9 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 074f3469-3bbd-46df-8286-3a57f91798e2] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:20:43.046837 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bab6aaa3-76a0-4121-9295-91ed2d3203d9 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:43.047679 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bab6aaa3-76a0-4121-9295-91ed2d3203d9 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:43.048357 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bab6aaa3-76a0-4121-9295-91ed2d3203d9 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:43.049278 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bab6aaa3-76a0-4121-9295-91ed2d3203d9 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:43.050024 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bab6aaa3-76a0-4121-9295-91ed2d3203d9 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:43.051177 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bab6aaa3-76a0-4121-9295-91ed2d3203d9 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:43.451677 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-bab6aaa3-76a0-4121-9295-91ed2d3203d9 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:43.461484 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-bab6aaa3-76a0-4121-9295-91ed2d3203d9 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:43.468367 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-bab6aaa3-76a0-4121-9295-91ed2d3203d9 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:43.469568 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-bab6aaa3-76a0-4121-9295-91ed2d3203d9 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/074f3469-3bbd-46df-8286-3a57f91798e2" status: 200 len: 1292 microversion: 2.25 time: 0.434873 Oct 19 03:20:43.471155 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1026/2120] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:20:43 2022] GET /compute/v2.1/servers/074f3469-3bbd-46df-8286-3a57f91798e2 => generated 1292 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:20:43.479439 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-41b196ee-4aaa-433c-8b62-ea3e6e6d36b7 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:20:43.489102 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-41b196ee-4aaa-433c-8b62-ea3e6e6d36b7 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] [instance: 245ae0c1-c202-41c0-8f85-d5d99549f3ae] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:20:43.492662 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-41b196ee-4aaa-433c-8b62-ea3e6e6d36b7 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:43.494051 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-41b196ee-4aaa-433c-8b62-ea3e6e6d36b7 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:43.494505 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-41b196ee-4aaa-433c-8b62-ea3e6e6d36b7 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:43.495218 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-41b196ee-4aaa-433c-8b62-ea3e6e6d36b7 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:43.495674 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-41b196ee-4aaa-433c-8b62-ea3e6e6d36b7 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:43.496099 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-41b196ee-4aaa-433c-8b62-ea3e6e6d36b7 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:43.879327 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-41b196ee-4aaa-433c-8b62-ea3e6e6d36b7 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8824f20e6a1f478a99f90e1ba8f028fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e436373e9e45efa03f08b33da619e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:43.889686 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-41b196ee-4aaa-433c-8b62-ea3e6e6d36b7 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] 10.222.0.52 "GET /compute/v2.1/servers/245ae0c1-c202-41c0-8f85-d5d99549f3ae" status: 200 len: 1520 microversion: 2.1 time: 0.417166 Oct 19 03:20:43.901879 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1027/2121] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:20:43 2022] GET /compute/v2.1/servers/245ae0c1-c202-41c0-8f85-d5d99549f3ae => generated 1520 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:20:43.905888 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5d9fada0-d433-4427-8bb9-2517744f10a5 tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:20:43.912635 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5d9fada0-d433-4427-8bb9-2517744f10a5 tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] [instance: 6888c8db-82ba-4072-b431-8d4fcf5f03e0] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:20:43.918664 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5d9fada0-d433-4427-8bb9-2517744f10a5 tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:43.919213 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5d9fada0-d433-4427-8bb9-2517744f10a5 tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:43.919666 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5d9fada0-d433-4427-8bb9-2517744f10a5 tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:43.920377 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5d9fada0-d433-4427-8bb9-2517744f10a5 tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:43.920838 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5d9fada0-d433-4427-8bb9-2517744f10a5 tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:43.921270 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5d9fada0-d433-4427-8bb9-2517744f10a5 tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:44.446809 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5d9fada0-d433-4427-8bb9-2517744f10a5 tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/6888c8db-82ba-4072-b431-8d4fcf5f03e0/action" status: 202 len: 0 microversion: 2.1 time: 0.546453 Oct 19 03:20:44.450746 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1028/2122] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:20:43 2022] POST /compute/v2.1/servers/6888c8db-82ba-4072-b431-8d4fcf5f03e0/action => generated 0 bytes in 551 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:20:44.455897 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c8ccd58d-0e34-428e-986f-5bbe2e2ffac0 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:20:44.457162 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c8ccd58d-0e34-428e-986f-5bbe2e2ffac0 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] [instance: fee1d282-ae3a-4792-ba8f-a19e498c8853] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:20:44.463515 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c8ccd58d-0e34-428e-986f-5bbe2e2ffac0 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:44.464092 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c8ccd58d-0e34-428e-986f-5bbe2e2ffac0 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:44.464640 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c8ccd58d-0e34-428e-986f-5bbe2e2ffac0 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:44.465480 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c8ccd58d-0e34-428e-986f-5bbe2e2ffac0 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:44.465999 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c8ccd58d-0e34-428e-986f-5bbe2e2ffac0 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:44.466507 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c8ccd58d-0e34-428e-986f-5bbe2e2ffac0 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:44.842204 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c8ccd58d-0e34-428e-986f-5bbe2e2ffac0 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '152fa52a83b14c71bf86b22d77a73625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1606da859950484e9aa949e5c59c0a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:44.854341 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c8ccd58d-0e34-428e-986f-5bbe2e2ffac0 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] 10.222.0.52 "GET /compute/v2.1/servers/fee1d282-ae3a-4792-ba8f-a19e498c8853" status: 200 len: 1524 microversion: 2.1 time: 0.401996 Oct 19 03:20:44.857151 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1029/2123] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:20:44 2022] GET /compute/v2.1/servers/fee1d282-ae3a-4792-ba8f-a19e498c8853 => generated 1524 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:20:44.864928 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b499b292-17eb-4380-8882-5a1b9c711341 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:20:44.866111 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b499b292-17eb-4380-8882-5a1b9c711341 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] [instance: bcf14e6a-ecdc-40c0-b76b-678a1bb14828] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:20:44.884625 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b499b292-17eb-4380-8882-5a1b9c711341 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:44.885341 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b499b292-17eb-4380-8882-5a1b9c711341 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:44.885787 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b499b292-17eb-4380-8882-5a1b9c711341 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:44.886512 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b499b292-17eb-4380-8882-5a1b9c711341 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:44.887680 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b499b292-17eb-4380-8882-5a1b9c711341 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:44.888130 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b499b292-17eb-4380-8882-5a1b9c711341 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:44.939006 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b499b292-17eb-4380-8882-5a1b9c711341 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:44.939671 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b499b292-17eb-4380-8882-5a1b9c711341 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:44.940204 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b499b292-17eb-4380-8882-5a1b9c711341 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:44.942442 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-b499b292-17eb-4380-8882-5a1b9c711341 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lazy-loading 'fault' on Instance uuid bcf14e6a-ecdc-40c0-b76b-678a1bb14828 {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:20:45.006126 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b499b292-17eb-4380-8882-5a1b9c711341 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac711151c0334c62958e7f2ec431d860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5d239ae4b24b7e978935fe9b3458cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:45.015438 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b499b292-17eb-4380-8882-5a1b9c711341 tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] 10.222.0.52 "GET /compute/v2.1/servers/bcf14e6a-ecdc-40c0-b76b-678a1bb14828" status: 200 len: 1313 microversion: 2.1 time: 0.156256 Oct 19 03:20:45.016546 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1030/2124] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:20:44 2022] GET /compute/v2.1/servers/bcf14e6a-ecdc-40c0-b76b-678a1bb14828 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:20:45.022201 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-2021d1ca-2cf0-4cec-9d06-94768084b9bb req-3ae4a5e5-2185-4ed4-b1bd-b6b64c7dd5e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcf14e6a-ecdc-40c0-b76b-678a1bb14828", "name": "network-vif-deleted", "tag": "2e33b971-5f4b-4979-8038-bf99f7338ba3"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:20:45.039879 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-2021d1ca-2cf0-4cec-9d06-94768084b9bb req-3ae4a5e5-2185-4ed4-b1bd-b6b64c7dd5e3 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:45.039879 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-2021d1ca-2cf0-4cec-9d06-94768084b9bb req-3ae4a5e5-2185-4ed4-b1bd-b6b64c7dd5e3 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:45.039879 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-2021d1ca-2cf0-4cec-9d06-94768084b9bb req-3ae4a5e5-2185-4ed4-b1bd-b6b64c7dd5e3 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:45.052232 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-2021d1ca-2cf0-4cec-9d06-94768084b9bb req-3ae4a5e5-2185-4ed4-b1bd-b6b64c7dd5e3 service nova] Creating event network-vif-deleted:2e33b971-5f4b-4979-8038-bf99f7338ba3 for instance bcf14e6a-ecdc-40c0-b76b-678a1bb14828 on n-h2-861333-8 Oct 19 03:20:45.058301 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-2021d1ca-2cf0-4cec-9d06-94768084b9bb req-3ae4a5e5-2185-4ed4-b1bd-b6b64c7dd5e3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039329 Oct 19 03:20:45.059316 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1031/2125] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:20:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:20:45.064860 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-483741b2-e9e2-4596-8279-3cfa5ffa4b55 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1098977062"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:20:45.068097 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-483741b2-e9e2-4596-8279-3cfa5ffa4b55 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] [instance: 245ae0c1-c202-41c0-8f85-d5d99549f3ae] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:20:45.075189 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-483741b2-e9e2-4596-8279-3cfa5ffa4b55 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:45.075925 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-483741b2-e9e2-4596-8279-3cfa5ffa4b55 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:45.077809 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-483741b2-e9e2-4596-8279-3cfa5ffa4b55 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:45.082649 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-483741b2-e9e2-4596-8279-3cfa5ffa4b55 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:45.083229 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-483741b2-e9e2-4596-8279-3cfa5ffa4b55 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:45.089675 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-483741b2-e9e2-4596-8279-3cfa5ffa4b55 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:45.643717 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-483741b2-e9e2-4596-8279-3cfa5ffa4b55 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] 10.222.0.52 "POST /compute/v2.1/servers/245ae0c1-c202-41c0-8f85-d5d99549f3ae/action" status: 202 len: 0 microversion: 2.1 time: 0.582398 Oct 19 03:20:45.651588 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1032/2126] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:20:45 2022] POST /compute/v2.1/servers/245ae0c1-c202-41c0-8f85-d5d99549f3ae/action => generated 0 bytes in 591 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 19 03:20:45.669004 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-45df2c07-4f35-45e9-abf5-30841e577109 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:20:45.669921 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-45df2c07-4f35-45e9-abf5-30841e577109 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] [instance: 4adec402-e94f-4a41-ac77-68f6091b87f7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:20:45.678218 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-45df2c07-4f35-45e9-abf5-30841e577109 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:45.678859 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-45df2c07-4f35-45e9-abf5-30841e577109 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:45.679455 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-45df2c07-4f35-45e9-abf5-30841e577109 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:45.680177 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-45df2c07-4f35-45e9-abf5-30841e577109 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:45.680819 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-45df2c07-4f35-45e9-abf5-30841e577109 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:45.681265 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-45df2c07-4f35-45e9-abf5-30841e577109 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:45.959870 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5ae6f835-7077-42a2-a1a0-9c62d9ab4798 tempest-FloatingIPDetailsTestJSON-1662489570 tempest-FloatingIPDetailsTestJSON-1662489570-project] 10.222.0.52 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.686169 Oct 19 03:20:45.962067 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1095/2127] 10.222.0.52 () {60 vars in 1170 bytes} [Wed Oct 19 03:20:42 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3690 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:20:45.971008 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-63806263-cd10-4fe4-8331-f020896267da tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:20:45.977181 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-63806263-cd10-4fe4-8331-f020896267da tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ce4c5e4123c44508a5d4911a17c44231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a495ccfced47f29cb928d1ded20d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:45.978272 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-63806263-cd10-4fe4-8331-f020896267da tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': 'c9a495ccfced47f29cb928d1ded20d85'} {{(pid=121135) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 03:20:45.988545 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-45df2c07-4f35-45e9-abf5-30841e577109 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:45.995354 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-63806263-cd10-4fe4-8331-f020896267da tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:45.996351 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-63806263-cd10-4fe4-8331-f020896267da tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:45.997327 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-63806263-cd10-4fe4-8331-f020896267da tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:45.998681 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-63806263-cd10-4fe4-8331-f020896267da tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:45.998917 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-45df2c07-4f35-45e9-abf5-30841e577109 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:45.999777 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-63806263-cd10-4fe4-8331-f020896267da tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:46.000674 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-45df2c07-4f35-45e9-abf5-30841e577109 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:46.000940 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-63806263-cd10-4fe4-8331-f020896267da tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:46.003077 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-45df2c07-4f35-45e9-abf5-30841e577109 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] 10.222.0.52 "GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7" status: 200 len: 1844 microversion: 2.32 time: 0.350735 Oct 19 03:20:46.014428 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1033/2128] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:20:45 2022] GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7 => generated 1844 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:20:46.015218 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3f557d37-e011-4139-a6e6-54c5bf608428 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:20:46.017965 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3f557d37-e011-4139-a6e6-54c5bf608428 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 074f3469-3bbd-46df-8286-3a57f91798e2] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:20:46.034498 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3f557d37-e011-4139-a6e6-54c5bf608428 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:46.036049 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3f557d37-e011-4139-a6e6-54c5bf608428 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:46.037529 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3f557d37-e011-4139-a6e6-54c5bf608428 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:46.039633 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3f557d37-e011-4139-a6e6-54c5bf608428 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:46.040121 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3f557d37-e011-4139-a6e6-54c5bf608428 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:46.042570 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3f557d37-e011-4139-a6e6-54c5bf608428 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:46.106963 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.multi_cell_list [None req-63806263-cd10-4fe4-8331-f020896267da tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121135) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 03:20:46.170733 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-63806263-cd10-4fe4-8331-f020896267da tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] 10.222.0.52 "GET /compute/v2.1/servers?status=error" status: 200 len: 339 microversion: 2.1 time: 0.204269 Oct 19 03:20:46.171499 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1096/2129] 10.222.0.52 () {58 vars in 1150 bytes} [Wed Oct 19 03:20:45 2022] GET /compute/v2.1/servers?status=error => generated 339 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:20:46.176482 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5b94b0d5-40c8-4411-bad8-450862b5ab67 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Calling method '.version_select at 0x7fc130b4a4c0>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:20:46.326460 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-3f557d37-e011-4139-a6e6-54c5bf608428 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:46.328886 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:20:46.336479 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-3f557d37-e011-4139-a6e6-54c5bf608428 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:46.338094 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-3f557d37-e011-4139-a6e6-54c5bf608428 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:46.339350 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3f557d37-e011-4139-a6e6-54c5bf608428 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/074f3469-3bbd-46df-8286-3a57f91798e2" status: 200 len: 1280 microversion: 2.25 time: 0.334740 Oct 19 03:20:46.340013 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1034/2130] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:20:46 2022] GET /compute/v2.1/servers/074f3469-3bbd-46df-8286-3a57f91798e2 => generated 1280 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:20:46.346439 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e5f78775-a22c-4a2d-945c-548fb19c514d tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:20:46.347857 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e5f78775-a22c-4a2d-945c-548fb19c514d tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] [instance: fee1d282-ae3a-4792-ba8f-a19e498c8853] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:20:46.354418 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e5f78775-a22c-4a2d-945c-548fb19c514d tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:46.355179 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e5f78775-a22c-4a2d-945c-548fb19c514d tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:46.355811 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e5f78775-a22c-4a2d-945c-548fb19c514d tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:46.359961 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e5f78775-a22c-4a2d-945c-548fb19c514d tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:46.359961 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e5f78775-a22c-4a2d-945c-548fb19c514d tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:46.359961 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e5f78775-a22c-4a2d-945c-548fb19c514d tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:46.526217 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5b94b0d5-40c8-4411-bad8-450862b5ab67 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] 10.222.0.52 "DELETE /compute/v2.1/images/ae6eaa7b-d160-4b0d-a026-99a87523125c" status: 204 len: 0 microversion: 2.1 time: 0.353237 Oct 19 03:20:46.527171 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1097/2131] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:20:46 2022] DELETE /compute/v2.1/images/ae6eaa7b-d160-4b0d-a026-99a87523125c => generated 0 bytes in 355 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:20:46.531292 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e5f78775-a22c-4a2d-945c-548fb19c514d tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '152fa52a83b14c71bf86b22d77a73625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1606da859950484e9aa949e5c59c0a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:46.532861 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-09a87e08-9053-4077-bc29-64fea11a493d tempest-FloatingIPDetailsTestJSON-1662489570 tempest-FloatingIPDetailsTestJSON-1662489570-project] Action: 'create', calling method: .version_select at 0x7fc134f75940>, body: {"pool": null} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:20:46.539575 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e5f78775-a22c-4a2d-945c-548fb19c514d tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] 10.222.0.52 "GET /compute/v2.1/servers/fee1d282-ae3a-4792-ba8f-a19e498c8853" status: 200 len: 1524 microversion: 2.1 time: 0.198198 Oct 19 03:20:46.542042 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1035/2132] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:20:46 2022] GET /compute/v2.1/servers/fee1d282-ae3a-4792-ba8f-a19e498c8853 => generated 1524 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:20:46.545504 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1b81ce1e-b2c3-4e56-8daa-69ef1fb61a8a tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:20:46.561577 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1b81ce1e-b2c3-4e56-8daa-69ef1fb61a8a tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] [instance: bcf14e6a-ecdc-40c0-b76b-678a1bb14828] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:20:46.561577 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1b81ce1e-b2c3-4e56-8daa-69ef1fb61a8a tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:46.561577 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1b81ce1e-b2c3-4e56-8daa-69ef1fb61a8a tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:46.561577 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1b81ce1e-b2c3-4e56-8daa-69ef1fb61a8a tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:46.562065 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1b81ce1e-b2c3-4e56-8daa-69ef1fb61a8a tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:46.562065 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1b81ce1e-b2c3-4e56-8daa-69ef1fb61a8a tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:46.562065 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1b81ce1e-b2c3-4e56-8daa-69ef1fb61a8a tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:46.570509 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-1b81ce1e-b2c3-4e56-8daa-69ef1fb61a8a tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] HTTP exception thrown: Instance bcf14e6a-ecdc-40c0-b76b-678a1bb14828 could not be found. Oct 19 03:20:46.572204 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1b81ce1e-b2c3-4e56-8daa-69ef1fb61a8a tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Request method failure captured: Oct 19 03:20:46.572204 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/bcf14e6a-ecdc-40c0-b76b-678a1bb14828 HTTP/1.1 Oct 19 03:20:46.572204 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:20:46.572204 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:20:46.572204 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:20:46.572204 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:20:46.572204 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:20:46.572204 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:20:46.572204 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:20:46.572204 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:20:46.572204 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT2yU1TiVmMJOqJlwwAmlZEHt8wZDze_VxtD76CDF0CRASzSv6EqHKs-qeX7CTJr89jfwreZvEdY2ZOcsOrxEZ2ZvISug5RObJXrJKifdcx-MBjw_GmiXD_1PDZUclA0I62TyajaKDzJZdah6fGSqyEgjIEtJlX0kwL-pOeCwZsXEoRI Oct 19 03:20:46.572204 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:20:46.572204 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:20:46.572204 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:20:46.572204 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:20:46.572204 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:20:46.572204 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:20:46.572204 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 0e5d239ae4b24b7e978935fe9b3458cf Oct 19 03:20:46.572204 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-140638534 Oct 19 03:20:46.572204 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:20:46.572204 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:20:46.573872 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/0e5d239ae4b24b7e978935fe9b3458cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0e5d239ae4b24b7e978935fe9b3458cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0e5d239ae4b24b7e978935fe9b3458cf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_0e5d239ae4b24b7e978935fe9b3458cf", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:20:46.573872 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-140638534 Oct 19 03:20:46.573872 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 0e5d239ae4b24b7e978935fe9b3458cf Oct 19 03:20:46.573872 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-140638534 Oct 19 03:20:46.573872 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-FloatingIPsAssociationTestJSON-140638534-project Oct 19 03:20:46.573872 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:20:46.573872 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:20:46.573872 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: ac711151c0334c62958e7f2ec431d860 Oct 19 03:20:46.573872 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-140638534-project Oct 19 03:20:46.573872 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:20:46.573872 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance bcf14e6a-ecdc-40c0-b76b-678a1bb14828 could not be found. Oct 19 03:20:46.573872 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': 'bcf14e6a-ecdc-40c0-b76b-678a1bb14828'} Oct 19 03:20:46.574735 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:20:46.574735 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:20:46.574735 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:20:46.574735 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:20:46.574735 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:20:46.574735 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:20:46.574735 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:20:46.574735 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:20:46.574735 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:20:46.574735 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:20:46.574735 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bcf14e6a-ecdc-40c0-b76b-678a1bb14828 could not be found. Oct 19 03:20:46.574735 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:20:46.574735 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:20:46.574735 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:20:46.574735 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:20:46.574735 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:20:46.574735 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:20:46.574735 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:20:46.574735 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:20:46.574735 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:20:46.578047 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:20:46.578047 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:20:46.578047 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:20:46.578047 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:20:46.578047 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:20:46.578047 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:20:46.578047 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:20:46.578047 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bcf14e6a-ecdc-40c0-b76b-678a1bb14828 could not be found. Oct 19 03:20:46.578047 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:20:46.578047 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:20:46.578047 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:20:46.578047 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:20:46.578047 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:20:46.578047 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:20:46.578047 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:20:46.578047 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:20:46.578047 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bcf14e6a-ecdc-40c0-b76b-678a1bb14828 could not be found. Oct 19 03:20:46.578047 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:20:46.582358 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1b81ce1e-b2c3-4e56-8daa-69ef1fb61a8a tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] Returning 404 to user: Instance bcf14e6a-ecdc-40c0-b76b-678a1bb14828 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:20:46.582358 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1b81ce1e-b2c3-4e56-8daa-69ef1fb61a8a tempest-FloatingIPsAssociationTestJSON-140638534 tempest-FloatingIPsAssociationTestJSON-140638534-project] 10.222.0.52 "GET /compute/v2.1/servers/bcf14e6a-ecdc-40c0-b76b-678a1bb14828" status: 404 len: 111 microversion: 2.1 time: 0.032103 Oct 19 03:20:46.582358 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1036/2133] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:20:46 2022] GET /compute/v2.1/servers/bcf14e6a-ecdc-40c0-b76b-678a1bb14828 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:20:46.584404 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ba623ded-cf2e-4266-a418-f474287e1ac4 tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:20:46.586805 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ba623ded-cf2e-4266-a418-f474287e1ac4 tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] [instance: 6888c8db-82ba-4072-b431-8d4fcf5f03e0] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:20:46.593004 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ba623ded-cf2e-4266-a418-f474287e1ac4 tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:46.594308 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ba623ded-cf2e-4266-a418-f474287e1ac4 tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:46.594308 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ba623ded-cf2e-4266-a418-f474287e1ac4 tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:46.594681 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ba623ded-cf2e-4266-a418-f474287e1ac4 tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:46.595226 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ba623ded-cf2e-4266-a418-f474287e1ac4 tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:46.595659 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ba623ded-cf2e-4266-a418-f474287e1ac4 tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:46.928430 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ba623ded-cf2e-4266-a418-f474287e1ac4 tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/6888c8db-82ba-4072-b431-8d4fcf5f03e0/action" status: 202 len: 0 microversion: 2.1 time: 0.349222 Oct 19 03:20:46.929262 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1037/2134] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:20:46 2022] POST /compute/v2.1/servers/6888c8db-82ba-4072-b431-8d4fcf5f03e0/action => generated 0 bytes in 351 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:20:46.936583 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-cd4049ed-10e6-48f7-907e-5c9da36cd326 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Calling method '.version_select at 0x7fc130b571f0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:20:46.959729 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-cd4049ed-10e6-48f7-907e-5c9da36cd326 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] HTTP exception thrown: Image not found. Oct 19 03:20:46.961875 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-cd4049ed-10e6-48f7-907e-5c9da36cd326 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Request method failure captured: Oct 19 03:20:46.961875 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/images/ae6eaa7b-d160-4b0d-a026-99a87523125c HTTP/1.1 Oct 19 03:20:46.961875 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:20:46.961875 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:20:46.961875 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:20:46.961875 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:20:46.961875 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:20:46.961875 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:20:46.961875 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:20:46.961875 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:20:46.961875 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT2y5QS5fGXOCh8dCARu_-t2vnckF3uwZtfqi9DmHed6pMoXibNoREyH_7cDYk3t8P2qbQ1u564D6Sq50msRMl2YQVddoWmeJm48OR72Wl7OECfXwMpGVDHULH4PSkCmyy31jkBvdZSxqyCmIGP32xNgLbjMxF4SrMQTDektLd28zxNg Oct 19 03:20:46.961875 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:20:46.961875 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:20:46.961875 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:20:46.961875 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:20:46.961875 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:20:46.961875 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:20:46.961875 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: f9e436373e9e45efa03f08b33da619e8 Oct 19 03:20:46.961875 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1767182949 Oct 19 03:20:46.961875 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:20:46.961875 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:20:46.964575 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f9e436373e9e45efa03f08b33da619e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f9e436373e9e45efa03f08b33da619e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f9e436373e9e45efa03f08b33da619e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f9e436373e9e45efa03f08b33da619e8", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:20:46.964575 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1767182949 Oct 19 03:20:46.964575 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: f9e436373e9e45efa03f08b33da619e8 Oct 19 03:20:46.964575 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1767182949 Oct 19 03:20:46.964575 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ImagesOneServerNegativeTestJSON-1767182949-project Oct 19 03:20:46.964575 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:20:46.964575 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:20:46.964575 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 8824f20e6a1f478a99f90e1ba8f028fe Oct 19 03:20:46.964575 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1767182949-project Oct 19 03:20:46.964575 n-d-861333-8 devstack@n-api.service[121134]: method: Oct 19 03:20:46.964575 n-d-861333-8 devstack@n-api.service[121134]: exception: Image not found. Oct 19 03:20:46.964575 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': 'ae6eaa7b-d160-4b0d-a026-99a87523125c'} Oct 19 03:20:46.964575 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:20:46.967917 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:20:46.967917 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 19 03:20:46.967917 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 19 03:20:46.967917 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 19 03:20:46.967917 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 19 03:20:46.967917 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 19 03:20:46.967917 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 19 03:20:46.967917 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 19 03:20:46.967917 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 19 03:20:46.967917 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 19 03:20:46.967917 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 19 03:20:46.967917 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 19 03:20:46.967917 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 19 03:20:46.967917 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 19 03:20:46.967917 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 19 03:20:46.967917 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 19 03:20:46.967917 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 19 03:20:46.967917 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID ae6eaa7b-d160-4b0d-a026-99a87523125c Oct 19 03:20:46.969534 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:20:46.969534 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:20:46.969534 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:20:46.969534 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:20:46.969534 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 19 03:20:46.969534 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 19 03:20:46.969534 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 19 03:20:46.969534 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 19 03:20:46.969534 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 19 03:20:46.969534 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 19 03:20:46.969534 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 19 03:20:46.969534 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 19 03:20:46.969534 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 19 03:20:46.969534 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 19 03:20:46.969534 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 19 03:20:46.969534 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 19 03:20:46.969534 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 19 03:20:46.969534 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 19 03:20:46.969534 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 19 03:20:46.969534 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 19 03:20:46.971819 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 19 03:20:46.971819 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 19 03:20:46.971819 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 19 03:20:46.971819 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 19 03:20:46.971819 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 19 03:20:46.971819 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 19 03:20:46.971819 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 19 03:20:46.971819 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 19 03:20:46.971819 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ae6eaa7b-d160-4b0d-a026-99a87523125c could not be found. Oct 19 03:20:46.971819 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:20:46.971819 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:20:46.971819 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:20:46.971819 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:20:46.971819 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:20:46.971819 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:20:46.971819 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:20:46.971819 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:20:46.971819 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 03:20:46.971819 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 03:20:46.973470 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:20:46.973470 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:20:46.973470 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 19 03:20:46.973470 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 19 03:20:46.973470 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 19 03:20:46.973470 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:20:46.973470 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:20:46.973470 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:20:46.973470 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:20:46.973470 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:20:46.973470 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:20:46.973470 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:20:46.973470 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:20:46.973470 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 19 03:20:46.973470 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:20:46.973470 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-cd4049ed-10e6-48f7-907e-5c9da36cd326 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Returning 404 to user: Image not found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:20:46.975475 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-cd4049ed-10e6-48f7-907e-5c9da36cd326 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] 10.222.0.52 "GET /compute/v2.1/images/ae6eaa7b-d160-4b0d-a026-99a87523125c" status: 404 len: 62 microversion: 2.1 time: 0.032841 Oct 19 03:20:46.975475 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1038/2135] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:20:46 2022] GET /compute/v2.1/images/ae6eaa7b-d160-4b0d-a026-99a87523125c => generated 62 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 03:20:46.975475 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-2b29f322-e884-443a-a063-5c9ee4d596ac req-dbf6445d-1e89-459c-b8fb-5fa90f5925f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4adec402-e94f-4a41-ac77-68f6091b87f7", "tag": "e74674bb-2d45-441f-a59b-6f6bc5ac59f5"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:20:46.985202 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-2b29f322-e884-443a-a063-5c9ee4d596ac req-dbf6445d-1e89-459c-b8fb-5fa90f5925f7 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:46.985435 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-2b29f322-e884-443a-a063-5c9ee4d596ac req-dbf6445d-1e89-459c-b8fb-5fa90f5925f7 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:46.985878 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-2b29f322-e884-443a-a063-5c9ee4d596ac req-dbf6445d-1e89-459c-b8fb-5fa90f5925f7 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:46.997448 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-2b29f322-e884-443a-a063-5c9ee4d596ac req-dbf6445d-1e89-459c-b8fb-5fa90f5925f7 service nova] Creating event network-changed:e74674bb-2d45-441f-a59b-6f6bc5ac59f5 for instance 4adec402-e94f-4a41-ac77-68f6091b87f7 on n-h2-861333-8 Oct 19 03:20:47.002328 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-2b29f322-e884-443a-a063-5c9ee4d596ac req-dbf6445d-1e89-459c-b8fb-5fa90f5925f7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033644 Oct 19 03:20:47.003241 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1039/2136] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:20:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:20:47.008935 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8d738c43-da8f-4dcc-ba67-4d0a7c7b77ed tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:20:47.009661 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8d738c43-da8f-4dcc-ba67-4d0a7c7b77ed tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] [instance: 6888c8db-82ba-4072-b431-8d4fcf5f03e0] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:20:47.024740 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8d738c43-da8f-4dcc-ba67-4d0a7c7b77ed tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:47.025300 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8d738c43-da8f-4dcc-ba67-4d0a7c7b77ed tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:47.025849 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8d738c43-da8f-4dcc-ba67-4d0a7c7b77ed tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:47.026576 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8d738c43-da8f-4dcc-ba67-4d0a7c7b77ed tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:47.030155 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8d738c43-da8f-4dcc-ba67-4d0a7c7b77ed tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:47.030617 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8d738c43-da8f-4dcc-ba67-4d0a7c7b77ed tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:47.775472 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8d738c43-da8f-4dcc-ba67-4d0a7c7b77ed tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/6888c8db-82ba-4072-b431-8d4fcf5f03e0" status: 200 len: 1614 microversion: 2.1 time: 0.770148 Oct 19 03:20:47.788571 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1040/2137] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:20:47 2022] GET /compute/v2.1/servers/6888c8db-82ba-4072-b431-8d4fcf5f03e0 => generated 1614 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:20:47.788571 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a774b78e-c674-4194-8ceb-60d71b7eb3e1 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:20:47.788571 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a774b78e-c674-4194-8ceb-60d71b7eb3e1 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] [instance: 245ae0c1-c202-41c0-8f85-d5d99549f3ae] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:20:47.795750 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a774b78e-c674-4194-8ceb-60d71b7eb3e1 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:47.795750 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a774b78e-c674-4194-8ceb-60d71b7eb3e1 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:47.795750 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a774b78e-c674-4194-8ceb-60d71b7eb3e1 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:47.795750 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a774b78e-c674-4194-8ceb-60d71b7eb3e1 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:47.796114 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a774b78e-c674-4194-8ceb-60d71b7eb3e1 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:47.796114 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a774b78e-c674-4194-8ceb-60d71b7eb3e1 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:48.268432 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a774b78e-c674-4194-8ceb-60d71b7eb3e1 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8824f20e6a1f478a99f90e1ba8f028fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e436373e9e45efa03f08b33da619e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:48.277558 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a774b78e-c674-4194-8ceb-60d71b7eb3e1 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] 10.222.0.52 "GET /compute/v2.1/servers/245ae0c1-c202-41c0-8f85-d5d99549f3ae" status: 200 len: 1538 microversion: 2.1 time: 0.499730 Oct 19 03:20:48.278416 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1041/2138] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:20:47 2022] GET /compute/v2.1/servers/245ae0c1-c202-41c0-8f85-d5d99549f3ae => generated 1538 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:20:48.283727 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ed855ddf-70a6-4f9b-8213-acb76745b06a tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:20:48.284585 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ed855ddf-70a6-4f9b-8213-acb76745b06a tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] [instance: 4adec402-e94f-4a41-ac77-68f6091b87f7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:20:48.291412 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ed855ddf-70a6-4f9b-8213-acb76745b06a tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:48.292201 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ed855ddf-70a6-4f9b-8213-acb76745b06a tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:48.292855 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ed855ddf-70a6-4f9b-8213-acb76745b06a tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:48.294053 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ed855ddf-70a6-4f9b-8213-acb76745b06a tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:48.294595 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ed855ddf-70a6-4f9b-8213-acb76745b06a tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:48.295176 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ed855ddf-70a6-4f9b-8213-acb76745b06a tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:48.771764 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ed855ddf-70a6-4f9b-8213-acb76745b06a tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:48.781620 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ed855ddf-70a6-4f9b-8213-acb76745b06a tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:48.783123 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ed855ddf-70a6-4f9b-8213-acb76745b06a tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:48.784276 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ed855ddf-70a6-4f9b-8213-acb76745b06a tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] 10.222.0.52 "GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7" status: 200 len: 1865 microversion: 2.32 time: 0.504577 Oct 19 03:20:48.785351 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1042/2139] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:20:48 2022] GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7 => generated 1865 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:20:48.801736 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8a82b22f-b56e-480f-b983-3a68dc89045d tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:20:48.805541 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8a82b22f-b56e-480f-b983-3a68dc89045d tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 074f3469-3bbd-46df-8286-3a57f91798e2] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:20:48.814313 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8a82b22f-b56e-480f-b983-3a68dc89045d tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:48.816535 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8a82b22f-b56e-480f-b983-3a68dc89045d tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:48.816983 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8a82b22f-b56e-480f-b983-3a68dc89045d tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:48.821775 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8a82b22f-b56e-480f-b983-3a68dc89045d tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:48.822350 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8a82b22f-b56e-480f-b983-3a68dc89045d tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:48.822797 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8a82b22f-b56e-480f-b983-3a68dc89045d tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:49.250114 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8a82b22f-b56e-480f-b983-3a68dc89045d tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:49.259857 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8a82b22f-b56e-480f-b983-3a68dc89045d tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:49.261447 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8a82b22f-b56e-480f-b983-3a68dc89045d tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:49.262605 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8a82b22f-b56e-480f-b983-3a68dc89045d tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/074f3469-3bbd-46df-8286-3a57f91798e2" status: 200 len: 1280 microversion: 2.25 time: 0.476276 Oct 19 03:20:49.263187 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1043/2140] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:20:48 2022] GET /compute/v2.1/servers/074f3469-3bbd-46df-8286-3a57f91798e2 => generated 1280 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:20:49.270360 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-58260eb5-6317-4af0-bda3-6ea9bc713a1f tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:20:49.270360 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-58260eb5-6317-4af0-bda3-6ea9bc713a1f tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] [instance: fee1d282-ae3a-4792-ba8f-a19e498c8853] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:20:49.275515 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-58260eb5-6317-4af0-bda3-6ea9bc713a1f tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:49.276141 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-58260eb5-6317-4af0-bda3-6ea9bc713a1f tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:49.276844 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-58260eb5-6317-4af0-bda3-6ea9bc713a1f tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:49.277763 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-58260eb5-6317-4af0-bda3-6ea9bc713a1f tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:49.278390 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-58260eb5-6317-4af0-bda3-6ea9bc713a1f tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:49.278877 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-58260eb5-6317-4af0-bda3-6ea9bc713a1f tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:49.498935 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-58260eb5-6317-4af0-bda3-6ea9bc713a1f tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '152fa52a83b14c71bf86b22d77a73625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1606da859950484e9aa949e5c59c0a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:49.507206 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-58260eb5-6317-4af0-bda3-6ea9bc713a1f tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] 10.222.0.52 "GET /compute/v2.1/servers/fee1d282-ae3a-4792-ba8f-a19e498c8853" status: 200 len: 1524 microversion: 2.1 time: 0.242603 Oct 19 03:20:49.508412 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1044/2141] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:20:49 2022] GET /compute/v2.1/servers/fee1d282-ae3a-4792-ba8f-a19e498c8853 => generated 1524 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:20:49.513274 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f6731bd3-2a60-4bbb-97d2-5e4f3ac9619a tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:20:49.514591 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f6731bd3-2a60-4bbb-97d2-5e4f3ac9619a tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] [instance: 6888c8db-82ba-4072-b431-8d4fcf5f03e0] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:20:49.521043 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f6731bd3-2a60-4bbb-97d2-5e4f3ac9619a tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:49.521485 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f6731bd3-2a60-4bbb-97d2-5e4f3ac9619a tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:49.522127 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f6731bd3-2a60-4bbb-97d2-5e4f3ac9619a tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:49.522829 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f6731bd3-2a60-4bbb-97d2-5e4f3ac9619a tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:49.523281 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f6731bd3-2a60-4bbb-97d2-5e4f3ac9619a tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:49.523704 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f6731bd3-2a60-4bbb-97d2-5e4f3ac9619a tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:50.206037 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:20:50.228983 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f6731bd3-2a60-4bbb-97d2-5e4f3ac9619a tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/6888c8db-82ba-4072-b431-8d4fcf5f03e0" status: 200 len: 1614 microversion: 2.1 time: 0.719272 Oct 19 03:20:50.229592 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1045/2142] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:20:49 2022] GET /compute/v2.1/servers/6888c8db-82ba-4072-b431-8d4fcf5f03e0 => generated 1614 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:20:50.235114 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2f510c95-f81f-4e17-a82b-16fa1f08c131 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:20:50.235917 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2f510c95-f81f-4e17-a82b-16fa1f08c131 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] [instance: 245ae0c1-c202-41c0-8f85-d5d99549f3ae] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:20:50.243374 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2f510c95-f81f-4e17-a82b-16fa1f08c131 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:50.244223 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2f510c95-f81f-4e17-a82b-16fa1f08c131 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:50.244833 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2f510c95-f81f-4e17-a82b-16fa1f08c131 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:50.246982 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2f510c95-f81f-4e17-a82b-16fa1f08c131 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:50.247747 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2f510c95-f81f-4e17-a82b-16fa1f08c131 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:50.248365 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2f510c95-f81f-4e17-a82b-16fa1f08c131 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:50.728440 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-2f510c95-f81f-4e17-a82b-16fa1f08c131 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8824f20e6a1f478a99f90e1ba8f028fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e436373e9e45efa03f08b33da619e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:50.738033 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2f510c95-f81f-4e17-a82b-16fa1f08c131 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] 10.222.0.52 "GET /compute/v2.1/servers/245ae0c1-c202-41c0-8f85-d5d99549f3ae" status: 200 len: 1520 microversion: 2.1 time: 0.507251 Oct 19 03:20:50.749446 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1046/2143] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:20:50 2022] GET /compute/v2.1/servers/245ae0c1-c202-41c0-8f85-d5d99549f3ae => generated 1520 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:20:50.763638 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-2f625b62-24a4-41d0-ab71-f2414eb08883 req-7a750b1d-b231-4082-8841-385165bd214b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4adec402-e94f-4a41-ac77-68f6091b87f7", "tag": "bad825e5-2050-4f8e-b26b-6ce95f019585"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:20:50.775360 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-2f625b62-24a4-41d0-ab71-f2414eb08883 req-7a750b1d-b231-4082-8841-385165bd214b service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:50.776293 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-2f625b62-24a4-41d0-ab71-f2414eb08883 req-7a750b1d-b231-4082-8841-385165bd214b service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:50.776937 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-2f625b62-24a4-41d0-ab71-f2414eb08883 req-7a750b1d-b231-4082-8841-385165bd214b service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:50.790636 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-2f625b62-24a4-41d0-ab71-f2414eb08883 req-7a750b1d-b231-4082-8841-385165bd214b service nova] Creating event network-changed:bad825e5-2050-4f8e-b26b-6ce95f019585 for instance 4adec402-e94f-4a41-ac77-68f6091b87f7 on n-h2-861333-8 Oct 19 03:20:50.796282 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-2f625b62-24a4-41d0-ab71-f2414eb08883 req-7a750b1d-b231-4082-8841-385165bd214b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045352 Oct 19 03:20:50.797486 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1047/2144] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:20:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:20:50.817068 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d5ebcb46-13d4-4ec3-9904-70a9e9d9f757 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:20:50.818812 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d5ebcb46-13d4-4ec3-9904-70a9e9d9f757 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] [instance: 4adec402-e94f-4a41-ac77-68f6091b87f7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:20:50.842760 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d5ebcb46-13d4-4ec3-9904-70a9e9d9f757 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:50.845065 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d5ebcb46-13d4-4ec3-9904-70a9e9d9f757 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:50.847564 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d5ebcb46-13d4-4ec3-9904-70a9e9d9f757 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:50.849768 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d5ebcb46-13d4-4ec3-9904-70a9e9d9f757 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:50.852752 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d5ebcb46-13d4-4ec3-9904-70a9e9d9f757 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:50.853419 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d5ebcb46-13d4-4ec3-9904-70a9e9d9f757 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:51.201850 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-09a87e08-9053-4077-bc29-64fea11a493d tempest-FloatingIPDetailsTestJSON-1662489570 tempest-FloatingIPDetailsTestJSON-1662489570-project] 10.222.0.52 "POST /compute/v2.1/os-floating-ips" status: 200 len: 140 microversion: 2.1 time: 4.673196 Oct 19 03:20:51.211491 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1098/2145] 10.222.0.52 () {60 vars in 1170 bytes} [Wed Oct 19 03:20:46 2022] POST /compute/v2.1/os-floating-ips => generated 140 bytes in 4683 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:20:51.217916 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0cae3fcf-7c69-4a8e-8178-9751da16e034 tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:20:51.229075 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0cae3fcf-7c69-4a8e-8178-9751da16e034 tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Searching by: {'host': 'n-h1-861333-8', 'deleted': False} {{(pid=121135) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 03:20:51.242547 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0cae3fcf-7c69-4a8e-8178-9751da16e034 tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:51.244019 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0cae3fcf-7c69-4a8e-8178-9751da16e034 tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:51.244486 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0cae3fcf-7c69-4a8e-8178-9751da16e034 tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:51.245274 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0cae3fcf-7c69-4a8e-8178-9751da16e034 tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:51.250209 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0cae3fcf-7c69-4a8e-8178-9751da16e034 tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:51.250698 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0cae3fcf-7c69-4a8e-8178-9751da16e034 tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:51.380395 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.multi_cell_list [None req-0cae3fcf-7c69-4a8e-8178-9751da16e034 tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Listed batch of 5 results from cell out of 1000 limit. Returned 5 total so far. {{(pid=121135) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 03:20:51.450979 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0cae3fcf-7c69-4a8e-8178-9751da16e034 tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] 10.222.0.52 "GET /compute/v2.1/servers?host=n-h1-861333-8&all_tenants=1" status: 200 len: 1661 microversion: 2.1 time: 0.237350 Oct 19 03:20:51.451575 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1099/2146] 10.222.0.52 () {58 vars in 1190 bytes} [Wed Oct 19 03:20:51 2022] GET /compute/v2.1/servers?host=n-h1-861333-8&all_tenants=1 => generated 1661 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:20:51.457477 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-457fd314-47d8-4ff2-8163-0d19d321c30a tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:20:51.458451 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-457fd314-47d8-4ff2-8163-0d19d321c30a tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 074f3469-3bbd-46df-8286-3a57f91798e2] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:20:51.465399 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-457fd314-47d8-4ff2-8163-0d19d321c30a tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:51.466252 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-457fd314-47d8-4ff2-8163-0d19d321c30a tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:51.466954 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-457fd314-47d8-4ff2-8163-0d19d321c30a tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:51.467908 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-457fd314-47d8-4ff2-8163-0d19d321c30a tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:51.468582 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-457fd314-47d8-4ff2-8163-0d19d321c30a tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:51.469202 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-457fd314-47d8-4ff2-8163-0d19d321c30a tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:51.539625 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=4 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:20:51.546855 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d5ebcb46-13d4-4ec3-9904-70a9e9d9f757 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:51.559309 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d5ebcb46-13d4-4ec3-9904-70a9e9d9f757 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:51.563466 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d5ebcb46-13d4-4ec3-9904-70a9e9d9f757 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:51.564954 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d5ebcb46-13d4-4ec3-9904-70a9e9d9f757 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] 10.222.0.52 "GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7" status: 200 len: 1865 microversion: 2.32 time: 0.765964 Oct 19 03:20:51.566673 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1048/2147] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:20:50 2022] GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7 => generated 1865 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:20:51.571737 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-51fe12e9-e80d-4163-9d85-248267c7a9f9 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:20:51.572701 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-51fe12e9-e80d-4163-9d85-248267c7a9f9 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] [instance: fee1d282-ae3a-4792-ba8f-a19e498c8853] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:20:51.583855 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-51fe12e9-e80d-4163-9d85-248267c7a9f9 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:51.584707 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-51fe12e9-e80d-4163-9d85-248267c7a9f9 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:51.585494 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-51fe12e9-e80d-4163-9d85-248267c7a9f9 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:51.586504 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-51fe12e9-e80d-4163-9d85-248267c7a9f9 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:51.587195 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-51fe12e9-e80d-4163-9d85-248267c7a9f9 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:51.587932 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-51fe12e9-e80d-4163-9d85-248267c7a9f9 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:51.832127 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-457fd314-47d8-4ff2-8163-0d19d321c30a tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:51.847409 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-457fd314-47d8-4ff2-8163-0d19d321c30a tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:51.849688 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-457fd314-47d8-4ff2-8163-0d19d321c30a tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:51.853274 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-457fd314-47d8-4ff2-8163-0d19d321c30a tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/074f3469-3bbd-46df-8286-3a57f91798e2" status: 200 len: 1280 microversion: 2.25 time: 0.400444 Oct 19 03:20:51.856633 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1100/2148] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:20:51 2022] GET /compute/v2.1/servers/074f3469-3bbd-46df-8286-3a57f91798e2 => generated 1280 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:20:51.869759 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ad0d1ec2-9f85-4685-843e-cc5efc20459e tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:20:51.870534 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ad0d1ec2-9f85-4685-843e-cc5efc20459e tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] [instance: 245ae0c1-c202-41c0-8f85-d5d99549f3ae] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:20:51.879855 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ad0d1ec2-9f85-4685-843e-cc5efc20459e tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:51.880628 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ad0d1ec2-9f85-4685-843e-cc5efc20459e tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:51.880788 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ad0d1ec2-9f85-4685-843e-cc5efc20459e tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:51.881539 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ad0d1ec2-9f85-4685-843e-cc5efc20459e tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:51.882000 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ad0d1ec2-9f85-4685-843e-cc5efc20459e tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:51.882440 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ad0d1ec2-9f85-4685-843e-cc5efc20459e tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:51.940326 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-51fe12e9-e80d-4163-9d85-248267c7a9f9 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '152fa52a83b14c71bf86b22d77a73625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1606da859950484e9aa949e5c59c0a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:51.940925 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ad0d1ec2-9f85-4685-843e-cc5efc20459e tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] [instance: 245ae0c1-c202-41c0-8f85-d5d99549f3ae] Going to try to terminate instance {{(pid=121135) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:20:51.952763 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-51fe12e9-e80d-4163-9d85-248267c7a9f9 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] 10.222.0.52 "GET /compute/v2.1/servers/fee1d282-ae3a-4792-ba8f-a19e498c8853" status: 200 len: 1524 microversion: 2.1 time: 0.382813 Oct 19 03:20:51.953380 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1049/2149] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:20:51 2022] GET /compute/v2.1/servers/fee1d282-ae3a-4792-ba8f-a19e498c8853 => generated 1524 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:20:51.977478 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-43283f97-4852-4431-baa0-794053f51974 req-5e812d48-6b48-4156-9c1d-3cb842f23e99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "245ae0c1-c202-41c0-8f85-d5d99549f3ae", "name": "network-vif-plugged", "status": "completed", "tag": "59e53e31-1407-44d1-8ec2-153ae5c03e55"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:20:52.003148 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-43283f97-4852-4431-baa0-794053f51974 req-5e812d48-6b48-4156-9c1d-3cb842f23e99 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:52.003834 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-43283f97-4852-4431-baa0-794053f51974 req-5e812d48-6b48-4156-9c1d-3cb842f23e99 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:52.004481 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-43283f97-4852-4431-baa0-794053f51974 req-5e812d48-6b48-4156-9c1d-3cb842f23e99 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:52.022242 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-43283f97-4852-4431-baa0-794053f51974 req-5e812d48-6b48-4156-9c1d-3cb842f23e99 service nova] Creating event network-vif-plugged:59e53e31-1407-44d1-8ec2-153ae5c03e55 for instance 245ae0c1-c202-41c0-8f85-d5d99549f3ae on n-h2-861333-8 Oct 19 03:20:52.027509 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-43283f97-4852-4431-baa0-794053f51974 req-5e812d48-6b48-4156-9c1d-3cb842f23e99 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056745 Oct 19 03:20:52.028657 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1050/2150] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:20:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:20:52.037657 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-386adcbe-fafd-460d-8cd4-e98d9c86929e tempest-FloatingIPDetailsTestJSON-1662489570 tempest-FloatingIPDetailsTestJSON-1662489570-project] Calling method '.version_select at 0x7fc130fad160>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:20:52.346065 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ad0d1ec2-9f85-4685-843e-cc5efc20459e tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] 10.222.0.52 "DELETE /compute/v2.1/servers/245ae0c1-c202-41c0-8f85-d5d99549f3ae" status: 204 len: 0 microversion: 2.1 time: 0.487417 Oct 19 03:20:52.347553 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1101/2151] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:20:51 2022] DELETE /compute/v2.1/servers/245ae0c1-c202-41c0-8f85-d5d99549f3ae => generated 0 bytes in 490 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:20:52.352709 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-386adcbe-fafd-460d-8cd4-e98d9c86929e tempest-FloatingIPDetailsTestJSON-1662489570 tempest-FloatingIPDetailsTestJSON-1662489570-project] 10.222.0.52 "GET /compute/v2.1/os-floating-ips/1e4bada0-33ae-4827-a319-64f0cc9237e6" status: 200 len: 140 microversion: 2.1 time: 0.322261 Oct 19 03:20:52.353580 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-fe624b05-f4f6-4bdd-8cbd-baacba9d210d tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:20:52.355293 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1051/2152] 10.222.0.52 () {58 vars in 1260 bytes} [Wed Oct 19 03:20:52 2022] GET /compute/v2.1/os-floating-ips/1e4bada0-33ae-4827-a319-64f0cc9237e6 => generated 140 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:20:52.368212 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-68f3ca08-39cc-461b-b500-9b186d3991cc tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:20:52.368924 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-68f3ca08-39cc-461b-b500-9b186d3991cc tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] [instance: 245ae0c1-c202-41c0-8f85-d5d99549f3ae] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:20:52.373861 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-fe624b05-f4f6-4bdd-8cbd-baacba9d210d tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=121135) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 03:20:52.384913 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-68f3ca08-39cc-461b-b500-9b186d3991cc tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:52.385449 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-68f3ca08-39cc-461b-b500-9b186d3991cc tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:52.386142 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fe624b05-f4f6-4bdd-8cbd-baacba9d210d tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:52.386636 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fe624b05-f4f6-4bdd-8cbd-baacba9d210d tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:52.389578 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fe624b05-f4f6-4bdd-8cbd-baacba9d210d tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:52.390355 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fe624b05-f4f6-4bdd-8cbd-baacba9d210d tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:52.391996 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-68f3ca08-39cc-461b-b500-9b186d3991cc tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:52.392524 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fe624b05-f4f6-4bdd-8cbd-baacba9d210d tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:52.393328 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-68f3ca08-39cc-461b-b500-9b186d3991cc tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:52.393773 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fe624b05-f4f6-4bdd-8cbd-baacba9d210d tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:52.394773 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-68f3ca08-39cc-461b-b500-9b186d3991cc tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:52.395389 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-68f3ca08-39cc-461b-b500-9b186d3991cc tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:52.422056 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-fe624b05-f4f6-4bdd-8cbd-baacba9d210d tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] 10.222.0.52 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.072172 Oct 19 03:20:52.422925 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1102/2153] 10.222.0.52 () {58 vars in 1196 bytes} [Wed Oct 19 03:20:52 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 03:20:52.427876 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-abe1921d-c846-4187-a1e1-6d37390b58b0 tempest-FloatingIPDetailsTestJSON-1662489570 tempest-FloatingIPDetailsTestJSON-1662489570-project] Calling method '.version_select at 0x7fc130bcd280>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:20:52.795022 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-68f3ca08-39cc-461b-b500-9b186d3991cc tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8824f20e6a1f478a99f90e1ba8f028fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e436373e9e45efa03f08b33da619e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:52.816380 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-68f3ca08-39cc-461b-b500-9b186d3991cc tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] 10.222.0.52 "GET /compute/v2.1/servers/245ae0c1-c202-41c0-8f85-d5d99549f3ae" status: 200 len: 1526 microversion: 2.1 time: 0.440140 Oct 19 03:20:52.816380 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1052/2154] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:20:52 2022] GET /compute/v2.1/servers/245ae0c1-c202-41c0-8f85-d5d99549f3ae => generated 1526 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:20:52.816380 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-72bd54b2-450e-4612-9f69-b0b250a5ab73 tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:20:52.822443 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-72bd54b2-450e-4612-9f69-b0b250a5ab73 tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] [instance: 6888c8db-82ba-4072-b431-8d4fcf5f03e0] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:20:52.841035 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-72bd54b2-450e-4612-9f69-b0b250a5ab73 tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:52.841635 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-72bd54b2-450e-4612-9f69-b0b250a5ab73 tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:52.842074 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-72bd54b2-450e-4612-9f69-b0b250a5ab73 tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:52.842785 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-72bd54b2-450e-4612-9f69-b0b250a5ab73 tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:52.843236 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-72bd54b2-450e-4612-9f69-b0b250a5ab73 tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:52.843661 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-72bd54b2-450e-4612-9f69-b0b250a5ab73 tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:52.984205 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:20:53.259997 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-72bd54b2-450e-4612-9f69-b0b250a5ab73 tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/6888c8db-82ba-4072-b431-8d4fcf5f03e0/action" status: 202 len: 0 microversion: 2.1 time: 0.448855 Oct 19 03:20:53.268094 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1053/2155] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:20:52 2022] POST /compute/v2.1/servers/6888c8db-82ba-4072-b431-8d4fcf5f03e0/action => generated 0 bytes in 460 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:20:53.270853 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b1042508-3d17-4302-aeb2-7e65f812b542 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:20:53.271487 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b1042508-3d17-4302-aeb2-7e65f812b542 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] [instance: 4adec402-e94f-4a41-ac77-68f6091b87f7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:20:53.277694 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b1042508-3d17-4302-aeb2-7e65f812b542 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:53.278199 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b1042508-3d17-4302-aeb2-7e65f812b542 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:53.278642 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b1042508-3d17-4302-aeb2-7e65f812b542 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:53.279355 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b1042508-3d17-4302-aeb2-7e65f812b542 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:53.279902 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b1042508-3d17-4302-aeb2-7e65f812b542 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:53.280339 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b1042508-3d17-4302-aeb2-7e65f812b542 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:53.599339 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b1042508-3d17-4302-aeb2-7e65f812b542 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:53.608935 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b1042508-3d17-4302-aeb2-7e65f812b542 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:53.610785 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b1042508-3d17-4302-aeb2-7e65f812b542 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:53.612187 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b1042508-3d17-4302-aeb2-7e65f812b542 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] 10.222.0.52 "GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7" status: 200 len: 1886 microversion: 2.32 time: 0.345725 Oct 19 03:20:53.613079 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1054/2156] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:20:53 2022] GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7 => generated 1886 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:20:53.617847 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-767e1e63-7307-4a08-be6f-f5b4e044a052 req-2470c83f-e83b-404f-939a-c74d8d8746ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4adec402-e94f-4a41-ac77-68f6091b87f7", "tag": "79d980c0-7663-46a5-9ee8-792d242f6019"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:20:53.628225 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-767e1e63-7307-4a08-be6f-f5b4e044a052 req-2470c83f-e83b-404f-939a-c74d8d8746ba service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:53.628945 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-767e1e63-7307-4a08-be6f-f5b4e044a052 req-2470c83f-e83b-404f-939a-c74d8d8746ba service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:53.629590 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-767e1e63-7307-4a08-be6f-f5b4e044a052 req-2470c83f-e83b-404f-939a-c74d8d8746ba service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:53.642907 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-767e1e63-7307-4a08-be6f-f5b4e044a052 req-2470c83f-e83b-404f-939a-c74d8d8746ba service nova] Creating event network-changed:79d980c0-7663-46a5-9ee8-792d242f6019 for instance 4adec402-e94f-4a41-ac77-68f6091b87f7 on n-h2-861333-8 Oct 19 03:20:53.650201 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-767e1e63-7307-4a08-be6f-f5b4e044a052 req-2470c83f-e83b-404f-939a-c74d8d8746ba service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035170 Oct 19 03:20:53.651781 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1055/2157] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:20:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:20:53.656666 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9d4a322e-4868-43c5-b117-f3cfc26a18e1 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:20:53.657455 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9d4a322e-4868-43c5-b117-f3cfc26a18e1 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 074f3469-3bbd-46df-8286-3a57f91798e2] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:20:53.665485 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9d4a322e-4868-43c5-b117-f3cfc26a18e1 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:53.666275 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9d4a322e-4868-43c5-b117-f3cfc26a18e1 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:53.666919 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9d4a322e-4868-43c5-b117-f3cfc26a18e1 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:53.668055 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9d4a322e-4868-43c5-b117-f3cfc26a18e1 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:53.668745 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9d4a322e-4868-43c5-b117-f3cfc26a18e1 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:53.669426 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9d4a322e-4868-43c5-b117-f3cfc26a18e1 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:54.181879 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9d4a322e-4868-43c5-b117-f3cfc26a18e1 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:54.199585 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9d4a322e-4868-43c5-b117-f3cfc26a18e1 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:54.204475 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9d4a322e-4868-43c5-b117-f3cfc26a18e1 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:54.209521 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9d4a322e-4868-43c5-b117-f3cfc26a18e1 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/074f3469-3bbd-46df-8286-3a57f91798e2" status: 200 len: 1280 microversion: 2.25 time: 0.556671 Oct 19 03:20:54.210737 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1056/2158] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:20:53 2022] GET /compute/v2.1/servers/074f3469-3bbd-46df-8286-3a57f91798e2 => generated 1280 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:20:54.226471 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5fd1d41c-2c79-4e17-9d35-3b4d4e835464 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:20:54.235617 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5fd1d41c-2c79-4e17-9d35-3b4d4e835464 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] [instance: fee1d282-ae3a-4792-ba8f-a19e498c8853] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:20:54.235617 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5fd1d41c-2c79-4e17-9d35-3b4d4e835464 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:54.236982 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5fd1d41c-2c79-4e17-9d35-3b4d4e835464 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:54.241072 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5fd1d41c-2c79-4e17-9d35-3b4d4e835464 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:54.244215 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5fd1d41c-2c79-4e17-9d35-3b4d4e835464 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:54.244932 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5fd1d41c-2c79-4e17-9d35-3b4d4e835464 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:54.250907 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5fd1d41c-2c79-4e17-9d35-3b4d4e835464 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:54.328215 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-abe1921d-c846-4187-a1e1-6d37390b58b0 tempest-FloatingIPDetailsTestJSON-1662489570 tempest-FloatingIPDetailsTestJSON-1662489570-project] 10.222.0.52 "DELETE /compute/v2.1/os-floating-ips/1e4bada0-33ae-4827-a319-64f0cc9237e6" status: 202 len: 0 microversion: 2.1 time: 1.904027 Oct 19 03:20:54.328807 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1103/2159] 10.222.0.52 () {58 vars in 1263 bytes} [Wed Oct 19 03:20:52 2022] DELETE /compute/v2.1/os-floating-ips/1e4bada0-33ae-4827-a319-64f0cc9237e6 => generated 0 bytes in 1905 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:20:54.339335 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-37ec6554-089e-4661-847a-c83177774211 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:20:54.349708 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-37ec6554-089e-4661-847a-c83177774211 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] [instance: 6888c8db-82ba-4072-b431-8d4fcf5f03e0] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:20:54.368000 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-37ec6554-089e-4661-847a-c83177774211 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:54.368777 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-37ec6554-089e-4661-847a-c83177774211 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:54.369442 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-37ec6554-089e-4661-847a-c83177774211 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:54.370392 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-37ec6554-089e-4661-847a-c83177774211 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:54.371018 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-37ec6554-089e-4661-847a-c83177774211 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:54.371612 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-37ec6554-089e-4661-847a-c83177774211 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:54.478414 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-37ec6554-089e-4661-847a-c83177774211 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Flavor limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:20:54.478843 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-37ec6554-089e-4661-847a-c83177774211 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Image limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:20:54.479388 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-37ec6554-089e-4661-847a-c83177774211 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Flavor pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:20:54.479891 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-37ec6554-089e-4661-847a-c83177774211 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Image pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:20:54.480313 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-37ec6554-089e-4661-847a-c83177774211 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:20:54.716956 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5fd1d41c-2c79-4e17-9d35-3b4d4e835464 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '152fa52a83b14c71bf86b22d77a73625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1606da859950484e9aa949e5c59c0a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:54.726631 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5fd1d41c-2c79-4e17-9d35-3b4d4e835464 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] 10.222.0.52 "GET /compute/v2.1/servers/fee1d282-ae3a-4792-ba8f-a19e498c8853" status: 200 len: 1524 microversion: 2.1 time: 0.514219 Oct 19 03:20:54.730114 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1057/2160] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:20:54 2022] GET /compute/v2.1/servers/fee1d282-ae3a-4792-ba8f-a19e498c8853 => generated 1524 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:20:54.745400 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-61a89995-8aef-4bfe-911e-4ca304024072 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:20:54.746415 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-61a89995-8aef-4bfe-911e-4ca304024072 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] [instance: 245ae0c1-c202-41c0-8f85-d5d99549f3ae] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:20:54.755487 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-61a89995-8aef-4bfe-911e-4ca304024072 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:54.756364 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-61a89995-8aef-4bfe-911e-4ca304024072 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:54.766392 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-61a89995-8aef-4bfe-911e-4ca304024072 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:54.766392 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-61a89995-8aef-4bfe-911e-4ca304024072 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:54.766392 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-61a89995-8aef-4bfe-911e-4ca304024072 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:54.766392 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-61a89995-8aef-4bfe-911e-4ca304024072 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:54.844762 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-37ec6554-089e-4661-847a-c83177774211 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] [instance: 6888c8db-82ba-4072-b431-8d4fcf5f03e0] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:20:54.860087 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-37ec6554-089e-4661-847a-c83177774211 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:54.860835 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-37ec6554-089e-4661-847a-c83177774211 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:54.861775 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-37ec6554-089e-4661-847a-c83177774211 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:54.862963 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-37ec6554-089e-4661-847a-c83177774211 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:54.863751 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-37ec6554-089e-4661-847a-c83177774211 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:54.864541 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-37ec6554-089e-4661-847a-c83177774211 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:54.906129 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-37ec6554-089e-4661-847a-c83177774211 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] 10.222.0.52 "POST /compute/v2.1/servers/6888c8db-82ba-4072-b431-8d4fcf5f03e0/action" status: 202 len: 1067 microversion: 2.1 time: 0.570211 Oct 19 03:20:54.907997 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1104/2161] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:20:54 2022] POST /compute/v2.1/servers/6888c8db-82ba-4072-b431-8d4fcf5f03e0/action => generated 1067 bytes in 574 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 19 03:20:54.925411 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-c6196808-accb-4b50-b4cc-f74f686f5015 req-538cf425-de0d-4da2-87ac-25df50a9dd74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "245ae0c1-c202-41c0-8f85-d5d99549f3ae", "name": "network-vif-unplugged", "status": "completed", "tag": "59e53e31-1407-44d1-8ec2-153ae5c03e55"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:20:54.935028 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-c6196808-accb-4b50-b4cc-f74f686f5015 req-538cf425-de0d-4da2-87ac-25df50a9dd74 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:54.935393 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-c6196808-accb-4b50-b4cc-f74f686f5015 req-538cf425-de0d-4da2-87ac-25df50a9dd74 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:54.935940 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-c6196808-accb-4b50-b4cc-f74f686f5015 req-538cf425-de0d-4da2-87ac-25df50a9dd74 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:54.948753 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-c6196808-accb-4b50-b4cc-f74f686f5015 req-538cf425-de0d-4da2-87ac-25df50a9dd74 service nova] Creating event network-vif-unplugged:59e53e31-1407-44d1-8ec2-153ae5c03e55 for instance 245ae0c1-c202-41c0-8f85-d5d99549f3ae on n-h2-861333-8 Oct 19 03:20:54.953865 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-c6196808-accb-4b50-b4cc-f74f686f5015 req-538cf425-de0d-4da2-87ac-25df50a9dd74 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044496 Oct 19 03:20:54.954996 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1105/2162] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:20:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:20:54.962371 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-65cc1837-ec1a-45a7-94db-1a4113b2fa8c tempest-FloatingIPDetailsTestJSON-1662489570 tempest-FloatingIPDetailsTestJSON-1662489570-project] Calling method '.version_select at 0x7fc130bb4a60>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:20:55.313069 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-61a89995-8aef-4bfe-911e-4ca304024072 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8824f20e6a1f478a99f90e1ba8f028fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e436373e9e45efa03f08b33da619e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:55.325654 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-61a89995-8aef-4bfe-911e-4ca304024072 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] 10.222.0.52 "GET /compute/v2.1/servers/245ae0c1-c202-41c0-8f85-d5d99549f3ae" status: 200 len: 1526 microversion: 2.1 time: 0.582460 Oct 19 03:20:55.328613 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1058/2163] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:20:54 2022] GET /compute/v2.1/servers/245ae0c1-c202-41c0-8f85-d5d99549f3ae => generated 1526 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:20:55.335138 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-58b01dd2-9f39-453a-89ed-f54a0127895f tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:20:55.340934 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-58b01dd2-9f39-453a-89ed-f54a0127895f tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] [instance: 4adec402-e94f-4a41-ac77-68f6091b87f7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:20:55.345666 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-58b01dd2-9f39-453a-89ed-f54a0127895f tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:55.346454 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-58b01dd2-9f39-453a-89ed-f54a0127895f tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:55.356825 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-65cc1837-ec1a-45a7-94db-1a4113b2fa8c tempest-FloatingIPDetailsTestJSON-1662489570 tempest-FloatingIPDetailsTestJSON-1662489570-project] 10.222.0.52 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.400390 Oct 19 03:20:55.358683 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1106/2164] 10.222.0.52 () {58 vars in 1164 bytes} [Wed Oct 19 03:20:54 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 03:20:55.364847 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-905a2ef1-5a8a-4542-b5d6-1c7757e30312 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:20:55.366554 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-905a2ef1-5a8a-4542-b5d6-1c7757e30312 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] [instance: 6888c8db-82ba-4072-b431-8d4fcf5f03e0] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:20:55.367946 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-58b01dd2-9f39-453a-89ed-f54a0127895f tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:55.371756 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-58b01dd2-9f39-453a-89ed-f54a0127895f tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:55.372579 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-58b01dd2-9f39-453a-89ed-f54a0127895f tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:55.375456 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-58b01dd2-9f39-453a-89ed-f54a0127895f tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:55.384373 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-905a2ef1-5a8a-4542-b5d6-1c7757e30312 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:55.384882 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-905a2ef1-5a8a-4542-b5d6-1c7757e30312 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:55.385335 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-905a2ef1-5a8a-4542-b5d6-1c7757e30312 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:55.389139 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-905a2ef1-5a8a-4542-b5d6-1c7757e30312 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:55.389718 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-905a2ef1-5a8a-4542-b5d6-1c7757e30312 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:55.390347 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-905a2ef1-5a8a-4542-b5d6-1c7757e30312 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:55.799388 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-905a2ef1-5a8a-4542-b5d6-1c7757e30312 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4c5e4123c44508a5d4911a17c44231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a495ccfced47f29cb928d1ded20d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:55.809685 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-905a2ef1-5a8a-4542-b5d6-1c7757e30312 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] 10.222.0.52 "GET /compute/v2.1/servers/6888c8db-82ba-4072-b431-8d4fcf5f03e0" status: 200 len: 1471 microversion: 2.1 time: 0.450006 Oct 19 03:20:55.827169 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1107/2165] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:20:55 2022] GET /compute/v2.1/servers/6888c8db-82ba-4072-b431-8d4fcf5f03e0 => generated 1471 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:20:55.844500 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-58b01dd2-9f39-453a-89ed-f54a0127895f tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:55.848677 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-70839956-9e0a-4a53-8431-17f2b53d3e07 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:20:55.849363 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-70839956-9e0a-4a53-8431-17f2b53d3e07 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 074f3469-3bbd-46df-8286-3a57f91798e2] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:20:55.862013 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-70839956-9e0a-4a53-8431-17f2b53d3e07 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:55.867384 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-70839956-9e0a-4a53-8431-17f2b53d3e07 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:55.867384 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-70839956-9e0a-4a53-8431-17f2b53d3e07 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:55.867384 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-70839956-9e0a-4a53-8431-17f2b53d3e07 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:55.867384 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-70839956-9e0a-4a53-8431-17f2b53d3e07 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:55.867815 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-70839956-9e0a-4a53-8431-17f2b53d3e07 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:55.871769 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-58b01dd2-9f39-453a-89ed-f54a0127895f tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:55.875617 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-58b01dd2-9f39-453a-89ed-f54a0127895f tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:55.886641 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-58b01dd2-9f39-453a-89ed-f54a0127895f tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] 10.222.0.52 "GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7" status: 200 len: 1886 microversion: 2.32 time: 0.556064 Oct 19 03:20:55.887839 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1059/2166] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:20:55 2022] GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7 => generated 1886 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:20:55.893490 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3b16e03f-b8c2-4c2d-95b4-217772ccbb0a tempest-FloatingIPDetailsTestJSON-1662489570 tempest-FloatingIPDetailsTestJSON-1662489570-project] Calling method '.version_select at 0x7fc130cb98b0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:20:56.303713 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-70839956-9e0a-4a53-8431-17f2b53d3e07 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:56.316586 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-70839956-9e0a-4a53-8431-17f2b53d3e07 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:56.323863 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-70839956-9e0a-4a53-8431-17f2b53d3e07 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:56.325110 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-70839956-9e0a-4a53-8431-17f2b53d3e07 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/074f3469-3bbd-46df-8286-3a57f91798e2" status: 200 len: 1280 microversion: 2.25 time: 0.495876 Oct 19 03:20:56.327427 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1108/2167] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:20:55 2022] GET /compute/v2.1/servers/074f3469-3bbd-46df-8286-3a57f91798e2 => generated 1280 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:20:56.350205 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-9ae5f098-7e33-4b97-a9ac-4697e1d272f2 req-42ae9ea1-0172-46bb-b119-f0700efc6229 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4adec402-e94f-4a41-ac77-68f6091b87f7", "tag": "66f823f7-1df0-47b2-bcc5-7f5bb365d0f5"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:20:56.375664 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3b16e03f-b8c2-4c2d-95b4-217772ccbb0a tempest-FloatingIPDetailsTestJSON-1662489570 tempest-FloatingIPDetailsTestJSON-1662489570-project] 10.222.0.52 "GET /compute/v2.1/os-floating-ips" status: 200 len: 399 microversion: 2.1 time: 0.486426 Oct 19 03:20:56.379515 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-9ae5f098-7e33-4b97-a9ac-4697e1d272f2 req-42ae9ea1-0172-46bb-b119-f0700efc6229 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:56.382132 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-9ae5f098-7e33-4b97-a9ac-4697e1d272f2 req-42ae9ea1-0172-46bb-b119-f0700efc6229 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:56.383205 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-9ae5f098-7e33-4b97-a9ac-4697e1d272f2 req-42ae9ea1-0172-46bb-b119-f0700efc6229 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:56.386594 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1060/2168] 10.222.0.52 () {58 vars in 1149 bytes} [Wed Oct 19 03:20:55 2022] GET /compute/v2.1/os-floating-ips => generated 399 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:20:56.392256 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4941d326-9c0a-4a01-a623-06c64c4f706a tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:20:56.393255 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4941d326-9c0a-4a01-a623-06c64c4f706a tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] [instance: fee1d282-ae3a-4792-ba8f-a19e498c8853] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:20:56.401697 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4941d326-9c0a-4a01-a623-06c64c4f706a tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:56.402453 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4941d326-9c0a-4a01-a623-06c64c4f706a tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:56.403137 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4941d326-9c0a-4a01-a623-06c64c4f706a tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:56.404188 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4941d326-9c0a-4a01-a623-06c64c4f706a tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:56.404880 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4941d326-9c0a-4a01-a623-06c64c4f706a tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:56.405569 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4941d326-9c0a-4a01-a623-06c64c4f706a tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:56.425493 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-9ae5f098-7e33-4b97-a9ac-4697e1d272f2 req-42ae9ea1-0172-46bb-b119-f0700efc6229 service nova] Creating event network-changed:66f823f7-1df0-47b2-bcc5-7f5bb365d0f5 for instance 4adec402-e94f-4a41-ac77-68f6091b87f7 on n-h2-861333-8 Oct 19 03:20:56.431375 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-9ae5f098-7e33-4b97-a9ac-4697e1d272f2 req-42ae9ea1-0172-46bb-b119-f0700efc6229 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102413 Oct 19 03:20:56.434356 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1109/2169] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:20:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:20:56.444672 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-982d4c21-0a2e-4483-a5f6-c7d45066cdd7 req-b0021d5d-8609-4602-aed0-a522550ec2f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "245ae0c1-c202-41c0-8f85-d5d99549f3ae", "name": "network-vif-deleted", "tag": "59e53e31-1407-44d1-8ec2-153ae5c03e55"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:20:56.456985 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-982d4c21-0a2e-4483-a5f6-c7d45066cdd7 req-b0021d5d-8609-4602-aed0-a522550ec2f3 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:56.458533 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-982d4c21-0a2e-4483-a5f6-c7d45066cdd7 req-b0021d5d-8609-4602-aed0-a522550ec2f3 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:56.458986 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-982d4c21-0a2e-4483-a5f6-c7d45066cdd7 req-b0021d5d-8609-4602-aed0-a522550ec2f3 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:56.473250 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-982d4c21-0a2e-4483-a5f6-c7d45066cdd7 req-b0021d5d-8609-4602-aed0-a522550ec2f3 service nova] Creating event network-vif-deleted:59e53e31-1407-44d1-8ec2-153ae5c03e55 for instance 245ae0c1-c202-41c0-8f85-d5d99549f3ae on n-h2-861333-8 Oct 19 03:20:56.477201 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-982d4c21-0a2e-4483-a5f6-c7d45066cdd7 req-b0021d5d-8609-4602-aed0-a522550ec2f3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041219 Oct 19 03:20:56.477924 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1110/2170] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:20:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:20:56.483249 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-14b05c80-78f8-4eae-9aa8-1b2ef10eed05 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:20:56.484287 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-14b05c80-78f8-4eae-9aa8-1b2ef10eed05 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] [instance: 245ae0c1-c202-41c0-8f85-d5d99549f3ae] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:20:56.491918 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-14b05c80-78f8-4eae-9aa8-1b2ef10eed05 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:56.492558 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-14b05c80-78f8-4eae-9aa8-1b2ef10eed05 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:56.493132 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-14b05c80-78f8-4eae-9aa8-1b2ef10eed05 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:56.494139 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-14b05c80-78f8-4eae-9aa8-1b2ef10eed05 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:56.494829 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-14b05c80-78f8-4eae-9aa8-1b2ef10eed05 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:56.495491 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-14b05c80-78f8-4eae-9aa8-1b2ef10eed05 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:56.531344 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-14b05c80-78f8-4eae-9aa8-1b2ef10eed05 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:56.531844 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-14b05c80-78f8-4eae-9aa8-1b2ef10eed05 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:56.532292 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-14b05c80-78f8-4eae-9aa8-1b2ef10eed05 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:56.532756 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-14b05c80-78f8-4eae-9aa8-1b2ef10eed05 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lazy-loading 'fault' on Instance uuid 245ae0c1-c202-41c0-8f85-d5d99549f3ae {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:20:56.842462 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-14b05c80-78f8-4eae-9aa8-1b2ef10eed05 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8824f20e6a1f478a99f90e1ba8f028fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e436373e9e45efa03f08b33da619e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:56.856903 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-14b05c80-78f8-4eae-9aa8-1b2ef10eed05 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] 10.222.0.52 "GET /compute/v2.1/servers/245ae0c1-c202-41c0-8f85-d5d99549f3ae" status: 200 len: 1314 microversion: 2.1 time: 0.377628 Oct 19 03:20:56.858623 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1111/2171] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:20:56 2022] GET /compute/v2.1/servers/245ae0c1-c202-41c0-8f85-d5d99549f3ae => generated 1314 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:20:56.864107 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ad80e7c5-eede-40c1-8ef3-0e782ff5435f tempest-FloatingIPDetailsTestJSON-1662489570 tempest-FloatingIPDetailsTestJSON-1662489570-project] Calling method '.version_select at 0x7fc130b2dca0>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:20:57.148035 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-4941d326-9c0a-4a01-a623-06c64c4f706a tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '152fa52a83b14c71bf86b22d77a73625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1606da859950484e9aa949e5c59c0a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:57.157857 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4941d326-9c0a-4a01-a623-06c64c4f706a tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] 10.222.0.52 "GET /compute/v2.1/servers/fee1d282-ae3a-4792-ba8f-a19e498c8853" status: 200 len: 1524 microversion: 2.1 time: 0.769826 Oct 19 03:20:57.158437 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1061/2172] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:20:56 2022] GET /compute/v2.1/servers/fee1d282-ae3a-4792-ba8f-a19e498c8853 => generated 1524 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:20:57.164325 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4f3ea357-089e-4e43-b095-a4e77ce8dfa1 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:20:57.164938 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4f3ea357-089e-4e43-b095-a4e77ce8dfa1 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] [instance: 6888c8db-82ba-4072-b431-8d4fcf5f03e0] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:20:57.170897 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4f3ea357-089e-4e43-b095-a4e77ce8dfa1 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:57.171379 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4f3ea357-089e-4e43-b095-a4e77ce8dfa1 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:57.172016 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4f3ea357-089e-4e43-b095-a4e77ce8dfa1 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:57.172710 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4f3ea357-089e-4e43-b095-a4e77ce8dfa1 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:57.173160 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4f3ea357-089e-4e43-b095-a4e77ce8dfa1 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:57.173618 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4f3ea357-089e-4e43-b095-a4e77ce8dfa1 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:57.594134 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-4f3ea357-089e-4e43-b095-a4e77ce8dfa1 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4c5e4123c44508a5d4911a17c44231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a495ccfced47f29cb928d1ded20d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:57.603258 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4f3ea357-089e-4e43-b095-a4e77ce8dfa1 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] 10.222.0.52 "GET /compute/v2.1/servers/6888c8db-82ba-4072-b431-8d4fcf5f03e0" status: 200 len: 1471 microversion: 2.1 time: 0.442453 Oct 19 03:20:57.613959 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1062/2173] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:20:57 2022] GET /compute/v2.1/servers/6888c8db-82ba-4072-b431-8d4fcf5f03e0 => generated 1471 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:20:57.613959 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-acbb8813-0a28-4447-b9a4-7677140b1e87 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:20:57.613959 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-acbb8813-0a28-4447-b9a4-7677140b1e87 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] [instance: 4adec402-e94f-4a41-ac77-68f6091b87f7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:20:57.615847 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-acbb8813-0a28-4447-b9a4-7677140b1e87 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:57.616054 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-acbb8813-0a28-4447-b9a4-7677140b1e87 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:57.616549 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-acbb8813-0a28-4447-b9a4-7677140b1e87 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:57.617285 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-acbb8813-0a28-4447-b9a4-7677140b1e87 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:57.617807 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-acbb8813-0a28-4447-b9a4-7677140b1e87 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:57.618330 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-acbb8813-0a28-4447-b9a4-7677140b1e87 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:58.118325 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-acbb8813-0a28-4447-b9a4-7677140b1e87 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:58.127886 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-acbb8813-0a28-4447-b9a4-7677140b1e87 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:58.130262 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-acbb8813-0a28-4447-b9a4-7677140b1e87 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:58.135906 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-acbb8813-0a28-4447-b9a4-7677140b1e87 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] 10.222.0.52 "GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7" status: 200 len: 1874 microversion: 2.32 time: 0.526824 Oct 19 03:20:58.135906 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1063/2174] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:20:57 2022] GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7 => generated 1874 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:20:58.136863 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-eff11f80-e737-4a63-9d6f-441b7124e9ee req-a4d4eccd-5636-4a5c-88b4-56eb65d1c47c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "074f3469-3bbd-46df-8286-3a57f91798e2", "name": "network-vif-plugged", "status": "completed", "tag": "44f53eb4-50b1-4764-8a1c-143764a0a324"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:20:58.146858 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-eff11f80-e737-4a63-9d6f-441b7124e9ee req-a4d4eccd-5636-4a5c-88b4-56eb65d1c47c service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:58.147384 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-eff11f80-e737-4a63-9d6f-441b7124e9ee req-a4d4eccd-5636-4a5c-88b4-56eb65d1c47c service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:58.147950 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-eff11f80-e737-4a63-9d6f-441b7124e9ee req-a4d4eccd-5636-4a5c-88b4-56eb65d1c47c service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:58.160356 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-eff11f80-e737-4a63-9d6f-441b7124e9ee req-a4d4eccd-5636-4a5c-88b4-56eb65d1c47c service nova] Creating event network-vif-plugged:44f53eb4-50b1-4764-8a1c-143764a0a324 for instance 074f3469-3bbd-46df-8286-3a57f91798e2 on n-h1-861333-8 Oct 19 03:20:58.168196 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-eff11f80-e737-4a63-9d6f-441b7124e9ee req-a4d4eccd-5636-4a5c-88b4-56eb65d1c47c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034771 Oct 19 03:20:58.169718 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1064/2175] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:20:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:20:58.178864 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f337bee2-7dcc-4b00-96b2-a626ba6891fb tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:20:58.182709 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f337bee2-7dcc-4b00-96b2-a626ba6891fb tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 074f3469-3bbd-46df-8286-3a57f91798e2] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:20:58.190253 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f337bee2-7dcc-4b00-96b2-a626ba6891fb tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:58.191885 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f337bee2-7dcc-4b00-96b2-a626ba6891fb tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:58.193166 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f337bee2-7dcc-4b00-96b2-a626ba6891fb tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:58.193566 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f337bee2-7dcc-4b00-96b2-a626ba6891fb tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:58.193852 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f337bee2-7dcc-4b00-96b2-a626ba6891fb tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:58.194496 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f337bee2-7dcc-4b00-96b2-a626ba6891fb tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:58.549504 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-f337bee2-7dcc-4b00-96b2-a626ba6891fb tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:58.559274 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-f337bee2-7dcc-4b00-96b2-a626ba6891fb tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:58.560749 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-f337bee2-7dcc-4b00-96b2-a626ba6891fb tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:58.561992 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f337bee2-7dcc-4b00-96b2-a626ba6891fb tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/074f3469-3bbd-46df-8286-3a57f91798e2" status: 200 len: 1280 microversion: 2.25 time: 0.391097 Oct 19 03:20:58.562561 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1065/2176] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:20:58 2022] GET /compute/v2.1/servers/074f3469-3bbd-46df-8286-3a57f91798e2 => generated 1280 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:20:58.567919 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-24fc77a5-2e49-46cd-9908-72d87307e5b1 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:20:58.568739 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-24fc77a5-2e49-46cd-9908-72d87307e5b1 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] [instance: 245ae0c1-c202-41c0-8f85-d5d99549f3ae] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:20:58.575413 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-24fc77a5-2e49-46cd-9908-72d87307e5b1 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:58.576378 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-24fc77a5-2e49-46cd-9908-72d87307e5b1 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:58.577036 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-24fc77a5-2e49-46cd-9908-72d87307e5b1 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:58.578025 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-24fc77a5-2e49-46cd-9908-72d87307e5b1 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:58.578739 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-24fc77a5-2e49-46cd-9908-72d87307e5b1 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:58.579409 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-24fc77a5-2e49-46cd-9908-72d87307e5b1 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:58.598618 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-24fc77a5-2e49-46cd-9908-72d87307e5b1 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] HTTP exception thrown: Instance 245ae0c1-c202-41c0-8f85-d5d99549f3ae could not be found. Oct 19 03:20:58.600387 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-24fc77a5-2e49-46cd-9908-72d87307e5b1 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Request method failure captured: Oct 19 03:20:58.600387 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/245ae0c1-c202-41c0-8f85-d5d99549f3ae HTTP/1.1 Oct 19 03:20:58.600387 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:20:58.600387 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:20:58.600387 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:20:58.600387 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:20:58.600387 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:20:58.600387 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:20:58.600387 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:20:58.600387 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:20:58.600387 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT2y5QS5fGXOCh8dCARu_-t2vnckF3uwZtfqi9DmHed6pMoXibNoREyH_7cDYk3t8P2qbQ1u564D6Sq50msRMl2YQVddoWmeJm48OR72Wl7OECfXwMpGVDHULH4PSkCmyy31jkBvdZSxqyCmIGP32xNgLbjMxF4SrMQTDektLd28zxNg Oct 19 03:20:58.600387 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:20:58.600387 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:20:58.600387 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:20:58.600387 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:20:58.600387 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:20:58.600387 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:20:58.600387 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: f9e436373e9e45efa03f08b33da619e8 Oct 19 03:20:58.600387 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1767182949 Oct 19 03:20:58.600387 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:20:58.600387 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:20:58.602207 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f9e436373e9e45efa03f08b33da619e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f9e436373e9e45efa03f08b33da619e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f9e436373e9e45efa03f08b33da619e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f9e436373e9e45efa03f08b33da619e8", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:20:58.602207 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1767182949 Oct 19 03:20:58.602207 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: f9e436373e9e45efa03f08b33da619e8 Oct 19 03:20:58.602207 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1767182949 Oct 19 03:20:58.602207 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ImagesOneServerNegativeTestJSON-1767182949-project Oct 19 03:20:58.602207 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:20:58.602207 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:20:58.602207 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 8824f20e6a1f478a99f90e1ba8f028fe Oct 19 03:20:58.602207 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1767182949-project Oct 19 03:20:58.602207 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:20:58.602207 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance 245ae0c1-c202-41c0-8f85-d5d99549f3ae could not be found. Oct 19 03:20:58.602207 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '245ae0c1-c202-41c0-8f85-d5d99549f3ae'} Oct 19 03:20:58.603108 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:20:58.603108 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:20:58.603108 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:20:58.603108 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:20:58.603108 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:20:58.603108 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:20:58.603108 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:20:58.603108 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:20:58.603108 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:20:58.603108 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:20:58.603108 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 245ae0c1-c202-41c0-8f85-d5d99549f3ae could not be found. Oct 19 03:20:58.603108 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:20:58.603108 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:20:58.603108 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:20:58.603108 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:20:58.603108 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:20:58.603108 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:20:58.603108 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:20:58.603108 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:20:58.603108 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:20:58.604531 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:20:58.604531 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:20:58.604531 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:20:58.604531 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:20:58.604531 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:20:58.604531 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:20:58.604531 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:20:58.604531 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 245ae0c1-c202-41c0-8f85-d5d99549f3ae could not be found. Oct 19 03:20:58.604531 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:20:58.604531 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:20:58.604531 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:20:58.604531 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:20:58.604531 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:20:58.604531 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:20:58.604531 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:20:58.604531 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:20:58.604531 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 245ae0c1-c202-41c0-8f85-d5d99549f3ae could not be found. Oct 19 03:20:58.604531 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:20:58.605898 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-24fc77a5-2e49-46cd-9908-72d87307e5b1 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Returning 404 to user: Instance 245ae0c1-c202-41c0-8f85-d5d99549f3ae could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:20:58.605898 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-24fc77a5-2e49-46cd-9908-72d87307e5b1 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] 10.222.0.52 "GET /compute/v2.1/servers/245ae0c1-c202-41c0-8f85-d5d99549f3ae" status: 404 len: 111 microversion: 2.1 time: 0.038207 Oct 19 03:20:58.605898 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1066/2177] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:20:58 2022] GET /compute/v2.1/servers/245ae0c1-c202-41c0-8f85-d5d99549f3ae => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:20:58.607236 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b12a785b-3d5b-438b-9ee6-b22e8e86fce0 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:20:58.607884 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b12a785b-3d5b-438b-9ee6-b22e8e86fce0 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] [instance: fee1d282-ae3a-4792-ba8f-a19e498c8853] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:20:58.615625 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b12a785b-3d5b-438b-9ee6-b22e8e86fce0 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:58.615625 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b12a785b-3d5b-438b-9ee6-b22e8e86fce0 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:58.615625 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b12a785b-3d5b-438b-9ee6-b22e8e86fce0 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:58.616385 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b12a785b-3d5b-438b-9ee6-b22e8e86fce0 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:58.616877 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b12a785b-3d5b-438b-9ee6-b22e8e86fce0 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:58.617339 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b12a785b-3d5b-438b-9ee6-b22e8e86fce0 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:58.955441 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b12a785b-3d5b-438b-9ee6-b22e8e86fce0 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '152fa52a83b14c71bf86b22d77a73625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1606da859950484e9aa949e5c59c0a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:58.964669 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ad80e7c5-eede-40c1-8ef3-0e782ff5435f tempest-FloatingIPDetailsTestJSON-1662489570 tempest-FloatingIPDetailsTestJSON-1662489570-project] 10.222.0.52 "DELETE /compute/v2.1/os-floating-ips/07d92caa-a8cf-401b-b5a9-f691b21d62b7" status: 202 len: 0 microversion: 2.1 time: 2.103190 Oct 19 03:20:58.966947 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1112/2178] 10.222.0.52 () {58 vars in 1263 bytes} [Wed Oct 19 03:20:56 2022] DELETE /compute/v2.1/os-floating-ips/07d92caa-a8cf-401b-b5a9-f691b21d62b7 => generated 0 bytes in 2108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:20:58.969486 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b12a785b-3d5b-438b-9ee6-b22e8e86fce0 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] 10.222.0.52 "GET /compute/v2.1/servers/fee1d282-ae3a-4792-ba8f-a19e498c8853" status: 200 len: 1504 microversion: 2.1 time: 0.365420 Oct 19 03:20:58.974678 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1067/2179] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:20:58 2022] GET /compute/v2.1/servers/fee1d282-ae3a-4792-ba8f-a19e498c8853 => generated 1504 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:20:58.979251 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9fa3f45d-afe5-40c2-9f85-920f84ba4ac7 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:20:58.982022 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9fa3f45d-afe5-40c2-9f85-920f84ba4ac7 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] [instance: 6888c8db-82ba-4072-b431-8d4fcf5f03e0] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:20:58.986808 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-79b6b851-a3da-4175-9c36-140cd69d2622 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1923317634", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:20:58.999732 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9fa3f45d-afe5-40c2-9f85-920f84ba4ac7 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:59.000530 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9fa3f45d-afe5-40c2-9f85-920f84ba4ac7 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:59.001703 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9fa3f45d-afe5-40c2-9f85-920f84ba4ac7 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:59.003996 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9fa3f45d-afe5-40c2-9f85-920f84ba4ac7 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:59.004696 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9fa3f45d-afe5-40c2-9f85-920f84ba4ac7 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:59.006720 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9fa3f45d-afe5-40c2-9f85-920f84ba4ac7 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:59.048811 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-79b6b851-a3da-4175-9c36-140cd69d2622 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] validate_networks() for [('2f96d8a2-32f5-44b2-88f4-374c3b78e3c5', None, None, None, None, None)] {{(pid=121134) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:20:59.379103 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-9fa3f45d-afe5-40c2-9f85-920f84ba4ac7 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4c5e4123c44508a5d4911a17c44231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a495ccfced47f29cb928d1ded20d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:20:59.389263 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9fa3f45d-afe5-40c2-9f85-920f84ba4ac7 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] 10.222.0.52 "GET /compute/v2.1/servers/6888c8db-82ba-4072-b431-8d4fcf5f03e0" status: 200 len: 1471 microversion: 2.1 time: 0.420283 Oct 19 03:20:59.390257 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1113/2180] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:20:58 2022] GET /compute/v2.1/servers/6888c8db-82ba-4072-b431-8d4fcf5f03e0 => generated 1471 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:20:59.405270 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-793fc933-0b4b-422e-961c-b9ea190b2f5a req-f0319556-a601-47fb-b3a8-27f781158df6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4adec402-e94f-4a41-ac77-68f6091b87f7", "tag": "1b205325-d228-42ec-97ef-c076cae51f44"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:20:59.419562 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-793fc933-0b4b-422e-961c-b9ea190b2f5a req-f0319556-a601-47fb-b3a8-27f781158df6 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:20:59.420463 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-793fc933-0b4b-422e-961c-b9ea190b2f5a req-f0319556-a601-47fb-b3a8-27f781158df6 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:20:59.421239 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-793fc933-0b4b-422e-961c-b9ea190b2f5a req-f0319556-a601-47fb-b3a8-27f781158df6 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:20:59.435305 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-793fc933-0b4b-422e-961c-b9ea190b2f5a req-f0319556-a601-47fb-b3a8-27f781158df6 service nova] Creating event network-changed:1b205325-d228-42ec-97ef-c076cae51f44 for instance 4adec402-e94f-4a41-ac77-68f6091b87f7 on n-h2-861333-8 Oct 19 03:20:59.440975 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-793fc933-0b4b-422e-961c-b9ea190b2f5a req-f0319556-a601-47fb-b3a8-27f781158df6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048258 Oct 19 03:20:59.442032 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1114/2181] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:20:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:20:59.447611 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-965f74a3-78f7-46ca-85ca-551e37a2952d tempest-FloatingIPDetailsTestJSON-1662489570 tempest-FloatingIPDetailsTestJSON-1662489570-project] Calling method '.version_select at 0x7fc130b2d160>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:00.616545 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-79b6b851-a3da-4175-9c36-140cd69d2622 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Flavor limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:21:00.617617 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-79b6b851-a3da-4175-9c36-140cd69d2622 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Image limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:21:00.618401 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-79b6b851-a3da-4175-9c36-140cd69d2622 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Flavor pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:21:00.620018 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-79b6b851-a3da-4175-9c36-140cd69d2622 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Image pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:21:00.621815 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-79b6b851-a3da-4175-9c36-140cd69d2622 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:21:00.646480 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-79b6b851-a3da-4175-9c36-140cd69d2622 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:00.647395 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-79b6b851-a3da-4175-9c36-140cd69d2622 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:00.648104 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-79b6b851-a3da-4175-9c36-140cd69d2622 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:00.650225 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-79b6b851-a3da-4175-9c36-140cd69d2622 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:00.652025 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-79b6b851-a3da-4175-9c36-140cd69d2622 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:00.654065 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-79b6b851-a3da-4175-9c36-140cd69d2622 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:00.680613 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-79b6b851-a3da-4175-9c36-140cd69d2622 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Getting quotas for project f9e436373e9e45efa03f08b33da619e8. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:21:00.687827 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-79b6b851-a3da-4175-9c36-140cd69d2622 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Getting quotas for user 8824f20e6a1f478a99f90e1ba8f028fe and project f9e436373e9e45efa03f08b33da619e8. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:21:00.702553 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=100 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:21:00.704617 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-79b6b851-a3da-4175-9c36-140cd69d2622 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Going to run 1 instances... {{(pid=121134) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:21:00.711394 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-79b6b851-a3da-4175-9c36-140cd69d2622 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] [instance: 67358716-e31b-4e54-b23b-592845c983ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:21:00.884888 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-79b6b851-a3da-4175-9c36-140cd69d2622 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.908605 Oct 19 03:21:00.892365 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1068/2182] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:20:58 2022] POST /compute/v2.1/servers => generated 383 bytes in 1921 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 03:21:00.898233 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d0542753-abf4-4556-9e01-407910a471b9 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Action: 'create', calling method: .version_select at 0x7fc13056fe50>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1579288161", "description": "tempest-description-365354561"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:21:01.807447 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d0542753-abf4-4556-9e01-407910a471b9 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 250 microversion: 2.1 time: 0.913635 Oct 19 03:21:01.811118 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1069/2183] 10.222.0.52 () {60 vars in 1180 bytes} [Wed Oct 19 03:21:00 2022] POST /compute/v2.1/os-security-groups => generated 250 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:21:01.822297 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-029f470a-34cd-4683-851c-dd83dbfbbedd tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:01.823293 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-029f470a-34cd-4683-851c-dd83dbfbbedd tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] [instance: 4adec402-e94f-4a41-ac77-68f6091b87f7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:01.835312 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-029f470a-34cd-4683-851c-dd83dbfbbedd tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:01.836660 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-029f470a-34cd-4683-851c-dd83dbfbbedd tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:01.837492 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-029f470a-34cd-4683-851c-dd83dbfbbedd tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:01.838912 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-029f470a-34cd-4683-851c-dd83dbfbbedd tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:01.839981 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-029f470a-34cd-4683-851c-dd83dbfbbedd tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:01.840915 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-029f470a-34cd-4683-851c-dd83dbfbbedd tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:01.859687 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-965f74a3-78f7-46ca-85ca-551e37a2952d tempest-FloatingIPDetailsTestJSON-1662489570 tempest-FloatingIPDetailsTestJSON-1662489570-project] 10.222.0.52 "DELETE /compute/v2.1/os-floating-ips/90b30f6f-6020-46c9-b2ea-602eb1aa0573" status: 202 len: 0 microversion: 2.1 time: 2.416137 Oct 19 03:21:01.860971 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1115/2184] 10.222.0.52 () {58 vars in 1263 bytes} [Wed Oct 19 03:20:59 2022] DELETE /compute/v2.1/os-floating-ips/90b30f6f-6020-46c9-b2ea-602eb1aa0573 => generated 0 bytes in 2418 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:21:01.867598 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d309cbf9-8142-400d-a16d-dd32b78120c4 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:01.868999 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d309cbf9-8142-400d-a16d-dd32b78120c4 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 074f3469-3bbd-46df-8286-3a57f91798e2] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:01.879142 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d309cbf9-8142-400d-a16d-dd32b78120c4 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:01.909080 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d309cbf9-8142-400d-a16d-dd32b78120c4 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:01.909080 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d309cbf9-8142-400d-a16d-dd32b78120c4 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:01.909080 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d309cbf9-8142-400d-a16d-dd32b78120c4 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:01.909080 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d309cbf9-8142-400d-a16d-dd32b78120c4 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:01.909824 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d309cbf9-8142-400d-a16d-dd32b78120c4 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:02.235944 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-029f470a-34cd-4683-851c-dd83dbfbbedd tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:02.247213 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-029f470a-34cd-4683-851c-dd83dbfbbedd tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:02.248816 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-029f470a-34cd-4683-851c-dd83dbfbbedd tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:02.250557 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-029f470a-34cd-4683-851c-dd83dbfbbedd tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] 10.222.0.52 "GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7" status: 200 len: 1874 microversion: 2.32 time: 0.437709 Oct 19 03:21:02.251872 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1070/2185] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:21:01 2022] GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7 => generated 1874 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:21:02.253297 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d309cbf9-8142-400d-a16d-dd32b78120c4 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:02.256913 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9602d8be-115d-478b-b9c6-b598d4298bd7 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:02.257833 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9602d8be-115d-478b-b9c6-b598d4298bd7 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] [instance: 6888c8db-82ba-4072-b431-8d4fcf5f03e0] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:02.275823 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:21:02.279475 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d309cbf9-8142-400d-a16d-dd32b78120c4 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:02.279692 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9602d8be-115d-478b-b9c6-b598d4298bd7 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:02.282033 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d309cbf9-8142-400d-a16d-dd32b78120c4 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:02.283691 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d309cbf9-8142-400d-a16d-dd32b78120c4 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/074f3469-3bbd-46df-8286-3a57f91798e2" status: 200 len: 1475 microversion: 2.25 time: 0.421407 Oct 19 03:21:02.284894 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9602d8be-115d-478b-b9c6-b598d4298bd7 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:02.285208 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1116/2186] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:21:01 2022] GET /compute/v2.1/servers/074f3469-3bbd-46df-8286-3a57f91798e2 => generated 1475 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:21:02.285349 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9602d8be-115d-478b-b9c6-b598d4298bd7 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:02.286138 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9602d8be-115d-478b-b9c6-b598d4298bd7 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:02.286596 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9602d8be-115d-478b-b9c6-b598d4298bd7 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:02.290631 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-240ec216-dd51-44ff-964b-f801ba8c3471 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:02.291485 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-240ec216-dd51-44ff-964b-f801ba8c3471 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] [instance: 67358716-e31b-4e54-b23b-592845c983ea] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:02.293326 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9602d8be-115d-478b-b9c6-b598d4298bd7 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:02.358084 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-240ec216-dd51-44ff-964b-f801ba8c3471 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8824f20e6a1f478a99f90e1ba8f028fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e436373e9e45efa03f08b33da619e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:02.367863 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-240ec216-dd51-44ff-964b-f801ba8c3471 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] 10.222.0.52 "GET /compute/v2.1/servers/67358716-e31b-4e54-b23b-592845c983ea" status: 200 len: 1225 microversion: 2.1 time: 0.081207 Oct 19 03:21:02.369045 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1117/2187] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:21:02 2022] GET /compute/v2.1/servers/67358716-e31b-4e54-b23b-592845c983ea => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:21:02.374646 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-1946caf9-414e-418f-8592-d6b0d496a010 req-7e9e5b50-a082-42ca-84ff-b6c095319546 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4adec402-e94f-4a41-ac77-68f6091b87f7", "tag": "e6dbfbc8-417d-4e7e-a4c5-055b2fa99fdc"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:21:02.394310 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-1946caf9-414e-418f-8592-d6b0d496a010 req-7e9e5b50-a082-42ca-84ff-b6c095319546 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:02.397574 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-1946caf9-414e-418f-8592-d6b0d496a010 req-7e9e5b50-a082-42ca-84ff-b6c095319546 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:02.403428 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-1946caf9-414e-418f-8592-d6b0d496a010 req-7e9e5b50-a082-42ca-84ff-b6c095319546 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:02.414808 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=7 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:21:02.417316 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-1946caf9-414e-418f-8592-d6b0d496a010 req-7e9e5b50-a082-42ca-84ff-b6c095319546 service nova] Creating event network-changed:e6dbfbc8-417d-4e7e-a4c5-055b2fa99fdc for instance 4adec402-e94f-4a41-ac77-68f6091b87f7 on n-h2-861333-8 Oct 19 03:21:02.422555 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-1946caf9-414e-418f-8592-d6b0d496a010 req-7e9e5b50-a082-42ca-84ff-b6c095319546 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052017 Oct 19 03:21:02.423908 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1118/2188] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:21:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:21:02.436792 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-db517646-0af5-4817-884a-d1d988d023ef tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1579288161"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:21:02.441117 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-db517646-0af5-4817-884a-d1d988d023ef tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] [instance: fee1d282-ae3a-4792-ba8f-a19e498c8853] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:02.447445 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-db517646-0af5-4817-884a-d1d988d023ef tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:02.448003 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-db517646-0af5-4817-884a-d1d988d023ef tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:02.448644 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-db517646-0af5-4817-884a-d1d988d023ef tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:02.449645 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-db517646-0af5-4817-884a-d1d988d023ef tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:02.450821 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-db517646-0af5-4817-884a-d1d988d023ef tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:02.451825 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-db517646-0af5-4817-884a-d1d988d023ef tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:02.662537 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9602d8be-115d-478b-b9c6-b598d4298bd7 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4c5e4123c44508a5d4911a17c44231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a495ccfced47f29cb928d1ded20d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:02.673236 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9602d8be-115d-478b-b9c6-b598d4298bd7 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] 10.222.0.52 "GET /compute/v2.1/servers/6888c8db-82ba-4072-b431-8d4fcf5f03e0" status: 200 len: 1471 microversion: 2.1 time: 0.419827 Oct 19 03:21:02.674288 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1071/2189] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:21:02 2022] GET /compute/v2.1/servers/6888c8db-82ba-4072-b431-8d4fcf5f03e0 => generated 1471 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:21:02.680955 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ceeb95aa-95fe-4f04-91cd-3111d72e02ca tempest-FloatingIPDetailsTestJSON-1662489570 tempest-FloatingIPDetailsTestJSON-1662489570-project] Calling method '.version_select at 0x7fc135083f70>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:02.985660 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.network.security_group_api [None req-db517646-0af5-4817-884a-d1d988d023ef tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Adding security group 21a3128c-b3c3-4439-a00c-6c514bb3c5b5 to port a0fe25a1-1468-4c11-9af9-8321e13e7e0f Oct 19 03:21:04.815164 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-db517646-0af5-4817-884a-d1d988d023ef tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] 10.222.0.52 "POST /compute/v2.1/servers/fee1d282-ae3a-4792-ba8f-a19e498c8853/action" status: 202 len: 0 microversion: 2.1 time: 2.388827 Oct 19 03:21:04.825120 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1119/2190] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:21:02 2022] POST /compute/v2.1/servers/fee1d282-ae3a-4792-ba8f-a19e498c8853/action => generated 0 bytes in 2400 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:21:04.832338 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a417dcc1-7e3c-4fee-a66e-ccd52ed060a0 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:04.833005 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a417dcc1-7e3c-4fee-a66e-ccd52ed060a0 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] [instance: 074f3469-3bbd-46df-8286-3a57f91798e2] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:04.842336 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a417dcc1-7e3c-4fee-a66e-ccd52ed060a0 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:04.843140 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a417dcc1-7e3c-4fee-a66e-ccd52ed060a0 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:04.845473 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a417dcc1-7e3c-4fee-a66e-ccd52ed060a0 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:04.846848 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a417dcc1-7e3c-4fee-a66e-ccd52ed060a0 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:04.847499 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a417dcc1-7e3c-4fee-a66e-ccd52ed060a0 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:04.848101 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a417dcc1-7e3c-4fee-a66e-ccd52ed060a0 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:05.206772 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-a417dcc1-7e3c-4fee-a66e-ccd52ed060a0 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lazy-loading 'services' on Instance uuid 074f3469-3bbd-46df-8286-3a57f91798e2 {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:21:05.220823 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a417dcc1-7e3c-4fee-a66e-ccd52ed060a0 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/074f3469-3bbd-46df-8286-3a57f91798e2" status: 200 len: 1967 microversion: 2.25 time: 0.393173 Oct 19 03:21:05.225524 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1120/2191] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:21:04 2022] GET /compute/v2.1/servers/074f3469-3bbd-46df-8286-3a57f91798e2 => generated 1967 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:21:05.230587 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4de006df-e3ef-44b5-8079-a6315a6de331 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:05.231206 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4de006df-e3ef-44b5-8079-a6315a6de331 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] [instance: 4adec402-e94f-4a41-ac77-68f6091b87f7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:05.238227 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4de006df-e3ef-44b5-8079-a6315a6de331 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:05.238912 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4de006df-e3ef-44b5-8079-a6315a6de331 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:05.239368 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4de006df-e3ef-44b5-8079-a6315a6de331 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:05.240072 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4de006df-e3ef-44b5-8079-a6315a6de331 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:05.240554 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4de006df-e3ef-44b5-8079-a6315a6de331 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:05.240968 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4de006df-e3ef-44b5-8079-a6315a6de331 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:05.618502 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ceeb95aa-95fe-4f04-91cd-3111d72e02ca tempest-FloatingIPDetailsTestJSON-1662489570 tempest-FloatingIPDetailsTestJSON-1662489570-project] 10.222.0.52 "DELETE /compute/v2.1/os-floating-ips/980c4022-fea3-41e7-99c0-f428f26d646b" status: 202 len: 0 microversion: 2.1 time: 2.942619 Oct 19 03:21:05.622415 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1072/2192] 10.222.0.52 () {58 vars in 1263 bytes} [Wed Oct 19 03:21:02 2022] DELETE /compute/v2.1/os-floating-ips/980c4022-fea3-41e7-99c0-f428f26d646b => generated 0 bytes in 2945 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:21:05.626073 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-03908e32-7ec5-40aa-af47-9f76b85600b1 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:05.626519 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-03908e32-7ec5-40aa-af47-9f76b85600b1 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] [instance: 67358716-e31b-4e54-b23b-592845c983ea] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:05.638895 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-03908e32-7ec5-40aa-af47-9f76b85600b1 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:05.639753 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-03908e32-7ec5-40aa-af47-9f76b85600b1 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:05.640488 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-03908e32-7ec5-40aa-af47-9f76b85600b1 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:05.642531 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-03908e32-7ec5-40aa-af47-9f76b85600b1 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:05.647235 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-03908e32-7ec5-40aa-af47-9f76b85600b1 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:05.647993 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-03908e32-7ec5-40aa-af47-9f76b85600b1 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:05.699909 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4de006df-e3ef-44b5-8079-a6315a6de331 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:05.710786 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4de006df-e3ef-44b5-8079-a6315a6de331 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:05.712537 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4de006df-e3ef-44b5-8079-a6315a6de331 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:05.714744 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4de006df-e3ef-44b5-8079-a6315a6de331 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] 10.222.0.52 "GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7" status: 200 len: 1874 microversion: 2.32 time: 0.487600 Oct 19 03:21:05.715573 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1121/2193] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:21:05 2022] GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7 => generated 1874 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:21:05.741575 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-be6ccb42-a738-49b9-9820-a36a056cb536 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:05.746992 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-be6ccb42-a738-49b9-9820-a36a056cb536 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '28ec45c74dcd448e924be40b1abfbc4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce8d13fab4fe4725a4759519818113f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:05.748013 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-be6ccb42-a738-49b9-9820-a36a056cb536 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Searching by: {'deleted': False, 'project_id': 'ce8d13fab4fe4725a4759519818113f0'} {{(pid=121135) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 03:21:05.753269 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:21:05.755446 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-be6ccb42-a738-49b9-9820-a36a056cb536 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:05.756143 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-be6ccb42-a738-49b9-9820-a36a056cb536 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:05.767560 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-03908e32-7ec5-40aa-af47-9f76b85600b1 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8824f20e6a1f478a99f90e1ba8f028fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e436373e9e45efa03f08b33da619e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:05.768464 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-be6ccb42-a738-49b9-9820-a36a056cb536 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:05.772568 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-be6ccb42-a738-49b9-9820-a36a056cb536 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:05.778470 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-be6ccb42-a738-49b9-9820-a36a056cb536 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:05.778470 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-be6ccb42-a738-49b9-9820-a36a056cb536 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:05.780300 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-03908e32-7ec5-40aa-af47-9f76b85600b1 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] 10.222.0.52 "GET /compute/v2.1/servers/67358716-e31b-4e54-b23b-592845c983ea" status: 200 len: 1283 microversion: 2.1 time: 0.159083 Oct 19 03:21:05.781655 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1073/2194] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:21:05 2022] GET /compute/v2.1/servers/67358716-e31b-4e54-b23b-592845c983ea => generated 1283 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:21:05.787516 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4c6b1cfb-a309-446b-83e9-35dd46b0ae94 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:05.788421 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4c6b1cfb-a309-446b-83e9-35dd46b0ae94 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] [instance: 6888c8db-82ba-4072-b431-8d4fcf5f03e0] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:05.795848 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4c6b1cfb-a309-446b-83e9-35dd46b0ae94 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:05.796719 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4c6b1cfb-a309-446b-83e9-35dd46b0ae94 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:05.797428 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4c6b1cfb-a309-446b-83e9-35dd46b0ae94 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:05.798534 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4c6b1cfb-a309-446b-83e9-35dd46b0ae94 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:05.799502 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4c6b1cfb-a309-446b-83e9-35dd46b0ae94 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:05.800801 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4c6b1cfb-a309-446b-83e9-35dd46b0ae94 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:05.814380 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.multi_cell_list [None req-be6ccb42-a738-49b9-9820-a36a056cb536 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121135) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 03:21:05.851236 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-be6ccb42-a738-49b9-9820-a36a056cb536 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] 10.222.0.52 "GET /compute/v2.1/servers" status: 200 len: 344 microversion: 2.1 time: 0.116038 Oct 19 03:21:05.852234 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1122/2195] 10.222.0.52 () {58 vars in 1125 bytes} [Wed Oct 19 03:21:05 2022] GET /compute/v2.1/servers => generated 344 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:21:06.120023 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-46103fad-9f17-44e2-b01b-e7f79ea2f50c tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1583420694", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "networks": [{"uuid": "99edd0a7-1ab1-49c6-b3e8-36828942abe3"}]}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:21:06.131656 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-4c6b1cfb-a309-446b-83e9-35dd46b0ae94 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4c5e4123c44508a5d4911a17c44231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a495ccfced47f29cb928d1ded20d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:06.139664 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4c6b1cfb-a309-446b-83e9-35dd46b0ae94 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] 10.222.0.52 "GET /compute/v2.1/servers/6888c8db-82ba-4072-b431-8d4fcf5f03e0" status: 200 len: 1471 microversion: 2.1 time: 0.356631 Oct 19 03:21:06.165558 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1074/2196] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:21:05 2022] GET /compute/v2.1/servers/6888c8db-82ba-4072-b431-8d4fcf5f03e0 => generated 1471 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:21:06.170681 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-d288f40f-62bd-4c2e-bf02-6412cb66df98 req-db9da918-0d1e-4b93-b883-cc17eeaebca6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4adec402-e94f-4a41-ac77-68f6091b87f7", "tag": "0c443dcd-8e48-4b36-9300-0450bbd1b333"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:21:06.185702 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.network.neutron [None req-46103fad-9f17-44e2-b01b-e7f79ea2f50c tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] validate_networks() for [('99edd0a7-1ab1-49c6-b3e8-36828942abe3', None, None, None, None, None)] {{(pid=121135) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:21:06.190892 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-d288f40f-62bd-4c2e-bf02-6412cb66df98 req-db9da918-0d1e-4b93-b883-cc17eeaebca6 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:06.191251 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-d288f40f-62bd-4c2e-bf02-6412cb66df98 req-db9da918-0d1e-4b93-b883-cc17eeaebca6 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:06.191901 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-d288f40f-62bd-4c2e-bf02-6412cb66df98 req-db9da918-0d1e-4b93-b883-cc17eeaebca6 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:06.203897 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-d288f40f-62bd-4c2e-bf02-6412cb66df98 req-db9da918-0d1e-4b93-b883-cc17eeaebca6 service nova] Creating event network-changed:0c443dcd-8e48-4b36-9300-0450bbd1b333 for instance 4adec402-e94f-4a41-ac77-68f6091b87f7 on n-h2-861333-8 Oct 19 03:21:06.209311 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-d288f40f-62bd-4c2e-bf02-6412cb66df98 req-db9da918-0d1e-4b93-b883-cc17eeaebca6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042474 Oct 19 03:21:06.210504 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1075/2197] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:21:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:21:06.215904 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-269bf3ba-dc85-489e-b558-adcb0321423e tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1579288161"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:21:06.216774 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-269bf3ba-dc85-489e-b558-adcb0321423e tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] [instance: fee1d282-ae3a-4792-ba8f-a19e498c8853] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:06.224248 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-269bf3ba-dc85-489e-b558-adcb0321423e tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:06.225270 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-269bf3ba-dc85-489e-b558-adcb0321423e tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:06.226357 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-269bf3ba-dc85-489e-b558-adcb0321423e tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:06.227441 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-269bf3ba-dc85-489e-b558-adcb0321423e tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:06.228094 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-269bf3ba-dc85-489e-b558-adcb0321423e tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:06.228726 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-269bf3ba-dc85-489e-b558-adcb0321423e tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:06.233163 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=98 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:21:06.982375 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.network.security_group_api [None req-269bf3ba-dc85-489e-b558-adcb0321423e tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Removing security group 21a3128c-b3c3-4439-a00c-6c514bb3c5b5 from port a0fe25a1-1468-4c11-9af9-8321e13e7e0f Oct 19 03:21:08.337896 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-46103fad-9f17-44e2-b01b-e7f79ea2f50c tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Flavor limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:21:08.340959 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-46103fad-9f17-44e2-b01b-e7f79ea2f50c tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Image limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:21:08.342671 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-46103fad-9f17-44e2-b01b-e7f79ea2f50c tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Flavor pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:21:08.343366 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-46103fad-9f17-44e2-b01b-e7f79ea2f50c tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Image pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:21:08.344132 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-46103fad-9f17-44e2-b01b-e7f79ea2f50c tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:21:08.369936 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-46103fad-9f17-44e2-b01b-e7f79ea2f50c tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:08.371357 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-46103fad-9f17-44e2-b01b-e7f79ea2f50c tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:08.373774 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-46103fad-9f17-44e2-b01b-e7f79ea2f50c tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:08.375741 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-46103fad-9f17-44e2-b01b-e7f79ea2f50c tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:08.381086 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-46103fad-9f17-44e2-b01b-e7f79ea2f50c tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:08.403429 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-46103fad-9f17-44e2-b01b-e7f79ea2f50c tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:08.453913 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-46103fad-9f17-44e2-b01b-e7f79ea2f50c tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Getting quotas for project 686dbeeaed0b44538a9bbc54d457a720. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:21:08.488777 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-46103fad-9f17-44e2-b01b-e7f79ea2f50c tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Getting quotas for user 57008d884859417ebc1456b55ec3f6e0 and project 686dbeeaed0b44538a9bbc54d457a720. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:21:08.523910 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-46103fad-9f17-44e2-b01b-e7f79ea2f50c tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Going to run 1 instances... {{(pid=121135) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:21:08.527028 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-46103fad-9f17-44e2-b01b-e7f79ea2f50c tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: 6fd536f4-6456-4291-8a11-2c48a453932a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121135) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:21:08.691441 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-46103fad-9f17-44e2-b01b-e7f79ea2f50c tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.837713 Oct 19 03:21:08.694942 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1123/2198] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:21:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 2839 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 03:21:08.704916 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4674f5e3-40e5-4a26-b25d-407c91205af6 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:08.706201 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4674f5e3-40e5-4a26-b25d-407c91205af6 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] [instance: 074f3469-3bbd-46df-8286-3a57f91798e2] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:08.719383 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4674f5e3-40e5-4a26-b25d-407c91205af6 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:08.720198 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4674f5e3-40e5-4a26-b25d-407c91205af6 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:08.723935 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4674f5e3-40e5-4a26-b25d-407c91205af6 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:08.739780 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4674f5e3-40e5-4a26-b25d-407c91205af6 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:08.741718 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4674f5e3-40e5-4a26-b25d-407c91205af6 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:08.743175 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4674f5e3-40e5-4a26-b25d-407c91205af6 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:09.273225 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-269bf3ba-dc85-489e-b558-adcb0321423e tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] 10.222.0.52 "POST /compute/v2.1/servers/fee1d282-ae3a-4792-ba8f-a19e498c8853/action" status: 202 len: 0 microversion: 2.1 time: 3.060563 Oct 19 03:21:09.274012 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1076/2199] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:21:06 2022] POST /compute/v2.1/servers/fee1d282-ae3a-4792-ba8f-a19e498c8853/action => generated 0 bytes in 3063 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:21:09.280734 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2c649f07-c94d-4f2d-bea5-6606dbddea9a tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:09.288022 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-2c649f07-c94d-4f2d-bea5-6606dbddea9a tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '28ec45c74dcd448e924be40b1abfbc4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce8d13fab4fe4725a4759519818113f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:09.289484 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2c649f07-c94d-4f2d-bea5-6606dbddea9a tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Searching by: {'deleted': False, 'project_id': 'ce8d13fab4fe4725a4759519818113f0'} {{(pid=121134) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 03:21:09.302303 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2c649f07-c94d-4f2d-bea5-6606dbddea9a tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:09.302800 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2c649f07-c94d-4f2d-bea5-6606dbddea9a tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:09.303481 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2c649f07-c94d-4f2d-bea5-6606dbddea9a tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:09.306410 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2c649f07-c94d-4f2d-bea5-6606dbddea9a tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:09.306968 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2c649f07-c94d-4f2d-bea5-6606dbddea9a tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:09.307735 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2c649f07-c94d-4f2d-bea5-6606dbddea9a tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:09.326347 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-4674f5e3-40e5-4a26-b25d-407c91205af6 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lazy-loading 'services' on Instance uuid 074f3469-3bbd-46df-8286-3a57f91798e2 {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:21:09.348041 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4674f5e3-40e5-4a26-b25d-407c91205af6 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/074f3469-3bbd-46df-8286-3a57f91798e2" status: 200 len: 1967 microversion: 2.25 time: 0.651210 Oct 19 03:21:09.351651 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1124/2200] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:21:08 2022] GET /compute/v2.1/servers/074f3469-3bbd-46df-8286-3a57f91798e2 => generated 1967 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:21:09.358856 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d41d524d-b88e-4d5e-81f3-b22fff020f83 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:09.359509 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d41d524d-b88e-4d5e-81f3-b22fff020f83 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] [instance: 4adec402-e94f-4a41-ac77-68f6091b87f7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:09.370700 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d41d524d-b88e-4d5e-81f3-b22fff020f83 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:09.371275 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d41d524d-b88e-4d5e-81f3-b22fff020f83 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:09.376481 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d41d524d-b88e-4d5e-81f3-b22fff020f83 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:09.376639 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.multi_cell_list [None req-2c649f07-c94d-4f2d-bea5-6606dbddea9a tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121134) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 03:21:09.376756 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d41d524d-b88e-4d5e-81f3-b22fff020f83 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:09.376756 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d41d524d-b88e-4d5e-81f3-b22fff020f83 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:09.376756 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d41d524d-b88e-4d5e-81f3-b22fff020f83 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:09.464027 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-2c649f07-c94d-4f2d-bea5-6606dbddea9a tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ec45c74dcd448e924be40b1abfbc4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce8d13fab4fe4725a4759519818113f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:09.478104 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2c649f07-c94d-4f2d-bea5-6606dbddea9a tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:09.482083 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2c649f07-c94d-4f2d-bea5-6606dbddea9a tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:09.482745 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2c649f07-c94d-4f2d-bea5-6606dbddea9a tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:10.149301 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2c649f07-c94d-4f2d-bea5-6606dbddea9a tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] 10.222.0.52 "GET /compute/v2.1/servers/detail" status: 200 len: 1605 microversion: 2.1 time: 0.873363 Oct 19 03:21:10.151020 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1077/2201] 10.222.0.52 () {58 vars in 1146 bytes} [Wed Oct 19 03:21:09 2022] GET /compute/v2.1/servers/detail => generated 1605 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:21:10.160704 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6890b7ac-d9c1-4d08-bd00-bfcbdeb02e25 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:10.161718 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6890b7ac-d9c1-4d08-bd00-bfcbdeb02e25 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] [instance: 67358716-e31b-4e54-b23b-592845c983ea] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:10.168296 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6890b7ac-d9c1-4d08-bd00-bfcbdeb02e25 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:10.170252 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6890b7ac-d9c1-4d08-bd00-bfcbdeb02e25 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:10.171723 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6890b7ac-d9c1-4d08-bd00-bfcbdeb02e25 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:10.172960 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6890b7ac-d9c1-4d08-bd00-bfcbdeb02e25 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:10.173622 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6890b7ac-d9c1-4d08-bd00-bfcbdeb02e25 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:10.174873 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6890b7ac-d9c1-4d08-bd00-bfcbdeb02e25 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:10.321871 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d41d524d-b88e-4d5e-81f3-b22fff020f83 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:10.368629 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d41d524d-b88e-4d5e-81f3-b22fff020f83 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:10.371837 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d41d524d-b88e-4d5e-81f3-b22fff020f83 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:10.371837 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d41d524d-b88e-4d5e-81f3-b22fff020f83 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] 10.222.0.52 "GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7" status: 200 len: 1874 microversion: 2.32 time: 1.018854 Oct 19 03:21:10.375738 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1125/2202] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:21:09 2022] GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7 => generated 1874 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:21:10.381890 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-25cef61a-13dd-4fca-94b0-8ec44154ed10 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:10.382456 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-25cef61a-13dd-4fca-94b0-8ec44154ed10 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] [instance: 6888c8db-82ba-4072-b431-8d4fcf5f03e0] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:10.412830 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-25cef61a-13dd-4fca-94b0-8ec44154ed10 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:10.413337 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-25cef61a-13dd-4fca-94b0-8ec44154ed10 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:10.421679 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-25cef61a-13dd-4fca-94b0-8ec44154ed10 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:10.422472 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-25cef61a-13dd-4fca-94b0-8ec44154ed10 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:10.422958 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-25cef61a-13dd-4fca-94b0-8ec44154ed10 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:10.423404 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-25cef61a-13dd-4fca-94b0-8ec44154ed10 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:10.553180 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-6890b7ac-d9c1-4d08-bd00-bfcbdeb02e25 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8824f20e6a1f478a99f90e1ba8f028fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e436373e9e45efa03f08b33da619e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:10.573244 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6890b7ac-d9c1-4d08-bd00-bfcbdeb02e25 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] 10.222.0.52 "GET /compute/v2.1/servers/67358716-e31b-4e54-b23b-592845c983ea" status: 200 len: 1325 microversion: 2.1 time: 0.418826 Oct 19 03:21:10.574861 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1078/2203] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:21:10 2022] GET /compute/v2.1/servers/67358716-e31b-4e54-b23b-592845c983ea => generated 1325 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:21:10.596162 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-b27455d1-38d5-4a52-a659-1209278ae6e3 req-273e62cd-28e7-402f-9fad-27f9a10d79c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fee1d282-ae3a-4792-ba8f-a19e498c8853", "tag": "a0fe25a1-1468-4c11-9af9-8321e13e7e0f"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:21:10.601864 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-b27455d1-38d5-4a52-a659-1209278ae6e3 req-273e62cd-28e7-402f-9fad-27f9a10d79c9 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:10.602590 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-b27455d1-38d5-4a52-a659-1209278ae6e3 req-273e62cd-28e7-402f-9fad-27f9a10d79c9 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:10.605171 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-b27455d1-38d5-4a52-a659-1209278ae6e3 req-273e62cd-28e7-402f-9fad-27f9a10d79c9 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:10.632129 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-b27455d1-38d5-4a52-a659-1209278ae6e3 req-273e62cd-28e7-402f-9fad-27f9a10d79c9 service nova] Creating event network-changed:a0fe25a1-1468-4c11-9af9-8321e13e7e0f for instance fee1d282-ae3a-4792-ba8f-a19e498c8853 on n-h2-861333-8 Oct 19 03:21:10.638573 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-b27455d1-38d5-4a52-a659-1209278ae6e3 req-273e62cd-28e7-402f-9fad-27f9a10d79c9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061687 Oct 19 03:21:10.639860 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1079/2204] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:21:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:21:10.653350 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e4c06883-fa53-4cc7-8227-30ed1ee9cceb tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:10.654356 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e4c06883-fa53-4cc7-8227-30ed1ee9cceb tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: 6fd536f4-6456-4291-8a11-2c48a453932a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:10.661886 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e4c06883-fa53-4cc7-8227-30ed1ee9cceb tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:10.662732 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e4c06883-fa53-4cc7-8227-30ed1ee9cceb tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:10.663472 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e4c06883-fa53-4cc7-8227-30ed1ee9cceb tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:10.664513 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e4c06883-fa53-4cc7-8227-30ed1ee9cceb tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:10.665180 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e4c06883-fa53-4cc7-8227-30ed1ee9cceb tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:10.665884 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e4c06883-fa53-4cc7-8227-30ed1ee9cceb tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:10.777672 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e4c06883-fa53-4cc7-8227-30ed1ee9cceb tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:10.789808 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e4c06883-fa53-4cc7-8227-30ed1ee9cceb tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/6fd536f4-6456-4291-8a11-2c48a453932a" status: 200 len: 1212 microversion: 2.1 time: 0.147901 Oct 19 03:21:10.793095 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1080/2205] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:21:10 2022] GET /compute/v2.1/servers/6fd536f4-6456-4291-8a11-2c48a453932a => generated 1212 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:21:10.815677 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5e41394d-0ac6-4635-b3e6-ca1c280833dc tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Action: 'create', calling method: .version_select at 0x7fc131077dc0>, body: {"pool": null} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:21:10.829101 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-25cef61a-13dd-4fca-94b0-8ec44154ed10 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4c5e4123c44508a5d4911a17c44231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a495ccfced47f29cb928d1ded20d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:10.844780 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-25cef61a-13dd-4fca-94b0-8ec44154ed10 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] 10.222.0.52 "GET /compute/v2.1/servers/6888c8db-82ba-4072-b431-8d4fcf5f03e0" status: 200 len: 1477 microversion: 2.1 time: 0.463811 Oct 19 03:21:10.844780 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1126/2206] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:21:10 2022] GET /compute/v2.1/servers/6888c8db-82ba-4072-b431-8d4fcf5f03e0 => generated 1477 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:21:10.856133 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-074cd3ef-b2c3-43e3-bc23-186669e1163f tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:10.870004 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-074cd3ef-b2c3-43e3-bc23-186669e1163f tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:10.870654 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-074cd3ef-b2c3-43e3-bc23-186669e1163f tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:10.871446 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-074cd3ef-b2c3-43e3-bc23-186669e1163f tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:10.874106 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-074cd3ef-b2c3-43e3-bc23-186669e1163f tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:10.875005 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-074cd3ef-b2c3-43e3-bc23-186669e1163f tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:10.876717 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-074cd3ef-b2c3-43e3-bc23-186669e1163f tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:10.958309 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-074cd3ef-b2c3-43e3-bc23-186669e1163f tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.114395 Oct 19 03:21:10.962454 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1127/2207] 10.222.0.52 () {60 vars in 1217 bytes} [Wed Oct 19 03:21:10 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 03:21:10.984686 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4bde5b40-3b98-4aab-9973-4bfbceae9178 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:10.996614 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4bde5b40-3b98-4aab-9973-4bfbceae9178 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] 10.222.0.52 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.027651 Oct 19 03:21:10.997557 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1128/2208] 10.222.0.52 () {58 vars in 1137 bytes} [Wed Oct 19 03:21:10 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:21:11.004625 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-74884c3b-2219-4b1f-a598-e34c4a1527fc tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-861333-8", "block_migration": "auto"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:21:11.016014 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-74884c3b-2219-4b1f-a598-e34c4a1527fc tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] [instance: 074f3469-3bbd-46df-8286-3a57f91798e2] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:11.029082 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-74884c3b-2219-4b1f-a598-e34c4a1527fc tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:11.029891 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-74884c3b-2219-4b1f-a598-e34c4a1527fc tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:11.030713 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-74884c3b-2219-4b1f-a598-e34c4a1527fc tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:11.031633 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-74884c3b-2219-4b1f-a598-e34c4a1527fc tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:11.032289 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-74884c3b-2219-4b1f-a598-e34c4a1527fc tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:11.033645 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-74884c3b-2219-4b1f-a598-e34c4a1527fc tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:11.062356 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-74884c3b-2219-4b1f-a598-e34c4a1527fc tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lazy-loading 'flavor' on Instance uuid 074f3469-3bbd-46df-8286-3a57f91798e2 {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:21:11.083197 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-74884c3b-2219-4b1f-a598-e34c4a1527fc tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] [instance: 074f3469-3bbd-46df-8286-3a57f91798e2] Going to try to live migrate instance to n-h2-861333-8 {{(pid=121135) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 19 03:21:14.244725 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5e41394d-0ac6-4635-b3e6-ca1c280833dc tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] 10.222.0.52 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.449021 Oct 19 03:21:14.254001 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1081/2209] 10.222.0.52 () {60 vars in 1170 bytes} [Wed Oct 19 03:21:10 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3459 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:21:14.259418 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-90093860-bd88-4c45-8c5c-f22b5c368f4e req-7671bdc0-46c5-45e7-876d-80a66bb235a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6888c8db-82ba-4072-b431-8d4fcf5f03e0", "name": "network-vif-unplugged", "status": "completed", "tag": "7d06606b-5258-42bd-89b9-3f972fa9dcda"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:21:14.270666 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-90093860-bd88-4c45-8c5c-f22b5c368f4e req-7671bdc0-46c5-45e7-876d-80a66bb235a0 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:14.271219 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-90093860-bd88-4c45-8c5c-f22b5c368f4e req-7671bdc0-46c5-45e7-876d-80a66bb235a0 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:14.271656 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-90093860-bd88-4c45-8c5c-f22b5c368f4e req-7671bdc0-46c5-45e7-876d-80a66bb235a0 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:14.285147 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-90093860-bd88-4c45-8c5c-f22b5c368f4e req-7671bdc0-46c5-45e7-876d-80a66bb235a0 service nova] Creating event network-vif-unplugged:7d06606b-5258-42bd-89b9-3f972fa9dcda for instance 6888c8db-82ba-4072-b431-8d4fcf5f03e0 on n-h1-861333-8 Oct 19 03:21:14.292051 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-90093860-bd88-4c45-8c5c-f22b5c368f4e req-7671bdc0-46c5-45e7-876d-80a66bb235a0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036677 Oct 19 03:21:14.298194 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1082/2210] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:21:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:21:14.304759 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a7e8a92d-adad-442c-ae0e-828566366725 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:14.305843 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a7e8a92d-adad-442c-ae0e-828566366725 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] [instance: 951e236c-943a-4f8c-956d-ac7bbbf0e0e1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:14.312879 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a7e8a92d-adad-442c-ae0e-828566366725 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:14.313669 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a7e8a92d-adad-442c-ae0e-828566366725 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:14.314183 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a7e8a92d-adad-442c-ae0e-828566366725 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:14.314932 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a7e8a92d-adad-442c-ae0e-828566366725 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:14.315450 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a7e8a92d-adad-442c-ae0e-828566366725 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:14.315907 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a7e8a92d-adad-442c-ae0e-828566366725 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:14.343435 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a7e8a92d-adad-442c-ae0e-828566366725 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] [instance: 951e236c-943a-4f8c-956d-ac7bbbf0e0e1] Going to try to terminate instance {{(pid=121134) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:21:14.720094 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a7e8a92d-adad-442c-ae0e-828566366725 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] 10.222.0.52 "DELETE /compute/v2.1/servers/951e236c-943a-4f8c-956d-ac7bbbf0e0e1" status: 204 len: 0 microversion: 2.1 time: 0.415612 Oct 19 03:21:14.720094 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1083/2211] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:21:14 2022] DELETE /compute/v2.1/servers/951e236c-943a-4f8c-956d-ac7bbbf0e0e1 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:21:14.724913 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4e7aacf4-71d1-4fa1-8efa-95e8d5ba5d2b tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:14.729536 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4e7aacf4-71d1-4fa1-8efa-95e8d5ba5d2b tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] [instance: 4adec402-e94f-4a41-ac77-68f6091b87f7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:14.738403 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4e7aacf4-71d1-4fa1-8efa-95e8d5ba5d2b tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:14.739225 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4e7aacf4-71d1-4fa1-8efa-95e8d5ba5d2b tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:14.739742 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4e7aacf4-71d1-4fa1-8efa-95e8d5ba5d2b tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:14.740622 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4e7aacf4-71d1-4fa1-8efa-95e8d5ba5d2b tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:14.741083 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4e7aacf4-71d1-4fa1-8efa-95e8d5ba5d2b tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:14.741630 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4e7aacf4-71d1-4fa1-8efa-95e8d5ba5d2b tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:15.175270 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-4e7aacf4-71d1-4fa1-8efa-95e8d5ba5d2b tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:15.196386 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-4e7aacf4-71d1-4fa1-8efa-95e8d5ba5d2b tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:15.198783 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-4e7aacf4-71d1-4fa1-8efa-95e8d5ba5d2b tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:15.202657 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4e7aacf4-71d1-4fa1-8efa-95e8d5ba5d2b tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] 10.222.0.52 "GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7" status: 200 len: 1874 microversion: 2.32 time: 0.484522 Oct 19 03:21:15.216957 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1084/2212] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:21:14 2022] GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7 => generated 1874 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:21:15.229409 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c0eed942-a8ee-473d-837f-616d7ef25ea9 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:15.230133 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c0eed942-a8ee-473d-837f-616d7ef25ea9 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] [instance: 67358716-e31b-4e54-b23b-592845c983ea] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:15.236929 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c0eed942-a8ee-473d-837f-616d7ef25ea9 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:15.237618 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c0eed942-a8ee-473d-837f-616d7ef25ea9 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:15.238066 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c0eed942-a8ee-473d-837f-616d7ef25ea9 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:15.239454 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c0eed942-a8ee-473d-837f-616d7ef25ea9 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:15.239825 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c0eed942-a8ee-473d-837f-616d7ef25ea9 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:15.240267 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c0eed942-a8ee-473d-837f-616d7ef25ea9 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:15.535195 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-74884c3b-2219-4b1f-a598-e34c4a1527fc tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/074f3469-3bbd-46df-8286-3a57f91798e2/action" status: 202 len: 0 microversion: 2.25 time: 4.536119 Oct 19 03:21:15.535798 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c0eed942-a8ee-473d-837f-616d7ef25ea9 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8824f20e6a1f478a99f90e1ba8f028fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e436373e9e45efa03f08b33da619e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:15.536259 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1129/2213] 10.222.0.52 () {62 vars in 1319 bytes} [Wed Oct 19 03:21:10 2022] POST /compute/v2.1/servers/074f3469-3bbd-46df-8286-3a57f91798e2/action => generated 0 bytes in 4538 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:21:15.543237 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-88b5c220-7916-4620-be0f-4b242e7a8e33 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:15.543237 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-88b5c220-7916-4620-be0f-4b242e7a8e33 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: 6fd536f4-6456-4291-8a11-2c48a453932a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:15.548346 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c0eed942-a8ee-473d-837f-616d7ef25ea9 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] 10.222.0.52 "GET /compute/v2.1/servers/67358716-e31b-4e54-b23b-592845c983ea" status: 200 len: 1325 microversion: 2.1 time: 0.329589 Oct 19 03:21:15.548942 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1085/2214] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:21:15 2022] GET /compute/v2.1/servers/67358716-e31b-4e54-b23b-592845c983ea => generated 1325 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:21:15.552606 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-88b5c220-7916-4620-be0f-4b242e7a8e33 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:15.553191 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-88b5c220-7916-4620-be0f-4b242e7a8e33 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:15.553660 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-88b5c220-7916-4620-be0f-4b242e7a8e33 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:15.554572 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-88b5c220-7916-4620-be0f-4b242e7a8e33 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:15.554974 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-03f37922-6e27-4359-af5c-677875f3f2c5 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:15.555097 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-88b5c220-7916-4620-be0f-4b242e7a8e33 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:15.555511 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-88b5c220-7916-4620-be0f-4b242e7a8e33 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:15.556041 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-03f37922-6e27-4359-af5c-677875f3f2c5 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] [instance: 6888c8db-82ba-4072-b431-8d4fcf5f03e0] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:15.562422 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-03f37922-6e27-4359-af5c-677875f3f2c5 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:15.563141 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-03f37922-6e27-4359-af5c-677875f3f2c5 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:15.563781 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-03f37922-6e27-4359-af5c-677875f3f2c5 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:15.564688 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-03f37922-6e27-4359-af5c-677875f3f2c5 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:15.565970 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-03f37922-6e27-4359-af5c-677875f3f2c5 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:15.566418 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-03f37922-6e27-4359-af5c-677875f3f2c5 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:15.931103 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-88b5c220-7916-4620-be0f-4b242e7a8e33 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:15.936050 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-03f37922-6e27-4359-af5c-677875f3f2c5 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4c5e4123c44508a5d4911a17c44231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a495ccfced47f29cb928d1ded20d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:15.947612 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-03f37922-6e27-4359-af5c-677875f3f2c5 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] 10.222.0.52 "GET /compute/v2.1/servers/6888c8db-82ba-4072-b431-8d4fcf5f03e0" status: 200 len: 1477 microversion: 2.1 time: 0.396781 Oct 19 03:21:15.947843 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-88b5c220-7916-4620-be0f-4b242e7a8e33 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/6fd536f4-6456-4291-8a11-2c48a453932a" status: 200 len: 1308 microversion: 2.1 time: 0.410356 Oct 19 03:21:15.961397 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1086/2215] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:21:15 2022] GET /compute/v2.1/servers/6888c8db-82ba-4072-b431-8d4fcf5f03e0 => generated 1477 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:21:15.965059 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1130/2216] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:21:15 2022] GET /compute/v2.1/servers/6fd536f4-6456-4291-8a11-2c48a453932a => generated 1308 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:21:15.968283 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-cd90f1e0-0014-4d65-92d2-7722edbb8e8f req-ef62a671-4ec1-4bb1-be9b-7477c81cf389 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fee1d282-ae3a-4792-ba8f-a19e498c8853", "tag": "a0fe25a1-1468-4c11-9af9-8321e13e7e0f"}, {"name": "network-changed", "server_uuid": "67358716-e31b-4e54-b23b-592845c983ea", "tag": "2adf0a16-bf47-4556-8224-4f72d8567375"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:21:15.970496 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b3152cd4-d580-46c0-9287-9a1616cab2a6 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.7.215"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:21:15.973482 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b3152cd4-d580-46c0-9287-9a1616cab2a6 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] [instance: fee1d282-ae3a-4792-ba8f-a19e498c8853] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:15.979892 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-cd90f1e0-0014-4d65-92d2-7722edbb8e8f req-ef62a671-4ec1-4bb1-be9b-7477c81cf389 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:15.980364 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-cd90f1e0-0014-4d65-92d2-7722edbb8e8f req-ef62a671-4ec1-4bb1-be9b-7477c81cf389 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:15.980690 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b3152cd4-d580-46c0-9287-9a1616cab2a6 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:15.980858 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-cd90f1e0-0014-4d65-92d2-7722edbb8e8f req-ef62a671-4ec1-4bb1-be9b-7477c81cf389 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:15.981185 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b3152cd4-d580-46c0-9287-9a1616cab2a6 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:15.981756 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b3152cd4-d580-46c0-9287-9a1616cab2a6 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:15.982456 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b3152cd4-d580-46c0-9287-9a1616cab2a6 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:15.983086 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b3152cd4-d580-46c0-9287-9a1616cab2a6 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:15.983683 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b3152cd4-d580-46c0-9287-9a1616cab2a6 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:15.995138 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-cd90f1e0-0014-4d65-92d2-7722edbb8e8f req-ef62a671-4ec1-4bb1-be9b-7477c81cf389 service nova] Creating event network-changed:a0fe25a1-1468-4c11-9af9-8321e13e7e0f for instance fee1d282-ae3a-4792-ba8f-a19e498c8853 on n-h2-861333-8 Oct 19 03:21:15.995650 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-cd90f1e0-0014-4d65-92d2-7722edbb8e8f req-ef62a671-4ec1-4bb1-be9b-7477c81cf389 service nova] Creating event network-changed:2adf0a16-bf47-4556-8224-4f72d8567375 for instance 67358716-e31b-4e54-b23b-592845c983ea on n-h2-861333-8 Oct 19 03:21:16.004696 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-cd90f1e0-0014-4d65-92d2-7722edbb8e8f req-ef62a671-4ec1-4bb1-be9b-7477c81cf389 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.054865 Oct 19 03:21:16.005576 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1087/2217] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:21:15 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:21:16.010680 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b3152cd4-d580-46c0-9287-9a1616cab2a6 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Acquiring lock "refresh_cache-fee1d282-ae3a-4792-ba8f-a19e498c8853" {{(pid=121135) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 19 03:21:16.011091 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b3152cd4-d580-46c0-9287-9a1616cab2a6 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Acquired lock "refresh_cache-fee1d282-ae3a-4792-ba8f-a19e498c8853" {{(pid=121135) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 19 03:21:16.011207 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8701bac3-f28a-49fa-b71e-d83deaeade78 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:16.011919 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8701bac3-f28a-49fa-b71e-d83deaeade78 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] [instance: 951e236c-943a-4f8c-956d-ac7bbbf0e0e1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:16.021396 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8701bac3-f28a-49fa-b71e-d83deaeade78 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:16.021927 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8701bac3-f28a-49fa-b71e-d83deaeade78 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:16.022538 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8701bac3-f28a-49fa-b71e-d83deaeade78 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:16.023362 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8701bac3-f28a-49fa-b71e-d83deaeade78 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:16.023802 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8701bac3-f28a-49fa-b71e-d83deaeade78 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:16.024232 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8701bac3-f28a-49fa-b71e-d83deaeade78 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:16.495570 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8701bac3-f28a-49fa-b71e-d83deaeade78 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ec45c74dcd448e924be40b1abfbc4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce8d13fab4fe4725a4759519818113f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:16.508066 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8701bac3-f28a-49fa-b71e-d83deaeade78 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] 10.222.0.52 "GET /compute/v2.1/servers/951e236c-943a-4f8c-956d-ac7bbbf0e0e1" status: 200 len: 1608 microversion: 2.1 time: 0.501041 Oct 19 03:21:16.509275 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1088/2218] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:21:16 2022] GET /compute/v2.1/servers/951e236c-943a-4f8c-956d-ac7bbbf0e0e1 => generated 1608 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:21:16.514167 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e683b0d2-b09a-4425-b9b5-a5c11bb8ef34 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:16.522813 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e683b0d2-b09a-4425-b9b5-a5c11bb8ef34 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 074f3469-3bbd-46df-8286-3a57f91798e2] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:16.537284 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e683b0d2-b09a-4425-b9b5-a5c11bb8ef34 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:16.538549 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e683b0d2-b09a-4425-b9b5-a5c11bb8ef34 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:16.539209 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e683b0d2-b09a-4425-b9b5-a5c11bb8ef34 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:16.540175 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e683b0d2-b09a-4425-b9b5-a5c11bb8ef34 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:16.540951 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e683b0d2-b09a-4425-b9b5-a5c11bb8ef34 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:16.541707 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e683b0d2-b09a-4425-b9b5-a5c11bb8ef34 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:17.204835 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e683b0d2-b09a-4425-b9b5-a5c11bb8ef34 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:17.214939 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e683b0d2-b09a-4425-b9b5-a5c11bb8ef34 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:17.216450 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e683b0d2-b09a-4425-b9b5-a5c11bb8ef34 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:17.217667 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e683b0d2-b09a-4425-b9b5-a5c11bb8ef34 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/074f3469-3bbd-46df-8286-3a57f91798e2" status: 200 len: 1485 microversion: 2.25 time: 0.707178 Oct 19 03:21:17.218239 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1089/2219] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:21:16 2022] GET /compute/v2.1/servers/074f3469-3bbd-46df-8286-3a57f91798e2 => generated 1485 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:21:17.241490 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-17e1d0cc-d36b-40ec-8fb1-38893ed240af tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:17.242347 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-17e1d0cc-d36b-40ec-8fb1-38893ed240af tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] [instance: 4adec402-e94f-4a41-ac77-68f6091b87f7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:17.249750 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-17e1d0cc-d36b-40ec-8fb1-38893ed240af tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:17.250549 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-17e1d0cc-d36b-40ec-8fb1-38893ed240af tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:17.251691 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-17e1d0cc-d36b-40ec-8fb1-38893ed240af tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:17.253791 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-17e1d0cc-d36b-40ec-8fb1-38893ed240af tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:17.254452 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-17e1d0cc-d36b-40ec-8fb1-38893ed240af tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:17.256892 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-17e1d0cc-d36b-40ec-8fb1-38893ed240af tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:18.120781 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-17e1d0cc-d36b-40ec-8fb1-38893ed240af tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:18.137513 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-17e1d0cc-d36b-40ec-8fb1-38893ed240af tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:18.143836 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-17e1d0cc-d36b-40ec-8fb1-38893ed240af tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:18.147234 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-17e1d0cc-d36b-40ec-8fb1-38893ed240af tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] 10.222.0.52 "GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7" status: 200 len: 1874 microversion: 2.32 time: 0.909079 Oct 19 03:21:18.150915 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1090/2220] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:21:17 2022] GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7 => generated 1874 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:21:18.177852 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-a86d1bd5-44b7-4cc2-9d76-d8567da4ca1e req-80074d18-4f72-41fc-bbb7-4946a1cb57dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6888c8db-82ba-4072-b431-8d4fcf5f03e0", "name": "network-vif-plugged", "status": "completed", "tag": "7d06606b-5258-42bd-89b9-3f972fa9dcda"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:21:18.209964 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-a86d1bd5-44b7-4cc2-9d76-d8567da4ca1e req-80074d18-4f72-41fc-bbb7-4946a1cb57dc service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:18.214347 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-a86d1bd5-44b7-4cc2-9d76-d8567da4ca1e req-80074d18-4f72-41fc-bbb7-4946a1cb57dc service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:18.214893 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-a86d1bd5-44b7-4cc2-9d76-d8567da4ca1e req-80074d18-4f72-41fc-bbb7-4946a1cb57dc service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:18.250170 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-a86d1bd5-44b7-4cc2-9d76-d8567da4ca1e req-80074d18-4f72-41fc-bbb7-4946a1cb57dc service nova] Creating event network-vif-plugged:7d06606b-5258-42bd-89b9-3f972fa9dcda for instance 6888c8db-82ba-4072-b431-8d4fcf5f03e0 on n-h1-861333-8 Oct 19 03:21:18.257252 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-a86d1bd5-44b7-4cc2-9d76-d8567da4ca1e req-80074d18-4f72-41fc-bbb7-4946a1cb57dc service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103836 Oct 19 03:21:18.260801 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1091/2221] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:21:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:21:18.267572 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0c39dc61-a57d-461a-896e-dfc5fa13a0ed tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:18.269240 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0c39dc61-a57d-461a-896e-dfc5fa13a0ed tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] [instance: 67358716-e31b-4e54-b23b-592845c983ea] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:18.277098 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0c39dc61-a57d-461a-896e-dfc5fa13a0ed tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:18.277970 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0c39dc61-a57d-461a-896e-dfc5fa13a0ed tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:18.278649 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0c39dc61-a57d-461a-896e-dfc5fa13a0ed tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:18.279619 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0c39dc61-a57d-461a-896e-dfc5fa13a0ed tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:18.280305 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0c39dc61-a57d-461a-896e-dfc5fa13a0ed tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:18.280984 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0c39dc61-a57d-461a-896e-dfc5fa13a0ed tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:18.503675 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=8 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:21:19.317593 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=4 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:21:19.327970 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0c39dc61-a57d-461a-896e-dfc5fa13a0ed tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8824f20e6a1f478a99f90e1ba8f028fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e436373e9e45efa03f08b33da619e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:19.355356 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0c39dc61-a57d-461a-896e-dfc5fa13a0ed tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] 10.222.0.52 "GET /compute/v2.1/servers/67358716-e31b-4e54-b23b-592845c983ea" status: 200 len: 1325 microversion: 2.1 time: 1.092796 Oct 19 03:21:19.355957 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1092/2222] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:21:18 2022] GET /compute/v2.1/servers/67358716-e31b-4e54-b23b-592845c983ea => generated 1325 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:21:19.376745 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4cedc29b-29ab-438e-8137-c8ee6863799b tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:19.382737 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4cedc29b-29ab-438e-8137-c8ee6863799b tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] [instance: 6888c8db-82ba-4072-b431-8d4fcf5f03e0] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:19.392189 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4cedc29b-29ab-438e-8137-c8ee6863799b tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:19.393686 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4cedc29b-29ab-438e-8137-c8ee6863799b tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:19.396049 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4cedc29b-29ab-438e-8137-c8ee6863799b tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:19.397315 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4cedc29b-29ab-438e-8137-c8ee6863799b tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:19.398647 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4cedc29b-29ab-438e-8137-c8ee6863799b tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:19.399271 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4cedc29b-29ab-438e-8137-c8ee6863799b tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:19.464636 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=8 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:21:19.647109 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-4cedc29b-29ab-438e-8137-c8ee6863799b tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4c5e4123c44508a5d4911a17c44231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a495ccfced47f29cb928d1ded20d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:19.660656 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4cedc29b-29ab-438e-8137-c8ee6863799b tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] 10.222.0.52 "GET /compute/v2.1/servers/6888c8db-82ba-4072-b431-8d4fcf5f03e0" status: 200 len: 1477 microversion: 2.1 time: 0.297571 Oct 19 03:21:19.673429 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1093/2223] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:21:19 2022] GET /compute/v2.1/servers/6888c8db-82ba-4072-b431-8d4fcf5f03e0 => generated 1477 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:21:19.680419 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d1ce4e78-45bd-4596-89c5-131a13397467 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:19.681048 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d1ce4e78-45bd-4596-89c5-131a13397467 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: 6fd536f4-6456-4291-8a11-2c48a453932a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:19.703753 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d1ce4e78-45bd-4596-89c5-131a13397467 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:19.704267 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d1ce4e78-45bd-4596-89c5-131a13397467 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:19.704723 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d1ce4e78-45bd-4596-89c5-131a13397467 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:19.709491 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d1ce4e78-45bd-4596-89c5-131a13397467 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:19.709903 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d1ce4e78-45bd-4596-89c5-131a13397467 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:19.713637 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d1ce4e78-45bd-4596-89c5-131a13397467 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:19.750228 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:21:20.098693 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d1ce4e78-45bd-4596-89c5-131a13397467 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:20.117795 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d1ce4e78-45bd-4596-89c5-131a13397467 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/6fd536f4-6456-4291-8a11-2c48a453932a" status: 200 len: 1308 microversion: 2.1 time: 0.445741 Oct 19 03:21:20.118025 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1094/2224] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:21:19 2022] GET /compute/v2.1/servers/6fd536f4-6456-4291-8a11-2c48a453932a => generated 1308 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:21:20.138641 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-da9851f0-0a5e-4743-83b3-d9066f881e46 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:20.139192 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-da9851f0-0a5e-4743-83b3-d9066f881e46 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] [instance: 951e236c-943a-4f8c-956d-ac7bbbf0e0e1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:20.168347 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-da9851f0-0a5e-4743-83b3-d9066f881e46 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:20.168956 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-da9851f0-0a5e-4743-83b3-d9066f881e46 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:20.169585 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-da9851f0-0a5e-4743-83b3-d9066f881e46 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:20.170537 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-da9851f0-0a5e-4743-83b3-d9066f881e46 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:20.171104 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-da9851f0-0a5e-4743-83b3-d9066f881e46 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:20.171714 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-da9851f0-0a5e-4743-83b3-d9066f881e46 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:20.422982 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-da9851f0-0a5e-4743-83b3-d9066f881e46 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ec45c74dcd448e924be40b1abfbc4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce8d13fab4fe4725a4759519818113f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:20.437152 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-da9851f0-0a5e-4743-83b3-d9066f881e46 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] 10.222.0.52 "GET /compute/v2.1/servers/951e236c-943a-4f8c-956d-ac7bbbf0e0e1" status: 200 len: 1541 microversion: 2.1 time: 0.312820 Oct 19 03:21:20.440946 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1095/2225] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:21:20 2022] GET /compute/v2.1/servers/951e236c-943a-4f8c-956d-ac7bbbf0e0e1 => generated 1541 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:21:20.454138 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c66de227-4cb4-4d84-86fb-b76f0c38fe8f tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:20.455026 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c66de227-4cb4-4d84-86fb-b76f0c38fe8f tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 074f3469-3bbd-46df-8286-3a57f91798e2] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:20.476060 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c66de227-4cb4-4d84-86fb-b76f0c38fe8f tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:20.476563 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c66de227-4cb4-4d84-86fb-b76f0c38fe8f tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:20.477008 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c66de227-4cb4-4d84-86fb-b76f0c38fe8f tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:20.477744 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c66de227-4cb4-4d84-86fb-b76f0c38fe8f tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:20.478198 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c66de227-4cb4-4d84-86fb-b76f0c38fe8f tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:20.482844 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c66de227-4cb4-4d84-86fb-b76f0c38fe8f tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:20.500218 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.network.neutron [None req-b3152cd4-d580-46c0-9287-9a1616cab2a6 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] [instance: fee1d282-ae3a-4792-ba8f-a19e498c8853] Building network info cache for instance {{(pid=121135) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 19 03:21:20.888817 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=6 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:21:21.087487 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c66de227-4cb4-4d84-86fb-b76f0c38fe8f tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:21.097772 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c66de227-4cb4-4d84-86fb-b76f0c38fe8f tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:21.112496 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c66de227-4cb4-4d84-86fb-b76f0c38fe8f tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:21.114147 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c66de227-4cb4-4d84-86fb-b76f0c38fe8f tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/074f3469-3bbd-46df-8286-3a57f91798e2" status: 200 len: 1485 microversion: 2.25 time: 0.669465 Oct 19 03:21:21.119955 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1096/2226] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:21:20 2022] GET /compute/v2.1/servers/074f3469-3bbd-46df-8286-3a57f91798e2 => generated 1485 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:21:21.128082 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-2880401f-a3e2-40d0-b788-5404bb00d91a req-30752b80-d7b5-4aa9-a631-94ece8a25b17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fd536f4-6456-4291-8a11-2c48a453932a", "tag": "8a122a74-7a6e-4f35-ab43-ab8ca0ff35c0"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:21:21.163439 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-2880401f-a3e2-40d0-b788-5404bb00d91a req-30752b80-d7b5-4aa9-a631-94ece8a25b17 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:21.164077 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-2880401f-a3e2-40d0-b788-5404bb00d91a req-30752b80-d7b5-4aa9-a631-94ece8a25b17 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:21.164535 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-2880401f-a3e2-40d0-b788-5404bb00d91a req-30752b80-d7b5-4aa9-a631-94ece8a25b17 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:21.192453 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-2880401f-a3e2-40d0-b788-5404bb00d91a req-30752b80-d7b5-4aa9-a631-94ece8a25b17 service nova] Creating event network-changed:8a122a74-7a6e-4f35-ab43-ab8ca0ff35c0 for instance 6fd536f4-6456-4291-8a11-2c48a453932a on n-h1-861333-8 Oct 19 03:21:21.202203 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-2880401f-a3e2-40d0-b788-5404bb00d91a req-30752b80-d7b5-4aa9-a631-94ece8a25b17 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080866 Oct 19 03:21:21.202821 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1097/2227] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:21:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:21:21.224918 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8b4be3ba-9efe-4bb5-8f5f-bd3deb421a5e tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:21.225900 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8b4be3ba-9efe-4bb5-8f5f-bd3deb421a5e tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] [instance: 4adec402-e94f-4a41-ac77-68f6091b87f7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:21.246018 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8b4be3ba-9efe-4bb5-8f5f-bd3deb421a5e tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:21.255916 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8b4be3ba-9efe-4bb5-8f5f-bd3deb421a5e tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:21.255916 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8b4be3ba-9efe-4bb5-8f5f-bd3deb421a5e tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:21.255916 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8b4be3ba-9efe-4bb5-8f5f-bd3deb421a5e tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:21.255916 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8b4be3ba-9efe-4bb5-8f5f-bd3deb421a5e tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:21.256738 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8b4be3ba-9efe-4bb5-8f5f-bd3deb421a5e tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:21.780488 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8b4be3ba-9efe-4bb5-8f5f-bd3deb421a5e tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:21.794892 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8b4be3ba-9efe-4bb5-8f5f-bd3deb421a5e tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:21.803624 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8b4be3ba-9efe-4bb5-8f5f-bd3deb421a5e tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:21.805044 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8b4be3ba-9efe-4bb5-8f5f-bd3deb421a5e tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] 10.222.0.52 "GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7" status: 200 len: 1874 microversion: 2.32 time: 0.600672 Oct 19 03:21:21.805762 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1098/2228] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:21:21 2022] GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7 => generated 1874 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:21:21.829072 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-a4095209-12eb-4329-94ef-284ef54ae5c8 req-27c68b4e-7b61-4579-9ed3-604f5dde6fa6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67358716-e31b-4e54-b23b-592845c983ea", "name": "network-vif-plugged", "status": "completed", "tag": "2adf0a16-bf47-4556-8224-4f72d8567375"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:21:21.840259 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-a4095209-12eb-4329-94ef-284ef54ae5c8 req-27c68b4e-7b61-4579-9ed3-604f5dde6fa6 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:21.841013 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-a4095209-12eb-4329-94ef-284ef54ae5c8 req-27c68b4e-7b61-4579-9ed3-604f5dde6fa6 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:21.842082 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-a4095209-12eb-4329-94ef-284ef54ae5c8 req-27c68b4e-7b61-4579-9ed3-604f5dde6fa6 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:21.856765 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-a4095209-12eb-4329-94ef-284ef54ae5c8 req-27c68b4e-7b61-4579-9ed3-604f5dde6fa6 service nova] Creating event network-vif-plugged:2adf0a16-bf47-4556-8224-4f72d8567375 for instance 67358716-e31b-4e54-b23b-592845c983ea on n-h2-861333-8 Oct 19 03:21:21.862606 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-a4095209-12eb-4329-94ef-284ef54ae5c8 req-27c68b4e-7b61-4579-9ed3-604f5dde6fa6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043791 Oct 19 03:21:21.863860 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1099/2229] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:21:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:21:21.871621 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2fde4e24-337e-484b-817e-0034b7e47359 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:21.872892 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2fde4e24-337e-484b-817e-0034b7e47359 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] [instance: 67358716-e31b-4e54-b23b-592845c983ea] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:21.895735 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2fde4e24-337e-484b-817e-0034b7e47359 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:21.896245 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2fde4e24-337e-484b-817e-0034b7e47359 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:21.896689 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2fde4e24-337e-484b-817e-0034b7e47359 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:21.897474 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2fde4e24-337e-484b-817e-0034b7e47359 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:21.897892 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2fde4e24-337e-484b-817e-0034b7e47359 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:21.898354 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2fde4e24-337e-484b-817e-0034b7e47359 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:22.678368 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.network.neutron [None req-b3152cd4-d580-46c0-9287-9a1616cab2a6 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] [instance: fee1d282-ae3a-4792-ba8f-a19e498c8853] Updating instance_info_cache with network_info: [{"id": "a0fe25a1-1468-4c11-9af9-8321e13e7e0f", "address": "fa:16:3e:b2:52:2d", "network": {"id": "da8b6b16-8818-4cf4-9bf0-ca13bd9544a1", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1497714882-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.7.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "1606da859950484e9aa949e5c59c0a65", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapa0fe25a1-14", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=121135) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 19 03:21:22.748615 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-2fde4e24-337e-484b-817e-0034b7e47359 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8824f20e6a1f478a99f90e1ba8f028fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e436373e9e45efa03f08b33da619e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:22.759642 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2fde4e24-337e-484b-817e-0034b7e47359 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] 10.222.0.52 "GET /compute/v2.1/servers/67358716-e31b-4e54-b23b-592845c983ea" status: 200 len: 1325 microversion: 2.1 time: 0.893151 Oct 19 03:21:22.766230 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b3152cd4-d580-46c0-9287-9a1616cab2a6 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Releasing lock "refresh_cache-fee1d282-ae3a-4792-ba8f-a19e498c8853" {{(pid=121135) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 19 03:21:22.767647 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b3152cd4-d580-46c0-9287-9a1616cab2a6 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] 10.222.0.52 "POST /compute/v2.1/servers/fee1d282-ae3a-4792-ba8f-a19e498c8853/action" status: 202 len: 0 microversion: 2.1 time: 6.808092 Oct 19 03:21:22.769035 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1131/2230] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:21:15 2022] POST /compute/v2.1/servers/fee1d282-ae3a-4792-ba8f-a19e498c8853/action => generated 0 bytes in 6810 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 19 03:21:22.772646 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1100/2231] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:21:21 2022] GET /compute/v2.1/servers/67358716-e31b-4e54-b23b-592845c983ea => generated 1325 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:21:22.778178 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-13d09397-58e5-4c48-94cf-ffad9d771c62 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:22.780297 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-13d09397-58e5-4c48-94cf-ffad9d771c62 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] [instance: 6888c8db-82ba-4072-b431-8d4fcf5f03e0] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:22.782388 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0680ab91-b1d2-4249-ba2d-32feac5acc7f tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:22.784401 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0680ab91-b1d2-4249-ba2d-32feac5acc7f tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: 6fd536f4-6456-4291-8a11-2c48a453932a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:22.791686 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0680ab91-b1d2-4249-ba2d-32feac5acc7f tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:22.791924 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-13d09397-58e5-4c48-94cf-ffad9d771c62 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:22.792674 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-13d09397-58e5-4c48-94cf-ffad9d771c62 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:22.792829 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0680ab91-b1d2-4249-ba2d-32feac5acc7f tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:22.793327 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0680ab91-b1d2-4249-ba2d-32feac5acc7f tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:22.795335 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-13d09397-58e5-4c48-94cf-ffad9d771c62 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:22.795460 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0680ab91-b1d2-4249-ba2d-32feac5acc7f tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:22.795460 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0680ab91-b1d2-4249-ba2d-32feac5acc7f tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:22.795631 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-13d09397-58e5-4c48-94cf-ffad9d771c62 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:22.796186 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-13d09397-58e5-4c48-94cf-ffad9d771c62 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:22.796344 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0680ab91-b1d2-4249-ba2d-32feac5acc7f tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:22.796672 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-13d09397-58e5-4c48-94cf-ffad9d771c62 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:23.064122 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0680ab91-b1d2-4249-ba2d-32feac5acc7f tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:23.073017 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0680ab91-b1d2-4249-ba2d-32feac5acc7f tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/6fd536f4-6456-4291-8a11-2c48a453932a" status: 200 len: 1308 microversion: 2.1 time: 0.301578 Oct 19 03:21:23.082362 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1101/2232] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:21:22 2022] GET /compute/v2.1/servers/6fd536f4-6456-4291-8a11-2c48a453932a => generated 1308 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:21:23.083256 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-13d09397-58e5-4c48-94cf-ffad9d771c62 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4c5e4123c44508a5d4911a17c44231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a495ccfced47f29cb928d1ded20d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:23.088135 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-dc0d1955-d669-4c46-8571-be10824e8c70 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:23.088815 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-dc0d1955-d669-4c46-8571-be10824e8c70 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] [instance: 951e236c-943a-4f8c-956d-ac7bbbf0e0e1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:23.095382 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dc0d1955-d669-4c46-8571-be10824e8c70 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:23.096026 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dc0d1955-d669-4c46-8571-be10824e8c70 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:23.096558 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dc0d1955-d669-4c46-8571-be10824e8c70 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:23.097753 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dc0d1955-d669-4c46-8571-be10824e8c70 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:23.098387 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dc0d1955-d669-4c46-8571-be10824e8c70 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:23.100957 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-13d09397-58e5-4c48-94cf-ffad9d771c62 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] 10.222.0.52 "GET /compute/v2.1/servers/6888c8db-82ba-4072-b431-8d4fcf5f03e0" status: 200 len: 1463 microversion: 2.1 time: 0.319382 Oct 19 03:21:23.101656 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dc0d1955-d669-4c46-8571-be10824e8c70 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:23.102800 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1132/2233] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:21:22 2022] GET /compute/v2.1/servers/6888c8db-82ba-4072-b431-8d4fcf5f03e0 => generated 1463 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:21:23.113192 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-64d3ac42-064c-4486-8847-4426dd8eb58d tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:23.114106 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-64d3ac42-064c-4486-8847-4426dd8eb58d tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 074f3469-3bbd-46df-8286-3a57f91798e2] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:23.128332 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-64d3ac42-064c-4486-8847-4426dd8eb58d tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:23.128834 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-64d3ac42-064c-4486-8847-4426dd8eb58d tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:23.133090 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-64d3ac42-064c-4486-8847-4426dd8eb58d tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:23.134987 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-64d3ac42-064c-4486-8847-4426dd8eb58d tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:23.138032 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-64d3ac42-064c-4486-8847-4426dd8eb58d tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:23.138573 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-64d3ac42-064c-4486-8847-4426dd8eb58d tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:23.199748 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-dc0d1955-d669-4c46-8571-be10824e8c70 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ec45c74dcd448e924be40b1abfbc4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce8d13fab4fe4725a4759519818113f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:23.210934 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-dc0d1955-d669-4c46-8571-be10824e8c70 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] 10.222.0.52 "GET /compute/v2.1/servers/951e236c-943a-4f8c-956d-ac7bbbf0e0e1" status: 200 len: 1253 microversion: 2.1 time: 0.127329 Oct 19 03:21:23.225479 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1102/2234] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:21:23 2022] GET /compute/v2.1/servers/951e236c-943a-4f8c-956d-ac7bbbf0e0e1 => generated 1253 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:21:23.225479 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-96496837-5c6d-4b02-aaa0-bfef5cd9687b tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.7.215"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:21:23.486337 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-96496837-5c6d-4b02-aaa0-bfef5cd9687b tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] [instance: fee1d282-ae3a-4792-ba8f-a19e498c8853] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:23.489971 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-64d3ac42-064c-4486-8847-4426dd8eb58d tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:23.493091 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-96496837-5c6d-4b02-aaa0-bfef5cd9687b tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:23.493622 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-96496837-5c6d-4b02-aaa0-bfef5cd9687b tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:23.494067 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-96496837-5c6d-4b02-aaa0-bfef5cd9687b tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:23.496685 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-96496837-5c6d-4b02-aaa0-bfef5cd9687b tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:23.496835 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:21:23.498572 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-96496837-5c6d-4b02-aaa0-bfef5cd9687b tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:23.499130 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-96496837-5c6d-4b02-aaa0-bfef5cd9687b tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:23.503902 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-64d3ac42-064c-4486-8847-4426dd8eb58d tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:23.504704 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-64d3ac42-064c-4486-8847-4426dd8eb58d tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:23.506489 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-64d3ac42-064c-4486-8847-4426dd8eb58d tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/074f3469-3bbd-46df-8286-3a57f91798e2" status: 200 len: 1485 microversion: 2.25 time: 0.402300 Oct 19 03:21:23.517412 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1133/2235] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:21:23 2022] GET /compute/v2.1/servers/074f3469-3bbd-46df-8286-3a57f91798e2 => generated 1485 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:21:23.517412 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-bbfd23bf-3072-444d-b277-cf01bddf7cc1 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:23.517412 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-bbfd23bf-3072-444d-b277-cf01bddf7cc1 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] [instance: 4adec402-e94f-4a41-ac77-68f6091b87f7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:23.522832 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bbfd23bf-3072-444d-b277-cf01bddf7cc1 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:23.523344 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bbfd23bf-3072-444d-b277-cf01bddf7cc1 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:23.523791 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bbfd23bf-3072-444d-b277-cf01bddf7cc1 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:23.524501 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bbfd23bf-3072-444d-b277-cf01bddf7cc1 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:23.524960 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bbfd23bf-3072-444d-b277-cf01bddf7cc1 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:23.525444 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bbfd23bf-3072-444d-b277-cf01bddf7cc1 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:24.020875 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-bbfd23bf-3072-444d-b277-cf01bddf7cc1 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:24.023737 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-96496837-5c6d-4b02-aaa0-bfef5cd9687b tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Acquiring lock "refresh_cache-fee1d282-ae3a-4792-ba8f-a19e498c8853" {{(pid=121134) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 19 03:21:24.024168 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-96496837-5c6d-4b02-aaa0-bfef5cd9687b tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Acquired lock "refresh_cache-fee1d282-ae3a-4792-ba8f-a19e498c8853" {{(pid=121134) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 19 03:21:24.043880 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-bbfd23bf-3072-444d-b277-cf01bddf7cc1 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:24.045695 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-bbfd23bf-3072-444d-b277-cf01bddf7cc1 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:24.046922 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-bbfd23bf-3072-444d-b277-cf01bddf7cc1 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] 10.222.0.52 "GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7" status: 200 len: 1874 microversion: 2.32 time: 0.537817 Oct 19 03:21:24.075911 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1134/2236] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:21:23 2022] GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7 => generated 1874 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:21:24.090597 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-44bd776c-51f4-400b-8178-bfa39464d9a9 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:24.094351 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-44bd776c-51f4-400b-8178-bfa39464d9a9 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] [instance: 6888c8db-82ba-4072-b431-8d4fcf5f03e0] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:24.104387 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-44bd776c-51f4-400b-8178-bfa39464d9a9 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:24.110316 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-44bd776c-51f4-400b-8178-bfa39464d9a9 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:24.110316 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-44bd776c-51f4-400b-8178-bfa39464d9a9 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:24.110316 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-44bd776c-51f4-400b-8178-bfa39464d9a9 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:24.110316 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-44bd776c-51f4-400b-8178-bfa39464d9a9 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:24.110887 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-44bd776c-51f4-400b-8178-bfa39464d9a9 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:24.608564 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-44bd776c-51f4-400b-8178-bfa39464d9a9 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4c5e4123c44508a5d4911a17c44231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a495ccfced47f29cb928d1ded20d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:24.619484 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-44bd776c-51f4-400b-8178-bfa39464d9a9 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] 10.222.0.52 "GET /compute/v2.1/servers/6888c8db-82ba-4072-b431-8d4fcf5f03e0" status: 200 len: 1463 microversion: 2.1 time: 0.541071 Oct 19 03:21:24.622729 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1135/2237] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:21:24 2022] GET /compute/v2.1/servers/6888c8db-82ba-4072-b431-8d4fcf5f03e0 => generated 1463 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:21:24.643685 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-020eb00b-fb1d-484e-9daf-2ec785a773ac req-df2fd9a6-30d6-4401-820b-7c5bd8f2e5cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fee1d282-ae3a-4792-ba8f-a19e498c8853", "tag": "a0fe25a1-1468-4c11-9af9-8321e13e7e0f"}, {"server_uuid": "951e236c-943a-4f8c-956d-ac7bbbf0e0e1", "name": "network-vif-deleted", "tag": "d95bdec8-e9af-43f6-8904-996c4e694095"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:21:24.656476 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-020eb00b-fb1d-484e-9daf-2ec785a773ac req-df2fd9a6-30d6-4401-820b-7c5bd8f2e5cc service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:24.657071 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-020eb00b-fb1d-484e-9daf-2ec785a773ac req-df2fd9a6-30d6-4401-820b-7c5bd8f2e5cc service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:24.657896 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-020eb00b-fb1d-484e-9daf-2ec785a773ac req-df2fd9a6-30d6-4401-820b-7c5bd8f2e5cc service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:24.683660 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-020eb00b-fb1d-484e-9daf-2ec785a773ac req-df2fd9a6-30d6-4401-820b-7c5bd8f2e5cc service nova] Creating event network-changed:a0fe25a1-1468-4c11-9af9-8321e13e7e0f for instance fee1d282-ae3a-4792-ba8f-a19e498c8853 on n-h2-861333-8 Oct 19 03:21:24.688395 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-020eb00b-fb1d-484e-9daf-2ec785a773ac req-df2fd9a6-30d6-4401-820b-7c5bd8f2e5cc service nova] Creating event network-vif-deleted:d95bdec8-e9af-43f6-8904-996c4e694095 for instance 951e236c-943a-4f8c-956d-ac7bbbf0e0e1 on n-h2-861333-8 Oct 19 03:21:24.700402 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-020eb00b-fb1d-484e-9daf-2ec785a773ac req-df2fd9a6-30d6-4401-820b-7c5bd8f2e5cc service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.076351 Oct 19 03:21:24.706219 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1136/2238] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:21:24 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:21:24.717605 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-bf6ce8e7-644e-435e-976b-2e4e6d93c5c0 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:24.718828 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-bf6ce8e7-644e-435e-976b-2e4e6d93c5c0 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] [instance: 67358716-e31b-4e54-b23b-592845c983ea] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:24.725692 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bf6ce8e7-644e-435e-976b-2e4e6d93c5c0 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:24.726530 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bf6ce8e7-644e-435e-976b-2e4e6d93c5c0 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:24.727208 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bf6ce8e7-644e-435e-976b-2e4e6d93c5c0 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:24.728145 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bf6ce8e7-644e-435e-976b-2e4e6d93c5c0 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:24.728988 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bf6ce8e7-644e-435e-976b-2e4e6d93c5c0 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:24.729680 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bf6ce8e7-644e-435e-976b-2e4e6d93c5c0 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:25.118792 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-bf6ce8e7-644e-435e-976b-2e4e6d93c5c0 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8824f20e6a1f478a99f90e1ba8f028fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e436373e9e45efa03f08b33da619e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:25.128799 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-bf6ce8e7-644e-435e-976b-2e4e6d93c5c0 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] 10.222.0.52 "GET /compute/v2.1/servers/67358716-e31b-4e54-b23b-592845c983ea" status: 200 len: 1522 microversion: 2.1 time: 0.421007 Oct 19 03:21:25.130350 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1137/2239] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:21:24 2022] GET /compute/v2.1/servers/67358716-e31b-4e54-b23b-592845c983ea => generated 1522 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:21:25.135650 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9a0a71f0-8497-47e5-ac09-9766e38fdd5e tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:25.136286 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9a0a71f0-8497-47e5-ac09-9766e38fdd5e tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: 6fd536f4-6456-4291-8a11-2c48a453932a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:25.145853 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9a0a71f0-8497-47e5-ac09-9766e38fdd5e tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:25.146355 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9a0a71f0-8497-47e5-ac09-9766e38fdd5e tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:25.146904 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9a0a71f0-8497-47e5-ac09-9766e38fdd5e tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:25.148086 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9a0a71f0-8497-47e5-ac09-9766e38fdd5e tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:25.148810 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9a0a71f0-8497-47e5-ac09-9766e38fdd5e tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:25.149255 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9a0a71f0-8497-47e5-ac09-9766e38fdd5e tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:25.485453 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-9a0a71f0-8497-47e5-ac09-9766e38fdd5e tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:25.510554 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9a0a71f0-8497-47e5-ac09-9766e38fdd5e tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/6fd536f4-6456-4291-8a11-2c48a453932a" status: 200 len: 1308 microversion: 2.1 time: 0.374386 Oct 19 03:21:25.513460 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1138/2240] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:21:25 2022] GET /compute/v2.1/servers/6fd536f4-6456-4291-8a11-2c48a453932a => generated 1308 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:21:25.599470 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e5b36403-3c7c-4d81-9d5d-411f8c83863e tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Action: 'create', calling method: .version_select at 0x7fc130c5a160>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1078478032", "description": "tempest-description-1915122915"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:21:25.895558 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-96496837-5c6d-4b02-aaa0-bfef5cd9687b tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] [instance: fee1d282-ae3a-4792-ba8f-a19e498c8853] Building network info cache for instance {{(pid=121134) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 19 03:21:26.956547 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e5b36403-3c7c-4d81-9d5d-411f8c83863e tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 1.444066 Oct 19 03:21:26.965679 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1139/2241] 10.222.0.52 () {60 vars in 1180 bytes} [Wed Oct 19 03:21:25 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 1445 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:21:26.968354 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-8209d915-9f81-4e0e-9421-1ce7209ae8a5 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:26.969039 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-8209d915-9f81-4e0e-9421-1ce7209ae8a5 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] [instance: 951e236c-943a-4f8c-956d-ac7bbbf0e0e1] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:26.984215 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8209d915-9f81-4e0e-9421-1ce7209ae8a5 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:26.984743 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8209d915-9f81-4e0e-9421-1ce7209ae8a5 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:26.985231 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8209d915-9f81-4e0e-9421-1ce7209ae8a5 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:26.985993 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8209d915-9f81-4e0e-9421-1ce7209ae8a5 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:26.987018 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8209d915-9f81-4e0e-9421-1ce7209ae8a5 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:26.987469 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8209d915-9f81-4e0e-9421-1ce7209ae8a5 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:27.141646 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-8209d915-9f81-4e0e-9421-1ce7209ae8a5 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ec45c74dcd448e924be40b1abfbc4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce8d13fab4fe4725a4759519818113f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:27.153916 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-8209d915-9f81-4e0e-9421-1ce7209ae8a5 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] 10.222.0.52 "GET /compute/v2.1/servers/951e236c-943a-4f8c-956d-ac7bbbf0e0e1" status: 200 len: 1253 microversion: 2.1 time: 0.195070 Oct 19 03:21:27.174469 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1140/2242] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:21:26 2022] GET /compute/v2.1/servers/951e236c-943a-4f8c-956d-ac7bbbf0e0e1 => generated 1253 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:21:27.183573 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-912aaeda-7e5e-4727-91cc-405bb14ee768 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:27.184895 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-912aaeda-7e5e-4727-91cc-405bb14ee768 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 074f3469-3bbd-46df-8286-3a57f91798e2] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:27.192544 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-912aaeda-7e5e-4727-91cc-405bb14ee768 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:27.193481 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-912aaeda-7e5e-4727-91cc-405bb14ee768 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:27.194494 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-912aaeda-7e5e-4727-91cc-405bb14ee768 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:27.196516 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-912aaeda-7e5e-4727-91cc-405bb14ee768 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:27.197261 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-912aaeda-7e5e-4727-91cc-405bb14ee768 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:27.198558 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-912aaeda-7e5e-4727-91cc-405bb14ee768 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:27.305593 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-96496837-5c6d-4b02-aaa0-bfef5cd9687b tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] [instance: fee1d282-ae3a-4792-ba8f-a19e498c8853] Updating instance_info_cache with network_info: [{"id": "a0fe25a1-1468-4c11-9af9-8321e13e7e0f", "address": "fa:16:3e:b2:52:2d", "network": {"id": "da8b6b16-8818-4cf4-9bf0-ca13bd9544a1", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1497714882-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "1606da859950484e9aa949e5c59c0a65", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapa0fe25a1-14", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=121134) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 19 03:21:27.314758 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-96496837-5c6d-4b02-aaa0-bfef5cd9687b tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Releasing lock "refresh_cache-fee1d282-ae3a-4792-ba8f-a19e498c8853" {{(pid=121134) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 19 03:21:27.316344 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-96496837-5c6d-4b02-aaa0-bfef5cd9687b tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] 10.222.0.52 "POST /compute/v2.1/servers/fee1d282-ae3a-4792-ba8f-a19e498c8853/action" status: 202 len: 0 microversion: 2.1 time: 4.102980 Oct 19 03:21:27.320687 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1103/2243] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:21:23 2022] POST /compute/v2.1/servers/fee1d282-ae3a-4792-ba8f-a19e498c8853/action => generated 0 bytes in 4108 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 19 03:21:27.327477 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-89cf5bb3-1c2b-46ed-9ac2-b6a0067463ae tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:21:27.331537 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-89cf5bb3-1c2b-46ed-9ac2-b6a0067463ae tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] [instance: 6888c8db-82ba-4072-b431-8d4fcf5f03e0] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:27.338995 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-89cf5bb3-1c2b-46ed-9ac2-b6a0067463ae tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:27.339733 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-89cf5bb3-1c2b-46ed-9ac2-b6a0067463ae tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:27.341281 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-89cf5bb3-1c2b-46ed-9ac2-b6a0067463ae tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:27.341281 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-89cf5bb3-1c2b-46ed-9ac2-b6a0067463ae tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:27.342085 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-89cf5bb3-1c2b-46ed-9ac2-b6a0067463ae tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:27.342921 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-89cf5bb3-1c2b-46ed-9ac2-b6a0067463ae tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:27.442598 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-912aaeda-7e5e-4727-91cc-405bb14ee768 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:27.443068 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-89cf5bb3-1c2b-46ed-9ac2-b6a0067463ae tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Flavor limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:21:27.444065 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-89cf5bb3-1c2b-46ed-9ac2-b6a0067463ae tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Image limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:21:27.444954 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-89cf5bb3-1c2b-46ed-9ac2-b6a0067463ae tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Flavor pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:21:27.445582 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-89cf5bb3-1c2b-46ed-9ac2-b6a0067463ae tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Image pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:21:27.449904 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-89cf5bb3-1c2b-46ed-9ac2-b6a0067463ae tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:21:27.452403 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-912aaeda-7e5e-4727-91cc-405bb14ee768 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:27.454225 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-912aaeda-7e5e-4727-91cc-405bb14ee768 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:27.456316 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-912aaeda-7e5e-4727-91cc-405bb14ee768 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/074f3469-3bbd-46df-8286-3a57f91798e2" status: 200 len: 1485 microversion: 2.25 time: 0.279682 Oct 19 03:21:27.458841 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1141/2244] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:21:27 2022] GET /compute/v2.1/servers/074f3469-3bbd-46df-8286-3a57f91798e2 => generated 1485 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:21:27.463886 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7bc0c067-1c32-4a98-bc7b-79c8fa8c3404 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:27.464713 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7bc0c067-1c32-4a98-bc7b-79c8fa8c3404 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] [instance: 4adec402-e94f-4a41-ac77-68f6091b87f7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:27.472113 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7bc0c067-1c32-4a98-bc7b-79c8fa8c3404 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:27.473398 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7bc0c067-1c32-4a98-bc7b-79c8fa8c3404 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:27.474108 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7bc0c067-1c32-4a98-bc7b-79c8fa8c3404 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:27.475006 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7bc0c067-1c32-4a98-bc7b-79c8fa8c3404 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:27.475648 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7bc0c067-1c32-4a98-bc7b-79c8fa8c3404 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:27.476247 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7bc0c067-1c32-4a98-bc7b-79c8fa8c3404 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:27.712222 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7bc0c067-1c32-4a98-bc7b-79c8fa8c3404 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:27.722373 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7bc0c067-1c32-4a98-bc7b-79c8fa8c3404 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:27.723856 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7bc0c067-1c32-4a98-bc7b-79c8fa8c3404 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:27.725099 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7bc0c067-1c32-4a98-bc7b-79c8fa8c3404 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] 10.222.0.52 "GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7" status: 200 len: 1874 microversion: 2.32 time: 0.264984 Oct 19 03:21:27.725890 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1142/2245] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:21:27 2022] GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7 => generated 1874 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:21:27.732221 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ca3eb120-a8e7-4313-8df4-2b9d5f73ff4a tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:27.733086 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ca3eb120-a8e7-4313-8df4-2b9d5f73ff4a tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] [instance: 67358716-e31b-4e54-b23b-592845c983ea] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:27.739772 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ca3eb120-a8e7-4313-8df4-2b9d5f73ff4a tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:27.740828 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ca3eb120-a8e7-4313-8df4-2b9d5f73ff4a tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:27.741614 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ca3eb120-a8e7-4313-8df4-2b9d5f73ff4a tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:27.748789 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ca3eb120-a8e7-4313-8df4-2b9d5f73ff4a tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:27.748789 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ca3eb120-a8e7-4313-8df4-2b9d5f73ff4a tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:27.748789 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ca3eb120-a8e7-4313-8df4-2b9d5f73ff4a tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:27.780309 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-89cf5bb3-1c2b-46ed-9ac2-b6a0067463ae tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] [instance: 6888c8db-82ba-4072-b431-8d4fcf5f03e0] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:27.785289 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ca3eb120-a8e7-4313-8df4-2b9d5f73ff4a tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] [instance: 67358716-e31b-4e54-b23b-592845c983ea] Going to try to terminate instance {{(pid=121135) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:21:27.790013 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-89cf5bb3-1c2b-46ed-9ac2-b6a0067463ae tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:27.790853 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-89cf5bb3-1c2b-46ed-9ac2-b6a0067463ae tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:27.791985 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-89cf5bb3-1c2b-46ed-9ac2-b6a0067463ae tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:27.792715 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-89cf5bb3-1c2b-46ed-9ac2-b6a0067463ae tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:27.793174 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-89cf5bb3-1c2b-46ed-9ac2-b6a0067463ae tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:27.793682 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-89cf5bb3-1c2b-46ed-9ac2-b6a0067463ae tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:27.829546 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-89cf5bb3-1c2b-46ed-9ac2-b6a0067463ae tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] 10.222.0.52 "POST /compute/v2.1/servers/6888c8db-82ba-4072-b431-8d4fcf5f03e0/action" status: 202 len: 1067 microversion: 2.1 time: 0.507412 Oct 19 03:21:27.830914 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1104/2246] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:21:27 2022] POST /compute/v2.1/servers/6888c8db-82ba-4072-b431-8d4fcf5f03e0/action => generated 1067 bytes in 509 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 19 03:21:27.836184 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c41bf806-16a7-400e-a76d-e0252c70870b tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:27.836900 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c41bf806-16a7-400e-a76d-e0252c70870b tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: 6fd536f4-6456-4291-8a11-2c48a453932a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:27.844891 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c41bf806-16a7-400e-a76d-e0252c70870b tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:27.845660 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c41bf806-16a7-400e-a76d-e0252c70870b tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:27.846823 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c41bf806-16a7-400e-a76d-e0252c70870b tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:27.847575 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c41bf806-16a7-400e-a76d-e0252c70870b tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:27.848033 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c41bf806-16a7-400e-a76d-e0252c70870b tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:27.848459 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c41bf806-16a7-400e-a76d-e0252c70870b tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:28.048022 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c41bf806-16a7-400e-a76d-e0252c70870b tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:28.059484 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c41bf806-16a7-400e-a76d-e0252c70870b tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/6fd536f4-6456-4291-8a11-2c48a453932a" status: 200 len: 1308 microversion: 2.1 time: 0.227435 Oct 19 03:21:28.062025 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1105/2247] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:21:27 2022] GET /compute/v2.1/servers/6fd536f4-6456-4291-8a11-2c48a453932a => generated 1308 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:21:28.067246 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-5895b095-cefa-46b7-8bb1-92aca90b0f34 req-96b8865a-ec7b-41ae-8bc1-8b2f88a88504 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fee1d282-ae3a-4792-ba8f-a19e498c8853", "tag": "a0fe25a1-1468-4c11-9af9-8321e13e7e0f"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:21:28.077960 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-5895b095-cefa-46b7-8bb1-92aca90b0f34 req-96b8865a-ec7b-41ae-8bc1-8b2f88a88504 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:28.078815 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-5895b095-cefa-46b7-8bb1-92aca90b0f34 req-96b8865a-ec7b-41ae-8bc1-8b2f88a88504 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:28.079319 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-5895b095-cefa-46b7-8bb1-92aca90b0f34 req-96b8865a-ec7b-41ae-8bc1-8b2f88a88504 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:28.093443 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-5895b095-cefa-46b7-8bb1-92aca90b0f34 req-96b8865a-ec7b-41ae-8bc1-8b2f88a88504 service nova] Creating event network-changed:a0fe25a1-1468-4c11-9af9-8321e13e7e0f for instance fee1d282-ae3a-4792-ba8f-a19e498c8853 on n-h2-861333-8 Oct 19 03:21:28.101075 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-5895b095-cefa-46b7-8bb1-92aca90b0f34 req-96b8865a-ec7b-41ae-8bc1-8b2f88a88504 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036380 Oct 19 03:21:28.101624 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1106/2248] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:21:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:21:28.110366 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-bf6d87da-2f00-4837-8990-af14727ce60b tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Action: 'create', calling method: .version_select at 0x7fc130cb9790>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1215036726", "description": "tempest-description-113538759"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:21:28.160025 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ca3eb120-a8e7-4313-8df4-2b9d5f73ff4a tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] 10.222.0.52 "DELETE /compute/v2.1/servers/67358716-e31b-4e54-b23b-592845c983ea" status: 204 len: 0 microversion: 2.1 time: 0.432560 Oct 19 03:21:28.160658 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1143/2249] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:21:27 2022] DELETE /compute/v2.1/servers/67358716-e31b-4e54-b23b-592845c983ea => generated 0 bytes in 434 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:21:28.169662 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9c14b021-e847-4ae5-95ae-1cc99aea6e4e tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Calling method '.version_select at 0x7fc130bcd5e0>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:28.724458 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-bf6d87da-2f00-4837-8990-af14727ce60b tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.618175 Oct 19 03:21:28.736259 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1107/2250] 10.222.0.52 () {60 vars in 1180 bytes} [Wed Oct 19 03:21:28 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:21:28.745997 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-131f2bf6-6ce1-43dc-ba42-f02b53bdf94c req-5eda2587-7d20-4b41-8022-0872c123b378 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fd536f4-6456-4291-8a11-2c48a453932a", "name": "network-vif-plugged", "status": "completed", "tag": "8a122a74-7a6e-4f35-ab43-ab8ca0ff35c0"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:21:28.759129 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-131f2bf6-6ce1-43dc-ba42-f02b53bdf94c req-5eda2587-7d20-4b41-8022-0872c123b378 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:28.759953 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-131f2bf6-6ce1-43dc-ba42-f02b53bdf94c req-5eda2587-7d20-4b41-8022-0872c123b378 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:28.760614 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-131f2bf6-6ce1-43dc-ba42-f02b53bdf94c req-5eda2587-7d20-4b41-8022-0872c123b378 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:28.782154 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-131f2bf6-6ce1-43dc-ba42-f02b53bdf94c req-5eda2587-7d20-4b41-8022-0872c123b378 service nova] Creating event network-vif-plugged:8a122a74-7a6e-4f35-ab43-ab8ca0ff35c0 for instance 6fd536f4-6456-4291-8a11-2c48a453932a on n-h1-861333-8 Oct 19 03:21:28.791164 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-131f2bf6-6ce1-43dc-ba42-f02b53bdf94c req-5eda2587-7d20-4b41-8022-0872c123b378 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052706 Oct 19 03:21:28.792729 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1108/2251] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:21:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:21:28.808087 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-dec46707-f605-4986-821b-713f926712e6 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:28.811679 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-dec46707-f605-4986-821b-713f926712e6 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] [instance: 6888c8db-82ba-4072-b431-8d4fcf5f03e0] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:28.815659 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dec46707-f605-4986-821b-713f926712e6 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:28.816158 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dec46707-f605-4986-821b-713f926712e6 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:28.816593 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dec46707-f605-4986-821b-713f926712e6 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:28.817306 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dec46707-f605-4986-821b-713f926712e6 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:28.818075 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dec46707-f605-4986-821b-713f926712e6 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:28.818509 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dec46707-f605-4986-821b-713f926712e6 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:29.121962 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-dec46707-f605-4986-821b-713f926712e6 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4c5e4123c44508a5d4911a17c44231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a495ccfced47f29cb928d1ded20d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:29.131653 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-dec46707-f605-4986-821b-713f926712e6 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] 10.222.0.52 "GET /compute/v2.1/servers/6888c8db-82ba-4072-b431-8d4fcf5f03e0" status: 200 len: 1472 microversion: 2.1 time: 0.329481 Oct 19 03:21:29.148918 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1109/2252] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:21:28 2022] GET /compute/v2.1/servers/6888c8db-82ba-4072-b431-8d4fcf5f03e0 => generated 1472 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:21:29.148918 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c8c22b87-267b-4882-ab33-d8839572a847 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:29.148918 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c8c22b87-267b-4882-ab33-d8839572a847 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] [instance: 67358716-e31b-4e54-b23b-592845c983ea] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:29.151922 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c8c22b87-267b-4882-ab33-d8839572a847 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:29.152437 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c8c22b87-267b-4882-ab33-d8839572a847 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:29.154527 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c8c22b87-267b-4882-ab33-d8839572a847 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:29.155316 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c8c22b87-267b-4882-ab33-d8839572a847 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:29.155793 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c8c22b87-267b-4882-ab33-d8839572a847 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:29.156239 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c8c22b87-267b-4882-ab33-d8839572a847 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:29.376502 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c8c22b87-267b-4882-ab33-d8839572a847 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8824f20e6a1f478a99f90e1ba8f028fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e436373e9e45efa03f08b33da619e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:29.394223 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c8c22b87-267b-4882-ab33-d8839572a847 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] 10.222.0.52 "GET /compute/v2.1/servers/67358716-e31b-4e54-b23b-592845c983ea" status: 200 len: 1528 microversion: 2.1 time: 0.256093 Oct 19 03:21:29.396695 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1110/2253] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:21:29 2022] GET /compute/v2.1/servers/67358716-e31b-4e54-b23b-592845c983ea => generated 1528 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:21:29.407786 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-58bb94bb-5253-428f-9ab6-20d8e059bd5a tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:29.413862 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-58bb94bb-5253-428f-9ab6-20d8e059bd5a tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] [instance: 951e236c-943a-4f8c-956d-ac7bbbf0e0e1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:29.427762 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-58bb94bb-5253-428f-9ab6-20d8e059bd5a tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:29.437399 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-58bb94bb-5253-428f-9ab6-20d8e059bd5a tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:29.438415 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-58bb94bb-5253-428f-9ab6-20d8e059bd5a tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:29.442625 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-58bb94bb-5253-428f-9ab6-20d8e059bd5a tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:29.443370 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-58bb94bb-5253-428f-9ab6-20d8e059bd5a tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:29.445245 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-58bb94bb-5253-428f-9ab6-20d8e059bd5a tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:29.592991 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-58bb94bb-5253-428f-9ab6-20d8e059bd5a tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ec45c74dcd448e924be40b1abfbc4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce8d13fab4fe4725a4759519818113f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:29.603223 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-58bb94bb-5253-428f-9ab6-20d8e059bd5a tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] 10.222.0.52 "GET /compute/v2.1/servers/951e236c-943a-4f8c-956d-ac7bbbf0e0e1" status: 200 len: 1253 microversion: 2.1 time: 0.205209 Oct 19 03:21:29.606994 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1111/2254] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:21:29 2022] GET /compute/v2.1/servers/951e236c-943a-4f8c-956d-ac7bbbf0e0e1 => generated 1253 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:21:29.611082 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5b9cc464-93e6-4a24-a441-4e7065f21aa1 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:29.612291 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5b9cc464-93e6-4a24-a441-4e7065f21aa1 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 074f3469-3bbd-46df-8286-3a57f91798e2] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:29.615926 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9c14b021-e847-4ae5-95ae-1cc99aea6e4e tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] 10.222.0.52 "DELETE /compute/v2.1/os-floating-ips/6ed0d173-4cc9-4cbf-99d7-de8c75e353d4" status: 202 len: 0 microversion: 2.1 time: 1.454089 Oct 19 03:21:29.617553 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1144/2255] 10.222.0.52 () {58 vars in 1263 bytes} [Wed Oct 19 03:21:28 2022] DELETE /compute/v2.1/os-floating-ips/6ed0d173-4cc9-4cbf-99d7-de8c75e353d4 => generated 0 bytes in 1456 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:21:29.621079 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5b9cc464-93e6-4a24-a441-4e7065f21aa1 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:29.621079 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5b9cc464-93e6-4a24-a441-4e7065f21aa1 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:29.621079 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5b9cc464-93e6-4a24-a441-4e7065f21aa1 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:29.621833 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5b9cc464-93e6-4a24-a441-4e7065f21aa1 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:29.622536 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5b9cc464-93e6-4a24-a441-4e7065f21aa1 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:29.623268 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5b9cc464-93e6-4a24-a441-4e7065f21aa1 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:29.628925 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=96,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:21:29.630953 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-76aa0938-2a20-4113-9498-6ad06e470b09 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:29.632778 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-76aa0938-2a20-4113-9498-6ad06e470b09 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] [instance: 4adec402-e94f-4a41-ac77-68f6091b87f7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:29.642652 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-76aa0938-2a20-4113-9498-6ad06e470b09 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:29.644743 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-76aa0938-2a20-4113-9498-6ad06e470b09 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:29.645231 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-76aa0938-2a20-4113-9498-6ad06e470b09 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:29.646059 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-76aa0938-2a20-4113-9498-6ad06e470b09 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:29.646532 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-76aa0938-2a20-4113-9498-6ad06e470b09 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:29.646973 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-76aa0938-2a20-4113-9498-6ad06e470b09 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:30.227683 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5b9cc464-93e6-4a24-a441-4e7065f21aa1 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:30.227683 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5b9cc464-93e6-4a24-a441-4e7065f21aa1 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:30.228686 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5b9cc464-93e6-4a24-a441-4e7065f21aa1 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:30.228686 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5b9cc464-93e6-4a24-a441-4e7065f21aa1 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/074f3469-3bbd-46df-8286-3a57f91798e2" status: 200 len: 1485 microversion: 2.25 time: 0.604162 Oct 19 03:21:30.228686 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1112/2256] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:21:29 2022] GET /compute/v2.1/servers/074f3469-3bbd-46df-8286-3a57f91798e2 => generated 1485 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:21:30.228853 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4baa6a84-e634-4474-aeec-afa74c0b0d32 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1188526059", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "networks": [{"uuid": "c3b95160-a16e-4a1c-b8ab-a16d61597a6c"}]}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:21:30.250500 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-76aa0938-2a20-4113-9498-6ad06e470b09 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:30.263715 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-76aa0938-2a20-4113-9498-6ad06e470b09 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:30.268963 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-76aa0938-2a20-4113-9498-6ad06e470b09 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:30.270593 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-76aa0938-2a20-4113-9498-6ad06e470b09 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] 10.222.0.52 "GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7" status: 200 len: 1874 microversion: 2.32 time: 0.650973 Oct 19 03:21:30.271617 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1145/2257] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:21:29 2022] GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7 => generated 1874 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:21:30.276676 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-80bad559-2303-4443-8609-a00b5127ca39 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:30.277548 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-80bad559-2303-4443-8609-a00b5127ca39 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: 6fd536f4-6456-4291-8a11-2c48a453932a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:30.284064 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-80bad559-2303-4443-8609-a00b5127ca39 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:30.288654 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-80bad559-2303-4443-8609-a00b5127ca39 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:30.288654 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-80bad559-2303-4443-8609-a00b5127ca39 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:30.288654 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-80bad559-2303-4443-8609-a00b5127ca39 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:30.288654 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-80bad559-2303-4443-8609-a00b5127ca39 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:30.288969 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-80bad559-2303-4443-8609-a00b5127ca39 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:30.347574 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-4baa6a84-e634-4474-aeec-afa74c0b0d32 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] validate_networks() for [('c3b95160-a16e-4a1c-b8ab-a16d61597a6c', None, None, None, None, None)] {{(pid=121134) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:21:30.685124 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-80bad559-2303-4443-8609-a00b5127ca39 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:30.694513 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-80bad559-2303-4443-8609-a00b5127ca39 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/6fd536f4-6456-4291-8a11-2c48a453932a" status: 200 len: 1308 microversion: 2.1 time: 0.421649 Oct 19 03:21:30.701510 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1146/2258] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:21:30 2022] GET /compute/v2.1/servers/6fd536f4-6456-4291-8a11-2c48a453932a => generated 1308 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:21:30.728484 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-77fc7ca4-31e9-4228-8d89-c24e229a18e5 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Calling method '.version_select at 0x7fc1305e1160>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:31.348074 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-4baa6a84-e634-4474-aeec-afa74c0b0d32 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Flavor limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:21:31.349444 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-4baa6a84-e634-4474-aeec-afa74c0b0d32 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Image limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:21:31.350111 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-4baa6a84-e634-4474-aeec-afa74c0b0d32 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Flavor pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:21:31.350692 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-4baa6a84-e634-4474-aeec-afa74c0b0d32 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Image pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:21:31.351534 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-4baa6a84-e634-4474-aeec-afa74c0b0d32 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:21:31.355628 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:21:31.365837 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4baa6a84-e634-4474-aeec-afa74c0b0d32 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:31.366710 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4baa6a84-e634-4474-aeec-afa74c0b0d32 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:31.367308 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4baa6a84-e634-4474-aeec-afa74c0b0d32 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:31.368220 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4baa6a84-e634-4474-aeec-afa74c0b0d32 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:31.368806 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4baa6a84-e634-4474-aeec-afa74c0b0d32 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:31.369910 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4baa6a84-e634-4474-aeec-afa74c0b0d32 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:31.393551 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-4baa6a84-e634-4474-aeec-afa74c0b0d32 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Getting quotas for project 385a1e7cceff48798bfefb9390e5979c. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:21:31.403434 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-4baa6a84-e634-4474-aeec-afa74c0b0d32 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Getting quotas for user 3661010393d44c428fb37652b1717072 and project 385a1e7cceff48798bfefb9390e5979c. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:21:31.417294 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4baa6a84-e634-4474-aeec-afa74c0b0d32 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Going to run 1 instances... {{(pid=121134) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:21:31.419834 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4baa6a84-e634-4474-aeec-afa74c0b0d32 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] [instance: 3b4bc3da-47f7-4719-817f-5636c247c87e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:21:31.485889 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-77fc7ca4-31e9-4228-8d89-c24e229a18e5 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/21a3128c-b3c3-4439-a00c-6c514bb3c5b5" status: 202 len: 0 microversion: 2.1 time: 0.788341 Oct 19 03:21:31.487348 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1147/2259] 10.222.0.52 () {58 vars in 1272 bytes} [Wed Oct 19 03:21:30 2022] DELETE /compute/v2.1/os-security-groups/21a3128c-b3c3-4439-a00c-6c514bb3c5b5 => generated 0 bytes in 790 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:21:31.498762 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-98b9b06e-a71e-4806-817e-76afccfb66b1 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:31.499564 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-98b9b06e-a71e-4806-817e-76afccfb66b1 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] [instance: 6888c8db-82ba-4072-b431-8d4fcf5f03e0] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:31.523541 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-98b9b06e-a71e-4806-817e-76afccfb66b1 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:31.534203 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-98b9b06e-a71e-4806-817e-76afccfb66b1 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:31.534203 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-98b9b06e-a71e-4806-817e-76afccfb66b1 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:31.534203 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-98b9b06e-a71e-4806-817e-76afccfb66b1 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:31.534203 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-98b9b06e-a71e-4806-817e-76afccfb66b1 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:31.534701 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-98b9b06e-a71e-4806-817e-76afccfb66b1 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:31.639646 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4baa6a84-e634-4474-aeec-afa74c0b0d32 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.427785 Oct 19 03:21:31.640419 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1113/2260] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:21:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1429 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 03:21:31.645665 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0e712ccf-bb47-47f5-9365-7a0f9d886561 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:31.646499 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0e712ccf-bb47-47f5-9365-7a0f9d886561 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] [instance: 67358716-e31b-4e54-b23b-592845c983ea] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:31.659388 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0e712ccf-bb47-47f5-9365-7a0f9d886561 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:31.660383 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0e712ccf-bb47-47f5-9365-7a0f9d886561 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:31.660383 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0e712ccf-bb47-47f5-9365-7a0f9d886561 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:31.661055 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0e712ccf-bb47-47f5-9365-7a0f9d886561 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:31.662317 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0e712ccf-bb47-47f5-9365-7a0f9d886561 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:31.662883 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0e712ccf-bb47-47f5-9365-7a0f9d886561 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:31.692224 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-98b9b06e-a71e-4806-817e-76afccfb66b1 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4c5e4123c44508a5d4911a17c44231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a495ccfced47f29cb928d1ded20d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:31.701192 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-98b9b06e-a71e-4806-817e-76afccfb66b1 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] 10.222.0.52 "GET /compute/v2.1/servers/6888c8db-82ba-4072-b431-8d4fcf5f03e0" status: 200 len: 1472 microversion: 2.1 time: 0.212649 Oct 19 03:21:31.702423 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1148/2261] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:21:31 2022] GET /compute/v2.1/servers/6888c8db-82ba-4072-b431-8d4fcf5f03e0 => generated 1472 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:21:31.709268 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7a3bda13-cbe1-4eef-a85e-4b1fcdcd3c42 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:31.710090 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7a3bda13-cbe1-4eef-a85e-4b1fcdcd3c42 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] [instance: 951e236c-943a-4f8c-956d-ac7bbbf0e0e1] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:31.716726 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7a3bda13-cbe1-4eef-a85e-4b1fcdcd3c42 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:31.718702 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7a3bda13-cbe1-4eef-a85e-4b1fcdcd3c42 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:31.719489 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7a3bda13-cbe1-4eef-a85e-4b1fcdcd3c42 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:31.720254 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7a3bda13-cbe1-4eef-a85e-4b1fcdcd3c42 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:31.721840 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7a3bda13-cbe1-4eef-a85e-4b1fcdcd3c42 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:31.722594 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7a3bda13-cbe1-4eef-a85e-4b1fcdcd3c42 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:31.761550 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7a3bda13-cbe1-4eef-a85e-4b1fcdcd3c42 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:31.762041 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7a3bda13-cbe1-4eef-a85e-4b1fcdcd3c42 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:31.762657 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7a3bda13-cbe1-4eef-a85e-4b1fcdcd3c42 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:31.763258 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-7a3bda13-cbe1-4eef-a85e-4b1fcdcd3c42 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Lazy-loading 'fault' on Instance uuid 951e236c-943a-4f8c-956d-ac7bbbf0e0e1 {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:21:31.777558 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0e712ccf-bb47-47f5-9365-7a0f9d886561 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8824f20e6a1f478a99f90e1ba8f028fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e436373e9e45efa03f08b33da619e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:31.787307 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0e712ccf-bb47-47f5-9365-7a0f9d886561 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] 10.222.0.52 "GET /compute/v2.1/servers/67358716-e31b-4e54-b23b-592845c983ea" status: 200 len: 1486 microversion: 2.1 time: 0.145339 Oct 19 03:21:31.788124 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1114/2262] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:21:31 2022] GET /compute/v2.1/servers/67358716-e31b-4e54-b23b-592845c983ea => generated 1486 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:21:31.797787 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-de9b9309-2af9-48e5-ac15-f5bedf05e0fc tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:31.798410 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-de9b9309-2af9-48e5-ac15-f5bedf05e0fc tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 074f3469-3bbd-46df-8286-3a57f91798e2] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:31.809705 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-de9b9309-2af9-48e5-ac15-f5bedf05e0fc tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:31.810468 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-de9b9309-2af9-48e5-ac15-f5bedf05e0fc tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:31.811184 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-de9b9309-2af9-48e5-ac15-f5bedf05e0fc tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:31.812228 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-de9b9309-2af9-48e5-ac15-f5bedf05e0fc tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:31.812886 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-de9b9309-2af9-48e5-ac15-f5bedf05e0fc tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:31.813662 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-de9b9309-2af9-48e5-ac15-f5bedf05e0fc tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:31.821451 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7a3bda13-cbe1-4eef-a85e-4b1fcdcd3c42 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ec45c74dcd448e924be40b1abfbc4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce8d13fab4fe4725a4759519818113f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:31.831750 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7a3bda13-cbe1-4eef-a85e-4b1fcdcd3c42 tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] 10.222.0.52 "GET /compute/v2.1/servers/951e236c-943a-4f8c-956d-ac7bbbf0e0e1" status: 200 len: 1258 microversion: 2.1 time: 0.127973 Oct 19 03:21:31.832716 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1149/2263] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:21:31 2022] GET /compute/v2.1/servers/951e236c-943a-4f8c-956d-ac7bbbf0e0e1 => generated 1258 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:21:31.844629 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-3e51d581-ed6b-4c2b-a75e-3d8d65b63cf0 req-27af325f-0998-4050-add9-ded639a76914 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67358716-e31b-4e54-b23b-592845c983ea", "name": "network-vif-deleted", "tag": "2adf0a16-bf47-4556-8224-4f72d8567375"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:21:31.854697 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-3e51d581-ed6b-4c2b-a75e-3d8d65b63cf0 req-27af325f-0998-4050-add9-ded639a76914 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:31.855248 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-3e51d581-ed6b-4c2b-a75e-3d8d65b63cf0 req-27af325f-0998-4050-add9-ded639a76914 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:31.855899 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-3e51d581-ed6b-4c2b-a75e-3d8d65b63cf0 req-27af325f-0998-4050-add9-ded639a76914 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:31.879365 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-3e51d581-ed6b-4c2b-a75e-3d8d65b63cf0 req-27af325f-0998-4050-add9-ded639a76914 service nova] Creating event network-vif-deleted:2adf0a16-bf47-4556-8224-4f72d8567375 for instance 67358716-e31b-4e54-b23b-592845c983ea on n-h2-861333-8 Oct 19 03:21:31.884821 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-3e51d581-ed6b-4c2b-a75e-3d8d65b63cf0 req-27af325f-0998-4050-add9-ded639a76914 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050767 Oct 19 03:21:31.885938 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1150/2264] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:21:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:21:31.892130 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f589532d-a5ae-4f57-a240-8398b1b56231 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:31.893475 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f589532d-a5ae-4f57-a240-8398b1b56231 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] [instance: 4adec402-e94f-4a41-ac77-68f6091b87f7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:31.902594 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f589532d-a5ae-4f57-a240-8398b1b56231 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:31.904187 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f589532d-a5ae-4f57-a240-8398b1b56231 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:31.904783 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f589532d-a5ae-4f57-a240-8398b1b56231 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:31.906357 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f589532d-a5ae-4f57-a240-8398b1b56231 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:31.907271 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f589532d-a5ae-4f57-a240-8398b1b56231 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:31.908054 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f589532d-a5ae-4f57-a240-8398b1b56231 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:32.016029 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-de9b9309-2af9-48e5-ac15-f5bedf05e0fc tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:32.032872 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-de9b9309-2af9-48e5-ac15-f5bedf05e0fc tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:32.035163 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-de9b9309-2af9-48e5-ac15-f5bedf05e0fc tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:32.037520 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-de9b9309-2af9-48e5-ac15-f5bedf05e0fc tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/074f3469-3bbd-46df-8286-3a57f91798e2" status: 200 len: 1485 microversion: 2.25 time: 0.248510 Oct 19 03:21:32.038436 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1115/2265] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:21:31 2022] GET /compute/v2.1/servers/074f3469-3bbd-46df-8286-3a57f91798e2 => generated 1485 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:21:32.044429 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e0a560a3-791c-4591-aa75-2515e523984d tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:32.045121 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e0a560a3-791c-4591-aa75-2515e523984d tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] [instance: fee1d282-ae3a-4792-ba8f-a19e498c8853] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:32.053207 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e0a560a3-791c-4591-aa75-2515e523984d tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:32.053904 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e0a560a3-791c-4591-aa75-2515e523984d tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:32.054512 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e0a560a3-791c-4591-aa75-2515e523984d tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:32.055494 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e0a560a3-791c-4591-aa75-2515e523984d tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:32.056241 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e0a560a3-791c-4591-aa75-2515e523984d tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:32.057011 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e0a560a3-791c-4591-aa75-2515e523984d tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:32.096917 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e0a560a3-791c-4591-aa75-2515e523984d tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] [instance: fee1d282-ae3a-4792-ba8f-a19e498c8853] Going to try to terminate instance {{(pid=121134) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:21:32.167611 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f589532d-a5ae-4f57-a240-8398b1b56231 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:32.179697 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f589532d-a5ae-4f57-a240-8398b1b56231 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:32.181852 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f589532d-a5ae-4f57-a240-8398b1b56231 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:32.183303 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f589532d-a5ae-4f57-a240-8398b1b56231 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] 10.222.0.52 "GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7" status: 200 len: 1874 microversion: 2.32 time: 0.296003 Oct 19 03:21:32.192640 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1151/2266] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:21:31 2022] GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7 => generated 1874 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:21:32.192640 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-cdae4bae-64dc-4b65-8ee0-e438fd08009c tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:32.195328 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-cdae4bae-64dc-4b65-8ee0-e438fd08009c tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] [instance: 3b4bc3da-47f7-4719-817f-5636c247c87e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:32.293728 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-cdae4bae-64dc-4b65-8ee0-e438fd08009c tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3661010393d44c428fb37652b1717072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a1e7cceff48798bfefb9390e5979c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:32.302107 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-cdae4bae-64dc-4b65-8ee0-e438fd08009c tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] 10.222.0.52 "GET /compute/v2.1/servers/3b4bc3da-47f7-4719-817f-5636c247c87e" status: 200 len: 1216 microversion: 2.1 time: 0.116611 Oct 19 03:21:32.316199 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1152/2267] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:21:32 2022] GET /compute/v2.1/servers/3b4bc3da-47f7-4719-817f-5636c247c87e => generated 1216 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:21:32.323220 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-457ffcba-5d54-42fd-a5a4-4c624b8945ce tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:32.323933 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-457ffcba-5d54-42fd-a5a4-4c624b8945ce tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: 6fd536f4-6456-4291-8a11-2c48a453932a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:32.331263 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-457ffcba-5d54-42fd-a5a4-4c624b8945ce tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:32.331843 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-457ffcba-5d54-42fd-a5a4-4c624b8945ce tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:32.332405 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-457ffcba-5d54-42fd-a5a4-4c624b8945ce tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:32.333179 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-457ffcba-5d54-42fd-a5a4-4c624b8945ce tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:32.334064 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-457ffcba-5d54-42fd-a5a4-4c624b8945ce tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:32.334230 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-457ffcba-5d54-42fd-a5a4-4c624b8945ce tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:32.530983 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-457ffcba-5d54-42fd-a5a4-4c624b8945ce tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:32.535452 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:21:32.542224 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-457ffcba-5d54-42fd-a5a4-4c624b8945ce tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/6fd536f4-6456-4291-8a11-2c48a453932a" status: 200 len: 1487 microversion: 2.1 time: 0.224007 Oct 19 03:21:32.543310 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1153/2268] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:21:32 2022] GET /compute/v2.1/servers/6fd536f4-6456-4291-8a11-2c48a453932a => generated 1487 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:21:32.568398 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1fc833ff-83d2-4cb5-90c5-4354afed9346 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:21:32.568972 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1fc833ff-83d2-4cb5-90c5-4354afed9346 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: 6fd536f4-6456-4291-8a11-2c48a453932a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:32.579543 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1fc833ff-83d2-4cb5-90c5-4354afed9346 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:32.580905 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1fc833ff-83d2-4cb5-90c5-4354afed9346 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:32.581534 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1fc833ff-83d2-4cb5-90c5-4354afed9346 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:32.582271 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1fc833ff-83d2-4cb5-90c5-4354afed9346 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:32.582732 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1fc833ff-83d2-4cb5-90c5-4354afed9346 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:32.583163 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1fc833ff-83d2-4cb5-90c5-4354afed9346 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:32.594517 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e0a560a3-791c-4591-aa75-2515e523984d tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] 10.222.0.52 "DELETE /compute/v2.1/servers/fee1d282-ae3a-4792-ba8f-a19e498c8853" status: 204 len: 0 microversion: 2.1 time: 0.554198 Oct 19 03:21:32.598802 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1116/2269] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:21:32 2022] DELETE /compute/v2.1/servers/fee1d282-ae3a-4792-ba8f-a19e498c8853 => generated 0 bytes in 556 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:21:32.617119 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ca7055f0-85ce-403a-b681-713b4af4e25a tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:32.618568 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ca7055f0-85ce-403a-b681-713b4af4e25a tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] [instance: fee1d282-ae3a-4792-ba8f-a19e498c8853] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:32.635720 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ca7055f0-85ce-403a-b681-713b4af4e25a tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:32.637800 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ca7055f0-85ce-403a-b681-713b4af4e25a tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:32.641293 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ca7055f0-85ce-403a-b681-713b4af4e25a tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:32.643201 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ca7055f0-85ce-403a-b681-713b4af4e25a tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:32.644099 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ca7055f0-85ce-403a-b681-713b4af4e25a tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:32.644825 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ca7055f0-85ce-403a-b681-713b4af4e25a tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:32.793824 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ca7055f0-85ce-403a-b681-713b4af4e25a tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '152fa52a83b14c71bf86b22d77a73625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1606da859950484e9aa949e5c59c0a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:32.802354 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ca7055f0-85ce-403a-b681-713b4af4e25a tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] 10.222.0.52 "GET /compute/v2.1/servers/fee1d282-ae3a-4792-ba8f-a19e498c8853" status: 200 len: 1510 microversion: 2.1 time: 0.193199 Oct 19 03:21:32.809510 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1117/2270] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:21:32 2022] GET /compute/v2.1/servers/fee1d282-ae3a-4792-ba8f-a19e498c8853 => generated 1510 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:21:32.813021 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-35464406-9609-489c-8125-b8c70d4591ff tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:32.813670 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-35464406-9609-489c-8125-b8c70d4591ff tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] [instance: 6888c8db-82ba-4072-b431-8d4fcf5f03e0] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:32.820841 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-35464406-9609-489c-8125-b8c70d4591ff tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:32.821345 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-35464406-9609-489c-8125-b8c70d4591ff tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:32.822159 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-35464406-9609-489c-8125-b8c70d4591ff tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:32.822559 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-35464406-9609-489c-8125-b8c70d4591ff tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:32.823016 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-35464406-9609-489c-8125-b8c70d4591ff tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:32.823469 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-35464406-9609-489c-8125-b8c70d4591ff tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:32.935697 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1fc833ff-83d2-4cb5-90c5-4354afed9346 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "POST /compute/v2.1/servers/6fd536f4-6456-4291-8a11-2c48a453932a/action" status: 202 len: 0 microversion: 2.1 time: 0.372613 Oct 19 03:21:32.940604 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1154/2271] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:21:32 2022] POST /compute/v2.1/servers/6fd536f4-6456-4291-8a11-2c48a453932a/action => generated 0 bytes in 378 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 19 03:21:32.946342 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f418b24b-43ec-40b6-bf94-56c1ee5c6eb1 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:32.947341 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f418b24b-43ec-40b6-bf94-56c1ee5c6eb1 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] [instance: 67358716-e31b-4e54-b23b-592845c983ea] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:32.956487 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f418b24b-43ec-40b6-bf94-56c1ee5c6eb1 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:32.962912 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f418b24b-43ec-40b6-bf94-56c1ee5c6eb1 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:32.962912 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f418b24b-43ec-40b6-bf94-56c1ee5c6eb1 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:32.962912 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f418b24b-43ec-40b6-bf94-56c1ee5c6eb1 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:32.962912 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f418b24b-43ec-40b6-bf94-56c1ee5c6eb1 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:32.963368 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f418b24b-43ec-40b6-bf94-56c1ee5c6eb1 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:32.963437 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-35464406-9609-489c-8125-b8c70d4591ff tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4c5e4123c44508a5d4911a17c44231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a495ccfced47f29cb928d1ded20d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:32.968851 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-35464406-9609-489c-8125-b8c70d4591ff tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] 10.222.0.52 "GET /compute/v2.1/servers/6888c8db-82ba-4072-b431-8d4fcf5f03e0" status: 200 len: 1472 microversion: 2.1 time: 0.164560 Oct 19 03:21:32.969670 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1118/2272] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:21:32 2022] GET /compute/v2.1/servers/6888c8db-82ba-4072-b431-8d4fcf5f03e0 => generated 1472 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:21:32.974987 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6d8f4df8-0348-4ed8-9df3-ff78ab9bb8ef tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:32.975964 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6d8f4df8-0348-4ed8-9df3-ff78ab9bb8ef tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] [instance: 951e236c-943a-4f8c-956d-ac7bbbf0e0e1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:32.991123 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6d8f4df8-0348-4ed8-9df3-ff78ab9bb8ef tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:32.991757 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6d8f4df8-0348-4ed8-9df3-ff78ab9bb8ef tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:32.992415 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6d8f4df8-0348-4ed8-9df3-ff78ab9bb8ef tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:32.993209 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6d8f4df8-0348-4ed8-9df3-ff78ab9bb8ef tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:32.993774 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6d8f4df8-0348-4ed8-9df3-ff78ab9bb8ef tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:32.994440 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6d8f4df8-0348-4ed8-9df3-ff78ab9bb8ef tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:33.003993 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f418b24b-43ec-40b6-bf94-56c1ee5c6eb1 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:33.004555 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f418b24b-43ec-40b6-bf94-56c1ee5c6eb1 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:33.004941 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f418b24b-43ec-40b6-bf94-56c1ee5c6eb1 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:33.005419 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-f418b24b-43ec-40b6-bf94-56c1ee5c6eb1 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lazy-loading 'fault' on Instance uuid 67358716-e31b-4e54-b23b-592845c983ea {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:21:33.012081 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-6d8f4df8-0348-4ed8-9df3-ff78ab9bb8ef tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] HTTP exception thrown: Instance 951e236c-943a-4f8c-956d-ac7bbbf0e0e1 could not be found. Oct 19 03:21:33.013798 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6d8f4df8-0348-4ed8-9df3-ff78ab9bb8ef tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Request method failure captured: Oct 19 03:21:33.013798 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/951e236c-943a-4f8c-956d-ac7bbbf0e0e1 HTTP/1.1 Oct 19 03:21:33.013798 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:21:33.013798 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:21:33.013798 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:21:33.013798 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:21:33.013798 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:21:33.013798 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:21:33.013798 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:21:33.013798 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:21:33.013798 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT2xuAcU6hrRavcK81fXn2kqRYHrE4aNHCOLEvnDlF47fbQQH9G0cJ_x9oRr9TYu3zXMXjcaSI_Wl77gPQTdfnnkBwRfKgsaoQebt3IYyqgqLHDYDNOL0g1W9IuIUl2jqeapBj-PwIIcL9gVwBkO9eONS4XZkd9uio-wvV4NnqBetJkU Oct 19 03:21:33.013798 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:21:33.013798 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:21:33.013798 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:21:33.013798 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:21:33.013798 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:21:33.013798 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:21:33.013798 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: ce8d13fab4fe4725a4759519818113f0 Oct 19 03:21:33.013798 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ServersTestBootFromVolume-1808459434 Oct 19 03:21:33.013798 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:21:33.013798 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:21:33.015070 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ce8d13fab4fe4725a4759519818113f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ce8d13fab4fe4725a4759519818113f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ce8d13fab4fe4725a4759519818113f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ce8d13fab4fe4725a4759519818113f0", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:21:33.015070 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ServersTestBootFromVolume-1808459434 Oct 19 03:21:33.015070 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: ce8d13fab4fe4725a4759519818113f0 Oct 19 03:21:33.015070 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ServersTestBootFromVolume-1808459434 Oct 19 03:21:33.015070 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ServersTestBootFromVolume-1808459434-project Oct 19 03:21:33.015070 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:21:33.015070 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:21:33.015070 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 28ec45c74dcd448e924be40b1abfbc4a Oct 19 03:21:33.015070 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ServersTestBootFromVolume-1808459434-project Oct 19 03:21:33.015070 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:21:33.015070 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance 951e236c-943a-4f8c-956d-ac7bbbf0e0e1 could not be found. Oct 19 03:21:33.015070 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '951e236c-943a-4f8c-956d-ac7bbbf0e0e1'} Oct 19 03:21:33.016463 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:21:33.016463 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:21:33.016463 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:21:33.016463 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:21:33.016463 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:21:33.016463 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:21:33.016463 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:21:33.016463 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:21:33.016463 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:21:33.016463 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:21:33.016463 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 951e236c-943a-4f8c-956d-ac7bbbf0e0e1 could not be found. Oct 19 03:21:33.016463 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:21:33.016463 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:21:33.016463 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:21:33.016463 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:21:33.016463 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:21:33.016463 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:21:33.016463 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:21:33.016463 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:21:33.016463 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:21:33.017468 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:21:33.017468 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:21:33.017468 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:21:33.017468 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:21:33.017468 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:21:33.017468 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:21:33.017468 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:21:33.017468 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 951e236c-943a-4f8c-956d-ac7bbbf0e0e1 could not be found. Oct 19 03:21:33.017468 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:21:33.017468 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:21:33.017468 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:21:33.017468 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:21:33.017468 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:21:33.017468 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:21:33.017468 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:21:33.017468 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:21:33.017468 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 951e236c-943a-4f8c-956d-ac7bbbf0e0e1 could not be found. Oct 19 03:21:33.017468 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:21:33.019869 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6d8f4df8-0348-4ed8-9df3-ff78ab9bb8ef tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Returning 404 to user: Instance 951e236c-943a-4f8c-956d-ac7bbbf0e0e1 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:21:33.019869 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6d8f4df8-0348-4ed8-9df3-ff78ab9bb8ef tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] 10.222.0.52 "GET /compute/v2.1/servers/951e236c-943a-4f8c-956d-ac7bbbf0e0e1" status: 404 len: 111 microversion: 2.1 time: 0.044523 Oct 19 03:21:33.019869 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1119/2273] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:21:32 2022] GET /compute/v2.1/servers/951e236c-943a-4f8c-956d-ac7bbbf0e0e1 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:21:33.022808 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2474ec1d-09a7-4b81-998c-bea747e90211 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:33.023427 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2474ec1d-09a7-4b81-998c-bea747e90211 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: 6fd536f4-6456-4291-8a11-2c48a453932a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:33.032703 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2474ec1d-09a7-4b81-998c-bea747e90211 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:33.032703 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2474ec1d-09a7-4b81-998c-bea747e90211 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:33.032703 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2474ec1d-09a7-4b81-998c-bea747e90211 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:33.032703 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2474ec1d-09a7-4b81-998c-bea747e90211 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:33.033059 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2474ec1d-09a7-4b81-998c-bea747e90211 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:33.033059 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2474ec1d-09a7-4b81-998c-bea747e90211 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:33.055722 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f418b24b-43ec-40b6-bf94-56c1ee5c6eb1 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8824f20e6a1f478a99f90e1ba8f028fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e436373e9e45efa03f08b33da619e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:33.063046 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f418b24b-43ec-40b6-bf94-56c1ee5c6eb1 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] 10.222.0.52 "GET /compute/v2.1/servers/67358716-e31b-4e54-b23b-592845c983ea" status: 200 len: 1315 microversion: 2.1 time: 0.120874 Oct 19 03:21:33.064918 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1155/2274] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:21:32 2022] GET /compute/v2.1/servers/67358716-e31b-4e54-b23b-592845c983ea => generated 1315 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:21:33.070074 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c330363b-853c-4d49-bee4-cc6aa80cd5cb tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] Calling method '.version_select at 0x7fc130ee1b80>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:33.179189 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c330363b-853c-4d49-bee4-cc6aa80cd5cb tempest-ServersTestBootFromVolume-1808459434 tempest-ServersTestBootFromVolume-1808459434-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1307991980" status: 202 len: 0 microversion: 2.1 time: 0.112993 Oct 19 03:21:33.180193 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1156/2275] 10.222.0.52 () {58 vars in 1221 bytes} [Wed Oct 19 03:21:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1307991980 => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:21:33.187126 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-63d14524-329c-4d2e-a97d-f96f348d68a6 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:33.187949 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-63d14524-329c-4d2e-a97d-f96f348d68a6 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 074f3469-3bbd-46df-8286-3a57f91798e2] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:33.196245 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-63d14524-329c-4d2e-a97d-f96f348d68a6 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:33.197074 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-63d14524-329c-4d2e-a97d-f96f348d68a6 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:33.197763 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-63d14524-329c-4d2e-a97d-f96f348d68a6 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:33.198704 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-63d14524-329c-4d2e-a97d-f96f348d68a6 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:33.199365 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-63d14524-329c-4d2e-a97d-f96f348d68a6 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:33.200028 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-63d14524-329c-4d2e-a97d-f96f348d68a6 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:33.583266 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-2474ec1d-09a7-4b81-998c-bea747e90211 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:33.591539 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2474ec1d-09a7-4b81-998c-bea747e90211 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/6fd536f4-6456-4291-8a11-2c48a453932a" status: 200 len: 1492 microversion: 2.1 time: 0.572413 Oct 19 03:21:33.612018 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1120/2276] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:21:33 2022] GET /compute/v2.1/servers/6fd536f4-6456-4291-8a11-2c48a453932a => generated 1492 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:21:33.624250 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-cc1cd59f-f755-4930-a2ce-16b5440b6fb5 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:33.630031 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-cc1cd59f-f755-4930-a2ce-16b5440b6fb5 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] [instance: 4adec402-e94f-4a41-ac77-68f6091b87f7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:33.655030 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cc1cd59f-f755-4930-a2ce-16b5440b6fb5 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:33.656096 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cc1cd59f-f755-4930-a2ce-16b5440b6fb5 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:33.656631 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cc1cd59f-f755-4930-a2ce-16b5440b6fb5 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:33.657623 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cc1cd59f-f755-4930-a2ce-16b5440b6fb5 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:33.658635 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cc1cd59f-f755-4930-a2ce-16b5440b6fb5 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:33.659280 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cc1cd59f-f755-4930-a2ce-16b5440b6fb5 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:33.701837 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-63d14524-329c-4d2e-a97d-f96f348d68a6 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:33.716532 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-63d14524-329c-4d2e-a97d-f96f348d68a6 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:33.718027 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-63d14524-329c-4d2e-a97d-f96f348d68a6 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:33.722519 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-63d14524-329c-4d2e-a97d-f96f348d68a6 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/074f3469-3bbd-46df-8286-3a57f91798e2" status: 200 len: 1485 microversion: 2.25 time: 0.539419 Oct 19 03:21:33.723116 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1157/2277] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:21:33 2022] GET /compute/v2.1/servers/074f3469-3bbd-46df-8286-3a57f91798e2 => generated 1485 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:21:33.732752 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-041c2133-51f1-44fd-abf6-03462170a326 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:33.733462 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-041c2133-51f1-44fd-abf6-03462170a326 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] [instance: 3b4bc3da-47f7-4719-817f-5636c247c87e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:33.754422 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-041c2133-51f1-44fd-abf6-03462170a326 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:33.755142 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-041c2133-51f1-44fd-abf6-03462170a326 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:33.755778 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-041c2133-51f1-44fd-abf6-03462170a326 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:33.756654 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-041c2133-51f1-44fd-abf6-03462170a326 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:33.757246 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-041c2133-51f1-44fd-abf6-03462170a326 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:33.758307 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-041c2133-51f1-44fd-abf6-03462170a326 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:33.927335 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-041c2133-51f1-44fd-abf6-03462170a326 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3661010393d44c428fb37652b1717072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a1e7cceff48798bfefb9390e5979c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:33.938263 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-041c2133-51f1-44fd-abf6-03462170a326 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] 10.222.0.52 "GET /compute/v2.1/servers/3b4bc3da-47f7-4719-817f-5636c247c87e" status: 200 len: 1220 microversion: 2.1 time: 0.212173 Oct 19 03:21:33.953421 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1158/2278] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:21:33 2022] GET /compute/v2.1/servers/3b4bc3da-47f7-4719-817f-5636c247c87e => generated 1220 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:21:33.975797 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e80188e9-0c73-4869-8ece-84e391bfa547 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:33.977096 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e80188e9-0c73-4869-8ece-84e391bfa547 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] [instance: fee1d282-ae3a-4792-ba8f-a19e498c8853] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:33.981989 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:21:33.991840 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-cc1cd59f-f755-4930-a2ce-16b5440b6fb5 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:33.991960 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e80188e9-0c73-4869-8ece-84e391bfa547 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:33.992147 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e80188e9-0c73-4869-8ece-84e391bfa547 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:33.992646 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e80188e9-0c73-4869-8ece-84e391bfa547 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:33.993390 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e80188e9-0c73-4869-8ece-84e391bfa547 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:33.993939 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e80188e9-0c73-4869-8ece-84e391bfa547 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:33.994373 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e80188e9-0c73-4869-8ece-84e391bfa547 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:34.002386 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-cc1cd59f-f755-4930-a2ce-16b5440b6fb5 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:34.004047 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-cc1cd59f-f755-4930-a2ce-16b5440b6fb5 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:34.005484 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-cc1cd59f-f755-4930-a2ce-16b5440b6fb5 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] 10.222.0.52 "GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7" status: 200 len: 1874 microversion: 2.32 time: 0.392274 Oct 19 03:21:34.006550 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1121/2279] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:21:33 2022] GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7 => generated 1874 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:21:34.011206 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-14c421a1-ed99-4c0a-bb33-e53d1d064275 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:34.012716 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-14c421a1-ed99-4c0a-bb33-e53d1d064275 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] [instance: 6888c8db-82ba-4072-b431-8d4fcf5f03e0] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:34.020209 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-14c421a1-ed99-4c0a-bb33-e53d1d064275 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:34.020844 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-14c421a1-ed99-4c0a-bb33-e53d1d064275 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:34.021582 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-14c421a1-ed99-4c0a-bb33-e53d1d064275 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:34.022433 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-14c421a1-ed99-4c0a-bb33-e53d1d064275 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:34.027292 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-14c421a1-ed99-4c0a-bb33-e53d1d064275 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:34.027292 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-14c421a1-ed99-4c0a-bb33-e53d1d064275 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:34.291688 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-e80188e9-0c73-4869-8ece-84e391bfa547 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '152fa52a83b14c71bf86b22d77a73625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1606da859950484e9aa949e5c59c0a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:34.295595 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-14c421a1-ed99-4c0a-bb33-e53d1d064275 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4c5e4123c44508a5d4911a17c44231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a495ccfced47f29cb928d1ded20d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:34.300686 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e80188e9-0c73-4869-8ece-84e391bfa547 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] 10.222.0.52 "GET /compute/v2.1/servers/fee1d282-ae3a-4792-ba8f-a19e498c8853" status: 200 len: 1510 microversion: 2.1 time: 0.348160 Oct 19 03:21:34.301324 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1159/2280] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:21:33 2022] GET /compute/v2.1/servers/fee1d282-ae3a-4792-ba8f-a19e498c8853 => generated 1510 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:21:34.303901 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-14c421a1-ed99-4c0a-bb33-e53d1d064275 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] 10.222.0.52 "GET /compute/v2.1/servers/6888c8db-82ba-4072-b431-8d4fcf5f03e0" status: 200 len: 1472 microversion: 2.1 time: 0.296168 Oct 19 03:21:34.305657 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1122/2281] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:21:34 2022] GET /compute/v2.1/servers/6888c8db-82ba-4072-b431-8d4fcf5f03e0 => generated 1472 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:21:34.312731 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-fce88ad9-89c3-476c-bf1c-2416babe4df7 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:34.313693 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-fce88ad9-89c3-476c-bf1c-2416babe4df7 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] [instance: 67358716-e31b-4e54-b23b-592845c983ea] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:34.321580 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fce88ad9-89c3-476c-bf1c-2416babe4df7 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:34.322173 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fce88ad9-89c3-476c-bf1c-2416babe4df7 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:34.322632 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fce88ad9-89c3-476c-bf1c-2416babe4df7 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:34.323346 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fce88ad9-89c3-476c-bf1c-2416babe4df7 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:34.323822 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fce88ad9-89c3-476c-bf1c-2416babe4df7 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:34.324238 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fce88ad9-89c3-476c-bf1c-2416babe4df7 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:34.356223 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fce88ad9-89c3-476c-bf1c-2416babe4df7 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:34.356694 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fce88ad9-89c3-476c-bf1c-2416babe4df7 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:34.357125 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fce88ad9-89c3-476c-bf1c-2416babe4df7 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:34.357588 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-fce88ad9-89c3-476c-bf1c-2416babe4df7 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lazy-loading 'fault' on Instance uuid 67358716-e31b-4e54-b23b-592845c983ea {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:21:34.431411 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-fce88ad9-89c3-476c-bf1c-2416babe4df7 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8824f20e6a1f478a99f90e1ba8f028fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e436373e9e45efa03f08b33da619e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:34.443504 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-fce88ad9-89c3-476c-bf1c-2416babe4df7 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] 10.222.0.52 "GET /compute/v2.1/servers/67358716-e31b-4e54-b23b-592845c983ea" status: 200 len: 1315 microversion: 2.1 time: 0.132994 Oct 19 03:21:34.456016 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1160/2282] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:21:34 2022] GET /compute/v2.1/servers/67358716-e31b-4e54-b23b-592845c983ea => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:21:34.620690 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-42fc3dd9-72a9-493a-a2b9-5744502d1c61 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:34.622422 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-42fc3dd9-72a9-493a-a2b9-5744502d1c61 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: 6fd536f4-6456-4291-8a11-2c48a453932a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:34.632207 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-42fc3dd9-72a9-493a-a2b9-5744502d1c61 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:34.632686 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-42fc3dd9-72a9-493a-a2b9-5744502d1c61 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:34.633477 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-42fc3dd9-72a9-493a-a2b9-5744502d1c61 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:34.634197 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-42fc3dd9-72a9-493a-a2b9-5744502d1c61 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:34.634874 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-42fc3dd9-72a9-493a-a2b9-5744502d1c61 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:34.635308 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-42fc3dd9-72a9-493a-a2b9-5744502d1c61 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:34.758992 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e7e612b6-d226-4a8b-a27a-fcbd307a36f1 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:34.759842 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e7e612b6-d226-4a8b-a27a-fcbd307a36f1 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 074f3469-3bbd-46df-8286-3a57f91798e2] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:34.776733 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e7e612b6-d226-4a8b-a27a-fcbd307a36f1 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:34.777950 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e7e612b6-d226-4a8b-a27a-fcbd307a36f1 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:34.779979 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e7e612b6-d226-4a8b-a27a-fcbd307a36f1 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:34.782421 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e7e612b6-d226-4a8b-a27a-fcbd307a36f1 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:34.783925 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e7e612b6-d226-4a8b-a27a-fcbd307a36f1 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:34.784569 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e7e612b6-d226-4a8b-a27a-fcbd307a36f1 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:34.820616 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-42fc3dd9-72a9-493a-a2b9-5744502d1c61 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:34.832243 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-42fc3dd9-72a9-493a-a2b9-5744502d1c61 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/6fd536f4-6456-4291-8a11-2c48a453932a" status: 200 len: 1472 microversion: 2.1 time: 0.217032 Oct 19 03:21:34.847261 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1123/2283] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:21:34 2022] GET /compute/v2.1/servers/6fd536f4-6456-4291-8a11-2c48a453932a => generated 1472 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:21:34.859626 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c1332841-3496-4510-a405-e303209c6816 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-961781822"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:21:34.862992 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c1332841-3496-4510-a405-e303209c6816 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: 6fd536f4-6456-4291-8a11-2c48a453932a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:34.870567 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c1332841-3496-4510-a405-e303209c6816 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:34.871701 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c1332841-3496-4510-a405-e303209c6816 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:34.872350 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c1332841-3496-4510-a405-e303209c6816 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:34.873649 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c1332841-3496-4510-a405-e303209c6816 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:34.874332 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c1332841-3496-4510-a405-e303209c6816 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:34.901219 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c1332841-3496-4510-a405-e303209c6816 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:35.013952 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-e7e612b6-d226-4a8b-a27a-fcbd307a36f1 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:35.026451 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-e7e612b6-d226-4a8b-a27a-fcbd307a36f1 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:35.028671 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-e7e612b6-d226-4a8b-a27a-fcbd307a36f1 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:35.031592 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e7e612b6-d226-4a8b-a27a-fcbd307a36f1 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/074f3469-3bbd-46df-8286-3a57f91798e2" status: 200 len: 1485 microversion: 2.25 time: 0.278232 Oct 19 03:21:35.032677 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1161/2284] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:21:34 2022] GET /compute/v2.1/servers/074f3469-3bbd-46df-8286-3a57f91798e2 => generated 1485 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:21:35.045817 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-88acd9bc-1993-4409-999b-17556344553c tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:35.047687 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-88acd9bc-1993-4409-999b-17556344553c tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] [instance: 3b4bc3da-47f7-4719-817f-5636c247c87e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:35.064585 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-88acd9bc-1993-4409-999b-17556344553c tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:35.065530 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-88acd9bc-1993-4409-999b-17556344553c tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:35.067284 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-88acd9bc-1993-4409-999b-17556344553c tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:35.068324 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-88acd9bc-1993-4409-999b-17556344553c tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:35.069083 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-88acd9bc-1993-4409-999b-17556344553c tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:35.069734 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-88acd9bc-1993-4409-999b-17556344553c tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:35.147423 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-88acd9bc-1993-4409-999b-17556344553c tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3661010393d44c428fb37652b1717072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a1e7cceff48798bfefb9390e5979c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:35.175244 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-88acd9bc-1993-4409-999b-17556344553c tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] 10.222.0.52 "GET /compute/v2.1/servers/3b4bc3da-47f7-4719-817f-5636c247c87e" status: 200 len: 1268 microversion: 2.1 time: 0.138998 Oct 19 03:21:35.191216 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1162/2285] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:21:35 2022] GET /compute/v2.1/servers/3b4bc3da-47f7-4719-817f-5636c247c87e => generated 1268 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:21:35.203602 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-68e85e15-603a-40ca-b4f4-cc9bf88e1b38 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:35.204094 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-68e85e15-603a-40ca-b4f4-cc9bf88e1b38 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] [instance: 4adec402-e94f-4a41-ac77-68f6091b87f7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:35.215741 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-68e85e15-603a-40ca-b4f4-cc9bf88e1b38 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:35.217130 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-68e85e15-603a-40ca-b4f4-cc9bf88e1b38 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:35.218825 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-68e85e15-603a-40ca-b4f4-cc9bf88e1b38 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:35.219841 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-68e85e15-603a-40ca-b4f4-cc9bf88e1b38 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:35.220744 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-68e85e15-603a-40ca-b4f4-cc9bf88e1b38 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:35.221352 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-68e85e15-603a-40ca-b4f4-cc9bf88e1b38 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:35.631807 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c1332841-3496-4510-a405-e303209c6816 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "POST /compute/v2.1/servers/6fd536f4-6456-4291-8a11-2c48a453932a/action" status: 202 len: 0 microversion: 2.1 time: 0.776686 Oct 19 03:21:35.635544 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1124/2286] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:21:34 2022] POST /compute/v2.1/servers/6fd536f4-6456-4291-8a11-2c48a453932a/action => generated 0 bytes in 781 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Oct 19 03:21:35.645581 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ccff1744-7d05-44ce-a606-5191efcdca52 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:35.658144 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ccff1744-7d05-44ce-a606-5191efcdca52 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] [instance: fee1d282-ae3a-4792-ba8f-a19e498c8853] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:35.668128 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ccff1744-7d05-44ce-a606-5191efcdca52 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:35.671166 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ccff1744-7d05-44ce-a606-5191efcdca52 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:35.671916 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ccff1744-7d05-44ce-a606-5191efcdca52 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:35.676277 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ccff1744-7d05-44ce-a606-5191efcdca52 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:35.677357 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ccff1744-7d05-44ce-a606-5191efcdca52 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:35.683588 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ccff1744-7d05-44ce-a606-5191efcdca52 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:35.753241 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-68e85e15-603a-40ca-b4f4-cc9bf88e1b38 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:35.763937 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-68e85e15-603a-40ca-b4f4-cc9bf88e1b38 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:35.765319 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-68e85e15-603a-40ca-b4f4-cc9bf88e1b38 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:35.775010 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-68e85e15-603a-40ca-b4f4-cc9bf88e1b38 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] 10.222.0.52 "GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7" status: 200 len: 1874 microversion: 2.32 time: 0.582509 Oct 19 03:21:35.775833 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1163/2287] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:21:35 2022] GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7 => generated 1874 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:21:35.785858 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-683714fe-bccc-43bc-b88f-9e4e0a4e7f87 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:35.788177 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-683714fe-bccc-43bc-b88f-9e4e0a4e7f87 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] [instance: 6888c8db-82ba-4072-b431-8d4fcf5f03e0] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:35.803079 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-683714fe-bccc-43bc-b88f-9e4e0a4e7f87 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:35.803614 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-683714fe-bccc-43bc-b88f-9e4e0a4e7f87 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:35.804019 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-683714fe-bccc-43bc-b88f-9e4e0a4e7f87 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:35.804893 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-683714fe-bccc-43bc-b88f-9e4e0a4e7f87 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:35.805531 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-683714fe-bccc-43bc-b88f-9e4e0a4e7f87 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:35.806590 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-683714fe-bccc-43bc-b88f-9e4e0a4e7f87 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:36.328608 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-683714fe-bccc-43bc-b88f-9e4e0a4e7f87 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4c5e4123c44508a5d4911a17c44231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a495ccfced47f29cb928d1ded20d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:36.343352 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-683714fe-bccc-43bc-b88f-9e4e0a4e7f87 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] 10.222.0.52 "GET /compute/v2.1/servers/6888c8db-82ba-4072-b431-8d4fcf5f03e0" status: 200 len: 1472 microversion: 2.1 time: 0.565297 Oct 19 03:21:36.347343 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1164/2288] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:21:35 2022] GET /compute/v2.1/servers/6888c8db-82ba-4072-b431-8d4fcf5f03e0 => generated 1472 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:21:36.353468 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ccff1744-7d05-44ce-a606-5191efcdca52 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '152fa52a83b14c71bf86b22d77a73625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1606da859950484e9aa949e5c59c0a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:36.359838 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1239f9ec-26dc-417f-aec2-56dd80eacc54 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:36.360776 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1239f9ec-26dc-417f-aec2-56dd80eacc54 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] [instance: 67358716-e31b-4e54-b23b-592845c983ea] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:36.370969 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ccff1744-7d05-44ce-a606-5191efcdca52 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] 10.222.0.52 "GET /compute/v2.1/servers/fee1d282-ae3a-4792-ba8f-a19e498c8853" status: 200 len: 1510 microversion: 2.1 time: 0.729919 Oct 19 03:21:36.373269 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1125/2289] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:21:35 2022] GET /compute/v2.1/servers/fee1d282-ae3a-4792-ba8f-a19e498c8853 => generated 1510 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:21:36.383856 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-08fe45bd-aaf5-428d-b1b5-2938f5cdaf3c tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '.version_select at 0x7fc135100430>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:36.386982 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1239f9ec-26dc-417f-aec2-56dd80eacc54 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:36.391867 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1239f9ec-26dc-417f-aec2-56dd80eacc54 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:36.396079 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1239f9ec-26dc-417f-aec2-56dd80eacc54 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:36.396949 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1239f9ec-26dc-417f-aec2-56dd80eacc54 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:36.397555 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1239f9ec-26dc-417f-aec2-56dd80eacc54 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:36.398067 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1239f9ec-26dc-417f-aec2-56dd80eacc54 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:36.432336 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-1239f9ec-26dc-417f-aec2-56dd80eacc54 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] HTTP exception thrown: Instance 67358716-e31b-4e54-b23b-592845c983ea could not be found. Oct 19 03:21:36.435538 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1239f9ec-26dc-417f-aec2-56dd80eacc54 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Request method failure captured: Oct 19 03:21:36.435538 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/67358716-e31b-4e54-b23b-592845c983ea HTTP/1.1 Oct 19 03:21:36.435538 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:21:36.435538 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:21:36.435538 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:21:36.435538 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:21:36.435538 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:21:36.435538 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:21:36.435538 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:21:36.435538 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:21:36.435538 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2y5QS5fGXOCh8dCARu_-t2vnckF3uwZtfqi9DmHed6pMoXibNoREyH_7cDYk3t8P2qbQ1u564D6Sq50msRMl2YQVddoWmeJm48OR72Wl7OECfXwMpGVDHULH4PSkCmyy31jkBvdZSxqyCmIGP32xNgLbjMxF4SrMQTDektLd28zxNg Oct 19 03:21:36.435538 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:21:36.435538 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:21:36.435538 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:21:36.435538 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:21:36.435538 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:21:36.435538 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:21:36.435538 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: f9e436373e9e45efa03f08b33da619e8 Oct 19 03:21:36.435538 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1767182949 Oct 19 03:21:36.435538 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:21:36.435538 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:21:36.436813 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f9e436373e9e45efa03f08b33da619e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f9e436373e9e45efa03f08b33da619e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f9e436373e9e45efa03f08b33da619e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f9e436373e9e45efa03f08b33da619e8", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:21:36.436813 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1767182949 Oct 19 03:21:36.436813 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: f9e436373e9e45efa03f08b33da619e8 Oct 19 03:21:36.436813 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1767182949 Oct 19 03:21:36.436813 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ImagesOneServerNegativeTestJSON-1767182949-project Oct 19 03:21:36.436813 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:21:36.436813 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:21:36.436813 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 8824f20e6a1f478a99f90e1ba8f028fe Oct 19 03:21:36.436813 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1767182949-project Oct 19 03:21:36.436813 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:21:36.436813 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance 67358716-e31b-4e54-b23b-592845c983ea could not be found. Oct 19 03:21:36.436813 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '67358716-e31b-4e54-b23b-592845c983ea'} Oct 19 03:21:36.437570 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:21:36.437570 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:21:36.437570 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:21:36.437570 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:21:36.437570 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:21:36.437570 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:21:36.437570 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:21:36.437570 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:21:36.437570 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:21:36.437570 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:21:36.437570 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67358716-e31b-4e54-b23b-592845c983ea could not be found. Oct 19 03:21:36.437570 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:21:36.437570 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:21:36.437570 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:21:36.437570 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:21:36.437570 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:21:36.437570 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:21:36.437570 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:21:36.437570 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:21:36.437570 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:21:36.438917 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:21:36.438917 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:21:36.438917 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:21:36.438917 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:21:36.438917 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:21:36.438917 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:21:36.438917 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:21:36.438917 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67358716-e31b-4e54-b23b-592845c983ea could not be found. Oct 19 03:21:36.438917 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:21:36.438917 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:21:36.438917 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:21:36.438917 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:21:36.438917 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:21:36.438917 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:21:36.438917 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:21:36.438917 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:21:36.438917 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67358716-e31b-4e54-b23b-592845c983ea could not be found. Oct 19 03:21:36.438917 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:21:36.440570 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1239f9ec-26dc-417f-aec2-56dd80eacc54 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Returning 404 to user: Instance 67358716-e31b-4e54-b23b-592845c983ea could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:21:36.440570 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1239f9ec-26dc-417f-aec2-56dd80eacc54 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] 10.222.0.52 "GET /compute/v2.1/servers/67358716-e31b-4e54-b23b-592845c983ea" status: 404 len: 111 microversion: 2.1 time: 0.088290 Oct 19 03:21:36.440570 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1165/2290] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:21:36 2022] GET /compute/v2.1/servers/67358716-e31b-4e54-b23b-592845c983ea => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:21:36.448942 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-656dece5-5060-40bf-94f6-183ee57da132 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:36.449474 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-656dece5-5060-40bf-94f6-183ee57da132 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 074f3469-3bbd-46df-8286-3a57f91798e2] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:36.465161 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-656dece5-5060-40bf-94f6-183ee57da132 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:36.466235 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-08fe45bd-aaf5-428d-b1b5-2938f5cdaf3c tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/images/bb3a25a0-f1e8-496e-9db8-05a27d2b182c" status: 200 len: 1409 microversion: 2.1 time: 0.090705 Oct 19 03:21:36.466816 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1126/2291] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:21:36 2022] GET /compute/v2.1/images/bb3a25a0-f1e8-496e-9db8-05a27d2b182c => generated 1409 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:21:36.468353 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-656dece5-5060-40bf-94f6-183ee57da132 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:36.468828 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-656dece5-5060-40bf-94f6-183ee57da132 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:36.469590 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-656dece5-5060-40bf-94f6-183ee57da132 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:36.470056 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-656dece5-5060-40bf-94f6-183ee57da132 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:36.471126 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-656dece5-5060-40bf-94f6-183ee57da132 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:36.478494 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a0eb53fc-d868-4651-a76f-3ae2153d67e9 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:36.480168 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a0eb53fc-d868-4651-a76f-3ae2153d67e9 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] [instance: 3b4bc3da-47f7-4719-817f-5636c247c87e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:36.496458 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a0eb53fc-d868-4651-a76f-3ae2153d67e9 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:36.497228 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a0eb53fc-d868-4651-a76f-3ae2153d67e9 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:36.500513 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a0eb53fc-d868-4651-a76f-3ae2153d67e9 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:36.501547 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a0eb53fc-d868-4651-a76f-3ae2153d67e9 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:36.502202 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a0eb53fc-d868-4651-a76f-3ae2153d67e9 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:36.503553 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a0eb53fc-d868-4651-a76f-3ae2153d67e9 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:36.692484 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a0eb53fc-d868-4651-a76f-3ae2153d67e9 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3661010393d44c428fb37652b1717072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a1e7cceff48798bfefb9390e5979c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:36.702769 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a0eb53fc-d868-4651-a76f-3ae2153d67e9 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] 10.222.0.52 "GET /compute/v2.1/servers/3b4bc3da-47f7-4719-817f-5636c247c87e" status: 200 len: 1274 microversion: 2.1 time: 0.234745 Oct 19 03:21:36.703967 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1127/2292] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:21:36 2022] GET /compute/v2.1/servers/3b4bc3da-47f7-4719-817f-5636c247c87e => generated 1274 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:21:36.709466 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-93bffd5f-6290-4eef-8742-f10aed090b7f tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Calling method '.version_select at 0x7fc130cbeca0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:36.749682 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-93bffd5f-6290-4eef-8742-f10aed090b7f tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] HTTP exception thrown: Image not found. Oct 19 03:21:36.753574 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-93bffd5f-6290-4eef-8742-f10aed090b7f tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Request method failure captured: Oct 19 03:21:36.753574 n-d-861333-8 devstack@n-api.service[121134]: request: DELETE /compute/v2.1/images/ae6eaa7b-d160-4b0d-a026-99a87523125c HTTP/1.1 Oct 19 03:21:36.753574 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:21:36.753574 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:21:36.753574 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:21:36.753574 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:21:36.753574 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:21:36.753574 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:21:36.753574 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:21:36.753574 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:21:36.753574 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT2y5QS5fGXOCh8dCARu_-t2vnckF3uwZtfqi9DmHed6pMoXibNoREyH_7cDYk3t8P2qbQ1u564D6Sq50msRMl2YQVddoWmeJm48OR72Wl7OECfXwMpGVDHULH4PSkCmyy31jkBvdZSxqyCmIGP32xNgLbjMxF4SrMQTDektLd28zxNg Oct 19 03:21:36.753574 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:21:36.753574 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:21:36.753574 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:21:36.753574 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:21:36.753574 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:21:36.753574 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:21:36.753574 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: f9e436373e9e45efa03f08b33da619e8 Oct 19 03:21:36.753574 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1767182949 Oct 19 03:21:36.753574 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:21:36.753574 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:21:36.754632 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f9e436373e9e45efa03f08b33da619e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f9e436373e9e45efa03f08b33da619e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f9e436373e9e45efa03f08b33da619e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f9e436373e9e45efa03f08b33da619e8", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:21:36.754632 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1767182949 Oct 19 03:21:36.754632 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: f9e436373e9e45efa03f08b33da619e8 Oct 19 03:21:36.754632 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1767182949 Oct 19 03:21:36.754632 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ImagesOneServerNegativeTestJSON-1767182949-project Oct 19 03:21:36.754632 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:21:36.754632 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:21:36.754632 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 8824f20e6a1f478a99f90e1ba8f028fe Oct 19 03:21:36.754632 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1767182949-project Oct 19 03:21:36.754632 n-d-861333-8 devstack@n-api.service[121134]: method: Oct 19 03:21:36.754632 n-d-861333-8 devstack@n-api.service[121134]: exception: Image not found. Oct 19 03:21:36.754632 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': 'ae6eaa7b-d160-4b0d-a026-99a87523125c'} Oct 19 03:21:36.754632 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:21:36.755247 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:21:36.755247 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 19 03:21:36.755247 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 19 03:21:36.755247 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 19 03:21:36.755247 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 19 03:21:36.755247 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 19 03:21:36.755247 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 19 03:21:36.755247 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 19 03:21:36.755247 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 19 03:21:36.755247 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 19 03:21:36.755247 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 19 03:21:36.755247 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 19 03:21:36.755247 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 19 03:21:36.755247 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 19 03:21:36.755247 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 19 03:21:36.755247 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image ae6eaa7b-d160-4b0d-a026-99a87523125c to delete Oct 19 03:21:36.755247 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:21:36.755247 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:21:36.755247 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:21:36.756120 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:21:36.756120 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 19 03:21:36.756120 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 19 03:21:36.756120 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 19 03:21:36.756120 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 19 03:21:36.756120 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 19 03:21:36.756120 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 19 03:21:36.756120 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ae6eaa7b-d160-4b0d-a026-99a87523125c could not be found. Oct 19 03:21:36.756120 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:21:36.756120 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:21:36.756120 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:21:36.756120 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:21:36.756120 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:21:36.756120 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:21:36.756120 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:21:36.756120 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:21:36.756120 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 03:21:36.756120 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 03:21:36.756120 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:21:36.756120 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:21:36.757758 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 19 03:21:36.757758 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 19 03:21:36.757758 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 19 03:21:36.757758 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:21:36.757758 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:21:36.757758 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:21:36.757758 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:21:36.757758 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:21:36.757758 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:21:36.757758 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:21:36.757758 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:21:36.757758 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 19 03:21:36.757758 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:21:36.757758 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-93bffd5f-6290-4eef-8742-f10aed090b7f tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Returning 404 to user: Image not found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:21:36.757758 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-93bffd5f-6290-4eef-8742-f10aed090b7f tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] 10.222.0.52 "DELETE /compute/v2.1/images/ae6eaa7b-d160-4b0d-a026-99a87523125c" status: 404 len: 62 microversion: 2.1 time: 0.049856 Oct 19 03:21:36.762947 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1128/2293] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:21:36 2022] DELETE /compute/v2.1/images/ae6eaa7b-d160-4b0d-a026-99a87523125c => generated 62 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 03:21:36.774487 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-487b1d29-eaaf-4e58-81e1-07bfd3c4abd1 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:36.775018 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-487b1d29-eaaf-4e58-81e1-07bfd3c4abd1 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] [instance: 245ae0c1-c202-41c0-8f85-d5d99549f3ae] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:36.798427 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-487b1d29-eaaf-4e58-81e1-07bfd3c4abd1 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:36.798989 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-487b1d29-eaaf-4e58-81e1-07bfd3c4abd1 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:36.799441 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-487b1d29-eaaf-4e58-81e1-07bfd3c4abd1 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:36.800290 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-487b1d29-eaaf-4e58-81e1-07bfd3c4abd1 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:36.800761 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-487b1d29-eaaf-4e58-81e1-07bfd3c4abd1 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:36.801204 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-487b1d29-eaaf-4e58-81e1-07bfd3c4abd1 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:36.820320 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:21:36.850945 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-487b1d29-eaaf-4e58-81e1-07bfd3c4abd1 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] HTTP exception thrown: Instance 245ae0c1-c202-41c0-8f85-d5d99549f3ae could not be found. Oct 19 03:21:36.852937 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-487b1d29-eaaf-4e58-81e1-07bfd3c4abd1 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Request method failure captured: Oct 19 03:21:36.852937 n-d-861333-8 devstack@n-api.service[121134]: request: DELETE /compute/v2.1/servers/245ae0c1-c202-41c0-8f85-d5d99549f3ae HTTP/1.1 Oct 19 03:21:36.852937 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:21:36.852937 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:21:36.852937 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:21:36.852937 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:21:36.852937 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:21:36.852937 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:21:36.852937 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:21:36.852937 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:21:36.852937 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT2y5QS5fGXOCh8dCARu_-t2vnckF3uwZtfqi9DmHed6pMoXibNoREyH_7cDYk3t8P2qbQ1u564D6Sq50msRMl2YQVddoWmeJm48OR72Wl7OECfXwMpGVDHULH4PSkCmyy31jkBvdZSxqyCmIGP32xNgLbjMxF4SrMQTDektLd28zxNg Oct 19 03:21:36.852937 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:21:36.852937 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:21:36.852937 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:21:36.852937 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:21:36.852937 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:21:36.852937 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:21:36.852937 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: f9e436373e9e45efa03f08b33da619e8 Oct 19 03:21:36.852937 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1767182949 Oct 19 03:21:36.852937 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:21:36.852937 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:21:36.854161 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f9e436373e9e45efa03f08b33da619e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f9e436373e9e45efa03f08b33da619e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f9e436373e9e45efa03f08b33da619e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f9e436373e9e45efa03f08b33da619e8", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:21:36.854161 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1767182949 Oct 19 03:21:36.854161 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: f9e436373e9e45efa03f08b33da619e8 Oct 19 03:21:36.854161 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1767182949 Oct 19 03:21:36.854161 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ImagesOneServerNegativeTestJSON-1767182949-project Oct 19 03:21:36.854161 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:21:36.854161 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:21:36.854161 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 8824f20e6a1f478a99f90e1ba8f028fe Oct 19 03:21:36.854161 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1767182949-project Oct 19 03:21:36.854161 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:21:36.854161 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance 245ae0c1-c202-41c0-8f85-d5d99549f3ae could not be found. Oct 19 03:21:36.854161 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '245ae0c1-c202-41c0-8f85-d5d99549f3ae'} Oct 19 03:21:36.854849 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:21:36.854849 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:21:36.854849 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:21:36.854849 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:21:36.854849 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:21:36.854849 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:21:36.854849 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:21:36.854849 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:21:36.854849 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:21:36.854849 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:21:36.854849 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 245ae0c1-c202-41c0-8f85-d5d99549f3ae could not be found. Oct 19 03:21:36.854849 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:21:36.854849 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:21:36.854849 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:21:36.854849 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:21:36.854849 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:21:36.854849 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:21:36.854849 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:21:36.854849 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:21:36.854849 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:21:36.855833 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:21:36.855833 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 03:21:36.855833 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 03:21:36.855833 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 03:21:36.855833 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 03:21:36.855833 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:21:36.855833 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:21:36.855833 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:21:36.855833 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:21:36.855833 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 245ae0c1-c202-41c0-8f85-d5d99549f3ae could not be found. Oct 19 03:21:36.855833 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:21:36.855833 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:21:36.855833 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:21:36.855833 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:21:36.855833 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:21:36.855833 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:21:36.855833 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:21:36.855833 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:21:36.855833 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 245ae0c1-c202-41c0-8f85-d5d99549f3ae could not be found. Oct 19 03:21:36.855833 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:21:36.859207 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-487b1d29-eaaf-4e58-81e1-07bfd3c4abd1 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Returning 404 to user: Instance 245ae0c1-c202-41c0-8f85-d5d99549f3ae could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:21:36.860367 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-487b1d29-eaaf-4e58-81e1-07bfd3c4abd1 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] 10.222.0.52 "DELETE /compute/v2.1/servers/245ae0c1-c202-41c0-8f85-d5d99549f3ae" status: 404 len: 111 microversion: 2.1 time: 0.096211 Oct 19 03:21:36.861252 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1129/2294] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:21:36 2022] DELETE /compute/v2.1/servers/245ae0c1-c202-41c0-8f85-d5d99549f3ae => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:21:36.867169 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-fb2972b2-3964-46a4-838d-083fe5ec660b tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:36.867892 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-fb2972b2-3964-46a4-838d-083fe5ec660b tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] [instance: 4adec402-e94f-4a41-ac77-68f6091b87f7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:36.874491 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fb2972b2-3964-46a4-838d-083fe5ec660b tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:36.875138 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fb2972b2-3964-46a4-838d-083fe5ec660b tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:36.875685 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fb2972b2-3964-46a4-838d-083fe5ec660b tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:36.876495 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fb2972b2-3964-46a4-838d-083fe5ec660b tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:36.877702 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fb2972b2-3964-46a4-838d-083fe5ec660b tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:36.878970 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fb2972b2-3964-46a4-838d-083fe5ec660b tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:37.030272 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-656dece5-5060-40bf-94f6-183ee57da132 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:37.043868 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-656dece5-5060-40bf-94f6-183ee57da132 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:37.045553 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-656dece5-5060-40bf-94f6-183ee57da132 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:37.046927 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-656dece5-5060-40bf-94f6-183ee57da132 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/074f3469-3bbd-46df-8286-3a57f91798e2" status: 200 len: 1485 microversion: 2.25 time: 0.605756 Oct 19 03:21:37.061951 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1166/2295] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:21:36 2022] GET /compute/v2.1/servers/074f3469-3bbd-46df-8286-3a57f91798e2 => generated 1485 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:21:37.072991 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-251e3a0c-b7b3-426a-9d22-5ee1cd8ea6f8 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:37.073930 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-251e3a0c-b7b3-426a-9d22-5ee1cd8ea6f8 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] [instance: 245ae0c1-c202-41c0-8f85-d5d99549f3ae] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:37.081127 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-251e3a0c-b7b3-426a-9d22-5ee1cd8ea6f8 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:37.082108 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-251e3a0c-b7b3-426a-9d22-5ee1cd8ea6f8 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:37.082943 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-251e3a0c-b7b3-426a-9d22-5ee1cd8ea6f8 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:37.083865 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-251e3a0c-b7b3-426a-9d22-5ee1cd8ea6f8 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:37.084583 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-251e3a0c-b7b3-426a-9d22-5ee1cd8ea6f8 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:37.085215 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-251e3a0c-b7b3-426a-9d22-5ee1cd8ea6f8 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:37.100780 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-251e3a0c-b7b3-426a-9d22-5ee1cd8ea6f8 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] HTTP exception thrown: Instance 245ae0c1-c202-41c0-8f85-d5d99549f3ae could not be found. Oct 19 03:21:37.102482 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-251e3a0c-b7b3-426a-9d22-5ee1cd8ea6f8 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Request method failure captured: Oct 19 03:21:37.102482 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/245ae0c1-c202-41c0-8f85-d5d99549f3ae HTTP/1.1 Oct 19 03:21:37.102482 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:21:37.102482 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:21:37.102482 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:21:37.102482 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:21:37.102482 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:21:37.102482 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:21:37.102482 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:21:37.102482 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:21:37.102482 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2y5QS5fGXOCh8dCARu_-t2vnckF3uwZtfqi9DmHed6pMoXibNoREyH_7cDYk3t8P2qbQ1u564D6Sq50msRMl2YQVddoWmeJm48OR72Wl7OECfXwMpGVDHULH4PSkCmyy31jkBvdZSxqyCmIGP32xNgLbjMxF4SrMQTDektLd28zxNg Oct 19 03:21:37.102482 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:21:37.102482 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:21:37.102482 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:21:37.102482 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:21:37.102482 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:21:37.102482 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:21:37.102482 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: f9e436373e9e45efa03f08b33da619e8 Oct 19 03:21:37.102482 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1767182949 Oct 19 03:21:37.102482 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:21:37.102482 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:21:37.103534 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f9e436373e9e45efa03f08b33da619e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f9e436373e9e45efa03f08b33da619e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f9e436373e9e45efa03f08b33da619e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f9e436373e9e45efa03f08b33da619e8", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:21:37.103534 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1767182949 Oct 19 03:21:37.103534 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: f9e436373e9e45efa03f08b33da619e8 Oct 19 03:21:37.103534 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1767182949 Oct 19 03:21:37.103534 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ImagesOneServerNegativeTestJSON-1767182949-project Oct 19 03:21:37.103534 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:21:37.103534 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:21:37.103534 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 8824f20e6a1f478a99f90e1ba8f028fe Oct 19 03:21:37.103534 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1767182949-project Oct 19 03:21:37.103534 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:21:37.103534 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance 245ae0c1-c202-41c0-8f85-d5d99549f3ae could not be found. Oct 19 03:21:37.103534 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '245ae0c1-c202-41c0-8f85-d5d99549f3ae'} Oct 19 03:21:37.104096 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:21:37.104096 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:21:37.104096 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:21:37.104096 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:21:37.104096 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:21:37.104096 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:21:37.104096 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:21:37.104096 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:21:37.104096 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:21:37.104096 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:21:37.104096 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 245ae0c1-c202-41c0-8f85-d5d99549f3ae could not be found. Oct 19 03:21:37.104096 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:21:37.104096 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:21:37.104096 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:21:37.104096 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:21:37.104096 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:21:37.104096 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:21:37.104096 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:21:37.104096 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:21:37.104096 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:21:37.105023 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:21:37.105023 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:21:37.105023 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:21:37.105023 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:21:37.105023 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:21:37.105023 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:21:37.105023 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:21:37.105023 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 245ae0c1-c202-41c0-8f85-d5d99549f3ae could not be found. Oct 19 03:21:37.105023 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:21:37.105023 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:21:37.105023 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:21:37.105023 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:21:37.105023 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:21:37.105023 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:21:37.105023 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:21:37.105023 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:21:37.105023 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 245ae0c1-c202-41c0-8f85-d5d99549f3ae could not be found. Oct 19 03:21:37.105023 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:21:37.105884 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-251e3a0c-b7b3-426a-9d22-5ee1cd8ea6f8 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Returning 404 to user: Instance 245ae0c1-c202-41c0-8f85-d5d99549f3ae could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:21:37.105884 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-251e3a0c-b7b3-426a-9d22-5ee1cd8ea6f8 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] 10.222.0.52 "GET /compute/v2.1/servers/245ae0c1-c202-41c0-8f85-d5d99549f3ae" status: 404 len: 111 microversion: 2.1 time: 0.040563 Oct 19 03:21:37.105884 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1167/2296] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:21:37 2022] GET /compute/v2.1/servers/245ae0c1-c202-41c0-8f85-d5d99549f3ae => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:21:37.111691 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-7a26f403-f6a4-4b4b-a6fc-5f9860679c74 req-36fb73b8-8b03-4526-b0dc-7fe28a929233 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fee1d282-ae3a-4792-ba8f-a19e498c8853", "name": "network-vif-deleted", "tag": "a0fe25a1-1468-4c11-9af9-8321e13e7e0f"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:21:37.121859 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-7a26f403-f6a4-4b4b-a6fc-5f9860679c74 req-36fb73b8-8b03-4526-b0dc-7fe28a929233 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:37.122414 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-7a26f403-f6a4-4b4b-a6fc-5f9860679c74 req-36fb73b8-8b03-4526-b0dc-7fe28a929233 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:37.122912 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-7a26f403-f6a4-4b4b-a6fc-5f9860679c74 req-36fb73b8-8b03-4526-b0dc-7fe28a929233 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:37.137121 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-7a26f403-f6a4-4b4b-a6fc-5f9860679c74 req-36fb73b8-8b03-4526-b0dc-7fe28a929233 service nova] Creating event network-vif-deleted:a0fe25a1-1468-4c11-9af9-8321e13e7e0f for instance fee1d282-ae3a-4792-ba8f-a19e498c8853 on n-h2-861333-8 Oct 19 03:21:37.144923 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-7a26f403-f6a4-4b4b-a6fc-5f9860679c74 req-36fb73b8-8b03-4526-b0dc-7fe28a929233 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038463 Oct 19 03:21:37.146107 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1168/2297] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:21:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:21:37.151669 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f366b02b-c813-43ae-a3a6-67cc1575bc17 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Calling method '.version_select at 0x7fc130c5f670>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:37.288553 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f366b02b-c813-43ae-a3a6-67cc1575bc17 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-287929124" status: 202 len: 0 microversion: 2.1 time: 0.141166 Oct 19 03:21:37.289967 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1169/2298] 10.222.0.52 () {58 vars in 1218 bytes} [Wed Oct 19 03:21:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-287929124 => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:21:37.377327 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-fb2972b2-3964-46a4-838d-083fe5ec660b tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:37.377554 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-47ee1f98-8fdd-4064-b078-930cc1636f15 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:37.382022 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-47ee1f98-8fdd-4064-b078-930cc1636f15 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] [instance: 6888c8db-82ba-4072-b431-8d4fcf5f03e0] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:37.394609 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-47ee1f98-8fdd-4064-b078-930cc1636f15 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:37.397706 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-47ee1f98-8fdd-4064-b078-930cc1636f15 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:37.400372 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-47ee1f98-8fdd-4064-b078-930cc1636f15 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:37.405197 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-47ee1f98-8fdd-4064-b078-930cc1636f15 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:37.407546 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-47ee1f98-8fdd-4064-b078-930cc1636f15 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:37.409745 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-47ee1f98-8fdd-4064-b078-930cc1636f15 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:37.417108 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-fb2972b2-3964-46a4-838d-083fe5ec660b tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:37.418889 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-fb2972b2-3964-46a4-838d-083fe5ec660b tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:37.422628 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-fb2972b2-3964-46a4-838d-083fe5ec660b tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] 10.222.0.52 "GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7" status: 200 len: 1874 microversion: 2.32 time: 0.559730 Oct 19 03:21:37.424967 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1130/2299] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:21:36 2022] GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7 => generated 1874 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:21:37.444173 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-60f058ac-bc63-41fa-8df1-39965a7fc01e tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:37.446431 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-60f058ac-bc63-41fa-8df1-39965a7fc01e tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] [instance: fee1d282-ae3a-4792-ba8f-a19e498c8853] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:37.456535 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-60f058ac-bc63-41fa-8df1-39965a7fc01e tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:37.457455 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-60f058ac-bc63-41fa-8df1-39965a7fc01e tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:37.457780 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-60f058ac-bc63-41fa-8df1-39965a7fc01e tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:37.485512 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-60f058ac-bc63-41fa-8df1-39965a7fc01e tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:37.488412 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-60f058ac-bc63-41fa-8df1-39965a7fc01e tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:37.489432 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-60f058ac-bc63-41fa-8df1-39965a7fc01e tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:37.533788 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-60f058ac-bc63-41fa-8df1-39965a7fc01e tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:37.534280 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-60f058ac-bc63-41fa-8df1-39965a7fc01e tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:37.534713 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-60f058ac-bc63-41fa-8df1-39965a7fc01e tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:37.535161 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-60f058ac-bc63-41fa-8df1-39965a7fc01e tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lazy-loading 'fault' on Instance uuid fee1d282-ae3a-4792-ba8f-a19e498c8853 {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:21:37.653461 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-60f058ac-bc63-41fa-8df1-39965a7fc01e tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '152fa52a83b14c71bf86b22d77a73625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1606da859950484e9aa949e5c59c0a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:37.674557 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-60f058ac-bc63-41fa-8df1-39965a7fc01e tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] 10.222.0.52 "GET /compute/v2.1/servers/fee1d282-ae3a-4792-ba8f-a19e498c8853" status: 200 len: 1313 microversion: 2.1 time: 0.244791 Oct 19 03:21:37.677161 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1131/2300] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:21:37 2022] GET /compute/v2.1/servers/fee1d282-ae3a-4792-ba8f-a19e498c8853 => generated 1313 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:21:37.686286 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-248e0c8f-cc54-4357-8f04-11dfaea797ec tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '.version_select at 0x7fc130c18ee0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:37.755691 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-248e0c8f-cc54-4357-8f04-11dfaea797ec tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/images/bb3a25a0-f1e8-496e-9db8-05a27d2b182c" status: 200 len: 1409 microversion: 2.1 time: 0.077009 Oct 19 03:21:37.757054 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1132/2301] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:21:37 2022] GET /compute/v2.1/images/bb3a25a0-f1e8-496e-9db8-05a27d2b182c => generated 1409 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:21:37.769123 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-faaeb80d-e4bf-48fb-958e-6469d511fae9 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:37.770124 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-faaeb80d-e4bf-48fb-958e-6469d511fae9 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] [instance: 3b4bc3da-47f7-4719-817f-5636c247c87e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:37.786192 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-faaeb80d-e4bf-48fb-958e-6469d511fae9 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:37.787405 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-faaeb80d-e4bf-48fb-958e-6469d511fae9 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:37.788273 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-faaeb80d-e4bf-48fb-958e-6469d511fae9 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:37.789727 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-faaeb80d-e4bf-48fb-958e-6469d511fae9 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:37.791177 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-faaeb80d-e4bf-48fb-958e-6469d511fae9 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:37.791865 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-faaeb80d-e4bf-48fb-958e-6469d511fae9 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:37.811616 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-47ee1f98-8fdd-4064-b078-930cc1636f15 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4c5e4123c44508a5d4911a17c44231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a495ccfced47f29cb928d1ded20d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:37.826103 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-47ee1f98-8fdd-4064-b078-930cc1636f15 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] 10.222.0.52 "GET /compute/v2.1/servers/6888c8db-82ba-4072-b431-8d4fcf5f03e0" status: 200 len: 1472 microversion: 2.1 time: 0.455783 Oct 19 03:21:37.859170 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1170/2302] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:21:37 2022] GET /compute/v2.1/servers/6888c8db-82ba-4072-b431-8d4fcf5f03e0 => generated 1472 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:21:37.896046 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-faaeb80d-e4bf-48fb-958e-6469d511fae9 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3661010393d44c428fb37652b1717072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a1e7cceff48798bfefb9390e5979c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:37.909519 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-faaeb80d-e4bf-48fb-958e-6469d511fae9 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] 10.222.0.52 "GET /compute/v2.1/servers/3b4bc3da-47f7-4719-817f-5636c247c87e" status: 200 len: 1274 microversion: 2.1 time: 0.148525 Oct 19 03:21:37.910873 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1133/2303] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:21:37 2022] GET /compute/v2.1/servers/3b4bc3da-47f7-4719-817f-5636c247c87e => generated 1274 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:21:38.078363 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-96acb585-4995-45b2-8646-e5605e5167ff tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:38.079382 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-96acb585-4995-45b2-8646-e5605e5167ff tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 074f3469-3bbd-46df-8286-3a57f91798e2] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:38.089587 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-96acb585-4995-45b2-8646-e5605e5167ff tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:38.090275 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-96acb585-4995-45b2-8646-e5605e5167ff tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:38.091138 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-96acb585-4995-45b2-8646-e5605e5167ff tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:38.092073 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-96acb585-4995-45b2-8646-e5605e5167ff tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:38.092668 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-96acb585-4995-45b2-8646-e5605e5167ff tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:38.093270 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-96acb585-4995-45b2-8646-e5605e5167ff tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:38.432072 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-96acb585-4995-45b2-8646-e5605e5167ff tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:38.443250 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-96acb585-4995-45b2-8646-e5605e5167ff tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:38.444971 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-96acb585-4995-45b2-8646-e5605e5167ff tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:38.448054 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-96acb585-4995-45b2-8646-e5605e5167ff tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/074f3469-3bbd-46df-8286-3a57f91798e2" status: 200 len: 1485 microversion: 2.25 time: 0.374084 Oct 19 03:21:38.449091 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1171/2304] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:21:38 2022] GET /compute/v2.1/servers/074f3469-3bbd-46df-8286-3a57f91798e2 => generated 1485 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:21:38.452200 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e8abd05b-9bfd-4ac8-af95-1aeaf3d1cf87 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:38.452805 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e8abd05b-9bfd-4ac8-af95-1aeaf3d1cf87 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] [instance: 4adec402-e94f-4a41-ac77-68f6091b87f7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:38.460019 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e8abd05b-9bfd-4ac8-af95-1aeaf3d1cf87 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:38.460516 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e8abd05b-9bfd-4ac8-af95-1aeaf3d1cf87 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:38.466921 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e8abd05b-9bfd-4ac8-af95-1aeaf3d1cf87 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:38.466921 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e8abd05b-9bfd-4ac8-af95-1aeaf3d1cf87 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:38.466921 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e8abd05b-9bfd-4ac8-af95-1aeaf3d1cf87 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:38.466921 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e8abd05b-9bfd-4ac8-af95-1aeaf3d1cf87 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:38.653588 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c3652303-48a3-44d8-8317-3e62094550d3 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Calling method '.version_select at 0x7fc1305f48b0>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:38.680077 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-c3652303-48a3-44d8-8317-3e62094550d3 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] HTTP exception thrown: Image not found. Oct 19 03:21:38.683048 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c3652303-48a3-44d8-8317-3e62094550d3 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Request method failure captured: Oct 19 03:21:38.683048 n-d-861333-8 devstack@n-api.service[121135]: request: DELETE /compute/v2.1/images/31a2644c-05b4-42cc-bf8c-f710e426fc62 HTTP/1.1 Oct 19 03:21:38.683048 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:21:38.683048 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:21:38.683048 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:21:38.683048 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:21:38.683048 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:21:38.683048 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:21:38.683048 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:21:38.683048 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:21:38.683048 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2y5QS5fGXOCh8dCARu_-t2vnckF3uwZtfqi9DmHed6pMoXibNoREyH_7cDYk3t8P2qbQ1u564D6Sq50msRMl2YQVddoWmeJm48OR72Wl7OECfXwMpGVDHULH4PSkCmyy31jkBvdZSxqyCmIGP32xNgLbjMxF4SrMQTDektLd28zxNg Oct 19 03:21:38.683048 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:21:38.683048 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:21:38.683048 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:21:38.683048 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:21:38.683048 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:21:38.683048 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:21:38.683048 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: f9e436373e9e45efa03f08b33da619e8 Oct 19 03:21:38.683048 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1767182949 Oct 19 03:21:38.683048 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:21:38.683048 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:21:38.684357 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f9e436373e9e45efa03f08b33da619e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f9e436373e9e45efa03f08b33da619e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f9e436373e9e45efa03f08b33da619e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f9e436373e9e45efa03f08b33da619e8", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:21:38.684357 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1767182949 Oct 19 03:21:38.684357 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: f9e436373e9e45efa03f08b33da619e8 Oct 19 03:21:38.684357 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1767182949 Oct 19 03:21:38.684357 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ImagesOneServerNegativeTestJSON-1767182949-project Oct 19 03:21:38.684357 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:21:38.684357 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:21:38.684357 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 8824f20e6a1f478a99f90e1ba8f028fe Oct 19 03:21:38.684357 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1767182949-project Oct 19 03:21:38.684357 n-d-861333-8 devstack@n-api.service[121135]: method: Oct 19 03:21:38.684357 n-d-861333-8 devstack@n-api.service[121135]: exception: Image not found. Oct 19 03:21:38.684357 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '31a2644c-05b4-42cc-bf8c-f710e426fc62'} Oct 19 03:21:38.684357 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:21:38.685246 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:21:38.685246 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 19 03:21:38.685246 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 19 03:21:38.685246 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 19 03:21:38.685246 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 19 03:21:38.685246 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 19 03:21:38.685246 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 19 03:21:38.685246 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 19 03:21:38.685246 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 19 03:21:38.685246 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 19 03:21:38.685246 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 19 03:21:38.685246 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 19 03:21:38.685246 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 19 03:21:38.685246 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 19 03:21:38.685246 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 19 03:21:38.685246 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 31a2644c-05b4-42cc-bf8c-f710e426fc62 to delete Oct 19 03:21:38.685246 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:21:38.685246 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:21:38.685246 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:21:38.686587 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:21:38.686587 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 19 03:21:38.686587 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 19 03:21:38.686587 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 19 03:21:38.686587 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 19 03:21:38.686587 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 19 03:21:38.686587 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 19 03:21:38.686587 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 31a2644c-05b4-42cc-bf8c-f710e426fc62 could not be found. Oct 19 03:21:38.686587 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:21:38.686587 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:21:38.686587 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:21:38.686587 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:21:38.686587 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:21:38.686587 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:21:38.686587 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:21:38.686587 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:21:38.686587 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 03:21:38.686587 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 03:21:38.686587 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:21:38.686587 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:21:38.688233 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 19 03:21:38.688233 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 19 03:21:38.688233 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 19 03:21:38.688233 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:21:38.688233 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:21:38.688233 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:21:38.688233 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:21:38.688233 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:21:38.688233 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:21:38.688233 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:21:38.688233 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:21:38.688233 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 19 03:21:38.688233 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:21:38.688233 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c3652303-48a3-44d8-8317-3e62094550d3 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Returning 404 to user: Image not found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:21:38.688233 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c3652303-48a3-44d8-8317-3e62094550d3 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] 10.222.0.52 "DELETE /compute/v2.1/images/31a2644c-05b4-42cc-bf8c-f710e426fc62" status: 404 len: 62 microversion: 2.1 time: 0.037320 Oct 19 03:21:38.693136 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1172/2305] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:21:38 2022] DELETE /compute/v2.1/images/31a2644c-05b4-42cc-bf8c-f710e426fc62 => generated 62 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 19 03:21:38.702478 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3d8e95e2-9c55-4907-b02f-577eec735b23 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:38.703050 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-3d8e95e2-9c55-4907-b02f-577eec735b23 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] [instance: d6d507e4-3a53-4734-bb88-8fc38efa4d9b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:38.711365 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3d8e95e2-9c55-4907-b02f-577eec735b23 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:38.712310 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3d8e95e2-9c55-4907-b02f-577eec735b23 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:38.712867 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3d8e95e2-9c55-4907-b02f-577eec735b23 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:38.713717 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3d8e95e2-9c55-4907-b02f-577eec735b23 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:38.714282 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3d8e95e2-9c55-4907-b02f-577eec735b23 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:38.714837 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3d8e95e2-9c55-4907-b02f-577eec735b23 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:38.734026 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-3d8e95e2-9c55-4907-b02f-577eec735b23 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] HTTP exception thrown: Instance d6d507e4-3a53-4734-bb88-8fc38efa4d9b could not be found. Oct 19 03:21:38.735786 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3d8e95e2-9c55-4907-b02f-577eec735b23 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Request method failure captured: Oct 19 03:21:38.735786 n-d-861333-8 devstack@n-api.service[121135]: request: DELETE /compute/v2.1/servers/d6d507e4-3a53-4734-bb88-8fc38efa4d9b HTTP/1.1 Oct 19 03:21:38.735786 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:21:38.735786 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:21:38.735786 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:21:38.735786 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:21:38.735786 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:21:38.735786 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:21:38.735786 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:21:38.735786 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:21:38.735786 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2y5QS5fGXOCh8dCARu_-t2vnckF3uwZtfqi9DmHed6pMoXibNoREyH_7cDYk3t8P2qbQ1u564D6Sq50msRMl2YQVddoWmeJm48OR72Wl7OECfXwMpGVDHULH4PSkCmyy31jkBvdZSxqyCmIGP32xNgLbjMxF4SrMQTDektLd28zxNg Oct 19 03:21:38.735786 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:21:38.735786 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:21:38.735786 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:21:38.735786 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:21:38.735786 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:21:38.735786 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:21:38.735786 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: f9e436373e9e45efa03f08b33da619e8 Oct 19 03:21:38.735786 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1767182949 Oct 19 03:21:38.735786 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:21:38.735786 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:21:38.737720 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f9e436373e9e45efa03f08b33da619e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f9e436373e9e45efa03f08b33da619e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f9e436373e9e45efa03f08b33da619e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f9e436373e9e45efa03f08b33da619e8", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:21:38.737720 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1767182949 Oct 19 03:21:38.737720 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: f9e436373e9e45efa03f08b33da619e8 Oct 19 03:21:38.737720 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1767182949 Oct 19 03:21:38.737720 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ImagesOneServerNegativeTestJSON-1767182949-project Oct 19 03:21:38.737720 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:21:38.737720 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:21:38.737720 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 8824f20e6a1f478a99f90e1ba8f028fe Oct 19 03:21:38.737720 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1767182949-project Oct 19 03:21:38.737720 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:21:38.737720 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance d6d507e4-3a53-4734-bb88-8fc38efa4d9b could not be found. Oct 19 03:21:38.737720 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': 'd6d507e4-3a53-4734-bb88-8fc38efa4d9b'} Oct 19 03:21:38.738463 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:21:38.738463 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:21:38.738463 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:21:38.738463 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:21:38.738463 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:21:38.738463 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:21:38.738463 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:21:38.738463 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:21:38.738463 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:21:38.738463 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:21:38.738463 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6d507e4-3a53-4734-bb88-8fc38efa4d9b could not be found. Oct 19 03:21:38.738463 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:21:38.738463 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:21:38.738463 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:21:38.738463 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:21:38.738463 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:21:38.738463 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:21:38.738463 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:21:38.738463 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:21:38.738463 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:21:38.739599 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:21:38.739599 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 03:21:38.739599 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 03:21:38.739599 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 03:21:38.739599 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 03:21:38.739599 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:21:38.739599 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:21:38.739599 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:21:38.739599 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:21:38.739599 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6d507e4-3a53-4734-bb88-8fc38efa4d9b could not be found. Oct 19 03:21:38.739599 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:21:38.739599 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:21:38.739599 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:21:38.739599 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:21:38.739599 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:21:38.739599 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:21:38.739599 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:21:38.739599 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:21:38.739599 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6d507e4-3a53-4734-bb88-8fc38efa4d9b could not be found. Oct 19 03:21:38.739599 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:21:38.741930 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3d8e95e2-9c55-4907-b02f-577eec735b23 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Returning 404 to user: Instance d6d507e4-3a53-4734-bb88-8fc38efa4d9b could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:21:38.742950 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-3d8e95e2-9c55-4907-b02f-577eec735b23 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] 10.222.0.52 "DELETE /compute/v2.1/servers/d6d507e4-3a53-4734-bb88-8fc38efa4d9b" status: 404 len: 111 microversion: 2.1 time: 0.047124 Oct 19 03:21:38.743634 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1173/2306] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:21:38 2022] DELETE /compute/v2.1/servers/d6d507e4-3a53-4734-bb88-8fc38efa4d9b => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 03:21:38.749995 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-524f5ae1-8058-49b8-b0b7-99a7f5fccd07 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:38.750851 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-524f5ae1-8058-49b8-b0b7-99a7f5fccd07 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] [instance: fee1d282-ae3a-4792-ba8f-a19e498c8853] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:38.761888 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-524f5ae1-8058-49b8-b0b7-99a7f5fccd07 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:38.762755 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-524f5ae1-8058-49b8-b0b7-99a7f5fccd07 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:38.763467 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-524f5ae1-8058-49b8-b0b7-99a7f5fccd07 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:38.765004 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-524f5ae1-8058-49b8-b0b7-99a7f5fccd07 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:38.768011 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-524f5ae1-8058-49b8-b0b7-99a7f5fccd07 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:38.769230 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-524f5ae1-8058-49b8-b0b7-99a7f5fccd07 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:38.794256 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:21:38.813019 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-524f5ae1-8058-49b8-b0b7-99a7f5fccd07 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:38.813211 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-524f5ae1-8058-49b8-b0b7-99a7f5fccd07 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:38.813709 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-524f5ae1-8058-49b8-b0b7-99a7f5fccd07 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:38.813987 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-524f5ae1-8058-49b8-b0b7-99a7f5fccd07 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lazy-loading 'fault' on Instance uuid fee1d282-ae3a-4792-ba8f-a19e498c8853 {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:21:38.820542 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e8abd05b-9bfd-4ac8-af95-1aeaf3d1cf87 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:38.830355 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e8abd05b-9bfd-4ac8-af95-1aeaf3d1cf87 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:38.832093 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e8abd05b-9bfd-4ac8-af95-1aeaf3d1cf87 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:38.834125 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e8abd05b-9bfd-4ac8-af95-1aeaf3d1cf87 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] 10.222.0.52 "GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7" status: 200 len: 1874 microversion: 2.32 time: 0.385885 Oct 19 03:21:38.835074 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1134/2307] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:21:38 2022] GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7 => generated 1874 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:21:38.842703 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-25735c65-94f7-417b-8004-81081a880c05 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:38.843520 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-25735c65-94f7-417b-8004-81081a880c05 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] [instance: d6d507e4-3a53-4734-bb88-8fc38efa4d9b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:38.850356 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-25735c65-94f7-417b-8004-81081a880c05 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:38.851451 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-25735c65-94f7-417b-8004-81081a880c05 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:38.852083 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-25735c65-94f7-417b-8004-81081a880c05 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:38.852934 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-25735c65-94f7-417b-8004-81081a880c05 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:38.853615 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-25735c65-94f7-417b-8004-81081a880c05 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:38.854213 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-25735c65-94f7-417b-8004-81081a880c05 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:38.870870 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-25735c65-94f7-417b-8004-81081a880c05 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] HTTP exception thrown: Instance d6d507e4-3a53-4734-bb88-8fc38efa4d9b could not be found. Oct 19 03:21:38.872886 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-25735c65-94f7-417b-8004-81081a880c05 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Request method failure captured: Oct 19 03:21:38.872886 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/d6d507e4-3a53-4734-bb88-8fc38efa4d9b HTTP/1.1 Oct 19 03:21:38.872886 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:21:38.872886 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:21:38.872886 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:21:38.872886 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:21:38.872886 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:21:38.872886 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:21:38.872886 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:21:38.872886 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:21:38.872886 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT2y5QS5fGXOCh8dCARu_-t2vnckF3uwZtfqi9DmHed6pMoXibNoREyH_7cDYk3t8P2qbQ1u564D6Sq50msRMl2YQVddoWmeJm48OR72Wl7OECfXwMpGVDHULH4PSkCmyy31jkBvdZSxqyCmIGP32xNgLbjMxF4SrMQTDektLd28zxNg Oct 19 03:21:38.872886 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:21:38.872886 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:21:38.872886 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:21:38.872886 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:21:38.872886 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:21:38.872886 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:21:38.872886 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: f9e436373e9e45efa03f08b33da619e8 Oct 19 03:21:38.872886 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1767182949 Oct 19 03:21:38.872886 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:21:38.872886 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:21:38.874093 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f9e436373e9e45efa03f08b33da619e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f9e436373e9e45efa03f08b33da619e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f9e436373e9e45efa03f08b33da619e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f9e436373e9e45efa03f08b33da619e8", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:21:38.874093 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1767182949 Oct 19 03:21:38.874093 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: f9e436373e9e45efa03f08b33da619e8 Oct 19 03:21:38.874093 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1767182949 Oct 19 03:21:38.874093 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ImagesOneServerNegativeTestJSON-1767182949-project Oct 19 03:21:38.874093 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:21:38.874093 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:21:38.874093 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 8824f20e6a1f478a99f90e1ba8f028fe Oct 19 03:21:38.874093 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1767182949-project Oct 19 03:21:38.874093 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:21:38.874093 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance d6d507e4-3a53-4734-bb88-8fc38efa4d9b could not be found. Oct 19 03:21:38.874093 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': 'd6d507e4-3a53-4734-bb88-8fc38efa4d9b'} Oct 19 03:21:38.874675 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:21:38.874675 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:21:38.874675 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:21:38.874675 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:21:38.874675 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:21:38.874675 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:21:38.874675 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:21:38.874675 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:21:38.874675 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:21:38.874675 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:21:38.874675 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6d507e4-3a53-4734-bb88-8fc38efa4d9b could not be found. Oct 19 03:21:38.874675 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:21:38.874675 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:21:38.874675 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:21:38.874675 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:21:38.874675 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:21:38.874675 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:21:38.874675 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:21:38.874675 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:21:38.874675 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:21:38.875595 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:21:38.875595 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:21:38.875595 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:21:38.875595 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:21:38.875595 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:21:38.875595 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:21:38.875595 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:21:38.875595 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6d507e4-3a53-4734-bb88-8fc38efa4d9b could not be found. Oct 19 03:21:38.875595 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:21:38.875595 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:21:38.875595 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:21:38.875595 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:21:38.875595 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:21:38.875595 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:21:38.875595 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:21:38.875595 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:21:38.875595 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6d507e4-3a53-4734-bb88-8fc38efa4d9b could not be found. Oct 19 03:21:38.875595 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:21:38.878635 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-25735c65-94f7-417b-8004-81081a880c05 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] Returning 404 to user: Instance d6d507e4-3a53-4734-bb88-8fc38efa4d9b could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:21:38.879717 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-25735c65-94f7-417b-8004-81081a880c05 tempest-ImagesOneServerNegativeTestJSON-1767182949 tempest-ImagesOneServerNegativeTestJSON-1767182949-project] 10.222.0.52 "GET /compute/v2.1/servers/d6d507e4-3a53-4734-bb88-8fc38efa4d9b" status: 404 len: 111 microversion: 2.1 time: 0.040720 Oct 19 03:21:38.880833 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1135/2308] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:21:38 2022] GET /compute/v2.1/servers/d6d507e4-3a53-4734-bb88-8fc38efa4d9b => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:21:38.886982 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-acd262a6-8d9d-40b6-adf5-754f1407d08b tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '.version_select at 0x7fc130e4a040>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:38.909407 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-524f5ae1-8058-49b8-b0b7-99a7f5fccd07 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '152fa52a83b14c71bf86b22d77a73625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1606da859950484e9aa949e5c59c0a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:38.919862 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-524f5ae1-8058-49b8-b0b7-99a7f5fccd07 tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] 10.222.0.52 "GET /compute/v2.1/servers/fee1d282-ae3a-4792-ba8f-a19e498c8853" status: 200 len: 1313 microversion: 2.1 time: 0.174863 Oct 19 03:21:38.920447 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1174/2309] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:21:38 2022] GET /compute/v2.1/servers/fee1d282-ae3a-4792-ba8f-a19e498c8853 => generated 1313 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:21:38.933949 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d2922ca5-0ec5-4ace-98c9-b6af8f1d0046 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:38.942552 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d2922ca5-0ec5-4ace-98c9-b6af8f1d0046 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] [instance: 6888c8db-82ba-4072-b431-8d4fcf5f03e0] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:38.950882 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d2922ca5-0ec5-4ace-98c9-b6af8f1d0046 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:38.951045 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-acd262a6-8d9d-40b6-adf5-754f1407d08b tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/images/bb3a25a0-f1e8-496e-9db8-05a27d2b182c" status: 200 len: 1409 microversion: 2.1 time: 0.068375 Oct 19 03:21:38.951848 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1136/2310] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:21:38 2022] GET /compute/v2.1/images/bb3a25a0-f1e8-496e-9db8-05a27d2b182c => generated 1409 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:21:38.952019 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d2922ca5-0ec5-4ace-98c9-b6af8f1d0046 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:38.952575 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d2922ca5-0ec5-4ace-98c9-b6af8f1d0046 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:38.953458 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d2922ca5-0ec5-4ace-98c9-b6af8f1d0046 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:38.955938 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d2922ca5-0ec5-4ace-98c9-b6af8f1d0046 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:38.956404 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d2922ca5-0ec5-4ace-98c9-b6af8f1d0046 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:38.957740 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ac734826-09cf-4ac6-8542-b5ca27e666a4 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:38.960529 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ac734826-09cf-4ac6-8542-b5ca27e666a4 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] [instance: 3b4bc3da-47f7-4719-817f-5636c247c87e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:38.974320 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ac734826-09cf-4ac6-8542-b5ca27e666a4 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:38.975187 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ac734826-09cf-4ac6-8542-b5ca27e666a4 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:38.975708 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ac734826-09cf-4ac6-8542-b5ca27e666a4 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:38.977737 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ac734826-09cf-4ac6-8542-b5ca27e666a4 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:38.978580 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ac734826-09cf-4ac6-8542-b5ca27e666a4 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:38.979494 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ac734826-09cf-4ac6-8542-b5ca27e666a4 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:39.495733 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ac734826-09cf-4ac6-8542-b5ca27e666a4 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3661010393d44c428fb37652b1717072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a1e7cceff48798bfefb9390e5979c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:39.505674 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ac734826-09cf-4ac6-8542-b5ca27e666a4 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] 10.222.0.52 "GET /compute/v2.1/servers/3b4bc3da-47f7-4719-817f-5636c247c87e" status: 200 len: 1316 microversion: 2.1 time: 0.552199 Oct 19 03:21:39.506248 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1137/2311] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:21:38 2022] GET /compute/v2.1/servers/3b4bc3da-47f7-4719-817f-5636c247c87e => generated 1316 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:21:39.518305 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0867aeee-9da5-4c47-94a4-886c7160f0ad tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:39.534478 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0867aeee-9da5-4c47-94a4-886c7160f0ad tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 074f3469-3bbd-46df-8286-3a57f91798e2] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:39.540827 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0867aeee-9da5-4c47-94a4-886c7160f0ad tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:39.541645 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0867aeee-9da5-4c47-94a4-886c7160f0ad tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:39.542249 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0867aeee-9da5-4c47-94a4-886c7160f0ad tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:39.543118 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0867aeee-9da5-4c47-94a4-886c7160f0ad tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:39.543706 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0867aeee-9da5-4c47-94a4-886c7160f0ad tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:39.544261 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0867aeee-9da5-4c47-94a4-886c7160f0ad tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:39.567921 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d2922ca5-0ec5-4ace-98c9-b6af8f1d0046 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4c5e4123c44508a5d4911a17c44231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a495ccfced47f29cb928d1ded20d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:39.588967 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d2922ca5-0ec5-4ace-98c9-b6af8f1d0046 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] 10.222.0.52 "GET /compute/v2.1/servers/6888c8db-82ba-4072-b431-8d4fcf5f03e0" status: 200 len: 1472 microversion: 2.1 time: 0.662345 Oct 19 03:21:39.589895 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1175/2312] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:21:38 2022] GET /compute/v2.1/servers/6888c8db-82ba-4072-b431-8d4fcf5f03e0 => generated 1472 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:21:39.862175 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b6648bc8-8757-4d41-a455-8021a8cd5835 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:39.863076 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b6648bc8-8757-4d41-a455-8021a8cd5835 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] [instance: 4adec402-e94f-4a41-ac77-68f6091b87f7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:39.869023 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0867aeee-9da5-4c47-94a4-886c7160f0ad tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:39.880992 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0867aeee-9da5-4c47-94a4-886c7160f0ad tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:39.888192 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b6648bc8-8757-4d41-a455-8021a8cd5835 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:39.888482 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0867aeee-9da5-4c47-94a4-886c7160f0ad tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:39.890620 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0867aeee-9da5-4c47-94a4-886c7160f0ad tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/074f3469-3bbd-46df-8286-3a57f91798e2" status: 200 len: 1485 microversion: 2.25 time: 0.377279 Oct 19 03:21:39.891175 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b6648bc8-8757-4d41-a455-8021a8cd5835 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:39.892064 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b6648bc8-8757-4d41-a455-8021a8cd5835 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:39.893614 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b6648bc8-8757-4d41-a455-8021a8cd5835 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:39.894755 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1138/2313] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:21:39 2022] GET /compute/v2.1/servers/074f3469-3bbd-46df-8286-3a57f91798e2 => generated 1485 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:21:39.895481 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b6648bc8-8757-4d41-a455-8021a8cd5835 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:39.896124 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b6648bc8-8757-4d41-a455-8021a8cd5835 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:39.952595 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-95069c97-d617-49e2-8172-fc58fc3076ee tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:39.952844 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-95069c97-d617-49e2-8172-fc58fc3076ee tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] [instance: fee1d282-ae3a-4792-ba8f-a19e498c8853] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:39.966861 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-95069c97-d617-49e2-8172-fc58fc3076ee tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:39.973446 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-95069c97-d617-49e2-8172-fc58fc3076ee tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:39.974077 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-95069c97-d617-49e2-8172-fc58fc3076ee tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:39.974853 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-95069c97-d617-49e2-8172-fc58fc3076ee tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:39.975335 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-95069c97-d617-49e2-8172-fc58fc3076ee tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:39.975757 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-95069c97-d617-49e2-8172-fc58fc3076ee tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:40.008551 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-95069c97-d617-49e2-8172-fc58fc3076ee tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] HTTP exception thrown: Instance fee1d282-ae3a-4792-ba8f-a19e498c8853 could not be found. Oct 19 03:21:40.011028 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-95069c97-d617-49e2-8172-fc58fc3076ee tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Request method failure captured: Oct 19 03:21:40.011028 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/fee1d282-ae3a-4792-ba8f-a19e498c8853 HTTP/1.1 Oct 19 03:21:40.011028 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:21:40.011028 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:21:40.011028 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:21:40.011028 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:21:40.011028 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:21:40.011028 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:21:40.011028 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:21:40.011028 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:21:40.011028 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT2zngkJXugfZsxONDHhynwgZaUOoq8iWRgDsGImmOE62slk-LUIhlctk5XrtsUr4UeksTFTDzAWRRiTiD9AvBI3dYps1Qg5VL9Lqhjmen0NOUC9mPha3oo9Zp1udZe8BRte-3V-GTcGyWrerHOUh4IPV8Lnvni6iV69Vk7C0fTM961Y Oct 19 03:21:40.011028 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:21:40.011028 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:21:40.011028 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:21:40.011028 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:21:40.011028 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:21:40.011028 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:21:40.011028 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 1606da859950484e9aa949e5c59c0a65 Oct 19 03:21:40.011028 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-118843582 Oct 19 03:21:40.011028 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:21:40.011028 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:21:40.012340 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1606da859950484e9aa949e5c59c0a65"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1606da859950484e9aa949e5c59c0a65"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1606da859950484e9aa949e5c59c0a65"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1606da859950484e9aa949e5c59c0a65", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:21:40.012340 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-118843582 Oct 19 03:21:40.012340 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 1606da859950484e9aa949e5c59c0a65 Oct 19 03:21:40.012340 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-118843582 Oct 19 03:21:40.012340 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ServerRescueTestJSONUnderV235-118843582-project Oct 19 03:21:40.012340 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:21:40.012340 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:21:40.012340 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 152fa52a83b14c71bf86b22d77a73625 Oct 19 03:21:40.012340 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-118843582-project Oct 19 03:21:40.012340 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:21:40.012340 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance fee1d282-ae3a-4792-ba8f-a19e498c8853 could not be found. Oct 19 03:21:40.012340 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': 'fee1d282-ae3a-4792-ba8f-a19e498c8853'} Oct 19 03:21:40.013090 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:21:40.013090 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:21:40.013090 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:21:40.013090 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:21:40.013090 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:21:40.013090 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:21:40.013090 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:21:40.013090 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:21:40.013090 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:21:40.013090 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:21:40.013090 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fee1d282-ae3a-4792-ba8f-a19e498c8853 could not be found. Oct 19 03:21:40.013090 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:21:40.013090 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:21:40.013090 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:21:40.013090 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:21:40.013090 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:21:40.013090 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:21:40.013090 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:21:40.013090 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:21:40.013090 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:21:40.014531 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:21:40.014531 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:21:40.014531 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:21:40.014531 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:21:40.014531 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:21:40.014531 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:21:40.014531 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:21:40.014531 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fee1d282-ae3a-4792-ba8f-a19e498c8853 could not be found. Oct 19 03:21:40.014531 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:21:40.014531 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:21:40.014531 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:21:40.014531 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:21:40.014531 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:21:40.014531 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:21:40.014531 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:21:40.014531 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:21:40.014531 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fee1d282-ae3a-4792-ba8f-a19e498c8853 could not be found. Oct 19 03:21:40.014531 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:21:40.015545 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-95069c97-d617-49e2-8172-fc58fc3076ee tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] Returning 404 to user: Instance fee1d282-ae3a-4792-ba8f-a19e498c8853 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:21:40.015545 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-95069c97-d617-49e2-8172-fc58fc3076ee tempest-ServerRescueTestJSONUnderV235-118843582 tempest-ServerRescueTestJSONUnderV235-118843582-project] 10.222.0.52 "GET /compute/v2.1/servers/fee1d282-ae3a-4792-ba8f-a19e498c8853" status: 404 len: 111 microversion: 2.1 time: 0.065810 Oct 19 03:21:40.015545 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1139/2314] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:21:39 2022] GET /compute/v2.1/servers/fee1d282-ae3a-4792-ba8f-a19e498c8853 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 03:21:40.020464 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8f2235fc-d921-442c-aee9-e9cfe9983d57 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '.version_select at 0x7fc130b57700>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:40.111622 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8f2235fc-d921-442c-aee9-e9cfe9983d57 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/images/bb3a25a0-f1e8-496e-9db8-05a27d2b182c" status: 200 len: 1409 microversion: 2.1 time: 0.096257 Oct 19 03:21:40.112824 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1140/2315] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:21:40 2022] GET /compute/v2.1/images/bb3a25a0-f1e8-496e-9db8-05a27d2b182c => generated 1409 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:21:40.539628 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9356084c-643b-49b2-b9d6-76d506e02fe8 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:40.540587 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9356084c-643b-49b2-b9d6-76d506e02fe8 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] [instance: 3b4bc3da-47f7-4719-817f-5636c247c87e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:40.549196 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9356084c-643b-49b2-b9d6-76d506e02fe8 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:40.550531 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9356084c-643b-49b2-b9d6-76d506e02fe8 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:40.550531 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9356084c-643b-49b2-b9d6-76d506e02fe8 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:40.551089 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9356084c-643b-49b2-b9d6-76d506e02fe8 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:40.551550 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9356084c-643b-49b2-b9d6-76d506e02fe8 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:40.551981 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9356084c-643b-49b2-b9d6-76d506e02fe8 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:40.711970 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b6648bc8-8757-4d41-a455-8021a8cd5835 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:40.734477 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b6648bc8-8757-4d41-a455-8021a8cd5835 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:40.738348 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b6648bc8-8757-4d41-a455-8021a8cd5835 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:40.740767 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b6648bc8-8757-4d41-a455-8021a8cd5835 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] 10.222.0.52 "GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7" status: 200 len: 1874 microversion: 2.32 time: 0.881950 Oct 19 03:21:40.742332 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1176/2316] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:21:39 2022] GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7 => generated 1874 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:21:40.750981 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-bc8dc7a7-1963-4fea-b768-eab83cae0141 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:40.751830 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-bc8dc7a7-1963-4fea-b768-eab83cae0141 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] [instance: 6888c8db-82ba-4072-b431-8d4fcf5f03e0] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:40.771761 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bc8dc7a7-1963-4fea-b768-eab83cae0141 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:40.771761 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bc8dc7a7-1963-4fea-b768-eab83cae0141 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:40.771761 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bc8dc7a7-1963-4fea-b768-eab83cae0141 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:40.771761 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bc8dc7a7-1963-4fea-b768-eab83cae0141 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:40.772044 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bc8dc7a7-1963-4fea-b768-eab83cae0141 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:40.773947 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bc8dc7a7-1963-4fea-b768-eab83cae0141 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:40.891049 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9356084c-643b-49b2-b9d6-76d506e02fe8 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3661010393d44c428fb37652b1717072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a1e7cceff48798bfefb9390e5979c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:40.915315 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9356084c-643b-49b2-b9d6-76d506e02fe8 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] 10.222.0.52 "GET /compute/v2.1/servers/3b4bc3da-47f7-4719-817f-5636c247c87e" status: 200 len: 1316 microversion: 2.1 time: 0.380810 Oct 19 03:21:40.929485 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1141/2317] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:21:40 2022] GET /compute/v2.1/servers/3b4bc3da-47f7-4719-817f-5636c247c87e => generated 1316 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:21:40.929485 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-7cd88455-bd0d-43d2-bf1d-a8b0e49629d7 req-771a7410-113f-4451-b67f-115ae6eb1bef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "074f3469-3bbd-46df-8286-3a57f91798e2", "name": "network-vif-unplugged", "status": "completed", "tag": "44f53eb4-50b1-4764-8a1c-143764a0a324"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:21:40.933338 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-7cd88455-bd0d-43d2-bf1d-a8b0e49629d7 req-771a7410-113f-4451-b67f-115ae6eb1bef service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:40.934680 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-7cd88455-bd0d-43d2-bf1d-a8b0e49629d7 req-771a7410-113f-4451-b67f-115ae6eb1bef service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:40.935360 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-7cd88455-bd0d-43d2-bf1d-a8b0e49629d7 req-771a7410-113f-4451-b67f-115ae6eb1bef service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:40.953782 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-7cd88455-bd0d-43d2-bf1d-a8b0e49629d7 req-771a7410-113f-4451-b67f-115ae6eb1bef service nova] Creating event network-vif-unplugged:44f53eb4-50b1-4764-8a1c-143764a0a324 for instance 074f3469-3bbd-46df-8286-3a57f91798e2 on n-h1-861333-8 Oct 19 03:21:40.960521 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-7cd88455-bd0d-43d2-bf1d-a8b0e49629d7 req-771a7410-113f-4451-b67f-115ae6eb1bef service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043165 Oct 19 03:21:40.961136 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1142/2318] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:21:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:21:40.966821 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-24c27fa6-f37d-45e5-8eb2-0473904cdc66 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:40.967719 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-24c27fa6-f37d-45e5-8eb2-0473904cdc66 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 074f3469-3bbd-46df-8286-3a57f91798e2] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:40.975690 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-24c27fa6-f37d-45e5-8eb2-0473904cdc66 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:40.976383 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-24c27fa6-f37d-45e5-8eb2-0473904cdc66 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:40.976993 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-24c27fa6-f37d-45e5-8eb2-0473904cdc66 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:40.977749 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-24c27fa6-f37d-45e5-8eb2-0473904cdc66 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:40.978213 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-24c27fa6-f37d-45e5-8eb2-0473904cdc66 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:40.978669 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-24c27fa6-f37d-45e5-8eb2-0473904cdc66 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:41.106982 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-bc8dc7a7-1963-4fea-b768-eab83cae0141 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4c5e4123c44508a5d4911a17c44231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a495ccfced47f29cb928d1ded20d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:41.116406 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-bc8dc7a7-1963-4fea-b768-eab83cae0141 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] 10.222.0.52 "GET /compute/v2.1/servers/6888c8db-82ba-4072-b431-8d4fcf5f03e0" status: 200 len: 1472 microversion: 2.1 time: 0.372341 Oct 19 03:21:41.117401 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1177/2319] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:21:40 2022] GET /compute/v2.1/servers/6888c8db-82ba-4072-b431-8d4fcf5f03e0 => generated 1472 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:21:41.129238 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0797966f-c476-4225-93bb-41fa12960141 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '.version_select at 0x7fc130c2da60>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:41.198337 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0797966f-c476-4225-93bb-41fa12960141 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/images/bb3a25a0-f1e8-496e-9db8-05a27d2b182c" status: 200 len: 1409 microversion: 2.1 time: 0.074225 Oct 19 03:21:41.206279 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1178/2320] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:21:41 2022] GET /compute/v2.1/images/bb3a25a0-f1e8-496e-9db8-05a27d2b182c => generated 1409 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:21:41.329596 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-7b0b2919-5126-4032-ad80-214c232038fb req-7470860b-a667-4c1e-8df5-f71c925e9d33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fd536f4-6456-4291-8a11-2c48a453932a", "name": "network-vif-plugged", "status": "completed", "tag": "8a122a74-7a6e-4f35-ab43-ab8ca0ff35c0"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:21:41.331139 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-24c27fa6-f37d-45e5-8eb2-0473904cdc66 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:41.341175 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-7b0b2919-5126-4032-ad80-214c232038fb req-7470860b-a667-4c1e-8df5-f71c925e9d33 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:41.342090 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-7b0b2919-5126-4032-ad80-214c232038fb req-7470860b-a667-4c1e-8df5-f71c925e9d33 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:41.342705 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-7b0b2919-5126-4032-ad80-214c232038fb req-7470860b-a667-4c1e-8df5-f71c925e9d33 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:41.343801 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-24c27fa6-f37d-45e5-8eb2-0473904cdc66 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:41.345817 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-24c27fa6-f37d-45e5-8eb2-0473904cdc66 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:41.350146 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-24c27fa6-f37d-45e5-8eb2-0473904cdc66 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/074f3469-3bbd-46df-8286-3a57f91798e2" status: 200 len: 1485 microversion: 2.25 time: 0.387582 Oct 19 03:21:41.356540 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-7b0b2919-5126-4032-ad80-214c232038fb req-7470860b-a667-4c1e-8df5-f71c925e9d33 service nova] Creating event network-vif-plugged:8a122a74-7a6e-4f35-ab43-ab8ca0ff35c0 for instance 6fd536f4-6456-4291-8a11-2c48a453932a on n-h1-861333-8 Oct 19 03:21:41.364027 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-7b0b2919-5126-4032-ad80-214c232038fb req-7470860b-a667-4c1e-8df5-f71c925e9d33 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038747 Oct 19 03:21:41.364250 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1143/2321] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:21:40 2022] GET /compute/v2.1/servers/074f3469-3bbd-46df-8286-3a57f91798e2 => generated 1485 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:21:41.365310 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1179/2322] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:21:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:21:41.770471 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3dab53fb-7fb8-4143-916e-b07594113007 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:41.772107 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3dab53fb-7fb8-4143-916e-b07594113007 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] [instance: 4adec402-e94f-4a41-ac77-68f6091b87f7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:41.774958 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:21:41.775716 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=6 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:21:41.781516 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3dab53fb-7fb8-4143-916e-b07594113007 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:41.782285 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3dab53fb-7fb8-4143-916e-b07594113007 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:41.782808 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3dab53fb-7fb8-4143-916e-b07594113007 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:41.786946 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3dab53fb-7fb8-4143-916e-b07594113007 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:41.786946 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3dab53fb-7fb8-4143-916e-b07594113007 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:41.786946 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3dab53fb-7fb8-4143-916e-b07594113007 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:41.971487 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-14fb12fd-eb95-4442-ac8e-89adae64c938 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:41.973140 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-14fb12fd-eb95-4442-ac8e-89adae64c938 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] [instance: 3b4bc3da-47f7-4719-817f-5636c247c87e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:41.987537 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-14fb12fd-eb95-4442-ac8e-89adae64c938 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:41.988033 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-14fb12fd-eb95-4442-ac8e-89adae64c938 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:41.988472 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-14fb12fd-eb95-4442-ac8e-89adae64c938 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:41.990234 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-14fb12fd-eb95-4442-ac8e-89adae64c938 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:41.990234 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-14fb12fd-eb95-4442-ac8e-89adae64c938 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:41.990234 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-14fb12fd-eb95-4442-ac8e-89adae64c938 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:42.258590 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-3dab53fb-7fb8-4143-916e-b07594113007 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:42.290511 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-3dab53fb-7fb8-4143-916e-b07594113007 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:42.293613 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-3dab53fb-7fb8-4143-916e-b07594113007 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:42.295773 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3dab53fb-7fb8-4143-916e-b07594113007 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] 10.222.0.52 "GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7" status: 200 len: 1874 microversion: 2.32 time: 0.529597 Oct 19 03:21:42.297485 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1144/2323] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:21:41 2022] GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7 => generated 1874 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:21:42.302060 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:21:42.315630 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-06ff2b8e-5041-407f-9f0a-799906520d66 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:42.318207 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-06ff2b8e-5041-407f-9f0a-799906520d66 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] [instance: 6888c8db-82ba-4072-b431-8d4fcf5f03e0] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:42.324826 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-06ff2b8e-5041-407f-9f0a-799906520d66 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:42.325596 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-06ff2b8e-5041-407f-9f0a-799906520d66 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:42.326177 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-06ff2b8e-5041-407f-9f0a-799906520d66 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:42.327045 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-06ff2b8e-5041-407f-9f0a-799906520d66 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:42.327644 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-06ff2b8e-5041-407f-9f0a-799906520d66 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:42.330652 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-06ff2b8e-5041-407f-9f0a-799906520d66 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:42.397423 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-14fb12fd-eb95-4442-ac8e-89adae64c938 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3661010393d44c428fb37652b1717072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a1e7cceff48798bfefb9390e5979c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:42.408587 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-14fb12fd-eb95-4442-ac8e-89adae64c938 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] 10.222.0.52 "GET /compute/v2.1/servers/3b4bc3da-47f7-4719-817f-5636c247c87e" status: 200 len: 1316 microversion: 2.1 time: 0.469683 Oct 19 03:21:42.409942 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1180/2324] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:21:41 2022] GET /compute/v2.1/servers/3b4bc3da-47f7-4719-817f-5636c247c87e => generated 1316 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:21:42.416154 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e4aca1e0-341d-4b0f-be6e-12f3f27b6464 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '.version_select at 0x7fc134f74550>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:42.471250 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e4aca1e0-341d-4b0f-be6e-12f3f27b6464 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/images/bb3a25a0-f1e8-496e-9db8-05a27d2b182c" status: 200 len: 1409 microversion: 2.1 time: 0.059290 Oct 19 03:21:42.472510 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1181/2325] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:21:42 2022] GET /compute/v2.1/images/bb3a25a0-f1e8-496e-9db8-05a27d2b182c => generated 1409 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:21:42.478485 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e9287fe6-82f3-4eef-9c07-d0f81a181edc tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:42.479378 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e9287fe6-82f3-4eef-9c07-d0f81a181edc tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 074f3469-3bbd-46df-8286-3a57f91798e2] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:42.487099 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e9287fe6-82f3-4eef-9c07-d0f81a181edc tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:42.487994 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e9287fe6-82f3-4eef-9c07-d0f81a181edc tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:42.488540 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e9287fe6-82f3-4eef-9c07-d0f81a181edc tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:42.490887 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e9287fe6-82f3-4eef-9c07-d0f81a181edc tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:42.491375 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e9287fe6-82f3-4eef-9c07-d0f81a181edc tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:42.491929 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e9287fe6-82f3-4eef-9c07-d0f81a181edc tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:42.527664 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-06ff2b8e-5041-407f-9f0a-799906520d66 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4c5e4123c44508a5d4911a17c44231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a495ccfced47f29cb928d1ded20d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:42.542169 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-06ff2b8e-5041-407f-9f0a-799906520d66 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] 10.222.0.52 "GET /compute/v2.1/servers/6888c8db-82ba-4072-b431-8d4fcf5f03e0" status: 200 len: 1472 microversion: 2.1 time: 0.242571 Oct 19 03:21:42.542763 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1145/2326] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:21:42 2022] GET /compute/v2.1/servers/6888c8db-82ba-4072-b431-8d4fcf5f03e0 => generated 1472 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:21:42.668278 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-e9287fe6-82f3-4eef-9c07-d0f81a181edc tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:42.678188 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-e9287fe6-82f3-4eef-9c07-d0f81a181edc tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:42.679738 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-e9287fe6-82f3-4eef-9c07-d0f81a181edc tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:42.681173 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e9287fe6-82f3-4eef-9c07-d0f81a181edc tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/074f3469-3bbd-46df-8286-3a57f91798e2" status: 200 len: 1485 microversion: 2.25 time: 0.207478 Oct 19 03:21:42.699599 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1182/2327] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:21:42 2022] GET /compute/v2.1/servers/074f3469-3bbd-46df-8286-3a57f91798e2 => generated 1485 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:21:42.985511 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-c33b13e1-60c4-4c36-a560-2acf20a63e3e req-c9085b01-9d1e-45c3-abbb-b15fef990cb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b4bc3da-47f7-4719-817f-5636c247c87e", "tag": "895e29f8-be3d-4fe5-9b3a-5b5bfaa322fc"}, {"name": "network-changed", "server_uuid": "074f3469-3bbd-46df-8286-3a57f91798e2", "tag": "44f53eb4-50b1-4764-8a1c-143764a0a324"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:21:43.003044 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-c33b13e1-60c4-4c36-a560-2acf20a63e3e req-c9085b01-9d1e-45c3-abbb-b15fef990cb1 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:43.003536 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-c33b13e1-60c4-4c36-a560-2acf20a63e3e req-c9085b01-9d1e-45c3-abbb-b15fef990cb1 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:43.003979 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-c33b13e1-60c4-4c36-a560-2acf20a63e3e req-c9085b01-9d1e-45c3-abbb-b15fef990cb1 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:43.021673 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-c33b13e1-60c4-4c36-a560-2acf20a63e3e req-c9085b01-9d1e-45c3-abbb-b15fef990cb1 service nova] Creating event network-changed:895e29f8-be3d-4fe5-9b3a-5b5bfaa322fc for instance 3b4bc3da-47f7-4719-817f-5636c247c87e on n-h1-861333-8 Oct 19 03:21:43.022117 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-c33b13e1-60c4-4c36-a560-2acf20a63e3e req-c9085b01-9d1e-45c3-abbb-b15fef990cb1 service nova] Creating event network-changed:44f53eb4-50b1-4764-8a1c-143764a0a324 for instance 074f3469-3bbd-46df-8286-3a57f91798e2 on n-h1-861333-8 Oct 19 03:21:43.028676 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-c33b13e1-60c4-4c36-a560-2acf20a63e3e req-c9085b01-9d1e-45c3-abbb-b15fef990cb1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.047635 Oct 19 03:21:43.029269 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1146/2328] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:21:42 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:21:43.324951 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3900f35c-f597-4a5e-944d-716ea595d539 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:43.327948 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-3900f35c-f597-4a5e-944d-716ea595d539 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] [instance: 4adec402-e94f-4a41-ac77-68f6091b87f7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:43.347949 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3900f35c-f597-4a5e-944d-716ea595d539 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:43.349888 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3900f35c-f597-4a5e-944d-716ea595d539 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:43.351439 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3900f35c-f597-4a5e-944d-716ea595d539 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:43.353897 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3900f35c-f597-4a5e-944d-716ea595d539 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:43.355694 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3900f35c-f597-4a5e-944d-716ea595d539 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:43.363708 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3900f35c-f597-4a5e-944d-716ea595d539 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:43.435594 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c7ac01b3-cd77-41e2-9d68-5675068626d3 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:43.438533 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c7ac01b3-cd77-41e2-9d68-5675068626d3 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] [instance: 3b4bc3da-47f7-4719-817f-5636c247c87e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:43.446021 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c7ac01b3-cd77-41e2-9d68-5675068626d3 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:43.446906 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c7ac01b3-cd77-41e2-9d68-5675068626d3 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:43.447656 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c7ac01b3-cd77-41e2-9d68-5675068626d3 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:43.448755 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c7ac01b3-cd77-41e2-9d68-5675068626d3 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:43.449405 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c7ac01b3-cd77-41e2-9d68-5675068626d3 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:43.455354 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c7ac01b3-cd77-41e2-9d68-5675068626d3 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:43.718747 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c7ac01b3-cd77-41e2-9d68-5675068626d3 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3661010393d44c428fb37652b1717072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a1e7cceff48798bfefb9390e5979c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:43.728281 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c7ac01b3-cd77-41e2-9d68-5675068626d3 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] 10.222.0.52 "GET /compute/v2.1/servers/3b4bc3da-47f7-4719-817f-5636c247c87e" status: 200 len: 1316 microversion: 2.1 time: 0.296955 Oct 19 03:21:43.731362 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1147/2329] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:21:43 2022] GET /compute/v2.1/servers/3b4bc3da-47f7-4719-817f-5636c247c87e => generated 1316 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:21:43.742824 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-95c727d6-7819-48d9-9e30-49bc1f53e616 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '.version_select at 0x7fc130d10550>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:43.802871 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-3900f35c-f597-4a5e-944d-716ea595d539 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:43.815039 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-95c727d6-7819-48d9-9e30-49bc1f53e616 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/images/bb3a25a0-f1e8-496e-9db8-05a27d2b182c" status: 200 len: 1409 microversion: 2.1 time: 0.081523 Oct 19 03:21:43.816507 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1148/2330] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:21:43 2022] GET /compute/v2.1/images/bb3a25a0-f1e8-496e-9db8-05a27d2b182c => generated 1409 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:21:43.819179 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-3900f35c-f597-4a5e-944d-716ea595d539 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:43.825166 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-3900f35c-f597-4a5e-944d-716ea595d539 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:43.826820 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-3900f35c-f597-4a5e-944d-716ea595d539 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] 10.222.0.52 "GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7" status: 200 len: 1874 microversion: 2.32 time: 0.506250 Oct 19 03:21:43.829444 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3a8976a2-3e81-423c-9895-c5b03d4213ee tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:43.830305 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1183/2331] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:21:43 2022] GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7 => generated 1874 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:21:43.833955 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3a8976a2-3e81-423c-9895-c5b03d4213ee tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] [instance: 6888c8db-82ba-4072-b431-8d4fcf5f03e0] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:43.839126 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-33bdf58e-a727-4aa0-9e63-76d1498458cb req-21b9d61e-3dd2-45fa-8e14-051751767cb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4adec402-e94f-4a41-ac77-68f6091b87f7", "name": "network-vif-plugged", "status": "completed", "tag": "66f823f7-1df0-47b2-bcc5-7f5bb365d0f5"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:21:43.854189 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3a8976a2-3e81-423c-9895-c5b03d4213ee tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:43.854694 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3a8976a2-3e81-423c-9895-c5b03d4213ee tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:43.855137 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3a8976a2-3e81-423c-9895-c5b03d4213ee tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:43.860430 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3a8976a2-3e81-423c-9895-c5b03d4213ee tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:43.864066 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3a8976a2-3e81-423c-9895-c5b03d4213ee tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:43.864880 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3a8976a2-3e81-423c-9895-c5b03d4213ee tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:43.878185 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-33bdf58e-a727-4aa0-9e63-76d1498458cb req-21b9d61e-3dd2-45fa-8e14-051751767cb0 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:43.878708 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-33bdf58e-a727-4aa0-9e63-76d1498458cb req-21b9d61e-3dd2-45fa-8e14-051751767cb0 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:43.879168 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-33bdf58e-a727-4aa0-9e63-76d1498458cb req-21b9d61e-3dd2-45fa-8e14-051751767cb0 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:43.902885 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-33bdf58e-a727-4aa0-9e63-76d1498458cb req-21b9d61e-3dd2-45fa-8e14-051751767cb0 service nova] Creating event network-vif-plugged:66f823f7-1df0-47b2-bcc5-7f5bb365d0f5 for instance 4adec402-e94f-4a41-ac77-68f6091b87f7 on n-h2-861333-8 Oct 19 03:21:43.910837 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-33bdf58e-a727-4aa0-9e63-76d1498458cb req-21b9d61e-3dd2-45fa-8e14-051751767cb0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078881 Oct 19 03:21:43.912508 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1184/2332] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:21:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:21:43.920594 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7bb76e61-1126-4be7-8035-eab5dca751e5 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:43.921954 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7bb76e61-1126-4be7-8035-eab5dca751e5 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 074f3469-3bbd-46df-8286-3a57f91798e2] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:43.934656 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7bb76e61-1126-4be7-8035-eab5dca751e5 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:43.938547 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7bb76e61-1126-4be7-8035-eab5dca751e5 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:43.939580 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7bb76e61-1126-4be7-8035-eab5dca751e5 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:43.941991 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7bb76e61-1126-4be7-8035-eab5dca751e5 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:43.944769 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7bb76e61-1126-4be7-8035-eab5dca751e5 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:43.946001 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7bb76e61-1126-4be7-8035-eab5dca751e5 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:44.082595 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-3a8976a2-3e81-423c-9895-c5b03d4213ee tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4c5e4123c44508a5d4911a17c44231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a495ccfced47f29cb928d1ded20d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:44.091502 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3a8976a2-3e81-423c-9895-c5b03d4213ee tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] 10.222.0.52 "GET /compute/v2.1/servers/6888c8db-82ba-4072-b431-8d4fcf5f03e0" status: 200 len: 1472 microversion: 2.1 time: 0.273752 Oct 19 03:21:44.094806 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1149/2333] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:21:43 2022] GET /compute/v2.1/servers/6888c8db-82ba-4072-b431-8d4fcf5f03e0 => generated 1472 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:21:44.184547 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7bb76e61-1126-4be7-8035-eab5dca751e5 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:44.195586 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7bb76e61-1126-4be7-8035-eab5dca751e5 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:44.197358 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7bb76e61-1126-4be7-8035-eab5dca751e5 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:44.202147 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7bb76e61-1126-4be7-8035-eab5dca751e5 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/074f3469-3bbd-46df-8286-3a57f91798e2" status: 200 len: 1485 microversion: 2.25 time: 0.287923 Oct 19 03:21:44.203396 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1185/2334] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:21:43 2022] GET /compute/v2.1/servers/074f3469-3bbd-46df-8286-3a57f91798e2 => generated 1485 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:21:44.759388 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-edcb1cee-80b4-42ba-b4ed-482bcc36773d tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:44.763948 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-edcb1cee-80b4-42ba-b4ed-482bcc36773d tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] [instance: 3b4bc3da-47f7-4719-817f-5636c247c87e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:44.768978 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-edcb1cee-80b4-42ba-b4ed-482bcc36773d tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:44.769512 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-edcb1cee-80b4-42ba-b4ed-482bcc36773d tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:44.770121 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-edcb1cee-80b4-42ba-b4ed-482bcc36773d tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:44.771140 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-edcb1cee-80b4-42ba-b4ed-482bcc36773d tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:44.771776 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-edcb1cee-80b4-42ba-b4ed-482bcc36773d tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:44.772507 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-edcb1cee-80b4-42ba-b4ed-482bcc36773d tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:44.832252 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f100444d-8fc0-4123-b6f4-bb51f5c9dc38 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '.version_select at 0x7fc134f49dc0>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:44.926052 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f100444d-8fc0-4123-b6f4-bb51f5c9dc38 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/images/bb3a25a0-f1e8-496e-9db8-05a27d2b182c" status: 200 len: 1409 microversion: 2.1 time: 0.098430 Oct 19 03:21:44.928358 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1186/2335] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:21:44 2022] GET /compute/v2.1/images/bb3a25a0-f1e8-496e-9db8-05a27d2b182c => generated 1409 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:21:44.935071 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-79b55bff-ef52-4cb5-987f-c2ca9739382e tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:44.936047 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-79b55bff-ef52-4cb5-987f-c2ca9739382e tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] [instance: 4adec402-e94f-4a41-ac77-68f6091b87f7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:44.944718 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-79b55bff-ef52-4cb5-987f-c2ca9739382e tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:44.945229 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-79b55bff-ef52-4cb5-987f-c2ca9739382e tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:44.945961 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-79b55bff-ef52-4cb5-987f-c2ca9739382e tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:44.946834 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-79b55bff-ef52-4cb5-987f-c2ca9739382e tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:44.947304 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-79b55bff-ef52-4cb5-987f-c2ca9739382e tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:44.947743 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-79b55bff-ef52-4cb5-987f-c2ca9739382e tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:44.989569 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-edcb1cee-80b4-42ba-b4ed-482bcc36773d tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3661010393d44c428fb37652b1717072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a1e7cceff48798bfefb9390e5979c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:44.997708 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-edcb1cee-80b4-42ba-b4ed-482bcc36773d tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] 10.222.0.52 "GET /compute/v2.1/servers/3b4bc3da-47f7-4719-817f-5636c247c87e" status: 200 len: 1316 microversion: 2.1 time: 0.242403 Oct 19 03:21:44.998300 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1150/2336] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:21:44 2022] GET /compute/v2.1/servers/3b4bc3da-47f7-4719-817f-5636c247c87e => generated 1316 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:21:45.120326 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-edc13ced-485d-418b-a261-e8d981d8c25d tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:45.120957 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-edc13ced-485d-418b-a261-e8d981d8c25d tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] [instance: 6888c8db-82ba-4072-b431-8d4fcf5f03e0] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:45.135091 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-edc13ced-485d-418b-a261-e8d981d8c25d tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:45.135604 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-edc13ced-485d-418b-a261-e8d981d8c25d tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:45.136053 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-edc13ced-485d-418b-a261-e8d981d8c25d tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:45.136783 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-edc13ced-485d-418b-a261-e8d981d8c25d tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:45.137244 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-edc13ced-485d-418b-a261-e8d981d8c25d tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:45.137715 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-edc13ced-485d-418b-a261-e8d981d8c25d tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:45.159384 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-79b55bff-ef52-4cb5-987f-c2ca9739382e tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:45.172867 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-79b55bff-ef52-4cb5-987f-c2ca9739382e tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:45.178559 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-79b55bff-ef52-4cb5-987f-c2ca9739382e tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:45.184179 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-79b55bff-ef52-4cb5-987f-c2ca9739382e tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] 10.222.0.52 "GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7" status: 200 len: 1874 microversion: 2.32 time: 0.251937 Oct 19 03:21:45.184980 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1187/2337] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:21:44 2022] GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7 => generated 1874 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:21:45.229019 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-563be524-594f-4fae-94c1-7b046a7d6edc tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:45.229681 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-563be524-594f-4fae-94c1-7b046a7d6edc tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 074f3469-3bbd-46df-8286-3a57f91798e2] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:45.244498 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-563be524-594f-4fae-94c1-7b046a7d6edc tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:45.245772 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-563be524-594f-4fae-94c1-7b046a7d6edc tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:45.246760 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-563be524-594f-4fae-94c1-7b046a7d6edc tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:45.247659 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-563be524-594f-4fae-94c1-7b046a7d6edc tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:45.248271 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-563be524-594f-4fae-94c1-7b046a7d6edc tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:45.248846 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-563be524-594f-4fae-94c1-7b046a7d6edc tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:45.538103 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-edc13ced-485d-418b-a261-e8d981d8c25d tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4c5e4123c44508a5d4911a17c44231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a495ccfced47f29cb928d1ded20d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:45.546330 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-563be524-594f-4fae-94c1-7b046a7d6edc tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:45.552053 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-edc13ced-485d-418b-a261-e8d981d8c25d tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] 10.222.0.52 "GET /compute/v2.1/servers/6888c8db-82ba-4072-b431-8d4fcf5f03e0" status: 200 len: 1472 microversion: 2.1 time: 0.436465 Oct 19 03:21:45.552855 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1151/2338] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:21:45 2022] GET /compute/v2.1/servers/6888c8db-82ba-4072-b431-8d4fcf5f03e0 => generated 1472 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:21:45.557542 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-563be524-594f-4fae-94c1-7b046a7d6edc tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:45.559144 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-563be524-594f-4fae-94c1-7b046a7d6edc tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:45.560414 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-563be524-594f-4fae-94c1-7b046a7d6edc tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/074f3469-3bbd-46df-8286-3a57f91798e2" status: 200 len: 1485 microversion: 2.25 time: 0.335870 Oct 19 03:21:45.561074 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1188/2339] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:21:45 2022] GET /compute/v2.1/servers/074f3469-3bbd-46df-8286-3a57f91798e2 => generated 1485 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:21:45.936094 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-fb2be254-4070-45f4-936d-88b8fb016345 req-b9c40f21-fcec-46b7-8b04-f05ef384f120 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4adec402-e94f-4a41-ac77-68f6091b87f7", "name": "network-vif-plugged", "status": "completed", "tag": "e6dbfbc8-417d-4e7e-a4c5-055b2fa99fdc"}, {"server_uuid": "4adec402-e94f-4a41-ac77-68f6091b87f7", "name": "network-vif-plugged", "status": "completed", "tag": "1b205325-d228-42ec-97ef-c076cae51f44"}, {"server_uuid": "4adec402-e94f-4a41-ac77-68f6091b87f7", "name": "network-vif-plugged", "status": "completed", "tag": "bad825e5-2050-4f8e-b26b-6ce95f019585"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:21:45.941738 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-31abf285-64a1-4874-b57c-18e754a397eb tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '.version_select at 0x7fc134f86550>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:45.948499 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-fb2be254-4070-45f4-936d-88b8fb016345 req-b9c40f21-fcec-46b7-8b04-f05ef384f120 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:45.948990 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-fb2be254-4070-45f4-936d-88b8fb016345 req-b9c40f21-fcec-46b7-8b04-f05ef384f120 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:45.949754 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-fb2be254-4070-45f4-936d-88b8fb016345 req-b9c40f21-fcec-46b7-8b04-f05ef384f120 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:45.962953 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-fb2be254-4070-45f4-936d-88b8fb016345 req-b9c40f21-fcec-46b7-8b04-f05ef384f120 service nova] Creating event network-vif-plugged:e6dbfbc8-417d-4e7e-a4c5-055b2fa99fdc for instance 4adec402-e94f-4a41-ac77-68f6091b87f7 on n-h2-861333-8 Oct 19 03:21:45.963743 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-fb2be254-4070-45f4-936d-88b8fb016345 req-b9c40f21-fcec-46b7-8b04-f05ef384f120 service nova] Creating event network-vif-plugged:1b205325-d228-42ec-97ef-c076cae51f44 for instance 4adec402-e94f-4a41-ac77-68f6091b87f7 on n-h2-861333-8 Oct 19 03:21:45.964526 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-fb2be254-4070-45f4-936d-88b8fb016345 req-b9c40f21-fcec-46b7-8b04-f05ef384f120 service nova] Creating event network-vif-plugged:bad825e5-2050-4f8e-b26b-6ce95f019585 for instance 4adec402-e94f-4a41-ac77-68f6091b87f7 on n-h2-861333-8 Oct 19 03:21:45.971417 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-fb2be254-4070-45f4-936d-88b8fb016345 req-b9c40f21-fcec-46b7-8b04-f05ef384f120 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.041631 Oct 19 03:21:45.984557 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1152/2340] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:21:45 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:21:46.019558 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-31abf285-64a1-4874-b57c-18e754a397eb tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/images/bb3a25a0-f1e8-496e-9db8-05a27d2b182c" status: 200 len: 1409 microversion: 2.1 time: 0.081411 Oct 19 03:21:46.020753 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1189/2341] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:21:45 2022] GET /compute/v2.1/images/bb3a25a0-f1e8-496e-9db8-05a27d2b182c => generated 1409 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:21:46.027186 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-fee49b39-7ba9-42dd-8c52-1010e3be5dd1 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:46.028234 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-fee49b39-7ba9-42dd-8c52-1010e3be5dd1 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] [instance: 3b4bc3da-47f7-4719-817f-5636c247c87e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:46.039390 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fee49b39-7ba9-42dd-8c52-1010e3be5dd1 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:46.040144 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fee49b39-7ba9-42dd-8c52-1010e3be5dd1 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:46.040806 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fee49b39-7ba9-42dd-8c52-1010e3be5dd1 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:46.041764 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fee49b39-7ba9-42dd-8c52-1010e3be5dd1 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:46.042368 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fee49b39-7ba9-42dd-8c52-1010e3be5dd1 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:46.042987 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fee49b39-7ba9-42dd-8c52-1010e3be5dd1 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:46.063985 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=100 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:21:46.191922 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-fee49b39-7ba9-42dd-8c52-1010e3be5dd1 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3661010393d44c428fb37652b1717072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a1e7cceff48798bfefb9390e5979c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:46.199572 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-fee49b39-7ba9-42dd-8c52-1010e3be5dd1 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] 10.222.0.52 "GET /compute/v2.1/servers/3b4bc3da-47f7-4719-817f-5636c247c87e" status: 200 len: 1316 microversion: 2.1 time: 0.182718 Oct 19 03:21:46.200146 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1153/2342] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:21:46 2022] GET /compute/v2.1/servers/3b4bc3da-47f7-4719-817f-5636c247c87e => generated 1316 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:21:46.223018 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-10863d9b-365b-4cdb-8f47-a1987618fc7d tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:46.223752 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-10863d9b-365b-4cdb-8f47-a1987618fc7d tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] [instance: 4adec402-e94f-4a41-ac77-68f6091b87f7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:46.231376 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-10863d9b-365b-4cdb-8f47-a1987618fc7d tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:46.232000 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-10863d9b-365b-4cdb-8f47-a1987618fc7d tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:46.232494 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-10863d9b-365b-4cdb-8f47-a1987618fc7d tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:46.237510 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-10863d9b-365b-4cdb-8f47-a1987618fc7d tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:46.237510 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-10863d9b-365b-4cdb-8f47-a1987618fc7d tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:46.237510 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-10863d9b-365b-4cdb-8f47-a1987618fc7d tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:46.579090 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-eb1514bf-8b89-45c8-9816-7328176895fe tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:46.580333 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-eb1514bf-8b89-45c8-9816-7328176895fe tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] [instance: 6888c8db-82ba-4072-b431-8d4fcf5f03e0] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:46.590656 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eb1514bf-8b89-45c8-9816-7328176895fe tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:46.593669 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eb1514bf-8b89-45c8-9816-7328176895fe tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:46.598637 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eb1514bf-8b89-45c8-9816-7328176895fe tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:46.599568 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eb1514bf-8b89-45c8-9816-7328176895fe tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:46.600252 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eb1514bf-8b89-45c8-9816-7328176895fe tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:46.600854 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eb1514bf-8b89-45c8-9816-7328176895fe tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:46.900826 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-10863d9b-365b-4cdb-8f47-a1987618fc7d tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:46.916950 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-10863d9b-365b-4cdb-8f47-a1987618fc7d tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:46.918575 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-10863d9b-365b-4cdb-8f47-a1987618fc7d tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:46.921917 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-10863d9b-365b-4cdb-8f47-a1987618fc7d tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] 10.222.0.52 "GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7" status: 200 len: 1874 microversion: 2.32 time: 0.708719 Oct 19 03:21:46.937974 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1190/2343] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:21:46 2022] GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7 => generated 1874 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:21:46.959540 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7e0357c1-5339-40a9-83eb-de645ffafed6 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:46.961363 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7e0357c1-5339-40a9-83eb-de645ffafed6 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 074f3469-3bbd-46df-8286-3a57f91798e2] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:46.991365 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7e0357c1-5339-40a9-83eb-de645ffafed6 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:46.998141 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7e0357c1-5339-40a9-83eb-de645ffafed6 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:46.998647 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7e0357c1-5339-40a9-83eb-de645ffafed6 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:47.001038 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7e0357c1-5339-40a9-83eb-de645ffafed6 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:47.002120 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7e0357c1-5339-40a9-83eb-de645ffafed6 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:47.002600 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7e0357c1-5339-40a9-83eb-de645ffafed6 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:47.074129 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-eb1514bf-8b89-45c8-9816-7328176895fe tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4c5e4123c44508a5d4911a17c44231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a495ccfced47f29cb928d1ded20d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:47.085568 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-eb1514bf-8b89-45c8-9816-7328176895fe tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] 10.222.0.52 "GET /compute/v2.1/servers/6888c8db-82ba-4072-b431-8d4fcf5f03e0" status: 200 len: 1472 microversion: 2.1 time: 0.510760 Oct 19 03:21:47.087643 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1154/2344] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:21:46 2022] GET /compute/v2.1/servers/6888c8db-82ba-4072-b431-8d4fcf5f03e0 => generated 1472 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:21:47.112086 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-36c8dfe9-b5d8-4dfd-a0a0-b8078e776f59 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '.version_select at 0x7fc130c1fe50>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:47.204843 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-36c8dfe9-b5d8-4dfd-a0a0-b8078e776f59 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/images/bb3a25a0-f1e8-496e-9db8-05a27d2b182c" status: 200 len: 1409 microversion: 2.1 time: 0.091729 Oct 19 03:21:47.204843 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1155/2345] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:21:47 2022] GET /compute/v2.1/images/bb3a25a0-f1e8-496e-9db8-05a27d2b182c => generated 1409 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:21:47.227750 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9774bb34-674a-436b-a1f8-40eeba79013a tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:47.228801 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9774bb34-674a-436b-a1f8-40eeba79013a tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] [instance: 3b4bc3da-47f7-4719-817f-5636c247c87e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:47.248245 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9774bb34-674a-436b-a1f8-40eeba79013a tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:47.249360 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9774bb34-674a-436b-a1f8-40eeba79013a tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:47.250045 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9774bb34-674a-436b-a1f8-40eeba79013a tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:47.251026 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9774bb34-674a-436b-a1f8-40eeba79013a tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:47.251680 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9774bb34-674a-436b-a1f8-40eeba79013a tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:47.253356 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9774bb34-674a-436b-a1f8-40eeba79013a tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:47.739668 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9774bb34-674a-436b-a1f8-40eeba79013a tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3661010393d44c428fb37652b1717072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a1e7cceff48798bfefb9390e5979c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:47.749579 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9774bb34-674a-436b-a1f8-40eeba79013a tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] 10.222.0.52 "GET /compute/v2.1/servers/3b4bc3da-47f7-4719-817f-5636c247c87e" status: 200 len: 1316 microversion: 2.1 time: 0.526587 Oct 19 03:21:47.750178 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1156/2346] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:21:47 2022] GET /compute/v2.1/servers/3b4bc3da-47f7-4719-817f-5636c247c87e => generated 1316 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:21:47.773085 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7e0357c1-5339-40a9-83eb-de645ffafed6 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:47.791805 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7e0357c1-5339-40a9-83eb-de645ffafed6 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:47.796092 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7e0357c1-5339-40a9-83eb-de645ffafed6 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:47.798469 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7e0357c1-5339-40a9-83eb-de645ffafed6 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/074f3469-3bbd-46df-8286-3a57f91798e2" status: 200 len: 1485 microversion: 2.25 time: 0.858244 Oct 19 03:21:47.800899 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1191/2347] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:21:46 2022] GET /compute/v2.1/servers/074f3469-3bbd-46df-8286-3a57f91798e2 => generated 1485 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:21:47.953584 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ae3f2d5e-2996-413f-ae0c-c42646127b9e tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:47.954345 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ae3f2d5e-2996-413f-ae0c-c42646127b9e tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] [instance: 4adec402-e94f-4a41-ac77-68f6091b87f7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:47.974638 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ae3f2d5e-2996-413f-ae0c-c42646127b9e tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:47.978519 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ae3f2d5e-2996-413f-ae0c-c42646127b9e tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:47.979120 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ae3f2d5e-2996-413f-ae0c-c42646127b9e tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:47.981055 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ae3f2d5e-2996-413f-ae0c-c42646127b9e tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:47.982878 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ae3f2d5e-2996-413f-ae0c-c42646127b9e tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:47.984864 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ae3f2d5e-2996-413f-ae0c-c42646127b9e tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:48.025815 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-57ebc458-0218-4f3c-b0f3-2dbf8aa208c7 req-9ee2ec4e-e105-4f51-b4ae-8697c27ce138 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4adec402-e94f-4a41-ac77-68f6091b87f7", "name": "network-vif-plugged", "status": "completed", "tag": "e74674bb-2d45-441f-a59b-6f6bc5ac59f5"}, {"server_uuid": "4adec402-e94f-4a41-ac77-68f6091b87f7", "name": "network-vif-plugged", "status": "completed", "tag": "0c443dcd-8e48-4b36-9300-0450bbd1b333"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:21:48.079783 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-57ebc458-0218-4f3c-b0f3-2dbf8aa208c7 req-9ee2ec4e-e105-4f51-b4ae-8697c27ce138 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:48.081334 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-57ebc458-0218-4f3c-b0f3-2dbf8aa208c7 req-9ee2ec4e-e105-4f51-b4ae-8697c27ce138 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:48.083032 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-57ebc458-0218-4f3c-b0f3-2dbf8aa208c7 req-9ee2ec4e-e105-4f51-b4ae-8697c27ce138 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:48.124239 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-57ebc458-0218-4f3c-b0f3-2dbf8aa208c7 req-9ee2ec4e-e105-4f51-b4ae-8697c27ce138 service nova] Creating event network-vif-plugged:e74674bb-2d45-441f-a59b-6f6bc5ac59f5 for instance 4adec402-e94f-4a41-ac77-68f6091b87f7 on n-h2-861333-8 Oct 19 03:21:48.124943 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-57ebc458-0218-4f3c-b0f3-2dbf8aa208c7 req-9ee2ec4e-e105-4f51-b4ae-8697c27ce138 service nova] Creating event network-vif-plugged:0c443dcd-8e48-4b36-9300-0450bbd1b333 for instance 4adec402-e94f-4a41-ac77-68f6091b87f7 on n-h2-861333-8 Oct 19 03:21:48.139453 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-57ebc458-0218-4f3c-b0f3-2dbf8aa208c7 req-9ee2ec4e-e105-4f51-b4ae-8697c27ce138 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.114181 Oct 19 03:21:48.140403 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1192/2348] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:21:48 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:21:48.153763 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6c7d9e68-03f5-464a-b983-f4ef846b17cd tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:48.154722 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6c7d9e68-03f5-464a-b983-f4ef846b17cd tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] [instance: 6888c8db-82ba-4072-b431-8d4fcf5f03e0] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:48.167399 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6c7d9e68-03f5-464a-b983-f4ef846b17cd tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:48.168557 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6c7d9e68-03f5-464a-b983-f4ef846b17cd tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:48.169164 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6c7d9e68-03f5-464a-b983-f4ef846b17cd tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:48.170673 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6c7d9e68-03f5-464a-b983-f4ef846b17cd tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:48.171295 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6c7d9e68-03f5-464a-b983-f4ef846b17cd tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:48.171878 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6c7d9e68-03f5-464a-b983-f4ef846b17cd tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:49.305326 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-6c7d9e68-03f5-464a-b983-f4ef846b17cd tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4c5e4123c44508a5d4911a17c44231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a495ccfced47f29cb928d1ded20d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:49.318919 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6c7d9e68-03f5-464a-b983-f4ef846b17cd tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] 10.222.0.52 "GET /compute/v2.1/servers/6888c8db-82ba-4072-b431-8d4fcf5f03e0" status: 200 len: 1472 microversion: 2.1 time: 1.166927 Oct 19 03:21:49.319844 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1193/2349] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:21:48 2022] GET /compute/v2.1/servers/6888c8db-82ba-4072-b431-8d4fcf5f03e0 => generated 1472 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:21:49.339833 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1bb4f79e-e5d1-4eb5-979a-e37673388c68 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '.version_select at 0x7fc134f49ee0>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:49.386089 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ae3f2d5e-2996-413f-ae0c-c42646127b9e tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:49.403080 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ae3f2d5e-2996-413f-ae0c-c42646127b9e tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:49.420378 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ae3f2d5e-2996-413f-ae0c-c42646127b9e tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:49.428441 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ae3f2d5e-2996-413f-ae0c-c42646127b9e tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] 10.222.0.52 "GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7" status: 200 len: 1874 microversion: 2.32 time: 1.473387 Oct 19 03:21:49.428441 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1157/2350] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:21:47 2022] GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7 => generated 1874 bytes in 1475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:21:49.453166 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-85061c5a-032b-412a-8f84-2994caf7680d tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:49.460044 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-85061c5a-032b-412a-8f84-2994caf7680d tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] [instance: 3b4bc3da-47f7-4719-817f-5636c247c87e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:49.461740 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1bb4f79e-e5d1-4eb5-979a-e37673388c68 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/images/bb3a25a0-f1e8-496e-9db8-05a27d2b182c" status: 200 len: 1409 microversion: 2.1 time: 0.139130 Oct 19 03:21:49.471731 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1194/2351] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:21:49 2022] GET /compute/v2.1/images/bb3a25a0-f1e8-496e-9db8-05a27d2b182c => generated 1409 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:21:49.476686 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-85061c5a-032b-412a-8f84-2994caf7680d tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:49.483227 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b440d959-1bb1-491b-ac4c-d3ca6338d1ad tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:49.484200 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b440d959-1bb1-491b-ac4c-d3ca6338d1ad tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 074f3469-3bbd-46df-8286-3a57f91798e2] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:49.493042 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-85061c5a-032b-412a-8f84-2994caf7680d tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:49.493562 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-85061c5a-032b-412a-8f84-2994caf7680d tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:49.494162 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b440d959-1bb1-491b-ac4c-d3ca6338d1ad tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:49.494322 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-85061c5a-032b-412a-8f84-2994caf7680d tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:49.494794 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-85061c5a-032b-412a-8f84-2994caf7680d tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:49.495225 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-85061c5a-032b-412a-8f84-2994caf7680d tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:49.495468 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b440d959-1bb1-491b-ac4c-d3ca6338d1ad tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:49.496121 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b440d959-1bb1-491b-ac4c-d3ca6338d1ad tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:49.497189 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b440d959-1bb1-491b-ac4c-d3ca6338d1ad tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:49.497887 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b440d959-1bb1-491b-ac4c-d3ca6338d1ad tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:49.498530 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b440d959-1bb1-491b-ac4c-d3ca6338d1ad tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:49.899934 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b440d959-1bb1-491b-ac4c-d3ca6338d1ad tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:49.910728 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b440d959-1bb1-491b-ac4c-d3ca6338d1ad tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:49.910952 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-85061c5a-032b-412a-8f84-2994caf7680d tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3661010393d44c428fb37652b1717072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a1e7cceff48798bfefb9390e5979c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:49.922011 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-85061c5a-032b-412a-8f84-2994caf7680d tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] 10.222.0.52 "GET /compute/v2.1/servers/3b4bc3da-47f7-4719-817f-5636c247c87e" status: 200 len: 1316 microversion: 2.1 time: 0.498674 Oct 19 03:21:49.922207 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b440d959-1bb1-491b-ac4c-d3ca6338d1ad tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:49.927888 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1158/2352] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:21:49 2022] GET /compute/v2.1/servers/3b4bc3da-47f7-4719-817f-5636c247c87e => generated 1316 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:21:49.937819 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b440d959-1bb1-491b-ac4c-d3ca6338d1ad tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/074f3469-3bbd-46df-8286-3a57f91798e2" status: 200 len: 1485 microversion: 2.25 time: 0.463450 Oct 19 03:21:49.938546 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1195/2353] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:21:49 2022] GET /compute/v2.1/servers/074f3469-3bbd-46df-8286-3a57f91798e2 => generated 1485 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:21:50.217727 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-9f738838-b725-4a63-9118-301ec343d942 req-58b31389-c028-4b8e-9a1a-9dd4a709991d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4adec402-e94f-4a41-ac77-68f6091b87f7", "name": "network-vif-plugged", "status": "completed", "tag": "79d980c0-7663-46a5-9ee8-792d242f6019"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:21:50.241916 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-9f738838-b725-4a63-9118-301ec343d942 req-58b31389-c028-4b8e-9a1a-9dd4a709991d service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:50.247351 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-9f738838-b725-4a63-9118-301ec343d942 req-58b31389-c028-4b8e-9a1a-9dd4a709991d service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:50.249882 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-9f738838-b725-4a63-9118-301ec343d942 req-58b31389-c028-4b8e-9a1a-9dd4a709991d service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:50.289694 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-9f738838-b725-4a63-9118-301ec343d942 req-58b31389-c028-4b8e-9a1a-9dd4a709991d service nova] Creating event network-vif-plugged:79d980c0-7663-46a5-9ee8-792d242f6019 for instance 4adec402-e94f-4a41-ac77-68f6091b87f7 on n-h2-861333-8 Oct 19 03:21:50.306040 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-9f738838-b725-4a63-9118-301ec343d942 req-58b31389-c028-4b8e-9a1a-9dd4a709991d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091942 Oct 19 03:21:50.310593 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1159/2354] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:21:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:21:50.355222 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ecb6f5eb-cf54-4884-93ad-2163979ca3d2 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:50.358410 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ecb6f5eb-cf54-4884-93ad-2163979ca3d2 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] [instance: 6888c8db-82ba-4072-b431-8d4fcf5f03e0] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:50.371636 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ecb6f5eb-cf54-4884-93ad-2163979ca3d2 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:50.373055 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ecb6f5eb-cf54-4884-93ad-2163979ca3d2 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:50.373790 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ecb6f5eb-cf54-4884-93ad-2163979ca3d2 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:50.375035 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ecb6f5eb-cf54-4884-93ad-2163979ca3d2 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:50.375795 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ecb6f5eb-cf54-4884-93ad-2163979ca3d2 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:50.376958 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ecb6f5eb-cf54-4884-93ad-2163979ca3d2 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:50.452735 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d64f90c7-b069-4726-aa51-5f2992c9f024 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:50.453357 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d64f90c7-b069-4726-aa51-5f2992c9f024 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] [instance: 4adec402-e94f-4a41-ac77-68f6091b87f7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:50.467442 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:21:50.474317 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d64f90c7-b069-4726-aa51-5f2992c9f024 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:50.479116 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d64f90c7-b069-4726-aa51-5f2992c9f024 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:50.479116 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d64f90c7-b069-4726-aa51-5f2992c9f024 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:50.479116 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d64f90c7-b069-4726-aa51-5f2992c9f024 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:50.479116 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d64f90c7-b069-4726-aa51-5f2992c9f024 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:50.479402 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d64f90c7-b069-4726-aa51-5f2992c9f024 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:51.011486 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ecb6f5eb-cf54-4884-93ad-2163979ca3d2 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4c5e4123c44508a5d4911a17c44231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a495ccfced47f29cb928d1ded20d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:51.026255 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ecb6f5eb-cf54-4884-93ad-2163979ca3d2 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] 10.222.0.52 "GET /compute/v2.1/servers/6888c8db-82ba-4072-b431-8d4fcf5f03e0" status: 200 len: 1472 microversion: 2.1 time: 0.675637 Oct 19 03:21:51.027016 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1196/2355] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:21:50 2022] GET /compute/v2.1/servers/6888c8db-82ba-4072-b431-8d4fcf5f03e0 => generated 1472 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:21:51.056841 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-737ad165-7808-4664-9af3-89711d673501 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '.version_select at 0x7fc134f19af0>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:51.132892 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d64f90c7-b069-4726-aa51-5f2992c9f024 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:51.144015 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d64f90c7-b069-4726-aa51-5f2992c9f024 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:51.151353 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d64f90c7-b069-4726-aa51-5f2992c9f024 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:51.151353 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d64f90c7-b069-4726-aa51-5f2992c9f024 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] 10.222.0.52 "GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7" status: 200 len: 1874 microversion: 2.32 time: 0.702593 Oct 19 03:21:51.151501 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1160/2356] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:21:50 2022] GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7 => generated 1874 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:21:51.167888 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-556fe106-306f-4170-abf3-66c68021b318 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:51.168462 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-556fe106-306f-4170-abf3-66c68021b318 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] [instance: 3b4bc3da-47f7-4719-817f-5636c247c87e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:51.192210 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-556fe106-306f-4170-abf3-66c68021b318 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:51.192733 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-556fe106-306f-4170-abf3-66c68021b318 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:51.193185 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-556fe106-306f-4170-abf3-66c68021b318 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:51.193944 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-556fe106-306f-4170-abf3-66c68021b318 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:51.198786 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-556fe106-306f-4170-abf3-66c68021b318 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:51.199230 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-556fe106-306f-4170-abf3-66c68021b318 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:51.215789 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-737ad165-7808-4664-9af3-89711d673501 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/images/bb3a25a0-f1e8-496e-9db8-05a27d2b182c" status: 200 len: 1409 microversion: 2.1 time: 0.169568 Oct 19 03:21:51.221256 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1197/2357] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:21:51 2022] GET /compute/v2.1/images/bb3a25a0-f1e8-496e-9db8-05a27d2b182c => generated 1409 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:21:51.299245 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6eb48361-5ec8-44ca-90bb-4bf4b7febcf3 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:51.303470 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6eb48361-5ec8-44ca-90bb-4bf4b7febcf3 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 074f3469-3bbd-46df-8286-3a57f91798e2] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:51.321883 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6eb48361-5ec8-44ca-90bb-4bf4b7febcf3 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:51.323312 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6eb48361-5ec8-44ca-90bb-4bf4b7febcf3 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:51.324575 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6eb48361-5ec8-44ca-90bb-4bf4b7febcf3 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:51.326415 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6eb48361-5ec8-44ca-90bb-4bf4b7febcf3 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:51.327549 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6eb48361-5ec8-44ca-90bb-4bf4b7febcf3 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:51.328735 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6eb48361-5ec8-44ca-90bb-4bf4b7febcf3 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:51.692421 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-556fe106-306f-4170-abf3-66c68021b318 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3661010393d44c428fb37652b1717072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a1e7cceff48798bfefb9390e5979c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:51.739456 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-556fe106-306f-4170-abf3-66c68021b318 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] 10.222.0.52 "GET /compute/v2.1/servers/3b4bc3da-47f7-4719-817f-5636c247c87e" status: 200 len: 1316 microversion: 2.1 time: 0.575946 Oct 19 03:21:51.742110 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1161/2358] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:21:51 2022] GET /compute/v2.1/servers/3b4bc3da-47f7-4719-817f-5636c247c87e => generated 1316 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:21:51.892141 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-6eb48361-5ec8-44ca-90bb-4bf4b7febcf3 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:51.897839 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=100 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:21:51.903948 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-6eb48361-5ec8-44ca-90bb-4bf4b7febcf3 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:51.906167 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-6eb48361-5ec8-44ca-90bb-4bf4b7febcf3 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:51.908249 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6eb48361-5ec8-44ca-90bb-4bf4b7febcf3 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/074f3469-3bbd-46df-8286-3a57f91798e2" status: 200 len: 1485 microversion: 2.25 time: 0.683152 Oct 19 03:21:51.909543 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1198/2359] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:21:51 2022] GET /compute/v2.1/servers/074f3469-3bbd-46df-8286-3a57f91798e2 => generated 1485 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:21:52.061875 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-cf5806b2-7d1b-4dfc-b4f6-a7646def87ca tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:52.063662 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-cf5806b2-7d1b-4dfc-b4f6-a7646def87ca tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] [instance: 6888c8db-82ba-4072-b431-8d4fcf5f03e0] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:52.106752 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cf5806b2-7d1b-4dfc-b4f6-a7646def87ca tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:52.113345 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cf5806b2-7d1b-4dfc-b4f6-a7646def87ca tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:52.115678 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cf5806b2-7d1b-4dfc-b4f6-a7646def87ca tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:52.116562 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cf5806b2-7d1b-4dfc-b4f6-a7646def87ca tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:52.119721 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cf5806b2-7d1b-4dfc-b4f6-a7646def87ca tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:52.121104 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cf5806b2-7d1b-4dfc-b4f6-a7646def87ca tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:52.196807 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-66555dfd-8670-4f25-9785-0b35395d371b tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:52.197444 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-66555dfd-8670-4f25-9785-0b35395d371b tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] [instance: 4adec402-e94f-4a41-ac77-68f6091b87f7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:52.216339 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-66555dfd-8670-4f25-9785-0b35395d371b tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:52.216848 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-66555dfd-8670-4f25-9785-0b35395d371b tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:52.217287 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-66555dfd-8670-4f25-9785-0b35395d371b tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:52.218022 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-66555dfd-8670-4f25-9785-0b35395d371b tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:52.218473 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-66555dfd-8670-4f25-9785-0b35395d371b tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:52.228215 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-66555dfd-8670-4f25-9785-0b35395d371b tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:53.051057 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-cf5806b2-7d1b-4dfc-b4f6-a7646def87ca tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4c5e4123c44508a5d4911a17c44231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a495ccfced47f29cb928d1ded20d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:53.086454 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-cf5806b2-7d1b-4dfc-b4f6-a7646def87ca tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] 10.222.0.52 "GET /compute/v2.1/servers/6888c8db-82ba-4072-b431-8d4fcf5f03e0" status: 200 len: 1472 microversion: 2.1 time: 1.030291 Oct 19 03:21:53.088517 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1162/2360] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:21:52 2022] GET /compute/v2.1/servers/6888c8db-82ba-4072-b431-8d4fcf5f03e0 => generated 1472 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:21:53.107933 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c6e96dee-e295-4d75-bef4-4a7cf55e209c tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '.version_select at 0x7fc1304de820>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:53.134666 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-66555dfd-8670-4f25-9785-0b35395d371b tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:53.155381 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-66555dfd-8670-4f25-9785-0b35395d371b tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:53.160269 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-66555dfd-8670-4f25-9785-0b35395d371b tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:53.165801 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-66555dfd-8670-4f25-9785-0b35395d371b tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] 10.222.0.52 "GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7" status: 200 len: 1874 microversion: 2.32 time: 0.972732 Oct 19 03:21:53.167653 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1199/2361] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:21:52 2022] GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7 => generated 1874 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:21:53.176010 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-726b9957-eecd-4fef-9e50-375073b5c927 req-ae642843-697a-4017-b3dc-82595db8da94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b4bc3da-47f7-4719-817f-5636c247c87e", "name": "network-vif-plugged", "status": "completed", "tag": "895e29f8-be3d-4fe5-9b3a-5b5bfaa322fc"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:21:53.194412 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-726b9957-eecd-4fef-9e50-375073b5c927 req-ae642843-697a-4017-b3dc-82595db8da94 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:53.195145 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-726b9957-eecd-4fef-9e50-375073b5c927 req-ae642843-697a-4017-b3dc-82595db8da94 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:53.197112 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-726b9957-eecd-4fef-9e50-375073b5c927 req-ae642843-697a-4017-b3dc-82595db8da94 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:53.215012 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-726b9957-eecd-4fef-9e50-375073b5c927 req-ae642843-697a-4017-b3dc-82595db8da94 service nova] Creating event network-vif-plugged:895e29f8-be3d-4fe5-9b3a-5b5bfaa322fc for instance 3b4bc3da-47f7-4719-817f-5636c247c87e on n-h1-861333-8 Oct 19 03:21:53.221058 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-726b9957-eecd-4fef-9e50-375073b5c927 req-ae642843-697a-4017-b3dc-82595db8da94 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051676 Oct 19 03:21:53.226284 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1200/2362] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:21:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:21:53.233699 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b9769c64-2f56-4a92-9f66-1561ead45d63 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:53.235047 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b9769c64-2f56-4a92-9f66-1561ead45d63 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] [instance: 3b4bc3da-47f7-4719-817f-5636c247c87e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:53.244137 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b9769c64-2f56-4a92-9f66-1561ead45d63 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:53.245116 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b9769c64-2f56-4a92-9f66-1561ead45d63 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:53.245779 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b9769c64-2f56-4a92-9f66-1561ead45d63 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:53.249159 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b9769c64-2f56-4a92-9f66-1561ead45d63 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:53.254516 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b9769c64-2f56-4a92-9f66-1561ead45d63 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:53.254516 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b9769c64-2f56-4a92-9f66-1561ead45d63 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:53.867387 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b9769c64-2f56-4a92-9f66-1561ead45d63 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3661010393d44c428fb37652b1717072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a1e7cceff48798bfefb9390e5979c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:53.868777 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b9769c64-2f56-4a92-9f66-1561ead45d63 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] 10.222.0.52 "GET /compute/v2.1/servers/3b4bc3da-47f7-4719-817f-5636c247c87e" status: 200 len: 1316 microversion: 2.1 time: 0.641050 Oct 19 03:21:53.887158 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1201/2363] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:21:53 2022] GET /compute/v2.1/servers/3b4bc3da-47f7-4719-817f-5636c247c87e => generated 1316 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:21:53.894263 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7a7e9209-d02a-4497-b2b5-35fdfe8e91a6 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:53.895992 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7a7e9209-d02a-4497-b2b5-35fdfe8e91a6 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 074f3469-3bbd-46df-8286-3a57f91798e2] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:53.902554 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7a7e9209-d02a-4497-b2b5-35fdfe8e91a6 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:53.903259 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7a7e9209-d02a-4497-b2b5-35fdfe8e91a6 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:53.903861 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7a7e9209-d02a-4497-b2b5-35fdfe8e91a6 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:53.905411 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7a7e9209-d02a-4497-b2b5-35fdfe8e91a6 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:53.906052 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7a7e9209-d02a-4497-b2b5-35fdfe8e91a6 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:53.907076 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7a7e9209-d02a-4497-b2b5-35fdfe8e91a6 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:54.255811 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c6e96dee-e295-4d75-bef4-4a7cf55e209c tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/images/bb3a25a0-f1e8-496e-9db8-05a27d2b182c" status: 200 len: 1409 microversion: 2.1 time: 1.166169 Oct 19 03:21:54.257020 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1163/2364] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:21:53 2022] GET /compute/v2.1/images/bb3a25a0-f1e8-496e-9db8-05a27d2b182c => generated 1409 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:21:54.269995 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-226a2af4-3c30-47d9-aeef-5c764a5a44a2 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:54.271205 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-226a2af4-3c30-47d9-aeef-5c764a5a44a2 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] [instance: 6888c8db-82ba-4072-b431-8d4fcf5f03e0] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:54.280973 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-226a2af4-3c30-47d9-aeef-5c764a5a44a2 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:54.282163 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-226a2af4-3c30-47d9-aeef-5c764a5a44a2 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:54.283386 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-226a2af4-3c30-47d9-aeef-5c764a5a44a2 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:54.284380 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-226a2af4-3c30-47d9-aeef-5c764a5a44a2 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:54.285750 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-226a2af4-3c30-47d9-aeef-5c764a5a44a2 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:54.286576 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-226a2af4-3c30-47d9-aeef-5c764a5a44a2 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:55.012215 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7a7e9209-d02a-4497-b2b5-35fdfe8e91a6 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:55.021830 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7a7e9209-d02a-4497-b2b5-35fdfe8e91a6 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:55.023068 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7a7e9209-d02a-4497-b2b5-35fdfe8e91a6 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:55.025134 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7a7e9209-d02a-4497-b2b5-35fdfe8e91a6 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/074f3469-3bbd-46df-8286-3a57f91798e2" status: 200 len: 1485 microversion: 2.25 time: 1.136572 Oct 19 03:21:55.025828 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1202/2365] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:21:53 2022] GET /compute/v2.1/servers/074f3469-3bbd-46df-8286-3a57f91798e2 => generated 1485 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:21:55.034008 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-11bb1b08-12a9-455a-9375-f3fe7aab1ea2 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Calling method '.version_select at 0x7fc134f74040>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:55.100954 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-11bb1b08-12a9-455a-9375-f3fe7aab1ea2 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] 10.222.0.52 "GET /compute/v2.1/images/d9356c75-0c08-4bdf-b70b-4333c3e8f2e9" status: 200 len: 661 microversion: 2.1 time: 0.073045 Oct 19 03:21:55.105778 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1203/2366] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:21:55 2022] GET /compute/v2.1/images/d9356c75-0c08-4bdf-b70b-4333c3e8f2e9 => generated 661 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:21:55.114084 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2ec32020-f75d-4db9-8207-474ec1302a85 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:55.114084 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-2ec32020-f75d-4db9-8207-474ec1302a85 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] [instance: 4adec402-e94f-4a41-ac77-68f6091b87f7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:55.121002 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2ec32020-f75d-4db9-8207-474ec1302a85 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:55.121542 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2ec32020-f75d-4db9-8207-474ec1302a85 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:55.122084 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2ec32020-f75d-4db9-8207-474ec1302a85 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:55.122986 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2ec32020-f75d-4db9-8207-474ec1302a85 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:55.123459 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2ec32020-f75d-4db9-8207-474ec1302a85 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:55.123890 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2ec32020-f75d-4db9-8207-474ec1302a85 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:55.153001 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-226a2af4-3c30-47d9-aeef-5c764a5a44a2 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4c5e4123c44508a5d4911a17c44231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a495ccfced47f29cb928d1ded20d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:55.163200 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-226a2af4-3c30-47d9-aeef-5c764a5a44a2 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] 10.222.0.52 "GET /compute/v2.1/servers/6888c8db-82ba-4072-b431-8d4fcf5f03e0" status: 200 len: 1472 microversion: 2.1 time: 0.904953 Oct 19 03:21:55.164090 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1164/2367] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:21:54 2022] GET /compute/v2.1/servers/6888c8db-82ba-4072-b431-8d4fcf5f03e0 => generated 1472 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:21:55.169240 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9a69bf9c-5696-44b1-8f39-9f9c077f4ae6 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:55.170139 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9a69bf9c-5696-44b1-8f39-9f9c077f4ae6 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] [instance: 3b4bc3da-47f7-4719-817f-5636c247c87e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:55.178456 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9a69bf9c-5696-44b1-8f39-9f9c077f4ae6 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:55.179213 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9a69bf9c-5696-44b1-8f39-9f9c077f4ae6 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:55.179871 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9a69bf9c-5696-44b1-8f39-9f9c077f4ae6 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:55.181528 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9a69bf9c-5696-44b1-8f39-9f9c077f4ae6 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:55.182212 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9a69bf9c-5696-44b1-8f39-9f9c077f4ae6 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:55.183094 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9a69bf9c-5696-44b1-8f39-9f9c077f4ae6 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:55.615617 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-2ec32020-f75d-4db9-8207-474ec1302a85 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:55.619519 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9a69bf9c-5696-44b1-8f39-9f9c077f4ae6 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3661010393d44c428fb37652b1717072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a1e7cceff48798bfefb9390e5979c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:55.641557 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9a69bf9c-5696-44b1-8f39-9f9c077f4ae6 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] 10.222.0.52 "GET /compute/v2.1/servers/3b4bc3da-47f7-4719-817f-5636c247c87e" status: 200 len: 1316 microversion: 2.1 time: 0.475750 Oct 19 03:21:55.662073 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1165/2368] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:21:55 2022] GET /compute/v2.1/servers/3b4bc3da-47f7-4719-817f-5636c247c87e => generated 1316 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:21:55.662858 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-2ec32020-f75d-4db9-8207-474ec1302a85 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:55.668475 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-2ec32020-f75d-4db9-8207-474ec1302a85 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:55.669874 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2ec32020-f75d-4db9-8207-474ec1302a85 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] 10.222.0.52 "GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7" status: 200 len: 2827 microversion: 2.32 time: 0.561383 Oct 19 03:21:55.683096 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-16643993-41b5-4cc6-872e-203dbff92fb4 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Calling method '.version_select at 0x7fc130cbe550>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:55.696447 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1204/2369] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:21:55 2022] GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7 => generated 2827 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:21:55.705701 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4d40d9c7-8d59-499b-ae08-c15aaf572762 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '.version_select at 0x7fc135083820>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:55.808245 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-16643993-41b5-4cc6-872e-203dbff92fb4 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] 10.222.0.52 "GET /compute/v2.1/images/d9356c75-0c08-4bdf-b70b-4333c3e8f2e9" status: 200 len: 661 microversion: 2.1 time: 0.144337 Oct 19 03:21:55.815416 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1166/2370] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:21:55 2022] GET /compute/v2.1/images/d9356c75-0c08-4bdf-b70b-4333c3e8f2e9 => generated 661 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:21:55.824223 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-53f5f8b5-2304-4406-b14e-66d17ed34416 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:55.830134 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-53f5f8b5-2304-4406-b14e-66d17ed34416 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] [instance: 4adec402-e94f-4a41-ac77-68f6091b87f7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:55.841142 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4d40d9c7-8d59-499b-ae08-c15aaf572762 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/images/bb3a25a0-f1e8-496e-9db8-05a27d2b182c" status: 200 len: 1409 microversion: 2.1 time: 0.143497 Oct 19 03:21:55.841889 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1205/2371] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:21:55 2022] GET /compute/v2.1/images/bb3a25a0-f1e8-496e-9db8-05a27d2b182c => generated 1409 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:21:55.857584 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-53f5f8b5-2304-4406-b14e-66d17ed34416 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:55.858392 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-53f5f8b5-2304-4406-b14e-66d17ed34416 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:55.858841 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-53f5f8b5-2304-4406-b14e-66d17ed34416 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:55.859555 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-53f5f8b5-2304-4406-b14e-66d17ed34416 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:55.860009 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-53f5f8b5-2304-4406-b14e-66d17ed34416 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:55.860961 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-53f5f8b5-2304-4406-b14e-66d17ed34416 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:56.061064 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7624c680-65c3-47da-807a-7f6a0d694449 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:56.062503 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7624c680-65c3-47da-807a-7f6a0d694449 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 074f3469-3bbd-46df-8286-3a57f91798e2] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:56.084177 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7624c680-65c3-47da-807a-7f6a0d694449 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:56.086873 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7624c680-65c3-47da-807a-7f6a0d694449 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:56.087334 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7624c680-65c3-47da-807a-7f6a0d694449 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:56.088076 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7624c680-65c3-47da-807a-7f6a0d694449 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:56.091349 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7624c680-65c3-47da-807a-7f6a0d694449 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:56.092080 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7624c680-65c3-47da-807a-7f6a0d694449 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:56.368840 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-53f5f8b5-2304-4406-b14e-66d17ed34416 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] 10.222.0.52 "GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7/os-interface" status: 200 len: 1830 microversion: 2.32 time: 0.548963 Oct 19 03:21:56.369480 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1167/2372] 10.222.0.52 () {60 vars in 1316 bytes} [Wed Oct 19 03:21:55 2022] GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7/os-interface => generated 1830 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:21:56.399384 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b9ea028b-b839-4939-b584-25200588cc17 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:56.403885 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b9ea028b-b839-4939-b584-25200588cc17 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] [instance: 6888c8db-82ba-4072-b431-8d4fcf5f03e0] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:56.420904 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b9ea028b-b839-4939-b584-25200588cc17 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:56.421431 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b9ea028b-b839-4939-b584-25200588cc17 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:56.421876 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b9ea028b-b839-4939-b584-25200588cc17 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:56.422598 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b9ea028b-b839-4939-b584-25200588cc17 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:56.427563 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b9ea028b-b839-4939-b584-25200588cc17 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:56.428122 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b9ea028b-b839-4939-b584-25200588cc17 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:57.573350 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7624c680-65c3-47da-807a-7f6a0d694449 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:57.590879 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7624c680-65c3-47da-807a-7f6a0d694449 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:57.595920 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7624c680-65c3-47da-807a-7f6a0d694449 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:57.600697 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b9ea028b-b839-4939-b584-25200588cc17 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4c5e4123c44508a5d4911a17c44231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a495ccfced47f29cb928d1ded20d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:57.612603 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b9ea028b-b839-4939-b584-25200588cc17 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] 10.222.0.52 "GET /compute/v2.1/servers/6888c8db-82ba-4072-b431-8d4fcf5f03e0" status: 200 len: 1472 microversion: 2.1 time: 1.229329 Oct 19 03:21:57.613202 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1168/2373] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:21:56 2022] GET /compute/v2.1/servers/6888c8db-82ba-4072-b431-8d4fcf5f03e0 => generated 1472 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:21:57.614486 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7624c680-65c3-47da-807a-7f6a0d694449 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/074f3469-3bbd-46df-8286-3a57f91798e2" status: 200 len: 1485 microversion: 2.25 time: 1.562731 Oct 19 03:21:57.615076 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1206/2374] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:21:56 2022] GET /compute/v2.1/servers/074f3469-3bbd-46df-8286-3a57f91798e2 => generated 1485 bytes in 1564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:21:57.633419 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ab825f34-9e4b-4151-9b43-8808328b8e4b tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:57.634010 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ab825f34-9e4b-4151-9b43-8808328b8e4b tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] [instance: 3b4bc3da-47f7-4719-817f-5636c247c87e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:57.637897 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-fa8cf24a-1089-498f-af9f-d9332eaf03a0 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '.version_select at 0x7fc134f86dc0>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:57.649885 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ab825f34-9e4b-4151-9b43-8808328b8e4b tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:57.652061 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ab825f34-9e4b-4151-9b43-8808328b8e4b tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:57.652779 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ab825f34-9e4b-4151-9b43-8808328b8e4b tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:57.653536 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ab825f34-9e4b-4151-9b43-8808328b8e4b tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:57.654054 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ab825f34-9e4b-4151-9b43-8808328b8e4b tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:57.654610 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ab825f34-9e4b-4151-9b43-8808328b8e4b tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:57.977777 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ab825f34-9e4b-4151-9b43-8808328b8e4b tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3661010393d44c428fb37652b1717072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a1e7cceff48798bfefb9390e5979c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:58.020869 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ab825f34-9e4b-4151-9b43-8808328b8e4b tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] 10.222.0.52 "GET /compute/v2.1/servers/3b4bc3da-47f7-4719-817f-5636c247c87e" status: 200 len: 1504 microversion: 2.1 time: 0.395547 Oct 19 03:21:58.021543 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1169/2375] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:21:57 2022] GET /compute/v2.1/servers/3b4bc3da-47f7-4719-817f-5636c247c87e => generated 1504 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:21:58.047112 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6f1d7212-0a6e-4acf-8226-ce81f8b0252f tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1078478032"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:21:58.048408 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6f1d7212-0a6e-4acf-8226-ce81f8b0252f tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] [instance: 3b4bc3da-47f7-4719-817f-5636c247c87e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:58.067424 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6f1d7212-0a6e-4acf-8226-ce81f8b0252f tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:58.073141 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6f1d7212-0a6e-4acf-8226-ce81f8b0252f tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:58.073828 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6f1d7212-0a6e-4acf-8226-ce81f8b0252f tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:58.076766 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6f1d7212-0a6e-4acf-8226-ce81f8b0252f tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:58.077427 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6f1d7212-0a6e-4acf-8226-ce81f8b0252f tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:58.078570 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6f1d7212-0a6e-4acf-8226-ce81f8b0252f tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:58.280210 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-fa8cf24a-1089-498f-af9f-d9332eaf03a0 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/images/bb3a25a0-f1e8-496e-9db8-05a27d2b182c" status: 200 len: 1409 microversion: 2.1 time: 0.662841 Oct 19 03:21:58.284320 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1207/2376] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:21:57 2022] GET /compute/v2.1/images/bb3a25a0-f1e8-496e-9db8-05a27d2b182c => generated 1409 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:21:58.302731 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-84d3e823-03b7-479f-a877-474ec2741bc8 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Calling method '.version_select at 0x7fc134f43e50>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:58.431357 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-84d3e823-03b7-479f-a877-474ec2741bc8 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] 10.222.0.52 "GET /compute/v2.1/images/0d6ac048-4f2a-4e56-8b9e-3cbbea8bcfd5" status: 200 len: 662 microversion: 2.1 time: 0.145820 Oct 19 03:21:58.431877 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1208/2377] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:21:58 2022] GET /compute/v2.1/images/0d6ac048-4f2a-4e56-8b9e-3cbbea8bcfd5 => generated 662 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:21:58.449786 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5eab6047-0b59-4b60-9394-9959ea3abd9d tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Calling method '.version_select at 0x7fc134f86670>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:58.537357 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5eab6047-0b59-4b60-9394-9959ea3abd9d tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] 10.222.0.52 "GET /compute/v2.1/images/0d6ac048-4f2a-4e56-8b9e-3cbbea8bcfd5" status: 200 len: 662 microversion: 2.1 time: 0.093798 Oct 19 03:21:58.551163 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1209/2378] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:21:58 2022] GET /compute/v2.1/images/0d6ac048-4f2a-4e56-8b9e-3cbbea8bcfd5 => generated 662 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:21:58.644506 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-749ab5b6-eba6-426e-8e2b-316ec131f95e tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:58.645142 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-749ab5b6-eba6-426e-8e2b-316ec131f95e tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] [instance: 6888c8db-82ba-4072-b431-8d4fcf5f03e0] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:58.660377 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.network.security_group_api [None req-6f1d7212-0a6e-4acf-8226-ce81f8b0252f tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Adding security group 627fdd43-93ea-4c4f-b36a-2438f9898580 to port 895e29f8-be3d-4fe5-9b3a-5b5bfaa322fc Oct 19 03:21:58.665256 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-749ab5b6-eba6-426e-8e2b-316ec131f95e tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:58.667843 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-749ab5b6-eba6-426e-8e2b-316ec131f95e tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:58.668320 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-749ab5b6-eba6-426e-8e2b-316ec131f95e tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:58.673769 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-749ab5b6-eba6-426e-8e2b-316ec131f95e tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:58.673769 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-749ab5b6-eba6-426e-8e2b-316ec131f95e tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:58.674004 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-749ab5b6-eba6-426e-8e2b-316ec131f95e tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:59.692884 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-749ab5b6-eba6-426e-8e2b-316ec131f95e tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4c5e4123c44508a5d4911a17c44231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a495ccfced47f29cb928d1ded20d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:21:59.712158 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-749ab5b6-eba6-426e-8e2b-316ec131f95e tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] 10.222.0.52 "GET /compute/v2.1/servers/6888c8db-82ba-4072-b431-8d4fcf5f03e0" status: 200 len: 1472 microversion: 2.1 time: 1.079846 Oct 19 03:21:59.713033 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1210/2379] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:21:58 2022] GET /compute/v2.1/servers/6888c8db-82ba-4072-b431-8d4fcf5f03e0 => generated 1472 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:21:59.731900 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6a46d194-a9d1-4230-a882-70737da7c1a5 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:21:59.732756 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6a46d194-a9d1-4230-a882-70737da7c1a5 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 074f3469-3bbd-46df-8286-3a57f91798e2] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:21:59.743705 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6a46d194-a9d1-4230-a882-70737da7c1a5 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:59.744452 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6a46d194-a9d1-4230-a882-70737da7c1a5 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:59.745077 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6a46d194-a9d1-4230-a882-70737da7c1a5 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:21:59.745971 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6a46d194-a9d1-4230-a882-70737da7c1a5 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:21:59.750148 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6a46d194-a9d1-4230-a882-70737da7c1a5 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:21:59.750869 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6a46d194-a9d1-4230-a882-70737da7c1a5 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:00.244104 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-6a46d194-a9d1-4230-a882-70737da7c1a5 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:00.260975 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-6a46d194-a9d1-4230-a882-70737da7c1a5 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:00.262707 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-6a46d194-a9d1-4230-a882-70737da7c1a5 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:00.267587 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6a46d194-a9d1-4230-a882-70737da7c1a5 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/074f3469-3bbd-46df-8286-3a57f91798e2" status: 200 len: 1475 microversion: 2.25 time: 0.549763 Oct 19 03:22:00.281833 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1211/2380] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:21:59 2022] GET /compute/v2.1/servers/074f3469-3bbd-46df-8286-3a57f91798e2 => generated 1475 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:22:00.304971 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-09069648-b8df-46a8-a3cc-00bca3d27976 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '.version_select at 0x7fc1305d5a60>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:00.972484 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6f1d7212-0a6e-4acf-8226-ce81f8b0252f tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] 10.222.0.52 "POST /compute/v2.1/servers/3b4bc3da-47f7-4719-817f-5636c247c87e/action" status: 202 len: 0 microversion: 2.1 time: 2.930152 Oct 19 03:22:00.974590 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1170/2381] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:21:58 2022] POST /compute/v2.1/servers/3b4bc3da-47f7-4719-817f-5636c247c87e/action => generated 0 bytes in 2933 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:22:00.979904 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-41784a2e-d2f5-4393-b74c-63e5d067bbde tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Calling method '.version_select at 0x7fc13043f670>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:00.988624 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-41784a2e-d2f5-4393-b74c-63e5d067bbde tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:00.990192 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-41784a2e-d2f5-4393-b74c-63e5d067bbde tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:00.992483 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-41784a2e-d2f5-4393-b74c-63e5d067bbde tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:01.033553 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-09069648-b8df-46a8-a3cc-00bca3d27976 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/images/bb3a25a0-f1e8-496e-9db8-05a27d2b182c" status: 200 len: 1409 microversion: 2.1 time: 0.740255 Oct 19 03:22:01.037122 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1212/2382] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:22:00 2022] GET /compute/v2.1/images/bb3a25a0-f1e8-496e-9db8-05a27d2b182c => generated 1409 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:22:01.045913 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-41784a2e-d2f5-4393-b74c-63e5d067bbde tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] 10.222.0.52 "GET /compute/v2.1/os-migrations" status: 200 len: 1696 microversion: 2.25 time: 0.069585 Oct 19 03:22:01.046795 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1171/2383] 10.222.0.52 () {60 vars in 1184 bytes} [Wed Oct 19 03:22:00 2022] GET /compute/v2.1/os-migrations => generated 1696 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:22:01.052521 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-61f80b11-3465-4ed7-8634-81ecf3c98899 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:01.055618 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-ab9b0f38-0a64-4131-a30f-2345e087a2cb req-e9334e56-c8b6-4c46-9441-61cbdda2d895 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4adec402-e94f-4a41-ac77-68f6091b87f7", "tag": "e74674bb-2d45-441f-a59b-6f6bc5ac59f5"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:22:01.055752 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-61f80b11-3465-4ed7-8634-81ecf3c98899 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] [instance: 6888c8db-82ba-4072-b431-8d4fcf5f03e0] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:01.074218 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-61f80b11-3465-4ed7-8634-81ecf3c98899 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:01.074218 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-61f80b11-3465-4ed7-8634-81ecf3c98899 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:01.074218 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-61f80b11-3465-4ed7-8634-81ecf3c98899 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:01.074218 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-61f80b11-3465-4ed7-8634-81ecf3c98899 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:01.074924 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-61f80b11-3465-4ed7-8634-81ecf3c98899 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:01.077070 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-61f80b11-3465-4ed7-8634-81ecf3c98899 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:01.093463 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-ab9b0f38-0a64-4131-a30f-2345e087a2cb req-e9334e56-c8b6-4c46-9441-61cbdda2d895 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:01.095157 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-ab9b0f38-0a64-4131-a30f-2345e087a2cb req-e9334e56-c8b6-4c46-9441-61cbdda2d895 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:01.095994 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-ab9b0f38-0a64-4131-a30f-2345e087a2cb req-e9334e56-c8b6-4c46-9441-61cbdda2d895 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:01.131592 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-ab9b0f38-0a64-4131-a30f-2345e087a2cb req-e9334e56-c8b6-4c46-9441-61cbdda2d895 service nova] Creating event network-changed:e74674bb-2d45-441f-a59b-6f6bc5ac59f5 for instance 4adec402-e94f-4a41-ac77-68f6091b87f7 on n-h2-861333-8 Oct 19 03:22:01.148464 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-ab9b0f38-0a64-4131-a30f-2345e087a2cb req-e9334e56-c8b6-4c46-9441-61cbdda2d895 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109812 Oct 19 03:22:01.150081 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1213/2384] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:22:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:22:01.163132 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-12262e85-8537-44ab-891b-73091feaa07c tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Calling method '.version_select at 0x7fc134f74790>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:01.248486 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-12262e85-8537-44ab-891b-73091feaa07c tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] 10.222.0.52 "GET /compute/v2.1/images/e442c226-6899-45f7-8b16-e84f6316a9e3" status: 200 len: 662 microversion: 2.1 time: 0.096879 Oct 19 03:22:01.249083 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1214/2385] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:22:01 2022] GET /compute/v2.1/images/e442c226-6899-45f7-8b16-e84f6316a9e3 => generated 662 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:22:01.263483 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ae5d2580-9776-4507-910e-5eaa9b898b6a tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1215036726"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:22:01.264168 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ae5d2580-9776-4507-910e-5eaa9b898b6a tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] [instance: 3b4bc3da-47f7-4719-817f-5636c247c87e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:01.301967 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ae5d2580-9776-4507-910e-5eaa9b898b6a tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:01.305579 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ae5d2580-9776-4507-910e-5eaa9b898b6a tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:01.306092 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ae5d2580-9776-4507-910e-5eaa9b898b6a tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:01.309786 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ae5d2580-9776-4507-910e-5eaa9b898b6a tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:01.311304 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ae5d2580-9776-4507-910e-5eaa9b898b6a tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:01.312283 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ae5d2580-9776-4507-910e-5eaa9b898b6a tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:01.798454 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.network.security_group_api [None req-ae5d2580-9776-4507-910e-5eaa9b898b6a tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Adding security group 99302a35-1b72-4bc5-a436-844764955de8 to port 895e29f8-be3d-4fe5-9b3a-5b5bfaa322fc Oct 19 03:22:02.063864 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-61f80b11-3465-4ed7-8634-81ecf3c98899 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4c5e4123c44508a5d4911a17c44231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a495ccfced47f29cb928d1ded20d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:02.077263 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-61f80b11-3465-4ed7-8634-81ecf3c98899 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] 10.222.0.52 "GET /compute/v2.1/servers/6888c8db-82ba-4072-b431-8d4fcf5f03e0" status: 200 len: 1478 microversion: 2.1 time: 1.028437 Oct 19 03:22:02.080516 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1172/2386] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:22:01 2022] GET /compute/v2.1/servers/6888c8db-82ba-4072-b431-8d4fcf5f03e0 => generated 1478 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:22:02.094611 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5e4e1b31-14bc-4956-a01e-309dd32eaa05 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:02.095268 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5e4e1b31-14bc-4956-a01e-309dd32eaa05 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] [instance: 074f3469-3bbd-46df-8286-3a57f91798e2] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:02.121732 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5e4e1b31-14bc-4956-a01e-309dd32eaa05 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:02.122366 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5e4e1b31-14bc-4956-a01e-309dd32eaa05 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:02.122917 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5e4e1b31-14bc-4956-a01e-309dd32eaa05 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:02.125334 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5e4e1b31-14bc-4956-a01e-309dd32eaa05 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:02.128749 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5e4e1b31-14bc-4956-a01e-309dd32eaa05 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:02.129297 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5e4e1b31-14bc-4956-a01e-309dd32eaa05 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:02.605224 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-5e4e1b31-14bc-4956-a01e-309dd32eaa05 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] Lazy-loading 'services' on Instance uuid 074f3469-3bbd-46df-8286-3a57f91798e2 {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:22:02.673746 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5e4e1b31-14bc-4956-a01e-309dd32eaa05 tempest-LiveAutoBlockMigrationV225Test-522755543 tempest-LiveAutoBlockMigrationV225Test-522755543-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/074f3469-3bbd-46df-8286-3a57f91798e2" status: 200 len: 1967 microversion: 2.25 time: 0.579747 Oct 19 03:22:02.680135 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1173/2387] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:22:02 2022] GET /compute/v2.1/servers/074f3469-3bbd-46df-8286-3a57f91798e2 => generated 1967 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:22:02.714592 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b29c316f-0c93-4b1d-a791-5459afa5b5a9 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Calling method '.version_select at 0x7fc130c18af0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:02.786530 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b29c316f-0c93-4b1d-a791-5459afa5b5a9 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] 10.222.0.52 "GET /compute/v2.1/images/e442c226-6899-45f7-8b16-e84f6316a9e3" status: 200 len: 662 microversion: 2.1 time: 0.104754 Oct 19 03:22:02.787145 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1174/2388] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:22:02 2022] GET /compute/v2.1/images/e442c226-6899-45f7-8b16-e84f6316a9e3 => generated 662 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:22:02.800019 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-fc668824-c1da-42d6-871a-5f1d4be24fef tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '.version_select at 0x7fc1304de9d0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:02.897146 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-fc668824-c1da-42d6-871a-5f1d4be24fef tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/images/bb3a25a0-f1e8-496e-9db8-05a27d2b182c" status: 200 len: 1409 microversion: 2.1 time: 0.102065 Oct 19 03:22:02.897667 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1175/2389] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:22:02 2022] GET /compute/v2.1/images/bb3a25a0-f1e8-496e-9db8-05a27d2b182c => generated 1409 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:22:02.907573 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8beac729-a259-44d1-95d2-af3c78218455 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:02.908096 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8beac729-a259-44d1-95d2-af3c78218455 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 074f3469-3bbd-46df-8286-3a57f91798e2] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:02.923868 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8beac729-a259-44d1-95d2-af3c78218455 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:02.925039 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8beac729-a259-44d1-95d2-af3c78218455 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:02.926798 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8beac729-a259-44d1-95d2-af3c78218455 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:02.928917 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8beac729-a259-44d1-95d2-af3c78218455 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:02.930802 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8beac729-a259-44d1-95d2-af3c78218455 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:02.931302 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8beac729-a259-44d1-95d2-af3c78218455 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:03.065643 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8beac729-a259-44d1-95d2-af3c78218455 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 074f3469-3bbd-46df-8286-3a57f91798e2] Going to try to terminate instance {{(pid=121134) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:22:03.065643 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=100 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:22:03.214864 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ae5d2580-9776-4507-910e-5eaa9b898b6a tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] 10.222.0.52 "POST /compute/v2.1/servers/3b4bc3da-47f7-4719-817f-5636c247c87e/action" status: 202 len: 0 microversion: 2.1 time: 1.953995 Oct 19 03:22:03.216792 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1215/2390] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:22:01 2022] POST /compute/v2.1/servers/3b4bc3da-47f7-4719-817f-5636c247c87e/action => generated 0 bytes in 1967 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:22:03.228157 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c19dc479-5f49-40fd-b64c-fc2778264373 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1127000544", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:22:03.341971 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.network.neutron [None req-c19dc479-5f49-40fd-b64c-fc2778264373 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] validate_networks() for None {{(pid=121135) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:22:03.735812 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-c19dc479-5f49-40fd-b64c-fc2778264373 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Flavor limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:22:03.736266 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-c19dc479-5f49-40fd-b64c-fc2778264373 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Image limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:22:03.736713 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-c19dc479-5f49-40fd-b64c-fc2778264373 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Flavor pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:22:03.737126 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-c19dc479-5f49-40fd-b64c-fc2778264373 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Image pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:22:03.737640 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-c19dc479-5f49-40fd-b64c-fc2778264373 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:22:03.748664 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c19dc479-5f49-40fd-b64c-fc2778264373 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:03.749141 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c19dc479-5f49-40fd-b64c-fc2778264373 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:03.749805 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c19dc479-5f49-40fd-b64c-fc2778264373 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:03.750739 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c19dc479-5f49-40fd-b64c-fc2778264373 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:03.751423 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c19dc479-5f49-40fd-b64c-fc2778264373 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:03.751851 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c19dc479-5f49-40fd-b64c-fc2778264373 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:03.771650 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-c19dc479-5f49-40fd-b64c-fc2778264373 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Getting quotas for project a146393855c047be83270e5334c68e45. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:22:03.777661 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-c19dc479-5f49-40fd-b64c-fc2778264373 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Getting quotas for user 97a222bb0f9a4c728d2ed5ca011c032d and project a146393855c047be83270e5334c68e45. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:22:03.781783 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:22:03.800671 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c19dc479-5f49-40fd-b64c-fc2778264373 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Going to run 1 instances... {{(pid=121135) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:22:03.800671 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c19dc479-5f49-40fd-b64c-fc2778264373 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] [instance: 410116db-4d00-4a9d-8375-a5cea6a0d627] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121135) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:22:03.857300 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8beac729-a259-44d1-95d2-af3c78218455 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "DELETE /compute/v2.1/servers/074f3469-3bbd-46df-8286-3a57f91798e2" status: 204 len: 0 microversion: 2.25 time: 0.958306 Oct 19 03:22:03.861502 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1176/2391] 10.222.0.52 () {60 vars in 1280 bytes} [Wed Oct 19 03:22:02 2022] DELETE /compute/v2.1/servers/074f3469-3bbd-46df-8286-3a57f91798e2 => generated 0 bytes in 963 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 19 03:22:03.870043 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0a193598-615e-4a8a-a5ec-d4a3929ea7db tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:03.875245 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0a193598-615e-4a8a-a5ec-d4a3929ea7db tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] [instance: 6888c8db-82ba-4072-b431-8d4fcf5f03e0] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:03.879423 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0a193598-615e-4a8a-a5ec-d4a3929ea7db tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:03.880302 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0a193598-615e-4a8a-a5ec-d4a3929ea7db tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:03.880873 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0a193598-615e-4a8a-a5ec-d4a3929ea7db tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:03.881804 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0a193598-615e-4a8a-a5ec-d4a3929ea7db tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:03.882396 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0a193598-615e-4a8a-a5ec-d4a3929ea7db tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:03.882932 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0a193598-615e-4a8a-a5ec-d4a3929ea7db tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:03.993154 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c19dc479-5f49-40fd-b64c-fc2778264373 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.771213 Oct 19 03:22:04.007386 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1216/2392] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:22:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 786 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 03:22:04.249237 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0a193598-615e-4a8a-a5ec-d4a3929ea7db tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4c5e4123c44508a5d4911a17c44231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a495ccfced47f29cb928d1ded20d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:04.261032 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0a193598-615e-4a8a-a5ec-d4a3929ea7db tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] 10.222.0.52 "GET /compute/v2.1/servers/6888c8db-82ba-4072-b431-8d4fcf5f03e0" status: 200 len: 1478 microversion: 2.1 time: 0.397576 Oct 19 03:22:04.264903 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1177/2393] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:22:03 2022] GET /compute/v2.1/servers/6888c8db-82ba-4072-b431-8d4fcf5f03e0 => generated 1478 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:22:04.269833 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-3a274ab8-477f-4b26-bca7-dea7d10ea2e3 req-dbd35f0e-b11d-414d-93b2-b0201cd42f85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b4bc3da-47f7-4719-817f-5636c247c87e", "tag": "895e29f8-be3d-4fe5-9b3a-5b5bfaa322fc"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:22:04.283325 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-3a274ab8-477f-4b26-bca7-dea7d10ea2e3 req-dbd35f0e-b11d-414d-93b2-b0201cd42f85 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:04.287969 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-3a274ab8-477f-4b26-bca7-dea7d10ea2e3 req-dbd35f0e-b11d-414d-93b2-b0201cd42f85 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:04.287969 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-3a274ab8-477f-4b26-bca7-dea7d10ea2e3 req-dbd35f0e-b11d-414d-93b2-b0201cd42f85 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:04.299531 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-3a274ab8-477f-4b26-bca7-dea7d10ea2e3 req-dbd35f0e-b11d-414d-93b2-b0201cd42f85 service nova] Creating event network-changed:895e29f8-be3d-4fe5-9b3a-5b5bfaa322fc for instance 3b4bc3da-47f7-4719-817f-5636c247c87e on n-h1-861333-8 Oct 19 03:22:04.305705 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-3a274ab8-477f-4b26-bca7-dea7d10ea2e3 req-dbd35f0e-b11d-414d-93b2-b0201cd42f85 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042084 Oct 19 03:22:04.317474 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1178/2394] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:22:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:22:04.339428 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e9985a4a-cff5-4bc4-99a4-333ccf81c502 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:04.339428 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e9985a4a-cff5-4bc4-99a4-333ccf81c502 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] [instance: 3b4bc3da-47f7-4719-817f-5636c247c87e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:04.339428 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e9985a4a-cff5-4bc4-99a4-333ccf81c502 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:04.339428 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e9985a4a-cff5-4bc4-99a4-333ccf81c502 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:04.340400 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e9985a4a-cff5-4bc4-99a4-333ccf81c502 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:04.340400 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e9985a4a-cff5-4bc4-99a4-333ccf81c502 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:04.340400 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e9985a4a-cff5-4bc4-99a4-333ccf81c502 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:04.340400 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e9985a4a-cff5-4bc4-99a4-333ccf81c502 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:04.471593 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-02cdfe37-4df2-487c-a36a-66cf6b59f45a tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-1191276496", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "networks": [{"uuid": "46ac208f-3db3-4d48-8b9e-831fb738a73c"}]}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:22:04.646027 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.network.neutron [None req-02cdfe37-4df2-487c-a36a-66cf6b59f45a tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] validate_networks() for [('46ac208f-3db3-4d48-8b9e-831fb738a73c', None, None, None, None, None)] {{(pid=121135) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:22:05.910534 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e9985a4a-cff5-4bc4-99a4-333ccf81c502 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] 10.222.0.52 "GET /compute/v2.1/servers/3b4bc3da-47f7-4719-817f-5636c247c87e/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 1.590794 Oct 19 03:22:05.912019 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1179/2395] 10.222.0.52 () {58 vars in 1293 bytes} [Wed Oct 19 03:22:04 2022] GET /compute/v2.1/servers/3b4bc3da-47f7-4719-817f-5636c247c87e/os-security-groups => generated 1158 bytes in 1593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:22:05.918490 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b22d35ec-9641-4b70-a9bc-8d53d69c156a tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:05.919399 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b22d35ec-9641-4b70-a9bc-8d53d69c156a tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 074f3469-3bbd-46df-8286-3a57f91798e2] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:05.936459 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b22d35ec-9641-4b70-a9bc-8d53d69c156a tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:05.936960 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b22d35ec-9641-4b70-a9bc-8d53d69c156a tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:05.941546 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b22d35ec-9641-4b70-a9bc-8d53d69c156a tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:05.943066 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b22d35ec-9641-4b70-a9bc-8d53d69c156a tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:05.943711 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b22d35ec-9641-4b70-a9bc-8d53d69c156a tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:05.945475 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b22d35ec-9641-4b70-a9bc-8d53d69c156a tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:06.903588 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b22d35ec-9641-4b70-a9bc-8d53d69c156a tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:06.916384 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b22d35ec-9641-4b70-a9bc-8d53d69c156a tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:06.918658 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b22d35ec-9641-4b70-a9bc-8d53d69c156a tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:06.922433 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b22d35ec-9641-4b70-a9bc-8d53d69c156a tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/074f3469-3bbd-46df-8286-3a57f91798e2" status: 200 len: 1481 microversion: 2.25 time: 1.009164 Oct 19 03:22:06.924748 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1180/2396] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:22:05 2022] GET /compute/v2.1/servers/074f3469-3bbd-46df-8286-3a57f91798e2 => generated 1481 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:22:06.937252 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-cb2ccdd1-e740-42c5-9618-378a8036ff15 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '.version_select at 0x7fc130b69a60>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:07.062975 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-cb2ccdd1-e740-42c5-9618-378a8036ff15 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/images/bb3a25a0-f1e8-496e-9db8-05a27d2b182c" status: 200 len: 1409 microversion: 2.1 time: 0.137145 Oct 19 03:22:07.065769 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1181/2397] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:22:06 2022] GET /compute/v2.1/images/bb3a25a0-f1e8-496e-9db8-05a27d2b182c => generated 1409 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:22:07.081047 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-826960eb-69c0-482a-bd7d-05eeb0254af1 req-6313f996-d6c6-4f27-91fd-263dce4a634c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6888c8db-82ba-4072-b431-8d4fcf5f03e0", "name": "network-vif-unplugged", "status": "completed", "tag": "7d06606b-5258-42bd-89b9-3f972fa9dcda"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:22:07.162065 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-826960eb-69c0-482a-bd7d-05eeb0254af1 req-6313f996-d6c6-4f27-91fd-263dce4a634c service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:07.175465 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-826960eb-69c0-482a-bd7d-05eeb0254af1 req-6313f996-d6c6-4f27-91fd-263dce4a634c service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:07.177809 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-826960eb-69c0-482a-bd7d-05eeb0254af1 req-6313f996-d6c6-4f27-91fd-263dce4a634c service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:07.240597 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-826960eb-69c0-482a-bd7d-05eeb0254af1 req-6313f996-d6c6-4f27-91fd-263dce4a634c service nova] Creating event network-vif-unplugged:7d06606b-5258-42bd-89b9-3f972fa9dcda for instance 6888c8db-82ba-4072-b431-8d4fcf5f03e0 on n-h1-861333-8 Oct 19 03:22:07.255080 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-826960eb-69c0-482a-bd7d-05eeb0254af1 req-6313f996-d6c6-4f27-91fd-263dce4a634c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.186786 Oct 19 03:22:07.255659 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1182/2398] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:22:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:22:07.274906 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8928190d-1fa0-428d-8869-c3ecd5c6f830 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1198599003", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:22:07.394340 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-8928190d-1fa0-428d-8869-c3ecd5c6f830 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] validate_networks() for None {{(pid=121134) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:22:07.463534 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-02cdfe37-4df2-487c-a36a-66cf6b59f45a tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Flavor limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:22:07.468470 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-02cdfe37-4df2-487c-a36a-66cf6b59f45a tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Image limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:22:07.468470 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-02cdfe37-4df2-487c-a36a-66cf6b59f45a tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Flavor pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:22:07.468470 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-02cdfe37-4df2-487c-a36a-66cf6b59f45a tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Image pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:22:07.468470 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-02cdfe37-4df2-487c-a36a-66cf6b59f45a tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:22:07.499704 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-02cdfe37-4df2-487c-a36a-66cf6b59f45a tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:07.505895 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-02cdfe37-4df2-487c-a36a-66cf6b59f45a tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:07.506613 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-02cdfe37-4df2-487c-a36a-66cf6b59f45a tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:07.507670 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-02cdfe37-4df2-487c-a36a-66cf6b59f45a tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:07.508382 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-02cdfe37-4df2-487c-a36a-66cf6b59f45a tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:07.509493 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-02cdfe37-4df2-487c-a36a-66cf6b59f45a tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:07.551155 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-02cdfe37-4df2-487c-a36a-66cf6b59f45a tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Getting quotas for project 16bc3a9713e04bafaf5812a87765de55. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:22:07.559911 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-02cdfe37-4df2-487c-a36a-66cf6b59f45a tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Getting quotas for user 63cf2636aee743148721b5ba622de9f5 and project 16bc3a9713e04bafaf5812a87765de55. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:22:07.578511 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-02cdfe37-4df2-487c-a36a-66cf6b59f45a tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Going to run 1 instances... {{(pid=121135) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:22:07.582435 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-02cdfe37-4df2-487c-a36a-66cf6b59f45a tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] [instance: b7ee1a20-f570-44ae-8e29-595fc6b3dcb6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121135) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:22:07.834089 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-02cdfe37-4df2-487c-a36a-66cf6b59f45a tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 3.820441 Oct 19 03:22:07.838210 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1217/2399] 10.222.0.52 () {62 vars in 1188 bytes} [Wed Oct 19 03:22:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 3827 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 19 03:22:07.854401 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c6631ab2-1031-43de-b066-2720633e1582 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:07.855786 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c6631ab2-1031-43de-b066-2720633e1582 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] [instance: 6888c8db-82ba-4072-b431-8d4fcf5f03e0] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:07.876717 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c6631ab2-1031-43de-b066-2720633e1582 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:07.878405 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c6631ab2-1031-43de-b066-2720633e1582 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:07.880460 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c6631ab2-1031-43de-b066-2720633e1582 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:07.883173 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c6631ab2-1031-43de-b066-2720633e1582 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:07.884506 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c6631ab2-1031-43de-b066-2720633e1582 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:07.886855 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c6631ab2-1031-43de-b066-2720633e1582 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:08.740205 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c6631ab2-1031-43de-b066-2720633e1582 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4c5e4123c44508a5d4911a17c44231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a495ccfced47f29cb928d1ded20d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:08.748665 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c6631ab2-1031-43de-b066-2720633e1582 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] 10.222.0.52 "GET /compute/v2.1/servers/6888c8db-82ba-4072-b431-8d4fcf5f03e0" status: 200 len: 1463 microversion: 2.1 time: 0.909001 Oct 19 03:22:08.751959 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1218/2400] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:22:07 2022] GET /compute/v2.1/servers/6888c8db-82ba-4072-b431-8d4fcf5f03e0 => generated 1463 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:22:08.761983 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-8b200be1-0de6-42ec-90a4-68099b18fb8c tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Action: 'create', calling method: .version_select at 0x7fc130ede1f0>, body: {"security_group": {"name": " tempest-securitygroup -952776486 ", "description": "tempest-description-2106550007"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:22:08.862251 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-8928190d-1fa0-428d-8869-c3ecd5c6f830 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Flavor limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:22:08.862727 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-8928190d-1fa0-428d-8869-c3ecd5c6f830 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Image limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:22:08.863143 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-8928190d-1fa0-428d-8869-c3ecd5c6f830 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Flavor pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:22:08.863952 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-8928190d-1fa0-428d-8869-c3ecd5c6f830 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Image pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:22:08.864744 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-8928190d-1fa0-428d-8869-c3ecd5c6f830 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:22:08.921032 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8928190d-1fa0-428d-8869-c3ecd5c6f830 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:08.924719 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8928190d-1fa0-428d-8869-c3ecd5c6f830 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:08.925722 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8928190d-1fa0-428d-8869-c3ecd5c6f830 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:08.930916 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8928190d-1fa0-428d-8869-c3ecd5c6f830 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:08.930916 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8928190d-1fa0-428d-8869-c3ecd5c6f830 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:08.930916 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8928190d-1fa0-428d-8869-c3ecd5c6f830 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:08.984105 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-8928190d-1fa0-428d-8869-c3ecd5c6f830 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Getting quotas for project a146393855c047be83270e5334c68e45. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:22:09.001162 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-8928190d-1fa0-428d-8869-c3ecd5c6f830 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Getting quotas for user 97a222bb0f9a4c728d2ed5ca011c032d and project a146393855c047be83270e5334c68e45. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:22:09.021612 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8928190d-1fa0-428d-8869-c3ecd5c6f830 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Going to run 1 instances... {{(pid=121134) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:22:09.025242 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8928190d-1fa0-428d-8869-c3ecd5c6f830 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] [instance: 6ef505a5-0624-4080-9089-821f6fdfb47c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:22:09.155985 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8928190d-1fa0-428d-8869-c3ecd5c6f830 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.898891 Oct 19 03:22:09.158179 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1183/2401] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:22:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1902 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 03:22:09.165287 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-4fe8e046-3609-437c-a502-e699c57a9b9d req-bde4ec57-4820-461d-b938-098fe36b982b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b4bc3da-47f7-4719-817f-5636c247c87e", "tag": "895e29f8-be3d-4fe5-9b3a-5b5bfaa322fc"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:22:09.218042 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-4fe8e046-3609-437c-a502-e699c57a9b9d req-bde4ec57-4820-461d-b938-098fe36b982b service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:09.233594 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-4fe8e046-3609-437c-a502-e699c57a9b9d req-bde4ec57-4820-461d-b938-098fe36b982b service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:09.235619 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-4fe8e046-3609-437c-a502-e699c57a9b9d req-bde4ec57-4820-461d-b938-098fe36b982b service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:09.285261 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-4fe8e046-3609-437c-a502-e699c57a9b9d req-bde4ec57-4820-461d-b938-098fe36b982b service nova] Creating event network-changed:895e29f8-be3d-4fe5-9b3a-5b5bfaa322fc for instance 3b4bc3da-47f7-4719-817f-5636c247c87e on n-h1-861333-8 Oct 19 03:22:09.322119 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-4fe8e046-3609-437c-a502-e699c57a9b9d req-bde4ec57-4820-461d-b938-098fe36b982b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.162359 Oct 19 03:22:09.327912 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1184/2402] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:22:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:22:09.353324 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ebdc296a-cbb0-4ded-a8a3-648aae42440a tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:09.376220 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ebdc296a-cbb0-4ded-a8a3-648aae42440a tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] [instance: b7ee1a20-f570-44ae-8e29-595fc6b3dcb6] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:09.790309 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ebdc296a-cbb0-4ded-a8a3-648aae42440a tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63cf2636aee743148721b5ba622de9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bc3a9713e04bafaf5812a87765de55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:09.800993 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ebdc296a-cbb0-4ded-a8a3-648aae42440a tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63cf2636aee743148721b5ba622de9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bc3a9713e04bafaf5812a87765de55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:09.807195 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ebdc296a-cbb0-4ded-a8a3-648aae42440a tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63cf2636aee743148721b5ba622de9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bc3a9713e04bafaf5812a87765de55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:09.812679 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ebdc296a-cbb0-4ded-a8a3-648aae42440a tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] 10.222.0.52 "GET /compute/v2.1/servers/b7ee1a20-f570-44ae-8e29-595fc6b3dcb6" status: 200 len: 1262 microversion: 2.26 time: 0.480444 Oct 19 03:22:09.819048 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1185/2403] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:22:09 2022] GET /compute/v2.1/servers/b7ee1a20-f570-44ae-8e29-595fc6b3dcb6 => generated 1262 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:22:09.826435 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0bf1ad1c-09b0-4cdd-99ab-4600e08f493e tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:09.829347 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0bf1ad1c-09b0-4cdd-99ab-4600e08f493e tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 074f3469-3bbd-46df-8286-3a57f91798e2] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:09.849831 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0bf1ad1c-09b0-4cdd-99ab-4600e08f493e tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:09.853636 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0bf1ad1c-09b0-4cdd-99ab-4600e08f493e tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:09.853636 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0bf1ad1c-09b0-4cdd-99ab-4600e08f493e tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:09.854392 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0bf1ad1c-09b0-4cdd-99ab-4600e08f493e tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:09.858340 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0bf1ad1c-09b0-4cdd-99ab-4600e08f493e tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:09.865194 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0bf1ad1c-09b0-4cdd-99ab-4600e08f493e tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:10.182398 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0bf1ad1c-09b0-4cdd-99ab-4600e08f493e tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:10.208566 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0bf1ad1c-09b0-4cdd-99ab-4600e08f493e tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:10.213288 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0bf1ad1c-09b0-4cdd-99ab-4600e08f493e tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:10.214804 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0bf1ad1c-09b0-4cdd-99ab-4600e08f493e tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/074f3469-3bbd-46df-8286-3a57f91798e2" status: 200 len: 1265 microversion: 2.25 time: 0.394173 Oct 19 03:22:10.215381 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1186/2404] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:22:09 2022] GET /compute/v2.1/servers/074f3469-3bbd-46df-8286-3a57f91798e2 => generated 1265 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:22:10.253070 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-8b200be1-0de6-42ec-90a4-68099b18fb8c tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 223 microversion: 2.1 time: 1.499917 Oct 19 03:22:10.254350 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1219/2405] 10.222.0.52 () {60 vars in 1180 bytes} [Wed Oct 19 03:22:08 2022] POST /compute/v2.1/os-security-groups => generated 223 bytes in 1502 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:22:10.260185 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-62c051e8-13f7-4fc3-b20e-989f2d15601b tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:22:10.263522 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-cd08ed11-8d82-4d68-b50e-7bd6d00c75ea tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '.version_select at 0x7fc130b4ab80>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:10.268812 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-62c051e8-13f7-4fc3-b20e-989f2d15601b tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] [instance: 6888c8db-82ba-4072-b431-8d4fcf5f03e0] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:10.320826 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-62c051e8-13f7-4fc3-b20e-989f2d15601b tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:10.332173 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-62c051e8-13f7-4fc3-b20e-989f2d15601b tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:10.332173 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-62c051e8-13f7-4fc3-b20e-989f2d15601b tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:10.332173 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-62c051e8-13f7-4fc3-b20e-989f2d15601b tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:10.333877 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-62c051e8-13f7-4fc3-b20e-989f2d15601b tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:10.334641 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-62c051e8-13f7-4fc3-b20e-989f2d15601b tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:10.419582 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-cd08ed11-8d82-4d68-b50e-7bd6d00c75ea tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/images/bb3a25a0-f1e8-496e-9db8-05a27d2b182c" status: 200 len: 1409 microversion: 2.1 time: 0.183338 Oct 19 03:22:10.421466 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1187/2406] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:22:10 2022] GET /compute/v2.1/images/bb3a25a0-f1e8-496e-9db8-05a27d2b182c => generated 1409 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:22:10.428665 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-337722d4-dace-495c-a368-29e4bc52f188 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:10.429715 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-337722d4-dace-495c-a368-29e4bc52f188 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] [instance: 6ef505a5-0624-4080-9089-821f6fdfb47c] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:10.693389 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-337722d4-dace-495c-a368-29e4bc52f188 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a222bb0f9a4c728d2ed5ca011c032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146393855c047be83270e5334c68e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:10.705051 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-337722d4-dace-495c-a368-29e4bc52f188 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] 10.222.0.52 "GET /compute/v2.1/servers/6ef505a5-0624-4080-9089-821f6fdfb47c" status: 200 len: 1218 microversion: 2.1 time: 0.278855 Oct 19 03:22:10.706144 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1188/2407] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:22:10 2022] GET /compute/v2.1/servers/6ef505a5-0624-4080-9089-821f6fdfb47c => generated 1218 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:22:10.717171 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-223a24fb-2b14-43e0-a28d-20fdc9df5a8b tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Calling method '.version_select at 0x7fc130d73940>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:10.846362 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-62c051e8-13f7-4fc3-b20e-989f2d15601b tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/6888c8db-82ba-4072-b431-8d4fcf5f03e0/action" status: 202 len: 0 microversion: 2.1 time: 0.590490 Oct 19 03:22:10.850457 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1220/2408] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:22:10 2022] POST /compute/v2.1/servers/6888c8db-82ba-4072-b431-8d4fcf5f03e0/action => generated 0 bytes in 595 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:22:10.856443 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-51d141f6-7edf-4622-975b-0e9bf555660b tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:10.857298 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-51d141f6-7edf-4622-975b-0e9bf555660b tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] [instance: b7ee1a20-f570-44ae-8e29-595fc6b3dcb6] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:10.883395 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-51d141f6-7edf-4622-975b-0e9bf555660b tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:10.883911 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-51d141f6-7edf-4622-975b-0e9bf555660b tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:10.884357 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-51d141f6-7edf-4622-975b-0e9bf555660b tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:10.890308 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-51d141f6-7edf-4622-975b-0e9bf555660b tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:10.892068 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-51d141f6-7edf-4622-975b-0e9bf555660b tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:10.892668 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-51d141f6-7edf-4622-975b-0e9bf555660b tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:11.364458 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-51d141f6-7edf-4622-975b-0e9bf555660b tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63cf2636aee743148721b5ba622de9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bc3a9713e04bafaf5812a87765de55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:11.395104 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-51d141f6-7edf-4622-975b-0e9bf555660b tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63cf2636aee743148721b5ba622de9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bc3a9713e04bafaf5812a87765de55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:11.403334 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-51d141f6-7edf-4622-975b-0e9bf555660b tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63cf2636aee743148721b5ba622de9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bc3a9713e04bafaf5812a87765de55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:11.421999 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-51d141f6-7edf-4622-975b-0e9bf555660b tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] 10.222.0.52 "GET /compute/v2.1/servers/b7ee1a20-f570-44ae-8e29-595fc6b3dcb6" status: 200 len: 1258 microversion: 2.26 time: 0.558746 Oct 19 03:22:11.444083 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-223a24fb-2b14-43e0-a28d-20fdc9df5a8b tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] 10.222.0.52 "GET /compute/v2.1/os-security-groups/ab1a77e1-3818-4431-a2cc-ab5f2a6ddabf" status: 200 len: 223 microversion: 2.1 time: 0.736682 Oct 19 03:22:11.445705 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1189/2409] 10.222.0.52 () {58 vars in 1269 bytes} [Wed Oct 19 03:22:10 2022] GET /compute/v2.1/os-security-groups/ab1a77e1-3818-4431-a2cc-ab5f2a6ddabf => generated 223 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:22:11.450392 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e06fcdff-ff8b-4eb8-aeef-a675716506cd tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:11.451345 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e06fcdff-ff8b-4eb8-aeef-a675716506cd tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] [instance: 6888c8db-82ba-4072-b431-8d4fcf5f03e0] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:11.453330 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1221/2410] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:22:10 2022] GET /compute/v2.1/servers/b7ee1a20-f570-44ae-8e29-595fc6b3dcb6 => generated 1258 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:22:11.464631 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-330a3d48-feaf-4e60-85e9-8ed4457298e8 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:11.465466 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-330a3d48-feaf-4e60-85e9-8ed4457298e8 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 074f3469-3bbd-46df-8286-3a57f91798e2] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:11.483539 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-330a3d48-feaf-4e60-85e9-8ed4457298e8 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:11.483734 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e06fcdff-ff8b-4eb8-aeef-a675716506cd tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:11.484378 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-330a3d48-feaf-4e60-85e9-8ed4457298e8 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:11.485569 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e06fcdff-ff8b-4eb8-aeef-a675716506cd tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:11.485842 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-330a3d48-feaf-4e60-85e9-8ed4457298e8 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:11.486789 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-330a3d48-feaf-4e60-85e9-8ed4457298e8 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:11.487384 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e06fcdff-ff8b-4eb8-aeef-a675716506cd tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:11.487581 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-330a3d48-feaf-4e60-85e9-8ed4457298e8 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:11.488435 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-330a3d48-feaf-4e60-85e9-8ed4457298e8 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:11.489424 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e06fcdff-ff8b-4eb8-aeef-a675716506cd tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:11.489892 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e06fcdff-ff8b-4eb8-aeef-a675716506cd tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:11.490336 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e06fcdff-ff8b-4eb8-aeef-a675716506cd tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:11.621324 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e06fcdff-ff8b-4eb8-aeef-a675716506cd tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:11.627176 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e06fcdff-ff8b-4eb8-aeef-a675716506cd tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:11.627176 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e06fcdff-ff8b-4eb8-aeef-a675716506cd tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:11.627176 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-e06fcdff-ff8b-4eb8-aeef-a675716506cd tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Lazy-loading 'fault' on Instance uuid 6888c8db-82ba-4072-b431-8d4fcf5f03e0 {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:22:11.698567 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-330a3d48-feaf-4e60-85e9-8ed4457298e8 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:11.716413 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-330a3d48-feaf-4e60-85e9-8ed4457298e8 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:11.728501 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-330a3d48-feaf-4e60-85e9-8ed4457298e8 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:11.729842 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-330a3d48-feaf-4e60-85e9-8ed4457298e8 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/074f3469-3bbd-46df-8286-3a57f91798e2" status: 200 len: 1265 microversion: 2.25 time: 0.274740 Oct 19 03:22:11.730427 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1222/2411] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:22:11 2022] GET /compute/v2.1/servers/074f3469-3bbd-46df-8286-3a57f91798e2 => generated 1265 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:22:11.749817 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2923540e-0fbb-4ebb-b4c2-a8e5d4775413 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '.version_select at 0x7fc130304550>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:11.839173 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2923540e-0fbb-4ebb-b4c2-a8e5d4775413 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/images/bb3a25a0-f1e8-496e-9db8-05a27d2b182c" status: 200 len: 1409 microversion: 2.1 time: 0.107670 Oct 19 03:22:11.839759 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1223/2412] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:22:11 2022] GET /compute/v2.1/images/bb3a25a0-f1e8-496e-9db8-05a27d2b182c => generated 1409 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:22:11.872019 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-82130000-b176-47ec-93aa-b0234f6057d0 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Calling method '.version_select at 0x7fc130cd5820>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:12.591836 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e06fcdff-ff8b-4eb8-aeef-a675716506cd tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/6888c8db-82ba-4072-b431-8d4fcf5f03e0" status: 200 len: 1597 microversion: 2.1 time: 1.142768 Oct 19 03:22:12.594117 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1190/2413] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:22:11 2022] GET /compute/v2.1/servers/6888c8db-82ba-4072-b431-8d4fcf5f03e0 => generated 1597 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:22:12.605894 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-d0283aae-508d-422b-9812-d388d8d23c6d req-1623a951-cefa-4d49-a87f-cbb5c344ee5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "074f3469-3bbd-46df-8286-3a57f91798e2", "name": "network-vif-deleted", "tag": "44f53eb4-50b1-4764-8a1c-143764a0a324"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:22:12.634549 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-d0283aae-508d-422b-9812-d388d8d23c6d req-1623a951-cefa-4d49-a87f-cbb5c344ee5a service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:12.635975 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-d0283aae-508d-422b-9812-d388d8d23c6d req-1623a951-cefa-4d49-a87f-cbb5c344ee5a service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:12.637252 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-d0283aae-508d-422b-9812-d388d8d23c6d req-1623a951-cefa-4d49-a87f-cbb5c344ee5a service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:12.673407 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-d0283aae-508d-422b-9812-d388d8d23c6d req-1623a951-cefa-4d49-a87f-cbb5c344ee5a service nova] Creating event network-vif-deleted:44f53eb4-50b1-4764-8a1c-143764a0a324 for instance 074f3469-3bbd-46df-8286-3a57f91798e2 on n-h2-861333-8 Oct 19 03:22:12.685134 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-d0283aae-508d-422b-9812-d388d8d23c6d req-1623a951-cefa-4d49-a87f-cbb5c344ee5a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088093 Oct 19 03:22:12.687920 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1191/2414] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:22:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:22:12.698950 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8573250d-56ba-4541-9abd-52a4ecb45333 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:12.702731 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8573250d-56ba-4541-9abd-52a4ecb45333 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] [instance: 6ef505a5-0624-4080-9089-821f6fdfb47c] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:12.718192 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8573250d-56ba-4541-9abd-52a4ecb45333 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:12.722205 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8573250d-56ba-4541-9abd-52a4ecb45333 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:12.728023 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8573250d-56ba-4541-9abd-52a4ecb45333 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:12.730596 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8573250d-56ba-4541-9abd-52a4ecb45333 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:12.731261 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8573250d-56ba-4541-9abd-52a4ecb45333 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:12.732865 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8573250d-56ba-4541-9abd-52a4ecb45333 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:13.205930 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8573250d-56ba-4541-9abd-52a4ecb45333 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a222bb0f9a4c728d2ed5ca011c032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146393855c047be83270e5334c68e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:13.222045 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8573250d-56ba-4541-9abd-52a4ecb45333 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] 10.222.0.52 "GET /compute/v2.1/servers/6ef505a5-0624-4080-9089-821f6fdfb47c" status: 200 len: 1270 microversion: 2.1 time: 0.526428 Oct 19 03:22:13.222191 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1192/2415] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:22:12 2022] GET /compute/v2.1/servers/6ef505a5-0624-4080-9089-821f6fdfb47c => generated 1270 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:22:13.230884 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-6243509f-d182-491b-ac64-3d21ab23eac3 req-b131db57-b4b1-4b89-b641-24ba7aef3105 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6888c8db-82ba-4072-b431-8d4fcf5f03e0", "name": "network-vif-plugged", "status": "completed", "tag": "7d06606b-5258-42bd-89b9-3f972fa9dcda"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:22:13.284819 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-6243509f-d182-491b-ac64-3d21ab23eac3 req-b131db57-b4b1-4b89-b641-24ba7aef3105 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:13.292455 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-6243509f-d182-491b-ac64-3d21ab23eac3 req-b131db57-b4b1-4b89-b641-24ba7aef3105 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:13.296563 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-6243509f-d182-491b-ac64-3d21ab23eac3 req-b131db57-b4b1-4b89-b641-24ba7aef3105 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:13.334185 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-6243509f-d182-491b-ac64-3d21ab23eac3 req-b131db57-b4b1-4b89-b641-24ba7aef3105 service nova] Creating event network-vif-plugged:7d06606b-5258-42bd-89b9-3f972fa9dcda for instance 6888c8db-82ba-4072-b431-8d4fcf5f03e0 on n-h1-861333-8 Oct 19 03:22:13.352789 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-6243509f-d182-491b-ac64-3d21ab23eac3 req-b131db57-b4b1-4b89-b641-24ba7aef3105 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127141 Oct 19 03:22:13.356908 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1193/2416] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:22:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:22:13.373768 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f587c53e-cc65-48cc-972a-10c412577f51 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:13.374983 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f587c53e-cc65-48cc-972a-10c412577f51 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] [instance: b7ee1a20-f570-44ae-8e29-595fc6b3dcb6] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:13.420094 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f587c53e-cc65-48cc-972a-10c412577f51 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:13.424351 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f587c53e-cc65-48cc-972a-10c412577f51 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:13.424839 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f587c53e-cc65-48cc-972a-10c412577f51 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:13.432223 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f587c53e-cc65-48cc-972a-10c412577f51 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:13.432723 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f587c53e-cc65-48cc-972a-10c412577f51 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:13.434991 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f587c53e-cc65-48cc-972a-10c412577f51 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:13.636129 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-f587c53e-cc65-48cc-972a-10c412577f51 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63cf2636aee743148721b5ba622de9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bc3a9713e04bafaf5812a87765de55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:13.647929 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-f587c53e-cc65-48cc-972a-10c412577f51 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63cf2636aee743148721b5ba622de9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bc3a9713e04bafaf5812a87765de55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:13.653697 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-f587c53e-cc65-48cc-972a-10c412577f51 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63cf2636aee743148721b5ba622de9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bc3a9713e04bafaf5812a87765de55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:13.660852 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f587c53e-cc65-48cc-972a-10c412577f51 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] 10.222.0.52 "GET /compute/v2.1/servers/b7ee1a20-f570-44ae-8e29-595fc6b3dcb6" status: 200 len: 1320 microversion: 2.26 time: 0.302525 Oct 19 03:22:13.662089 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1194/2417] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:22:13 2022] GET /compute/v2.1/servers/b7ee1a20-f570-44ae-8e29-595fc6b3dcb6 => generated 1320 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:22:13.673826 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ae099851-3b09-4b7c-9d4a-5d84f253280d tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:22:13.680622 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ae099851-3b09-4b7c-9d4a-5d84f253280d tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] [instance: 6888c8db-82ba-4072-b431-8d4fcf5f03e0] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:13.695136 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ae099851-3b09-4b7c-9d4a-5d84f253280d tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:13.697937 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ae099851-3b09-4b7c-9d4a-5d84f253280d tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:13.699553 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ae099851-3b09-4b7c-9d4a-5d84f253280d tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:13.702896 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ae099851-3b09-4b7c-9d4a-5d84f253280d tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:13.703691 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ae099851-3b09-4b7c-9d4a-5d84f253280d tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:13.704736 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ae099851-3b09-4b7c-9d4a-5d84f253280d tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:13.951486 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-82130000-b176-47ec-93aa-b0234f6057d0 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/ab1a77e1-3818-4431-a2cc-ab5f2a6ddabf" status: 202 len: 0 microversion: 2.1 time: 2.110662 Oct 19 03:22:13.956811 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1224/2418] 10.222.0.52 () {58 vars in 1272 bytes} [Wed Oct 19 03:22:11 2022] DELETE /compute/v2.1/os-security-groups/ab1a77e1-3818-4431-a2cc-ab5f2a6ddabf => generated 0 bytes in 2116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:22:13.972031 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b46a905b-94b5-40b1-8772-845f15f9a4ec tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:13.980699 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b46a905b-94b5-40b1-8772-845f15f9a4ec tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 074f3469-3bbd-46df-8286-3a57f91798e2] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:14.010186 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b46a905b-94b5-40b1-8772-845f15f9a4ec tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:14.011709 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b46a905b-94b5-40b1-8772-845f15f9a4ec tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:14.018399 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b46a905b-94b5-40b1-8772-845f15f9a4ec tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:14.019493 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b46a905b-94b5-40b1-8772-845f15f9a4ec tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:14.021958 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b46a905b-94b5-40b1-8772-845f15f9a4ec tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:14.022587 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b46a905b-94b5-40b1-8772-845f15f9a4ec tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:14.235659 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ae099851-3b09-4b7c-9d4a-5d84f253280d tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/6888c8db-82ba-4072-b431-8d4fcf5f03e0/action" status: 202 len: 0 microversion: 2.1 time: 0.570487 Oct 19 03:22:14.236491 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1195/2419] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:22:13 2022] POST /compute/v2.1/servers/6888c8db-82ba-4072-b431-8d4fcf5f03e0/action => generated 0 bytes in 572 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:22:14.242804 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-dc9da911-2bf5-46e6-9dd9-6dadd5e21078 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '.version_select at 0x7fc1302a7ca0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:14.421605 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-dc9da911-2bf5-46e6-9dd9-6dadd5e21078 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/images/bb3a25a0-f1e8-496e-9db8-05a27d2b182c" status: 200 len: 1409 microversion: 2.1 time: 0.183226 Oct 19 03:22:14.426350 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1196/2420] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:22:14 2022] GET /compute/v2.1/images/bb3a25a0-f1e8-496e-9db8-05a27d2b182c => generated 1409 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:22:14.428982 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-abb88e77-13ad-4460-8cf8-da4b32f01b81 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Calling method '.version_select at 0x7fc13043fe50>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:14.630855 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b46a905b-94b5-40b1-8772-845f15f9a4ec tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:14.642915 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b46a905b-94b5-40b1-8772-845f15f9a4ec tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:14.649761 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b46a905b-94b5-40b1-8772-845f15f9a4ec tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:14.651723 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b46a905b-94b5-40b1-8772-845f15f9a4ec tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/074f3469-3bbd-46df-8286-3a57f91798e2" status: 200 len: 1265 microversion: 2.25 time: 0.693144 Oct 19 03:22:14.668553 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1225/2421] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:22:13 2022] GET /compute/v2.1/servers/074f3469-3bbd-46df-8286-3a57f91798e2 => generated 1265 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:22:14.668895 n-d-861333-8 devstack@n-api.service[121134]: DEBUG neutronclient.v2_0.client [None req-abb88e77-13ad-4460-8cf8-da4b32f01b81 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group ab1a77e1-3818-4431-a2cc-ab5f2a6ddabf does not exist", "detail": ""}} {{(pid=121134) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 19 03:22:14.668895 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.security_group_api [None req-abb88e77-13ad-4460-8cf8-da4b32f01b81 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Neutron security group ab1a77e1-3818-4431-a2cc-ab5f2a6ddabf not found {{(pid=121134) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 19 03:22:14.668895 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-abb88e77-13ad-4460-8cf8-da4b32f01b81 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] HTTP exception thrown: Security group ab1a77e1-3818-4431-a2cc-ab5f2a6ddabf does not exist Oct 19 03:22:14.668895 n-d-861333-8 devstack@n-api.service[121134]: Neutron server returns request_ids: ['req-f62aa6c6-32fb-47c4-b696-899f038a7355'] Oct 19 03:22:14.669585 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d285c755-234a-463a-952f-4f97843709f0 tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:14.669585 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d285c755-234a-463a-952f-4f97843709f0 tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] [instance: 6888c8db-82ba-4072-b431-8d4fcf5f03e0] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:14.687279 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d285c755-234a-463a-952f-4f97843709f0 tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:14.687279 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d285c755-234a-463a-952f-4f97843709f0 tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:14.687477 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-abb88e77-13ad-4460-8cf8-da4b32f01b81 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Request method failure captured: Oct 19 03:22:14.687477 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/os-security-groups/ab1a77e1-3818-4431-a2cc-ab5f2a6ddabf HTTP/1.1 Oct 19 03:22:14.687477 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:22:14.687477 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:22:14.687477 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:22:14.687477 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:22:14.687477 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:22:14.687477 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:22:14.687477 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:22:14.687477 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:22:14.687477 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT200KvQGsyi_a_sB4TfhhJOzMfG19jSa6oSlia6bg0oJGWsETmIFLMxsrnEQMCxFlXYpeXPwW52kFxfganN5M4cxj3tahAijx2xJ--2WsWYJtuNU3tc5IIgL3W8HC4CGP3frn8iROEzLPCi1mQC1-zUvq06vNZR4ARbYNlrlnvumYqI Oct 19 03:22:14.687477 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:22:14.687477 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:22:14.687477 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:22:14.687477 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:22:14.687477 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:22:14.687477 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:22:14.687477 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 385a1e7cceff48798bfefb9390e5979c Oct 19 03:22:14.687477 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-SecurityGroupsTestJSON-637911912 Oct 19 03:22:14.687477 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:22:14.687477 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:22:14.689257 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/385a1e7cceff48798bfefb9390e5979c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/385a1e7cceff48798bfefb9390e5979c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/385a1e7cceff48798bfefb9390e5979c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_385a1e7cceff48798bfefb9390e5979c", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:22:14.689257 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-SecurityGroupsTestJSON-637911912 Oct 19 03:22:14.689257 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 385a1e7cceff48798bfefb9390e5979c Oct 19 03:22:14.689257 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-637911912 Oct 19 03:22:14.689257 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-SecurityGroupsTestJSON-637911912-project Oct 19 03:22:14.689257 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:22:14.689257 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:22:14.689257 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 3661010393d44c428fb37652b1717072 Oct 19 03:22:14.689257 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-SecurityGroupsTestJSON-637911912-project Oct 19 03:22:14.689257 n-d-861333-8 devstack@n-api.service[121134]: method: Oct 19 03:22:14.689257 n-d-861333-8 devstack@n-api.service[121134]: exception: Security group ab1a77e1-3818-4431-a2cc-ab5f2a6ddabf does not exist Oct 19 03:22:14.689257 n-d-861333-8 devstack@n-api.service[121134]: Neutron server returns request_ids: ['req-f62aa6c6-32fb-47c4-b696-899f038a7355'] Oct 19 03:22:14.689257 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': 'ab1a77e1-3818-4431-a2cc-ab5f2a6ddabf'} Oct 19 03:22:14.690045 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:22:14.690045 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:22:14.690045 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 19 03:22:14.690045 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 19 03:22:14.690045 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:22:14.690045 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:22:14.690045 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 19 03:22:14.690045 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 19 03:22:14.690045 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:22:14.690045 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:22:14.690045 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 19 03:22:14.690045 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 19 03:22:14.690045 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:22:14.690045 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:22:14.690045 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 19 03:22:14.690045 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 19 03:22:14.690045 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:22:14.690045 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:22:14.690045 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 19 03:22:14.691048 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 19 03:22:14.691048 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:22:14.691048 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:22:14.691048 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 19 03:22:14.691048 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 19 03:22:14.691048 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 19 03:22:14.691048 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 19 03:22:14.691048 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group ab1a77e1-3818-4431-a2cc-ab5f2a6ddabf does not exist Oct 19 03:22:14.691048 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f62aa6c6-32fb-47c4-b696-899f038a7355'] Oct 19 03:22:14.691048 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:22:14.691048 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:22:14.691048 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:22:14.691048 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:22:14.691048 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 19 03:22:14.691048 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 19 03:22:14.691048 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 19 03:22:14.691048 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 19 03:22:14.691048 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group ab1a77e1-3818-4431-a2cc-ab5f2a6ddabf does not exist Oct 19 03:22:14.692005 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f62aa6c6-32fb-47c4-b696-899f038a7355'] Oct 19 03:22:14.692005 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:22:14.692005 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:22:14.692005 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:22:14.692005 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:22:14.692005 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:22:14.692005 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:22:14.692005 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:22:14.692005 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:22:14.692005 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 03:22:14.692005 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 03:22:14.692005 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:22:14.692005 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:22:14.692005 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 19 03:22:14.692005 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 19 03:22:14.692005 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group ab1a77e1-3818-4431-a2cc-ab5f2a6ddabf does not exist Oct 19 03:22:14.692005 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f62aa6c6-32fb-47c4-b696-899f038a7355'] Oct 19 03:22:14.692005 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:22:14.692005 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:22:14.692005 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:22:14.692005 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:22:14.693046 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:22:14.693046 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:22:14.693046 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:22:14.693046 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:22:14.693046 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group ab1a77e1-3818-4431-a2cc-ab5f2a6ddabf does not exist Oct 19 03:22:14.693046 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f62aa6c6-32fb-47c4-b696-899f038a7355'] Oct 19 03:22:14.693046 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:22:14.699283 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-abb88e77-13ad-4460-8cf8-da4b32f01b81 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Returning 404 to user: Security group ab1a77e1-3818-4431-a2cc-ab5f2a6ddabf does not exist Oct 19 03:22:14.699283 n-d-861333-8 devstack@n-api.service[121134]: Neutron server returns request_ids: ['req-f62aa6c6-32fb-47c4-b696-899f038a7355'] {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:22:14.700787 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-abb88e77-13ad-4460-8cf8-da4b32f01b81 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] 10.222.0.52 "GET /compute/v2.1/os-security-groups/ab1a77e1-3818-4431-a2cc-ab5f2a6ddabf" status: 404 len: 194 microversion: 2.1 time: 0.277072 Oct 19 03:22:14.706616 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1197/2422] 10.222.0.52 () {58 vars in 1269 bytes} [Wed Oct 19 03:22:14 2022] GET /compute/v2.1/os-security-groups/ab1a77e1-3818-4431-a2cc-ab5f2a6ddabf => generated 194 bytes in 278 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:22:14.706818 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d285c755-234a-463a-952f-4f97843709f0 tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:14.706818 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d285c755-234a-463a-952f-4f97843709f0 tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:14.706818 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d285c755-234a-463a-952f-4f97843709f0 tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:14.706818 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d285c755-234a-463a-952f-4f97843709f0 tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:14.756108 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ce44834a-bd56-4212-b4e9-a2a32e5fc617 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:14.761642 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ce44834a-bd56-4212-b4e9-a2a32e5fc617 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] [instance: 6ef505a5-0624-4080-9089-821f6fdfb47c] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:14.788855 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ce44834a-bd56-4212-b4e9-a2a32e5fc617 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:14.789409 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ce44834a-bd56-4212-b4e9-a2a32e5fc617 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:14.789895 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ce44834a-bd56-4212-b4e9-a2a32e5fc617 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:14.790863 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ce44834a-bd56-4212-b4e9-a2a32e5fc617 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:14.791567 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ce44834a-bd56-4212-b4e9-a2a32e5fc617 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:14.792186 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ce44834a-bd56-4212-b4e9-a2a32e5fc617 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:15.880899 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ce44834a-bd56-4212-b4e9-a2a32e5fc617 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a222bb0f9a4c728d2ed5ca011c032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146393855c047be83270e5334c68e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:15.891533 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ce44834a-bd56-4212-b4e9-a2a32e5fc617 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] 10.222.0.52 "GET /compute/v2.1/servers/6ef505a5-0624-4080-9089-821f6fdfb47c" status: 200 len: 1288 microversion: 2.1 time: 1.174345 Oct 19 03:22:15.916613 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1198/2423] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:22:14 2022] GET /compute/v2.1/servers/6ef505a5-0624-4080-9089-821f6fdfb47c => generated 1288 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:22:15.923425 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-992983b8-1417-4e08-8c73-fc7af12a8d8b tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:15.924065 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-992983b8-1417-4e08-8c73-fc7af12a8d8b tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] [instance: b7ee1a20-f570-44ae-8e29-595fc6b3dcb6] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:15.942502 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-992983b8-1417-4e08-8c73-fc7af12a8d8b tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:15.943043 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-992983b8-1417-4e08-8c73-fc7af12a8d8b tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:15.943486 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-992983b8-1417-4e08-8c73-fc7af12a8d8b tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:15.944289 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-992983b8-1417-4e08-8c73-fc7af12a8d8b tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:15.944747 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-992983b8-1417-4e08-8c73-fc7af12a8d8b tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:15.945176 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-992983b8-1417-4e08-8c73-fc7af12a8d8b tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:16.133451 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d285c755-234a-463a-952f-4f97843709f0 tempest-ServersAdminTestJSON-230010543 tempest-ServersAdminTestJSON-230010543-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/6888c8db-82ba-4072-b431-8d4fcf5f03e0" status: 200 len: 1614 microversion: 2.1 time: 1.477125 Oct 19 03:22:16.153632 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1226/2424] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:22:14 2022] GET /compute/v2.1/servers/6888c8db-82ba-4072-b431-8d4fcf5f03e0 => generated 1614 bytes in 1497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:22:16.164853 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-65eea604-4ec7-458e-a1e3-b4a014b1d4e4 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Action: 'create', calling method: .version_select at 0x7fc130304700>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-808877411", "description": "tempest-description-1710733058"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:22:16.244239 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-992983b8-1417-4e08-8c73-fc7af12a8d8b tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63cf2636aee743148721b5ba622de9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bc3a9713e04bafaf5812a87765de55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:16.260076 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-992983b8-1417-4e08-8c73-fc7af12a8d8b tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63cf2636aee743148721b5ba622de9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bc3a9713e04bafaf5812a87765de55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:16.268341 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-992983b8-1417-4e08-8c73-fc7af12a8d8b tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63cf2636aee743148721b5ba622de9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bc3a9713e04bafaf5812a87765de55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:16.271370 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-992983b8-1417-4e08-8c73-fc7af12a8d8b tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] 10.222.0.52 "GET /compute/v2.1/servers/b7ee1a20-f570-44ae-8e29-595fc6b3dcb6" status: 200 len: 1320 microversion: 2.26 time: 0.353288 Oct 19 03:22:16.277469 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1199/2425] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:22:15 2022] GET /compute/v2.1/servers/b7ee1a20-f570-44ae-8e29-595fc6b3dcb6 => generated 1320 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:22:16.289831 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-25eed11d-a116-4e4f-8370-f2aecb66bb49 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '.version_select at 0x7fc130246820>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:16.415583 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-25eed11d-a116-4e4f-8370-f2aecb66bb49 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/images/bb3a25a0-f1e8-496e-9db8-05a27d2b182c" status: 200 len: 1418 microversion: 2.1 time: 0.135451 Oct 19 03:22:16.418319 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1200/2426] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:22:16 2022] GET /compute/v2.1/images/bb3a25a0-f1e8-496e-9db8-05a27d2b182c => generated 1418 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:22:16.430202 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0671cd7f-e017-42a9-99cd-108ba3fb2330 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:16.432427 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0671cd7f-e017-42a9-99cd-108ba3fb2330 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 074f3469-3bbd-46df-8286-3a57f91798e2] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:16.446226 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0671cd7f-e017-42a9-99cd-108ba3fb2330 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:16.449099 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0671cd7f-e017-42a9-99cd-108ba3fb2330 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:16.469632 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0671cd7f-e017-42a9-99cd-108ba3fb2330 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:16.470919 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0671cd7f-e017-42a9-99cd-108ba3fb2330 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:16.475124 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0671cd7f-e017-42a9-99cd-108ba3fb2330 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:16.478280 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0671cd7f-e017-42a9-99cd-108ba3fb2330 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:17.001540 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0671cd7f-e017-42a9-99cd-108ba3fb2330 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:17.027758 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0671cd7f-e017-42a9-99cd-108ba3fb2330 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:17.034679 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0671cd7f-e017-42a9-99cd-108ba3fb2330 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:17.047362 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0671cd7f-e017-42a9-99cd-108ba3fb2330 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/074f3469-3bbd-46df-8286-3a57f91798e2" status: 200 len: 1265 microversion: 2.25 time: 0.625793 Oct 19 03:22:17.049775 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1201/2427] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:22:16 2022] GET /compute/v2.1/servers/074f3469-3bbd-46df-8286-3a57f91798e2 => generated 1265 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:22:17.054683 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2f63d9bf-20a8-493b-9851-70ca28e9b941 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:17.074020 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2f63d9bf-20a8-493b-9851-70ca28e9b941 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] [instance: b1acb084-c2bd-49b1-b38a-5e7630389abd] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:17.096808 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2f63d9bf-20a8-493b-9851-70ca28e9b941 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:17.097581 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2f63d9bf-20a8-493b-9851-70ca28e9b941 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:17.100108 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2f63d9bf-20a8-493b-9851-70ca28e9b941 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:17.103301 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2f63d9bf-20a8-493b-9851-70ca28e9b941 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:17.105660 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2f63d9bf-20a8-493b-9851-70ca28e9b941 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:17.107329 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2f63d9bf-20a8-493b-9851-70ca28e9b941 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:17.123274 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:22:17.213468 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2f63d9bf-20a8-493b-9851-70ca28e9b941 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] [instance: b1acb084-c2bd-49b1-b38a-5e7630389abd] Going to try to terminate instance {{(pid=121134) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:22:17.322293 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-65eea604-4ec7-458e-a1e3-b4a014b1d4e4 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.167842 Oct 19 03:22:17.323253 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1227/2428] 10.222.0.52 () {60 vars in 1180 bytes} [Wed Oct 19 03:22:16 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:22:17.329612 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a6878fd5-e8fc-4dce-9410-fb0451cb0799 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '.version_select at 0x7fc134f43550>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:17.440364 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a6878fd5-e8fc-4dce-9410-fb0451cb0799 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/images/bb3a25a0-f1e8-496e-9db8-05a27d2b182c" status: 200 len: 1418 microversion: 2.1 time: 0.115824 Oct 19 03:22:17.441102 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1228/2429] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:22:17 2022] GET /compute/v2.1/images/bb3a25a0-f1e8-496e-9db8-05a27d2b182c => generated 1418 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:22:17.456179 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a3646cf7-de81-4b19-9ebd-765c2b0deb75 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:17.456941 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a3646cf7-de81-4b19-9ebd-765c2b0deb75 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] [instance: 6ef505a5-0624-4080-9089-821f6fdfb47c] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:17.468596 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a3646cf7-de81-4b19-9ebd-765c2b0deb75 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:17.474493 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a3646cf7-de81-4b19-9ebd-765c2b0deb75 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:17.475241 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a3646cf7-de81-4b19-9ebd-765c2b0deb75 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:17.476186 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a3646cf7-de81-4b19-9ebd-765c2b0deb75 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:17.476837 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a3646cf7-de81-4b19-9ebd-765c2b0deb75 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:17.477549 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a3646cf7-de81-4b19-9ebd-765c2b0deb75 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:17.489308 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:22:17.564831 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=4 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:22:17.589459 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=12 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:22:17.617653 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2f63d9bf-20a8-493b-9851-70ca28e9b941 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] 10.222.0.52 "DELETE /compute/v2.1/servers/b1acb084-c2bd-49b1-b38a-5e7630389abd" status: 204 len: 0 microversion: 2.1 time: 0.566479 Oct 19 03:22:17.618828 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1202/2430] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:22:17 2022] DELETE /compute/v2.1/servers/b1acb084-c2bd-49b1-b38a-5e7630389abd => generated 0 bytes in 568 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:22:17.625020 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e47bf49a-1d4c-4937-bcec-02a81c819762 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:17.627445 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e47bf49a-1d4c-4937-bcec-02a81c819762 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] [instance: b7ee1a20-f570-44ae-8e29-595fc6b3dcb6] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:17.643134 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e47bf49a-1d4c-4937-bcec-02a81c819762 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:17.643644 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e47bf49a-1d4c-4937-bcec-02a81c819762 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:17.644091 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e47bf49a-1d4c-4937-bcec-02a81c819762 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:17.644837 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e47bf49a-1d4c-4937-bcec-02a81c819762 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:17.645283 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e47bf49a-1d4c-4937-bcec-02a81c819762 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:17.645742 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e47bf49a-1d4c-4937-bcec-02a81c819762 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:17.833603 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e47bf49a-1d4c-4937-bcec-02a81c819762 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63cf2636aee743148721b5ba622de9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bc3a9713e04bafaf5812a87765de55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:17.882589 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e47bf49a-1d4c-4937-bcec-02a81c819762 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63cf2636aee743148721b5ba622de9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bc3a9713e04bafaf5812a87765de55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:17.884794 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e47bf49a-1d4c-4937-bcec-02a81c819762 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63cf2636aee743148721b5ba622de9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bc3a9713e04bafaf5812a87765de55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:17.889188 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e47bf49a-1d4c-4937-bcec-02a81c819762 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] 10.222.0.52 "GET /compute/v2.1/servers/b7ee1a20-f570-44ae-8e29-595fc6b3dcb6" status: 200 len: 1320 microversion: 2.26 time: 0.268754 Oct 19 03:22:17.891053 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1203/2431] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:22:17 2022] GET /compute/v2.1/servers/b7ee1a20-f570-44ae-8e29-595fc6b3dcb6 => generated 1320 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:22:17.896929 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b231128a-d04e-418b-9d7e-a2779238503c tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Action: 'create', calling method: .version_select at 0x7fc130246a60>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-429771310", "description": "tempest-description-1946429274"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:22:18.150462 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a3646cf7-de81-4b19-9ebd-765c2b0deb75 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a222bb0f9a4c728d2ed5ca011c032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146393855c047be83270e5334c68e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:18.171171 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a3646cf7-de81-4b19-9ebd-765c2b0deb75 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] 10.222.0.52 "GET /compute/v2.1/servers/6ef505a5-0624-4080-9089-821f6fdfb47c" status: 200 len: 1318 microversion: 2.1 time: 0.723433 Oct 19 03:22:18.181560 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1229/2432] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:22:17 2022] GET /compute/v2.1/servers/6ef505a5-0624-4080-9089-821f6fdfb47c => generated 1318 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:22:18.194036 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9550f2dc-0bcd-4a14-9686-a21bb080370d tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '.version_select at 0x7fc130d0b940>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:18.952031 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:22:19.226650 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b231128a-d04e-418b-9d7e-a2779238503c tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.334321 Oct 19 03:22:19.229819 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1204/2433] 10.222.0.52 () {60 vars in 1180 bytes} [Wed Oct 19 03:22:17 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:22:19.238933 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-88da0670-10c0-407b-b2fc-783014dd2c88 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:19.243165 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-88da0670-10c0-407b-b2fc-783014dd2c88 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] [instance: b1acb084-c2bd-49b1-b38a-5e7630389abd] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:19.265404 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-88da0670-10c0-407b-b2fc-783014dd2c88 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:19.267673 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-88da0670-10c0-407b-b2fc-783014dd2c88 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:19.273196 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-88da0670-10c0-407b-b2fc-783014dd2c88 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:19.274582 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-88da0670-10c0-407b-b2fc-783014dd2c88 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:19.275082 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-88da0670-10c0-407b-b2fc-783014dd2c88 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:19.275947 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-88da0670-10c0-407b-b2fc-783014dd2c88 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:19.970147 n-d-861333-8 devstack@n-api.service[121134]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 03:22:19.970733 n-d-861333-8 devstack@n-api.service[121134]: Wed Oct 19 03:22:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b1acb084-c2bd-49b1-b38a-5e7630389abd (ip 10.222.0.52) !!! Oct 19 03:22:20.133310 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-88da0670-10c0-407b-b2fc-783014dd2c88 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4c5e4123c44508a5d4911a17c44231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a495ccfced47f29cb928d1ded20d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:20.148473 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-88da0670-10c0-407b-b2fc-783014dd2c88 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] 10.222.0.52 "GET /compute/v2.1/servers/b1acb084-c2bd-49b1-b38a-5e7630389abd" status: 200 len: 1469 microversion: 2.1 time: 0.913114 Oct 19 03:22:20.149946 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1205/2434] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:22:19 2022] GET /compute/v2.1/servers/b1acb084-c2bd-49b1-b38a-5e7630389abd => generated 1469 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:22:20.157640 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-548afc7e-63ab-4e3d-bb90-b98c22065d63 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:20.158327 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-548afc7e-63ab-4e3d-bb90-b98c22065d63 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 074f3469-3bbd-46df-8286-3a57f91798e2] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:20.160536 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:22:20.167234 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-548afc7e-63ab-4e3d-bb90-b98c22065d63 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:20.168359 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-548afc7e-63ab-4e3d-bb90-b98c22065d63 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:20.168799 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-548afc7e-63ab-4e3d-bb90-b98c22065d63 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:20.170901 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-548afc7e-63ab-4e3d-bb90-b98c22065d63 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:20.171641 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-548afc7e-63ab-4e3d-bb90-b98c22065d63 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:20.173502 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-548afc7e-63ab-4e3d-bb90-b98c22065d63 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:20.218123 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9550f2dc-0bcd-4a14-9686-a21bb080370d tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "DELETE /compute/v2.1/images/bb3a25a0-f1e8-496e-9db8-05a27d2b182c" status: 204 len: 0 microversion: 2.1 time: 2.032824 Oct 19 03:22:20.218123 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1230/2435] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:22:18 2022] DELETE /compute/v2.1/images/bb3a25a0-f1e8-496e-9db8-05a27d2b182c => generated 0 bytes in 2034 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:22:20.225507 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f835c21f-7492-4422-b7f5-bd9f12b8eff2 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:20.227284 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f835c21f-7492-4422-b7f5-bd9f12b8eff2 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] [instance: b7ee1a20-f570-44ae-8e29-595fc6b3dcb6] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:20.281864 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f835c21f-7492-4422-b7f5-bd9f12b8eff2 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:20.282647 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f835c21f-7492-4422-b7f5-bd9f12b8eff2 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:20.283969 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f835c21f-7492-4422-b7f5-bd9f12b8eff2 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:20.288959 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f835c21f-7492-4422-b7f5-bd9f12b8eff2 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:20.294656 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f835c21f-7492-4422-b7f5-bd9f12b8eff2 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:20.294656 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f835c21f-7492-4422-b7f5-bd9f12b8eff2 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:20.345852 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-548afc7e-63ab-4e3d-bb90-b98c22065d63 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:20.347533 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-548afc7e-63ab-4e3d-bb90-b98c22065d63 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:20.348218 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-548afc7e-63ab-4e3d-bb90-b98c22065d63 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:20.360427 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-548afc7e-63ab-4e3d-bb90-b98c22065d63 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lazy-loading 'fault' on Instance uuid 074f3469-3bbd-46df-8286-3a57f91798e2 {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:22:20.478446 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-548afc7e-63ab-4e3d-bb90-b98c22065d63 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:20.512051 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-548afc7e-63ab-4e3d-bb90-b98c22065d63 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:20.515303 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-548afc7e-63ab-4e3d-bb90-b98c22065d63 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:20.520142 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-548afc7e-63ab-4e3d-bb90-b98c22065d63 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/074f3469-3bbd-46df-8286-3a57f91798e2" status: 200 len: 1270 microversion: 2.25 time: 0.366797 Oct 19 03:22:20.543710 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1206/2436] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:22:20 2022] GET /compute/v2.1/servers/074f3469-3bbd-46df-8286-3a57f91798e2 => generated 1270 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:22:20.564587 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-23fc6ad4-b895-4616-bb44-709f671b4828 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:20.564587 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-23fc6ad4-b895-4616-bb44-709f671b4828 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] [instance: 6ef505a5-0624-4080-9089-821f6fdfb47c] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:20.570881 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-23fc6ad4-b895-4616-bb44-709f671b4828 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:20.574747 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-23fc6ad4-b895-4616-bb44-709f671b4828 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:20.577062 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-23fc6ad4-b895-4616-bb44-709f671b4828 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:20.585740 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-23fc6ad4-b895-4616-bb44-709f671b4828 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:20.586527 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-23fc6ad4-b895-4616-bb44-709f671b4828 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:20.589786 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-23fc6ad4-b895-4616-bb44-709f671b4828 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:20.697831 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=10 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:22:21.184281 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-23fc6ad4-b895-4616-bb44-709f671b4828 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a222bb0f9a4c728d2ed5ca011c032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146393855c047be83270e5334c68e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:21.203165 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-23fc6ad4-b895-4616-bb44-709f671b4828 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] 10.222.0.52 "GET /compute/v2.1/servers/6ef505a5-0624-4080-9089-821f6fdfb47c" status: 200 len: 1318 microversion: 2.1 time: 0.655403 Oct 19 03:22:21.214218 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1207/2437] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:22:20 2022] GET /compute/v2.1/servers/6ef505a5-0624-4080-9089-821f6fdfb47c => generated 1318 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:22:21.232325 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4fa7b8d5-9aa3-4f72-b13b-a25c498e2bfd tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Action: 'create', calling method: .version_select at 0x7fc13024f160>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-793485337", "description": "tempest-description-193540996"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:22:21.594665 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f835c21f-7492-4422-b7f5-bd9f12b8eff2 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63cf2636aee743148721b5ba622de9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bc3a9713e04bafaf5812a87765de55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:21.630927 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f835c21f-7492-4422-b7f5-bd9f12b8eff2 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63cf2636aee743148721b5ba622de9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bc3a9713e04bafaf5812a87765de55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:21.632695 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f835c21f-7492-4422-b7f5-bd9f12b8eff2 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63cf2636aee743148721b5ba622de9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bc3a9713e04bafaf5812a87765de55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:21.639924 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f835c21f-7492-4422-b7f5-bd9f12b8eff2 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] 10.222.0.52 "GET /compute/v2.1/servers/b7ee1a20-f570-44ae-8e29-595fc6b3dcb6" status: 200 len: 1362 microversion: 2.26 time: 1.417362 Oct 19 03:22:21.642389 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1231/2438] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:22:20 2022] GET /compute/v2.1/servers/b7ee1a20-f570-44ae-8e29-595fc6b3dcb6 => generated 1362 bytes in 1425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:22:21.651259 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-d427a4e8-781d-4e1f-836e-f398492cdabb req-20525136-d90a-4e40-9cff-4678b481f2d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "410116db-4d00-4a9d-8375-a5cea6a0d627", "tag": "c7f441d5-a985-4c81-97b8-114d47006d03"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:22:21.663752 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-d427a4e8-781d-4e1f-836e-f398492cdabb req-20525136-d90a-4e40-9cff-4678b481f2d4 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:21.664261 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-d427a4e8-781d-4e1f-836e-f398492cdabb req-20525136-d90a-4e40-9cff-4678b481f2d4 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:21.664683 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-d427a4e8-781d-4e1f-836e-f398492cdabb req-20525136-d90a-4e40-9cff-4678b481f2d4 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:21.683356 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-d427a4e8-781d-4e1f-836e-f398492cdabb req-20525136-d90a-4e40-9cff-4678b481f2d4 service nova] Creating event network-changed:c7f441d5-a985-4c81-97b8-114d47006d03 for instance 410116db-4d00-4a9d-8375-a5cea6a0d627 on n-h2-861333-8 Oct 19 03:22:21.693857 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-d427a4e8-781d-4e1f-836e-f398492cdabb req-20525136-d90a-4e40-9cff-4678b481f2d4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045983 Oct 19 03:22:21.698164 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1232/2439] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:22:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:22:21.704978 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e89f5ff2-a3c4-4ea1-b830-29b112de244a tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:21.707873 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e89f5ff2-a3c4-4ea1-b830-29b112de244a tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: 6fd536f4-6456-4291-8a11-2c48a453932a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:21.721323 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e89f5ff2-a3c4-4ea1-b830-29b112de244a tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:21.722447 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e89f5ff2-a3c4-4ea1-b830-29b112de244a tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:21.723049 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e89f5ff2-a3c4-4ea1-b830-29b112de244a tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:21.724451 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e89f5ff2-a3c4-4ea1-b830-29b112de244a tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:21.725068 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e89f5ff2-a3c4-4ea1-b830-29b112de244a tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:21.725688 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e89f5ff2-a3c4-4ea1-b830-29b112de244a tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:21.768738 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e89f5ff2-a3c4-4ea1-b830-29b112de244a tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: 6fd536f4-6456-4291-8a11-2c48a453932a] Going to try to terminate instance {{(pid=121135) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:22:22.195149 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e89f5ff2-a3c4-4ea1-b830-29b112de244a tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "DELETE /compute/v2.1/servers/6fd536f4-6456-4291-8a11-2c48a453932a" status: 204 len: 0 microversion: 2.1 time: 0.495008 Oct 19 03:22:22.204402 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1233/2440] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:22:21 2022] DELETE /compute/v2.1/servers/6fd536f4-6456-4291-8a11-2c48a453932a => generated 0 bytes in 497 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:22:22.204402 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-2230938f-524d-49e9-8baf-7b77050b7922 req-c32ed584-0c94-491c-bbb7-54090b5c71d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ef505a5-0624-4080-9089-821f6fdfb47c", "tag": "3d68ba4c-839d-44ea-b4e3-7563b0f4650a"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:22:22.220769 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-2230938f-524d-49e9-8baf-7b77050b7922 req-c32ed584-0c94-491c-bbb7-54090b5c71d7 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:22.224087 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-2230938f-524d-49e9-8baf-7b77050b7922 req-c32ed584-0c94-491c-bbb7-54090b5c71d7 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:22.225942 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-2230938f-524d-49e9-8baf-7b77050b7922 req-c32ed584-0c94-491c-bbb7-54090b5c71d7 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:22.234851 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4fa7b8d5-9aa3-4f72-b13b-a25c498e2bfd tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 1.008182 Oct 19 03:22:22.236476 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1208/2441] 10.222.0.52 () {60 vars in 1180 bytes} [Wed Oct 19 03:22:21 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:22:22.241608 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4bddcc84-7b55-473c-8a84-3876a08fee38 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:22.242454 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4bddcc84-7b55-473c-8a84-3876a08fee38 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] [instance: b1acb084-c2bd-49b1-b38a-5e7630389abd] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:22.262840 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-2230938f-524d-49e9-8baf-7b77050b7922 req-c32ed584-0c94-491c-bbb7-54090b5c71d7 service nova] Creating event network-changed:3d68ba4c-839d-44ea-b4e3-7563b0f4650a for instance 6ef505a5-0624-4080-9089-821f6fdfb47c on n-h1-861333-8 Oct 19 03:22:22.267993 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4bddcc84-7b55-473c-8a84-3876a08fee38 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:22.268499 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4bddcc84-7b55-473c-8a84-3876a08fee38 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:22.268947 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4bddcc84-7b55-473c-8a84-3876a08fee38 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:22.272881 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4bddcc84-7b55-473c-8a84-3876a08fee38 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:22.274263 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4bddcc84-7b55-473c-8a84-3876a08fee38 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:22.276425 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4bddcc84-7b55-473c-8a84-3876a08fee38 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:22.281095 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-2230938f-524d-49e9-8baf-7b77050b7922 req-c32ed584-0c94-491c-bbb7-54090b5c71d7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083773 Oct 19 03:22:22.282994 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1234/2442] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:22:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:22:22.293084 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e3438359-46c4-429f-821d-680c1508e10d tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:22.299547 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e3438359-46c4-429f-821d-680c1508e10d tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 074f3469-3bbd-46df-8286-3a57f91798e2] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:22.311438 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e3438359-46c4-429f-821d-680c1508e10d tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:22.314780 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e3438359-46c4-429f-821d-680c1508e10d tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:22.315456 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e3438359-46c4-429f-821d-680c1508e10d tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:22.318656 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e3438359-46c4-429f-821d-680c1508e10d tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:22.319306 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e3438359-46c4-429f-821d-680c1508e10d tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:22.319929 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e3438359-46c4-429f-821d-680c1508e10d tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:22.353760 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-e3438359-46c4-429f-821d-680c1508e10d tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] HTTP exception thrown: Instance 074f3469-3bbd-46df-8286-3a57f91798e2 could not be found. Oct 19 03:22:22.357870 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4bddcc84-7b55-473c-8a84-3876a08fee38 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:22.358413 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4bddcc84-7b55-473c-8a84-3876a08fee38 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:22.358932 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4bddcc84-7b55-473c-8a84-3876a08fee38 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:22.359819 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-4bddcc84-7b55-473c-8a84-3876a08fee38 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lazy-loading 'fault' on Instance uuid b1acb084-c2bd-49b1-b38a-5e7630389abd {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:22:22.361999 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e3438359-46c4-429f-821d-680c1508e10d tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Request method failure captured: Oct 19 03:22:22.361999 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/074f3469-3bbd-46df-8286-3a57f91798e2 HTTP/1.1 Oct 19 03:22:22.361999 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:22:22.361999 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:22:22.361999 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:22:22.361999 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:22:22.361999 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:22:22.361999 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:22:22.361999 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:22:22.361999 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:22:22.361999 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2tcwFSozsDsogt_HZcdUgmGnTvZs8mzfeFkvs053pzVRjXX83ROjKcXxAHBTWN9olIwcvfh5hq7TjIjuqVNVroG0_bo0U9SvMsHfqMQQCgAJwV8poqheN5uAYUPiFrTwSdQzcOt_Ql8r-P63WnnR-1IArren7PYbX_jjeQwEmghEeI Oct 19 03:22:22.361999 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:22:22.361999 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:22:22.361999 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:22:22.361999 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:22:22.361999 n-d-861333-8 devstack@n-api.service[121135]: X-Openstack-Nova-Api-Version: 2.25 Oct 19 03:22:22.361999 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:22:22.361999 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:22:22.361999 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 86eaac72e51142f795b3e482be19c4f2 Oct 19 03:22:22.361999 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1644681798 Oct 19 03:22:22.361999 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:22:22.361999 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:22:22.363566 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/86eaac72e51142f795b3e482be19c4f2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/86eaac72e51142f795b3e482be19c4f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/86eaac72e51142f795b3e482be19c4f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_86eaac72e51142f795b3e482be19c4f2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:22:22.363566 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1644681798 Oct 19 03:22:22.363566 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 86eaac72e51142f795b3e482be19c4f2 Oct 19 03:22:22.363566 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1644681798 Oct 19 03:22:22.363566 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-LiveAutoBlockMigrationV225Test-1644681798-project Oct 19 03:22:22.363566 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:22:22.363566 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:22:22.363566 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 7a453f077dae4dfa8a3cf28c555a9a7c Oct 19 03:22:22.363566 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1644681798-project Oct 19 03:22:22.363566 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:22:22.363566 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance 074f3469-3bbd-46df-8286-3a57f91798e2 could not be found. Oct 19 03:22:22.363566 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '074f3469-3bbd-46df-8286-3a57f91798e2'} Oct 19 03:22:22.364423 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:22:22.364423 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:22:22.364423 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:22:22.364423 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:22:22.364423 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:22:22.364423 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:22:22.364423 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:22:22.364423 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:22:22.364423 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:22:22.364423 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:22:22.364423 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 074f3469-3bbd-46df-8286-3a57f91798e2 could not be found. Oct 19 03:22:22.364423 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:22:22.364423 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:22:22.364423 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:22:22.364423 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:22:22.364423 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:22:22.364423 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:22:22.364423 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:22:22.364423 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:22:22.364423 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:22:22.365798 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:22:22.365798 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:22:22.365798 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:22:22.365798 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:22:22.365798 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:22:22.365798 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:22:22.365798 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:22:22.365798 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 074f3469-3bbd-46df-8286-3a57f91798e2 could not be found. Oct 19 03:22:22.365798 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:22:22.365798 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:22:22.365798 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:22:22.365798 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:22:22.365798 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:22:22.365798 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:22:22.365798 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:22:22.365798 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:22:22.365798 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 074f3469-3bbd-46df-8286-3a57f91798e2 could not be found. Oct 19 03:22:22.365798 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:22:22.367811 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e3438359-46c4-429f-821d-680c1508e10d tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Returning 404 to user: Instance 074f3469-3bbd-46df-8286-3a57f91798e2 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:22:22.368718 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e3438359-46c4-429f-821d-680c1508e10d tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/074f3469-3bbd-46df-8286-3a57f91798e2" status: 404 len: 111 microversion: 2.25 time: 0.083068 Oct 19 03:22:22.369363 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1235/2443] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:22:22 2022] GET /compute/v2.1/servers/074f3469-3bbd-46df-8286-3a57f91798e2 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 19 03:22:22.388305 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-f12388eb-fddf-4edb-b950-76e84355e352 req-5ba7cb79-d7a0-49e1-a881-e00de6055481 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fd536f4-6456-4291-8a11-2c48a453932a", "name": "network-vif-unplugged", "status": "completed", "tag": "8a122a74-7a6e-4f35-ab43-ab8ca0ff35c0"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:22:22.425730 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-f12388eb-fddf-4edb-b950-76e84355e352 req-5ba7cb79-d7a0-49e1-a881-e00de6055481 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:22.427667 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-f12388eb-fddf-4edb-b950-76e84355e352 req-5ba7cb79-d7a0-49e1-a881-e00de6055481 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:22.428614 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-f12388eb-fddf-4edb-b950-76e84355e352 req-5ba7cb79-d7a0-49e1-a881-e00de6055481 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:22.446160 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-f12388eb-fddf-4edb-b950-76e84355e352 req-5ba7cb79-d7a0-49e1-a881-e00de6055481 service nova] Creating event network-vif-unplugged:8a122a74-7a6e-4f35-ab43-ab8ca0ff35c0 for instance 6fd536f4-6456-4291-8a11-2c48a453932a on n-h1-861333-8 Oct 19 03:22:22.453516 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-f12388eb-fddf-4edb-b950-76e84355e352 req-5ba7cb79-d7a0-49e1-a881-e00de6055481 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.082912 Oct 19 03:22:22.455331 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1236/2444] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:22:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:22:22.463906 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0bbad7bf-0077-46dd-bda7-e233728a5068 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:22.465552 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0bbad7bf-0077-46dd-bda7-e233728a5068 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] [instance: 6ef505a5-0624-4080-9089-821f6fdfb47c] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:22.467590 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-4bddcc84-7b55-473c-8a84-3876a08fee38 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4c5e4123c44508a5d4911a17c44231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a495ccfced47f29cb928d1ded20d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:22.475818 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0bbad7bf-0077-46dd-bda7-e233728a5068 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:22.479968 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0bbad7bf-0077-46dd-bda7-e233728a5068 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:22.479968 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0bbad7bf-0077-46dd-bda7-e233728a5068 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:22.481403 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0bbad7bf-0077-46dd-bda7-e233728a5068 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:22.482383 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0bbad7bf-0077-46dd-bda7-e233728a5068 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:22.483151 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0bbad7bf-0077-46dd-bda7-e233728a5068 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:22.485995 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4bddcc84-7b55-473c-8a84-3876a08fee38 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] 10.222.0.52 "GET /compute/v2.1/servers/b1acb084-c2bd-49b1-b38a-5e7630389abd" status: 200 len: 1303 microversion: 2.1 time: 0.245288 Oct 19 03:22:22.486618 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1209/2445] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:22:22 2022] GET /compute/v2.1/servers/b1acb084-c2bd-49b1-b38a-5e7630389abd => generated 1303 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:22:22.500081 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f69ce418-297b-412f-878b-c034751b922e tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Calling method '.version_select at 0x7fc13043f5e0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:22.786844 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-0bbad7bf-0077-46dd-bda7-e233728a5068 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a222bb0f9a4c728d2ed5ca011c032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146393855c047be83270e5334c68e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:22.796407 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0bbad7bf-0077-46dd-bda7-e233728a5068 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] 10.222.0.52 "GET /compute/v2.1/servers/6ef505a5-0624-4080-9089-821f6fdfb47c" status: 200 len: 1318 microversion: 2.1 time: 0.339915 Oct 19 03:22:22.798576 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1237/2446] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:22:22 2022] GET /compute/v2.1/servers/6ef505a5-0624-4080-9089-821f6fdfb47c => generated 1318 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:22:22.810427 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-96fcb07e-7a13-4c8f-b59a-57cd33545f56 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1077165539", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "networks": [{"uuid": "99edd0a7-1ab1-49c6-b3e8-36828942abe3"}]}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:22:22.913741 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.network.neutron [None req-96fcb07e-7a13-4c8f-b59a-57cd33545f56 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] validate_networks() for [('99edd0a7-1ab1-49c6-b3e8-36828942abe3', None, None, None, None, None)] {{(pid=121135) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:22:22.959490 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f69ce418-297b-412f-878b-c034751b922e tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] 10.222.0.52 "GET /compute/v2.1/os-security-groups" status: 200 len: 1832 microversion: 2.1 time: 0.471792 Oct 19 03:22:22.962449 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1210/2447] 10.222.0.52 () {58 vars in 1158 bytes} [Wed Oct 19 03:22:22 2022] GET /compute/v2.1/os-security-groups => generated 1832 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:22:22.968804 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e55ce492-af1c-4514-806a-3c46f8766b44 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:22.969645 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e55ce492-af1c-4514-806a-3c46f8766b44 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] [instance: b7ee1a20-f570-44ae-8e29-595fc6b3dcb6] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:22.977129 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e55ce492-af1c-4514-806a-3c46f8766b44 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:22.977972 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e55ce492-af1c-4514-806a-3c46f8766b44 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:22.978571 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e55ce492-af1c-4514-806a-3c46f8766b44 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:22.981844 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e55ce492-af1c-4514-806a-3c46f8766b44 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:22.981844 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e55ce492-af1c-4514-806a-3c46f8766b44 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:22.981844 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e55ce492-af1c-4514-806a-3c46f8766b44 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:23.262783 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e55ce492-af1c-4514-806a-3c46f8766b44 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63cf2636aee743148721b5ba622de9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bc3a9713e04bafaf5812a87765de55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:23.289978 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e55ce492-af1c-4514-806a-3c46f8766b44 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63cf2636aee743148721b5ba622de9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bc3a9713e04bafaf5812a87765de55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:23.296825 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e55ce492-af1c-4514-806a-3c46f8766b44 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63cf2636aee743148721b5ba622de9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bc3a9713e04bafaf5812a87765de55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:23.303600 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e55ce492-af1c-4514-806a-3c46f8766b44 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] 10.222.0.52 "GET /compute/v2.1/servers/b7ee1a20-f570-44ae-8e29-595fc6b3dcb6" status: 200 len: 1362 microversion: 2.26 time: 0.339070 Oct 19 03:22:23.307517 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1211/2448] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:22:22 2022] GET /compute/v2.1/servers/b7ee1a20-f570-44ae-8e29-595fc6b3dcb6 => generated 1362 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:22:23.324038 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-05cbfe76-d1cc-42cf-b39c-da9406108817 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Calling method '.version_select at 0x7fc13024e550>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:24.129420 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-05cbfe76-d1cc-42cf-b39c-da9406108817 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/98dc95fd-3ac4-4b56-962d-c9e3f9f380b3" status: 202 len: 0 microversion: 2.1 time: 0.812369 Oct 19 03:22:24.130821 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1212/2449] 10.222.0.52 () {58 vars in 1272 bytes} [Wed Oct 19 03:22:23 2022] DELETE /compute/v2.1/os-security-groups/98dc95fd-3ac4-4b56-962d-c9e3f9f380b3 => generated 0 bytes in 826 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:22:24.138193 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f2e83537-755f-4002-855f-4c4b5be72d5d tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:24.139254 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f2e83537-755f-4002-855f-4c4b5be72d5d tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] [instance: b1acb084-c2bd-49b1-b38a-5e7630389abd] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:24.171788 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f2e83537-755f-4002-855f-4c4b5be72d5d tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:24.173663 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f2e83537-755f-4002-855f-4c4b5be72d5d tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:24.174288 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f2e83537-755f-4002-855f-4c4b5be72d5d tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:24.175538 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f2e83537-755f-4002-855f-4c4b5be72d5d tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:24.176690 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f2e83537-755f-4002-855f-4c4b5be72d5d tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:24.177292 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f2e83537-755f-4002-855f-4c4b5be72d5d tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:24.245650 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-96fcb07e-7a13-4c8f-b59a-57cd33545f56 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Flavor limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:22:24.248990 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-96fcb07e-7a13-4c8f-b59a-57cd33545f56 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Image limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:22:24.250557 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-96fcb07e-7a13-4c8f-b59a-57cd33545f56 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Flavor pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:22:24.251447 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-96fcb07e-7a13-4c8f-b59a-57cd33545f56 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Image pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:22:24.252050 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-96fcb07e-7a13-4c8f-b59a-57cd33545f56 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:22:24.256913 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f2e83537-755f-4002-855f-4c4b5be72d5d tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:24.262472 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f2e83537-755f-4002-855f-4c4b5be72d5d tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:24.263780 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f2e83537-755f-4002-855f-4c4b5be72d5d tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:24.267288 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-f2e83537-755f-4002-855f-4c4b5be72d5d tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lazy-loading 'fault' on Instance uuid b1acb084-c2bd-49b1-b38a-5e7630389abd {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:22:24.272526 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-96fcb07e-7a13-4c8f-b59a-57cd33545f56 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:24.273127 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-96fcb07e-7a13-4c8f-b59a-57cd33545f56 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:24.273827 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-96fcb07e-7a13-4c8f-b59a-57cd33545f56 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:24.276440 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-96fcb07e-7a13-4c8f-b59a-57cd33545f56 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:24.278388 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-96fcb07e-7a13-4c8f-b59a-57cd33545f56 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:24.279096 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-96fcb07e-7a13-4c8f-b59a-57cd33545f56 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:24.331494 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-96fcb07e-7a13-4c8f-b59a-57cd33545f56 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Getting quotas for project 686dbeeaed0b44538a9bbc54d457a720. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:22:24.360312 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-96fcb07e-7a13-4c8f-b59a-57cd33545f56 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Getting quotas for user 57008d884859417ebc1456b55ec3f6e0 and project 686dbeeaed0b44538a9bbc54d457a720. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:22:24.402073 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-96fcb07e-7a13-4c8f-b59a-57cd33545f56 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Going to run 1 instances... {{(pid=121135) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:22:24.405978 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-96fcb07e-7a13-4c8f-b59a-57cd33545f56 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: c45890de-f7bf-4736-8b08-6f3e6863e2b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121135) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:22:24.623398 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-96fcb07e-7a13-4c8f-b59a-57cd33545f56 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.817038 Oct 19 03:22:24.624405 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1238/2450] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:22:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1826 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 03:22:24.635320 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-57c0a267-4afb-489e-ae9a-4e63d20eac9a req-ef3bf9cd-e6bc-4a71-a318-6ee8a3c804fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7ee1a20-f570-44ae-8e29-595fc6b3dcb6", "tag": "ae4be69b-546f-4929-8906-f31230a604dd"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:22:24.650207 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-57c0a267-4afb-489e-ae9a-4e63d20eac9a req-ef3bf9cd-e6bc-4a71-a318-6ee8a3c804fc service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:24.650701 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-57c0a267-4afb-489e-ae9a-4e63d20eac9a req-ef3bf9cd-e6bc-4a71-a318-6ee8a3c804fc service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:24.651134 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-57c0a267-4afb-489e-ae9a-4e63d20eac9a req-ef3bf9cd-e6bc-4a71-a318-6ee8a3c804fc service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:24.663164 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-57c0a267-4afb-489e-ae9a-4e63d20eac9a req-ef3bf9cd-e6bc-4a71-a318-6ee8a3c804fc service nova] Creating event network-changed:ae4be69b-546f-4929-8906-f31230a604dd for instance b7ee1a20-f570-44ae-8e29-595fc6b3dcb6 on n-h1-861333-8 Oct 19 03:22:24.685204 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-57c0a267-4afb-489e-ae9a-4e63d20eac9a req-ef3bf9cd-e6bc-4a71-a318-6ee8a3c804fc service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057526 Oct 19 03:22:24.688781 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1239/2451] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:22:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:22:24.697291 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6622eaa2-d897-4d12-93fb-deefe181f069 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:24.698304 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6622eaa2-d897-4d12-93fb-deefe181f069 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] [instance: 6ef505a5-0624-4080-9089-821f6fdfb47c] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:24.706319 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6622eaa2-d897-4d12-93fb-deefe181f069 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:24.712906 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6622eaa2-d897-4d12-93fb-deefe181f069 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:24.713464 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6622eaa2-d897-4d12-93fb-deefe181f069 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:24.716472 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6622eaa2-d897-4d12-93fb-deefe181f069 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:24.716963 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6622eaa2-d897-4d12-93fb-deefe181f069 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:24.720018 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6622eaa2-d897-4d12-93fb-deefe181f069 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:24.948159 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-f2e83537-755f-4002-855f-4c4b5be72d5d tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4c5e4123c44508a5d4911a17c44231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a495ccfced47f29cb928d1ded20d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:24.959546 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f2e83537-755f-4002-855f-4c4b5be72d5d tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] 10.222.0.52 "GET /compute/v2.1/servers/b1acb084-c2bd-49b1-b38a-5e7630389abd" status: 200 len: 1303 microversion: 2.1 time: 0.827400 Oct 19 03:22:24.960135 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1213/2452] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:22:24 2022] GET /compute/v2.1/servers/b1acb084-c2bd-49b1-b38a-5e7630389abd => generated 1303 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:22:24.975678 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3ed010b6-826a-4aa1-867c-88acea342df8 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Calling method '.version_select at 0x7fc13024a700>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:25.065300 n-d-861333-8 devstack@n-api.service[121134]: DEBUG neutronclient.v2_0.client [None req-3ed010b6-826a-4aa1-867c-88acea342df8 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 98dc95fd-3ac4-4b56-962d-c9e3f9f380b3 does not exist", "detail": ""}} {{(pid=121134) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 19 03:22:25.066119 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.security_group_api [None req-3ed010b6-826a-4aa1-867c-88acea342df8 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Neutron security group 98dc95fd-3ac4-4b56-962d-c9e3f9f380b3 not found {{(pid=121134) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 19 03:22:25.066820 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-3ed010b6-826a-4aa1-867c-88acea342df8 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] HTTP exception thrown: Security group 98dc95fd-3ac4-4b56-962d-c9e3f9f380b3 does not exist Oct 19 03:22:25.066820 n-d-861333-8 devstack@n-api.service[121134]: Neutron server returns request_ids: ['req-46a1a197-7caa-40f4-8610-669753b38a0a'] Oct 19 03:22:25.069294 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3ed010b6-826a-4aa1-867c-88acea342df8 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Request method failure captured: Oct 19 03:22:25.069294 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/os-security-groups/98dc95fd-3ac4-4b56-962d-c9e3f9f380b3 HTTP/1.1 Oct 19 03:22:25.069294 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:22:25.069294 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:22:25.069294 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:22:25.069294 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:22:25.069294 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:22:25.069294 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:22:25.069294 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:22:25.069294 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:22:25.069294 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT200KvQGsyi_a_sB4TfhhJOzMfG19jSa6oSlia6bg0oJGWsETmIFLMxsrnEQMCxFlXYpeXPwW52kFxfganN5M4cxj3tahAijx2xJ--2WsWYJtuNU3tc5IIgL3W8HC4CGP3frn8iROEzLPCi1mQC1-zUvq06vNZR4ARbYNlrlnvumYqI Oct 19 03:22:25.069294 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:22:25.069294 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:22:25.069294 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:22:25.069294 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:22:25.069294 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:22:25.069294 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:22:25.069294 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 385a1e7cceff48798bfefb9390e5979c Oct 19 03:22:25.069294 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-SecurityGroupsTestJSON-637911912 Oct 19 03:22:25.069294 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:22:25.069294 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:22:25.075127 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/385a1e7cceff48798bfefb9390e5979c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/385a1e7cceff48798bfefb9390e5979c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/385a1e7cceff48798bfefb9390e5979c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_385a1e7cceff48798bfefb9390e5979c", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:22:25.075127 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-SecurityGroupsTestJSON-637911912 Oct 19 03:22:25.075127 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 385a1e7cceff48798bfefb9390e5979c Oct 19 03:22:25.075127 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-637911912 Oct 19 03:22:25.075127 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-SecurityGroupsTestJSON-637911912-project Oct 19 03:22:25.075127 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:22:25.075127 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:22:25.075127 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 3661010393d44c428fb37652b1717072 Oct 19 03:22:25.075127 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-SecurityGroupsTestJSON-637911912-project Oct 19 03:22:25.075127 n-d-861333-8 devstack@n-api.service[121134]: method: Oct 19 03:22:25.075127 n-d-861333-8 devstack@n-api.service[121134]: exception: Security group 98dc95fd-3ac4-4b56-962d-c9e3f9f380b3 does not exist Oct 19 03:22:25.075127 n-d-861333-8 devstack@n-api.service[121134]: Neutron server returns request_ids: ['req-46a1a197-7caa-40f4-8610-669753b38a0a'] Oct 19 03:22:25.075127 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '98dc95fd-3ac4-4b56-962d-c9e3f9f380b3'} Oct 19 03:22:25.076099 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:22:25.076099 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:22:25.076099 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 19 03:22:25.076099 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 19 03:22:25.076099 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:22:25.076099 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:22:25.076099 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 19 03:22:25.076099 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 19 03:22:25.076099 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:22:25.076099 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:22:25.076099 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 19 03:22:25.076099 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 19 03:22:25.076099 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:22:25.076099 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:22:25.076099 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 19 03:22:25.076099 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 19 03:22:25.076099 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:22:25.076099 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:22:25.076099 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 19 03:22:25.077165 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 19 03:22:25.077165 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:22:25.077165 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:22:25.077165 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 19 03:22:25.077165 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 19 03:22:25.077165 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 19 03:22:25.077165 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 19 03:22:25.077165 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 98dc95fd-3ac4-4b56-962d-c9e3f9f380b3 does not exist Oct 19 03:22:25.077165 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-46a1a197-7caa-40f4-8610-669753b38a0a'] Oct 19 03:22:25.077165 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:22:25.077165 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:22:25.077165 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:22:25.077165 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:22:25.077165 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 19 03:22:25.077165 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 19 03:22:25.077165 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 19 03:22:25.077165 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 19 03:22:25.077165 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 98dc95fd-3ac4-4b56-962d-c9e3f9f380b3 does not exist Oct 19 03:22:25.078197 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-46a1a197-7caa-40f4-8610-669753b38a0a'] Oct 19 03:22:25.078197 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:22:25.078197 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:22:25.078197 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:22:25.078197 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:22:25.078197 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:22:25.078197 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:22:25.078197 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:22:25.078197 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:22:25.078197 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 03:22:25.078197 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 03:22:25.078197 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:22:25.078197 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:22:25.078197 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 19 03:22:25.078197 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 19 03:22:25.078197 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 98dc95fd-3ac4-4b56-962d-c9e3f9f380b3 does not exist Oct 19 03:22:25.078197 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-46a1a197-7caa-40f4-8610-669753b38a0a'] Oct 19 03:22:25.078197 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:22:25.078197 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:22:25.078197 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:22:25.078197 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:22:25.079501 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:22:25.079501 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:22:25.079501 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:22:25.079501 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:22:25.079501 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 98dc95fd-3ac4-4b56-962d-c9e3f9f380b3 does not exist Oct 19 03:22:25.079501 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-46a1a197-7caa-40f4-8610-669753b38a0a'] Oct 19 03:22:25.079501 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:22:25.079501 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3ed010b6-826a-4aa1-867c-88acea342df8 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Returning 404 to user: Security group 98dc95fd-3ac4-4b56-962d-c9e3f9f380b3 does not exist Oct 19 03:22:25.079501 n-d-861333-8 devstack@n-api.service[121134]: Neutron server returns request_ids: ['req-46a1a197-7caa-40f4-8610-669753b38a0a'] {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:22:25.079501 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3ed010b6-826a-4aa1-867c-88acea342df8 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] 10.222.0.52 "GET /compute/v2.1/os-security-groups/98dc95fd-3ac4-4b56-962d-c9e3f9f380b3" status: 404 len: 194 microversion: 2.1 time: 0.106979 Oct 19 03:22:25.079501 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1214/2453] 10.222.0.52 () {58 vars in 1269 bytes} [Wed Oct 19 03:22:24 2022] GET /compute/v2.1/os-security-groups/98dc95fd-3ac4-4b56-962d-c9e3f9f380b3 => generated 194 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:22:25.088459 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-e5f76594-587c-4052-976a-5773cf840ecd req-9104c60f-1e86-4036-90c8-d30b90c9e9b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1acb084-c2bd-49b1-b38a-5e7630389abd", "name": "network-vif-deleted", "tag": "4f0a4fb9-fac6-42f2-b204-c5448efc4ee9"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:22:25.112099 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-e5f76594-587c-4052-976a-5773cf840ecd req-9104c60f-1e86-4036-90c8-d30b90c9e9b7 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:25.112584 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-e5f76594-587c-4052-976a-5773cf840ecd req-9104c60f-1e86-4036-90c8-d30b90c9e9b7 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:25.113011 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-e5f76594-587c-4052-976a-5773cf840ecd req-9104c60f-1e86-4036-90c8-d30b90c9e9b7 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:25.142073 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-e5f76594-587c-4052-976a-5773cf840ecd req-9104c60f-1e86-4036-90c8-d30b90c9e9b7 service nova] Creating event network-vif-deleted:4f0a4fb9-fac6-42f2-b204-c5448efc4ee9 for instance b1acb084-c2bd-49b1-b38a-5e7630389abd on n-h1-861333-8 Oct 19 03:22:25.154448 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-e5f76594-587c-4052-976a-5773cf840ecd req-9104c60f-1e86-4036-90c8-d30b90c9e9b7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081055 Oct 19 03:22:25.162291 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1215/2454] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:22:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:22:25.168644 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-be61573e-a65d-4f15-bd08-d6c5b448ab8c tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:25.177818 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-be61573e-a65d-4f15-bd08-d6c5b448ab8c tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] [instance: b7ee1a20-f570-44ae-8e29-595fc6b3dcb6] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:25.186462 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-be61573e-a65d-4f15-bd08-d6c5b448ab8c tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:25.189536 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-be61573e-a65d-4f15-bd08-d6c5b448ab8c tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:25.189990 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-be61573e-a65d-4f15-bd08-d6c5b448ab8c tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:25.190724 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-be61573e-a65d-4f15-bd08-d6c5b448ab8c tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:25.191204 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-be61573e-a65d-4f15-bd08-d6c5b448ab8c tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:25.195459 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-be61573e-a65d-4f15-bd08-d6c5b448ab8c tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:25.386801 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-6622eaa2-d897-4d12-93fb-deefe181f069 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a222bb0f9a4c728d2ed5ca011c032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146393855c047be83270e5334c68e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:25.410558 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6622eaa2-d897-4d12-93fb-deefe181f069 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] 10.222.0.52 "GET /compute/v2.1/servers/6ef505a5-0624-4080-9089-821f6fdfb47c" status: 200 len: 1318 microversion: 2.1 time: 0.720123 Oct 19 03:22:25.411405 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1240/2455] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:22:24 2022] GET /compute/v2.1/servers/6ef505a5-0624-4080-9089-821f6fdfb47c => generated 1318 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:22:25.428726 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-992fa4fe-3ebe-462e-8eef-5f220a3edbc6 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:25.428726 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-992fa4fe-3ebe-462e-8eef-5f220a3edbc6 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: c45890de-f7bf-4736-8b08-6f3e6863e2b3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:25.556425 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-992fa4fe-3ebe-462e-8eef-5f220a3edbc6 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:25.572750 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-992fa4fe-3ebe-462e-8eef-5f220a3edbc6 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/c45890de-f7bf-4736-8b08-6f3e6863e2b3" status: 200 len: 1208 microversion: 2.1 time: 0.156402 Oct 19 03:22:25.592444 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1241/2456] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:22:25 2022] GET /compute/v2.1/servers/c45890de-f7bf-4736-8b08-6f3e6863e2b3 => generated 1208 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:22:25.605687 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-01dd2bf2-07ba-4346-bab6-895a031bbcb6 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Calling method '.version_select at 0x7fc134f74280>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:25.640344 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-be61573e-a65d-4f15-bd08-d6c5b448ab8c tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63cf2636aee743148721b5ba622de9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bc3a9713e04bafaf5812a87765de55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:25.653519 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-be61573e-a65d-4f15-bd08-d6c5b448ab8c tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63cf2636aee743148721b5ba622de9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bc3a9713e04bafaf5812a87765de55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:25.657711 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-be61573e-a65d-4f15-bd08-d6c5b448ab8c tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63cf2636aee743148721b5ba622de9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bc3a9713e04bafaf5812a87765de55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:25.659733 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-be61573e-a65d-4f15-bd08-d6c5b448ab8c tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] 10.222.0.52 "GET /compute/v2.1/servers/b7ee1a20-f570-44ae-8e29-595fc6b3dcb6" status: 200 len: 1362 microversion: 2.26 time: 0.496056 Oct 19 03:22:25.662596 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1216/2457] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:22:25 2022] GET /compute/v2.1/servers/b7ee1a20-f570-44ae-8e29-595fc6b3dcb6 => generated 1362 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:22:25.993668 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b9b4ad72-ea05-429a-9723-8684a547a005 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:25.994291 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b9b4ad72-ea05-429a-9723-8684a547a005 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] [instance: b1acb084-c2bd-49b1-b38a-5e7630389abd] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:26.005704 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b9b4ad72-ea05-429a-9723-8684a547a005 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:26.009255 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b9b4ad72-ea05-429a-9723-8684a547a005 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:26.009255 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b9b4ad72-ea05-429a-9723-8684a547a005 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:26.009255 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b9b4ad72-ea05-429a-9723-8684a547a005 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:26.009255 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b9b4ad72-ea05-429a-9723-8684a547a005 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:26.009821 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b9b4ad72-ea05-429a-9723-8684a547a005 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:26.053203 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b9b4ad72-ea05-429a-9723-8684a547a005 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:26.053832 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b9b4ad72-ea05-429a-9723-8684a547a005 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:26.054623 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b9b4ad72-ea05-429a-9723-8684a547a005 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:26.060233 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-b9b4ad72-ea05-429a-9723-8684a547a005 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lazy-loading 'fault' on Instance uuid b1acb084-c2bd-49b1-b38a-5e7630389abd {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:22:26.113245 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b9b4ad72-ea05-429a-9723-8684a547a005 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4c5e4123c44508a5d4911a17c44231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a495ccfced47f29cb928d1ded20d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:26.127610 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b9b4ad72-ea05-429a-9723-8684a547a005 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] 10.222.0.52 "GET /compute/v2.1/servers/b1acb084-c2bd-49b1-b38a-5e7630389abd" status: 200 len: 1303 microversion: 2.1 time: 0.143223 Oct 19 03:22:26.129048 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1217/2458] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:22:25 2022] GET /compute/v2.1/servers/b1acb084-c2bd-49b1-b38a-5e7630389abd => generated 1303 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:22:26.180905 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-01dd2bf2-07ba-4346-bab6-895a031bbcb6 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/0445a54a-53eb-436c-b6e4-d171f1875c19" status: 202 len: 0 microversion: 2.1 time: 0.586624 Oct 19 03:22:26.184815 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1242/2459] 10.222.0.52 () {58 vars in 1272 bytes} [Wed Oct 19 03:22:25 2022] DELETE /compute/v2.1/os-security-groups/0445a54a-53eb-436c-b6e4-d171f1875c19 => generated 0 bytes in 591 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:22:26.189996 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-bd588302-840e-48da-8b12-6bd66ad168f8 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Calling method '.version_select at 0x7fc130246a60>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:26.317467 n-d-861333-8 devstack@n-api.service[121134]: DEBUG neutronclient.v2_0.client [None req-bd588302-840e-48da-8b12-6bd66ad168f8 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 0445a54a-53eb-436c-b6e4-d171f1875c19 does not exist", "detail": ""}} {{(pid=121134) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 19 03:22:26.318146 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.security_group_api [None req-bd588302-840e-48da-8b12-6bd66ad168f8 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Neutron security group 0445a54a-53eb-436c-b6e4-d171f1875c19 not found {{(pid=121134) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 19 03:22:26.318562 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-bd588302-840e-48da-8b12-6bd66ad168f8 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] HTTP exception thrown: Security group 0445a54a-53eb-436c-b6e4-d171f1875c19 does not exist Oct 19 03:22:26.318562 n-d-861333-8 devstack@n-api.service[121134]: Neutron server returns request_ids: ['req-b6e54cbf-ce04-4716-aae2-35c5b93f6767'] Oct 19 03:22:26.320518 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-bd588302-840e-48da-8b12-6bd66ad168f8 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Request method failure captured: Oct 19 03:22:26.320518 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/os-security-groups/0445a54a-53eb-436c-b6e4-d171f1875c19 HTTP/1.1 Oct 19 03:22:26.320518 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:22:26.320518 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:22:26.320518 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:22:26.320518 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:22:26.320518 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:22:26.320518 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:22:26.320518 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:22:26.320518 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:22:26.320518 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT200KvQGsyi_a_sB4TfhhJOzMfG19jSa6oSlia6bg0oJGWsETmIFLMxsrnEQMCxFlXYpeXPwW52kFxfganN5M4cxj3tahAijx2xJ--2WsWYJtuNU3tc5IIgL3W8HC4CGP3frn8iROEzLPCi1mQC1-zUvq06vNZR4ARbYNlrlnvumYqI Oct 19 03:22:26.320518 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:22:26.320518 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:22:26.320518 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:22:26.320518 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:22:26.320518 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:22:26.320518 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:22:26.320518 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 385a1e7cceff48798bfefb9390e5979c Oct 19 03:22:26.320518 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-SecurityGroupsTestJSON-637911912 Oct 19 03:22:26.320518 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:22:26.320518 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:22:26.321710 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/385a1e7cceff48798bfefb9390e5979c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/385a1e7cceff48798bfefb9390e5979c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/385a1e7cceff48798bfefb9390e5979c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_385a1e7cceff48798bfefb9390e5979c", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:22:26.321710 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-SecurityGroupsTestJSON-637911912 Oct 19 03:22:26.321710 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 385a1e7cceff48798bfefb9390e5979c Oct 19 03:22:26.321710 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-637911912 Oct 19 03:22:26.321710 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-SecurityGroupsTestJSON-637911912-project Oct 19 03:22:26.321710 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:22:26.321710 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:22:26.321710 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 3661010393d44c428fb37652b1717072 Oct 19 03:22:26.321710 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-SecurityGroupsTestJSON-637911912-project Oct 19 03:22:26.321710 n-d-861333-8 devstack@n-api.service[121134]: method: Oct 19 03:22:26.321710 n-d-861333-8 devstack@n-api.service[121134]: exception: Security group 0445a54a-53eb-436c-b6e4-d171f1875c19 does not exist Oct 19 03:22:26.321710 n-d-861333-8 devstack@n-api.service[121134]: Neutron server returns request_ids: ['req-b6e54cbf-ce04-4716-aae2-35c5b93f6767'] Oct 19 03:22:26.321710 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '0445a54a-53eb-436c-b6e4-d171f1875c19'} Oct 19 03:22:26.322410 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:22:26.322410 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:22:26.322410 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 19 03:22:26.322410 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 19 03:22:26.322410 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:22:26.322410 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:22:26.322410 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 19 03:22:26.322410 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 19 03:22:26.322410 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:22:26.322410 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:22:26.322410 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 19 03:22:26.322410 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 19 03:22:26.322410 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:22:26.322410 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:22:26.322410 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 19 03:22:26.322410 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 19 03:22:26.322410 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:22:26.322410 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:22:26.322410 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 19 03:22:26.323374 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 19 03:22:26.323374 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:22:26.323374 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:22:26.323374 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 19 03:22:26.323374 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 19 03:22:26.323374 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 19 03:22:26.323374 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 19 03:22:26.323374 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 0445a54a-53eb-436c-b6e4-d171f1875c19 does not exist Oct 19 03:22:26.323374 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b6e54cbf-ce04-4716-aae2-35c5b93f6767'] Oct 19 03:22:26.323374 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:22:26.323374 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:22:26.323374 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:22:26.323374 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:22:26.323374 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 19 03:22:26.323374 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 19 03:22:26.323374 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 19 03:22:26.323374 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 19 03:22:26.323374 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 0445a54a-53eb-436c-b6e4-d171f1875c19 does not exist Oct 19 03:22:26.325105 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b6e54cbf-ce04-4716-aae2-35c5b93f6767'] Oct 19 03:22:26.325105 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:22:26.325105 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:22:26.325105 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:22:26.325105 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:22:26.325105 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:22:26.325105 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:22:26.325105 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:22:26.325105 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:22:26.325105 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 03:22:26.325105 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 03:22:26.325105 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:22:26.325105 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:22:26.325105 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 19 03:22:26.325105 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 19 03:22:26.325105 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 0445a54a-53eb-436c-b6e4-d171f1875c19 does not exist Oct 19 03:22:26.325105 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b6e54cbf-ce04-4716-aae2-35c5b93f6767'] Oct 19 03:22:26.325105 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:22:26.325105 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:22:26.325105 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:22:26.325105 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:22:26.327674 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:22:26.327674 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:22:26.327674 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:22:26.327674 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:22:26.327674 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 0445a54a-53eb-436c-b6e4-d171f1875c19 does not exist Oct 19 03:22:26.327674 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b6e54cbf-ce04-4716-aae2-35c5b93f6767'] Oct 19 03:22:26.327674 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:22:26.327674 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-bd588302-840e-48da-8b12-6bd66ad168f8 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Returning 404 to user: Security group 0445a54a-53eb-436c-b6e4-d171f1875c19 does not exist Oct 19 03:22:26.327674 n-d-861333-8 devstack@n-api.service[121134]: Neutron server returns request_ids: ['req-b6e54cbf-ce04-4716-aae2-35c5b93f6767'] {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:22:26.327674 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-bd588302-840e-48da-8b12-6bd66ad168f8 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] 10.222.0.52 "GET /compute/v2.1/os-security-groups/0445a54a-53eb-436c-b6e4-d171f1875c19" status: 404 len: 194 microversion: 2.1 time: 0.136983 Oct 19 03:22:26.327674 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1218/2460] 10.222.0.52 () {58 vars in 1269 bytes} [Wed Oct 19 03:22:26 2022] GET /compute/v2.1/os-security-groups/0445a54a-53eb-436c-b6e4-d171f1875c19 => generated 194 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 03:22:26.332945 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4e2f2aa2-04b9-4476-a76e-ad224ae67282 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Calling method '.version_select at 0x7fc1350834c0>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:26.436769 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b3c53628-8c94-467d-910d-070bc7d5bd55 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:26.437729 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b3c53628-8c94-467d-910d-070bc7d5bd55 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] [instance: 6ef505a5-0624-4080-9089-821f6fdfb47c] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:26.448845 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b3c53628-8c94-467d-910d-070bc7d5bd55 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:26.449607 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b3c53628-8c94-467d-910d-070bc7d5bd55 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:26.450204 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b3c53628-8c94-467d-910d-070bc7d5bd55 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:26.451394 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b3c53628-8c94-467d-910d-070bc7d5bd55 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:26.452007 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b3c53628-8c94-467d-910d-070bc7d5bd55 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:26.452663 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b3c53628-8c94-467d-910d-070bc7d5bd55 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:26.703569 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b3c53628-8c94-467d-910d-070bc7d5bd55 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a222bb0f9a4c728d2ed5ca011c032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146393855c047be83270e5334c68e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:26.713650 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b3c53628-8c94-467d-910d-070bc7d5bd55 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] 10.222.0.52 "GET /compute/v2.1/servers/6ef505a5-0624-4080-9089-821f6fdfb47c" status: 200 len: 1318 microversion: 2.1 time: 0.281328 Oct 19 03:22:26.726481 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1219/2461] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:22:26 2022] GET /compute/v2.1/servers/6ef505a5-0624-4080-9089-821f6fdfb47c => generated 1318 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:22:26.739424 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c40e58a2-d55e-428f-bd68-979b47ce2910 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:26.740946 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c40e58a2-d55e-428f-bd68-979b47ce2910 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: c45890de-f7bf-4736-8b08-6f3e6863e2b3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:26.753842 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c40e58a2-d55e-428f-bd68-979b47ce2910 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:26.754370 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c40e58a2-d55e-428f-bd68-979b47ce2910 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:26.754806 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c40e58a2-d55e-428f-bd68-979b47ce2910 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:26.755641 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c40e58a2-d55e-428f-bd68-979b47ce2910 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:26.756195 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c40e58a2-d55e-428f-bd68-979b47ce2910 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:26.757401 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c40e58a2-d55e-428f-bd68-979b47ce2910 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:26.817601 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4e2f2aa2-04b9-4476-a76e-ad224ae67282 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/01df0d23-d4a3-48cc-9de5-57177768e76e" status: 202 len: 0 microversion: 2.1 time: 0.489171 Oct 19 03:22:26.819069 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1243/2462] 10.222.0.52 () {58 vars in 1272 bytes} [Wed Oct 19 03:22:26 2022] DELETE /compute/v2.1/os-security-groups/01df0d23-d4a3-48cc-9de5-57177768e76e => generated 0 bytes in 492 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:22:26.829290 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d0ee2d07-c20e-4642-bf02-63f6d011e0d9 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:26.829897 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d0ee2d07-c20e-4642-bf02-63f6d011e0d9 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] [instance: b7ee1a20-f570-44ae-8e29-595fc6b3dcb6] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:26.866059 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d0ee2d07-c20e-4642-bf02-63f6d011e0d9 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:26.866660 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d0ee2d07-c20e-4642-bf02-63f6d011e0d9 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:26.873821 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d0ee2d07-c20e-4642-bf02-63f6d011e0d9 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:26.886879 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d0ee2d07-c20e-4642-bf02-63f6d011e0d9 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:26.889313 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d0ee2d07-c20e-4642-bf02-63f6d011e0d9 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:26.890066 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c40e58a2-d55e-428f-bd68-979b47ce2910 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:26.895317 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d0ee2d07-c20e-4642-bf02-63f6d011e0d9 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:26.907375 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c40e58a2-d55e-428f-bd68-979b47ce2910 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/c45890de-f7bf-4736-8b08-6f3e6863e2b3" status: 200 len: 1204 microversion: 2.1 time: 0.175223 Oct 19 03:22:26.912913 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1220/2463] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:22:26 2022] GET /compute/v2.1/servers/c45890de-f7bf-4736-8b08-6f3e6863e2b3 => generated 1204 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:22:26.923398 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-11ee8f31-ff05-4b41-bdf1-790b910a15ca tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Calling method '.version_select at 0x7fc130503040>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:27.011367 n-d-861333-8 devstack@n-api.service[121134]: DEBUG neutronclient.v2_0.client [None req-11ee8f31-ff05-4b41-bdf1-790b910a15ca tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 01df0d23-d4a3-48cc-9de5-57177768e76e does not exist", "detail": ""}} {{(pid=121134) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 19 03:22:27.012284 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.security_group_api [None req-11ee8f31-ff05-4b41-bdf1-790b910a15ca tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Neutron security group 01df0d23-d4a3-48cc-9de5-57177768e76e not found {{(pid=121134) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 19 03:22:27.012968 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-11ee8f31-ff05-4b41-bdf1-790b910a15ca tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] HTTP exception thrown: Security group 01df0d23-d4a3-48cc-9de5-57177768e76e does not exist Oct 19 03:22:27.012968 n-d-861333-8 devstack@n-api.service[121134]: Neutron server returns request_ids: ['req-b3cc76e0-197a-40f4-93a8-3ef66d279d9d'] Oct 19 03:22:27.018804 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-11ee8f31-ff05-4b41-bdf1-790b910a15ca tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Request method failure captured: Oct 19 03:22:27.018804 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/os-security-groups/01df0d23-d4a3-48cc-9de5-57177768e76e HTTP/1.1 Oct 19 03:22:27.018804 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:22:27.018804 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:22:27.018804 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:22:27.018804 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:22:27.018804 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:22:27.018804 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:22:27.018804 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:22:27.018804 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:22:27.018804 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT200KvQGsyi_a_sB4TfhhJOzMfG19jSa6oSlia6bg0oJGWsETmIFLMxsrnEQMCxFlXYpeXPwW52kFxfganN5M4cxj3tahAijx2xJ--2WsWYJtuNU3tc5IIgL3W8HC4CGP3frn8iROEzLPCi1mQC1-zUvq06vNZR4ARbYNlrlnvumYqI Oct 19 03:22:27.018804 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:22:27.018804 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:22:27.018804 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:22:27.018804 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:22:27.018804 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:22:27.018804 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:22:27.018804 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 385a1e7cceff48798bfefb9390e5979c Oct 19 03:22:27.018804 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-SecurityGroupsTestJSON-637911912 Oct 19 03:22:27.018804 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:22:27.018804 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:22:27.023093 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/385a1e7cceff48798bfefb9390e5979c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/385a1e7cceff48798bfefb9390e5979c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/385a1e7cceff48798bfefb9390e5979c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_385a1e7cceff48798bfefb9390e5979c", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:22:27.023093 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-SecurityGroupsTestJSON-637911912 Oct 19 03:22:27.023093 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 385a1e7cceff48798bfefb9390e5979c Oct 19 03:22:27.023093 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-637911912 Oct 19 03:22:27.023093 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-SecurityGroupsTestJSON-637911912-project Oct 19 03:22:27.023093 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:22:27.023093 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:22:27.023093 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 3661010393d44c428fb37652b1717072 Oct 19 03:22:27.023093 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-SecurityGroupsTestJSON-637911912-project Oct 19 03:22:27.023093 n-d-861333-8 devstack@n-api.service[121134]: method: Oct 19 03:22:27.023093 n-d-861333-8 devstack@n-api.service[121134]: exception: Security group 01df0d23-d4a3-48cc-9de5-57177768e76e does not exist Oct 19 03:22:27.023093 n-d-861333-8 devstack@n-api.service[121134]: Neutron server returns request_ids: ['req-b3cc76e0-197a-40f4-93a8-3ef66d279d9d'] Oct 19 03:22:27.023093 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '01df0d23-d4a3-48cc-9de5-57177768e76e'} Oct 19 03:22:27.023783 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:22:27.023783 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:22:27.023783 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 19 03:22:27.023783 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 19 03:22:27.023783 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:22:27.023783 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:22:27.023783 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 19 03:22:27.023783 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 19 03:22:27.023783 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:22:27.023783 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:22:27.023783 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 19 03:22:27.023783 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 19 03:22:27.023783 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:22:27.023783 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:22:27.023783 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 19 03:22:27.023783 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 19 03:22:27.023783 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:22:27.023783 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:22:27.023783 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 19 03:22:27.024784 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 19 03:22:27.024784 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:22:27.024784 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:22:27.024784 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 19 03:22:27.024784 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 19 03:22:27.024784 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 19 03:22:27.024784 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 19 03:22:27.024784 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 01df0d23-d4a3-48cc-9de5-57177768e76e does not exist Oct 19 03:22:27.024784 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b3cc76e0-197a-40f4-93a8-3ef66d279d9d'] Oct 19 03:22:27.024784 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:22:27.024784 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:22:27.024784 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:22:27.024784 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:22:27.024784 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 19 03:22:27.024784 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 19 03:22:27.024784 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 19 03:22:27.024784 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 19 03:22:27.024784 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 01df0d23-d4a3-48cc-9de5-57177768e76e does not exist Oct 19 03:22:27.025928 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b3cc76e0-197a-40f4-93a8-3ef66d279d9d'] Oct 19 03:22:27.025928 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:22:27.025928 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:22:27.025928 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:22:27.025928 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:22:27.025928 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:22:27.025928 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:22:27.025928 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:22:27.025928 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:22:27.025928 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 03:22:27.025928 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 03:22:27.025928 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:22:27.025928 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:22:27.025928 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 19 03:22:27.025928 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 19 03:22:27.025928 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 01df0d23-d4a3-48cc-9de5-57177768e76e does not exist Oct 19 03:22:27.025928 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b3cc76e0-197a-40f4-93a8-3ef66d279d9d'] Oct 19 03:22:27.025928 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:22:27.025928 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:22:27.025928 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:22:27.025928 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:22:27.027220 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:22:27.027220 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:22:27.027220 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:22:27.027220 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:22:27.027220 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 01df0d23-d4a3-48cc-9de5-57177768e76e does not exist Oct 19 03:22:27.027220 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b3cc76e0-197a-40f4-93a8-3ef66d279d9d'] Oct 19 03:22:27.027220 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:22:27.027220 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-11ee8f31-ff05-4b41-bdf1-790b910a15ca tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Returning 404 to user: Security group 01df0d23-d4a3-48cc-9de5-57177768e76e does not exist Oct 19 03:22:27.027220 n-d-861333-8 devstack@n-api.service[121134]: Neutron server returns request_ids: ['req-b3cc76e0-197a-40f4-93a8-3ef66d279d9d'] {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:22:27.027220 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-11ee8f31-ff05-4b41-bdf1-790b910a15ca tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] 10.222.0.52 "GET /compute/v2.1/os-security-groups/01df0d23-d4a3-48cc-9de5-57177768e76e" status: 404 len: 194 microversion: 2.1 time: 0.111218 Oct 19 03:22:27.027220 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1221/2464] 10.222.0.52 () {58 vars in 1269 bytes} [Wed Oct 19 03:22:26 2022] GET /compute/v2.1/os-security-groups/01df0d23-d4a3-48cc-9de5-57177768e76e => generated 194 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:22:27.040319 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-07558edb-fcfe-4f4c-8b68-91b581cefd4f tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Calling method '.version_select at 0x7fc13024e820>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:27.431487 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d0ee2d07-c20e-4642-bf02-63f6d011e0d9 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63cf2636aee743148721b5ba622de9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bc3a9713e04bafaf5812a87765de55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:27.447275 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d0ee2d07-c20e-4642-bf02-63f6d011e0d9 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63cf2636aee743148721b5ba622de9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bc3a9713e04bafaf5812a87765de55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:27.449658 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d0ee2d07-c20e-4642-bf02-63f6d011e0d9 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63cf2636aee743148721b5ba622de9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bc3a9713e04bafaf5812a87765de55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:27.451542 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d0ee2d07-c20e-4642-bf02-63f6d011e0d9 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] 10.222.0.52 "GET /compute/v2.1/servers/b7ee1a20-f570-44ae-8e29-595fc6b3dcb6" status: 200 len: 1362 microversion: 2.26 time: 0.629603 Oct 19 03:22:27.458214 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1244/2465] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:22:26 2022] GET /compute/v2.1/servers/b7ee1a20-f570-44ae-8e29-595fc6b3dcb6 => generated 1362 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:22:27.463261 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-908709c0-69a2-454c-8f12-85a1f4364c0a tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:27.463898 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-908709c0-69a2-454c-8f12-85a1f4364c0a tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] [instance: b1acb084-c2bd-49b1-b38a-5e7630389abd] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:27.481502 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-908709c0-69a2-454c-8f12-85a1f4364c0a tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:27.482191 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-908709c0-69a2-454c-8f12-85a1f4364c0a tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:27.482836 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-908709c0-69a2-454c-8f12-85a1f4364c0a tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:27.483723 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-908709c0-69a2-454c-8f12-85a1f4364c0a tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:27.484391 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-908709c0-69a2-454c-8f12-85a1f4364c0a tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:27.485020 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-908709c0-69a2-454c-8f12-85a1f4364c0a tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:27.522835 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-908709c0-69a2-454c-8f12-85a1f4364c0a tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] HTTP exception thrown: Instance b1acb084-c2bd-49b1-b38a-5e7630389abd could not be found. Oct 19 03:22:27.524728 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-908709c0-69a2-454c-8f12-85a1f4364c0a tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Request method failure captured: Oct 19 03:22:27.524728 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/b1acb084-c2bd-49b1-b38a-5e7630389abd HTTP/1.1 Oct 19 03:22:27.524728 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:22:27.524728 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:22:27.524728 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:22:27.524728 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:22:27.524728 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:22:27.524728 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:22:27.524728 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:22:27.524728 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:22:27.524728 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2zDUs0PfKBQXbcZfGGAccSRG5jgb02LYsGmYLP1ROuYjn-BamP9m6xLekYIRWRDh4DgJHaPUk4VOJvLHFJIs4DKzlVqtqHDa4_bHP0zyZaXPHUBA9GxouDNx4Fw19X0fhhLN_lKSEAUPdg5sp5WlUhKT6lQXeoO2oPj4rnKZAZ7fj4 Oct 19 03:22:27.524728 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:22:27.524728 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:22:27.524728 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:22:27.524728 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:22:27.524728 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:22:27.524728 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:22:27.524728 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: c9a495ccfced47f29cb928d1ded20d85 Oct 19 03:22:27.524728 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ServersAdminTestJSON-824225463 Oct 19 03:22:27.524728 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:22:27.524728 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:22:27.526145 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c9a495ccfced47f29cb928d1ded20d85"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c9a495ccfced47f29cb928d1ded20d85"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c9a495ccfced47f29cb928d1ded20d85"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c9a495ccfced47f29cb928d1ded20d85", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:22:27.526145 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ServersAdminTestJSON-824225463 Oct 19 03:22:27.526145 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: c9a495ccfced47f29cb928d1ded20d85 Oct 19 03:22:27.526145 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ServersAdminTestJSON-824225463 Oct 19 03:22:27.526145 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ServersAdminTestJSON-824225463-project Oct 19 03:22:27.526145 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:22:27.526145 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:22:27.526145 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: ce4c5e4123c44508a5d4911a17c44231 Oct 19 03:22:27.526145 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ServersAdminTestJSON-824225463-project Oct 19 03:22:27.526145 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:22:27.526145 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance b1acb084-c2bd-49b1-b38a-5e7630389abd could not be found. Oct 19 03:22:27.526145 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': 'b1acb084-c2bd-49b1-b38a-5e7630389abd'} Oct 19 03:22:27.526888 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:22:27.526888 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:22:27.526888 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:22:27.526888 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:22:27.526888 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:22:27.526888 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:22:27.526888 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:22:27.526888 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:22:27.526888 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:22:27.526888 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:22:27.526888 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1acb084-c2bd-49b1-b38a-5e7630389abd could not be found. Oct 19 03:22:27.526888 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:22:27.526888 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:22:27.526888 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:22:27.526888 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:22:27.526888 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:22:27.526888 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:22:27.526888 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:22:27.526888 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:22:27.526888 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:22:27.528126 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:22:27.528126 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:22:27.528126 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:22:27.528126 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:22:27.528126 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:22:27.528126 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:22:27.528126 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:22:27.528126 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1acb084-c2bd-49b1-b38a-5e7630389abd could not be found. Oct 19 03:22:27.528126 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:22:27.528126 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:22:27.528126 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:22:27.528126 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:22:27.528126 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:22:27.528126 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:22:27.528126 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:22:27.528126 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:22:27.528126 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1acb084-c2bd-49b1-b38a-5e7630389abd could not be found. Oct 19 03:22:27.528126 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:22:27.530635 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-908709c0-69a2-454c-8f12-85a1f4364c0a tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Returning 404 to user: Instance b1acb084-c2bd-49b1-b38a-5e7630389abd could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:22:27.534967 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-908709c0-69a2-454c-8f12-85a1f4364c0a tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] 10.222.0.52 "GET /compute/v2.1/servers/b1acb084-c2bd-49b1-b38a-5e7630389abd" status: 404 len: 111 microversion: 2.1 time: 0.072792 Oct 19 03:22:27.534967 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1245/2466] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:22:27 2022] GET /compute/v2.1/servers/b1acb084-c2bd-49b1-b38a-5e7630389abd => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:22:27.546391 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-dd13ad13-6181-44f6-a863-59e8cf007c5c tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:27.547679 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-dd13ad13-6181-44f6-a863-59e8cf007c5c tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] [instance: 19fbcbe2-9039-4d18-94ef-51ce58cb6365] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:27.569804 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dd13ad13-6181-44f6-a863-59e8cf007c5c tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:27.570567 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dd13ad13-6181-44f6-a863-59e8cf007c5c tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:27.571154 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dd13ad13-6181-44f6-a863-59e8cf007c5c tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:27.573933 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dd13ad13-6181-44f6-a863-59e8cf007c5c tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:27.574625 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dd13ad13-6181-44f6-a863-59e8cf007c5c tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:27.579444 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dd13ad13-6181-44f6-a863-59e8cf007c5c tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:27.627000 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-dd13ad13-6181-44f6-a863-59e8cf007c5c tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] [instance: 19fbcbe2-9039-4d18-94ef-51ce58cb6365] Going to try to terminate instance {{(pid=121135) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:22:27.743822 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-07558edb-fcfe-4f4c-8b68-91b581cefd4f tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] 10.222.0.52 "GET /compute/v2.1/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 0.717337 Oct 19 03:22:27.754764 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1222/2467] 10.222.0.52 () {58 vars in 1158 bytes} [Wed Oct 19 03:22:27 2022] GET /compute/v2.1/os-security-groups => generated 1158 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:22:27.754764 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e0023039-e84c-42d3-8dd5-aca2cd9f3442 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:27.762539 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e0023039-e84c-42d3-8dd5-aca2cd9f3442 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] [instance: 6ef505a5-0624-4080-9089-821f6fdfb47c] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:27.767457 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e0023039-e84c-42d3-8dd5-aca2cd9f3442 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:27.767950 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e0023039-e84c-42d3-8dd5-aca2cd9f3442 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:27.768406 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e0023039-e84c-42d3-8dd5-aca2cd9f3442 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:27.769175 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e0023039-e84c-42d3-8dd5-aca2cd9f3442 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:27.775850 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e0023039-e84c-42d3-8dd5-aca2cd9f3442 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:27.778398 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e0023039-e84c-42d3-8dd5-aca2cd9f3442 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:28.011540 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e0023039-e84c-42d3-8dd5-aca2cd9f3442 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a222bb0f9a4c728d2ed5ca011c032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146393855c047be83270e5334c68e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:28.025473 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e0023039-e84c-42d3-8dd5-aca2cd9f3442 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] 10.222.0.52 "GET /compute/v2.1/servers/6ef505a5-0624-4080-9089-821f6fdfb47c" status: 200 len: 1318 microversion: 2.1 time: 0.279123 Oct 19 03:22:28.027338 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1223/2468] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:22:27 2022] GET /compute/v2.1/servers/6ef505a5-0624-4080-9089-821f6fdfb47c => generated 1318 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:22:28.034155 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-fdcf1a3d-9af4-4a6e-ae90-856057a307d8 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Action: 'create', calling method: .version_select at 0x7fc130246dc0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-620013496", "description": "tempest-description-1175332669"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:22:28.052474 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-dd13ad13-6181-44f6-a863-59e8cf007c5c tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] 10.222.0.52 "DELETE /compute/v2.1/servers/19fbcbe2-9039-4d18-94ef-51ce58cb6365" status: 204 len: 0 microversion: 2.1 time: 0.514490 Oct 19 03:22:28.057161 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1246/2469] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:22:27 2022] DELETE /compute/v2.1/servers/19fbcbe2-9039-4d18-94ef-51ce58cb6365 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:22:28.060781 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5a7b8179-0d5d-4716-82ef-4f176c1d0016 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:28.063041 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-5a7b8179-0d5d-4716-82ef-4f176c1d0016 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: c45890de-f7bf-4736-8b08-6f3e6863e2b3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:28.080429 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5a7b8179-0d5d-4716-82ef-4f176c1d0016 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:28.081445 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5a7b8179-0d5d-4716-82ef-4f176c1d0016 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:28.082440 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5a7b8179-0d5d-4716-82ef-4f176c1d0016 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:28.083187 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5a7b8179-0d5d-4716-82ef-4f176c1d0016 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:28.083868 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5a7b8179-0d5d-4716-82ef-4f176c1d0016 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:28.084456 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5a7b8179-0d5d-4716-82ef-4f176c1d0016 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:28.279399 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-5a7b8179-0d5d-4716-82ef-4f176c1d0016 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:28.290387 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5a7b8179-0d5d-4716-82ef-4f176c1d0016 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/c45890de-f7bf-4736-8b08-6f3e6863e2b3" status: 200 len: 1260 microversion: 2.1 time: 0.234837 Oct 19 03:22:28.318193 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1247/2470] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:22:28 2022] GET /compute/v2.1/servers/c45890de-f7bf-4736-8b08-6f3e6863e2b3 => generated 1260 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:22:28.327050 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-f7ef9b07-2051-4d94-aa13-f10d52f978b4 req-afc15d1a-5b5e-4428-9200-bf658adbd8f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "410116db-4d00-4a9d-8375-a5cea6a0d627", "name": "network-vif-plugged", "status": "completed", "tag": "c7f441d5-a985-4c81-97b8-114d47006d03"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:22:28.349689 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-f7ef9b07-2051-4d94-aa13-f10d52f978b4 req-afc15d1a-5b5e-4428-9200-bf658adbd8f6 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:28.350186 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-f7ef9b07-2051-4d94-aa13-f10d52f978b4 req-afc15d1a-5b5e-4428-9200-bf658adbd8f6 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:28.350831 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-f7ef9b07-2051-4d94-aa13-f10d52f978b4 req-afc15d1a-5b5e-4428-9200-bf658adbd8f6 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:28.398213 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-f7ef9b07-2051-4d94-aa13-f10d52f978b4 req-afc15d1a-5b5e-4428-9200-bf658adbd8f6 service nova] Creating event network-vif-plugged:c7f441d5-a985-4c81-97b8-114d47006d03 for instance 410116db-4d00-4a9d-8375-a5cea6a0d627 on n-h2-861333-8 Oct 19 03:22:28.423248 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-f7ef9b07-2051-4d94-aa13-f10d52f978b4 req-afc15d1a-5b5e-4428-9200-bf658adbd8f6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103609 Oct 19 03:22:28.423972 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1248/2471] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:22:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:22:28.445035 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9ed62549-7eb8-4932-9872-88a79c3c99a4 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:28.446121 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9ed62549-7eb8-4932-9872-88a79c3c99a4 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] [instance: 19fbcbe2-9039-4d18-94ef-51ce58cb6365] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:28.460197 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9ed62549-7eb8-4932-9872-88a79c3c99a4 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:28.461030 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9ed62549-7eb8-4932-9872-88a79c3c99a4 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:28.461734 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9ed62549-7eb8-4932-9872-88a79c3c99a4 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:28.463759 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9ed62549-7eb8-4932-9872-88a79c3c99a4 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:28.466040 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9ed62549-7eb8-4932-9872-88a79c3c99a4 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:28.467450 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9ed62549-7eb8-4932-9872-88a79c3c99a4 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:28.818800 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-fdcf1a3d-9af4-4a6e-ae90-856057a307d8 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.789246 Oct 19 03:22:28.819896 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1224/2472] 10.222.0.52 () {60 vars in 1180 bytes} [Wed Oct 19 03:22:28 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:22:28.825173 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-762d8e4d-1e0a-4eac-adb7-4c7e93b7073e tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:28.827445 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-762d8e4d-1e0a-4eac-adb7-4c7e93b7073e tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 62133546-4a75-4532-81ab-0c49c9252e85] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:28.852515 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-762d8e4d-1e0a-4eac-adb7-4c7e93b7073e tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:28.852515 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-762d8e4d-1e0a-4eac-adb7-4c7e93b7073e tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:28.852515 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-762d8e4d-1e0a-4eac-adb7-4c7e93b7073e tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:28.852515 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-762d8e4d-1e0a-4eac-adb7-4c7e93b7073e tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:28.853188 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-762d8e4d-1e0a-4eac-adb7-4c7e93b7073e tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:28.858395 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-762d8e4d-1e0a-4eac-adb7-4c7e93b7073e tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:28.902049 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:22:28.908498 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-762d8e4d-1e0a-4eac-adb7-4c7e93b7073e tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 62133546-4a75-4532-81ab-0c49c9252e85] Going to try to terminate instance {{(pid=121134) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:22:28.931655 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-9ed62549-7eb8-4932-9872-88a79c3c99a4 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4c5e4123c44508a5d4911a17c44231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a495ccfced47f29cb928d1ded20d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:28.944114 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9ed62549-7eb8-4932-9872-88a79c3c99a4 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] 10.222.0.52 "GET /compute/v2.1/servers/19fbcbe2-9039-4d18-94ef-51ce58cb6365" status: 200 len: 1470 microversion: 2.1 time: 0.507682 Oct 19 03:22:28.944726 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1249/2473] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:22:28 2022] GET /compute/v2.1/servers/19fbcbe2-9039-4d18-94ef-51ce58cb6365 => generated 1470 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:22:28.961661 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b9e30fc4-c389-4ab4-b2d2-478695842751 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:28.962287 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b9e30fc4-c389-4ab4-b2d2-478695842751 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] [instance: b7ee1a20-f570-44ae-8e29-595fc6b3dcb6] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:28.964395 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=9,nova_api:UPDATE=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:22:28.970964 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b9e30fc4-c389-4ab4-b2d2-478695842751 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:28.970964 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b9e30fc4-c389-4ab4-b2d2-478695842751 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:28.971172 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b9e30fc4-c389-4ab4-b2d2-478695842751 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:28.971897 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b9e30fc4-c389-4ab4-b2d2-478695842751 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:28.972617 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b9e30fc4-c389-4ab4-b2d2-478695842751 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:28.973718 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b9e30fc4-c389-4ab4-b2d2-478695842751 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:29.136992 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b9e30fc4-c389-4ab4-b2d2-478695842751 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63cf2636aee743148721b5ba622de9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bc3a9713e04bafaf5812a87765de55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:29.149659 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b9e30fc4-c389-4ab4-b2d2-478695842751 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63cf2636aee743148721b5ba622de9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bc3a9713e04bafaf5812a87765de55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:29.152546 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b9e30fc4-c389-4ab4-b2d2-478695842751 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63cf2636aee743148721b5ba622de9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bc3a9713e04bafaf5812a87765de55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:29.152673 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b9e30fc4-c389-4ab4-b2d2-478695842751 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] 10.222.0.52 "GET /compute/v2.1/servers/b7ee1a20-f570-44ae-8e29-595fc6b3dcb6" status: 200 len: 1362 microversion: 2.26 time: 0.198136 Oct 19 03:22:29.166856 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1250/2474] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:22:28 2022] GET /compute/v2.1/servers/b7ee1a20-f570-44ae-8e29-595fc6b3dcb6 => generated 1362 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:22:29.178459 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-604a63fd-10fc-4a68-82e6-028a6a018c4a req-916ff4e6-db57-4009-ad1c-6a6de42286ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fd536f4-6456-4291-8a11-2c48a453932a", "name": "network-vif-deleted", "tag": "8a122a74-7a6e-4f35-ab43-ab8ca0ff35c0"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:22:29.189981 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-604a63fd-10fc-4a68-82e6-028a6a018c4a req-916ff4e6-db57-4009-ad1c-6a6de42286ed service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:29.190678 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-604a63fd-10fc-4a68-82e6-028a6a018c4a req-916ff4e6-db57-4009-ad1c-6a6de42286ed service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:29.191310 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-604a63fd-10fc-4a68-82e6-028a6a018c4a req-916ff4e6-db57-4009-ad1c-6a6de42286ed service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:29.213502 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-604a63fd-10fc-4a68-82e6-028a6a018c4a req-916ff4e6-db57-4009-ad1c-6a6de42286ed service nova] Creating event network-vif-deleted:8a122a74-7a6e-4f35-ab43-ab8ca0ff35c0 for instance 6fd536f4-6456-4291-8a11-2c48a453932a on n-h1-861333-8 Oct 19 03:22:29.226085 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-604a63fd-10fc-4a68-82e6-028a6a018c4a req-916ff4e6-db57-4009-ad1c-6a6de42286ed service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057789 Oct 19 03:22:29.226726 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1251/2475] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:22:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:22:29.245594 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-46666194-0536-4aba-a225-94bbddf61596 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Action: 'create', calling method: .version_select at 0x7fc130baaaf0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-107393672", "description": "tempest-description-1581255136"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:22:29.348604 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-762d8e4d-1e0a-4eac-adb7-4c7e93b7073e tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "DELETE /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85" status: 204 len: 0 microversion: 2.25 time: 0.527111 Oct 19 03:22:29.380830 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1225/2476] 10.222.0.52 () {60 vars in 1280 bytes} [Wed Oct 19 03:22:28 2022] DELETE /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 19 03:22:29.380830 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7d0098a5-1265-4afd-87fd-abfcf91ee211 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:29.380830 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7d0098a5-1265-4afd-87fd-abfcf91ee211 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] [instance: 6ef505a5-0624-4080-9089-821f6fdfb47c] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:29.380830 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7d0098a5-1265-4afd-87fd-abfcf91ee211 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:29.381484 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7d0098a5-1265-4afd-87fd-abfcf91ee211 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:29.381484 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7d0098a5-1265-4afd-87fd-abfcf91ee211 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:29.381484 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7d0098a5-1265-4afd-87fd-abfcf91ee211 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:29.381484 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7d0098a5-1265-4afd-87fd-abfcf91ee211 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:29.381942 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7d0098a5-1265-4afd-87fd-abfcf91ee211 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:29.600376 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-7d0098a5-1265-4afd-87fd-abfcf91ee211 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a222bb0f9a4c728d2ed5ca011c032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146393855c047be83270e5334c68e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:29.611861 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7d0098a5-1265-4afd-87fd-abfcf91ee211 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] 10.222.0.52 "GET /compute/v2.1/servers/6ef505a5-0624-4080-9089-821f6fdfb47c" status: 200 len: 1318 microversion: 2.1 time: 0.261286 Oct 19 03:22:29.613992 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1226/2477] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:22:29 2022] GET /compute/v2.1/servers/6ef505a5-0624-4080-9089-821f6fdfb47c => generated 1318 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:22:29.618351 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0d32a52d-1553-4a6a-bbec-41de2a2a84cb tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:29.619171 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0d32a52d-1553-4a6a-bbec-41de2a2a84cb tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: c45890de-f7bf-4736-8b08-6f3e6863e2b3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:29.626397 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0d32a52d-1553-4a6a-bbec-41de2a2a84cb tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:29.627134 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0d32a52d-1553-4a6a-bbec-41de2a2a84cb tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:29.628004 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0d32a52d-1553-4a6a-bbec-41de2a2a84cb tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:29.629198 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0d32a52d-1553-4a6a-bbec-41de2a2a84cb tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:29.629986 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0d32a52d-1553-4a6a-bbec-41de2a2a84cb tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:29.630640 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0d32a52d-1553-4a6a-bbec-41de2a2a84cb tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:29.696221 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0d32a52d-1553-4a6a-bbec-41de2a2a84cb tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:29.708028 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0d32a52d-1553-4a6a-bbec-41de2a2a84cb tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/c45890de-f7bf-4736-8b08-6f3e6863e2b3" status: 200 len: 1266 microversion: 2.1 time: 0.093940 Oct 19 03:22:29.717719 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1227/2478] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:22:29 2022] GET /compute/v2.1/servers/c45890de-f7bf-4736-8b08-6f3e6863e2b3 => generated 1266 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:22:29.717719 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-02a31093-691a-4a9a-a4b5-3ace06f1a40e tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:29.717719 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-02a31093-691a-4a9a-a4b5-3ace06f1a40e tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 62133546-4a75-4532-81ab-0c49c9252e85] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:29.724559 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-02a31093-691a-4a9a-a4b5-3ace06f1a40e tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:29.725717 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-02a31093-691a-4a9a-a4b5-3ace06f1a40e tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:29.726559 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-02a31093-691a-4a9a-a4b5-3ace06f1a40e tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:29.727631 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-02a31093-691a-4a9a-a4b5-3ace06f1a40e tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:29.728124 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-02a31093-691a-4a9a-a4b5-3ace06f1a40e tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:29.728556 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-02a31093-691a-4a9a-a4b5-3ace06f1a40e tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:30.005233 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-02a31093-691a-4a9a-a4b5-3ace06f1a40e tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:30.020842 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-02a31093-691a-4a9a-a4b5-3ace06f1a40e tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:30.020842 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-02a31093-691a-4a9a-a4b5-3ace06f1a40e tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:30.020842 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-02a31093-691a-4a9a-a4b5-3ace06f1a40e tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85" status: 200 len: 1728 microversion: 2.25 time: 0.309200 Oct 19 03:22:30.021132 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1228/2479] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:22:29 2022] GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85 => generated 1728 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:22:30.030239 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-00116b3c-2fbb-4d48-a29a-beb05987ae43 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:30.031669 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-00116b3c-2fbb-4d48-a29a-beb05987ae43 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] [instance: 19fbcbe2-9039-4d18-94ef-51ce58cb6365] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:30.038949 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-00116b3c-2fbb-4d48-a29a-beb05987ae43 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:30.039752 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-00116b3c-2fbb-4d48-a29a-beb05987ae43 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:30.040199 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-00116b3c-2fbb-4d48-a29a-beb05987ae43 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:30.041089 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-00116b3c-2fbb-4d48-a29a-beb05987ae43 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:30.046387 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-00116b3c-2fbb-4d48-a29a-beb05987ae43 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:30.046387 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-00116b3c-2fbb-4d48-a29a-beb05987ae43 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:30.271893 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-46666194-0536-4aba-a225-94bbddf61596 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.037031 Oct 19 03:22:30.273441 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1252/2480] 10.222.0.52 () {60 vars in 1180 bytes} [Wed Oct 19 03:22:29 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:22:30.278742 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-00116b3c-2fbb-4d48-a29a-beb05987ae43 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4c5e4123c44508a5d4911a17c44231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a495ccfced47f29cb928d1ded20d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:30.279258 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-37fbc6ef-b424-44c5-87cd-9b0d360cf4cb tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:30.280160 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-37fbc6ef-b424-44c5-87cd-9b0d360cf4cb tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] [instance: b7ee1a20-f570-44ae-8e29-595fc6b3dcb6] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:30.292557 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-00116b3c-2fbb-4d48-a29a-beb05987ae43 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] 10.222.0.52 "GET /compute/v2.1/servers/19fbcbe2-9039-4d18-94ef-51ce58cb6365" status: 200 len: 1470 microversion: 2.1 time: 0.266744 Oct 19 03:22:30.294638 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1229/2481] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:22:30 2022] GET /compute/v2.1/servers/19fbcbe2-9039-4d18-94ef-51ce58cb6365 => generated 1470 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:22:30.311426 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-37fbc6ef-b424-44c5-87cd-9b0d360cf4cb tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:30.318729 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-37fbc6ef-b424-44c5-87cd-9b0d360cf4cb tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:30.318729 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-37fbc6ef-b424-44c5-87cd-9b0d360cf4cb tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:30.318729 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-37fbc6ef-b424-44c5-87cd-9b0d360cf4cb tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:30.318729 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-37fbc6ef-b424-44c5-87cd-9b0d360cf4cb tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:30.319347 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-37fbc6ef-b424-44c5-87cd-9b0d360cf4cb tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:30.368553 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:22:30.441218 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-ead82097-e40f-4ed6-9bce-63fb8dea9c78 req-ff30f6ec-aaf1-41d4-8ca7-9708a512c152 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ef505a5-0624-4080-9089-821f6fdfb47c", "name": "network-vif-plugged", "status": "completed", "tag": "3d68ba4c-839d-44ea-b4e3-7563b0f4650a"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:22:30.461572 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-ead82097-e40f-4ed6-9bce-63fb8dea9c78 req-ff30f6ec-aaf1-41d4-8ca7-9708a512c152 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:30.462116 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-ead82097-e40f-4ed6-9bce-63fb8dea9c78 req-ff30f6ec-aaf1-41d4-8ca7-9708a512c152 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:30.462553 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-ead82097-e40f-4ed6-9bce-63fb8dea9c78 req-ff30f6ec-aaf1-41d4-8ca7-9708a512c152 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:30.487184 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-ead82097-e40f-4ed6-9bce-63fb8dea9c78 req-ff30f6ec-aaf1-41d4-8ca7-9708a512c152 service nova] Creating event network-vif-plugged:3d68ba4c-839d-44ea-b4e3-7563b0f4650a for instance 6ef505a5-0624-4080-9089-821f6fdfb47c on n-h1-861333-8 Oct 19 03:22:30.493037 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-ead82097-e40f-4ed6-9bce-63fb8dea9c78 req-ff30f6ec-aaf1-41d4-8ca7-9708a512c152 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056372 Oct 19 03:22:30.493806 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1230/2482] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:22:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:22:30.499356 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ff4eb596-6275-4736-b375-d0045215ad57 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-917249934", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "networks": [{"uuid": "c3b95160-a16e-4a1c-b8ab-a16d61597a6c"}]}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:22:30.568153 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-ff4eb596-6275-4736-b375-d0045215ad57 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] validate_networks() for [('c3b95160-a16e-4a1c-b8ab-a16d61597a6c', None, None, None, None, None)] {{(pid=121134) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:22:30.893567 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-37fbc6ef-b424-44c5-87cd-9b0d360cf4cb tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63cf2636aee743148721b5ba622de9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bc3a9713e04bafaf5812a87765de55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:30.904876 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-37fbc6ef-b424-44c5-87cd-9b0d360cf4cb tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63cf2636aee743148721b5ba622de9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bc3a9713e04bafaf5812a87765de55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:30.907938 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-37fbc6ef-b424-44c5-87cd-9b0d360cf4cb tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63cf2636aee743148721b5ba622de9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bc3a9713e04bafaf5812a87765de55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:30.909170 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-37fbc6ef-b424-44c5-87cd-9b0d360cf4cb tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] 10.222.0.52 "GET /compute/v2.1/servers/b7ee1a20-f570-44ae-8e29-595fc6b3dcb6" status: 200 len: 1362 microversion: 2.26 time: 0.634058 Oct 19 03:22:30.921834 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1253/2483] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:22:30 2022] GET /compute/v2.1/servers/b7ee1a20-f570-44ae-8e29-595fc6b3dcb6 => generated 1362 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:22:30.928667 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-23411298-453f-4f97-a036-44957e234fd8 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:30.928797 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-23411298-453f-4f97-a036-44957e234fd8 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] [instance: 6ef505a5-0624-4080-9089-821f6fdfb47c] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:30.942447 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-23411298-453f-4f97-a036-44957e234fd8 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:30.943024 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-23411298-453f-4f97-a036-44957e234fd8 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:30.943465 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-23411298-453f-4f97-a036-44957e234fd8 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:30.944286 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-23411298-453f-4f97-a036-44957e234fd8 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:30.944752 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-23411298-453f-4f97-a036-44957e234fd8 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:30.945169 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-23411298-453f-4f97-a036-44957e234fd8 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:31.724995 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-23411298-453f-4f97-a036-44957e234fd8 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a222bb0f9a4c728d2ed5ca011c032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146393855c047be83270e5334c68e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:31.733754 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-23411298-453f-4f97-a036-44957e234fd8 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] 10.222.0.52 "GET /compute/v2.1/servers/6ef505a5-0624-4080-9089-821f6fdfb47c" status: 200 len: 1318 microversion: 2.1 time: 0.810192 Oct 19 03:22:31.734946 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1254/2484] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:22:30 2022] GET /compute/v2.1/servers/6ef505a5-0624-4080-9089-821f6fdfb47c => generated 1318 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:22:31.739882 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c9a7b7f0-5e09-4fcd-880d-43e5c3af1179 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:31.740520 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c9a7b7f0-5e09-4fcd-880d-43e5c3af1179 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: c45890de-f7bf-4736-8b08-6f3e6863e2b3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:31.746415 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c9a7b7f0-5e09-4fcd-880d-43e5c3af1179 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:31.747079 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c9a7b7f0-5e09-4fcd-880d-43e5c3af1179 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:31.747714 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c9a7b7f0-5e09-4fcd-880d-43e5c3af1179 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:31.748407 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c9a7b7f0-5e09-4fcd-880d-43e5c3af1179 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:31.748881 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c9a7b7f0-5e09-4fcd-880d-43e5c3af1179 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:31.749491 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c9a7b7f0-5e09-4fcd-880d-43e5c3af1179 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:32.116364 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-ff4eb596-6275-4736-b375-d0045215ad57 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Flavor limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:22:32.120261 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-ff4eb596-6275-4736-b375-d0045215ad57 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Image limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:22:32.120261 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-ff4eb596-6275-4736-b375-d0045215ad57 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Flavor pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:22:32.120261 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-ff4eb596-6275-4736-b375-d0045215ad57 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Image pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:22:32.120261 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-ff4eb596-6275-4736-b375-d0045215ad57 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:22:32.128445 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ff4eb596-6275-4736-b375-d0045215ad57 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:32.129142 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ff4eb596-6275-4736-b375-d0045215ad57 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:32.129782 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ff4eb596-6275-4736-b375-d0045215ad57 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:32.131318 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ff4eb596-6275-4736-b375-d0045215ad57 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:32.131960 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ff4eb596-6275-4736-b375-d0045215ad57 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:32.132751 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ff4eb596-6275-4736-b375-d0045215ad57 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:32.139178 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c9a7b7f0-5e09-4fcd-880d-43e5c3af1179 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:32.148911 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c9a7b7f0-5e09-4fcd-880d-43e5c3af1179 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/c45890de-f7bf-4736-8b08-6f3e6863e2b3" status: 200 len: 1308 microversion: 2.1 time: 0.412596 Oct 19 03:22:32.150138 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1255/2485] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:22:31 2022] GET /compute/v2.1/servers/c45890de-f7bf-4736-8b08-6f3e6863e2b3 => generated 1308 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:22:32.153486 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-ff4eb596-6275-4736-b375-d0045215ad57 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Getting quotas for project 385a1e7cceff48798bfefb9390e5979c. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:22:32.155205 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1194e592-e72a-43d3-83df-3b584a860155 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:32.156461 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1194e592-e72a-43d3-83df-3b584a860155 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 62133546-4a75-4532-81ab-0c49c9252e85] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:32.160291 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-ff4eb596-6275-4736-b375-d0045215ad57 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Getting quotas for user 3661010393d44c428fb37652b1717072 and project 385a1e7cceff48798bfefb9390e5979c. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:22:32.165099 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1194e592-e72a-43d3-83df-3b584a860155 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:32.165732 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1194e592-e72a-43d3-83df-3b584a860155 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:32.166436 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1194e592-e72a-43d3-83df-3b584a860155 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:32.167348 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1194e592-e72a-43d3-83df-3b584a860155 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:32.168262 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1194e592-e72a-43d3-83df-3b584a860155 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:32.169005 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1194e592-e72a-43d3-83df-3b584a860155 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:32.176110 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ff4eb596-6275-4736-b375-d0045215ad57 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Going to run 1 instances... {{(pid=121134) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:22:32.178807 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ff4eb596-6275-4736-b375-d0045215ad57 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] [instance: bb7dc549-597e-4568-8ab7-768654c73278] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:22:32.306879 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ff4eb596-6275-4736-b375-d0045215ad57 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.811510 Oct 19 03:22:32.308660 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1231/2486] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:22:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1814 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 03:22:32.314332 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6cab1ae9-9482-40ab-b872-02e3497d7d25 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:32.317257 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6cab1ae9-9482-40ab-b872-02e3497d7d25 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] [instance: 19fbcbe2-9039-4d18-94ef-51ce58cb6365] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:32.322617 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6cab1ae9-9482-40ab-b872-02e3497d7d25 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:32.323309 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6cab1ae9-9482-40ab-b872-02e3497d7d25 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:32.324185 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6cab1ae9-9482-40ab-b872-02e3497d7d25 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:32.325057 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6cab1ae9-9482-40ab-b872-02e3497d7d25 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:32.325716 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6cab1ae9-9482-40ab-b872-02e3497d7d25 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:32.326299 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6cab1ae9-9482-40ab-b872-02e3497d7d25 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:32.472450 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-1194e592-e72a-43d3-83df-3b584a860155 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:32.483157 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-1194e592-e72a-43d3-83df-3b584a860155 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:32.486129 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-1194e592-e72a-43d3-83df-3b584a860155 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:32.495380 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1194e592-e72a-43d3-83df-3b584a860155 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85" status: 200 len: 1728 microversion: 2.25 time: 0.339400 Oct 19 03:22:32.495380 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1256/2487] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:22:32 2022] GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85 => generated 1728 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:22:32.496627 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1852f601-5c4f-4f6a-8675-49ffaa57d37a tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:32.497299 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1852f601-5c4f-4f6a-8675-49ffaa57d37a tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] [instance: b7ee1a20-f570-44ae-8e29-595fc6b3dcb6] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:32.503690 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1852f601-5c4f-4f6a-8675-49ffaa57d37a tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:32.504456 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1852f601-5c4f-4f6a-8675-49ffaa57d37a tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:32.505207 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1852f601-5c4f-4f6a-8675-49ffaa57d37a tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:32.506009 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1852f601-5c4f-4f6a-8675-49ffaa57d37a tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:32.507443 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1852f601-5c4f-4f6a-8675-49ffaa57d37a tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:32.516570 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1852f601-5c4f-4f6a-8675-49ffaa57d37a tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:32.803702 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-6cab1ae9-9482-40ab-b872-02e3497d7d25 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4c5e4123c44508a5d4911a17c44231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a495ccfced47f29cb928d1ded20d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:32.815346 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6cab1ae9-9482-40ab-b872-02e3497d7d25 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] 10.222.0.52 "GET /compute/v2.1/servers/19fbcbe2-9039-4d18-94ef-51ce58cb6365" status: 200 len: 1470 microversion: 2.1 time: 0.504816 Oct 19 03:22:32.822875 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1232/2488] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:22:32 2022] GET /compute/v2.1/servers/19fbcbe2-9039-4d18-94ef-51ce58cb6365 => generated 1470 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:22:32.836742 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-65440bf9-d64b-403c-bed9-caadd36d01a9 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:32.837593 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-65440bf9-d64b-403c-bed9-caadd36d01a9 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] [instance: bb7dc549-597e-4568-8ab7-768654c73278] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:32.975194 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-1852f601-5c4f-4f6a-8675-49ffaa57d37a tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63cf2636aee743148721b5ba622de9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bc3a9713e04bafaf5812a87765de55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:32.988409 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-1852f601-5c4f-4f6a-8675-49ffaa57d37a tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63cf2636aee743148721b5ba622de9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bc3a9713e04bafaf5812a87765de55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:32.990785 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-1852f601-5c4f-4f6a-8675-49ffaa57d37a tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63cf2636aee743148721b5ba622de9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bc3a9713e04bafaf5812a87765de55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:32.993082 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1852f601-5c4f-4f6a-8675-49ffaa57d37a tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] 10.222.0.52 "GET /compute/v2.1/servers/b7ee1a20-f570-44ae-8e29-595fc6b3dcb6" status: 200 len: 1362 microversion: 2.26 time: 0.500239 Oct 19 03:22:32.994818 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1257/2489] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:22:32 2022] GET /compute/v2.1/servers/b7ee1a20-f570-44ae-8e29-595fc6b3dcb6 => generated 1362 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:22:33.000281 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-362ca5b7-0c3c-41f6-abc0-fb9bbdd95b9b tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:33.004817 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-362ca5b7-0c3c-41f6-abc0-fb9bbdd95b9b tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] [instance: 6ef505a5-0624-4080-9089-821f6fdfb47c] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:33.055786 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-362ca5b7-0c3c-41f6-abc0-fb9bbdd95b9b tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:33.072329 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-362ca5b7-0c3c-41f6-abc0-fb9bbdd95b9b tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:33.073280 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-362ca5b7-0c3c-41f6-abc0-fb9bbdd95b9b tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:33.076307 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-362ca5b7-0c3c-41f6-abc0-fb9bbdd95b9b tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:33.077819 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-362ca5b7-0c3c-41f6-abc0-fb9bbdd95b9b tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:33.082305 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-362ca5b7-0c3c-41f6-abc0-fb9bbdd95b9b tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:33.189274 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-65440bf9-d64b-403c-bed9-caadd36d01a9 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3661010393d44c428fb37652b1717072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a1e7cceff48798bfefb9390e5979c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:33.205866 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-65440bf9-d64b-403c-bed9-caadd36d01a9 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] 10.222.0.52 "GET /compute/v2.1/servers/bb7dc549-597e-4568-8ab7-768654c73278" status: 200 len: 1215 microversion: 2.1 time: 0.381321 Oct 19 03:22:33.228458 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1233/2490] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:22:32 2022] GET /compute/v2.1/servers/bb7dc549-597e-4568-8ab7-768654c73278 => generated 1215 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:22:33.234191 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-6d7fc47d-ec19-494e-b7ce-a3882b75fb01 req-fb041eb7-90a9-44bc-a212-3658c818665d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c45890de-f7bf-4736-8b08-6f3e6863e2b3", "tag": "6dfdbd8b-f3ab-4274-8a35-fe995bdd3cba"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:22:33.277608 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-6d7fc47d-ec19-494e-b7ce-a3882b75fb01 req-fb041eb7-90a9-44bc-a212-3658c818665d service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:33.277608 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-6d7fc47d-ec19-494e-b7ce-a3882b75fb01 req-fb041eb7-90a9-44bc-a212-3658c818665d service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:33.277608 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-6d7fc47d-ec19-494e-b7ce-a3882b75fb01 req-fb041eb7-90a9-44bc-a212-3658c818665d service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:33.311614 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-6d7fc47d-ec19-494e-b7ce-a3882b75fb01 req-fb041eb7-90a9-44bc-a212-3658c818665d service nova] Creating event network-changed:6dfdbd8b-f3ab-4274-8a35-fe995bdd3cba for instance c45890de-f7bf-4736-8b08-6f3e6863e2b3 on n-h2-861333-8 Oct 19 03:22:33.323331 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-6d7fc47d-ec19-494e-b7ce-a3882b75fb01 req-fb041eb7-90a9-44bc-a212-3658c818665d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093981 Oct 19 03:22:33.329192 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1234/2491] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:22:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:22:33.335068 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b9beb62b-6393-4d9f-844f-e9fc5bf2bb98 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:33.335960 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b9beb62b-6393-4d9f-844f-e9fc5bf2bb98 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: c45890de-f7bf-4736-8b08-6f3e6863e2b3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:33.353414 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b9beb62b-6393-4d9f-844f-e9fc5bf2bb98 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:33.354113 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b9beb62b-6393-4d9f-844f-e9fc5bf2bb98 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:33.354724 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b9beb62b-6393-4d9f-844f-e9fc5bf2bb98 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:33.355920 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b9beb62b-6393-4d9f-844f-e9fc5bf2bb98 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:33.356550 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b9beb62b-6393-4d9f-844f-e9fc5bf2bb98 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:33.357159 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b9beb62b-6393-4d9f-844f-e9fc5bf2bb98 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:33.711099 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-362ca5b7-0c3c-41f6-abc0-fb9bbdd95b9b tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a222bb0f9a4c728d2ed5ca011c032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146393855c047be83270e5334c68e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:33.723073 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-362ca5b7-0c3c-41f6-abc0-fb9bbdd95b9b tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] 10.222.0.52 "GET /compute/v2.1/servers/6ef505a5-0624-4080-9089-821f6fdfb47c" status: 200 len: 1318 microversion: 2.1 time: 0.726860 Oct 19 03:22:33.723674 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1258/2492] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:22:32 2022] GET /compute/v2.1/servers/6ef505a5-0624-4080-9089-821f6fdfb47c => generated 1318 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:22:33.739190 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0d14ebc0-2fac-45f6-b880-2ff96ad84bc1 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:33.740100 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0d14ebc0-2fac-45f6-b880-2ff96ad84bc1 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 62133546-4a75-4532-81ab-0c49c9252e85] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:33.748908 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0d14ebc0-2fac-45f6-b880-2ff96ad84bc1 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:33.749626 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0d14ebc0-2fac-45f6-b880-2ff96ad84bc1 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:33.750079 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0d14ebc0-2fac-45f6-b880-2ff96ad84bc1 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:33.750792 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0d14ebc0-2fac-45f6-b880-2ff96ad84bc1 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:33.751253 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0d14ebc0-2fac-45f6-b880-2ff96ad84bc1 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:33.751681 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0d14ebc0-2fac-45f6-b880-2ff96ad84bc1 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:33.913693 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-0d14ebc0-2fac-45f6-b880-2ff96ad84bc1 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:33.923007 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-0d14ebc0-2fac-45f6-b880-2ff96ad84bc1 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:33.929428 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-0d14ebc0-2fac-45f6-b880-2ff96ad84bc1 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:33.930877 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0d14ebc0-2fac-45f6-b880-2ff96ad84bc1 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85" status: 200 len: 1661 microversion: 2.25 time: 0.204270 Oct 19 03:22:33.936491 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1259/2493] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:22:33 2022] GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85 => generated 1661 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:22:33.942962 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-fb0a730a-52f9-40bc-b561-75e74aed0b1f tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:33.947677 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b9beb62b-6393-4d9f-844f-e9fc5bf2bb98 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:33.948024 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-fb0a730a-52f9-40bc-b561-75e74aed0b1f tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] [instance: 19fbcbe2-9039-4d18-94ef-51ce58cb6365] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:33.964826 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fb0a730a-52f9-40bc-b561-75e74aed0b1f tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:33.964826 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fb0a730a-52f9-40bc-b561-75e74aed0b1f tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:33.964826 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fb0a730a-52f9-40bc-b561-75e74aed0b1f tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:33.964826 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fb0a730a-52f9-40bc-b561-75e74aed0b1f tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:33.965556 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fb0a730a-52f9-40bc-b561-75e74aed0b1f tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:33.965899 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b9beb62b-6393-4d9f-844f-e9fc5bf2bb98 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/c45890de-f7bf-4736-8b08-6f3e6863e2b3" status: 200 len: 1308 microversion: 2.1 time: 0.635667 Oct 19 03:22:33.966393 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fb0a730a-52f9-40bc-b561-75e74aed0b1f tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:33.966547 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1235/2494] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:22:33 2022] GET /compute/v2.1/servers/c45890de-f7bf-4736-8b08-6f3e6863e2b3 => generated 1308 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:22:34.024110 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c2be39bc-ba24-430e-bb4f-9e6db56bd78a tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:34.024971 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c2be39bc-ba24-430e-bb4f-9e6db56bd78a tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] [instance: b7ee1a20-f570-44ae-8e29-595fc6b3dcb6] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:34.040690 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c2be39bc-ba24-430e-bb4f-9e6db56bd78a tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:34.042086 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c2be39bc-ba24-430e-bb4f-9e6db56bd78a tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:34.042086 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c2be39bc-ba24-430e-bb4f-9e6db56bd78a tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:34.042672 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c2be39bc-ba24-430e-bb4f-9e6db56bd78a tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:34.043137 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c2be39bc-ba24-430e-bb4f-9e6db56bd78a tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:34.043759 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c2be39bc-ba24-430e-bb4f-9e6db56bd78a tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:34.302685 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:22:34.344884 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-fb0a730a-52f9-40bc-b561-75e74aed0b1f tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4c5e4123c44508a5d4911a17c44231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a495ccfced47f29cb928d1ded20d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:34.356220 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-fb0a730a-52f9-40bc-b561-75e74aed0b1f tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] 10.222.0.52 "GET /compute/v2.1/servers/19fbcbe2-9039-4d18-94ef-51ce58cb6365" status: 200 len: 1470 microversion: 2.1 time: 0.417762 Oct 19 03:22:34.359464 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1260/2495] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:22:33 2022] GET /compute/v2.1/servers/19fbcbe2-9039-4d18-94ef-51ce58cb6365 => generated 1470 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:22:34.376625 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5042ff03-d287-4f9f-a7ac-fc1675aeeaac tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:34.379920 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-5042ff03-d287-4f9f-a7ac-fc1675aeeaac tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] [instance: bb7dc549-597e-4568-8ab7-768654c73278] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:34.409403 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5042ff03-d287-4f9f-a7ac-fc1675aeeaac tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:34.413547 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5042ff03-d287-4f9f-a7ac-fc1675aeeaac tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:34.421068 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5042ff03-d287-4f9f-a7ac-fc1675aeeaac tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:34.427058 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5042ff03-d287-4f9f-a7ac-fc1675aeeaac tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:34.427058 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5042ff03-d287-4f9f-a7ac-fc1675aeeaac tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:34.427058 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5042ff03-d287-4f9f-a7ac-fc1675aeeaac tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:34.583636 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c2be39bc-ba24-430e-bb4f-9e6db56bd78a tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63cf2636aee743148721b5ba622de9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bc3a9713e04bafaf5812a87765de55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:34.596788 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c2be39bc-ba24-430e-bb4f-9e6db56bd78a tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63cf2636aee743148721b5ba622de9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bc3a9713e04bafaf5812a87765de55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:34.598723 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c2be39bc-ba24-430e-bb4f-9e6db56bd78a tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63cf2636aee743148721b5ba622de9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bc3a9713e04bafaf5812a87765de55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:34.602174 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c2be39bc-ba24-430e-bb4f-9e6db56bd78a tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] 10.222.0.52 "GET /compute/v2.1/servers/b7ee1a20-f570-44ae-8e29-595fc6b3dcb6" status: 200 len: 1362 microversion: 2.26 time: 0.581889 Oct 19 03:22:34.605550 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1236/2496] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:22:34 2022] GET /compute/v2.1/servers/b7ee1a20-f570-44ae-8e29-595fc6b3dcb6 => generated 1362 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:22:34.611258 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-5042ff03-d287-4f9f-a7ac-fc1675aeeaac tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3661010393d44c428fb37652b1717072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a1e7cceff48798bfefb9390e5979c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:34.621711 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5042ff03-d287-4f9f-a7ac-fc1675aeeaac tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] 10.222.0.52 "GET /compute/v2.1/servers/bb7dc549-597e-4568-8ab7-768654c73278" status: 200 len: 1219 microversion: 2.1 time: 0.259248 Oct 19 03:22:34.633546 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1261/2497] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:22:34 2022] GET /compute/v2.1/servers/bb7dc549-597e-4568-8ab7-768654c73278 => generated 1219 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:22:34.710456 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-497b5a44-7348-49f9-9ab4-251086d80090 req-b8dcc677-b38b-4657-9dc1-4c757ae62758 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19fbcbe2-9039-4d18-94ef-51ce58cb6365", "name": "network-vif-deleted", "tag": "9630ac60-448c-49d9-b986-9926a85b1f58"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:22:34.739735 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-497b5a44-7348-49f9-9ab4-251086d80090 req-b8dcc677-b38b-4657-9dc1-4c757ae62758 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:34.740574 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-497b5a44-7348-49f9-9ab4-251086d80090 req-b8dcc677-b38b-4657-9dc1-4c757ae62758 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:34.747233 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a4fd04f6-b519-48d6-a987-bfc1745a429d tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:34.748802 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a4fd04f6-b519-48d6-a987-bfc1745a429d tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] [instance: 6ef505a5-0624-4080-9089-821f6fdfb47c] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:34.755161 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-497b5a44-7348-49f9-9ab4-251086d80090 req-b8dcc677-b38b-4657-9dc1-4c757ae62758 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:34.762521 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a4fd04f6-b519-48d6-a987-bfc1745a429d tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:34.768392 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a4fd04f6-b519-48d6-a987-bfc1745a429d tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:34.769054 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a4fd04f6-b519-48d6-a987-bfc1745a429d tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:34.770098 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a4fd04f6-b519-48d6-a987-bfc1745a429d tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:34.771713 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a4fd04f6-b519-48d6-a987-bfc1745a429d tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:34.773521 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a4fd04f6-b519-48d6-a987-bfc1745a429d tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:34.805426 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-497b5a44-7348-49f9-9ab4-251086d80090 req-b8dcc677-b38b-4657-9dc1-4c757ae62758 service nova] Creating event network-vif-deleted:9630ac60-448c-49d9-b986-9926a85b1f58 for instance 19fbcbe2-9039-4d18-94ef-51ce58cb6365 on n-h1-861333-8 Oct 19 03:22:34.818106 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-497b5a44-7348-49f9-9ab4-251086d80090 req-b8dcc677-b38b-4657-9dc1-4c757ae62758 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109317 Oct 19 03:22:34.838133 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1237/2498] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:22:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:22:34.963472 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-fd44cbcb-69b0-4d0e-a691-eb8ffa1a8513 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:34.964693 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-fd44cbcb-69b0-4d0e-a691-eb8ffa1a8513 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 62133546-4a75-4532-81ab-0c49c9252e85] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:34.999609 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fd44cbcb-69b0-4d0e-a691-eb8ffa1a8513 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:34.999609 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fd44cbcb-69b0-4d0e-a691-eb8ffa1a8513 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:34.999609 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fd44cbcb-69b0-4d0e-a691-eb8ffa1a8513 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:34.999609 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fd44cbcb-69b0-4d0e-a691-eb8ffa1a8513 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:35.000023 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fd44cbcb-69b0-4d0e-a691-eb8ffa1a8513 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:35.000023 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fd44cbcb-69b0-4d0e-a691-eb8ffa1a8513 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:35.013695 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a4fd04f6-b519-48d6-a987-bfc1745a429d tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a222bb0f9a4c728d2ed5ca011c032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146393855c047be83270e5334c68e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:35.026367 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a4fd04f6-b519-48d6-a987-bfc1745a429d tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] 10.222.0.52 "GET /compute/v2.1/servers/6ef505a5-0624-4080-9089-821f6fdfb47c" status: 200 len: 1318 microversion: 2.1 time: 0.283066 Oct 19 03:22:35.030502 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1262/2499] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:22:34 2022] GET /compute/v2.1/servers/6ef505a5-0624-4080-9089-821f6fdfb47c => generated 1318 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:22:35.048652 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-dee5fb3c-a80f-472d-804f-6df804921a8b tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:35.058286 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-dee5fb3c-a80f-472d-804f-6df804921a8b tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: c45890de-f7bf-4736-8b08-6f3e6863e2b3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:35.084026 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dee5fb3c-a80f-472d-804f-6df804921a8b tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:35.087047 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dee5fb3c-a80f-472d-804f-6df804921a8b tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:35.087601 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dee5fb3c-a80f-472d-804f-6df804921a8b tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:35.088432 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dee5fb3c-a80f-472d-804f-6df804921a8b tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:35.089146 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dee5fb3c-a80f-472d-804f-6df804921a8b tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:35.091577 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dee5fb3c-a80f-472d-804f-6df804921a8b tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:35.099204 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fd44cbcb-69b0-4d0e-a691-eb8ffa1a8513 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:35.100027 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fd44cbcb-69b0-4d0e-a691-eb8ffa1a8513 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:35.100683 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fd44cbcb-69b0-4d0e-a691-eb8ffa1a8513 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:35.101331 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-fd44cbcb-69b0-4d0e-a691-eb8ffa1a8513 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lazy-loading 'fault' on Instance uuid 62133546-4a75-4532-81ab-0c49c9252e85 {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:22:35.197756 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-fd44cbcb-69b0-4d0e-a691-eb8ffa1a8513 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:35.216369 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-fd44cbcb-69b0-4d0e-a691-eb8ffa1a8513 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:35.220336 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-fd44cbcb-69b0-4d0e-a691-eb8ffa1a8513 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:35.221890 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-fd44cbcb-69b0-4d0e-a691-eb8ffa1a8513 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85" status: 200 len: 1375 microversion: 2.25 time: 0.263039 Oct 19 03:22:35.223435 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1238/2500] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:22:34 2022] GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85 => generated 1375 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:22:35.337984 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-dee5fb3c-a80f-472d-804f-6df804921a8b tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:35.354269 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-dee5fb3c-a80f-472d-804f-6df804921a8b tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/c45890de-f7bf-4736-8b08-6f3e6863e2b3" status: 200 len: 1308 microversion: 2.1 time: 0.321402 Oct 19 03:22:35.355454 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1263/2501] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:22:35 2022] GET /compute/v2.1/servers/c45890de-f7bf-4736-8b08-6f3e6863e2b3 => generated 1308 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:22:35.391308 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-dd2e5ac2-1717-4fa7-baf2-9619ce0853c8 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:35.392265 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-dd2e5ac2-1717-4fa7-baf2-9619ce0853c8 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] [instance: 19fbcbe2-9039-4d18-94ef-51ce58cb6365] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:35.401007 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dd2e5ac2-1717-4fa7-baf2-9619ce0853c8 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:35.407187 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dd2e5ac2-1717-4fa7-baf2-9619ce0853c8 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:35.408417 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dd2e5ac2-1717-4fa7-baf2-9619ce0853c8 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:35.409521 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dd2e5ac2-1717-4fa7-baf2-9619ce0853c8 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:35.410153 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dd2e5ac2-1717-4fa7-baf2-9619ce0853c8 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:35.410820 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dd2e5ac2-1717-4fa7-baf2-9619ce0853c8 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:35.447060 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-e12b84be-b59f-44ea-90fd-72df5f579df5 req-da60fc35-faab-48b1-b300-46613ec6797a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62133546-4a75-4532-81ab-0c49c9252e85", "name": "network-vif-deleted", "tag": "00532cca-3534-4784-9094-66d340359b0e"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:22:35.457420 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-e12b84be-b59f-44ea-90fd-72df5f579df5 req-da60fc35-faab-48b1-b300-46613ec6797a service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:35.457912 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-e12b84be-b59f-44ea-90fd-72df5f579df5 req-da60fc35-faab-48b1-b300-46613ec6797a service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:35.458349 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-e12b84be-b59f-44ea-90fd-72df5f579df5 req-da60fc35-faab-48b1-b300-46613ec6797a service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:35.489519 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-e12b84be-b59f-44ea-90fd-72df5f579df5 req-da60fc35-faab-48b1-b300-46613ec6797a service nova] Creating event network-vif-deleted:00532cca-3534-4784-9094-66d340359b0e for instance 62133546-4a75-4532-81ab-0c49c9252e85 on n-h2-861333-8 Oct 19 03:22:35.497909 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-e12b84be-b59f-44ea-90fd-72df5f579df5 req-da60fc35-faab-48b1-b300-46613ec6797a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154590 Oct 19 03:22:35.500314 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1239/2502] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:22:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:22:35.517809 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-dd2e5ac2-1717-4fa7-baf2-9619ce0853c8 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4c5e4123c44508a5d4911a17c44231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a495ccfced47f29cb928d1ded20d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:35.527875 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-dd2e5ac2-1717-4fa7-baf2-9619ce0853c8 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] 10.222.0.52 "GET /compute/v2.1/servers/19fbcbe2-9039-4d18-94ef-51ce58cb6365" status: 200 len: 1428 microversion: 2.1 time: 0.145168 Oct 19 03:22:35.528845 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1264/2503] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:22:35 2022] GET /compute/v2.1/servers/19fbcbe2-9039-4d18-94ef-51ce58cb6365 => generated 1428 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:22:35.637135 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1404239d-2669-42c2-a16a-b7aaf50da3ef tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:35.638182 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1404239d-2669-42c2-a16a-b7aaf50da3ef tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] [instance: b7ee1a20-f570-44ae-8e29-595fc6b3dcb6] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:35.651518 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a30615eb-8fc1-4d4e-9fbe-080dd8f333de tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:35.652297 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a30615eb-8fc1-4d4e-9fbe-080dd8f333de tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] [instance: bb7dc549-597e-4568-8ab7-768654c73278] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:35.659495 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1404239d-2669-42c2-a16a-b7aaf50da3ef tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:35.660117 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1404239d-2669-42c2-a16a-b7aaf50da3ef tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:35.663843 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1404239d-2669-42c2-a16a-b7aaf50da3ef tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:35.665111 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=8 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:22:35.666773 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1404239d-2669-42c2-a16a-b7aaf50da3ef tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:35.668700 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a30615eb-8fc1-4d4e-9fbe-080dd8f333de tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:35.669268 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a30615eb-8fc1-4d4e-9fbe-080dd8f333de tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:35.669797 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a30615eb-8fc1-4d4e-9fbe-080dd8f333de tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:35.670564 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a30615eb-8fc1-4d4e-9fbe-080dd8f333de tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:35.671059 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a30615eb-8fc1-4d4e-9fbe-080dd8f333de tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:35.671552 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a30615eb-8fc1-4d4e-9fbe-080dd8f333de tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:35.672478 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1404239d-2669-42c2-a16a-b7aaf50da3ef tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:35.672978 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1404239d-2669-42c2-a16a-b7aaf50da3ef tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:35.839629 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a30615eb-8fc1-4d4e-9fbe-080dd8f333de tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3661010393d44c428fb37652b1717072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a1e7cceff48798bfefb9390e5979c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:35.857211 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a30615eb-8fc1-4d4e-9fbe-080dd8f333de tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] 10.222.0.52 "GET /compute/v2.1/servers/bb7dc549-597e-4568-8ab7-768654c73278" status: 200 len: 1211 microversion: 2.1 time: 0.210613 Oct 19 03:22:35.879192 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1265/2504] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:22:35 2022] GET /compute/v2.1/servers/bb7dc549-597e-4568-8ab7-768654c73278 => generated 1211 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:22:35.945963 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-1404239d-2669-42c2-a16a-b7aaf50da3ef tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63cf2636aee743148721b5ba622de9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bc3a9713e04bafaf5812a87765de55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:35.955487 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-1404239d-2669-42c2-a16a-b7aaf50da3ef tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63cf2636aee743148721b5ba622de9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bc3a9713e04bafaf5812a87765de55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:35.957776 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-1404239d-2669-42c2-a16a-b7aaf50da3ef tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63cf2636aee743148721b5ba622de9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bc3a9713e04bafaf5812a87765de55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:35.960312 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1404239d-2669-42c2-a16a-b7aaf50da3ef tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] 10.222.0.52 "GET /compute/v2.1/servers/b7ee1a20-f570-44ae-8e29-595fc6b3dcb6" status: 200 len: 1362 microversion: 2.26 time: 0.328329 Oct 19 03:22:35.961272 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1240/2505] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:22:35 2022] GET /compute/v2.1/servers/b7ee1a20-f570-44ae-8e29-595fc6b3dcb6 => generated 1362 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:22:36.069310 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-939bd18a-ad79-4b80-b51d-7bb24b555265 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:36.070677 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-939bd18a-ad79-4b80-b51d-7bb24b555265 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] [instance: 6ef505a5-0624-4080-9089-821f6fdfb47c] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:36.078865 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-939bd18a-ad79-4b80-b51d-7bb24b555265 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:36.079599 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-939bd18a-ad79-4b80-b51d-7bb24b555265 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:36.080196 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-939bd18a-ad79-4b80-b51d-7bb24b555265 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:36.081091 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-939bd18a-ad79-4b80-b51d-7bb24b555265 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:36.081761 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-939bd18a-ad79-4b80-b51d-7bb24b555265 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:36.083309 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-939bd18a-ad79-4b80-b51d-7bb24b555265 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:36.251452 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7a30b9ee-7851-4ca4-b7e2-d88e71b1d4b6 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:36.252063 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7a30b9ee-7851-4ca4-b7e2-d88e71b1d4b6 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 62133546-4a75-4532-81ab-0c49c9252e85] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:36.258866 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7a30b9ee-7851-4ca4-b7e2-d88e71b1d4b6 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:36.259357 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7a30b9ee-7851-4ca4-b7e2-d88e71b1d4b6 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:36.259919 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7a30b9ee-7851-4ca4-b7e2-d88e71b1d4b6 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:36.260801 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7a30b9ee-7851-4ca4-b7e2-d88e71b1d4b6 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:36.261264 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7a30b9ee-7851-4ca4-b7e2-d88e71b1d4b6 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:36.262046 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7a30b9ee-7851-4ca4-b7e2-d88e71b1d4b6 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:36.308302 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7a30b9ee-7851-4ca4-b7e2-d88e71b1d4b6 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:36.318116 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7a30b9ee-7851-4ca4-b7e2-d88e71b1d4b6 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:36.318116 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7a30b9ee-7851-4ca4-b7e2-d88e71b1d4b6 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:36.318116 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-7a30b9ee-7851-4ca4-b7e2-d88e71b1d4b6 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lazy-loading 'fault' on Instance uuid 62133546-4a75-4532-81ab-0c49c9252e85 {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:22:36.318385 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-939bd18a-ad79-4b80-b51d-7bb24b555265 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a222bb0f9a4c728d2ed5ca011c032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146393855c047be83270e5334c68e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:36.329431 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-939bd18a-ad79-4b80-b51d-7bb24b555265 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] 10.222.0.52 "GET /compute/v2.1/servers/6ef505a5-0624-4080-9089-821f6fdfb47c" status: 200 len: 1467 microversion: 2.1 time: 0.264717 Oct 19 03:22:36.348861 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1266/2506] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:22:36 2022] GET /compute/v2.1/servers/6ef505a5-0624-4080-9089-821f6fdfb47c => generated 1467 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:22:36.354203 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-171f621e-1c06-40a4-b888-10a8a4bb2831 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:36.355015 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-171f621e-1c06-40a4-b888-10a8a4bb2831 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] [instance: 410116db-4d00-4a9d-8375-a5cea6a0d627] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:36.363486 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-171f621e-1c06-40a4-b888-10a8a4bb2831 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:36.364133 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-171f621e-1c06-40a4-b888-10a8a4bb2831 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:36.364675 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-171f621e-1c06-40a4-b888-10a8a4bb2831 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:36.367288 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-171f621e-1c06-40a4-b888-10a8a4bb2831 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:36.368177 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-171f621e-1c06-40a4-b888-10a8a4bb2831 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:36.368791 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-171f621e-1c06-40a4-b888-10a8a4bb2831 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:36.391137 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-7a30b9ee-7851-4ca4-b7e2-d88e71b1d4b6 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:36.412397 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-7a30b9ee-7851-4ca4-b7e2-d88e71b1d4b6 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:36.413921 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-7a30b9ee-7851-4ca4-b7e2-d88e71b1d4b6 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:36.415119 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7a30b9ee-7851-4ca4-b7e2-d88e71b1d4b6 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85" status: 200 len: 1375 microversion: 2.25 time: 0.167812 Oct 19 03:22:36.415697 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1241/2507] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:22:36 2022] GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85 => generated 1375 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:22:36.420436 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ecd4bd6c-e079-4958-8df0-dd5620f3e988 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:36.421256 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ecd4bd6c-e079-4958-8df0-dd5620f3e988 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: c45890de-f7bf-4736-8b08-6f3e6863e2b3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:36.428149 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ecd4bd6c-e079-4958-8df0-dd5620f3e988 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:36.428641 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ecd4bd6c-e079-4958-8df0-dd5620f3e988 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:36.429080 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ecd4bd6c-e079-4958-8df0-dd5620f3e988 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:36.436001 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ecd4bd6c-e079-4958-8df0-dd5620f3e988 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:36.436001 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ecd4bd6c-e079-4958-8df0-dd5620f3e988 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:36.436001 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ecd4bd6c-e079-4958-8df0-dd5620f3e988 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:36.703213 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-171f621e-1c06-40a4-b888-10a8a4bb2831 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a222bb0f9a4c728d2ed5ca011c032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146393855c047be83270e5334c68e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:36.719119 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-171f621e-1c06-40a4-b888-10a8a4bb2831 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] 10.222.0.52 "GET /compute/v2.1/servers/410116db-4d00-4a9d-8375-a5cea6a0d627" status: 200 len: 1467 microversion: 2.1 time: 0.361124 Oct 19 03:22:36.719119 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1267/2508] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:22:36 2022] GET /compute/v2.1/servers/410116db-4d00-4a9d-8375-a5cea6a0d627 => generated 1467 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:22:36.719119 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b9478040-613e-4f01-905c-113f7c41cd46 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:36.719119 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b9478040-613e-4f01-905c-113f7c41cd46 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] [instance: 19fbcbe2-9039-4d18-94ef-51ce58cb6365] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:36.723450 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b9478040-613e-4f01-905c-113f7c41cd46 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:36.723944 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b9478040-613e-4f01-905c-113f7c41cd46 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:36.724384 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b9478040-613e-4f01-905c-113f7c41cd46 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:36.725077 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b9478040-613e-4f01-905c-113f7c41cd46 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:36.725716 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b9478040-613e-4f01-905c-113f7c41cd46 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:36.726011 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b9478040-613e-4f01-905c-113f7c41cd46 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:36.742336 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ecd4bd6c-e079-4958-8df0-dd5620f3e988 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:36.751659 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ecd4bd6c-e079-4958-8df0-dd5620f3e988 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/c45890de-f7bf-4736-8b08-6f3e6863e2b3" status: 200 len: 1308 microversion: 2.1 time: 0.334930 Oct 19 03:22:36.774419 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1242/2509] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:22:36 2022] GET /compute/v2.1/servers/c45890de-f7bf-4736-8b08-6f3e6863e2b3 => generated 1308 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:22:36.779682 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-53907308-2735-45e7-bd97-fbaa5006cb63 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-799499763"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:22:36.780128 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b9478040-613e-4f01-905c-113f7c41cd46 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:36.782691 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-53907308-2735-45e7-bd97-fbaa5006cb63 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] [instance: 410116db-4d00-4a9d-8375-a5cea6a0d627] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:36.789095 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-53907308-2735-45e7-bd97-fbaa5006cb63 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:36.789832 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-53907308-2735-45e7-bd97-fbaa5006cb63 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:36.790453 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-53907308-2735-45e7-bd97-fbaa5006cb63 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:36.791321 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-53907308-2735-45e7-bd97-fbaa5006cb63 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:36.791934 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-53907308-2735-45e7-bd97-fbaa5006cb63 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:36.792518 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-53907308-2735-45e7-bd97-fbaa5006cb63 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:36.795821 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b9478040-613e-4f01-905c-113f7c41cd46 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:36.796288 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b9478040-613e-4f01-905c-113f7c41cd46 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:36.798557 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-b9478040-613e-4f01-905c-113f7c41cd46 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lazy-loading 'fault' on Instance uuid 19fbcbe2-9039-4d18-94ef-51ce58cb6365 {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:22:36.898576 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b9478040-613e-4f01-905c-113f7c41cd46 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4c5e4123c44508a5d4911a17c44231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a495ccfced47f29cb928d1ded20d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:36.909183 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b9478040-613e-4f01-905c-113f7c41cd46 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] 10.222.0.52 "GET /compute/v2.1/servers/19fbcbe2-9039-4d18-94ef-51ce58cb6365" status: 200 len: 1304 microversion: 2.1 time: 0.196251 Oct 19 03:22:36.923579 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1268/2510] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:22:36 2022] GET /compute/v2.1/servers/19fbcbe2-9039-4d18-94ef-51ce58cb6365 => generated 1304 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:22:36.935187 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4ff5ff43-5b2d-4b96-a66c-a7d6b2258602 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:36.936163 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4ff5ff43-5b2d-4b96-a66c-a7d6b2258602 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] [instance: bb7dc549-597e-4568-8ab7-768654c73278] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:36.951549 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4ff5ff43-5b2d-4b96-a66c-a7d6b2258602 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:36.953654 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4ff5ff43-5b2d-4b96-a66c-a7d6b2258602 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:36.956196 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4ff5ff43-5b2d-4b96-a66c-a7d6b2258602 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:36.956196 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4ff5ff43-5b2d-4b96-a66c-a7d6b2258602 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:36.956530 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4ff5ff43-5b2d-4b96-a66c-a7d6b2258602 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:36.956801 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4ff5ff43-5b2d-4b96-a66c-a7d6b2258602 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:37.083800 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4ff5ff43-5b2d-4b96-a66c-a7d6b2258602 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3661010393d44c428fb37652b1717072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a1e7cceff48798bfefb9390e5979c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:37.086616 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=100 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:22:37.100069 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4ff5ff43-5b2d-4b96-a66c-a7d6b2258602 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] 10.222.0.52 "GET /compute/v2.1/servers/bb7dc549-597e-4568-8ab7-768654c73278" status: 200 len: 1267 microversion: 2.1 time: 0.168539 Oct 19 03:22:37.100069 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1269/2511] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:22:36 2022] GET /compute/v2.1/servers/bb7dc549-597e-4568-8ab7-768654c73278 => generated 1267 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:22:37.100069 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a4edd9bf-f2f3-4c95-ba8b-faaa6824100a tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:37.100069 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a4edd9bf-f2f3-4c95-ba8b-faaa6824100a tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] [instance: b7ee1a20-f570-44ae-8e29-595fc6b3dcb6] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:37.105470 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a4edd9bf-f2f3-4c95-ba8b-faaa6824100a tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:37.106388 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a4edd9bf-f2f3-4c95-ba8b-faaa6824100a tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:37.106846 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a4edd9bf-f2f3-4c95-ba8b-faaa6824100a tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:37.107579 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a4edd9bf-f2f3-4c95-ba8b-faaa6824100a tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:37.108349 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a4edd9bf-f2f3-4c95-ba8b-faaa6824100a tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:37.109519 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a4edd9bf-f2f3-4c95-ba8b-faaa6824100a tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:37.210916 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:22:37.267336 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a4edd9bf-f2f3-4c95-ba8b-faaa6824100a tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63cf2636aee743148721b5ba622de9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bc3a9713e04bafaf5812a87765de55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:37.278151 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a4edd9bf-f2f3-4c95-ba8b-faaa6824100a tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63cf2636aee743148721b5ba622de9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bc3a9713e04bafaf5812a87765de55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:37.287545 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a4edd9bf-f2f3-4c95-ba8b-faaa6824100a tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63cf2636aee743148721b5ba622de9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bc3a9713e04bafaf5812a87765de55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:37.289589 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a4edd9bf-f2f3-4c95-ba8b-faaa6824100a tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] 10.222.0.52 "GET /compute/v2.1/servers/b7ee1a20-f570-44ae-8e29-595fc6b3dcb6" status: 200 len: 1362 microversion: 2.26 time: 0.194652 Oct 19 03:22:37.290573 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1270/2512] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:22:37 2022] GET /compute/v2.1/servers/b7ee1a20-f570-44ae-8e29-595fc6b3dcb6 => generated 1362 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:22:37.295818 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-ee1090fc-7c41-404f-9518-17d629afbfa2 req-9740f9ff-6570-4fd0-a073-8a791bc91e6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7ee1a20-f570-44ae-8e29-595fc6b3dcb6", "name": "network-vif-plugged", "status": "completed", "tag": "ae4be69b-546f-4929-8906-f31230a604dd"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:22:37.308063 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-ee1090fc-7c41-404f-9518-17d629afbfa2 req-9740f9ff-6570-4fd0-a073-8a791bc91e6f service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:37.309484 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-ee1090fc-7c41-404f-9518-17d629afbfa2 req-9740f9ff-6570-4fd0-a073-8a791bc91e6f service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:37.309484 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-ee1090fc-7c41-404f-9518-17d629afbfa2 req-9740f9ff-6570-4fd0-a073-8a791bc91e6f service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:37.322310 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-ee1090fc-7c41-404f-9518-17d629afbfa2 req-9740f9ff-6570-4fd0-a073-8a791bc91e6f service nova] Creating event network-vif-plugged:ae4be69b-546f-4929-8906-f31230a604dd for instance b7ee1a20-f570-44ae-8e29-595fc6b3dcb6 on n-h1-861333-8 Oct 19 03:22:37.327835 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-ee1090fc-7c41-404f-9518-17d629afbfa2 req-9740f9ff-6570-4fd0-a073-8a791bc91e6f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035864 Oct 19 03:22:37.328878 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1271/2513] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:22:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:22:37.441844 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a9c22ef2-994c-4a7e-8c76-743aeaa93019 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:37.442635 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a9c22ef2-994c-4a7e-8c76-743aeaa93019 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 62133546-4a75-4532-81ab-0c49c9252e85] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:37.451929 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a9c22ef2-994c-4a7e-8c76-743aeaa93019 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:37.452560 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a9c22ef2-994c-4a7e-8c76-743aeaa93019 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:37.453083 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a9c22ef2-994c-4a7e-8c76-743aeaa93019 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:37.454555 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a9c22ef2-994c-4a7e-8c76-743aeaa93019 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:37.455102 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a9c22ef2-994c-4a7e-8c76-743aeaa93019 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:37.456522 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a9c22ef2-994c-4a7e-8c76-743aeaa93019 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:37.468698 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-53907308-2735-45e7-bd97-fbaa5006cb63 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] 10.222.0.52 "POST /compute/v2.1/servers/410116db-4d00-4a9d-8375-a5cea6a0d627/action" status: 202 len: 0 microversion: 2.1 time: 0.692188 Oct 19 03:22:37.472218 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1243/2514] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:22:36 2022] POST /compute/v2.1/servers/410116db-4d00-4a9d-8375-a5cea6a0d627/action => generated 0 bytes in 697 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 19 03:22:37.485542 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1be08933-3349-45f8-a965-2cdd0a03e7a8 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Calling method '.version_select at 0x7fc130207550>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:37.493340 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-a9c22ef2-994c-4a7e-8c76-743aeaa93019 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] HTTP exception thrown: Instance 62133546-4a75-4532-81ab-0c49c9252e85 could not be found. Oct 19 03:22:37.498959 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a9c22ef2-994c-4a7e-8c76-743aeaa93019 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Request method failure captured: Oct 19 03:22:37.498959 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85 HTTP/1.1 Oct 19 03:22:37.498959 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:22:37.498959 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:22:37.498959 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:22:37.498959 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:22:37.498959 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:22:37.498959 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:22:37.498959 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:22:37.498959 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:22:37.498959 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2tcwFSozsDsogt_HZcdUgmGnTvZs8mzfeFkvs053pzVRjXX83ROjKcXxAHBTWN9olIwcvfh5hq7TjIjuqVNVroG0_bo0U9SvMsHfqMQQCgAJwV8poqheN5uAYUPiFrTwSdQzcOt_Ql8r-P63WnnR-1IArren7PYbX_jjeQwEmghEeI Oct 19 03:22:37.498959 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:22:37.498959 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:22:37.498959 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:22:37.498959 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:22:37.498959 n-d-861333-8 devstack@n-api.service[121135]: X-Openstack-Nova-Api-Version: 2.25 Oct 19 03:22:37.498959 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:22:37.498959 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:22:37.498959 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 86eaac72e51142f795b3e482be19c4f2 Oct 19 03:22:37.498959 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1644681798 Oct 19 03:22:37.498959 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:22:37.498959 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:22:37.500613 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/86eaac72e51142f795b3e482be19c4f2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/86eaac72e51142f795b3e482be19c4f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/86eaac72e51142f795b3e482be19c4f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_86eaac72e51142f795b3e482be19c4f2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:22:37.500613 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1644681798 Oct 19 03:22:37.500613 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 86eaac72e51142f795b3e482be19c4f2 Oct 19 03:22:37.500613 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1644681798 Oct 19 03:22:37.500613 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-LiveAutoBlockMigrationV225Test-1644681798-project Oct 19 03:22:37.500613 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:22:37.500613 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:22:37.500613 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 7a453f077dae4dfa8a3cf28c555a9a7c Oct 19 03:22:37.500613 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1644681798-project Oct 19 03:22:37.500613 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:22:37.500613 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance 62133546-4a75-4532-81ab-0c49c9252e85 could not be found. Oct 19 03:22:37.500613 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '62133546-4a75-4532-81ab-0c49c9252e85'} Oct 19 03:22:37.501294 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:22:37.501294 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:22:37.501294 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:22:37.501294 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:22:37.501294 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:22:37.501294 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:22:37.501294 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:22:37.501294 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:22:37.501294 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:22:37.501294 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:22:37.501294 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62133546-4a75-4532-81ab-0c49c9252e85 could not be found. Oct 19 03:22:37.501294 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:22:37.501294 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:22:37.501294 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:22:37.501294 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:22:37.501294 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:22:37.501294 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:22:37.501294 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:22:37.501294 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:22:37.501294 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:22:37.502459 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:22:37.502459 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:22:37.502459 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:22:37.502459 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:22:37.502459 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:22:37.502459 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:22:37.502459 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:22:37.502459 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62133546-4a75-4532-81ab-0c49c9252e85 could not be found. Oct 19 03:22:37.502459 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:22:37.502459 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:22:37.502459 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:22:37.502459 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:22:37.502459 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:22:37.502459 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:22:37.502459 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:22:37.502459 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:22:37.502459 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62133546-4a75-4532-81ab-0c49c9252e85 could not be found. Oct 19 03:22:37.502459 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:22:37.503432 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a9c22ef2-994c-4a7e-8c76-743aeaa93019 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Returning 404 to user: Instance 62133546-4a75-4532-81ab-0c49c9252e85 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:22:37.503432 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a9c22ef2-994c-4a7e-8c76-743aeaa93019 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85" status: 404 len: 111 microversion: 2.25 time: 0.063278 Oct 19 03:22:37.519656 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1272/2515] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:22:37 2022] GET /compute/v2.1/servers/62133546-4a75-4532-81ab-0c49c9252e85 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 19 03:22:37.533590 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d4ebaae6-0a7b-4378-ba02-5f594aebe46e tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '.version_select at 0x7fc134f86160>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:37.556689 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1be08933-3349-45f8-a965-2cdd0a03e7a8 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] 10.222.0.52 "GET /compute/v2.1/images/b198d558-6429-48b5-a113-6a3a25c104ff" status: 200 len: 1454 microversion: 2.1 time: 0.074805 Oct 19 03:22:37.556689 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1244/2516] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:22:37 2022] GET /compute/v2.1/images/b198d558-6429-48b5-a113-6a3a25c104ff => generated 1454 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:22:37.674873 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d4ebaae6-0a7b-4378-ba02-5f594aebe46e tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-509612903" status: 204 len: 0 microversion: 2.25 time: 0.154008 Oct 19 03:22:37.676485 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1273/2517] 10.222.0.52 () {60 vars in 1259 bytes} [Wed Oct 19 03:22:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-509612903 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 19 03:22:37.779213 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7bbd0951-60dd-4c40-a1e9-f4c417dff64d tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:37.780646 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7bbd0951-60dd-4c40-a1e9-f4c417dff64d tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: c45890de-f7bf-4736-8b08-6f3e6863e2b3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:37.787695 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7bbd0951-60dd-4c40-a1e9-f4c417dff64d tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:37.788483 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7bbd0951-60dd-4c40-a1e9-f4c417dff64d tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:37.788919 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7bbd0951-60dd-4c40-a1e9-f4c417dff64d tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:37.789819 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7bbd0951-60dd-4c40-a1e9-f4c417dff64d tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:37.790399 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7bbd0951-60dd-4c40-a1e9-f4c417dff64d tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:37.790694 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7bbd0951-60dd-4c40-a1e9-f4c417dff64d tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:37.936257 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-806b6722-0901-414a-b9dc-abeff2b9d7aa tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:37.936983 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-806b6722-0901-414a-b9dc-abeff2b9d7aa tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] [instance: 19fbcbe2-9039-4d18-94ef-51ce58cb6365] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:37.944123 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-806b6722-0901-414a-b9dc-abeff2b9d7aa tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:37.944786 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-806b6722-0901-414a-b9dc-abeff2b9d7aa tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:37.945241 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-806b6722-0901-414a-b9dc-abeff2b9d7aa tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:37.945977 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-806b6722-0901-414a-b9dc-abeff2b9d7aa tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:37.946440 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-806b6722-0901-414a-b9dc-abeff2b9d7aa tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:37.946891 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-806b6722-0901-414a-b9dc-abeff2b9d7aa tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:37.988271 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-806b6722-0901-414a-b9dc-abeff2b9d7aa tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:37.988963 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-806b6722-0901-414a-b9dc-abeff2b9d7aa tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:37.990730 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-806b6722-0901-414a-b9dc-abeff2b9d7aa tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:37.991216 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-806b6722-0901-414a-b9dc-abeff2b9d7aa tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lazy-loading 'fault' on Instance uuid 19fbcbe2-9039-4d18-94ef-51ce58cb6365 {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:22:38.064503 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-7bbd0951-60dd-4c40-a1e9-f4c417dff64d tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:38.080905 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7bbd0951-60dd-4c40-a1e9-f4c417dff64d tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/c45890de-f7bf-4736-8b08-6f3e6863e2b3" status: 200 len: 1308 microversion: 2.1 time: 0.300821 Oct 19 03:22:38.080905 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1245/2518] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:22:37 2022] GET /compute/v2.1/servers/c45890de-f7bf-4736-8b08-6f3e6863e2b3 => generated 1308 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:22:38.103709 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-806b6722-0901-414a-b9dc-abeff2b9d7aa tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4c5e4123c44508a5d4911a17c44231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a495ccfced47f29cb928d1ded20d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:38.118633 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0a54d5b5-1f25-4fbd-a492-cb1a69bba131 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:38.119410 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0a54d5b5-1f25-4fbd-a492-cb1a69bba131 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] [instance: bb7dc549-597e-4568-8ab7-768654c73278] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:38.126990 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-806b6722-0901-414a-b9dc-abeff2b9d7aa tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] 10.222.0.52 "GET /compute/v2.1/servers/19fbcbe2-9039-4d18-94ef-51ce58cb6365" status: 200 len: 1304 microversion: 2.1 time: 0.195630 Oct 19 03:22:38.127511 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1274/2519] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:22:37 2022] GET /compute/v2.1/servers/19fbcbe2-9039-4d18-94ef-51ce58cb6365 => generated 1304 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:22:38.132678 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0a54d5b5-1f25-4fbd-a492-cb1a69bba131 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:38.138122 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0a54d5b5-1f25-4fbd-a492-cb1a69bba131 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:38.138827 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0a54d5b5-1f25-4fbd-a492-cb1a69bba131 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:38.139939 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0a54d5b5-1f25-4fbd-a492-cb1a69bba131 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:38.141700 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0a54d5b5-1f25-4fbd-a492-cb1a69bba131 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:38.142320 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0a54d5b5-1f25-4fbd-a492-cb1a69bba131 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:38.258545 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0a54d5b5-1f25-4fbd-a492-cb1a69bba131 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3661010393d44c428fb37652b1717072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a1e7cceff48798bfefb9390e5979c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:38.273553 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0a54d5b5-1f25-4fbd-a492-cb1a69bba131 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] 10.222.0.52 "GET /compute/v2.1/servers/bb7dc549-597e-4568-8ab7-768654c73278" status: 200 len: 1273 microversion: 2.1 time: 0.158696 Oct 19 03:22:38.279944 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1246/2520] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:22:38 2022] GET /compute/v2.1/servers/bb7dc549-597e-4568-8ab7-768654c73278 => generated 1273 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:22:38.318540 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4aa0026b-708e-4a9b-9369-c7809ca99421 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:38.319591 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4aa0026b-708e-4a9b-9369-c7809ca99421 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] [instance: b7ee1a20-f570-44ae-8e29-595fc6b3dcb6] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:38.328428 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4aa0026b-708e-4a9b-9369-c7809ca99421 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:38.329154 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4aa0026b-708e-4a9b-9369-c7809ca99421 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:38.329893 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4aa0026b-708e-4a9b-9369-c7809ca99421 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:38.331381 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4aa0026b-708e-4a9b-9369-c7809ca99421 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:38.332274 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4aa0026b-708e-4a9b-9369-c7809ca99421 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:38.333231 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4aa0026b-708e-4a9b-9369-c7809ca99421 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:38.571039 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8f9c7ea6-ec84-40e3-bd98-e9569682f1de tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Calling method '.version_select at 0x7fc13024f160>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:38.620434 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8f9c7ea6-ec84-40e3-bd98-e9569682f1de tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] 10.222.0.52 "GET /compute/v2.1/images/b198d558-6429-48b5-a113-6a3a25c104ff" status: 200 len: 1454 microversion: 2.1 time: 0.054115 Oct 19 03:22:38.621467 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1247/2521] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:22:38 2022] GET /compute/v2.1/images/b198d558-6429-48b5-a113-6a3a25c104ff => generated 1454 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:22:38.804896 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-71e2fdc1-8870-4c27-a8e3-65f77c240ba5 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:38.809300 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-71e2fdc1-8870-4c27-a8e3-65f77c240ba5 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: d67da55c-724e-4305-9960-99d15ecfb23a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:38.812990 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-71e2fdc1-8870-4c27-a8e3-65f77c240ba5 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:38.814058 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-71e2fdc1-8870-4c27-a8e3-65f77c240ba5 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:38.814458 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-71e2fdc1-8870-4c27-a8e3-65f77c240ba5 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:38.815180 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-71e2fdc1-8870-4c27-a8e3-65f77c240ba5 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:38.815641 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-71e2fdc1-8870-4c27-a8e3-65f77c240ba5 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:38.816143 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-71e2fdc1-8870-4c27-a8e3-65f77c240ba5 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:38.844454 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-71e2fdc1-8870-4c27-a8e3-65f77c240ba5 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: d67da55c-724e-4305-9960-99d15ecfb23a] Going to try to terminate instance {{(pid=121134) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:22:38.899913 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4aa0026b-708e-4a9b-9369-c7809ca99421 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63cf2636aee743148721b5ba622de9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bc3a9713e04bafaf5812a87765de55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:38.912028 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4aa0026b-708e-4a9b-9369-c7809ca99421 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63cf2636aee743148721b5ba622de9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bc3a9713e04bafaf5812a87765de55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:38.918595 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4aa0026b-708e-4a9b-9369-c7809ca99421 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63cf2636aee743148721b5ba622de9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bc3a9713e04bafaf5812a87765de55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:38.920219 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4aa0026b-708e-4a9b-9369-c7809ca99421 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] 10.222.0.52 "GET /compute/v2.1/servers/b7ee1a20-f570-44ae-8e29-595fc6b3dcb6" status: 200 len: 1362 microversion: 2.26 time: 0.608016 Oct 19 03:22:38.936960 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1275/2522] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:22:38 2022] GET /compute/v2.1/servers/b7ee1a20-f570-44ae-8e29-595fc6b3dcb6 => generated 1362 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:22:39.110625 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c6e33cf8-3e49-4bcb-9ae6-0b1ef0f38dc5 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:39.111239 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c6e33cf8-3e49-4bcb-9ae6-0b1ef0f38dc5 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: c45890de-f7bf-4736-8b08-6f3e6863e2b3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:39.117716 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c6e33cf8-3e49-4bcb-9ae6-0b1ef0f38dc5 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:39.118440 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c6e33cf8-3e49-4bcb-9ae6-0b1ef0f38dc5 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:39.119080 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c6e33cf8-3e49-4bcb-9ae6-0b1ef0f38dc5 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:39.120008 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c6e33cf8-3e49-4bcb-9ae6-0b1ef0f38dc5 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:39.131069 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c6e33cf8-3e49-4bcb-9ae6-0b1ef0f38dc5 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:39.131532 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c6e33cf8-3e49-4bcb-9ae6-0b1ef0f38dc5 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:39.289233 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:22:39.379595 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c6e33cf8-3e49-4bcb-9ae6-0b1ef0f38dc5 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:39.388457 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c6e33cf8-3e49-4bcb-9ae6-0b1ef0f38dc5 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/c45890de-f7bf-4736-8b08-6f3e6863e2b3" status: 200 len: 1308 microversion: 2.1 time: 0.287431 Oct 19 03:22:39.389721 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1276/2523] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:22:39 2022] GET /compute/v2.1/servers/c45890de-f7bf-4736-8b08-6f3e6863e2b3 => generated 1308 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:22:39.395679 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-bf111304-9dd7-485e-859a-2445b1b80161 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:39.396666 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-bf111304-9dd7-485e-859a-2445b1b80161 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] [instance: 19fbcbe2-9039-4d18-94ef-51ce58cb6365] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:39.404182 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bf111304-9dd7-485e-859a-2445b1b80161 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:39.411465 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bf111304-9dd7-485e-859a-2445b1b80161 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:39.411465 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bf111304-9dd7-485e-859a-2445b1b80161 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:39.411465 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bf111304-9dd7-485e-859a-2445b1b80161 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:39.411465 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bf111304-9dd7-485e-859a-2445b1b80161 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:39.411859 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bf111304-9dd7-485e-859a-2445b1b80161 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:39.423689 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-bf111304-9dd7-485e-859a-2445b1b80161 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] HTTP exception thrown: Instance 19fbcbe2-9039-4d18-94ef-51ce58cb6365 could not be found. Oct 19 03:22:39.425521 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-bf111304-9dd7-485e-859a-2445b1b80161 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Request method failure captured: Oct 19 03:22:39.425521 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/19fbcbe2-9039-4d18-94ef-51ce58cb6365 HTTP/1.1 Oct 19 03:22:39.425521 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:22:39.425521 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:22:39.425521 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:22:39.425521 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:22:39.425521 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:22:39.425521 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:22:39.425521 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:22:39.425521 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:22:39.425521 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2zDUs0PfKBQXbcZfGGAccSRG5jgb02LYsGmYLP1ROuYjn-BamP9m6xLekYIRWRDh4DgJHaPUk4VOJvLHFJIs4DKzlVqtqHDa4_bHP0zyZaXPHUBA9GxouDNx4Fw19X0fhhLN_lKSEAUPdg5sp5WlUhKT6lQXeoO2oPj4rnKZAZ7fj4 Oct 19 03:22:39.425521 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:22:39.425521 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:22:39.425521 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:22:39.425521 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:22:39.425521 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:22:39.425521 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:22:39.425521 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: c9a495ccfced47f29cb928d1ded20d85 Oct 19 03:22:39.425521 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ServersAdminTestJSON-824225463 Oct 19 03:22:39.425521 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:22:39.425521 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:22:39.426999 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c9a495ccfced47f29cb928d1ded20d85"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c9a495ccfced47f29cb928d1ded20d85"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c9a495ccfced47f29cb928d1ded20d85"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c9a495ccfced47f29cb928d1ded20d85", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:22:39.426999 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ServersAdminTestJSON-824225463 Oct 19 03:22:39.426999 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: c9a495ccfced47f29cb928d1ded20d85 Oct 19 03:22:39.426999 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ServersAdminTestJSON-824225463 Oct 19 03:22:39.426999 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ServersAdminTestJSON-824225463-project Oct 19 03:22:39.426999 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:22:39.426999 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:22:39.426999 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: ce4c5e4123c44508a5d4911a17c44231 Oct 19 03:22:39.426999 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ServersAdminTestJSON-824225463-project Oct 19 03:22:39.426999 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:22:39.426999 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance 19fbcbe2-9039-4d18-94ef-51ce58cb6365 could not be found. Oct 19 03:22:39.426999 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '19fbcbe2-9039-4d18-94ef-51ce58cb6365'} Oct 19 03:22:39.427788 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:22:39.427788 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:22:39.427788 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:22:39.427788 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:22:39.427788 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:22:39.427788 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:22:39.427788 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:22:39.427788 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:22:39.427788 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:22:39.427788 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:22:39.427788 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19fbcbe2-9039-4d18-94ef-51ce58cb6365 could not be found. Oct 19 03:22:39.427788 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:22:39.427788 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:22:39.427788 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:22:39.427788 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:22:39.427788 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:22:39.427788 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:22:39.427788 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:22:39.427788 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:22:39.427788 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:22:39.429061 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:22:39.429061 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:22:39.429061 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:22:39.429061 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:22:39.429061 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:22:39.429061 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:22:39.429061 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:22:39.429061 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19fbcbe2-9039-4d18-94ef-51ce58cb6365 could not be found. Oct 19 03:22:39.429061 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:22:39.429061 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:22:39.429061 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:22:39.429061 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:22:39.429061 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:22:39.429061 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:22:39.429061 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:22:39.429061 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:22:39.429061 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19fbcbe2-9039-4d18-94ef-51ce58cb6365 could not be found. Oct 19 03:22:39.429061 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:22:39.430366 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-bf111304-9dd7-485e-859a-2445b1b80161 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Returning 404 to user: Instance 19fbcbe2-9039-4d18-94ef-51ce58cb6365 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:22:39.430530 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-bf111304-9dd7-485e-859a-2445b1b80161 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] 10.222.0.52 "GET /compute/v2.1/servers/19fbcbe2-9039-4d18-94ef-51ce58cb6365" status: 404 len: 111 microversion: 2.1 time: 0.038005 Oct 19 03:22:39.431867 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1277/2524] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:22:39 2022] GET /compute/v2.1/servers/19fbcbe2-9039-4d18-94ef-51ce58cb6365 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:22:39.436247 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7148db88-26c7-47b2-aad7-439d7e0fa589 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:39.437068 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7148db88-26c7-47b2-aad7-439d7e0fa589 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] [instance: bb7dc549-597e-4568-8ab7-768654c73278] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:39.443489 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7148db88-26c7-47b2-aad7-439d7e0fa589 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:39.448995 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7148db88-26c7-47b2-aad7-439d7e0fa589 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:39.448995 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7148db88-26c7-47b2-aad7-439d7e0fa589 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:39.448995 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7148db88-26c7-47b2-aad7-439d7e0fa589 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:39.448995 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7148db88-26c7-47b2-aad7-439d7e0fa589 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:39.449337 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7148db88-26c7-47b2-aad7-439d7e0fa589 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:39.473874 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-71e2fdc1-8870-4c27-a8e3-65f77c240ba5 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "DELETE /compute/v2.1/servers/d67da55c-724e-4305-9960-99d15ecfb23a" status: 204 len: 0 microversion: 2.25 time: 0.673175 Oct 19 03:22:39.484803 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1248/2525] 10.222.0.52 () {60 vars in 1280 bytes} [Wed Oct 19 03:22:38 2022] DELETE /compute/v2.1/servers/d67da55c-724e-4305-9960-99d15ecfb23a => generated 0 bytes in 676 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 19 03:22:39.484803 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-662a85cc-2c27-4f62-893b-3319a4f0819b tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:39.484803 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-662a85cc-2c27-4f62-893b-3319a4f0819b tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] [instance: 6888c8db-82ba-4072-b431-8d4fcf5f03e0] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:39.497411 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-662a85cc-2c27-4f62-893b-3319a4f0819b tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:39.498050 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-662a85cc-2c27-4f62-893b-3319a4f0819b tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:39.498602 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-662a85cc-2c27-4f62-893b-3319a4f0819b tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:39.500130 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-662a85cc-2c27-4f62-893b-3319a4f0819b tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:39.500696 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-662a85cc-2c27-4f62-893b-3319a4f0819b tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:39.501222 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-662a85cc-2c27-4f62-893b-3319a4f0819b tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:39.553798 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-662a85cc-2c27-4f62-893b-3319a4f0819b tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] [instance: 6888c8db-82ba-4072-b431-8d4fcf5f03e0] Going to try to terminate instance {{(pid=121134) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:22:39.754636 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7148db88-26c7-47b2-aad7-439d7e0fa589 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3661010393d44c428fb37652b1717072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a1e7cceff48798bfefb9390e5979c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:39.763567 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7148db88-26c7-47b2-aad7-439d7e0fa589 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] 10.222.0.52 "GET /compute/v2.1/servers/bb7dc549-597e-4568-8ab7-768654c73278" status: 200 len: 1315 microversion: 2.1 time: 0.330873 Oct 19 03:22:39.764280 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1278/2526] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:22:39 2022] GET /compute/v2.1/servers/bb7dc549-597e-4568-8ab7-768654c73278 => generated 1315 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:22:39.770853 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7c8b8b1c-8644-47bb-a16b-081cad3917d3 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:39.771637 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7c8b8b1c-8644-47bb-a16b-081cad3917d3 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: d67da55c-724e-4305-9960-99d15ecfb23a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:39.779950 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7c8b8b1c-8644-47bb-a16b-081cad3917d3 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:39.781471 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7c8b8b1c-8644-47bb-a16b-081cad3917d3 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:39.782191 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7c8b8b1c-8644-47bb-a16b-081cad3917d3 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:39.782957 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7c8b8b1c-8644-47bb-a16b-081cad3917d3 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:39.783605 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7c8b8b1c-8644-47bb-a16b-081cad3917d3 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:39.784044 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7c8b8b1c-8644-47bb-a16b-081cad3917d3 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:39.920278 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-662a85cc-2c27-4f62-893b-3319a4f0819b tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] 10.222.0.52 "DELETE /compute/v2.1/servers/6888c8db-82ba-4072-b431-8d4fcf5f03e0" status: 204 len: 0 microversion: 2.1 time: 0.441135 Oct 19 03:22:39.920950 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1249/2527] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:22:39 2022] DELETE /compute/v2.1/servers/6888c8db-82ba-4072-b431-8d4fcf5f03e0 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:22:39.927171 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a2a4fa2c-cc6a-441d-bf49-a5d1658b3df5 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Calling method '.version_select at 0x7fc1301b5160>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:39.975011 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a2a4fa2c-cc6a-441d-bf49-a5d1658b3df5 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] 10.222.0.52 "GET /compute/v2.1/images/b198d558-6429-48b5-a113-6a3a25c104ff" status: 200 len: 1454 microversion: 2.1 time: 0.051991 Oct 19 03:22:39.983189 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1250/2528] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:22:39 2022] GET /compute/v2.1/images/b198d558-6429-48b5-a113-6a3a25c104ff => generated 1454 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:22:39.983189 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-17bfd94c-53d7-47cd-9dee-42f8fb44fbef req-5467299e-67e1-45d5-b410-acd16dcc6864 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c45890de-f7bf-4736-8b08-6f3e6863e2b3", "name": "network-vif-plugged", "status": "completed", "tag": "6dfdbd8b-f3ab-4274-8a35-fe995bdd3cba"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:22:39.993010 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-17bfd94c-53d7-47cd-9dee-42f8fb44fbef req-5467299e-67e1-45d5-b410-acd16dcc6864 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:39.993520 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-17bfd94c-53d7-47cd-9dee-42f8fb44fbef req-5467299e-67e1-45d5-b410-acd16dcc6864 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:39.994042 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-17bfd94c-53d7-47cd-9dee-42f8fb44fbef req-5467299e-67e1-45d5-b410-acd16dcc6864 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:40.005126 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-17bfd94c-53d7-47cd-9dee-42f8fb44fbef req-5467299e-67e1-45d5-b410-acd16dcc6864 service nova] Creating event network-vif-plugged:6dfdbd8b-f3ab-4274-8a35-fe995bdd3cba for instance c45890de-f7bf-4736-8b08-6f3e6863e2b3 on n-h2-861333-8 Oct 19 03:22:40.010078 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-17bfd94c-53d7-47cd-9dee-42f8fb44fbef req-5467299e-67e1-45d5-b410-acd16dcc6864 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032815 Oct 19 03:22:40.017886 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1251/2529] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:22:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:22:40.020357 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6a9a5e10-99a0-44ff-b9ee-27ce61bf44b7 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:40.021074 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6a9a5e10-99a0-44ff-b9ee-27ce61bf44b7 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] [instance: 6888c8db-82ba-4072-b431-8d4fcf5f03e0] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:40.028894 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6a9a5e10-99a0-44ff-b9ee-27ce61bf44b7 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:40.029904 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6a9a5e10-99a0-44ff-b9ee-27ce61bf44b7 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:40.030388 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6a9a5e10-99a0-44ff-b9ee-27ce61bf44b7 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:40.031789 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6a9a5e10-99a0-44ff-b9ee-27ce61bf44b7 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:40.032365 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6a9a5e10-99a0-44ff-b9ee-27ce61bf44b7 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:40.032692 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6a9a5e10-99a0-44ff-b9ee-27ce61bf44b7 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:40.191622 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7c8b8b1c-8644-47bb-a16b-081cad3917d3 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:40.209791 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7c8b8b1c-8644-47bb-a16b-081cad3917d3 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:40.211881 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7c8b8b1c-8644-47bb-a16b-081cad3917d3 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:40.213657 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7c8b8b1c-8644-47bb-a16b-081cad3917d3 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/d67da55c-724e-4305-9960-99d15ecfb23a" status: 200 len: 1546 microversion: 2.25 time: 0.448154 Oct 19 03:22:40.214475 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1279/2530] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:22:39 2022] GET /compute/v2.1/servers/d67da55c-724e-4305-9960-99d15ecfb23a => generated 1546 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:22:40.240390 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-72cc636b-7a04-49b2-b979-662e297596ba tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:40.241278 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-72cc636b-7a04-49b2-b979-662e297596ba tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] [instance: b7ee1a20-f570-44ae-8e29-595fc6b3dcb6] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:40.248677 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-72cc636b-7a04-49b2-b979-662e297596ba tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:40.251047 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-72cc636b-7a04-49b2-b979-662e297596ba tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:40.251781 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-72cc636b-7a04-49b2-b979-662e297596ba tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:40.252671 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-72cc636b-7a04-49b2-b979-662e297596ba tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:40.255024 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-72cc636b-7a04-49b2-b979-662e297596ba tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:40.255536 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-72cc636b-7a04-49b2-b979-662e297596ba tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:40.414258 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-6a9a5e10-99a0-44ff-b9ee-27ce61bf44b7 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4c5e4123c44508a5d4911a17c44231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a495ccfced47f29cb928d1ded20d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:40.426062 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6a9a5e10-99a0-44ff-b9ee-27ce61bf44b7 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] 10.222.0.52 "GET /compute/v2.1/servers/6888c8db-82ba-4072-b431-8d4fcf5f03e0" status: 200 len: 1469 microversion: 2.1 time: 0.411250 Oct 19 03:22:40.433155 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1252/2531] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:22:40 2022] GET /compute/v2.1/servers/6888c8db-82ba-4072-b431-8d4fcf5f03e0 => generated 1469 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:22:40.444518 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f27ca3ea-e484-46df-a61d-52e73b7ed9e6 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:40.445172 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f27ca3ea-e484-46df-a61d-52e73b7ed9e6 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: c45890de-f7bf-4736-8b08-6f3e6863e2b3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:40.452277 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f27ca3ea-e484-46df-a61d-52e73b7ed9e6 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:40.453336 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f27ca3ea-e484-46df-a61d-52e73b7ed9e6 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:40.453800 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f27ca3ea-e484-46df-a61d-52e73b7ed9e6 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:40.454533 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f27ca3ea-e484-46df-a61d-52e73b7ed9e6 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:40.454984 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f27ca3ea-e484-46df-a61d-52e73b7ed9e6 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:40.455578 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f27ca3ea-e484-46df-a61d-52e73b7ed9e6 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:40.633219 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-72cc636b-7a04-49b2-b979-662e297596ba tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63cf2636aee743148721b5ba622de9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bc3a9713e04bafaf5812a87765de55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:40.643574 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-72cc636b-7a04-49b2-b979-662e297596ba tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63cf2636aee743148721b5ba622de9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bc3a9713e04bafaf5812a87765de55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:40.644875 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-72cc636b-7a04-49b2-b979-662e297596ba tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63cf2636aee743148721b5ba622de9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bc3a9713e04bafaf5812a87765de55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:40.646137 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-72cc636b-7a04-49b2-b979-662e297596ba tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] 10.222.0.52 "GET /compute/v2.1/servers/b7ee1a20-f570-44ae-8e29-595fc6b3dcb6" status: 200 len: 1547 microversion: 2.26 time: 0.417941 Oct 19 03:22:40.650427 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1280/2532] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:22:40 2022] GET /compute/v2.1/servers/b7ee1a20-f570-44ae-8e29-595fc6b3dcb6 => generated 1547 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:22:40.697832 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-99991225-2881-4209-831a-900f6ac339fa tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Calling method '.version_select at 0x7fc130ee1280>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:40.716862 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-99991225-2881-4209-831a-900f6ac339fa tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:40.717732 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-99991225-2881-4209-831a-900f6ac339fa tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:40.717848 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-99991225-2881-4209-831a-900f6ac339fa tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:40.718363 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-99991225-2881-4209-831a-900f6ac339fa tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] [instance: b7ee1a20-f570-44ae-8e29-595fc6b3dcb6] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:40.737460 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-99991225-2881-4209-831a-900f6ac339fa tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:40.737460 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-99991225-2881-4209-831a-900f6ac339fa tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:40.737460 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-99991225-2881-4209-831a-900f6ac339fa tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:40.737460 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-99991225-2881-4209-831a-900f6ac339fa tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:40.737851 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-99991225-2881-4209-831a-900f6ac339fa tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:40.737851 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-99991225-2881-4209-831a-900f6ac339fa tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:40.747066 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-f27ca3ea-e484-46df-a61d-52e73b7ed9e6 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:40.755631 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f27ca3ea-e484-46df-a61d-52e73b7ed9e6 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/c45890de-f7bf-4736-8b08-6f3e6863e2b3" status: 200 len: 1308 microversion: 2.1 time: 0.327330 Oct 19 03:22:40.783633 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1253/2533] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:22:40 2022] GET /compute/v2.1/servers/c45890de-f7bf-4736-8b08-6f3e6863e2b3 => generated 1308 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:22:40.788694 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7a402380-e13b-410a-9b09-53e233769ae8 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:40.789319 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7a402380-e13b-410a-9b09-53e233769ae8 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] [instance: bb7dc549-597e-4568-8ab7-768654c73278] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:40.795908 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7a402380-e13b-410a-9b09-53e233769ae8 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:40.796932 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7a402380-e13b-410a-9b09-53e233769ae8 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:40.797604 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7a402380-e13b-410a-9b09-53e233769ae8 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:40.798474 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7a402380-e13b-410a-9b09-53e233769ae8 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:40.799100 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7a402380-e13b-410a-9b09-53e233769ae8 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:40.799680 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7a402380-e13b-410a-9b09-53e233769ae8 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:40.801566 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-99991225-2881-4209-831a-900f6ac339fa tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:40.803012 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-99991225-2881-4209-831a-900f6ac339fa tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:40.803730 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-99991225-2881-4209-831a-900f6ac339fa tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:40.823262 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-99991225-2881-4209-831a-900f6ac339fa tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:40.823947 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-99991225-2881-4209-831a-900f6ac339fa tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:40.824494 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-99991225-2881-4209-831a-900f6ac339fa tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:40.926536 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-99991225-2881-4209-831a-900f6ac339fa tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lazy-loading 'flavor' on Instance uuid b7ee1a20-f570-44ae-8e29-595fc6b3dcb6 {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:22:40.943531 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-99991225-2881-4209-831a-900f6ac339fa tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] 10.222.0.52 "PUT /compute/v2.1/servers/b7ee1a20-f570-44ae-8e29-595fc6b3dcb6/tags/tempest-tag-2005331088" status: 201 len: 0 microversion: 2.26 time: 0.252867 Oct 19 03:22:40.955791 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1281/2534] 10.222.0.52 () {62 vars in 1380 bytes} [Wed Oct 19 03:22:40 2022] PUT /compute/v2.1/servers/b7ee1a20-f570-44ae-8e29-595fc6b3dcb6/tags/tempest-tag-2005331088 => generated 0 bytes in 255 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 19 03:22:40.955791 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-67a14ee8-a6a8-45f6-9a37-60e0ba71522f req-16116ebe-90e2-4fdd-802d-5d9168d9be6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb7dc549-597e-4568-8ab7-768654c73278", "tag": "0387e7d0-f8d7-44a7-96d1-e3e551f9b133"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:22:40.960531 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-67a14ee8-a6a8-45f6-9a37-60e0ba71522f req-16116ebe-90e2-4fdd-802d-5d9168d9be6f service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:40.960726 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-67a14ee8-a6a8-45f6-9a37-60e0ba71522f req-16116ebe-90e2-4fdd-802d-5d9168d9be6f service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:40.961194 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-67a14ee8-a6a8-45f6-9a37-60e0ba71522f req-16116ebe-90e2-4fdd-802d-5d9168d9be6f service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:40.974297 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-67a14ee8-a6a8-45f6-9a37-60e0ba71522f req-16116ebe-90e2-4fdd-802d-5d9168d9be6f service nova] Creating event network-changed:0387e7d0-f8d7-44a7-96d1-e3e551f9b133 for instance bb7dc549-597e-4568-8ab7-768654c73278 on n-h2-861333-8 Oct 19 03:22:40.980226 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-67a14ee8-a6a8-45f6-9a37-60e0ba71522f req-16116ebe-90e2-4fdd-802d-5d9168d9be6f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034221 Oct 19 03:22:40.982179 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1282/2535] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:22:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:22:40.990431 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-81652cdb-1edd-4aeb-8149-0d684498db81 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Calling method '.version_select at 0x7fc1305d7310>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:40.998905 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-81652cdb-1edd-4aeb-8149-0d684498db81 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:41.000176 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-81652cdb-1edd-4aeb-8149-0d684498db81 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:41.000677 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-81652cdb-1edd-4aeb-8149-0d684498db81 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:41.013347 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-81652cdb-1edd-4aeb-8149-0d684498db81 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] 10.222.0.52 "GET /compute/v2.1/servers/b7ee1a20-f570-44ae-8e29-595fc6b3dcb6/tags/tempest-tag-2005331088" status: 204 len: 0 microversion: 2.26 time: 0.029541 Oct 19 03:22:41.017910 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1283/2536] 10.222.0.52 () {60 vars in 1361 bytes} [Wed Oct 19 03:22:40 2022] GET /compute/v2.1/servers/b7ee1a20-f570-44ae-8e29-595fc6b3dcb6/tags/tempest-tag-2005331088 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 19 03:22:41.021531 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5a9b4b31-8b9b-4bf3-93f0-56e62056ac43 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Calling method '.version_select at 0x7fc134f43940>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:41.068473 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-7a402380-e13b-410a-9b09-53e233769ae8 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3661010393d44c428fb37652b1717072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a1e7cceff48798bfefb9390e5979c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:41.076857 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7a402380-e13b-410a-9b09-53e233769ae8 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] 10.222.0.52 "GET /compute/v2.1/servers/bb7dc549-597e-4568-8ab7-768654c73278" status: 200 len: 1315 microversion: 2.1 time: 0.292049 Oct 19 03:22:41.092646 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5a9b4b31-8b9b-4bf3-93f0-56e62056ac43 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] 10.222.0.52 "GET /compute/v2.1/images/b198d558-6429-48b5-a113-6a3a25c104ff" status: 200 len: 1454 microversion: 2.1 time: 0.061915 Oct 19 03:22:41.092646 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1284/2537] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:22:41 2022] GET /compute/v2.1/images/b198d558-6429-48b5-a113-6a3a25c104ff => generated 1454 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:22:41.093331 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1254/2538] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:22:40 2022] GET /compute/v2.1/servers/bb7dc549-597e-4568-8ab7-768654c73278 => generated 1315 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:22:41.093458 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a80b7f6c-cc40-4f77-ac2f-589ed9e2aa51 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Calling method '.version_select at 0x7fc1305d7940>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:41.095090 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a80b7f6c-cc40-4f77-ac2f-589ed9e2aa51 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:41.095675 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a80b7f6c-cc40-4f77-ac2f-589ed9e2aa51 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:41.096461 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a80b7f6c-cc40-4f77-ac2f-589ed9e2aa51 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:41.097451 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a80b7f6c-cc40-4f77-ac2f-589ed9e2aa51 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] [instance: b7ee1a20-f570-44ae-8e29-595fc6b3dcb6] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:41.106356 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a80b7f6c-cc40-4f77-ac2f-589ed9e2aa51 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:41.112481 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a80b7f6c-cc40-4f77-ac2f-589ed9e2aa51 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:41.112481 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a80b7f6c-cc40-4f77-ac2f-589ed9e2aa51 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:41.112481 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a80b7f6c-cc40-4f77-ac2f-589ed9e2aa51 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:41.112481 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a80b7f6c-cc40-4f77-ac2f-589ed9e2aa51 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:41.113724 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a80b7f6c-cc40-4f77-ac2f-589ed9e2aa51 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:41.152155 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a80b7f6c-cc40-4f77-ac2f-589ed9e2aa51 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:41.152731 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a80b7f6c-cc40-4f77-ac2f-589ed9e2aa51 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:41.153178 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a80b7f6c-cc40-4f77-ac2f-589ed9e2aa51 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:41.224267 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-a80b7f6c-cc40-4f77-ac2f-589ed9e2aa51 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lazy-loading 'flavor' on Instance uuid b7ee1a20-f570-44ae-8e29-595fc6b3dcb6 {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:22:41.247610 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a80b7f6c-cc40-4f77-ac2f-589ed9e2aa51 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] 10.222.0.52 "DELETE /compute/v2.1/servers/b7ee1a20-f570-44ae-8e29-595fc6b3dcb6/tags" status: 204 len: 0 microversion: 2.26 time: 0.167968 Oct 19 03:22:41.248798 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1285/2539] 10.222.0.52 () {60 vars in 1295 bytes} [Wed Oct 19 03:22:41 2022] DELETE /compute/v2.1/servers/b7ee1a20-f570-44ae-8e29-595fc6b3dcb6/tags => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 19 03:22:41.249076 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-33e94f4b-b5e1-4b83-8771-e0146171ccec tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:41.249875 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-33e94f4b-b5e1-4b83-8771-e0146171ccec tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: d67da55c-724e-4305-9960-99d15ecfb23a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:41.258631 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-956caffe-40d8-4edb-96d4-a7ac9d0f7b0a tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Calling method '.version_select at 0x7fc1305e75e0>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:41.265093 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-33e94f4b-b5e1-4b83-8771-e0146171ccec tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:41.266121 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-33e94f4b-b5e1-4b83-8771-e0146171ccec tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:41.267288 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-33e94f4b-b5e1-4b83-8771-e0146171ccec tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:41.268093 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-33e94f4b-b5e1-4b83-8771-e0146171ccec tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:41.269224 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-956caffe-40d8-4edb-96d4-a7ac9d0f7b0a tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:41.269915 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-33e94f4b-b5e1-4b83-8771-e0146171ccec tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:41.270198 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-956caffe-40d8-4edb-96d4-a7ac9d0f7b0a tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:41.270542 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-33e94f4b-b5e1-4b83-8771-e0146171ccec tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:41.271162 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-956caffe-40d8-4edb-96d4-a7ac9d0f7b0a tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:41.282839 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-956caffe-40d8-4edb-96d4-a7ac9d0f7b0a tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] 10.222.0.52 "GET /compute/v2.1/servers/b7ee1a20-f570-44ae-8e29-595fc6b3dcb6/tags" status: 200 len: 12 microversion: 2.26 time: 0.028465 Oct 19 03:22:41.284270 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1286/2540] 10.222.0.52 () {60 vars in 1292 bytes} [Wed Oct 19 03:22:41 2022] GET /compute/v2.1/servers/b7ee1a20-f570-44ae-8e29-595fc6b3dcb6/tags => generated 12 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:22:41.316775 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3aec8501-5642-4193-a6f9-c66b52ad3722 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Calling method '.version_select at 0x7fc1305d75e0>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:41.352861 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3aec8501-5642-4193-a6f9-c66b52ad3722 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:41.353393 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3aec8501-5642-4193-a6f9-c66b52ad3722 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:41.353827 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3aec8501-5642-4193-a6f9-c66b52ad3722 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:41.354474 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-3aec8501-5642-4193-a6f9-c66b52ad3722 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] [instance: b7ee1a20-f570-44ae-8e29-595fc6b3dcb6] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:41.369156 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3aec8501-5642-4193-a6f9-c66b52ad3722 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:41.370328 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3aec8501-5642-4193-a6f9-c66b52ad3722 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:41.370956 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3aec8501-5642-4193-a6f9-c66b52ad3722 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:41.371788 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3aec8501-5642-4193-a6f9-c66b52ad3722 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:41.372347 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3aec8501-5642-4193-a6f9-c66b52ad3722 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:41.372784 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3aec8501-5642-4193-a6f9-c66b52ad3722 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:41.422279 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3aec8501-5642-4193-a6f9-c66b52ad3722 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:41.425990 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3aec8501-5642-4193-a6f9-c66b52ad3722 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:41.427396 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3aec8501-5642-4193-a6f9-c66b52ad3722 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:41.442214 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3aec8501-5642-4193-a6f9-c66b52ad3722 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:41.443605 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3aec8501-5642-4193-a6f9-c66b52ad3722 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:41.444237 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3aec8501-5642-4193-a6f9-c66b52ad3722 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:41.498914 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-33e94f4b-b5e1-4b83-8771-e0146171ccec tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:41.508532 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-33e94f4b-b5e1-4b83-8771-e0146171ccec tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:41.509906 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-33e94f4b-b5e1-4b83-8771-e0146171ccec tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:41.511071 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-33e94f4b-b5e1-4b83-8771-e0146171ccec tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/d67da55c-724e-4305-9960-99d15ecfb23a" status: 200 len: 1504 microversion: 2.25 time: 0.267281 Oct 19 03:22:41.514054 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1255/2541] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:22:41 2022] GET /compute/v2.1/servers/d67da55c-724e-4305-9960-99d15ecfb23a => generated 1504 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:22:41.517785 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-58b7cf47-08a9-4bbe-893b-c14af88f5a7b tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:41.518176 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-58b7cf47-08a9-4bbe-893b-c14af88f5a7b tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] [instance: 6888c8db-82ba-4072-b431-8d4fcf5f03e0] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:41.533927 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-58b7cf47-08a9-4bbe-893b-c14af88f5a7b tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:41.540408 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-58b7cf47-08a9-4bbe-893b-c14af88f5a7b tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:41.540408 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-58b7cf47-08a9-4bbe-893b-c14af88f5a7b tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:41.553874 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-58b7cf47-08a9-4bbe-893b-c14af88f5a7b tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:41.559061 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-58b7cf47-08a9-4bbe-893b-c14af88f5a7b tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:41.559061 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-58b7cf47-08a9-4bbe-893b-c14af88f5a7b tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:41.569111 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=93,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2,nova_cell1:DELETE=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:22:41.574603 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-3aec8501-5642-4193-a6f9-c66b52ad3722 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lazy-loading 'flavor' on Instance uuid b7ee1a20-f570-44ae-8e29-595fc6b3dcb6 {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:22:41.597273 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-3aec8501-5642-4193-a6f9-c66b52ad3722 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] 10.222.0.52 "PUT /compute/v2.1/servers/b7ee1a20-f570-44ae-8e29-595fc6b3dcb6/tags/tempest-tag-2029057291" status: 201 len: 0 microversion: 2.26 time: 0.291088 Oct 19 03:22:41.599329 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1287/2542] 10.222.0.52 () {62 vars in 1380 bytes} [Wed Oct 19 03:22:41 2022] PUT /compute/v2.1/servers/b7ee1a20-f570-44ae-8e29-595fc6b3dcb6/tags/tempest-tag-2029057291 => generated 0 bytes in 294 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 19 03:22:41.620839 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-734425cd-f09c-4365-9291-373de57a79b0 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Calling method '.version_select at 0x7fc1302cd4c0>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:41.634753 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-734425cd-f09c-4365-9291-373de57a79b0 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:41.636300 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-734425cd-f09c-4365-9291-373de57a79b0 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:41.637320 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-734425cd-f09c-4365-9291-373de57a79b0 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:41.651506 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-734425cd-f09c-4365-9291-373de57a79b0 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] 10.222.0.52 "GET /compute/v2.1/servers/b7ee1a20-f570-44ae-8e29-595fc6b3dcb6/tags" status: 200 len: 36 microversion: 2.26 time: 0.035332 Oct 19 03:22:41.652224 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1288/2543] 10.222.0.52 () {60 vars in 1292 bytes} [Wed Oct 19 03:22:41 2022] GET /compute/v2.1/servers/b7ee1a20-f570-44ae-8e29-595fc6b3dcb6/tags => generated 36 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:22:41.662925 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-af53ed0e-7aac-4f7a-b2b4-260a1020c5ab tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Calling method '.version_select at 0x7fc1305d5ee0>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:41.674415 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-af53ed0e-7aac-4f7a-b2b4-260a1020c5ab tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:41.675529 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-af53ed0e-7aac-4f7a-b2b4-260a1020c5ab tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:41.676601 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-af53ed0e-7aac-4f7a-b2b4-260a1020c5ab tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:41.677060 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-af53ed0e-7aac-4f7a-b2b4-260a1020c5ab tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] [instance: b7ee1a20-f570-44ae-8e29-595fc6b3dcb6] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:41.690076 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-af53ed0e-7aac-4f7a-b2b4-260a1020c5ab tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:41.690076 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-af53ed0e-7aac-4f7a-b2b4-260a1020c5ab tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:41.690388 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-af53ed0e-7aac-4f7a-b2b4-260a1020c5ab tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:41.691104 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-af53ed0e-7aac-4f7a-b2b4-260a1020c5ab tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:41.691611 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-af53ed0e-7aac-4f7a-b2b4-260a1020c5ab tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:41.692046 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-af53ed0e-7aac-4f7a-b2b4-260a1020c5ab tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:41.723684 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-af53ed0e-7aac-4f7a-b2b4-260a1020c5ab tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:41.724164 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-af53ed0e-7aac-4f7a-b2b4-260a1020c5ab tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:41.724613 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-af53ed0e-7aac-4f7a-b2b4-260a1020c5ab tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:41.830375 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-58b7cf47-08a9-4bbe-893b-c14af88f5a7b tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4c5e4123c44508a5d4911a17c44231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a495ccfced47f29cb928d1ded20d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:41.839606 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-58b7cf47-08a9-4bbe-893b-c14af88f5a7b tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] 10.222.0.52 "GET /compute/v2.1/servers/6888c8db-82ba-4072-b431-8d4fcf5f03e0" status: 200 len: 1469 microversion: 2.1 time: 0.326805 Oct 19 03:22:41.850060 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1256/2544] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:22:41 2022] GET /compute/v2.1/servers/6888c8db-82ba-4072-b431-8d4fcf5f03e0 => generated 1469 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:22:41.862647 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ba3122b6-4193-4bf6-aea8-fcf098de6aae tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:41.863511 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ba3122b6-4193-4bf6-aea8-fcf098de6aae tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: c45890de-f7bf-4736-8b08-6f3e6863e2b3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:41.870199 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ba3122b6-4193-4bf6-aea8-fcf098de6aae tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:41.871006 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ba3122b6-4193-4bf6-aea8-fcf098de6aae tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:41.871762 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ba3122b6-4193-4bf6-aea8-fcf098de6aae tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:41.872657 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ba3122b6-4193-4bf6-aea8-fcf098de6aae tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:41.873162 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ba3122b6-4193-4bf6-aea8-fcf098de6aae tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:41.874881 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ba3122b6-4193-4bf6-aea8-fcf098de6aae tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:41.913461 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-af53ed0e-7aac-4f7a-b2b4-260a1020c5ab tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lazy-loading 'flavor' on Instance uuid b7ee1a20-f570-44ae-8e29-595fc6b3dcb6 {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:22:41.936266 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-af53ed0e-7aac-4f7a-b2b4-260a1020c5ab tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] 10.222.0.52 "DELETE /compute/v2.1/servers/b7ee1a20-f570-44ae-8e29-595fc6b3dcb6/tags/tempest-tag-2029057291" status: 204 len: 0 microversion: 2.26 time: 0.277441 Oct 19 03:22:41.943224 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1289/2545] 10.222.0.52 () {60 vars in 1364 bytes} [Wed Oct 19 03:22:41 2022] DELETE /compute/v2.1/servers/b7ee1a20-f570-44ae-8e29-595fc6b3dcb6/tags/tempest-tag-2029057291 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 19 03:22:41.947911 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-54463d4c-f3d3-4519-86bb-1d87855ac250 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Calling method '.version_select at 0x7fc1302ce280>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:41.963437 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-54463d4c-f3d3-4519-86bb-1d87855ac250 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:41.966626 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-54463d4c-f3d3-4519-86bb-1d87855ac250 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:41.966626 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-54463d4c-f3d3-4519-86bb-1d87855ac250 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:41.976381 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-54463d4c-f3d3-4519-86bb-1d87855ac250 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] 10.222.0.52 "GET /compute/v2.1/servers/b7ee1a20-f570-44ae-8e29-595fc6b3dcb6/tags" status: 200 len: 12 microversion: 2.26 time: 0.033385 Oct 19 03:22:41.982179 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1290/2546] 10.222.0.52 () {60 vars in 1292 bytes} [Wed Oct 19 03:22:41 2022] GET /compute/v2.1/servers/b7ee1a20-f570-44ae-8e29-595fc6b3dcb6/tags => generated 12 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:22:41.999888 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-8ea23d89-0cfc-4a6e-99b1-6e8d1080ee78 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Calling method '.version_select at 0x7fc1302cda60>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:42.008517 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8ea23d89-0cfc-4a6e-99b1-6e8d1080ee78 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:42.009079 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8ea23d89-0cfc-4a6e-99b1-6e8d1080ee78 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:42.009963 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8ea23d89-0cfc-4a6e-99b1-6e8d1080ee78 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:42.010335 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-8ea23d89-0cfc-4a6e-99b1-6e8d1080ee78 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] [instance: b7ee1a20-f570-44ae-8e29-595fc6b3dcb6] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:42.018134 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8ea23d89-0cfc-4a6e-99b1-6e8d1080ee78 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:42.018627 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8ea23d89-0cfc-4a6e-99b1-6e8d1080ee78 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:42.023658 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8ea23d89-0cfc-4a6e-99b1-6e8d1080ee78 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:42.023658 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8ea23d89-0cfc-4a6e-99b1-6e8d1080ee78 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:42.023658 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8ea23d89-0cfc-4a6e-99b1-6e8d1080ee78 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:42.023658 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8ea23d89-0cfc-4a6e-99b1-6e8d1080ee78 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:42.052839 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8ea23d89-0cfc-4a6e-99b1-6e8d1080ee78 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:42.053340 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8ea23d89-0cfc-4a6e-99b1-6e8d1080ee78 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:42.053893 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8ea23d89-0cfc-4a6e-99b1-6e8d1080ee78 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:42.079010 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-8ea23d89-0cfc-4a6e-99b1-6e8d1080ee78 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lazy-loading 'flavor' on Instance uuid b7ee1a20-f570-44ae-8e29-595fc6b3dcb6 {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:22:42.105421 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-8ea23d89-0cfc-4a6e-99b1-6e8d1080ee78 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] 10.222.0.52 "DELETE /compute/v2.1/servers/b7ee1a20-f570-44ae-8e29-595fc6b3dcb6/tags" status: 204 len: 0 microversion: 2.26 time: 0.121891 Oct 19 03:22:42.113886 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1291/2547] 10.222.0.52 () {60 vars in 1295 bytes} [Wed Oct 19 03:22:41 2022] DELETE /compute/v2.1/servers/b7ee1a20-f570-44ae-8e29-595fc6b3dcb6/tags => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 19 03:22:42.117933 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-856f4e0b-375e-4044-b801-5a9a508eec66 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Calling method '.version_select at 0x7fc130cf83a0>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:42.144816 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:22:42.204924 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-856f4e0b-375e-4044-b801-5a9a508eec66 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] 10.222.0.52 "GET /compute/v2.1/images/b198d558-6429-48b5-a113-6a3a25c104ff" status: 200 len: 1454 microversion: 2.1 time: 0.088420 Oct 19 03:22:42.204924 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1292/2548] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:22:42 2022] GET /compute/v2.1/images/b198d558-6429-48b5-a113-6a3a25c104ff => generated 1454 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:22:42.211913 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-32ee67a5-57d2-4aae-998d-b9eea15ced22 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:42.214650 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-32ee67a5-57d2-4aae-998d-b9eea15ced22 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] [instance: bb7dc549-597e-4568-8ab7-768654c73278] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:42.233867 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-32ee67a5-57d2-4aae-998d-b9eea15ced22 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:42.233867 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-32ee67a5-57d2-4aae-998d-b9eea15ced22 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:42.233867 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-32ee67a5-57d2-4aae-998d-b9eea15ced22 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:42.233867 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-32ee67a5-57d2-4aae-998d-b9eea15ced22 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:42.234630 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-32ee67a5-57d2-4aae-998d-b9eea15ced22 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:42.234630 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-32ee67a5-57d2-4aae-998d-b9eea15ced22 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:42.454034 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ba3122b6-4193-4bf6-aea8-fcf098de6aae tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:42.462656 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ba3122b6-4193-4bf6-aea8-fcf098de6aae tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/c45890de-f7bf-4736-8b08-6f3e6863e2b3" status: 200 len: 1487 microversion: 2.1 time: 0.604497 Oct 19 03:22:42.463845 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1257/2549] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:22:41 2022] GET /compute/v2.1/servers/c45890de-f7bf-4736-8b08-6f3e6863e2b3 => generated 1487 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:22:42.470663 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a9b0db94-04a0-4435-8223-b5c08350b5d8 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Calling method '.version_select at 0x7fc13024af70>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:42.481433 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a9b0db94-04a0-4435-8223-b5c08350b5d8 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:42.482096 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a9b0db94-04a0-4435-8223-b5c08350b5d8 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:42.482677 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a9b0db94-04a0-4435-8223-b5c08350b5d8 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:42.484146 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a9b0db94-04a0-4435-8223-b5c08350b5d8 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] [instance: b7ee1a20-f570-44ae-8e29-595fc6b3dcb6] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:42.491949 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a9b0db94-04a0-4435-8223-b5c08350b5d8 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:42.492582 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a9b0db94-04a0-4435-8223-b5c08350b5d8 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:42.493140 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a9b0db94-04a0-4435-8223-b5c08350b5d8 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:42.494020 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a9b0db94-04a0-4435-8223-b5c08350b5d8 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:42.494719 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a9b0db94-04a0-4435-8223-b5c08350b5d8 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:42.495368 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a9b0db94-04a0-4435-8223-b5c08350b5d8 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:42.549860 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a9b0db94-04a0-4435-8223-b5c08350b5d8 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:42.550645 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a9b0db94-04a0-4435-8223-b5c08350b5d8 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:42.551291 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a9b0db94-04a0-4435-8223-b5c08350b5d8 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:42.569726 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a9b0db94-04a0-4435-8223-b5c08350b5d8 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:42.570715 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a9b0db94-04a0-4435-8223-b5c08350b5d8 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:42.571718 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a9b0db94-04a0-4435-8223-b5c08350b5d8 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:42.588208 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=3,nova_cell1:INSERT=4,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:22:42.695440 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-a9b0db94-04a0-4435-8223-b5c08350b5d8 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lazy-loading 'flavor' on Instance uuid b7ee1a20-f570-44ae-8e29-595fc6b3dcb6 {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:22:42.725222 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-32ee67a5-57d2-4aae-998d-b9eea15ced22 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3661010393d44c428fb37652b1717072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a1e7cceff48798bfefb9390e5979c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:42.740728 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-32ee67a5-57d2-4aae-998d-b9eea15ced22 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] 10.222.0.52 "GET /compute/v2.1/servers/bb7dc549-597e-4568-8ab7-768654c73278" status: 200 len: 1315 microversion: 2.1 time: 0.531226 Oct 19 03:22:42.741955 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1293/2550] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:22:42 2022] GET /compute/v2.1/servers/bb7dc549-597e-4568-8ab7-768654c73278 => generated 1315 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:22:42.755544 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ccffb1c5-70d8-4382-9fa1-45696fc075eb tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:22:42.782141 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ccffb1c5-70d8-4382-9fa1-45696fc075eb tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:42.782649 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ccffb1c5-70d8-4382-9fa1-45696fc075eb tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:42.783150 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ccffb1c5-70d8-4382-9fa1-45696fc075eb tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:42.898196 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a9b0db94-04a0-4435-8223-b5c08350b5d8 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] 10.222.0.52 "PUT /compute/v2.1/servers/b7ee1a20-f570-44ae-8e29-595fc6b3dcb6/tags/tempest-tag-1970190573" status: 201 len: 0 microversion: 2.26 time: 0.431714 Oct 19 03:22:42.904466 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1258/2551] 10.222.0.52 () {62 vars in 1380 bytes} [Wed Oct 19 03:22:42 2022] PUT /compute/v2.1/servers/b7ee1a20-f570-44ae-8e29-595fc6b3dcb6/tags/tempest-tag-1970190573 => generated 0 bytes in 440 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 19 03:22:42.911064 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f57ce51f-2679-4d78-bff9-fa9a4e6012f9 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:42.912077 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f57ce51f-2679-4d78-bff9-fa9a4e6012f9 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: d67da55c-724e-4305-9960-99d15ecfb23a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:42.919306 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f57ce51f-2679-4d78-bff9-fa9a4e6012f9 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:42.923849 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f57ce51f-2679-4d78-bff9-fa9a4e6012f9 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:42.923849 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f57ce51f-2679-4d78-bff9-fa9a4e6012f9 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:42.923849 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f57ce51f-2679-4d78-bff9-fa9a4e6012f9 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:42.923849 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f57ce51f-2679-4d78-bff9-fa9a4e6012f9 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:42.924249 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f57ce51f-2679-4d78-bff9-fa9a4e6012f9 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:42.927405 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ccffb1c5-70d8-4382-9fa1-45696fc075eb tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: c45890de-f7bf-4736-8b08-6f3e6863e2b3] Going to try to stop instance {{(pid=121135) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 19 03:22:42.968497 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f57ce51f-2679-4d78-bff9-fa9a4e6012f9 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:42.969445 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f57ce51f-2679-4d78-bff9-fa9a4e6012f9 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:42.970149 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f57ce51f-2679-4d78-bff9-fa9a4e6012f9 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:42.970865 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-f57ce51f-2679-4d78-bff9-fa9a4e6012f9 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lazy-loading 'fault' on Instance uuid d67da55c-724e-4305-9960-99d15ecfb23a {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:22:43.036064 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-f57ce51f-2679-4d78-bff9-fa9a4e6012f9 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:43.047979 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-f57ce51f-2679-4d78-bff9-fa9a4e6012f9 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:43.050152 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-f57ce51f-2679-4d78-bff9-fa9a4e6012f9 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:43.051580 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f57ce51f-2679-4d78-bff9-fa9a4e6012f9 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/d67da55c-724e-4305-9960-99d15ecfb23a" status: 200 len: 1351 microversion: 2.25 time: 0.144840 Oct 19 03:22:43.052352 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1259/2552] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:22:42 2022] GET /compute/v2.1/servers/d67da55c-724e-4305-9960-99d15ecfb23a => generated 1351 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:22:43.056971 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-027d8e96-3d06-4440-b43a-b0df00842e8e req-f86be7ad-f5a8-47c4-b6cc-1f2d2e561b16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6888c8db-82ba-4072-b431-8d4fcf5f03e0", "name": "network-vif-deleted", "tag": "7d06606b-5258-42bd-89b9-3f972fa9dcda"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:22:43.075905 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-027d8e96-3d06-4440-b43a-b0df00842e8e req-f86be7ad-f5a8-47c4-b6cc-1f2d2e561b16 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:43.076702 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-027d8e96-3d06-4440-b43a-b0df00842e8e req-f86be7ad-f5a8-47c4-b6cc-1f2d2e561b16 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:43.077133 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-027d8e96-3d06-4440-b43a-b0df00842e8e req-f86be7ad-f5a8-47c4-b6cc-1f2d2e561b16 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:43.090954 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-027d8e96-3d06-4440-b43a-b0df00842e8e req-f86be7ad-f5a8-47c4-b6cc-1f2d2e561b16 service nova] Creating event network-vif-deleted:7d06606b-5258-42bd-89b9-3f972fa9dcda for instance 6888c8db-82ba-4072-b431-8d4fcf5f03e0 on n-h1-861333-8 Oct 19 03:22:43.098234 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-027d8e96-3d06-4440-b43a-b0df00842e8e req-f86be7ad-f5a8-47c4-b6cc-1f2d2e561b16 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044487 Oct 19 03:22:43.104130 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1260/2553] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:22:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:22:43.110638 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4915cf8d-2a72-40f6-bf2a-c2f4e800a927 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:43.111505 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4915cf8d-2a72-40f6-bf2a-c2f4e800a927 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] [instance: 6888c8db-82ba-4072-b431-8d4fcf5f03e0] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:43.119402 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4915cf8d-2a72-40f6-bf2a-c2f4e800a927 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:43.119914 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4915cf8d-2a72-40f6-bf2a-c2f4e800a927 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:43.120353 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4915cf8d-2a72-40f6-bf2a-c2f4e800a927 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:43.121203 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4915cf8d-2a72-40f6-bf2a-c2f4e800a927 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:43.121698 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4915cf8d-2a72-40f6-bf2a-c2f4e800a927 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:43.122133 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4915cf8d-2a72-40f6-bf2a-c2f4e800a927 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:43.195387 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=8 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:22:43.217382 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-4915cf8d-2a72-40f6-bf2a-c2f4e800a927 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4c5e4123c44508a5d4911a17c44231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a495ccfced47f29cb928d1ded20d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:43.227392 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4915cf8d-2a72-40f6-bf2a-c2f4e800a927 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] 10.222.0.52 "GET /compute/v2.1/servers/6888c8db-82ba-4072-b431-8d4fcf5f03e0" status: 200 len: 1299 microversion: 2.1 time: 0.121411 Oct 19 03:22:43.228489 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1261/2554] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:22:43 2022] GET /compute/v2.1/servers/6888c8db-82ba-4072-b431-8d4fcf5f03e0 => generated 1299 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:22:43.250378 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ccffb1c5-70d8-4382-9fa1-45696fc075eb tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "POST /compute/v2.1/servers/c45890de-f7bf-4736-8b08-6f3e6863e2b3/action" status: 202 len: 0 microversion: 2.1 time: 0.500273 Oct 19 03:22:43.253553 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1294/2555] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:22:42 2022] POST /compute/v2.1/servers/c45890de-f7bf-4736-8b08-6f3e6863e2b3/action => generated 0 bytes in 509 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:22:43.262142 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4d504325-d195-467d-9917-1b3cff311b5a tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Calling method '.version_select at 0x7fc1302a7670>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:43.264716 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-6b5cdb73-5fce-45ce-9c4b-cfb291cee943 req-befdec5c-9745-4ed6-9373-8a1c623bd851 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d67da55c-724e-4305-9960-99d15ecfb23a", "name": "network-vif-deleted", "tag": "0816439e-71ce-4a08-8fd4-aa143aa0c267"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:22:43.272227 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:22:43.292550 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4d504325-d195-467d-9917-1b3cff311b5a tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:43.294642 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-6b5cdb73-5fce-45ce-9c4b-cfb291cee943 req-befdec5c-9745-4ed6-9373-8a1c623bd851 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:43.295421 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4d504325-d195-467d-9917-1b3cff311b5a tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:43.297317 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4d504325-d195-467d-9917-1b3cff311b5a tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:43.300163 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4d504325-d195-467d-9917-1b3cff311b5a tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] [instance: b7ee1a20-f570-44ae-8e29-595fc6b3dcb6] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:43.300295 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-6b5cdb73-5fce-45ce-9c4b-cfb291cee943 req-befdec5c-9745-4ed6-9373-8a1c623bd851 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:43.300931 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-6b5cdb73-5fce-45ce-9c4b-cfb291cee943 req-befdec5c-9745-4ed6-9373-8a1c623bd851 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:43.313986 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4d504325-d195-467d-9917-1b3cff311b5a tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:43.314485 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4d504325-d195-467d-9917-1b3cff311b5a tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:43.314934 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4d504325-d195-467d-9917-1b3cff311b5a tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:43.322416 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4d504325-d195-467d-9917-1b3cff311b5a tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:43.322892 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4d504325-d195-467d-9917-1b3cff311b5a tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:43.329056 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4d504325-d195-467d-9917-1b3cff311b5a tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:43.329950 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-6b5cdb73-5fce-45ce-9c4b-cfb291cee943 req-befdec5c-9745-4ed6-9373-8a1c623bd851 service nova] Creating event network-vif-deleted:0816439e-71ce-4a08-8fd4-aa143aa0c267 for instance d67da55c-724e-4305-9960-99d15ecfb23a on n-h2-861333-8 Oct 19 03:22:43.344998 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-6b5cdb73-5fce-45ce-9c4b-cfb291cee943 req-befdec5c-9745-4ed6-9373-8a1c623bd851 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080502 Oct 19 03:22:43.351603 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1295/2556] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:22:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:22:43.366101 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-414d448e-d7a1-4c35-8f2b-16eb6d12413a tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Calling method '.version_select at 0x7fc1302cd040>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:43.407756 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4d504325-d195-467d-9917-1b3cff311b5a tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:43.408259 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4d504325-d195-467d-9917-1b3cff311b5a tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:43.412143 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4d504325-d195-467d-9917-1b3cff311b5a tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:43.450709 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-414d448e-d7a1-4c35-8f2b-16eb6d12413a tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] 10.222.0.52 "GET /compute/v2.1/images/b198d558-6429-48b5-a113-6a3a25c104ff" status: 200 len: 1454 microversion: 2.1 time: 0.097593 Oct 19 03:22:43.451505 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1296/2557] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:22:43 2022] GET /compute/v2.1/images/b198d558-6429-48b5-a113-6a3a25c104ff => generated 1454 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:22:43.458575 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-619ba99c-e1f3-45d5-86d7-ed5c5ed1e03d tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:43.459996 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4d504325-d195-467d-9917-1b3cff311b5a tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:43.460651 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4d504325-d195-467d-9917-1b3cff311b5a tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:43.461258 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4d504325-d195-467d-9917-1b3cff311b5a tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:43.462949 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-619ba99c-e1f3-45d5-86d7-ed5c5ed1e03d tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: c45890de-f7bf-4736-8b08-6f3e6863e2b3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:43.481331 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-619ba99c-e1f3-45d5-86d7-ed5c5ed1e03d tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:43.482247 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-619ba99c-e1f3-45d5-86d7-ed5c5ed1e03d tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:43.482794 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-619ba99c-e1f3-45d5-86d7-ed5c5ed1e03d tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:43.484253 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-619ba99c-e1f3-45d5-86d7-ed5c5ed1e03d tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:43.484842 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-619ba99c-e1f3-45d5-86d7-ed5c5ed1e03d tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:43.485275 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-619ba99c-e1f3-45d5-86d7-ed5c5ed1e03d tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:43.580281 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-4d504325-d195-467d-9917-1b3cff311b5a tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lazy-loading 'flavor' on Instance uuid b7ee1a20-f570-44ae-8e29-595fc6b3dcb6 {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:22:43.617441 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4d504325-d195-467d-9917-1b3cff311b5a tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] 10.222.0.52 "PUT /compute/v2.1/servers/b7ee1a20-f570-44ae-8e29-595fc6b3dcb6/tags/tempest-tag-1631529638" status: 201 len: 0 microversion: 2.26 time: 0.387800 Oct 19 03:22:43.626725 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1262/2558] 10.222.0.52 () {62 vars in 1380 bytes} [Wed Oct 19 03:22:43 2022] PUT /compute/v2.1/servers/b7ee1a20-f570-44ae-8e29-595fc6b3dcb6/tags/tempest-tag-1631529638 => generated 0 bytes in 395 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 19 03:22:43.632267 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-3423fff0-b71b-4317-846f-9492723daca2 req-bc68a5cb-115a-4998-b0fd-ffac6ec5b278 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "410116db-4d00-4a9d-8375-a5cea6a0d627", "name": "network-vif-plugged", "status": "completed", "tag": "c7f441d5-a985-4c81-97b8-114d47006d03"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:22:43.668507 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-3423fff0-b71b-4317-846f-9492723daca2 req-bc68a5cb-115a-4998-b0fd-ffac6ec5b278 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:43.669536 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-3423fff0-b71b-4317-846f-9492723daca2 req-bc68a5cb-115a-4998-b0fd-ffac6ec5b278 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:43.670166 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-3423fff0-b71b-4317-846f-9492723daca2 req-bc68a5cb-115a-4998-b0fd-ffac6ec5b278 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:43.689586 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-3423fff0-b71b-4317-846f-9492723daca2 req-bc68a5cb-115a-4998-b0fd-ffac6ec5b278 service nova] Creating event network-vif-plugged:c7f441d5-a985-4c81-97b8-114d47006d03 for instance 410116db-4d00-4a9d-8375-a5cea6a0d627 on n-h2-861333-8 Oct 19 03:22:43.696133 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-3423fff0-b71b-4317-846f-9492723daca2 req-bc68a5cb-115a-4998-b0fd-ffac6ec5b278 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067517 Oct 19 03:22:43.702790 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1263/2559] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:22:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:22:43.710580 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-98a4b899-8804-4015-8847-424053afc002 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Calling method '.version_select at 0x7fc13024f1f0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:43.730927 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-98a4b899-8804-4015-8847-424053afc002 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:43.738108 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-98a4b899-8804-4015-8847-424053afc002 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:43.738907 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-98a4b899-8804-4015-8847-424053afc002 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:43.741422 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-98a4b899-8804-4015-8847-424053afc002 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] [instance: b7ee1a20-f570-44ae-8e29-595fc6b3dcb6] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:43.752246 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-619ba99c-e1f3-45d5-86d7-ed5c5ed1e03d tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:43.756880 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-98a4b899-8804-4015-8847-424053afc002 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:43.760072 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-98a4b899-8804-4015-8847-424053afc002 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:43.763260 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-98a4b899-8804-4015-8847-424053afc002 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:43.767327 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-98a4b899-8804-4015-8847-424053afc002 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:43.767327 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-98a4b899-8804-4015-8847-424053afc002 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:43.767327 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-98a4b899-8804-4015-8847-424053afc002 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:43.772253 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-619ba99c-e1f3-45d5-86d7-ed5c5ed1e03d tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/c45890de-f7bf-4736-8b08-6f3e6863e2b3" status: 200 len: 1497 microversion: 2.1 time: 0.310941 Oct 19 03:22:43.772253 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1297/2560] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:22:43 2022] GET /compute/v2.1/servers/c45890de-f7bf-4736-8b08-6f3e6863e2b3 => generated 1497 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:22:43.777086 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-51cdd58d-7315-487d-8ab8-a8dd807be39f tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:43.777895 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-51cdd58d-7315-487d-8ab8-a8dd807be39f tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] [instance: bb7dc549-597e-4568-8ab7-768654c73278] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:43.784333 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-51cdd58d-7315-487d-8ab8-a8dd807be39f tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:43.784989 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-51cdd58d-7315-487d-8ab8-a8dd807be39f tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:43.785637 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-51cdd58d-7315-487d-8ab8-a8dd807be39f tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:43.786507 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-51cdd58d-7315-487d-8ab8-a8dd807be39f tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:43.787117 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-51cdd58d-7315-487d-8ab8-a8dd807be39f tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:43.787803 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-51cdd58d-7315-487d-8ab8-a8dd807be39f tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:43.834632 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-98a4b899-8804-4015-8847-424053afc002 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:43.835121 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-98a4b899-8804-4015-8847-424053afc002 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:43.835561 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-98a4b899-8804-4015-8847-424053afc002 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:43.934664 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-98a4b899-8804-4015-8847-424053afc002 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lazy-loading 'flavor' on Instance uuid b7ee1a20-f570-44ae-8e29-595fc6b3dcb6 {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:22:43.959992 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-98a4b899-8804-4015-8847-424053afc002 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] 10.222.0.52 "DELETE /compute/v2.1/servers/b7ee1a20-f570-44ae-8e29-595fc6b3dcb6/tags" status: 204 len: 0 microversion: 2.26 time: 0.254849 Oct 19 03:22:43.963817 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1264/2561] 10.222.0.52 () {60 vars in 1295 bytes} [Wed Oct 19 03:22:43 2022] DELETE /compute/v2.1/servers/b7ee1a20-f570-44ae-8e29-595fc6b3dcb6/tags => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 19 03:22:43.970437 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ecdcc918-f9c5-42b5-a54a-88e81d295e28 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Calling method '.version_select at 0x7fc1302a7310>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:43.982845 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ecdcc918-f9c5-42b5-a54a-88e81d295e28 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:43.983407 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ecdcc918-f9c5-42b5-a54a-88e81d295e28 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:43.984188 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ecdcc918-f9c5-42b5-a54a-88e81d295e28 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:43.995077 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ecdcc918-f9c5-42b5-a54a-88e81d295e28 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] 10.222.0.52 "GET /compute/v2.1/servers/b7ee1a20-f570-44ae-8e29-595fc6b3dcb6/tags" status: 200 len: 12 microversion: 2.26 time: 0.029752 Oct 19 03:22:44.000673 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1265/2562] 10.222.0.52 () {60 vars in 1292 bytes} [Wed Oct 19 03:22:43 2022] GET /compute/v2.1/servers/b7ee1a20-f570-44ae-8e29-595fc6b3dcb6/tags => generated 12 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:22:44.010834 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5e304ef5-2884-4eca-8290-1f4d1546cdc5 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Calling method '.version_select at 0x7fc1301b5280>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:44.028447 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5e304ef5-2884-4eca-8290-1f4d1546cdc5 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:44.028447 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5e304ef5-2884-4eca-8290-1f4d1546cdc5 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:44.028447 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5e304ef5-2884-4eca-8290-1f4d1546cdc5 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:44.028447 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5e304ef5-2884-4eca-8290-1f4d1546cdc5 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] [instance: b7ee1a20-f570-44ae-8e29-595fc6b3dcb6] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:44.031488 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-51cdd58d-7315-487d-8ab8-a8dd807be39f tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3661010393d44c428fb37652b1717072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a1e7cceff48798bfefb9390e5979c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:44.037895 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5e304ef5-2884-4eca-8290-1f4d1546cdc5 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:44.038968 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5e304ef5-2884-4eca-8290-1f4d1546cdc5 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:44.039483 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5e304ef5-2884-4eca-8290-1f4d1546cdc5 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:44.040205 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5e304ef5-2884-4eca-8290-1f4d1546cdc5 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:44.041251 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5e304ef5-2884-4eca-8290-1f4d1546cdc5 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:44.041729 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5e304ef5-2884-4eca-8290-1f4d1546cdc5 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:44.047196 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-51cdd58d-7315-487d-8ab8-a8dd807be39f tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] 10.222.0.52 "GET /compute/v2.1/servers/bb7dc549-597e-4568-8ab7-768654c73278" status: 200 len: 1315 microversion: 2.1 time: 0.269311 Oct 19 03:22:44.061511 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1298/2563] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:22:43 2022] GET /compute/v2.1/servers/bb7dc549-597e-4568-8ab7-768654c73278 => generated 1315 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:22:44.081566 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d2ac4875-95a7-43dd-8f67-f3c4039949b9 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:44.082499 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d2ac4875-95a7-43dd-8f67-f3c4039949b9 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: d67da55c-724e-4305-9960-99d15ecfb23a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:44.090159 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5e304ef5-2884-4eca-8290-1f4d1546cdc5 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:44.090673 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5e304ef5-2884-4eca-8290-1f4d1546cdc5 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:44.091450 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5e304ef5-2884-4eca-8290-1f4d1546cdc5 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:44.094068 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d2ac4875-95a7-43dd-8f67-f3c4039949b9 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:44.098436 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d2ac4875-95a7-43dd-8f67-f3c4039949b9 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:44.104314 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d2ac4875-95a7-43dd-8f67-f3c4039949b9 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:44.105244 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d2ac4875-95a7-43dd-8f67-f3c4039949b9 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:44.105903 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d2ac4875-95a7-43dd-8f67-f3c4039949b9 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:44.106027 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-5e304ef5-2884-4eca-8290-1f4d1546cdc5 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lazy-loading 'flavor' on Instance uuid b7ee1a20-f570-44ae-8e29-595fc6b3dcb6 {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:22:44.106619 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d2ac4875-95a7-43dd-8f67-f3c4039949b9 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:44.123618 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5e304ef5-2884-4eca-8290-1f4d1546cdc5 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] 10.222.0.52 "DELETE /compute/v2.1/servers/b7ee1a20-f570-44ae-8e29-595fc6b3dcb6/tags" status: 204 len: 0 microversion: 2.26 time: 0.120987 Oct 19 03:22:44.125058 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1266/2564] 10.222.0.52 () {60 vars in 1295 bytes} [Wed Oct 19 03:22:44 2022] DELETE /compute/v2.1/servers/b7ee1a20-f570-44ae-8e29-595fc6b3dcb6/tags => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 19 03:22:44.134614 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b8e9a188-a8af-410f-aef9-9ca4bcabf8a0 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Calling method '.version_select at 0x7fc130c1f1f0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:44.142750 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-d2ac4875-95a7-43dd-8f67-f3c4039949b9 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] HTTP exception thrown: Instance d67da55c-724e-4305-9960-99d15ecfb23a could not be found. Oct 19 03:22:44.144469 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d2ac4875-95a7-43dd-8f67-f3c4039949b9 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Request method failure captured: Oct 19 03:22:44.144469 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/d67da55c-724e-4305-9960-99d15ecfb23a HTTP/1.1 Oct 19 03:22:44.144469 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:22:44.144469 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:22:44.144469 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:22:44.144469 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:22:44.144469 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:22:44.144469 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:22:44.144469 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:22:44.144469 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:22:44.144469 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2tcwFSozsDsogt_HZcdUgmGnTvZs8mzfeFkvs053pzVRjXX83ROjKcXxAHBTWN9olIwcvfh5hq7TjIjuqVNVroG0_bo0U9SvMsHfqMQQCgAJwV8poqheN5uAYUPiFrTwSdQzcOt_Ql8r-P63WnnR-1IArren7PYbX_jjeQwEmghEeI Oct 19 03:22:44.144469 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:22:44.144469 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:22:44.144469 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:22:44.144469 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:22:44.144469 n-d-861333-8 devstack@n-api.service[121135]: X-Openstack-Nova-Api-Version: 2.25 Oct 19 03:22:44.144469 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:22:44.144469 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:22:44.144469 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 86eaac72e51142f795b3e482be19c4f2 Oct 19 03:22:44.144469 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1644681798 Oct 19 03:22:44.144469 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:22:44.144469 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:22:44.152170 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/86eaac72e51142f795b3e482be19c4f2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/86eaac72e51142f795b3e482be19c4f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/86eaac72e51142f795b3e482be19c4f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_86eaac72e51142f795b3e482be19c4f2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:22:44.152170 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1644681798 Oct 19 03:22:44.152170 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 86eaac72e51142f795b3e482be19c4f2 Oct 19 03:22:44.152170 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1644681798 Oct 19 03:22:44.152170 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-LiveAutoBlockMigrationV225Test-1644681798-project Oct 19 03:22:44.152170 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:22:44.152170 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:22:44.152170 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 7a453f077dae4dfa8a3cf28c555a9a7c Oct 19 03:22:44.152170 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1644681798-project Oct 19 03:22:44.152170 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:22:44.152170 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance d67da55c-724e-4305-9960-99d15ecfb23a could not be found. Oct 19 03:22:44.152170 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': 'd67da55c-724e-4305-9960-99d15ecfb23a'} Oct 19 03:22:44.152966 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:22:44.152966 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:22:44.152966 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:22:44.152966 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:22:44.152966 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:22:44.152966 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:22:44.152966 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:22:44.152966 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:22:44.152966 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:22:44.152966 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:22:44.152966 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d67da55c-724e-4305-9960-99d15ecfb23a could not be found. Oct 19 03:22:44.152966 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:22:44.152966 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:22:44.152966 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:22:44.152966 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:22:44.152966 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:22:44.152966 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:22:44.152966 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:22:44.152966 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:22:44.152966 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:22:44.154269 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:22:44.154269 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:22:44.154269 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:22:44.154269 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:22:44.154269 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:22:44.154269 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:22:44.154269 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:22:44.154269 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d67da55c-724e-4305-9960-99d15ecfb23a could not be found. Oct 19 03:22:44.154269 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:22:44.154269 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:22:44.154269 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:22:44.154269 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:22:44.154269 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:22:44.154269 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:22:44.154269 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:22:44.154269 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:22:44.154269 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d67da55c-724e-4305-9960-99d15ecfb23a could not be found. Oct 19 03:22:44.154269 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:22:44.155897 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d2ac4875-95a7-43dd-8f67-f3c4039949b9 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Returning 404 to user: Instance d67da55c-724e-4305-9960-99d15ecfb23a could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:22:44.155984 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b8e9a188-a8af-410f-aef9-9ca4bcabf8a0 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:44.155984 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b8e9a188-a8af-410f-aef9-9ca4bcabf8a0 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:44.156159 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d2ac4875-95a7-43dd-8f67-f3c4039949b9 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/d67da55c-724e-4305-9960-99d15ecfb23a" status: 404 len: 111 microversion: 2.25 time: 0.072476 Oct 19 03:22:44.156244 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b8e9a188-a8af-410f-aef9-9ca4bcabf8a0 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:44.156244 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b8e9a188-a8af-410f-aef9-9ca4bcabf8a0 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] [instance: b7ee1a20-f570-44ae-8e29-595fc6b3dcb6] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:44.156396 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1299/2565] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:22:44 2022] GET /compute/v2.1/servers/d67da55c-724e-4305-9960-99d15ecfb23a => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 19 03:22:44.161955 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b8e9a188-a8af-410f-aef9-9ca4bcabf8a0 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:44.164814 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-95b92385-2c49-40bd-bd03-ce466b25a37d tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:44.165482 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b8e9a188-a8af-410f-aef9-9ca4bcabf8a0 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:44.166040 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b8e9a188-a8af-410f-aef9-9ca4bcabf8a0 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:44.171309 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b8e9a188-a8af-410f-aef9-9ca4bcabf8a0 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:44.171309 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b8e9a188-a8af-410f-aef9-9ca4bcabf8a0 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:44.171309 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b8e9a188-a8af-410f-aef9-9ca4bcabf8a0 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:44.171517 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-95b92385-2c49-40bd-bd03-ce466b25a37d tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 82f8d22c-99ee-4c2b-8a36-5299c187ace7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:44.189641 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-95b92385-2c49-40bd-bd03-ce466b25a37d tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:44.193777 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-95b92385-2c49-40bd-bd03-ce466b25a37d tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:44.195208 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-95b92385-2c49-40bd-bd03-ce466b25a37d tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:44.197167 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-95b92385-2c49-40bd-bd03-ce466b25a37d tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:44.198438 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-95b92385-2c49-40bd-bd03-ce466b25a37d tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:44.198957 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-95b92385-2c49-40bd-bd03-ce466b25a37d tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:44.220096 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b8e9a188-a8af-410f-aef9-9ca4bcabf8a0 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:44.220858 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b8e9a188-a8af-410f-aef9-9ca4bcabf8a0 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:44.221394 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b8e9a188-a8af-410f-aef9-9ca4bcabf8a0 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:44.233821 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b8e9a188-a8af-410f-aef9-9ca4bcabf8a0 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:44.234454 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b8e9a188-a8af-410f-aef9-9ca4bcabf8a0 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:44.234974 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b8e9a188-a8af-410f-aef9-9ca4bcabf8a0 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:44.270769 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-95b92385-2c49-40bd-bd03-ce466b25a37d tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 82f8d22c-99ee-4c2b-8a36-5299c187ace7] Going to try to terminate instance {{(pid=121135) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:22:44.416290 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-b8e9a188-a8af-410f-aef9-9ca4bcabf8a0 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lazy-loading 'flavor' on Instance uuid b7ee1a20-f570-44ae-8e29-595fc6b3dcb6 {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:22:44.439257 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b8e9a188-a8af-410f-aef9-9ca4bcabf8a0 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] 10.222.0.52 "PUT /compute/v2.1/servers/b7ee1a20-f570-44ae-8e29-595fc6b3dcb6/tags/tempest-tag-1394252183" status: 201 len: 0 microversion: 2.26 time: 0.308686 Oct 19 03:22:44.440361 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1267/2566] 10.222.0.52 () {62 vars in 1380 bytes} [Wed Oct 19 03:22:44 2022] PUT /compute/v2.1/servers/b7ee1a20-f570-44ae-8e29-595fc6b3dcb6/tags/tempest-tag-1394252183 => generated 0 bytes in 310 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 19 03:22:44.445875 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6017098f-73e3-4799-9cbf-904b6a7d3848 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:44.446805 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6017098f-73e3-4799-9cbf-904b6a7d3848 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] [instance: 6888c8db-82ba-4072-b431-8d4fcf5f03e0] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:44.455305 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6017098f-73e3-4799-9cbf-904b6a7d3848 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:44.457037 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6017098f-73e3-4799-9cbf-904b6a7d3848 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:44.457537 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6017098f-73e3-4799-9cbf-904b6a7d3848 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:44.461352 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6017098f-73e3-4799-9cbf-904b6a7d3848 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:44.461897 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6017098f-73e3-4799-9cbf-904b6a7d3848 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:44.462477 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6017098f-73e3-4799-9cbf-904b6a7d3848 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:44.492472 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-6017098f-73e3-4799-9cbf-904b6a7d3848 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] HTTP exception thrown: Instance 6888c8db-82ba-4072-b431-8d4fcf5f03e0 could not be found. Oct 19 03:22:44.494158 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6017098f-73e3-4799-9cbf-904b6a7d3848 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Request method failure captured: Oct 19 03:22:44.494158 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/6888c8db-82ba-4072-b431-8d4fcf5f03e0 HTTP/1.1 Oct 19 03:22:44.494158 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:22:44.494158 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:22:44.494158 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:22:44.494158 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:22:44.494158 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:22:44.494158 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:22:44.494158 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:22:44.494158 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:22:44.494158 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT2zDUs0PfKBQXbcZfGGAccSRG5jgb02LYsGmYLP1ROuYjn-BamP9m6xLekYIRWRDh4DgJHaPUk4VOJvLHFJIs4DKzlVqtqHDa4_bHP0zyZaXPHUBA9GxouDNx4Fw19X0fhhLN_lKSEAUPdg5sp5WlUhKT6lQXeoO2oPj4rnKZAZ7fj4 Oct 19 03:22:44.494158 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:22:44.494158 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:22:44.494158 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:22:44.494158 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:22:44.494158 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:22:44.494158 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:22:44.494158 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: c9a495ccfced47f29cb928d1ded20d85 Oct 19 03:22:44.494158 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ServersAdminTestJSON-824225463 Oct 19 03:22:44.494158 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:22:44.494158 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:22:44.495723 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c9a495ccfced47f29cb928d1ded20d85"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c9a495ccfced47f29cb928d1ded20d85"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c9a495ccfced47f29cb928d1ded20d85"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c9a495ccfced47f29cb928d1ded20d85", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:22:44.495723 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ServersAdminTestJSON-824225463 Oct 19 03:22:44.495723 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: c9a495ccfced47f29cb928d1ded20d85 Oct 19 03:22:44.495723 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ServersAdminTestJSON-824225463 Oct 19 03:22:44.495723 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ServersAdminTestJSON-824225463-project Oct 19 03:22:44.495723 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:22:44.495723 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:22:44.495723 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: ce4c5e4123c44508a5d4911a17c44231 Oct 19 03:22:44.495723 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ServersAdminTestJSON-824225463-project Oct 19 03:22:44.495723 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:22:44.495723 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance 6888c8db-82ba-4072-b431-8d4fcf5f03e0 could not be found. Oct 19 03:22:44.495723 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '6888c8db-82ba-4072-b431-8d4fcf5f03e0'} Oct 19 03:22:44.496514 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:22:44.496514 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:22:44.496514 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:22:44.496514 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:22:44.496514 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:22:44.496514 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:22:44.496514 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:22:44.496514 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:22:44.496514 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:22:44.496514 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:22:44.496514 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6888c8db-82ba-4072-b431-8d4fcf5f03e0 could not be found. Oct 19 03:22:44.496514 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:22:44.496514 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:22:44.496514 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:22:44.496514 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:22:44.496514 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:22:44.496514 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:22:44.496514 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:22:44.496514 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:22:44.496514 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:22:44.497942 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:22:44.497942 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:22:44.497942 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:22:44.497942 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:22:44.497942 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:22:44.497942 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:22:44.497942 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:22:44.497942 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6888c8db-82ba-4072-b431-8d4fcf5f03e0 could not be found. Oct 19 03:22:44.497942 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:22:44.497942 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:22:44.497942 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:22:44.497942 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:22:44.497942 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:22:44.497942 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:22:44.497942 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:22:44.497942 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:22:44.497942 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6888c8db-82ba-4072-b431-8d4fcf5f03e0 could not be found. Oct 19 03:22:44.497942 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:22:44.499381 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6017098f-73e3-4799-9cbf-904b6a7d3848 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] Returning 404 to user: Instance 6888c8db-82ba-4072-b431-8d4fcf5f03e0 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:22:44.499381 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6017098f-73e3-4799-9cbf-904b6a7d3848 tempest-ServersAdminTestJSON-824225463 tempest-ServersAdminTestJSON-824225463-project] 10.222.0.52 "GET /compute/v2.1/servers/6888c8db-82ba-4072-b431-8d4fcf5f03e0" status: 404 len: 111 microversion: 2.1 time: 0.054200 Oct 19 03:22:44.501720 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1268/2567] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:22:44 2022] GET /compute/v2.1/servers/6888c8db-82ba-4072-b431-8d4fcf5f03e0 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:22:44.508696 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ced13b16-834f-44db-8b85-fbcd0e5c04e0 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Calling method '.version_select at 0x7fc13024f160>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:44.523386 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ced13b16-834f-44db-8b85-fbcd0e5c04e0 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:44.524264 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ced13b16-834f-44db-8b85-fbcd0e5c04e0 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:44.524875 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ced13b16-834f-44db-8b85-fbcd0e5c04e0 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:44.525613 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ced13b16-834f-44db-8b85-fbcd0e5c04e0 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] [instance: b7ee1a20-f570-44ae-8e29-595fc6b3dcb6] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:44.533885 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ced13b16-834f-44db-8b85-fbcd0e5c04e0 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:44.534429 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ced13b16-834f-44db-8b85-fbcd0e5c04e0 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:44.534870 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ced13b16-834f-44db-8b85-fbcd0e5c04e0 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:44.537259 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ced13b16-834f-44db-8b85-fbcd0e5c04e0 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:44.538165 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ced13b16-834f-44db-8b85-fbcd0e5c04e0 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:44.538605 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ced13b16-834f-44db-8b85-fbcd0e5c04e0 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:44.580253 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ced13b16-834f-44db-8b85-fbcd0e5c04e0 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:44.580741 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ced13b16-834f-44db-8b85-fbcd0e5c04e0 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:44.581182 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ced13b16-834f-44db-8b85-fbcd0e5c04e0 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:44.606318 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ced13b16-834f-44db-8b85-fbcd0e5c04e0 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:44.606756 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ced13b16-834f-44db-8b85-fbcd0e5c04e0 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:44.607190 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ced13b16-834f-44db-8b85-fbcd0e5c04e0 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:44.675296 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-95b92385-2c49-40bd-bd03-ce466b25a37d tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "DELETE /compute/v2.1/servers/82f8d22c-99ee-4c2b-8a36-5299c187ace7" status: 204 len: 0 microversion: 2.25 time: 0.516525 Oct 19 03:22:44.679966 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1300/2568] 10.222.0.52 () {60 vars in 1280 bytes} [Wed Oct 19 03:22:44 2022] DELETE /compute/v2.1/servers/82f8d22c-99ee-4c2b-8a36-5299c187ace7 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 19 03:22:44.690393 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9fc66646-3bf5-4b78-bf46-03d69949d896 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Calling method '.version_select at 0x7fc1302b65e0>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:44.720459 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-ced13b16-834f-44db-8b85-fbcd0e5c04e0 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lazy-loading 'flavor' on Instance uuid b7ee1a20-f570-44ae-8e29-595fc6b3dcb6 {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:22:44.747224 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ced13b16-834f-44db-8b85-fbcd0e5c04e0 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] 10.222.0.52 "PUT /compute/v2.1/servers/b7ee1a20-f570-44ae-8e29-595fc6b3dcb6/tags/tempest-tag-154023370" status: 201 len: 0 microversion: 2.26 time: 0.242901 Oct 19 03:22:44.747959 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1269/2569] 10.222.0.52 () {62 vars in 1377 bytes} [Wed Oct 19 03:22:44 2022] PUT /compute/v2.1/servers/b7ee1a20-f570-44ae-8e29-595fc6b3dcb6/tags/tempest-tag-154023370 => generated 0 bytes in 245 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 19 03:22:44.753781 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6eac8cdf-408d-4ad6-adc6-dd3c1bf4ed2a tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:44.754975 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6eac8cdf-408d-4ad6-adc6-dd3c1bf4ed2a tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 82f8d22c-99ee-4c2b-8a36-5299c187ace7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:44.762433 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6eac8cdf-408d-4ad6-adc6-dd3c1bf4ed2a tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:44.763087 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6eac8cdf-408d-4ad6-adc6-dd3c1bf4ed2a tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:44.763532 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6eac8cdf-408d-4ad6-adc6-dd3c1bf4ed2a tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:44.764241 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6eac8cdf-408d-4ad6-adc6-dd3c1bf4ed2a tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:44.765006 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6eac8cdf-408d-4ad6-adc6-dd3c1bf4ed2a tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:44.768963 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6eac8cdf-408d-4ad6-adc6-dd3c1bf4ed2a tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:44.775587 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9fc66646-3bf5-4b78-bf46-03d69949d896 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] 10.222.0.52 "GET /compute/v2.1/images/b198d558-6429-48b5-a113-6a3a25c104ff" status: 200 len: 1454 microversion: 2.1 time: 0.097268 Oct 19 03:22:44.776354 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1301/2570] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:22:44 2022] GET /compute/v2.1/images/b198d558-6429-48b5-a113-6a3a25c104ff => generated 1454 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:22:44.776354 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-378176e9-497d-4818-bb8d-c3feec5572da tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Action: 'update_all', calling method: .version_select at 0x7fc130270820>, body: {"tags": ["tempest-tag-441612687", "tempest-tag-1707162772"]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:22:44.790576 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=89,nova_cell1:SAVEPOINT=3,nova_cell1:INSERT=3,nova_cell1:RELEASE=3,nova_cell1:DELETE=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:22:44.805301 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-378176e9-497d-4818-bb8d-c3feec5572da tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:44.806181 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-378176e9-497d-4818-bb8d-c3feec5572da tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:44.806777 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-378176e9-497d-4818-bb8d-c3feec5572da tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:44.807575 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-378176e9-497d-4818-bb8d-c3feec5572da tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] [instance: b7ee1a20-f570-44ae-8e29-595fc6b3dcb6] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:44.816812 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-378176e9-497d-4818-bb8d-c3feec5572da tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:44.820491 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-378176e9-497d-4818-bb8d-c3feec5572da tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:44.820491 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-378176e9-497d-4818-bb8d-c3feec5572da tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:44.822473 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-378176e9-497d-4818-bb8d-c3feec5572da tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:44.822473 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-378176e9-497d-4818-bb8d-c3feec5572da tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:44.823310 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-378176e9-497d-4818-bb8d-c3feec5572da tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:44.888783 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-378176e9-497d-4818-bb8d-c3feec5572da tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:44.889295 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-378176e9-497d-4818-bb8d-c3feec5572da tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:44.890046 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-378176e9-497d-4818-bb8d-c3feec5572da tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:44.972849 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-6eac8cdf-408d-4ad6-adc6-dd3c1bf4ed2a tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:44.983113 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-6eac8cdf-408d-4ad6-adc6-dd3c1bf4ed2a tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:44.985182 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-6eac8cdf-408d-4ad6-adc6-dd3c1bf4ed2a tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:44.987530 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6eac8cdf-408d-4ad6-adc6-dd3c1bf4ed2a tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/82f8d22c-99ee-4c2b-8a36-5299c187ace7" status: 200 len: 1562 microversion: 2.25 time: 0.238441 Oct 19 03:22:44.993989 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1270/2571] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:22:44 2022] GET /compute/v2.1/servers/82f8d22c-99ee-4c2b-8a36-5299c187ace7 => generated 1562 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:22:45.006338 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f2699903-1f4a-4a21-83d4-a3778c8c2681 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:45.008656 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f2699903-1f4a-4a21-83d4-a3778c8c2681 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: c45890de-f7bf-4736-8b08-6f3e6863e2b3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:45.018828 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f2699903-1f4a-4a21-83d4-a3778c8c2681 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:45.019541 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f2699903-1f4a-4a21-83d4-a3778c8c2681 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:45.020486 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f2699903-1f4a-4a21-83d4-a3778c8c2681 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:45.021006 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-378176e9-497d-4818-bb8d-c3feec5572da tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lazy-loading 'flavor' on Instance uuid b7ee1a20-f570-44ae-8e29-595fc6b3dcb6 {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:22:45.021255 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f2699903-1f4a-4a21-83d4-a3778c8c2681 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:45.021746 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f2699903-1f4a-4a21-83d4-a3778c8c2681 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:45.022201 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f2699903-1f4a-4a21-83d4-a3778c8c2681 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:45.040654 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-378176e9-497d-4818-bb8d-c3feec5572da tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] 10.222.0.52 "PUT /compute/v2.1/servers/b7ee1a20-f570-44ae-8e29-595fc6b3dcb6/tags" status: 200 len: 61 microversion: 2.26 time: 0.263253 Oct 19 03:22:45.047444 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1302/2572] 10.222.0.52 () {62 vars in 1312 bytes} [Wed Oct 19 03:22:44 2022] PUT /compute/v2.1/servers/b7ee1a20-f570-44ae-8e29-595fc6b3dcb6/tags => generated 61 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:22:45.053591 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-84773efe-8067-4ea7-9acb-4d297cd95ca5 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Calling method '.version_select at 0x7fc130c5fd30>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:45.062497 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-84773efe-8067-4ea7-9acb-4d297cd95ca5 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:45.063235 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-84773efe-8067-4ea7-9acb-4d297cd95ca5 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:45.063830 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-84773efe-8067-4ea7-9acb-4d297cd95ca5 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:45.076010 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-84773efe-8067-4ea7-9acb-4d297cd95ca5 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] 10.222.0.52 "GET /compute/v2.1/servers/b7ee1a20-f570-44ae-8e29-595fc6b3dcb6/tags" status: 200 len: 61 microversion: 2.26 time: 0.027228 Oct 19 03:22:45.082928 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1303/2573] 10.222.0.52 () {60 vars in 1292 bytes} [Wed Oct 19 03:22:45 2022] GET /compute/v2.1/servers/b7ee1a20-f570-44ae-8e29-595fc6b3dcb6/tags => generated 61 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:22:45.089197 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6c8f979d-f29c-4efa-8384-b70ba5faee1b tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:45.089863 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6c8f979d-f29c-4efa-8384-b70ba5faee1b tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] [instance: bb7dc549-597e-4568-8ab7-768654c73278] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:45.097389 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6c8f979d-f29c-4efa-8384-b70ba5faee1b tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:45.097897 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6c8f979d-f29c-4efa-8384-b70ba5faee1b tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:45.098345 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6c8f979d-f29c-4efa-8384-b70ba5faee1b tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:45.099150 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6c8f979d-f29c-4efa-8384-b70ba5faee1b tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:45.100613 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6c8f979d-f29c-4efa-8384-b70ba5faee1b tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:45.100613 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6c8f979d-f29c-4efa-8384-b70ba5faee1b tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:45.366471 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-f2699903-1f4a-4a21-83d4-a3778c8c2681 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:45.379253 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f2699903-1f4a-4a21-83d4-a3778c8c2681 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/c45890de-f7bf-4736-8b08-6f3e6863e2b3" status: 200 len: 1497 microversion: 2.1 time: 0.382331 Oct 19 03:22:45.397860 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1271/2574] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:22:44 2022] GET /compute/v2.1/servers/c45890de-f7bf-4736-8b08-6f3e6863e2b3 => generated 1497 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:22:45.409998 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-6c8f979d-f29c-4efa-8384-b70ba5faee1b tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3661010393d44c428fb37652b1717072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a1e7cceff48798bfefb9390e5979c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:45.413163 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=92,nova_cell1:DELETE=3,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:22:45.415594 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6c8f979d-f29c-4efa-8384-b70ba5faee1b tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] 10.222.0.52 "GET /compute/v2.1/servers/bb7dc549-597e-4568-8ab7-768654c73278" status: 200 len: 1315 microversion: 2.1 time: 0.330661 Oct 19 03:22:45.416173 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1304/2575] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:22:45 2022] GET /compute/v2.1/servers/bb7dc549-597e-4568-8ab7-768654c73278 => generated 1315 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:22:45.420842 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ddaa0cc4-2c87-461d-9148-d92a32cb0e68 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Calling method '.version_select at 0x7fc1301ca940>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:45.434169 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ddaa0cc4-2c87-461d-9148-d92a32cb0e68 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:45.434657 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ddaa0cc4-2c87-461d-9148-d92a32cb0e68 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:45.438135 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ddaa0cc4-2c87-461d-9148-d92a32cb0e68 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:45.449201 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ddaa0cc4-2c87-461d-9148-d92a32cb0e68 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] [instance: b7ee1a20-f570-44ae-8e29-595fc6b3dcb6] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:45.452530 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ddaa0cc4-2c87-461d-9148-d92a32cb0e68 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:45.454886 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ddaa0cc4-2c87-461d-9148-d92a32cb0e68 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:45.457991 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ddaa0cc4-2c87-461d-9148-d92a32cb0e68 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:45.458971 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ddaa0cc4-2c87-461d-9148-d92a32cb0e68 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:45.459726 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ddaa0cc4-2c87-461d-9148-d92a32cb0e68 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:45.461436 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ddaa0cc4-2c87-461d-9148-d92a32cb0e68 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:45.508827 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ddaa0cc4-2c87-461d-9148-d92a32cb0e68 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:45.509696 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ddaa0cc4-2c87-461d-9148-d92a32cb0e68 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:45.510378 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ddaa0cc4-2c87-461d-9148-d92a32cb0e68 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:45.611607 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-ddaa0cc4-2c87-461d-9148-d92a32cb0e68 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lazy-loading 'flavor' on Instance uuid b7ee1a20-f570-44ae-8e29-595fc6b3dcb6 {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:22:45.669261 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ddaa0cc4-2c87-461d-9148-d92a32cb0e68 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] 10.222.0.52 "DELETE /compute/v2.1/servers/b7ee1a20-f570-44ae-8e29-595fc6b3dcb6/tags" status: 204 len: 0 microversion: 2.26 time: 0.268278 Oct 19 03:22:45.670447 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1272/2576] 10.222.0.52 () {60 vars in 1295 bytes} [Wed Oct 19 03:22:45 2022] DELETE /compute/v2.1/servers/b7ee1a20-f570-44ae-8e29-595fc6b3dcb6/tags => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 19 03:22:45.681657 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-479d315c-4d4f-448b-842d-80ca259f32f2 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:45.682288 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-479d315c-4d4f-448b-842d-80ca259f32f2 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] [instance: b7ee1a20-f570-44ae-8e29-595fc6b3dcb6] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:45.699463 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-479d315c-4d4f-448b-842d-80ca259f32f2 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:45.699463 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-479d315c-4d4f-448b-842d-80ca259f32f2 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:45.699463 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-479d315c-4d4f-448b-842d-80ca259f32f2 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:45.699463 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-479d315c-4d4f-448b-842d-80ca259f32f2 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:45.699837 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-479d315c-4d4f-448b-842d-80ca259f32f2 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:45.699837 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-479d315c-4d4f-448b-842d-80ca259f32f2 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:45.729513 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-479d315c-4d4f-448b-842d-80ca259f32f2 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] [instance: b7ee1a20-f570-44ae-8e29-595fc6b3dcb6] Going to try to terminate instance {{(pid=121135) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:22:45.791683 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2d111815-7db5-4234-a0d0-990b13a78440 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Calling method '.version_select at 0x7fc1302a7ee0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:45.851613 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2d111815-7db5-4234-a0d0-990b13a78440 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] 10.222.0.52 "GET /compute/v2.1/images/b198d558-6429-48b5-a113-6a3a25c104ff" status: 200 len: 1454 microversion: 2.1 time: 0.063910 Oct 19 03:22:45.856181 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1273/2577] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:22:45 2022] GET /compute/v2.1/images/b198d558-6429-48b5-a113-6a3a25c104ff => generated 1454 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:22:46.014385 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c59b9211-d420-42b4-9150-f2baadb6c837 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:46.016503 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c59b9211-d420-42b4-9150-f2baadb6c837 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 82f8d22c-99ee-4c2b-8a36-5299c187ace7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:46.027160 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c59b9211-d420-42b4-9150-f2baadb6c837 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:46.029044 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c59b9211-d420-42b4-9150-f2baadb6c837 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:46.029805 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c59b9211-d420-42b4-9150-f2baadb6c837 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:46.030720 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c59b9211-d420-42b4-9150-f2baadb6c837 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:46.031342 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c59b9211-d420-42b4-9150-f2baadb6c837 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:46.031944 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c59b9211-d420-42b4-9150-f2baadb6c837 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:46.240237 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c59b9211-d420-42b4-9150-f2baadb6c837 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:46.246765 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c59b9211-d420-42b4-9150-f2baadb6c837 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:46.248225 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c59b9211-d420-42b4-9150-f2baadb6c837 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:46.250680 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c59b9211-d420-42b4-9150-f2baadb6c837 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/82f8d22c-99ee-4c2b-8a36-5299c187ace7" status: 200 len: 1562 microversion: 2.25 time: 0.239333 Oct 19 03:22:46.263866 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1274/2578] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:22:46 2022] GET /compute/v2.1/servers/82f8d22c-99ee-4c2b-8a36-5299c187ace7 => generated 1562 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:22:46.360328 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-479d315c-4d4f-448b-842d-80ca259f32f2 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] 10.222.0.52 "DELETE /compute/v2.1/servers/b7ee1a20-f570-44ae-8e29-595fc6b3dcb6" status: 204 len: 0 microversion: 2.26 time: 0.681708 Oct 19 03:22:46.362907 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1305/2579] 10.222.0.52 () {60 vars in 1280 bytes} [Wed Oct 19 03:22:45 2022] DELETE /compute/v2.1/servers/b7ee1a20-f570-44ae-8e29-595fc6b3dcb6 => generated 0 bytes in 687 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 19 03:22:46.376586 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c3e7693e-9d4d-471f-a4e2-9430db61a031 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:46.377495 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c3e7693e-9d4d-471f-a4e2-9430db61a031 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] [instance: b7ee1a20-f570-44ae-8e29-595fc6b3dcb6] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:46.403477 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c3e7693e-9d4d-471f-a4e2-9430db61a031 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:46.409459 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6cc5d8ff-c7d3-452d-9136-a94b0964bc09 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:46.410312 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c3e7693e-9d4d-471f-a4e2-9430db61a031 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:46.410633 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6cc5d8ff-c7d3-452d-9136-a94b0964bc09 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: c45890de-f7bf-4736-8b08-6f3e6863e2b3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:46.413661 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c3e7693e-9d4d-471f-a4e2-9430db61a031 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:46.414756 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c3e7693e-9d4d-471f-a4e2-9430db61a031 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:46.426855 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c3e7693e-9d4d-471f-a4e2-9430db61a031 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:46.426855 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c3e7693e-9d4d-471f-a4e2-9430db61a031 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:46.428942 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6cc5d8ff-c7d3-452d-9136-a94b0964bc09 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:46.430242 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6cc5d8ff-c7d3-452d-9136-a94b0964bc09 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:46.430835 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6cc5d8ff-c7d3-452d-9136-a94b0964bc09 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:46.431684 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6cc5d8ff-c7d3-452d-9136-a94b0964bc09 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:46.432280 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6cc5d8ff-c7d3-452d-9136-a94b0964bc09 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:46.432954 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6cc5d8ff-c7d3-452d-9136-a94b0964bc09 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:46.731874 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-6cc5d8ff-c7d3-452d-9136-a94b0964bc09 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:46.748046 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6cc5d8ff-c7d3-452d-9136-a94b0964bc09 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/c45890de-f7bf-4736-8b08-6f3e6863e2b3" status: 200 len: 1497 microversion: 2.1 time: 0.344757 Oct 19 03:22:46.752648 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1306/2580] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:22:46 2022] GET /compute/v2.1/servers/c45890de-f7bf-4736-8b08-6f3e6863e2b3 => generated 1497 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:22:46.764430 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2ce19810-81d4-458a-9b39-9f3b8ce9a696 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:46.764430 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-2ce19810-81d4-458a-9b39-9f3b8ce9a696 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] [instance: bb7dc549-597e-4568-8ab7-768654c73278] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:46.770183 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2ce19810-81d4-458a-9b39-9f3b8ce9a696 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:46.770679 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2ce19810-81d4-458a-9b39-9f3b8ce9a696 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:46.771118 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2ce19810-81d4-458a-9b39-9f3b8ce9a696 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:46.771818 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2ce19810-81d4-458a-9b39-9f3b8ce9a696 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:46.772273 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2ce19810-81d4-458a-9b39-9f3b8ce9a696 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:46.772744 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2ce19810-81d4-458a-9b39-9f3b8ce9a696 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:46.888398 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c3e7693e-9d4d-471f-a4e2-9430db61a031 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63cf2636aee743148721b5ba622de9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bc3a9713e04bafaf5812a87765de55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:46.902246 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c3e7693e-9d4d-471f-a4e2-9430db61a031 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63cf2636aee743148721b5ba622de9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bc3a9713e04bafaf5812a87765de55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:46.904301 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c3e7693e-9d4d-471f-a4e2-9430db61a031 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63cf2636aee743148721b5ba622de9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bc3a9713e04bafaf5812a87765de55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:46.908014 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c3e7693e-9d4d-471f-a4e2-9430db61a031 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] 10.222.0.52 "GET /compute/v2.1/servers/b7ee1a20-f570-44ae-8e29-595fc6b3dcb6" status: 200 len: 1553 microversion: 2.26 time: 0.537800 Oct 19 03:22:46.908014 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1275/2581] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:22:46 2022] GET /compute/v2.1/servers/b7ee1a20-f570-44ae-8e29-595fc6b3dcb6 => generated 1553 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:22:46.928329 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-3514ced7-6992-48f7-82f2-1dadad804ff7 req-16de5fb9-f65f-433d-b966-72c8bd3f7dd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82f8d22c-99ee-4c2b-8a36-5299c187ace7", "name": "network-vif-deleted", "tag": "dfc9deee-726a-4739-85f8-2d1374704cd1"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:22:46.945913 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-3514ced7-6992-48f7-82f2-1dadad804ff7 req-16de5fb9-f65f-433d-b966-72c8bd3f7dd6 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:46.946647 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-3514ced7-6992-48f7-82f2-1dadad804ff7 req-16de5fb9-f65f-433d-b966-72c8bd3f7dd6 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:46.947321 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-3514ced7-6992-48f7-82f2-1dadad804ff7 req-16de5fb9-f65f-433d-b966-72c8bd3f7dd6 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:46.973926 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-3514ced7-6992-48f7-82f2-1dadad804ff7 req-16de5fb9-f65f-433d-b966-72c8bd3f7dd6 service nova] Creating event network-vif-deleted:dfc9deee-726a-4739-85f8-2d1374704cd1 for instance 82f8d22c-99ee-4c2b-8a36-5299c187ace7 on n-h1-861333-8 Oct 19 03:22:46.985501 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-3514ced7-6992-48f7-82f2-1dadad804ff7 req-16de5fb9-f65f-433d-b966-72c8bd3f7dd6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070674 Oct 19 03:22:46.985501 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1276/2582] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:22:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:22:46.996634 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f805ccf1-42df-4b88-86ed-eb1cdd4bff12 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Calling method '.version_select at 0x7fc13018b280>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:47.048556 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-2ce19810-81d4-458a-9b39-9f3b8ce9a696 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3661010393d44c428fb37652b1717072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a1e7cceff48798bfefb9390e5979c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:47.061301 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2ce19810-81d4-458a-9b39-9f3b8ce9a696 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] 10.222.0.52 "GET /compute/v2.1/servers/bb7dc549-597e-4568-8ab7-768654c73278" status: 200 len: 1315 microversion: 2.1 time: 0.306240 Oct 19 03:22:47.062392 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1307/2583] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:22:46 2022] GET /compute/v2.1/servers/bb7dc549-597e-4568-8ab7-768654c73278 => generated 1315 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:22:47.086442 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f805ccf1-42df-4b88-86ed-eb1cdd4bff12 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] 10.222.0.52 "GET /compute/v2.1/images/b198d558-6429-48b5-a113-6a3a25c104ff" status: 200 len: 1454 microversion: 2.1 time: 0.095603 Oct 19 03:22:47.087008 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1277/2584] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:22:46 2022] GET /compute/v2.1/images/b198d558-6429-48b5-a113-6a3a25c104ff => generated 1454 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:22:47.282931 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-875a759d-330f-4042-879a-1fc412451fcb tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:47.283470 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-875a759d-330f-4042-879a-1fc412451fcb tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 82f8d22c-99ee-4c2b-8a36-5299c187ace7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:47.292055 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-875a759d-330f-4042-879a-1fc412451fcb tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:47.293941 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-875a759d-330f-4042-879a-1fc412451fcb tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:47.293941 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-875a759d-330f-4042-879a-1fc412451fcb tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:47.293941 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-875a759d-330f-4042-879a-1fc412451fcb tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:47.294180 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-875a759d-330f-4042-879a-1fc412451fcb tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:47.294545 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-875a759d-330f-4042-879a-1fc412451fcb tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:47.364116 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-875a759d-330f-4042-879a-1fc412451fcb tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:47.373640 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-875a759d-330f-4042-879a-1fc412451fcb tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:47.375740 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-875a759d-330f-4042-879a-1fc412451fcb tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:47.376930 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-875a759d-330f-4042-879a-1fc412451fcb tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/82f8d22c-99ee-4c2b-8a36-5299c187ace7" status: 200 len: 1520 microversion: 2.25 time: 0.098119 Oct 19 03:22:47.377523 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1308/2585] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:22:47 2022] GET /compute/v2.1/servers/82f8d22c-99ee-4c2b-8a36-5299c187ace7 => generated 1520 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:22:47.775931 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b27d1df1-32ed-47f4-ba1a-069467b0ef2f tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:47.780500 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b27d1df1-32ed-47f4-ba1a-069467b0ef2f tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: c45890de-f7bf-4736-8b08-6f3e6863e2b3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:47.792256 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b27d1df1-32ed-47f4-ba1a-069467b0ef2f tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:47.799220 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b27d1df1-32ed-47f4-ba1a-069467b0ef2f tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:47.800111 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b27d1df1-32ed-47f4-ba1a-069467b0ef2f tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:47.800902 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b27d1df1-32ed-47f4-ba1a-069467b0ef2f tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:47.801897 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b27d1df1-32ed-47f4-ba1a-069467b0ef2f tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:47.801897 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b27d1df1-32ed-47f4-ba1a-069467b0ef2f tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:47.936581 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-02b581e2-2964-4c04-a125-8188566af91e tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:47.937480 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-02b581e2-2964-4c04-a125-8188566af91e tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] [instance: b7ee1a20-f570-44ae-8e29-595fc6b3dcb6] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:47.945422 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-02b581e2-2964-4c04-a125-8188566af91e tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:47.945935 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-02b581e2-2964-4c04-a125-8188566af91e tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:47.946388 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-02b581e2-2964-4c04-a125-8188566af91e tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:47.952283 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-02b581e2-2964-4c04-a125-8188566af91e tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:47.952795 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-02b581e2-2964-4c04-a125-8188566af91e tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:47.955340 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-02b581e2-2964-4c04-a125-8188566af91e tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:48.007901 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b27d1df1-32ed-47f4-ba1a-069467b0ef2f tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:48.017455 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b27d1df1-32ed-47f4-ba1a-069467b0ef2f tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/c45890de-f7bf-4736-8b08-6f3e6863e2b3" status: 200 len: 1497 microversion: 2.1 time: 0.246132 Oct 19 03:22:48.020035 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1278/2586] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:22:47 2022] GET /compute/v2.1/servers/c45890de-f7bf-4736-8b08-6f3e6863e2b3 => generated 1497 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:22:48.034034 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-47c6a090-abb5-4bda-9d7f-ab0e032011c0 req-9ed1c5d5-ca2f-40cf-881d-9efedb96ee4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb7dc549-597e-4568-8ab7-768654c73278", "name": "network-vif-plugged", "status": "completed", "tag": "0387e7d0-f8d7-44a7-96d1-e3e551f9b133"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:22:48.055759 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-47c6a090-abb5-4bda-9d7f-ab0e032011c0 req-9ed1c5d5-ca2f-40cf-881d-9efedb96ee4c service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:48.056266 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-47c6a090-abb5-4bda-9d7f-ab0e032011c0 req-9ed1c5d5-ca2f-40cf-881d-9efedb96ee4c service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:48.056723 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-47c6a090-abb5-4bda-9d7f-ab0e032011c0 req-9ed1c5d5-ca2f-40cf-881d-9efedb96ee4c service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:48.075595 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-47c6a090-abb5-4bda-9d7f-ab0e032011c0 req-9ed1c5d5-ca2f-40cf-881d-9efedb96ee4c service nova] Creating event network-vif-plugged:0387e7d0-f8d7-44a7-96d1-e3e551f9b133 for instance bb7dc549-597e-4568-8ab7-768654c73278 on n-h2-861333-8 Oct 19 03:22:48.082424 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-47c6a090-abb5-4bda-9d7f-ab0e032011c0 req-9ed1c5d5-ca2f-40cf-881d-9efedb96ee4c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052765 Oct 19 03:22:48.087443 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1279/2587] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:22:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:22:48.109241 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7ab718d4-ff42-43e6-82fe-a3a73f1962e4 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:48.113679 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7ab718d4-ff42-43e6-82fe-a3a73f1962e4 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] [instance: bb7dc549-597e-4568-8ab7-768654c73278] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:48.138195 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7ab718d4-ff42-43e6-82fe-a3a73f1962e4 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:48.141334 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7ab718d4-ff42-43e6-82fe-a3a73f1962e4 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:48.141334 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7ab718d4-ff42-43e6-82fe-a3a73f1962e4 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:48.141334 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7ab718d4-ff42-43e6-82fe-a3a73f1962e4 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:48.142373 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7ab718d4-ff42-43e6-82fe-a3a73f1962e4 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:48.143906 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7ab718d4-ff42-43e6-82fe-a3a73f1962e4 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:48.221170 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-02b581e2-2964-4c04-a125-8188566af91e tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63cf2636aee743148721b5ba622de9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bc3a9713e04bafaf5812a87765de55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:48.234906 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-02b581e2-2964-4c04-a125-8188566af91e tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63cf2636aee743148721b5ba622de9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bc3a9713e04bafaf5812a87765de55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:48.237418 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-02b581e2-2964-4c04-a125-8188566af91e tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63cf2636aee743148721b5ba622de9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bc3a9713e04bafaf5812a87765de55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:48.243693 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-02b581e2-2964-4c04-a125-8188566af91e tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] 10.222.0.52 "GET /compute/v2.1/servers/b7ee1a20-f570-44ae-8e29-595fc6b3dcb6" status: 200 len: 1553 microversion: 2.26 time: 0.311014 Oct 19 03:22:48.246600 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1309/2588] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:22:47 2022] GET /compute/v2.1/servers/b7ee1a20-f570-44ae-8e29-595fc6b3dcb6 => generated 1553 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:22:48.256706 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5b7c3f39-1b58-46d2-891b-8ef0f3923612 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Calling method '.version_select at 0x7fc1302cd9d0>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:48.340688 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5b7c3f39-1b58-46d2-891b-8ef0f3923612 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] 10.222.0.52 "GET /compute/v2.1/images/b198d558-6429-48b5-a113-6a3a25c104ff" status: 200 len: 1454 microversion: 2.1 time: 0.092533 Oct 19 03:22:48.341949 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1310/2589] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:22:48 2022] GET /compute/v2.1/images/b198d558-6429-48b5-a113-6a3a25c104ff => generated 1454 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:22:48.407414 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-75855d03-c3af-4631-898a-eaa78d82d9a9 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:48.408197 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-75855d03-c3af-4631-898a-eaa78d82d9a9 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 82f8d22c-99ee-4c2b-8a36-5299c187ace7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:48.419848 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-75855d03-c3af-4631-898a-eaa78d82d9a9 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:48.422413 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-75855d03-c3af-4631-898a-eaa78d82d9a9 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:48.426315 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-75855d03-c3af-4631-898a-eaa78d82d9a9 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:48.427548 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-75855d03-c3af-4631-898a-eaa78d82d9a9 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:48.428175 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-75855d03-c3af-4631-898a-eaa78d82d9a9 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:48.428783 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-75855d03-c3af-4631-898a-eaa78d82d9a9 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:48.499751 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-75855d03-c3af-4631-898a-eaa78d82d9a9 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:48.500479 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-75855d03-c3af-4631-898a-eaa78d82d9a9 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:48.501079 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-75855d03-c3af-4631-898a-eaa78d82d9a9 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:48.501715 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-75855d03-c3af-4631-898a-eaa78d82d9a9 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lazy-loading 'fault' on Instance uuid 82f8d22c-99ee-4c2b-8a36-5299c187ace7 {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:22:48.502862 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-7ab718d4-ff42-43e6-82fe-a3a73f1962e4 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3661010393d44c428fb37652b1717072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a1e7cceff48798bfefb9390e5979c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:48.512888 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7ab718d4-ff42-43e6-82fe-a3a73f1962e4 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] 10.222.0.52 "GET /compute/v2.1/servers/bb7dc549-597e-4568-8ab7-768654c73278" status: 200 len: 1315 microversion: 2.1 time: 0.424158 Oct 19 03:22:48.518563 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1280/2590] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:22:48 2022] GET /compute/v2.1/servers/bb7dc549-597e-4568-8ab7-768654c73278 => generated 1315 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:22:48.567692 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-75855d03-c3af-4631-898a-eaa78d82d9a9 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:48.578495 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-75855d03-c3af-4631-898a-eaa78d82d9a9 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:48.579950 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-75855d03-c3af-4631-898a-eaa78d82d9a9 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a453f077dae4dfa8a3cf28c555a9a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86eaac72e51142f795b3e482be19c4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:48.581765 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-75855d03-c3af-4631-898a-eaa78d82d9a9 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/82f8d22c-99ee-4c2b-8a36-5299c187ace7" status: 200 len: 1352 microversion: 2.25 time: 0.180026 Oct 19 03:22:48.582401 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1311/2591] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:22:48 2022] GET /compute/v2.1/servers/82f8d22c-99ee-4c2b-8a36-5299c187ace7 => generated 1352 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:22:49.059016 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-05a4553e-bb7e-4837-ac3f-9de02e91e6c8 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:49.061428 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-05a4553e-bb7e-4837-ac3f-9de02e91e6c8 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: c45890de-f7bf-4736-8b08-6f3e6863e2b3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:49.079129 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-05a4553e-bb7e-4837-ac3f-9de02e91e6c8 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:49.081842 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-05a4553e-bb7e-4837-ac3f-9de02e91e6c8 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:49.082991 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-05a4553e-bb7e-4837-ac3f-9de02e91e6c8 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:49.084519 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-05a4553e-bb7e-4837-ac3f-9de02e91e6c8 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:49.086869 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-05a4553e-bb7e-4837-ac3f-9de02e91e6c8 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:49.088109 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-05a4553e-bb7e-4837-ac3f-9de02e91e6c8 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:49.251829 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-6a57aa8e-a576-4f2d-84be-1981a320648e req-4712d678-4ea6-4cf2-9501-7ce3563e9372 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7ee1a20-f570-44ae-8e29-595fc6b3dcb6", "name": "network-vif-deleted", "tag": "ae4be69b-546f-4929-8906-f31230a604dd"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:22:49.262196 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-6a57aa8e-a576-4f2d-84be-1981a320648e req-4712d678-4ea6-4cf2-9501-7ce3563e9372 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:49.263919 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-6a57aa8e-a576-4f2d-84be-1981a320648e req-4712d678-4ea6-4cf2-9501-7ce3563e9372 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:49.264429 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-6a57aa8e-a576-4f2d-84be-1981a320648e req-4712d678-4ea6-4cf2-9501-7ce3563e9372 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:49.291324 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-6a57aa8e-a576-4f2d-84be-1981a320648e req-4712d678-4ea6-4cf2-9501-7ce3563e9372 service nova] Creating event network-vif-deleted:ae4be69b-546f-4929-8906-f31230a604dd for instance b7ee1a20-f570-44ae-8e29-595fc6b3dcb6 on n-h1-861333-8 Oct 19 03:22:49.302942 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-6a57aa8e-a576-4f2d-84be-1981a320648e req-4712d678-4ea6-4cf2-9501-7ce3563e9372 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066400 Oct 19 03:22:49.305963 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1312/2592] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:22:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:22:49.315995 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-19e118d5-081d-4c94-b75a-046b60d5a03e tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:49.320675 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-19e118d5-081d-4c94-b75a-046b60d5a03e tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] [instance: b7ee1a20-f570-44ae-8e29-595fc6b3dcb6] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:49.336673 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-19e118d5-081d-4c94-b75a-046b60d5a03e tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:49.337576 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-19e118d5-081d-4c94-b75a-046b60d5a03e tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:49.338204 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-19e118d5-081d-4c94-b75a-046b60d5a03e tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:49.339108 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-19e118d5-081d-4c94-b75a-046b60d5a03e tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:49.341654 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-19e118d5-081d-4c94-b75a-046b60d5a03e tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:49.348789 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-19e118d5-081d-4c94-b75a-046b60d5a03e tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:49.360641 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-05a4553e-bb7e-4837-ac3f-9de02e91e6c8 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:49.382037 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-05a4553e-bb7e-4837-ac3f-9de02e91e6c8 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/c45890de-f7bf-4736-8b08-6f3e6863e2b3" status: 200 len: 1497 microversion: 2.1 time: 0.328534 Oct 19 03:22:49.383008 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1281/2593] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:22:49 2022] GET /compute/v2.1/servers/c45890de-f7bf-4736-8b08-6f3e6863e2b3 => generated 1497 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:22:49.393666 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9bf216de-9a3d-4796-afa1-9a5f5912197a tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Calling method '.version_select at 0x7fc1301288b0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:49.461531 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9bf216de-9a3d-4796-afa1-9a5f5912197a tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] 10.222.0.52 "GET /compute/v2.1/images/b198d558-6429-48b5-a113-6a3a25c104ff" status: 200 len: 1454 microversion: 2.1 time: 0.077297 Oct 19 03:22:49.462115 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1282/2594] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:22:49 2022] GET /compute/v2.1/images/b198d558-6429-48b5-a113-6a3a25c104ff => generated 1454 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:22:49.479296 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-19e118d5-081d-4c94-b75a-046b60d5a03e tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63cf2636aee743148721b5ba622de9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bc3a9713e04bafaf5812a87765de55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:49.490691 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-19e118d5-081d-4c94-b75a-046b60d5a03e tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63cf2636aee743148721b5ba622de9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bc3a9713e04bafaf5812a87765de55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:49.495605 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-19e118d5-081d-4c94-b75a-046b60d5a03e tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63cf2636aee743148721b5ba622de9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bc3a9713e04bafaf5812a87765de55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:49.495605 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-19e118d5-081d-4c94-b75a-046b60d5a03e tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] 10.222.0.52 "GET /compute/v2.1/servers/b7ee1a20-f570-44ae-8e29-595fc6b3dcb6" status: 200 len: 1511 microversion: 2.26 time: 0.186229 Oct 19 03:22:49.501695 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1313/2595] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:22:49 2022] GET /compute/v2.1/servers/b7ee1a20-f570-44ae-8e29-595fc6b3dcb6 => generated 1511 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:22:49.542790 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-14c68e6d-a9a5-4333-945a-4cd744b9a449 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:49.547353 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-14c68e6d-a9a5-4333-945a-4cd744b9a449 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] [instance: bb7dc549-597e-4568-8ab7-768654c73278] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:49.552706 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-14c68e6d-a9a5-4333-945a-4cd744b9a449 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:49.553447 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-14c68e6d-a9a5-4333-945a-4cd744b9a449 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:49.554045 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-14c68e6d-a9a5-4333-945a-4cd744b9a449 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:49.555013 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-14c68e6d-a9a5-4333-945a-4cd744b9a449 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:49.555656 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-14c68e6d-a9a5-4333-945a-4cd744b9a449 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:49.556255 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-14c68e6d-a9a5-4333-945a-4cd744b9a449 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:49.617489 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0993dd8f-18e3-4b2e-aeec-45fe424642b2 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:49.618491 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0993dd8f-18e3-4b2e-aeec-45fe424642b2 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] [instance: 82f8d22c-99ee-4c2b-8a36-5299c187ace7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:49.633284 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0993dd8f-18e3-4b2e-aeec-45fe424642b2 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:49.635996 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0993dd8f-18e3-4b2e-aeec-45fe424642b2 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:49.638442 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0993dd8f-18e3-4b2e-aeec-45fe424642b2 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:49.640366 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0993dd8f-18e3-4b2e-aeec-45fe424642b2 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:49.642175 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0993dd8f-18e3-4b2e-aeec-45fe424642b2 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:49.645191 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0993dd8f-18e3-4b2e-aeec-45fe424642b2 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:49.682332 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-0993dd8f-18e3-4b2e-aeec-45fe424642b2 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] HTTP exception thrown: Instance 82f8d22c-99ee-4c2b-8a36-5299c187ace7 could not be found. Oct 19 03:22:49.684262 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0993dd8f-18e3-4b2e-aeec-45fe424642b2 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Request method failure captured: Oct 19 03:22:49.684262 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/82f8d22c-99ee-4c2b-8a36-5299c187ace7 HTTP/1.1 Oct 19 03:22:49.684262 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:22:49.684262 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:22:49.684262 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:22:49.684262 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:22:49.684262 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:22:49.684262 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:22:49.684262 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:22:49.684262 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:22:49.684262 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2tcwFSozsDsogt_HZcdUgmGnTvZs8mzfeFkvs053pzVRjXX83ROjKcXxAHBTWN9olIwcvfh5hq7TjIjuqVNVroG0_bo0U9SvMsHfqMQQCgAJwV8poqheN5uAYUPiFrTwSdQzcOt_Ql8r-P63WnnR-1IArren7PYbX_jjeQwEmghEeI Oct 19 03:22:49.684262 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:22:49.684262 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:22:49.684262 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:22:49.684262 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:22:49.684262 n-d-861333-8 devstack@n-api.service[121135]: X-Openstack-Nova-Api-Version: 2.25 Oct 19 03:22:49.684262 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:22:49.684262 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:22:49.684262 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 86eaac72e51142f795b3e482be19c4f2 Oct 19 03:22:49.684262 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1644681798 Oct 19 03:22:49.684262 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:22:49.684262 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:22:49.685715 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/86eaac72e51142f795b3e482be19c4f2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/86eaac72e51142f795b3e482be19c4f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/86eaac72e51142f795b3e482be19c4f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_86eaac72e51142f795b3e482be19c4f2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:22:49.685715 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1644681798 Oct 19 03:22:49.685715 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 86eaac72e51142f795b3e482be19c4f2 Oct 19 03:22:49.685715 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1644681798 Oct 19 03:22:49.685715 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-LiveAutoBlockMigrationV225Test-1644681798-project Oct 19 03:22:49.685715 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:22:49.685715 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:22:49.685715 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 7a453f077dae4dfa8a3cf28c555a9a7c Oct 19 03:22:49.685715 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1644681798-project Oct 19 03:22:49.685715 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:22:49.685715 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance 82f8d22c-99ee-4c2b-8a36-5299c187ace7 could not be found. Oct 19 03:22:49.685715 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '82f8d22c-99ee-4c2b-8a36-5299c187ace7'} Oct 19 03:22:49.686371 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:22:49.686371 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:22:49.686371 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:22:49.686371 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:22:49.686371 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:22:49.686371 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:22:49.686371 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:22:49.686371 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:22:49.686371 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:22:49.686371 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:22:49.686371 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82f8d22c-99ee-4c2b-8a36-5299c187ace7 could not be found. Oct 19 03:22:49.686371 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:22:49.686371 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:22:49.686371 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:22:49.686371 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:22:49.686371 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:22:49.686371 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:22:49.686371 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:22:49.686371 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:22:49.686371 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:22:49.687476 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:22:49.687476 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:22:49.687476 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:22:49.687476 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:22:49.687476 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:22:49.687476 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:22:49.687476 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:22:49.687476 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82f8d22c-99ee-4c2b-8a36-5299c187ace7 could not be found. Oct 19 03:22:49.687476 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:22:49.687476 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:22:49.687476 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:22:49.687476 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:22:49.687476 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:22:49.687476 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:22:49.687476 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:22:49.687476 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:22:49.687476 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82f8d22c-99ee-4c2b-8a36-5299c187ace7 could not be found. Oct 19 03:22:49.687476 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:22:49.690393 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0993dd8f-18e3-4b2e-aeec-45fe424642b2 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] Returning 404 to user: Instance 82f8d22c-99ee-4c2b-8a36-5299c187ace7 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:22:49.692468 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0993dd8f-18e3-4b2e-aeec-45fe424642b2 tempest-LiveAutoBlockMigrationV225Test-1644681798 tempest-LiveAutoBlockMigrationV225Test-1644681798-project] 10.222.0.52 "GET /compute/v2.1/servers/82f8d22c-99ee-4c2b-8a36-5299c187ace7" status: 404 len: 111 microversion: 2.25 time: 0.079187 Oct 19 03:22:49.693782 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1314/2596] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:22:49 2022] GET /compute/v2.1/servers/82f8d22c-99ee-4c2b-8a36-5299c187ace7 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 19 03:22:49.725004 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-14c68e6d-a9a5-4333-945a-4cd744b9a449 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3661010393d44c428fb37652b1717072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a1e7cceff48798bfefb9390e5979c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:49.737938 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-14c68e6d-a9a5-4333-945a-4cd744b9a449 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] 10.222.0.52 "GET /compute/v2.1/servers/bb7dc549-597e-4568-8ab7-768654c73278" status: 200 len: 1315 microversion: 2.1 time: 0.197725 Oct 19 03:22:49.738674 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1283/2597] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:22:49 2022] GET /compute/v2.1/servers/bb7dc549-597e-4568-8ab7-768654c73278 => generated 1315 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:22:50.412762 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-65423ec2-a126-4dfd-bc8e-48340e8ccae0 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:50.413408 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-65423ec2-a126-4dfd-bc8e-48340e8ccae0 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: c45890de-f7bf-4736-8b08-6f3e6863e2b3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:50.426598 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-65423ec2-a126-4dfd-bc8e-48340e8ccae0 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:50.427343 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-65423ec2-a126-4dfd-bc8e-48340e8ccae0 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:50.427933 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-65423ec2-a126-4dfd-bc8e-48340e8ccae0 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:50.433059 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-65423ec2-a126-4dfd-bc8e-48340e8ccae0 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:50.433736 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-65423ec2-a126-4dfd-bc8e-48340e8ccae0 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:50.434395 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-65423ec2-a126-4dfd-bc8e-48340e8ccae0 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:50.480025 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-01c5d950-8c99-46d6-b502-576634e1a2f2 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Calling method '.version_select at 0x7fc13024baf0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:50.584663 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-01c5d950-8c99-46d6-b502-576634e1a2f2 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] 10.222.0.52 "GET /compute/v2.1/images/b198d558-6429-48b5-a113-6a3a25c104ff" status: 200 len: 1454 microversion: 2.1 time: 0.109853 Oct 19 03:22:50.589714 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1284/2598] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:22:50 2022] GET /compute/v2.1/images/b198d558-6429-48b5-a113-6a3a25c104ff => generated 1454 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:22:50.595508 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-35e6866b-471f-4d60-b18e-48553fe582d1 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:50.600885 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-35e6866b-471f-4d60-b18e-48553fe582d1 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] [instance: b7ee1a20-f570-44ae-8e29-595fc6b3dcb6] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:50.615178 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-35e6866b-471f-4d60-b18e-48553fe582d1 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:50.615993 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-35e6866b-471f-4d60-b18e-48553fe582d1 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:50.618119 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-35e6866b-471f-4d60-b18e-48553fe582d1 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:50.619620 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-35e6866b-471f-4d60-b18e-48553fe582d1 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:50.621935 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-35e6866b-471f-4d60-b18e-48553fe582d1 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:50.626635 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-35e6866b-471f-4d60-b18e-48553fe582d1 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:50.711329 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-65423ec2-a126-4dfd-bc8e-48340e8ccae0 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:50.724936 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-35e6866b-471f-4d60-b18e-48553fe582d1 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:50.725139 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-65423ec2-a126-4dfd-bc8e-48340e8ccae0 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/c45890de-f7bf-4736-8b08-6f3e6863e2b3" status: 200 len: 1497 microversion: 2.1 time: 0.318684 Oct 19 03:22:50.725479 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-35e6866b-471f-4d60-b18e-48553fe582d1 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:50.725583 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1315/2599] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:22:50 2022] GET /compute/v2.1/servers/c45890de-f7bf-4736-8b08-6f3e6863e2b3 => generated 1497 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:22:50.726811 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-35e6866b-471f-4d60-b18e-48553fe582d1 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:50.727273 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-35e6866b-471f-4d60-b18e-48553fe582d1 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lazy-loading 'fault' on Instance uuid b7ee1a20-f570-44ae-8e29-595fc6b3dcb6 {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:22:50.767891 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2d00c8c6-6866-4be0-8672-7d8d9e2c599b tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:50.769935 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-2d00c8c6-6866-4be0-8672-7d8d9e2c599b tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] [instance: bb7dc549-597e-4568-8ab7-768654c73278] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:50.784808 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2d00c8c6-6866-4be0-8672-7d8d9e2c599b tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:50.789033 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2d00c8c6-6866-4be0-8672-7d8d9e2c599b tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:50.791906 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2d00c8c6-6866-4be0-8672-7d8d9e2c599b tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:50.793920 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2d00c8c6-6866-4be0-8672-7d8d9e2c599b tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:50.795267 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-35e6866b-471f-4d60-b18e-48553fe582d1 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63cf2636aee743148721b5ba622de9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bc3a9713e04bafaf5812a87765de55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:50.807336 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2d00c8c6-6866-4be0-8672-7d8d9e2c599b tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:50.807336 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2d00c8c6-6866-4be0-8672-7d8d9e2c599b tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:50.807623 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-35e6866b-471f-4d60-b18e-48553fe582d1 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63cf2636aee743148721b5ba622de9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bc3a9713e04bafaf5812a87765de55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:50.807623 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-35e6866b-471f-4d60-b18e-48553fe582d1 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63cf2636aee743148721b5ba622de9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bc3a9713e04bafaf5812a87765de55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:50.807623 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-35e6866b-471f-4d60-b18e-48553fe582d1 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] 10.222.0.52 "GET /compute/v2.1/servers/b7ee1a20-f570-44ae-8e29-595fc6b3dcb6" status: 200 len: 1352 microversion: 2.26 time: 0.215913 Oct 19 03:22:50.817900 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1285/2600] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:22:50 2022] GET /compute/v2.1/servers/b7ee1a20-f570-44ae-8e29-595fc6b3dcb6 => generated 1352 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:22:51.043501 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-2d00c8c6-6866-4be0-8672-7d8d9e2c599b tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3661010393d44c428fb37652b1717072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a1e7cceff48798bfefb9390e5979c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:51.065208 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2d00c8c6-6866-4be0-8672-7d8d9e2c599b tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] 10.222.0.52 "GET /compute/v2.1/servers/bb7dc549-597e-4568-8ab7-768654c73278" status: 200 len: 1504 microversion: 2.1 time: 0.306543 Oct 19 03:22:51.066881 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1316/2601] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:22:50 2022] GET /compute/v2.1/servers/bb7dc549-597e-4568-8ab7-768654c73278 => generated 1504 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:22:51.096411 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c370fada-7f6b-4073-bfaa-306e5b413009 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-620013496"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:22:51.097364 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c370fada-7f6b-4073-bfaa-306e5b413009 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] [instance: bb7dc549-597e-4568-8ab7-768654c73278] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:51.116077 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c370fada-7f6b-4073-bfaa-306e5b413009 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:51.116836 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c370fada-7f6b-4073-bfaa-306e5b413009 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:51.117460 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c370fada-7f6b-4073-bfaa-306e5b413009 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:51.118337 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c370fada-7f6b-4073-bfaa-306e5b413009 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:51.119314 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c370fada-7f6b-4073-bfaa-306e5b413009 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:51.123709 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c370fada-7f6b-4073-bfaa-306e5b413009 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:51.281362 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9fe29487-2791-4f47-b19c-4afa58555264 tempest-ServicesAdminTestJSON-1783635334 tempest-ServicesAdminTestJSON-1783635334-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:51.290354 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9fe29487-2791-4f47-b19c-4afa58555264 tempest-ServicesAdminTestJSON-1783635334 tempest-ServicesAdminTestJSON-1783635334-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:51.290865 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9fe29487-2791-4f47-b19c-4afa58555264 tempest-ServicesAdminTestJSON-1783635334 tempest-ServicesAdminTestJSON-1783635334-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:51.296441 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9fe29487-2791-4f47-b19c-4afa58555264 tempest-ServicesAdminTestJSON-1783635334 tempest-ServicesAdminTestJSON-1783635334-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:51.300715 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9fe29487-2791-4f47-b19c-4afa58555264 tempest-ServicesAdminTestJSON-1783635334 tempest-ServicesAdminTestJSON-1783635334-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:51.301426 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9fe29487-2791-4f47-b19c-4afa58555264 tempest-ServicesAdminTestJSON-1783635334 tempest-ServicesAdminTestJSON-1783635334-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:51.301972 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9fe29487-2791-4f47-b19c-4afa58555264 tempest-ServicesAdminTestJSON-1783635334 tempest-ServicesAdminTestJSON-1783635334-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:51.360629 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9fe29487-2791-4f47-b19c-4afa58555264 tempest-ServicesAdminTestJSON-1783635334 tempest-ServicesAdminTestJSON-1783635334-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.312569 Oct 19 03:22:51.370106 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1286/2602] 10.222.0.52 () {58 vars in 1137 bytes} [Wed Oct 19 03:22:51 2022] GET /compute/v2.1/os-services => generated 944 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:22:51.376247 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ffa07f89-a48e-4741-9b1a-8ae69a78a694 tempest-ServicesAdminTestJSON-1783635334 tempest-ServicesAdminTestJSON-1783635334-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:51.385681 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ffa07f89-a48e-4741-9b1a-8ae69a78a694 tempest-ServicesAdminTestJSON-1783635334 tempest-ServicesAdminTestJSON-1783635334-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:51.391356 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ffa07f89-a48e-4741-9b1a-8ae69a78a694 tempest-ServicesAdminTestJSON-1783635334 tempest-ServicesAdminTestJSON-1783635334-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:51.391988 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ffa07f89-a48e-4741-9b1a-8ae69a78a694 tempest-ServicesAdminTestJSON-1783635334 tempest-ServicesAdminTestJSON-1783635334-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:51.401138 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ffa07f89-a48e-4741-9b1a-8ae69a78a694 tempest-ServicesAdminTestJSON-1783635334 tempest-ServicesAdminTestJSON-1783635334-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:51.402142 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ffa07f89-a48e-4741-9b1a-8ae69a78a694 tempest-ServicesAdminTestJSON-1783635334 tempest-ServicesAdminTestJSON-1783635334-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:51.404014 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ffa07f89-a48e-4741-9b1a-8ae69a78a694 tempest-ServicesAdminTestJSON-1783635334 tempest-ServicesAdminTestJSON-1783635334-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:51.423071 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.network.security_group_api [None req-c370fada-7f6b-4073-bfaa-306e5b413009 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Adding security group e4da6f5b-5c5b-4fbd-8abc-32a3d8564e88 to port 0387e7d0-f8d7-44a7-96d1-e3e551f9b133 Oct 19 03:22:51.455146 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:22:51.460509 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ffa07f89-a48e-4741-9b1a-8ae69a78a694 tempest-ServicesAdminTestJSON-1783635334 tempest-ServicesAdminTestJSON-1783635334-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services?host=n-d-861333-8" status: 200 len: 578 microversion: 2.1 time: 0.089032 Oct 19 03:22:51.461711 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1287/2603] 10.222.0.52 () {58 vars in 1172 bytes} [Wed Oct 19 03:22:51 2022] GET /compute/v2.1/os-services?host=n-d-861333-8 => generated 578 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:22:51.480513 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-95067c6c-5a4e-424f-a839-9234f34587bb tempest-ServicesAdminTestJSON-1783635334 tempest-ServicesAdminTestJSON-1783635334-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:51.485239 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-95067c6c-5a4e-424f-a839-9234f34587bb tempest-ServicesAdminTestJSON-1783635334 tempest-ServicesAdminTestJSON-1783635334-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:51.486021 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-95067c6c-5a4e-424f-a839-9234f34587bb tempest-ServicesAdminTestJSON-1783635334 tempest-ServicesAdminTestJSON-1783635334-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:51.486469 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-95067c6c-5a4e-424f-a839-9234f34587bb tempest-ServicesAdminTestJSON-1783635334 tempest-ServicesAdminTestJSON-1783635334-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:51.487256 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-95067c6c-5a4e-424f-a839-9234f34587bb tempest-ServicesAdminTestJSON-1783635334 tempest-ServicesAdminTestJSON-1783635334-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:51.487715 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-95067c6c-5a4e-424f-a839-9234f34587bb tempest-ServicesAdminTestJSON-1783635334 tempest-ServicesAdminTestJSON-1783635334-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:51.488145 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-95067c6c-5a4e-424f-a839-9234f34587bb tempest-ServicesAdminTestJSON-1783635334 tempest-ServicesAdminTestJSON-1783635334-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:51.516382 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-95067c6c-5a4e-424f-a839-9234f34587bb tempest-ServicesAdminTestJSON-1783635334 tempest-ServicesAdminTestJSON-1783635334-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.039518 Oct 19 03:22:51.517807 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1288/2604] 10.222.0.52 () {58 vars in 1176 bytes} [Wed Oct 19 03:22:51 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:22:51.536518 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-480c9bc0-d9c9-455c-9728-8c8078bd8973 tempest-ServicesAdminTestJSON-1783635334 tempest-ServicesAdminTestJSON-1783635334-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:51.546181 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-480c9bc0-d9c9-455c-9728-8c8078bd8973 tempest-ServicesAdminTestJSON-1783635334 tempest-ServicesAdminTestJSON-1783635334-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:51.546733 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-480c9bc0-d9c9-455c-9728-8c8078bd8973 tempest-ServicesAdminTestJSON-1783635334 tempest-ServicesAdminTestJSON-1783635334-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:51.547128 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-480c9bc0-d9c9-455c-9728-8c8078bd8973 tempest-ServicesAdminTestJSON-1783635334 tempest-ServicesAdminTestJSON-1783635334-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:51.547887 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-480c9bc0-d9c9-455c-9728-8c8078bd8973 tempest-ServicesAdminTestJSON-1783635334 tempest-ServicesAdminTestJSON-1783635334-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:51.548316 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-480c9bc0-d9c9-455c-9728-8c8078bd8973 tempest-ServicesAdminTestJSON-1783635334 tempest-ServicesAdminTestJSON-1783635334-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:51.559244 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-480c9bc0-d9c9-455c-9728-8c8078bd8973 tempest-ServicesAdminTestJSON-1783635334 tempest-ServicesAdminTestJSON-1783635334-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:51.613017 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-480c9bc0-d9c9-455c-9728-8c8078bd8973 tempest-ServicesAdminTestJSON-1783635334 tempest-ServicesAdminTestJSON-1783635334-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.082885 Oct 19 03:22:51.613686 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1289/2605] 10.222.0.52 () {58 vars in 1137 bytes} [Wed Oct 19 03:22:51 2022] GET /compute/v2.1/os-services => generated 944 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:22:51.618446 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b2d49c70-cd29-4507-8aab-0bd05d4a9105 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Calling method '.version_select at 0x7fc1301ca790>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:51.713187 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b2d49c70-cd29-4507-8aab-0bd05d4a9105 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] 10.222.0.52 "GET /compute/v2.1/images/b198d558-6429-48b5-a113-6a3a25c104ff" status: 200 len: 1454 microversion: 2.1 time: 0.098127 Oct 19 03:22:51.717646 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1290/2606] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:22:51 2022] GET /compute/v2.1/images/b198d558-6429-48b5-a113-6a3a25c104ff => generated 1454 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:22:51.759071 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ed566079-c770-4412-8e77-4c70f094d65d tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:51.759708 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ed566079-c770-4412-8e77-4c70f094d65d tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: c45890de-f7bf-4736-8b08-6f3e6863e2b3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:51.778090 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ed566079-c770-4412-8e77-4c70f094d65d tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:51.779398 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ed566079-c770-4412-8e77-4c70f094d65d tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:51.779930 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ed566079-c770-4412-8e77-4c70f094d65d tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:51.780703 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ed566079-c770-4412-8e77-4c70f094d65d tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:51.781165 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ed566079-c770-4412-8e77-4c70f094d65d tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:51.783161 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ed566079-c770-4412-8e77-4c70f094d65d tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:52.091447 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ed566079-c770-4412-8e77-4c70f094d65d tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:52.100565 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ed566079-c770-4412-8e77-4c70f094d65d tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/c45890de-f7bf-4736-8b08-6f3e6863e2b3" status: 200 len: 1497 microversion: 2.1 time: 0.353210 Oct 19 03:22:52.113820 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1291/2607] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:22:51 2022] GET /compute/v2.1/servers/c45890de-f7bf-4736-8b08-6f3e6863e2b3 => generated 1497 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:22:52.122649 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c4d387c2-1e84-4994-bf1d-14aa5c66d458 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:52.123342 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c4d387c2-1e84-4994-bf1d-14aa5c66d458 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] [instance: b7ee1a20-f570-44ae-8e29-595fc6b3dcb6] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:52.130528 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c4d387c2-1e84-4994-bf1d-14aa5c66d458 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:52.131028 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c4d387c2-1e84-4994-bf1d-14aa5c66d458 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:52.131523 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c4d387c2-1e84-4994-bf1d-14aa5c66d458 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:52.132261 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c4d387c2-1e84-4994-bf1d-14aa5c66d458 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:52.132712 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c4d387c2-1e84-4994-bf1d-14aa5c66d458 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:52.133142 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c4d387c2-1e84-4994-bf1d-14aa5c66d458 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:52.154750 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-c4d387c2-1e84-4994-bf1d-14aa5c66d458 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] HTTP exception thrown: Instance b7ee1a20-f570-44ae-8e29-595fc6b3dcb6 could not be found. Oct 19 03:22:52.157019 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c4d387c2-1e84-4994-bf1d-14aa5c66d458 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Request method failure captured: Oct 19 03:22:52.157019 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/b7ee1a20-f570-44ae-8e29-595fc6b3dcb6 HTTP/1.1 Oct 19 03:22:52.157019 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:22:52.157019 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:22:52.157019 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:22:52.157019 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:22:52.157019 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:22:52.157019 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:22:52.157019 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:22:52.157019 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:22:52.157019 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT21amjsh1-X5vf0NKTASmXkOhHm_ITHwwIn95xf9ocap5nHt1wkADZu3P1DY9_cYQ5ZSPcry9UJ2fIBY_SKq5fQB3j-hc8puSMYiVzr3_-bN3ekRYZAh2lcxHIfrM3nlkwn2X5dg0rQyCxpqb4yQ5jaskzIhsFPsEoaElG6rG_C2HEw Oct 19 03:22:52.157019 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:22:52.157019 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:22:52.157019 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:22:52.157019 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:22:52.157019 n-d-861333-8 devstack@n-api.service[121134]: X-Openstack-Nova-Api-Version: 2.26 Oct 19 03:22:52.157019 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:22:52.157019 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:22:52.157019 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 16bc3a9713e04bafaf5812a87765de55 Oct 19 03:22:52.157019 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ServerTagsTestJSON-779154574 Oct 19 03:22:52.157019 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:22:52.157019 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:22:52.158892 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/16bc3a9713e04bafaf5812a87765de55"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/16bc3a9713e04bafaf5812a87765de55"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/16bc3a9713e04bafaf5812a87765de55"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_16bc3a9713e04bafaf5812a87765de55", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:22:52.158892 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ServerTagsTestJSON-779154574 Oct 19 03:22:52.158892 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 16bc3a9713e04bafaf5812a87765de55 Oct 19 03:22:52.158892 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ServerTagsTestJSON-779154574 Oct 19 03:22:52.158892 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ServerTagsTestJSON-779154574-project Oct 19 03:22:52.158892 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:22:52.158892 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:22:52.158892 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 63cf2636aee743148721b5ba622de9f5 Oct 19 03:22:52.158892 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ServerTagsTestJSON-779154574-project Oct 19 03:22:52.158892 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:22:52.158892 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance b7ee1a20-f570-44ae-8e29-595fc6b3dcb6 could not be found. Oct 19 03:22:52.158892 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': 'b7ee1a20-f570-44ae-8e29-595fc6b3dcb6'} Oct 19 03:22:52.159893 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:22:52.159893 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:22:52.159893 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:22:52.159893 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:22:52.159893 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:22:52.159893 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:22:52.159893 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:22:52.159893 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:22:52.159893 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:22:52.159893 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:22:52.159893 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7ee1a20-f570-44ae-8e29-595fc6b3dcb6 could not be found. Oct 19 03:22:52.159893 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:22:52.159893 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:22:52.159893 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:22:52.159893 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:22:52.159893 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:22:52.159893 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:22:52.159893 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:22:52.159893 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:22:52.159893 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:22:52.161301 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:22:52.161301 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:22:52.161301 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:22:52.161301 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:22:52.161301 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:22:52.161301 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:22:52.161301 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:22:52.161301 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7ee1a20-f570-44ae-8e29-595fc6b3dcb6 could not be found. Oct 19 03:22:52.161301 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:22:52.161301 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:22:52.161301 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:22:52.161301 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:22:52.161301 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:22:52.161301 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:22:52.161301 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:22:52.161301 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:22:52.161301 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7ee1a20-f570-44ae-8e29-595fc6b3dcb6 could not be found. Oct 19 03:22:52.161301 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:22:52.163022 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c4d387c2-1e84-4994-bf1d-14aa5c66d458 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] Returning 404 to user: Instance b7ee1a20-f570-44ae-8e29-595fc6b3dcb6 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:22:52.163022 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c4d387c2-1e84-4994-bf1d-14aa5c66d458 tempest-ServerTagsTestJSON-779154574 tempest-ServerTagsTestJSON-779154574-project] 10.222.0.52 "GET /compute/v2.1/servers/b7ee1a20-f570-44ae-8e29-595fc6b3dcb6" status: 404 len: 111 microversion: 2.26 time: 0.043802 Oct 19 03:22:52.163022 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1292/2608] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:22:52 2022] GET /compute/v2.1/servers/b7ee1a20-f570-44ae-8e29-595fc6b3dcb6 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 19 03:22:52.262813 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c370fada-7f6b-4073-bfaa-306e5b413009 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] 10.222.0.52 "POST /compute/v2.1/servers/bb7dc549-597e-4568-8ab7-768654c73278/action" status: 202 len: 0 microversion: 2.1 time: 1.172367 Oct 19 03:22:52.270032 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1317/2609] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:22:51 2022] POST /compute/v2.1/servers/bb7dc549-597e-4568-8ab7-768654c73278/action => generated 0 bytes in 1180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:22:52.275141 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-fc7689e3-3f0a-40ab-bdd2-f4d379ca810a tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Calling method '.version_select at 0x7fc1301ca820>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:52.736631 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a019d3f0-0e4d-4949-b385-f6055ea67633 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Calling method '.version_select at 0x7fc130245280>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:52.852478 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a019d3f0-0e4d-4949-b385-f6055ea67633 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] 10.222.0.52 "GET /compute/v2.1/images/b198d558-6429-48b5-a113-6a3a25c104ff" status: 200 len: 1454 microversion: 2.1 time: 0.121525 Oct 19 03:22:52.866990 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1318/2610] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:22:52 2022] GET /compute/v2.1/images/b198d558-6429-48b5-a113-6a3a25c104ff => generated 1454 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:22:52.907267 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-a9fb4baf-2f66-4971-a479-0d7ed5e820ea req-c1880e8f-be1a-4ee3-9c61-5863f421de00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb7dc549-597e-4568-8ab7-768654c73278", "tag": "0387e7d0-f8d7-44a7-96d1-e3e551f9b133"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:22:52.941057 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-a9fb4baf-2f66-4971-a479-0d7ed5e820ea req-c1880e8f-be1a-4ee3-9c61-5863f421de00 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:52.941663 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-a9fb4baf-2f66-4971-a479-0d7ed5e820ea req-c1880e8f-be1a-4ee3-9c61-5863f421de00 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:52.942134 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-a9fb4baf-2f66-4971-a479-0d7ed5e820ea req-c1880e8f-be1a-4ee3-9c61-5863f421de00 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:52.984984 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-a9fb4baf-2f66-4971-a479-0d7ed5e820ea req-c1880e8f-be1a-4ee3-9c61-5863f421de00 service nova] Creating event network-changed:0387e7d0-f8d7-44a7-96d1-e3e551f9b133 for instance bb7dc549-597e-4568-8ab7-768654c73278 on n-h2-861333-8 Oct 19 03:22:52.994031 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-a9fb4baf-2f66-4971-a479-0d7ed5e820ea req-c1880e8f-be1a-4ee3-9c61-5863f421de00 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111240 Oct 19 03:22:52.995502 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1319/2611] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:22:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:22:53.126264 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-397f9451-7d76-4f0b-8f25-31290ac876e4 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:53.133103 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-397f9451-7d76-4f0b-8f25-31290ac876e4 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: c45890de-f7bf-4736-8b08-6f3e6863e2b3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:53.153296 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-397f9451-7d76-4f0b-8f25-31290ac876e4 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:53.154197 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-397f9451-7d76-4f0b-8f25-31290ac876e4 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:53.154881 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-397f9451-7d76-4f0b-8f25-31290ac876e4 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:53.156449 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-397f9451-7d76-4f0b-8f25-31290ac876e4 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:53.157225 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-397f9451-7d76-4f0b-8f25-31290ac876e4 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:53.158101 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-397f9451-7d76-4f0b-8f25-31290ac876e4 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:53.774413 n-d-861333-8 devstack@n-api.service[121134]: DEBUG neutronclient.v2_0.client [None req-fc7689e3-3f0a-40ab-bdd2-f4d379ca810a tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group e4da6f5b-5c5b-4fbd-8abc-32a3d8564e88 in use.", "detail": ""}} {{(pid=121134) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 19 03:22:53.775486 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-fc7689e3-3f0a-40ab-bdd2-f4d379ca810a tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] HTTP exception thrown: Security Group e4da6f5b-5c5b-4fbd-8abc-32a3d8564e88 in use. Oct 19 03:22:53.775486 n-d-861333-8 devstack@n-api.service[121134]: Neutron server returns request_ids: ['req-76832194-b17e-4a19-ac83-87cdf14e0b4a'] Oct 19 03:22:53.777349 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-fc7689e3-3f0a-40ab-bdd2-f4d379ca810a tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Request method failure captured: Oct 19 03:22:53.777349 n-d-861333-8 devstack@n-api.service[121134]: request: DELETE /compute/v2.1/os-security-groups/e4da6f5b-5c5b-4fbd-8abc-32a3d8564e88 HTTP/1.1 Oct 19 03:22:53.777349 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:22:53.777349 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:22:53.777349 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:22:53.777349 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:22:53.777349 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:22:53.777349 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:22:53.777349 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:22:53.777349 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:22:53.777349 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT200KvQGsyi_a_sB4TfhhJOzMfG19jSa6oSlia6bg0oJGWsETmIFLMxsrnEQMCxFlXYpeXPwW52kFxfganN5M4cxj3tahAijx2xJ--2WsWYJtuNU3tc5IIgL3W8HC4CGP3frn8iROEzLPCi1mQC1-zUvq06vNZR4ARbYNlrlnvumYqI Oct 19 03:22:53.777349 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:22:53.777349 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:22:53.777349 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:22:53.777349 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:22:53.777349 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:22:53.777349 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:22:53.777349 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 385a1e7cceff48798bfefb9390e5979c Oct 19 03:22:53.777349 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-SecurityGroupsTestJSON-637911912 Oct 19 03:22:53.777349 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:22:53.777349 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:22:53.778596 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/385a1e7cceff48798bfefb9390e5979c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/385a1e7cceff48798bfefb9390e5979c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/385a1e7cceff48798bfefb9390e5979c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_385a1e7cceff48798bfefb9390e5979c", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:22:53.778596 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-SecurityGroupsTestJSON-637911912 Oct 19 03:22:53.778596 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 385a1e7cceff48798bfefb9390e5979c Oct 19 03:22:53.778596 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-637911912 Oct 19 03:22:53.778596 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-SecurityGroupsTestJSON-637911912-project Oct 19 03:22:53.778596 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:22:53.778596 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:22:53.778596 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 3661010393d44c428fb37652b1717072 Oct 19 03:22:53.778596 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-SecurityGroupsTestJSON-637911912-project Oct 19 03:22:53.778596 n-d-861333-8 devstack@n-api.service[121134]: method: Oct 19 03:22:53.778596 n-d-861333-8 devstack@n-api.service[121134]: exception: Security Group e4da6f5b-5c5b-4fbd-8abc-32a3d8564e88 in use. Oct 19 03:22:53.778596 n-d-861333-8 devstack@n-api.service[121134]: Neutron server returns request_ids: ['req-76832194-b17e-4a19-ac83-87cdf14e0b4a'] Oct 19 03:22:53.778596 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': 'e4da6f5b-5c5b-4fbd-8abc-32a3d8564e88'} Oct 19 03:22:53.779447 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:22:53.779447 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:22:53.779447 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 19 03:22:53.779447 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 19 03:22:53.779447 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:22:53.779447 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:22:53.779447 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 19 03:22:53.779447 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 19 03:22:53.779447 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:22:53.779447 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:22:53.779447 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 19 03:22:53.779447 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 19 03:22:53.779447 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:22:53.779447 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:22:53.779447 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 19 03:22:53.779447 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 19 03:22:53.779447 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:22:53.779447 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:22:53.779447 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 19 03:22:53.780523 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 19 03:22:53.780523 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:22:53.780523 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:22:53.780523 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 19 03:22:53.780523 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 19 03:22:53.780523 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 19 03:22:53.780523 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 19 03:22:53.780523 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group e4da6f5b-5c5b-4fbd-8abc-32a3d8564e88 in use. Oct 19 03:22:53.780523 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-76832194-b17e-4a19-ac83-87cdf14e0b4a'] Oct 19 03:22:53.780523 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:22:53.780523 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:22:53.780523 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:22:53.780523 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:22:53.780523 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 19 03:22:53.780523 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 19 03:22:53.780523 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 19 03:22:53.780523 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 19 03:22:53.780523 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group e4da6f5b-5c5b-4fbd-8abc-32a3d8564e88 in use. Oct 19 03:22:53.780523 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-76832194-b17e-4a19-ac83-87cdf14e0b4a'] Oct 19 03:22:53.781597 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:22:53.781597 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:22:53.781597 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:22:53.781597 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:22:53.781597 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:22:53.781597 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:22:53.781597 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:22:53.781597 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:22:53.781597 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 03:22:53.781597 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 03:22:53.781597 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:22:53.781597 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:22:53.781597 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 19 03:22:53.781597 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 19 03:22:53.781597 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group e4da6f5b-5c5b-4fbd-8abc-32a3d8564e88 in use. Oct 19 03:22:53.781597 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-76832194-b17e-4a19-ac83-87cdf14e0b4a'] Oct 19 03:22:53.781597 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:22:53.781597 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:22:53.781597 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:22:53.781597 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:22:53.781597 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:22:53.782703 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:22:53.782703 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:22:53.782703 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:22:53.782703 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group e4da6f5b-5c5b-4fbd-8abc-32a3d8564e88 in use. Oct 19 03:22:53.782703 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-76832194-b17e-4a19-ac83-87cdf14e0b4a'] Oct 19 03:22:53.782703 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:22:53.782703 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-fc7689e3-3f0a-40ab-bdd2-f4d379ca810a tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Returning 400 to user: Security Group e4da6f5b-5c5b-4fbd-8abc-32a3d8564e88 in use. Oct 19 03:22:53.782703 n-d-861333-8 devstack@n-api.service[121134]: Neutron server returns request_ids: ['req-76832194-b17e-4a19-ac83-87cdf14e0b4a'] {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:22:53.782703 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-fc7689e3-3f0a-40ab-bdd2-f4d379ca810a tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/e4da6f5b-5c5b-4fbd-8abc-32a3d8564e88" status: 400 len: 185 microversion: 2.1 time: 1.507615 Oct 19 03:22:53.782703 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1293/2612] 10.222.0.52 () {58 vars in 1272 bytes} [Wed Oct 19 03:22:52 2022] DELETE /compute/v2.1/os-security-groups/e4da6f5b-5c5b-4fbd-8abc-32a3d8564e88 => generated 185 bytes in 1509 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 19 03:22:53.789003 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8b88ac87-cd86-46ce-9956-4dd026993cdb tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:22:53.791664 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8b88ac87-cd86-46ce-9956-4dd026993cdb tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] [instance: bb7dc549-597e-4568-8ab7-768654c73278] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:53.799761 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8b88ac87-cd86-46ce-9956-4dd026993cdb tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:53.800264 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8b88ac87-cd86-46ce-9956-4dd026993cdb tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:53.800701 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8b88ac87-cd86-46ce-9956-4dd026993cdb tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:53.801442 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8b88ac87-cd86-46ce-9956-4dd026993cdb tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:53.801897 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8b88ac87-cd86-46ce-9956-4dd026993cdb tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:53.802323 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8b88ac87-cd86-46ce-9956-4dd026993cdb tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:53.899604 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-397f9451-7d76-4f0b-8f25-31290ac876e4 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:53.910066 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-397f9451-7d76-4f0b-8f25-31290ac876e4 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/c45890de-f7bf-4736-8b08-6f3e6863e2b3" status: 200 len: 1497 microversion: 2.1 time: 0.788519 Oct 19 03:22:53.924057 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1320/2613] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:22:53 2022] GET /compute/v2.1/servers/c45890de-f7bf-4736-8b08-6f3e6863e2b3 => generated 1497 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:22:53.929198 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5e808147-45ed-4f6a-831c-cc1485bd98e5 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Calling method '.version_select at 0x7fc130203670>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:54.014041 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5e808147-45ed-4f6a-831c-cc1485bd98e5 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] 10.222.0.52 "GET /compute/v2.1/images/b198d558-6429-48b5-a113-6a3a25c104ff" status: 200 len: 1454 microversion: 2.1 time: 0.102028 Oct 19 03:22:54.015230 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1321/2614] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:22:53 2022] GET /compute/v2.1/images/b198d558-6429-48b5-a113-6a3a25c104ff => generated 1454 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:22:54.167237 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8b88ac87-cd86-46ce-9956-4dd026993cdb tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] 10.222.0.52 "POST /compute/v2.1/servers/bb7dc549-597e-4568-8ab7-768654c73278/action" status: 202 len: 0 microversion: 2.1 time: 0.376172 Oct 19 03:22:54.167237 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1294/2615] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:22:53 2022] POST /compute/v2.1/servers/bb7dc549-597e-4568-8ab7-768654c73278/action => generated 0 bytes in 378 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 19 03:22:54.175937 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6cefcecb-0867-4ea6-88fb-4d8a099f69bf tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:54.178781 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6cefcecb-0867-4ea6-88fb-4d8a099f69bf tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] [instance: bb7dc549-597e-4568-8ab7-768654c73278] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:54.196344 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6cefcecb-0867-4ea6-88fb-4d8a099f69bf tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:54.199823 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6cefcecb-0867-4ea6-88fb-4d8a099f69bf tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:54.200545 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6cefcecb-0867-4ea6-88fb-4d8a099f69bf tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:54.205024 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6cefcecb-0867-4ea6-88fb-4d8a099f69bf tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:54.210035 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6cefcecb-0867-4ea6-88fb-4d8a099f69bf tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:54.210785 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6cefcecb-0867-4ea6-88fb-4d8a099f69bf tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:54.673759 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-6cefcecb-0867-4ea6-88fb-4d8a099f69bf tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3661010393d44c428fb37652b1717072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a1e7cceff48798bfefb9390e5979c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:54.684876 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6cefcecb-0867-4ea6-88fb-4d8a099f69bf tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] 10.222.0.52 "GET /compute/v2.1/servers/bb7dc549-597e-4568-8ab7-768654c73278" status: 200 len: 1574 microversion: 2.1 time: 0.519212 Oct 19 03:22:54.687685 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1322/2616] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:22:54 2022] GET /compute/v2.1/servers/bb7dc549-597e-4568-8ab7-768654c73278 => generated 1574 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:22:54.940598 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e0962e1d-5ab0-4817-bd04-3cf4dbc50a96 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:54.941234 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e0962e1d-5ab0-4817-bd04-3cf4dbc50a96 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: c45890de-f7bf-4736-8b08-6f3e6863e2b3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:54.950770 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e0962e1d-5ab0-4817-bd04-3cf4dbc50a96 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:54.951274 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e0962e1d-5ab0-4817-bd04-3cf4dbc50a96 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:54.951696 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e0962e1d-5ab0-4817-bd04-3cf4dbc50a96 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:54.964715 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e0962e1d-5ab0-4817-bd04-3cf4dbc50a96 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:54.971730 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e0962e1d-5ab0-4817-bd04-3cf4dbc50a96 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:54.972391 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e0962e1d-5ab0-4817-bd04-3cf4dbc50a96 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:55.031263 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-27bc37e8-bc3c-4d01-91e0-b32818dd0c4f tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Calling method '.version_select at 0x7fc1301d7820>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:55.103883 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-27bc37e8-bc3c-4d01-91e0-b32818dd0c4f tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] 10.222.0.52 "GET /compute/v2.1/images/b198d558-6429-48b5-a113-6a3a25c104ff" status: 200 len: 1454 microversion: 2.1 time: 0.076741 Oct 19 03:22:55.104971 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1323/2617] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:22:55 2022] GET /compute/v2.1/images/b198d558-6429-48b5-a113-6a3a25c104ff => generated 1454 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:22:55.526159 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e0962e1d-5ab0-4817-bd04-3cf4dbc50a96 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:55.530295 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=97,nova_cell1:DELETE=1,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:22:55.537641 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e0962e1d-5ab0-4817-bd04-3cf4dbc50a96 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/c45890de-f7bf-4736-8b08-6f3e6863e2b3" status: 200 len: 1497 microversion: 2.1 time: 0.602082 Oct 19 03:22:55.540874 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1295/2618] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:22:54 2022] GET /compute/v2.1/servers/c45890de-f7bf-4736-8b08-6f3e6863e2b3 => generated 1497 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:22:55.712667 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-02fde33d-e0cf-4f3d-9a1c-e18eb5cd97bb tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:55.713388 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-02fde33d-e0cf-4f3d-9a1c-e18eb5cd97bb tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] [instance: bb7dc549-597e-4568-8ab7-768654c73278] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:55.738989 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-02fde33d-e0cf-4f3d-9a1c-e18eb5cd97bb tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:55.741807 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-02fde33d-e0cf-4f3d-9a1c-e18eb5cd97bb tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:55.744963 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-02fde33d-e0cf-4f3d-9a1c-e18eb5cd97bb tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:55.748493 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-02fde33d-e0cf-4f3d-9a1c-e18eb5cd97bb tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:55.749030 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-02fde33d-e0cf-4f3d-9a1c-e18eb5cd97bb tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:55.749504 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-02fde33d-e0cf-4f3d-9a1c-e18eb5cd97bb tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:56.130853 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c3466e9a-e3bd-4f8c-8608-eda04f87ede4 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Calling method '.version_select at 0x7fc130112280>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:56.245993 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c3466e9a-e3bd-4f8c-8608-eda04f87ede4 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] 10.222.0.52 "GET /compute/v2.1/images/b198d558-6429-48b5-a113-6a3a25c104ff" status: 200 len: 1454 microversion: 2.1 time: 0.129731 Oct 19 03:22:56.247719 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1296/2619] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:22:56 2022] GET /compute/v2.1/images/b198d558-6429-48b5-a113-6a3a25c104ff => generated 1454 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:22:56.510415 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-02fde33d-e0cf-4f3d-9a1c-e18eb5cd97bb tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3661010393d44c428fb37652b1717072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a1e7cceff48798bfefb9390e5979c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:56.520670 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-02fde33d-e0cf-4f3d-9a1c-e18eb5cd97bb tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] 10.222.0.52 "GET /compute/v2.1/servers/bb7dc549-597e-4568-8ab7-768654c73278" status: 200 len: 1574 microversion: 2.1 time: 0.812776 Oct 19 03:22:56.539467 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1324/2620] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:22:55 2022] GET /compute/v2.1/servers/bb7dc549-597e-4568-8ab7-768654c73278 => generated 1574 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:22:56.567729 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-10776615-43d0-46d2-abf5-b05a2086ecb7 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:56.568376 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-10776615-43d0-46d2-abf5-b05a2086ecb7 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: c45890de-f7bf-4736-8b08-6f3e6863e2b3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:56.589325 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-10776615-43d0-46d2-abf5-b05a2086ecb7 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:56.589864 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-10776615-43d0-46d2-abf5-b05a2086ecb7 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:56.595084 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-10776615-43d0-46d2-abf5-b05a2086ecb7 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:56.595900 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-10776615-43d0-46d2-abf5-b05a2086ecb7 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:56.606711 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-10776615-43d0-46d2-abf5-b05a2086ecb7 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:56.607589 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-10776615-43d0-46d2-abf5-b05a2086ecb7 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:57.168227 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-10776615-43d0-46d2-abf5-b05a2086ecb7 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:57.195650 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-10776615-43d0-46d2-abf5-b05a2086ecb7 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/c45890de-f7bf-4736-8b08-6f3e6863e2b3" status: 200 len: 1497 microversion: 2.1 time: 0.631591 Oct 19 03:22:57.198646 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1297/2621] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:22:56 2022] GET /compute/v2.1/servers/c45890de-f7bf-4736-8b08-6f3e6863e2b3 => generated 1497 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:22:57.266718 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2fac1ff6-c142-40d5-96c3-5426e51c866c tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Calling method '.version_select at 0x7fc130207700>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:57.359566 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2fac1ff6-c142-40d5-96c3-5426e51c866c tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] 10.222.0.52 "GET /compute/v2.1/images/b198d558-6429-48b5-a113-6a3a25c104ff" status: 200 len: 1454 microversion: 2.1 time: 0.101423 Oct 19 03:22:57.367253 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1325/2622] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:22:57 2022] GET /compute/v2.1/images/b198d558-6429-48b5-a113-6a3a25c104ff => generated 1454 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:22:57.553390 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-14280f98-3b90-4311-9e8d-408a61764b85 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:57.554074 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-14280f98-3b90-4311-9e8d-408a61764b85 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] [instance: bb7dc549-597e-4568-8ab7-768654c73278] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:57.571679 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-14280f98-3b90-4311-9e8d-408a61764b85 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:57.572124 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-14280f98-3b90-4311-9e8d-408a61764b85 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:57.572559 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-14280f98-3b90-4311-9e8d-408a61764b85 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:57.577338 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-14280f98-3b90-4311-9e8d-408a61764b85 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:57.579862 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-14280f98-3b90-4311-9e8d-408a61764b85 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:57.582474 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-14280f98-3b90-4311-9e8d-408a61764b85 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:58.054595 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-14280f98-3b90-4311-9e8d-408a61764b85 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3661010393d44c428fb37652b1717072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a1e7cceff48798bfefb9390e5979c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:58.062362 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-14280f98-3b90-4311-9e8d-408a61764b85 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] 10.222.0.52 "GET /compute/v2.1/servers/bb7dc549-597e-4568-8ab7-768654c73278" status: 200 len: 1579 microversion: 2.1 time: 0.512813 Oct 19 03:22:58.083720 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1298/2623] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:22:57 2022] GET /compute/v2.1/servers/bb7dc549-597e-4568-8ab7-768654c73278 => generated 1579 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:22:58.221429 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-342f94a3-8c71-40df-9cc3-2d39d8c08846 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:58.221988 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-342f94a3-8c71-40df-9cc3-2d39d8c08846 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: c45890de-f7bf-4736-8b08-6f3e6863e2b3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:58.232460 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-342f94a3-8c71-40df-9cc3-2d39d8c08846 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:58.233398 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-342f94a3-8c71-40df-9cc3-2d39d8c08846 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:58.234370 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-342f94a3-8c71-40df-9cc3-2d39d8c08846 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:58.238371 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-342f94a3-8c71-40df-9cc3-2d39d8c08846 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:58.239022 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-342f94a3-8c71-40df-9cc3-2d39d8c08846 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:58.239642 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-342f94a3-8c71-40df-9cc3-2d39d8c08846 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:58.376178 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a34c2954-0621-4f4c-be29-eab6c7aa8bbb tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Calling method '.version_select at 0x7fc13014f670>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:58.468434 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a34c2954-0621-4f4c-be29-eab6c7aa8bbb tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] 10.222.0.52 "GET /compute/v2.1/images/b198d558-6429-48b5-a113-6a3a25c104ff" status: 200 len: 1454 microversion: 2.1 time: 0.096629 Oct 19 03:22:58.469417 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1299/2624] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:22:58 2022] GET /compute/v2.1/images/b198d558-6429-48b5-a113-6a3a25c104ff => generated 1454 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:22:58.569232 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-342f94a3-8c71-40df-9cc3-2d39d8c08846 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:58.575848 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:22:58.579935 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-342f94a3-8c71-40df-9cc3-2d39d8c08846 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/c45890de-f7bf-4736-8b08-6f3e6863e2b3" status: 200 len: 1497 microversion: 2.1 time: 0.363502 Oct 19 03:22:58.583389 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1326/2625] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:22:58 2022] GET /compute/v2.1/servers/c45890de-f7bf-4736-8b08-6f3e6863e2b3 => generated 1497 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:22:59.098411 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b3d872fd-c8fb-408d-b690-394381600edc tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:59.098411 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b3d872fd-c8fb-408d-b690-394381600edc tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] [instance: bb7dc549-597e-4568-8ab7-768654c73278] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:59.106109 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b3d872fd-c8fb-408d-b690-394381600edc tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:59.106825 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b3d872fd-c8fb-408d-b690-394381600edc tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:59.107410 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b3d872fd-c8fb-408d-b690-394381600edc tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:59.108936 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b3d872fd-c8fb-408d-b690-394381600edc tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:59.109573 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b3d872fd-c8fb-408d-b690-394381600edc tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:59.110204 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b3d872fd-c8fb-408d-b690-394381600edc tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:59.487721 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f1e3916a-df6f-4991-a2a2-f9213f62b9c1 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Calling method '.version_select at 0x7fc130245280>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:59.556892 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b3d872fd-c8fb-408d-b690-394381600edc tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3661010393d44c428fb37652b1717072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a1e7cceff48798bfefb9390e5979c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:22:59.573715 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b3d872fd-c8fb-408d-b690-394381600edc tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] 10.222.0.52 "GET /compute/v2.1/servers/bb7dc549-597e-4568-8ab7-768654c73278" status: 200 len: 1572 microversion: 2.1 time: 0.477705 Oct 19 03:22:59.573715 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1300/2626] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:22:59 2022] GET /compute/v2.1/servers/bb7dc549-597e-4568-8ab7-768654c73278 => generated 1572 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:22:59.604869 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f1e3916a-df6f-4991-a2a2-f9213f62b9c1 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] 10.222.0.52 "GET /compute/v2.1/images/b198d558-6429-48b5-a113-6a3a25c104ff" status: 200 len: 1454 microversion: 2.1 time: 0.122481 Oct 19 03:22:59.617227 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1327/2627] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:22:59 2022] GET /compute/v2.1/images/b198d558-6429-48b5-a113-6a3a25c104ff => generated 1454 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:22:59.621850 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-66ac70c9-f5e0-4fa7-b415-91106395f602 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-107393672"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:22:59.624888 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-66ac70c9-f5e0-4fa7-b415-91106395f602 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] [instance: bb7dc549-597e-4568-8ab7-768654c73278] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:59.632415 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f702f5a3-dd4c-451c-a8ae-113a87b34f71 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:22:59.635169 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f702f5a3-dd4c-451c-a8ae-113a87b34f71 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: c45890de-f7bf-4736-8b08-6f3e6863e2b3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:22:59.651928 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f702f5a3-dd4c-451c-a8ae-113a87b34f71 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:59.652777 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f702f5a3-dd4c-451c-a8ae-113a87b34f71 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:59.658720 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f702f5a3-dd4c-451c-a8ae-113a87b34f71 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:59.659951 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f702f5a3-dd4c-451c-a8ae-113a87b34f71 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:59.660663 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f702f5a3-dd4c-451c-a8ae-113a87b34f71 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:59.661349 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f702f5a3-dd4c-451c-a8ae-113a87b34f71 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:59.672662 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-66ac70c9-f5e0-4fa7-b415-91106395f602 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:59.674565 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-66ac70c9-f5e0-4fa7-b415-91106395f602 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:59.675027 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-66ac70c9-f5e0-4fa7-b415-91106395f602 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:22:59.675781 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-66ac70c9-f5e0-4fa7-b415-91106395f602 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:22:59.676242 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-66ac70c9-f5e0-4fa7-b415-91106395f602 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:22:59.692201 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-66ac70c9-f5e0-4fa7-b415-91106395f602 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:00.284430 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f702f5a3-dd4c-451c-a8ae-113a87b34f71 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:23:00.319584 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f702f5a3-dd4c-451c-a8ae-113a87b34f71 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/c45890de-f7bf-4736-8b08-6f3e6863e2b3" status: 200 len: 1497 microversion: 2.1 time: 0.700845 Oct 19 03:23:00.325655 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1328/2628] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:22:59 2022] GET /compute/v2.1/servers/c45890de-f7bf-4736-8b08-6f3e6863e2b3 => generated 1497 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:23:00.410537 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.network.security_group_api [None req-66ac70c9-f5e0-4fa7-b415-91106395f602 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Adding security group d57db41a-f3fe-4805-a71f-7bcef9ca64bf to port 0387e7d0-f8d7-44a7-96d1-e3e551f9b133 Oct 19 03:23:00.626413 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3dbeac2f-10d5-4b4d-aa50-c26798bf1886 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Calling method '.version_select at 0x7fc1301e3670>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:23:00.710392 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-3dbeac2f-10d5-4b4d-aa50-c26798bf1886 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] 10.222.0.52 "GET /compute/v2.1/images/b198d558-6429-48b5-a113-6a3a25c104ff" status: 200 len: 1454 microversion: 2.1 time: 0.092473 Oct 19 03:23:00.714577 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1329/2629] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:23:00 2022] GET /compute/v2.1/images/b198d558-6429-48b5-a113-6a3a25c104ff => generated 1454 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:23:01.353265 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-639a6616-8364-4ba1-9c1a-a854d2e97570 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:23:01.353985 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-639a6616-8364-4ba1-9c1a-a854d2e97570 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: c45890de-f7bf-4736-8b08-6f3e6863e2b3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:23:01.374985 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-639a6616-8364-4ba1-9c1a-a854d2e97570 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:01.375501 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-639a6616-8364-4ba1-9c1a-a854d2e97570 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:01.378268 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-639a6616-8364-4ba1-9c1a-a854d2e97570 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:01.396286 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-639a6616-8364-4ba1-9c1a-a854d2e97570 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:01.396793 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-639a6616-8364-4ba1-9c1a-a854d2e97570 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:01.397240 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-639a6616-8364-4ba1-9c1a-a854d2e97570 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:01.580241 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=8 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:23:01.769602 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-639a6616-8364-4ba1-9c1a-a854d2e97570 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:23:01.785359 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-639a6616-8364-4ba1-9c1a-a854d2e97570 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/c45890de-f7bf-4736-8b08-6f3e6863e2b3" status: 200 len: 1497 microversion: 2.1 time: 0.436708 Oct 19 03:23:01.786093 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1330/2630] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:23:01 2022] GET /compute/v2.1/servers/c45890de-f7bf-4736-8b08-6f3e6863e2b3 => generated 1497 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:23:01.801012 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-abd0c9a1-4193-495c-b0d6-13a1f12458c9 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Calling method '.version_select at 0x7fc135173dc0>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:23:01.846545 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-abd0c9a1-4193-495c-b0d6-13a1f12458c9 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] 10.222.0.52 "GET /compute/v2.1/images/b198d558-6429-48b5-a113-6a3a25c104ff" status: 200 len: 1454 microversion: 2.1 time: 0.049181 Oct 19 03:23:01.847111 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1331/2631] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:23:01 2022] GET /compute/v2.1/images/b198d558-6429-48b5-a113-6a3a25c104ff => generated 1454 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:23:01.983987 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-66ac70c9-f5e0-4fa7-b415-91106395f602 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] 10.222.0.52 "POST /compute/v2.1/servers/bb7dc549-597e-4568-8ab7-768654c73278/action" status: 202 len: 0 microversion: 2.1 time: 2.379222 Oct 19 03:23:01.985026 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1301/2632] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:22:59 2022] POST /compute/v2.1/servers/bb7dc549-597e-4568-8ab7-768654c73278/action => generated 0 bytes in 2381 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:23:01.993406 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a523a2b3-86a7-4930-a0b7-97ef9c4a2720 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Calling method '.version_select at 0x7fc130270040>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:23:02.063305 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-0ad27b17-0cdb-41d9-bde1-65e3da7b2914 req-a72128a2-0770-4b6d-8d91-1446b92e599b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb7dc549-597e-4568-8ab7-768654c73278", "tag": "0387e7d0-f8d7-44a7-96d1-e3e551f9b133"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:23:02.099370 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-0ad27b17-0cdb-41d9-bde1-65e3da7b2914 req-a72128a2-0770-4b6d-8d91-1446b92e599b service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:02.099866 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-0ad27b17-0cdb-41d9-bde1-65e3da7b2914 req-a72128a2-0770-4b6d-8d91-1446b92e599b service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:02.100300 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-0ad27b17-0cdb-41d9-bde1-65e3da7b2914 req-a72128a2-0770-4b6d-8d91-1446b92e599b service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:02.150194 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-0ad27b17-0cdb-41d9-bde1-65e3da7b2914 req-a72128a2-0770-4b6d-8d91-1446b92e599b service nova] Creating event network-changed:0387e7d0-f8d7-44a7-96d1-e3e551f9b133 for instance bb7dc549-597e-4568-8ab7-768654c73278 on n-h2-861333-8 Oct 19 03:23:02.175977 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-0ad27b17-0cdb-41d9-bde1-65e3da7b2914 req-a72128a2-0770-4b6d-8d91-1446b92e599b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118276 Oct 19 03:23:02.188565 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1302/2633] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:23:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:23:02.488257 n-d-861333-8 devstack@n-api.service[121135]: DEBUG neutronclient.v2_0.client [None req-a523a2b3-86a7-4930-a0b7-97ef9c4a2720 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group d57db41a-f3fe-4805-a71f-7bcef9ca64bf in use.", "detail": ""}} {{(pid=121135) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 19 03:23:02.489201 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-a523a2b3-86a7-4930-a0b7-97ef9c4a2720 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] HTTP exception thrown: Security Group d57db41a-f3fe-4805-a71f-7bcef9ca64bf in use. Oct 19 03:23:02.489201 n-d-861333-8 devstack@n-api.service[121135]: Neutron server returns request_ids: ['req-0510afac-f4f9-416f-883b-5dbcdde01140'] Oct 19 03:23:02.492279 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a523a2b3-86a7-4930-a0b7-97ef9c4a2720 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Request method failure captured: Oct 19 03:23:02.492279 n-d-861333-8 devstack@n-api.service[121135]: request: DELETE /compute/v2.1/os-security-groups/d57db41a-f3fe-4805-a71f-7bcef9ca64bf HTTP/1.1 Oct 19 03:23:02.492279 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:23:02.492279 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:23:02.492279 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:23:02.492279 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:23:02.492279 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:23:02.492279 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:23:02.492279 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:23:02.492279 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:23:02.492279 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT200KvQGsyi_a_sB4TfhhJOzMfG19jSa6oSlia6bg0oJGWsETmIFLMxsrnEQMCxFlXYpeXPwW52kFxfganN5M4cxj3tahAijx2xJ--2WsWYJtuNU3tc5IIgL3W8HC4CGP3frn8iROEzLPCi1mQC1-zUvq06vNZR4ARbYNlrlnvumYqI Oct 19 03:23:02.492279 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:23:02.492279 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:23:02.492279 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:23:02.492279 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:23:02.492279 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:23:02.492279 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:23:02.492279 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 385a1e7cceff48798bfefb9390e5979c Oct 19 03:23:02.492279 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-SecurityGroupsTestJSON-637911912 Oct 19 03:23:02.492279 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:23:02.492279 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:23:02.494005 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/385a1e7cceff48798bfefb9390e5979c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/385a1e7cceff48798bfefb9390e5979c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/385a1e7cceff48798bfefb9390e5979c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_385a1e7cceff48798bfefb9390e5979c", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:23:02.494005 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-SecurityGroupsTestJSON-637911912 Oct 19 03:23:02.494005 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 385a1e7cceff48798bfefb9390e5979c Oct 19 03:23:02.494005 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-637911912 Oct 19 03:23:02.494005 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-SecurityGroupsTestJSON-637911912-project Oct 19 03:23:02.494005 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:23:02.494005 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:23:02.494005 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 3661010393d44c428fb37652b1717072 Oct 19 03:23:02.494005 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-SecurityGroupsTestJSON-637911912-project Oct 19 03:23:02.494005 n-d-861333-8 devstack@n-api.service[121135]: method: Oct 19 03:23:02.494005 n-d-861333-8 devstack@n-api.service[121135]: exception: Security Group d57db41a-f3fe-4805-a71f-7bcef9ca64bf in use. Oct 19 03:23:02.494005 n-d-861333-8 devstack@n-api.service[121135]: Neutron server returns request_ids: ['req-0510afac-f4f9-416f-883b-5dbcdde01140'] Oct 19 03:23:02.494005 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': 'd57db41a-f3fe-4805-a71f-7bcef9ca64bf'} Oct 19 03:23:02.494998 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:23:02.494998 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:23:02.494998 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 19 03:23:02.494998 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 19 03:23:02.494998 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:23:02.494998 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:23:02.494998 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 19 03:23:02.494998 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 19 03:23:02.494998 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:23:02.494998 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:23:02.494998 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 19 03:23:02.494998 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 19 03:23:02.494998 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:23:02.494998 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:23:02.494998 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 19 03:23:02.494998 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 19 03:23:02.494998 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:23:02.494998 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:23:02.494998 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 19 03:23:02.496387 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 19 03:23:02.496387 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:23:02.496387 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:23:02.496387 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 19 03:23:02.496387 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 19 03:23:02.496387 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 19 03:23:02.496387 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 19 03:23:02.496387 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group d57db41a-f3fe-4805-a71f-7bcef9ca64bf in use. Oct 19 03:23:02.496387 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0510afac-f4f9-416f-883b-5dbcdde01140'] Oct 19 03:23:02.496387 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:23:02.496387 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:23:02.496387 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:23:02.496387 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:23:02.496387 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 19 03:23:02.496387 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 19 03:23:02.496387 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 19 03:23:02.496387 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 19 03:23:02.496387 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group d57db41a-f3fe-4805-a71f-7bcef9ca64bf in use. Oct 19 03:23:02.496387 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0510afac-f4f9-416f-883b-5dbcdde01140'] Oct 19 03:23:02.497731 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:23:02.497731 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:23:02.497731 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:23:02.497731 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:23:02.497731 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:23:02.497731 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:23:02.497731 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:23:02.497731 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:23:02.497731 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 03:23:02.497731 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 03:23:02.497731 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:23:02.497731 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:23:02.497731 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 19 03:23:02.497731 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 19 03:23:02.497731 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group d57db41a-f3fe-4805-a71f-7bcef9ca64bf in use. Oct 19 03:23:02.497731 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0510afac-f4f9-416f-883b-5dbcdde01140'] Oct 19 03:23:02.497731 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:23:02.497731 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:23:02.497731 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:23:02.497731 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:23:02.497731 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:23:02.499181 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:23:02.499181 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:23:02.499181 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:23:02.499181 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group d57db41a-f3fe-4805-a71f-7bcef9ca64bf in use. Oct 19 03:23:02.499181 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0510afac-f4f9-416f-883b-5dbcdde01140'] Oct 19 03:23:02.499181 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:23:02.501236 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a523a2b3-86a7-4930-a0b7-97ef9c4a2720 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Returning 400 to user: Security Group d57db41a-f3fe-4805-a71f-7bcef9ca64bf in use. Oct 19 03:23:02.501236 n-d-861333-8 devstack@n-api.service[121135]: Neutron server returns request_ids: ['req-0510afac-f4f9-416f-883b-5dbcdde01140'] {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:23:02.508044 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a523a2b3-86a7-4930-a0b7-97ef9c4a2720 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/d57db41a-f3fe-4805-a71f-7bcef9ca64bf" status: 400 len: 185 microversion: 2.1 time: 0.513122 Oct 19 03:23:02.508044 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1332/2634] 10.222.0.52 () {58 vars in 1272 bytes} [Wed Oct 19 03:23:01 2022] DELETE /compute/v2.1/os-security-groups/d57db41a-f3fe-4805-a71f-7bcef9ca64bf => generated 185 bytes in 517 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 03:23:02.514046 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-444991e3-85e2-4149-a754-d9e673674569 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:23:02.515350 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-444991e3-85e2-4149-a754-d9e673674569 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] [instance: bb7dc549-597e-4568-8ab7-768654c73278] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:23:02.535610 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-444991e3-85e2-4149-a754-d9e673674569 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:02.540486 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-444991e3-85e2-4149-a754-d9e673674569 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:02.542566 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-444991e3-85e2-4149-a754-d9e673674569 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:02.543436 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-444991e3-85e2-4149-a754-d9e673674569 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:02.548657 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-444991e3-85e2-4149-a754-d9e673674569 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:02.549237 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-444991e3-85e2-4149-a754-d9e673674569 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:02.644829 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-444991e3-85e2-4149-a754-d9e673674569 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] [instance: bb7dc549-597e-4568-8ab7-768654c73278] Going to try to terminate instance {{(pid=121134) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:23:02.811037 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9a8a0c32-1387-4226-9b34-1168f76d6d44 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:23:02.812711 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9a8a0c32-1387-4226-9b34-1168f76d6d44 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: c45890de-f7bf-4736-8b08-6f3e6863e2b3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:23:02.832434 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9a8a0c32-1387-4226-9b34-1168f76d6d44 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:02.832434 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9a8a0c32-1387-4226-9b34-1168f76d6d44 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:02.834227 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9a8a0c32-1387-4226-9b34-1168f76d6d44 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:02.835371 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9a8a0c32-1387-4226-9b34-1168f76d6d44 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:02.839504 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9a8a0c32-1387-4226-9b34-1168f76d6d44 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:02.840201 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9a8a0c32-1387-4226-9b34-1168f76d6d44 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:03.180952 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-444991e3-85e2-4149-a754-d9e673674569 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] 10.222.0.52 "DELETE /compute/v2.1/servers/bb7dc549-597e-4568-8ab7-768654c73278" status: 204 len: 0 microversion: 2.1 time: 0.669319 Oct 19 03:23:03.180952 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1303/2635] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:23:02 2022] DELETE /compute/v2.1/servers/bb7dc549-597e-4568-8ab7-768654c73278 => generated 0 bytes in 672 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 19 03:23:03.186294 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7f2e2207-1efd-48cc-85fb-e7e84efdfe51 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Calling method '.version_select at 0x7fc1302a7670>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:23:03.244460 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-9a8a0c32-1387-4226-9b34-1168f76d6d44 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:23:03.253489 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9a8a0c32-1387-4226-9b34-1168f76d6d44 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/c45890de-f7bf-4736-8b08-6f3e6863e2b3" status: 200 len: 1497 microversion: 2.1 time: 0.448127 Oct 19 03:23:03.254600 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1333/2636] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:23:02 2022] GET /compute/v2.1/servers/c45890de-f7bf-4736-8b08-6f3e6863e2b3 => generated 1497 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:23:03.259519 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-076e9d0d-b1f6-4ab0-a7d0-bd36f74d1c56 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:23:03.261256 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-076e9d0d-b1f6-4ab0-a7d0-bd36f74d1c56 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] [instance: bb7dc549-597e-4568-8ab7-768654c73278] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:23:03.267838 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-076e9d0d-b1f6-4ab0-a7d0-bd36f74d1c56 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:03.268675 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-076e9d0d-b1f6-4ab0-a7d0-bd36f74d1c56 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:03.269353 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-076e9d0d-b1f6-4ab0-a7d0-bd36f74d1c56 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:03.281528 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-076e9d0d-b1f6-4ab0-a7d0-bd36f74d1c56 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:03.282271 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-076e9d0d-b1f6-4ab0-a7d0-bd36f74d1c56 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:03.283578 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-076e9d0d-b1f6-4ab0-a7d0-bd36f74d1c56 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:03.287812 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7f2e2207-1efd-48cc-85fb-e7e84efdfe51 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] 10.222.0.52 "GET /compute/v2.1/images/b198d558-6429-48b5-a113-6a3a25c104ff" status: 200 len: 1454 microversion: 2.1 time: 0.106300 Oct 19 03:23:03.288552 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1304/2637] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:23:03 2022] GET /compute/v2.1/images/b198d558-6429-48b5-a113-6a3a25c104ff => generated 1454 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:23:03.565576 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-076e9d0d-b1f6-4ab0-a7d0-bd36f74d1c56 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3661010393d44c428fb37652b1717072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a1e7cceff48798bfefb9390e5979c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:23:03.582324 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-076e9d0d-b1f6-4ab0-a7d0-bd36f74d1c56 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] 10.222.0.52 "GET /compute/v2.1/servers/bb7dc549-597e-4568-8ab7-768654c73278" status: 200 len: 1646 microversion: 2.1 time: 0.326402 Oct 19 03:23:03.584243 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1334/2638] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:23:03 2022] GET /compute/v2.1/servers/bb7dc549-597e-4568-8ab7-768654c73278 => generated 1646 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:23:04.283711 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b0be57ff-2ac6-4055-b8b6-3cc16fabcbab tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:23:04.284905 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b0be57ff-2ac6-4055-b8b6-3cc16fabcbab tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: c45890de-f7bf-4736-8b08-6f3e6863e2b3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:23:04.299233 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b0be57ff-2ac6-4055-b8b6-3cc16fabcbab tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:04.300735 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b0be57ff-2ac6-4055-b8b6-3cc16fabcbab tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:04.301446 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b0be57ff-2ac6-4055-b8b6-3cc16fabcbab tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:04.304762 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2e5f6628-3d8f-4184-8fb3-1798dfb830c2 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Calling method '.version_select at 0x7fc130bb4700>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:23:04.307717 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b0be57ff-2ac6-4055-b8b6-3cc16fabcbab tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:04.308453 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b0be57ff-2ac6-4055-b8b6-3cc16fabcbab tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:04.309088 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b0be57ff-2ac6-4055-b8b6-3cc16fabcbab tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:04.391633 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2e5f6628-3d8f-4184-8fb3-1798dfb830c2 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] 10.222.0.52 "GET /compute/v2.1/images/b198d558-6429-48b5-a113-6a3a25c104ff" status: 200 len: 1463 microversion: 2.1 time: 0.091282 Oct 19 03:23:04.409828 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1335/2639] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:23:04 2022] GET /compute/v2.1/images/b198d558-6429-48b5-a113-6a3a25c104ff => generated 1463 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:23:04.425221 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2df69fdf-6952-44a1-bf2c-dcd3acde95be tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Calling method '.version_select at 0x7fc1301b8040>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:23:04.491386 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2df69fdf-6952-44a1-bf2c-dcd3acde95be tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] 10.222.0.52 "GET /compute/v2.1/images/b198d558-6429-48b5-a113-6a3a25c104ff" status: 200 len: 1463 microversion: 2.1 time: 0.077988 Oct 19 03:23:04.492786 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1336/2640] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:23:04 2022] GET /compute/v2.1/images/b198d558-6429-48b5-a113-6a3a25c104ff => generated 1463 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:23:04.507716 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-677bc056-a414-4d93-8509-236af4a63170 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:23:04.508501 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-677bc056-a414-4d93-8509-236af4a63170 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] [instance: 410116db-4d00-4a9d-8375-a5cea6a0d627] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:23:04.517260 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-677bc056-a414-4d93-8509-236af4a63170 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:04.525899 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-677bc056-a414-4d93-8509-236af4a63170 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:04.526687 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-677bc056-a414-4d93-8509-236af4a63170 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:04.528415 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-677bc056-a414-4d93-8509-236af4a63170 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:04.529080 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-677bc056-a414-4d93-8509-236af4a63170 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:04.530331 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-677bc056-a414-4d93-8509-236af4a63170 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:04.996219 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b0be57ff-2ac6-4055-b8b6-3cc16fabcbab tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:23:05.020714 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b0be57ff-2ac6-4055-b8b6-3cc16fabcbab tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/c45890de-f7bf-4736-8b08-6f3e6863e2b3" status: 200 len: 1497 microversion: 2.1 time: 0.743515 Oct 19 03:23:05.032205 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1305/2641] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:23:04 2022] GET /compute/v2.1/servers/c45890de-f7bf-4736-8b08-6f3e6863e2b3 => generated 1497 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:23:05.043033 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-676337c8-d32c-48e8-a1c1-8d74a52895ac tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:23:05.045113 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-676337c8-d32c-48e8-a1c1-8d74a52895ac tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] [instance: bb7dc549-597e-4568-8ab7-768654c73278] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:23:05.071140 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-676337c8-d32c-48e8-a1c1-8d74a52895ac tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:05.072591 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-676337c8-d32c-48e8-a1c1-8d74a52895ac tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:05.073439 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-676337c8-d32c-48e8-a1c1-8d74a52895ac tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:05.075608 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-676337c8-d32c-48e8-a1c1-8d74a52895ac tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:05.077028 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-676337c8-d32c-48e8-a1c1-8d74a52895ac tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:05.078757 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-676337c8-d32c-48e8-a1c1-8d74a52895ac tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:05.231834 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-677bc056-a414-4d93-8509-236af4a63170 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a222bb0f9a4c728d2ed5ca011c032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146393855c047be83270e5334c68e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:23:05.243359 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-677bc056-a414-4d93-8509-236af4a63170 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] 10.222.0.52 "GET /compute/v2.1/servers/410116db-4d00-4a9d-8375-a5cea6a0d627" status: 200 len: 1480 microversion: 2.1 time: 0.740420 Oct 19 03:23:05.244305 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1337/2642] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:23:04 2022] GET /compute/v2.1/servers/410116db-4d00-4a9d-8375-a5cea6a0d627 => generated 1480 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:23:05.730481 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-676337c8-d32c-48e8-a1c1-8d74a52895ac tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3661010393d44c428fb37652b1717072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a1e7cceff48798bfefb9390e5979c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:23:05.743113 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-676337c8-d32c-48e8-a1c1-8d74a52895ac tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] 10.222.0.52 "GET /compute/v2.1/servers/bb7dc549-597e-4568-8ab7-768654c73278" status: 200 len: 1646 microversion: 2.1 time: 0.709438 Oct 19 03:23:05.753860 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1306/2643] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:23:05 2022] GET /compute/v2.1/servers/bb7dc549-597e-4568-8ab7-768654c73278 => generated 1646 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:23:06.052584 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c927ad06-842f-46a6-b2b5-856b5ef93587 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:23:06.056739 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c927ad06-842f-46a6-b2b5-856b5ef93587 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: c45890de-f7bf-4736-8b08-6f3e6863e2b3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:23:06.078646 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c927ad06-842f-46a6-b2b5-856b5ef93587 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:06.079632 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c927ad06-842f-46a6-b2b5-856b5ef93587 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:06.080317 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c927ad06-842f-46a6-b2b5-856b5ef93587 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:06.081292 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c927ad06-842f-46a6-b2b5-856b5ef93587 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:06.082002 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c927ad06-842f-46a6-b2b5-856b5ef93587 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:06.082640 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c927ad06-842f-46a6-b2b5-856b5ef93587 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:06.269956 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-278cc53e-7bcd-4294-8fbb-88ff63fd0628 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:23:06.270961 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-278cc53e-7bcd-4294-8fbb-88ff63fd0628 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] [instance: 410116db-4d00-4a9d-8375-a5cea6a0d627] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:23:06.282501 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-278cc53e-7bcd-4294-8fbb-88ff63fd0628 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:06.285759 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-278cc53e-7bcd-4294-8fbb-88ff63fd0628 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:06.286460 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-278cc53e-7bcd-4294-8fbb-88ff63fd0628 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:06.292658 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-278cc53e-7bcd-4294-8fbb-88ff63fd0628 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:06.298120 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-278cc53e-7bcd-4294-8fbb-88ff63fd0628 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:06.299484 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-278cc53e-7bcd-4294-8fbb-88ff63fd0628 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:06.591716 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c927ad06-842f-46a6-b2b5-856b5ef93587 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:23:06.607662 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c927ad06-842f-46a6-b2b5-856b5ef93587 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/c45890de-f7bf-4736-8b08-6f3e6863e2b3" status: 200 len: 1497 microversion: 2.1 time: 0.557507 Oct 19 03:23:06.609711 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1338/2644] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:23:06 2022] GET /compute/v2.1/servers/c45890de-f7bf-4736-8b08-6f3e6863e2b3 => generated 1497 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:23:06.620438 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-b5cbd71f-57ac-436b-999d-79cb8a1858e0 req-a5fc6365-b718-40bc-b86f-ae97dc39fc27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb7dc549-597e-4568-8ab7-768654c73278", "name": "network-vif-deleted", "tag": "0387e7d0-f8d7-44a7-96d1-e3e551f9b133"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:23:06.646353 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-b5cbd71f-57ac-436b-999d-79cb8a1858e0 req-a5fc6365-b718-40bc-b86f-ae97dc39fc27 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:06.652098 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-b5cbd71f-57ac-436b-999d-79cb8a1858e0 req-a5fc6365-b718-40bc-b86f-ae97dc39fc27 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:06.653213 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-b5cbd71f-57ac-436b-999d-79cb8a1858e0 req-a5fc6365-b718-40bc-b86f-ae97dc39fc27 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:06.688929 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-b5cbd71f-57ac-436b-999d-79cb8a1858e0 req-a5fc6365-b718-40bc-b86f-ae97dc39fc27 service nova] Creating event network-vif-deleted:0387e7d0-f8d7-44a7-96d1-e3e551f9b133 for instance bb7dc549-597e-4568-8ab7-768654c73278 on n-h2-861333-8 Oct 19 03:23:06.693798 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-278cc53e-7bcd-4294-8fbb-88ff63fd0628 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a222bb0f9a4c728d2ed5ca011c032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146393855c047be83270e5334c68e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:23:06.708936 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-278cc53e-7bcd-4294-8fbb-88ff63fd0628 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] 10.222.0.52 "GET /compute/v2.1/servers/410116db-4d00-4a9d-8375-a5cea6a0d627" status: 200 len: 1467 microversion: 2.1 time: 0.444467 Oct 19 03:23:06.710920 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-b5cbd71f-57ac-436b-999d-79cb8a1858e0 req-a5fc6365-b718-40bc-b86f-ae97dc39fc27 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097262 Oct 19 03:23:06.711768 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1307/2645] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:23:06 2022] GET /compute/v2.1/servers/410116db-4d00-4a9d-8375-a5cea6a0d627 => generated 1467 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:23:06.712575 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1339/2646] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:23:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:23:06.746211 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4e0738ad-e310-4064-ae02-78dfb5c24dee tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-2003498500"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:23:06.749144 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4e0738ad-e310-4064-ae02-78dfb5c24dee tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] [instance: 6ef505a5-0624-4080-9089-821f6fdfb47c] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:23:06.758855 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4e0738ad-e310-4064-ae02-78dfb5c24dee tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:06.759216 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4e0738ad-e310-4064-ae02-78dfb5c24dee tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:06.759906 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4e0738ad-e310-4064-ae02-78dfb5c24dee tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:06.761308 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4e0738ad-e310-4064-ae02-78dfb5c24dee tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:06.762398 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4e0738ad-e310-4064-ae02-78dfb5c24dee tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:06.763041 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4e0738ad-e310-4064-ae02-78dfb5c24dee tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:06.773233 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-eda9ea30-f757-449f-aa06-00dec6d87038 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:23:06.774321 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-eda9ea30-f757-449f-aa06-00dec6d87038 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] [instance: bb7dc549-597e-4568-8ab7-768654c73278] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:23:06.784984 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-eda9ea30-f757-449f-aa06-00dec6d87038 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:06.788248 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-eda9ea30-f757-449f-aa06-00dec6d87038 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:06.790952 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-eda9ea30-f757-449f-aa06-00dec6d87038 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:06.790952 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-eda9ea30-f757-449f-aa06-00dec6d87038 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:06.790952 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-eda9ea30-f757-449f-aa06-00dec6d87038 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:06.790952 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-eda9ea30-f757-449f-aa06-00dec6d87038 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:06.954920 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-eda9ea30-f757-449f-aa06-00dec6d87038 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3661010393d44c428fb37652b1717072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a1e7cceff48798bfefb9390e5979c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:23:06.968035 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-eda9ea30-f757-449f-aa06-00dec6d87038 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] 10.222.0.52 "GET /compute/v2.1/servers/bb7dc549-597e-4568-8ab7-768654c73278" status: 200 len: 1300 microversion: 2.1 time: 0.200131 Oct 19 03:23:06.969263 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1340/2647] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:23:06 2022] GET /compute/v2.1/servers/bb7dc549-597e-4568-8ab7-768654c73278 => generated 1300 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:23:07.441944 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4e0738ad-e310-4064-ae02-78dfb5c24dee tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] 10.222.0.52 "POST /compute/v2.1/servers/6ef505a5-0624-4080-9089-821f6fdfb47c/action" status: 202 len: 0 microversion: 2.1 time: 0.700441 Oct 19 03:23:07.446336 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1308/2648] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:23:06 2022] POST /compute/v2.1/servers/6ef505a5-0624-4080-9089-821f6fdfb47c/action => generated 0 bytes in 706 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Oct 19 03:23:07.456646 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f08c592c-1315-4874-b45f-c04bb0b79b58 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Calling method '.version_select at 0x7fc130203e50>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:23:07.530055 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f08c592c-1315-4874-b45f-c04bb0b79b58 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] 10.222.0.52 "GET /compute/v2.1/images/c09f0682-cee7-4a5b-a32d-5b6db22a1d38" status: 200 len: 1455 microversion: 2.1 time: 0.076725 Oct 19 03:23:07.531708 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1341/2649] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:23:07 2022] GET /compute/v2.1/images/c09f0682-cee7-4a5b-a32d-5b6db22a1d38 => generated 1455 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:23:07.636515 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f90aaaf9-a1cf-436e-8c6e-a8fd96cc474f tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:23:07.642666 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f90aaaf9-a1cf-436e-8c6e-a8fd96cc474f tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: c45890de-f7bf-4736-8b08-6f3e6863e2b3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:23:07.677784 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f90aaaf9-a1cf-436e-8c6e-a8fd96cc474f tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:07.678958 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f90aaaf9-a1cf-436e-8c6e-a8fd96cc474f tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:07.680533 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f90aaaf9-a1cf-436e-8c6e-a8fd96cc474f tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:07.683195 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f90aaaf9-a1cf-436e-8c6e-a8fd96cc474f tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:07.685962 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f90aaaf9-a1cf-436e-8c6e-a8fd96cc474f tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:07.694437 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f90aaaf9-a1cf-436e-8c6e-a8fd96cc474f tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:07.943951 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-28817915-a093-4f89-b649-06291fcef974 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1917487337", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "networks": "none"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:23:08.019244 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-28817915-a093-4f89-b649-06291fcef974 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Flavor limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:23:08.019815 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-28817915-a093-4f89-b649-06291fcef974 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Image limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:23:08.020390 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-28817915-a093-4f89-b649-06291fcef974 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Flavor pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:23:08.020822 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-28817915-a093-4f89-b649-06291fcef974 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Image pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:23:08.021495 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-28817915-a093-4f89-b649-06291fcef974 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:23:08.031740 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-28817915-a093-4f89-b649-06291fcef974 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:08.032526 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-28817915-a093-4f89-b649-06291fcef974 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:08.033308 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-28817915-a093-4f89-b649-06291fcef974 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:08.035639 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-28817915-a093-4f89-b649-06291fcef974 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:08.035639 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-28817915-a093-4f89-b649-06291fcef974 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:08.035639 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-28817915-a093-4f89-b649-06291fcef974 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:08.055445 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-28817915-a093-4f89-b649-06291fcef974 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Getting quotas for project 6e10c25837184a3983c67f2da5fe74b3. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:23:08.061462 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-28817915-a093-4f89-b649-06291fcef974 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Getting quotas for user 8e1ff892953e478b814922c82cc108a3 and project 6e10c25837184a3983c67f2da5fe74b3. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:23:08.076181 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-28817915-a093-4f89-b649-06291fcef974 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Going to run 1 instances... {{(pid=121134) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:23:08.080089 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-28817915-a093-4f89-b649-06291fcef974 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] [instance: 60eb0d03-428c-4c76-a608-1a86e9271839] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:23:08.083546 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f90aaaf9-a1cf-436e-8c6e-a8fd96cc474f tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:23:08.100470 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f90aaaf9-a1cf-436e-8c6e-a8fd96cc474f tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/c45890de-f7bf-4736-8b08-6f3e6863e2b3" status: 200 len: 1497 microversion: 2.1 time: 0.467775 Oct 19 03:23:08.106533 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1342/2650] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:23:07 2022] GET /compute/v2.1/servers/c45890de-f7bf-4736-8b08-6f3e6863e2b3 => generated 1497 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:23:08.108008 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b7e0c4f7-068a-4152-be36-b30963ec4d7c tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:23:08.109192 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b7e0c4f7-068a-4152-be36-b30963ec4d7c tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] [instance: bb7dc549-597e-4568-8ab7-768654c73278] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:23:08.117192 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b7e0c4f7-068a-4152-be36-b30963ec4d7c tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:08.118058 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b7e0c4f7-068a-4152-be36-b30963ec4d7c tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:08.119080 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b7e0c4f7-068a-4152-be36-b30963ec4d7c tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:08.120395 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b7e0c4f7-068a-4152-be36-b30963ec4d7c tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:08.121581 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b7e0c4f7-068a-4152-be36-b30963ec4d7c tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:08.122322 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b7e0c4f7-068a-4152-be36-b30963ec4d7c tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:08.145175 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-b7e0c4f7-068a-4152-be36-b30963ec4d7c tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] HTTP exception thrown: Instance bb7dc549-597e-4568-8ab7-768654c73278 could not be found. Oct 19 03:23:08.146889 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b7e0c4f7-068a-4152-be36-b30963ec4d7c tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Request method failure captured: Oct 19 03:23:08.146889 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/bb7dc549-597e-4568-8ab7-768654c73278 HTTP/1.1 Oct 19 03:23:08.146889 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:23:08.146889 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:23:08.146889 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:23:08.146889 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:23:08.146889 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:23:08.146889 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:23:08.146889 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:23:08.146889 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:23:08.146889 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT200KvQGsyi_a_sB4TfhhJOzMfG19jSa6oSlia6bg0oJGWsETmIFLMxsrnEQMCxFlXYpeXPwW52kFxfganN5M4cxj3tahAijx2xJ--2WsWYJtuNU3tc5IIgL3W8HC4CGP3frn8iROEzLPCi1mQC1-zUvq06vNZR4ARbYNlrlnvumYqI Oct 19 03:23:08.146889 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:23:08.146889 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:23:08.146889 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:23:08.146889 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:23:08.146889 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:23:08.146889 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:23:08.146889 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 385a1e7cceff48798bfefb9390e5979c Oct 19 03:23:08.146889 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-SecurityGroupsTestJSON-637911912 Oct 19 03:23:08.146889 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:23:08.146889 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:23:08.148170 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/385a1e7cceff48798bfefb9390e5979c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/385a1e7cceff48798bfefb9390e5979c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/385a1e7cceff48798bfefb9390e5979c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_385a1e7cceff48798bfefb9390e5979c", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:23:08.148170 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-SecurityGroupsTestJSON-637911912 Oct 19 03:23:08.148170 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 385a1e7cceff48798bfefb9390e5979c Oct 19 03:23:08.148170 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-637911912 Oct 19 03:23:08.148170 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-SecurityGroupsTestJSON-637911912-project Oct 19 03:23:08.148170 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:23:08.148170 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:23:08.148170 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 3661010393d44c428fb37652b1717072 Oct 19 03:23:08.148170 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-SecurityGroupsTestJSON-637911912-project Oct 19 03:23:08.148170 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:23:08.148170 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance bb7dc549-597e-4568-8ab7-768654c73278 could not be found. Oct 19 03:23:08.148170 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': 'bb7dc549-597e-4568-8ab7-768654c73278'} Oct 19 03:23:08.148845 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:23:08.148845 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:23:08.148845 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:23:08.148845 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:23:08.148845 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:23:08.148845 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:23:08.148845 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:23:08.148845 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:23:08.148845 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:23:08.148845 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:23:08.148845 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb7dc549-597e-4568-8ab7-768654c73278 could not be found. Oct 19 03:23:08.148845 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:23:08.148845 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:23:08.148845 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:23:08.148845 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:23:08.148845 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:23:08.148845 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:23:08.148845 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:23:08.148845 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:23:08.148845 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:23:08.149976 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:23:08.149976 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:23:08.149976 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:23:08.149976 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:23:08.149976 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:23:08.149976 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:23:08.149976 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:23:08.149976 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb7dc549-597e-4568-8ab7-768654c73278 could not be found. Oct 19 03:23:08.149976 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:23:08.149976 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:23:08.149976 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:23:08.149976 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:23:08.149976 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:23:08.149976 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:23:08.149976 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:23:08.149976 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:23:08.149976 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb7dc549-597e-4568-8ab7-768654c73278 could not be found. Oct 19 03:23:08.149976 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:23:08.151061 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b7e0c4f7-068a-4152-be36-b30963ec4d7c tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Returning 404 to user: Instance bb7dc549-597e-4568-8ab7-768654c73278 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:23:08.151061 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b7e0c4f7-068a-4152-be36-b30963ec4d7c tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] 10.222.0.52 "GET /compute/v2.1/servers/bb7dc549-597e-4568-8ab7-768654c73278" status: 404 len: 111 microversion: 2.1 time: 0.045345 Oct 19 03:23:08.152429 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1343/2651] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:23:08 2022] GET /compute/v2.1/servers/bb7dc549-597e-4568-8ab7-768654c73278 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:23:08.236878 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-a6877c64-621d-43af-af01-d327fc7b53b3 req-54b66028-3379-4742-86b3-e71eb7164d72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "410116db-4d00-4a9d-8375-a5cea6a0d627", "name": "network-vif-unplugged", "status": "completed", "tag": "c7f441d5-a985-4c81-97b8-114d47006d03"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:23:08.255590 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-a6877c64-621d-43af-af01-d327fc7b53b3 req-54b66028-3379-4742-86b3-e71eb7164d72 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:08.259943 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-28817915-a093-4f89-b649-06291fcef974 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.707736 Oct 19 03:23:08.261182 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-a6877c64-621d-43af-af01-d327fc7b53b3 req-54b66028-3379-4742-86b3-e71eb7164d72 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:08.264995 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1309/2652] 10.222.0.52 () {62 vars in 1188 bytes} [Wed Oct 19 03:23:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 713 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 19 03:23:08.271224 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-a6877c64-621d-43af-af01-d327fc7b53b3 req-54b66028-3379-4742-86b3-e71eb7164d72 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:08.273011 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7d69ec96-7728-4fcb-9752-f3aa4e738803 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Calling method '.version_select at 0x7fc1301be4c0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:23:08.287142 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-a6877c64-621d-43af-af01-d327fc7b53b3 req-54b66028-3379-4742-86b3-e71eb7164d72 service nova] Creating event network-vif-unplugged:c7f441d5-a985-4c81-97b8-114d47006d03 for instance 410116db-4d00-4a9d-8375-a5cea6a0d627 on n-h2-861333-8 Oct 19 03:23:08.293538 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-a6877c64-621d-43af-af01-d327fc7b53b3 req-54b66028-3379-4742-86b3-e71eb7164d72 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.140084 Oct 19 03:23:08.294807 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1344/2653] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:23:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:23:08.300724 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5060ea9a-f123-40b6-95cf-90e1627c6f5a tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:23:08.302978 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-5060ea9a-f123-40b6-95cf-90e1627c6f5a tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] [instance: 60eb0d03-428c-4c76-a608-1a86e9271839] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:23:08.440088 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-5060ea9a-f123-40b6-95cf-90e1627c6f5a tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1ff892953e478b814922c82cc108a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e10c25837184a3983c67f2da5fe74b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:23:08.452027 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-5060ea9a-f123-40b6-95cf-90e1627c6f5a tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e1ff892953e478b814922c82cc108a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e10c25837184a3983c67f2da5fe74b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:23:08.455153 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-5060ea9a-f123-40b6-95cf-90e1627c6f5a tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e1ff892953e478b814922c82cc108a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e10c25837184a3983c67f2da5fe74b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:23:08.458839 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5060ea9a-f123-40b6-95cf-90e1627c6f5a tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] 10.222.0.52 "GET /compute/v2.1/servers/60eb0d03-428c-4c76-a608-1a86e9271839" status: 200 len: 1278 microversion: 2.47 time: 0.160109 Oct 19 03:23:08.483984 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1345/2654] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:23:08 2022] GET /compute/v2.1/servers/60eb0d03-428c-4c76-a608-1a86e9271839 => generated 1278 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:23:08.549508 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f9137ffe-68d2-4a7d-824b-2a971c8e5218 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Calling method '.version_select at 0x7fc1301b84c0>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:23:08.653659 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f9137ffe-68d2-4a7d-824b-2a971c8e5218 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] 10.222.0.52 "GET /compute/v2.1/images/c09f0682-cee7-4a5b-a32d-5b6db22a1d38" status: 200 len: 1455 microversion: 2.1 time: 0.109381 Oct 19 03:23:08.654244 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1346/2655] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:23:08 2022] GET /compute/v2.1/images/c09f0682-cee7-4a5b-a32d-5b6db22a1d38 => generated 1455 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:23:08.659797 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e748a787-eda6-4c18-bbb3-fce34fac14b5 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1035285984", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "networks": "none"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:23:08.721451 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-e748a787-eda6-4c18-bbb3-fce34fac14b5 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Flavor limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:23:08.722054 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-e748a787-eda6-4c18-bbb3-fce34fac14b5 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Image limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:23:08.724934 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-e748a787-eda6-4c18-bbb3-fce34fac14b5 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Flavor pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:23:08.728009 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-e748a787-eda6-4c18-bbb3-fce34fac14b5 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Image pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:23:08.728785 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-e748a787-eda6-4c18-bbb3-fce34fac14b5 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:23:08.742397 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e748a787-eda6-4c18-bbb3-fce34fac14b5 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:08.743182 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e748a787-eda6-4c18-bbb3-fce34fac14b5 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:08.743811 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e748a787-eda6-4c18-bbb3-fce34fac14b5 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:08.744771 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e748a787-eda6-4c18-bbb3-fce34fac14b5 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:08.745443 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e748a787-eda6-4c18-bbb3-fce34fac14b5 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:08.746065 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e748a787-eda6-4c18-bbb3-fce34fac14b5 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:08.796398 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-e748a787-eda6-4c18-bbb3-fce34fac14b5 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Getting quotas for project 6e10c25837184a3983c67f2da5fe74b3. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:23:08.811418 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-e748a787-eda6-4c18-bbb3-fce34fac14b5 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Getting quotas for user 8e1ff892953e478b814922c82cc108a3 and project 6e10c25837184a3983c67f2da5fe74b3. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:23:08.816189 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:23:08.827845 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e748a787-eda6-4c18-bbb3-fce34fac14b5 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Going to run 1 instances... {{(pid=121135) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:23:08.830506 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e748a787-eda6-4c18-bbb3-fce34fac14b5 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] [instance: 24678d1b-08b3-4475-aaed-a33d8eed0923] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121135) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:23:08.975886 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e748a787-eda6-4c18-bbb3-fce34fac14b5 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.319984 Oct 19 03:23:08.984476 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1347/2656] 10.222.0.52 () {62 vars in 1188 bytes} [Wed Oct 19 03:23:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 329 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 19 03:23:08.990867 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7b318bc7-21c7-4527-83b4-73e614660d39 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:23:08.997825 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7b318bc7-21c7-4527-83b4-73e614660d39 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] [instance: 24678d1b-08b3-4475-aaed-a33d8eed0923] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:23:09.045915 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7b318bc7-21c7-4527-83b4-73e614660d39 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] 10.222.0.52 "PUT /compute/v2.1/servers/24678d1b-08b3-4475-aaed-a33d8eed0923" status: 200 len: 992 microversion: 2.47 time: 0.059087 Oct 19 03:23:09.046939 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1348/2657] 10.222.0.52 () {62 vars in 1297 bytes} [Wed Oct 19 03:23:08 2022] PUT /compute/v2.1/servers/24678d1b-08b3-4475-aaed-a33d8eed0923 => generated 992 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 03:23:09.069339 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-db501a9e-5436-48a3-9603-e39d1056d30c tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:23:09.070820 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-db501a9e-5436-48a3-9603-e39d1056d30c tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] [instance: 24678d1b-08b3-4475-aaed-a33d8eed0923] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:23:09.275578 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-db501a9e-5436-48a3-9603-e39d1056d30c tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1ff892953e478b814922c82cc108a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e10c25837184a3983c67f2da5fe74b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:23:09.287399 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-db501a9e-5436-48a3-9603-e39d1056d30c tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e1ff892953e478b814922c82cc108a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e10c25837184a3983c67f2da5fe74b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:23:09.287399 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-db501a9e-5436-48a3-9603-e39d1056d30c tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e1ff892953e478b814922c82cc108a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e10c25837184a3983c67f2da5fe74b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:23:09.287399 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-db501a9e-5436-48a3-9603-e39d1056d30c tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] 10.222.0.52 "GET /compute/v2.1/servers/24678d1b-08b3-4475-aaed-a33d8eed0923" status: 200 len: 1278 microversion: 2.47 time: 0.222205 Oct 19 03:23:09.294352 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1349/2658] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:23:09 2022] GET /compute/v2.1/servers/24678d1b-08b3-4475-aaed-a33d8eed0923 => generated 1278 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:23:09.300737 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7ae02654-416f-4ece-87e2-6ee2f0d62943 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:23:09.301677 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7ae02654-416f-4ece-87e2-6ee2f0d62943 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: c45890de-f7bf-4736-8b08-6f3e6863e2b3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:23:09.311360 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7ae02654-416f-4ece-87e2-6ee2f0d62943 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:09.312064 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7ae02654-416f-4ece-87e2-6ee2f0d62943 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:09.312663 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7ae02654-416f-4ece-87e2-6ee2f0d62943 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:09.313798 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7ae02654-416f-4ece-87e2-6ee2f0d62943 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:09.314465 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7ae02654-416f-4ece-87e2-6ee2f0d62943 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:09.315627 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7ae02654-416f-4ece-87e2-6ee2f0d62943 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:09.409852 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7d69ec96-7728-4fcb-9752-f3aa4e738803 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/e4da6f5b-5c5b-4fbd-8abc-32a3d8564e88" status: 202 len: 0 microversion: 2.1 time: 1.143379 Oct 19 03:23:09.410982 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1310/2659] 10.222.0.52 () {58 vars in 1272 bytes} [Wed Oct 19 03:23:08 2022] DELETE /compute/v2.1/os-security-groups/e4da6f5b-5c5b-4fbd-8abc-32a3d8564e88 => generated 0 bytes in 1145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:23:09.419500 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f3a5df82-4bb7-4ae9-9949-65a9716c43a0 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Calling method '.version_select at 0x7fc13043f670>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:23:09.622921 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7ae02654-416f-4ece-87e2-6ee2f0d62943 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:23:09.637893 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7ae02654-416f-4ece-87e2-6ee2f0d62943 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/c45890de-f7bf-4736-8b08-6f3e6863e2b3" status: 200 len: 1497 microversion: 2.1 time: 0.341663 Oct 19 03:23:09.655362 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1350/2660] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:23:09 2022] GET /compute/v2.1/servers/c45890de-f7bf-4736-8b08-6f3e6863e2b3 => generated 1497 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:23:09.690078 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3e026642-e472-45d3-9e6f-d6ee27cd2aa8 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Calling method '.version_select at 0x7fc1301b8d30>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:23:09.787891 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-3e026642-e472-45d3-9e6f-d6ee27cd2aa8 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] 10.222.0.52 "GET /compute/v2.1/images/c09f0682-cee7-4a5b-a32d-5b6db22a1d38" status: 200 len: 1455 microversion: 2.1 time: 0.119436 Oct 19 03:23:09.807028 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1351/2661] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:23:09 2022] GET /compute/v2.1/images/c09f0682-cee7-4a5b-a32d-5b6db22a1d38 => generated 1455 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:23:10.117714 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f3a5df82-4bb7-4ae9-9949-65a9716c43a0 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/d57db41a-f3fe-4805-a71f-7bcef9ca64bf" status: 202 len: 0 microversion: 2.1 time: 0.700067 Oct 19 03:23:10.120193 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1311/2662] 10.222.0.52 () {58 vars in 1272 bytes} [Wed Oct 19 03:23:09 2022] DELETE /compute/v2.1/os-security-groups/d57db41a-f3fe-4805-a71f-7bcef9ca64bf => generated 0 bytes in 705 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:23:10.137704 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4b1621a5-5ce3-4b1e-a82b-a7dd46dfdce5 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Action: 'create', calling method: .version_select at 0x7fc130207430>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2064065604", "description": "tempest-description-1493228280"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:23:10.313441 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a1663a46-10f4-45ee-87b0-c2b57fb8ca1a tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:23:10.319228 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a1663a46-10f4-45ee-87b0-c2b57fb8ca1a tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] [instance: 24678d1b-08b3-4475-aaed-a33d8eed0923] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:23:10.403466 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a1663a46-10f4-45ee-87b0-c2b57fb8ca1a tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1ff892953e478b814922c82cc108a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e10c25837184a3983c67f2da5fe74b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:23:10.412450 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a1663a46-10f4-45ee-87b0-c2b57fb8ca1a tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e1ff892953e478b814922c82cc108a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e10c25837184a3983c67f2da5fe74b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:23:10.414915 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a1663a46-10f4-45ee-87b0-c2b57fb8ca1a tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e1ff892953e478b814922c82cc108a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e10c25837184a3983c67f2da5fe74b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:23:10.416090 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a1663a46-10f4-45ee-87b0-c2b57fb8ca1a tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] 10.222.0.52 "GET /compute/v2.1/servers/24678d1b-08b3-4475-aaed-a33d8eed0923" status: 200 len: 1278 microversion: 2.47 time: 0.108028 Oct 19 03:23:10.416666 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1312/2663] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:23:10 2022] GET /compute/v2.1/servers/24678d1b-08b3-4475-aaed-a33d8eed0923 => generated 1278 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:23:10.668783 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a1c6c529-366e-4b5f-8781-fb2d37c09b32 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:23:10.673020 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a1c6c529-366e-4b5f-8781-fb2d37c09b32 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: c45890de-f7bf-4736-8b08-6f3e6863e2b3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:23:10.691026 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a1c6c529-366e-4b5f-8781-fb2d37c09b32 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:10.694087 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a1c6c529-366e-4b5f-8781-fb2d37c09b32 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:10.696922 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a1c6c529-366e-4b5f-8781-fb2d37c09b32 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:10.700920 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a1c6c529-366e-4b5f-8781-fb2d37c09b32 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:10.701835 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a1c6c529-366e-4b5f-8781-fb2d37c09b32 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:10.715510 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a1c6c529-366e-4b5f-8781-fb2d37c09b32 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:11.220074 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4b1621a5-5ce3-4b1e-a82b-a7dd46dfdce5 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 1.086853 Oct 19 03:23:11.223382 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1352/2664] 10.222.0.52 () {60 vars in 1180 bytes} [Wed Oct 19 03:23:10 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:23:11.240178 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7e373741-de12-431b-921a-eb2c0326939f tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Calling method '.version_select at 0x7fc1301d7430>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:23:11.319895 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a1c6c529-366e-4b5f-8781-fb2d37c09b32 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:23:11.331693 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a1c6c529-366e-4b5f-8781-fb2d37c09b32 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/c45890de-f7bf-4736-8b08-6f3e6863e2b3" status: 200 len: 1497 microversion: 2.1 time: 0.666681 Oct 19 03:23:11.332667 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1313/2665] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:23:10 2022] GET /compute/v2.1/servers/c45890de-f7bf-4736-8b08-6f3e6863e2b3 => generated 1497 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:23:11.339016 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-104f8acc-2b82-4c07-810b-05e3b1dbd27f tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Action: 'update', calling method: .version_select at 0x7fc13014fd30>, body: {"security_group": {"name": "tempest-sg-hth-1076717859", "description": "tempest-description-hth-822427414"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:23:11.350269 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7e373741-de12-431b-921a-eb2c0326939f tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] 10.222.0.52 "GET /compute/v2.1/images/c09f0682-cee7-4a5b-a32d-5b6db22a1d38" status: 200 len: 1455 microversion: 2.1 time: 0.125272 Oct 19 03:23:11.352447 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1353/2666] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:23:11 2022] GET /compute/v2.1/images/c09f0682-cee7-4a5b-a32d-5b6db22a1d38 => generated 1455 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:23:11.447068 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c179b216-197b-46cd-8222-1bb2ad77ebea tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:23:11.447769 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c179b216-197b-46cd-8222-1bb2ad77ebea tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] [instance: 24678d1b-08b3-4475-aaed-a33d8eed0923] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:23:11.458590 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c179b216-197b-46cd-8222-1bb2ad77ebea tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:11.461678 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c179b216-197b-46cd-8222-1bb2ad77ebea tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:11.462346 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c179b216-197b-46cd-8222-1bb2ad77ebea tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:11.463297 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c179b216-197b-46cd-8222-1bb2ad77ebea tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:11.465909 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c179b216-197b-46cd-8222-1bb2ad77ebea tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:11.468905 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c179b216-197b-46cd-8222-1bb2ad77ebea tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:11.627398 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c179b216-197b-46cd-8222-1bb2ad77ebea tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1ff892953e478b814922c82cc108a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e10c25837184a3983c67f2da5fe74b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:23:11.644984 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c179b216-197b-46cd-8222-1bb2ad77ebea tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e1ff892953e478b814922c82cc108a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e10c25837184a3983c67f2da5fe74b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:23:11.647761 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c179b216-197b-46cd-8222-1bb2ad77ebea tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e1ff892953e478b814922c82cc108a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e10c25837184a3983c67f2da5fe74b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:23:11.651596 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c179b216-197b-46cd-8222-1bb2ad77ebea tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] 10.222.0.52 "GET /compute/v2.1/servers/24678d1b-08b3-4475-aaed-a33d8eed0923" status: 200 len: 1274 microversion: 2.47 time: 0.208903 Oct 19 03:23:11.654064 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1354/2667] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:23:11 2022] GET /compute/v2.1/servers/24678d1b-08b3-4475-aaed-a33d8eed0923 => generated 1274 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:23:11.940580 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-104f8acc-2b82-4c07-810b-05e3b1dbd27f tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] 10.222.0.52 "PUT /compute/v2.1/os-security-groups/8b364f0b-c449-4cfe-870c-4f58a7f5f8a9" status: 200 len: 217 microversion: 2.1 time: 0.597816 Oct 19 03:23:11.940580 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1314/2668] 10.222.0.52 () {60 vars in 1290 bytes} [Wed Oct 19 03:23:11 2022] PUT /compute/v2.1/os-security-groups/8b364f0b-c449-4cfe-870c-4f58a7f5f8a9 => generated 217 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:23:11.948799 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2645c295-23fd-45ba-bd5f-1b32f88998d4 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Calling method '.version_select at 0x7fc1301e3ca0>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:23:12.176406 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2645c295-23fd-45ba-bd5f-1b32f88998d4 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] 10.222.0.52 "GET /compute/v2.1/os-security-groups/8b364f0b-c449-4cfe-870c-4f58a7f5f8a9" status: 200 len: 217 microversion: 2.1 time: 0.231876 Oct 19 03:23:12.187087 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1355/2669] 10.222.0.52 () {58 vars in 1269 bytes} [Wed Oct 19 03:23:11 2022] GET /compute/v2.1/os-security-groups/8b364f0b-c449-4cfe-870c-4f58a7f5f8a9 => generated 217 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:23:12.191635 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9a741af1-3b63-41f9-ab85-4091b95b8616 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Calling method '.version_select at 0x7fc1301be670>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:23:12.355941 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0745b4dc-9cf7-4187-aa7d-dabfc1978d9c tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:23:12.357294 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0745b4dc-9cf7-4187-aa7d-dabfc1978d9c tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: c45890de-f7bf-4736-8b08-6f3e6863e2b3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:23:12.372376 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0745b4dc-9cf7-4187-aa7d-dabfc1978d9c tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:12.374189 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0745b4dc-9cf7-4187-aa7d-dabfc1978d9c tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:12.375271 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0745b4dc-9cf7-4187-aa7d-dabfc1978d9c tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:12.376427 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0745b4dc-9cf7-4187-aa7d-dabfc1978d9c tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:12.381436 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0745b4dc-9cf7-4187-aa7d-dabfc1978d9c tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:12.382728 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0745b4dc-9cf7-4187-aa7d-dabfc1978d9c tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:13.594442 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-0745b4dc-9cf7-4187-aa7d-dabfc1978d9c tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:23:13.610857 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0745b4dc-9cf7-4187-aa7d-dabfc1978d9c tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/c45890de-f7bf-4736-8b08-6f3e6863e2b3" status: 200 len: 1497 microversion: 2.1 time: 1.258487 Oct 19 03:23:13.612312 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1356/2670] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:23:12 2022] GET /compute/v2.1/servers/c45890de-f7bf-4736-8b08-6f3e6863e2b3 => generated 1497 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:23:13.622937 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d073fd4c-c892-4dfa-84e1-119862661965 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Calling method '.version_select at 0x7fc1301e3700>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:23:13.708965 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d073fd4c-c892-4dfa-84e1-119862661965 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] 10.222.0.52 "GET /compute/v2.1/images/c09f0682-cee7-4a5b-a32d-5b6db22a1d38" status: 200 len: 1455 microversion: 2.1 time: 0.095195 Oct 19 03:23:13.709848 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1357/2671] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:23:13 2022] GET /compute/v2.1/images/c09f0682-cee7-4a5b-a32d-5b6db22a1d38 => generated 1455 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:23:13.718263 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-cb77db78-a7be-474e-a2cf-8e45f4955364 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:23:13.733912 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-cb77db78-a7be-474e-a2cf-8e45f4955364 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] [instance: 24678d1b-08b3-4475-aaed-a33d8eed0923] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:23:13.740882 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cb77db78-a7be-474e-a2cf-8e45f4955364 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:13.741408 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cb77db78-a7be-474e-a2cf-8e45f4955364 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:13.741866 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cb77db78-a7be-474e-a2cf-8e45f4955364 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:13.742591 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cb77db78-a7be-474e-a2cf-8e45f4955364 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:13.743056 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cb77db78-a7be-474e-a2cf-8e45f4955364 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:13.743486 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cb77db78-a7be-474e-a2cf-8e45f4955364 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:13.964955 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-cb77db78-a7be-474e-a2cf-8e45f4955364 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1ff892953e478b814922c82cc108a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e10c25837184a3983c67f2da5fe74b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:23:13.980076 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-cb77db78-a7be-474e-a2cf-8e45f4955364 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e1ff892953e478b814922c82cc108a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e10c25837184a3983c67f2da5fe74b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:23:13.984551 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-cb77db78-a7be-474e-a2cf-8e45f4955364 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e1ff892953e478b814922c82cc108a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e10c25837184a3983c67f2da5fe74b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:23:13.989154 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-cb77db78-a7be-474e-a2cf-8e45f4955364 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] 10.222.0.52 "GET /compute/v2.1/servers/24678d1b-08b3-4475-aaed-a33d8eed0923" status: 200 len: 1338 microversion: 2.47 time: 0.275480 Oct 19 03:23:13.990572 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1358/2672] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:23:13 2022] GET /compute/v2.1/servers/24678d1b-08b3-4475-aaed-a33d8eed0923 => generated 1338 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:23:14.548435 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9a741af1-3b63-41f9-ab85-4091b95b8616 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/8b364f0b-c449-4cfe-870c-4f58a7f5f8a9" status: 202 len: 0 microversion: 2.1 time: 2.360797 Oct 19 03:23:14.552664 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1315/2673] 10.222.0.52 () {58 vars in 1272 bytes} [Wed Oct 19 03:23:12 2022] DELETE /compute/v2.1/os-security-groups/8b364f0b-c449-4cfe-870c-4f58a7f5f8a9 => generated 0 bytes in 2366 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 19 03:23:14.559795 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b670ac26-41ef-4fad-bccb-58e80268f342 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:23:14.560171 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b670ac26-41ef-4fad-bccb-58e80268f342 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] [instance: bb7dc549-597e-4568-8ab7-768654c73278] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:23:14.567746 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b670ac26-41ef-4fad-bccb-58e80268f342 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:14.568425 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b670ac26-41ef-4fad-bccb-58e80268f342 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:14.569021 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b670ac26-41ef-4fad-bccb-58e80268f342 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:14.569992 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b670ac26-41ef-4fad-bccb-58e80268f342 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:14.570792 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b670ac26-41ef-4fad-bccb-58e80268f342 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:14.571376 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b670ac26-41ef-4fad-bccb-58e80268f342 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:14.597180 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-b670ac26-41ef-4fad-bccb-58e80268f342 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] HTTP exception thrown: Instance bb7dc549-597e-4568-8ab7-768654c73278 could not be found. Oct 19 03:23:14.598981 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b670ac26-41ef-4fad-bccb-58e80268f342 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Request method failure captured: Oct 19 03:23:14.598981 n-d-861333-8 devstack@n-api.service[121135]: request: DELETE /compute/v2.1/servers/bb7dc549-597e-4568-8ab7-768654c73278 HTTP/1.1 Oct 19 03:23:14.598981 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:23:14.598981 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:23:14.598981 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:23:14.598981 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:23:14.598981 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:23:14.598981 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:23:14.598981 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:23:14.598981 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:23:14.598981 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT200KvQGsyi_a_sB4TfhhJOzMfG19jSa6oSlia6bg0oJGWsETmIFLMxsrnEQMCxFlXYpeXPwW52kFxfganN5M4cxj3tahAijx2xJ--2WsWYJtuNU3tc5IIgL3W8HC4CGP3frn8iROEzLPCi1mQC1-zUvq06vNZR4ARbYNlrlnvumYqI Oct 19 03:23:14.598981 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:23:14.598981 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:23:14.598981 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:23:14.598981 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:23:14.598981 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:23:14.598981 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:23:14.598981 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 385a1e7cceff48798bfefb9390e5979c Oct 19 03:23:14.598981 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-SecurityGroupsTestJSON-637911912 Oct 19 03:23:14.598981 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:23:14.598981 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:23:14.600537 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/385a1e7cceff48798bfefb9390e5979c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/385a1e7cceff48798bfefb9390e5979c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/385a1e7cceff48798bfefb9390e5979c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_385a1e7cceff48798bfefb9390e5979c", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:23:14.600537 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-SecurityGroupsTestJSON-637911912 Oct 19 03:23:14.600537 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 385a1e7cceff48798bfefb9390e5979c Oct 19 03:23:14.600537 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-637911912 Oct 19 03:23:14.600537 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-SecurityGroupsTestJSON-637911912-project Oct 19 03:23:14.600537 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:23:14.600537 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:23:14.600537 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 3661010393d44c428fb37652b1717072 Oct 19 03:23:14.600537 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-SecurityGroupsTestJSON-637911912-project Oct 19 03:23:14.600537 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:23:14.600537 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance bb7dc549-597e-4568-8ab7-768654c73278 could not be found. Oct 19 03:23:14.600537 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': 'bb7dc549-597e-4568-8ab7-768654c73278'} Oct 19 03:23:14.601399 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:23:14.601399 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:23:14.601399 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:23:14.601399 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:23:14.601399 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:23:14.601399 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:23:14.601399 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:23:14.601399 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:23:14.601399 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:23:14.601399 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:23:14.601399 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb7dc549-597e-4568-8ab7-768654c73278 could not be found. Oct 19 03:23:14.601399 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:23:14.601399 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:23:14.601399 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:23:14.601399 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:23:14.601399 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:23:14.601399 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:23:14.601399 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:23:14.601399 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:23:14.601399 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:23:14.602743 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:23:14.602743 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 03:23:14.602743 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 03:23:14.602743 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 03:23:14.602743 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 03:23:14.602743 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:23:14.602743 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:23:14.602743 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:23:14.602743 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:23:14.602743 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb7dc549-597e-4568-8ab7-768654c73278 could not be found. Oct 19 03:23:14.602743 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:23:14.602743 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:23:14.602743 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:23:14.602743 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:23:14.602743 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:23:14.602743 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:23:14.602743 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:23:14.602743 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:23:14.602743 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb7dc549-597e-4568-8ab7-768654c73278 could not be found. Oct 19 03:23:14.602743 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:23:14.604074 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b670ac26-41ef-4fad-bccb-58e80268f342 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Returning 404 to user: Instance bb7dc549-597e-4568-8ab7-768654c73278 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:23:14.604074 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b670ac26-41ef-4fad-bccb-58e80268f342 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] 10.222.0.52 "DELETE /compute/v2.1/servers/bb7dc549-597e-4568-8ab7-768654c73278" status: 404 len: 111 microversion: 2.1 time: 0.044752 Oct 19 03:23:14.621841 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-bab6f385-eed2-478b-a86b-9cfd30da8b06 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:23:14.621841 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-bab6f385-eed2-478b-a86b-9cfd30da8b06 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] [instance: bb7dc549-597e-4568-8ab7-768654c73278] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:23:14.623088 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1359/2674] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:23:14 2022] DELETE /compute/v2.1/servers/bb7dc549-597e-4568-8ab7-768654c73278 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:23:14.626220 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bab6f385-eed2-478b-a86b-9cfd30da8b06 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:14.626719 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bab6f385-eed2-478b-a86b-9cfd30da8b06 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:14.627157 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bab6f385-eed2-478b-a86b-9cfd30da8b06 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:14.628043 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bab6f385-eed2-478b-a86b-9cfd30da8b06 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:14.628718 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bab6f385-eed2-478b-a86b-9cfd30da8b06 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:14.629449 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bab6f385-eed2-478b-a86b-9cfd30da8b06 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:14.641138 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d75640ae-966a-450f-88f8-9441870a763f tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:23:14.650258 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d75640ae-966a-450f-88f8-9441870a763f tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: c45890de-f7bf-4736-8b08-6f3e6863e2b3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:23:14.652335 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d75640ae-966a-450f-88f8-9441870a763f tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:14.653023 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d75640ae-966a-450f-88f8-9441870a763f tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:14.653670 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d75640ae-966a-450f-88f8-9441870a763f tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:14.658570 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d75640ae-966a-450f-88f8-9441870a763f tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:14.659300 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d75640ae-966a-450f-88f8-9441870a763f tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:14.659924 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d75640ae-966a-450f-88f8-9441870a763f tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:14.673096 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-bab6f385-eed2-478b-a86b-9cfd30da8b06 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] HTTP exception thrown: Instance bb7dc549-597e-4568-8ab7-768654c73278 could not be found. Oct 19 03:23:14.675163 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-bab6f385-eed2-478b-a86b-9cfd30da8b06 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Request method failure captured: Oct 19 03:23:14.675163 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/bb7dc549-597e-4568-8ab7-768654c73278 HTTP/1.1 Oct 19 03:23:14.675163 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:23:14.675163 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:23:14.675163 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:23:14.675163 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:23:14.675163 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:23:14.675163 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:23:14.675163 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:23:14.675163 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:23:14.675163 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT200KvQGsyi_a_sB4TfhhJOzMfG19jSa6oSlia6bg0oJGWsETmIFLMxsrnEQMCxFlXYpeXPwW52kFxfganN5M4cxj3tahAijx2xJ--2WsWYJtuNU3tc5IIgL3W8HC4CGP3frn8iROEzLPCi1mQC1-zUvq06vNZR4ARbYNlrlnvumYqI Oct 19 03:23:14.675163 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:23:14.675163 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:23:14.675163 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:23:14.675163 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:23:14.675163 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:23:14.675163 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:23:14.675163 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 385a1e7cceff48798bfefb9390e5979c Oct 19 03:23:14.675163 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-SecurityGroupsTestJSON-637911912 Oct 19 03:23:14.675163 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:23:14.675163 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:23:14.676456 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/385a1e7cceff48798bfefb9390e5979c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/385a1e7cceff48798bfefb9390e5979c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/385a1e7cceff48798bfefb9390e5979c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_385a1e7cceff48798bfefb9390e5979c", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:23:14.676456 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-SecurityGroupsTestJSON-637911912 Oct 19 03:23:14.676456 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 385a1e7cceff48798bfefb9390e5979c Oct 19 03:23:14.676456 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-637911912 Oct 19 03:23:14.676456 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-SecurityGroupsTestJSON-637911912-project Oct 19 03:23:14.676456 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:23:14.676456 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:23:14.676456 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 3661010393d44c428fb37652b1717072 Oct 19 03:23:14.676456 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-SecurityGroupsTestJSON-637911912-project Oct 19 03:23:14.676456 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:23:14.676456 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance bb7dc549-597e-4568-8ab7-768654c73278 could not be found. Oct 19 03:23:14.676456 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': 'bb7dc549-597e-4568-8ab7-768654c73278'} Oct 19 03:23:14.677119 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:23:14.677119 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:23:14.677119 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:23:14.677119 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:23:14.677119 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:23:14.677119 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:23:14.677119 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:23:14.677119 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:23:14.677119 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:23:14.677119 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:23:14.677119 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb7dc549-597e-4568-8ab7-768654c73278 could not be found. Oct 19 03:23:14.677119 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:23:14.677119 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:23:14.677119 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:23:14.677119 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:23:14.677119 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:23:14.677119 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:23:14.677119 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:23:14.677119 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:23:14.677119 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:23:14.678536 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:23:14.678536 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:23:14.678536 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:23:14.678536 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:23:14.678536 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:23:14.678536 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:23:14.678536 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:23:14.678536 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb7dc549-597e-4568-8ab7-768654c73278 could not be found. Oct 19 03:23:14.678536 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:23:14.678536 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:23:14.678536 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:23:14.678536 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:23:14.678536 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:23:14.678536 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:23:14.678536 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:23:14.678536 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:23:14.678536 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb7dc549-597e-4568-8ab7-768654c73278 could not be found. Oct 19 03:23:14.678536 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:23:14.684650 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-bab6f385-eed2-478b-a86b-9cfd30da8b06 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Returning 404 to user: Instance bb7dc549-597e-4568-8ab7-768654c73278 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:23:14.685994 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-bab6f385-eed2-478b-a86b-9cfd30da8b06 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] 10.222.0.52 "GET /compute/v2.1/servers/bb7dc549-597e-4568-8ab7-768654c73278" status: 404 len: 111 microversion: 2.1 time: 0.080840 Oct 19 03:23:14.690128 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1316/2675] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:23:14 2022] GET /compute/v2.1/servers/bb7dc549-597e-4568-8ab7-768654c73278 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:23:14.700781 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b0c5f772-6f85-40f8-8d2d-1bf37fc5a323 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Calling method '.version_select at 0x7fc1300df550>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:23:14.803057 n-d-861333-8 devstack@n-api.service[121134]: DEBUG neutronclient.v2_0.client [None req-b0c5f772-6f85-40f8-8d2d-1bf37fc5a323 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d57db41a-f3fe-4805-a71f-7bcef9ca64bf does not exist", "detail": ""}} {{(pid=121134) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 19 03:23:14.805803 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.security_group_api [None req-b0c5f772-6f85-40f8-8d2d-1bf37fc5a323 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Neutron security group d57db41a-f3fe-4805-a71f-7bcef9ca64bf not found {{(pid=121134) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 19 03:23:14.806592 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-b0c5f772-6f85-40f8-8d2d-1bf37fc5a323 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] HTTP exception thrown: Security group d57db41a-f3fe-4805-a71f-7bcef9ca64bf does not exist Oct 19 03:23:14.806592 n-d-861333-8 devstack@n-api.service[121134]: Neutron server returns request_ids: ['req-181f79b7-ad3c-407d-9968-90a4a5c85f7b'] Oct 19 03:23:14.809461 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b0c5f772-6f85-40f8-8d2d-1bf37fc5a323 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Request method failure captured: Oct 19 03:23:14.809461 n-d-861333-8 devstack@n-api.service[121134]: request: DELETE /compute/v2.1/os-security-groups/d57db41a-f3fe-4805-a71f-7bcef9ca64bf HTTP/1.1 Oct 19 03:23:14.809461 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:23:14.809461 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:23:14.809461 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:23:14.809461 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:23:14.809461 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:23:14.809461 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:23:14.809461 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:23:14.809461 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:23:14.809461 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT200KvQGsyi_a_sB4TfhhJOzMfG19jSa6oSlia6bg0oJGWsETmIFLMxsrnEQMCxFlXYpeXPwW52kFxfganN5M4cxj3tahAijx2xJ--2WsWYJtuNU3tc5IIgL3W8HC4CGP3frn8iROEzLPCi1mQC1-zUvq06vNZR4ARbYNlrlnvumYqI Oct 19 03:23:14.809461 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:23:14.809461 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:23:14.809461 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:23:14.809461 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:23:14.809461 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:23:14.809461 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:23:14.809461 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 385a1e7cceff48798bfefb9390e5979c Oct 19 03:23:14.809461 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-SecurityGroupsTestJSON-637911912 Oct 19 03:23:14.809461 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:23:14.809461 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:23:14.810849 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/385a1e7cceff48798bfefb9390e5979c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/385a1e7cceff48798bfefb9390e5979c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/385a1e7cceff48798bfefb9390e5979c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_385a1e7cceff48798bfefb9390e5979c", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:23:14.810849 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-SecurityGroupsTestJSON-637911912 Oct 19 03:23:14.810849 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 385a1e7cceff48798bfefb9390e5979c Oct 19 03:23:14.810849 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-637911912 Oct 19 03:23:14.810849 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-SecurityGroupsTestJSON-637911912-project Oct 19 03:23:14.810849 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:23:14.810849 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:23:14.810849 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 3661010393d44c428fb37652b1717072 Oct 19 03:23:14.810849 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-SecurityGroupsTestJSON-637911912-project Oct 19 03:23:14.810849 n-d-861333-8 devstack@n-api.service[121134]: method: Oct 19 03:23:14.810849 n-d-861333-8 devstack@n-api.service[121134]: exception: Security group d57db41a-f3fe-4805-a71f-7bcef9ca64bf does not exist Oct 19 03:23:14.810849 n-d-861333-8 devstack@n-api.service[121134]: Neutron server returns request_ids: ['req-181f79b7-ad3c-407d-9968-90a4a5c85f7b'] Oct 19 03:23:14.810849 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': 'd57db41a-f3fe-4805-a71f-7bcef9ca64bf'} Oct 19 03:23:14.812092 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:23:14.812092 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:23:14.812092 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 19 03:23:14.812092 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 19 03:23:14.812092 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:23:14.812092 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:23:14.812092 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 19 03:23:14.812092 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 19 03:23:14.812092 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:23:14.812092 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:23:14.812092 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 19 03:23:14.812092 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 19 03:23:14.812092 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:23:14.812092 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:23:14.812092 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 19 03:23:14.812092 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 19 03:23:14.812092 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:23:14.812092 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:23:14.812092 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 19 03:23:14.814067 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 19 03:23:14.814067 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:23:14.814067 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:23:14.814067 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 19 03:23:14.814067 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 19 03:23:14.814067 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 19 03:23:14.814067 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 19 03:23:14.814067 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d57db41a-f3fe-4805-a71f-7bcef9ca64bf does not exist Oct 19 03:23:14.814067 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-181f79b7-ad3c-407d-9968-90a4a5c85f7b'] Oct 19 03:23:14.814067 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:23:14.814067 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:23:14.814067 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:23:14.814067 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:23:14.814067 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 19 03:23:14.814067 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 19 03:23:14.814067 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 19 03:23:14.814067 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 19 03:23:14.814067 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d57db41a-f3fe-4805-a71f-7bcef9ca64bf does not exist Oct 19 03:23:14.816623 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-181f79b7-ad3c-407d-9968-90a4a5c85f7b'] Oct 19 03:23:14.816623 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:23:14.816623 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:23:14.816623 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:23:14.816623 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:23:14.816623 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:23:14.816623 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:23:14.816623 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:23:14.816623 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:23:14.816623 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 03:23:14.816623 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 03:23:14.816623 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:23:14.816623 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:23:14.816623 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 19 03:23:14.816623 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 19 03:23:14.816623 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d57db41a-f3fe-4805-a71f-7bcef9ca64bf does not exist Oct 19 03:23:14.816623 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-181f79b7-ad3c-407d-9968-90a4a5c85f7b'] Oct 19 03:23:14.816623 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:23:14.816623 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:23:14.816623 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:23:14.816623 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:23:14.823273 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:23:14.823273 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:23:14.823273 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:23:14.823273 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:23:14.823273 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d57db41a-f3fe-4805-a71f-7bcef9ca64bf does not exist Oct 19 03:23:14.823273 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-181f79b7-ad3c-407d-9968-90a4a5c85f7b'] Oct 19 03:23:14.823273 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:23:14.823273 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b0c5f772-6f85-40f8-8d2d-1bf37fc5a323 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Returning 404 to user: Security group d57db41a-f3fe-4805-a71f-7bcef9ca64bf does not exist Oct 19 03:23:14.823273 n-d-861333-8 devstack@n-api.service[121134]: Neutron server returns request_ids: ['req-181f79b7-ad3c-407d-9968-90a4a5c85f7b'] {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:23:14.823273 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b0c5f772-6f85-40f8-8d2d-1bf37fc5a323 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/d57db41a-f3fe-4805-a71f-7bcef9ca64bf" status: 404 len: 194 microversion: 2.1 time: 0.125302 Oct 19 03:23:14.823273 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1317/2676] 10.222.0.52 () {58 vars in 1272 bytes} [Wed Oct 19 03:23:14 2022] DELETE /compute/v2.1/os-security-groups/d57db41a-f3fe-4805-a71f-7bcef9ca64bf => generated 194 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:23:14.838938 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c128e97b-ac0e-413d-a2a6-bf24e358451f tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Calling method '.version_select at 0x7fc130129ee0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:23:14.953144 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c128e97b-ac0e-413d-a2a6-bf24e358451f tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] 10.222.0.52 "GET /compute/v2.1/images/c09f0682-cee7-4a5b-a32d-5b6db22a1d38" status: 200 len: 1455 microversion: 2.1 time: 0.127654 Oct 19 03:23:14.954385 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1318/2677] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:23:14 2022] GET /compute/v2.1/images/c09f0682-cee7-4a5b-a32d-5b6db22a1d38 => generated 1455 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:23:14.962121 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-75b499b5-cecd-459c-b127-6f3e539f304c tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Calling method '.version_select at 0x7fc1301295e0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:23:15.162318 n-d-861333-8 devstack@n-api.service[121134]: DEBUG neutronclient.v2_0.client [None req-75b499b5-cecd-459c-b127-6f3e539f304c tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group e4da6f5b-5c5b-4fbd-8abc-32a3d8564e88 does not exist", "detail": ""}} {{(pid=121134) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 19 03:23:15.163211 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.security_group_api [None req-75b499b5-cecd-459c-b127-6f3e539f304c tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Neutron security group e4da6f5b-5c5b-4fbd-8abc-32a3d8564e88 not found {{(pid=121134) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 19 03:23:15.163907 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-75b499b5-cecd-459c-b127-6f3e539f304c tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] HTTP exception thrown: Security group e4da6f5b-5c5b-4fbd-8abc-32a3d8564e88 does not exist Oct 19 03:23:15.163907 n-d-861333-8 devstack@n-api.service[121134]: Neutron server returns request_ids: ['req-683b0677-5599-42e1-aa4f-feee709f0722'] Oct 19 03:23:15.168763 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-75b499b5-cecd-459c-b127-6f3e539f304c tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Request method failure captured: Oct 19 03:23:15.168763 n-d-861333-8 devstack@n-api.service[121134]: request: DELETE /compute/v2.1/os-security-groups/e4da6f5b-5c5b-4fbd-8abc-32a3d8564e88 HTTP/1.1 Oct 19 03:23:15.168763 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:23:15.168763 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:23:15.168763 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:23:15.168763 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:23:15.168763 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:23:15.168763 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:23:15.168763 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:23:15.168763 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:23:15.168763 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT200KvQGsyi_a_sB4TfhhJOzMfG19jSa6oSlia6bg0oJGWsETmIFLMxsrnEQMCxFlXYpeXPwW52kFxfganN5M4cxj3tahAijx2xJ--2WsWYJtuNU3tc5IIgL3W8HC4CGP3frn8iROEzLPCi1mQC1-zUvq06vNZR4ARbYNlrlnvumYqI Oct 19 03:23:15.168763 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:23:15.168763 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:23:15.168763 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:23:15.168763 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:23:15.168763 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:23:15.168763 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:23:15.168763 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 385a1e7cceff48798bfefb9390e5979c Oct 19 03:23:15.168763 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-SecurityGroupsTestJSON-637911912 Oct 19 03:23:15.168763 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:23:15.168763 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:23:15.170162 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/385a1e7cceff48798bfefb9390e5979c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/385a1e7cceff48798bfefb9390e5979c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/385a1e7cceff48798bfefb9390e5979c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_385a1e7cceff48798bfefb9390e5979c", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:23:15.170162 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-SecurityGroupsTestJSON-637911912 Oct 19 03:23:15.170162 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 385a1e7cceff48798bfefb9390e5979c Oct 19 03:23:15.170162 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-637911912 Oct 19 03:23:15.170162 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-SecurityGroupsTestJSON-637911912-project Oct 19 03:23:15.170162 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:23:15.170162 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:23:15.170162 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 3661010393d44c428fb37652b1717072 Oct 19 03:23:15.170162 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-SecurityGroupsTestJSON-637911912-project Oct 19 03:23:15.170162 n-d-861333-8 devstack@n-api.service[121134]: method: Oct 19 03:23:15.170162 n-d-861333-8 devstack@n-api.service[121134]: exception: Security group e4da6f5b-5c5b-4fbd-8abc-32a3d8564e88 does not exist Oct 19 03:23:15.170162 n-d-861333-8 devstack@n-api.service[121134]: Neutron server returns request_ids: ['req-683b0677-5599-42e1-aa4f-feee709f0722'] Oct 19 03:23:15.170162 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': 'e4da6f5b-5c5b-4fbd-8abc-32a3d8564e88'} Oct 19 03:23:15.170905 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:23:15.170905 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:23:15.170905 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 19 03:23:15.170905 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 19 03:23:15.170905 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:23:15.170905 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:23:15.170905 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 19 03:23:15.170905 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 19 03:23:15.170905 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:23:15.170905 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:23:15.170905 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 19 03:23:15.170905 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 19 03:23:15.170905 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:23:15.170905 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:23:15.170905 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 19 03:23:15.170905 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 19 03:23:15.170905 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:23:15.170905 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:23:15.170905 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 19 03:23:15.172096 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 19 03:23:15.172096 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:23:15.172096 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:23:15.172096 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 19 03:23:15.172096 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 19 03:23:15.172096 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 19 03:23:15.172096 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 19 03:23:15.172096 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group e4da6f5b-5c5b-4fbd-8abc-32a3d8564e88 does not exist Oct 19 03:23:15.172096 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-683b0677-5599-42e1-aa4f-feee709f0722'] Oct 19 03:23:15.172096 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:23:15.172096 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:23:15.172096 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:23:15.172096 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:23:15.172096 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 19 03:23:15.172096 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 19 03:23:15.172096 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 19 03:23:15.172096 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 19 03:23:15.172096 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group e4da6f5b-5c5b-4fbd-8abc-32a3d8564e88 does not exist Oct 19 03:23:15.173154 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-683b0677-5599-42e1-aa4f-feee709f0722'] Oct 19 03:23:15.173154 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:23:15.173154 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:23:15.173154 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:23:15.173154 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:23:15.173154 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:23:15.173154 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:23:15.173154 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:23:15.173154 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:23:15.173154 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 03:23:15.173154 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 03:23:15.173154 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:23:15.173154 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:23:15.173154 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 19 03:23:15.173154 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 19 03:23:15.173154 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group e4da6f5b-5c5b-4fbd-8abc-32a3d8564e88 does not exist Oct 19 03:23:15.173154 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-683b0677-5599-42e1-aa4f-feee709f0722'] Oct 19 03:23:15.173154 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:23:15.173154 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:23:15.173154 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:23:15.173154 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:23:15.174286 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:23:15.174286 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:23:15.174286 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:23:15.174286 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:23:15.174286 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group e4da6f5b-5c5b-4fbd-8abc-32a3d8564e88 does not exist Oct 19 03:23:15.174286 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-683b0677-5599-42e1-aa4f-feee709f0722'] Oct 19 03:23:15.174286 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:23:15.178267 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-75b499b5-cecd-459c-b127-6f3e539f304c tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Returning 404 to user: Security group e4da6f5b-5c5b-4fbd-8abc-32a3d8564e88 does not exist Oct 19 03:23:15.178267 n-d-861333-8 devstack@n-api.service[121134]: Neutron server returns request_ids: ['req-683b0677-5599-42e1-aa4f-feee709f0722'] {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:23:15.180863 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-75b499b5-cecd-459c-b127-6f3e539f304c tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/e4da6f5b-5c5b-4fbd-8abc-32a3d8564e88" status: 404 len: 194 microversion: 2.1 time: 0.225281 Oct 19 03:23:15.181806 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1319/2678] 10.222.0.52 () {58 vars in 1272 bytes} [Wed Oct 19 03:23:14 2022] DELETE /compute/v2.1/os-security-groups/e4da6f5b-5c5b-4fbd-8abc-32a3d8564e88 => generated 194 bytes in 227 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:23:15.192983 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-89e9dd70-bfff-42fa-97c8-1046c323baa7 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:23:15.195023 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-89e9dd70-bfff-42fa-97c8-1046c323baa7 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] [instance: 24678d1b-08b3-4475-aaed-a33d8eed0923] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:23:15.211318 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-89e9dd70-bfff-42fa-97c8-1046c323baa7 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:15.214693 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-89e9dd70-bfff-42fa-97c8-1046c323baa7 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:15.215374 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-89e9dd70-bfff-42fa-97c8-1046c323baa7 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:15.216354 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-89e9dd70-bfff-42fa-97c8-1046c323baa7 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:15.217106 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-89e9dd70-bfff-42fa-97c8-1046c323baa7 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:15.217913 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-89e9dd70-bfff-42fa-97c8-1046c323baa7 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:15.353968 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-89e9dd70-bfff-42fa-97c8-1046c323baa7 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1ff892953e478b814922c82cc108a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e10c25837184a3983c67f2da5fe74b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:23:15.367138 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-89e9dd70-bfff-42fa-97c8-1046c323baa7 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e1ff892953e478b814922c82cc108a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e10c25837184a3983c67f2da5fe74b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:23:15.372413 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-89e9dd70-bfff-42fa-97c8-1046c323baa7 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e1ff892953e478b814922c82cc108a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e10c25837184a3983c67f2da5fe74b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:23:15.376469 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-89e9dd70-bfff-42fa-97c8-1046c323baa7 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] 10.222.0.52 "GET /compute/v2.1/servers/24678d1b-08b3-4475-aaed-a33d8eed0923" status: 200 len: 1336 microversion: 2.47 time: 0.193382 Oct 19 03:23:15.377273 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1320/2679] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:23:15 2022] GET /compute/v2.1/servers/24678d1b-08b3-4475-aaed-a33d8eed0923 => generated 1336 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:23:15.382283 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5c11feef-f509-4019-98fd-650d5ff7c1df tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Calling method '.version_select at 0x7fc13014fee0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:23:15.483957 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d75640ae-966a-450f-88f8-9441870a763f tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:23:15.496373 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d75640ae-966a-450f-88f8-9441870a763f tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/c45890de-f7bf-4736-8b08-6f3e6863e2b3" status: 200 len: 1497 microversion: 2.1 time: 0.860253 Oct 19 03:23:15.496949 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1360/2680] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:23:14 2022] GET /compute/v2.1/servers/c45890de-f7bf-4736-8b08-6f3e6863e2b3 => generated 1497 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:23:15.509361 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3a6a3f04-13f8-4135-b303-cb65f003ff46 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Action: 'create', calling method: .version_select at 0x7fc130ee1430>, body: {"keypair": {"name": "tempest-keypair-394842387", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIqgo7nMDdncZPFifnL0HfJbn3DuifI6ttsr4fLUxisimSUGSPsJ379yLhtJiBRAw6Ap2TJZvTUqGbWP9QCazuUwCXWXdJ6vABW4ov24Fy03XdTDdBYK/3bp0f4ZIhQJyw=="}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:23:15.523426 n-d-861333-8 devstack@n-api.service[121134]: DEBUG neutronclient.v2_0.client [None req-5c11feef-f509-4019-98fd-650d5ff7c1df tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 01df0d23-d4a3-48cc-9de5-57177768e76e does not exist", "detail": ""}} {{(pid=121134) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 19 03:23:15.524108 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.security_group_api [None req-5c11feef-f509-4019-98fd-650d5ff7c1df tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Neutron security group 01df0d23-d4a3-48cc-9de5-57177768e76e not found {{(pid=121134) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 19 03:23:15.524703 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-5c11feef-f509-4019-98fd-650d5ff7c1df tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] HTTP exception thrown: Security group 01df0d23-d4a3-48cc-9de5-57177768e76e does not exist Oct 19 03:23:15.524703 n-d-861333-8 devstack@n-api.service[121134]: Neutron server returns request_ids: ['req-f49988d4-80de-42e3-a134-1419b271ac86'] Oct 19 03:23:15.526712 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5c11feef-f509-4019-98fd-650d5ff7c1df tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Request method failure captured: Oct 19 03:23:15.526712 n-d-861333-8 devstack@n-api.service[121134]: request: DELETE /compute/v2.1/os-security-groups/01df0d23-d4a3-48cc-9de5-57177768e76e HTTP/1.1 Oct 19 03:23:15.526712 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:23:15.526712 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:23:15.526712 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:23:15.526712 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:23:15.526712 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:23:15.526712 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:23:15.526712 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:23:15.526712 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:23:15.526712 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT200KvQGsyi_a_sB4TfhhJOzMfG19jSa6oSlia6bg0oJGWsETmIFLMxsrnEQMCxFlXYpeXPwW52kFxfganN5M4cxj3tahAijx2xJ--2WsWYJtuNU3tc5IIgL3W8HC4CGP3frn8iROEzLPCi1mQC1-zUvq06vNZR4ARbYNlrlnvumYqI Oct 19 03:23:15.526712 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:23:15.526712 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:23:15.526712 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:23:15.526712 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:23:15.526712 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:23:15.526712 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:23:15.526712 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 385a1e7cceff48798bfefb9390e5979c Oct 19 03:23:15.526712 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-SecurityGroupsTestJSON-637911912 Oct 19 03:23:15.526712 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:23:15.526712 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:23:15.533827 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/385a1e7cceff48798bfefb9390e5979c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/385a1e7cceff48798bfefb9390e5979c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/385a1e7cceff48798bfefb9390e5979c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_385a1e7cceff48798bfefb9390e5979c", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:23:15.533827 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-SecurityGroupsTestJSON-637911912 Oct 19 03:23:15.533827 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 385a1e7cceff48798bfefb9390e5979c Oct 19 03:23:15.533827 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-637911912 Oct 19 03:23:15.533827 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-SecurityGroupsTestJSON-637911912-project Oct 19 03:23:15.533827 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:23:15.533827 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:23:15.533827 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 3661010393d44c428fb37652b1717072 Oct 19 03:23:15.533827 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-SecurityGroupsTestJSON-637911912-project Oct 19 03:23:15.533827 n-d-861333-8 devstack@n-api.service[121134]: method: Oct 19 03:23:15.533827 n-d-861333-8 devstack@n-api.service[121134]: exception: Security group 01df0d23-d4a3-48cc-9de5-57177768e76e does not exist Oct 19 03:23:15.533827 n-d-861333-8 devstack@n-api.service[121134]: Neutron server returns request_ids: ['req-f49988d4-80de-42e3-a134-1419b271ac86'] Oct 19 03:23:15.533827 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '01df0d23-d4a3-48cc-9de5-57177768e76e'} Oct 19 03:23:15.534613 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:23:15.534613 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:23:15.534613 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 19 03:23:15.534613 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 19 03:23:15.534613 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:23:15.534613 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:23:15.534613 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 19 03:23:15.534613 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 19 03:23:15.534613 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:23:15.534613 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:23:15.534613 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 19 03:23:15.534613 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 19 03:23:15.534613 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:23:15.534613 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:23:15.534613 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 19 03:23:15.534613 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 19 03:23:15.534613 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:23:15.534613 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:23:15.534613 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 19 03:23:15.535609 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 19 03:23:15.535609 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:23:15.535609 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:23:15.535609 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 19 03:23:15.535609 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 19 03:23:15.535609 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 19 03:23:15.535609 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 19 03:23:15.535609 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 01df0d23-d4a3-48cc-9de5-57177768e76e does not exist Oct 19 03:23:15.535609 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f49988d4-80de-42e3-a134-1419b271ac86'] Oct 19 03:23:15.535609 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:23:15.535609 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:23:15.535609 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:23:15.535609 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:23:15.535609 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 19 03:23:15.535609 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 19 03:23:15.535609 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 19 03:23:15.535609 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 19 03:23:15.535609 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 01df0d23-d4a3-48cc-9de5-57177768e76e does not exist Oct 19 03:23:15.536593 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f49988d4-80de-42e3-a134-1419b271ac86'] Oct 19 03:23:15.536593 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:23:15.536593 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:23:15.536593 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:23:15.536593 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:23:15.536593 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:23:15.536593 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:23:15.536593 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:23:15.536593 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:23:15.536593 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 03:23:15.536593 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 03:23:15.536593 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:23:15.536593 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:23:15.536593 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 19 03:23:15.536593 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 19 03:23:15.536593 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 01df0d23-d4a3-48cc-9de5-57177768e76e does not exist Oct 19 03:23:15.536593 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f49988d4-80de-42e3-a134-1419b271ac86'] Oct 19 03:23:15.536593 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:23:15.536593 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:23:15.536593 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:23:15.536593 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:23:15.537731 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:23:15.537731 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:23:15.537731 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:23:15.537731 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:23:15.537731 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 01df0d23-d4a3-48cc-9de5-57177768e76e does not exist Oct 19 03:23:15.537731 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f49988d4-80de-42e3-a134-1419b271ac86'] Oct 19 03:23:15.537731 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:23:15.537731 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5c11feef-f509-4019-98fd-650d5ff7c1df tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Returning 404 to user: Security group 01df0d23-d4a3-48cc-9de5-57177768e76e does not exist Oct 19 03:23:15.537731 n-d-861333-8 devstack@n-api.service[121134]: Neutron server returns request_ids: ['req-f49988d4-80de-42e3-a134-1419b271ac86'] {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:23:15.537731 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5c11feef-f509-4019-98fd-650d5ff7c1df tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/01df0d23-d4a3-48cc-9de5-57177768e76e" status: 404 len: 194 microversion: 2.1 time: 0.149942 Oct 19 03:23:15.537731 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1321/2681] 10.222.0.52 () {58 vars in 1272 bytes} [Wed Oct 19 03:23:15 2022] DELETE /compute/v2.1/os-security-groups/01df0d23-d4a3-48cc-9de5-57177768e76e => generated 194 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:23:15.548282 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ebc63921-883d-49c0-9757-3b758e48b20d tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Calling method '.version_select at 0x7fc1300fa1f0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:23:15.567181 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-3a6a3f04-13f8-4135-b303-cb65f003ff46 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Getting quotas for project 3de899450062428e8cd4686ae84de2eb. Resources: {'key_pairs'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:23:15.577983 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-3a6a3f04-13f8-4135-b303-cb65f003ff46 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Getting quotas for user 1804c1df36f347feb017deec5eef9dbb and project 3de899450062428e8cd4686ae84de2eb. Resources: {'key_pairs'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:23:15.670638 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-3a6a3f04-13f8-4135-b303-cb65f003ff46 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.42 time: 0.169461 Oct 19 03:23:15.672149 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1361/2682] 10.222.0.52 () {62 vars in 1200 bytes} [Wed Oct 19 03:23:15 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 172 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 19 03:23:15.749208 n-d-861333-8 devstack@n-api.service[121134]: DEBUG neutronclient.v2_0.client [None req-ebc63921-883d-49c0-9757-3b758e48b20d tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 0445a54a-53eb-436c-b6e4-d171f1875c19 does not exist", "detail": ""}} {{(pid=121134) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 19 03:23:15.749873 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.security_group_api [None req-ebc63921-883d-49c0-9757-3b758e48b20d tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Neutron security group 0445a54a-53eb-436c-b6e4-d171f1875c19 not found {{(pid=121134) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 19 03:23:15.750391 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-ebc63921-883d-49c0-9757-3b758e48b20d tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] HTTP exception thrown: Security group 0445a54a-53eb-436c-b6e4-d171f1875c19 does not exist Oct 19 03:23:15.750391 n-d-861333-8 devstack@n-api.service[121134]: Neutron server returns request_ids: ['req-2bdd3026-626b-4516-88bd-35fc44291323'] Oct 19 03:23:15.760490 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ebc63921-883d-49c0-9757-3b758e48b20d tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Request method failure captured: Oct 19 03:23:15.760490 n-d-861333-8 devstack@n-api.service[121134]: request: DELETE /compute/v2.1/os-security-groups/0445a54a-53eb-436c-b6e4-d171f1875c19 HTTP/1.1 Oct 19 03:23:15.760490 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:23:15.760490 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:23:15.760490 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:23:15.760490 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:23:15.760490 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:23:15.760490 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:23:15.760490 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:23:15.760490 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:23:15.760490 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT200KvQGsyi_a_sB4TfhhJOzMfG19jSa6oSlia6bg0oJGWsETmIFLMxsrnEQMCxFlXYpeXPwW52kFxfganN5M4cxj3tahAijx2xJ--2WsWYJtuNU3tc5IIgL3W8HC4CGP3frn8iROEzLPCi1mQC1-zUvq06vNZR4ARbYNlrlnvumYqI Oct 19 03:23:15.760490 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:23:15.760490 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:23:15.760490 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:23:15.760490 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:23:15.760490 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:23:15.760490 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:23:15.760490 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 385a1e7cceff48798bfefb9390e5979c Oct 19 03:23:15.760490 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-SecurityGroupsTestJSON-637911912 Oct 19 03:23:15.760490 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:23:15.760490 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:23:15.766920 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/385a1e7cceff48798bfefb9390e5979c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/385a1e7cceff48798bfefb9390e5979c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/385a1e7cceff48798bfefb9390e5979c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_385a1e7cceff48798bfefb9390e5979c", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:23:15.766920 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-SecurityGroupsTestJSON-637911912 Oct 19 03:23:15.766920 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 385a1e7cceff48798bfefb9390e5979c Oct 19 03:23:15.766920 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-637911912 Oct 19 03:23:15.766920 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-SecurityGroupsTestJSON-637911912-project Oct 19 03:23:15.766920 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:23:15.766920 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:23:15.766920 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 3661010393d44c428fb37652b1717072 Oct 19 03:23:15.766920 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-SecurityGroupsTestJSON-637911912-project Oct 19 03:23:15.766920 n-d-861333-8 devstack@n-api.service[121134]: method: Oct 19 03:23:15.766920 n-d-861333-8 devstack@n-api.service[121134]: exception: Security group 0445a54a-53eb-436c-b6e4-d171f1875c19 does not exist Oct 19 03:23:15.766920 n-d-861333-8 devstack@n-api.service[121134]: Neutron server returns request_ids: ['req-2bdd3026-626b-4516-88bd-35fc44291323'] Oct 19 03:23:15.766920 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '0445a54a-53eb-436c-b6e4-d171f1875c19'} Oct 19 03:23:15.767743 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:23:15.767743 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:23:15.767743 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 19 03:23:15.767743 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 19 03:23:15.767743 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:23:15.767743 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:23:15.767743 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 19 03:23:15.767743 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 19 03:23:15.767743 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:23:15.767743 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:23:15.767743 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 19 03:23:15.767743 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 19 03:23:15.767743 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:23:15.767743 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:23:15.767743 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 19 03:23:15.767743 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 19 03:23:15.767743 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:23:15.767743 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:23:15.767743 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 19 03:23:15.768823 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 19 03:23:15.768823 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:23:15.768823 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:23:15.768823 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 19 03:23:15.768823 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 19 03:23:15.768823 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 19 03:23:15.768823 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 19 03:23:15.768823 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 0445a54a-53eb-436c-b6e4-d171f1875c19 does not exist Oct 19 03:23:15.768823 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2bdd3026-626b-4516-88bd-35fc44291323'] Oct 19 03:23:15.768823 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:23:15.768823 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:23:15.768823 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:23:15.768823 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:23:15.768823 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 19 03:23:15.768823 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 19 03:23:15.768823 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 19 03:23:15.768823 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 19 03:23:15.768823 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 0445a54a-53eb-436c-b6e4-d171f1875c19 does not exist Oct 19 03:23:15.769853 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2bdd3026-626b-4516-88bd-35fc44291323'] Oct 19 03:23:15.769853 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:23:15.769853 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:23:15.769853 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:23:15.769853 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:23:15.769853 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:23:15.769853 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:23:15.769853 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:23:15.769853 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:23:15.769853 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 03:23:15.769853 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 03:23:15.769853 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:23:15.769853 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:23:15.769853 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 19 03:23:15.769853 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 19 03:23:15.769853 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 0445a54a-53eb-436c-b6e4-d171f1875c19 does not exist Oct 19 03:23:15.769853 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2bdd3026-626b-4516-88bd-35fc44291323'] Oct 19 03:23:15.769853 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:23:15.769853 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:23:15.769853 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:23:15.769853 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:23:15.771885 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:23:15.771885 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:23:15.771885 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:23:15.771885 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:23:15.771885 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 0445a54a-53eb-436c-b6e4-d171f1875c19 does not exist Oct 19 03:23:15.771885 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2bdd3026-626b-4516-88bd-35fc44291323'] Oct 19 03:23:15.771885 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:23:15.771885 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ebc63921-883d-49c0-9757-3b758e48b20d tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Returning 404 to user: Security group 0445a54a-53eb-436c-b6e4-d171f1875c19 does not exist Oct 19 03:23:15.771885 n-d-861333-8 devstack@n-api.service[121134]: Neutron server returns request_ids: ['req-2bdd3026-626b-4516-88bd-35fc44291323'] {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:23:15.771885 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ebc63921-883d-49c0-9757-3b758e48b20d tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/0445a54a-53eb-436c-b6e4-d171f1875c19" status: 404 len: 194 microversion: 2.1 time: 0.226972 Oct 19 03:23:15.771885 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1322/2683] 10.222.0.52 () {58 vars in 1272 bytes} [Wed Oct 19 03:23:15 2022] DELETE /compute/v2.1/os-security-groups/0445a54a-53eb-436c-b6e4-d171f1875c19 => generated 194 bytes in 230 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:23:15.775617 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5bd7920e-f84c-42b2-9fd7-10afbbfad9f0 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Calling method '.version_select at 0x7fc1301b9040>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:23:15.864686 n-d-861333-8 devstack@n-api.service[121135]: DEBUG neutronclient.v2_0.client [None req-5bd7920e-f84c-42b2-9fd7-10afbbfad9f0 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 98dc95fd-3ac4-4b56-962d-c9e3f9f380b3 does not exist", "detail": ""}} {{(pid=121135) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 19 03:23:15.865809 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.network.security_group_api [None req-5bd7920e-f84c-42b2-9fd7-10afbbfad9f0 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Neutron security group 98dc95fd-3ac4-4b56-962d-c9e3f9f380b3 not found {{(pid=121135) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 19 03:23:15.866675 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-5bd7920e-f84c-42b2-9fd7-10afbbfad9f0 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] HTTP exception thrown: Security group 98dc95fd-3ac4-4b56-962d-c9e3f9f380b3 does not exist Oct 19 03:23:15.866675 n-d-861333-8 devstack@n-api.service[121135]: Neutron server returns request_ids: ['req-f8fde259-6038-495c-88b7-dcc7b02a78df'] Oct 19 03:23:15.869546 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5bd7920e-f84c-42b2-9fd7-10afbbfad9f0 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Request method failure captured: Oct 19 03:23:15.869546 n-d-861333-8 devstack@n-api.service[121135]: request: DELETE /compute/v2.1/os-security-groups/98dc95fd-3ac4-4b56-962d-c9e3f9f380b3 HTTP/1.1 Oct 19 03:23:15.869546 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:23:15.869546 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:23:15.869546 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:23:15.869546 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:23:15.869546 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:23:15.869546 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:23:15.869546 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:23:15.869546 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:23:15.869546 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT200KvQGsyi_a_sB4TfhhJOzMfG19jSa6oSlia6bg0oJGWsETmIFLMxsrnEQMCxFlXYpeXPwW52kFxfganN5M4cxj3tahAijx2xJ--2WsWYJtuNU3tc5IIgL3W8HC4CGP3frn8iROEzLPCi1mQC1-zUvq06vNZR4ARbYNlrlnvumYqI Oct 19 03:23:15.869546 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:23:15.869546 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:23:15.869546 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:23:15.869546 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:23:15.869546 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:23:15.869546 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:23:15.869546 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 385a1e7cceff48798bfefb9390e5979c Oct 19 03:23:15.869546 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-SecurityGroupsTestJSON-637911912 Oct 19 03:23:15.869546 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:23:15.869546 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:23:15.870979 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/385a1e7cceff48798bfefb9390e5979c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/385a1e7cceff48798bfefb9390e5979c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/385a1e7cceff48798bfefb9390e5979c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_385a1e7cceff48798bfefb9390e5979c", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:23:15.870979 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-SecurityGroupsTestJSON-637911912 Oct 19 03:23:15.870979 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 385a1e7cceff48798bfefb9390e5979c Oct 19 03:23:15.870979 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-637911912 Oct 19 03:23:15.870979 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-SecurityGroupsTestJSON-637911912-project Oct 19 03:23:15.870979 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:23:15.870979 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:23:15.870979 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 3661010393d44c428fb37652b1717072 Oct 19 03:23:15.870979 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-SecurityGroupsTestJSON-637911912-project Oct 19 03:23:15.870979 n-d-861333-8 devstack@n-api.service[121135]: method: Oct 19 03:23:15.870979 n-d-861333-8 devstack@n-api.service[121135]: exception: Security group 98dc95fd-3ac4-4b56-962d-c9e3f9f380b3 does not exist Oct 19 03:23:15.870979 n-d-861333-8 devstack@n-api.service[121135]: Neutron server returns request_ids: ['req-f8fde259-6038-495c-88b7-dcc7b02a78df'] Oct 19 03:23:15.870979 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '98dc95fd-3ac4-4b56-962d-c9e3f9f380b3'} Oct 19 03:23:15.871686 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:23:15.871686 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:23:15.871686 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 19 03:23:15.871686 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 19 03:23:15.871686 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:23:15.871686 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:23:15.871686 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 19 03:23:15.871686 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 19 03:23:15.871686 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:23:15.871686 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:23:15.871686 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 19 03:23:15.871686 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 19 03:23:15.871686 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:23:15.871686 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:23:15.871686 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 19 03:23:15.871686 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 19 03:23:15.871686 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:23:15.871686 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:23:15.871686 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 19 03:23:15.873518 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 19 03:23:15.873518 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:23:15.873518 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:23:15.873518 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 19 03:23:15.873518 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 19 03:23:15.873518 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 19 03:23:15.873518 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 19 03:23:15.873518 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 98dc95fd-3ac4-4b56-962d-c9e3f9f380b3 does not exist Oct 19 03:23:15.873518 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f8fde259-6038-495c-88b7-dcc7b02a78df'] Oct 19 03:23:15.873518 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:23:15.873518 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:23:15.873518 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:23:15.873518 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:23:15.873518 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 19 03:23:15.873518 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 19 03:23:15.873518 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 19 03:23:15.873518 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 19 03:23:15.873518 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 98dc95fd-3ac4-4b56-962d-c9e3f9f380b3 does not exist Oct 19 03:23:15.875622 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f8fde259-6038-495c-88b7-dcc7b02a78df'] Oct 19 03:23:15.875622 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:23:15.875622 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:23:15.875622 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:23:15.875622 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:23:15.875622 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:23:15.875622 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:23:15.875622 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:23:15.875622 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:23:15.875622 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 03:23:15.875622 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 03:23:15.875622 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:23:15.875622 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:23:15.875622 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 19 03:23:15.875622 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 19 03:23:15.875622 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 98dc95fd-3ac4-4b56-962d-c9e3f9f380b3 does not exist Oct 19 03:23:15.875622 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f8fde259-6038-495c-88b7-dcc7b02a78df'] Oct 19 03:23:15.875622 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:23:15.875622 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:23:15.875622 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:23:15.875622 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:23:15.876975 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:23:15.876975 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:23:15.876975 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:23:15.876975 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:23:15.876975 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 98dc95fd-3ac4-4b56-962d-c9e3f9f380b3 does not exist Oct 19 03:23:15.876975 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f8fde259-6038-495c-88b7-dcc7b02a78df'] Oct 19 03:23:15.876975 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:23:15.876975 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5bd7920e-f84c-42b2-9fd7-10afbbfad9f0 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Returning 404 to user: Security group 98dc95fd-3ac4-4b56-962d-c9e3f9f380b3 does not exist Oct 19 03:23:15.876975 n-d-861333-8 devstack@n-api.service[121135]: Neutron server returns request_ids: ['req-f8fde259-6038-495c-88b7-dcc7b02a78df'] {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:23:15.876975 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5bd7920e-f84c-42b2-9fd7-10afbbfad9f0 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/98dc95fd-3ac4-4b56-962d-c9e3f9f380b3" status: 404 len: 194 microversion: 2.1 time: 0.102089 Oct 19 03:23:15.876975 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1362/2684] 10.222.0.52 () {58 vars in 1272 bytes} [Wed Oct 19 03:23:15 2022] DELETE /compute/v2.1/os-security-groups/98dc95fd-3ac4-4b56-962d-c9e3f9f380b3 => generated 194 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:23:15.882159 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-857e4894-7d0d-4c23-aa62-123dd961c80f tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Calling method '.version_select at 0x7fc13017a820>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:23:15.937570 n-d-861333-8 devstack@n-api.service[121134]: DEBUG neutronclient.v2_0.client [None req-857e4894-7d0d-4c23-aa62-123dd961c80f tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group ab1a77e1-3818-4431-a2cc-ab5f2a6ddabf does not exist", "detail": ""}} {{(pid=121134) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 19 03:23:15.938155 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.security_group_api [None req-857e4894-7d0d-4c23-aa62-123dd961c80f tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Neutron security group ab1a77e1-3818-4431-a2cc-ab5f2a6ddabf not found {{(pid=121134) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 19 03:23:15.938988 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-857e4894-7d0d-4c23-aa62-123dd961c80f tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] HTTP exception thrown: Security group ab1a77e1-3818-4431-a2cc-ab5f2a6ddabf does not exist Oct 19 03:23:15.938988 n-d-861333-8 devstack@n-api.service[121134]: Neutron server returns request_ids: ['req-568206fc-f3e3-45c7-a011-386e830aa73a'] Oct 19 03:23:15.941165 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-857e4894-7d0d-4c23-aa62-123dd961c80f tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Request method failure captured: Oct 19 03:23:15.941165 n-d-861333-8 devstack@n-api.service[121134]: request: DELETE /compute/v2.1/os-security-groups/ab1a77e1-3818-4431-a2cc-ab5f2a6ddabf HTTP/1.1 Oct 19 03:23:15.941165 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:23:15.941165 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:23:15.941165 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:23:15.941165 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:23:15.941165 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:23:15.941165 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:23:15.941165 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:23:15.941165 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:23:15.941165 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT200KvQGsyi_a_sB4TfhhJOzMfG19jSa6oSlia6bg0oJGWsETmIFLMxsrnEQMCxFlXYpeXPwW52kFxfganN5M4cxj3tahAijx2xJ--2WsWYJtuNU3tc5IIgL3W8HC4CGP3frn8iROEzLPCi1mQC1-zUvq06vNZR4ARbYNlrlnvumYqI Oct 19 03:23:15.941165 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:23:15.941165 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:23:15.941165 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:23:15.941165 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:23:15.941165 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:23:15.941165 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:23:15.941165 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 385a1e7cceff48798bfefb9390e5979c Oct 19 03:23:15.941165 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-SecurityGroupsTestJSON-637911912 Oct 19 03:23:15.941165 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:23:15.941165 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:23:15.942402 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/385a1e7cceff48798bfefb9390e5979c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/385a1e7cceff48798bfefb9390e5979c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/385a1e7cceff48798bfefb9390e5979c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_385a1e7cceff48798bfefb9390e5979c", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:23:15.942402 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-SecurityGroupsTestJSON-637911912 Oct 19 03:23:15.942402 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 385a1e7cceff48798bfefb9390e5979c Oct 19 03:23:15.942402 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-637911912 Oct 19 03:23:15.942402 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-SecurityGroupsTestJSON-637911912-project Oct 19 03:23:15.942402 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:23:15.942402 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:23:15.942402 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 3661010393d44c428fb37652b1717072 Oct 19 03:23:15.942402 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-SecurityGroupsTestJSON-637911912-project Oct 19 03:23:15.942402 n-d-861333-8 devstack@n-api.service[121134]: method: Oct 19 03:23:15.942402 n-d-861333-8 devstack@n-api.service[121134]: exception: Security group ab1a77e1-3818-4431-a2cc-ab5f2a6ddabf does not exist Oct 19 03:23:15.942402 n-d-861333-8 devstack@n-api.service[121134]: Neutron server returns request_ids: ['req-568206fc-f3e3-45c7-a011-386e830aa73a'] Oct 19 03:23:15.942402 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': 'ab1a77e1-3818-4431-a2cc-ab5f2a6ddabf'} Oct 19 03:23:15.943107 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:23:15.943107 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:23:15.943107 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 19 03:23:15.943107 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 19 03:23:15.943107 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:23:15.943107 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:23:15.943107 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 19 03:23:15.943107 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 19 03:23:15.943107 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:23:15.943107 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:23:15.943107 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 19 03:23:15.943107 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 19 03:23:15.943107 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:23:15.943107 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:23:15.943107 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 19 03:23:15.943107 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 19 03:23:15.943107 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:23:15.943107 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:23:15.943107 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 19 03:23:15.944139 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 19 03:23:15.944139 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:23:15.944139 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:23:15.944139 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 19 03:23:15.944139 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 19 03:23:15.944139 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 19 03:23:15.944139 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 19 03:23:15.944139 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group ab1a77e1-3818-4431-a2cc-ab5f2a6ddabf does not exist Oct 19 03:23:15.944139 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-568206fc-f3e3-45c7-a011-386e830aa73a'] Oct 19 03:23:15.944139 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:23:15.944139 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:23:15.944139 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:23:15.944139 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:23:15.944139 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 19 03:23:15.944139 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 19 03:23:15.944139 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 19 03:23:15.944139 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 19 03:23:15.944139 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group ab1a77e1-3818-4431-a2cc-ab5f2a6ddabf does not exist Oct 19 03:23:15.945126 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-568206fc-f3e3-45c7-a011-386e830aa73a'] Oct 19 03:23:15.945126 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:23:15.945126 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:23:15.945126 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:23:15.945126 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:23:15.945126 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:23:15.945126 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:23:15.945126 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:23:15.945126 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:23:15.945126 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 03:23:15.945126 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 03:23:15.945126 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:23:15.945126 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:23:15.945126 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 19 03:23:15.945126 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 19 03:23:15.945126 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group ab1a77e1-3818-4431-a2cc-ab5f2a6ddabf does not exist Oct 19 03:23:15.945126 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-568206fc-f3e3-45c7-a011-386e830aa73a'] Oct 19 03:23:15.945126 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:23:15.945126 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:23:15.945126 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:23:15.945126 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:23:15.946329 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:23:15.946329 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:23:15.946329 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:23:15.946329 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:23:15.946329 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group ab1a77e1-3818-4431-a2cc-ab5f2a6ddabf does not exist Oct 19 03:23:15.946329 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-568206fc-f3e3-45c7-a011-386e830aa73a'] Oct 19 03:23:15.946329 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:23:15.949486 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-857e4894-7d0d-4c23-aa62-123dd961c80f tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Returning 404 to user: Security group ab1a77e1-3818-4431-a2cc-ab5f2a6ddabf does not exist Oct 19 03:23:15.949486 n-d-861333-8 devstack@n-api.service[121134]: Neutron server returns request_ids: ['req-568206fc-f3e3-45c7-a011-386e830aa73a'] {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:23:15.951238 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-857e4894-7d0d-4c23-aa62-123dd961c80f tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/ab1a77e1-3818-4431-a2cc-ab5f2a6ddabf" status: 404 len: 194 microversion: 2.1 time: 0.072889 Oct 19 03:23:15.962582 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-95cc399a-29ed-4239-ad1a-75fb0ed841f9 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:23:15.964274 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-95cc399a-29ed-4239-ad1a-75fb0ed841f9 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] [instance: 3b4bc3da-47f7-4719-817f-5636c247c87e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:23:15.965820 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1323/2685] 10.222.0.52 () {58 vars in 1272 bytes} [Wed Oct 19 03:23:15 2022] DELETE /compute/v2.1/os-security-groups/ab1a77e1-3818-4431-a2cc-ab5f2a6ddabf => generated 194 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:23:15.978846 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-95cc399a-29ed-4239-ad1a-75fb0ed841f9 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:15.983707 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-170d1170-0208-4647-a2ef-7524b1eaab7a tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Calling method '.version_select at 0x7fc1300fa8b0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:23:15.983835 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-95cc399a-29ed-4239-ad1a-75fb0ed841f9 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:15.983835 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-95cc399a-29ed-4239-ad1a-75fb0ed841f9 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:15.983835 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-95cc399a-29ed-4239-ad1a-75fb0ed841f9 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:15.983835 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-95cc399a-29ed-4239-ad1a-75fb0ed841f9 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:15.984106 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-95cc399a-29ed-4239-ad1a-75fb0ed841f9 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:16.019735 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-95cc399a-29ed-4239-ad1a-75fb0ed841f9 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] [instance: 3b4bc3da-47f7-4719-817f-5636c247c87e] Going to try to terminate instance {{(pid=121135) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:23:16.052189 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-170d1170-0208-4647-a2ef-7524b1eaab7a tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] 10.222.0.52 "GET /compute/v2.1/images/c09f0682-cee7-4a5b-a32d-5b6db22a1d38" status: 200 len: 1455 microversion: 2.1 time: 0.085026 Oct 19 03:23:16.053147 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1324/2686] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:23:15 2022] GET /compute/v2.1/images/c09f0682-cee7-4a5b-a32d-5b6db22a1d38 => generated 1455 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:23:16.117247 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:23:16.407598 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4eed10a3-22f6-4d34-8a73-5869104b3456 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:23:16.408490 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4eed10a3-22f6-4d34-8a73-5869104b3456 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] [instance: 24678d1b-08b3-4475-aaed-a33d8eed0923] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:23:16.419914 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4eed10a3-22f6-4d34-8a73-5869104b3456 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:16.428010 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4eed10a3-22f6-4d34-8a73-5869104b3456 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:16.428868 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4eed10a3-22f6-4d34-8a73-5869104b3456 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:16.429891 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4eed10a3-22f6-4d34-8a73-5869104b3456 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:16.430492 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4eed10a3-22f6-4d34-8a73-5869104b3456 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:16.431006 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4eed10a3-22f6-4d34-8a73-5869104b3456 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:16.548651 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-4eed10a3-22f6-4d34-8a73-5869104b3456 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1ff892953e478b814922c82cc108a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e10c25837184a3983c67f2da5fe74b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:23:16.559587 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-4eed10a3-22f6-4d34-8a73-5869104b3456 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e1ff892953e478b814922c82cc108a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e10c25837184a3983c67f2da5fe74b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:23:16.561334 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-4eed10a3-22f6-4d34-8a73-5869104b3456 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e1ff892953e478b814922c82cc108a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e10c25837184a3983c67f2da5fe74b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:23:16.563746 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4eed10a3-22f6-4d34-8a73-5869104b3456 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] 10.222.0.52 "GET /compute/v2.1/servers/24678d1b-08b3-4475-aaed-a33d8eed0923" status: 200 len: 1336 microversion: 2.47 time: 0.162427 Oct 19 03:23:16.564875 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1325/2687] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:23:16 2022] GET /compute/v2.1/servers/24678d1b-08b3-4475-aaed-a33d8eed0923 => generated 1336 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:23:16.571205 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-712b93ec-dcd4-4d79-a343-3829f564fc1d tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:23:16.572373 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-712b93ec-dcd4-4d79-a343-3829f564fc1d tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: c45890de-f7bf-4736-8b08-6f3e6863e2b3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:23:16.581807 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-712b93ec-dcd4-4d79-a343-3829f564fc1d tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:16.582308 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-712b93ec-dcd4-4d79-a343-3829f564fc1d tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:16.583583 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-712b93ec-dcd4-4d79-a343-3829f564fc1d tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:16.584307 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-712b93ec-dcd4-4d79-a343-3829f564fc1d tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:16.584964 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-712b93ec-dcd4-4d79-a343-3829f564fc1d tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:16.585456 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-712b93ec-dcd4-4d79-a343-3829f564fc1d tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:16.594396 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-95cc399a-29ed-4239-ad1a-75fb0ed841f9 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] 10.222.0.52 "DELETE /compute/v2.1/servers/3b4bc3da-47f7-4719-817f-5636c247c87e" status: 204 len: 0 microversion: 2.1 time: 0.637121 Oct 19 03:23:16.596887 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1363/2688] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:23:15 2022] DELETE /compute/v2.1/servers/3b4bc3da-47f7-4719-817f-5636c247c87e => generated 0 bytes in 640 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:23:16.606356 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-89cd7f2a-3816-4232-b1eb-6bcac5573d99 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:23:16.608238 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-89cd7f2a-3816-4232-b1eb-6bcac5573d99 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] [instance: 3b4bc3da-47f7-4719-817f-5636c247c87e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:23:16.634951 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-89cd7f2a-3816-4232-b1eb-6bcac5573d99 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:16.634951 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-89cd7f2a-3816-4232-b1eb-6bcac5573d99 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:16.634951 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-89cd7f2a-3816-4232-b1eb-6bcac5573d99 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:16.634951 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-89cd7f2a-3816-4232-b1eb-6bcac5573d99 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:16.635460 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-89cd7f2a-3816-4232-b1eb-6bcac5573d99 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:16.635460 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-89cd7f2a-3816-4232-b1eb-6bcac5573d99 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:17.241069 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-712b93ec-dcd4-4d79-a343-3829f564fc1d tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:23:17.245595 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:23:17.258440 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-712b93ec-dcd4-4d79-a343-3829f564fc1d tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/c45890de-f7bf-4736-8b08-6f3e6863e2b3" status: 200 len: 1474 microversion: 2.1 time: 0.692321 Oct 19 03:23:17.260994 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1326/2689] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:23:16 2022] GET /compute/v2.1/servers/c45890de-f7bf-4736-8b08-6f3e6863e2b3 => generated 1474 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:23:17.272617 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-33c8b230-ce3c-48c5-8dcf-78b88eebdaf2 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Calling method '.version_select at 0x7fc1300f7790>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:23:17.350937 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-33c8b230-ce3c-48c5-8dcf-78b88eebdaf2 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] 10.222.0.52 "GET /compute/v2.1/images/c09f0682-cee7-4a5b-a32d-5b6db22a1d38" status: 200 len: 1455 microversion: 2.1 time: 0.088569 Oct 19 03:23:17.351532 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1327/2690] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:23:17 2022] GET /compute/v2.1/images/c09f0682-cee7-4a5b-a32d-5b6db22a1d38 => generated 1455 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:23:17.365306 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-548552d2-5b76-422e-a316-41e9eff9aaf0 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1671650377"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:23:17.368534 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-548552d2-5b76-422e-a316-41e9eff9aaf0 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: c45890de-f7bf-4736-8b08-6f3e6863e2b3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:23:17.378109 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-548552d2-5b76-422e-a316-41e9eff9aaf0 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:17.378881 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-548552d2-5b76-422e-a316-41e9eff9aaf0 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:17.379483 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-548552d2-5b76-422e-a316-41e9eff9aaf0 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:17.380370 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-548552d2-5b76-422e-a316-41e9eff9aaf0 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:17.381022 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-548552d2-5b76-422e-a316-41e9eff9aaf0 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:17.381643 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-548552d2-5b76-422e-a316-41e9eff9aaf0 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:17.497783 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-89cd7f2a-3816-4232-b1eb-6bcac5573d99 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3661010393d44c428fb37652b1717072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a1e7cceff48798bfefb9390e5979c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:23:17.512220 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-89cd7f2a-3816-4232-b1eb-6bcac5573d99 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] 10.222.0.52 "GET /compute/v2.1/servers/3b4bc3da-47f7-4719-817f-5636c247c87e" status: 200 len: 1648 microversion: 2.1 time: 0.910682 Oct 19 03:23:17.516518 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1364/2691] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:23:16 2022] GET /compute/v2.1/servers/3b4bc3da-47f7-4719-817f-5636c247c87e => generated 1648 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:23:17.530237 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-6028dfde-10b1-4111-8269-67d781a5d8db req-2b009b7a-2f31-4911-86b0-c19ab7d14b4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ef505a5-0624-4080-9089-821f6fdfb47c", "name": "network-vif-plugged", "status": "completed", "tag": "3d68ba4c-839d-44ea-b4e3-7563b0f4650a"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:23:17.555448 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-6028dfde-10b1-4111-8269-67d781a5d8db req-2b009b7a-2f31-4911-86b0-c19ab7d14b4a service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:17.557047 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-6028dfde-10b1-4111-8269-67d781a5d8db req-2b009b7a-2f31-4911-86b0-c19ab7d14b4a service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:17.558763 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-6028dfde-10b1-4111-8269-67d781a5d8db req-2b009b7a-2f31-4911-86b0-c19ab7d14b4a service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:17.593212 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-6028dfde-10b1-4111-8269-67d781a5d8db req-2b009b7a-2f31-4911-86b0-c19ab7d14b4a service nova] Creating event network-vif-plugged:3d68ba4c-839d-44ea-b4e3-7563b0f4650a for instance 6ef505a5-0624-4080-9089-821f6fdfb47c on n-h1-861333-8 Oct 19 03:23:17.610124 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-6028dfde-10b1-4111-8269-67d781a5d8db req-2b009b7a-2f31-4911-86b0-c19ab7d14b4a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088801 Oct 19 03:23:17.610790 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1365/2692] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:23:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:23:17.632128 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ba3d3381-f493-42fb-9826-6e6dd89b9f17 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:23:17.634214 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ba3d3381-f493-42fb-9826-6e6dd89b9f17 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] [instance: 24678d1b-08b3-4475-aaed-a33d8eed0923] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:23:17.660090 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ba3d3381-f493-42fb-9826-6e6dd89b9f17 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:17.660615 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ba3d3381-f493-42fb-9826-6e6dd89b9f17 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:17.661040 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ba3d3381-f493-42fb-9826-6e6dd89b9f17 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:17.661819 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ba3d3381-f493-42fb-9826-6e6dd89b9f17 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:17.662287 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ba3d3381-f493-42fb-9826-6e6dd89b9f17 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:17.669064 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ba3d3381-f493-42fb-9826-6e6dd89b9f17 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:17.892690 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ba3d3381-f493-42fb-9826-6e6dd89b9f17 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1ff892953e478b814922c82cc108a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e10c25837184a3983c67f2da5fe74b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:23:17.905120 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ba3d3381-f493-42fb-9826-6e6dd89b9f17 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e1ff892953e478b814922c82cc108a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e10c25837184a3983c67f2da5fe74b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:23:17.908490 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ba3d3381-f493-42fb-9826-6e6dd89b9f17 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e1ff892953e478b814922c82cc108a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e10c25837184a3983c67f2da5fe74b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:23:17.909954 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ba3d3381-f493-42fb-9826-6e6dd89b9f17 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] 10.222.0.52 "GET /compute/v2.1/servers/24678d1b-08b3-4475-aaed-a33d8eed0923" status: 200 len: 1336 microversion: 2.47 time: 0.291659 Oct 19 03:23:17.910549 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1366/2693] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:23:17 2022] GET /compute/v2.1/servers/24678d1b-08b3-4475-aaed-a33d8eed0923 => generated 1336 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:23:18.046756 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:23:18.184880 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-548552d2-5b76-422e-a316-41e9eff9aaf0 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "POST /compute/v2.1/servers/c45890de-f7bf-4736-8b08-6f3e6863e2b3/action" status: 202 len: 0 microversion: 2.1 time: 0.830442 Oct 19 03:23:18.186195 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1328/2694] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:23:17 2022] POST /compute/v2.1/servers/c45890de-f7bf-4736-8b08-6f3e6863e2b3/action => generated 0 bytes in 832 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 19 03:23:18.199305 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-089c9175-41dd-461e-ac67-476fc8444223 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '.version_select at 0x7fc1301b9280>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:23:18.272763 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-089c9175-41dd-461e-ac67-476fc8444223 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/images/9891212c-fa9a-4fc6-b4f5-ab78e62e6e45" status: 200 len: 1410 microversion: 2.1 time: 0.079239 Oct 19 03:23:18.274780 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1367/2695] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:23:18 2022] GET /compute/v2.1/images/9891212c-fa9a-4fc6-b4f5-ab78e62e6e45 => generated 1410 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:23:18.371012 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4ed86aaf-5ac5-43e4-9d0e-cd6f66ca481a tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Calling method '.version_select at 0x7fc130129700>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:23:18.437264 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4ed86aaf-5ac5-43e4-9d0e-cd6f66ca481a tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] 10.222.0.52 "GET /compute/v2.1/images/c09f0682-cee7-4a5b-a32d-5b6db22a1d38" status: 200 len: 1455 microversion: 2.1 time: 0.073720 Oct 19 03:23:18.441988 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1329/2696] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:23:18 2022] GET /compute/v2.1/images/c09f0682-cee7-4a5b-a32d-5b6db22a1d38 => generated 1455 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:23:18.539156 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7fd3452b-ebd7-482f-b1f1-a647f0306a1d tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:23:18.539946 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7fd3452b-ebd7-482f-b1f1-a647f0306a1d tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] [instance: 3b4bc3da-47f7-4719-817f-5636c247c87e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:23:18.548612 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7fd3452b-ebd7-482f-b1f1-a647f0306a1d tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:18.551701 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7fd3452b-ebd7-482f-b1f1-a647f0306a1d tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:18.553585 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7fd3452b-ebd7-482f-b1f1-a647f0306a1d tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:18.554570 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7fd3452b-ebd7-482f-b1f1-a647f0306a1d tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:18.558699 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7fd3452b-ebd7-482f-b1f1-a647f0306a1d tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:18.559438 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7fd3452b-ebd7-482f-b1f1-a647f0306a1d tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:18.777994 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:23:18.945438 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5b87f2e3-28a5-4acf-a981-b747bd63c804 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:23:18.946906 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5b87f2e3-28a5-4acf-a981-b747bd63c804 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] [instance: 24678d1b-08b3-4475-aaed-a33d8eed0923] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:23:18.962253 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5b87f2e3-28a5-4acf-a981-b747bd63c804 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:18.963519 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5b87f2e3-28a5-4acf-a981-b747bd63c804 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:18.964479 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5b87f2e3-28a5-4acf-a981-b747bd63c804 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:18.965358 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5b87f2e3-28a5-4acf-a981-b747bd63c804 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:18.966428 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5b87f2e3-28a5-4acf-a981-b747bd63c804 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:18.967128 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5b87f2e3-28a5-4acf-a981-b747bd63c804 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:19.257234 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5b87f2e3-28a5-4acf-a981-b747bd63c804 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1ff892953e478b814922c82cc108a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e10c25837184a3983c67f2da5fe74b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:23:19.279037 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5b87f2e3-28a5-4acf-a981-b747bd63c804 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e1ff892953e478b814922c82cc108a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e10c25837184a3983c67f2da5fe74b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:23:19.281573 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5b87f2e3-28a5-4acf-a981-b747bd63c804 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e1ff892953e478b814922c82cc108a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e10c25837184a3983c67f2da5fe74b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:23:19.284631 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5b87f2e3-28a5-4acf-a981-b747bd63c804 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] 10.222.0.52 "GET /compute/v2.1/servers/24678d1b-08b3-4475-aaed-a33d8eed0923" status: 200 len: 1336 microversion: 2.47 time: 0.346940 Oct 19 03:23:19.285978 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1330/2697] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:23:18 2022] GET /compute/v2.1/servers/24678d1b-08b3-4475-aaed-a33d8eed0923 => generated 1336 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:23:19.292828 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-fec6e4d4-438e-4dde-b113-226e8e5d279c tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '.version_select at 0x7fc1300f7e50>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:23:19.373555 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-fec6e4d4-438e-4dde-b113-226e8e5d279c tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/images/9891212c-fa9a-4fc6-b4f5-ab78e62e6e45" status: 200 len: 1410 microversion: 2.1 time: 0.076004 Oct 19 03:23:19.374543 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1331/2698] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:23:19 2022] GET /compute/v2.1/images/9891212c-fa9a-4fc6-b4f5-ab78e62e6e45 => generated 1410 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:23:19.458446 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d833fb10-129c-4d36-bfc5-1b156ae0e348 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Calling method '.version_select at 0x7fc1300fa3a0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:23:19.513643 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d833fb10-129c-4d36-bfc5-1b156ae0e348 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] 10.222.0.52 "GET /compute/v2.1/images/c09f0682-cee7-4a5b-a32d-5b6db22a1d38" status: 200 len: 1455 microversion: 2.1 time: 0.059883 Oct 19 03:23:19.517647 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1332/2699] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:23:19 2022] GET /compute/v2.1/images/c09f0682-cee7-4a5b-a32d-5b6db22a1d38 => generated 1455 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:23:19.686010 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7fd3452b-ebd7-482f-b1f1-a647f0306a1d tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3661010393d44c428fb37652b1717072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a1e7cceff48798bfefb9390e5979c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:23:19.696555 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7fd3452b-ebd7-482f-b1f1-a647f0306a1d tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] 10.222.0.52 "GET /compute/v2.1/servers/3b4bc3da-47f7-4719-817f-5636c247c87e" status: 200 len: 1648 microversion: 2.1 time: 1.161563 Oct 19 03:23:19.697571 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1368/2700] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:23:18 2022] GET /compute/v2.1/servers/3b4bc3da-47f7-4719-817f-5636c247c87e => generated 1648 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:23:20.319888 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b0ce3d31-f793-4a61-bebc-345476cc4ee9 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:23:20.320518 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b0ce3d31-f793-4a61-bebc-345476cc4ee9 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] [instance: 24678d1b-08b3-4475-aaed-a33d8eed0923] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:23:20.329034 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b0ce3d31-f793-4a61-bebc-345476cc4ee9 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:20.329810 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b0ce3d31-f793-4a61-bebc-345476cc4ee9 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:20.330471 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b0ce3d31-f793-4a61-bebc-345476cc4ee9 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:20.332625 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b0ce3d31-f793-4a61-bebc-345476cc4ee9 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:20.333293 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b0ce3d31-f793-4a61-bebc-345476cc4ee9 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:20.334620 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b0ce3d31-f793-4a61-bebc-345476cc4ee9 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:20.385406 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-47dddc74-77df-40b6-b60c-c3534fea93c4 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '.version_select at 0x7fc1301d7670>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:23:20.425247 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=8 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:23:20.488076 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-47dddc74-77df-40b6-b60c-c3534fea93c4 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/images/9891212c-fa9a-4fc6-b4f5-ab78e62e6e45" status: 200 len: 1410 microversion: 2.1 time: 0.105006 Oct 19 03:23:20.490771 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1369/2701] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:23:20 2022] GET /compute/v2.1/images/9891212c-fa9a-4fc6-b4f5-ab78e62e6e45 => generated 1410 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:23:20.503099 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b0ce3d31-f793-4a61-bebc-345476cc4ee9 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1ff892953e478b814922c82cc108a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e10c25837184a3983c67f2da5fe74b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:23:20.521417 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b0ce3d31-f793-4a61-bebc-345476cc4ee9 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e1ff892953e478b814922c82cc108a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e10c25837184a3983c67f2da5fe74b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:23:20.524234 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b0ce3d31-f793-4a61-bebc-345476cc4ee9 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e1ff892953e478b814922c82cc108a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e10c25837184a3983c67f2da5fe74b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:23:20.531271 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b0ce3d31-f793-4a61-bebc-345476cc4ee9 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] 10.222.0.52 "GET /compute/v2.1/servers/24678d1b-08b3-4475-aaed-a33d8eed0923" status: 200 len: 1336 microversion: 2.47 time: 0.218411 Oct 19 03:23:20.533767 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-629f3be9-f3d0-41bf-9d9b-ab77016bfa41 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Calling method '.version_select at 0x7fc130203af0>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:23:20.545244 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1333/2702] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:23:20 2022] GET /compute/v2.1/servers/24678d1b-08b3-4475-aaed-a33d8eed0923 => generated 1336 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:23:20.598051 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-629f3be9-f3d0-41bf-9d9b-ab77016bfa41 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] 10.222.0.52 "GET /compute/v2.1/images/c09f0682-cee7-4a5b-a32d-5b6db22a1d38" status: 200 len: 1455 microversion: 2.1 time: 0.069234 Oct 19 03:23:20.599053 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1370/2703] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:23:20 2022] GET /compute/v2.1/images/c09f0682-cee7-4a5b-a32d-5b6db22a1d38 => generated 1455 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:23:20.720969 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-12e0664a-dc2e-4f36-9914-d32d1859b393 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:23:20.724911 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-12e0664a-dc2e-4f36-9914-d32d1859b393 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] [instance: 3b4bc3da-47f7-4719-817f-5636c247c87e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:23:20.731387 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-12e0664a-dc2e-4f36-9914-d32d1859b393 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:20.732083 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-12e0664a-dc2e-4f36-9914-d32d1859b393 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:20.732889 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-12e0664a-dc2e-4f36-9914-d32d1859b393 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:20.733866 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-12e0664a-dc2e-4f36-9914-d32d1859b393 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:20.735683 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-12e0664a-dc2e-4f36-9914-d32d1859b393 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:20.736344 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-12e0664a-dc2e-4f36-9914-d32d1859b393 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:21.331911 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ec8bc249-ca14-4935-a7fe-6aa2e14fe586 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1583524105", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "de81162f-8ab1-409d-8f6d-9e1ab29a6959"}, {"port": "08b1ab84-ad3f-4225-9361-51c47cd1448e", "tag": "port-1"}, {"port": "60051f56-f07d-4d7c-b7f8-7fc736fa8bc5", "tag": "port-2"}, {"uuid": "12ff5932-780b-46e2-a8c8-3e6bcbc4354c", "tag": "net-1"}, {"uuid": "12ff5932-780b-46e2-a8c8-3e6bcbc4354c"}, {"uuid": "6839fd2a-5f8d-44ea-9529-bd34cc1ad6bd", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "6839fd2a-5f8d-44ea-9529-bd34cc1ad6bd", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "9e116d77-182d-4d99-b6c4-a1131f592f04", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "9c15ca04-9341-480c-9c6b-f94519f4ce28", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "be873a16-1c4e-4da2-8616-bdff73a9ff63", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1970104001"}], "key_name": "tempest-keypair-394842387", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:23:21.351047 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-12e0664a-dc2e-4f36-9914-d32d1859b393 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3661010393d44c428fb37652b1717072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a1e7cceff48798bfefb9390e5979c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:23:21.374165 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-12e0664a-dc2e-4f36-9914-d32d1859b393 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] 10.222.0.52 "GET /compute/v2.1/servers/3b4bc3da-47f7-4719-817f-5636c247c87e" status: 200 len: 1648 microversion: 2.1 time: 0.657861 Oct 19 03:23:21.381522 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1334/2704] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:23:20 2022] GET /compute/v2.1/servers/3b4bc3da-47f7-4719-817f-5636c247c87e => generated 1648 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:23:21.506134 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-75de7f24-cd33-4593-a659-f2ce8f1ee367 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '.version_select at 0x7fc1301bee50>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:23:21.572268 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.network.neutron [None req-ec8bc249-ca14-4935-a7fe-6aa2e14fe586 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] validate_networks() for [('de81162f-8ab1-409d-8f6d-9e1ab29a6959', None, None, None, None, None), (None, None, '08b1ab84-ad3f-4225-9361-51c47cd1448e', None, None, None), (None, None, '60051f56-f07d-4d7c-b7f8-7fc736fa8bc5', None, None, None), ('12ff5932-780b-46e2-a8c8-3e6bcbc4354c', None, None, None, None, None), ('12ff5932-780b-46e2-a8c8-3e6bcbc4354c', None, None, None, None, None), ('6839fd2a-5f8d-44ea-9529-bd34cc1ad6bd', '10.2.2.100', None, None, None, None), ('6839fd2a-5f8d-44ea-9529-bd34cc1ad6bd', '10.2.2.200', None, None, None, None)] {{(pid=121135) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:23:21.585715 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-75de7f24-cd33-4593-a659-f2ce8f1ee367 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/images/9891212c-fa9a-4fc6-b4f5-ab78e62e6e45" status: 200 len: 1410 microversion: 2.1 time: 0.083390 Oct 19 03:23:21.594737 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1335/2705] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:23:21 2022] GET /compute/v2.1/images/9891212c-fa9a-4fc6-b4f5-ab78e62e6e45 => generated 1410 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:23:21.602091 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-297e3819-f7f9-47d4-a193-b51c8f4f3d28 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:23:21.604004 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-297e3819-f7f9-47d4-a193-b51c8f4f3d28 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] [instance: 24678d1b-08b3-4475-aaed-a33d8eed0923] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:23:21.619796 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-297e3819-f7f9-47d4-a193-b51c8f4f3d28 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:21.623989 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-297e3819-f7f9-47d4-a193-b51c8f4f3d28 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:21.624518 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-297e3819-f7f9-47d4-a193-b51c8f4f3d28 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:21.625568 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-297e3819-f7f9-47d4-a193-b51c8f4f3d28 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:21.626222 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-297e3819-f7f9-47d4-a193-b51c8f4f3d28 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:21.627058 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-297e3819-f7f9-47d4-a193-b51c8f4f3d28 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:21.771728 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-297e3819-f7f9-47d4-a193-b51c8f4f3d28 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1ff892953e478b814922c82cc108a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e10c25837184a3983c67f2da5fe74b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:23:21.789466 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-297e3819-f7f9-47d4-a193-b51c8f4f3d28 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e1ff892953e478b814922c82cc108a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e10c25837184a3983c67f2da5fe74b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:23:21.792734 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-297e3819-f7f9-47d4-a193-b51c8f4f3d28 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e1ff892953e478b814922c82cc108a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e10c25837184a3983c67f2da5fe74b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:23:21.793951 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-297e3819-f7f9-47d4-a193-b51c8f4f3d28 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] 10.222.0.52 "GET /compute/v2.1/servers/24678d1b-08b3-4475-aaed-a33d8eed0923" status: 200 len: 1336 microversion: 2.47 time: 0.198145 Oct 19 03:23:21.794522 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1336/2706] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:23:21 2022] GET /compute/v2.1/servers/24678d1b-08b3-4475-aaed-a33d8eed0923 => generated 1336 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:23:21.802298 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-dc2cef60-920a-4936-9d2a-21d0c95925e1 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Calling method '.version_select at 0x7fc130137790>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:23:21.894625 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-dc2cef60-920a-4936-9d2a-21d0c95925e1 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] 10.222.0.52 "GET /compute/v2.1/images/c09f0682-cee7-4a5b-a32d-5b6db22a1d38" status: 200 len: 1455 microversion: 2.1 time: 0.096021 Oct 19 03:23:21.895560 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1337/2707] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:23:21 2022] GET /compute/v2.1/images/c09f0682-cee7-4a5b-a32d-5b6db22a1d38 => generated 1455 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:23:22.419026 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a3fe4ada-a001-4125-a959-167986bc4c95 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:23:22.421920 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a3fe4ada-a001-4125-a959-167986bc4c95 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] [instance: 3b4bc3da-47f7-4719-817f-5636c247c87e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:23:22.452312 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:23:22.457868 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a3fe4ada-a001-4125-a959-167986bc4c95 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:22.458599 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a3fe4ada-a001-4125-a959-167986bc4c95 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:22.459097 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a3fe4ada-a001-4125-a959-167986bc4c95 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:22.459827 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a3fe4ada-a001-4125-a959-167986bc4c95 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:22.463977 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a3fe4ada-a001-4125-a959-167986bc4c95 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:22.464495 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a3fe4ada-a001-4125-a959-167986bc4c95 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:23.751758 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a3fe4ada-a001-4125-a959-167986bc4c95 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3661010393d44c428fb37652b1717072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a1e7cceff48798bfefb9390e5979c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:23:23.767394 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a3fe4ada-a001-4125-a959-167986bc4c95 tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] 10.222.0.52 "GET /compute/v2.1/servers/3b4bc3da-47f7-4719-817f-5636c247c87e" status: 200 len: 1648 microversion: 2.1 time: 1.363577 Oct 19 03:23:23.777585 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1338/2708] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:23:22 2022] GET /compute/v2.1/servers/3b4bc3da-47f7-4719-817f-5636c247c87e => generated 1648 bytes in 1374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:23:23.788227 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1b4465f7-ea41-4155-a0da-6291db55bba2 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '.version_select at 0x7fc1300faca0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:23:23.882520 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1b4465f7-ea41-4155-a0da-6291db55bba2 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/images/9891212c-fa9a-4fc6-b4f5-ab78e62e6e45" status: 200 len: 1410 microversion: 2.1 time: 0.103545 Oct 19 03:23:23.891184 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1339/2709] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:23:23 2022] GET /compute/v2.1/images/9891212c-fa9a-4fc6-b4f5-ab78e62e6e45 => generated 1410 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:23:23.898845 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c6963790-a549-4da8-8c89-ac761857f26b tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:23:23.899457 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c6963790-a549-4da8-8c89-ac761857f26b tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] [instance: 24678d1b-08b3-4475-aaed-a33d8eed0923] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:23:23.922937 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c6963790-a549-4da8-8c89-ac761857f26b tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:23.928307 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c6963790-a549-4da8-8c89-ac761857f26b tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:23.929451 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c6963790-a549-4da8-8c89-ac761857f26b tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:23.932540 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c6963790-a549-4da8-8c89-ac761857f26b tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:23.935658 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c6963790-a549-4da8-8c89-ac761857f26b tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:23.938873 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c6963790-a549-4da8-8c89-ac761857f26b tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:24.567228 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c6963790-a549-4da8-8c89-ac761857f26b tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1ff892953e478b814922c82cc108a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e10c25837184a3983c67f2da5fe74b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:23:24.587613 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c6963790-a549-4da8-8c89-ac761857f26b tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e1ff892953e478b814922c82cc108a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e10c25837184a3983c67f2da5fe74b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:23:24.595925 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c6963790-a549-4da8-8c89-ac761857f26b tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e1ff892953e478b814922c82cc108a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e10c25837184a3983c67f2da5fe74b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:23:24.617906 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c6963790-a549-4da8-8c89-ac761857f26b tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] 10.222.0.52 "GET /compute/v2.1/servers/24678d1b-08b3-4475-aaed-a33d8eed0923" status: 200 len: 1336 microversion: 2.47 time: 0.723557 Oct 19 03:23:24.625363 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1340/2710] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:23:23 2022] GET /compute/v2.1/servers/24678d1b-08b3-4475-aaed-a33d8eed0923 => generated 1336 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:23:24.703342 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-32be0901-8514-4bb0-94fb-33d2e7705ee1 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Calling method '.version_select at 0x7fc130129ca0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:23:25.588248 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=14 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:23:29.624959 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-ec8bc249-ca14-4935-a7fe-6aa2e14fe586 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Flavor limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:23:29.626015 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-ec8bc249-ca14-4935-a7fe-6aa2e14fe586 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Image limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:23:29.626671 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-ec8bc249-ca14-4935-a7fe-6aa2e14fe586 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Flavor pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:23:29.627099 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-ec8bc249-ca14-4935-a7fe-6aa2e14fe586 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Image pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:23:29.627675 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-ec8bc249-ca14-4935-a7fe-6aa2e14fe586 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:23:29.647835 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ec8bc249-ca14-4935-a7fe-6aa2e14fe586 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:29.648355 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ec8bc249-ca14-4935-a7fe-6aa2e14fe586 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:29.651693 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ec8bc249-ca14-4935-a7fe-6aa2e14fe586 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:29.652868 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ec8bc249-ca14-4935-a7fe-6aa2e14fe586 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:29.654911 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ec8bc249-ca14-4935-a7fe-6aa2e14fe586 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:29.655640 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ec8bc249-ca14-4935-a7fe-6aa2e14fe586 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:29.699604 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-ec8bc249-ca14-4935-a7fe-6aa2e14fe586 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Getting quotas for project 3de899450062428e8cd4686ae84de2eb. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:23:29.716930 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-ec8bc249-ca14-4935-a7fe-6aa2e14fe586 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Getting quotas for user 1804c1df36f347feb017deec5eef9dbb and project 3de899450062428e8cd4686ae84de2eb. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:23:30.076968 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ec8bc249-ca14-4935-a7fe-6aa2e14fe586 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Going to run 1 instances... {{(pid=121135) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:23:30.080384 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ec8bc249-ca14-4935-a7fe-6aa2e14fe586 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] [instance: cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='9e116d77-182d-4d99-b6c4-a1131f592f04',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='9c15ca04-9341-480c-9c6b-f94519f4ce28',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='be873a16-1c4e-4da2-8616-bdff73a9ff63',volume_size=None,volume_type=None)] {{(pid=121135) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:23:32.641620 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ec8bc249-ca14-4935-a7fe-6aa2e14fe586 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.42 time: 11.317869 Oct 19 03:23:32.653143 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1371/2711] 10.222.0.52 () {62 vars in 1189 bytes} [Wed Oct 19 03:23:21 2022] POST /compute/v2.1/servers => generated 406 bytes in 11331 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 19 03:23:32.674737 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a93a8ef1-ade5-451c-9407-4a52fe2730ae tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:23:32.675279 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a93a8ef1-ade5-451c-9407-4a52fe2730ae tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] [instance: 3b4bc3da-47f7-4719-817f-5636c247c87e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:23:32.694189 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a93a8ef1-ade5-451c-9407-4a52fe2730ae tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:32.694616 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a93a8ef1-ade5-451c-9407-4a52fe2730ae tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:32.695069 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a93a8ef1-ade5-451c-9407-4a52fe2730ae tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:32.695795 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a93a8ef1-ade5-451c-9407-4a52fe2730ae tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:32.696259 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a93a8ef1-ade5-451c-9407-4a52fe2730ae tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:32.696695 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a93a8ef1-ade5-451c-9407-4a52fe2730ae tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:32.766623 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-a93a8ef1-ade5-451c-9407-4a52fe2730ae tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] HTTP exception thrown: Instance 3b4bc3da-47f7-4719-817f-5636c247c87e could not be found. Oct 19 03:23:32.766623 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a93a8ef1-ade5-451c-9407-4a52fe2730ae tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Request method failure captured: Oct 19 03:23:32.766623 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/3b4bc3da-47f7-4719-817f-5636c247c87e HTTP/1.1 Oct 19 03:23:32.766623 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:23:32.766623 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:23:32.766623 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:23:32.766623 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:23:32.766623 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:23:32.766623 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:23:32.766623 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:23:32.766623 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:23:32.766623 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT200KvQGsyi_a_sB4TfhhJOzMfG19jSa6oSlia6bg0oJGWsETmIFLMxsrnEQMCxFlXYpeXPwW52kFxfganN5M4cxj3tahAijx2xJ--2WsWYJtuNU3tc5IIgL3W8HC4CGP3frn8iROEzLPCi1mQC1-zUvq06vNZR4ARbYNlrlnvumYqI Oct 19 03:23:32.766623 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:23:32.766623 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:23:32.766623 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:23:32.766623 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:23:32.766623 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:23:32.766623 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:23:32.766623 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 385a1e7cceff48798bfefb9390e5979c Oct 19 03:23:32.766623 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-SecurityGroupsTestJSON-637911912 Oct 19 03:23:32.766623 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:23:32.766623 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:23:32.767930 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/385a1e7cceff48798bfefb9390e5979c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/385a1e7cceff48798bfefb9390e5979c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/385a1e7cceff48798bfefb9390e5979c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_385a1e7cceff48798bfefb9390e5979c", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:23:32.767930 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-SecurityGroupsTestJSON-637911912 Oct 19 03:23:32.767930 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 385a1e7cceff48798bfefb9390e5979c Oct 19 03:23:32.767930 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-637911912 Oct 19 03:23:32.767930 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-SecurityGroupsTestJSON-637911912-project Oct 19 03:23:32.767930 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:23:32.767930 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:23:32.767930 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 3661010393d44c428fb37652b1717072 Oct 19 03:23:32.767930 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-SecurityGroupsTestJSON-637911912-project Oct 19 03:23:32.767930 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:23:32.767930 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance 3b4bc3da-47f7-4719-817f-5636c247c87e could not be found. Oct 19 03:23:32.767930 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '3b4bc3da-47f7-4719-817f-5636c247c87e'} Oct 19 03:23:32.768674 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:23:32.768674 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:23:32.768674 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:23:32.768674 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:23:32.768674 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:23:32.768674 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:23:32.768674 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:23:32.768674 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:23:32.768674 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:23:32.768674 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:23:32.768674 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b4bc3da-47f7-4719-817f-5636c247c87e could not be found. Oct 19 03:23:32.768674 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:23:32.768674 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:23:32.768674 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:23:32.768674 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:23:32.768674 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:23:32.768674 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:23:32.768674 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:23:32.768674 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:23:32.768674 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:23:32.769993 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:23:32.769993 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:23:32.769993 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:23:32.769993 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:23:32.769993 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:23:32.769993 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:23:32.769993 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:23:32.769993 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b4bc3da-47f7-4719-817f-5636c247c87e could not be found. Oct 19 03:23:32.769993 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:23:32.769993 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:23:32.769993 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:23:32.769993 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:23:32.769993 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:23:32.769993 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:23:32.769993 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:23:32.769993 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:23:32.769993 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b4bc3da-47f7-4719-817f-5636c247c87e could not be found. Oct 19 03:23:32.769993 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:23:32.773936 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a93a8ef1-ade5-451c-9407-4a52fe2730ae tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Returning 404 to user: Instance 3b4bc3da-47f7-4719-817f-5636c247c87e could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:23:32.773936 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a93a8ef1-ade5-451c-9407-4a52fe2730ae tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] 10.222.0.52 "GET /compute/v2.1/servers/3b4bc3da-47f7-4719-817f-5636c247c87e" status: 404 len: 111 microversion: 2.1 time: 0.113189 Oct 19 03:23:32.788385 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1372/2712] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:23:32 2022] GET /compute/v2.1/servers/3b4bc3da-47f7-4719-817f-5636c247c87e => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:23:32.802925 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4c368828-b1f9-4635-9aa3-421fa057af02 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '.version_select at 0x7fc1301d7940>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:23:34.572612 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:23:35.073731 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=3 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:23:39.675951 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:23:39.736375 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=6 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:23:42.695413 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:23:42.730969 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=27,nova_cell1:INSERT=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:23:46.233740 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-32be0901-8514-4bb0-94fb-33d2e7705ee1 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] 10.222.0.52 "GET /compute/v2.1/images/c09f0682-cee7-4a5b-a32d-5b6db22a1d38" status: 200 len: 1455 microversion: 2.1 time: 21.601900 Oct 19 03:23:46.234320 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1341/2713] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:23:24 2022] GET /compute/v2.1/images/c09f0682-cee7-4a5b-a32d-5b6db22a1d38 => generated 1455 bytes in 21608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:23:46.246278 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-351eb658-285a-4567-9b85-79633c1b95e1 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:23:46.248126 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-351eb658-285a-4567-9b85-79633c1b95e1 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] [instance: 24678d1b-08b3-4475-aaed-a33d8eed0923] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:23:46.263041 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-351eb658-285a-4567-9b85-79633c1b95e1 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:46.265175 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-351eb658-285a-4567-9b85-79633c1b95e1 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:46.265672 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-351eb658-285a-4567-9b85-79633c1b95e1 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:46.266905 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-351eb658-285a-4567-9b85-79633c1b95e1 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:46.267198 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-351eb658-285a-4567-9b85-79633c1b95e1 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:46.267634 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-351eb658-285a-4567-9b85-79633c1b95e1 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:46.411038 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-351eb658-285a-4567-9b85-79633c1b95e1 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1ff892953e478b814922c82cc108a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e10c25837184a3983c67f2da5fe74b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:23:46.425593 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-351eb658-285a-4567-9b85-79633c1b95e1 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e1ff892953e478b814922c82cc108a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e10c25837184a3983c67f2da5fe74b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:23:46.427086 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-351eb658-285a-4567-9b85-79633c1b95e1 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e1ff892953e478b814922c82cc108a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e10c25837184a3983c67f2da5fe74b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:23:46.428369 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-351eb658-285a-4567-9b85-79633c1b95e1 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] 10.222.0.52 "GET /compute/v2.1/servers/24678d1b-08b3-4475-aaed-a33d8eed0923" status: 200 len: 1357 microversion: 2.47 time: 0.193130 Oct 19 03:23:46.428955 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1342/2714] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:23:46 2022] GET /compute/v2.1/servers/24678d1b-08b3-4475-aaed-a33d8eed0923 => generated 1357 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:23:46.557528 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-fa29eafd-a925-4644-aeb3-f95b6ddbfd2b req-88ecc613-248d-44e8-a7de-fe304fbe433f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b4bc3da-47f7-4719-817f-5636c247c87e", "name": "network-vif-deleted", "tag": "895e29f8-be3d-4fe5-9b3a-5b5bfaa322fc"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:23:46.577493 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-fa29eafd-a925-4644-aeb3-f95b6ddbfd2b req-88ecc613-248d-44e8-a7de-fe304fbe433f service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:46.578297 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4c368828-b1f9-4635-9aa3-421fa057af02 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/images/9891212c-fa9a-4fc6-b4f5-ab78e62e6e45" status: 200 len: 1410 microversion: 2.1 time: 13.788722 Oct 19 03:23:46.579210 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-fa29eafd-a925-4644-aeb3-f95b6ddbfd2b req-88ecc613-248d-44e8-a7de-fe304fbe433f service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:46.579827 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-fa29eafd-a925-4644-aeb3-f95b6ddbfd2b req-88ecc613-248d-44e8-a7de-fe304fbe433f service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:46.588206 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1373/2715] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:23:32 2022] GET /compute/v2.1/images/9891212c-fa9a-4fc6-b4f5-ab78e62e6e45 => generated 1410 bytes in 13797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:23:46.610162 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-b475a11b-d86d-4637-a21d-12d2ade8721d req-b8b6cb2d-ccb9-4f13-8eca-5f3b660718a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c45890de-f7bf-4736-8b08-6f3e6863e2b3", "name": "network-vif-plugged", "status": "completed", "tag": "6dfdbd8b-f3ab-4274-8a35-fe995bdd3cba"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:23:46.630631 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-fa29eafd-a925-4644-aeb3-f95b6ddbfd2b req-88ecc613-248d-44e8-a7de-fe304fbe433f service nova] Creating event network-vif-deleted:895e29f8-be3d-4fe5-9b3a-5b5bfaa322fc for instance 3b4bc3da-47f7-4719-817f-5636c247c87e on n-h1-861333-8 Oct 19 03:23:46.657972 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-fa29eafd-a925-4644-aeb3-f95b6ddbfd2b req-88ecc613-248d-44e8-a7de-fe304fbe433f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.217284 Oct 19 03:23:46.657972 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1343/2716] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:23:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:23:46.679367 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-89bb3cc2-e66d-40f3-9ca0-3bb7e2812ce0 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:23:46.681326 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-89bb3cc2-e66d-40f3-9ca0-3bb7e2812ce0 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] [instance: cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:23:46.697036 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-89bb3cc2-e66d-40f3-9ca0-3bb7e2812ce0 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:46.701058 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-89bb3cc2-e66d-40f3-9ca0-3bb7e2812ce0 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:46.714478 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-89bb3cc2-e66d-40f3-9ca0-3bb7e2812ce0 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:46.715872 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-b475a11b-d86d-4637-a21d-12d2ade8721d req-b8b6cb2d-ccb9-4f13-8eca-5f3b660718a8 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:46.724391 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-b475a11b-d86d-4637-a21d-12d2ade8721d req-b8b6cb2d-ccb9-4f13-8eca-5f3b660718a8 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:46.727394 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-89bb3cc2-e66d-40f3-9ca0-3bb7e2812ce0 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:46.730161 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-b475a11b-d86d-4637-a21d-12d2ade8721d req-b8b6cb2d-ccb9-4f13-8eca-5f3b660718a8 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:46.730910 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-89bb3cc2-e66d-40f3-9ca0-3bb7e2812ce0 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:46.733223 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-89bb3cc2-e66d-40f3-9ca0-3bb7e2812ce0 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:46.791832 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-b475a11b-d86d-4637-a21d-12d2ade8721d req-b8b6cb2d-ccb9-4f13-8eca-5f3b660718a8 service nova] Creating event network-vif-plugged:6dfdbd8b-f3ab-4274-8a35-fe995bdd3cba for instance c45890de-f7bf-4736-8b08-6f3e6863e2b3 on n-h2-861333-8 Oct 19 03:23:46.805513 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-b475a11b-d86d-4637-a21d-12d2ade8721d req-b8b6cb2d-ccb9-4f13-8eca-5f3b660718a8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.213318 Oct 19 03:23:46.808780 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1374/2717] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:23:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:23:46.828496 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-05b71648-1d82-4015-8ae8-c9d6a42543dc tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Calling method '.version_select at 0x7fc130172dc0>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:23:47.335600 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-89bb3cc2-e66d-40f3-9ca0-3bb7e2812ce0 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:23:47.355614 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-89bb3cc2-e66d-40f3-9ca0-3bb7e2812ce0 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:23:47.358486 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-89bb3cc2-e66d-40f3-9ca0-3bb7e2812ce0 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:23:47.359949 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-89bb3cc2-e66d-40f3-9ca0-3bb7e2812ce0 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] 10.222.0.52 "GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95" status: 200 len: 1802 microversion: 2.42 time: 0.704205 Oct 19 03:23:47.374066 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1344/2718] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:23:46 2022] GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 => generated 1802 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:23:47.495156 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ab25a187-a7a9-429a-928a-e1f39df8f1c8 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-870954496", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "networks": [{"uuid": "8936f55f-9ffa-46d8-8ece-d8a531cfe6c3"}]}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:23:47.612822 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-ab25a187-a7a9-429a-928a-e1f39df8f1c8 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] validate_networks() for [('8936f55f-9ffa-46d8-8ece-d8a531cfe6c3', None, None, None, None, None)] {{(pid=121134) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:23:48.230470 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-05b71648-1d82-4015-8ae8-c9d6a42543dc tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/99302a35-1b72-4bc5-a436-844764955de8" status: 202 len: 0 microversion: 2.1 time: 1.419729 Oct 19 03:23:48.239320 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1375/2719] 10.222.0.52 () {58 vars in 1272 bytes} [Wed Oct 19 03:23:46 2022] DELETE /compute/v2.1/os-security-groups/99302a35-1b72-4bc5-a436-844764955de8 => generated 0 bytes in 1430 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:23:48.246683 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-35febe59-be85-4615-9260-8405b4f5c634 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:23:48.250401 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-35febe59-be85-4615-9260-8405b4f5c634 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] [instance: 24678d1b-08b3-4475-aaed-a33d8eed0923] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:23:48.258551 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-35febe59-be85-4615-9260-8405b4f5c634 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:48.259332 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-35febe59-be85-4615-9260-8405b4f5c634 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:48.259941 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-35febe59-be85-4615-9260-8405b4f5c634 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:48.260828 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-35febe59-be85-4615-9260-8405b4f5c634 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:48.261534 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-35febe59-be85-4615-9260-8405b4f5c634 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:48.262120 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-35febe59-be85-4615-9260-8405b4f5c634 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:48.416693 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-35febe59-be85-4615-9260-8405b4f5c634 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Flavor limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:23:48.424254 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-35febe59-be85-4615-9260-8405b4f5c634 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Image limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:23:48.424254 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-35febe59-be85-4615-9260-8405b4f5c634 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Flavor pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:23:48.424254 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-35febe59-be85-4615-9260-8405b4f5c634 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Image pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:23:48.424254 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-35febe59-be85-4615-9260-8405b4f5c634 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:23:48.680514 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-35febe59-be85-4615-9260-8405b4f5c634 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] [instance: 24678d1b-08b3-4475-aaed-a33d8eed0923] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:23:48.688762 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-ab25a187-a7a9-429a-928a-e1f39df8f1c8 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Flavor limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:23:48.689817 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-ab25a187-a7a9-429a-928a-e1f39df8f1c8 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Image limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:23:48.691468 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-ab25a187-a7a9-429a-928a-e1f39df8f1c8 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Flavor pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:23:48.692140 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-ab25a187-a7a9-429a-928a-e1f39df8f1c8 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Image pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:23:48.692850 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-ab25a187-a7a9-429a-928a-e1f39df8f1c8 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:23:48.707742 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ab25a187-a7a9-429a-928a-e1f39df8f1c8 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:48.710343 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-35febe59-be85-4615-9260-8405b4f5c634 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:48.713806 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-35febe59-be85-4615-9260-8405b4f5c634 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:48.715402 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-35febe59-be85-4615-9260-8405b4f5c634 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:48.715402 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-35febe59-be85-4615-9260-8405b4f5c634 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:48.716244 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ab25a187-a7a9-429a-928a-e1f39df8f1c8 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:48.716920 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ab25a187-a7a9-429a-928a-e1f39df8f1c8 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:48.717337 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-35febe59-be85-4615-9260-8405b4f5c634 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:48.718252 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ab25a187-a7a9-429a-928a-e1f39df8f1c8 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:48.722725 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-35febe59-be85-4615-9260-8405b4f5c634 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:48.723522 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ab25a187-a7a9-429a-928a-e1f39df8f1c8 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:48.725923 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ab25a187-a7a9-429a-928a-e1f39df8f1c8 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:48.788003 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-ab25a187-a7a9-429a-928a-e1f39df8f1c8 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Getting quotas for project 8019441bff8642cebf21fd1c4e890196. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:23:48.802710 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-ab25a187-a7a9-429a-928a-e1f39df8f1c8 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Getting quotas for user 2b5b2cb1272541dfbc2659cf4adf9026 and project 8019441bff8642cebf21fd1c4e890196. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:23:48.807466 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-35febe59-be85-4615-9260-8405b4f5c634 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] 10.222.0.52 "POST /compute/v2.1/servers/24678d1b-08b3-4475-aaed-a33d8eed0923/action" status: 202 len: 1079 microversion: 2.47 time: 0.565454 Oct 19 03:23:48.820532 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1376/2720] 10.222.0.52 () {62 vars in 1319 bytes} [Wed Oct 19 03:23:48 2022] POST /compute/v2.1/servers/24678d1b-08b3-4475-aaed-a33d8eed0923/action => generated 1079 bytes in 580 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 19 03:23:48.832736 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6a0fdba9-14e7-4a3a-88e6-21f57b75d5bf tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Calling method '.version_select at 0x7fc130203940>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:23:48.849712 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ab25a187-a7a9-429a-928a-e1f39df8f1c8 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Going to run 1 instances... {{(pid=121134) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:23:48.853863 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ab25a187-a7a9-429a-928a-e1f39df8f1c8 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: fc300547-2017-4a58-8afc-350a262b5450] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:23:48.923758 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6a0fdba9-14e7-4a3a-88e6-21f57b75d5bf tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] 10.222.0.52 "GET /compute/v2.1/images/c09f0682-cee7-4a5b-a32d-5b6db22a1d38" status: 200 len: 1464 microversion: 2.1 time: 0.100001 Oct 19 03:23:48.926670 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1377/2721] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:23:48 2022] GET /compute/v2.1/images/c09f0682-cee7-4a5b-a32d-5b6db22a1d38 => generated 1464 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:23:48.943036 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-99a1f59c-efe5-401f-821b-25a05337fe63 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '.version_select at 0x7fc1301d7550>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:23:49.010266 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-99a1f59c-efe5-401f-821b-25a05337fe63 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/images/9891212c-fa9a-4fc6-b4f5-ab78e62e6e45" status: 200 len: 1419 microversion: 2.1 time: 0.071339 Oct 19 03:23:49.017793 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1378/2722] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:23:48 2022] GET /compute/v2.1/images/9891212c-fa9a-4fc6-b4f5-ab78e62e6e45 => generated 1419 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:23:49.029047 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f9924fd7-cf60-4517-ab34-9a6df8187eee tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] Calling method '.version_select at 0x7fc130203e50>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:23:49.062935 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ab25a187-a7a9-429a-928a-e1f39df8f1c8 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.687314 Oct 19 03:23:49.066776 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1345/2723] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:23:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1692 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 03:23:49.083710 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2f1f5dea-3fb7-4b6a-baf7-08c1ec91ea06 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:23:49.084474 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2f1f5dea-3fb7-4b6a-baf7-08c1ec91ea06 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] [instance: cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:23:49.103215 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2f1f5dea-3fb7-4b6a-baf7-08c1ec91ea06 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:49.110129 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2f1f5dea-3fb7-4b6a-baf7-08c1ec91ea06 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:49.110857 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2f1f5dea-3fb7-4b6a-baf7-08c1ec91ea06 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:49.114395 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2f1f5dea-3fb7-4b6a-baf7-08c1ec91ea06 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:49.118775 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2f1f5dea-3fb7-4b6a-baf7-08c1ec91ea06 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:49.119578 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2f1f5dea-3fb7-4b6a-baf7-08c1ec91ea06 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:49.544730 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-2f1f5dea-3fb7-4b6a-baf7-08c1ec91ea06 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:23:49.566365 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-2f1f5dea-3fb7-4b6a-baf7-08c1ec91ea06 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:23:49.572678 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-2f1f5dea-3fb7-4b6a-baf7-08c1ec91ea06 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:23:49.574822 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2f1f5dea-3fb7-4b6a-baf7-08c1ec91ea06 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] 10.222.0.52 "GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95" status: 200 len: 1849 microversion: 2.42 time: 0.506787 Oct 19 03:23:49.613091 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1346/2724] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:23:49 2022] GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 => generated 1849 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:23:49.618661 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a43e1986-4d08-4b0b-955b-249338a2fef2 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:23:49.619790 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a43e1986-4d08-4b0b-955b-249338a2fef2 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] [instance: 24678d1b-08b3-4475-aaed-a33d8eed0923] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:23:49.648370 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a43e1986-4d08-4b0b-955b-249338a2fef2 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:49.649744 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a43e1986-4d08-4b0b-955b-249338a2fef2 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:49.650477 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a43e1986-4d08-4b0b-955b-249338a2fef2 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:49.652102 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a43e1986-4d08-4b0b-955b-249338a2fef2 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:49.652813 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a43e1986-4d08-4b0b-955b-249338a2fef2 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:49.656132 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a43e1986-4d08-4b0b-955b-249338a2fef2 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:49.846416 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a43e1986-4d08-4b0b-955b-249338a2fef2 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1ff892953e478b814922c82cc108a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e10c25837184a3983c67f2da5fe74b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:23:49.865748 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a43e1986-4d08-4b0b-955b-249338a2fef2 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e1ff892953e478b814922c82cc108a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e10c25837184a3983c67f2da5fe74b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:23:49.868281 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a43e1986-4d08-4b0b-955b-249338a2fef2 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e1ff892953e478b814922c82cc108a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e10c25837184a3983c67f2da5fe74b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:23:49.869975 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a43e1986-4d08-4b0b-955b-249338a2fef2 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] 10.222.0.52 "GET /compute/v2.1/servers/24678d1b-08b3-4475-aaed-a33d8eed0923" status: 200 len: 1366 microversion: 2.47 time: 0.255454 Oct 19 03:23:49.881758 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1347/2725] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:23:49 2022] GET /compute/v2.1/servers/24678d1b-08b3-4475-aaed-a33d8eed0923 => generated 1366 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:23:49.913182 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f6f46bff-5eb9-4f64-b4eb-6f5907d8d7bb tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Calling method '.version_select at 0x7fc1301be4c0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:23:49.994056 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f6f46bff-5eb9-4f64-b4eb-6f5907d8d7bb tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] 10.222.0.52 "GET /compute/v2.1/images/c09f0682-cee7-4a5b-a32d-5b6db22a1d38" status: 200 len: 1464 microversion: 2.1 time: 0.110854 Oct 19 03:23:50.003708 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1348/2726] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:23:49 2022] GET /compute/v2.1/images/c09f0682-cee7-4a5b-a32d-5b6db22a1d38 => generated 1464 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:23:50.020596 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ebff197c-0bf2-4f9e-85bc-d43f13ac9f13 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '.version_select at 0x7fc130137b80>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:23:50.097671 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ebff197c-0bf2-4f9e-85bc-d43f13ac9f13 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/images/9891212c-fa9a-4fc6-b4f5-ab78e62e6e45" status: 200 len: 1419 microversion: 2.1 time: 0.092346 Oct 19 03:23:50.099257 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1349/2727] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:23:50 2022] GET /compute/v2.1/images/9891212c-fa9a-4fc6-b4f5-ab78e62e6e45 => generated 1419 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:23:50.114714 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9475d6ae-ab3b-425b-a464-5367464c7fcb tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:23:50.116754 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9475d6ae-ab3b-425b-a464-5367464c7fcb tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: fc300547-2017-4a58-8afc-350a262b5450] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:23:50.173230 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f9924fd7-cf60-4517-ab34-9a6df8187eee tempest-SecurityGroupsTestJSON-637911912 tempest-SecurityGroupsTestJSON-637911912-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/627fdd43-93ea-4c4f-b36a-2438f9898580" status: 202 len: 0 microversion: 2.1 time: 1.154005 Oct 19 03:23:50.179751 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1379/2728] 10.222.0.52 () {58 vars in 1272 bytes} [Wed Oct 19 03:23:49 2022] DELETE /compute/v2.1/os-security-groups/627fdd43-93ea-4c4f-b36a-2438f9898580 => generated 0 bytes in 1161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:23:50.185819 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-21455b2f-5714-4f7b-888c-c491d2be28ae tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:23:50.186721 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-21455b2f-5714-4f7b-888c-c491d2be28ae tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] [instance: 6ef505a5-0624-4080-9089-821f6fdfb47c] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:23:50.228048 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-21455b2f-5714-4f7b-888c-c491d2be28ae tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:50.229570 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-21455b2f-5714-4f7b-888c-c491d2be28ae tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:50.230305 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-21455b2f-5714-4f7b-888c-c491d2be28ae tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:50.231927 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-21455b2f-5714-4f7b-888c-c491d2be28ae tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:50.233167 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-21455b2f-5714-4f7b-888c-c491d2be28ae tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:50.234130 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-21455b2f-5714-4f7b-888c-c491d2be28ae tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:50.238390 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9475d6ae-ab3b-425b-a464-5367464c7fcb tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:23:50.248209 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9475d6ae-ab3b-425b-a464-5367464c7fcb tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/fc300547-2017-4a58-8afc-350a262b5450" status: 200 len: 1210 microversion: 2.1 time: 0.147886 Oct 19 03:23:50.249677 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1350/2729] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:23:50 2022] GET /compute/v2.1/servers/fc300547-2017-4a58-8afc-350a262b5450 => generated 1210 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:23:50.259961 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-67f9d0af-cd73-46f3-9199-46dcdf0c3803 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '.version_select at 0x7fc130137e50>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:23:50.686727 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-21455b2f-5714-4f7b-888c-c491d2be28ae tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a222bb0f9a4c728d2ed5ca011c032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146393855c047be83270e5334c68e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:23:50.696723 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-21455b2f-5714-4f7b-888c-c491d2be28ae tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] 10.222.0.52 "GET /compute/v2.1/servers/6ef505a5-0624-4080-9089-821f6fdfb47c" status: 200 len: 1467 microversion: 2.1 time: 0.515431 Oct 19 03:23:50.702484 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1380/2730] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:23:50 2022] GET /compute/v2.1/servers/6ef505a5-0624-4080-9089-821f6fdfb47c => generated 1467 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:23:50.712264 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c66c8a5d-6e94-4814-8adb-6add46f78204 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:23:50.713084 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c66c8a5d-6e94-4814-8adb-6add46f78204 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] [instance: cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:23:50.749444 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c66c8a5d-6e94-4814-8adb-6add46f78204 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:50.751627 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c66c8a5d-6e94-4814-8adb-6add46f78204 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:50.753024 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c66c8a5d-6e94-4814-8adb-6add46f78204 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:50.755227 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c66c8a5d-6e94-4814-8adb-6add46f78204 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:50.756381 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c66c8a5d-6e94-4814-8adb-6add46f78204 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:50.761232 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c66c8a5d-6e94-4814-8adb-6add46f78204 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:51.012647 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c66c8a5d-6e94-4814-8adb-6add46f78204 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:23:51.024471 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c66c8a5d-6e94-4814-8adb-6add46f78204 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:23:51.026400 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c66c8a5d-6e94-4814-8adb-6add46f78204 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:23:51.028606 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c66c8a5d-6e94-4814-8adb-6add46f78204 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] 10.222.0.52 "GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95" status: 200 len: 1849 microversion: 2.42 time: 0.324178 Oct 19 03:23:51.029878 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1381/2731] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:23:50 2022] GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 => generated 1849 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:23:51.035062 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5c951bb2-a29a-4caf-bb16-040f329ed26c tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1234035374"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:23:51.040941 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-5c951bb2-a29a-4caf-bb16-040f329ed26c tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] [instance: 410116db-4d00-4a9d-8375-a5cea6a0d627] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:23:51.053804 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5c951bb2-a29a-4caf-bb16-040f329ed26c tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:51.055116 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5c951bb2-a29a-4caf-bb16-040f329ed26c tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:51.055607 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5c951bb2-a29a-4caf-bb16-040f329ed26c tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:51.056448 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5c951bb2-a29a-4caf-bb16-040f329ed26c tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:51.056927 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5c951bb2-a29a-4caf-bb16-040f329ed26c tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:51.057512 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5c951bb2-a29a-4caf-bb16-040f329ed26c tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:51.785687 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5c951bb2-a29a-4caf-bb16-040f329ed26c tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] 10.222.0.52 "POST /compute/v2.1/servers/410116db-4d00-4a9d-8375-a5cea6a0d627/action" status: 202 len: 0 microversion: 2.1 time: 0.751994 Oct 19 03:23:51.797975 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1382/2732] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:23:51 2022] POST /compute/v2.1/servers/410116db-4d00-4a9d-8375-a5cea6a0d627/action => generated 0 bytes in 767 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 19 03:23:51.808754 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-591bf6cb-fe12-4ddd-a795-21e4afede20c tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:23:51.816241 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-591bf6cb-fe12-4ddd-a795-21e4afede20c tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] [instance: 24678d1b-08b3-4475-aaed-a33d8eed0923] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:23:51.837275 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-591bf6cb-fe12-4ddd-a795-21e4afede20c tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:51.845511 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-591bf6cb-fe12-4ddd-a795-21e4afede20c tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:51.846457 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-591bf6cb-fe12-4ddd-a795-21e4afede20c tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:51.849502 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-591bf6cb-fe12-4ddd-a795-21e4afede20c tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:51.850066 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-591bf6cb-fe12-4ddd-a795-21e4afede20c tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:51.850579 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-591bf6cb-fe12-4ddd-a795-21e4afede20c tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:52.160480 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-591bf6cb-fe12-4ddd-a795-21e4afede20c tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1ff892953e478b814922c82cc108a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e10c25837184a3983c67f2da5fe74b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:23:52.186008 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-591bf6cb-fe12-4ddd-a795-21e4afede20c tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e1ff892953e478b814922c82cc108a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e10c25837184a3983c67f2da5fe74b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:23:52.192456 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-591bf6cb-fe12-4ddd-a795-21e4afede20c tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e1ff892953e478b814922c82cc108a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e10c25837184a3983c67f2da5fe74b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:23:52.207732 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-591bf6cb-fe12-4ddd-a795-21e4afede20c tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] 10.222.0.52 "GET /compute/v2.1/servers/24678d1b-08b3-4475-aaed-a33d8eed0923" status: 200 len: 1366 microversion: 2.47 time: 0.408014 Oct 19 03:23:52.230571 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1383/2733] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:23:51 2022] GET /compute/v2.1/servers/24678d1b-08b3-4475-aaed-a33d8eed0923 => generated 1366 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:23:52.246853 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-246f1a65-92ed-4572-b63d-13bb1e7e1e85 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:23:52.248257 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-246f1a65-92ed-4572-b63d-13bb1e7e1e85 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: fc300547-2017-4a58-8afc-350a262b5450] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:23:52.287397 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-246f1a65-92ed-4572-b63d-13bb1e7e1e85 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:52.289974 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-246f1a65-92ed-4572-b63d-13bb1e7e1e85 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:52.291815 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-246f1a65-92ed-4572-b63d-13bb1e7e1e85 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:52.292735 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-246f1a65-92ed-4572-b63d-13bb1e7e1e85 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:52.305096 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-246f1a65-92ed-4572-b63d-13bb1e7e1e85 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:52.316297 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-246f1a65-92ed-4572-b63d-13bb1e7e1e85 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:52.376975 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-67f9d0af-cd73-46f3-9199-46dcdf0c3803 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "DELETE /compute/v2.1/images/9891212c-fa9a-4fc6-b4f5-ab78e62e6e45" status: 204 len: 0 microversion: 2.1 time: 2.126005 Oct 19 03:23:52.377837 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1351/2734] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:23:50 2022] DELETE /compute/v2.1/images/9891212c-fa9a-4fc6-b4f5-ab78e62e6e45 => generated 0 bytes in 2127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:23:52.384068 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-75597921-e481-4662-b6ef-561958640370 req-f1491e60-e70d-4c77-b5eb-685aa87bc221 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ef505a5-0624-4080-9089-821f6fdfb47c", "name": "network-vif-unplugged", "status": "completed", "tag": "3d68ba4c-839d-44ea-b4e3-7563b0f4650a"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:23:52.421307 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-75597921-e481-4662-b6ef-561958640370 req-f1491e60-e70d-4c77-b5eb-685aa87bc221 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:52.425133 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-75597921-e481-4662-b6ef-561958640370 req-f1491e60-e70d-4c77-b5eb-685aa87bc221 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:52.427168 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-75597921-e481-4662-b6ef-561958640370 req-f1491e60-e70d-4c77-b5eb-685aa87bc221 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:52.468574 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-75597921-e481-4662-b6ef-561958640370 req-f1491e60-e70d-4c77-b5eb-685aa87bc221 service nova] Creating event network-vif-unplugged:3d68ba4c-839d-44ea-b4e3-7563b0f4650a for instance 6ef505a5-0624-4080-9089-821f6fdfb47c on n-h1-861333-8 Oct 19 03:23:52.483554 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-75597921-e481-4662-b6ef-561958640370 req-f1491e60-e70d-4c77-b5eb-685aa87bc221 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.103843 Oct 19 03:23:52.485845 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1352/2735] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:23:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:23:52.499570 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c5d3f295-11d1-44f3-bcc3-c7ca854dc5b7 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Calling method '.version_select at 0x7fc13010ab80>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:23:52.582344 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c5d3f295-11d1-44f3-bcc3-c7ca854dc5b7 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] 10.222.0.52 "GET /compute/v2.1/images/f79fed39-c87d-4cd3-891b-877f8e1da73d" status: 200 len: 1455 microversion: 2.1 time: 0.093995 Oct 19 03:23:52.587546 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1353/2736] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:23:52 2022] GET /compute/v2.1/images/f79fed39-c87d-4cd3-891b-877f8e1da73d => generated 1455 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:23:52.598243 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-f2dcc74f-7186-424e-9d0e-02f9978aec18 req-09420538-ffb9-4715-9c5b-a217ba8be04a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95", "tag": "65396b7f-6d0e-408a-b3e0-4a8c18d5caa3"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:23:52.631066 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-f2dcc74f-7186-424e-9d0e-02f9978aec18 req-09420538-ffb9-4715-9c5b-a217ba8be04a service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:52.631970 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-f2dcc74f-7186-424e-9d0e-02f9978aec18 req-09420538-ffb9-4715-9c5b-a217ba8be04a service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:52.632643 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-f2dcc74f-7186-424e-9d0e-02f9978aec18 req-09420538-ffb9-4715-9c5b-a217ba8be04a service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:52.660436 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-f2dcc74f-7186-424e-9d0e-02f9978aec18 req-09420538-ffb9-4715-9c5b-a217ba8be04a service nova] Creating event network-changed:65396b7f-6d0e-408a-b3e0-4a8c18d5caa3 for instance cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 on n-h2-861333-8 Oct 19 03:23:52.684758 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-f2dcc74f-7186-424e-9d0e-02f9978aec18 req-09420538-ffb9-4715-9c5b-a217ba8be04a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086118 Oct 19 03:23:52.684758 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1354/2737] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:23:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:23:52.697847 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4c97b361-b7d6-428b-92b6-57fc864b2d66 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:23:52.700044 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4c97b361-b7d6-428b-92b6-57fc864b2d66 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] [instance: cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:23:52.718787 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4c97b361-b7d6-428b-92b6-57fc864b2d66 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:52.719760 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4c97b361-b7d6-428b-92b6-57fc864b2d66 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:52.720433 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4c97b361-b7d6-428b-92b6-57fc864b2d66 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:52.721470 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4c97b361-b7d6-428b-92b6-57fc864b2d66 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:52.724098 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4c97b361-b7d6-428b-92b6-57fc864b2d66 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:52.726303 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4c97b361-b7d6-428b-92b6-57fc864b2d66 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:52.834689 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-246f1a65-92ed-4572-b63d-13bb1e7e1e85 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:23:52.861643 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-246f1a65-92ed-4572-b63d-13bb1e7e1e85 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/fc300547-2017-4a58-8afc-350a262b5450" status: 200 len: 1262 microversion: 2.1 time: 0.629560 Oct 19 03:23:52.862920 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1384/2738] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:23:52 2022] GET /compute/v2.1/servers/fc300547-2017-4a58-8afc-350a262b5450 => generated 1262 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:23:52.895903 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c1206a4e-8cb7-49b4-987d-94cbf5fe9e00 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:23:52.899701 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c1206a4e-8cb7-49b4-987d-94cbf5fe9e00 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: c45890de-f7bf-4736-8b08-6f3e6863e2b3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:23:52.921543 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c1206a4e-8cb7-49b4-987d-94cbf5fe9e00 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:52.923015 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c1206a4e-8cb7-49b4-987d-94cbf5fe9e00 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:52.923485 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c1206a4e-8cb7-49b4-987d-94cbf5fe9e00 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:52.924222 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c1206a4e-8cb7-49b4-987d-94cbf5fe9e00 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:52.927792 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c1206a4e-8cb7-49b4-987d-94cbf5fe9e00 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:52.928325 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c1206a4e-8cb7-49b4-987d-94cbf5fe9e00 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:53.034389 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c1206a4e-8cb7-49b4-987d-94cbf5fe9e00 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: c45890de-f7bf-4736-8b08-6f3e6863e2b3] Going to try to terminate instance {{(pid=121135) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:23:53.633470 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c1206a4e-8cb7-49b4-987d-94cbf5fe9e00 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "DELETE /compute/v2.1/servers/c45890de-f7bf-4736-8b08-6f3e6863e2b3" status: 204 len: 0 microversion: 2.1 time: 0.769021 Oct 19 03:23:53.634324 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1385/2739] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:23:52 2022] DELETE /compute/v2.1/servers/c45890de-f7bf-4736-8b08-6f3e6863e2b3 => generated 0 bytes in 771 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:23:53.667056 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a3137433-510a-4530-a640-b8ce04fb2e2d tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:23:53.667151 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a3137433-510a-4530-a640-b8ce04fb2e2d tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] [instance: 24678d1b-08b3-4475-aaed-a33d8eed0923] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:23:53.698291 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a3137433-510a-4530-a640-b8ce04fb2e2d tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:53.698788 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a3137433-510a-4530-a640-b8ce04fb2e2d tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:53.699221 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a3137433-510a-4530-a640-b8ce04fb2e2d tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:53.717778 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a3137433-510a-4530-a640-b8ce04fb2e2d tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:53.724278 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a3137433-510a-4530-a640-b8ce04fb2e2d tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:53.724278 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a3137433-510a-4530-a640-b8ce04fb2e2d tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:54.242085 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a3137433-510a-4530-a640-b8ce04fb2e2d tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1ff892953e478b814922c82cc108a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e10c25837184a3983c67f2da5fe74b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:23:54.259266 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a3137433-510a-4530-a640-b8ce04fb2e2d tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e1ff892953e478b814922c82cc108a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e10c25837184a3983c67f2da5fe74b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:23:54.265516 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a3137433-510a-4530-a640-b8ce04fb2e2d tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e1ff892953e478b814922c82cc108a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e10c25837184a3983c67f2da5fe74b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:23:54.272384 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a3137433-510a-4530-a640-b8ce04fb2e2d tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] 10.222.0.52 "GET /compute/v2.1/servers/24678d1b-08b3-4475-aaed-a33d8eed0923" status: 200 len: 1366 microversion: 2.47 time: 0.636502 Oct 19 03:23:54.273946 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1386/2740] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:23:53 2022] GET /compute/v2.1/servers/24678d1b-08b3-4475-aaed-a33d8eed0923 => generated 1366 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:23:54.286767 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0e41d30b-445d-4bf2-a942-a246f0802712 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:23:54.296586 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0e41d30b-445d-4bf2-a942-a246f0802712 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] [instance: 4adec402-e94f-4a41-ac77-68f6091b87f7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:23:54.318300 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0e41d30b-445d-4bf2-a942-a246f0802712 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:54.325356 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0e41d30b-445d-4bf2-a942-a246f0802712 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:54.326385 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0e41d30b-445d-4bf2-a942-a246f0802712 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:54.330596 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0e41d30b-445d-4bf2-a942-a246f0802712 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:54.332353 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0e41d30b-445d-4bf2-a942-a246f0802712 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:54.334026 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0e41d30b-445d-4bf2-a942-a246f0802712 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:54.527639 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-4c97b361-b7d6-428b-92b6-57fc864b2d66 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:23:54.557453 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-4c97b361-b7d6-428b-92b6-57fc864b2d66 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:23:54.562619 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-4c97b361-b7d6-428b-92b6-57fc864b2d66 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:23:54.567464 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4c97b361-b7d6-428b-92b6-57fc864b2d66 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] 10.222.0.52 "GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95" status: 200 len: 1849 microversion: 2.42 time: 1.881649 Oct 19 03:23:54.570142 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1355/2741] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:23:52 2022] GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 => generated 1849 bytes in 1888 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:23:54.577183 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-71cc4322-3bd2-4bf4-9a19-95468d3cbd28 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Calling method '.version_select at 0x7fc1300df820>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:23:54.672139 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-71cc4322-3bd2-4bf4-9a19-95468d3cbd28 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] 10.222.0.52 "GET /compute/v2.1/images/f79fed39-c87d-4cd3-891b-877f8e1da73d" status: 200 len: 1455 microversion: 2.1 time: 0.098051 Oct 19 03:23:54.673256 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1356/2742] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:23:54 2022] GET /compute/v2.1/images/f79fed39-c87d-4cd3-891b-877f8e1da73d => generated 1455 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:23:54.680929 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-dacb8372-6b31-4a2b-8616-246e073fecaa tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:23:54.681584 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-dacb8372-6b31-4a2b-8616-246e073fecaa tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: fc300547-2017-4a58-8afc-350a262b5450] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:23:54.698689 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dacb8372-6b31-4a2b-8616-246e073fecaa tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:54.700911 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dacb8372-6b31-4a2b-8616-246e073fecaa tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:54.701969 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dacb8372-6b31-4a2b-8616-246e073fecaa tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:54.704470 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dacb8372-6b31-4a2b-8616-246e073fecaa tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:54.705197 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dacb8372-6b31-4a2b-8616-246e073fecaa tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:54.705881 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dacb8372-6b31-4a2b-8616-246e073fecaa tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:54.771568 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-0e41d30b-445d-4bf2-a942-a246f0802712 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:23:54.788605 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-0e41d30b-445d-4bf2-a942-a246f0802712 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:23:54.790950 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-0e41d30b-445d-4bf2-a942-a246f0802712 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:23:54.792922 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0e41d30b-445d-4bf2-a942-a246f0802712 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] 10.222.0.52 "GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7" status: 200 len: 2946 microversion: 2.32 time: 0.516798 Oct 19 03:23:54.819634 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1387/2743] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:23:54 2022] GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7 => generated 2946 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:23:54.836264 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4842783d-3d50-4286-8e01-aab0c465e254 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-340438481", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "networks": [{"uuid": "99edd0a7-1ab1-49c6-b3e8-36828942abe3"}]}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:23:54.966219 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-dacb8372-6b31-4a2b-8616-246e073fecaa tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:23:54.989231 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.network.neutron [None req-4842783d-3d50-4286-8e01-aab0c465e254 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] validate_networks() for [('99edd0a7-1ab1-49c6-b3e8-36828942abe3', None, None, None, None, None)] {{(pid=121135) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:23:54.993560 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-dacb8372-6b31-4a2b-8616-246e073fecaa tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/fc300547-2017-4a58-8afc-350a262b5450" status: 200 len: 1268 microversion: 2.1 time: 0.317202 Oct 19 03:23:54.996358 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1357/2744] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:23:54 2022] GET /compute/v2.1/servers/fc300547-2017-4a58-8afc-350a262b5450 => generated 1268 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:23:55.006606 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-fec23eaf-7ed9-49cc-b5e7-b8f14b5d2af3 req-d4109cbb-bde8-4ac9-8db5-f6afb9979163 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c45890de-f7bf-4736-8b08-6f3e6863e2b3", "name": "network-vif-unplugged", "status": "completed", "tag": "6dfdbd8b-f3ab-4274-8a35-fe995bdd3cba"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:23:55.019556 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-fec23eaf-7ed9-49cc-b5e7-b8f14b5d2af3 req-d4109cbb-bde8-4ac9-8db5-f6afb9979163 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:55.020708 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-fec23eaf-7ed9-49cc-b5e7-b8f14b5d2af3 req-d4109cbb-bde8-4ac9-8db5-f6afb9979163 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:55.021353 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-fec23eaf-7ed9-49cc-b5e7-b8f14b5d2af3 req-d4109cbb-bde8-4ac9-8db5-f6afb9979163 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:55.055742 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-fec23eaf-7ed9-49cc-b5e7-b8f14b5d2af3 req-d4109cbb-bde8-4ac9-8db5-f6afb9979163 service nova] Creating event network-vif-unplugged:6dfdbd8b-f3ab-4274-8a35-fe995bdd3cba for instance c45890de-f7bf-4736-8b08-6f3e6863e2b3 on n-h2-861333-8 Oct 19 03:23:55.064637 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-fec23eaf-7ed9-49cc-b5e7-b8f14b5d2af3 req-d4109cbb-bde8-4ac9-8db5-f6afb9979163 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.064755 Oct 19 03:23:55.066020 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1358/2745] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:23:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:23:55.071979 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ea5b51b8-bfb2-4e14-8a35-a278ca682dab tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:23:55.074211 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ea5b51b8-bfb2-4e14-8a35-a278ca682dab tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] [instance: 4adec402-e94f-4a41-ac77-68f6091b87f7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:23:55.087357 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ea5b51b8-bfb2-4e14-8a35-a278ca682dab tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:55.088200 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ea5b51b8-bfb2-4e14-8a35-a278ca682dab tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:55.089339 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ea5b51b8-bfb2-4e14-8a35-a278ca682dab tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:55.090968 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ea5b51b8-bfb2-4e14-8a35-a278ca682dab tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:55.091648 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ea5b51b8-bfb2-4e14-8a35-a278ca682dab tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:55.092357 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ea5b51b8-bfb2-4e14-8a35-a278ca682dab tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:55.600274 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ea5b51b8-bfb2-4e14-8a35-a278ca682dab tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] 10.222.0.52 "GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7/os-interface" status: 200 len: 1830 microversion: 2.32 time: 0.532731 Oct 19 03:23:55.602127 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1359/2746] 10.222.0.52 () {60 vars in 1316 bytes} [Wed Oct 19 03:23:55 2022] GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7/os-interface => generated 1830 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:23:55.614908 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b4f1e950-9cbb-43f1-8cee-ac5fee1bd331 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:23:55.614908 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b4f1e950-9cbb-43f1-8cee-ac5fee1bd331 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] [instance: 24678d1b-08b3-4475-aaed-a33d8eed0923] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:23:55.632101 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b4f1e950-9cbb-43f1-8cee-ac5fee1bd331 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:55.632612 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b4f1e950-9cbb-43f1-8cee-ac5fee1bd331 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:55.638578 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b4f1e950-9cbb-43f1-8cee-ac5fee1bd331 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:55.642473 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b4f1e950-9cbb-43f1-8cee-ac5fee1bd331 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:55.642473 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b4f1e950-9cbb-43f1-8cee-ac5fee1bd331 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:55.642920 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b4f1e950-9cbb-43f1-8cee-ac5fee1bd331 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:55.807726 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b4f1e950-9cbb-43f1-8cee-ac5fee1bd331 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1ff892953e478b814922c82cc108a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e10c25837184a3983c67f2da5fe74b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:23:55.817997 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b4f1e950-9cbb-43f1-8cee-ac5fee1bd331 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e1ff892953e478b814922c82cc108a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e10c25837184a3983c67f2da5fe74b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:23:55.824800 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b4f1e950-9cbb-43f1-8cee-ac5fee1bd331 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e1ff892953e478b814922c82cc108a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e10c25837184a3983c67f2da5fe74b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:23:55.830149 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b4f1e950-9cbb-43f1-8cee-ac5fee1bd331 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] 10.222.0.52 "GET /compute/v2.1/servers/24678d1b-08b3-4475-aaed-a33d8eed0923" status: 200 len: 1366 microversion: 2.47 time: 0.226654 Oct 19 03:23:55.830878 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1360/2747] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:23:55 2022] GET /compute/v2.1/servers/24678d1b-08b3-4475-aaed-a33d8eed0923 => generated 1366 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:23:55.861547 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-44640a4f-a632-476c-9747-6c805167ee05 req-b464dc27-de07-4c08-8f69-6413c51bec6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95", "tag": "08b1ab84-ad3f-4225-9361-51c47cd1448e"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:23:55.932325 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-44640a4f-a632-476c-9747-6c805167ee05 req-b464dc27-de07-4c08-8f69-6413c51bec6a service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:55.932812 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-44640a4f-a632-476c-9747-6c805167ee05 req-b464dc27-de07-4c08-8f69-6413c51bec6a service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:55.935958 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-44640a4f-a632-476c-9747-6c805167ee05 req-b464dc27-de07-4c08-8f69-6413c51bec6a service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:55.967266 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-44640a4f-a632-476c-9747-6c805167ee05 req-b464dc27-de07-4c08-8f69-6413c51bec6a service nova] Creating event network-changed:08b1ab84-ad3f-4225-9361-51c47cd1448e for instance cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 on n-h2-861333-8 Oct 19 03:23:55.976606 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-44640a4f-a632-476c-9747-6c805167ee05 req-b464dc27-de07-4c08-8f69-6413c51bec6a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135364 Oct 19 03:23:55.980417 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1361/2748] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:23:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:23:56.006886 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c6923e1f-93d9-4013-b6ff-b3b8663b684f tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:23:56.010965 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c6923e1f-93d9-4013-b6ff-b3b8663b684f tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] [instance: cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:23:56.027545 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c6923e1f-93d9-4013-b6ff-b3b8663b684f tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:56.030916 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c6923e1f-93d9-4013-b6ff-b3b8663b684f tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:56.041549 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c6923e1f-93d9-4013-b6ff-b3b8663b684f tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:56.044714 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c6923e1f-93d9-4013-b6ff-b3b8663b684f tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:56.045305 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c6923e1f-93d9-4013-b6ff-b3b8663b684f tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:56.046266 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c6923e1f-93d9-4013-b6ff-b3b8663b684f tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:56.795281 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-4842783d-3d50-4286-8e01-aab0c465e254 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Flavor limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:23:56.795908 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-4842783d-3d50-4286-8e01-aab0c465e254 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Image limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:23:56.796315 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-4842783d-3d50-4286-8e01-aab0c465e254 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Flavor pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:23:56.796773 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-4842783d-3d50-4286-8e01-aab0c465e254 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Image pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:23:56.797194 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-4842783d-3d50-4286-8e01-aab0c465e254 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:23:56.820958 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4842783d-3d50-4286-8e01-aab0c465e254 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:56.821485 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4842783d-3d50-4286-8e01-aab0c465e254 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:56.823583 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4842783d-3d50-4286-8e01-aab0c465e254 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:56.823583 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4842783d-3d50-4286-8e01-aab0c465e254 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:56.823583 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4842783d-3d50-4286-8e01-aab0c465e254 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:56.823583 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4842783d-3d50-4286-8e01-aab0c465e254 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:56.908425 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c6923e1f-93d9-4013-b6ff-b3b8663b684f tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:23:56.910821 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-4842783d-3d50-4286-8e01-aab0c465e254 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Getting quotas for project 686dbeeaed0b44538a9bbc54d457a720. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:23:56.923069 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-4842783d-3d50-4286-8e01-aab0c465e254 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Getting quotas for user 57008d884859417ebc1456b55ec3f6e0 and project 686dbeeaed0b44538a9bbc54d457a720. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:23:56.925218 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c6923e1f-93d9-4013-b6ff-b3b8663b684f tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:23:56.929874 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c6923e1f-93d9-4013-b6ff-b3b8663b684f tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:23:56.933919 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c6923e1f-93d9-4013-b6ff-b3b8663b684f tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] 10.222.0.52 "GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95" status: 200 len: 1870 microversion: 2.42 time: 0.950304 Oct 19 03:23:56.936128 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1362/2749] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:23:55 2022] GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 => generated 1870 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:23:56.946230 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-47690ab2-390e-4dab-a96f-28268e27c58f tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Calling method '.version_select at 0x7fc130128790>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:23:56.989001 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4842783d-3d50-4286-8e01-aab0c465e254 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Going to run 1 instances... {{(pid=121135) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:23:56.999394 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4842783d-3d50-4286-8e01-aab0c465e254 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: 4d77faf6-475d-4711-820a-623c1b705f8c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121135) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:23:57.057961 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-47690ab2-390e-4dab-a96f-28268e27c58f tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] 10.222.0.52 "GET /compute/v2.1/images/f79fed39-c87d-4cd3-891b-877f8e1da73d" status: 200 len: 1455 microversion: 2.1 time: 0.120404 Oct 19 03:23:57.063030 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1363/2750] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:23:56 2022] GET /compute/v2.1/images/f79fed39-c87d-4cd3-891b-877f8e1da73d => generated 1455 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:23:57.072894 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-be8f587c-5bda-4f22-9f02-2eb6a28d25cc tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:23:57.074356 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-be8f587c-5bda-4f22-9f02-2eb6a28d25cc tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: fc300547-2017-4a58-8afc-350a262b5450] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:23:57.093393 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-be8f587c-5bda-4f22-9f02-2eb6a28d25cc tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:57.094350 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-be8f587c-5bda-4f22-9f02-2eb6a28d25cc tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:57.096583 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-be8f587c-5bda-4f22-9f02-2eb6a28d25cc tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:57.102223 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-be8f587c-5bda-4f22-9f02-2eb6a28d25cc tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:57.106419 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-be8f587c-5bda-4f22-9f02-2eb6a28d25cc tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:57.107259 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-be8f587c-5bda-4f22-9f02-2eb6a28d25cc tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:57.208502 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4842783d-3d50-4286-8e01-aab0c465e254 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.382197 Oct 19 03:23:57.217601 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1388/2751] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:23:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 2397 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 03:23:57.240311 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-696c114b-22b1-4fa6-919f-72a0ac6f7e8e tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:23:57.246385 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-696c114b-22b1-4fa6-919f-72a0ac6f7e8e tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] [instance: 24678d1b-08b3-4475-aaed-a33d8eed0923] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:23:57.276203 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-696c114b-22b1-4fa6-919f-72a0ac6f7e8e tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:57.276878 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-696c114b-22b1-4fa6-919f-72a0ac6f7e8e tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:57.277338 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-696c114b-22b1-4fa6-919f-72a0ac6f7e8e tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:57.282526 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-696c114b-22b1-4fa6-919f-72a0ac6f7e8e tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:57.283024 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-696c114b-22b1-4fa6-919f-72a0ac6f7e8e tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:57.283545 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-696c114b-22b1-4fa6-919f-72a0ac6f7e8e tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:57.289915 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-be8f587c-5bda-4f22-9f02-2eb6a28d25cc tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:23:57.307488 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-be8f587c-5bda-4f22-9f02-2eb6a28d25cc tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/fc300547-2017-4a58-8afc-350a262b5450" status: 200 len: 1268 microversion: 2.1 time: 0.238981 Oct 19 03:23:57.307488 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1364/2752] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:23:57 2022] GET /compute/v2.1/servers/fc300547-2017-4a58-8afc-350a262b5450 => generated 1268 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:23:57.326935 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5d60299b-cd67-4a60-b918-febdd99c0685 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:23:57.328376 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5d60299b-cd67-4a60-b918-febdd99c0685 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: 4d77faf6-475d-4711-820a-623c1b705f8c] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:23:57.544379 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5d60299b-cd67-4a60-b918-febdd99c0685 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:23:57.555754 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5d60299b-cd67-4a60-b918-febdd99c0685 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/4d77faf6-475d-4711-820a-623c1b705f8c" status: 200 len: 1207 microversion: 2.1 time: 0.243700 Oct 19 03:23:57.569398 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1365/2753] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:23:57 2022] GET /compute/v2.1/servers/4d77faf6-475d-4711-820a-623c1b705f8c => generated 1207 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:23:57.639689 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-696c114b-22b1-4fa6-919f-72a0ac6f7e8e tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1ff892953e478b814922c82cc108a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e10c25837184a3983c67f2da5fe74b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:23:57.658587 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-696c114b-22b1-4fa6-919f-72a0ac6f7e8e tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e1ff892953e478b814922c82cc108a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e10c25837184a3983c67f2da5fe74b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:23:57.663035 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-696c114b-22b1-4fa6-919f-72a0ac6f7e8e tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e1ff892953e478b814922c82cc108a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e10c25837184a3983c67f2da5fe74b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:23:57.667118 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-696c114b-22b1-4fa6-919f-72a0ac6f7e8e tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] 10.222.0.52 "GET /compute/v2.1/servers/24678d1b-08b3-4475-aaed-a33d8eed0923" status: 200 len: 1366 microversion: 2.47 time: 0.447944 Oct 19 03:23:57.678253 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1389/2754] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:23:57 2022] GET /compute/v2.1/servers/24678d1b-08b3-4475-aaed-a33d8eed0923 => generated 1366 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:23:57.970009 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b5749ec2-bc39-4521-aa0a-43afd3cc70cb tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:23:57.971423 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b5749ec2-bc39-4521-aa0a-43afd3cc70cb tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] [instance: cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:23:58.005437 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b5749ec2-bc39-4521-aa0a-43afd3cc70cb tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:58.008958 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b5749ec2-bc39-4521-aa0a-43afd3cc70cb tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:58.011194 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b5749ec2-bc39-4521-aa0a-43afd3cc70cb tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:58.014427 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b5749ec2-bc39-4521-aa0a-43afd3cc70cb tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:58.014918 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b5749ec2-bc39-4521-aa0a-43afd3cc70cb tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:58.018822 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b5749ec2-bc39-4521-aa0a-43afd3cc70cb tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:58.093647 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d5cf58a9-fdac-4a39-8d66-a2a6dd7a0c3a tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Calling method '.version_select at 0x7fc1301725e0>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:23:58.281463 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d5cf58a9-fdac-4a39-8d66-a2a6dd7a0c3a tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] 10.222.0.52 "GET /compute/v2.1/images/f79fed39-c87d-4cd3-891b-877f8e1da73d" status: 200 len: 1455 microversion: 2.1 time: 0.198411 Oct 19 03:23:58.284084 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1390/2755] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:23:58 2022] GET /compute/v2.1/images/f79fed39-c87d-4cd3-891b-877f8e1da73d => generated 1455 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:23:58.346426 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0409baa1-5cbd-4252-9c10-6cb0e8250995 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:23:58.348768 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0409baa1-5cbd-4252-9c10-6cb0e8250995 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: fc300547-2017-4a58-8afc-350a262b5450] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:23:58.391889 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0409baa1-5cbd-4252-9c10-6cb0e8250995 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:58.398729 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0409baa1-5cbd-4252-9c10-6cb0e8250995 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:58.399534 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0409baa1-5cbd-4252-9c10-6cb0e8250995 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:58.407135 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0409baa1-5cbd-4252-9c10-6cb0e8250995 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:58.410080 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0409baa1-5cbd-4252-9c10-6cb0e8250995 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:58.410899 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0409baa1-5cbd-4252-9c10-6cb0e8250995 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:58.768629 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:23:59.179774 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b5749ec2-bc39-4521-aa0a-43afd3cc70cb tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:23:59.209115 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b5749ec2-bc39-4521-aa0a-43afd3cc70cb tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:23:59.219658 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b5749ec2-bc39-4521-aa0a-43afd3cc70cb tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:23:59.222124 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b5749ec2-bc39-4521-aa0a-43afd3cc70cb tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] 10.222.0.52 "GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95" status: 200 len: 1891 microversion: 2.42 time: 1.257855 Oct 19 03:23:59.238473 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1366/2756] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:23:57 2022] GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 => generated 1891 bytes in 1275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:23:59.259632 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6f89853f-d874-4c5c-8650-1efe9ee44300 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:23:59.259632 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6f89853f-d874-4c5c-8650-1efe9ee44300 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: 4d77faf6-475d-4711-820a-623c1b705f8c] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:23:59.273019 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6f89853f-d874-4c5c-8650-1efe9ee44300 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:59.273567 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6f89853f-d874-4c5c-8650-1efe9ee44300 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:59.274149 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6f89853f-d874-4c5c-8650-1efe9ee44300 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:59.274732 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6f89853f-d874-4c5c-8650-1efe9ee44300 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:59.278969 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6f89853f-d874-4c5c-8650-1efe9ee44300 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:59.279503 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6f89853f-d874-4c5c-8650-1efe9ee44300 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:59.396286 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-0409baa1-5cbd-4252-9c10-6cb0e8250995 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:23:59.400033 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:23:59.408986 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0409baa1-5cbd-4252-9c10-6cb0e8250995 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/fc300547-2017-4a58-8afc-350a262b5450" status: 200 len: 1310 microversion: 2.1 time: 1.070912 Oct 19 03:23:59.423201 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1391/2757] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:23:58 2022] GET /compute/v2.1/servers/fc300547-2017-4a58-8afc-350a262b5450 => generated 1310 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:23:59.423201 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0ca3451e-8488-430a-88d7-1ef2ebe1fad5 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:23:59.424370 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0ca3451e-8488-430a-88d7-1ef2ebe1fad5 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] [instance: 24678d1b-08b3-4475-aaed-a33d8eed0923] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:23:59.444894 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0ca3451e-8488-430a-88d7-1ef2ebe1fad5 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:59.447516 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0ca3451e-8488-430a-88d7-1ef2ebe1fad5 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:59.447516 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0ca3451e-8488-430a-88d7-1ef2ebe1fad5 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:59.447516 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0ca3451e-8488-430a-88d7-1ef2ebe1fad5 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:59.448457 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0ca3451e-8488-430a-88d7-1ef2ebe1fad5 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:59.450519 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0ca3451e-8488-430a-88d7-1ef2ebe1fad5 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:59.455775 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-6f89853f-d874-4c5c-8650-1efe9ee44300 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:23:59.469884 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6f89853f-d874-4c5c-8650-1efe9ee44300 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/4d77faf6-475d-4711-820a-623c1b705f8c" status: 200 len: 1211 microversion: 2.1 time: 0.227908 Oct 19 03:23:59.481833 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1367/2758] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:23:59 2022] GET /compute/v2.1/servers/4d77faf6-475d-4711-820a-623c1b705f8c => generated 1211 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:23:59.505345 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-348ed73e-ccbc-4c58-87e4-cb24b50fe0e9 req-086a1d92-e0d3-4b21-8a11-092c829efc4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c45890de-f7bf-4736-8b08-6f3e6863e2b3", "name": "network-vif-deleted", "tag": "6dfdbd8b-f3ab-4274-8a35-fe995bdd3cba"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:23:59.545921 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-348ed73e-ccbc-4c58-87e4-cb24b50fe0e9 req-086a1d92-e0d3-4b21-8a11-092c829efc4f service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:59.546456 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-348ed73e-ccbc-4c58-87e4-cb24b50fe0e9 req-086a1d92-e0d3-4b21-8a11-092c829efc4f service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:59.546906 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-348ed73e-ccbc-4c58-87e4-cb24b50fe0e9 req-086a1d92-e0d3-4b21-8a11-092c829efc4f service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:59.593142 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-348ed73e-ccbc-4c58-87e4-cb24b50fe0e9 req-086a1d92-e0d3-4b21-8a11-092c829efc4f service nova] Creating event network-vif-deleted:6dfdbd8b-f3ab-4274-8a35-fe995bdd3cba for instance c45890de-f7bf-4736-8b08-6f3e6863e2b3 on n-h2-861333-8 Oct 19 03:23:59.614182 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-348ed73e-ccbc-4c58-87e4-cb24b50fe0e9 req-086a1d92-e0d3-4b21-8a11-092c829efc4f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126062 Oct 19 03:23:59.614980 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1368/2759] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:23:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:23:59.628528 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9097fc9a-b765-44c1-bc29-e5945593d74f tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Calling method '.version_select at 0x7fc13184a8b0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:23:59.685311 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-0ca3451e-8488-430a-88d7-1ef2ebe1fad5 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1ff892953e478b814922c82cc108a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e10c25837184a3983c67f2da5fe74b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:23:59.697979 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-0ca3451e-8488-430a-88d7-1ef2ebe1fad5 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e1ff892953e478b814922c82cc108a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e10c25837184a3983c67f2da5fe74b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:23:59.699889 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-0ca3451e-8488-430a-88d7-1ef2ebe1fad5 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e1ff892953e478b814922c82cc108a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e10c25837184a3983c67f2da5fe74b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:23:59.704628 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0ca3451e-8488-430a-88d7-1ef2ebe1fad5 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] 10.222.0.52 "GET /compute/v2.1/servers/24678d1b-08b3-4475-aaed-a33d8eed0923" status: 200 len: 1366 microversion: 2.47 time: 0.291232 Oct 19 03:23:59.706798 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1392/2760] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:23:59 2022] GET /compute/v2.1/servers/24678d1b-08b3-4475-aaed-a33d8eed0923 => generated 1366 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:23:59.784126 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-4b8e3030-5f1c-4774-b959-67d119b9bc0d req-324c6b5b-085d-4757-a675-13d01486228c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "410116db-4d00-4a9d-8375-a5cea6a0d627", "name": "network-vif-plugged", "status": "completed", "tag": "c7f441d5-a985-4c81-97b8-114d47006d03"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:23:59.817038 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-4b8e3030-5f1c-4774-b959-67d119b9bc0d req-324c6b5b-085d-4757-a675-13d01486228c service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:23:59.817652 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-4b8e3030-5f1c-4774-b959-67d119b9bc0d req-324c6b5b-085d-4757-a675-13d01486228c service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:23:59.818106 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-4b8e3030-5f1c-4774-b959-67d119b9bc0d req-324c6b5b-085d-4757-a675-13d01486228c service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:23:59.844788 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-4b8e3030-5f1c-4774-b959-67d119b9bc0d req-324c6b5b-085d-4757-a675-13d01486228c service nova] Creating event network-vif-plugged:c7f441d5-a985-4c81-97b8-114d47006d03 for instance 410116db-4d00-4a9d-8375-a5cea6a0d627 on n-h2-861333-8 Oct 19 03:23:59.864548 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-4b8e3030-5f1c-4774-b959-67d119b9bc0d req-324c6b5b-085d-4757-a675-13d01486228c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080460 Oct 19 03:23:59.865662 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1393/2761] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:23:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:24:00.089278 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-70874611-13ae-44fa-8f01-dd9bac564cc9 req-6e6cd4e4-f656-4e32-93ee-d6f45fd64f04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95", "tag": "60051f56-f07d-4d7c-b7f8-7fc736fa8bc5"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:24:00.103302 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-70874611-13ae-44fa-8f01-dd9bac564cc9 req-6e6cd4e4-f656-4e32-93ee-d6f45fd64f04 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:00.107374 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-70874611-13ae-44fa-8f01-dd9bac564cc9 req-6e6cd4e4-f656-4e32-93ee-d6f45fd64f04 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:00.108222 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-70874611-13ae-44fa-8f01-dd9bac564cc9 req-6e6cd4e4-f656-4e32-93ee-d6f45fd64f04 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:00.156550 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-70874611-13ae-44fa-8f01-dd9bac564cc9 req-6e6cd4e4-f656-4e32-93ee-d6f45fd64f04 service nova] Creating event network-changed:60051f56-f07d-4d7c-b7f8-7fc736fa8bc5 for instance cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 on n-h2-861333-8 Oct 19 03:24:00.192995 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-70874611-13ae-44fa-8f01-dd9bac564cc9 req-6e6cd4e4-f656-4e32-93ee-d6f45fd64f04 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109173 Oct 19 03:24:00.193719 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1394/2762] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:24:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:24:00.254931 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-348311bc-54df-4e55-bcd5-c175bf1c6a1e tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:00.255729 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-348311bc-54df-4e55-bcd5-c175bf1c6a1e tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] [instance: cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:00.266687 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-348311bc-54df-4e55-bcd5-c175bf1c6a1e tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:00.294499 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-348311bc-54df-4e55-bcd5-c175bf1c6a1e tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:00.299672 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-348311bc-54df-4e55-bcd5-c175bf1c6a1e tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:00.301399 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-348311bc-54df-4e55-bcd5-c175bf1c6a1e tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:00.303455 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-348311bc-54df-4e55-bcd5-c175bf1c6a1e tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:00.304243 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-348311bc-54df-4e55-bcd5-c175bf1c6a1e tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:01.065669 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-348311bc-54df-4e55-bcd5-c175bf1c6a1e tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:01.081804 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-348311bc-54df-4e55-bcd5-c175bf1c6a1e tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:01.085759 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-348311bc-54df-4e55-bcd5-c175bf1c6a1e tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:01.091174 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-348311bc-54df-4e55-bcd5-c175bf1c6a1e tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] 10.222.0.52 "GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95" status: 200 len: 1891 microversion: 2.42 time: 0.837223 Oct 19 03:24:01.094580 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1395/2763] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:24:00 2022] GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 => generated 1891 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:24:01.109336 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-713eced1-cfac-455b-b192-200b27e4da97 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:01.114625 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-713eced1-cfac-455b-b192-200b27e4da97 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: fc300547-2017-4a58-8afc-350a262b5450] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:01.135287 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-713eced1-cfac-455b-b192-200b27e4da97 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:01.138011 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-713eced1-cfac-455b-b192-200b27e4da97 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:01.138829 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-713eced1-cfac-455b-b192-200b27e4da97 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:01.141890 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-713eced1-cfac-455b-b192-200b27e4da97 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:01.142630 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-713eced1-cfac-455b-b192-200b27e4da97 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:01.143307 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-713eced1-cfac-455b-b192-200b27e4da97 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:01.392112 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-713eced1-cfac-455b-b192-200b27e4da97 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:01.406592 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-713eced1-cfac-455b-b192-200b27e4da97 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/fc300547-2017-4a58-8afc-350a262b5450" status: 200 len: 1310 microversion: 2.1 time: 0.307812 Oct 19 03:24:01.406592 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1396/2764] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:24:01 2022] GET /compute/v2.1/servers/fc300547-2017-4a58-8afc-350a262b5450 => generated 1310 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:24:01.434615 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-81c02775-186b-4594-a0c2-53012f2ae746 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:01.435429 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-81c02775-186b-4594-a0c2-53012f2ae746 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: 4d77faf6-475d-4711-820a-623c1b705f8c] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:01.452647 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-81c02775-186b-4594-a0c2-53012f2ae746 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:01.454476 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-81c02775-186b-4594-a0c2-53012f2ae746 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:01.455179 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-81c02775-186b-4594-a0c2-53012f2ae746 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:01.458706 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-81c02775-186b-4594-a0c2-53012f2ae746 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:01.464812 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-81c02775-186b-4594-a0c2-53012f2ae746 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:01.466148 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-81c02775-186b-4594-a0c2-53012f2ae746 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:01.666098 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-81c02775-186b-4594-a0c2-53012f2ae746 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:01.682969 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-81c02775-186b-4594-a0c2-53012f2ae746 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/4d77faf6-475d-4711-820a-623c1b705f8c" status: 200 len: 1259 microversion: 2.1 time: 0.256567 Oct 19 03:24:01.683916 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1397/2765] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:24:01 2022] GET /compute/v2.1/servers/4d77faf6-475d-4711-820a-623c1b705f8c => generated 1259 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:24:01.691138 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-23ee80cd-d3d3-4272-8d56-c0d6f93f4ed3 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:01.691812 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-23ee80cd-d3d3-4272-8d56-c0d6f93f4ed3 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] [instance: 24678d1b-08b3-4475-aaed-a33d8eed0923] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:01.711472 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-23ee80cd-d3d3-4272-8d56-c0d6f93f4ed3 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:01.711977 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-23ee80cd-d3d3-4272-8d56-c0d6f93f4ed3 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:01.712414 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-23ee80cd-d3d3-4272-8d56-c0d6f93f4ed3 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:01.713121 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-23ee80cd-d3d3-4272-8d56-c0d6f93f4ed3 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:01.713603 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-23ee80cd-d3d3-4272-8d56-c0d6f93f4ed3 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:01.722345 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-23ee80cd-d3d3-4272-8d56-c0d6f93f4ed3 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:01.997309 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-23ee80cd-d3d3-4272-8d56-c0d6f93f4ed3 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1ff892953e478b814922c82cc108a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e10c25837184a3983c67f2da5fe74b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:02.013131 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-23ee80cd-d3d3-4272-8d56-c0d6f93f4ed3 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e1ff892953e478b814922c82cc108a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e10c25837184a3983c67f2da5fe74b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:02.014920 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-23ee80cd-d3d3-4272-8d56-c0d6f93f4ed3 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e1ff892953e478b814922c82cc108a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e10c25837184a3983c67f2da5fe74b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:02.019498 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-23ee80cd-d3d3-4272-8d56-c0d6f93f4ed3 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] 10.222.0.52 "GET /compute/v2.1/servers/24678d1b-08b3-4475-aaed-a33d8eed0923" status: 200 len: 1384 microversion: 2.47 time: 0.334517 Oct 19 03:24:02.033841 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1398/2766] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:24:01 2022] GET /compute/v2.1/servers/24678d1b-08b3-4475-aaed-a33d8eed0923 => generated 1384 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:24:02.123807 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-cb432a9c-e447-4b22-a957-52fa1ec0cb65 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:02.124465 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-cb432a9c-e447-4b22-a957-52fa1ec0cb65 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] [instance: cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:02.132249 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cb432a9c-e447-4b22-a957-52fa1ec0cb65 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:02.141312 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cb432a9c-e447-4b22-a957-52fa1ec0cb65 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:02.141921 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cb432a9c-e447-4b22-a957-52fa1ec0cb65 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:02.142916 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cb432a9c-e447-4b22-a957-52fa1ec0cb65 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:02.143285 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cb432a9c-e447-4b22-a957-52fa1ec0cb65 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:02.143910 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cb432a9c-e447-4b22-a957-52fa1ec0cb65 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:02.868076 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-cb432a9c-e447-4b22-a957-52fa1ec0cb65 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:02.879802 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-cb432a9c-e447-4b22-a957-52fa1ec0cb65 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:02.885513 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-cb432a9c-e447-4b22-a957-52fa1ec0cb65 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:02.886708 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-cb432a9c-e447-4b22-a957-52fa1ec0cb65 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] 10.222.0.52 "GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95" status: 200 len: 1891 microversion: 2.42 time: 0.767623 Oct 19 03:24:02.891327 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1399/2767] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:24:02 2022] GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 => generated 1891 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:24:02.901920 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ad74d116-ed51-4212-a690-a1b7af45495b tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:02.906923 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ad74d116-ed51-4212-a690-a1b7af45495b tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: fc300547-2017-4a58-8afc-350a262b5450] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:02.916175 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ad74d116-ed51-4212-a690-a1b7af45495b tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:02.916678 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ad74d116-ed51-4212-a690-a1b7af45495b tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:02.917129 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ad74d116-ed51-4212-a690-a1b7af45495b tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:02.922469 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ad74d116-ed51-4212-a690-a1b7af45495b tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:02.923098 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ad74d116-ed51-4212-a690-a1b7af45495b tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:02.923681 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ad74d116-ed51-4212-a690-a1b7af45495b tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:03.525817 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ad74d116-ed51-4212-a690-a1b7af45495b tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:03.533863 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ad74d116-ed51-4212-a690-a1b7af45495b tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/fc300547-2017-4a58-8afc-350a262b5450" status: 200 len: 1310 microversion: 2.1 time: 0.641145 Oct 19 03:24:03.538587 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1400/2768] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:24:02 2022] GET /compute/v2.1/servers/fc300547-2017-4a58-8afc-350a262b5450 => generated 1310 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:24:03.551186 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-2da84e6c-27f5-431b-961e-3393bb4e0e12 req-5f4a4c30-9d25-4382-b640-f7ea8666cfe0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc300547-2017-4a58-8afc-350a262b5450", "tag": "b4c0ab4e-2e4a-45c0-abba-79284270738d"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:24:03.568041 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-2da84e6c-27f5-431b-961e-3393bb4e0e12 req-5f4a4c30-9d25-4382-b640-f7ea8666cfe0 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:03.572805 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-2da84e6c-27f5-431b-961e-3393bb4e0e12 req-5f4a4c30-9d25-4382-b640-f7ea8666cfe0 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:03.573445 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-2da84e6c-27f5-431b-961e-3393bb4e0e12 req-5f4a4c30-9d25-4382-b640-f7ea8666cfe0 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:03.604072 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-2da84e6c-27f5-431b-961e-3393bb4e0e12 req-5f4a4c30-9d25-4382-b640-f7ea8666cfe0 service nova] Creating event network-changed:b4c0ab4e-2e4a-45c0-abba-79284270738d for instance fc300547-2017-4a58-8afc-350a262b5450 on n-h1-861333-8 Oct 19 03:24:03.615505 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-2da84e6c-27f5-431b-961e-3393bb4e0e12 req-5f4a4c30-9d25-4382-b640-f7ea8666cfe0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075526 Oct 19 03:24:03.618756 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1401/2769] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:24:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:24:03.633200 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-699d66e7-3c54-4a66-bce5-59df11773581 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:03.637192 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-699d66e7-3c54-4a66-bce5-59df11773581 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: 4d77faf6-475d-4711-820a-623c1b705f8c] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:03.648895 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-699d66e7-3c54-4a66-bce5-59df11773581 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:03.649739 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-699d66e7-3c54-4a66-bce5-59df11773581 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:03.651420 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-699d66e7-3c54-4a66-bce5-59df11773581 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:03.653728 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-699d66e7-3c54-4a66-bce5-59df11773581 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:03.654421 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-699d66e7-3c54-4a66-bce5-59df11773581 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:03.655714 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-699d66e7-3c54-4a66-bce5-59df11773581 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:03.883450 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-699d66e7-3c54-4a66-bce5-59df11773581 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:03.901085 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-699d66e7-3c54-4a66-bce5-59df11773581 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/4d77faf6-475d-4711-820a-623c1b705f8c" status: 200 len: 1265 microversion: 2.1 time: 0.280875 Oct 19 03:24:03.904578 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1402/2770] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:24:03 2022] GET /compute/v2.1/servers/4d77faf6-475d-4711-820a-623c1b705f8c => generated 1265 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:24:03.911985 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f2b61571-d17e-4cc9-9b4e-fc99c483d32a tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:03.918661 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f2b61571-d17e-4cc9-9b4e-fc99c483d32a tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] [instance: 24678d1b-08b3-4475-aaed-a33d8eed0923] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:03.928065 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f2b61571-d17e-4cc9-9b4e-fc99c483d32a tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:03.937293 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f2b61571-d17e-4cc9-9b4e-fc99c483d32a tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:03.938230 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f2b61571-d17e-4cc9-9b4e-fc99c483d32a tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:03.942285 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f2b61571-d17e-4cc9-9b4e-fc99c483d32a tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:03.943410 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f2b61571-d17e-4cc9-9b4e-fc99c483d32a tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:03.946167 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f2b61571-d17e-4cc9-9b4e-fc99c483d32a tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:04.150198 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f2b61571-d17e-4cc9-9b4e-fc99c483d32a tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1ff892953e478b814922c82cc108a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e10c25837184a3983c67f2da5fe74b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:04.169434 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f2b61571-d17e-4cc9-9b4e-fc99c483d32a tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e1ff892953e478b814922c82cc108a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e10c25837184a3983c67f2da5fe74b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:04.172582 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f2b61571-d17e-4cc9-9b4e-fc99c483d32a tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e1ff892953e478b814922c82cc108a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e10c25837184a3983c67f2da5fe74b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:04.174574 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f2b61571-d17e-4cc9-9b4e-fc99c483d32a tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] 10.222.0.52 "GET /compute/v2.1/servers/24678d1b-08b3-4475-aaed-a33d8eed0923" status: 200 len: 1372 microversion: 2.47 time: 0.268725 Oct 19 03:24:04.175139 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1403/2771] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:24:03 2022] GET /compute/v2.1/servers/24678d1b-08b3-4475-aaed-a33d8eed0923 => generated 1372 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:24:04.184625 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-acf8cc65-7cec-418c-9088-71594f2056f8 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:04.189950 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-acf8cc65-7cec-418c-9088-71594f2056f8 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] [instance: cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:04.207882 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-acf8cc65-7cec-418c-9088-71594f2056f8 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:04.210812 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-acf8cc65-7cec-418c-9088-71594f2056f8 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:04.211062 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-acf8cc65-7cec-418c-9088-71594f2056f8 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:04.216186 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-acf8cc65-7cec-418c-9088-71594f2056f8 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:04.216744 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-acf8cc65-7cec-418c-9088-71594f2056f8 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:04.217158 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-acf8cc65-7cec-418c-9088-71594f2056f8 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:04.519427 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-acf8cc65-7cec-418c-9088-71594f2056f8 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:04.532707 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-acf8cc65-7cec-418c-9088-71594f2056f8 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:04.536782 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-acf8cc65-7cec-418c-9088-71594f2056f8 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:04.539755 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-acf8cc65-7cec-418c-9088-71594f2056f8 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] 10.222.0.52 "GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95" status: 200 len: 1891 microversion: 2.42 time: 0.363636 Oct 19 03:24:04.541962 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1404/2772] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:24:04 2022] GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 => generated 1891 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:24:04.575582 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ad717f97-8ab3-4c0e-83f5-afe33df0e224 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:04.578072 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ad717f97-8ab3-4c0e-83f5-afe33df0e224 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: fc300547-2017-4a58-8afc-350a262b5450] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:04.596601 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ad717f97-8ab3-4c0e-83f5-afe33df0e224 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:04.601510 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ad717f97-8ab3-4c0e-83f5-afe33df0e224 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:04.602225 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ad717f97-8ab3-4c0e-83f5-afe33df0e224 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:04.603219 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ad717f97-8ab3-4c0e-83f5-afe33df0e224 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:04.605023 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ad717f97-8ab3-4c0e-83f5-afe33df0e224 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:04.607562 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ad717f97-8ab3-4c0e-83f5-afe33df0e224 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:05.316139 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ad717f97-8ab3-4c0e-83f5-afe33df0e224 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:05.325013 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ad717f97-8ab3-4c0e-83f5-afe33df0e224 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/fc300547-2017-4a58-8afc-350a262b5450" status: 200 len: 1310 microversion: 2.1 time: 0.763414 Oct 19 03:24:05.332883 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1405/2773] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:24:04 2022] GET /compute/v2.1/servers/fc300547-2017-4a58-8afc-350a262b5450 => generated 1310 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:24:05.345525 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-56d10902-3cf3-4c9c-85ca-14317da822ae tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:05.350287 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-56d10902-3cf3-4c9c-85ca-14317da822ae tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: 4d77faf6-475d-4711-820a-623c1b705f8c] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:05.368632 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-56d10902-3cf3-4c9c-85ca-14317da822ae tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:05.372905 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-56d10902-3cf3-4c9c-85ca-14317da822ae tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:05.373698 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-56d10902-3cf3-4c9c-85ca-14317da822ae tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:05.374623 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-56d10902-3cf3-4c9c-85ca-14317da822ae tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:05.378075 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-56d10902-3cf3-4c9c-85ca-14317da822ae tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:05.378960 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-56d10902-3cf3-4c9c-85ca-14317da822ae tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:05.704460 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-56d10902-3cf3-4c9c-85ca-14317da822ae tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:05.714282 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-56d10902-3cf3-4c9c-85ca-14317da822ae tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/4d77faf6-475d-4711-820a-623c1b705f8c" status: 200 len: 1307 microversion: 2.1 time: 0.379157 Oct 19 03:24:05.733531 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1406/2774] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:24:05 2022] GET /compute/v2.1/servers/4d77faf6-475d-4711-820a-623c1b705f8c => generated 1307 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:24:05.740527 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a4fa954c-7a9f-41dd-928a-a5ec508ce7d8 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:05.741164 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a4fa954c-7a9f-41dd-928a-a5ec508ce7d8 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] [instance: 24678d1b-08b3-4475-aaed-a33d8eed0923] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:05.754973 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a4fa954c-7a9f-41dd-928a-a5ec508ce7d8 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:05.760242 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a4fa954c-7a9f-41dd-928a-a5ec508ce7d8 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:05.760767 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a4fa954c-7a9f-41dd-928a-a5ec508ce7d8 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:05.761568 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a4fa954c-7a9f-41dd-928a-a5ec508ce7d8 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:05.763560 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a4fa954c-7a9f-41dd-928a-a5ec508ce7d8 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:05.764014 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a4fa954c-7a9f-41dd-928a-a5ec508ce7d8 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:05.922390 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a4fa954c-7a9f-41dd-928a-a5ec508ce7d8 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1ff892953e478b814922c82cc108a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e10c25837184a3983c67f2da5fe74b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:05.932378 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a4fa954c-7a9f-41dd-928a-a5ec508ce7d8 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e1ff892953e478b814922c82cc108a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e10c25837184a3983c67f2da5fe74b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:05.933344 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a4fa954c-7a9f-41dd-928a-a5ec508ce7d8 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e1ff892953e478b814922c82cc108a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e10c25837184a3983c67f2da5fe74b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:05.935180 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a4fa954c-7a9f-41dd-928a-a5ec508ce7d8 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] 10.222.0.52 "GET /compute/v2.1/servers/24678d1b-08b3-4475-aaed-a33d8eed0923" status: 200 len: 1372 microversion: 2.47 time: 0.213348 Oct 19 03:24:05.936219 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1407/2775] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:24:05 2022] GET /compute/v2.1/servers/24678d1b-08b3-4475-aaed-a33d8eed0923 => generated 1372 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:24:05.942291 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d84acb5a-da3e-4b8d-a967-9a4200911d42 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:05.942918 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d84acb5a-da3e-4b8d-a967-9a4200911d42 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] [instance: cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:05.951164 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d84acb5a-da3e-4b8d-a967-9a4200911d42 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:05.951760 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d84acb5a-da3e-4b8d-a967-9a4200911d42 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:05.952342 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d84acb5a-da3e-4b8d-a967-9a4200911d42 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:05.953011 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d84acb5a-da3e-4b8d-a967-9a4200911d42 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:05.953561 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d84acb5a-da3e-4b8d-a967-9a4200911d42 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:05.954008 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d84acb5a-da3e-4b8d-a967-9a4200911d42 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:06.222308 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d84acb5a-da3e-4b8d-a967-9a4200911d42 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:06.235374 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d84acb5a-da3e-4b8d-a967-9a4200911d42 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:06.237063 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d84acb5a-da3e-4b8d-a967-9a4200911d42 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:06.238914 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d84acb5a-da3e-4b8d-a967-9a4200911d42 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] 10.222.0.52 "GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95" status: 200 len: 1891 microversion: 2.42 time: 0.300634 Oct 19 03:24:06.239225 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1408/2776] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:24:05 2022] GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 => generated 1891 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:24:06.252599 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-94897d7c-0712-4d6c-a3ec-6f3d4bf14b08 req-960ad700-bd46-47e9-b03c-93d7913d6e97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95", "tag": "475eb265-32ca-40db-846e-3d83be38943b"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:24:06.254777 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-94897d7c-0712-4d6c-a3ec-6f3d4bf14b08 req-960ad700-bd46-47e9-b03c-93d7913d6e97 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:06.255394 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-94897d7c-0712-4d6c-a3ec-6f3d4bf14b08 req-960ad700-bd46-47e9-b03c-93d7913d6e97 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:06.255948 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-94897d7c-0712-4d6c-a3ec-6f3d4bf14b08 req-960ad700-bd46-47e9-b03c-93d7913d6e97 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:06.271127 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-94897d7c-0712-4d6c-a3ec-6f3d4bf14b08 req-960ad700-bd46-47e9-b03c-93d7913d6e97 service nova] Creating event network-changed:475eb265-32ca-40db-846e-3d83be38943b for instance cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 on n-h2-861333-8 Oct 19 03:24:06.276027 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-94897d7c-0712-4d6c-a3ec-6f3d4bf14b08 req-960ad700-bd46-47e9-b03c-93d7913d6e97 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035605 Oct 19 03:24:06.276717 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1409/2777] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:24:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:24:06.355215 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c4b34d88-4f0c-4ce8-bf3b-312c7870878a tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:06.356542 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c4b34d88-4f0c-4ce8-bf3b-312c7870878a tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: fc300547-2017-4a58-8afc-350a262b5450] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:06.363256 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c4b34d88-4f0c-4ce8-bf3b-312c7870878a tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:06.363691 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c4b34d88-4f0c-4ce8-bf3b-312c7870878a tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:06.364197 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c4b34d88-4f0c-4ce8-bf3b-312c7870878a tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:06.365036 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c4b34d88-4f0c-4ce8-bf3b-312c7870878a tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:06.365623 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c4b34d88-4f0c-4ce8-bf3b-312c7870878a tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:06.366063 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c4b34d88-4f0c-4ce8-bf3b-312c7870878a tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:06.623572 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c4b34d88-4f0c-4ce8-bf3b-312c7870878a tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:06.632259 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c4b34d88-4f0c-4ce8-bf3b-312c7870878a tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/fc300547-2017-4a58-8afc-350a262b5450" status: 200 len: 1310 microversion: 2.1 time: 0.281564 Oct 19 03:24:06.645718 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1410/2778] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:24:06 2022] GET /compute/v2.1/servers/fc300547-2017-4a58-8afc-350a262b5450 => generated 1310 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:24:06.744384 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a4c39e0d-ad5a-4919-a668-a3b6ae8d0dc9 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:06.745050 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a4c39e0d-ad5a-4919-a668-a3b6ae8d0dc9 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: 4d77faf6-475d-4711-820a-623c1b705f8c] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:06.751222 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a4c39e0d-ad5a-4919-a668-a3b6ae8d0dc9 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:06.751708 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a4c39e0d-ad5a-4919-a668-a3b6ae8d0dc9 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:06.752146 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a4c39e0d-ad5a-4919-a668-a3b6ae8d0dc9 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:06.752836 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a4c39e0d-ad5a-4919-a668-a3b6ae8d0dc9 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:06.753292 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a4c39e0d-ad5a-4919-a668-a3b6ae8d0dc9 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:06.753742 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a4c39e0d-ad5a-4919-a668-a3b6ae8d0dc9 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:06.758262 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=100 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:24:06.873815 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:24:06.976748 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=6 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:24:07.207741 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a4c39e0d-ad5a-4919-a668-a3b6ae8d0dc9 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:07.217816 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a4c39e0d-ad5a-4919-a668-a3b6ae8d0dc9 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/4d77faf6-475d-4711-820a-623c1b705f8c" status: 200 len: 1307 microversion: 2.1 time: 0.477336 Oct 19 03:24:07.219028 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1411/2779] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:24:06 2022] GET /compute/v2.1/servers/4d77faf6-475d-4711-820a-623c1b705f8c => generated 1307 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:24:07.229323 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-456e9987-b4b9-4853-afda-7003fddcb281 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:07.232502 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-456e9987-b4b9-4853-afda-7003fddcb281 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] [instance: 24678d1b-08b3-4475-aaed-a33d8eed0923] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:07.263620 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-456e9987-b4b9-4853-afda-7003fddcb281 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:07.266199 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-456e9987-b4b9-4853-afda-7003fddcb281 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:07.266966 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-456e9987-b4b9-4853-afda-7003fddcb281 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:07.268771 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-456e9987-b4b9-4853-afda-7003fddcb281 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:07.276837 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-456e9987-b4b9-4853-afda-7003fddcb281 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:07.281561 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-456e9987-b4b9-4853-afda-7003fddcb281 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:07.514432 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-456e9987-b4b9-4853-afda-7003fddcb281 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1ff892953e478b814922c82cc108a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e10c25837184a3983c67f2da5fe74b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:07.523572 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-456e9987-b4b9-4853-afda-7003fddcb281 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e1ff892953e478b814922c82cc108a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e10c25837184a3983c67f2da5fe74b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:07.525035 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-456e9987-b4b9-4853-afda-7003fddcb281 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e1ff892953e478b814922c82cc108a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e10c25837184a3983c67f2da5fe74b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:07.526257 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-456e9987-b4b9-4853-afda-7003fddcb281 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] 10.222.0.52 "GET /compute/v2.1/servers/24678d1b-08b3-4475-aaed-a33d8eed0923" status: 200 len: 1357 microversion: 2.47 time: 0.306029 Oct 19 03:24:07.526826 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1412/2780] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:24:07 2022] GET /compute/v2.1/servers/24678d1b-08b3-4475-aaed-a33d8eed0923 => generated 1357 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:24:07.552912 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=10 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:24:07.562778 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-091117a4-bb4f-48e7-bfa1-ad6866cc8316 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:07.563403 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-091117a4-bb4f-48e7-bfa1-ad6866cc8316 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] [instance: cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:07.592003 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-091117a4-bb4f-48e7-bfa1-ad6866cc8316 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:07.592552 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-091117a4-bb4f-48e7-bfa1-ad6866cc8316 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:07.598713 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-091117a4-bb4f-48e7-bfa1-ad6866cc8316 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:07.599738 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-091117a4-bb4f-48e7-bfa1-ad6866cc8316 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:07.600745 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-091117a4-bb4f-48e7-bfa1-ad6866cc8316 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:07.601666 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-091117a4-bb4f-48e7-bfa1-ad6866cc8316 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:08.384407 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-091117a4-bb4f-48e7-bfa1-ad6866cc8316 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:08.410614 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-091117a4-bb4f-48e7-bfa1-ad6866cc8316 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:08.415458 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-091117a4-bb4f-48e7-bfa1-ad6866cc8316 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:08.422116 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-091117a4-bb4f-48e7-bfa1-ad6866cc8316 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] 10.222.0.52 "GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95" status: 200 len: 1891 microversion: 2.42 time: 0.871615 Oct 19 03:24:08.422513 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1413/2781] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:24:07 2022] GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 => generated 1891 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:24:08.431574 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-744cbd59-8e50-4860-80c3-59b016e86c93 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:08.452193 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-744cbd59-8e50-4860-80c3-59b016e86c93 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8e1ff892953e478b814922c82cc108a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e10c25837184a3983c67f2da5fe74b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:08.453582 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-744cbd59-8e50-4860-80c3-59b016e86c93 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Searching by: {'deleted': False, 'project_id': '6e10c25837184a3983c67f2da5fe74b3'} {{(pid=121135) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 03:24:08.468763 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-744cbd59-8e50-4860-80c3-59b016e86c93 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:08.473710 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-744cbd59-8e50-4860-80c3-59b016e86c93 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:08.475339 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-744cbd59-8e50-4860-80c3-59b016e86c93 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:08.480435 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-744cbd59-8e50-4860-80c3-59b016e86c93 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:08.481413 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-744cbd59-8e50-4860-80c3-59b016e86c93 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:08.482095 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-744cbd59-8e50-4860-80c3-59b016e86c93 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:08.764925 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.multi_cell_list [None req-744cbd59-8e50-4860-80c3-59b016e86c93 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=121135) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 03:24:08.928663 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-744cbd59-8e50-4860-80c3-59b016e86c93 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1ff892953e478b814922c82cc108a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e10c25837184a3983c67f2da5fe74b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:08.956306 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-744cbd59-8e50-4860-80c3-59b016e86c93 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:08.956918 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-744cbd59-8e50-4860-80c3-59b016e86c93 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:08.957395 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-744cbd59-8e50-4860-80c3-59b016e86c93 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:08.982419 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-744cbd59-8e50-4860-80c3-59b016e86c93 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e1ff892953e478b814922c82cc108a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e10c25837184a3983c67f2da5fe74b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:08.985965 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-744cbd59-8e50-4860-80c3-59b016e86c93 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e1ff892953e478b814922c82cc108a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e10c25837184a3983c67f2da5fe74b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:09.414502 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-744cbd59-8e50-4860-80c3-59b016e86c93 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] 10.222.0.52 "GET /compute/v2.1/servers/detail" status: 200 len: 2707 microversion: 2.47 time: 0.990572 Oct 19 03:24:09.415410 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1414/2782] 10.222.0.52 () {60 vars in 1187 bytes} [Wed Oct 19 03:24:08 2022] GET /compute/v2.1/servers/detail => generated 2707 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:24:09.420120 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ab28685c-cf46-4b4d-82c1-30fd3e96fff3 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:09.420751 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ab28685c-cf46-4b4d-82c1-30fd3e96fff3 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: fc300547-2017-4a58-8afc-350a262b5450] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:09.427079 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:24:09.428914 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ab28685c-cf46-4b4d-82c1-30fd3e96fff3 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:09.429608 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ab28685c-cf46-4b4d-82c1-30fd3e96fff3 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:09.430270 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ab28685c-cf46-4b4d-82c1-30fd3e96fff3 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:09.431131 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ab28685c-cf46-4b4d-82c1-30fd3e96fff3 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:09.431746 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ab28685c-cf46-4b4d-82c1-30fd3e96fff3 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:09.432348 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ab28685c-cf46-4b4d-82c1-30fd3e96fff3 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:09.541559 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:24:09.565336 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=84 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:24:09.676199 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ab28685c-cf46-4b4d-82c1-30fd3e96fff3 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:09.694442 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ab28685c-cf46-4b4d-82c1-30fd3e96fff3 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/fc300547-2017-4a58-8afc-350a262b5450" status: 200 len: 1310 microversion: 2.1 time: 0.277880 Oct 19 03:24:09.706372 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1415/2783] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:24:09 2022] GET /compute/v2.1/servers/fc300547-2017-4a58-8afc-350a262b5450 => generated 1310 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:24:09.714117 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-342e7780-9187-45da-8f11-ee9c2e5ef05e req-23d4fe93-f7cf-42fa-adde-91f47f13efa6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d77faf6-475d-4711-820a-623c1b705f8c", "tag": "22167c4d-32ff-41fa-bec4-4c8908d6b685"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:24:09.756893 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-342e7780-9187-45da-8f11-ee9c2e5ef05e req-23d4fe93-f7cf-42fa-adde-91f47f13efa6 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:09.766372 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-342e7780-9187-45da-8f11-ee9c2e5ef05e req-23d4fe93-f7cf-42fa-adde-91f47f13efa6 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:09.767134 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-342e7780-9187-45da-8f11-ee9c2e5ef05e req-23d4fe93-f7cf-42fa-adde-91f47f13efa6 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:09.784535 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-342e7780-9187-45da-8f11-ee9c2e5ef05e req-23d4fe93-f7cf-42fa-adde-91f47f13efa6 service nova] Creating event network-changed:22167c4d-32ff-41fa-bec4-4c8908d6b685 for instance 4d77faf6-475d-4711-820a-623c1b705f8c on n-h2-861333-8 Oct 19 03:24:09.801313 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-342e7780-9187-45da-8f11-ee9c2e5ef05e req-23d4fe93-f7cf-42fa-adde-91f47f13efa6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093280 Oct 19 03:24:09.802571 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1416/2784] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:24:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:24:09.814393 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1c8efe94-e567-401e-8abb-b67921c4f641 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:09.815340 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1c8efe94-e567-401e-8abb-b67921c4f641 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: 4d77faf6-475d-4711-820a-623c1b705f8c] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:09.833211 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1c8efe94-e567-401e-8abb-b67921c4f641 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:09.833988 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1c8efe94-e567-401e-8abb-b67921c4f641 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:09.834587 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1c8efe94-e567-401e-8abb-b67921c4f641 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:09.837106 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1c8efe94-e567-401e-8abb-b67921c4f641 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:09.837764 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1c8efe94-e567-401e-8abb-b67921c4f641 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:09.845042 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1c8efe94-e567-401e-8abb-b67921c4f641 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:10.146844 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-1c8efe94-e567-401e-8abb-b67921c4f641 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:10.163799 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1c8efe94-e567-401e-8abb-b67921c4f641 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/4d77faf6-475d-4711-820a-623c1b705f8c" status: 200 len: 1307 microversion: 2.1 time: 0.358205 Oct 19 03:24:10.185726 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1417/2785] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:24:09 2022] GET /compute/v2.1/servers/4d77faf6-475d-4711-820a-623c1b705f8c => generated 1307 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:24:10.225311 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-96407642-fb34-4aaa-bda1-0fef00c57d19 req-2a19ed4b-730c-45e8-8e53-b771f39c60e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95", "tag": "7131b08f-dd0e-40a5-b85e-19128faf4efc"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:24:10.281692 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-96407642-fb34-4aaa-bda1-0fef00c57d19 req-2a19ed4b-730c-45e8-8e53-b771f39c60e2 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:10.285515 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-96407642-fb34-4aaa-bda1-0fef00c57d19 req-2a19ed4b-730c-45e8-8e53-b771f39c60e2 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:10.286061 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-96407642-fb34-4aaa-bda1-0fef00c57d19 req-2a19ed4b-730c-45e8-8e53-b771f39c60e2 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:10.337570 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-96407642-fb34-4aaa-bda1-0fef00c57d19 req-2a19ed4b-730c-45e8-8e53-b771f39c60e2 service nova] Creating event network-changed:7131b08f-dd0e-40a5-b85e-19128faf4efc for instance cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 on n-h2-861333-8 Oct 19 03:24:10.361598 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-96407642-fb34-4aaa-bda1-0fef00c57d19 req-2a19ed4b-730c-45e8-8e53-b771f39c60e2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.172593 Oct 19 03:24:10.363724 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1418/2786] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:24:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:24:10.391519 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ff4c2229-f5fe-433e-b4c7-9e8268c3f36b tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:10.392187 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ff4c2229-f5fe-433e-b4c7-9e8268c3f36b tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] [instance: 24678d1b-08b3-4475-aaed-a33d8eed0923] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:10.416438 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ff4c2229-f5fe-433e-b4c7-9e8268c3f36b tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:10.423216 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ff4c2229-f5fe-433e-b4c7-9e8268c3f36b tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:10.425200 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ff4c2229-f5fe-433e-b4c7-9e8268c3f36b tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:10.426031 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ff4c2229-f5fe-433e-b4c7-9e8268c3f36b tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:10.430817 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ff4c2229-f5fe-433e-b4c7-9e8268c3f36b tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:10.431363 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ff4c2229-f5fe-433e-b4c7-9e8268c3f36b tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:10.555855 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ff4c2229-f5fe-433e-b4c7-9e8268c3f36b tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] [instance: 24678d1b-08b3-4475-aaed-a33d8eed0923] Going to try to terminate instance {{(pid=121135) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:24:10.930088 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ff4c2229-f5fe-433e-b4c7-9e8268c3f36b tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] 10.222.0.52 "DELETE /compute/v2.1/servers/24678d1b-08b3-4475-aaed-a33d8eed0923" status: 204 len: 0 microversion: 2.47 time: 0.559464 Oct 19 03:24:10.938697 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1419/2787] 10.222.0.52 () {60 vars in 1280 bytes} [Wed Oct 19 03:24:10 2022] DELETE /compute/v2.1/servers/24678d1b-08b3-4475-aaed-a33d8eed0923 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 19 03:24:10.948802 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-495f2120-c563-4948-bc05-5fbc44d34d70 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:10.949640 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-495f2120-c563-4948-bc05-5fbc44d34d70 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] [instance: cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:10.965401 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-495f2120-c563-4948-bc05-5fbc44d34d70 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:10.965976 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-495f2120-c563-4948-bc05-5fbc44d34d70 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:10.975100 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-495f2120-c563-4948-bc05-5fbc44d34d70 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:10.975100 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-495f2120-c563-4948-bc05-5fbc44d34d70 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:10.975100 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-495f2120-c563-4948-bc05-5fbc44d34d70 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:10.975100 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-495f2120-c563-4948-bc05-5fbc44d34d70 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:12.107901 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-495f2120-c563-4948-bc05-5fbc44d34d70 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:12.134562 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-495f2120-c563-4948-bc05-5fbc44d34d70 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:12.145663 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-495f2120-c563-4948-bc05-5fbc44d34d70 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:12.150562 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-495f2120-c563-4948-bc05-5fbc44d34d70 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] 10.222.0.52 "GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95" status: 200 len: 1891 microversion: 2.42 time: 1.210346 Oct 19 03:24:12.158767 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1420/2788] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:24:10 2022] GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 => generated 1891 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:24:12.185768 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e66ad4da-4951-4766-a91f-b289afdf5318 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:12.186512 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e66ad4da-4951-4766-a91f-b289afdf5318 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: fc300547-2017-4a58-8afc-350a262b5450] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:12.225680 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e66ad4da-4951-4766-a91f-b289afdf5318 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:12.235414 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e66ad4da-4951-4766-a91f-b289afdf5318 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:12.235985 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e66ad4da-4951-4766-a91f-b289afdf5318 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:12.236760 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e66ad4da-4951-4766-a91f-b289afdf5318 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:12.239086 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e66ad4da-4951-4766-a91f-b289afdf5318 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:12.239583 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e66ad4da-4951-4766-a91f-b289afdf5318 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:12.738360 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-e66ad4da-4951-4766-a91f-b289afdf5318 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:12.753672 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e66ad4da-4951-4766-a91f-b289afdf5318 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/fc300547-2017-4a58-8afc-350a262b5450" status: 200 len: 1310 microversion: 2.1 time: 0.593116 Oct 19 03:24:12.755886 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1421/2789] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:24:12 2022] GET /compute/v2.1/servers/fc300547-2017-4a58-8afc-350a262b5450 => generated 1310 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:24:12.765271 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-dabe8564-441f-40ed-bff2-5baec215c55a tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:12.769418 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-dabe8564-441f-40ed-bff2-5baec215c55a tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] [instance: 24678d1b-08b3-4475-aaed-a33d8eed0923] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:12.792401 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dabe8564-441f-40ed-bff2-5baec215c55a tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:12.796109 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dabe8564-441f-40ed-bff2-5baec215c55a tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:12.798618 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dabe8564-441f-40ed-bff2-5baec215c55a tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:12.801764 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dabe8564-441f-40ed-bff2-5baec215c55a tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:12.804532 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dabe8564-441f-40ed-bff2-5baec215c55a tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:12.806116 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dabe8564-441f-40ed-bff2-5baec215c55a tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:13.135194 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-dabe8564-441f-40ed-bff2-5baec215c55a tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1ff892953e478b814922c82cc108a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e10c25837184a3983c67f2da5fe74b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:13.150146 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-dabe8564-441f-40ed-bff2-5baec215c55a tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e1ff892953e478b814922c82cc108a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e10c25837184a3983c67f2da5fe74b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:13.151909 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-dabe8564-441f-40ed-bff2-5baec215c55a tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e1ff892953e478b814922c82cc108a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e10c25837184a3983c67f2da5fe74b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:13.153394 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-dabe8564-441f-40ed-bff2-5baec215c55a tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] 10.222.0.52 "GET /compute/v2.1/servers/24678d1b-08b3-4475-aaed-a33d8eed0923" status: 200 len: 1363 microversion: 2.47 time: 0.395495 Oct 19 03:24:13.154461 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1422/2790] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:24:12 2022] GET /compute/v2.1/servers/24678d1b-08b3-4475-aaed-a33d8eed0923 => generated 1363 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:24:13.162386 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-187bb1fe-8fd5-40f5-8ab4-46e5e35baf17 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:13.165223 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-187bb1fe-8fd5-40f5-8ab4-46e5e35baf17 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: 4d77faf6-475d-4711-820a-623c1b705f8c] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:13.182728 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-187bb1fe-8fd5-40f5-8ab4-46e5e35baf17 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:13.188080 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-187bb1fe-8fd5-40f5-8ab4-46e5e35baf17 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:13.188744 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-187bb1fe-8fd5-40f5-8ab4-46e5e35baf17 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:13.190838 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-187bb1fe-8fd5-40f5-8ab4-46e5e35baf17 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:13.191481 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-187bb1fe-8fd5-40f5-8ab4-46e5e35baf17 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:13.197171 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-187bb1fe-8fd5-40f5-8ab4-46e5e35baf17 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:13.707722 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-187bb1fe-8fd5-40f5-8ab4-46e5e35baf17 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:13.721295 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-187bb1fe-8fd5-40f5-8ab4-46e5e35baf17 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/4d77faf6-475d-4711-820a-623c1b705f8c" status: 200 len: 1307 microversion: 2.1 time: 0.561160 Oct 19 03:24:13.721733 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1423/2791] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:24:13 2022] GET /compute/v2.1/servers/4d77faf6-475d-4711-820a-623c1b705f8c => generated 1307 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:24:13.726426 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-8dc67d5c-6a32-41b5-9dab-6528c92c68bb req-e187dac0-7d35-4277-bd64-b4c6be77f453 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95", "tag": "8a375b84-11bb-4f0c-9583-6d7d29938112"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:24:13.752050 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-8dc67d5c-6a32-41b5-9dab-6528c92c68bb req-e187dac0-7d35-4277-bd64-b4c6be77f453 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:13.752553 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-8dc67d5c-6a32-41b5-9dab-6528c92c68bb req-e187dac0-7d35-4277-bd64-b4c6be77f453 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:13.752992 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-8dc67d5c-6a32-41b5-9dab-6528c92c68bb req-e187dac0-7d35-4277-bd64-b4c6be77f453 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:13.766260 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-8dc67d5c-6a32-41b5-9dab-6528c92c68bb req-e187dac0-7d35-4277-bd64-b4c6be77f453 service nova] Creating event network-changed:8a375b84-11bb-4f0c-9583-6d7d29938112 for instance cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 on n-h2-861333-8 Oct 19 03:24:13.782845 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-8dc67d5c-6a32-41b5-9dab-6528c92c68bb req-e187dac0-7d35-4277-bd64-b4c6be77f453 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059757 Oct 19 03:24:13.791338 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1424/2792] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:24:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:24:13.807911 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e6e71d48-1804-43f7-88e3-bd78449a8e03 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:13.810774 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e6e71d48-1804-43f7-88e3-bd78449a8e03 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] [instance: cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:13.821463 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e6e71d48-1804-43f7-88e3-bd78449a8e03 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:13.821971 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e6e71d48-1804-43f7-88e3-bd78449a8e03 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:13.822546 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e6e71d48-1804-43f7-88e3-bd78449a8e03 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:13.823112 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e6e71d48-1804-43f7-88e3-bd78449a8e03 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:13.824324 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e6e71d48-1804-43f7-88e3-bd78449a8e03 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:13.825008 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e6e71d48-1804-43f7-88e3-bd78449a8e03 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:14.527941 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-e6e71d48-1804-43f7-88e3-bd78449a8e03 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:14.565265 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-e6e71d48-1804-43f7-88e3-bd78449a8e03 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:14.576218 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-e6e71d48-1804-43f7-88e3-bd78449a8e03 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:14.590903 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e6e71d48-1804-43f7-88e3-bd78449a8e03 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] 10.222.0.52 "GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95" status: 200 len: 1891 microversion: 2.42 time: 0.793890 Oct 19 03:24:14.604731 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1425/2793] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:24:13 2022] GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 => generated 1891 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:24:14.619384 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c42ed8d6-007b-4df2-933d-98eb415b6b16 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:14.620034 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c42ed8d6-007b-4df2-933d-98eb415b6b16 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: fc300547-2017-4a58-8afc-350a262b5450] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:14.648775 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c42ed8d6-007b-4df2-933d-98eb415b6b16 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:14.649315 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c42ed8d6-007b-4df2-933d-98eb415b6b16 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:14.654782 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c42ed8d6-007b-4df2-933d-98eb415b6b16 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:14.655765 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c42ed8d6-007b-4df2-933d-98eb415b6b16 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:14.659591 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c42ed8d6-007b-4df2-933d-98eb415b6b16 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:14.663588 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c42ed8d6-007b-4df2-933d-98eb415b6b16 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:15.443264 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c42ed8d6-007b-4df2-933d-98eb415b6b16 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:15.455119 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c42ed8d6-007b-4df2-933d-98eb415b6b16 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/fc300547-2017-4a58-8afc-350a262b5450" status: 200 len: 1310 microversion: 2.1 time: 0.857622 Oct 19 03:24:15.457747 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1426/2794] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:24:14 2022] GET /compute/v2.1/servers/fc300547-2017-4a58-8afc-350a262b5450 => generated 1310 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:24:15.490634 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d56b52ac-0051-4eb4-9362-82721d1bab26 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:15.490634 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d56b52ac-0051-4eb4-9362-82721d1bab26 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] [instance: 24678d1b-08b3-4475-aaed-a33d8eed0923] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:15.497205 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d56b52ac-0051-4eb4-9362-82721d1bab26 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:15.498097 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d56b52ac-0051-4eb4-9362-82721d1bab26 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:15.498757 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d56b52ac-0051-4eb4-9362-82721d1bab26 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:15.499695 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d56b52ac-0051-4eb4-9362-82721d1bab26 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:15.500394 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d56b52ac-0051-4eb4-9362-82721d1bab26 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:15.501091 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d56b52ac-0051-4eb4-9362-82721d1bab26 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:15.537139 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:24:15.637870 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d56b52ac-0051-4eb4-9362-82721d1bab26 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1ff892953e478b814922c82cc108a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e10c25837184a3983c67f2da5fe74b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:15.671345 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d56b52ac-0051-4eb4-9362-82721d1bab26 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e1ff892953e478b814922c82cc108a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e10c25837184a3983c67f2da5fe74b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:15.677655 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d56b52ac-0051-4eb4-9362-82721d1bab26 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e1ff892953e478b814922c82cc108a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e10c25837184a3983c67f2da5fe74b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:15.684886 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d56b52ac-0051-4eb4-9362-82721d1bab26 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] 10.222.0.52 "GET /compute/v2.1/servers/24678d1b-08b3-4475-aaed-a33d8eed0923" status: 200 len: 1363 microversion: 2.47 time: 0.209109 Oct 19 03:24:15.689476 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1427/2795] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:24:15 2022] GET /compute/v2.1/servers/24678d1b-08b3-4475-aaed-a33d8eed0923 => generated 1363 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:24:15.706292 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-dd65179e-9322-4f2d-b367-5e0c1c46c6b6 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:15.707169 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-dd65179e-9322-4f2d-b367-5e0c1c46c6b6 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: 4d77faf6-475d-4711-820a-623c1b705f8c] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:15.738168 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dd65179e-9322-4f2d-b367-5e0c1c46c6b6 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:15.738971 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dd65179e-9322-4f2d-b367-5e0c1c46c6b6 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:15.739603 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dd65179e-9322-4f2d-b367-5e0c1c46c6b6 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:15.740932 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dd65179e-9322-4f2d-b367-5e0c1c46c6b6 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:15.748413 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dd65179e-9322-4f2d-b367-5e0c1c46c6b6 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:15.749257 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dd65179e-9322-4f2d-b367-5e0c1c46c6b6 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:16.462671 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-dd65179e-9322-4f2d-b367-5e0c1c46c6b6 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:16.478764 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-dd65179e-9322-4f2d-b367-5e0c1c46c6b6 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/4d77faf6-475d-4711-820a-623c1b705f8c" status: 200 len: 1307 microversion: 2.1 time: 0.787920 Oct 19 03:24:16.484834 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1428/2796] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:24:15 2022] GET /compute/v2.1/servers/4d77faf6-475d-4711-820a-623c1b705f8c => generated 1307 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:24:16.502397 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-fc358af3-542e-47bd-a0c1-6e825848ea42 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:16.503429 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-fc358af3-542e-47bd-a0c1-6e825848ea42 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] [instance: cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:16.529630 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fc358af3-542e-47bd-a0c1-6e825848ea42 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:16.531142 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fc358af3-542e-47bd-a0c1-6e825848ea42 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:16.532930 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fc358af3-542e-47bd-a0c1-6e825848ea42 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:16.537107 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fc358af3-542e-47bd-a0c1-6e825848ea42 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:16.541359 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fc358af3-542e-47bd-a0c1-6e825848ea42 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:16.545584 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fc358af3-542e-47bd-a0c1-6e825848ea42 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:17.611010 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-fc358af3-542e-47bd-a0c1-6e825848ea42 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:17.634874 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-fc358af3-542e-47bd-a0c1-6e825848ea42 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:17.637223 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-fc358af3-542e-47bd-a0c1-6e825848ea42 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:17.642261 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-fc358af3-542e-47bd-a0c1-6e825848ea42 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] 10.222.0.52 "GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95" status: 200 len: 1891 microversion: 2.42 time: 1.151893 Oct 19 03:24:17.644614 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1429/2797] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:24:16 2022] GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 => generated 1891 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:24:17.661927 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-1ae571f3-9b7b-4137-9804-a95a7af5ae42 req-9c19deb3-a937-41db-bbb8-4a64e0f9b1f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95", "tag": "e7593819-3c37-4a86-a761-7d7c0fa6d983"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:24:17.706622 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-1ae571f3-9b7b-4137-9804-a95a7af5ae42 req-9c19deb3-a937-41db-bbb8-4a64e0f9b1f3 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:17.711238 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-1ae571f3-9b7b-4137-9804-a95a7af5ae42 req-9c19deb3-a937-41db-bbb8-4a64e0f9b1f3 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:17.711701 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-1ae571f3-9b7b-4137-9804-a95a7af5ae42 req-9c19deb3-a937-41db-bbb8-4a64e0f9b1f3 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:17.742575 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-1ae571f3-9b7b-4137-9804-a95a7af5ae42 req-9c19deb3-a937-41db-bbb8-4a64e0f9b1f3 service nova] Creating event network-changed:e7593819-3c37-4a86-a761-7d7c0fa6d983 for instance cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 on n-h2-861333-8 Oct 19 03:24:17.771940 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-1ae571f3-9b7b-4137-9804-a95a7af5ae42 req-9c19deb3-a937-41db-bbb8-4a64e0f9b1f3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125864 Oct 19 03:24:17.772864 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1430/2798] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:24:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:24:17.788810 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2bede567-6c1b-4f6d-a3c4-cc22b69ebac9 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:17.795554 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-2bede567-6c1b-4f6d-a3c4-cc22b69ebac9 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: fc300547-2017-4a58-8afc-350a262b5450] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:17.818377 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2bede567-6c1b-4f6d-a3c4-cc22b69ebac9 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:17.819082 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2bede567-6c1b-4f6d-a3c4-cc22b69ebac9 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:17.819724 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2bede567-6c1b-4f6d-a3c4-cc22b69ebac9 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:17.820591 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2bede567-6c1b-4f6d-a3c4-cc22b69ebac9 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:17.821201 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2bede567-6c1b-4f6d-a3c4-cc22b69ebac9 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:17.821817 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2bede567-6c1b-4f6d-a3c4-cc22b69ebac9 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:18.607176 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:24:18.647779 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-2bede567-6c1b-4f6d-a3c4-cc22b69ebac9 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:18.659315 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2bede567-6c1b-4f6d-a3c4-cc22b69ebac9 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/fc300547-2017-4a58-8afc-350a262b5450" status: 200 len: 1310 microversion: 2.1 time: 0.884951 Oct 19 03:24:18.659908 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1431/2799] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:24:17 2022] GET /compute/v2.1/servers/fc300547-2017-4a58-8afc-350a262b5450 => generated 1310 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:24:18.684279 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b0104e1e-3f60-4d9e-b71f-ee142f15a6f1 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:18.692181 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b0104e1e-3f60-4d9e-b71f-ee142f15a6f1 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] [instance: 24678d1b-08b3-4475-aaed-a33d8eed0923] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:18.715095 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b0104e1e-3f60-4d9e-b71f-ee142f15a6f1 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:18.715592 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b0104e1e-3f60-4d9e-b71f-ee142f15a6f1 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:18.716035 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b0104e1e-3f60-4d9e-b71f-ee142f15a6f1 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:18.716741 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b0104e1e-3f60-4d9e-b71f-ee142f15a6f1 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:18.717202 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b0104e1e-3f60-4d9e-b71f-ee142f15a6f1 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:18.728060 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b0104e1e-3f60-4d9e-b71f-ee142f15a6f1 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:18.778392 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-b0104e1e-3f60-4d9e-b71f-ee142f15a6f1 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] HTTP exception thrown: Instance 24678d1b-08b3-4475-aaed-a33d8eed0923 could not be found. Oct 19 03:24:18.780022 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b0104e1e-3f60-4d9e-b71f-ee142f15a6f1 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Request method failure captured: Oct 19 03:24:18.780022 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/24678d1b-08b3-4475-aaed-a33d8eed0923 HTTP/1.1 Oct 19 03:24:18.780022 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:24:18.780022 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:24:18.780022 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:24:18.780022 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:24:18.780022 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:24:18.780022 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:24:18.780022 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:24:18.780022 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:24:18.780022 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT22bS-00fx34jzSmBbkxs1UPyrNdWTcszt0QHAcVKMoXrASmWwA_492aeikombArOwWs_mhqLzlXCpV0GjjularOO14gqz0GQ1x3hqX45W-5B4i9Ayi_GCse2_a_EFr_96ew4YdcSJfCDRFUQJBrAdNBhDtZO-noHDp3hsNpvaPZzs8 Oct 19 03:24:18.780022 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:24:18.780022 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:24:18.780022 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:24:18.780022 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:24:18.780022 n-d-861333-8 devstack@n-api.service[121135]: X-Openstack-Nova-Api-Version: 2.47 Oct 19 03:24:18.780022 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:24:18.780022 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:24:18.780022 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 6e10c25837184a3983c67f2da5fe74b3 Oct 19 03:24:18.780022 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ServerShowV247Test-1675282108 Oct 19 03:24:18.780022 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:24:18.780022 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:24:18.781651 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6e10c25837184a3983c67f2da5fe74b3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6e10c25837184a3983c67f2da5fe74b3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6e10c25837184a3983c67f2da5fe74b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6e10c25837184a3983c67f2da5fe74b3", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:24:18.781651 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ServerShowV247Test-1675282108 Oct 19 03:24:18.781651 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 6e10c25837184a3983c67f2da5fe74b3 Oct 19 03:24:18.781651 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ServerShowV247Test-1675282108 Oct 19 03:24:18.781651 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ServerShowV247Test-1675282108-project Oct 19 03:24:18.781651 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:24:18.781651 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:24:18.781651 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 8e1ff892953e478b814922c82cc108a3 Oct 19 03:24:18.781651 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ServerShowV247Test-1675282108-project Oct 19 03:24:18.781651 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:24:18.781651 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance 24678d1b-08b3-4475-aaed-a33d8eed0923 could not be found. Oct 19 03:24:18.781651 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '24678d1b-08b3-4475-aaed-a33d8eed0923'} Oct 19 03:24:18.782567 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:24:18.782567 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:24:18.782567 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:24:18.782567 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:24:18.782567 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:24:18.782567 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:24:18.782567 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:24:18.782567 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:24:18.782567 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:24:18.782567 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:24:18.782567 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24678d1b-08b3-4475-aaed-a33d8eed0923 could not be found. Oct 19 03:24:18.782567 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:24:18.782567 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:24:18.782567 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:24:18.782567 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:24:18.782567 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:24:18.782567 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:24:18.782567 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:24:18.782567 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:24:18.782567 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:24:18.784030 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:24:18.784030 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:24:18.784030 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:24:18.784030 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:24:18.784030 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:24:18.784030 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:24:18.784030 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:24:18.784030 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24678d1b-08b3-4475-aaed-a33d8eed0923 could not be found. Oct 19 03:24:18.784030 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:24:18.784030 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:24:18.784030 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:24:18.784030 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:24:18.784030 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:24:18.784030 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:24:18.784030 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:24:18.784030 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:24:18.784030 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24678d1b-08b3-4475-aaed-a33d8eed0923 could not be found. Oct 19 03:24:18.784030 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:24:18.785154 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b0104e1e-3f60-4d9e-b71f-ee142f15a6f1 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Returning 404 to user: Instance 24678d1b-08b3-4475-aaed-a33d8eed0923 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:24:18.785154 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b0104e1e-3f60-4d9e-b71f-ee142f15a6f1 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] 10.222.0.52 "GET /compute/v2.1/servers/24678d1b-08b3-4475-aaed-a33d8eed0923" status: 404 len: 111 microversion: 2.47 time: 0.111202 Oct 19 03:24:18.793726 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1432/2800] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:24:18 2022] GET /compute/v2.1/servers/24678d1b-08b3-4475-aaed-a33d8eed0923 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 19 03:24:18.798573 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9c802b08-a013-4433-932a-7fabb9ca90ba tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:18.799195 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9c802b08-a013-4433-932a-7fabb9ca90ba tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: 4d77faf6-475d-4711-820a-623c1b705f8c] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:18.830045 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9c802b08-a013-4433-932a-7fabb9ca90ba tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:18.830457 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9c802b08-a013-4433-932a-7fabb9ca90ba tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:18.830998 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9c802b08-a013-4433-932a-7fabb9ca90ba tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:18.831615 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9c802b08-a013-4433-932a-7fabb9ca90ba tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:18.832068 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9c802b08-a013-4433-932a-7fabb9ca90ba tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:18.832519 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9c802b08-a013-4433-932a-7fabb9ca90ba tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:18.917869 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:24:19.184106 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-9c802b08-a013-4433-932a-7fabb9ca90ba tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:19.224239 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9c802b08-a013-4433-932a-7fabb9ca90ba tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/4d77faf6-475d-4711-820a-623c1b705f8c" status: 200 len: 1307 microversion: 2.1 time: 0.426281 Oct 19 03:24:19.229265 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1433/2801] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:24:18 2022] GET /compute/v2.1/servers/4d77faf6-475d-4711-820a-623c1b705f8c => generated 1307 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:24:19.237573 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-456a7a89-0d41-4dff-b472-de75cfc62413 req-752eaf0a-745b-4ec3-adc2-7d7c96e118db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc300547-2017-4a58-8afc-350a262b5450", "name": "network-vif-plugged", "status": "completed", "tag": "b4c0ab4e-2e4a-45c0-abba-79284270738d"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:24:19.264321 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-456a7a89-0d41-4dff-b472-de75cfc62413 req-752eaf0a-745b-4ec3-adc2-7d7c96e118db service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:19.265158 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-456a7a89-0d41-4dff-b472-de75cfc62413 req-752eaf0a-745b-4ec3-adc2-7d7c96e118db service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:19.266475 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-456a7a89-0d41-4dff-b472-de75cfc62413 req-752eaf0a-745b-4ec3-adc2-7d7c96e118db service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:19.299370 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-456a7a89-0d41-4dff-b472-de75cfc62413 req-752eaf0a-745b-4ec3-adc2-7d7c96e118db service nova] Creating event network-vif-plugged:b4c0ab4e-2e4a-45c0-abba-79284270738d for instance fc300547-2017-4a58-8afc-350a262b5450 on n-h1-861333-8 Oct 19 03:24:19.322961 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-456a7a89-0d41-4dff-b472-de75cfc62413 req-752eaf0a-745b-4ec3-adc2-7d7c96e118db service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094183 Oct 19 03:24:19.326977 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1434/2802] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:24:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:24:19.354307 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-8bcf7906-5c61-4f4b-861f-3283ab3c61d6 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:19.354307 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-8bcf7906-5c61-4f4b-861f-3283ab3c61d6 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] [instance: cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:19.364849 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8bcf7906-5c61-4f4b-861f-3283ab3c61d6 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:19.365682 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8bcf7906-5c61-4f4b-861f-3283ab3c61d6 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:19.366286 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8bcf7906-5c61-4f4b-861f-3283ab3c61d6 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:19.367864 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8bcf7906-5c61-4f4b-861f-3283ab3c61d6 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:19.369129 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8bcf7906-5c61-4f4b-861f-3283ab3c61d6 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:19.369883 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8bcf7906-5c61-4f4b-861f-3283ab3c61d6 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:20.146369 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-8bcf7906-5c61-4f4b-861f-3283ab3c61d6 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:20.163479 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-8bcf7906-5c61-4f4b-861f-3283ab3c61d6 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:20.166451 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-8bcf7906-5c61-4f4b-861f-3283ab3c61d6 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:20.173326 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-8bcf7906-5c61-4f4b-861f-3283ab3c61d6 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] 10.222.0.52 "GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95" status: 200 len: 1891 microversion: 2.42 time: 0.840969 Oct 19 03:24:20.176937 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1435/2803] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:24:19 2022] GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 => generated 1891 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:24:20.201651 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-cacabccb-1126-4e7c-aa31-31ad0d771923 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:20.202426 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-cacabccb-1126-4e7c-aa31-31ad0d771923 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] [instance: 60eb0d03-428c-4c76-a608-1a86e9271839] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:20.212264 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cacabccb-1126-4e7c-aa31-31ad0d771923 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:20.217771 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cacabccb-1126-4e7c-aa31-31ad0d771923 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:20.218513 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cacabccb-1126-4e7c-aa31-31ad0d771923 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:20.219510 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cacabccb-1126-4e7c-aa31-31ad0d771923 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:20.220187 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cacabccb-1126-4e7c-aa31-31ad0d771923 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:20.220834 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cacabccb-1126-4e7c-aa31-31ad0d771923 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:20.300512 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-cacabccb-1126-4e7c-aa31-31ad0d771923 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] [instance: 60eb0d03-428c-4c76-a608-1a86e9271839] Going to try to terminate instance {{(pid=121135) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:24:20.770985 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-cacabccb-1126-4e7c-aa31-31ad0d771923 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] 10.222.0.52 "DELETE /compute/v2.1/servers/60eb0d03-428c-4c76-a608-1a86e9271839" status: 204 len: 0 microversion: 2.47 time: 0.594454 Oct 19 03:24:20.774821 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1436/2804] 10.222.0.52 () {60 vars in 1280 bytes} [Wed Oct 19 03:24:20 2022] DELETE /compute/v2.1/servers/60eb0d03-428c-4c76-a608-1a86e9271839 => generated 0 bytes in 596 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 19 03:24:20.782136 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6e8e9c63-2785-418f-a119-5157adc9b160 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:20.785994 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6e8e9c63-2785-418f-a119-5157adc9b160 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: fc300547-2017-4a58-8afc-350a262b5450] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:20.807208 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6e8e9c63-2785-418f-a119-5157adc9b160 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:20.815380 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6e8e9c63-2785-418f-a119-5157adc9b160 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:20.819316 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6e8e9c63-2785-418f-a119-5157adc9b160 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:20.826521 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6e8e9c63-2785-418f-a119-5157adc9b160 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:20.827311 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6e8e9c63-2785-418f-a119-5157adc9b160 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:20.827865 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6e8e9c63-2785-418f-a119-5157adc9b160 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:21.263590 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-6e8e9c63-2785-418f-a119-5157adc9b160 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:21.284681 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6e8e9c63-2785-418f-a119-5157adc9b160 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/fc300547-2017-4a58-8afc-350a262b5450" status: 200 len: 1310 microversion: 2.1 time: 0.508435 Oct 19 03:24:21.286744 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1437/2805] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:24:20 2022] GET /compute/v2.1/servers/fc300547-2017-4a58-8afc-350a262b5450 => generated 1310 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:24:21.304122 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b1e2c8bd-9b70-4fc4-98d1-a800235da044 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:21.313817 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b1e2c8bd-9b70-4fc4-98d1-a800235da044 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: 4d77faf6-475d-4711-820a-623c1b705f8c] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:21.332142 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b1e2c8bd-9b70-4fc4-98d1-a800235da044 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:21.333274 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b1e2c8bd-9b70-4fc4-98d1-a800235da044 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:21.333904 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b1e2c8bd-9b70-4fc4-98d1-a800235da044 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:21.334832 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b1e2c8bd-9b70-4fc4-98d1-a800235da044 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:21.335449 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b1e2c8bd-9b70-4fc4-98d1-a800235da044 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:21.336026 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b1e2c8bd-9b70-4fc4-98d1-a800235da044 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:21.650306 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b1e2c8bd-9b70-4fc4-98d1-a800235da044 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:21.658552 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b1e2c8bd-9b70-4fc4-98d1-a800235da044 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/4d77faf6-475d-4711-820a-623c1b705f8c" status: 200 len: 1307 microversion: 2.1 time: 0.369811 Oct 19 03:24:21.659133 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1438/2806] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:24:21 2022] GET /compute/v2.1/servers/4d77faf6-475d-4711-820a-623c1b705f8c => generated 1307 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:24:21.671698 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-22feb3cf-9005-4746-8411-e4c07ca1714f tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:21.672320 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-22feb3cf-9005-4746-8411-e4c07ca1714f tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] [instance: 60eb0d03-428c-4c76-a608-1a86e9271839] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:21.681468 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-22feb3cf-9005-4746-8411-e4c07ca1714f tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:21.681967 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-22feb3cf-9005-4746-8411-e4c07ca1714f tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:21.682405 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-22feb3cf-9005-4746-8411-e4c07ca1714f tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:21.683640 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-22feb3cf-9005-4746-8411-e4c07ca1714f tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:21.684097 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-22feb3cf-9005-4746-8411-e4c07ca1714f tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:21.684558 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-22feb3cf-9005-4746-8411-e4c07ca1714f tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:21.775470 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-22feb3cf-9005-4746-8411-e4c07ca1714f tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1ff892953e478b814922c82cc108a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e10c25837184a3983c67f2da5fe74b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:21.807764 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-22feb3cf-9005-4746-8411-e4c07ca1714f tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e1ff892953e478b814922c82cc108a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e10c25837184a3983c67f2da5fe74b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:21.810224 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-22feb3cf-9005-4746-8411-e4c07ca1714f tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e1ff892953e478b814922c82cc108a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e10c25837184a3983c67f2da5fe74b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:21.811831 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-22feb3cf-9005-4746-8411-e4c07ca1714f tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] 10.222.0.52 "GET /compute/v2.1/servers/60eb0d03-428c-4c76-a608-1a86e9271839" status: 200 len: 1363 microversion: 2.47 time: 0.151654 Oct 19 03:24:21.813169 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1439/2807] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:24:21 2022] GET /compute/v2.1/servers/60eb0d03-428c-4c76-a608-1a86e9271839 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:24:21.827735 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-22829dd7-2d17-4b0c-95ec-51911340b9e6 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:21.828473 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-22829dd7-2d17-4b0c-95ec-51911340b9e6 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] [instance: cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:21.835981 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-22829dd7-2d17-4b0c-95ec-51911340b9e6 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:21.836470 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-22829dd7-2d17-4b0c-95ec-51911340b9e6 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:21.837978 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-22829dd7-2d17-4b0c-95ec-51911340b9e6 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:21.837978 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-22829dd7-2d17-4b0c-95ec-51911340b9e6 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:21.838163 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-22829dd7-2d17-4b0c-95ec-51911340b9e6 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:21.838500 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-22829dd7-2d17-4b0c-95ec-51911340b9e6 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:22.641679 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-22829dd7-2d17-4b0c-95ec-51911340b9e6 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:22.673469 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-22829dd7-2d17-4b0c-95ec-51911340b9e6 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:22.673469 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-22829dd7-2d17-4b0c-95ec-51911340b9e6 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:22.673469 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-22829dd7-2d17-4b0c-95ec-51911340b9e6 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] 10.222.0.52 "GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95" status: 200 len: 1891 microversion: 2.42 time: 0.845317 Oct 19 03:24:22.673770 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1440/2808] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:24:21 2022] GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 => generated 1891 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:24:22.673770 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-748f5d16-1b98-4778-bdc0-76017e1b0ea8 req-ca71efa5-50cb-45a1-bff1-200e25a17653 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d77faf6-475d-4711-820a-623c1b705f8c", "name": "network-vif-plugged", "status": "completed", "tag": "22167c4d-32ff-41fa-bec4-4c8908d6b685"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:24:22.695110 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-748f5d16-1b98-4778-bdc0-76017e1b0ea8 req-ca71efa5-50cb-45a1-bff1-200e25a17653 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:22.695684 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-748f5d16-1b98-4778-bdc0-76017e1b0ea8 req-ca71efa5-50cb-45a1-bff1-200e25a17653 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:22.696254 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-748f5d16-1b98-4778-bdc0-76017e1b0ea8 req-ca71efa5-50cb-45a1-bff1-200e25a17653 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:22.710069 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-748f5d16-1b98-4778-bdc0-76017e1b0ea8 req-ca71efa5-50cb-45a1-bff1-200e25a17653 service nova] Creating event network-vif-plugged:22167c4d-32ff-41fa-bec4-4c8908d6b685 for instance 4d77faf6-475d-4711-820a-623c1b705f8c on n-h2-861333-8 Oct 19 03:24:22.715505 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-748f5d16-1b98-4778-bdc0-76017e1b0ea8 req-ca71efa5-50cb-45a1-bff1-200e25a17653 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053569 Oct 19 03:24:22.716288 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1441/2809] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:24:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:24:23.046511 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e09b9ce1-4876-40c6-b56f-4b339b4a0d70 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-1274975519", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "networks": [{"uuid": "312e05fe-473a-45fc-8cc2-f26027d1a147"}]}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:24:23.303938 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9097fc9a-b765-44c1-bc29-e5945593d74f tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] 10.222.0.52 "GET /compute/v2.1/images/f79fed39-c87d-4cd3-891b-877f8e1da73d" status: 200 len: 1455 microversion: 2.1 time: 23.687902 Oct 19 03:24:23.313191 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1369/2810] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:23:59 2022] GET /compute/v2.1/images/f79fed39-c87d-4cd3-891b-877f8e1da73d => generated 1455 bytes in 23689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:24:23.313415 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.network.neutron [None req-e09b9ce1-4876-40c6-b56f-4b339b4a0d70 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] validate_networks() for [('312e05fe-473a-45fc-8cc2-f26027d1a147', None, None, None, None, None)] {{(pid=121135) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:24:23.313628 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-cf7173b1-2862-44b8-a9d8-3c5dd13b7296 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:23.313628 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-cf7173b1-2862-44b8-a9d8-3c5dd13b7296 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: fc300547-2017-4a58-8afc-350a262b5450] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:23.322610 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cf7173b1-2862-44b8-a9d8-3c5dd13b7296 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:23.323504 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cf7173b1-2862-44b8-a9d8-3c5dd13b7296 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:23.324538 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cf7173b1-2862-44b8-a9d8-3c5dd13b7296 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:23.325865 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cf7173b1-2862-44b8-a9d8-3c5dd13b7296 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:23.326532 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cf7173b1-2862-44b8-a9d8-3c5dd13b7296 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:23.327169 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cf7173b1-2862-44b8-a9d8-3c5dd13b7296 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:23.916795 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-cf7173b1-2862-44b8-a9d8-3c5dd13b7296 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:23.925758 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-cf7173b1-2862-44b8-a9d8-3c5dd13b7296 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/fc300547-2017-4a58-8afc-350a262b5450" status: 200 len: 1493 microversion: 2.1 time: 0.619688 Oct 19 03:24:23.937883 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1370/2811] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:24:23 2022] GET /compute/v2.1/servers/fc300547-2017-4a58-8afc-350a262b5450 => generated 1493 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:24:23.951156 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-dd0c79a7-3a36-4de6-970e-6b415d741a8a tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:23.952295 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-dd0c79a7-3a36-4de6-970e-6b415d741a8a tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: 4d77faf6-475d-4711-820a-623c1b705f8c] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:23.960296 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dd0c79a7-3a36-4de6-970e-6b415d741a8a tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:23.962171 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dd0c79a7-3a36-4de6-970e-6b415d741a8a tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:23.962796 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dd0c79a7-3a36-4de6-970e-6b415d741a8a tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:23.963676 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dd0c79a7-3a36-4de6-970e-6b415d741a8a tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:23.964852 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dd0c79a7-3a36-4de6-970e-6b415d741a8a tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:23.965469 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dd0c79a7-3a36-4de6-970e-6b415d741a8a tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:24.041496 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-e09b9ce1-4876-40c6-b56f-4b339b4a0d70 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Flavor limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:24:24.043108 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-e09b9ce1-4876-40c6-b56f-4b339b4a0d70 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Image limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:24:24.043589 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-e09b9ce1-4876-40c6-b56f-4b339b4a0d70 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Flavor pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:24:24.048734 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-e09b9ce1-4876-40c6-b56f-4b339b4a0d70 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Image pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:24:24.048734 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-e09b9ce1-4876-40c6-b56f-4b339b4a0d70 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:24:24.059345 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e09b9ce1-4876-40c6-b56f-4b339b4a0d70 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:24.061578 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e09b9ce1-4876-40c6-b56f-4b339b4a0d70 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:24.063266 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e09b9ce1-4876-40c6-b56f-4b339b4a0d70 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:24.065230 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e09b9ce1-4876-40c6-b56f-4b339b4a0d70 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:24.067376 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e09b9ce1-4876-40c6-b56f-4b339b4a0d70 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:24.068198 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e09b9ce1-4876-40c6-b56f-4b339b4a0d70 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:24.103658 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-e09b9ce1-4876-40c6-b56f-4b339b4a0d70 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Getting quotas for project 0aa84ea2412a41d19901061f97068a00. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:24:24.111327 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-e09b9ce1-4876-40c6-b56f-4b339b4a0d70 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Getting quotas for user 9e1fe2c1882341168e740e196b84ab32 and project 0aa84ea2412a41d19901061f97068a00. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:24:24.128301 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e09b9ce1-4876-40c6-b56f-4b339b4a0d70 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Going to run 1 instances... {{(pid=121135) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:24:24.131130 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e09b9ce1-4876-40c6-b56f-4b339b4a0d70 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] [instance: 333ed6dd-d020-4ef4-849c-956ed44cd18c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121135) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:24:24.200495 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-dd0c79a7-3a36-4de6-970e-6b415d741a8a tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:24.211300 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-dd0c79a7-3a36-4de6-970e-6b415d741a8a tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/4d77faf6-475d-4711-820a-623c1b705f8c" status: 200 len: 1307 microversion: 2.1 time: 0.271683 Oct 19 03:24:24.226283 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1371/2812] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:24:23 2022] GET /compute/v2.1/servers/4d77faf6-475d-4711-820a-623c1b705f8c => generated 1307 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:24:24.226283 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-881a2c99-9fc4-4820-9ebe-fdd5fd2da1c7 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:24.226283 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-881a2c99-9fc4-4820-9ebe-fdd5fd2da1c7 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] [instance: 60eb0d03-428c-4c76-a608-1a86e9271839] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:24.226283 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-881a2c99-9fc4-4820-9ebe-fdd5fd2da1c7 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:24.226283 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-881a2c99-9fc4-4820-9ebe-fdd5fd2da1c7 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:24.227269 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-881a2c99-9fc4-4820-9ebe-fdd5fd2da1c7 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:24.227269 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-881a2c99-9fc4-4820-9ebe-fdd5fd2da1c7 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:24.228096 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-881a2c99-9fc4-4820-9ebe-fdd5fd2da1c7 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:24.228609 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-881a2c99-9fc4-4820-9ebe-fdd5fd2da1c7 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:24.264827 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-881a2c99-9fc4-4820-9ebe-fdd5fd2da1c7 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:24.265537 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-881a2c99-9fc4-4820-9ebe-fdd5fd2da1c7 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:24.266425 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-881a2c99-9fc4-4820-9ebe-fdd5fd2da1c7 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:24.266879 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-881a2c99-9fc4-4820-9ebe-fdd5fd2da1c7 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lazy-loading 'fault' on Instance uuid 60eb0d03-428c-4c76-a608-1a86e9271839 {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:24:24.321588 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-881a2c99-9fc4-4820-9ebe-fdd5fd2da1c7 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1ff892953e478b814922c82cc108a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e10c25837184a3983c67f2da5fe74b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:24.329742 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-881a2c99-9fc4-4820-9ebe-fdd5fd2da1c7 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e1ff892953e478b814922c82cc108a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e10c25837184a3983c67f2da5fe74b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:24.331332 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-881a2c99-9fc4-4820-9ebe-fdd5fd2da1c7 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e1ff892953e478b814922c82cc108a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e10c25837184a3983c67f2da5fe74b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:24.332611 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-881a2c99-9fc4-4820-9ebe-fdd5fd2da1c7 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] 10.222.0.52 "GET /compute/v2.1/servers/60eb0d03-428c-4c76-a608-1a86e9271839" status: 200 len: 1368 microversion: 2.47 time: 0.119296 Oct 19 03:24:24.333502 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1372/2813] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:24:24 2022] GET /compute/v2.1/servers/60eb0d03-428c-4c76-a608-1a86e9271839 => generated 1368 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:24:24.365563 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e09b9ce1-4876-40c6-b56f-4b339b4a0d70 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.647884 Oct 19 03:24:24.366935 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1442/2814] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:24:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1650 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 03:24:24.374220 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e41a420b-e815-4285-96bb-04d29d67e2ff tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:24.374855 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e41a420b-e815-4285-96bb-04d29d67e2ff tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] [instance: cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:24.404154 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e41a420b-e815-4285-96bb-04d29d67e2ff tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:24.405127 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e41a420b-e815-4285-96bb-04d29d67e2ff tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:24.406737 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e41a420b-e815-4285-96bb-04d29d67e2ff tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:24.408410 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e41a420b-e815-4285-96bb-04d29d67e2ff tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:24.410498 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e41a420b-e815-4285-96bb-04d29d67e2ff tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:24.411209 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e41a420b-e815-4285-96bb-04d29d67e2ff tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:24.557484 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1ceba509-cbf8-4857-bf31-99dc14f3b035 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Action: 'create', calling method: .version_select at 0x7fc1301ca1f0>, body: {"keypair": {"name": "tempest-keypair-250895219", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBInhzqEbF6qHLGoKdqoIl32QgAJYCGkoYOVyDYYLZbAXTXAZQDvNyy2CP3CVCWh01x9oOUcr1EvyMjKUsj9LYJ6WShNRBrTCjQB5CtI9z22KTp5gc8X5+ovBhFIXS7j1PQ=="}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:24:24.596756 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-1ceba509-cbf8-4857-bf31-99dc14f3b035 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Getting quotas for project 42bf79842c02480eb1e91d521226d317. Resources: {'key_pairs'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:24:24.605720 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-1ceba509-cbf8-4857-bf31-99dc14f3b035 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Getting quotas for user 74bf143866aa44afb11285d61ffd7ee2 and project 42bf79842c02480eb1e91d521226d317. Resources: {'key_pairs'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:24:24.711643 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1ceba509-cbf8-4857-bf31-99dc14f3b035 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.368594 Oct 19 03:24:24.711643 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1373/2815] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Oct 19 03:24:24 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:24:24.751086 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-e41a420b-e815-4285-96bb-04d29d67e2ff tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:24.767669 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-e41a420b-e815-4285-96bb-04d29d67e2ff tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:24.773432 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-e41a420b-e815-4285-96bb-04d29d67e2ff tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:24.775892 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e41a420b-e815-4285-96bb-04d29d67e2ff tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] 10.222.0.52 "GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95" status: 200 len: 1879 microversion: 2.42 time: 0.407833 Oct 19 03:24:24.780650 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1443/2816] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:24:24 2022] GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 => generated 1879 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:24:24.788276 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a8bb01e5-4bc4-45ca-b756-81511e3cf7a0 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Calling method '.version_select at 0x7fc1300321f0>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:24.853505 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a8bb01e5-4bc4-45ca-b756-81511e3cf7a0 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] 10.222.0.52 "GET /compute/v2.1/images/f79fed39-c87d-4cd3-891b-877f8e1da73d" status: 200 len: 1464 microversion: 2.1 time: 0.071432 Oct 19 03:24:24.863390 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1444/2817] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:24:24 2022] GET /compute/v2.1/images/f79fed39-c87d-4cd3-891b-877f8e1da73d => generated 1464 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:24:24.871923 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ebcbc40f-7754-4451-aa7e-e813da78951c tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:24.877089 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ebcbc40f-7754-4451-aa7e-e813da78951c tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] [instance: 333ed6dd-d020-4ef4-849c-956ed44cd18c] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:24.904541 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b59a67c5-49ac-4d9f-a21e-80d073d3763f tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:24.905510 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b59a67c5-49ac-4d9f-a21e-80d073d3763f tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] [instance: fc300547-2017-4a58-8afc-350a262b5450] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:24.913586 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b59a67c5-49ac-4d9f-a21e-80d073d3763f tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:24.914338 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b59a67c5-49ac-4d9f-a21e-80d073d3763f tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:24.915028 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b59a67c5-49ac-4d9f-a21e-80d073d3763f tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:24.915843 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b59a67c5-49ac-4d9f-a21e-80d073d3763f tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:24.916409 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b59a67c5-49ac-4d9f-a21e-80d073d3763f tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:24.916944 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b59a67c5-49ac-4d9f-a21e-80d073d3763f tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:24.945484 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ebcbc40f-7754-4451-aa7e-e813da78951c tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1fe2c1882341168e740e196b84ab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aa84ea2412a41d19901061f97068a00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:24.961191 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ebcbc40f-7754-4451-aa7e-e813da78951c tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] 10.222.0.52 "GET /compute/v2.1/servers/333ed6dd-d020-4ef4-849c-956ed44cd18c" status: 200 len: 1217 microversion: 2.1 time: 0.096489 Oct 19 03:24:24.965037 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1445/2818] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:24:24 2022] GET /compute/v2.1/servers/333ed6dd-d020-4ef4-849c-956ed44cd18c => generated 1217 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:24:24.968457 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-67b43933-62bc-4989-9287-54dab75b19a5 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Calling method '.version_select at 0x7fc12bfcf5e0>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:25.049542 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-67b43933-62bc-4989-9287-54dab75b19a5 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] 10.222.0.52 "GET /compute/v2.1/images/f79fed39-c87d-4cd3-891b-877f8e1da73d" status: 200 len: 1464 microversion: 2.1 time: 0.085392 Oct 19 03:24:25.050437 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1446/2819] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:24:24 2022] GET /compute/v2.1/images/f79fed39-c87d-4cd3-891b-877f8e1da73d => generated 1464 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:24:25.070722 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-75e9f3e5-cba8-4189-9f44-6756e7b37227 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:25.073796 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-75e9f3e5-cba8-4189-9f44-6756e7b37227 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] [instance: 410116db-4d00-4a9d-8375-a5cea6a0d627] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:25.084118 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-75e9f3e5-cba8-4189-9f44-6756e7b37227 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:25.090319 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-75e9f3e5-cba8-4189-9f44-6756e7b37227 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:25.099680 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-75e9f3e5-cba8-4189-9f44-6756e7b37227 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:25.099680 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-75e9f3e5-cba8-4189-9f44-6756e7b37227 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:25.099680 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-75e9f3e5-cba8-4189-9f44-6756e7b37227 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:25.099680 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-75e9f3e5-cba8-4189-9f44-6756e7b37227 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:25.133646 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b59a67c5-49ac-4d9f-a21e-80d073d3763f tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/fc300547-2017-4a58-8afc-350a262b5450" status: 200 len: 1644 microversion: 2.1 time: 0.426930 Oct 19 03:24:25.134309 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1374/2820] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:24:24 2022] GET /compute/v2.1/servers/fc300547-2017-4a58-8afc-350a262b5450 => generated 1644 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:24:25.156479 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d96353ea-e9c6-47d1-b500-c119a237cee7 tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:25.157118 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d96353ea-e9c6-47d1-b500-c119a237cee7 tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] [instance: fc300547-2017-4a58-8afc-350a262b5450] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:25.163496 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d96353ea-e9c6-47d1-b500-c119a237cee7 tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:25.163918 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d96353ea-e9c6-47d1-b500-c119a237cee7 tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:25.164379 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d96353ea-e9c6-47d1-b500-c119a237cee7 tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:25.165062 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d96353ea-e9c6-47d1-b500-c119a237cee7 tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:25.166104 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d96353ea-e9c6-47d1-b500-c119a237cee7 tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:25.166104 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d96353ea-e9c6-47d1-b500-c119a237cee7 tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:25.284585 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-75e9f3e5-cba8-4189-9f44-6756e7b37227 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a222bb0f9a4c728d2ed5ca011c032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146393855c047be83270e5334c68e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:25.299173 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-75e9f3e5-cba8-4189-9f44-6756e7b37227 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] 10.222.0.52 "GET /compute/v2.1/servers/410116db-4d00-4a9d-8375-a5cea6a0d627" status: 200 len: 1467 microversion: 2.1 time: 0.238641 Oct 19 03:24:25.300337 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1447/2821] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:24:25 2022] GET /compute/v2.1/servers/410116db-4d00-4a9d-8375-a5cea6a0d627 => generated 1467 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:24:25.336712 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ad52e44b-d794-4d76-83a2-0ca5042ee92b tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:25.337008 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ad52e44b-d794-4d76-83a2-0ca5042ee92b tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: 4d77faf6-475d-4711-820a-623c1b705f8c] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:25.347202 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ad52e44b-d794-4d76-83a2-0ca5042ee92b tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:25.347641 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ad52e44b-d794-4d76-83a2-0ca5042ee92b tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:25.348103 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ad52e44b-d794-4d76-83a2-0ca5042ee92b tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:25.348835 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ad52e44b-d794-4d76-83a2-0ca5042ee92b tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:25.349453 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ad52e44b-d794-4d76-83a2-0ca5042ee92b tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:25.354487 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ad52e44b-d794-4d76-83a2-0ca5042ee92b tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:25.581639 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d96353ea-e9c6-47d1-b500-c119a237cee7 tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/fc300547-2017-4a58-8afc-350a262b5450" status: 200 len: 1644 microversion: 2.1 time: 0.428725 Oct 19 03:24:25.586968 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1375/2822] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:24:25 2022] GET /compute/v2.1/servers/fc300547-2017-4a58-8afc-350a262b5450 => generated 1644 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:24:25.598471 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-834bbd96-918f-4e98-8301-0f987273678a tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Calling method '.version_select at 0x7fc13024baf0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:25.742325 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ad52e44b-d794-4d76-83a2-0ca5042ee92b tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:25.746877 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:24:25.752448 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ad52e44b-d794-4d76-83a2-0ca5042ee92b tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/4d77faf6-475d-4711-820a-623c1b705f8c" status: 200 len: 1486 microversion: 2.1 time: 0.451008 Oct 19 03:24:25.765414 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1448/2823] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:24:25 2022] GET /compute/v2.1/servers/4d77faf6-475d-4711-820a-623c1b705f8c => generated 1486 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:24:25.765414 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-76e40808-f103-4d36-8abb-3091c7ce2099 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:25.765414 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-76e40808-f103-4d36-8abb-3091c7ce2099 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] [instance: 60eb0d03-428c-4c76-a608-1a86e9271839] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:25.766311 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-76e40808-f103-4d36-8abb-3091c7ce2099 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:25.770511 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-76e40808-f103-4d36-8abb-3091c7ce2099 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:25.770511 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-76e40808-f103-4d36-8abb-3091c7ce2099 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:25.770742 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-834bbd96-918f-4e98-8301-0f987273678a tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] 10.222.0.52 "GET /compute/v2.1/images?changes-since=2022-10-19T03%3A21%3A59Z" status: 200 len: 2329 microversion: 2.1 time: 0.181390 Oct 19 03:24:25.770879 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-76e40808-f103-4d36-8abb-3091c7ce2099 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:25.770879 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-76e40808-f103-4d36-8abb-3091c7ce2099 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:25.770879 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-76e40808-f103-4d36-8abb-3091c7ce2099 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:25.771110 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1376/2824] 10.222.0.52 () {58 vars in 1199 bytes} [Wed Oct 19 03:24:25 2022] GET /compute/v2.1/images?changes-since=2022-10-19T03%3A21%3A59Z => generated 2329 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:24:25.775864 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-74d323f0-a8d6-4150-8403-a0c2f8c153d8 tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:25.779896 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-74d323f0-a8d6-4150-8403-a0c2f8c153d8 tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:25.780982 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-74d323f0-a8d6-4150-8403-a0c2f8c153d8 tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:25.781473 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-74d323f0-a8d6-4150-8403-a0c2f8c153d8 tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:25.782546 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-74d323f0-a8d6-4150-8403-a0c2f8c153d8 tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:25.783024 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-74d323f0-a8d6-4150-8403-a0c2f8c153d8 tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:25.783528 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-74d323f0-a8d6-4150-8403-a0c2f8c153d8 tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:25.794026 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-76e40808-f103-4d36-8abb-3091c7ce2099 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] HTTP exception thrown: Instance 60eb0d03-428c-4c76-a608-1a86e9271839 could not be found. Oct 19 03:24:25.795691 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-76e40808-f103-4d36-8abb-3091c7ce2099 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Request method failure captured: Oct 19 03:24:25.795691 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/60eb0d03-428c-4c76-a608-1a86e9271839 HTTP/1.1 Oct 19 03:24:25.795691 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:24:25.795691 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:24:25.795691 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:24:25.795691 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:24:25.795691 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:24:25.795691 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:24:25.795691 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:24:25.795691 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:24:25.795691 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT22bS-00fx34jzSmBbkxs1UPyrNdWTcszt0QHAcVKMoXrASmWwA_492aeikombArOwWs_mhqLzlXCpV0GjjularOO14gqz0GQ1x3hqX45W-5B4i9Ayi_GCse2_a_EFr_96ew4YdcSJfCDRFUQJBrAdNBhDtZO-noHDp3hsNpvaPZzs8 Oct 19 03:24:25.795691 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:24:25.795691 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:24:25.795691 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:24:25.795691 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:24:25.795691 n-d-861333-8 devstack@n-api.service[121135]: X-Openstack-Nova-Api-Version: 2.47 Oct 19 03:24:25.795691 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:24:25.795691 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:24:25.795691 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 6e10c25837184a3983c67f2da5fe74b3 Oct 19 03:24:25.795691 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ServerShowV247Test-1675282108 Oct 19 03:24:25.795691 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:24:25.795691 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:24:25.797226 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6e10c25837184a3983c67f2da5fe74b3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6e10c25837184a3983c67f2da5fe74b3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6e10c25837184a3983c67f2da5fe74b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6e10c25837184a3983c67f2da5fe74b3", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:24:25.797226 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ServerShowV247Test-1675282108 Oct 19 03:24:25.797226 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 6e10c25837184a3983c67f2da5fe74b3 Oct 19 03:24:25.797226 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ServerShowV247Test-1675282108 Oct 19 03:24:25.797226 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ServerShowV247Test-1675282108-project Oct 19 03:24:25.797226 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:24:25.797226 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:24:25.797226 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 8e1ff892953e478b814922c82cc108a3 Oct 19 03:24:25.797226 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ServerShowV247Test-1675282108-project Oct 19 03:24:25.797226 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:24:25.797226 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance 60eb0d03-428c-4c76-a608-1a86e9271839 could not be found. Oct 19 03:24:25.797226 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '60eb0d03-428c-4c76-a608-1a86e9271839'} Oct 19 03:24:25.798186 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:24:25.798186 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:24:25.798186 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:24:25.798186 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:24:25.798186 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:24:25.798186 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:24:25.798186 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:24:25.798186 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:24:25.798186 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:24:25.798186 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:24:25.798186 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60eb0d03-428c-4c76-a608-1a86e9271839 could not be found. Oct 19 03:24:25.798186 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:24:25.798186 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:24:25.798186 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:24:25.798186 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:24:25.798186 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:24:25.798186 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:24:25.798186 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:24:25.798186 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:24:25.798186 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:24:25.799582 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:24:25.799582 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:24:25.799582 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:24:25.799582 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:24:25.799582 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:24:25.799582 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:24:25.799582 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:24:25.799582 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60eb0d03-428c-4c76-a608-1a86e9271839 could not be found. Oct 19 03:24:25.799582 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:24:25.799582 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:24:25.799582 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:24:25.799582 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:24:25.799582 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:24:25.799582 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:24:25.799582 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:24:25.799582 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:24:25.799582 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60eb0d03-428c-4c76-a608-1a86e9271839 could not be found. Oct 19 03:24:25.799582 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:24:25.813798 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-76e40808-f103-4d36-8abb-3091c7ce2099 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] Returning 404 to user: Instance 60eb0d03-428c-4c76-a608-1a86e9271839 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:24:25.815873 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-76e40808-f103-4d36-8abb-3091c7ce2099 tempest-ServerShowV247Test-1675282108 tempest-ServerShowV247Test-1675282108-project] 10.222.0.52 "GET /compute/v2.1/servers/60eb0d03-428c-4c76-a608-1a86e9271839" status: 404 len: 111 microversion: 2.47 time: 0.061543 Oct 19 03:24:25.816452 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1449/2825] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:24:25 2022] GET /compute/v2.1/servers/60eb0d03-428c-4c76-a608-1a86e9271839 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 19 03:24:25.822502 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-74d323f0-a8d6-4150-8403-a0c2f8c153d8 tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.050919 Oct 19 03:24:25.824116 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1377/2826] 10.222.0.52 () {58 vars in 1176 bytes} [Wed Oct 19 03:24:25 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:24:25.828994 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-150bb911-0042-4e34-b582-d7bfe117cf23 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Calling method '.version_select at 0x7fc13014f8b0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:25.831717 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-fde40e32-fa2f-4ac3-b1d4-285d6f2125e7 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:24:25.832282 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-fde40e32-fa2f-4ac3-b1d4-285d6f2125e7 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: 4d77faf6-475d-4711-820a-623c1b705f8c] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:25.847692 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fde40e32-fa2f-4ac3-b1d4-285d6f2125e7 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:25.853257 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fde40e32-fa2f-4ac3-b1d4-285d6f2125e7 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:25.853257 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fde40e32-fa2f-4ac3-b1d4-285d6f2125e7 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:25.853641 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fde40e32-fa2f-4ac3-b1d4-285d6f2125e7 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:25.854053 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fde40e32-fa2f-4ac3-b1d4-285d6f2125e7 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:25.854494 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fde40e32-fa2f-4ac3-b1d4-285d6f2125e7 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:25.918315 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-fde40e32-fa2f-4ac3-b1d4-285d6f2125e7 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lazy-loading 'flavor' on Instance uuid 4d77faf6-475d-4711-820a-623c1b705f8c {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:24:25.985756 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-150bb911-0042-4e34-b582-d7bfe117cf23 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] 10.222.0.52 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-811934560" status: 200 len: 484 microversion: 2.1 time: 0.159791 Oct 19 03:24:25.986841 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1378/2827] 10.222.0.52 () {58 vars in 1229 bytes} [Wed Oct 19 03:24:25 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-811934560 => generated 484 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:24:25.991603 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9f154375-2cdf-4489-af2c-2fe34c7aad18 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:25.993829 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9f154375-2cdf-4489-af2c-2fe34c7aad18 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] [instance: cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:26.001493 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9f154375-2cdf-4489-af2c-2fe34c7aad18 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:26.005531 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9f154375-2cdf-4489-af2c-2fe34c7aad18 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:26.005531 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9f154375-2cdf-4489-af2c-2fe34c7aad18 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:26.005531 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9f154375-2cdf-4489-af2c-2fe34c7aad18 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:26.005531 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9f154375-2cdf-4489-af2c-2fe34c7aad18 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:26.005989 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9f154375-2cdf-4489-af2c-2fe34c7aad18 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:26.267657 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9f154375-2cdf-4489-af2c-2fe34c7aad18 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:26.283140 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9f154375-2cdf-4489-af2c-2fe34c7aad18 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:26.283140 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9f154375-2cdf-4489-af2c-2fe34c7aad18 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:26.283336 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-fde40e32-fa2f-4ac3-b1d4-285d6f2125e7 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "POST /compute/v2.1/servers/4d77faf6-475d-4711-820a-623c1b705f8c/action" status: 202 len: 0 microversion: 2.1 time: 0.457455 Oct 19 03:24:26.283336 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1450/2828] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:24:25 2022] POST /compute/v2.1/servers/4d77faf6-475d-4711-820a-623c1b705f8c/action => generated 0 bytes in 460 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:24:26.283862 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9f154375-2cdf-4489-af2c-2fe34c7aad18 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] 10.222.0.52 "GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95" status: 200 len: 1879 microversion: 2.42 time: 0.295800 Oct 19 03:24:26.284270 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1379/2829] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:24:25 2022] GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 => generated 1879 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:24:26.302021 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0d1db70b-94a0-4802-9dc5-9118fdc1c0a5 tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-861333-8", "block_migration": true, "disk_over_commit": false}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:24:26.305095 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0d1db70b-94a0-4802-9dc5-9118fdc1c0a5 tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] [instance: fc300547-2017-4a58-8afc-350a262b5450] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:26.311010 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9012f5bf-99cf-41e0-b772-ffc7a8572ceb tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:26.311999 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9012f5bf-99cf-41e0-b772-ffc7a8572ceb tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] [instance: 333ed6dd-d020-4ef4-849c-956ed44cd18c] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:26.318447 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0d1db70b-94a0-4802-9dc5-9118fdc1c0a5 tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:26.318929 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0d1db70b-94a0-4802-9dc5-9118fdc1c0a5 tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:26.321517 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9012f5bf-99cf-41e0-b772-ffc7a8572ceb tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:26.330153 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9012f5bf-99cf-41e0-b772-ffc7a8572ceb tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:26.330418 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0d1db70b-94a0-4802-9dc5-9118fdc1c0a5 tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:26.330418 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0d1db70b-94a0-4802-9dc5-9118fdc1c0a5 tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:26.330418 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0d1db70b-94a0-4802-9dc5-9118fdc1c0a5 tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:26.330418 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0d1db70b-94a0-4802-9dc5-9118fdc1c0a5 tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:26.332824 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9012f5bf-99cf-41e0-b772-ffc7a8572ceb tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:26.333968 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9012f5bf-99cf-41e0-b772-ffc7a8572ceb tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:26.334686 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9012f5bf-99cf-41e0-b772-ffc7a8572ceb tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:26.341810 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9012f5bf-99cf-41e0-b772-ffc7a8572ceb tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:26.360200 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-0d1db70b-94a0-4802-9dc5-9118fdc1c0a5 tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Lazy-loading 'flavor' on Instance uuid fc300547-2017-4a58-8afc-350a262b5450 {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:24:26.376777 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0d1db70b-94a0-4802-9dc5-9118fdc1c0a5 tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] [instance: fc300547-2017-4a58-8afc-350a262b5450] Going to try to live migrate instance to n-h2-861333-8 {{(pid=121135) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 19 03:24:26.476099 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9012f5bf-99cf-41e0-b772-ffc7a8572ceb tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1fe2c1882341168e740e196b84ab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aa84ea2412a41d19901061f97068a00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:26.501594 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9012f5bf-99cf-41e0-b772-ffc7a8572ceb tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] 10.222.0.52 "GET /compute/v2.1/servers/333ed6dd-d020-4ef4-849c-956ed44cd18c" status: 200 len: 1221 microversion: 2.1 time: 0.216173 Oct 19 03:24:26.502772 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1380/2830] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:24:26 2022] GET /compute/v2.1/servers/333ed6dd-d020-4ef4-849c-956ed44cd18c => generated 1221 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:24:26.523550 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3b891891-d824-4eb0-8c07-1367ff409294 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Calling method '.version_select at 0x7fc1301ca430>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:26.653123 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3b891891-d824-4eb0-8c07-1367ff409294 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] 10.222.0.52 "GET /compute/v2.1/images?server=410116db-4d00-4a9d-8375-a5cea6a0d627" status: 200 len: 957 microversion: 2.1 time: 0.148749 Oct 19 03:24:26.662382 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1381/2831] 10.222.0.52 () {58 vars in 1209 bytes} [Wed Oct 19 03:24:26 2022] GET /compute/v2.1/images?server=410116db-4d00-4a9d-8375-a5cea6a0d627 => generated 957 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:24:26.668982 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7289bc8c-ae30-4648-a5af-b6a16f41c182 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:26.669649 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7289bc8c-ae30-4648-a5af-b6a16f41c182 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: 4d77faf6-475d-4711-820a-623c1b705f8c] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:26.676196 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7289bc8c-ae30-4648-a5af-b6a16f41c182 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:26.676909 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7289bc8c-ae30-4648-a5af-b6a16f41c182 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:26.677750 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7289bc8c-ae30-4648-a5af-b6a16f41c182 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:26.679201 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7289bc8c-ae30-4648-a5af-b6a16f41c182 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:26.679944 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7289bc8c-ae30-4648-a5af-b6a16f41c182 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:26.680614 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7289bc8c-ae30-4648-a5af-b6a16f41c182 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:26.897582 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-7289bc8c-ae30-4648-a5af-b6a16f41c182 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:26.909936 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7289bc8c-ae30-4648-a5af-b6a16f41c182 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/4d77faf6-475d-4711-820a-623c1b705f8c" status: 200 len: 1494 microversion: 2.1 time: 0.246120 Oct 19 03:24:26.911064 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1382/2832] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:24:26 2022] GET /compute/v2.1/servers/4d77faf6-475d-4711-820a-623c1b705f8c => generated 1494 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:24:26.916056 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b6f2c23d-fb8d-400b-9c88-c6c9018dbde9 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Calling method '.version_select at 0x7fc1301caca0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:26.970163 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b6f2c23d-fb8d-400b-9c88-c6c9018dbde9 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] 10.222.0.52 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.52%2Fcompute%2Fv2.1%2Fservers%2F6ef505a5-0624-4080-9089-821f6fdfb47c" status: 200 len: 485 microversion: 2.1 time: 0.057761 Oct 19 03:24:26.970853 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1383/2833] 10.222.0.52 () {58 vars in 1317 bytes} [Wed Oct 19 03:24:26 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.52%2Fcompute%2Fv2.1%2Fservers%2F6ef505a5-0624-4080-9089-821f6fdfb47c => generated 485 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:24:27.002205 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d320b61a-c414-410c-9ddb-d6f4b2f0b274 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Calling method '.version_select at 0x7fc13024ba60>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:27.067890 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d320b61a-c414-410c-9ddb-d6f4b2f0b274 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] 10.222.0.52 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.52%2Fcompute%2Fservers%2F6ef505a5-0624-4080-9089-821f6fdfb47c" status: 200 len: 485 microversion: 2.1 time: 0.082351 Oct 19 03:24:27.070688 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1384/2834] 10.222.0.52 () {58 vars in 1303 bytes} [Wed Oct 19 03:24:26 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.52%2Fcompute%2Fservers%2F6ef505a5-0624-4080-9089-821f6fdfb47c => generated 485 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:24:27.086525 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-81d2baec-f454-4007-96e2-e2d6504b013e tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Calling method '.version_select at 0x7fc13014f4c0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:27.231859 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-81d2baec-f454-4007-96e2-e2d6504b013e tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] 10.222.0.52 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3707 microversion: 2.1 time: 0.151785 Oct 19 03:24:27.232433 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1385/2835] 10.222.0.52 () {58 vars in 1149 bytes} [Wed Oct 19 03:24:27 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3707 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:24:27.248751 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-27165943-9950-4ac7-a15a-f6437818209f tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Calling method '.version_select at 0x7fc1300e8dc0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:27.318532 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-27165943-9950-4ac7-a15a-f6437818209f tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] 10.222.0.52 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1430 microversion: 2.1 time: 0.074625 Oct 19 03:24:27.328526 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1386/2836] 10.222.0.52 () {58 vars in 1149 bytes} [Wed Oct 19 03:24:27 2022] GET /compute/v2.1/images?type=snapshot => generated 1430 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:24:27.328526 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1208f4e0-c890-49c2-b8b8-36589b8eaffb tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:27.328526 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1208f4e0-c890-49c2-b8b8-36589b8eaffb tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] [instance: cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:27.333952 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1208f4e0-c890-49c2-b8b8-36589b8eaffb tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:27.335403 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1208f4e0-c890-49c2-b8b8-36589b8eaffb tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:27.335403 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1208f4e0-c890-49c2-b8b8-36589b8eaffb tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:27.335614 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1208f4e0-c890-49c2-b8b8-36589b8eaffb tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:27.336056 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1208f4e0-c890-49c2-b8b8-36589b8eaffb tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:27.336536 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1208f4e0-c890-49c2-b8b8-36589b8eaffb tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:27.559855 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-1208f4e0-c890-49c2-b8b8-36589b8eaffb tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:27.568843 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-1208f4e0-c890-49c2-b8b8-36589b8eaffb tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:27.571095 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-1208f4e0-c890-49c2-b8b8-36589b8eaffb tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:27.577918 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1208f4e0-c890-49c2-b8b8-36589b8eaffb tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] 10.222.0.52 "GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95" status: 200 len: 1879 microversion: 2.42 time: 0.251860 Oct 19 03:24:27.590061 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1387/2837] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:24:27 2022] GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 => generated 1879 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:24:27.602438 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-10139abe-3e76-4a11-92cc-72c1b9207d35 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Calling method '.version_select at 0x7fc1301ef3a0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:27.681896 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-10139abe-3e76-4a11-92cc-72c1b9207d35 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] 10.222.0.52 "GET /compute/v2.1/images?limit=1" status: 200 len: 575 microversion: 2.1 time: 0.090457 Oct 19 03:24:27.682558 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1388/2838] 10.222.0.52 () {58 vars in 1137 bytes} [Wed Oct 19 03:24:27 2022] GET /compute/v2.1/images?limit=1 => generated 575 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:24:27.687939 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c731df42-44c5-4080-a61b-6b5d04f02e4a tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:27.688714 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c731df42-44c5-4080-a61b-6b5d04f02e4a tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] [instance: 333ed6dd-d020-4ef4-849c-956ed44cd18c] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:27.695365 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c731df42-44c5-4080-a61b-6b5d04f02e4a tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:27.696445 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c731df42-44c5-4080-a61b-6b5d04f02e4a tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:27.696445 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c731df42-44c5-4080-a61b-6b5d04f02e4a tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:27.696986 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c731df42-44c5-4080-a61b-6b5d04f02e4a tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:27.697487 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c731df42-44c5-4080-a61b-6b5d04f02e4a tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:27.697917 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c731df42-44c5-4080-a61b-6b5d04f02e4a tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:27.791700 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c731df42-44c5-4080-a61b-6b5d04f02e4a tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1fe2c1882341168e740e196b84ab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aa84ea2412a41d19901061f97068a00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:27.803064 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c731df42-44c5-4080-a61b-6b5d04f02e4a tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] 10.222.0.52 "GET /compute/v2.1/servers/333ed6dd-d020-4ef4-849c-956ed44cd18c" status: 200 len: 1277 microversion: 2.1 time: 0.119042 Oct 19 03:24:27.815665 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1389/2839] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:24:27 2022] GET /compute/v2.1/servers/333ed6dd-d020-4ef4-849c-956ed44cd18c => generated 1277 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:24:27.815665 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-15ab85a2-71c3-45a5-8116-63badb7c173d tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Calling method '.version_select at 0x7fc1301ef3a0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:27.935482 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-15ab85a2-71c3-45a5-8116-63badb7c173d tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] 10.222.0.52 "GET /compute/v2.1/images/detail?changes-since=2022-10-19T03%3A21%3A52Z" status: 200 len: 7022 microversion: 2.1 time: 0.128844 Oct 19 03:24:27.936228 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1390/2840] 10.222.0.52 () {58 vars in 1220 bytes} [Wed Oct 19 03:24:27 2022] GET /compute/v2.1/images/detail?changes-since=2022-10-19T03%3A21%3A52Z => generated 7022 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:24:27.942315 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c0a147ec-9a2c-4d28-8a92-56ab276338d2 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:27.942936 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c0a147ec-9a2c-4d28-8a92-56ab276338d2 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: 4d77faf6-475d-4711-820a-623c1b705f8c] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:27.950469 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c0a147ec-9a2c-4d28-8a92-56ab276338d2 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:27.950967 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c0a147ec-9a2c-4d28-8a92-56ab276338d2 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:27.951593 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c0a147ec-9a2c-4d28-8a92-56ab276338d2 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:27.952301 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c0a147ec-9a2c-4d28-8a92-56ab276338d2 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:27.952956 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c0a147ec-9a2c-4d28-8a92-56ab276338d2 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:27.953418 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c0a147ec-9a2c-4d28-8a92-56ab276338d2 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:28.112639 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c0a147ec-9a2c-4d28-8a92-56ab276338d2 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:28.128779 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c0a147ec-9a2c-4d28-8a92-56ab276338d2 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/4d77faf6-475d-4711-820a-623c1b705f8c" status: 200 len: 1477 microversion: 2.1 time: 0.190646 Oct 19 03:24:28.129433 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1391/2841] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:24:27 2022] GET /compute/v2.1/servers/4d77faf6-475d-4711-820a-623c1b705f8c => generated 1477 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:24:28.148005 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-36fca39f-dce9-40c9-a3fb-8c45a4089eb5 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Calling method '.version_select at 0x7fc13024a790>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:28.198076 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-36fca39f-dce9-40c9-a3fb-8c45a4089eb5 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] 10.222.0.52 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-811934560" status: 200 len: 664 microversion: 2.1 time: 0.067115 Oct 19 03:24:28.199379 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1392/2842] 10.222.0.52 () {58 vars in 1250 bytes} [Wed Oct 19 03:24:28 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-811934560 => generated 664 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:24:28.214721 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7da7fe1a-84dd-48ec-9e8c-29a3b24b09a1 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-134458971", "imageRef": "7859ccbe-ff2d-44fa-88f5-c303bc8930d2", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "b3962430-ec55-4c43-a48f-9632d5c711f0"}], "security_groups": [{"name": "tempest-securitygroup--1137393540"}], "key_name": "tempest-keypair-250895219", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:24:28.421349 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-7da7fe1a-84dd-48ec-9e8c-29a3b24b09a1 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] validate_networks() for [('b3962430-ec55-4c43-a48f-9632d5c711f0', None, None, None, None, None)] {{(pid=121134) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:24:29.163749 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-7da7fe1a-84dd-48ec-9e8c-29a3b24b09a1 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Flavor limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:24:29.165044 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-7da7fe1a-84dd-48ec-9e8c-29a3b24b09a1 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Image limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:24:29.165935 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-7da7fe1a-84dd-48ec-9e8c-29a3b24b09a1 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Flavor pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:24:29.166556 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-7da7fe1a-84dd-48ec-9e8c-29a3b24b09a1 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Image pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:24:29.167730 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-7da7fe1a-84dd-48ec-9e8c-29a3b24b09a1 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:24:29.178115 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7da7fe1a-84dd-48ec-9e8c-29a3b24b09a1 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:29.178830 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7da7fe1a-84dd-48ec-9e8c-29a3b24b09a1 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:29.180455 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7da7fe1a-84dd-48ec-9e8c-29a3b24b09a1 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:29.181269 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7da7fe1a-84dd-48ec-9e8c-29a3b24b09a1 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:29.181746 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7da7fe1a-84dd-48ec-9e8c-29a3b24b09a1 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:29.182354 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7da7fe1a-84dd-48ec-9e8c-29a3b24b09a1 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:29.202855 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-7da7fe1a-84dd-48ec-9e8c-29a3b24b09a1 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Getting quotas for project 42bf79842c02480eb1e91d521226d317. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:24:29.209470 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-7da7fe1a-84dd-48ec-9e8c-29a3b24b09a1 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Getting quotas for user 74bf143866aa44afb11285d61ffd7ee2 and project 42bf79842c02480eb1e91d521226d317. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:24:29.224054 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7da7fe1a-84dd-48ec-9e8c-29a3b24b09a1 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Going to run 1 instances... {{(pid=121134) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:24:29.226430 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7da7fe1a-84dd-48ec-9e8c-29a3b24b09a1 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] [instance: 2870c53d-df7c-45d3-b8bd-c88966ad6315] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7859ccbe-ff2d-44fa-88f5-c303bc8930d2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:24:29.458266 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7da7fe1a-84dd-48ec-9e8c-29a3b24b09a1 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.257640 Oct 19 03:24:29.465587 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1393/2843] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:24:28 2022] POST /compute/v2.1/servers => generated 406 bytes in 1265 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 03:24:29.470830 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ca7d7ef2-a9b8-4407-9e10-c642c800df5b tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-654223510"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:24:29.473340 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ca7d7ef2-a9b8-4407-9e10-c642c800df5b tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: 4d77faf6-475d-4711-820a-623c1b705f8c] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:29.480444 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ca7d7ef2-a9b8-4407-9e10-c642c800df5b tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:29.481212 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ca7d7ef2-a9b8-4407-9e10-c642c800df5b tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:29.481748 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ca7d7ef2-a9b8-4407-9e10-c642c800df5b tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:29.482516 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ca7d7ef2-a9b8-4407-9e10-c642c800df5b tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:29.483033 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ca7d7ef2-a9b8-4407-9e10-c642c800df5b tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:29.487235 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ca7d7ef2-a9b8-4407-9e10-c642c800df5b tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:29.987323 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0d1db70b-94a0-4802-9dc5-9118fdc1c0a5 tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/fc300547-2017-4a58-8afc-350a262b5450/action" status: 202 len: 0 microversion: 2.1 time: 3.696366 Oct 19 03:24:29.989323 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1451/2844] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:24:26 2022] POST /compute/v2.1/servers/fc300547-2017-4a58-8afc-350a262b5450/action => generated 0 bytes in 3707 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:24:29.992705 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ca7d7ef2-a9b8-4407-9e10-c642c800df5b tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "POST /compute/v2.1/servers/4d77faf6-475d-4711-820a-623c1b705f8c/action" status: 202 len: 0 microversion: 2.1 time: 0.525166 Oct 19 03:24:29.994292 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1394/2845] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:24:29 2022] POST /compute/v2.1/servers/4d77faf6-475d-4711-820a-623c1b705f8c/action => generated 0 bytes in 528 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 19 03:24:30.004472 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5a8afe45-f8f6-4421-8c73-13f1d3e0cab0 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Calling method '.version_select at 0x7fc130032430>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:30.004667 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-09232e1a-230f-4deb-b929-e532dbc8c09c req-f722d9f8-9d3c-4ab3-b243-e128acb6af33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "410116db-4d00-4a9d-8375-a5cea6a0d627", "name": "network-vif-unplugged", "status": "completed", "tag": "c7f441d5-a985-4c81-97b8-114d47006d03"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:24:30.019367 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-09232e1a-230f-4deb-b929-e532dbc8c09c req-f722d9f8-9d3c-4ab3-b243-e128acb6af33 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:30.020351 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-09232e1a-230f-4deb-b929-e532dbc8c09c req-f722d9f8-9d3c-4ab3-b243-e128acb6af33 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:30.021703 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-09232e1a-230f-4deb-b929-e532dbc8c09c req-f722d9f8-9d3c-4ab3-b243-e128acb6af33 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:30.041213 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-09232e1a-230f-4deb-b929-e532dbc8c09c req-f722d9f8-9d3c-4ab3-b243-e128acb6af33 service nova] Creating event network-vif-unplugged:c7f441d5-a985-4c81-97b8-114d47006d03 for instance 410116db-4d00-4a9d-8375-a5cea6a0d627 on n-h2-861333-8 Oct 19 03:24:30.046554 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-09232e1a-230f-4deb-b929-e532dbc8c09c req-f722d9f8-9d3c-4ab3-b243-e128acb6af33 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048144 Oct 19 03:24:30.047119 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1395/2846] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:24:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:24:30.052995 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c124806d-9a66-4cda-9819-0af2c8d43d23 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:30.053718 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c124806d-9a66-4cda-9819-0af2c8d43d23 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] [instance: cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:30.063629 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c124806d-9a66-4cda-9819-0af2c8d43d23 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:30.064137 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c124806d-9a66-4cda-9819-0af2c8d43d23 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:30.064579 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c124806d-9a66-4cda-9819-0af2c8d43d23 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:30.065403 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c124806d-9a66-4cda-9819-0af2c8d43d23 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:30.065864 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c124806d-9a66-4cda-9819-0af2c8d43d23 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:30.066961 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c124806d-9a66-4cda-9819-0af2c8d43d23 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:30.085253 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5a8afe45-f8f6-4421-8c73-13f1d3e0cab0 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] 10.222.0.52 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.52%2Fcompute%2Fv2.1%2Fservers%2F6ef505a5-0624-4080-9089-821f6fdfb47c" status: 200 len: 1467 microversion: 2.1 time: 0.089725 Oct 19 03:24:30.085878 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1452/2847] 10.222.0.52 () {58 vars in 1338 bytes} [Wed Oct 19 03:24:29 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.52%2Fcompute%2Fv2.1%2Fservers%2F6ef505a5-0624-4080-9089-821f6fdfb47c => generated 1467 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:24:30.094454 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b0ec7a59-d19c-4034-a743-745d2bcc66bd tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:30.095992 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b0ec7a59-d19c-4034-a743-745d2bcc66bd tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] [instance: 333ed6dd-d020-4ef4-849c-956ed44cd18c] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:30.100900 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:24:30.105034 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b0ec7a59-d19c-4034-a743-745d2bcc66bd tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:30.105566 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b0ec7a59-d19c-4034-a743-745d2bcc66bd tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:30.106178 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b0ec7a59-d19c-4034-a743-745d2bcc66bd tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:30.107239 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b0ec7a59-d19c-4034-a743-745d2bcc66bd tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:30.107712 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b0ec7a59-d19c-4034-a743-745d2bcc66bd tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:30.108147 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b0ec7a59-d19c-4034-a743-745d2bcc66bd tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:30.433225 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b0ec7a59-d19c-4034-a743-745d2bcc66bd tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1fe2c1882341168e740e196b84ab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aa84ea2412a41d19901061f97068a00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:30.453303 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c124806d-9a66-4cda-9819-0af2c8d43d23 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:30.454512 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b0ec7a59-d19c-4034-a743-745d2bcc66bd tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] 10.222.0.52 "GET /compute/v2.1/servers/333ed6dd-d020-4ef4-849c-956ed44cd18c" status: 200 len: 1317 microversion: 2.1 time: 0.357103 Oct 19 03:24:30.455173 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1453/2848] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:24:30 2022] GET /compute/v2.1/servers/333ed6dd-d020-4ef4-849c-956ed44cd18c => generated 1317 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:24:30.469588 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c124806d-9a66-4cda-9819-0af2c8d43d23 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:30.471463 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c124806d-9a66-4cda-9819-0af2c8d43d23 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:30.473726 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c124806d-9a66-4cda-9819-0af2c8d43d23 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] 10.222.0.52 "GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95" status: 200 len: 1879 microversion: 2.42 time: 0.425240 Oct 19 03:24:30.483078 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ea127449-5d90-4d20-9be0-a3610720f6d8 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:30.485808 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ea127449-5d90-4d20-9be0-a3610720f6d8 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] [instance: 2870c53d-df7c-45d3-b8bd-c88966ad6315] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:30.488235 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1396/2849] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:24:30 2022] GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 => generated 1879 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:24:30.499651 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e180e963-4cf1-4835-ae30-88f03f1c6a3f tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:30.500126 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e180e963-4cf1-4835-ae30-88f03f1c6a3f tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: fc300547-2017-4a58-8afc-350a262b5450] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:30.517114 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e180e963-4cf1-4835-ae30-88f03f1c6a3f tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:30.519146 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e180e963-4cf1-4835-ae30-88f03f1c6a3f tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:30.519405 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e180e963-4cf1-4835-ae30-88f03f1c6a3f tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:30.520192 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e180e963-4cf1-4835-ae30-88f03f1c6a3f tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:30.520621 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e180e963-4cf1-4835-ae30-88f03f1c6a3f tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:30.521052 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e180e963-4cf1-4835-ae30-88f03f1c6a3f tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:30.573536 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ea127449-5d90-4d20-9be0-a3610720f6d8 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bf143866aa44afb11285d61ffd7ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bf79842c02480eb1e91d521226d317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:30.581296 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ea127449-5d90-4d20-9be0-a3610720f6d8 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] 10.222.0.52 "GET /compute/v2.1/servers/2870c53d-df7c-45d3-b8bd-c88966ad6315" status: 200 len: 1244 microversion: 2.1 time: 0.107031 Oct 19 03:24:30.586332 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1454/2850] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:24:30 2022] GET /compute/v2.1/servers/2870c53d-df7c-45d3-b8bd-c88966ad6315 => generated 1244 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:24:30.600226 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e129a067-74cc-44b1-913b-c5a95cde1c7e tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '.version_select at 0x7fc12bfef550>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:30.653008 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e129a067-74cc-44b1-913b-c5a95cde1c7e tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/images/d097da85-3979-4bc7-a81a-f2cd9d38e3ff" status: 200 len: 1435 microversion: 2.1 time: 0.065293 Oct 19 03:24:30.653627 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1455/2851] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:24:30 2022] GET /compute/v2.1/images/d097da85-3979-4bc7-a81a-f2cd9d38e3ff => generated 1435 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:24:30.659040 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-eec7239c-97e7-42e4-8948-7629f8a42190 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Calling method '.version_select at 0x7fc1300153a0>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:30.708535 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e180e963-4cf1-4835-ae30-88f03f1c6a3f tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:30.717355 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:24:30.725983 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-eec7239c-97e7-42e4-8948-7629f8a42190 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] 10.222.0.52 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.52%2Fcompute%2Fservers%2F6ef505a5-0624-4080-9089-821f6fdfb47c" status: 200 len: 1467 microversion: 2.1 time: 0.071098 Oct 19 03:24:30.730278 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1456/2852] 10.222.0.52 () {58 vars in 1324 bytes} [Wed Oct 19 03:24:30 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.52%2Fcompute%2Fservers%2F6ef505a5-0624-4080-9089-821f6fdfb47c => generated 1467 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:24:30.743763 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e180e963-4cf1-4835-ae30-88f03f1c6a3f tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/fc300547-2017-4a58-8afc-350a262b5450" status: 200 len: 1503 microversion: 2.1 time: 0.254319 Oct 19 03:24:30.744265 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-e5df32e6-5ce2-4053-8bc3-e68c2cebafd1 req-642e3949-5518-4849-9cbb-644512b23b63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "333ed6dd-d020-4ef4-849c-956ed44cd18c", "tag": "4c4afe41-1ec7-44c2-915b-bd1b7979020e"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:24:30.744839 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1397/2853] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:24:30 2022] GET /compute/v2.1/servers/fc300547-2017-4a58-8afc-350a262b5450 => generated 1503 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:24:30.758086 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-e5df32e6-5ce2-4053-8bc3-e68c2cebafd1 req-642e3949-5518-4849-9cbb-644512b23b63 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:30.758086 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-e5df32e6-5ce2-4053-8bc3-e68c2cebafd1 req-642e3949-5518-4849-9cbb-644512b23b63 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:30.758086 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-e5df32e6-5ce2-4053-8bc3-e68c2cebafd1 req-642e3949-5518-4849-9cbb-644512b23b63 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:30.767356 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1e565ad0-46bc-40bd-b767-196a36ee5024 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Calling method '.version_select at 0x7fc1302de670>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:30.769665 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-e5df32e6-5ce2-4053-8bc3-e68c2cebafd1 req-642e3949-5518-4849-9cbb-644512b23b63 service nova] Creating event network-changed:4c4afe41-1ec7-44c2-915b-bd1b7979020e for instance 333ed6dd-d020-4ef4-849c-956ed44cd18c on n-h1-861333-8 Oct 19 03:24:30.775048 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-e5df32e6-5ce2-4053-8bc3-e68c2cebafd1 req-642e3949-5518-4849-9cbb-644512b23b63 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043325 Oct 19 03:24:30.775831 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1457/2854] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:24:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:24:30.867766 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1e565ad0-46bc-40bd-b767-196a36ee5024 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] 10.222.0.52 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7797 microversion: 2.1 time: 0.107835 Oct 19 03:24:30.868369 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1398/2855] 10.222.0.52 () {58 vars in 1170 bytes} [Wed Oct 19 03:24:30 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7797 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:24:30.892365 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-741bbf46-daad-414d-b7bc-7b2570edd4af tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Calling method '.version_select at 0x7fc1300474c0>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:30.991547 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-741bbf46-daad-414d-b7bc-7b2570edd4af tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] 10.222.0.52 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4376 microversion: 2.1 time: 0.105352 Oct 19 03:24:30.992258 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1458/2856] 10.222.0.52 () {58 vars in 1170 bytes} [Wed Oct 19 03:24:30 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4376 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:24:31.013611 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6bed7adf-f41e-40e5-a9f7-a3f2ebfaa93d tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Calling method '.version_select at 0x7fc1302de430>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:31.061212 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6bed7adf-f41e-40e5-a9f7-a3f2ebfaa93d tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] 10.222.0.52 "GET /compute/v2.1/images/9e16d73e-70ea-4421-aee3-047d80396c02" status: 200 len: 784 microversion: 2.1 time: 0.053589 Oct 19 03:24:31.071895 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1399/2857] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:24:31 2022] GET /compute/v2.1/images/9e16d73e-70ea-4421-aee3-047d80396c02 => generated 784 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:24:31.078348 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c4c0f843-4954-465a-aca5-72460d313f62 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Calling method '.version_select at 0x7fc12bfef940>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:31.129075 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c4c0f843-4954-465a-aca5-72460d313f62 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] 10.222.0.52 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 844 microversion: 2.1 time: 0.056159 Oct 19 03:24:31.130123 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1459/2858] 10.222.0.52 () {58 vars in 1158 bytes} [Wed Oct 19 03:24:31 2022] GET /compute/v2.1/images/detail?limit=1 => generated 844 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:24:31.147162 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-23efc14e-5111-4034-b329-6eb744333a6d tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Calling method '.version_select at 0x7fc1301ef280>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:31.493936 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-aaf1a8eb-c70f-448d-a513-6ff11dce68da tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:31.494868 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-aaf1a8eb-c70f-448d-a513-6ff11dce68da tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] [instance: 333ed6dd-d020-4ef4-849c-956ed44cd18c] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:31.503559 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aaf1a8eb-c70f-448d-a513-6ff11dce68da tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:31.504163 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aaf1a8eb-c70f-448d-a513-6ff11dce68da tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:31.504749 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aaf1a8eb-c70f-448d-a513-6ff11dce68da tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:31.505591 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aaf1a8eb-c70f-448d-a513-6ff11dce68da tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:31.506179 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aaf1a8eb-c70f-448d-a513-6ff11dce68da tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:31.506830 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aaf1a8eb-c70f-448d-a513-6ff11dce68da tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:32.080536 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-aaf1a8eb-c70f-448d-a513-6ff11dce68da tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1fe2c1882341168e740e196b84ab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aa84ea2412a41d19901061f97068a00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:32.088267 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-aaf1a8eb-c70f-448d-a513-6ff11dce68da tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] 10.222.0.52 "GET /compute/v2.1/servers/333ed6dd-d020-4ef4-849c-956ed44cd18c" status: 200 len: 1317 microversion: 2.1 time: 0.598883 Oct 19 03:24:32.088866 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1460/2859] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:24:31 2022] GET /compute/v2.1/servers/333ed6dd-d020-4ef4-849c-956ed44cd18c => generated 1317 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:24:32.093593 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a90c04c9-fe41-4a8d-9fba-60729292409b tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:32.094302 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a90c04c9-fe41-4a8d-9fba-60729292409b tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] [instance: cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:32.100305 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a90c04c9-fe41-4a8d-9fba-60729292409b tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:32.100871 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a90c04c9-fe41-4a8d-9fba-60729292409b tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:32.101321 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a90c04c9-fe41-4a8d-9fba-60729292409b tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:32.102056 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a90c04c9-fe41-4a8d-9fba-60729292409b tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:32.102503 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a90c04c9-fe41-4a8d-9fba-60729292409b tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:32.102928 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a90c04c9-fe41-4a8d-9fba-60729292409b tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:32.454444 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-23efc14e-5111-4034-b329-6eb744333a6d tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] 10.222.0.52 "DELETE /compute/v2.1/images/f79fed39-c87d-4cd3-891b-877f8e1da73d" status: 204 len: 0 microversion: 2.1 time: 1.311454 Oct 19 03:24:32.455025 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1400/2860] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:24:31 2022] DELETE /compute/v2.1/images/f79fed39-c87d-4cd3-891b-877f8e1da73d => generated 0 bytes in 1313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 19 03:24:32.460160 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-47495075-fcdd-4eff-a763-0e768fa39fe9 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:32.460995 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-47495075-fcdd-4eff-a763-0e768fa39fe9 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] [instance: 2870c53d-df7c-45d3-b8bd-c88966ad6315] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:32.472360 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-47495075-fcdd-4eff-a763-0e768fa39fe9 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:32.475952 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-47495075-fcdd-4eff-a763-0e768fa39fe9 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:32.476874 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-47495075-fcdd-4eff-a763-0e768fa39fe9 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:32.477852 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-47495075-fcdd-4eff-a763-0e768fa39fe9 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:32.478662 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-47495075-fcdd-4eff-a763-0e768fa39fe9 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:32.483299 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a90c04c9-fe41-4a8d-9fba-60729292409b tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:32.483658 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-47495075-fcdd-4eff-a763-0e768fa39fe9 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:32.497906 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a90c04c9-fe41-4a8d-9fba-60729292409b tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:32.499360 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a90c04c9-fe41-4a8d-9fba-60729292409b tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:32.500539 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a90c04c9-fe41-4a8d-9fba-60729292409b tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] 10.222.0.52 "GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95" status: 200 len: 1879 microversion: 2.42 time: 0.410545 Oct 19 03:24:32.518314 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1461/2861] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:24:32 2022] GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 => generated 1879 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:24:32.526084 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b19f4f8e-dd08-4021-b8af-cabb6393ea69 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '.version_select at 0x7fc130031c10>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:32.597575 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b19f4f8e-dd08-4021-b8af-cabb6393ea69 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/images/d097da85-3979-4bc7-a81a-f2cd9d38e3ff" status: 200 len: 1435 microversion: 2.1 time: 0.071462 Oct 19 03:24:32.597575 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1462/2862] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:24:32 2022] GET /compute/v2.1/images/d097da85-3979-4bc7-a81a-f2cd9d38e3ff => generated 1435 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:24:32.597575 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a5f27f1d-21dd-48b4-b354-27a299046368 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:32.598127 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a5f27f1d-21dd-48b4-b354-27a299046368 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: fc300547-2017-4a58-8afc-350a262b5450] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:32.605098 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a5f27f1d-21dd-48b4-b354-27a299046368 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:32.605702 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a5f27f1d-21dd-48b4-b354-27a299046368 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:32.606078 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a5f27f1d-21dd-48b4-b354-27a299046368 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:32.606786 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a5f27f1d-21dd-48b4-b354-27a299046368 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:32.607275 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a5f27f1d-21dd-48b4-b354-27a299046368 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:32.609471 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a5f27f1d-21dd-48b4-b354-27a299046368 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:32.621786 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-47495075-fcdd-4eff-a763-0e768fa39fe9 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bf143866aa44afb11285d61ffd7ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bf79842c02480eb1e91d521226d317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:32.630792 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-47495075-fcdd-4eff-a763-0e768fa39fe9 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] 10.222.0.52 "GET /compute/v2.1/servers/2870c53d-df7c-45d3-b8bd-c88966ad6315" status: 200 len: 1248 microversion: 2.1 time: 0.174500 Oct 19 03:24:32.631383 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1401/2863] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:24:32 2022] GET /compute/v2.1/servers/2870c53d-df7c-45d3-b8bd-c88966ad6315 => generated 1248 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:24:32.652324 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-30acc86a-bc1b-47ea-9978-181c6eac6b8f tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Calling method '.version_select at 0x7fc1301ef040>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:32.927294 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a5f27f1d-21dd-48b4-b354-27a299046368 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:32.936823 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a5f27f1d-21dd-48b4-b354-27a299046368 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/fc300547-2017-4a58-8afc-350a262b5450" status: 200 len: 1503 microversion: 2.1 time: 0.343558 Oct 19 03:24:32.940730 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1463/2864] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:24:32 2022] GET /compute/v2.1/servers/fc300547-2017-4a58-8afc-350a262b5450 => generated 1503 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:24:33.117567 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b9141950-bbe1-49d0-929b-38c8914deb23 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:33.119020 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b9141950-bbe1-49d0-929b-38c8914deb23 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] [instance: 333ed6dd-d020-4ef4-849c-956ed44cd18c] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:33.150982 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b9141950-bbe1-49d0-929b-38c8914deb23 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:33.156142 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b9141950-bbe1-49d0-929b-38c8914deb23 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:33.156142 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b9141950-bbe1-49d0-929b-38c8914deb23 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:33.157620 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b9141950-bbe1-49d0-929b-38c8914deb23 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:33.158117 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b9141950-bbe1-49d0-929b-38c8914deb23 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:33.158879 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b9141950-bbe1-49d0-929b-38c8914deb23 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:33.535303 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b9141950-bbe1-49d0-929b-38c8914deb23 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1fe2c1882341168e740e196b84ab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aa84ea2412a41d19901061f97068a00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:33.543024 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b9141950-bbe1-49d0-929b-38c8914deb23 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] 10.222.0.52 "GET /compute/v2.1/servers/333ed6dd-d020-4ef4-849c-956ed44cd18c" status: 200 len: 1317 microversion: 2.1 time: 0.429669 Oct 19 03:24:33.543602 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1464/2865] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:24:33 2022] GET /compute/v2.1/servers/333ed6dd-d020-4ef4-849c-956ed44cd18c => generated 1317 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:24:33.561268 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-3698f787-2c47-4268-94e3-3280f93993be req-980c0431-ed2f-4ca6-8b1b-ee1c81406db1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc300547-2017-4a58-8afc-350a262b5450", "name": "network-vif-unplugged", "status": "completed", "tag": "b4c0ab4e-2e4a-45c0-abba-79284270738d"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:24:33.576249 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-3698f787-2c47-4268-94e3-3280f93993be req-980c0431-ed2f-4ca6-8b1b-ee1c81406db1 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:33.581268 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-3698f787-2c47-4268-94e3-3280f93993be req-980c0431-ed2f-4ca6-8b1b-ee1c81406db1 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:33.581890 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-3698f787-2c47-4268-94e3-3280f93993be req-980c0431-ed2f-4ca6-8b1b-ee1c81406db1 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:33.610360 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-3698f787-2c47-4268-94e3-3280f93993be req-980c0431-ed2f-4ca6-8b1b-ee1c81406db1 service nova] Creating event network-vif-unplugged:b4c0ab4e-2e4a-45c0-abba-79284270738d for instance fc300547-2017-4a58-8afc-350a262b5450 on n-h1-861333-8 Oct 19 03:24:33.615737 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-3698f787-2c47-4268-94e3-3280f93993be req-980c0431-ed2f-4ca6-8b1b-ee1c81406db1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.070976 Oct 19 03:24:33.616715 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1465/2866] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:24:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:24:33.623289 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7e094b2d-a02f-4364-b387-1610030fbb33 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:33.623988 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7e094b2d-a02f-4364-b387-1610030fbb33 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] [instance: cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:33.630259 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7e094b2d-a02f-4364-b387-1610030fbb33 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:33.630744 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7e094b2d-a02f-4364-b387-1610030fbb33 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:33.631196 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7e094b2d-a02f-4364-b387-1610030fbb33 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:33.631866 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7e094b2d-a02f-4364-b387-1610030fbb33 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:33.632324 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7e094b2d-a02f-4364-b387-1610030fbb33 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:33.632740 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7e094b2d-a02f-4364-b387-1610030fbb33 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:34.066643 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7e094b2d-a02f-4364-b387-1610030fbb33 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:34.087017 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7e094b2d-a02f-4364-b387-1610030fbb33 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:34.087017 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7e094b2d-a02f-4364-b387-1610030fbb33 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:34.087907 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7e094b2d-a02f-4364-b387-1610030fbb33 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] 10.222.0.52 "GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95" status: 200 len: 1879 microversion: 2.42 time: 0.469821 Oct 19 03:24:34.088567 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1466/2867] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:24:33 2022] GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 => generated 1879 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:24:34.101582 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-dc8b3150-c1f9-4400-9d4a-a29cbb444931 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '.version_select at 0x7fc130015670>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:34.104734 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:24:34.117139 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-30acc86a-bc1b-47ea-9978-181c6eac6b8f tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] 10.222.0.52 "DELETE /compute/v2.1/images/c09f0682-cee7-4a5b-a32d-5b6db22a1d38" status: 204 len: 0 microversion: 2.1 time: 1.474409 Oct 19 03:24:34.123073 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1402/2868] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:24:32 2022] DELETE /compute/v2.1/images/c09f0682-cee7-4a5b-a32d-5b6db22a1d38 => generated 0 bytes in 1477 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:24:34.135138 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ffdc5772-4a57-408c-9b98-74e660ed73a3 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:34.138738 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ffdc5772-4a57-408c-9b98-74e660ed73a3 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] [instance: 2870c53d-df7c-45d3-b8bd-c88966ad6315] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:34.159899 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ffdc5772-4a57-408c-9b98-74e660ed73a3 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:34.161138 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ffdc5772-4a57-408c-9b98-74e660ed73a3 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:34.162141 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ffdc5772-4a57-408c-9b98-74e660ed73a3 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:34.164003 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ffdc5772-4a57-408c-9b98-74e660ed73a3 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:34.166097 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ffdc5772-4a57-408c-9b98-74e660ed73a3 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:34.166629 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ffdc5772-4a57-408c-9b98-74e660ed73a3 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:34.226470 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-dc8b3150-c1f9-4400-9d4a-a29cbb444931 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/images/d097da85-3979-4bc7-a81a-f2cd9d38e3ff" status: 200 len: 1435 microversion: 2.1 time: 0.123001 Oct 19 03:24:34.243067 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1467/2869] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:24:34 2022] GET /compute/v2.1/images/d097da85-3979-4bc7-a81a-f2cd9d38e3ff => generated 1435 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:24:34.250631 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b93ce085-89ac-4c6e-9be0-9ba43afeb13b tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:34.253965 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b93ce085-89ac-4c6e-9be0-9ba43afeb13b tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: fc300547-2017-4a58-8afc-350a262b5450] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:34.271163 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b93ce085-89ac-4c6e-9be0-9ba43afeb13b tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:34.271864 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b93ce085-89ac-4c6e-9be0-9ba43afeb13b tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:34.272453 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b93ce085-89ac-4c6e-9be0-9ba43afeb13b tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:34.274881 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b93ce085-89ac-4c6e-9be0-9ba43afeb13b tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:34.277248 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b93ce085-89ac-4c6e-9be0-9ba43afeb13b tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:34.277892 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b93ce085-89ac-4c6e-9be0-9ba43afeb13b tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:34.329895 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ffdc5772-4a57-408c-9b98-74e660ed73a3 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bf143866aa44afb11285d61ffd7ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bf79842c02480eb1e91d521226d317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:34.344991 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ffdc5772-4a57-408c-9b98-74e660ed73a3 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] 10.222.0.52 "GET /compute/v2.1/servers/2870c53d-df7c-45d3-b8bd-c88966ad6315" status: 200 len: 1296 microversion: 2.1 time: 0.219265 Oct 19 03:24:34.344991 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1403/2870] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:24:34 2022] GET /compute/v2.1/servers/2870c53d-df7c-45d3-b8bd-c88966ad6315 => generated 1296 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:24:34.355145 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-62352880-4864-4e64-b5c2-59a2db743aff tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Calling method '.version_select at 0x7fc13024a040>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:34.693596 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b93ce085-89ac-4c6e-9be0-9ba43afeb13b tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:34.713094 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b93ce085-89ac-4c6e-9be0-9ba43afeb13b tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/fc300547-2017-4a58-8afc-350a262b5450" status: 200 len: 1503 microversion: 2.1 time: 0.463354 Oct 19 03:24:34.713094 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1468/2871] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:24:34 2022] GET /compute/v2.1/servers/fc300547-2017-4a58-8afc-350a262b5450 => generated 1503 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:24:34.720923 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-91dad15f-d64a-4f94-a738-7d3675c8d0b4 req-89ab84ce-f87b-4529-a047-efc03782d3df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d77faf6-475d-4711-820a-623c1b705f8c", "name": "network-vif-plugged", "status": "completed", "tag": "22167c4d-32ff-41fa-bec4-4c8908d6b685"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:24:34.743856 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-91dad15f-d64a-4f94-a738-7d3675c8d0b4 req-89ab84ce-f87b-4529-a047-efc03782d3df service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:34.747687 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-91dad15f-d64a-4f94-a738-7d3675c8d0b4 req-89ab84ce-f87b-4529-a047-efc03782d3df service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:34.747687 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-91dad15f-d64a-4f94-a738-7d3675c8d0b4 req-89ab84ce-f87b-4529-a047-efc03782d3df service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:34.778586 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-91dad15f-d64a-4f94-a738-7d3675c8d0b4 req-89ab84ce-f87b-4529-a047-efc03782d3df service nova] Creating event network-vif-plugged:22167c4d-32ff-41fa-bec4-4c8908d6b685 for instance 4d77faf6-475d-4711-820a-623c1b705f8c on n-h2-861333-8 Oct 19 03:24:34.785643 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-91dad15f-d64a-4f94-a738-7d3675c8d0b4 req-89ab84ce-f87b-4529-a047-efc03782d3df service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075620 Oct 19 03:24:34.786944 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1469/2872] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:24:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:24:34.796846 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-65384d01-4c32-4199-b759-6a3f79d3b602 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:34.799223 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-65384d01-4c32-4199-b759-6a3f79d3b602 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] [instance: 333ed6dd-d020-4ef4-849c-956ed44cd18c] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:34.806145 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-65384d01-4c32-4199-b759-6a3f79d3b602 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:34.806949 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-65384d01-4c32-4199-b759-6a3f79d3b602 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:34.807674 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-65384d01-4c32-4199-b759-6a3f79d3b602 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:34.808679 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-65384d01-4c32-4199-b759-6a3f79d3b602 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:34.809356 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-65384d01-4c32-4199-b759-6a3f79d3b602 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:34.811019 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-65384d01-4c32-4199-b759-6a3f79d3b602 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:35.186001 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-65384d01-4c32-4199-b759-6a3f79d3b602 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1fe2c1882341168e740e196b84ab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aa84ea2412a41d19901061f97068a00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:35.207913 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-65384d01-4c32-4199-b759-6a3f79d3b602 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] 10.222.0.52 "GET /compute/v2.1/servers/333ed6dd-d020-4ef4-849c-956ed44cd18c" status: 200 len: 1317 microversion: 2.1 time: 0.416989 Oct 19 03:24:35.227000 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1470/2873] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:24:34 2022] GET /compute/v2.1/servers/333ed6dd-d020-4ef4-849c-956ed44cd18c => generated 1317 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:24:35.238390 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ebe9f567-e107-4d87-962c-cb71883be090 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:35.238390 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ebe9f567-e107-4d87-962c-cb71883be090 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] [instance: cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:35.249297 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ebe9f567-e107-4d87-962c-cb71883be090 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:35.251303 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ebe9f567-e107-4d87-962c-cb71883be090 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:35.254981 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ebe9f567-e107-4d87-962c-cb71883be090 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:35.257625 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ebe9f567-e107-4d87-962c-cb71883be090 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:35.258304 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ebe9f567-e107-4d87-962c-cb71883be090 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:35.258792 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ebe9f567-e107-4d87-962c-cb71883be090 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:35.583555 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ebe9f567-e107-4d87-962c-cb71883be090 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:35.593189 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ebe9f567-e107-4d87-962c-cb71883be090 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:35.597762 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ebe9f567-e107-4d87-962c-cb71883be090 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:35.602237 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ebe9f567-e107-4d87-962c-cb71883be090 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] 10.222.0.52 "GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95" status: 200 len: 1879 microversion: 2.42 time: 0.372563 Oct 19 03:24:35.606990 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1471/2874] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:24:35 2022] GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 => generated 1879 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:24:35.622112 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-42977bdf-698c-42db-b8a7-5c742da537cc tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '.version_select at 0x7fc12bfef310>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:36.155974 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-62352880-4864-4e64-b5c2-59a2db743aff tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] 10.222.0.52 "DELETE /compute/v2.1/images/b198d558-6429-48b5-a113-6a3a25c104ff" status: 204 len: 0 microversion: 2.1 time: 1.806284 Oct 19 03:24:36.155974 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1404/2875] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:24:34 2022] DELETE /compute/v2.1/images/b198d558-6429-48b5-a113-6a3a25c104ff => generated 0 bytes in 1808 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:24:36.157902 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-449dfe3e-6877-411d-8ac5-fb3b4d97ec25 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:36.158811 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-449dfe3e-6877-411d-8ac5-fb3b4d97ec25 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] [instance: 2870c53d-df7c-45d3-b8bd-c88966ad6315] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:36.181737 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-449dfe3e-6877-411d-8ac5-fb3b4d97ec25 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:36.184455 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-449dfe3e-6877-411d-8ac5-fb3b4d97ec25 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:36.187077 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-449dfe3e-6877-411d-8ac5-fb3b4d97ec25 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:36.188145 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-449dfe3e-6877-411d-8ac5-fb3b4d97ec25 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:36.191578 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-449dfe3e-6877-411d-8ac5-fb3b4d97ec25 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:36.192499 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-449dfe3e-6877-411d-8ac5-fb3b4d97ec25 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:36.303063 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-42977bdf-698c-42db-b8a7-5c742da537cc tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/images/d097da85-3979-4bc7-a81a-f2cd9d38e3ff" status: 200 len: 1435 microversion: 2.1 time: 0.694779 Oct 19 03:24:36.304392 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1472/2876] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:24:35 2022] GET /compute/v2.1/images/d097da85-3979-4bc7-a81a-f2cd9d38e3ff => generated 1435 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:24:36.320997 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-a69e5ea7-1af2-46bc-8cc9-7b561190ceaa req-5d2c5e57-c600-41bf-95a7-e57d9c3c77fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc300547-2017-4a58-8afc-350a262b5450", "tag": "b4c0ab4e-2e4a-45c0-abba-79284270738d"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:24:36.344689 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-a69e5ea7-1af2-46bc-8cc9-7b561190ceaa req-5d2c5e57-c600-41bf-95a7-e57d9c3c77fa service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:36.348973 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-a69e5ea7-1af2-46bc-8cc9-7b561190ceaa req-5d2c5e57-c600-41bf-95a7-e57d9c3c77fa service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:36.350178 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-a69e5ea7-1af2-46bc-8cc9-7b561190ceaa req-5d2c5e57-c600-41bf-95a7-e57d9c3c77fa service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:36.389040 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-a69e5ea7-1af2-46bc-8cc9-7b561190ceaa req-5d2c5e57-c600-41bf-95a7-e57d9c3c77fa service nova] Creating event network-changed:b4c0ab4e-2e4a-45c0-abba-79284270738d for instance fc300547-2017-4a58-8afc-350a262b5450 on n-h1-861333-8 Oct 19 03:24:36.411824 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-a69e5ea7-1af2-46bc-8cc9-7b561190ceaa req-5d2c5e57-c600-41bf-95a7-e57d9c3c77fa service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105857 Oct 19 03:24:36.425460 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1473/2877] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:24:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:24:36.437495 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4aa0ff87-441d-4d9d-840e-d6813469e7ab tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:36.438305 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4aa0ff87-441d-4d9d-840e-d6813469e7ab tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: fc300547-2017-4a58-8afc-350a262b5450] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:36.468872 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4aa0ff87-441d-4d9d-840e-d6813469e7ab tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:36.475893 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4aa0ff87-441d-4d9d-840e-d6813469e7ab tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:36.479607 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4aa0ff87-441d-4d9d-840e-d6813469e7ab tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:36.480383 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4aa0ff87-441d-4d9d-840e-d6813469e7ab tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:36.480849 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4aa0ff87-441d-4d9d-840e-d6813469e7ab tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:36.481280 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4aa0ff87-441d-4d9d-840e-d6813469e7ab tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:36.493911 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:24:36.584175 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-449dfe3e-6877-411d-8ac5-fb3b4d97ec25 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bf143866aa44afb11285d61ffd7ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bf79842c02480eb1e91d521226d317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:36.598885 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-449dfe3e-6877-411d-8ac5-fb3b4d97ec25 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] 10.222.0.52 "GET /compute/v2.1/servers/2870c53d-df7c-45d3-b8bd-c88966ad6315" status: 200 len: 1302 microversion: 2.1 time: 0.447327 Oct 19 03:24:36.600422 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1405/2878] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:24:36 2022] GET /compute/v2.1/servers/2870c53d-df7c-45d3-b8bd-c88966ad6315 => generated 1302 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:24:36.621435 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ed5fda1e-65a4-4c2f-8963-b2bff9cb1b4c tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:36.623432 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ed5fda1e-65a4-4c2f-8963-b2bff9cb1b4c tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] [instance: 6ef505a5-0624-4080-9089-821f6fdfb47c] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:36.636493 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ed5fda1e-65a4-4c2f-8963-b2bff9cb1b4c tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:36.641580 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ed5fda1e-65a4-4c2f-8963-b2bff9cb1b4c tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:36.642517 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ed5fda1e-65a4-4c2f-8963-b2bff9cb1b4c tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:36.643486 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ed5fda1e-65a4-4c2f-8963-b2bff9cb1b4c tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:36.647117 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ed5fda1e-65a4-4c2f-8963-b2bff9cb1b4c tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:36.647913 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ed5fda1e-65a4-4c2f-8963-b2bff9cb1b4c tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:36.708451 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ed5fda1e-65a4-4c2f-8963-b2bff9cb1b4c tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] [instance: 6ef505a5-0624-4080-9089-821f6fdfb47c] Going to try to terminate instance {{(pid=121134) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:24:37.116315 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ed5fda1e-65a4-4c2f-8963-b2bff9cb1b4c tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] 10.222.0.52 "DELETE /compute/v2.1/servers/6ef505a5-0624-4080-9089-821f6fdfb47c" status: 204 len: 0 microversion: 2.1 time: 0.513528 Oct 19 03:24:37.121014 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1406/2879] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:24:36 2022] DELETE /compute/v2.1/servers/6ef505a5-0624-4080-9089-821f6fdfb47c => generated 0 bytes in 517 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:24:37.129914 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a37c98b2-cd79-48b0-990f-326249ea8ad4 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:37.133970 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a37c98b2-cd79-48b0-990f-326249ea8ad4 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] [instance: 333ed6dd-d020-4ef4-849c-956ed44cd18c] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:37.147509 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a37c98b2-cd79-48b0-990f-326249ea8ad4 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:37.149286 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a37c98b2-cd79-48b0-990f-326249ea8ad4 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:37.149990 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a37c98b2-cd79-48b0-990f-326249ea8ad4 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:37.151670 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a37c98b2-cd79-48b0-990f-326249ea8ad4 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:37.153177 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a37c98b2-cd79-48b0-990f-326249ea8ad4 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:37.154134 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a37c98b2-cd79-48b0-990f-326249ea8ad4 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:37.761396 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4aa0ff87-441d-4d9d-840e-d6813469e7ab tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:37.770887 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4aa0ff87-441d-4d9d-840e-d6813469e7ab tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/fc300547-2017-4a58-8afc-350a262b5450" status: 200 len: 1503 microversion: 2.1 time: 1.344048 Oct 19 03:24:37.777619 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1474/2880] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:24:36 2022] GET /compute/v2.1/servers/fc300547-2017-4a58-8afc-350a262b5450 => generated 1503 bytes in 1352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:24:37.798386 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1320277c-c49c-4bd1-9f32-14cdcb3c4970 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:37.799239 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1320277c-c49c-4bd1-9f32-14cdcb3c4970 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] [instance: cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:37.812830 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1320277c-c49c-4bd1-9f32-14cdcb3c4970 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:37.813635 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1320277c-c49c-4bd1-9f32-14cdcb3c4970 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:37.814226 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1320277c-c49c-4bd1-9f32-14cdcb3c4970 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:37.815097 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1320277c-c49c-4bd1-9f32-14cdcb3c4970 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:37.815702 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1320277c-c49c-4bd1-9f32-14cdcb3c4970 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:37.816303 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1320277c-c49c-4bd1-9f32-14cdcb3c4970 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:38.042782 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a37c98b2-cd79-48b0-990f-326249ea8ad4 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1fe2c1882341168e740e196b84ab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aa84ea2412a41d19901061f97068a00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:38.054427 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a37c98b2-cd79-48b0-990f-326249ea8ad4 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] 10.222.0.52 "GET /compute/v2.1/servers/333ed6dd-d020-4ef4-849c-956ed44cd18c" status: 200 len: 1317 microversion: 2.1 time: 0.935591 Oct 19 03:24:38.055551 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1407/2881] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:24:37 2022] GET /compute/v2.1/servers/333ed6dd-d020-4ef4-849c-956ed44cd18c => generated 1317 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:24:38.062789 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8835a5fa-84b8-4caf-a7c1-6c8aac6b0e7c tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:38.074175 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8835a5fa-84b8-4caf-a7c1-6c8aac6b0e7c tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] [instance: 6ef505a5-0624-4080-9089-821f6fdfb47c] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:38.083088 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8835a5fa-84b8-4caf-a7c1-6c8aac6b0e7c tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:38.083907 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8835a5fa-84b8-4caf-a7c1-6c8aac6b0e7c tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:38.085113 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8835a5fa-84b8-4caf-a7c1-6c8aac6b0e7c tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:38.086307 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8835a5fa-84b8-4caf-a7c1-6c8aac6b0e7c tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:38.090160 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8835a5fa-84b8-4caf-a7c1-6c8aac6b0e7c tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:38.090643 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8835a5fa-84b8-4caf-a7c1-6c8aac6b0e7c tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:38.433815 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-1320277c-c49c-4bd1-9f32-14cdcb3c4970 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:38.451476 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-1320277c-c49c-4bd1-9f32-14cdcb3c4970 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:38.455588 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-1320277c-c49c-4bd1-9f32-14cdcb3c4970 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:38.457183 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1320277c-c49c-4bd1-9f32-14cdcb3c4970 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] 10.222.0.52 "GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95" status: 200 len: 1879 microversion: 2.42 time: 0.666597 Oct 19 03:24:38.458163 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1475/2882] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:24:37 2022] GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 => generated 1879 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:24:38.463716 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4b53b0cd-a6fd-4473-aabd-b1ce670b7300 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '.version_select at 0x7fc12bff7430>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:38.588611 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8835a5fa-84b8-4caf-a7c1-6c8aac6b0e7c tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a222bb0f9a4c728d2ed5ca011c032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146393855c047be83270e5334c68e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:38.597363 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8835a5fa-84b8-4caf-a7c1-6c8aac6b0e7c tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] 10.222.0.52 "GET /compute/v2.1/servers/6ef505a5-0624-4080-9089-821f6fdfb47c" status: 200 len: 1473 microversion: 2.1 time: 0.540562 Oct 19 03:24:38.598160 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1408/2883] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:24:38 2022] GET /compute/v2.1/servers/6ef505a5-0624-4080-9089-821f6fdfb47c => generated 1473 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:24:38.603277 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1ddb23ae-41ad-4e30-a6be-eaf17233f08d tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:38.603896 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1ddb23ae-41ad-4e30-a6be-eaf17233f08d tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] [instance: 2870c53d-df7c-45d3-b8bd-c88966ad6315] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:38.610881 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1ddb23ae-41ad-4e30-a6be-eaf17233f08d tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:38.611367 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1ddb23ae-41ad-4e30-a6be-eaf17233f08d tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:38.612091 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1ddb23ae-41ad-4e30-a6be-eaf17233f08d tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:38.612958 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1ddb23ae-41ad-4e30-a6be-eaf17233f08d tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:38.613686 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1ddb23ae-41ad-4e30-a6be-eaf17233f08d tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:38.614278 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1ddb23ae-41ad-4e30-a6be-eaf17233f08d tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:39.012893 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-1ddb23ae-41ad-4e30-a6be-eaf17233f08d tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bf143866aa44afb11285d61ffd7ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bf79842c02480eb1e91d521226d317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:39.012893 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1ddb23ae-41ad-4e30-a6be-eaf17233f08d tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] 10.222.0.52 "GET /compute/v2.1/servers/2870c53d-df7c-45d3-b8bd-c88966ad6315" status: 200 len: 1370 microversion: 2.1 time: 0.248560 Oct 19 03:24:39.012893 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1409/2884] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:24:38 2022] GET /compute/v2.1/servers/2870c53d-df7c-45d3-b8bd-c88966ad6315 => generated 1370 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:24:39.013688 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-a49e3d54-dbeb-4c1f-8a39-c8b055dd762a req-b1f3d074-4aa0-4f18-b1e3-2f98d1268c77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "333ed6dd-d020-4ef4-849c-956ed44cd18c", "name": "network-vif-plugged", "status": "completed", "tag": "4c4afe41-1ec7-44c2-915b-bd1b7979020e"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:24:39.013688 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-a49e3d54-dbeb-4c1f-8a39-c8b055dd762a req-b1f3d074-4aa0-4f18-b1e3-2f98d1268c77 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:39.013688 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-a49e3d54-dbeb-4c1f-8a39-c8b055dd762a req-b1f3d074-4aa0-4f18-b1e3-2f98d1268c77 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:39.013688 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-a49e3d54-dbeb-4c1f-8a39-c8b055dd762a req-b1f3d074-4aa0-4f18-b1e3-2f98d1268c77 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:39.014913 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-a49e3d54-dbeb-4c1f-8a39-c8b055dd762a req-b1f3d074-4aa0-4f18-b1e3-2f98d1268c77 service nova] Creating event network-vif-plugged:4c4afe41-1ec7-44c2-915b-bd1b7979020e for instance 333ed6dd-d020-4ef4-849c-956ed44cd18c on n-h1-861333-8 Oct 19 03:24:39.014913 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-a49e3d54-dbeb-4c1f-8a39-c8b055dd762a req-b1f3d074-4aa0-4f18-b1e3-2f98d1268c77 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039100 Oct 19 03:24:39.014913 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1410/2885] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:24:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:24:39.014913 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-264eff45-c59c-450b-97bb-489f76831fb4 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:39.014913 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-264eff45-c59c-450b-97bb-489f76831fb4 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: fc300547-2017-4a58-8afc-350a262b5450] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:39.015504 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-264eff45-c59c-450b-97bb-489f76831fb4 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:39.015504 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-264eff45-c59c-450b-97bb-489f76831fb4 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:39.015504 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-264eff45-c59c-450b-97bb-489f76831fb4 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:39.015504 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-264eff45-c59c-450b-97bb-489f76831fb4 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:39.016082 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-264eff45-c59c-450b-97bb-489f76831fb4 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:39.016082 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-264eff45-c59c-450b-97bb-489f76831fb4 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:39.066924 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-264eff45-c59c-450b-97bb-489f76831fb4 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:39.076731 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-264eff45-c59c-450b-97bb-489f76831fb4 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/fc300547-2017-4a58-8afc-350a262b5450" status: 200 len: 1503 microversion: 2.1 time: 0.179262 Oct 19 03:24:39.079772 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1411/2886] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:24:38 2022] GET /compute/v2.1/servers/fc300547-2017-4a58-8afc-350a262b5450 => generated 1503 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:24:39.085877 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5dd3b93b-430f-4e63-86d6-391a5ff5ecab tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:39.086614 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5dd3b93b-430f-4e63-86d6-391a5ff5ecab tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] [instance: 333ed6dd-d020-4ef4-849c-956ed44cd18c] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:39.093612 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5dd3b93b-430f-4e63-86d6-391a5ff5ecab tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:39.094111 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5dd3b93b-430f-4e63-86d6-391a5ff5ecab tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:39.094554 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5dd3b93b-430f-4e63-86d6-391a5ff5ecab tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:39.095261 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5dd3b93b-430f-4e63-86d6-391a5ff5ecab tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:39.095723 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5dd3b93b-430f-4e63-86d6-391a5ff5ecab tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:39.096186 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5dd3b93b-430f-4e63-86d6-391a5ff5ecab tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:39.193865 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=4 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:24:39.218449 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=10 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:24:39.721178 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5dd3b93b-430f-4e63-86d6-391a5ff5ecab tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1fe2c1882341168e740e196b84ab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aa84ea2412a41d19901061f97068a00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:39.730357 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5dd3b93b-430f-4e63-86d6-391a5ff5ecab tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] 10.222.0.52 "GET /compute/v2.1/servers/333ed6dd-d020-4ef4-849c-956ed44cd18c" status: 200 len: 1317 microversion: 2.1 time: 0.651734 Oct 19 03:24:39.735150 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1412/2887] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:24:39 2022] GET /compute/v2.1/servers/333ed6dd-d020-4ef4-849c-956ed44cd18c => generated 1317 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:24:39.750148 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-46d70e16-44dd-4b7a-979a-060754584c12 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:39.758786 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-46d70e16-44dd-4b7a-979a-060754584c12 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] [instance: cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:39.778442 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-46d70e16-44dd-4b7a-979a-060754584c12 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:39.779330 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-46d70e16-44dd-4b7a-979a-060754584c12 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:39.780002 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-46d70e16-44dd-4b7a-979a-060754584c12 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:39.780949 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-46d70e16-44dd-4b7a-979a-060754584c12 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:39.781657 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-46d70e16-44dd-4b7a-979a-060754584c12 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:39.782311 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-46d70e16-44dd-4b7a-979a-060754584c12 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:40.250633 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-46d70e16-44dd-4b7a-979a-060754584c12 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:40.269588 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-46d70e16-44dd-4b7a-979a-060754584c12 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:40.271046 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-46d70e16-44dd-4b7a-979a-060754584c12 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:40.274818 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-46d70e16-44dd-4b7a-979a-060754584c12 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] 10.222.0.52 "GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95" status: 200 len: 1879 microversion: 2.42 time: 0.538153 Oct 19 03:24:40.275403 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1413/2888] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:24:39 2022] GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 => generated 1879 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:24:40.298236 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c53f1421-d6d8-40a7-a28f-4e2bafe72632 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:40.300035 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c53f1421-d6d8-40a7-a28f-4e2bafe72632 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] [instance: 6ef505a5-0624-4080-9089-821f6fdfb47c] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:40.332656 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c53f1421-d6d8-40a7-a28f-4e2bafe72632 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:40.333354 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c53f1421-d6d8-40a7-a28f-4e2bafe72632 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:40.333839 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c53f1421-d6d8-40a7-a28f-4e2bafe72632 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:40.334596 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c53f1421-d6d8-40a7-a28f-4e2bafe72632 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:40.335048 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c53f1421-d6d8-40a7-a28f-4e2bafe72632 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:40.335477 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c53f1421-d6d8-40a7-a28f-4e2bafe72632 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:40.579901 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=10 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:24:41.146598 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c53f1421-d6d8-40a7-a28f-4e2bafe72632 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a222bb0f9a4c728d2ed5ca011c032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146393855c047be83270e5334c68e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:41.177735 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c53f1421-d6d8-40a7-a28f-4e2bafe72632 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] 10.222.0.52 "GET /compute/v2.1/servers/6ef505a5-0624-4080-9089-821f6fdfb47c" status: 200 len: 1473 microversion: 2.1 time: 0.879159 Oct 19 03:24:41.177735 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1414/2889] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:24:40 2022] GET /compute/v2.1/servers/6ef505a5-0624-4080-9089-821f6fdfb47c => generated 1473 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:24:41.177735 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f3c201fd-0ef9-47fa-b8a3-24d518c1dc89 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:41.177735 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f3c201fd-0ef9-47fa-b8a3-24d518c1dc89 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] [instance: 2870c53d-df7c-45d3-b8bd-c88966ad6315] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:41.185589 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f3c201fd-0ef9-47fa-b8a3-24d518c1dc89 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:41.186299 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f3c201fd-0ef9-47fa-b8a3-24d518c1dc89 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:41.187180 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f3c201fd-0ef9-47fa-b8a3-24d518c1dc89 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:41.193242 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f3c201fd-0ef9-47fa-b8a3-24d518c1dc89 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:41.193977 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f3c201fd-0ef9-47fa-b8a3-24d518c1dc89 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:41.194523 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f3c201fd-0ef9-47fa-b8a3-24d518c1dc89 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:41.709017 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-f3c201fd-0ef9-47fa-b8a3-24d518c1dc89 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bf143866aa44afb11285d61ffd7ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bf79842c02480eb1e91d521226d317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:41.724444 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f3c201fd-0ef9-47fa-b8a3-24d518c1dc89 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] 10.222.0.52 "GET /compute/v2.1/servers/2870c53d-df7c-45d3-b8bd-c88966ad6315" status: 200 len: 1370 microversion: 2.1 time: 0.556998 Oct 19 03:24:41.725293 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1415/2890] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:24:41 2022] GET /compute/v2.1/servers/2870c53d-df7c-45d3-b8bd-c88966ad6315 => generated 1370 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:24:41.741854 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-51f59876-d3c9-42cd-b9db-c910a46694f2 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:41.753163 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-51f59876-d3c9-42cd-b9db-c910a46694f2 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: fc300547-2017-4a58-8afc-350a262b5450] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:41.771342 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:24:41.780034 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-51f59876-d3c9-42cd-b9db-c910a46694f2 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:41.782350 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-51f59876-d3c9-42cd-b9db-c910a46694f2 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:41.785830 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-51f59876-d3c9-42cd-b9db-c910a46694f2 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:41.789095 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-51f59876-d3c9-42cd-b9db-c910a46694f2 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:41.792705 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-51f59876-d3c9-42cd-b9db-c910a46694f2 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:41.793810 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-51f59876-d3c9-42cd-b9db-c910a46694f2 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:42.377970 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-51f59876-d3c9-42cd-b9db-c910a46694f2 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:42.399724 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-51f59876-d3c9-42cd-b9db-c910a46694f2 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/fc300547-2017-4a58-8afc-350a262b5450" status: 200 len: 1503 microversion: 2.1 time: 0.670910 Oct 19 03:24:42.414581 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1416/2891] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:24:41 2022] GET /compute/v2.1/servers/fc300547-2017-4a58-8afc-350a262b5450 => generated 1503 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:24:42.442581 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-70f2a040-67e7-436d-a2a6-9908ae866376 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:42.443553 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-70f2a040-67e7-436d-a2a6-9908ae866376 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] [instance: 333ed6dd-d020-4ef4-849c-956ed44cd18c] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:42.452573 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-70f2a040-67e7-436d-a2a6-9908ae866376 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:42.453459 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-70f2a040-67e7-436d-a2a6-9908ae866376 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:42.454152 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-70f2a040-67e7-436d-a2a6-9908ae866376 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:42.459343 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-70f2a040-67e7-436d-a2a6-9908ae866376 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:42.460070 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-70f2a040-67e7-436d-a2a6-9908ae866376 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:42.460732 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-70f2a040-67e7-436d-a2a6-9908ae866376 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:42.783382 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-70f2a040-67e7-436d-a2a6-9908ae866376 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1fe2c1882341168e740e196b84ab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aa84ea2412a41d19901061f97068a00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:42.796114 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-70f2a040-67e7-436d-a2a6-9908ae866376 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] 10.222.0.52 "GET /compute/v2.1/servers/333ed6dd-d020-4ef4-849c-956ed44cd18c" status: 200 len: 1317 microversion: 2.1 time: 0.367177 Oct 19 03:24:42.815029 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1417/2892] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:24:42 2022] GET /compute/v2.1/servers/333ed6dd-d020-4ef4-849c-956ed44cd18c => generated 1317 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:24:42.823368 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ca93c08d-f638-44e0-85da-b6cda59bc602 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:42.825988 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ca93c08d-f638-44e0-85da-b6cda59bc602 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] [instance: cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:42.833359 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ca93c08d-f638-44e0-85da-b6cda59bc602 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:42.836063 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ca93c08d-f638-44e0-85da-b6cda59bc602 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:42.837300 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ca93c08d-f638-44e0-85da-b6cda59bc602 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:42.839371 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ca93c08d-f638-44e0-85da-b6cda59bc602 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:42.840121 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ca93c08d-f638-44e0-85da-b6cda59bc602 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:42.840732 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ca93c08d-f638-44e0-85da-b6cda59bc602 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:42.871275 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:24:43.286978 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ca93c08d-f638-44e0-85da-b6cda59bc602 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:43.313610 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ca93c08d-f638-44e0-85da-b6cda59bc602 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:43.315713 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ca93c08d-f638-44e0-85da-b6cda59bc602 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:43.317185 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ca93c08d-f638-44e0-85da-b6cda59bc602 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] 10.222.0.52 "GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95" status: 200 len: 1879 microversion: 2.42 time: 0.500648 Oct 19 03:24:43.318301 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1418/2893] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:24:42 2022] GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 => generated 1879 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:24:43.327063 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-af69a94a-273c-417c-a53e-e58d75a5452b tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:43.328386 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-af69a94a-273c-417c-a53e-e58d75a5452b tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] [instance: 6ef505a5-0624-4080-9089-821f6fdfb47c] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:43.347047 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-af69a94a-273c-417c-a53e-e58d75a5452b tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:43.347806 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-af69a94a-273c-417c-a53e-e58d75a5452b tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:43.349914 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-af69a94a-273c-417c-a53e-e58d75a5452b tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:43.351309 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-af69a94a-273c-417c-a53e-e58d75a5452b tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:43.354607 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-af69a94a-273c-417c-a53e-e58d75a5452b tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:43.356704 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-af69a94a-273c-417c-a53e-e58d75a5452b tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:43.564473 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-af69a94a-273c-417c-a53e-e58d75a5452b tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a222bb0f9a4c728d2ed5ca011c032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146393855c047be83270e5334c68e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:43.585818 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-af69a94a-273c-417c-a53e-e58d75a5452b tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] 10.222.0.52 "GET /compute/v2.1/servers/6ef505a5-0624-4080-9089-821f6fdfb47c" status: 200 len: 1431 microversion: 2.1 time: 0.265895 Oct 19 03:24:43.609676 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1419/2894] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:24:43 2022] GET /compute/v2.1/servers/6ef505a5-0624-4080-9089-821f6fdfb47c => generated 1431 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:24:43.636921 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1a702c7f-cc4a-4059-b181-fa223874a891 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:43.638050 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1a702c7f-cc4a-4059-b181-fa223874a891 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] [instance: 2870c53d-df7c-45d3-b8bd-c88966ad6315] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:43.647101 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1a702c7f-cc4a-4059-b181-fa223874a891 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:43.647777 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1a702c7f-cc4a-4059-b181-fa223874a891 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:43.648411 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1a702c7f-cc4a-4059-b181-fa223874a891 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:43.649517 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1a702c7f-cc4a-4059-b181-fa223874a891 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:43.650430 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1a702c7f-cc4a-4059-b181-fa223874a891 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:43.651206 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1a702c7f-cc4a-4059-b181-fa223874a891 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:44.207966 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-1a702c7f-cc4a-4059-b181-fa223874a891 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bf143866aa44afb11285d61ffd7ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bf79842c02480eb1e91d521226d317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:44.237229 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1a702c7f-cc4a-4059-b181-fa223874a891 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] 10.222.0.52 "GET /compute/v2.1/servers/2870c53d-df7c-45d3-b8bd-c88966ad6315" status: 200 len: 1370 microversion: 2.1 time: 0.620058 Oct 19 03:24:44.250307 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1420/2895] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:24:43 2022] GET /compute/v2.1/servers/2870c53d-df7c-45d3-b8bd-c88966ad6315 => generated 1370 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:24:44.493746 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5841b21a-9f75-420f-80b6-4f5e38b6dea2 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-1029330798", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "networks": [{"uuid": "05216dbc-056d-4707-86fe-afea9c8b3e8d"}]}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:24:47.803744 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=32 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:24:48.447283 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=10 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:24:50.930407 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4b53b0cd-a6fd-4473-aabd-b1ce670b7300 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/images/d097da85-3979-4bc7-a81a-f2cd9d38e3ff" status: 200 len: 1444 microversion: 2.1 time: 12.470855 Oct 19 03:24:50.931049 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-5841b21a-9f75-420f-80b6-4f5e38b6dea2 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] validate_networks() for [('05216dbc-056d-4707-86fe-afea9c8b3e8d', None, None, None, None, None)] {{(pid=121134) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:24:50.942165 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1476/2896] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:24:38 2022] GET /compute/v2.1/images/d097da85-3979-4bc7-a81a-f2cd9d38e3ff => generated 1444 bytes in 12483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:24:50.953861 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-2b8d69fb-5579-4663-9cb0-e6d7a7186e81 req-6969c288-6f81-4857-ad4a-5f188c656887 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ef505a5-0624-4080-9089-821f6fdfb47c", "name": "network-vif-deleted", "tag": "3d68ba4c-839d-44ea-b4e3-7563b0f4650a"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:24:50.995784 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-2b8d69fb-5579-4663-9cb0-e6d7a7186e81 req-6969c288-6f81-4857-ad4a-5f188c656887 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:50.996280 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-2b8d69fb-5579-4663-9cb0-e6d7a7186e81 req-6969c288-6f81-4857-ad4a-5f188c656887 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:50.996730 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-2b8d69fb-5579-4663-9cb0-e6d7a7186e81 req-6969c288-6f81-4857-ad4a-5f188c656887 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:51.015275 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-2b8d69fb-5579-4663-9cb0-e6d7a7186e81 req-6969c288-6f81-4857-ad4a-5f188c656887 service nova] Creating event network-vif-deleted:3d68ba4c-839d-44ea-b4e3-7563b0f4650a for instance 6ef505a5-0624-4080-9089-821f6fdfb47c on n-h1-861333-8 Oct 19 03:24:51.030725 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-2b8d69fb-5579-4663-9cb0-e6d7a7186e81 req-6969c288-6f81-4857-ad4a-5f188c656887 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086932 Oct 19 03:24:51.031683 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1477/2897] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:24:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:24:51.042994 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-49f6a39f-053f-460c-b448-e1e4243b5aa9 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:51.054677 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-49f6a39f-053f-460c-b448-e1e4243b5aa9 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: fc300547-2017-4a58-8afc-350a262b5450] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:51.076016 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-49f6a39f-053f-460c-b448-e1e4243b5aa9 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:51.076537 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-49f6a39f-053f-460c-b448-e1e4243b5aa9 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:51.077081 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-49f6a39f-053f-460c-b448-e1e4243b5aa9 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:51.077844 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-49f6a39f-053f-460c-b448-e1e4243b5aa9 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:51.078306 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-49f6a39f-053f-460c-b448-e1e4243b5aa9 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:51.078732 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-49f6a39f-053f-460c-b448-e1e4243b5aa9 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:51.719670 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-49f6a39f-053f-460c-b448-e1e4243b5aa9 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:51.727675 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-49f6a39f-053f-460c-b448-e1e4243b5aa9 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/fc300547-2017-4a58-8afc-350a262b5450" status: 200 len: 1493 microversion: 2.1 time: 0.694639 Oct 19 03:24:51.728271 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1478/2898] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:24:51 2022] GET /compute/v2.1/servers/fc300547-2017-4a58-8afc-350a262b5450 => generated 1493 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:24:51.733300 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-473ce573-abad-41f6-bf2e-3baada91b705 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:51.733945 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-473ce573-abad-41f6-bf2e-3baada91b705 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] [instance: 333ed6dd-d020-4ef4-849c-956ed44cd18c] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:51.739963 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-473ce573-abad-41f6-bf2e-3baada91b705 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:51.740454 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-473ce573-abad-41f6-bf2e-3baada91b705 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:51.740896 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-473ce573-abad-41f6-bf2e-3baada91b705 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:51.741796 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-473ce573-abad-41f6-bf2e-3baada91b705 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:51.742259 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-473ce573-abad-41f6-bf2e-3baada91b705 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:51.745260 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-473ce573-abad-41f6-bf2e-3baada91b705 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:51.829548 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-5841b21a-9f75-420f-80b6-4f5e38b6dea2 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Flavor limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:24:51.829937 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-5841b21a-9f75-420f-80b6-4f5e38b6dea2 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Image limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:24:51.830657 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-5841b21a-9f75-420f-80b6-4f5e38b6dea2 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Flavor pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:24:51.831365 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-5841b21a-9f75-420f-80b6-4f5e38b6dea2 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Image pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:24:51.831784 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-5841b21a-9f75-420f-80b6-4f5e38b6dea2 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:24:51.842657 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5841b21a-9f75-420f-80b6-4f5e38b6dea2 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:51.843454 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5841b21a-9f75-420f-80b6-4f5e38b6dea2 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:51.843888 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5841b21a-9f75-420f-80b6-4f5e38b6dea2 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:51.844816 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5841b21a-9f75-420f-80b6-4f5e38b6dea2 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:51.845484 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5841b21a-9f75-420f-80b6-4f5e38b6dea2 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:51.846129 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5841b21a-9f75-420f-80b6-4f5e38b6dea2 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:51.872052 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-5841b21a-9f75-420f-80b6-4f5e38b6dea2 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Getting quotas for project 7a836a10033546ed9a73a4f463587d72. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:24:51.880064 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-5841b21a-9f75-420f-80b6-4f5e38b6dea2 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Getting quotas for user b09d2eecd3d9419189e6308379fa8a09 and project 7a836a10033546ed9a73a4f463587d72. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:24:51.895162 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5841b21a-9f75-420f-80b6-4f5e38b6dea2 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Going to run 1 instances... {{(pid=121134) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:24:51.897596 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5841b21a-9f75-420f-80b6-4f5e38b6dea2 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: eb2d22d5-8fc4-4a1a-a2ac-d54318936f21] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:24:52.073467 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5841b21a-9f75-420f-80b6-4f5e38b6dea2 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 7.821893 Oct 19 03:24:52.074766 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1421/2899] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:24:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 7824 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 03:24:52.080363 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-185178da-11b7-4a96-9654-fc56bbb2e9d6 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:52.086863 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-185178da-11b7-4a96-9654-fc56bbb2e9d6 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] [instance: cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:52.088580 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-185178da-11b7-4a96-9654-fc56bbb2e9d6 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:52.089075 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-185178da-11b7-4a96-9654-fc56bbb2e9d6 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:52.089756 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-185178da-11b7-4a96-9654-fc56bbb2e9d6 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:52.090695 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-185178da-11b7-4a96-9654-fc56bbb2e9d6 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:52.091165 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-185178da-11b7-4a96-9654-fc56bbb2e9d6 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:52.091646 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-185178da-11b7-4a96-9654-fc56bbb2e9d6 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:52.170850 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-473ce573-abad-41f6-bf2e-3baada91b705 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1fe2c1882341168e740e196b84ab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aa84ea2412a41d19901061f97068a00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:52.187185 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-473ce573-abad-41f6-bf2e-3baada91b705 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] 10.222.0.52 "GET /compute/v2.1/servers/333ed6dd-d020-4ef4-849c-956ed44cd18c" status: 200 len: 1506 microversion: 2.1 time: 0.457305 Oct 19 03:24:52.187844 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1479/2900] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:24:51 2022] GET /compute/v2.1/servers/333ed6dd-d020-4ef4-849c-956ed44cd18c => generated 1506 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:24:52.192703 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-80d06f0f-13f3-4ad4-be0e-fc2cfbc2bd48 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:52.193420 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-80d06f0f-13f3-4ad4-be0e-fc2cfbc2bd48 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] [instance: 6ef505a5-0624-4080-9089-821f6fdfb47c] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:52.200559 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-80d06f0f-13f3-4ad4-be0e-fc2cfbc2bd48 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:52.201055 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-80d06f0f-13f3-4ad4-be0e-fc2cfbc2bd48 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:52.201524 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-80d06f0f-13f3-4ad4-be0e-fc2cfbc2bd48 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:52.203312 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-80d06f0f-13f3-4ad4-be0e-fc2cfbc2bd48 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:52.204666 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-80d06f0f-13f3-4ad4-be0e-fc2cfbc2bd48 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:52.205689 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-80d06f0f-13f3-4ad4-be0e-fc2cfbc2bd48 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:52.223156 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-80d06f0f-13f3-4ad4-be0e-fc2cfbc2bd48 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] HTTP exception thrown: Instance 6ef505a5-0624-4080-9089-821f6fdfb47c could not be found. Oct 19 03:24:52.224819 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-80d06f0f-13f3-4ad4-be0e-fc2cfbc2bd48 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Request method failure captured: Oct 19 03:24:52.224819 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/6ef505a5-0624-4080-9089-821f6fdfb47c HTTP/1.1 Oct 19 03:24:52.224819 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:24:52.224819 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:24:52.224819 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:24:52.224819 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:24:52.224819 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:24:52.224819 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:24:52.224819 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:24:52.224819 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:24:52.224819 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT21Pw8YmHewscZDMnUs1--DTAsbzPgAvwpoNZxQ3G_0zAh6OxLXIw2cGXot0t8eYsUUTxrVn_R_0AfHDQw5I8tyFYWWrO5-hn_yP-iNDwlt63S3DiTGMYoZdyj_seVvViIP8T4neiIaeQu96qju_-zQfxDa_G3TPLu4HcRJpzYIfEjk Oct 19 03:24:52.224819 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:24:52.224819 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:24:52.224819 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:24:52.224819 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:24:52.224819 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:24:52.224819 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:24:52.224819 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: a146393855c047be83270e5334c68e45 Oct 19 03:24:52.224819 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ListImageFiltersTestJSON-1015938331 Oct 19 03:24:52.224819 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:24:52.224819 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:24:52.227873 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a146393855c047be83270e5334c68e45"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a146393855c047be83270e5334c68e45"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a146393855c047be83270e5334c68e45"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a146393855c047be83270e5334c68e45", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:24:52.227873 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ListImageFiltersTestJSON-1015938331 Oct 19 03:24:52.227873 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: a146393855c047be83270e5334c68e45 Oct 19 03:24:52.227873 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1015938331 Oct 19 03:24:52.227873 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ListImageFiltersTestJSON-1015938331-project Oct 19 03:24:52.227873 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:24:52.227873 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:24:52.227873 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 97a222bb0f9a4c728d2ed5ca011c032d Oct 19 03:24:52.227873 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ListImageFiltersTestJSON-1015938331-project Oct 19 03:24:52.227873 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:24:52.227873 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance 6ef505a5-0624-4080-9089-821f6fdfb47c could not be found. Oct 19 03:24:52.227873 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '6ef505a5-0624-4080-9089-821f6fdfb47c'} Oct 19 03:24:52.230637 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:24:52.230637 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:24:52.230637 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:24:52.230637 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:24:52.230637 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:24:52.230637 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:24:52.230637 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:24:52.230637 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:24:52.230637 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:24:52.230637 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:24:52.230637 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ef505a5-0624-4080-9089-821f6fdfb47c could not be found. Oct 19 03:24:52.230637 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:24:52.230637 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:24:52.230637 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:24:52.230637 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:24:52.230637 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:24:52.230637 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:24:52.230637 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:24:52.230637 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:24:52.230637 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:24:52.233649 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:24:52.233649 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:24:52.233649 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:24:52.233649 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:24:52.233649 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:24:52.233649 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:24:52.233649 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:24:52.233649 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ef505a5-0624-4080-9089-821f6fdfb47c could not be found. Oct 19 03:24:52.233649 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:24:52.233649 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:24:52.233649 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:24:52.233649 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:24:52.233649 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:24:52.233649 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:24:52.233649 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:24:52.233649 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:24:52.233649 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ef505a5-0624-4080-9089-821f6fdfb47c could not be found. Oct 19 03:24:52.233649 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:24:52.237580 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-80d06f0f-13f3-4ad4-be0e-fc2cfbc2bd48 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Returning 404 to user: Instance 6ef505a5-0624-4080-9089-821f6fdfb47c could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:24:52.237580 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-80d06f0f-13f3-4ad4-be0e-fc2cfbc2bd48 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] 10.222.0.52 "GET /compute/v2.1/servers/6ef505a5-0624-4080-9089-821f6fdfb47c" status: 404 len: 111 microversion: 2.1 time: 0.037138 Oct 19 03:24:52.237580 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1480/2901] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:24:52 2022] GET /compute/v2.1/servers/6ef505a5-0624-4080-9089-821f6fdfb47c => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:24:52.237580 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ee658444-fade-4213-94c6-9a3be5ece43d tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:52.237580 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ee658444-fade-4213-94c6-9a3be5ece43d tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] [instance: 2870c53d-df7c-45d3-b8bd-c88966ad6315] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:52.239820 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ee658444-fade-4213-94c6-9a3be5ece43d tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:52.239820 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ee658444-fade-4213-94c6-9a3be5ece43d tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:52.239820 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ee658444-fade-4213-94c6-9a3be5ece43d tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:52.240535 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ee658444-fade-4213-94c6-9a3be5ece43d tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:52.240780 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ee658444-fade-4213-94c6-9a3be5ece43d tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:52.241033 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ee658444-fade-4213-94c6-9a3be5ece43d tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:52.370001 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-185178da-11b7-4a96-9654-fc56bbb2e9d6 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:52.379580 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-185178da-11b7-4a96-9654-fc56bbb2e9d6 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:52.381038 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-185178da-11b7-4a96-9654-fc56bbb2e9d6 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:52.382239 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-185178da-11b7-4a96-9654-fc56bbb2e9d6 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] 10.222.0.52 "GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95" status: 200 len: 1879 microversion: 2.42 time: 0.306281 Oct 19 03:24:52.382816 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1422/2902] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:24:52 2022] GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 => generated 1879 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:24:52.387791 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-92685a9f-3865-495a-9a45-cd060725147b tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '.version_select at 0x7fc130c18c10>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:52.413227 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ee658444-fade-4213-94c6-9a3be5ece43d tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bf143866aa44afb11285d61ffd7ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bf79842c02480eb1e91d521226d317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:52.421880 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ee658444-fade-4213-94c6-9a3be5ece43d tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] 10.222.0.52 "GET /compute/v2.1/servers/2870c53d-df7c-45d3-b8bd-c88966ad6315" status: 200 len: 1370 microversion: 2.1 time: 0.194077 Oct 19 03:24:52.422439 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1481/2903] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:24:52 2022] GET /compute/v2.1/servers/2870c53d-df7c-45d3-b8bd-c88966ad6315 => generated 1370 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:24:52.429910 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f2accf21-55fb-4c93-a809-648af1675480 tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Calling method '.version_select at 0x7fc13008f670>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:52.433542 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f2accf21-55fb-4c93-a809-648af1675480 tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:52.434038 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f2accf21-55fb-4c93-a809-648af1675480 tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:52.434998 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f2accf21-55fb-4c93-a809-648af1675480 tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:52.441975 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f2accf21-55fb-4c93-a809-648af1675480 tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] 10.222.0.52 "GET /compute/v2.1/os-migrations" status: 200 len: 400 microversion: 2.1 time: 0.017651 Oct 19 03:24:52.450467 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1482/2904] 10.222.0.52 () {58 vars in 1143 bytes} [Wed Oct 19 03:24:52 2022] GET /compute/v2.1/os-migrations => generated 400 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:24:52.450467 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6c6cb1cc-cd70-48ea-8f6f-ceb30486500f tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:52.450467 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6c6cb1cc-cd70-48ea-8f6f-ceb30486500f tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: eb2d22d5-8fc4-4a1a-a2ac-d54318936f21] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:52.454275 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-92685a9f-3865-495a-9a45-cd060725147b tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/images/d097da85-3979-4bc7-a81a-f2cd9d38e3ff" status: 200 len: 1444 microversion: 2.1 time: 0.065470 Oct 19 03:24:52.454275 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1423/2905] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:24:52 2022] GET /compute/v2.1/images/d097da85-3979-4bc7-a81a-f2cd9d38e3ff => generated 1444 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:24:52.454962 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6f5393ae-d1ab-4735-bdc7-2c6ae3546f2e tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:52.455532 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6f5393ae-d1ab-4735-bdc7-2c6ae3546f2e tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] [instance: 333ed6dd-d020-4ef4-849c-956ed44cd18c] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:52.461629 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6f5393ae-d1ab-4735-bdc7-2c6ae3546f2e tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:52.462380 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6f5393ae-d1ab-4735-bdc7-2c6ae3546f2e tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:52.462828 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6f5393ae-d1ab-4735-bdc7-2c6ae3546f2e tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:52.464056 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6f5393ae-d1ab-4735-bdc7-2c6ae3546f2e tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:52.464521 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6f5393ae-d1ab-4735-bdc7-2c6ae3546f2e tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:52.464960 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6f5393ae-d1ab-4735-bdc7-2c6ae3546f2e tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:52.500097 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-6f5393ae-d1ab-4735-bdc7-2c6ae3546f2e tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '9e1fe2c1882341168e740e196b84ab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aa84ea2412a41d19901061f97068a00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:52.501114 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6f5393ae-d1ab-4735-bdc7-2c6ae3546f2e tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] 10.222.0.52 "GET /compute/v2.1/servers/333ed6dd-d020-4ef4-849c-956ed44cd18c/os-instance-actions/req-e09b9ce1-4876-40c6-b56f-4b339b4a0d70" status: 200 len: 313 microversion: 2.1 time: 0.049892 Oct 19 03:24:52.501870 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1424/2906] 10.222.0.52 () {58 vars in 1419 bytes} [Wed Oct 19 03:24:52 2022] GET /compute/v2.1/servers/333ed6dd-d020-4ef4-849c-956ed44cd18c/os-instance-actions/req-e09b9ce1-4876-40c6-b56f-4b339b4a0d70 => generated 313 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:24:52.504572 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-6c6cb1cc-cd70-48ea-8f6f-ceb30486500f tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:52.506496 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9435d8cd-1d7f-4855-b7e6-241218de6cb4 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:52.507008 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9435d8cd-1d7f-4855-b7e6-241218de6cb4 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] [instance: 410116db-4d00-4a9d-8375-a5cea6a0d627] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:52.512706 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6c6cb1cc-cd70-48ea-8f6f-ceb30486500f tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/eb2d22d5-8fc4-4a1a-a2ac-d54318936f21" status: 200 len: 1193 microversion: 2.1 time: 0.068707 Oct 19 03:24:52.513456 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1483/2907] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:24:52 2022] GET /compute/v2.1/servers/eb2d22d5-8fc4-4a1a-a2ac-d54318936f21 => generated 1193 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:24:52.515006 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9435d8cd-1d7f-4855-b7e6-241218de6cb4 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:52.515502 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9435d8cd-1d7f-4855-b7e6-241218de6cb4 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:52.516199 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9435d8cd-1d7f-4855-b7e6-241218de6cb4 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:52.516911 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9435d8cd-1d7f-4855-b7e6-241218de6cb4 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:52.517443 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9435d8cd-1d7f-4855-b7e6-241218de6cb4 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:52.517893 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9435d8cd-1d7f-4855-b7e6-241218de6cb4 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:52.518002 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d24f09ab-05dc-4381-b38f-4e9bb254089d tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:52.518638 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d24f09ab-05dc-4381-b38f-4e9bb254089d tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] [instance: fc300547-2017-4a58-8afc-350a262b5450] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:52.525277 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d24f09ab-05dc-4381-b38f-4e9bb254089d tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:52.526630 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d24f09ab-05dc-4381-b38f-4e9bb254089d tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:52.531032 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d24f09ab-05dc-4381-b38f-4e9bb254089d tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:52.531032 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d24f09ab-05dc-4381-b38f-4e9bb254089d tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:52.531032 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d24f09ab-05dc-4381-b38f-4e9bb254089d tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:52.531032 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d24f09ab-05dc-4381-b38f-4e9bb254089d tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:52.550224 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9435d8cd-1d7f-4855-b7e6-241218de6cb4 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] [instance: 410116db-4d00-4a9d-8375-a5cea6a0d627] Going to try to terminate instance {{(pid=121134) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:24:52.659694 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d24f09ab-05dc-4381-b38f-4e9bb254089d tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/fc300547-2017-4a58-8afc-350a262b5450" status: 200 len: 1644 microversion: 2.1 time: 0.145326 Oct 19 03:24:52.660262 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1484/2908] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:24:52 2022] GET /compute/v2.1/servers/fc300547-2017-4a58-8afc-350a262b5450 => generated 1644 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:24:52.664596 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-93a4aad4-7941-4505-a2a9-f88e94385a28 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '.version_select at 0x7fc12bfee1f0>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:52.914730 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9435d8cd-1d7f-4855-b7e6-241218de6cb4 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] 10.222.0.52 "DELETE /compute/v2.1/servers/410116db-4d00-4a9d-8375-a5cea6a0d627" status: 204 len: 0 microversion: 2.1 time: 0.411589 Oct 19 03:24:52.915612 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1425/2909] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:24:52 2022] DELETE /compute/v2.1/servers/410116db-4d00-4a9d-8375-a5cea6a0d627 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:24:52.924139 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3d6b0afd-177f-4b33-9c7a-3c19373d86ee tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:24:52.924139 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3d6b0afd-177f-4b33-9c7a-3c19373d86ee tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] [instance: 333ed6dd-d020-4ef4-849c-956ed44cd18c] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:52.929786 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3d6b0afd-177f-4b33-9c7a-3c19373d86ee tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:52.930036 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3d6b0afd-177f-4b33-9c7a-3c19373d86ee tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:52.930525 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3d6b0afd-177f-4b33-9c7a-3c19373d86ee tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:52.931164 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3d6b0afd-177f-4b33-9c7a-3c19373d86ee tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:52.931852 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3d6b0afd-177f-4b33-9c7a-3c19373d86ee tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:52.932144 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3d6b0afd-177f-4b33-9c7a-3c19373d86ee tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:53.158964 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3d6b0afd-177f-4b33-9c7a-3c19373d86ee tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] 10.222.0.52 "POST /compute/v2.1/servers/333ed6dd-d020-4ef4-849c-956ed44cd18c/action" status: 202 len: 0 microversion: 2.1 time: 0.238630 Oct 19 03:24:53.158964 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1426/2910] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:24:52 2022] POST /compute/v2.1/servers/333ed6dd-d020-4ef4-849c-956ed44cd18c/action => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:24:53.161791 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3754477c-536c-4854-a68b-b85daa7f6505 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1206543647", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "networks": [{"uuid": "8936f55f-9ffa-46d8-8ece-d8a531cfe6c3"}]}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:24:53.217424 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-3754477c-536c-4854-a68b-b85daa7f6505 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] validate_networks() for [('8936f55f-9ffa-46d8-8ece-d8a531cfe6c3', None, None, None, None, None)] {{(pid=121134) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:24:53.607306 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-3754477c-536c-4854-a68b-b85daa7f6505 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Flavor limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:24:53.607799 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-3754477c-536c-4854-a68b-b85daa7f6505 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Image limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:24:53.608338 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-3754477c-536c-4854-a68b-b85daa7f6505 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Flavor pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:24:53.608919 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-3754477c-536c-4854-a68b-b85daa7f6505 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Image pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:24:53.609430 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-3754477c-536c-4854-a68b-b85daa7f6505 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:24:53.619827 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3754477c-536c-4854-a68b-b85daa7f6505 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:53.620407 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3754477c-536c-4854-a68b-b85daa7f6505 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:53.620884 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3754477c-536c-4854-a68b-b85daa7f6505 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:53.621928 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3754477c-536c-4854-a68b-b85daa7f6505 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:53.622390 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3754477c-536c-4854-a68b-b85daa7f6505 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:53.622928 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3754477c-536c-4854-a68b-b85daa7f6505 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:53.643771 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-3754477c-536c-4854-a68b-b85daa7f6505 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Getting quotas for project 8019441bff8642cebf21fd1c4e890196. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:24:53.649259 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-3754477c-536c-4854-a68b-b85daa7f6505 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Getting quotas for user 2b5b2cb1272541dfbc2659cf4adf9026 and project 8019441bff8642cebf21fd1c4e890196. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:24:53.661724 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3754477c-536c-4854-a68b-b85daa7f6505 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Going to run 1 instances... {{(pid=121134) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:24:53.664123 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3754477c-536c-4854-a68b-b85daa7f6505 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:24:54.567870 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3754477c-536c-4854-a68b-b85daa7f6505 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.410101 Oct 19 03:24:54.572855 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1427/2911] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:24:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1412 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 03:24:54.577950 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9e7223ca-0008-473b-86e6-cd8de19fb736 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:54.579178 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9e7223ca-0008-473b-86e6-cd8de19fb736 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] [instance: 410116db-4d00-4a9d-8375-a5cea6a0d627] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:54.587059 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9e7223ca-0008-473b-86e6-cd8de19fb736 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:54.587549 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9e7223ca-0008-473b-86e6-cd8de19fb736 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:54.587994 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9e7223ca-0008-473b-86e6-cd8de19fb736 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:54.590610 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9e7223ca-0008-473b-86e6-cd8de19fb736 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:54.591163 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9e7223ca-0008-473b-86e6-cd8de19fb736 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:54.591901 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9e7223ca-0008-473b-86e6-cd8de19fb736 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:54.666245 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-93a4aad4-7941-4505-a2a9-f88e94385a28 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "DELETE /compute/v2.1/images/d097da85-3979-4bc7-a81a-f2cd9d38e3ff" status: 204 len: 0 microversion: 2.1 time: 2.001179 Oct 19 03:24:54.666245 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1485/2912] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:24:52 2022] DELETE /compute/v2.1/images/d097da85-3979-4bc7-a81a-f2cd9d38e3ff => generated 0 bytes in 2002 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:24:54.668877 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-46b984d8-68a8-4424-a3ae-511349eac9bb req-16577f80-7d84-4138-a5ac-cc1f70d812a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2870c53d-df7c-45d3-b8bd-c88966ad6315", "tag": "4438c03f-7c43-41c1-aadf-24b917ab0a59"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:24:54.679562 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-46b984d8-68a8-4424-a3ae-511349eac9bb req-16577f80-7d84-4138-a5ac-cc1f70d812a9 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:54.680060 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-46b984d8-68a8-4424-a3ae-511349eac9bb req-16577f80-7d84-4138-a5ac-cc1f70d812a9 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:54.680495 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-46b984d8-68a8-4424-a3ae-511349eac9bb req-16577f80-7d84-4138-a5ac-cc1f70d812a9 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:54.691836 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-46b984d8-68a8-4424-a3ae-511349eac9bb req-16577f80-7d84-4138-a5ac-cc1f70d812a9 service nova] Creating event network-changed:4438c03f-7c43-41c1-aadf-24b917ab0a59 for instance 2870c53d-df7c-45d3-b8bd-c88966ad6315 on n-h1-861333-8 Oct 19 03:24:54.696766 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-46b984d8-68a8-4424-a3ae-511349eac9bb req-16577f80-7d84-4138-a5ac-cc1f70d812a9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032519 Oct 19 03:24:54.697749 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1486/2913] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:24:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:24:54.705530 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2da88b5a-a39d-45b3-b73d-4b0f64738548 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:54.706429 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-2da88b5a-a39d-45b3-b73d-4b0f64738548 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] [instance: 333ed6dd-d020-4ef4-849c-956ed44cd18c] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:54.713180 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2da88b5a-a39d-45b3-b73d-4b0f64738548 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:54.714007 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2da88b5a-a39d-45b3-b73d-4b0f64738548 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:54.714821 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2da88b5a-a39d-45b3-b73d-4b0f64738548 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:54.715701 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2da88b5a-a39d-45b3-b73d-4b0f64738548 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:54.716963 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2da88b5a-a39d-45b3-b73d-4b0f64738548 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:54.717447 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2da88b5a-a39d-45b3-b73d-4b0f64738548 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:54.748004 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9e7223ca-0008-473b-86e6-cd8de19fb736 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a222bb0f9a4c728d2ed5ca011c032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146393855c047be83270e5334c68e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:54.758404 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9e7223ca-0008-473b-86e6-cd8de19fb736 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] 10.222.0.52 "GET /compute/v2.1/servers/410116db-4d00-4a9d-8375-a5cea6a0d627" status: 200 len: 1473 microversion: 2.1 time: 0.188387 Oct 19 03:24:54.765417 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1428/2914] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:24:54 2022] GET /compute/v2.1/servers/410116db-4d00-4a9d-8375-a5cea6a0d627 => generated 1473 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:24:54.765417 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a94f901b-148c-47f2-80fa-99ba4a9b91b5 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:54.766421 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a94f901b-148c-47f2-80fa-99ba4a9b91b5 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] [instance: cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:54.792413 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a94f901b-148c-47f2-80fa-99ba4a9b91b5 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:54.792413 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a94f901b-148c-47f2-80fa-99ba4a9b91b5 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:54.792413 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a94f901b-148c-47f2-80fa-99ba4a9b91b5 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:54.792413 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a94f901b-148c-47f2-80fa-99ba4a9b91b5 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:54.792909 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a94f901b-148c-47f2-80fa-99ba4a9b91b5 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:54.792909 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a94f901b-148c-47f2-80fa-99ba4a9b91b5 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:55.054263 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-2da88b5a-a39d-45b3-b73d-4b0f64738548 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1fe2c1882341168e740e196b84ab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aa84ea2412a41d19901061f97068a00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:55.067004 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2da88b5a-a39d-45b3-b73d-4b0f64738548 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] 10.222.0.52 "GET /compute/v2.1/servers/333ed6dd-d020-4ef4-849c-956ed44cd18c" status: 200 len: 1508 microversion: 2.1 time: 0.367007 Oct 19 03:24:55.068021 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1487/2915] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:24:54 2022] GET /compute/v2.1/servers/333ed6dd-d020-4ef4-849c-956ed44cd18c => generated 1508 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:24:55.074669 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e68a5088-2192-4eb7-8624-750dd3d41fa0 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:55.082175 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e68a5088-2192-4eb7-8624-750dd3d41fa0 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] [instance: 2870c53d-df7c-45d3-b8bd-c88966ad6315] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:55.084047 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e68a5088-2192-4eb7-8624-750dd3d41fa0 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:55.084714 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e68a5088-2192-4eb7-8624-750dd3d41fa0 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:55.085201 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e68a5088-2192-4eb7-8624-750dd3d41fa0 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:55.086111 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e68a5088-2192-4eb7-8624-750dd3d41fa0 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:55.086564 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e68a5088-2192-4eb7-8624-750dd3d41fa0 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:55.087066 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e68a5088-2192-4eb7-8624-750dd3d41fa0 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:55.155334 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a94f901b-148c-47f2-80fa-99ba4a9b91b5 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:55.167513 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a94f901b-148c-47f2-80fa-99ba4a9b91b5 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:55.169618 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a94f901b-148c-47f2-80fa-99ba4a9b91b5 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:55.171872 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a94f901b-148c-47f2-80fa-99ba4a9b91b5 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] 10.222.0.52 "GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95" status: 200 len: 1879 microversion: 2.42 time: 0.410397 Oct 19 03:24:55.172524 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1429/2916] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:24:54 2022] GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 => generated 1879 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:24:55.177342 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b4bbb2e4-8068-4b1f-96f5-361a8314278a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:55.178551 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b4bbb2e4-8068-4b1f-96f5-361a8314278a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: eb2d22d5-8fc4-4a1a-a2ac-d54318936f21] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:55.201167 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b4bbb2e4-8068-4b1f-96f5-361a8314278a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:55.202575 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b4bbb2e4-8068-4b1f-96f5-361a8314278a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:55.203032 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b4bbb2e4-8068-4b1f-96f5-361a8314278a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:55.203772 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b4bbb2e4-8068-4b1f-96f5-361a8314278a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:55.204317 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b4bbb2e4-8068-4b1f-96f5-361a8314278a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:55.204758 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b4bbb2e4-8068-4b1f-96f5-361a8314278a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:55.351389 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b4bbb2e4-8068-4b1f-96f5-361a8314278a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:55.361176 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b4bbb2e4-8068-4b1f-96f5-361a8314278a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/eb2d22d5-8fc4-4a1a-a2ac-d54318936f21" status: 200 len: 1189 microversion: 2.1 time: 0.186984 Oct 19 03:24:55.376830 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1430/2917] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:24:55 2022] GET /compute/v2.1/servers/eb2d22d5-8fc4-4a1a-a2ac-d54318936f21 => generated 1189 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:24:55.376830 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-86cce33a-3b5f-4c16-9972-f7df30f93126 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:55.376830 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-86cce33a-3b5f-4c16-9972-f7df30f93126 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:55.405281 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-e68a5088-2192-4eb7-8624-750dd3d41fa0 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bf143866aa44afb11285d61ffd7ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bf79842c02480eb1e91d521226d317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:55.413793 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e68a5088-2192-4eb7-8624-750dd3d41fa0 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] 10.222.0.52 "GET /compute/v2.1/servers/2870c53d-df7c-45d3-b8bd-c88966ad6315" status: 200 len: 1370 microversion: 2.1 time: 0.343668 Oct 19 03:24:55.414514 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1488/2918] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:24:55 2022] GET /compute/v2.1/servers/2870c53d-df7c-45d3-b8bd-c88966ad6315 => generated 1370 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:24:55.424407 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-097fbc50-4dea-44fb-ab1d-2f7fb7845c0e tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:55.424407 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-097fbc50-4dea-44fb-ab1d-2f7fb7845c0e tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: 4d77faf6-475d-4711-820a-623c1b705f8c] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:55.433264 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-097fbc50-4dea-44fb-ab1d-2f7fb7845c0e tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:55.433863 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-097fbc50-4dea-44fb-ab1d-2f7fb7845c0e tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:55.434387 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-097fbc50-4dea-44fb-ab1d-2f7fb7845c0e tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:55.435164 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-097fbc50-4dea-44fb-ab1d-2f7fb7845c0e tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:55.435692 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-097fbc50-4dea-44fb-ab1d-2f7fb7845c0e tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:55.436213 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-097fbc50-4dea-44fb-ab1d-2f7fb7845c0e tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:55.454135 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-86cce33a-3b5f-4c16-9972-f7df30f93126 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:55.461690 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-86cce33a-3b5f-4c16-9972-f7df30f93126 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6" status: 200 len: 1211 microversion: 2.1 time: 0.098908 Oct 19 03:24:55.464976 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1431/2919] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:24:55 2022] GET /compute/v2.1/servers/25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6 => generated 1211 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:24:55.465981 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-097fbc50-4dea-44fb-ab1d-2f7fb7845c0e tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: 4d77faf6-475d-4711-820a-623c1b705f8c] Going to try to terminate instance {{(pid=121135) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:24:55.765338 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-d079e61e-e985-48cd-ac37-77bb5f2e1380 req-6cbc12ac-cd63-43cf-bfcb-7860c422b09f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "410116db-4d00-4a9d-8375-a5cea6a0d627", "name": "network-vif-deleted", "tag": "c7f441d5-a985-4c81-97b8-114d47006d03"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:24:55.768851 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-097fbc50-4dea-44fb-ab1d-2f7fb7845c0e tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "DELETE /compute/v2.1/servers/4d77faf6-475d-4711-820a-623c1b705f8c" status: 204 len: 0 microversion: 2.1 time: 0.352787 Oct 19 03:24:55.769465 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1489/2920] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:24:55 2022] DELETE /compute/v2.1/servers/4d77faf6-475d-4711-820a-623c1b705f8c => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:24:55.775438 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-d079e61e-e985-48cd-ac37-77bb5f2e1380 req-6cbc12ac-cd63-43cf-bfcb-7860c422b09f service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:55.783308 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-d079e61e-e985-48cd-ac37-77bb5f2e1380 req-6cbc12ac-cd63-43cf-bfcb-7860c422b09f service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:55.783308 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-d079e61e-e985-48cd-ac37-77bb5f2e1380 req-6cbc12ac-cd63-43cf-bfcb-7860c422b09f service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:55.790642 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0fd901ed-817c-4627-8152-46446feb945c tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:55.791442 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0fd901ed-817c-4627-8152-46446feb945c tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] [instance: 410116db-4d00-4a9d-8375-a5cea6a0d627] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:55.791575 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-d079e61e-e985-48cd-ac37-77bb5f2e1380 req-6cbc12ac-cd63-43cf-bfcb-7860c422b09f service nova] Creating event network-vif-deleted:c7f441d5-a985-4c81-97b8-114d47006d03 for instance 410116db-4d00-4a9d-8375-a5cea6a0d627 on n-h2-861333-8 Oct 19 03:24:55.796752 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-d079e61e-e985-48cd-ac37-77bb5f2e1380 req-6cbc12ac-cd63-43cf-bfcb-7860c422b09f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035660 Oct 19 03:24:55.797684 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1432/2921] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:24:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:24:55.799113 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0fd901ed-817c-4627-8152-46446feb945c tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:55.799834 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0fd901ed-817c-4627-8152-46446feb945c tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:55.800408 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0fd901ed-817c-4627-8152-46446feb945c tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:55.801467 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0fd901ed-817c-4627-8152-46446feb945c tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:55.801935 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0fd901ed-817c-4627-8152-46446feb945c tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:55.802371 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0fd901ed-817c-4627-8152-46446feb945c tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:55.870102 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-0fd901ed-817c-4627-8152-46446feb945c tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a222bb0f9a4c728d2ed5ca011c032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146393855c047be83270e5334c68e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:55.872187 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d8bb2e58-7b8f-4e62-b24b-1d0571e59b82 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1687159126", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "networks": [{"uuid": "99edd0a7-1ab1-49c6-b3e8-36828942abe3"}]}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:24:55.878568 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0fd901ed-817c-4627-8152-46446feb945c tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] 10.222.0.52 "GET /compute/v2.1/servers/410116db-4d00-4a9d-8375-a5cea6a0d627" status: 200 len: 1431 microversion: 2.1 time: 0.093136 Oct 19 03:24:55.879142 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1490/2922] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:24:55 2022] GET /compute/v2.1/servers/410116db-4d00-4a9d-8375-a5cea6a0d627 => generated 1431 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:24:55.926492 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-d8bb2e58-7b8f-4e62-b24b-1d0571e59b82 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] validate_networks() for [('99edd0a7-1ab1-49c6-b3e8-36828942abe3', None, None, None, None, None)] {{(pid=121134) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:24:56.092313 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-156c2088-ff72-4ca3-bfd3-c8ed5b12caf8 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:56.092907 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-156c2088-ff72-4ca3-bfd3-c8ed5b12caf8 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] [instance: 333ed6dd-d020-4ef4-849c-956ed44cd18c] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:56.099948 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-156c2088-ff72-4ca3-bfd3-c8ed5b12caf8 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:56.104127 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-156c2088-ff72-4ca3-bfd3-c8ed5b12caf8 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:56.104127 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-156c2088-ff72-4ca3-bfd3-c8ed5b12caf8 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:56.104127 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-156c2088-ff72-4ca3-bfd3-c8ed5b12caf8 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:56.104127 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-156c2088-ff72-4ca3-bfd3-c8ed5b12caf8 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:56.105227 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-156c2088-ff72-4ca3-bfd3-c8ed5b12caf8 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:56.325035 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-156c2088-ff72-4ca3-bfd3-c8ed5b12caf8 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1fe2c1882341168e740e196b84ab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aa84ea2412a41d19901061f97068a00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:56.332967 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-156c2088-ff72-4ca3-bfd3-c8ed5b12caf8 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] 10.222.0.52 "GET /compute/v2.1/servers/333ed6dd-d020-4ef4-849c-956ed44cd18c" status: 200 len: 1508 microversion: 2.1 time: 0.245556 Oct 19 03:24:56.333577 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1491/2923] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:24:56 2022] GET /compute/v2.1/servers/333ed6dd-d020-4ef4-849c-956ed44cd18c => generated 1508 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:24:56.338007 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-10df5959-1459-4340-b683-b7ca204bcd35 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:56.338626 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-10df5959-1459-4340-b683-b7ca204bcd35 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] [instance: cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:56.344741 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-10df5959-1459-4340-b683-b7ca204bcd35 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:56.345231 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-10df5959-1459-4340-b683-b7ca204bcd35 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:56.345709 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-10df5959-1459-4340-b683-b7ca204bcd35 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:56.346407 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-10df5959-1459-4340-b683-b7ca204bcd35 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:56.346863 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-10df5959-1459-4340-b683-b7ca204bcd35 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:56.347294 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-10df5959-1459-4340-b683-b7ca204bcd35 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:56.409640 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-d8bb2e58-7b8f-4e62-b24b-1d0571e59b82 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Flavor limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:24:56.410139 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-d8bb2e58-7b8f-4e62-b24b-1d0571e59b82 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Image limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:24:56.410736 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-d8bb2e58-7b8f-4e62-b24b-1d0571e59b82 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Flavor pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:24:56.411220 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-d8bb2e58-7b8f-4e62-b24b-1d0571e59b82 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Image pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:24:56.411735 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-d8bb2e58-7b8f-4e62-b24b-1d0571e59b82 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:24:56.421217 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d8bb2e58-7b8f-4e62-b24b-1d0571e59b82 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:56.421736 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d8bb2e58-7b8f-4e62-b24b-1d0571e59b82 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:56.422178 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d8bb2e58-7b8f-4e62-b24b-1d0571e59b82 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:56.422903 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d8bb2e58-7b8f-4e62-b24b-1d0571e59b82 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:56.423446 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d8bb2e58-7b8f-4e62-b24b-1d0571e59b82 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:56.423882 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d8bb2e58-7b8f-4e62-b24b-1d0571e59b82 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:56.442534 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-d8bb2e58-7b8f-4e62-b24b-1d0571e59b82 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Getting quotas for project 686dbeeaed0b44538a9bbc54d457a720. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:24:56.449027 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-d8bb2e58-7b8f-4e62-b24b-1d0571e59b82 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Getting quotas for user 57008d884859417ebc1456b55ec3f6e0 and project 686dbeeaed0b44538a9bbc54d457a720. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:24:56.461590 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d8bb2e58-7b8f-4e62-b24b-1d0571e59b82 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Going to run 1 instances... {{(pid=121134) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:24:56.464516 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d8bb2e58-7b8f-4e62-b24b-1d0571e59b82 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: e5093d9e-cd31-4074-b339-828de5892bd1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:24:56.544059 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-10df5959-1459-4340-b683-b7ca204bcd35 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:56.553727 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-10df5959-1459-4340-b683-b7ca204bcd35 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:56.556377 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-10df5959-1459-4340-b683-b7ca204bcd35 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:56.556508 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d8bb2e58-7b8f-4e62-b24b-1d0571e59b82 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.688067 Oct 19 03:24:56.556596 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-10df5959-1459-4340-b683-b7ca204bcd35 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] 10.222.0.52 "GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95" status: 200 len: 1879 microversion: 2.42 time: 0.221963 Oct 19 03:24:56.565321 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1433/2924] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:24:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 690 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 19 03:24:56.565547 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1492/2925] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:24:56 2022] GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 => generated 1879 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:24:56.565643 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-23b35a0d-a35b-487b-9be3-5bb3f43bcadb tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:56.569114 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-17ab4c7a-6532-4cb1-a1bb-a2d080e4fbc3 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:56.570013 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-23b35a0d-a35b-487b-9be3-5bb3f43bcadb tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: eb2d22d5-8fc4-4a1a-a2ac-d54318936f21] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:56.570854 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-17ab4c7a-6532-4cb1-a1bb-a2d080e4fbc3 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] [instance: 2870c53d-df7c-45d3-b8bd-c88966ad6315] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:56.579203 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-17ab4c7a-6532-4cb1-a1bb-a2d080e4fbc3 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:56.580052 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-17ab4c7a-6532-4cb1-a1bb-a2d080e4fbc3 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:56.580160 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-17ab4c7a-6532-4cb1-a1bb-a2d080e4fbc3 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:56.580877 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-17ab4c7a-6532-4cb1-a1bb-a2d080e4fbc3 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:56.581378 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-17ab4c7a-6532-4cb1-a1bb-a2d080e4fbc3 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:56.581906 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-17ab4c7a-6532-4cb1-a1bb-a2d080e4fbc3 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:56.582171 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-23b35a0d-a35b-487b-9be3-5bb3f43bcadb tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:56.582747 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-23b35a0d-a35b-487b-9be3-5bb3f43bcadb tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:56.583194 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-23b35a0d-a35b-487b-9be3-5bb3f43bcadb tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:56.584267 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-23b35a0d-a35b-487b-9be3-5bb3f43bcadb tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:56.584689 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-23b35a0d-a35b-487b-9be3-5bb3f43bcadb tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:56.585121 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-23b35a0d-a35b-487b-9be3-5bb3f43bcadb tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:56.678160 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-23b35a0d-a35b-487b-9be3-5bb3f43bcadb tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:56.687332 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-23b35a0d-a35b-487b-9be3-5bb3f43bcadb tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/eb2d22d5-8fc4-4a1a-a2ac-d54318936f21" status: 200 len: 1245 microversion: 2.1 time: 0.129299 Oct 19 03:24:56.687918 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1434/2926] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:24:56 2022] GET /compute/v2.1/servers/eb2d22d5-8fc4-4a1a-a2ac-d54318936f21 => generated 1245 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:24:56.692445 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c6a6f969-f5b4-40e5-a0da-115c14e3855a tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:56.693056 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c6a6f969-f5b4-40e5-a0da-115c14e3855a tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:56.699984 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c6a6f969-f5b4-40e5-a0da-115c14e3855a tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:56.700539 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c6a6f969-f5b4-40e5-a0da-115c14e3855a tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:56.700988 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c6a6f969-f5b4-40e5-a0da-115c14e3855a tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:56.701734 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c6a6f969-f5b4-40e5-a0da-115c14e3855a tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:56.702198 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c6a6f969-f5b4-40e5-a0da-115c14e3855a tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:56.702748 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c6a6f969-f5b4-40e5-a0da-115c14e3855a tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:56.773749 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c6a6f969-f5b4-40e5-a0da-115c14e3855a tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:56.777237 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-17ab4c7a-6532-4cb1-a1bb-a2d080e4fbc3 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bf143866aa44afb11285d61ffd7ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bf79842c02480eb1e91d521226d317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:56.782818 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c6a6f969-f5b4-40e5-a0da-115c14e3855a tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6" status: 200 len: 1215 microversion: 2.1 time: 0.093872 Oct 19 03:24:56.783950 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1435/2927] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:24:56 2022] GET /compute/v2.1/servers/25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6 => generated 1215 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:24:56.785101 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-17ab4c7a-6532-4cb1-a1bb-a2d080e4fbc3 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] 10.222.0.52 "GET /compute/v2.1/servers/2870c53d-df7c-45d3-b8bd-c88966ad6315" status: 200 len: 1370 microversion: 2.1 time: 0.226578 Oct 19 03:24:56.785836 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1493/2928] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:24:56 2022] GET /compute/v2.1/servers/2870c53d-df7c-45d3-b8bd-c88966ad6315 => generated 1370 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:24:56.789497 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b0ee0110-66a7-4280-9cbe-2c365ff7911e tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:56.790114 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b0ee0110-66a7-4280-9cbe-2c365ff7911e tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: e5093d9e-cd31-4074-b339-828de5892bd1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:56.844245 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b0ee0110-66a7-4280-9cbe-2c365ff7911e tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:56.851113 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b0ee0110-66a7-4280-9cbe-2c365ff7911e tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/e5093d9e-cd31-4074-b339-828de5892bd1" status: 200 len: 1208 microversion: 2.1 time: 0.066044 Oct 19 03:24:56.851684 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1436/2929] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:24:56 2022] GET /compute/v2.1/servers/e5093d9e-cd31-4074-b339-828de5892bd1 => generated 1208 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:24:56.902953 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7213e5e2-8fc9-4ffb-aec2-85546b7eeb25 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:56.903699 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7213e5e2-8fc9-4ffb-aec2-85546b7eeb25 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] [instance: 410116db-4d00-4a9d-8375-a5cea6a0d627] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:56.909648 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7213e5e2-8fc9-4ffb-aec2-85546b7eeb25 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:56.910542 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7213e5e2-8fc9-4ffb-aec2-85546b7eeb25 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:56.910663 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7213e5e2-8fc9-4ffb-aec2-85546b7eeb25 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:56.911310 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7213e5e2-8fc9-4ffb-aec2-85546b7eeb25 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:56.911762 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7213e5e2-8fc9-4ffb-aec2-85546b7eeb25 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:56.912184 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7213e5e2-8fc9-4ffb-aec2-85546b7eeb25 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:56.978532 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7213e5e2-8fc9-4ffb-aec2-85546b7eeb25 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a222bb0f9a4c728d2ed5ca011c032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146393855c047be83270e5334c68e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:56.987055 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7213e5e2-8fc9-4ffb-aec2-85546b7eeb25 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] 10.222.0.52 "GET /compute/v2.1/servers/410116db-4d00-4a9d-8375-a5cea6a0d627" status: 200 len: 1431 microversion: 2.1 time: 0.088887 Oct 19 03:24:56.987621 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1494/2930] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:24:56 2022] GET /compute/v2.1/servers/410116db-4d00-4a9d-8375-a5cea6a0d627 => generated 1431 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:24:57.356741 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-fd65aed8-d937-46e4-87cf-857cd3f38f8e tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:57.357358 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-fd65aed8-d937-46e4-87cf-857cd3f38f8e tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] [instance: 333ed6dd-d020-4ef4-849c-956ed44cd18c] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:57.365047 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fd65aed8-d937-46e4-87cf-857cd3f38f8e tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:57.365573 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fd65aed8-d937-46e4-87cf-857cd3f38f8e tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:57.366077 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fd65aed8-d937-46e4-87cf-857cd3f38f8e tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:57.366782 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fd65aed8-d937-46e4-87cf-857cd3f38f8e tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:57.367241 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fd65aed8-d937-46e4-87cf-857cd3f38f8e tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:57.367673 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fd65aed8-d937-46e4-87cf-857cd3f38f8e tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:57.504771 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-fd65aed8-d937-46e4-87cf-857cd3f38f8e tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1fe2c1882341168e740e196b84ab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aa84ea2412a41d19901061f97068a00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:57.513225 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-fd65aed8-d937-46e4-87cf-857cd3f38f8e tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] 10.222.0.52 "GET /compute/v2.1/servers/333ed6dd-d020-4ef4-849c-956ed44cd18c" status: 200 len: 1508 microversion: 2.1 time: 0.160431 Oct 19 03:24:57.513828 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1437/2931] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:24:57 2022] GET /compute/v2.1/servers/333ed6dd-d020-4ef4-849c-956ed44cd18c => generated 1508 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:24:57.583133 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a6c685b1-34c3-4961-beec-5239941711eb tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:57.583778 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a6c685b1-34c3-4961-beec-5239941711eb tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] [instance: cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:57.591092 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a6c685b1-34c3-4961-beec-5239941711eb tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:57.591589 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a6c685b1-34c3-4961-beec-5239941711eb tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:57.592152 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a6c685b1-34c3-4961-beec-5239941711eb tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:57.592848 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a6c685b1-34c3-4961-beec-5239941711eb tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:57.593299 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a6c685b1-34c3-4961-beec-5239941711eb tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:57.593749 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a6c685b1-34c3-4961-beec-5239941711eb tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:57.712071 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-bd86084a-d81d-47ad-ba74-45da508cda3a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:57.712664 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-bd86084a-d81d-47ad-ba74-45da508cda3a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: eb2d22d5-8fc4-4a1a-a2ac-d54318936f21] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:57.719146 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bd86084a-d81d-47ad-ba74-45da508cda3a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:57.721446 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bd86084a-d81d-47ad-ba74-45da508cda3a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:57.721446 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bd86084a-d81d-47ad-ba74-45da508cda3a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:57.721446 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bd86084a-d81d-47ad-ba74-45da508cda3a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:57.721446 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bd86084a-d81d-47ad-ba74-45da508cda3a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:57.722154 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bd86084a-d81d-47ad-ba74-45da508cda3a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:57.726739 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:24:57.882307 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-bd86084a-d81d-47ad-ba74-45da508cda3a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:57.900134 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-bd86084a-d81d-47ad-ba74-45da508cda3a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/eb2d22d5-8fc4-4a1a-a2ac-d54318936f21" status: 200 len: 1245 microversion: 2.1 time: 0.192750 Oct 19 03:24:57.914020 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1438/2932] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:24:57 2022] GET /compute/v2.1/servers/eb2d22d5-8fc4-4a1a-a2ac-d54318936f21 => generated 1245 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:24:57.922308 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a11b5389-ee1c-4e69-92d3-21b40c1c1052 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:57.923043 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a11b5389-ee1c-4e69-92d3-21b40c1c1052 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:57.942325 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a11b5389-ee1c-4e69-92d3-21b40c1c1052 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:57.948284 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a11b5389-ee1c-4e69-92d3-21b40c1c1052 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:57.948284 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a11b5389-ee1c-4e69-92d3-21b40c1c1052 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:57.948284 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a11b5389-ee1c-4e69-92d3-21b40c1c1052 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:57.948284 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a11b5389-ee1c-4e69-92d3-21b40c1c1052 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:57.949638 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a11b5389-ee1c-4e69-92d3-21b40c1c1052 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:58.072987 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a6c685b1-34c3-4961-beec-5239941711eb tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:58.077153 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a11b5389-ee1c-4e69-92d3-21b40c1c1052 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:58.089532 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a11b5389-ee1c-4e69-92d3-21b40c1c1052 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6" status: 200 len: 1215 microversion: 2.1 time: 0.171002 Oct 19 03:24:58.090167 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1439/2933] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:24:57 2022] GET /compute/v2.1/servers/25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6 => generated 1215 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:24:58.097922 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b2dbf2b8-5f31-4492-a256-cea5735053c6 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:58.102853 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b2dbf2b8-5f31-4492-a256-cea5735053c6 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] [instance: 2870c53d-df7c-45d3-b8bd-c88966ad6315] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:58.103818 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a6c685b1-34c3-4961-beec-5239941711eb tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:58.106243 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a6c685b1-34c3-4961-beec-5239941711eb tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:58.108968 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a6c685b1-34c3-4961-beec-5239941711eb tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] 10.222.0.52 "GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95" status: 200 len: 1879 microversion: 2.42 time: 0.528454 Oct 19 03:24:58.111533 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1495/2934] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:24:57 2022] GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 => generated 1879 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:24:58.118978 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b2dbf2b8-5f31-4492-a256-cea5735053c6 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:58.119491 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b2dbf2b8-5f31-4492-a256-cea5735053c6 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:58.119993 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b2dbf2b8-5f31-4492-a256-cea5735053c6 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:58.121384 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b2dbf2b8-5f31-4492-a256-cea5735053c6 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:58.121659 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9907a279-ac1a-4cfa-aaa2-a72be2a29b95 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:58.121850 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b2dbf2b8-5f31-4492-a256-cea5735053c6 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:58.124006 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9907a279-ac1a-4cfa-aaa2-a72be2a29b95 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: e5093d9e-cd31-4074-b339-828de5892bd1] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:58.125147 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b2dbf2b8-5f31-4492-a256-cea5735053c6 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:58.137393 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9907a279-ac1a-4cfa-aaa2-a72be2a29b95 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:58.138118 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9907a279-ac1a-4cfa-aaa2-a72be2a29b95 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:58.138665 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9907a279-ac1a-4cfa-aaa2-a72be2a29b95 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:58.139492 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9907a279-ac1a-4cfa-aaa2-a72be2a29b95 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:58.140056 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9907a279-ac1a-4cfa-aaa2-a72be2a29b95 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:58.140591 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9907a279-ac1a-4cfa-aaa2-a72be2a29b95 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:58.165159 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:24:58.244443 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-9907a279-ac1a-4cfa-aaa2-a72be2a29b95 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:58.252906 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9907a279-ac1a-4cfa-aaa2-a72be2a29b95 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/e5093d9e-cd31-4074-b339-828de5892bd1" status: 200 len: 1212 microversion: 2.1 time: 0.140043 Oct 19 03:24:58.266937 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1496/2935] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:24:58 2022] GET /compute/v2.1/servers/e5093d9e-cd31-4074-b339-828de5892bd1 => generated 1212 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:24:58.279726 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-341234d1-5806-4e2a-a36c-1777eb636499 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:58.280689 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-341234d1-5806-4e2a-a36c-1777eb636499 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] [instance: 410116db-4d00-4a9d-8375-a5cea6a0d627] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:58.288815 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-341234d1-5806-4e2a-a36c-1777eb636499 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:58.289988 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-341234d1-5806-4e2a-a36c-1777eb636499 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:58.290883 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-341234d1-5806-4e2a-a36c-1777eb636499 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:58.291702 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-341234d1-5806-4e2a-a36c-1777eb636499 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:58.292342 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-341234d1-5806-4e2a-a36c-1777eb636499 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:58.293630 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-341234d1-5806-4e2a-a36c-1777eb636499 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:58.329889 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-341234d1-5806-4e2a-a36c-1777eb636499 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:58.330435 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-341234d1-5806-4e2a-a36c-1777eb636499 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:58.330822 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-341234d1-5806-4e2a-a36c-1777eb636499 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:58.331455 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-341234d1-5806-4e2a-a36c-1777eb636499 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lazy-loading 'fault' on Instance uuid 410116db-4d00-4a9d-8375-a5cea6a0d627 {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:24:58.372925 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b2dbf2b8-5f31-4492-a256-cea5735053c6 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bf143866aa44afb11285d61ffd7ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bf79842c02480eb1e91d521226d317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:58.383082 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b2dbf2b8-5f31-4492-a256-cea5735053c6 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] 10.222.0.52 "GET /compute/v2.1/servers/2870c53d-df7c-45d3-b8bd-c88966ad6315" status: 200 len: 1370 microversion: 2.1 time: 0.291104 Oct 19 03:24:58.384940 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1440/2936] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:24:58 2022] GET /compute/v2.1/servers/2870c53d-df7c-45d3-b8bd-c88966ad6315 => generated 1370 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:24:58.390059 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-7d242108-7391-4a9c-aa29-7bb34ac4fe34 req-2dca00a1-6937-4a12-9e24-4c9e0b7a7ce4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95", "name": "network-vif-plugged", "status": "completed", "tag": "60051f56-f07d-4d7c-b7f8-7fc736fa8bc5"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:24:58.396064 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-341234d1-5806-4e2a-a36c-1777eb636499 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a222bb0f9a4c728d2ed5ca011c032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146393855c047be83270e5334c68e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:58.419108 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-341234d1-5806-4e2a-a36c-1777eb636499 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] 10.222.0.52 "GET /compute/v2.1/servers/410116db-4d00-4a9d-8375-a5cea6a0d627" status: 200 len: 1308 microversion: 2.1 time: 0.150247 Oct 19 03:24:58.434567 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1497/2937] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:24:58 2022] GET /compute/v2.1/servers/410116db-4d00-4a9d-8375-a5cea6a0d627 => generated 1308 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:24:58.440020 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:24:58.441964 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-7d242108-7391-4a9c-aa29-7bb34ac4fe34 req-2dca00a1-6937-4a12-9e24-4c9e0b7a7ce4 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:58.442737 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-7d242108-7391-4a9c-aa29-7bb34ac4fe34 req-2dca00a1-6937-4a12-9e24-4c9e0b7a7ce4 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:58.443263 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-7d242108-7391-4a9c-aa29-7bb34ac4fe34 req-2dca00a1-6937-4a12-9e24-4c9e0b7a7ce4 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:58.470223 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-7d242108-7391-4a9c-aa29-7bb34ac4fe34 req-2dca00a1-6937-4a12-9e24-4c9e0b7a7ce4 service nova] Creating event network-vif-plugged:60051f56-f07d-4d7c-b7f8-7fc736fa8bc5 for instance cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 on n-h2-861333-8 Oct 19 03:24:58.476163 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-7d242108-7391-4a9c-aa29-7bb34ac4fe34 req-2dca00a1-6937-4a12-9e24-4c9e0b7a7ce4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089815 Oct 19 03:24:58.477437 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1441/2938] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:24:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:24:58.537229 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-504d5e76-e6da-4924-8f69-f92cb5938e34 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:58.537950 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-504d5e76-e6da-4924-8f69-f92cb5938e34 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] [instance: 333ed6dd-d020-4ef4-849c-956ed44cd18c] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:58.544852 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-504d5e76-e6da-4924-8f69-f92cb5938e34 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:58.545442 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-504d5e76-e6da-4924-8f69-f92cb5938e34 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:58.545896 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-504d5e76-e6da-4924-8f69-f92cb5938e34 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:58.546611 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-504d5e76-e6da-4924-8f69-f92cb5938e34 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:58.547069 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-504d5e76-e6da-4924-8f69-f92cb5938e34 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:58.547583 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-504d5e76-e6da-4924-8f69-f92cb5938e34 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:58.684078 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-504d5e76-e6da-4924-8f69-f92cb5938e34 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1fe2c1882341168e740e196b84ab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aa84ea2412a41d19901061f97068a00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:58.691829 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-504d5e76-e6da-4924-8f69-f92cb5938e34 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] 10.222.0.52 "GET /compute/v2.1/servers/333ed6dd-d020-4ef4-849c-956ed44cd18c" status: 200 len: 1508 microversion: 2.1 time: 0.158729 Oct 19 03:24:58.693786 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1498/2939] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:24:58 2022] GET /compute/v2.1/servers/333ed6dd-d020-4ef4-849c-956ed44cd18c => generated 1508 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:24:58.842978 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-f3b0eb4c-476c-454c-b7a6-243ab8d317d6 req-284b55e7-7db5-4b83-8ac9-6acf3e28ca9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d77faf6-475d-4711-820a-623c1b705f8c", "name": "network-vif-deleted", "tag": "22167c4d-32ff-41fa-bec4-4c8908d6b685"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:24:58.860772 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-f3b0eb4c-476c-454c-b7a6-243ab8d317d6 req-284b55e7-7db5-4b83-8ac9-6acf3e28ca9f service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:58.866581 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-f3b0eb4c-476c-454c-b7a6-243ab8d317d6 req-284b55e7-7db5-4b83-8ac9-6acf3e28ca9f service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:58.866581 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-f3b0eb4c-476c-454c-b7a6-243ab8d317d6 req-284b55e7-7db5-4b83-8ac9-6acf3e28ca9f service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:58.877395 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-f3b0eb4c-476c-454c-b7a6-243ab8d317d6 req-284b55e7-7db5-4b83-8ac9-6acf3e28ca9f service nova] Creating event network-vif-deleted:22167c4d-32ff-41fa-bec4-4c8908d6b685 for instance 4d77faf6-475d-4711-820a-623c1b705f8c on n-h2-861333-8 Oct 19 03:24:58.884732 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-f3b0eb4c-476c-454c-b7a6-243ab8d317d6 req-284b55e7-7db5-4b83-8ac9-6acf3e28ca9f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046332 Oct 19 03:24:58.887107 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1442/2940] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:24:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:24:58.929451 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-90726f98-d667-4757-9768-cfc596c52aff tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:58.930504 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-90726f98-d667-4757-9768-cfc596c52aff tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: eb2d22d5-8fc4-4a1a-a2ac-d54318936f21] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:58.941303 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-90726f98-d667-4757-9768-cfc596c52aff tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:58.941303 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-90726f98-d667-4757-9768-cfc596c52aff tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:58.941303 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-90726f98-d667-4757-9768-cfc596c52aff tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:58.941303 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-90726f98-d667-4757-9768-cfc596c52aff tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:58.941768 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-90726f98-d667-4757-9768-cfc596c52aff tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:58.942238 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-90726f98-d667-4757-9768-cfc596c52aff tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:59.040920 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-90726f98-d667-4757-9768-cfc596c52aff tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:59.049034 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-90726f98-d667-4757-9768-cfc596c52aff tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/eb2d22d5-8fc4-4a1a-a2ac-d54318936f21" status: 200 len: 1253 microversion: 2.1 time: 0.124633 Oct 19 03:24:59.050562 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1499/2941] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:24:58 2022] GET /compute/v2.1/servers/eb2d22d5-8fc4-4a1a-a2ac-d54318936f21 => generated 1253 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:24:59.112981 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0443c8d1-8d5b-40ce-b1ee-52b45b63bccd tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:59.113616 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0443c8d1-8d5b-40ce-b1ee-52b45b63bccd tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:59.119881 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0443c8d1-8d5b-40ce-b1ee-52b45b63bccd tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:59.120423 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0443c8d1-8d5b-40ce-b1ee-52b45b63bccd tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:59.121438 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0443c8d1-8d5b-40ce-b1ee-52b45b63bccd tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:59.122099 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0443c8d1-8d5b-40ce-b1ee-52b45b63bccd tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:59.122553 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0443c8d1-8d5b-40ce-b1ee-52b45b63bccd tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:59.122979 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0443c8d1-8d5b-40ce-b1ee-52b45b63bccd tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:59.139025 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d54bf3e2-3fb8-4838-b61c-80c9d968b846 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:59.141965 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d54bf3e2-3fb8-4838-b61c-80c9d968b846 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] [instance: cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:59.150612 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d54bf3e2-3fb8-4838-b61c-80c9d968b846 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:59.151050 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d54bf3e2-3fb8-4838-b61c-80c9d968b846 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:59.151507 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d54bf3e2-3fb8-4838-b61c-80c9d968b846 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:59.154125 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d54bf3e2-3fb8-4838-b61c-80c9d968b846 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:59.154622 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d54bf3e2-3fb8-4838-b61c-80c9d968b846 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:59.155069 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d54bf3e2-3fb8-4838-b61c-80c9d968b846 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:59.200523 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0443c8d1-8d5b-40ce-b1ee-52b45b63bccd tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:59.211315 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0443c8d1-8d5b-40ce-b1ee-52b45b63bccd tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6" status: 200 len: 1207 microversion: 2.1 time: 0.102565 Oct 19 03:24:59.225160 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1443/2942] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:24:59 2022] GET /compute/v2.1/servers/25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6 => generated 1207 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:24:59.283934 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-dd787c00-6cf6-4b7c-851d-fe964b88ca40 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:59.283934 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-dd787c00-6cf6-4b7c-851d-fe964b88ca40 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: e5093d9e-cd31-4074-b339-828de5892bd1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:59.289214 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dd787c00-6cf6-4b7c-851d-fe964b88ca40 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:59.290015 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dd787c00-6cf6-4b7c-851d-fe964b88ca40 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:59.290584 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dd787c00-6cf6-4b7c-851d-fe964b88ca40 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:59.291377 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dd787c00-6cf6-4b7c-851d-fe964b88ca40 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:59.291893 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dd787c00-6cf6-4b7c-851d-fe964b88ca40 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:59.292604 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dd787c00-6cf6-4b7c-851d-fe964b88ca40 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:59.382773 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-dd787c00-6cf6-4b7c-851d-fe964b88ca40 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:59.416684 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-dd787c00-6cf6-4b7c-851d-fe964b88ca40 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/e5093d9e-cd31-4074-b339-828de5892bd1" status: 200 len: 1260 microversion: 2.1 time: 0.139428 Oct 19 03:24:59.424320 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1444/2943] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:24:59 2022] GET /compute/v2.1/servers/e5093d9e-cd31-4074-b339-828de5892bd1 => generated 1260 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:24:59.429678 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d54bf3e2-3fb8-4838-b61c-80c9d968b846 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:59.443154 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a562272f-7cbc-4f0e-b0f7-bf3995b1aff4 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:59.451553 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a562272f-7cbc-4f0e-b0f7-bf3995b1aff4 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] [instance: 2870c53d-df7c-45d3-b8bd-c88966ad6315] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:59.452042 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d54bf3e2-3fb8-4838-b61c-80c9d968b846 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:59.452042 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d54bf3e2-3fb8-4838-b61c-80c9d968b846 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:59.452856 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d54bf3e2-3fb8-4838-b61c-80c9d968b846 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] 10.222.0.52 "GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95" status: 200 len: 1879 microversion: 2.42 time: 0.317059 Oct 19 03:24:59.454315 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1500/2944] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:24:59 2022] GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 => generated 1879 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:24:59.459940 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-963b8b61-e0d7-4f83-af37-4409648fe2df tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:59.460887 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-963b8b61-e0d7-4f83-af37-4409648fe2df tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] [instance: 410116db-4d00-4a9d-8375-a5cea6a0d627] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:59.467415 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a562272f-7cbc-4f0e-b0f7-bf3995b1aff4 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:59.470279 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-963b8b61-e0d7-4f83-af37-4409648fe2df tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:59.471009 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-963b8b61-e0d7-4f83-af37-4409648fe2df tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:59.471209 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a562272f-7cbc-4f0e-b0f7-bf3995b1aff4 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:59.471775 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a562272f-7cbc-4f0e-b0f7-bf3995b1aff4 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:59.472191 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-963b8b61-e0d7-4f83-af37-4409648fe2df tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:59.472532 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a562272f-7cbc-4f0e-b0f7-bf3995b1aff4 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:59.473013 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a562272f-7cbc-4f0e-b0f7-bf3995b1aff4 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:59.473486 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a562272f-7cbc-4f0e-b0f7-bf3995b1aff4 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:59.473918 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-963b8b61-e0d7-4f83-af37-4409648fe2df tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:59.474569 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-963b8b61-e0d7-4f83-af37-4409648fe2df tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:59.475201 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-963b8b61-e0d7-4f83-af37-4409648fe2df tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:59.494606 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-963b8b61-e0d7-4f83-af37-4409648fe2df tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] HTTP exception thrown: Instance 410116db-4d00-4a9d-8375-a5cea6a0d627 could not be found. Oct 19 03:24:59.497629 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-963b8b61-e0d7-4f83-af37-4409648fe2df tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Request method failure captured: Oct 19 03:24:59.497629 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/410116db-4d00-4a9d-8375-a5cea6a0d627 HTTP/1.1 Oct 19 03:24:59.497629 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:24:59.497629 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:24:59.497629 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:24:59.497629 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:24:59.497629 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:24:59.497629 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:24:59.497629 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:24:59.497629 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:24:59.497629 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT21Pw8YmHewscZDMnUs1--DTAsbzPgAvwpoNZxQ3G_0zAh6OxLXIw2cGXot0t8eYsUUTxrVn_R_0AfHDQw5I8tyFYWWrO5-hn_yP-iNDwlt63S3DiTGMYoZdyj_seVvViIP8T4neiIaeQu96qju_-zQfxDa_G3TPLu4HcRJpzYIfEjk Oct 19 03:24:59.497629 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:24:59.497629 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:24:59.497629 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:24:59.497629 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:24:59.497629 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:24:59.497629 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:24:59.497629 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: a146393855c047be83270e5334c68e45 Oct 19 03:24:59.497629 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ListImageFiltersTestJSON-1015938331 Oct 19 03:24:59.497629 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:24:59.497629 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:24:59.499265 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a146393855c047be83270e5334c68e45"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a146393855c047be83270e5334c68e45"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a146393855c047be83270e5334c68e45"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a146393855c047be83270e5334c68e45", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:24:59.499265 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ListImageFiltersTestJSON-1015938331 Oct 19 03:24:59.499265 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: a146393855c047be83270e5334c68e45 Oct 19 03:24:59.499265 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1015938331 Oct 19 03:24:59.499265 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ListImageFiltersTestJSON-1015938331-project Oct 19 03:24:59.499265 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:24:59.499265 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:24:59.499265 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 97a222bb0f9a4c728d2ed5ca011c032d Oct 19 03:24:59.499265 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ListImageFiltersTestJSON-1015938331-project Oct 19 03:24:59.499265 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:24:59.499265 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance 410116db-4d00-4a9d-8375-a5cea6a0d627 could not be found. Oct 19 03:24:59.499265 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '410116db-4d00-4a9d-8375-a5cea6a0d627'} Oct 19 03:24:59.500150 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:24:59.500150 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:24:59.500150 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:24:59.500150 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:24:59.500150 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:24:59.500150 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:24:59.500150 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:24:59.500150 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:24:59.500150 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:24:59.500150 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:24:59.500150 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 410116db-4d00-4a9d-8375-a5cea6a0d627 could not be found. Oct 19 03:24:59.500150 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:24:59.500150 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:24:59.500150 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:24:59.500150 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:24:59.500150 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:24:59.500150 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:24:59.500150 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:24:59.500150 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:24:59.500150 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:24:59.501761 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:24:59.501761 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:24:59.501761 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:24:59.501761 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:24:59.501761 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:24:59.501761 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:24:59.501761 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:24:59.501761 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 410116db-4d00-4a9d-8375-a5cea6a0d627 could not be found. Oct 19 03:24:59.501761 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:24:59.501761 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:24:59.501761 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:24:59.501761 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:24:59.501761 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:24:59.501761 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:24:59.501761 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:24:59.501761 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:24:59.501761 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 410116db-4d00-4a9d-8375-a5cea6a0d627 could not be found. Oct 19 03:24:59.501761 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:24:59.503077 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-963b8b61-e0d7-4f83-af37-4409648fe2df tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Returning 404 to user: Instance 410116db-4d00-4a9d-8375-a5cea6a0d627 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:24:59.503551 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-963b8b61-e0d7-4f83-af37-4409648fe2df tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] 10.222.0.52 "GET /compute/v2.1/servers/410116db-4d00-4a9d-8375-a5cea6a0d627" status: 404 len: 111 microversion: 2.1 time: 0.046310 Oct 19 03:24:59.504686 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1501/2945] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:24:59 2022] GET /compute/v2.1/servers/410116db-4d00-4a9d-8375-a5cea6a0d627 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:24:59.515455 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-97455670-f8e8-47aa-a219-3c87dfa4c167 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Calling method '.version_select at 0x7fc130270550>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:59.744484 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a562272f-7cbc-4f0e-b0f7-bf3995b1aff4 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bf143866aa44afb11285d61ffd7ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bf79842c02480eb1e91d521226d317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:59.769715 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a562272f-7cbc-4f0e-b0f7-bf3995b1aff4 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] 10.222.0.52 "GET /compute/v2.1/servers/2870c53d-df7c-45d3-b8bd-c88966ad6315" status: 200 len: 1370 microversion: 2.1 time: 0.344115 Oct 19 03:24:59.771852 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1445/2946] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:24:59 2022] GET /compute/v2.1/servers/2870c53d-df7c-45d3-b8bd-c88966ad6315 => generated 1370 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:24:59.779660 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-86c4d1be-a813-47bc-9987-f1dda22ecafa tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:59.782436 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-86c4d1be-a813-47bc-9987-f1dda22ecafa tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] [instance: 333ed6dd-d020-4ef4-849c-956ed44cd18c] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:24:59.788437 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-86c4d1be-a813-47bc-9987-f1dda22ecafa tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:59.789512 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-86c4d1be-a813-47bc-9987-f1dda22ecafa tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:59.790209 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-86c4d1be-a813-47bc-9987-f1dda22ecafa tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:59.792831 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-86c4d1be-a813-47bc-9987-f1dda22ecafa tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:24:59.794055 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-86c4d1be-a813-47bc-9987-f1dda22ecafa tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:24:59.795790 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-86c4d1be-a813-47bc-9987-f1dda22ecafa tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:24:59.960278 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-86c4d1be-a813-47bc-9987-f1dda22ecafa tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1fe2c1882341168e740e196b84ab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aa84ea2412a41d19901061f97068a00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:24:59.969293 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-86c4d1be-a813-47bc-9987-f1dda22ecafa tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] 10.222.0.52 "GET /compute/v2.1/servers/333ed6dd-d020-4ef4-849c-956ed44cd18c" status: 200 len: 1506 microversion: 2.1 time: 0.196109 Oct 19 03:24:59.971148 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1446/2947] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:24:59 2022] GET /compute/v2.1/servers/333ed6dd-d020-4ef4-849c-956ed44cd18c => generated 1506 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:24:59.992801 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-cafc1596-cde8-4df5-9520-d730029ea642 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Calling method '.version_select at 0x7fc130b694c0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:24:59.993235 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-cafc1596-cde8-4df5-9520-d730029ea642 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] [instance: 333ed6dd-d020-4ef4-849c-956ed44cd18c] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:00.000696 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cafc1596-cde8-4df5-9520-d730029ea642 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:00.001345 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cafc1596-cde8-4df5-9520-d730029ea642 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:00.002089 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cafc1596-cde8-4df5-9520-d730029ea642 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:00.002808 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cafc1596-cde8-4df5-9520-d730029ea642 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:00.003271 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cafc1596-cde8-4df5-9520-d730029ea642 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:00.003708 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cafc1596-cde8-4df5-9520-d730029ea642 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:00.041402 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-cafc1596-cde8-4df5-9520-d730029ea642 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] 10.222.0.52 "GET /compute/v2.1/servers/333ed6dd-d020-4ef4-849c-956ed44cd18c/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.053169 Oct 19 03:25:00.042770 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1447/2948] 10.222.0.52 () {58 vars in 1296 bytes} [Wed Oct 19 03:24:59 2022] GET /compute/v2.1/servers/333ed6dd-d020-4ef4-849c-956ed44cd18c/os-instance-actions => generated 611 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:25:00.055320 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b3ce18ca-30a7-49ff-b90e-396638ce5906 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:00.056188 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b3ce18ca-30a7-49ff-b90e-396638ce5906 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] [instance: 333ed6dd-d020-4ef4-849c-956ed44cd18c] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:00.070213 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b3ce18ca-30a7-49ff-b90e-396638ce5906 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:00.071149 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b3ce18ca-30a7-49ff-b90e-396638ce5906 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:00.072212 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b3ce18ca-30a7-49ff-b90e-396638ce5906 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:00.073624 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b3ce18ca-30a7-49ff-b90e-396638ce5906 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:00.079189 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b3ce18ca-30a7-49ff-b90e-396638ce5906 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:00.081688 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b3ce18ca-30a7-49ff-b90e-396638ce5906 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:00.152653 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b3ce18ca-30a7-49ff-b90e-396638ce5906 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] [instance: 333ed6dd-d020-4ef4-849c-956ed44cd18c] Going to try to terminate instance {{(pid=121134) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:25:00.276140 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-97455670-f8e8-47aa-a219-3c87dfa4c167 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] 10.222.0.52 "DELETE /compute/v2.1/images/e442c226-6899-45f7-8b16-e84f6316a9e3" status: 204 len: 0 microversion: 2.1 time: 0.765533 Oct 19 03:25:00.278626 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1502/2949] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:24:59 2022] DELETE /compute/v2.1/images/e442c226-6899-45f7-8b16-e84f6316a9e3 => generated 0 bytes in 770 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:25:00.284289 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-8f0d1527-90a0-42ea-bafb-7fc16698f91a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:00.301318 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-8f0d1527-90a0-42ea-bafb-7fc16698f91a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: eb2d22d5-8fc4-4a1a-a2ac-d54318936f21] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:00.326621 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8f0d1527-90a0-42ea-bafb-7fc16698f91a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:00.327136 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8f0d1527-90a0-42ea-bafb-7fc16698f91a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:00.339989 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8f0d1527-90a0-42ea-bafb-7fc16698f91a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:00.341029 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8f0d1527-90a0-42ea-bafb-7fc16698f91a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:00.341338 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8f0d1527-90a0-42ea-bafb-7fc16698f91a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:00.341803 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8f0d1527-90a0-42ea-bafb-7fc16698f91a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:00.662352 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-8f0d1527-90a0-42ea-bafb-7fc16698f91a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:00.674099 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-8f0d1527-90a0-42ea-bafb-7fc16698f91a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/eb2d22d5-8fc4-4a1a-a2ac-d54318936f21" status: 200 len: 1293 microversion: 2.1 time: 0.394143 Oct 19 03:25:00.674937 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1503/2950] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:00 2022] GET /compute/v2.1/servers/eb2d22d5-8fc4-4a1a-a2ac-d54318936f21 => generated 1293 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:00.680836 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4f9e38db-37b2-4bd1-aa6b-97b45566c3cd tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:00.681696 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4f9e38db-37b2-4bd1-aa6b-97b45566c3cd tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:00.689169 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4f9e38db-37b2-4bd1-aa6b-97b45566c3cd tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:00.689921 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4f9e38db-37b2-4bd1-aa6b-97b45566c3cd tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:00.690552 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4f9e38db-37b2-4bd1-aa6b-97b45566c3cd tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:00.691560 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4f9e38db-37b2-4bd1-aa6b-97b45566c3cd tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:00.692021 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4f9e38db-37b2-4bd1-aa6b-97b45566c3cd tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:00.692454 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4f9e38db-37b2-4bd1-aa6b-97b45566c3cd tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:00.729393 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b3ce18ca-30a7-49ff-b90e-396638ce5906 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] 10.222.0.52 "DELETE /compute/v2.1/servers/333ed6dd-d020-4ef4-849c-956ed44cd18c" status: 204 len: 0 microversion: 2.1 time: 0.677783 Oct 19 03:25:00.737053 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1448/2951] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:25:00 2022] DELETE /compute/v2.1/servers/333ed6dd-d020-4ef4-849c-956ed44cd18c => generated 0 bytes in 683 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 19 03:25:00.754162 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-acc2c083-4ff3-4bab-b86f-e820e38adb93 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Calling method '.version_select at 0x7fc13024b310>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:00.765992 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4f9e38db-37b2-4bd1-aa6b-97b45566c3cd tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:00.776101 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4f9e38db-37b2-4bd1-aa6b-97b45566c3cd tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6" status: 200 len: 1263 microversion: 2.1 time: 0.099006 Oct 19 03:25:00.777064 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1504/2952] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:00 2022] GET /compute/v2.1/servers/25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6 => generated 1263 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:00.796736 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ac9261cf-7349-4087-bbca-34e09902355f tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:00.797537 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ac9261cf-7349-4087-bbca-34e09902355f tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: e5093d9e-cd31-4074-b339-828de5892bd1] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:00.805168 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ac9261cf-7349-4087-bbca-34e09902355f tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:00.807481 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ac9261cf-7349-4087-bbca-34e09902355f tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:00.808712 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ac9261cf-7349-4087-bbca-34e09902355f tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:00.816792 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ac9261cf-7349-4087-bbca-34e09902355f tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:00.816792 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ac9261cf-7349-4087-bbca-34e09902355f tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:00.816792 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ac9261cf-7349-4087-bbca-34e09902355f tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:00.906356 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ac9261cf-7349-4087-bbca-34e09902355f tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:00.915928 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ac9261cf-7349-4087-bbca-34e09902355f tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/e5093d9e-cd31-4074-b339-828de5892bd1" status: 200 len: 1278 microversion: 2.1 time: 0.137489 Oct 19 03:25:00.920195 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1505/2953] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:00 2022] GET /compute/v2.1/servers/e5093d9e-cd31-4074-b339-828de5892bd1 => generated 1278 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:00.929922 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c5e1f683-cdcc-408a-9346-62b5896d442f tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:00.930828 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c5e1f683-cdcc-408a-9346-62b5896d442f tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] [instance: cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:00.941722 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c5e1f683-cdcc-408a-9346-62b5896d442f tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:00.947858 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c5e1f683-cdcc-408a-9346-62b5896d442f tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:00.947858 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c5e1f683-cdcc-408a-9346-62b5896d442f tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:00.947858 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c5e1f683-cdcc-408a-9346-62b5896d442f tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:00.947858 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c5e1f683-cdcc-408a-9346-62b5896d442f tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:00.948476 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c5e1f683-cdcc-408a-9346-62b5896d442f tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:01.187240 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c5e1f683-cdcc-408a-9346-62b5896d442f tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:01.197602 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c5e1f683-cdcc-408a-9346-62b5896d442f tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:01.199210 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c5e1f683-cdcc-408a-9346-62b5896d442f tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:01.200683 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c5e1f683-cdcc-408a-9346-62b5896d442f tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] 10.222.0.52 "GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95" status: 200 len: 1879 microversion: 2.42 time: 0.280999 Oct 19 03:25:01.201432 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1506/2954] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:25:00 2022] GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 => generated 1879 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:25:01.206664 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-dfaad09f-c623-4977-a3d4-a43d3d40f341 req-80e1c954-0ba1-427e-9f1d-9f3ac109702c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95", "name": "network-vif-plugged", "status": "completed", "tag": "e7593819-3c37-4a86-a761-7d7c0fa6d983"}, {"server_uuid": "cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95", "name": "network-vif-plugged", "status": "completed", "tag": "08b1ab84-ad3f-4225-9361-51c47cd1448e"}, {"server_uuid": "cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95", "name": "network-vif-plugged", "status": "completed", "tag": "8a375b84-11bb-4f0c-9583-6d7d29938112"}, {"server_uuid": "cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95", "name": "network-vif-plugged", "status": "completed", "tag": "65396b7f-6d0e-408a-b3e0-4a8c18d5caa3"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:25:01.218990 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-dfaad09f-c623-4977-a3d4-a43d3d40f341 req-80e1c954-0ba1-427e-9f1d-9f3ac109702c service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:01.219482 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-dfaad09f-c623-4977-a3d4-a43d3d40f341 req-80e1c954-0ba1-427e-9f1d-9f3ac109702c service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:01.219922 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-dfaad09f-c623-4977-a3d4-a43d3d40f341 req-80e1c954-0ba1-427e-9f1d-9f3ac109702c service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:01.233349 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-dfaad09f-c623-4977-a3d4-a43d3d40f341 req-80e1c954-0ba1-427e-9f1d-9f3ac109702c service nova] Creating event network-vif-plugged:e7593819-3c37-4a86-a761-7d7c0fa6d983 for instance cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 on n-h2-861333-8 Oct 19 03:25:01.234046 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-dfaad09f-c623-4977-a3d4-a43d3d40f341 req-80e1c954-0ba1-427e-9f1d-9f3ac109702c service nova] Creating event network-vif-plugged:08b1ab84-ad3f-4225-9361-51c47cd1448e for instance cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 on n-h2-861333-8 Oct 19 03:25:01.234554 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-dfaad09f-c623-4977-a3d4-a43d3d40f341 req-80e1c954-0ba1-427e-9f1d-9f3ac109702c service nova] Creating event network-vif-plugged:8a375b84-11bb-4f0c-9583-6d7d29938112 for instance cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 on n-h2-861333-8 Oct 19 03:25:01.235099 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-dfaad09f-c623-4977-a3d4-a43d3d40f341 req-80e1c954-0ba1-427e-9f1d-9f3ac109702c service nova] Creating event network-vif-plugged:65396b7f-6d0e-408a-b3e0-4a8c18d5caa3 for instance cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 on n-h2-861333-8 Oct 19 03:25:01.240984 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-dfaad09f-c623-4977-a3d4-a43d3d40f341 req-80e1c954-0ba1-427e-9f1d-9f3ac109702c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.038262 Oct 19 03:25:01.241633 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1507/2955] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:25:01 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:25:01.255741 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ae61ad60-8677-4137-addd-e397347664ee tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:01.255741 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ae61ad60-8677-4137-addd-e397347664ee tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] [instance: 333ed6dd-d020-4ef4-849c-956ed44cd18c] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:01.255741 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ae61ad60-8677-4137-addd-e397347664ee tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:01.255741 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ae61ad60-8677-4137-addd-e397347664ee tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:01.256132 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ae61ad60-8677-4137-addd-e397347664ee tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:01.256132 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ae61ad60-8677-4137-addd-e397347664ee tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:01.256328 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ae61ad60-8677-4137-addd-e397347664ee tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:01.256588 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ae61ad60-8677-4137-addd-e397347664ee tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:01.408562 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ae61ad60-8677-4137-addd-e397347664ee tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1fe2c1882341168e740e196b84ab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aa84ea2412a41d19901061f97068a00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:01.416811 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ae61ad60-8677-4137-addd-e397347664ee tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] 10.222.0.52 "GET /compute/v2.1/servers/333ed6dd-d020-4ef4-849c-956ed44cd18c" status: 200 len: 1512 microversion: 2.1 time: 0.173954 Oct 19 03:25:01.420126 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1508/2956] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:01 2022] GET /compute/v2.1/servers/333ed6dd-d020-4ef4-849c-956ed44cd18c => generated 1512 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:01.425047 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c1c9755c-9a00-4c46-9463-15c0845bbc07 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:01.425928 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c1c9755c-9a00-4c46-9463-15c0845bbc07 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] [instance: 2870c53d-df7c-45d3-b8bd-c88966ad6315] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:01.440496 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c1c9755c-9a00-4c46-9463-15c0845bbc07 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:01.441624 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c1c9755c-9a00-4c46-9463-15c0845bbc07 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:01.442074 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c1c9755c-9a00-4c46-9463-15c0845bbc07 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:01.442786 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c1c9755c-9a00-4c46-9463-15c0845bbc07 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:01.443426 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c1c9755c-9a00-4c46-9463-15c0845bbc07 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:01.444304 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c1c9755c-9a00-4c46-9463-15c0845bbc07 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:01.557678 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-acc2c083-4ff3-4bab-b86f-e820e38adb93 tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] 10.222.0.52 "DELETE /compute/v2.1/images/0d6ac048-4f2a-4e56-8b9e-3cbbea8bcfd5" status: 204 len: 0 microversion: 2.1 time: 0.819088 Oct 19 03:25:01.559321 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1449/2957] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:00 2022] DELETE /compute/v2.1/images/0d6ac048-4f2a-4e56-8b9e-3cbbea8bcfd5 => generated 0 bytes in 822 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:25:01.568079 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b2f1fa95-4036-4009-8d0b-ba51924fcf8b tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] Calling method '.version_select at 0x7fc13024f5e0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:01.609805 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c1c9755c-9a00-4c46-9463-15c0845bbc07 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bf143866aa44afb11285d61ffd7ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bf79842c02480eb1e91d521226d317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:01.623405 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c1c9755c-9a00-4c46-9463-15c0845bbc07 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] 10.222.0.52 "GET /compute/v2.1/servers/2870c53d-df7c-45d3-b8bd-c88966ad6315" status: 200 len: 1370 microversion: 2.1 time: 0.201958 Oct 19 03:25:01.624984 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1509/2958] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:01 2022] GET /compute/v2.1/servers/2870c53d-df7c-45d3-b8bd-c88966ad6315 => generated 1370 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:01.702198 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-95d0f8a9-9df3-4cfb-a91d-9be104625e11 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:01.703610 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-95d0f8a9-9df3-4cfb-a91d-9be104625e11 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: eb2d22d5-8fc4-4a1a-a2ac-d54318936f21] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:01.721058 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-95d0f8a9-9df3-4cfb-a91d-9be104625e11 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:01.723391 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-95d0f8a9-9df3-4cfb-a91d-9be104625e11 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:01.724665 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-95d0f8a9-9df3-4cfb-a91d-9be104625e11 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:01.724665 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-95d0f8a9-9df3-4cfb-a91d-9be104625e11 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:01.728927 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-95d0f8a9-9df3-4cfb-a91d-9be104625e11 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:01.729603 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-95d0f8a9-9df3-4cfb-a91d-9be104625e11 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:01.909472 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-95d0f8a9-9df3-4cfb-a91d-9be104625e11 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:01.922049 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-95d0f8a9-9df3-4cfb-a91d-9be104625e11 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/eb2d22d5-8fc4-4a1a-a2ac-d54318936f21" status: 200 len: 1293 microversion: 2.1 time: 0.228135 Oct 19 03:25:01.922860 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1510/2959] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:01 2022] GET /compute/v2.1/servers/eb2d22d5-8fc4-4a1a-a2ac-d54318936f21 => generated 1293 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:01.927616 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-94eedefa-0c8e-40e9-97bb-4a4f6575adda tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:01.928235 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-94eedefa-0c8e-40e9-97bb-4a4f6575adda tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:01.934850 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-94eedefa-0c8e-40e9-97bb-4a4f6575adda tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:01.935509 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-94eedefa-0c8e-40e9-97bb-4a4f6575adda tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:01.936384 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-94eedefa-0c8e-40e9-97bb-4a4f6575adda tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:01.937194 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-94eedefa-0c8e-40e9-97bb-4a4f6575adda tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:01.937671 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-94eedefa-0c8e-40e9-97bb-4a4f6575adda tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:01.938100 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-94eedefa-0c8e-40e9-97bb-4a4f6575adda tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:02.001063 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-94eedefa-0c8e-40e9-97bb-4a4f6575adda tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:02.008741 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-94eedefa-0c8e-40e9-97bb-4a4f6575adda tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6" status: 200 len: 1271 microversion: 2.1 time: 0.084881 Oct 19 03:25:02.009322 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1511/2960] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:01 2022] GET /compute/v2.1/servers/25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6 => generated 1271 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:02.021545 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-5be7bde6-7ca5-433e-983a-0a722d894bbe req-a02343f7-5d3f-4257-96e9-22da2b08ba98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb2d22d5-8fc4-4a1a-a2ac-d54318936f21", "tag": "e46e34c0-a202-40e2-b74d-93cf2fca0962"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:25:02.023920 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-5be7bde6-7ca5-433e-983a-0a722d894bbe req-a02343f7-5d3f-4257-96e9-22da2b08ba98 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:02.024398 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-5be7bde6-7ca5-433e-983a-0a722d894bbe req-a02343f7-5d3f-4257-96e9-22da2b08ba98 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:02.024829 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-5be7bde6-7ca5-433e-983a-0a722d894bbe req-a02343f7-5d3f-4257-96e9-22da2b08ba98 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:02.036044 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-5be7bde6-7ca5-433e-983a-0a722d894bbe req-a02343f7-5d3f-4257-96e9-22da2b08ba98 service nova] Creating event network-changed:e46e34c0-a202-40e2-b74d-93cf2fca0962 for instance eb2d22d5-8fc4-4a1a-a2ac-d54318936f21 on n-h1-861333-8 Oct 19 03:25:02.041551 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-5be7bde6-7ca5-433e-983a-0a722d894bbe req-a02343f7-5d3f-4257-96e9-22da2b08ba98 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030541 Oct 19 03:25:02.042897 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1512/2961] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:25:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:25:02.048151 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b12b4bcf-7404-41f4-ae91-7714f75c304d tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:02.048841 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b12b4bcf-7404-41f4-ae91-7714f75c304d tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: e5093d9e-cd31-4074-b339-828de5892bd1] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:02.055003 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b12b4bcf-7404-41f4-ae91-7714f75c304d tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:02.055483 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b12b4bcf-7404-41f4-ae91-7714f75c304d tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:02.055920 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b12b4bcf-7404-41f4-ae91-7714f75c304d tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:02.056600 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b12b4bcf-7404-41f4-ae91-7714f75c304d tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:02.057270 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b12b4bcf-7404-41f4-ae91-7714f75c304d tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:02.057587 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b12b4bcf-7404-41f4-ae91-7714f75c304d tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:02.167224 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b2f1fa95-4036-4009-8d0b-ba51924fcf8b tempest-ListImageFiltersTestJSON-1015938331 tempest-ListImageFiltersTestJSON-1015938331-project] 10.222.0.52 "DELETE /compute/v2.1/images/d9356c75-0c08-4bdf-b70b-4333c3e8f2e9" status: 204 len: 0 microversion: 2.1 time: 0.603505 Oct 19 03:25:02.168575 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1450/2962] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:01 2022] DELETE /compute/v2.1/images/d9356c75-0c08-4bdf-b70b-4333c3e8f2e9 => generated 0 bytes in 606 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 19 03:25:02.197829 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b12b4bcf-7404-41f4-ae91-7714f75c304d tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:02.206144 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b12b4bcf-7404-41f4-ae91-7714f75c304d tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/e5093d9e-cd31-4074-b339-828de5892bd1" status: 200 len: 1308 microversion: 2.1 time: 0.161892 Oct 19 03:25:02.206850 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1513/2963] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:02 2022] GET /compute/v2.1/servers/e5093d9e-cd31-4074-b339-828de5892bd1 => generated 1308 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:02.228049 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-cde2b49b-ea4c-4ee2-900e-a6d14f3c18e3 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:02.228792 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-cde2b49b-ea4c-4ee2-900e-a6d14f3c18e3 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] [instance: cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:02.235578 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cde2b49b-ea4c-4ee2-900e-a6d14f3c18e3 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:02.240122 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cde2b49b-ea4c-4ee2-900e-a6d14f3c18e3 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:02.240122 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cde2b49b-ea4c-4ee2-900e-a6d14f3c18e3 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:02.240122 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cde2b49b-ea4c-4ee2-900e-a6d14f3c18e3 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:02.240122 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cde2b49b-ea4c-4ee2-900e-a6d14f3c18e3 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:02.240474 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cde2b49b-ea4c-4ee2-900e-a6d14f3c18e3 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:02.426924 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-cde2b49b-ea4c-4ee2-900e-a6d14f3c18e3 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:02.439053 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-cde2b49b-ea4c-4ee2-900e-a6d14f3c18e3 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:02.457616 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-cde2b49b-ea4c-4ee2-900e-a6d14f3c18e3 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:02.457616 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-cde2b49b-ea4c-4ee2-900e-a6d14f3c18e3 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] 10.222.0.52 "GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95" status: 200 len: 1879 microversion: 2.42 time: 0.217743 Oct 19 03:25:02.457616 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1451/2964] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:25:02 2022] GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 => generated 1879 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:25:02.458086 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-8bac3f29-fa76-4678-b921-61d943e5d149 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:02.458086 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-8bac3f29-fa76-4678-b921-61d943e5d149 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] [instance: 333ed6dd-d020-4ef4-849c-956ed44cd18c] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:02.463128 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8bac3f29-fa76-4678-b921-61d943e5d149 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:02.463630 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8bac3f29-fa76-4678-b921-61d943e5d149 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:02.464077 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8bac3f29-fa76-4678-b921-61d943e5d149 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:02.465448 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8bac3f29-fa76-4678-b921-61d943e5d149 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:02.465911 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8bac3f29-fa76-4678-b921-61d943e5d149 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:02.466403 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8bac3f29-fa76-4678-b921-61d943e5d149 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:02.510588 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:25:02.619130 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-8bac3f29-fa76-4678-b921-61d943e5d149 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1fe2c1882341168e740e196b84ab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aa84ea2412a41d19901061f97068a00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:02.629121 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-8bac3f29-fa76-4678-b921-61d943e5d149 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] 10.222.0.52 "GET /compute/v2.1/servers/333ed6dd-d020-4ef4-849c-956ed44cd18c" status: 200 len: 1512 microversion: 2.1 time: 0.178316 Oct 19 03:25:02.630057 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1514/2965] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:02 2022] GET /compute/v2.1/servers/333ed6dd-d020-4ef4-849c-956ed44cd18c => generated 1512 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:02.648047 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7ed51239-0d0f-4ad0-ac41-e82f54eaddef tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:02.650456 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7ed51239-0d0f-4ad0-ac41-e82f54eaddef tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] [instance: 2870c53d-df7c-45d3-b8bd-c88966ad6315] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:02.657105 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7ed51239-0d0f-4ad0-ac41-e82f54eaddef tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:02.657922 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7ed51239-0d0f-4ad0-ac41-e82f54eaddef tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:02.658468 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7ed51239-0d0f-4ad0-ac41-e82f54eaddef tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:02.659296 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7ed51239-0d0f-4ad0-ac41-e82f54eaddef tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:02.659865 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7ed51239-0d0f-4ad0-ac41-e82f54eaddef tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:02.660376 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7ed51239-0d0f-4ad0-ac41-e82f54eaddef tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:02.866660 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-7ed51239-0d0f-4ad0-ac41-e82f54eaddef tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bf143866aa44afb11285d61ffd7ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bf79842c02480eb1e91d521226d317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:02.881195 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7ed51239-0d0f-4ad0-ac41-e82f54eaddef tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] 10.222.0.52 "GET /compute/v2.1/servers/2870c53d-df7c-45d3-b8bd-c88966ad6315" status: 200 len: 1370 microversion: 2.1 time: 0.237962 Oct 19 03:25:02.882369 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1452/2966] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:02 2022] GET /compute/v2.1/servers/2870c53d-df7c-45d3-b8bd-c88966ad6315 => generated 1370 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:02.949481 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f363b631-6908-4c44-a298-577eb5b13dc5 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:02.950691 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f363b631-6908-4c44-a298-577eb5b13dc5 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: eb2d22d5-8fc4-4a1a-a2ac-d54318936f21] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:02.959924 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f363b631-6908-4c44-a298-577eb5b13dc5 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:02.964174 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f363b631-6908-4c44-a298-577eb5b13dc5 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:02.964174 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f363b631-6908-4c44-a298-577eb5b13dc5 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:02.964174 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f363b631-6908-4c44-a298-577eb5b13dc5 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:02.964174 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f363b631-6908-4c44-a298-577eb5b13dc5 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:02.964759 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f363b631-6908-4c44-a298-577eb5b13dc5 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:03.037511 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-101d4434-4641-4ba4-a095-2d0b086889c6 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:03.050297 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-101d4434-4641-4ba4-a095-2d0b086889c6 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:03.051782 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-101d4434-4641-4ba4-a095-2d0b086889c6 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:03.052456 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-101d4434-4641-4ba4-a095-2d0b086889c6 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:03.053112 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-101d4434-4641-4ba4-a095-2d0b086889c6 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:03.054117 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-101d4434-4641-4ba4-a095-2d0b086889c6 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:03.054657 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-101d4434-4641-4ba4-a095-2d0b086889c6 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:03.055172 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-101d4434-4641-4ba4-a095-2d0b086889c6 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:03.157305 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-101d4434-4641-4ba4-a095-2d0b086889c6 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:03.169430 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-101d4434-4641-4ba4-a095-2d0b086889c6 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6" status: 200 len: 1281 microversion: 2.1 time: 0.140140 Oct 19 03:25:03.177597 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1453/2967] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:03 2022] GET /compute/v2.1/servers/25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6 => generated 1281 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:25:03.231745 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9d28bcfe-b3fd-49ba-bafe-7e5e68af486b tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:03.233658 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9d28bcfe-b3fd-49ba-bafe-7e5e68af486b tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: e5093d9e-cd31-4074-b339-828de5892bd1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:03.235358 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f363b631-6908-4c44-a298-577eb5b13dc5 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:03.241688 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9d28bcfe-b3fd-49ba-bafe-7e5e68af486b tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:03.244608 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9d28bcfe-b3fd-49ba-bafe-7e5e68af486b tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:03.244745 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=100 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:25:03.244861 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9d28bcfe-b3fd-49ba-bafe-7e5e68af486b tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:03.244861 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9d28bcfe-b3fd-49ba-bafe-7e5e68af486b tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:03.244861 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9d28bcfe-b3fd-49ba-bafe-7e5e68af486b tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:03.246036 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9d28bcfe-b3fd-49ba-bafe-7e5e68af486b tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:03.253964 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f363b631-6908-4c44-a298-577eb5b13dc5 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/eb2d22d5-8fc4-4a1a-a2ac-d54318936f21" status: 200 len: 1293 microversion: 2.1 time: 0.304725 Oct 19 03:25:03.255185 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1515/2968] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:02 2022] GET /compute/v2.1/servers/eb2d22d5-8fc4-4a1a-a2ac-d54318936f21 => generated 1293 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:03.260041 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-df785947-96f7-48ac-b446-b3ccdcd8ca83 req-36810271-d4d7-447b-b101-bd2c952cb318 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95", "name": "network-vif-plugged", "status": "completed", "tag": "475eb265-32ca-40db-846e-3d83be38943b"}, {"server_uuid": "cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95", "name": "network-vif-plugged", "status": "completed", "tag": "7131b08f-dd0e-40a5-b85e-19128faf4efc"}, {"server_uuid": "2870c53d-df7c-45d3-b8bd-c88966ad6315", "name": "network-vif-plugged", "status": "completed", "tag": "4438c03f-7c43-41c1-aadf-24b917ab0a59"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:25:03.276205 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-df785947-96f7-48ac-b446-b3ccdcd8ca83 req-36810271-d4d7-447b-b101-bd2c952cb318 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:03.277050 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-df785947-96f7-48ac-b446-b3ccdcd8ca83 req-36810271-d4d7-447b-b101-bd2c952cb318 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:03.277763 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-df785947-96f7-48ac-b446-b3ccdcd8ca83 req-36810271-d4d7-447b-b101-bd2c952cb318 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:03.295865 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-df785947-96f7-48ac-b446-b3ccdcd8ca83 req-36810271-d4d7-447b-b101-bd2c952cb318 service nova] Creating event network-vif-plugged:475eb265-32ca-40db-846e-3d83be38943b for instance cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 on n-h2-861333-8 Oct 19 03:25:03.296758 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-df785947-96f7-48ac-b446-b3ccdcd8ca83 req-36810271-d4d7-447b-b101-bd2c952cb318 service nova] Creating event network-vif-plugged:7131b08f-dd0e-40a5-b85e-19128faf4efc for instance cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 on n-h2-861333-8 Oct 19 03:25:03.297724 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-df785947-96f7-48ac-b446-b3ccdcd8ca83 req-36810271-d4d7-447b-b101-bd2c952cb318 service nova] Creating event network-vif-plugged:4438c03f-7c43-41c1-aadf-24b917ab0a59 for instance 2870c53d-df7c-45d3-b8bd-c88966ad6315 on n-h1-861333-8 Oct 19 03:25:03.312761 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-df785947-96f7-48ac-b446-b3ccdcd8ca83 req-36810271-d4d7-447b-b101-bd2c952cb318 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.056008 Oct 19 03:25:03.313476 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1516/2969] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:25:03 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:25:03.470821 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3cca1773-dfbf-435e-9c6a-555b16fc66c3 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:03.471701 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-3cca1773-dfbf-435e-9c6a-555b16fc66c3 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] [instance: cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:03.480936 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3cca1773-dfbf-435e-9c6a-555b16fc66c3 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:03.481610 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3cca1773-dfbf-435e-9c6a-555b16fc66c3 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:03.482394 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3cca1773-dfbf-435e-9c6a-555b16fc66c3 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:03.483221 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3cca1773-dfbf-435e-9c6a-555b16fc66c3 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:03.483787 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3cca1773-dfbf-435e-9c6a-555b16fc66c3 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:03.484460 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3cca1773-dfbf-435e-9c6a-555b16fc66c3 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:03.488167 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9d28bcfe-b3fd-49ba-bafe-7e5e68af486b tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:03.500281 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9d28bcfe-b3fd-49ba-bafe-7e5e68af486b tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/e5093d9e-cd31-4074-b339-828de5892bd1" status: 200 len: 1308 microversion: 2.1 time: 0.274345 Oct 19 03:25:03.503417 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1454/2970] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:03 2022] GET /compute/v2.1/servers/e5093d9e-cd31-4074-b339-828de5892bd1 => generated 1308 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:25:03.655843 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ce5a5fd0-faab-4dff-a429-82fe970b9fd0 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:03.656363 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ce5a5fd0-faab-4dff-a429-82fe970b9fd0 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] [instance: 333ed6dd-d020-4ef4-849c-956ed44cd18c] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:03.665277 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ce5a5fd0-faab-4dff-a429-82fe970b9fd0 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:03.666117 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ce5a5fd0-faab-4dff-a429-82fe970b9fd0 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:03.666898 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ce5a5fd0-faab-4dff-a429-82fe970b9fd0 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:03.668308 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ce5a5fd0-faab-4dff-a429-82fe970b9fd0 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:03.670046 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ce5a5fd0-faab-4dff-a429-82fe970b9fd0 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:03.670634 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ce5a5fd0-faab-4dff-a429-82fe970b9fd0 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:03.820855 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ce5a5fd0-faab-4dff-a429-82fe970b9fd0 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1fe2c1882341168e740e196b84ab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aa84ea2412a41d19901061f97068a00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:03.831982 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ce5a5fd0-faab-4dff-a429-82fe970b9fd0 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] 10.222.0.52 "GET /compute/v2.1/servers/333ed6dd-d020-4ef4-849c-956ed44cd18c" status: 200 len: 1470 microversion: 2.1 time: 0.182093 Oct 19 03:25:03.833226 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1455/2971] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:03 2022] GET /compute/v2.1/servers/333ed6dd-d020-4ef4-849c-956ed44cd18c => generated 1470 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:03.838333 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-46effa9a-e5a3-48e6-a259-af68389826eb req-9a5a064b-79a4-40f6-bfc8-99dbc76a944b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "333ed6dd-d020-4ef4-849c-956ed44cd18c", "name": "network-vif-deleted", "tag": "4c4afe41-1ec7-44c2-915b-bd1b7979020e"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:25:03.848937 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-46effa9a-e5a3-48e6-a259-af68389826eb req-9a5a064b-79a4-40f6-bfc8-99dbc76a944b service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:03.849313 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-46effa9a-e5a3-48e6-a259-af68389826eb req-9a5a064b-79a4-40f6-bfc8-99dbc76a944b service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:03.849772 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-46effa9a-e5a3-48e6-a259-af68389826eb req-9a5a064b-79a4-40f6-bfc8-99dbc76a944b service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:03.867312 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-46effa9a-e5a3-48e6-a259-af68389826eb req-9a5a064b-79a4-40f6-bfc8-99dbc76a944b service nova] Creating event network-vif-deleted:4c4afe41-1ec7-44c2-915b-bd1b7979020e for instance 333ed6dd-d020-4ef4-849c-956ed44cd18c on n-h1-861333-8 Oct 19 03:25:03.875896 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-46effa9a-e5a3-48e6-a259-af68389826eb req-9a5a064b-79a4-40f6-bfc8-99dbc76a944b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041059 Oct 19 03:25:03.877089 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1456/2972] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:25:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:25:03.885246 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-3cca1773-dfbf-435e-9c6a-555b16fc66c3 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:03.896539 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-3cca1773-dfbf-435e-9c6a-555b16fc66c3 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:03.898360 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-3cca1773-dfbf-435e-9c6a-555b16fc66c3 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:03.899391 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-3cca1773-dfbf-435e-9c6a-555b16fc66c3 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] 10.222.0.52 "GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95" status: 200 len: 1879 microversion: 2.42 time: 0.433517 Oct 19 03:25:03.904250 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1517/2973] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:25:03 2022] GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 => generated 1879 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:25:03.912804 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-df10493f-9fc0-4505-accd-169aa0edfaea tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:03.913693 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-df10493f-9fc0-4505-accd-169aa0edfaea tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] [instance: 2870c53d-df7c-45d3-b8bd-c88966ad6315] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:03.924699 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-df10493f-9fc0-4505-accd-169aa0edfaea tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:03.925244 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-df10493f-9fc0-4505-accd-169aa0edfaea tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:03.925883 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-df10493f-9fc0-4505-accd-169aa0edfaea tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:03.926512 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-df10493f-9fc0-4505-accd-169aa0edfaea tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:03.927006 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-df10493f-9fc0-4505-accd-169aa0edfaea tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:03.927437 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-df10493f-9fc0-4505-accd-169aa0edfaea tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:03.932449 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:25:04.073220 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-df10493f-9fc0-4505-accd-169aa0edfaea tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bf143866aa44afb11285d61ffd7ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bf79842c02480eb1e91d521226d317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:04.083104 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-df10493f-9fc0-4505-accd-169aa0edfaea tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] 10.222.0.52 "GET /compute/v2.1/servers/2870c53d-df7c-45d3-b8bd-c88966ad6315" status: 200 len: 1370 microversion: 2.1 time: 0.176495 Oct 19 03:25:04.088596 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1457/2974] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:03 2022] GET /compute/v2.1/servers/2870c53d-df7c-45d3-b8bd-c88966ad6315 => generated 1370 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:04.194731 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0a2201e7-cf20-403c-8c45-79610dbeafcb tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:04.195425 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0a2201e7-cf20-403c-8c45-79610dbeafcb tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:04.202459 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0a2201e7-cf20-403c-8c45-79610dbeafcb tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:04.203031 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0a2201e7-cf20-403c-8c45-79610dbeafcb tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:04.203702 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0a2201e7-cf20-403c-8c45-79610dbeafcb tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:04.204687 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0a2201e7-cf20-403c-8c45-79610dbeafcb tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:04.205223 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0a2201e7-cf20-403c-8c45-79610dbeafcb tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:04.206101 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0a2201e7-cf20-403c-8c45-79610dbeafcb tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:04.274734 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-0a2201e7-cf20-403c-8c45-79610dbeafcb tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:04.285991 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0a2201e7-cf20-403c-8c45-79610dbeafcb tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6" status: 200 len: 1269 microversion: 2.1 time: 0.095412 Oct 19 03:25:04.286371 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-aa751059-c8ea-4018-95ff-f1d384a8bf04 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:04.286971 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-aa751059-c8ea-4018-95ff-f1d384a8bf04 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: eb2d22d5-8fc4-4a1a-a2ac-d54318936f21] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:04.297203 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1518/2975] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:04 2022] GET /compute/v2.1/servers/25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6 => generated 1269 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:04.298497 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-aa751059-c8ea-4018-95ff-f1d384a8bf04 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:04.299161 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-aa751059-c8ea-4018-95ff-f1d384a8bf04 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:04.299768 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-aa751059-c8ea-4018-95ff-f1d384a8bf04 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:04.300548 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-aa751059-c8ea-4018-95ff-f1d384a8bf04 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:04.301012 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-aa751059-c8ea-4018-95ff-f1d384a8bf04 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:04.301586 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-aa751059-c8ea-4018-95ff-f1d384a8bf04 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:04.447599 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-aa751059-c8ea-4018-95ff-f1d384a8bf04 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:04.462267 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-aa751059-c8ea-4018-95ff-f1d384a8bf04 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/eb2d22d5-8fc4-4a1a-a2ac-d54318936f21" status: 200 len: 1293 microversion: 2.1 time: 0.181685 Oct 19 03:25:04.463340 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1458/2976] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:04 2022] GET /compute/v2.1/servers/eb2d22d5-8fc4-4a1a-a2ac-d54318936f21 => generated 1293 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:25:04.497965 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-c602198c-1a7d-4e56-b0f7-ad8e3f17b4cd req-3eb8e63b-2d88-46e6-b7f9-18d441e508c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5093d9e-cd31-4074-b339-828de5892bd1", "tag": "8014cea8-dac9-42ee-b483-a953805bdcd0"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:25:04.509040 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-c602198c-1a7d-4e56-b0f7-ad8e3f17b4cd req-3eb8e63b-2d88-46e6-b7f9-18d441e508c6 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:04.509806 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-c602198c-1a7d-4e56-b0f7-ad8e3f17b4cd req-3eb8e63b-2d88-46e6-b7f9-18d441e508c6 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:04.510399 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-c602198c-1a7d-4e56-b0f7-ad8e3f17b4cd req-3eb8e63b-2d88-46e6-b7f9-18d441e508c6 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:04.525434 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6dbbd252-7dfc-4ae5-a9ef-2edb87495324 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:04.527247 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-c602198c-1a7d-4e56-b0f7-ad8e3f17b4cd req-3eb8e63b-2d88-46e6-b7f9-18d441e508c6 service nova] Creating event network-changed:8014cea8-dac9-42ee-b483-a953805bdcd0 for instance e5093d9e-cd31-4074-b339-828de5892bd1 on n-h1-861333-8 Oct 19 03:25:04.534644 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6dbbd252-7dfc-4ae5-a9ef-2edb87495324 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: e5093d9e-cd31-4074-b339-828de5892bd1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:04.536139 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-c602198c-1a7d-4e56-b0f7-ad8e3f17b4cd req-3eb8e63b-2d88-46e6-b7f9-18d441e508c6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042608 Oct 19 03:25:04.537795 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1519/2977] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:25:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:25:04.546334 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6dbbd252-7dfc-4ae5-a9ef-2edb87495324 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:04.547172 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6dbbd252-7dfc-4ae5-a9ef-2edb87495324 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:04.547945 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6dbbd252-7dfc-4ae5-a9ef-2edb87495324 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:04.548910 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6dbbd252-7dfc-4ae5-a9ef-2edb87495324 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:04.549608 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6dbbd252-7dfc-4ae5-a9ef-2edb87495324 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:04.550720 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6dbbd252-7dfc-4ae5-a9ef-2edb87495324 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:04.858252 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a5433c37-1c75-4e95-b0a9-52549b524556 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:04.859205 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a5433c37-1c75-4e95-b0a9-52549b524556 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] [instance: 333ed6dd-d020-4ef4-849c-956ed44cd18c] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:04.869324 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a5433c37-1c75-4e95-b0a9-52549b524556 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:04.870196 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a5433c37-1c75-4e95-b0a9-52549b524556 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:04.871607 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a5433c37-1c75-4e95-b0a9-52549b524556 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:04.872651 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a5433c37-1c75-4e95-b0a9-52549b524556 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:04.873514 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a5433c37-1c75-4e95-b0a9-52549b524556 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:04.874178 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a5433c37-1c75-4e95-b0a9-52549b524556 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:05.054740 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a5433c37-1c75-4e95-b0a9-52549b524556 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1fe2c1882341168e740e196b84ab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aa84ea2412a41d19901061f97068a00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:05.064195 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a5433c37-1c75-4e95-b0a9-52549b524556 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] 10.222.0.52 "GET /compute/v2.1/servers/333ed6dd-d020-4ef4-849c-956ed44cd18c" status: 200 len: 1302 microversion: 2.1 time: 0.211552 Oct 19 03:25:05.064786 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1520/2978] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:04 2022] GET /compute/v2.1/servers/333ed6dd-d020-4ef4-849c-956ed44cd18c => generated 1302 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:25:05.069841 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4178b56b-75ce-483b-b5e1-5970666b78de tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:05.071297 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4178b56b-75ce-483b-b5e1-5970666b78de tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] [instance: cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:05.077872 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4178b56b-75ce-483b-b5e1-5970666b78de tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:05.078649 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4178b56b-75ce-483b-b5e1-5970666b78de tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:05.079316 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4178b56b-75ce-483b-b5e1-5970666b78de tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:05.080220 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4178b56b-75ce-483b-b5e1-5970666b78de tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:05.081009 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4178b56b-75ce-483b-b5e1-5970666b78de tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:05.081491 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4178b56b-75ce-483b-b5e1-5970666b78de tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:05.088505 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-6dbbd252-7dfc-4ae5-a9ef-2edb87495324 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:05.098909 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6dbbd252-7dfc-4ae5-a9ef-2edb87495324 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/e5093d9e-cd31-4074-b339-828de5892bd1" status: 200 len: 1308 microversion: 2.1 time: 0.577724 Oct 19 03:25:05.107711 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1459/2979] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:04 2022] GET /compute/v2.1/servers/e5093d9e-cd31-4074-b339-828de5892bd1 => generated 1308 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:25:05.263606 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3db3042f-168f-4beb-9282-2df621c58b42 tempest-KeyPairsV22TestJSON-1557952363 tempest-KeyPairsV22TestJSON-1557952363-project] Action: 'create', calling method: .version_select at 0x7fc130cbed30>, body: {"keypair": {"name": "tempest-keypair-1719113373", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLux39DJKP7TtwAnSfbk3132+kpV4l69KkKX1QIAJ76W+cJT71wH2L1uZlseZ3uIyzJ45ZGo1xXSHQbgFHjRwKKsCbD1vmADXo2UWGx68NVZ6rWZRpG6hvinlVeAWVSNlg=="}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:25:05.282523 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-3db3042f-168f-4beb-9282-2df621c58b42 tempest-KeyPairsV22TestJSON-1557952363 tempest-KeyPairsV22TestJSON-1557952363-project] Getting quotas for project 3b74fc0611da45ff9895350d1b0454d9. Resources: {'key_pairs'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:25:05.288287 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-3db3042f-168f-4beb-9282-2df621c58b42 tempest-KeyPairsV22TestJSON-1557952363 tempest-KeyPairsV22TestJSON-1557952363-project] Getting quotas for user fdf3191958ac4bf2acbae445fcbf68db and project 3b74fc0611da45ff9895350d1b0454d9. Resources: {'key_pairs'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:25:05.326875 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4178b56b-75ce-483b-b5e1-5970666b78de tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:05.336221 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4178b56b-75ce-483b-b5e1-5970666b78de tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:05.338123 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4178b56b-75ce-483b-b5e1-5970666b78de tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:05.339884 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4178b56b-75ce-483b-b5e1-5970666b78de tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] 10.222.0.52 "GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95" status: 200 len: 1879 microversion: 2.42 time: 0.273280 Oct 19 03:25:05.340458 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1521/2980] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:25:05 2022] GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 => generated 1879 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:25:05.345264 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-27085752-114c-4595-90fb-4599bcac584a tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:05.345928 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-27085752-114c-4595-90fb-4599bcac584a tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] [instance: 2870c53d-df7c-45d3-b8bd-c88966ad6315] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:05.352059 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-27085752-114c-4595-90fb-4599bcac584a tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:05.352552 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-27085752-114c-4595-90fb-4599bcac584a tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:05.353057 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-27085752-114c-4595-90fb-4599bcac584a tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:05.353795 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-27085752-114c-4595-90fb-4599bcac584a tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:05.354310 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-27085752-114c-4595-90fb-4599bcac584a tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:05.355561 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-27085752-114c-4595-90fb-4599bcac584a tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:05.440143 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3db3042f-168f-4beb-9282-2df621c58b42 tempest-KeyPairsV22TestJSON-1557952363 tempest-KeyPairsV22TestJSON-1557952363-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.329150 Oct 19 03:25:05.441559 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1460/2981] 10.222.0.52 () {62 vars in 1199 bytes} [Wed Oct 19 03:25:05 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 332 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 19 03:25:05.448119 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-74cf21d2-e188-4bc0-8c66-7d89ede4566d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:05.449525 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-74cf21d2-e188-4bc0-8c66-7d89ede4566d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:05.461059 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-74cf21d2-e188-4bc0-8c66-7d89ede4566d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:05.462350 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-74cf21d2-e188-4bc0-8c66-7d89ede4566d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:05.467646 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-74cf21d2-e188-4bc0-8c66-7d89ede4566d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:05.468011 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-74cf21d2-e188-4bc0-8c66-7d89ede4566d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:05.468770 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-74cf21d2-e188-4bc0-8c66-7d89ede4566d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:05.469433 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-74cf21d2-e188-4bc0-8c66-7d89ede4566d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:05.601799 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-27085752-114c-4595-90fb-4599bcac584a tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bf143866aa44afb11285d61ffd7ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bf79842c02480eb1e91d521226d317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:05.609829 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-27085752-114c-4595-90fb-4599bcac584a tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] 10.222.0.52 "GET /compute/v2.1/servers/2870c53d-df7c-45d3-b8bd-c88966ad6315" status: 200 len: 1370 microversion: 2.1 time: 0.267993 Oct 19 03:25:05.610405 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1522/2982] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:05 2022] GET /compute/v2.1/servers/2870c53d-df7c-45d3-b8bd-c88966ad6315 => generated 1370 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:05.631145 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-17407c93-7562-4c2b-9f95-ad12a326c7cd tempest-KeyPairsV22TestJSON-1557952363 tempest-KeyPairsV22TestJSON-1557952363-project] Calling method '.version_select at 0x7fc12bff7040>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:05.641927 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-17407c93-7562-4c2b-9f95-ad12a326c7cd tempest-KeyPairsV22TestJSON-1557952363 tempest-KeyPairsV22TestJSON-1557952363-project] 10.222.0.52 "GET /compute/v2.1/os-keypairs/tempest-keypair-1719113373" status: 200 len: 513 microversion: 2.2 time: 0.014220 Oct 19 03:25:05.642741 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1523/2983] 10.222.0.52 () {60 vars in 1258 bytes} [Wed Oct 19 03:25:05 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1719113373 => generated 513 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:25:05.651311 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0a90a0fc-e044-4b9a-aa93-8af5452d5601 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:05.652792 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0a90a0fc-e044-4b9a-aa93-8af5452d5601 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: eb2d22d5-8fc4-4a1a-a2ac-d54318936f21] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:05.656849 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:25:05.661881 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0a90a0fc-e044-4b9a-aa93-8af5452d5601 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:05.662442 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0a90a0fc-e044-4b9a-aa93-8af5452d5601 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:05.662891 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0a90a0fc-e044-4b9a-aa93-8af5452d5601 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:05.663813 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0a90a0fc-e044-4b9a-aa93-8af5452d5601 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:05.664468 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0a90a0fc-e044-4b9a-aa93-8af5452d5601 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:05.664906 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0a90a0fc-e044-4b9a-aa93-8af5452d5601 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:05.686177 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-74cf21d2-e188-4bc0-8c66-7d89ede4566d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:05.693733 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-74cf21d2-e188-4bc0-8c66-7d89ede4566d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6" status: 200 len: 1311 microversion: 2.1 time: 0.250611 Oct 19 03:25:05.694349 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1461/2984] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:05 2022] GET /compute/v2.1/servers/25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6 => generated 1311 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:05.699490 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-466dfdb2-64d7-41f2-8358-ed59131d8e3a tempest-KeyPairsV22TestJSON-1557952363 tempest-KeyPairsV22TestJSON-1557952363-project] Calling method '.version_select at 0x7fc1312473a0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:05.804577 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-0a90a0fc-e044-4b9a-aa93-8af5452d5601 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:05.810083 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-466dfdb2-64d7-41f2-8358-ed59131d8e3a tempest-KeyPairsV22TestJSON-1557952363 tempest-KeyPairsV22TestJSON-1557952363-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1719113373" status: 204 len: 0 microversion: 2.2 time: 0.114656 Oct 19 03:25:05.810785 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1462/2985] 10.222.0.52 () {60 vars in 1261 bytes} [Wed Oct 19 03:25:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1719113373 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:25:05.814298 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0a90a0fc-e044-4b9a-aa93-8af5452d5601 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/eb2d22d5-8fc4-4a1a-a2ac-d54318936f21" status: 200 len: 1293 microversion: 2.1 time: 0.170251 Oct 19 03:25:05.815065 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1524/2986] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:05 2022] GET /compute/v2.1/servers/eb2d22d5-8fc4-4a1a-a2ac-d54318936f21 => generated 1293 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:05.828363 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7be654fa-4c03-409e-aef5-79efd9555ea2 tempest-KeyPairsV22TestJSON-1557952363 tempest-KeyPairsV22TestJSON-1557952363-project] Action: 'create', calling method: .version_select at 0x7fc130d10160>, body: {"keypair": {"name": "tempest-keypair-1475851455", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBk5FyhUm6/h+6h79Rl4yIiEbC+pTzz5oUzf4SvQDjT75P+ebL88ihPMTe1D+St2g+ivas+R+oNWF6WWQWSvMSMCa31pyfAfLh+NMngvUheF4NofXJ3ltSL3tV6kez4wwA=="}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:25:05.847412 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-7be654fa-4c03-409e-aef5-79efd9555ea2 tempest-KeyPairsV22TestJSON-1557952363 tempest-KeyPairsV22TestJSON-1557952363-project] Getting quotas for project 3b74fc0611da45ff9895350d1b0454d9. Resources: {'key_pairs'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:25:05.853592 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-7be654fa-4c03-409e-aef5-79efd9555ea2 tempest-KeyPairsV22TestJSON-1557952363 tempest-KeyPairsV22TestJSON-1557952363-project] Getting quotas for user fdf3191958ac4bf2acbae445fcbf68db and project 3b74fc0611da45ff9895350d1b0454d9. Resources: {'key_pairs'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:25:06.011960 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7be654fa-4c03-409e-aef5-79efd9555ea2 tempest-KeyPairsV22TestJSON-1557952363 tempest-KeyPairsV22TestJSON-1557952363-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.189241 Oct 19 03:25:06.012692 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1463/2987] 10.222.0.52 () {62 vars in 1199 bytes} [Wed Oct 19 03:25:05 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 191 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 19 03:25:06.024071 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-06af2e2e-cb96-440c-b688-9a0f15e2808c tempest-KeyPairsV22TestJSON-1557952363 tempest-KeyPairsV22TestJSON-1557952363-project] Calling method '.version_select at 0x7fc12bff7f70>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:06.087411 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-58447bd3-330e-4238-9590-356c3807454b tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:06.088035 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-58447bd3-330e-4238-9590-356c3807454b tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] [instance: 333ed6dd-d020-4ef4-849c-956ed44cd18c] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:06.094181 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-58447bd3-330e-4238-9590-356c3807454b tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:06.094788 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-58447bd3-330e-4238-9590-356c3807454b tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:06.095145 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-58447bd3-330e-4238-9590-356c3807454b tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:06.095848 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-58447bd3-330e-4238-9590-356c3807454b tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:06.096304 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-58447bd3-330e-4238-9590-356c3807454b tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:06.096736 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-58447bd3-330e-4238-9590-356c3807454b tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:06.129495 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-58447bd3-330e-4238-9590-356c3807454b tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:06.130007 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-58447bd3-330e-4238-9590-356c3807454b tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:06.130458 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-58447bd3-330e-4238-9590-356c3807454b tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:06.130950 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-58447bd3-330e-4238-9590-356c3807454b tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Lazy-loading 'fault' on Instance uuid 333ed6dd-d020-4ef4-849c-956ed44cd18c {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:25:06.135808 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-06af2e2e-cb96-440c-b688-9a0f15e2808c tempest-KeyPairsV22TestJSON-1557952363 tempest-KeyPairsV22TestJSON-1557952363-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1475851455" status: 204 len: 0 microversion: 2.2 time: 0.115633 Oct 19 03:25:06.136977 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1525/2988] 10.222.0.52 () {60 vars in 1261 bytes} [Wed Oct 19 03:25:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1475851455 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:25:06.143040 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4235f53c-f09e-45a2-937b-e52816643ef2 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:06.143660 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4235f53c-f09e-45a2-937b-e52816643ef2 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: e5093d9e-cd31-4074-b339-828de5892bd1] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:06.150681 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4235f53c-f09e-45a2-937b-e52816643ef2 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:06.151174 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4235f53c-f09e-45a2-937b-e52816643ef2 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:06.151990 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4235f53c-f09e-45a2-937b-e52816643ef2 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:06.152695 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4235f53c-f09e-45a2-937b-e52816643ef2 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:06.153153 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4235f53c-f09e-45a2-937b-e52816643ef2 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:06.153614 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4235f53c-f09e-45a2-937b-e52816643ef2 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:06.179151 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-58447bd3-330e-4238-9590-356c3807454b tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1fe2c1882341168e740e196b84ab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aa84ea2412a41d19901061f97068a00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:06.187829 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-58447bd3-330e-4238-9590-356c3807454b tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] 10.222.0.52 "GET /compute/v2.1/servers/333ed6dd-d020-4ef4-849c-956ed44cd18c" status: 200 len: 1307 microversion: 2.1 time: 0.104590 Oct 19 03:25:06.188409 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1464/2989] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:06 2022] GET /compute/v2.1/servers/333ed6dd-d020-4ef4-849c-956ed44cd18c => generated 1307 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:25:06.192971 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8006cf6e-915a-4097-8454-74e188d196d4 tempest-KeyPairsV22TestJSON-1557952363 tempest-KeyPairsV22TestJSON-1557952363-project] Action: 'create', calling method: .version_select at 0x7fc130d101f0>, body: {"keypair": {"name": "tempest-keypair-50841918", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:25:06.211646 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-8006cf6e-915a-4097-8454-74e188d196d4 tempest-KeyPairsV22TestJSON-1557952363 tempest-KeyPairsV22TestJSON-1557952363-project] Getting quotas for project 3b74fc0611da45ff9895350d1b0454d9. Resources: {'key_pairs'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:25:06.216863 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-8006cf6e-915a-4097-8454-74e188d196d4 tempest-KeyPairsV22TestJSON-1557952363 tempest-KeyPairsV22TestJSON-1557952363-project] Getting quotas for user fdf3191958ac4bf2acbae445fcbf68db and project 3b74fc0611da45ff9895350d1b0454d9. Resources: {'key_pairs'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:25:06.288592 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4235f53c-f09e-45a2-937b-e52816643ef2 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:06.297256 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4235f53c-f09e-45a2-937b-e52816643ef2 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/e5093d9e-cd31-4074-b339-828de5892bd1" status: 200 len: 1308 microversion: 2.1 time: 0.158903 Oct 19 03:25:06.297959 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1526/2990] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:06 2022] GET /compute/v2.1/servers/e5093d9e-cd31-4074-b339-828de5892bd1 => generated 1308 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:06.358824 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8006cf6e-915a-4097-8454-74e188d196d4 tempest-KeyPairsV22TestJSON-1557952363 tempest-KeyPairsV22TestJSON-1557952363-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 587 microversion: 2.2 time: 0.169367 Oct 19 03:25:06.359603 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1465/2991] 10.222.0.52 () {62 vars in 1199 bytes} [Wed Oct 19 03:25:06 2022] POST /compute/v2.1/os-keypairs => generated 587 bytes in 171 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 19 03:25:06.367191 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4fe8fb9b-b159-4bbc-a6c8-03316a318d7c tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:06.367809 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4fe8fb9b-b159-4bbc-a6c8-03316a318d7c tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] [instance: cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:06.371390 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6b2203fb-083c-487e-847e-072323ab3b3f tempest-KeyPairsV22TestJSON-1557952363 tempest-KeyPairsV22TestJSON-1557952363-project] Calling method '.version_select at 0x7fc1302dee50>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:06.374375 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4fe8fb9b-b159-4bbc-a6c8-03316a318d7c tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:06.375130 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4fe8fb9b-b159-4bbc-a6c8-03316a318d7c tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:06.375823 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4fe8fb9b-b159-4bbc-a6c8-03316a318d7c tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:06.376845 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4fe8fb9b-b159-4bbc-a6c8-03316a318d7c tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:06.377303 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4fe8fb9b-b159-4bbc-a6c8-03316a318d7c tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:06.377764 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4fe8fb9b-b159-4bbc-a6c8-03316a318d7c tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:06.434408 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=6 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:25:06.493005 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6b2203fb-083c-487e-847e-072323ab3b3f tempest-KeyPairsV22TestJSON-1557952363 tempest-KeyPairsV22TestJSON-1557952363-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-50841918" status: 204 len: 0 microversion: 2.2 time: 0.126580 Oct 19 03:25:06.493632 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1466/2992] 10.222.0.52 () {60 vars in 1255 bytes} [Wed Oct 19 03:25:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-50841918 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 19 03:25:06.505927 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-918f4f67-eb36-4e78-bc43-73783a10a952 tempest-KeyPairsV22TestJSON-1557952363 tempest-KeyPairsV22TestJSON-1557952363-project] Action: 'create', calling method: .version_select at 0x7fc130cc4b80>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-927272547", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF4nbB4yTXn0sJ4SwFEr7Nmht9T3TWiw6Dwuq89s3BI+I5HlLQBZcma5x+wl48Vm2SgTaUwMoc5H/Zrv+fAdNL81ufFivk+apGEI9j/qKc2fquYzLyGRVmbjYtO9pQtf1Q=="}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:25:06.522266 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-918f4f67-eb36-4e78-bc43-73783a10a952 tempest-KeyPairsV22TestJSON-1557952363 tempest-KeyPairsV22TestJSON-1557952363-project] Getting quotas for project 3b74fc0611da45ff9895350d1b0454d9. Resources: {'key_pairs'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:25:06.528431 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-918f4f67-eb36-4e78-bc43-73783a10a952 tempest-KeyPairsV22TestJSON-1557952363 tempest-KeyPairsV22TestJSON-1557952363-project] Getting quotas for user fdf3191958ac4bf2acbae445fcbf68db and project 3b74fc0611da45ff9895350d1b0454d9. Resources: {'key_pairs'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:25:06.546044 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=4,nova_api:DELETE=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:25:06.568289 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4fe8fb9b-b159-4bbc-a6c8-03316a318d7c tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:06.618683 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4fe8fb9b-b159-4bbc-a6c8-03316a318d7c tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:06.620142 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4fe8fb9b-b159-4bbc-a6c8-03316a318d7c tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:06.621423 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4fe8fb9b-b159-4bbc-a6c8-03316a318d7c tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] 10.222.0.52 "GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95" status: 200 len: 2835 microversion: 2.42 time: 0.258448 Oct 19 03:25:06.621989 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1527/2993] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:25:06 2022] GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 => generated 2835 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:25:06.626545 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-00205242-c391-4574-a333-9ecaaec514bc req-9aaf770c-c9b5-495b-9491-7ebc921ded4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6", "tag": "b1a17f00-f144-4de3-b98d-df60b15d0f90"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:25:06.636274 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-00205242-c391-4574-a333-9ecaaec514bc req-9aaf770c-c9b5-495b-9491-7ebc921ded4c service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:06.636960 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-00205242-c391-4574-a333-9ecaaec514bc req-9aaf770c-c9b5-495b-9491-7ebc921ded4c service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:06.639070 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-00205242-c391-4574-a333-9ecaaec514bc req-9aaf770c-c9b5-495b-9491-7ebc921ded4c service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:06.649023 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-00205242-c391-4574-a333-9ecaaec514bc req-9aaf770c-c9b5-495b-9491-7ebc921ded4c service nova] Creating event network-changed:b1a17f00-f144-4de3-b98d-df60b15d0f90 for instance 25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6 on n-h1-861333-8 Oct 19 03:25:06.654818 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-00205242-c391-4574-a333-9ecaaec514bc req-9aaf770c-c9b5-495b-9491-7ebc921ded4c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031643 Oct 19 03:25:06.655411 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1528/2994] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:25:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:25:06.669765 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-86121bd8-ec6d-4480-bad4-d06598760192 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:06.669765 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-86121bd8-ec6d-4480-bad4-d06598760192 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] [instance: 2870c53d-df7c-45d3-b8bd-c88966ad6315] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:06.669765 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-86121bd8-ec6d-4480-bad4-d06598760192 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:06.669765 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-86121bd8-ec6d-4480-bad4-d06598760192 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:06.670127 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-86121bd8-ec6d-4480-bad4-d06598760192 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:06.670127 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-86121bd8-ec6d-4480-bad4-d06598760192 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:06.670127 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-86121bd8-ec6d-4480-bad4-d06598760192 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:06.670371 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-86121bd8-ec6d-4480-bad4-d06598760192 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:06.699508 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-918f4f67-eb36-4e78-bc43-73783a10a952 tempest-KeyPairsV22TestJSON-1557952363 tempest-KeyPairsV22TestJSON-1557952363-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.197390 Oct 19 03:25:06.700536 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1467/2995] 10.222.0.52 () {62 vars in 1199 bytes} [Wed Oct 19 03:25:06 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 199 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 19 03:25:06.705503 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b2f51fa3-00a0-493c-8aff-c5edfc00966d tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:06.706126 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b2f51fa3-00a0-493c-8aff-c5edfc00966d tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] [instance: cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:06.712510 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b2f51fa3-00a0-493c-8aff-c5edfc00966d tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:06.713078 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b2f51fa3-00a0-493c-8aff-c5edfc00966d tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:06.713627 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b2f51fa3-00a0-493c-8aff-c5edfc00966d tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:06.714934 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b2f51fa3-00a0-493c-8aff-c5edfc00966d tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:06.715437 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b2f51fa3-00a0-493c-8aff-c5edfc00966d tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:06.715932 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b2f51fa3-00a0-493c-8aff-c5edfc00966d tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:06.858657 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b2f51fa3-00a0-493c-8aff-c5edfc00966d tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] 10.222.0.52 "GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95/os-interface" status: 200 len: 1830 microversion: 2.42 time: 0.156922 Oct 19 03:25:06.859344 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1468/2996] 10.222.0.52 () {60 vars in 1316 bytes} [Wed Oct 19 03:25:06 2022] GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95/os-interface => generated 1830 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:25:06.864191 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-72d1109b-e1cf-4291-9714-a39d713d0f75 tempest-KeyPairsV22TestJSON-1557952363 tempest-KeyPairsV22TestJSON-1557952363-project] Action: 'create', calling method: .version_select at 0x7fc130d100d0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-27677715", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM1YS/mHBQ0bbpvC4oMoUVUtHZwWAM8buVEYIDD5HjagENDVZFbOyHsW43mHuY1N6Bl7/bL4PbIGmhWFtr8R+/CCDWFSfIjZI31eZGl1HC1NUFqWvEKs1KzmYAvis8rJ9Q=="}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:25:06.880337 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-72d1109b-e1cf-4291-9714-a39d713d0f75 tempest-KeyPairsV22TestJSON-1557952363 tempest-KeyPairsV22TestJSON-1557952363-project] Getting quotas for project 3b74fc0611da45ff9895350d1b0454d9. Resources: {'key_pairs'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:25:06.885763 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-72d1109b-e1cf-4291-9714-a39d713d0f75 tempest-KeyPairsV22TestJSON-1557952363 tempest-KeyPairsV22TestJSON-1557952363-project] Getting quotas for user fdf3191958ac4bf2acbae445fcbf68db and project 3b74fc0611da45ff9895350d1b0454d9. Resources: {'key_pairs'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:25:06.893056 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-86121bd8-ec6d-4480-bad4-d06598760192 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bf143866aa44afb11285d61ffd7ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bf79842c02480eb1e91d521226d317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:06.901952 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-86121bd8-ec6d-4480-bad4-d06598760192 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] 10.222.0.52 "GET /compute/v2.1/servers/2870c53d-df7c-45d3-b8bd-c88966ad6315" status: 200 len: 1556 microversion: 2.1 time: 0.244847 Oct 19 03:25:06.902802 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1529/2997] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:06 2022] GET /compute/v2.1/servers/2870c53d-df7c-45d3-b8bd-c88966ad6315 => generated 1556 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:06.920119 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d743d169-2060-4faf-aa67-5b37c5b070de tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:06.920950 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d743d169-2060-4faf-aa67-5b37c5b070de tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:06.926882 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d743d169-2060-4faf-aa67-5b37c5b070de tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:06.927373 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d743d169-2060-4faf-aa67-5b37c5b070de tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:06.927816 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d743d169-2060-4faf-aa67-5b37c5b070de tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:06.928517 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d743d169-2060-4faf-aa67-5b37c5b070de tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:06.929098 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d743d169-2060-4faf-aa67-5b37c5b070de tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:06.929481 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d743d169-2060-4faf-aa67-5b37c5b070de tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:06.965179 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-72d1109b-e1cf-4291-9714-a39d713d0f75 tempest-KeyPairsV22TestJSON-1557952363 tempest-KeyPairsV22TestJSON-1557952363-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 419 microversion: 2.2 time: 0.103945 Oct 19 03:25:06.966148 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1469/2998] 10.222.0.52 () {62 vars in 1199 bytes} [Wed Oct 19 03:25:06 2022] POST /compute/v2.1/os-keypairs => generated 419 bytes in 106 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 19 03:25:06.971128 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-58b7cd81-9aee-4bcf-86dd-a98874d73d31 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:06.974990 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-58b7cd81-9aee-4bcf-86dd-a98874d73d31 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: eb2d22d5-8fc4-4a1a-a2ac-d54318936f21] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:06.978481 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-58b7cd81-9aee-4bcf-86dd-a98874d73d31 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:06.979205 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-58b7cd81-9aee-4bcf-86dd-a98874d73d31 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:06.979801 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-58b7cd81-9aee-4bcf-86dd-a98874d73d31 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:06.980522 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-58b7cd81-9aee-4bcf-86dd-a98874d73d31 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:06.980986 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-58b7cd81-9aee-4bcf-86dd-a98874d73d31 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:06.981447 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-58b7cd81-9aee-4bcf-86dd-a98874d73d31 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:07.140459 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d743d169-2060-4faf-aa67-5b37c5b070de tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:07.149733 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d743d169-2060-4faf-aa67-5b37c5b070de tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6" status: 200 len: 1311 microversion: 2.1 time: 0.234066 Oct 19 03:25:07.150796 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1530/2999] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:06 2022] GET /compute/v2.1/servers/25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6 => generated 1311 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:07.155911 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9f4c6661-35e9-4689-8461-61cc948ec655 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:07.156426 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9f4c6661-35e9-4689-8461-61cc948ec655 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] [instance: 2870c53d-df7c-45d3-b8bd-c88966ad6315] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:07.164879 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9f4c6661-35e9-4689-8461-61cc948ec655 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:07.164879 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9f4c6661-35e9-4689-8461-61cc948ec655 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:07.170712 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9f4c6661-35e9-4689-8461-61cc948ec655 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:07.170712 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9f4c6661-35e9-4689-8461-61cc948ec655 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:07.170712 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9f4c6661-35e9-4689-8461-61cc948ec655 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:07.170712 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9f4c6661-35e9-4689-8461-61cc948ec655 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:07.177529 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-58b7cd81-9aee-4bcf-86dd-a98874d73d31 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:07.188519 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-58b7cd81-9aee-4bcf-86dd-a98874d73d31 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/eb2d22d5-8fc4-4a1a-a2ac-d54318936f21" status: 200 len: 1293 microversion: 2.1 time: 0.220963 Oct 19 03:25:07.189453 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1470/3000] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:06 2022] GET /compute/v2.1/servers/eb2d22d5-8fc4-4a1a-a2ac-d54318936f21 => generated 1293 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:07.194446 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-01e1028e-ce46-4230-a123-a24ba1c3df7b tempest-KeyPairsV22TestJSON-1557952363 tempest-KeyPairsV22TestJSON-1557952363-project] Action: 'create', calling method: .version_select at 0x7fc1310811f0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1180771313", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMPg/jqfsOg6K2KGjPR2G2rK/21naIhTAh7fZjnT1VBRPRL6aGMDJ2x3lSdh1qN4p8CkwKCCLTwWuDJf4pWPhJPPETacgXia170tr0kZSEvBrWQWJjNDlODfOzEjr+VuOA=="}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:25:07.211425 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-01e1028e-ce46-4230-a123-a24ba1c3df7b tempest-KeyPairsV22TestJSON-1557952363 tempest-KeyPairsV22TestJSON-1557952363-project] Getting quotas for project 3b74fc0611da45ff9895350d1b0454d9. Resources: {'key_pairs'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:25:07.217577 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-01e1028e-ce46-4230-a123-a24ba1c3df7b tempest-KeyPairsV22TestJSON-1557952363 tempest-KeyPairsV22TestJSON-1557952363-project] Getting quotas for user fdf3191958ac4bf2acbae445fcbf68db and project 3b74fc0611da45ff9895350d1b0454d9. Resources: {'key_pairs'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:25:07.261353 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9f4c6661-35e9-4689-8461-61cc948ec655 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] 10.222.0.52 "GET /compute/v2.1/servers/2870c53d-df7c-45d3-b8bd-c88966ad6315/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.109460 Oct 19 03:25:07.262080 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1531/3001] 10.222.0.52 () {58 vars in 1275 bytes} [Wed Oct 19 03:25:07 2022] GET /compute/v2.1/servers/2870c53d-df7c-45d3-b8bd-c88966ad6315/os-interface => generated 284 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:25:07.267293 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-19d7ca37-731d-421a-babb-f9289d7699a5 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:07.267918 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-19d7ca37-731d-421a-babb-f9289d7699a5 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] [instance: 333ed6dd-d020-4ef4-849c-956ed44cd18c] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:07.274707 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-19d7ca37-731d-421a-babb-f9289d7699a5 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:07.275211 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-19d7ca37-731d-421a-babb-f9289d7699a5 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:07.275659 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-19d7ca37-731d-421a-babb-f9289d7699a5 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:07.276377 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-19d7ca37-731d-421a-babb-f9289d7699a5 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:07.276837 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-19d7ca37-731d-421a-babb-f9289d7699a5 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:07.277342 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-19d7ca37-731d-421a-babb-f9289d7699a5 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:07.312816 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-19d7ca37-731d-421a-babb-f9289d7699a5 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:07.313329 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-19d7ca37-731d-421a-babb-f9289d7699a5 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:07.315383 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-19d7ca37-731d-421a-babb-f9289d7699a5 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:07.315860 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-19d7ca37-731d-421a-babb-f9289d7699a5 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Lazy-loading 'fault' on Instance uuid 333ed6dd-d020-4ef4-849c-956ed44cd18c {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:25:07.330102 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-01e1028e-ce46-4230-a123-a24ba1c3df7b tempest-KeyPairsV22TestJSON-1557952363 tempest-KeyPairsV22TestJSON-1557952363-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.139566 Oct 19 03:25:07.330956 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1471/3002] 10.222.0.52 () {62 vars in 1199 bytes} [Wed Oct 19 03:25:07 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 141 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 19 03:25:07.336752 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3f15aae9-879b-4ca9-a88e-7ac93636f056 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:07.336752 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3f15aae9-879b-4ca9-a88e-7ac93636f056 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: e5093d9e-cd31-4074-b339-828de5892bd1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:07.343602 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3f15aae9-879b-4ca9-a88e-7ac93636f056 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:07.344232 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3f15aae9-879b-4ca9-a88e-7ac93636f056 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:07.344781 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3f15aae9-879b-4ca9-a88e-7ac93636f056 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:07.345635 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3f15aae9-879b-4ca9-a88e-7ac93636f056 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:07.346200 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3f15aae9-879b-4ca9-a88e-7ac93636f056 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:07.346743 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3f15aae9-879b-4ca9-a88e-7ac93636f056 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:07.435077 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-19d7ca37-731d-421a-babb-f9289d7699a5 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1fe2c1882341168e740e196b84ab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aa84ea2412a41d19901061f97068a00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:07.443614 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-19d7ca37-731d-421a-babb-f9289d7699a5 tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] 10.222.0.52 "GET /compute/v2.1/servers/333ed6dd-d020-4ef4-849c-956ed44cd18c" status: 200 len: 1307 microversion: 2.1 time: 0.180433 Oct 19 03:25:07.444323 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1532/3003] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:07 2022] GET /compute/v2.1/servers/333ed6dd-d020-4ef4-849c-956ed44cd18c => generated 1307 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:07.462027 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9f86060b-0d42-4cb0-b4dd-31c6b2ee786e tempest-KeyPairsV22TestJSON-1557952363 tempest-KeyPairsV22TestJSON-1557952363-project] Calling method '.version_select at 0x7fc12bff79d0>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:07.467560 n-d-861333-8 devstack@n-api.service[121135]: WARNING oslo_db.sqlalchemy.utils [None req-9f86060b-0d42-4cb0-b4dd-31c6b2ee786e tempest-KeyPairsV22TestJSON-1557952363 tempest-KeyPairsV22TestJSON-1557952363-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 19 03:25:07.473774 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9f86060b-0d42-4cb0-b4dd-31c6b2ee786e tempest-KeyPairsV22TestJSON-1557952363 tempest-KeyPairsV22TestJSON-1557952363-project] 10.222.0.52 "GET /compute/v2.1/os-keypairs" status: 200 len: 1139 microversion: 2.2 time: 0.028167 Oct 19 03:25:07.474516 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1533/3004] 10.222.0.52 () {60 vars in 1177 bytes} [Wed Oct 19 03:25:07 2022] GET /compute/v2.1/os-keypairs => generated 1139 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:07.486502 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-68dbaa09-7db7-4ae5-84c4-473dd9ebce97 tempest-KeyPairsV22TestJSON-1557952363 tempest-KeyPairsV22TestJSON-1557952363-project] Calling method '.version_select at 0x7fc1301b9b80>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:07.582217 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-68dbaa09-7db7-4ae5-84c4-473dd9ebce97 tempest-KeyPairsV22TestJSON-1557952363 tempest-KeyPairsV22TestJSON-1557952363-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1180771313" status: 204 len: 0 microversion: 2.2 time: 0.099253 Oct 19 03:25:07.583019 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1534/3005] 10.222.0.52 () {60 vars in 1321 bytes} [Wed Oct 19 03:25:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1180771313 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:25:07.591707 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e345a20d-b83f-43f0-926e-c665b8f2d9f7 tempest-KeyPairsV22TestJSON-1557952363 tempest-KeyPairsV22TestJSON-1557952363-project] Calling method '.version_select at 0x7fc1305d70d0>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:07.619392 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-3f15aae9-879b-4ca9-a88e-7ac93636f056 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:07.630252 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3f15aae9-879b-4ca9-a88e-7ac93636f056 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/e5093d9e-cd31-4074-b339-828de5892bd1" status: 200 len: 1308 microversion: 2.1 time: 0.297896 Oct 19 03:25:07.639445 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1472/3006] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:07 2022] GET /compute/v2.1/servers/e5093d9e-cd31-4074-b339-828de5892bd1 => generated 1308 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:07.689345 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e345a20d-b83f-43f0-926e-c665b8f2d9f7 tempest-KeyPairsV22TestJSON-1557952363 tempest-KeyPairsV22TestJSON-1557952363-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-27677715" status: 204 len: 0 microversion: 2.2 time: 0.101870 Oct 19 03:25:07.690008 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1535/3007] 10.222.0.52 () {60 vars in 1315 bytes} [Wed Oct 19 03:25:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-27677715 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 19 03:25:07.699358 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d7ff3334-28f8-4f98-84c0-f5490665dc1a tempest-KeyPairsV22TestJSON-1557952363 tempest-KeyPairsV22TestJSON-1557952363-project] Calling method '.version_select at 0x7fc1302de670>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:07.859344 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d7ff3334-28f8-4f98-84c0-f5490665dc1a tempest-KeyPairsV22TestJSON-1557952363 tempest-KeyPairsV22TestJSON-1557952363-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-927272547" status: 204 len: 0 microversion: 2.2 time: 0.164290 Oct 19 03:25:07.859898 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1473/3008] 10.222.0.52 () {60 vars in 1318 bytes} [Wed Oct 19 03:25:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-927272547 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:25:07.872691 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f1ff8fa6-2212-4be6-a547-ff34bb6ef21f tempest-KeyPairsV22TestJSON-1557952363 tempest-KeyPairsV22TestJSON-1557952363-project] Action: 'create', calling method: .version_select at 0x7fc1305e79d0>, body: {"keypair": {"name": "tempest-keypair-72695093", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOR41mCd5F+AGZgyvoBBHdSfTkXShQhvVwWJSarLZSiHLw4+d5diJDZwpzKhQ7+BIyXih2J7bxiAd8fUefkGpmIaCnRnsOY18nwOzRDe9vNzkZcPy9a6SmpOMmVkl82uPg=="}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:25:07.891299 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-f1ff8fa6-2212-4be6-a547-ff34bb6ef21f tempest-KeyPairsV22TestJSON-1557952363 tempest-KeyPairsV22TestJSON-1557952363-project] Getting quotas for project 3b74fc0611da45ff9895350d1b0454d9. Resources: {'key_pairs'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:25:07.899985 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-f1ff8fa6-2212-4be6-a547-ff34bb6ef21f tempest-KeyPairsV22TestJSON-1557952363 tempest-KeyPairsV22TestJSON-1557952363-project] Getting quotas for user fdf3191958ac4bf2acbae445fcbf68db and project 3b74fc0611da45ff9895350d1b0454d9. Resources: {'key_pairs'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:25:08.004396 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f1ff8fa6-2212-4be6-a547-ff34bb6ef21f tempest-KeyPairsV22TestJSON-1557952363 tempest-KeyPairsV22TestJSON-1557952363-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.2 time: 0.135926 Oct 19 03:25:08.005149 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1536/3009] 10.222.0.52 () {62 vars in 1199 bytes} [Wed Oct 19 03:25:07 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 137 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 19 03:25:08.019899 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1b2ea647-68fa-4295-94d2-3672ed52386e tempest-KeyPairsV22TestJSON-1557952363 tempest-KeyPairsV22TestJSON-1557952363-project] Calling method '.version_select at 0x7fc130d10820>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:08.029113 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1b2ea647-68fa-4295-94d2-3672ed52386e tempest-KeyPairsV22TestJSON-1557952363 tempest-KeyPairsV22TestJSON-1557952363-project] 10.222.0.52 "GET /compute/v2.1/os-keypairs/tempest-keypair-72695093" status: 200 len: 511 microversion: 2.2 time: 0.015403 Oct 19 03:25:08.031058 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1474/3010] 10.222.0.52 () {60 vars in 1252 bytes} [Wed Oct 19 03:25:08 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-72695093 => generated 511 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:25:08.046043 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-53ea3367-ded3-42ff-ab6d-8e8ad1f05777 tempest-KeyPairsV22TestJSON-1557952363 tempest-KeyPairsV22TestJSON-1557952363-project] Calling method '.version_select at 0x7fc130172ca0>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:08.050378 n-d-861333-8 devstack@n-api.service[121135]: WARNING oslo_db.sqlalchemy.utils [None req-53ea3367-ded3-42ff-ab6d-8e8ad1f05777 tempest-KeyPairsV22TestJSON-1557952363 tempest-KeyPairsV22TestJSON-1557952363-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 19 03:25:08.056381 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-53ea3367-ded3-42ff-ab6d-8e8ad1f05777 tempest-KeyPairsV22TestJSON-1557952363 tempest-KeyPairsV22TestJSON-1557952363-project] 10.222.0.52 "GET /compute/v2.1/os-keypairs" status: 200 len: 368 microversion: 2.2 time: 0.015415 Oct 19 03:25:08.057749 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1537/3011] 10.222.0.52 () {60 vars in 1177 bytes} [Wed Oct 19 03:25:08 2022] GET /compute/v2.1/os-keypairs => generated 368 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:25:08.069224 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-93365a8d-707a-482b-989c-7e49f56082bf tempest-KeyPairsV22TestJSON-1557952363 tempest-KeyPairsV22TestJSON-1557952363-project] Calling method '.version_select at 0x7fc130d03ee0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:08.171793 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-93365a8d-707a-482b-989c-7e49f56082bf tempest-KeyPairsV22TestJSON-1557952363 tempest-KeyPairsV22TestJSON-1557952363-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-72695093" status: 204 len: 0 microversion: 2.2 time: 0.106709 Oct 19 03:25:08.172649 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1475/3012] 10.222.0.52 () {60 vars in 1255 bytes} [Wed Oct 19 03:25:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-72695093 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:25:08.177400 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-dc09a46a-2e1c-499f-a9db-5a4807f09ab4 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:08.177400 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-dc09a46a-2e1c-499f-a9db-5a4807f09ab4 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:08.184719 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6995d30b-7a98-4a5d-b78c-421dfbd422c3 tempest-KeyPairsV22TestJSON-1557952363 tempest-KeyPairsV22TestJSON-1557952363-project] Action: 'create', calling method: .version_select at 0x7fc130e4aca0>, body: {"keypair": {"name": "tempest-keypair-999993634", "type": "x509"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:25:08.191623 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dc09a46a-2e1c-499f-a9db-5a4807f09ab4 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:08.192451 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dc09a46a-2e1c-499f-a9db-5a4807f09ab4 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:08.193010 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dc09a46a-2e1c-499f-a9db-5a4807f09ab4 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:08.194903 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dc09a46a-2e1c-499f-a9db-5a4807f09ab4 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:08.195040 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dc09a46a-2e1c-499f-a9db-5a4807f09ab4 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:08.199680 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dc09a46a-2e1c-499f-a9db-5a4807f09ab4 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:08.211023 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-6995d30b-7a98-4a5d-b78c-421dfbd422c3 tempest-KeyPairsV22TestJSON-1557952363 tempest-KeyPairsV22TestJSON-1557952363-project] Getting quotas for project 3b74fc0611da45ff9895350d1b0454d9. Resources: {'key_pairs'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:25:08.220549 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-6995d30b-7a98-4a5d-b78c-421dfbd422c3 tempest-KeyPairsV22TestJSON-1557952363 tempest-KeyPairsV22TestJSON-1557952363-project] Getting quotas for user fdf3191958ac4bf2acbae445fcbf68db and project 3b74fc0611da45ff9895350d1b0454d9. Resources: {'key_pairs'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:25:08.253957 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.processutils [None req-6995d30b-7a98-4a5d-b78c-421dfbd422c3 tempest-KeyPairsV22TestJSON-1557952363 tempest-KeyPairsV22TestJSON-1557952363-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpnibtn7sm/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpnibtn7sm/temp.key -subj /CN=fdf3191958ac4bf2acbae445fcbf68db -extensions v3_req_client {{(pid=121134) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 19 03:25:08.465382 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-dc09a46a-2e1c-499f-a9db-5a4807f09ab4 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:08.476313 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-dc09a46a-2e1c-499f-a9db-5a4807f09ab4 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6" status: 200 len: 1311 microversion: 2.1 time: 0.307082 Oct 19 03:25:08.477761 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1538/3013] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:08 2022] GET /compute/v2.1/servers/25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6 => generated 1311 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:08.486615 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f67acf59-5b95-4a76-a844-afc5fb806928 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:08.488751 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f67acf59-5b95-4a76-a844-afc5fb806928 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: eb2d22d5-8fc4-4a1a-a2ac-d54318936f21] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:08.504155 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f67acf59-5b95-4a76-a844-afc5fb806928 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:08.505415 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f67acf59-5b95-4a76-a844-afc5fb806928 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:08.506054 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f67acf59-5b95-4a76-a844-afc5fb806928 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:08.506936 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f67acf59-5b95-4a76-a844-afc5fb806928 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:08.507548 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f67acf59-5b95-4a76-a844-afc5fb806928 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:08.508362 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f67acf59-5b95-4a76-a844-afc5fb806928 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:08.775230 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f67acf59-5b95-4a76-a844-afc5fb806928 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:08.783461 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f67acf59-5b95-4a76-a844-afc5fb806928 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/eb2d22d5-8fc4-4a1a-a2ac-d54318936f21" status: 200 len: 1293 microversion: 2.1 time: 0.304418 Oct 19 03:25:08.784058 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1539/3014] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:08 2022] GET /compute/v2.1/servers/eb2d22d5-8fc4-4a1a-a2ac-d54318936f21 => generated 1293 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:08.791872 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3da72fbc-dd39-49b8-b21e-f8f50902a15e tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:08.793135 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-3da72fbc-dd39-49b8-b21e-f8f50902a15e tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] [instance: 333ed6dd-d020-4ef4-849c-956ed44cd18c] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:08.799404 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3da72fbc-dd39-49b8-b21e-f8f50902a15e tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:08.800411 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3da72fbc-dd39-49b8-b21e-f8f50902a15e tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:08.800791 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3da72fbc-dd39-49b8-b21e-f8f50902a15e tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:08.801546 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3da72fbc-dd39-49b8-b21e-f8f50902a15e tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:08.801860 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.processutils [None req-6995d30b-7a98-4a5d-b78c-421dfbd422c3 tempest-KeyPairsV22TestJSON-1557952363 tempest-KeyPairsV22TestJSON-1557952363-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpnibtn7sm/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpnibtn7sm/temp.key -subj /CN=fdf3191958ac4bf2acbae445fcbf68db -extensions v3_req_client" returned: 0 in 0.546s {{(pid=121134) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 19 03:25:08.802020 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3da72fbc-dd39-49b8-b21e-f8f50902a15e tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:08.809680 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3da72fbc-dd39-49b8-b21e-f8f50902a15e tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:08.809842 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.processutils [None req-6995d30b-7a98-4a5d-b78c-421dfbd422c3 tempest-KeyPairsV22TestJSON-1557952363 tempest-KeyPairsV22TestJSON-1557952363-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpnibtn7sm/temp.key -password pass: {{(pid=121134) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 19 03:25:08.823334 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-3da72fbc-dd39-49b8-b21e-f8f50902a15e tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] HTTP exception thrown: Instance 333ed6dd-d020-4ef4-849c-956ed44cd18c could not be found. Oct 19 03:25:08.825051 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3da72fbc-dd39-49b8-b21e-f8f50902a15e tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Request method failure captured: Oct 19 03:25:08.825051 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/333ed6dd-d020-4ef4-849c-956ed44cd18c HTTP/1.1 Oct 19 03:25:08.825051 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:25:08.825051 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:25:08.825051 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:25:08.825051 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:25:08.825051 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:25:08.825051 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:25:08.825051 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:25:08.825051 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:25:08.825051 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT23lnL-_6M9oDorbQXAx3u7BXhCwfdFef06AupzSd34Djf57-CP5caJ4YWBs72nHTJH_eR0M6zrGmVBxnuyIO0mQ7R58kP1NSpG8QoQ4UV3JgtKbkbZZUnzMwWk1zC4sN9fvoOv8fpg0a2j7mTDGRFO7DfxoBip2Vyqp1KdqAIbZBYY Oct 19 03:25:08.825051 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:25:08.825051 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:25:08.825051 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:25:08.825051 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:25:08.825051 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:25:08.825051 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:25:08.825051 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 0aa84ea2412a41d19901061f97068a00 Oct 19 03:25:08.825051 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-InstanceActionsTestJSON-8128677 Oct 19 03:25:08.825051 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:25:08.825051 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:25:08.826450 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/0aa84ea2412a41d19901061f97068a00"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0aa84ea2412a41d19901061f97068a00"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0aa84ea2412a41d19901061f97068a00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_0aa84ea2412a41d19901061f97068a00", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:25:08.826450 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-InstanceActionsTestJSON-8128677 Oct 19 03:25:08.826450 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 0aa84ea2412a41d19901061f97068a00 Oct 19 03:25:08.826450 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-InstanceActionsTestJSON-8128677 Oct 19 03:25:08.826450 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-InstanceActionsTestJSON-8128677-project Oct 19 03:25:08.826450 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:25:08.826450 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:25:08.826450 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 9e1fe2c1882341168e740e196b84ab32 Oct 19 03:25:08.826450 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-InstanceActionsTestJSON-8128677-project Oct 19 03:25:08.826450 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:25:08.826450 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance 333ed6dd-d020-4ef4-849c-956ed44cd18c could not be found. Oct 19 03:25:08.826450 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '333ed6dd-d020-4ef4-849c-956ed44cd18c'} Oct 19 03:25:08.827206 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:25:08.827206 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:25:08.827206 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:25:08.827206 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:25:08.827206 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:25:08.827206 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:25:08.827206 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:25:08.827206 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:25:08.827206 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:25:08.827206 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:25:08.827206 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 333ed6dd-d020-4ef4-849c-956ed44cd18c could not be found. Oct 19 03:25:08.827206 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:25:08.827206 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:25:08.827206 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:25:08.827206 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:25:08.827206 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:25:08.827206 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:25:08.827206 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:25:08.827206 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:25:08.827206 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:25:08.829018 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:25:08.829018 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:25:08.829018 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:25:08.829018 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:25:08.829018 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:25:08.829018 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:25:08.829018 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:25:08.829018 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 333ed6dd-d020-4ef4-849c-956ed44cd18c could not be found. Oct 19 03:25:08.829018 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:25:08.829018 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:25:08.829018 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:25:08.829018 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:25:08.829018 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:25:08.829018 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:25:08.829018 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:25:08.829018 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:25:08.829018 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 333ed6dd-d020-4ef4-849c-956ed44cd18c could not be found. Oct 19 03:25:08.829018 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:25:08.834832 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3da72fbc-dd39-49b8-b21e-f8f50902a15e tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] Returning 404 to user: Instance 333ed6dd-d020-4ef4-849c-956ed44cd18c could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:25:08.834832 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-3da72fbc-dd39-49b8-b21e-f8f50902a15e tempest-InstanceActionsTestJSON-8128677 tempest-InstanceActionsTestJSON-8128677-project] 10.222.0.52 "GET /compute/v2.1/servers/333ed6dd-d020-4ef4-849c-956ed44cd18c" status: 404 len: 111 microversion: 2.1 time: 0.039815 Oct 19 03:25:08.834832 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1540/3015] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:08 2022] GET /compute/v2.1/servers/333ed6dd-d020-4ef4-849c-956ed44cd18c => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:25:08.844284 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9b4e3351-699c-43f6-9c6d-7a09737e2ca8 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:08.854050 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9b4e3351-699c-43f6-9c6d-7a09737e2ca8 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: e5093d9e-cd31-4074-b339-828de5892bd1] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:08.863464 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.processutils [None req-6995d30b-7a98-4a5d-b78c-421dfbd422c3 tempest-KeyPairsV22TestJSON-1557952363 tempest-KeyPairsV22TestJSON-1557952363-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpnibtn7sm/temp.key -password pass:" returned: 0 in 0.059s {{(pid=121134) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 19 03:25:08.868139 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9b4e3351-699c-43f6-9c6d-7a09737e2ca8 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:08.868680 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9b4e3351-699c-43f6-9c6d-7a09737e2ca8 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:08.869774 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9b4e3351-699c-43f6-9c6d-7a09737e2ca8 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:08.870611 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9b4e3351-699c-43f6-9c6d-7a09737e2ca8 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:08.871076 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9b4e3351-699c-43f6-9c6d-7a09737e2ca8 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:08.871510 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9b4e3351-699c-43f6-9c6d-7a09737e2ca8 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:09.024061 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-6995d30b-7a98-4a5d-b78c-421dfbd422c3 tempest-KeyPairsV22TestJSON-1557952363 tempest-KeyPairsV22TestJSON-1557952363-project] Getting quotas for project 3b74fc0611da45ff9895350d1b0454d9. Resources: {'key_pairs'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:25:09.030910 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-6995d30b-7a98-4a5d-b78c-421dfbd422c3 tempest-KeyPairsV22TestJSON-1557952363 tempest-KeyPairsV22TestJSON-1557952363-project] Getting quotas for user fdf3191958ac4bf2acbae445fcbf68db and project 3b74fc0611da45ff9895350d1b0454d9. Resources: {'key_pairs'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:25:09.050087 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6995d30b-7a98-4a5d-b78c-421dfbd422c3 tempest-KeyPairsV22TestJSON-1557952363 tempest-KeyPairsV22TestJSON-1557952363-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 4692 microversion: 2.2 time: 0.870243 Oct 19 03:25:09.051615 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1476/3016] 10.222.0.52 () {62 vars in 1198 bytes} [Wed Oct 19 03:25:08 2022] POST /compute/v2.1/os-keypairs => generated 4692 bytes in 873 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:25:09.057732 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-0c1a4602-1981-4363-a3ff-2529d9836d8d req-5277b517-1c0c-4b8d-86f0-154f8418d2ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95", "tag": "65396b7f-6d0e-408a-b3e0-4a8c18d5caa3"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:25:09.070572 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-0c1a4602-1981-4363-a3ff-2529d9836d8d req-5277b517-1c0c-4b8d-86f0-154f8418d2ea service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:09.071457 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-0c1a4602-1981-4363-a3ff-2529d9836d8d req-5277b517-1c0c-4b8d-86f0-154f8418d2ea service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:09.072378 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-0c1a4602-1981-4363-a3ff-2529d9836d8d req-5277b517-1c0c-4b8d-86f0-154f8418d2ea service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:09.087335 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-0c1a4602-1981-4363-a3ff-2529d9836d8d req-5277b517-1c0c-4b8d-86f0-154f8418d2ea service nova] Creating event network-changed:65396b7f-6d0e-408a-b3e0-4a8c18d5caa3 for instance cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 on n-h2-861333-8 Oct 19 03:25:09.094874 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-0c1a4602-1981-4363-a3ff-2529d9836d8d req-5277b517-1c0c-4b8d-86f0-154f8418d2ea service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041533 Oct 19 03:25:09.095956 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1477/3017] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:25:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:25:09.103182 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-2ef7974b-0e86-4bd8-ae34-1807025ab927 req-10980377-9c4b-4c4d-8ea3-9352af46431b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2870c53d-df7c-45d3-b8bd-c88966ad6315", "tag": "4438c03f-7c43-41c1-aadf-24b917ab0a59"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:25:09.129224 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-2ef7974b-0e86-4bd8-ae34-1807025ab927 req-10980377-9c4b-4c4d-8ea3-9352af46431b service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:09.129750 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-2ef7974b-0e86-4bd8-ae34-1807025ab927 req-10980377-9c4b-4c4d-8ea3-9352af46431b service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:09.130189 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-2ef7974b-0e86-4bd8-ae34-1807025ab927 req-10980377-9c4b-4c4d-8ea3-9352af46431b service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:09.147491 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-2ef7974b-0e86-4bd8-ae34-1807025ab927 req-10980377-9c4b-4c4d-8ea3-9352af46431b service nova] Creating event network-changed:4438c03f-7c43-41c1-aadf-24b917ab0a59 for instance 2870c53d-df7c-45d3-b8bd-c88966ad6315 on n-h1-861333-8 Oct 19 03:25:09.153401 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-2ef7974b-0e86-4bd8-ae34-1807025ab927 req-10980377-9c4b-4c4d-8ea3-9352af46431b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055940 Oct 19 03:25:09.154707 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1478/3018] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:25:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:25:09.160352 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4ad6e11a-9796-465f-adad-2ffb46afb174 tempest-KeyPairsV22TestJSON-1557952363 tempest-KeyPairsV22TestJSON-1557952363-project] Calling method '.version_select at 0x7fc130d60700>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:09.174873 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4ad6e11a-9796-465f-adad-2ffb46afb174 tempest-KeyPairsV22TestJSON-1557952363 tempest-KeyPairsV22TestJSON-1557952363-project] 10.222.0.52 "GET /compute/v2.1/os-keypairs/tempest-keypair-999993634" status: 200 len: 1533 microversion: 2.2 time: 0.017510 Oct 19 03:25:09.174873 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1479/3019] 10.222.0.52 () {60 vars in 1255 bytes} [Wed Oct 19 03:25:09 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-999993634 => generated 1533 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:09.187093 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-006d784f-63cb-403b-b540-5b22a13f2861 tempest-KeyPairsV22TestJSON-1557952363 tempest-KeyPairsV22TestJSON-1557952363-project] Calling method '.version_select at 0x7fc13014fe50>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:09.192984 n-d-861333-8 devstack@n-api.service[121134]: WARNING oslo_db.sqlalchemy.utils [None req-006d784f-63cb-403b-b540-5b22a13f2861 tempest-KeyPairsV22TestJSON-1557952363 tempest-KeyPairsV22TestJSON-1557952363-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 19 03:25:09.201622 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-006d784f-63cb-403b-b540-5b22a13f2861 tempest-KeyPairsV22TestJSON-1557952363 tempest-KeyPairsV22TestJSON-1557952363-project] 10.222.0.52 "GET /compute/v2.1/os-keypairs" status: 200 len: 1390 microversion: 2.2 time: 0.019646 Oct 19 03:25:09.205814 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1480/3020] 10.222.0.52 () {60 vars in 1177 bytes} [Wed Oct 19 03:25:09 2022] GET /compute/v2.1/os-keypairs => generated 1390 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:25:09.218982 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-057a5c28-4e74-404b-9093-009bc36d6f37 tempest-KeyPairsV22TestJSON-1557952363 tempest-KeyPairsV22TestJSON-1557952363-project] Calling method '.version_select at 0x7fc130d10940>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:09.225069 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-9b4e3351-699c-43f6-9c6d-7a09737e2ca8 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:09.249700 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9b4e3351-699c-43f6-9c6d-7a09737e2ca8 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/e5093d9e-cd31-4074-b339-828de5892bd1" status: 200 len: 1308 microversion: 2.1 time: 0.408701 Oct 19 03:25:09.249700 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1541/3021] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:08 2022] GET /compute/v2.1/servers/e5093d9e-cd31-4074-b339-828de5892bd1 => generated 1308 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:09.333880 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-057a5c28-4e74-404b-9093-009bc36d6f37 tempest-KeyPairsV22TestJSON-1557952363 tempest-KeyPairsV22TestJSON-1557952363-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-999993634" status: 204 len: 0 microversion: 2.2 time: 0.122064 Oct 19 03:25:09.334817 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1481/3022] 10.222.0.52 () {60 vars in 1258 bytes} [Wed Oct 19 03:25:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-999993634 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:25:09.507705 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c2aae702-3b2e-4b34-8884-d032f2e4ebb7 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:09.508510 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c2aae702-3b2e-4b34-8884-d032f2e4ebb7 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:09.514988 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c2aae702-3b2e-4b34-8884-d032f2e4ebb7 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:09.515572 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c2aae702-3b2e-4b34-8884-d032f2e4ebb7 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:09.516393 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c2aae702-3b2e-4b34-8884-d032f2e4ebb7 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:09.522435 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c2aae702-3b2e-4b34-8884-d032f2e4ebb7 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:09.522435 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c2aae702-3b2e-4b34-8884-d032f2e4ebb7 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:09.522435 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c2aae702-3b2e-4b34-8884-d032f2e4ebb7 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:09.542813 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=100 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:25:09.810473 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0166e213-8ace-46f4-bba4-148dd63c5762 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:09.813447 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0166e213-8ace-46f4-bba4-148dd63c5762 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: eb2d22d5-8fc4-4a1a-a2ac-d54318936f21] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:09.823158 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0166e213-8ace-46f4-bba4-148dd63c5762 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:09.827800 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0166e213-8ace-46f4-bba4-148dd63c5762 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:09.828318 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0166e213-8ace-46f4-bba4-148dd63c5762 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:09.829165 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0166e213-8ace-46f4-bba4-148dd63c5762 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:09.829731 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0166e213-8ace-46f4-bba4-148dd63c5762 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:09.833981 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0166e213-8ace-46f4-bba4-148dd63c5762 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:10.019545 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c2aae702-3b2e-4b34-8884-d032f2e4ebb7 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:10.040912 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c2aae702-3b2e-4b34-8884-d032f2e4ebb7 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6" status: 200 len: 1311 microversion: 2.1 time: 0.537417 Oct 19 03:25:10.051016 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1542/3023] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:09 2022] GET /compute/v2.1/servers/25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6 => generated 1311 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:10.263519 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-524165d8-b2a3-448d-b616-9e811ae02d53 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:10.264401 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-524165d8-b2a3-448d-b616-9e811ae02d53 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: e5093d9e-cd31-4074-b339-828de5892bd1] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:10.278711 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-524165d8-b2a3-448d-b616-9e811ae02d53 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:10.281058 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-524165d8-b2a3-448d-b616-9e811ae02d53 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:10.283083 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-524165d8-b2a3-448d-b616-9e811ae02d53 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:10.286866 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-524165d8-b2a3-448d-b616-9e811ae02d53 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:10.287596 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-524165d8-b2a3-448d-b616-9e811ae02d53 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:10.288203 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-524165d8-b2a3-448d-b616-9e811ae02d53 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:10.672784 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0166e213-8ace-46f4-bba4-148dd63c5762 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:10.682863 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0166e213-8ace-46f4-bba4-148dd63c5762 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/eb2d22d5-8fc4-4a1a-a2ac-d54318936f21" status: 200 len: 1293 microversion: 2.1 time: 0.880311 Oct 19 03:25:10.686480 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1482/3024] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:09 2022] GET /compute/v2.1/servers/eb2d22d5-8fc4-4a1a-a2ac-d54318936f21 => generated 1293 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:10.992028 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-524165d8-b2a3-448d-b616-9e811ae02d53 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:11.022272 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-524165d8-b2a3-448d-b616-9e811ae02d53 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/e5093d9e-cd31-4074-b339-828de5892bd1" status: 200 len: 1308 microversion: 2.1 time: 0.763874 Oct 19 03:25:11.023945 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1543/3025] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:10 2022] GET /compute/v2.1/servers/e5093d9e-cd31-4074-b339-828de5892bd1 => generated 1308 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:25:11.071778 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ba676c63-18f8-4afe-9440-38fe7719b3d5 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:11.071778 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ba676c63-18f8-4afe-9440-38fe7719b3d5 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:11.078365 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ba676c63-18f8-4afe-9440-38fe7719b3d5 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:11.079237 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ba676c63-18f8-4afe-9440-38fe7719b3d5 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:11.079918 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ba676c63-18f8-4afe-9440-38fe7719b3d5 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:11.080883 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ba676c63-18f8-4afe-9440-38fe7719b3d5 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:11.081596 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ba676c63-18f8-4afe-9440-38fe7719b3d5 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:11.082254 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ba676c63-18f8-4afe-9440-38fe7719b3d5 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:11.277072 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ba676c63-18f8-4afe-9440-38fe7719b3d5 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:11.291553 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ba676c63-18f8-4afe-9440-38fe7719b3d5 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6" status: 200 len: 1311 microversion: 2.1 time: 0.227955 Oct 19 03:25:11.292588 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1483/3026] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:11 2022] GET /compute/v2.1/servers/25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6 => generated 1311 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:11.714241 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-73dcc23d-d7d5-436d-87fc-ccab4882b66f tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:11.714867 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-73dcc23d-d7d5-436d-87fc-ccab4882b66f tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: eb2d22d5-8fc4-4a1a-a2ac-d54318936f21] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:11.750585 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-73dcc23d-d7d5-436d-87fc-ccab4882b66f tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:11.753038 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-73dcc23d-d7d5-436d-87fc-ccab4882b66f tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:11.753694 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-73dcc23d-d7d5-436d-87fc-ccab4882b66f tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:11.755979 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-73dcc23d-d7d5-436d-87fc-ccab4882b66f tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:11.756640 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-73dcc23d-d7d5-436d-87fc-ccab4882b66f tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:11.758751 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-73dcc23d-d7d5-436d-87fc-ccab4882b66f tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:12.047830 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-99f6882d-63ae-44a0-bf2e-8ca131711b7d tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:12.048579 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-99f6882d-63ae-44a0-bf2e-8ca131711b7d tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: e5093d9e-cd31-4074-b339-828de5892bd1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:12.062906 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-99f6882d-63ae-44a0-bf2e-8ca131711b7d tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:12.067457 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-99f6882d-63ae-44a0-bf2e-8ca131711b7d tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:12.068306 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-99f6882d-63ae-44a0-bf2e-8ca131711b7d tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:12.069363 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-99f6882d-63ae-44a0-bf2e-8ca131711b7d tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:12.071922 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-99f6882d-63ae-44a0-bf2e-8ca131711b7d tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:12.076607 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-99f6882d-63ae-44a0-bf2e-8ca131711b7d tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:12.079818 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-73dcc23d-d7d5-436d-87fc-ccab4882b66f tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:12.094088 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-73dcc23d-d7d5-436d-87fc-ccab4882b66f tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/eb2d22d5-8fc4-4a1a-a2ac-d54318936f21" status: 200 len: 1293 microversion: 2.1 time: 0.385233 Oct 19 03:25:12.097879 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1544/3027] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:11 2022] GET /compute/v2.1/servers/eb2d22d5-8fc4-4a1a-a2ac-d54318936f21 => generated 1293 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:12.316735 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f0920343-0123-480f-8259-edf2f8a7b674 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:12.317689 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f0920343-0123-480f-8259-edf2f8a7b674 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:12.336323 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f0920343-0123-480f-8259-edf2f8a7b674 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:12.338219 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f0920343-0123-480f-8259-edf2f8a7b674 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:12.339578 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-99f6882d-63ae-44a0-bf2e-8ca131711b7d tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:12.341747 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f0920343-0123-480f-8259-edf2f8a7b674 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:12.345869 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f0920343-0123-480f-8259-edf2f8a7b674 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:12.346593 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f0920343-0123-480f-8259-edf2f8a7b674 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:12.347283 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f0920343-0123-480f-8259-edf2f8a7b674 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:12.351275 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-99f6882d-63ae-44a0-bf2e-8ca131711b7d tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/e5093d9e-cd31-4074-b339-828de5892bd1" status: 200 len: 1308 microversion: 2.1 time: 0.307242 Oct 19 03:25:12.352282 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1484/3028] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:12 2022] GET /compute/v2.1/servers/e5093d9e-cd31-4074-b339-828de5892bd1 => generated 1308 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:12.420826 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-531b603e-b72d-4e54-a143-3f5ddef7d37e req-c5fcd1dc-3a31-4b66-aa70-58f3128c6f12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb2d22d5-8fc4-4a1a-a2ac-d54318936f21", "name": "network-vif-plugged", "status": "completed", "tag": "e46e34c0-a202-40e2-b74d-93cf2fca0962"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:25:12.439627 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-531b603e-b72d-4e54-a143-3f5ddef7d37e req-c5fcd1dc-3a31-4b66-aa70-58f3128c6f12 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:12.441809 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-531b603e-b72d-4e54-a143-3f5ddef7d37e req-c5fcd1dc-3a31-4b66-aa70-58f3128c6f12 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:12.442370 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-531b603e-b72d-4e54-a143-3f5ddef7d37e req-c5fcd1dc-3a31-4b66-aa70-58f3128c6f12 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:12.480267 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-531b603e-b72d-4e54-a143-3f5ddef7d37e req-c5fcd1dc-3a31-4b66-aa70-58f3128c6f12 service nova] Creating event network-vif-plugged:e46e34c0-a202-40e2-b74d-93cf2fca0962 for instance eb2d22d5-8fc4-4a1a-a2ac-d54318936f21 on n-h1-861333-8 Oct 19 03:25:12.486969 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-531b603e-b72d-4e54-a143-3f5ddef7d37e req-c5fcd1dc-3a31-4b66-aa70-58f3128c6f12 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072910 Oct 19 03:25:12.488136 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1485/3029] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:25:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:25:12.619208 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f0920343-0123-480f-8259-edf2f8a7b674 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:12.629093 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f0920343-0123-480f-8259-edf2f8a7b674 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6" status: 200 len: 1311 microversion: 2.1 time: 0.316635 Oct 19 03:25:12.630083 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1545/3030] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:12 2022] GET /compute/v2.1/servers/25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6 => generated 1311 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:25:13.124525 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d4188c55-735b-4a2e-a7aa-17f116501d1c tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:13.125469 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d4188c55-735b-4a2e-a7aa-17f116501d1c tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: eb2d22d5-8fc4-4a1a-a2ac-d54318936f21] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:13.132530 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d4188c55-735b-4a2e-a7aa-17f116501d1c tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:13.133159 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d4188c55-735b-4a2e-a7aa-17f116501d1c tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:13.134002 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d4188c55-735b-4a2e-a7aa-17f116501d1c tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:13.134997 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d4188c55-735b-4a2e-a7aa-17f116501d1c tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:13.136482 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d4188c55-735b-4a2e-a7aa-17f116501d1c tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:13.137090 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d4188c55-735b-4a2e-a7aa-17f116501d1c tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:13.305039 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d4188c55-735b-4a2e-a7aa-17f116501d1c tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:13.314009 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d4188c55-735b-4a2e-a7aa-17f116501d1c tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/eb2d22d5-8fc4-4a1a-a2ac-d54318936f21" status: 200 len: 1293 microversion: 2.1 time: 0.196620 Oct 19 03:25:13.314931 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1486/3031] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:13 2022] GET /compute/v2.1/servers/eb2d22d5-8fc4-4a1a-a2ac-d54318936f21 => generated 1293 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:13.375371 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b6f8b0d8-3dc6-4cb5-b81b-df3242b2b5b7 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:13.376071 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b6f8b0d8-3dc6-4cb5-b81b-df3242b2b5b7 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: e5093d9e-cd31-4074-b339-828de5892bd1] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:13.383175 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b6f8b0d8-3dc6-4cb5-b81b-df3242b2b5b7 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:13.383669 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b6f8b0d8-3dc6-4cb5-b81b-df3242b2b5b7 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:13.384120 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b6f8b0d8-3dc6-4cb5-b81b-df3242b2b5b7 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:13.384831 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b6f8b0d8-3dc6-4cb5-b81b-df3242b2b5b7 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:13.385291 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b6f8b0d8-3dc6-4cb5-b81b-df3242b2b5b7 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:13.385765 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b6f8b0d8-3dc6-4cb5-b81b-df3242b2b5b7 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:13.528610 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b6f8b0d8-3dc6-4cb5-b81b-df3242b2b5b7 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:13.536562 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b6f8b0d8-3dc6-4cb5-b81b-df3242b2b5b7 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/e5093d9e-cd31-4074-b339-828de5892bd1" status: 200 len: 1308 microversion: 2.1 time: 0.165232 Oct 19 03:25:13.537158 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1546/3032] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:13 2022] GET /compute/v2.1/servers/e5093d9e-cd31-4074-b339-828de5892bd1 => generated 1308 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:13.657109 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b1fa0bb5-3463-40a8-b9bf-3baac732066b tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:13.657659 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b1fa0bb5-3463-40a8-b9bf-3baac732066b tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:13.676603 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b1fa0bb5-3463-40a8-b9bf-3baac732066b tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:13.677126 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b1fa0bb5-3463-40a8-b9bf-3baac732066b tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:13.677717 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b1fa0bb5-3463-40a8-b9bf-3baac732066b tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:13.678513 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b1fa0bb5-3463-40a8-b9bf-3baac732066b tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:13.679176 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b1fa0bb5-3463-40a8-b9bf-3baac732066b tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:13.679828 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b1fa0bb5-3463-40a8-b9bf-3baac732066b tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:13.853789 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b1fa0bb5-3463-40a8-b9bf-3baac732066b tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:13.862993 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b1fa0bb5-3463-40a8-b9bf-3baac732066b tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6" status: 200 len: 1311 microversion: 2.1 time: 0.209474 Oct 19 03:25:13.863889 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1487/3033] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:13 2022] GET /compute/v2.1/servers/25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6 => generated 1311 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:14.336255 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b66dd92c-cd52-4344-ac04-a37da08cbdcb tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:14.336887 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b66dd92c-cd52-4344-ac04-a37da08cbdcb tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: eb2d22d5-8fc4-4a1a-a2ac-d54318936f21] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:14.343386 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b66dd92c-cd52-4344-ac04-a37da08cbdcb tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:14.343888 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b66dd92c-cd52-4344-ac04-a37da08cbdcb tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:14.344340 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b66dd92c-cd52-4344-ac04-a37da08cbdcb tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:14.345043 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b66dd92c-cd52-4344-ac04-a37da08cbdcb tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:14.345532 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b66dd92c-cd52-4344-ac04-a37da08cbdcb tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:14.346073 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b66dd92c-cd52-4344-ac04-a37da08cbdcb tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:14.504570 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b66dd92c-cd52-4344-ac04-a37da08cbdcb tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:14.512697 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b66dd92c-cd52-4344-ac04-a37da08cbdcb tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/eb2d22d5-8fc4-4a1a-a2ac-d54318936f21" status: 200 len: 1293 microversion: 2.1 time: 0.180499 Oct 19 03:25:14.513273 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1547/3034] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:14 2022] GET /compute/v2.1/servers/eb2d22d5-8fc4-4a1a-a2ac-d54318936f21 => generated 1293 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:14.561546 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a313d132-b977-4ab3-943c-3087850bc940 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:14.563037 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a313d132-b977-4ab3-943c-3087850bc940 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: e5093d9e-cd31-4074-b339-828de5892bd1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:14.576666 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a313d132-b977-4ab3-943c-3087850bc940 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:14.577187 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a313d132-b977-4ab3-943c-3087850bc940 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:14.577653 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a313d132-b977-4ab3-943c-3087850bc940 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:14.578386 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a313d132-b977-4ab3-943c-3087850bc940 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:14.578851 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a313d132-b977-4ab3-943c-3087850bc940 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:14.579286 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a313d132-b977-4ab3-943c-3087850bc940 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:14.775782 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a313d132-b977-4ab3-943c-3087850bc940 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:14.786451 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a313d132-b977-4ab3-943c-3087850bc940 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/e5093d9e-cd31-4074-b339-828de5892bd1" status: 200 len: 1308 microversion: 2.1 time: 0.230203 Oct 19 03:25:14.787393 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1488/3035] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:14 2022] GET /compute/v2.1/servers/e5093d9e-cd31-4074-b339-828de5892bd1 => generated 1308 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:14.892504 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5c177743-1235-4f95-bfc9-00f268019706 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:14.893519 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-5c177743-1235-4f95-bfc9-00f268019706 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:14.900550 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5c177743-1235-4f95-bfc9-00f268019706 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:14.902005 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5c177743-1235-4f95-bfc9-00f268019706 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:14.903406 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5c177743-1235-4f95-bfc9-00f268019706 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:14.904345 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5c177743-1235-4f95-bfc9-00f268019706 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:14.905000 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5c177743-1235-4f95-bfc9-00f268019706 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:14.905447 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5c177743-1235-4f95-bfc9-00f268019706 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:15.108995 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-5c177743-1235-4f95-bfc9-00f268019706 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:15.117941 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5c177743-1235-4f95-bfc9-00f268019706 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6" status: 200 len: 1311 microversion: 2.1 time: 0.234911 Oct 19 03:25:15.118552 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1548/3036] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:14 2022] GET /compute/v2.1/servers/25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6 => generated 1311 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:25:15.536942 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-01c70a12-edc0-46c2-8488-67ee0c27a079 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:15.537677 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-01c70a12-edc0-46c2-8488-67ee0c27a079 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: eb2d22d5-8fc4-4a1a-a2ac-d54318936f21] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:15.546152 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-01c70a12-edc0-46c2-8488-67ee0c27a079 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:15.548571 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-01c70a12-edc0-46c2-8488-67ee0c27a079 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:15.548571 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-01c70a12-edc0-46c2-8488-67ee0c27a079 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:15.548571 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-01c70a12-edc0-46c2-8488-67ee0c27a079 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:15.549577 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-01c70a12-edc0-46c2-8488-67ee0c27a079 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:15.550175 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-01c70a12-edc0-46c2-8488-67ee0c27a079 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:15.778684 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-01c70a12-edc0-46c2-8488-67ee0c27a079 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:15.801122 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-01c70a12-edc0-46c2-8488-67ee0c27a079 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/eb2d22d5-8fc4-4a1a-a2ac-d54318936f21" status: 200 len: 1293 microversion: 2.1 time: 0.267599 Oct 19 03:25:15.802591 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1489/3037] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:15 2022] GET /compute/v2.1/servers/eb2d22d5-8fc4-4a1a-a2ac-d54318936f21 => generated 1293 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:15.821655 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-397bb097-88a5-49f3-b4dc-faea81004b40 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:15.822286 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-397bb097-88a5-49f3-b4dc-faea81004b40 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: e5093d9e-cd31-4074-b339-828de5892bd1] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:15.842126 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-397bb097-88a5-49f3-b4dc-faea81004b40 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:15.845721 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-397bb097-88a5-49f3-b4dc-faea81004b40 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:15.845721 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-397bb097-88a5-49f3-b4dc-faea81004b40 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:15.845721 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-397bb097-88a5-49f3-b4dc-faea81004b40 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:15.845721 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-397bb097-88a5-49f3-b4dc-faea81004b40 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:15.846199 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-397bb097-88a5-49f3-b4dc-faea81004b40 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:16.084559 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-397bb097-88a5-49f3-b4dc-faea81004b40 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:16.097048 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-397bb097-88a5-49f3-b4dc-faea81004b40 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/e5093d9e-cd31-4074-b339-828de5892bd1" status: 200 len: 1308 microversion: 2.1 time: 0.280158 Oct 19 03:25:16.100030 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1549/3038] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:15 2022] GET /compute/v2.1/servers/e5093d9e-cd31-4074-b339-828de5892bd1 => generated 1308 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:25:16.145465 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-52e0b35d-d529-44f1-957f-dcb7d15bff0f tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:16.146294 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-52e0b35d-d529-44f1-957f-dcb7d15bff0f tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:16.155132 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-52e0b35d-d529-44f1-957f-dcb7d15bff0f tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:16.155845 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-52e0b35d-d529-44f1-957f-dcb7d15bff0f tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:16.156588 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-52e0b35d-d529-44f1-957f-dcb7d15bff0f tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:16.157348 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-52e0b35d-d529-44f1-957f-dcb7d15bff0f tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:16.158046 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-52e0b35d-d529-44f1-957f-dcb7d15bff0f tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:16.159581 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-52e0b35d-d529-44f1-957f-dcb7d15bff0f tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:16.420062 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-b947725b-fa52-4657-a074-b63fbb37c222 req-02c4b94b-39db-4a67-9166-99c7f4346f7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5093d9e-cd31-4074-b339-828de5892bd1", "name": "network-vif-plugged", "status": "completed", "tag": "8014cea8-dac9-42ee-b483-a953805bdcd0"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:25:16.442975 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-b947725b-fa52-4657-a074-b63fbb37c222 req-02c4b94b-39db-4a67-9166-99c7f4346f7a service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:16.447499 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-b947725b-fa52-4657-a074-b63fbb37c222 req-02c4b94b-39db-4a67-9166-99c7f4346f7a service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:16.447699 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-b947725b-fa52-4657-a074-b63fbb37c222 req-02c4b94b-39db-4a67-9166-99c7f4346f7a service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:16.478997 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-52e0b35d-d529-44f1-957f-dcb7d15bff0f tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:16.483996 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=100 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:25:16.497176 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-b947725b-fa52-4657-a074-b63fbb37c222 req-02c4b94b-39db-4a67-9166-99c7f4346f7a service nova] Creating event network-vif-plugged:8014cea8-dac9-42ee-b483-a953805bdcd0 for instance e5093d9e-cd31-4074-b339-828de5892bd1 on n-h1-861333-8 Oct 19 03:25:16.499940 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-52e0b35d-d529-44f1-957f-dcb7d15bff0f tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6" status: 200 len: 1311 microversion: 2.1 time: 0.354074 Oct 19 03:25:16.500760 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1490/3039] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:16 2022] GET /compute/v2.1/servers/25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6 => generated 1311 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:25:16.508172 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-b947725b-fa52-4657-a074-b63fbb37c222 req-02c4b94b-39db-4a67-9166-99c7f4346f7a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093986 Oct 19 03:25:16.514484 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1550/3040] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:25:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:25:16.827945 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7ba6529d-45a2-4ad8-9816-99fefc840d0d tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:16.828757 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7ba6529d-45a2-4ad8-9816-99fefc840d0d tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: eb2d22d5-8fc4-4a1a-a2ac-d54318936f21] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:16.840872 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7ba6529d-45a2-4ad8-9816-99fefc840d0d tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:16.841952 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7ba6529d-45a2-4ad8-9816-99fefc840d0d tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:16.842855 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7ba6529d-45a2-4ad8-9816-99fefc840d0d tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:16.845875 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7ba6529d-45a2-4ad8-9816-99fefc840d0d tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:16.847986 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7ba6529d-45a2-4ad8-9816-99fefc840d0d tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:16.848918 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7ba6529d-45a2-4ad8-9816-99fefc840d0d tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:17.127753 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e8ae8200-36a0-4220-a457-43505a4cbc2e tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:17.129587 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e8ae8200-36a0-4220-a457-43505a4cbc2e tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: e5093d9e-cd31-4074-b339-828de5892bd1] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:17.136898 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-7ba6529d-45a2-4ad8-9816-99fefc840d0d tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:17.150043 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7ba6529d-45a2-4ad8-9816-99fefc840d0d tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/eb2d22d5-8fc4-4a1a-a2ac-d54318936f21" status: 200 len: 1475 microversion: 2.1 time: 0.327018 Oct 19 03:25:17.150248 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e8ae8200-36a0-4220-a457-43505a4cbc2e tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:17.152076 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e8ae8200-36a0-4220-a457-43505a4cbc2e tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:17.152076 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e8ae8200-36a0-4220-a457-43505a4cbc2e tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:17.153261 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1491/3041] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:16 2022] GET /compute/v2.1/servers/eb2d22d5-8fc4-4a1a-a2ac-d54318936f21 => generated 1475 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:17.164820 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e8ae8200-36a0-4220-a457-43505a4cbc2e tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:17.165536 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e8ae8200-36a0-4220-a457-43505a4cbc2e tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:17.174203 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e8ae8200-36a0-4220-a457-43505a4cbc2e tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:17.348457 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c6d65115-0ad0-46da-864e-5fc3bb78bcfd tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-833024888", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:25:17.430223 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-c6d65115-0ad0-46da-864e-5fc3bb78bcfd tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] validate_networks() for [('05216dbc-056d-4707-86fe-afea9c8b3e8d', None, None, None, None, None)] {{(pid=121134) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:25:17.578328 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-e8ae8200-36a0-4220-a457-43505a4cbc2e tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:17.588677 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e8ae8200-36a0-4220-a457-43505a4cbc2e tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/e5093d9e-cd31-4074-b339-828de5892bd1" status: 200 len: 1308 microversion: 2.1 time: 0.467319 Oct 19 03:25:17.604759 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1551/3042] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:17 2022] GET /compute/v2.1/servers/e5093d9e-cd31-4074-b339-828de5892bd1 => generated 1308 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:17.610034 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1cb3fd01-d83e-4a89-8bd1-02ac207081a0 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:17.610657 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1cb3fd01-d83e-4a89-8bd1-02ac207081a0 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:17.616763 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1cb3fd01-d83e-4a89-8bd1-02ac207081a0 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:17.617516 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1cb3fd01-d83e-4a89-8bd1-02ac207081a0 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:17.618137 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1cb3fd01-d83e-4a89-8bd1-02ac207081a0 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:17.619010 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1cb3fd01-d83e-4a89-8bd1-02ac207081a0 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:17.619646 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1cb3fd01-d83e-4a89-8bd1-02ac207081a0 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:17.620814 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1cb3fd01-d83e-4a89-8bd1-02ac207081a0 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:17.876089 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-1cb3fd01-d83e-4a89-8bd1-02ac207081a0 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:17.886780 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1cb3fd01-d83e-4a89-8bd1-02ac207081a0 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6" status: 200 len: 1311 microversion: 2.1 time: 0.279900 Oct 19 03:25:17.888931 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1552/3043] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:17 2022] GET /compute/v2.1/servers/25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6 => generated 1311 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:18.509420 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-c6d65115-0ad0-46da-864e-5fc3bb78bcfd tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Flavor limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:25:18.509943 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-c6d65115-0ad0-46da-864e-5fc3bb78bcfd tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Image limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:25:18.510668 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-c6d65115-0ad0-46da-864e-5fc3bb78bcfd tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Flavor pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:25:18.511080 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-c6d65115-0ad0-46da-864e-5fc3bb78bcfd tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Image pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:25:18.511502 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-c6d65115-0ad0-46da-864e-5fc3bb78bcfd tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:25:18.522869 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c6d65115-0ad0-46da-864e-5fc3bb78bcfd tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:18.523546 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c6d65115-0ad0-46da-864e-5fc3bb78bcfd tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:18.523987 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c6d65115-0ad0-46da-864e-5fc3bb78bcfd tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:18.525227 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c6d65115-0ad0-46da-864e-5fc3bb78bcfd tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:18.525973 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c6d65115-0ad0-46da-864e-5fc3bb78bcfd tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:18.527007 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c6d65115-0ad0-46da-864e-5fc3bb78bcfd tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:18.542415 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:DELETE=3 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:25:18.548192 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-c6d65115-0ad0-46da-864e-5fc3bb78bcfd tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Getting quotas for project 7a836a10033546ed9a73a4f463587d72. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:25:18.555400 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-c6d65115-0ad0-46da-864e-5fc3bb78bcfd tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Getting quotas for user b09d2eecd3d9419189e6308379fa8a09 and project 7a836a10033546ed9a73a4f463587d72. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:25:18.569838 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c6d65115-0ad0-46da-864e-5fc3bb78bcfd tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Going to run 1 instances... {{(pid=121134) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:25:18.572668 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c6d65115-0ad0-46da-864e-5fc3bb78bcfd tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 237226a1-b89a-417e-a337-4c9afe08ec87] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:25:18.613732 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-df0f9882-7add-424a-a042-304c39e3a27f tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:18.614526 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-df0f9882-7add-424a-a042-304c39e3a27f tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: e5093d9e-cd31-4074-b339-828de5892bd1] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:18.617884 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=4 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:25:18.622812 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-df0f9882-7add-424a-a042-304c39e3a27f tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:18.623414 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-df0f9882-7add-424a-a042-304c39e3a27f tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:18.623964 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-df0f9882-7add-424a-a042-304c39e3a27f tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:18.624758 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-df0f9882-7add-424a-a042-304c39e3a27f tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:18.625306 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-df0f9882-7add-424a-a042-304c39e3a27f tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:18.625855 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-df0f9882-7add-424a-a042-304c39e3a27f tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:18.752108 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c6d65115-0ad0-46da-864e-5fc3bb78bcfd tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.407925 Oct 19 03:25:18.753547 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1492/3044] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:25:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1410 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 03:25:18.760418 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-8d0bf2f0-e6a0-45e1-a5c4-2e1e8957f51e req-025aece2-29e7-4409-a68c-a4eccd6b61fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6", "name": "network-vif-plugged", "status": "completed", "tag": "b1a17f00-f144-4de3-b98d-df60b15d0f90"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:25:18.780168 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-8d0bf2f0-e6a0-45e1-a5c4-2e1e8957f51e req-025aece2-29e7-4409-a68c-a4eccd6b61fe service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:18.786013 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-8d0bf2f0-e6a0-45e1-a5c4-2e1e8957f51e req-025aece2-29e7-4409-a68c-a4eccd6b61fe service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:18.787531 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-8d0bf2f0-e6a0-45e1-a5c4-2e1e8957f51e req-025aece2-29e7-4409-a68c-a4eccd6b61fe service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:18.803876 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-8d0bf2f0-e6a0-45e1-a5c4-2e1e8957f51e req-025aece2-29e7-4409-a68c-a4eccd6b61fe service nova] Creating event network-vif-plugged:b1a17f00-f144-4de3-b98d-df60b15d0f90 for instance 25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6 on n-h1-861333-8 Oct 19 03:25:18.812580 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-8d0bf2f0-e6a0-45e1-a5c4-2e1e8957f51e req-025aece2-29e7-4409-a68c-a4eccd6b61fe service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057267 Oct 19 03:25:18.815217 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1493/3045] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:25:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:25:18.822799 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ec5fd081-26cd-4fdc-963c-e83d72ced2d1 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:18.827908 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ec5fd081-26cd-4fdc-963c-e83d72ced2d1 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 237226a1-b89a-417e-a337-4c9afe08ec87] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:18.854996 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ec5fd081-26cd-4fdc-963c-e83d72ced2d1 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 237226a1-b89a-417e-a337-4c9afe08ec87] Going to try to terminate instance {{(pid=121134) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:25:18.928218 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-df0f9882-7add-424a-a042-304c39e3a27f tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:18.937389 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-df0f9882-7add-424a-a042-304c39e3a27f tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/e5093d9e-cd31-4074-b339-828de5892bd1" status: 200 len: 1488 microversion: 2.1 time: 0.329038 Oct 19 03:25:18.953425 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1553/3046] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:18 2022] GET /compute/v2.1/servers/e5093d9e-cd31-4074-b339-828de5892bd1 => generated 1488 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:18.958672 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-25092d30-5ffd-4b2f-88cc-72475cf2a94c tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:18.960939 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-25092d30-5ffd-4b2f-88cc-72475cf2a94c tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:19.013779 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-25092d30-5ffd-4b2f-88cc-72475cf2a94c tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:19.015393 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-25092d30-5ffd-4b2f-88cc-72475cf2a94c tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:19.017445 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-25092d30-5ffd-4b2f-88cc-72475cf2a94c tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:19.018955 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-25092d30-5ffd-4b2f-88cc-72475cf2a94c tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:19.022074 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-25092d30-5ffd-4b2f-88cc-72475cf2a94c tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:19.023152 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-25092d30-5ffd-4b2f-88cc-72475cf2a94c tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:19.339388 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-25092d30-5ffd-4b2f-88cc-72475cf2a94c tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:19.350619 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-25092d30-5ffd-4b2f-88cc-72475cf2a94c tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6" status: 200 len: 1311 microversion: 2.1 time: 0.406049 Oct 19 03:25:19.353364 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1554/3047] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:18 2022] GET /compute/v2.1/servers/25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6 => generated 1311 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:19.359111 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-28ecca11-7e26-49e3-af8f-a953b15baeda tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-439177791"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:25:19.364537 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-28ecca11-7e26-49e3-af8f-a953b15baeda tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: e5093d9e-cd31-4074-b339-828de5892bd1] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:19.381650 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-28ecca11-7e26-49e3-af8f-a953b15baeda tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:19.382274 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-28ecca11-7e26-49e3-af8f-a953b15baeda tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:19.382740 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-28ecca11-7e26-49e3-af8f-a953b15baeda tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:19.383496 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-28ecca11-7e26-49e3-af8f-a953b15baeda tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:19.383964 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-28ecca11-7e26-49e3-af8f-a953b15baeda tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:19.384401 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-28ecca11-7e26-49e3-af8f-a953b15baeda tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:19.565796 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ec5fd081-26cd-4fdc-963c-e83d72ced2d1 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "DELETE /compute/v2.1/servers/237226a1-b89a-417e-a337-4c9afe08ec87" status: 204 len: 0 microversion: 2.1 time: 0.748654 Oct 19 03:25:19.569819 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1494/3048] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:25:18 2022] DELETE /compute/v2.1/servers/237226a1-b89a-417e-a337-4c9afe08ec87 => generated 0 bytes in 751 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:25:19.575966 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-66f5e783-01b8-4eb8-a75f-f3ffcae865b1 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:19.576772 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-66f5e783-01b8-4eb8-a75f-f3ffcae865b1 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 237226a1-b89a-417e-a337-4c9afe08ec87] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:19.605844 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-66f5e783-01b8-4eb8-a75f-f3ffcae865b1 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] HTTP exception thrown: Instance 237226a1-b89a-417e-a337-4c9afe08ec87 could not be found. Oct 19 03:25:19.625332 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-66f5e783-01b8-4eb8-a75f-f3ffcae865b1 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Request method failure captured: Oct 19 03:25:19.625332 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/237226a1-b89a-417e-a337-4c9afe08ec87 HTTP/1.1 Oct 19 03:25:19.625332 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:25:19.625332 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:25:19.625332 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:25:19.625332 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:25:19.625332 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:25:19.625332 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:25:19.625332 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:25:19.625332 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:25:19.625332 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT236feAW7aGPVoj9kEkUuQkRB8Nm9YBd70D85XbXnYqUAmlwAIPPx50C6dTRY9MbtBVt7IleIPYf6veKmIP1JclrFv3Px4uu5w7tRxEjRIxVTymsVviR-8HO1OxRuIfq2VSbST57MCBZOLAwnCIkIbO3ZT-DhhWvyFTRPdgvgRqqxa8 Oct 19 03:25:19.625332 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:25:19.625332 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:25:19.625332 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:25:19.625332 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:25:19.625332 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:25:19.625332 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:25:19.625332 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 7a836a10033546ed9a73a4f463587d72 Oct 19 03:25:19.625332 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ServersTestJSON-490256660 Oct 19 03:25:19.625332 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:25:19.625332 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:25:19.626956 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7a836a10033546ed9a73a4f463587d72"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7a836a10033546ed9a73a4f463587d72"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7a836a10033546ed9a73a4f463587d72"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7a836a10033546ed9a73a4f463587d72", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:25:19.626956 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ServersTestJSON-490256660 Oct 19 03:25:19.626956 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 7a836a10033546ed9a73a4f463587d72 Oct 19 03:25:19.626956 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ServersTestJSON-490256660 Oct 19 03:25:19.626956 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ServersTestJSON-490256660-project Oct 19 03:25:19.626956 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:25:19.626956 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:25:19.626956 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: b09d2eecd3d9419189e6308379fa8a09 Oct 19 03:25:19.626956 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ServersTestJSON-490256660-project Oct 19 03:25:19.626956 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:25:19.626956 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance 237226a1-b89a-417e-a337-4c9afe08ec87 could not be found. Oct 19 03:25:19.626956 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '237226a1-b89a-417e-a337-4c9afe08ec87'} Oct 19 03:25:19.627812 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:25:19.627812 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:25:19.627812 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2932, in _get_instance Oct 19 03:25:19.627812 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi build_req = objects.BuildRequest.get_by_instance_uuid( Oct 19 03:25:19.627812 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 03:25:19.627812 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 03:25:19.627812 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 177, in get_by_instance_uuid Oct 19 03:25:19.627812 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi db_req = cls._get_by_instance_uuid_from_db(context, instance_uuid) Oct 19 03:25:19.627812 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 19 03:25:19.627812 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 19 03:25:19.627812 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 172, in _get_by_instance_uuid_from_db Oct 19 03:25:19.627812 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.BuildRequestNotFound(uuid=instance_uuid) Oct 19 03:25:19.627812 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.BuildRequestNotFound: BuildRequest not found for instance 237226a1-b89a-417e-a337-4c9afe08ec87 Oct 19 03:25:19.627812 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:25:19.627812 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:25:19.627812 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:25:19.627812 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:25:19.627812 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:25:19.627812 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:25:19.629113 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:25:19.629113 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:25:19.629113 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2944, in _get_instance Oct 19 03:25:19.629113 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 19 03:25:19.629113 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 237226a1-b89a-417e-a337-4c9afe08ec87 could not be found. Oct 19 03:25:19.629113 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:25:19.629113 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:25:19.629113 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:25:19.629113 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:25:19.629113 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:25:19.629113 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:25:19.629113 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:25:19.629113 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:25:19.629113 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:25:19.629113 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:25:19.629113 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:25:19.629113 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:25:19.629113 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:25:19.629113 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:25:19.629113 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:25:19.638965 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:25:19.638965 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 237226a1-b89a-417e-a337-4c9afe08ec87 could not be found. Oct 19 03:25:19.638965 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:25:19.638965 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:25:19.638965 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:25:19.638965 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:25:19.638965 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:25:19.638965 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:25:19.638965 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:25:19.638965 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:25:19.638965 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 237226a1-b89a-417e-a337-4c9afe08ec87 could not be found. Oct 19 03:25:19.638965 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:25:19.638965 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-66f5e783-01b8-4eb8-a75f-f3ffcae865b1 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Returning 404 to user: Instance 237226a1-b89a-417e-a337-4c9afe08ec87 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:25:19.638965 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-66f5e783-01b8-4eb8-a75f-f3ffcae865b1 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/237226a1-b89a-417e-a337-4c9afe08ec87" status: 404 len: 111 microversion: 2.1 time: 0.061320 Oct 19 03:25:19.640004 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1495/3049] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:19 2022] GET /compute/v2.1/servers/237226a1-b89a-417e-a337-4c9afe08ec87 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:25:19.797508 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d9af25dd-5688-4df6-a59f-2ce0c7cc3ec7 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1483011392", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "05216dbc-056d-4707-86fe-afea9c8b3e8d"}]}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:25:19.863604 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-d9af25dd-5688-4df6-a59f-2ce0c7cc3ec7 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] validate_networks() for [('05216dbc-056d-4707-86fe-afea9c8b3e8d', None, None, None, None, None)] {{(pid=121134) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:25:20.087552 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-28ecca11-7e26-49e3-af8f-a953b15baeda tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "POST /compute/v2.1/servers/e5093d9e-cd31-4074-b339-828de5892bd1/action" status: 202 len: 0 microversion: 2.1 time: 0.732104 Oct 19 03:25:20.091382 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1555/3050] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:25:19 2022] POST /compute/v2.1/servers/e5093d9e-cd31-4074-b339-828de5892bd1/action => generated 0 bytes in 737 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 19 03:25:20.102844 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a4e2e3ba-4c6d-4126-adb6-402a158a20ed tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '.version_select at 0x7fc1302b6af0>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:20.165282 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a4e2e3ba-4c6d-4126-adb6-402a158a20ed tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/images/9014f0d3-c315-4e14-86df-7411ca9d43dc" status: 200 len: 1409 microversion: 2.1 time: 0.066808 Oct 19 03:25:20.166136 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1556/3051] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:25:20 2022] GET /compute/v2.1/images/9014f0d3-c315-4e14-86df-7411ca9d43dc => generated 1409 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:25:20.381740 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-8491518b-6bc6-45a7-ba9e-a5d3a2847cad tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:20.381740 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-8491518b-6bc6-45a7-ba9e-a5d3a2847cad tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:20.388565 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8491518b-6bc6-45a7-ba9e-a5d3a2847cad tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:20.389437 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8491518b-6bc6-45a7-ba9e-a5d3a2847cad tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:20.390038 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8491518b-6bc6-45a7-ba9e-a5d3a2847cad tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:20.391194 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8491518b-6bc6-45a7-ba9e-a5d3a2847cad tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:20.394350 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8491518b-6bc6-45a7-ba9e-a5d3a2847cad tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:20.395158 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8491518b-6bc6-45a7-ba9e-a5d3a2847cad tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:20.681793 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-d9af25dd-5688-4df6-a59f-2ce0c7cc3ec7 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Flavor limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:25:20.682888 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-d9af25dd-5688-4df6-a59f-2ce0c7cc3ec7 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Image limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:25:20.683364 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-d9af25dd-5688-4df6-a59f-2ce0c7cc3ec7 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Flavor pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:25:20.683789 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-d9af25dd-5688-4df6-a59f-2ce0c7cc3ec7 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Image pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:25:20.684223 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-d9af25dd-5688-4df6-a59f-2ce0c7cc3ec7 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:25:20.693993 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=63 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:25:20.698289 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d9af25dd-5688-4df6-a59f-2ce0c7cc3ec7 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:20.699393 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d9af25dd-5688-4df6-a59f-2ce0c7cc3ec7 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:20.699849 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d9af25dd-5688-4df6-a59f-2ce0c7cc3ec7 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:20.700664 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d9af25dd-5688-4df6-a59f-2ce0c7cc3ec7 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:20.701136 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d9af25dd-5688-4df6-a59f-2ce0c7cc3ec7 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:20.701768 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d9af25dd-5688-4df6-a59f-2ce0c7cc3ec7 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:20.728237 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-d9af25dd-5688-4df6-a59f-2ce0c7cc3ec7 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Getting quotas for project 7a836a10033546ed9a73a4f463587d72. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:25:20.738821 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-d9af25dd-5688-4df6-a59f-2ce0c7cc3ec7 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Getting quotas for user b09d2eecd3d9419189e6308379fa8a09 and project 7a836a10033546ed9a73a4f463587d72. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:25:20.755738 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d9af25dd-5688-4df6-a59f-2ce0c7cc3ec7 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Going to run 1 instances... {{(pid=121134) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:25:20.758341 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d9af25dd-5688-4df6-a59f-2ce0c7cc3ec7 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: e0e22e25-87ae-4a48-84b2-d58394a28b62] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:25:20.762357 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-8491518b-6bc6-45a7-ba9e-a5d3a2847cad tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:20.772154 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-8491518b-6bc6-45a7-ba9e-a5d3a2847cad tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6" status: 200 len: 1311 microversion: 2.1 time: 0.398923 Oct 19 03:25:20.786751 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1557/3052] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:20 2022] GET /compute/v2.1/servers/25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6 => generated 1311 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:20.924302 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d9af25dd-5688-4df6-a59f-2ce0c7cc3ec7 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.131529 Oct 19 03:25:20.932271 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1496/3053] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:25:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1140 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 19 03:25:20.949656 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-13696063-5d63-4015-ae84-ce2e6040efc7 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:20.952940 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-13696063-5d63-4015-ae84-ce2e6040efc7 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: e0e22e25-87ae-4a48-84b2-d58394a28b62] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:21.109331 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-13696063-5d63-4015-ae84-ce2e6040efc7 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:21.123062 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-13696063-5d63-4015-ae84-ce2e6040efc7 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/e0e22e25-87ae-4a48-84b2-d58394a28b62" status: 200 len: 1221 microversion: 2.1 time: 0.182888 Oct 19 03:25:21.136533 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1558/3054] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:20 2022] GET /compute/v2.1/servers/e0e22e25-87ae-4a48-84b2-d58394a28b62 => generated 1221 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:21.182918 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-176bd4ca-b1da-4749-825c-9ce5f6006690 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '.version_select at 0x7fc1304de0d0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:21.246637 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-176bd4ca-b1da-4749-825c-9ce5f6006690 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/images/9014f0d3-c315-4e14-86df-7411ca9d43dc" status: 200 len: 1409 microversion: 2.1 time: 0.069112 Oct 19 03:25:21.247571 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1497/3055] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:25:21 2022] GET /compute/v2.1/images/9014f0d3-c315-4e14-86df-7411ca9d43dc => generated 1409 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:21.796664 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f65c75dd-0eb5-448e-b299-40295ea737bd tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:21.797409 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f65c75dd-0eb5-448e-b299-40295ea737bd tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:21.810842 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f65c75dd-0eb5-448e-b299-40295ea737bd tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:21.818038 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f65c75dd-0eb5-448e-b299-40295ea737bd tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:21.818038 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f65c75dd-0eb5-448e-b299-40295ea737bd tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:21.818038 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f65c75dd-0eb5-448e-b299-40295ea737bd tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:21.818038 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f65c75dd-0eb5-448e-b299-40295ea737bd tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:21.818485 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f65c75dd-0eb5-448e-b299-40295ea737bd tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:22.149701 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4110707c-7914-42d5-8914-33bae1f82ba4 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:22.153115 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4110707c-7914-42d5-8914-33bae1f82ba4 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: e0e22e25-87ae-4a48-84b2-d58394a28b62] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:22.161095 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4110707c-7914-42d5-8914-33bae1f82ba4 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:22.163556 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4110707c-7914-42d5-8914-33bae1f82ba4 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:22.164220 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4110707c-7914-42d5-8914-33bae1f82ba4 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:22.165141 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4110707c-7914-42d5-8914-33bae1f82ba4 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:22.165703 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4110707c-7914-42d5-8914-33bae1f82ba4 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:22.171996 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4110707c-7914-42d5-8914-33bae1f82ba4 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:22.288865 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-4110707c-7914-42d5-8914-33bae1f82ba4 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:22.306025 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4110707c-7914-42d5-8914-33bae1f82ba4 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/e0e22e25-87ae-4a48-84b2-d58394a28b62" status: 200 len: 1225 microversion: 2.1 time: 0.154573 Oct 19 03:25:22.306851 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1498/3056] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:22 2022] GET /compute/v2.1/servers/e0e22e25-87ae-4a48-84b2-d58394a28b62 => generated 1225 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:22.330244 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-19632640-f5ac-4468-9939-13b99dd00874 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '.version_select at 0x7fc13109b670>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:22.393273 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-19632640-f5ac-4468-9939-13b99dd00874 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/images/9014f0d3-c315-4e14-86df-7411ca9d43dc" status: 200 len: 1409 microversion: 2.1 time: 0.080285 Oct 19 03:25:22.405152 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1499/3057] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:25:22 2022] GET /compute/v2.1/images/9014f0d3-c315-4e14-86df-7411ca9d43dc => generated 1409 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:22.486347 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f65c75dd-0eb5-448e-b299-40295ea737bd tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:22.498738 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f65c75dd-0eb5-448e-b299-40295ea737bd tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6" status: 200 len: 1493 microversion: 2.1 time: 0.705486 Oct 19 03:25:22.516093 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1559/3058] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:21 2022] GET /compute/v2.1/servers/25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6 => generated 1493 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:22.528717 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-44589ac8-4471-41c8-b7c2-cf1bf42bc0a8 tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:22.529564 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-44589ac8-4471-41c8-b7c2-cf1bf42bc0a8 tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] [instance: 25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:22.544397 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-44589ac8-4471-41c8-b7c2-cf1bf42bc0a8 tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:22.546972 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-44589ac8-4471-41c8-b7c2-cf1bf42bc0a8 tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:22.547543 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-44589ac8-4471-41c8-b7c2-cf1bf42bc0a8 tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:22.554803 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-44589ac8-4471-41c8-b7c2-cf1bf42bc0a8 tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:22.556616 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-44589ac8-4471-41c8-b7c2-cf1bf42bc0a8 tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:22.559085 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-44589ac8-4471-41c8-b7c2-cf1bf42bc0a8 tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:22.823507 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-44589ac8-4471-41c8-b7c2-cf1bf42bc0a8 tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6" status: 200 len: 1644 microversion: 2.1 time: 0.299663 Oct 19 03:25:22.825030 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1500/3059] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:22 2022] GET /compute/v2.1/servers/25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6 => generated 1644 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:22.858824 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-68543d3c-acff-4c90-83a4-f379130567cd tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:22.860442 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-68543d3c-acff-4c90-83a4-f379130567cd tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] [instance: 25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:22.873726 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-68543d3c-acff-4c90-83a4-f379130567cd tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:22.874991 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-68543d3c-acff-4c90-83a4-f379130567cd tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:22.875999 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-68543d3c-acff-4c90-83a4-f379130567cd tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:22.877486 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-68543d3c-acff-4c90-83a4-f379130567cd tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:22.878459 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-68543d3c-acff-4c90-83a4-f379130567cd tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:22.879463 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-68543d3c-acff-4c90-83a4-f379130567cd tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:22.889538 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:25:23.158617 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-530d78cb-3751-40ed-a5f6-b7ef1aac939b tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Action: 'create', calling method: .version_select at 0x7fc130d03700>, body: {"keypair": {"name": "tempest-keypair-2090115582", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDxwr35jf7qAbhUqf6604ZgJ5TD9oYKGNaV1NOHxOB+wFHBwootBz9UWyS1gch6ITyr5nNdu3+zSY7CUhHoXoZgBfU4IYhnSxAwT38Y8AMSUADZIMjN0jBVCOtHJg2nfbA=="}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:25:23.177123 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-530d78cb-3751-40ed-a5f6-b7ef1aac939b tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Getting quotas for project d0b2195b7d124b4eb2552f88dba26b55. Resources: {'key_pairs'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:25:23.185512 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-530d78cb-3751-40ed-a5f6-b7ef1aac939b tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Getting quotas for user f5ed9dc7e0304f28afb381ef2ec3cefd and project d0b2195b7d124b4eb2552f88dba26b55. Resources: {'key_pairs'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:25:23.292963 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-530d78cb-3751-40ed-a5f6-b7ef1aac939b tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.376030 Oct 19 03:25:23.293621 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1501/3060] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Oct 19 03:25:22 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:25:23.331584 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-eae2a9e8-5a3e-417a-ac59-2d1c4bcfe94b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:23.331793 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-68543d3c-acff-4c90-83a4-f379130567cd tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6" status: 200 len: 1644 microversion: 2.1 time: 0.484694 Oct 19 03:25:23.333635 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-eae2a9e8-5a3e-417a-ac59-2d1c4bcfe94b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: e0e22e25-87ae-4a48-84b2-d58394a28b62] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:23.334999 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1560/3061] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:22 2022] GET /compute/v2.1/servers/25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6 => generated 1644 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:23.353063 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eae2a9e8-5a3e-417a-ac59-2d1c4bcfe94b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:23.358759 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eae2a9e8-5a3e-417a-ac59-2d1c4bcfe94b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:23.361302 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eae2a9e8-5a3e-417a-ac59-2d1c4bcfe94b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:23.363982 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eae2a9e8-5a3e-417a-ac59-2d1c4bcfe94b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:23.366722 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eae2a9e8-5a3e-417a-ac59-2d1c4bcfe94b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:23.366852 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-88796d57-f680-4c14-8dc5-f85de42c2e3b tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:23.367819 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eae2a9e8-5a3e-417a-ac59-2d1c4bcfe94b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:23.385952 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-88796d57-f680-4c14-8dc5-f85de42c2e3b tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:23.404608 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-88796d57-f680-4c14-8dc5-f85de42c2e3b tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:23.406548 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-88796d57-f680-4c14-8dc5-f85de42c2e3b tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:23.407410 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-88796d57-f680-4c14-8dc5-f85de42c2e3b tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:23.411455 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-88796d57-f680-4c14-8dc5-f85de42c2e3b tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:23.415259 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-88796d57-f680-4c14-8dc5-f85de42c2e3b tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:23.453739 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-88796d57-f680-4c14-8dc5-f85de42c2e3b tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.096602 Oct 19 03:25:23.455153 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1561/3062] 10.222.0.52 () {58 vars in 1176 bytes} [Wed Oct 19 03:25:23 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:25:23.461603 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2fceb7d0-7e83-4cb7-b409-b3f4d02a4e7f tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '.version_select at 0x7fc1301b95e0>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:23.503138 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-eae2a9e8-5a3e-417a-ac59-2d1c4bcfe94b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:23.517700 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-eae2a9e8-5a3e-417a-ac59-2d1c4bcfe94b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/e0e22e25-87ae-4a48-84b2-d58394a28b62" status: 200 len: 1273 microversion: 2.1 time: 0.190135 Oct 19 03:25:23.521505 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1502/3063] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:23 2022] GET /compute/v2.1/servers/e0e22e25-87ae-4a48-84b2-d58394a28b62 => generated 1273 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:23.530411 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2fceb7d0-7e83-4cb7-b409-b3f4d02a4e7f tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/images/9014f0d3-c315-4e14-86df-7411ca9d43dc" status: 200 len: 1409 microversion: 2.1 time: 0.072518 Oct 19 03:25:23.531534 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1562/3064] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:25:23 2022] GET /compute/v2.1/images/9014f0d3-c315-4e14-86df-7411ca9d43dc => generated 1409 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:23.533914 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2ca7ebd6-537c-4af7-98e5-9a7770750f85 tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:25:23.534532 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2ca7ebd6-537c-4af7-98e5-9a7770750f85 tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] [instance: 25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:23.541940 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2ca7ebd6-537c-4af7-98e5-9a7770750f85 tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:23.542664 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2ca7ebd6-537c-4af7-98e5-9a7770750f85 tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:23.543118 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2ca7ebd6-537c-4af7-98e5-9a7770750f85 tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:23.543827 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2ca7ebd6-537c-4af7-98e5-9a7770750f85 tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:23.544287 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2ca7ebd6-537c-4af7-98e5-9a7770750f85 tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:23.544724 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2ca7ebd6-537c-4af7-98e5-9a7770750f85 tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:23.862551 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2ca7ebd6-537c-4af7-98e5-9a7770750f85 tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6/action" status: 202 len: 0 microversion: 2.1 time: 0.342704 Oct 19 03:25:23.864390 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1503/3065] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:25:23 2022] POST /compute/v2.1/servers/25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6/action => generated 0 bytes in 345 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:25:23.872663 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-cc334c26-c28d-4863-8f80-62c232c6f03b tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:23.873280 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-cc334c26-c28d-4863-8f80-62c232c6f03b tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] [instance: 25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:23.890091 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cc334c26-c28d-4863-8f80-62c232c6f03b tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:23.890860 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cc334c26-c28d-4863-8f80-62c232c6f03b tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:23.891301 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cc334c26-c28d-4863-8f80-62c232c6f03b tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:23.892007 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cc334c26-c28d-4863-8f80-62c232c6f03b tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:23.892457 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cc334c26-c28d-4863-8f80-62c232c6f03b tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:23.892885 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cc334c26-c28d-4863-8f80-62c232c6f03b tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:24.220609 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-cc334c26-c28d-4863-8f80-62c232c6f03b tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6" status: 200 len: 1649 microversion: 2.1 time: 0.351807 Oct 19 03:25:24.221213 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1563/3066] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:23 2022] GET /compute/v2.1/servers/25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6 => generated 1649 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:24.552241 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0e765cf8-8f2c-47f6-b17b-bd91bff987b8 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '.version_select at 0x7fc130d0b670>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:24.558092 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0a6a45ef-1ff5-4bb3-b94e-06d52e53a8a4 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:24.559465 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0a6a45ef-1ff5-4bb3-b94e-06d52e53a8a4 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: e0e22e25-87ae-4a48-84b2-d58394a28b62] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:24.582024 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0a6a45ef-1ff5-4bb3-b94e-06d52e53a8a4 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:24.584333 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0a6a45ef-1ff5-4bb3-b94e-06d52e53a8a4 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:24.585077 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0a6a45ef-1ff5-4bb3-b94e-06d52e53a8a4 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:24.586161 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0a6a45ef-1ff5-4bb3-b94e-06d52e53a8a4 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:24.589824 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0a6a45ef-1ff5-4bb3-b94e-06d52e53a8a4 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:24.590530 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0a6a45ef-1ff5-4bb3-b94e-06d52e53a8a4 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:24.629003 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0e765cf8-8f2c-47f6-b17b-bd91bff987b8 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/images/9014f0d3-c315-4e14-86df-7411ca9d43dc" status: 200 len: 1409 microversion: 2.1 time: 0.079707 Oct 19 03:25:24.629636 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1564/3067] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:25:24 2022] GET /compute/v2.1/images/9014f0d3-c315-4e14-86df-7411ca9d43dc => generated 1409 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:24.760013 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0a6a45ef-1ff5-4bb3-b94e-06d52e53a8a4 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:24.773540 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0a6a45ef-1ff5-4bb3-b94e-06d52e53a8a4 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/e0e22e25-87ae-4a48-84b2-d58394a28b62" status: 200 len: 1279 microversion: 2.1 time: 0.230497 Oct 19 03:25:24.777000 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1504/3068] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:24 2022] GET /compute/v2.1/servers/e0e22e25-87ae-4a48-84b2-d58394a28b62 => generated 1279 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:25.250448 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-275919bc-aac4-4e86-8dac-e0977148dccf tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:25.251701 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-275919bc-aac4-4e86-8dac-e0977148dccf tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] [instance: 25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:25.278125 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-275919bc-aac4-4e86-8dac-e0977148dccf tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:25.280560 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-275919bc-aac4-4e86-8dac-e0977148dccf tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:25.282206 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-275919bc-aac4-4e86-8dac-e0977148dccf tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:25.284596 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-275919bc-aac4-4e86-8dac-e0977148dccf tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:25.286931 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-275919bc-aac4-4e86-8dac-e0977148dccf tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:25.290487 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-275919bc-aac4-4e86-8dac-e0977148dccf tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:25.646810 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a5aa1143-6b3e-4d03-ba8b-0791ddb61d58 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '.version_select at 0x7fc131077c10>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:25.722072 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a5aa1143-6b3e-4d03-ba8b-0791ddb61d58 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/images/9014f0d3-c315-4e14-86df-7411ca9d43dc" status: 200 len: 1409 microversion: 2.1 time: 0.078501 Oct 19 03:25:25.723061 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1505/3069] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:25:25 2022] GET /compute/v2.1/images/9014f0d3-c315-4e14-86df-7411ca9d43dc => generated 1409 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:25:25.788805 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-275919bc-aac4-4e86-8dac-e0977148dccf tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6" status: 200 len: 1629 microversion: 2.1 time: 0.548302 Oct 19 03:25:25.790539 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1565/3070] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:25 2022] GET /compute/v2.1/servers/25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6 => generated 1629 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:25.805526 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3e579d5c-45d7-46f7-8099-dfe12cccb24a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:25.806235 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3e579d5c-45d7-46f7-8099-dfe12cccb24a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: e0e22e25-87ae-4a48-84b2-d58394a28b62] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:25.816635 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3e579d5c-45d7-46f7-8099-dfe12cccb24a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:25.817234 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3e579d5c-45d7-46f7-8099-dfe12cccb24a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:25.817721 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3e579d5c-45d7-46f7-8099-dfe12cccb24a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:25.818578 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3e579d5c-45d7-46f7-8099-dfe12cccb24a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:25.819272 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-795eae2b-d5e1-438b-ad5c-70944f0e63e2 tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-861333-8", "block_migration": true, "disk_over_commit": false}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:25:25.819445 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3e579d5c-45d7-46f7-8099-dfe12cccb24a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:25.819879 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3e579d5c-45d7-46f7-8099-dfe12cccb24a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:25.822218 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-795eae2b-d5e1-438b-ad5c-70944f0e63e2 tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] [instance: 25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:25.830529 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=3,nova_api:INSERT=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:25:25.837328 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-795eae2b-d5e1-438b-ad5c-70944f0e63e2 tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:25.837328 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-795eae2b-d5e1-438b-ad5c-70944f0e63e2 tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:25.837328 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-795eae2b-d5e1-438b-ad5c-70944f0e63e2 tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:25.837328 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-795eae2b-d5e1-438b-ad5c-70944f0e63e2 tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:25.838102 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-795eae2b-d5e1-438b-ad5c-70944f0e63e2 tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:25.838102 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-795eae2b-d5e1-438b-ad5c-70944f0e63e2 tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:25.883756 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-795eae2b-d5e1-438b-ad5c-70944f0e63e2 tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Lazy-loading 'flavor' on Instance uuid 25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6 {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:25:25.909659 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-795eae2b-d5e1-438b-ad5c-70944f0e63e2 tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] [instance: 25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6] Going to try to live migrate instance to n-h2-861333-8 {{(pid=121135) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 19 03:25:26.457431 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-3e579d5c-45d7-46f7-8099-dfe12cccb24a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:26.472204 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3e579d5c-45d7-46f7-8099-dfe12cccb24a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/e0e22e25-87ae-4a48-84b2-d58394a28b62" status: 200 len: 1321 microversion: 2.1 time: 0.671202 Oct 19 03:25:26.473488 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1506/3071] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:25 2022] GET /compute/v2.1/servers/e0e22e25-87ae-4a48-84b2-d58394a28b62 => generated 1321 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:26.740483 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-87b4766d-e100-4a49-a0b1-666a7a6d980b tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '.version_select at 0x7fc131077a60>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:26.827497 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-87b4766d-e100-4a49-a0b1-666a7a6d980b tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/images/9014f0d3-c315-4e14-86df-7411ca9d43dc" status: 200 len: 1409 microversion: 2.1 time: 0.080359 Oct 19 03:25:26.829831 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1507/3072] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:25:26 2022] GET /compute/v2.1/images/9014f0d3-c315-4e14-86df-7411ca9d43dc => generated 1409 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:25:27.503714 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-dd4006a1-a029-4983-b8f0-6f0d03de91a0 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:27.505181 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-dd4006a1-a029-4983-b8f0-6f0d03de91a0 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: e0e22e25-87ae-4a48-84b2-d58394a28b62] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:27.556242 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dd4006a1-a029-4983-b8f0-6f0d03de91a0 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:27.558168 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dd4006a1-a029-4983-b8f0-6f0d03de91a0 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:27.563254 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dd4006a1-a029-4983-b8f0-6f0d03de91a0 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:27.564241 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dd4006a1-a029-4983-b8f0-6f0d03de91a0 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:27.567324 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dd4006a1-a029-4983-b8f0-6f0d03de91a0 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:27.568044 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dd4006a1-a029-4983-b8f0-6f0d03de91a0 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:27.966603 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-dd4006a1-a029-4983-b8f0-6f0d03de91a0 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:27.975181 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-dd4006a1-a029-4983-b8f0-6f0d03de91a0 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/e0e22e25-87ae-4a48-84b2-d58394a28b62" status: 200 len: 1321 microversion: 2.1 time: 0.479432 Oct 19 03:25:27.985499 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1508/3073] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:27 2022] GET /compute/v2.1/servers/e0e22e25-87ae-4a48-84b2-d58394a28b62 => generated 1321 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:27.985499 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-23b1809a-fffa-4df8-9ca8-2b5a755740e5 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '.version_select at 0x7fc130c18a60>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:28.045080 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-23b1809a-fffa-4df8-9ca8-2b5a755740e5 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/images/9014f0d3-c315-4e14-86df-7411ca9d43dc" status: 200 len: 1409 microversion: 2.1 time: 0.066756 Oct 19 03:25:28.054826 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1509/3074] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:25:27 2022] GET /compute/v2.1/images/9014f0d3-c315-4e14-86df-7411ca9d43dc => generated 1409 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:28.476592 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-1b439643-7077-4ea4-ba72-c8d59f078444 req-2ce184ba-e791-43cc-9728-2d526202cb46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5093d9e-cd31-4074-b339-828de5892bd1", "name": "network-vif-plugged", "status": "completed", "tag": "8014cea8-dac9-42ee-b483-a953805bdcd0"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:25:28.505273 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-1b439643-7077-4ea4-ba72-c8d59f078444 req-2ce184ba-e791-43cc-9728-2d526202cb46 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:28.505877 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-1b439643-7077-4ea4-ba72-c8d59f078444 req-2ce184ba-e791-43cc-9728-2d526202cb46 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:28.506320 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-1b439643-7077-4ea4-ba72-c8d59f078444 req-2ce184ba-e791-43cc-9728-2d526202cb46 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:28.518172 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-1b439643-7077-4ea4-ba72-c8d59f078444 req-2ce184ba-e791-43cc-9728-2d526202cb46 service nova] Creating event network-vif-plugged:8014cea8-dac9-42ee-b483-a953805bdcd0 for instance e5093d9e-cd31-4074-b339-828de5892bd1 on n-h1-861333-8 Oct 19 03:25:28.534439 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-1b439643-7077-4ea4-ba72-c8d59f078444 req-2ce184ba-e791-43cc-9728-2d526202cb46 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063393 Oct 19 03:25:28.535361 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1510/3075] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:25:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:25:29.002490 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ebd27734-6c3b-4991-8d80-56c3bd86eccd tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:29.003292 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ebd27734-6c3b-4991-8d80-56c3bd86eccd tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: e0e22e25-87ae-4a48-84b2-d58394a28b62] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:29.017711 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ebd27734-6c3b-4991-8d80-56c3bd86eccd tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:29.019980 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ebd27734-6c3b-4991-8d80-56c3bd86eccd tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:29.021236 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ebd27734-6c3b-4991-8d80-56c3bd86eccd tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:29.023450 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ebd27734-6c3b-4991-8d80-56c3bd86eccd tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:29.024833 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ebd27734-6c3b-4991-8d80-56c3bd86eccd tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:29.026504 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ebd27734-6c3b-4991-8d80-56c3bd86eccd tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:29.562423 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ebd27734-6c3b-4991-8d80-56c3bd86eccd tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:29.582871 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ebd27734-6c3b-4991-8d80-56c3bd86eccd tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/e0e22e25-87ae-4a48-84b2-d58394a28b62" status: 200 len: 1321 microversion: 2.1 time: 0.581777 Oct 19 03:25:29.583433 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1511/3076] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:28 2022] GET /compute/v2.1/servers/e0e22e25-87ae-4a48-84b2-d58394a28b62 => generated 1321 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:29.591746 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e4aaba58-6c3c-4b10-b21a-6ca5fcac1f54 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '.version_select at 0x7fc130cb9670>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:29.684262 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e4aaba58-6c3c-4b10-b21a-6ca5fcac1f54 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/images/9014f0d3-c315-4e14-86df-7411ca9d43dc" status: 200 len: 1409 microversion: 2.1 time: 0.096090 Oct 19 03:25:29.686261 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1512/3077] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:25:29 2022] GET /compute/v2.1/images/9014f0d3-c315-4e14-86df-7411ca9d43dc => generated 1409 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:29.694074 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d5cc7dfc-f26a-4636-b4b1-91a20a002474 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "79ef236d-b6aa-4c73-809b-90ae374cbd79"}], "security_groups": [{"name": "tempest-securitygroup--176577449"}], "key_name": "tempest-keypair-2090115582", "user_data": "}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:25:30.013578 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-d5cc7dfc-f26a-4636-b4b1-91a20a002474 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] validate_networks() for [('79ef236d-b6aa-4c73-809b-90ae374cbd79', None, None, None, None, None)] {{(pid=121134) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:25:30.442121 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-795eae2b-d5e1-438b-ad5c-70944f0e63e2 tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6/action" status: 202 len: 0 microversion: 2.1 time: 4.628478 Oct 19 03:25:30.447831 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1566/3078] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:25:25 2022] POST /compute/v2.1/servers/25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6/action => generated 0 bytes in 4634 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:25:30.454923 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-8df7cdf3-260a-4f36-951d-332ffeafaf5c req-11f76d14-a7fe-42a2-ae74-571c3c46800e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0e22e25-87ae-4a48-84b2-d58394a28b62", "tag": "fe670da9-cb46-44b6-bddd-430129cebeb9"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:25:30.485525 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-8df7cdf3-260a-4f36-951d-332ffeafaf5c req-11f76d14-a7fe-42a2-ae74-571c3c46800e service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:30.486302 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-8df7cdf3-260a-4f36-951d-332ffeafaf5c req-11f76d14-a7fe-42a2-ae74-571c3c46800e service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:30.487013 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-8df7cdf3-260a-4f36-951d-332ffeafaf5c req-11f76d14-a7fe-42a2-ae74-571c3c46800e service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:30.504966 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-8df7cdf3-260a-4f36-951d-332ffeafaf5c req-11f76d14-a7fe-42a2-ae74-571c3c46800e service nova] Creating event network-changed:fe670da9-cb46-44b6-bddd-430129cebeb9 for instance e0e22e25-87ae-4a48-84b2-d58394a28b62 on n-h2-861333-8 Oct 19 03:25:30.512956 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-8df7cdf3-260a-4f36-951d-332ffeafaf5c req-11f76d14-a7fe-42a2-ae74-571c3c46800e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063039 Oct 19 03:25:30.515400 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1567/3079] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:25:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:25:30.665287 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6bcb277d-0b49-4ad9-9959-95e2cacba085 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-1206523221", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "networks": [{"uuid": "8d6aa693-62d1-4fe7-be53-f3766990ce90"}]}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:25:30.720329 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=4 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:25:30.783274 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.network.neutron [None req-6bcb277d-0b49-4ad9-9959-95e2cacba085 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] validate_networks() for [('8d6aa693-62d1-4fe7-be53-f3766990ce90', None, None, None, None, None)] {{(pid=121135) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:25:31.114166 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:25:31.155414 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-d5cc7dfc-f26a-4636-b4b1-91a20a002474 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Flavor limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:25:31.155931 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-d5cc7dfc-f26a-4636-b4b1-91a20a002474 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Image limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:25:31.156309 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-d5cc7dfc-f26a-4636-b4b1-91a20a002474 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Flavor pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:25:31.156725 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-d5cc7dfc-f26a-4636-b4b1-91a20a002474 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Image pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:25:31.157144 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-d5cc7dfc-f26a-4636-b4b1-91a20a002474 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:25:31.168935 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d5cc7dfc-f26a-4636-b4b1-91a20a002474 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:31.169819 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d5cc7dfc-f26a-4636-b4b1-91a20a002474 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:31.170690 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d5cc7dfc-f26a-4636-b4b1-91a20a002474 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:31.172174 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d5cc7dfc-f26a-4636-b4b1-91a20a002474 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:31.172873 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d5cc7dfc-f26a-4636-b4b1-91a20a002474 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:31.173901 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d5cc7dfc-f26a-4636-b4b1-91a20a002474 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:31.224088 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-d5cc7dfc-f26a-4636-b4b1-91a20a002474 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Getting quotas for project d0b2195b7d124b4eb2552f88dba26b55. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:25:31.232010 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-d5cc7dfc-f26a-4636-b4b1-91a20a002474 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Getting quotas for user f5ed9dc7e0304f28afb381ef2ec3cefd and project d0b2195b7d124b4eb2552f88dba26b55. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:25:31.249759 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d5cc7dfc-f26a-4636-b4b1-91a20a002474 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Going to run 1 instances... {{(pid=121134) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:25:31.253435 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d5cc7dfc-f26a-4636-b4b1-91a20a002474 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] [instance: 4c823d1c-eebe-4aa6-972c-38209d6cc70e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:25:31.411050 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d5cc7dfc-f26a-4636-b4b1-91a20a002474 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.720804 Oct 19 03:25:31.412457 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1513/3080] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:25:29 2022] POST /compute/v2.1/servers => generated 408 bytes in 1725 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 03:25:31.429734 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f8a2314c-7974-4bb9-9fc2-0f85f17c1f53 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:31.432512 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f8a2314c-7974-4bb9-9fc2-0f85f17c1f53 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:31.444883 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f8a2314c-7974-4bb9-9fc2-0f85f17c1f53 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:31.448419 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f8a2314c-7974-4bb9-9fc2-0f85f17c1f53 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:31.451567 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f8a2314c-7974-4bb9-9fc2-0f85f17c1f53 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:31.455208 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f8a2314c-7974-4bb9-9fc2-0f85f17c1f53 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:31.457611 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f8a2314c-7974-4bb9-9fc2-0f85f17c1f53 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:31.460367 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f8a2314c-7974-4bb9-9fc2-0f85f17c1f53 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:31.582630 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-6bcb277d-0b49-4ad9-9959-95e2cacba085 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Flavor limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:25:31.583184 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-6bcb277d-0b49-4ad9-9959-95e2cacba085 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Image limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:25:31.583539 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-6bcb277d-0b49-4ad9-9959-95e2cacba085 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Flavor pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:25:31.583956 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-6bcb277d-0b49-4ad9-9959-95e2cacba085 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Image pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:25:31.584458 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-6bcb277d-0b49-4ad9-9959-95e2cacba085 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:25:31.606203 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6bcb277d-0b49-4ad9-9959-95e2cacba085 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:31.607017 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6bcb277d-0b49-4ad9-9959-95e2cacba085 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:31.607824 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6bcb277d-0b49-4ad9-9959-95e2cacba085 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:31.608876 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6bcb277d-0b49-4ad9-9959-95e2cacba085 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:31.609968 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6bcb277d-0b49-4ad9-9959-95e2cacba085 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:31.610902 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6bcb277d-0b49-4ad9-9959-95e2cacba085 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:31.657305 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-6bcb277d-0b49-4ad9-9959-95e2cacba085 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Getting quotas for project 91f91748d2e94f85a70dcc787713fb6e. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:25:31.675160 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-6bcb277d-0b49-4ad9-9959-95e2cacba085 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Getting quotas for user a7bf94a5de054f98a24a6a8f3d5fea9b and project 91f91748d2e94f85a70dcc787713fb6e. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:25:31.707253 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6bcb277d-0b49-4ad9-9959-95e2cacba085 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Going to run 1 instances... {{(pid=121135) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:25:31.713106 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-f8a2314c-7974-4bb9-9fc2-0f85f17c1f53 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:31.726574 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f8a2314c-7974-4bb9-9fc2-0f85f17c1f53 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6" status: 200 len: 1503 microversion: 2.1 time: 0.311408 Oct 19 03:25:31.729193 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6bcb277d-0b49-4ad9-9959-95e2cacba085 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] [instance: dac9628d-657b-4e72-8a7f-08156be8fad7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121135) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:25:31.729323 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1514/3081] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:31 2022] GET /compute/v2.1/servers/25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6 => generated 1503 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:31.746302 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e4a296a1-f6ed-457e-bda3-da49715944f4 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:31.746944 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e4a296a1-f6ed-457e-bda3-da49715944f4 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: e0e22e25-87ae-4a48-84b2-d58394a28b62] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:31.763250 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=10,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:25:31.779339 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e4a296a1-f6ed-457e-bda3-da49715944f4 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:31.782493 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e4a296a1-f6ed-457e-bda3-da49715944f4 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:31.784372 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e4a296a1-f6ed-457e-bda3-da49715944f4 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:31.785457 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e4a296a1-f6ed-457e-bda3-da49715944f4 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:31.787102 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e4a296a1-f6ed-457e-bda3-da49715944f4 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:31.788918 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e4a296a1-f6ed-457e-bda3-da49715944f4 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:31.891953 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6bcb277d-0b49-4ad9-9959-95e2cacba085 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 1.373589 Oct 19 03:25:31.892963 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1568/3082] 10.222.0.52 () {62 vars in 1188 bytes} [Wed Oct 19 03:25:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1376 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 19 03:25:31.903279 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f2857e02-c8e5-4ecb-a4f4-f4fbfaacddba tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '.version_select at 0x7fc134f74dc0>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:31.974044 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f2857e02-c8e5-4ecb-a4f4-f4fbfaacddba tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/images/9014f0d3-c315-4e14-86df-7411ca9d43dc" status: 200 len: 1409 microversion: 2.1 time: 0.079915 Oct 19 03:25:31.983392 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1569/3083] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:25:31 2022] GET /compute/v2.1/images/9014f0d3-c315-4e14-86df-7411ca9d43dc => generated 1409 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:31.989110 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6c412018-8347-42cd-b38e-c819be635c72 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:31.989810 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6c412018-8347-42cd-b38e-c819be635c72 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] [instance: 4c823d1c-eebe-4aa6-972c-38209d6cc70e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:32.139047 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-6c412018-8347-42cd-b38e-c819be635c72 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5ed9dc7e0304f28afb381ef2ec3cefd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b2195b7d124b4eb2552f88dba26b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:32.151489 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6c412018-8347-42cd-b38e-c819be635c72 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] 10.222.0.52 "GET /compute/v2.1/servers/4c823d1c-eebe-4aa6-972c-38209d6cc70e" status: 200 len: 1226 microversion: 2.1 time: 0.165398 Oct 19 03:25:32.152620 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1570/3084] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:31 2022] GET /compute/v2.1/servers/4c823d1c-eebe-4aa6-972c-38209d6cc70e => generated 1226 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:32.180759 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e4a296a1-f6ed-457e-bda3-da49715944f4 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:32.181461 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ea626357-cda7-4ff4-bc52-b056a8b88da7 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:32.184990 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ea626357-cda7-4ff4-bc52-b056a8b88da7 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] [instance: dac9628d-657b-4e72-8a7f-08156be8fad7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:32.197353 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e4a296a1-f6ed-457e-bda3-da49715944f4 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/e0e22e25-87ae-4a48-84b2-d58394a28b62" status: 200 len: 1321 microversion: 2.1 time: 0.465036 Oct 19 03:25:32.198554 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1515/3085] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:31 2022] GET /compute/v2.1/servers/e0e22e25-87ae-4a48-84b2-d58394a28b62 => generated 1321 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:32.382928 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ea626357-cda7-4ff4-bc52-b056a8b88da7 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7bf94a5de054f98a24a6a8f3d5fea9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f91748d2e94f85a70dcc787713fb6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:32.398807 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ea626357-cda7-4ff4-bc52-b056a8b88da7 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7bf94a5de054f98a24a6a8f3d5fea9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f91748d2e94f85a70dcc787713fb6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:32.403736 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ea626357-cda7-4ff4-bc52-b056a8b88da7 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7bf94a5de054f98a24a6a8f3d5fea9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f91748d2e94f85a70dcc787713fb6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:32.406700 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ea626357-cda7-4ff4-bc52-b056a8b88da7 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] 10.222.0.52 "GET /compute/v2.1/servers/dac9628d-657b-4e72-8a7f-08156be8fad7" status: 200 len: 1259 microversion: 2.21 time: 0.234288 Oct 19 03:25:32.409087 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1571/3086] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:25:32 2022] GET /compute/v2.1/servers/dac9628d-657b-4e72-8a7f-08156be8fad7 => generated 1259 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:25:32.766641 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f3b4bc3c-21fd-4282-a19c-405286163485 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:32.767387 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f3b4bc3c-21fd-4282-a19c-405286163485 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:32.782604 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f3b4bc3c-21fd-4282-a19c-405286163485 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:32.783413 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f3b4bc3c-21fd-4282-a19c-405286163485 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:32.784170 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f3b4bc3c-21fd-4282-a19c-405286163485 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:32.785054 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f3b4bc3c-21fd-4282-a19c-405286163485 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:32.785737 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f3b4bc3c-21fd-4282-a19c-405286163485 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:32.786481 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f3b4bc3c-21fd-4282-a19c-405286163485 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:32.994707 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f9084617-bc85-4740-acc9-c7896505b3b7 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '.version_select at 0x7fc1310f6310>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:33.070961 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f9084617-bc85-4740-acc9-c7896505b3b7 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/images/9014f0d3-c315-4e14-86df-7411ca9d43dc" status: 200 len: 1409 microversion: 2.1 time: 0.084074 Oct 19 03:25:33.072553 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1572/3087] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:25:32 2022] GET /compute/v2.1/images/9014f0d3-c315-4e14-86df-7411ca9d43dc => generated 1409 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:25:33.145159 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-f3b4bc3c-21fd-4282-a19c-405286163485 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:33.156748 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f3b4bc3c-21fd-4282-a19c-405286163485 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6" status: 200 len: 1503 microversion: 2.1 time: 0.399945 Oct 19 03:25:33.157780 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1516/3088] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:32 2022] GET /compute/v2.1/servers/25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6 => generated 1503 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:33.182684 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-49edd9f6-d044-4a9c-89f0-026084784ae2 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:33.184007 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-49edd9f6-d044-4a9c-89f0-026084784ae2 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] [instance: 4c823d1c-eebe-4aa6-972c-38209d6cc70e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:33.196133 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-49edd9f6-d044-4a9c-89f0-026084784ae2 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:33.196640 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-49edd9f6-d044-4a9c-89f0-026084784ae2 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:33.197084 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-49edd9f6-d044-4a9c-89f0-026084784ae2 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:33.205500 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-49edd9f6-d044-4a9c-89f0-026084784ae2 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:33.206325 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-49edd9f6-d044-4a9c-89f0-026084784ae2 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:33.206965 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-49edd9f6-d044-4a9c-89f0-026084784ae2 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:33.225965 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9e67c276-d7a0-41cf-a6b6-f8777ab828e3 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:33.225965 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9e67c276-d7a0-41cf-a6b6-f8777ab828e3 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: e0e22e25-87ae-4a48-84b2-d58394a28b62] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:33.240541 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9e67c276-d7a0-41cf-a6b6-f8777ab828e3 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:33.241673 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9e67c276-d7a0-41cf-a6b6-f8777ab828e3 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:33.242667 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9e67c276-d7a0-41cf-a6b6-f8777ab828e3 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:33.245274 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9e67c276-d7a0-41cf-a6b6-f8777ab828e3 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:33.250645 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9e67c276-d7a0-41cf-a6b6-f8777ab828e3 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:33.250645 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9e67c276-d7a0-41cf-a6b6-f8777ab828e3 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:33.360419 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-49edd9f6-d044-4a9c-89f0-026084784ae2 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5ed9dc7e0304f28afb381ef2ec3cefd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b2195b7d124b4eb2552f88dba26b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:33.371434 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-49edd9f6-d044-4a9c-89f0-026084784ae2 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] 10.222.0.52 "GET /compute/v2.1/servers/4c823d1c-eebe-4aa6-972c-38209d6cc70e" status: 200 len: 1230 microversion: 2.1 time: 0.196101 Oct 19 03:25:33.373210 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1573/3089] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:33 2022] GET /compute/v2.1/servers/4c823d1c-eebe-4aa6-972c-38209d6cc70e => generated 1230 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:33.435354 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-cc9241b3-1d12-4032-b2d5-06fa404b3d15 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:33.436275 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-cc9241b3-1d12-4032-b2d5-06fa404b3d15 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] [instance: dac9628d-657b-4e72-8a7f-08156be8fad7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:33.540675 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-cc9241b3-1d12-4032-b2d5-06fa404b3d15 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7bf94a5de054f98a24a6a8f3d5fea9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f91748d2e94f85a70dcc787713fb6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:33.549704 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-cc9241b3-1d12-4032-b2d5-06fa404b3d15 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7bf94a5de054f98a24a6a8f3d5fea9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f91748d2e94f85a70dcc787713fb6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:33.555807 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-cc9241b3-1d12-4032-b2d5-06fa404b3d15 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7bf94a5de054f98a24a6a8f3d5fea9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f91748d2e94f85a70dcc787713fb6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:33.557268 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-cc9241b3-1d12-4032-b2d5-06fa404b3d15 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] 10.222.0.52 "GET /compute/v2.1/servers/dac9628d-657b-4e72-8a7f-08156be8fad7" status: 200 len: 1259 microversion: 2.21 time: 0.126325 Oct 19 03:25:33.558965 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1574/3090] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:25:33 2022] GET /compute/v2.1/servers/dac9628d-657b-4e72-8a7f-08156be8fad7 => generated 1259 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:25:33.696437 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9e67c276-d7a0-41cf-a6b6-f8777ab828e3 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:33.710990 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9e67c276-d7a0-41cf-a6b6-f8777ab828e3 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/e0e22e25-87ae-4a48-84b2-d58394a28b62" status: 200 len: 1321 microversion: 2.1 time: 0.487577 Oct 19 03:25:33.731671 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1517/3091] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:33 2022] GET /compute/v2.1/servers/e0e22e25-87ae-4a48-84b2-d58394a28b62 => generated 1321 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:25:33.885767 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-0855f19e-0366-4eb2-a66e-0e7b4e005fb7 req-a7bf7c5a-3bc6-4640-b4da-d5acc1e55e49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6", "name": "network-vif-unplugged", "status": "completed", "tag": "b1a17f00-f144-4de3-b98d-df60b15d0f90"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:25:33.915851 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-0855f19e-0366-4eb2-a66e-0e7b4e005fb7 req-a7bf7c5a-3bc6-4640-b4da-d5acc1e55e49 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:33.916828 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-0855f19e-0366-4eb2-a66e-0e7b4e005fb7 req-a7bf7c5a-3bc6-4640-b4da-d5acc1e55e49 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:33.917630 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-0855f19e-0366-4eb2-a66e-0e7b4e005fb7 req-a7bf7c5a-3bc6-4640-b4da-d5acc1e55e49 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:33.929969 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-0855f19e-0366-4eb2-a66e-0e7b4e005fb7 req-a7bf7c5a-3bc6-4640-b4da-d5acc1e55e49 service nova] Creating event network-vif-unplugged:b1a17f00-f144-4de3-b98d-df60b15d0f90 for instance 25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6 on n-h1-861333-8 Oct 19 03:25:33.936965 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-0855f19e-0366-4eb2-a66e-0e7b4e005fb7 req-a7bf7c5a-3bc6-4640-b4da-d5acc1e55e49 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057182 Oct 19 03:25:33.938584 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1575/3092] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:25:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:25:34.090443 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a11e18af-6b62-415e-9897-6358fe548ef3 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '.version_select at 0x7fc130e4a4c0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:34.187244 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-97125bf5-eec1-43f5-ae7a-d4099963c625 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:34.188210 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-97125bf5-eec1-43f5-ae7a-d4099963c625 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:34.194667 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a11e18af-6b62-415e-9897-6358fe548ef3 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/images/9014f0d3-c315-4e14-86df-7411ca9d43dc" status: 200 len: 1409 microversion: 2.1 time: 0.096289 Oct 19 03:25:34.198529 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1518/3093] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:25:34 2022] GET /compute/v2.1/images/9014f0d3-c315-4e14-86df-7411ca9d43dc => generated 1409 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:34.212759 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-97125bf5-eec1-43f5-ae7a-d4099963c625 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:34.217139 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-97125bf5-eec1-43f5-ae7a-d4099963c625 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:34.219399 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-97125bf5-eec1-43f5-ae7a-d4099963c625 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:34.220341 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-97125bf5-eec1-43f5-ae7a-d4099963c625 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:34.225651 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-97125bf5-eec1-43f5-ae7a-d4099963c625 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:34.227286 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-97125bf5-eec1-43f5-ae7a-d4099963c625 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:34.405300 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1620dcd4-ca5a-4790-b87b-159e873abda4 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:34.406613 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1620dcd4-ca5a-4790-b87b-159e873abda4 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] [instance: 4c823d1c-eebe-4aa6-972c-38209d6cc70e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:34.416351 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1620dcd4-ca5a-4790-b87b-159e873abda4 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:34.417168 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1620dcd4-ca5a-4790-b87b-159e873abda4 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:34.424544 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1620dcd4-ca5a-4790-b87b-159e873abda4 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:34.424544 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1620dcd4-ca5a-4790-b87b-159e873abda4 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:34.424544 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1620dcd4-ca5a-4790-b87b-159e873abda4 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:34.424544 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1620dcd4-ca5a-4790-b87b-159e873abda4 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:34.648367 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-1620dcd4-ca5a-4790-b87b-159e873abda4 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5ed9dc7e0304f28afb381ef2ec3cefd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b2195b7d124b4eb2552f88dba26b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:34.652808 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:25:34.667553 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1620dcd4-ca5a-4790-b87b-159e873abda4 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] 10.222.0.52 "GET /compute/v2.1/servers/4c823d1c-eebe-4aa6-972c-38209d6cc70e" status: 200 len: 1278 microversion: 2.1 time: 0.269448 Oct 19 03:25:34.668342 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1519/3094] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:34 2022] GET /compute/v2.1/servers/4c823d1c-eebe-4aa6-972c-38209d6cc70e => generated 1278 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:34.694783 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ceb596b4-d21b-4827-8e97-5b52bb83c4d8 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:34.698373 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ceb596b4-d21b-4827-8e97-5b52bb83c4d8 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] [instance: dac9628d-657b-4e72-8a7f-08156be8fad7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:34.718178 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ceb596b4-d21b-4827-8e97-5b52bb83c4d8 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:34.719524 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ceb596b4-d21b-4827-8e97-5b52bb83c4d8 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:34.720288 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ceb596b4-d21b-4827-8e97-5b52bb83c4d8 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:34.724676 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ceb596b4-d21b-4827-8e97-5b52bb83c4d8 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:34.727059 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ceb596b4-d21b-4827-8e97-5b52bb83c4d8 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:34.727796 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ceb596b4-d21b-4827-8e97-5b52bb83c4d8 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:34.775740 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-97125bf5-eec1-43f5-ae7a-d4099963c625 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:34.787176 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-97125bf5-eec1-43f5-ae7a-d4099963c625 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6" status: 200 len: 1503 microversion: 2.1 time: 0.605296 Oct 19 03:25:34.787778 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1576/3095] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:34 2022] GET /compute/v2.1/servers/25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6 => generated 1503 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:25:34.798571 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-8116d8ee-b7de-45f1-816e-d6b6bff092ca tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:34.799199 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-8116d8ee-b7de-45f1-816e-d6b6bff092ca tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: e0e22e25-87ae-4a48-84b2-d58394a28b62] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:34.814101 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8116d8ee-b7de-45f1-816e-d6b6bff092ca tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:34.814615 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8116d8ee-b7de-45f1-816e-d6b6bff092ca tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:34.820776 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8116d8ee-b7de-45f1-816e-d6b6bff092ca tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:34.820776 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8116d8ee-b7de-45f1-816e-d6b6bff092ca tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:34.820776 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8116d8ee-b7de-45f1-816e-d6b6bff092ca tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:34.820776 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8116d8ee-b7de-45f1-816e-d6b6bff092ca tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:34.842249 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ceb596b4-d21b-4827-8e97-5b52bb83c4d8 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7bf94a5de054f98a24a6a8f3d5fea9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f91748d2e94f85a70dcc787713fb6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:34.855006 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ceb596b4-d21b-4827-8e97-5b52bb83c4d8 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7bf94a5de054f98a24a6a8f3d5fea9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f91748d2e94f85a70dcc787713fb6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:34.857256 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ceb596b4-d21b-4827-8e97-5b52bb83c4d8 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7bf94a5de054f98a24a6a8f3d5fea9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f91748d2e94f85a70dcc787713fb6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:34.862370 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ceb596b4-d21b-4827-8e97-5b52bb83c4d8 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] 10.222.0.52 "GET /compute/v2.1/servers/dac9628d-657b-4e72-8a7f-08156be8fad7" status: 200 len: 1255 microversion: 2.21 time: 0.191759 Oct 19 03:25:34.863188 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1520/3096] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:25:34 2022] GET /compute/v2.1/servers/dac9628d-657b-4e72-8a7f-08156be8fad7 => generated 1255 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:25:35.022686 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-8116d8ee-b7de-45f1-816e-d6b6bff092ca tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:35.034345 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-8116d8ee-b7de-45f1-816e-d6b6bff092ca tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/e0e22e25-87ae-4a48-84b2-d58394a28b62" status: 200 len: 1321 microversion: 2.1 time: 0.245405 Oct 19 03:25:35.035311 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1577/3097] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:34 2022] GET /compute/v2.1/servers/e0e22e25-87ae-4a48-84b2-d58394a28b62 => generated 1321 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:35.215057 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-69986e10-7d7a-4036-927b-41c8a2ada588 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '.version_select at 0x7fc130b74b80>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:35.271979 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-69986e10-7d7a-4036-927b-41c8a2ada588 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/images/9014f0d3-c315-4e14-86df-7411ca9d43dc" status: 200 len: 1409 microversion: 2.1 time: 0.061685 Oct 19 03:25:35.272870 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1521/3098] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:25:35 2022] GET /compute/v2.1/images/9014f0d3-c315-4e14-86df-7411ca9d43dc => generated 1409 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:35.693207 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6395e89c-c7a4-486b-b4ac-78a4005bec8d tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:35.693868 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6395e89c-c7a4-486b-b4ac-78a4005bec8d tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] [instance: 4c823d1c-eebe-4aa6-972c-38209d6cc70e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:35.701276 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6395e89c-c7a4-486b-b4ac-78a4005bec8d tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:35.701815 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6395e89c-c7a4-486b-b4ac-78a4005bec8d tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:35.702260 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6395e89c-c7a4-486b-b4ac-78a4005bec8d tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:35.702968 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6395e89c-c7a4-486b-b4ac-78a4005bec8d tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:35.703897 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6395e89c-c7a4-486b-b4ac-78a4005bec8d tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:35.704483 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6395e89c-c7a4-486b-b4ac-78a4005bec8d tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:35.798983 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-6395e89c-c7a4-486b-b4ac-78a4005bec8d tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5ed9dc7e0304f28afb381ef2ec3cefd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b2195b7d124b4eb2552f88dba26b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:35.808140 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6395e89c-c7a4-486b-b4ac-78a4005bec8d tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] 10.222.0.52 "GET /compute/v2.1/servers/4c823d1c-eebe-4aa6-972c-38209d6cc70e" status: 200 len: 1286 microversion: 2.1 time: 0.118664 Oct 19 03:25:35.817192 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-334e86f9-0761-4a90-9f56-5196445b5ffa tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:35.817192 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-334e86f9-0761-4a90-9f56-5196445b5ffa tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:35.822821 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1578/3099] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:35 2022] GET /compute/v2.1/servers/4c823d1c-eebe-4aa6-972c-38209d6cc70e => generated 1286 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:35.829008 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-334e86f9-0761-4a90-9f56-5196445b5ffa tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:35.829816 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-334e86f9-0761-4a90-9f56-5196445b5ffa tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:35.830569 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-334e86f9-0761-4a90-9f56-5196445b5ffa tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:35.832052 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-334e86f9-0761-4a90-9f56-5196445b5ffa tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:35.832918 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-334e86f9-0761-4a90-9f56-5196445b5ffa tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:35.835543 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-334e86f9-0761-4a90-9f56-5196445b5ffa tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:35.891274 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-8d747159-74b2-4b28-a3c6-bff1c8ad1779 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:35.892248 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-8d747159-74b2-4b28-a3c6-bff1c8ad1779 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] [instance: dac9628d-657b-4e72-8a7f-08156be8fad7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:35.902001 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8d747159-74b2-4b28-a3c6-bff1c8ad1779 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:35.904841 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8d747159-74b2-4b28-a3c6-bff1c8ad1779 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:35.905317 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8d747159-74b2-4b28-a3c6-bff1c8ad1779 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:35.906265 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8d747159-74b2-4b28-a3c6-bff1c8ad1779 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:35.906883 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8d747159-74b2-4b28-a3c6-bff1c8ad1779 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:35.907498 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8d747159-74b2-4b28-a3c6-bff1c8ad1779 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:36.090234 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-8d747159-74b2-4b28-a3c6-bff1c8ad1779 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7bf94a5de054f98a24a6a8f3d5fea9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f91748d2e94f85a70dcc787713fb6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:36.100336 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-8d747159-74b2-4b28-a3c6-bff1c8ad1779 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7bf94a5de054f98a24a6a8f3d5fea9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f91748d2e94f85a70dcc787713fb6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:36.100612 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-334e86f9-0761-4a90-9f56-5196445b5ffa tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:36.103037 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-8d747159-74b2-4b28-a3c6-bff1c8ad1779 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7bf94a5de054f98a24a6a8f3d5fea9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f91748d2e94f85a70dcc787713fb6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:36.105543 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-8d747159-74b2-4b28-a3c6-bff1c8ad1779 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] 10.222.0.52 "GET /compute/v2.1/servers/dac9628d-657b-4e72-8a7f-08156be8fad7" status: 200 len: 1311 microversion: 2.21 time: 0.218527 Oct 19 03:25:36.106778 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1579/3100] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:25:35 2022] GET /compute/v2.1/servers/dac9628d-657b-4e72-8a7f-08156be8fad7 => generated 1311 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:25:36.111775 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-334e86f9-0761-4a90-9f56-5196445b5ffa tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6" status: 200 len: 1503 microversion: 2.1 time: 0.301317 Oct 19 03:25:36.116012 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-e6f10c1e-5c33-4167-b4e1-8dd81580e414 req-98560888-efc6-4ea9-b819-b2557b5d311e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6", "tag": "b1a17f00-f144-4de3-b98d-df60b15d0f90"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:25:36.116143 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1522/3101] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:35 2022] GET /compute/v2.1/servers/25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6 => generated 1503 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:36.120567 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d4fd99cf-622a-4338-9a6d-00dff6c06c8d tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:36.122062 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d4fd99cf-622a-4338-9a6d-00dff6c06c8d tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: e0e22e25-87ae-4a48-84b2-d58394a28b62] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:36.138374 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d4fd99cf-622a-4338-9a6d-00dff6c06c8d tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:36.139182 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d4fd99cf-622a-4338-9a6d-00dff6c06c8d tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:36.139859 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d4fd99cf-622a-4338-9a6d-00dff6c06c8d tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:36.141018 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d4fd99cf-622a-4338-9a6d-00dff6c06c8d tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:36.141957 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d4fd99cf-622a-4338-9a6d-00dff6c06c8d tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:36.142638 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d4fd99cf-622a-4338-9a6d-00dff6c06c8d tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:36.145857 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-e6f10c1e-5c33-4167-b4e1-8dd81580e414 req-98560888-efc6-4ea9-b819-b2557b5d311e service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:36.146477 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-e6f10c1e-5c33-4167-b4e1-8dd81580e414 req-98560888-efc6-4ea9-b819-b2557b5d311e service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:36.147026 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-e6f10c1e-5c33-4167-b4e1-8dd81580e414 req-98560888-efc6-4ea9-b819-b2557b5d311e service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:36.165114 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-e6f10c1e-5c33-4167-b4e1-8dd81580e414 req-98560888-efc6-4ea9-b819-b2557b5d311e service nova] Creating event network-changed:b1a17f00-f144-4de3-b98d-df60b15d0f90 for instance 25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6 on n-h1-861333-8 Oct 19 03:25:36.171513 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-e6f10c1e-5c33-4167-b4e1-8dd81580e414 req-98560888-efc6-4ea9-b819-b2557b5d311e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063261 Oct 19 03:25:36.172747 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1580/3102] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:25:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:25:36.290258 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ae83d17a-ab9c-4cc7-82b3-3fb1d5d41efd tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '.version_select at 0x7fc12bff7280>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:36.310182 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d4fd99cf-622a-4338-9a6d-00dff6c06c8d tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:36.329647 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d4fd99cf-622a-4338-9a6d-00dff6c06c8d tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/e0e22e25-87ae-4a48-84b2-d58394a28b62" status: 200 len: 1321 microversion: 2.1 time: 0.215234 Oct 19 03:25:36.359803 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1523/3103] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:36 2022] GET /compute/v2.1/servers/e0e22e25-87ae-4a48-84b2-d58394a28b62 => generated 1321 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:36.402759 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ae83d17a-ab9c-4cc7-82b3-3fb1d5d41efd tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/images/9014f0d3-c315-4e14-86df-7411ca9d43dc" status: 200 len: 1409 microversion: 2.1 time: 0.117026 Oct 19 03:25:36.411183 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1581/3104] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:25:36 2022] GET /compute/v2.1/images/9014f0d3-c315-4e14-86df-7411ca9d43dc => generated 1409 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:25:36.605333 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-da6e7fd4-3f6f-4c6c-a994-24f4635819e3 req-f93c6cff-92fd-4cd7-9ca2-9042f9464f0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0e22e25-87ae-4a48-84b2-d58394a28b62", "name": "network-vif-plugged", "status": "completed", "tag": "fe670da9-cb46-44b6-bddd-430129cebeb9"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:25:36.619829 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-da6e7fd4-3f6f-4c6c-a994-24f4635819e3 req-f93c6cff-92fd-4cd7-9ca2-9042f9464f0e service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:36.620336 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-da6e7fd4-3f6f-4c6c-a994-24f4635819e3 req-f93c6cff-92fd-4cd7-9ca2-9042f9464f0e service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:36.620958 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-da6e7fd4-3f6f-4c6c-a994-24f4635819e3 req-f93c6cff-92fd-4cd7-9ca2-9042f9464f0e service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:36.636254 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-da6e7fd4-3f6f-4c6c-a994-24f4635819e3 req-f93c6cff-92fd-4cd7-9ca2-9042f9464f0e service nova] Creating event network-vif-plugged:fe670da9-cb46-44b6-bddd-430129cebeb9 for instance e0e22e25-87ae-4a48-84b2-d58394a28b62 on n-h2-861333-8 Oct 19 03:25:36.642643 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-da6e7fd4-3f6f-4c6c-a994-24f4635819e3 req-f93c6cff-92fd-4cd7-9ca2-9042f9464f0e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041094 Oct 19 03:25:36.643944 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1524/3105] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:25:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:25:36.834060 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-160183af-0446-4603-8508-76cfcb3ba819 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:36.835453 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-160183af-0446-4603-8508-76cfcb3ba819 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] [instance: 4c823d1c-eebe-4aa6-972c-38209d6cc70e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:36.849126 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-160183af-0446-4603-8508-76cfcb3ba819 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:36.851621 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-160183af-0446-4603-8508-76cfcb3ba819 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:36.852071 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-160183af-0446-4603-8508-76cfcb3ba819 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:36.852797 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-160183af-0446-4603-8508-76cfcb3ba819 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:36.853347 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-160183af-0446-4603-8508-76cfcb3ba819 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:36.854291 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-160183af-0446-4603-8508-76cfcb3ba819 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:36.959312 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-160183af-0446-4603-8508-76cfcb3ba819 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5ed9dc7e0304f28afb381ef2ec3cefd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b2195b7d124b4eb2552f88dba26b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:36.969936 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-160183af-0446-4603-8508-76cfcb3ba819 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] 10.222.0.52 "GET /compute/v2.1/servers/4c823d1c-eebe-4aa6-972c-38209d6cc70e" status: 200 len: 1284 microversion: 2.1 time: 0.140977 Oct 19 03:25:36.981967 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1582/3106] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:36 2022] GET /compute/v2.1/servers/4c823d1c-eebe-4aa6-972c-38209d6cc70e => generated 1284 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:37.142739 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0343f6f8-788e-4ef2-8e0d-c69f4ae51f6a tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:37.143460 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0343f6f8-788e-4ef2-8e0d-c69f4ae51f6a tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:37.150156 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-8ecde5f1-7a51-41b7-a934-5e67e46595b8 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:37.151260 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-8ecde5f1-7a51-41b7-a934-5e67e46595b8 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] [instance: dac9628d-657b-4e72-8a7f-08156be8fad7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:37.160474 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8ecde5f1-7a51-41b7-a934-5e67e46595b8 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:37.161551 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8ecde5f1-7a51-41b7-a934-5e67e46595b8 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:37.161876 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0343f6f8-788e-4ef2-8e0d-c69f4ae51f6a tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:37.162267 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0343f6f8-788e-4ef2-8e0d-c69f4ae51f6a tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:37.162723 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0343f6f8-788e-4ef2-8e0d-c69f4ae51f6a tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:37.163508 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0343f6f8-788e-4ef2-8e0d-c69f4ae51f6a tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:37.163991 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0343f6f8-788e-4ef2-8e0d-c69f4ae51f6a tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:37.164406 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8ecde5f1-7a51-41b7-a934-5e67e46595b8 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:37.164523 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0343f6f8-788e-4ef2-8e0d-c69f4ae51f6a tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:37.165590 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8ecde5f1-7a51-41b7-a934-5e67e46595b8 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:37.166980 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8ecde5f1-7a51-41b7-a934-5e67e46595b8 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:37.168982 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8ecde5f1-7a51-41b7-a934-5e67e46595b8 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:37.452969 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-8ecde5f1-7a51-41b7-a934-5e67e46595b8 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7bf94a5de054f98a24a6a8f3d5fea9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f91748d2e94f85a70dcc787713fb6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:37.476294 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-8ecde5f1-7a51-41b7-a934-5e67e46595b8 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7bf94a5de054f98a24a6a8f3d5fea9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f91748d2e94f85a70dcc787713fb6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:37.485539 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-8ecde5f1-7a51-41b7-a934-5e67e46595b8 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7bf94a5de054f98a24a6a8f3d5fea9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f91748d2e94f85a70dcc787713fb6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:37.489845 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-8ecde5f1-7a51-41b7-a934-5e67e46595b8 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] 10.222.0.52 "GET /compute/v2.1/servers/dac9628d-657b-4e72-8a7f-08156be8fad7" status: 200 len: 1311 microversion: 2.21 time: 0.350491 Oct 19 03:25:37.491033 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0343f6f8-788e-4ef2-8e0d-c69f4ae51f6a tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:37.493659 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1583/3107] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:25:37 2022] GET /compute/v2.1/servers/dac9628d-657b-4e72-8a7f-08156be8fad7 => generated 1311 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:25:37.514595 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7c83261d-6f40-42af-b10f-36a3ffd3b6a9 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:37.514595 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7c83261d-6f40-42af-b10f-36a3ffd3b6a9 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: e0e22e25-87ae-4a48-84b2-d58394a28b62] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:37.524468 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0343f6f8-788e-4ef2-8e0d-c69f4ae51f6a tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6" status: 200 len: 1503 microversion: 2.1 time: 0.386263 Oct 19 03:25:37.526783 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1525/3108] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:37 2022] GET /compute/v2.1/servers/25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6 => generated 1503 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:37.532379 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4b4362d8-f8a6-454a-8e39-84eb26089632 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '.version_select at 0x7fc130af7ca0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:37.546275 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7c83261d-6f40-42af-b10f-36a3ffd3b6a9 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:37.547765 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7c83261d-6f40-42af-b10f-36a3ffd3b6a9 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:37.548494 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7c83261d-6f40-42af-b10f-36a3ffd3b6a9 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:37.549218 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7c83261d-6f40-42af-b10f-36a3ffd3b6a9 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:37.549749 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7c83261d-6f40-42af-b10f-36a3ffd3b6a9 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:37.550159 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7c83261d-6f40-42af-b10f-36a3ffd3b6a9 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:37.599479 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4b4362d8-f8a6-454a-8e39-84eb26089632 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/images/9014f0d3-c315-4e14-86df-7411ca9d43dc" status: 200 len: 1409 microversion: 2.1 time: 0.070927 Oct 19 03:25:37.601289 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1526/3109] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:25:37 2022] GET /compute/v2.1/images/9014f0d3-c315-4e14-86df-7411ca9d43dc => generated 1409 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:37.812864 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7c83261d-6f40-42af-b10f-36a3ffd3b6a9 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:37.824091 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7c83261d-6f40-42af-b10f-36a3ffd3b6a9 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/e0e22e25-87ae-4a48-84b2-d58394a28b62" status: 200 len: 1321 microversion: 2.1 time: 0.326356 Oct 19 03:25:37.825830 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1584/3110] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:37 2022] GET /compute/v2.1/servers/e0e22e25-87ae-4a48-84b2-d58394a28b62 => generated 1321 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:38.005607 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2d79aec0-041a-4815-8967-00f9569f51d8 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:38.008619 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2d79aec0-041a-4815-8967-00f9569f51d8 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] [instance: 4c823d1c-eebe-4aa6-972c-38209d6cc70e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:38.027112 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2d79aec0-041a-4815-8967-00f9569f51d8 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:38.029310 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2d79aec0-041a-4815-8967-00f9569f51d8 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:38.030154 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2d79aec0-041a-4815-8967-00f9569f51d8 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:38.031065 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2d79aec0-041a-4815-8967-00f9569f51d8 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:38.031872 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2d79aec0-041a-4815-8967-00f9569f51d8 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:38.032499 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2d79aec0-041a-4815-8967-00f9569f51d8 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:38.241191 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-2d79aec0-041a-4815-8967-00f9569f51d8 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5ed9dc7e0304f28afb381ef2ec3cefd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b2195b7d124b4eb2552f88dba26b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:38.252501 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2d79aec0-041a-4815-8967-00f9569f51d8 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] 10.222.0.52 "GET /compute/v2.1/servers/4c823d1c-eebe-4aa6-972c-38209d6cc70e" status: 200 len: 1351 microversion: 2.1 time: 0.260887 Oct 19 03:25:38.253322 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1527/3111] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:37 2022] GET /compute/v2.1/servers/4c823d1c-eebe-4aa6-972c-38209d6cc70e => generated 1351 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:38.522491 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0bce5a55-1f88-4373-a1a0-8d6d627c49b5 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:38.526522 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0bce5a55-1f88-4373-a1a0-8d6d627c49b5 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] [instance: dac9628d-657b-4e72-8a7f-08156be8fad7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:38.533707 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0bce5a55-1f88-4373-a1a0-8d6d627c49b5 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:38.534201 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0bce5a55-1f88-4373-a1a0-8d6d627c49b5 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:38.534640 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0bce5a55-1f88-4373-a1a0-8d6d627c49b5 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:38.535565 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0bce5a55-1f88-4373-a1a0-8d6d627c49b5 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:38.536072 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0bce5a55-1f88-4373-a1a0-8d6d627c49b5 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:38.537079 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0bce5a55-1f88-4373-a1a0-8d6d627c49b5 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:38.551114 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-35ea9e33-a080-4c9d-91a9-da250e2995ca tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:38.552028 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-35ea9e33-a080-4c9d-91a9-da250e2995ca tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:38.561304 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-35ea9e33-a080-4c9d-91a9-da250e2995ca tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:38.562120 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-35ea9e33-a080-4c9d-91a9-da250e2995ca tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:38.562780 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-35ea9e33-a080-4c9d-91a9-da250e2995ca tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:38.563699 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-35ea9e33-a080-4c9d-91a9-da250e2995ca tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:38.564338 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-35ea9e33-a080-4c9d-91a9-da250e2995ca tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:38.564973 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-35ea9e33-a080-4c9d-91a9-da250e2995ca tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:38.651398 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-0bce5a55-1f88-4373-a1a0-8d6d627c49b5 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7bf94a5de054f98a24a6a8f3d5fea9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f91748d2e94f85a70dcc787713fb6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:38.664768 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-0bce5a55-1f88-4373-a1a0-8d6d627c49b5 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7bf94a5de054f98a24a6a8f3d5fea9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f91748d2e94f85a70dcc787713fb6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:38.670074 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-0bce5a55-1f88-4373-a1a0-8d6d627c49b5 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7bf94a5de054f98a24a6a8f3d5fea9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f91748d2e94f85a70dcc787713fb6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:38.672396 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0bce5a55-1f88-4373-a1a0-8d6d627c49b5 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] 10.222.0.52 "GET /compute/v2.1/servers/dac9628d-657b-4e72-8a7f-08156be8fad7" status: 200 len: 1317 microversion: 2.21 time: 0.154536 Oct 19 03:25:38.674484 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1585/3112] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:25:38 2022] GET /compute/v2.1/servers/dac9628d-657b-4e72-8a7f-08156be8fad7 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:25:38.682576 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b177a0ea-6dba-4e77-a90a-481f4e2ed5ee tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '.version_select at 0x7fc12bff7670>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:38.741316 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b177a0ea-6dba-4e77-a90a-481f4e2ed5ee tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/images/9014f0d3-c315-4e14-86df-7411ca9d43dc" status: 200 len: 1409 microversion: 2.1 time: 0.065500 Oct 19 03:25:38.750544 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1586/3113] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:25:38 2022] GET /compute/v2.1/images/9014f0d3-c315-4e14-86df-7411ca9d43dc => generated 1409 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:38.803279 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-35ea9e33-a080-4c9d-91a9-da250e2995ca tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:38.812138 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-35ea9e33-a080-4c9d-91a9-da250e2995ca tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6" status: 200 len: 1503 microversion: 2.1 time: 0.264612 Oct 19 03:25:38.813269 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1528/3114] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:38 2022] GET /compute/v2.1/servers/25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6 => generated 1503 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:38.857614 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3c0adbe4-7358-46cc-8b32-3f4f5c382e8e tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:38.859573 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-3c0adbe4-7358-46cc-8b32-3f4f5c382e8e tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: e0e22e25-87ae-4a48-84b2-d58394a28b62] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:38.870232 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3c0adbe4-7358-46cc-8b32-3f4f5c382e8e tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:38.871291 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3c0adbe4-7358-46cc-8b32-3f4f5c382e8e tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:38.872217 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3c0adbe4-7358-46cc-8b32-3f4f5c382e8e tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:38.873045 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3c0adbe4-7358-46cc-8b32-3f4f5c382e8e tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:38.874160 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3c0adbe4-7358-46cc-8b32-3f4f5c382e8e tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:38.874715 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3c0adbe4-7358-46cc-8b32-3f4f5c382e8e tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:38.882435 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:25:39.042177 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-3c0adbe4-7358-46cc-8b32-3f4f5c382e8e tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:39.050350 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-3c0adbe4-7358-46cc-8b32-3f4f5c382e8e tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/e0e22e25-87ae-4a48-84b2-d58394a28b62" status: 200 len: 1502 microversion: 2.1 time: 0.198612 Oct 19 03:25:39.050932 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1587/3115] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:38 2022] GET /compute/v2.1/servers/e0e22e25-87ae-4a48-84b2-d58394a28b62 => generated 1502 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:39.076610 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2300d8a3-3025-4821-93ec-81c01b4d9a77 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:39.077256 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2300d8a3-3025-4821-93ec-81c01b4d9a77 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: e0e22e25-87ae-4a48-84b2-d58394a28b62] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:39.089870 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2300d8a3-3025-4821-93ec-81c01b4d9a77 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:39.092434 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2300d8a3-3025-4821-93ec-81c01b4d9a77 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:39.092434 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2300d8a3-3025-4821-93ec-81c01b4d9a77 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:39.092434 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2300d8a3-3025-4821-93ec-81c01b4d9a77 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:39.094743 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2300d8a3-3025-4821-93ec-81c01b4d9a77 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:39.095460 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2300d8a3-3025-4821-93ec-81c01b4d9a77 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:39.134844 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-ef920a90-44e0-49cb-baf3-db112e19ba07 req-8b623ed5-9425-44d9-ad41-90860f5116ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c823d1c-eebe-4aa6-972c-38209d6cc70e", "tag": "2450ebc0-ad1d-4651-825d-17d4dd7a5d3d"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:25:39.148837 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-ef920a90-44e0-49cb-baf3-db112e19ba07 req-8b623ed5-9425-44d9-ad41-90860f5116ce service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:39.149254 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-ef920a90-44e0-49cb-baf3-db112e19ba07 req-8b623ed5-9425-44d9-ad41-90860f5116ce service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:39.151222 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-ef920a90-44e0-49cb-baf3-db112e19ba07 req-8b623ed5-9425-44d9-ad41-90860f5116ce service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:39.174236 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-ef920a90-44e0-49cb-baf3-db112e19ba07 req-8b623ed5-9425-44d9-ad41-90860f5116ce service nova] Creating event network-changed:2450ebc0-ad1d-4651-825d-17d4dd7a5d3d for instance 4c823d1c-eebe-4aa6-972c-38209d6cc70e on n-h1-861333-8 Oct 19 03:25:39.179701 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-ef920a90-44e0-49cb-baf3-db112e19ba07 req-8b623ed5-9425-44d9-ad41-90860f5116ce service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049193 Oct 19 03:25:39.180667 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1588/3116] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:25:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:25:39.280856 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-12caff7a-a46e-42c5-9cb7-e1d46091f1c9 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:39.281609 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-12caff7a-a46e-42c5-9cb7-e1d46091f1c9 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] [instance: 4c823d1c-eebe-4aa6-972c-38209d6cc70e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:39.318720 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-12caff7a-a46e-42c5-9cb7-e1d46091f1c9 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:39.319418 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-12caff7a-a46e-42c5-9cb7-e1d46091f1c9 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:39.320032 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-12caff7a-a46e-42c5-9cb7-e1d46091f1c9 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:39.320866 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-12caff7a-a46e-42c5-9cb7-e1d46091f1c9 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:39.321514 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-12caff7a-a46e-42c5-9cb7-e1d46091f1c9 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:39.322650 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-12caff7a-a46e-42c5-9cb7-e1d46091f1c9 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:39.340197 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-2300d8a3-3025-4821-93ec-81c01b4d9a77 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:39.356230 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2300d8a3-3025-4821-93ec-81c01b4d9a77 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/e0e22e25-87ae-4a48-84b2-d58394a28b62" status: 200 len: 1502 microversion: 2.1 time: 0.284135 Oct 19 03:25:39.357465 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1529/3117] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:39 2022] GET /compute/v2.1/servers/e0e22e25-87ae-4a48-84b2-d58394a28b62 => generated 1502 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:39.383694 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c2567a07-acbf-408c-8c38-3887007ca8a5 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:39.391790 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c2567a07-acbf-408c-8c38-3887007ca8a5 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: e0e22e25-87ae-4a48-84b2-d58394a28b62] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:39.416027 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c2567a07-acbf-408c-8c38-3887007ca8a5 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:39.420769 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c2567a07-acbf-408c-8c38-3887007ca8a5 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:39.421319 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c2567a07-acbf-408c-8c38-3887007ca8a5 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:39.422187 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c2567a07-acbf-408c-8c38-3887007ca8a5 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:39.422737 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c2567a07-acbf-408c-8c38-3887007ca8a5 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:39.424215 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c2567a07-acbf-408c-8c38-3887007ca8a5 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:39.463384 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c2567a07-acbf-408c-8c38-3887007ca8a5 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: e0e22e25-87ae-4a48-84b2-d58394a28b62] Going to try to terminate instance {{(pid=121134) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:25:39.585752 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-12caff7a-a46e-42c5-9cb7-e1d46091f1c9 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5ed9dc7e0304f28afb381ef2ec3cefd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b2195b7d124b4eb2552f88dba26b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:39.597652 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-12caff7a-a46e-42c5-9cb7-e1d46091f1c9 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] 10.222.0.52 "GET /compute/v2.1/servers/4c823d1c-eebe-4aa6-972c-38209d6cc70e" status: 200 len: 1351 microversion: 2.1 time: 0.324055 Oct 19 03:25:39.631807 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1589/3118] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:39 2022] GET /compute/v2.1/servers/4c823d1c-eebe-4aa6-972c-38209d6cc70e => generated 1351 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:39.706702 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5f4ca39c-a4d5-4908-9a8b-2237d03cde2f tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:39.709190 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-5f4ca39c-a4d5-4908-9a8b-2237d03cde2f tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] [instance: dac9628d-657b-4e72-8a7f-08156be8fad7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:39.717169 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5f4ca39c-a4d5-4908-9a8b-2237d03cde2f tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:39.718016 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5f4ca39c-a4d5-4908-9a8b-2237d03cde2f tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:39.718699 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5f4ca39c-a4d5-4908-9a8b-2237d03cde2f tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:39.719481 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5f4ca39c-a4d5-4908-9a8b-2237d03cde2f tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:39.720017 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5f4ca39c-a4d5-4908-9a8b-2237d03cde2f tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:39.720477 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5f4ca39c-a4d5-4908-9a8b-2237d03cde2f tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:39.891828 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c2567a07-acbf-408c-8c38-3887007ca8a5 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "DELETE /compute/v2.1/servers/e0e22e25-87ae-4a48-84b2-d58394a28b62" status: 204 len: 0 microversion: 2.1 time: 0.512242 Oct 19 03:25:39.895731 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1530/3119] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:25:39 2022] DELETE /compute/v2.1/servers/e0e22e25-87ae-4a48-84b2-d58394a28b62 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:25:39.904480 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-27729b02-a618-40cf-bd99-d19cf2cd49ab tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '.version_select at 0x7fc130cc4af0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:39.943319 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-5f4ca39c-a4d5-4908-9a8b-2237d03cde2f tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7bf94a5de054f98a24a6a8f3d5fea9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f91748d2e94f85a70dcc787713fb6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:39.960437 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-5f4ca39c-a4d5-4908-9a8b-2237d03cde2f tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7bf94a5de054f98a24a6a8f3d5fea9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f91748d2e94f85a70dcc787713fb6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:39.963656 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-5f4ca39c-a4d5-4908-9a8b-2237d03cde2f tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7bf94a5de054f98a24a6a8f3d5fea9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f91748d2e94f85a70dcc787713fb6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:39.967125 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5f4ca39c-a4d5-4908-9a8b-2237d03cde2f tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] 10.222.0.52 "GET /compute/v2.1/servers/dac9628d-657b-4e72-8a7f-08156be8fad7" status: 200 len: 1359 microversion: 2.21 time: 0.264950 Oct 19 03:25:39.968293 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1590/3120] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:25:39 2022] GET /compute/v2.1/servers/dac9628d-657b-4e72-8a7f-08156be8fad7 => generated 1359 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:25:39.974664 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e03e77cb-d822-4a88-ad89-8438e0e0af52 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:39.975311 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e03e77cb-d822-4a88-ad89-8438e0e0af52 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:39.984113 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e03e77cb-d822-4a88-ad89-8438e0e0af52 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:39.984908 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e03e77cb-d822-4a88-ad89-8438e0e0af52 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:39.985569 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e03e77cb-d822-4a88-ad89-8438e0e0af52 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:39.986073 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-27729b02-a618-40cf-bd99-d19cf2cd49ab tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/images/9014f0d3-c315-4e14-86df-7411ca9d43dc" status: 200 len: 1409 microversion: 2.1 time: 0.091628 Oct 19 03:25:39.986679 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e03e77cb-d822-4a88-ad89-8438e0e0af52 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:39.986806 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1531/3121] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:25:39 2022] GET /compute/v2.1/images/9014f0d3-c315-4e14-86df-7411ca9d43dc => generated 1409 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:39.987430 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e03e77cb-d822-4a88-ad89-8438e0e0af52 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:39.988063 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e03e77cb-d822-4a88-ad89-8438e0e0af52 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:39.995298 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ddd3f48c-bac4-45b2-b064-94bc8c519cd4 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:39.996194 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ddd3f48c-bac4-45b2-b064-94bc8c519cd4 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: e0e22e25-87ae-4a48-84b2-d58394a28b62] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:40.005221 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ddd3f48c-bac4-45b2-b064-94bc8c519cd4 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:40.007513 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ddd3f48c-bac4-45b2-b064-94bc8c519cd4 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:40.008269 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ddd3f48c-bac4-45b2-b064-94bc8c519cd4 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:40.010672 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ddd3f48c-bac4-45b2-b064-94bc8c519cd4 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:40.011426 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ddd3f48c-bac4-45b2-b064-94bc8c519cd4 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:40.012122 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ddd3f48c-bac4-45b2-b064-94bc8c519cd4 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:40.253234 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ddd3f48c-bac4-45b2-b064-94bc8c519cd4 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:40.265416 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ddd3f48c-bac4-45b2-b064-94bc8c519cd4 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/e0e22e25-87ae-4a48-84b2-d58394a28b62" status: 200 len: 1508 microversion: 2.1 time: 0.274757 Oct 19 03:25:40.267146 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1532/3122] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:39 2022] GET /compute/v2.1/servers/e0e22e25-87ae-4a48-84b2-d58394a28b62 => generated 1508 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:40.308799 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-e03e77cb-d822-4a88-ad89-8438e0e0af52 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:40.370821 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e03e77cb-d822-4a88-ad89-8438e0e0af52 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6" status: 200 len: 1503 microversion: 2.1 time: 0.348306 Oct 19 03:25:40.370821 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1591/3123] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:39 2022] GET /compute/v2.1/servers/25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6 => generated 1503 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:40.624459 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-115cab21-56f3-468a-8c62-672a225041ff tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:40.625190 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-115cab21-56f3-468a-8c62-672a225041ff tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] [instance: 4c823d1c-eebe-4aa6-972c-38209d6cc70e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:40.631598 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-115cab21-56f3-468a-8c62-672a225041ff tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:40.632203 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-115cab21-56f3-468a-8c62-672a225041ff tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:40.632878 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-115cab21-56f3-468a-8c62-672a225041ff tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:40.633535 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-115cab21-56f3-468a-8c62-672a225041ff tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:40.634001 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-115cab21-56f3-468a-8c62-672a225041ff tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:40.634441 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-115cab21-56f3-468a-8c62-672a225041ff tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:40.776208 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-115cab21-56f3-468a-8c62-672a225041ff tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5ed9dc7e0304f28afb381ef2ec3cefd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b2195b7d124b4eb2552f88dba26b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:40.784248 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-115cab21-56f3-468a-8c62-672a225041ff tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] 10.222.0.52 "GET /compute/v2.1/servers/4c823d1c-eebe-4aa6-972c-38209d6cc70e" status: 200 len: 1351 microversion: 2.1 time: 0.163768 Oct 19 03:25:40.785461 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1533/3124] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:40 2022] GET /compute/v2.1/servers/4c823d1c-eebe-4aa6-972c-38209d6cc70e => generated 1351 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:40.999196 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-770ce3eb-4eae-424a-98e9-22bee424d82c tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:41.000631 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-770ce3eb-4eae-424a-98e9-22bee424d82c tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] [instance: dac9628d-657b-4e72-8a7f-08156be8fad7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:41.003300 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5983fc64-d32f-451c-9235-f03c222b2ff6 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '.version_select at 0x7fc131081820>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:41.015371 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-770ce3eb-4eae-424a-98e9-22bee424d82c tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:41.041348 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-770ce3eb-4eae-424a-98e9-22bee424d82c tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:41.042930 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-770ce3eb-4eae-424a-98e9-22bee424d82c tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:41.047198 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-770ce3eb-4eae-424a-98e9-22bee424d82c tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:41.047878 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-770ce3eb-4eae-424a-98e9-22bee424d82c tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:41.049897 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-770ce3eb-4eae-424a-98e9-22bee424d82c tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:41.086228 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5983fc64-d32f-451c-9235-f03c222b2ff6 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/images/9014f0d3-c315-4e14-86df-7411ca9d43dc" status: 200 len: 1409 microversion: 2.1 time: 0.088063 Oct 19 03:25:41.088650 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1534/3125] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:25:40 2022] GET /compute/v2.1/images/9014f0d3-c315-4e14-86df-7411ca9d43dc => generated 1409 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:25:41.239598 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-770ce3eb-4eae-424a-98e9-22bee424d82c tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7bf94a5de054f98a24a6a8f3d5fea9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f91748d2e94f85a70dcc787713fb6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:41.249193 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-770ce3eb-4eae-424a-98e9-22bee424d82c tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7bf94a5de054f98a24a6a8f3d5fea9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f91748d2e94f85a70dcc787713fb6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:41.254556 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-770ce3eb-4eae-424a-98e9-22bee424d82c tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7bf94a5de054f98a24a6a8f3d5fea9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f91748d2e94f85a70dcc787713fb6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:41.254556 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-770ce3eb-4eae-424a-98e9-22bee424d82c tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] 10.222.0.52 "GET /compute/v2.1/servers/dac9628d-657b-4e72-8a7f-08156be8fad7" status: 200 len: 1359 microversion: 2.21 time: 0.260599 Oct 19 03:25:41.254556 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1592/3126] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:25:40 2022] GET /compute/v2.1/servers/dac9628d-657b-4e72-8a7f-08156be8fad7 => generated 1359 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:25:41.313001 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-48d6d8af-beb7-4941-99ed-0eb9945bd0e7 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:41.314020 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-48d6d8af-beb7-4941-99ed-0eb9945bd0e7 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: e0e22e25-87ae-4a48-84b2-d58394a28b62] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:41.323798 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:25:41.325117 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=15 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:25:41.327242 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-48d6d8af-beb7-4941-99ed-0eb9945bd0e7 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:41.328205 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-48d6d8af-beb7-4941-99ed-0eb9945bd0e7 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:41.328818 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-48d6d8af-beb7-4941-99ed-0eb9945bd0e7 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:41.330113 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-48d6d8af-beb7-4941-99ed-0eb9945bd0e7 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:41.330830 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-48d6d8af-beb7-4941-99ed-0eb9945bd0e7 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:41.334850 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-48d6d8af-beb7-4941-99ed-0eb9945bd0e7 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:41.395247 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-09d5687e-e467-4101-a538-00415798c01a tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:41.397555 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-09d5687e-e467-4101-a538-00415798c01a tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:41.411031 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-09d5687e-e467-4101-a538-00415798c01a tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:41.427843 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-09d5687e-e467-4101-a538-00415798c01a tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:41.427843 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-09d5687e-e467-4101-a538-00415798c01a tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:41.427843 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-09d5687e-e467-4101-a538-00415798c01a tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:41.427843 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-09d5687e-e467-4101-a538-00415798c01a tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:41.428295 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-09d5687e-e467-4101-a538-00415798c01a tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:41.634739 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=4 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:25:41.658861 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-48d6d8af-beb7-4941-99ed-0eb9945bd0e7 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:41.689797 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-48d6d8af-beb7-4941-99ed-0eb9945bd0e7 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/e0e22e25-87ae-4a48-84b2-d58394a28b62" status: 200 len: 1508 microversion: 2.1 time: 0.385189 Oct 19 03:25:41.698677 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1535/3127] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:41 2022] GET /compute/v2.1/servers/e0e22e25-87ae-4a48-84b2-d58394a28b62 => generated 1508 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:41.810850 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a9c4b2bf-9519-42e1-816c-a299ab01ca2f tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:41.811555 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a9c4b2bf-9519-42e1-816c-a299ab01ca2f tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] [instance: 4c823d1c-eebe-4aa6-972c-38209d6cc70e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:41.823916 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a9c4b2bf-9519-42e1-816c-a299ab01ca2f tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:41.824695 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a9c4b2bf-9519-42e1-816c-a299ab01ca2f tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:41.825973 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a9c4b2bf-9519-42e1-816c-a299ab01ca2f tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:41.830132 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a9c4b2bf-9519-42e1-816c-a299ab01ca2f tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:41.830807 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a9c4b2bf-9519-42e1-816c-a299ab01ca2f tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:41.832286 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a9c4b2bf-9519-42e1-816c-a299ab01ca2f tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:41.843329 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-09d5687e-e467-4101-a538-00415798c01a tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:41.853142 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-09d5687e-e467-4101-a538-00415798c01a tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6" status: 200 len: 1503 microversion: 2.1 time: 0.464128 Oct 19 03:25:41.873932 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1593/3128] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:41 2022] GET /compute/v2.1/servers/25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6 => generated 1503 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:25:41.897018 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-8724c839-7ea2-44ad-abd4-ea88a385e851 req-e1451bbd-e145-4f92-9c42-89262fdd28bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dac9628d-657b-4e72-8a7f-08156be8fad7", "tag": "af70bc82-b873-4d91-83de-baf5a4ae6ccd"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:25:41.919863 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-8724c839-7ea2-44ad-abd4-ea88a385e851 req-e1451bbd-e145-4f92-9c42-89262fdd28bf service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:41.927408 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-8724c839-7ea2-44ad-abd4-ea88a385e851 req-e1451bbd-e145-4f92-9c42-89262fdd28bf service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:41.930887 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-8724c839-7ea2-44ad-abd4-ea88a385e851 req-e1451bbd-e145-4f92-9c42-89262fdd28bf service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:41.946264 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-8724c839-7ea2-44ad-abd4-ea88a385e851 req-e1451bbd-e145-4f92-9c42-89262fdd28bf service nova] Creating event network-changed:af70bc82-b873-4d91-83de-baf5a4ae6ccd for instance dac9628d-657b-4e72-8a7f-08156be8fad7 on n-h1-861333-8 Oct 19 03:25:41.953103 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-8724c839-7ea2-44ad-abd4-ea88a385e851 req-e1451bbd-e145-4f92-9c42-89262fdd28bf service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074704 Oct 19 03:25:41.955357 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1594/3129] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:25:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:25:42.084782 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a9c4b2bf-9519-42e1-816c-a299ab01ca2f tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5ed9dc7e0304f28afb381ef2ec3cefd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b2195b7d124b4eb2552f88dba26b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:42.094778 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a9c4b2bf-9519-42e1-816c-a299ab01ca2f tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] 10.222.0.52 "GET /compute/v2.1/servers/4c823d1c-eebe-4aa6-972c-38209d6cc70e" status: 200 len: 1351 microversion: 2.1 time: 0.287338 Oct 19 03:25:42.095615 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1536/3130] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:41 2022] GET /compute/v2.1/servers/4c823d1c-eebe-4aa6-972c-38209d6cc70e => generated 1351 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:25:42.103339 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-817842f0-c32b-415c-8961-4fb0f46cfdf3 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '.version_select at 0x7fc130172550>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:42.159013 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-817842f0-c32b-415c-8961-4fb0f46cfdf3 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/images/9014f0d3-c315-4e14-86df-7411ca9d43dc" status: 200 len: 1409 microversion: 2.1 time: 0.059659 Oct 19 03:25:42.160067 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1595/3131] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:25:42 2022] GET /compute/v2.1/images/9014f0d3-c315-4e14-86df-7411ca9d43dc => generated 1409 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:42.278280 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-976fbc95-bd98-4a5e-b357-c793acca1215 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:42.278900 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-976fbc95-bd98-4a5e-b357-c793acca1215 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] [instance: dac9628d-657b-4e72-8a7f-08156be8fad7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:42.289610 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-976fbc95-bd98-4a5e-b357-c793acca1215 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:42.291133 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-976fbc95-bd98-4a5e-b357-c793acca1215 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:42.291133 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-976fbc95-bd98-4a5e-b357-c793acca1215 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:42.291798 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-976fbc95-bd98-4a5e-b357-c793acca1215 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:42.292108 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-976fbc95-bd98-4a5e-b357-c793acca1215 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:42.292419 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-976fbc95-bd98-4a5e-b357-c793acca1215 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:42.371205 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-15a5a836-d92c-4ab8-9eb2-9cd101ad5b09 req-cb9ee6c3-ff0d-43c2-8b15-b797b2241e5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0e22e25-87ae-4a48-84b2-d58394a28b62", "name": "network-vif-deleted", "tag": "fe670da9-cb46-44b6-bddd-430129cebeb9"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:25:42.394295 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-15a5a836-d92c-4ab8-9eb2-9cd101ad5b09 req-cb9ee6c3-ff0d-43c2-8b15-b797b2241e5d service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:42.394871 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-15a5a836-d92c-4ab8-9eb2-9cd101ad5b09 req-cb9ee6c3-ff0d-43c2-8b15-b797b2241e5d service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:42.395497 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-15a5a836-d92c-4ab8-9eb2-9cd101ad5b09 req-cb9ee6c3-ff0d-43c2-8b15-b797b2241e5d service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:42.421175 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-15a5a836-d92c-4ab8-9eb2-9cd101ad5b09 req-cb9ee6c3-ff0d-43c2-8b15-b797b2241e5d service nova] Creating event network-vif-deleted:fe670da9-cb46-44b6-bddd-430129cebeb9 for instance e0e22e25-87ae-4a48-84b2-d58394a28b62 on n-h2-861333-8 Oct 19 03:25:42.435383 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-15a5a836-d92c-4ab8-9eb2-9cd101ad5b09 req-cb9ee6c3-ff0d-43c2-8b15-b797b2241e5d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070478 Oct 19 03:25:42.436164 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1596/3132] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:25:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:25:42.525916 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-976fbc95-bd98-4a5e-b357-c793acca1215 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7bf94a5de054f98a24a6a8f3d5fea9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f91748d2e94f85a70dcc787713fb6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:42.548938 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-976fbc95-bd98-4a5e-b357-c793acca1215 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7bf94a5de054f98a24a6a8f3d5fea9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f91748d2e94f85a70dcc787713fb6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:42.549957 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-976fbc95-bd98-4a5e-b357-c793acca1215 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7bf94a5de054f98a24a6a8f3d5fea9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f91748d2e94f85a70dcc787713fb6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:42.552800 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-976fbc95-bd98-4a5e-b357-c793acca1215 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] 10.222.0.52 "GET /compute/v2.1/servers/dac9628d-657b-4e72-8a7f-08156be8fad7" status: 200 len: 1359 microversion: 2.21 time: 0.279126 Oct 19 03:25:42.570699 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1537/3133] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:25:42 2022] GET /compute/v2.1/servers/dac9628d-657b-4e72-8a7f-08156be8fad7 => generated 1359 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:25:42.716349 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-285db04e-ad7a-42ca-a449-a518edcb0c72 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:42.717326 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-285db04e-ad7a-42ca-a449-a518edcb0c72 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: e0e22e25-87ae-4a48-84b2-d58394a28b62] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:42.728981 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-285db04e-ad7a-42ca-a449-a518edcb0c72 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:42.729521 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-285db04e-ad7a-42ca-a449-a518edcb0c72 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:42.729961 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-285db04e-ad7a-42ca-a449-a518edcb0c72 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:42.730663 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-285db04e-ad7a-42ca-a449-a518edcb0c72 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:42.731112 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-285db04e-ad7a-42ca-a449-a518edcb0c72 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:42.731536 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-285db04e-ad7a-42ca-a449-a518edcb0c72 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:42.779529 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-285db04e-ad7a-42ca-a449-a518edcb0c72 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:42.782260 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-285db04e-ad7a-42ca-a449-a518edcb0c72 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:42.782777 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-285db04e-ad7a-42ca-a449-a518edcb0c72 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:42.783352 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-285db04e-ad7a-42ca-a449-a518edcb0c72 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lazy-loading 'fault' on Instance uuid e0e22e25-87ae-4a48-84b2-d58394a28b62 {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:25:42.839511 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-285db04e-ad7a-42ca-a449-a518edcb0c72 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:42.850577 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-285db04e-ad7a-42ca-a449-a518edcb0c72 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/e0e22e25-87ae-4a48-84b2-d58394a28b62" status: 200 len: 1311 microversion: 2.1 time: 0.138827 Oct 19 03:25:42.853413 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1597/3134] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:42 2022] GET /compute/v2.1/servers/e0e22e25-87ae-4a48-84b2-d58394a28b62 => generated 1311 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:42.882508 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6c6689a6-a3b0-4980-9d8a-233d39c21cd8 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:42.883781 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6c6689a6-a3b0-4980-9d8a-233d39c21cd8 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:42.891472 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6c6689a6-a3b0-4980-9d8a-233d39c21cd8 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:42.892098 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6c6689a6-a3b0-4980-9d8a-233d39c21cd8 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:42.892672 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6c6689a6-a3b0-4980-9d8a-233d39c21cd8 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:42.894092 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6c6689a6-a3b0-4980-9d8a-233d39c21cd8 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:42.894777 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6c6689a6-a3b0-4980-9d8a-233d39c21cd8 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:42.895288 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6c6689a6-a3b0-4980-9d8a-233d39c21cd8 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:43.060086 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-6c6689a6-a3b0-4980-9d8a-233d39c21cd8 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:43.068404 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6c6689a6-a3b0-4980-9d8a-233d39c21cd8 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6" status: 200 len: 1503 microversion: 2.1 time: 0.189986 Oct 19 03:25:43.069077 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1538/3135] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:42 2022] GET /compute/v2.1/servers/25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6 => generated 1503 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:43.120461 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4038417c-87e2-459e-ab75-feb8396eef11 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:43.121697 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4038417c-87e2-459e-ab75-feb8396eef11 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] [instance: 4c823d1c-eebe-4aa6-972c-38209d6cc70e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:43.129524 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4038417c-87e2-459e-ab75-feb8396eef11 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:43.130213 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4038417c-87e2-459e-ab75-feb8396eef11 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:43.130832 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4038417c-87e2-459e-ab75-feb8396eef11 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:43.131712 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4038417c-87e2-459e-ab75-feb8396eef11 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:43.132167 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4038417c-87e2-459e-ab75-feb8396eef11 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:43.132598 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4038417c-87e2-459e-ab75-feb8396eef11 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:43.178903 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-80e9539f-612f-4101-a331-47da83404934 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '.version_select at 0x7fc130d105e0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:43.251939 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-80e9539f-612f-4101-a331-47da83404934 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/images/9014f0d3-c315-4e14-86df-7411ca9d43dc" status: 200 len: 1409 microversion: 2.1 time: 0.080125 Oct 19 03:25:43.261741 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1539/3136] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:25:43 2022] GET /compute/v2.1/images/9014f0d3-c315-4e14-86df-7411ca9d43dc => generated 1409 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:43.323183 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4038417c-87e2-459e-ab75-feb8396eef11 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5ed9dc7e0304f28afb381ef2ec3cefd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b2195b7d124b4eb2552f88dba26b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:43.333291 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4038417c-87e2-459e-ab75-feb8396eef11 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] 10.222.0.52 "GET /compute/v2.1/servers/4c823d1c-eebe-4aa6-972c-38209d6cc70e" status: 200 len: 1351 microversion: 2.1 time: 0.216822 Oct 19 03:25:43.334109 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1598/3137] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:43 2022] GET /compute/v2.1/servers/4c823d1c-eebe-4aa6-972c-38209d6cc70e => generated 1351 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:43.586684 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-45cc6a23-f47f-473a-995e-20324ee2300e tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:43.587304 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-45cc6a23-f47f-473a-995e-20324ee2300e tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] [instance: dac9628d-657b-4e72-8a7f-08156be8fad7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:43.595149 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-45cc6a23-f47f-473a-995e-20324ee2300e tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:43.596470 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-45cc6a23-f47f-473a-995e-20324ee2300e tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:43.596470 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-45cc6a23-f47f-473a-995e-20324ee2300e tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:43.597542 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-45cc6a23-f47f-473a-995e-20324ee2300e tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:43.598345 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-45cc6a23-f47f-473a-995e-20324ee2300e tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:43.598849 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-45cc6a23-f47f-473a-995e-20324ee2300e tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:43.628975 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:25:43.766173 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-45cc6a23-f47f-473a-995e-20324ee2300e tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7bf94a5de054f98a24a6a8f3d5fea9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f91748d2e94f85a70dcc787713fb6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:43.775291 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-45cc6a23-f47f-473a-995e-20324ee2300e tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7bf94a5de054f98a24a6a8f3d5fea9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f91748d2e94f85a70dcc787713fb6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:43.777186 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-45cc6a23-f47f-473a-995e-20324ee2300e tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7bf94a5de054f98a24a6a8f3d5fea9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f91748d2e94f85a70dcc787713fb6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:43.778376 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-45cc6a23-f47f-473a-995e-20324ee2300e tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] 10.222.0.52 "GET /compute/v2.1/servers/dac9628d-657b-4e72-8a7f-08156be8fad7" status: 200 len: 1359 microversion: 2.21 time: 0.198365 Oct 19 03:25:43.778957 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1540/3138] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:25:43 2022] GET /compute/v2.1/servers/dac9628d-657b-4e72-8a7f-08156be8fad7 => generated 1359 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:25:43.876419 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2405240b-ada3-42ab-91ff-2e395856c062 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:43.877223 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-2405240b-ada3-42ab-91ff-2e395856c062 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: e0e22e25-87ae-4a48-84b2-d58394a28b62] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:43.879757 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=12 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:25:43.885923 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2405240b-ada3-42ab-91ff-2e395856c062 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:43.886630 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2405240b-ada3-42ab-91ff-2e395856c062 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:43.887054 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2405240b-ada3-42ab-91ff-2e395856c062 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:43.887757 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2405240b-ada3-42ab-91ff-2e395856c062 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:43.888218 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2405240b-ada3-42ab-91ff-2e395856c062 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:43.888649 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2405240b-ada3-42ab-91ff-2e395856c062 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:43.906782 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-2405240b-ada3-42ab-91ff-2e395856c062 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] HTTP exception thrown: Instance e0e22e25-87ae-4a48-84b2-d58394a28b62 could not be found. Oct 19 03:25:43.908590 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2405240b-ada3-42ab-91ff-2e395856c062 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Request method failure captured: Oct 19 03:25:43.908590 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/e0e22e25-87ae-4a48-84b2-d58394a28b62 HTTP/1.1 Oct 19 03:25:43.908590 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:25:43.908590 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:25:43.908590 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:25:43.908590 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:25:43.908590 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:25:43.908590 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:25:43.908590 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:25:43.908590 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:25:43.908590 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT236feAW7aGPVoj9kEkUuQkRB8Nm9YBd70D85XbXnYqUAmlwAIPPx50C6dTRY9MbtBVt7IleIPYf6veKmIP1JclrFv3Px4uu5w7tRxEjRIxVTymsVviR-8HO1OxRuIfq2VSbST57MCBZOLAwnCIkIbO3ZT-DhhWvyFTRPdgvgRqqxa8 Oct 19 03:25:43.908590 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:25:43.908590 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:25:43.908590 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:25:43.908590 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:25:43.908590 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:25:43.908590 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:25:43.908590 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 7a836a10033546ed9a73a4f463587d72 Oct 19 03:25:43.908590 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ServersTestJSON-490256660 Oct 19 03:25:43.908590 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:25:43.908590 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:25:43.910405 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7a836a10033546ed9a73a4f463587d72"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7a836a10033546ed9a73a4f463587d72"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7a836a10033546ed9a73a4f463587d72"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7a836a10033546ed9a73a4f463587d72", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:25:43.910405 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ServersTestJSON-490256660 Oct 19 03:25:43.910405 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 7a836a10033546ed9a73a4f463587d72 Oct 19 03:25:43.910405 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ServersTestJSON-490256660 Oct 19 03:25:43.910405 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ServersTestJSON-490256660-project Oct 19 03:25:43.910405 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:25:43.910405 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:25:43.910405 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: b09d2eecd3d9419189e6308379fa8a09 Oct 19 03:25:43.910405 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ServersTestJSON-490256660-project Oct 19 03:25:43.910405 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:25:43.910405 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance e0e22e25-87ae-4a48-84b2-d58394a28b62 could not be found. Oct 19 03:25:43.910405 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': 'e0e22e25-87ae-4a48-84b2-d58394a28b62'} Oct 19 03:25:43.911219 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:25:43.911219 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:25:43.911219 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:25:43.911219 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:25:43.911219 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:25:43.911219 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:25:43.911219 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:25:43.911219 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:25:43.911219 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:25:43.911219 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:25:43.911219 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0e22e25-87ae-4a48-84b2-d58394a28b62 could not be found. Oct 19 03:25:43.911219 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:25:43.911219 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:25:43.911219 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:25:43.911219 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:25:43.911219 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:25:43.911219 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:25:43.911219 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:25:43.911219 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:25:43.911219 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:25:43.915268 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:25:43.915268 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:25:43.915268 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:25:43.915268 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:25:43.915268 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:25:43.915268 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:25:43.915268 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:25:43.915268 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0e22e25-87ae-4a48-84b2-d58394a28b62 could not be found. Oct 19 03:25:43.915268 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:25:43.915268 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:25:43.915268 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:25:43.915268 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:25:43.915268 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:25:43.915268 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:25:43.915268 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:25:43.915268 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:25:43.915268 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0e22e25-87ae-4a48-84b2-d58394a28b62 could not be found. Oct 19 03:25:43.915268 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:25:43.917798 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2405240b-ada3-42ab-91ff-2e395856c062 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Returning 404 to user: Instance e0e22e25-87ae-4a48-84b2-d58394a28b62 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:25:43.917798 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2405240b-ada3-42ab-91ff-2e395856c062 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/e0e22e25-87ae-4a48-84b2-d58394a28b62" status: 404 len: 111 microversion: 2.1 time: 0.038305 Oct 19 03:25:43.919171 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1599/3139] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:43 2022] GET /compute/v2.1/servers/e0e22e25-87ae-4a48-84b2-d58394a28b62 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:25:43.931932 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-99c4c1e2-b221-4f47-ae89-985970977609 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Action: 'create', calling method: .version_select at 0x7fc1312473a0>, body: {"keypair": {"name": "tempest-key-436191766", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBANtc/8VXQd+UosANthlQNBiJMWpU7fGHSTNoctApL4xPPuRvfG+YZM1l9RLsEoZOknb4AIcDCTiL8zlerd0pNGGr6JiW8ufj23EQ2ESLtc8RoQAXRKWsVWGsDOJA1BP2w=="}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:25:43.948659 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-99c4c1e2-b221-4f47-ae89-985970977609 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Getting quotas for project 7a836a10033546ed9a73a4f463587d72. Resources: {'key_pairs'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:25:43.954889 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-99c4c1e2-b221-4f47-ae89-985970977609 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Getting quotas for user b09d2eecd3d9419189e6308379fa8a09 and project 7a836a10033546ed9a73a4f463587d72. Resources: {'key_pairs'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:25:44.031797 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-99c4c1e2-b221-4f47-ae89-985970977609 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 381 microversion: 2.1 time: 0.107212 Oct 19 03:25:44.032433 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1541/3140] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Oct 19 03:25:43 2022] POST /compute/v2.1/os-keypairs => generated 381 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:25:44.043278 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-807cdc1c-229b-4eb2-8f44-961fe592a7ee tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '.version_select at 0x7fc130ede280>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:44.047676 n-d-861333-8 devstack@n-api.service[121135]: WARNING oslo_db.sqlalchemy.utils [None req-807cdc1c-229b-4eb2-8f44-961fe592a7ee tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 19 03:25:44.053541 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-807cdc1c-229b-4eb2-8f44-961fe592a7ee tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/os-keypairs" status: 200 len: 350 microversion: 2.1 time: 0.014154 Oct 19 03:25:44.056140 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1600/3141] 10.222.0.52 () {58 vars in 1137 bytes} [Wed Oct 19 03:25:44 2022] GET /compute/v2.1/os-keypairs => generated 350 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:25:44.093500 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5925e63a-37fc-42a1-93a4-2e4b78e117ce tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:44.094493 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5925e63a-37fc-42a1-93a4-2e4b78e117ce tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:44.102534 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5925e63a-37fc-42a1-93a4-2e4b78e117ce tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:44.103190 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5925e63a-37fc-42a1-93a4-2e4b78e117ce tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:44.103796 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5925e63a-37fc-42a1-93a4-2e4b78e117ce tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:44.104797 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5925e63a-37fc-42a1-93a4-2e4b78e117ce tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:44.105812 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5925e63a-37fc-42a1-93a4-2e4b78e117ce tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:44.106282 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5925e63a-37fc-42a1-93a4-2e4b78e117ce tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:44.110814 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0442c8bc-f3d0-4f27-948a-4fcb282ecbb7 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-480856618", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "key_name": "tempest-key-436191766", "networks": [{"uuid": "05216dbc-056d-4707-86fe-afea9c8b3e8d"}]}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:25:44.183260 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.network.neutron [None req-0442c8bc-f3d0-4f27-948a-4fcb282ecbb7 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] validate_networks() for [('05216dbc-056d-4707-86fe-afea9c8b3e8d', None, None, None, None, None)] {{(pid=121135) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:25:44.564966 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5925e63a-37fc-42a1-93a4-2e4b78e117ce tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:44.564966 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5925e63a-37fc-42a1-93a4-2e4b78e117ce tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6" status: 200 len: 1503 microversion: 2.1 time: 0.254519 Oct 19 03:25:44.564966 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1542/3142] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:44 2022] GET /compute/v2.1/servers/25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6 => generated 1503 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:44.564966 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d4ce1aff-121c-488a-94e9-01465d003d1c tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '.version_select at 0x7fc130b74af0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:44.565710 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d4ce1aff-121c-488a-94e9-01465d003d1c tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/images/9014f0d3-c315-4e14-86df-7411ca9d43dc" status: 200 len: 1409 microversion: 2.1 time: 0.071390 Oct 19 03:25:44.565710 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1543/3143] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:25:44 2022] GET /compute/v2.1/images/9014f0d3-c315-4e14-86df-7411ca9d43dc => generated 1409 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:44.565710 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-53d2eca0-c7f5-48e5-8462-7cdd1012b61e tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:44.565710 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-53d2eca0-c7f5-48e5-8462-7cdd1012b61e tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] [instance: 4c823d1c-eebe-4aa6-972c-38209d6cc70e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:44.565710 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-53d2eca0-c7f5-48e5-8462-7cdd1012b61e tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:44.566215 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-53d2eca0-c7f5-48e5-8462-7cdd1012b61e tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:44.566215 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-53d2eca0-c7f5-48e5-8462-7cdd1012b61e tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:44.566215 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-53d2eca0-c7f5-48e5-8462-7cdd1012b61e tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:44.566215 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-53d2eca0-c7f5-48e5-8462-7cdd1012b61e tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:44.567055 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-53d2eca0-c7f5-48e5-8462-7cdd1012b61e tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:44.687210 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-53d2eca0-c7f5-48e5-8462-7cdd1012b61e tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5ed9dc7e0304f28afb381ef2ec3cefd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b2195b7d124b4eb2552f88dba26b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:44.699120 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-53d2eca0-c7f5-48e5-8462-7cdd1012b61e tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] 10.222.0.52 "GET /compute/v2.1/servers/4c823d1c-eebe-4aa6-972c-38209d6cc70e" status: 200 len: 1351 microversion: 2.1 time: 0.270541 Oct 19 03:25:44.705287 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1544/3144] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:44 2022] GET /compute/v2.1/servers/4c823d1c-eebe-4aa6-972c-38209d6cc70e => generated 1351 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:44.805767 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-bed35ff0-b8bf-4749-be07-1cc26b49c729 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:44.807770 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-0442c8bc-f3d0-4f27-948a-4fcb282ecbb7 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Flavor limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:25:44.808905 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-0442c8bc-f3d0-4f27-948a-4fcb282ecbb7 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Image limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:25:44.808905 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-0442c8bc-f3d0-4f27-948a-4fcb282ecbb7 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Flavor pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:25:44.809091 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-0442c8bc-f3d0-4f27-948a-4fcb282ecbb7 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Image pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:25:44.809530 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-0442c8bc-f3d0-4f27-948a-4fcb282ecbb7 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:25:44.810226 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-bed35ff0-b8bf-4749-be07-1cc26b49c729 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] [instance: dac9628d-657b-4e72-8a7f-08156be8fad7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:44.819634 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bed35ff0-b8bf-4749-be07-1cc26b49c729 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:44.820583 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bed35ff0-b8bf-4749-be07-1cc26b49c729 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:44.821266 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bed35ff0-b8bf-4749-be07-1cc26b49c729 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:44.824635 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bed35ff0-b8bf-4749-be07-1cc26b49c729 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:44.825407 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bed35ff0-b8bf-4749-be07-1cc26b49c729 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:44.825598 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0442c8bc-f3d0-4f27-948a-4fcb282ecbb7 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:44.826089 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0442c8bc-f3d0-4f27-948a-4fcb282ecbb7 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:44.826497 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bed35ff0-b8bf-4749-be07-1cc26b49c729 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:44.826628 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0442c8bc-f3d0-4f27-948a-4fcb282ecbb7 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:44.829453 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0442c8bc-f3d0-4f27-948a-4fcb282ecbb7 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:44.829979 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0442c8bc-f3d0-4f27-948a-4fcb282ecbb7 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:44.833566 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0442c8bc-f3d0-4f27-948a-4fcb282ecbb7 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:44.868236 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-0442c8bc-f3d0-4f27-948a-4fcb282ecbb7 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Getting quotas for project 7a836a10033546ed9a73a4f463587d72. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:25:44.875577 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-0442c8bc-f3d0-4f27-948a-4fcb282ecbb7 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Getting quotas for user b09d2eecd3d9419189e6308379fa8a09 and project 7a836a10033546ed9a73a4f463587d72. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:25:44.892973 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0442c8bc-f3d0-4f27-948a-4fcb282ecbb7 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Going to run 1 instances... {{(pid=121135) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:25:44.895656 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0442c8bc-f3d0-4f27-948a-4fcb282ecbb7 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: f71d8b11-c58e-493d-a03c-90d042f22218] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121135) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:25:44.966665 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:25:45.097235 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-bed35ff0-b8bf-4749-be07-1cc26b49c729 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7bf94a5de054f98a24a6a8f3d5fea9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f91748d2e94f85a70dcc787713fb6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:45.107648 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0442c8bc-f3d0-4f27-948a-4fcb282ecbb7 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.000651 Oct 19 03:25:45.109501 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1601/3145] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:25:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1003 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 03:25:45.113533 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-bed35ff0-b8bf-4749-be07-1cc26b49c729 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7bf94a5de054f98a24a6a8f3d5fea9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f91748d2e94f85a70dcc787713fb6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:45.115798 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-bed35ff0-b8bf-4749-be07-1cc26b49c729 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7bf94a5de054f98a24a6a8f3d5fea9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f91748d2e94f85a70dcc787713fb6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:45.117033 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-bed35ff0-b8bf-4749-be07-1cc26b49c729 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] 10.222.0.52 "GET /compute/v2.1/servers/dac9628d-657b-4e72-8a7f-08156be8fad7" status: 200 len: 1359 microversion: 2.21 time: 0.316025 Oct 19 03:25:45.117999 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1545/3146] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:25:44 2022] GET /compute/v2.1/servers/dac9628d-657b-4e72-8a7f-08156be8fad7 => generated 1359 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:25:45.146431 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e76df6dc-64bb-4446-8ab3-2f719759c1ca tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:45.147332 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e76df6dc-64bb-4446-8ab3-2f719759c1ca tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: f71d8b11-c58e-493d-a03c-90d042f22218] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:45.260264 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-e76df6dc-64bb-4446-8ab3-2f719759c1ca tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:45.269220 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e76df6dc-64bb-4446-8ab3-2f719759c1ca tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/f71d8b11-c58e-493d-a03c-90d042f22218" status: 200 len: 1227 microversion: 2.1 time: 0.128428 Oct 19 03:25:45.276605 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1602/3147] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:45 2022] GET /compute/v2.1/servers/f71d8b11-c58e-493d-a03c-90d042f22218 => generated 1227 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:45.372765 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1f0b0fda-7354-4a47-ba3f-61a83a1301cd tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:45.373402 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1f0b0fda-7354-4a47-ba3f-61a83a1301cd tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:45.382094 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1f0b0fda-7354-4a47-ba3f-61a83a1301cd tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:45.382599 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1f0b0fda-7354-4a47-ba3f-61a83a1301cd tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:45.383042 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1f0b0fda-7354-4a47-ba3f-61a83a1301cd tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:45.383749 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1f0b0fda-7354-4a47-ba3f-61a83a1301cd tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:45.384252 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1f0b0fda-7354-4a47-ba3f-61a83a1301cd tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:45.389282 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1f0b0fda-7354-4a47-ba3f-61a83a1301cd tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:45.445132 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2adac511-9a00-4535-98ae-5c6e139df513 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '.version_select at 0x7fc130270700>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:45.490904 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2adac511-9a00-4535-98ae-5c6e139df513 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/images/9014f0d3-c315-4e14-86df-7411ca9d43dc" status: 200 len: 1409 microversion: 2.1 time: 0.050767 Oct 19 03:25:45.491530 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1603/3148] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:25:45 2022] GET /compute/v2.1/images/9014f0d3-c315-4e14-86df-7411ca9d43dc => generated 1409 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:25:45.626159 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-1f0b0fda-7354-4a47-ba3f-61a83a1301cd tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:45.634080 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1f0b0fda-7354-4a47-ba3f-61a83a1301cd tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6" status: 200 len: 1503 microversion: 2.1 time: 0.265765 Oct 19 03:25:45.634703 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1546/3149] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:45 2022] GET /compute/v2.1/servers/25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6 => generated 1503 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:45.725022 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-119261b5-c38b-477a-9281-ce50906a1b97 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:45.725706 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-119261b5-c38b-477a-9281-ce50906a1b97 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] [instance: 4c823d1c-eebe-4aa6-972c-38209d6cc70e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:45.733166 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-119261b5-c38b-477a-9281-ce50906a1b97 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:45.733868 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-119261b5-c38b-477a-9281-ce50906a1b97 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:45.734315 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-119261b5-c38b-477a-9281-ce50906a1b97 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:45.735155 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-119261b5-c38b-477a-9281-ce50906a1b97 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:45.735751 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-119261b5-c38b-477a-9281-ce50906a1b97 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:45.736230 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-119261b5-c38b-477a-9281-ce50906a1b97 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:45.873530 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-119261b5-c38b-477a-9281-ce50906a1b97 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5ed9dc7e0304f28afb381ef2ec3cefd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b2195b7d124b4eb2552f88dba26b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:45.881671 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-119261b5-c38b-477a-9281-ce50906a1b97 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] 10.222.0.52 "GET /compute/v2.1/servers/4c823d1c-eebe-4aa6-972c-38209d6cc70e" status: 200 len: 1351 microversion: 2.1 time: 0.160978 Oct 19 03:25:45.882245 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1604/3150] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:45 2022] GET /compute/v2.1/servers/4c823d1c-eebe-4aa6-972c-38209d6cc70e => generated 1351 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:46.147170 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e8a685b4-33a5-4d3b-a61f-22c450062bb0 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:46.147719 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e8a685b4-33a5-4d3b-a61f-22c450062bb0 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] [instance: dac9628d-657b-4e72-8a7f-08156be8fad7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:46.154800 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e8a685b4-33a5-4d3b-a61f-22c450062bb0 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:46.155297 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e8a685b4-33a5-4d3b-a61f-22c450062bb0 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:46.155743 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e8a685b4-33a5-4d3b-a61f-22c450062bb0 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:46.156453 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e8a685b4-33a5-4d3b-a61f-22c450062bb0 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:46.156910 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e8a685b4-33a5-4d3b-a61f-22c450062bb0 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:46.157346 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e8a685b4-33a5-4d3b-a61f-22c450062bb0 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:46.292700 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a64c257d-1adf-49b1-9e26-b3bf39ccadf2 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:46.295271 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a64c257d-1adf-49b1-9e26-b3bf39ccadf2 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: f71d8b11-c58e-493d-a03c-90d042f22218] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:46.360085 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e8a685b4-33a5-4d3b-a61f-22c450062bb0 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7bf94a5de054f98a24a6a8f3d5fea9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f91748d2e94f85a70dcc787713fb6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:46.370198 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e8a685b4-33a5-4d3b-a61f-22c450062bb0 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7bf94a5de054f98a24a6a8f3d5fea9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f91748d2e94f85a70dcc787713fb6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:46.373273 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a64c257d-1adf-49b1-9e26-b3bf39ccadf2 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:46.377296 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e8a685b4-33a5-4d3b-a61f-22c450062bb0 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7bf94a5de054f98a24a6a8f3d5fea9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f91748d2e94f85a70dcc787713fb6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:46.392410 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e8a685b4-33a5-4d3b-a61f-22c450062bb0 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] 10.222.0.52 "GET /compute/v2.1/servers/dac9628d-657b-4e72-8a7f-08156be8fad7" status: 200 len: 1359 microversion: 2.21 time: 0.235413 Oct 19 03:25:46.392410 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1547/3151] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:25:46 2022] GET /compute/v2.1/servers/dac9628d-657b-4e72-8a7f-08156be8fad7 => generated 1359 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:25:46.392656 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a64c257d-1adf-49b1-9e26-b3bf39ccadf2 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/f71d8b11-c58e-493d-a03c-90d042f22218" status: 200 len: 1227 microversion: 2.1 time: 0.095115 Oct 19 03:25:46.397773 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1605/3152] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:46 2022] GET /compute/v2.1/servers/f71d8b11-c58e-493d-a03c-90d042f22218 => generated 1227 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:25:46.507101 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8b954a2f-12ba-4aea-bcf8-6eacd0b0f03d tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '.version_select at 0x7fc130af7040>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:46.566669 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8b954a2f-12ba-4aea-bcf8-6eacd0b0f03d tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/images/9014f0d3-c315-4e14-86df-7411ca9d43dc" status: 200 len: 1418 microversion: 2.1 time: 0.063356 Oct 19 03:25:46.576854 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1548/3153] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:25:46 2022] GET /compute/v2.1/images/9014f0d3-c315-4e14-86df-7411ca9d43dc => generated 1418 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:46.582110 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a8901e16-df62-4ca0-a30a-8b4883d0834a tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '.version_select at 0x7fc1305d71f0>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:46.627038 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a8901e16-df62-4ca0-a30a-8b4883d0834a tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/images/9014f0d3-c315-4e14-86df-7411ca9d43dc" status: 200 len: 1418 microversion: 2.1 time: 0.048929 Oct 19 03:25:46.627598 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1606/3154] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:25:46 2022] GET /compute/v2.1/images/9014f0d3-c315-4e14-86df-7411ca9d43dc => generated 1418 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:46.657521 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8f8777f2-8af8-4227-8c91-357dbfd713de tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:46.658060 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8f8777f2-8af8-4227-8c91-357dbfd713de tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:46.664497 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8f8777f2-8af8-4227-8c91-357dbfd713de tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:46.664981 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8f8777f2-8af8-4227-8c91-357dbfd713de tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:46.665452 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8f8777f2-8af8-4227-8c91-357dbfd713de tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:46.666143 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8f8777f2-8af8-4227-8c91-357dbfd713de tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:46.666594 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8f8777f2-8af8-4227-8c91-357dbfd713de tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:46.667012 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8f8777f2-8af8-4227-8c91-357dbfd713de tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:46.740945 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-53ab976e-e4ef-49e8-8abb-b11aaf17cd4d tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1693424030", "imageRef": "9014f0d3-c315-4e14-86df-7411ca9d43dc", "flavorRef": "452", "networks": [{"uuid": "99edd0a7-1ab1-49c6-b3e8-36828942abe3"}]}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:25:46.805324 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.network.neutron [None req-53ab976e-e4ef-49e8-8abb-b11aaf17cd4d tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] validate_networks() for [('99edd0a7-1ab1-49c6-b3e8-36828942abe3', None, None, None, None, None)] {{(pid=121135) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:25:46.882556 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8f8777f2-8af8-4227-8c91-357dbfd713de tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:46.890915 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8f8777f2-8af8-4227-8c91-357dbfd713de tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6" status: 200 len: 1478 microversion: 2.1 time: 0.238019 Oct 19 03:25:46.891704 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1549/3155] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:46 2022] GET /compute/v2.1/servers/25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6 => generated 1478 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:25:46.905146 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e98947e2-f9c6-4245-8ea5-e626bc695909 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:46.905896 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e98947e2-f9c6-4245-8ea5-e626bc695909 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] [instance: 4c823d1c-eebe-4aa6-972c-38209d6cc70e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:46.921006 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e98947e2-f9c6-4245-8ea5-e626bc695909 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:46.921926 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e98947e2-f9c6-4245-8ea5-e626bc695909 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:46.922376 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e98947e2-f9c6-4245-8ea5-e626bc695909 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:46.922834 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e98947e2-f9c6-4245-8ea5-e626bc695909 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:46.923295 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e98947e2-f9c6-4245-8ea5-e626bc695909 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:46.923725 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e98947e2-f9c6-4245-8ea5-e626bc695909 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:47.157603 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e98947e2-f9c6-4245-8ea5-e626bc695909 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5ed9dc7e0304f28afb381ef2ec3cefd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b2195b7d124b4eb2552f88dba26b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:47.166849 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e98947e2-f9c6-4245-8ea5-e626bc695909 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] 10.222.0.52 "GET /compute/v2.1/servers/4c823d1c-eebe-4aa6-972c-38209d6cc70e" status: 200 len: 1351 microversion: 2.1 time: 0.266016 Oct 19 03:25:47.167367 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1550/3156] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:46 2022] GET /compute/v2.1/servers/4c823d1c-eebe-4aa6-972c-38209d6cc70e => generated 1351 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:47.171922 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-fac77f1e-a318-4853-be3d-9d72acef50fc tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Calling method '.version_select at 0x7fc1300aaa60>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:47.175589 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fac77f1e-a318-4853-be3d-9d72acef50fc tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:47.176136 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fac77f1e-a318-4853-be3d-9d72acef50fc tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:47.176580 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fac77f1e-a318-4853-be3d-9d72acef50fc tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:47.184406 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-fac77f1e-a318-4853-be3d-9d72acef50fc tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] 10.222.0.52 "GET /compute/v2.1/os-migrations" status: 200 len: 783 microversion: 2.1 time: 0.016056 Oct 19 03:25:47.185019 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1551/3157] 10.222.0.52 () {58 vars in 1143 bytes} [Wed Oct 19 03:25:47 2022] GET /compute/v2.1/os-migrations => generated 783 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:25:47.198191 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-427e02a2-6ee4-4cc3-9f0c-d1a46294abc8 tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:47.198830 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-427e02a2-6ee4-4cc3-9f0c-d1a46294abc8 tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] [instance: 25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:47.205845 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-427e02a2-6ee4-4cc3-9f0c-d1a46294abc8 tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:47.205995 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-427e02a2-6ee4-4cc3-9f0c-d1a46294abc8 tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:47.206434 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-427e02a2-6ee4-4cc3-9f0c-d1a46294abc8 tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:47.207288 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-427e02a2-6ee4-4cc3-9f0c-d1a46294abc8 tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:47.207749 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-427e02a2-6ee4-4cc3-9f0c-d1a46294abc8 tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:47.208176 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-427e02a2-6ee4-4cc3-9f0c-d1a46294abc8 tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:47.325878 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-53ab976e-e4ef-49e8-8abb-b11aaf17cd4d tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Flavor limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:25:47.326388 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-53ab976e-e4ef-49e8-8abb-b11aaf17cd4d tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Image limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:25:47.326790 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-53ab976e-e4ef-49e8-8abb-b11aaf17cd4d tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Flavor pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:25:47.327209 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-53ab976e-e4ef-49e8-8abb-b11aaf17cd4d tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Image pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:25:47.327631 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-53ab976e-e4ef-49e8-8abb-b11aaf17cd4d tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:25:47.351071 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-53ab976e-e4ef-49e8-8abb-b11aaf17cd4d tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:47.351919 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-53ab976e-e4ef-49e8-8abb-b11aaf17cd4d tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:47.352599 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-53ab976e-e4ef-49e8-8abb-b11aaf17cd4d tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:47.354317 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-53ab976e-e4ef-49e8-8abb-b11aaf17cd4d tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:47.354998 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-53ab976e-e4ef-49e8-8abb-b11aaf17cd4d tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:47.355653 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-53ab976e-e4ef-49e8-8abb-b11aaf17cd4d tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:47.370214 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-427e02a2-6ee4-4cc3-9f0c-d1a46294abc8 tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6" status: 200 len: 1629 microversion: 2.1 time: 0.175486 Oct 19 03:25:47.371185 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1552/3158] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:47 2022] GET /compute/v2.1/servers/25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6 => generated 1629 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:25:47.387170 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-53ab976e-e4ef-49e8-8abb-b11aaf17cd4d tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Getting quotas for project 686dbeeaed0b44538a9bbc54d457a720. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:25:47.401802 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-53ab976e-e4ef-49e8-8abb-b11aaf17cd4d tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Getting quotas for user 57008d884859417ebc1456b55ec3f6e0 and project 686dbeeaed0b44538a9bbc54d457a720. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:25:47.407182 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a3d3c699-5b3f-4861-a39d-bf373589e1d0 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:47.408092 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a3d3c699-5b3f-4861-a39d-bf373589e1d0 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] [instance: dac9628d-657b-4e72-8a7f-08156be8fad7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:47.415288 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a3d3c699-5b3f-4861-a39d-bf373589e1d0 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:47.416485 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a3d3c699-5b3f-4861-a39d-bf373589e1d0 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:47.417654 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a3d3c699-5b3f-4861-a39d-bf373589e1d0 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:47.418279 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-53ab976e-e4ef-49e8-8abb-b11aaf17cd4d tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Going to run 1 instances... {{(pid=121135) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:25:47.418405 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a3d3c699-5b3f-4861-a39d-bf373589e1d0 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:47.418809 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a3d3c699-5b3f-4861-a39d-bf373589e1d0 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:47.419314 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a3d3c699-5b3f-4861-a39d-bf373589e1d0 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:47.420544 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-53ab976e-e4ef-49e8-8abb-b11aaf17cd4d tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: e022fc4b-88e6-44c8-9729-7e8d25238bb3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9014f0d3-c315-4e14-86df-7411ca9d43dc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121135) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:25:47.558442 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a3d3c699-5b3f-4861-a39d-bf373589e1d0 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7bf94a5de054f98a24a6a8f3d5fea9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f91748d2e94f85a70dcc787713fb6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:47.566741 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a3d3c699-5b3f-4861-a39d-bf373589e1d0 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7bf94a5de054f98a24a6a8f3d5fea9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f91748d2e94f85a70dcc787713fb6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:47.568169 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a3d3c699-5b3f-4861-a39d-bf373589e1d0 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7bf94a5de054f98a24a6a8f3d5fea9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f91748d2e94f85a70dcc787713fb6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:47.569281 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a3d3c699-5b3f-4861-a39d-bf373589e1d0 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] 10.222.0.52 "GET /compute/v2.1/servers/dac9628d-657b-4e72-8a7f-08156be8fad7" status: 200 len: 1359 microversion: 2.21 time: 0.167320 Oct 19 03:25:47.569861 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1553/3159] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:25:47 2022] GET /compute/v2.1/servers/dac9628d-657b-4e72-8a7f-08156be8fad7 => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:25:47.574940 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-53ab976e-e4ef-49e8-8abb-b11aaf17cd4d tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.838041 Oct 19 03:25:47.581476 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1607/3160] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:25:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 840 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 19 03:25:47.581666 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-392c31e0-9654-403f-8ac8-d4144cf6f9c2 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Action: 'create', calling method: .version_select at 0x7fc130d9c550>, body: {"keypair": {"name": "tempest-keypair-167267698", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOmboHb1gkzSY41s2bHI9V0vqTLj67B9saPndJb+WJGg4JbMzDMpp4qO5UpP/ZVSZSBFyOB47nT+QMApjTqypIoers5btX782svwL/nrX8utb7h7n2mx5ylm864OunDR7Q=="}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:25:47.586347 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-bd0beee9-50bf-4c9d-b574-da74d9f13559 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:47.588048 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-bd0beee9-50bf-4c9d-b574-da74d9f13559 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: f71d8b11-c58e-493d-a03c-90d042f22218] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:47.593091 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-392c31e0-9654-403f-8ac8-d4144cf6f9c2 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Getting quotas for project 8019441bff8642cebf21fd1c4e890196. Resources: {'key_pairs'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:25:47.595088 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bd0beee9-50bf-4c9d-b574-da74d9f13559 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:47.595546 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bd0beee9-50bf-4c9d-b574-da74d9f13559 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:47.595987 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bd0beee9-50bf-4c9d-b574-da74d9f13559 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:47.596687 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bd0beee9-50bf-4c9d-b574-da74d9f13559 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:47.597139 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bd0beee9-50bf-4c9d-b574-da74d9f13559 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:47.597658 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bd0beee9-50bf-4c9d-b574-da74d9f13559 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:47.598707 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-392c31e0-9654-403f-8ac8-d4144cf6f9c2 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Getting quotas for user 2b5b2cb1272541dfbc2659cf4adf9026 and project 8019441bff8642cebf21fd1c4e890196. Resources: {'key_pairs'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:25:47.661414 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-bd0beee9-50bf-4c9d-b574-da74d9f13559 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:47.669698 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-bd0beee9-50bf-4c9d-b574-da74d9f13559 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/f71d8b11-c58e-493d-a03c-90d042f22218" status: 200 len: 1279 microversion: 2.1 time: 0.092569 Oct 19 03:25:47.670230 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1608/3161] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:47 2022] GET /compute/v2.1/servers/f71d8b11-c58e-493d-a03c-90d042f22218 => generated 1279 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:47.687291 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-603aaa43-f99c-46fa-9581-fd7c2f7f9197 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:47.687291 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-603aaa43-f99c-46fa-9581-fd7c2f7f9197 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: e022fc4b-88e6-44c8-9729-7e8d25238bb3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:47.703194 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-392c31e0-9654-403f-8ac8-d4144cf6f9c2 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.132243 Oct 19 03:25:47.705725 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1554/3162] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Oct 19 03:25:47 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:25:47.749078 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-603aaa43-f99c-46fa-9581-fd7c2f7f9197 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:47.754605 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-603aaa43-f99c-46fa-9581-fd7c2f7f9197 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/e022fc4b-88e6-44c8-9729-7e8d25238bb3" status: 200 len: 1208 microversion: 2.1 time: 0.072549 Oct 19 03:25:47.755377 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1609/3163] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:47 2022] GET /compute/v2.1/servers/e022fc4b-88e6-44c8-9729-7e8d25238bb3 => generated 1208 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:48.190550 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f8a8ac73-d467-4473-a301-d8b3ded48912 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:48.191168 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f8a8ac73-d467-4473-a301-d8b3ded48912 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] [instance: 4c823d1c-eebe-4aa6-972c-38209d6cc70e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:48.199658 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f8a8ac73-d467-4473-a301-d8b3ded48912 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:48.200036 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f8a8ac73-d467-4473-a301-d8b3ded48912 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:48.201005 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f8a8ac73-d467-4473-a301-d8b3ded48912 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:48.201958 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f8a8ac73-d467-4473-a301-d8b3ded48912 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:48.202962 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f8a8ac73-d467-4473-a301-d8b3ded48912 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:48.208626 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f8a8ac73-d467-4473-a301-d8b3ded48912 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:48.438841 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-f8a8ac73-d467-4473-a301-d8b3ded48912 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5ed9dc7e0304f28afb381ef2ec3cefd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b2195b7d124b4eb2552f88dba26b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:48.444299 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f8a8ac73-d467-4473-a301-d8b3ded48912 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] 10.222.0.52 "GET /compute/v2.1/servers/4c823d1c-eebe-4aa6-972c-38209d6cc70e" status: 200 len: 1351 microversion: 2.1 time: 0.255581 Oct 19 03:25:48.444918 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1555/3164] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:48 2022] GET /compute/v2.1/servers/4c823d1c-eebe-4aa6-972c-38209d6cc70e => generated 1351 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:48.596456 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7f4abc4a-0251-466d-9fe9-88647fe098eb tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:48.597795 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7f4abc4a-0251-466d-9fe9-88647fe098eb tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] [instance: dac9628d-657b-4e72-8a7f-08156be8fad7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:48.607358 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7f4abc4a-0251-466d-9fe9-88647fe098eb tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:48.608716 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7f4abc4a-0251-466d-9fe9-88647fe098eb tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:48.609423 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7f4abc4a-0251-466d-9fe9-88647fe098eb tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:48.610482 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7f4abc4a-0251-466d-9fe9-88647fe098eb tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:48.610987 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7f4abc4a-0251-466d-9fe9-88647fe098eb tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:48.611489 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7f4abc4a-0251-466d-9fe9-88647fe098eb tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:48.694537 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7d81886a-c524-4925-bd2a-8b89a28bfc97 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:48.695262 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7d81886a-c524-4925-bd2a-8b89a28bfc97 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: f71d8b11-c58e-493d-a03c-90d042f22218] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:48.702554 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7d81886a-c524-4925-bd2a-8b89a28bfc97 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:48.703057 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7d81886a-c524-4925-bd2a-8b89a28bfc97 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:48.703507 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7d81886a-c524-4925-bd2a-8b89a28bfc97 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:48.704260 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7d81886a-c524-4925-bd2a-8b89a28bfc97 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:48.704719 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7d81886a-c524-4925-bd2a-8b89a28bfc97 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:48.705426 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7d81886a-c524-4925-bd2a-8b89a28bfc97 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:48.869650 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7f4abc4a-0251-466d-9fe9-88647fe098eb tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7bf94a5de054f98a24a6a8f3d5fea9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f91748d2e94f85a70dcc787713fb6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:48.882234 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7f4abc4a-0251-466d-9fe9-88647fe098eb tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7bf94a5de054f98a24a6a8f3d5fea9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f91748d2e94f85a70dcc787713fb6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:48.884811 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7f4abc4a-0251-466d-9fe9-88647fe098eb tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7bf94a5de054f98a24a6a8f3d5fea9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f91748d2e94f85a70dcc787713fb6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:48.890245 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7f4abc4a-0251-466d-9fe9-88647fe098eb tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] 10.222.0.52 "GET /compute/v2.1/servers/dac9628d-657b-4e72-8a7f-08156be8fad7" status: 200 len: 1359 microversion: 2.21 time: 0.296617 Oct 19 03:25:48.891801 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1610/3165] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:25:48 2022] GET /compute/v2.1/servers/dac9628d-657b-4e72-8a7f-08156be8fad7 => generated 1359 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:25:48.897645 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-544a2f40-87ce-4333-916f-9e3c1dffa830 req-0ffeb8f8-361e-42cb-a928-38a4ef075bd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c823d1c-eebe-4aa6-972c-38209d6cc70e", "name": "network-vif-plugged", "status": "completed", "tag": "2450ebc0-ad1d-4651-825d-17d4dd7a5d3d"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:25:48.911062 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-544a2f40-87ce-4333-916f-9e3c1dffa830 req-0ffeb8f8-361e-42cb-a928-38a4ef075bd4 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:48.911858 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-544a2f40-87ce-4333-916f-9e3c1dffa830 req-0ffeb8f8-361e-42cb-a928-38a4ef075bd4 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:48.912864 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-544a2f40-87ce-4333-916f-9e3c1dffa830 req-0ffeb8f8-361e-42cb-a928-38a4ef075bd4 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:48.930990 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-544a2f40-87ce-4333-916f-9e3c1dffa830 req-0ffeb8f8-361e-42cb-a928-38a4ef075bd4 service nova] Creating event network-vif-plugged:2450ebc0-ad1d-4651-825d-17d4dd7a5d3d for instance 4c823d1c-eebe-4aa6-972c-38209d6cc70e on n-h1-861333-8 Oct 19 03:25:48.947351 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-544a2f40-87ce-4333-916f-9e3c1dffa830 req-0ffeb8f8-361e-42cb-a928-38a4ef075bd4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052779 Oct 19 03:25:48.948489 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1611/3166] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:25:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:25:48.959380 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-451517c0-96f0-4bb6-bf8a-afba538c1ab7 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:48.959380 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-451517c0-96f0-4bb6-bf8a-afba538c1ab7 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: e022fc4b-88e6-44c8-9729-7e8d25238bb3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:48.965997 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-451517c0-96f0-4bb6-bf8a-afba538c1ab7 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:48.967221 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-451517c0-96f0-4bb6-bf8a-afba538c1ab7 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:48.967686 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-451517c0-96f0-4bb6-bf8a-afba538c1ab7 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:48.970161 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-451517c0-96f0-4bb6-bf8a-afba538c1ab7 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:48.970928 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-451517c0-96f0-4bb6-bf8a-afba538c1ab7 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:48.971604 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-451517c0-96f0-4bb6-bf8a-afba538c1ab7 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:49.058391 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-7d81886a-c524-4925-bd2a-8b89a28bfc97 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:49.068903 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7d81886a-c524-4925-bd2a-8b89a28bfc97 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/f71d8b11-c58e-493d-a03c-90d042f22218" status: 200 len: 1327 microversion: 2.1 time: 0.378044 Oct 19 03:25:49.073403 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1556/3167] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:48 2022] GET /compute/v2.1/servers/f71d8b11-c58e-493d-a03c-90d042f22218 => generated 1327 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:25:49.123026 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-451517c0-96f0-4bb6-bf8a-afba538c1ab7 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:49.132602 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-451517c0-96f0-4bb6-bf8a-afba538c1ab7 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/e022fc4b-88e6-44c8-9729-7e8d25238bb3" status: 200 len: 1212 microversion: 2.1 time: 0.182563 Oct 19 03:25:49.133422 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1612/3168] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:48 2022] GET /compute/v2.1/servers/e022fc4b-88e6-44c8-9729-7e8d25238bb3 => generated 1212 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:49.467206 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ba366835-4a0a-4983-a590-c20b1f5a365d tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:49.468487 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ba366835-4a0a-4983-a590-c20b1f5a365d tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] [instance: 4c823d1c-eebe-4aa6-972c-38209d6cc70e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:49.475178 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ba366835-4a0a-4983-a590-c20b1f5a365d tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:49.475874 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ba366835-4a0a-4983-a590-c20b1f5a365d tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:49.477091 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ba366835-4a0a-4983-a590-c20b1f5a365d tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:49.478047 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ba366835-4a0a-4983-a590-c20b1f5a365d tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:49.478511 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ba366835-4a0a-4983-a590-c20b1f5a365d tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:49.481591 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ba366835-4a0a-4983-a590-c20b1f5a365d tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:49.728746 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ba366835-4a0a-4983-a590-c20b1f5a365d tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5ed9dc7e0304f28afb381ef2ec3cefd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b2195b7d124b4eb2552f88dba26b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:49.736450 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ba366835-4a0a-4983-a590-c20b1f5a365d tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] 10.222.0.52 "GET /compute/v2.1/servers/4c823d1c-eebe-4aa6-972c-38209d6cc70e" status: 200 len: 1351 microversion: 2.1 time: 0.273826 Oct 19 03:25:49.737273 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1557/3169] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:49 2022] GET /compute/v2.1/servers/4c823d1c-eebe-4aa6-972c-38209d6cc70e => generated 1351 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:49.916778 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1c776c23-8973-44ae-b201-15d3a14706b9 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:49.917394 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1c776c23-8973-44ae-b201-15d3a14706b9 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] [instance: dac9628d-657b-4e72-8a7f-08156be8fad7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:49.924765 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1c776c23-8973-44ae-b201-15d3a14706b9 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:49.928729 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1c776c23-8973-44ae-b201-15d3a14706b9 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:49.928729 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1c776c23-8973-44ae-b201-15d3a14706b9 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:49.928729 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1c776c23-8973-44ae-b201-15d3a14706b9 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:49.928729 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1c776c23-8973-44ae-b201-15d3a14706b9 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:49.929223 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1c776c23-8973-44ae-b201-15d3a14706b9 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:50.096181 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-02378511-fd00-4bdb-b0b5-fe59abba3d2e tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:50.096730 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-02378511-fd00-4bdb-b0b5-fe59abba3d2e tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: f71d8b11-c58e-493d-a03c-90d042f22218] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:50.107041 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-02378511-fd00-4bdb-b0b5-fe59abba3d2e tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:50.111307 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-02378511-fd00-4bdb-b0b5-fe59abba3d2e tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:50.111766 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-02378511-fd00-4bdb-b0b5-fe59abba3d2e tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:50.112517 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-02378511-fd00-4bdb-b0b5-fe59abba3d2e tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:50.113055 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-02378511-fd00-4bdb-b0b5-fe59abba3d2e tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:50.113559 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-02378511-fd00-4bdb-b0b5-fe59abba3d2e tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:50.222577 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-1c776c23-8973-44ae-b201-15d3a14706b9 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7bf94a5de054f98a24a6a8f3d5fea9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f91748d2e94f85a70dcc787713fb6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:50.231645 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-1c776c23-8973-44ae-b201-15d3a14706b9 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7bf94a5de054f98a24a6a8f3d5fea9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f91748d2e94f85a70dcc787713fb6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:50.233408 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-1c776c23-8973-44ae-b201-15d3a14706b9 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7bf94a5de054f98a24a6a8f3d5fea9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f91748d2e94f85a70dcc787713fb6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:50.234682 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1c776c23-8973-44ae-b201-15d3a14706b9 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] 10.222.0.52 "GET /compute/v2.1/servers/dac9628d-657b-4e72-8a7f-08156be8fad7" status: 200 len: 1359 microversion: 2.21 time: 0.321951 Oct 19 03:25:50.235323 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1613/3170] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:25:49 2022] GET /compute/v2.1/servers/dac9628d-657b-4e72-8a7f-08156be8fad7 => generated 1359 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:25:50.241320 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-280a81d4-3163-491d-9164-c1b63bfda4d7 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:50.242205 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-280a81d4-3163-491d-9164-c1b63bfda4d7 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: e022fc4b-88e6-44c8-9729-7e8d25238bb3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:50.249276 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-280a81d4-3163-491d-9164-c1b63bfda4d7 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:50.249903 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-280a81d4-3163-491d-9164-c1b63bfda4d7 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:50.250442 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-280a81d4-3163-491d-9164-c1b63bfda4d7 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:50.251202 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-280a81d4-3163-491d-9164-c1b63bfda4d7 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:50.251722 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-280a81d4-3163-491d-9164-c1b63bfda4d7 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:50.252153 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-280a81d4-3163-491d-9164-c1b63bfda4d7 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:50.335053 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-280a81d4-3163-491d-9164-c1b63bfda4d7 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:50.344045 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-280a81d4-3163-491d-9164-c1b63bfda4d7 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/e022fc4b-88e6-44c8-9729-7e8d25238bb3" status: 200 len: 1260 microversion: 2.1 time: 0.107273 Oct 19 03:25:50.345068 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1614/3171] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:50 2022] GET /compute/v2.1/servers/e022fc4b-88e6-44c8-9729-7e8d25238bb3 => generated 1260 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:50.372325 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-02378511-fd00-4bdb-b0b5-fe59abba3d2e tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:50.381999 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-02378511-fd00-4bdb-b0b5-fe59abba3d2e tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/f71d8b11-c58e-493d-a03c-90d042f22218" status: 200 len: 1327 microversion: 2.1 time: 0.289770 Oct 19 03:25:50.382587 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1558/3172] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:50 2022] GET /compute/v2.1/servers/f71d8b11-c58e-493d-a03c-90d042f22218 => generated 1327 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:50.666656 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e7d8e42a-b162-4fe4-bcbe-e64c89b3aa9d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1537506588", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "networks": [{"uuid": "8936f55f-9ffa-46d8-8ece-d8a531cfe6c3"}], "security_groups": [{"name": "tempest-securitygroup--1544537580"}], "key_name": "tempest-keypair-167267698", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:25:50.672895 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-bf4b5b02-2611-4d6b-b40a-851b19144491 req-60730aff-7172-4b67-81ea-d10289d8e144 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f71d8b11-c58e-493d-a03c-90d042f22218", "tag": "01192655-dfdc-48c9-9121-e6d9fc9b8a2d"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:25:50.686665 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-bf4b5b02-2611-4d6b-b40a-851b19144491 req-60730aff-7172-4b67-81ea-d10289d8e144 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:50.687549 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-bf4b5b02-2611-4d6b-b40a-851b19144491 req-60730aff-7172-4b67-81ea-d10289d8e144 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:50.688248 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-bf4b5b02-2611-4d6b-b40a-851b19144491 req-60730aff-7172-4b67-81ea-d10289d8e144 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:50.738456 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-bf4b5b02-2611-4d6b-b40a-851b19144491 req-60730aff-7172-4b67-81ea-d10289d8e144 service nova] Creating event network-changed:01192655-dfdc-48c9-9121-e6d9fc9b8a2d for instance f71d8b11-c58e-493d-a03c-90d042f22218 on n-h2-861333-8 Oct 19 03:25:50.745835 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-bf4b5b02-2611-4d6b-b40a-851b19144491 req-60730aff-7172-4b67-81ea-d10289d8e144 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076573 Oct 19 03:25:50.747027 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1559/3173] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:25:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:25:50.760733 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2233224f-325b-457c-85ca-a69c4d0d52c1 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:50.761827 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2233224f-325b-457c-85ca-a69c4d0d52c1 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] [instance: 4c823d1c-eebe-4aa6-972c-38209d6cc70e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:50.768679 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2233224f-325b-457c-85ca-a69c4d0d52c1 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:50.769512 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2233224f-325b-457c-85ca-a69c4d0d52c1 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:50.770162 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2233224f-325b-457c-85ca-a69c4d0d52c1 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:50.771089 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2233224f-325b-457c-85ca-a69c4d0d52c1 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:50.771757 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2233224f-325b-457c-85ca-a69c4d0d52c1 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:50.772377 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2233224f-325b-457c-85ca-a69c4d0d52c1 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:51.020891 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.network.neutron [None req-e7d8e42a-b162-4fe4-bcbe-e64c89b3aa9d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] validate_networks() for [('8936f55f-9ffa-46d8-8ece-d8a531cfe6c3', None, None, None, None, None)] {{(pid=121135) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:25:51.225507 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-2233224f-325b-457c-85ca-a69c4d0d52c1 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5ed9dc7e0304f28afb381ef2ec3cefd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b2195b7d124b4eb2552f88dba26b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:51.234623 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2233224f-325b-457c-85ca-a69c4d0d52c1 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] 10.222.0.52 "GET /compute/v2.1/servers/4c823d1c-eebe-4aa6-972c-38209d6cc70e" status: 200 len: 1351 microversion: 2.1 time: 0.478127 Oct 19 03:25:51.235323 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1560/3174] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:50 2022] GET /compute/v2.1/servers/4c823d1c-eebe-4aa6-972c-38209d6cc70e => generated 1351 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:51.261832 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4bb3407d-59c5-4991-a39e-f11896d2d6b8 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:51.265807 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4bb3407d-59c5-4991-a39e-f11896d2d6b8 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] [instance: dac9628d-657b-4e72-8a7f-08156be8fad7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:51.265807 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:25:51.269797 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4bb3407d-59c5-4991-a39e-f11896d2d6b8 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:51.270437 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4bb3407d-59c5-4991-a39e-f11896d2d6b8 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:51.270893 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4bb3407d-59c5-4991-a39e-f11896d2d6b8 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:51.271681 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4bb3407d-59c5-4991-a39e-f11896d2d6b8 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:51.272146 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4bb3407d-59c5-4991-a39e-f11896d2d6b8 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:51.272583 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4bb3407d-59c5-4991-a39e-f11896d2d6b8 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:51.698923 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-4bb3407d-59c5-4991-a39e-f11896d2d6b8 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7bf94a5de054f98a24a6a8f3d5fea9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f91748d2e94f85a70dcc787713fb6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:51.709491 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-4bb3407d-59c5-4991-a39e-f11896d2d6b8 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7bf94a5de054f98a24a6a8f3d5fea9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f91748d2e94f85a70dcc787713fb6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:51.711479 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-4bb3407d-59c5-4991-a39e-f11896d2d6b8 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7bf94a5de054f98a24a6a8f3d5fea9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f91748d2e94f85a70dcc787713fb6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:51.712956 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4bb3407d-59c5-4991-a39e-f11896d2d6b8 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] 10.222.0.52 "GET /compute/v2.1/servers/dac9628d-657b-4e72-8a7f-08156be8fad7" status: 200 len: 1359 microversion: 2.21 time: 0.456371 Oct 19 03:25:51.729899 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1561/3175] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:25:51 2022] GET /compute/v2.1/servers/dac9628d-657b-4e72-8a7f-08156be8fad7 => generated 1359 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:25:51.742599 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-01e63357-ccf8-46f8-8ec6-ecf999959f92 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:51.742599 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-01e63357-ccf8-46f8-8ec6-ecf999959f92 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: e022fc4b-88e6-44c8-9729-7e8d25238bb3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:51.746847 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-01e63357-ccf8-46f8-8ec6-ecf999959f92 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:51.747537 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-01e63357-ccf8-46f8-8ec6-ecf999959f92 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:51.748168 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-01e63357-ccf8-46f8-8ec6-ecf999959f92 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:51.749071 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-01e63357-ccf8-46f8-8ec6-ecf999959f92 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:51.749730 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-01e63357-ccf8-46f8-8ec6-ecf999959f92 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:51.750477 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-01e63357-ccf8-46f8-8ec6-ecf999959f92 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:51.775369 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=100 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:25:51.914400 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-01e63357-ccf8-46f8-8ec6-ecf999959f92 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:51.938397 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-01e63357-ccf8-46f8-8ec6-ecf999959f92 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/e022fc4b-88e6-44c8-9729-7e8d25238bb3" status: 200 len: 1266 microversion: 2.1 time: 0.206945 Oct 19 03:25:51.939080 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1562/3176] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:51 2022] GET /compute/v2.1/servers/e022fc4b-88e6-44c8-9729-7e8d25238bb3 => generated 1266 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:51.944334 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e4cb653a-90a2-4063-92ea-86eb502939fb tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:51.945095 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e4cb653a-90a2-4063-92ea-86eb502939fb tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: f71d8b11-c58e-493d-a03c-90d042f22218] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:51.952049 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e4cb653a-90a2-4063-92ea-86eb502939fb tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:51.952809 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e4cb653a-90a2-4063-92ea-86eb502939fb tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:51.953344 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e4cb653a-90a2-4063-92ea-86eb502939fb tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:51.954336 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e4cb653a-90a2-4063-92ea-86eb502939fb tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:51.955015 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e4cb653a-90a2-4063-92ea-86eb502939fb tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:51.955433 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e4cb653a-90a2-4063-92ea-86eb502939fb tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:52.276389 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-e7d8e42a-b162-4fe4-bcbe-e64c89b3aa9d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Flavor limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:25:52.276884 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-e7d8e42a-b162-4fe4-bcbe-e64c89b3aa9d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Image limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:25:52.277312 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-e7d8e42a-b162-4fe4-bcbe-e64c89b3aa9d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Flavor pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:25:52.277777 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-e7d8e42a-b162-4fe4-bcbe-e64c89b3aa9d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Image pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:25:52.278487 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-e7d8e42a-b162-4fe4-bcbe-e64c89b3aa9d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:25:52.292449 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e7d8e42a-b162-4fe4-bcbe-e64c89b3aa9d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:52.293322 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e7d8e42a-b162-4fe4-bcbe-e64c89b3aa9d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:52.293823 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e7d8e42a-b162-4fe4-bcbe-e64c89b3aa9d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:52.294704 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e7d8e42a-b162-4fe4-bcbe-e64c89b3aa9d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:52.295501 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e7d8e42a-b162-4fe4-bcbe-e64c89b3aa9d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:52.296175 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e7d8e42a-b162-4fe4-bcbe-e64c89b3aa9d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:52.298864 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e4cb653a-90a2-4063-92ea-86eb502939fb tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:52.307343 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=100 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:25:52.314700 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e4cb653a-90a2-4063-92ea-86eb502939fb tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/f71d8b11-c58e-493d-a03c-90d042f22218" status: 200 len: 1327 microversion: 2.1 time: 0.374145 Oct 19 03:25:52.315723 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1563/3177] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:51 2022] GET /compute/v2.1/servers/f71d8b11-c58e-493d-a03c-90d042f22218 => generated 1327 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:52.321109 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c01f3d25-4897-4322-a25c-ee51679bff28 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:52.322300 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c01f3d25-4897-4322-a25c-ee51679bff28 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] [instance: 4c823d1c-eebe-4aa6-972c-38209d6cc70e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:52.334710 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-e7d8e42a-b162-4fe4-bcbe-e64c89b3aa9d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Getting quotas for project 8019441bff8642cebf21fd1c4e890196. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:25:52.341004 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c01f3d25-4897-4322-a25c-ee51679bff28 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:52.341806 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c01f3d25-4897-4322-a25c-ee51679bff28 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:52.343790 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-e7d8e42a-b162-4fe4-bcbe-e64c89b3aa9d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Getting quotas for user 2b5b2cb1272541dfbc2659cf4adf9026 and project 8019441bff8642cebf21fd1c4e890196. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:25:52.343927 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c01f3d25-4897-4322-a25c-ee51679bff28 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:52.344809 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c01f3d25-4897-4322-a25c-ee51679bff28 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:52.345912 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c01f3d25-4897-4322-a25c-ee51679bff28 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:52.348105 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c01f3d25-4897-4322-a25c-ee51679bff28 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:52.360078 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e7d8e42a-b162-4fe4-bcbe-e64c89b3aa9d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Going to run 1 instances... {{(pid=121135) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:25:52.362642 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e7d8e42a-b162-4fe4-bcbe-e64c89b3aa9d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 5cc2003b-73ef-4a54-a22d-9cef47c6ed3f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121135) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:25:52.546623 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e7d8e42a-b162-4fe4-bcbe-e64c89b3aa9d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.881990 Oct 19 03:25:52.548429 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1615/3178] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:25:50 2022] POST /compute/v2.1/servers => generated 406 bytes in 1887 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 03:25:52.555633 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c01f3d25-4897-4322-a25c-ee51679bff28 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5ed9dc7e0304f28afb381ef2ec3cefd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b2195b7d124b4eb2552f88dba26b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:52.560831 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a57de6a5-861f-4872-b832-38aadbbcfa78 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:52.561490 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a57de6a5-861f-4872-b832-38aadbbcfa78 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 5cc2003b-73ef-4a54-a22d-9cef47c6ed3f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:52.570622 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c01f3d25-4897-4322-a25c-ee51679bff28 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] 10.222.0.52 "GET /compute/v2.1/servers/4c823d1c-eebe-4aa6-972c-38209d6cc70e" status: 200 len: 1540 microversion: 2.1 time: 0.253569 Oct 19 03:25:52.574278 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1564/3179] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:52 2022] GET /compute/v2.1/servers/4c823d1c-eebe-4aa6-972c-38209d6cc70e => generated 1540 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:52.599053 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2a7aea38-c04c-4f4e-9fc9-95e8056a8141 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:52.599631 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2a7aea38-c04c-4f4e-9fc9-95e8056a8141 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] [instance: 4c823d1c-eebe-4aa6-972c-38209d6cc70e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:52.605994 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2a7aea38-c04c-4f4e-9fc9-95e8056a8141 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:52.606537 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2a7aea38-c04c-4f4e-9fc9-95e8056a8141 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:52.606989 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2a7aea38-c04c-4f4e-9fc9-95e8056a8141 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:52.607836 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2a7aea38-c04c-4f4e-9fc9-95e8056a8141 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:52.608288 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2a7aea38-c04c-4f4e-9fc9-95e8056a8141 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:52.608771 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2a7aea38-c04c-4f4e-9fc9-95e8056a8141 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:52.764418 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2a7aea38-c04c-4f4e-9fc9-95e8056a8141 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] 10.222.0.52 "GET /compute/v2.1/servers/4c823d1c-eebe-4aa6-972c-38209d6cc70e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.164547 Oct 19 03:25:52.768714 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1565/3180] 10.222.0.52 () {58 vars in 1275 bytes} [Wed Oct 19 03:25:52 2022] GET /compute/v2.1/servers/4c823d1c-eebe-4aa6-972c-38209d6cc70e/os-interface => generated 284 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:25:52.774591 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3556f2aa-a66c-41e5-99b4-d0c371b82735 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:52.775331 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3556f2aa-a66c-41e5-99b4-d0c371b82735 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] [instance: dac9628d-657b-4e72-8a7f-08156be8fad7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:52.787731 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3556f2aa-a66c-41e5-99b4-d0c371b82735 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:52.787731 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3556f2aa-a66c-41e5-99b4-d0c371b82735 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:52.787731 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3556f2aa-a66c-41e5-99b4-d0c371b82735 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:52.788341 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a57de6a5-861f-4872-b832-38aadbbcfa78 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:52.789033 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3556f2aa-a66c-41e5-99b4-d0c371b82735 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:52.790865 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3556f2aa-a66c-41e5-99b4-d0c371b82735 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:52.792861 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3556f2aa-a66c-41e5-99b4-d0c371b82735 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:52.799194 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a57de6a5-861f-4872-b832-38aadbbcfa78 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f" status: 200 len: 1234 microversion: 2.1 time: 0.243836 Oct 19 03:25:52.815443 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1616/3181] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:52 2022] GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f => generated 1234 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:25:52.831862 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-0890657a-7b44-4c18-9970-39c3f2812721 req-ba4745a8-8948-4cdd-b5fe-bea82e455f73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dac9628d-657b-4e72-8a7f-08156be8fad7", "name": "network-vif-plugged", "status": "completed", "tag": "af70bc82-b873-4d91-83de-baf5a4ae6ccd"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:25:52.859288 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-0890657a-7b44-4c18-9970-39c3f2812721 req-ba4745a8-8948-4cdd-b5fe-bea82e455f73 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:52.860288 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-0890657a-7b44-4c18-9970-39c3f2812721 req-ba4745a8-8948-4cdd-b5fe-bea82e455f73 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:52.860987 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-0890657a-7b44-4c18-9970-39c3f2812721 req-ba4745a8-8948-4cdd-b5fe-bea82e455f73 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:52.882683 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-0890657a-7b44-4c18-9970-39c3f2812721 req-ba4745a8-8948-4cdd-b5fe-bea82e455f73 service nova] Creating event network-vif-plugged:af70bc82-b873-4d91-83de-baf5a4ae6ccd for instance dac9628d-657b-4e72-8a7f-08156be8fad7 on n-h1-861333-8 Oct 19 03:25:52.888659 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-0890657a-7b44-4c18-9970-39c3f2812721 req-ba4745a8-8948-4cdd-b5fe-bea82e455f73 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071897 Oct 19 03:25:52.889765 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1617/3182] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:25:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:25:52.969450 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-8a8c395e-62a5-476f-ba8c-d1a4accc25b7 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:52.970245 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-8a8c395e-62a5-476f-ba8c-d1a4accc25b7 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: e022fc4b-88e6-44c8-9729-7e8d25238bb3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:52.979104 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8a8c395e-62a5-476f-ba8c-d1a4accc25b7 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:52.981019 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8a8c395e-62a5-476f-ba8c-d1a4accc25b7 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:52.981873 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8a8c395e-62a5-476f-ba8c-d1a4accc25b7 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:52.984122 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8a8c395e-62a5-476f-ba8c-d1a4accc25b7 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:52.985192 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8a8c395e-62a5-476f-ba8c-d1a4accc25b7 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:52.986514 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8a8c395e-62a5-476f-ba8c-d1a4accc25b7 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:53.016420 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-3556f2aa-a66c-41e5-99b4-d0c371b82735 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7bf94a5de054f98a24a6a8f3d5fea9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f91748d2e94f85a70dcc787713fb6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:53.031298 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-3556f2aa-a66c-41e5-99b4-d0c371b82735 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7bf94a5de054f98a24a6a8f3d5fea9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f91748d2e94f85a70dcc787713fb6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:53.034692 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-3556f2aa-a66c-41e5-99b4-d0c371b82735 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7bf94a5de054f98a24a6a8f3d5fea9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f91748d2e94f85a70dcc787713fb6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:53.044806 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3556f2aa-a66c-41e5-99b4-d0c371b82735 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] 10.222.0.52 "GET /compute/v2.1/servers/dac9628d-657b-4e72-8a7f-08156be8fad7" status: 200 len: 1359 microversion: 2.21 time: 0.274832 Oct 19 03:25:53.045441 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1566/3183] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:25:52 2022] GET /compute/v2.1/servers/dac9628d-657b-4e72-8a7f-08156be8fad7 => generated 1359 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:25:53.167410 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-8a8c395e-62a5-476f-ba8c-d1a4accc25b7 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:53.184356 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-8a8c395e-62a5-476f-ba8c-d1a4accc25b7 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/e022fc4b-88e6-44c8-9729-7e8d25238bb3" status: 200 len: 1308 microversion: 2.1 time: 0.220546 Oct 19 03:25:53.185278 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1618/3184] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:52 2022] GET /compute/v2.1/servers/e022fc4b-88e6-44c8-9729-7e8d25238bb3 => generated 1308 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:53.340769 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-31fd18a6-173a-4800-8f7c-1c79ab4b3ad7 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:53.345549 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-31fd18a6-173a-4800-8f7c-1c79ab4b3ad7 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: f71d8b11-c58e-493d-a03c-90d042f22218] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:53.347315 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-31fd18a6-173a-4800-8f7c-1c79ab4b3ad7 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:53.347800 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-31fd18a6-173a-4800-8f7c-1c79ab4b3ad7 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:53.348236 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-31fd18a6-173a-4800-8f7c-1c79ab4b3ad7 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:53.348944 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-31fd18a6-173a-4800-8f7c-1c79ab4b3ad7 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:53.349410 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-31fd18a6-173a-4800-8f7c-1c79ab4b3ad7 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:53.349839 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-31fd18a6-173a-4800-8f7c-1c79ab4b3ad7 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:53.497929 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-31fd18a6-173a-4800-8f7c-1c79ab4b3ad7 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:53.508471 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-31fd18a6-173a-4800-8f7c-1c79ab4b3ad7 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/f71d8b11-c58e-493d-a03c-90d042f22218" status: 200 len: 1327 microversion: 2.1 time: 0.169930 Oct 19 03:25:53.518738 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1567/3185] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:53 2022] GET /compute/v2.1/servers/f71d8b11-c58e-493d-a03c-90d042f22218 => generated 1327 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:53.829121 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-16320433-4bc3-48d7-83dd-d9c5abb4f2d8 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:53.830426 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-16320433-4bc3-48d7-83dd-d9c5abb4f2d8 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 5cc2003b-73ef-4a54-a22d-9cef47c6ed3f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:53.838081 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-16320433-4bc3-48d7-83dd-d9c5abb4f2d8 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:53.839786 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-16320433-4bc3-48d7-83dd-d9c5abb4f2d8 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:53.839786 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-16320433-4bc3-48d7-83dd-d9c5abb4f2d8 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:53.840645 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-16320433-4bc3-48d7-83dd-d9c5abb4f2d8 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:53.841273 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-16320433-4bc3-48d7-83dd-d9c5abb4f2d8 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:53.841899 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-16320433-4bc3-48d7-83dd-d9c5abb4f2d8 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:53.958391 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-16320433-4bc3-48d7-83dd-d9c5abb4f2d8 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:53.968439 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-16320433-4bc3-48d7-83dd-d9c5abb4f2d8 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f" status: 200 len: 1238 microversion: 2.1 time: 0.144010 Oct 19 03:25:53.981891 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1619/3186] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:53 2022] GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f => generated 1238 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:54.075600 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-08ff6333-6d70-4665-936e-e6913aaa26e9 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:54.076281 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-08ff6333-6d70-4665-936e-e6913aaa26e9 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] [instance: dac9628d-657b-4e72-8a7f-08156be8fad7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:54.092870 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-08ff6333-6d70-4665-936e-e6913aaa26e9 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:54.093674 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-08ff6333-6d70-4665-936e-e6913aaa26e9 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:54.099327 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-08ff6333-6d70-4665-936e-e6913aaa26e9 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:54.099327 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-08ff6333-6d70-4665-936e-e6913aaa26e9 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:54.099327 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-08ff6333-6d70-4665-936e-e6913aaa26e9 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:54.099327 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-08ff6333-6d70-4665-936e-e6913aaa26e9 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:54.208693 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-fbc0765e-c1d5-4063-838d-7e3d19a6dd0f tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:54.209614 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-fbc0765e-c1d5-4063-838d-7e3d19a6dd0f tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: e022fc4b-88e6-44c8-9729-7e8d25238bb3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:54.222564 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fbc0765e-c1d5-4063-838d-7e3d19a6dd0f tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:54.223424 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fbc0765e-c1d5-4063-838d-7e3d19a6dd0f tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:54.226603 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fbc0765e-c1d5-4063-838d-7e3d19a6dd0f tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:54.228801 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fbc0765e-c1d5-4063-838d-7e3d19a6dd0f tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:54.231049 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fbc0765e-c1d5-4063-838d-7e3d19a6dd0f tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:54.231700 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fbc0765e-c1d5-4063-838d-7e3d19a6dd0f tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:54.291011 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-08ff6333-6d70-4665-936e-e6913aaa26e9 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7bf94a5de054f98a24a6a8f3d5fea9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f91748d2e94f85a70dcc787713fb6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:54.300029 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-08ff6333-6d70-4665-936e-e6913aaa26e9 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7bf94a5de054f98a24a6a8f3d5fea9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f91748d2e94f85a70dcc787713fb6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:54.301877 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-08ff6333-6d70-4665-936e-e6913aaa26e9 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7bf94a5de054f98a24a6a8f3d5fea9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f91748d2e94f85a70dcc787713fb6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:54.303021 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-08ff6333-6d70-4665-936e-e6913aaa26e9 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] 10.222.0.52 "GET /compute/v2.1/servers/dac9628d-657b-4e72-8a7f-08156be8fad7" status: 200 len: 1359 microversion: 2.21 time: 0.232992 Oct 19 03:25:54.320559 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1568/3187] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:25:54 2022] GET /compute/v2.1/servers/dac9628d-657b-4e72-8a7f-08156be8fad7 => generated 1359 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:25:54.477461 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-28a8c004-2fb2-4a8c-9a94-3d364568e88f req-44376b48-08f7-4d9f-8f2d-d4faa6ac0ced service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c823d1c-eebe-4aa6-972c-38209d6cc70e", "tag": "2450ebc0-ad1d-4651-825d-17d4dd7a5d3d"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:25:54.489146 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-28a8c004-2fb2-4a8c-9a94-3d364568e88f req-44376b48-08f7-4d9f-8f2d-d4faa6ac0ced service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:54.492940 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-28a8c004-2fb2-4a8c-9a94-3d364568e88f req-44376b48-08f7-4d9f-8f2d-d4faa6ac0ced service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:54.492940 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-28a8c004-2fb2-4a8c-9a94-3d364568e88f req-44376b48-08f7-4d9f-8f2d-d4faa6ac0ced service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:54.519371 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-fbc0765e-c1d5-4063-838d-7e3d19a6dd0f tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:54.529416 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-fbc0765e-c1d5-4063-838d-7e3d19a6dd0f tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/e022fc4b-88e6-44c8-9729-7e8d25238bb3" status: 200 len: 1308 microversion: 2.1 time: 0.324861 Oct 19 03:25:54.538356 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-28a8c004-2fb2-4a8c-9a94-3d364568e88f req-44376b48-08f7-4d9f-8f2d-d4faa6ac0ced service nova] Creating event network-changed:2450ebc0-ad1d-4651-825d-17d4dd7a5d3d for instance 4c823d1c-eebe-4aa6-972c-38209d6cc70e on n-h1-861333-8 Oct 19 03:25:54.542044 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1620/3188] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:54 2022] GET /compute/v2.1/servers/e022fc4b-88e6-44c8-9729-7e8d25238bb3 => generated 1308 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:25:54.551466 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b140c6be-8455-4e73-901f-bfdce5994cc4 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:54.551959 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-28a8c004-2fb2-4a8c-9a94-3d364568e88f req-44376b48-08f7-4d9f-8f2d-d4faa6ac0ced service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081686 Oct 19 03:25:54.552473 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b140c6be-8455-4e73-901f-bfdce5994cc4 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: f71d8b11-c58e-493d-a03c-90d042f22218] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:54.553181 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1569/3189] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:25:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:25:54.559363 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b140c6be-8455-4e73-901f-bfdce5994cc4 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:54.559865 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b140c6be-8455-4e73-901f-bfdce5994cc4 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:54.560306 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b140c6be-8455-4e73-901f-bfdce5994cc4 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:54.561484 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b140c6be-8455-4e73-901f-bfdce5994cc4 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:54.561484 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b140c6be-8455-4e73-901f-bfdce5994cc4 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:54.562255 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b140c6be-8455-4e73-901f-bfdce5994cc4 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:54.756382 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b140c6be-8455-4e73-901f-bfdce5994cc4 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:54.765785 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b140c6be-8455-4e73-901f-bfdce5994cc4 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/f71d8b11-c58e-493d-a03c-90d042f22218" status: 200 len: 1327 microversion: 2.1 time: 0.222287 Oct 19 03:25:54.766596 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1621/3190] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:54 2022] GET /compute/v2.1/servers/f71d8b11-c58e-493d-a03c-90d042f22218 => generated 1327 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:54.936954 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-2e79d99c-e4d8-43ea-927e-6ded9424e758 req-4217b91f-3e5b-4da7-8b54-3b39a390c080 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5093d9e-cd31-4074-b339-828de5892bd1", "name": "network-vif-unplugged", "status": "completed", "tag": "8014cea8-dac9-42ee-b483-a953805bdcd0"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:25:54.950710 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-2e79d99c-e4d8-43ea-927e-6ded9424e758 req-4217b91f-3e5b-4da7-8b54-3b39a390c080 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:54.951390 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-2e79d99c-e4d8-43ea-927e-6ded9424e758 req-4217b91f-3e5b-4da7-8b54-3b39a390c080 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:54.951883 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-2e79d99c-e4d8-43ea-927e-6ded9424e758 req-4217b91f-3e5b-4da7-8b54-3b39a390c080 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:54.966598 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-2e79d99c-e4d8-43ea-927e-6ded9424e758 req-4217b91f-3e5b-4da7-8b54-3b39a390c080 service nova] Creating event network-vif-unplugged:8014cea8-dac9-42ee-b483-a953805bdcd0 for instance e5093d9e-cd31-4074-b339-828de5892bd1 on n-h1-861333-8 Oct 19 03:25:54.985081 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-2e79d99c-e4d8-43ea-927e-6ded9424e758 req-4217b91f-3e5b-4da7-8b54-3b39a390c080 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044061 Oct 19 03:25:54.986256 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1570/3191] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:25:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:25:54.996360 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-eab47b95-bc3b-4231-8214-1d92e3fbe2dd tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:54.998902 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-eab47b95-bc3b-4231-8214-1d92e3fbe2dd tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 5cc2003b-73ef-4a54-a22d-9cef47c6ed3f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:55.020784 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-eab47b95-bc3b-4231-8214-1d92e3fbe2dd tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:55.021663 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-eab47b95-bc3b-4231-8214-1d92e3fbe2dd tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:55.022392 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-eab47b95-bc3b-4231-8214-1d92e3fbe2dd tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:55.023337 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-eab47b95-bc3b-4231-8214-1d92e3fbe2dd tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:55.023993 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-eab47b95-bc3b-4231-8214-1d92e3fbe2dd tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:55.025185 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-eab47b95-bc3b-4231-8214-1d92e3fbe2dd tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:55.135720 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-eab47b95-bc3b-4231-8214-1d92e3fbe2dd tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:55.152673 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-eab47b95-bc3b-4231-8214-1d92e3fbe2dd tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f" status: 200 len: 1238 microversion: 2.1 time: 0.157268 Oct 19 03:25:55.152673 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1622/3192] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:54 2022] GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f => generated 1238 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:25:55.335547 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-60decdde-b5dd-4d43-910e-57b4779b76fc tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:55.337482 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-60decdde-b5dd-4d43-910e-57b4779b76fc tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] [instance: dac9628d-657b-4e72-8a7f-08156be8fad7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:55.354008 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-60decdde-b5dd-4d43-910e-57b4779b76fc tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:55.355492 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-60decdde-b5dd-4d43-910e-57b4779b76fc tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:55.356098 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-60decdde-b5dd-4d43-910e-57b4779b76fc tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:55.356987 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-60decdde-b5dd-4d43-910e-57b4779b76fc tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:55.357640 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-60decdde-b5dd-4d43-910e-57b4779b76fc tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:55.358295 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-60decdde-b5dd-4d43-910e-57b4779b76fc tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:55.561012 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-deed18bd-a540-4019-b4db-109ad99fa96d tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:55.561607 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-deed18bd-a540-4019-b4db-109ad99fa96d tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: e022fc4b-88e6-44c8-9729-7e8d25238bb3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:55.567921 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-deed18bd-a540-4019-b4db-109ad99fa96d tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:55.568422 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-deed18bd-a540-4019-b4db-109ad99fa96d tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:55.568868 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-deed18bd-a540-4019-b4db-109ad99fa96d tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:55.569634 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-deed18bd-a540-4019-b4db-109ad99fa96d tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:55.578109 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-deed18bd-a540-4019-b4db-109ad99fa96d tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:55.578770 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-deed18bd-a540-4019-b4db-109ad99fa96d tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:55.651960 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-60decdde-b5dd-4d43-910e-57b4779b76fc tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7bf94a5de054f98a24a6a8f3d5fea9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f91748d2e94f85a70dcc787713fb6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:55.665813 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-60decdde-b5dd-4d43-910e-57b4779b76fc tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7bf94a5de054f98a24a6a8f3d5fea9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f91748d2e94f85a70dcc787713fb6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:55.673220 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-60decdde-b5dd-4d43-910e-57b4779b76fc tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7bf94a5de054f98a24a6a8f3d5fea9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f91748d2e94f85a70dcc787713fb6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:55.676436 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-60decdde-b5dd-4d43-910e-57b4779b76fc tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] 10.222.0.52 "GET /compute/v2.1/servers/dac9628d-657b-4e72-8a7f-08156be8fad7" status: 200 len: 1552 microversion: 2.21 time: 0.348039 Oct 19 03:25:55.692666 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1571/3193] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:25:55 2022] GET /compute/v2.1/servers/dac9628d-657b-4e72-8a7f-08156be8fad7 => generated 1552 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:25:55.718167 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-714d61b2-36ae-4f74-b429-97d76b0b9c65 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:55.718849 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-714d61b2-36ae-4f74-b429-97d76b0b9c65 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] [instance: dac9628d-657b-4e72-8a7f-08156be8fad7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:55.731428 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-714d61b2-36ae-4f74-b429-97d76b0b9c65 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:55.731428 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-714d61b2-36ae-4f74-b429-97d76b0b9c65 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:55.731428 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-714d61b2-36ae-4f74-b429-97d76b0b9c65 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:55.731428 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-714d61b2-36ae-4f74-b429-97d76b0b9c65 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:55.732063 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-714d61b2-36ae-4f74-b429-97d76b0b9c65 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:55.732063 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-714d61b2-36ae-4f74-b429-97d76b0b9c65 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:55.772718 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-714d61b2-36ae-4f74-b429-97d76b0b9c65 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] [instance: dac9628d-657b-4e72-8a7f-08156be8fad7] Going to try to terminate instance {{(pid=121134) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:25:55.845463 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-deed18bd-a540-4019-b4db-109ad99fa96d tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:55.855636 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-deed18bd-a540-4019-b4db-109ad99fa96d tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/e022fc4b-88e6-44c8-9729-7e8d25238bb3" status: 200 len: 1308 microversion: 2.1 time: 0.298564 Oct 19 03:25:55.859223 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1623/3194] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:55 2022] GET /compute/v2.1/servers/e022fc4b-88e6-44c8-9729-7e8d25238bb3 => generated 1308 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:55.871043 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7be55c60-9968-4740-881f-ca5579a520f9 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:55.876503 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7be55c60-9968-4740-881f-ca5579a520f9 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: f71d8b11-c58e-493d-a03c-90d042f22218] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:55.887626 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7be55c60-9968-4740-881f-ca5579a520f9 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:55.889937 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7be55c60-9968-4740-881f-ca5579a520f9 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:55.894466 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7be55c60-9968-4740-881f-ca5579a520f9 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:55.895429 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7be55c60-9968-4740-881f-ca5579a520f9 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:55.896071 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7be55c60-9968-4740-881f-ca5579a520f9 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:55.896811 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7be55c60-9968-4740-881f-ca5579a520f9 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:56.115732 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7be55c60-9968-4740-881f-ca5579a520f9 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:56.133677 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7be55c60-9968-4740-881f-ca5579a520f9 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/f71d8b11-c58e-493d-a03c-90d042f22218" status: 200 len: 1327 microversion: 2.1 time: 0.273227 Oct 19 03:25:56.137816 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1624/3195] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:55 2022] GET /compute/v2.1/servers/f71d8b11-c58e-493d-a03c-90d042f22218 => generated 1327 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:56.174968 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b82e6649-121c-4e58-8bbe-428350dc0b78 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:56.176484 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b82e6649-121c-4e58-8bbe-428350dc0b78 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 5cc2003b-73ef-4a54-a22d-9cef47c6ed3f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:56.187110 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b82e6649-121c-4e58-8bbe-428350dc0b78 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:56.188052 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b82e6649-121c-4e58-8bbe-428350dc0b78 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:56.188823 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b82e6649-121c-4e58-8bbe-428350dc0b78 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:56.189847 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b82e6649-121c-4e58-8bbe-428350dc0b78 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:56.190554 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b82e6649-121c-4e58-8bbe-428350dc0b78 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:56.191265 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b82e6649-121c-4e58-8bbe-428350dc0b78 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:56.278573 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b82e6649-121c-4e58-8bbe-428350dc0b78 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:56.288730 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b82e6649-121c-4e58-8bbe-428350dc0b78 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f" status: 200 len: 1238 microversion: 2.1 time: 0.117027 Oct 19 03:25:56.289456 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1625/3196] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:56 2022] GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f => generated 1238 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:25:56.683514 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-714d61b2-36ae-4f74-b429-97d76b0b9c65 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] 10.222.0.52 "DELETE /compute/v2.1/servers/dac9628d-657b-4e72-8a7f-08156be8fad7" status: 204 len: 0 microversion: 2.21 time: 0.969604 Oct 19 03:25:56.692275 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1572/3197] 10.222.0.52 () {60 vars in 1280 bytes} [Wed Oct 19 03:25:55 2022] DELETE /compute/v2.1/servers/dac9628d-657b-4e72-8a7f-08156be8fad7 => generated 0 bytes in 974 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 19 03:25:56.695871 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-42bee1dd-06fc-4078-b12e-d7cd6a3781b3 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:56.698631 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-42bee1dd-06fc-4078-b12e-d7cd6a3781b3 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] [instance: dac9628d-657b-4e72-8a7f-08156be8fad7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:56.715181 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-42bee1dd-06fc-4078-b12e-d7cd6a3781b3 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:56.715678 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-42bee1dd-06fc-4078-b12e-d7cd6a3781b3 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:56.716149 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-42bee1dd-06fc-4078-b12e-d7cd6a3781b3 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:56.724034 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-42bee1dd-06fc-4078-b12e-d7cd6a3781b3 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:56.724525 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-42bee1dd-06fc-4078-b12e-d7cd6a3781b3 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:56.724969 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-42bee1dd-06fc-4078-b12e-d7cd6a3781b3 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:56.884911 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-20ab039a-dabb-4395-84c5-53558c043b0b tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:56.886009 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-20ab039a-dabb-4395-84c5-53558c043b0b tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: e022fc4b-88e6-44c8-9729-7e8d25238bb3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:56.896928 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-20ab039a-dabb-4395-84c5-53558c043b0b tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:56.897864 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-20ab039a-dabb-4395-84c5-53558c043b0b tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:56.898516 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-20ab039a-dabb-4395-84c5-53558c043b0b tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:56.900104 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-20ab039a-dabb-4395-84c5-53558c043b0b tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:56.900758 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-20ab039a-dabb-4395-84c5-53558c043b0b tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:56.901414 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-20ab039a-dabb-4395-84c5-53558c043b0b tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:57.220438 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-42bee1dd-06fc-4078-b12e-d7cd6a3781b3 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7bf94a5de054f98a24a6a8f3d5fea9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f91748d2e94f85a70dcc787713fb6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:57.232388 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-42bee1dd-06fc-4078-b12e-d7cd6a3781b3 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7bf94a5de054f98a24a6a8f3d5fea9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f91748d2e94f85a70dcc787713fb6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:57.239700 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-42bee1dd-06fc-4078-b12e-d7cd6a3781b3 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7bf94a5de054f98a24a6a8f3d5fea9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f91748d2e94f85a70dcc787713fb6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:57.241328 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-42bee1dd-06fc-4078-b12e-d7cd6a3781b3 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] 10.222.0.52 "GET /compute/v2.1/servers/dac9628d-657b-4e72-8a7f-08156be8fad7" status: 200 len: 1558 microversion: 2.21 time: 0.550073 Oct 19 03:25:57.244861 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1626/3198] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:25:56 2022] GET /compute/v2.1/servers/dac9628d-657b-4e72-8a7f-08156be8fad7 => generated 1558 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:25:57.256469 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c5ffb068-8530-477d-8132-8b4775cba32a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:57.257216 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c5ffb068-8530-477d-8132-8b4775cba32a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: f71d8b11-c58e-493d-a03c-90d042f22218] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:57.269702 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c5ffb068-8530-477d-8132-8b4775cba32a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:57.274984 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c5ffb068-8530-477d-8132-8b4775cba32a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:57.275714 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c5ffb068-8530-477d-8132-8b4775cba32a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:57.276856 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c5ffb068-8530-477d-8132-8b4775cba32a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:57.279094 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c5ffb068-8530-477d-8132-8b4775cba32a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:57.279780 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c5ffb068-8530-477d-8132-8b4775cba32a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:57.606649 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=8 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:25:57.648738 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-20ab039a-dabb-4395-84c5-53558c043b0b tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:57.657609 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-20ab039a-dabb-4395-84c5-53558c043b0b tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/e022fc4b-88e6-44c8-9729-7e8d25238bb3" status: 200 len: 1308 microversion: 2.1 time: 0.778359 Oct 19 03:25:57.659593 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1573/3199] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:56 2022] GET /compute/v2.1/servers/e022fc4b-88e6-44c8-9729-7e8d25238bb3 => generated 1308 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:25:57.668919 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f4242ac0-f794-4d86-881a-82dc9cd5409e tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:57.669909 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f4242ac0-f794-4d86-881a-82dc9cd5409e tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 5cc2003b-73ef-4a54-a22d-9cef47c6ed3f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:57.676824 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f4242ac0-f794-4d86-881a-82dc9cd5409e tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:57.677451 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f4242ac0-f794-4d86-881a-82dc9cd5409e tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:57.677987 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f4242ac0-f794-4d86-881a-82dc9cd5409e tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:57.678831 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f4242ac0-f794-4d86-881a-82dc9cd5409e tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:57.679500 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f4242ac0-f794-4d86-881a-82dc9cd5409e tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:57.680191 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f4242ac0-f794-4d86-881a-82dc9cd5409e tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:57.791684 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-f4242ac0-f794-4d86-881a-82dc9cd5409e tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:57.812798 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f4242ac0-f794-4d86-881a-82dc9cd5409e tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f" status: 200 len: 1286 microversion: 2.1 time: 0.151488 Oct 19 03:25:57.821927 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1574/3200] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:57 2022] GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f => generated 1286 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:57.861177 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c5ffb068-8530-477d-8132-8b4775cba32a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:57.869843 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c5ffb068-8530-477d-8132-8b4775cba32a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/f71d8b11-c58e-493d-a03c-90d042f22218" status: 200 len: 1327 microversion: 2.1 time: 0.623560 Oct 19 03:25:57.886029 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1627/3201] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:57 2022] GET /compute/v2.1/servers/f71d8b11-c58e-493d-a03c-90d042f22218 => generated 1327 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:58.274703 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-283d71ce-28be-4bd1-89aa-85a42390aa32 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:58.277255 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-283d71ce-28be-4bd1-89aa-85a42390aa32 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] [instance: dac9628d-657b-4e72-8a7f-08156be8fad7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:58.285976 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-283d71ce-28be-4bd1-89aa-85a42390aa32 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:58.286552 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-283d71ce-28be-4bd1-89aa-85a42390aa32 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:58.287005 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-283d71ce-28be-4bd1-89aa-85a42390aa32 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:58.287735 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-283d71ce-28be-4bd1-89aa-85a42390aa32 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:58.288191 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-283d71ce-28be-4bd1-89aa-85a42390aa32 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:58.293720 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-283d71ce-28be-4bd1-89aa-85a42390aa32 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:58.407045 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-124000a3-d863-4f6e-9e6e-9fcb19989566 req-bc950262-c4dc-42a2-80f0-9523941ed9fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e022fc4b-88e6-44c8-9729-7e8d25238bb3", "tag": "97a600ca-4482-476f-b559-c5e02bc3e014"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:25:58.420253 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-124000a3-d863-4f6e-9e6e-9fcb19989566 req-bc950262-c4dc-42a2-80f0-9523941ed9fc service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:58.421076 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-124000a3-d863-4f6e-9e6e-9fcb19989566 req-bc950262-c4dc-42a2-80f0-9523941ed9fc service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:58.421727 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-124000a3-d863-4f6e-9e6e-9fcb19989566 req-bc950262-c4dc-42a2-80f0-9523941ed9fc service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:58.435893 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-124000a3-d863-4f6e-9e6e-9fcb19989566 req-bc950262-c4dc-42a2-80f0-9523941ed9fc service nova] Creating event network-changed:97a600ca-4482-476f-b559-c5e02bc3e014 for instance e022fc4b-88e6-44c8-9729-7e8d25238bb3 on n-h2-861333-8 Oct 19 03:25:58.441951 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-124000a3-d863-4f6e-9e6e-9fcb19989566 req-bc950262-c4dc-42a2-80f0-9523941ed9fc service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039384 Oct 19 03:25:58.443076 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1628/3202] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:25:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:25:58.681673 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a87b0d31-1c50-4ff3-82eb-d5ac375eec29 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:58.682738 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a87b0d31-1c50-4ff3-82eb-d5ac375eec29 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: e022fc4b-88e6-44c8-9729-7e8d25238bb3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:58.688818 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-283d71ce-28be-4bd1-89aa-85a42390aa32 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7bf94a5de054f98a24a6a8f3d5fea9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f91748d2e94f85a70dcc787713fb6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:58.698653 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-283d71ce-28be-4bd1-89aa-85a42390aa32 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7bf94a5de054f98a24a6a8f3d5fea9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f91748d2e94f85a70dcc787713fb6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:58.700209 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-283d71ce-28be-4bd1-89aa-85a42390aa32 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7bf94a5de054f98a24a6a8f3d5fea9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f91748d2e94f85a70dcc787713fb6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:58.701500 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-283d71ce-28be-4bd1-89aa-85a42390aa32 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] 10.222.0.52 "GET /compute/v2.1/servers/dac9628d-657b-4e72-8a7f-08156be8fad7" status: 200 len: 1558 microversion: 2.21 time: 0.431644 Oct 19 03:25:58.704063 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a87b0d31-1c50-4ff3-82eb-d5ac375eec29 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:58.704851 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a87b0d31-1c50-4ff3-82eb-d5ac375eec29 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:58.705573 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a87b0d31-1c50-4ff3-82eb-d5ac375eec29 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:58.706580 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a87b0d31-1c50-4ff3-82eb-d5ac375eec29 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:58.707571 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a87b0d31-1c50-4ff3-82eb-d5ac375eec29 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:58.709067 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a87b0d31-1c50-4ff3-82eb-d5ac375eec29 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:58.726632 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1575/3203] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:25:58 2022] GET /compute/v2.1/servers/dac9628d-657b-4e72-8a7f-08156be8fad7 => generated 1558 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:25:58.837801 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4c6ec5ed-581b-45fc-acf0-a97b4d61adc3 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:58.838464 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4c6ec5ed-581b-45fc-acf0-a97b4d61adc3 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 5cc2003b-73ef-4a54-a22d-9cef47c6ed3f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:58.845641 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4c6ec5ed-581b-45fc-acf0-a97b4d61adc3 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:58.846362 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4c6ec5ed-581b-45fc-acf0-a97b4d61adc3 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:58.847119 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4c6ec5ed-581b-45fc-acf0-a97b4d61adc3 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:58.848019 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4c6ec5ed-581b-45fc-acf0-a97b4d61adc3 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:58.848701 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4c6ec5ed-581b-45fc-acf0-a97b4d61adc3 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:58.849843 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4c6ec5ed-581b-45fc-acf0-a97b4d61adc3 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:58.961637 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-4c6ec5ed-581b-45fc-acf0-a97b4d61adc3 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:58.972483 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4c6ec5ed-581b-45fc-acf0-a97b4d61adc3 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f" status: 200 len: 1286 microversion: 2.1 time: 0.139771 Oct 19 03:25:58.986259 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1576/3204] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:58 2022] GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f => generated 1286 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:25:58.993954 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-dfa4509a-e2d8-4734-b6c7-7a6541ada0f3 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:58.994651 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-dfa4509a-e2d8-4734-b6c7-7a6541ada0f3 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: f71d8b11-c58e-493d-a03c-90d042f22218] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:59.002514 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dfa4509a-e2d8-4734-b6c7-7a6541ada0f3 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:59.003112 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dfa4509a-e2d8-4734-b6c7-7a6541ada0f3 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:59.003704 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dfa4509a-e2d8-4734-b6c7-7a6541ada0f3 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:59.004467 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dfa4509a-e2d8-4734-b6c7-7a6541ada0f3 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:59.004972 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dfa4509a-e2d8-4734-b6c7-7a6541ada0f3 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:59.005550 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dfa4509a-e2d8-4734-b6c7-7a6541ada0f3 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:59.012612 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a87b0d31-1c50-4ff3-82eb-d5ac375eec29 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:59.035919 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a87b0d31-1c50-4ff3-82eb-d5ac375eec29 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/e022fc4b-88e6-44c8-9729-7e8d25238bb3" status: 200 len: 1308 microversion: 2.1 time: 0.358531 Oct 19 03:25:59.037894 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1629/3205] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:58 2022] GET /compute/v2.1/servers/e022fc4b-88e6-44c8-9729-7e8d25238bb3 => generated 1308 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:59.055050 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-0e3f677d-1174-4620-93a4-4b6f6e13f0c7 req-33c43ced-2eb8-43de-8fae-1411d090db02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f71d8b11-c58e-493d-a03c-90d042f22218", "name": "network-vif-plugged", "status": "completed", "tag": "01192655-dfdc-48c9-9121-e6d9fc9b8a2d"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:25:59.090728 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-0e3f677d-1174-4620-93a4-4b6f6e13f0c7 req-33c43ced-2eb8-43de-8fae-1411d090db02 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:59.095660 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-0e3f677d-1174-4620-93a4-4b6f6e13f0c7 req-33c43ced-2eb8-43de-8fae-1411d090db02 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:59.096285 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-0e3f677d-1174-4620-93a4-4b6f6e13f0c7 req-33c43ced-2eb8-43de-8fae-1411d090db02 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:59.119487 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-0e3f677d-1174-4620-93a4-4b6f6e13f0c7 req-33c43ced-2eb8-43de-8fae-1411d090db02 service nova] Creating event network-vif-plugged:01192655-dfdc-48c9-9121-e6d9fc9b8a2d for instance f71d8b11-c58e-493d-a03c-90d042f22218 on n-h2-861333-8 Oct 19 03:25:59.131266 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-0e3f677d-1174-4620-93a4-4b6f6e13f0c7 req-33c43ced-2eb8-43de-8fae-1411d090db02 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080162 Oct 19 03:25:59.142445 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1630/3206] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:25:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:25:59.193851 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-dfa4509a-e2d8-4734-b6c7-7a6541ada0f3 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:59.204397 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-dfa4509a-e2d8-4734-b6c7-7a6541ada0f3 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/f71d8b11-c58e-493d-a03c-90d042f22218" status: 200 len: 1327 microversion: 2.1 time: 0.216354 Oct 19 03:25:59.204397 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1577/3207] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:58 2022] GET /compute/v2.1/servers/f71d8b11-c58e-493d-a03c-90d042f22218 => generated 1327 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:25:59.382657 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-f065fec2-ccbf-4841-9baf-39d5c7604106 req-87d42b5b-ba27-4d33-81d6-25256b2c50ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dac9628d-657b-4e72-8a7f-08156be8fad7", "name": "network-vif-deleted", "tag": "af70bc82-b873-4d91-83de-baf5a4ae6ccd"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:25:59.411450 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-f065fec2-ccbf-4841-9baf-39d5c7604106 req-87d42b5b-ba27-4d33-81d6-25256b2c50ed service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:59.412866 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-f065fec2-ccbf-4841-9baf-39d5c7604106 req-87d42b5b-ba27-4d33-81d6-25256b2c50ed service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:59.413836 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-f065fec2-ccbf-4841-9baf-39d5c7604106 req-87d42b5b-ba27-4d33-81d6-25256b2c50ed service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:59.429699 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-f065fec2-ccbf-4841-9baf-39d5c7604106 req-87d42b5b-ba27-4d33-81d6-25256b2c50ed service nova] Creating event network-vif-deleted:af70bc82-b873-4d91-83de-baf5a4ae6ccd for instance dac9628d-657b-4e72-8a7f-08156be8fad7 on n-h1-861333-8 Oct 19 03:25:59.436990 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-f065fec2-ccbf-4841-9baf-39d5c7604106 req-87d42b5b-ba27-4d33-81d6-25256b2c50ed service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063661 Oct 19 03:25:59.438354 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1631/3208] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:25:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:25:59.731956 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5079bd35-f544-42fc-a172-c9c2a2411932 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:59.732578 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5079bd35-f544-42fc-a172-c9c2a2411932 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] [instance: dac9628d-657b-4e72-8a7f-08156be8fad7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:25:59.742062 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5079bd35-f544-42fc-a172-c9c2a2411932 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:59.742550 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5079bd35-f544-42fc-a172-c9c2a2411932 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:59.743041 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5079bd35-f544-42fc-a172-c9c2a2411932 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:59.745542 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5079bd35-f544-42fc-a172-c9c2a2411932 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:25:59.746039 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5079bd35-f544-42fc-a172-c9c2a2411932 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:25:59.746483 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5079bd35-f544-42fc-a172-c9c2a2411932 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:25:59.833231 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5079bd35-f544-42fc-a172-c9c2a2411932 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7bf94a5de054f98a24a6a8f3d5fea9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f91748d2e94f85a70dcc787713fb6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:59.842555 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5079bd35-f544-42fc-a172-c9c2a2411932 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7bf94a5de054f98a24a6a8f3d5fea9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f91748d2e94f85a70dcc787713fb6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:59.849606 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5079bd35-f544-42fc-a172-c9c2a2411932 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7bf94a5de054f98a24a6a8f3d5fea9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f91748d2e94f85a70dcc787713fb6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:25:59.849606 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5079bd35-f544-42fc-a172-c9c2a2411932 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] 10.222.0.52 "GET /compute/v2.1/servers/dac9628d-657b-4e72-8a7f-08156be8fad7" status: 200 len: 1344 microversion: 2.21 time: 0.121825 Oct 19 03:25:59.849985 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1578/3209] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:25:59 2022] GET /compute/v2.1/servers/dac9628d-657b-4e72-8a7f-08156be8fad7 => generated 1344 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:25:59.998304 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9ccb9905-db54-4db2-a0e6-59469a0d14ed tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:25:59.999461 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9ccb9905-db54-4db2-a0e6-59469a0d14ed tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 5cc2003b-73ef-4a54-a22d-9cef47c6ed3f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:00.007974 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9ccb9905-db54-4db2-a0e6-59469a0d14ed tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:00.010550 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9ccb9905-db54-4db2-a0e6-59469a0d14ed tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:00.012106 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9ccb9905-db54-4db2-a0e6-59469a0d14ed tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:00.013683 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9ccb9905-db54-4db2-a0e6-59469a0d14ed tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:00.014237 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9ccb9905-db54-4db2-a0e6-59469a0d14ed tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:00.014687 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9ccb9905-db54-4db2-a0e6-59469a0d14ed tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:00.061994 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d428ae7a-ec6d-4ed7-b6d6-1936505fe7c6 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:00.062625 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d428ae7a-ec6d-4ed7-b6d6-1936505fe7c6 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: e022fc4b-88e6-44c8-9729-7e8d25238bb3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:00.070614 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d428ae7a-ec6d-4ed7-b6d6-1936505fe7c6 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:00.081724 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d428ae7a-ec6d-4ed7-b6d6-1936505fe7c6 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:00.082594 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d428ae7a-ec6d-4ed7-b6d6-1936505fe7c6 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:00.084034 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d428ae7a-ec6d-4ed7-b6d6-1936505fe7c6 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:00.084755 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d428ae7a-ec6d-4ed7-b6d6-1936505fe7c6 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:00.085453 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d428ae7a-ec6d-4ed7-b6d6-1936505fe7c6 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:00.090961 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:26:00.115997 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-9ccb9905-db54-4db2-a0e6-59469a0d14ed tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:00.125450 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9ccb9905-db54-4db2-a0e6-59469a0d14ed tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f" status: 200 len: 1286 microversion: 2.1 time: 0.131648 Oct 19 03:26:00.126676 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1632/3210] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:25:59 2022] GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f => generated 1286 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:26:00.228538 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5e9a259a-07d1-4032-aec0-4c1e00a93e10 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:00.229163 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-5e9a259a-07d1-4032-aec0-4c1e00a93e10 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: f71d8b11-c58e-493d-a03c-90d042f22218] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:00.236103 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5e9a259a-07d1-4032-aec0-4c1e00a93e10 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:00.237067 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5e9a259a-07d1-4032-aec0-4c1e00a93e10 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:00.237904 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5e9a259a-07d1-4032-aec0-4c1e00a93e10 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:00.239563 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5e9a259a-07d1-4032-aec0-4c1e00a93e10 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:00.240368 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5e9a259a-07d1-4032-aec0-4c1e00a93e10 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:00.240990 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5e9a259a-07d1-4032-aec0-4c1e00a93e10 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:00.366719 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d428ae7a-ec6d-4ed7-b6d6-1936505fe7c6 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:00.383388 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d428ae7a-ec6d-4ed7-b6d6-1936505fe7c6 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/e022fc4b-88e6-44c8-9729-7e8d25238bb3" status: 200 len: 1308 microversion: 2.1 time: 0.324674 Oct 19 03:26:00.398729 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1579/3211] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:00 2022] GET /compute/v2.1/servers/e022fc4b-88e6-44c8-9729-7e8d25238bb3 => generated 1308 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:26:00.471958 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-5e9a259a-07d1-4032-aec0-4c1e00a93e10 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:00.500135 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5e9a259a-07d1-4032-aec0-4c1e00a93e10 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/f71d8b11-c58e-493d-a03c-90d042f22218" status: 200 len: 1327 microversion: 2.1 time: 0.276739 Oct 19 03:26:00.500751 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1633/3212] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:00 2022] GET /compute/v2.1/servers/f71d8b11-c58e-493d-a03c-90d042f22218 => generated 1327 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:26:00.876266 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-aea29d45-392c-4c16-af16-3b210c4f5c61 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:00.876934 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-aea29d45-392c-4c16-af16-3b210c4f5c61 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] [instance: dac9628d-657b-4e72-8a7f-08156be8fad7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:00.884453 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-aea29d45-392c-4c16-af16-3b210c4f5c61 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:00.884903 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-aea29d45-392c-4c16-af16-3b210c4f5c61 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:00.885346 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-aea29d45-392c-4c16-af16-3b210c4f5c61 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:00.886074 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-aea29d45-392c-4c16-af16-3b210c4f5c61 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:00.886533 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-aea29d45-392c-4c16-af16-3b210c4f5c61 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:00.886965 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-aea29d45-392c-4c16-af16-3b210c4f5c61 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:00.922338 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-aea29d45-392c-4c16-af16-3b210c4f5c61 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:00.922824 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-aea29d45-392c-4c16-af16-3b210c4f5c61 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:00.923268 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-aea29d45-392c-4c16-af16-3b210c4f5c61 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:00.923726 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-aea29d45-392c-4c16-af16-3b210c4f5c61 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Lazy-loading 'fault' on Instance uuid dac9628d-657b-4e72-8a7f-08156be8fad7 {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:26:00.968481 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-aea29d45-392c-4c16-af16-3b210c4f5c61 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7bf94a5de054f98a24a6a8f3d5fea9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f91748d2e94f85a70dcc787713fb6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:00.982088 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-aea29d45-392c-4c16-af16-3b210c4f5c61 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7bf94a5de054f98a24a6a8f3d5fea9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f91748d2e94f85a70dcc787713fb6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:00.982088 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-aea29d45-392c-4c16-af16-3b210c4f5c61 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7bf94a5de054f98a24a6a8f3d5fea9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f91748d2e94f85a70dcc787713fb6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:00.982088 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-aea29d45-392c-4c16-af16-3b210c4f5c61 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] 10.222.0.52 "GET /compute/v2.1/servers/dac9628d-657b-4e72-8a7f-08156be8fad7" status: 200 len: 1349 microversion: 2.21 time: 0.107349 Oct 19 03:26:00.982593 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1580/3213] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:26:00 2022] GET /compute/v2.1/servers/dac9628d-657b-4e72-8a7f-08156be8fad7 => generated 1349 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:26:01.148979 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7ab7043b-00c6-4b8a-ac79-2a3c733c2d49 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:01.150222 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7ab7043b-00c6-4b8a-ac79-2a3c733c2d49 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 5cc2003b-73ef-4a54-a22d-9cef47c6ed3f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:01.155842 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:26:01.156862 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7ab7043b-00c6-4b8a-ac79-2a3c733c2d49 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:01.157359 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7ab7043b-00c6-4b8a-ac79-2a3c733c2d49 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:01.157827 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7ab7043b-00c6-4b8a-ac79-2a3c733c2d49 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:01.158524 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7ab7043b-00c6-4b8a-ac79-2a3c733c2d49 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:01.159113 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7ab7043b-00c6-4b8a-ac79-2a3c733c2d49 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:01.159549 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7ab7043b-00c6-4b8a-ac79-2a3c733c2d49 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:01.227532 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7ab7043b-00c6-4b8a-ac79-2a3c733c2d49 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:01.232020 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7ab7043b-00c6-4b8a-ac79-2a3c733c2d49 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f" status: 200 len: 1286 microversion: 2.1 time: 0.087689 Oct 19 03:26:01.232722 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1634/3214] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:01 2022] GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f => generated 1286 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:26:01.411646 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-eb13327e-5172-4154-8011-b1cda88c479d tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:01.412439 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-eb13327e-5172-4154-8011-b1cda88c479d tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: e022fc4b-88e6-44c8-9729-7e8d25238bb3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:01.419253 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eb13327e-5172-4154-8011-b1cda88c479d tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:01.419759 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eb13327e-5172-4154-8011-b1cda88c479d tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:01.420209 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eb13327e-5172-4154-8011-b1cda88c479d tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:01.420928 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eb13327e-5172-4154-8011-b1cda88c479d tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:01.421410 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eb13327e-5172-4154-8011-b1cda88c479d tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:01.421852 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eb13327e-5172-4154-8011-b1cda88c479d tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:01.527174 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ba367577-9c75-428f-a9b7-e6b1ea54afd2 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:01.528469 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ba367577-9c75-428f-a9b7-e6b1ea54afd2 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: f71d8b11-c58e-493d-a03c-90d042f22218] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:01.539616 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ba367577-9c75-428f-a9b7-e6b1ea54afd2 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:01.540574 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ba367577-9c75-428f-a9b7-e6b1ea54afd2 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:01.541232 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ba367577-9c75-428f-a9b7-e6b1ea54afd2 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:01.544338 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ba367577-9c75-428f-a9b7-e6b1ea54afd2 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:01.544999 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ba367577-9c75-428f-a9b7-e6b1ea54afd2 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:01.545703 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ba367577-9c75-428f-a9b7-e6b1ea54afd2 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:01.674377 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-eb13327e-5172-4154-8011-b1cda88c479d tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:01.682995 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-eb13327e-5172-4154-8011-b1cda88c479d tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/e022fc4b-88e6-44c8-9729-7e8d25238bb3" status: 200 len: 1308 microversion: 2.1 time: 0.275485 Oct 19 03:26:01.683664 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1581/3215] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:01 2022] GET /compute/v2.1/servers/e022fc4b-88e6-44c8-9729-7e8d25238bb3 => generated 1308 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:26:01.719259 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ba367577-9c75-428f-a9b7-e6b1ea54afd2 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:01.727927 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ba367577-9c75-428f-a9b7-e6b1ea54afd2 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/f71d8b11-c58e-493d-a03c-90d042f22218" status: 200 len: 1327 microversion: 2.1 time: 0.206867 Oct 19 03:26:01.728501 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1635/3216] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:01 2022] GET /compute/v2.1/servers/f71d8b11-c58e-493d-a03c-90d042f22218 => generated 1327 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:26:02.007413 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b899b869-f351-4184-b0ef-eae160fa0347 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:02.008031 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b899b869-f351-4184-b0ef-eae160fa0347 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] [instance: dac9628d-657b-4e72-8a7f-08156be8fad7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:02.015118 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b899b869-f351-4184-b0ef-eae160fa0347 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:02.015859 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b899b869-f351-4184-b0ef-eae160fa0347 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:02.016300 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b899b869-f351-4184-b0ef-eae160fa0347 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:02.017000 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b899b869-f351-4184-b0ef-eae160fa0347 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:02.017489 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b899b869-f351-4184-b0ef-eae160fa0347 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:02.017926 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b899b869-f351-4184-b0ef-eae160fa0347 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:02.031756 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-b899b869-f351-4184-b0ef-eae160fa0347 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] HTTP exception thrown: Instance dac9628d-657b-4e72-8a7f-08156be8fad7 could not be found. Oct 19 03:26:02.033511 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b899b869-f351-4184-b0ef-eae160fa0347 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Request method failure captured: Oct 19 03:26:02.033511 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/dac9628d-657b-4e72-8a7f-08156be8fad7 HTTP/1.1 Oct 19 03:26:02.033511 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:26:02.033511 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:26:02.033511 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:26:02.033511 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:26:02.033511 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:26:02.033511 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:26:02.033511 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:26:02.033511 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:26:02.033511 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT24qfZFciaDDyp8CnCJlTfMzN4XjNVd206EgWo0dh7qf3Ok2iz1qId4D-sdDjnzGr5mQxJf1vFlbSdAzhha-5AAcsKVUTxkDx2lAopqrae8ZGoDWlh8jWdKAivrXSIajTnGVj5oLLXl52EZAF5YC7-lLxgRBteSL7OA_SR0kuVzaPeg Oct 19 03:26:02.033511 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:26:02.033511 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:26:02.033511 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:26:02.033511 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:26:02.033511 n-d-861333-8 devstack@n-api.service[121134]: X-Openstack-Nova-Api-Version: 2.21 Oct 19 03:26:02.033511 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:26:02.033511 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:26:02.033511 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 91f91748d2e94f85a70dcc787713fb6e Oct 19 03:26:02.033511 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-InstanceActionsV221TestJSON-372058469 Oct 19 03:26:02.033511 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:26:02.033511 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:26:02.035289 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/91f91748d2e94f85a70dcc787713fb6e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/91f91748d2e94f85a70dcc787713fb6e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/91f91748d2e94f85a70dcc787713fb6e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_91f91748d2e94f85a70dcc787713fb6e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:26:02.035289 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-InstanceActionsV221TestJSON-372058469 Oct 19 03:26:02.035289 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 91f91748d2e94f85a70dcc787713fb6e Oct 19 03:26:02.035289 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-372058469 Oct 19 03:26:02.035289 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-InstanceActionsV221TestJSON-372058469-project Oct 19 03:26:02.035289 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:26:02.035289 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:26:02.035289 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: a7bf94a5de054f98a24a6a8f3d5fea9b Oct 19 03:26:02.035289 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-InstanceActionsV221TestJSON-372058469-project Oct 19 03:26:02.035289 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:26:02.035289 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance dac9628d-657b-4e72-8a7f-08156be8fad7 could not be found. Oct 19 03:26:02.035289 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': 'dac9628d-657b-4e72-8a7f-08156be8fad7'} Oct 19 03:26:02.036489 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:26:02.036489 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:26:02.036489 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:26:02.036489 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:26:02.036489 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:26:02.036489 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:26:02.036489 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:26:02.036489 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:26:02.036489 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:26:02.036489 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:26:02.036489 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dac9628d-657b-4e72-8a7f-08156be8fad7 could not be found. Oct 19 03:26:02.036489 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:26:02.036489 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:26:02.036489 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:26:02.036489 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:26:02.036489 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:26:02.036489 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:26:02.036489 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:26:02.036489 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:26:02.036489 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:26:02.037801 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:26:02.037801 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:26:02.037801 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:26:02.037801 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:26:02.037801 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:26:02.037801 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:26:02.037801 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:26:02.037801 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dac9628d-657b-4e72-8a7f-08156be8fad7 could not be found. Oct 19 03:26:02.037801 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:26:02.037801 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:26:02.037801 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:26:02.037801 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:26:02.037801 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:26:02.037801 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:26:02.037801 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:26:02.037801 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:26:02.037801 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dac9628d-657b-4e72-8a7f-08156be8fad7 could not be found. Oct 19 03:26:02.037801 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:26:02.040557 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b899b869-f351-4184-b0ef-eae160fa0347 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Returning 404 to user: Instance dac9628d-657b-4e72-8a7f-08156be8fad7 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:26:02.040557 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b899b869-f351-4184-b0ef-eae160fa0347 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] 10.222.0.52 "GET /compute/v2.1/servers/dac9628d-657b-4e72-8a7f-08156be8fad7" status: 404 len: 111 microversion: 2.21 time: 0.031685 Oct 19 03:26:02.040557 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1582/3217] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:26:02 2022] GET /compute/v2.1/servers/dac9628d-657b-4e72-8a7f-08156be8fad7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 19 03:26:02.047116 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e49f017b-6eb6-4148-a2c0-bc346356ebf2 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Calling method '.version_select at 0x7fc1305e7550>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:02.047709 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e49f017b-6eb6-4148-a2c0-bc346356ebf2 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] [instance: dac9628d-657b-4e72-8a7f-08156be8fad7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:02.053776 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e49f017b-6eb6-4148-a2c0-bc346356ebf2 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:02.054274 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e49f017b-6eb6-4148-a2c0-bc346356ebf2 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:02.054791 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e49f017b-6eb6-4148-a2c0-bc346356ebf2 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:02.056053 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e49f017b-6eb6-4148-a2c0-bc346356ebf2 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:02.056683 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e49f017b-6eb6-4148-a2c0-bc346356ebf2 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:02.057298 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e49f017b-6eb6-4148-a2c0-bc346356ebf2 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:02.083996 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=100 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:26:02.127773 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e49f017b-6eb6-4148-a2c0-bc346356ebf2 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] 10.222.0.52 "GET /compute/v2.1/servers/dac9628d-657b-4e72-8a7f-08156be8fad7/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.085051 Oct 19 03:26:02.128359 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1636/3218] 10.222.0.52 () {60 vars in 1337 bytes} [Wed Oct 19 03:26:02 2022] GET /compute/v2.1/servers/dac9628d-657b-4e72-8a7f-08156be8fad7/os-instance-actions => generated 611 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 03:26:02.143726 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7d308aed-c76a-4aab-a0f1-e39abd264802 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:02.144487 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7d308aed-c76a-4aab-a0f1-e39abd264802 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] [instance: dac9628d-657b-4e72-8a7f-08156be8fad7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:02.151180 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7d308aed-c76a-4aab-a0f1-e39abd264802 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:02.151678 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7d308aed-c76a-4aab-a0f1-e39abd264802 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:02.152441 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7d308aed-c76a-4aab-a0f1-e39abd264802 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:02.153320 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7d308aed-c76a-4aab-a0f1-e39abd264802 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:02.153961 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7d308aed-c76a-4aab-a0f1-e39abd264802 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:02.154569 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7d308aed-c76a-4aab-a0f1-e39abd264802 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:02.169992 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-7d308aed-c76a-4aab-a0f1-e39abd264802 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] HTTP exception thrown: Instance dac9628d-657b-4e72-8a7f-08156be8fad7 could not be found. Oct 19 03:26:02.171698 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7d308aed-c76a-4aab-a0f1-e39abd264802 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Request method failure captured: Oct 19 03:26:02.171698 n-d-861333-8 devstack@n-api.service[121135]: request: DELETE /compute/v2.1/servers/dac9628d-657b-4e72-8a7f-08156be8fad7 HTTP/1.1 Oct 19 03:26:02.171698 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:26:02.171698 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:26:02.171698 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:26:02.171698 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:26:02.171698 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:26:02.171698 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:26:02.171698 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:26:02.171698 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:26:02.171698 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT24qfZFciaDDyp8CnCJlTfMzN4XjNVd206EgWo0dh7qf3Ok2iz1qId4D-sdDjnzGr5mQxJf1vFlbSdAzhha-5AAcsKVUTxkDx2lAopqrae8ZGoDWlh8jWdKAivrXSIajTnGVj5oLLXl52EZAF5YC7-lLxgRBteSL7OA_SR0kuVzaPeg Oct 19 03:26:02.171698 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:26:02.171698 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:26:02.171698 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:26:02.171698 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:26:02.171698 n-d-861333-8 devstack@n-api.service[121135]: X-Openstack-Nova-Api-Version: 2.21 Oct 19 03:26:02.171698 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:26:02.171698 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:26:02.171698 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 91f91748d2e94f85a70dcc787713fb6e Oct 19 03:26:02.171698 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-InstanceActionsV221TestJSON-372058469 Oct 19 03:26:02.171698 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:26:02.171698 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:26:02.173321 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/91f91748d2e94f85a70dcc787713fb6e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/91f91748d2e94f85a70dcc787713fb6e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/91f91748d2e94f85a70dcc787713fb6e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_91f91748d2e94f85a70dcc787713fb6e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:26:02.173321 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-InstanceActionsV221TestJSON-372058469 Oct 19 03:26:02.173321 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 91f91748d2e94f85a70dcc787713fb6e Oct 19 03:26:02.173321 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-372058469 Oct 19 03:26:02.173321 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-InstanceActionsV221TestJSON-372058469-project Oct 19 03:26:02.173321 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:26:02.173321 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:26:02.173321 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: a7bf94a5de054f98a24a6a8f3d5fea9b Oct 19 03:26:02.173321 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-InstanceActionsV221TestJSON-372058469-project Oct 19 03:26:02.173321 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:26:02.173321 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance dac9628d-657b-4e72-8a7f-08156be8fad7 could not be found. Oct 19 03:26:02.173321 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': 'dac9628d-657b-4e72-8a7f-08156be8fad7'} Oct 19 03:26:02.174269 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:26:02.174269 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:26:02.174269 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:26:02.174269 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:26:02.174269 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:26:02.174269 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:26:02.174269 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:26:02.174269 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:26:02.174269 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:26:02.174269 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:26:02.174269 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dac9628d-657b-4e72-8a7f-08156be8fad7 could not be found. Oct 19 03:26:02.174269 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:26:02.174269 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:26:02.174269 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:26:02.174269 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:26:02.174269 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:26:02.174269 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:26:02.174269 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:26:02.174269 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:26:02.174269 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:26:02.175918 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:26:02.175918 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 03:26:02.175918 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 03:26:02.175918 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 03:26:02.175918 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 03:26:02.175918 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:26:02.175918 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:26:02.175918 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:26:02.175918 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:26:02.175918 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dac9628d-657b-4e72-8a7f-08156be8fad7 could not be found. Oct 19 03:26:02.175918 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:26:02.175918 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:26:02.175918 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:26:02.175918 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:26:02.175918 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:26:02.175918 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:26:02.175918 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:26:02.175918 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:26:02.175918 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dac9628d-657b-4e72-8a7f-08156be8fad7 could not be found. Oct 19 03:26:02.175918 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:26:02.177514 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7d308aed-c76a-4aab-a0f1-e39abd264802 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Returning 404 to user: Instance dac9628d-657b-4e72-8a7f-08156be8fad7 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:26:02.177514 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7d308aed-c76a-4aab-a0f1-e39abd264802 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] 10.222.0.52 "DELETE /compute/v2.1/servers/dac9628d-657b-4e72-8a7f-08156be8fad7" status: 404 len: 111 microversion: 2.21 time: 0.034389 Oct 19 03:26:02.177514 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1637/3219] 10.222.0.52 () {60 vars in 1280 bytes} [Wed Oct 19 03:26:02 2022] DELETE /compute/v2.1/servers/dac9628d-657b-4e72-8a7f-08156be8fad7 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 19 03:26:02.181845 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ad8c2b83-c3f8-4b76-96ba-6a3a5daf5509 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:02.182493 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ad8c2b83-c3f8-4b76-96ba-6a3a5daf5509 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] [instance: dac9628d-657b-4e72-8a7f-08156be8fad7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:02.188791 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ad8c2b83-c3f8-4b76-96ba-6a3a5daf5509 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:02.189282 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ad8c2b83-c3f8-4b76-96ba-6a3a5daf5509 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:02.189759 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ad8c2b83-c3f8-4b76-96ba-6a3a5daf5509 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:02.190472 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ad8c2b83-c3f8-4b76-96ba-6a3a5daf5509 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:02.190936 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ad8c2b83-c3f8-4b76-96ba-6a3a5daf5509 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:02.191372 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ad8c2b83-c3f8-4b76-96ba-6a3a5daf5509 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:02.198696 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-771dfcf4-95f6-4e07-93a4-482ab56e4fca tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:02.201362 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-771dfcf4-95f6-4e07-93a4-482ab56e4fca tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] [instance: 4adec402-e94f-4a41-ac77-68f6091b87f7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:02.206445 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-771dfcf4-95f6-4e07-93a4-482ab56e4fca tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:02.206934 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-ad8c2b83-c3f8-4b76-96ba-6a3a5daf5509 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] HTTP exception thrown: Instance dac9628d-657b-4e72-8a7f-08156be8fad7 could not be found. Oct 19 03:26:02.207129 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-771dfcf4-95f6-4e07-93a4-482ab56e4fca tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:02.207835 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-771dfcf4-95f6-4e07-93a4-482ab56e4fca tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:02.208503 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ad8c2b83-c3f8-4b76-96ba-6a3a5daf5509 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Request method failure captured: Oct 19 03:26:02.208503 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/dac9628d-657b-4e72-8a7f-08156be8fad7 HTTP/1.1 Oct 19 03:26:02.208503 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:26:02.208503 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:26:02.208503 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:26:02.208503 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:26:02.208503 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:26:02.208503 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:26:02.208503 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:26:02.208503 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:26:02.208503 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT24qfZFciaDDyp8CnCJlTfMzN4XjNVd206EgWo0dh7qf3Ok2iz1qId4D-sdDjnzGr5mQxJf1vFlbSdAzhha-5AAcsKVUTxkDx2lAopqrae8ZGoDWlh8jWdKAivrXSIajTnGVj5oLLXl52EZAF5YC7-lLxgRBteSL7OA_SR0kuVzaPeg Oct 19 03:26:02.208503 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:26:02.208503 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:26:02.208503 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:26:02.208503 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:26:02.208503 n-d-861333-8 devstack@n-api.service[121135]: X-Openstack-Nova-Api-Version: 2.21 Oct 19 03:26:02.208503 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:26:02.208503 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:26:02.208503 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 91f91748d2e94f85a70dcc787713fb6e Oct 19 03:26:02.208503 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-InstanceActionsV221TestJSON-372058469 Oct 19 03:26:02.208503 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:26:02.208503 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:26:02.209939 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/91f91748d2e94f85a70dcc787713fb6e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/91f91748d2e94f85a70dcc787713fb6e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/91f91748d2e94f85a70dcc787713fb6e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_91f91748d2e94f85a70dcc787713fb6e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:26:02.209939 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-InstanceActionsV221TestJSON-372058469 Oct 19 03:26:02.209939 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 91f91748d2e94f85a70dcc787713fb6e Oct 19 03:26:02.209939 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-372058469 Oct 19 03:26:02.209939 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-InstanceActionsV221TestJSON-372058469-project Oct 19 03:26:02.209939 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:26:02.209939 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:26:02.209939 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: a7bf94a5de054f98a24a6a8f3d5fea9b Oct 19 03:26:02.209939 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-InstanceActionsV221TestJSON-372058469-project Oct 19 03:26:02.209939 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:26:02.209939 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance dac9628d-657b-4e72-8a7f-08156be8fad7 could not be found. Oct 19 03:26:02.209939 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': 'dac9628d-657b-4e72-8a7f-08156be8fad7'} Oct 19 03:26:02.213817 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:26:02.213817 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:26:02.213817 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:26:02.213817 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:26:02.213817 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:26:02.213817 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:26:02.213817 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:26:02.213817 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:26:02.213817 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:26:02.213817 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:26:02.213817 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dac9628d-657b-4e72-8a7f-08156be8fad7 could not be found. Oct 19 03:26:02.213817 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:26:02.213817 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:26:02.213817 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:26:02.213817 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:26:02.213817 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:26:02.213817 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:26:02.213817 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:26:02.213817 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:26:02.213817 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:26:02.216780 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:26:02.216780 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:26:02.216780 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:26:02.216780 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:26:02.216780 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:26:02.216780 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:26:02.216780 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:26:02.216780 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dac9628d-657b-4e72-8a7f-08156be8fad7 could not be found. Oct 19 03:26:02.216780 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:26:02.216780 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:26:02.216780 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:26:02.216780 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:26:02.216780 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:26:02.216780 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:26:02.216780 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:26:02.216780 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:26:02.216780 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dac9628d-657b-4e72-8a7f-08156be8fad7 could not be found. Oct 19 03:26:02.216780 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:26:02.218588 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-771dfcf4-95f6-4e07-93a4-482ab56e4fca tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:02.218691 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ad8c2b83-c3f8-4b76-96ba-6a3a5daf5509 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] Returning 404 to user: Instance dac9628d-657b-4e72-8a7f-08156be8fad7 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:26:02.218792 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-771dfcf4-95f6-4e07-93a4-482ab56e4fca tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:02.218792 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-771dfcf4-95f6-4e07-93a4-482ab56e4fca tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:02.218974 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ad8c2b83-c3f8-4b76-96ba-6a3a5daf5509 tempest-InstanceActionsV221TestJSON-372058469 tempest-InstanceActionsV221TestJSON-372058469-project] 10.222.0.52 "GET /compute/v2.1/servers/dac9628d-657b-4e72-8a7f-08156be8fad7" status: 404 len: 111 microversion: 2.21 time: 0.031983 Oct 19 03:26:02.218974 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1638/3220] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:26:02 2022] GET /compute/v2.1/servers/dac9628d-657b-4e72-8a7f-08156be8fad7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 19 03:26:02.237769 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-771dfcf4-95f6-4e07-93a4-482ab56e4fca tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] [instance: 4adec402-e94f-4a41-ac77-68f6091b87f7] Going to try to terminate instance {{(pid=121134) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:26:02.261158 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-8e07f6e1-cd4f-4d39-9acc-bd84debd2a6d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:02.262552 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-8e07f6e1-cd4f-4d39-9acc-bd84debd2a6d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 5cc2003b-73ef-4a54-a22d-9cef47c6ed3f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:02.273073 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8e07f6e1-cd4f-4d39-9acc-bd84debd2a6d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:02.274026 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8e07f6e1-cd4f-4d39-9acc-bd84debd2a6d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:02.275222 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8e07f6e1-cd4f-4d39-9acc-bd84debd2a6d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:02.277695 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8e07f6e1-cd4f-4d39-9acc-bd84debd2a6d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:02.280510 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8e07f6e1-cd4f-4d39-9acc-bd84debd2a6d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:02.280987 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8e07f6e1-cd4f-4d39-9acc-bd84debd2a6d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:02.307083 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=6 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:26:02.385962 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-8e07f6e1-cd4f-4d39-9acc-bd84debd2a6d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:02.396299 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-8e07f6e1-cd4f-4d39-9acc-bd84debd2a6d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f" status: 200 len: 1292 microversion: 2.1 time: 0.145338 Oct 19 03:26:02.396881 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1639/3221] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:02 2022] GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f => generated 1292 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:26:02.551547 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-771dfcf4-95f6-4e07-93a4-482ab56e4fca tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] 10.222.0.52 "DELETE /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7" status: 204 len: 0 microversion: 2.32 time: 0.488711 Oct 19 03:26:02.552586 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1583/3222] 10.222.0.52 () {60 vars in 1280 bytes} [Wed Oct 19 03:26:02 2022] DELETE /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 19 03:26:02.561762 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-529dd43f-f3a4-4eb3-935a-a1426a915340 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:02.567458 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-529dd43f-f3a4-4eb3-935a-a1426a915340 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] [instance: 4adec402-e94f-4a41-ac77-68f6091b87f7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:02.577005 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-529dd43f-f3a4-4eb3-935a-a1426a915340 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:02.578330 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-529dd43f-f3a4-4eb3-935a-a1426a915340 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:02.579009 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-529dd43f-f3a4-4eb3-935a-a1426a915340 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:02.579943 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-529dd43f-f3a4-4eb3-935a-a1426a915340 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:02.580617 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-529dd43f-f3a4-4eb3-935a-a1426a915340 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:02.581200 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-529dd43f-f3a4-4eb3-935a-a1426a915340 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:02.708171 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-555f632d-a2ca-46e1-92eb-5db385763b64 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:02.709073 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-555f632d-a2ca-46e1-92eb-5db385763b64 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: e022fc4b-88e6-44c8-9729-7e8d25238bb3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:02.719090 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-555f632d-a2ca-46e1-92eb-5db385763b64 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:02.719090 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-555f632d-a2ca-46e1-92eb-5db385763b64 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:02.719090 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-555f632d-a2ca-46e1-92eb-5db385763b64 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:02.719090 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-555f632d-a2ca-46e1-92eb-5db385763b64 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:02.719954 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-555f632d-a2ca-46e1-92eb-5db385763b64 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:02.720658 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-555f632d-a2ca-46e1-92eb-5db385763b64 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:02.797140 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=26 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:26:02.971532 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-529dd43f-f3a4-4eb3-935a-a1426a915340 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:02.981428 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-529dd43f-f3a4-4eb3-935a-a1426a915340 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:02.982864 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-529dd43f-f3a4-4eb3-935a-a1426a915340 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:02.984111 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-529dd43f-f3a4-4eb3-935a-a1426a915340 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] 10.222.0.52 "GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7" status: 200 len: 2952 microversion: 2.32 time: 0.426666 Oct 19 03:26:02.984678 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1640/3223] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:26:02 2022] GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7 => generated 2952 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:26:02.989069 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-850e3e70-af59-40d7-ac3a-c96f4b3b4d4e tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:02.989714 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-850e3e70-af59-40d7-ac3a-c96f4b3b4d4e tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: f71d8b11-c58e-493d-a03c-90d042f22218] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:02.995552 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-850e3e70-af59-40d7-ac3a-c96f4b3b4d4e tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:02.996034 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-850e3e70-af59-40d7-ac3a-c96f4b3b4d4e tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:02.996460 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-850e3e70-af59-40d7-ac3a-c96f4b3b4d4e tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:02.997404 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-850e3e70-af59-40d7-ac3a-c96f4b3b4d4e tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:02.997801 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-850e3e70-af59-40d7-ac3a-c96f4b3b4d4e tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:02.998078 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-850e3e70-af59-40d7-ac3a-c96f4b3b4d4e tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:03.006125 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-555f632d-a2ca-46e1-92eb-5db385763b64 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:03.014788 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-555f632d-a2ca-46e1-92eb-5db385763b64 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/e022fc4b-88e6-44c8-9729-7e8d25238bb3" status: 200 len: 1308 microversion: 2.1 time: 0.311224 Oct 19 03:26:03.025538 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1584/3224] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:02 2022] GET /compute/v2.1/servers/e022fc4b-88e6-44c8-9729-7e8d25238bb3 => generated 1308 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:26:03.221075 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-850e3e70-af59-40d7-ac3a-c96f4b3b4d4e tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:03.229153 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-850e3e70-af59-40d7-ac3a-c96f4b3b4d4e tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/f71d8b11-c58e-493d-a03c-90d042f22218" status: 200 len: 1327 microversion: 2.1 time: 0.243487 Oct 19 03:26:03.229777 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1641/3225] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:02 2022] GET /compute/v2.1/servers/f71d8b11-c58e-493d-a03c-90d042f22218 => generated 1327 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:26:03.420004 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-43d27ff5-7ce1-4f7a-bcd5-cba938542cf2 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:03.420622 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-43d27ff5-7ce1-4f7a-bcd5-cba938542cf2 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 5cc2003b-73ef-4a54-a22d-9cef47c6ed3f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:03.426604 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-43d27ff5-7ce1-4f7a-bcd5-cba938542cf2 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:03.427092 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-43d27ff5-7ce1-4f7a-bcd5-cba938542cf2 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:03.427537 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-43d27ff5-7ce1-4f7a-bcd5-cba938542cf2 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:03.428242 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-43d27ff5-7ce1-4f7a-bcd5-cba938542cf2 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:03.428701 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-43d27ff5-7ce1-4f7a-bcd5-cba938542cf2 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:03.429145 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-43d27ff5-7ce1-4f7a-bcd5-cba938542cf2 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:03.583638 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-43d27ff5-7ce1-4f7a-bcd5-cba938542cf2 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:03.591934 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-43d27ff5-7ce1-4f7a-bcd5-cba938542cf2 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f" status: 200 len: 1360 microversion: 2.1 time: 0.175936 Oct 19 03:26:03.592504 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1585/3226] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:03 2022] GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f => generated 1360 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:26:04.013569 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-80e68096-2236-4337-9929-dfb1cd3624bf tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:04.014423 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-80e68096-2236-4337-9929-dfb1cd3624bf tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] [instance: 4adec402-e94f-4a41-ac77-68f6091b87f7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:04.022094 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-80e68096-2236-4337-9929-dfb1cd3624bf tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:04.022798 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-80e68096-2236-4337-9929-dfb1cd3624bf tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:04.023336 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-80e68096-2236-4337-9929-dfb1cd3624bf tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:04.024346 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-80e68096-2236-4337-9929-dfb1cd3624bf tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:04.024802 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-80e68096-2236-4337-9929-dfb1cd3624bf tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:04.025430 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-80e68096-2236-4337-9929-dfb1cd3624bf tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:04.038215 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-490fbb91-6eb9-4648-9a9f-b81482b5a9d9 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:04.038833 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-490fbb91-6eb9-4648-9a9f-b81482b5a9d9 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: e022fc4b-88e6-44c8-9729-7e8d25238bb3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:04.047535 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-490fbb91-6eb9-4648-9a9f-b81482b5a9d9 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:04.047951 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-490fbb91-6eb9-4648-9a9f-b81482b5a9d9 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:04.048392 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-490fbb91-6eb9-4648-9a9f-b81482b5a9d9 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:04.049096 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-490fbb91-6eb9-4648-9a9f-b81482b5a9d9 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:04.049609 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-490fbb91-6eb9-4648-9a9f-b81482b5a9d9 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:04.050040 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-490fbb91-6eb9-4648-9a9f-b81482b5a9d9 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:04.684840 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-490fbb91-6eb9-4648-9a9f-b81482b5a9d9 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:04.697168 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-490fbb91-6eb9-4648-9a9f-b81482b5a9d9 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/e022fc4b-88e6-44c8-9729-7e8d25238bb3" status: 200 len: 1308 microversion: 2.1 time: 0.662608 Oct 19 03:26:04.699104 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1586/3227] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:04 2022] GET /compute/v2.1/servers/e022fc4b-88e6-44c8-9729-7e8d25238bb3 => generated 1308 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:26:04.700495 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-80e68096-2236-4337-9929-dfb1cd3624bf tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:04.705311 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d5d90aaa-f716-4b9f-8a8e-0d446f5d1016 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:04.706405 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d5d90aaa-f716-4b9f-8a8e-0d446f5d1016 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: f71d8b11-c58e-493d-a03c-90d042f22218] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:04.721279 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-80e68096-2236-4337-9929-dfb1cd3624bf tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:04.722651 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d5d90aaa-f716-4b9f-8a8e-0d446f5d1016 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:04.723044 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-80e68096-2236-4337-9929-dfb1cd3624bf tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:04.723206 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d5d90aaa-f716-4b9f-8a8e-0d446f5d1016 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:04.723603 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d5d90aaa-f716-4b9f-8a8e-0d446f5d1016 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:04.724329 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d5d90aaa-f716-4b9f-8a8e-0d446f5d1016 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:04.724799 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d5d90aaa-f716-4b9f-8a8e-0d446f5d1016 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:04.725236 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d5d90aaa-f716-4b9f-8a8e-0d446f5d1016 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:04.725763 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-80e68096-2236-4337-9929-dfb1cd3624bf tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] 10.222.0.52 "GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7" status: 200 len: 2952 microversion: 2.32 time: 0.716161 Oct 19 03:26:04.738594 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1642/3228] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:26:04 2022] GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7 => generated 2952 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:26:04.753672 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-53646b51-78ad-45d6-8d8b-d50f4e2d5c10 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:04.754645 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-53646b51-78ad-45d6-8d8b-d50f4e2d5c10 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 5cc2003b-73ef-4a54-a22d-9cef47c6ed3f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:04.762305 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-53646b51-78ad-45d6-8d8b-d50f4e2d5c10 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:04.763057 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-53646b51-78ad-45d6-8d8b-d50f4e2d5c10 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:04.763730 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-53646b51-78ad-45d6-8d8b-d50f4e2d5c10 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:04.764694 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-53646b51-78ad-45d6-8d8b-d50f4e2d5c10 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:04.765670 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-53646b51-78ad-45d6-8d8b-d50f4e2d5c10 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:04.766345 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-53646b51-78ad-45d6-8d8b-d50f4e2d5c10 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:04.963591 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d5d90aaa-f716-4b9f-8a8e-0d446f5d1016 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:04.972504 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d5d90aaa-f716-4b9f-8a8e-0d446f5d1016 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/f71d8b11-c58e-493d-a03c-90d042f22218" status: 200 len: 1327 microversion: 2.1 time: 0.271792 Oct 19 03:26:04.985744 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1587/3229] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:04 2022] GET /compute/v2.1/servers/f71d8b11-c58e-493d-a03c-90d042f22218 => generated 1327 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:26:04.987246 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-53646b51-78ad-45d6-8d8b-d50f4e2d5c10 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:04.995645 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-53646b51-78ad-45d6-8d8b-d50f4e2d5c10 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f" status: 200 len: 1360 microversion: 2.1 time: 0.255705 Oct 19 03:26:04.999828 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1643/3230] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:04 2022] GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f => generated 1360 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:26:05.722529 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1169ed70-27b8-45ed-b9c8-b39583f4933c tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:05.723156 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1169ed70-27b8-45ed-b9c8-b39583f4933c tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: e022fc4b-88e6-44c8-9729-7e8d25238bb3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:05.730911 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1169ed70-27b8-45ed-b9c8-b39583f4933c tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:05.731420 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1169ed70-27b8-45ed-b9c8-b39583f4933c tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:05.731865 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1169ed70-27b8-45ed-b9c8-b39583f4933c tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:05.732578 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1169ed70-27b8-45ed-b9c8-b39583f4933c tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:05.733041 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1169ed70-27b8-45ed-b9c8-b39583f4933c tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:05.733501 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1169ed70-27b8-45ed-b9c8-b39583f4933c tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:05.758866 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2501fff5-e8f6-48c2-b225-f230ea1236cf tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:05.760899 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-2501fff5-e8f6-48c2-b225-f230ea1236cf tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] [instance: 4adec402-e94f-4a41-ac77-68f6091b87f7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:05.769356 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2501fff5-e8f6-48c2-b225-f230ea1236cf tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:05.770817 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2501fff5-e8f6-48c2-b225-f230ea1236cf tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:05.771596 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2501fff5-e8f6-48c2-b225-f230ea1236cf tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:05.773163 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2501fff5-e8f6-48c2-b225-f230ea1236cf tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:05.773864 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2501fff5-e8f6-48c2-b225-f230ea1236cf tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:05.774463 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2501fff5-e8f6-48c2-b225-f230ea1236cf tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:06.037157 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-2501fff5-e8f6-48c2-b225-f230ea1236cf tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:06.047366 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-2501fff5-e8f6-48c2-b225-f230ea1236cf tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:06.048801 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-2501fff5-e8f6-48c2-b225-f230ea1236cf tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:06.050113 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-1169ed70-27b8-45ed-b9c8-b39583f4933c tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:06.050260 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2501fff5-e8f6-48c2-b225-f230ea1236cf tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] 10.222.0.52 "GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7" status: 200 len: 2952 microversion: 2.32 time: 0.295580 Oct 19 03:26:06.050688 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1644/3231] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:26:05 2022] GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7 => generated 2952 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:26:06.055044 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4ebe330c-97b9-4eee-af7b-f01da8a6562c tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:06.055691 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4ebe330c-97b9-4eee-af7b-f01da8a6562c tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: f71d8b11-c58e-493d-a03c-90d042f22218] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:06.062228 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4ebe330c-97b9-4eee-af7b-f01da8a6562c tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:06.062724 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4ebe330c-97b9-4eee-af7b-f01da8a6562c tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:06.063174 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4ebe330c-97b9-4eee-af7b-f01da8a6562c tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:06.063378 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1169ed70-27b8-45ed-b9c8-b39583f4933c tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/e022fc4b-88e6-44c8-9729-7e8d25238bb3" status: 200 len: 1308 microversion: 2.1 time: 0.344812 Oct 19 03:26:06.063864 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4ebe330c-97b9-4eee-af7b-f01da8a6562c tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:06.064183 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1588/3232] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:05 2022] GET /compute/v2.1/servers/e022fc4b-88e6-44c8-9729-7e8d25238bb3 => generated 1308 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:26:06.073568 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b59e9110-d83c-4a4e-baf6-b544083fa4f9 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:06.073568 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b59e9110-d83c-4a4e-baf6-b544083fa4f9 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 5cc2003b-73ef-4a54-a22d-9cef47c6ed3f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:06.073779 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4ebe330c-97b9-4eee-af7b-f01da8a6562c tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:06.073779 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4ebe330c-97b9-4eee-af7b-f01da8a6562c tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:06.079070 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b59e9110-d83c-4a4e-baf6-b544083fa4f9 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:06.079751 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b59e9110-d83c-4a4e-baf6-b544083fa4f9 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:06.080240 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b59e9110-d83c-4a4e-baf6-b544083fa4f9 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:06.081015 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b59e9110-d83c-4a4e-baf6-b544083fa4f9 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:06.081567 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b59e9110-d83c-4a4e-baf6-b544083fa4f9 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:06.082043 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b59e9110-d83c-4a4e-baf6-b544083fa4f9 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:06.308543 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4ebe330c-97b9-4eee-af7b-f01da8a6562c tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:06.312568 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b59e9110-d83c-4a4e-baf6-b544083fa4f9 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:06.318492 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4ebe330c-97b9-4eee-af7b-f01da8a6562c tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/f71d8b11-c58e-493d-a03c-90d042f22218" status: 200 len: 1508 microversion: 2.1 time: 0.266758 Oct 19 03:26:06.320541 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b59e9110-d83c-4a4e-baf6-b544083fa4f9 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f" status: 200 len: 1360 microversion: 2.1 time: 0.255237 Oct 19 03:26:06.321701 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1589/3233] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:06 2022] GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f => generated 1360 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:26:06.322235 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1645/3234] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:06 2022] GET /compute/v2.1/servers/f71d8b11-c58e-493d-a03c-90d042f22218 => generated 1508 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:26:06.341999 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f7ee9cad-7bca-4e44-a370-426693e748b8 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:06.342718 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f7ee9cad-7bca-4e44-a370-426693e748b8 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: f71d8b11-c58e-493d-a03c-90d042f22218] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:06.349001 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f7ee9cad-7bca-4e44-a370-426693e748b8 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:06.349717 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f7ee9cad-7bca-4e44-a370-426693e748b8 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:06.350163 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f7ee9cad-7bca-4e44-a370-426693e748b8 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:06.350868 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f7ee9cad-7bca-4e44-a370-426693e748b8 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:06.351328 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f7ee9cad-7bca-4e44-a370-426693e748b8 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:06.351794 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f7ee9cad-7bca-4e44-a370-426693e748b8 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:06.500210 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-f7ee9cad-7bca-4e44-a370-426693e748b8 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:06.509177 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f7ee9cad-7bca-4e44-a370-426693e748b8 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/f71d8b11-c58e-493d-a03c-90d042f22218" status: 200 len: 1508 microversion: 2.1 time: 0.170598 Oct 19 03:26:06.510529 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1590/3235] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:06 2022] GET /compute/v2.1/servers/f71d8b11-c58e-493d-a03c-90d042f22218 => generated 1508 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:26:06.537698 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-217571b6-42c8-4375-8df0-50ba19462252 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:06.538485 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-217571b6-42c8-4375-8df0-50ba19462252 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: f71d8b11-c58e-493d-a03c-90d042f22218] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:06.545343 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-217571b6-42c8-4375-8df0-50ba19462252 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:06.546068 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-217571b6-42c8-4375-8df0-50ba19462252 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:06.546509 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-217571b6-42c8-4375-8df0-50ba19462252 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:06.547377 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-217571b6-42c8-4375-8df0-50ba19462252 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:06.548013 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-217571b6-42c8-4375-8df0-50ba19462252 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:06.548427 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-217571b6-42c8-4375-8df0-50ba19462252 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:06.575409 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-217571b6-42c8-4375-8df0-50ba19462252 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: f71d8b11-c58e-493d-a03c-90d042f22218] Going to try to terminate instance {{(pid=121135) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:26:06.910685 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-217571b6-42c8-4375-8df0-50ba19462252 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "DELETE /compute/v2.1/servers/f71d8b11-c58e-493d-a03c-90d042f22218" status: 204 len: 0 microversion: 2.1 time: 0.375916 Oct 19 03:26:06.913186 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1646/3236] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:26:06 2022] DELETE /compute/v2.1/servers/f71d8b11-c58e-493d-a03c-90d042f22218 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:26:06.920160 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-876d7a70-881e-43ce-a84f-dd9b1e939a11 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:06.920776 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-876d7a70-881e-43ce-a84f-dd9b1e939a11 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: f71d8b11-c58e-493d-a03c-90d042f22218] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:06.927734 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-876d7a70-881e-43ce-a84f-dd9b1e939a11 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:06.928234 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-876d7a70-881e-43ce-a84f-dd9b1e939a11 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:06.928681 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-876d7a70-881e-43ce-a84f-dd9b1e939a11 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:06.929427 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-876d7a70-881e-43ce-a84f-dd9b1e939a11 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:06.930064 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-876d7a70-881e-43ce-a84f-dd9b1e939a11 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:06.931079 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-876d7a70-881e-43ce-a84f-dd9b1e939a11 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:07.082623 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9bb036c7-de66-4bb1-95f1-66488d92d822 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:07.084479 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9bb036c7-de66-4bb1-95f1-66488d92d822 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] [instance: 4adec402-e94f-4a41-ac77-68f6091b87f7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:07.096962 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9bb036c7-de66-4bb1-95f1-66488d92d822 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:07.097497 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9bb036c7-de66-4bb1-95f1-66488d92d822 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:07.097947 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9bb036c7-de66-4bb1-95f1-66488d92d822 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:07.098717 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9bb036c7-de66-4bb1-95f1-66488d92d822 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:07.099180 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9bb036c7-de66-4bb1-95f1-66488d92d822 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:07.100103 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9bb036c7-de66-4bb1-95f1-66488d92d822 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:07.202488 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-876d7a70-881e-43ce-a84f-dd9b1e939a11 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:07.213003 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-876d7a70-881e-43ce-a84f-dd9b1e939a11 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/f71d8b11-c58e-493d-a03c-90d042f22218" status: 200 len: 1514 microversion: 2.1 time: 0.296599 Oct 19 03:26:07.213633 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1591/3237] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:06 2022] GET /compute/v2.1/servers/f71d8b11-c58e-493d-a03c-90d042f22218 => generated 1514 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:26:07.234481 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7ce3a686-5b0a-4032-b49c-8a0a6eee9b23 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:07.235348 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7ce3a686-5b0a-4032-b49c-8a0a6eee9b23 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: e022fc4b-88e6-44c8-9729-7e8d25238bb3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:07.242049 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7ce3a686-5b0a-4032-b49c-8a0a6eee9b23 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:07.242780 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7ce3a686-5b0a-4032-b49c-8a0a6eee9b23 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:07.244465 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7ce3a686-5b0a-4032-b49c-8a0a6eee9b23 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:07.245563 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7ce3a686-5b0a-4032-b49c-8a0a6eee9b23 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:07.246411 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7ce3a686-5b0a-4032-b49c-8a0a6eee9b23 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:07.247004 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7ce3a686-5b0a-4032-b49c-8a0a6eee9b23 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:07.427653 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-9bb036c7-de66-4bb1-95f1-66488d92d822 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:07.442173 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-9bb036c7-de66-4bb1-95f1-66488d92d822 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:07.445086 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-9bb036c7-de66-4bb1-95f1-66488d92d822 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:07.447750 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9bb036c7-de66-4bb1-95f1-66488d92d822 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] 10.222.0.52 "GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7" status: 200 len: 2952 microversion: 2.32 time: 0.369613 Oct 19 03:26:07.449177 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1647/3238] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:26:07 2022] GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7 => generated 2952 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:26:07.455065 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-a315e91d-0228-49b9-beec-723b500984d1 req-60df0db9-c547-4cf0-a179-6bfcb21a0d48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5cc2003b-73ef-4a54-a22d-9cef47c6ed3f", "tag": "6c518d82-939f-43bb-ab5f-244d4b674bfe"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:26:07.470025 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-a315e91d-0228-49b9-beec-723b500984d1 req-60df0db9-c547-4cf0-a179-6bfcb21a0d48 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:07.470766 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-a315e91d-0228-49b9-beec-723b500984d1 req-60df0db9-c547-4cf0-a179-6bfcb21a0d48 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:07.471493 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-a315e91d-0228-49b9-beec-723b500984d1 req-60df0db9-c547-4cf0-a179-6bfcb21a0d48 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:07.474400 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-7ce3a686-5b0a-4032-b49c-8a0a6eee9b23 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:07.483592 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7ce3a686-5b0a-4032-b49c-8a0a6eee9b23 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/e022fc4b-88e6-44c8-9729-7e8d25238bb3" status: 200 len: 1308 microversion: 2.1 time: 0.252595 Oct 19 03:26:07.484355 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1592/3239] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:07 2022] GET /compute/v2.1/servers/e022fc4b-88e6-44c8-9729-7e8d25238bb3 => generated 1308 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:26:07.489467 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3d91dbb1-6240-45f6-883e-b0a8d40094cc tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:07.490253 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3d91dbb1-6240-45f6-883e-b0a8d40094cc tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 5cc2003b-73ef-4a54-a22d-9cef47c6ed3f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:07.496905 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3d91dbb1-6240-45f6-883e-b0a8d40094cc tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:07.497221 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-a315e91d-0228-49b9-beec-723b500984d1 req-60df0db9-c547-4cf0-a179-6bfcb21a0d48 service nova] Creating event network-changed:6c518d82-939f-43bb-ab5f-244d4b674bfe for instance 5cc2003b-73ef-4a54-a22d-9cef47c6ed3f on n-h2-861333-8 Oct 19 03:26:07.497829 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3d91dbb1-6240-45f6-883e-b0a8d40094cc tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:07.498436 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3d91dbb1-6240-45f6-883e-b0a8d40094cc tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:07.499298 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3d91dbb1-6240-45f6-883e-b0a8d40094cc tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:07.499903 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3d91dbb1-6240-45f6-883e-b0a8d40094cc tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:07.500481 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3d91dbb1-6240-45f6-883e-b0a8d40094cc tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:07.503554 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-a315e91d-0228-49b9-beec-723b500984d1 req-60df0db9-c547-4cf0-a179-6bfcb21a0d48 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052778 Oct 19 03:26:07.504972 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1648/3240] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:26:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:26:07.632779 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-3d91dbb1-6240-45f6-883e-b0a8d40094cc tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:07.641626 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3d91dbb1-6240-45f6-883e-b0a8d40094cc tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f" status: 200 len: 1360 microversion: 2.1 time: 0.155510 Oct 19 03:26:07.642220 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1593/3241] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:07 2022] GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f => generated 1360 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:26:08.237456 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-42906a8f-707a-4bc8-a7a4-72fa273e33d2 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:08.238155 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-42906a8f-707a-4bc8-a7a4-72fa273e33d2 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: f71d8b11-c58e-493d-a03c-90d042f22218] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:08.244775 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-42906a8f-707a-4bc8-a7a4-72fa273e33d2 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:08.245284 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-42906a8f-707a-4bc8-a7a4-72fa273e33d2 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:08.245785 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-42906a8f-707a-4bc8-a7a4-72fa273e33d2 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:08.246427 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-42906a8f-707a-4bc8-a7a4-72fa273e33d2 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:08.246880 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-42906a8f-707a-4bc8-a7a4-72fa273e33d2 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:08.247794 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-42906a8f-707a-4bc8-a7a4-72fa273e33d2 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:08.476629 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7b6748ac-b29e-41ec-9887-6798ac9a71d8 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:08.477938 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7b6748ac-b29e-41ec-9887-6798ac9a71d8 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] [instance: 4adec402-e94f-4a41-ac77-68f6091b87f7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:08.488299 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7b6748ac-b29e-41ec-9887-6798ac9a71d8 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:08.489029 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-42906a8f-707a-4bc8-a7a4-72fa273e33d2 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:08.489531 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7b6748ac-b29e-41ec-9887-6798ac9a71d8 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:08.490215 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7b6748ac-b29e-41ec-9887-6798ac9a71d8 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:08.493685 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7b6748ac-b29e-41ec-9887-6798ac9a71d8 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:08.494571 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7b6748ac-b29e-41ec-9887-6798ac9a71d8 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:08.496176 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7b6748ac-b29e-41ec-9887-6798ac9a71d8 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:08.506408 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-42906a8f-707a-4bc8-a7a4-72fa273e33d2 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/f71d8b11-c58e-493d-a03c-90d042f22218" status: 200 len: 1514 microversion: 2.1 time: 0.273309 Oct 19 03:26:08.511834 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1649/3242] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:08 2022] GET /compute/v2.1/servers/f71d8b11-c58e-493d-a03c-90d042f22218 => generated 1514 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:26:08.511834 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-edbeff7e-c275-4816-996d-1609dee606d4 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:08.512023 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-edbeff7e-c275-4816-996d-1609dee606d4 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: e022fc4b-88e6-44c8-9729-7e8d25238bb3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:08.528445 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-edbeff7e-c275-4816-996d-1609dee606d4 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:08.528932 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-edbeff7e-c275-4816-996d-1609dee606d4 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:08.529609 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-edbeff7e-c275-4816-996d-1609dee606d4 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:08.530482 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-edbeff7e-c275-4816-996d-1609dee606d4 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:08.531097 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-edbeff7e-c275-4816-996d-1609dee606d4 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:08.531716 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-edbeff7e-c275-4816-996d-1609dee606d4 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:08.532596 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:26:09.035354 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-7b6748ac-b29e-41ec-9887-6798ac9a71d8 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:09.047608 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-7b6748ac-b29e-41ec-9887-6798ac9a71d8 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:09.049314 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-7b6748ac-b29e-41ec-9887-6798ac9a71d8 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:09.050820 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7b6748ac-b29e-41ec-9887-6798ac9a71d8 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] 10.222.0.52 "GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7" status: 200 len: 2952 microversion: 2.32 time: 0.578468 Oct 19 03:26:09.066691 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1594/3243] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:26:08 2022] GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7 => generated 2952 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:26:09.076477 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-444a9940-fe08-42ba-a033-9f4cb83559d5 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:09.078889 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-444a9940-fe08-42ba-a033-9f4cb83559d5 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 5cc2003b-73ef-4a54-a22d-9cef47c6ed3f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:09.088403 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-444a9940-fe08-42ba-a033-9f4cb83559d5 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:09.088998 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-444a9940-fe08-42ba-a033-9f4cb83559d5 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:09.089842 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-444a9940-fe08-42ba-a033-9f4cb83559d5 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:09.090765 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-444a9940-fe08-42ba-a033-9f4cb83559d5 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:09.091290 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-444a9940-fe08-42ba-a033-9f4cb83559d5 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:09.091782 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-444a9940-fe08-42ba-a033-9f4cb83559d5 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:09.097734 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-edbeff7e-c275-4816-996d-1609dee606d4 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:09.108601 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-edbeff7e-c275-4816-996d-1609dee606d4 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/e022fc4b-88e6-44c8-9729-7e8d25238bb3" status: 200 len: 1308 microversion: 2.1 time: 0.599936 Oct 19 03:26:09.126928 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1650/3244] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:08 2022] GET /compute/v2.1/servers/e022fc4b-88e6-44c8-9729-7e8d25238bb3 => generated 1308 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:26:09.136384 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-18aeaa2f-867d-4eac-b90e-f51b8aaa64ae req-40217d6d-b2eb-44bd-9916-1c0297a75853 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e022fc4b-88e6-44c8-9729-7e8d25238bb3", "name": "network-vif-plugged", "status": "completed", "tag": "97a600ca-4482-476f-b559-c5e02bc3e014"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:26:09.173428 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-18aeaa2f-867d-4eac-b90e-f51b8aaa64ae req-40217d6d-b2eb-44bd-9916-1c0297a75853 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:09.176250 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-18aeaa2f-867d-4eac-b90e-f51b8aaa64ae req-40217d6d-b2eb-44bd-9916-1c0297a75853 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:09.176892 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-18aeaa2f-867d-4eac-b90e-f51b8aaa64ae req-40217d6d-b2eb-44bd-9916-1c0297a75853 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:09.194078 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-18aeaa2f-867d-4eac-b90e-f51b8aaa64ae req-40217d6d-b2eb-44bd-9916-1c0297a75853 service nova] Creating event network-vif-plugged:97a600ca-4482-476f-b559-c5e02bc3e014 for instance e022fc4b-88e6-44c8-9729-7e8d25238bb3 on n-h2-861333-8 Oct 19 03:26:09.204307 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-18aeaa2f-867d-4eac-b90e-f51b8aaa64ae req-40217d6d-b2eb-44bd-9916-1c0297a75853 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072787 Oct 19 03:26:09.204307 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1651/3245] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:26:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:26:09.373646 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-444a9940-fe08-42ba-a033-9f4cb83559d5 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:09.381347 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-444a9940-fe08-42ba-a033-9f4cb83559d5 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f" status: 200 len: 1360 microversion: 2.1 time: 0.312301 Oct 19 03:26:09.381962 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1595/3246] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:09 2022] GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f => generated 1360 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:26:09.534562 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c92a406f-d24d-4b1d-abbc-8256ac17b882 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:09.535271 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c92a406f-d24d-4b1d-abbc-8256ac17b882 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: f71d8b11-c58e-493d-a03c-90d042f22218] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:09.542724 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c92a406f-d24d-4b1d-abbc-8256ac17b882 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:09.547790 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c92a406f-d24d-4b1d-abbc-8256ac17b882 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:09.547790 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c92a406f-d24d-4b1d-abbc-8256ac17b882 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:09.547790 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c92a406f-d24d-4b1d-abbc-8256ac17b882 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:09.547790 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c92a406f-d24d-4b1d-abbc-8256ac17b882 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:09.548160 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c92a406f-d24d-4b1d-abbc-8256ac17b882 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:09.780305 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-8ad66c9c-ded1-4313-9bd8-76641a10d60b req-5559d1cd-b3fa-42eb-815b-6909c955054e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f71d8b11-c58e-493d-a03c-90d042f22218", "name": "network-vif-deleted", "tag": "01192655-dfdc-48c9-9121-e6d9fc9b8a2d"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:26:09.800020 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-8ad66c9c-ded1-4313-9bd8-76641a10d60b req-5559d1cd-b3fa-42eb-815b-6909c955054e service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:09.800510 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-8ad66c9c-ded1-4313-9bd8-76641a10d60b req-5559d1cd-b3fa-42eb-815b-6909c955054e service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:09.800949 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-8ad66c9c-ded1-4313-9bd8-76641a10d60b req-5559d1cd-b3fa-42eb-815b-6909c955054e service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:09.811337 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c92a406f-d24d-4b1d-abbc-8256ac17b882 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:09.820456 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c92a406f-d24d-4b1d-abbc-8256ac17b882 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/f71d8b11-c58e-493d-a03c-90d042f22218" status: 200 len: 1514 microversion: 2.1 time: 0.290644 Oct 19 03:26:09.820809 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-8ad66c9c-ded1-4313-9bd8-76641a10d60b req-5559d1cd-b3fa-42eb-815b-6909c955054e service nova] Creating event network-vif-deleted:01192655-dfdc-48c9-9121-e6d9fc9b8a2d for instance f71d8b11-c58e-493d-a03c-90d042f22218 on n-h2-861333-8 Oct 19 03:26:09.833652 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1652/3247] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:09 2022] GET /compute/v2.1/servers/f71d8b11-c58e-493d-a03c-90d042f22218 => generated 1514 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:26:09.835612 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-8ad66c9c-ded1-4313-9bd8-76641a10d60b req-5559d1cd-b3fa-42eb-815b-6909c955054e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058461 Oct 19 03:26:09.836770 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1596/3248] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:26:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:26:10.079709 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a53ad575-3cbb-4160-aab7-08d82b09152b tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:10.080321 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a53ad575-3cbb-4160-aab7-08d82b09152b tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] [instance: 4adec402-e94f-4a41-ac77-68f6091b87f7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:10.087419 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a53ad575-3cbb-4160-aab7-08d82b09152b tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:10.087936 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a53ad575-3cbb-4160-aab7-08d82b09152b tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:10.088371 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a53ad575-3cbb-4160-aab7-08d82b09152b tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:10.089478 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a53ad575-3cbb-4160-aab7-08d82b09152b tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:10.090357 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a53ad575-3cbb-4160-aab7-08d82b09152b tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:10.090357 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a53ad575-3cbb-4160-aab7-08d82b09152b tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:10.139628 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-099f6b4e-1184-4054-8e7d-76c8418f08ad tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:10.141680 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-099f6b4e-1184-4054-8e7d-76c8418f08ad tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: e022fc4b-88e6-44c8-9729-7e8d25238bb3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:10.152354 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-099f6b4e-1184-4054-8e7d-76c8418f08ad tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:10.155513 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-099f6b4e-1184-4054-8e7d-76c8418f08ad tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:10.155513 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-099f6b4e-1184-4054-8e7d-76c8418f08ad tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:10.155513 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-099f6b4e-1184-4054-8e7d-76c8418f08ad tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:10.155513 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-099f6b4e-1184-4054-8e7d-76c8418f08ad tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:10.157246 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-099f6b4e-1184-4054-8e7d-76c8418f08ad tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:10.524844 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a53ad575-3cbb-4160-aab7-08d82b09152b tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:10.528520 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:26:10.535447 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a53ad575-3cbb-4160-aab7-08d82b09152b tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:10.542842 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a53ad575-3cbb-4160-aab7-08d82b09152b tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:10.563892 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a53ad575-3cbb-4160-aab7-08d82b09152b tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] 10.222.0.52 "GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7" status: 200 len: 2931 microversion: 2.32 time: 0.485757 Oct 19 03:26:10.565942 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1653/3249] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:26:10 2022] GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7 => generated 2931 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:26:10.572666 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7de85d81-cc46-460e-b5b0-c4864977d993 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:10.573918 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7de85d81-cc46-460e-b5b0-c4864977d993 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 5cc2003b-73ef-4a54-a22d-9cef47c6ed3f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:10.585504 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7de85d81-cc46-460e-b5b0-c4864977d993 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:10.587639 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7de85d81-cc46-460e-b5b0-c4864977d993 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:10.588090 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7de85d81-cc46-460e-b5b0-c4864977d993 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:10.588818 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7de85d81-cc46-460e-b5b0-c4864977d993 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:10.589280 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7de85d81-cc46-460e-b5b0-c4864977d993 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:10.589749 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7de85d81-cc46-460e-b5b0-c4864977d993 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:10.651290 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-099f6b4e-1184-4054-8e7d-76c8418f08ad tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:10.663667 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-099f6b4e-1184-4054-8e7d-76c8418f08ad tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/e022fc4b-88e6-44c8-9729-7e8d25238bb3" status: 200 len: 1308 microversion: 2.1 time: 0.532317 Oct 19 03:26:10.670643 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1597/3250] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:10 2022] GET /compute/v2.1/servers/e022fc4b-88e6-44c8-9729-7e8d25238bb3 => generated 1308 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:26:10.850493 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4de90f1d-f213-4c3e-9df2-51f8a4efcf87 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:10.852655 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4de90f1d-f213-4c3e-9df2-51f8a4efcf87 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: f71d8b11-c58e-493d-a03c-90d042f22218] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:10.866206 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4de90f1d-f213-4c3e-9df2-51f8a4efcf87 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:10.866957 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4de90f1d-f213-4c3e-9df2-51f8a4efcf87 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:10.867980 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4de90f1d-f213-4c3e-9df2-51f8a4efcf87 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:10.869003 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4de90f1d-f213-4c3e-9df2-51f8a4efcf87 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:10.869642 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4de90f1d-f213-4c3e-9df2-51f8a4efcf87 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:10.871005 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4de90f1d-f213-4c3e-9df2-51f8a4efcf87 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:10.923090 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4de90f1d-f213-4c3e-9df2-51f8a4efcf87 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:10.924591 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4de90f1d-f213-4c3e-9df2-51f8a4efcf87 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:10.928322 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4de90f1d-f213-4c3e-9df2-51f8a4efcf87 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:10.928322 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-4de90f1d-f213-4c3e-9df2-51f8a4efcf87 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lazy-loading 'fault' on Instance uuid f71d8b11-c58e-493d-a03c-90d042f22218 {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:26:11.005041 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-4de90f1d-f213-4c3e-9df2-51f8a4efcf87 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:11.005238 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7de85d81-cc46-460e-b5b0-c4864977d993 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:11.016875 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7de85d81-cc46-460e-b5b0-c4864977d993 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f" status: 200 len: 1360 microversion: 2.1 time: 0.449584 Oct 19 03:26:11.018691 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1654/3251] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:10 2022] GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f => generated 1360 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:26:11.023080 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4de90f1d-f213-4c3e-9df2-51f8a4efcf87 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/f71d8b11-c58e-493d-a03c-90d042f22218" status: 200 len: 1317 microversion: 2.1 time: 0.179392 Oct 19 03:26:11.026253 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1598/3252] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:10 2022] GET /compute/v2.1/servers/f71d8b11-c58e-493d-a03c-90d042f22218 => generated 1317 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:26:11.228524 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-3e836bbb-6eee-44fc-bf2d-4a12135ec5bd req-ae38343e-0c03-4960-bbc2-f93504e9506f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4adec402-e94f-4a41-ac77-68f6091b87f7", "name": "network-vif-unplugged", "status": "completed", "tag": "66f823f7-1df0-47b2-bcc5-7f5bb365d0f5"}, {"server_uuid": "4adec402-e94f-4a41-ac77-68f6091b87f7", "name": "network-vif-unplugged", "status": "completed", "tag": "e6dbfbc8-417d-4e7e-a4c5-055b2fa99fdc"}, {"server_uuid": "4adec402-e94f-4a41-ac77-68f6091b87f7", "name": "network-vif-unplugged", "status": "completed", "tag": "1b205325-d228-42ec-97ef-c076cae51f44"}, {"server_uuid": "4adec402-e94f-4a41-ac77-68f6091b87f7", "name": "network-vif-unplugged", "status": "completed", "tag": "e74674bb-2d45-441f-a59b-6f6bc5ac59f5"}, {"server_uuid": "4adec402-e94f-4a41-ac77-68f6091b87f7", "name": "network-vif-unplugged", "status": "completed", "tag": "0c443dcd-8e48-4b36-9300-0450bbd1b333"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:26:11.254933 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-3e836bbb-6eee-44fc-bf2d-4a12135ec5bd req-ae38343e-0c03-4960-bbc2-f93504e9506f service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:11.255338 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-3e836bbb-6eee-44fc-bf2d-4a12135ec5bd req-ae38343e-0c03-4960-bbc2-f93504e9506f service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:11.255961 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-3e836bbb-6eee-44fc-bf2d-4a12135ec5bd req-ae38343e-0c03-4960-bbc2-f93504e9506f service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:11.291899 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-3e836bbb-6eee-44fc-bf2d-4a12135ec5bd req-ae38343e-0c03-4960-bbc2-f93504e9506f service nova] Creating event network-vif-unplugged:66f823f7-1df0-47b2-bcc5-7f5bb365d0f5 for instance 4adec402-e94f-4a41-ac77-68f6091b87f7 on n-h2-861333-8 Oct 19 03:26:11.292915 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-3e836bbb-6eee-44fc-bf2d-4a12135ec5bd req-ae38343e-0c03-4960-bbc2-f93504e9506f service nova] Creating event network-vif-unplugged:e6dbfbc8-417d-4e7e-a4c5-055b2fa99fdc for instance 4adec402-e94f-4a41-ac77-68f6091b87f7 on n-h2-861333-8 Oct 19 03:26:11.293672 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-3e836bbb-6eee-44fc-bf2d-4a12135ec5bd req-ae38343e-0c03-4960-bbc2-f93504e9506f service nova] Creating event network-vif-unplugged:1b205325-d228-42ec-97ef-c076cae51f44 for instance 4adec402-e94f-4a41-ac77-68f6091b87f7 on n-h2-861333-8 Oct 19 03:26:11.294655 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-3e836bbb-6eee-44fc-bf2d-4a12135ec5bd req-ae38343e-0c03-4960-bbc2-f93504e9506f service nova] Creating event network-vif-unplugged:e74674bb-2d45-441f-a59b-6f6bc5ac59f5 for instance 4adec402-e94f-4a41-ac77-68f6091b87f7 on n-h2-861333-8 Oct 19 03:26:11.295317 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-3e836bbb-6eee-44fc-bf2d-4a12135ec5bd req-ae38343e-0c03-4960-bbc2-f93504e9506f service nova] Creating event network-vif-unplugged:0c443dcd-8e48-4b36-9300-0450bbd1b333 for instance 4adec402-e94f-4a41-ac77-68f6091b87f7 on n-h2-861333-8 Oct 19 03:26:11.308057 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-3e836bbb-6eee-44fc-bf2d-4a12135ec5bd req-ae38343e-0c03-4960-bbc2-f93504e9506f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 877 microversion: 2.1 time: 0.082959 Oct 19 03:26:11.308057 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1655/3253] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:26:11 2022] POST /compute/v2.1/os-server-external-events => generated 877 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:26:11.596114 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2d9f04af-3f36-4d19-bd10-f3d62bd5261f tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:11.596901 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2d9f04af-3f36-4d19-bd10-f3d62bd5261f tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] [instance: 4adec402-e94f-4a41-ac77-68f6091b87f7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:11.603687 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2d9f04af-3f36-4d19-bd10-f3d62bd5261f tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:11.604337 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2d9f04af-3f36-4d19-bd10-f3d62bd5261f tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:11.604885 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2d9f04af-3f36-4d19-bd10-f3d62bd5261f tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:11.605748 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2d9f04af-3f36-4d19-bd10-f3d62bd5261f tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:11.606313 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2d9f04af-3f36-4d19-bd10-f3d62bd5261f tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:11.606854 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2d9f04af-3f36-4d19-bd10-f3d62bd5261f tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:11.697195 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5cb5b4ef-b2a1-4214-b2c1-e4da71e960b2 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:11.698478 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-5cb5b4ef-b2a1-4214-b2c1-e4da71e960b2 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: e022fc4b-88e6-44c8-9729-7e8d25238bb3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:11.705967 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5cb5b4ef-b2a1-4214-b2c1-e4da71e960b2 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:11.706682 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5cb5b4ef-b2a1-4214-b2c1-e4da71e960b2 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:11.707291 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5cb5b4ef-b2a1-4214-b2c1-e4da71e960b2 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:11.708188 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5cb5b4ef-b2a1-4214-b2c1-e4da71e960b2 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:11.708806 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5cb5b4ef-b2a1-4214-b2c1-e4da71e960b2 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:11.709418 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5cb5b4ef-b2a1-4214-b2c1-e4da71e960b2 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:12.038223 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-2d9f04af-3f36-4d19-bd10-f3d62bd5261f tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:12.049908 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-2d9f04af-3f36-4d19-bd10-f3d62bd5261f tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:12.051420 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-2d9f04af-3f36-4d19-bd10-f3d62bd5261f tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:12.052796 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2d9f04af-3f36-4d19-bd10-f3d62bd5261f tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] 10.222.0.52 "GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7" status: 200 len: 2910 microversion: 2.32 time: 0.461025 Oct 19 03:26:12.053596 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1599/3254] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:26:11 2022] GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7 => generated 2910 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:26:12.061046 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-288a7c66-4dfe-4991-b354-b27e37f8fa4d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:12.061706 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-288a7c66-4dfe-4991-b354-b27e37f8fa4d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 5cc2003b-73ef-4a54-a22d-9cef47c6ed3f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:12.067827 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-288a7c66-4dfe-4991-b354-b27e37f8fa4d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:12.068319 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-288a7c66-4dfe-4991-b354-b27e37f8fa4d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:12.068929 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-288a7c66-4dfe-4991-b354-b27e37f8fa4d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:12.069812 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-288a7c66-4dfe-4991-b354-b27e37f8fa4d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:12.070441 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-288a7c66-4dfe-4991-b354-b27e37f8fa4d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:12.071647 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-288a7c66-4dfe-4991-b354-b27e37f8fa4d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:12.160402 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-5cb5b4ef-b2a1-4214-b2c1-e4da71e960b2 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:12.168528 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5cb5b4ef-b2a1-4214-b2c1-e4da71e960b2 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/e022fc4b-88e6-44c8-9729-7e8d25238bb3" status: 200 len: 1308 microversion: 2.1 time: 0.476107 Oct 19 03:26:12.169202 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1656/3255] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:11 2022] GET /compute/v2.1/servers/e022fc4b-88e6-44c8-9729-7e8d25238bb3 => generated 1308 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:26:12.181620 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0b04ea7e-fe10-4cea-9160-ef8544b90578 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:12.181620 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0b04ea7e-fe10-4cea-9160-ef8544b90578 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: f71d8b11-c58e-493d-a03c-90d042f22218] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:12.181620 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0b04ea7e-fe10-4cea-9160-ef8544b90578 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:12.181915 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0b04ea7e-fe10-4cea-9160-ef8544b90578 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:12.185052 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0b04ea7e-fe10-4cea-9160-ef8544b90578 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:12.185052 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0b04ea7e-fe10-4cea-9160-ef8544b90578 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:12.185052 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0b04ea7e-fe10-4cea-9160-ef8544b90578 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:12.185052 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0b04ea7e-fe10-4cea-9160-ef8544b90578 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:12.216743 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0b04ea7e-fe10-4cea-9160-ef8544b90578 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:12.217231 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0b04ea7e-fe10-4cea-9160-ef8544b90578 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:12.217768 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0b04ea7e-fe10-4cea-9160-ef8544b90578 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:12.218222 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-0b04ea7e-fe10-4cea-9160-ef8544b90578 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lazy-loading 'fault' on Instance uuid f71d8b11-c58e-493d-a03c-90d042f22218 {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:26:12.286659 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-0b04ea7e-fe10-4cea-9160-ef8544b90578 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:12.295270 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0b04ea7e-fe10-4cea-9160-ef8544b90578 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/f71d8b11-c58e-493d-a03c-90d042f22218" status: 200 len: 1317 microversion: 2.1 time: 0.124887 Oct 19 03:26:12.296088 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1657/3256] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:12 2022] GET /compute/v2.1/servers/f71d8b11-c58e-493d-a03c-90d042f22218 => generated 1317 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:26:12.358476 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-288a7c66-4dfe-4991-b354-b27e37f8fa4d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:12.366488 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-288a7c66-4dfe-4991-b354-b27e37f8fa4d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f" status: 200 len: 1360 microversion: 2.1 time: 0.311793 Oct 19 03:26:12.367093 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1600/3257] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:12 2022] GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f => generated 1360 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:26:12.519034 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-1c51b168-4a81-4adf-9e69-a4f4e16c13bc req-29982807-575d-4848-b26f-8d3290db4914 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4adec402-e94f-4a41-ac77-68f6091b87f7", "name": "network-vif-deleted", "tag": "1b205325-d228-42ec-97ef-c076cae51f44"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:26:12.529237 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-1c51b168-4a81-4adf-9e69-a4f4e16c13bc req-29982807-575d-4848-b26f-8d3290db4914 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:12.529889 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-1c51b168-4a81-4adf-9e69-a4f4e16c13bc req-29982807-575d-4848-b26f-8d3290db4914 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:12.530334 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-1c51b168-4a81-4adf-9e69-a4f4e16c13bc req-29982807-575d-4848-b26f-8d3290db4914 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:12.547063 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-1c51b168-4a81-4adf-9e69-a4f4e16c13bc req-29982807-575d-4848-b26f-8d3290db4914 service nova] Creating event network-vif-deleted:1b205325-d228-42ec-97ef-c076cae51f44 for instance 4adec402-e94f-4a41-ac77-68f6091b87f7 on n-h2-861333-8 Oct 19 03:26:12.548815 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-1c51b168-4a81-4adf-9e69-a4f4e16c13bc req-29982807-575d-4848-b26f-8d3290db4914 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034447 Oct 19 03:26:12.549722 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1658/3258] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:26:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:26:13.088415 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7697d8ac-9eb7-4fa0-b5e5-0da1b9e2e1f2 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:13.088980 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7697d8ac-9eb7-4fa0-b5e5-0da1b9e2e1f2 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] [instance: 4adec402-e94f-4a41-ac77-68f6091b87f7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:13.096511 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7697d8ac-9eb7-4fa0-b5e5-0da1b9e2e1f2 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:13.097339 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7697d8ac-9eb7-4fa0-b5e5-0da1b9e2e1f2 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:13.097970 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7697d8ac-9eb7-4fa0-b5e5-0da1b9e2e1f2 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:13.098681 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7697d8ac-9eb7-4fa0-b5e5-0da1b9e2e1f2 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:13.099132 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7697d8ac-9eb7-4fa0-b5e5-0da1b9e2e1f2 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:13.099745 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7697d8ac-9eb7-4fa0-b5e5-0da1b9e2e1f2 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:13.194028 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b66f97d2-e973-4654-ab19-81454e3044de tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:13.194811 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b66f97d2-e973-4654-ab19-81454e3044de tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: e022fc4b-88e6-44c8-9729-7e8d25238bb3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:13.202521 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b66f97d2-e973-4654-ab19-81454e3044de tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:13.203044 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b66f97d2-e973-4654-ab19-81454e3044de tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:13.203717 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b66f97d2-e973-4654-ab19-81454e3044de tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:13.204499 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b66f97d2-e973-4654-ab19-81454e3044de tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:13.204957 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b66f97d2-e973-4654-ab19-81454e3044de tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:13.205593 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b66f97d2-e973-4654-ab19-81454e3044de tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:13.369977 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-7697d8ac-9eb7-4fa0-b5e5-0da1b9e2e1f2 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:13.380869 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-7697d8ac-9eb7-4fa0-b5e5-0da1b9e2e1f2 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:13.382727 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-7697d8ac-9eb7-4fa0-b5e5-0da1b9e2e1f2 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:13.409765 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7697d8ac-9eb7-4fa0-b5e5-0da1b9e2e1f2 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] 10.222.0.52 "GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7" status: 200 len: 2750 microversion: 2.32 time: 0.326213 Oct 19 03:26:13.423051 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1601/3259] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:26:13 2022] GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7 => generated 2750 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:26:13.443489 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-45d9b798-8d3f-420b-a30c-8c71aa7c7f18 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:13.446253 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-45d9b798-8d3f-420b-a30c-8c71aa7c7f18 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: f71d8b11-c58e-493d-a03c-90d042f22218] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:13.454169 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-45d9b798-8d3f-420b-a30c-8c71aa7c7f18 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:13.455124 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-45d9b798-8d3f-420b-a30c-8c71aa7c7f18 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:13.455860 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-45d9b798-8d3f-420b-a30c-8c71aa7c7f18 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:13.456798 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-45d9b798-8d3f-420b-a30c-8c71aa7c7f18 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:13.457513 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-45d9b798-8d3f-420b-a30c-8c71aa7c7f18 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:13.458154 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-45d9b798-8d3f-420b-a30c-8c71aa7c7f18 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:13.479372 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-45d9b798-8d3f-420b-a30c-8c71aa7c7f18 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] HTTP exception thrown: Instance f71d8b11-c58e-493d-a03c-90d042f22218 could not be found. Oct 19 03:26:13.481415 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-45d9b798-8d3f-420b-a30c-8c71aa7c7f18 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Request method failure captured: Oct 19 03:26:13.481415 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/f71d8b11-c58e-493d-a03c-90d042f22218 HTTP/1.1 Oct 19 03:26:13.481415 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:26:13.481415 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:26:13.481415 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:26:13.481415 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:26:13.481415 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:26:13.481415 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:26:13.481415 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:26:13.481415 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:26:13.481415 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT236feAW7aGPVoj9kEkUuQkRB8Nm9YBd70D85XbXnYqUAmlwAIPPx50C6dTRY9MbtBVt7IleIPYf6veKmIP1JclrFv3Px4uu5w7tRxEjRIxVTymsVviR-8HO1OxRuIfq2VSbST57MCBZOLAwnCIkIbO3ZT-DhhWvyFTRPdgvgRqqxa8 Oct 19 03:26:13.481415 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:26:13.481415 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:26:13.481415 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:26:13.481415 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:26:13.481415 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:26:13.481415 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:26:13.481415 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 7a836a10033546ed9a73a4f463587d72 Oct 19 03:26:13.481415 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ServersTestJSON-490256660 Oct 19 03:26:13.481415 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:26:13.481415 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:26:13.482774 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7a836a10033546ed9a73a4f463587d72"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7a836a10033546ed9a73a4f463587d72"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7a836a10033546ed9a73a4f463587d72"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7a836a10033546ed9a73a4f463587d72", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:26:13.482774 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ServersTestJSON-490256660 Oct 19 03:26:13.482774 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 7a836a10033546ed9a73a4f463587d72 Oct 19 03:26:13.482774 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ServersTestJSON-490256660 Oct 19 03:26:13.482774 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ServersTestJSON-490256660-project Oct 19 03:26:13.482774 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:26:13.482774 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:26:13.482774 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: b09d2eecd3d9419189e6308379fa8a09 Oct 19 03:26:13.482774 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ServersTestJSON-490256660-project Oct 19 03:26:13.482774 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:26:13.482774 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance f71d8b11-c58e-493d-a03c-90d042f22218 could not be found. Oct 19 03:26:13.482774 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': 'f71d8b11-c58e-493d-a03c-90d042f22218'} Oct 19 03:26:13.483511 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:26:13.483511 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:26:13.483511 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:26:13.483511 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:26:13.483511 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:26:13.483511 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:26:13.483511 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:26:13.483511 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:26:13.483511 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:26:13.483511 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:26:13.483511 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f71d8b11-c58e-493d-a03c-90d042f22218 could not be found. Oct 19 03:26:13.483511 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:26:13.483511 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:26:13.483511 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:26:13.483511 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:26:13.483511 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:26:13.483511 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:26:13.483511 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:26:13.483511 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:26:13.483511 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:26:13.484682 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:26:13.484682 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:26:13.484682 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:26:13.484682 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:26:13.484682 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:26:13.484682 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:26:13.484682 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:26:13.484682 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f71d8b11-c58e-493d-a03c-90d042f22218 could not be found. Oct 19 03:26:13.484682 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:26:13.484682 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:26:13.484682 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:26:13.484682 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:26:13.484682 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:26:13.484682 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:26:13.484682 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:26:13.484682 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:26:13.484682 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f71d8b11-c58e-493d-a03c-90d042f22218 could not be found. Oct 19 03:26:13.484682 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:26:13.487441 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-45d9b798-8d3f-420b-a30c-8c71aa7c7f18 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Returning 404 to user: Instance f71d8b11-c58e-493d-a03c-90d042f22218 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:26:13.488438 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-45d9b798-8d3f-420b-a30c-8c71aa7c7f18 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/f71d8b11-c58e-493d-a03c-90d042f22218" status: 404 len: 111 microversion: 2.1 time: 0.064189 Oct 19 03:26:13.489637 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1602/3260] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:13 2022] GET /compute/v2.1/servers/f71d8b11-c58e-493d-a03c-90d042f22218 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:26:13.494615 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-262dc134-6aff-4bec-85bf-dd2e2d1da0a0 req-1c3bfb20-f68d-4605-ba30-94c195b63758 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cc2003b-73ef-4a54-a22d-9cef47c6ed3f", "name": "network-vif-plugged", "status": "completed", "tag": "6c518d82-939f-43bb-ab5f-244d4b674bfe"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:26:13.500486 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:26:13.507549 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b66f97d2-e973-4654-ab19-81454e3044de tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:13.508997 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-262dc134-6aff-4bec-85bf-dd2e2d1da0a0 req-1c3bfb20-f68d-4605-ba30-94c195b63758 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:13.509695 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-262dc134-6aff-4bec-85bf-dd2e2d1da0a0 req-1c3bfb20-f68d-4605-ba30-94c195b63758 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:13.512464 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-262dc134-6aff-4bec-85bf-dd2e2d1da0a0 req-1c3bfb20-f68d-4605-ba30-94c195b63758 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:13.519784 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b66f97d2-e973-4654-ab19-81454e3044de tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/e022fc4b-88e6-44c8-9729-7e8d25238bb3" status: 200 len: 1488 microversion: 2.1 time: 0.330088 Oct 19 03:26:13.520377 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1659/3261] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:13 2022] GET /compute/v2.1/servers/e022fc4b-88e6-44c8-9729-7e8d25238bb3 => generated 1488 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:26:13.529771 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-262dc134-6aff-4bec-85bf-dd2e2d1da0a0 req-1c3bfb20-f68d-4605-ba30-94c195b63758 service nova] Creating event network-vif-plugged:6c518d82-939f-43bb-ab5f-244d4b674bfe for instance 5cc2003b-73ef-4a54-a22d-9cef47c6ed3f on n-h2-861333-8 Oct 19 03:26:13.531301 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-262dc134-6aff-4bec-85bf-dd2e2d1da0a0 req-1c3bfb20-f68d-4605-ba30-94c195b63758 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040450 Oct 19 03:26:13.532480 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1603/3262] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:26:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:26:13.539883 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0ec48d11-d8b0-44c2-ada8-843664abfc7d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:13.540909 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0ec48d11-d8b0-44c2-ada8-843664abfc7d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 5cc2003b-73ef-4a54-a22d-9cef47c6ed3f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:13.549998 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4e68b5bd-5a97-4f02-8cd9-7ab73c1a0ead tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '.version_select at 0x7fc135164dc0>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:13.558313 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0ec48d11-d8b0-44c2-ada8-843664abfc7d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:13.558956 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0ec48d11-d8b0-44c2-ada8-843664abfc7d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:13.559522 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0ec48d11-d8b0-44c2-ada8-843664abfc7d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:13.560330 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0ec48d11-d8b0-44c2-ada8-843664abfc7d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:13.560889 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0ec48d11-d8b0-44c2-ada8-843664abfc7d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:13.561456 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0ec48d11-d8b0-44c2-ada8-843664abfc7d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:13.653789 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4e68b5bd-5a97-4f02-8cd9-7ab73c1a0ead tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-key-436191766" status: 202 len: 0 microversion: 2.1 time: 0.118391 Oct 19 03:26:13.655231 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1660/3263] 10.222.0.52 () {58 vars in 1206 bytes} [Wed Oct 19 03:26:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-436191766 => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:26:13.660734 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a3022598-5aec-450b-b67b-9633307ef626 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:13.662171 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a3022598-5aec-450b-b67b-9633307ef626 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: e022fc4b-88e6-44c8-9729-7e8d25238bb3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:13.670302 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a3022598-5aec-450b-b67b-9633307ef626 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:13.670798 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a3022598-5aec-450b-b67b-9633307ef626 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:13.671237 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a3022598-5aec-450b-b67b-9633307ef626 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:13.671966 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a3022598-5aec-450b-b67b-9633307ef626 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:13.672799 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a3022598-5aec-450b-b67b-9633307ef626 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:13.673260 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a3022598-5aec-450b-b67b-9633307ef626 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:13.741194 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a3022598-5aec-450b-b67b-9633307ef626 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: e022fc4b-88e6-44c8-9729-7e8d25238bb3] Going to try to terminate instance {{(pid=121135) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:26:13.956299 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0ec48d11-d8b0-44c2-ada8-843664abfc7d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:13.968625 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0ec48d11-d8b0-44c2-ada8-843664abfc7d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f" status: 200 len: 1360 microversion: 2.1 time: 0.434383 Oct 19 03:26:13.983828 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1604/3264] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:13 2022] GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f => generated 1360 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:26:13.983828 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e2cf65e4-68cc-4675-9489-6796d289cbc3 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-145055963", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "networks": [{"uuid": "05216dbc-056d-4707-86fe-afea9c8b3e8d"}]}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:26:14.092489 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-e2cf65e4-68cc-4675-9489-6796d289cbc3 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] validate_networks() for [('05216dbc-056d-4707-86fe-afea9c8b3e8d', None, None, None, None, None)] {{(pid=121134) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:26:14.228187 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a3022598-5aec-450b-b67b-9633307ef626 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "DELETE /compute/v2.1/servers/e022fc4b-88e6-44c8-9729-7e8d25238bb3" status: 204 len: 0 microversion: 2.1 time: 0.569488 Oct 19 03:26:14.228187 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1661/3265] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:26:13 2022] DELETE /compute/v2.1/servers/e022fc4b-88e6-44c8-9729-7e8d25238bb3 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:26:14.235755 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4f315d97-5cbf-4a05-a521-767455a9c235 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:14.236708 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4f315d97-5cbf-4a05-a521-767455a9c235 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: e022fc4b-88e6-44c8-9729-7e8d25238bb3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:14.248588 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4f315d97-5cbf-4a05-a521-767455a9c235 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:14.251292 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4f315d97-5cbf-4a05-a521-767455a9c235 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:14.251292 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4f315d97-5cbf-4a05-a521-767455a9c235 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:14.251292 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4f315d97-5cbf-4a05-a521-767455a9c235 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:14.251896 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4f315d97-5cbf-4a05-a521-767455a9c235 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:14.252489 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4f315d97-5cbf-4a05-a521-767455a9c235 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:14.574174 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4f315d97-5cbf-4a05-a521-767455a9c235 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:14.582132 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4f315d97-5cbf-4a05-a521-767455a9c235 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/e022fc4b-88e6-44c8-9729-7e8d25238bb3" status: 200 len: 1494 microversion: 2.1 time: 0.350774 Oct 19 03:26:14.582712 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1662/3266] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:14 2022] GET /compute/v2.1/servers/e022fc4b-88e6-44c8-9729-7e8d25238bb3 => generated 1494 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:26:14.588360 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-32ecfd5c-dab0-40da-84ba-373237dc4f00 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:14.588972 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-32ecfd5c-dab0-40da-84ba-373237dc4f00 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] [instance: 4adec402-e94f-4a41-ac77-68f6091b87f7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:14.597355 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-32ecfd5c-dab0-40da-84ba-373237dc4f00 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:14.598938 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-32ecfd5c-dab0-40da-84ba-373237dc4f00 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:14.599378 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-32ecfd5c-dab0-40da-84ba-373237dc4f00 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:14.600078 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-32ecfd5c-dab0-40da-84ba-373237dc4f00 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:14.600531 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-32ecfd5c-dab0-40da-84ba-373237dc4f00 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:14.600958 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-32ecfd5c-dab0-40da-84ba-373237dc4f00 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:14.866082 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-e2cf65e4-68cc-4675-9489-6796d289cbc3 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Flavor limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:26:14.866892 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-e2cf65e4-68cc-4675-9489-6796d289cbc3 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Image limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:26:14.868229 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-e2cf65e4-68cc-4675-9489-6796d289cbc3 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Flavor pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:26:14.869024 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-e2cf65e4-68cc-4675-9489-6796d289cbc3 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Image pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:26:14.870321 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-e2cf65e4-68cc-4675-9489-6796d289cbc3 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:26:14.888622 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e2cf65e4-68cc-4675-9489-6796d289cbc3 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:14.889971 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-32ecfd5c-dab0-40da-84ba-373237dc4f00 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:14.890555 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e2cf65e4-68cc-4675-9489-6796d289cbc3 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:14.891234 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e2cf65e4-68cc-4675-9489-6796d289cbc3 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:14.892468 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e2cf65e4-68cc-4675-9489-6796d289cbc3 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:14.893549 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e2cf65e4-68cc-4675-9489-6796d289cbc3 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:14.894341 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e2cf65e4-68cc-4675-9489-6796d289cbc3 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:14.901214 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-32ecfd5c-dab0-40da-84ba-373237dc4f00 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:14.903190 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-32ecfd5c-dab0-40da-84ba-373237dc4f00 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:14.908378 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-32ecfd5c-dab0-40da-84ba-373237dc4f00 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] 10.222.0.52 "GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7" status: 200 len: 2658 microversion: 2.32 time: 0.324415 Oct 19 03:26:14.919037 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1663/3267] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:26:14 2022] GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7 => generated 2658 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:26:14.925823 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-e2cf65e4-68cc-4675-9489-6796d289cbc3 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Getting quotas for project 7a836a10033546ed9a73a4f463587d72. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:26:14.931162 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-6d14752e-082e-45c8-9ee1-af0861e14d23 req-5123a169-eac1-4b89-ae68-ade90f1700f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4adec402-e94f-4a41-ac77-68f6091b87f7", "name": "network-vif-deleted", "tag": "e6dbfbc8-417d-4e7e-a4c5-055b2fa99fdc"}, {"server_uuid": "4adec402-e94f-4a41-ac77-68f6091b87f7", "name": "network-vif-deleted", "tag": "0c443dcd-8e48-4b36-9300-0450bbd1b333"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:26:14.934984 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-e2cf65e4-68cc-4675-9489-6796d289cbc3 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Getting quotas for user b09d2eecd3d9419189e6308379fa8a09 and project 7a836a10033546ed9a73a4f463587d72. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:26:14.941604 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-6d14752e-082e-45c8-9ee1-af0861e14d23 req-5123a169-eac1-4b89-ae68-ade90f1700f0 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:14.942355 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-6d14752e-082e-45c8-9ee1-af0861e14d23 req-5123a169-eac1-4b89-ae68-ade90f1700f0 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:14.943060 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-6d14752e-082e-45c8-9ee1-af0861e14d23 req-5123a169-eac1-4b89-ae68-ade90f1700f0 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:14.955581 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e2cf65e4-68cc-4675-9489-6796d289cbc3 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Going to run 1 instances... {{(pid=121134) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:26:14.957610 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-6d14752e-082e-45c8-9ee1-af0861e14d23 req-5123a169-eac1-4b89-ae68-ade90f1700f0 service nova] Creating event network-vif-deleted:e6dbfbc8-417d-4e7e-a4c5-055b2fa99fdc for instance 4adec402-e94f-4a41-ac77-68f6091b87f7 on n-h2-861333-8 Oct 19 03:26:14.958435 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-6d14752e-082e-45c8-9ee1-af0861e14d23 req-5123a169-eac1-4b89-ae68-ade90f1700f0 service nova] Creating event network-vif-deleted:0c443dcd-8e48-4b36-9300-0450bbd1b333 for instance 4adec402-e94f-4a41-ac77-68f6091b87f7 on n-h2-861333-8 Oct 19 03:26:14.958588 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e2cf65e4-68cc-4675-9489-6796d289cbc3 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 58aea4eb-a319-4bdc-99f2-eed095150ecb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:26:14.964642 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-6d14752e-082e-45c8-9ee1-af0861e14d23 req-5123a169-eac1-4b89-ae68-ade90f1700f0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.044258 Oct 19 03:26:14.969960 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1664/3268] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:26:14 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:26:14.991611 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-93a8915d-4ae0-4541-97fa-e2f3f8cede3c tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:14.993394 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-93a8915d-4ae0-4541-97fa-e2f3f8cede3c tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 5cc2003b-73ef-4a54-a22d-9cef47c6ed3f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:15.007576 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-93a8915d-4ae0-4541-97fa-e2f3f8cede3c tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:15.011518 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-93a8915d-4ae0-4541-97fa-e2f3f8cede3c tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:15.011518 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-93a8915d-4ae0-4541-97fa-e2f3f8cede3c tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:15.011518 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-93a8915d-4ae0-4541-97fa-e2f3f8cede3c tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:15.011518 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-93a8915d-4ae0-4541-97fa-e2f3f8cede3c tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:15.011940 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-93a8915d-4ae0-4541-97fa-e2f3f8cede3c tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:15.143389 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e2cf65e4-68cc-4675-9489-6796d289cbc3 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.168951 Oct 19 03:26:15.143966 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1605/3269] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:26:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1171 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 03:26:15.173087 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e7318e62-65b2-4132-a2e6-672fabf2ffb5 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:15.174308 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e7318e62-65b2-4132-a2e6-672fabf2ffb5 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 58aea4eb-a319-4bdc-99f2-eed095150ecb] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:15.220785 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-93a8915d-4ae0-4541-97fa-e2f3f8cede3c tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:15.236987 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e7318e62-65b2-4132-a2e6-672fabf2ffb5 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:15.238635 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-93a8915d-4ae0-4541-97fa-e2f3f8cede3c tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f" status: 200 len: 1360 microversion: 2.1 time: 0.251189 Oct 19 03:26:15.242653 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1665/3270] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:14 2022] GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f => generated 1360 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:26:15.261233 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e7318e62-65b2-4132-a2e6-672fabf2ffb5 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/58aea4eb-a319-4bdc-99f2-eed095150ecb" status: 200 len: 1208 microversion: 2.1 time: 0.103352 Oct 19 03:26:15.265658 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1606/3271] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:15 2022] GET /compute/v2.1/servers/58aea4eb-a319-4bdc-99f2-eed095150ecb => generated 1208 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:26:15.607434 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d6b7b36f-724a-4453-80ad-6d24ec2c8c99 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:15.608252 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d6b7b36f-724a-4453-80ad-6d24ec2c8c99 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: e022fc4b-88e6-44c8-9729-7e8d25238bb3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:15.616432 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d6b7b36f-724a-4453-80ad-6d24ec2c8c99 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:15.616928 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d6b7b36f-724a-4453-80ad-6d24ec2c8c99 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:15.617404 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d6b7b36f-724a-4453-80ad-6d24ec2c8c99 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:15.618110 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d6b7b36f-724a-4453-80ad-6d24ec2c8c99 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:15.618576 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d6b7b36f-724a-4453-80ad-6d24ec2c8c99 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:15.619596 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d6b7b36f-724a-4453-80ad-6d24ec2c8c99 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:15.765048 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d6b7b36f-724a-4453-80ad-6d24ec2c8c99 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:15.774254 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d6b7b36f-724a-4453-80ad-6d24ec2c8c99 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/e022fc4b-88e6-44c8-9729-7e8d25238bb3" status: 200 len: 1494 microversion: 2.1 time: 0.171692 Oct 19 03:26:15.774910 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1666/3272] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:15 2022] GET /compute/v2.1/servers/e022fc4b-88e6-44c8-9729-7e8d25238bb3 => generated 1494 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:26:15.939165 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-aad5b626-85e5-44e9-9288-6d9cd7f79182 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:15.940147 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-aad5b626-85e5-44e9-9288-6d9cd7f79182 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] [instance: 4adec402-e94f-4a41-ac77-68f6091b87f7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:15.949974 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-aad5b626-85e5-44e9-9288-6d9cd7f79182 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:15.950387 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-aad5b626-85e5-44e9-9288-6d9cd7f79182 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:15.950825 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-aad5b626-85e5-44e9-9288-6d9cd7f79182 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:15.951539 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-aad5b626-85e5-44e9-9288-6d9cd7f79182 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:15.952048 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-aad5b626-85e5-44e9-9288-6d9cd7f79182 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:15.952479 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-aad5b626-85e5-44e9-9288-6d9cd7f79182 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:16.266071 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-36246bf8-b67a-4aaa-af36-6053b23e870c tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:16.266687 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-36246bf8-b67a-4aaa-af36-6053b23e870c tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 5cc2003b-73ef-4a54-a22d-9cef47c6ed3f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:16.272906 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-36246bf8-b67a-4aaa-af36-6053b23e870c tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:16.281505 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-36246bf8-b67a-4aaa-af36-6053b23e870c tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:16.282474 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-36246bf8-b67a-4aaa-af36-6053b23e870c tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:16.283414 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-36246bf8-b67a-4aaa-af36-6053b23e870c tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:16.284036 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-36246bf8-b67a-4aaa-af36-6053b23e870c tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:16.284607 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-36246bf8-b67a-4aaa-af36-6053b23e870c tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:16.374260 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-aad5b626-85e5-44e9-9288-6d9cd7f79182 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:16.392045 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-aad5b626-85e5-44e9-9288-6d9cd7f79182 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:16.405528 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-aad5b626-85e5-44e9-9288-6d9cd7f79182 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:16.405528 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-aad5b626-85e5-44e9-9288-6d9cd7f79182 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] 10.222.0.52 "GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7" status: 200 len: 2544 microversion: 2.32 time: 0.471284 Oct 19 03:26:16.405528 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1607/3273] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:26:15 2022] GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7 => generated 2544 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:26:16.409592 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a47db962-81fc-4b75-9f8b-474aba0d65ca tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:16.419487 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a47db962-81fc-4b75-9f8b-474aba0d65ca tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 58aea4eb-a319-4bdc-99f2-eed095150ecb] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:16.426219 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a47db962-81fc-4b75-9f8b-474aba0d65ca tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:16.426912 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a47db962-81fc-4b75-9f8b-474aba0d65ca tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:16.431254 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a47db962-81fc-4b75-9f8b-474aba0d65ca tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:16.437667 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a47db962-81fc-4b75-9f8b-474aba0d65ca tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:16.437667 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a47db962-81fc-4b75-9f8b-474aba0d65ca tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:16.437667 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a47db962-81fc-4b75-9f8b-474aba0d65ca tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:16.590034 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a47db962-81fc-4b75-9f8b-474aba0d65ca tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:16.603197 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a47db962-81fc-4b75-9f8b-474aba0d65ca tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/58aea4eb-a319-4bdc-99f2-eed095150ecb" status: 200 len: 1212 microversion: 2.1 time: 0.197531 Oct 19 03:26:16.605156 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1608/3274] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:16 2022] GET /compute/v2.1/servers/58aea4eb-a319-4bdc-99f2-eed095150ecb => generated 1212 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:26:16.798639 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4090a712-19cf-4ffe-9285-82ee026086b9 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:16.799594 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4090a712-19cf-4ffe-9285-82ee026086b9 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: e022fc4b-88e6-44c8-9729-7e8d25238bb3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:16.811656 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4090a712-19cf-4ffe-9285-82ee026086b9 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:16.812276 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4090a712-19cf-4ffe-9285-82ee026086b9 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:16.813667 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4090a712-19cf-4ffe-9285-82ee026086b9 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:16.818224 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4090a712-19cf-4ffe-9285-82ee026086b9 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:16.818726 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4090a712-19cf-4ffe-9285-82ee026086b9 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:16.819180 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4090a712-19cf-4ffe-9285-82ee026086b9 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:17.334946 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-36246bf8-b67a-4aaa-af36-6053b23e870c tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:17.358377 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-36246bf8-b67a-4aaa-af36-6053b23e870c tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f" status: 200 len: 1360 microversion: 2.1 time: 1.096301 Oct 19 03:26:17.360351 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1667/3275] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:16 2022] GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f => generated 1360 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:26:17.436675 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-da673c49-37fe-48ad-8798-044c46d9e237 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:17.437356 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-da673c49-37fe-48ad-8798-044c46d9e237 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] [instance: 4adec402-e94f-4a41-ac77-68f6091b87f7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:17.444709 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-da673c49-37fe-48ad-8798-044c46d9e237 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:17.446432 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-da673c49-37fe-48ad-8798-044c46d9e237 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:17.447135 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-da673c49-37fe-48ad-8798-044c46d9e237 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:17.448398 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-da673c49-37fe-48ad-8798-044c46d9e237 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:17.449088 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-da673c49-37fe-48ad-8798-044c46d9e237 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:17.449846 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-da673c49-37fe-48ad-8798-044c46d9e237 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:17.659082 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-4090a712-19cf-4ffe-9285-82ee026086b9 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:17.668291 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4090a712-19cf-4ffe-9285-82ee026086b9 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/e022fc4b-88e6-44c8-9729-7e8d25238bb3" status: 200 len: 1494 microversion: 2.1 time: 0.873733 Oct 19 03:26:17.668965 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1609/3276] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:16 2022] GET /compute/v2.1/servers/e022fc4b-88e6-44c8-9729-7e8d25238bb3 => generated 1494 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:26:17.675160 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f0868ee7-b9b8-4f22-aa00-0fbbb4601568 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:17.677327 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f0868ee7-b9b8-4f22-aa00-0fbbb4601568 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 58aea4eb-a319-4bdc-99f2-eed095150ecb] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:17.684490 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f0868ee7-b9b8-4f22-aa00-0fbbb4601568 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:17.684987 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f0868ee7-b9b8-4f22-aa00-0fbbb4601568 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:17.685483 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f0868ee7-b9b8-4f22-aa00-0fbbb4601568 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:17.686185 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f0868ee7-b9b8-4f22-aa00-0fbbb4601568 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:17.686699 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f0868ee7-b9b8-4f22-aa00-0fbbb4601568 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:17.687133 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f0868ee7-b9b8-4f22-aa00-0fbbb4601568 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:17.861770 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-f0868ee7-b9b8-4f22-aa00-0fbbb4601568 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:17.876552 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f0868ee7-b9b8-4f22-aa00-0fbbb4601568 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/58aea4eb-a319-4bdc-99f2-eed095150ecb" status: 200 len: 1260 microversion: 2.1 time: 0.205880 Oct 19 03:26:17.887898 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1610/3277] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:17 2022] GET /compute/v2.1/servers/58aea4eb-a319-4bdc-99f2-eed095150ecb => generated 1260 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:26:17.998888 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-da673c49-37fe-48ad-8798-044c46d9e237 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:18.016840 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-da673c49-37fe-48ad-8798-044c46d9e237 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:18.019103 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-da673c49-37fe-48ad-8798-044c46d9e237 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:18.020505 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-da673c49-37fe-48ad-8798-044c46d9e237 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] 10.222.0.52 "GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7" status: 200 len: 2386 microversion: 2.32 time: 0.588209 Oct 19 03:26:18.021494 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1668/3278] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:26:17 2022] GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7 => generated 2386 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:26:18.384411 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c3ee80ff-5f6c-48b1-91cf-11c525b5a596 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:18.385774 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-9a191a40-c14d-4947-b219-2a9bbefe7c60 req-91d22ca2-3165-4846-86c6-0cbdd0d3db48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e022fc4b-88e6-44c8-9729-7e8d25238bb3", "name": "network-vif-deleted", "tag": "97a600ca-4482-476f-b559-c5e02bc3e014"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:26:18.387063 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c3ee80ff-5f6c-48b1-91cf-11c525b5a596 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 5cc2003b-73ef-4a54-a22d-9cef47c6ed3f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:18.409468 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-9a191a40-c14d-4947-b219-2a9bbefe7c60 req-91d22ca2-3165-4846-86c6-0cbdd0d3db48 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:18.409863 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c3ee80ff-5f6c-48b1-91cf-11c525b5a596 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:18.410495 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c3ee80ff-5f6c-48b1-91cf-11c525b5a596 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:18.410817 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-9a191a40-c14d-4947-b219-2a9bbefe7c60 req-91d22ca2-3165-4846-86c6-0cbdd0d3db48 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:18.410952 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c3ee80ff-5f6c-48b1-91cf-11c525b5a596 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:18.411599 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-9a191a40-c14d-4947-b219-2a9bbefe7c60 req-91d22ca2-3165-4846-86c6-0cbdd0d3db48 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:18.411763 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c3ee80ff-5f6c-48b1-91cf-11c525b5a596 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:18.412151 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c3ee80ff-5f6c-48b1-91cf-11c525b5a596 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:18.412592 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c3ee80ff-5f6c-48b1-91cf-11c525b5a596 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:18.431201 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-9a191a40-c14d-4947-b219-2a9bbefe7c60 req-91d22ca2-3165-4846-86c6-0cbdd0d3db48 service nova] Creating event network-vif-deleted:97a600ca-4482-476f-b559-c5e02bc3e014 for instance e022fc4b-88e6-44c8-9729-7e8d25238bb3 on n-h2-861333-8 Oct 19 03:26:18.438384 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-9a191a40-c14d-4947-b219-2a9bbefe7c60 req-91d22ca2-3165-4846-86c6-0cbdd0d3db48 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065856 Oct 19 03:26:18.445991 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1611/3279] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:26:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:26:18.693888 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-47f528d4-9985-47c3-b89c-fc377b6c6c65 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:18.694622 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-47f528d4-9985-47c3-b89c-fc377b6c6c65 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: e022fc4b-88e6-44c8-9729-7e8d25238bb3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:18.709186 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-47f528d4-9985-47c3-b89c-fc377b6c6c65 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:18.710239 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-47f528d4-9985-47c3-b89c-fc377b6c6c65 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:18.712056 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-47f528d4-9985-47c3-b89c-fc377b6c6c65 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:18.715193 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-47f528d4-9985-47c3-b89c-fc377b6c6c65 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:18.717223 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-47f528d4-9985-47c3-b89c-fc377b6c6c65 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:18.717778 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-47f528d4-9985-47c3-b89c-fc377b6c6c65 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:18.774693 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c3ee80ff-5f6c-48b1-91cf-11c525b5a596 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:18.793551 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c3ee80ff-5f6c-48b1-91cf-11c525b5a596 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f" status: 200 len: 1542 microversion: 2.1 time: 0.414741 Oct 19 03:26:18.798387 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1669/3280] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:18 2022] GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f => generated 1542 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:26:18.825436 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b8d3754e-d4ec-47a1-b4bb-91c4ff3ec577 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:18.826253 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b8d3754e-d4ec-47a1-b4bb-91c4ff3ec577 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 5cc2003b-73ef-4a54-a22d-9cef47c6ed3f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:18.844219 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b8d3754e-d4ec-47a1-b4bb-91c4ff3ec577 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:18.849049 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b8d3754e-d4ec-47a1-b4bb-91c4ff3ec577 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:18.853396 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b8d3754e-d4ec-47a1-b4bb-91c4ff3ec577 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:18.856800 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b8d3754e-d4ec-47a1-b4bb-91c4ff3ec577 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:18.857578 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b8d3754e-d4ec-47a1-b4bb-91c4ff3ec577 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:18.859240 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b8d3754e-d4ec-47a1-b4bb-91c4ff3ec577 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:18.922001 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-47f528d4-9985-47c3-b89c-fc377b6c6c65 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:18.942780 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-47f528d4-9985-47c3-b89c-fc377b6c6c65 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/e022fc4b-88e6-44c8-9729-7e8d25238bb3" status: 200 len: 1293 microversion: 2.1 time: 0.250181 Oct 19 03:26:18.946103 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1612/3281] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:18 2022] GET /compute/v2.1/servers/e022fc4b-88e6-44c8-9729-7e8d25238bb3 => generated 1293 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:26:18.955602 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a1b7679c-2fbc-481e-bd39-d1bf6d338e7a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:18.956749 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a1b7679c-2fbc-481e-bd39-d1bf6d338e7a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 58aea4eb-a319-4bdc-99f2-eed095150ecb] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:18.964597 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a1b7679c-2fbc-481e-bd39-d1bf6d338e7a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:18.965502 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a1b7679c-2fbc-481e-bd39-d1bf6d338e7a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:18.966367 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a1b7679c-2fbc-481e-bd39-d1bf6d338e7a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:18.967331 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a1b7679c-2fbc-481e-bd39-d1bf6d338e7a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:18.967947 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a1b7679c-2fbc-481e-bd39-d1bf6d338e7a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:18.968538 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a1b7679c-2fbc-481e-bd39-d1bf6d338e7a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:19.111010 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a1b7679c-2fbc-481e-bd39-d1bf6d338e7a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:19.124270 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a1b7679c-2fbc-481e-bd39-d1bf6d338e7a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/58aea4eb-a319-4bdc-99f2-eed095150ecb" status: 200 len: 1278 microversion: 2.1 time: 0.175900 Oct 19 03:26:19.125661 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1613/3282] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:18 2022] GET /compute/v2.1/servers/58aea4eb-a319-4bdc-99f2-eed095150ecb => generated 1278 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:26:19.130515 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7ea4e912-7f2e-45b9-afc9-6a1cd8ef24ee tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:19.131130 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7ea4e912-7f2e-45b9-afc9-6a1cd8ef24ee tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] [instance: 4adec402-e94f-4a41-ac77-68f6091b87f7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:19.135402 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b8d3754e-d4ec-47a1-b4bb-91c4ff3ec577 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.315211 Oct 19 03:26:19.136006 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1670/3283] 10.222.0.52 () {58 vars in 1275 bytes} [Wed Oct 19 03:26:18 2022] GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f/os-interface => generated 284 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:26:19.138335 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7ea4e912-7f2e-45b9-afc9-6a1cd8ef24ee tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:19.139029 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7ea4e912-7f2e-45b9-afc9-6a1cd8ef24ee tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:19.139622 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7ea4e912-7f2e-45b9-afc9-6a1cd8ef24ee tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:19.140730 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7ea4e912-7f2e-45b9-afc9-6a1cd8ef24ee tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:19.141462 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7ea4e912-7f2e-45b9-afc9-6a1cd8ef24ee tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:19.142043 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7ea4e912-7f2e-45b9-afc9-6a1cd8ef24ee tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:19.469896 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-7ea4e912-7f2e-45b9-afc9-6a1cd8ef24ee tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:19.487979 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-7ea4e912-7f2e-45b9-afc9-6a1cd8ef24ee tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:19.489889 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-7ea4e912-7f2e-45b9-afc9-6a1cd8ef24ee tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:19.491444 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7ea4e912-7f2e-45b9-afc9-6a1cd8ef24ee tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] 10.222.0.52 "GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7" status: 200 len: 2340 microversion: 2.32 time: 0.364570 Oct 19 03:26:19.494185 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1614/3284] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:26:19 2022] GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7 => generated 2340 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:26:19.971937 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c82eeb74-8529-4512-9669-4fd43db6d0ee tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:19.972572 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c82eeb74-8529-4512-9669-4fd43db6d0ee tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: e022fc4b-88e6-44c8-9729-7e8d25238bb3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:19.985992 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c82eeb74-8529-4512-9669-4fd43db6d0ee tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:19.986556 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c82eeb74-8529-4512-9669-4fd43db6d0ee tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:19.987218 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c82eeb74-8529-4512-9669-4fd43db6d0ee tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:19.987725 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c82eeb74-8529-4512-9669-4fd43db6d0ee tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:19.988385 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c82eeb74-8529-4512-9669-4fd43db6d0ee tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:19.988997 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c82eeb74-8529-4512-9669-4fd43db6d0ee tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:20.030764 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c82eeb74-8529-4512-9669-4fd43db6d0ee tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:20.031627 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c82eeb74-8529-4512-9669-4fd43db6d0ee tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:20.032284 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c82eeb74-8529-4512-9669-4fd43db6d0ee tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:20.032902 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-c82eeb74-8529-4512-9669-4fd43db6d0ee tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lazy-loading 'fault' on Instance uuid e022fc4b-88e6-44c8-9729-7e8d25238bb3 {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:26:20.036445 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:26:20.146387 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c82eeb74-8529-4512-9669-4fd43db6d0ee tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:20.160683 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1c25fc99-c824-4f1f-808f-4df6f3fd141c tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:20.163280 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1c25fc99-c824-4f1f-808f-4df6f3fd141c tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 58aea4eb-a319-4bdc-99f2-eed095150ecb] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:20.179464 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1c25fc99-c824-4f1f-808f-4df6f3fd141c tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:20.180754 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c82eeb74-8529-4512-9669-4fd43db6d0ee tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/e022fc4b-88e6-44c8-9729-7e8d25238bb3" status: 200 len: 1298 microversion: 2.1 time: 0.210549 Oct 19 03:26:20.193523 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1671/3285] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:19 2022] GET /compute/v2.1/servers/e022fc4b-88e6-44c8-9729-7e8d25238bb3 => generated 1298 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:26:20.193709 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1c25fc99-c824-4f1f-808f-4df6f3fd141c tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:20.194183 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1c25fc99-c824-4f1f-808f-4df6f3fd141c tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:20.195171 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1c25fc99-c824-4f1f-808f-4df6f3fd141c tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:20.196409 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1c25fc99-c824-4f1f-808f-4df6f3fd141c tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:20.196883 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1c25fc99-c824-4f1f-808f-4df6f3fd141c tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:20.201906 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=100 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:26:20.276510 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-1c25fc99-c824-4f1f-808f-4df6f3fd141c tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:20.285976 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1c25fc99-c824-4f1f-808f-4df6f3fd141c tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/58aea4eb-a319-4bdc-99f2-eed095150ecb" status: 200 len: 1266 microversion: 2.1 time: 0.133789 Oct 19 03:26:20.296525 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1615/3286] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:20 2022] GET /compute/v2.1/servers/58aea4eb-a319-4bdc-99f2-eed095150ecb => generated 1266 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:26:20.525261 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d9f6a28c-d610-46fe-8dd4-0147dec722d1 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:20.526050 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d9f6a28c-d610-46fe-8dd4-0147dec722d1 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] [instance: 4adec402-e94f-4a41-ac77-68f6091b87f7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:20.538700 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d9f6a28c-d610-46fe-8dd4-0147dec722d1 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:20.549848 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d9f6a28c-d610-46fe-8dd4-0147dec722d1 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:20.549848 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d9f6a28c-d610-46fe-8dd4-0147dec722d1 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:20.549848 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d9f6a28c-d610-46fe-8dd4-0147dec722d1 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:20.549848 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d9f6a28c-d610-46fe-8dd4-0147dec722d1 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:20.550495 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d9f6a28c-d610-46fe-8dd4-0147dec722d1 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:20.569293 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-95a694a3-d20e-4a0d-be43-402aaac8d4b3 req-9bd536a9-f41a-4c69-8239-8aa1d08b006f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4adec402-e94f-4a41-ac77-68f6091b87f7", "name": "network-vif-deleted", "tag": "e74674bb-2d45-441f-a59b-6f6bc5ac59f5"}, {"server_uuid": "4adec402-e94f-4a41-ac77-68f6091b87f7", "name": "network-vif-deleted", "tag": "66f823f7-1df0-47b2-bcc5-7f5bb365d0f5"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:26:20.589983 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-95a694a3-d20e-4a0d-be43-402aaac8d4b3 req-9bd536a9-f41a-4c69-8239-8aa1d08b006f service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:20.592749 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-95a694a3-d20e-4a0d-be43-402aaac8d4b3 req-9bd536a9-f41a-4c69-8239-8aa1d08b006f service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:20.594145 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-95a694a3-d20e-4a0d-be43-402aaac8d4b3 req-9bd536a9-f41a-4c69-8239-8aa1d08b006f service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:20.640049 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-95a694a3-d20e-4a0d-be43-402aaac8d4b3 req-9bd536a9-f41a-4c69-8239-8aa1d08b006f service nova] Creating event network-vif-deleted:e74674bb-2d45-441f-a59b-6f6bc5ac59f5 for instance 4adec402-e94f-4a41-ac77-68f6091b87f7 on n-h2-861333-8 Oct 19 03:26:20.640049 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-95a694a3-d20e-4a0d-be43-402aaac8d4b3 req-9bd536a9-f41a-4c69-8239-8aa1d08b006f service nova] Creating event network-vif-deleted:66f823f7-1df0-47b2-bcc5-7f5bb365d0f5 for instance 4adec402-e94f-4a41-ac77-68f6091b87f7 on n-h2-861333-8 Oct 19 03:26:20.670591 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-95a694a3-d20e-4a0d-be43-402aaac8d4b3 req-9bd536a9-f41a-4c69-8239-8aa1d08b006f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.097421 Oct 19 03:26:20.676423 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1616/3287] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:26:20 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:26:20.711408 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d9f6a28c-d610-46fe-8dd4-0147dec722d1 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:20.727918 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d9f6a28c-d610-46fe-8dd4-0147dec722d1 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:20.729482 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d9f6a28c-d610-46fe-8dd4-0147dec722d1 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:20.733445 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d9f6a28c-d610-46fe-8dd4-0147dec722d1 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] 10.222.0.52 "GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7" status: 200 len: 2273 microversion: 2.32 time: 0.212926 Oct 19 03:26:20.750078 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1672/3288] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:26:20 2022] GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7 => generated 2273 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:26:21.213734 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c5ae4aca-224e-476f-af68-cd5b087fabc6 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:21.214485 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c5ae4aca-224e-476f-af68-cd5b087fabc6 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: e022fc4b-88e6-44c8-9729-7e8d25238bb3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:21.264716 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c5ae4aca-224e-476f-af68-cd5b087fabc6 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:21.269170 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c5ae4aca-224e-476f-af68-cd5b087fabc6 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:21.270414 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c5ae4aca-224e-476f-af68-cd5b087fabc6 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:21.275949 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c5ae4aca-224e-476f-af68-cd5b087fabc6 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:21.278715 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c5ae4aca-224e-476f-af68-cd5b087fabc6 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:21.279202 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c5ae4aca-224e-476f-af68-cd5b087fabc6 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:21.314102 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4bb38ed4-111f-4c35-a792-3124f217e464 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:21.314880 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4bb38ed4-111f-4c35-a792-3124f217e464 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 58aea4eb-a319-4bdc-99f2-eed095150ecb] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:21.318599 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-c5ae4aca-224e-476f-af68-cd5b087fabc6 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] HTTP exception thrown: Instance e022fc4b-88e6-44c8-9729-7e8d25238bb3 could not be found. Oct 19 03:26:21.321453 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c5ae4aca-224e-476f-af68-cd5b087fabc6 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Request method failure captured: Oct 19 03:26:21.321453 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/e022fc4b-88e6-44c8-9729-7e8d25238bb3 HTTP/1.1 Oct 19 03:26:21.321453 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:26:21.321453 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:26:21.321453 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:26:21.321453 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:26:21.321453 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:26:21.321453 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:26:21.321453 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:26:21.321453 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:26:21.321453 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT20gKQCK3ZL5EjJtPpRF7E5hDOxix0C6fC1xUCWH8zbtFP3xUYoeIuXXDuos_Kcg-uER8mXZ0Dro2xiDEvGnr5RthhAxRX-UfAhulQWkJ7AvlI4OyC3dPVV75p4qDytKaHGa_jIWhID093t1C1fPqYSaGdAl1m0elNZW2yuRkiSpcQc Oct 19 03:26:21.321453 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:26:21.321453 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:26:21.321453 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:26:21.321453 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:26:21.321453 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:26:21.321453 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:26:21.321453 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 686dbeeaed0b44538a9bbc54d457a720 Oct 19 03:26:21.321453 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ImagesTestJSON-30140053 Oct 19 03:26:21.321453 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:26:21.321453 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:26:21.323126 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/686dbeeaed0b44538a9bbc54d457a720"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/686dbeeaed0b44538a9bbc54d457a720"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/686dbeeaed0b44538a9bbc54d457a720"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_686dbeeaed0b44538a9bbc54d457a720", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:26:21.323126 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ImagesTestJSON-30140053 Oct 19 03:26:21.323126 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 686dbeeaed0b44538a9bbc54d457a720 Oct 19 03:26:21.323126 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ImagesTestJSON-30140053 Oct 19 03:26:21.323126 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ImagesTestJSON-30140053-project Oct 19 03:26:21.323126 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:26:21.323126 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:26:21.323126 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 57008d884859417ebc1456b55ec3f6e0 Oct 19 03:26:21.323126 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ImagesTestJSON-30140053-project Oct 19 03:26:21.323126 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:26:21.323126 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance e022fc4b-88e6-44c8-9729-7e8d25238bb3 could not be found. Oct 19 03:26:21.323126 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': 'e022fc4b-88e6-44c8-9729-7e8d25238bb3'} Oct 19 03:26:21.327546 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:26:21.327546 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:26:21.327546 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:26:21.327546 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:26:21.327546 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:26:21.327546 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:26:21.327546 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:26:21.327546 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:26:21.327546 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:26:21.327546 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:26:21.327546 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e022fc4b-88e6-44c8-9729-7e8d25238bb3 could not be found. Oct 19 03:26:21.327546 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:26:21.327546 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:26:21.327546 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:26:21.327546 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:26:21.327546 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:26:21.327546 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:26:21.327546 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:26:21.327546 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:26:21.327546 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:26:21.329123 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:26:21.329123 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:26:21.329123 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:26:21.329123 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:26:21.329123 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:26:21.329123 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:26:21.329123 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:26:21.329123 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e022fc4b-88e6-44c8-9729-7e8d25238bb3 could not be found. Oct 19 03:26:21.329123 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:26:21.329123 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:26:21.329123 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:26:21.329123 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:26:21.329123 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:26:21.329123 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:26:21.329123 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:26:21.329123 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:26:21.329123 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e022fc4b-88e6-44c8-9729-7e8d25238bb3 could not be found. Oct 19 03:26:21.329123 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:26:21.330493 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c5ae4aca-224e-476f-af68-cd5b087fabc6 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Returning 404 to user: Instance e022fc4b-88e6-44c8-9729-7e8d25238bb3 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:26:21.330493 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c5ae4aca-224e-476f-af68-cd5b087fabc6 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/e022fc4b-88e6-44c8-9729-7e8d25238bb3" status: 404 len: 111 microversion: 2.1 time: 0.118510 Oct 19 03:26:21.330493 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1617/3289] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:21 2022] GET /compute/v2.1/servers/e022fc4b-88e6-44c8-9729-7e8d25238bb3 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:26:21.332656 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-70d98c94-b38b-45b0-aed3-46733b5c15fa tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '.version_select at 0x7fc135083790>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:21.339395 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4bb38ed4-111f-4c35-a792-3124f217e464 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:21.340236 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4bb38ed4-111f-4c35-a792-3124f217e464 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:21.340976 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4bb38ed4-111f-4c35-a792-3124f217e464 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:21.343103 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4bb38ed4-111f-4c35-a792-3124f217e464 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:21.343873 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4bb38ed4-111f-4c35-a792-3124f217e464 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:21.344598 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4bb38ed4-111f-4c35-a792-3124f217e464 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:21.711807 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4bb38ed4-111f-4c35-a792-3124f217e464 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:21.719907 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4bb38ed4-111f-4c35-a792-3124f217e464 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/58aea4eb-a319-4bdc-99f2-eed095150ecb" status: 200 len: 1308 microversion: 2.1 time: 0.409830 Oct 19 03:26:21.734531 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1673/3290] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:21 2022] GET /compute/v2.1/servers/58aea4eb-a319-4bdc-99f2-eed095150ecb => generated 1308 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:26:21.768234 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b3d1a2ef-e0ee-47be-b41c-2a156ca2713b tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:21.769199 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b3d1a2ef-e0ee-47be-b41c-2a156ca2713b tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] [instance: 4adec402-e94f-4a41-ac77-68f6091b87f7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:21.779114 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b3d1a2ef-e0ee-47be-b41c-2a156ca2713b tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:21.783023 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b3d1a2ef-e0ee-47be-b41c-2a156ca2713b tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:21.783864 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b3d1a2ef-e0ee-47be-b41c-2a156ca2713b tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:21.784625 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b3d1a2ef-e0ee-47be-b41c-2a156ca2713b tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:21.785096 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b3d1a2ef-e0ee-47be-b41c-2a156ca2713b tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:21.789023 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b3d1a2ef-e0ee-47be-b41c-2a156ca2713b tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:21.914429 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b3d1a2ef-e0ee-47be-b41c-2a156ca2713b tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:21.925771 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b3d1a2ef-e0ee-47be-b41c-2a156ca2713b tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:21.928009 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b3d1a2ef-e0ee-47be-b41c-2a156ca2713b tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:21.930516 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b3d1a2ef-e0ee-47be-b41c-2a156ca2713b tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] 10.222.0.52 "GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7" status: 200 len: 1873 microversion: 2.32 time: 0.166234 Oct 19 03:26:21.934734 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1674/3291] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:26:21 2022] GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7 => generated 1873 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:26:22.239843 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e0871d85-d8b3-4653-ab4b-cf71563e3bc8 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-381901349", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "networks": [{"uuid": "55d65d28-d390-462b-8e5d-901744d0bd9b"}]}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:26:22.264548 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:26:22.319151 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.network.neutron [None req-e0871d85-d8b3-4653-ab4b-cf71563e3bc8 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] validate_networks() for [('55d65d28-d390-462b-8e5d-901744d0bd9b', None, None, None, None, None)] {{(pid=121135) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:26:23.074851 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-e0871d85-d8b3-4653-ab4b-cf71563e3bc8 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Flavor limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:26:23.076204 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-e0871d85-d8b3-4653-ab4b-cf71563e3bc8 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Image limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:26:23.076697 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-e0871d85-d8b3-4653-ab4b-cf71563e3bc8 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Flavor pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:26:23.077176 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-e0871d85-d8b3-4653-ab4b-cf71563e3bc8 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Image pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:26:23.077790 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-e0871d85-d8b3-4653-ab4b-cf71563e3bc8 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:26:23.089255 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e0871d85-d8b3-4653-ab4b-cf71563e3bc8 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:23.092346 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e0871d85-d8b3-4653-ab4b-cf71563e3bc8 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:23.092911 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e0871d85-d8b3-4653-ab4b-cf71563e3bc8 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:23.093841 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e0871d85-d8b3-4653-ab4b-cf71563e3bc8 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:23.094195 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e0871d85-d8b3-4653-ab4b-cf71563e3bc8 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:23.096065 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e0871d85-d8b3-4653-ab4b-cf71563e3bc8 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:23.148580 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-e0871d85-d8b3-4653-ab4b-cf71563e3bc8 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Getting quotas for project bbcd7fa961164d20a4ca7ed8b6747530. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:26:23.160505 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-e0871d85-d8b3-4653-ab4b-cf71563e3bc8 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Getting quotas for user 2781ce2927ff43e89c90725bf2887c5b and project bbcd7fa961164d20a4ca7ed8b6747530. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:26:23.192433 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e0871d85-d8b3-4653-ab4b-cf71563e3bc8 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Going to run 1 instances... {{(pid=121135) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:26:23.197250 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e0871d85-d8b3-4653-ab4b-cf71563e3bc8 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] [instance: e3136e59-f897-40c0-bf1a-1981424717ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121135) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:26:23.310333 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-70d98c94-b38b-45b0-aed3-46733b5c15fa tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "DELETE /compute/v2.1/images/9014f0d3-c315-4e14-86df-7411ca9d43dc" status: 204 len: 0 microversion: 2.1 time: 1.982046 Oct 19 03:26:23.311174 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1618/3292] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:21 2022] DELETE /compute/v2.1/images/9014f0d3-c315-4e14-86df-7411ca9d43dc => generated 0 bytes in 1983 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:26:23.316858 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-537a9898-090a-4aef-b5df-a85733edc0f3 req-6f47b137-c624-4577-a1b6-bb9ad0eb32eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5cc2003b-73ef-4a54-a22d-9cef47c6ed3f", "tag": "6c518d82-939f-43bb-ab5f-244d4b674bfe"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:26:23.329341 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-537a9898-090a-4aef-b5df-a85733edc0f3 req-6f47b137-c624-4577-a1b6-bb9ad0eb32eb service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:23.330216 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-537a9898-090a-4aef-b5df-a85733edc0f3 req-6f47b137-c624-4577-a1b6-bb9ad0eb32eb service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:23.332063 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-537a9898-090a-4aef-b5df-a85733edc0f3 req-6f47b137-c624-4577-a1b6-bb9ad0eb32eb service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:23.343456 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-537a9898-090a-4aef-b5df-a85733edc0f3 req-6f47b137-c624-4577-a1b6-bb9ad0eb32eb service nova] Creating event network-changed:6c518d82-939f-43bb-ab5f-244d4b674bfe for instance 5cc2003b-73ef-4a54-a22d-9cef47c6ed3f on n-h2-861333-8 Oct 19 03:26:23.348755 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-537a9898-090a-4aef-b5df-a85733edc0f3 req-6f47b137-c624-4577-a1b6-bb9ad0eb32eb service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035537 Oct 19 03:26:23.350114 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1619/3293] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:26:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:26:23.356321 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f9af1d4f-7f4a-480f-9c58-e71cf0f380a9 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:23.358259 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f9af1d4f-7f4a-480f-9c58-e71cf0f380a9 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 58aea4eb-a319-4bdc-99f2-eed095150ecb] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:23.364720 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f9af1d4f-7f4a-480f-9c58-e71cf0f380a9 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:23.365320 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f9af1d4f-7f4a-480f-9c58-e71cf0f380a9 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:23.365897 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f9af1d4f-7f4a-480f-9c58-e71cf0f380a9 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:23.366672 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f9af1d4f-7f4a-480f-9c58-e71cf0f380a9 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:23.367742 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f9af1d4f-7f4a-480f-9c58-e71cf0f380a9 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:23.368246 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f9af1d4f-7f4a-480f-9c58-e71cf0f380a9 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:23.434429 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e0871d85-d8b3-4653-ab4b-cf71563e3bc8 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.362971 Oct 19 03:26:23.437739 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1675/3294] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:26:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1367 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 03:26:23.443904 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-8d56016b-0e38-4147-bf90-77c41fdfee2a tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:23.451272 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-8d56016b-0e38-4147-bf90-77c41fdfee2a tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] [instance: 4adec402-e94f-4a41-ac77-68f6091b87f7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:23.462756 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8d56016b-0e38-4147-bf90-77c41fdfee2a tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:23.466645 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8d56016b-0e38-4147-bf90-77c41fdfee2a tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:23.467670 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8d56016b-0e38-4147-bf90-77c41fdfee2a tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:23.469545 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8d56016b-0e38-4147-bf90-77c41fdfee2a tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:23.469545 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8d56016b-0e38-4147-bf90-77c41fdfee2a tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:23.472853 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8d56016b-0e38-4147-bf90-77c41fdfee2a tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:23.658056 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-8d56016b-0e38-4147-bf90-77c41fdfee2a tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:23.678866 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-8d56016b-0e38-4147-bf90-77c41fdfee2a tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:23.682698 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-8d56016b-0e38-4147-bf90-77c41fdfee2a tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:23.687795 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-8d56016b-0e38-4147-bf90-77c41fdfee2a tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] 10.222.0.52 "GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7" status: 200 len: 1873 microversion: 2.32 time: 0.247071 Oct 19 03:26:23.687795 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1676/3295] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:26:23 2022] GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7 => generated 1873 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:26:23.700208 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-48880575-1c81-4a61-9468-577ea4e97ac6 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:23.700943 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-48880575-1c81-4a61-9468-577ea4e97ac6 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: e5093d9e-cd31-4074-b339-828de5892bd1] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:23.701336 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-f9af1d4f-7f4a-480f-9c58-e71cf0f380a9 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:23.713537 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f9af1d4f-7f4a-480f-9c58-e71cf0f380a9 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/58aea4eb-a319-4bdc-99f2-eed095150ecb" status: 200 len: 1308 microversion: 2.1 time: 0.361516 Oct 19 03:26:23.717361 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-48880575-1c81-4a61-9468-577ea4e97ac6 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:23.717742 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1620/3296] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:23 2022] GET /compute/v2.1/servers/58aea4eb-a319-4bdc-99f2-eed095150ecb => generated 1308 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:26:23.718452 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-48880575-1c81-4a61-9468-577ea4e97ac6 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:23.719289 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-48880575-1c81-4a61-9468-577ea4e97ac6 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:23.722860 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-48880575-1c81-4a61-9468-577ea4e97ac6 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:23.723473 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-48880575-1c81-4a61-9468-577ea4e97ac6 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:23.723988 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-48880575-1c81-4a61-9468-577ea4e97ac6 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:23.724167 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a5c0fa35-1828-4ac9-89c4-4b699ceebbb4 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:23.724828 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a5c0fa35-1828-4ac9-89c4-4b699ceebbb4 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] [instance: e3136e59-f897-40c0-bf1a-1981424717ed] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:23.787674 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-48880575-1c81-4a61-9468-577ea4e97ac6 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: e5093d9e-cd31-4074-b339-828de5892bd1] Going to try to terminate instance {{(pid=121135) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:26:23.889790 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a5c0fa35-1828-4ac9-89c4-4b699ceebbb4 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2781ce2927ff43e89c90725bf2887c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcd7fa961164d20a4ca7ed8b6747530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:23.901497 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a5c0fa35-1828-4ac9-89c4-4b699ceebbb4 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] 10.222.0.52 "GET /compute/v2.1/servers/e3136e59-f897-40c0-bf1a-1981424717ed" status: 200 len: 1216 microversion: 2.1 time: 0.181344 Oct 19 03:26:23.902461 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1621/3297] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:23 2022] GET /compute/v2.1/servers/e3136e59-f897-40c0-bf1a-1981424717ed => generated 1216 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:26:24.292238 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-48880575-1c81-4a61-9468-577ea4e97ac6 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "DELETE /compute/v2.1/servers/e5093d9e-cd31-4074-b339-828de5892bd1" status: 204 len: 0 microversion: 2.1 time: 0.603704 Oct 19 03:26:24.296527 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1677/3298] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:26:23 2022] DELETE /compute/v2.1/servers/e5093d9e-cd31-4074-b339-828de5892bd1 => generated 0 bytes in 606 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:26:24.640181 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4c823259-7470-47ee-b4a0-6f1758d45cfa tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-609937837", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "networks": [{"uuid": "99edd0a7-1ab1-49c6-b3e8-36828942abe3"}]}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:26:24.718272 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-00b19ef9-7e99-455d-8e01-4858990b2dfb tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:24.721530 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-00b19ef9-7e99-455d-8e01-4858990b2dfb tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] [instance: 4adec402-e94f-4a41-ac77-68f6091b87f7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:24.750124 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-00b19ef9-7e99-455d-8e01-4858990b2dfb tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:24.752423 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-00b19ef9-7e99-455d-8e01-4858990b2dfb tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:24.753530 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-00b19ef9-7e99-455d-8e01-4858990b2dfb tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:24.755150 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-00b19ef9-7e99-455d-8e01-4858990b2dfb tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:24.777714 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-00b19ef9-7e99-455d-8e01-4858990b2dfb tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:24.778172 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-00b19ef9-7e99-455d-8e01-4858990b2dfb tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:24.779474 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-4c823259-7470-47ee-b4a0-6f1758d45cfa tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] validate_networks() for [('99edd0a7-1ab1-49c6-b3e8-36828942abe3', None, None, None, None, None)] {{(pid=121134) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:26:24.910207 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:26:24.944048 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-00b19ef9-7e99-455d-8e01-4858990b2dfb tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:24.962149 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-00b19ef9-7e99-455d-8e01-4858990b2dfb tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:24.963761 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-00b19ef9-7e99-455d-8e01-4858990b2dfb tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:24.965077 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-00b19ef9-7e99-455d-8e01-4858990b2dfb tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] 10.222.0.52 "GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7" status: 200 len: 1873 microversion: 2.32 time: 0.252232 Oct 19 03:26:24.981397 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1678/3299] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:26:24 2022] GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7 => generated 1873 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:26:24.981397 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1e0e9d96-9468-4304-9fe8-289e5ab9cdc7 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:24.981397 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1e0e9d96-9468-4304-9fe8-289e5ab9cdc7 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 58aea4eb-a319-4bdc-99f2-eed095150ecb] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:24.981397 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1e0e9d96-9468-4304-9fe8-289e5ab9cdc7 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:24.981397 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1e0e9d96-9468-4304-9fe8-289e5ab9cdc7 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:24.981967 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1e0e9d96-9468-4304-9fe8-289e5ab9cdc7 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:24.981967 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1e0e9d96-9468-4304-9fe8-289e5ab9cdc7 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:24.981967 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1e0e9d96-9468-4304-9fe8-289e5ab9cdc7 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:24.981967 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1e0e9d96-9468-4304-9fe8-289e5ab9cdc7 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:25.334243 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-1e0e9d96-9468-4304-9fe8-289e5ab9cdc7 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:25.376470 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1e0e9d96-9468-4304-9fe8-289e5ab9cdc7 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/58aea4eb-a319-4bdc-99f2-eed095150ecb" status: 200 len: 1308 microversion: 2.1 time: 0.409016 Oct 19 03:26:25.377816 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1679/3300] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:24 2022] GET /compute/v2.1/servers/58aea4eb-a319-4bdc-99f2-eed095150ecb => generated 1308 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:26:25.383850 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5d5e4197-59c5-4a4c-b7cd-d1d86286dc89 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:25.385075 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-5d5e4197-59c5-4a4c-b7cd-d1d86286dc89 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] [instance: e3136e59-f897-40c0-bf1a-1981424717ed] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:25.393357 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5d5e4197-59c5-4a4c-b7cd-d1d86286dc89 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:25.394133 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5d5e4197-59c5-4a4c-b7cd-d1d86286dc89 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:25.394787 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5d5e4197-59c5-4a4c-b7cd-d1d86286dc89 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:25.396002 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5d5e4197-59c5-4a4c-b7cd-d1d86286dc89 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:25.397036 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5d5e4197-59c5-4a4c-b7cd-d1d86286dc89 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:25.397785 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5d5e4197-59c5-4a4c-b7cd-d1d86286dc89 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:25.542876 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-5d5e4197-59c5-4a4c-b7cd-d1d86286dc89 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2781ce2927ff43e89c90725bf2887c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcd7fa961164d20a4ca7ed8b6747530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:25.551460 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5d5e4197-59c5-4a4c-b7cd-d1d86286dc89 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] 10.222.0.52 "GET /compute/v2.1/servers/e3136e59-f897-40c0-bf1a-1981424717ed" status: 200 len: 1220 microversion: 2.1 time: 0.171925 Oct 19 03:26:25.553131 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1680/3301] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:25 2022] GET /compute/v2.1/servers/e3136e59-f897-40c0-bf1a-1981424717ed => generated 1220 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:26:25.558034 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-04f4f53a-ef7e-4b7a-9252-7f2343c33265 req-432000f5-1758-4104-b77a-1e97547d0141 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58aea4eb-a319-4bdc-99f2-eed095150ecb", "tag": "32a70dcd-3c99-42b7-b060-729134b5f912"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:26:25.572895 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-04f4f53a-ef7e-4b7a-9252-7f2343c33265 req-432000f5-1758-4104-b77a-1e97547d0141 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:25.573653 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-04f4f53a-ef7e-4b7a-9252-7f2343c33265 req-432000f5-1758-4104-b77a-1e97547d0141 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:25.574300 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-04f4f53a-ef7e-4b7a-9252-7f2343c33265 req-432000f5-1758-4104-b77a-1e97547d0141 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:25.591591 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-04f4f53a-ef7e-4b7a-9252-7f2343c33265 req-432000f5-1758-4104-b77a-1e97547d0141 service nova] Creating event network-changed:32a70dcd-3c99-42b7-b060-729134b5f912 for instance 58aea4eb-a319-4bdc-99f2-eed095150ecb on n-h1-861333-8 Oct 19 03:26:25.599353 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-04f4f53a-ef7e-4b7a-9252-7f2343c33265 req-432000f5-1758-4104-b77a-1e97547d0141 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044688 Oct 19 03:26:25.600087 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1681/3302] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:26:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:26:25.790437 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-4c823259-7470-47ee-b4a0-6f1758d45cfa tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Flavor limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:26:25.790929 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-4c823259-7470-47ee-b4a0-6f1758d45cfa tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Image limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:26:25.791686 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-4c823259-7470-47ee-b4a0-6f1758d45cfa tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Flavor pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:26:25.792110 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-4c823259-7470-47ee-b4a0-6f1758d45cfa tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Image pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:26:25.792589 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-4c823259-7470-47ee-b4a0-6f1758d45cfa tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:26:25.818629 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4c823259-7470-47ee-b4a0-6f1758d45cfa tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:25.819288 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4c823259-7470-47ee-b4a0-6f1758d45cfa tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:25.819836 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4c823259-7470-47ee-b4a0-6f1758d45cfa tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:25.820713 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4c823259-7470-47ee-b4a0-6f1758d45cfa tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:25.821285 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4c823259-7470-47ee-b4a0-6f1758d45cfa tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:25.821846 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4c823259-7470-47ee-b4a0-6f1758d45cfa tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:25.843778 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-4c823259-7470-47ee-b4a0-6f1758d45cfa tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Getting quotas for project 686dbeeaed0b44538a9bbc54d457a720. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:26:25.852146 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-4c823259-7470-47ee-b4a0-6f1758d45cfa tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Getting quotas for user 57008d884859417ebc1456b55ec3f6e0 and project 686dbeeaed0b44538a9bbc54d457a720. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:26:25.869211 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4c823259-7470-47ee-b4a0-6f1758d45cfa tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Going to run 1 instances... {{(pid=121134) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:26:25.872072 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4c823259-7470-47ee-b4a0-6f1758d45cfa tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: f10456f4-625a-483d-98e7-e1d23d187571] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:26:26.000837 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-305e90b1-0086-4ccc-be6a-516ef19ab018 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:26.001907 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-305e90b1-0086-4ccc-be6a-516ef19ab018 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] [instance: 4adec402-e94f-4a41-ac77-68f6091b87f7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:26.021339 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-305e90b1-0086-4ccc-be6a-516ef19ab018 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:26.022031 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-305e90b1-0086-4ccc-be6a-516ef19ab018 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:26.022577 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-305e90b1-0086-4ccc-be6a-516ef19ab018 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:26.023607 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-305e90b1-0086-4ccc-be6a-516ef19ab018 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:26.024168 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-305e90b1-0086-4ccc-be6a-516ef19ab018 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:26.024695 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-305e90b1-0086-4ccc-be6a-516ef19ab018 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:26.041244 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4c823259-7470-47ee-b4a0-6f1758d45cfa tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.404992 Oct 19 03:26:26.044403 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1622/3303] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:26:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1409 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 03:26:26.058048 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-943e2248-7591-4f4f-a584-9da019fbd326 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:26.061546 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-943e2248-7591-4f4f-a584-9da019fbd326 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: f10456f4-625a-483d-98e7-e1d23d187571] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:26.170888 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-943e2248-7591-4f4f-a584-9da019fbd326 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:26.172722 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-305e90b1-0086-4ccc-be6a-516ef19ab018 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:26.180053 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-943e2248-7591-4f4f-a584-9da019fbd326 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/f10456f4-625a-483d-98e7-e1d23d187571" status: 200 len: 1207 microversion: 2.1 time: 0.128191 Oct 19 03:26:26.181785 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1623/3304] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:26 2022] GET /compute/v2.1/servers/f10456f4-625a-483d-98e7-e1d23d187571 => generated 1207 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:26:26.183714 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-305e90b1-0086-4ccc-be6a-516ef19ab018 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:26.185169 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-305e90b1-0086-4ccc-be6a-516ef19ab018 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:26.186394 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-305e90b1-0086-4ccc-be6a-516ef19ab018 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] 10.222.0.52 "GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7" status: 200 len: 1873 microversion: 2.32 time: 0.191447 Oct 19 03:26:26.186957 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1682/3305] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:26:25 2022] GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7 => generated 1873 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:26:26.415356 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5e393000-b0c8-4a3a-92c3-380fb9554d8f tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:26.416409 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5e393000-b0c8-4a3a-92c3-380fb9554d8f tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 58aea4eb-a319-4bdc-99f2-eed095150ecb] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:26.426241 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5e393000-b0c8-4a3a-92c3-380fb9554d8f tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:26.426733 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5e393000-b0c8-4a3a-92c3-380fb9554d8f tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:26.427174 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5e393000-b0c8-4a3a-92c3-380fb9554d8f tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:26.427894 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5e393000-b0c8-4a3a-92c3-380fb9554d8f tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:26.428345 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5e393000-b0c8-4a3a-92c3-380fb9554d8f tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:26.428767 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5e393000-b0c8-4a3a-92c3-380fb9554d8f tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:26.574323 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5c59b414-d56e-4717-af17-30775aff4aa7 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:26.574950 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-5c59b414-d56e-4717-af17-30775aff4aa7 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] [instance: e3136e59-f897-40c0-bf1a-1981424717ed] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:26.597585 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5e393000-b0c8-4a3a-92c3-380fb9554d8f tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:26.603575 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5c59b414-d56e-4717-af17-30775aff4aa7 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:26.604333 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5c59b414-d56e-4717-af17-30775aff4aa7 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:26.604948 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5c59b414-d56e-4717-af17-30775aff4aa7 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:26.605857 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5c59b414-d56e-4717-af17-30775aff4aa7 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:26.606472 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5c59b414-d56e-4717-af17-30775aff4aa7 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:26.607074 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5c59b414-d56e-4717-af17-30775aff4aa7 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:26.611712 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5e393000-b0c8-4a3a-92c3-380fb9554d8f tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/58aea4eb-a319-4bdc-99f2-eed095150ecb" status: 200 len: 1308 microversion: 2.1 time: 0.200752 Oct 19 03:26:26.612978 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1624/3306] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:26 2022] GET /compute/v2.1/servers/58aea4eb-a319-4bdc-99f2-eed095150ecb => generated 1308 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:26:26.698080 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-5c59b414-d56e-4717-af17-30775aff4aa7 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2781ce2927ff43e89c90725bf2887c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcd7fa961164d20a4ca7ed8b6747530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:26.705962 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5c59b414-d56e-4717-af17-30775aff4aa7 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] 10.222.0.52 "GET /compute/v2.1/servers/e3136e59-f897-40c0-bf1a-1981424717ed" status: 200 len: 1268 microversion: 2.1 time: 0.135799 Oct 19 03:26:26.706894 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1683/3307] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:26 2022] GET /compute/v2.1/servers/e3136e59-f897-40c0-bf1a-1981424717ed => generated 1268 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:26:27.204923 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-125b148d-f7b9-4cba-8bbe-4c9d4ed18d04 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:27.205687 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-125b148d-f7b9-4cba-8bbe-4c9d4ed18d04 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: f10456f4-625a-483d-98e7-e1d23d187571] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:27.217123 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-125b148d-f7b9-4cba-8bbe-4c9d4ed18d04 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:27.217749 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-125b148d-f7b9-4cba-8bbe-4c9d4ed18d04 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:27.218650 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-125b148d-f7b9-4cba-8bbe-4c9d4ed18d04 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:27.218913 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-125b148d-f7b9-4cba-8bbe-4c9d4ed18d04 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:27.219274 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0943c75c-efee-40d3-b378-ecdd1a2942d5 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:27.219925 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-125b148d-f7b9-4cba-8bbe-4c9d4ed18d04 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:27.220362 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-125b148d-f7b9-4cba-8bbe-4c9d4ed18d04 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:27.220777 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0943c75c-efee-40d3-b378-ecdd1a2942d5 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] [instance: 4adec402-e94f-4a41-ac77-68f6091b87f7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:27.229326 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0943c75c-efee-40d3-b378-ecdd1a2942d5 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:27.230130 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0943c75c-efee-40d3-b378-ecdd1a2942d5 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:27.230734 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0943c75c-efee-40d3-b378-ecdd1a2942d5 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:27.232684 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0943c75c-efee-40d3-b378-ecdd1a2942d5 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:27.233577 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0943c75c-efee-40d3-b378-ecdd1a2942d5 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:27.234212 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0943c75c-efee-40d3-b378-ecdd1a2942d5 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:27.291006 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-125b148d-f7b9-4cba-8bbe-4c9d4ed18d04 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:27.301011 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-125b148d-f7b9-4cba-8bbe-4c9d4ed18d04 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/f10456f4-625a-483d-98e7-e1d23d187571" status: 200 len: 1211 microversion: 2.1 time: 0.100460 Oct 19 03:26:27.302237 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1625/3308] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:27 2022] GET /compute/v2.1/servers/f10456f4-625a-483d-98e7-e1d23d187571 => generated 1211 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:26:27.379937 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-0943c75c-efee-40d3-b378-ecdd1a2942d5 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:27.399068 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-0943c75c-efee-40d3-b378-ecdd1a2942d5 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:27.400514 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-0943c75c-efee-40d3-b378-ecdd1a2942d5 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:27.401773 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0943c75c-efee-40d3-b378-ecdd1a2942d5 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] 10.222.0.52 "GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7" status: 200 len: 1873 microversion: 2.32 time: 0.189444 Oct 19 03:26:27.402341 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1684/3309] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:26:27 2022] GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7 => generated 1873 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:26:27.638478 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d597184a-f5c3-4bd8-a25c-4f3f57b8f3fa tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:27.639544 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d597184a-f5c3-4bd8-a25c-4f3f57b8f3fa tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 58aea4eb-a319-4bdc-99f2-eed095150ecb] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:27.648926 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d597184a-f5c3-4bd8-a25c-4f3f57b8f3fa tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:27.649730 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d597184a-f5c3-4bd8-a25c-4f3f57b8f3fa tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:27.650274 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d597184a-f5c3-4bd8-a25c-4f3f57b8f3fa tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:27.651103 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d597184a-f5c3-4bd8-a25c-4f3f57b8f3fa tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:27.651647 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d597184a-f5c3-4bd8-a25c-4f3f57b8f3fa tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:27.652638 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d597184a-f5c3-4bd8-a25c-4f3f57b8f3fa tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:27.731542 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c29e2f70-8e47-4962-a026-f5bdec5e3706 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:27.732468 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c29e2f70-8e47-4962-a026-f5bdec5e3706 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] [instance: e3136e59-f897-40c0-bf1a-1981424717ed] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:27.739325 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c29e2f70-8e47-4962-a026-f5bdec5e3706 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:27.739921 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c29e2f70-8e47-4962-a026-f5bdec5e3706 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:27.740507 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c29e2f70-8e47-4962-a026-f5bdec5e3706 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:27.742901 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c29e2f70-8e47-4962-a026-f5bdec5e3706 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:27.745420 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c29e2f70-8e47-4962-a026-f5bdec5e3706 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:27.745420 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c29e2f70-8e47-4962-a026-f5bdec5e3706 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:27.927664 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d597184a-f5c3-4bd8-a25c-4f3f57b8f3fa tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:27.957020 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d597184a-f5c3-4bd8-a25c-4f3f57b8f3fa tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/58aea4eb-a319-4bdc-99f2-eed095150ecb" status: 200 len: 1308 microversion: 2.1 time: 0.320779 Oct 19 03:26:27.958757 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1626/3310] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:27 2022] GET /compute/v2.1/servers/58aea4eb-a319-4bdc-99f2-eed095150ecb => generated 1308 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:26:27.997875 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c29e2f70-8e47-4962-a026-f5bdec5e3706 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2781ce2927ff43e89c90725bf2887c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcd7fa961164d20a4ca7ed8b6747530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:28.006675 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c29e2f70-8e47-4962-a026-f5bdec5e3706 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] 10.222.0.52 "GET /compute/v2.1/servers/e3136e59-f897-40c0-bf1a-1981424717ed" status: 200 len: 1316 microversion: 2.1 time: 0.280071 Oct 19 03:26:28.008279 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1685/3311] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:27 2022] GET /compute/v2.1/servers/e3136e59-f897-40c0-bf1a-1981424717ed => generated 1316 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:26:28.333278 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9f0dc31a-423b-413f-b0fc-9454d88fbfe6 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:28.334120 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9f0dc31a-423b-413f-b0fc-9454d88fbfe6 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: f10456f4-625a-483d-98e7-e1d23d187571] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:28.343333 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9f0dc31a-423b-413f-b0fc-9454d88fbfe6 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:28.345230 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9f0dc31a-423b-413f-b0fc-9454d88fbfe6 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:28.345230 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9f0dc31a-423b-413f-b0fc-9454d88fbfe6 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:28.345230 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9f0dc31a-423b-413f-b0fc-9454d88fbfe6 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:28.346072 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9f0dc31a-423b-413f-b0fc-9454d88fbfe6 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:28.346642 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9f0dc31a-423b-413f-b0fc-9454d88fbfe6 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:28.432130 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9f0dc31a-423b-413f-b0fc-9454d88fbfe6 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:28.439360 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-22199648-7d64-401b-ab28-1165659c2edb tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:28.439996 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-22199648-7d64-401b-ab28-1165659c2edb tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] [instance: 4adec402-e94f-4a41-ac77-68f6091b87f7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:28.448423 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-22199648-7d64-401b-ab28-1165659c2edb tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:28.448944 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-22199648-7d64-401b-ab28-1165659c2edb tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:28.453715 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9f0dc31a-423b-413f-b0fc-9454d88fbfe6 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/f10456f4-625a-483d-98e7-e1d23d187571" status: 200 len: 1259 microversion: 2.1 time: 0.126550 Oct 19 03:26:28.454976 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-22199648-7d64-401b-ab28-1165659c2edb tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:28.456083 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-22199648-7d64-401b-ab28-1165659c2edb tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:28.456560 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-22199648-7d64-401b-ab28-1165659c2edb tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:28.457022 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-22199648-7d64-401b-ab28-1165659c2edb tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:28.462084 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1627/3312] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:28 2022] GET /compute/v2.1/servers/f10456f4-625a-483d-98e7-e1d23d187571 => generated 1259 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:26:28.541989 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-22199648-7d64-401b-ab28-1165659c2edb tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:28.553993 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-22199648-7d64-401b-ab28-1165659c2edb tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:28.556838 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-22199648-7d64-401b-ab28-1165659c2edb tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:28.558569 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-22199648-7d64-401b-ab28-1165659c2edb tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] 10.222.0.52 "GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7" status: 200 len: 1873 microversion: 2.32 time: 0.122807 Oct 19 03:26:28.559472 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1686/3313] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:26:28 2022] GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7 => generated 1873 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:26:28.980411 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ce1fe38d-9f77-42b8-a8f4-838344c0f4af tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:28.981025 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ce1fe38d-9f77-42b8-a8f4-838344c0f4af tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 58aea4eb-a319-4bdc-99f2-eed095150ecb] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:28.988894 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ce1fe38d-9f77-42b8-a8f4-838344c0f4af tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:28.991634 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ce1fe38d-9f77-42b8-a8f4-838344c0f4af tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:28.991634 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ce1fe38d-9f77-42b8-a8f4-838344c0f4af tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:28.991634 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ce1fe38d-9f77-42b8-a8f4-838344c0f4af tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:28.991634 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ce1fe38d-9f77-42b8-a8f4-838344c0f4af tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:28.992216 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ce1fe38d-9f77-42b8-a8f4-838344c0f4af tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:29.032602 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4caed8d9-6d2e-43bb-9121-b32f7ada3d24 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:29.033448 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4caed8d9-6d2e-43bb-9121-b32f7ada3d24 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] [instance: e3136e59-f897-40c0-bf1a-1981424717ed] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:29.041065 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4caed8d9-6d2e-43bb-9121-b32f7ada3d24 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:29.041831 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4caed8d9-6d2e-43bb-9121-b32f7ada3d24 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:29.042603 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4caed8d9-6d2e-43bb-9121-b32f7ada3d24 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:29.043595 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4caed8d9-6d2e-43bb-9121-b32f7ada3d24 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:29.044440 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4caed8d9-6d2e-43bb-9121-b32f7ada3d24 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:29.045031 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4caed8d9-6d2e-43bb-9121-b32f7ada3d24 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:29.372450 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4caed8d9-6d2e-43bb-9121-b32f7ada3d24 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2781ce2927ff43e89c90725bf2887c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcd7fa961164d20a4ca7ed8b6747530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:29.376292 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:26:29.397421 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4caed8d9-6d2e-43bb-9121-b32f7ada3d24 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] 10.222.0.52 "GET /compute/v2.1/servers/e3136e59-f897-40c0-bf1a-1981424717ed" status: 200 len: 1316 microversion: 2.1 time: 0.355006 Oct 19 03:26:29.397421 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1687/3314] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:29 2022] GET /compute/v2.1/servers/e3136e59-f897-40c0-bf1a-1981424717ed => generated 1316 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:26:29.401473 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ce1fe38d-9f77-42b8-a8f4-838344c0f4af tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:29.405026 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-d0f44513-e335-4bad-9c8a-1f7f3da94af2 req-b348c508-ea0d-4c8b-a3dc-2d13822302c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3136e59-f897-40c0-bf1a-1981424717ed", "tag": "8fdd9d63-2e53-4d1b-9fc9-e975b467a60e"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:26:29.420546 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ce1fe38d-9f77-42b8-a8f4-838344c0f4af tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/58aea4eb-a319-4bdc-99f2-eed095150ecb" status: 200 len: 1308 microversion: 2.1 time: 0.437863 Oct 19 03:26:29.420546 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1628/3315] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:28 2022] GET /compute/v2.1/servers/58aea4eb-a319-4bdc-99f2-eed095150ecb => generated 1308 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:26:29.422052 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-d0f44513-e335-4bad-9c8a-1f7f3da94af2 req-b348c508-ea0d-4c8b-a3dc-2d13822302c4 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:29.422727 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-d0f44513-e335-4bad-9c8a-1f7f3da94af2 req-b348c508-ea0d-4c8b-a3dc-2d13822302c4 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:29.423170 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-d0f44513-e335-4bad-9c8a-1f7f3da94af2 req-b348c508-ea0d-4c8b-a3dc-2d13822302c4 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:29.458127 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-d0f44513-e335-4bad-9c8a-1f7f3da94af2 req-b348c508-ea0d-4c8b-a3dc-2d13822302c4 service nova] Creating event network-changed:8fdd9d63-2e53-4d1b-9fc9-e975b467a60e for instance e3136e59-f897-40c0-bf1a-1981424717ed on n-h2-861333-8 Oct 19 03:26:29.458127 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-d0f44513-e335-4bad-9c8a-1f7f3da94af2 req-b348c508-ea0d-4c8b-a3dc-2d13822302c4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070970 Oct 19 03:26:29.458127 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1688/3316] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:26:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:26:29.483192 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9b7e43f9-6aae-4aa0-80eb-b6cfe4fd9fea tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:29.483818 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9b7e43f9-6aae-4aa0-80eb-b6cfe4fd9fea tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: f10456f4-625a-483d-98e7-e1d23d187571] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:29.495073 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9b7e43f9-6aae-4aa0-80eb-b6cfe4fd9fea tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:29.496157 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9b7e43f9-6aae-4aa0-80eb-b6cfe4fd9fea tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:29.496812 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9b7e43f9-6aae-4aa0-80eb-b6cfe4fd9fea tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:29.498148 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9b7e43f9-6aae-4aa0-80eb-b6cfe4fd9fea tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:29.498858 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9b7e43f9-6aae-4aa0-80eb-b6cfe4fd9fea tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:29.499446 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9b7e43f9-6aae-4aa0-80eb-b6cfe4fd9fea tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:29.586799 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-35c395d0-e674-47bc-823d-645d9cfad698 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:29.587752 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-35c395d0-e674-47bc-823d-645d9cfad698 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] [instance: 4adec402-e94f-4a41-ac77-68f6091b87f7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:29.594781 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-35c395d0-e674-47bc-823d-645d9cfad698 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:29.595558 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-35c395d0-e674-47bc-823d-645d9cfad698 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:29.596179 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-35c395d0-e674-47bc-823d-645d9cfad698 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:29.597052 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-35c395d0-e674-47bc-823d-645d9cfad698 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:29.597709 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-35c395d0-e674-47bc-823d-645d9cfad698 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:29.598294 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-35c395d0-e674-47bc-823d-645d9cfad698 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:29.626727 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9b7e43f9-6aae-4aa0-80eb-b6cfe4fd9fea tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:29.640088 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9b7e43f9-6aae-4aa0-80eb-b6cfe4fd9fea tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/f10456f4-625a-483d-98e7-e1d23d187571" status: 200 len: 1265 microversion: 2.1 time: 0.162232 Oct 19 03:26:29.643424 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1629/3317] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:29 2022] GET /compute/v2.1/servers/f10456f4-625a-483d-98e7-e1d23d187571 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:26:29.732584 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-35c395d0-e674-47bc-823d-645d9cfad698 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:29.749720 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-35c395d0-e674-47bc-823d-645d9cfad698 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:29.755247 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-35c395d0-e674-47bc-823d-645d9cfad698 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:29.755247 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-35c395d0-e674-47bc-823d-645d9cfad698 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] 10.222.0.52 "GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7" status: 200 len: 1873 microversion: 2.32 time: 0.171341 Oct 19 03:26:29.757338 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1689/3318] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:26:29 2022] GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7 => generated 1873 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:26:30.407441 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-fa63f8ab-0778-409b-9da8-06eee261b788 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:30.408219 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-fa63f8ab-0778-409b-9da8-06eee261b788 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] [instance: e3136e59-f897-40c0-bf1a-1981424717ed] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:30.415482 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fa63f8ab-0778-409b-9da8-06eee261b788 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:30.416097 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fa63f8ab-0778-409b-9da8-06eee261b788 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:30.416650 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fa63f8ab-0778-409b-9da8-06eee261b788 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:30.417520 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fa63f8ab-0778-409b-9da8-06eee261b788 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:30.418087 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fa63f8ab-0778-409b-9da8-06eee261b788 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:30.418625 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fa63f8ab-0778-409b-9da8-06eee261b788 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:30.446140 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-cbd83ba7-d51b-4ee1-93cc-9be727f10844 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:30.447044 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-cbd83ba7-d51b-4ee1-93cc-9be727f10844 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 58aea4eb-a319-4bdc-99f2-eed095150ecb] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:30.454895 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cbd83ba7-d51b-4ee1-93cc-9be727f10844 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:30.455607 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cbd83ba7-d51b-4ee1-93cc-9be727f10844 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:30.456211 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cbd83ba7-d51b-4ee1-93cc-9be727f10844 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:30.457428 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cbd83ba7-d51b-4ee1-93cc-9be727f10844 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:30.457904 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cbd83ba7-d51b-4ee1-93cc-9be727f10844 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:30.458433 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cbd83ba7-d51b-4ee1-93cc-9be727f10844 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:30.666379 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-fa63f8ab-0778-409b-9da8-06eee261b788 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2781ce2927ff43e89c90725bf2887c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcd7fa961164d20a4ca7ed8b6747530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:30.681522 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-fa63f8ab-0778-409b-9da8-06eee261b788 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] 10.222.0.52 "GET /compute/v2.1/servers/e3136e59-f897-40c0-bf1a-1981424717ed" status: 200 len: 1316 microversion: 2.1 time: 0.277760 Oct 19 03:26:30.688085 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1630/3319] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:30 2022] GET /compute/v2.1/servers/e3136e59-f897-40c0-bf1a-1981424717ed => generated 1316 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:26:30.701406 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-10ccc2bf-f6f9-432b-a909-80d2cb950a68 req-4cde9ffe-cfdd-4e9f-b240-2b830aeddb2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5093d9e-cd31-4074-b339-828de5892bd1", "name": "network-vif-deleted", "tag": "8014cea8-dac9-42ee-b483-a953805bdcd0"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:26:30.721782 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-10ccc2bf-f6f9-432b-a909-80d2cb950a68 req-4cde9ffe-cfdd-4e9f-b240-2b830aeddb2e service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:30.722386 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-10ccc2bf-f6f9-432b-a909-80d2cb950a68 req-4cde9ffe-cfdd-4e9f-b240-2b830aeddb2e service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:30.722934 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-10ccc2bf-f6f9-432b-a909-80d2cb950a68 req-4cde9ffe-cfdd-4e9f-b240-2b830aeddb2e service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:30.727848 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-cbd83ba7-d51b-4ee1-93cc-9be727f10844 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:30.741620 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-cbd83ba7-d51b-4ee1-93cc-9be727f10844 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/58aea4eb-a319-4bdc-99f2-eed095150ecb" status: 200 len: 1308 microversion: 2.1 time: 0.299675 Oct 19 03:26:30.742879 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1690/3320] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:30 2022] GET /compute/v2.1/servers/58aea4eb-a319-4bdc-99f2-eed095150ecb => generated 1308 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:26:30.749626 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d14d2357-e162-46eb-b34a-9d30ff4dddc5 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:30.750597 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-10ccc2bf-f6f9-432b-a909-80d2cb950a68 req-4cde9ffe-cfdd-4e9f-b240-2b830aeddb2e service nova] Creating event network-vif-deleted:8014cea8-dac9-42ee-b483-a953805bdcd0 for instance e5093d9e-cd31-4074-b339-828de5892bd1 on n-h1-861333-8 Oct 19 03:26:30.751533 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d14d2357-e162-46eb-b34a-9d30ff4dddc5 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: f10456f4-625a-483d-98e7-e1d23d187571] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:30.758577 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-10ccc2bf-f6f9-432b-a909-80d2cb950a68 req-4cde9ffe-cfdd-4e9f-b240-2b830aeddb2e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068940 Oct 19 03:26:30.760691 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1631/3321] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:26:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:26:30.766275 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d14d2357-e162-46eb-b34a-9d30ff4dddc5 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:30.766275 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d14d2357-e162-46eb-b34a-9d30ff4dddc5 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:30.766275 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d14d2357-e162-46eb-b34a-9d30ff4dddc5 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:30.766275 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d14d2357-e162-46eb-b34a-9d30ff4dddc5 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:30.766887 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d14d2357-e162-46eb-b34a-9d30ff4dddc5 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:30.767231 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d14d2357-e162-46eb-b34a-9d30ff4dddc5 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:30.783656 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-cac49189-f914-40eb-b106-c41236a577d9 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:30.784698 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-cac49189-f914-40eb-b106-c41236a577d9 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] [instance: 4adec402-e94f-4a41-ac77-68f6091b87f7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:30.794436 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cac49189-f914-40eb-b106-c41236a577d9 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:30.798145 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cac49189-f914-40eb-b106-c41236a577d9 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:30.798145 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cac49189-f914-40eb-b106-c41236a577d9 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:30.798145 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cac49189-f914-40eb-b106-c41236a577d9 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:30.800341 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cac49189-f914-40eb-b106-c41236a577d9 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:30.800925 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cac49189-f914-40eb-b106-c41236a577d9 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:30.895809 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d14d2357-e162-46eb-b34a-9d30ff4dddc5 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:30.905613 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d14d2357-e162-46eb-b34a-9d30ff4dddc5 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/f10456f4-625a-483d-98e7-e1d23d187571" status: 200 len: 1265 microversion: 2.1 time: 0.161458 Oct 19 03:26:30.918510 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1691/3322] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:30 2022] GET /compute/v2.1/servers/f10456f4-625a-483d-98e7-e1d23d187571 => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:26:30.967489 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-cac49189-f914-40eb-b106-c41236a577d9 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:30.985981 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-cac49189-f914-40eb-b106-c41236a577d9 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:30.990353 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-cac49189-f914-40eb-b106-c41236a577d9 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:30.993303 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-cac49189-f914-40eb-b106-c41236a577d9 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] 10.222.0.52 "GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7" status: 200 len: 1873 microversion: 2.32 time: 0.213049 Oct 19 03:26:30.993985 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1632/3323] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:26:30 2022] GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7 => generated 1873 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:26:31.710906 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-27592422-7544-4db3-b5aa-f5b26b0b2996 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:31.712405 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-27592422-7544-4db3-b5aa-f5b26b0b2996 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] [instance: e3136e59-f897-40c0-bf1a-1981424717ed] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:31.721200 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-27592422-7544-4db3-b5aa-f5b26b0b2996 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:31.722155 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-27592422-7544-4db3-b5aa-f5b26b0b2996 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:31.722910 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-27592422-7544-4db3-b5aa-f5b26b0b2996 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:31.723799 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-27592422-7544-4db3-b5aa-f5b26b0b2996 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:31.724710 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-27592422-7544-4db3-b5aa-f5b26b0b2996 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:31.725303 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-27592422-7544-4db3-b5aa-f5b26b0b2996 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:31.797711 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f0e58924-3b75-4b8a-9433-ba6004a7cfa8 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:31.797711 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f0e58924-3b75-4b8a-9433-ba6004a7cfa8 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 58aea4eb-a319-4bdc-99f2-eed095150ecb] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:31.797711 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f0e58924-3b75-4b8a-9433-ba6004a7cfa8 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:31.797711 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f0e58924-3b75-4b8a-9433-ba6004a7cfa8 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:31.799618 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f0e58924-3b75-4b8a-9433-ba6004a7cfa8 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:31.799618 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f0e58924-3b75-4b8a-9433-ba6004a7cfa8 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:31.799618 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f0e58924-3b75-4b8a-9433-ba6004a7cfa8 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:31.799618 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f0e58924-3b75-4b8a-9433-ba6004a7cfa8 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:31.949411 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-27592422-7544-4db3-b5aa-f5b26b0b2996 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2781ce2927ff43e89c90725bf2887c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcd7fa961164d20a4ca7ed8b6747530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:31.958703 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-27592422-7544-4db3-b5aa-f5b26b0b2996 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] 10.222.0.52 "GET /compute/v2.1/servers/e3136e59-f897-40c0-bf1a-1981424717ed" status: 200 len: 1316 microversion: 2.1 time: 0.251770 Oct 19 03:26:31.973898 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1692/3324] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:31 2022] GET /compute/v2.1/servers/e3136e59-f897-40c0-bf1a-1981424717ed => generated 1316 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:26:31.980351 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-da960161-3f30-447a-8005-1356f59c8500 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:31.984302 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-da960161-3f30-447a-8005-1356f59c8500 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: f10456f4-625a-483d-98e7-e1d23d187571] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:31.988096 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-da960161-3f30-447a-8005-1356f59c8500 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:31.988905 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-da960161-3f30-447a-8005-1356f59c8500 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:31.989624 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-da960161-3f30-447a-8005-1356f59c8500 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:31.990571 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-da960161-3f30-447a-8005-1356f59c8500 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:31.991269 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-da960161-3f30-447a-8005-1356f59c8500 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:31.992548 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-da960161-3f30-447a-8005-1356f59c8500 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:32.008201 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-f0e58924-3b75-4b8a-9433-ba6004a7cfa8 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:32.020144 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f0e58924-3b75-4b8a-9433-ba6004a7cfa8 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/58aea4eb-a319-4bdc-99f2-eed095150ecb" status: 200 len: 1308 microversion: 2.1 time: 0.251835 Oct 19 03:26:32.020742 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1633/3325] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:31 2022] GET /compute/v2.1/servers/58aea4eb-a319-4bdc-99f2-eed095150ecb => generated 1308 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:26:32.041129 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-95c0f7a9-008c-4d7e-b5a5-e40c329b5538 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:32.041810 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-95c0f7a9-008c-4d7e-b5a5-e40c329b5538 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] [instance: 4adec402-e94f-4a41-ac77-68f6091b87f7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:32.048330 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-95c0f7a9-008c-4d7e-b5a5-e40c329b5538 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:32.049046 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-95c0f7a9-008c-4d7e-b5a5-e40c329b5538 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:32.049884 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-95c0f7a9-008c-4d7e-b5a5-e40c329b5538 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:32.051221 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-95c0f7a9-008c-4d7e-b5a5-e40c329b5538 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:32.051758 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-95c0f7a9-008c-4d7e-b5a5-e40c329b5538 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:32.052194 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-95c0f7a9-008c-4d7e-b5a5-e40c329b5538 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:32.186008 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-95c0f7a9-008c-4d7e-b5a5-e40c329b5538 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:32.202233 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-95c0f7a9-008c-4d7e-b5a5-e40c329b5538 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:32.203682 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-95c0f7a9-008c-4d7e-b5a5-e40c329b5538 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:32.204883 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-95c0f7a9-008c-4d7e-b5a5-e40c329b5538 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] 10.222.0.52 "GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7" status: 200 len: 1873 microversion: 2.32 time: 0.171556 Oct 19 03:26:32.211008 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1634/3326] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:26:32 2022] GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7 => generated 1873 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:26:32.240879 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-da960161-3f30-447a-8005-1356f59c8500 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:32.251873 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-da960161-3f30-447a-8005-1356f59c8500 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/f10456f4-625a-483d-98e7-e1d23d187571" status: 200 len: 1307 microversion: 2.1 time: 0.276379 Oct 19 03:26:32.252459 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1693/3327] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:31 2022] GET /compute/v2.1/servers/f10456f4-625a-483d-98e7-e1d23d187571 => generated 1307 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:26:32.783370 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-cab18ce1-8040-4d5c-bdf8-a6f20229e0a6 req-b61ade54-2b1d-44ba-992f-f12995462ee9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f10456f4-625a-483d-98e7-e1d23d187571", "tag": "bae859a8-4017-4db1-8eed-d383aed6e87f"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:26:32.795867 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-cab18ce1-8040-4d5c-bdf8-a6f20229e0a6 req-b61ade54-2b1d-44ba-992f-f12995462ee9 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:32.796367 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-cab18ce1-8040-4d5c-bdf8-a6f20229e0a6 req-b61ade54-2b1d-44ba-992f-f12995462ee9 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:32.796786 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-cab18ce1-8040-4d5c-bdf8-a6f20229e0a6 req-b61ade54-2b1d-44ba-992f-f12995462ee9 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:32.809935 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-cab18ce1-8040-4d5c-bdf8-a6f20229e0a6 req-b61ade54-2b1d-44ba-992f-f12995462ee9 service nova] Creating event network-changed:bae859a8-4017-4db1-8eed-d383aed6e87f for instance f10456f4-625a-483d-98e7-e1d23d187571 on n-h2-861333-8 Oct 19 03:26:32.815038 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-cab18ce1-8040-4d5c-bdf8-a6f20229e0a6 req-b61ade54-2b1d-44ba-992f-f12995462ee9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037594 Oct 19 03:26:32.816154 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1635/3328] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:26:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:26:32.986271 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-8c1383c6-21c9-4541-8df9-b03016927ca1 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:32.986980 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-8c1383c6-21c9-4541-8df9-b03016927ca1 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] [instance: e3136e59-f897-40c0-bf1a-1981424717ed] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:33.000358 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8c1383c6-21c9-4541-8df9-b03016927ca1 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:33.002145 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8c1383c6-21c9-4541-8df9-b03016927ca1 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:33.003053 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8c1383c6-21c9-4541-8df9-b03016927ca1 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:33.004199 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8c1383c6-21c9-4541-8df9-b03016927ca1 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:33.005186 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8c1383c6-21c9-4541-8df9-b03016927ca1 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:33.005931 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8c1383c6-21c9-4541-8df9-b03016927ca1 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:33.046812 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-47bb98fc-a3d7-4635-84d7-ad0fc4b060b4 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:33.049433 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-47bb98fc-a3d7-4635-84d7-ad0fc4b060b4 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 58aea4eb-a319-4bdc-99f2-eed095150ecb] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:33.057152 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-47bb98fc-a3d7-4635-84d7-ad0fc4b060b4 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:33.061679 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-47bb98fc-a3d7-4635-84d7-ad0fc4b060b4 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:33.062382 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-47bb98fc-a3d7-4635-84d7-ad0fc4b060b4 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:33.063905 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-47bb98fc-a3d7-4635-84d7-ad0fc4b060b4 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:33.066081 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-47bb98fc-a3d7-4635-84d7-ad0fc4b060b4 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:33.068371 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-47bb98fc-a3d7-4635-84d7-ad0fc4b060b4 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:33.122973 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:26:33.175234 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=6 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:26:33.234822 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-8c1383c6-21c9-4541-8df9-b03016927ca1 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2781ce2927ff43e89c90725bf2887c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcd7fa961164d20a4ca7ed8b6747530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:33.246815 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-8c1383c6-21c9-4541-8df9-b03016927ca1 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] 10.222.0.52 "GET /compute/v2.1/servers/e3136e59-f897-40c0-bf1a-1981424717ed" status: 200 len: 1316 microversion: 2.1 time: 0.264833 Oct 19 03:26:33.265159 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1694/3329] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:32 2022] GET /compute/v2.1/servers/e3136e59-f897-40c0-bf1a-1981424717ed => generated 1316 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:26:33.270757 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b2c74c57-486b-41be-9856-8527a16507ab tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:33.274024 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b2c74c57-486b-41be-9856-8527a16507ab tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] [instance: 4adec402-e94f-4a41-ac77-68f6091b87f7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:33.280146 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b2c74c57-486b-41be-9856-8527a16507ab tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:33.280651 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b2c74c57-486b-41be-9856-8527a16507ab tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:33.281095 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b2c74c57-486b-41be-9856-8527a16507ab tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:33.281826 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b2c74c57-486b-41be-9856-8527a16507ab tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:33.282462 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b2c74c57-486b-41be-9856-8527a16507ab tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:33.283053 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b2c74c57-486b-41be-9856-8527a16507ab tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:33.292040 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-47bb98fc-a3d7-4635-84d7-ad0fc4b060b4 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:33.302045 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-47bb98fc-a3d7-4635-84d7-ad0fc4b060b4 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/58aea4eb-a319-4bdc-99f2-eed095150ecb" status: 200 len: 1308 microversion: 2.1 time: 0.259970 Oct 19 03:26:33.306835 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1636/3330] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:33 2022] GET /compute/v2.1/servers/58aea4eb-a319-4bdc-99f2-eed095150ecb => generated 1308 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:26:33.313163 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-94aba5b8-69ba-4945-a6ec-25b3a8b4b235 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:33.314757 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-94aba5b8-69ba-4945-a6ec-25b3a8b4b235 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: f10456f4-625a-483d-98e7-e1d23d187571] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:33.321926 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:26:33.327078 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-94aba5b8-69ba-4945-a6ec-25b3a8b4b235 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:33.327078 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-94aba5b8-69ba-4945-a6ec-25b3a8b4b235 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:33.327078 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-94aba5b8-69ba-4945-a6ec-25b3a8b4b235 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:33.327078 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-94aba5b8-69ba-4945-a6ec-25b3a8b4b235 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:33.327504 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-94aba5b8-69ba-4945-a6ec-25b3a8b4b235 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:33.327504 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-94aba5b8-69ba-4945-a6ec-25b3a8b4b235 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:33.370448 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b2c74c57-486b-41be-9856-8527a16507ab tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:33.384670 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b2c74c57-486b-41be-9856-8527a16507ab tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:33.386115 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b2c74c57-486b-41be-9856-8527a16507ab tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:33.387632 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b2c74c57-486b-41be-9856-8527a16507ab tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] 10.222.0.52 "GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7" status: 200 len: 1873 microversion: 2.32 time: 0.121205 Oct 19 03:26:33.397497 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1695/3331] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:26:33 2022] GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7 => generated 1873 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:26:33.397497 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-e87b2efa-6b88-4b6c-bc0a-4c6e8d01b265 req-b819a2e0-e156-44c7-95f9-330b0e1d3971 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58aea4eb-a319-4bdc-99f2-eed095150ecb", "name": "network-vif-plugged", "status": "completed", "tag": "32a70dcd-3c99-42b7-b060-729134b5f912"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:26:33.405024 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-e87b2efa-6b88-4b6c-bc0a-4c6e8d01b265 req-b819a2e0-e156-44c7-95f9-330b0e1d3971 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:33.405711 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-e87b2efa-6b88-4b6c-bc0a-4c6e8d01b265 req-b819a2e0-e156-44c7-95f9-330b0e1d3971 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:33.406157 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-e87b2efa-6b88-4b6c-bc0a-4c6e8d01b265 req-b819a2e0-e156-44c7-95f9-330b0e1d3971 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:33.419535 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-e87b2efa-6b88-4b6c-bc0a-4c6e8d01b265 req-b819a2e0-e156-44c7-95f9-330b0e1d3971 service nova] Creating event network-vif-plugged:32a70dcd-3c99-42b7-b060-729134b5f912 for instance 58aea4eb-a319-4bdc-99f2-eed095150ecb on n-h1-861333-8 Oct 19 03:26:33.425099 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-e87b2efa-6b88-4b6c-bc0a-4c6e8d01b265 req-b819a2e0-e156-44c7-95f9-330b0e1d3971 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035137 Oct 19 03:26:33.426176 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1696/3332] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:26:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:26:33.539064 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-94aba5b8-69ba-4945-a6ec-25b3a8b4b235 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:33.547908 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-94aba5b8-69ba-4945-a6ec-25b3a8b4b235 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/f10456f4-625a-483d-98e7-e1d23d187571" status: 200 len: 1307 microversion: 2.1 time: 0.239220 Oct 19 03:26:33.548899 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1637/3333] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:33 2022] GET /compute/v2.1/servers/f10456f4-625a-483d-98e7-e1d23d187571 => generated 1307 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:26:34.276309 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3474f360-c978-41e3-b21b-88aa3381faf8 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:34.277834 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-3474f360-c978-41e3-b21b-88aa3381faf8 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] [instance: e3136e59-f897-40c0-bf1a-1981424717ed] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:34.285337 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3474f360-c978-41e3-b21b-88aa3381faf8 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:34.285926 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3474f360-c978-41e3-b21b-88aa3381faf8 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:34.286545 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3474f360-c978-41e3-b21b-88aa3381faf8 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:34.287447 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3474f360-c978-41e3-b21b-88aa3381faf8 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:34.287910 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3474f360-c978-41e3-b21b-88aa3381faf8 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:34.288338 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3474f360-c978-41e3-b21b-88aa3381faf8 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:34.333481 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-755a457a-9297-4496-9807-fb84d2d4b0b0 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:34.334795 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-755a457a-9297-4496-9807-fb84d2d4b0b0 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 58aea4eb-a319-4bdc-99f2-eed095150ecb] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:34.347389 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-755a457a-9297-4496-9807-fb84d2d4b0b0 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:34.348192 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-755a457a-9297-4496-9807-fb84d2d4b0b0 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:34.348815 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-755a457a-9297-4496-9807-fb84d2d4b0b0 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:34.349982 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-755a457a-9297-4496-9807-fb84d2d4b0b0 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:34.350634 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-755a457a-9297-4496-9807-fb84d2d4b0b0 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:34.351709 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-755a457a-9297-4496-9807-fb84d2d4b0b0 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:34.507656 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-3474f360-c978-41e3-b21b-88aa3381faf8 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2781ce2927ff43e89c90725bf2887c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcd7fa961164d20a4ca7ed8b6747530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:34.519464 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-3474f360-c978-41e3-b21b-88aa3381faf8 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] 10.222.0.52 "GET /compute/v2.1/servers/e3136e59-f897-40c0-bf1a-1981424717ed" status: 200 len: 1316 microversion: 2.1 time: 0.250428 Oct 19 03:26:34.519464 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1697/3334] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:34 2022] GET /compute/v2.1/servers/e3136e59-f897-40c0-bf1a-1981424717ed => generated 1316 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:26:34.533402 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d116f8ae-4476-464b-bbc9-5756cc63e13c tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:34.537156 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d116f8ae-4476-464b-bbc9-5756cc63e13c tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] [instance: 4adec402-e94f-4a41-ac77-68f6091b87f7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:34.544529 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d116f8ae-4476-464b-bbc9-5756cc63e13c tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:34.546477 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d116f8ae-4476-464b-bbc9-5756cc63e13c tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:34.546477 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d116f8ae-4476-464b-bbc9-5756cc63e13c tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:34.546735 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d116f8ae-4476-464b-bbc9-5756cc63e13c tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:34.547157 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d116f8ae-4476-464b-bbc9-5756cc63e13c tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:34.547595 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d116f8ae-4476-464b-bbc9-5756cc63e13c tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:34.550919 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-755a457a-9297-4496-9807-fb84d2d4b0b0 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:34.556106 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=100 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:26:34.562247 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-755a457a-9297-4496-9807-fb84d2d4b0b0 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/58aea4eb-a319-4bdc-99f2-eed095150ecb" status: 200 len: 1308 microversion: 2.1 time: 0.234332 Oct 19 03:26:34.574330 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1638/3335] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:34 2022] GET /compute/v2.1/servers/58aea4eb-a319-4bdc-99f2-eed095150ecb => generated 1308 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:26:34.584332 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b09770d2-1810-4bdb-9094-2e4e14a19d22 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:34.585083 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b09770d2-1810-4bdb-9094-2e4e14a19d22 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: f10456f4-625a-483d-98e7-e1d23d187571] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:34.591924 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b09770d2-1810-4bdb-9094-2e4e14a19d22 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:34.592420 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b09770d2-1810-4bdb-9094-2e4e14a19d22 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:34.592884 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b09770d2-1810-4bdb-9094-2e4e14a19d22 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:34.593784 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b09770d2-1810-4bdb-9094-2e4e14a19d22 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:34.594563 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b09770d2-1810-4bdb-9094-2e4e14a19d22 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:34.595013 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b09770d2-1810-4bdb-9094-2e4e14a19d22 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:34.632158 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d116f8ae-4476-464b-bbc9-5756cc63e13c tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:34.642702 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d116f8ae-4476-464b-bbc9-5756cc63e13c tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:34.644302 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d116f8ae-4476-464b-bbc9-5756cc63e13c tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:34.645726 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d116f8ae-4476-464b-bbc9-5756cc63e13c tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] 10.222.0.52 "GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7" status: 200 len: 1873 microversion: 2.32 time: 0.118674 Oct 19 03:26:34.649418 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1698/3336] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:26:34 2022] GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7 => generated 1873 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:26:35.089132 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b09770d2-1810-4bdb-9094-2e4e14a19d22 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:35.098925 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b09770d2-1810-4bdb-9094-2e4e14a19d22 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/f10456f4-625a-483d-98e7-e1d23d187571" status: 200 len: 1307 microversion: 2.1 time: 0.523409 Oct 19 03:26:35.101208 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1639/3337] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:34 2022] GET /compute/v2.1/servers/f10456f4-625a-483d-98e7-e1d23d187571 => generated 1307 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:26:35.446647 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-c07d2247-fd95-4b63-931e-9fa156900379 req-4f8cf8d8-7871-41b7-928c-960bc10d0635 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3136e59-f897-40c0-bf1a-1981424717ed", "name": "network-vif-plugged", "status": "completed", "tag": "8fdd9d63-2e53-4d1b-9fc9-e975b467a60e"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:26:35.459769 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-c07d2247-fd95-4b63-931e-9fa156900379 req-4f8cf8d8-7871-41b7-928c-960bc10d0635 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:35.460995 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-c07d2247-fd95-4b63-931e-9fa156900379 req-4f8cf8d8-7871-41b7-928c-960bc10d0635 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:35.461651 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-c07d2247-fd95-4b63-931e-9fa156900379 req-4f8cf8d8-7871-41b7-928c-960bc10d0635 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:35.478253 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-c07d2247-fd95-4b63-931e-9fa156900379 req-4f8cf8d8-7871-41b7-928c-960bc10d0635 service nova] Creating event network-vif-plugged:8fdd9d63-2e53-4d1b-9fc9-e975b467a60e for instance e3136e59-f897-40c0-bf1a-1981424717ed on n-h2-861333-8 Oct 19 03:26:35.487191 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-c07d2247-fd95-4b63-931e-9fa156900379 req-4f8cf8d8-7871-41b7-928c-960bc10d0635 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045882 Oct 19 03:26:35.488148 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1699/3338] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:26:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:26:35.547033 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7cc82941-10d7-4d1c-9d8b-03b62e942d63 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:35.547627 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7cc82941-10d7-4d1c-9d8b-03b62e942d63 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] [instance: e3136e59-f897-40c0-bf1a-1981424717ed] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:35.555008 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7cc82941-10d7-4d1c-9d8b-03b62e942d63 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:35.557604 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7cc82941-10d7-4d1c-9d8b-03b62e942d63 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:35.557604 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7cc82941-10d7-4d1c-9d8b-03b62e942d63 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:35.557604 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7cc82941-10d7-4d1c-9d8b-03b62e942d63 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:35.557604 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7cc82941-10d7-4d1c-9d8b-03b62e942d63 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:35.557953 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7cc82941-10d7-4d1c-9d8b-03b62e942d63 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:35.590876 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9c5068aa-e3de-4452-9110-d437a78d5394 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:35.591723 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9c5068aa-e3de-4452-9110-d437a78d5394 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 58aea4eb-a319-4bdc-99f2-eed095150ecb] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:35.603490 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9c5068aa-e3de-4452-9110-d437a78d5394 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:35.604195 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9c5068aa-e3de-4452-9110-d437a78d5394 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:35.604645 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9c5068aa-e3de-4452-9110-d437a78d5394 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:35.605629 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9c5068aa-e3de-4452-9110-d437a78d5394 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:35.607446 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9c5068aa-e3de-4452-9110-d437a78d5394 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:35.608291 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9c5068aa-e3de-4452-9110-d437a78d5394 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:35.733665 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-7cc82941-10d7-4d1c-9d8b-03b62e942d63 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2781ce2927ff43e89c90725bf2887c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcd7fa961164d20a4ca7ed8b6747530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:35.744697 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7cc82941-10d7-4d1c-9d8b-03b62e942d63 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] 10.222.0.52 "GET /compute/v2.1/servers/e3136e59-f897-40c0-bf1a-1981424717ed" status: 200 len: 1316 microversion: 2.1 time: 0.202445 Oct 19 03:26:35.745445 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1640/3339] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:35 2022] GET /compute/v2.1/servers/e3136e59-f897-40c0-bf1a-1981424717ed => generated 1316 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:26:35.751978 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d5049213-11ba-46bd-a1c5-af390ac86fac tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:35.752817 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d5049213-11ba-46bd-a1c5-af390ac86fac tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] [instance: 4adec402-e94f-4a41-ac77-68f6091b87f7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:35.759742 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d5049213-11ba-46bd-a1c5-af390ac86fac tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:35.760579 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d5049213-11ba-46bd-a1c5-af390ac86fac tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:35.761265 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d5049213-11ba-46bd-a1c5-af390ac86fac tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:35.762192 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d5049213-11ba-46bd-a1c5-af390ac86fac tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:35.762831 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d5049213-11ba-46bd-a1c5-af390ac86fac tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:35.763263 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d5049213-11ba-46bd-a1c5-af390ac86fac tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:35.784213 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-9c5068aa-e3de-4452-9110-d437a78d5394 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:35.792422 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9c5068aa-e3de-4452-9110-d437a78d5394 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/58aea4eb-a319-4bdc-99f2-eed095150ecb" status: 200 len: 1490 microversion: 2.1 time: 0.207768 Oct 19 03:26:35.795763 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1700/3340] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:35 2022] GET /compute/v2.1/servers/58aea4eb-a319-4bdc-99f2-eed095150ecb => generated 1490 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:26:35.832186 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d5049213-11ba-46bd-a1c5-af390ac86fac tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:35.834810 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:26:35.845206 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d5049213-11ba-46bd-a1c5-af390ac86fac tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:35.847106 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d5049213-11ba-46bd-a1c5-af390ac86fac tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:35.848597 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d5049213-11ba-46bd-a1c5-af390ac86fac tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] 10.222.0.52 "GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7" status: 200 len: 1873 microversion: 2.32 time: 0.102031 Oct 19 03:26:35.849658 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1641/3341] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:26:35 2022] GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7 => generated 1873 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:26:35.869922 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-98c82a6d-8b3e-40a4-b437-9a11ebb14c9b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-145055963", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "networks": [{"uuid": "05216dbc-056d-4707-86fe-afea9c8b3e8d"}]}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:26:35.927039 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.network.neutron [None req-98c82a6d-8b3e-40a4-b437-9a11ebb14c9b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] validate_networks() for [('05216dbc-056d-4707-86fe-afea9c8b3e8d', None, None, None, None, None)] {{(pid=121135) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:26:36.122911 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d4694590-80d7-4723-af80-5b84aea27af9 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:36.126297 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d4694590-80d7-4723-af80-5b84aea27af9 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: f10456f4-625a-483d-98e7-e1d23d187571] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:36.130842 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d4694590-80d7-4723-af80-5b84aea27af9 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:36.131347 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d4694590-80d7-4723-af80-5b84aea27af9 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:36.131785 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d4694590-80d7-4723-af80-5b84aea27af9 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:36.132565 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d4694590-80d7-4723-af80-5b84aea27af9 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:36.133019 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d4694590-80d7-4723-af80-5b84aea27af9 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:36.133467 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d4694590-80d7-4723-af80-5b84aea27af9 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:36.177623 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=18 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:26:36.361525 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d4694590-80d7-4723-af80-5b84aea27af9 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:36.369713 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d4694590-80d7-4723-af80-5b84aea27af9 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/f10456f4-625a-483d-98e7-e1d23d187571" status: 200 len: 1307 microversion: 2.1 time: 0.251533 Oct 19 03:26:36.370347 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1642/3342] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:36 2022] GET /compute/v2.1/servers/f10456f4-625a-483d-98e7-e1d23d187571 => generated 1307 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:26:36.405781 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-98c82a6d-8b3e-40a4-b437-9a11ebb14c9b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Flavor limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:26:36.406141 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-98c82a6d-8b3e-40a4-b437-9a11ebb14c9b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Image limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:26:36.406650 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-98c82a6d-8b3e-40a4-b437-9a11ebb14c9b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Flavor pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:26:36.407063 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-98c82a6d-8b3e-40a4-b437-9a11ebb14c9b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Image pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:26:36.407553 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-98c82a6d-8b3e-40a4-b437-9a11ebb14c9b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:26:36.416880 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-98c82a6d-8b3e-40a4-b437-9a11ebb14c9b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:36.417362 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-98c82a6d-8b3e-40a4-b437-9a11ebb14c9b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:36.417823 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-98c82a6d-8b3e-40a4-b437-9a11ebb14c9b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:36.418538 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-98c82a6d-8b3e-40a4-b437-9a11ebb14c9b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:36.418991 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-98c82a6d-8b3e-40a4-b437-9a11ebb14c9b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:36.419413 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-98c82a6d-8b3e-40a4-b437-9a11ebb14c9b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:36.436330 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-98c82a6d-8b3e-40a4-b437-9a11ebb14c9b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Getting quotas for project 7a836a10033546ed9a73a4f463587d72. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:26:36.441795 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-98c82a6d-8b3e-40a4-b437-9a11ebb14c9b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Getting quotas for user b09d2eecd3d9419189e6308379fa8a09 and project 7a836a10033546ed9a73a4f463587d72. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:26:36.456085 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-98c82a6d-8b3e-40a4-b437-9a11ebb14c9b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Going to run 1 instances... {{(pid=121135) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:26:36.459394 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-98c82a6d-8b3e-40a4-b437-9a11ebb14c9b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: ae0179a6-3cf0-4943-81b5-c971e8d10000] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121135) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:26:36.574962 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-98c82a6d-8b3e-40a4-b437-9a11ebb14c9b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.709287 Oct 19 03:26:36.575891 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1701/3343] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:26:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 711 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 03:26:36.588151 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-80caf336-a032-4789-8949-ffe7a16a0b2b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:36.588772 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-80caf336-a032-4789-8949-ffe7a16a0b2b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: ae0179a6-3cf0-4943-81b5-c971e8d10000] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:36.667269 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-80caf336-a032-4789-8949-ffe7a16a0b2b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:36.674591 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-80caf336-a032-4789-8949-ffe7a16a0b2b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/ae0179a6-3cf0-4943-81b5-c971e8d10000" status: 200 len: 1208 microversion: 2.1 time: 0.091101 Oct 19 03:26:36.683850 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1643/3344] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:36 2022] GET /compute/v2.1/servers/ae0179a6-3cf0-4943-81b5-c971e8d10000 => generated 1208 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:26:36.770909 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-252912d3-22a9-4d93-9588-a1f84f1d72b9 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:36.771529 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-252912d3-22a9-4d93-9588-a1f84f1d72b9 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] [instance: e3136e59-f897-40c0-bf1a-1981424717ed] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:36.781533 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-252912d3-22a9-4d93-9588-a1f84f1d72b9 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:36.782215 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-252912d3-22a9-4d93-9588-a1f84f1d72b9 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:36.782745 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-252912d3-22a9-4d93-9588-a1f84f1d72b9 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:36.783457 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-252912d3-22a9-4d93-9588-a1f84f1d72b9 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:36.783953 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-252912d3-22a9-4d93-9588-a1f84f1d72b9 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:36.784396 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-252912d3-22a9-4d93-9588-a1f84f1d72b9 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:36.888664 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-cebe7713-ad9f-4fec-baf8-b0061f0e1c99 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:36.899891 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-cebe7713-ad9f-4fec-baf8-b0061f0e1c99 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] [instance: 4adec402-e94f-4a41-ac77-68f6091b87f7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:36.903546 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cebe7713-ad9f-4fec-baf8-b0061f0e1c99 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:36.904228 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cebe7713-ad9f-4fec-baf8-b0061f0e1c99 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:36.904684 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cebe7713-ad9f-4fec-baf8-b0061f0e1c99 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:36.905597 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cebe7713-ad9f-4fec-baf8-b0061f0e1c99 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:36.906327 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cebe7713-ad9f-4fec-baf8-b0061f0e1c99 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:36.906968 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cebe7713-ad9f-4fec-baf8-b0061f0e1c99 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:36.952700 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-252912d3-22a9-4d93-9588-a1f84f1d72b9 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2781ce2927ff43e89c90725bf2887c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcd7fa961164d20a4ca7ed8b6747530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:36.960697 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-252912d3-22a9-4d93-9588-a1f84f1d72b9 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] 10.222.0.52 "GET /compute/v2.1/servers/e3136e59-f897-40c0-bf1a-1981424717ed" status: 200 len: 1316 microversion: 2.1 time: 0.193919 Oct 19 03:26:36.961622 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1702/3345] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:36 2022] GET /compute/v2.1/servers/e3136e59-f897-40c0-bf1a-1981424717ed => generated 1316 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:26:37.001481 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-cebe7713-ad9f-4fec-baf8-b0061f0e1c99 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:37.024076 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-cebe7713-ad9f-4fec-baf8-b0061f0e1c99 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:37.026063 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-cebe7713-ad9f-4fec-baf8-b0061f0e1c99 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:37.027495 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-cebe7713-ad9f-4fec-baf8-b0061f0e1c99 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] 10.222.0.52 "GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7" status: 200 len: 1873 microversion: 2.32 time: 0.148929 Oct 19 03:26:37.045764 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1644/3346] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:26:36 2022] GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7 => generated 1873 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:26:37.394861 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-718994b5-a6c5-47ab-8067-bd7a3a3adcf3 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:37.395491 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-718994b5-a6c5-47ab-8067-bd7a3a3adcf3 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: f10456f4-625a-483d-98e7-e1d23d187571] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:37.404124 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-718994b5-a6c5-47ab-8067-bd7a3a3adcf3 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:37.404631 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-718994b5-a6c5-47ab-8067-bd7a3a3adcf3 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:37.405279 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-718994b5-a6c5-47ab-8067-bd7a3a3adcf3 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:37.406044 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-718994b5-a6c5-47ab-8067-bd7a3a3adcf3 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:37.407124 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-718994b5-a6c5-47ab-8067-bd7a3a3adcf3 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:37.407568 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-718994b5-a6c5-47ab-8067-bd7a3a3adcf3 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:37.547612 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-718994b5-a6c5-47ab-8067-bd7a3a3adcf3 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:37.555627 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-718994b5-a6c5-47ab-8067-bd7a3a3adcf3 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/f10456f4-625a-483d-98e7-e1d23d187571" status: 200 len: 1307 microversion: 2.1 time: 0.164641 Oct 19 03:26:37.556280 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1703/3347] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:37 2022] GET /compute/v2.1/servers/f10456f4-625a-483d-98e7-e1d23d187571 => generated 1307 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:26:37.698234 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ebe3c9c2-a684-4a95-96ac-8c9f695b4dea tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:37.698903 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ebe3c9c2-a684-4a95-96ac-8c9f695b4dea tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: ae0179a6-3cf0-4943-81b5-c971e8d10000] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:37.706417 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ebe3c9c2-a684-4a95-96ac-8c9f695b4dea tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:37.707289 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ebe3c9c2-a684-4a95-96ac-8c9f695b4dea tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:37.707289 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ebe3c9c2-a684-4a95-96ac-8c9f695b4dea tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:37.707917 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ebe3c9c2-a684-4a95-96ac-8c9f695b4dea tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:37.708562 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ebe3c9c2-a684-4a95-96ac-8c9f695b4dea tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:37.708980 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ebe3c9c2-a684-4a95-96ac-8c9f695b4dea tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:37.779764 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ebe3c9c2-a684-4a95-96ac-8c9f695b4dea tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:37.787676 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ebe3c9c2-a684-4a95-96ac-8c9f695b4dea tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/ae0179a6-3cf0-4943-81b5-c971e8d10000" status: 200 len: 1212 microversion: 2.1 time: 0.094052 Oct 19 03:26:37.788282 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1645/3348] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:37 2022] GET /compute/v2.1/servers/ae0179a6-3cf0-4943-81b5-c971e8d10000 => generated 1212 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:26:37.984595 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-04416548-dda5-42b9-8f1e-6ac78839af54 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:37.985218 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-04416548-dda5-42b9-8f1e-6ac78839af54 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] [instance: e3136e59-f897-40c0-bf1a-1981424717ed] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:37.991950 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-04416548-dda5-42b9-8f1e-6ac78839af54 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:37.992625 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-04416548-dda5-42b9-8f1e-6ac78839af54 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:37.993153 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-04416548-dda5-42b9-8f1e-6ac78839af54 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:37.993932 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-04416548-dda5-42b9-8f1e-6ac78839af54 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:37.994394 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-04416548-dda5-42b9-8f1e-6ac78839af54 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:37.994964 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-04416548-dda5-42b9-8f1e-6ac78839af54 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:38.056214 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0f7d6b56-c3e9-404e-a020-d0c032115061 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:38.056844 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0f7d6b56-c3e9-404e-a020-d0c032115061 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] [instance: 4adec402-e94f-4a41-ac77-68f6091b87f7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:38.063075 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0f7d6b56-c3e9-404e-a020-d0c032115061 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:38.063571 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0f7d6b56-c3e9-404e-a020-d0c032115061 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:38.064012 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0f7d6b56-c3e9-404e-a020-d0c032115061 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:38.064906 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0f7d6b56-c3e9-404e-a020-d0c032115061 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:38.065386 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0f7d6b56-c3e9-404e-a020-d0c032115061 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:38.065828 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0f7d6b56-c3e9-404e-a020-d0c032115061 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:38.100878 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0f7d6b56-c3e9-404e-a020-d0c032115061 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:38.101383 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0f7d6b56-c3e9-404e-a020-d0c032115061 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:38.101836 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0f7d6b56-c3e9-404e-a020-d0c032115061 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:38.102292 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-0f7d6b56-c3e9-404e-a020-d0c032115061 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lazy-loading 'fault' on Instance uuid 4adec402-e94f-4a41-ac77-68f6091b87f7 {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:26:38.152765 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0f7d6b56-c3e9-404e-a020-d0c032115061 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:38.156313 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-04416548-dda5-42b9-8f1e-6ac78839af54 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2781ce2927ff43e89c90725bf2887c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcd7fa961164d20a4ca7ed8b6747530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:38.162482 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0f7d6b56-c3e9-404e-a020-d0c032115061 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:38.164072 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0f7d6b56-c3e9-404e-a020-d0c032115061 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9e45a223244d29976d3bcf6f06a1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bf3e0ec0b34e2bb80b1d09877c3fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:38.164478 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-04416548-dda5-42b9-8f1e-6ac78839af54 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] 10.222.0.52 "GET /compute/v2.1/servers/e3136e59-f897-40c0-bf1a-1981424717ed" status: 200 len: 1506 microversion: 2.1 time: 0.183843 Oct 19 03:26:38.165134 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1704/3349] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:37 2022] GET /compute/v2.1/servers/e3136e59-f897-40c0-bf1a-1981424717ed => generated 1506 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:26:38.168383 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0f7d6b56-c3e9-404e-a020-d0c032115061 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] 10.222.0.52 "GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7" status: 200 len: 1878 microversion: 2.32 time: 0.113572 Oct 19 03:26:38.169055 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1646/3350] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:26:38 2022] GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7 => generated 1878 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:26:38.190480 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6be820a4-f20d-409b-83c3-a2b42d1e0da2 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:38.190981 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6be820a4-f20d-409b-83c3-a2b42d1e0da2 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] [instance: e3136e59-f897-40c0-bf1a-1981424717ed] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:38.197879 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6be820a4-f20d-409b-83c3-a2b42d1e0da2 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:38.198364 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6be820a4-f20d-409b-83c3-a2b42d1e0da2 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:38.198806 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6be820a4-f20d-409b-83c3-a2b42d1e0da2 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:38.199499 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6be820a4-f20d-409b-83c3-a2b42d1e0da2 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:38.199952 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6be820a4-f20d-409b-83c3-a2b42d1e0da2 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:38.200382 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6be820a4-f20d-409b-83c3-a2b42d1e0da2 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:38.224096 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6be820a4-f20d-409b-83c3-a2b42d1e0da2 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] 10.222.0.52 "GET /compute/v2.1/servers/e3136e59-f897-40c0-bf1a-1981424717ed/ips" status: 200 len: 110 microversion: 2.1 time: 0.037443 Oct 19 03:26:38.224668 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1705/3351] 10.222.0.52 () {58 vars in 1248 bytes} [Wed Oct 19 03:26:38 2022] GET /compute/v2.1/servers/e3136e59-f897-40c0-bf1a-1981424717ed/ips => generated 110 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:26:38.246243 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-bb5169aa-a85c-49db-890f-5dcd479bbaa8 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:38.246755 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-bb5169aa-a85c-49db-890f-5dcd479bbaa8 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] [instance: e3136e59-f897-40c0-bf1a-1981424717ed] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:38.252823 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bb5169aa-a85c-49db-890f-5dcd479bbaa8 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:38.253316 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bb5169aa-a85c-49db-890f-5dcd479bbaa8 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:38.253791 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bb5169aa-a85c-49db-890f-5dcd479bbaa8 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:38.254490 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bb5169aa-a85c-49db-890f-5dcd479bbaa8 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:38.254951 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bb5169aa-a85c-49db-890f-5dcd479bbaa8 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:38.255383 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bb5169aa-a85c-49db-890f-5dcd479bbaa8 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:38.282499 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-bb5169aa-a85c-49db-890f-5dcd479bbaa8 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] 10.222.0.52 "GET /compute/v2.1/servers/e3136e59-f897-40c0-bf1a-1981424717ed/ips" status: 200 len: 110 microversion: 2.1 time: 0.040635 Oct 19 03:26:38.283225 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1647/3352] 10.222.0.52 () {58 vars in 1248 bytes} [Wed Oct 19 03:26:38 2022] GET /compute/v2.1/servers/e3136e59-f897-40c0-bf1a-1981424717ed/ips => generated 110 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:26:38.294303 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4e509c95-4333-490a-9e03-b5fc62c6afc0 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:38.294809 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4e509c95-4333-490a-9e03-b5fc62c6afc0 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] [instance: e3136e59-f897-40c0-bf1a-1981424717ed] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:38.300760 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4e509c95-4333-490a-9e03-b5fc62c6afc0 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:38.301245 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4e509c95-4333-490a-9e03-b5fc62c6afc0 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:38.301725 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4e509c95-4333-490a-9e03-b5fc62c6afc0 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:38.302422 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4e509c95-4333-490a-9e03-b5fc62c6afc0 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:38.302883 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4e509c95-4333-490a-9e03-b5fc62c6afc0 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:38.303316 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4e509c95-4333-490a-9e03-b5fc62c6afc0 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:38.328172 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4e509c95-4333-490a-9e03-b5fc62c6afc0 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] 10.222.0.52 "GET /compute/v2.1/servers/e3136e59-f897-40c0-bf1a-1981424717ed/ips/tempest-ServerAddressesTestJSON-1582482969-network" status: 200 len: 95 microversion: 2.1 time: 0.037700 Oct 19 03:26:38.331025 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1706/3353] 10.222.0.52 () {58 vars in 1401 bytes} [Wed Oct 19 03:26:38 2022] GET /compute/v2.1/servers/e3136e59-f897-40c0-bf1a-1981424717ed/ips/tempest-ServerAddressesTestJSON-1582482969-network => generated 95 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 03:26:38.340467 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-cbe10641-26f4-4c3a-90a6-73e657a02626 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:38.340973 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-cbe10641-26f4-4c3a-90a6-73e657a02626 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] [instance: e3136e59-f897-40c0-bf1a-1981424717ed] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:38.347468 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cbe10641-26f4-4c3a-90a6-73e657a02626 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:38.351384 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cbe10641-26f4-4c3a-90a6-73e657a02626 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:38.351384 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cbe10641-26f4-4c3a-90a6-73e657a02626 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:38.351384 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cbe10641-26f4-4c3a-90a6-73e657a02626 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:38.351384 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cbe10641-26f4-4c3a-90a6-73e657a02626 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:38.351731 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cbe10641-26f4-4c3a-90a6-73e657a02626 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:38.376607 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-cbe10641-26f4-4c3a-90a6-73e657a02626 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] [instance: e3136e59-f897-40c0-bf1a-1981424717ed] Going to try to terminate instance {{(pid=121134) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:26:38.578886 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-23857ace-31b6-41d4-8214-bf96379ae79a tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:38.579501 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-23857ace-31b6-41d4-8214-bf96379ae79a tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: f10456f4-625a-483d-98e7-e1d23d187571] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:38.586693 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-23857ace-31b6-41d4-8214-bf96379ae79a tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:38.595062 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-23857ace-31b6-41d4-8214-bf96379ae79a tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:38.595062 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-23857ace-31b6-41d4-8214-bf96379ae79a tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:38.595062 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-23857ace-31b6-41d4-8214-bf96379ae79a tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:38.595062 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-23857ace-31b6-41d4-8214-bf96379ae79a tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:38.595642 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-23857ace-31b6-41d4-8214-bf96379ae79a tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:38.728362 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-23857ace-31b6-41d4-8214-bf96379ae79a tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:38.732217 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=100 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:26:38.739659 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-23857ace-31b6-41d4-8214-bf96379ae79a tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/f10456f4-625a-483d-98e7-e1d23d187571" status: 200 len: 1307 microversion: 2.1 time: 0.162234 Oct 19 03:26:38.739659 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1707/3354] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:38 2022] GET /compute/v2.1/servers/f10456f4-625a-483d-98e7-e1d23d187571 => generated 1307 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:26:38.806713 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-cbe10641-26f4-4c3a-90a6-73e657a02626 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] 10.222.0.52 "DELETE /compute/v2.1/servers/e3136e59-f897-40c0-bf1a-1981424717ed" status: 204 len: 0 microversion: 2.1 time: 0.469833 Oct 19 03:26:38.807392 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1648/3355] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:26:38 2022] DELETE /compute/v2.1/servers/e3136e59-f897-40c0-bf1a-1981424717ed => generated 0 bytes in 471 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:26:38.811071 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-198f36a8-6538-430a-b55f-c21fd0a13115 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:38.811718 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-198f36a8-6538-430a-b55f-c21fd0a13115 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: ae0179a6-3cf0-4943-81b5-c971e8d10000] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:38.814704 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:26:38.815807 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3614258b-1ca5-426c-b58c-fcbeb42eb76d tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:38.816518 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3614258b-1ca5-426c-b58c-fcbeb42eb76d tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] [instance: e3136e59-f897-40c0-bf1a-1981424717ed] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:38.818259 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-198f36a8-6538-430a-b55f-c21fd0a13115 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:38.818744 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-198f36a8-6538-430a-b55f-c21fd0a13115 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:38.819413 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-198f36a8-6538-430a-b55f-c21fd0a13115 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:38.820015 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-198f36a8-6538-430a-b55f-c21fd0a13115 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:38.820483 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-198f36a8-6538-430a-b55f-c21fd0a13115 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:38.821013 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-198f36a8-6538-430a-b55f-c21fd0a13115 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:38.822389 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3614258b-1ca5-426c-b58c-fcbeb42eb76d tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:38.822871 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3614258b-1ca5-426c-b58c-fcbeb42eb76d tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:38.823304 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3614258b-1ca5-426c-b58c-fcbeb42eb76d tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:38.823986 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3614258b-1ca5-426c-b58c-fcbeb42eb76d tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:38.824435 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3614258b-1ca5-426c-b58c-fcbeb42eb76d tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:38.824857 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3614258b-1ca5-426c-b58c-fcbeb42eb76d tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:38.895583 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-198f36a8-6538-430a-b55f-c21fd0a13115 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:38.904119 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-198f36a8-6538-430a-b55f-c21fd0a13115 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/ae0179a6-3cf0-4943-81b5-c971e8d10000" status: 200 len: 1260 microversion: 2.1 time: 0.097233 Oct 19 03:26:38.904698 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1708/3356] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:38 2022] GET /compute/v2.1/servers/ae0179a6-3cf0-4943-81b5-c971e8d10000 => generated 1260 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:26:38.981418 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-3614258b-1ca5-426c-b58c-fcbeb42eb76d tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2781ce2927ff43e89c90725bf2887c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcd7fa961164d20a4ca7ed8b6747530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:38.989333 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3614258b-1ca5-426c-b58c-fcbeb42eb76d tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] 10.222.0.52 "GET /compute/v2.1/servers/e3136e59-f897-40c0-bf1a-1981424717ed" status: 200 len: 1512 microversion: 2.1 time: 0.177579 Oct 19 03:26:38.990024 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1649/3357] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:38 2022] GET /compute/v2.1/servers/e3136e59-f897-40c0-bf1a-1981424717ed => generated 1512 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:26:39.185985 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-02d13744-a315-4949-b06b-7149e4701038 req-f35edbf6-3af4-4220-80b2-2f0023d937df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f10456f4-625a-483d-98e7-e1d23d187571", "name": "network-vif-plugged", "status": "completed", "tag": "bae859a8-4017-4db1-8eed-d383aed6e87f"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:26:39.196510 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-081dab7a-a343-46ef-ad44-e280b1438cd3 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:39.197125 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-02d13744-a315-4949-b06b-7149e4701038 req-f35edbf6-3af4-4220-80b2-2f0023d937df service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:39.197250 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-081dab7a-a343-46ef-ad44-e280b1438cd3 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] [instance: 4adec402-e94f-4a41-ac77-68f6091b87f7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:39.197647 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-02d13744-a315-4949-b06b-7149e4701038 req-f35edbf6-3af4-4220-80b2-2f0023d937df service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:39.198088 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-02d13744-a315-4949-b06b-7149e4701038 req-f35edbf6-3af4-4220-80b2-2f0023d937df service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:39.203299 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-081dab7a-a343-46ef-ad44-e280b1438cd3 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:39.203794 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-081dab7a-a343-46ef-ad44-e280b1438cd3 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:39.204241 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-081dab7a-a343-46ef-ad44-e280b1438cd3 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:39.204941 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-081dab7a-a343-46ef-ad44-e280b1438cd3 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:39.205489 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-081dab7a-a343-46ef-ad44-e280b1438cd3 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:39.205927 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-081dab7a-a343-46ef-ad44-e280b1438cd3 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:39.209996 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-02d13744-a315-4949-b06b-7149e4701038 req-f35edbf6-3af4-4220-80b2-2f0023d937df service nova] Creating event network-vif-plugged:bae859a8-4017-4db1-8eed-d383aed6e87f for instance f10456f4-625a-483d-98e7-e1d23d187571 on n-h2-861333-8 Oct 19 03:26:39.218133 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-02d13744-a315-4949-b06b-7149e4701038 req-f35edbf6-3af4-4220-80b2-2f0023d937df service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034501 Oct 19 03:26:39.218133 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1709/3358] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:26:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:26:39.221931 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-081dab7a-a343-46ef-ad44-e280b1438cd3 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] HTTP exception thrown: Instance 4adec402-e94f-4a41-ac77-68f6091b87f7 could not be found. Oct 19 03:26:39.223701 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-081dab7a-a343-46ef-ad44-e280b1438cd3 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Request method failure captured: Oct 19 03:26:39.223701 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7 HTTP/1.1 Oct 19 03:26:39.223701 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:26:39.223701 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:26:39.223701 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:26:39.223701 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:26:39.223701 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:26:39.223701 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:26:39.223701 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:26:39.223701 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:26:39.223701 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT2yaSUgrwCLmY4HgXwmwjC51uvlVETUqKYqmgdp9PAUprB1RIcHQ2Hce-XszCP9B3VI6NpUfhqiGNHScwJ4ZvbkypOsNRsBG0yhpNQ3g1zelXuPppEc50u7kyYyfQKlaYISsCPT6Jiz6jQ9glRDqRqTvMuY19umdkDjb3Wep6ud5-m4 Oct 19 03:26:39.223701 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:26:39.223701 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:26:39.223701 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:26:39.223701 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:26:39.223701 n-d-861333-8 devstack@n-api.service[121134]: X-Openstack-Nova-Api-Version: 2.32 Oct 19 03:26:39.223701 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:26:39.223701 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:26:39.223701 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: b8bf3e0ec0b34e2bb80b1d09877c3fd0 Oct 19 03:26:39.223701 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-TaggedBootDevicesTest-560118694 Oct 19 03:26:39.223701 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:26:39.223701 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:26:39.225515 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b8bf3e0ec0b34e2bb80b1d09877c3fd0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b8bf3e0ec0b34e2bb80b1d09877c3fd0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b8bf3e0ec0b34e2bb80b1d09877c3fd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b8bf3e0ec0b34e2bb80b1d09877c3fd0", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:26:39.225515 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-TaggedBootDevicesTest-560118694 Oct 19 03:26:39.225515 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: b8bf3e0ec0b34e2bb80b1d09877c3fd0 Oct 19 03:26:39.225515 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-TaggedBootDevicesTest-560118694 Oct 19 03:26:39.225515 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-TaggedBootDevicesTest-560118694-project Oct 19 03:26:39.225515 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:26:39.225515 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:26:39.225515 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: ca9e45a223244d29976d3bcf6f06a1d2 Oct 19 03:26:39.225515 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-TaggedBootDevicesTest-560118694-project Oct 19 03:26:39.225515 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:26:39.225515 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance 4adec402-e94f-4a41-ac77-68f6091b87f7 could not be found. Oct 19 03:26:39.225515 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '4adec402-e94f-4a41-ac77-68f6091b87f7'} Oct 19 03:26:39.226693 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:26:39.226693 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:26:39.226693 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:26:39.226693 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:26:39.226693 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:26:39.226693 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:26:39.226693 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:26:39.226693 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:26:39.226693 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:26:39.226693 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:26:39.226693 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4adec402-e94f-4a41-ac77-68f6091b87f7 could not be found. Oct 19 03:26:39.226693 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:26:39.226693 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:26:39.226693 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:26:39.226693 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:26:39.226693 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:26:39.226693 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:26:39.226693 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:26:39.226693 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:26:39.226693 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:26:39.227997 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:26:39.227997 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:26:39.227997 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:26:39.227997 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:26:39.227997 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:26:39.227997 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:26:39.227997 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:26:39.227997 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4adec402-e94f-4a41-ac77-68f6091b87f7 could not be found. Oct 19 03:26:39.227997 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:26:39.227997 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:26:39.227997 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:26:39.227997 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:26:39.227997 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:26:39.227997 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:26:39.227997 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:26:39.227997 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:26:39.227997 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4adec402-e94f-4a41-ac77-68f6091b87f7 could not be found. Oct 19 03:26:39.227997 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:26:39.229349 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-081dab7a-a343-46ef-ad44-e280b1438cd3 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Returning 404 to user: Instance 4adec402-e94f-4a41-ac77-68f6091b87f7 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:26:39.229349 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-081dab7a-a343-46ef-ad44-e280b1438cd3 tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] 10.222.0.52 "GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7" status: 404 len: 111 microversion: 2.32 time: 0.032985 Oct 19 03:26:39.229349 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1650/3359] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:26:39 2022] GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 19 03:26:39.235655 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-be973320-180c-4763-b754-0bab530c30bf tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Calling method '.version_select at 0x7fc130047f70>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:39.357062 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-be973320-180c-4763-b754-0bab530c30bf tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1702125918" status: 204 len: 0 microversion: 2.32 time: 0.125727 Oct 19 03:26:39.360613 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1710/3360] 10.222.0.52 () {60 vars in 1262 bytes} [Wed Oct 19 03:26:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1702125918 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 19 03:26:39.760543 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d2777f33-db14-4ba3-a732-8596c9cc8957 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:39.761170 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d2777f33-db14-4ba3-a732-8596c9cc8957 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: f10456f4-625a-483d-98e7-e1d23d187571] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:39.768224 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d2777f33-db14-4ba3-a732-8596c9cc8957 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:39.768948 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d2777f33-db14-4ba3-a732-8596c9cc8957 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:39.769609 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d2777f33-db14-4ba3-a732-8596c9cc8957 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:39.770505 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d2777f33-db14-4ba3-a732-8596c9cc8957 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:39.771127 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d2777f33-db14-4ba3-a732-8596c9cc8957 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:39.771722 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d2777f33-db14-4ba3-a732-8596c9cc8957 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:39.922817 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d2777f33-db14-4ba3-a732-8596c9cc8957 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:39.929177 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1db1343a-ca83-4512-8f6a-815e28c020c5 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:39.930447 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1db1343a-ca83-4512-8f6a-815e28c020c5 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: ae0179a6-3cf0-4943-81b5-c971e8d10000] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:39.942372 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1db1343a-ca83-4512-8f6a-815e28c020c5 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:39.942870 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1db1343a-ca83-4512-8f6a-815e28c020c5 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:39.943310 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1db1343a-ca83-4512-8f6a-815e28c020c5 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:39.943996 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d2777f33-db14-4ba3-a732-8596c9cc8957 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/f10456f4-625a-483d-98e7-e1d23d187571" status: 200 len: 1307 microversion: 2.1 time: 0.187772 Oct 19 03:26:39.944118 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1db1343a-ca83-4512-8f6a-815e28c020c5 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:39.944467 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1db1343a-ca83-4512-8f6a-815e28c020c5 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:39.944764 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1651/3361] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:39 2022] GET /compute/v2.1/servers/f10456f4-625a-483d-98e7-e1d23d187571 => generated 1307 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:26:39.950737 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1db1343a-ca83-4512-8f6a-815e28c020c5 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:40.013820 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-66670e00-5cdd-4e6f-a22f-54eb44eae462 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:40.014456 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-66670e00-5cdd-4e6f-a22f-54eb44eae462 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] [instance: e3136e59-f897-40c0-bf1a-1981424717ed] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:40.025932 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-1db1343a-ca83-4512-8f6a-815e28c020c5 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:40.026756 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-66670e00-5cdd-4e6f-a22f-54eb44eae462 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:40.027303 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-66670e00-5cdd-4e6f-a22f-54eb44eae462 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:40.029556 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-66670e00-5cdd-4e6f-a22f-54eb44eae462 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:40.033515 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-66670e00-5cdd-4e6f-a22f-54eb44eae462 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:40.034212 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-66670e00-5cdd-4e6f-a22f-54eb44eae462 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:40.035524 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-66670e00-5cdd-4e6f-a22f-54eb44eae462 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:40.048003 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1db1343a-ca83-4512-8f6a-815e28c020c5 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/ae0179a6-3cf0-4943-81b5-c971e8d10000" status: 200 len: 1266 microversion: 2.1 time: 0.123325 Oct 19 03:26:40.056166 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1711/3362] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:39 2022] GET /compute/v2.1/servers/ae0179a6-3cf0-4943-81b5-c971e8d10000 => generated 1266 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:26:40.218652 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-66670e00-5cdd-4e6f-a22f-54eb44eae462 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2781ce2927ff43e89c90725bf2887c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcd7fa961164d20a4ca7ed8b6747530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:40.226771 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-66670e00-5cdd-4e6f-a22f-54eb44eae462 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] 10.222.0.52 "GET /compute/v2.1/servers/e3136e59-f897-40c0-bf1a-1981424717ed" status: 200 len: 1512 microversion: 2.1 time: 0.218135 Oct 19 03:26:40.227339 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1652/3363] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:40 2022] GET /compute/v2.1/servers/e3136e59-f897-40c0-bf1a-1981424717ed => generated 1512 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:26:40.970037 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-08112ddb-ec1d-4251-a46e-afaf20c68c78 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:40.970037 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-08112ddb-ec1d-4251-a46e-afaf20c68c78 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: f10456f4-625a-483d-98e7-e1d23d187571] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:40.982587 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-08112ddb-ec1d-4251-a46e-afaf20c68c78 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:40.982999 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-b1d322bc-8d5e-42dd-8457-82b8d8ec77d7 req-2d41a5a8-5fef-4bb2-a4b5-7410dd5d979d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3136e59-f897-40c0-bf1a-1981424717ed", "name": "network-vif-deleted", "tag": "8fdd9d63-2e53-4d1b-9fc9-e975b467a60e"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:26:40.983466 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-08112ddb-ec1d-4251-a46e-afaf20c68c78 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:40.983568 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-08112ddb-ec1d-4251-a46e-afaf20c68c78 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:40.984288 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-08112ddb-ec1d-4251-a46e-afaf20c68c78 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:40.984762 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-08112ddb-ec1d-4251-a46e-afaf20c68c78 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:40.985199 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-08112ddb-ec1d-4251-a46e-afaf20c68c78 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:41.003312 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-b1d322bc-8d5e-42dd-8457-82b8d8ec77d7 req-2d41a5a8-5fef-4bb2-a4b5-7410dd5d979d service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:41.003870 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-b1d322bc-8d5e-42dd-8457-82b8d8ec77d7 req-2d41a5a8-5fef-4bb2-a4b5-7410dd5d979d service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:41.004349 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-b1d322bc-8d5e-42dd-8457-82b8d8ec77d7 req-2d41a5a8-5fef-4bb2-a4b5-7410dd5d979d service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:41.025078 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-b1d322bc-8d5e-42dd-8457-82b8d8ec77d7 req-2d41a5a8-5fef-4bb2-a4b5-7410dd5d979d service nova] Creating event network-vif-deleted:8fdd9d63-2e53-4d1b-9fc9-e975b467a60e for instance e3136e59-f897-40c0-bf1a-1981424717ed on n-h2-861333-8 Oct 19 03:26:41.032145 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-b1d322bc-8d5e-42dd-8457-82b8d8ec77d7 req-2d41a5a8-5fef-4bb2-a4b5-7410dd5d979d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053487 Oct 19 03:26:41.042665 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1653/3364] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:26:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:26:41.081273 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-08e63a8a-e0c6-4e33-9976-a34eaa818968 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:41.082448 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-08e63a8a-e0c6-4e33-9976-a34eaa818968 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: ae0179a6-3cf0-4943-81b5-c971e8d10000] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:41.091378 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-08e63a8a-e0c6-4e33-9976-a34eaa818968 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:41.092364 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-08e63a8a-e0c6-4e33-9976-a34eaa818968 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:41.093003 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-08e63a8a-e0c6-4e33-9976-a34eaa818968 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:41.094091 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-08e63a8a-e0c6-4e33-9976-a34eaa818968 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:41.094732 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-08e63a8a-e0c6-4e33-9976-a34eaa818968 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:41.095340 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-08e63a8a-e0c6-4e33-9976-a34eaa818968 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:41.301217 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-08112ddb-ec1d-4251-a46e-afaf20c68c78 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:41.313225 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-08112ddb-ec1d-4251-a46e-afaf20c68c78 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/f10456f4-625a-483d-98e7-e1d23d187571" status: 200 len: 1307 microversion: 2.1 time: 0.349706 Oct 19 03:26:41.314652 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1712/3365] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:40 2022] GET /compute/v2.1/servers/f10456f4-625a-483d-98e7-e1d23d187571 => generated 1307 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:26:41.320995 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6bc2a95c-3735-4ff8-9ba8-ae8b49593ddd tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:41.323839 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6bc2a95c-3735-4ff8-9ba8-ae8b49593ddd tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] [instance: e3136e59-f897-40c0-bf1a-1981424717ed] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:41.328220 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6bc2a95c-3735-4ff8-9ba8-ae8b49593ddd tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:41.329122 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6bc2a95c-3735-4ff8-9ba8-ae8b49593ddd tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:41.329849 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6bc2a95c-3735-4ff8-9ba8-ae8b49593ddd tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:41.330550 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6bc2a95c-3735-4ff8-9ba8-ae8b49593ddd tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:41.331292 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6bc2a95c-3735-4ff8-9ba8-ae8b49593ddd tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:41.331928 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6bc2a95c-3735-4ff8-9ba8-ae8b49593ddd tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:41.340876 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-08e63a8a-e0c6-4e33-9976-a34eaa818968 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:41.351015 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-08e63a8a-e0c6-4e33-9976-a34eaa818968 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/ae0179a6-3cf0-4943-81b5-c971e8d10000" status: 200 len: 1308 microversion: 2.1 time: 0.275435 Oct 19 03:26:41.352345 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1654/3366] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:41 2022] GET /compute/v2.1/servers/ae0179a6-3cf0-4943-81b5-c971e8d10000 => generated 1308 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:26:41.407810 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-6bc2a95c-3735-4ff8-9ba8-ae8b49593ddd tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2781ce2927ff43e89c90725bf2887c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcd7fa961164d20a4ca7ed8b6747530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:41.415804 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6bc2a95c-3735-4ff8-9ba8-ae8b49593ddd tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] 10.222.0.52 "GET /compute/v2.1/servers/e3136e59-f897-40c0-bf1a-1981424717ed" status: 200 len: 1301 microversion: 2.1 time: 0.099995 Oct 19 03:26:41.416382 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1713/3367] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:41 2022] GET /compute/v2.1/servers/e3136e59-f897-40c0-bf1a-1981424717ed => generated 1301 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:26:42.304060 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1d5a5ecd-6bd2-4efb-9aa0-75bb30e9d468 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fbe9bac4-90da-472e-9686-713706d14d10"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:26:42.305766 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1d5a5ecd-6bd2-4efb-9aa0-75bb30e9d468 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] [instance: 2870c53d-df7c-45d3-b8bd-c88966ad6315] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:42.314004 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1d5a5ecd-6bd2-4efb-9aa0-75bb30e9d468 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:42.314505 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1d5a5ecd-6bd2-4efb-9aa0-75bb30e9d468 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:42.315089 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1d5a5ecd-6bd2-4efb-9aa0-75bb30e9d468 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:42.315883 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1d5a5ecd-6bd2-4efb-9aa0-75bb30e9d468 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:42.316351 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1d5a5ecd-6bd2-4efb-9aa0-75bb30e9d468 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:42.322050 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-141d49f5-8a7a-435a-a0a8-266aad10dc79 req-968485b6-4cf2-4acc-834b-7aa86d274e16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae0179a6-3cf0-4943-81b5-c971e8d10000", "tag": "640d0b38-8205-42b6-803c-1c1cd6c518e8"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:26:42.330065 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1d5a5ecd-6bd2-4efb-9aa0-75bb30e9d468 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:42.338278 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-141d49f5-8a7a-435a-a0a8-266aad10dc79 req-968485b6-4cf2-4acc-834b-7aa86d274e16 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:42.338771 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-141d49f5-8a7a-435a-a0a8-266aad10dc79 req-968485b6-4cf2-4acc-834b-7aa86d274e16 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:42.339217 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-141d49f5-8a7a-435a-a0a8-266aad10dc79 req-968485b6-4cf2-4acc-834b-7aa86d274e16 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:42.352274 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-141d49f5-8a7a-435a-a0a8-266aad10dc79 req-968485b6-4cf2-4acc-834b-7aa86d274e16 service nova] Creating event network-changed:640d0b38-8205-42b6-803c-1c1cd6c518e8 for instance ae0179a6-3cf0-4943-81b5-c971e8d10000 on n-h1-861333-8 Oct 19 03:26:42.357576 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-141d49f5-8a7a-435a-a0a8-266aad10dc79 req-968485b6-4cf2-4acc-834b-7aa86d274e16 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039194 Oct 19 03:26:42.358803 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1714/3368] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:26:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:26:42.365878 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7b6a0298-74d1-4c4e-886a-ef3d3e58d74c tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:42.367538 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7b6a0298-74d1-4c4e-886a-ef3d3e58d74c tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: f10456f4-625a-483d-98e7-e1d23d187571] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:42.373896 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7b6a0298-74d1-4c4e-886a-ef3d3e58d74c tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:42.374398 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7b6a0298-74d1-4c4e-886a-ef3d3e58d74c tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:42.374848 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7b6a0298-74d1-4c4e-886a-ef3d3e58d74c tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:42.375703 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7b6a0298-74d1-4c4e-886a-ef3d3e58d74c tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:42.376309 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7b6a0298-74d1-4c4e-886a-ef3d3e58d74c tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:42.376772 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7b6a0298-74d1-4c4e-886a-ef3d3e58d74c tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:42.625463 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7b6a0298-74d1-4c4e-886a-ef3d3e58d74c tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:42.634406 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7b6a0298-74d1-4c4e-886a-ef3d3e58d74c tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/f10456f4-625a-483d-98e7-e1d23d187571" status: 200 len: 1486 microversion: 2.1 time: 0.274246 Oct 19 03:26:42.635722 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1715/3369] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:42 2022] GET /compute/v2.1/servers/f10456f4-625a-483d-98e7-e1d23d187571 => generated 1486 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:26:42.645256 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9029a2eb-989c-4e55-8515-8e7b8dd21cdd tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:42.646321 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9029a2eb-989c-4e55-8515-8e7b8dd21cdd tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: ae0179a6-3cf0-4943-81b5-c971e8d10000] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:42.654230 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9029a2eb-989c-4e55-8515-8e7b8dd21cdd tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:42.654863 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9029a2eb-989c-4e55-8515-8e7b8dd21cdd tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:42.655479 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9029a2eb-989c-4e55-8515-8e7b8dd21cdd tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:42.656987 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9029a2eb-989c-4e55-8515-8e7b8dd21cdd tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:42.656987 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9029a2eb-989c-4e55-8515-8e7b8dd21cdd tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:42.657548 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9029a2eb-989c-4e55-8515-8e7b8dd21cdd tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:42.663048 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:26:42.880317 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-9029a2eb-989c-4e55-8515-8e7b8dd21cdd tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:42.890010 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9029a2eb-989c-4e55-8515-8e7b8dd21cdd tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/ae0179a6-3cf0-4943-81b5-c971e8d10000" status: 200 len: 1308 microversion: 2.1 time: 0.252867 Oct 19 03:26:42.901779 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1716/3370] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:42 2022] GET /compute/v2.1/servers/ae0179a6-3cf0-4943-81b5-c971e8d10000 => generated 1308 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:26:42.901779 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b62214d9-a721-4b9d-87dc-91049a8b0309 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:42.901779 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b62214d9-a721-4b9d-87dc-91049a8b0309 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] [instance: e3136e59-f897-40c0-bf1a-1981424717ed] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:42.907672 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b62214d9-a721-4b9d-87dc-91049a8b0309 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:42.907672 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b62214d9-a721-4b9d-87dc-91049a8b0309 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:42.907672 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b62214d9-a721-4b9d-87dc-91049a8b0309 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:42.907672 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b62214d9-a721-4b9d-87dc-91049a8b0309 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:42.908022 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b62214d9-a721-4b9d-87dc-91049a8b0309 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:42.908022 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b62214d9-a721-4b9d-87dc-91049a8b0309 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:42.924516 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-b62214d9-a721-4b9d-87dc-91049a8b0309 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] HTTP exception thrown: Instance e3136e59-f897-40c0-bf1a-1981424717ed could not be found. Oct 19 03:26:42.937192 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b62214d9-a721-4b9d-87dc-91049a8b0309 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Request method failure captured: Oct 19 03:26:42.937192 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/e3136e59-f897-40c0-bf1a-1981424717ed HTTP/1.1 Oct 19 03:26:42.937192 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:26:42.937192 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:26:42.937192 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:26:42.937192 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:26:42.937192 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:26:42.937192 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:26:42.937192 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:26:42.937192 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:26:42.937192 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT25d8zwhL431zz2FhyZ9FZztUWedUMXGJaRrf5Cz0_d7ERjEmJ32p-LyB69lYDNEAMKp_hg6lOePv3F2-nQnYNveF33cZthocEjc3lPEu1YKHDGDWB-kuKRgqF9bo3qqYoC2oLEea4joH9wz8A6GSPK5x9o_r6PBV0j95bGwIB7uAP4 Oct 19 03:26:42.937192 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:26:42.937192 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:26:42.937192 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:26:42.937192 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:26:42.937192 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:26:42.937192 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:26:42.937192 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: bbcd7fa961164d20a4ca7ed8b6747530 Oct 19 03:26:42.937192 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ServerAddressesTestJSON-1777129266 Oct 19 03:26:42.937192 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:26:42.937192 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:26:42.939009 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/bbcd7fa961164d20a4ca7ed8b6747530"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/bbcd7fa961164d20a4ca7ed8b6747530"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/bbcd7fa961164d20a4ca7ed8b6747530"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_bbcd7fa961164d20a4ca7ed8b6747530", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:26:42.939009 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ServerAddressesTestJSON-1777129266 Oct 19 03:26:42.939009 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: bbcd7fa961164d20a4ca7ed8b6747530 Oct 19 03:26:42.939009 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ServerAddressesTestJSON-1777129266 Oct 19 03:26:42.939009 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ServerAddressesTestJSON-1777129266-project Oct 19 03:26:42.939009 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:26:42.939009 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:26:42.939009 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 2781ce2927ff43e89c90725bf2887c5b Oct 19 03:26:42.939009 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ServerAddressesTestJSON-1777129266-project Oct 19 03:26:42.939009 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:26:42.939009 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance e3136e59-f897-40c0-bf1a-1981424717ed could not be found. Oct 19 03:26:42.939009 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': 'e3136e59-f897-40c0-bf1a-1981424717ed'} Oct 19 03:26:42.939922 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:26:42.939922 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:26:42.939922 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:26:42.939922 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:26:42.939922 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:26:42.939922 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:26:42.939922 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:26:42.939922 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:26:42.939922 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:26:42.939922 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:26:42.939922 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3136e59-f897-40c0-bf1a-1981424717ed could not be found. Oct 19 03:26:42.939922 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:26:42.939922 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:26:42.939922 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:26:42.939922 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:26:42.939922 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:26:42.939922 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:26:42.939922 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:26:42.939922 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:26:42.939922 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:26:42.941621 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:26:42.941621 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:26:42.941621 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:26:42.941621 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:26:42.941621 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:26:42.941621 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:26:42.941621 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:26:42.941621 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3136e59-f897-40c0-bf1a-1981424717ed could not be found. Oct 19 03:26:42.941621 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:26:42.941621 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:26:42.941621 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:26:42.941621 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:26:42.941621 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:26:42.941621 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:26:42.941621 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:26:42.941621 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:26:42.941621 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3136e59-f897-40c0-bf1a-1981424717ed could not be found. Oct 19 03:26:42.941621 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:26:42.943048 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b62214d9-a721-4b9d-87dc-91049a8b0309 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] Returning 404 to user: Instance e3136e59-f897-40c0-bf1a-1981424717ed could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:26:42.943048 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b62214d9-a721-4b9d-87dc-91049a8b0309 tempest-ServerAddressesTestJSON-1777129266 tempest-ServerAddressesTestJSON-1777129266-project] 10.222.0.52 "GET /compute/v2.1/servers/e3136e59-f897-40c0-bf1a-1981424717ed" status: 404 len: 111 microversion: 2.1 time: 0.047014 Oct 19 03:26:42.943814 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1717/3371] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:42 2022] GET /compute/v2.1/servers/e3136e59-f897-40c0-bf1a-1981424717ed => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:26:42.950604 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7864d64e-b5f0-4d16-92d5-3cb8ede07280 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-186417883"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:26:42.953027 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7864d64e-b5f0-4d16-92d5-3cb8ede07280 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: f10456f4-625a-483d-98e7-e1d23d187571] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:42.960017 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7864d64e-b5f0-4d16-92d5-3cb8ede07280 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:42.960537 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7864d64e-b5f0-4d16-92d5-3cb8ede07280 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:42.961109 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7864d64e-b5f0-4d16-92d5-3cb8ede07280 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:42.961848 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7864d64e-b5f0-4d16-92d5-3cb8ede07280 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:42.962360 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7864d64e-b5f0-4d16-92d5-3cb8ede07280 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:42.962797 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7864d64e-b5f0-4d16-92d5-3cb8ede07280 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:43.319223 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1d5a5ecd-6bd2-4efb-9aa0-75bb30e9d468 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] 10.222.0.52 "POST /compute/v2.1/servers/2870c53d-df7c-45d3-b8bd-c88966ad6315/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.026660 Oct 19 03:26:43.324446 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1655/3372] 10.222.0.52 () {60 vars in 1323 bytes} [Wed Oct 19 03:26:42 2022] POST /compute/v2.1/servers/2870c53d-df7c-45d3-b8bd-c88966ad6315/os-volume_attachments => generated 194 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:26:43.535087 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7864d64e-b5f0-4d16-92d5-3cb8ede07280 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "POST /compute/v2.1/servers/f10456f4-625a-483d-98e7-e1d23d187571/action" status: 202 len: 0 microversion: 2.1 time: 0.589712 Oct 19 03:26:43.536682 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1718/3373] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:26:42 2022] POST /compute/v2.1/servers/f10456f4-625a-483d-98e7-e1d23d187571/action => generated 0 bytes in 592 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 19 03:26:43.550739 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-514791c4-d12b-4dc6-a2e0-605e1dc9d6bd tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '.version_select at 0x7fc134f200d0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:43.612100 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-514791c4-d12b-4dc6-a2e0-605e1dc9d6bd tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/images/15991ea4-51a0-45da-9013-9bf460b6e731" status: 200 len: 1409 microversion: 2.1 time: 0.065495 Oct 19 03:26:43.627009 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1656/3374] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:26:43 2022] GET /compute/v2.1/images/15991ea4-51a0-45da-9013-9bf460b6e731 => generated 1409 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:26:43.628942 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-36559c1f-55cd-4906-93c9-1f84e39bdc9b tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '.version_select at 0x7fc134f43940>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:43.710694 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-36559c1f-55cd-4906-93c9-1f84e39bdc9b tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/images/15991ea4-51a0-45da-9013-9bf460b6e731" status: 200 len: 1409 microversion: 2.1 time: 0.087168 Oct 19 03:26:43.720372 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1719/3375] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:26:43 2022] GET /compute/v2.1/images/15991ea4-51a0-45da-9013-9bf460b6e731 => generated 1409 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:26:43.728471 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4c1a4c38-3795-422e-94d5-12ff214867ca tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '.version_select at 0x7fc1305875e0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:43.916858 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-53c6f8c9-9246-4108-bb96-cc8d6a9ae8b4 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:43.918049 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-53c6f8c9-9246-4108-bb96-cc8d6a9ae8b4 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: ae0179a6-3cf0-4943-81b5-c971e8d10000] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:43.925187 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-53c6f8c9-9246-4108-bb96-cc8d6a9ae8b4 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:43.929723 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-53c6f8c9-9246-4108-bb96-cc8d6a9ae8b4 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:43.929723 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-53c6f8c9-9246-4108-bb96-cc8d6a9ae8b4 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:43.929723 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-53c6f8c9-9246-4108-bb96-cc8d6a9ae8b4 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:43.929723 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-53c6f8c9-9246-4108-bb96-cc8d6a9ae8b4 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:43.930081 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-53c6f8c9-9246-4108-bb96-cc8d6a9ae8b4 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:44.118728 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4c1a4c38-3795-422e-94d5-12ff214867ca tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "DELETE /compute/v2.1/images/15991ea4-51a0-45da-9013-9bf460b6e731" status: 204 len: 0 microversion: 2.1 time: 0.397424 Oct 19 03:26:44.119316 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1657/3376] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:43 2022] DELETE /compute/v2.1/images/15991ea4-51a0-45da-9013-9bf460b6e731 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 19 03:26:44.128430 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f0b5eb88-3e38-4ecf-91b3-530c4953f2ac tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '.version_select at 0x7fc134f259d0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:44.145573 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-53c6f8c9-9246-4108-bb96-cc8d6a9ae8b4 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:44.151491 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-53c6f8c9-9246-4108-bb96-cc8d6a9ae8b4 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/ae0179a6-3cf0-4943-81b5-c971e8d10000" status: 200 len: 1308 microversion: 2.1 time: 0.238675 Oct 19 03:26:44.160291 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1720/3377] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:43 2022] GET /compute/v2.1/servers/ae0179a6-3cf0-4943-81b5-c971e8d10000 => generated 1308 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:26:44.169823 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-f0b5eb88-3e38-4ecf-91b3-530c4953f2ac tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] HTTP exception thrown: Image not found. Oct 19 03:26:44.172228 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f0b5eb88-3e38-4ecf-91b3-530c4953f2ac tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Request method failure captured: Oct 19 03:26:44.172228 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/images/15991ea4-51a0-45da-9013-9bf460b6e731 HTTP/1.1 Oct 19 03:26:44.172228 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:26:44.172228 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:26:44.172228 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:26:44.172228 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:26:44.172228 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:26:44.172228 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:26:44.172228 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:26:44.172228 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:26:44.172228 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT20gKQCK3ZL5EjJtPpRF7E5hDOxix0C6fC1xUCWH8zbtFP3xUYoeIuXXDuos_Kcg-uER8mXZ0Dro2xiDEvGnr5RthhAxRX-UfAhulQWkJ7AvlI4OyC3dPVV75p4qDytKaHGa_jIWhID093t1C1fPqYSaGdAl1m0elNZW2yuRkiSpcQc Oct 19 03:26:44.172228 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:26:44.172228 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:26:44.172228 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:26:44.172228 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:26:44.172228 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:26:44.172228 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:26:44.172228 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 686dbeeaed0b44538a9bbc54d457a720 Oct 19 03:26:44.172228 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ImagesTestJSON-30140053 Oct 19 03:26:44.172228 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:26:44.172228 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:26:44.173800 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/686dbeeaed0b44538a9bbc54d457a720"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/686dbeeaed0b44538a9bbc54d457a720"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/686dbeeaed0b44538a9bbc54d457a720"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_686dbeeaed0b44538a9bbc54d457a720", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:26:44.173800 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ImagesTestJSON-30140053 Oct 19 03:26:44.173800 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 686dbeeaed0b44538a9bbc54d457a720 Oct 19 03:26:44.173800 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ImagesTestJSON-30140053 Oct 19 03:26:44.173800 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ImagesTestJSON-30140053-project Oct 19 03:26:44.173800 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:26:44.173800 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:26:44.173800 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 57008d884859417ebc1456b55ec3f6e0 Oct 19 03:26:44.173800 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ImagesTestJSON-30140053-project Oct 19 03:26:44.173800 n-d-861333-8 devstack@n-api.service[121134]: method: Oct 19 03:26:44.173800 n-d-861333-8 devstack@n-api.service[121134]: exception: Image not found. Oct 19 03:26:44.173800 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '15991ea4-51a0-45da-9013-9bf460b6e731'} Oct 19 03:26:44.173800 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:26:44.173800 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:26:44.175101 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 19 03:26:44.175101 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 19 03:26:44.175101 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 19 03:26:44.175101 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 19 03:26:44.175101 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 19 03:26:44.175101 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 19 03:26:44.175101 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 19 03:26:44.175101 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 19 03:26:44.175101 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 19 03:26:44.175101 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 19 03:26:44.175101 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 19 03:26:44.175101 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 19 03:26:44.175101 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 19 03:26:44.175101 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 19 03:26:44.175101 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 19 03:26:44.175101 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 19 03:26:44.175101 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 15991ea4-51a0-45da-9013-9bf460b6e731 Oct 19 03:26:44.175101 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:26:44.176395 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:26:44.176395 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:26:44.176395 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:26:44.176395 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 19 03:26:44.176395 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 19 03:26:44.176395 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 19 03:26:44.176395 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 19 03:26:44.176395 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 19 03:26:44.176395 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 19 03:26:44.176395 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 19 03:26:44.176395 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 19 03:26:44.176395 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 19 03:26:44.176395 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 19 03:26:44.176395 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 19 03:26:44.176395 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 19 03:26:44.176395 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 19 03:26:44.176395 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 19 03:26:44.176395 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 19 03:26:44.176395 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 19 03:26:44.177659 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 19 03:26:44.177659 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 19 03:26:44.177659 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 19 03:26:44.177659 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 19 03:26:44.177659 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 19 03:26:44.177659 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 19 03:26:44.177659 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 19 03:26:44.177659 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 19 03:26:44.177659 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 15991ea4-51a0-45da-9013-9bf460b6e731 could not be found. Oct 19 03:26:44.177659 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:26:44.177659 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:26:44.177659 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:26:44.177659 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:26:44.177659 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:26:44.177659 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:26:44.177659 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:26:44.177659 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:26:44.177659 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 03:26:44.177659 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 03:26:44.180070 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:26:44.180070 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:26:44.180070 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 19 03:26:44.180070 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 19 03:26:44.180070 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 19 03:26:44.180070 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:26:44.180070 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:26:44.180070 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:26:44.180070 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:26:44.180070 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:26:44.180070 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:26:44.180070 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:26:44.180070 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:26:44.180070 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 19 03:26:44.180070 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:26:44.183372 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f0b5eb88-3e38-4ecf-91b3-530c4953f2ac tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Returning 404 to user: Image not found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:26:44.184003 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f0b5eb88-3e38-4ecf-91b3-530c4953f2ac tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/images/15991ea4-51a0-45da-9013-9bf460b6e731" status: 404 len: 62 microversion: 2.1 time: 0.060127 Oct 19 03:26:44.184679 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1658/3378] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:26:44 2022] GET /compute/v2.1/images/15991ea4-51a0-45da-9013-9bf460b6e731 => generated 62 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 19 03:26:44.202162 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0d759443-1bcb-4467-86c2-ecbe696037bb tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:44.202793 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0d759443-1bcb-4467-86c2-ecbe696037bb tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: f10456f4-625a-483d-98e7-e1d23d187571] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:44.209221 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0d759443-1bcb-4467-86c2-ecbe696037bb tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:44.209771 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0d759443-1bcb-4467-86c2-ecbe696037bb tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:44.210219 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0d759443-1bcb-4467-86c2-ecbe696037bb tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:44.211005 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0d759443-1bcb-4467-86c2-ecbe696037bb tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:44.211656 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0d759443-1bcb-4467-86c2-ecbe696037bb tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:44.212448 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0d759443-1bcb-4467-86c2-ecbe696037bb tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:44.490221 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-0d759443-1bcb-4467-86c2-ecbe696037bb tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:44.499515 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0d759443-1bcb-4467-86c2-ecbe696037bb tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/f10456f4-625a-483d-98e7-e1d23d187571" status: 200 len: 1498 microversion: 2.1 time: 0.302170 Oct 19 03:26:44.502465 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1721/3379] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:44 2022] GET /compute/v2.1/servers/f10456f4-625a-483d-98e7-e1d23d187571 => generated 1498 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:26:45.180297 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-dbb954de-2848-47bc-bc30-16b7c29762ae tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:45.182276 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-dbb954de-2848-47bc-bc30-16b7c29762ae tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: ae0179a6-3cf0-4943-81b5-c971e8d10000] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:45.204680 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-8be3dbf1-9571-41eb-99fa-a9e1b7cd761f tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:45.205207 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-8be3dbf1-9571-41eb-99fa-a9e1b7cd761f tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] [instance: 4adec402-e94f-4a41-ac77-68f6091b87f7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:45.212387 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dbb954de-2848-47bc-bc30-16b7c29762ae tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:45.220761 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8be3dbf1-9571-41eb-99fa-a9e1b7cd761f tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:45.221601 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8be3dbf1-9571-41eb-99fa-a9e1b7cd761f tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:45.222211 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8be3dbf1-9571-41eb-99fa-a9e1b7cd761f tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:45.225121 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dbb954de-2848-47bc-bc30-16b7c29762ae tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:45.226176 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8be3dbf1-9571-41eb-99fa-a9e1b7cd761f tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:45.226800 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dbb954de-2848-47bc-bc30-16b7c29762ae tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:45.228734 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8be3dbf1-9571-41eb-99fa-a9e1b7cd761f tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:45.228734 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8be3dbf1-9571-41eb-99fa-a9e1b7cd761f tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:45.231370 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dbb954de-2848-47bc-bc30-16b7c29762ae tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:45.232026 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dbb954de-2848-47bc-bc30-16b7c29762ae tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:45.234735 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dbb954de-2848-47bc-bc30-16b7c29762ae tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:45.262575 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-8be3dbf1-9571-41eb-99fa-a9e1b7cd761f tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] HTTP exception thrown: Instance 4adec402-e94f-4a41-ac77-68f6091b87f7 could not be found. Oct 19 03:26:45.266893 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-8be3dbf1-9571-41eb-99fa-a9e1b7cd761f tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Request method failure captured: Oct 19 03:26:45.266893 n-d-861333-8 devstack@n-api.service[121135]: request: DELETE /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7 HTTP/1.1 Oct 19 03:26:45.266893 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:26:45.266893 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:26:45.266893 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:26:45.266893 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:26:45.266893 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:26:45.266893 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:26:45.266893 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:26:45.266893 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:26:45.266893 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2yaSUgrwCLmY4HgXwmwjC51uvlVETUqKYqmgdp9PAUprB1RIcHQ2Hce-XszCP9B3VI6NpUfhqiGNHScwJ4ZvbkypOsNRsBG0yhpNQ3g1zelXuPppEc50u7kyYyfQKlaYISsCPT6Jiz6jQ9glRDqRqTvMuY19umdkDjb3Wep6ud5-m4 Oct 19 03:26:45.266893 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:26:45.266893 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:26:45.266893 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:26:45.266893 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:26:45.266893 n-d-861333-8 devstack@n-api.service[121135]: X-Openstack-Nova-Api-Version: 2.32 Oct 19 03:26:45.266893 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:26:45.266893 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:26:45.266893 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: b8bf3e0ec0b34e2bb80b1d09877c3fd0 Oct 19 03:26:45.266893 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-TaggedBootDevicesTest-560118694 Oct 19 03:26:45.266893 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:26:45.266893 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:26:45.268513 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b8bf3e0ec0b34e2bb80b1d09877c3fd0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b8bf3e0ec0b34e2bb80b1d09877c3fd0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b8bf3e0ec0b34e2bb80b1d09877c3fd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b8bf3e0ec0b34e2bb80b1d09877c3fd0", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:26:45.268513 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-TaggedBootDevicesTest-560118694 Oct 19 03:26:45.268513 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: b8bf3e0ec0b34e2bb80b1d09877c3fd0 Oct 19 03:26:45.268513 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-TaggedBootDevicesTest-560118694 Oct 19 03:26:45.268513 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-TaggedBootDevicesTest-560118694-project Oct 19 03:26:45.268513 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:26:45.268513 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:26:45.268513 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: ca9e45a223244d29976d3bcf6f06a1d2 Oct 19 03:26:45.268513 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-TaggedBootDevicesTest-560118694-project Oct 19 03:26:45.268513 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:26:45.268513 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance 4adec402-e94f-4a41-ac77-68f6091b87f7 could not be found. Oct 19 03:26:45.268513 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '4adec402-e94f-4a41-ac77-68f6091b87f7'} Oct 19 03:26:45.269448 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:26:45.269448 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:26:45.269448 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:26:45.269448 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:26:45.269448 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:26:45.269448 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:26:45.269448 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:26:45.269448 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:26:45.269448 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:26:45.269448 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:26:45.269448 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4adec402-e94f-4a41-ac77-68f6091b87f7 could not be found. Oct 19 03:26:45.269448 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:26:45.269448 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:26:45.269448 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:26:45.269448 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:26:45.269448 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:26:45.269448 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:26:45.269448 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:26:45.269448 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:26:45.269448 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:26:45.270873 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:26:45.270873 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 03:26:45.270873 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 03:26:45.270873 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 03:26:45.270873 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 03:26:45.270873 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:26:45.270873 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:26:45.270873 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:26:45.270873 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:26:45.270873 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4adec402-e94f-4a41-ac77-68f6091b87f7 could not be found. Oct 19 03:26:45.270873 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:26:45.270873 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:26:45.270873 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:26:45.270873 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:26:45.270873 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:26:45.270873 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:26:45.270873 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:26:45.270873 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:26:45.270873 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4adec402-e94f-4a41-ac77-68f6091b87f7 could not be found. Oct 19 03:26:45.270873 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:26:45.275582 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-8be3dbf1-9571-41eb-99fa-a9e1b7cd761f tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Returning 404 to user: Instance 4adec402-e94f-4a41-ac77-68f6091b87f7 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:26:45.281346 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-8be3dbf1-9571-41eb-99fa-a9e1b7cd761f tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] 10.222.0.52 "DELETE /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7" status: 404 len: 111 microversion: 2.32 time: 0.083748 Oct 19 03:26:45.282223 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1722/3380] 10.222.0.52 () {60 vars in 1280 bytes} [Wed Oct 19 03:26:45 2022] DELETE /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 19 03:26:45.291699 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c08377fb-1a50-45cf-a7a6-c252829531ae tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:45.295853 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c08377fb-1a50-45cf-a7a6-c252829531ae tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] [instance: 4adec402-e94f-4a41-ac77-68f6091b87f7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:45.307125 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c08377fb-1a50-45cf-a7a6-c252829531ae tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:45.311562 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c08377fb-1a50-45cf-a7a6-c252829531ae tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:45.312018 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c08377fb-1a50-45cf-a7a6-c252829531ae tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:45.312739 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c08377fb-1a50-45cf-a7a6-c252829531ae tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:45.313397 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c08377fb-1a50-45cf-a7a6-c252829531ae tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:45.313835 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c08377fb-1a50-45cf-a7a6-c252829531ae tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:45.329921 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-c08377fb-1a50-45cf-a7a6-c252829531ae tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] HTTP exception thrown: Instance 4adec402-e94f-4a41-ac77-68f6091b87f7 could not be found. Oct 19 03:26:45.331781 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c08377fb-1a50-45cf-a7a6-c252829531ae tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Request method failure captured: Oct 19 03:26:45.331781 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7 HTTP/1.1 Oct 19 03:26:45.331781 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:26:45.331781 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:26:45.331781 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:26:45.331781 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:26:45.331781 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:26:45.331781 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:26:45.331781 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:26:45.331781 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:26:45.331781 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2yaSUgrwCLmY4HgXwmwjC51uvlVETUqKYqmgdp9PAUprB1RIcHQ2Hce-XszCP9B3VI6NpUfhqiGNHScwJ4ZvbkypOsNRsBG0yhpNQ3g1zelXuPppEc50u7kyYyfQKlaYISsCPT6Jiz6jQ9glRDqRqTvMuY19umdkDjb3Wep6ud5-m4 Oct 19 03:26:45.331781 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:26:45.331781 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:26:45.331781 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:26:45.331781 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:26:45.331781 n-d-861333-8 devstack@n-api.service[121135]: X-Openstack-Nova-Api-Version: 2.32 Oct 19 03:26:45.331781 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:26:45.331781 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:26:45.331781 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: b8bf3e0ec0b34e2bb80b1d09877c3fd0 Oct 19 03:26:45.331781 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-TaggedBootDevicesTest-560118694 Oct 19 03:26:45.331781 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:26:45.331781 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:26:45.333158 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b8bf3e0ec0b34e2bb80b1d09877c3fd0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b8bf3e0ec0b34e2bb80b1d09877c3fd0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b8bf3e0ec0b34e2bb80b1d09877c3fd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b8bf3e0ec0b34e2bb80b1d09877c3fd0", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:26:45.333158 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-TaggedBootDevicesTest-560118694 Oct 19 03:26:45.333158 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: b8bf3e0ec0b34e2bb80b1d09877c3fd0 Oct 19 03:26:45.333158 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-TaggedBootDevicesTest-560118694 Oct 19 03:26:45.333158 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-TaggedBootDevicesTest-560118694-project Oct 19 03:26:45.333158 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:26:45.333158 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:26:45.333158 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: ca9e45a223244d29976d3bcf6f06a1d2 Oct 19 03:26:45.333158 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-TaggedBootDevicesTest-560118694-project Oct 19 03:26:45.333158 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:26:45.333158 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance 4adec402-e94f-4a41-ac77-68f6091b87f7 could not be found. Oct 19 03:26:45.333158 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '4adec402-e94f-4a41-ac77-68f6091b87f7'} Oct 19 03:26:45.337897 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:26:45.337897 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:26:45.337897 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:26:45.337897 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:26:45.337897 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:26:45.337897 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:26:45.337897 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:26:45.337897 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:26:45.337897 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:26:45.337897 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:26:45.337897 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4adec402-e94f-4a41-ac77-68f6091b87f7 could not be found. Oct 19 03:26:45.337897 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:26:45.337897 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:26:45.337897 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:26:45.337897 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:26:45.337897 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:26:45.337897 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:26:45.337897 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:26:45.337897 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:26:45.337897 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:26:45.339357 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:26:45.339357 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:26:45.339357 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:26:45.339357 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:26:45.339357 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:26:45.339357 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:26:45.339357 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:26:45.339357 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4adec402-e94f-4a41-ac77-68f6091b87f7 could not be found. Oct 19 03:26:45.339357 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:26:45.339357 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:26:45.339357 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:26:45.339357 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:26:45.339357 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:26:45.339357 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:26:45.339357 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:26:45.339357 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:26:45.339357 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4adec402-e94f-4a41-ac77-68f6091b87f7 could not be found. Oct 19 03:26:45.339357 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:26:45.340851 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c08377fb-1a50-45cf-a7a6-c252829531ae tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] Returning 404 to user: Instance 4adec402-e94f-4a41-ac77-68f6091b87f7 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:26:45.340851 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c08377fb-1a50-45cf-a7a6-c252829531ae tempest-TaggedBootDevicesTest-560118694 tempest-TaggedBootDevicesTest-560118694-project] 10.222.0.52 "GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7" status: 404 len: 111 microversion: 2.32 time: 0.045530 Oct 19 03:26:45.340851 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1723/3381] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:26:45 2022] GET /compute/v2.1/servers/4adec402-e94f-4a41-ac77-68f6091b87f7 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 19 03:26:45.525507 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-53572541-d760-4089-8fa2-56dc4028823b tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:45.535507 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-53572541-d760-4089-8fa2-56dc4028823b tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: f10456f4-625a-483d-98e7-e1d23d187571] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:45.543216 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-53572541-d760-4089-8fa2-56dc4028823b tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:45.543988 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-53572541-d760-4089-8fa2-56dc4028823b tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:45.544727 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-53572541-d760-4089-8fa2-56dc4028823b tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:45.545670 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-53572541-d760-4089-8fa2-56dc4028823b tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:45.546285 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-53572541-d760-4089-8fa2-56dc4028823b tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:45.546876 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-53572541-d760-4089-8fa2-56dc4028823b tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:45.752257 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-dbb954de-2848-47bc-bc30-16b7c29762ae tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:45.761249 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-dbb954de-2848-47bc-bc30-16b7c29762ae tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/ae0179a6-3cf0-4943-81b5-c971e8d10000" status: 200 len: 1308 microversion: 2.1 time: 0.588476 Oct 19 03:26:45.773437 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1659/3382] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:45 2022] GET /compute/v2.1/servers/ae0179a6-3cf0-4943-81b5-c971e8d10000 => generated 1308 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:26:45.863030 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-53572541-d760-4089-8fa2-56dc4028823b tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:45.872281 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-53572541-d760-4089-8fa2-56dc4028823b tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/f10456f4-625a-483d-98e7-e1d23d187571" status: 200 len: 1504 microversion: 2.1 time: 0.351385 Oct 19 03:26:45.873758 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1724/3383] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:45 2022] GET /compute/v2.1/servers/f10456f4-625a-483d-98e7-e1d23d187571 => generated 1504 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:26:46.792476 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-84fd9991-3a89-49a6-8e0b-3ae3faaca501 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:46.793154 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-84fd9991-3a89-49a6-8e0b-3ae3faaca501 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: ae0179a6-3cf0-4943-81b5-c971e8d10000] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:46.801235 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:26:46.803105 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-84fd9991-3a89-49a6-8e0b-3ae3faaca501 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:46.803843 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-84fd9991-3a89-49a6-8e0b-3ae3faaca501 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:46.805389 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-84fd9991-3a89-49a6-8e0b-3ae3faaca501 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:46.806307 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-84fd9991-3a89-49a6-8e0b-3ae3faaca501 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:46.806987 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-84fd9991-3a89-49a6-8e0b-3ae3faaca501 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:46.808067 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-84fd9991-3a89-49a6-8e0b-3ae3faaca501 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:46.896580 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7f0b127e-6e08-4679-9e3a-5ed9947f371b tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:46.897399 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7f0b127e-6e08-4679-9e3a-5ed9947f371b tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: f10456f4-625a-483d-98e7-e1d23d187571] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:46.907330 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:26:46.908257 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=6 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:26:46.913320 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7f0b127e-6e08-4679-9e3a-5ed9947f371b tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:46.916139 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7f0b127e-6e08-4679-9e3a-5ed9947f371b tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:46.923102 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7f0b127e-6e08-4679-9e3a-5ed9947f371b tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:46.923102 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7f0b127e-6e08-4679-9e3a-5ed9947f371b tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:46.923102 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7f0b127e-6e08-4679-9e3a-5ed9947f371b tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:46.923102 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7f0b127e-6e08-4679-9e3a-5ed9947f371b tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:47.135961 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-84fd9991-3a89-49a6-8e0b-3ae3faaca501 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:47.145236 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-84fd9991-3a89-49a6-8e0b-3ae3faaca501 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/ae0179a6-3cf0-4943-81b5-c971e8d10000" status: 200 len: 1308 microversion: 2.1 time: 0.357128 Oct 19 03:26:47.150198 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1660/3384] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:46 2022] GET /compute/v2.1/servers/ae0179a6-3cf0-4943-81b5-c971e8d10000 => generated 1308 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:26:47.214296 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7f0b127e-6e08-4679-9e3a-5ed9947f371b tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:47.225148 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7f0b127e-6e08-4679-9e3a-5ed9947f371b tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/f10456f4-625a-483d-98e7-e1d23d187571" status: 200 len: 1504 microversion: 2.1 time: 0.332467 Oct 19 03:26:47.227119 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1725/3385] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:46 2022] GET /compute/v2.1/servers/f10456f4-625a-483d-98e7-e1d23d187571 => generated 1504 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:26:48.179729 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2079042c-0230-42b5-8eea-775a5df52289 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:48.180415 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2079042c-0230-42b5-8eea-775a5df52289 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: ae0179a6-3cf0-4943-81b5-c971e8d10000] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:48.188527 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2079042c-0230-42b5-8eea-775a5df52289 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:48.189030 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2079042c-0230-42b5-8eea-775a5df52289 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:48.189545 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2079042c-0230-42b5-8eea-775a5df52289 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:48.190260 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2079042c-0230-42b5-8eea-775a5df52289 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:48.190711 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2079042c-0230-42b5-8eea-775a5df52289 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:48.191135 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2079042c-0230-42b5-8eea-775a5df52289 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:48.255400 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b3c32393-337d-4df3-b62a-7c16431315ad tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:48.257462 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b3c32393-337d-4df3-b62a-7c16431315ad tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: f10456f4-625a-483d-98e7-e1d23d187571] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:48.267558 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b3c32393-337d-4df3-b62a-7c16431315ad tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:48.268065 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b3c32393-337d-4df3-b62a-7c16431315ad tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:48.268548 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b3c32393-337d-4df3-b62a-7c16431315ad tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:48.269295 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b3c32393-337d-4df3-b62a-7c16431315ad tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:48.269791 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b3c32393-337d-4df3-b62a-7c16431315ad tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:48.270265 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b3c32393-337d-4df3-b62a-7c16431315ad tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:48.469108 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-2079042c-0230-42b5-8eea-775a5df52289 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:48.477894 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2079042c-0230-42b5-8eea-775a5df52289 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/ae0179a6-3cf0-4943-81b5-c971e8d10000" status: 200 len: 1308 microversion: 2.1 time: 0.304494 Oct 19 03:26:48.482477 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1661/3386] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:48 2022] GET /compute/v2.1/servers/ae0179a6-3cf0-4943-81b5-c971e8d10000 => generated 1308 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:26:48.502640 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b3c32393-337d-4df3-b62a-7c16431315ad tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:48.511423 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b3c32393-337d-4df3-b62a-7c16431315ad tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/f10456f4-625a-483d-98e7-e1d23d187571" status: 200 len: 1486 microversion: 2.1 time: 0.264972 Oct 19 03:26:48.512084 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1726/3387] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:48 2022] GET /compute/v2.1/servers/f10456f4-625a-483d-98e7-e1d23d187571 => generated 1486 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:26:48.534981 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b9e605fa-fe34-4a08-99a2-d68400baf02d tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:48.535696 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b9e605fa-fe34-4a08-99a2-d68400baf02d tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: f10456f4-625a-483d-98e7-e1d23d187571] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:48.543650 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b9e605fa-fe34-4a08-99a2-d68400baf02d tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:48.552032 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b9e605fa-fe34-4a08-99a2-d68400baf02d tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:48.552032 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b9e605fa-fe34-4a08-99a2-d68400baf02d tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:48.552032 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b9e605fa-fe34-4a08-99a2-d68400baf02d tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:48.552032 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b9e605fa-fe34-4a08-99a2-d68400baf02d tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:48.552556 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b9e605fa-fe34-4a08-99a2-d68400baf02d tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:48.592246 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b9e605fa-fe34-4a08-99a2-d68400baf02d tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: f10456f4-625a-483d-98e7-e1d23d187571] Going to try to terminate instance {{(pid=121134) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:26:48.960704 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b9e605fa-fe34-4a08-99a2-d68400baf02d tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "DELETE /compute/v2.1/servers/f10456f4-625a-483d-98e7-e1d23d187571" status: 204 len: 0 microversion: 2.1 time: 0.426362 Oct 19 03:26:48.961824 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1662/3388] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:26:48 2022] DELETE /compute/v2.1/servers/f10456f4-625a-483d-98e7-e1d23d187571 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:26:48.970636 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d29cd823-c35b-4699-a699-7761c7059696 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '.version_select at 0x7fc1301b8430>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:48.995129 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-d29cd823-c35b-4699-a699-7761c7059696 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] HTTP exception thrown: Image not found. Oct 19 03:26:48.997207 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d29cd823-c35b-4699-a699-7761c7059696 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Request method failure captured: Oct 19 03:26:48.997207 n-d-861333-8 devstack@n-api.service[121135]: request: DELETE /compute/v2.1/images/15991ea4-51a0-45da-9013-9bf460b6e731 HTTP/1.1 Oct 19 03:26:48.997207 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:26:48.997207 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:26:48.997207 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:26:48.997207 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:26:48.997207 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:26:48.997207 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:26:48.997207 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:26:48.997207 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:26:48.997207 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT20gKQCK3ZL5EjJtPpRF7E5hDOxix0C6fC1xUCWH8zbtFP3xUYoeIuXXDuos_Kcg-uER8mXZ0Dro2xiDEvGnr5RthhAxRX-UfAhulQWkJ7AvlI4OyC3dPVV75p4qDytKaHGa_jIWhID093t1C1fPqYSaGdAl1m0elNZW2yuRkiSpcQc Oct 19 03:26:48.997207 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:26:48.997207 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:26:48.997207 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:26:48.997207 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:26:48.997207 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:26:48.997207 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:26:48.997207 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 686dbeeaed0b44538a9bbc54d457a720 Oct 19 03:26:48.997207 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ImagesTestJSON-30140053 Oct 19 03:26:48.997207 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:26:48.997207 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:26:48.998576 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/686dbeeaed0b44538a9bbc54d457a720"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/686dbeeaed0b44538a9bbc54d457a720"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/686dbeeaed0b44538a9bbc54d457a720"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_686dbeeaed0b44538a9bbc54d457a720", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:26:48.998576 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ImagesTestJSON-30140053 Oct 19 03:26:48.998576 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 686dbeeaed0b44538a9bbc54d457a720 Oct 19 03:26:48.998576 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ImagesTestJSON-30140053 Oct 19 03:26:48.998576 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ImagesTestJSON-30140053-project Oct 19 03:26:48.998576 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:26:48.998576 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:26:48.998576 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 57008d884859417ebc1456b55ec3f6e0 Oct 19 03:26:48.998576 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ImagesTestJSON-30140053-project Oct 19 03:26:48.998576 n-d-861333-8 devstack@n-api.service[121135]: method: Oct 19 03:26:48.998576 n-d-861333-8 devstack@n-api.service[121135]: exception: Image not found. Oct 19 03:26:48.998576 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '15991ea4-51a0-45da-9013-9bf460b6e731'} Oct 19 03:26:48.998576 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:26:48.998576 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:26:48.999431 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 19 03:26:48.999431 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 19 03:26:48.999431 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 19 03:26:48.999431 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 19 03:26:48.999431 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 19 03:26:48.999431 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 19 03:26:48.999431 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 19 03:26:48.999431 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 19 03:26:48.999431 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 19 03:26:48.999431 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 19 03:26:48.999431 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 19 03:26:48.999431 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 19 03:26:48.999431 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 19 03:26:48.999431 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 19 03:26:48.999431 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 15991ea4-51a0-45da-9013-9bf460b6e731 to delete Oct 19 03:26:48.999431 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:26:48.999431 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:26:48.999431 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:26:48.999431 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:26:49.003096 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 19 03:26:49.003096 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 19 03:26:49.003096 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 19 03:26:49.003096 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 19 03:26:49.003096 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 19 03:26:49.003096 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 19 03:26:49.003096 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 15991ea4-51a0-45da-9013-9bf460b6e731 could not be found. Oct 19 03:26:49.003096 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:26:49.003096 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:26:49.003096 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:26:49.003096 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:26:49.003096 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:26:49.003096 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:26:49.003096 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:26:49.003096 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:26:49.003096 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 03:26:49.003096 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 03:26:49.003096 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:26:49.003096 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:26:49.003096 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 19 03:26:49.005753 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 19 03:26:49.005753 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 19 03:26:49.005753 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:26:49.005753 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:26:49.005753 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:26:49.005753 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:26:49.005753 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:26:49.005753 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:26:49.005753 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:26:49.005753 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:26:49.005753 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 19 03:26:49.005753 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:26:49.005753 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d29cd823-c35b-4699-a699-7761c7059696 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Returning 404 to user: Image not found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:26:49.005753 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d29cd823-c35b-4699-a699-7761c7059696 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "DELETE /compute/v2.1/images/15991ea4-51a0-45da-9013-9bf460b6e731" status: 404 len: 62 microversion: 2.1 time: 0.032345 Oct 19 03:26:49.005753 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1727/3389] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:48 2022] DELETE /compute/v2.1/images/15991ea4-51a0-45da-9013-9bf460b6e731 => generated 62 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 03:26:49.015621 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1f095849-9a7f-469b-8e0d-c83d33c5de4f tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:49.016522 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1f095849-9a7f-469b-8e0d-c83d33c5de4f tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: f10456f4-625a-483d-98e7-e1d23d187571] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:49.024441 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1f095849-9a7f-469b-8e0d-c83d33c5de4f tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:49.025193 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1f095849-9a7f-469b-8e0d-c83d33c5de4f tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:49.025971 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1f095849-9a7f-469b-8e0d-c83d33c5de4f tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:49.026995 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1f095849-9a7f-469b-8e0d-c83d33c5de4f tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:49.027654 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1f095849-9a7f-469b-8e0d-c83d33c5de4f tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:49.028386 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1f095849-9a7f-469b-8e0d-c83d33c5de4f tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:49.075153 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1f095849-9a7f-469b-8e0d-c83d33c5de4f tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: f10456f4-625a-483d-98e7-e1d23d187571] Going to try to terminate instance {{(pid=121134) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:26:49.139810 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.compute.api [None req-1f095849-9a7f-469b-8e0d-c83d33c5de4f tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: f10456f4-625a-483d-98e7-e1d23d187571] Instance is already in deleting state, ignoring this request Oct 19 03:26:49.141508 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1f095849-9a7f-469b-8e0d-c83d33c5de4f tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "DELETE /compute/v2.1/servers/f10456f4-625a-483d-98e7-e1d23d187571" status: 204 len: 0 microversion: 2.1 time: 0.131028 Oct 19 03:26:49.143536 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1663/3390] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:26:49 2022] DELETE /compute/v2.1/servers/f10456f4-625a-483d-98e7-e1d23d187571 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:26:49.152301 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a571cef4-15c6-42e2-89b5-db8450158b7a tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:49.153060 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a571cef4-15c6-42e2-89b5-db8450158b7a tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: f10456f4-625a-483d-98e7-e1d23d187571] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:49.162700 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a571cef4-15c6-42e2-89b5-db8450158b7a tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:49.163529 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a571cef4-15c6-42e2-89b5-db8450158b7a tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:49.164724 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a571cef4-15c6-42e2-89b5-db8450158b7a tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:49.165351 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a571cef4-15c6-42e2-89b5-db8450158b7a tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:49.165964 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a571cef4-15c6-42e2-89b5-db8450158b7a tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:49.166692 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a571cef4-15c6-42e2-89b5-db8450158b7a tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:49.347061 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a571cef4-15c6-42e2-89b5-db8450158b7a tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:49.355566 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a571cef4-15c6-42e2-89b5-db8450158b7a tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/f10456f4-625a-483d-98e7-e1d23d187571" status: 200 len: 1492 microversion: 2.1 time: 0.208091 Oct 19 03:26:49.356287 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1728/3391] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:49 2022] GET /compute/v2.1/servers/f10456f4-625a-483d-98e7-e1d23d187571 => generated 1492 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:26:49.504408 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-eb1b69ed-6450-4851-9a30-255812150c15 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:49.505121 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-eb1b69ed-6450-4851-9a30-255812150c15 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: ae0179a6-3cf0-4943-81b5-c971e8d10000] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:49.517035 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eb1b69ed-6450-4851-9a30-255812150c15 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:49.517646 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eb1b69ed-6450-4851-9a30-255812150c15 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:49.518085 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eb1b69ed-6450-4851-9a30-255812150c15 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:49.518934 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eb1b69ed-6450-4851-9a30-255812150c15 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:49.519507 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eb1b69ed-6450-4851-9a30-255812150c15 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:49.520171 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eb1b69ed-6450-4851-9a30-255812150c15 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:49.671490 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-eb1b69ed-6450-4851-9a30-255812150c15 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:49.682582 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-eb1b69ed-6450-4851-9a30-255812150c15 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/ae0179a6-3cf0-4943-81b5-c971e8d10000" status: 200 len: 1308 microversion: 2.1 time: 0.182268 Oct 19 03:26:49.683843 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1664/3392] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:49 2022] GET /compute/v2.1/servers/ae0179a6-3cf0-4943-81b5-c971e8d10000 => generated 1308 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:26:50.032881 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-1d35f80a-62af-4e7d-a85e-0694ee5b1c77 req-b7d772c2-400f-475c-9673-572ba0087da7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae0179a6-3cf0-4943-81b5-c971e8d10000", "name": "network-vif-plugged", "status": "completed", "tag": "640d0b38-8205-42b6-803c-1c1cd6c518e8"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:26:50.058015 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-1d35f80a-62af-4e7d-a85e-0694ee5b1c77 req-b7d772c2-400f-475c-9673-572ba0087da7 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:50.058513 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-1d35f80a-62af-4e7d-a85e-0694ee5b1c77 req-b7d772c2-400f-475c-9673-572ba0087da7 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:50.058955 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-1d35f80a-62af-4e7d-a85e-0694ee5b1c77 req-b7d772c2-400f-475c-9673-572ba0087da7 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:50.076361 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-1d35f80a-62af-4e7d-a85e-0694ee5b1c77 req-b7d772c2-400f-475c-9673-572ba0087da7 service nova] Creating event network-vif-plugged:640d0b38-8205-42b6-803c-1c1cd6c518e8 for instance ae0179a6-3cf0-4943-81b5-c971e8d10000 on n-h1-861333-8 Oct 19 03:26:50.083436 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-1d35f80a-62af-4e7d-a85e-0694ee5b1c77 req-b7d772c2-400f-475c-9673-572ba0087da7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054313 Oct 19 03:26:50.084435 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1729/3393] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:26:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:26:50.380527 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e5def622-c7a8-4f8a-b86d-986e9a8d53d8 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:50.385953 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e5def622-c7a8-4f8a-b86d-986e9a8d53d8 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: f10456f4-625a-483d-98e7-e1d23d187571] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:50.398623 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e5def622-c7a8-4f8a-b86d-986e9a8d53d8 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:50.399334 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e5def622-c7a8-4f8a-b86d-986e9a8d53d8 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:50.399788 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e5def622-c7a8-4f8a-b86d-986e9a8d53d8 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:50.400806 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e5def622-c7a8-4f8a-b86d-986e9a8d53d8 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:50.401074 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e5def622-c7a8-4f8a-b86d-986e9a8d53d8 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:50.401581 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e5def622-c7a8-4f8a-b86d-986e9a8d53d8 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:50.544198 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e5def622-c7a8-4f8a-b86d-986e9a8d53d8 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:50.552533 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e5def622-c7a8-4f8a-b86d-986e9a8d53d8 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/f10456f4-625a-483d-98e7-e1d23d187571" status: 200 len: 1492 microversion: 2.1 time: 0.176272 Oct 19 03:26:50.554774 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1665/3394] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:50 2022] GET /compute/v2.1/servers/f10456f4-625a-483d-98e7-e1d23d187571 => generated 1492 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:26:50.708727 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6f8d5b35-8451-4267-a5e6-d2c9fd876e7a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:50.710156 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6f8d5b35-8451-4267-a5e6-d2c9fd876e7a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: ae0179a6-3cf0-4943-81b5-c971e8d10000] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:50.717293 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6f8d5b35-8451-4267-a5e6-d2c9fd876e7a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:50.723193 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6f8d5b35-8451-4267-a5e6-d2c9fd876e7a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:50.723193 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6f8d5b35-8451-4267-a5e6-d2c9fd876e7a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:50.723193 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6f8d5b35-8451-4267-a5e6-d2c9fd876e7a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:50.723193 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6f8d5b35-8451-4267-a5e6-d2c9fd876e7a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:50.723869 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6f8d5b35-8451-4267-a5e6-d2c9fd876e7a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:50.725561 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:26:51.047306 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-6f8d5b35-8451-4267-a5e6-d2c9fd876e7a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:51.063590 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6f8d5b35-8451-4267-a5e6-d2c9fd876e7a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/ae0179a6-3cf0-4943-81b5-c971e8d10000" status: 200 len: 1308 microversion: 2.1 time: 0.358597 Oct 19 03:26:51.066034 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1730/3395] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:50 2022] GET /compute/v2.1/servers/ae0179a6-3cf0-4943-81b5-c971e8d10000 => generated 1308 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:26:51.578729 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-17f7ba62-6803-4ac5-a049-f02743b90af5 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:51.579255 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-17f7ba62-6803-4ac5-a049-f02743b90af5 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: f10456f4-625a-483d-98e7-e1d23d187571] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:51.596513 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-17f7ba62-6803-4ac5-a049-f02743b90af5 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:51.597975 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-17f7ba62-6803-4ac5-a049-f02743b90af5 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:51.599279 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-17f7ba62-6803-4ac5-a049-f02743b90af5 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:51.600851 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-17f7ba62-6803-4ac5-a049-f02743b90af5 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:51.640668 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-17f7ba62-6803-4ac5-a049-f02743b90af5 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.039s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:51.645959 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-17f7ba62-6803-4ac5-a049-f02743b90af5 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:51.708828 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-7b77d747-33eb-4121-beec-36a6f2caf1ca req-7720ce01-029f-4579-9c7c-1b5c7dc70610 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f10456f4-625a-483d-98e7-e1d23d187571", "name": "network-vif-deleted", "tag": "bae859a8-4017-4db1-8eed-d383aed6e87f"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:26:51.726245 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-7b77d747-33eb-4121-beec-36a6f2caf1ca req-7720ce01-029f-4579-9c7c-1b5c7dc70610 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:51.727162 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-7b77d747-33eb-4121-beec-36a6f2caf1ca req-7720ce01-029f-4579-9c7c-1b5c7dc70610 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:51.727817 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-7b77d747-33eb-4121-beec-36a6f2caf1ca req-7720ce01-029f-4579-9c7c-1b5c7dc70610 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:51.753919 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-17f7ba62-6803-4ac5-a049-f02743b90af5 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:51.754146 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-7b77d747-33eb-4121-beec-36a6f2caf1ca req-7720ce01-029f-4579-9c7c-1b5c7dc70610 service nova] Creating event network-vif-deleted:bae859a8-4017-4db1-8eed-d383aed6e87f for instance f10456f4-625a-483d-98e7-e1d23d187571 on n-h2-861333-8 Oct 19 03:26:51.763320 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-17f7ba62-6803-4ac5-a049-f02743b90af5 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/f10456f4-625a-483d-98e7-e1d23d187571" status: 200 len: 1450 microversion: 2.1 time: 0.188555 Oct 19 03:26:51.764454 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1666/3396] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:51 2022] GET /compute/v2.1/servers/f10456f4-625a-483d-98e7-e1d23d187571 => generated 1450 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:26:51.779800 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-7b77d747-33eb-4121-beec-36a6f2caf1ca req-7720ce01-029f-4579-9c7c-1b5c7dc70610 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077162 Oct 19 03:26:51.783668 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1731/3397] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:26:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:26:52.102051 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c35f9ee3-f805-4234-9d5d-ca12e7f24b9a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:52.102675 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c35f9ee3-f805-4234-9d5d-ca12e7f24b9a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: ae0179a6-3cf0-4943-81b5-c971e8d10000] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:52.112886 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c35f9ee3-f805-4234-9d5d-ca12e7f24b9a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:52.122675 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c35f9ee3-f805-4234-9d5d-ca12e7f24b9a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:52.123826 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c35f9ee3-f805-4234-9d5d-ca12e7f24b9a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:52.126879 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c35f9ee3-f805-4234-9d5d-ca12e7f24b9a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:52.127405 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c35f9ee3-f805-4234-9d5d-ca12e7f24b9a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:52.127865 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c35f9ee3-f805-4234-9d5d-ca12e7f24b9a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:52.323128 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c35f9ee3-f805-4234-9d5d-ca12e7f24b9a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:52.333079 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c35f9ee3-f805-4234-9d5d-ca12e7f24b9a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/ae0179a6-3cf0-4943-81b5-c971e8d10000" status: 200 len: 1490 microversion: 2.1 time: 0.235109 Oct 19 03:26:52.345822 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1667/3398] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:52 2022] GET /compute/v2.1/servers/ae0179a6-3cf0-4943-81b5-c971e8d10000 => generated 1490 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:26:52.358531 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6de1c894-8a12-4491-b1df-f2e748831e43 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:52.359248 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6de1c894-8a12-4491-b1df-f2e748831e43 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 58aea4eb-a319-4bdc-99f2-eed095150ecb] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:52.366498 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6de1c894-8a12-4491-b1df-f2e748831e43 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:52.366998 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6de1c894-8a12-4491-b1df-f2e748831e43 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:52.367448 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6de1c894-8a12-4491-b1df-f2e748831e43 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:52.368161 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6de1c894-8a12-4491-b1df-f2e748831e43 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:52.368623 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6de1c894-8a12-4491-b1df-f2e748831e43 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:52.369055 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6de1c894-8a12-4491-b1df-f2e748831e43 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:52.597253 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-6de1c894-8a12-4491-b1df-f2e748831e43 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:52.609247 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6de1c894-8a12-4491-b1df-f2e748831e43 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/58aea4eb-a319-4bdc-99f2-eed095150ecb" status: 200 len: 1490 microversion: 2.1 time: 0.255044 Oct 19 03:26:52.611931 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1732/3399] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:52 2022] GET /compute/v2.1/servers/58aea4eb-a319-4bdc-99f2-eed095150ecb => generated 1490 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:26:52.633028 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8caa16b8-d04e-4f0f-abad-af1e3c815cdd tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:52.634274 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8caa16b8-d04e-4f0f-abad-af1e3c815cdd tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: ae0179a6-3cf0-4943-81b5-c971e8d10000] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:52.641950 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8caa16b8-d04e-4f0f-abad-af1e3c815cdd tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:52.642653 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8caa16b8-d04e-4f0f-abad-af1e3c815cdd tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:52.643926 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8caa16b8-d04e-4f0f-abad-af1e3c815cdd tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:52.644877 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8caa16b8-d04e-4f0f-abad-af1e3c815cdd tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:52.645554 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8caa16b8-d04e-4f0f-abad-af1e3c815cdd tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:52.646168 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8caa16b8-d04e-4f0f-abad-af1e3c815cdd tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:52.791121 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e93f1366-e166-428f-b07e-24dca0c464b4 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:52.791659 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e93f1366-e166-428f-b07e-24dca0c464b4 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: f10456f4-625a-483d-98e7-e1d23d187571] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:52.798819 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e93f1366-e166-428f-b07e-24dca0c464b4 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:52.799320 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e93f1366-e166-428f-b07e-24dca0c464b4 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:52.799772 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e93f1366-e166-428f-b07e-24dca0c464b4 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:52.800479 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e93f1366-e166-428f-b07e-24dca0c464b4 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:52.800978 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e93f1366-e166-428f-b07e-24dca0c464b4 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:52.801434 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e93f1366-e166-428f-b07e-24dca0c464b4 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:52.817877 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8caa16b8-d04e-4f0f-abad-af1e3c815cdd tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:52.839319 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8caa16b8-d04e-4f0f-abad-af1e3c815cdd tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/ae0179a6-3cf0-4943-81b5-c971e8d10000" status: 200 len: 1490 microversion: 2.1 time: 0.210154 Oct 19 03:26:52.840394 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1668/3400] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:52 2022] GET /compute/v2.1/servers/ae0179a6-3cf0-4943-81b5-c971e8d10000 => generated 1490 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:26:52.869327 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2bb7a406-0271-4bd4-9f87-2c5c21c11c24 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:52.869327 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2bb7a406-0271-4bd4-9f87-2c5c21c11c24 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: ae0179a6-3cf0-4943-81b5-c971e8d10000] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:52.869675 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e93f1366-e166-428f-b07e-24dca0c464b4 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:52.869675 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e93f1366-e166-428f-b07e-24dca0c464b4 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:52.869675 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e93f1366-e166-428f-b07e-24dca0c464b4 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:52.869675 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-e93f1366-e166-428f-b07e-24dca0c464b4 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lazy-loading 'fault' on Instance uuid f10456f4-625a-483d-98e7-e1d23d187571 {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:26:52.875532 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2bb7a406-0271-4bd4-9f87-2c5c21c11c24 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:52.877110 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2bb7a406-0271-4bd4-9f87-2c5c21c11c24 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:52.879200 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2bb7a406-0271-4bd4-9f87-2c5c21c11c24 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:52.880237 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2bb7a406-0271-4bd4-9f87-2c5c21c11c24 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:52.881299 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2bb7a406-0271-4bd4-9f87-2c5c21c11c24 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:52.890406 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2bb7a406-0271-4bd4-9f87-2c5c21c11c24 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:52.919486 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-e93f1366-e166-428f-b07e-24dca0c464b4 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57008d884859417ebc1456b55ec3f6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686dbeeaed0b44538a9bbc54d457a720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:52.928569 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e93f1366-e166-428f-b07e-24dca0c464b4 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/f10456f4-625a-483d-98e7-e1d23d187571" status: 200 len: 1297 microversion: 2.1 time: 0.141660 Oct 19 03:26:52.929389 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1733/3401] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:52 2022] GET /compute/v2.1/servers/f10456f4-625a-483d-98e7-e1d23d187571 => generated 1297 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:26:52.954496 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2bb7a406-0271-4bd4-9f87-2c5c21c11c24 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: ae0179a6-3cf0-4943-81b5-c971e8d10000] Going to try to terminate instance {{(pid=121134) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:26:53.117894 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:26:53.354457 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2bb7a406-0271-4bd4-9f87-2c5c21c11c24 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ae0179a6-3cf0-4943-81b5-c971e8d10000" status: 204 len: 0 microversion: 2.1 time: 0.493315 Oct 19 03:26:53.355260 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1669/3402] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:26:52 2022] DELETE /compute/v2.1/servers/ae0179a6-3cf0-4943-81b5-c971e8d10000 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 19 03:26:53.364167 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-46206f91-1063-4501-ad31-99352451136b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:53.364938 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-46206f91-1063-4501-ad31-99352451136b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: ae0179a6-3cf0-4943-81b5-c971e8d10000] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:53.377096 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-46206f91-1063-4501-ad31-99352451136b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:53.377775 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-46206f91-1063-4501-ad31-99352451136b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:53.378334 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-46206f91-1063-4501-ad31-99352451136b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:53.379992 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-46206f91-1063-4501-ad31-99352451136b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:53.381090 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-46206f91-1063-4501-ad31-99352451136b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:53.390839 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-46206f91-1063-4501-ad31-99352451136b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:53.593624 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-46206f91-1063-4501-ad31-99352451136b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:53.599666 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-46206f91-1063-4501-ad31-99352451136b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/ae0179a6-3cf0-4943-81b5-c971e8d10000" status: 200 len: 1496 microversion: 2.1 time: 0.239786 Oct 19 03:26:53.602175 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1734/3403] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:53 2022] GET /compute/v2.1/servers/ae0179a6-3cf0-4943-81b5-c971e8d10000 => generated 1496 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:26:53.954590 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c7b00370-7160-4332-b59c-02b8e4bf55eb tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:53.955869 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c7b00370-7160-4332-b59c-02b8e4bf55eb tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: f10456f4-625a-483d-98e7-e1d23d187571] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:53.976921 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c7b00370-7160-4332-b59c-02b8e4bf55eb tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:53.977456 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c7b00370-7160-4332-b59c-02b8e4bf55eb tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:53.990077 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c7b00370-7160-4332-b59c-02b8e4bf55eb tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:53.990077 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c7b00370-7160-4332-b59c-02b8e4bf55eb tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:53.990077 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c7b00370-7160-4332-b59c-02b8e4bf55eb tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:53.990077 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c7b00370-7160-4332-b59c-02b8e4bf55eb tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:54.011384 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-c7b00370-7160-4332-b59c-02b8e4bf55eb tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] HTTP exception thrown: Instance f10456f4-625a-483d-98e7-e1d23d187571 could not be found. Oct 19 03:26:54.013069 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c7b00370-7160-4332-b59c-02b8e4bf55eb tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Request method failure captured: Oct 19 03:26:54.013069 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/f10456f4-625a-483d-98e7-e1d23d187571 HTTP/1.1 Oct 19 03:26:54.013069 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:26:54.013069 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:26:54.013069 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:26:54.013069 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:26:54.013069 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:26:54.013069 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:26:54.013069 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:26:54.013069 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:26:54.013069 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT20gKQCK3ZL5EjJtPpRF7E5hDOxix0C6fC1xUCWH8zbtFP3xUYoeIuXXDuos_Kcg-uER8mXZ0Dro2xiDEvGnr5RthhAxRX-UfAhulQWkJ7AvlI4OyC3dPVV75p4qDytKaHGa_jIWhID093t1C1fPqYSaGdAl1m0elNZW2yuRkiSpcQc Oct 19 03:26:54.013069 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:26:54.013069 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:26:54.013069 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:26:54.013069 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:26:54.013069 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:26:54.013069 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:26:54.013069 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 686dbeeaed0b44538a9bbc54d457a720 Oct 19 03:26:54.013069 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ImagesTestJSON-30140053 Oct 19 03:26:54.013069 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:26:54.013069 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:26:54.014874 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/686dbeeaed0b44538a9bbc54d457a720"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/686dbeeaed0b44538a9bbc54d457a720"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/686dbeeaed0b44538a9bbc54d457a720"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_686dbeeaed0b44538a9bbc54d457a720", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:26:54.014874 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ImagesTestJSON-30140053 Oct 19 03:26:54.014874 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 686dbeeaed0b44538a9bbc54d457a720 Oct 19 03:26:54.014874 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ImagesTestJSON-30140053 Oct 19 03:26:54.014874 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ImagesTestJSON-30140053-project Oct 19 03:26:54.014874 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:26:54.014874 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:26:54.014874 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 57008d884859417ebc1456b55ec3f6e0 Oct 19 03:26:54.014874 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ImagesTestJSON-30140053-project Oct 19 03:26:54.014874 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:26:54.014874 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance f10456f4-625a-483d-98e7-e1d23d187571 could not be found. Oct 19 03:26:54.014874 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': 'f10456f4-625a-483d-98e7-e1d23d187571'} Oct 19 03:26:54.015962 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:26:54.015962 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:26:54.015962 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:26:54.015962 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:26:54.015962 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:26:54.015962 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:26:54.015962 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:26:54.015962 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:26:54.015962 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:26:54.015962 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:26:54.015962 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f10456f4-625a-483d-98e7-e1d23d187571 could not be found. Oct 19 03:26:54.015962 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:26:54.015962 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:26:54.015962 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:26:54.015962 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:26:54.015962 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:26:54.015962 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:26:54.015962 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:26:54.015962 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:26:54.015962 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:26:54.017133 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:26:54.017133 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:26:54.017133 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:26:54.017133 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:26:54.017133 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:26:54.017133 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:26:54.017133 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:26:54.017133 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f10456f4-625a-483d-98e7-e1d23d187571 could not be found. Oct 19 03:26:54.017133 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:26:54.017133 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:26:54.017133 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:26:54.017133 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:26:54.017133 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:26:54.017133 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:26:54.017133 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:26:54.017133 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:26:54.017133 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f10456f4-625a-483d-98e7-e1d23d187571 could not be found. Oct 19 03:26:54.017133 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:26:54.020611 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c7b00370-7160-4332-b59c-02b8e4bf55eb tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Returning 404 to user: Instance f10456f4-625a-483d-98e7-e1d23d187571 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:26:54.026976 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c7b00370-7160-4332-b59c-02b8e4bf55eb tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/f10456f4-625a-483d-98e7-e1d23d187571" status: 404 len: 111 microversion: 2.1 time: 0.074694 Oct 19 03:26:54.027593 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1670/3404] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:53 2022] GET /compute/v2.1/servers/f10456f4-625a-483d-98e7-e1d23d187571 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:26:54.042347 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-8c9ecb42-e4e4-4e36-81f1-d5cf83a0ffac tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:54.043046 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-8c9ecb42-e4e4-4e36-81f1-d5cf83a0ffac tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: e022fc4b-88e6-44c8-9729-7e8d25238bb3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:54.052386 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8c9ecb42-e4e4-4e36-81f1-d5cf83a0ffac tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:54.053051 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8c9ecb42-e4e4-4e36-81f1-d5cf83a0ffac tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:54.054118 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8c9ecb42-e4e4-4e36-81f1-d5cf83a0ffac tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:54.054974 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8c9ecb42-e4e4-4e36-81f1-d5cf83a0ffac tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:54.055533 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8c9ecb42-e4e4-4e36-81f1-d5cf83a0ffac tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:54.056194 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8c9ecb42-e4e4-4e36-81f1-d5cf83a0ffac tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:54.074825 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-8c9ecb42-e4e4-4e36-81f1-d5cf83a0ffac tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] HTTP exception thrown: Instance e022fc4b-88e6-44c8-9729-7e8d25238bb3 could not be found. Oct 19 03:26:54.076750 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-8c9ecb42-e4e4-4e36-81f1-d5cf83a0ffac tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Request method failure captured: Oct 19 03:26:54.076750 n-d-861333-8 devstack@n-api.service[121135]: request: DELETE /compute/v2.1/servers/e022fc4b-88e6-44c8-9729-7e8d25238bb3 HTTP/1.1 Oct 19 03:26:54.076750 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:26:54.076750 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:26:54.076750 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:26:54.076750 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:26:54.076750 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:26:54.076750 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:26:54.076750 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:26:54.076750 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:26:54.076750 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT20gKQCK3ZL5EjJtPpRF7E5hDOxix0C6fC1xUCWH8zbtFP3xUYoeIuXXDuos_Kcg-uER8mXZ0Dro2xiDEvGnr5RthhAxRX-UfAhulQWkJ7AvlI4OyC3dPVV75p4qDytKaHGa_jIWhID093t1C1fPqYSaGdAl1m0elNZW2yuRkiSpcQc Oct 19 03:26:54.076750 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:26:54.076750 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:26:54.076750 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:26:54.076750 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:26:54.076750 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:26:54.076750 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:26:54.076750 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 686dbeeaed0b44538a9bbc54d457a720 Oct 19 03:26:54.076750 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ImagesTestJSON-30140053 Oct 19 03:26:54.076750 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:26:54.076750 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:26:54.078380 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/686dbeeaed0b44538a9bbc54d457a720"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/686dbeeaed0b44538a9bbc54d457a720"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/686dbeeaed0b44538a9bbc54d457a720"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_686dbeeaed0b44538a9bbc54d457a720", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:26:54.078380 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ImagesTestJSON-30140053 Oct 19 03:26:54.078380 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 686dbeeaed0b44538a9bbc54d457a720 Oct 19 03:26:54.078380 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ImagesTestJSON-30140053 Oct 19 03:26:54.078380 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ImagesTestJSON-30140053-project Oct 19 03:26:54.078380 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:26:54.078380 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:26:54.078380 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 57008d884859417ebc1456b55ec3f6e0 Oct 19 03:26:54.078380 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ImagesTestJSON-30140053-project Oct 19 03:26:54.078380 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:26:54.078380 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance e022fc4b-88e6-44c8-9729-7e8d25238bb3 could not be found. Oct 19 03:26:54.078380 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': 'e022fc4b-88e6-44c8-9729-7e8d25238bb3'} Oct 19 03:26:54.079266 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:26:54.079266 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:26:54.079266 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:26:54.079266 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:26:54.079266 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:26:54.079266 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:26:54.079266 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:26:54.079266 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:26:54.079266 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:26:54.079266 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:26:54.079266 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e022fc4b-88e6-44c8-9729-7e8d25238bb3 could not be found. Oct 19 03:26:54.079266 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:26:54.079266 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:26:54.079266 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:26:54.079266 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:26:54.079266 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:26:54.079266 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:26:54.079266 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:26:54.079266 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:26:54.079266 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:26:54.080800 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:26:54.080800 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 03:26:54.080800 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 03:26:54.080800 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 03:26:54.080800 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 03:26:54.080800 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:26:54.080800 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:26:54.080800 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:26:54.080800 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:26:54.080800 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e022fc4b-88e6-44c8-9729-7e8d25238bb3 could not be found. Oct 19 03:26:54.080800 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:26:54.080800 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:26:54.080800 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:26:54.080800 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:26:54.080800 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:26:54.080800 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:26:54.080800 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:26:54.080800 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:26:54.080800 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e022fc4b-88e6-44c8-9729-7e8d25238bb3 could not be found. Oct 19 03:26:54.080800 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:26:54.082193 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-8c9ecb42-e4e4-4e36-81f1-d5cf83a0ffac tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Returning 404 to user: Instance e022fc4b-88e6-44c8-9729-7e8d25238bb3 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:26:54.082193 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-8c9ecb42-e4e4-4e36-81f1-d5cf83a0ffac tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "DELETE /compute/v2.1/servers/e022fc4b-88e6-44c8-9729-7e8d25238bb3" status: 404 len: 111 microversion: 2.1 time: 0.047679 Oct 19 03:26:54.082193 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1735/3405] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:26:54 2022] DELETE /compute/v2.1/servers/e022fc4b-88e6-44c8-9729-7e8d25238bb3 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:26:54.092160 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b250cdc3-8ecc-4711-a1ec-0435ff506acf tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:54.092905 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b250cdc3-8ecc-4711-a1ec-0435ff506acf tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: e022fc4b-88e6-44c8-9729-7e8d25238bb3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:54.099091 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b250cdc3-8ecc-4711-a1ec-0435ff506acf tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:54.099577 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b250cdc3-8ecc-4711-a1ec-0435ff506acf tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:54.100019 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b250cdc3-8ecc-4711-a1ec-0435ff506acf tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:54.101462 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b250cdc3-8ecc-4711-a1ec-0435ff506acf tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:54.101912 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b250cdc3-8ecc-4711-a1ec-0435ff506acf tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:54.102347 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b250cdc3-8ecc-4711-a1ec-0435ff506acf tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:54.119789 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-b250cdc3-8ecc-4711-a1ec-0435ff506acf tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] HTTP exception thrown: Instance e022fc4b-88e6-44c8-9729-7e8d25238bb3 could not be found. Oct 19 03:26:54.121420 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b250cdc3-8ecc-4711-a1ec-0435ff506acf tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Request method failure captured: Oct 19 03:26:54.121420 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/e022fc4b-88e6-44c8-9729-7e8d25238bb3 HTTP/1.1 Oct 19 03:26:54.121420 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:26:54.121420 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:26:54.121420 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:26:54.121420 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:26:54.121420 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:26:54.121420 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:26:54.121420 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:26:54.121420 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:26:54.121420 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT20gKQCK3ZL5EjJtPpRF7E5hDOxix0C6fC1xUCWH8zbtFP3xUYoeIuXXDuos_Kcg-uER8mXZ0Dro2xiDEvGnr5RthhAxRX-UfAhulQWkJ7AvlI4OyC3dPVV75p4qDytKaHGa_jIWhID093t1C1fPqYSaGdAl1m0elNZW2yuRkiSpcQc Oct 19 03:26:54.121420 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:26:54.121420 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:26:54.121420 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:26:54.121420 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:26:54.121420 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:26:54.121420 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:26:54.121420 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 686dbeeaed0b44538a9bbc54d457a720 Oct 19 03:26:54.121420 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ImagesTestJSON-30140053 Oct 19 03:26:54.121420 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:26:54.121420 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:26:54.123037 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/686dbeeaed0b44538a9bbc54d457a720"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/686dbeeaed0b44538a9bbc54d457a720"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/686dbeeaed0b44538a9bbc54d457a720"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_686dbeeaed0b44538a9bbc54d457a720", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:26:54.123037 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ImagesTestJSON-30140053 Oct 19 03:26:54.123037 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 686dbeeaed0b44538a9bbc54d457a720 Oct 19 03:26:54.123037 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ImagesTestJSON-30140053 Oct 19 03:26:54.123037 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ImagesTestJSON-30140053-project Oct 19 03:26:54.123037 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:26:54.123037 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:26:54.123037 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 57008d884859417ebc1456b55ec3f6e0 Oct 19 03:26:54.123037 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ImagesTestJSON-30140053-project Oct 19 03:26:54.123037 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:26:54.123037 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance e022fc4b-88e6-44c8-9729-7e8d25238bb3 could not be found. Oct 19 03:26:54.123037 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': 'e022fc4b-88e6-44c8-9729-7e8d25238bb3'} Oct 19 03:26:54.123982 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:26:54.123982 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:26:54.123982 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:26:54.123982 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:26:54.123982 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:26:54.123982 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:26:54.123982 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:26:54.123982 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:26:54.123982 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:26:54.123982 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:26:54.123982 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e022fc4b-88e6-44c8-9729-7e8d25238bb3 could not be found. Oct 19 03:26:54.123982 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:26:54.123982 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:26:54.123982 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:26:54.123982 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:26:54.123982 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:26:54.123982 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:26:54.123982 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:26:54.123982 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:26:54.123982 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:26:54.125864 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:26:54.125864 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:26:54.125864 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:26:54.125864 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:26:54.125864 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:26:54.125864 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:26:54.125864 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:26:54.125864 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e022fc4b-88e6-44c8-9729-7e8d25238bb3 could not be found. Oct 19 03:26:54.125864 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:26:54.125864 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:26:54.125864 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:26:54.125864 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:26:54.125864 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:26:54.125864 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:26:54.125864 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:26:54.125864 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:26:54.125864 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e022fc4b-88e6-44c8-9729-7e8d25238bb3 could not be found. Oct 19 03:26:54.125864 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:26:54.127586 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b250cdc3-8ecc-4711-a1ec-0435ff506acf tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Returning 404 to user: Instance e022fc4b-88e6-44c8-9729-7e8d25238bb3 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:26:54.127586 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b250cdc3-8ecc-4711-a1ec-0435ff506acf tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/e022fc4b-88e6-44c8-9729-7e8d25238bb3" status: 404 len: 111 microversion: 2.1 time: 0.036677 Oct 19 03:26:54.127586 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1671/3406] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:54 2022] GET /compute/v2.1/servers/e022fc4b-88e6-44c8-9729-7e8d25238bb3 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:26:54.132393 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d6fce1a9-9d7a-48db-9aa7-8850aea444ef tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '.version_select at 0x7fc1305f4d30>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:54.159556 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-d6fce1a9-9d7a-48db-9aa7-8850aea444ef tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] HTTP exception thrown: Image not found. Oct 19 03:26:54.161401 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d6fce1a9-9d7a-48db-9aa7-8850aea444ef tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Request method failure captured: Oct 19 03:26:54.161401 n-d-861333-8 devstack@n-api.service[121135]: request: DELETE /compute/v2.1/images/9014f0d3-c315-4e14-86df-7411ca9d43dc HTTP/1.1 Oct 19 03:26:54.161401 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:26:54.161401 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:26:54.161401 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:26:54.161401 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:26:54.161401 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:26:54.161401 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:26:54.161401 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:26:54.161401 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:26:54.161401 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT20gKQCK3ZL5EjJtPpRF7E5hDOxix0C6fC1xUCWH8zbtFP3xUYoeIuXXDuos_Kcg-uER8mXZ0Dro2xiDEvGnr5RthhAxRX-UfAhulQWkJ7AvlI4OyC3dPVV75p4qDytKaHGa_jIWhID093t1C1fPqYSaGdAl1m0elNZW2yuRkiSpcQc Oct 19 03:26:54.161401 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:26:54.161401 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:26:54.161401 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:26:54.161401 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:26:54.161401 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:26:54.161401 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:26:54.161401 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 686dbeeaed0b44538a9bbc54d457a720 Oct 19 03:26:54.161401 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ImagesTestJSON-30140053 Oct 19 03:26:54.161401 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:26:54.161401 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:26:54.163114 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/686dbeeaed0b44538a9bbc54d457a720"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/686dbeeaed0b44538a9bbc54d457a720"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/686dbeeaed0b44538a9bbc54d457a720"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_686dbeeaed0b44538a9bbc54d457a720", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:26:54.163114 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ImagesTestJSON-30140053 Oct 19 03:26:54.163114 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 686dbeeaed0b44538a9bbc54d457a720 Oct 19 03:26:54.163114 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ImagesTestJSON-30140053 Oct 19 03:26:54.163114 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ImagesTestJSON-30140053-project Oct 19 03:26:54.163114 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:26:54.163114 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:26:54.163114 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 57008d884859417ebc1456b55ec3f6e0 Oct 19 03:26:54.163114 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ImagesTestJSON-30140053-project Oct 19 03:26:54.163114 n-d-861333-8 devstack@n-api.service[121135]: method: Oct 19 03:26:54.163114 n-d-861333-8 devstack@n-api.service[121135]: exception: Image not found. Oct 19 03:26:54.163114 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '9014f0d3-c315-4e14-86df-7411ca9d43dc'} Oct 19 03:26:54.163114 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:26:54.163114 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:26:54.166259 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 19 03:26:54.166259 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 19 03:26:54.166259 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 19 03:26:54.166259 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 19 03:26:54.166259 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 19 03:26:54.166259 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 19 03:26:54.166259 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 19 03:26:54.166259 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 19 03:26:54.166259 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 19 03:26:54.166259 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 19 03:26:54.166259 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 19 03:26:54.166259 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 19 03:26:54.166259 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 19 03:26:54.166259 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 19 03:26:54.166259 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 9014f0d3-c315-4e14-86df-7411ca9d43dc to delete Oct 19 03:26:54.166259 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:26:54.166259 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:26:54.166259 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:26:54.166259 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:26:54.167374 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 19 03:26:54.167374 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 19 03:26:54.167374 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 19 03:26:54.167374 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 19 03:26:54.167374 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 19 03:26:54.167374 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 19 03:26:54.167374 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9014f0d3-c315-4e14-86df-7411ca9d43dc could not be found. Oct 19 03:26:54.167374 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:26:54.167374 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:26:54.167374 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:26:54.167374 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:26:54.167374 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:26:54.167374 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:26:54.167374 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:26:54.167374 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:26:54.167374 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 03:26:54.167374 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 03:26:54.167374 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:26:54.167374 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:26:54.167374 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 19 03:26:54.168561 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 19 03:26:54.168561 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 19 03:26:54.168561 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:26:54.168561 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:26:54.168561 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:26:54.168561 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:26:54.168561 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:26:54.168561 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:26:54.168561 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:26:54.168561 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:26:54.168561 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 19 03:26:54.168561 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:26:54.168561 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d6fce1a9-9d7a-48db-9aa7-8850aea444ef tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Returning 404 to user: Image not found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:26:54.168561 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d6fce1a9-9d7a-48db-9aa7-8850aea444ef tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "DELETE /compute/v2.1/images/9014f0d3-c315-4e14-86df-7411ca9d43dc" status: 404 len: 62 microversion: 2.1 time: 0.034505 Oct 19 03:26:54.168561 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1736/3407] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:54 2022] DELETE /compute/v2.1/images/9014f0d3-c315-4e14-86df-7411ca9d43dc => generated 62 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 03:26:54.172414 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f3d0ad8e-651e-4602-a573-41f04f33d91b tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:54.172914 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f3d0ad8e-651e-4602-a573-41f04f33d91b tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: e5093d9e-cd31-4074-b339-828de5892bd1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:54.179336 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f3d0ad8e-651e-4602-a573-41f04f33d91b tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:54.179800 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f3d0ad8e-651e-4602-a573-41f04f33d91b tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:54.180248 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f3d0ad8e-651e-4602-a573-41f04f33d91b tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:54.180939 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f3d0ad8e-651e-4602-a573-41f04f33d91b tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:54.181531 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f3d0ad8e-651e-4602-a573-41f04f33d91b tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:54.181960 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f3d0ad8e-651e-4602-a573-41f04f33d91b tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:54.220105 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-f3d0ad8e-651e-4602-a573-41f04f33d91b tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] HTTP exception thrown: Instance e5093d9e-cd31-4074-b339-828de5892bd1 could not be found. Oct 19 03:26:54.221940 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f3d0ad8e-651e-4602-a573-41f04f33d91b tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Request method failure captured: Oct 19 03:26:54.221940 n-d-861333-8 devstack@n-api.service[121134]: request: DELETE /compute/v2.1/servers/e5093d9e-cd31-4074-b339-828de5892bd1 HTTP/1.1 Oct 19 03:26:54.221940 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:26:54.221940 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:26:54.221940 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:26:54.221940 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:26:54.221940 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:26:54.221940 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:26:54.221940 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:26:54.221940 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:26:54.221940 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT20gKQCK3ZL5EjJtPpRF7E5hDOxix0C6fC1xUCWH8zbtFP3xUYoeIuXXDuos_Kcg-uER8mXZ0Dro2xiDEvGnr5RthhAxRX-UfAhulQWkJ7AvlI4OyC3dPVV75p4qDytKaHGa_jIWhID093t1C1fPqYSaGdAl1m0elNZW2yuRkiSpcQc Oct 19 03:26:54.221940 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:26:54.221940 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:26:54.221940 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:26:54.221940 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:26:54.221940 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:26:54.221940 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:26:54.221940 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 686dbeeaed0b44538a9bbc54d457a720 Oct 19 03:26:54.221940 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ImagesTestJSON-30140053 Oct 19 03:26:54.221940 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:26:54.221940 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:26:54.223458 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/686dbeeaed0b44538a9bbc54d457a720"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/686dbeeaed0b44538a9bbc54d457a720"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/686dbeeaed0b44538a9bbc54d457a720"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_686dbeeaed0b44538a9bbc54d457a720", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:26:54.223458 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ImagesTestJSON-30140053 Oct 19 03:26:54.223458 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 686dbeeaed0b44538a9bbc54d457a720 Oct 19 03:26:54.223458 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ImagesTestJSON-30140053 Oct 19 03:26:54.223458 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ImagesTestJSON-30140053-project Oct 19 03:26:54.223458 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:26:54.223458 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:26:54.223458 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 57008d884859417ebc1456b55ec3f6e0 Oct 19 03:26:54.223458 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ImagesTestJSON-30140053-project Oct 19 03:26:54.223458 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:26:54.223458 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance e5093d9e-cd31-4074-b339-828de5892bd1 could not be found. Oct 19 03:26:54.223458 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': 'e5093d9e-cd31-4074-b339-828de5892bd1'} Oct 19 03:26:54.224515 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:26:54.224515 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:26:54.224515 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:26:54.224515 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:26:54.224515 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:26:54.224515 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:26:54.224515 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:26:54.224515 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:26:54.224515 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:26:54.224515 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:26:54.224515 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5093d9e-cd31-4074-b339-828de5892bd1 could not be found. Oct 19 03:26:54.224515 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:26:54.224515 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:26:54.224515 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:26:54.224515 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:26:54.224515 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:26:54.224515 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:26:54.224515 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:26:54.224515 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:26:54.224515 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:26:54.226057 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:26:54.226057 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 03:26:54.226057 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 03:26:54.226057 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 03:26:54.226057 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 03:26:54.226057 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:26:54.226057 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:26:54.226057 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:26:54.226057 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:26:54.226057 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5093d9e-cd31-4074-b339-828de5892bd1 could not be found. Oct 19 03:26:54.226057 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:26:54.226057 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:26:54.226057 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:26:54.226057 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:26:54.226057 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:26:54.226057 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:26:54.226057 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:26:54.226057 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:26:54.226057 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5093d9e-cd31-4074-b339-828de5892bd1 could not be found. Oct 19 03:26:54.226057 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:26:54.227576 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f3d0ad8e-651e-4602-a573-41f04f33d91b tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Returning 404 to user: Instance e5093d9e-cd31-4074-b339-828de5892bd1 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:26:54.227576 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f3d0ad8e-651e-4602-a573-41f04f33d91b tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "DELETE /compute/v2.1/servers/e5093d9e-cd31-4074-b339-828de5892bd1" status: 404 len: 111 microversion: 2.1 time: 0.055244 Oct 19 03:26:54.227576 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1672/3408] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:26:54 2022] DELETE /compute/v2.1/servers/e5093d9e-cd31-4074-b339-828de5892bd1 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 03:26:54.232188 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1924c7f1-02f3-4227-a6e8-bb47bf5e004f tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:54.232806 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1924c7f1-02f3-4227-a6e8-bb47bf5e004f tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: e5093d9e-cd31-4074-b339-828de5892bd1] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:54.240178 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1924c7f1-02f3-4227-a6e8-bb47bf5e004f tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:54.240679 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1924c7f1-02f3-4227-a6e8-bb47bf5e004f tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:54.241563 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1924c7f1-02f3-4227-a6e8-bb47bf5e004f tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:54.242440 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1924c7f1-02f3-4227-a6e8-bb47bf5e004f tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:54.242909 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1924c7f1-02f3-4227-a6e8-bb47bf5e004f tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:54.243354 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1924c7f1-02f3-4227-a6e8-bb47bf5e004f tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:54.268017 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-1924c7f1-02f3-4227-a6e8-bb47bf5e004f tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] HTTP exception thrown: Instance e5093d9e-cd31-4074-b339-828de5892bd1 could not be found. Oct 19 03:26:54.269891 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1924c7f1-02f3-4227-a6e8-bb47bf5e004f tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Request method failure captured: Oct 19 03:26:54.269891 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/e5093d9e-cd31-4074-b339-828de5892bd1 HTTP/1.1 Oct 19 03:26:54.269891 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:26:54.269891 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:26:54.269891 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:26:54.269891 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:26:54.269891 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:26:54.269891 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:26:54.269891 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:26:54.269891 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:26:54.269891 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT20gKQCK3ZL5EjJtPpRF7E5hDOxix0C6fC1xUCWH8zbtFP3xUYoeIuXXDuos_Kcg-uER8mXZ0Dro2xiDEvGnr5RthhAxRX-UfAhulQWkJ7AvlI4OyC3dPVV75p4qDytKaHGa_jIWhID093t1C1fPqYSaGdAl1m0elNZW2yuRkiSpcQc Oct 19 03:26:54.269891 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:26:54.269891 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:26:54.269891 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:26:54.269891 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:26:54.269891 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:26:54.269891 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:26:54.269891 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 686dbeeaed0b44538a9bbc54d457a720 Oct 19 03:26:54.269891 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ImagesTestJSON-30140053 Oct 19 03:26:54.269891 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:26:54.269891 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:26:54.271417 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/686dbeeaed0b44538a9bbc54d457a720"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/686dbeeaed0b44538a9bbc54d457a720"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/686dbeeaed0b44538a9bbc54d457a720"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_686dbeeaed0b44538a9bbc54d457a720", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:26:54.271417 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ImagesTestJSON-30140053 Oct 19 03:26:54.271417 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 686dbeeaed0b44538a9bbc54d457a720 Oct 19 03:26:54.271417 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ImagesTestJSON-30140053 Oct 19 03:26:54.271417 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ImagesTestJSON-30140053-project Oct 19 03:26:54.271417 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:26:54.271417 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:26:54.271417 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 57008d884859417ebc1456b55ec3f6e0 Oct 19 03:26:54.271417 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ImagesTestJSON-30140053-project Oct 19 03:26:54.271417 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:26:54.271417 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance e5093d9e-cd31-4074-b339-828de5892bd1 could not be found. Oct 19 03:26:54.271417 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': 'e5093d9e-cd31-4074-b339-828de5892bd1'} Oct 19 03:26:54.273517 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:26:54.273517 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:26:54.273517 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:26:54.273517 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:26:54.273517 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:26:54.273517 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:26:54.273517 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:26:54.273517 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:26:54.273517 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:26:54.273517 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:26:54.273517 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5093d9e-cd31-4074-b339-828de5892bd1 could not be found. Oct 19 03:26:54.273517 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:26:54.273517 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:26:54.273517 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:26:54.273517 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:26:54.273517 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:26:54.273517 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:26:54.273517 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:26:54.273517 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:26:54.273517 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:26:54.275149 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:26:54.275149 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:26:54.275149 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:26:54.275149 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:26:54.275149 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:26:54.275149 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:26:54.275149 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:26:54.275149 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5093d9e-cd31-4074-b339-828de5892bd1 could not be found. Oct 19 03:26:54.275149 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:26:54.275149 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:26:54.275149 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:26:54.275149 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:26:54.275149 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:26:54.275149 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:26:54.275149 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:26:54.275149 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:26:54.275149 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5093d9e-cd31-4074-b339-828de5892bd1 could not be found. Oct 19 03:26:54.275149 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:26:54.276447 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1924c7f1-02f3-4227-a6e8-bb47bf5e004f tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Returning 404 to user: Instance e5093d9e-cd31-4074-b339-828de5892bd1 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:26:54.276447 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1924c7f1-02f3-4227-a6e8-bb47bf5e004f tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/e5093d9e-cd31-4074-b339-828de5892bd1" status: 404 len: 111 microversion: 2.1 time: 0.043059 Oct 19 03:26:54.276447 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1737/3409] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:54 2022] GET /compute/v2.1/servers/e5093d9e-cd31-4074-b339-828de5892bd1 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:26:54.283013 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-343a8340-f3b0-478c-bc02-95bbf32d282b tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '.version_select at 0x7fc13057bdc0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:54.309653 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-343a8340-f3b0-478c-bc02-95bbf32d282b tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] HTTP exception thrown: Image not found. Oct 19 03:26:54.311546 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-343a8340-f3b0-478c-bc02-95bbf32d282b tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Request method failure captured: Oct 19 03:26:54.311546 n-d-861333-8 devstack@n-api.service[121134]: request: DELETE /compute/v2.1/images/d097da85-3979-4bc7-a81a-f2cd9d38e3ff HTTP/1.1 Oct 19 03:26:54.311546 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:26:54.311546 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:26:54.311546 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:26:54.311546 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:26:54.311546 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:26:54.311546 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:26:54.311546 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:26:54.311546 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:26:54.311546 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT20gKQCK3ZL5EjJtPpRF7E5hDOxix0C6fC1xUCWH8zbtFP3xUYoeIuXXDuos_Kcg-uER8mXZ0Dro2xiDEvGnr5RthhAxRX-UfAhulQWkJ7AvlI4OyC3dPVV75p4qDytKaHGa_jIWhID093t1C1fPqYSaGdAl1m0elNZW2yuRkiSpcQc Oct 19 03:26:54.311546 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:26:54.311546 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:26:54.311546 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:26:54.311546 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:26:54.311546 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:26:54.311546 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:26:54.311546 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 686dbeeaed0b44538a9bbc54d457a720 Oct 19 03:26:54.311546 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ImagesTestJSON-30140053 Oct 19 03:26:54.311546 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:26:54.311546 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:26:54.313194 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/686dbeeaed0b44538a9bbc54d457a720"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/686dbeeaed0b44538a9bbc54d457a720"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/686dbeeaed0b44538a9bbc54d457a720"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_686dbeeaed0b44538a9bbc54d457a720", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:26:54.313194 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ImagesTestJSON-30140053 Oct 19 03:26:54.313194 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 686dbeeaed0b44538a9bbc54d457a720 Oct 19 03:26:54.313194 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ImagesTestJSON-30140053 Oct 19 03:26:54.313194 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ImagesTestJSON-30140053-project Oct 19 03:26:54.313194 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:26:54.313194 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:26:54.313194 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 57008d884859417ebc1456b55ec3f6e0 Oct 19 03:26:54.313194 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ImagesTestJSON-30140053-project Oct 19 03:26:54.313194 n-d-861333-8 devstack@n-api.service[121134]: method: Oct 19 03:26:54.313194 n-d-861333-8 devstack@n-api.service[121134]: exception: Image not found. Oct 19 03:26:54.313194 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': 'd097da85-3979-4bc7-a81a-f2cd9d38e3ff'} Oct 19 03:26:54.313194 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:26:54.313194 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:26:54.314239 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 19 03:26:54.314239 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 19 03:26:54.314239 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 19 03:26:54.314239 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 19 03:26:54.314239 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 19 03:26:54.314239 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 19 03:26:54.314239 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 19 03:26:54.314239 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 19 03:26:54.314239 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 19 03:26:54.314239 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 19 03:26:54.314239 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 19 03:26:54.314239 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 19 03:26:54.314239 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 19 03:26:54.314239 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 19 03:26:54.314239 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image d097da85-3979-4bc7-a81a-f2cd9d38e3ff to delete Oct 19 03:26:54.314239 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:26:54.314239 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:26:54.314239 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:26:54.314239 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:26:54.315605 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 19 03:26:54.315605 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 19 03:26:54.315605 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 19 03:26:54.315605 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 19 03:26:54.315605 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 19 03:26:54.315605 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 19 03:26:54.315605 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d097da85-3979-4bc7-a81a-f2cd9d38e3ff could not be found. Oct 19 03:26:54.315605 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:26:54.315605 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:26:54.315605 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:26:54.315605 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:26:54.315605 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:26:54.315605 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:26:54.315605 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:26:54.315605 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:26:54.315605 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 03:26:54.315605 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 03:26:54.315605 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:26:54.315605 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:26:54.315605 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 19 03:26:54.317006 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 19 03:26:54.317006 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 19 03:26:54.317006 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:26:54.317006 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:26:54.317006 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:26:54.317006 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:26:54.317006 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:26:54.317006 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:26:54.317006 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:26:54.317006 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:26:54.317006 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 19 03:26:54.317006 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:26:54.318715 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-343a8340-f3b0-478c-bc02-95bbf32d282b tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Returning 404 to user: Image not found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:26:54.320349 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-343a8340-f3b0-478c-bc02-95bbf32d282b tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "DELETE /compute/v2.1/images/d097da85-3979-4bc7-a81a-f2cd9d38e3ff" status: 404 len: 62 microversion: 2.1 time: 0.041058 Oct 19 03:26:54.321448 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1673/3410] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:54 2022] DELETE /compute/v2.1/images/d097da85-3979-4bc7-a81a-f2cd9d38e3ff => generated 62 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 03:26:54.330423 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-71df9240-6d9f-4ec9-bda4-9581c6dc37ed tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:54.331355 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-71df9240-6d9f-4ec9-bda4-9581c6dc37ed tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: 4d77faf6-475d-4711-820a-623c1b705f8c] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:54.339829 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-71df9240-6d9f-4ec9-bda4-9581c6dc37ed tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:54.340320 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-71df9240-6d9f-4ec9-bda4-9581c6dc37ed tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:54.340757 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-71df9240-6d9f-4ec9-bda4-9581c6dc37ed tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:54.341564 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-71df9240-6d9f-4ec9-bda4-9581c6dc37ed tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:54.342019 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-71df9240-6d9f-4ec9-bda4-9581c6dc37ed tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:54.342445 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-71df9240-6d9f-4ec9-bda4-9581c6dc37ed tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:54.357311 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-71df9240-6d9f-4ec9-bda4-9581c6dc37ed tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] HTTP exception thrown: Instance 4d77faf6-475d-4711-820a-623c1b705f8c could not be found. Oct 19 03:26:54.359329 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-71df9240-6d9f-4ec9-bda4-9581c6dc37ed tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Request method failure captured: Oct 19 03:26:54.359329 n-d-861333-8 devstack@n-api.service[121135]: request: DELETE /compute/v2.1/servers/4d77faf6-475d-4711-820a-623c1b705f8c HTTP/1.1 Oct 19 03:26:54.359329 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:26:54.359329 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:26:54.359329 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:26:54.359329 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:26:54.359329 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:26:54.359329 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:26:54.359329 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:26:54.359329 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:26:54.359329 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT20gKQCK3ZL5EjJtPpRF7E5hDOxix0C6fC1xUCWH8zbtFP3xUYoeIuXXDuos_Kcg-uER8mXZ0Dro2xiDEvGnr5RthhAxRX-UfAhulQWkJ7AvlI4OyC3dPVV75p4qDytKaHGa_jIWhID093t1C1fPqYSaGdAl1m0elNZW2yuRkiSpcQc Oct 19 03:26:54.359329 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:26:54.359329 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:26:54.359329 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:26:54.359329 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:26:54.359329 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:26:54.359329 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:26:54.359329 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 686dbeeaed0b44538a9bbc54d457a720 Oct 19 03:26:54.359329 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ImagesTestJSON-30140053 Oct 19 03:26:54.359329 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:26:54.359329 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:26:54.361053 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/686dbeeaed0b44538a9bbc54d457a720"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/686dbeeaed0b44538a9bbc54d457a720"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/686dbeeaed0b44538a9bbc54d457a720"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_686dbeeaed0b44538a9bbc54d457a720", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:26:54.361053 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ImagesTestJSON-30140053 Oct 19 03:26:54.361053 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 686dbeeaed0b44538a9bbc54d457a720 Oct 19 03:26:54.361053 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ImagesTestJSON-30140053 Oct 19 03:26:54.361053 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ImagesTestJSON-30140053-project Oct 19 03:26:54.361053 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:26:54.361053 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:26:54.361053 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 57008d884859417ebc1456b55ec3f6e0 Oct 19 03:26:54.361053 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ImagesTestJSON-30140053-project Oct 19 03:26:54.361053 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:26:54.361053 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance 4d77faf6-475d-4711-820a-623c1b705f8c could not be found. Oct 19 03:26:54.361053 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '4d77faf6-475d-4711-820a-623c1b705f8c'} Oct 19 03:26:54.362077 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:26:54.362077 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:26:54.362077 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:26:54.362077 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:26:54.362077 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:26:54.362077 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:26:54.362077 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:26:54.362077 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:26:54.362077 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:26:54.362077 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:26:54.362077 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d77faf6-475d-4711-820a-623c1b705f8c could not be found. Oct 19 03:26:54.362077 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:26:54.362077 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:26:54.362077 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:26:54.362077 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:26:54.362077 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:26:54.362077 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:26:54.362077 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:26:54.362077 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:26:54.362077 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:26:54.363899 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:26:54.363899 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 03:26:54.363899 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 03:26:54.363899 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 03:26:54.363899 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 03:26:54.363899 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:26:54.363899 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:26:54.363899 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:26:54.363899 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:26:54.363899 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d77faf6-475d-4711-820a-623c1b705f8c could not be found. Oct 19 03:26:54.363899 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:26:54.363899 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:26:54.363899 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:26:54.363899 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:26:54.363899 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:26:54.363899 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:26:54.363899 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:26:54.363899 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:26:54.363899 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d77faf6-475d-4711-820a-623c1b705f8c could not be found. Oct 19 03:26:54.363899 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:26:54.365552 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-71df9240-6d9f-4ec9-bda4-9581c6dc37ed tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Returning 404 to user: Instance 4d77faf6-475d-4711-820a-623c1b705f8c could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:26:54.365552 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-71df9240-6d9f-4ec9-bda4-9581c6dc37ed tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "DELETE /compute/v2.1/servers/4d77faf6-475d-4711-820a-623c1b705f8c" status: 404 len: 111 microversion: 2.1 time: 0.035356 Oct 19 03:26:54.375617 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f748acc8-b529-43b0-84ec-100de1588e9a tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:54.377598 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f748acc8-b529-43b0-84ec-100de1588e9a tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: 4d77faf6-475d-4711-820a-623c1b705f8c] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:54.380810 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1738/3411] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:26:54 2022] DELETE /compute/v2.1/servers/4d77faf6-475d-4711-820a-623c1b705f8c => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 03:26:54.387945 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f748acc8-b529-43b0-84ec-100de1588e9a tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:54.388865 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f748acc8-b529-43b0-84ec-100de1588e9a tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:54.389515 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f748acc8-b529-43b0-84ec-100de1588e9a tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:54.393051 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f748acc8-b529-43b0-84ec-100de1588e9a tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:54.394003 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f748acc8-b529-43b0-84ec-100de1588e9a tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:54.395969 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f748acc8-b529-43b0-84ec-100de1588e9a tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:54.416452 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-f748acc8-b529-43b0-84ec-100de1588e9a tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] HTTP exception thrown: Instance 4d77faf6-475d-4711-820a-623c1b705f8c could not be found. Oct 19 03:26:54.418699 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f748acc8-b529-43b0-84ec-100de1588e9a tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Request method failure captured: Oct 19 03:26:54.418699 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/4d77faf6-475d-4711-820a-623c1b705f8c HTTP/1.1 Oct 19 03:26:54.418699 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:26:54.418699 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:26:54.418699 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:26:54.418699 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:26:54.418699 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:26:54.418699 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:26:54.418699 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:26:54.418699 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:26:54.418699 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT20gKQCK3ZL5EjJtPpRF7E5hDOxix0C6fC1xUCWH8zbtFP3xUYoeIuXXDuos_Kcg-uER8mXZ0Dro2xiDEvGnr5RthhAxRX-UfAhulQWkJ7AvlI4OyC3dPVV75p4qDytKaHGa_jIWhID093t1C1fPqYSaGdAl1m0elNZW2yuRkiSpcQc Oct 19 03:26:54.418699 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:26:54.418699 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:26:54.418699 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:26:54.418699 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:26:54.418699 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:26:54.418699 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:26:54.418699 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 686dbeeaed0b44538a9bbc54d457a720 Oct 19 03:26:54.418699 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ImagesTestJSON-30140053 Oct 19 03:26:54.418699 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:26:54.418699 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:26:54.427333 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/686dbeeaed0b44538a9bbc54d457a720"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/686dbeeaed0b44538a9bbc54d457a720"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/686dbeeaed0b44538a9bbc54d457a720"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_686dbeeaed0b44538a9bbc54d457a720", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:26:54.427333 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ImagesTestJSON-30140053 Oct 19 03:26:54.427333 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 686dbeeaed0b44538a9bbc54d457a720 Oct 19 03:26:54.427333 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ImagesTestJSON-30140053 Oct 19 03:26:54.427333 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ImagesTestJSON-30140053-project Oct 19 03:26:54.427333 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:26:54.427333 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:26:54.427333 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 57008d884859417ebc1456b55ec3f6e0 Oct 19 03:26:54.427333 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ImagesTestJSON-30140053-project Oct 19 03:26:54.427333 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:26:54.427333 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance 4d77faf6-475d-4711-820a-623c1b705f8c could not be found. Oct 19 03:26:54.427333 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '4d77faf6-475d-4711-820a-623c1b705f8c'} Oct 19 03:26:54.428246 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:26:54.428246 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:26:54.428246 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:26:54.428246 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:26:54.428246 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:26:54.428246 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:26:54.428246 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:26:54.428246 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:26:54.428246 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:26:54.428246 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:26:54.428246 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d77faf6-475d-4711-820a-623c1b705f8c could not be found. Oct 19 03:26:54.428246 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:26:54.428246 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:26:54.428246 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:26:54.428246 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:26:54.428246 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:26:54.428246 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:26:54.428246 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:26:54.428246 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:26:54.428246 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:26:54.430392 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:26:54.430392 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:26:54.430392 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:26:54.430392 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:26:54.430392 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:26:54.430392 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:26:54.430392 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:26:54.430392 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d77faf6-475d-4711-820a-623c1b705f8c could not be found. Oct 19 03:26:54.430392 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:26:54.430392 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:26:54.430392 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:26:54.430392 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:26:54.430392 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:26:54.430392 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:26:54.430392 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:26:54.430392 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:26:54.430392 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d77faf6-475d-4711-820a-623c1b705f8c could not be found. Oct 19 03:26:54.430392 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:26:54.431743 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f748acc8-b529-43b0-84ec-100de1588e9a tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Returning 404 to user: Instance 4d77faf6-475d-4711-820a-623c1b705f8c could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:26:54.431743 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f748acc8-b529-43b0-84ec-100de1588e9a tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/4d77faf6-475d-4711-820a-623c1b705f8c" status: 404 len: 111 microversion: 2.1 time: 0.054663 Oct 19 03:26:54.431743 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1674/3412] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:54 2022] GET /compute/v2.1/servers/4d77faf6-475d-4711-820a-623c1b705f8c => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:26:54.437876 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b97a1091-fdca-42e2-8486-c03161db3a56 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '.version_select at 0x7fc130047d30>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:54.459900 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-b97a1091-fdca-42e2-8486-c03161db3a56 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] HTTP exception thrown: Image not found. Oct 19 03:26:54.462238 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b97a1091-fdca-42e2-8486-c03161db3a56 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Request method failure captured: Oct 19 03:26:54.462238 n-d-861333-8 devstack@n-api.service[121135]: request: DELETE /compute/v2.1/images/9891212c-fa9a-4fc6-b4f5-ab78e62e6e45 HTTP/1.1 Oct 19 03:26:54.462238 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:26:54.462238 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:26:54.462238 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:26:54.462238 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:26:54.462238 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:26:54.462238 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:26:54.462238 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:26:54.462238 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:26:54.462238 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT20gKQCK3ZL5EjJtPpRF7E5hDOxix0C6fC1xUCWH8zbtFP3xUYoeIuXXDuos_Kcg-uER8mXZ0Dro2xiDEvGnr5RthhAxRX-UfAhulQWkJ7AvlI4OyC3dPVV75p4qDytKaHGa_jIWhID093t1C1fPqYSaGdAl1m0elNZW2yuRkiSpcQc Oct 19 03:26:54.462238 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:26:54.462238 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:26:54.462238 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:26:54.462238 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:26:54.462238 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:26:54.462238 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:26:54.462238 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 686dbeeaed0b44538a9bbc54d457a720 Oct 19 03:26:54.462238 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ImagesTestJSON-30140053 Oct 19 03:26:54.462238 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:26:54.462238 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:26:54.463568 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/686dbeeaed0b44538a9bbc54d457a720"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/686dbeeaed0b44538a9bbc54d457a720"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/686dbeeaed0b44538a9bbc54d457a720"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_686dbeeaed0b44538a9bbc54d457a720", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:26:54.463568 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ImagesTestJSON-30140053 Oct 19 03:26:54.463568 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 686dbeeaed0b44538a9bbc54d457a720 Oct 19 03:26:54.463568 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ImagesTestJSON-30140053 Oct 19 03:26:54.463568 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ImagesTestJSON-30140053-project Oct 19 03:26:54.463568 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:26:54.463568 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:26:54.463568 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 57008d884859417ebc1456b55ec3f6e0 Oct 19 03:26:54.463568 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ImagesTestJSON-30140053-project Oct 19 03:26:54.463568 n-d-861333-8 devstack@n-api.service[121135]: method: Oct 19 03:26:54.463568 n-d-861333-8 devstack@n-api.service[121135]: exception: Image not found. Oct 19 03:26:54.463568 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '9891212c-fa9a-4fc6-b4f5-ab78e62e6e45'} Oct 19 03:26:54.463568 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:26:54.463568 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:26:54.464414 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 19 03:26:54.464414 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 19 03:26:54.464414 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 19 03:26:54.464414 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 19 03:26:54.464414 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 19 03:26:54.464414 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 19 03:26:54.464414 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 19 03:26:54.464414 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 19 03:26:54.464414 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 19 03:26:54.464414 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 19 03:26:54.464414 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 19 03:26:54.464414 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 19 03:26:54.464414 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 19 03:26:54.464414 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 19 03:26:54.464414 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 9891212c-fa9a-4fc6-b4f5-ab78e62e6e45 to delete Oct 19 03:26:54.464414 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:26:54.464414 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:26:54.464414 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:26:54.464414 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:26:54.465780 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 19 03:26:54.465780 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 19 03:26:54.465780 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 19 03:26:54.465780 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 19 03:26:54.465780 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 19 03:26:54.465780 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 19 03:26:54.465780 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9891212c-fa9a-4fc6-b4f5-ab78e62e6e45 could not be found. Oct 19 03:26:54.465780 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:26:54.465780 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:26:54.465780 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:26:54.465780 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:26:54.465780 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:26:54.465780 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:26:54.465780 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:26:54.465780 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:26:54.465780 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 03:26:54.465780 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 03:26:54.465780 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:26:54.465780 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:26:54.465780 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 19 03:26:54.466941 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 19 03:26:54.466941 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 19 03:26:54.466941 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:26:54.466941 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:26:54.466941 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:26:54.466941 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:26:54.466941 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:26:54.466941 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:26:54.466941 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:26:54.466941 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:26:54.466941 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 19 03:26:54.466941 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:26:54.466941 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b97a1091-fdca-42e2-8486-c03161db3a56 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Returning 404 to user: Image not found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:26:54.466941 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b97a1091-fdca-42e2-8486-c03161db3a56 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "DELETE /compute/v2.1/images/9891212c-fa9a-4fc6-b4f5-ab78e62e6e45" status: 404 len: 62 microversion: 2.1 time: 0.030675 Oct 19 03:26:54.469461 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1739/3413] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:54 2022] DELETE /compute/v2.1/images/9891212c-fa9a-4fc6-b4f5-ab78e62e6e45 => generated 62 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 03:26:54.472853 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d32973c9-668f-40bc-8401-c544d75b5265 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:54.472991 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d32973c9-668f-40bc-8401-c544d75b5265 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: c45890de-f7bf-4736-8b08-6f3e6863e2b3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:54.479776 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d32973c9-668f-40bc-8401-c544d75b5265 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:54.480274 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d32973c9-668f-40bc-8401-c544d75b5265 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:54.480718 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d32973c9-668f-40bc-8401-c544d75b5265 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:54.481443 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d32973c9-668f-40bc-8401-c544d75b5265 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:54.481907 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d32973c9-668f-40bc-8401-c544d75b5265 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:54.482340 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d32973c9-668f-40bc-8401-c544d75b5265 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:54.497918 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-d32973c9-668f-40bc-8401-c544d75b5265 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] HTTP exception thrown: Instance c45890de-f7bf-4736-8b08-6f3e6863e2b3 could not be found. Oct 19 03:26:54.499491 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d32973c9-668f-40bc-8401-c544d75b5265 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Request method failure captured: Oct 19 03:26:54.499491 n-d-861333-8 devstack@n-api.service[121134]: request: DELETE /compute/v2.1/servers/c45890de-f7bf-4736-8b08-6f3e6863e2b3 HTTP/1.1 Oct 19 03:26:54.499491 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:26:54.499491 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:26:54.499491 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:26:54.499491 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:26:54.499491 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:26:54.499491 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:26:54.499491 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:26:54.499491 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:26:54.499491 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT20gKQCK3ZL5EjJtPpRF7E5hDOxix0C6fC1xUCWH8zbtFP3xUYoeIuXXDuos_Kcg-uER8mXZ0Dro2xiDEvGnr5RthhAxRX-UfAhulQWkJ7AvlI4OyC3dPVV75p4qDytKaHGa_jIWhID093t1C1fPqYSaGdAl1m0elNZW2yuRkiSpcQc Oct 19 03:26:54.499491 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:26:54.499491 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:26:54.499491 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:26:54.499491 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:26:54.499491 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:26:54.499491 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:26:54.499491 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 686dbeeaed0b44538a9bbc54d457a720 Oct 19 03:26:54.499491 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ImagesTestJSON-30140053 Oct 19 03:26:54.499491 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:26:54.499491 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:26:54.501063 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/686dbeeaed0b44538a9bbc54d457a720"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/686dbeeaed0b44538a9bbc54d457a720"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/686dbeeaed0b44538a9bbc54d457a720"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_686dbeeaed0b44538a9bbc54d457a720", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:26:54.501063 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ImagesTestJSON-30140053 Oct 19 03:26:54.501063 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 686dbeeaed0b44538a9bbc54d457a720 Oct 19 03:26:54.501063 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ImagesTestJSON-30140053 Oct 19 03:26:54.501063 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ImagesTestJSON-30140053-project Oct 19 03:26:54.501063 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:26:54.501063 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:26:54.501063 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 57008d884859417ebc1456b55ec3f6e0 Oct 19 03:26:54.501063 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ImagesTestJSON-30140053-project Oct 19 03:26:54.501063 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:26:54.501063 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance c45890de-f7bf-4736-8b08-6f3e6863e2b3 could not be found. Oct 19 03:26:54.501063 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': 'c45890de-f7bf-4736-8b08-6f3e6863e2b3'} Oct 19 03:26:54.505152 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:26:54.505152 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:26:54.505152 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:26:54.505152 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:26:54.505152 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:26:54.505152 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:26:54.505152 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:26:54.505152 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:26:54.505152 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:26:54.505152 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:26:54.505152 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c45890de-f7bf-4736-8b08-6f3e6863e2b3 could not be found. Oct 19 03:26:54.505152 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:26:54.505152 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:26:54.505152 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:26:54.505152 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:26:54.505152 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:26:54.505152 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:26:54.505152 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:26:54.505152 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:26:54.505152 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:26:54.506592 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:26:54.506592 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 03:26:54.506592 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 03:26:54.506592 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 03:26:54.506592 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 03:26:54.506592 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:26:54.506592 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:26:54.506592 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:26:54.506592 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:26:54.506592 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c45890de-f7bf-4736-8b08-6f3e6863e2b3 could not be found. Oct 19 03:26:54.506592 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:26:54.506592 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:26:54.506592 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:26:54.506592 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:26:54.506592 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:26:54.506592 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:26:54.506592 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:26:54.506592 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:26:54.506592 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c45890de-f7bf-4736-8b08-6f3e6863e2b3 could not be found. Oct 19 03:26:54.506592 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:26:54.508152 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d32973c9-668f-40bc-8401-c544d75b5265 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Returning 404 to user: Instance c45890de-f7bf-4736-8b08-6f3e6863e2b3 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:26:54.508152 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d32973c9-668f-40bc-8401-c544d75b5265 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "DELETE /compute/v2.1/servers/c45890de-f7bf-4736-8b08-6f3e6863e2b3" status: 404 len: 111 microversion: 2.1 time: 0.032397 Oct 19 03:26:54.508152 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1675/3414] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:26:54 2022] DELETE /compute/v2.1/servers/c45890de-f7bf-4736-8b08-6f3e6863e2b3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 03:26:54.514117 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1e0a96f3-29fe-4845-9e6a-d2a853fca501 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:54.514927 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1e0a96f3-29fe-4845-9e6a-d2a853fca501 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: c45890de-f7bf-4736-8b08-6f3e6863e2b3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:54.522261 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1e0a96f3-29fe-4845-9e6a-d2a853fca501 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:54.522783 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1e0a96f3-29fe-4845-9e6a-d2a853fca501 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:54.523487 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1e0a96f3-29fe-4845-9e6a-d2a853fca501 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:54.524187 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1e0a96f3-29fe-4845-9e6a-d2a853fca501 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:54.524678 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1e0a96f3-29fe-4845-9e6a-d2a853fca501 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:54.525112 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1e0a96f3-29fe-4845-9e6a-d2a853fca501 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:54.540883 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-1e0a96f3-29fe-4845-9e6a-d2a853fca501 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] HTTP exception thrown: Instance c45890de-f7bf-4736-8b08-6f3e6863e2b3 could not be found. Oct 19 03:26:54.542502 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1e0a96f3-29fe-4845-9e6a-d2a853fca501 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Request method failure captured: Oct 19 03:26:54.542502 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/c45890de-f7bf-4736-8b08-6f3e6863e2b3 HTTP/1.1 Oct 19 03:26:54.542502 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:26:54.542502 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:26:54.542502 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:26:54.542502 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:26:54.542502 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:26:54.542502 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:26:54.542502 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:26:54.542502 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:26:54.542502 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT20gKQCK3ZL5EjJtPpRF7E5hDOxix0C6fC1xUCWH8zbtFP3xUYoeIuXXDuos_Kcg-uER8mXZ0Dro2xiDEvGnr5RthhAxRX-UfAhulQWkJ7AvlI4OyC3dPVV75p4qDytKaHGa_jIWhID093t1C1fPqYSaGdAl1m0elNZW2yuRkiSpcQc Oct 19 03:26:54.542502 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:26:54.542502 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:26:54.542502 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:26:54.542502 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:26:54.542502 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:26:54.542502 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:26:54.542502 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 686dbeeaed0b44538a9bbc54d457a720 Oct 19 03:26:54.542502 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ImagesTestJSON-30140053 Oct 19 03:26:54.542502 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:26:54.542502 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:26:54.543830 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/686dbeeaed0b44538a9bbc54d457a720"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/686dbeeaed0b44538a9bbc54d457a720"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/686dbeeaed0b44538a9bbc54d457a720"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_686dbeeaed0b44538a9bbc54d457a720", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:26:54.543830 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ImagesTestJSON-30140053 Oct 19 03:26:54.543830 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 686dbeeaed0b44538a9bbc54d457a720 Oct 19 03:26:54.543830 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ImagesTestJSON-30140053 Oct 19 03:26:54.543830 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ImagesTestJSON-30140053-project Oct 19 03:26:54.543830 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:26:54.543830 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:26:54.543830 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 57008d884859417ebc1456b55ec3f6e0 Oct 19 03:26:54.543830 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ImagesTestJSON-30140053-project Oct 19 03:26:54.543830 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:26:54.543830 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance c45890de-f7bf-4736-8b08-6f3e6863e2b3 could not be found. Oct 19 03:26:54.543830 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': 'c45890de-f7bf-4736-8b08-6f3e6863e2b3'} Oct 19 03:26:54.544546 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:26:54.544546 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:26:54.544546 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:26:54.544546 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:26:54.544546 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:26:54.544546 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:26:54.544546 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:26:54.544546 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:26:54.544546 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:26:54.544546 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:26:54.544546 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c45890de-f7bf-4736-8b08-6f3e6863e2b3 could not be found. Oct 19 03:26:54.544546 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:26:54.544546 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:26:54.544546 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:26:54.544546 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:26:54.544546 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:26:54.544546 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:26:54.544546 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:26:54.544546 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:26:54.544546 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:26:54.546818 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:26:54.546818 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:26:54.546818 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:26:54.546818 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:26:54.546818 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:26:54.546818 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:26:54.546818 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:26:54.546818 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c45890de-f7bf-4736-8b08-6f3e6863e2b3 could not be found. Oct 19 03:26:54.546818 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:26:54.546818 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:26:54.546818 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:26:54.546818 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:26:54.546818 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:26:54.546818 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:26:54.546818 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:26:54.546818 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:26:54.546818 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c45890de-f7bf-4736-8b08-6f3e6863e2b3 could not be found. Oct 19 03:26:54.546818 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:26:54.548780 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1e0a96f3-29fe-4845-9e6a-d2a853fca501 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Returning 404 to user: Instance c45890de-f7bf-4736-8b08-6f3e6863e2b3 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:26:54.548780 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1e0a96f3-29fe-4845-9e6a-d2a853fca501 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/c45890de-f7bf-4736-8b08-6f3e6863e2b3" status: 404 len: 111 microversion: 2.1 time: 0.034020 Oct 19 03:26:54.548780 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1740/3415] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:54 2022] GET /compute/v2.1/servers/c45890de-f7bf-4736-8b08-6f3e6863e2b3 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 03:26:54.555159 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-71603a36-ef1f-439d-bfe1-843e758f2a66 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '.version_select at 0x7fc1305823a0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:54.587859 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-71603a36-ef1f-439d-bfe1-843e758f2a66 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] HTTP exception thrown: Image not found. Oct 19 03:26:54.589659 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-71603a36-ef1f-439d-bfe1-843e758f2a66 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Request method failure captured: Oct 19 03:26:54.589659 n-d-861333-8 devstack@n-api.service[121134]: request: DELETE /compute/v2.1/images/bb3a25a0-f1e8-496e-9db8-05a27d2b182c HTTP/1.1 Oct 19 03:26:54.589659 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:26:54.589659 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:26:54.589659 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:26:54.589659 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:26:54.589659 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:26:54.589659 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:26:54.589659 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:26:54.589659 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:26:54.589659 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT20gKQCK3ZL5EjJtPpRF7E5hDOxix0C6fC1xUCWH8zbtFP3xUYoeIuXXDuos_Kcg-uER8mXZ0Dro2xiDEvGnr5RthhAxRX-UfAhulQWkJ7AvlI4OyC3dPVV75p4qDytKaHGa_jIWhID093t1C1fPqYSaGdAl1m0elNZW2yuRkiSpcQc Oct 19 03:26:54.589659 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:26:54.589659 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:26:54.589659 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:26:54.589659 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:26:54.589659 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:26:54.589659 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:26:54.589659 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 686dbeeaed0b44538a9bbc54d457a720 Oct 19 03:26:54.589659 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ImagesTestJSON-30140053 Oct 19 03:26:54.589659 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:26:54.589659 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:26:54.590969 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/686dbeeaed0b44538a9bbc54d457a720"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/686dbeeaed0b44538a9bbc54d457a720"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/686dbeeaed0b44538a9bbc54d457a720"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_686dbeeaed0b44538a9bbc54d457a720", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:26:54.590969 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ImagesTestJSON-30140053 Oct 19 03:26:54.590969 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 686dbeeaed0b44538a9bbc54d457a720 Oct 19 03:26:54.590969 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ImagesTestJSON-30140053 Oct 19 03:26:54.590969 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ImagesTestJSON-30140053-project Oct 19 03:26:54.590969 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:26:54.590969 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:26:54.590969 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 57008d884859417ebc1456b55ec3f6e0 Oct 19 03:26:54.590969 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ImagesTestJSON-30140053-project Oct 19 03:26:54.590969 n-d-861333-8 devstack@n-api.service[121134]: method: Oct 19 03:26:54.590969 n-d-861333-8 devstack@n-api.service[121134]: exception: Image not found. Oct 19 03:26:54.590969 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': 'bb3a25a0-f1e8-496e-9db8-05a27d2b182c'} Oct 19 03:26:54.590969 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:26:54.590969 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:26:54.591862 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 19 03:26:54.591862 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 19 03:26:54.591862 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 19 03:26:54.591862 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 19 03:26:54.591862 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 19 03:26:54.591862 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 19 03:26:54.591862 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 19 03:26:54.591862 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 19 03:26:54.591862 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 19 03:26:54.591862 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 19 03:26:54.591862 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 19 03:26:54.591862 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 19 03:26:54.591862 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 19 03:26:54.591862 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 19 03:26:54.591862 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image bb3a25a0-f1e8-496e-9db8-05a27d2b182c to delete Oct 19 03:26:54.591862 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:26:54.591862 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:26:54.591862 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:26:54.591862 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:26:54.596674 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 19 03:26:54.596674 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 19 03:26:54.596674 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 19 03:26:54.596674 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 19 03:26:54.596674 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 19 03:26:54.596674 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 19 03:26:54.596674 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image bb3a25a0-f1e8-496e-9db8-05a27d2b182c could not be found. Oct 19 03:26:54.596674 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:26:54.596674 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:26:54.596674 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:26:54.596674 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:26:54.596674 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:26:54.596674 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:26:54.596674 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:26:54.596674 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:26:54.596674 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 03:26:54.596674 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 03:26:54.596674 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:26:54.596674 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:26:54.596674 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 19 03:26:54.598217 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 19 03:26:54.598217 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 19 03:26:54.598217 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:26:54.598217 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:26:54.598217 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:26:54.598217 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:26:54.598217 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:26:54.598217 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:26:54.598217 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:26:54.598217 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:26:54.598217 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 19 03:26:54.598217 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:26:54.598217 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-71603a36-ef1f-439d-bfe1-843e758f2a66 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Returning 404 to user: Image not found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:26:54.598217 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-71603a36-ef1f-439d-bfe1-843e758f2a66 tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "DELETE /compute/v2.1/images/bb3a25a0-f1e8-496e-9db8-05a27d2b182c" status: 404 len: 62 microversion: 2.1 time: 0.041058 Oct 19 03:26:54.598217 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1676/3416] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:54 2022] DELETE /compute/v2.1/images/bb3a25a0-f1e8-496e-9db8-05a27d2b182c => generated 62 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 03:26:54.610355 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-eb63b9c2-4772-435d-bce5-d902c9207dfc tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:54.610355 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-eb63b9c2-4772-435d-bce5-d902c9207dfc tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: 6fd536f4-6456-4291-8a11-2c48a453932a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:54.620993 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-eb63b9c2-4772-435d-bce5-d902c9207dfc tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:54.621754 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-eb63b9c2-4772-435d-bce5-d902c9207dfc tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:54.622399 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-eb63b9c2-4772-435d-bce5-d902c9207dfc tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:54.625857 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d6fa7895-af16-4144-b026-c0565b9a977f tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:54.626897 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-eb63b9c2-4772-435d-bce5-d902c9207dfc tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:54.627595 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-eb63b9c2-4772-435d-bce5-d902c9207dfc tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:54.628218 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-eb63b9c2-4772-435d-bce5-d902c9207dfc tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:54.629174 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d6fa7895-af16-4144-b026-c0565b9a977f tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: ae0179a6-3cf0-4943-81b5-c971e8d10000] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:54.642247 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d6fa7895-af16-4144-b026-c0565b9a977f tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:54.642917 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d6fa7895-af16-4144-b026-c0565b9a977f tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:54.644073 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d6fa7895-af16-4144-b026-c0565b9a977f tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:54.645070 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d6fa7895-af16-4144-b026-c0565b9a977f tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:54.646010 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d6fa7895-af16-4144-b026-c0565b9a977f tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:54.647086 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d6fa7895-af16-4144-b026-c0565b9a977f tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:54.680735 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-eb63b9c2-4772-435d-bce5-d902c9207dfc tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] HTTP exception thrown: Instance 6fd536f4-6456-4291-8a11-2c48a453932a could not be found. Oct 19 03:26:54.682363 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-eb63b9c2-4772-435d-bce5-d902c9207dfc tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Request method failure captured: Oct 19 03:26:54.682363 n-d-861333-8 devstack@n-api.service[121135]: request: DELETE /compute/v2.1/servers/6fd536f4-6456-4291-8a11-2c48a453932a HTTP/1.1 Oct 19 03:26:54.682363 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:26:54.682363 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:26:54.682363 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:26:54.682363 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:26:54.682363 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:26:54.682363 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:26:54.682363 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:26:54.682363 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:26:54.682363 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT20gKQCK3ZL5EjJtPpRF7E5hDOxix0C6fC1xUCWH8zbtFP3xUYoeIuXXDuos_Kcg-uER8mXZ0Dro2xiDEvGnr5RthhAxRX-UfAhulQWkJ7AvlI4OyC3dPVV75p4qDytKaHGa_jIWhID093t1C1fPqYSaGdAl1m0elNZW2yuRkiSpcQc Oct 19 03:26:54.682363 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:26:54.682363 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:26:54.682363 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:26:54.682363 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:26:54.682363 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:26:54.682363 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:26:54.682363 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 686dbeeaed0b44538a9bbc54d457a720 Oct 19 03:26:54.682363 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ImagesTestJSON-30140053 Oct 19 03:26:54.682363 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:26:54.682363 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:26:54.684128 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/686dbeeaed0b44538a9bbc54d457a720"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/686dbeeaed0b44538a9bbc54d457a720"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/686dbeeaed0b44538a9bbc54d457a720"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_686dbeeaed0b44538a9bbc54d457a720", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:26:54.684128 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ImagesTestJSON-30140053 Oct 19 03:26:54.684128 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 686dbeeaed0b44538a9bbc54d457a720 Oct 19 03:26:54.684128 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ImagesTestJSON-30140053 Oct 19 03:26:54.684128 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ImagesTestJSON-30140053-project Oct 19 03:26:54.684128 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:26:54.684128 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:26:54.684128 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 57008d884859417ebc1456b55ec3f6e0 Oct 19 03:26:54.684128 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ImagesTestJSON-30140053-project Oct 19 03:26:54.684128 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:26:54.684128 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance 6fd536f4-6456-4291-8a11-2c48a453932a could not be found. Oct 19 03:26:54.684128 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '6fd536f4-6456-4291-8a11-2c48a453932a'} Oct 19 03:26:54.685047 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:26:54.685047 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:26:54.685047 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:26:54.685047 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:26:54.685047 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:26:54.685047 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:26:54.685047 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:26:54.685047 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:26:54.685047 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:26:54.685047 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:26:54.685047 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6fd536f4-6456-4291-8a11-2c48a453932a could not be found. Oct 19 03:26:54.685047 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:26:54.685047 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:26:54.685047 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:26:54.685047 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:26:54.685047 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:26:54.685047 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:26:54.685047 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:26:54.685047 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:26:54.685047 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:26:54.686691 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:26:54.686691 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 03:26:54.686691 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 03:26:54.686691 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 03:26:54.686691 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 03:26:54.686691 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:26:54.686691 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:26:54.686691 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:26:54.686691 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:26:54.686691 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6fd536f4-6456-4291-8a11-2c48a453932a could not be found. Oct 19 03:26:54.686691 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:26:54.686691 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:26:54.686691 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:26:54.686691 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:26:54.686691 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:26:54.686691 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:26:54.686691 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:26:54.686691 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:26:54.686691 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6fd536f4-6456-4291-8a11-2c48a453932a could not be found. Oct 19 03:26:54.686691 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:26:54.688098 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-eb63b9c2-4772-435d-bce5-d902c9207dfc tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Returning 404 to user: Instance 6fd536f4-6456-4291-8a11-2c48a453932a could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:26:54.688098 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-eb63b9c2-4772-435d-bce5-d902c9207dfc tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "DELETE /compute/v2.1/servers/6fd536f4-6456-4291-8a11-2c48a453932a" status: 404 len: 111 microversion: 2.1 time: 0.079607 Oct 19 03:26:54.694002 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1741/3417] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:26:54 2022] DELETE /compute/v2.1/servers/6fd536f4-6456-4291-8a11-2c48a453932a => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:26:54.699085 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1e51f8c5-cdcb-4db7-9eaa-8d84fdba999c tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:54.701298 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1e51f8c5-cdcb-4db7-9eaa-8d84fdba999c tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] [instance: 6fd536f4-6456-4291-8a11-2c48a453932a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:54.715357 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1e51f8c5-cdcb-4db7-9eaa-8d84fdba999c tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:54.716479 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1e51f8c5-cdcb-4db7-9eaa-8d84fdba999c tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:54.717097 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1e51f8c5-cdcb-4db7-9eaa-8d84fdba999c tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:54.718031 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1e51f8c5-cdcb-4db7-9eaa-8d84fdba999c tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:54.718654 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1e51f8c5-cdcb-4db7-9eaa-8d84fdba999c tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:54.719252 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1e51f8c5-cdcb-4db7-9eaa-8d84fdba999c tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:54.736099 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-1e51f8c5-cdcb-4db7-9eaa-8d84fdba999c tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] HTTP exception thrown: Instance 6fd536f4-6456-4291-8a11-2c48a453932a could not be found. Oct 19 03:26:54.737810 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1e51f8c5-cdcb-4db7-9eaa-8d84fdba999c tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Request method failure captured: Oct 19 03:26:54.737810 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/6fd536f4-6456-4291-8a11-2c48a453932a HTTP/1.1 Oct 19 03:26:54.737810 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:26:54.737810 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:26:54.737810 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:26:54.737810 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:26:54.737810 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:26:54.737810 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:26:54.737810 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:26:54.737810 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:26:54.737810 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT20gKQCK3ZL5EjJtPpRF7E5hDOxix0C6fC1xUCWH8zbtFP3xUYoeIuXXDuos_Kcg-uER8mXZ0Dro2xiDEvGnr5RthhAxRX-UfAhulQWkJ7AvlI4OyC3dPVV75p4qDytKaHGa_jIWhID093t1C1fPqYSaGdAl1m0elNZW2yuRkiSpcQc Oct 19 03:26:54.737810 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:26:54.737810 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:26:54.737810 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:26:54.737810 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:26:54.737810 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:26:54.737810 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:26:54.737810 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 686dbeeaed0b44538a9bbc54d457a720 Oct 19 03:26:54.737810 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ImagesTestJSON-30140053 Oct 19 03:26:54.737810 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:26:54.737810 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:26:54.739389 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/686dbeeaed0b44538a9bbc54d457a720"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/686dbeeaed0b44538a9bbc54d457a720"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/686dbeeaed0b44538a9bbc54d457a720"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_686dbeeaed0b44538a9bbc54d457a720", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:26:54.739389 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ImagesTestJSON-30140053 Oct 19 03:26:54.739389 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 686dbeeaed0b44538a9bbc54d457a720 Oct 19 03:26:54.739389 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ImagesTestJSON-30140053 Oct 19 03:26:54.739389 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ImagesTestJSON-30140053-project Oct 19 03:26:54.739389 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:26:54.739389 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:26:54.739389 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 57008d884859417ebc1456b55ec3f6e0 Oct 19 03:26:54.739389 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ImagesTestJSON-30140053-project Oct 19 03:26:54.739389 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:26:54.739389 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance 6fd536f4-6456-4291-8a11-2c48a453932a could not be found. Oct 19 03:26:54.739389 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '6fd536f4-6456-4291-8a11-2c48a453932a'} Oct 19 03:26:54.740333 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:26:54.740333 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:26:54.740333 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:26:54.740333 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:26:54.740333 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:26:54.740333 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:26:54.740333 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:26:54.740333 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:26:54.740333 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:26:54.740333 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:26:54.740333 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6fd536f4-6456-4291-8a11-2c48a453932a could not be found. Oct 19 03:26:54.740333 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:26:54.740333 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:26:54.740333 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:26:54.740333 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:26:54.740333 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:26:54.740333 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:26:54.740333 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:26:54.740333 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:26:54.740333 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:26:54.741848 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:26:54.741848 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:26:54.741848 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:26:54.741848 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:26:54.741848 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:26:54.741848 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:26:54.741848 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:26:54.741848 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6fd536f4-6456-4291-8a11-2c48a453932a could not be found. Oct 19 03:26:54.741848 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:26:54.741848 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:26:54.741848 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:26:54.741848 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:26:54.741848 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:26:54.741848 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:26:54.741848 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:26:54.741848 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:26:54.741848 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6fd536f4-6456-4291-8a11-2c48a453932a could not be found. Oct 19 03:26:54.741848 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:26:54.743120 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1e51f8c5-cdcb-4db7-9eaa-8d84fdba999c tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] Returning 404 to user: Instance 6fd536f4-6456-4291-8a11-2c48a453932a could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:26:54.744550 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1e51f8c5-cdcb-4db7-9eaa-8d84fdba999c tempest-ImagesTestJSON-30140053 tempest-ImagesTestJSON-30140053-project] 10.222.0.52 "GET /compute/v2.1/servers/6fd536f4-6456-4291-8a11-2c48a453932a" status: 404 len: 111 microversion: 2.1 time: 0.049316 Oct 19 03:26:54.745688 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1742/3418] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:54 2022] GET /compute/v2.1/servers/6fd536f4-6456-4291-8a11-2c48a453932a => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:26:54.892287 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d6fa7895-af16-4144-b026-c0565b9a977f tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:54.903500 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d6fa7895-af16-4144-b026-c0565b9a977f tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/ae0179a6-3cf0-4943-81b5-c971e8d10000" status: 200 len: 1496 microversion: 2.1 time: 0.281463 Oct 19 03:26:54.904341 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1677/3419] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:54 2022] GET /compute/v2.1/servers/ae0179a6-3cf0-4943-81b5-c971e8d10000 => generated 1496 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:26:55.933342 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1b42e22c-d39a-44b2-973e-5a7e8ad2e574 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:55.938136 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1b42e22c-d39a-44b2-973e-5a7e8ad2e574 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: ae0179a6-3cf0-4943-81b5-c971e8d10000] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:55.954871 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1b42e22c-d39a-44b2-973e-5a7e8ad2e574 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:55.956658 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1b42e22c-d39a-44b2-973e-5a7e8ad2e574 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:55.957574 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1b42e22c-d39a-44b2-973e-5a7e8ad2e574 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:55.958770 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1b42e22c-d39a-44b2-973e-5a7e8ad2e574 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:55.959478 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1b42e22c-d39a-44b2-973e-5a7e8ad2e574 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:55.960995 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1b42e22c-d39a-44b2-973e-5a7e8ad2e574 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:56.153802 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-1b42e22c-d39a-44b2-973e-5a7e8ad2e574 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:56.169335 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1b42e22c-d39a-44b2-973e-5a7e8ad2e574 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/ae0179a6-3cf0-4943-81b5-c971e8d10000" status: 200 len: 1496 microversion: 2.1 time: 0.238672 Oct 19 03:26:56.174327 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1743/3420] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:55 2022] GET /compute/v2.1/servers/ae0179a6-3cf0-4943-81b5-c971e8d10000 => generated 1496 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:26:56.628569 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-bbfe3a25-ee37-4999-b82f-477942c5ce3a tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:56.629363 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-bbfe3a25-ee37-4999-b82f-477942c5ce3a tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] [instance: 5cc2003b-73ef-4a54-a22d-9cef47c6ed3f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:56.644833 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bbfe3a25-ee37-4999-b82f-477942c5ce3a tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:56.647310 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bbfe3a25-ee37-4999-b82f-477942c5ce3a tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:56.647866 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bbfe3a25-ee37-4999-b82f-477942c5ce3a tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:56.649403 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bbfe3a25-ee37-4999-b82f-477942c5ce3a tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:56.650388 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bbfe3a25-ee37-4999-b82f-477942c5ce3a tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:56.651056 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bbfe3a25-ee37-4999-b82f-477942c5ce3a tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:56.675449 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-450d084e-9e2c-4262-9469-1e1bc8e8d7be req-05fb0ea9-6666-46cf-bd09-144740fc48b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae0179a6-3cf0-4943-81b5-c971e8d10000", "name": "network-vif-deleted", "tag": "640d0b38-8205-42b6-803c-1c1cd6c518e8"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:26:56.692281 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-450d084e-9e2c-4262-9469-1e1bc8e8d7be req-05fb0ea9-6666-46cf-bd09-144740fc48b4 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:56.692994 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-450d084e-9e2c-4262-9469-1e1bc8e8d7be req-05fb0ea9-6666-46cf-bd09-144740fc48b4 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:56.693723 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-450d084e-9e2c-4262-9469-1e1bc8e8d7be req-05fb0ea9-6666-46cf-bd09-144740fc48b4 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:56.733831 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-450d084e-9e2c-4262-9469-1e1bc8e8d7be req-05fb0ea9-6666-46cf-bd09-144740fc48b4 service nova] Creating event network-vif-deleted:640d0b38-8205-42b6-803c-1c1cd6c518e8 for instance ae0179a6-3cf0-4943-81b5-c971e8d10000 on n-h1-861333-8 Oct 19 03:26:56.741147 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-450d084e-9e2c-4262-9469-1e1bc8e8d7be req-05fb0ea9-6666-46cf-bd09-144740fc48b4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069099 Oct 19 03:26:56.742861 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1744/3421] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:26:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:26:57.043352 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-bbfe3a25-ee37-4999-b82f-477942c5ce3a tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f" status: 200 len: 1812 microversion: 2.1 time: 0.418432 Oct 19 03:26:57.046244 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1678/3422] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:56 2022] GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f => generated 1812 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:26:57.069691 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0379bbfe-3e28-490f-9908-07b86eb43fa3 tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:57.074352 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0379bbfe-3e28-490f-9908-07b86eb43fa3 tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:57.075216 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0379bbfe-3e28-490f-9908-07b86eb43fa3 tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:57.076027 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0379bbfe-3e28-490f-9908-07b86eb43fa3 tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:57.078200 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0379bbfe-3e28-490f-9908-07b86eb43fa3 tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:57.078891 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0379bbfe-3e28-490f-9908-07b86eb43fa3 tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:57.079655 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0379bbfe-3e28-490f-9908-07b86eb43fa3 tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:57.111495 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0379bbfe-3e28-490f-9908-07b86eb43fa3 tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.047911 Oct 19 03:26:57.123545 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1745/3423] 10.222.0.52 () {58 vars in 1176 bytes} [Wed Oct 19 03:26:57 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:26:57.189488 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3cbfbcdd-a891-42d6-8c90-74037e145622 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:57.190268 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3cbfbcdd-a891-42d6-8c90-74037e145622 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: ae0179a6-3cf0-4943-81b5-c971e8d10000] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:57.202444 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3cbfbcdd-a891-42d6-8c90-74037e145622 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:57.205102 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3cbfbcdd-a891-42d6-8c90-74037e145622 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:57.205602 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3cbfbcdd-a891-42d6-8c90-74037e145622 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:57.208380 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3cbfbcdd-a891-42d6-8c90-74037e145622 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:57.208902 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3cbfbcdd-a891-42d6-8c90-74037e145622 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:57.212944 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3cbfbcdd-a891-42d6-8c90-74037e145622 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:57.310525 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3cbfbcdd-a891-42d6-8c90-74037e145622 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:57.312011 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3cbfbcdd-a891-42d6-8c90-74037e145622 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:57.314630 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3cbfbcdd-a891-42d6-8c90-74037e145622 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:57.315978 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-3cbfbcdd-a891-42d6-8c90-74037e145622 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lazy-loading 'fault' on Instance uuid ae0179a6-3cf0-4943-81b5-c971e8d10000 {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:26:57.500777 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-3cbfbcdd-a891-42d6-8c90-74037e145622 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:26:57.514402 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3cbfbcdd-a891-42d6-8c90-74037e145622 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/ae0179a6-3cf0-4943-81b5-c971e8d10000" status: 200 len: 1298 microversion: 2.1 time: 0.325529 Oct 19 03:26:57.525915 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1679/3424] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:57 2022] GET /compute/v2.1/servers/ae0179a6-3cf0-4943-81b5-c971e8d10000 => generated 1298 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:26:58.549772 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6a7ba957-1ed1-4571-ab2a-34117eca563f tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:58.551847 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6a7ba957-1ed1-4571-ab2a-34117eca563f tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: ae0179a6-3cf0-4943-81b5-c971e8d10000] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:58.562726 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6a7ba957-1ed1-4571-ab2a-34117eca563f tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:58.563701 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6a7ba957-1ed1-4571-ab2a-34117eca563f tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:58.566027 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6a7ba957-1ed1-4571-ab2a-34117eca563f tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:58.566027 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6a7ba957-1ed1-4571-ab2a-34117eca563f tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:58.567387 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6a7ba957-1ed1-4571-ab2a-34117eca563f tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:58.568009 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6a7ba957-1ed1-4571-ab2a-34117eca563f tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:58.624610 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-6a7ba957-1ed1-4571-ab2a-34117eca563f tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] HTTP exception thrown: Instance ae0179a6-3cf0-4943-81b5-c971e8d10000 could not be found. Oct 19 03:26:58.630815 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6a7ba957-1ed1-4571-ab2a-34117eca563f tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Request method failure captured: Oct 19 03:26:58.630815 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/ae0179a6-3cf0-4943-81b5-c971e8d10000 HTTP/1.1 Oct 19 03:26:58.630815 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:26:58.630815 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:26:58.630815 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:26:58.630815 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:26:58.630815 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:26:58.630815 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:26:58.630815 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:26:58.630815 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:26:58.630815 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT236feAW7aGPVoj9kEkUuQkRB8Nm9YBd70D85XbXnYqUAmlwAIPPx50C6dTRY9MbtBVt7IleIPYf6veKmIP1JclrFv3Px4uu5w7tRxEjRIxVTymsVviR-8HO1OxRuIfq2VSbST57MCBZOLAwnCIkIbO3ZT-DhhWvyFTRPdgvgRqqxa8 Oct 19 03:26:58.630815 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:26:58.630815 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:26:58.630815 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:26:58.630815 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:26:58.630815 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:26:58.630815 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:26:58.630815 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 7a836a10033546ed9a73a4f463587d72 Oct 19 03:26:58.630815 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ServersTestJSON-490256660 Oct 19 03:26:58.630815 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:26:58.630815 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:26:58.632201 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7a836a10033546ed9a73a4f463587d72"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7a836a10033546ed9a73a4f463587d72"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7a836a10033546ed9a73a4f463587d72"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7a836a10033546ed9a73a4f463587d72", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:26:58.632201 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ServersTestJSON-490256660 Oct 19 03:26:58.632201 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 7a836a10033546ed9a73a4f463587d72 Oct 19 03:26:58.632201 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ServersTestJSON-490256660 Oct 19 03:26:58.632201 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ServersTestJSON-490256660-project Oct 19 03:26:58.632201 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:26:58.632201 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:26:58.632201 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: b09d2eecd3d9419189e6308379fa8a09 Oct 19 03:26:58.632201 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ServersTestJSON-490256660-project Oct 19 03:26:58.632201 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:26:58.632201 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance ae0179a6-3cf0-4943-81b5-c971e8d10000 could not be found. Oct 19 03:26:58.632201 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': 'ae0179a6-3cf0-4943-81b5-c971e8d10000'} Oct 19 03:26:58.632988 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:26:58.632988 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:26:58.632988 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:26:58.632988 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:26:58.632988 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:26:58.632988 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:26:58.632988 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:26:58.632988 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:26:58.632988 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:26:58.632988 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:26:58.632988 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae0179a6-3cf0-4943-81b5-c971e8d10000 could not be found. Oct 19 03:26:58.632988 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:26:58.632988 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:26:58.632988 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:26:58.632988 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:26:58.632988 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:26:58.632988 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:26:58.632988 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:26:58.632988 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:26:58.632988 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:26:58.634293 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:26:58.634293 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:26:58.634293 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:26:58.634293 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:26:58.634293 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:26:58.634293 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:26:58.634293 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:26:58.634293 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae0179a6-3cf0-4943-81b5-c971e8d10000 could not be found. Oct 19 03:26:58.634293 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:26:58.634293 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:26:58.634293 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:26:58.634293 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:26:58.634293 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:26:58.634293 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:26:58.634293 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:26:58.634293 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:26:58.634293 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae0179a6-3cf0-4943-81b5-c971e8d10000 could not be found. Oct 19 03:26:58.634293 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:26:58.638226 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6a7ba957-1ed1-4571-ab2a-34117eca563f tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Returning 404 to user: Instance ae0179a6-3cf0-4943-81b5-c971e8d10000 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:26:58.639554 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6a7ba957-1ed1-4571-ab2a-34117eca563f tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/ae0179a6-3cf0-4943-81b5-c971e8d10000" status: 404 len: 111 microversion: 2.1 time: 0.097363 Oct 19 03:26:58.641495 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1746/3425] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:58 2022] GET /compute/v2.1/servers/ae0179a6-3cf0-4943-81b5-c971e8d10000 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:26:58.652186 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4d8a09ae-d1a1-4572-aecb-b8f09b94365d tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:58.652739 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4d8a09ae-d1a1-4572-aecb-b8f09b94365d tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 58aea4eb-a319-4bdc-99f2-eed095150ecb] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:58.659466 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:26:58.670468 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4d8a09ae-d1a1-4572-aecb-b8f09b94365d tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:58.674058 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4d8a09ae-d1a1-4572-aecb-b8f09b94365d tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:58.674674 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4d8a09ae-d1a1-4572-aecb-b8f09b94365d tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:58.675541 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4d8a09ae-d1a1-4572-aecb-b8f09b94365d tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:58.677542 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4d8a09ae-d1a1-4572-aecb-b8f09b94365d tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:58.678144 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4d8a09ae-d1a1-4572-aecb-b8f09b94365d tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:58.777657 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4d8a09ae-d1a1-4572-aecb-b8f09b94365d tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 58aea4eb-a319-4bdc-99f2-eed095150ecb] Going to try to terminate instance {{(pid=121134) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:26:59.230611 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4d8a09ae-d1a1-4572-aecb-b8f09b94365d tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "DELETE /compute/v2.1/servers/58aea4eb-a319-4bdc-99f2-eed095150ecb" status: 204 len: 0 microversion: 2.1 time: 0.584570 Oct 19 03:26:59.234660 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1680/3426] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:26:58 2022] DELETE /compute/v2.1/servers/58aea4eb-a319-4bdc-99f2-eed095150ecb => generated 0 bytes in 586 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:26:59.239925 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0a366e73-ab94-4b4d-b35d-9e5b259bcb0a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:26:59.251663 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0a366e73-ab94-4b4d-b35d-9e5b259bcb0a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 58aea4eb-a319-4bdc-99f2-eed095150ecb] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:26:59.256353 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0a366e73-ab94-4b4d-b35d-9e5b259bcb0a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:59.260180 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0a366e73-ab94-4b4d-b35d-9e5b259bcb0a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:59.262023 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0a366e73-ab94-4b4d-b35d-9e5b259bcb0a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:26:59.262808 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0a366e73-ab94-4b4d-b35d-9e5b259bcb0a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:26:59.269519 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0a366e73-ab94-4b4d-b35d-9e5b259bcb0a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:26:59.270440 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0a366e73-ab94-4b4d-b35d-9e5b259bcb0a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:00.820687 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-0a366e73-ab94-4b4d-b35d-9e5b259bcb0a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:27:00.837602 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0a366e73-ab94-4b4d-b35d-9e5b259bcb0a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/58aea4eb-a319-4bdc-99f2-eed095150ecb" status: 200 len: 1496 microversion: 2.1 time: 1.598751 Oct 19 03:27:00.838280 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1747/3427] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:26:59 2022] GET /compute/v2.1/servers/58aea4eb-a319-4bdc-99f2-eed095150ecb => generated 1496 bytes in 1603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:27:01.823595 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0158fc10-ecff-4862-a940-0e69462ccc1d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6e7015a0-8508-4edc-a024-86600bf259a0", "device": "/dev/xvdb"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:27:01.836020 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0158fc10-ecff-4862-a940-0e69462ccc1d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 5cc2003b-73ef-4a54-a22d-9cef47c6ed3f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:01.857500 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0158fc10-ecff-4862-a940-0e69462ccc1d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:01.857500 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0158fc10-ecff-4862-a940-0e69462ccc1d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:01.857500 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0158fc10-ecff-4862-a940-0e69462ccc1d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:01.857500 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0158fc10-ecff-4862-a940-0e69462ccc1d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:01.858282 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0158fc10-ecff-4862-a940-0e69462ccc1d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:01.858282 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0158fc10-ecff-4862-a940-0e69462ccc1d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:01.869096 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9cdcda79-d96b-403b-aa3d-7ac4ec48c2ee tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:01.869755 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9cdcda79-d96b-403b-aa3d-7ac4ec48c2ee tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 58aea4eb-a319-4bdc-99f2-eed095150ecb] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:01.894580 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9cdcda79-d96b-403b-aa3d-7ac4ec48c2ee tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:01.895570 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9cdcda79-d96b-403b-aa3d-7ac4ec48c2ee tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:01.898986 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9cdcda79-d96b-403b-aa3d-7ac4ec48c2ee tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:01.900240 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9cdcda79-d96b-403b-aa3d-7ac4ec48c2ee tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:01.900864 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9cdcda79-d96b-403b-aa3d-7ac4ec48c2ee tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:01.901678 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9cdcda79-d96b-403b-aa3d-7ac4ec48c2ee tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:02.262916 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-9cdcda79-d96b-403b-aa3d-7ac4ec48c2ee tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:27:02.272634 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9cdcda79-d96b-403b-aa3d-7ac4ec48c2ee tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/58aea4eb-a319-4bdc-99f2-eed095150ecb" status: 200 len: 1496 microversion: 2.1 time: 0.411988 Oct 19 03:27:02.277025 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1748/3428] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:01 2022] GET /compute/v2.1/servers/58aea4eb-a319-4bdc-99f2-eed095150ecb => generated 1496 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:27:02.717292 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e2d5a30c-85dc-4584-a1df-82a7e766af05 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-2088732956", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "networks": [{"uuid": "d48dbbb9-aa19-4da0-b7b1-7cd83435074a"}]}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:27:02.717292 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.network.neutron [None req-e2d5a30c-85dc-4584-a1df-82a7e766af05 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] validate_networks() for [('d48dbbb9-aa19-4da0-b7b1-7cd83435074a', None, None, None, None, None)] {{(pid=121135) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:27:03.091026 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-e2d5a30c-85dc-4584-a1df-82a7e766af05 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Flavor limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:27:03.097777 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-e2d5a30c-85dc-4584-a1df-82a7e766af05 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Image limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:27:03.097777 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-e2d5a30c-85dc-4584-a1df-82a7e766af05 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Flavor pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:27:03.097777 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-e2d5a30c-85dc-4584-a1df-82a7e766af05 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Image pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:27:03.097777 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-e2d5a30c-85dc-4584-a1df-82a7e766af05 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:27:03.101922 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e2d5a30c-85dc-4584-a1df-82a7e766af05 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:03.102408 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e2d5a30c-85dc-4584-a1df-82a7e766af05 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:03.102843 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e2d5a30c-85dc-4584-a1df-82a7e766af05 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:03.103618 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e2d5a30c-85dc-4584-a1df-82a7e766af05 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:03.104072 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e2d5a30c-85dc-4584-a1df-82a7e766af05 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:03.104581 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e2d5a30c-85dc-4584-a1df-82a7e766af05 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:03.122957 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-e2d5a30c-85dc-4584-a1df-82a7e766af05 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Getting quotas for project ba704466a29f4b35b97dbbb8c69ee19c. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:27:03.128821 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-e2d5a30c-85dc-4584-a1df-82a7e766af05 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Getting quotas for user c5eb004df19246c7ac6f0937dfc504d4 and project ba704466a29f4b35b97dbbb8c69ee19c. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:27:03.142592 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e2d5a30c-85dc-4584-a1df-82a7e766af05 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Going to run 1 instances... {{(pid=121135) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:27:03.144910 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e2d5a30c-85dc-4584-a1df-82a7e766af05 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] [instance: ff9df81f-bb98-4ed6-ba31-f44a7aa57258] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121135) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:27:03.351176 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e2d5a30c-85dc-4584-a1df-82a7e766af05 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.071922 Oct 19 03:27:03.358476 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1749/3429] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:27:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1080 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 03:27:03.372369 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-bb1c147b-e43f-4f32-9281-bb063e293241 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:03.375463 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-bb1c147b-e43f-4f32-9281-bb063e293241 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] [instance: 2870c53d-df7c-45d3-b8bd-c88966ad6315] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:03.432006 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bb1c147b-e43f-4f32-9281-bb063e293241 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:03.432762 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bb1c147b-e43f-4f32-9281-bb063e293241 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:03.433417 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bb1c147b-e43f-4f32-9281-bb063e293241 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:03.435081 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bb1c147b-e43f-4f32-9281-bb063e293241 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:03.435714 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bb1c147b-e43f-4f32-9281-bb063e293241 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:03.436305 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bb1c147b-e43f-4f32-9281-bb063e293241 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:03.500259 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-bb1c147b-e43f-4f32-9281-bb063e293241 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] 10.222.0.52 "GET /compute/v2.1/servers/2870c53d-df7c-45d3-b8bd-c88966ad6315/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.132138 Oct 19 03:27:03.500259 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1750/3430] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Oct 19 03:27:03 2022] GET /compute/v2.1/servers/2870c53d-df7c-45d3-b8bd-c88966ad6315/os-volume_attachments => generated 197 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:27:03.515387 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-5acd53e7-7d7b-422c-a6d1-ee4b047ee55d req-0ad5216f-5afd-4102-a786-b7d1fd87d3eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58aea4eb-a319-4bdc-99f2-eed095150ecb", "name": "network-vif-deleted", "tag": "32a70dcd-3c99-42b7-b060-729134b5f912"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:27:03.531487 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-5acd53e7-7d7b-422c-a6d1-ee4b047ee55d req-0ad5216f-5afd-4102-a786-b7d1fd87d3eb service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:03.532246 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-5acd53e7-7d7b-422c-a6d1-ee4b047ee55d req-0ad5216f-5afd-4102-a786-b7d1fd87d3eb service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:03.534964 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-5acd53e7-7d7b-422c-a6d1-ee4b047ee55d req-0ad5216f-5afd-4102-a786-b7d1fd87d3eb service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:03.574831 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-5acd53e7-7d7b-422c-a6d1-ee4b047ee55d req-0ad5216f-5afd-4102-a786-b7d1fd87d3eb service nova] Creating event network-vif-deleted:32a70dcd-3c99-42b7-b060-729134b5f912 for instance 58aea4eb-a319-4bdc-99f2-eed095150ecb on n-h1-861333-8 Oct 19 03:27:03.592015 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-5acd53e7-7d7b-422c-a6d1-ee4b047ee55d req-0ad5216f-5afd-4102-a786-b7d1fd87d3eb service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087779 Oct 19 03:27:03.593927 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1751/3431] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:27:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:27:03.605839 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e327f577-fc69-4a44-88ef-7d704376e87f tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:03.608715 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e327f577-fc69-4a44-88ef-7d704376e87f tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 58aea4eb-a319-4bdc-99f2-eed095150ecb] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:03.613361 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:27:03.619212 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e327f577-fc69-4a44-88ef-7d704376e87f tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:03.626676 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e327f577-fc69-4a44-88ef-7d704376e87f tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:03.626676 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e327f577-fc69-4a44-88ef-7d704376e87f tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:03.626676 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e327f577-fc69-4a44-88ef-7d704376e87f tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:03.626676 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e327f577-fc69-4a44-88ef-7d704376e87f tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:03.627406 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e327f577-fc69-4a44-88ef-7d704376e87f tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:03.758037 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-e327f577-fc69-4a44-88ef-7d704376e87f tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:27:03.773453 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e327f577-fc69-4a44-88ef-7d704376e87f tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/58aea4eb-a319-4bdc-99f2-eed095150ecb" status: 200 len: 1293 microversion: 2.1 time: 0.175772 Oct 19 03:27:03.775816 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1752/3432] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:03 2022] GET /compute/v2.1/servers/58aea4eb-a319-4bdc-99f2-eed095150ecb => generated 1293 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:27:03.785636 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-45bec096-782c-454c-b578-9be3ac186729 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:03.788648 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-45bec096-782c-454c-b578-9be3ac186729 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] [instance: ff9df81f-bb98-4ed6-ba31-f44a7aa57258] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:03.819884 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0158fc10-ecff-4862-a940-0e69462ccc1d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "POST /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.003823 Oct 19 03:27:03.821665 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1681/3433] 10.222.0.52 () {60 vars in 1323 bytes} [Wed Oct 19 03:27:01 2022] POST /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f/os-volume_attachments => generated 194 bytes in 2006 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:27:03.836957 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-595cf3f0-e537-48bc-836d-43cb1e9106ef tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:03.837633 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-595cf3f0-e537-48bc-836d-43cb1e9106ef tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] [instance: 2870c53d-df7c-45d3-b8bd-c88966ad6315] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:03.853509 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-595cf3f0-e537-48bc-836d-43cb1e9106ef tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:03.854086 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-595cf3f0-e537-48bc-836d-43cb1e9106ef tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:03.854426 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-595cf3f0-e537-48bc-836d-43cb1e9106ef tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:03.855135 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-595cf3f0-e537-48bc-836d-43cb1e9106ef tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:03.855584 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-595cf3f0-e537-48bc-836d-43cb1e9106ef tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:03.856018 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-595cf3f0-e537-48bc-836d-43cb1e9106ef tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:03.904149 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-45bec096-782c-454c-b578-9be3ac186729 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5eb004df19246c7ac6f0937dfc504d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba704466a29f4b35b97dbbb8c69ee19c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:27:03.913059 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-45bec096-782c-454c-b578-9be3ac186729 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] 10.222.0.52 "GET /compute/v2.1/servers/ff9df81f-bb98-4ed6-ba31-f44a7aa57258" status: 200 len: 1225 microversion: 2.1 time: 0.135209 Oct 19 03:27:03.924710 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1753/3434] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:03 2022] GET /compute/v2.1/servers/ff9df81f-bb98-4ed6-ba31-f44a7aa57258 => generated 1225 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:27:04.022014 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-595cf3f0-e537-48bc-836d-43cb1e9106ef tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lazy-loading 'services' on Instance uuid 2870c53d-df7c-45d3-b8bd-c88966ad6315 {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:27:04.400147 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-595cf3f0-e537-48bc-836d-43cb1e9106ef tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] 10.222.0.52 "DELETE /compute/v2.1/servers/2870c53d-df7c-45d3-b8bd-c88966ad6315/os-volume_attachments/fbe9bac4-90da-472e-9686-713706d14d10" status: 202 len: 0 microversion: 2.1 time: 0.578050 Oct 19 03:27:04.403889 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1682/3435] 10.222.0.52 () {58 vars in 1416 bytes} [Wed Oct 19 03:27:03 2022] DELETE /compute/v2.1/servers/2870c53d-df7c-45d3-b8bd-c88966ad6315/os-volume_attachments/fbe9bac4-90da-472e-9686-713706d14d10 => generated 0 bytes in 580 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:27:04.807434 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-873c3ba6-0a40-4a3f-8bdf-0ca8ce1a80fa tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:04.808055 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-873c3ba6-0a40-4a3f-8bdf-0ca8ce1a80fa tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 58aea4eb-a319-4bdc-99f2-eed095150ecb] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:04.821745 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-48e6e198-7a23-44a7-8cc2-3326fc3fa35e tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:04.822463 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-48e6e198-7a23-44a7-8cc2-3326fc3fa35e tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] [instance: cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:04.828888 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-873c3ba6-0a40-4a3f-8bdf-0ca8ce1a80fa tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:04.829417 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-873c3ba6-0a40-4a3f-8bdf-0ca8ce1a80fa tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:04.829859 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-873c3ba6-0a40-4a3f-8bdf-0ca8ce1a80fa tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:04.830569 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-873c3ba6-0a40-4a3f-8bdf-0ca8ce1a80fa tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:04.831026 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-873c3ba6-0a40-4a3f-8bdf-0ca8ce1a80fa tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:04.831456 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-873c3ba6-0a40-4a3f-8bdf-0ca8ce1a80fa tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:04.845868 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-48e6e198-7a23-44a7-8cc2-3326fc3fa35e tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:04.848732 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-48e6e198-7a23-44a7-8cc2-3326fc3fa35e tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:04.848732 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-48e6e198-7a23-44a7-8cc2-3326fc3fa35e tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:04.848732 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-48e6e198-7a23-44a7-8cc2-3326fc3fa35e tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:04.848732 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-48e6e198-7a23-44a7-8cc2-3326fc3fa35e tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:04.849101 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-48e6e198-7a23-44a7-8cc2-3326fc3fa35e tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:05.005966 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-873c3ba6-0a40-4a3f-8bdf-0ca8ce1a80fa tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:05.018767 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-873c3ba6-0a40-4a3f-8bdf-0ca8ce1a80fa tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:05.020681 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-873c3ba6-0a40-4a3f-8bdf-0ca8ce1a80fa tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:05.021458 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-873c3ba6-0a40-4a3f-8bdf-0ca8ce1a80fa tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lazy-loading 'fault' on Instance uuid 58aea4eb-a319-4bdc-99f2-eed095150ecb {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:27:05.219295 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-873c3ba6-0a40-4a3f-8bdf-0ca8ce1a80fa tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:27:05.243260 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-873c3ba6-0a40-4a3f-8bdf-0ca8ce1a80fa tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/58aea4eb-a319-4bdc-99f2-eed095150ecb" status: 200 len: 1298 microversion: 2.1 time: 0.437469 Oct 19 03:27:05.258912 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1754/3436] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:04 2022] GET /compute/v2.1/servers/58aea4eb-a319-4bdc-99f2-eed095150ecb => generated 1298 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:27:05.280317 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-97367d89-6676-473f-82dc-3bbe1740be4c tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:05.281492 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-97367d89-6676-473f-82dc-3bbe1740be4c tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] [instance: ff9df81f-bb98-4ed6-ba31-f44a7aa57258] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:05.781735 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-97367d89-6676-473f-82dc-3bbe1740be4c tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5eb004df19246c7ac6f0937dfc504d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba704466a29f4b35b97dbbb8c69ee19c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:27:05.791597 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-97367d89-6676-473f-82dc-3bbe1740be4c tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] 10.222.0.52 "GET /compute/v2.1/servers/ff9df81f-bb98-4ed6-ba31-f44a7aa57258" status: 200 len: 1225 microversion: 2.1 time: 0.526781 Oct 19 03:27:05.794201 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1755/3437] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:05 2022] GET /compute/v2.1/servers/ff9df81f-bb98-4ed6-ba31-f44a7aa57258 => generated 1225 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:27:05.839363 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-48e6e198-7a23-44a7-8cc2-3326fc3fa35e tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:27:05.851256 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-48e6e198-7a23-44a7-8cc2-3326fc3fa35e tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:27:05.853511 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-48e6e198-7a23-44a7-8cc2-3326fc3fa35e tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:27:05.855068 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-48e6e198-7a23-44a7-8cc2-3326fc3fa35e tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] 10.222.0.52 "GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95" status: 200 len: 2954 microversion: 2.42 time: 1.038673 Oct 19 03:27:05.871411 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1683/3438] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:27:04 2022] GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 => generated 2954 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:27:05.887942 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-db4b2a7d-24c7-46dd-b57f-605df80daa8d tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:05.888544 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-db4b2a7d-24c7-46dd-b57f-605df80daa8d tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] [instance: cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:05.895636 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-db4b2a7d-24c7-46dd-b57f-605df80daa8d tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:05.896198 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-db4b2a7d-24c7-46dd-b57f-605df80daa8d tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:05.896895 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-db4b2a7d-24c7-46dd-b57f-605df80daa8d tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:05.899518 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-db4b2a7d-24c7-46dd-b57f-605df80daa8d tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:05.902058 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-db4b2a7d-24c7-46dd-b57f-605df80daa8d tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:05.902058 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-db4b2a7d-24c7-46dd-b57f-605df80daa8d tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:06.134625 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-db4b2a7d-24c7-46dd-b57f-605df80daa8d tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] 10.222.0.52 "GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95/os-interface" status: 200 len: 1830 microversion: 2.42 time: 0.250717 Oct 19 03:27:06.135491 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1756/3439] 10.222.0.52 () {60 vars in 1316 bytes} [Wed Oct 19 03:27:05 2022] GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95/os-interface => generated 1830 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:27:06.272481 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5b14d6ba-05e7-4682-9a52-a3131032ef6f tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:06.273194 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5b14d6ba-05e7-4682-9a52-a3131032ef6f tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 58aea4eb-a319-4bdc-99f2-eed095150ecb] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:06.285252 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5b14d6ba-05e7-4682-9a52-a3131032ef6f tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:06.285690 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5b14d6ba-05e7-4682-9a52-a3131032ef6f tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:06.286143 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5b14d6ba-05e7-4682-9a52-a3131032ef6f tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:06.286855 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5b14d6ba-05e7-4682-9a52-a3131032ef6f tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:06.287308 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5b14d6ba-05e7-4682-9a52-a3131032ef6f tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:06.288339 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5b14d6ba-05e7-4682-9a52-a3131032ef6f tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:06.311124 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-5b14d6ba-05e7-4682-9a52-a3131032ef6f tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] HTTP exception thrown: Instance 58aea4eb-a319-4bdc-99f2-eed095150ecb could not be found. Oct 19 03:27:06.313891 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5b14d6ba-05e7-4682-9a52-a3131032ef6f tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Request method failure captured: Oct 19 03:27:06.313891 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/58aea4eb-a319-4bdc-99f2-eed095150ecb HTTP/1.1 Oct 19 03:27:06.313891 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:27:06.313891 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:27:06.313891 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:27:06.313891 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:27:06.313891 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:27:06.313891 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:27:06.313891 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:27:06.313891 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:27:06.313891 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT236feAW7aGPVoj9kEkUuQkRB8Nm9YBd70D85XbXnYqUAmlwAIPPx50C6dTRY9MbtBVt7IleIPYf6veKmIP1JclrFv3Px4uu5w7tRxEjRIxVTymsVviR-8HO1OxRuIfq2VSbST57MCBZOLAwnCIkIbO3ZT-DhhWvyFTRPdgvgRqqxa8 Oct 19 03:27:06.313891 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:27:06.313891 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:27:06.313891 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:27:06.313891 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:27:06.313891 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:27:06.313891 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:27:06.313891 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 7a836a10033546ed9a73a4f463587d72 Oct 19 03:27:06.313891 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ServersTestJSON-490256660 Oct 19 03:27:06.313891 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:27:06.313891 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:27:06.315324 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7a836a10033546ed9a73a4f463587d72"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7a836a10033546ed9a73a4f463587d72"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7a836a10033546ed9a73a4f463587d72"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7a836a10033546ed9a73a4f463587d72", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:27:06.315324 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ServersTestJSON-490256660 Oct 19 03:27:06.315324 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 7a836a10033546ed9a73a4f463587d72 Oct 19 03:27:06.315324 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ServersTestJSON-490256660 Oct 19 03:27:06.315324 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ServersTestJSON-490256660-project Oct 19 03:27:06.315324 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:27:06.315324 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:27:06.315324 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: b09d2eecd3d9419189e6308379fa8a09 Oct 19 03:27:06.315324 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ServersTestJSON-490256660-project Oct 19 03:27:06.315324 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:27:06.315324 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance 58aea4eb-a319-4bdc-99f2-eed095150ecb could not be found. Oct 19 03:27:06.315324 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '58aea4eb-a319-4bdc-99f2-eed095150ecb'} Oct 19 03:27:06.316307 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:27:06.316307 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:27:06.316307 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:27:06.316307 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:27:06.316307 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:27:06.316307 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:27:06.316307 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:27:06.316307 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:27:06.316307 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:27:06.316307 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:27:06.316307 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58aea4eb-a319-4bdc-99f2-eed095150ecb could not be found. Oct 19 03:27:06.316307 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:27:06.316307 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:27:06.316307 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:27:06.316307 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:27:06.316307 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:27:06.316307 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:27:06.316307 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:27:06.316307 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:27:06.316307 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:27:06.317713 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:27:06.317713 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:27:06.317713 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:27:06.317713 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:27:06.317713 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:27:06.317713 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:27:06.317713 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:27:06.317713 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58aea4eb-a319-4bdc-99f2-eed095150ecb could not be found. Oct 19 03:27:06.317713 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:27:06.317713 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:27:06.317713 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:27:06.317713 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:27:06.317713 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:27:06.317713 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:27:06.317713 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:27:06.317713 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:27:06.317713 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58aea4eb-a319-4bdc-99f2-eed095150ecb could not be found. Oct 19 03:27:06.317713 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:27:06.321498 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5b14d6ba-05e7-4682-9a52-a3131032ef6f tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Returning 404 to user: Instance 58aea4eb-a319-4bdc-99f2-eed095150ecb could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:27:06.329650 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5b14d6ba-05e7-4682-9a52-a3131032ef6f tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/58aea4eb-a319-4bdc-99f2-eed095150ecb" status: 404 len: 111 microversion: 2.1 time: 0.055197 Oct 19 03:27:06.336240 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1684/3440] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:06 2022] GET /compute/v2.1/servers/58aea4eb-a319-4bdc-99f2-eed095150ecb => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:27:06.534829 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ca0d4f07-86cb-4d56-a87e-84b8af39983e tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1141323083", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "networks": [{"uuid": "05216dbc-056d-4707-86fe-afea9c8b3e8d"}]}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:27:06.657534 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-ca0d4f07-86cb-4d56-a87e-84b8af39983e tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] validate_networks() for [('05216dbc-056d-4707-86fe-afea9c8b3e8d', None, None, None, None, None)] {{(pid=121134) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:27:06.754345 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-662dd657-068b-4ff5-aee3-48cc09da327a tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-189833074", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:27:06.869870 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.network.neutron [None req-662dd657-068b-4ff5-aee3-48cc09da327a tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] validate_networks() for None {{(pid=121135) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:27:07.737911 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-662dd657-068b-4ff5-aee3-48cc09da327a tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Flavor limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:27:07.743542 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-662dd657-068b-4ff5-aee3-48cc09da327a tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Image limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:27:07.743542 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-662dd657-068b-4ff5-aee3-48cc09da327a tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Flavor pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:27:07.743542 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-662dd657-068b-4ff5-aee3-48cc09da327a tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Image pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:27:07.744592 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-662dd657-068b-4ff5-aee3-48cc09da327a tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:27:07.772859 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-662dd657-068b-4ff5-aee3-48cc09da327a tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:07.785033 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-662dd657-068b-4ff5-aee3-48cc09da327a tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:07.790620 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-662dd657-068b-4ff5-aee3-48cc09da327a tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:07.792377 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-662dd657-068b-4ff5-aee3-48cc09da327a tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:07.793066 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-662dd657-068b-4ff5-aee3-48cc09da327a tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:07.793730 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-662dd657-068b-4ff5-aee3-48cc09da327a tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:07.842668 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-662dd657-068b-4ff5-aee3-48cc09da327a tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Getting quotas for project b9fcb4d8381f474d8bbea44443f845f8. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:27:07.854254 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-662dd657-068b-4ff5-aee3-48cc09da327a tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Getting quotas for user 17362106426c46ca8c07ee8192fe2bac and project b9fcb4d8381f474d8bbea44443f845f8. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:27:07.875137 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-662dd657-068b-4ff5-aee3-48cc09da327a tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Going to run 1 instances... {{(pid=121135) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:27:07.888801 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-662dd657-068b-4ff5-aee3-48cc09da327a tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] [instance: 3bfbe3fa-5e16-4b72-8232-7cf260c78f0a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121135) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:27:07.969911 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-ca0d4f07-86cb-4d56-a87e-84b8af39983e tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Flavor limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:27:07.970396 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-ca0d4f07-86cb-4d56-a87e-84b8af39983e tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Image limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:27:07.970803 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-ca0d4f07-86cb-4d56-a87e-84b8af39983e tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Flavor pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:27:07.971233 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-ca0d4f07-86cb-4d56-a87e-84b8af39983e tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Image pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:27:07.975114 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-ca0d4f07-86cb-4d56-a87e-84b8af39983e tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:27:08.003310 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ca0d4f07-86cb-4d56-a87e-84b8af39983e tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:08.003828 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ca0d4f07-86cb-4d56-a87e-84b8af39983e tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:08.004281 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ca0d4f07-86cb-4d56-a87e-84b8af39983e tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:08.005026 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ca0d4f07-86cb-4d56-a87e-84b8af39983e tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:08.005681 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ca0d4f07-86cb-4d56-a87e-84b8af39983e tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:08.006116 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ca0d4f07-86cb-4d56-a87e-84b8af39983e tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:08.060200 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-ca0d4f07-86cb-4d56-a87e-84b8af39983e tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Getting quotas for project 7a836a10033546ed9a73a4f463587d72. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:27:08.074612 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-ca0d4f07-86cb-4d56-a87e-84b8af39983e tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Getting quotas for user b09d2eecd3d9419189e6308379fa8a09 and project 7a836a10033546ed9a73a4f463587d72. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:27:08.101706 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ca0d4f07-86cb-4d56-a87e-84b8af39983e tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Going to run 1 instances... {{(pid=121134) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:27:08.104096 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ca0d4f07-86cb-4d56-a87e-84b8af39983e tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 5c23235b-b905-463f-bb7b-fef2a0381ed8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:27:08.238472 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-662dd657-068b-4ff5-aee3-48cc09da327a tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.790306 Oct 19 03:27:08.245768 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1757/3441] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:27:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1794 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 03:27:08.251282 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3a95c48c-0ad4-4dbc-b4aa-98c4ee62c8ca tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:08.256265 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-3a95c48c-0ad4-4dbc-b4aa-98c4ee62c8ca tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] [instance: ff9df81f-bb98-4ed6-ba31-f44a7aa57258] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:08.262452 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3a95c48c-0ad4-4dbc-b4aa-98c4ee62c8ca tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:08.263123 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3a95c48c-0ad4-4dbc-b4aa-98c4ee62c8ca tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:08.263632 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3a95c48c-0ad4-4dbc-b4aa-98c4ee62c8ca tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:08.264375 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3a95c48c-0ad4-4dbc-b4aa-98c4ee62c8ca tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:08.264808 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3a95c48c-0ad4-4dbc-b4aa-98c4ee62c8ca tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:08.265517 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3a95c48c-0ad4-4dbc-b4aa-98c4ee62c8ca tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:08.304085 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ca0d4f07-86cb-4d56-a87e-84b8af39983e tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.782651 Oct 19 03:27:08.307049 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1685/3442] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:27:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1788 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 19 03:27:08.321859 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8301589e-61e3-45d6-8aba-6bd530e85911 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:08.326223 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8301589e-61e3-45d6-8aba-6bd530e85911 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] [instance: 3bfbe3fa-5e16-4b72-8232-7cf260c78f0a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:08.696180 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8301589e-61e3-45d6-8aba-6bd530e85911 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17362106426c46ca8c07ee8192fe2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcb4d8381f474d8bbea44443f845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:27:08.704511 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8301589e-61e3-45d6-8aba-6bd530e85911 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] 10.222.0.52 "GET /compute/v2.1/servers/3bfbe3fa-5e16-4b72-8232-7cf260c78f0a" status: 200 len: 1216 microversion: 2.1 time: 0.390638 Oct 19 03:27:08.705106 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1686/3443] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:08 2022] GET /compute/v2.1/servers/3bfbe3fa-5e16-4b72-8232-7cf260c78f0a => generated 1216 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:27:08.730629 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0c24828f-5d70-40aa-a396-863c6a621d42 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:08.731588 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0c24828f-5d70-40aa-a396-863c6a621d42 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 5c23235b-b905-463f-bb7b-fef2a0381ed8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:08.741380 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-3a95c48c-0ad4-4dbc-b4aa-98c4ee62c8ca tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5eb004df19246c7ac6f0937dfc504d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba704466a29f4b35b97dbbb8c69ee19c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:27:08.752309 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-3a95c48c-0ad4-4dbc-b4aa-98c4ee62c8ca tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] 10.222.0.52 "GET /compute/v2.1/servers/ff9df81f-bb98-4ed6-ba31-f44a7aa57258" status: 200 len: 1283 microversion: 2.1 time: 0.508387 Oct 19 03:27:08.752972 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1758/3444] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:08 2022] GET /compute/v2.1/servers/ff9df81f-bb98-4ed6-ba31-f44a7aa57258 => generated 1283 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:27:08.879955 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0c24828f-5d70-40aa-a396-863c6a621d42 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:27:08.898882 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0c24828f-5d70-40aa-a396-863c6a621d42 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/5c23235b-b905-463f-bb7b-fef2a0381ed8" status: 200 len: 1209 microversion: 2.1 time: 0.180597 Oct 19 03:27:08.899681 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1687/3445] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:08 2022] GET /compute/v2.1/servers/5c23235b-b905-463f-bb7b-fef2a0381ed8 => generated 1209 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:27:09.732844 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-329af2e4-eed3-4019-8d31-0e5c2d0cee29 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:09.733745 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-329af2e4-eed3-4019-8d31-0e5c2d0cee29 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] [instance: 3bfbe3fa-5e16-4b72-8232-7cf260c78f0a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:09.781585 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-42ff7558-6960-42a5-b38f-ddd28e46d4fe tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:09.782186 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-42ff7558-6960-42a5-b38f-ddd28e46d4fe tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] [instance: ff9df81f-bb98-4ed6-ba31-f44a7aa57258] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:09.807841 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-42ff7558-6960-42a5-b38f-ddd28e46d4fe tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:09.808711 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-42ff7558-6960-42a5-b38f-ddd28e46d4fe tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:09.809161 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-42ff7558-6960-42a5-b38f-ddd28e46d4fe tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:09.809977 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-42ff7558-6960-42a5-b38f-ddd28e46d4fe tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:09.810440 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-42ff7558-6960-42a5-b38f-ddd28e46d4fe tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:09.811211 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-42ff7558-6960-42a5-b38f-ddd28e46d4fe tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:09.872685 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-329af2e4-eed3-4019-8d31-0e5c2d0cee29 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17362106426c46ca8c07ee8192fe2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcb4d8381f474d8bbea44443f845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:27:09.879946 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-329af2e4-eed3-4019-8d31-0e5c2d0cee29 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] 10.222.0.52 "GET /compute/v2.1/servers/3bfbe3fa-5e16-4b72-8232-7cf260c78f0a" status: 200 len: 1216 microversion: 2.1 time: 0.151314 Oct 19 03:27:09.889286 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1759/3446] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:09 2022] GET /compute/v2.1/servers/3bfbe3fa-5e16-4b72-8232-7cf260c78f0a => generated 1216 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:27:09.931396 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7bf05cb7-1ff0-4fba-b0f1-2144fea0ca7e tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:09.932376 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7bf05cb7-1ff0-4fba-b0f1-2144fea0ca7e tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 5c23235b-b905-463f-bb7b-fef2a0381ed8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:09.942476 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7bf05cb7-1ff0-4fba-b0f1-2144fea0ca7e tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:09.943353 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7bf05cb7-1ff0-4fba-b0f1-2144fea0ca7e tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:09.945426 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7bf05cb7-1ff0-4fba-b0f1-2144fea0ca7e tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:09.946339 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7bf05cb7-1ff0-4fba-b0f1-2144fea0ca7e tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:09.947008 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7bf05cb7-1ff0-4fba-b0f1-2144fea0ca7e tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:09.947771 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7bf05cb7-1ff0-4fba-b0f1-2144fea0ca7e tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:09.956353 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=100 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:27:10.107032 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-42ff7558-6960-42a5-b38f-ddd28e46d4fe tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5eb004df19246c7ac6f0937dfc504d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba704466a29f4b35b97dbbb8c69ee19c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:27:10.111448 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7bf05cb7-1ff0-4fba-b0f1-2144fea0ca7e tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:27:10.119501 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-42ff7558-6960-42a5-b38f-ddd28e46d4fe tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] 10.222.0.52 "GET /compute/v2.1/servers/ff9df81f-bb98-4ed6-ba31-f44a7aa57258" status: 200 len: 1325 microversion: 2.1 time: 0.340316 Oct 19 03:27:10.120570 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1688/3447] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:09 2022] GET /compute/v2.1/servers/ff9df81f-bb98-4ed6-ba31-f44a7aa57258 => generated 1325 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:27:10.125454 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7bf05cb7-1ff0-4fba-b0f1-2144fea0ca7e tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/5c23235b-b905-463f-bb7b-fef2a0381ed8" status: 200 len: 1213 microversion: 2.1 time: 0.207047 Oct 19 03:27:10.126179 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1760/3448] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:09 2022] GET /compute/v2.1/servers/5c23235b-b905-463f-bb7b-fef2a0381ed8 => generated 1213 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:27:10.913817 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b61137a7-6fcc-4dd4-8cf0-a4a591c5a5dc tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:10.915891 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b61137a7-6fcc-4dd4-8cf0-a4a591c5a5dc tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] [instance: 3bfbe3fa-5e16-4b72-8232-7cf260c78f0a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:10.939014 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b61137a7-6fcc-4dd4-8cf0-a4a591c5a5dc tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:10.939014 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b61137a7-6fcc-4dd4-8cf0-a4a591c5a5dc tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:10.939014 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b61137a7-6fcc-4dd4-8cf0-a4a591c5a5dc tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:10.939014 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b61137a7-6fcc-4dd4-8cf0-a4a591c5a5dc tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:10.939881 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b61137a7-6fcc-4dd4-8cf0-a4a591c5a5dc tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:10.942723 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b61137a7-6fcc-4dd4-8cf0-a4a591c5a5dc tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:10.967733 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-4d92ed6c-3a75-496f-b50e-bd1bbe37439f req-358476d6-eec7-47bc-8f48-cfa41a6c8abb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff9df81f-bb98-4ed6-ba31-f44a7aa57258", "tag": "b78325b6-b590-44d8-87bf-63300f736f7a"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:27:11.003161 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-4d92ed6c-3a75-496f-b50e-bd1bbe37439f req-358476d6-eec7-47bc-8f48-cfa41a6c8abb service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:11.005896 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-4d92ed6c-3a75-496f-b50e-bd1bbe37439f req-358476d6-eec7-47bc-8f48-cfa41a6c8abb service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:11.007012 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-4d92ed6c-3a75-496f-b50e-bd1bbe37439f req-358476d6-eec7-47bc-8f48-cfa41a6c8abb service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:11.053944 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-4d92ed6c-3a75-496f-b50e-bd1bbe37439f req-358476d6-eec7-47bc-8f48-cfa41a6c8abb service nova] Creating event network-changed:b78325b6-b590-44d8-87bf-63300f736f7a for instance ff9df81f-bb98-4ed6-ba31-f44a7aa57258 on n-h2-861333-8 Oct 19 03:27:11.076983 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-4d92ed6c-3a75-496f-b50e-bd1bbe37439f req-358476d6-eec7-47bc-8f48-cfa41a6c8abb service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114143 Oct 19 03:27:11.080577 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1761/3449] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:27:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:27:11.147816 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6e6bb031-20bc-4ea3-baf7-7e180a339caf tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:11.148520 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6e6bb031-20bc-4ea3-baf7-7e180a339caf tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] [instance: ff9df81f-bb98-4ed6-ba31-f44a7aa57258] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:11.171441 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6e6bb031-20bc-4ea3-baf7-7e180a339caf tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:11.171955 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6e6bb031-20bc-4ea3-baf7-7e180a339caf tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:11.172401 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6e6bb031-20bc-4ea3-baf7-7e180a339caf tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:11.173130 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6e6bb031-20bc-4ea3-baf7-7e180a339caf tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:11.173623 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6e6bb031-20bc-4ea3-baf7-7e180a339caf tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:11.174062 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6e6bb031-20bc-4ea3-baf7-7e180a339caf tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:11.323631 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b61137a7-6fcc-4dd4-8cf0-a4a591c5a5dc tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17362106426c46ca8c07ee8192fe2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcb4d8381f474d8bbea44443f845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:27:11.334037 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b61137a7-6fcc-4dd4-8cf0-a4a591c5a5dc tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] 10.222.0.52 "GET /compute/v2.1/servers/3bfbe3fa-5e16-4b72-8232-7cf260c78f0a" status: 200 len: 1212 microversion: 2.1 time: 0.430262 Oct 19 03:27:11.349395 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1689/3450] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:10 2022] GET /compute/v2.1/servers/3bfbe3fa-5e16-4b72-8232-7cf260c78f0a => generated 1212 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:27:11.355077 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-87b916a9-1be4-41d3-8344-76a6eea1bc07 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:11.355986 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-87b916a9-1be4-41d3-8344-76a6eea1bc07 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 5c23235b-b905-463f-bb7b-fef2a0381ed8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:11.369881 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-87b916a9-1be4-41d3-8344-76a6eea1bc07 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:11.370387 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-87b916a9-1be4-41d3-8344-76a6eea1bc07 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:11.370829 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-87b916a9-1be4-41d3-8344-76a6eea1bc07 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:11.371537 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-87b916a9-1be4-41d3-8344-76a6eea1bc07 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:11.375057 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-87b916a9-1be4-41d3-8344-76a6eea1bc07 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:11.377437 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-87b916a9-1be4-41d3-8344-76a6eea1bc07 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:11.604104 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-87b916a9-1be4-41d3-8344-76a6eea1bc07 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:27:11.614431 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-87b916a9-1be4-41d3-8344-76a6eea1bc07 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/5c23235b-b905-463f-bb7b-fef2a0381ed8" status: 200 len: 1261 microversion: 2.1 time: 0.275147 Oct 19 03:27:11.632138 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1690/3451] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:11 2022] GET /compute/v2.1/servers/5c23235b-b905-463f-bb7b-fef2a0381ed8 => generated 1261 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:27:12.026912 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-6e6bb031-20bc-4ea3-baf7-7e180a339caf tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5eb004df19246c7ac6f0937dfc504d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba704466a29f4b35b97dbbb8c69ee19c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:27:12.043478 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6e6bb031-20bc-4ea3-baf7-7e180a339caf tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] 10.222.0.52 "GET /compute/v2.1/servers/ff9df81f-bb98-4ed6-ba31-f44a7aa57258" status: 200 len: 1325 microversion: 2.1 time: 0.902466 Oct 19 03:27:12.057395 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1762/3452] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:11 2022] GET /compute/v2.1/servers/ff9df81f-bb98-4ed6-ba31-f44a7aa57258 => generated 1325 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:27:12.370324 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-98600919-2386-4f36-8f8c-c08a979925d5 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:12.371713 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-98600919-2386-4f36-8f8c-c08a979925d5 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] [instance: 3bfbe3fa-5e16-4b72-8232-7cf260c78f0a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:12.387140 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-98600919-2386-4f36-8f8c-c08a979925d5 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:12.387934 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-98600919-2386-4f36-8f8c-c08a979925d5 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:12.388572 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-98600919-2386-4f36-8f8c-c08a979925d5 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:12.394910 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-98600919-2386-4f36-8f8c-c08a979925d5 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:12.395662 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-98600919-2386-4f36-8f8c-c08a979925d5 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:12.396308 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-98600919-2386-4f36-8f8c-c08a979925d5 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:12.409696 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:27:12.513854 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0c640b3c-437a-4940-bd7f-a4443ff5dc53 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:12.514463 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0c640b3c-437a-4940-bd7f-a4443ff5dc53 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] [instance: 4c823d1c-eebe-4aa6-972c-38209d6cc70e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:12.530982 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0c640b3c-437a-4940-bd7f-a4443ff5dc53 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:12.531363 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-98600919-2386-4f36-8f8c-c08a979925d5 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17362106426c46ca8c07ee8192fe2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcb4d8381f474d8bbea44443f845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:27:12.532457 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0c640b3c-437a-4940-bd7f-a4443ff5dc53 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:12.532982 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0c640b3c-437a-4940-bd7f-a4443ff5dc53 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:12.533980 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0c640b3c-437a-4940-bd7f-a4443ff5dc53 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:12.534656 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0c640b3c-437a-4940-bd7f-a4443ff5dc53 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:12.535285 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0c640b3c-437a-4940-bd7f-a4443ff5dc53 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:12.569861 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-98600919-2386-4f36-8f8c-c08a979925d5 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] 10.222.0.52 "GET /compute/v2.1/servers/3bfbe3fa-5e16-4b72-8232-7cf260c78f0a" status: 200 len: 1268 microversion: 2.1 time: 0.203383 Oct 19 03:27:12.570493 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1691/3453] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:12 2022] GET /compute/v2.1/servers/3bfbe3fa-5e16-4b72-8232-7cf260c78f0a => generated 1268 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:27:12.605036 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0c640b3c-437a-4940-bd7f-a4443ff5dc53 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] [instance: 4c823d1c-eebe-4aa6-972c-38209d6cc70e] Going to try to terminate instance {{(pid=121135) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:27:12.654164 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5a365564-6423-4775-a362-f0c77937b134 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:12.654820 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5a365564-6423-4775-a362-f0c77937b134 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 5c23235b-b905-463f-bb7b-fef2a0381ed8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:12.674098 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5a365564-6423-4775-a362-f0c77937b134 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:12.674861 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5a365564-6423-4775-a362-f0c77937b134 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:12.675473 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5a365564-6423-4775-a362-f0c77937b134 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:12.676388 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5a365564-6423-4775-a362-f0c77937b134 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:12.678079 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5a365564-6423-4775-a362-f0c77937b134 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:12.678685 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5a365564-6423-4775-a362-f0c77937b134 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:12.776159 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5a365564-6423-4775-a362-f0c77937b134 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:27:12.784957 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5a365564-6423-4775-a362-f0c77937b134 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/5c23235b-b905-463f-bb7b-fef2a0381ed8" status: 200 len: 1267 microversion: 2.1 time: 0.135416 Oct 19 03:27:12.786174 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1692/3454] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:12 2022] GET /compute/v2.1/servers/5c23235b-b905-463f-bb7b-fef2a0381ed8 => generated 1267 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:27:12.815285 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-890303a3-a04f-4049-9025-5583fe4ee311 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:12.829427 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-890303a3-a04f-4049-9025-5583fe4ee311 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] [instance: 2870c53d-df7c-45d3-b8bd-c88966ad6315] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:12.839594 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-890303a3-a04f-4049-9025-5583fe4ee311 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:12.840100 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-890303a3-a04f-4049-9025-5583fe4ee311 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:12.840556 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-890303a3-a04f-4049-9025-5583fe4ee311 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:12.846550 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-890303a3-a04f-4049-9025-5583fe4ee311 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:12.847046 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-890303a3-a04f-4049-9025-5583fe4ee311 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:12.847493 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-890303a3-a04f-4049-9025-5583fe4ee311 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:12.893614 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-890303a3-a04f-4049-9025-5583fe4ee311 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] 10.222.0.52 "GET /compute/v2.1/servers/2870c53d-df7c-45d3-b8bd-c88966ad6315/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.082152 Oct 19 03:27:12.901057 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1693/3455] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Oct 19 03:27:12 2022] GET /compute/v2.1/servers/2870c53d-df7c-45d3-b8bd-c88966ad6315/os-volume_attachments => generated 25 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 03:27:12.984101 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3c1f3d43-cc4f-4556-8501-04826f348ed3 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:12.986381 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3c1f3d43-cc4f-4556-8501-04826f348ed3 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] [instance: 2870c53d-df7c-45d3-b8bd-c88966ad6315] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:12.998719 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3c1f3d43-cc4f-4556-8501-04826f348ed3 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:12.999216 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3c1f3d43-cc4f-4556-8501-04826f348ed3 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:12.999663 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3c1f3d43-cc4f-4556-8501-04826f348ed3 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:13.000376 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3c1f3d43-cc4f-4556-8501-04826f348ed3 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:13.001072 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3c1f3d43-cc4f-4556-8501-04826f348ed3 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:13.001583 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3c1f3d43-cc4f-4556-8501-04826f348ed3 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:13.052773 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0c640b3c-437a-4940-bd7f-a4443ff5dc53 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] 10.222.0.52 "DELETE /compute/v2.1/servers/4c823d1c-eebe-4aa6-972c-38209d6cc70e" status: 204 len: 0 microversion: 2.1 time: 0.542699 Oct 19 03:27:13.054817 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1763/3456] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:27:12 2022] DELETE /compute/v2.1/servers/4c823d1c-eebe-4aa6-972c-38209d6cc70e => generated 0 bytes in 546 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:27:13.068061 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-98e3be71-c246-4909-b2b0-f0d3cfb247cf tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:13.071374 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-98e3be71-c246-4909-b2b0-f0d3cfb247cf tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] [instance: 4c823d1c-eebe-4aa6-972c-38209d6cc70e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:13.082472 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3c1f3d43-cc4f-4556-8501-04826f348ed3 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] 10.222.0.52 "GET /compute/v2.1/servers/2870c53d-df7c-45d3-b8bd-c88966ad6315/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.102654 Oct 19 03:27:13.088960 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-98e3be71-c246-4909-b2b0-f0d3cfb247cf tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:13.090060 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-98e3be71-c246-4909-b2b0-f0d3cfb247cf tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:13.091460 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-98e3be71-c246-4909-b2b0-f0d3cfb247cf tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:13.091878 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1694/3457] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Oct 19 03:27:12 2022] GET /compute/v2.1/servers/2870c53d-df7c-45d3-b8bd-c88966ad6315/os-volume_attachments => generated 25 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 19 03:27:13.092913 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-98e3be71-c246-4909-b2b0-f0d3cfb247cf tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:13.094045 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-98e3be71-c246-4909-b2b0-f0d3cfb247cf tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:13.096098 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-98e3be71-c246-4909-b2b0-f0d3cfb247cf tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:13.109500 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-40b6c231-1d3d-4860-b433-2006a3377eed tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:13.110286 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-40b6c231-1d3d-4860-b433-2006a3377eed tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] [instance: ff9df81f-bb98-4ed6-ba31-f44a7aa57258] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:13.116506 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-40b6c231-1d3d-4860-b433-2006a3377eed tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:13.117005 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-40b6c231-1d3d-4860-b433-2006a3377eed tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:13.117473 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-40b6c231-1d3d-4860-b433-2006a3377eed tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:13.118204 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-40b6c231-1d3d-4860-b433-2006a3377eed tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:13.118661 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-40b6c231-1d3d-4860-b433-2006a3377eed tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:13.119188 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-40b6c231-1d3d-4860-b433-2006a3377eed tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:13.368027 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-98e3be71-c246-4909-b2b0-f0d3cfb247cf tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5ed9dc7e0304f28afb381ef2ec3cefd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b2195b7d124b4eb2552f88dba26b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:27:13.391758 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-98e3be71-c246-4909-b2b0-f0d3cfb247cf tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] 10.222.0.52 "GET /compute/v2.1/servers/4c823d1c-eebe-4aa6-972c-38209d6cc70e" status: 200 len: 1665 microversion: 2.1 time: 0.329299 Oct 19 03:27:13.406373 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1764/3458] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:13 2022] GET /compute/v2.1/servers/4c823d1c-eebe-4aa6-972c-38209d6cc70e => generated 1665 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:27:13.413182 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a1c86f1c-79d6-404c-8162-4170f11f4b3f tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:13.414007 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a1c86f1c-79d6-404c-8162-4170f11f4b3f tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] [instance: 2870c53d-df7c-45d3-b8bd-c88966ad6315] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:13.420586 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a1c86f1c-79d6-404c-8162-4170f11f4b3f tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:13.422066 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a1c86f1c-79d6-404c-8162-4170f11f4b3f tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:13.425545 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a1c86f1c-79d6-404c-8162-4170f11f4b3f tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:13.425545 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a1c86f1c-79d6-404c-8162-4170f11f4b3f tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:13.425545 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a1c86f1c-79d6-404c-8162-4170f11f4b3f tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:13.425545 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a1c86f1c-79d6-404c-8162-4170f11f4b3f tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:13.482167 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a1c86f1c-79d6-404c-8162-4170f11f4b3f tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] [instance: 2870c53d-df7c-45d3-b8bd-c88966ad6315] Going to try to terminate instance {{(pid=121135) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:27:13.508896 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-40b6c231-1d3d-4860-b433-2006a3377eed tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5eb004df19246c7ac6f0937dfc504d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba704466a29f4b35b97dbbb8c69ee19c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:27:13.527158 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-40b6c231-1d3d-4860-b433-2006a3377eed tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] 10.222.0.52 "GET /compute/v2.1/servers/ff9df81f-bb98-4ed6-ba31-f44a7aa57258" status: 200 len: 1325 microversion: 2.1 time: 0.433990 Oct 19 03:27:13.527855 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1695/3459] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:13 2022] GET /compute/v2.1/servers/ff9df81f-bb98-4ed6-ba31-f44a7aa57258 => generated 1325 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:27:13.593301 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f407c219-77ef-4fbc-aaeb-9ff312a1c937 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:13.593957 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f407c219-77ef-4fbc-aaeb-9ff312a1c937 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] [instance: 3bfbe3fa-5e16-4b72-8232-7cf260c78f0a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:13.601224 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f407c219-77ef-4fbc-aaeb-9ff312a1c937 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:13.601779 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f407c219-77ef-4fbc-aaeb-9ff312a1c937 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:13.602202 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f407c219-77ef-4fbc-aaeb-9ff312a1c937 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:13.603085 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f407c219-77ef-4fbc-aaeb-9ff312a1c937 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:13.603739 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f407c219-77ef-4fbc-aaeb-9ff312a1c937 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:13.604378 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f407c219-77ef-4fbc-aaeb-9ff312a1c937 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:13.846663 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-f407c219-77ef-4fbc-aaeb-9ff312a1c937 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17362106426c46ca8c07ee8192fe2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcb4d8381f474d8bbea44443f845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:27:13.848094 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a1c86f1c-79d6-404c-8162-4170f11f4b3f tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] 10.222.0.52 "DELETE /compute/v2.1/servers/2870c53d-df7c-45d3-b8bd-c88966ad6315" status: 204 len: 0 microversion: 2.1 time: 0.446562 Oct 19 03:27:13.848884 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1765/3460] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:27:13 2022] DELETE /compute/v2.1/servers/2870c53d-df7c-45d3-b8bd-c88966ad6315 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:27:13.857161 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-53b8572a-c55a-4115-8943-73dce16a3304 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:13.857361 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f407c219-77ef-4fbc-aaeb-9ff312a1c937 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] 10.222.0.52 "GET /compute/v2.1/servers/3bfbe3fa-5e16-4b72-8232-7cf260c78f0a" status: 200 len: 1276 microversion: 2.1 time: 0.268504 Oct 19 03:27:13.860770 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-53b8572a-c55a-4115-8943-73dce16a3304 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 5c23235b-b905-463f-bb7b-fef2a0381ed8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:13.862415 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1696/3461] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:13 2022] GET /compute/v2.1/servers/3bfbe3fa-5e16-4b72-8232-7cf260c78f0a => generated 1276 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:27:13.876985 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-53b8572a-c55a-4115-8943-73dce16a3304 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:13.879281 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a901da29-54cd-49ef-8290-1526420bc9e2 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:13.879411 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-53b8572a-c55a-4115-8943-73dce16a3304 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:13.880140 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a901da29-54cd-49ef-8290-1526420bc9e2 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] [instance: 2870c53d-df7c-45d3-b8bd-c88966ad6315] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:13.880562 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-53b8572a-c55a-4115-8943-73dce16a3304 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:13.883747 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-53b8572a-c55a-4115-8943-73dce16a3304 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:13.883747 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-53b8572a-c55a-4115-8943-73dce16a3304 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:13.883747 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-53b8572a-c55a-4115-8943-73dce16a3304 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:13.895546 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a901da29-54cd-49ef-8290-1526420bc9e2 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:13.900484 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a901da29-54cd-49ef-8290-1526420bc9e2 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:13.900968 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a901da29-54cd-49ef-8290-1526420bc9e2 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:13.903292 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a901da29-54cd-49ef-8290-1526420bc9e2 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:13.903825 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a901da29-54cd-49ef-8290-1526420bc9e2 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:13.904267 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a901da29-54cd-49ef-8290-1526420bc9e2 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:14.298235 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-53b8572a-c55a-4115-8943-73dce16a3304 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:27:14.338464 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a901da29-54cd-49ef-8290-1526420bc9e2 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bf143866aa44afb11285d61ffd7ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bf79842c02480eb1e91d521226d317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:27:14.340272 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-53b8572a-c55a-4115-8943-73dce16a3304 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/5c23235b-b905-463f-bb7b-fef2a0381ed8" status: 200 len: 1309 microversion: 2.1 time: 0.487233 Oct 19 03:27:14.354590 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a901da29-54cd-49ef-8290-1526420bc9e2 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] 10.222.0.52 "GET /compute/v2.1/servers/2870c53d-df7c-45d3-b8bd-c88966ad6315" status: 200 len: 1681 microversion: 2.1 time: 0.488527 Oct 19 03:27:14.354590 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1697/3462] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:13 2022] GET /compute/v2.1/servers/2870c53d-df7c-45d3-b8bd-c88966ad6315 => generated 1681 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:27:14.359893 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1766/3463] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:13 2022] GET /compute/v2.1/servers/5c23235b-b905-463f-bb7b-fef2a0381ed8 => generated 1309 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:27:14.421655 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1b87ded9-3f4d-40d1-bc3b-f00fe5e12a83 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:14.422476 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1b87ded9-3f4d-40d1-bc3b-f00fe5e12a83 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] [instance: 4c823d1c-eebe-4aa6-972c-38209d6cc70e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:14.430106 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1b87ded9-3f4d-40d1-bc3b-f00fe5e12a83 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:14.430821 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1b87ded9-3f4d-40d1-bc3b-f00fe5e12a83 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:14.431439 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1b87ded9-3f4d-40d1-bc3b-f00fe5e12a83 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:14.432186 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1b87ded9-3f4d-40d1-bc3b-f00fe5e12a83 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:14.432679 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1b87ded9-3f4d-40d1-bc3b-f00fe5e12a83 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:14.433118 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1b87ded9-3f4d-40d1-bc3b-f00fe5e12a83 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:14.551794 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1aede428-5925-4b10-8f5c-65bdd9839397 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:14.553938 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1aede428-5925-4b10-8f5c-65bdd9839397 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] [instance: ff9df81f-bb98-4ed6-ba31-f44a7aa57258] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:14.572082 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1aede428-5925-4b10-8f5c-65bdd9839397 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:14.572924 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1aede428-5925-4b10-8f5c-65bdd9839397 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:14.573782 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1aede428-5925-4b10-8f5c-65bdd9839397 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:14.574723 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1aede428-5925-4b10-8f5c-65bdd9839397 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:14.575366 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1aede428-5925-4b10-8f5c-65bdd9839397 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:14.575979 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1aede428-5925-4b10-8f5c-65bdd9839397 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:14.765628 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-1b87ded9-3f4d-40d1-bc3b-f00fe5e12a83 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5ed9dc7e0304f28afb381ef2ec3cefd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b2195b7d124b4eb2552f88dba26b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:27:14.776264 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1b87ded9-3f4d-40d1-bc3b-f00fe5e12a83 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] 10.222.0.52 "GET /compute/v2.1/servers/4c823d1c-eebe-4aa6-972c-38209d6cc70e" status: 200 len: 1665 microversion: 2.1 time: 0.358610 Oct 19 03:27:14.793564 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1698/3464] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:14 2022] GET /compute/v2.1/servers/4c823d1c-eebe-4aa6-972c-38209d6cc70e => generated 1665 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:27:14.852970 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-1aede428-5925-4b10-8f5c-65bdd9839397 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5eb004df19246c7ac6f0937dfc504d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba704466a29f4b35b97dbbb8c69ee19c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:27:14.865132 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1aede428-5925-4b10-8f5c-65bdd9839397 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] 10.222.0.52 "GET /compute/v2.1/servers/ff9df81f-bb98-4ed6-ba31-f44a7aa57258" status: 200 len: 1325 microversion: 2.1 time: 0.317438 Oct 19 03:27:14.866830 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1767/3465] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:14 2022] GET /compute/v2.1/servers/ff9df81f-bb98-4ed6-ba31-f44a7aa57258 => generated 1325 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:27:14.887683 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6fd6d89c-24c9-4399-a8e7-d9e75bcede97 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:14.888319 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6fd6d89c-24c9-4399-a8e7-d9e75bcede97 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] [instance: 3bfbe3fa-5e16-4b72-8232-7cf260c78f0a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:14.895490 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6fd6d89c-24c9-4399-a8e7-d9e75bcede97 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:14.895988 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6fd6d89c-24c9-4399-a8e7-d9e75bcede97 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:14.897215 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6fd6d89c-24c9-4399-a8e7-d9e75bcede97 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:14.898247 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6fd6d89c-24c9-4399-a8e7-d9e75bcede97 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:14.898917 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6fd6d89c-24c9-4399-a8e7-d9e75bcede97 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:14.899554 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6fd6d89c-24c9-4399-a8e7-d9e75bcede97 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:14.972467 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-6fd6d89c-24c9-4399-a8e7-d9e75bcede97 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17362106426c46ca8c07ee8192fe2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcb4d8381f474d8bbea44443f845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:27:14.984044 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6fd6d89c-24c9-4399-a8e7-d9e75bcede97 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] 10.222.0.52 "GET /compute/v2.1/servers/3bfbe3fa-5e16-4b72-8232-7cf260c78f0a" status: 200 len: 1286 microversion: 2.1 time: 0.100598 Oct 19 03:27:14.987786 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1699/3466] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:14 2022] GET /compute/v2.1/servers/3bfbe3fa-5e16-4b72-8232-7cf260c78f0a => generated 1286 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:27:15.364493 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b0d58960-677d-4a01-bcd9-ac3ba5f41970 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:15.365024 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b0d58960-677d-4a01-bcd9-ac3ba5f41970 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 5c23235b-b905-463f-bb7b-fef2a0381ed8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:15.376231 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-167a8740-c564-40f0-94f3-e80a8ff621c1 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:15.377386 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-167a8740-c564-40f0-94f3-e80a8ff621c1 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] [instance: 2870c53d-df7c-45d3-b8bd-c88966ad6315] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:15.388367 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b0d58960-677d-4a01-bcd9-ac3ba5f41970 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:15.388367 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b0d58960-677d-4a01-bcd9-ac3ba5f41970 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:15.388367 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b0d58960-677d-4a01-bcd9-ac3ba5f41970 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:15.388367 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b0d58960-677d-4a01-bcd9-ac3ba5f41970 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:15.393166 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b0d58960-677d-4a01-bcd9-ac3ba5f41970 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:15.393166 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b0d58960-677d-4a01-bcd9-ac3ba5f41970 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:15.393314 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-167a8740-c564-40f0-94f3-e80a8ff621c1 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:15.393314 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-167a8740-c564-40f0-94f3-e80a8ff621c1 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:15.393852 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-167a8740-c564-40f0-94f3-e80a8ff621c1 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:15.394745 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-167a8740-c564-40f0-94f3-e80a8ff621c1 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:15.395352 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-167a8740-c564-40f0-94f3-e80a8ff621c1 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:15.396061 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-167a8740-c564-40f0-94f3-e80a8ff621c1 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:15.667929 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-167a8740-c564-40f0-94f3-e80a8ff621c1 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bf143866aa44afb11285d61ffd7ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bf79842c02480eb1e91d521226d317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:27:15.679141 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b0d58960-677d-4a01-bcd9-ac3ba5f41970 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:27:15.692567 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-167a8740-c564-40f0-94f3-e80a8ff621c1 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] 10.222.0.52 "GET /compute/v2.1/servers/2870c53d-df7c-45d3-b8bd-c88966ad6315" status: 200 len: 1681 microversion: 2.1 time: 0.320242 Oct 19 03:27:15.694766 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b0d58960-677d-4a01-bcd9-ac3ba5f41970 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/5c23235b-b905-463f-bb7b-fef2a0381ed8" status: 200 len: 1309 microversion: 2.1 time: 0.334080 Oct 19 03:27:15.707158 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1768/3467] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:15 2022] GET /compute/v2.1/servers/5c23235b-b905-463f-bb7b-fef2a0381ed8 => generated 1309 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:27:15.713771 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1700/3468] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:15 2022] GET /compute/v2.1/servers/2870c53d-df7c-45d3-b8bd-c88966ad6315 => generated 1681 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:27:15.805639 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ae3643d3-6a24-4f32-b284-1f1455e87972 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:15.807293 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ae3643d3-6a24-4f32-b284-1f1455e87972 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] [instance: 4c823d1c-eebe-4aa6-972c-38209d6cc70e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:15.831414 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ae3643d3-6a24-4f32-b284-1f1455e87972 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:15.843689 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ae3643d3-6a24-4f32-b284-1f1455e87972 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:15.844497 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ae3643d3-6a24-4f32-b284-1f1455e87972 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:15.848707 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ae3643d3-6a24-4f32-b284-1f1455e87972 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:15.851527 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ae3643d3-6a24-4f32-b284-1f1455e87972 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:15.854587 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ae3643d3-6a24-4f32-b284-1f1455e87972 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:15.892383 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-336cb85c-1b21-44bf-a012-b2c95a972772 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:15.895189 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-336cb85c-1b21-44bf-a012-b2c95a972772 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] [instance: ff9df81f-bb98-4ed6-ba31-f44a7aa57258] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:15.902302 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-336cb85c-1b21-44bf-a012-b2c95a972772 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:15.903962 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-336cb85c-1b21-44bf-a012-b2c95a972772 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:15.904714 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-336cb85c-1b21-44bf-a012-b2c95a972772 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:15.906454 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-336cb85c-1b21-44bf-a012-b2c95a972772 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:15.907238 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-336cb85c-1b21-44bf-a012-b2c95a972772 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:15.907916 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-336cb85c-1b21-44bf-a012-b2c95a972772 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:16.430970 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-336cb85c-1b21-44bf-a012-b2c95a972772 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5eb004df19246c7ac6f0937dfc504d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba704466a29f4b35b97dbbb8c69ee19c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:27:16.441001 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-336cb85c-1b21-44bf-a012-b2c95a972772 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] 10.222.0.52 "GET /compute/v2.1/servers/ff9df81f-bb98-4ed6-ba31-f44a7aa57258" status: 200 len: 1325 microversion: 2.1 time: 0.554602 Oct 19 03:27:16.445964 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1701/3469] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:15 2022] GET /compute/v2.1/servers/ff9df81f-bb98-4ed6-ba31-f44a7aa57258 => generated 1325 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:27:16.461755 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-aab5ea12-6216-4ef7-9959-c7f69d40c076 req-5910477c-5e14-4994-9956-38d054d69e9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c23235b-b905-463f-bb7b-fef2a0381ed8", "tag": "44ad91f0-f48c-4cd2-82f2-4ec973157955"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:27:16.476160 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-aab5ea12-6216-4ef7-9959-c7f69d40c076 req-5910477c-5e14-4994-9956-38d054d69e9c service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:16.476658 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-aab5ea12-6216-4ef7-9959-c7f69d40c076 req-5910477c-5e14-4994-9956-38d054d69e9c service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:16.477606 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-aab5ea12-6216-4ef7-9959-c7f69d40c076 req-5910477c-5e14-4994-9956-38d054d69e9c service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:16.492697 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-aab5ea12-6216-4ef7-9959-c7f69d40c076 req-5910477c-5e14-4994-9956-38d054d69e9c service nova] Creating event network-changed:44ad91f0-f48c-4cd2-82f2-4ec973157955 for instance 5c23235b-b905-463f-bb7b-fef2a0381ed8 on n-h1-861333-8 Oct 19 03:27:16.499076 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-aab5ea12-6216-4ef7-9959-c7f69d40c076 req-5910477c-5e14-4994-9956-38d054d69e9c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051723 Oct 19 03:27:16.505299 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1702/3470] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:27:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:27:16.507077 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0385365d-83e6-4114-9cc7-d84508550f9c tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:16.508280 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0385365d-83e6-4114-9cc7-d84508550f9c tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] [instance: 3bfbe3fa-5e16-4b72-8232-7cf260c78f0a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:16.517262 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0385365d-83e6-4114-9cc7-d84508550f9c tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:16.519187 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0385365d-83e6-4114-9cc7-d84508550f9c tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:16.519961 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0385365d-83e6-4114-9cc7-d84508550f9c tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:16.521682 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0385365d-83e6-4114-9cc7-d84508550f9c tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:16.522652 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0385365d-83e6-4114-9cc7-d84508550f9c tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:16.523251 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0385365d-83e6-4114-9cc7-d84508550f9c tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:16.543844 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ae3643d3-6a24-4f32-b284-1f1455e87972 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5ed9dc7e0304f28afb381ef2ec3cefd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b2195b7d124b4eb2552f88dba26b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:27:16.556566 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ae3643d3-6a24-4f32-b284-1f1455e87972 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] 10.222.0.52 "GET /compute/v2.1/servers/4c823d1c-eebe-4aa6-972c-38209d6cc70e" status: 200 len: 1665 microversion: 2.1 time: 0.757181 Oct 19 03:27:16.557433 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1769/3471] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:15 2022] GET /compute/v2.1/servers/4c823d1c-eebe-4aa6-972c-38209d6cc70e => generated 1665 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:27:16.720271 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-02de4549-fc78-4132-b843-85353227754b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:16.720970 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-02de4549-fc78-4132-b843-85353227754b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 5c23235b-b905-463f-bb7b-fef2a0381ed8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:16.734911 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-02de4549-fc78-4132-b843-85353227754b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:16.734911 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-02de4549-fc78-4132-b843-85353227754b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:16.734911 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-02de4549-fc78-4132-b843-85353227754b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:16.734911 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-02de4549-fc78-4132-b843-85353227754b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:16.735269 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-02de4549-fc78-4132-b843-85353227754b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:16.735269 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-02de4549-fc78-4132-b843-85353227754b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:16.757311 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0385365d-83e6-4114-9cc7-d84508550f9c tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17362106426c46ca8c07ee8192fe2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcb4d8381f474d8bbea44443f845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:27:16.770812 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0385365d-83e6-4114-9cc7-d84508550f9c tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] 10.222.0.52 "GET /compute/v2.1/servers/3bfbe3fa-5e16-4b72-8232-7cf260c78f0a" status: 200 len: 1274 microversion: 2.1 time: 0.269074 Oct 19 03:27:16.771648 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1703/3472] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:16 2022] GET /compute/v2.1/servers/3bfbe3fa-5e16-4b72-8232-7cf260c78f0a => generated 1274 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:27:16.780873 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6d162280-c9db-4b3c-bdc2-b097a3fa8cca tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:16.782285 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6d162280-c9db-4b3c-bdc2-b097a3fa8cca tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] [instance: 2870c53d-df7c-45d3-b8bd-c88966ad6315] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:16.790949 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6d162280-c9db-4b3c-bdc2-b097a3fa8cca tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:16.791445 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6d162280-c9db-4b3c-bdc2-b097a3fa8cca tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:16.791883 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6d162280-c9db-4b3c-bdc2-b097a3fa8cca tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:16.792795 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6d162280-c9db-4b3c-bdc2-b097a3fa8cca tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:16.793464 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6d162280-c9db-4b3c-bdc2-b097a3fa8cca tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:16.793960 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6d162280-c9db-4b3c-bdc2-b097a3fa8cca tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:17.359794 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-02de4549-fc78-4132-b843-85353227754b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:27:17.375465 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-02de4549-fc78-4132-b843-85353227754b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/5c23235b-b905-463f-bb7b-fef2a0381ed8" status: 200 len: 1309 microversion: 2.1 time: 0.659085 Oct 19 03:27:17.378603 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1770/3473] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:16 2022] GET /compute/v2.1/servers/5c23235b-b905-463f-bb7b-fef2a0381ed8 => generated 1309 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:27:17.379824 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-6d162280-c9db-4b3c-bdc2-b097a3fa8cca tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bf143866aa44afb11285d61ffd7ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bf79842c02480eb1e91d521226d317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:27:17.409440 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6d162280-c9db-4b3c-bdc2-b097a3fa8cca tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] 10.222.0.52 "GET /compute/v2.1/servers/2870c53d-df7c-45d3-b8bd-c88966ad6315" status: 200 len: 1681 microversion: 2.1 time: 0.635915 Oct 19 03:27:17.410373 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1704/3474] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:16 2022] GET /compute/v2.1/servers/2870c53d-df7c-45d3-b8bd-c88966ad6315 => generated 1681 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:27:17.469715 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d854cf86-668b-40c2-a13e-247ab41d2a0a tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:17.470775 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d854cf86-668b-40c2-a13e-247ab41d2a0a tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] [instance: ff9df81f-bb98-4ed6-ba31-f44a7aa57258] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:17.484183 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d854cf86-668b-40c2-a13e-247ab41d2a0a tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:17.486899 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d854cf86-668b-40c2-a13e-247ab41d2a0a tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:17.490324 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d854cf86-668b-40c2-a13e-247ab41d2a0a tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:17.494926 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d854cf86-668b-40c2-a13e-247ab41d2a0a tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:17.496911 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d854cf86-668b-40c2-a13e-247ab41d2a0a tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:17.497595 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d854cf86-668b-40c2-a13e-247ab41d2a0a tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:17.584358 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8d85e373-5e8c-4ec6-9df6-8d3efd005281 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:17.585276 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8d85e373-5e8c-4ec6-9df6-8d3efd005281 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] [instance: 4c823d1c-eebe-4aa6-972c-38209d6cc70e] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:17.602997 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8d85e373-5e8c-4ec6-9df6-8d3efd005281 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:17.603803 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8d85e373-5e8c-4ec6-9df6-8d3efd005281 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:17.604411 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8d85e373-5e8c-4ec6-9df6-8d3efd005281 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:17.605315 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8d85e373-5e8c-4ec6-9df6-8d3efd005281 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:17.605963 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8d85e373-5e8c-4ec6-9df6-8d3efd005281 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:17.606559 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8d85e373-5e8c-4ec6-9df6-8d3efd005281 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:17.829617 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=6 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:27:17.965981 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d854cf86-668b-40c2-a13e-247ab41d2a0a tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5eb004df19246c7ac6f0937dfc504d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba704466a29f4b35b97dbbb8c69ee19c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:27:17.981286 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d854cf86-668b-40c2-a13e-247ab41d2a0a tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] 10.222.0.52 "GET /compute/v2.1/servers/ff9df81f-bb98-4ed6-ba31-f44a7aa57258" status: 200 len: 1325 microversion: 2.1 time: 0.515491 Oct 19 03:27:17.989294 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1771/3475] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:17 2022] GET /compute/v2.1/servers/ff9df81f-bb98-4ed6-ba31-f44a7aa57258 => generated 1325 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:27:17.997431 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1f1e37ea-23a6-4d26-b9dd-80802f2db2f1 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:18.008689 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1f1e37ea-23a6-4d26-b9dd-80802f2db2f1 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] [instance: 3bfbe3fa-5e16-4b72-8232-7cf260c78f0a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:18.029450 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1f1e37ea-23a6-4d26-b9dd-80802f2db2f1 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:18.032228 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1f1e37ea-23a6-4d26-b9dd-80802f2db2f1 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:18.033348 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1f1e37ea-23a6-4d26-b9dd-80802f2db2f1 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:18.033982 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:27:18.035649 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1f1e37ea-23a6-4d26-b9dd-80802f2db2f1 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:18.036974 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1f1e37ea-23a6-4d26-b9dd-80802f2db2f1 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:18.040223 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1f1e37ea-23a6-4d26-b9dd-80802f2db2f1 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:18.077006 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8d85e373-5e8c-4ec6-9df6-8d3efd005281 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5ed9dc7e0304f28afb381ef2ec3cefd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b2195b7d124b4eb2552f88dba26b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:27:18.088012 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8d85e373-5e8c-4ec6-9df6-8d3efd005281 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] 10.222.0.52 "GET /compute/v2.1/servers/4c823d1c-eebe-4aa6-972c-38209d6cc70e" status: 200 len: 1665 microversion: 2.1 time: 0.507250 Oct 19 03:27:18.089566 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1705/3476] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:17 2022] GET /compute/v2.1/servers/4c823d1c-eebe-4aa6-972c-38209d6cc70e => generated 1665 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:27:18.107506 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-6aeb88f7-e404-4363-b0d6-b05615b93f70 req-6899f6da-f077-4946-a2d5-5f7a9e47d42c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff9df81f-bb98-4ed6-ba31-f44a7aa57258", "name": "network-vif-plugged", "status": "completed", "tag": "b78325b6-b590-44d8-87bf-63300f736f7a"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:27:18.135440 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-6aeb88f7-e404-4363-b0d6-b05615b93f70 req-6899f6da-f077-4946-a2d5-5f7a9e47d42c service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:18.136872 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-6aeb88f7-e404-4363-b0d6-b05615b93f70 req-6899f6da-f077-4946-a2d5-5f7a9e47d42c service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:18.137687 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-6aeb88f7-e404-4363-b0d6-b05615b93f70 req-6899f6da-f077-4946-a2d5-5f7a9e47d42c service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:18.153878 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-6aeb88f7-e404-4363-b0d6-b05615b93f70 req-6899f6da-f077-4946-a2d5-5f7a9e47d42c service nova] Creating event network-vif-plugged:b78325b6-b590-44d8-87bf-63300f736f7a for instance ff9df81f-bb98-4ed6-ba31-f44a7aa57258 on n-h2-861333-8 Oct 19 03:27:18.159416 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-6aeb88f7-e404-4363-b0d6-b05615b93f70 req-6899f6da-f077-4946-a2d5-5f7a9e47d42c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068352 Oct 19 03:27:18.160619 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1706/3477] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:27:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:27:18.337118 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-1f1e37ea-23a6-4d26-b9dd-80802f2db2f1 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17362106426c46ca8c07ee8192fe2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcb4d8381f474d8bbea44443f845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:27:18.346008 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1f1e37ea-23a6-4d26-b9dd-80802f2db2f1 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] 10.222.0.52 "GET /compute/v2.1/servers/3bfbe3fa-5e16-4b72-8232-7cf260c78f0a" status: 200 len: 1274 microversion: 2.1 time: 0.354325 Oct 19 03:27:18.348960 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1772/3478] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:17 2022] GET /compute/v2.1/servers/3bfbe3fa-5e16-4b72-8232-7cf260c78f0a => generated 1274 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:27:18.404041 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a976debe-18fc-4046-817b-e9378645e497 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:18.404743 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a976debe-18fc-4046-817b-e9378645e497 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 5c23235b-b905-463f-bb7b-fef2a0381ed8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:18.419883 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a976debe-18fc-4046-817b-e9378645e497 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:18.420711 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a976debe-18fc-4046-817b-e9378645e497 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:18.421315 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a976debe-18fc-4046-817b-e9378645e497 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:18.422913 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a976debe-18fc-4046-817b-e9378645e497 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:18.424766 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a976debe-18fc-4046-817b-e9378645e497 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:18.431463 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a976debe-18fc-4046-817b-e9378645e497 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:18.433290 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0f661e2b-8c53-46dd-9944-c219f8ed5517 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:18.434473 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0f661e2b-8c53-46dd-9944-c219f8ed5517 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] [instance: 2870c53d-df7c-45d3-b8bd-c88966ad6315] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:18.447880 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0f661e2b-8c53-46dd-9944-c219f8ed5517 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:18.451703 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0f661e2b-8c53-46dd-9944-c219f8ed5517 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:18.452379 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0f661e2b-8c53-46dd-9944-c219f8ed5517 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:18.464826 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0f661e2b-8c53-46dd-9944-c219f8ed5517 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:18.464826 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0f661e2b-8c53-46dd-9944-c219f8ed5517 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:18.464826 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0f661e2b-8c53-46dd-9944-c219f8ed5517 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:18.727434 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-0f661e2b-8c53-46dd-9944-c219f8ed5517 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bf143866aa44afb11285d61ffd7ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bf79842c02480eb1e91d521226d317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:27:18.741471 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0f661e2b-8c53-46dd-9944-c219f8ed5517 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] 10.222.0.52 "GET /compute/v2.1/servers/2870c53d-df7c-45d3-b8bd-c88966ad6315" status: 200 len: 1613 microversion: 2.1 time: 0.312975 Oct 19 03:27:18.748754 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1773/3479] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:18 2022] GET /compute/v2.1/servers/2870c53d-df7c-45d3-b8bd-c88966ad6315 => generated 1613 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:27:18.816270 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a976debe-18fc-4046-817b-e9378645e497 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:27:18.834917 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a976debe-18fc-4046-817b-e9378645e497 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/5c23235b-b905-463f-bb7b-fef2a0381ed8" status: 200 len: 1309 microversion: 2.1 time: 0.434023 Oct 19 03:27:18.836707 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1707/3480] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:18 2022] GET /compute/v2.1/servers/5c23235b-b905-463f-bb7b-fef2a0381ed8 => generated 1309 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:27:18.852334 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-dee24b3f-b4ae-4c42-b9bd-9e5f69004d44 req-4c1d1b3e-dd70-456c-9bc4-f0f8675eb451 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c823d1c-eebe-4aa6-972c-38209d6cc70e", "name": "network-vif-deleted", "tag": "2450ebc0-ad1d-4651-825d-17d4dd7a5d3d"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:27:18.875942 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-dee24b3f-b4ae-4c42-b9bd-9e5f69004d44 req-4c1d1b3e-dd70-456c-9bc4-f0f8675eb451 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:18.876437 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-dee24b3f-b4ae-4c42-b9bd-9e5f69004d44 req-4c1d1b3e-dd70-456c-9bc4-f0f8675eb451 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:18.876881 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-dee24b3f-b4ae-4c42-b9bd-9e5f69004d44 req-4c1d1b3e-dd70-456c-9bc4-f0f8675eb451 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:18.881190 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:27:18.895657 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-dee24b3f-b4ae-4c42-b9bd-9e5f69004d44 req-4c1d1b3e-dd70-456c-9bc4-f0f8675eb451 service nova] Creating event network-vif-deleted:2450ebc0-ad1d-4651-825d-17d4dd7a5d3d for instance 4c823d1c-eebe-4aa6-972c-38209d6cc70e on n-h1-861333-8 Oct 19 03:27:18.916432 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-dee24b3f-b4ae-4c42-b9bd-9e5f69004d44 req-4c1d1b3e-dd70-456c-9bc4-f0f8675eb451 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067760 Oct 19 03:27:18.918211 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1774/3481] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:27:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:27:19.019477 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7e5a5abe-0fc3-4d7e-90bf-8ad6f9c2dc87 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:19.026430 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7e5a5abe-0fc3-4d7e-90bf-8ad6f9c2dc87 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] [instance: ff9df81f-bb98-4ed6-ba31-f44a7aa57258] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:19.029862 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=10 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:27:19.038785 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7e5a5abe-0fc3-4d7e-90bf-8ad6f9c2dc87 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:19.048971 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7e5a5abe-0fc3-4d7e-90bf-8ad6f9c2dc87 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:19.048971 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7e5a5abe-0fc3-4d7e-90bf-8ad6f9c2dc87 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:19.048971 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7e5a5abe-0fc3-4d7e-90bf-8ad6f9c2dc87 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:19.048971 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7e5a5abe-0fc3-4d7e-90bf-8ad6f9c2dc87 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:19.049561 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7e5a5abe-0fc3-4d7e-90bf-8ad6f9c2dc87 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:19.122144 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1c748f44-3208-4164-8a59-750c657ad0cd tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:19.123027 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1c748f44-3208-4164-8a59-750c657ad0cd tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] [instance: 4c823d1c-eebe-4aa6-972c-38209d6cc70e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:19.137409 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1c748f44-3208-4164-8a59-750c657ad0cd tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:19.137897 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1c748f44-3208-4164-8a59-750c657ad0cd tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:19.138336 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1c748f44-3208-4164-8a59-750c657ad0cd tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:19.139056 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1c748f44-3208-4164-8a59-750c657ad0cd tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:19.139513 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1c748f44-3208-4164-8a59-750c657ad0cd tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:19.140182 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1c748f44-3208-4164-8a59-750c657ad0cd tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:19.294719 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-1c748f44-3208-4164-8a59-750c657ad0cd tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5ed9dc7e0304f28afb381ef2ec3cefd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b2195b7d124b4eb2552f88dba26b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:27:19.307784 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1c748f44-3208-4164-8a59-750c657ad0cd tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] 10.222.0.52 "GET /compute/v2.1/servers/4c823d1c-eebe-4aa6-972c-38209d6cc70e" status: 200 len: 1598 microversion: 2.1 time: 0.199135 Oct 19 03:27:19.308391 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1775/3482] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:19 2022] GET /compute/v2.1/servers/4c823d1c-eebe-4aa6-972c-38209d6cc70e => generated 1598 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:27:19.320399 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-c319e773-ac6e-4a88-927e-94b180cdd06c req-2c580c5b-43d9-469d-829a-eb8df8c0f275 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2870c53d-df7c-45d3-b8bd-c88966ad6315", "name": "network-vif-deleted", "tag": "4438c03f-7c43-41c1-aadf-24b917ab0a59"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:27:19.334241 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-c319e773-ac6e-4a88-927e-94b180cdd06c req-2c580c5b-43d9-469d-829a-eb8df8c0f275 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:19.334241 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-c319e773-ac6e-4a88-927e-94b180cdd06c req-2c580c5b-43d9-469d-829a-eb8df8c0f275 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:19.334241 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-c319e773-ac6e-4a88-927e-94b180cdd06c req-2c580c5b-43d9-469d-829a-eb8df8c0f275 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:19.347211 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-c319e773-ac6e-4a88-927e-94b180cdd06c req-2c580c5b-43d9-469d-829a-eb8df8c0f275 service nova] Creating event network-vif-deleted:4438c03f-7c43-41c1-aadf-24b917ab0a59 for instance 2870c53d-df7c-45d3-b8bd-c88966ad6315 on n-h1-861333-8 Oct 19 03:27:19.352949 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-c319e773-ac6e-4a88-927e-94b180cdd06c req-2c580c5b-43d9-469d-829a-eb8df8c0f275 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043406 Oct 19 03:27:19.354659 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1776/3483] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:27:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:27:19.372356 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-af799efc-3e0f-44f3-83cd-e1ef2aaadce6 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:19.373154 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-af799efc-3e0f-44f3-83cd-e1ef2aaadce6 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] [instance: 3bfbe3fa-5e16-4b72-8232-7cf260c78f0a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:19.381806 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-af799efc-3e0f-44f3-83cd-e1ef2aaadce6 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:19.382300 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-af799efc-3e0f-44f3-83cd-e1ef2aaadce6 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:19.382941 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-af799efc-3e0f-44f3-83cd-e1ef2aaadce6 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:19.383646 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-af799efc-3e0f-44f3-83cd-e1ef2aaadce6 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:19.384259 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-af799efc-3e0f-44f3-83cd-e1ef2aaadce6 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:19.384873 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-af799efc-3e0f-44f3-83cd-e1ef2aaadce6 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:19.710825 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-af799efc-3e0f-44f3-83cd-e1ef2aaadce6 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17362106426c46ca8c07ee8192fe2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcb4d8381f474d8bbea44443f845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:27:19.720720 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-af799efc-3e0f-44f3-83cd-e1ef2aaadce6 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] 10.222.0.52 "GET /compute/v2.1/servers/3bfbe3fa-5e16-4b72-8232-7cf260c78f0a" status: 200 len: 1316 microversion: 2.1 time: 0.351788 Oct 19 03:27:19.722016 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1777/3484] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:19 2022] GET /compute/v2.1/servers/3bfbe3fa-5e16-4b72-8232-7cf260c78f0a => generated 1316 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:27:19.750486 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-7e5a5abe-0fc3-4d7e-90bf-8ad6f9c2dc87 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5eb004df19246c7ac6f0937dfc504d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba704466a29f4b35b97dbbb8c69ee19c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:27:19.759024 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7e5a5abe-0fc3-4d7e-90bf-8ad6f9c2dc87 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] 10.222.0.52 "GET /compute/v2.1/servers/ff9df81f-bb98-4ed6-ba31-f44a7aa57258" status: 200 len: 1325 microversion: 2.1 time: 0.747645 Oct 19 03:27:19.760661 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1708/3485] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:19 2022] GET /compute/v2.1/servers/ff9df81f-bb98-4ed6-ba31-f44a7aa57258 => generated 1325 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:27:19.770551 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-59944d21-d736-4ca9-965d-3a00b27ac200 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:19.771478 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-59944d21-d736-4ca9-965d-3a00b27ac200 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] [instance: 2870c53d-df7c-45d3-b8bd-c88966ad6315] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:19.780027 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-59944d21-d736-4ca9-965d-3a00b27ac200 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:19.780525 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-59944d21-d736-4ca9-965d-3a00b27ac200 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:19.781181 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-59944d21-d736-4ca9-965d-3a00b27ac200 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:19.782093 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-59944d21-d736-4ca9-965d-3a00b27ac200 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:19.782553 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-59944d21-d736-4ca9-965d-3a00b27ac200 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:19.782976 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-59944d21-d736-4ca9-965d-3a00b27ac200 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:19.862140 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-59944d21-d736-4ca9-965d-3a00b27ac200 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bf143866aa44afb11285d61ffd7ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bf79842c02480eb1e91d521226d317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:27:19.867853 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-37cd7747-a8a7-4f5a-b3d8-5396cccb7294 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:19.868552 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-37cd7747-a8a7-4f5a-b3d8-5396cccb7294 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 5c23235b-b905-463f-bb7b-fef2a0381ed8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:19.870432 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-59944d21-d736-4ca9-965d-3a00b27ac200 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] 10.222.0.52 "GET /compute/v2.1/servers/2870c53d-df7c-45d3-b8bd-c88966ad6315" status: 200 len: 1613 microversion: 2.1 time: 0.103999 Oct 19 03:27:19.871022 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1778/3486] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:19 2022] GET /compute/v2.1/servers/2870c53d-df7c-45d3-b8bd-c88966ad6315 => generated 1613 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:27:19.880579 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-37cd7747-a8a7-4f5a-b3d8-5396cccb7294 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:19.881113 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-37cd7747-a8a7-4f5a-b3d8-5396cccb7294 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:19.881597 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-37cd7747-a8a7-4f5a-b3d8-5396cccb7294 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:19.882348 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-37cd7747-a8a7-4f5a-b3d8-5396cccb7294 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:19.882810 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-37cd7747-a8a7-4f5a-b3d8-5396cccb7294 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:19.883236 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-37cd7747-a8a7-4f5a-b3d8-5396cccb7294 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:19.889354 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=100 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:27:20.149882 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-37cd7747-a8a7-4f5a-b3d8-5396cccb7294 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:27:20.157969 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-37cd7747-a8a7-4f5a-b3d8-5396cccb7294 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/5c23235b-b905-463f-bb7b-fef2a0381ed8" status: 200 len: 1309 microversion: 2.1 time: 0.300889 Oct 19 03:27:20.159177 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1709/3487] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:19 2022] GET /compute/v2.1/servers/5c23235b-b905-463f-bb7b-fef2a0381ed8 => generated 1309 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:27:20.332831 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c5b7fab9-0d47-4d38-bae5-c2197b6eace8 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:20.333356 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c5b7fab9-0d47-4d38-bae5-c2197b6eace8 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] [instance: 4c823d1c-eebe-4aa6-972c-38209d6cc70e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:20.335730 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=18 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:27:20.345308 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c5b7fab9-0d47-4d38-bae5-c2197b6eace8 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:20.352566 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c5b7fab9-0d47-4d38-bae5-c2197b6eace8 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:20.352566 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c5b7fab9-0d47-4d38-bae5-c2197b6eace8 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:20.352566 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c5b7fab9-0d47-4d38-bae5-c2197b6eace8 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:20.352566 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c5b7fab9-0d47-4d38-bae5-c2197b6eace8 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:20.353184 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c5b7fab9-0d47-4d38-bae5-c2197b6eace8 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:20.744412 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0248129d-5c52-4044-a90f-73e47b3104bd tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:20.745265 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0248129d-5c52-4044-a90f-73e47b3104bd tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] [instance: 3bfbe3fa-5e16-4b72-8232-7cf260c78f0a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:20.758961 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0248129d-5c52-4044-a90f-73e47b3104bd tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:20.762354 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0248129d-5c52-4044-a90f-73e47b3104bd tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:20.763003 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0248129d-5c52-4044-a90f-73e47b3104bd tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:20.764820 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0248129d-5c52-4044-a90f-73e47b3104bd tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:20.765583 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0248129d-5c52-4044-a90f-73e47b3104bd tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:20.766019 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0248129d-5c52-4044-a90f-73e47b3104bd tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:20.941149 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c5b7fab9-0d47-4d38-bae5-c2197b6eace8 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5ed9dc7e0304f28afb381ef2ec3cefd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b2195b7d124b4eb2552f88dba26b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:27:20.951257 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c5b7fab9-0d47-4d38-bae5-c2197b6eace8 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] 10.222.0.52 "GET /compute/v2.1/servers/4c823d1c-eebe-4aa6-972c-38209d6cc70e" status: 200 len: 1598 microversion: 2.1 time: 0.622234 Oct 19 03:27:20.952231 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1779/3488] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:20 2022] GET /compute/v2.1/servers/4c823d1c-eebe-4aa6-972c-38209d6cc70e => generated 1598 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:27:20.958937 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ee91dca2-917d-487b-bf56-af3c535f9c71 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:20.961631 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ee91dca2-917d-487b-bf56-af3c535f9c71 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] [instance: ff9df81f-bb98-4ed6-ba31-f44a7aa57258] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:20.967226 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ee91dca2-917d-487b-bf56-af3c535f9c71 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:20.967982 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ee91dca2-917d-487b-bf56-af3c535f9c71 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:20.969432 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ee91dca2-917d-487b-bf56-af3c535f9c71 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:20.971110 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ee91dca2-917d-487b-bf56-af3c535f9c71 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:20.971785 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ee91dca2-917d-487b-bf56-af3c535f9c71 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:20.972439 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ee91dca2-917d-487b-bf56-af3c535f9c71 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:21.150940 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0248129d-5c52-4044-a90f-73e47b3104bd tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17362106426c46ca8c07ee8192fe2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcb4d8381f474d8bbea44443f845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:27:21.159141 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0248129d-5c52-4044-a90f-73e47b3104bd tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] 10.222.0.52 "GET /compute/v2.1/servers/3bfbe3fa-5e16-4b72-8232-7cf260c78f0a" status: 200 len: 1316 microversion: 2.1 time: 0.418938 Oct 19 03:27:21.160272 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1710/3489] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:20 2022] GET /compute/v2.1/servers/3bfbe3fa-5e16-4b72-8232-7cf260c78f0a => generated 1316 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:27:21.166954 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1d741dd7-8faa-47ac-af86-721cac615cb6 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:21.167777 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1d741dd7-8faa-47ac-af86-721cac615cb6 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] [instance: 2870c53d-df7c-45d3-b8bd-c88966ad6315] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:21.177733 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1d741dd7-8faa-47ac-af86-721cac615cb6 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:21.178426 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1d741dd7-8faa-47ac-af86-721cac615cb6 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:21.184260 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1d741dd7-8faa-47ac-af86-721cac615cb6 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:21.184260 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1d741dd7-8faa-47ac-af86-721cac615cb6 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:21.184260 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1d741dd7-8faa-47ac-af86-721cac615cb6 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:21.184260 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1d741dd7-8faa-47ac-af86-721cac615cb6 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:21.220704 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1d741dd7-8faa-47ac-af86-721cac615cb6 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:21.221638 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1d741dd7-8faa-47ac-af86-721cac615cb6 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:21.222302 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1d741dd7-8faa-47ac-af86-721cac615cb6 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:21.222934 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-1d741dd7-8faa-47ac-af86-721cac615cb6 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lazy-loading 'fault' on Instance uuid 2870c53d-df7c-45d3-b8bd-c88966ad6315 {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:27:21.291870 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ee91dca2-917d-487b-bf56-af3c535f9c71 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5eb004df19246c7ac6f0937dfc504d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba704466a29f4b35b97dbbb8c69ee19c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:27:21.293456 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-1d741dd7-8faa-47ac-af86-721cac615cb6 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bf143866aa44afb11285d61ffd7ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bf79842c02480eb1e91d521226d317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:27:21.302736 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ee91dca2-917d-487b-bf56-af3c535f9c71 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] 10.222.0.52 "GET /compute/v2.1/servers/ff9df81f-bb98-4ed6-ba31-f44a7aa57258" status: 200 len: 1521 microversion: 2.1 time: 0.349145 Oct 19 03:27:21.303229 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1d741dd7-8faa-47ac-af86-721cac615cb6 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] 10.222.0.52 "GET /compute/v2.1/servers/2870c53d-df7c-45d3-b8bd-c88966ad6315" status: 200 len: 1330 microversion: 2.1 time: 0.141415 Oct 19 03:27:21.314220 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1711/3491] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:21 2022] GET /compute/v2.1/servers/2870c53d-df7c-45d3-b8bd-c88966ad6315 => generated 1330 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:27:21.314351 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1780/3491] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:20 2022] GET /compute/v2.1/servers/ff9df81f-bb98-4ed6-ba31-f44a7aa57258 => generated 1521 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:27:21.325999 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-35873fd6-a737-47ab-89e6-1b6b7f3b9cc9 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:21.326623 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-35873fd6-a737-47ab-89e6-1b6b7f3b9cc9 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 5c23235b-b905-463f-bb7b-fef2a0381ed8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:21.328194 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e69e0804-4ceb-46fd-841b-a0642c0e18c2 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:21.329624 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e69e0804-4ceb-46fd-841b-a0642c0e18c2 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] [instance: ff9df81f-bb98-4ed6-ba31-f44a7aa57258] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:21.333422 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-35873fd6-a737-47ab-89e6-1b6b7f3b9cc9 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:21.334830 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-35873fd6-a737-47ab-89e6-1b6b7f3b9cc9 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:21.335497 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-35873fd6-a737-47ab-89e6-1b6b7f3b9cc9 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:21.336760 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-35873fd6-a737-47ab-89e6-1b6b7f3b9cc9 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:21.337170 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-35873fd6-a737-47ab-89e6-1b6b7f3b9cc9 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:21.337671 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-35873fd6-a737-47ab-89e6-1b6b7f3b9cc9 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:21.337964 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e69e0804-4ceb-46fd-841b-a0642c0e18c2 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:21.339165 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e69e0804-4ceb-46fd-841b-a0642c0e18c2 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:21.339819 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e69e0804-4ceb-46fd-841b-a0642c0e18c2 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:21.340901 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e69e0804-4ceb-46fd-841b-a0642c0e18c2 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:21.341597 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e69e0804-4ceb-46fd-841b-a0642c0e18c2 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:21.343598 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e69e0804-4ceb-46fd-841b-a0642c0e18c2 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:21.378108 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-e69e0804-4ceb-46fd-841b-a0642c0e18c2 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] HTTP exception thrown: Instance is not a member of specified network Oct 19 03:27:21.386458 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e69e0804-4ceb-46fd-841b-a0642c0e18c2 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Request method failure captured: Oct 19 03:27:21.386458 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/ff9df81f-bb98-4ed6-ba31-f44a7aa57258/ips/invalid HTTP/1.1 Oct 19 03:27:21.386458 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:27:21.386458 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:27:21.386458 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:27:21.386458 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:27:21.386458 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:27:21.386458 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:27:21.386458 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:27:21.386458 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:27:21.386458 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT26FPyPx2sbB6gnpEzg436ZkZmwIdPot5HRl-eEPyVQSIotvZetQUGun7xXdnYnda9DZZFo-DNLXPwEnABgz7JrgRbwYaxiX9qJm0D3_kKpOa8SqA4w0Lv01m5BqPFdfU4Au78gpObCjS4N6tCSO1aQ51RQRhCNV9EGLQnIR9GzSOsU Oct 19 03:27:21.386458 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:27:21.386458 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:27:21.386458 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:27:21.386458 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:27:21.386458 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:27:21.386458 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:27:21.386458 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: ba704466a29f4b35b97dbbb8c69ee19c Oct 19 03:27:21.386458 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-289174266 Oct 19 03:27:21.386458 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:27:21.386458 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:27:21.388090 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ba704466a29f4b35b97dbbb8c69ee19c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ba704466a29f4b35b97dbbb8c69ee19c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ba704466a29f4b35b97dbbb8c69ee19c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ba704466a29f4b35b97dbbb8c69ee19c", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:27:21.388090 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-289174266 Oct 19 03:27:21.388090 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: ba704466a29f4b35b97dbbb8c69ee19c Oct 19 03:27:21.388090 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-289174266 Oct 19 03:27:21.388090 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ServerAddressesNegativeTestJSON-289174266-project Oct 19 03:27:21.388090 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:27:21.388090 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:27:21.388090 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: c5eb004df19246c7ac6f0937dfc504d4 Oct 19 03:27:21.388090 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-289174266-project Oct 19 03:27:21.388090 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:27:21.388090 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance is not a member of specified network Oct 19 03:27:21.388090 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'server_id': 'ff9df81f-bb98-4ed6-ba31-f44a7aa57258', 'id': 'invalid'} Oct 19 03:27:21.389121 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:27:21.389121 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:27:21.389121 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:27:21.389121 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:27:21.389121 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:27:21.389121 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:27:21.389121 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:27:21.389121 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:27:21.389121 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Oct 19 03:27:21.389121 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 19 03:27:21.389121 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Oct 19 03:27:21.389121 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:27:21.389121 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:27:21.389121 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:27:21.389121 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:27:21.389121 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:27:21.389121 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:27:21.389121 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:27:21.389121 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:27:21.389121 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Oct 19 03:27:21.389121 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:27:21.392624 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e69e0804-4ceb-46fd-841b-a0642c0e18c2 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Returning 404 to user: Instance is not a member of specified network {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:27:21.393767 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e69e0804-4ceb-46fd-841b-a0642c0e18c2 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] 10.222.0.52 "GET /compute/v2.1/servers/ff9df81f-bb98-4ed6-ba31-f44a7aa57258/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.069954 Oct 19 03:27:21.400427 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1781/3492] 10.222.0.52 () {58 vars in 1272 bytes} [Wed Oct 19 03:27:21 2022] GET /compute/v2.1/servers/ff9df81f-bb98-4ed6-ba31-f44a7aa57258/ips/invalid => generated 91 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 03:27:21.408505 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3a6a4d96-9cac-477f-b304-ceb39a8d1dde tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:21.409406 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-3a6a4d96-9cac-477f-b304-ceb39a8d1dde tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Failed to fetch instance by id 999 {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 19 03:27:21.410601 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-3a6a4d96-9cac-477f-b304-ceb39a8d1dde tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] HTTP exception thrown: Instance 999 could not be found. Oct 19 03:27:21.412705 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3a6a4d96-9cac-477f-b304-ceb39a8d1dde tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Request method failure captured: Oct 19 03:27:21.412705 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Oct 19 03:27:21.412705 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:27:21.412705 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:27:21.412705 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:27:21.412705 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:27:21.412705 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:27:21.412705 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:27:21.412705 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:27:21.412705 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:27:21.412705 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT26FPyPx2sbB6gnpEzg436ZkZmwIdPot5HRl-eEPyVQSIotvZetQUGun7xXdnYnda9DZZFo-DNLXPwEnABgz7JrgRbwYaxiX9qJm0D3_kKpOa8SqA4w0Lv01m5BqPFdfU4Au78gpObCjS4N6tCSO1aQ51RQRhCNV9EGLQnIR9GzSOsU Oct 19 03:27:21.412705 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:27:21.412705 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:27:21.412705 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:27:21.412705 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:27:21.412705 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:27:21.412705 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:27:21.412705 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: ba704466a29f4b35b97dbbb8c69ee19c Oct 19 03:27:21.412705 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-289174266 Oct 19 03:27:21.412705 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:27:21.412705 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:27:21.414283 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ba704466a29f4b35b97dbbb8c69ee19c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ba704466a29f4b35b97dbbb8c69ee19c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ba704466a29f4b35b97dbbb8c69ee19c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ba704466a29f4b35b97dbbb8c69ee19c", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:27:21.414283 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-289174266 Oct 19 03:27:21.414283 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: ba704466a29f4b35b97dbbb8c69ee19c Oct 19 03:27:21.414283 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-289174266 Oct 19 03:27:21.414283 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ServerAddressesNegativeTestJSON-289174266-project Oct 19 03:27:21.414283 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:27:21.414283 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:27:21.414283 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: c5eb004df19246c7ac6f0937dfc504d4 Oct 19 03:27:21.414283 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-289174266-project Oct 19 03:27:21.414283 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:27:21.414283 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance 999 could not be found. Oct 19 03:27:21.414283 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'server_id': '999'} Oct 19 03:27:21.415180 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:27:21.415180 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:27:21.415180 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:27:21.415180 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:27:21.415180 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 19 03:27:21.415180 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 19 03:27:21.415180 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 19 03:27:21.415180 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:27:21.415180 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:27:21.415180 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:27:21.415180 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:27:21.415180 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:27:21.415180 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:27:21.415180 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:27:21.415180 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:27:21.415180 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:27:21.415180 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:27:21.415180 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Oct 19 03:27:21.415180 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Oct 19 03:27:21.415180 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:27:21.416655 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:27:21.416655 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 19 03:27:21.416655 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:27:21.416655 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:27:21.416655 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:27:21.416655 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:27:21.416655 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:27:21.416655 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:27:21.416655 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:27:21.416655 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:27:21.416655 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 19 03:27:21.416655 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:27:21.418524 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3a6a4d96-9cac-477f-b304-ceb39a8d1dde tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Returning 404 to user: Instance 999 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:27:21.420574 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-3a6a4d96-9cac-477f-b304-ceb39a8d1dde tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] 10.222.0.52 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.017711 Oct 19 03:27:21.421300 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1782/3493] 10.222.0.52 () {58 vars in 1149 bytes} [Wed Oct 19 03:27:21 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 03:27:21.430386 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-844b68b5-f709-4f06-a0c3-3db381c50a80 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:21.431326 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-844b68b5-f709-4f06-a0c3-3db381c50a80 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] [instance: ff9df81f-bb98-4ed6-ba31-f44a7aa57258] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:21.439937 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-844b68b5-f709-4f06-a0c3-3db381c50a80 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:21.440438 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-844b68b5-f709-4f06-a0c3-3db381c50a80 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:21.440911 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-844b68b5-f709-4f06-a0c3-3db381c50a80 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:21.441656 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-844b68b5-f709-4f06-a0c3-3db381c50a80 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:21.442115 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-844b68b5-f709-4f06-a0c3-3db381c50a80 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:21.442549 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-844b68b5-f709-4f06-a0c3-3db381c50a80 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:21.485644 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-844b68b5-f709-4f06-a0c3-3db381c50a80 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] [instance: ff9df81f-bb98-4ed6-ba31-f44a7aa57258] Going to try to terminate instance {{(pid=121135) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:27:21.800183 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=3 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:27:21.899639 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-844b68b5-f709-4f06-a0c3-3db381c50a80 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ff9df81f-bb98-4ed6-ba31-f44a7aa57258" status: 204 len: 0 microversion: 2.1 time: 0.471778 Oct 19 03:27:21.904751 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1783/3494] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:27:21 2022] DELETE /compute/v2.1/servers/ff9df81f-bb98-4ed6-ba31-f44a7aa57258 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:27:21.910954 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-f46df4c1-1172-4554-bd38-1ff3dd4e4bd7 req-30b00d2a-c755-4b2a-a7a5-c13b551de270 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3bfbe3fa-5e16-4b72-8232-7cf260c78f0a", "tag": "4cf986cf-c812-445d-9c71-bf2c9df9bf7f"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:27:21.923497 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-f46df4c1-1172-4554-bd38-1ff3dd4e4bd7 req-30b00d2a-c755-4b2a-a7a5-c13b551de270 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:21.923851 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-f46df4c1-1172-4554-bd38-1ff3dd4e4bd7 req-30b00d2a-c755-4b2a-a7a5-c13b551de270 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:21.924529 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-f46df4c1-1172-4554-bd38-1ff3dd4e4bd7 req-30b00d2a-c755-4b2a-a7a5-c13b551de270 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:21.930773 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-35873fd6-a737-47ab-89e6-1b6b7f3b9cc9 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:27:21.939953 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-f46df4c1-1172-4554-bd38-1ff3dd4e4bd7 req-30b00d2a-c755-4b2a-a7a5-c13b551de270 service nova] Creating event network-changed:4cf986cf-c812-445d-9c71-bf2c9df9bf7f for instance 3bfbe3fa-5e16-4b72-8232-7cf260c78f0a on n-h1-861333-8 Oct 19 03:27:21.940101 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-35873fd6-a737-47ab-89e6-1b6b7f3b9cc9 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/5c23235b-b905-463f-bb7b-fef2a0381ed8" status: 200 len: 1309 microversion: 2.1 time: 0.624640 Oct 19 03:27:21.940615 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1712/3495] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:21 2022] GET /compute/v2.1/servers/5c23235b-b905-463f-bb7b-fef2a0381ed8 => generated 1309 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:27:21.945784 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-f46df4c1-1172-4554-bd38-1ff3dd4e4bd7 req-30b00d2a-c755-4b2a-a7a5-c13b551de270 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043115 Oct 19 03:27:21.947220 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1784/3496] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:27:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:27:21.947950 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d6cd61de-41ac-456c-882e-854e17412eb2 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:21.948727 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d6cd61de-41ac-456c-882e-854e17412eb2 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] [instance: ff9df81f-bb98-4ed6-ba31-f44a7aa57258] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:21.957494 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d6cd61de-41ac-456c-882e-854e17412eb2 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:21.957999 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d6cd61de-41ac-456c-882e-854e17412eb2 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:21.958448 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d6cd61de-41ac-456c-882e-854e17412eb2 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:21.959835 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d6cd61de-41ac-456c-882e-854e17412eb2 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:21.960299 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d6cd61de-41ac-456c-882e-854e17412eb2 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:21.960735 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d6cd61de-41ac-456c-882e-854e17412eb2 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:21.977502 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f62cb610-3373-4081-b41d-2751910765c6 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:21.978223 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f62cb610-3373-4081-b41d-2751910765c6 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] [instance: 4c823d1c-eebe-4aa6-972c-38209d6cc70e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:21.985448 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f62cb610-3373-4081-b41d-2751910765c6 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:21.986212 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f62cb610-3373-4081-b41d-2751910765c6 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:21.986657 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f62cb610-3373-4081-b41d-2751910765c6 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:21.987360 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f62cb610-3373-4081-b41d-2751910765c6 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:21.987816 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f62cb610-3373-4081-b41d-2751910765c6 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:21.988235 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f62cb610-3373-4081-b41d-2751910765c6 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:22.022744 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f62cb610-3373-4081-b41d-2751910765c6 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:22.023233 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f62cb610-3373-4081-b41d-2751910765c6 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:22.024298 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f62cb610-3373-4081-b41d-2751910765c6 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:22.024772 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-f62cb610-3373-4081-b41d-2751910765c6 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Lazy-loading 'fault' on Instance uuid 4c823d1c-eebe-4aa6-972c-38209d6cc70e {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:27:22.078730 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f62cb610-3373-4081-b41d-2751910765c6 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5ed9dc7e0304f28afb381ef2ec3cefd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b2195b7d124b4eb2552f88dba26b55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:27:22.087170 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f62cb610-3373-4081-b41d-2751910765c6 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] 10.222.0.52 "GET /compute/v2.1/servers/4c823d1c-eebe-4aa6-972c-38209d6cc70e" status: 200 len: 1316 microversion: 2.1 time: 0.114719 Oct 19 03:27:22.088319 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1785/3497] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:21 2022] GET /compute/v2.1/servers/4c823d1c-eebe-4aa6-972c-38209d6cc70e => generated 1316 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:27:22.127219 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d6cd61de-41ac-456c-882e-854e17412eb2 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5eb004df19246c7ac6f0937dfc504d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba704466a29f4b35b97dbbb8c69ee19c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:27:22.141780 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d6cd61de-41ac-456c-882e-854e17412eb2 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] 10.222.0.52 "GET /compute/v2.1/servers/ff9df81f-bb98-4ed6-ba31-f44a7aa57258" status: 200 len: 1527 microversion: 2.1 time: 0.199717 Oct 19 03:27:22.142756 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1713/3498] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:21 2022] GET /compute/v2.1/servers/ff9df81f-bb98-4ed6-ba31-f44a7aa57258 => generated 1527 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:27:22.186911 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3e943a07-2e02-493b-9d34-02510620e4d8 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:22.187535 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-3e943a07-2e02-493b-9d34-02510620e4d8 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] [instance: 3bfbe3fa-5e16-4b72-8232-7cf260c78f0a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:22.194349 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3e943a07-2e02-493b-9d34-02510620e4d8 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:22.194844 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3e943a07-2e02-493b-9d34-02510620e4d8 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:22.195452 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3e943a07-2e02-493b-9d34-02510620e4d8 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:22.200937 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3e943a07-2e02-493b-9d34-02510620e4d8 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:22.200937 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3e943a07-2e02-493b-9d34-02510620e4d8 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:22.200937 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3e943a07-2e02-493b-9d34-02510620e4d8 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:22.331823 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0e81bf4b-8b61-48f7-9b99-8af5c6c12168 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:22.333501 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0e81bf4b-8b61-48f7-9b99-8af5c6c12168 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] [instance: 2870c53d-df7c-45d3-b8bd-c88966ad6315] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:22.342623 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0e81bf4b-8b61-48f7-9b99-8af5c6c12168 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:22.343573 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0e81bf4b-8b61-48f7-9b99-8af5c6c12168 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:22.344815 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0e81bf4b-8b61-48f7-9b99-8af5c6c12168 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:22.347252 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0e81bf4b-8b61-48f7-9b99-8af5c6c12168 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:22.348840 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0e81bf4b-8b61-48f7-9b99-8af5c6c12168 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:22.350635 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0e81bf4b-8b61-48f7-9b99-8af5c6c12168 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:22.374843 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-0e81bf4b-8b61-48f7-9b99-8af5c6c12168 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] HTTP exception thrown: Instance 2870c53d-df7c-45d3-b8bd-c88966ad6315 could not be found. Oct 19 03:27:22.377007 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0e81bf4b-8b61-48f7-9b99-8af5c6c12168 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Request method failure captured: Oct 19 03:27:22.377007 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/2870c53d-df7c-45d3-b8bd-c88966ad6315 HTTP/1.1 Oct 19 03:27:22.377007 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:27:22.377007 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:27:22.377007 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:27:22.377007 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:27:22.377007 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:27:22.377007 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:27:22.377007 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:27:22.377007 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:27:22.377007 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT22iwM9bMU8vGzsgNo-2rhAMI_nRmQaY0p3hFFLzGjzX4BzFZMlwC3I9nEye0iBUd6HbCvAVoR8EQW6BTU2BBmyeeUg2o7E5eqiu0T1-oXaSZmAZhcxcJkCdzxTMmHlDvBXQCRlNo5Pc-PMPCKn_5F-Ms7Qk8uv7K_RKZNxHv3FL8aI Oct 19 03:27:22.377007 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:27:22.377007 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:27:22.377007 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:27:22.377007 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:27:22.377007 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:27:22.377007 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:27:22.377007 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 42bf79842c02480eb1e91d521226d317 Oct 19 03:27:22.377007 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1765420318 Oct 19 03:27:22.377007 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:27:22.377007 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:27:22.378630 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/42bf79842c02480eb1e91d521226d317"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/42bf79842c02480eb1e91d521226d317"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/42bf79842c02480eb1e91d521226d317"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_42bf79842c02480eb1e91d521226d317", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:27:22.378630 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1765420318 Oct 19 03:27:22.378630 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 42bf79842c02480eb1e91d521226d317 Oct 19 03:27:22.378630 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1765420318 Oct 19 03:27:22.378630 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-AttachSCSIVolumeTestJSON-1765420318-project Oct 19 03:27:22.378630 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:27:22.378630 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:27:22.378630 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 74bf143866aa44afb11285d61ffd7ee2 Oct 19 03:27:22.378630 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1765420318-project Oct 19 03:27:22.378630 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:27:22.378630 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance 2870c53d-df7c-45d3-b8bd-c88966ad6315 could not be found. Oct 19 03:27:22.378630 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '2870c53d-df7c-45d3-b8bd-c88966ad6315'} Oct 19 03:27:22.379542 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:27:22.379542 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:27:22.379542 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:27:22.379542 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:27:22.379542 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:27:22.379542 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:27:22.379542 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:27:22.379542 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:27:22.379542 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:27:22.379542 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:27:22.379542 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2870c53d-df7c-45d3-b8bd-c88966ad6315 could not be found. Oct 19 03:27:22.379542 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:27:22.379542 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:27:22.379542 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:27:22.379542 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:27:22.379542 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:27:22.379542 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:27:22.379542 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:27:22.379542 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:27:22.379542 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:27:22.385136 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:27:22.385136 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:27:22.385136 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:27:22.385136 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:27:22.385136 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:27:22.385136 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:27:22.385136 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:27:22.385136 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2870c53d-df7c-45d3-b8bd-c88966ad6315 could not be found. Oct 19 03:27:22.385136 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:27:22.385136 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:27:22.385136 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:27:22.385136 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:27:22.385136 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:27:22.385136 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:27:22.385136 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:27:22.385136 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:27:22.385136 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2870c53d-df7c-45d3-b8bd-c88966ad6315 could not be found. Oct 19 03:27:22.385136 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:27:22.386307 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0e81bf4b-8b61-48f7-9b99-8af5c6c12168 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Returning 404 to user: Instance 2870c53d-df7c-45d3-b8bd-c88966ad6315 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:27:22.386307 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0e81bf4b-8b61-48f7-9b99-8af5c6c12168 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] 10.222.0.52 "GET /compute/v2.1/servers/2870c53d-df7c-45d3-b8bd-c88966ad6315" status: 404 len: 111 microversion: 2.1 time: 0.057937 Oct 19 03:27:22.386307 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1714/3499] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:22 2022] GET /compute/v2.1/servers/2870c53d-df7c-45d3-b8bd-c88966ad6315 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:27:22.395993 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-83f3b346-5c59-4151-922b-688c4570f183 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Calling method '.version_select at 0x7fc130137a60>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:22.430052 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-3e943a07-2e02-493b-9d34-02510620e4d8 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17362106426c46ca8c07ee8192fe2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcb4d8381f474d8bbea44443f845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:27:22.452006 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-3e943a07-2e02-493b-9d34-02510620e4d8 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] 10.222.0.52 "GET /compute/v2.1/servers/3bfbe3fa-5e16-4b72-8232-7cf260c78f0a" status: 200 len: 1316 microversion: 2.1 time: 0.269039 Oct 19 03:27:22.452644 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1786/3500] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:22 2022] GET /compute/v2.1/servers/3bfbe3fa-5e16-4b72-8232-7cf260c78f0a => generated 1316 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:27:22.479978 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-83f3b346-5c59-4151-922b-688c4570f183 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-250895219" status: 202 len: 0 microversion: 2.1 time: 0.089716 Oct 19 03:27:22.481241 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1715/3501] 10.222.0.52 () {58 vars in 1218 bytes} [Wed Oct 19 03:27:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-250895219 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:27:22.492458 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-9363a134-6035-4a53-a13f-dad261dbcd6d req-5dd39a04-931b-4773-b8a9-85cbad845e95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c23235b-b905-463f-bb7b-fef2a0381ed8", "name": "network-vif-plugged", "status": "completed", "tag": "44ad91f0-f48c-4cd2-82f2-4ec973157955"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:27:22.500060 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-9363a134-6035-4a53-a13f-dad261dbcd6d req-5dd39a04-931b-4773-b8a9-85cbad845e95 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:22.500549 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-9363a134-6035-4a53-a13f-dad261dbcd6d req-5dd39a04-931b-4773-b8a9-85cbad845e95 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:22.500987 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-9363a134-6035-4a53-a13f-dad261dbcd6d req-5dd39a04-931b-4773-b8a9-85cbad845e95 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:22.513180 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-9363a134-6035-4a53-a13f-dad261dbcd6d req-5dd39a04-931b-4773-b8a9-85cbad845e95 service nova] Creating event network-vif-plugged:44ad91f0-f48c-4cd2-82f2-4ec973157955 for instance 5c23235b-b905-463f-bb7b-fef2a0381ed8 on n-h1-861333-8 Oct 19 03:27:22.519307 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-9363a134-6035-4a53-a13f-dad261dbcd6d req-5dd39a04-931b-4773-b8a9-85cbad845e95 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042177 Oct 19 03:27:22.520569 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1787/3502] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:27:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:27:22.965999 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-39d6817e-e470-456a-aceb-36a6fd1c39c3 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:22.967058 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-39d6817e-e470-456a-aceb-36a6fd1c39c3 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 5c23235b-b905-463f-bb7b-fef2a0381ed8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:22.973447 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:27:22.977987 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-39d6817e-e470-456a-aceb-36a6fd1c39c3 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:22.978548 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-39d6817e-e470-456a-aceb-36a6fd1c39c3 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:22.979522 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-39d6817e-e470-456a-aceb-36a6fd1c39c3 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:22.980227 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-39d6817e-e470-456a-aceb-36a6fd1c39c3 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:22.980851 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-39d6817e-e470-456a-aceb-36a6fd1c39c3 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:22.981277 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-39d6817e-e470-456a-aceb-36a6fd1c39c3 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:23.111797 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1118de49-2d52-439b-810e-c7530d901d0c tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:23.112562 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1118de49-2d52-439b-810e-c7530d901d0c tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] [instance: 4c823d1c-eebe-4aa6-972c-38209d6cc70e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:23.121533 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1118de49-2d52-439b-810e-c7530d901d0c tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:23.122915 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1118de49-2d52-439b-810e-c7530d901d0c tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:23.123559 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1118de49-2d52-439b-810e-c7530d901d0c tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:23.124951 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1118de49-2d52-439b-810e-c7530d901d0c tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:23.125600 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1118de49-2d52-439b-810e-c7530d901d0c tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:23.126482 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1118de49-2d52-439b-810e-c7530d901d0c tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:23.145871 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-1118de49-2d52-439b-810e-c7530d901d0c tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] HTTP exception thrown: Instance 4c823d1c-eebe-4aa6-972c-38209d6cc70e could not be found. Oct 19 03:27:23.148031 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1118de49-2d52-439b-810e-c7530d901d0c tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Request method failure captured: Oct 19 03:27:23.148031 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/4c823d1c-eebe-4aa6-972c-38209d6cc70e HTTP/1.1 Oct 19 03:27:23.148031 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:27:23.148031 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:27:23.148031 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:27:23.148031 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:27:23.148031 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:27:23.148031 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:27:23.148031 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:27:23.148031 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:27:23.148031 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT24i_feohoghcyBbEH2Q0GOv5B7vdhCSjEd041uoUyNvID8pXgmVANsGZgrqnSnYiBarBP3lrWCEB7kMoWYgeHcAg_o8VGdfnXGUMZREmd1OgrgZ2zy--78Ly6QoJnhjba1y4Mt7X_vVc5A0KE_PU8G5XpTrrwYjIvRELKzLXNLo8j4 Oct 19 03:27:23.148031 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:27:23.148031 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:27:23.148031 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:27:23.148031 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:27:23.148031 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:27:23.148031 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:27:23.148031 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: d0b2195b7d124b4eb2552f88dba26b55 Oct 19 03:27:23.148031 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ServersTestFqdnHostnames-1160436752 Oct 19 03:27:23.148031 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:27:23.148031 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:27:23.149428 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d0b2195b7d124b4eb2552f88dba26b55"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d0b2195b7d124b4eb2552f88dba26b55"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d0b2195b7d124b4eb2552f88dba26b55"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d0b2195b7d124b4eb2552f88dba26b55", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:27:23.149428 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ServersTestFqdnHostnames-1160436752 Oct 19 03:27:23.149428 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: d0b2195b7d124b4eb2552f88dba26b55 Oct 19 03:27:23.149428 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-1160436752 Oct 19 03:27:23.149428 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ServersTestFqdnHostnames-1160436752-project Oct 19 03:27:23.149428 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:27:23.149428 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:27:23.149428 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: f5ed9dc7e0304f28afb381ef2ec3cefd Oct 19 03:27:23.149428 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ServersTestFqdnHostnames-1160436752-project Oct 19 03:27:23.149428 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:27:23.149428 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance 4c823d1c-eebe-4aa6-972c-38209d6cc70e could not be found. Oct 19 03:27:23.149428 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '4c823d1c-eebe-4aa6-972c-38209d6cc70e'} Oct 19 03:27:23.155971 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:27:23.155971 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:27:23.155971 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:27:23.155971 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:27:23.155971 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:27:23.155971 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:27:23.155971 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:27:23.155971 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:27:23.155971 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:27:23.155971 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:27:23.155971 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c823d1c-eebe-4aa6-972c-38209d6cc70e could not be found. Oct 19 03:27:23.155971 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:27:23.155971 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:27:23.155971 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:27:23.155971 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:27:23.155971 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:27:23.155971 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:27:23.155971 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:27:23.155971 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:27:23.155971 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:27:23.157152 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:27:23.157152 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:27:23.157152 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:27:23.157152 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:27:23.157152 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:27:23.157152 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:27:23.157152 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:27:23.157152 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c823d1c-eebe-4aa6-972c-38209d6cc70e could not be found. Oct 19 03:27:23.157152 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:27:23.157152 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:27:23.157152 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:27:23.157152 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:27:23.157152 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:27:23.157152 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:27:23.157152 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:27:23.157152 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:27:23.157152 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c823d1c-eebe-4aa6-972c-38209d6cc70e could not be found. Oct 19 03:27:23.157152 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:27:23.158374 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1118de49-2d52-439b-810e-c7530d901d0c tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Returning 404 to user: Instance 4c823d1c-eebe-4aa6-972c-38209d6cc70e could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:27:23.158374 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1118de49-2d52-439b-810e-c7530d901d0c tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] 10.222.0.52 "GET /compute/v2.1/servers/4c823d1c-eebe-4aa6-972c-38209d6cc70e" status: 404 len: 111 microversion: 2.1 time: 0.042970 Oct 19 03:27:23.158374 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1788/3503] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:23 2022] GET /compute/v2.1/servers/4c823d1c-eebe-4aa6-972c-38209d6cc70e => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 03:27:23.167758 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-39d6817e-e470-456a-aceb-36a6fd1c39c3 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:27:23.169857 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c8bbfdd2-e2d5-40c6-a2fb-0b62d7234554 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] Calling method '.version_select at 0x7fc12bfa5a60>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:23.183393 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-39d6817e-e470-456a-aceb-36a6fd1c39c3 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/5c23235b-b905-463f-bb7b-fef2a0381ed8" status: 200 len: 1309 microversion: 2.1 time: 0.221743 Oct 19 03:27:23.185505 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1716/3504] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:22 2022] GET /compute/v2.1/servers/5c23235b-b905-463f-bb7b-fef2a0381ed8 => generated 1309 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:27:23.191818 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-778a15b0-b0b8-4541-b276-bd55fb5cdcc9 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:23.192690 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-778a15b0-b0b8-4541-b276-bd55fb5cdcc9 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] [instance: ff9df81f-bb98-4ed6-ba31-f44a7aa57258] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:23.202308 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-778a15b0-b0b8-4541-b276-bd55fb5cdcc9 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:23.203177 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-778a15b0-b0b8-4541-b276-bd55fb5cdcc9 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:23.203850 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-778a15b0-b0b8-4541-b276-bd55fb5cdcc9 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:23.204948 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-778a15b0-b0b8-4541-b276-bd55fb5cdcc9 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:23.205445 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-778a15b0-b0b8-4541-b276-bd55fb5cdcc9 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:23.206074 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-778a15b0-b0b8-4541-b276-bd55fb5cdcc9 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:23.315860 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c8bbfdd2-e2d5-40c6-a2fb-0b62d7234554 tempest-ServersTestFqdnHostnames-1160436752 tempest-ServersTestFqdnHostnames-1160436752-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2090115582" status: 202 len: 0 microversion: 2.1 time: 0.150148 Oct 19 03:27:23.316469 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1789/3505] 10.222.0.52 () {58 vars in 1221 bytes} [Wed Oct 19 03:27:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2090115582 => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:27:23.364430 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-778a15b0-b0b8-4541-b276-bd55fb5cdcc9 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5eb004df19246c7ac6f0937dfc504d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba704466a29f4b35b97dbbb8c69ee19c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:27:23.374995 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-778a15b0-b0b8-4541-b276-bd55fb5cdcc9 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] 10.222.0.52 "GET /compute/v2.1/servers/ff9df81f-bb98-4ed6-ba31-f44a7aa57258" status: 200 len: 1527 microversion: 2.1 time: 0.187923 Oct 19 03:27:23.375787 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1717/3506] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:23 2022] GET /compute/v2.1/servers/ff9df81f-bb98-4ed6-ba31-f44a7aa57258 => generated 1527 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:27:23.477570 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ef2d3aab-fc7c-4814-8b62-467192bbd3d7 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:23.478213 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ef2d3aab-fc7c-4814-8b62-467192bbd3d7 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] [instance: 3bfbe3fa-5e16-4b72-8232-7cf260c78f0a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:23.488222 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ef2d3aab-fc7c-4814-8b62-467192bbd3d7 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:23.489093 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ef2d3aab-fc7c-4814-8b62-467192bbd3d7 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:23.489777 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ef2d3aab-fc7c-4814-8b62-467192bbd3d7 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:23.491353 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ef2d3aab-fc7c-4814-8b62-467192bbd3d7 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:23.494995 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ef2d3aab-fc7c-4814-8b62-467192bbd3d7 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:23.494995 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ef2d3aab-fc7c-4814-8b62-467192bbd3d7 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:23.855366 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ef2d3aab-fc7c-4814-8b62-467192bbd3d7 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17362106426c46ca8c07ee8192fe2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcb4d8381f474d8bbea44443f845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:27:23.874382 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ef2d3aab-fc7c-4814-8b62-467192bbd3d7 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] 10.222.0.52 "GET /compute/v2.1/servers/3bfbe3fa-5e16-4b72-8232-7cf260c78f0a" status: 200 len: 1316 microversion: 2.1 time: 0.402690 Oct 19 03:27:23.874983 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1790/3507] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:23 2022] GET /compute/v2.1/servers/3bfbe3fa-5e16-4b72-8232-7cf260c78f0a => generated 1316 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:27:24.208096 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e750c473-11f4-41c0-aefd-cf00f9cebaa9 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:24.212543 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e750c473-11f4-41c0-aefd-cf00f9cebaa9 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 5c23235b-b905-463f-bb7b-fef2a0381ed8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:24.220675 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e750c473-11f4-41c0-aefd-cf00f9cebaa9 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:24.221510 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e750c473-11f4-41c0-aefd-cf00f9cebaa9 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:24.222156 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e750c473-11f4-41c0-aefd-cf00f9cebaa9 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:24.223132 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e750c473-11f4-41c0-aefd-cf00f9cebaa9 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:24.223810 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e750c473-11f4-41c0-aefd-cf00f9cebaa9 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:24.224471 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e750c473-11f4-41c0-aefd-cf00f9cebaa9 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:24.408186 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1eb4b788-0803-485f-95d4-c0aa8fc9ddfb tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:24.409662 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1eb4b788-0803-485f-95d4-c0aa8fc9ddfb tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] [instance: ff9df81f-bb98-4ed6-ba31-f44a7aa57258] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:24.427779 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1eb4b788-0803-485f-95d4-c0aa8fc9ddfb tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:24.429177 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1eb4b788-0803-485f-95d4-c0aa8fc9ddfb tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:24.429905 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1eb4b788-0803-485f-95d4-c0aa8fc9ddfb tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:24.434037 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1eb4b788-0803-485f-95d4-c0aa8fc9ddfb tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:24.434037 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1eb4b788-0803-485f-95d4-c0aa8fc9ddfb tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:24.434037 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1eb4b788-0803-485f-95d4-c0aa8fc9ddfb tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:24.538606 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-1eb4b788-0803-485f-95d4-c0aa8fc9ddfb tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5eb004df19246c7ac6f0937dfc504d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba704466a29f4b35b97dbbb8c69ee19c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:27:24.549610 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1eb4b788-0803-485f-95d4-c0aa8fc9ddfb tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] 10.222.0.52 "GET /compute/v2.1/servers/ff9df81f-bb98-4ed6-ba31-f44a7aa57258" status: 200 len: 1485 microversion: 2.1 time: 0.153964 Oct 19 03:27:24.550462 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1791/3508] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:24 2022] GET /compute/v2.1/servers/ff9df81f-bb98-4ed6-ba31-f44a7aa57258 => generated 1485 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:27:24.553440 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e750c473-11f4-41c0-aefd-cf00f9cebaa9 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:27:24.577338 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e750c473-11f4-41c0-aefd-cf00f9cebaa9 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/5c23235b-b905-463f-bb7b-fef2a0381ed8" status: 200 len: 1309 microversion: 2.1 time: 0.370114 Oct 19 03:27:24.577894 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1718/3509] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:24 2022] GET /compute/v2.1/servers/5c23235b-b905-463f-bb7b-fef2a0381ed8 => generated 1309 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:27:24.678007 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-63f8442e-e014-484d-a03b-fc8a36bfc880 req-1a22e7cf-3908-4edf-9fba-0bf6a4694cf4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff9df81f-bb98-4ed6-ba31-f44a7aa57258", "name": "network-vif-deleted", "tag": "b78325b6-b590-44d8-87bf-63300f736f7a"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:27:24.699025 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-63f8442e-e014-484d-a03b-fc8a36bfc880 req-1a22e7cf-3908-4edf-9fba-0bf6a4694cf4 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:24.700088 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-63f8442e-e014-484d-a03b-fc8a36bfc880 req-1a22e7cf-3908-4edf-9fba-0bf6a4694cf4 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:24.700873 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-63f8442e-e014-484d-a03b-fc8a36bfc880 req-1a22e7cf-3908-4edf-9fba-0bf6a4694cf4 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:24.731771 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-63f8442e-e014-484d-a03b-fc8a36bfc880 req-1a22e7cf-3908-4edf-9fba-0bf6a4694cf4 service nova] Creating event network-vif-deleted:b78325b6-b590-44d8-87bf-63300f736f7a for instance ff9df81f-bb98-4ed6-ba31-f44a7aa57258 on n-h2-861333-8 Oct 19 03:27:24.739140 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-63f8442e-e014-484d-a03b-fc8a36bfc880 req-1a22e7cf-3908-4edf-9fba-0bf6a4694cf4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064901 Oct 19 03:27:24.739971 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1792/3510] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:27:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:27:24.900123 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a320a272-3429-4cc5-a0de-64258b3789b9 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:24.901546 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a320a272-3429-4cc5-a0de-64258b3789b9 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] [instance: 3bfbe3fa-5e16-4b72-8232-7cf260c78f0a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:24.912759 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a320a272-3429-4cc5-a0de-64258b3789b9 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:24.913754 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a320a272-3429-4cc5-a0de-64258b3789b9 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:24.915676 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a320a272-3429-4cc5-a0de-64258b3789b9 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:24.917725 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a320a272-3429-4cc5-a0de-64258b3789b9 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:24.919127 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a320a272-3429-4cc5-a0de-64258b3789b9 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:24.919662 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a320a272-3429-4cc5-a0de-64258b3789b9 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:25.272854 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a320a272-3429-4cc5-a0de-64258b3789b9 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17362106426c46ca8c07ee8192fe2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcb4d8381f474d8bbea44443f845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:27:25.283734 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a320a272-3429-4cc5-a0de-64258b3789b9 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] 10.222.0.52 "GET /compute/v2.1/servers/3bfbe3fa-5e16-4b72-8232-7cf260c78f0a" status: 200 len: 1316 microversion: 2.1 time: 0.389333 Oct 19 03:27:25.299719 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1719/3511] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:24 2022] GET /compute/v2.1/servers/3bfbe3fa-5e16-4b72-8232-7cf260c78f0a => generated 1316 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:27:25.574096 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7831f4ad-06ec-45f3-ac32-80d3d7e5d673 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:25.575440 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7831f4ad-06ec-45f3-ac32-80d3d7e5d673 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] [instance: ff9df81f-bb98-4ed6-ba31-f44a7aa57258] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:25.582616 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7831f4ad-06ec-45f3-ac32-80d3d7e5d673 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:25.583274 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7831f4ad-06ec-45f3-ac32-80d3d7e5d673 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:25.584420 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7831f4ad-06ec-45f3-ac32-80d3d7e5d673 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:25.585304 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7831f4ad-06ec-45f3-ac32-80d3d7e5d673 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:25.586449 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7831f4ad-06ec-45f3-ac32-80d3d7e5d673 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:25.587074 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7831f4ad-06ec-45f3-ac32-80d3d7e5d673 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:25.600766 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c65fb830-0c1c-4192-bbb1-1f92c7056577 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:25.601767 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c65fb830-0c1c-4192-bbb1-1f92c7056577 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 5c23235b-b905-463f-bb7b-fef2a0381ed8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:25.615671 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c65fb830-0c1c-4192-bbb1-1f92c7056577 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:25.616174 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c65fb830-0c1c-4192-bbb1-1f92c7056577 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:25.617040 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c65fb830-0c1c-4192-bbb1-1f92c7056577 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:25.617969 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c65fb830-0c1c-4192-bbb1-1f92c7056577 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:25.620966 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c65fb830-0c1c-4192-bbb1-1f92c7056577 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:25.621520 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c65fb830-0c1c-4192-bbb1-1f92c7056577 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:25.660831 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7831f4ad-06ec-45f3-ac32-80d3d7e5d673 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:25.665077 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7831f4ad-06ec-45f3-ac32-80d3d7e5d673 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:25.665918 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7831f4ad-06ec-45f3-ac32-80d3d7e5d673 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:25.666766 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-7831f4ad-06ec-45f3-ac32-80d3d7e5d673 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Lazy-loading 'fault' on Instance uuid ff9df81f-bb98-4ed6-ba31-f44a7aa57258 {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:27:25.790819 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7831f4ad-06ec-45f3-ac32-80d3d7e5d673 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5eb004df19246c7ac6f0937dfc504d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba704466a29f4b35b97dbbb8c69ee19c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:27:25.815078 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7831f4ad-06ec-45f3-ac32-80d3d7e5d673 tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] 10.222.0.52 "GET /compute/v2.1/servers/ff9df81f-bb98-4ed6-ba31-f44a7aa57258" status: 200 len: 1315 microversion: 2.1 time: 0.245182 Oct 19 03:27:25.829678 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1793/3512] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:25 2022] GET /compute/v2.1/servers/ff9df81f-bb98-4ed6-ba31-f44a7aa57258 => generated 1315 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:27:25.999713 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c65fb830-0c1c-4192-bbb1-1f92c7056577 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:27:26.015913 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c65fb830-0c1c-4192-bbb1-1f92c7056577 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/5c23235b-b905-463f-bb7b-fef2a0381ed8" status: 200 len: 1309 microversion: 2.1 time: 0.417976 Oct 19 03:27:26.018846 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1720/3513] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:25 2022] GET /compute/v2.1/servers/5c23235b-b905-463f-bb7b-fef2a0381ed8 => generated 1309 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:27:26.259315 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e78e3a88-f08b-4182-8694-6e992e2b059f tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:26.260601 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e78e3a88-f08b-4182-8694-6e992e2b059f tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] [instance: 5cc2003b-73ef-4a54-a22d-9cef47c6ed3f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:26.275515 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e78e3a88-f08b-4182-8694-6e992e2b059f tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:26.294582 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e78e3a88-f08b-4182-8694-6e992e2b059f tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:26.296383 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e78e3a88-f08b-4182-8694-6e992e2b059f tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:26.297576 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e78e3a88-f08b-4182-8694-6e992e2b059f tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:26.298304 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e78e3a88-f08b-4182-8694-6e992e2b059f tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:26.298837 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e78e3a88-f08b-4182-8694-6e992e2b059f tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:26.309756 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a0353065-67ad-4463-9a10-218f989f4745 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:26.311095 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a0353065-67ad-4463-9a10-218f989f4745 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] [instance: 3bfbe3fa-5e16-4b72-8232-7cf260c78f0a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:26.319292 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a0353065-67ad-4463-9a10-218f989f4745 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:26.320085 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a0353065-67ad-4463-9a10-218f989f4745 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:26.320735 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a0353065-67ad-4463-9a10-218f989f4745 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:26.321710 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a0353065-67ad-4463-9a10-218f989f4745 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:26.322376 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a0353065-67ad-4463-9a10-218f989f4745 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:26.323068 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a0353065-67ad-4463-9a10-218f989f4745 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:27.321292 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:27:27.327310 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e78e3a88-f08b-4182-8694-6e992e2b059f tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f" status: 200 len: 1858 microversion: 2.1 time: 1.073181 Oct 19 03:27:27.334863 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1794/3514] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:26 2022] GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f => generated 1858 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:27:27.360836 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a0353065-67ad-4463-9a10-218f989f4745 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17362106426c46ca8c07ee8192fe2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcb4d8381f474d8bbea44443f845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:27:27.374144 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a0353065-67ad-4463-9a10-218f989f4745 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] 10.222.0.52 "GET /compute/v2.1/servers/3bfbe3fa-5e16-4b72-8232-7cf260c78f0a" status: 200 len: 1316 microversion: 2.1 time: 1.065263 Oct 19 03:27:27.375899 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1721/3515] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:26 2022] GET /compute/v2.1/servers/3bfbe3fa-5e16-4b72-8232-7cf260c78f0a => generated 1316 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:27:27.399242 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-056c0b90-c412-4da7-a0a3-370ebcaee95e tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:27.401910 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-056c0b90-c412-4da7-a0a3-370ebcaee95e tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] [instance: ff9df81f-bb98-4ed6-ba31-f44a7aa57258] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:27.407104 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b9189ef1-0971-4efd-8b8a-9d94715636fe tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:27.407766 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b9189ef1-0971-4efd-8b8a-9d94715636fe tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 5c23235b-b905-463f-bb7b-fef2a0381ed8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:27.435306 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-056c0b90-c412-4da7-a0a3-370ebcaee95e tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:27.435306 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-056c0b90-c412-4da7-a0a3-370ebcaee95e tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:27.435306 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-056c0b90-c412-4da7-a0a3-370ebcaee95e tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:27.435306 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-056c0b90-c412-4da7-a0a3-370ebcaee95e tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:27.435763 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-056c0b90-c412-4da7-a0a3-370ebcaee95e tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:27.435763 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-056c0b90-c412-4da7-a0a3-370ebcaee95e tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:27.435989 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b9189ef1-0971-4efd-8b8a-9d94715636fe tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:27.435989 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b9189ef1-0971-4efd-8b8a-9d94715636fe tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:27.435989 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b9189ef1-0971-4efd-8b8a-9d94715636fe tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:27.435989 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b9189ef1-0971-4efd-8b8a-9d94715636fe tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:27.436295 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b9189ef1-0971-4efd-8b8a-9d94715636fe tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:27.436295 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b9189ef1-0971-4efd-8b8a-9d94715636fe tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:27.462657 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-056c0b90-c412-4da7-a0a3-370ebcaee95e tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] HTTP exception thrown: Instance ff9df81f-bb98-4ed6-ba31-f44a7aa57258 could not be found. Oct 19 03:27:27.465278 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-056c0b90-c412-4da7-a0a3-370ebcaee95e tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Request method failure captured: Oct 19 03:27:27.465278 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/ff9df81f-bb98-4ed6-ba31-f44a7aa57258 HTTP/1.1 Oct 19 03:27:27.465278 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:27:27.465278 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:27:27.465278 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:27:27.465278 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:27:27.465278 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:27:27.465278 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:27:27.465278 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:27:27.465278 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:27:27.465278 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT26FPyPx2sbB6gnpEzg436ZkZmwIdPot5HRl-eEPyVQSIotvZetQUGun7xXdnYnda9DZZFo-DNLXPwEnABgz7JrgRbwYaxiX9qJm0D3_kKpOa8SqA4w0Lv01m5BqPFdfU4Au78gpObCjS4N6tCSO1aQ51RQRhCNV9EGLQnIR9GzSOsU Oct 19 03:27:27.465278 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:27:27.465278 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:27:27.465278 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:27:27.465278 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:27:27.465278 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:27:27.465278 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:27:27.465278 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: ba704466a29f4b35b97dbbb8c69ee19c Oct 19 03:27:27.465278 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-289174266 Oct 19 03:27:27.465278 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:27:27.465278 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:27:27.466905 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ba704466a29f4b35b97dbbb8c69ee19c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ba704466a29f4b35b97dbbb8c69ee19c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ba704466a29f4b35b97dbbb8c69ee19c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ba704466a29f4b35b97dbbb8c69ee19c", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:27:27.466905 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-289174266 Oct 19 03:27:27.466905 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: ba704466a29f4b35b97dbbb8c69ee19c Oct 19 03:27:27.466905 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-289174266 Oct 19 03:27:27.466905 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ServerAddressesNegativeTestJSON-289174266-project Oct 19 03:27:27.466905 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:27:27.466905 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:27:27.466905 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: c5eb004df19246c7ac6f0937dfc504d4 Oct 19 03:27:27.466905 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-289174266-project Oct 19 03:27:27.466905 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:27:27.466905 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance ff9df81f-bb98-4ed6-ba31-f44a7aa57258 could not be found. Oct 19 03:27:27.466905 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': 'ff9df81f-bb98-4ed6-ba31-f44a7aa57258'} Oct 19 03:27:27.467751 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:27:27.467751 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:27:27.467751 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:27:27.467751 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:27:27.467751 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:27:27.467751 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:27:27.467751 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:27:27.467751 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:27:27.467751 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:27:27.467751 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:27:27.467751 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff9df81f-bb98-4ed6-ba31-f44a7aa57258 could not be found. Oct 19 03:27:27.467751 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:27:27.467751 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:27:27.467751 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:27:27.467751 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:27:27.467751 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:27:27.467751 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:27:27.467751 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:27:27.467751 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:27:27.467751 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:27:27.469036 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:27:27.469036 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:27:27.469036 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:27:27.469036 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:27:27.469036 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:27:27.469036 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:27:27.469036 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:27:27.469036 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff9df81f-bb98-4ed6-ba31-f44a7aa57258 could not be found. Oct 19 03:27:27.469036 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:27:27.469036 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:27:27.469036 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:27:27.469036 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:27:27.469036 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:27:27.469036 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:27:27.469036 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:27:27.469036 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:27:27.469036 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff9df81f-bb98-4ed6-ba31-f44a7aa57258 could not be found. Oct 19 03:27:27.469036 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:27:27.470197 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-056c0b90-c412-4da7-a0a3-370ebcaee95e tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] Returning 404 to user: Instance ff9df81f-bb98-4ed6-ba31-f44a7aa57258 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:27:27.470197 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-056c0b90-c412-4da7-a0a3-370ebcaee95e tempest-ServerAddressesNegativeTestJSON-289174266 tempest-ServerAddressesNegativeTestJSON-289174266-project] 10.222.0.52 "GET /compute/v2.1/servers/ff9df81f-bb98-4ed6-ba31-f44a7aa57258" status: 404 len: 111 microversion: 2.1 time: 0.095999 Oct 19 03:27:27.470197 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1795/3516] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:27 2022] GET /compute/v2.1/servers/ff9df81f-bb98-4ed6-ba31-f44a7aa57258 => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:27:27.478095 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-8bfad50a-60c1-4e1a-867d-8167885297ce tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-861333-8", "block_migration": true, "disk_over_commit": false}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:27:27.488249 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-8bfad50a-60c1-4e1a-867d-8167885297ce tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] [instance: 5cc2003b-73ef-4a54-a22d-9cef47c6ed3f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:27.506091 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8bfad50a-60c1-4e1a-867d-8167885297ce tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:27.506599 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8bfad50a-60c1-4e1a-867d-8167885297ce tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:27.507044 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8bfad50a-60c1-4e1a-867d-8167885297ce tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:27.507866 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8bfad50a-60c1-4e1a-867d-8167885297ce tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:27.508332 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8bfad50a-60c1-4e1a-867d-8167885297ce tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:27.508765 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8bfad50a-60c1-4e1a-867d-8167885297ce tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:27.619568 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-8bfad50a-60c1-4e1a-867d-8167885297ce tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Lazy-loading 'flavor' on Instance uuid 5cc2003b-73ef-4a54-a22d-9cef47c6ed3f {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:27:27.655463 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-8bfad50a-60c1-4e1a-867d-8167885297ce tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] [instance: 5cc2003b-73ef-4a54-a22d-9cef47c6ed3f] Going to try to live migrate instance to n-h1-861333-8 {{(pid=121135) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 19 03:27:28.245384 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b9189ef1-0971-4efd-8b8a-9d94715636fe tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:27:28.256175 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b9189ef1-0971-4efd-8b8a-9d94715636fe tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/5c23235b-b905-463f-bb7b-fef2a0381ed8" status: 200 len: 1490 microversion: 2.1 time: 0.878457 Oct 19 03:27:28.261429 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1722/3517] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:27 2022] GET /compute/v2.1/servers/5c23235b-b905-463f-bb7b-fef2a0381ed8 => generated 1490 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:27:28.286856 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-86579b2c-03fd-4ee9-bb65-00618570e7e4 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:27:28.289797 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-86579b2c-03fd-4ee9-bb65-00618570e7e4 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 5c23235b-b905-463f-bb7b-fef2a0381ed8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:28.312708 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-86579b2c-03fd-4ee9-bb65-00618570e7e4 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:28.312708 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-86579b2c-03fd-4ee9-bb65-00618570e7e4 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:28.312708 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-86579b2c-03fd-4ee9-bb65-00618570e7e4 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:28.312708 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-86579b2c-03fd-4ee9-bb65-00618570e7e4 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:28.313177 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-86579b2c-03fd-4ee9-bb65-00618570e7e4 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:28.313177 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-86579b2c-03fd-4ee9-bb65-00618570e7e4 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:28.638357 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-86579b2c-03fd-4ee9-bb65-00618570e7e4 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "PUT /compute/v2.1/servers/5c23235b-b905-463f-bb7b-fef2a0381ed8" status: 200 len: 1085 microversion: 2.1 time: 0.355506 Oct 19 03:27:28.649854 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1723/3518] 10.222.0.52 () {60 vars in 1256 bytes} [Wed Oct 19 03:27:28 2022] PUT /compute/v2.1/servers/5c23235b-b905-463f-bb7b-fef2a0381ed8 => generated 1085 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:27:28.649854 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5519c1db-78e1-406d-85c3-d44c18ff10df tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:28.669988 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5519c1db-78e1-406d-85c3-d44c18ff10df tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] [instance: 3bfbe3fa-5e16-4b72-8232-7cf260c78f0a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:28.696297 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5519c1db-78e1-406d-85c3-d44c18ff10df tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:28.697031 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5519c1db-78e1-406d-85c3-d44c18ff10df tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:28.697646 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5519c1db-78e1-406d-85c3-d44c18ff10df tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:28.698940 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5519c1db-78e1-406d-85c3-d44c18ff10df tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:28.699514 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5519c1db-78e1-406d-85c3-d44c18ff10df tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:28.700054 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5519c1db-78e1-406d-85c3-d44c18ff10df tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:29.251877 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5519c1db-78e1-406d-85c3-d44c18ff10df tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17362106426c46ca8c07ee8192fe2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcb4d8381f474d8bbea44443f845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:27:29.260195 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5519c1db-78e1-406d-85c3-d44c18ff10df tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] 10.222.0.52 "GET /compute/v2.1/servers/3bfbe3fa-5e16-4b72-8232-7cf260c78f0a" status: 200 len: 1316 microversion: 2.1 time: 0.617945 Oct 19 03:27:29.264118 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1724/3519] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:28 2022] GET /compute/v2.1/servers/3bfbe3fa-5e16-4b72-8232-7cf260c78f0a => generated 1316 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:27:29.277193 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7ab5b3ec-0d88-4bb9-b450-eac977470ad4 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:29.292408 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7ab5b3ec-0d88-4bb9-b450-eac977470ad4 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 5c23235b-b905-463f-bb7b-fef2a0381ed8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:29.309815 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7ab5b3ec-0d88-4bb9-b450-eac977470ad4 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:29.310370 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7ab5b3ec-0d88-4bb9-b450-eac977470ad4 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:29.311060 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7ab5b3ec-0d88-4bb9-b450-eac977470ad4 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:29.312467 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7ab5b3ec-0d88-4bb9-b450-eac977470ad4 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:29.313105 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7ab5b3ec-0d88-4bb9-b450-eac977470ad4 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:29.314550 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7ab5b3ec-0d88-4bb9-b450-eac977470ad4 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:29.598889 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-7ab5b3ec-0d88-4bb9-b450-eac977470ad4 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:27:29.619998 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7ab5b3ec-0d88-4bb9-b450-eac977470ad4 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/5c23235b-b905-463f-bb7b-fef2a0381ed8" status: 200 len: 1511 microversion: 2.1 time: 0.353431 Oct 19 03:27:29.636533 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1725/3520] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:29 2022] GET /compute/v2.1/servers/5c23235b-b905-463f-bb7b-fef2a0381ed8 => generated 1511 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:27:29.659789 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-d59ad83e-28a7-41bc-9715-7ed00cbed628 req-61608fae-c228-4270-94ce-4055cb261bfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bfbe3fa-5e16-4b72-8232-7cf260c78f0a", "name": "network-vif-plugged", "status": "completed", "tag": "4cf986cf-c812-445d-9c71-bf2c9df9bf7f"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:27:29.690671 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-d59ad83e-28a7-41bc-9715-7ed00cbed628 req-61608fae-c228-4270-94ce-4055cb261bfd service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:29.691214 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-d59ad83e-28a7-41bc-9715-7ed00cbed628 req-61608fae-c228-4270-94ce-4055cb261bfd service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:29.691906 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-d59ad83e-28a7-41bc-9715-7ed00cbed628 req-61608fae-c228-4270-94ce-4055cb261bfd service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:29.758018 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-d59ad83e-28a7-41bc-9715-7ed00cbed628 req-61608fae-c228-4270-94ce-4055cb261bfd service nova] Creating event network-vif-plugged:4cf986cf-c812-445d-9c71-bf2c9df9bf7f for instance 3bfbe3fa-5e16-4b72-8232-7cf260c78f0a on n-h1-861333-8 Oct 19 03:27:29.772402 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-d59ad83e-28a7-41bc-9715-7ed00cbed628 req-61608fae-c228-4270-94ce-4055cb261bfd service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132939 Oct 19 03:27:29.774263 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1726/3521] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:27:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:27:29.781486 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d7a7e509-d9c9-4262-83df-2f7b6fd5b122 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:29.782598 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d7a7e509-d9c9-4262-83df-2f7b6fd5b122 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 5c23235b-b905-463f-bb7b-fef2a0381ed8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:29.809932 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d7a7e509-d9c9-4262-83df-2f7b6fd5b122 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:29.810776 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d7a7e509-d9c9-4262-83df-2f7b6fd5b122 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:29.811443 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d7a7e509-d9c9-4262-83df-2f7b6fd5b122 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:29.813259 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d7a7e509-d9c9-4262-83df-2f7b6fd5b122 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:29.814044 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d7a7e509-d9c9-4262-83df-2f7b6fd5b122 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:29.818655 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d7a7e509-d9c9-4262-83df-2f7b6fd5b122 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:29.843752 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:27:30.095895 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d7a7e509-d9c9-4262-83df-2f7b6fd5b122 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:27:30.104466 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d7a7e509-d9c9-4262-83df-2f7b6fd5b122 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/5c23235b-b905-463f-bb7b-fef2a0381ed8" status: 200 len: 1511 microversion: 2.1 time: 0.328831 Oct 19 03:27:30.113321 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1727/3522] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:29 2022] GET /compute/v2.1/servers/5c23235b-b905-463f-bb7b-fef2a0381ed8 => generated 1511 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:27:30.139681 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-81cf58f3-6f1b-4a72-a55f-1a074322932e tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:30.140454 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-81cf58f3-6f1b-4a72-a55f-1a074322932e tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 5c23235b-b905-463f-bb7b-fef2a0381ed8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:30.149924 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-81cf58f3-6f1b-4a72-a55f-1a074322932e tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:30.150425 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-81cf58f3-6f1b-4a72-a55f-1a074322932e tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:30.150866 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-81cf58f3-6f1b-4a72-a55f-1a074322932e tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:30.151575 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-81cf58f3-6f1b-4a72-a55f-1a074322932e tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:30.152026 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-81cf58f3-6f1b-4a72-a55f-1a074322932e tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:30.152450 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-81cf58f3-6f1b-4a72-a55f-1a074322932e tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:30.195770 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-81cf58f3-6f1b-4a72-a55f-1a074322932e tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 5c23235b-b905-463f-bb7b-fef2a0381ed8] Going to try to terminate instance {{(pid=121134) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:27:30.755489 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-81cf58f3-6f1b-4a72-a55f-1a074322932e tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "DELETE /compute/v2.1/servers/5c23235b-b905-463f-bb7b-fef2a0381ed8" status: 204 len: 0 microversion: 2.1 time: 0.619285 Oct 19 03:27:30.757060 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1728/3523] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:27:30 2022] DELETE /compute/v2.1/servers/5c23235b-b905-463f-bb7b-fef2a0381ed8 => generated 0 bytes in 622 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:27:30.767743 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-baed11c9-312f-44b0-962c-ec79c6332f43 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:30.769063 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-baed11c9-312f-44b0-962c-ec79c6332f43 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] [instance: 3bfbe3fa-5e16-4b72-8232-7cf260c78f0a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:30.784016 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-baed11c9-312f-44b0-962c-ec79c6332f43 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:30.788632 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-baed11c9-312f-44b0-962c-ec79c6332f43 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:30.788632 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-baed11c9-312f-44b0-962c-ec79c6332f43 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:30.788632 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-baed11c9-312f-44b0-962c-ec79c6332f43 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:30.788632 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-baed11c9-312f-44b0-962c-ec79c6332f43 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:30.789332 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-baed11c9-312f-44b0-962c-ec79c6332f43 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:31.069389 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-baed11c9-312f-44b0-962c-ec79c6332f43 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17362106426c46ca8c07ee8192fe2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcb4d8381f474d8bbea44443f845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:27:31.077684 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-baed11c9-312f-44b0-962c-ec79c6332f43 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] 10.222.0.52 "GET /compute/v2.1/servers/3bfbe3fa-5e16-4b72-8232-7cf260c78f0a" status: 200 len: 1316 microversion: 2.1 time: 0.315340 Oct 19 03:27:31.084403 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1729/3524] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:30 2022] GET /compute/v2.1/servers/3bfbe3fa-5e16-4b72-8232-7cf260c78f0a => generated 1316 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:27:31.098031 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-85809d15-629a-4c5c-b23e-10190d0bee61 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:31.098849 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-85809d15-629a-4c5c-b23e-10190d0bee61 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 5c23235b-b905-463f-bb7b-fef2a0381ed8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:31.113237 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-85809d15-629a-4c5c-b23e-10190d0bee61 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:31.113943 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-85809d15-629a-4c5c-b23e-10190d0bee61 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:31.114579 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-85809d15-629a-4c5c-b23e-10190d0bee61 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:31.115536 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-85809d15-629a-4c5c-b23e-10190d0bee61 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:31.116208 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-85809d15-629a-4c5c-b23e-10190d0bee61 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:31.116806 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-85809d15-629a-4c5c-b23e-10190d0bee61 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:31.418261 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-85809d15-629a-4c5c-b23e-10190d0bee61 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:27:31.429048 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-85809d15-629a-4c5c-b23e-10190d0bee61 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/5c23235b-b905-463f-bb7b-fef2a0381ed8" status: 200 len: 1517 microversion: 2.1 time: 0.343273 Oct 19 03:27:31.433704 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1730/3525] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:31 2022] GET /compute/v2.1/servers/5c23235b-b905-463f-bb7b-fef2a0381ed8 => generated 1517 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:27:31.449664 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1bccf39e-7d30-4825-95d4-01255f39fa28 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:31.453887 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1bccf39e-7d30-4825-95d4-01255f39fa28 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] [instance: 2870c53d-df7c-45d3-b8bd-c88966ad6315] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:31.479147 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1bccf39e-7d30-4825-95d4-01255f39fa28 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:31.479612 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1bccf39e-7d30-4825-95d4-01255f39fa28 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:31.485395 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1bccf39e-7d30-4825-95d4-01255f39fa28 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:31.486243 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1bccf39e-7d30-4825-95d4-01255f39fa28 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:31.486765 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1bccf39e-7d30-4825-95d4-01255f39fa28 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:31.487210 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1bccf39e-7d30-4825-95d4-01255f39fa28 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:31.509718 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-1bccf39e-7d30-4825-95d4-01255f39fa28 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] HTTP exception thrown: Instance 2870c53d-df7c-45d3-b8bd-c88966ad6315 could not be found. Oct 19 03:27:31.513633 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1bccf39e-7d30-4825-95d4-01255f39fa28 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Request method failure captured: Oct 19 03:27:31.513633 n-d-861333-8 devstack@n-api.service[121134]: request: DELETE /compute/v2.1/servers/2870c53d-df7c-45d3-b8bd-c88966ad6315 HTTP/1.1 Oct 19 03:27:31.513633 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:27:31.513633 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:27:31.513633 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:27:31.513633 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:27:31.513633 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:27:31.513633 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:27:31.513633 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:27:31.513633 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:27:31.513633 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT22iwM9bMU8vGzsgNo-2rhAMI_nRmQaY0p3hFFLzGjzX4BzFZMlwC3I9nEye0iBUd6HbCvAVoR8EQW6BTU2BBmyeeUg2o7E5eqiu0T1-oXaSZmAZhcxcJkCdzxTMmHlDvBXQCRlNo5Pc-PMPCKn_5F-Ms7Qk8uv7K_RKZNxHv3FL8aI Oct 19 03:27:31.513633 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:27:31.513633 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:27:31.513633 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:27:31.513633 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:27:31.513633 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:27:31.513633 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:27:31.513633 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 42bf79842c02480eb1e91d521226d317 Oct 19 03:27:31.513633 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1765420318 Oct 19 03:27:31.513633 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:27:31.513633 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:27:31.515397 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/42bf79842c02480eb1e91d521226d317"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/42bf79842c02480eb1e91d521226d317"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/42bf79842c02480eb1e91d521226d317"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_42bf79842c02480eb1e91d521226d317", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:27:31.515397 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1765420318 Oct 19 03:27:31.515397 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 42bf79842c02480eb1e91d521226d317 Oct 19 03:27:31.515397 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1765420318 Oct 19 03:27:31.515397 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-AttachSCSIVolumeTestJSON-1765420318-project Oct 19 03:27:31.515397 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:27:31.515397 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:27:31.515397 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 74bf143866aa44afb11285d61ffd7ee2 Oct 19 03:27:31.515397 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1765420318-project Oct 19 03:27:31.515397 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:27:31.515397 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance 2870c53d-df7c-45d3-b8bd-c88966ad6315 could not be found. Oct 19 03:27:31.515397 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '2870c53d-df7c-45d3-b8bd-c88966ad6315'} Oct 19 03:27:31.516353 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:27:31.516353 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:27:31.516353 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:27:31.516353 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:27:31.516353 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:27:31.516353 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:27:31.516353 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:27:31.516353 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:27:31.516353 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:27:31.516353 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:27:31.516353 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2870c53d-df7c-45d3-b8bd-c88966ad6315 could not be found. Oct 19 03:27:31.516353 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:27:31.516353 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:27:31.516353 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:27:31.516353 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:27:31.516353 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:27:31.516353 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:27:31.516353 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:27:31.516353 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:27:31.516353 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:27:31.517592 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:27:31.517592 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 03:27:31.517592 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 03:27:31.517592 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 03:27:31.517592 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 03:27:31.517592 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:27:31.517592 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:27:31.517592 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:27:31.517592 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:27:31.517592 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2870c53d-df7c-45d3-b8bd-c88966ad6315 could not be found. Oct 19 03:27:31.517592 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:27:31.517592 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:27:31.517592 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:27:31.517592 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:27:31.517592 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:27:31.517592 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:27:31.517592 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:27:31.517592 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:27:31.517592 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2870c53d-df7c-45d3-b8bd-c88966ad6315 could not be found. Oct 19 03:27:31.517592 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:27:31.520015 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1bccf39e-7d30-4825-95d4-01255f39fa28 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Returning 404 to user: Instance 2870c53d-df7c-45d3-b8bd-c88966ad6315 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:27:31.520015 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1bccf39e-7d30-4825-95d4-01255f39fa28 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] 10.222.0.52 "DELETE /compute/v2.1/servers/2870c53d-df7c-45d3-b8bd-c88966ad6315" status: 404 len: 111 microversion: 2.1 time: 0.081798 Oct 19 03:27:31.523744 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1731/3526] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:27:31 2022] DELETE /compute/v2.1/servers/2870c53d-df7c-45d3-b8bd-c88966ad6315 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:27:31.541217 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-594c430a-bb37-4114-bd37-6e1dcb5a2a71 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:31.545545 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-594c430a-bb37-4114-bd37-6e1dcb5a2a71 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] [instance: 2870c53d-df7c-45d3-b8bd-c88966ad6315] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:31.550209 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-594c430a-bb37-4114-bd37-6e1dcb5a2a71 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:31.551679 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-594c430a-bb37-4114-bd37-6e1dcb5a2a71 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:31.552393 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-594c430a-bb37-4114-bd37-6e1dcb5a2a71 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:31.553330 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-594c430a-bb37-4114-bd37-6e1dcb5a2a71 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:31.555264 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-594c430a-bb37-4114-bd37-6e1dcb5a2a71 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:31.556739 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-594c430a-bb37-4114-bd37-6e1dcb5a2a71 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:31.581908 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-594c430a-bb37-4114-bd37-6e1dcb5a2a71 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] HTTP exception thrown: Instance 2870c53d-df7c-45d3-b8bd-c88966ad6315 could not be found. Oct 19 03:27:31.585195 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-594c430a-bb37-4114-bd37-6e1dcb5a2a71 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Request method failure captured: Oct 19 03:27:31.585195 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/2870c53d-df7c-45d3-b8bd-c88966ad6315 HTTP/1.1 Oct 19 03:27:31.585195 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:27:31.585195 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:27:31.585195 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:27:31.585195 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:27:31.585195 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:27:31.585195 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:27:31.585195 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:27:31.585195 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:27:31.585195 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT22iwM9bMU8vGzsgNo-2rhAMI_nRmQaY0p3hFFLzGjzX4BzFZMlwC3I9nEye0iBUd6HbCvAVoR8EQW6BTU2BBmyeeUg2o7E5eqiu0T1-oXaSZmAZhcxcJkCdzxTMmHlDvBXQCRlNo5Pc-PMPCKn_5F-Ms7Qk8uv7K_RKZNxHv3FL8aI Oct 19 03:27:31.585195 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:27:31.585195 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:27:31.585195 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:27:31.585195 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:27:31.585195 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:27:31.585195 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:27:31.585195 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 42bf79842c02480eb1e91d521226d317 Oct 19 03:27:31.585195 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1765420318 Oct 19 03:27:31.585195 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:27:31.585195 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:27:31.586763 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/42bf79842c02480eb1e91d521226d317"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/42bf79842c02480eb1e91d521226d317"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/42bf79842c02480eb1e91d521226d317"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_42bf79842c02480eb1e91d521226d317", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:27:31.586763 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1765420318 Oct 19 03:27:31.586763 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 42bf79842c02480eb1e91d521226d317 Oct 19 03:27:31.586763 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1765420318 Oct 19 03:27:31.586763 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-AttachSCSIVolumeTestJSON-1765420318-project Oct 19 03:27:31.586763 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:27:31.586763 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:27:31.586763 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 74bf143866aa44afb11285d61ffd7ee2 Oct 19 03:27:31.586763 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1765420318-project Oct 19 03:27:31.586763 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:27:31.586763 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance 2870c53d-df7c-45d3-b8bd-c88966ad6315 could not be found. Oct 19 03:27:31.586763 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '2870c53d-df7c-45d3-b8bd-c88966ad6315'} Oct 19 03:27:31.587479 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:27:31.587479 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:27:31.587479 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:27:31.587479 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:27:31.587479 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:27:31.587479 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:27:31.587479 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:27:31.587479 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:27:31.587479 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:27:31.587479 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:27:31.587479 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2870c53d-df7c-45d3-b8bd-c88966ad6315 could not be found. Oct 19 03:27:31.587479 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:27:31.587479 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:27:31.587479 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:27:31.587479 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:27:31.587479 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:27:31.587479 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:27:31.587479 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:27:31.587479 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:27:31.587479 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:27:31.588688 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:27:31.588688 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:27:31.588688 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:27:31.588688 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:27:31.588688 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:27:31.588688 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:27:31.588688 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:27:31.588688 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2870c53d-df7c-45d3-b8bd-c88966ad6315 could not be found. Oct 19 03:27:31.588688 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:27:31.588688 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:27:31.588688 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:27:31.588688 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:27:31.588688 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:27:31.588688 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:27:31.588688 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:27:31.588688 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:27:31.588688 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2870c53d-df7c-45d3-b8bd-c88966ad6315 could not be found. Oct 19 03:27:31.588688 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:27:31.595480 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-594c430a-bb37-4114-bd37-6e1dcb5a2a71 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] Returning 404 to user: Instance 2870c53d-df7c-45d3-b8bd-c88966ad6315 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:27:31.595480 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-594c430a-bb37-4114-bd37-6e1dcb5a2a71 tempest-AttachSCSIVolumeTestJSON-1765420318 tempest-AttachSCSIVolumeTestJSON-1765420318-project] 10.222.0.52 "GET /compute/v2.1/servers/2870c53d-df7c-45d3-b8bd-c88966ad6315" status: 404 len: 111 microversion: 2.1 time: 0.062647 Oct 19 03:27:31.595480 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1732/3527] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:31 2022] GET /compute/v2.1/servers/2870c53d-df7c-45d3-b8bd-c88966ad6315 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:27:31.942643 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-8bfad50a-60c1-4e1a-867d-8167885297ce tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f/action" status: 202 len: 0 microversion: 2.1 time: 4.471498 Oct 19 03:27:31.944832 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1796/3528] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:27:27 2022] POST /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f/action => generated 0 bytes in 4474 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:27:31.953876 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-eaccd81a-9f4c-4290-ab74-402adb85fad5 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:31.954497 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-eaccd81a-9f4c-4290-ab74-402adb85fad5 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 5cc2003b-73ef-4a54-a22d-9cef47c6ed3f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:31.965595 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eaccd81a-9f4c-4290-ab74-402adb85fad5 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:31.972822 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eaccd81a-9f4c-4290-ab74-402adb85fad5 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:31.973675 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eaccd81a-9f4c-4290-ab74-402adb85fad5 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:31.976656 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eaccd81a-9f4c-4290-ab74-402adb85fad5 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:31.985298 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eaccd81a-9f4c-4290-ab74-402adb85fad5 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:31.989135 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eaccd81a-9f4c-4290-ab74-402adb85fad5 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:32.105732 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a66f46cc-1e60-4dad-bc21-1bb7d5c8b78d tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:32.108220 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a66f46cc-1e60-4dad-bc21-1bb7d5c8b78d tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] [instance: 3bfbe3fa-5e16-4b72-8232-7cf260c78f0a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:32.121942 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a66f46cc-1e60-4dad-bc21-1bb7d5c8b78d tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:32.123057 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a66f46cc-1e60-4dad-bc21-1bb7d5c8b78d tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:32.124390 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a66f46cc-1e60-4dad-bc21-1bb7d5c8b78d tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:32.125440 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a66f46cc-1e60-4dad-bc21-1bb7d5c8b78d tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:32.126744 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a66f46cc-1e60-4dad-bc21-1bb7d5c8b78d tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:32.129858 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a66f46cc-1e60-4dad-bc21-1bb7d5c8b78d tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:32.488683 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-eaccd81a-9f4c-4290-ab74-402adb85fad5 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:27:32.503919 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-eaccd81a-9f4c-4290-ab74-402adb85fad5 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f" status: 200 len: 1717 microversion: 2.1 time: 0.555546 Oct 19 03:27:32.505035 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1733/3529] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:31 2022] GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f => generated 1717 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:27:32.529949 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b5e6436c-41ac-42c9-997f-5f44500a67ef tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:32.530702 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b5e6436c-41ac-42c9-997f-5f44500a67ef tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 5c23235b-b905-463f-bb7b-fef2a0381ed8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:32.543756 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b5e6436c-41ac-42c9-997f-5f44500a67ef tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:32.544272 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b5e6436c-41ac-42c9-997f-5f44500a67ef tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:32.544975 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b5e6436c-41ac-42c9-997f-5f44500a67ef tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:32.545912 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b5e6436c-41ac-42c9-997f-5f44500a67ef tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:32.548008 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b5e6436c-41ac-42c9-997f-5f44500a67ef tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:32.548626 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b5e6436c-41ac-42c9-997f-5f44500a67ef tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:32.588804 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a66f46cc-1e60-4dad-bc21-1bb7d5c8b78d tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17362106426c46ca8c07ee8192fe2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcb4d8381f474d8bbea44443f845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:27:32.607943 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a66f46cc-1e60-4dad-bc21-1bb7d5c8b78d tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] 10.222.0.52 "GET /compute/v2.1/servers/3bfbe3fa-5e16-4b72-8232-7cf260c78f0a" status: 200 len: 1316 microversion: 2.1 time: 0.506104 Oct 19 03:27:32.608552 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1797/3530] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:32 2022] GET /compute/v2.1/servers/3bfbe3fa-5e16-4b72-8232-7cf260c78f0a => generated 1316 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:27:33.532755 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5a4766cc-44b1-43a9-b627-4554fc1eb2c8 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:33.533615 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-5a4766cc-44b1-43a9-b627-4554fc1eb2c8 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 5cc2003b-73ef-4a54-a22d-9cef47c6ed3f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:33.544186 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5a4766cc-44b1-43a9-b627-4554fc1eb2c8 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:33.544910 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5a4766cc-44b1-43a9-b627-4554fc1eb2c8 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:33.546022 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5a4766cc-44b1-43a9-b627-4554fc1eb2c8 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:33.546942 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5a4766cc-44b1-43a9-b627-4554fc1eb2c8 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:33.547653 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5a4766cc-44b1-43a9-b627-4554fc1eb2c8 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:33.548195 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5a4766cc-44b1-43a9-b627-4554fc1eb2c8 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:33.668721 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b5e6436c-41ac-42c9-997f-5f44500a67ef tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:27:33.681090 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b5e6436c-41ac-42c9-997f-5f44500a67ef tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/5c23235b-b905-463f-bb7b-fef2a0381ed8" status: 200 len: 1517 microversion: 2.1 time: 1.174264 Oct 19 03:27:33.694727 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1734/3531] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:32 2022] GET /compute/v2.1/servers/5c23235b-b905-463f-bb7b-fef2a0381ed8 => generated 1517 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:27:33.704654 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-fc4d1267-fb63-4c94-ad4e-73aea57d61b9 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:33.705641 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-fc4d1267-fb63-4c94-ad4e-73aea57d61b9 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] [instance: 3bfbe3fa-5e16-4b72-8232-7cf260c78f0a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:33.727934 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fc4d1267-fb63-4c94-ad4e-73aea57d61b9 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:33.729267 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fc4d1267-fb63-4c94-ad4e-73aea57d61b9 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:33.732523 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fc4d1267-fb63-4c94-ad4e-73aea57d61b9 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:33.734351 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fc4d1267-fb63-4c94-ad4e-73aea57d61b9 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:33.734992 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fc4d1267-fb63-4c94-ad4e-73aea57d61b9 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:33.735608 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fc4d1267-fb63-4c94-ad4e-73aea57d61b9 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:33.999160 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-fc4d1267-fb63-4c94-ad4e-73aea57d61b9 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17362106426c46ca8c07ee8192fe2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcb4d8381f474d8bbea44443f845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:27:34.011768 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-fc4d1267-fb63-4c94-ad4e-73aea57d61b9 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] 10.222.0.52 "GET /compute/v2.1/servers/3bfbe3fa-5e16-4b72-8232-7cf260c78f0a" status: 200 len: 1466 microversion: 2.1 time: 0.315571 Oct 19 03:27:34.014603 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1735/3532] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:33 2022] GET /compute/v2.1/servers/3bfbe3fa-5e16-4b72-8232-7cf260c78f0a => generated 1466 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:27:34.286491 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-5a4766cc-44b1-43a9-b627-4554fc1eb2c8 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:27:34.290426 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-cb22b621-a6e7-4aae-a38f-d4d709b138be tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-5963999", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "networks": [{"uuid": "549a6939-4677-4325-946a-139cb93dc76f"}]}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:27:34.303332 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5a4766cc-44b1-43a9-b627-4554fc1eb2c8 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f" status: 200 len: 1717 microversion: 2.1 time: 0.774809 Oct 19 03:27:34.303955 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1798/3533] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:33 2022] GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f => generated 1717 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:27:34.326244 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f405f499-b840-4012-be19-6ee546e187c2 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-1084738986", "metadata": {"image_type": "test"}}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:27:34.330809 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f405f499-b840-4012-be19-6ee546e187c2 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] [instance: 3bfbe3fa-5e16-4b72-8232-7cf260c78f0a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:34.344603 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f405f499-b840-4012-be19-6ee546e187c2 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:34.345425 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f405f499-b840-4012-be19-6ee546e187c2 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:34.346166 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f405f499-b840-4012-be19-6ee546e187c2 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:34.347275 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f405f499-b840-4012-be19-6ee546e187c2 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:34.348731 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f405f499-b840-4012-be19-6ee546e187c2 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:34.349359 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f405f499-b840-4012-be19-6ee546e187c2 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:34.410831 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-cb22b621-a6e7-4aae-a38f-d4d709b138be tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] validate_networks() for [('549a6939-4677-4325-946a-139cb93dc76f', None, None, None, None, None)] {{(pid=121134) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:27:34.438537 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-f405f499-b840-4012-be19-6ee546e187c2 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Getting quotas for project b9fcb4d8381f474d8bbea44443f845f8. Resources: dict_keys(['metadata_items']) {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:27:34.445822 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-f405f499-b840-4012-be19-6ee546e187c2 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Getting quotas for user 17362106426c46ca8c07ee8192fe2bac and project b9fcb4d8381f474d8bbea44443f845f8. Resources: dict_keys(['metadata_items']) {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:27:35.016374 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f405f499-b840-4012-be19-6ee546e187c2 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] 10.222.0.52 "POST /compute/v2.1/servers/3bfbe3fa-5e16-4b72-8232-7cf260c78f0a/action" status: 202 len: 0 microversion: 2.1 time: 0.700758 Oct 19 03:27:35.018831 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1799/3534] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:27:34 2022] POST /compute/v2.1/servers/3bfbe3fa-5e16-4b72-8232-7cf260c78f0a/action => generated 0 bytes in 704 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 19 03:27:35.029549 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2f4a6ca1-1c57-4db1-99c3-b01edc5617f5 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:35.030945 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-2f4a6ca1-1c57-4db1-99c3-b01edc5617f5 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 5c23235b-b905-463f-bb7b-fef2a0381ed8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:35.041085 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2f4a6ca1-1c57-4db1-99c3-b01edc5617f5 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:35.041867 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2f4a6ca1-1c57-4db1-99c3-b01edc5617f5 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:35.042769 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2f4a6ca1-1c57-4db1-99c3-b01edc5617f5 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:35.043680 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2f4a6ca1-1c57-4db1-99c3-b01edc5617f5 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:35.045245 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2f4a6ca1-1c57-4db1-99c3-b01edc5617f5 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:35.046072 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2f4a6ca1-1c57-4db1-99c3-b01edc5617f5 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:35.679996 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-2f4a6ca1-1c57-4db1-99c3-b01edc5617f5 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:27:35.689141 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2f4a6ca1-1c57-4db1-99c3-b01edc5617f5 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/5c23235b-b905-463f-bb7b-fef2a0381ed8" status: 200 len: 1517 microversion: 2.1 time: 0.668621 Oct 19 03:27:35.690255 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1800/3535] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:35 2022] GET /compute/v2.1/servers/5c23235b-b905-463f-bb7b-fef2a0381ed8 => generated 1517 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:27:35.696014 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f54c802c-39bf-4b71-811e-352279c33ad7 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Calling method '.version_select at 0x7fc1301b81f0>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:35.771776 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f54c802c-39bf-4b71-811e-352279c33ad7 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] 10.222.0.52 "GET /compute/v2.1/images/ccff1b05-0698-450d-8019-09c754007fb9" status: 200 len: 1422 microversion: 2.1 time: 0.066467 Oct 19 03:27:35.771776 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1801/3536] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:27:35 2022] GET /compute/v2.1/images/ccff1b05-0698-450d-8019-09c754007fb9 => generated 1422 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:27:35.771776 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-507b65d7-bd69-4968-a16d-d2f35e84fb33 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:35.771776 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-507b65d7-bd69-4968-a16d-d2f35e84fb33 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 5cc2003b-73ef-4a54-a22d-9cef47c6ed3f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:35.779938 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-507b65d7-bd69-4968-a16d-d2f35e84fb33 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:35.780685 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-507b65d7-bd69-4968-a16d-d2f35e84fb33 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:35.781397 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-507b65d7-bd69-4968-a16d-d2f35e84fb33 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:35.782430 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-507b65d7-bd69-4968-a16d-d2f35e84fb33 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:35.783205 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-507b65d7-bd69-4968-a16d-d2f35e84fb33 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:35.783835 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-507b65d7-bd69-4968-a16d-d2f35e84fb33 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:36.520233 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-cb22b621-a6e7-4aae-a38f-d4d709b138be tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Flavor limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:27:36.520763 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-cb22b621-a6e7-4aae-a38f-d4d709b138be tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Image limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:27:36.521298 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-cb22b621-a6e7-4aae-a38f-d4d709b138be tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Flavor pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:27:36.521916 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-cb22b621-a6e7-4aae-a38f-d4d709b138be tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Image pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:27:36.522449 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-cb22b621-a6e7-4aae-a38f-d4d709b138be tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:27:36.552890 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cb22b621-a6e7-4aae-a38f-d4d709b138be tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:36.553784 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cb22b621-a6e7-4aae-a38f-d4d709b138be tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:36.555088 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cb22b621-a6e7-4aae-a38f-d4d709b138be tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:36.556051 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cb22b621-a6e7-4aae-a38f-d4d709b138be tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:36.556717 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cb22b621-a6e7-4aae-a38f-d4d709b138be tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:36.557321 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cb22b621-a6e7-4aae-a38f-d4d709b138be tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:36.641686 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-cb22b621-a6e7-4aae-a38f-d4d709b138be tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Getting quotas for project c4dfe251b1e046a995b8ec302cb2ffa0. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:27:36.650595 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-cb22b621-a6e7-4aae-a38f-d4d709b138be tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Getting quotas for user de2b0581ad4e4c9787bef838c81870a2 and project c4dfe251b1e046a995b8ec302cb2ffa0. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:27:36.668376 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-cb22b621-a6e7-4aae-a38f-d4d709b138be tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Going to run 1 instances... {{(pid=121134) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:27:36.671675 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-cb22b621-a6e7-4aae-a38f-d4d709b138be tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: 0051ff67-c0d0-4c84-a643-867d6416d8d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:27:36.698295 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-507b65d7-bd69-4968-a16d-d2f35e84fb33 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:27:36.710270 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-507b65d7-bd69-4968-a16d-d2f35e84fb33 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f" status: 200 len: 1717 microversion: 2.1 time: 0.946996 Oct 19 03:27:36.715600 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1802/3537] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:35 2022] GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f => generated 1717 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:27:36.723314 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4a2d970e-7fa8-4b7c-aab0-5d000b319155 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:36.724775 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4a2d970e-7fa8-4b7c-aab0-5d000b319155 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 5c23235b-b905-463f-bb7b-fef2a0381ed8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:36.731689 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4a2d970e-7fa8-4b7c-aab0-5d000b319155 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:36.732869 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4a2d970e-7fa8-4b7c-aab0-5d000b319155 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:36.733515 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4a2d970e-7fa8-4b7c-aab0-5d000b319155 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:36.734397 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4a2d970e-7fa8-4b7c-aab0-5d000b319155 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:36.735029 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4a2d970e-7fa8-4b7c-aab0-5d000b319155 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:36.735617 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4a2d970e-7fa8-4b7c-aab0-5d000b319155 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:36.957130 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-cb22b621-a6e7-4aae-a38f-d4d709b138be tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.939581 Oct 19 03:27:36.961004 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1736/3538] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:27:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 2945 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 03:27:37.029466 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4a2d970e-7fa8-4b7c-aab0-5d000b319155 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:27:37.051812 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4a2d970e-7fa8-4b7c-aab0-5d000b319155 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/5c23235b-b905-463f-bb7b-fef2a0381ed8" status: 200 len: 1475 microversion: 2.1 time: 0.334923 Oct 19 03:27:37.052723 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1803/3539] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:36 2022] GET /compute/v2.1/servers/5c23235b-b905-463f-bb7b-fef2a0381ed8 => generated 1475 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:27:37.075944 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-fc180dfa-5a81-4aac-aadb-f266b16627d8 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Calling method '.version_select at 0x7fc130025b80>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:37.155092 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-fc180dfa-5a81-4aac-aadb-f266b16627d8 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] 10.222.0.52 "GET /compute/v2.1/images/ccff1b05-0698-450d-8019-09c754007fb9" status: 200 len: 1422 microversion: 2.1 time: 0.101120 Oct 19 03:27:37.162255 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1804/3540] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:27:37 2022] GET /compute/v2.1/images/ccff1b05-0698-450d-8019-09c754007fb9 => generated 1422 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:27:37.171823 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-16158384-ec64-4170-a9b5-b2602cec94e7 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:37.172457 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-16158384-ec64-4170-a9b5-b2602cec94e7 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: 0051ff67-c0d0-4c84-a643-867d6416d8d1] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:37.340654 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-8aec500c-9763-4eef-b35a-ffb83e014f3f req-867ad802-8f32-4aaf-ae36-1a5fcc947183 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c23235b-b905-463f-bb7b-fef2a0381ed8", "name": "network-vif-deleted", "tag": "44ad91f0-f48c-4cd2-82f2-4ec973157955"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:27:37.388383 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-8aec500c-9763-4eef-b35a-ffb83e014f3f req-867ad802-8f32-4aaf-ae36-1a5fcc947183 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:37.389545 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-8aec500c-9763-4eef-b35a-ffb83e014f3f req-867ad802-8f32-4aaf-ae36-1a5fcc947183 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:37.390561 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-8aec500c-9763-4eef-b35a-ffb83e014f3f req-867ad802-8f32-4aaf-ae36-1a5fcc947183 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:37.439032 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-16158384-ec64-4170-a9b5-b2602cec94e7 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2b0581ad4e4c9787bef838c81870a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dfe251b1e046a995b8ec302cb2ffa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:27:37.444349 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-8aec500c-9763-4eef-b35a-ffb83e014f3f req-867ad802-8f32-4aaf-ae36-1a5fcc947183 service nova] Creating event network-vif-deleted:44ad91f0-f48c-4cd2-82f2-4ec973157955 for instance 5c23235b-b905-463f-bb7b-fef2a0381ed8 on n-h1-861333-8 Oct 19 03:27:37.456473 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-16158384-ec64-4170-a9b5-b2602cec94e7 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "GET /compute/v2.1/servers/0051ff67-c0d0-4c84-a643-867d6416d8d1" status: 200 len: 1215 microversion: 2.1 time: 0.290125 Oct 19 03:27:37.457132 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1805/3541] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:37 2022] GET /compute/v2.1/servers/0051ff67-c0d0-4c84-a643-867d6416d8d1 => generated 1215 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:27:37.459219 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-8aec500c-9763-4eef-b35a-ffb83e014f3f req-867ad802-8f32-4aaf-ae36-1a5fcc947183 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.493448 Oct 19 03:27:37.460875 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1737/3542] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:27:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:27:37.741543 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6d1e896d-2647-4cee-8a22-bc4e5cf3bbad tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:37.742371 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6d1e896d-2647-4cee-8a22-bc4e5cf3bbad tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 5cc2003b-73ef-4a54-a22d-9cef47c6ed3f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:37.765743 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6d1e896d-2647-4cee-8a22-bc4e5cf3bbad tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:37.765743 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6d1e896d-2647-4cee-8a22-bc4e5cf3bbad tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:37.765743 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6d1e896d-2647-4cee-8a22-bc4e5cf3bbad tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:37.795796 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6d1e896d-2647-4cee-8a22-bc4e5cf3bbad tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:37.796376 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6d1e896d-2647-4cee-8a22-bc4e5cf3bbad tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:37.799290 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6d1e896d-2647-4cee-8a22-bc4e5cf3bbad tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:38.082395 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-94f9f59c-f9e5-48f4-a6dd-d5ce4a6db188 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:38.089749 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-94f9f59c-f9e5-48f4-a6dd-d5ce4a6db188 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 5c23235b-b905-463f-bb7b-fef2a0381ed8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:38.098064 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-94f9f59c-f9e5-48f4-a6dd-d5ce4a6db188 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:38.098562 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-94f9f59c-f9e5-48f4-a6dd-d5ce4a6db188 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:38.099050 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-94f9f59c-f9e5-48f4-a6dd-d5ce4a6db188 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:38.104075 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-94f9f59c-f9e5-48f4-a6dd-d5ce4a6db188 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:38.105219 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-94f9f59c-f9e5-48f4-a6dd-d5ce4a6db188 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:38.105703 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-94f9f59c-f9e5-48f4-a6dd-d5ce4a6db188 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:38.151485 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-6d1e896d-2647-4cee-8a22-bc4e5cf3bbad tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:27:38.173197 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6d1e896d-2647-4cee-8a22-bc4e5cf3bbad tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f" status: 200 len: 1717 microversion: 2.1 time: 0.427290 Oct 19 03:27:38.193866 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1806/3543] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:37 2022] GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f => generated 1717 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:27:38.203834 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-87770f53-07ee-44c4-bc49-23ca9f791b56 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Calling method '.version_select at 0x7fc130015ca0>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:38.205327 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-94f9f59c-f9e5-48f4-a6dd-d5ce4a6db188 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:38.206717 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-94f9f59c-f9e5-48f4-a6dd-d5ce4a6db188 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:38.209394 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-94f9f59c-f9e5-48f4-a6dd-d5ce4a6db188 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:38.210130 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-94f9f59c-f9e5-48f4-a6dd-d5ce4a6db188 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lazy-loading 'fault' on Instance uuid 5c23235b-b905-463f-bb7b-fef2a0381ed8 {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:27:38.300711 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-87770f53-07ee-44c4-bc49-23ca9f791b56 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] 10.222.0.52 "GET /compute/v2.1/images/ccff1b05-0698-450d-8019-09c754007fb9" status: 200 len: 1422 microversion: 2.1 time: 0.104295 Oct 19 03:27:38.310264 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1807/3544] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:27:38 2022] GET /compute/v2.1/images/ccff1b05-0698-450d-8019-09c754007fb9 => generated 1422 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:27:38.366872 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-94f9f59c-f9e5-48f4-a6dd-d5ce4a6db188 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:27:38.385406 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-94f9f59c-f9e5-48f4-a6dd-d5ce4a6db188 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/5c23235b-b905-463f-bb7b-fef2a0381ed8" status: 200 len: 1320 microversion: 2.1 time: 0.305723 Oct 19 03:27:38.401601 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1738/3545] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:38 2022] GET /compute/v2.1/servers/5c23235b-b905-463f-bb7b-fef2a0381ed8 => generated 1320 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:27:38.485230 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b1b3e8b2-59d9-4d01-a5b5-b8e640c43619 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:38.485921 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b1b3e8b2-59d9-4d01-a5b5-b8e640c43619 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: 0051ff67-c0d0-4c84-a643-867d6416d8d1] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:38.650197 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b1b3e8b2-59d9-4d01-a5b5-b8e640c43619 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2b0581ad4e4c9787bef838c81870a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dfe251b1e046a995b8ec302cb2ffa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:27:38.662786 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b1b3e8b2-59d9-4d01-a5b5-b8e640c43619 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "GET /compute/v2.1/servers/0051ff67-c0d0-4c84-a643-867d6416d8d1" status: 200 len: 1215 microversion: 2.1 time: 0.180375 Oct 19 03:27:38.666216 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1808/3546] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:38 2022] GET /compute/v2.1/servers/0051ff67-c0d0-4c84-a643-867d6416d8d1 => generated 1215 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:27:39.203293 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a460f5ee-f753-40e0-ba47-0ff5470c2743 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:39.203929 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a460f5ee-f753-40e0-ba47-0ff5470c2743 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 5cc2003b-73ef-4a54-a22d-9cef47c6ed3f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:39.214011 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a460f5ee-f753-40e0-ba47-0ff5470c2743 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:39.219558 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a460f5ee-f753-40e0-ba47-0ff5470c2743 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:39.219985 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a460f5ee-f753-40e0-ba47-0ff5470c2743 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:39.221815 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a460f5ee-f753-40e0-ba47-0ff5470c2743 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:39.223125 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a460f5ee-f753-40e0-ba47-0ff5470c2743 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:39.225324 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a460f5ee-f753-40e0-ba47-0ff5470c2743 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:39.325687 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d3784dc4-d1f5-433d-bc41-fbfe75ed3d76 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Calling method '.version_select at 0x7fc1301b83a0>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:39.424732 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d3784dc4-d1f5-433d-bc41-fbfe75ed3d76 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] 10.222.0.52 "GET /compute/v2.1/images/ccff1b05-0698-450d-8019-09c754007fb9" status: 200 len: 1422 microversion: 2.1 time: 0.102929 Oct 19 03:27:39.425726 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1809/3547] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:27:39 2022] GET /compute/v2.1/images/ccff1b05-0698-450d-8019-09c754007fb9 => generated 1422 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:27:39.437461 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c72b4c97-9da3-40a7-a594-194e2c55762b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:39.438091 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c72b4c97-9da3-40a7-a594-194e2c55762b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 5c23235b-b905-463f-bb7b-fef2a0381ed8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:39.448878 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c72b4c97-9da3-40a7-a594-194e2c55762b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:39.454250 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c72b4c97-9da3-40a7-a594-194e2c55762b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:39.455018 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c72b4c97-9da3-40a7-a594-194e2c55762b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:39.455998 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c72b4c97-9da3-40a7-a594-194e2c55762b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:39.456689 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c72b4c97-9da3-40a7-a594-194e2c55762b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:39.457323 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c72b4c97-9da3-40a7-a594-194e2c55762b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:39.494118 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-c72b4c97-9da3-40a7-a594-194e2c55762b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] HTTP exception thrown: Instance 5c23235b-b905-463f-bb7b-fef2a0381ed8 could not be found. Oct 19 03:27:39.499261 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c72b4c97-9da3-40a7-a594-194e2c55762b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Request method failure captured: Oct 19 03:27:39.499261 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/5c23235b-b905-463f-bb7b-fef2a0381ed8 HTTP/1.1 Oct 19 03:27:39.499261 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:27:39.499261 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:27:39.499261 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:27:39.499261 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:27:39.499261 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:27:39.499261 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:27:39.499261 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:27:39.499261 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:27:39.499261 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT236feAW7aGPVoj9kEkUuQkRB8Nm9YBd70D85XbXnYqUAmlwAIPPx50C6dTRY9MbtBVt7IleIPYf6veKmIP1JclrFv3Px4uu5w7tRxEjRIxVTymsVviR-8HO1OxRuIfq2VSbST57MCBZOLAwnCIkIbO3ZT-DhhWvyFTRPdgvgRqqxa8 Oct 19 03:27:39.499261 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:27:39.499261 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:27:39.499261 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:27:39.499261 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:27:39.499261 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:27:39.499261 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:27:39.499261 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 7a836a10033546ed9a73a4f463587d72 Oct 19 03:27:39.499261 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ServersTestJSON-490256660 Oct 19 03:27:39.499261 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:27:39.499261 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:27:39.500770 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7a836a10033546ed9a73a4f463587d72"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7a836a10033546ed9a73a4f463587d72"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7a836a10033546ed9a73a4f463587d72"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7a836a10033546ed9a73a4f463587d72", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:27:39.500770 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ServersTestJSON-490256660 Oct 19 03:27:39.500770 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 7a836a10033546ed9a73a4f463587d72 Oct 19 03:27:39.500770 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ServersTestJSON-490256660 Oct 19 03:27:39.500770 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ServersTestJSON-490256660-project Oct 19 03:27:39.500770 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:27:39.500770 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:27:39.500770 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: b09d2eecd3d9419189e6308379fa8a09 Oct 19 03:27:39.500770 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ServersTestJSON-490256660-project Oct 19 03:27:39.500770 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:27:39.500770 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance 5c23235b-b905-463f-bb7b-fef2a0381ed8 could not be found. Oct 19 03:27:39.500770 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '5c23235b-b905-463f-bb7b-fef2a0381ed8'} Oct 19 03:27:39.501844 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:27:39.501844 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:27:39.501844 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:27:39.501844 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:27:39.501844 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:27:39.501844 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:27:39.501844 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:27:39.501844 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:27:39.501844 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:27:39.501844 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:27:39.501844 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c23235b-b905-463f-bb7b-fef2a0381ed8 could not be found. Oct 19 03:27:39.501844 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:27:39.501844 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:27:39.501844 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:27:39.501844 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:27:39.501844 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:27:39.501844 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:27:39.501844 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:27:39.501844 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:27:39.501844 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:27:39.503168 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:27:39.503168 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:27:39.503168 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:27:39.503168 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:27:39.503168 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:27:39.503168 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:27:39.503168 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:27:39.503168 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c23235b-b905-463f-bb7b-fef2a0381ed8 could not be found. Oct 19 03:27:39.503168 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:27:39.503168 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:27:39.503168 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:27:39.503168 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:27:39.503168 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:27:39.503168 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:27:39.503168 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:27:39.503168 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:27:39.503168 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c23235b-b905-463f-bb7b-fef2a0381ed8 could not be found. Oct 19 03:27:39.503168 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:27:39.508455 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c72b4c97-9da3-40a7-a594-194e2c55762b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Returning 404 to user: Instance 5c23235b-b905-463f-bb7b-fef2a0381ed8 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:27:39.509663 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c72b4c97-9da3-40a7-a594-194e2c55762b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/5c23235b-b905-463f-bb7b-fef2a0381ed8" status: 404 len: 111 microversion: 2.1 time: 0.082813 Oct 19 03:27:39.510431 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1810/3548] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:39 2022] GET /compute/v2.1/servers/5c23235b-b905-463f-bb7b-fef2a0381ed8 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:27:39.687070 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9139f413-f215-41cb-914e-fe81c0661322 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:39.687706 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9139f413-f215-41cb-914e-fe81c0661322 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: 0051ff67-c0d0-4c84-a643-867d6416d8d1] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:39.695754 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9139f413-f215-41cb-914e-fe81c0661322 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:39.696261 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9139f413-f215-41cb-914e-fe81c0661322 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:39.696712 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9139f413-f215-41cb-914e-fe81c0661322 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:39.701243 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9139f413-f215-41cb-914e-fe81c0661322 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:39.709152 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9139f413-f215-41cb-914e-fe81c0661322 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:39.710332 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9139f413-f215-41cb-914e-fe81c0661322 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:39.849583 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a460f5ee-f753-40e0-ba47-0ff5470c2743 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:27:39.863940 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a460f5ee-f753-40e0-ba47-0ff5470c2743 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f" status: 200 len: 1717 microversion: 2.1 time: 0.666063 Oct 19 03:27:39.866377 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1739/3549] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:39 2022] GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f => generated 1717 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:27:39.882402 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4eb2d1aa-5f57-4551-bc86-f7d5d9ae88cf tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-580546609", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "networks": [{"uuid": "05216dbc-056d-4707-86fe-afea9c8b3e8d"}]}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:27:39.916945 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-9139f413-f215-41cb-914e-fe81c0661322 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2b0581ad4e4c9787bef838c81870a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dfe251b1e046a995b8ec302cb2ffa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:27:39.928265 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9139f413-f215-41cb-914e-fe81c0661322 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "GET /compute/v2.1/servers/0051ff67-c0d0-4c84-a643-867d6416d8d1" status: 200 len: 1219 microversion: 2.1 time: 0.245192 Oct 19 03:27:39.935481 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1811/3550] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:39 2022] GET /compute/v2.1/servers/0051ff67-c0d0-4c84-a643-867d6416d8d1 => generated 1219 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:27:40.018266 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-4eb2d1aa-5f57-4551-bc86-f7d5d9ae88cf tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] validate_networks() for [('05216dbc-056d-4707-86fe-afea9c8b3e8d', None, None, None, None, None)] {{(pid=121134) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:27:40.440490 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5042b6cd-a72d-445d-83d4-88300cbc4f0e tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Calling method '.version_select at 0x7fc135173b80>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:40.516097 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5042b6cd-a72d-445d-83d4-88300cbc4f0e tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] 10.222.0.52 "GET /compute/v2.1/images/ccff1b05-0698-450d-8019-09c754007fb9" status: 200 len: 1422 microversion: 2.1 time: 0.079795 Oct 19 03:27:40.517326 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1812/3551] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:27:40 2022] GET /compute/v2.1/images/ccff1b05-0698-450d-8019-09c754007fb9 => generated 1422 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:27:40.827486 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-4eb2d1aa-5f57-4551-bc86-f7d5d9ae88cf tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Flavor limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:27:40.828729 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-4eb2d1aa-5f57-4551-bc86-f7d5d9ae88cf tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Image limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:27:40.830800 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-4eb2d1aa-5f57-4551-bc86-f7d5d9ae88cf tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Flavor pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:27:40.830800 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-4eb2d1aa-5f57-4551-bc86-f7d5d9ae88cf tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Image pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:27:40.830800 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-4eb2d1aa-5f57-4551-bc86-f7d5d9ae88cf tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:27:40.848542 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4eb2d1aa-5f57-4551-bc86-f7d5d9ae88cf tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:40.850561 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4eb2d1aa-5f57-4551-bc86-f7d5d9ae88cf tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:40.851008 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4eb2d1aa-5f57-4551-bc86-f7d5d9ae88cf tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:40.853953 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4eb2d1aa-5f57-4551-bc86-f7d5d9ae88cf tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:40.858706 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4eb2d1aa-5f57-4551-bc86-f7d5d9ae88cf tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:40.858706 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4eb2d1aa-5f57-4551-bc86-f7d5d9ae88cf tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:40.894082 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-4eb2d1aa-5f57-4551-bc86-f7d5d9ae88cf tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Getting quotas for project 7a836a10033546ed9a73a4f463587d72. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:27:40.900733 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-4eb2d1aa-5f57-4551-bc86-f7d5d9ae88cf tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Getting quotas for user b09d2eecd3d9419189e6308379fa8a09 and project 7a836a10033546ed9a73a4f463587d72. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:27:40.903470 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-40a32fc2-2e02-4c85-b097-a36b121501ad tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:40.904375 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-40a32fc2-2e02-4c85-b097-a36b121501ad tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 5cc2003b-73ef-4a54-a22d-9cef47c6ed3f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:40.919064 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4eb2d1aa-5f57-4551-bc86-f7d5d9ae88cf tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Going to run 1 instances... {{(pid=121134) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:27:40.922420 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4eb2d1aa-5f57-4551-bc86-f7d5d9ae88cf tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 3bb7abe9-5796-48da-bb31-aed0273716c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:27:40.942016 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-40a32fc2-2e02-4c85-b097-a36b121501ad tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:40.943818 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-40a32fc2-2e02-4c85-b097-a36b121501ad tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:40.945820 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-40a32fc2-2e02-4c85-b097-a36b121501ad tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:40.949214 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-40a32fc2-2e02-4c85-b097-a36b121501ad tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:40.952309 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-40a32fc2-2e02-4c85-b097-a36b121501ad tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:40.954368 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-40a32fc2-2e02-4c85-b097-a36b121501ad tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:41.108211 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4eb2d1aa-5f57-4551-bc86-f7d5d9ae88cf tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.239893 Oct 19 03:27:41.122478 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1740/3552] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:27:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1255 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 03:27:41.153163 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7f584b52-a07f-4408-ba5b-489606545ead tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:41.154863 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7f584b52-a07f-4408-ba5b-489606545ead tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: 0051ff67-c0d0-4c84-a643-867d6416d8d1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:41.189915 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7f584b52-a07f-4408-ba5b-489606545ead tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:41.194409 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7f584b52-a07f-4408-ba5b-489606545ead tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:41.195130 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7f584b52-a07f-4408-ba5b-489606545ead tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:41.210206 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7f584b52-a07f-4408-ba5b-489606545ead tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:41.210981 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7f584b52-a07f-4408-ba5b-489606545ead tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:41.211602 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7f584b52-a07f-4408-ba5b-489606545ead tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:41.503416 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-7f584b52-a07f-4408-ba5b-489606545ead tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2b0581ad4e4c9787bef838c81870a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dfe251b1e046a995b8ec302cb2ffa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:27:41.527357 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7f584b52-a07f-4408-ba5b-489606545ead tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "GET /compute/v2.1/servers/0051ff67-c0d0-4c84-a643-867d6416d8d1" status: 200 len: 1275 microversion: 2.1 time: 0.403242 Oct 19 03:27:41.541771 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1741/3553] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:41 2022] GET /compute/v2.1/servers/0051ff67-c0d0-4c84-a643-867d6416d8d1 => generated 1275 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:27:41.543470 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-72d3d69c-c0b3-4b54-9022-f4e4731d2b86 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:41.544184 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-72d3d69c-c0b3-4b54-9022-f4e4731d2b86 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 3bb7abe9-5796-48da-bb31-aed0273716c7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:41.748252 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-72d3d69c-c0b3-4b54-9022-f4e4731d2b86 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:27:41.757511 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-72d3d69c-c0b3-4b54-9022-f4e4731d2b86 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7" status: 200 len: 1208 microversion: 2.1 time: 0.221187 Oct 19 03:27:41.758937 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1742/3554] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:41 2022] GET /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7 => generated 1208 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:27:41.767573 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-32d4e5b7-dc01-4881-bb83-b69631849ab8 req-aae032ee-a477-408c-ade6-b0d3b7dfc9da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bfbe3fa-5e16-4b72-8232-7cf260c78f0a", "name": "network-vif-plugged", "status": "completed", "tag": "4cf986cf-c812-445d-9c71-bf2c9df9bf7f"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:27:41.800331 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-32d4e5b7-dc01-4881-bb83-b69631849ab8 req-aae032ee-a477-408c-ade6-b0d3b7dfc9da service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:41.808608 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-32d4e5b7-dc01-4881-bb83-b69631849ab8 req-aae032ee-a477-408c-ade6-b0d3b7dfc9da service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:41.808608 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-32d4e5b7-dc01-4881-bb83-b69631849ab8 req-aae032ee-a477-408c-ade6-b0d3b7dfc9da service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:41.822088 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-32d4e5b7-dc01-4881-bb83-b69631849ab8 req-aae032ee-a477-408c-ade6-b0d3b7dfc9da service nova] Creating event network-vif-plugged:4cf986cf-c812-445d-9c71-bf2c9df9bf7f for instance 3bfbe3fa-5e16-4b72-8232-7cf260c78f0a on n-h1-861333-8 Oct 19 03:27:41.829962 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-32d4e5b7-dc01-4881-bb83-b69631849ab8 req-aae032ee-a477-408c-ade6-b0d3b7dfc9da service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068387 Oct 19 03:27:41.842973 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1743/3555] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:27:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:27:41.847032 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2d2bba9e-24a0-4c89-b7f8-34a99070c7e0 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Calling method '.version_select at 0x7fc1303e3f70>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:41.904714 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2d2bba9e-24a0-4c89-b7f8-34a99070c7e0 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] 10.222.0.52 "GET /compute/v2.1/images/ccff1b05-0698-450d-8019-09c754007fb9" status: 200 len: 1422 microversion: 2.1 time: 0.062547 Oct 19 03:27:41.905642 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1744/3556] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:27:41 2022] GET /compute/v2.1/images/ccff1b05-0698-450d-8019-09c754007fb9 => generated 1422 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:27:41.930215 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-40a32fc2-2e02-4c85-b097-a36b121501ad tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:27:41.943973 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-40a32fc2-2e02-4c85-b097-a36b121501ad tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f" status: 200 len: 1717 microversion: 2.1 time: 1.052186 Oct 19 03:27:41.962943 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1813/3557] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:40 2022] GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f => generated 1717 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:27:42.586435 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-31e2ea26-2043-4324-bf6f-aad89303e884 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:42.587728 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-31e2ea26-2043-4324-bf6f-aad89303e884 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: 0051ff67-c0d0-4c84-a643-867d6416d8d1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:42.601201 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-31e2ea26-2043-4324-bf6f-aad89303e884 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:42.603741 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-31e2ea26-2043-4324-bf6f-aad89303e884 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:42.610769 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-31e2ea26-2043-4324-bf6f-aad89303e884 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:42.612265 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-31e2ea26-2043-4324-bf6f-aad89303e884 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:42.614264 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-31e2ea26-2043-4324-bf6f-aad89303e884 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:42.617072 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-31e2ea26-2043-4324-bf6f-aad89303e884 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:42.789383 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-64c96425-40cb-4a30-878a-43181c7ba5c1 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:42.794541 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-64c96425-40cb-4a30-878a-43181c7ba5c1 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 3bb7abe9-5796-48da-bb31-aed0273716c7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:42.811403 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-64c96425-40cb-4a30-878a-43181c7ba5c1 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:42.811919 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-64c96425-40cb-4a30-878a-43181c7ba5c1 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:42.816908 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-64c96425-40cb-4a30-878a-43181c7ba5c1 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:42.818217 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-64c96425-40cb-4a30-878a-43181c7ba5c1 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:42.821951 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-64c96425-40cb-4a30-878a-43181c7ba5c1 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:42.823940 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-64c96425-40cb-4a30-878a-43181c7ba5c1 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:43.232289 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-31e2ea26-2043-4324-bf6f-aad89303e884 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2b0581ad4e4c9787bef838c81870a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dfe251b1e046a995b8ec302cb2ffa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:27:43.246521 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-31e2ea26-2043-4324-bf6f-aad89303e884 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "GET /compute/v2.1/servers/0051ff67-c0d0-4c84-a643-867d6416d8d1" status: 200 len: 1273 microversion: 2.1 time: 0.687993 Oct 19 03:27:43.282657 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1745/3558] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:42 2022] GET /compute/v2.1/servers/0051ff67-c0d0-4c84-a643-867d6416d8d1 => generated 1273 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:27:43.297707 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c2bdc22a-5099-460e-9c77-27723bf40db1 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Calling method '.version_select at 0x7fc130503e50>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:43.323832 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-64c96425-40cb-4a30-878a-43181c7ba5c1 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:27:43.360575 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-64c96425-40cb-4a30-878a-43181c7ba5c1 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7" status: 200 len: 1212 microversion: 2.1 time: 0.580219 Oct 19 03:27:43.361264 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1814/3559] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:42 2022] GET /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7 => generated 1212 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:27:43.434352 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b25ba304-7072-4c15-a9bc-e1c718bd4e8c tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:43.435282 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b25ba304-7072-4c15-a9bc-e1c718bd4e8c tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 5cc2003b-73ef-4a54-a22d-9cef47c6ed3f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:43.461454 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c2bdc22a-5099-460e-9c77-27723bf40db1 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] 10.222.0.52 "GET /compute/v2.1/images/ccff1b05-0698-450d-8019-09c754007fb9" status: 200 len: 1422 microversion: 2.1 time: 0.174969 Oct 19 03:27:43.466010 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1746/3560] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:27:43 2022] GET /compute/v2.1/images/ccff1b05-0698-450d-8019-09c754007fb9 => generated 1422 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:27:43.473167 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b25ba304-7072-4c15-a9bc-e1c718bd4e8c tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:43.473167 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b25ba304-7072-4c15-a9bc-e1c718bd4e8c tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:43.473167 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b25ba304-7072-4c15-a9bc-e1c718bd4e8c tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:43.473167 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b25ba304-7072-4c15-a9bc-e1c718bd4e8c tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:43.474217 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b25ba304-7072-4c15-a9bc-e1c718bd4e8c tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:43.474217 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b25ba304-7072-4c15-a9bc-e1c718bd4e8c tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:44.280637 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-027493b0-0066-4e53-bbd2-c805755efe6f tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:44.281303 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-027493b0-0066-4e53-bbd2-c805755efe6f tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: 0051ff67-c0d0-4c84-a643-867d6416d8d1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:44.292352 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-027493b0-0066-4e53-bbd2-c805755efe6f tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:44.299369 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-027493b0-0066-4e53-bbd2-c805755efe6f tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:44.299819 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-027493b0-0066-4e53-bbd2-c805755efe6f tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:44.300682 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-027493b0-0066-4e53-bbd2-c805755efe6f tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:44.301220 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-027493b0-0066-4e53-bbd2-c805755efe6f tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:44.302215 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-027493b0-0066-4e53-bbd2-c805755efe6f tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:44.346662 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b25ba304-7072-4c15-a9bc-e1c718bd4e8c tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:27:44.362574 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:27:44.376214 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b25ba304-7072-4c15-a9bc-e1c718bd4e8c tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f" status: 200 len: 1717 microversion: 2.1 time: 0.981678 Oct 19 03:27:44.377256 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1815/3561] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:43 2022] GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f => generated 1717 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:27:44.402924 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-380f6c3d-ed40-405b-aef2-c9022e9ef766 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:44.403869 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-380f6c3d-ed40-405b-aef2-c9022e9ef766 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 3bb7abe9-5796-48da-bb31-aed0273716c7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:44.426205 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-380f6c3d-ed40-405b-aef2-c9022e9ef766 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:44.427808 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-380f6c3d-ed40-405b-aef2-c9022e9ef766 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:44.428447 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-380f6c3d-ed40-405b-aef2-c9022e9ef766 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:44.429384 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-380f6c3d-ed40-405b-aef2-c9022e9ef766 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:44.430054 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-380f6c3d-ed40-405b-aef2-c9022e9ef766 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:44.431501 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-380f6c3d-ed40-405b-aef2-c9022e9ef766 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:44.806855 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-380f6c3d-ed40-405b-aef2-c9022e9ef766 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:27:44.819250 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-380f6c3d-ed40-405b-aef2-c9022e9ef766 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7" status: 200 len: 1260 microversion: 2.1 time: 0.432503 Oct 19 03:27:44.821725 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1816/3562] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:44 2022] GET /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7 => generated 1260 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:27:44.834736 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5069d760-99de-4408-815d-2f7ebf01948f tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Calling method '.version_select at 0x7fc131963a60>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:44.961471 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5069d760-99de-4408-815d-2f7ebf01948f tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] 10.222.0.52 "GET /compute/v2.1/images/ccff1b05-0698-450d-8019-09c754007fb9" status: 200 len: 1422 microversion: 2.1 time: 0.138578 Oct 19 03:27:44.962482 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1817/3563] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:27:44 2022] GET /compute/v2.1/images/ccff1b05-0698-450d-8019-09c754007fb9 => generated 1422 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:27:45.135238 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-027493b0-0066-4e53-bbd2-c805755efe6f tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2b0581ad4e4c9787bef838c81870a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dfe251b1e046a995b8ec302cb2ffa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:27:45.147251 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-027493b0-0066-4e53-bbd2-c805755efe6f tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "GET /compute/v2.1/servers/0051ff67-c0d0-4c84-a643-867d6416d8d1" status: 200 len: 1315 microversion: 2.1 time: 0.872360 Oct 19 03:27:45.153445 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1747/3564] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:44 2022] GET /compute/v2.1/servers/0051ff67-c0d0-4c84-a643-867d6416d8d1 => generated 1315 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:27:45.402550 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2d19f70d-9a7d-4fce-9611-3899b282092d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:45.404771 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-2d19f70d-9a7d-4fce-9611-3899b282092d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 5cc2003b-73ef-4a54-a22d-9cef47c6ed3f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:45.414400 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2d19f70d-9a7d-4fce-9611-3899b282092d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:45.419257 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2d19f70d-9a7d-4fce-9611-3899b282092d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:45.419725 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2d19f70d-9a7d-4fce-9611-3899b282092d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:45.420477 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2d19f70d-9a7d-4fce-9611-3899b282092d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:45.420940 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2d19f70d-9a7d-4fce-9611-3899b282092d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:45.421400 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2d19f70d-9a7d-4fce-9611-3899b282092d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:45.849250 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-2d19f70d-9a7d-4fce-9611-3899b282092d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:27:45.855013 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c1dad8ab-ef93-4faa-b5c4-be67db844d5b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:45.855626 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c1dad8ab-ef93-4faa-b5c4-be67db844d5b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 3bb7abe9-5796-48da-bb31-aed0273716c7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:45.856274 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2d19f70d-9a7d-4fce-9611-3899b282092d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f" status: 200 len: 1717 microversion: 2.1 time: 0.458195 Oct 19 03:27:45.869774 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1818/3565] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:45 2022] GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f => generated 1717 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:27:45.885199 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c1dad8ab-ef93-4faa-b5c4-be67db844d5b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:45.894976 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c1dad8ab-ef93-4faa-b5c4-be67db844d5b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:45.896215 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c1dad8ab-ef93-4faa-b5c4-be67db844d5b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:45.899819 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c1dad8ab-ef93-4faa-b5c4-be67db844d5b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:45.900481 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c1dad8ab-ef93-4faa-b5c4-be67db844d5b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:45.903275 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c1dad8ab-ef93-4faa-b5c4-be67db844d5b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:45.977319 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c93f5b6f-cdb7-403b-b83a-d023c5363db1 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Calling method '.version_select at 0x7fc1305f4700>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:46.057420 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c93f5b6f-cdb7-403b-b83a-d023c5363db1 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] 10.222.0.52 "GET /compute/v2.1/images/ccff1b05-0698-450d-8019-09c754007fb9" status: 200 len: 1422 microversion: 2.1 time: 0.083702 Oct 19 03:27:46.057670 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1819/3566] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:27:45 2022] GET /compute/v2.1/images/ccff1b05-0698-450d-8019-09c754007fb9 => generated 1422 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:27:46.175041 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-fa3b72cf-3dd4-4bde-8926-efe216116566 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:46.175941 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-fa3b72cf-3dd4-4bde-8926-efe216116566 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: 0051ff67-c0d0-4c84-a643-867d6416d8d1] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:46.182668 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fa3b72cf-3dd4-4bde-8926-efe216116566 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:46.184025 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fa3b72cf-3dd4-4bde-8926-efe216116566 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:46.184636 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fa3b72cf-3dd4-4bde-8926-efe216116566 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:46.185605 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fa3b72cf-3dd4-4bde-8926-efe216116566 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:46.186229 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fa3b72cf-3dd4-4bde-8926-efe216116566 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:46.186807 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fa3b72cf-3dd4-4bde-8926-efe216116566 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:46.262915 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c1dad8ab-ef93-4faa-b5c4-be67db844d5b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:27:46.271771 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:27:46.275431 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c1dad8ab-ef93-4faa-b5c4-be67db844d5b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7" status: 200 len: 1266 microversion: 2.1 time: 0.424383 Oct 19 03:27:46.279339 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1748/3567] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:45 2022] GET /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7 => generated 1266 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:27:46.885102 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-fa3b72cf-3dd4-4bde-8926-efe216116566 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2b0581ad4e4c9787bef838c81870a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dfe251b1e046a995b8ec302cb2ffa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:27:46.891681 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-058cacd3-f604-424e-9b10-bf92b387b117 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:46.893743 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-058cacd3-f604-424e-9b10-bf92b387b117 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 5cc2003b-73ef-4a54-a22d-9cef47c6ed3f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:46.906285 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:27:46.907955 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-fa3b72cf-3dd4-4bde-8926-efe216116566 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "GET /compute/v2.1/servers/0051ff67-c0d0-4c84-a643-867d6416d8d1" status: 200 len: 1315 microversion: 2.1 time: 0.736945 Oct 19 03:27:46.912896 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1820/3568] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:46 2022] GET /compute/v2.1/servers/0051ff67-c0d0-4c84-a643-867d6416d8d1 => generated 1315 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:27:46.915431 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-058cacd3-f604-424e-9b10-bf92b387b117 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:46.916138 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-058cacd3-f604-424e-9b10-bf92b387b117 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:46.916756 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-058cacd3-f604-424e-9b10-bf92b387b117 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:46.917732 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-058cacd3-f604-424e-9b10-bf92b387b117 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:46.921157 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-058cacd3-f604-424e-9b10-bf92b387b117 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:46.922293 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-058cacd3-f604-424e-9b10-bf92b387b117 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:47.073909 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-43e5cee9-2acc-4b56-9e7d-10012db94928 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Calling method '.version_select at 0x7fc1305f4b80>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:47.142860 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-43e5cee9-2acc-4b56-9e7d-10012db94928 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] 10.222.0.52 "GET /compute/v2.1/images/ccff1b05-0698-450d-8019-09c754007fb9" status: 200 len: 1422 microversion: 2.1 time: 0.073926 Oct 19 03:27:47.143694 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1821/3569] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:27:47 2022] GET /compute/v2.1/images/ccff1b05-0698-450d-8019-09c754007fb9 => generated 1422 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:27:47.303339 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-35a42680-a9dc-4dd0-b443-769a1bec0444 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:47.303969 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-35a42680-a9dc-4dd0-b443-769a1bec0444 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 3bb7abe9-5796-48da-bb31-aed0273716c7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:47.319677 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-35a42680-a9dc-4dd0-b443-769a1bec0444 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:47.319677 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-35a42680-a9dc-4dd0-b443-769a1bec0444 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:47.319938 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-35a42680-a9dc-4dd0-b443-769a1bec0444 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:47.320549 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-35a42680-a9dc-4dd0-b443-769a1bec0444 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:47.321018 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-35a42680-a9dc-4dd0-b443-769a1bec0444 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:47.334156 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-35a42680-a9dc-4dd0-b443-769a1bec0444 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:47.947781 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-35a42680-a9dc-4dd0-b443-769a1bec0444 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:27:47.964487 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-35a42680-a9dc-4dd0-b443-769a1bec0444 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7" status: 200 len: 1266 microversion: 2.1 time: 0.663927 Oct 19 03:27:47.967077 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1822/3570] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:47 2022] GET /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7 => generated 1266 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:27:47.988121 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0b3aed25-e1af-4757-b89c-babf6d6f6cb6 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:47.990168 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0b3aed25-e1af-4757-b89c-babf6d6f6cb6 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: 0051ff67-c0d0-4c84-a643-867d6416d8d1] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:48.000395 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0b3aed25-e1af-4757-b89c-babf6d6f6cb6 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:48.001942 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0b3aed25-e1af-4757-b89c-babf6d6f6cb6 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:48.002941 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0b3aed25-e1af-4757-b89c-babf6d6f6cb6 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:48.003962 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0b3aed25-e1af-4757-b89c-babf6d6f6cb6 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:48.005050 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0b3aed25-e1af-4757-b89c-babf6d6f6cb6 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:48.005765 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0b3aed25-e1af-4757-b89c-babf6d6f6cb6 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:48.508892 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-058cacd3-f604-424e-9b10-bf92b387b117 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:27:48.528533 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-058cacd3-f604-424e-9b10-bf92b387b117 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f" status: 200 len: 1717 microversion: 2.1 time: 1.651637 Oct 19 03:27:48.529882 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1749/3571] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:46 2022] GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f => generated 1717 bytes in 1655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:27:48.537326 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7098aed1-de29-4543-952b-0a7fb34f44b4 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Calling method '.version_select at 0x7fc1300a03a0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:48.609173 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7098aed1-de29-4543-952b-0a7fb34f44b4 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] 10.222.0.52 "GET /compute/v2.1/images/ccff1b05-0698-450d-8019-09c754007fb9" status: 200 len: 1422 microversion: 2.1 time: 0.077120 Oct 19 03:27:48.617524 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1750/3572] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:27:48 2022] GET /compute/v2.1/images/ccff1b05-0698-450d-8019-09c754007fb9 => generated 1422 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:27:48.655055 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=4 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:27:48.750250 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-0b3aed25-e1af-4757-b89c-babf6d6f6cb6 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2b0581ad4e4c9787bef838c81870a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dfe251b1e046a995b8ec302cb2ffa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:27:48.760026 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0b3aed25-e1af-4757-b89c-babf6d6f6cb6 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "GET /compute/v2.1/servers/0051ff67-c0d0-4c84-a643-867d6416d8d1" status: 200 len: 1315 microversion: 2.1 time: 0.790316 Oct 19 03:27:48.764216 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1823/3573] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:47 2022] GET /compute/v2.1/servers/0051ff67-c0d0-4c84-a643-867d6416d8d1 => generated 1315 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:27:48.994051 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1b1a075c-04e6-4db6-97e1-b2f9b9a52c44 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:48.994711 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1b1a075c-04e6-4db6-97e1-b2f9b9a52c44 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 3bb7abe9-5796-48da-bb31-aed0273716c7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:49.015386 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1b1a075c-04e6-4db6-97e1-b2f9b9a52c44 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:49.020757 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1b1a075c-04e6-4db6-97e1-b2f9b9a52c44 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:49.023887 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1b1a075c-04e6-4db6-97e1-b2f9b9a52c44 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:49.025318 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1b1a075c-04e6-4db6-97e1-b2f9b9a52c44 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:49.029103 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1b1a075c-04e6-4db6-97e1-b2f9b9a52c44 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:49.032165 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1b1a075c-04e6-4db6-97e1-b2f9b9a52c44 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:49.438787 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2b931fe8-0560-4df3-8d70-ca4ebe883a4d tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Action: 'create', calling method: .version_select at 0x7fc1300253a0>, body: {"keypair": {"name": "tempest-keypair-876596665", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFf1zCAcSBAf7PMDeeSrE5qXq9ZhPV0fv5EDLipXMAQmmdqldsVdBV0PTYFRbo/CoFCBVy2F4iIgQ45z7+Hq+6UgUSrVoEQ8fQb0bOgEdjun5SPShzTUHkTsTFSZi9pNvw=="}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:27:49.506433 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-2b931fe8-0560-4df3-8d70-ca4ebe883a4d tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Getting quotas for project a5f56376721941f8ae2293f8f969db84. Resources: {'key_pairs'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:27:49.519361 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-2b931fe8-0560-4df3-8d70-ca4ebe883a4d tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Getting quotas for user 746e1034a7ee40c1a69c8838c1e17e16 and project a5f56376721941f8ae2293f8f969db84. Resources: {'key_pairs'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:27:49.671577 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2b931fe8-0560-4df3-8d70-ca4ebe883a4d tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.559248 Oct 19 03:27:49.672768 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1824/3574] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Oct 19 03:27:49 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:27:49.678453 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a81a0b3e-a9cd-4751-b60c-d262d4cae07b tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:49.681808 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a81a0b3e-a9cd-4751-b60c-d262d4cae07b tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 5cc2003b-73ef-4a54-a22d-9cef47c6ed3f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:49.697813 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a81a0b3e-a9cd-4751-b60c-d262d4cae07b tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:49.702140 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a81a0b3e-a9cd-4751-b60c-d262d4cae07b tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:49.704724 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a81a0b3e-a9cd-4751-b60c-d262d4cae07b tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:49.707542 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a81a0b3e-a9cd-4751-b60c-d262d4cae07b tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:49.708232 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a81a0b3e-a9cd-4751-b60c-d262d4cae07b tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:49.710802 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a81a0b3e-a9cd-4751-b60c-d262d4cae07b tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:50.186751 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-1b1a075c-04e6-4db6-97e1-b2f9b9a52c44 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:27:50.201478 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1b1a075c-04e6-4db6-97e1-b2f9b9a52c44 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7" status: 200 len: 1308 microversion: 2.1 time: 1.213745 Oct 19 03:27:50.202107 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1751/3575] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:48 2022] GET /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7 => generated 1308 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:27:50.213660 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-470755db-62b9-4ed4-8d98-22c91a907299 req-2370a67a-418f-43f5-83dd-5f47f37a2517 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0051ff67-c0d0-4c84-a643-867d6416d8d1", "tag": "21fd1481-24a3-4546-a0cb-b825ae11a779"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:27:50.239729 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-470755db-62b9-4ed4-8d98-22c91a907299 req-2370a67a-418f-43f5-83dd-5f47f37a2517 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:50.240229 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-470755db-62b9-4ed4-8d98-22c91a907299 req-2370a67a-418f-43f5-83dd-5f47f37a2517 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:50.240657 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-470755db-62b9-4ed4-8d98-22c91a907299 req-2370a67a-418f-43f5-83dd-5f47f37a2517 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:50.266316 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-470755db-62b9-4ed4-8d98-22c91a907299 req-2370a67a-418f-43f5-83dd-5f47f37a2517 service nova] Creating event network-changed:21fd1481-24a3-4546-a0cb-b825ae11a779 for instance 0051ff67-c0d0-4c84-a643-867d6416d8d1 on n-h2-861333-8 Oct 19 03:27:50.275991 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-470755db-62b9-4ed4-8d98-22c91a907299 req-2370a67a-418f-43f5-83dd-5f47f37a2517 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072645 Oct 19 03:27:50.281298 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1752/3576] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:27:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:27:50.297995 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1bc477b7-2aac-4db4-86bd-f3b6b4b3113c tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Calling method '.version_select at 0x7fc130503c10>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:50.395370 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1bc477b7-2aac-4db4-86bd-f3b6b4b3113c tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] 10.222.0.52 "GET /compute/v2.1/images/ccff1b05-0698-450d-8019-09c754007fb9" status: 200 len: 1422 microversion: 2.1 time: 0.108709 Oct 19 03:27:50.395969 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1753/3577] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:27:50 2022] GET /compute/v2.1/images/ccff1b05-0698-450d-8019-09c754007fb9 => generated 1422 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:27:50.406388 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e011d880-7bc8-4e4c-bab4-57a8af04a0b2 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:50.415648 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e011d880-7bc8-4e4c-bab4-57a8af04a0b2 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: 0051ff67-c0d0-4c84-a643-867d6416d8d1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:50.441472 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e011d880-7bc8-4e4c-bab4-57a8af04a0b2 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:50.447495 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e011d880-7bc8-4e4c-bab4-57a8af04a0b2 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:50.447495 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e011d880-7bc8-4e4c-bab4-57a8af04a0b2 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:50.447495 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e011d880-7bc8-4e4c-bab4-57a8af04a0b2 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:50.447495 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e011d880-7bc8-4e4c-bab4-57a8af04a0b2 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:50.447868 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e011d880-7bc8-4e4c-bab4-57a8af04a0b2 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:50.610475 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a81a0b3e-a9cd-4751-b60c-d262d4cae07b tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:27:50.625594 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a81a0b3e-a9cd-4751-b60c-d262d4cae07b tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f" status: 200 len: 1717 microversion: 2.1 time: 0.944959 Oct 19 03:27:50.626295 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1825/3578] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:49 2022] GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f => generated 1717 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:27:50.876897 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=4 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:27:51.235155 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-457e253e-af96-4d47-965c-951e0f610ed6 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:51.236048 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-457e253e-af96-4d47-965c-951e0f610ed6 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 3bb7abe9-5796-48da-bb31-aed0273716c7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:51.244120 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:27:51.248984 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-457e253e-af96-4d47-965c-951e0f610ed6 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:51.248984 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-457e253e-af96-4d47-965c-951e0f610ed6 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:51.248984 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-457e253e-af96-4d47-965c-951e0f610ed6 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:51.248984 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-457e253e-af96-4d47-965c-951e0f610ed6 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:51.249331 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-457e253e-af96-4d47-965c-951e0f610ed6 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:51.249331 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-457e253e-af96-4d47-965c-951e0f610ed6 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:51.312743 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e011d880-7bc8-4e4c-bab4-57a8af04a0b2 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2b0581ad4e4c9787bef838c81870a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dfe251b1e046a995b8ec302cb2ffa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:27:51.322772 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e011d880-7bc8-4e4c-bab4-57a8af04a0b2 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "GET /compute/v2.1/servers/0051ff67-c0d0-4c84-a643-867d6416d8d1" status: 200 len: 1315 microversion: 2.1 time: 0.925733 Oct 19 03:27:51.325704 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1754/3579] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:50 2022] GET /compute/v2.1/servers/0051ff67-c0d0-4c84-a643-867d6416d8d1 => generated 1315 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:27:51.413952 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-da624cc9-4e8e-42bc-afc1-082df72e7449 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Calling method '.version_select at 0x7fc130503040>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:51.538453 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-da624cc9-4e8e-42bc-afc1-082df72e7449 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] 10.222.0.52 "GET /compute/v2.1/images/ccff1b05-0698-450d-8019-09c754007fb9" status: 200 len: 1422 microversion: 2.1 time: 0.130728 Oct 19 03:27:51.539365 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1755/3580] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:27:51 2022] GET /compute/v2.1/images/ccff1b05-0698-450d-8019-09c754007fb9 => generated 1422 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:27:51.654523 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-03b9531f-0d50-410e-98c3-1fc8b0283731 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:51.655296 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-03b9531f-0d50-410e-98c3-1fc8b0283731 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 5cc2003b-73ef-4a54-a22d-9cef47c6ed3f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:51.670106 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-03b9531f-0d50-410e-98c3-1fc8b0283731 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:51.670748 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-03b9531f-0d50-410e-98c3-1fc8b0283731 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:51.673083 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-03b9531f-0d50-410e-98c3-1fc8b0283731 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:51.673083 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-03b9531f-0d50-410e-98c3-1fc8b0283731 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:51.673083 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-03b9531f-0d50-410e-98c3-1fc8b0283731 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:51.681523 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-03b9531f-0d50-410e-98c3-1fc8b0283731 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:51.772510 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=14 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:27:52.012782 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-457e253e-af96-4d47-965c-951e0f610ed6 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:27:52.012782 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-457e253e-af96-4d47-965c-951e0f610ed6 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7" status: 200 len: 1308 microversion: 2.1 time: 0.766608 Oct 19 03:27:52.012782 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1826/3581] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:51 2022] GET /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7 => generated 1308 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:27:52.208750 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-03b9531f-0d50-410e-98c3-1fc8b0283731 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:27:52.219381 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-03b9531f-0d50-410e-98c3-1fc8b0283731 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f" status: 200 len: 1717 microversion: 2.1 time: 0.569490 Oct 19 03:27:52.220660 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1756/3582] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:51 2022] GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f => generated 1717 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:27:52.296100 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-2686fb8d-934c-4314-b5b0-51b1ba740958 req-67f8b786-08e6-4802-a4cf-7e01ed9062c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cc2003b-73ef-4a54-a22d-9cef47c6ed3f", "name": "network-vif-unplugged", "status": "completed", "tag": "6c518d82-939f-43bb-ab5f-244d4b674bfe"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:27:52.306679 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-2686fb8d-934c-4314-b5b0-51b1ba740958 req-67f8b786-08e6-4802-a4cf-7e01ed9062c0 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:52.307169 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-2686fb8d-934c-4314-b5b0-51b1ba740958 req-67f8b786-08e6-4802-a4cf-7e01ed9062c0 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:52.307611 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-2686fb8d-934c-4314-b5b0-51b1ba740958 req-67f8b786-08e6-4802-a4cf-7e01ed9062c0 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:52.319552 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-2686fb8d-934c-4314-b5b0-51b1ba740958 req-67f8b786-08e6-4802-a4cf-7e01ed9062c0 service nova] Creating event network-vif-unplugged:6c518d82-939f-43bb-ab5f-244d4b674bfe for instance 5cc2003b-73ef-4a54-a22d-9cef47c6ed3f on n-h2-861333-8 Oct 19 03:27:52.324606 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-2686fb8d-934c-4314-b5b0-51b1ba740958 req-67f8b786-08e6-4802-a4cf-7e01ed9062c0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032202 Oct 19 03:27:52.325200 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1827/3583] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:27:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:27:52.349646 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-38f7c157-2a51-47ee-b83a-08a7a6e23675 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:52.350469 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-38f7c157-2a51-47ee-b83a-08a7a6e23675 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: 0051ff67-c0d0-4c84-a643-867d6416d8d1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:52.357263 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-38f7c157-2a51-47ee-b83a-08a7a6e23675 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:52.357888 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-38f7c157-2a51-47ee-b83a-08a7a6e23675 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:52.358697 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-38f7c157-2a51-47ee-b83a-08a7a6e23675 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:52.359435 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-38f7c157-2a51-47ee-b83a-08a7a6e23675 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:52.359949 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-38f7c157-2a51-47ee-b83a-08a7a6e23675 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:52.360399 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-38f7c157-2a51-47ee-b83a-08a7a6e23675 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:52.558192 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f03a9165-cbda-49dd-af18-8c36701ece43 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Calling method '.version_select at 0x7fc13004c550>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:52.673538 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f03a9165-cbda-49dd-af18-8c36701ece43 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] 10.222.0.52 "GET /compute/v2.1/images/ccff1b05-0698-450d-8019-09c754007fb9" status: 200 len: 1422 microversion: 2.1 time: 0.119489 Oct 19 03:27:52.674620 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1828/3584] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:27:52 2022] GET /compute/v2.1/images/ccff1b05-0698-450d-8019-09c754007fb9 => generated 1422 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:27:53.052870 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ae920596-340e-4c50-b937-12de491704dc tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:53.054088 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ae920596-340e-4c50-b937-12de491704dc tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 3bb7abe9-5796-48da-bb31-aed0273716c7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:53.069128 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ae920596-340e-4c50-b937-12de491704dc tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:53.069851 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ae920596-340e-4c50-b937-12de491704dc tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:53.070428 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ae920596-340e-4c50-b937-12de491704dc tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:53.076053 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ae920596-340e-4c50-b937-12de491704dc tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:53.077000 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ae920596-340e-4c50-b937-12de491704dc tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:53.077605 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ae920596-340e-4c50-b937-12de491704dc tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:53.396857 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-38f7c157-2a51-47ee-b83a-08a7a6e23675 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2b0581ad4e4c9787bef838c81870a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dfe251b1e046a995b8ec302cb2ffa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:27:53.408151 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-38f7c157-2a51-47ee-b83a-08a7a6e23675 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "GET /compute/v2.1/servers/0051ff67-c0d0-4c84-a643-867d6416d8d1" status: 200 len: 1315 microversion: 2.1 time: 1.062432 Oct 19 03:27:53.432925 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1757/3585] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:52 2022] GET /compute/v2.1/servers/0051ff67-c0d0-4c84-a643-867d6416d8d1 => generated 1315 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:27:53.438580 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e927eeb6-3fd8-4943-b754-753bc4380a68 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:53.443385 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e927eeb6-3fd8-4943-b754-753bc4380a68 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 5cc2003b-73ef-4a54-a22d-9cef47c6ed3f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:53.459860 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e927eeb6-3fd8-4943-b754-753bc4380a68 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:53.460684 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e927eeb6-3fd8-4943-b754-753bc4380a68 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:53.464364 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e927eeb6-3fd8-4943-b754-753bc4380a68 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:53.468362 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e927eeb6-3fd8-4943-b754-753bc4380a68 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:53.468362 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e927eeb6-3fd8-4943-b754-753bc4380a68 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:53.468362 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e927eeb6-3fd8-4943-b754-753bc4380a68 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:53.614664 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ae920596-340e-4c50-b937-12de491704dc tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:27:53.628585 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ae920596-340e-4c50-b937-12de491704dc tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7" status: 200 len: 1308 microversion: 2.1 time: 0.580727 Oct 19 03:27:53.629887 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1829/3586] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:53 2022] GET /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7 => generated 1308 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:27:53.690588 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c04c8e78-4277-441e-bf60-32b3366239bf tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Calling method '.version_select at 0x7fc1301b8ee0>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:53.776027 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c04c8e78-4277-441e-bf60-32b3366239bf tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] 10.222.0.52 "GET /compute/v2.1/images/ccff1b05-0698-450d-8019-09c754007fb9" status: 200 len: 1422 microversion: 2.1 time: 0.089920 Oct 19 03:27:53.786627 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1830/3587] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:27:53 2022] GET /compute/v2.1/images/ccff1b05-0698-450d-8019-09c754007fb9 => generated 1422 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:27:54.009751 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e927eeb6-3fd8-4943-b754-753bc4380a68 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:27:54.027270 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e927eeb6-3fd8-4943-b754-753bc4380a68 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f" status: 200 len: 1717 microversion: 2.1 time: 0.592735 Oct 19 03:27:54.030588 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1758/3588] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:53 2022] GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f => generated 1717 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:27:54.262999 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-97ee3ee7-4ffd-4de1-b6c1-d48c7e8be4ee req-fc030858-b454-493a-adfa-e092ec55cd40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3bb7abe9-5796-48da-bb31-aed0273716c7", "tag": "c632210a-428d-44d2-877e-fa2afcc8a7d8"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:27:54.290398 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-97ee3ee7-4ffd-4de1-b6c1-d48c7e8be4ee req-fc030858-b454-493a-adfa-e092ec55cd40 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:54.291161 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-97ee3ee7-4ffd-4de1-b6c1-d48c7e8be4ee req-fc030858-b454-493a-adfa-e092ec55cd40 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:54.291797 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-97ee3ee7-4ffd-4de1-b6c1-d48c7e8be4ee req-fc030858-b454-493a-adfa-e092ec55cd40 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:54.315251 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-97ee3ee7-4ffd-4de1-b6c1-d48c7e8be4ee req-fc030858-b454-493a-adfa-e092ec55cd40 service nova] Creating event network-changed:c632210a-428d-44d2-877e-fa2afcc8a7d8 for instance 3bb7abe9-5796-48da-bb31-aed0273716c7 on n-h1-861333-8 Oct 19 03:27:54.328547 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-97ee3ee7-4ffd-4de1-b6c1-d48c7e8be4ee req-fc030858-b454-493a-adfa-e092ec55cd40 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069216 Oct 19 03:27:54.333341 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1831/3589] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:27:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:27:54.439950 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c3365a75-a75f-4255-ba45-ae7c523efd4e tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:54.440580 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c3365a75-a75f-4255-ba45-ae7c523efd4e tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: 0051ff67-c0d0-4c84-a643-867d6416d8d1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:54.462524 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c3365a75-a75f-4255-ba45-ae7c523efd4e tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:54.463050 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c3365a75-a75f-4255-ba45-ae7c523efd4e tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:54.463510 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c3365a75-a75f-4255-ba45-ae7c523efd4e tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:54.464429 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c3365a75-a75f-4255-ba45-ae7c523efd4e tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:54.465081 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c3365a75-a75f-4255-ba45-ae7c523efd4e tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:54.465611 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c3365a75-a75f-4255-ba45-ae7c523efd4e tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:54.661245 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-142379a5-8b6c-40e7-8ade-8c2b6334ef0f tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:54.662076 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-142379a5-8b6c-40e7-8ade-8c2b6334ef0f tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 3bb7abe9-5796-48da-bb31-aed0273716c7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:54.676100 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-142379a5-8b6c-40e7-8ade-8c2b6334ef0f tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:54.677950 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-142379a5-8b6c-40e7-8ade-8c2b6334ef0f tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:54.678762 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-142379a5-8b6c-40e7-8ade-8c2b6334ef0f tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:54.681680 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-142379a5-8b6c-40e7-8ade-8c2b6334ef0f tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:54.682326 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-142379a5-8b6c-40e7-8ade-8c2b6334ef0f tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:54.684647 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-142379a5-8b6c-40e7-8ade-8c2b6334ef0f tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:55.331590 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-142379a5-8b6c-40e7-8ade-8c2b6334ef0f tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:27:55.340387 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-142379a5-8b6c-40e7-8ade-8c2b6334ef0f tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7" status: 200 len: 1308 microversion: 2.1 time: 0.686228 Oct 19 03:27:55.366038 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1832/3590] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:54 2022] GET /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7 => generated 1308 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:27:55.380005 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-573f5396-7132-4cb2-9545-bb25c5e4e8b2 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Calling method '.version_select at 0x7fc130c77d30>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:55.444566 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-573f5396-7132-4cb2-9545-bb25c5e4e8b2 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] 10.222.0.52 "GET /compute/v2.1/images/ccff1b05-0698-450d-8019-09c754007fb9" status: 200 len: 1422 microversion: 2.1 time: 0.077222 Oct 19 03:27:55.456017 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1833/3591] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:27:55 2022] GET /compute/v2.1/images/ccff1b05-0698-450d-8019-09c754007fb9 => generated 1422 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:27:55.462281 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4097e97c-92fa-4b83-ad96-d979bcc8548a tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:55.463067 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4097e97c-92fa-4b83-ad96-d979bcc8548a tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 5cc2003b-73ef-4a54-a22d-9cef47c6ed3f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:55.474181 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4097e97c-92fa-4b83-ad96-d979bcc8548a tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:55.475074 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4097e97c-92fa-4b83-ad96-d979bcc8548a tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:55.475711 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4097e97c-92fa-4b83-ad96-d979bcc8548a tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:55.477101 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4097e97c-92fa-4b83-ad96-d979bcc8548a tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:55.478271 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4097e97c-92fa-4b83-ad96-d979bcc8548a tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:55.478880 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4097e97c-92fa-4b83-ad96-d979bcc8548a tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:55.515412 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c3365a75-a75f-4255-ba45-ae7c523efd4e tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2b0581ad4e4c9787bef838c81870a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dfe251b1e046a995b8ec302cb2ffa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:27:55.532987 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c3365a75-a75f-4255-ba45-ae7c523efd4e tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "GET /compute/v2.1/servers/0051ff67-c0d0-4c84-a643-867d6416d8d1" status: 200 len: 1315 microversion: 2.1 time: 1.099790 Oct 19 03:27:55.536434 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1759/3592] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:54 2022] GET /compute/v2.1/servers/0051ff67-c0d0-4c84-a643-867d6416d8d1 => generated 1315 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:27:56.124966 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4097e97c-92fa-4b83-ad96-d979bcc8548a tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:27:56.135822 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4097e97c-92fa-4b83-ad96-d979bcc8548a tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f" status: 200 len: 1717 microversion: 2.1 time: 0.678429 Oct 19 03:27:56.137825 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1834/3593] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:55 2022] GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f => generated 1717 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:27:56.386556 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6533eb21-11c9-4cff-bc03-4062eb75af5b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:56.387553 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6533eb21-11c9-4cff-bc03-4062eb75af5b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 3bb7abe9-5796-48da-bb31-aed0273716c7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:56.423245 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6533eb21-11c9-4cff-bc03-4062eb75af5b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:56.425942 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6533eb21-11c9-4cff-bc03-4062eb75af5b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:56.430093 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6533eb21-11c9-4cff-bc03-4062eb75af5b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:56.434867 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6533eb21-11c9-4cff-bc03-4062eb75af5b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:56.435608 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6533eb21-11c9-4cff-bc03-4062eb75af5b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:56.439443 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6533eb21-11c9-4cff-bc03-4062eb75af5b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:56.494498 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c391207a-7be2-42ff-a57d-7db941dd3815 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Calling method '.version_select at 0x7fc13008c4c0>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:56.576461 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c391207a-7be2-42ff-a57d-7db941dd3815 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] 10.222.0.52 "GET /compute/v2.1/images/ccff1b05-0698-450d-8019-09c754007fb9" status: 200 len: 1422 microversion: 2.1 time: 0.118617 Oct 19 03:27:56.577356 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1835/3594] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:27:56 2022] GET /compute/v2.1/images/ccff1b05-0698-450d-8019-09c754007fb9 => generated 1422 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:27:56.589875 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a0e324de-03e8-4939-a9ea-ea36e4749894 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:56.596545 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a0e324de-03e8-4939-a9ea-ea36e4749894 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: 0051ff67-c0d0-4c84-a643-867d6416d8d1] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:56.630098 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a0e324de-03e8-4939-a9ea-ea36e4749894 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:56.631133 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a0e324de-03e8-4939-a9ea-ea36e4749894 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:56.631361 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a0e324de-03e8-4939-a9ea-ea36e4749894 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:56.636649 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a0e324de-03e8-4939-a9ea-ea36e4749894 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:56.637110 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a0e324de-03e8-4939-a9ea-ea36e4749894 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:56.637590 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a0e324de-03e8-4939-a9ea-ea36e4749894 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:57.252608 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-6533eb21-11c9-4cff-bc03-4062eb75af5b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:27:57.262461 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6533eb21-11c9-4cff-bc03-4062eb75af5b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7" status: 200 len: 1308 microversion: 2.1 time: 0.885971 Oct 19 03:27:57.284036 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1760/3595] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:56 2022] GET /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7 => generated 1308 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:27:57.284388 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a0e324de-03e8-4939-a9ea-ea36e4749894 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2b0581ad4e4c9787bef838c81870a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dfe251b1e046a995b8ec302cb2ffa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:27:57.290210 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-aae4ae0a-1084-413e-9d1a-0b6689ac6c80 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:57.291163 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-aae4ae0a-1084-413e-9d1a-0b6689ac6c80 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 5cc2003b-73ef-4a54-a22d-9cef47c6ed3f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:57.307868 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a0e324de-03e8-4939-a9ea-ea36e4749894 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "GET /compute/v2.1/servers/0051ff67-c0d0-4c84-a643-867d6416d8d1" status: 200 len: 1315 microversion: 2.1 time: 0.728720 Oct 19 03:27:57.318934 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-aae4ae0a-1084-413e-9d1a-0b6689ac6c80 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:57.321858 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-aae4ae0a-1084-413e-9d1a-0b6689ac6c80 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:57.323780 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-aae4ae0a-1084-413e-9d1a-0b6689ac6c80 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:57.326271 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-aae4ae0a-1084-413e-9d1a-0b6689ac6c80 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:57.326711 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1836/3596] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:56 2022] GET /compute/v2.1/servers/0051ff67-c0d0-4c84-a643-867d6416d8d1 => generated 1315 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:27:57.334167 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-aae4ae0a-1084-413e-9d1a-0b6689ac6c80 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:57.338298 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-aae4ae0a-1084-413e-9d1a-0b6689ac6c80 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:57.562075 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-4b38f088-3484-4767-882a-aeb39d826d8e req-f2a7ba6a-03e1-4236-a357-47e1dab0bcd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5cc2003b-73ef-4a54-a22d-9cef47c6ed3f", "tag": "6c518d82-939f-43bb-ab5f-244d4b674bfe"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:27:57.604155 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-4b38f088-3484-4767-882a-aeb39d826d8e req-f2a7ba6a-03e1-4236-a357-47e1dab0bcd2 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:57.606166 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-4b38f088-3484-4767-882a-aeb39d826d8e req-f2a7ba6a-03e1-4236-a357-47e1dab0bcd2 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:57.608796 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-4b38f088-3484-4767-882a-aeb39d826d8e req-f2a7ba6a-03e1-4236-a357-47e1dab0bcd2 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:57.647769 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-4b38f088-3484-4767-882a-aeb39d826d8e req-f2a7ba6a-03e1-4236-a357-47e1dab0bcd2 service nova] Creating event network-changed:6c518d82-939f-43bb-ab5f-244d4b674bfe for instance 5cc2003b-73ef-4a54-a22d-9cef47c6ed3f on n-h2-861333-8 Oct 19 03:27:57.666145 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-4b38f088-3484-4767-882a-aeb39d826d8e req-f2a7ba6a-03e1-4236-a357-47e1dab0bcd2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111972 Oct 19 03:27:57.670288 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1837/3597] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:27:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:27:57.690881 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e2399168-840c-4c42-b54a-a39ad18ba6cc tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Calling method '.version_select at 0x7fc13012f5e0>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:57.761704 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e2399168-840c-4c42-b54a-a39ad18ba6cc tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] 10.222.0.52 "GET /compute/v2.1/images/ccff1b05-0698-450d-8019-09c754007fb9" status: 200 len: 1422 microversion: 2.1 time: 0.087523 Oct 19 03:27:57.762578 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1838/3598] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:27:57 2022] GET /compute/v2.1/images/ccff1b05-0698-450d-8019-09c754007fb9 => generated 1422 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:27:57.842260 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-aae4ae0a-1084-413e-9d1a-0b6689ac6c80 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:27:57.851377 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-aae4ae0a-1084-413e-9d1a-0b6689ac6c80 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f" status: 200 len: 1717 microversion: 2.1 time: 0.565502 Oct 19 03:27:57.855665 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1761/3599] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:57 2022] GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f => generated 1717 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:27:58.295261 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-569abf3e-0c37-47b2-b1ee-81b5eb7e3599 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:58.296033 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-569abf3e-0c37-47b2-b1ee-81b5eb7e3599 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 3bb7abe9-5796-48da-bb31-aed0273716c7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:58.306844 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-569abf3e-0c37-47b2-b1ee-81b5eb7e3599 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:58.315135 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-569abf3e-0c37-47b2-b1ee-81b5eb7e3599 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:58.318113 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-569abf3e-0c37-47b2-b1ee-81b5eb7e3599 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:58.321049 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-569abf3e-0c37-47b2-b1ee-81b5eb7e3599 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:58.323658 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-569abf3e-0c37-47b2-b1ee-81b5eb7e3599 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:58.324539 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-569abf3e-0c37-47b2-b1ee-81b5eb7e3599 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:58.336654 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-622e20a7-9e5c-425d-b20f-942145b94acc tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:58.337917 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-622e20a7-9e5c-425d-b20f-942145b94acc tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: 0051ff67-c0d0-4c84-a643-867d6416d8d1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:58.354196 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-622e20a7-9e5c-425d-b20f-942145b94acc tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:58.355022 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-622e20a7-9e5c-425d-b20f-942145b94acc tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:58.355472 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-622e20a7-9e5c-425d-b20f-942145b94acc tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:58.356240 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-622e20a7-9e5c-425d-b20f-942145b94acc tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:58.356698 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-622e20a7-9e5c-425d-b20f-942145b94acc tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:58.357130 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-622e20a7-9e5c-425d-b20f-942145b94acc tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:59.070129 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-569abf3e-0c37-47b2-b1ee-81b5eb7e3599 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:27:59.081213 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-622e20a7-9e5c-425d-b20f-942145b94acc tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2b0581ad4e4c9787bef838c81870a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dfe251b1e046a995b8ec302cb2ffa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:27:59.082327 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-569abf3e-0c37-47b2-b1ee-81b5eb7e3599 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7" status: 200 len: 1308 microversion: 2.1 time: 0.790824 Oct 19 03:27:59.088444 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1839/3600] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:58 2022] GET /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7 => generated 1308 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:27:59.096832 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-66d61609-e1d4-44f1-b132-a3853f8b229b tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Calling method '.version_select at 0x7fc130245820>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:59.127217 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-622e20a7-9e5c-425d-b20f-942145b94acc tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "GET /compute/v2.1/servers/0051ff67-c0d0-4c84-a643-867d6416d8d1" status: 200 len: 1315 microversion: 2.1 time: 0.794832 Oct 19 03:27:59.129958 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1762/3601] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:58 2022] GET /compute/v2.1/servers/0051ff67-c0d0-4c84-a643-867d6416d8d1 => generated 1315 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:27:59.137386 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-860cc125-ef1f-4001-baf6-146cbb8a70fa tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:27:59.142306 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-860cc125-ef1f-4001-baf6-146cbb8a70fa tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 5cc2003b-73ef-4a54-a22d-9cef47c6ed3f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:27:59.163612 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-860cc125-ef1f-4001-baf6-146cbb8a70fa tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:59.165022 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-860cc125-ef1f-4001-baf6-146cbb8a70fa tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:59.170625 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-860cc125-ef1f-4001-baf6-146cbb8a70fa tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:59.170625 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-860cc125-ef1f-4001-baf6-146cbb8a70fa tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:27:59.170625 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-860cc125-ef1f-4001-baf6-146cbb8a70fa tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:27:59.170625 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-860cc125-ef1f-4001-baf6-146cbb8a70fa tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:27:59.190930 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-66d61609-e1d4-44f1-b132-a3853f8b229b tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] 10.222.0.52 "GET /compute/v2.1/images/ccff1b05-0698-450d-8019-09c754007fb9" status: 200 len: 1422 microversion: 2.1 time: 0.101106 Oct 19 03:27:59.191554 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1840/3602] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:27:59 2022] GET /compute/v2.1/images/ccff1b05-0698-450d-8019-09c754007fb9 => generated 1422 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:27:59.527140 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-860cc125-ef1f-4001-baf6-146cbb8a70fa tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:27:59.547780 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-860cc125-ef1f-4001-baf6-146cbb8a70fa tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f" status: 200 len: 1717 microversion: 2.1 time: 0.416085 Oct 19 03:27:59.561885 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1763/3603] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:27:59 2022] GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f => generated 1717 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:00.037610 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=4 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:28:00.045584 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-36985bbf-4c43-4e9f-ba5e-e9310158e235 req-026c4050-f15e-45de-a391-f76faee86c74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0051ff67-c0d0-4c84-a643-867d6416d8d1", "name": "network-vif-plugged", "status": "completed", "tag": "21fd1481-24a3-4546-a0cb-b825ae11a779"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:28:00.064870 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-36985bbf-4c43-4e9f-ba5e-e9310158e235 req-026c4050-f15e-45de-a391-f76faee86c74 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:00.065363 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-36985bbf-4c43-4e9f-ba5e-e9310158e235 req-026c4050-f15e-45de-a391-f76faee86c74 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:00.065834 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-36985bbf-4c43-4e9f-ba5e-e9310158e235 req-026c4050-f15e-45de-a391-f76faee86c74 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:00.089987 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-36985bbf-4c43-4e9f-ba5e-e9310158e235 req-026c4050-f15e-45de-a391-f76faee86c74 service nova] Creating event network-vif-plugged:21fd1481-24a3-4546-a0cb-b825ae11a779 for instance 0051ff67-c0d0-4c84-a643-867d6416d8d1 on n-h2-861333-8 Oct 19 03:28:00.096157 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-36985bbf-4c43-4e9f-ba5e-e9310158e235 req-026c4050-f15e-45de-a391-f76faee86c74 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059226 Oct 19 03:28:00.101728 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1841/3604] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:28:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:28:00.133753 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-87b359ab-852e-4433-9ee6-4c7f55c0e5b4 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:00.136306 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-87b359ab-852e-4433-9ee6-4c7f55c0e5b4 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 3bb7abe9-5796-48da-bb31-aed0273716c7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:00.145609 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-87b359ab-852e-4433-9ee6-4c7f55c0e5b4 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:00.147029 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-87b359ab-852e-4433-9ee6-4c7f55c0e5b4 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:00.149411 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-87b359ab-852e-4433-9ee6-4c7f55c0e5b4 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:00.150508 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-87b359ab-852e-4433-9ee6-4c7f55c0e5b4 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:00.152283 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-87b359ab-852e-4433-9ee6-4c7f55c0e5b4 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:00.152995 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-87b359ab-852e-4433-9ee6-4c7f55c0e5b4 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:00.161944 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-94af59ac-045f-4422-ac29-8371a2281dba tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:00.163241 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-94af59ac-045f-4422-ac29-8371a2281dba tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: 0051ff67-c0d0-4c84-a643-867d6416d8d1] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:00.188361 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-94af59ac-045f-4422-ac29-8371a2281dba tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:00.194448 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-94af59ac-045f-4422-ac29-8371a2281dba tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:00.195302 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-94af59ac-045f-4422-ac29-8371a2281dba tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:00.197714 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-94af59ac-045f-4422-ac29-8371a2281dba tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:00.201748 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-94af59ac-045f-4422-ac29-8371a2281dba tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:00.202550 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-94af59ac-045f-4422-ac29-8371a2281dba tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:00.598597 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-94af59ac-045f-4422-ac29-8371a2281dba tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2b0581ad4e4c9787bef838c81870a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dfe251b1e046a995b8ec302cb2ffa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:28:00.609709 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-94af59ac-045f-4422-ac29-8371a2281dba tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "GET /compute/v2.1/servers/0051ff67-c0d0-4c84-a643-867d6416d8d1" status: 200 len: 1315 microversion: 2.1 time: 0.452519 Oct 19 03:28:00.617671 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1842/3605] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:00 2022] GET /compute/v2.1/servers/0051ff67-c0d0-4c84-a643-867d6416d8d1 => generated 1315 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:28:00.622815 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b6b72d13-793d-4e67-a1c0-c3117cc2e86e tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Calling method '.version_select at 0x7fc130017af0>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:00.736765 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b6b72d13-793d-4e67-a1c0-c3117cc2e86e tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] 10.222.0.52 "GET /compute/v2.1/images/ccff1b05-0698-450d-8019-09c754007fb9" status: 200 len: 1422 microversion: 2.1 time: 0.117633 Oct 19 03:28:00.746816 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1843/3606] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:28:00 2022] GET /compute/v2.1/images/ccff1b05-0698-450d-8019-09c754007fb9 => generated 1422 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:00.750390 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b168c5d5-d930-497e-b0ad-80460bcddab9 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:00.752700 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b168c5d5-d930-497e-b0ad-80460bcddab9 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 5cc2003b-73ef-4a54-a22d-9cef47c6ed3f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:00.767710 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b168c5d5-d930-497e-b0ad-80460bcddab9 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:00.770362 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b168c5d5-d930-497e-b0ad-80460bcddab9 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:00.770604 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b168c5d5-d930-497e-b0ad-80460bcddab9 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:00.771266 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b168c5d5-d930-497e-b0ad-80460bcddab9 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:00.771991 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b168c5d5-d930-497e-b0ad-80460bcddab9 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:00.772715 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b168c5d5-d930-497e-b0ad-80460bcddab9 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:00.777420 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-87b359ab-852e-4433-9ee6-4c7f55c0e5b4 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:28:00.791359 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-87b359ab-852e-4433-9ee6-4c7f55c0e5b4 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7" status: 200 len: 1308 microversion: 2.1 time: 0.680441 Oct 19 03:28:00.803923 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1764/3607] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:00 2022] GET /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7 => generated 1308 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:01.092260 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b168c5d5-d930-497e-b0ad-80460bcddab9 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:28:01.107904 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-723eb7bf-723f-47b5-ad66-73d65439ce7c tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1458538645", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6b668808-7c3c-40ac-9532-ec2c53b84149"}], "security_groups": [{"name": "tempest-securitygroup--1326686642"}], "key_name": "tempest-keypair-876596665", "user_data": "}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:28:01.114718 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b168c5d5-d930-497e-b0ad-80460bcddab9 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f" status: 200 len: 1717 microversion: 2.1 time: 0.374503 Oct 19 03:28:01.115881 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1844/3608] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:00 2022] GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f => generated 1717 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:01.266861 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-723eb7bf-723f-47b5-ad66-73d65439ce7c tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] validate_networks() for [('6b668808-7c3c-40ac-9532-ec2c53b84149', None, None, None, None, None)] {{(pid=121134) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:28:01.643904 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7683aa5b-20c9-4683-9c04-d65964e0eaa9 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:01.645413 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7683aa5b-20c9-4683-9c04-d65964e0eaa9 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: 0051ff67-c0d0-4c84-a643-867d6416d8d1] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:01.674954 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7683aa5b-20c9-4683-9c04-d65964e0eaa9 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:01.680968 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7683aa5b-20c9-4683-9c04-d65964e0eaa9 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:01.681833 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7683aa5b-20c9-4683-9c04-d65964e0eaa9 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:01.685168 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7683aa5b-20c9-4683-9c04-d65964e0eaa9 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:01.691012 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7683aa5b-20c9-4683-9c04-d65964e0eaa9 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:01.692856 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7683aa5b-20c9-4683-9c04-d65964e0eaa9 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:02.007389 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7683aa5b-20c9-4683-9c04-d65964e0eaa9 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2b0581ad4e4c9787bef838c81870a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dfe251b1e046a995b8ec302cb2ffa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:28:02.015852 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7683aa5b-20c9-4683-9c04-d65964e0eaa9 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "GET /compute/v2.1/servers/0051ff67-c0d0-4c84-a643-867d6416d8d1" status: 200 len: 1315 microversion: 2.1 time: 0.377132 Oct 19 03:28:02.019963 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1845/3609] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:01 2022] GET /compute/v2.1/servers/0051ff67-c0d0-4c84-a643-867d6416d8d1 => generated 1315 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:02.027080 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-98b110a0-7ec1-411c-b695-ee633c1d444d tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Calling method '.version_select at 0x7fc135193e50>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:02.037197 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-723eb7bf-723f-47b5-ad66-73d65439ce7c tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Flavor limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:28:02.037802 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-723eb7bf-723f-47b5-ad66-73d65439ce7c tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Image limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:28:02.038153 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-723eb7bf-723f-47b5-ad66-73d65439ce7c tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Flavor pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:28:02.038567 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-723eb7bf-723f-47b5-ad66-73d65439ce7c tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Image pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:28:02.038985 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-723eb7bf-723f-47b5-ad66-73d65439ce7c tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:28:02.054030 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-723eb7bf-723f-47b5-ad66-73d65439ce7c tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:02.054604 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-723eb7bf-723f-47b5-ad66-73d65439ce7c tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:02.055051 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-723eb7bf-723f-47b5-ad66-73d65439ce7c tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:02.056252 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-723eb7bf-723f-47b5-ad66-73d65439ce7c tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:02.056854 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-723eb7bf-723f-47b5-ad66-73d65439ce7c tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:02.057346 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-723eb7bf-723f-47b5-ad66-73d65439ce7c tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:02.077018 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-723eb7bf-723f-47b5-ad66-73d65439ce7c tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Getting quotas for project a5f56376721941f8ae2293f8f969db84. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:28:02.085691 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-723eb7bf-723f-47b5-ad66-73d65439ce7c tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Getting quotas for user 746e1034a7ee40c1a69c8838c1e17e16 and project a5f56376721941f8ae2293f8f969db84. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:28:02.101742 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-723eb7bf-723f-47b5-ad66-73d65439ce7c tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Going to run 1 instances... {{(pid=121134) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:28:02.104559 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-723eb7bf-723f-47b5-ad66-73d65439ce7c tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:28:02.145895 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-98b110a0-7ec1-411c-b695-ee633c1d444d tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] 10.222.0.52 "GET /compute/v2.1/images/ccff1b05-0698-450d-8019-09c754007fb9" status: 200 len: 1422 microversion: 2.1 time: 0.124300 Oct 19 03:28:02.155296 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1846/3610] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:28:02 2022] GET /compute/v2.1/images/ccff1b05-0698-450d-8019-09c754007fb9 => generated 1422 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:02.174943 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9a6e660d-c135-46f9-a5e2-14d2d71a36d5 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:02.176003 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9a6e660d-c135-46f9-a5e2-14d2d71a36d5 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 3bb7abe9-5796-48da-bb31-aed0273716c7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:02.192796 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9a6e660d-c135-46f9-a5e2-14d2d71a36d5 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:02.193908 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9a6e660d-c135-46f9-a5e2-14d2d71a36d5 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:02.194622 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9a6e660d-c135-46f9-a5e2-14d2d71a36d5 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:02.196347 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9a6e660d-c135-46f9-a5e2-14d2d71a36d5 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:02.198488 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9a6e660d-c135-46f9-a5e2-14d2d71a36d5 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:02.199108 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9a6e660d-c135-46f9-a5e2-14d2d71a36d5 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:02.228745 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=100 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:28:02.319874 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-723eb7bf-723f-47b5-ad66-73d65439ce7c tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.217705 Oct 19 03:28:02.327066 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1765/3611] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:28:01 2022] POST /compute/v2.1/servers => generated 409 bytes in 1226 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 03:28:02.335530 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-56b79c06-5c4f-4f20-839c-e33394e24896 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:02.336395 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-56b79c06-5c4f-4f20-839c-e33394e24896 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 5cc2003b-73ef-4a54-a22d-9cef47c6ed3f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:02.345783 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-56b79c06-5c4f-4f20-839c-e33394e24896 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:02.346508 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-56b79c06-5c4f-4f20-839c-e33394e24896 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:02.347111 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-56b79c06-5c4f-4f20-839c-e33394e24896 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:02.348641 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-56b79c06-5c4f-4f20-839c-e33394e24896 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:02.349335 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-56b79c06-5c4f-4f20-839c-e33394e24896 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:02.350153 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-56b79c06-5c4f-4f20-839c-e33394e24896 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:02.569116 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-9a6e660d-c135-46f9-a5e2-14d2d71a36d5 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:28:02.597882 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9a6e660d-c135-46f9-a5e2-14d2d71a36d5 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7" status: 200 len: 1308 microversion: 2.1 time: 0.427968 Oct 19 03:28:02.603872 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1847/3612] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:02 2022] GET /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7 => generated 1308 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:02.612594 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-bac73abf-3c05-45a2-b859-cb92fcd5ae07 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:02.625216 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-bac73abf-3c05-45a2-b859-cb92fcd5ae07 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:02.795639 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-56b79c06-5c4f-4f20-839c-e33394e24896 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:28:02.815519 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-bac73abf-3c05-45a2-b859-cb92fcd5ae07 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:28:02.819112 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-56b79c06-5c4f-4f20-839c-e33394e24896 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f" status: 200 len: 1717 microversion: 2.1 time: 0.476482 Oct 19 03:28:02.833417 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1766/3613] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:02 2022] GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f => generated 1717 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:02.833729 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-bac73abf-3c05-45a2-b859-cb92fcd5ae07 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1238 microversion: 2.1 time: 0.217889 Oct 19 03:28:02.833729 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1848/3614] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:02 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1238 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:03.056948 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c739adb7-3d44-4678-9ca9-de7d35eac392 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:03.061123 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c739adb7-3d44-4678-9ca9-de7d35eac392 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: 0051ff67-c0d0-4c84-a643-867d6416d8d1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:03.077127 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c739adb7-3d44-4678-9ca9-de7d35eac392 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:03.078440 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c739adb7-3d44-4678-9ca9-de7d35eac392 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:03.080684 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c739adb7-3d44-4678-9ca9-de7d35eac392 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:03.081745 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c739adb7-3d44-4678-9ca9-de7d35eac392 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:03.083479 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c739adb7-3d44-4678-9ca9-de7d35eac392 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:03.085827 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c739adb7-3d44-4678-9ca9-de7d35eac392 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:03.161976 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f1534780-0ef9-4ff2-9081-d41c69f4293d tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Calling method '.version_select at 0x7fc12bfa53a0>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:03.260951 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f1534780-0ef9-4ff2-9081-d41c69f4293d tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] 10.222.0.52 "GET /compute/v2.1/images/ccff1b05-0698-450d-8019-09c754007fb9" status: 200 len: 1422 microversion: 2.1 time: 0.102732 Oct 19 03:28:03.277415 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1849/3615] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:28:03 2022] GET /compute/v2.1/images/ccff1b05-0698-450d-8019-09c754007fb9 => generated 1422 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:03.281574 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f1534780-0ef9-4ff2-9081-d41c69f4293d tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:03.285157 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f1534780-0ef9-4ff2-9081-d41c69f4293d tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] 10.222.0.52 "GET /compute//" status: 200 len: 377 microversion: - time: 0.004178 Oct 19 03:28:03.293771 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1850/3616] 10.222.0.52 () {56 vars in 886 bytes} [Wed Oct 19 03:28:03 2022] GET /compute/ => generated 377 bytes in 15 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 19 03:28:03.423468 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c739adb7-3d44-4678-9ca9-de7d35eac392 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2b0581ad4e4c9787bef838c81870a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dfe251b1e046a995b8ec302cb2ffa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:28:03.440245 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c739adb7-3d44-4678-9ca9-de7d35eac392 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "GET /compute/v2.1/servers/0051ff67-c0d0-4c84-a643-867d6416d8d1" status: 200 len: 1505 microversion: 2.1 time: 0.395382 Oct 19 03:28:03.441183 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1767/3617] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:03 2022] GET /compute/v2.1/servers/0051ff67-c0d0-4c84-a643-867d6416d8d1 => generated 1505 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:03.470246 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-95117869-fbce-41b4-bb2f-9b3b5dad2f32 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:03.470982 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-95117869-fbce-41b4-bb2f-9b3b5dad2f32 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: 0051ff67-c0d0-4c84-a643-867d6416d8d1] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:03.484387 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-95117869-fbce-41b4-bb2f-9b3b5dad2f32 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:03.492760 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-95117869-fbce-41b4-bb2f-9b3b5dad2f32 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:03.496252 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-95117869-fbce-41b4-bb2f-9b3b5dad2f32 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:03.499951 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-95117869-fbce-41b4-bb2f-9b3b5dad2f32 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:03.502653 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-95117869-fbce-41b4-bb2f-9b3b5dad2f32 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:03.506085 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-95117869-fbce-41b4-bb2f-9b3b5dad2f32 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:03.614827 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d8979a61-9a52-4801-9a9c-ff10583248ae tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:03.615447 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d8979a61-9a52-4801-9a9c-ff10583248ae tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 3bb7abe9-5796-48da-bb31-aed0273716c7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:03.623717 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d8979a61-9a52-4801-9a9c-ff10583248ae tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:03.629382 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d8979a61-9a52-4801-9a9c-ff10583248ae tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:03.630146 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d8979a61-9a52-4801-9a9c-ff10583248ae tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:03.631142 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d8979a61-9a52-4801-9a9c-ff10583248ae tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:03.631838 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d8979a61-9a52-4801-9a9c-ff10583248ae tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:03.632469 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d8979a61-9a52-4801-9a9c-ff10583248ae tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:03.879900 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-95117869-fbce-41b4-bb2f-9b3b5dad2f32 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2b0581ad4e4c9787bef838c81870a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dfe251b1e046a995b8ec302cb2ffa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:28:03.898181 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-95117869-fbce-41b4-bb2f-9b3b5dad2f32 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "GET /compute/v2.1/servers/0051ff67-c0d0-4c84-a643-867d6416d8d1" status: 200 len: 1505 microversion: 2.1 time: 0.432727 Oct 19 03:28:03.900691 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1851/3618] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:03 2022] GET /compute/v2.1/servers/0051ff67-c0d0-4c84-a643-867d6416d8d1 => generated 1505 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:03.904775 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-33607c94-c194-4569-8852-74dd057183ed tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:03.905404 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-33607c94-c194-4569-8852-74dd057183ed tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:04.401151 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-33607c94-c194-4569-8852-74dd057183ed tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:28:04.411983 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-33607c94-c194-4569-8852-74dd057183ed tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1238 microversion: 2.1 time: 0.509623 Oct 19 03:28:04.411983 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1852/3619] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:03 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1238 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:04.420647 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7d3006ea-4eac-4039-af76-a260a0880893 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:04.427155 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7d3006ea-4eac-4039-af76-a260a0880893 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 5cc2003b-73ef-4a54-a22d-9cef47c6ed3f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:04.448583 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7d3006ea-4eac-4039-af76-a260a0880893 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:04.449450 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7d3006ea-4eac-4039-af76-a260a0880893 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:04.450152 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7d3006ea-4eac-4039-af76-a260a0880893 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:04.451087 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7d3006ea-4eac-4039-af76-a260a0880893 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:04.451752 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7d3006ea-4eac-4039-af76-a260a0880893 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:04.452384 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7d3006ea-4eac-4039-af76-a260a0880893 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:04.546871 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d8979a61-9a52-4801-9a9c-ff10583248ae tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:28:04.569756 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d8979a61-9a52-4801-9a9c-ff10583248ae tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7" status: 200 len: 1308 microversion: 2.1 time: 0.958106 Oct 19 03:28:04.619780 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1768/3620] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:03 2022] GET /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7 => generated 1308 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:04.640771 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3fbc7d12-d351-4134-8f07-0318dd5ea52b tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "OS-DCF:diskConfig": "AUTO"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:28:04.658853 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3fbc7d12-d351-4134-8f07-0318dd5ea52b tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: 0051ff67-c0d0-4c84-a643-867d6416d8d1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:04.687958 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3fbc7d12-d351-4134-8f07-0318dd5ea52b tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:04.689975 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3fbc7d12-d351-4134-8f07-0318dd5ea52b tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:04.694311 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3fbc7d12-d351-4134-8f07-0318dd5ea52b tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:04.695519 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3fbc7d12-d351-4134-8f07-0318dd5ea52b tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:04.700515 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3fbc7d12-d351-4134-8f07-0318dd5ea52b tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:04.701284 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3fbc7d12-d351-4134-8f07-0318dd5ea52b tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:04.746484 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7d3006ea-4eac-4039-af76-a260a0880893 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:28:04.766377 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7d3006ea-4eac-4039-af76-a260a0880893 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f" status: 200 len: 1717 microversion: 2.1 time: 0.345432 Oct 19 03:28:04.769176 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1853/3621] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:04 2022] GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f => generated 1717 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:04.776696 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-54d31119-2457-4360-b3ae-719939822543 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Calling method '.version_select at 0x7fc130bbce50>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:04.900669 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=100 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:28:04.903513 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-54d31119-2457-4360-b3ae-719939822543 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] 10.222.0.52 "GET /compute/v2.1/images/ccff1b05-0698-450d-8019-09c754007fb9" status: 200 len: 1422 microversion: 2.1 time: 0.130595 Oct 19 03:28:04.904117 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1854/3622] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:28:04 2022] GET /compute/v2.1/images/ccff1b05-0698-450d-8019-09c754007fb9 => generated 1422 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:04.918032 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-3fbc7d12-d351-4134-8f07-0318dd5ea52b tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Flavor limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:28:04.918765 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-3fbc7d12-d351-4134-8f07-0318dd5ea52b tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Image limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:28:04.919283 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-3fbc7d12-d351-4134-8f07-0318dd5ea52b tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Flavor pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:28:04.919713 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-3fbc7d12-d351-4134-8f07-0318dd5ea52b tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Image pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:28:04.920133 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-3fbc7d12-d351-4134-8f07-0318dd5ea52b tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:28:05.149140 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3fbc7d12-d351-4134-8f07-0318dd5ea52b tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: 0051ff67-c0d0-4c84-a643-867d6416d8d1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:05.162680 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3fbc7d12-d351-4134-8f07-0318dd5ea52b tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:05.163194 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3fbc7d12-d351-4134-8f07-0318dd5ea52b tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:05.163646 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3fbc7d12-d351-4134-8f07-0318dd5ea52b tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:05.166631 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3fbc7d12-d351-4134-8f07-0318dd5ea52b tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:05.167116 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3fbc7d12-d351-4134-8f07-0318dd5ea52b tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:05.167576 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3fbc7d12-d351-4134-8f07-0318dd5ea52b tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:05.209608 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3fbc7d12-d351-4134-8f07-0318dd5ea52b tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "POST /compute/v2.1/servers/0051ff67-c0d0-4c84-a643-867d6416d8d1/action" status: 202 len: 1107 microversion: 2.1 time: 0.588532 Oct 19 03:28:05.210712 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1769/3623] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:28:04 2022] POST /compute/v2.1/servers/0051ff67-c0d0-4c84-a643-867d6416d8d1/action => generated 1107 bytes in 590 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 19 03:28:05.244572 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-bc5679ad-84a8-466b-8b19-139dd8a93f05 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:05.244572 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-bc5679ad-84a8-466b-8b19-139dd8a93f05 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: 0051ff67-c0d0-4c84-a643-867d6416d8d1] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:05.256450 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bc5679ad-84a8-466b-8b19-139dd8a93f05 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:05.257364 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bc5679ad-84a8-466b-8b19-139dd8a93f05 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:05.258765 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bc5679ad-84a8-466b-8b19-139dd8a93f05 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:05.260550 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bc5679ad-84a8-466b-8b19-139dd8a93f05 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:05.260716 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bc5679ad-84a8-466b-8b19-139dd8a93f05 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:05.262061 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bc5679ad-84a8-466b-8b19-139dd8a93f05 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:05.437984 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5894dff4-3441-4ff5-9c7f-cb87b04bf078 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:05.438792 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5894dff4-3441-4ff5-9c7f-cb87b04bf078 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:05.454402 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5894dff4-3441-4ff5-9c7f-cb87b04bf078 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:05.455488 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5894dff4-3441-4ff5-9c7f-cb87b04bf078 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:05.456826 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5894dff4-3441-4ff5-9c7f-cb87b04bf078 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:05.459276 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5894dff4-3441-4ff5-9c7f-cb87b04bf078 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:05.459992 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5894dff4-3441-4ff5-9c7f-cb87b04bf078 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:05.466567 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5894dff4-3441-4ff5-9c7f-cb87b04bf078 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:05.662365 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-bc5679ad-84a8-466b-8b19-139dd8a93f05 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2b0581ad4e4c9787bef838c81870a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dfe251b1e046a995b8ec302cb2ffa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:28:05.681063 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-bc5679ad-84a8-466b-8b19-139dd8a93f05 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "GET /compute/v2.1/servers/0051ff67-c0d0-4c84-a643-867d6416d8d1" status: 200 len: 1512 microversion: 2.1 time: 0.450075 Oct 19 03:28:05.684521 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1855/3624] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:05 2022] GET /compute/v2.1/servers/0051ff67-c0d0-4c84-a643-867d6416d8d1 => generated 1512 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:05.702903 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-890fada8-7974-4200-a47d-8afde1349ce6 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:05.704425 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-890fada8-7974-4200-a47d-8afde1349ce6 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 3bb7abe9-5796-48da-bb31-aed0273716c7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:05.715927 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-890fada8-7974-4200-a47d-8afde1349ce6 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:05.722248 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-890fada8-7974-4200-a47d-8afde1349ce6 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:05.725665 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-890fada8-7974-4200-a47d-8afde1349ce6 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:05.726168 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5894dff4-3441-4ff5-9c7f-cb87b04bf078 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:28:05.726654 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-890fada8-7974-4200-a47d-8afde1349ce6 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:05.729648 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-890fada8-7974-4200-a47d-8afde1349ce6 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:05.732057 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-890fada8-7974-4200-a47d-8afde1349ce6 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:05.736404 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5894dff4-3441-4ff5-9c7f-cb87b04bf078 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1290 microversion: 2.1 time: 0.302764 Oct 19 03:28:05.743335 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1770/3625] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:05 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1290 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:28:05.808995 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b8151aac-c26e-403a-94d1-000432c67101 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:05.810723 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b8151aac-c26e-403a-94d1-000432c67101 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 5cc2003b-73ef-4a54-a22d-9cef47c6ed3f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:05.823375 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b8151aac-c26e-403a-94d1-000432c67101 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:05.824630 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b8151aac-c26e-403a-94d1-000432c67101 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:05.825479 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b8151aac-c26e-403a-94d1-000432c67101 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:05.827720 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b8151aac-c26e-403a-94d1-000432c67101 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:05.828352 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b8151aac-c26e-403a-94d1-000432c67101 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:05.829178 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b8151aac-c26e-403a-94d1-000432c67101 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:06.376495 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-890fada8-7974-4200-a47d-8afde1349ce6 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:28:06.407002 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-890fada8-7974-4200-a47d-8afde1349ce6 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7" status: 200 len: 1308 microversion: 2.1 time: 0.717852 Oct 19 03:28:06.427983 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1856/3626] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:05 2022] GET /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7 => generated 1308 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:06.431594 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2f2356c8-66ba-4cb4-92c6-21f902ad5222 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Calling method '.version_select at 0x7fc130c2d5e0>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:06.506755 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2f2356c8-66ba-4cb4-92c6-21f902ad5222 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] 10.222.0.52 "GET /compute/v2.1/images/ccff1b05-0698-450d-8019-09c754007fb9" status: 200 len: 1422 microversion: 2.1 time: 0.091213 Oct 19 03:28:06.507659 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1857/3627] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:28:06 2022] GET /compute/v2.1/images/ccff1b05-0698-450d-8019-09c754007fb9 => generated 1422 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:06.522896 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-6e9f9826-092c-4f62-a263-f46614aae6c9 req-b6376ae3-5ea1-411b-9876-51ae7037586d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bb7abe9-5796-48da-bb31-aed0273716c7", "name": "network-vif-plugged", "status": "completed", "tag": "c632210a-428d-44d2-877e-fa2afcc8a7d8"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:28:06.553897 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-6e9f9826-092c-4f62-a263-f46614aae6c9 req-b6376ae3-5ea1-411b-9876-51ae7037586d service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:06.559060 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-6e9f9826-092c-4f62-a263-f46614aae6c9 req-b6376ae3-5ea1-411b-9876-51ae7037586d service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:06.559742 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-6e9f9826-092c-4f62-a263-f46614aae6c9 req-b6376ae3-5ea1-411b-9876-51ae7037586d service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:06.585273 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-6e9f9826-092c-4f62-a263-f46614aae6c9 req-b6376ae3-5ea1-411b-9876-51ae7037586d service nova] Creating event network-vif-plugged:c632210a-428d-44d2-877e-fa2afcc8a7d8 for instance 3bb7abe9-5796-48da-bb31-aed0273716c7 on n-h1-861333-8 Oct 19 03:28:06.598760 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-6e9f9826-092c-4f62-a263-f46614aae6c9 req-b6376ae3-5ea1-411b-9876-51ae7037586d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079633 Oct 19 03:28:06.600618 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1858/3628] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:28:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:28:06.651982 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b8151aac-c26e-403a-94d1-000432c67101 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:28:06.669537 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b8151aac-c26e-403a-94d1-000432c67101 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f" status: 200 len: 1717 microversion: 2.1 time: 0.865789 Oct 19 03:28:06.671791 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1771/3629] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:05 2022] GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f => generated 1717 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:06.710510 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9caa8ab8-8792-4d96-a7f5-92c23b85ac9e tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:06.711247 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9caa8ab8-8792-4d96-a7f5-92c23b85ac9e tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: 0051ff67-c0d0-4c84-a643-867d6416d8d1] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:06.727518 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9caa8ab8-8792-4d96-a7f5-92c23b85ac9e tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:06.728044 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9caa8ab8-8792-4d96-a7f5-92c23b85ac9e tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:06.728564 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9caa8ab8-8792-4d96-a7f5-92c23b85ac9e tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:06.729291 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9caa8ab8-8792-4d96-a7f5-92c23b85ac9e tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:06.729790 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9caa8ab8-8792-4d96-a7f5-92c23b85ac9e tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:06.730230 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9caa8ab8-8792-4d96-a7f5-92c23b85ac9e tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:06.768401 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-83159220-aa7b-41e0-97d7-77fe745dcb55 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:06.778145 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-83159220-aa7b-41e0-97d7-77fe745dcb55 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:06.794716 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-83159220-aa7b-41e0-97d7-77fe745dcb55 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:06.795671 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-83159220-aa7b-41e0-97d7-77fe745dcb55 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:06.796907 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-83159220-aa7b-41e0-97d7-77fe745dcb55 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:06.801527 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-83159220-aa7b-41e0-97d7-77fe745dcb55 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:06.802926 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-83159220-aa7b-41e0-97d7-77fe745dcb55 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:06.803677 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-83159220-aa7b-41e0-97d7-77fe745dcb55 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:07.006064 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-83159220-aa7b-41e0-97d7-77fe745dcb55 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:28:07.014248 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-83159220-aa7b-41e0-97d7-77fe745dcb55 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1298 microversion: 2.1 time: 0.252699 Oct 19 03:28:07.028048 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1772/3630] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:06 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1298 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:07.305705 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-9caa8ab8-8792-4d96-a7f5-92c23b85ac9e tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2b0581ad4e4c9787bef838c81870a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dfe251b1e046a995b8ec302cb2ffa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:28:07.322652 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9caa8ab8-8792-4d96-a7f5-92c23b85ac9e tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "GET /compute/v2.1/servers/0051ff67-c0d0-4c84-a643-867d6416d8d1" status: 200 len: 1512 microversion: 2.1 time: 0.618340 Oct 19 03:28:07.323576 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1859/3631] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:06 2022] GET /compute/v2.1/servers/0051ff67-c0d0-4c84-a643-867d6416d8d1 => generated 1512 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:07.435963 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-18b72f34-a7f4-40d1-b658-05464bd2b1d6 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:07.441636 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-18b72f34-a7f4-40d1-b658-05464bd2b1d6 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 3bb7abe9-5796-48da-bb31-aed0273716c7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:07.447482 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-18b72f34-a7f4-40d1-b658-05464bd2b1d6 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:07.448253 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-18b72f34-a7f4-40d1-b658-05464bd2b1d6 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:07.448931 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-18b72f34-a7f4-40d1-b658-05464bd2b1d6 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:07.450072 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-18b72f34-a7f4-40d1-b658-05464bd2b1d6 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:07.451505 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-18b72f34-a7f4-40d1-b658-05464bd2b1d6 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:07.452205 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-18b72f34-a7f4-40d1-b658-05464bd2b1d6 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:07.523933 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-33ebb489-d03e-4987-bdf4-f01dddb3914f tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Calling method '.version_select at 0x7fc130207670>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:07.580855 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-33ebb489-d03e-4987-bdf4-f01dddb3914f tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] 10.222.0.52 "GET /compute/v2.1/images/ccff1b05-0698-450d-8019-09c754007fb9" status: 200 len: 1422 microversion: 2.1 time: 0.061424 Oct 19 03:28:07.590476 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1860/3632] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:28:07 2022] GET /compute/v2.1/images/ccff1b05-0698-450d-8019-09c754007fb9 => generated 1422 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:07.720326 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-455037b0-f0f9-48f8-9120-89c5e0db7b14 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:07.724012 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-455037b0-f0f9-48f8-9120-89c5e0db7b14 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 5cc2003b-73ef-4a54-a22d-9cef47c6ed3f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:07.731227 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-455037b0-f0f9-48f8-9120-89c5e0db7b14 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:07.732276 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-455037b0-f0f9-48f8-9120-89c5e0db7b14 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:07.732791 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-455037b0-f0f9-48f8-9120-89c5e0db7b14 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:07.733721 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-455037b0-f0f9-48f8-9120-89c5e0db7b14 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:07.734358 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-455037b0-f0f9-48f8-9120-89c5e0db7b14 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:07.734827 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-455037b0-f0f9-48f8-9120-89c5e0db7b14 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:08.093540 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-18b72f34-a7f4-40d1-b658-05464bd2b1d6 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:28:08.109885 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-18b72f34-a7f4-40d1-b658-05464bd2b1d6 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7" status: 200 len: 1308 microversion: 2.1 time: 0.677632 Oct 19 03:28:08.110848 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1773/3633] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:07 2022] GET /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7 => generated 1308 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:08.116432 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-75d2a2f4-2ad2-4282-ba6e-723bbacc4c54 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:08.120451 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-75d2a2f4-2ad2-4282-ba6e-723bbacc4c54 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:08.132213 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-75d2a2f4-2ad2-4282-ba6e-723bbacc4c54 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:08.132736 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-75d2a2f4-2ad2-4282-ba6e-723bbacc4c54 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:08.133189 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-75d2a2f4-2ad2-4282-ba6e-723bbacc4c54 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:08.133999 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-75d2a2f4-2ad2-4282-ba6e-723bbacc4c54 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:08.134454 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-75d2a2f4-2ad2-4282-ba6e-723bbacc4c54 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:08.134890 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-75d2a2f4-2ad2-4282-ba6e-723bbacc4c54 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:08.313745 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-455037b0-f0f9-48f8-9120-89c5e0db7b14 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:28:08.323582 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-455037b0-f0f9-48f8-9120-89c5e0db7b14 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f" status: 200 len: 1717 microversion: 2.1 time: 0.607598 Oct 19 03:28:08.324231 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1861/3634] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:07 2022] GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f => generated 1717 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:08.348488 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-76a21211-2981-4587-baa5-d20f6ad8004d tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:08.349626 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-76a21211-2981-4587-baa5-d20f6ad8004d tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: 0051ff67-c0d0-4c84-a643-867d6416d8d1] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:08.356415 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-76a21211-2981-4587-baa5-d20f6ad8004d tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:08.357051 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-76a21211-2981-4587-baa5-d20f6ad8004d tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:08.357628 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-76a21211-2981-4587-baa5-d20f6ad8004d tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:08.358631 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-76a21211-2981-4587-baa5-d20f6ad8004d tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:08.359295 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-76a21211-2981-4587-baa5-d20f6ad8004d tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:08.359877 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-76a21211-2981-4587-baa5-d20f6ad8004d tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:08.363659 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-75d2a2f4-2ad2-4282-ba6e-723bbacc4c54 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:28:08.379773 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-75d2a2f4-2ad2-4282-ba6e-723bbacc4c54 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1296 microversion: 2.1 time: 0.266928 Oct 19 03:28:08.380642 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1774/3635] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:08 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1296 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:08.598308 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-73580238-adbc-4809-be70-ac0cf65a5015 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Calling method '.version_select at 0x7fc13056f1f0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:08.674798 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-73580238-adbc-4809-be70-ac0cf65a5015 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] 10.222.0.52 "GET /compute/v2.1/images/ccff1b05-0698-450d-8019-09c754007fb9" status: 200 len: 1422 microversion: 2.1 time: 0.081137 Oct 19 03:28:08.678763 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1775/3636] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:28:08 2022] GET /compute/v2.1/images/ccff1b05-0698-450d-8019-09c754007fb9 => generated 1422 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:08.826651 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-76a21211-2981-4587-baa5-d20f6ad8004d tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2b0581ad4e4c9787bef838c81870a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dfe251b1e046a995b8ec302cb2ffa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:28:08.835892 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-76a21211-2981-4587-baa5-d20f6ad8004d tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "GET /compute/v2.1/servers/0051ff67-c0d0-4c84-a643-867d6416d8d1" status: 200 len: 1512 microversion: 2.1 time: 0.491220 Oct 19 03:28:08.853269 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1862/3637] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:08 2022] GET /compute/v2.1/servers/0051ff67-c0d0-4c84-a643-867d6416d8d1 => generated 1512 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:09.148138 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f7fd2129-67d5-4741-a345-a5280afff739 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:09.150045 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f7fd2129-67d5-4741-a345-a5280afff739 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 3bb7abe9-5796-48da-bb31-aed0273716c7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:09.177784 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f7fd2129-67d5-4741-a345-a5280afff739 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:09.178682 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f7fd2129-67d5-4741-a345-a5280afff739 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:09.179950 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f7fd2129-67d5-4741-a345-a5280afff739 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:09.180884 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f7fd2129-67d5-4741-a345-a5280afff739 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:09.181792 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f7fd2129-67d5-4741-a345-a5280afff739 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:09.183415 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f7fd2129-67d5-4741-a345-a5280afff739 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:09.353132 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3dd0b8aa-b741-45ec-9153-133031c69bdc tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:09.356215 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-3dd0b8aa-b741-45ec-9153-133031c69bdc tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 5cc2003b-73ef-4a54-a22d-9cef47c6ed3f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:09.364523 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3dd0b8aa-b741-45ec-9153-133031c69bdc tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:09.369742 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3dd0b8aa-b741-45ec-9153-133031c69bdc tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:09.370207 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3dd0b8aa-b741-45ec-9153-133031c69bdc tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:09.370958 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3dd0b8aa-b741-45ec-9153-133031c69bdc tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:09.371427 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3dd0b8aa-b741-45ec-9153-133031c69bdc tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:09.371876 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3dd0b8aa-b741-45ec-9153-133031c69bdc tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:09.527301 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-f7fd2129-67d5-4741-a345-a5280afff739 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:28:09.538740 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f7fd2129-67d5-4741-a345-a5280afff739 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7" status: 200 len: 1308 microversion: 2.1 time: 0.400309 Oct 19 03:28:09.538740 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1776/3638] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:09 2022] GET /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7 => generated 1308 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:09.552647 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9697bf9b-8ee4-446a-8b8c-52a0e3c9cddc tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:09.553276 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9697bf9b-8ee4-446a-8b8c-52a0e3c9cddc tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:09.585601 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9697bf9b-8ee4-446a-8b8c-52a0e3c9cddc tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:09.586111 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9697bf9b-8ee4-446a-8b8c-52a0e3c9cddc tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:09.586646 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9697bf9b-8ee4-446a-8b8c-52a0e3c9cddc tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:09.587375 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9697bf9b-8ee4-446a-8b8c-52a0e3c9cddc tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:09.588615 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9697bf9b-8ee4-446a-8b8c-52a0e3c9cddc tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:09.589337 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9697bf9b-8ee4-446a-8b8c-52a0e3c9cddc tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:09.845845 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9697bf9b-8ee4-446a-8b8c-52a0e3c9cddc tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:28:09.862148 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9697bf9b-8ee4-446a-8b8c-52a0e3c9cddc tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1364 microversion: 2.1 time: 0.322497 Oct 19 03:28:09.863528 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1777/3639] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:09 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1364 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:09.873842 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-cf418421-d957-40cb-a9d4-32a484bf34de tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Calling method '.version_select at 0x7fc13044ac10>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:09.895634 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-3dd0b8aa-b741-45ec-9153-133031c69bdc tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:28:09.909398 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-3dd0b8aa-b741-45ec-9153-133031c69bdc tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f" status: 200 len: 1717 microversion: 2.1 time: 0.557302 Oct 19 03:28:09.911797 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1863/3640] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:09 2022] GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f => generated 1717 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:28:09.923612 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-8c7ab395-1951-4c93-abe5-09f058b0d6ea tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:09.949887 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-8c7ab395-1951-4c93-abe5-09f058b0d6ea tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: 0051ff67-c0d0-4c84-a643-867d6416d8d1] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:09.961061 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-cf418421-d957-40cb-a9d4-32a484bf34de tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] 10.222.0.52 "GET /compute/v2.1/images/ccff1b05-0698-450d-8019-09c754007fb9" status: 200 len: 1431 microversion: 2.1 time: 0.096091 Oct 19 03:28:09.964109 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1778/3641] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:28:09 2022] GET /compute/v2.1/images/ccff1b05-0698-450d-8019-09c754007fb9 => generated 1431 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:09.969644 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8c7ab395-1951-4c93-abe5-09f058b0d6ea tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:09.970271 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8c7ab395-1951-4c93-abe5-09f058b0d6ea tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:09.978541 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e989db7f-f24e-4673-b7e4-00fb1224c0a6 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Calling method '.version_select at 0x7fc1300984c0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:09.978908 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8c7ab395-1951-4c93-abe5-09f058b0d6ea tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:09.980460 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8c7ab395-1951-4c93-abe5-09f058b0d6ea tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:09.982683 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8c7ab395-1951-4c93-abe5-09f058b0d6ea tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:09.983313 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8c7ab395-1951-4c93-abe5-09f058b0d6ea tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:10.072434 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e989db7f-f24e-4673-b7e4-00fb1224c0a6 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] 10.222.0.52 "GET /compute/v2.1/images/ccff1b05-0698-450d-8019-09c754007fb9" status: 200 len: 1431 microversion: 2.1 time: 0.098980 Oct 19 03:28:10.077786 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1779/3642] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:28:09 2022] GET /compute/v2.1/images/ccff1b05-0698-450d-8019-09c754007fb9 => generated 1431 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:10.093135 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4799b744-0cae-4129-a2ba-719b948bcdbf tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:10.093964 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4799b744-0cae-4129-a2ba-719b948bcdbf tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] [instance: 3bfbe3fa-5e16-4b72-8232-7cf260c78f0a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:10.103832 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4799b744-0cae-4129-a2ba-719b948bcdbf tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:10.108665 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4799b744-0cae-4129-a2ba-719b948bcdbf tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:10.109540 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4799b744-0cae-4129-a2ba-719b948bcdbf tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:10.111078 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4799b744-0cae-4129-a2ba-719b948bcdbf tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:10.115007 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4799b744-0cae-4129-a2ba-719b948bcdbf tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:10.115682 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4799b744-0cae-4129-a2ba-719b948bcdbf tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:10.738539 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-8c7ab395-1951-4c93-abe5-09f058b0d6ea tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2b0581ad4e4c9787bef838c81870a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dfe251b1e046a995b8ec302cb2ffa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:28:10.769315 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-8c7ab395-1951-4c93-abe5-09f058b0d6ea tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "GET /compute/v2.1/servers/0051ff67-c0d0-4c84-a643-867d6416d8d1" status: 200 len: 1512 microversion: 2.1 time: 0.852460 Oct 19 03:28:10.786517 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1864/3643] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:09 2022] GET /compute/v2.1/servers/0051ff67-c0d0-4c84-a643-867d6416d8d1 => generated 1512 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:10.796798 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b6a39be1-ab86-45c7-8215-46bd7b25c776 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:10.798212 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b6a39be1-ab86-45c7-8215-46bd7b25c776 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 3bb7abe9-5796-48da-bb31-aed0273716c7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:10.811366 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b6a39be1-ab86-45c7-8215-46bd7b25c776 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:10.812318 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b6a39be1-ab86-45c7-8215-46bd7b25c776 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:10.813056 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b6a39be1-ab86-45c7-8215-46bd7b25c776 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:10.815325 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b6a39be1-ab86-45c7-8215-46bd7b25c776 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:10.816539 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b6a39be1-ab86-45c7-8215-46bd7b25c776 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:10.817997 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b6a39be1-ab86-45c7-8215-46bd7b25c776 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:10.929509 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-4799b744-0cae-4129-a2ba-719b948bcdbf tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17362106426c46ca8c07ee8192fe2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcb4d8381f474d8bbea44443f845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:28:10.944266 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4799b744-0cae-4129-a2ba-719b948bcdbf tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] 10.222.0.52 "GET /compute/v2.1/servers/3bfbe3fa-5e16-4b72-8232-7cf260c78f0a" status: 200 len: 1479 microversion: 2.1 time: 0.854907 Oct 19 03:28:10.945463 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1780/3644] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:10 2022] GET /compute/v2.1/servers/3bfbe3fa-5e16-4b72-8232-7cf260c78f0a => generated 1479 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:10.954312 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ae9681cc-a0a1-4f2a-b5b3-e0049a5d6792 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:10.955471 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ae9681cc-a0a1-4f2a-b5b3-e0049a5d6792 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:10.971263 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ae9681cc-a0a1-4f2a-b5b3-e0049a5d6792 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:10.971837 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ae9681cc-a0a1-4f2a-b5b3-e0049a5d6792 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:10.972389 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ae9681cc-a0a1-4f2a-b5b3-e0049a5d6792 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:10.973616 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ae9681cc-a0a1-4f2a-b5b3-e0049a5d6792 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:10.974379 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ae9681cc-a0a1-4f2a-b5b3-e0049a5d6792 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:10.975156 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ae9681cc-a0a1-4f2a-b5b3-e0049a5d6792 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:11.333107 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b6a39be1-ab86-45c7-8215-46bd7b25c776 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:28:11.343729 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b6a39be1-ab86-45c7-8215-46bd7b25c776 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7" status: 200 len: 1489 microversion: 2.1 time: 0.555934 Oct 19 03:28:11.365290 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1865/3645] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:10 2022] GET /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7 => generated 1489 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:11.380345 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-efa29305-3851-47a3-89d6-b2795b540159 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:11.384280 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-efa29305-3851-47a3-89d6-b2795b540159 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 5cc2003b-73ef-4a54-a22d-9cef47c6ed3f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:11.400347 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-efa29305-3851-47a3-89d6-b2795b540159 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:11.401803 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-efa29305-3851-47a3-89d6-b2795b540159 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:11.407304 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-efa29305-3851-47a3-89d6-b2795b540159 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:11.407304 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-efa29305-3851-47a3-89d6-b2795b540159 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:11.407304 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-efa29305-3851-47a3-89d6-b2795b540159 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:11.407304 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-efa29305-3851-47a3-89d6-b2795b540159 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:11.407645 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ae9681cc-a0a1-4f2a-b5b3-e0049a5d6792 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:28:11.418808 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ae9681cc-a0a1-4f2a-b5b3-e0049a5d6792 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1364 microversion: 2.1 time: 0.471664 Oct 19 03:28:11.419561 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1781/3646] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:10 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1364 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:11.424772 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b590f46d-882b-4394-b493-2ac0259157af tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1012806382"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:28:11.428488 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b590f46d-882b-4394-b493-2ac0259157af tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 3bb7abe9-5796-48da-bb31-aed0273716c7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:11.436863 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b590f46d-882b-4394-b493-2ac0259157af tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:11.438061 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b590f46d-882b-4394-b493-2ac0259157af tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:11.447898 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b590f46d-882b-4394-b493-2ac0259157af tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:11.447898 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b590f46d-882b-4394-b493-2ac0259157af tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:11.447898 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b590f46d-882b-4394-b493-2ac0259157af tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:11.447898 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b590f46d-882b-4394-b493-2ac0259157af tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:11.734173 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b590f46d-882b-4394-b493-2ac0259157af tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "PUT /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7" status: 200 len: 1075 microversion: 2.1 time: 0.307287 Oct 19 03:28:11.734173 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1782/3647] 10.222.0.52 () {60 vars in 1256 bytes} [Wed Oct 19 03:28:11 2022] PUT /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7 => generated 1075 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:11.757127 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f31c391c-74ef-4f51-9d4e-88f04f7b4709 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:11.758394 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f31c391c-74ef-4f51-9d4e-88f04f7b4709 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 3bb7abe9-5796-48da-bb31-aed0273716c7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:11.766007 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f31c391c-74ef-4f51-9d4e-88f04f7b4709 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:11.771489 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f31c391c-74ef-4f51-9d4e-88f04f7b4709 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:11.771489 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f31c391c-74ef-4f51-9d4e-88f04f7b4709 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:11.771489 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f31c391c-74ef-4f51-9d4e-88f04f7b4709 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:11.771489 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f31c391c-74ef-4f51-9d4e-88f04f7b4709 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:11.771918 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f31c391c-74ef-4f51-9d4e-88f04f7b4709 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:12.066310 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:28:12.096172 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=6 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:28:12.166364 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-efa29305-3851-47a3-89d6-b2795b540159 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:28:12.188027 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-efa29305-3851-47a3-89d6-b2795b540159 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f" status: 200 len: 1717 microversion: 2.1 time: 0.821091 Oct 19 03:28:12.188929 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1866/3648] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:11 2022] GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f => generated 1717 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:12.195936 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f10791c2-fd3a-49b1-b468-69d95e07faa9 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:12.203858 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f10791c2-fd3a-49b1-b468-69d95e07faa9 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: 0051ff67-c0d0-4c84-a643-867d6416d8d1] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:12.233136 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f10791c2-fd3a-49b1-b468-69d95e07faa9 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:12.234521 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f10791c2-fd3a-49b1-b468-69d95e07faa9 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:12.235225 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f10791c2-fd3a-49b1-b468-69d95e07faa9 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:12.236832 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f10791c2-fd3a-49b1-b468-69d95e07faa9 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:12.237583 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f10791c2-fd3a-49b1-b468-69d95e07faa9 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:12.239479 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f10791c2-fd3a-49b1-b468-69d95e07faa9 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:12.453498 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-f31c391c-74ef-4f51-9d4e-88f04f7b4709 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:28:12.463411 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f31c391c-74ef-4f51-9d4e-88f04f7b4709 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7" status: 200 len: 1501 microversion: 2.1 time: 0.712113 Oct 19 03:28:12.468702 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1783/3649] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:11 2022] GET /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7 => generated 1501 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:12.475530 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e08bdc29-7e60-4698-952c-96af63208302 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:12.476320 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e08bdc29-7e60-4698-952c-96af63208302 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] [instance: 3bfbe3fa-5e16-4b72-8232-7cf260c78f0a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:12.502732 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e08bdc29-7e60-4698-952c-96af63208302 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:12.502732 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e08bdc29-7e60-4698-952c-96af63208302 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:12.502732 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e08bdc29-7e60-4698-952c-96af63208302 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:12.502732 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e08bdc29-7e60-4698-952c-96af63208302 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:12.503226 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e08bdc29-7e60-4698-952c-96af63208302 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:12.503226 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e08bdc29-7e60-4698-952c-96af63208302 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:12.753396 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f10791c2-fd3a-49b1-b468-69d95e07faa9 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2b0581ad4e4c9787bef838c81870a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dfe251b1e046a995b8ec302cb2ffa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:28:12.762815 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f10791c2-fd3a-49b1-b468-69d95e07faa9 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "GET /compute/v2.1/servers/0051ff67-c0d0-4c84-a643-867d6416d8d1" status: 200 len: 1512 microversion: 2.1 time: 0.572626 Oct 19 03:28:12.767676 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1867/3650] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:12 2022] GET /compute/v2.1/servers/0051ff67-c0d0-4c84-a643-867d6416d8d1 => generated 1512 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:12.773032 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3e2ae9d3-7af8-4c7e-9b8a-e6fb17ac4290 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:12.782304 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-3e2ae9d3-7af8-4c7e-9b8a-e6fb17ac4290 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:12.802761 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3e2ae9d3-7af8-4c7e-9b8a-e6fb17ac4290 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:12.803265 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3e2ae9d3-7af8-4c7e-9b8a-e6fb17ac4290 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:12.813945 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3e2ae9d3-7af8-4c7e-9b8a-e6fb17ac4290 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:12.813945 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3e2ae9d3-7af8-4c7e-9b8a-e6fb17ac4290 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:12.813945 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3e2ae9d3-7af8-4c7e-9b8a-e6fb17ac4290 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:12.813945 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3e2ae9d3-7af8-4c7e-9b8a-e6fb17ac4290 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:13.011562 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e08bdc29-7e60-4698-952c-96af63208302 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17362106426c46ca8c07ee8192fe2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcb4d8381f474d8bbea44443f845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:28:13.030853 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e08bdc29-7e60-4698-952c-96af63208302 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] 10.222.0.52 "GET /compute/v2.1/servers/3bfbe3fa-5e16-4b72-8232-7cf260c78f0a" status: 200 len: 1466 microversion: 2.1 time: 0.553919 Oct 19 03:28:13.041770 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1784/3651] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:12 2022] GET /compute/v2.1/servers/3bfbe3fa-5e16-4b72-8232-7cf260c78f0a => generated 1466 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:13.049406 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a4c75faf-46f2-4ba5-b727-8db3bd0ff366 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:13.052468 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a4c75faf-46f2-4ba5-b727-8db3bd0ff366 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 3bb7abe9-5796-48da-bb31-aed0273716c7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:13.072228 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a4c75faf-46f2-4ba5-b727-8db3bd0ff366 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:13.072228 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a4c75faf-46f2-4ba5-b727-8db3bd0ff366 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:13.072228 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a4c75faf-46f2-4ba5-b727-8db3bd0ff366 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:13.072228 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a4c75faf-46f2-4ba5-b727-8db3bd0ff366 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:13.073048 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a4c75faf-46f2-4ba5-b727-8db3bd0ff366 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:13.073048 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a4c75faf-46f2-4ba5-b727-8db3bd0ff366 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:13.280656 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-3e2ae9d3-7af8-4c7e-9b8a-e6fb17ac4290 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:28:13.288657 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-3e2ae9d3-7af8-4c7e-9b8a-e6fb17ac4290 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1364 microversion: 2.1 time: 0.519694 Oct 19 03:28:13.301485 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1868/3652] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:12 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1364 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:13.312256 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f7f431fb-7e58-4871-beb6-eaf59c11daba tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Calling method '.version_select at 0x7fc134f43dc0>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:13.408527 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f7f431fb-7e58-4871-beb6-eaf59c11daba tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] 10.222.0.52 "GET /compute/v2.1/images/9e16d73e-70ea-4421-aee3-047d80396c02" status: 200 len: 784 microversion: 2.1 time: 0.101083 Oct 19 03:28:13.408527 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1869/3653] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:28:13 2022] GET /compute/v2.1/images/9e16d73e-70ea-4421-aee3-047d80396c02 => generated 784 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:28:13.409442 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a4c75faf-46f2-4ba5-b727-8db3bd0ff366 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:28:13.417179 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a4c75faf-46f2-4ba5-b727-8db3bd0ff366 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7" status: 200 len: 1501 microversion: 2.1 time: 0.380513 Oct 19 03:28:13.418952 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-719deb01-c234-4351-b0ed-74d11ad0d464 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:13.419952 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-719deb01-c234-4351-b0ed-74d11ad0d464 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 5cc2003b-73ef-4a54-a22d-9cef47c6ed3f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:13.420670 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1785/3654] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:13 2022] GET /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7 => generated 1501 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:13.428379 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-719deb01-c234-4351-b0ed-74d11ad0d464 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:13.429105 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-719deb01-c234-4351-b0ed-74d11ad0d464 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:13.431385 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-719deb01-c234-4351-b0ed-74d11ad0d464 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:13.431385 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-719deb01-c234-4351-b0ed-74d11ad0d464 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:13.431385 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-719deb01-c234-4351-b0ed-74d11ad0d464 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:13.431867 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-719deb01-c234-4351-b0ed-74d11ad0d464 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:13.461348 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-1a08162c-ac92-4b18-a5e5-0433c41bb312 req-86158a4a-6ec5-43d2-93a3-c7bb0a62d247 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58b9ce4c-4a42-40ff-b8ed-b75de752b46f", "tag": "ff8c2e3f-1c6f-4ac7-b6b8-751825489845"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:28:13.475120 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-1a08162c-ac92-4b18-a5e5-0433c41bb312 req-86158a4a-6ec5-43d2-93a3-c7bb0a62d247 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:13.475703 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-1a08162c-ac92-4b18-a5e5-0433c41bb312 req-86158a4a-6ec5-43d2-93a3-c7bb0a62d247 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:13.483255 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-1a08162c-ac92-4b18-a5e5-0433c41bb312 req-86158a4a-6ec5-43d2-93a3-c7bb0a62d247 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:13.488823 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-1a08162c-ac92-4b18-a5e5-0433c41bb312 req-86158a4a-6ec5-43d2-93a3-c7bb0a62d247 service nova] Creating event network-changed:ff8c2e3f-1c6f-4ac7-b6b8-751825489845 for instance 58b9ce4c-4a42-40ff-b8ed-b75de752b46f on n-h2-861333-8 Oct 19 03:28:13.497922 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-1a08162c-ac92-4b18-a5e5-0433c41bb312 req-86158a4a-6ec5-43d2-93a3-c7bb0a62d247 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057020 Oct 19 03:28:13.501839 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1786/3655] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:28:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:28:13.508106 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3be1cda3-0514-44e5-8aea-280c7130438d tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:13.531165 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3be1cda3-0514-44e5-8aea-280c7130438d tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] 10.222.0.52 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.027660 Oct 19 03:28:13.531747 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1787/3656] 10.222.0.52 () {58 vars in 1137 bytes} [Wed Oct 19 03:28:13 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:28:13.544319 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7de05509-7d3f-42e7-a96b-3a51d4a5bf3c tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:28:13.555022 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7de05509-7d3f-42e7-a96b-3a51d4a5bf3c tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:13.557906 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7de05509-7d3f-42e7-a96b-3a51d4a5bf3c tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:13.557906 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7de05509-7d3f-42e7-a96b-3a51d4a5bf3c tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:13.663304 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:28:13.669393 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7de05509-7d3f-42e7-a96b-3a51d4a5bf3c tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 3bb7abe9-5796-48da-bb31-aed0273716c7] Going to try to stop instance {{(pid=121134) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 19 03:28:13.825237 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-719deb01-c234-4351-b0ed-74d11ad0d464 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:28:13.838708 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-719deb01-c234-4351-b0ed-74d11ad0d464 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f" status: 200 len: 1717 microversion: 2.1 time: 0.429292 Oct 19 03:28:13.841021 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1870/3657] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:13 2022] GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f => generated 1717 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:13.846306 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ba6b156c-61b3-45e6-b446-50fdc12d6887 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Calling method '.version_select at 0x7fc1305f4700>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:13.969094 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7de05509-7d3f-42e7-a96b-3a51d4a5bf3c tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "POST /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7/action" status: 202 len: 0 microversion: 2.1 time: 0.428600 Oct 19 03:28:13.975207 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1788/3658] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:28:13 2022] POST /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7/action => generated 0 bytes in 442 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:28:14.236977 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-f70c8f1e-2b46-486d-870e-9842c3fc54b0 req-ab8aca3c-2c1f-48b5-b389-5c47e9c5dfcc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bfbe3fa-5e16-4b72-8232-7cf260c78f0a", "name": "network-vif-unplugged", "status": "completed", "tag": "4cf986cf-c812-445d-9c71-bf2c9df9bf7f"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:28:14.256160 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-f70c8f1e-2b46-486d-870e-9842c3fc54b0 req-ab8aca3c-2c1f-48b5-b389-5c47e9c5dfcc service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:14.257965 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-f70c8f1e-2b46-486d-870e-9842c3fc54b0 req-ab8aca3c-2c1f-48b5-b389-5c47e9c5dfcc service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:14.258397 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-f70c8f1e-2b46-486d-870e-9842c3fc54b0 req-ab8aca3c-2c1f-48b5-b389-5c47e9c5dfcc service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:14.298381 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-f70c8f1e-2b46-486d-870e-9842c3fc54b0 req-ab8aca3c-2c1f-48b5-b389-5c47e9c5dfcc service nova] Creating event network-vif-unplugged:4cf986cf-c812-445d-9c71-bf2c9df9bf7f for instance 3bfbe3fa-5e16-4b72-8232-7cf260c78f0a on n-h1-861333-8 Oct 19 03:28:14.310911 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-f70c8f1e-2b46-486d-870e-9842c3fc54b0 req-ab8aca3c-2c1f-48b5-b389-5c47e9c5dfcc service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.333684 Oct 19 03:28:14.313868 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1789/3659] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:28:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:28:14.325068 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2e535667-42e5-4a5e-9f76-d236ec357839 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:14.328186 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2e535667-42e5-4a5e-9f76-d236ec357839 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: 0051ff67-c0d0-4c84-a643-867d6416d8d1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:14.355669 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2e535667-42e5-4a5e-9f76-d236ec357839 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:14.357661 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2e535667-42e5-4a5e-9f76-d236ec357839 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:14.359903 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2e535667-42e5-4a5e-9f76-d236ec357839 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:14.360974 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2e535667-42e5-4a5e-9f76-d236ec357839 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:14.361810 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2e535667-42e5-4a5e-9f76-d236ec357839 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:14.364039 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2e535667-42e5-4a5e-9f76-d236ec357839 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:14.409898 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=4 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:28:14.640986 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-2e535667-42e5-4a5e-9f76-d236ec357839 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2b0581ad4e4c9787bef838c81870a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dfe251b1e046a995b8ec302cb2ffa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:28:14.649627 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2e535667-42e5-4a5e-9f76-d236ec357839 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "GET /compute/v2.1/servers/0051ff67-c0d0-4c84-a643-867d6416d8d1" status: 200 len: 1512 microversion: 2.1 time: 0.331246 Oct 19 03:28:14.650321 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1790/3660] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:14 2022] GET /compute/v2.1/servers/0051ff67-c0d0-4c84-a643-867d6416d8d1 => generated 1512 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:14.655176 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a2697e93-809b-4dee-8175-e5a1392ca34a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:14.656532 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a2697e93-809b-4dee-8175-e5a1392ca34a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 3bb7abe9-5796-48da-bb31-aed0273716c7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:14.665540 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a2697e93-809b-4dee-8175-e5a1392ca34a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:14.666297 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a2697e93-809b-4dee-8175-e5a1392ca34a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:14.666649 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a2697e93-809b-4dee-8175-e5a1392ca34a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:14.667629 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a2697e93-809b-4dee-8175-e5a1392ca34a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:14.668283 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a2697e93-809b-4dee-8175-e5a1392ca34a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:14.668776 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a2697e93-809b-4dee-8175-e5a1392ca34a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:14.853153 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a2697e93-809b-4dee-8175-e5a1392ca34a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:28:14.864695 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a2697e93-809b-4dee-8175-e5a1392ca34a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7" status: 200 len: 1511 microversion: 2.1 time: 0.213080 Oct 19 03:28:14.866448 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1791/3661] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:14 2022] GET /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7 => generated 1511 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:14.882214 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6835d22a-ea9f-4b74-a81e-c7bfe458c7d3 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:14.882908 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6835d22a-ea9f-4b74-a81e-c7bfe458c7d3 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:14.890657 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6835d22a-ea9f-4b74-a81e-c7bfe458c7d3 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:14.891152 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6835d22a-ea9f-4b74-a81e-c7bfe458c7d3 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:14.891911 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6835d22a-ea9f-4b74-a81e-c7bfe458c7d3 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:14.892862 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6835d22a-ea9f-4b74-a81e-c7bfe458c7d3 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:14.893510 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6835d22a-ea9f-4b74-a81e-c7bfe458c7d3 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:14.894279 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6835d22a-ea9f-4b74-a81e-c7bfe458c7d3 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:15.089099 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-6835d22a-ea9f-4b74-a81e-c7bfe458c7d3 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:28:15.098570 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6835d22a-ea9f-4b74-a81e-c7bfe458c7d3 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1364 microversion: 2.1 time: 0.228516 Oct 19 03:28:15.098570 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1792/3662] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:14 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1364 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:15.103016 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-fdf04670-d101-43bf-b81f-dc74aedb0b85 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:15.103631 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-fdf04670-d101-43bf-b81f-dc74aedb0b85 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 5cc2003b-73ef-4a54-a22d-9cef47c6ed3f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:15.109442 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fdf04670-d101-43bf-b81f-dc74aedb0b85 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:15.109934 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fdf04670-d101-43bf-b81f-dc74aedb0b85 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:15.110383 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fdf04670-d101-43bf-b81f-dc74aedb0b85 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:15.111082 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fdf04670-d101-43bf-b81f-dc74aedb0b85 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:15.111544 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fdf04670-d101-43bf-b81f-dc74aedb0b85 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:15.111979 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fdf04670-d101-43bf-b81f-dc74aedb0b85 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:15.305249 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-fdf04670-d101-43bf-b81f-dc74aedb0b85 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:28:15.315675 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-fdf04670-d101-43bf-b81f-dc74aedb0b85 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f" status: 200 len: 1717 microversion: 2.1 time: 0.214924 Oct 19 03:28:15.334926 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1793/3663] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:15 2022] GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f => generated 1717 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:15.675472 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3abd702d-ab78-4aa7-bd81-3a110a1620e3 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:15.680759 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3abd702d-ab78-4aa7-bd81-3a110a1620e3 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: 0051ff67-c0d0-4c84-a643-867d6416d8d1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:15.684475 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3abd702d-ab78-4aa7-bd81-3a110a1620e3 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:15.685157 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3abd702d-ab78-4aa7-bd81-3a110a1620e3 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:15.685647 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3abd702d-ab78-4aa7-bd81-3a110a1620e3 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:15.686376 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3abd702d-ab78-4aa7-bd81-3a110a1620e3 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:15.686901 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3abd702d-ab78-4aa7-bd81-3a110a1620e3 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:15.687327 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3abd702d-ab78-4aa7-bd81-3a110a1620e3 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:15.910638 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-3abd702d-ab78-4aa7-bd81-3a110a1620e3 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2b0581ad4e4c9787bef838c81870a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dfe251b1e046a995b8ec302cb2ffa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:28:15.919579 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3abd702d-ab78-4aa7-bd81-3a110a1620e3 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "GET /compute/v2.1/servers/0051ff67-c0d0-4c84-a643-867d6416d8d1" status: 200 len: 1512 microversion: 2.1 time: 0.248052 Oct 19 03:28:15.933407 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1794/3664] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:15 2022] GET /compute/v2.1/servers/0051ff67-c0d0-4c84-a643-867d6416d8d1 => generated 1512 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:15.947743 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-98cbb2b2-4cec-423b-ab78-5dfb276fc654 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:15.948261 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-98cbb2b2-4cec-423b-ab78-5dfb276fc654 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 3bb7abe9-5796-48da-bb31-aed0273716c7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:15.950369 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:28:15.955130 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ba6b156c-61b3-45e6-b446-50fdc12d6887 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] 10.222.0.52 "DELETE /compute/v2.1/images/ccff1b05-0698-450d-8019-09c754007fb9" status: 204 len: 0 microversion: 2.1 time: 2.112429 Oct 19 03:28:15.955730 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1871/3665] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:13 2022] DELETE /compute/v2.1/images/ccff1b05-0698-450d-8019-09c754007fb9 => generated 0 bytes in 2114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:28:15.957457 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-98cbb2b2-4cec-423b-ab78-5dfb276fc654 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:15.957953 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-98cbb2b2-4cec-423b-ab78-5dfb276fc654 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:15.958396 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-98cbb2b2-4cec-423b-ab78-5dfb276fc654 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:15.959201 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-98cbb2b2-4cec-423b-ab78-5dfb276fc654 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:15.959825 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-98cbb2b2-4cec-423b-ab78-5dfb276fc654 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:15.960417 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-98cbb2b2-4cec-423b-ab78-5dfb276fc654 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:15.965274 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-770e16e3-d5d1-4b72-b38c-948c054f7bfc tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Calling method '.version_select at 0x7fc12bfb1b80>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:16.000293 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-770e16e3-d5d1-4b72-b38c-948c054f7bfc tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] HTTP exception thrown: Image not found. Oct 19 03:28:16.003860 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-770e16e3-d5d1-4b72-b38c-948c054f7bfc tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Request method failure captured: Oct 19 03:28:16.003860 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/images/ccff1b05-0698-450d-8019-09c754007fb9 HTTP/1.1 Oct 19 03:28:16.003860 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:28:16.003860 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:28:16.003860 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:28:16.003860 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:28:16.003860 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:28:16.003860 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:28:16.003860 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:28:16.003860 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:28:16.003860 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT26KRkQxqaGJKebQpaIRKc1C06FR2n-oiWuZrEqN7RnQhsWfo04BL753HN727mvlmU99Q0WMnKPJQCDxkX9HQsoapHKbP1vWTa0BZIZsMWFlx7Zp_m-dWSCuCXh0NinS7EJrzPV0c3BUs_i_4HmiT6d3vnaS8rm54dqm-QzA8WoL1VQ Oct 19 03:28:16.003860 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:28:16.003860 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:28:16.003860 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:28:16.003860 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:28:16.003860 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:28:16.003860 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:28:16.003860 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: b9fcb4d8381f474d8bbea44443f845f8 Oct 19 03:28:16.003860 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ImagesOneServerTestJSON-397829642 Oct 19 03:28:16.003860 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:28:16.003860 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:28:16.005320 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b9fcb4d8381f474d8bbea44443f845f8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b9fcb4d8381f474d8bbea44443f845f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b9fcb4d8381f474d8bbea44443f845f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b9fcb4d8381f474d8bbea44443f845f8", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:28:16.005320 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ImagesOneServerTestJSON-397829642 Oct 19 03:28:16.005320 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: b9fcb4d8381f474d8bbea44443f845f8 Oct 19 03:28:16.005320 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-397829642 Oct 19 03:28:16.005320 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ImagesOneServerTestJSON-397829642-project Oct 19 03:28:16.005320 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:28:16.005320 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:28:16.005320 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 17362106426c46ca8c07ee8192fe2bac Oct 19 03:28:16.005320 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ImagesOneServerTestJSON-397829642-project Oct 19 03:28:16.005320 n-d-861333-8 devstack@n-api.service[121135]: method: Oct 19 03:28:16.005320 n-d-861333-8 devstack@n-api.service[121135]: exception: Image not found. Oct 19 03:28:16.005320 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': 'ccff1b05-0698-450d-8019-09c754007fb9'} Oct 19 03:28:16.005320 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:28:16.006573 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:28:16.006573 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 19 03:28:16.006573 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 19 03:28:16.006573 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 19 03:28:16.006573 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 19 03:28:16.006573 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 19 03:28:16.006573 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 19 03:28:16.006573 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 19 03:28:16.006573 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 19 03:28:16.006573 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 19 03:28:16.006573 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 19 03:28:16.006573 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 19 03:28:16.006573 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 19 03:28:16.006573 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 19 03:28:16.006573 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 19 03:28:16.006573 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 19 03:28:16.006573 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 19 03:28:16.006573 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID ccff1b05-0698-450d-8019-09c754007fb9 Oct 19 03:28:16.007886 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:28:16.007886 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:28:16.007886 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:28:16.007886 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:28:16.007886 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 19 03:28:16.007886 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 19 03:28:16.007886 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 19 03:28:16.007886 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 19 03:28:16.007886 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 19 03:28:16.007886 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 19 03:28:16.007886 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 19 03:28:16.007886 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 19 03:28:16.007886 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 19 03:28:16.007886 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 19 03:28:16.007886 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 19 03:28:16.007886 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 19 03:28:16.007886 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 19 03:28:16.007886 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 19 03:28:16.007886 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 19 03:28:16.007886 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 19 03:28:16.009123 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 19 03:28:16.009123 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 19 03:28:16.009123 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 19 03:28:16.009123 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 19 03:28:16.009123 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 19 03:28:16.009123 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 19 03:28:16.009123 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 19 03:28:16.009123 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 19 03:28:16.009123 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ccff1b05-0698-450d-8019-09c754007fb9 could not be found. Oct 19 03:28:16.009123 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:28:16.009123 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:28:16.009123 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:28:16.009123 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:28:16.009123 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:28:16.009123 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:28:16.009123 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:28:16.009123 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:28:16.009123 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 03:28:16.009123 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 03:28:16.012740 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:28:16.012740 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:28:16.012740 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 19 03:28:16.012740 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 19 03:28:16.012740 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 19 03:28:16.012740 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:28:16.012740 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:28:16.012740 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:28:16.012740 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:28:16.012740 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:28:16.012740 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:28:16.012740 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:28:16.012740 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:28:16.012740 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 19 03:28:16.012740 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:28:16.012740 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-770e16e3-d5d1-4b72-b38c-948c054f7bfc tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Returning 404 to user: Image not found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:28:16.012740 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-770e16e3-d5d1-4b72-b38c-948c054f7bfc tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] 10.222.0.52 "GET /compute/v2.1/images/ccff1b05-0698-450d-8019-09c754007fb9" status: 404 len: 62 microversion: 2.1 time: 0.045107 Oct 19 03:28:16.015619 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1872/3666] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:28:15 2022] GET /compute/v2.1/images/ccff1b05-0698-450d-8019-09c754007fb9 => generated 62 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 19 03:28:16.023272 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4f724c42-a57d-4473-9bf6-4a1adef8cc66 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-695547710"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:28:16.025920 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4f724c42-a57d-4473-9bf6-4a1adef8cc66 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] [instance: 3bfbe3fa-5e16-4b72-8232-7cf260c78f0a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:16.033172 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4f724c42-a57d-4473-9bf6-4a1adef8cc66 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:16.033805 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4f724c42-a57d-4473-9bf6-4a1adef8cc66 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:16.042669 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4f724c42-a57d-4473-9bf6-4a1adef8cc66 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:16.042669 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4f724c42-a57d-4473-9bf6-4a1adef8cc66 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:16.042669 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4f724c42-a57d-4473-9bf6-4a1adef8cc66 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:16.042669 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4f724c42-a57d-4473-9bf6-4a1adef8cc66 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:16.289244 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-98cbb2b2-4cec-423b-ab78-5dfb276fc654 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:28:16.303359 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-98cbb2b2-4cec-423b-ab78-5dfb276fc654 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7" status: 200 len: 1511 microversion: 2.1 time: 0.378211 Oct 19 03:28:16.303892 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1795/3667] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:15 2022] GET /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7 => generated 1511 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:16.312752 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2966d602-1269-46f1-96e7-90d681535286 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:16.314164 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2966d602-1269-46f1-96e7-90d681535286 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:16.321721 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2966d602-1269-46f1-96e7-90d681535286 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:16.322339 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2966d602-1269-46f1-96e7-90d681535286 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:16.322861 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2966d602-1269-46f1-96e7-90d681535286 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:16.323858 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2966d602-1269-46f1-96e7-90d681535286 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:16.324693 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2966d602-1269-46f1-96e7-90d681535286 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:16.325264 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2966d602-1269-46f1-96e7-90d681535286 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:16.476404 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=100 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:28:16.645993 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-2966d602-1269-46f1-96e7-90d681535286 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:28:16.655696 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2966d602-1269-46f1-96e7-90d681535286 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1364 microversion: 2.1 time: 0.348994 Oct 19 03:28:16.656304 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1796/3668] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:16 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1364 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:16.664669 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9bda3aa4-77df-403d-a03b-3e33b994592a tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:16.666044 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9bda3aa4-77df-403d-a03b-3e33b994592a tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 5cc2003b-73ef-4a54-a22d-9cef47c6ed3f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:16.681308 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9bda3aa4-77df-403d-a03b-3e33b994592a tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:16.681857 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9bda3aa4-77df-403d-a03b-3e33b994592a tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:16.682304 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9bda3aa4-77df-403d-a03b-3e33b994592a tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:16.685304 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9bda3aa4-77df-403d-a03b-3e33b994592a tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:16.685822 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9bda3aa4-77df-403d-a03b-3e33b994592a tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:16.686280 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9bda3aa4-77df-403d-a03b-3e33b994592a tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:16.686646 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4f724c42-a57d-4473-9bf6-4a1adef8cc66 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] 10.222.0.52 "POST /compute/v2.1/servers/3bfbe3fa-5e16-4b72-8232-7cf260c78f0a/action" status: 202 len: 0 microversion: 2.1 time: 0.667220 Oct 19 03:28:16.687492 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1873/3669] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:28:16 2022] POST /compute/v2.1/servers/3bfbe3fa-5e16-4b72-8232-7cf260c78f0a/action => generated 0 bytes in 670 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 19 03:28:16.689650 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4f724c42-a57d-4473-9bf6-4a1adef8cc66 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:16.691549 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4f724c42-a57d-4473-9bf6-4a1adef8cc66 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] 10.222.0.52 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001644 Oct 19 03:28:16.691976 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1874/3670] 10.222.0.52 () {56 vars in 886 bytes} [Wed Oct 19 03:28:16 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 19 03:28:16.705764 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f7cc4c3f-4947-417e-b69b-659f60d542d5 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Calling method '.version_select at 0x7fc12bf9b820>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:16.782446 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f7cc4c3f-4947-417e-b69b-659f60d542d5 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] 10.222.0.52 "GET /compute/v2.1/images/cb8790e4-8520-4f34-9984-d5d9253c6556" status: 200 len: 1426 microversion: 2.1 time: 0.086896 Oct 19 03:28:16.783231 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1875/3671] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:28:16 2022] GET /compute/v2.1/images/cb8790e4-8520-4f34-9984-d5d9253c6556 => generated 1426 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:16.952759 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e156b5a8-8ea9-4c75-9535-56bd38b01f8e tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:16.954283 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e156b5a8-8ea9-4c75-9535-56bd38b01f8e tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: 0051ff67-c0d0-4c84-a643-867d6416d8d1] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:16.963710 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e156b5a8-8ea9-4c75-9535-56bd38b01f8e tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:16.965919 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e156b5a8-8ea9-4c75-9535-56bd38b01f8e tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:16.970294 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e156b5a8-8ea9-4c75-9535-56bd38b01f8e tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:16.970294 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e156b5a8-8ea9-4c75-9535-56bd38b01f8e tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:16.970294 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e156b5a8-8ea9-4c75-9535-56bd38b01f8e tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:16.970294 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e156b5a8-8ea9-4c75-9535-56bd38b01f8e tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:17.232802 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9bda3aa4-77df-403d-a03b-3e33b994592a tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:28:17.248835 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9bda3aa4-77df-403d-a03b-3e33b994592a tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f" status: 200 len: 1717 microversion: 2.1 time: 0.591432 Oct 19 03:28:17.250863 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1797/3672] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:16 2022] GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f => generated 1717 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:17.331254 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8ee59b5c-cee5-45af-b804-4583a660ece9 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:17.348476 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8ee59b5c-cee5-45af-b804-4583a660ece9 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 3bb7abe9-5796-48da-bb31-aed0273716c7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:17.356544 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8ee59b5c-cee5-45af-b804-4583a660ece9 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:17.360881 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8ee59b5c-cee5-45af-b804-4583a660ece9 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:17.361868 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8ee59b5c-cee5-45af-b804-4583a660ece9 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:17.364264 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8ee59b5c-cee5-45af-b804-4583a660ece9 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:17.365147 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8ee59b5c-cee5-45af-b804-4583a660ece9 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:17.366616 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8ee59b5c-cee5-45af-b804-4583a660ece9 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:17.371873 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-e156b5a8-8ea9-4c75-9535-56bd38b01f8e tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2b0581ad4e4c9787bef838c81870a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dfe251b1e046a995b8ec302cb2ffa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:28:17.383636 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e156b5a8-8ea9-4c75-9535-56bd38b01f8e tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "GET /compute/v2.1/servers/0051ff67-c0d0-4c84-a643-867d6416d8d1" status: 200 len: 1512 microversion: 2.1 time: 0.431310 Oct 19 03:28:17.390789 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1876/3673] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:16 2022] GET /compute/v2.1/servers/0051ff67-c0d0-4c84-a643-867d6416d8d1 => generated 1512 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:28:17.608726 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8ee59b5c-cee5-45af-b804-4583a660ece9 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:28:17.620756 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8ee59b5c-cee5-45af-b804-4583a660ece9 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7" status: 200 len: 1511 microversion: 2.1 time: 0.296746 Oct 19 03:28:17.621722 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1798/3674] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:17 2022] GET /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7 => generated 1511 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:17.686287 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-149bb5ae-7fb4-47f6-9e27-b00d231f3a2c tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:17.696110 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-149bb5ae-7fb4-47f6-9e27-b00d231f3a2c tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:17.714747 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-149bb5ae-7fb4-47f6-9e27-b00d231f3a2c tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:17.717899 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-149bb5ae-7fb4-47f6-9e27-b00d231f3a2c tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:17.717899 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-149bb5ae-7fb4-47f6-9e27-b00d231f3a2c tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:17.717899 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-149bb5ae-7fb4-47f6-9e27-b00d231f3a2c tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:17.717899 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-149bb5ae-7fb4-47f6-9e27-b00d231f3a2c tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:17.718427 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-149bb5ae-7fb4-47f6-9e27-b00d231f3a2c tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:17.733584 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7f853fdd-57b5-4455-874d-c048f2810673 tempest-FloatingIPsTestJSON-619246542 tempest-FloatingIPsTestJSON-619246542-project] Action: 'create', calling method: .version_select at 0x7fc1300251f0>, body: {"pool": null} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:28:18.100936 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-149bb5ae-7fb4-47f6-9e27-b00d231f3a2c tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:28:18.109275 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-149bb5ae-7fb4-47f6-9e27-b00d231f3a2c tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1364 microversion: 2.1 time: 0.428027 Oct 19 03:28:18.120931 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1799/3675] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:17 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1364 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:18.120931 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-12853814-8147-46cd-9a8f-fe8024148dac tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Calling method '.version_select at 0x7fc130027af0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:18.178109 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-12853814-8147-46cd-9a8f-fe8024148dac tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] 10.222.0.52 "GET /compute/v2.1/images/cb8790e4-8520-4f34-9984-d5d9253c6556" status: 200 len: 1426 microversion: 2.1 time: 0.066750 Oct 19 03:28:18.178706 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1800/3676] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:28:18 2022] GET /compute/v2.1/images/cb8790e4-8520-4f34-9984-d5d9253c6556 => generated 1426 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:18.275554 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1ea09ecf-14a1-446f-a546-1be74ad21013 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:18.276525 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1ea09ecf-14a1-446f-a546-1be74ad21013 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 5cc2003b-73ef-4a54-a22d-9cef47c6ed3f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:18.283362 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1ea09ecf-14a1-446f-a546-1be74ad21013 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:18.284148 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1ea09ecf-14a1-446f-a546-1be74ad21013 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:18.284850 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1ea09ecf-14a1-446f-a546-1be74ad21013 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:18.285840 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1ea09ecf-14a1-446f-a546-1be74ad21013 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:18.286546 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1ea09ecf-14a1-446f-a546-1be74ad21013 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:18.287759 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1ea09ecf-14a1-446f-a546-1be74ad21013 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:18.571295 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-1ea09ecf-14a1-446f-a546-1be74ad21013 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:28:18.580441 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1ea09ecf-14a1-446f-a546-1be74ad21013 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f" status: 200 len: 1707 microversion: 2.1 time: 0.309019 Oct 19 03:28:18.582151 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1801/3677] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:18 2022] GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f => generated 1707 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:18.588626 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-03f73360-bf1b-4e92-a9fd-ad9f49e1c0ab tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:18.589237 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-03f73360-bf1b-4e92-a9fd-ad9f49e1c0ab tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: 0051ff67-c0d0-4c84-a643-867d6416d8d1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:18.595392 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-03f73360-bf1b-4e92-a9fd-ad9f49e1c0ab tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:18.595882 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-03f73360-bf1b-4e92-a9fd-ad9f49e1c0ab tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:18.596320 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-03f73360-bf1b-4e92-a9fd-ad9f49e1c0ab tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:18.597595 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-03f73360-bf1b-4e92-a9fd-ad9f49e1c0ab tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:18.598086 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-03f73360-bf1b-4e92-a9fd-ad9f49e1c0ab tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:18.598521 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-03f73360-bf1b-4e92-a9fd-ad9f49e1c0ab tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:19.201752 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-03f73360-bf1b-4e92-a9fd-ad9f49e1c0ab tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2b0581ad4e4c9787bef838c81870a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dfe251b1e046a995b8ec302cb2ffa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:28:19.222432 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-03f73360-bf1b-4e92-a9fd-ad9f49e1c0ab tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "GET /compute/v2.1/servers/0051ff67-c0d0-4c84-a643-867d6416d8d1" status: 200 len: 1512 microversion: 2.1 time: 0.636520 Oct 19 03:28:19.225320 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1802/3678] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:18 2022] GET /compute/v2.1/servers/0051ff67-c0d0-4c84-a643-867d6416d8d1 => generated 1512 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:19.252339 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-446e45d6-2bf0-46b0-93c5-9040e88d7fa4 tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Calling method '.version_select at 0x7fc130505c10>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:19.254017 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-446e45d6-2bf0-46b0-93c5-9040e88d7fa4 tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:19.254629 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-446e45d6-2bf0-46b0-93c5-9040e88d7fa4 tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:19.254964 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-446e45d6-2bf0-46b0-93c5-9040e88d7fa4 tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:19.263728 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-446e45d6-2bf0-46b0-93c5-9040e88d7fa4 tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] 10.222.0.52 "GET /compute/v2.1/os-migrations" status: 200 len: 1168 microversion: 2.1 time: 0.036375 Oct 19 03:28:19.264361 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1803/3679] 10.222.0.52 () {58 vars in 1143 bytes} [Wed Oct 19 03:28:19 2022] GET /compute/v2.1/os-migrations => generated 1168 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:19.269704 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-912a9929-2e0f-4485-8e80-055fd371980d tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:19.277723 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-912a9929-2e0f-4485-8e80-055fd371980d tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 3bb7abe9-5796-48da-bb31-aed0273716c7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:19.284084 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-912a9929-2e0f-4485-8e80-055fd371980d tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:19.287296 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-912a9929-2e0f-4485-8e80-055fd371980d tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:19.287296 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-912a9929-2e0f-4485-8e80-055fd371980d tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:19.287296 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-912a9929-2e0f-4485-8e80-055fd371980d tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:19.287296 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-912a9929-2e0f-4485-8e80-055fd371980d tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:19.287836 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-912a9929-2e0f-4485-8e80-055fd371980d tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:19.546361 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-912a9929-2e0f-4485-8e80-055fd371980d tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:28:19.562770 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-912a9929-2e0f-4485-8e80-055fd371980d tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7" status: 200 len: 1511 microversion: 2.1 time: 0.296958 Oct 19 03:28:19.563822 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1804/3680] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:19 2022] GET /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7 => generated 1511 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:19.569092 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8ef3eaea-8b35-4ecd-810a-bba9d6c6c845 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:19.569968 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8ef3eaea-8b35-4ecd-810a-bba9d6c6c845 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:19.578333 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8ef3eaea-8b35-4ecd-810a-bba9d6c6c845 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:19.580129 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8ef3eaea-8b35-4ecd-810a-bba9d6c6c845 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:19.583273 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8ef3eaea-8b35-4ecd-810a-bba9d6c6c845 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:19.587588 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8ef3eaea-8b35-4ecd-810a-bba9d6c6c845 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:19.588284 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8ef3eaea-8b35-4ecd-810a-bba9d6c6c845 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:19.594239 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8ef3eaea-8b35-4ecd-810a-bba9d6c6c845 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:19.847585 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8ef3eaea-8b35-4ecd-810a-bba9d6c6c845 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:28:19.858574 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8ef3eaea-8b35-4ecd-810a-bba9d6c6c845 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1364 microversion: 2.1 time: 0.291724 Oct 19 03:28:19.862220 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1805/3681] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:19 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1364 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:19.874792 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9dff418d-4680-4d64-9c6a-058cb9bcf6fc tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Calling method '.version_select at 0x7fc130098dc0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:19.940366 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9dff418d-4680-4d64-9c6a-058cb9bcf6fc tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] 10.222.0.52 "GET /compute/v2.1/images/cb8790e4-8520-4f34-9984-d5d9253c6556" status: 200 len: 1426 microversion: 2.1 time: 0.076012 Oct 19 03:28:19.942200 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1806/3682] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:28:19 2022] GET /compute/v2.1/images/cb8790e4-8520-4f34-9984-d5d9253c6556 => generated 1426 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:19.947060 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6619e131-eeca-414d-a877-6c0b28b39c6c tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:19.947674 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6619e131-eeca-414d-a877-6c0b28b39c6c tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] [instance: 5cc2003b-73ef-4a54-a22d-9cef47c6ed3f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:19.954437 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6619e131-eeca-414d-a877-6c0b28b39c6c tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:19.957011 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6619e131-eeca-414d-a877-6c0b28b39c6c tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:19.957011 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6619e131-eeca-414d-a877-6c0b28b39c6c tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:19.957011 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6619e131-eeca-414d-a877-6c0b28b39c6c tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:19.957499 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6619e131-eeca-414d-a877-6c0b28b39c6c tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:19.957710 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6619e131-eeca-414d-a877-6c0b28b39c6c tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:19.986087 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:28:20.153234 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6619e131-eeca-414d-a877-6c0b28b39c6c tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f" status: 200 len: 1858 microversion: 2.1 time: 0.209743 Oct 19 03:28:20.156094 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1807/3683] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:19 2022] GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f => generated 1858 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:20.162074 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-79ddbd15-ad9b-4321-9c99-7e232ce2918d req-f293c2e7-8f33-475e-aa21-a18ac585a68b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58b9ce4c-4a42-40ff-b8ed-b75de752b46f", "name": "network-vif-plugged", "status": "completed", "tag": "ff8c2e3f-1c6f-4ac7-b6b8-751825489845"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:28:20.174664 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-79ddbd15-ad9b-4321-9c99-7e232ce2918d req-f293c2e7-8f33-475e-aa21-a18ac585a68b service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:20.178541 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-79ddbd15-ad9b-4321-9c99-7e232ce2918d req-f293c2e7-8f33-475e-aa21-a18ac585a68b service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:20.178541 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-79ddbd15-ad9b-4321-9c99-7e232ce2918d req-f293c2e7-8f33-475e-aa21-a18ac585a68b service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:20.192226 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-79ddbd15-ad9b-4321-9c99-7e232ce2918d req-f293c2e7-8f33-475e-aa21-a18ac585a68b service nova] Creating event network-vif-plugged:ff8c2e3f-1c6f-4ac7-b6b8-751825489845 for instance 58b9ce4c-4a42-40ff-b8ed-b75de752b46f on n-h2-861333-8 Oct 19 03:28:20.198179 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-79ddbd15-ad9b-4321-9c99-7e232ce2918d req-f293c2e7-8f33-475e-aa21-a18ac585a68b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040638 Oct 19 03:28:20.199725 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1808/3684] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:28:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:28:20.208308 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-265070e7-e9e7-44bb-acb3-118394ebe8ab tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:20.208781 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-265070e7-e9e7-44bb-acb3-118394ebe8ab tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] [instance: 5cc2003b-73ef-4a54-a22d-9cef47c6ed3f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:20.218885 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-265070e7-e9e7-44bb-acb3-118394ebe8ab tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:20.219740 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-265070e7-e9e7-44bb-acb3-118394ebe8ab tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:20.220380 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-265070e7-e9e7-44bb-acb3-118394ebe8ab tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:20.221567 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-265070e7-e9e7-44bb-acb3-118394ebe8ab tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:20.222933 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-265070e7-e9e7-44bb-acb3-118394ebe8ab tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:20.223435 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-265070e7-e9e7-44bb-acb3-118394ebe8ab tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:20.439401 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-265070e7-e9e7-44bb-acb3-118394ebe8ab tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f" status: 200 len: 1858 microversion: 2.1 time: 0.236197 Oct 19 03:28:20.449956 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1809/3685] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:20 2022] GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f => generated 1858 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:20.466836 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-eeca8e2c-f7e9-4413-bff3-8cb084dd1e37 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:20.468006 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-eeca8e2c-f7e9-4413-bff3-8cb084dd1e37 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: 0051ff67-c0d0-4c84-a643-867d6416d8d1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:20.476965 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eeca8e2c-f7e9-4413-bff3-8cb084dd1e37 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:20.477506 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eeca8e2c-f7e9-4413-bff3-8cb084dd1e37 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:20.478154 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eeca8e2c-f7e9-4413-bff3-8cb084dd1e37 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:20.479044 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eeca8e2c-f7e9-4413-bff3-8cb084dd1e37 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:20.479664 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eeca8e2c-f7e9-4413-bff3-8cb084dd1e37 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:20.480257 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eeca8e2c-f7e9-4413-bff3-8cb084dd1e37 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:20.719856 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7f853fdd-57b5-4455-874d-c048f2810673 tempest-FloatingIPsTestJSON-619246542 tempest-FloatingIPsTestJSON-619246542-project] 10.222.0.52 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.194225 Oct 19 03:28:20.720817 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1877/3686] 10.222.0.52 () {60 vars in 1170 bytes} [Wed Oct 19 03:28:17 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:28:20.730075 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-eeca8e2c-f7e9-4413-bff3-8cb084dd1e37 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2b0581ad4e4c9787bef838c81870a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dfe251b1e046a995b8ec302cb2ffa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:28:20.732651 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c62884e0-de64-4e35-9173-4de29165893c tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:20.733231 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c62884e0-de64-4e35-9173-4de29165893c tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 5cc2003b-73ef-4a54-a22d-9cef47c6ed3f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:20.740684 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-eeca8e2c-f7e9-4413-bff3-8cb084dd1e37 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "GET /compute/v2.1/servers/0051ff67-c0d0-4c84-a643-867d6416d8d1" status: 200 len: 1512 microversion: 2.1 time: 0.289213 Oct 19 03:28:20.741666 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1810/3687] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:20 2022] GET /compute/v2.1/servers/0051ff67-c0d0-4c84-a643-867d6416d8d1 => generated 1512 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:20.750293 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c62884e0-de64-4e35-9173-4de29165893c tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:20.751076 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c62884e0-de64-4e35-9173-4de29165893c tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:20.751679 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c62884e0-de64-4e35-9173-4de29165893c tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:20.752549 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c62884e0-de64-4e35-9173-4de29165893c tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:20.753585 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c62884e0-de64-4e35-9173-4de29165893c tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:20.754177 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c62884e0-de64-4e35-9173-4de29165893c tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:20.754497 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ff44ae9c-193d-4685-a0ce-26f20aed30d6 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:20.755290 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ff44ae9c-193d-4685-a0ce-26f20aed30d6 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 3bb7abe9-5796-48da-bb31-aed0273716c7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:20.762843 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ff44ae9c-193d-4685-a0ce-26f20aed30d6 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:20.763423 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ff44ae9c-193d-4685-a0ce-26f20aed30d6 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:20.763932 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ff44ae9c-193d-4685-a0ce-26f20aed30d6 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:20.765665 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ff44ae9c-193d-4685-a0ce-26f20aed30d6 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:20.766211 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ff44ae9c-193d-4685-a0ce-26f20aed30d6 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:20.767048 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ff44ae9c-193d-4685-a0ce-26f20aed30d6 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:20.846305 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-c62884e0-de64-4e35-9173-4de29165893c tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lazy-loading 'services' on Instance uuid 5cc2003b-73ef-4a54-a22d-9cef47c6ed3f {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:28:20.941269 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ff44ae9c-193d-4685-a0ce-26f20aed30d6 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:28:20.949535 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ff44ae9c-193d-4685-a0ce-26f20aed30d6 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7" status: 200 len: 1511 microversion: 2.1 time: 0.206784 Oct 19 03:28:20.950130 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1811/3688] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:20 2022] GET /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7 => generated 1511 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:20.955202 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-32ab4215-73d7-49dd-b6ed-1ecf585d101e tempest-FloatingIPsTestJSON-619246542 tempest-FloatingIPsTestJSON-619246542-project] Calling method '.version_select at 0x7fc130054670>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:21.151415 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-32ab4215-73d7-49dd-b6ed-1ecf585d101e tempest-FloatingIPsTestJSON-619246542 tempest-FloatingIPsTestJSON-619246542-project] 10.222.0.52 "GET /compute/v2.1/os-floating-ips/2fbdbff6-fdb9-4f55-8b4d-e75b7536a400" status: 200 len: 141 microversion: 2.1 time: 0.199951 Oct 19 03:28:21.152016 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1812/3689] 10.222.0.52 () {58 vars in 1260 bytes} [Wed Oct 19 03:28:20 2022] GET /compute/v2.1/os-floating-ips/2fbdbff6-fdb9-4f55-8b4d-e75b7536a400 => generated 141 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:28:21.160877 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1f00c095-5528-4bc0-9a2d-773f3677d315 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:21.161539 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1f00c095-5528-4bc0-9a2d-773f3677d315 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:21.161677 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c62884e0-de64-4e35-9173-4de29165893c tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "DELETE /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f/os-volume_attachments/6e7015a0-8508-4edc-a024-86600bf259a0" status: 202 len: 0 microversion: 2.1 time: 0.436587 Oct 19 03:28:21.162397 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1878/3690] 10.222.0.52 () {58 vars in 1416 bytes} [Wed Oct 19 03:28:20 2022] DELETE /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f/os-volume_attachments/6e7015a0-8508-4edc-a024-86600bf259a0 => generated 0 bytes in 441 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:28:21.171553 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-28904057-a973-4fdf-b34b-26889ff62381 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Calling method '.version_select at 0x7fc130025310>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:21.176698 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1f00c095-5528-4bc0-9a2d-773f3677d315 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:21.182074 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1f00c095-5528-4bc0-9a2d-773f3677d315 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:21.182528 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1f00c095-5528-4bc0-9a2d-773f3677d315 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:21.183264 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1f00c095-5528-4bc0-9a2d-773f3677d315 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:21.183730 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1f00c095-5528-4bc0-9a2d-773f3677d315 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:21.187735 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1f00c095-5528-4bc0-9a2d-773f3677d315 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:21.236376 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-28904057-a973-4fdf-b34b-26889ff62381 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] 10.222.0.52 "GET /compute/v2.1/images/cb8790e4-8520-4f34-9984-d5d9253c6556" status: 200 len: 1426 microversion: 2.1 time: 0.069200 Oct 19 03:28:21.237469 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1879/3691] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:28:21 2022] GET /compute/v2.1/images/cb8790e4-8520-4f34-9984-d5d9253c6556 => generated 1426 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:21.246403 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2debf3c9-e197-4816-9335-fe2c1dd00c6d tempest-FloatingIPsTestJSON-619246542 tempest-FloatingIPsTestJSON-619246542-project] Calling method '.version_select at 0x7fc12bff8c10>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:21.512741 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-1f00c095-5528-4bc0-9a2d-773f3677d315 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:28:21.522291 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1f00c095-5528-4bc0-9a2d-773f3677d315 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1364 microversion: 2.1 time: 0.369218 Oct 19 03:28:21.545769 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1813/3692] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:21 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1364 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:21.552813 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-15befea7-7897-4a7a-bb59-f6be243f4162 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:21.555155 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-15befea7-7897-4a7a-bb59-f6be243f4162 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 5cc2003b-73ef-4a54-a22d-9cef47c6ed3f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:21.561817 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-15befea7-7897-4a7a-bb59-f6be243f4162 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:21.562334 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-15befea7-7897-4a7a-bb59-f6be243f4162 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:21.563155 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-15befea7-7897-4a7a-bb59-f6be243f4162 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:21.564094 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-15befea7-7897-4a7a-bb59-f6be243f4162 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:21.565035 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-15befea7-7897-4a7a-bb59-f6be243f4162 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:21.565745 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-15befea7-7897-4a7a-bb59-f6be243f4162 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:21.566605 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2debf3c9-e197-4816-9335-fe2c1dd00c6d tempest-FloatingIPsTestJSON-619246542 tempest-FloatingIPsTestJSON-619246542-project] 10.222.0.52 "GET /compute/v2.1/os-floating-ips" status: 200 len: 144 microversion: 2.1 time: 0.327108 Oct 19 03:28:21.567232 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1880/3693] 10.222.0.52 () {58 vars in 1149 bytes} [Wed Oct 19 03:28:21 2022] GET /compute/v2.1/os-floating-ips => generated 144 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:28:21.582698 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-618c7d32-6f3a-432f-bc36-a23181b1cd57 tempest-FloatingIPsTestJSON-619246542 tempest-FloatingIPsTestJSON-619246542-project] Calling method '.version_select at 0x7fc12bfaa4c0>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:21.614688 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-15befea7-7897-4a7a-bb59-f6be243f4162 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067448 Oct 19 03:28:21.620366 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1814/3694] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Oct 19 03:28:21 2022] GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:28:21.766182 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3d668a39-194a-49f3-977d-f60cf008bd85 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:21.767486 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3d668a39-194a-49f3-977d-f60cf008bd85 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: 0051ff67-c0d0-4c84-a643-867d6416d8d1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:21.775741 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3d668a39-194a-49f3-977d-f60cf008bd85 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:21.779412 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3d668a39-194a-49f3-977d-f60cf008bd85 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:21.779412 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3d668a39-194a-49f3-977d-f60cf008bd85 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:21.779412 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3d668a39-194a-49f3-977d-f60cf008bd85 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:21.779412 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3d668a39-194a-49f3-977d-f60cf008bd85 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:21.779805 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3d668a39-194a-49f3-977d-f60cf008bd85 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:22.068557 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-3d668a39-194a-49f3-977d-f60cf008bd85 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2b0581ad4e4c9787bef838c81870a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dfe251b1e046a995b8ec302cb2ffa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:28:22.077653 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3d668a39-194a-49f3-977d-f60cf008bd85 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "GET /compute/v2.1/servers/0051ff67-c0d0-4c84-a643-867d6416d8d1" status: 200 len: 1512 microversion: 2.1 time: 0.317159 Oct 19 03:28:22.078980 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1815/3695] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:21 2022] GET /compute/v2.1/servers/0051ff67-c0d0-4c84-a643-867d6416d8d1 => generated 1512 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:28:22.251141 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2ee7f92a-bda5-4e55-857b-c9311dc7a06f tempest-ComputeTenantNetworksTest-2007706636 tempest-ComputeTenantNetworksTest-2007706636-project] Calling method '.version_select at 0x7fc1300540d0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:22.510562 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2ee7f92a-bda5-4e55-857b-c9311dc7a06f tempest-ComputeTenantNetworksTest-2007706636 tempest-ComputeTenantNetworksTest-2007706636-project] 10.222.0.52 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 309 microversion: 2.1 time: 0.430272 Oct 19 03:28:22.511145 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1816/3696] 10.222.0.52 () {58 vars in 1158 bytes} [Wed Oct 19 03:28:22 2022] GET /compute/v2.1/os-tenant-networks => generated 309 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:28:22.516752 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5f838e9b-47e1-479b-8b50-be9c96e48feb tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:22.517886 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5f838e9b-47e1-479b-8b50-be9c96e48feb tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 3bb7abe9-5796-48da-bb31-aed0273716c7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:22.525403 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5f838e9b-47e1-479b-8b50-be9c96e48feb tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:22.526714 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5f838e9b-47e1-479b-8b50-be9c96e48feb tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:22.526714 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5f838e9b-47e1-479b-8b50-be9c96e48feb tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:22.527310 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5f838e9b-47e1-479b-8b50-be9c96e48feb tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:22.527985 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5f838e9b-47e1-479b-8b50-be9c96e48feb tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:22.528545 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5f838e9b-47e1-479b-8b50-be9c96e48feb tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:22.671377 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5f838e9b-47e1-479b-8b50-be9c96e48feb tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:28:22.680504 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5f838e9b-47e1-479b-8b50-be9c96e48feb tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7" status: 200 len: 1511 microversion: 2.1 time: 0.167873 Oct 19 03:28:22.681206 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1817/3697] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:22 2022] GET /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7 => generated 1511 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:22.689745 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ab35b532-441d-43da-9c4d-a6fa705a8ffd tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Calling method '.version_select at 0x7fc1300b4670>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:22.750759 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ab35b532-441d-43da-9c4d-a6fa705a8ffd tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] 10.222.0.52 "GET /compute/v2.1/images/cb8790e4-8520-4f34-9984-d5d9253c6556" status: 200 len: 1426 microversion: 2.1 time: 0.068089 Oct 19 03:28:22.751427 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1818/3698] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:28:22 2022] GET /compute/v2.1/images/cb8790e4-8520-4f34-9984-d5d9253c6556 => generated 1426 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:22.764889 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-07c78504-5f6a-4a13-b65b-e7c5d99328cf tempest-ComputeTenantNetworksTest-2007706636 tempest-ComputeTenantNetworksTest-2007706636-project] Calling method '.version_select at 0x7fc1300cd310>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:22.777265 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-618c7d32-6f3a-432f-bc36-a23181b1cd57 tempest-FloatingIPsTestJSON-619246542 tempest-FloatingIPsTestJSON-619246542-project] 10.222.0.52 "DELETE /compute/v2.1/os-floating-ips/2fbdbff6-fdb9-4f55-8b4d-e75b7536a400" status: 202 len: 0 microversion: 2.1 time: 1.200864 Oct 19 03:28:22.778280 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1881/3699] 10.222.0.52 () {58 vars in 1263 bytes} [Wed Oct 19 03:28:21 2022] DELETE /compute/v2.1/os-floating-ips/2fbdbff6-fdb9-4f55-8b4d-e75b7536a400 => generated 0 bytes in 1202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:28:22.782981 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0d7db559-9258-4d94-abd9-ce3b6f468765 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:22.783820 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0d7db559-9258-4d94-abd9-ce3b6f468765 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:22.786634 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=71 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:28:22.792076 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0d7db559-9258-4d94-abd9-ce3b6f468765 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:22.792542 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0d7db559-9258-4d94-abd9-ce3b6f468765 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:22.797780 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0d7db559-9258-4d94-abd9-ce3b6f468765 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:22.797780 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0d7db559-9258-4d94-abd9-ce3b6f468765 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:22.797780 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0d7db559-9258-4d94-abd9-ce3b6f468765 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:22.797780 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0d7db559-9258-4d94-abd9-ce3b6f468765 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:22.904896 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-07c78504-5f6a-4a13-b65b-e7c5d99328cf tempest-ComputeTenantNetworksTest-2007706636 tempest-ComputeTenantNetworksTest-2007706636-project] 10.222.0.52 "GET /compute/v2.1/os-tenant-networks/b2b62cb6-184e-434c-94fe-a75782bd8332" status: 200 len: 140 microversion: 2.1 time: 0.143944 Oct 19 03:28:22.906379 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1819/3700] 10.222.0.52 () {58 vars in 1269 bytes} [Wed Oct 19 03:28:22 2022] GET /compute/v2.1/os-tenant-networks/b2b62cb6-184e-434c-94fe-a75782bd8332 => generated 140 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:28:22.911969 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-655fe958-5abe-481f-aa0d-7535d0730ca1 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:22.914403 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-655fe958-5abe-481f-aa0d-7535d0730ca1 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 5cc2003b-73ef-4a54-a22d-9cef47c6ed3f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:22.927345 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-655fe958-5abe-481f-aa0d-7535d0730ca1 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:22.928177 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-655fe958-5abe-481f-aa0d-7535d0730ca1 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:22.928885 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-655fe958-5abe-481f-aa0d-7535d0730ca1 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:22.929943 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-655fe958-5abe-481f-aa0d-7535d0730ca1 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:22.930692 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-655fe958-5abe-481f-aa0d-7535d0730ca1 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:22.931347 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-655fe958-5abe-481f-aa0d-7535d0730ca1 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:22.970349 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-655fe958-5abe-481f-aa0d-7535d0730ca1 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063658 Oct 19 03:28:22.972496 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1820/3701] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Oct 19 03:28:22 2022] GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:28:22.984279 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0cb78bed-e9d4-4cb3-a8c5-22d580eaa362 tempest-FloatingIPsTestJSON-619246542 tempest-FloatingIPsTestJSON-619246542-project] Action: 'create', calling method: .version_select at 0x7fc1300cd310>, body: {"pool": null} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:28:22.985885 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-0d7db559-9258-4d94-abd9-ce3b6f468765 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:28:22.996728 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0d7db559-9258-4d94-abd9-ce3b6f468765 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1551 microversion: 2.1 time: 0.217474 Oct 19 03:28:22.997733 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1882/3702] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:22 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1551 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:23.025817 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a450dece-0521-4c33-b0f3-8c1cde248b7d tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:23.026593 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a450dece-0521-4c33-b0f3-8c1cde248b7d tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:23.038386 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a450dece-0521-4c33-b0f3-8c1cde248b7d tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:23.039506 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a450dece-0521-4c33-b0f3-8c1cde248b7d tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:23.040183 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a450dece-0521-4c33-b0f3-8c1cde248b7d tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:23.041329 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a450dece-0521-4c33-b0f3-8c1cde248b7d tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:23.042040 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a450dece-0521-4c33-b0f3-8c1cde248b7d tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:23.042694 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a450dece-0521-4c33-b0f3-8c1cde248b7d tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:23.180699 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a450dece-0521-4c33-b0f3-8c1cde248b7d tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.164097 Oct 19 03:28:23.181685 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1883/3703] 10.222.0.52 () {58 vars in 1275 bytes} [Wed Oct 19 03:28:23 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f/os-interface => generated 284 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:28:23.188826 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1fe9af69-6d27-426f-a733-f1fb5d1b7b1a tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:23.189798 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1fe9af69-6d27-426f-a733-f1fb5d1b7b1a tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: 0051ff67-c0d0-4c84-a643-867d6416d8d1] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:23.207626 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1fe9af69-6d27-426f-a733-f1fb5d1b7b1a tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:23.208151 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1fe9af69-6d27-426f-a733-f1fb5d1b7b1a tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:23.208589 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1fe9af69-6d27-426f-a733-f1fb5d1b7b1a tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:23.209998 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1fe9af69-6d27-426f-a733-f1fb5d1b7b1a tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:23.212993 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1fe9af69-6d27-426f-a733-f1fb5d1b7b1a tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:23.214291 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1fe9af69-6d27-426f-a733-f1fb5d1b7b1a tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:23.649288 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-1fe9af69-6d27-426f-a733-f1fb5d1b7b1a tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2b0581ad4e4c9787bef838c81870a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dfe251b1e046a995b8ec302cb2ffa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:28:23.661352 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1fe9af69-6d27-426f-a733-f1fb5d1b7b1a tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "GET /compute/v2.1/servers/0051ff67-c0d0-4c84-a643-867d6416d8d1" status: 200 len: 1512 microversion: 2.1 time: 0.477793 Oct 19 03:28:23.663207 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1884/3704] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:23 2022] GET /compute/v2.1/servers/0051ff67-c0d0-4c84-a643-867d6416d8d1 => generated 1512 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:23.683431 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-f9486f6c-a44c-4dfd-8c28-5527b93d53e4 req-af03caf7-644c-4f77-9e74-d35de17a13a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bfbe3fa-5e16-4b72-8232-7cf260c78f0a", "name": "network-vif-plugged", "status": "completed", "tag": "4cf986cf-c812-445d-9c71-bf2c9df9bf7f"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:28:23.700649 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-f9486f6c-a44c-4dfd-8c28-5527b93d53e4 req-af03caf7-644c-4f77-9e74-d35de17a13a9 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:23.701459 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-f9486f6c-a44c-4dfd-8c28-5527b93d53e4 req-af03caf7-644c-4f77-9e74-d35de17a13a9 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:23.702104 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-f9486f6c-a44c-4dfd-8c28-5527b93d53e4 req-af03caf7-644c-4f77-9e74-d35de17a13a9 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:23.721428 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-f9486f6c-a44c-4dfd-8c28-5527b93d53e4 req-af03caf7-644c-4f77-9e74-d35de17a13a9 service nova] Creating event network-vif-plugged:4cf986cf-c812-445d-9c71-bf2c9df9bf7f for instance 3bfbe3fa-5e16-4b72-8232-7cf260c78f0a on n-h1-861333-8 Oct 19 03:28:23.738964 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-f9486f6c-a44c-4dfd-8c28-5527b93d53e4 req-af03caf7-644c-4f77-9e74-d35de17a13a9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063950 Oct 19 03:28:23.738964 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1885/3705] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:28:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:28:23.738964 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-090721df-6dc4-423b-94ac-ad01c7f35b34 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:23.738964 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-090721df-6dc4-423b-94ac-ad01c7f35b34 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 3bb7abe9-5796-48da-bb31-aed0273716c7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:23.742931 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-090721df-6dc4-423b-94ac-ad01c7f35b34 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:23.744103 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-090721df-6dc4-423b-94ac-ad01c7f35b34 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:23.745223 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-090721df-6dc4-423b-94ac-ad01c7f35b34 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:23.746148 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-090721df-6dc4-423b-94ac-ad01c7f35b34 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:23.746794 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-090721df-6dc4-423b-94ac-ad01c7f35b34 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:23.747411 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-090721df-6dc4-423b-94ac-ad01c7f35b34 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:24.417070 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-090721df-6dc4-423b-94ac-ad01c7f35b34 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:28:24.425689 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-090721df-6dc4-423b-94ac-ad01c7f35b34 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7" status: 200 len: 1511 microversion: 2.1 time: 0.694812 Oct 19 03:28:24.426426 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1886/3706] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:23 2022] GET /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7 => generated 1511 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:24.448166 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-37c8d278-d242-4a5d-9684-cffdba8aecad tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Calling method '.version_select at 0x7fc12bf488b0>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:24.498889 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-37c8d278-d242-4a5d-9684-cffdba8aecad tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] 10.222.0.52 "GET /compute/v2.1/images/cb8790e4-8520-4f34-9984-d5d9253c6556" status: 200 len: 1426 microversion: 2.1 time: 0.058763 Oct 19 03:28:24.499564 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1887/3707] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:28:24 2022] GET /compute/v2.1/images/cb8790e4-8520-4f34-9984-d5d9253c6556 => generated 1426 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:24.504714 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-42c0cfce-9baa-4502-982c-331a6ec0e302 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:24.507153 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-42c0cfce-9baa-4502-982c-331a6ec0e302 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 5cc2003b-73ef-4a54-a22d-9cef47c6ed3f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:24.513709 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-42c0cfce-9baa-4502-982c-331a6ec0e302 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:24.514421 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-42c0cfce-9baa-4502-982c-331a6ec0e302 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:24.515265 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-42c0cfce-9baa-4502-982c-331a6ec0e302 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:24.516144 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-42c0cfce-9baa-4502-982c-331a6ec0e302 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:24.516741 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-42c0cfce-9baa-4502-982c-331a6ec0e302 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:24.517319 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-42c0cfce-9baa-4502-982c-331a6ec0e302 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:24.555303 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-42c0cfce-9baa-4502-982c-331a6ec0e302 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054415 Oct 19 03:28:24.556780 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1888/3708] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Oct 19 03:28:24 2022] GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:28:24.687182 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2226e0d6-cb14-4317-bfae-22746824a60e tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:24.687850 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-2226e0d6-cb14-4317-bfae-22746824a60e tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: 0051ff67-c0d0-4c84-a643-867d6416d8d1] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:24.695335 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2226e0d6-cb14-4317-bfae-22746824a60e tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:24.695852 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2226e0d6-cb14-4317-bfae-22746824a60e tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:24.696301 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2226e0d6-cb14-4317-bfae-22746824a60e tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:24.697013 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2226e0d6-cb14-4317-bfae-22746824a60e tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:24.697600 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2226e0d6-cb14-4317-bfae-22746824a60e tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:24.698069 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2226e0d6-cb14-4317-bfae-22746824a60e tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:25.075470 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-2226e0d6-cb14-4317-bfae-22746824a60e tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2b0581ad4e4c9787bef838c81870a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dfe251b1e046a995b8ec302cb2ffa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:28:25.085878 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2226e0d6-cb14-4317-bfae-22746824a60e tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "GET /compute/v2.1/servers/0051ff67-c0d0-4c84-a643-867d6416d8d1" status: 200 len: 1512 microversion: 2.1 time: 0.403169 Oct 19 03:28:25.104385 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1889/3709] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:24 2022] GET /compute/v2.1/servers/0051ff67-c0d0-4c84-a643-867d6416d8d1 => generated 1512 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:25.317259 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-e137647f-04e4-446b-8ee8-3eda4dafe247 req-7568cdad-5476-413b-b9cd-b3b238d0c789 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58b9ce4c-4a42-40ff-b8ed-b75de752b46f", "tag": "ff8c2e3f-1c6f-4ac7-b6b8-751825489845"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:28:25.336858 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-e137647f-04e4-446b-8ee8-3eda4dafe247 req-7568cdad-5476-413b-b9cd-b3b238d0c789 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:25.337898 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-e137647f-04e4-446b-8ee8-3eda4dafe247 req-7568cdad-5476-413b-b9cd-b3b238d0c789 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:25.338360 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-e137647f-04e4-446b-8ee8-3eda4dafe247 req-7568cdad-5476-413b-b9cd-b3b238d0c789 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:25.355639 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-e137647f-04e4-446b-8ee8-3eda4dafe247 req-7568cdad-5476-413b-b9cd-b3b238d0c789 service nova] Creating event network-changed:ff8c2e3f-1c6f-4ac7-b6b8-751825489845 for instance 58b9ce4c-4a42-40ff-b8ed-b75de752b46f on n-h2-861333-8 Oct 19 03:28:25.367726 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-e137647f-04e4-446b-8ee8-3eda4dafe247 req-7568cdad-5476-413b-b9cd-b3b238d0c789 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051026 Oct 19 03:28:25.367726 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1890/3710] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:28:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:28:25.453681 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4f70f3c5-3e09-418b-8444-98579e398073 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:25.454392 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4f70f3c5-3e09-418b-8444-98579e398073 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 3bb7abe9-5796-48da-bb31-aed0273716c7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:25.464850 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4f70f3c5-3e09-418b-8444-98579e398073 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:25.469162 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4f70f3c5-3e09-418b-8444-98579e398073 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:25.469162 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4f70f3c5-3e09-418b-8444-98579e398073 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:25.469162 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4f70f3c5-3e09-418b-8444-98579e398073 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:25.469162 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4f70f3c5-3e09-418b-8444-98579e398073 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:25.469640 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4f70f3c5-3e09-418b-8444-98579e398073 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:25.844890 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4f70f3c5-3e09-418b-8444-98579e398073 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:28:25.857052 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4f70f3c5-3e09-418b-8444-98579e398073 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7" status: 200 len: 1511 microversion: 2.1 time: 0.407539 Oct 19 03:28:25.858869 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1891/3711] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:25 2022] GET /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7 => generated 1511 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:28:25.873362 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c1483b7d-8085-4dcf-822e-7ade36d0fa3b tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Calling method '.version_select at 0x7fc130b2d160>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:25.975756 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c1483b7d-8085-4dcf-822e-7ade36d0fa3b tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] 10.222.0.52 "GET /compute/v2.1/images/cb8790e4-8520-4f34-9984-d5d9253c6556" status: 200 len: 1426 microversion: 2.1 time: 0.115685 Oct 19 03:28:25.976347 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1892/3712] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:28:25 2022] GET /compute/v2.1/images/cb8790e4-8520-4f34-9984-d5d9253c6556 => generated 1426 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:25.982734 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e7103d81-7f5d-423a-8bfd-bbe7c42a7f9d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:26.013829 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e7103d81-7f5d-423a-8bfd-bbe7c42a7f9d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 5cc2003b-73ef-4a54-a22d-9cef47c6ed3f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:26.029753 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e7103d81-7f5d-423a-8bfd-bbe7c42a7f9d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:26.032683 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e7103d81-7f5d-423a-8bfd-bbe7c42a7f9d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:26.033134 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e7103d81-7f5d-423a-8bfd-bbe7c42a7f9d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:26.036536 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e7103d81-7f5d-423a-8bfd-bbe7c42a7f9d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:26.037023 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e7103d81-7f5d-423a-8bfd-bbe7c42a7f9d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:26.037596 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e7103d81-7f5d-423a-8bfd-bbe7c42a7f9d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:26.115036 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e7103d81-7f5d-423a-8bfd-bbe7c42a7f9d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.133936 Oct 19 03:28:26.123306 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1893/3713] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Oct 19 03:28:25 2022] GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f/os-volume_attachments => generated 197 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:28:26.136193 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f2396f80-c432-42b3-b132-275a5aee450a tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:26.136986 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f2396f80-c432-42b3-b132-275a5aee450a tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: 0051ff67-c0d0-4c84-a643-867d6416d8d1] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:26.147720 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f2396f80-c432-42b3-b132-275a5aee450a tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:26.148355 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f2396f80-c432-42b3-b132-275a5aee450a tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:26.148940 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f2396f80-c432-42b3-b132-275a5aee450a tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:26.149793 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f2396f80-c432-42b3-b132-275a5aee450a tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:26.150347 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f2396f80-c432-42b3-b132-275a5aee450a tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:26.150885 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f2396f80-c432-42b3-b132-275a5aee450a tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:26.328473 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0cb78bed-e9d4-4cb3-a8c5-22d580eaa362 tempest-FloatingIPsTestJSON-619246542 tempest-FloatingIPsTestJSON-619246542-project] 10.222.0.52 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.349187 Oct 19 03:28:26.329204 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1821/3714] 10.222.0.52 () {60 vars in 1170 bytes} [Wed Oct 19 03:28:22 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:28:26.341702 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-15e7412d-21bd-4c85-9dc1-9dd0374957d7 tempest-FloatingIPsTestJSON-619246542 tempest-FloatingIPsTestJSON-619246542-project] Calling method '.version_select at 0x7fc130054c10>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:26.447256 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f2396f80-c432-42b3-b132-275a5aee450a tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2b0581ad4e4c9787bef838c81870a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dfe251b1e046a995b8ec302cb2ffa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:28:26.458349 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f2396f80-c432-42b3-b132-275a5aee450a tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "GET /compute/v2.1/servers/0051ff67-c0d0-4c84-a643-867d6416d8d1" status: 200 len: 1512 microversion: 2.1 time: 0.333752 Oct 19 03:28:26.474444 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1894/3715] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:26 2022] GET /compute/v2.1/servers/0051ff67-c0d0-4c84-a643-867d6416d8d1 => generated 1512 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:26.886638 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6c31736f-4b8f-4aad-9dca-933bb2727838 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:26.887667 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6c31736f-4b8f-4aad-9dca-933bb2727838 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 3bb7abe9-5796-48da-bb31-aed0273716c7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:26.928061 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6c31736f-4b8f-4aad-9dca-933bb2727838 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:26.928570 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6c31736f-4b8f-4aad-9dca-933bb2727838 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:26.929016 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6c31736f-4b8f-4aad-9dca-933bb2727838 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:26.929825 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6c31736f-4b8f-4aad-9dca-933bb2727838 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:26.930288 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6c31736f-4b8f-4aad-9dca-933bb2727838 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:26.930719 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6c31736f-4b8f-4aad-9dca-933bb2727838 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:27.227465 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-6c31736f-4b8f-4aad-9dca-933bb2727838 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:28:27.241609 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6c31736f-4b8f-4aad-9dca-933bb2727838 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7" status: 200 len: 1511 microversion: 2.1 time: 0.360678 Oct 19 03:28:27.243607 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1895/3716] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:26 2022] GET /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7 => generated 1511 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:28:27.256464 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a118f587-59d5-4a49-88a2-7653a3a4a162 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Calling method '.version_select at 0x7fc130015c10>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:27.341106 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a118f587-59d5-4a49-88a2-7653a3a4a162 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] 10.222.0.52 "GET /compute/v2.1/images/cb8790e4-8520-4f34-9984-d5d9253c6556" status: 200 len: 1426 microversion: 2.1 time: 0.096198 Oct 19 03:28:27.343914 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1896/3717] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:28:27 2022] GET /compute/v2.1/images/cb8790e4-8520-4f34-9984-d5d9253c6556 => generated 1426 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:27.350368 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ad20ac28-5ce9-4c31-bca1-53011c680107 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:27.352536 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ad20ac28-5ce9-4c31-bca1-53011c680107 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 5cc2003b-73ef-4a54-a22d-9cef47c6ed3f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:27.358935 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ad20ac28-5ce9-4c31-bca1-53011c680107 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:27.359979 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ad20ac28-5ce9-4c31-bca1-53011c680107 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:27.360617 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ad20ac28-5ce9-4c31-bca1-53011c680107 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:27.361298 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ad20ac28-5ce9-4c31-bca1-53011c680107 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:27.361777 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ad20ac28-5ce9-4c31-bca1-53011c680107 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:27.362257 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ad20ac28-5ce9-4c31-bca1-53011c680107 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:27.396741 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ad20ac28-5ce9-4c31-bca1-53011c680107 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051081 Oct 19 03:28:27.397332 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1897/3718] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Oct 19 03:28:27 2022] GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 03:28:27.481972 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9128ddda-ba45-4537-bd1d-65d9e6528cd8 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:27.482802 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9128ddda-ba45-4537-bd1d-65d9e6528cd8 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: 0051ff67-c0d0-4c84-a643-867d6416d8d1] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:27.489582 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9128ddda-ba45-4537-bd1d-65d9e6528cd8 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:27.490305 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9128ddda-ba45-4537-bd1d-65d9e6528cd8 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:27.491371 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9128ddda-ba45-4537-bd1d-65d9e6528cd8 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:27.492293 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9128ddda-ba45-4537-bd1d-65d9e6528cd8 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:27.492950 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9128ddda-ba45-4537-bd1d-65d9e6528cd8 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:27.493958 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9128ddda-ba45-4537-bd1d-65d9e6528cd8 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:27.657405 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-15e7412d-21bd-4c85-9dc1-9dd0374957d7 tempest-FloatingIPsTestJSON-619246542 tempest-FloatingIPsTestJSON-619246542-project] 10.222.0.52 "DELETE /compute/v2.1/os-floating-ips/67e8fcb4-bb54-4273-9c30-d50cf48abead" status: 202 len: 0 microversion: 2.1 time: 1.319356 Oct 19 03:28:27.661476 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1822/3719] 10.222.0.52 () {58 vars in 1263 bytes} [Wed Oct 19 03:28:26 2022] DELETE /compute/v2.1/os-floating-ips/67e8fcb4-bb54-4273-9c30-d50cf48abead => generated 0 bytes in 1321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 19 03:28:27.667178 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2044c2d4-b812-40a1-82a6-6d75d0deb1c4 tempest-FloatingIPsTestJSON-619246542 tempest-FloatingIPsTestJSON-619246542-project] Calling method '.version_select at 0x7fc130098f70>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:27.728805 n-d-861333-8 devstack@n-api.service[121134]: DEBUG neutronclient.v2_0.client [None req-2044c2d4-b812-40a1-82a6-6d75d0deb1c4 tempest-FloatingIPsTestJSON-619246542 tempest-FloatingIPsTestJSON-619246542-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 67e8fcb4-bb54-4273-9c30-d50cf48abead could not be found", "detail": ""}} {{(pid=121134) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 19 03:28:27.729832 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-2044c2d4-b812-40a1-82a6-6d75d0deb1c4 tempest-FloatingIPsTestJSON-619246542 tempest-FloatingIPsTestJSON-619246542-project] HTTP exception thrown: Floating IP not found for ID 67e8fcb4-bb54-4273-9c30-d50cf48abead Oct 19 03:28:27.733652 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2044c2d4-b812-40a1-82a6-6d75d0deb1c4 tempest-FloatingIPsTestJSON-619246542 tempest-FloatingIPsTestJSON-619246542-project] Request method failure captured: Oct 19 03:28:27.733652 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/os-floating-ips/67e8fcb4-bb54-4273-9c30-d50cf48abead HTTP/1.1 Oct 19 03:28:27.733652 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:28:27.733652 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:28:27.733652 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:28:27.733652 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:28:27.733652 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:28:27.733652 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:28:27.733652 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:28:27.733652 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:28:27.733652 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT27R0MbMdtPmniveX80f_N27C6rDlmzbe24k3_OTRqhu6rKjXycKGRkyx5g8jjVh8diYs0Ud6vEGaaYT2BM3O7M_fxnd35BQdYron12JZUvHNTqpQ1AYlYoAwcpanLcC5yGXiU7g2LOgBXWXuj6Xq5ZDtfc1KZpEkUmvHkn5IGF2FaQ Oct 19 03:28:27.733652 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:28:27.733652 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:28:27.733652 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:28:27.733652 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:28:27.733652 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:28:27.733652 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:28:27.733652 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: a195fa6d0901477c9b4e0d426f53814b Oct 19 03:28:27.733652 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-FloatingIPsTestJSON-619246542 Oct 19 03:28:27.733652 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:28:27.733652 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:28:27.735242 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a195fa6d0901477c9b4e0d426f53814b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a195fa6d0901477c9b4e0d426f53814b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a195fa6d0901477c9b4e0d426f53814b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a195fa6d0901477c9b4e0d426f53814b", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:28:27.735242 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-FloatingIPsTestJSON-619246542 Oct 19 03:28:27.735242 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: a195fa6d0901477c9b4e0d426f53814b Oct 19 03:28:27.735242 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-FloatingIPsTestJSON-619246542 Oct 19 03:28:27.735242 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-FloatingIPsTestJSON-619246542-project Oct 19 03:28:27.735242 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:28:27.735242 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:28:27.735242 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 8d8810952312496395845838cbbbda5c Oct 19 03:28:27.735242 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-FloatingIPsTestJSON-619246542-project Oct 19 03:28:27.735242 n-d-861333-8 devstack@n-api.service[121134]: method: Oct 19 03:28:27.735242 n-d-861333-8 devstack@n-api.service[121134]: exception: Floating IP not found for ID 67e8fcb4-bb54-4273-9c30-d50cf48abead Oct 19 03:28:27.735242 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '67e8fcb4-bb54-4273-9c30-d50cf48abead'} Oct 19 03:28:27.735242 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:28:27.736277 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:28:27.736277 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 19 03:28:27.736277 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 19 03:28:27.736277 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:28:27.736277 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:28:27.736277 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 19 03:28:27.736277 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 19 03:28:27.736277 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:28:27.736277 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:28:27.736277 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 19 03:28:27.736277 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 19 03:28:27.736277 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:28:27.736277 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:28:27.736277 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 19 03:28:27.736277 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 19 03:28:27.736277 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:28:27.736277 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:28:27.736277 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 19 03:28:27.736277 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 19 03:28:27.737584 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:28:27.737584 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:28:27.737584 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 19 03:28:27.737584 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 19 03:28:27.737584 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 19 03:28:27.737584 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 19 03:28:27.737584 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 67e8fcb4-bb54-4273-9c30-d50cf48abead could not be found Oct 19 03:28:27.737584 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-05fb65dd-0e55-4f79-85fb-2e0c9fddcb86'] Oct 19 03:28:27.737584 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:28:27.737584 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:28:27.737584 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:28:27.737584 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:28:27.737584 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 19 03:28:27.737584 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 19 03:28:27.737584 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 19 03:28:27.737584 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 19 03:28:27.737584 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 67e8fcb4-bb54-4273-9c30-d50cf48abead. Oct 19 03:28:27.737584 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:28:27.737584 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:28:27.737584 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:28:27.741880 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:28:27.741880 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:28:27.741880 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:28:27.741880 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:28:27.741880 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:28:27.741880 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 03:28:27.741880 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 03:28:27.741880 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:28:27.741880 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:28:27.741880 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 19 03:28:27.741880 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 19 03:28:27.741880 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 67e8fcb4-bb54-4273-9c30-d50cf48abead Oct 19 03:28:27.741880 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:28:27.741880 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:28:27.741880 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:28:27.741880 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:28:27.741880 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:28:27.741880 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:28:27.741880 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:28:27.741880 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:28:27.748471 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 67e8fcb4-bb54-4273-9c30-d50cf48abead Oct 19 03:28:27.748471 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:28:27.748471 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2044c2d4-b812-40a1-82a6-6d75d0deb1c4 tempest-FloatingIPsTestJSON-619246542 tempest-FloatingIPsTestJSON-619246542-project] Returning 404 to user: Floating IP not found for ID 67e8fcb4-bb54-4273-9c30-d50cf48abead {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:28:27.748471 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2044c2d4-b812-40a1-82a6-6d75d0deb1c4 tempest-FloatingIPsTestJSON-619246542 tempest-FloatingIPsTestJSON-619246542-project] 10.222.0.52 "GET /compute/v2.1/os-floating-ips/67e8fcb4-bb54-4273-9c30-d50cf48abead" status: 404 len: 111 microversion: 2.1 time: 0.073759 Oct 19 03:28:27.749225 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-9128ddda-ba45-4537-bd1d-65d9e6528cd8 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2b0581ad4e4c9787bef838c81870a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dfe251b1e046a995b8ec302cb2ffa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:28:27.749634 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1823/3720] 10.222.0.52 () {58 vars in 1260 bytes} [Wed Oct 19 03:28:27 2022] GET /compute/v2.1/os-floating-ips/67e8fcb4-bb54-4273-9c30-d50cf48abead => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:28:27.749827 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9128ddda-ba45-4537-bd1d-65d9e6528cd8 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "GET /compute/v2.1/servers/0051ff67-c0d0-4c84-a643-867d6416d8d1" status: 200 len: 1512 microversion: 2.1 time: 0.270960 Oct 19 03:28:27.750680 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1898/3721] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:27 2022] GET /compute/v2.1/servers/0051ff67-c0d0-4c84-a643-867d6416d8d1 => generated 1512 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:28:27.761767 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1bfa1b62-7c5c-4646-9074-c0e84abd8e80 tempest-FloatingIPsTestJSON-619246542 tempest-FloatingIPsTestJSON-619246542-project] Calling method '.version_select at 0x7fc134f251f0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:27.848787 n-d-861333-8 devstack@n-api.service[121134]: DEBUG neutronclient.v2_0.client [None req-1bfa1b62-7c5c-4646-9074-c0e84abd8e80 tempest-FloatingIPsTestJSON-619246542 tempest-FloatingIPsTestJSON-619246542-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 67e8fcb4-bb54-4273-9c30-d50cf48abead could not be found", "detail": ""}} {{(pid=121134) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 19 03:28:27.849526 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-1bfa1b62-7c5c-4646-9074-c0e84abd8e80 tempest-FloatingIPsTestJSON-619246542 tempest-FloatingIPsTestJSON-619246542-project] HTTP exception thrown: Floating IP not found for ID 67e8fcb4-bb54-4273-9c30-d50cf48abead Oct 19 03:28:27.851383 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1bfa1b62-7c5c-4646-9074-c0e84abd8e80 tempest-FloatingIPsTestJSON-619246542 tempest-FloatingIPsTestJSON-619246542-project] Request method failure captured: Oct 19 03:28:27.851383 n-d-861333-8 devstack@n-api.service[121134]: request: DELETE /compute/v2.1/os-floating-ips/67e8fcb4-bb54-4273-9c30-d50cf48abead HTTP/1.1 Oct 19 03:28:27.851383 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:28:27.851383 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:28:27.851383 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:28:27.851383 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:28:27.851383 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:28:27.851383 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:28:27.851383 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:28:27.851383 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:28:27.851383 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT27R0MbMdtPmniveX80f_N27C6rDlmzbe24k3_OTRqhu6rKjXycKGRkyx5g8jjVh8diYs0Ud6vEGaaYT2BM3O7M_fxnd35BQdYron12JZUvHNTqpQ1AYlYoAwcpanLcC5yGXiU7g2LOgBXWXuj6Xq5ZDtfc1KZpEkUmvHkn5IGF2FaQ Oct 19 03:28:27.851383 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:28:27.851383 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:28:27.851383 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:28:27.851383 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:28:27.851383 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:28:27.851383 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:28:27.851383 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: a195fa6d0901477c9b4e0d426f53814b Oct 19 03:28:27.851383 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-FloatingIPsTestJSON-619246542 Oct 19 03:28:27.851383 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:28:27.851383 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:28:27.852792 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a195fa6d0901477c9b4e0d426f53814b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a195fa6d0901477c9b4e0d426f53814b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a195fa6d0901477c9b4e0d426f53814b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a195fa6d0901477c9b4e0d426f53814b", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:28:27.852792 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-FloatingIPsTestJSON-619246542 Oct 19 03:28:27.852792 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: a195fa6d0901477c9b4e0d426f53814b Oct 19 03:28:27.852792 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-FloatingIPsTestJSON-619246542 Oct 19 03:28:27.852792 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-FloatingIPsTestJSON-619246542-project Oct 19 03:28:27.852792 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:28:27.852792 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:28:27.852792 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 8d8810952312496395845838cbbbda5c Oct 19 03:28:27.852792 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-FloatingIPsTestJSON-619246542-project Oct 19 03:28:27.852792 n-d-861333-8 devstack@n-api.service[121134]: method: Oct 19 03:28:27.852792 n-d-861333-8 devstack@n-api.service[121134]: exception: Floating IP not found for ID 67e8fcb4-bb54-4273-9c30-d50cf48abead Oct 19 03:28:27.852792 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '67e8fcb4-bb54-4273-9c30-d50cf48abead'} Oct 19 03:28:27.852792 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:28:27.853633 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:28:27.853633 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 19 03:28:27.853633 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 19 03:28:27.853633 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:28:27.853633 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:28:27.853633 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 19 03:28:27.853633 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 19 03:28:27.853633 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:28:27.853633 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:28:27.853633 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 19 03:28:27.853633 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 19 03:28:27.853633 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:28:27.853633 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:28:27.853633 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 19 03:28:27.853633 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 19 03:28:27.853633 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:28:27.853633 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:28:27.853633 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 19 03:28:27.853633 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 19 03:28:27.854907 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:28:27.854907 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:28:27.854907 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 19 03:28:27.854907 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 19 03:28:27.854907 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 19 03:28:27.854907 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 19 03:28:27.854907 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 67e8fcb4-bb54-4273-9c30-d50cf48abead could not be found Oct 19 03:28:27.854907 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4013885e-3b8f-441c-9128-7cc18d794b17'] Oct 19 03:28:27.854907 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:28:27.854907 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:28:27.854907 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:28:27.854907 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:28:27.854907 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 19 03:28:27.854907 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 19 03:28:27.854907 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 19 03:28:27.854907 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 19 03:28:27.854907 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 67e8fcb4-bb54-4273-9c30-d50cf48abead. Oct 19 03:28:27.854907 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:28:27.854907 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:28:27.854907 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:28:27.856157 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:28:27.856157 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:28:27.856157 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:28:27.856157 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:28:27.856157 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:28:27.856157 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 03:28:27.856157 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 03:28:27.856157 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:28:27.856157 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:28:27.856157 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 19 03:28:27.856157 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 19 03:28:27.856157 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 67e8fcb4-bb54-4273-9c30-d50cf48abead Oct 19 03:28:27.856157 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:28:27.856157 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:28:27.856157 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:28:27.856157 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:28:27.856157 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:28:27.856157 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:28:27.856157 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:28:27.856157 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:28:27.857410 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 67e8fcb4-bb54-4273-9c30-d50cf48abead Oct 19 03:28:27.857410 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:28:27.857410 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1bfa1b62-7c5c-4646-9074-c0e84abd8e80 tempest-FloatingIPsTestJSON-619246542 tempest-FloatingIPsTestJSON-619246542-project] Returning 404 to user: Floating IP not found for ID 67e8fcb4-bb54-4273-9c30-d50cf48abead {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:28:27.857410 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1bfa1b62-7c5c-4646-9074-c0e84abd8e80 tempest-FloatingIPsTestJSON-619246542 tempest-FloatingIPsTestJSON-619246542-project] 10.222.0.52 "DELETE /compute/v2.1/os-floating-ips/67e8fcb4-bb54-4273-9c30-d50cf48abead" status: 404 len: 111 microversion: 2.1 time: 0.110697 Oct 19 03:28:27.857410 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1824/3722] 10.222.0.52 () {58 vars in 1263 bytes} [Wed Oct 19 03:28:27 2022] DELETE /compute/v2.1/os-floating-ips/67e8fcb4-bb54-4273-9c30-d50cf48abead => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:28:28.270464 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c82a9eb0-c6da-4e9b-8e99-97048fc41a9f tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:28.273124 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c82a9eb0-c6da-4e9b-8e99-97048fc41a9f tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 3bb7abe9-5796-48da-bb31-aed0273716c7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:28.282891 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c82a9eb0-c6da-4e9b-8e99-97048fc41a9f tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:28.284743 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c82a9eb0-c6da-4e9b-8e99-97048fc41a9f tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:28.287032 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c82a9eb0-c6da-4e9b-8e99-97048fc41a9f tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:28.288099 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c82a9eb0-c6da-4e9b-8e99-97048fc41a9f tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:28.288759 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c82a9eb0-c6da-4e9b-8e99-97048fc41a9f tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:28.289787 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c82a9eb0-c6da-4e9b-8e99-97048fc41a9f tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:28.362996 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-fe53a942-864f-4b7b-b017-73fcc71d7cbf tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Calling method '.version_select at 0x7fc1300279d0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:28.481008 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c82a9eb0-c6da-4e9b-8e99-97048fc41a9f tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:28:28.486249 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-fe53a942-864f-4b7b-b017-73fcc71d7cbf tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] 10.222.0.52 "GET /compute/v2.1/images/cb8790e4-8520-4f34-9984-d5d9253c6556" status: 200 len: 1426 microversion: 2.1 time: 0.124237 Oct 19 03:28:28.486610 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=97,nova_cell1:INSERT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:28:28.491391 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c82a9eb0-c6da-4e9b-8e99-97048fc41a9f tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7" status: 200 len: 1511 microversion: 2.1 time: 0.228968 Oct 19 03:28:28.492300 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1899/3723] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:28 2022] GET /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7 => generated 1511 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:28.515170 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1825/3724] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:28:28 2022] GET /compute/v2.1/images/cb8790e4-8520-4f34-9984-d5d9253c6556 => generated 1426 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:28.780067 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-801ed494-c640-47da-9a71-00c55b33f094 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:28.782892 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-801ed494-c640-47da-9a71-00c55b33f094 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: 0051ff67-c0d0-4c84-a643-867d6416d8d1] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:28.804090 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-801ed494-c640-47da-9a71-00c55b33f094 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:28.804593 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-801ed494-c640-47da-9a71-00c55b33f094 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:28.812724 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-801ed494-c640-47da-9a71-00c55b33f094 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:28.813891 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-801ed494-c640-47da-9a71-00c55b33f094 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:28.814593 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-801ed494-c640-47da-9a71-00c55b33f094 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:28.815057 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-801ed494-c640-47da-9a71-00c55b33f094 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:29.036523 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-801ed494-c640-47da-9a71-00c55b33f094 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2b0581ad4e4c9787bef838c81870a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dfe251b1e046a995b8ec302cb2ffa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:28:29.051633 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-801ed494-c640-47da-9a71-00c55b33f094 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "GET /compute/v2.1/servers/0051ff67-c0d0-4c84-a643-867d6416d8d1" status: 200 len: 1512 microversion: 2.1 time: 0.276777 Oct 19 03:28:29.053523 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1900/3725] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:28 2022] GET /compute/v2.1/servers/0051ff67-c0d0-4c84-a643-867d6416d8d1 => generated 1512 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:29.516929 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-35844b25-f43a-4bd9-aca2-bda25f080bd5 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Calling method '.version_select at 0x7fc1300b4a60>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:29.521042 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5f95541e-c2da-41b9-a8c7-b1cdb36b6baa tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:29.522265 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-5f95541e-c2da-41b9-a8c7-b1cdb36b6baa tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 3bb7abe9-5796-48da-bb31-aed0273716c7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:29.537135 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5f95541e-c2da-41b9-a8c7-b1cdb36b6baa tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:29.537992 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5f95541e-c2da-41b9-a8c7-b1cdb36b6baa tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:29.538663 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5f95541e-c2da-41b9-a8c7-b1cdb36b6baa tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:29.539537 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5f95541e-c2da-41b9-a8c7-b1cdb36b6baa tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:29.540242 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5f95541e-c2da-41b9-a8c7-b1cdb36b6baa tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:29.541469 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5f95541e-c2da-41b9-a8c7-b1cdb36b6baa tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:29.793608 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-5f95541e-c2da-41b9-a8c7-b1cdb36b6baa tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:28:29.810656 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5f95541e-c2da-41b9-a8c7-b1cdb36b6baa tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7" status: 200 len: 1511 microversion: 2.1 time: 0.296847 Oct 19 03:28:29.812559 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1901/3726] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:29 2022] GET /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7 => generated 1511 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:28:30.076714 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3f72095e-709e-4c84-b4df-3a16eb528413 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:30.082649 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-3f72095e-709e-4c84-b4df-3a16eb528413 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: 0051ff67-c0d0-4c84-a643-867d6416d8d1] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:30.090130 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3f72095e-709e-4c84-b4df-3a16eb528413 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:30.091783 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3f72095e-709e-4c84-b4df-3a16eb528413 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:30.095275 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3f72095e-709e-4c84-b4df-3a16eb528413 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:30.096288 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3f72095e-709e-4c84-b4df-3a16eb528413 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:30.099234 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3f72095e-709e-4c84-b4df-3a16eb528413 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:30.101087 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3f72095e-709e-4c84-b4df-3a16eb528413 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:30.450044 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-3f72095e-709e-4c84-b4df-3a16eb528413 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2b0581ad4e4c9787bef838c81870a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dfe251b1e046a995b8ec302cb2ffa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:28:30.462758 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-3f72095e-709e-4c84-b4df-3a16eb528413 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "GET /compute/v2.1/servers/0051ff67-c0d0-4c84-a643-867d6416d8d1" status: 200 len: 1512 microversion: 2.1 time: 0.387130 Oct 19 03:28:30.465613 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1902/3727] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:30 2022] GET /compute/v2.1/servers/0051ff67-c0d0-4c84-a643-867d6416d8d1 => generated 1512 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:28:30.835966 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a4d3623a-8943-479c-8a2f-c9d471b1aa30 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:30.837855 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a4d3623a-8943-479c-8a2f-c9d471b1aa30 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 3bb7abe9-5796-48da-bb31-aed0273716c7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:30.861564 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a4d3623a-8943-479c-8a2f-c9d471b1aa30 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:30.865273 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a4d3623a-8943-479c-8a2f-c9d471b1aa30 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:30.869984 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a4d3623a-8943-479c-8a2f-c9d471b1aa30 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:30.886037 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a4d3623a-8943-479c-8a2f-c9d471b1aa30 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:30.889880 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a4d3623a-8943-479c-8a2f-c9d471b1aa30 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:30.900941 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a4d3623a-8943-479c-8a2f-c9d471b1aa30 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:31.435894 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a4d3623a-8943-479c-8a2f-c9d471b1aa30 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:28:31.448774 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a4d3623a-8943-479c-8a2f-c9d471b1aa30 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7" status: 200 len: 1511 microversion: 2.1 time: 0.617598 Oct 19 03:28:31.450235 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1903/3728] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:30 2022] GET /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7 => generated 1511 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:31.491959 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-de5e593d-1ac8-4467-b06c-a48fa6ec9dd8 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:31.492973 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-de5e593d-1ac8-4467-b06c-a48fa6ec9dd8 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: 0051ff67-c0d0-4c84-a643-867d6416d8d1] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:31.505069 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-de5e593d-1ac8-4467-b06c-a48fa6ec9dd8 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:31.507665 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-de5e593d-1ac8-4467-b06c-a48fa6ec9dd8 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:31.508468 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-de5e593d-1ac8-4467-b06c-a48fa6ec9dd8 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:31.510087 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-de5e593d-1ac8-4467-b06c-a48fa6ec9dd8 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:31.510087 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-de5e593d-1ac8-4467-b06c-a48fa6ec9dd8 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:31.515302 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-de5e593d-1ac8-4467-b06c-a48fa6ec9dd8 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:31.819930 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-de5e593d-1ac8-4467-b06c-a48fa6ec9dd8 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2b0581ad4e4c9787bef838c81870a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dfe251b1e046a995b8ec302cb2ffa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:28:31.829547 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-de5e593d-1ac8-4467-b06c-a48fa6ec9dd8 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "GET /compute/v2.1/servers/0051ff67-c0d0-4c84-a643-867d6416d8d1" status: 200 len: 1512 microversion: 2.1 time: 0.343883 Oct 19 03:28:31.834928 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1904/3729] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:31 2022] GET /compute/v2.1/servers/0051ff67-c0d0-4c84-a643-867d6416d8d1 => generated 1512 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:32.476460 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-dbd0a1a2-956a-45d3-acaf-6b6d57a6d4a4 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:32.477886 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-dbd0a1a2-956a-45d3-acaf-6b6d57a6d4a4 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 3bb7abe9-5796-48da-bb31-aed0273716c7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:32.486427 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dbd0a1a2-956a-45d3-acaf-6b6d57a6d4a4 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:32.487913 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dbd0a1a2-956a-45d3-acaf-6b6d57a6d4a4 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:32.488521 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dbd0a1a2-956a-45d3-acaf-6b6d57a6d4a4 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:32.489410 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dbd0a1a2-956a-45d3-acaf-6b6d57a6d4a4 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:32.490018 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dbd0a1a2-956a-45d3-acaf-6b6d57a6d4a4 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:32.490607 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dbd0a1a2-956a-45d3-acaf-6b6d57a6d4a4 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:32.809158 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-dbd0a1a2-956a-45d3-acaf-6b6d57a6d4a4 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:28:32.820375 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-dbd0a1a2-956a-45d3-acaf-6b6d57a6d4a4 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7" status: 200 len: 1511 microversion: 2.1 time: 0.348046 Oct 19 03:28:32.837959 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1905/3730] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:32 2022] GET /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7 => generated 1511 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:28:32.858815 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2781ff7f-6784-4d40-8931-84ebdfd8c0eb tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:32.862651 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-2781ff7f-6784-4d40-8931-84ebdfd8c0eb tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: 0051ff67-c0d0-4c84-a643-867d6416d8d1] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:32.894000 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2781ff7f-6784-4d40-8931-84ebdfd8c0eb tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:32.894520 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2781ff7f-6784-4d40-8931-84ebdfd8c0eb tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:32.896407 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2781ff7f-6784-4d40-8931-84ebdfd8c0eb tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:32.899467 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2781ff7f-6784-4d40-8931-84ebdfd8c0eb tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:32.901803 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2781ff7f-6784-4d40-8931-84ebdfd8c0eb tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:32.903579 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2781ff7f-6784-4d40-8931-84ebdfd8c0eb tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:32.928606 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=37 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:28:32.966142 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=52 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:28:33.511628 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-2781ff7f-6784-4d40-8931-84ebdfd8c0eb tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2b0581ad4e4c9787bef838c81870a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dfe251b1e046a995b8ec302cb2ffa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:28:33.527304 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2781ff7f-6784-4d40-8931-84ebdfd8c0eb tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "GET /compute/v2.1/servers/0051ff67-c0d0-4c84-a643-867d6416d8d1" status: 200 len: 1512 microversion: 2.1 time: 0.673034 Oct 19 03:28:33.542290 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1906/3731] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:32 2022] GET /compute/v2.1/servers/0051ff67-c0d0-4c84-a643-867d6416d8d1 => generated 1512 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:28:33.852011 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1050aa55-802d-4a39-aeda-783a181c1721 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:33.868598 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1050aa55-802d-4a39-aeda-783a181c1721 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 3bb7abe9-5796-48da-bb31-aed0273716c7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:33.904737 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1050aa55-802d-4a39-aeda-783a181c1721 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:33.904737 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1050aa55-802d-4a39-aeda-783a181c1721 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:33.904737 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1050aa55-802d-4a39-aeda-783a181c1721 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:33.904737 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1050aa55-802d-4a39-aeda-783a181c1721 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:33.905117 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1050aa55-802d-4a39-aeda-783a181c1721 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:33.905117 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1050aa55-802d-4a39-aeda-783a181c1721 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:34.194043 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-1050aa55-802d-4a39-aeda-783a181c1721 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:28:34.203641 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1050aa55-802d-4a39-aeda-783a181c1721 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7" status: 200 len: 1511 microversion: 2.1 time: 0.358215 Oct 19 03:28:34.224994 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1907/3732] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:33 2022] GET /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7 => generated 1511 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:34.556220 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e2344f0f-4851-4aef-b7da-d945dc5d908f tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:34.563890 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e2344f0f-4851-4aef-b7da-d945dc5d908f tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: 0051ff67-c0d0-4c84-a643-867d6416d8d1] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:34.574647 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e2344f0f-4851-4aef-b7da-d945dc5d908f tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:34.576196 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e2344f0f-4851-4aef-b7da-d945dc5d908f tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:34.576918 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e2344f0f-4851-4aef-b7da-d945dc5d908f tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:34.579990 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e2344f0f-4851-4aef-b7da-d945dc5d908f tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:34.583233 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e2344f0f-4851-4aef-b7da-d945dc5d908f tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:34.585152 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e2344f0f-4851-4aef-b7da-d945dc5d908f tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:34.814821 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-e2344f0f-4851-4aef-b7da-d945dc5d908f tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2b0581ad4e4c9787bef838c81870a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dfe251b1e046a995b8ec302cb2ffa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:28:34.830862 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e2344f0f-4851-4aef-b7da-d945dc5d908f tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "GET /compute/v2.1/servers/0051ff67-c0d0-4c84-a643-867d6416d8d1" status: 200 len: 1518 microversion: 2.1 time: 0.279047 Oct 19 03:28:34.832649 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1908/3733] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:34 2022] GET /compute/v2.1/servers/0051ff67-c0d0-4c84-a643-867d6416d8d1 => generated 1518 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:28:35.227722 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6b153f9f-f8b5-4234-860c-b217e044d0ef tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:35.228402 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6b153f9f-f8b5-4234-860c-b217e044d0ef tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 3bb7abe9-5796-48da-bb31-aed0273716c7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:35.235685 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6b153f9f-f8b5-4234-860c-b217e044d0ef tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:35.236468 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6b153f9f-f8b5-4234-860c-b217e044d0ef tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:35.237844 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6b153f9f-f8b5-4234-860c-b217e044d0ef tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:35.239211 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6b153f9f-f8b5-4234-860c-b217e044d0ef tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:35.239834 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6b153f9f-f8b5-4234-860c-b217e044d0ef tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:35.240428 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6b153f9f-f8b5-4234-860c-b217e044d0ef tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:35.469427 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-6b153f9f-f8b5-4234-860c-b217e044d0ef tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:28:35.481063 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6b153f9f-f8b5-4234-860c-b217e044d0ef tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7" status: 200 len: 1511 microversion: 2.1 time: 0.257448 Oct 19 03:28:35.494590 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1909/3734] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:35 2022] GET /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7 => generated 1511 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:28:35.856112 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-870d9551-3a69-4e54-8ec3-97134862f2ad tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:35.856832 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-870d9551-3a69-4e54-8ec3-97134862f2ad tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: 0051ff67-c0d0-4c84-a643-867d6416d8d1] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:35.868119 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-870d9551-3a69-4e54-8ec3-97134862f2ad tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:35.870317 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-870d9551-3a69-4e54-8ec3-97134862f2ad tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:35.873967 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-870d9551-3a69-4e54-8ec3-97134862f2ad tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:35.875089 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-870d9551-3a69-4e54-8ec3-97134862f2ad tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:35.875582 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-870d9551-3a69-4e54-8ec3-97134862f2ad tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:35.876328 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-870d9551-3a69-4e54-8ec3-97134862f2ad tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:36.293123 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-870d9551-3a69-4e54-8ec3-97134862f2ad tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2b0581ad4e4c9787bef838c81870a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dfe251b1e046a995b8ec302cb2ffa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:28:36.311200 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-870d9551-3a69-4e54-8ec3-97134862f2ad tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "GET /compute/v2.1/servers/0051ff67-c0d0-4c84-a643-867d6416d8d1" status: 200 len: 1518 microversion: 2.1 time: 0.458814 Oct 19 03:28:36.312025 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1910/3735] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:35 2022] GET /compute/v2.1/servers/0051ff67-c0d0-4c84-a643-867d6416d8d1 => generated 1518 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:36.318807 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-1868a03e-907d-4b84-bd93-0c832ccab9d6 req-021675b2-cd20-49d4-b364-8d282fb237f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0051ff67-c0d0-4c84-a643-867d6416d8d1", "name": "network-vif-unplugged", "status": "completed", "tag": "21fd1481-24a3-4546-a0cb-b825ae11a779"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:28:36.330595 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-1868a03e-907d-4b84-bd93-0c832ccab9d6 req-021675b2-cd20-49d4-b364-8d282fb237f7 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:36.331340 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-1868a03e-907d-4b84-bd93-0c832ccab9d6 req-021675b2-cd20-49d4-b364-8d282fb237f7 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:36.332229 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-1868a03e-907d-4b84-bd93-0c832ccab9d6 req-021675b2-cd20-49d4-b364-8d282fb237f7 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:36.348741 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-1868a03e-907d-4b84-bd93-0c832ccab9d6 req-021675b2-cd20-49d4-b364-8d282fb237f7 service nova] Creating event network-vif-unplugged:21fd1481-24a3-4546-a0cb-b825ae11a779 for instance 0051ff67-c0d0-4c84-a643-867d6416d8d1 on n-h2-861333-8 Oct 19 03:28:36.354553 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-1868a03e-907d-4b84-bd93-0c832ccab9d6 req-021675b2-cd20-49d4-b364-8d282fb237f7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039487 Oct 19 03:28:36.355789 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1911/3736] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:28:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:28:36.509983 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-85ecdc79-c77b-4747-afdf-a332587bc868 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:36.511590 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-85ecdc79-c77b-4747-afdf-a332587bc868 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 3bb7abe9-5796-48da-bb31-aed0273716c7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:36.522202 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-85ecdc79-c77b-4747-afdf-a332587bc868 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:36.523401 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-85ecdc79-c77b-4747-afdf-a332587bc868 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:36.524287 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-85ecdc79-c77b-4747-afdf-a332587bc868 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:36.525732 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-85ecdc79-c77b-4747-afdf-a332587bc868 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:36.528383 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-85ecdc79-c77b-4747-afdf-a332587bc868 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:36.529021 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-85ecdc79-c77b-4747-afdf-a332587bc868 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:36.736492 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-85ecdc79-c77b-4747-afdf-a332587bc868 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:28:36.748793 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-85ecdc79-c77b-4747-afdf-a332587bc868 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7" status: 200 len: 1511 microversion: 2.1 time: 0.245905 Oct 19 03:28:36.750015 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1912/3737] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:36 2022] GET /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7 => generated 1511 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:37.336675 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2f4d7824-12fb-4cbe-971e-1855589a9988 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:37.337968 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-2f4d7824-12fb-4cbe-971e-1855589a9988 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: 0051ff67-c0d0-4c84-a643-867d6416d8d1] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:37.351604 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2f4d7824-12fb-4cbe-971e-1855589a9988 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:37.352028 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2f4d7824-12fb-4cbe-971e-1855589a9988 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:37.352480 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2f4d7824-12fb-4cbe-971e-1855589a9988 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:37.353198 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2f4d7824-12fb-4cbe-971e-1855589a9988 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:37.353691 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2f4d7824-12fb-4cbe-971e-1855589a9988 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:37.354127 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2f4d7824-12fb-4cbe-971e-1855589a9988 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:37.727769 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-2f4d7824-12fb-4cbe-971e-1855589a9988 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2b0581ad4e4c9787bef838c81870a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dfe251b1e046a995b8ec302cb2ffa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:28:37.737000 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2f4d7824-12fb-4cbe-971e-1855589a9988 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "GET /compute/v2.1/servers/0051ff67-c0d0-4c84-a643-867d6416d8d1" status: 200 len: 1518 microversion: 2.1 time: 0.403815 Oct 19 03:28:37.758892 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1913/3738] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:37 2022] GET /compute/v2.1/servers/0051ff67-c0d0-4c84-a643-867d6416d8d1 => generated 1518 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:37.774438 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3a8c2227-6395-4829-8c5e-ce6aba21c6b9 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:37.779600 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-3a8c2227-6395-4829-8c5e-ce6aba21c6b9 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 3bb7abe9-5796-48da-bb31-aed0273716c7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:37.781928 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3a8c2227-6395-4829-8c5e-ce6aba21c6b9 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:37.782614 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3a8c2227-6395-4829-8c5e-ce6aba21c6b9 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:37.783054 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3a8c2227-6395-4829-8c5e-ce6aba21c6b9 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:37.784170 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3a8c2227-6395-4829-8c5e-ce6aba21c6b9 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:37.784625 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3a8c2227-6395-4829-8c5e-ce6aba21c6b9 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:37.785219 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3a8c2227-6395-4829-8c5e-ce6aba21c6b9 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:38.020334 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-3a8c2227-6395-4829-8c5e-ce6aba21c6b9 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:28:38.031770 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-3a8c2227-6395-4829-8c5e-ce6aba21c6b9 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7" status: 200 len: 1511 microversion: 2.1 time: 0.259842 Oct 19 03:28:38.046166 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1914/3739] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:37 2022] GET /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7 => generated 1511 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:38.762404 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-20292dcd-5035-4c74-82c9-dabf275ffa61 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:38.763146 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-20292dcd-5035-4c74-82c9-dabf275ffa61 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: 0051ff67-c0d0-4c84-a643-867d6416d8d1] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:38.772283 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-20292dcd-5035-4c74-82c9-dabf275ffa61 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:38.772953 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-20292dcd-5035-4c74-82c9-dabf275ffa61 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:38.773836 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-20292dcd-5035-4c74-82c9-dabf275ffa61 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:38.774676 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-20292dcd-5035-4c74-82c9-dabf275ffa61 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:38.775317 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-20292dcd-5035-4c74-82c9-dabf275ffa61 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:38.775915 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-20292dcd-5035-4c74-82c9-dabf275ffa61 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:38.927827 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-20292dcd-5035-4c74-82c9-dabf275ffa61 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2b0581ad4e4c9787bef838c81870a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dfe251b1e046a995b8ec302cb2ffa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:28:38.936448 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-20292dcd-5035-4c74-82c9-dabf275ffa61 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "GET /compute/v2.1/servers/0051ff67-c0d0-4c84-a643-867d6416d8d1" status: 200 len: 1518 microversion: 2.1 time: 0.177860 Oct 19 03:28:38.937034 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1915/3740] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:38 2022] GET /compute/v2.1/servers/0051ff67-c0d0-4c84-a643-867d6416d8d1 => generated 1518 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:28:39.058629 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f5ea92a6-0fc5-4d22-92a7-812c3439d269 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:39.059435 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f5ea92a6-0fc5-4d22-92a7-812c3439d269 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 3bb7abe9-5796-48da-bb31-aed0273716c7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:39.070246 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f5ea92a6-0fc5-4d22-92a7-812c3439d269 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:39.071103 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f5ea92a6-0fc5-4d22-92a7-812c3439d269 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:39.071610 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f5ea92a6-0fc5-4d22-92a7-812c3439d269 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:39.072499 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f5ea92a6-0fc5-4d22-92a7-812c3439d269 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:39.073170 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f5ea92a6-0fc5-4d22-92a7-812c3439d269 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:39.073682 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f5ea92a6-0fc5-4d22-92a7-812c3439d269 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:39.273233 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f5ea92a6-0fc5-4d22-92a7-812c3439d269 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:28:39.283384 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f5ea92a6-0fc5-4d22-92a7-812c3439d269 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7" status: 200 len: 1511 microversion: 2.1 time: 0.228317 Oct 19 03:28:39.300524 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1916/3741] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:39 2022] GET /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7 => generated 1511 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:39.961616 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c2cb0b46-85ca-482d-a225-c5f4a82accc9 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:39.962296 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c2cb0b46-85ca-482d-a225-c5f4a82accc9 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: 0051ff67-c0d0-4c84-a643-867d6416d8d1] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:39.982193 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c2cb0b46-85ca-482d-a225-c5f4a82accc9 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:39.982193 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c2cb0b46-85ca-482d-a225-c5f4a82accc9 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:39.982193 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c2cb0b46-85ca-482d-a225-c5f4a82accc9 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:39.982193 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c2cb0b46-85ca-482d-a225-c5f4a82accc9 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:39.983678 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c2cb0b46-85ca-482d-a225-c5f4a82accc9 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:39.983678 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c2cb0b46-85ca-482d-a225-c5f4a82accc9 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:40.074411 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=100 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:28:40.298369 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c2cb0b46-85ca-482d-a225-c5f4a82accc9 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2b0581ad4e4c9787bef838c81870a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dfe251b1e046a995b8ec302cb2ffa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:28:40.308723 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c2cb0b46-85ca-482d-a225-c5f4a82accc9 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "GET /compute/v2.1/servers/0051ff67-c0d0-4c84-a643-867d6416d8d1" status: 200 len: 1518 microversion: 2.1 time: 0.351106 Oct 19 03:28:40.310299 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1917/3742] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:39 2022] GET /compute/v2.1/servers/0051ff67-c0d0-4c84-a643-867d6416d8d1 => generated 1518 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:28:40.319404 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-110f6d35-83d5-470d-ab23-4f3500c9f060 req-bcb82d06-4bb3-42c7-9ce8-217169a182b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0051ff67-c0d0-4c84-a643-867d6416d8d1", "name": "network-vif-plugged", "status": "completed", "tag": "21fd1481-24a3-4546-a0cb-b825ae11a779"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:28:40.334103 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-110f6d35-83d5-470d-ab23-4f3500c9f060 req-bcb82d06-4bb3-42c7-9ce8-217169a182b0 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:40.335031 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-110f6d35-83d5-470d-ab23-4f3500c9f060 req-bcb82d06-4bb3-42c7-9ce8-217169a182b0 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:40.335714 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-110f6d35-83d5-470d-ab23-4f3500c9f060 req-bcb82d06-4bb3-42c7-9ce8-217169a182b0 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:40.355588 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-110f6d35-83d5-470d-ab23-4f3500c9f060 req-bcb82d06-4bb3-42c7-9ce8-217169a182b0 service nova] Creating event network-vif-plugged:21fd1481-24a3-4546-a0cb-b825ae11a779 for instance 0051ff67-c0d0-4c84-a643-867d6416d8d1 on n-h2-861333-8 Oct 19 03:28:40.363629 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-110f6d35-83d5-470d-ab23-4f3500c9f060 req-bcb82d06-4bb3-42c7-9ce8-217169a182b0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050816 Oct 19 03:28:40.364833 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1918/3743] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:28:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:28:40.370740 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-43e96855-0bac-45e6-9ca8-ea2abd80b4ab tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:40.380224 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-43e96855-0bac-45e6-9ca8-ea2abd80b4ab tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 3bb7abe9-5796-48da-bb31-aed0273716c7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:40.396870 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-43e96855-0bac-45e6-9ca8-ea2abd80b4ab tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:40.397789 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-43e96855-0bac-45e6-9ca8-ea2abd80b4ab tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:40.398628 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-43e96855-0bac-45e6-9ca8-ea2abd80b4ab tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:40.402158 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-43e96855-0bac-45e6-9ca8-ea2abd80b4ab tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:40.402987 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-43e96855-0bac-45e6-9ca8-ea2abd80b4ab tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:40.405636 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-43e96855-0bac-45e6-9ca8-ea2abd80b4ab tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:40.790519 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-43e96855-0bac-45e6-9ca8-ea2abd80b4ab tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:28:40.842131 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-43e96855-0bac-45e6-9ca8-ea2abd80b4ab tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7" status: 200 len: 1511 microversion: 2.1 time: 0.475230 Oct 19 03:28:40.853615 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1919/3744] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:40 2022] GET /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7 => generated 1511 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:41.332651 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4af84533-2faf-407e-82b2-b81920846003 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:41.333432 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4af84533-2faf-407e-82b2-b81920846003 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: 0051ff67-c0d0-4c84-a643-867d6416d8d1] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:41.342882 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4af84533-2faf-407e-82b2-b81920846003 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:41.344023 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4af84533-2faf-407e-82b2-b81920846003 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:41.344587 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4af84533-2faf-407e-82b2-b81920846003 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:41.345740 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4af84533-2faf-407e-82b2-b81920846003 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:41.346441 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4af84533-2faf-407e-82b2-b81920846003 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:41.347098 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4af84533-2faf-407e-82b2-b81920846003 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:41.526885 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4af84533-2faf-407e-82b2-b81920846003 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2b0581ad4e4c9787bef838c81870a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dfe251b1e046a995b8ec302cb2ffa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:28:41.535900 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4af84533-2faf-407e-82b2-b81920846003 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "GET /compute/v2.1/servers/0051ff67-c0d0-4c84-a643-867d6416d8d1" status: 200 len: 1518 microversion: 2.1 time: 0.206234 Oct 19 03:28:41.556284 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1920/3745] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:41 2022] GET /compute/v2.1/servers/0051ff67-c0d0-4c84-a643-867d6416d8d1 => generated 1518 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:41.883528 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-51ca3a0b-f68c-4381-bf1e-ce1c52923f09 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:41.884299 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-51ca3a0b-f68c-4381-bf1e-ce1c52923f09 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 3bb7abe9-5796-48da-bb31-aed0273716c7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:41.901721 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-51ca3a0b-f68c-4381-bf1e-ce1c52923f09 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:41.910647 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-51ca3a0b-f68c-4381-bf1e-ce1c52923f09 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:41.910647 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-51ca3a0b-f68c-4381-bf1e-ce1c52923f09 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:41.910647 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-51ca3a0b-f68c-4381-bf1e-ce1c52923f09 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:41.910647 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-51ca3a0b-f68c-4381-bf1e-ce1c52923f09 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:41.911304 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-51ca3a0b-f68c-4381-bf1e-ce1c52923f09 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:42.253927 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-51ca3a0b-f68c-4381-bf1e-ce1c52923f09 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:28:42.268132 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-51ca3a0b-f68c-4381-bf1e-ce1c52923f09 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7" status: 200 len: 1511 microversion: 2.1 time: 0.389356 Oct 19 03:28:42.268739 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1921/3746] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:41 2022] GET /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7 => generated 1511 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:42.575662 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d361181c-c0ea-4765-a7b4-a7e3d24870fd tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:42.577018 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d361181c-c0ea-4765-a7b4-a7e3d24870fd tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: 0051ff67-c0d0-4c84-a643-867d6416d8d1] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:42.594638 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d361181c-c0ea-4765-a7b4-a7e3d24870fd tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:42.597360 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d361181c-c0ea-4765-a7b4-a7e3d24870fd tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:42.598939 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d361181c-c0ea-4765-a7b4-a7e3d24870fd tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:42.600913 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d361181c-c0ea-4765-a7b4-a7e3d24870fd tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:42.601592 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d361181c-c0ea-4765-a7b4-a7e3d24870fd tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:42.603978 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d361181c-c0ea-4765-a7b4-a7e3d24870fd tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:42.817257 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d361181c-c0ea-4765-a7b4-a7e3d24870fd tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2b0581ad4e4c9787bef838c81870a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dfe251b1e046a995b8ec302cb2ffa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:28:42.827787 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d361181c-c0ea-4765-a7b4-a7e3d24870fd tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "GET /compute/v2.1/servers/0051ff67-c0d0-4c84-a643-867d6416d8d1" status: 200 len: 1503 microversion: 2.1 time: 0.267252 Oct 19 03:28:42.833824 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1922/3747] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:42 2022] GET /compute/v2.1/servers/0051ff67-c0d0-4c84-a643-867d6416d8d1 => generated 1503 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:42.854282 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-527b9ab4-19d8-4efd-8770-f12c4358a14d tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:42.855556 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-527b9ab4-19d8-4efd-8770-f12c4358a14d tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: 0051ff67-c0d0-4c84-a643-867d6416d8d1] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:42.865708 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-527b9ab4-19d8-4efd-8770-f12c4358a14d tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:42.866582 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-527b9ab4-19d8-4efd-8770-f12c4358a14d tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:42.867791 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-527b9ab4-19d8-4efd-8770-f12c4358a14d tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:42.869860 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-527b9ab4-19d8-4efd-8770-f12c4358a14d tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:42.870548 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-527b9ab4-19d8-4efd-8770-f12c4358a14d tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:42.872305 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-527b9ab4-19d8-4efd-8770-f12c4358a14d tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:43.347652 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-527b9ab4-19d8-4efd-8770-f12c4358a14d tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2b0581ad4e4c9787bef838c81870a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dfe251b1e046a995b8ec302cb2ffa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:28:43.358500 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-527b9ab4-19d8-4efd-8770-f12c4358a14d tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "GET /compute/v2.1/servers/0051ff67-c0d0-4c84-a643-867d6416d8d1" status: 200 len: 1503 microversion: 2.1 time: 0.508682 Oct 19 03:28:43.359120 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1923/3748] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:42 2022] GET /compute/v2.1/servers/0051ff67-c0d0-4c84-a643-867d6416d8d1 => generated 1503 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:43.372305 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-650da39c-4d26-4046-8d9e-1f931c7c55f3 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:43.382274 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-650da39c-4d26-4046-8d9e-1f931c7c55f3 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 3bb7abe9-5796-48da-bb31-aed0273716c7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:43.416338 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-650da39c-4d26-4046-8d9e-1f931c7c55f3 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:43.422973 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-650da39c-4d26-4046-8d9e-1f931c7c55f3 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:43.426390 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-650da39c-4d26-4046-8d9e-1f931c7c55f3 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:43.426390 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-650da39c-4d26-4046-8d9e-1f931c7c55f3 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:43.427442 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-650da39c-4d26-4046-8d9e-1f931c7c55f3 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:43.429836 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-650da39c-4d26-4046-8d9e-1f931c7c55f3 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:43.788333 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-650da39c-4d26-4046-8d9e-1f931c7c55f3 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:28:43.802300 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-650da39c-4d26-4046-8d9e-1f931c7c55f3 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7" status: 200 len: 1511 microversion: 2.1 time: 0.438110 Oct 19 03:28:43.805496 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1924/3749] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:43 2022] GET /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7 => generated 1511 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:43.814099 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-586ff518-6b47-46a9-b108-5e96e90a96ee tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:43.825536 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-586ff518-6b47-46a9-b108-5e96e90a96ee tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: 0051ff67-c0d0-4c84-a643-867d6416d8d1] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:43.846730 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-586ff518-6b47-46a9-b108-5e96e90a96ee tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:43.847268 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-586ff518-6b47-46a9-b108-5e96e90a96ee tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:43.847719 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-586ff518-6b47-46a9-b108-5e96e90a96ee tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:43.848460 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-586ff518-6b47-46a9-b108-5e96e90a96ee tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:43.848919 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-586ff518-6b47-46a9-b108-5e96e90a96ee tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:43.849351 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-586ff518-6b47-46a9-b108-5e96e90a96ee tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:43.959849 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-586ff518-6b47-46a9-b108-5e96e90a96ee tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: 0051ff67-c0d0-4c84-a643-867d6416d8d1] Going to try to terminate instance {{(pid=121135) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:28:44.840693 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-586ff518-6b47-46a9-b108-5e96e90a96ee tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "DELETE /compute/v2.1/servers/0051ff67-c0d0-4c84-a643-867d6416d8d1" status: 204 len: 0 microversion: 2.1 time: 1.033867 Oct 19 03:28:44.841346 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1925/3750] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:28:43 2022] DELETE /compute/v2.1/servers/0051ff67-c0d0-4c84-a643-867d6416d8d1 => generated 0 bytes in 1035 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:28:44.860167 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-758ba0ea-ac4b-45fe-8f46-f37dd3c5ee0e tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:44.860167 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-758ba0ea-ac4b-45fe-8f46-f37dd3c5ee0e tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 3bb7abe9-5796-48da-bb31-aed0273716c7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:44.874346 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-758ba0ea-ac4b-45fe-8f46-f37dd3c5ee0e tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:44.875358 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-758ba0ea-ac4b-45fe-8f46-f37dd3c5ee0e tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:44.875885 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-758ba0ea-ac4b-45fe-8f46-f37dd3c5ee0e tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:44.876902 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-758ba0ea-ac4b-45fe-8f46-f37dd3c5ee0e tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:44.882690 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-758ba0ea-ac4b-45fe-8f46-f37dd3c5ee0e tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:44.883642 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-758ba0ea-ac4b-45fe-8f46-f37dd3c5ee0e tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:45.250038 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-758ba0ea-ac4b-45fe-8f46-f37dd3c5ee0e tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:28:45.255344 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-758ba0ea-ac4b-45fe-8f46-f37dd3c5ee0e tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7" status: 200 len: 1511 microversion: 2.1 time: 0.412774 Oct 19 03:28:45.258198 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1926/3751] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:44 2022] GET /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7 => generated 1511 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:45.276567 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-adfd30fa-d529-4d7a-a7da-d33853438cdc tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1207173499", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "networks": [{"uuid": "549a6939-4677-4325-946a-139cb93dc76f"}]}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:28:46.844733 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-35844b25-f43a-4bd9-aca2-bda25f080bd5 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] 10.222.0.52 "GET /compute/v2.1/images/cb8790e4-8520-4f34-9984-d5d9253c6556" status: 200 len: 1435 microversion: 2.1 time: 17.332613 Oct 19 03:28:46.849653 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1826/3752] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:28:29 2022] GET /compute/v2.1/images/cb8790e4-8520-4f34-9984-d5d9253c6556 => generated 1435 bytes in 17334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:46.852345 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5db95b1b-5561-445d-b2b9-c7c2fab6c36a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:46.852962 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5db95b1b-5561-445d-b2b9-c7c2fab6c36a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 3bb7abe9-5796-48da-bb31-aed0273716c7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:46.866884 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.network.neutron [None req-adfd30fa-d529-4d7a-a7da-d33853438cdc tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] validate_networks() for [('549a6939-4677-4325-946a-139cb93dc76f', None, None, None, None, None)] {{(pid=121135) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:28:46.897931 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5db95b1b-5561-445d-b2b9-c7c2fab6c36a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:46.898705 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5db95b1b-5561-445d-b2b9-c7c2fab6c36a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:46.899169 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5db95b1b-5561-445d-b2b9-c7c2fab6c36a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:46.899873 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5db95b1b-5561-445d-b2b9-c7c2fab6c36a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:46.900349 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5db95b1b-5561-445d-b2b9-c7c2fab6c36a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:46.900779 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5db95b1b-5561-445d-b2b9-c7c2fab6c36a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:47.249509 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5db95b1b-5561-445d-b2b9-c7c2fab6c36a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:28:47.271235 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5db95b1b-5561-445d-b2b9-c7c2fab6c36a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7" status: 200 len: 1488 microversion: 2.1 time: 0.424242 Oct 19 03:28:47.273031 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1827/3753] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:46 2022] GET /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7 => generated 1488 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:47.660916 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7eef7557-4dac-4e84-be65-b5381cfb79e7 tempest-FloatingIPsNegativeTestJSON-425016498 tempest-FloatingIPsNegativeTestJSON-425016498-project] Calling method '.version_select at 0x7fc12bfe68b0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:48.044445 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7eef7557-4dac-4e84-be65-b5381cfb79e7 tempest-FloatingIPsNegativeTestJSON-425016498 tempest-FloatingIPsNegativeTestJSON-425016498-project] 10.222.0.52 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.769948 Oct 19 03:28:48.045613 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1828/3754] 10.222.0.52 () {58 vars in 1149 bytes} [Wed Oct 19 03:28:47 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 03:28:48.050874 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-292734c9-ef5b-4e8a-9d5a-45812433a99f tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Calling method '.version_select at 0x7fc12bfcd3a0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:48.109111 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-adfd30fa-d529-4d7a-a7da-d33853438cdc tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Flavor limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:28:48.109666 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-adfd30fa-d529-4d7a-a7da-d33853438cdc tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Image limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:28:48.110282 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-adfd30fa-d529-4d7a-a7da-d33853438cdc tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Flavor pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:28:48.110799 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-adfd30fa-d529-4d7a-a7da-d33853438cdc tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Image pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:28:48.111918 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-adfd30fa-d529-4d7a-a7da-d33853438cdc tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:28:48.114239 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-292734c9-ef5b-4e8a-9d5a-45812433a99f tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] 10.222.0.52 "GET /compute/v2.1/images/cb8790e4-8520-4f34-9984-d5d9253c6556" status: 200 len: 1435 microversion: 2.1 time: 0.067336 Oct 19 03:28:48.115512 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1829/3755] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:28:48 2022] GET /compute/v2.1/images/cb8790e4-8520-4f34-9984-d5d9253c6556 => generated 1435 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:48.122517 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-adfd30fa-d529-4d7a-a7da-d33853438cdc tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:48.131696 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-adfd30fa-d529-4d7a-a7da-d33853438cdc tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:48.131696 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-adfd30fa-d529-4d7a-a7da-d33853438cdc tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:48.131696 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-adfd30fa-d529-4d7a-a7da-d33853438cdc tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:48.131696 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-adfd30fa-d529-4d7a-a7da-d33853438cdc tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:48.132193 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-adfd30fa-d529-4d7a-a7da-d33853438cdc tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:48.147388 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-adfd30fa-d529-4d7a-a7da-d33853438cdc tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Getting quotas for project c4dfe251b1e046a995b8ec302cb2ffa0. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:28:48.153245 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-adfd30fa-d529-4d7a-a7da-d33853438cdc tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Getting quotas for user de2b0581ad4e4c9787bef838c81870a2 and project c4dfe251b1e046a995b8ec302cb2ffa0. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:28:48.171205 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:28:48.174210 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-adfd30fa-d529-4d7a-a7da-d33853438cdc tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Going to run 1 instances... {{(pid=121135) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:28:48.184058 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-adfd30fa-d529-4d7a-a7da-d33853438cdc tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: e13547eb-efb0-4153-8dec-a666d4e6349b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121135) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:28:48.329006 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-adfd30fa-d529-4d7a-a7da-d33853438cdc tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.063992 Oct 19 03:28:48.331653 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1927/3756] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:28:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 3073 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 03:28:48.344254 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d2a9e47b-19eb-4329-a519-0257533636af tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1988205706"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:28:48.351692 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d2a9e47b-19eb-4329-a519-0257533636af tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 3bb7abe9-5796-48da-bb31-aed0273716c7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:48.364476 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d2a9e47b-19eb-4329-a519-0257533636af tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:48.365134 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d2a9e47b-19eb-4329-a519-0257533636af tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:48.365607 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d2a9e47b-19eb-4329-a519-0257533636af tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:48.366318 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d2a9e47b-19eb-4329-a519-0257533636af tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:48.366776 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d2a9e47b-19eb-4329-a519-0257533636af tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:48.367207 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d2a9e47b-19eb-4329-a519-0257533636af tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:48.424968 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-7e181df2-7b99-4434-ace5-d7d07fde4c3a req-eae213cf-ccf8-43dd-8f24-518422e63b5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0051ff67-c0d0-4c84-a643-867d6416d8d1", "name": "network-vif-deleted", "tag": "21fd1481-24a3-4546-a0cb-b825ae11a779"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:28:48.442641 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-7e181df2-7b99-4434-ace5-d7d07fde4c3a req-eae213cf-ccf8-43dd-8f24-518422e63b5a service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:48.443132 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-7e181df2-7b99-4434-ace5-d7d07fde4c3a req-eae213cf-ccf8-43dd-8f24-518422e63b5a service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:48.444913 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-7e181df2-7b99-4434-ace5-d7d07fde4c3a req-eae213cf-ccf8-43dd-8f24-518422e63b5a service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:48.461361 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-7e181df2-7b99-4434-ace5-d7d07fde4c3a req-eae213cf-ccf8-43dd-8f24-518422e63b5a service nova] Creating event network-vif-deleted:21fd1481-24a3-4546-a0cb-b825ae11a779 for instance 0051ff67-c0d0-4c84-a643-867d6416d8d1 on n-h2-861333-8 Oct 19 03:28:48.469598 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-7e181df2-7b99-4434-ace5-d7d07fde4c3a req-eae213cf-ccf8-43dd-8f24-518422e63b5a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.351836 Oct 19 03:28:48.470454 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1830/3757] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:28:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:28:48.482757 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-83fe50e2-3002-4c76-b1a1-8889c6e3c3f5 tempest-FloatingIPsNegativeTestJSON-425016498 tempest-FloatingIPsNegativeTestJSON-425016498-project] Action: 'create', calling method: .version_select at 0x7fc12bfcd5e0>, body: {"pool": "non_exist_pool"} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:28:48.522536 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-83fe50e2-3002-4c76-b1a1-8889c6e3c3f5 tempest-FloatingIPsNegativeTestJSON-425016498 tempest-FloatingIPsNegativeTestJSON-425016498-project] HTTP exception thrown: Floating IP pool not found. Oct 19 03:28:48.524596 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d2a9e47b-19eb-4329-a519-0257533636af tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "PUT /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7" status: 200 len: 1061 microversion: 2.1 time: 0.189120 Oct 19 03:28:48.525008 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-83fe50e2-3002-4c76-b1a1-8889c6e3c3f5 tempest-FloatingIPsNegativeTestJSON-425016498 tempest-FloatingIPsNegativeTestJSON-425016498-project] Request method failure captured: Oct 19 03:28:48.525008 n-d-861333-8 devstack@n-api.service[121134]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Oct 19 03:28:48.525008 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:28:48.525008 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:28:48.525008 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:28:48.525008 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 26 Oct 19 03:28:48.525008 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:28:48.525008 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:28:48.525008 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:28:48.525008 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:28:48.525008 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT27u1-rvtAmHUU5moyoU3XPcAp0iRKwTYmaTQGVnBuSKgDjPGjEwsHRT_9Sk93BO_tXJS1y3ZOxgZ4aYfjJ9KfZYgnm8_QHxQuhYqAQp9lFciQQiQvlzPmU9B32k8bMFREQuiu8D8vmA0usjiBLUMzA5aBfwbcQesova3t7OpD0-6Ng Oct 19 03:28:48.525008 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:28:48.525008 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:28:48.525008 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:28:48.525008 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:28:48.525008 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:28:48.525008 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:28:48.525008 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 0104e8b89f854ad8a62e3394cf393a22 Oct 19 03:28:48.525008 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-425016498 Oct 19 03:28:48.525008 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:28:48.525008 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:28:48.526682 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/0104e8b89f854ad8a62e3394cf393a22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0104e8b89f854ad8a62e3394cf393a22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0104e8b89f854ad8a62e3394cf393a22"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_0104e8b89f854ad8a62e3394cf393a22", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:28:48.526682 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-425016498 Oct 19 03:28:48.526682 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 0104e8b89f854ad8a62e3394cf393a22 Oct 19 03:28:48.526682 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-425016498 Oct 19 03:28:48.526682 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-FloatingIPsNegativeTestJSON-425016498-project Oct 19 03:28:48.526682 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:28:48.526682 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:28:48.526682 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: c03d726e78a44f3988c07cd618f09269 Oct 19 03:28:48.526682 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-425016498-project Oct 19 03:28:48.526682 n-d-861333-8 devstack@n-api.service[121134]: Oct 19 03:28:48.526682 n-d-861333-8 devstack@n-api.service[121134]: {"pool": "non_exist_pool"} Oct 19 03:28:48.526682 n-d-861333-8 devstack@n-api.service[121134]: method: Oct 19 03:28:48.526682 n-d-861333-8 devstack@n-api.service[121134]: exception: Floating IP pool not found. Oct 19 03:28:48.526682 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'body': {'pool': 'non_exist_pool'}} Oct 19 03:28:48.526682 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:28:48.528837 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:28:48.528837 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Oct 19 03:28:48.528837 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Oct 19 03:28:48.528837 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2972, in allocate_floating_ip Oct 19 03:28:48.528837 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Oct 19 03:28:48.528837 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2962, in _get_floating_ip_pool_id_by_name_or_id Oct 19 03:28:48.528837 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Oct 19 03:28:48.528837 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Oct 19 03:28:48.528837 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:28:48.528837 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:28:48.528837 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:28:48.528837 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:28:48.528837 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:28:48.528837 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:28:48.528837 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:28:48.528837 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:28:48.528837 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 03:28:48.528837 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 03:28:48.528837 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:28:48.528837 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:28:48.530592 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Oct 19 03:28:48.530592 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:28:48.530592 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Oct 19 03:28:48.530592 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:28:48.530592 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:28:48.530592 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:28:48.530592 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:28:48.530592 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:28:48.530592 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:28:48.530592 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:28:48.530592 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:28:48.530592 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Oct 19 03:28:48.530592 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:28:48.530592 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-83fe50e2-3002-4c76-b1a1-8889c6e3c3f5 tempest-FloatingIPsNegativeTestJSON-425016498 tempest-FloatingIPsNegativeTestJSON-425016498-project] Returning 404 to user: Floating IP pool not found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:28:48.531509 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1928/3758] 10.222.0.52 () {60 vars in 1256 bytes} [Wed Oct 19 03:28:48 2022] PUT /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7 => generated 1061 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:48.531612 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-83fe50e2-3002-4c76-b1a1-8889c6e3c3f5 tempest-FloatingIPsNegativeTestJSON-425016498 tempest-FloatingIPsNegativeTestJSON-425016498-project] 10.222.0.52 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.049720 Oct 19 03:28:48.531612 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1831/3759] 10.222.0.52 () {60 vars in 1170 bytes} [Wed Oct 19 03:28:48 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 03:28:48.536577 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3fd3c477-db3c-44ec-bf21-847c4903e57c tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:48.537490 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3fd3c477-db3c-44ec-bf21-847c4903e57c tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: e13547eb-efb0-4153-8dec-a666d4e6349b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:48.538537 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-819b70c7-a92c-47cc-9e43-ac24a14d96ad tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:48.539168 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-819b70c7-a92c-47cc-9e43-ac24a14d96ad tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] [instance: 3bfbe3fa-5e16-4b72-8232-7cf260c78f0a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:48.553818 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-819b70c7-a92c-47cc-9e43-ac24a14d96ad tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:48.554509 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-819b70c7-a92c-47cc-9e43-ac24a14d96ad tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:48.566937 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-819b70c7-a92c-47cc-9e43-ac24a14d96ad tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:48.567705 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-819b70c7-a92c-47cc-9e43-ac24a14d96ad tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:48.568184 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-819b70c7-a92c-47cc-9e43-ac24a14d96ad tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:48.574349 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-819b70c7-a92c-47cc-9e43-ac24a14d96ad tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:48.625699 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-3fd3c477-db3c-44ec-bf21-847c4903e57c tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2b0581ad4e4c9787bef838c81870a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dfe251b1e046a995b8ec302cb2ffa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:28:48.637016 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3fd3c477-db3c-44ec-bf21-847c4903e57c tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "GET /compute/v2.1/servers/e13547eb-efb0-4153-8dec-a666d4e6349b" status: 200 len: 1218 microversion: 2.1 time: 0.107891 Oct 19 03:28:48.637719 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1832/3760] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:48 2022] GET /compute/v2.1/servers/e13547eb-efb0-4153-8dec-a666d4e6349b => generated 1218 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:48.660752 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ebc8b5ad-ee5b-4433-bd28-eb62d562f0d7 tempest-FloatingIPsNegativeTestJSON-425016498 tempest-FloatingIPsNegativeTestJSON-425016498-project] Calling method '.version_select at 0x7fc12bfe34c0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:48.729819 n-d-861333-8 devstack@n-api.service[121134]: DEBUG neutronclient.v2_0.client [None req-ebc8b5ad-ee5b-4433-bd28-eb62d562f0d7 tempest-FloatingIPsNegativeTestJSON-425016498 tempest-FloatingIPsNegativeTestJSON-425016498-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP a254aa06-5dcc-4c24-a7c4-2b700c860321 could not be found", "detail": ""}} {{(pid=121134) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 19 03:28:48.730761 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-ebc8b5ad-ee5b-4433-bd28-eb62d562f0d7 tempest-FloatingIPsNegativeTestJSON-425016498 tempest-FloatingIPsNegativeTestJSON-425016498-project] HTTP exception thrown: Floating IP not found for ID a254aa06-5dcc-4c24-a7c4-2b700c860321 Oct 19 03:28:48.732845 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ebc8b5ad-ee5b-4433-bd28-eb62d562f0d7 tempest-FloatingIPsNegativeTestJSON-425016498 tempest-FloatingIPsNegativeTestJSON-425016498-project] Request method failure captured: Oct 19 03:28:48.732845 n-d-861333-8 devstack@n-api.service[121134]: request: DELETE /compute/v2.1/os-floating-ips/a254aa06-5dcc-4c24-a7c4-2b700c860321 HTTP/1.1 Oct 19 03:28:48.732845 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:28:48.732845 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:28:48.732845 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:28:48.732845 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:28:48.732845 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:28:48.732845 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:28:48.732845 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:28:48.732845 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:28:48.732845 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT27u1-rvtAmHUU5moyoU3XPcAp0iRKwTYmaTQGVnBuSKgDjPGjEwsHRT_9Sk93BO_tXJS1y3ZOxgZ4aYfjJ9KfZYgnm8_QHxQuhYqAQp9lFciQQiQvlzPmU9B32k8bMFREQuiu8D8vmA0usjiBLUMzA5aBfwbcQesova3t7OpD0-6Ng Oct 19 03:28:48.732845 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:28:48.732845 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:28:48.732845 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:28:48.732845 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:28:48.732845 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:28:48.732845 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:28:48.732845 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 0104e8b89f854ad8a62e3394cf393a22 Oct 19 03:28:48.732845 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-425016498 Oct 19 03:28:48.732845 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:28:48.732845 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:28:48.734397 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/0104e8b89f854ad8a62e3394cf393a22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0104e8b89f854ad8a62e3394cf393a22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0104e8b89f854ad8a62e3394cf393a22"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_0104e8b89f854ad8a62e3394cf393a22", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:28:48.734397 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-425016498 Oct 19 03:28:48.734397 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 0104e8b89f854ad8a62e3394cf393a22 Oct 19 03:28:48.734397 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-425016498 Oct 19 03:28:48.734397 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-FloatingIPsNegativeTestJSON-425016498-project Oct 19 03:28:48.734397 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:28:48.734397 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:28:48.734397 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: c03d726e78a44f3988c07cd618f09269 Oct 19 03:28:48.734397 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-425016498-project Oct 19 03:28:48.734397 n-d-861333-8 devstack@n-api.service[121134]: method: Oct 19 03:28:48.734397 n-d-861333-8 devstack@n-api.service[121134]: exception: Floating IP not found for ID a254aa06-5dcc-4c24-a7c4-2b700c860321 Oct 19 03:28:48.734397 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': 'a254aa06-5dcc-4c24-a7c4-2b700c860321'} Oct 19 03:28:48.734397 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:28:48.735238 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:28:48.735238 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 19 03:28:48.735238 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 19 03:28:48.735238 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:28:48.735238 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:28:48.735238 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 19 03:28:48.735238 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 19 03:28:48.735238 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:28:48.735238 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:28:48.735238 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 19 03:28:48.735238 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 19 03:28:48.735238 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:28:48.735238 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:28:48.735238 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 19 03:28:48.735238 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 19 03:28:48.735238 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:28:48.735238 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:28:48.735238 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 19 03:28:48.735238 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 19 03:28:48.736528 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:28:48.736528 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:28:48.736528 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 19 03:28:48.736528 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 19 03:28:48.736528 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 19 03:28:48.736528 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 19 03:28:48.736528 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP a254aa06-5dcc-4c24-a7c4-2b700c860321 could not be found Oct 19 03:28:48.736528 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cb839a23-735f-409b-be38-1d3b23f1acc6'] Oct 19 03:28:48.736528 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:28:48.736528 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:28:48.736528 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:28:48.736528 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:28:48.736528 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 19 03:28:48.736528 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 19 03:28:48.736528 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 19 03:28:48.736528 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 19 03:28:48.736528 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID a254aa06-5dcc-4c24-a7c4-2b700c860321. Oct 19 03:28:48.736528 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:28:48.736528 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:28:48.736528 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:28:48.743200 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:28:48.743200 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:28:48.743200 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:28:48.743200 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:28:48.743200 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:28:48.743200 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 03:28:48.743200 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 03:28:48.743200 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:28:48.743200 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:28:48.743200 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 19 03:28:48.743200 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 19 03:28:48.743200 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID a254aa06-5dcc-4c24-a7c4-2b700c860321 Oct 19 03:28:48.743200 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:28:48.743200 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:28:48.743200 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:28:48.743200 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:28:48.743200 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:28:48.743200 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:28:48.743200 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:28:48.743200 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:28:48.746317 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID a254aa06-5dcc-4c24-a7c4-2b700c860321 Oct 19 03:28:48.746317 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:28:48.746317 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ebc8b5ad-ee5b-4433-bd28-eb62d562f0d7 tempest-FloatingIPsNegativeTestJSON-425016498 tempest-FloatingIPsNegativeTestJSON-425016498-project] Returning 404 to user: Floating IP not found for ID a254aa06-5dcc-4c24-a7c4-2b700c860321 {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:28:48.746317 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ebc8b5ad-ee5b-4433-bd28-eb62d562f0d7 tempest-FloatingIPsNegativeTestJSON-425016498 tempest-FloatingIPsNegativeTestJSON-425016498-project] 10.222.0.52 "DELETE /compute/v2.1/os-floating-ips/a254aa06-5dcc-4c24-a7c4-2b700c860321" status: 404 len: 111 microversion: 2.1 time: 0.083950 Oct 19 03:28:48.746317 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1833/3761] 10.222.0.52 () {58 vars in 1263 bytes} [Wed Oct 19 03:28:48 2022] DELETE /compute/v2.1/os-floating-ips/a254aa06-5dcc-4c24-a7c4-2b700c860321 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:28:48.746317 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-09d0d563-a628-4ab3-8d07-a150c7272008 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:48.747509 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-09d0d563-a628-4ab3-8d07-a150c7272008 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 3bb7abe9-5796-48da-bb31-aed0273716c7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:48.768592 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-09d0d563-a628-4ab3-8d07-a150c7272008 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:48.771746 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-09d0d563-a628-4ab3-8d07-a150c7272008 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:48.771746 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-09d0d563-a628-4ab3-8d07-a150c7272008 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:48.771746 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-09d0d563-a628-4ab3-8d07-a150c7272008 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:48.771746 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-09d0d563-a628-4ab3-8d07-a150c7272008 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:48.772173 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-09d0d563-a628-4ab3-8d07-a150c7272008 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:48.829706 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-819b70c7-a92c-47cc-9e43-ac24a14d96ad tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17362106426c46ca8c07ee8192fe2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcb4d8381f474d8bbea44443f845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:28:48.839819 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-819b70c7-a92c-47cc-9e43-ac24a14d96ad tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] 10.222.0.52 "GET /compute/v2.1/servers/3bfbe3fa-5e16-4b72-8232-7cf260c78f0a" status: 200 len: 1466 microversion: 2.1 time: 0.311640 Oct 19 03:28:48.841296 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1929/3762] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:48 2022] GET /compute/v2.1/servers/3bfbe3fa-5e16-4b72-8232-7cf260c78f0a => generated 1466 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:48.877870 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-963bb06f-15bf-4f5a-b598-6be75ba96caa tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Calling method '.version_select at 0x7fc12bfaa1f0>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:49.056512 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-09d0d563-a628-4ab3-8d07-a150c7272008 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:28:49.074290 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-09d0d563-a628-4ab3-8d07-a150c7272008 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7" status: 200 len: 1488 microversion: 2.1 time: 0.330597 Oct 19 03:28:49.075847 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1834/3763] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:48 2022] GET /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7 => generated 1488 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:49.105741 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-221cc830-a7bc-4c43-9864-9e49570f4cf5 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:49.105741 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-221cc830-a7bc-4c43-9864-9e49570f4cf5 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 3bb7abe9-5796-48da-bb31-aed0273716c7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:49.111679 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-221cc830-a7bc-4c43-9864-9e49570f4cf5 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:49.112787 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-221cc830-a7bc-4c43-9864-9e49570f4cf5 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:49.113465 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-221cc830-a7bc-4c43-9864-9e49570f4cf5 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:49.115587 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-221cc830-a7bc-4c43-9864-9e49570f4cf5 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:49.116688 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-221cc830-a7bc-4c43-9864-9e49570f4cf5 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:49.120867 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-221cc830-a7bc-4c43-9864-9e49570f4cf5 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:49.450470 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-221cc830-a7bc-4c43-9864-9e49570f4cf5 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:28:49.462389 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-221cc830-a7bc-4c43-9864-9e49570f4cf5 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7" status: 200 len: 1488 microversion: 2.1 time: 0.367776 Oct 19 03:28:49.462980 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1835/3764] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:49 2022] GET /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7 => generated 1488 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:28:49.492442 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b4a8398d-6c59-4b0e-ba33-e0c906578950 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:49.493309 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b4a8398d-6c59-4b0e-ba33-e0c906578950 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 3bb7abe9-5796-48da-bb31-aed0273716c7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:49.502563 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b4a8398d-6c59-4b0e-ba33-e0c906578950 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:49.503356 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b4a8398d-6c59-4b0e-ba33-e0c906578950 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:49.503866 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b4a8398d-6c59-4b0e-ba33-e0c906578950 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:49.504770 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b4a8398d-6c59-4b0e-ba33-e0c906578950 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:49.505346 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b4a8398d-6c59-4b0e-ba33-e0c906578950 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:49.505853 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b4a8398d-6c59-4b0e-ba33-e0c906578950 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:49.541108 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b4a8398d-6c59-4b0e-ba33-e0c906578950 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 3bb7abe9-5796-48da-bb31-aed0273716c7] Going to try to terminate instance {{(pid=121134) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:28:50.733895 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b4a8398d-6c59-4b0e-ba33-e0c906578950 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "DELETE /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7" status: 204 len: 0 microversion: 2.1 time: 1.244533 Oct 19 03:28:50.734547 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1836/3765] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:28:49 2022] DELETE /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7 => generated 0 bytes in 1247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:28:50.743463 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-82ffe62f-9ac6-4d73-b2d6-c7fec0411b48 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:50.746266 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-82ffe62f-9ac6-4d73-b2d6-c7fec0411b48 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: e13547eb-efb0-4153-8dec-a666d4e6349b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:50.764793 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-82ffe62f-9ac6-4d73-b2d6-c7fec0411b48 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:50.766249 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-82ffe62f-9ac6-4d73-b2d6-c7fec0411b48 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:50.772009 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-82ffe62f-9ac6-4d73-b2d6-c7fec0411b48 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:50.796647 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-82ffe62f-9ac6-4d73-b2d6-c7fec0411b48 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:50.811874 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-82ffe62f-9ac6-4d73-b2d6-c7fec0411b48 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:50.815903 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-82ffe62f-9ac6-4d73-b2d6-c7fec0411b48 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:50.946095 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-82ffe62f-9ac6-4d73-b2d6-c7fec0411b48 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2b0581ad4e4c9787bef838c81870a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dfe251b1e046a995b8ec302cb2ffa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:28:50.954481 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-82ffe62f-9ac6-4d73-b2d6-c7fec0411b48 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "GET /compute/v2.1/servers/e13547eb-efb0-4153-8dec-a666d4e6349b" status: 200 len: 1222 microversion: 2.1 time: 0.218758 Oct 19 03:28:50.965844 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1837/3766] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:50 2022] GET /compute/v2.1/servers/e13547eb-efb0-4153-8dec-a666d4e6349b => generated 1222 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:50.979127 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-6c84e908-f15c-4a68-8fdf-e47636790139 req-21752578-4f33-42b5-b05a-e35c5e823fb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bfbe3fa-5e16-4b72-8232-7cf260c78f0a", "name": "network-vif-unplugged", "status": "completed", "tag": "4cf986cf-c812-445d-9c71-bf2c9df9bf7f"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:28:51.004019 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-6c84e908-f15c-4a68-8fdf-e47636790139 req-21752578-4f33-42b5-b05a-e35c5e823fb9 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:51.004705 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-6c84e908-f15c-4a68-8fdf-e47636790139 req-21752578-4f33-42b5-b05a-e35c5e823fb9 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:51.005320 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-6c84e908-f15c-4a68-8fdf-e47636790139 req-21752578-4f33-42b5-b05a-e35c5e823fb9 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:51.019458 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-6c84e908-f15c-4a68-8fdf-e47636790139 req-21752578-4f33-42b5-b05a-e35c5e823fb9 service nova] Creating event network-vif-unplugged:4cf986cf-c812-445d-9c71-bf2c9df9bf7f for instance 3bfbe3fa-5e16-4b72-8232-7cf260c78f0a on n-h1-861333-8 Oct 19 03:28:51.025483 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-6c84e908-f15c-4a68-8fdf-e47636790139 req-21752578-4f33-42b5-b05a-e35c5e823fb9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058282 Oct 19 03:28:51.027297 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1838/3767] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:28:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:28:51.033077 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0a86580d-d01f-4079-b5a3-a2c8bdc08677 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:51.039103 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0a86580d-d01f-4079-b5a3-a2c8bdc08677 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 3bb7abe9-5796-48da-bb31-aed0273716c7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:51.042058 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0a86580d-d01f-4079-b5a3-a2c8bdc08677 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:51.042743 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0a86580d-d01f-4079-b5a3-a2c8bdc08677 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:51.043973 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0a86580d-d01f-4079-b5a3-a2c8bdc08677 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:51.044854 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0a86580d-d01f-4079-b5a3-a2c8bdc08677 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:51.045602 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0a86580d-d01f-4079-b5a3-a2c8bdc08677 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:51.047110 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0a86580d-d01f-4079-b5a3-a2c8bdc08677 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:51.273418 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0a86580d-d01f-4079-b5a3-a2c8bdc08677 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:28:51.284834 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0a86580d-d01f-4079-b5a3-a2c8bdc08677 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7" status: 200 len: 1494 microversion: 2.1 time: 0.255445 Oct 19 03:28:51.287210 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1839/3768] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:51 2022] GET /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7 => generated 1494 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:51.505310 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-963bb06f-15bf-4f5a-b598-6be75ba96caa tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] 10.222.0.52 "DELETE /compute/v2.1/images/cb8790e4-8520-4f34-9984-d5d9253c6556" status: 204 len: 0 microversion: 2.1 time: 2.631260 Oct 19 03:28:51.506628 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1930/3769] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:48 2022] DELETE /compute/v2.1/images/cb8790e4-8520-4f34-9984-d5d9253c6556 => generated 0 bytes in 2633 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 19 03:28:51.515357 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-66f52a10-4fcc-4592-a212-273bba8a00d5 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Calling method '.version_select at 0x7fc12bfd6c10>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:51.538421 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-66f52a10-4fcc-4592-a212-273bba8a00d5 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] HTTP exception thrown: Image not found. Oct 19 03:28:51.540268 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-66f52a10-4fcc-4592-a212-273bba8a00d5 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Request method failure captured: Oct 19 03:28:51.540268 n-d-861333-8 devstack@n-api.service[121134]: request: DELETE /compute/v2.1/images/ccff1b05-0698-450d-8019-09c754007fb9 HTTP/1.1 Oct 19 03:28:51.540268 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:28:51.540268 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:28:51.540268 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:28:51.540268 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:28:51.540268 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:28:51.540268 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:28:51.540268 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:28:51.540268 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:28:51.540268 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT26KRkQxqaGJKebQpaIRKc1C06FR2n-oiWuZrEqN7RnQhsWfo04BL753HN727mvlmU99Q0WMnKPJQCDxkX9HQsoapHKbP1vWTa0BZIZsMWFlx7Zp_m-dWSCuCXh0NinS7EJrzPV0c3BUs_i_4HmiT6d3vnaS8rm54dqm-QzA8WoL1VQ Oct 19 03:28:51.540268 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:28:51.540268 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:28:51.540268 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:28:51.540268 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:28:51.540268 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:28:51.540268 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:28:51.540268 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: b9fcb4d8381f474d8bbea44443f845f8 Oct 19 03:28:51.540268 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ImagesOneServerTestJSON-397829642 Oct 19 03:28:51.540268 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:28:51.540268 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:28:51.542089 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b9fcb4d8381f474d8bbea44443f845f8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b9fcb4d8381f474d8bbea44443f845f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b9fcb4d8381f474d8bbea44443f845f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b9fcb4d8381f474d8bbea44443f845f8", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:28:51.542089 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ImagesOneServerTestJSON-397829642 Oct 19 03:28:51.542089 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: b9fcb4d8381f474d8bbea44443f845f8 Oct 19 03:28:51.542089 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-397829642 Oct 19 03:28:51.542089 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ImagesOneServerTestJSON-397829642-project Oct 19 03:28:51.542089 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:28:51.542089 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:28:51.542089 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 17362106426c46ca8c07ee8192fe2bac Oct 19 03:28:51.542089 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ImagesOneServerTestJSON-397829642-project Oct 19 03:28:51.542089 n-d-861333-8 devstack@n-api.service[121134]: method: Oct 19 03:28:51.542089 n-d-861333-8 devstack@n-api.service[121134]: exception: Image not found. Oct 19 03:28:51.542089 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': 'ccff1b05-0698-450d-8019-09c754007fb9'} Oct 19 03:28:51.542089 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:28:51.543306 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:28:51.543306 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 19 03:28:51.543306 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 19 03:28:51.543306 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 19 03:28:51.543306 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 19 03:28:51.543306 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 19 03:28:51.543306 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 19 03:28:51.543306 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 19 03:28:51.543306 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 19 03:28:51.543306 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 19 03:28:51.543306 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 19 03:28:51.543306 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 19 03:28:51.543306 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 19 03:28:51.543306 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 19 03:28:51.543306 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 19 03:28:51.543306 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image ccff1b05-0698-450d-8019-09c754007fb9 to delete Oct 19 03:28:51.543306 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:28:51.543306 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:28:51.543306 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:28:51.545545 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:28:51.545545 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 19 03:28:51.545545 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 19 03:28:51.545545 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 19 03:28:51.545545 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 19 03:28:51.545545 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 19 03:28:51.545545 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 19 03:28:51.545545 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ccff1b05-0698-450d-8019-09c754007fb9 could not be found. Oct 19 03:28:51.545545 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:28:51.545545 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:28:51.545545 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:28:51.545545 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:28:51.545545 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:28:51.545545 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:28:51.545545 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:28:51.545545 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:28:51.545545 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 03:28:51.545545 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 03:28:51.545545 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:28:51.545545 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:28:51.547092 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 19 03:28:51.547092 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 19 03:28:51.547092 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 19 03:28:51.547092 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:28:51.547092 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:28:51.547092 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:28:51.547092 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:28:51.547092 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:28:51.547092 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:28:51.547092 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:28:51.547092 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:28:51.547092 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 19 03:28:51.547092 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:28:51.547092 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-66f52a10-4fcc-4592-a212-273bba8a00d5 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Returning 404 to user: Image not found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:28:51.547092 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-66f52a10-4fcc-4592-a212-273bba8a00d5 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] 10.222.0.52 "DELETE /compute/v2.1/images/ccff1b05-0698-450d-8019-09c754007fb9" status: 404 len: 62 microversion: 2.1 time: 0.031437 Oct 19 03:28:51.551857 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ac6f3f7f-a7b8-4c4a-9393-ef1966fb578e tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:51.552353 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ac6f3f7f-a7b8-4c4a-9393-ef1966fb578e tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] [instance: 3bfbe3fa-5e16-4b72-8232-7cf260c78f0a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:51.557455 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1840/3770] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:51 2022] DELETE /compute/v2.1/images/ccff1b05-0698-450d-8019-09c754007fb9 => generated 62 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 19 03:28:51.559200 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ac6f3f7f-a7b8-4c4a-9393-ef1966fb578e tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:51.563052 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ac6f3f7f-a7b8-4c4a-9393-ef1966fb578e tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:51.563052 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ac6f3f7f-a7b8-4c4a-9393-ef1966fb578e tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:51.563052 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ac6f3f7f-a7b8-4c4a-9393-ef1966fb578e tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:51.563052 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ac6f3f7f-a7b8-4c4a-9393-ef1966fb578e tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:51.563638 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ac6f3f7f-a7b8-4c4a-9393-ef1966fb578e tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:51.592395 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ac6f3f7f-a7b8-4c4a-9393-ef1966fb578e tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] [instance: 3bfbe3fa-5e16-4b72-8232-7cf260c78f0a] Going to try to terminate instance {{(pid=121135) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:28:51.984000 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-71150366-5dc4-4e3b-a40c-4ca94d3976a3 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:51.984552 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-71150366-5dc4-4e3b-a40c-4ca94d3976a3 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: e13547eb-efb0-4153-8dec-a666d4e6349b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:51.996348 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ac6f3f7f-a7b8-4c4a-9393-ef1966fb578e tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] 10.222.0.52 "DELETE /compute/v2.1/servers/3bfbe3fa-5e16-4b72-8232-7cf260c78f0a" status: 204 len: 0 microversion: 2.1 time: 0.447927 Oct 19 03:28:51.997037 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1931/3771] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:28:51 2022] DELETE /compute/v2.1/servers/3bfbe3fa-5e16-4b72-8232-7cf260c78f0a => generated 0 bytes in 450 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:28:52.020192 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7304a618-f8bc-4ef8-b4a1-a42e17b8fdb1 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:52.031721 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7304a618-f8bc-4ef8-b4a1-a42e17b8fdb1 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] [instance: 3bfbe3fa-5e16-4b72-8232-7cf260c78f0a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:52.061144 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7304a618-f8bc-4ef8-b4a1-a42e17b8fdb1 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:52.063477 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-71150366-5dc4-4e3b-a40c-4ca94d3976a3 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:52.063999 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-71150366-5dc4-4e3b-a40c-4ca94d3976a3 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:52.064989 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-71150366-5dc4-4e3b-a40c-4ca94d3976a3 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:52.066041 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-71150366-5dc4-4e3b-a40c-4ca94d3976a3 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:52.066197 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-71150366-5dc4-4e3b-a40c-4ca94d3976a3 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:52.066627 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-71150366-5dc4-4e3b-a40c-4ca94d3976a3 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:52.066959 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7304a618-f8bc-4ef8-b4a1-a42e17b8fdb1 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:52.069088 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7304a618-f8bc-4ef8-b4a1-a42e17b8fdb1 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:52.071400 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7304a618-f8bc-4ef8-b4a1-a42e17b8fdb1 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:52.073476 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7304a618-f8bc-4ef8-b4a1-a42e17b8fdb1 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:52.074292 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7304a618-f8bc-4ef8-b4a1-a42e17b8fdb1 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:52.083583 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:28:52.242140 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-71150366-5dc4-4e3b-a40c-4ca94d3976a3 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2b0581ad4e4c9787bef838c81870a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dfe251b1e046a995b8ec302cb2ffa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:28:52.253855 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-71150366-5dc4-4e3b-a40c-4ca94d3976a3 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "GET /compute/v2.1/servers/e13547eb-efb0-4153-8dec-a666d4e6349b" status: 200 len: 1214 microversion: 2.1 time: 0.277185 Oct 19 03:28:52.255383 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1841/3772] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:51 2022] GET /compute/v2.1/servers/e13547eb-efb0-4153-8dec-a666d4e6349b => generated 1214 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:28:52.313586 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-227b8c5a-772f-473d-9b31-8075666b8be9 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:52.314879 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-227b8c5a-772f-473d-9b31-8075666b8be9 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 3bb7abe9-5796-48da-bb31-aed0273716c7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:52.328795 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-227b8c5a-772f-473d-9b31-8075666b8be9 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:52.331981 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-227b8c5a-772f-473d-9b31-8075666b8be9 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:52.336105 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-227b8c5a-772f-473d-9b31-8075666b8be9 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:52.337665 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-227b8c5a-772f-473d-9b31-8075666b8be9 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:52.338330 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-227b8c5a-772f-473d-9b31-8075666b8be9 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:52.342174 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-227b8c5a-772f-473d-9b31-8075666b8be9 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:52.482084 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7304a618-f8bc-4ef8-b4a1-a42e17b8fdb1 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17362106426c46ca8c07ee8192fe2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcb4d8381f474d8bbea44443f845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:28:52.494331 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7304a618-f8bc-4ef8-b4a1-a42e17b8fdb1 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] 10.222.0.52 "GET /compute/v2.1/servers/3bfbe3fa-5e16-4b72-8232-7cf260c78f0a" status: 200 len: 1472 microversion: 2.1 time: 0.492800 Oct 19 03:28:52.508879 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1932/3773] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:52 2022] GET /compute/v2.1/servers/3bfbe3fa-5e16-4b72-8232-7cf260c78f0a => generated 1472 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:28:52.728527 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-227b8c5a-772f-473d-9b31-8075666b8be9 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:28:52.736923 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-227b8c5a-772f-473d-9b31-8075666b8be9 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7" status: 200 len: 1494 microversion: 2.1 time: 0.428451 Oct 19 03:28:52.737906 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1842/3774] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:52 2022] GET /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7 => generated 1494 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:53.280368 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-61ea2d11-2f56-459e-8193-d9e3e0469114 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:53.281006 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-61ea2d11-2f56-459e-8193-d9e3e0469114 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: e13547eb-efb0-4153-8dec-a666d4e6349b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:53.288605 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-61ea2d11-2f56-459e-8193-d9e3e0469114 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:53.289102 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-61ea2d11-2f56-459e-8193-d9e3e0469114 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:53.291733 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-61ea2d11-2f56-459e-8193-d9e3e0469114 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:53.292730 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-61ea2d11-2f56-459e-8193-d9e3e0469114 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:53.293606 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-61ea2d11-2f56-459e-8193-d9e3e0469114 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:53.294212 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-61ea2d11-2f56-459e-8193-d9e3e0469114 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:53.364524 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-61ea2d11-2f56-459e-8193-d9e3e0469114 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2b0581ad4e4c9787bef838c81870a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dfe251b1e046a995b8ec302cb2ffa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:28:53.385356 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-61ea2d11-2f56-459e-8193-d9e3e0469114 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "GET /compute/v2.1/servers/e13547eb-efb0-4153-8dec-a666d4e6349b" status: 200 len: 1270 microversion: 2.1 time: 0.109343 Oct 19 03:28:53.405084 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1933/3775] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:53 2022] GET /compute/v2.1/servers/e13547eb-efb0-4153-8dec-a666d4e6349b => generated 1270 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:53.519744 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7310eddf-62c5-4092-9d91-a2a9003f6fcb tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:53.520364 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7310eddf-62c5-4092-9d91-a2a9003f6fcb tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] [instance: 3bfbe3fa-5e16-4b72-8232-7cf260c78f0a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:53.528491 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7310eddf-62c5-4092-9d91-a2a9003f6fcb tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:53.528983 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7310eddf-62c5-4092-9d91-a2a9003f6fcb tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:53.529452 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7310eddf-62c5-4092-9d91-a2a9003f6fcb tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:53.530161 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7310eddf-62c5-4092-9d91-a2a9003f6fcb tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:53.530614 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7310eddf-62c5-4092-9d91-a2a9003f6fcb tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:53.531049 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7310eddf-62c5-4092-9d91-a2a9003f6fcb tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:53.776243 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-724513c8-58c3-406b-9d77-66ccdb219c7e tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:53.776940 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-724513c8-58c3-406b-9d77-66ccdb219c7e tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 3bb7abe9-5796-48da-bb31-aed0273716c7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:53.787935 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-724513c8-58c3-406b-9d77-66ccdb219c7e tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:53.788431 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-724513c8-58c3-406b-9d77-66ccdb219c7e tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:53.798113 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-724513c8-58c3-406b-9d77-66ccdb219c7e tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:53.799717 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-724513c8-58c3-406b-9d77-66ccdb219c7e tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:53.800365 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-724513c8-58c3-406b-9d77-66ccdb219c7e tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:53.800969 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-724513c8-58c3-406b-9d77-66ccdb219c7e tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:53.818794 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-7310eddf-62c5-4092-9d91-a2a9003f6fcb tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17362106426c46ca8c07ee8192fe2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcb4d8381f474d8bbea44443f845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:28:53.826895 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7310eddf-62c5-4092-9d91-a2a9003f6fcb tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] 10.222.0.52 "GET /compute/v2.1/servers/3bfbe3fa-5e16-4b72-8232-7cf260c78f0a" status: 200 len: 1472 microversion: 2.1 time: 0.311088 Oct 19 03:28:53.828467 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1843/3776] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:53 2022] GET /compute/v2.1/servers/3bfbe3fa-5e16-4b72-8232-7cf260c78f0a => generated 1472 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:54.057330 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-724513c8-58c3-406b-9d77-66ccdb219c7e tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:28:54.085155 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-724513c8-58c3-406b-9d77-66ccdb219c7e tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7" status: 200 len: 1494 microversion: 2.1 time: 0.326618 Oct 19 03:28:54.088059 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1934/3777] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:53 2022] GET /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7 => generated 1494 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:54.412669 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2a29f3e0-7973-4b96-8a26-78ab97f9b4db tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:54.414401 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2a29f3e0-7973-4b96-8a26-78ab97f9b4db tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: e13547eb-efb0-4153-8dec-a666d4e6349b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:54.423167 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2a29f3e0-7973-4b96-8a26-78ab97f9b4db tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:54.423821 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2a29f3e0-7973-4b96-8a26-78ab97f9b4db tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:54.424403 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2a29f3e0-7973-4b96-8a26-78ab97f9b4db tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:54.425492 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2a29f3e0-7973-4b96-8a26-78ab97f9b4db tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:54.425927 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2a29f3e0-7973-4b96-8a26-78ab97f9b4db tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:54.426440 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2a29f3e0-7973-4b96-8a26-78ab97f9b4db tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:54.499469 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-2a29f3e0-7973-4b96-8a26-78ab97f9b4db tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2b0581ad4e4c9787bef838c81870a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dfe251b1e046a995b8ec302cb2ffa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:28:54.510330 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2a29f3e0-7973-4b96-8a26-78ab97f9b4db tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "GET /compute/v2.1/servers/e13547eb-efb0-4153-8dec-a666d4e6349b" status: 200 len: 1270 microversion: 2.1 time: 0.101483 Oct 19 03:28:54.511239 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1844/3778] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:54 2022] GET /compute/v2.1/servers/e13547eb-efb0-4153-8dec-a666d4e6349b => generated 1270 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:54.855092 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a09d36ba-c7bd-4ebe-8dfc-ed059430d1c6 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:54.856322 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a09d36ba-c7bd-4ebe-8dfc-ed059430d1c6 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] [instance: 3bfbe3fa-5e16-4b72-8232-7cf260c78f0a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:54.875437 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-038da98a-c165-448a-8fad-13ab3459c4e5 req-aea1214f-e96d-4ee1-89e2-de5f0227f04b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bb7abe9-5796-48da-bb31-aed0273716c7", "name": "network-vif-deleted", "tag": "c632210a-428d-44d2-877e-fa2afcc8a7d8"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:28:54.879013 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a09d36ba-c7bd-4ebe-8dfc-ed059430d1c6 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:54.879903 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a09d36ba-c7bd-4ebe-8dfc-ed059430d1c6 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:54.880534 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a09d36ba-c7bd-4ebe-8dfc-ed059430d1c6 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:54.881493 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a09d36ba-c7bd-4ebe-8dfc-ed059430d1c6 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:54.882149 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a09d36ba-c7bd-4ebe-8dfc-ed059430d1c6 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:54.882772 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a09d36ba-c7bd-4ebe-8dfc-ed059430d1c6 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:54.914692 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-038da98a-c165-448a-8fad-13ab3459c4e5 req-aea1214f-e96d-4ee1-89e2-de5f0227f04b service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:54.914692 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-038da98a-c165-448a-8fad-13ab3459c4e5 req-aea1214f-e96d-4ee1-89e2-de5f0227f04b service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:54.914692 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-038da98a-c165-448a-8fad-13ab3459c4e5 req-aea1214f-e96d-4ee1-89e2-de5f0227f04b service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:54.939933 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-038da98a-c165-448a-8fad-13ab3459c4e5 req-aea1214f-e96d-4ee1-89e2-de5f0227f04b service nova] Creating event network-vif-deleted:c632210a-428d-44d2-877e-fa2afcc8a7d8 for instance 3bb7abe9-5796-48da-bb31-aed0273716c7 on n-h1-861333-8 Oct 19 03:28:54.948874 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-038da98a-c165-448a-8fad-13ab3459c4e5 req-aea1214f-e96d-4ee1-89e2-de5f0227f04b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079480 Oct 19 03:28:54.950272 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1845/3779] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:28:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:28:55.114337 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a307dd1a-701a-4330-89a7-46727f8f584b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:55.115895 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a307dd1a-701a-4330-89a7-46727f8f584b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 3bb7abe9-5796-48da-bb31-aed0273716c7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:55.137734 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a307dd1a-701a-4330-89a7-46727f8f584b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:55.139048 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a307dd1a-701a-4330-89a7-46727f8f584b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:55.142154 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a307dd1a-701a-4330-89a7-46727f8f584b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:55.142981 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a307dd1a-701a-4330-89a7-46727f8f584b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:55.143451 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a307dd1a-701a-4330-89a7-46727f8f584b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:55.147472 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a307dd1a-701a-4330-89a7-46727f8f584b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:55.185584 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a09d36ba-c7bd-4ebe-8dfc-ed059430d1c6 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17362106426c46ca8c07ee8192fe2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcb4d8381f474d8bbea44443f845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:28:55.210483 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a09d36ba-c7bd-4ebe-8dfc-ed059430d1c6 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] 10.222.0.52 "GET /compute/v2.1/servers/3bfbe3fa-5e16-4b72-8232-7cf260c78f0a" status: 200 len: 1472 microversion: 2.1 time: 0.362402 Oct 19 03:28:55.211235 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1935/3780] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:54 2022] GET /compute/v2.1/servers/3bfbe3fa-5e16-4b72-8232-7cf260c78f0a => generated 1472 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:55.264950 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a307dd1a-701a-4330-89a7-46727f8f584b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:28:55.283481 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a307dd1a-701a-4330-89a7-46727f8f584b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7" status: 200 len: 1292 microversion: 2.1 time: 0.175863 Oct 19 03:28:55.293741 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1846/3781] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:55 2022] GET /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7 => generated 1292 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:28:55.418696 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-0ebeed6c-d9b9-4c99-ab73-31f8d873f33c req-69b5f790-be14-4953-86f3-d2c6f9f81e46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bfbe3fa-5e16-4b72-8232-7cf260c78f0a", "name": "network-vif-deleted", "tag": "4cf986cf-c812-445d-9c71-bf2c9df9bf7f"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:28:55.440844 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-0ebeed6c-d9b9-4c99-ab73-31f8d873f33c req-69b5f790-be14-4953-86f3-d2c6f9f81e46 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:55.441305 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-0ebeed6c-d9b9-4c99-ab73-31f8d873f33c req-69b5f790-be14-4953-86f3-d2c6f9f81e46 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:55.441789 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-0ebeed6c-d9b9-4c99-ab73-31f8d873f33c req-69b5f790-be14-4953-86f3-d2c6f9f81e46 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:55.454046 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-0ebeed6c-d9b9-4c99-ab73-31f8d873f33c req-69b5f790-be14-4953-86f3-d2c6f9f81e46 service nova] Creating event network-vif-deleted:4cf986cf-c812-445d-9c71-bf2c9df9bf7f for instance 3bfbe3fa-5e16-4b72-8232-7cf260c78f0a on n-h1-861333-8 Oct 19 03:28:55.460875 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-0ebeed6c-d9b9-4c99-ab73-31f8d873f33c req-69b5f790-be14-4953-86f3-d2c6f9f81e46 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045027 Oct 19 03:28:55.462748 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1936/3782] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:28:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:28:55.535099 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-fd796275-d584-4ae7-8fda-28c1de868108 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:55.535766 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-fd796275-d584-4ae7-8fda-28c1de868108 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: e13547eb-efb0-4153-8dec-a666d4e6349b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:55.544242 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fd796275-d584-4ae7-8fda-28c1de868108 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:55.548242 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fd796275-d584-4ae7-8fda-28c1de868108 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:55.548949 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fd796275-d584-4ae7-8fda-28c1de868108 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:55.549887 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fd796275-d584-4ae7-8fda-28c1de868108 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:55.551459 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fd796275-d584-4ae7-8fda-28c1de868108 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:55.558368 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fd796275-d584-4ae7-8fda-28c1de868108 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:55.711307 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-fd796275-d584-4ae7-8fda-28c1de868108 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2b0581ad4e4c9787bef838c81870a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dfe251b1e046a995b8ec302cb2ffa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:28:55.734721 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-fd796275-d584-4ae7-8fda-28c1de868108 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "GET /compute/v2.1/servers/e13547eb-efb0-4153-8dec-a666d4e6349b" status: 200 len: 1278 microversion: 2.1 time: 0.204057 Oct 19 03:28:55.736530 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1847/3783] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:55 2022] GET /compute/v2.1/servers/e13547eb-efb0-4153-8dec-a666d4e6349b => generated 1278 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:56.238412 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6ce9e440-aa1b-4369-ab79-aa5718cb0416 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:56.239973 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6ce9e440-aa1b-4369-ab79-aa5718cb0416 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] [instance: 3bfbe3fa-5e16-4b72-8232-7cf260c78f0a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:56.253330 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6ce9e440-aa1b-4369-ab79-aa5718cb0416 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:56.254661 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6ce9e440-aa1b-4369-ab79-aa5718cb0416 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:56.256365 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6ce9e440-aa1b-4369-ab79-aa5718cb0416 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:56.257970 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6ce9e440-aa1b-4369-ab79-aa5718cb0416 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:56.259148 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6ce9e440-aa1b-4369-ab79-aa5718cb0416 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:56.260027 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6ce9e440-aa1b-4369-ab79-aa5718cb0416 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:56.307414 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1b21f624-7fb0-4dbb-8d14-c499a26821df tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:56.308019 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1b21f624-7fb0-4dbb-8d14-c499a26821df tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 3bb7abe9-5796-48da-bb31-aed0273716c7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:56.313566 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6ce9e440-aa1b-4369-ab79-aa5718cb0416 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:56.314653 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6ce9e440-aa1b-4369-ab79-aa5718cb0416 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:56.314800 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1b21f624-7fb0-4dbb-8d14-c499a26821df tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:56.315265 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1b21f624-7fb0-4dbb-8d14-c499a26821df tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:56.315581 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6ce9e440-aa1b-4369-ab79-aa5718cb0416 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:56.315704 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1b21f624-7fb0-4dbb-8d14-c499a26821df tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:56.316362 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-6ce9e440-aa1b-4369-ab79-aa5718cb0416 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Lazy-loading 'fault' on Instance uuid 3bfbe3fa-5e16-4b72-8232-7cf260c78f0a {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:28:56.316495 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1b21f624-7fb0-4dbb-8d14-c499a26821df tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:56.316812 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1b21f624-7fb0-4dbb-8d14-c499a26821df tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:56.317239 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1b21f624-7fb0-4dbb-8d14-c499a26821df tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:56.400137 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-6ce9e440-aa1b-4369-ab79-aa5718cb0416 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17362106426c46ca8c07ee8192fe2bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcb4d8381f474d8bbea44443f845f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:28:56.408843 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1b21f624-7fb0-4dbb-8d14-c499a26821df tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:56.409646 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1b21f624-7fb0-4dbb-8d14-c499a26821df tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:56.410474 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1b21f624-7fb0-4dbb-8d14-c499a26821df tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:56.411107 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-1b21f624-7fb0-4dbb-8d14-c499a26821df tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lazy-loading 'fault' on Instance uuid 3bb7abe9-5796-48da-bb31-aed0273716c7 {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:28:56.417064 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6ce9e440-aa1b-4369-ab79-aa5718cb0416 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] 10.222.0.52 "GET /compute/v2.1/servers/3bfbe3fa-5e16-4b72-8232-7cf260c78f0a" status: 200 len: 1306 microversion: 2.1 time: 0.184751 Oct 19 03:28:56.423982 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1937/3784] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:56 2022] GET /compute/v2.1/servers/3bfbe3fa-5e16-4b72-8232-7cf260c78f0a => generated 1306 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:56.508762 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-1b21f624-7fb0-4dbb-8d14-c499a26821df tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:28:56.538208 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1b21f624-7fb0-4dbb-8d14-c499a26821df tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7" status: 200 len: 1310 microversion: 2.1 time: 0.218329 Oct 19 03:28:56.538208 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1848/3785] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:56 2022] GET /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7 => generated 1310 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:56.762521 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-963071a8-cf50-4b3c-88a0-96ef38473ecd tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:56.763260 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-963071a8-cf50-4b3c-88a0-96ef38473ecd tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: e13547eb-efb0-4153-8dec-a666d4e6349b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:56.771987 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-963071a8-cf50-4b3c-88a0-96ef38473ecd tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:56.781576 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-963071a8-cf50-4b3c-88a0-96ef38473ecd tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:56.782370 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-963071a8-cf50-4b3c-88a0-96ef38473ecd tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:56.785442 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-963071a8-cf50-4b3c-88a0-96ef38473ecd tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:56.785920 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-963071a8-cf50-4b3c-88a0-96ef38473ecd tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:56.786357 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-963071a8-cf50-4b3c-88a0-96ef38473ecd tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:57.014737 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-963071a8-cf50-4b3c-88a0-96ef38473ecd tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2b0581ad4e4c9787bef838c81870a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dfe251b1e046a995b8ec302cb2ffa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:28:57.024479 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-963071a8-cf50-4b3c-88a0-96ef38473ecd tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "GET /compute/v2.1/servers/e13547eb-efb0-4153-8dec-a666d4e6349b" status: 200 len: 1318 microversion: 2.1 time: 0.266212 Oct 19 03:28:57.025820 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1938/3786] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:56 2022] GET /compute/v2.1/servers/e13547eb-efb0-4153-8dec-a666d4e6349b => generated 1318 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:57.448071 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6dcbeb5b-3950-41f2-836d-bec7f91e49f9 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:57.451159 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6dcbeb5b-3950-41f2-836d-bec7f91e49f9 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] [instance: 3bfbe3fa-5e16-4b72-8232-7cf260c78f0a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:57.457594 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6dcbeb5b-3950-41f2-836d-bec7f91e49f9 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:57.463670 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6dcbeb5b-3950-41f2-836d-bec7f91e49f9 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:57.464208 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6dcbeb5b-3950-41f2-836d-bec7f91e49f9 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:57.465061 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6dcbeb5b-3950-41f2-836d-bec7f91e49f9 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:57.467237 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6dcbeb5b-3950-41f2-836d-bec7f91e49f9 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:57.467787 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6dcbeb5b-3950-41f2-836d-bec7f91e49f9 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:57.483516 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-6dcbeb5b-3950-41f2-836d-bec7f91e49f9 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] HTTP exception thrown: Instance 3bfbe3fa-5e16-4b72-8232-7cf260c78f0a could not be found. Oct 19 03:28:57.485499 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6dcbeb5b-3950-41f2-836d-bec7f91e49f9 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Request method failure captured: Oct 19 03:28:57.485499 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/3bfbe3fa-5e16-4b72-8232-7cf260c78f0a HTTP/1.1 Oct 19 03:28:57.485499 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:28:57.485499 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:28:57.485499 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:28:57.485499 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:28:57.485499 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:28:57.485499 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:28:57.485499 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:28:57.485499 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:28:57.485499 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT26KRkQxqaGJKebQpaIRKc1C06FR2n-oiWuZrEqN7RnQhsWfo04BL753HN727mvlmU99Q0WMnKPJQCDxkX9HQsoapHKbP1vWTa0BZIZsMWFlx7Zp_m-dWSCuCXh0NinS7EJrzPV0c3BUs_i_4HmiT6d3vnaS8rm54dqm-QzA8WoL1VQ Oct 19 03:28:57.485499 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:28:57.485499 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:28:57.485499 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:28:57.485499 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:28:57.485499 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:28:57.485499 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:28:57.485499 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: b9fcb4d8381f474d8bbea44443f845f8 Oct 19 03:28:57.485499 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ImagesOneServerTestJSON-397829642 Oct 19 03:28:57.485499 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:28:57.485499 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:28:57.487042 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b9fcb4d8381f474d8bbea44443f845f8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b9fcb4d8381f474d8bbea44443f845f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b9fcb4d8381f474d8bbea44443f845f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b9fcb4d8381f474d8bbea44443f845f8", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:28:57.487042 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ImagesOneServerTestJSON-397829642 Oct 19 03:28:57.487042 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: b9fcb4d8381f474d8bbea44443f845f8 Oct 19 03:28:57.487042 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-397829642 Oct 19 03:28:57.487042 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ImagesOneServerTestJSON-397829642-project Oct 19 03:28:57.487042 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:28:57.487042 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:28:57.487042 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 17362106426c46ca8c07ee8192fe2bac Oct 19 03:28:57.487042 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ImagesOneServerTestJSON-397829642-project Oct 19 03:28:57.487042 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:28:57.487042 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance 3bfbe3fa-5e16-4b72-8232-7cf260c78f0a could not be found. Oct 19 03:28:57.487042 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '3bfbe3fa-5e16-4b72-8232-7cf260c78f0a'} Oct 19 03:28:57.487818 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:28:57.487818 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:28:57.487818 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:28:57.487818 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:28:57.487818 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:28:57.487818 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:28:57.487818 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:28:57.487818 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:28:57.487818 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:28:57.487818 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:28:57.487818 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3bfbe3fa-5e16-4b72-8232-7cf260c78f0a could not be found. Oct 19 03:28:57.487818 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:28:57.487818 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:28:57.487818 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:28:57.487818 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:28:57.487818 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:28:57.487818 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:28:57.487818 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:28:57.487818 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:28:57.487818 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:28:57.489117 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:28:57.489117 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:28:57.489117 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:28:57.489117 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:28:57.489117 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:28:57.489117 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:28:57.489117 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:28:57.489117 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3bfbe3fa-5e16-4b72-8232-7cf260c78f0a could not be found. Oct 19 03:28:57.489117 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:28:57.489117 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:28:57.489117 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:28:57.489117 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:28:57.489117 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:28:57.489117 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:28:57.489117 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:28:57.489117 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:28:57.489117 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3bfbe3fa-5e16-4b72-8232-7cf260c78f0a could not be found. Oct 19 03:28:57.489117 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:28:57.491680 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6dcbeb5b-3950-41f2-836d-bec7f91e49f9 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] Returning 404 to user: Instance 3bfbe3fa-5e16-4b72-8232-7cf260c78f0a could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:28:57.492774 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6dcbeb5b-3950-41f2-836d-bec7f91e49f9 tempest-ImagesOneServerTestJSON-397829642 tempest-ImagesOneServerTestJSON-397829642-project] 10.222.0.52 "GET /compute/v2.1/servers/3bfbe3fa-5e16-4b72-8232-7cf260c78f0a" status: 404 len: 111 microversion: 2.1 time: 0.049230 Oct 19 03:28:57.493958 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1849/3787] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:57 2022] GET /compute/v2.1/servers/3bfbe3fa-5e16-4b72-8232-7cf260c78f0a => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:28:57.557660 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-61840163-5788-4e6a-a556-de1c5d4ffa47 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:57.557660 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-61840163-5788-4e6a-a556-de1c5d4ffa47 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 3bb7abe9-5796-48da-bb31-aed0273716c7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:57.568380 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-61840163-5788-4e6a-a556-de1c5d4ffa47 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:57.568874 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-61840163-5788-4e6a-a556-de1c5d4ffa47 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:57.569492 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-61840163-5788-4e6a-a556-de1c5d4ffa47 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:57.570202 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-61840163-5788-4e6a-a556-de1c5d4ffa47 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:57.570803 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-61840163-5788-4e6a-a556-de1c5d4ffa47 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:57.574487 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-61840163-5788-4e6a-a556-de1c5d4ffa47 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:57.604790 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-61840163-5788-4e6a-a556-de1c5d4ffa47 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] HTTP exception thrown: Instance 3bb7abe9-5796-48da-bb31-aed0273716c7 could not be found. Oct 19 03:28:57.606520 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-61840163-5788-4e6a-a556-de1c5d4ffa47 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Request method failure captured: Oct 19 03:28:57.606520 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7 HTTP/1.1 Oct 19 03:28:57.606520 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:28:57.606520 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:28:57.606520 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:28:57.606520 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:28:57.606520 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:28:57.606520 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:28:57.606520 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:28:57.606520 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:28:57.606520 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT236feAW7aGPVoj9kEkUuQkRB8Nm9YBd70D85XbXnYqUAmlwAIPPx50C6dTRY9MbtBVt7IleIPYf6veKmIP1JclrFv3Px4uu5w7tRxEjRIxVTymsVviR-8HO1OxRuIfq2VSbST57MCBZOLAwnCIkIbO3ZT-DhhWvyFTRPdgvgRqqxa8 Oct 19 03:28:57.606520 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:28:57.606520 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:28:57.606520 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:28:57.606520 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:28:57.606520 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:28:57.606520 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:28:57.606520 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 7a836a10033546ed9a73a4f463587d72 Oct 19 03:28:57.606520 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ServersTestJSON-490256660 Oct 19 03:28:57.606520 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:28:57.606520 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:28:57.608233 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7a836a10033546ed9a73a4f463587d72"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7a836a10033546ed9a73a4f463587d72"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7a836a10033546ed9a73a4f463587d72"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7a836a10033546ed9a73a4f463587d72", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:28:57.608233 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ServersTestJSON-490256660 Oct 19 03:28:57.608233 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 7a836a10033546ed9a73a4f463587d72 Oct 19 03:28:57.608233 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ServersTestJSON-490256660 Oct 19 03:28:57.608233 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ServersTestJSON-490256660-project Oct 19 03:28:57.608233 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:28:57.608233 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:28:57.608233 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: b09d2eecd3d9419189e6308379fa8a09 Oct 19 03:28:57.608233 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ServersTestJSON-490256660-project Oct 19 03:28:57.608233 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:28:57.608233 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance 3bb7abe9-5796-48da-bb31-aed0273716c7 could not be found. Oct 19 03:28:57.608233 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '3bb7abe9-5796-48da-bb31-aed0273716c7'} Oct 19 03:28:57.609171 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:28:57.609171 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:28:57.609171 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:28:57.609171 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:28:57.609171 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:28:57.609171 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:28:57.609171 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:28:57.609171 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:28:57.609171 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:28:57.609171 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:28:57.609171 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3bb7abe9-5796-48da-bb31-aed0273716c7 could not be found. Oct 19 03:28:57.609171 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:28:57.609171 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:28:57.609171 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:28:57.609171 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:28:57.609171 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:28:57.609171 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:28:57.609171 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:28:57.609171 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:28:57.609171 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:28:57.610730 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:28:57.610730 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:28:57.610730 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:28:57.610730 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:28:57.610730 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:28:57.610730 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:28:57.610730 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:28:57.610730 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3bb7abe9-5796-48da-bb31-aed0273716c7 could not be found. Oct 19 03:28:57.610730 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:28:57.610730 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:28:57.610730 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:28:57.610730 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:28:57.610730 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:28:57.610730 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:28:57.610730 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:28:57.610730 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:28:57.610730 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3bb7abe9-5796-48da-bb31-aed0273716c7 could not be found. Oct 19 03:28:57.610730 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:28:57.612584 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-61840163-5788-4e6a-a556-de1c5d4ffa47 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Returning 404 to user: Instance 3bb7abe9-5796-48da-bb31-aed0273716c7 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:28:57.612584 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-61840163-5788-4e6a-a556-de1c5d4ffa47 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7" status: 404 len: 111 microversion: 2.1 time: 0.058810 Oct 19 03:28:57.613252 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1939/3788] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:57 2022] GET /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:28:57.630549 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-dae78e79-2034-421b-b514-6830b37992d2 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:57.631142 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-dae78e79-2034-421b-b514-6830b37992d2 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 3bb7abe9-5796-48da-bb31-aed0273716c7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:57.642912 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dae78e79-2034-421b-b514-6830b37992d2 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:57.643423 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dae78e79-2034-421b-b514-6830b37992d2 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:57.643853 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dae78e79-2034-421b-b514-6830b37992d2 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:57.645338 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dae78e79-2034-421b-b514-6830b37992d2 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:57.645815 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dae78e79-2034-421b-b514-6830b37992d2 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:57.646244 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dae78e79-2034-421b-b514-6830b37992d2 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:57.657666 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:28:57.680995 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-dae78e79-2034-421b-b514-6830b37992d2 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] HTTP exception thrown: Instance 3bb7abe9-5796-48da-bb31-aed0273716c7 could not be found. Oct 19 03:28:57.686767 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-dae78e79-2034-421b-b514-6830b37992d2 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Request method failure captured: Oct 19 03:28:57.686767 n-d-861333-8 devstack@n-api.service[121134]: request: DELETE /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7 HTTP/1.1 Oct 19 03:28:57.686767 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:28:57.686767 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:28:57.686767 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:28:57.686767 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:28:57.686767 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:28:57.686767 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:28:57.686767 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:28:57.686767 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:28:57.686767 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT236feAW7aGPVoj9kEkUuQkRB8Nm9YBd70D85XbXnYqUAmlwAIPPx50C6dTRY9MbtBVt7IleIPYf6veKmIP1JclrFv3Px4uu5w7tRxEjRIxVTymsVviR-8HO1OxRuIfq2VSbST57MCBZOLAwnCIkIbO3ZT-DhhWvyFTRPdgvgRqqxa8 Oct 19 03:28:57.686767 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:28:57.686767 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:28:57.686767 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:28:57.686767 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:28:57.686767 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:28:57.686767 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:28:57.686767 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 7a836a10033546ed9a73a4f463587d72 Oct 19 03:28:57.686767 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ServersTestJSON-490256660 Oct 19 03:28:57.686767 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:28:57.686767 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:28:57.691834 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7a836a10033546ed9a73a4f463587d72"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7a836a10033546ed9a73a4f463587d72"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7a836a10033546ed9a73a4f463587d72"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7a836a10033546ed9a73a4f463587d72", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:28:57.691834 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ServersTestJSON-490256660 Oct 19 03:28:57.691834 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 7a836a10033546ed9a73a4f463587d72 Oct 19 03:28:57.691834 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ServersTestJSON-490256660 Oct 19 03:28:57.691834 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ServersTestJSON-490256660-project Oct 19 03:28:57.691834 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:28:57.691834 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:28:57.691834 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: b09d2eecd3d9419189e6308379fa8a09 Oct 19 03:28:57.691834 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ServersTestJSON-490256660-project Oct 19 03:28:57.691834 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:28:57.691834 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance 3bb7abe9-5796-48da-bb31-aed0273716c7 could not be found. Oct 19 03:28:57.691834 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '3bb7abe9-5796-48da-bb31-aed0273716c7'} Oct 19 03:28:57.692832 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:28:57.692832 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:28:57.692832 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:28:57.692832 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:28:57.692832 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:28:57.692832 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:28:57.692832 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:28:57.692832 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:28:57.692832 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:28:57.692832 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:28:57.692832 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3bb7abe9-5796-48da-bb31-aed0273716c7 could not be found. Oct 19 03:28:57.692832 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:28:57.692832 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:28:57.692832 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:28:57.692832 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:28:57.692832 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:28:57.692832 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:28:57.692832 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:28:57.692832 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:28:57.692832 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:28:57.694468 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:28:57.694468 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 03:28:57.694468 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 03:28:57.694468 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 03:28:57.694468 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 03:28:57.694468 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:28:57.694468 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:28:57.694468 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:28:57.694468 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:28:57.694468 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3bb7abe9-5796-48da-bb31-aed0273716c7 could not be found. Oct 19 03:28:57.694468 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:28:57.694468 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:28:57.694468 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:28:57.694468 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:28:57.694468 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:28:57.694468 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:28:57.694468 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:28:57.694468 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:28:57.694468 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3bb7abe9-5796-48da-bb31-aed0273716c7 could not be found. Oct 19 03:28:57.694468 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:28:57.696201 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-dae78e79-2034-421b-b514-6830b37992d2 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Returning 404 to user: Instance 3bb7abe9-5796-48da-bb31-aed0273716c7 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:28:57.696201 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-dae78e79-2034-421b-b514-6830b37992d2 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "DELETE /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7" status: 404 len: 111 microversion: 2.1 time: 0.063176 Oct 19 03:28:57.696201 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1850/3789] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:28:57 2022] DELETE /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:28:57.699551 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5f6c19fe-4f87-4318-8b6a-b35ef009b46a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:57.700171 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-5f6c19fe-4f87-4318-8b6a-b35ef009b46a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 3bb7abe9-5796-48da-bb31-aed0273716c7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:57.709895 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5f6c19fe-4f87-4318-8b6a-b35ef009b46a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:57.713786 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5f6c19fe-4f87-4318-8b6a-b35ef009b46a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:57.714182 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5f6c19fe-4f87-4318-8b6a-b35ef009b46a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:57.714909 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5f6c19fe-4f87-4318-8b6a-b35ef009b46a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:57.715533 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5f6c19fe-4f87-4318-8b6a-b35ef009b46a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:57.715972 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5f6c19fe-4f87-4318-8b6a-b35ef009b46a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:57.733771 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-5f6c19fe-4f87-4318-8b6a-b35ef009b46a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] HTTP exception thrown: Instance 3bb7abe9-5796-48da-bb31-aed0273716c7 could not be found. Oct 19 03:28:57.737026 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5f6c19fe-4f87-4318-8b6a-b35ef009b46a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Request method failure captured: Oct 19 03:28:57.737026 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7 HTTP/1.1 Oct 19 03:28:57.737026 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:28:57.737026 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:28:57.737026 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:28:57.737026 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:28:57.737026 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:28:57.737026 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:28:57.737026 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:28:57.737026 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:28:57.737026 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT236feAW7aGPVoj9kEkUuQkRB8Nm9YBd70D85XbXnYqUAmlwAIPPx50C6dTRY9MbtBVt7IleIPYf6veKmIP1JclrFv3Px4uu5w7tRxEjRIxVTymsVviR-8HO1OxRuIfq2VSbST57MCBZOLAwnCIkIbO3ZT-DhhWvyFTRPdgvgRqqxa8 Oct 19 03:28:57.737026 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:28:57.737026 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:28:57.737026 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:28:57.737026 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:28:57.737026 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:28:57.737026 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:28:57.737026 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 7a836a10033546ed9a73a4f463587d72 Oct 19 03:28:57.737026 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ServersTestJSON-490256660 Oct 19 03:28:57.737026 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:28:57.737026 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:28:57.738535 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7a836a10033546ed9a73a4f463587d72"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7a836a10033546ed9a73a4f463587d72"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7a836a10033546ed9a73a4f463587d72"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7a836a10033546ed9a73a4f463587d72", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:28:57.738535 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ServersTestJSON-490256660 Oct 19 03:28:57.738535 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 7a836a10033546ed9a73a4f463587d72 Oct 19 03:28:57.738535 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ServersTestJSON-490256660 Oct 19 03:28:57.738535 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ServersTestJSON-490256660-project Oct 19 03:28:57.738535 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:28:57.738535 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:28:57.738535 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: b09d2eecd3d9419189e6308379fa8a09 Oct 19 03:28:57.738535 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ServersTestJSON-490256660-project Oct 19 03:28:57.738535 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:28:57.738535 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance 3bb7abe9-5796-48da-bb31-aed0273716c7 could not be found. Oct 19 03:28:57.738535 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '3bb7abe9-5796-48da-bb31-aed0273716c7'} Oct 19 03:28:57.739328 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:28:57.739328 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:28:57.739328 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:28:57.739328 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:28:57.739328 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:28:57.739328 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:28:57.739328 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:28:57.739328 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:28:57.739328 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:28:57.739328 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:28:57.739328 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3bb7abe9-5796-48da-bb31-aed0273716c7 could not be found. Oct 19 03:28:57.739328 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:28:57.739328 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:28:57.739328 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:28:57.739328 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:28:57.739328 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:28:57.739328 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:28:57.739328 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:28:57.739328 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:28:57.739328 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:28:57.740554 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:28:57.740554 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:28:57.740554 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:28:57.740554 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:28:57.740554 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:28:57.740554 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:28:57.740554 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:28:57.740554 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3bb7abe9-5796-48da-bb31-aed0273716c7 could not be found. Oct 19 03:28:57.740554 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:28:57.740554 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:28:57.740554 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:28:57.740554 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:28:57.740554 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:28:57.740554 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:28:57.740554 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:28:57.740554 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:28:57.740554 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3bb7abe9-5796-48da-bb31-aed0273716c7 could not be found. Oct 19 03:28:57.740554 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:28:57.742690 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5f6c19fe-4f87-4318-8b6a-b35ef009b46a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Returning 404 to user: Instance 3bb7abe9-5796-48da-bb31-aed0273716c7 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:28:57.743814 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5f6c19fe-4f87-4318-8b6a-b35ef009b46a tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7" status: 404 len: 111 microversion: 2.1 time: 0.049192 Oct 19 03:28:57.744928 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1940/3790] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:57 2022] GET /compute/v2.1/servers/3bb7abe9-5796-48da-bb31-aed0273716c7 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:28:57.755935 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ed29d8ad-e8b3-492b-ba92-2edec8c88c4f tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:57.756976 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ed29d8ad-e8b3-492b-ba92-2edec8c88c4f tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 5c23235b-b905-463f-bb7b-fef2a0381ed8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:57.766272 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ed29d8ad-e8b3-492b-ba92-2edec8c88c4f tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:57.767055 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ed29d8ad-e8b3-492b-ba92-2edec8c88c4f tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:57.767520 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ed29d8ad-e8b3-492b-ba92-2edec8c88c4f tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:57.768454 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ed29d8ad-e8b3-492b-ba92-2edec8c88c4f tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:57.768917 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ed29d8ad-e8b3-492b-ba92-2edec8c88c4f tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:57.769351 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ed29d8ad-e8b3-492b-ba92-2edec8c88c4f tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:57.793222 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-ed29d8ad-e8b3-492b-ba92-2edec8c88c4f tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] HTTP exception thrown: Instance 5c23235b-b905-463f-bb7b-fef2a0381ed8 could not be found. Oct 19 03:28:57.794868 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ed29d8ad-e8b3-492b-ba92-2edec8c88c4f tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Request method failure captured: Oct 19 03:28:57.794868 n-d-861333-8 devstack@n-api.service[121134]: request: DELETE /compute/v2.1/servers/5c23235b-b905-463f-bb7b-fef2a0381ed8 HTTP/1.1 Oct 19 03:28:57.794868 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:28:57.794868 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:28:57.794868 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:28:57.794868 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:28:57.794868 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:28:57.794868 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:28:57.794868 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:28:57.794868 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:28:57.794868 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT236feAW7aGPVoj9kEkUuQkRB8Nm9YBd70D85XbXnYqUAmlwAIPPx50C6dTRY9MbtBVt7IleIPYf6veKmIP1JclrFv3Px4uu5w7tRxEjRIxVTymsVviR-8HO1OxRuIfq2VSbST57MCBZOLAwnCIkIbO3ZT-DhhWvyFTRPdgvgRqqxa8 Oct 19 03:28:57.794868 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:28:57.794868 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:28:57.794868 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:28:57.794868 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:28:57.794868 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:28:57.794868 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:28:57.794868 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 7a836a10033546ed9a73a4f463587d72 Oct 19 03:28:57.794868 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ServersTestJSON-490256660 Oct 19 03:28:57.794868 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:28:57.794868 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:28:57.796314 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7a836a10033546ed9a73a4f463587d72"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7a836a10033546ed9a73a4f463587d72"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7a836a10033546ed9a73a4f463587d72"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7a836a10033546ed9a73a4f463587d72", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:28:57.796314 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ServersTestJSON-490256660 Oct 19 03:28:57.796314 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 7a836a10033546ed9a73a4f463587d72 Oct 19 03:28:57.796314 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ServersTestJSON-490256660 Oct 19 03:28:57.796314 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ServersTestJSON-490256660-project Oct 19 03:28:57.796314 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:28:57.796314 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:28:57.796314 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: b09d2eecd3d9419189e6308379fa8a09 Oct 19 03:28:57.796314 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ServersTestJSON-490256660-project Oct 19 03:28:57.796314 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:28:57.796314 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance 5c23235b-b905-463f-bb7b-fef2a0381ed8 could not be found. Oct 19 03:28:57.796314 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '5c23235b-b905-463f-bb7b-fef2a0381ed8'} Oct 19 03:28:57.797057 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:28:57.797057 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:28:57.797057 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:28:57.797057 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:28:57.797057 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:28:57.797057 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:28:57.797057 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:28:57.797057 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:28:57.797057 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:28:57.797057 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:28:57.797057 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c23235b-b905-463f-bb7b-fef2a0381ed8 could not be found. Oct 19 03:28:57.797057 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:28:57.797057 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:28:57.797057 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:28:57.797057 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:28:57.797057 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:28:57.797057 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:28:57.797057 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:28:57.797057 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:28:57.797057 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:28:57.798907 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:28:57.798907 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 03:28:57.798907 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 03:28:57.798907 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 03:28:57.798907 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 03:28:57.798907 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:28:57.798907 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:28:57.798907 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:28:57.798907 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:28:57.798907 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c23235b-b905-463f-bb7b-fef2a0381ed8 could not be found. Oct 19 03:28:57.798907 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:28:57.798907 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:28:57.798907 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:28:57.798907 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:28:57.798907 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:28:57.798907 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:28:57.798907 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:28:57.798907 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:28:57.798907 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c23235b-b905-463f-bb7b-fef2a0381ed8 could not be found. Oct 19 03:28:57.798907 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:28:57.800160 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ed29d8ad-e8b3-492b-ba92-2edec8c88c4f tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Returning 404 to user: Instance 5c23235b-b905-463f-bb7b-fef2a0381ed8 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:28:57.800160 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ed29d8ad-e8b3-492b-ba92-2edec8c88c4f tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "DELETE /compute/v2.1/servers/5c23235b-b905-463f-bb7b-fef2a0381ed8" status: 404 len: 111 microversion: 2.1 time: 0.045000 Oct 19 03:28:57.800160 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1851/3791] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:28:57 2022] DELETE /compute/v2.1/servers/5c23235b-b905-463f-bb7b-fef2a0381ed8 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:28:57.805835 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-bca69795-4c04-4bff-9f0a-0efcbbbe433b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:57.806455 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-bca69795-4c04-4bff-9f0a-0efcbbbe433b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 5c23235b-b905-463f-bb7b-fef2a0381ed8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:57.812698 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bca69795-4c04-4bff-9f0a-0efcbbbe433b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:57.813227 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bca69795-4c04-4bff-9f0a-0efcbbbe433b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:57.813757 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bca69795-4c04-4bff-9f0a-0efcbbbe433b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:57.815281 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bca69795-4c04-4bff-9f0a-0efcbbbe433b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:57.815761 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bca69795-4c04-4bff-9f0a-0efcbbbe433b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:57.816199 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bca69795-4c04-4bff-9f0a-0efcbbbe433b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:57.830461 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-bca69795-4c04-4bff-9f0a-0efcbbbe433b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] HTTP exception thrown: Instance 5c23235b-b905-463f-bb7b-fef2a0381ed8 could not be found. Oct 19 03:28:57.832031 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-bca69795-4c04-4bff-9f0a-0efcbbbe433b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Request method failure captured: Oct 19 03:28:57.832031 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/5c23235b-b905-463f-bb7b-fef2a0381ed8 HTTP/1.1 Oct 19 03:28:57.832031 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:28:57.832031 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:28:57.832031 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:28:57.832031 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:28:57.832031 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:28:57.832031 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:28:57.832031 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:28:57.832031 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:28:57.832031 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT236feAW7aGPVoj9kEkUuQkRB8Nm9YBd70D85XbXnYqUAmlwAIPPx50C6dTRY9MbtBVt7IleIPYf6veKmIP1JclrFv3Px4uu5w7tRxEjRIxVTymsVviR-8HO1OxRuIfq2VSbST57MCBZOLAwnCIkIbO3ZT-DhhWvyFTRPdgvgRqqxa8 Oct 19 03:28:57.832031 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:28:57.832031 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:28:57.832031 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:28:57.832031 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:28:57.832031 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:28:57.832031 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:28:57.832031 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 7a836a10033546ed9a73a4f463587d72 Oct 19 03:28:57.832031 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ServersTestJSON-490256660 Oct 19 03:28:57.832031 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:28:57.832031 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:28:57.833740 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7a836a10033546ed9a73a4f463587d72"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7a836a10033546ed9a73a4f463587d72"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7a836a10033546ed9a73a4f463587d72"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7a836a10033546ed9a73a4f463587d72", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:28:57.833740 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ServersTestJSON-490256660 Oct 19 03:28:57.833740 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 7a836a10033546ed9a73a4f463587d72 Oct 19 03:28:57.833740 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ServersTestJSON-490256660 Oct 19 03:28:57.833740 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ServersTestJSON-490256660-project Oct 19 03:28:57.833740 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:28:57.833740 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:28:57.833740 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: b09d2eecd3d9419189e6308379fa8a09 Oct 19 03:28:57.833740 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ServersTestJSON-490256660-project Oct 19 03:28:57.833740 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:28:57.833740 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance 5c23235b-b905-463f-bb7b-fef2a0381ed8 could not be found. Oct 19 03:28:57.833740 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '5c23235b-b905-463f-bb7b-fef2a0381ed8'} Oct 19 03:28:57.834567 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:28:57.834567 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:28:57.834567 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:28:57.834567 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:28:57.834567 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:28:57.834567 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:28:57.834567 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:28:57.834567 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:28:57.834567 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:28:57.834567 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:28:57.834567 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c23235b-b905-463f-bb7b-fef2a0381ed8 could not be found. Oct 19 03:28:57.834567 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:28:57.834567 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:28:57.834567 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:28:57.834567 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:28:57.834567 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:28:57.834567 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:28:57.834567 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:28:57.834567 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:28:57.834567 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:28:57.835872 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:28:57.835872 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:28:57.835872 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:28:57.835872 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:28:57.835872 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:28:57.835872 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:28:57.835872 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:28:57.835872 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c23235b-b905-463f-bb7b-fef2a0381ed8 could not be found. Oct 19 03:28:57.835872 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:28:57.835872 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:28:57.835872 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:28:57.835872 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:28:57.835872 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:28:57.835872 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:28:57.835872 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:28:57.835872 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:28:57.835872 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c23235b-b905-463f-bb7b-fef2a0381ed8 could not be found. Oct 19 03:28:57.835872 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:28:57.836971 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-bca69795-4c04-4bff-9f0a-0efcbbbe433b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Returning 404 to user: Instance 5c23235b-b905-463f-bb7b-fef2a0381ed8 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:28:57.836971 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-bca69795-4c04-4bff-9f0a-0efcbbbe433b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/5c23235b-b905-463f-bb7b-fef2a0381ed8" status: 404 len: 111 microversion: 2.1 time: 0.031876 Oct 19 03:28:57.836971 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1941/3792] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:57 2022] GET /compute/v2.1/servers/5c23235b-b905-463f-bb7b-fef2a0381ed8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:28:57.842615 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-943b31e0-39c9-457f-94b5-bfdb9e3e942f tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:57.843120 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-943b31e0-39c9-457f-94b5-bfdb9e3e942f tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: ae0179a6-3cf0-4943-81b5-c971e8d10000] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:57.849057 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-943b31e0-39c9-457f-94b5-bfdb9e3e942f tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:57.849617 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-943b31e0-39c9-457f-94b5-bfdb9e3e942f tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:57.850060 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-943b31e0-39c9-457f-94b5-bfdb9e3e942f tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:57.850749 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-943b31e0-39c9-457f-94b5-bfdb9e3e942f tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:57.851201 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-943b31e0-39c9-457f-94b5-bfdb9e3e942f tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:57.851652 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-943b31e0-39c9-457f-94b5-bfdb9e3e942f tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:57.866081 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-943b31e0-39c9-457f-94b5-bfdb9e3e942f tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] HTTP exception thrown: Instance ae0179a6-3cf0-4943-81b5-c971e8d10000 could not be found. Oct 19 03:28:57.867638 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-943b31e0-39c9-457f-94b5-bfdb9e3e942f tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Request method failure captured: Oct 19 03:28:57.867638 n-d-861333-8 devstack@n-api.service[121134]: request: DELETE /compute/v2.1/servers/ae0179a6-3cf0-4943-81b5-c971e8d10000 HTTP/1.1 Oct 19 03:28:57.867638 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:28:57.867638 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:28:57.867638 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:28:57.867638 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:28:57.867638 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:28:57.867638 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:28:57.867638 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:28:57.867638 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:28:57.867638 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT236feAW7aGPVoj9kEkUuQkRB8Nm9YBd70D85XbXnYqUAmlwAIPPx50C6dTRY9MbtBVt7IleIPYf6veKmIP1JclrFv3Px4uu5w7tRxEjRIxVTymsVviR-8HO1OxRuIfq2VSbST57MCBZOLAwnCIkIbO3ZT-DhhWvyFTRPdgvgRqqxa8 Oct 19 03:28:57.867638 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:28:57.867638 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:28:57.867638 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:28:57.867638 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:28:57.867638 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:28:57.867638 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:28:57.867638 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 7a836a10033546ed9a73a4f463587d72 Oct 19 03:28:57.867638 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ServersTestJSON-490256660 Oct 19 03:28:57.867638 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:28:57.867638 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:28:57.869959 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7a836a10033546ed9a73a4f463587d72"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7a836a10033546ed9a73a4f463587d72"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7a836a10033546ed9a73a4f463587d72"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7a836a10033546ed9a73a4f463587d72", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:28:57.869959 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ServersTestJSON-490256660 Oct 19 03:28:57.869959 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 7a836a10033546ed9a73a4f463587d72 Oct 19 03:28:57.869959 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ServersTestJSON-490256660 Oct 19 03:28:57.869959 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ServersTestJSON-490256660-project Oct 19 03:28:57.869959 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:28:57.869959 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:28:57.869959 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: b09d2eecd3d9419189e6308379fa8a09 Oct 19 03:28:57.869959 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ServersTestJSON-490256660-project Oct 19 03:28:57.869959 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:28:57.869959 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance ae0179a6-3cf0-4943-81b5-c971e8d10000 could not be found. Oct 19 03:28:57.869959 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': 'ae0179a6-3cf0-4943-81b5-c971e8d10000'} Oct 19 03:28:57.871340 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:28:57.871340 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:28:57.871340 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:28:57.871340 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:28:57.871340 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:28:57.871340 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:28:57.871340 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:28:57.871340 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:28:57.871340 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:28:57.871340 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:28:57.871340 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae0179a6-3cf0-4943-81b5-c971e8d10000 could not be found. Oct 19 03:28:57.871340 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:28:57.871340 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:28:57.871340 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:28:57.871340 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:28:57.871340 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:28:57.871340 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:28:57.871340 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:28:57.871340 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:28:57.871340 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:28:57.873202 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:28:57.873202 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 03:28:57.873202 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 03:28:57.873202 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 03:28:57.873202 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 03:28:57.873202 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:28:57.873202 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:28:57.873202 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:28:57.873202 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:28:57.873202 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae0179a6-3cf0-4943-81b5-c971e8d10000 could not be found. Oct 19 03:28:57.873202 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:28:57.873202 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:28:57.873202 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:28:57.873202 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:28:57.873202 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:28:57.873202 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:28:57.873202 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:28:57.873202 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:28:57.873202 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae0179a6-3cf0-4943-81b5-c971e8d10000 could not be found. Oct 19 03:28:57.873202 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:28:57.874812 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-943b31e0-39c9-457f-94b5-bfdb9e3e942f tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Returning 404 to user: Instance ae0179a6-3cf0-4943-81b5-c971e8d10000 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:28:57.874812 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-943b31e0-39c9-457f-94b5-bfdb9e3e942f tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ae0179a6-3cf0-4943-81b5-c971e8d10000" status: 404 len: 111 microversion: 2.1 time: 0.030509 Oct 19 03:28:57.874812 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1852/3793] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:28:57 2022] DELETE /compute/v2.1/servers/ae0179a6-3cf0-4943-81b5-c971e8d10000 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:28:57.879378 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-25aafbb7-8765-4d1b-9b3a-d2ef60e3548d tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:57.879999 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-25aafbb7-8765-4d1b-9b3a-d2ef60e3548d tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: ae0179a6-3cf0-4943-81b5-c971e8d10000] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:57.886145 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-25aafbb7-8765-4d1b-9b3a-d2ef60e3548d tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:57.886514 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-25aafbb7-8765-4d1b-9b3a-d2ef60e3548d tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:57.886956 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-25aafbb7-8765-4d1b-9b3a-d2ef60e3548d tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:57.887651 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-25aafbb7-8765-4d1b-9b3a-d2ef60e3548d tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:57.888184 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-25aafbb7-8765-4d1b-9b3a-d2ef60e3548d tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:57.888519 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-25aafbb7-8765-4d1b-9b3a-d2ef60e3548d tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:57.903426 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-25aafbb7-8765-4d1b-9b3a-d2ef60e3548d tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] HTTP exception thrown: Instance ae0179a6-3cf0-4943-81b5-c971e8d10000 could not be found. Oct 19 03:28:57.910565 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-25aafbb7-8765-4d1b-9b3a-d2ef60e3548d tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Request method failure captured: Oct 19 03:28:57.910565 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/ae0179a6-3cf0-4943-81b5-c971e8d10000 HTTP/1.1 Oct 19 03:28:57.910565 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:28:57.910565 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:28:57.910565 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:28:57.910565 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:28:57.910565 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:28:57.910565 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:28:57.910565 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:28:57.910565 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:28:57.910565 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT236feAW7aGPVoj9kEkUuQkRB8Nm9YBd70D85XbXnYqUAmlwAIPPx50C6dTRY9MbtBVt7IleIPYf6veKmIP1JclrFv3Px4uu5w7tRxEjRIxVTymsVviR-8HO1OxRuIfq2VSbST57MCBZOLAwnCIkIbO3ZT-DhhWvyFTRPdgvgRqqxa8 Oct 19 03:28:57.910565 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:28:57.910565 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:28:57.910565 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:28:57.910565 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:28:57.910565 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:28:57.910565 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:28:57.910565 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 7a836a10033546ed9a73a4f463587d72 Oct 19 03:28:57.910565 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ServersTestJSON-490256660 Oct 19 03:28:57.910565 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:28:57.910565 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:28:57.911933 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7a836a10033546ed9a73a4f463587d72"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7a836a10033546ed9a73a4f463587d72"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7a836a10033546ed9a73a4f463587d72"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7a836a10033546ed9a73a4f463587d72", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:28:57.911933 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ServersTestJSON-490256660 Oct 19 03:28:57.911933 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 7a836a10033546ed9a73a4f463587d72 Oct 19 03:28:57.911933 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ServersTestJSON-490256660 Oct 19 03:28:57.911933 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ServersTestJSON-490256660-project Oct 19 03:28:57.911933 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:28:57.911933 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:28:57.911933 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: b09d2eecd3d9419189e6308379fa8a09 Oct 19 03:28:57.911933 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ServersTestJSON-490256660-project Oct 19 03:28:57.911933 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:28:57.911933 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance ae0179a6-3cf0-4943-81b5-c971e8d10000 could not be found. Oct 19 03:28:57.911933 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': 'ae0179a6-3cf0-4943-81b5-c971e8d10000'} Oct 19 03:28:57.912711 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:28:57.912711 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:28:57.912711 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:28:57.912711 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:28:57.912711 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:28:57.912711 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:28:57.912711 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:28:57.912711 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:28:57.912711 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:28:57.912711 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:28:57.912711 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae0179a6-3cf0-4943-81b5-c971e8d10000 could not be found. Oct 19 03:28:57.912711 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:28:57.912711 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:28:57.912711 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:28:57.912711 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:28:57.912711 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:28:57.912711 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:28:57.912711 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:28:57.912711 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:28:57.912711 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:28:57.914393 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:28:57.914393 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:28:57.914393 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:28:57.914393 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:28:57.914393 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:28:57.914393 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:28:57.914393 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:28:57.914393 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae0179a6-3cf0-4943-81b5-c971e8d10000 could not be found. Oct 19 03:28:57.914393 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:28:57.914393 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:28:57.914393 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:28:57.914393 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:28:57.914393 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:28:57.914393 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:28:57.914393 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:28:57.914393 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:28:57.914393 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae0179a6-3cf0-4943-81b5-c971e8d10000 could not be found. Oct 19 03:28:57.914393 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:28:57.916565 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-25aafbb7-8765-4d1b-9b3a-d2ef60e3548d tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Returning 404 to user: Instance ae0179a6-3cf0-4943-81b5-c971e8d10000 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:28:57.916565 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-25aafbb7-8765-4d1b-9b3a-d2ef60e3548d tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/ae0179a6-3cf0-4943-81b5-c971e8d10000" status: 404 len: 111 microversion: 2.1 time: 0.031497 Oct 19 03:28:57.916565 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1942/3794] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:57 2022] GET /compute/v2.1/servers/ae0179a6-3cf0-4943-81b5-c971e8d10000 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 03:28:57.918070 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-24a1737f-e35e-49f5-bb3d-eb293a5da756 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:57.918570 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-24a1737f-e35e-49f5-bb3d-eb293a5da756 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 58aea4eb-a319-4bdc-99f2-eed095150ecb] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:57.925461 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-24a1737f-e35e-49f5-bb3d-eb293a5da756 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:57.925919 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-24a1737f-e35e-49f5-bb3d-eb293a5da756 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:57.926338 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-24a1737f-e35e-49f5-bb3d-eb293a5da756 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:57.927484 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-24a1737f-e35e-49f5-bb3d-eb293a5da756 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:57.927484 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-24a1737f-e35e-49f5-bb3d-eb293a5da756 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:57.927923 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-24a1737f-e35e-49f5-bb3d-eb293a5da756 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:57.942937 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-24a1737f-e35e-49f5-bb3d-eb293a5da756 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] HTTP exception thrown: Instance 58aea4eb-a319-4bdc-99f2-eed095150ecb could not be found. Oct 19 03:28:57.944651 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-24a1737f-e35e-49f5-bb3d-eb293a5da756 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Request method failure captured: Oct 19 03:28:57.944651 n-d-861333-8 devstack@n-api.service[121134]: request: DELETE /compute/v2.1/servers/58aea4eb-a319-4bdc-99f2-eed095150ecb HTTP/1.1 Oct 19 03:28:57.944651 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:28:57.944651 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:28:57.944651 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:28:57.944651 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:28:57.944651 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:28:57.944651 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:28:57.944651 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:28:57.944651 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:28:57.944651 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT236feAW7aGPVoj9kEkUuQkRB8Nm9YBd70D85XbXnYqUAmlwAIPPx50C6dTRY9MbtBVt7IleIPYf6veKmIP1JclrFv3Px4uu5w7tRxEjRIxVTymsVviR-8HO1OxRuIfq2VSbST57MCBZOLAwnCIkIbO3ZT-DhhWvyFTRPdgvgRqqxa8 Oct 19 03:28:57.944651 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:28:57.944651 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:28:57.944651 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:28:57.944651 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:28:57.944651 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:28:57.944651 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:28:57.944651 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 7a836a10033546ed9a73a4f463587d72 Oct 19 03:28:57.944651 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ServersTestJSON-490256660 Oct 19 03:28:57.944651 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:28:57.944651 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:28:57.946526 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7a836a10033546ed9a73a4f463587d72"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7a836a10033546ed9a73a4f463587d72"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7a836a10033546ed9a73a4f463587d72"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7a836a10033546ed9a73a4f463587d72", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:28:57.946526 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ServersTestJSON-490256660 Oct 19 03:28:57.946526 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 7a836a10033546ed9a73a4f463587d72 Oct 19 03:28:57.946526 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ServersTestJSON-490256660 Oct 19 03:28:57.946526 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ServersTestJSON-490256660-project Oct 19 03:28:57.946526 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:28:57.946526 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:28:57.946526 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: b09d2eecd3d9419189e6308379fa8a09 Oct 19 03:28:57.946526 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ServersTestJSON-490256660-project Oct 19 03:28:57.946526 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:28:57.946526 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance 58aea4eb-a319-4bdc-99f2-eed095150ecb could not be found. Oct 19 03:28:57.946526 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '58aea4eb-a319-4bdc-99f2-eed095150ecb'} Oct 19 03:28:57.955576 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:28:57.955576 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:28:57.955576 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:28:57.955576 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:28:57.955576 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:28:57.955576 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:28:57.955576 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:28:57.955576 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:28:57.955576 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:28:57.955576 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:28:57.955576 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58aea4eb-a319-4bdc-99f2-eed095150ecb could not be found. Oct 19 03:28:57.955576 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:28:57.955576 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:28:57.955576 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:28:57.955576 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:28:57.955576 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:28:57.955576 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:28:57.955576 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:28:57.955576 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:28:57.955576 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:28:57.957090 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:28:57.957090 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 03:28:57.957090 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 03:28:57.957090 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 03:28:57.957090 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 03:28:57.957090 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:28:57.957090 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:28:57.957090 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:28:57.957090 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:28:57.957090 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58aea4eb-a319-4bdc-99f2-eed095150ecb could not be found. Oct 19 03:28:57.957090 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:28:57.957090 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:28:57.957090 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:28:57.957090 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:28:57.957090 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:28:57.957090 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:28:57.957090 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:28:57.957090 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:28:57.957090 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58aea4eb-a319-4bdc-99f2-eed095150ecb could not be found. Oct 19 03:28:57.957090 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:28:57.958711 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-24a1737f-e35e-49f5-bb3d-eb293a5da756 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Returning 404 to user: Instance 58aea4eb-a319-4bdc-99f2-eed095150ecb could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:28:57.958711 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-24a1737f-e35e-49f5-bb3d-eb293a5da756 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "DELETE /compute/v2.1/servers/58aea4eb-a319-4bdc-99f2-eed095150ecb" status: 404 len: 111 microversion: 2.1 time: 0.034485 Oct 19 03:28:57.958711 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1853/3795] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:28:57 2022] DELETE /compute/v2.1/servers/58aea4eb-a319-4bdc-99f2-eed095150ecb => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 03:28:57.958972 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-430027a5-54c6-45d6-8884-68bf5e3f974c tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:57.958972 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-430027a5-54c6-45d6-8884-68bf5e3f974c tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 58aea4eb-a319-4bdc-99f2-eed095150ecb] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:57.961923 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-430027a5-54c6-45d6-8884-68bf5e3f974c tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:57.962610 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-430027a5-54c6-45d6-8884-68bf5e3f974c tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:57.963231 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-430027a5-54c6-45d6-8884-68bf5e3f974c tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:57.963746 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-430027a5-54c6-45d6-8884-68bf5e3f974c tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:57.964285 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-430027a5-54c6-45d6-8884-68bf5e3f974c tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:57.964662 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-430027a5-54c6-45d6-8884-68bf5e3f974c tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:57.991615 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-430027a5-54c6-45d6-8884-68bf5e3f974c tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] HTTP exception thrown: Instance 58aea4eb-a319-4bdc-99f2-eed095150ecb could not be found. Oct 19 03:28:57.994405 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-430027a5-54c6-45d6-8884-68bf5e3f974c tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Request method failure captured: Oct 19 03:28:57.994405 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/58aea4eb-a319-4bdc-99f2-eed095150ecb HTTP/1.1 Oct 19 03:28:57.994405 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:28:57.994405 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:28:57.994405 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:28:57.994405 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:28:57.994405 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:28:57.994405 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:28:57.994405 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:28:57.994405 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:28:57.994405 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT236feAW7aGPVoj9kEkUuQkRB8Nm9YBd70D85XbXnYqUAmlwAIPPx50C6dTRY9MbtBVt7IleIPYf6veKmIP1JclrFv3Px4uu5w7tRxEjRIxVTymsVviR-8HO1OxRuIfq2VSbST57MCBZOLAwnCIkIbO3ZT-DhhWvyFTRPdgvgRqqxa8 Oct 19 03:28:57.994405 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:28:57.994405 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:28:57.994405 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:28:57.994405 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:28:57.994405 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:28:57.994405 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:28:57.994405 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 7a836a10033546ed9a73a4f463587d72 Oct 19 03:28:57.994405 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ServersTestJSON-490256660 Oct 19 03:28:57.994405 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:28:57.994405 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:28:57.995882 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7a836a10033546ed9a73a4f463587d72"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7a836a10033546ed9a73a4f463587d72"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7a836a10033546ed9a73a4f463587d72"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7a836a10033546ed9a73a4f463587d72", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:28:57.995882 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ServersTestJSON-490256660 Oct 19 03:28:57.995882 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 7a836a10033546ed9a73a4f463587d72 Oct 19 03:28:57.995882 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ServersTestJSON-490256660 Oct 19 03:28:57.995882 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ServersTestJSON-490256660-project Oct 19 03:28:57.995882 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:28:57.995882 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:28:57.995882 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: b09d2eecd3d9419189e6308379fa8a09 Oct 19 03:28:57.995882 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ServersTestJSON-490256660-project Oct 19 03:28:57.995882 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:28:57.995882 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance 58aea4eb-a319-4bdc-99f2-eed095150ecb could not be found. Oct 19 03:28:57.995882 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '58aea4eb-a319-4bdc-99f2-eed095150ecb'} Oct 19 03:28:57.996685 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:28:57.996685 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:28:57.996685 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:28:57.996685 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:28:57.996685 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:28:57.996685 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:28:57.996685 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:28:57.996685 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:28:57.996685 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:28:57.996685 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:28:57.996685 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58aea4eb-a319-4bdc-99f2-eed095150ecb could not be found. Oct 19 03:28:57.996685 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:28:57.996685 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:28:57.996685 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:28:57.996685 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:28:57.996685 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:28:57.996685 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:28:57.996685 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:28:57.996685 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:28:57.996685 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:28:57.998016 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:28:57.998016 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:28:57.998016 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:28:57.998016 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:28:57.998016 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:28:57.998016 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:28:57.998016 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:28:57.998016 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58aea4eb-a319-4bdc-99f2-eed095150ecb could not be found. Oct 19 03:28:57.998016 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:28:57.998016 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:28:57.998016 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:28:57.998016 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:28:57.998016 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:28:57.998016 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:28:57.998016 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:28:57.998016 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:28:57.998016 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58aea4eb-a319-4bdc-99f2-eed095150ecb could not be found. Oct 19 03:28:57.998016 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:28:58.001686 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-430027a5-54c6-45d6-8884-68bf5e3f974c tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Returning 404 to user: Instance 58aea4eb-a319-4bdc-99f2-eed095150ecb could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:28:58.002872 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-430027a5-54c6-45d6-8884-68bf5e3f974c tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/58aea4eb-a319-4bdc-99f2-eed095150ecb" status: 404 len: 111 microversion: 2.1 time: 0.051774 Oct 19 03:28:58.007095 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1943/3796] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:57 2022] GET /compute/v2.1/servers/58aea4eb-a319-4bdc-99f2-eed095150ecb => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 03:28:58.014727 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-76516be3-5ddd-4d52-a969-f5c653c8da0b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:58.015248 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-76516be3-5ddd-4d52-a969-f5c653c8da0b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: f71d8b11-c58e-493d-a03c-90d042f22218] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:58.030023 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-76516be3-5ddd-4d52-a969-f5c653c8da0b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:58.030023 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-76516be3-5ddd-4d52-a969-f5c653c8da0b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:58.030023 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-76516be3-5ddd-4d52-a969-f5c653c8da0b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:58.030023 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-76516be3-5ddd-4d52-a969-f5c653c8da0b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:58.030401 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-76516be3-5ddd-4d52-a969-f5c653c8da0b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:58.030401 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-76516be3-5ddd-4d52-a969-f5c653c8da0b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:58.044468 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-76516be3-5ddd-4d52-a969-f5c653c8da0b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] HTTP exception thrown: Instance f71d8b11-c58e-493d-a03c-90d042f22218 could not be found. Oct 19 03:28:58.046527 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-76516be3-5ddd-4d52-a969-f5c653c8da0b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Request method failure captured: Oct 19 03:28:58.046527 n-d-861333-8 devstack@n-api.service[121134]: request: DELETE /compute/v2.1/servers/f71d8b11-c58e-493d-a03c-90d042f22218 HTTP/1.1 Oct 19 03:28:58.046527 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:28:58.046527 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:28:58.046527 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:28:58.046527 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:28:58.046527 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:28:58.046527 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:28:58.046527 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:28:58.046527 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:28:58.046527 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT236feAW7aGPVoj9kEkUuQkRB8Nm9YBd70D85XbXnYqUAmlwAIPPx50C6dTRY9MbtBVt7IleIPYf6veKmIP1JclrFv3Px4uu5w7tRxEjRIxVTymsVviR-8HO1OxRuIfq2VSbST57MCBZOLAwnCIkIbO3ZT-DhhWvyFTRPdgvgRqqxa8 Oct 19 03:28:58.046527 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:28:58.046527 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:28:58.046527 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:28:58.046527 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:28:58.046527 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:28:58.046527 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:28:58.046527 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 7a836a10033546ed9a73a4f463587d72 Oct 19 03:28:58.046527 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ServersTestJSON-490256660 Oct 19 03:28:58.046527 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:28:58.046527 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:28:58.047917 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7a836a10033546ed9a73a4f463587d72"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7a836a10033546ed9a73a4f463587d72"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7a836a10033546ed9a73a4f463587d72"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7a836a10033546ed9a73a4f463587d72", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:28:58.047917 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ServersTestJSON-490256660 Oct 19 03:28:58.047917 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 7a836a10033546ed9a73a4f463587d72 Oct 19 03:28:58.047917 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ServersTestJSON-490256660 Oct 19 03:28:58.047917 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ServersTestJSON-490256660-project Oct 19 03:28:58.047917 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:28:58.047917 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:28:58.047917 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: b09d2eecd3d9419189e6308379fa8a09 Oct 19 03:28:58.047917 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ServersTestJSON-490256660-project Oct 19 03:28:58.047917 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:28:58.047917 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance f71d8b11-c58e-493d-a03c-90d042f22218 could not be found. Oct 19 03:28:58.047917 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': 'f71d8b11-c58e-493d-a03c-90d042f22218'} Oct 19 03:28:58.049990 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:28:58.049990 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:28:58.049990 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:28:58.049990 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:28:58.049990 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:28:58.049990 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:28:58.049990 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:28:58.049990 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:28:58.049990 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:28:58.049990 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:28:58.049990 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f71d8b11-c58e-493d-a03c-90d042f22218 could not be found. Oct 19 03:28:58.049990 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:28:58.049990 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:28:58.049990 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:28:58.049990 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:28:58.049990 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:28:58.049990 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:28:58.049990 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:28:58.049990 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:28:58.049990 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:28:58.051603 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:28:58.051603 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 03:28:58.051603 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 03:28:58.051603 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 03:28:58.051603 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 03:28:58.051603 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:28:58.051603 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:28:58.051603 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:28:58.051603 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:28:58.051603 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f71d8b11-c58e-493d-a03c-90d042f22218 could not be found. Oct 19 03:28:58.051603 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:28:58.051603 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:28:58.051603 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:28:58.051603 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:28:58.051603 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:28:58.051603 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:28:58.051603 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:28:58.051603 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:28:58.051603 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f71d8b11-c58e-493d-a03c-90d042f22218 could not be found. Oct 19 03:28:58.051603 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:28:58.053481 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-76516be3-5ddd-4d52-a969-f5c653c8da0b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Returning 404 to user: Instance f71d8b11-c58e-493d-a03c-90d042f22218 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:28:58.053481 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-76516be3-5ddd-4d52-a969-f5c653c8da0b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "DELETE /compute/v2.1/servers/f71d8b11-c58e-493d-a03c-90d042f22218" status: 404 len: 111 microversion: 2.1 time: 0.039088 Oct 19 03:28:58.053481 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1854/3797] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:28:58 2022] DELETE /compute/v2.1/servers/f71d8b11-c58e-493d-a03c-90d042f22218 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 03:28:58.054909 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-12d62f68-a103-4c61-97bc-ff6d9d7fbc54 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:58.055603 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-12d62f68-a103-4c61-97bc-ff6d9d7fbc54 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: e13547eb-efb0-4153-8dec-a666d4e6349b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:58.060191 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-67924139-fee5-4296-823d-f619968712fe tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:58.060862 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-67924139-fee5-4296-823d-f619968712fe tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: f71d8b11-c58e-493d-a03c-90d042f22218] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:58.062830 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-12d62f68-a103-4c61-97bc-ff6d9d7fbc54 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:58.063345 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-12d62f68-a103-4c61-97bc-ff6d9d7fbc54 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:58.063801 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-12d62f68-a103-4c61-97bc-ff6d9d7fbc54 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:58.065058 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-12d62f68-a103-4c61-97bc-ff6d9d7fbc54 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:58.065616 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-12d62f68-a103-4c61-97bc-ff6d9d7fbc54 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:58.066064 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-12d62f68-a103-4c61-97bc-ff6d9d7fbc54 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:58.068546 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-67924139-fee5-4296-823d-f619968712fe tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:58.069060 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-67924139-fee5-4296-823d-f619968712fe tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:58.076634 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-67924139-fee5-4296-823d-f619968712fe tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:58.076634 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-67924139-fee5-4296-823d-f619968712fe tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:58.076634 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-67924139-fee5-4296-823d-f619968712fe tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:58.076634 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-67924139-fee5-4296-823d-f619968712fe tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:58.094409 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-67924139-fee5-4296-823d-f619968712fe tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] HTTP exception thrown: Instance f71d8b11-c58e-493d-a03c-90d042f22218 could not be found. Oct 19 03:28:58.096861 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-67924139-fee5-4296-823d-f619968712fe tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Request method failure captured: Oct 19 03:28:58.096861 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/f71d8b11-c58e-493d-a03c-90d042f22218 HTTP/1.1 Oct 19 03:28:58.096861 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:28:58.096861 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:28:58.096861 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:28:58.096861 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:28:58.096861 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:28:58.096861 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:28:58.096861 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:28:58.096861 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:28:58.096861 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT236feAW7aGPVoj9kEkUuQkRB8Nm9YBd70D85XbXnYqUAmlwAIPPx50C6dTRY9MbtBVt7IleIPYf6veKmIP1JclrFv3Px4uu5w7tRxEjRIxVTymsVviR-8HO1OxRuIfq2VSbST57MCBZOLAwnCIkIbO3ZT-DhhWvyFTRPdgvgRqqxa8 Oct 19 03:28:58.096861 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:28:58.096861 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:28:58.096861 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:28:58.096861 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:28:58.096861 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:28:58.096861 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:28:58.096861 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 7a836a10033546ed9a73a4f463587d72 Oct 19 03:28:58.096861 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ServersTestJSON-490256660 Oct 19 03:28:58.096861 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:28:58.096861 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:28:58.098401 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7a836a10033546ed9a73a4f463587d72"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7a836a10033546ed9a73a4f463587d72"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7a836a10033546ed9a73a4f463587d72"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7a836a10033546ed9a73a4f463587d72", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:28:58.098401 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ServersTestJSON-490256660 Oct 19 03:28:58.098401 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 7a836a10033546ed9a73a4f463587d72 Oct 19 03:28:58.098401 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ServersTestJSON-490256660 Oct 19 03:28:58.098401 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ServersTestJSON-490256660-project Oct 19 03:28:58.098401 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:28:58.098401 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:28:58.098401 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: b09d2eecd3d9419189e6308379fa8a09 Oct 19 03:28:58.098401 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ServersTestJSON-490256660-project Oct 19 03:28:58.098401 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:28:58.098401 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance f71d8b11-c58e-493d-a03c-90d042f22218 could not be found. Oct 19 03:28:58.098401 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': 'f71d8b11-c58e-493d-a03c-90d042f22218'} Oct 19 03:28:58.099193 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:28:58.099193 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:28:58.099193 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:28:58.099193 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:28:58.099193 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:28:58.099193 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:28:58.099193 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:28:58.099193 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:28:58.099193 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:28:58.099193 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:28:58.099193 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f71d8b11-c58e-493d-a03c-90d042f22218 could not be found. Oct 19 03:28:58.099193 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:28:58.099193 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:28:58.099193 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:28:58.099193 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:28:58.099193 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:28:58.099193 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:28:58.099193 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:28:58.099193 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:28:58.099193 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:28:58.100484 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:28:58.100484 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:28:58.100484 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:28:58.100484 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:28:58.100484 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:28:58.100484 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:28:58.100484 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:28:58.100484 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f71d8b11-c58e-493d-a03c-90d042f22218 could not be found. Oct 19 03:28:58.100484 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:28:58.100484 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:28:58.100484 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:28:58.100484 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:28:58.100484 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:28:58.100484 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:28:58.100484 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:28:58.100484 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:28:58.100484 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f71d8b11-c58e-493d-a03c-90d042f22218 could not be found. Oct 19 03:28:58.100484 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:28:58.103386 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-67924139-fee5-4296-823d-f619968712fe tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Returning 404 to user: Instance f71d8b11-c58e-493d-a03c-90d042f22218 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:28:58.104794 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-67924139-fee5-4296-823d-f619968712fe tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/f71d8b11-c58e-493d-a03c-90d042f22218" status: 404 len: 111 microversion: 2.1 time: 0.049226 Oct 19 03:28:58.106045 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1855/3798] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:58 2022] GET /compute/v2.1/servers/f71d8b11-c58e-493d-a03c-90d042f22218 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:28:58.114745 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-57246964-91ce-4cbd-ad59-f349b6180d7b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:58.115527 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-57246964-91ce-4cbd-ad59-f349b6180d7b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: e0e22e25-87ae-4a48-84b2-d58394a28b62] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:58.122886 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-57246964-91ce-4cbd-ad59-f349b6180d7b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:58.123493 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-57246964-91ce-4cbd-ad59-f349b6180d7b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:58.123862 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-57246964-91ce-4cbd-ad59-f349b6180d7b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:58.124602 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-57246964-91ce-4cbd-ad59-f349b6180d7b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:58.125112 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-57246964-91ce-4cbd-ad59-f349b6180d7b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:58.125690 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-57246964-91ce-4cbd-ad59-f349b6180d7b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:58.137238 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:28:58.142738 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-57246964-91ce-4cbd-ad59-f349b6180d7b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] HTTP exception thrown: Instance e0e22e25-87ae-4a48-84b2-d58394a28b62 could not be found. Oct 19 03:28:58.144639 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-57246964-91ce-4cbd-ad59-f349b6180d7b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Request method failure captured: Oct 19 03:28:58.144639 n-d-861333-8 devstack@n-api.service[121134]: request: DELETE /compute/v2.1/servers/e0e22e25-87ae-4a48-84b2-d58394a28b62 HTTP/1.1 Oct 19 03:28:58.144639 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:28:58.144639 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:28:58.144639 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:28:58.144639 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:28:58.144639 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:28:58.144639 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:28:58.144639 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:28:58.144639 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:28:58.144639 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT236feAW7aGPVoj9kEkUuQkRB8Nm9YBd70D85XbXnYqUAmlwAIPPx50C6dTRY9MbtBVt7IleIPYf6veKmIP1JclrFv3Px4uu5w7tRxEjRIxVTymsVviR-8HO1OxRuIfq2VSbST57MCBZOLAwnCIkIbO3ZT-DhhWvyFTRPdgvgRqqxa8 Oct 19 03:28:58.144639 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:28:58.144639 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:28:58.144639 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:28:58.144639 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:28:58.144639 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:28:58.144639 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:28:58.144639 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 7a836a10033546ed9a73a4f463587d72 Oct 19 03:28:58.144639 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ServersTestJSON-490256660 Oct 19 03:28:58.144639 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:28:58.144639 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:28:58.146207 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7a836a10033546ed9a73a4f463587d72"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7a836a10033546ed9a73a4f463587d72"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7a836a10033546ed9a73a4f463587d72"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7a836a10033546ed9a73a4f463587d72", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:28:58.146207 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ServersTestJSON-490256660 Oct 19 03:28:58.146207 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 7a836a10033546ed9a73a4f463587d72 Oct 19 03:28:58.146207 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ServersTestJSON-490256660 Oct 19 03:28:58.146207 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ServersTestJSON-490256660-project Oct 19 03:28:58.146207 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:28:58.146207 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:28:58.146207 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: b09d2eecd3d9419189e6308379fa8a09 Oct 19 03:28:58.146207 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ServersTestJSON-490256660-project Oct 19 03:28:58.146207 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:28:58.146207 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance e0e22e25-87ae-4a48-84b2-d58394a28b62 could not be found. Oct 19 03:28:58.146207 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': 'e0e22e25-87ae-4a48-84b2-d58394a28b62'} Oct 19 03:28:58.147159 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:28:58.147159 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:28:58.147159 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:28:58.147159 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:28:58.147159 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:28:58.147159 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:28:58.147159 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:28:58.147159 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:28:58.147159 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:28:58.147159 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:28:58.147159 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0e22e25-87ae-4a48-84b2-d58394a28b62 could not be found. Oct 19 03:28:58.147159 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:28:58.147159 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:28:58.147159 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:28:58.147159 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:28:58.147159 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:28:58.147159 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:28:58.147159 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:28:58.147159 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:28:58.147159 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:28:58.148951 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:28:58.148951 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 03:28:58.148951 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 03:28:58.148951 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 03:28:58.148951 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 03:28:58.148951 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:28:58.148951 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:28:58.148951 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:28:58.148951 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:28:58.148951 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0e22e25-87ae-4a48-84b2-d58394a28b62 could not be found. Oct 19 03:28:58.148951 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:28:58.148951 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:28:58.148951 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:28:58.148951 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:28:58.148951 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:28:58.148951 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:28:58.148951 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:28:58.148951 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:28:58.148951 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0e22e25-87ae-4a48-84b2-d58394a28b62 could not be found. Oct 19 03:28:58.148951 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:28:58.155881 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-57246964-91ce-4cbd-ad59-f349b6180d7b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Returning 404 to user: Instance e0e22e25-87ae-4a48-84b2-d58394a28b62 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:28:58.155881 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-57246964-91ce-4cbd-ad59-f349b6180d7b tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "DELETE /compute/v2.1/servers/e0e22e25-87ae-4a48-84b2-d58394a28b62" status: 404 len: 111 microversion: 2.1 time: 0.036466 Oct 19 03:28:58.155881 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1856/3799] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:28:58 2022] DELETE /compute/v2.1/servers/e0e22e25-87ae-4a48-84b2-d58394a28b62 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 03:28:58.155881 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-306ebfdb-ef23-4d02-b05d-0e3a822e2dc6 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:58.156881 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-306ebfdb-ef23-4d02-b05d-0e3a822e2dc6 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: e0e22e25-87ae-4a48-84b2-d58394a28b62] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:58.164041 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-306ebfdb-ef23-4d02-b05d-0e3a822e2dc6 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:58.164695 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-306ebfdb-ef23-4d02-b05d-0e3a822e2dc6 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:58.164855 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=6 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:28:58.165317 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-306ebfdb-ef23-4d02-b05d-0e3a822e2dc6 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:58.166138 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-306ebfdb-ef23-4d02-b05d-0e3a822e2dc6 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:58.166838 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-306ebfdb-ef23-4d02-b05d-0e3a822e2dc6 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:58.167434 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-306ebfdb-ef23-4d02-b05d-0e3a822e2dc6 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:58.186655 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-306ebfdb-ef23-4d02-b05d-0e3a822e2dc6 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] HTTP exception thrown: Instance e0e22e25-87ae-4a48-84b2-d58394a28b62 could not be found. Oct 19 03:28:58.193918 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-306ebfdb-ef23-4d02-b05d-0e3a822e2dc6 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Request method failure captured: Oct 19 03:28:58.193918 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/e0e22e25-87ae-4a48-84b2-d58394a28b62 HTTP/1.1 Oct 19 03:28:58.193918 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:28:58.193918 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:28:58.193918 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:28:58.193918 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:28:58.193918 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:28:58.193918 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:28:58.193918 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:28:58.193918 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:28:58.193918 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT236feAW7aGPVoj9kEkUuQkRB8Nm9YBd70D85XbXnYqUAmlwAIPPx50C6dTRY9MbtBVt7IleIPYf6veKmIP1JclrFv3Px4uu5w7tRxEjRIxVTymsVviR-8HO1OxRuIfq2VSbST57MCBZOLAwnCIkIbO3ZT-DhhWvyFTRPdgvgRqqxa8 Oct 19 03:28:58.193918 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:28:58.193918 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:28:58.193918 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:28:58.193918 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:28:58.193918 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:28:58.193918 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:28:58.193918 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 7a836a10033546ed9a73a4f463587d72 Oct 19 03:28:58.193918 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ServersTestJSON-490256660 Oct 19 03:28:58.193918 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:28:58.193918 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:28:58.195766 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7a836a10033546ed9a73a4f463587d72"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7a836a10033546ed9a73a4f463587d72"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7a836a10033546ed9a73a4f463587d72"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7a836a10033546ed9a73a4f463587d72", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:28:58.195766 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ServersTestJSON-490256660 Oct 19 03:28:58.195766 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 7a836a10033546ed9a73a4f463587d72 Oct 19 03:28:58.195766 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ServersTestJSON-490256660 Oct 19 03:28:58.195766 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ServersTestJSON-490256660-project Oct 19 03:28:58.195766 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:28:58.195766 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:28:58.195766 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: b09d2eecd3d9419189e6308379fa8a09 Oct 19 03:28:58.195766 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ServersTestJSON-490256660-project Oct 19 03:28:58.195766 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:28:58.195766 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance e0e22e25-87ae-4a48-84b2-d58394a28b62 could not be found. Oct 19 03:28:58.195766 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': 'e0e22e25-87ae-4a48-84b2-d58394a28b62'} Oct 19 03:28:58.196553 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:28:58.196553 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:28:58.196553 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:28:58.196553 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:28:58.196553 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:28:58.196553 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:28:58.196553 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:28:58.196553 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:28:58.196553 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:28:58.196553 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:28:58.196553 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0e22e25-87ae-4a48-84b2-d58394a28b62 could not be found. Oct 19 03:28:58.196553 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:28:58.196553 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:28:58.196553 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:28:58.196553 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:28:58.196553 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:28:58.196553 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:28:58.196553 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:28:58.196553 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:28:58.196553 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:28:58.197961 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:28:58.197961 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:28:58.197961 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:28:58.197961 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:28:58.197961 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:28:58.197961 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:28:58.197961 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:28:58.197961 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0e22e25-87ae-4a48-84b2-d58394a28b62 could not be found. Oct 19 03:28:58.197961 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:28:58.197961 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:28:58.197961 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:28:58.197961 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:28:58.197961 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:28:58.197961 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:28:58.197961 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:28:58.197961 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:28:58.197961 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0e22e25-87ae-4a48-84b2-d58394a28b62 could not be found. Oct 19 03:28:58.197961 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:28:58.200561 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-306ebfdb-ef23-4d02-b05d-0e3a822e2dc6 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Returning 404 to user: Instance e0e22e25-87ae-4a48-84b2-d58394a28b62 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:28:58.200561 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-306ebfdb-ef23-4d02-b05d-0e3a822e2dc6 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/e0e22e25-87ae-4a48-84b2-d58394a28b62" status: 404 len: 111 microversion: 2.1 time: 0.039715 Oct 19 03:28:58.200561 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1857/3800] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:58 2022] GET /compute/v2.1/servers/e0e22e25-87ae-4a48-84b2-d58394a28b62 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 03:28:58.207833 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a495e0d6-72bb-4d03-8d50-845d7a287ee7 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:58.208689 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a495e0d6-72bb-4d03-8d50-845d7a287ee7 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 237226a1-b89a-417e-a337-4c9afe08ec87] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:58.216002 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-a495e0d6-72bb-4d03-8d50-845d7a287ee7 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] HTTP exception thrown: Instance 237226a1-b89a-417e-a337-4c9afe08ec87 could not be found. Oct 19 03:28:58.219191 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a495e0d6-72bb-4d03-8d50-845d7a287ee7 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Request method failure captured: Oct 19 03:28:58.219191 n-d-861333-8 devstack@n-api.service[121134]: request: DELETE /compute/v2.1/servers/237226a1-b89a-417e-a337-4c9afe08ec87 HTTP/1.1 Oct 19 03:28:58.219191 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:28:58.219191 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:28:58.219191 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:28:58.219191 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:28:58.219191 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:28:58.219191 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:28:58.219191 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:28:58.219191 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:28:58.219191 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT236feAW7aGPVoj9kEkUuQkRB8Nm9YBd70D85XbXnYqUAmlwAIPPx50C6dTRY9MbtBVt7IleIPYf6veKmIP1JclrFv3Px4uu5w7tRxEjRIxVTymsVviR-8HO1OxRuIfq2VSbST57MCBZOLAwnCIkIbO3ZT-DhhWvyFTRPdgvgRqqxa8 Oct 19 03:28:58.219191 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:28:58.219191 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:28:58.219191 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:28:58.219191 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:28:58.219191 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:28:58.219191 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:28:58.219191 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 7a836a10033546ed9a73a4f463587d72 Oct 19 03:28:58.219191 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ServersTestJSON-490256660 Oct 19 03:28:58.219191 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:28:58.219191 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:28:58.220721 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7a836a10033546ed9a73a4f463587d72"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7a836a10033546ed9a73a4f463587d72"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7a836a10033546ed9a73a4f463587d72"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7a836a10033546ed9a73a4f463587d72", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:28:58.220721 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ServersTestJSON-490256660 Oct 19 03:28:58.220721 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 7a836a10033546ed9a73a4f463587d72 Oct 19 03:28:58.220721 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ServersTestJSON-490256660 Oct 19 03:28:58.220721 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ServersTestJSON-490256660-project Oct 19 03:28:58.220721 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:28:58.220721 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:28:58.220721 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: b09d2eecd3d9419189e6308379fa8a09 Oct 19 03:28:58.220721 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ServersTestJSON-490256660-project Oct 19 03:28:58.220721 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:28:58.220721 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance 237226a1-b89a-417e-a337-4c9afe08ec87 could not be found. Oct 19 03:28:58.220721 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '237226a1-b89a-417e-a337-4c9afe08ec87'} Oct 19 03:28:58.222250 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:28:58.222250 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:28:58.222250 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:28:58.222250 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:28:58.222250 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:28:58.222250 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:28:58.222250 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 19 03:28:58.222250 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 19 03:28:58.222250 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 237226a1-b89a-417e-a337-4c9afe08ec87 could not be found. Oct 19 03:28:58.222250 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:28:58.222250 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:28:58.222250 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:28:58.222250 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:28:58.222250 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:28:58.222250 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:28:58.222250 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:28:58.222250 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:28:58.222250 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:28:58.222250 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:28:58.222250 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 03:28:58.223578 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 03:28:58.223578 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 03:28:58.223578 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 03:28:58.223578 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:28:58.223578 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:28:58.223578 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:28:58.223578 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:28:58.223578 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 237226a1-b89a-417e-a337-4c9afe08ec87 could not be found. Oct 19 03:28:58.223578 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:28:58.223578 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:28:58.223578 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:28:58.223578 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:28:58.223578 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:28:58.223578 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:28:58.223578 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:28:58.223578 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:28:58.223578 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 237226a1-b89a-417e-a337-4c9afe08ec87 could not be found. Oct 19 03:28:58.223578 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:28:58.226346 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a495e0d6-72bb-4d03-8d50-845d7a287ee7 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Returning 404 to user: Instance 237226a1-b89a-417e-a337-4c9afe08ec87 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:28:58.227982 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a495e0d6-72bb-4d03-8d50-845d7a287ee7 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "DELETE /compute/v2.1/servers/237226a1-b89a-417e-a337-4c9afe08ec87" status: 404 len: 111 microversion: 2.1 time: 0.024939 Oct 19 03:28:58.233810 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1858/3801] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:28:58 2022] DELETE /compute/v2.1/servers/237226a1-b89a-417e-a337-4c9afe08ec87 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:28:58.240098 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-03d9d269-a4da-40fa-a56c-f679f1936c2c tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:58.240718 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-03d9d269-a4da-40fa-a56c-f679f1936c2c tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: 237226a1-b89a-417e-a337-4c9afe08ec87] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:58.247673 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-03d9d269-a4da-40fa-a56c-f679f1936c2c tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] HTTP exception thrown: Instance 237226a1-b89a-417e-a337-4c9afe08ec87 could not be found. Oct 19 03:28:58.249202 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-03d9d269-a4da-40fa-a56c-f679f1936c2c tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Request method failure captured: Oct 19 03:28:58.249202 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/237226a1-b89a-417e-a337-4c9afe08ec87 HTTP/1.1 Oct 19 03:28:58.249202 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:28:58.249202 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:28:58.249202 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:28:58.249202 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:28:58.249202 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:28:58.249202 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:28:58.249202 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:28:58.249202 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:28:58.249202 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT236feAW7aGPVoj9kEkUuQkRB8Nm9YBd70D85XbXnYqUAmlwAIPPx50C6dTRY9MbtBVt7IleIPYf6veKmIP1JclrFv3Px4uu5w7tRxEjRIxVTymsVviR-8HO1OxRuIfq2VSbST57MCBZOLAwnCIkIbO3ZT-DhhWvyFTRPdgvgRqqxa8 Oct 19 03:28:58.249202 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:28:58.249202 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:28:58.249202 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:28:58.249202 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:28:58.249202 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:28:58.249202 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:28:58.249202 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 7a836a10033546ed9a73a4f463587d72 Oct 19 03:28:58.249202 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ServersTestJSON-490256660 Oct 19 03:28:58.249202 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:28:58.249202 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:28:58.251082 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7a836a10033546ed9a73a4f463587d72"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7a836a10033546ed9a73a4f463587d72"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7a836a10033546ed9a73a4f463587d72"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7a836a10033546ed9a73a4f463587d72", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:28:58.251082 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ServersTestJSON-490256660 Oct 19 03:28:58.251082 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 7a836a10033546ed9a73a4f463587d72 Oct 19 03:28:58.251082 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ServersTestJSON-490256660 Oct 19 03:28:58.251082 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ServersTestJSON-490256660-project Oct 19 03:28:58.251082 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:28:58.251082 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:28:58.251082 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: b09d2eecd3d9419189e6308379fa8a09 Oct 19 03:28:58.251082 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ServersTestJSON-490256660-project Oct 19 03:28:58.251082 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:28:58.251082 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance 237226a1-b89a-417e-a337-4c9afe08ec87 could not be found. Oct 19 03:28:58.251082 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '237226a1-b89a-417e-a337-4c9afe08ec87'} Oct 19 03:28:58.256331 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:28:58.256331 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:28:58.256331 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:28:58.256331 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:28:58.256331 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:28:58.256331 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:28:58.256331 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 19 03:28:58.256331 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 19 03:28:58.256331 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 237226a1-b89a-417e-a337-4c9afe08ec87 could not be found. Oct 19 03:28:58.256331 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:28:58.256331 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:28:58.256331 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:28:58.256331 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:28:58.256331 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:28:58.256331 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:28:58.256331 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:28:58.256331 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:28:58.256331 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:28:58.256331 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:28:58.256331 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:28:58.257708 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:28:58.257708 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:28:58.257708 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:28:58.257708 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:28:58.257708 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:28:58.257708 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 237226a1-b89a-417e-a337-4c9afe08ec87 could not be found. Oct 19 03:28:58.257708 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:28:58.257708 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:28:58.257708 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:28:58.257708 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:28:58.257708 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:28:58.257708 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:28:58.257708 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:28:58.257708 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:28:58.257708 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 237226a1-b89a-417e-a337-4c9afe08ec87 could not be found. Oct 19 03:28:58.257708 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:28:58.257708 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-03d9d269-a4da-40fa-a56c-f679f1936c2c tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Returning 404 to user: Instance 237226a1-b89a-417e-a337-4c9afe08ec87 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:28:58.259869 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-03d9d269-a4da-40fa-a56c-f679f1936c2c tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/237226a1-b89a-417e-a337-4c9afe08ec87" status: 404 len: 111 microversion: 2.1 time: 0.014559 Oct 19 03:28:58.259869 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1859/3802] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:58 2022] GET /compute/v2.1/servers/237226a1-b89a-417e-a337-4c9afe08ec87 => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:28:58.266323 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-17374716-f0b5-4d21-9bea-b3a66a145318 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:58.268151 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-17374716-f0b5-4d21-9bea-b3a66a145318 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: eb2d22d5-8fc4-4a1a-a2ac-d54318936f21] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:58.279712 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-17374716-f0b5-4d21-9bea-b3a66a145318 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:58.280213 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-17374716-f0b5-4d21-9bea-b3a66a145318 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:58.286925 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-17374716-f0b5-4d21-9bea-b3a66a145318 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:58.286925 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-17374716-f0b5-4d21-9bea-b3a66a145318 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:58.286925 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-17374716-f0b5-4d21-9bea-b3a66a145318 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:58.286925 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-17374716-f0b5-4d21-9bea-b3a66a145318 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:58.317682 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-17374716-f0b5-4d21-9bea-b3a66a145318 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: eb2d22d5-8fc4-4a1a-a2ac-d54318936f21] Going to try to terminate instance {{(pid=121134) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:28:58.340486 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-12d62f68-a103-4c61-97bc-ff6d9d7fbc54 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2b0581ad4e4c9787bef838c81870a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dfe251b1e046a995b8ec302cb2ffa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:28:58.352397 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-12d62f68-a103-4c61-97bc-ff6d9d7fbc54 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "GET /compute/v2.1/servers/e13547eb-efb0-4153-8dec-a666d4e6349b" status: 200 len: 1318 microversion: 2.1 time: 0.306239 Oct 19 03:28:58.354119 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1944/3803] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:58 2022] GET /compute/v2.1/servers/e13547eb-efb0-4153-8dec-a666d4e6349b => generated 1318 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:58.557595 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-1e4943ca-c77e-4bb6-9ccd-d709eddbb4e1 req-aa342bea-f720-496c-a45f-bc5414a15dff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e13547eb-efb0-4153-8dec-a666d4e6349b", "tag": "c2a6f65f-751d-40d2-9e77-e8429e7d45d4"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:28:58.557595 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-1e4943ca-c77e-4bb6-9ccd-d709eddbb4e1 req-aa342bea-f720-496c-a45f-bc5414a15dff service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:58.557595 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-1e4943ca-c77e-4bb6-9ccd-d709eddbb4e1 req-aa342bea-f720-496c-a45f-bc5414a15dff service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:58.557595 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-1e4943ca-c77e-4bb6-9ccd-d709eddbb4e1 req-aa342bea-f720-496c-a45f-bc5414a15dff service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:58.573124 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-1e4943ca-c77e-4bb6-9ccd-d709eddbb4e1 req-aa342bea-f720-496c-a45f-bc5414a15dff service nova] Creating event network-changed:c2a6f65f-751d-40d2-9e77-e8429e7d45d4 for instance e13547eb-efb0-4153-8dec-a666d4e6349b on n-h1-861333-8 Oct 19 03:28:58.578150 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-1e4943ca-c77e-4bb6-9ccd-d709eddbb4e1 req-aa342bea-f720-496c-a45f-bc5414a15dff service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046465 Oct 19 03:28:58.579038 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1945/3804] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:28:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:28:58.633739 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:28:58.848795 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-17374716-f0b5-4d21-9bea-b3a66a145318 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "DELETE /compute/v2.1/servers/eb2d22d5-8fc4-4a1a-a2ac-d54318936f21" status: 204 len: 0 microversion: 2.1 time: 0.592352 Oct 19 03:28:58.849561 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1860/3805] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:28:58 2022] DELETE /compute/v2.1/servers/eb2d22d5-8fc4-4a1a-a2ac-d54318936f21 => generated 0 bytes in 594 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:28:58.858305 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-81a4d0f6-74ac-42d4-9259-f870aa1dde19 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:58.859547 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-81a4d0f6-74ac-42d4-9259-f870aa1dde19 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: eb2d22d5-8fc4-4a1a-a2ac-d54318936f21] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:58.872331 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-81a4d0f6-74ac-42d4-9259-f870aa1dde19 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:58.874495 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-81a4d0f6-74ac-42d4-9259-f870aa1dde19 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:58.875204 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-81a4d0f6-74ac-42d4-9259-f870aa1dde19 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:58.875931 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-81a4d0f6-74ac-42d4-9259-f870aa1dde19 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:58.876423 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-81a4d0f6-74ac-42d4-9259-f870aa1dde19 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:58.876934 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-81a4d0f6-74ac-42d4-9259-f870aa1dde19 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:59.120864 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-81a4d0f6-74ac-42d4-9259-f870aa1dde19 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:28:59.130295 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-81a4d0f6-74ac-42d4-9259-f870aa1dde19 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/eb2d22d5-8fc4-4a1a-a2ac-d54318936f21" status: 200 len: 1481 microversion: 2.1 time: 0.276238 Oct 19 03:28:59.130918 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1946/3806] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:58 2022] GET /compute/v2.1/servers/eb2d22d5-8fc4-4a1a-a2ac-d54318936f21 => generated 1481 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:28:59.379619 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3b67cef0-a1bc-4e80-9235-ba05d9537446 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:28:59.380304 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3b67cef0-a1bc-4e80-9235-ba05d9537446 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: e13547eb-efb0-4153-8dec-a666d4e6349b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:28:59.386202 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3b67cef0-a1bc-4e80-9235-ba05d9537446 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:59.386687 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3b67cef0-a1bc-4e80-9235-ba05d9537446 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:59.387132 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3b67cef0-a1bc-4e80-9235-ba05d9537446 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:59.387823 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3b67cef0-a1bc-4e80-9235-ba05d9537446 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:28:59.388326 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3b67cef0-a1bc-4e80-9235-ba05d9537446 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:28:59.388759 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3b67cef0-a1bc-4e80-9235-ba05d9537446 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:28:59.541445 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-3b67cef0-a1bc-4e80-9235-ba05d9537446 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2b0581ad4e4c9787bef838c81870a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dfe251b1e046a995b8ec302cb2ffa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:28:59.573963 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3b67cef0-a1bc-4e80-9235-ba05d9537446 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "GET /compute/v2.1/servers/e13547eb-efb0-4153-8dec-a666d4e6349b" status: 200 len: 1318 microversion: 2.1 time: 0.183128 Oct 19 03:28:59.573963 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1861/3807] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:28:59 2022] GET /compute/v2.1/servers/e13547eb-efb0-4153-8dec-a666d4e6349b => generated 1318 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:29:00.162589 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ba28711c-d721-4a80-a309-06ff94e27af5 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:29:00.163820 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ba28711c-d721-4a80-a309-06ff94e27af5 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: eb2d22d5-8fc4-4a1a-a2ac-d54318936f21] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:29:00.178132 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ba28711c-d721-4a80-a309-06ff94e27af5 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:00.180954 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ba28711c-d721-4a80-a309-06ff94e27af5 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:00.183094 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ba28711c-d721-4a80-a309-06ff94e27af5 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:00.187433 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ba28711c-d721-4a80-a309-06ff94e27af5 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:00.188339 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ba28711c-d721-4a80-a309-06ff94e27af5 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:00.190324 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ba28711c-d721-4a80-a309-06ff94e27af5 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:00.588569 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2f14eda4-c95b-408a-8973-70c19fe1681b tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:29:00.589971 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2f14eda4-c95b-408a-8973-70c19fe1681b tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: e13547eb-efb0-4153-8dec-a666d4e6349b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:29:00.605243 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2f14eda4-c95b-408a-8973-70c19fe1681b tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:00.606971 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2f14eda4-c95b-408a-8973-70c19fe1681b tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:00.607628 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2f14eda4-c95b-408a-8973-70c19fe1681b tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:00.609683 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2f14eda4-c95b-408a-8973-70c19fe1681b tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:00.610347 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2f14eda4-c95b-408a-8973-70c19fe1681b tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:00.610982 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2f14eda4-c95b-408a-8973-70c19fe1681b tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:00.991948 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ba28711c-d721-4a80-a309-06ff94e27af5 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:01.009774 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ba28711c-d721-4a80-a309-06ff94e27af5 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/eb2d22d5-8fc4-4a1a-a2ac-d54318936f21" status: 200 len: 1481 microversion: 2.1 time: 0.847168 Oct 19 03:29:01.010919 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1947/3808] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:29:00 2022] GET /compute/v2.1/servers/eb2d22d5-8fc4-4a1a-a2ac-d54318936f21 => generated 1481 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:29:01.122253 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-2f14eda4-c95b-408a-8973-70c19fe1681b tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2b0581ad4e4c9787bef838c81870a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dfe251b1e046a995b8ec302cb2ffa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:01.128311 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2f14eda4-c95b-408a-8973-70c19fe1681b tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "GET /compute/v2.1/servers/e13547eb-efb0-4153-8dec-a666d4e6349b" status: 200 len: 1318 microversion: 2.1 time: 0.546067 Oct 19 03:29:01.129475 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1862/3809] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:29:00 2022] GET /compute/v2.1/servers/e13547eb-efb0-4153-8dec-a666d4e6349b => generated 1318 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:29:01.539617 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-622b78fd-ae9a-4b92-8748-6340a26b4f00 req-f6b12d34-ce60-4a57-9d5c-accd7ea32a14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb2d22d5-8fc4-4a1a-a2ac-d54318936f21", "name": "network-vif-deleted", "tag": "e46e34c0-a202-40e2-b74d-93cf2fca0962"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:29:01.552127 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-622b78fd-ae9a-4b92-8748-6340a26b4f00 req-f6b12d34-ce60-4a57-9d5c-accd7ea32a14 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:01.552632 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-622b78fd-ae9a-4b92-8748-6340a26b4f00 req-f6b12d34-ce60-4a57-9d5c-accd7ea32a14 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:01.553069 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-622b78fd-ae9a-4b92-8748-6340a26b4f00 req-f6b12d34-ce60-4a57-9d5c-accd7ea32a14 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:01.565574 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-622b78fd-ae9a-4b92-8748-6340a26b4f00 req-f6b12d34-ce60-4a57-9d5c-accd7ea32a14 service nova] Creating event network-vif-deleted:e46e34c0-a202-40e2-b74d-93cf2fca0962 for instance eb2d22d5-8fc4-4a1a-a2ac-d54318936f21 on n-h1-861333-8 Oct 19 03:29:01.570678 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-622b78fd-ae9a-4b92-8748-6340a26b4f00 req-f6b12d34-ce60-4a57-9d5c-accd7ea32a14 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035064 Oct 19 03:29:01.571286 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1948/3810] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:29:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:29:02.037321 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-62c6d025-1e7a-4851-982d-032c47888379 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:29:02.038081 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-62c6d025-1e7a-4851-982d-032c47888379 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: eb2d22d5-8fc4-4a1a-a2ac-d54318936f21] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:29:02.046752 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-62c6d025-1e7a-4851-982d-032c47888379 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:02.047490 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-62c6d025-1e7a-4851-982d-032c47888379 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:02.048929 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-62c6d025-1e7a-4851-982d-032c47888379 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:02.049944 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-62c6d025-1e7a-4851-982d-032c47888379 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:02.050618 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-62c6d025-1e7a-4851-982d-032c47888379 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:02.051310 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-62c6d025-1e7a-4851-982d-032c47888379 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:02.156963 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f01a837f-9fe4-4edc-a75e-65dccec9dbfc tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:29:02.157965 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f01a837f-9fe4-4edc-a75e-65dccec9dbfc tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: e13547eb-efb0-4153-8dec-a666d4e6349b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:29:02.164657 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f01a837f-9fe4-4edc-a75e-65dccec9dbfc tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:02.165286 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f01a837f-9fe4-4edc-a75e-65dccec9dbfc tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:02.165886 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f01a837f-9fe4-4edc-a75e-65dccec9dbfc tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:02.166700 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f01a837f-9fe4-4edc-a75e-65dccec9dbfc tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:02.167277 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f01a837f-9fe4-4edc-a75e-65dccec9dbfc tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:02.167941 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f01a837f-9fe4-4edc-a75e-65dccec9dbfc tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:02.179254 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-62c6d025-1e7a-4851-982d-032c47888379 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:02.188132 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-62c6d025-1e7a-4851-982d-032c47888379 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/eb2d22d5-8fc4-4a1a-a2ac-d54318936f21" status: 200 len: 1439 microversion: 2.1 time: 0.158277 Oct 19 03:29:02.190090 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1863/3811] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:29:02 2022] GET /compute/v2.1/servers/eb2d22d5-8fc4-4a1a-a2ac-d54318936f21 => generated 1439 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:29:02.330150 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5a73d5f3-621f-4054-81d1-fd87ab634d1f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:29:02.331086 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5a73d5f3-621f-4054-81d1-fd87ab634d1f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:29:02.339192 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5a73d5f3-621f-4054-81d1-fd87ab634d1f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:02.339920 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5a73d5f3-621f-4054-81d1-fd87ab634d1f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:02.340616 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5a73d5f3-621f-4054-81d1-fd87ab634d1f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:02.341537 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5a73d5f3-621f-4054-81d1-fd87ab634d1f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:02.342157 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5a73d5f3-621f-4054-81d1-fd87ab634d1f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:02.342810 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5a73d5f3-621f-4054-81d1-fd87ab634d1f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:02.431285 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f01a837f-9fe4-4edc-a75e-65dccec9dbfc tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2b0581ad4e4c9787bef838c81870a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dfe251b1e046a995b8ec302cb2ffa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:02.441311 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f01a837f-9fe4-4edc-a75e-65dccec9dbfc tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "GET /compute/v2.1/servers/e13547eb-efb0-4153-8dec-a666d4e6349b" status: 200 len: 1318 microversion: 2.1 time: 0.288754 Oct 19 03:29:02.441973 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1949/3812] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:29:02 2022] GET /compute/v2.1/servers/e13547eb-efb0-4153-8dec-a666d4e6349b => generated 1318 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:29:02.657975 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5a73d5f3-621f-4054-81d1-fd87ab634d1f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:02.660765 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5a73d5f3-621f-4054-81d1-fd87ab634d1f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1670 microversion: 2.1 time: 0.334626 Oct 19 03:29:02.661530 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1864/3813] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:29:02 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1670 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:29:02.684654 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-08349f2c-786b-4a43-b105-af92db65ac7f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:29:02.685271 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-08349f2c-786b-4a43-b105-af92db65ac7f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:29:02.694150 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-08349f2c-786b-4a43-b105-af92db65ac7f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:02.694640 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-08349f2c-786b-4a43-b105-af92db65ac7f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:02.695097 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-08349f2c-786b-4a43-b105-af92db65ac7f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:02.695779 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-08349f2c-786b-4a43-b105-af92db65ac7f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:02.696419 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-08349f2c-786b-4a43-b105-af92db65ac7f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:02.697260 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-08349f2c-786b-4a43-b105-af92db65ac7f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:02.973936 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-08349f2c-786b-4a43-b105-af92db65ac7f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:02.994666 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-08349f2c-786b-4a43-b105-af92db65ac7f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1670 microversion: 2.1 time: 0.310756 Oct 19 03:29:02.995586 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1950/3814] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:29:02 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1670 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:29:03.018088 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-639c8c72-17ed-496a-8c4c-60897898bae3 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:29:03.018768 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-639c8c72-17ed-496a-8c4c-60897898bae3 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:29:03.025953 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-639c8c72-17ed-496a-8c4c-60897898bae3 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:03.026483 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-639c8c72-17ed-496a-8c4c-60897898bae3 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:03.026875 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-639c8c72-17ed-496a-8c4c-60897898bae3 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:03.027595 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-639c8c72-17ed-496a-8c4c-60897898bae3 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:03.028056 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-639c8c72-17ed-496a-8c4c-60897898bae3 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:03.028484 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-639c8c72-17ed-496a-8c4c-60897898bae3 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:03.217934 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c9740960-d2a2-4b9b-829f-452397e9bddd tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:29:03.218784 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c9740960-d2a2-4b9b-829f-452397e9bddd tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: eb2d22d5-8fc4-4a1a-a2ac-d54318936f21] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:29:03.225867 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c9740960-d2a2-4b9b-829f-452397e9bddd tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:03.226576 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c9740960-d2a2-4b9b-829f-452397e9bddd tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:03.227880 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c9740960-d2a2-4b9b-829f-452397e9bddd tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:03.228843 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c9740960-d2a2-4b9b-829f-452397e9bddd tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:03.229308 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c9740960-d2a2-4b9b-829f-452397e9bddd tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:03.229959 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c9740960-d2a2-4b9b-829f-452397e9bddd tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:03.249507 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-639c8c72-17ed-496a-8c4c-60897898bae3 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:03.259295 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-639c8c72-17ed-496a-8c4c-60897898bae3 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1670 microversion: 2.1 time: 0.245551 Oct 19 03:29:03.260176 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1865/3815] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:29:03 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1670 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:29:03.291000 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6afcfcb2-1abb-4e96-aab3-9483a28b33c6 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-112993962"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:29:03.293674 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6afcfcb2-1abb-4e96-aab3-9483a28b33c6 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:29:03.300000 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6afcfcb2-1abb-4e96-aab3-9483a28b33c6 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:03.300500 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6afcfcb2-1abb-4e96-aab3-9483a28b33c6 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:03.300939 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6afcfcb2-1abb-4e96-aab3-9483a28b33c6 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:03.301893 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6afcfcb2-1abb-4e96-aab3-9483a28b33c6 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:03.302359 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6afcfcb2-1abb-4e96-aab3-9483a28b33c6 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:03.302782 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6afcfcb2-1abb-4e96-aab3-9483a28b33c6 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:03.323099 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c9740960-d2a2-4b9b-829f-452397e9bddd tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:03.335203 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c9740960-d2a2-4b9b-829f-452397e9bddd tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/eb2d22d5-8fc4-4a1a-a2ac-d54318936f21" status: 200 len: 1439 microversion: 2.1 time: 0.118978 Oct 19 03:29:03.335203 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1951/3816] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:29:03 2022] GET /compute/v2.1/servers/eb2d22d5-8fc4-4a1a-a2ac-d54318936f21 => generated 1439 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:29:03.466361 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-728b237b-ffdd-4561-b474-705b9d0bb2bc tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:29:03.467272 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-728b237b-ffdd-4561-b474-705b9d0bb2bc tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: e13547eb-efb0-4153-8dec-a666d4e6349b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:29:03.474366 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-728b237b-ffdd-4561-b474-705b9d0bb2bc tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:03.474366 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-728b237b-ffdd-4561-b474-705b9d0bb2bc tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:03.475324 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-728b237b-ffdd-4561-b474-705b9d0bb2bc tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:03.476194 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-728b237b-ffdd-4561-b474-705b9d0bb2bc tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:03.477043 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-728b237b-ffdd-4561-b474-705b9d0bb2bc tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:03.477704 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-728b237b-ffdd-4561-b474-705b9d0bb2bc tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:03.695415 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-728b237b-ffdd-4561-b474-705b9d0bb2bc tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2b0581ad4e4c9787bef838c81870a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dfe251b1e046a995b8ec302cb2ffa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:03.704866 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-728b237b-ffdd-4561-b474-705b9d0bb2bc tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "GET /compute/v2.1/servers/e13547eb-efb0-4153-8dec-a666d4e6349b" status: 200 len: 1318 microversion: 2.1 time: 0.242267 Oct 19 03:29:03.706727 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1952/3817] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:29:03 2022] GET /compute/v2.1/servers/e13547eb-efb0-4153-8dec-a666d4e6349b => generated 1318 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:29:03.884943 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6afcfcb2-1abb-4e96-aab3-9483a28b33c6 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "POST /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f/action" status: 202 len: 0 microversion: 2.1 time: 0.601522 Oct 19 03:29:03.889959 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1866/3818] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:29:03 2022] POST /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f/action => generated 0 bytes in 607 msecs (HTTP/1.1 202) 10 headers in 456 bytes (2 switches on core 0) Oct 19 03:29:04.356324 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e908da94-1d28-48fe-a559-017ebc33f121 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:29:04.356864 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e908da94-1d28-48fe-a559-017ebc33f121 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: eb2d22d5-8fc4-4a1a-a2ac-d54318936f21] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:29:04.363589 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e908da94-1d28-48fe-a559-017ebc33f121 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:04.364147 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e908da94-1d28-48fe-a559-017ebc33f121 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:04.364636 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e908da94-1d28-48fe-a559-017ebc33f121 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:04.365425 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e908da94-1d28-48fe-a559-017ebc33f121 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:04.366074 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e908da94-1d28-48fe-a559-017ebc33f121 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:04.366505 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e908da94-1d28-48fe-a559-017ebc33f121 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:04.419238 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e908da94-1d28-48fe-a559-017ebc33f121 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:04.420198 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e908da94-1d28-48fe-a559-017ebc33f121 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:04.420952 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e908da94-1d28-48fe-a559-017ebc33f121 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:04.421663 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-e908da94-1d28-48fe-a559-017ebc33f121 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lazy-loading 'fault' on Instance uuid eb2d22d5-8fc4-4a1a-a2ac-d54318936f21 {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:29:04.425835 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=100 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:29:04.611390 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-e908da94-1d28-48fe-a559-017ebc33f121 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09d2eecd3d9419189e6308379fa8a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a836a10033546ed9a73a4f463587d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:04.621610 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e908da94-1d28-48fe-a559-017ebc33f121 tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/eb2d22d5-8fc4-4a1a-a2ac-d54318936f21" status: 200 len: 1283 microversion: 2.1 time: 0.269147 Oct 19 03:29:04.633597 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1953/3819] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:29:04 2022] GET /compute/v2.1/servers/eb2d22d5-8fc4-4a1a-a2ac-d54318936f21 => generated 1283 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:29:04.732691 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-71609030-14e6-47b1-8e2b-918c46253140 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:29:04.733327 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-71609030-14e6-47b1-8e2b-918c46253140 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: e13547eb-efb0-4153-8dec-a666d4e6349b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:29:04.741042 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-71609030-14e6-47b1-8e2b-918c46253140 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:04.741576 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-71609030-14e6-47b1-8e2b-918c46253140 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:04.742022 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-71609030-14e6-47b1-8e2b-918c46253140 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:04.742734 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-71609030-14e6-47b1-8e2b-918c46253140 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:04.743190 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-71609030-14e6-47b1-8e2b-918c46253140 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:04.743680 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-71609030-14e6-47b1-8e2b-918c46253140 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:04.974708 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-71609030-14e6-47b1-8e2b-918c46253140 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2b0581ad4e4c9787bef838c81870a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dfe251b1e046a995b8ec302cb2ffa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:04.984732 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-71609030-14e6-47b1-8e2b-918c46253140 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "GET /compute/v2.1/servers/e13547eb-efb0-4153-8dec-a666d4e6349b" status: 200 len: 1318 microversion: 2.1 time: 0.259597 Oct 19 03:29:04.985745 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1867/3820] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:29:04 2022] GET /compute/v2.1/servers/e13547eb-efb0-4153-8dec-a666d4e6349b => generated 1318 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:29:05.646771 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-af725e5d-d297-40e2-b71b-827784ddfabc tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:29:05.647397 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-af725e5d-d297-40e2-b71b-827784ddfabc tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] [instance: eb2d22d5-8fc4-4a1a-a2ac-d54318936f21] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:29:05.655743 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-af725e5d-d297-40e2-b71b-827784ddfabc tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:05.656191 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-af725e5d-d297-40e2-b71b-827784ddfabc tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:05.656744 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-af725e5d-d297-40e2-b71b-827784ddfabc tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:05.658147 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-af725e5d-d297-40e2-b71b-827784ddfabc tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:05.658716 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-af725e5d-d297-40e2-b71b-827784ddfabc tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:05.659521 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-af725e5d-d297-40e2-b71b-827784ddfabc tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:05.674328 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-af725e5d-d297-40e2-b71b-827784ddfabc tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] HTTP exception thrown: Instance eb2d22d5-8fc4-4a1a-a2ac-d54318936f21 could not be found. Oct 19 03:29:05.675998 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-af725e5d-d297-40e2-b71b-827784ddfabc tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Request method failure captured: Oct 19 03:29:05.675998 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/eb2d22d5-8fc4-4a1a-a2ac-d54318936f21 HTTP/1.1 Oct 19 03:29:05.675998 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:29:05.675998 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:29:05.675998 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:29:05.675998 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:29:05.675998 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:29:05.675998 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:29:05.675998 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:29:05.675998 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:29:05.675998 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT236feAW7aGPVoj9kEkUuQkRB8Nm9YBd70D85XbXnYqUAmlwAIPPx50C6dTRY9MbtBVt7IleIPYf6veKmIP1JclrFv3Px4uu5w7tRxEjRIxVTymsVviR-8HO1OxRuIfq2VSbST57MCBZOLAwnCIkIbO3ZT-DhhWvyFTRPdgvgRqqxa8 Oct 19 03:29:05.675998 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:29:05.675998 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:29:05.675998 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:29:05.675998 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:29:05.675998 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:29:05.675998 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:29:05.675998 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 7a836a10033546ed9a73a4f463587d72 Oct 19 03:29:05.675998 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ServersTestJSON-490256660 Oct 19 03:29:05.675998 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:29:05.675998 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:29:05.677707 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7a836a10033546ed9a73a4f463587d72"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7a836a10033546ed9a73a4f463587d72"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7a836a10033546ed9a73a4f463587d72"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7a836a10033546ed9a73a4f463587d72", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:29:05.677707 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ServersTestJSON-490256660 Oct 19 03:29:05.677707 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 7a836a10033546ed9a73a4f463587d72 Oct 19 03:29:05.677707 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ServersTestJSON-490256660 Oct 19 03:29:05.677707 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ServersTestJSON-490256660-project Oct 19 03:29:05.677707 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:29:05.677707 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:29:05.677707 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: b09d2eecd3d9419189e6308379fa8a09 Oct 19 03:29:05.677707 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ServersTestJSON-490256660-project Oct 19 03:29:05.677707 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:29:05.677707 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance eb2d22d5-8fc4-4a1a-a2ac-d54318936f21 could not be found. Oct 19 03:29:05.677707 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': 'eb2d22d5-8fc4-4a1a-a2ac-d54318936f21'} Oct 19 03:29:05.678621 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:29:05.678621 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:29:05.678621 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:29:05.678621 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:29:05.678621 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:29:05.678621 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:29:05.678621 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:29:05.678621 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:29:05.678621 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:29:05.678621 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:29:05.678621 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb2d22d5-8fc4-4a1a-a2ac-d54318936f21 could not be found. Oct 19 03:29:05.678621 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:29:05.678621 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:29:05.678621 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:29:05.678621 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:29:05.678621 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:29:05.678621 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:29:05.678621 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:29:05.678621 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:29:05.678621 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:29:05.680035 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:29:05.680035 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:29:05.680035 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:29:05.680035 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:29:05.680035 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:29:05.680035 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:29:05.680035 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:29:05.680035 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb2d22d5-8fc4-4a1a-a2ac-d54318936f21 could not be found. Oct 19 03:29:05.680035 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:29:05.680035 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:29:05.680035 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:29:05.680035 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:29:05.680035 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:29:05.680035 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:29:05.680035 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:29:05.680035 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:29:05.680035 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb2d22d5-8fc4-4a1a-a2ac-d54318936f21 could not be found. Oct 19 03:29:05.680035 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:29:05.681254 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-af725e5d-d297-40e2-b71b-827784ddfabc tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] Returning 404 to user: Instance eb2d22d5-8fc4-4a1a-a2ac-d54318936f21 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:29:05.681254 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-af725e5d-d297-40e2-b71b-827784ddfabc tempest-ServersTestJSON-490256660 tempest-ServersTestJSON-490256660-project] 10.222.0.52 "GET /compute/v2.1/servers/eb2d22d5-8fc4-4a1a-a2ac-d54318936f21" status: 404 len: 111 microversion: 2.1 time: 0.035383 Oct 19 03:29:05.681254 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1954/3821] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:29:05 2022] GET /compute/v2.1/servers/eb2d22d5-8fc4-4a1a-a2ac-d54318936f21 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:29:06.009062 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-671a62b0-7a1d-4a17-8e9f-a1553c5d2ded tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:29:06.011896 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-671a62b0-7a1d-4a17-8e9f-a1553c5d2ded tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: e13547eb-efb0-4153-8dec-a666d4e6349b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:29:06.027526 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-671a62b0-7a1d-4a17-8e9f-a1553c5d2ded tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:06.029192 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-671a62b0-7a1d-4a17-8e9f-a1553c5d2ded tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:06.031490 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-671a62b0-7a1d-4a17-8e9f-a1553c5d2ded tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:06.032926 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-671a62b0-7a1d-4a17-8e9f-a1553c5d2ded tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:06.037033 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-671a62b0-7a1d-4a17-8e9f-a1553c5d2ded tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:06.037695 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-671a62b0-7a1d-4a17-8e9f-a1553c5d2ded tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:06.675242 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-671a62b0-7a1d-4a17-8e9f-a1553c5d2ded tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2b0581ad4e4c9787bef838c81870a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dfe251b1e046a995b8ec302cb2ffa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:06.698222 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-671a62b0-7a1d-4a17-8e9f-a1553c5d2ded tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "GET /compute/v2.1/servers/e13547eb-efb0-4153-8dec-a666d4e6349b" status: 200 len: 1318 microversion: 2.1 time: 0.688781 Oct 19 03:29:06.698867 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1868/3822] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:29:06 2022] GET /compute/v2.1/servers/e13547eb-efb0-4153-8dec-a666d4e6349b => generated 1318 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:29:06.847990 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-a1b0f25e-c1f3-435b-a9fd-8d846b7999e1 req-786952bc-7f09-423a-a4c1-a26f95e3ecf5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e13547eb-efb0-4153-8dec-a666d4e6349b", "name": "network-vif-plugged", "status": "completed", "tag": "c2a6f65f-751d-40d2-9e77-e8429e7d45d4"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:29:06.898671 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-a1b0f25e-c1f3-435b-a9fd-8d846b7999e1 req-786952bc-7f09-423a-a4c1-a26f95e3ecf5 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:06.904742 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-a1b0f25e-c1f3-435b-a9fd-8d846b7999e1 req-786952bc-7f09-423a-a4c1-a26f95e3ecf5 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:06.905211 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-a1b0f25e-c1f3-435b-a9fd-8d846b7999e1 req-786952bc-7f09-423a-a4c1-a26f95e3ecf5 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:06.928440 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-a1b0f25e-c1f3-435b-a9fd-8d846b7999e1 req-786952bc-7f09-423a-a4c1-a26f95e3ecf5 service nova] Creating event network-vif-plugged:c2a6f65f-751d-40d2-9e77-e8429e7d45d4 for instance e13547eb-efb0-4153-8dec-a666d4e6349b on n-h1-861333-8 Oct 19 03:29:06.978893 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-a1b0f25e-c1f3-435b-a9fd-8d846b7999e1 req-786952bc-7f09-423a-a4c1-a26f95e3ecf5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136332 Oct 19 03:29:06.982276 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1955/3823] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:29:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:29:07.732597 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5b15a889-8d16-4c9e-9543-bd7c488f6028 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:29:07.732597 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5b15a889-8d16-4c9e-9543-bd7c488f6028 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: e13547eb-efb0-4153-8dec-a666d4e6349b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:29:07.752728 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5b15a889-8d16-4c9e-9543-bd7c488f6028 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:07.756731 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5b15a889-8d16-4c9e-9543-bd7c488f6028 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:07.757263 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5b15a889-8d16-4c9e-9543-bd7c488f6028 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:07.760329 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5b15a889-8d16-4c9e-9543-bd7c488f6028 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:07.760831 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5b15a889-8d16-4c9e-9543-bd7c488f6028 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:07.763223 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5b15a889-8d16-4c9e-9543-bd7c488f6028 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:08.706491 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5b15a889-8d16-4c9e-9543-bd7c488f6028 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2b0581ad4e4c9787bef838c81870a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dfe251b1e046a995b8ec302cb2ffa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:08.716875 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5b15a889-8d16-4c9e-9543-bd7c488f6028 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "GET /compute/v2.1/servers/e13547eb-efb0-4153-8dec-a666d4e6349b" status: 200 len: 1318 microversion: 2.1 time: 0.999078 Oct 19 03:29:08.717715 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1869/3824] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:29:07 2022] GET /compute/v2.1/servers/e13547eb-efb0-4153-8dec-a666d4e6349b => generated 1318 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:29:09.742056 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4e2f31f9-3b67-4b79-b440-f6d71c3c954f tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:29:09.742796 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4e2f31f9-3b67-4b79-b440-f6d71c3c954f tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: e13547eb-efb0-4153-8dec-a666d4e6349b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:29:09.759665 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4e2f31f9-3b67-4b79-b440-f6d71c3c954f tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:09.760725 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4e2f31f9-3b67-4b79-b440-f6d71c3c954f tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:09.762522 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4e2f31f9-3b67-4b79-b440-f6d71c3c954f tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:09.765139 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4e2f31f9-3b67-4b79-b440-f6d71c3c954f tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:09.765841 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4e2f31f9-3b67-4b79-b440-f6d71c3c954f tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:09.767631 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4e2f31f9-3b67-4b79-b440-f6d71c3c954f tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:09.822884 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4c9131b0-4707-41b0-b8f3-c589c970e12f tempest-FloatingIPDetailsNegativeTestJSON-9080675 tempest-FloatingIPDetailsNegativeTestJSON-9080675-project] Calling method '.version_select at 0x7fc12bf22dc0>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:29:10.542705 n-d-861333-8 devstack@n-api.service[121135]: DEBUG neutronclient.v2_0.client [None req-4c9131b0-4707-41b0-b8f3-c589c970e12f tempest-FloatingIPDetailsNegativeTestJSON-9080675 tempest-FloatingIPDetailsNegativeTestJSON-9080675-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 81c88b80-d6cf-422d-960a-440211698873 could not be found", "detail": ""}} {{(pid=121135) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 19 03:29:10.544666 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-4c9131b0-4707-41b0-b8f3-c589c970e12f tempest-FloatingIPDetailsNegativeTestJSON-9080675 tempest-FloatingIPDetailsNegativeTestJSON-9080675-project] HTTP exception thrown: Floating IP not found for ID 81c88b80-d6cf-422d-960a-440211698873 Oct 19 03:29:10.548271 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4c9131b0-4707-41b0-b8f3-c589c970e12f tempest-FloatingIPDetailsNegativeTestJSON-9080675 tempest-FloatingIPDetailsNegativeTestJSON-9080675-project] Request method failure captured: Oct 19 03:29:10.548271 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/os-floating-ips/81c88b80-d6cf-422d-960a-440211698873 HTTP/1.1 Oct 19 03:29:10.548271 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:29:10.548271 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:29:10.548271 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:29:10.548271 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:29:10.548271 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:29:10.548271 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:29:10.548271 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:29:10.548271 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:29:10.548271 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT28FUwbWiG5K-JM9HBN8keyjV8s6MnERGU8Y4YF2pvjaUTE7d7fzaeq_oHNlLoktk5QDXMN5JL2oFcQ2FfyZpVhHBzqzuOjwkrfo8m74BkCNEEc6WKfhTNeFmFRhuXegFyPsy7ZXTTjubSLjcG7qHRfLxPG0hMsY4XrhFwSeIuiNJxE Oct 19 03:29:10.548271 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:29:10.548271 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:29:10.548271 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:29:10.548271 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:29:10.548271 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:29:10.548271 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:29:10.548271 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 5ce1a2c66f924ca9b3ca6f95d48f04e1 Oct 19 03:29:10.548271 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-9080675 Oct 19 03:29:10.548271 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:29:10.548271 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:29:10.550260 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5ce1a2c66f924ca9b3ca6f95d48f04e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5ce1a2c66f924ca9b3ca6f95d48f04e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5ce1a2c66f924ca9b3ca6f95d48f04e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5ce1a2c66f924ca9b3ca6f95d48f04e1", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:29:10.550260 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-9080675 Oct 19 03:29:10.550260 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 5ce1a2c66f924ca9b3ca6f95d48f04e1 Oct 19 03:29:10.550260 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-9080675 Oct 19 03:29:10.550260 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-9080675-project Oct 19 03:29:10.550260 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:29:10.550260 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:29:10.550260 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 67b71970d6a24021a834d74886d62d24 Oct 19 03:29:10.550260 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-9080675-project Oct 19 03:29:10.550260 n-d-861333-8 devstack@n-api.service[121135]: method: Oct 19 03:29:10.550260 n-d-861333-8 devstack@n-api.service[121135]: exception: Floating IP not found for ID 81c88b80-d6cf-422d-960a-440211698873 Oct 19 03:29:10.550260 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '81c88b80-d6cf-422d-960a-440211698873'} Oct 19 03:29:10.551301 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:29:10.551301 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:29:10.551301 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 19 03:29:10.551301 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 19 03:29:10.551301 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:29:10.551301 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:29:10.551301 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 19 03:29:10.551301 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 19 03:29:10.551301 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:29:10.551301 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:29:10.551301 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 19 03:29:10.551301 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 19 03:29:10.551301 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:29:10.551301 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:29:10.551301 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 19 03:29:10.551301 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 19 03:29:10.551301 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:29:10.551301 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:29:10.551301 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 19 03:29:10.556364 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 19 03:29:10.556364 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:29:10.556364 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:29:10.556364 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 19 03:29:10.556364 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 19 03:29:10.556364 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 19 03:29:10.556364 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 19 03:29:10.556364 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 81c88b80-d6cf-422d-960a-440211698873 could not be found Oct 19 03:29:10.556364 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5809524e-903a-4d11-86ab-04ad736af417'] Oct 19 03:29:10.556364 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:29:10.556364 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:29:10.556364 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:29:10.556364 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:29:10.556364 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 19 03:29:10.556364 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 19 03:29:10.556364 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 19 03:29:10.556364 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 19 03:29:10.556364 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 81c88b80-d6cf-422d-960a-440211698873. Oct 19 03:29:10.556364 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:29:10.557966 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:29:10.557966 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:29:10.557966 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:29:10.557966 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:29:10.557966 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:29:10.557966 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:29:10.557966 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:29:10.557966 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 03:29:10.557966 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 03:29:10.557966 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:29:10.557966 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:29:10.557966 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 19 03:29:10.557966 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 19 03:29:10.557966 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 81c88b80-d6cf-422d-960a-440211698873 Oct 19 03:29:10.557966 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:29:10.557966 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:29:10.557966 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:29:10.557966 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:29:10.557966 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:29:10.557966 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:29:10.557966 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:29:10.559637 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:29:10.559637 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 81c88b80-d6cf-422d-960a-440211698873 Oct 19 03:29:10.559637 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:29:10.561797 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4c9131b0-4707-41b0-b8f3-c589c970e12f tempest-FloatingIPDetailsNegativeTestJSON-9080675 tempest-FloatingIPDetailsNegativeTestJSON-9080675-project] Returning 404 to user: Floating IP not found for ID 81c88b80-d6cf-422d-960a-440211698873 {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:29:10.563942 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4c9131b0-4707-41b0-b8f3-c589c970e12f tempest-FloatingIPDetailsNegativeTestJSON-9080675 tempest-FloatingIPDetailsNegativeTestJSON-9080675-project] 10.222.0.52 "GET /compute/v2.1/os-floating-ips/81c88b80-d6cf-422d-960a-440211698873" status: 404 len: 111 microversion: 2.1 time: 0.920446 Oct 19 03:29:10.565114 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1956/3825] 10.222.0.52 () {58 vars in 1260 bytes} [Wed Oct 19 03:29:09 2022] GET /compute/v2.1/os-floating-ips/81c88b80-d6cf-422d-960a-440211698873 => generated 111 bytes in 922 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:29:10.599563 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1d00929c-f08c-481b-9091-33afe1e724db tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-165789676", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "8936f55f-9ffa-46d8-8ece-d8a531cfe6c3"}], "block_device_mapping_v2": [{"uuid": "3e344b3c-b0db-44e3-80a7-ee701e7a32b4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:29:10.938896 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.network.neutron [None req-1d00929c-f08c-481b-9091-33afe1e724db tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] validate_networks() for [('8936f55f-9ffa-46d8-8ece-d8a531cfe6c3', None, None, None, None, None)] {{(pid=121135) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:29:11.448538 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-4e2f31f9-3b67-4b79-b440-f6d71c3c954f tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2b0581ad4e4c9787bef838c81870a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dfe251b1e046a995b8ec302cb2ffa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:11.513015 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4e2f31f9-3b67-4b79-b440-f6d71c3c954f tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "GET /compute/v2.1/servers/e13547eb-efb0-4153-8dec-a666d4e6349b" status: 200 len: 1508 microversion: 2.1 time: 1.761817 Oct 19 03:29:11.539454 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1870/3826] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:29:09 2022] GET /compute/v2.1/servers/e13547eb-efb0-4153-8dec-a666d4e6349b => generated 1508 bytes in 1797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:29:11.569272 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-76d65f51-a535-4c7c-99bd-13b524fe535c tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:29:11.570797 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-76d65f51-a535-4c7c-99bd-13b524fe535c tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: e13547eb-efb0-4153-8dec-a666d4e6349b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:29:11.584917 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-76d65f51-a535-4c7c-99bd-13b524fe535c tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:11.586563 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-76d65f51-a535-4c7c-99bd-13b524fe535c tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:11.588362 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-76d65f51-a535-4c7c-99bd-13b524fe535c tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:11.590178 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-76d65f51-a535-4c7c-99bd-13b524fe535c tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:11.592947 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-76d65f51-a535-4c7c-99bd-13b524fe535c tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:11.595491 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-76d65f51-a535-4c7c-99bd-13b524fe535c tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:11.707094 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:29:12.549059 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-76d65f51-a535-4c7c-99bd-13b524fe535c tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2b0581ad4e4c9787bef838c81870a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dfe251b1e046a995b8ec302cb2ffa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:12.560321 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-76d65f51-a535-4c7c-99bd-13b524fe535c tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "GET /compute/v2.1/servers/e13547eb-efb0-4153-8dec-a666d4e6349b" status: 200 len: 1508 microversion: 2.1 time: 1.002492 Oct 19 03:29:12.566524 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1871/3827] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:29:11 2022] GET /compute/v2.1/servers/e13547eb-efb0-4153-8dec-a666d4e6349b => generated 1508 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:29:12.663386 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-1d00929c-f08c-481b-9091-33afe1e724db tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Flavor limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:29:12.663903 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-1d00929c-f08c-481b-9091-33afe1e724db tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Image limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:29:12.664493 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-1d00929c-f08c-481b-9091-33afe1e724db tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Flavor pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:29:12.665062 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-1d00929c-f08c-481b-9091-33afe1e724db tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Image pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:29:12.665754 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-1d00929c-f08c-481b-9091-33afe1e724db tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:29:12.682573 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1d00929c-f08c-481b-9091-33afe1e724db tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:12.700916 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1d00929c-f08c-481b-9091-33afe1e724db tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:12.702298 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1d00929c-f08c-481b-9091-33afe1e724db tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:12.703267 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1d00929c-f08c-481b-9091-33afe1e724db tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:12.704431 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1d00929c-f08c-481b-9091-33afe1e724db tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:12.705262 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1d00929c-f08c-481b-9091-33afe1e724db tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:12.814780 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-1d00929c-f08c-481b-9091-33afe1e724db tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Getting quotas for project 8019441bff8642cebf21fd1c4e890196. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:29:12.836013 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-1d00929c-f08c-481b-9091-33afe1e724db tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Getting quotas for user 2b5b2cb1272541dfbc2659cf4adf9026 and project 8019441bff8642cebf21fd1c4e890196. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:29:13.066011 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1d00929c-f08c-481b-9091-33afe1e724db tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Going to run 1 instances... {{(pid=121135) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:29:13.070880 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1d00929c-f08c-481b-9091-33afe1e724db tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 89f5f23f-8580-46fa-accf-206b1141c301] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3e344b3c-b0db-44e3-80a7-ee701e7a32b4',volume_size=None,volume_type=None)] {{(pid=121135) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:29:13.245491 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4f1ee803-0de4-46f5-8e28-98f0f14b463d tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:29:13.246380 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4f1ee803-0de4-46f5-8e28-98f0f14b463d tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] [instance: cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:29:13.249467 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:29:13.275189 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4f1ee803-0de4-46f5-8e28-98f0f14b463d tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:13.275674 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4f1ee803-0de4-46f5-8e28-98f0f14b463d tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:13.286648 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4f1ee803-0de4-46f5-8e28-98f0f14b463d tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:13.286648 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4f1ee803-0de4-46f5-8e28-98f0f14b463d tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:13.287977 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4f1ee803-0de4-46f5-8e28-98f0f14b463d tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:13.289020 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4f1ee803-0de4-46f5-8e28-98f0f14b463d tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:13.456688 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4f1ee803-0de4-46f5-8e28-98f0f14b463d tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] [instance: cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95] Going to try to terminate instance {{(pid=121134) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:29:13.974260 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1d00929c-f08c-481b-9091-33afe1e724db tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.388318 Oct 19 03:29:13.979005 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1957/3828] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:29:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 3413 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 03:29:14.017762 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-335d9478-c595-4f08-909d-8ed45de8bcd6 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:29:14.033668 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-335d9478-c595-4f08-909d-8ed45de8bcd6 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: e13547eb-efb0-4153-8dec-a666d4e6349b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:29:14.071534 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-335d9478-c595-4f08-909d-8ed45de8bcd6 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:14.077839 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-335d9478-c595-4f08-909d-8ed45de8bcd6 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:14.083448 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-335d9478-c595-4f08-909d-8ed45de8bcd6 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:14.087792 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-335d9478-c595-4f08-909d-8ed45de8bcd6 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:14.088668 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-335d9478-c595-4f08-909d-8ed45de8bcd6 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:14.089392 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-335d9478-c595-4f08-909d-8ed45de8bcd6 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:14.135365 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4f1ee803-0de4-46f5-8e28-98f0f14b463d tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] 10.222.0.52 "DELETE /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95" status: 204 len: 0 microversion: 2.42 time: 1.565744 Oct 19 03:29:14.137009 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1872/3829] 10.222.0.52 () {60 vars in 1280 bytes} [Wed Oct 19 03:29:12 2022] DELETE /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 => generated 0 bytes in 1569 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 19 03:29:14.146870 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-e42e6176-258f-4af0-a486-9d9d9b7fd6de req-f9962b1c-3bd1-415f-9ff0-cb6fac351330 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58b9ce4c-4a42-40ff-b8ed-b75de752b46f", "name": "network-vif-plugged", "status": "completed", "tag": "ff8c2e3f-1c6f-4ac7-b6b8-751825489845"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:29:14.236086 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-e42e6176-258f-4af0-a486-9d9d9b7fd6de req-f9962b1c-3bd1-415f-9ff0-cb6fac351330 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:14.236669 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-e42e6176-258f-4af0-a486-9d9d9b7fd6de req-f9962b1c-3bd1-415f-9ff0-cb6fac351330 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:14.237163 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-e42e6176-258f-4af0-a486-9d9d9b7fd6de req-f9962b1c-3bd1-415f-9ff0-cb6fac351330 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:14.298191 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-e42e6176-258f-4af0-a486-9d9d9b7fd6de req-f9962b1c-3bd1-415f-9ff0-cb6fac351330 service nova] Creating event network-vif-plugged:ff8c2e3f-1c6f-4ac7-b6b8-751825489845 for instance 58b9ce4c-4a42-40ff-b8ed-b75de752b46f on n-h2-861333-8 Oct 19 03:29:14.326340 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-e42e6176-258f-4af0-a486-9d9d9b7fd6de req-f9962b1c-3bd1-415f-9ff0-cb6fac351330 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.187050 Oct 19 03:29:14.327000 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1873/3830] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:29:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:29:14.352232 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-335d9478-c595-4f08-909d-8ed45de8bcd6 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "PUT /compute/v2.1/servers/e13547eb-efb0-4153-8dec-a666d4e6349b" status: 200 len: 1080 microversion: 2.1 time: 0.366442 Oct 19 03:29:14.353675 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1958/3831] 10.222.0.52 () {60 vars in 1256 bytes} [Wed Oct 19 03:29:13 2022] PUT /compute/v2.1/servers/e13547eb-efb0-4153-8dec-a666d4e6349b => generated 1080 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:29:14.362341 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5deaf200-7d7d-4b9f-8181-e8482d91d489 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:29:14.370662 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5deaf200-7d7d-4b9f-8181-e8482d91d489 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 89f5f23f-8580-46fa-accf-206b1141c301] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:29:14.377475 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-25ffde22-b86e-4711-bd4d-31dba4d93c0f tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:29:14.378155 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-25ffde22-b86e-4711-bd4d-31dba4d93c0f tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] [instance: cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:29:14.405608 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-25ffde22-b86e-4711-bd4d-31dba4d93c0f tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:14.406362 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-25ffde22-b86e-4711-bd4d-31dba4d93c0f tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:14.407571 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-25ffde22-b86e-4711-bd4d-31dba4d93c0f tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:14.414623 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-25ffde22-b86e-4711-bd4d-31dba4d93c0f tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:14.415349 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-25ffde22-b86e-4711-bd4d-31dba4d93c0f tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:14.415963 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-25ffde22-b86e-4711-bd4d-31dba4d93c0f tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:14.619182 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5deaf200-7d7d-4b9f-8181-e8482d91d489 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:14.714340 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5deaf200-7d7d-4b9f-8181-e8482d91d489 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301" status: 200 len: 1052 microversion: 2.1 time: 0.379281 Oct 19 03:29:14.714938 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1874/3832] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:29:14 2022] GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301 => generated 1052 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:29:14.729152 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-51059d90-2aa7-49ce-9b23-94d70343b7f1 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:29:14.733608 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-51059d90-2aa7-49ce-9b23-94d70343b7f1 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: e13547eb-efb0-4153-8dec-a666d4e6349b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:29:14.764834 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-51059d90-2aa7-49ce-9b23-94d70343b7f1 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:14.765341 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-51059d90-2aa7-49ce-9b23-94d70343b7f1 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:14.765814 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-51059d90-2aa7-49ce-9b23-94d70343b7f1 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:14.767136 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-51059d90-2aa7-49ce-9b23-94d70343b7f1 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:14.782798 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-51059d90-2aa7-49ce-9b23-94d70343b7f1 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:14.783270 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-51059d90-2aa7-49ce-9b23-94d70343b7f1 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:15.159161 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-25ffde22-b86e-4711-bd4d-31dba4d93c0f tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:15.167896 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-25ffde22-b86e-4711-bd4d-31dba4d93c0f tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:15.177773 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-25ffde22-b86e-4711-bd4d-31dba4d93c0f tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:15.179659 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-25ffde22-b86e-4711-bd4d-31dba4d93c0f tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] 10.222.0.52 "GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95" status: 200 len: 2960 microversion: 2.42 time: 0.823854 Oct 19 03:29:15.180408 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1959/3833] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:29:14 2022] GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 => generated 2960 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:29:15.298421 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-51059d90-2aa7-49ce-9b23-94d70343b7f1 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2b0581ad4e4c9787bef838c81870a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dfe251b1e046a995b8ec302cb2ffa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:15.312326 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-51059d90-2aa7-49ce-9b23-94d70343b7f1 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "GET /compute/v2.1/servers/e13547eb-efb0-4153-8dec-a666d4e6349b" status: 200 len: 1506 microversion: 2.1 time: 0.596314 Oct 19 03:29:15.312915 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1875/3834] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:29:14 2022] GET /compute/v2.1/servers/e13547eb-efb0-4153-8dec-a666d4e6349b => generated 1506 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:29:15.339301 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-649ff16d-5049-402d-894c-3775fed960e9 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:29:15.340150 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-649ff16d-5049-402d-894c-3775fed960e9 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: e13547eb-efb0-4153-8dec-a666d4e6349b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:29:15.357826 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-649ff16d-5049-402d-894c-3775fed960e9 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:15.361039 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-649ff16d-5049-402d-894c-3775fed960e9 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:15.365489 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-649ff16d-5049-402d-894c-3775fed960e9 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:15.369892 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-649ff16d-5049-402d-894c-3775fed960e9 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:15.369892 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-649ff16d-5049-402d-894c-3775fed960e9 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:15.369892 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-649ff16d-5049-402d-894c-3775fed960e9 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:15.745026 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-fb9098ca-157b-473e-834e-8341d3e32a5e tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:29:15.748946 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-fb9098ca-157b-473e-834e-8341d3e32a5e tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 89f5f23f-8580-46fa-accf-206b1141c301] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:29:15.776719 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fb9098ca-157b-473e-834e-8341d3e32a5e tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:15.777205 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fb9098ca-157b-473e-834e-8341d3e32a5e tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:15.777683 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fb9098ca-157b-473e-834e-8341d3e32a5e tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:15.803771 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fb9098ca-157b-473e-834e-8341d3e32a5e tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:15.809848 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fb9098ca-157b-473e-834e-8341d3e32a5e tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.031s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:15.812499 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fb9098ca-157b-473e-834e-8341d3e32a5e tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:16.094605 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-649ff16d-5049-402d-894c-3775fed960e9 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2b0581ad4e4c9787bef838c81870a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dfe251b1e046a995b8ec302cb2ffa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:16.094605 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-649ff16d-5049-402d-894c-3775fed960e9 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "GET /compute/v2.1/servers/e13547eb-efb0-4153-8dec-a666d4e6349b" status: 200 len: 1506 microversion: 2.1 time: 0.588887 Oct 19 03:29:16.094605 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1960/3835] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:29:15 2022] GET /compute/v2.1/servers/e13547eb-efb0-4153-8dec-a666d4e6349b => generated 1506 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:29:16.094605 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4398fd02-607d-471b-8958-f2e07def3479 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:29:16.096195 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4398fd02-607d-471b-8958-f2e07def3479 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: e13547eb-efb0-4153-8dec-a666d4e6349b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:29:16.096195 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4398fd02-607d-471b-8958-f2e07def3479 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:16.096195 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4398fd02-607d-471b-8958-f2e07def3479 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:16.096195 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4398fd02-607d-471b-8958-f2e07def3479 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:16.096793 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4398fd02-607d-471b-8958-f2e07def3479 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:16.096793 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4398fd02-607d-471b-8958-f2e07def3479 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:16.096793 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4398fd02-607d-471b-8958-f2e07def3479 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:16.175254 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-fb9098ca-157b-473e-834e-8341d3e32a5e tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:16.196933 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-fb9098ca-157b-473e-834e-8341d3e32a5e tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301" status: 200 len: 1102 microversion: 2.1 time: 0.460610 Oct 19 03:29:16.212922 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1876/3836] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:29:15 2022] GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301 => generated 1102 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:29:16.217610 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-4398fd02-607d-471b-8958-f2e07def3479 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Flavor limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:29:16.218121 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-4398fd02-607d-471b-8958-f2e07def3479 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Image limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:29:16.224190 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-4398fd02-607d-471b-8958-f2e07def3479 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Flavor pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:29:16.224652 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-4398fd02-607d-471b-8958-f2e07def3479 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Image pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:29:16.225084 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-4398fd02-607d-471b-8958-f2e07def3479 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:29:16.234868 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-88c2b5cb-c9fa-4cf6-8b87-769465a064c8 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:29:16.243584 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-88c2b5cb-c9fa-4cf6-8b87-769465a064c8 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] [instance: cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:29:16.293173 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-88c2b5cb-c9fa-4cf6-8b87-769465a064c8 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:16.294993 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-88c2b5cb-c9fa-4cf6-8b87-769465a064c8 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:16.300878 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-88c2b5cb-c9fa-4cf6-8b87-769465a064c8 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:16.314354 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-88c2b5cb-c9fa-4cf6-8b87-769465a064c8 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:16.314354 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-88c2b5cb-c9fa-4cf6-8b87-769465a064c8 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:16.314354 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-88c2b5cb-c9fa-4cf6-8b87-769465a064c8 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:16.721927 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4398fd02-607d-471b-8958-f2e07def3479 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: e13547eb-efb0-4153-8dec-a666d4e6349b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:29:16.741360 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4398fd02-607d-471b-8958-f2e07def3479 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:16.744190 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4398fd02-607d-471b-8958-f2e07def3479 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:16.745073 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4398fd02-607d-471b-8958-f2e07def3479 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:16.746135 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4398fd02-607d-471b-8958-f2e07def3479 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:16.748493 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4398fd02-607d-471b-8958-f2e07def3479 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:16.749243 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4398fd02-607d-471b-8958-f2e07def3479 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:16.824208 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4398fd02-607d-471b-8958-f2e07def3479 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "POST /compute/v2.1/servers/e13547eb-efb0-4153-8dec-a666d4e6349b/action" status: 202 len: 1112 microversion: 2.1 time: 0.862589 Oct 19 03:29:16.826478 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1961/3837] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:29:15 2022] POST /compute/v2.1/servers/e13547eb-efb0-4153-8dec-a666d4e6349b/action => generated 1112 bytes in 867 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Oct 19 03:29:16.848970 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-dd0b8484-4799-42bb-b371-4150f1e89654 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:29:16.850077 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-dd0b8484-4799-42bb-b371-4150f1e89654 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: e13547eb-efb0-4153-8dec-a666d4e6349b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:29:16.865914 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dd0b8484-4799-42bb-b371-4150f1e89654 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:16.866661 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dd0b8484-4799-42bb-b371-4150f1e89654 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:16.878927 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dd0b8484-4799-42bb-b371-4150f1e89654 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:16.880771 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dd0b8484-4799-42bb-b371-4150f1e89654 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:16.881271 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dd0b8484-4799-42bb-b371-4150f1e89654 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:16.885114 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dd0b8484-4799-42bb-b371-4150f1e89654 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:17.512126 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-88c2b5cb-c9fa-4cf6-8b87-769465a064c8 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:17.533211 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-88c2b5cb-c9fa-4cf6-8b87-769465a064c8 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:17.537029 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-88c2b5cb-c9fa-4cf6-8b87-769465a064c8 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:17.538760 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-88c2b5cb-c9fa-4cf6-8b87-769465a064c8 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] 10.222.0.52 "GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95" status: 200 len: 2960 microversion: 2.42 time: 1.324722 Oct 19 03:29:17.557908 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1877/3838] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:29:16 2022] GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 => generated 2960 bytes in 1344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:29:17.578571 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2a6c8f3e-e48b-4607-b5ee-8e5281e47036 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:29:17.582932 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2a6c8f3e-e48b-4607-b5ee-8e5281e47036 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 89f5f23f-8580-46fa-accf-206b1141c301] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:29:17.601235 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2a6c8f3e-e48b-4607-b5ee-8e5281e47036 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:17.602538 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2a6c8f3e-e48b-4607-b5ee-8e5281e47036 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:17.603249 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2a6c8f3e-e48b-4607-b5ee-8e5281e47036 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:17.604515 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2a6c8f3e-e48b-4607-b5ee-8e5281e47036 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:17.605308 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2a6c8f3e-e48b-4607-b5ee-8e5281e47036 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:17.606664 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2a6c8f3e-e48b-4607-b5ee-8e5281e47036 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:17.736346 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-dd0b8484-4799-42bb-b371-4150f1e89654 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2b0581ad4e4c9787bef838c81870a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dfe251b1e046a995b8ec302cb2ffa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:17.752113 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-dd0b8484-4799-42bb-b371-4150f1e89654 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "GET /compute/v2.1/servers/e13547eb-efb0-4153-8dec-a666d4e6349b" status: 200 len: 1517 microversion: 2.1 time: 0.903141 Oct 19 03:29:17.779821 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1962/3839] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:29:16 2022] GET /compute/v2.1/servers/e13547eb-efb0-4153-8dec-a666d4e6349b => generated 1517 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:29:17.832030 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-2a6c8f3e-e48b-4607-b5ee-8e5281e47036 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:17.842933 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2a6c8f3e-e48b-4607-b5ee-8e5281e47036 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301" status: 200 len: 1150 microversion: 2.1 time: 0.283453 Oct 19 03:29:17.879125 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1878/3840] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:29:17 2022] GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301 => generated 1150 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:29:18.581082 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b22a3e7d-0317-46af-9018-9049a75f5636 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:29:18.586413 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b22a3e7d-0317-46af-9018-9049a75f5636 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] [instance: cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:29:18.591117 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:29:18.619774 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b22a3e7d-0317-46af-9018-9049a75f5636 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:18.626191 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b22a3e7d-0317-46af-9018-9049a75f5636 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:18.626812 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b22a3e7d-0317-46af-9018-9049a75f5636 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:18.627685 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b22a3e7d-0317-46af-9018-9049a75f5636 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:18.630699 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b22a3e7d-0317-46af-9018-9049a75f5636 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:18.631285 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b22a3e7d-0317-46af-9018-9049a75f5636 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:18.785130 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3e1715a8-28f8-45ce-aec8-3c6335827151 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:29:18.785811 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3e1715a8-28f8-45ce-aec8-3c6335827151 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: e13547eb-efb0-4153-8dec-a666d4e6349b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:29:18.806873 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3e1715a8-28f8-45ce-aec8-3c6335827151 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:18.808346 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3e1715a8-28f8-45ce-aec8-3c6335827151 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:18.813794 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3e1715a8-28f8-45ce-aec8-3c6335827151 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:18.813794 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3e1715a8-28f8-45ce-aec8-3c6335827151 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:18.813794 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3e1715a8-28f8-45ce-aec8-3c6335827151 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:18.813794 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3e1715a8-28f8-45ce-aec8-3c6335827151 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:19.210845 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b22a3e7d-0317-46af-9018-9049a75f5636 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:19.224027 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b22a3e7d-0317-46af-9018-9049a75f5636 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:19.225509 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b22a3e7d-0317-46af-9018-9049a75f5636 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:19.233260 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b22a3e7d-0317-46af-9018-9049a75f5636 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] 10.222.0.52 "GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95" status: 200 len: 2960 microversion: 2.42 time: 0.655360 Oct 19 03:29:19.233907 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1963/3841] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:29:18 2022] GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 => generated 2960 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:29:19.267105 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a0f851d4-1bbd-4517-8cd5-00812001a2c0 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:29:19.267370 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a0f851d4-1bbd-4517-8cd5-00812001a2c0 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 89f5f23f-8580-46fa-accf-206b1141c301] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:29:19.283724 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a0f851d4-1bbd-4517-8cd5-00812001a2c0 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:19.284517 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a0f851d4-1bbd-4517-8cd5-00812001a2c0 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:19.287647 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a0f851d4-1bbd-4517-8cd5-00812001a2c0 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:19.292829 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a0f851d4-1bbd-4517-8cd5-00812001a2c0 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:19.292829 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a0f851d4-1bbd-4517-8cd5-00812001a2c0 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:19.292829 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a0f851d4-1bbd-4517-8cd5-00812001a2c0 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:19.308757 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-3e1715a8-28f8-45ce-aec8-3c6335827151 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2b0581ad4e4c9787bef838c81870a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dfe251b1e046a995b8ec302cb2ffa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:19.325508 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3e1715a8-28f8-45ce-aec8-3c6335827151 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "GET /compute/v2.1/servers/e13547eb-efb0-4153-8dec-a666d4e6349b" status: 200 len: 1517 microversion: 2.1 time: 0.548176 Oct 19 03:29:19.330789 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1879/3842] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:29:18 2022] GET /compute/v2.1/servers/e13547eb-efb0-4153-8dec-a666d4e6349b => generated 1517 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:29:19.473331 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a0f851d4-1bbd-4517-8cd5-00812001a2c0 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:19.486095 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a0f851d4-1bbd-4517-8cd5-00812001a2c0 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301" status: 200 len: 1168 microversion: 2.1 time: 0.235479 Oct 19 03:29:19.526092 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1964/3843] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:29:19 2022] GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301 => generated 1168 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:29:20.064698 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-82995abc-14ce-4582-9546-9f6eb9cb4137 tempest-SecurityGroupsNegativeTestJSON-1092545231 tempest-SecurityGroupsNegativeTestJSON-1092545231-project] Calling method '.version_select at 0x7fc12bfac160>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:29:20.267713 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ccc8ea58-8e56-404e-998d-2c46ce22479b tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:29:20.268333 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ccc8ea58-8e56-404e-998d-2c46ce22479b tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] [instance: cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:29:20.286230 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ccc8ea58-8e56-404e-998d-2c46ce22479b tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:20.286733 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ccc8ea58-8e56-404e-998d-2c46ce22479b tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:20.294951 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ccc8ea58-8e56-404e-998d-2c46ce22479b tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:20.296059 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ccc8ea58-8e56-404e-998d-2c46ce22479b tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:20.299772 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ccc8ea58-8e56-404e-998d-2c46ce22479b tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:20.301240 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ccc8ea58-8e56-404e-998d-2c46ce22479b tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:20.388483 n-d-861333-8 devstack@n-api.service[121134]: DEBUG neutronclient.v2_0.client [None req-82995abc-14ce-4582-9546-9f6eb9cb4137 tempest-SecurityGroupsNegativeTestJSON-1092545231 tempest-SecurityGroupsNegativeTestJSON-1092545231-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group ead8f093-26d9-4257-b5a0-0dff9c48848c does not exist", "detail": ""}} {{(pid=121134) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 19 03:29:20.389345 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.security_group_api [None req-82995abc-14ce-4582-9546-9f6eb9cb4137 tempest-SecurityGroupsNegativeTestJSON-1092545231 tempest-SecurityGroupsNegativeTestJSON-1092545231-project] Neutron security group ead8f093-26d9-4257-b5a0-0dff9c48848c not found {{(pid=121134) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 19 03:29:20.389943 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-82995abc-14ce-4582-9546-9f6eb9cb4137 tempest-SecurityGroupsNegativeTestJSON-1092545231 tempest-SecurityGroupsNegativeTestJSON-1092545231-project] HTTP exception thrown: Security group ead8f093-26d9-4257-b5a0-0dff9c48848c does not exist Oct 19 03:29:20.389943 n-d-861333-8 devstack@n-api.service[121134]: Neutron server returns request_ids: ['req-6da50b74-900b-4916-886d-cbfbdfc94e4a'] Oct 19 03:29:20.392003 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-82995abc-14ce-4582-9546-9f6eb9cb4137 tempest-SecurityGroupsNegativeTestJSON-1092545231 tempest-SecurityGroupsNegativeTestJSON-1092545231-project] Request method failure captured: Oct 19 03:29:20.392003 n-d-861333-8 devstack@n-api.service[121134]: request: DELETE /compute/v2.1/os-security-groups/ead8f093-26d9-4257-b5a0-0dff9c48848c HTTP/1.1 Oct 19 03:29:20.392003 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:29:20.392003 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:29:20.392003 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:29:20.392003 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:29:20.392003 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:29:20.392003 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:29:20.392003 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:29:20.392003 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:29:20.392003 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT28Pd_9a3pk9gFH7hgeKGNlu7s3NG6TznhrPvoK6RmJ6JqyaebpID_Lj45NscgrdNu2n7nipkdxNeitBunh1dk0hi_jjBha0T8ZS0sA31yx64kstWRvWRhCbT9K6_W8MQCJJNyoicTmPhT63AkmGZH_DfZ0vvwKwLsn-k-oAiliOnLc Oct 19 03:29:20.392003 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:29:20.392003 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:29:20.392003 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:29:20.392003 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:29:20.392003 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:29:20.392003 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:29:20.392003 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 3838e32f217c45cb8230dde2a9f68a00 Oct 19 03:29:20.392003 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1092545231 Oct 19 03:29:20.392003 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:29:20.392003 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:29:20.394005 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/3838e32f217c45cb8230dde2a9f68a00"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3838e32f217c45cb8230dde2a9f68a00"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3838e32f217c45cb8230dde2a9f68a00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_3838e32f217c45cb8230dde2a9f68a00", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:29:20.394005 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1092545231 Oct 19 03:29:20.394005 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 3838e32f217c45cb8230dde2a9f68a00 Oct 19 03:29:20.394005 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1092545231 Oct 19 03:29:20.394005 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-SecurityGroupsNegativeTestJSON-1092545231-project Oct 19 03:29:20.394005 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:29:20.394005 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:29:20.394005 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: b145e7002cda4aef8417115fe03dd58f Oct 19 03:29:20.394005 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1092545231-project Oct 19 03:29:20.394005 n-d-861333-8 devstack@n-api.service[121134]: method: Oct 19 03:29:20.394005 n-d-861333-8 devstack@n-api.service[121134]: exception: Security group ead8f093-26d9-4257-b5a0-0dff9c48848c does not exist Oct 19 03:29:20.394005 n-d-861333-8 devstack@n-api.service[121134]: Neutron server returns request_ids: ['req-6da50b74-900b-4916-886d-cbfbdfc94e4a'] Oct 19 03:29:20.394005 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': 'ead8f093-26d9-4257-b5a0-0dff9c48848c'} Oct 19 03:29:20.395168 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:29:20.395168 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:29:20.395168 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 19 03:29:20.395168 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 19 03:29:20.395168 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:29:20.395168 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:29:20.395168 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 19 03:29:20.395168 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 19 03:29:20.395168 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:29:20.395168 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:29:20.395168 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 19 03:29:20.395168 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 19 03:29:20.395168 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:29:20.395168 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:29:20.395168 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 19 03:29:20.395168 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 19 03:29:20.395168 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:29:20.395168 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:29:20.395168 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 19 03:29:20.396764 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 19 03:29:20.396764 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:29:20.396764 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:29:20.396764 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 19 03:29:20.396764 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 19 03:29:20.396764 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 19 03:29:20.396764 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 19 03:29:20.396764 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group ead8f093-26d9-4257-b5a0-0dff9c48848c does not exist Oct 19 03:29:20.396764 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6da50b74-900b-4916-886d-cbfbdfc94e4a'] Oct 19 03:29:20.396764 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:29:20.396764 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:29:20.396764 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:29:20.396764 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:29:20.396764 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 19 03:29:20.396764 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 19 03:29:20.396764 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 19 03:29:20.396764 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 19 03:29:20.396764 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group ead8f093-26d9-4257-b5a0-0dff9c48848c does not exist Oct 19 03:29:20.398335 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6da50b74-900b-4916-886d-cbfbdfc94e4a'] Oct 19 03:29:20.398335 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:29:20.398335 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:29:20.398335 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:29:20.398335 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:29:20.398335 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:29:20.398335 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:29:20.398335 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:29:20.398335 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:29:20.398335 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 03:29:20.398335 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 03:29:20.398335 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:29:20.398335 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:29:20.398335 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 19 03:29:20.398335 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 19 03:29:20.398335 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group ead8f093-26d9-4257-b5a0-0dff9c48848c does not exist Oct 19 03:29:20.398335 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6da50b74-900b-4916-886d-cbfbdfc94e4a'] Oct 19 03:29:20.398335 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:29:20.398335 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:29:20.398335 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:29:20.398335 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:29:20.400062 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:29:20.400062 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:29:20.400062 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:29:20.400062 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:29:20.400062 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group ead8f093-26d9-4257-b5a0-0dff9c48848c does not exist Oct 19 03:29:20.400062 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6da50b74-900b-4916-886d-cbfbdfc94e4a'] Oct 19 03:29:20.400062 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:29:20.402570 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-82995abc-14ce-4582-9546-9f6eb9cb4137 tempest-SecurityGroupsNegativeTestJSON-1092545231 tempest-SecurityGroupsNegativeTestJSON-1092545231-project] Returning 404 to user: Security group ead8f093-26d9-4257-b5a0-0dff9c48848c does not exist Oct 19 03:29:20.402570 n-d-861333-8 devstack@n-api.service[121134]: Neutron server returns request_ids: ['req-6da50b74-900b-4916-886d-cbfbdfc94e4a'] {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:29:20.403613 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-82995abc-14ce-4582-9546-9f6eb9cb4137 tempest-SecurityGroupsNegativeTestJSON-1092545231 tempest-SecurityGroupsNegativeTestJSON-1092545231-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/ead8f093-26d9-4257-b5a0-0dff9c48848c" status: 404 len: 194 microversion: 2.1 time: 0.779022 Oct 19 03:29:20.404364 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1880/3844] 10.222.0.52 () {58 vars in 1272 bytes} [Wed Oct 19 03:29:19 2022] DELETE /compute/v2.1/os-security-groups/ead8f093-26d9-4257-b5a0-0dff9c48848c => generated 194 bytes in 780 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:29:20.423553 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5ba6915c-31e1-471a-b70b-27e678313cc9 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:29:20.433775 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5ba6915c-31e1-471a-b70b-27e678313cc9 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: e13547eb-efb0-4153-8dec-a666d4e6349b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:29:20.445622 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5ba6915c-31e1-471a-b70b-27e678313cc9 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:20.446453 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5ba6915c-31e1-471a-b70b-27e678313cc9 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:20.447076 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5ba6915c-31e1-471a-b70b-27e678313cc9 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:20.453196 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5ba6915c-31e1-471a-b70b-27e678313cc9 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:20.453989 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5ba6915c-31e1-471a-b70b-27e678313cc9 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:20.454610 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5ba6915c-31e1-471a-b70b-27e678313cc9 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:20.771627 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ccc8ea58-8e56-404e-998d-2c46ce22479b tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:20.783806 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ccc8ea58-8e56-404e-998d-2c46ce22479b tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:20.785272 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ccc8ea58-8e56-404e-998d-2c46ce22479b tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:20.786598 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ccc8ea58-8e56-404e-998d-2c46ce22479b tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] 10.222.0.52 "GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95" status: 200 len: 2960 microversion: 2.42 time: 0.523881 Oct 19 03:29:20.787165 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1965/3845] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:29:20 2022] GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 => generated 2960 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:29:20.819432 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-8966301f-b3f7-4018-8821-167a3e147455 req-82814cfe-4d6b-4ac5-a29d-d0c06a60ff5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95", "name": "network-vif-unplugged", "status": "completed", "tag": "60051f56-f07d-4d7c-b7f8-7fc736fa8bc5"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:29:20.845606 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-8966301f-b3f7-4018-8821-167a3e147455 req-82814cfe-4d6b-4ac5-a29d-d0c06a60ff5d service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:20.847853 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-8966301f-b3f7-4018-8821-167a3e147455 req-82814cfe-4d6b-4ac5-a29d-d0c06a60ff5d service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:20.848304 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-8966301f-b3f7-4018-8821-167a3e147455 req-82814cfe-4d6b-4ac5-a29d-d0c06a60ff5d service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:20.886829 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-8966301f-b3f7-4018-8821-167a3e147455 req-82814cfe-4d6b-4ac5-a29d-d0c06a60ff5d service nova] Creating event network-vif-unplugged:60051f56-f07d-4d7c-b7f8-7fc736fa8bc5 for instance cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 on n-h2-861333-8 Oct 19 03:29:20.902231 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-8966301f-b3f7-4018-8821-167a3e147455 req-82814cfe-4d6b-4ac5-a29d-d0c06a60ff5d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.100146 Oct 19 03:29:20.903187 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1966/3846] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:29:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:29:20.913944 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5ba6915c-31e1-471a-b70b-27e678313cc9 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2b0581ad4e4c9787bef838c81870a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dfe251b1e046a995b8ec302cb2ffa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:20.924020 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5ba6915c-31e1-471a-b70b-27e678313cc9 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "GET /compute/v2.1/servers/e13547eb-efb0-4153-8dec-a666d4e6349b" status: 200 len: 1517 microversion: 2.1 time: 0.512753 Oct 19 03:29:20.924621 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1881/3847] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:29:20 2022] GET /compute/v2.1/servers/e13547eb-efb0-4153-8dec-a666d4e6349b => generated 1517 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:29:20.934984 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-637772d5-decd-4bda-add3-22bfcfaac265 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:29:20.939674 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6ca6708d-b514-4777-98ac-85058b5680b4 tempest-SecurityGroupsNegativeTestJSON-1092545231 tempest-SecurityGroupsNegativeTestJSON-1092545231-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.035601 Oct 19 03:29:20.954690 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1967/3848] 10.222.0.52 () {58 vars in 1164 bytes} [Wed Oct 19 03:29:20 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 19 03:29:20.955811 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-637772d5-decd-4bda-add3-22bfcfaac265 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 89f5f23f-8580-46fa-accf-206b1141c301] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:29:20.963793 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d71c12eb-0d4f-4619-b2c4-878d158e1829 tempest-SecurityGroupsNegativeTestJSON-1092545231 tempest-SecurityGroupsNegativeTestJSON-1092545231-project] Calling method '.version_select at 0x7fc12bf67af0>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:29:20.982442 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-637772d5-decd-4bda-add3-22bfcfaac265 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:20.982956 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-637772d5-decd-4bda-add3-22bfcfaac265 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:20.983404 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-637772d5-decd-4bda-add3-22bfcfaac265 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:20.984135 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-637772d5-decd-4bda-add3-22bfcfaac265 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:20.984666 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-637772d5-decd-4bda-add3-22bfcfaac265 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:20.989339 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-637772d5-decd-4bda-add3-22bfcfaac265 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:21.213740 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-637772d5-decd-4bda-add3-22bfcfaac265 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:21.223851 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-637772d5-decd-4bda-add3-22bfcfaac265 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301" status: 200 len: 1168 microversion: 2.1 time: 0.298185 Oct 19 03:29:21.244306 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1882/3849] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:29:20 2022] GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301 => generated 1168 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:29:21.741618 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d71c12eb-0d4f-4619-b2c4-878d158e1829 tempest-SecurityGroupsNegativeTestJSON-1092545231 tempest-SecurityGroupsNegativeTestJSON-1092545231-project] 10.222.0.52 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.781660 Oct 19 03:29:21.754626 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1968/3850] 10.222.0.52 () {58 vars in 1158 bytes} [Wed Oct 19 03:29:20 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:29:21.761777 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2fe84771-3c64-41e6-b6bc-6789ac5dc48b tempest-SecurityGroupsNegativeTestJSON-1092545231 tempest-SecurityGroupsNegativeTestJSON-1092545231-project] Calling method '.version_select at 0x7fc12bf829d0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:29:21.768516 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d71c12eb-0d4f-4619-b2c4-878d158e1829 tempest-SecurityGroupsNegativeTestJSON-1092545231 tempest-SecurityGroupsNegativeTestJSON-1092545231-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:29:21.769856 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d71c12eb-0d4f-4619-b2c4-878d158e1829 tempest-SecurityGroupsNegativeTestJSON-1092545231 tempest-SecurityGroupsNegativeTestJSON-1092545231-project] 10.222.0.52 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001674 Oct 19 03:29:21.770665 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1969/3851] 10.222.0.52 () {56 vars in 886 bytes} [Wed Oct 19 03:29:21 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (2 switches on core 0) Oct 19 03:29:21.779670 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d71c12eb-0d4f-4619-b2c4-878d158e1829 tempest-SecurityGroupsNegativeTestJSON-1092545231 tempest-SecurityGroupsNegativeTestJSON-1092545231-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:29:21.781690 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d71c12eb-0d4f-4619-b2c4-878d158e1829 tempest-SecurityGroupsNegativeTestJSON-1092545231 tempest-SecurityGroupsNegativeTestJSON-1092545231-project] 10.222.0.52 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.002303 Oct 19 03:29:21.788876 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1970/3852] 10.222.0.52 () {54 vars in 1035 bytes} [Wed Oct 19 03:29:21 2022] GET /compute/v2/ => generated 379 bytes in 10 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Oct 19 03:29:21.791080 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d71c12eb-0d4f-4619-b2c4-878d158e1829 tempest-SecurityGroupsNegativeTestJSON-1092545231 tempest-SecurityGroupsNegativeTestJSON-1092545231-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:29:21.793016 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d71c12eb-0d4f-4619-b2c4-878d158e1829 tempest-SecurityGroupsNegativeTestJSON-1092545231 tempest-SecurityGroupsNegativeTestJSON-1092545231-project] 10.222.0.52 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002226 Oct 19 03:29:21.803638 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1971/3853] 10.222.0.52 () {54 vars in 1041 bytes} [Wed Oct 19 03:29:21 2022] GET /compute/v2.1/ => generated 388 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:29:21.804475 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d71c12eb-0d4f-4619-b2c4-878d158e1829 tempest-SecurityGroupsNegativeTestJSON-1092545231 tempest-SecurityGroupsNegativeTestJSON-1092545231-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:29:21.805735 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d71c12eb-0d4f-4619-b2c4-878d158e1829 tempest-SecurityGroupsNegativeTestJSON-1092545231 tempest-SecurityGroupsNegativeTestJSON-1092545231-project] 10.222.0.52 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001514 Oct 19 03:29:21.806292 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1972/3854] 10.222.0.52 () {56 vars in 886 bytes} [Wed Oct 19 03:29:21 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 19 03:29:21.828007 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d879ee2c-4009-4f3a-92cb-650acace4ffd tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:29:21.830328 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d879ee2c-4009-4f3a-92cb-650acace4ffd tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] [instance: cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:29:21.852393 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d879ee2c-4009-4f3a-92cb-650acace4ffd tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:21.865643 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d879ee2c-4009-4f3a-92cb-650acace4ffd tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:21.866627 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d879ee2c-4009-4f3a-92cb-650acace4ffd tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:21.873205 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d879ee2c-4009-4f3a-92cb-650acace4ffd tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:21.873205 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d879ee2c-4009-4f3a-92cb-650acace4ffd tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:21.875021 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d879ee2c-4009-4f3a-92cb-650acace4ffd tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:22.631647 n-d-861333-8 devstack@n-api.service[121134]: DEBUG neutronclient.v2_0.client [None req-2fe84771-3c64-41e6-b6bc-6789ac5dc48b tempest-SecurityGroupsNegativeTestJSON-1092545231 tempest-SecurityGroupsNegativeTestJSON-1092545231-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=121134) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 19 03:29:22.632363 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-2fe84771-3c64-41e6-b6bc-6789ac5dc48b tempest-SecurityGroupsNegativeTestJSON-1092545231 tempest-SecurityGroupsNegativeTestJSON-1092545231-project] HTTP exception thrown: Insufficient rights for removing default security group. Oct 19 03:29:22.632363 n-d-861333-8 devstack@n-api.service[121134]: Neutron server returns request_ids: ['req-9b67a400-9b8c-40e1-9ea6-44cfc45312ea'] Oct 19 03:29:22.635723 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2fe84771-3c64-41e6-b6bc-6789ac5dc48b tempest-SecurityGroupsNegativeTestJSON-1092545231 tempest-SecurityGroupsNegativeTestJSON-1092545231-project] Request method failure captured: Oct 19 03:29:22.635723 n-d-861333-8 devstack@n-api.service[121134]: request: DELETE /compute/v2.1/os-security-groups/8a208feb-926a-4216-bce9-4c81ff244ce5 HTTP/1.1 Oct 19 03:29:22.635723 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:29:22.635723 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:29:22.635723 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:29:22.635723 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:29:22.635723 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:29:22.635723 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:29:22.635723 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:29:22.635723 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:29:22.635723 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT28Pd_9a3pk9gFH7hgeKGNlu7s3NG6TznhrPvoK6RmJ6JqyaebpID_Lj45NscgrdNu2n7nipkdxNeitBunh1dk0hi_jjBha0T8ZS0sA31yx64kstWRvWRhCbT9K6_W8MQCJJNyoicTmPhT63AkmGZH_DfZ0vvwKwLsn-k-oAiliOnLc Oct 19 03:29:22.635723 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:29:22.635723 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:29:22.635723 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:29:22.635723 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:29:22.635723 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:29:22.635723 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:29:22.635723 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 3838e32f217c45cb8230dde2a9f68a00 Oct 19 03:29:22.635723 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1092545231 Oct 19 03:29:22.635723 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:29:22.635723 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:29:22.637409 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/3838e32f217c45cb8230dde2a9f68a00"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3838e32f217c45cb8230dde2a9f68a00"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3838e32f217c45cb8230dde2a9f68a00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_3838e32f217c45cb8230dde2a9f68a00", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:29:22.637409 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1092545231 Oct 19 03:29:22.637409 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 3838e32f217c45cb8230dde2a9f68a00 Oct 19 03:29:22.637409 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1092545231 Oct 19 03:29:22.637409 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-SecurityGroupsNegativeTestJSON-1092545231-project Oct 19 03:29:22.637409 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:29:22.637409 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:29:22.637409 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: b145e7002cda4aef8417115fe03dd58f Oct 19 03:29:22.637409 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1092545231-project Oct 19 03:29:22.637409 n-d-861333-8 devstack@n-api.service[121134]: method: Oct 19 03:29:22.637409 n-d-861333-8 devstack@n-api.service[121134]: exception: Insufficient rights for removing default security group. Oct 19 03:29:22.637409 n-d-861333-8 devstack@n-api.service[121134]: Neutron server returns request_ids: ['req-9b67a400-9b8c-40e1-9ea6-44cfc45312ea'] Oct 19 03:29:22.637409 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '8a208feb-926a-4216-bce9-4c81ff244ce5'} Oct 19 03:29:22.638480 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:29:22.638480 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:29:22.638480 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 19 03:29:22.638480 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 19 03:29:22.638480 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:29:22.638480 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:29:22.638480 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 19 03:29:22.638480 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 19 03:29:22.638480 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:29:22.638480 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:29:22.638480 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 19 03:29:22.638480 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 19 03:29:22.638480 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:29:22.638480 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:29:22.638480 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 19 03:29:22.638480 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 19 03:29:22.638480 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:29:22.638480 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:29:22.638480 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 19 03:29:22.640261 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 19 03:29:22.640261 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:29:22.640261 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:29:22.640261 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 19 03:29:22.640261 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 19 03:29:22.640261 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 19 03:29:22.640261 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 19 03:29:22.640261 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Oct 19 03:29:22.640261 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9b67a400-9b8c-40e1-9ea6-44cfc45312ea'] Oct 19 03:29:22.640261 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:29:22.640261 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:29:22.640261 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:29:22.640261 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:29:22.640261 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 19 03:29:22.640261 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 19 03:29:22.640261 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 19 03:29:22.640261 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 19 03:29:22.640261 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Oct 19 03:29:22.640261 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9b67a400-9b8c-40e1-9ea6-44cfc45312ea'] Oct 19 03:29:22.642330 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:29:22.642330 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:29:22.642330 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:29:22.642330 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:29:22.642330 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:29:22.642330 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:29:22.642330 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:29:22.642330 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:29:22.642330 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 03:29:22.642330 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 03:29:22.642330 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:29:22.642330 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:29:22.642330 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 19 03:29:22.642330 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 19 03:29:22.642330 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Oct 19 03:29:22.642330 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9b67a400-9b8c-40e1-9ea6-44cfc45312ea'] Oct 19 03:29:22.642330 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:29:22.642330 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:29:22.642330 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:29:22.642330 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:29:22.642330 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:29:22.644080 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:29:22.644080 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:29:22.644080 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:29:22.644080 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Oct 19 03:29:22.644080 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9b67a400-9b8c-40e1-9ea6-44cfc45312ea'] Oct 19 03:29:22.644080 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:29:22.644080 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2fe84771-3c64-41e6-b6bc-6789ac5dc48b tempest-SecurityGroupsNegativeTestJSON-1092545231 tempest-SecurityGroupsNegativeTestJSON-1092545231-project] Returning 400 to user: Insufficient rights for removing default security group. Oct 19 03:29:22.644080 n-d-861333-8 devstack@n-api.service[121134]: Neutron server returns request_ids: ['req-9b67a400-9b8c-40e1-9ea6-44cfc45312ea'] {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:29:22.654057 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2fe84771-3c64-41e6-b6bc-6789ac5dc48b tempest-SecurityGroupsNegativeTestJSON-1092545231 tempest-SecurityGroupsNegativeTestJSON-1092545231-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/8a208feb-926a-4216-bce9-4c81ff244ce5" status: 400 len: 182 microversion: 2.1 time: 0.896142 Oct 19 03:29:22.655531 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1883/3855] 10.222.0.52 () {58 vars in 1272 bytes} [Wed Oct 19 03:29:21 2022] DELETE /compute/v2.1/os-security-groups/8a208feb-926a-4216-bce9-4c81ff244ce5 => generated 182 bytes in 898 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 03:29:22.684139 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6ebcf5ee-a5c6-4657-957a-e0f417c2440e tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:29:22.687284 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6ebcf5ee-a5c6-4657-957a-e0f417c2440e tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: e13547eb-efb0-4153-8dec-a666d4e6349b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:29:22.722832 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6ebcf5ee-a5c6-4657-957a-e0f417c2440e tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:22.728078 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6ebcf5ee-a5c6-4657-957a-e0f417c2440e tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:22.732409 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6ebcf5ee-a5c6-4657-957a-e0f417c2440e tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:22.735138 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6ebcf5ee-a5c6-4657-957a-e0f417c2440e tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:22.736956 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6ebcf5ee-a5c6-4657-957a-e0f417c2440e tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:22.738669 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6ebcf5ee-a5c6-4657-957a-e0f417c2440e tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:22.744901 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:29:22.865646 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=6 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:29:22.992389 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d879ee2c-4009-4f3a-92cb-650acace4ffd tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:23.012416 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d879ee2c-4009-4f3a-92cb-650acace4ffd tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:23.020743 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d879ee2c-4009-4f3a-92cb-650acace4ffd tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:23.024680 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d879ee2c-4009-4f3a-92cb-650acace4ffd tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] 10.222.0.52 "GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95" status: 200 len: 2960 microversion: 2.42 time: 1.198563 Oct 19 03:29:23.050784 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1973/3856] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:29:21 2022] GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 => generated 2960 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:29:23.061324 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-70df8b94-245e-4034-a292-3b7d4625286d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:29:23.063380 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-70df8b94-245e-4034-a292-3b7d4625286d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 89f5f23f-8580-46fa-accf-206b1141c301] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:29:23.073068 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-70df8b94-245e-4034-a292-3b7d4625286d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:23.082241 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-70df8b94-245e-4034-a292-3b7d4625286d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:23.082977 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-70df8b94-245e-4034-a292-3b7d4625286d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:23.084011 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-70df8b94-245e-4034-a292-3b7d4625286d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:23.084913 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-70df8b94-245e-4034-a292-3b7d4625286d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:23.085669 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-70df8b94-245e-4034-a292-3b7d4625286d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:23.935768 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-6ebcf5ee-a5c6-4657-957a-e0f417c2440e tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2b0581ad4e4c9787bef838c81870a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dfe251b1e046a995b8ec302cb2ffa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:23.958202 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6ebcf5ee-a5c6-4657-957a-e0f417c2440e tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "GET /compute/v2.1/servers/e13547eb-efb0-4153-8dec-a666d4e6349b" status: 200 len: 1517 microversion: 2.1 time: 1.293924 Oct 19 03:29:23.973892 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1884/3857] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:29:22 2022] GET /compute/v2.1/servers/e13547eb-efb0-4153-8dec-a666d4e6349b => generated 1517 bytes in 1298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:29:23.996275 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-de7c36e2-e482-4b9b-be6a-e99d2c22740e tempest-SecurityGroupsNegativeTestJSON-1092545231 tempest-SecurityGroupsNegativeTestJSON-1092545231-project] Calling method '.version_select at 0x7fc12bfe9940>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:29:24.154964 n-d-861333-8 devstack@n-api.service[121134]: DEBUG neutronclient.v2_0.client [None req-de7c36e2-e482-4b9b-be6a-e99d2c22740e tempest-SecurityGroupsNegativeTestJSON-1092545231 tempest-SecurityGroupsNegativeTestJSON-1092545231-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c92e206c-8b35-4ce1-bfc4-306e99a973d7 does not exist", "detail": ""}} {{(pid=121134) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 19 03:29:24.156209 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.security_group_api [None req-de7c36e2-e482-4b9b-be6a-e99d2c22740e tempest-SecurityGroupsNegativeTestJSON-1092545231 tempest-SecurityGroupsNegativeTestJSON-1092545231-project] Neutron security group c92e206c-8b35-4ce1-bfc4-306e99a973d7 not found {{(pid=121134) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 19 03:29:24.156916 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-de7c36e2-e482-4b9b-be6a-e99d2c22740e tempest-SecurityGroupsNegativeTestJSON-1092545231 tempest-SecurityGroupsNegativeTestJSON-1092545231-project] HTTP exception thrown: Security group c92e206c-8b35-4ce1-bfc4-306e99a973d7 does not exist Oct 19 03:29:24.156916 n-d-861333-8 devstack@n-api.service[121134]: Neutron server returns request_ids: ['req-c9a11a79-ccb0-4212-8550-d9ec0e6c7d39'] Oct 19 03:29:24.159290 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-de7c36e2-e482-4b9b-be6a-e99d2c22740e tempest-SecurityGroupsNegativeTestJSON-1092545231 tempest-SecurityGroupsNegativeTestJSON-1092545231-project] Request method failure captured: Oct 19 03:29:24.159290 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/os-security-groups/c92e206c-8b35-4ce1-bfc4-306e99a973d7 HTTP/1.1 Oct 19 03:29:24.159290 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:29:24.159290 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:29:24.159290 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:29:24.159290 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:29:24.159290 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:29:24.159290 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:29:24.159290 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:29:24.159290 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:29:24.159290 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT28Pd_9a3pk9gFH7hgeKGNlu7s3NG6TznhrPvoK6RmJ6JqyaebpID_Lj45NscgrdNu2n7nipkdxNeitBunh1dk0hi_jjBha0T8ZS0sA31yx64kstWRvWRhCbT9K6_W8MQCJJNyoicTmPhT63AkmGZH_DfZ0vvwKwLsn-k-oAiliOnLc Oct 19 03:29:24.159290 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:29:24.159290 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:29:24.159290 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:29:24.159290 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:29:24.159290 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:29:24.159290 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:29:24.159290 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 3838e32f217c45cb8230dde2a9f68a00 Oct 19 03:29:24.159290 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1092545231 Oct 19 03:29:24.159290 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:29:24.159290 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:29:24.161071 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/3838e32f217c45cb8230dde2a9f68a00"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3838e32f217c45cb8230dde2a9f68a00"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3838e32f217c45cb8230dde2a9f68a00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_3838e32f217c45cb8230dde2a9f68a00", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:29:24.161071 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1092545231 Oct 19 03:29:24.161071 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 3838e32f217c45cb8230dde2a9f68a00 Oct 19 03:29:24.161071 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1092545231 Oct 19 03:29:24.161071 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-SecurityGroupsNegativeTestJSON-1092545231-project Oct 19 03:29:24.161071 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:29:24.161071 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:29:24.161071 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: b145e7002cda4aef8417115fe03dd58f Oct 19 03:29:24.161071 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1092545231-project Oct 19 03:29:24.161071 n-d-861333-8 devstack@n-api.service[121134]: method: Oct 19 03:29:24.161071 n-d-861333-8 devstack@n-api.service[121134]: exception: Security group c92e206c-8b35-4ce1-bfc4-306e99a973d7 does not exist Oct 19 03:29:24.161071 n-d-861333-8 devstack@n-api.service[121134]: Neutron server returns request_ids: ['req-c9a11a79-ccb0-4212-8550-d9ec0e6c7d39'] Oct 19 03:29:24.161071 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': 'c92e206c-8b35-4ce1-bfc4-306e99a973d7'} Oct 19 03:29:24.162170 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:29:24.162170 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:29:24.162170 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 19 03:29:24.162170 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 19 03:29:24.162170 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:29:24.162170 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:29:24.162170 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 19 03:29:24.162170 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 19 03:29:24.162170 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:29:24.162170 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:29:24.162170 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 19 03:29:24.162170 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 19 03:29:24.162170 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:29:24.162170 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:29:24.162170 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 19 03:29:24.162170 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 19 03:29:24.162170 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:29:24.162170 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:29:24.162170 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 19 03:29:24.164165 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 19 03:29:24.164165 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:29:24.164165 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:29:24.164165 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 19 03:29:24.164165 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 19 03:29:24.164165 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 19 03:29:24.164165 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 19 03:29:24.164165 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c92e206c-8b35-4ce1-bfc4-306e99a973d7 does not exist Oct 19 03:29:24.164165 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c9a11a79-ccb0-4212-8550-d9ec0e6c7d39'] Oct 19 03:29:24.164165 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:29:24.164165 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:29:24.164165 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:29:24.164165 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:29:24.164165 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 19 03:29:24.164165 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 19 03:29:24.164165 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 19 03:29:24.164165 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 19 03:29:24.164165 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c92e206c-8b35-4ce1-bfc4-306e99a973d7 does not exist Oct 19 03:29:24.165642 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c9a11a79-ccb0-4212-8550-d9ec0e6c7d39'] Oct 19 03:29:24.165642 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:29:24.165642 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:29:24.165642 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:29:24.165642 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:29:24.165642 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:29:24.165642 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:29:24.165642 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:29:24.165642 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:29:24.165642 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 03:29:24.165642 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 03:29:24.165642 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:29:24.165642 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:29:24.165642 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 19 03:29:24.165642 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 19 03:29:24.165642 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c92e206c-8b35-4ce1-bfc4-306e99a973d7 does not exist Oct 19 03:29:24.165642 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c9a11a79-ccb0-4212-8550-d9ec0e6c7d39'] Oct 19 03:29:24.165642 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:29:24.165642 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:29:24.165642 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:29:24.165642 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:29:24.167323 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:29:24.167323 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:29:24.167323 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:29:24.167323 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:29:24.167323 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c92e206c-8b35-4ce1-bfc4-306e99a973d7 does not exist Oct 19 03:29:24.167323 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c9a11a79-ccb0-4212-8550-d9ec0e6c7d39'] Oct 19 03:29:24.167323 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:29:24.167323 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-de7c36e2-e482-4b9b-be6a-e99d2c22740e tempest-SecurityGroupsNegativeTestJSON-1092545231 tempest-SecurityGroupsNegativeTestJSON-1092545231-project] Returning 404 to user: Security group c92e206c-8b35-4ce1-bfc4-306e99a973d7 does not exist Oct 19 03:29:24.167323 n-d-861333-8 devstack@n-api.service[121134]: Neutron server returns request_ids: ['req-c9a11a79-ccb0-4212-8550-d9ec0e6c7d39'] {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:29:24.173399 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-de7c36e2-e482-4b9b-be6a-e99d2c22740e tempest-SecurityGroupsNegativeTestJSON-1092545231 tempest-SecurityGroupsNegativeTestJSON-1092545231-project] 10.222.0.52 "GET /compute/v2.1/os-security-groups/c92e206c-8b35-4ce1-bfc4-306e99a973d7" status: 404 len: 194 microversion: 2.1 time: 0.182442 Oct 19 03:29:24.179667 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1885/3858] 10.222.0.52 () {58 vars in 1269 bytes} [Wed Oct 19 03:29:23 2022] GET /compute/v2.1/os-security-groups/c92e206c-8b35-4ce1-bfc4-306e99a973d7 => generated 194 bytes in 215 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:29:24.182872 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-9c1cfe8a-0031-4937-9d13-eb04149c3e73 req-1f7cdeb6-b166-458b-96db-4618fcc2d010 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95", "name": "network-vif-unplugged", "status": "completed", "tag": "e7593819-3c37-4a86-a761-7d7c0fa6d983"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:29:24.227309 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-9c1cfe8a-0031-4937-9d13-eb04149c3e73 req-1f7cdeb6-b166-458b-96db-4618fcc2d010 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:24.234101 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-9c1cfe8a-0031-4937-9d13-eb04149c3e73 req-1f7cdeb6-b166-458b-96db-4618fcc2d010 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:24.235305 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-9c1cfe8a-0031-4937-9d13-eb04149c3e73 req-1f7cdeb6-b166-458b-96db-4618fcc2d010 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:24.261464 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-9c1cfe8a-0031-4937-9d13-eb04149c3e73 req-1f7cdeb6-b166-458b-96db-4618fcc2d010 service nova] Creating event network-vif-unplugged:e7593819-3c37-4a86-a761-7d7c0fa6d983 for instance cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 on n-h2-861333-8 Oct 19 03:29:24.280244 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-9c1cfe8a-0031-4937-9d13-eb04149c3e73 req-1f7cdeb6-b166-458b-96db-4618fcc2d010 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.102020 Oct 19 03:29:24.285502 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1886/3859] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:29:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:29:24.299692 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b32538a4-d3b5-461b-bab4-e24b0ca12b9c tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:29:24.305197 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b32538a4-d3b5-461b-bab4-e24b0ca12b9c tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] [instance: cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:29:24.325788 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b32538a4-d3b5-461b-bab4-e24b0ca12b9c tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:24.327165 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b32538a4-d3b5-461b-bab4-e24b0ca12b9c tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:24.331568 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b32538a4-d3b5-461b-bab4-e24b0ca12b9c tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:24.333674 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b32538a4-d3b5-461b-bab4-e24b0ca12b9c tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:24.333674 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b32538a4-d3b5-461b-bab4-e24b0ca12b9c tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:24.333959 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b32538a4-d3b5-461b-bab4-e24b0ca12b9c tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:24.423614 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-70df8b94-245e-4034-a292-3b7d4625286d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:24.432016 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-70df8b94-245e-4034-a292-3b7d4625286d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301" status: 200 len: 1210 microversion: 2.1 time: 1.391641 Oct 19 03:29:24.449750 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1974/3860] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:29:23 2022] GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301 => generated 1210 bytes in 1410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:29:24.464462 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-832d1344-38fc-4cc9-a4d2-7017caae1d55 tempest-SecurityGroupsNegativeTestJSON-1092545231 tempest-SecurityGroupsNegativeTestJSON-1092545231-project] Action: 'update', calling method: .version_select at 0x7fc12becdb80>, body: {"security_group": {"name": "tempest-sg-1824335909", "description": "tempest-description-62133784"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:29:24.577529 n-d-861333-8 devstack@n-api.service[121135]: DEBUG neutronclient.v2_0.client [None req-832d1344-38fc-4cc9-a4d2-7017caae1d55 tempest-SecurityGroupsNegativeTestJSON-1092545231 tempest-SecurityGroupsNegativeTestJSON-1092545231-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group cef4682b-7491-415a-8531-ada5ea00dc57 does not exist", "detail": ""}} {{(pid=121135) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 19 03:29:24.578898 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.network.security_group_api [None req-832d1344-38fc-4cc9-a4d2-7017caae1d55 tempest-SecurityGroupsNegativeTestJSON-1092545231 tempest-SecurityGroupsNegativeTestJSON-1092545231-project] Neutron security group cef4682b-7491-415a-8531-ada5ea00dc57 not found {{(pid=121135) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 19 03:29:24.579626 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-832d1344-38fc-4cc9-a4d2-7017caae1d55 tempest-SecurityGroupsNegativeTestJSON-1092545231 tempest-SecurityGroupsNegativeTestJSON-1092545231-project] HTTP exception thrown: Security group cef4682b-7491-415a-8531-ada5ea00dc57 does not exist Oct 19 03:29:24.579626 n-d-861333-8 devstack@n-api.service[121135]: Neutron server returns request_ids: ['req-ccfef85e-cd0d-4b75-bccb-8633cb699995'] Oct 19 03:29:24.582059 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-832d1344-38fc-4cc9-a4d2-7017caae1d55 tempest-SecurityGroupsNegativeTestJSON-1092545231 tempest-SecurityGroupsNegativeTestJSON-1092545231-project] Request method failure captured: Oct 19 03:29:24.582059 n-d-861333-8 devstack@n-api.service[121135]: request: PUT /compute/v2.1/os-security-groups/cef4682b-7491-415a-8531-ada5ea00dc57 HTTP/1.1 Oct 19 03:29:24.582059 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:29:24.582059 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:29:24.582059 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:29:24.582059 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 100 Oct 19 03:29:24.582059 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:29:24.582059 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:29:24.582059 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:29:24.582059 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:29:24.582059 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT28Pd_9a3pk9gFH7hgeKGNlu7s3NG6TznhrPvoK6RmJ6JqyaebpID_Lj45NscgrdNu2n7nipkdxNeitBunh1dk0hi_jjBha0T8ZS0sA31yx64kstWRvWRhCbT9K6_W8MQCJJNyoicTmPhT63AkmGZH_DfZ0vvwKwLsn-k-oAiliOnLc Oct 19 03:29:24.582059 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:29:24.582059 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:29:24.582059 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:29:24.582059 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:29:24.582059 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:29:24.582059 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:29:24.582059 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 3838e32f217c45cb8230dde2a9f68a00 Oct 19 03:29:24.582059 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1092545231 Oct 19 03:29:24.582059 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:29:24.582059 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:29:24.583829 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/3838e32f217c45cb8230dde2a9f68a00"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3838e32f217c45cb8230dde2a9f68a00"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3838e32f217c45cb8230dde2a9f68a00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_3838e32f217c45cb8230dde2a9f68a00", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:29:24.583829 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1092545231 Oct 19 03:29:24.583829 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 3838e32f217c45cb8230dde2a9f68a00 Oct 19 03:29:24.583829 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1092545231 Oct 19 03:29:24.583829 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-SecurityGroupsNegativeTestJSON-1092545231-project Oct 19 03:29:24.583829 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:29:24.583829 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:29:24.583829 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: b145e7002cda4aef8417115fe03dd58f Oct 19 03:29:24.583829 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1092545231-project Oct 19 03:29:24.583829 n-d-861333-8 devstack@n-api.service[121135]: Oct 19 03:29:24.583829 n-d-861333-8 devstack@n-api.service[121135]: {"security_group": {"name": "tempest-sg-1824335909", "description": "tempest-description-62133784"}} Oct 19 03:29:24.583829 n-d-861333-8 devstack@n-api.service[121135]: method: Oct 19 03:29:24.583829 n-d-861333-8 devstack@n-api.service[121135]: exception: Security group cef4682b-7491-415a-8531-ada5ea00dc57 does not exist Oct 19 03:29:24.584897 n-d-861333-8 devstack@n-api.service[121135]: Neutron server returns request_ids: ['req-ccfef85e-cd0d-4b75-bccb-8633cb699995'] Oct 19 03:29:24.584897 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': 'cef4682b-7491-415a-8531-ada5ea00dc57', 'body': {'security_group': {'name': 'tempest-sg-1824335909', 'description': 'tempest-description-62133784'}}} Oct 19 03:29:24.584897 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:29:24.584897 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:29:24.584897 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 19 03:29:24.584897 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 19 03:29:24.584897 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:29:24.584897 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:29:24.584897 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 19 03:29:24.584897 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 19 03:29:24.584897 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:29:24.584897 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:29:24.584897 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 19 03:29:24.584897 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 19 03:29:24.584897 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:29:24.584897 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:29:24.584897 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 19 03:29:24.584897 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 19 03:29:24.586376 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:29:24.586376 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:29:24.586376 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 19 03:29:24.586376 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 19 03:29:24.586376 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:29:24.586376 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:29:24.586376 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 19 03:29:24.586376 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 19 03:29:24.586376 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 19 03:29:24.586376 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 19 03:29:24.586376 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group cef4682b-7491-415a-8531-ada5ea00dc57 does not exist Oct 19 03:29:24.586376 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ccfef85e-cd0d-4b75-bccb-8633cb699995'] Oct 19 03:29:24.586376 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:29:24.586376 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:29:24.586376 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:29:24.586376 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:29:24.586376 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Oct 19 03:29:24.586376 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 19 03:29:24.586376 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 19 03:29:24.587898 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 19 03:29:24.587898 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group cef4682b-7491-415a-8531-ada5ea00dc57 does not exist Oct 19 03:29:24.587898 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ccfef85e-cd0d-4b75-bccb-8633cb699995'] Oct 19 03:29:24.587898 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:29:24.587898 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:29:24.587898 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:29:24.587898 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:29:24.587898 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:29:24.587898 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:29:24.587898 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:29:24.587898 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:29:24.587898 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 03:29:24.587898 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 03:29:24.587898 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:29:24.587898 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:29:24.587898 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Oct 19 03:29:24.587898 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 19 03:29:24.587898 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group cef4682b-7491-415a-8531-ada5ea00dc57 does not exist Oct 19 03:29:24.587898 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ccfef85e-cd0d-4b75-bccb-8633cb699995'] Oct 19 03:29:24.587898 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:29:24.589547 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:29:24.589547 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:29:24.589547 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:29:24.589547 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:29:24.589547 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:29:24.589547 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:29:24.589547 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:29:24.589547 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group cef4682b-7491-415a-8531-ada5ea00dc57 does not exist Oct 19 03:29:24.589547 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ccfef85e-cd0d-4b75-bccb-8633cb699995'] Oct 19 03:29:24.589547 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:29:24.591998 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-832d1344-38fc-4cc9-a4d2-7017caae1d55 tempest-SecurityGroupsNegativeTestJSON-1092545231 tempest-SecurityGroupsNegativeTestJSON-1092545231-project] Returning 404 to user: Security group cef4682b-7491-415a-8531-ada5ea00dc57 does not exist Oct 19 03:29:24.591998 n-d-861333-8 devstack@n-api.service[121135]: Neutron server returns request_ids: ['req-ccfef85e-cd0d-4b75-bccb-8633cb699995'] {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:29:24.593173 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-832d1344-38fc-4cc9-a4d2-7017caae1d55 tempest-SecurityGroupsNegativeTestJSON-1092545231 tempest-SecurityGroupsNegativeTestJSON-1092545231-project] 10.222.0.52 "PUT /compute/v2.1/os-security-groups/cef4682b-7491-415a-8531-ada5ea00dc57" status: 404 len: 194 microversion: 2.1 time: 0.142349 Oct 19 03:29:24.595254 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1975/3861] 10.222.0.52 () {60 vars in 1290 bytes} [Wed Oct 19 03:29:24 2022] PUT /compute/v2.1/os-security-groups/cef4682b-7491-415a-8531-ada5ea00dc57 => generated 194 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:29:24.625579 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:29:24.989789 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-13e9fb08-4efd-4184-8ac5-a9a62b5e3013 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:29:24.990689 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-13e9fb08-4efd-4184-8ac5-a9a62b5e3013 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: e13547eb-efb0-4153-8dec-a666d4e6349b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:29:25.017573 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-13e9fb08-4efd-4184-8ac5-a9a62b5e3013 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:25.017573 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-13e9fb08-4efd-4184-8ac5-a9a62b5e3013 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:25.017573 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-13e9fb08-4efd-4184-8ac5-a9a62b5e3013 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:25.018108 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-13e9fb08-4efd-4184-8ac5-a9a62b5e3013 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:25.018806 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-13e9fb08-4efd-4184-8ac5-a9a62b5e3013 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:25.019449 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-13e9fb08-4efd-4184-8ac5-a9a62b5e3013 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:25.023628 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b32538a4-d3b5-461b-bab4-e24b0ca12b9c tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:25.040458 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b32538a4-d3b5-461b-bab4-e24b0ca12b9c tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:25.044217 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b32538a4-d3b5-461b-bab4-e24b0ca12b9c tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:25.048608 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b32538a4-d3b5-461b-bab4-e24b0ca12b9c tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] 10.222.0.52 "GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95" status: 200 len: 2939 microversion: 2.42 time: 0.761481 Oct 19 03:29:25.050590 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1887/3862] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:29:24 2022] GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 => generated 2939 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:29:25.467864 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-13818a19-ad6c-4e15-9a4e-1748fcea4acb tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:29:25.470167 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-13818a19-ad6c-4e15-9a4e-1748fcea4acb tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 89f5f23f-8580-46fa-accf-206b1141c301] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:29:25.490072 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-13818a19-ad6c-4e15-9a4e-1748fcea4acb tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:25.492354 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-13818a19-ad6c-4e15-9a4e-1748fcea4acb tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:25.495662 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-13818a19-ad6c-4e15-9a4e-1748fcea4acb tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:25.497767 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-13818a19-ad6c-4e15-9a4e-1748fcea4acb tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:25.503352 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-13818a19-ad6c-4e15-9a4e-1748fcea4acb tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:25.505353 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-13818a19-ad6c-4e15-9a4e-1748fcea4acb tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:26.156789 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-13e9fb08-4efd-4184-8ac5-a9a62b5e3013 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2b0581ad4e4c9787bef838c81870a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dfe251b1e046a995b8ec302cb2ffa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:26.175494 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-13e9fb08-4efd-4184-8ac5-a9a62b5e3013 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "GET /compute/v2.1/servers/e13547eb-efb0-4153-8dec-a666d4e6349b" status: 200 len: 1517 microversion: 2.1 time: 1.189340 Oct 19 03:29:26.180914 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1976/3863] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:29:24 2022] GET /compute/v2.1/servers/e13547eb-efb0-4153-8dec-a666d4e6349b => generated 1517 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:29:26.210317 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ebe0052f-991f-4cc1-a57a-d4656881f703 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:29:26.211208 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ebe0052f-991f-4cc1-a57a-d4656881f703 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] [instance: cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:29:26.240211 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ebe0052f-991f-4cc1-a57a-d4656881f703 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:26.241502 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ebe0052f-991f-4cc1-a57a-d4656881f703 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:26.247490 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ebe0052f-991f-4cc1-a57a-d4656881f703 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:26.249120 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ebe0052f-991f-4cc1-a57a-d4656881f703 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:26.250853 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ebe0052f-991f-4cc1-a57a-d4656881f703 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:26.254452 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ebe0052f-991f-4cc1-a57a-d4656881f703 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:26.407986 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-13818a19-ad6c-4e15-9a4e-1748fcea4acb tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:26.417845 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-13818a19-ad6c-4e15-9a4e-1748fcea4acb tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301" status: 200 len: 1210 microversion: 2.1 time: 0.959851 Oct 19 03:29:26.419897 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1888/3864] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:29:25 2022] GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301 => generated 1210 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:29:26.463102 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-10276313-c101-4755-a8d0-3202955f740b req-338d47a9-5460-4fef-97ec-ffce3e439fbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95", "name": "network-vif-unplugged", "status": "completed", "tag": "475eb265-32ca-40db-846e-3d83be38943b"}, {"server_uuid": "cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95", "name": "network-vif-unplugged", "status": "completed", "tag": "8a375b84-11bb-4f0c-9583-6d7d29938112"}, {"server_uuid": "cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95", "name": "network-vif-unplugged", "status": "completed", "tag": "65396b7f-6d0e-408a-b3e0-4a8c18d5caa3"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:29:26.486692 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-10276313-c101-4755-a8d0-3202955f740b req-338d47a9-5460-4fef-97ec-ffce3e439fbf service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:26.489864 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-10276313-c101-4755-a8d0-3202955f740b req-338d47a9-5460-4fef-97ec-ffce3e439fbf service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:26.491691 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-10276313-c101-4755-a8d0-3202955f740b req-338d47a9-5460-4fef-97ec-ffce3e439fbf service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:26.526015 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-10276313-c101-4755-a8d0-3202955f740b req-338d47a9-5460-4fef-97ec-ffce3e439fbf service nova] Creating event network-vif-unplugged:475eb265-32ca-40db-846e-3d83be38943b for instance cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 on n-h2-861333-8 Oct 19 03:29:26.526917 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-10276313-c101-4755-a8d0-3202955f740b req-338d47a9-5460-4fef-97ec-ffce3e439fbf service nova] Creating event network-vif-unplugged:8a375b84-11bb-4f0c-9583-6d7d29938112 for instance cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 on n-h2-861333-8 Oct 19 03:29:26.529909 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-10276313-c101-4755-a8d0-3202955f740b req-338d47a9-5460-4fef-97ec-ffce3e439fbf service nova] Creating event network-vif-unplugged:65396b7f-6d0e-408a-b3e0-4a8c18d5caa3 for instance cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 on n-h2-861333-8 Oct 19 03:29:26.543489 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-10276313-c101-4755-a8d0-3202955f740b req-338d47a9-5460-4fef-97ec-ffce3e439fbf service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.085704 Oct 19 03:29:26.548340 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1889/3865] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:29:26 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:29:26.684430 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ebe0052f-991f-4cc1-a57a-d4656881f703 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:26.702160 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ebe0052f-991f-4cc1-a57a-d4656881f703 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:26.709435 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ebe0052f-991f-4cc1-a57a-d4656881f703 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:26.713102 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ebe0052f-991f-4cc1-a57a-d4656881f703 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] 10.222.0.52 "GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95" status: 200 len: 2918 microversion: 2.42 time: 0.523761 Oct 19 03:29:26.716163 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1977/3866] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:29:26 2022] GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 => generated 2918 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:29:27.208085 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-223ba22e-c9f8-460c-a9ce-822027991aec tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:29:27.209605 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-223ba22e-c9f8-460c-a9ce-822027991aec tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: e13547eb-efb0-4153-8dec-a666d4e6349b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:29:27.230570 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-223ba22e-c9f8-460c-a9ce-822027991aec tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:27.231444 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-223ba22e-c9f8-460c-a9ce-822027991aec tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:27.232173 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-223ba22e-c9f8-460c-a9ce-822027991aec tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:27.233526 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-223ba22e-c9f8-460c-a9ce-822027991aec tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:27.234222 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-223ba22e-c9f8-460c-a9ce-822027991aec tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:27.239017 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-223ba22e-c9f8-460c-a9ce-822027991aec tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:27.447342 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-371a77c1-1ccc-4535-8b8d-3ac072d9152d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:29:27.447963 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-371a77c1-1ccc-4535-8b8d-3ac072d9152d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 89f5f23f-8580-46fa-accf-206b1141c301] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:29:27.465941 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-371a77c1-1ccc-4535-8b8d-3ac072d9152d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:27.472104 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-371a77c1-1ccc-4535-8b8d-3ac072d9152d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:27.472104 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-371a77c1-1ccc-4535-8b8d-3ac072d9152d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:27.472104 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-371a77c1-1ccc-4535-8b8d-3ac072d9152d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:27.472104 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-371a77c1-1ccc-4535-8b8d-3ac072d9152d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:27.472782 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-371a77c1-1ccc-4535-8b8d-3ac072d9152d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:27.490689 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:29:27.886637 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-223ba22e-c9f8-460c-a9ce-822027991aec tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2b0581ad4e4c9787bef838c81870a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dfe251b1e046a995b8ec302cb2ffa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:27.906095 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-223ba22e-c9f8-460c-a9ce-822027991aec tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "GET /compute/v2.1/servers/e13547eb-efb0-4153-8dec-a666d4e6349b" status: 200 len: 1517 microversion: 2.1 time: 0.694328 Oct 19 03:29:27.907340 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1890/3867] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:29:27 2022] GET /compute/v2.1/servers/e13547eb-efb0-4153-8dec-a666d4e6349b => generated 1517 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:29:27.922718 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b1a575ea-54d0-4e70-b1f0-8d8a5ca25f87 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:29:27.935249 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b1a575ea-54d0-4e70-b1f0-8d8a5ca25f87 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] [instance: cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:29:27.961603 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b1a575ea-54d0-4e70-b1f0-8d8a5ca25f87 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:27.962253 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b1a575ea-54d0-4e70-b1f0-8d8a5ca25f87 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:27.969993 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b1a575ea-54d0-4e70-b1f0-8d8a5ca25f87 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:27.970939 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b1a575ea-54d0-4e70-b1f0-8d8a5ca25f87 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:27.971424 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b1a575ea-54d0-4e70-b1f0-8d8a5ca25f87 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:27.971867 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b1a575ea-54d0-4e70-b1f0-8d8a5ca25f87 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:28.104215 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-371a77c1-1ccc-4535-8b8d-3ac072d9152d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:28.122513 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-371a77c1-1ccc-4535-8b8d-3ac072d9152d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301" status: 200 len: 1210 microversion: 2.1 time: 0.679011 Oct 19 03:29:28.127144 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1978/3868] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:29:27 2022] GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301 => generated 1210 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:29:28.935366 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-8114404e-f486-42e9-ba82-26bb300139e3 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:29:28.936042 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-8114404e-f486-42e9-ba82-26bb300139e3 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: e13547eb-efb0-4153-8dec-a666d4e6349b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:29:28.956514 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8114404e-f486-42e9-ba82-26bb300139e3 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:28.959249 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8114404e-f486-42e9-ba82-26bb300139e3 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:28.961515 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8114404e-f486-42e9-ba82-26bb300139e3 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:28.963340 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8114404e-f486-42e9-ba82-26bb300139e3 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:28.966451 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8114404e-f486-42e9-ba82-26bb300139e3 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:28.969726 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8114404e-f486-42e9-ba82-26bb300139e3 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:29.313529 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b1a575ea-54d0-4e70-b1f0-8d8a5ca25f87 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:29.336283 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b1a575ea-54d0-4e70-b1f0-8d8a5ca25f87 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:29.341077 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b1a575ea-54d0-4e70-b1f0-8d8a5ca25f87 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:29.349587 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b1a575ea-54d0-4e70-b1f0-8d8a5ca25f87 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] 10.222.0.52 "GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95" status: 200 len: 2918 microversion: 2.42 time: 1.439130 Oct 19 03:29:29.352566 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1891/3869] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:29:27 2022] GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 => generated 2918 bytes in 1444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:29:29.371139 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-7a66c42b-ac0a-4f51-8553-1a2ae9099d29 req-04e485aa-bb95-41bc-9097-868f45bd671c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95", "name": "network-vif-unplugged", "status": "completed", "tag": "7131b08f-dd0e-40a5-b85e-19128faf4efc"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:29:29.420940 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-7a66c42b-ac0a-4f51-8553-1a2ae9099d29 req-04e485aa-bb95-41bc-9097-868f45bd671c service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:29.421460 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-7a66c42b-ac0a-4f51-8553-1a2ae9099d29 req-04e485aa-bb95-41bc-9097-868f45bd671c service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:29.424068 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-7a66c42b-ac0a-4f51-8553-1a2ae9099d29 req-04e485aa-bb95-41bc-9097-868f45bd671c service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:29.445509 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:29:29.456330 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-8114404e-f486-42e9-ba82-26bb300139e3 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2b0581ad4e4c9787bef838c81870a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dfe251b1e046a995b8ec302cb2ffa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:29.462707 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-7a66c42b-ac0a-4f51-8553-1a2ae9099d29 req-04e485aa-bb95-41bc-9097-868f45bd671c service nova] Creating event network-vif-unplugged:7131b08f-dd0e-40a5-b85e-19128faf4efc for instance cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 on n-h2-861333-8 Oct 19 03:29:29.472175 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-7a66c42b-ac0a-4f51-8553-1a2ae9099d29 req-04e485aa-bb95-41bc-9097-868f45bd671c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.117007 Oct 19 03:29:29.474395 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-8114404e-f486-42e9-ba82-26bb300139e3 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "GET /compute/v2.1/servers/e13547eb-efb0-4153-8dec-a666d4e6349b" status: 200 len: 1517 microversion: 2.1 time: 0.543010 Oct 19 03:29:29.475508 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1892/3870] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:29:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:29:29.491332 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b88937a5-80a0-448f-b64a-0260216b5d40 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:29:29.495349 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b88937a5-80a0-448f-b64a-0260216b5d40 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 89f5f23f-8580-46fa-accf-206b1141c301] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:29:29.499508 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1979/3871] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:29:28 2022] GET /compute/v2.1/servers/e13547eb-efb0-4153-8dec-a666d4e6349b => generated 1517 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:29:29.509168 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b88937a5-80a0-448f-b64a-0260216b5d40 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:29.509703 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b88937a5-80a0-448f-b64a-0260216b5d40 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:29.513186 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b88937a5-80a0-448f-b64a-0260216b5d40 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:29.513186 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b88937a5-80a0-448f-b64a-0260216b5d40 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:29.513186 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b88937a5-80a0-448f-b64a-0260216b5d40 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:29.513186 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b88937a5-80a0-448f-b64a-0260216b5d40 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:29.900183 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b88937a5-80a0-448f-b64a-0260216b5d40 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:29.912967 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b88937a5-80a0-448f-b64a-0260216b5d40 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301" status: 200 len: 1210 microversion: 2.1 time: 0.432729 Oct 19 03:29:29.914535 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1893/3872] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:29:29 2022] GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301 => generated 1210 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:29:30.080065 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-85cc5d8c-4ac2-4a5d-9745-82892d5386c8 tempest-VolumesGetTestJSON-1059602706 tempest-VolumesGetTestJSON-1059602706-project] Action: 'create', calling method: .version_select at 0x7fc12becd9d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-99864110", "metadata": {"Type": "work"}}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:29:30.387568 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-241ba954-727e-4f9e-b60c-50a223f9223d tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:29:30.388277 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-241ba954-727e-4f9e-b60c-50a223f9223d tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] [instance: cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:29:30.418394 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-241ba954-727e-4f9e-b60c-50a223f9223d tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:30.419061 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-241ba954-727e-4f9e-b60c-50a223f9223d tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:30.419526 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-241ba954-727e-4f9e-b60c-50a223f9223d tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:30.423334 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-241ba954-727e-4f9e-b60c-50a223f9223d tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:30.424114 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-241ba954-727e-4f9e-b60c-50a223f9223d tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:30.425578 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-241ba954-727e-4f9e-b60c-50a223f9223d tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:30.775134 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-241ba954-727e-4f9e-b60c-50a223f9223d tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:30.806830 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-241ba954-727e-4f9e-b60c-50a223f9223d tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:30.813992 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-241ba954-727e-4f9e-b60c-50a223f9223d tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:30.815540 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-241ba954-727e-4f9e-b60c-50a223f9223d tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] 10.222.0.52 "GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95" status: 200 len: 2871 microversion: 2.42 time: 0.433511 Oct 19 03:29:30.824111 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1894/3873] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:29:30 2022] GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 => generated 2871 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:29:30.831145 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-893eeef7-633f-43bc-864b-980a52e2f97b tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:29:30.831774 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-893eeef7-633f-43bc-864b-980a52e2f97b tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: e13547eb-efb0-4153-8dec-a666d4e6349b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:29:30.841563 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-893eeef7-633f-43bc-864b-980a52e2f97b tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:30.842070 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-893eeef7-633f-43bc-864b-980a52e2f97b tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:30.842575 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-893eeef7-633f-43bc-864b-980a52e2f97b tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:30.843542 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-893eeef7-633f-43bc-864b-980a52e2f97b tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:30.844851 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-893eeef7-633f-43bc-864b-980a52e2f97b tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:30.845299 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-893eeef7-633f-43bc-864b-980a52e2f97b tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:31.040071 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-893eeef7-633f-43bc-864b-980a52e2f97b tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2b0581ad4e4c9787bef838c81870a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dfe251b1e046a995b8ec302cb2ffa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:31.045794 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-893eeef7-633f-43bc-864b-980a52e2f97b tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "GET /compute/v2.1/servers/e13547eb-efb0-4153-8dec-a666d4e6349b" status: 200 len: 1517 microversion: 2.1 time: 0.219733 Oct 19 03:29:31.046398 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1895/3874] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:29:30 2022] GET /compute/v2.1/servers/e13547eb-efb0-4153-8dec-a666d4e6349b => generated 1517 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:29:31.052835 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-c98f3dc2-f40f-4fea-aeee-bc20e5f67ba9 req-2ac1ba71-d20a-4096-aa36-e1bb3e484154 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95", "name": "network-vif-deleted", "tag": "e7593819-3c37-4a86-a761-7d7c0fa6d983"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:29:31.064273 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-c98f3dc2-f40f-4fea-aeee-bc20e5f67ba9 req-2ac1ba71-d20a-4096-aa36-e1bb3e484154 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:31.073586 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-c98f3dc2-f40f-4fea-aeee-bc20e5f67ba9 req-2ac1ba71-d20a-4096-aa36-e1bb3e484154 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:31.073586 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-c98f3dc2-f40f-4fea-aeee-bc20e5f67ba9 req-2ac1ba71-d20a-4096-aa36-e1bb3e484154 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:31.082767 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-c98f3dc2-f40f-4fea-aeee-bc20e5f67ba9 req-2ac1ba71-d20a-4096-aa36-e1bb3e484154 service nova] Creating event network-vif-deleted:e7593819-3c37-4a86-a761-7d7c0fa6d983 for instance cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 on n-h2-861333-8 Oct 19 03:29:31.088442 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-c98f3dc2-f40f-4fea-aeee-bc20e5f67ba9 req-2ac1ba71-d20a-4096-aa36-e1bb3e484154 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039072 Oct 19 03:29:31.090030 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1896/3875] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:29:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:29:31.095217 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-85db3b39-4d0e-4e95-9b2b-8b5a17afcd89 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:29:31.096012 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-85db3b39-4d0e-4e95-9b2b-8b5a17afcd89 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 89f5f23f-8580-46fa-accf-206b1141c301] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:29:31.120400 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-85db3b39-4d0e-4e95-9b2b-8b5a17afcd89 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:31.124590 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-85db3b39-4d0e-4e95-9b2b-8b5a17afcd89 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:31.125814 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-85db3b39-4d0e-4e95-9b2b-8b5a17afcd89 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:31.130656 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-85db3b39-4d0e-4e95-9b2b-8b5a17afcd89 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:31.130656 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-85db3b39-4d0e-4e95-9b2b-8b5a17afcd89 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:31.130656 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-85db3b39-4d0e-4e95-9b2b-8b5a17afcd89 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:31.381602 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-85db3b39-4d0e-4e95-9b2b-8b5a17afcd89 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:31.399516 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-85db3b39-4d0e-4e95-9b2b-8b5a17afcd89 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301" status: 200 len: 1210 microversion: 2.1 time: 0.308142 Oct 19 03:29:31.400828 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1897/3876] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:29:31 2022] GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301 => generated 1210 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:29:31.444672 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-85cc5d8c-4ac2-4a5d-9745-82892d5386c8 tempest-VolumesGetTestJSON-1059602706 tempest-VolumesGetTestJSON-1059602706-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 200 len: 351 microversion: 2.1 time: 1.652955 Oct 19 03:29:31.445749 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1980/3877] 10.222.0.52 () {60 vars in 1156 bytes} [Wed Oct 19 03:29:29 2022] POST /compute/v2.1/os-volumes => generated 351 bytes in 1655 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 19 03:29:31.459349 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-272a9d69-6d2e-45f6-9365-6722aadb47c0 tempest-VolumesGetTestJSON-1059602706 tempest-VolumesGetTestJSON-1059602706-project] Calling method '.version_select at 0x7fc12bf954c0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:29:31.550138 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-272a9d69-6d2e-45f6-9365-6722aadb47c0 tempest-VolumesGetTestJSON-1059602706 tempest-VolumesGetTestJSON-1059602706-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/73cc4419-40df-43cd-8671-7138d1e8c962" status: 200 len: 351 microversion: 2.1 time: 0.095302 Oct 19 03:29:31.550719 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1898/3878] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Oct 19 03:29:31 2022] GET /compute/v2.1/os-volumes/73cc4419-40df-43cd-8671-7138d1e8c962 => generated 351 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:29:31.854726 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f0c723c1-081a-470d-b31a-1f01fef45352 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:29:31.855258 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f0c723c1-081a-470d-b31a-1f01fef45352 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] [instance: cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:29:31.864307 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f0c723c1-081a-470d-b31a-1f01fef45352 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:31.864878 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f0c723c1-081a-470d-b31a-1f01fef45352 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:31.865330 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f0c723c1-081a-470d-b31a-1f01fef45352 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:31.866270 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f0c723c1-081a-470d-b31a-1f01fef45352 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:31.867002 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f0c723c1-081a-470d-b31a-1f01fef45352 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:31.867445 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f0c723c1-081a-470d-b31a-1f01fef45352 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:32.075466 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ede7ce29-2aa6-4d52-be39-735f450bae6a tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:29:32.077270 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ede7ce29-2aa6-4d52-be39-735f450bae6a tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: e13547eb-efb0-4153-8dec-a666d4e6349b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:29:32.107585 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ede7ce29-2aa6-4d52-be39-735f450bae6a tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:32.122149 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ede7ce29-2aa6-4d52-be39-735f450bae6a tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:32.122615 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ede7ce29-2aa6-4d52-be39-735f450bae6a tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:32.130324 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ede7ce29-2aa6-4d52-be39-735f450bae6a tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:32.130803 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ede7ce29-2aa6-4d52-be39-735f450bae6a tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:32.131243 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ede7ce29-2aa6-4d52-be39-735f450bae6a tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:32.304151 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f0c723c1-081a-470d-b31a-1f01fef45352 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:32.314325 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f0c723c1-081a-470d-b31a-1f01fef45352 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:32.315758 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f0c723c1-081a-470d-b31a-1f01fef45352 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:32.317012 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f0c723c1-081a-470d-b31a-1f01fef45352 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] 10.222.0.52 "GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95" status: 200 len: 2757 microversion: 2.42 time: 0.467925 Oct 19 03:29:32.330115 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1981/3879] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:29:31 2022] GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 => generated 2757 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:29:32.427461 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7b336ef1-8980-42ca-bc62-3e9cef57d34c tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:29:32.428071 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7b336ef1-8980-42ca-bc62-3e9cef57d34c tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 89f5f23f-8580-46fa-accf-206b1141c301] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:29:32.445598 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7b336ef1-8980-42ca-bc62-3e9cef57d34c tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:32.446329 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7b336ef1-8980-42ca-bc62-3e9cef57d34c tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:32.446550 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7b336ef1-8980-42ca-bc62-3e9cef57d34c tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:32.447246 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7b336ef1-8980-42ca-bc62-3e9cef57d34c tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:32.447696 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7b336ef1-8980-42ca-bc62-3e9cef57d34c tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:32.448120 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7b336ef1-8980-42ca-bc62-3e9cef57d34c tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:32.649585 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ede7ce29-2aa6-4d52-be39-735f450bae6a tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2b0581ad4e4c9787bef838c81870a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dfe251b1e046a995b8ec302cb2ffa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:32.664315 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ede7ce29-2aa6-4d52-be39-735f450bae6a tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "GET /compute/v2.1/servers/e13547eb-efb0-4153-8dec-a666d4e6349b" status: 200 len: 1517 microversion: 2.1 time: 0.597110 Oct 19 03:29:32.666655 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1899/3880] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:29:32 2022] GET /compute/v2.1/servers/e13547eb-efb0-4153-8dec-a666d4e6349b => generated 1517 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:29:32.680878 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0c6fce70-eb07-411d-ad61-6f834e3abbd4 tempest-VolumesGetTestJSON-1059602706 tempest-VolumesGetTestJSON-1059602706-project] Calling method '.version_select at 0x7fc12bf62040>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:29:32.795658 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0c6fce70-eb07-411d-ad61-6f834e3abbd4 tempest-VolumesGetTestJSON-1059602706 tempest-VolumesGetTestJSON-1059602706-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/73cc4419-40df-43cd-8671-7138d1e8c962" status: 200 len: 351 microversion: 2.1 time: 0.127702 Oct 19 03:29:32.796238 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1900/3881] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Oct 19 03:29:32 2022] GET /compute/v2.1/os-volumes/73cc4419-40df-43cd-8671-7138d1e8c962 => generated 351 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:29:32.901640 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7b336ef1-8980-42ca-bc62-3e9cef57d34c tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:32.919303 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7b336ef1-8980-42ca-bc62-3e9cef57d34c tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301" status: 200 len: 1198 microversion: 2.1 time: 0.495532 Oct 19 03:29:32.933608 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1982/3882] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:29:32 2022] GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301 => generated 1198 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:29:33.220281 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-8d9fb0e8-8953-44be-b33b-4fb04df4a8ae req-edc22fa6-c291-43c2-8b83-94d4c89fba50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89f5f23f-8580-46fa-accf-206b1141c301", "tag": "a2678fb1-a9fa-4f93-9241-80d9c1c2d9d1"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:29:33.238658 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-8d9fb0e8-8953-44be-b33b-4fb04df4a8ae req-edc22fa6-c291-43c2-8b83-94d4c89fba50 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:33.242424 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-8d9fb0e8-8953-44be-b33b-4fb04df4a8ae req-edc22fa6-c291-43c2-8b83-94d4c89fba50 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:33.242881 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-8d9fb0e8-8953-44be-b33b-4fb04df4a8ae req-edc22fa6-c291-43c2-8b83-94d4c89fba50 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:33.284317 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-8d9fb0e8-8953-44be-b33b-4fb04df4a8ae req-edc22fa6-c291-43c2-8b83-94d4c89fba50 service nova] Creating event network-changed:a2678fb1-a9fa-4f93-9241-80d9c1c2d9d1 for instance 89f5f23f-8580-46fa-accf-206b1141c301 on n-h1-861333-8 Oct 19 03:29:33.290198 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-8d9fb0e8-8953-44be-b33b-4fb04df4a8ae req-edc22fa6-c291-43c2-8b83-94d4c89fba50 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073659 Oct 19 03:29:33.294260 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1901/3883] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:29:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:29:33.360995 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7c9a2ab2-49a1-4c90-9e9d-a0d886f6f1a3 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:29:33.361672 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7c9a2ab2-49a1-4c90-9e9d-a0d886f6f1a3 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] [instance: cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:29:33.382340 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7c9a2ab2-49a1-4c90-9e9d-a0d886f6f1a3 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:33.382850 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7c9a2ab2-49a1-4c90-9e9d-a0d886f6f1a3 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:33.383293 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7c9a2ab2-49a1-4c90-9e9d-a0d886f6f1a3 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:33.384005 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7c9a2ab2-49a1-4c90-9e9d-a0d886f6f1a3 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:33.384465 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7c9a2ab2-49a1-4c90-9e9d-a0d886f6f1a3 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:33.384893 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7c9a2ab2-49a1-4c90-9e9d-a0d886f6f1a3 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:33.697143 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c9ec2e2a-7e05-4b9f-a230-d2f740a12c60 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:29:33.703932 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c9ec2e2a-7e05-4b9f-a230-d2f740a12c60 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: e13547eb-efb0-4153-8dec-a666d4e6349b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:29:33.725473 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c9ec2e2a-7e05-4b9f-a230-d2f740a12c60 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:33.733768 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c9ec2e2a-7e05-4b9f-a230-d2f740a12c60 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:33.734706 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c9ec2e2a-7e05-4b9f-a230-d2f740a12c60 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:33.737025 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c9ec2e2a-7e05-4b9f-a230-d2f740a12c60 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:33.737752 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c9ec2e2a-7e05-4b9f-a230-d2f740a12c60 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:33.739233 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c9ec2e2a-7e05-4b9f-a230-d2f740a12c60 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:33.889448 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7c9a2ab2-49a1-4c90-9e9d-a0d886f6f1a3 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:33.911271 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7c9a2ab2-49a1-4c90-9e9d-a0d886f6f1a3 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:33.914901 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7c9a2ab2-49a1-4c90-9e9d-a0d886f6f1a3 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:33.916379 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7c9a2ab2-49a1-4c90-9e9d-a0d886f6f1a3 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] 10.222.0.52 "GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95" status: 200 len: 2757 microversion: 2.42 time: 0.559805 Oct 19 03:29:33.923447 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1983/3884] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:29:33 2022] GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 => generated 2757 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:29:33.943650 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-32eef264-481d-4d1d-ba97-1446e66c1ab9 tempest-VolumesGetTestJSON-1059602706 tempest-VolumesGetTestJSON-1059602706-project] Calling method '.version_select at 0x7fc12bf340d0>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:29:34.042892 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-32eef264-481d-4d1d-ba97-1446e66c1ab9 tempest-VolumesGetTestJSON-1059602706 tempest-VolumesGetTestJSON-1059602706-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/73cc4419-40df-43cd-8671-7138d1e8c962" status: 200 len: 352 microversion: 2.1 time: 0.118235 Oct 19 03:29:34.051945 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1984/3885] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Oct 19 03:29:33 2022] GET /compute/v2.1/os-volumes/73cc4419-40df-43cd-8671-7138d1e8c962 => generated 352 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:29:34.063011 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-59e4af4a-41ce-4ca1-8443-b0676f9b4774 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:29:34.063011 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-59e4af4a-41ce-4ca1-8443-b0676f9b4774 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 89f5f23f-8580-46fa-accf-206b1141c301] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:29:34.075549 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-59e4af4a-41ce-4ca1-8443-b0676f9b4774 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:34.076327 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-59e4af4a-41ce-4ca1-8443-b0676f9b4774 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:34.076990 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-59e4af4a-41ce-4ca1-8443-b0676f9b4774 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:34.080774 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-59e4af4a-41ce-4ca1-8443-b0676f9b4774 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:34.081475 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-59e4af4a-41ce-4ca1-8443-b0676f9b4774 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:34.082292 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-59e4af4a-41ce-4ca1-8443-b0676f9b4774 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:34.529905 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c9ec2e2a-7e05-4b9f-a230-d2f740a12c60 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2b0581ad4e4c9787bef838c81870a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dfe251b1e046a995b8ec302cb2ffa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:34.549035 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c9ec2e2a-7e05-4b9f-a230-d2f740a12c60 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "GET /compute/v2.1/servers/e13547eb-efb0-4153-8dec-a666d4e6349b" status: 200 len: 1517 microversion: 2.1 time: 0.860153 Oct 19 03:29:34.549964 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1902/3886] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:29:33 2022] GET /compute/v2.1/servers/e13547eb-efb0-4153-8dec-a666d4e6349b => generated 1517 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:29:34.556294 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-dc132117-230a-4d73-8228-dd73f0f0a603 tempest-VolumesGetTestJSON-1059602706 tempest-VolumesGetTestJSON-1059602706-project] Calling method '.version_select at 0x7fc12bf5d280>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:29:34.670123 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-dc132117-230a-4d73-8228-dd73f0f0a603 tempest-VolumesGetTestJSON-1059602706 tempest-VolumesGetTestJSON-1059602706-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/73cc4419-40df-43cd-8671-7138d1e8c962" status: 200 len: 352 microversion: 2.1 time: 0.118770 Oct 19 03:29:34.679413 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1903/3887] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Oct 19 03:29:34 2022] GET /compute/v2.1/os-volumes/73cc4419-40df-43cd-8671-7138d1e8c962 => generated 352 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:29:34.686465 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ae5edffc-30b4-4e66-8c43-7898ab3e5e64 tempest-VolumesGetTestJSON-1059602706 tempest-VolumesGetTestJSON-1059602706-project] Calling method '.version_select at 0x7fc12bf5d310>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:29:34.770155 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-59e4af4a-41ce-4ca1-8443-b0676f9b4774 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:34.783762 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-59e4af4a-41ce-4ca1-8443-b0676f9b4774 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301" status: 200 len: 1198 microversion: 2.1 time: 0.728379 Oct 19 03:29:34.785125 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1985/3888] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:29:34 2022] GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301 => generated 1198 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:29:34.957144 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a6c23023-ca6b-4931-b0b5-dc83d6c63374 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:29:34.958580 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a6c23023-ca6b-4931-b0b5-dc83d6c63374 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] [instance: cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:29:34.977615 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a6c23023-ca6b-4931-b0b5-dc83d6c63374 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:34.979208 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a6c23023-ca6b-4931-b0b5-dc83d6c63374 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:34.981033 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a6c23023-ca6b-4931-b0b5-dc83d6c63374 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:34.983801 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a6c23023-ca6b-4931-b0b5-dc83d6c63374 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:34.984708 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a6c23023-ca6b-4931-b0b5-dc83d6c63374 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:34.985540 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a6c23023-ca6b-4931-b0b5-dc83d6c63374 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:34.996600 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ae5edffc-30b4-4e66-8c43-7898ab3e5e64 tempest-VolumesGetTestJSON-1059602706 tempest-VolumesGetTestJSON-1059602706-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/73cc4419-40df-43cd-8671-7138d1e8c962" status: 202 len: 0 microversion: 2.1 time: 0.311188 Oct 19 03:29:34.996600 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1904/3889] 10.222.0.52 () {58 vars in 1248 bytes} [Wed Oct 19 03:29:34 2022] DELETE /compute/v2.1/os-volumes/73cc4419-40df-43cd-8671-7138d1e8c962 => generated 0 bytes in 313 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:29:35.005188 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-118c9618-63ae-4577-897b-b519d60b24a6 tempest-VolumesGetTestJSON-1059602706 tempest-VolumesGetTestJSON-1059602706-project] Calling method '.version_select at 0x7fc12bfe9af0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:29:35.164553 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-118c9618-63ae-4577-897b-b519d60b24a6 tempest-VolumesGetTestJSON-1059602706 tempest-VolumesGetTestJSON-1059602706-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/73cc4419-40df-43cd-8671-7138d1e8c962" status: 200 len: 351 microversion: 2.1 time: 0.163085 Oct 19 03:29:35.165997 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1905/3890] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Oct 19 03:29:35 2022] GET /compute/v2.1/os-volumes/73cc4419-40df-43cd-8671-7138d1e8c962 => generated 351 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:29:35.447021 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a6c23023-ca6b-4931-b0b5-dc83d6c63374 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:35.465171 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a6c23023-ca6b-4931-b0b5-dc83d6c63374 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:35.469139 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a6c23023-ca6b-4931-b0b5-dc83d6c63374 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:35.484952 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a6c23023-ca6b-4931-b0b5-dc83d6c63374 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] 10.222.0.52 "GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95" status: 200 len: 2710 microversion: 2.42 time: 0.520736 Oct 19 03:29:35.484952 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1986/3891] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:29:34 2022] GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 => generated 2710 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:29:35.576327 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-df93af6c-972a-4551-bea8-16c7a17fd6d2 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:29:35.576327 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-df93af6c-972a-4551-bea8-16c7a17fd6d2 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: e13547eb-efb0-4153-8dec-a666d4e6349b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:29:35.615005 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-df93af6c-972a-4551-bea8-16c7a17fd6d2 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:35.615509 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-df93af6c-972a-4551-bea8-16c7a17fd6d2 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:35.625671 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-df93af6c-972a-4551-bea8-16c7a17fd6d2 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:35.629072 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-df93af6c-972a-4551-bea8-16c7a17fd6d2 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:35.630849 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-df93af6c-972a-4551-bea8-16c7a17fd6d2 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:35.631292 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-df93af6c-972a-4551-bea8-16c7a17fd6d2 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:35.720370 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-06730920-03c5-4582-b5ca-574c0bc8e320 req-d611a406-7ecc-4db2-8bd2-e3413f049081 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95", "name": "network-vif-deleted", "tag": "65396b7f-6d0e-408a-b3e0-4a8c18d5caa3"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:29:35.748364 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-06730920-03c5-4582-b5ca-574c0bc8e320 req-d611a406-7ecc-4db2-8bd2-e3413f049081 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:35.748859 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-06730920-03c5-4582-b5ca-574c0bc8e320 req-d611a406-7ecc-4db2-8bd2-e3413f049081 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:35.759347 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-06730920-03c5-4582-b5ca-574c0bc8e320 req-d611a406-7ecc-4db2-8bd2-e3413f049081 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:35.813672 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-06730920-03c5-4582-b5ca-574c0bc8e320 req-d611a406-7ecc-4db2-8bd2-e3413f049081 service nova] Creating event network-vif-deleted:65396b7f-6d0e-408a-b3e0-4a8c18d5caa3 for instance cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 on n-h2-861333-8 Oct 19 03:29:35.857122 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-06730920-03c5-4582-b5ca-574c0bc8e320 req-d611a406-7ecc-4db2-8bd2-e3413f049081 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142596 Oct 19 03:29:35.857769 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1987/3892] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:29:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:29:35.890365 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-003c64ef-89d2-4e59-87c7-ece280ed429d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:29:35.893745 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-003c64ef-89d2-4e59-87c7-ece280ed429d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 89f5f23f-8580-46fa-accf-206b1141c301] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:29:35.928066 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-003c64ef-89d2-4e59-87c7-ece280ed429d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:35.928570 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-003c64ef-89d2-4e59-87c7-ece280ed429d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:35.942620 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-003c64ef-89d2-4e59-87c7-ece280ed429d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:35.944155 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-003c64ef-89d2-4e59-87c7-ece280ed429d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:35.944644 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-003c64ef-89d2-4e59-87c7-ece280ed429d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:35.950963 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-003c64ef-89d2-4e59-87c7-ece280ed429d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:36.543838 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-df93af6c-972a-4551-bea8-16c7a17fd6d2 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2b0581ad4e4c9787bef838c81870a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dfe251b1e046a995b8ec302cb2ffa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:36.581413 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-df93af6c-972a-4551-bea8-16c7a17fd6d2 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "GET /compute/v2.1/servers/e13547eb-efb0-4153-8dec-a666d4e6349b" status: 200 len: 1517 microversion: 2.1 time: 1.013072 Oct 19 03:29:36.587141 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1906/3893] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:29:35 2022] GET /compute/v2.1/servers/e13547eb-efb0-4153-8dec-a666d4e6349b => generated 1517 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:29:36.598809 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-39a6d2e0-f163-4058-bb6a-656ad25724de tempest-VolumesGetTestJSON-1059602706 tempest-VolumesGetTestJSON-1059602706-project] Calling method '.version_select at 0x7fc12bfe9670>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:29:36.676112 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-003c64ef-89d2-4e59-87c7-ece280ed429d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:36.694836 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-003c64ef-89d2-4e59-87c7-ece280ed429d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301" status: 200 len: 1198 microversion: 2.1 time: 0.828647 Oct 19 03:29:36.698969 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1988/3894] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:29:35 2022] GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301 => generated 1198 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:29:36.728169 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3b0df4a9-b452-485a-9a31-e490ad08c30b tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:29:36.741484 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-39a6d2e0-f163-4058-bb6a-656ad25724de tempest-VolumesGetTestJSON-1059602706 tempest-VolumesGetTestJSON-1059602706-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/73cc4419-40df-43cd-8671-7138d1e8c962" status: 200 len: 351 microversion: 2.1 time: 0.152991 Oct 19 03:29:36.742943 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-3b0df4a9-b452-485a-9a31-e490ad08c30b tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] [instance: cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:29:36.751349 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1907/3895] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Oct 19 03:29:36 2022] GET /compute/v2.1/os-volumes/73cc4419-40df-43cd-8671-7138d1e8c962 => generated 351 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:29:36.773643 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3b0df4a9-b452-485a-9a31-e490ad08c30b tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:36.776296 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3b0df4a9-b452-485a-9a31-e490ad08c30b tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:36.777697 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3b0df4a9-b452-485a-9a31-e490ad08c30b tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:36.781966 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3b0df4a9-b452-485a-9a31-e490ad08c30b tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:36.784517 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3b0df4a9-b452-485a-9a31-e490ad08c30b tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:36.786486 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3b0df4a9-b452-485a-9a31-e490ad08c30b tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:37.324458 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-3b0df4a9-b452-485a-9a31-e490ad08c30b tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:37.339567 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-3b0df4a9-b452-485a-9a31-e490ad08c30b tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:37.348519 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-3b0df4a9-b452-485a-9a31-e490ad08c30b tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:37.352253 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-3b0df4a9-b452-485a-9a31-e490ad08c30b tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] 10.222.0.52 "GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95" status: 200 len: 2418 microversion: 2.42 time: 0.652017 Oct 19 03:29:37.356969 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1989/3896] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:29:36 2022] GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 => generated 2418 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:29:37.611972 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-fd6f4122-7a85-4de2-9166-344d9c72830e tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:29:37.613017 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-fd6f4122-7a85-4de2-9166-344d9c72830e tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: e13547eb-efb0-4153-8dec-a666d4e6349b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:29:37.634769 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fd6f4122-7a85-4de2-9166-344d9c72830e tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:37.635307 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fd6f4122-7a85-4de2-9166-344d9c72830e tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:37.635685 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fd6f4122-7a85-4de2-9166-344d9c72830e tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:37.641450 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fd6f4122-7a85-4de2-9166-344d9c72830e tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:37.641958 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fd6f4122-7a85-4de2-9166-344d9c72830e tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:37.642400 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fd6f4122-7a85-4de2-9166-344d9c72830e tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:37.723918 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c09d74ce-9ec9-4b13-b144-06044a33fe3d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:29:37.724751 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c09d74ce-9ec9-4b13-b144-06044a33fe3d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 89f5f23f-8580-46fa-accf-206b1141c301] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:29:37.740016 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c09d74ce-9ec9-4b13-b144-06044a33fe3d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:37.740423 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c09d74ce-9ec9-4b13-b144-06044a33fe3d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:37.741767 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c09d74ce-9ec9-4b13-b144-06044a33fe3d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:37.751945 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c09d74ce-9ec9-4b13-b144-06044a33fe3d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:37.752440 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c09d74ce-9ec9-4b13-b144-06044a33fe3d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:37.752881 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c09d74ce-9ec9-4b13-b144-06044a33fe3d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:38.712053 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-fd6f4122-7a85-4de2-9166-344d9c72830e tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2b0581ad4e4c9787bef838c81870a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dfe251b1e046a995b8ec302cb2ffa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:38.721185 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-fd6f4122-7a85-4de2-9166-344d9c72830e tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "GET /compute/v2.1/servers/e13547eb-efb0-4153-8dec-a666d4e6349b" status: 200 len: 1517 microversion: 2.1 time: 1.113975 Oct 19 03:29:38.725246 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1908/3897] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:29:37 2022] GET /compute/v2.1/servers/e13547eb-efb0-4153-8dec-a666d4e6349b => generated 1517 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:29:38.746750 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a10c4951-20d5-449d-8346-daef16c01124 tempest-VolumesGetTestJSON-1059602706 tempest-VolumesGetTestJSON-1059602706-project] Calling method '.version_select at 0x7fc12bfe9ee0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:29:38.920738 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c09d74ce-9ec9-4b13-b144-06044a33fe3d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:38.957077 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c09d74ce-9ec9-4b13-b144-06044a33fe3d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301" status: 200 len: 1198 microversion: 2.1 time: 1.239244 Oct 19 03:29:38.998681 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1990/3898] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:29:37 2022] GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301 => generated 1198 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:29:39.010468 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a10c4951-20d5-449d-8346-daef16c01124 tempest-VolumesGetTestJSON-1059602706 tempest-VolumesGetTestJSON-1059602706-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/73cc4419-40df-43cd-8671-7138d1e8c962" status: 200 len: 351 microversion: 2.1 time: 0.283444 Oct 19 03:29:39.011121 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1909/3899] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Oct 19 03:29:38 2022] GET /compute/v2.1/os-volumes/73cc4419-40df-43cd-8671-7138d1e8c962 => generated 351 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:29:39.012432 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-309d1045-0465-497d-afb6-6f3a0cd3de6d req-37d4af48-fa31-4272-8c08-13df0818af42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95", "name": "network-vif-deleted", "tag": "7131b08f-dd0e-40a5-b85e-19128faf4efc"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:29:39.017488 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0c4cb710-a597-43bd-ab51-8f47265ea8d5 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:29:39.018114 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0c4cb710-a597-43bd-ab51-8f47265ea8d5 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] [instance: cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:29:39.034751 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-309d1045-0465-497d-afb6-6f3a0cd3de6d req-37d4af48-fa31-4272-8c08-13df0818af42 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:39.036111 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-309d1045-0465-497d-afb6-6f3a0cd3de6d req-37d4af48-fa31-4272-8c08-13df0818af42 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:39.037165 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-309d1045-0465-497d-afb6-6f3a0cd3de6d req-37d4af48-fa31-4272-8c08-13df0818af42 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:39.049684 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0c4cb710-a597-43bd-ab51-8f47265ea8d5 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:39.056042 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0c4cb710-a597-43bd-ab51-8f47265ea8d5 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:39.057896 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0c4cb710-a597-43bd-ab51-8f47265ea8d5 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:39.064780 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0c4cb710-a597-43bd-ab51-8f47265ea8d5 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:39.065329 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0c4cb710-a597-43bd-ab51-8f47265ea8d5 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:39.065816 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0c4cb710-a597-43bd-ab51-8f47265ea8d5 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:39.066424 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-309d1045-0465-497d-afb6-6f3a0cd3de6d req-37d4af48-fa31-4272-8c08-13df0818af42 service nova] Creating event network-vif-deleted:7131b08f-dd0e-40a5-b85e-19128faf4efc for instance cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 on n-h2-861333-8 Oct 19 03:29:39.079015 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-309d1045-0465-497d-afb6-6f3a0cd3de6d req-37d4af48-fa31-4272-8c08-13df0818af42 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076963 Oct 19 03:29:39.080721 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1991/3900] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:29:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:29:39.770976 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2818b4ed-70b7-4007-9ad5-a4dcb2eb7b7b tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:29:39.773798 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-2818b4ed-70b7-4007-9ad5-a4dcb2eb7b7b tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: e13547eb-efb0-4153-8dec-a666d4e6349b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:29:39.811170 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2818b4ed-70b7-4007-9ad5-a4dcb2eb7b7b tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:39.812147 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2818b4ed-70b7-4007-9ad5-a4dcb2eb7b7b tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:39.814801 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2818b4ed-70b7-4007-9ad5-a4dcb2eb7b7b tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:39.823591 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2818b4ed-70b7-4007-9ad5-a4dcb2eb7b7b tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:39.823591 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2818b4ed-70b7-4007-9ad5-a4dcb2eb7b7b tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:39.823591 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2818b4ed-70b7-4007-9ad5-a4dcb2eb7b7b tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:40.288791 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0c4cb710-a597-43bd-ab51-8f47265ea8d5 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:40.302898 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-2818b4ed-70b7-4007-9ad5-a4dcb2eb7b7b tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2b0581ad4e4c9787bef838c81870a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dfe251b1e046a995b8ec302cb2ffa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:40.308301 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0c4cb710-a597-43bd-ab51-8f47265ea8d5 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:40.310020 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0c4cb710-a597-43bd-ab51-8f47265ea8d5 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:40.311302 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0c4cb710-a597-43bd-ab51-8f47265ea8d5 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] 10.222.0.52 "GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95" status: 200 len: 2324 microversion: 2.42 time: 1.299255 Oct 19 03:29:40.317180 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1910/3901] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:29:39 2022] GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 => generated 2324 bytes in 1305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:29:40.321103 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2818b4ed-70b7-4007-9ad5-a4dcb2eb7b7b tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "GET /compute/v2.1/servers/e13547eb-efb0-4153-8dec-a666d4e6349b" status: 200 len: 1517 microversion: 2.1 time: 0.551260 Oct 19 03:29:40.321992 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1992/3902] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:29:39 2022] GET /compute/v2.1/servers/e13547eb-efb0-4153-8dec-a666d4e6349b => generated 1517 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:29:40.334502 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d0589f7e-7c29-495c-9bab-e62af2928fd9 tempest-VolumesGetTestJSON-1059602706 tempest-VolumesGetTestJSON-1059602706-project] Calling method '.version_select at 0x7fc12bf53040>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:29:40.343031 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c47f6fa8-8c03-4eae-8b41-2b8bec4a6c22 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:29:40.344213 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c47f6fa8-8c03-4eae-8b41-2b8bec4a6c22 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 89f5f23f-8580-46fa-accf-206b1141c301] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:29:40.363407 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c47f6fa8-8c03-4eae-8b41-2b8bec4a6c22 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:40.370250 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c47f6fa8-8c03-4eae-8b41-2b8bec4a6c22 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:40.372684 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c47f6fa8-8c03-4eae-8b41-2b8bec4a6c22 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:40.377246 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c47f6fa8-8c03-4eae-8b41-2b8bec4a6c22 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:40.377746 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c47f6fa8-8c03-4eae-8b41-2b8bec4a6c22 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:40.378354 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c47f6fa8-8c03-4eae-8b41-2b8bec4a6c22 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:40.425950 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-d0589f7e-7c29-495c-9bab-e62af2928fd9 tempest-VolumesGetTestJSON-1059602706 tempest-VolumesGetTestJSON-1059602706-project] HTTP exception thrown: Volume 73cc4419-40df-43cd-8671-7138d1e8c962 could not be found. Oct 19 03:29:40.431986 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d0589f7e-7c29-495c-9bab-e62af2928fd9 tempest-VolumesGetTestJSON-1059602706 tempest-VolumesGetTestJSON-1059602706-project] Request method failure captured: Oct 19 03:29:40.431986 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/os-volumes/73cc4419-40df-43cd-8671-7138d1e8c962 HTTP/1.1 Oct 19 03:29:40.431986 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:29:40.431986 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:29:40.431986 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:29:40.431986 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:29:40.431986 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:29:40.431986 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:29:40.431986 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:29:40.431986 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:29:40.431986 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT28ZOEDvd0amLl-URj8D_rBnPnJfvgxAO4VipVmd98awK0Xnt9cUFSkIejpAYotcSmQtieShxsfbwF3YDcc8URRIxschoGCoJmtUa7XOdmx09-R1QVRDmxjx1sbTZ-DSyxJ0814vabKwpSKhpyY5yo6vpRFKADy28VG-xWjti56wGnE Oct 19 03:29:40.431986 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:29:40.431986 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:29:40.431986 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:29:40.431986 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:29:40.431986 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:29:40.431986 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:29:40.431986 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 9a9f16e2655044158933475592b4a60d Oct 19 03:29:40.431986 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-VolumesGetTestJSON-1059602706 Oct 19 03:29:40.431986 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:29:40.431986 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:29:40.433673 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9a9f16e2655044158933475592b4a60d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9a9f16e2655044158933475592b4a60d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9a9f16e2655044158933475592b4a60d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9a9f16e2655044158933475592b4a60d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:29:40.433673 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-VolumesGetTestJSON-1059602706 Oct 19 03:29:40.433673 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 9a9f16e2655044158933475592b4a60d Oct 19 03:29:40.433673 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-VolumesGetTestJSON-1059602706 Oct 19 03:29:40.433673 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-VolumesGetTestJSON-1059602706-project Oct 19 03:29:40.433673 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:29:40.433673 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:29:40.433673 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 0b66cdb884a147428ff0b37a15c6fb05 Oct 19 03:29:40.433673 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-VolumesGetTestJSON-1059602706-project Oct 19 03:29:40.433673 n-d-861333-8 devstack@n-api.service[121135]: method: Oct 19 03:29:40.433673 n-d-861333-8 devstack@n-api.service[121135]: exception: Volume 73cc4419-40df-43cd-8671-7138d1e8c962 could not be found. Oct 19 03:29:40.433673 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '73cc4419-40df-43cd-8671-7138d1e8c962'} Oct 19 03:29:40.433673 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:29:40.434603 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:29:40.434603 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 03:29:40.434603 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 03:29:40.434603 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 19 03:29:40.434603 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 19 03:29:40.434603 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 19 03:29:40.434603 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 19 03:29:40.434603 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 19 03:29:40.434603 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 19 03:29:40.434603 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 19 03:29:40.434603 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 19 03:29:40.434603 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 03:29:40.434603 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 03:29:40.434603 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 03:29:40.434603 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 03:29:40.434603 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 73cc4419-40df-43cd-8671-7138d1e8c962 could not be found. (HTTP 404) (Request-ID: req-0928a6ff-105f-4821-a3cc-a20a7a014403) Oct 19 03:29:40.434603 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:29:40.434603 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:29:40.434603 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:29:40.435959 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:29:40.435959 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 19 03:29:40.435959 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 19 03:29:40.435959 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 19 03:29:40.435959 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 19 03:29:40.435959 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 19 03:29:40.435959 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 19 03:29:40.435959 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 19 03:29:40.435959 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 19 03:29:40.435959 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 03:29:40.435959 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 03:29:40.435959 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 19 03:29:40.435959 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 19 03:29:40.435959 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 19 03:29:40.435959 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 19 03:29:40.435959 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 19 03:29:40.435959 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 19 03:29:40.435959 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 19 03:29:40.435959 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 19 03:29:40.438956 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 03:29:40.438956 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 03:29:40.438956 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 03:29:40.438956 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 03:29:40.438956 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 73cc4419-40df-43cd-8671-7138d1e8c962 could not be found. Oct 19 03:29:40.438956 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:29:40.438956 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:29:40.438956 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:29:40.438956 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:29:40.438956 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:29:40.438956 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:29:40.438956 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:29:40.438956 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:29:40.438956 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 03:29:40.438956 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 03:29:40.438956 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:29:40.438956 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:29:40.438956 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 19 03:29:40.438956 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:29:40.441798 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 73cc4419-40df-43cd-8671-7138d1e8c962 could not be found. Oct 19 03:29:40.441798 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:29:40.441798 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:29:40.441798 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:29:40.441798 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:29:40.441798 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:29:40.441798 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:29:40.441798 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:29:40.441798 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:29:40.441798 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 73cc4419-40df-43cd-8671-7138d1e8c962 could not be found. Oct 19 03:29:40.441798 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:29:40.444528 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d0589f7e-7c29-495c-9bab-e62af2928fd9 tempest-VolumesGetTestJSON-1059602706 tempest-VolumesGetTestJSON-1059602706-project] Returning 404 to user: Volume 73cc4419-40df-43cd-8671-7138d1e8c962 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:29:40.445788 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d0589f7e-7c29-495c-9bab-e62af2928fd9 tempest-VolumesGetTestJSON-1059602706 tempest-VolumesGetTestJSON-1059602706-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/73cc4419-40df-43cd-8671-7138d1e8c962" status: 404 len: 109 microversion: 2.1 time: 0.115364 Oct 19 03:29:40.448494 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1993/3903] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Oct 19 03:29:40 2022] GET /compute/v2.1/os-volumes/73cc4419-40df-43cd-8671-7138d1e8c962 => generated 109 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:29:40.810837 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c47f6fa8-8c03-4eae-8b41-2b8bec4a6c22 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:40.823088 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c47f6fa8-8c03-4eae-8b41-2b8bec4a6c22 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301" status: 200 len: 1198 microversion: 2.1 time: 0.489893 Oct 19 03:29:40.841115 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1911/3904] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:29:40 2022] GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301 => generated 1198 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:29:41.156513 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-7b3aaaab-39d4-4656-91b5-8de55950f8d7 req-9490af84-294d-4b34-9307-a00e8262ee25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95", "name": "network-vif-deleted", "tag": "475eb265-32ca-40db-846e-3d83be38943b"}, {"server_uuid": "cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95", "name": "network-vif-deleted", "tag": "8a375b84-11bb-4f0c-9583-6d7d29938112"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:29:41.184231 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-7b3aaaab-39d4-4656-91b5-8de55950f8d7 req-9490af84-294d-4b34-9307-a00e8262ee25 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:41.184858 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-7b3aaaab-39d4-4656-91b5-8de55950f8d7 req-9490af84-294d-4b34-9307-a00e8262ee25 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:41.185157 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-7b3aaaab-39d4-4656-91b5-8de55950f8d7 req-9490af84-294d-4b34-9307-a00e8262ee25 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:41.227094 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-7b3aaaab-39d4-4656-91b5-8de55950f8d7 req-9490af84-294d-4b34-9307-a00e8262ee25 service nova] Creating event network-vif-deleted:475eb265-32ca-40db-846e-3d83be38943b for instance cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 on n-h2-861333-8 Oct 19 03:29:41.234165 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-7b3aaaab-39d4-4656-91b5-8de55950f8d7 req-9490af84-294d-4b34-9307-a00e8262ee25 service nova] Creating event network-vif-deleted:8a375b84-11bb-4f0c-9583-6d7d29938112 for instance cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 on n-h2-861333-8 Oct 19 03:29:41.246096 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-7b3aaaab-39d4-4656-91b5-8de55950f8d7 req-9490af84-294d-4b34-9307-a00e8262ee25 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.097208 Oct 19 03:29:41.248680 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1994/3905] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:29:41 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:29:41.349046 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1592830c-b5cd-404d-bfb3-b32a809dbdd6 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:29:41.349693 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1592830c-b5cd-404d-bfb3-b32a809dbdd6 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: e13547eb-efb0-4153-8dec-a666d4e6349b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:29:41.351651 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-99bb0070-511d-4124-9d1a-4af9dffc5763 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:29:41.352939 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-99bb0070-511d-4124-9d1a-4af9dffc5763 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] [instance: cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:29:41.366952 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-99bb0070-511d-4124-9d1a-4af9dffc5763 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:41.369204 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-99bb0070-511d-4124-9d1a-4af9dffc5763 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:41.372546 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-99bb0070-511d-4124-9d1a-4af9dffc5763 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:41.375170 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-99bb0070-511d-4124-9d1a-4af9dffc5763 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:41.375321 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1592830c-b5cd-404d-bfb3-b32a809dbdd6 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:41.375685 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1592830c-b5cd-404d-bfb3-b32a809dbdd6 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:41.376105 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-99bb0070-511d-4124-9d1a-4af9dffc5763 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:41.376235 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1592830c-b5cd-404d-bfb3-b32a809dbdd6 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:41.377826 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-99bb0070-511d-4124-9d1a-4af9dffc5763 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:41.397856 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1592830c-b5cd-404d-bfb3-b32a809dbdd6 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:41.401646 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1592830c-b5cd-404d-bfb3-b32a809dbdd6 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:41.410899 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1592830c-b5cd-404d-bfb3-b32a809dbdd6 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:41.825926 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-99bb0070-511d-4124-9d1a-4af9dffc5763 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:41.845618 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-99bb0070-511d-4124-9d1a-4af9dffc5763 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:41.846985 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-99bb0070-511d-4124-9d1a-4af9dffc5763 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:41.875727 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-99bb0070-511d-4124-9d1a-4af9dffc5763 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] 10.222.0.52 "GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95" status: 200 len: 1604 microversion: 2.42 time: 0.525892 Oct 19 03:29:41.879527 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1995/3906] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:29:41 2022] GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 => generated 1604 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:29:41.892610 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9a0b7fbe-7c5f-4ccc-9785-dab271b8ae52 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:29:41.896123 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9a0b7fbe-7c5f-4ccc-9785-dab271b8ae52 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 89f5f23f-8580-46fa-accf-206b1141c301] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:29:41.917715 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9a0b7fbe-7c5f-4ccc-9785-dab271b8ae52 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:41.918693 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9a0b7fbe-7c5f-4ccc-9785-dab271b8ae52 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:41.919259 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9a0b7fbe-7c5f-4ccc-9785-dab271b8ae52 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:41.928559 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9a0b7fbe-7c5f-4ccc-9785-dab271b8ae52 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:41.929332 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9a0b7fbe-7c5f-4ccc-9785-dab271b8ae52 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:41.934070 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9a0b7fbe-7c5f-4ccc-9785-dab271b8ae52 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:42.481899 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-1592830c-b5cd-404d-bfb3-b32a809dbdd6 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2b0581ad4e4c9787bef838c81870a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dfe251b1e046a995b8ec302cb2ffa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:42.495385 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1592830c-b5cd-404d-bfb3-b32a809dbdd6 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "GET /compute/v2.1/servers/e13547eb-efb0-4153-8dec-a666d4e6349b" status: 200 len: 1523 microversion: 2.1 time: 1.149530 Oct 19 03:29:42.497282 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1912/3907] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:29:41 2022] GET /compute/v2.1/servers/e13547eb-efb0-4153-8dec-a666d4e6349b => generated 1523 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:29:42.689020 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-cf8ad205-dc2e-417e-bfaa-af4def6a4984 req-3d6ec9f5-bff4-4bd5-9248-23ead88a0392 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e13547eb-efb0-4153-8dec-a666d4e6349b", "name": "network-vif-unplugged", "status": "completed", "tag": "c2a6f65f-751d-40d2-9e77-e8429e7d45d4"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:29:42.712462 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-cf8ad205-dc2e-417e-bfaa-af4def6a4984 req-3d6ec9f5-bff4-4bd5-9248-23ead88a0392 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:42.713708 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-cf8ad205-dc2e-417e-bfaa-af4def6a4984 req-3d6ec9f5-bff4-4bd5-9248-23ead88a0392 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:42.715273 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-cf8ad205-dc2e-417e-bfaa-af4def6a4984 req-3d6ec9f5-bff4-4bd5-9248-23ead88a0392 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:42.755188 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-cf8ad205-dc2e-417e-bfaa-af4def6a4984 req-3d6ec9f5-bff4-4bd5-9248-23ead88a0392 service nova] Creating event network-vif-unplugged:c2a6f65f-751d-40d2-9e77-e8429e7d45d4 for instance e13547eb-efb0-4153-8dec-a666d4e6349b on n-h1-861333-8 Oct 19 03:29:42.757285 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-9a0b7fbe-7c5f-4ccc-9785-dab271b8ae52 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:42.769213 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-cf8ad205-dc2e-417e-bfaa-af4def6a4984 req-3d6ec9f5-bff4-4bd5-9248-23ead88a0392 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.085805 Oct 19 03:29:42.771403 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1913/3908] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:29:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:29:42.772577 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9a0b7fbe-7c5f-4ccc-9785-dab271b8ae52 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301" status: 200 len: 1198 microversion: 2.1 time: 0.891761 Oct 19 03:29:42.774284 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1996/3909] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:29:41 2022] GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301 => generated 1198 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:29:42.914936 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-327df74f-f7da-4474-a828-88f0166fc0af tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:29:42.915857 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-327df74f-f7da-4474-a828-88f0166fc0af tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] [instance: cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:29:42.934166 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-327df74f-f7da-4474-a828-88f0166fc0af tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:42.934658 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-327df74f-f7da-4474-a828-88f0166fc0af tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:42.935150 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-327df74f-f7da-4474-a828-88f0166fc0af tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:42.935791 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-327df74f-f7da-4474-a828-88f0166fc0af tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:42.936234 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-327df74f-f7da-4474-a828-88f0166fc0af tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:42.945699 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-327df74f-f7da-4474-a828-88f0166fc0af tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:43.094755 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-327df74f-f7da-4474-a828-88f0166fc0af tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:43.106635 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-327df74f-f7da-4474-a828-88f0166fc0af tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:43.107982 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-327df74f-f7da-4474-a828-88f0166fc0af tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:43.121291 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-327df74f-f7da-4474-a828-88f0166fc0af tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] 10.222.0.52 "GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95" status: 200 len: 1604 microversion: 2.42 time: 0.201888 Oct 19 03:29:43.134260 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1914/3910] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:29:42 2022] GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 => generated 1604 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:29:43.524631 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-8901ba15-7553-4fca-b78e-73a297d76fbf tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:29:43.525268 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-8901ba15-7553-4fca-b78e-73a297d76fbf tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: e13547eb-efb0-4153-8dec-a666d4e6349b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:29:43.540464 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8901ba15-7553-4fca-b78e-73a297d76fbf tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:43.540960 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8901ba15-7553-4fca-b78e-73a297d76fbf tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:43.541672 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8901ba15-7553-4fca-b78e-73a297d76fbf tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:43.542778 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8901ba15-7553-4fca-b78e-73a297d76fbf tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:43.543416 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8901ba15-7553-4fca-b78e-73a297d76fbf tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:43.544021 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8901ba15-7553-4fca-b78e-73a297d76fbf tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:43.804805 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-eb05b0cc-2740-4643-9299-6690112ded43 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:29:43.810696 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-eb05b0cc-2740-4643-9299-6690112ded43 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 89f5f23f-8580-46fa-accf-206b1141c301] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:29:43.820150 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eb05b0cc-2740-4643-9299-6690112ded43 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:43.830624 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eb05b0cc-2740-4643-9299-6690112ded43 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:43.833872 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eb05b0cc-2740-4643-9299-6690112ded43 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:43.834876 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eb05b0cc-2740-4643-9299-6690112ded43 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:43.835817 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eb05b0cc-2740-4643-9299-6690112ded43 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:43.837316 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eb05b0cc-2740-4643-9299-6690112ded43 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:43.880385 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-8901ba15-7553-4fca-b78e-73a297d76fbf tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2b0581ad4e4c9787bef838c81870a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dfe251b1e046a995b8ec302cb2ffa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:43.905652 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-8901ba15-7553-4fca-b78e-73a297d76fbf tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "GET /compute/v2.1/servers/e13547eb-efb0-4153-8dec-a666d4e6349b" status: 200 len: 1523 microversion: 2.1 time: 0.374524 Oct 19 03:29:43.906652 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1997/3911] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:29:43 2022] GET /compute/v2.1/servers/e13547eb-efb0-4153-8dec-a666d4e6349b => generated 1523 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:29:44.150206 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ae3e5eec-cd9a-4f8e-ab8a-59ad8a96ef6b tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:29:44.150774 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ae3e5eec-cd9a-4f8e-ab8a-59ad8a96ef6b tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] [instance: cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:29:44.166916 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ae3e5eec-cd9a-4f8e-ab8a-59ad8a96ef6b tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:44.168245 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ae3e5eec-cd9a-4f8e-ab8a-59ad8a96ef6b tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:44.172448 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ae3e5eec-cd9a-4f8e-ab8a-59ad8a96ef6b tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:44.173056 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ae3e5eec-cd9a-4f8e-ab8a-59ad8a96ef6b tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:44.173850 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ae3e5eec-cd9a-4f8e-ab8a-59ad8a96ef6b tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:44.176646 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-eb05b0cc-2740-4643-9299-6690112ded43 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:44.177845 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ae3e5eec-cd9a-4f8e-ab8a-59ad8a96ef6b tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:44.185837 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-eb05b0cc-2740-4643-9299-6690112ded43 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301" status: 200 len: 1198 microversion: 2.1 time: 0.387400 Oct 19 03:29:44.204765 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1915/3912] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:29:43 2022] GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301 => generated 1198 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:29:44.318759 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-bc4264ca-3568-4414-89bf-cf8ac146f666 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:29:44.319468 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-bc4264ca-3568-4414-89bf-cf8ac146f666 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:29:44.335348 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bc4264ca-3568-4414-89bf-cf8ac146f666 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:44.343473 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bc4264ca-3568-4414-89bf-cf8ac146f666 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:44.343473 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bc4264ca-3568-4414-89bf-cf8ac146f666 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:44.346106 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bc4264ca-3568-4414-89bf-cf8ac146f666 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:44.353275 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bc4264ca-3568-4414-89bf-cf8ac146f666 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:44.405676 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bc4264ca-3568-4414-89bf-cf8ac146f666 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.054s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:44.410249 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ae3e5eec-cd9a-4f8e-ab8a-59ad8a96ef6b tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:44.429713 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ae3e5eec-cd9a-4f8e-ab8a-59ad8a96ef6b tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:44.439198 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ae3e5eec-cd9a-4f8e-ab8a-59ad8a96ef6b tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:44.450702 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ae3e5eec-cd9a-4f8e-ab8a-59ad8a96ef6b tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] 10.222.0.52 "GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95" status: 200 len: 1604 microversion: 2.42 time: 0.297354 Oct 19 03:29:44.465426 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1998/3913] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:29:44 2022] GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 => generated 1604 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:29:44.726994 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-bc4264ca-3568-4414-89bf-cf8ac146f666 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:44.736134 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-bc4264ca-3568-4414-89bf-cf8ac146f666 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1670 microversion: 2.1 time: 0.421757 Oct 19 03:29:44.757853 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1916/3914] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:29:44 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1670 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:29:44.772889 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-8159b77b-4ac0-4dde-9cce-09a5a81ef514 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-424278168"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:29:44.776651 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-8159b77b-4ac0-4dde-9cce-09a5a81ef514 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:29:44.808992 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8159b77b-4ac0-4dde-9cce-09a5a81ef514 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:44.813733 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8159b77b-4ac0-4dde-9cce-09a5a81ef514 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:44.814355 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8159b77b-4ac0-4dde-9cce-09a5a81ef514 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:44.815137 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8159b77b-4ac0-4dde-9cce-09a5a81ef514 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:44.815610 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8159b77b-4ac0-4dde-9cce-09a5a81ef514 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:44.816044 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8159b77b-4ac0-4dde-9cce-09a5a81ef514 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:44.908860 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=100 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:29:44.931689 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a7494a16-ed1e-4f26-93c9-f3415d9f6bc4 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:29:44.932287 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a7494a16-ed1e-4f26-93c9-f3415d9f6bc4 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: e13547eb-efb0-4153-8dec-a666d4e6349b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:29:44.936187 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:29:44.949952 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a7494a16-ed1e-4f26-93c9-f3415d9f6bc4 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:44.950385 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a7494a16-ed1e-4f26-93c9-f3415d9f6bc4 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:44.953881 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a7494a16-ed1e-4f26-93c9-f3415d9f6bc4 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:44.954729 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a7494a16-ed1e-4f26-93c9-f3415d9f6bc4 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:44.961180 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a7494a16-ed1e-4f26-93c9-f3415d9f6bc4 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:44.961627 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a7494a16-ed1e-4f26-93c9-f3415d9f6bc4 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:45.589606 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a7494a16-ed1e-4f26-93c9-f3415d9f6bc4 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2b0581ad4e4c9787bef838c81870a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dfe251b1e046a995b8ec302cb2ffa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:45.607336 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a7494a16-ed1e-4f26-93c9-f3415d9f6bc4 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "GET /compute/v2.1/servers/e13547eb-efb0-4153-8dec-a666d4e6349b" status: 200 len: 1523 microversion: 2.1 time: 0.678103 Oct 19 03:29:45.621153 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1917/3915] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:29:44 2022] GET /compute/v2.1/servers/e13547eb-efb0-4153-8dec-a666d4e6349b => generated 1523 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:29:45.640318 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-78b97f4e-bea3-48b0-88df-bd71fe2c0a5f tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:29:45.645226 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-78b97f4e-bea3-48b0-88df-bd71fe2c0a5f tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 89f5f23f-8580-46fa-accf-206b1141c301] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:29:45.665055 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-78b97f4e-bea3-48b0-88df-bd71fe2c0a5f tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:45.667916 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-78b97f4e-bea3-48b0-88df-bd71fe2c0a5f tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:45.668397 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-78b97f4e-bea3-48b0-88df-bd71fe2c0a5f tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:45.669161 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-78b97f4e-bea3-48b0-88df-bd71fe2c0a5f tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:45.674081 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-78b97f4e-bea3-48b0-88df-bd71fe2c0a5f tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:45.676567 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-78b97f4e-bea3-48b0-88df-bd71fe2c0a5f tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:45.688012 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-8159b77b-4ac0-4dde-9cce-09a5a81ef514 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "POST /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f/action" status: 202 len: 0 microversion: 2.1 time: 0.920794 Oct 19 03:29:45.691831 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 1999/3916] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:29:44 2022] POST /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f/action => generated 0 bytes in 922 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 19 03:29:45.696541 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-29fd2cce-f2d9-40b9-89b2-9b18ae40febc tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:29:45.700513 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-29fd2cce-f2d9-40b9-89b2-9b18ae40febc tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] [instance: cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:29:45.718965 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-29fd2cce-f2d9-40b9-89b2-9b18ae40febc tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:45.718965 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-29fd2cce-f2d9-40b9-89b2-9b18ae40febc tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:45.718965 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-29fd2cce-f2d9-40b9-89b2-9b18ae40febc tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:45.718965 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-29fd2cce-f2d9-40b9-89b2-9b18ae40febc tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:45.719455 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-29fd2cce-f2d9-40b9-89b2-9b18ae40febc tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:45.725187 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-29fd2cce-f2d9-40b9-89b2-9b18ae40febc tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:45.776752 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=100 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:29:45.957306 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-29fd2cce-f2d9-40b9-89b2-9b18ae40febc tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:45.968445 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-29fd2cce-f2d9-40b9-89b2-9b18ae40febc tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:45.987291 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-29fd2cce-f2d9-40b9-89b2-9b18ae40febc tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:45.995278 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-29fd2cce-f2d9-40b9-89b2-9b18ae40febc tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] 10.222.0.52 "GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95" status: 200 len: 1604 microversion: 2.42 time: 0.303763 Oct 19 03:29:45.996014 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2000/3917] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:29:45 2022] GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 => generated 1604 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:29:46.132014 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-78b97f4e-bea3-48b0-88df-bd71fe2c0a5f tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:46.145115 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-78b97f4e-bea3-48b0-88df-bd71fe2c0a5f tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301" status: 200 len: 1198 microversion: 2.1 time: 0.523440 Oct 19 03:29:46.159333 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1918/3918] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:29:45 2022] GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301 => generated 1198 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:29:46.262471 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-715da7ac-2f52-481e-9b81-4972c9449789 req-a33f2c70-0e00-4c7e-ab1f-ec34a903423c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89f5f23f-8580-46fa-accf-206b1141c301", "name": "network-vif-plugged", "status": "completed", "tag": "a2678fb1-a9fa-4f93-9241-80d9c1c2d9d1"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:29:46.289178 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-715da7ac-2f52-481e-9b81-4972c9449789 req-a33f2c70-0e00-4c7e-ab1f-ec34a903423c service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:46.296894 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-715da7ac-2f52-481e-9b81-4972c9449789 req-a33f2c70-0e00-4c7e-ab1f-ec34a903423c service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:46.302850 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-715da7ac-2f52-481e-9b81-4972c9449789 req-a33f2c70-0e00-4c7e-ab1f-ec34a903423c service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:46.340422 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-715da7ac-2f52-481e-9b81-4972c9449789 req-a33f2c70-0e00-4c7e-ab1f-ec34a903423c service nova] Creating event network-vif-plugged:a2678fb1-a9fa-4f93-9241-80d9c1c2d9d1 for instance 89f5f23f-8580-46fa-accf-206b1141c301 on n-h1-861333-8 Oct 19 03:29:46.356636 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-715da7ac-2f52-481e-9b81-4972c9449789 req-a33f2c70-0e00-4c7e-ab1f-ec34a903423c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108643 Oct 19 03:29:46.357999 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2001/3919] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:29:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:29:46.635313 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-eeac77a4-864a-4b01-9566-63d42c81c647 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:29:46.635934 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-eeac77a4-864a-4b01-9566-63d42c81c647 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: e13547eb-efb0-4153-8dec-a666d4e6349b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:29:46.657239 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eeac77a4-864a-4b01-9566-63d42c81c647 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:46.657918 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eeac77a4-864a-4b01-9566-63d42c81c647 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:46.658361 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eeac77a4-864a-4b01-9566-63d42c81c647 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:46.659069 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eeac77a4-864a-4b01-9566-63d42c81c647 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:46.665017 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eeac77a4-864a-4b01-9566-63d42c81c647 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:46.669919 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eeac77a4-864a-4b01-9566-63d42c81c647 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:47.031999 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0b491626-fd05-4b26-bd7e-c692dbf69f8b tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:29:47.062555 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0b491626-fd05-4b26-bd7e-c692dbf69f8b tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] [instance: cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:29:47.062555 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0b491626-fd05-4b26-bd7e-c692dbf69f8b tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:47.062555 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0b491626-fd05-4b26-bd7e-c692dbf69f8b tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:47.062555 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0b491626-fd05-4b26-bd7e-c692dbf69f8b tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:47.064604 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0b491626-fd05-4b26-bd7e-c692dbf69f8b tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:47.064604 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0b491626-fd05-4b26-bd7e-c692dbf69f8b tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:47.064604 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0b491626-fd05-4b26-bd7e-c692dbf69f8b tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:47.104156 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-eeac77a4-864a-4b01-9566-63d42c81c647 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2b0581ad4e4c9787bef838c81870a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dfe251b1e046a995b8ec302cb2ffa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:47.120043 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-eeac77a4-864a-4b01-9566-63d42c81c647 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "GET /compute/v2.1/servers/e13547eb-efb0-4153-8dec-a666d4e6349b" status: 200 len: 1523 microversion: 2.1 time: 0.488599 Oct 19 03:29:47.126182 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1919/3920] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:29:46 2022] GET /compute/v2.1/servers/e13547eb-efb0-4153-8dec-a666d4e6349b => generated 1523 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:29:47.185094 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ac8ffda6-e531-4af0-a95a-bec3058e36a2 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:29:47.185844 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ac8ffda6-e531-4af0-a95a-bec3058e36a2 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 89f5f23f-8580-46fa-accf-206b1141c301] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:29:47.200098 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ac8ffda6-e531-4af0-a95a-bec3058e36a2 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:47.200596 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ac8ffda6-e531-4af0-a95a-bec3058e36a2 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:47.201241 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ac8ffda6-e531-4af0-a95a-bec3058e36a2 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:47.202164 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ac8ffda6-e531-4af0-a95a-bec3058e36a2 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:47.202834 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ac8ffda6-e531-4af0-a95a-bec3058e36a2 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:47.204185 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ac8ffda6-e531-4af0-a95a-bec3058e36a2 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:47.523577 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-0b491626-fd05-4b26-bd7e-c692dbf69f8b tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:47.539373 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-0b491626-fd05-4b26-bd7e-c692dbf69f8b tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:47.545781 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-0b491626-fd05-4b26-bd7e-c692dbf69f8b tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:47.550640 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0b491626-fd05-4b26-bd7e-c692dbf69f8b tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] 10.222.0.52 "GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95" status: 200 len: 1604 microversion: 2.42 time: 0.527835 Oct 19 03:29:47.553861 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2002/3921] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:29:47 2022] GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 => generated 1604 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:29:47.661683 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ac8ffda6-e531-4af0-a95a-bec3058e36a2 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:47.683667 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ac8ffda6-e531-4af0-a95a-bec3058e36a2 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301" status: 200 len: 1198 microversion: 2.1 time: 0.499218 Oct 19 03:29:47.688899 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1920/3922] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:29:47 2022] GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301 => generated 1198 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:29:48.158609 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e2c75e95-1675-4f04-a3ad-6cd9c386d5d0 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:29:48.159237 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e2c75e95-1675-4f04-a3ad-6cd9c386d5d0 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: e13547eb-efb0-4153-8dec-a666d4e6349b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:29:48.173850 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e2c75e95-1675-4f04-a3ad-6cd9c386d5d0 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:48.175929 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e2c75e95-1675-4f04-a3ad-6cd9c386d5d0 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:48.178395 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e2c75e95-1675-4f04-a3ad-6cd9c386d5d0 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:48.179156 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e2c75e95-1675-4f04-a3ad-6cd9c386d5d0 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:48.179645 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e2c75e95-1675-4f04-a3ad-6cd9c386d5d0 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:48.180062 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e2c75e95-1675-4f04-a3ad-6cd9c386d5d0 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:48.583378 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-184ecd01-5497-484e-ae47-945e2c06a978 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:29:48.587971 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-184ecd01-5497-484e-ae47-945e2c06a978 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] [instance: cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:29:48.598167 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-e2c75e95-1675-4f04-a3ad-6cd9c386d5d0 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2b0581ad4e4c9787bef838c81870a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dfe251b1e046a995b8ec302cb2ffa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:48.601147 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-184ecd01-5497-484e-ae47-945e2c06a978 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:48.601683 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-184ecd01-5497-484e-ae47-945e2c06a978 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:48.602131 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-184ecd01-5497-484e-ae47-945e2c06a978 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:48.611229 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-184ecd01-5497-484e-ae47-945e2c06a978 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:48.611782 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-184ecd01-5497-484e-ae47-945e2c06a978 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:48.612241 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-184ecd01-5497-484e-ae47-945e2c06a978 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:48.616466 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e2c75e95-1675-4f04-a3ad-6cd9c386d5d0 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "GET /compute/v2.1/servers/e13547eb-efb0-4153-8dec-a666d4e6349b" status: 200 len: 1523 microversion: 2.1 time: 0.462784 Oct 19 03:29:48.619369 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2003/3923] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:29:48 2022] GET /compute/v2.1/servers/e13547eb-efb0-4153-8dec-a666d4e6349b => generated 1523 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:29:48.714191 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1ed3be95-4271-4d86-bad8-167e3d50a494 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:29:48.715593 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1ed3be95-4271-4d86-bad8-167e3d50a494 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 89f5f23f-8580-46fa-accf-206b1141c301] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:29:48.740659 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1ed3be95-4271-4d86-bad8-167e3d50a494 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:48.741174 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1ed3be95-4271-4d86-bad8-167e3d50a494 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:48.741676 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1ed3be95-4271-4d86-bad8-167e3d50a494 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:48.742403 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1ed3be95-4271-4d86-bad8-167e3d50a494 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:48.742909 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1ed3be95-4271-4d86-bad8-167e3d50a494 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:48.745122 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1ed3be95-4271-4d86-bad8-167e3d50a494 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:48.817235 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-184ecd01-5497-484e-ae47-945e2c06a978 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:48.831385 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-184ecd01-5497-484e-ae47-945e2c06a978 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:48.834729 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-184ecd01-5497-484e-ae47-945e2c06a978 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:48.838190 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-184ecd01-5497-484e-ae47-945e2c06a978 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] 10.222.0.52 "GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95" status: 200 len: 1604 microversion: 2.42 time: 0.258744 Oct 19 03:29:48.839851 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1921/3924] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:29:48 2022] GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 => generated 1604 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:29:49.064641 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-b4f20a02-db48-4215-a60b-72d4e717d093 req-d8153109-f62b-409a-8b95-d12b31b2e44b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58b9ce4c-4a42-40ff-b8ed-b75de752b46f", "name": "network-vif-unplugged", "status": "completed", "tag": "ff8c2e3f-1c6f-4ac7-b6b8-751825489845"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:29:49.104453 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-b4f20a02-db48-4215-a60b-72d4e717d093 req-d8153109-f62b-409a-8b95-d12b31b2e44b service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:49.105499 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-b4f20a02-db48-4215-a60b-72d4e717d093 req-d8153109-f62b-409a-8b95-d12b31b2e44b service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:49.106626 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-b4f20a02-db48-4215-a60b-72d4e717d093 req-d8153109-f62b-409a-8b95-d12b31b2e44b service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:49.200162 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-1ed3be95-4271-4d86-bad8-167e3d50a494 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:49.220762 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1ed3be95-4271-4d86-bad8-167e3d50a494 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301" status: 200 len: 1380 microversion: 2.1 time: 0.511099 Oct 19 03:29:49.223382 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2004/3925] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:29:48 2022] GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301 => generated 1380 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:29:49.948094 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6db61707-fd3b-442d-ae19-3ff91d9bfc75 tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:29:49.948923 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6db61707-fd3b-442d-ae19-3ff91d9bfc75 tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] [instance: 89f5f23f-8580-46fa-accf-206b1141c301] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:29:49.959588 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-b4f20a02-db48-4215-a60b-72d4e717d093 req-d8153109-f62b-409a-8b95-d12b31b2e44b service nova] Creating event network-vif-unplugged:ff8c2e3f-1c6f-4ac7-b6b8-751825489845 for instance 58b9ce4c-4a42-40ff-b8ed-b75de752b46f on n-h2-861333-8 Oct 19 03:29:49.961248 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6db61707-fd3b-442d-ae19-3ff91d9bfc75 tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:49.961807 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6db61707-fd3b-442d-ae19-3ff91d9bfc75 tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:49.964946 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6db61707-fd3b-442d-ae19-3ff91d9bfc75 tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:49.967494 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6db61707-fd3b-442d-ae19-3ff91d9bfc75 tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:49.970434 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6db61707-fd3b-442d-ae19-3ff91d9bfc75 tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:49.971146 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6db61707-fd3b-442d-ae19-3ff91d9bfc75 tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:49.979743 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-b4f20a02-db48-4215-a60b-72d4e717d093 req-d8153109-f62b-409a-8b95-d12b31b2e44b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.917406 Oct 19 03:29:49.979743 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1922/3926] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:29:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:29:49.994069 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-294439d4-48cc-4c32-8d35-4a9c96668227 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:29:49.996013 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-294439d4-48cc-4c32-8d35-4a9c96668227 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: e13547eb-efb0-4153-8dec-a666d4e6349b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:29:50.019312 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-294439d4-48cc-4c32-8d35-4a9c96668227 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:50.020338 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-294439d4-48cc-4c32-8d35-4a9c96668227 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:50.021046 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-294439d4-48cc-4c32-8d35-4a9c96668227 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:50.022861 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-294439d4-48cc-4c32-8d35-4a9c96668227 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:50.023512 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-294439d4-48cc-4c32-8d35-4a9c96668227 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:50.024352 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-294439d4-48cc-4c32-8d35-4a9c96668227 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:50.700318 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6db61707-fd3b-442d-ae19-3ff91d9bfc75 tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301" status: 200 len: 1531 microversion: 2.1 time: 1.441485 Oct 19 03:29:50.706412 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-294439d4-48cc-4c32-8d35-4a9c96668227 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2b0581ad4e4c9787bef838c81870a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dfe251b1e046a995b8ec302cb2ffa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:50.717661 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2005/3927] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:29:49 2022] GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301 => generated 1531 bytes in 1473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:29:50.720759 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-294439d4-48cc-4c32-8d35-4a9c96668227 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "GET /compute/v2.1/servers/e13547eb-efb0-4153-8dec-a666d4e6349b" status: 200 len: 1523 microversion: 2.1 time: 0.741925 Oct 19 03:29:50.748174 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1923/3928] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:29:49 2022] GET /compute/v2.1/servers/e13547eb-efb0-4153-8dec-a666d4e6349b => generated 1523 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:29:50.753499 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-983f39d2-1ca7-4da4-8f48-9560884e48ce tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:29:50.755079 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-983f39d2-1ca7-4da4-8f48-9560884e48ce tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] [instance: cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:29:50.761507 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c085fa8a-558f-4315-9aee-14c29604e7ed tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:29:50.765577 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c085fa8a-558f-4315-9aee-14c29604e7ed tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] [instance: 89f5f23f-8580-46fa-accf-206b1141c301] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:29:50.773789 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-983f39d2-1ca7-4da4-8f48-9560884e48ce tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:50.778236 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c085fa8a-558f-4315-9aee-14c29604e7ed tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:50.779514 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-983f39d2-1ca7-4da4-8f48-9560884e48ce tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:50.782438 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-983f39d2-1ca7-4da4-8f48-9560884e48ce tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:50.783413 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-983f39d2-1ca7-4da4-8f48-9560884e48ce tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:50.784868 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-983f39d2-1ca7-4da4-8f48-9560884e48ce tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:50.789407 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-983f39d2-1ca7-4da4-8f48-9560884e48ce tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:50.790303 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c085fa8a-558f-4315-9aee-14c29604e7ed tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:50.795658 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c085fa8a-558f-4315-9aee-14c29604e7ed tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:50.797199 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c085fa8a-558f-4315-9aee-14c29604e7ed tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:50.797887 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c085fa8a-558f-4315-9aee-14c29604e7ed tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:50.799463 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c085fa8a-558f-4315-9aee-14c29604e7ed tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:50.989947 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-983f39d2-1ca7-4da4-8f48-9560884e48ce tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:51.009751 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-983f39d2-1ca7-4da4-8f48-9560884e48ce tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:51.017326 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-983f39d2-1ca7-4da4-8f48-9560884e48ce tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:51.021027 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-983f39d2-1ca7-4da4-8f48-9560884e48ce tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] 10.222.0.52 "GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95" status: 200 len: 1604 microversion: 2.42 time: 0.298837 Oct 19 03:29:51.024687 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2006/3929] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:29:50 2022] GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 => generated 1604 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:29:51.342055 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c085fa8a-558f-4315-9aee-14c29604e7ed tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301" status: 200 len: 1531 microversion: 2.1 time: 0.591894 Oct 19 03:29:51.366836 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1924/3930] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:29:50 2022] GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301 => generated 1531 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:29:51.375408 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e301b718-1a8e-4fd3-a3e1-d10d2255fff6 tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:29:51.379524 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e301b718-1a8e-4fd3-a3e1-d10d2255fff6 tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:51.381234 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e301b718-1a8e-4fd3-a3e1-d10d2255fff6 tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:51.383177 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e301b718-1a8e-4fd3-a3e1-d10d2255fff6 tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:51.385186 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e301b718-1a8e-4fd3-a3e1-d10d2255fff6 tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:51.385859 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e301b718-1a8e-4fd3-a3e1-d10d2255fff6 tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:51.390557 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e301b718-1a8e-4fd3-a3e1-d10d2255fff6 tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:51.430544 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=68 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:29:51.465629 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e301b718-1a8e-4fd3-a3e1-d10d2255fff6 tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.094265 Oct 19 03:29:51.466970 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2007/3931] 10.222.0.52 () {58 vars in 1176 bytes} [Wed Oct 19 03:29:51 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:29:51.481323 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5d1c227c-46d2-432f-947b-e6d2fbf77fba tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-861333-8", "block_migration": false, "disk_over_commit": false}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:29:51.484855 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5d1c227c-46d2-432f-947b-e6d2fbf77fba tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] [instance: 89f5f23f-8580-46fa-accf-206b1141c301] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:29:51.501925 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5d1c227c-46d2-432f-947b-e6d2fbf77fba tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:51.502694 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5d1c227c-46d2-432f-947b-e6d2fbf77fba tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:51.503148 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5d1c227c-46d2-432f-947b-e6d2fbf77fba tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:51.504057 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5d1c227c-46d2-432f-947b-e6d2fbf77fba tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:51.505754 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5d1c227c-46d2-432f-947b-e6d2fbf77fba tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:51.508040 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5d1c227c-46d2-432f-947b-e6d2fbf77fba tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:51.753710 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b4743de4-4477-4254-8e30-a0754794307c tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:29:51.754516 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b4743de4-4477-4254-8e30-a0754794307c tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: e13547eb-efb0-4153-8dec-a666d4e6349b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:29:51.771081 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b4743de4-4477-4254-8e30-a0754794307c tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:51.771588 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b4743de4-4477-4254-8e30-a0754794307c tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:51.772025 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b4743de4-4477-4254-8e30-a0754794307c tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:51.783507 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b4743de4-4477-4254-8e30-a0754794307c tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:51.784260 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b4743de4-4477-4254-8e30-a0754794307c tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:51.791107 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b4743de4-4477-4254-8e30-a0754794307c tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:52.180435 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-5d1c227c-46d2-432f-947b-e6d2fbf77fba tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Lazy-loading 'flavor' on Instance uuid 89f5f23f-8580-46fa-accf-206b1141c301 {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:29:52.261987 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5d1c227c-46d2-432f-947b-e6d2fbf77fba tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] [instance: 89f5f23f-8580-46fa-accf-206b1141c301] Going to try to live migrate instance to n-h2-861333-8 {{(pid=121134) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 19 03:29:52.364491 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b4743de4-4477-4254-8e30-a0754794307c tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2b0581ad4e4c9787bef838c81870a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dfe251b1e046a995b8ec302cb2ffa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:52.377225 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b4743de4-4477-4254-8e30-a0754794307c tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "GET /compute/v2.1/servers/e13547eb-efb0-4153-8dec-a666d4e6349b" status: 200 len: 1523 microversion: 2.1 time: 0.626415 Oct 19 03:29:52.378612 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2008/3932] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:29:51 2022] GET /compute/v2.1/servers/e13547eb-efb0-4153-8dec-a666d4e6349b => generated 1523 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:29:52.840042 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-48cf5749-3aec-484f-8565-d8f415f0b880 tempest-SecurityGroupRulesTestJSON-1243509135 tempest-SecurityGroupRulesTestJSON-1243509135-project] Action: 'create', calling method: .version_select at 0x7fc12bfaa0d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-146293522", "description": "tempest-description-338242821"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:29:53.469162 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-48cf5749-3aec-484f-8565-d8f415f0b880 tempest-SecurityGroupRulesTestJSON-1243509135 tempest-SecurityGroupRulesTestJSON-1243509135-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 1.088105 Oct 19 03:29:53.472434 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2009/3933] 10.222.0.52 () {60 vars in 1180 bytes} [Wed Oct 19 03:29:52 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:29:53.476867 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-679db20c-3ec6-45de-992c-cf63f7349128 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:29:53.481537 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-679db20c-3ec6-45de-992c-cf63f7349128 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] [instance: cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:29:53.501019 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-679db20c-3ec6-45de-992c-cf63f7349128 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:53.501791 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-679db20c-3ec6-45de-992c-cf63f7349128 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:53.502865 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-679db20c-3ec6-45de-992c-cf63f7349128 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:53.503884 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-679db20c-3ec6-45de-992c-cf63f7349128 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:53.504559 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-679db20c-3ec6-45de-992c-cf63f7349128 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:53.505199 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-679db20c-3ec6-45de-992c-cf63f7349128 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:53.626890 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-679db20c-3ec6-45de-992c-cf63f7349128 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:53.643679 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-679db20c-3ec6-45de-992c-cf63f7349128 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:53.646425 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-679db20c-3ec6-45de-992c-cf63f7349128 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:53.664590 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-679db20c-3ec6-45de-992c-cf63f7349128 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] 10.222.0.52 "GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95" status: 200 len: 1604 microversion: 2.42 time: 0.189357 Oct 19 03:29:53.690677 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2010/3934] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:29:53 2022] GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 => generated 1604 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:29:53.697032 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1a3eee69-a83e-4959-9fc1-f39ef8235673 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:29:53.697710 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1a3eee69-a83e-4959-9fc1-f39ef8235673 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: e13547eb-efb0-4153-8dec-a666d4e6349b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:29:53.741498 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1a3eee69-a83e-4959-9fc1-f39ef8235673 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:53.741498 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1a3eee69-a83e-4959-9fc1-f39ef8235673 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:53.745909 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1a3eee69-a83e-4959-9fc1-f39ef8235673 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:53.751113 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1a3eee69-a83e-4959-9fc1-f39ef8235673 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:53.752589 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1a3eee69-a83e-4959-9fc1-f39ef8235673 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:53.754480 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1a3eee69-a83e-4959-9fc1-f39ef8235673 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:54.795955 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-1a3eee69-a83e-4959-9fc1-f39ef8235673 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2b0581ad4e4c9787bef838c81870a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dfe251b1e046a995b8ec302cb2ffa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:54.808473 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1a3eee69-a83e-4959-9fc1-f39ef8235673 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "GET /compute/v2.1/servers/e13547eb-efb0-4153-8dec-a666d4e6349b" status: 200 len: 1523 microversion: 2.1 time: 1.116376 Oct 19 03:29:54.817131 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2011/3935] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:29:53 2022] GET /compute/v2.1/servers/e13547eb-efb0-4153-8dec-a666d4e6349b => generated 1523 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:29:54.838083 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-7fab9d25-dc74-464d-8114-f02a32be3328 req-76a37eca-4fcd-4955-8f2a-d3f045d2ccc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e13547eb-efb0-4153-8dec-a666d4e6349b", "name": "network-vif-plugged", "status": "completed", "tag": "c2a6f65f-751d-40d2-9e77-e8429e7d45d4"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:29:54.879767 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-7fab9d25-dc74-464d-8114-f02a32be3328 req-76a37eca-4fcd-4955-8f2a-d3f045d2ccc7 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:54.880223 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-7fab9d25-dc74-464d-8114-f02a32be3328 req-76a37eca-4fcd-4955-8f2a-d3f045d2ccc7 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:54.885231 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-7fab9d25-dc74-464d-8114-f02a32be3328 req-76a37eca-4fcd-4955-8f2a-d3f045d2ccc7 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:54.923826 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-7fab9d25-dc74-464d-8114-f02a32be3328 req-76a37eca-4fcd-4955-8f2a-d3f045d2ccc7 service nova] Creating event network-vif-plugged:c2a6f65f-751d-40d2-9e77-e8429e7d45d4 for instance e13547eb-efb0-4153-8dec-a666d4e6349b on n-h1-861333-8 Oct 19 03:29:54.934850 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-7fab9d25-dc74-464d-8114-f02a32be3328 req-76a37eca-4fcd-4955-8f2a-d3f045d2ccc7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116041 Oct 19 03:29:54.936049 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2012/3936] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:29:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:29:54.944205 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-aa8d0282-64cc-4eff-a672-f14301771317 tempest-SecurityGroupRulesTestJSON-1243509135 tempest-SecurityGroupRulesTestJSON-1243509135-project] Action: 'create', calling method: .version_select at 0x7fc12bed3280>, body: {"security_group_rule": {"parent_group_id": "2f107245-d35b-4218-b5d0-456ea53b5db0", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:29:56.330590 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-aa8d0282-64cc-4eff-a672-f14301771317 tempest-SecurityGroupRulesTestJSON-1243509135 tempest-SecurityGroupRulesTestJSON-1243509135-project] 10.222.0.52 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.390671 Oct 19 03:29:56.330590 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2013/3937] 10.222.0.52 () {60 vars in 1195 bytes} [Wed Oct 19 03:29:54 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1393 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:29:56.334627 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ea6d1f46-23e3-41b5-86a9-1e74bc93f03e tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:29:56.338349 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ea6d1f46-23e3-41b5-86a9-1e74bc93f03e tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] [instance: cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:29:56.374451 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ea6d1f46-23e3-41b5-86a9-1e74bc93f03e tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:56.379855 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ea6d1f46-23e3-41b5-86a9-1e74bc93f03e tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:56.383839 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ea6d1f46-23e3-41b5-86a9-1e74bc93f03e tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:56.384694 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ea6d1f46-23e3-41b5-86a9-1e74bc93f03e tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:56.387702 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ea6d1f46-23e3-41b5-86a9-1e74bc93f03e tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:56.391591 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ea6d1f46-23e3-41b5-86a9-1e74bc93f03e tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:57.754039 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ea6d1f46-23e3-41b5-86a9-1e74bc93f03e tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:57.763610 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ea6d1f46-23e3-41b5-86a9-1e74bc93f03e tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:57.765315 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ea6d1f46-23e3-41b5-86a9-1e74bc93f03e tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:57.766529 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ea6d1f46-23e3-41b5-86a9-1e74bc93f03e tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] 10.222.0.52 "GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95" status: 200 len: 1604 microversion: 2.42 time: 1.435762 Oct 19 03:29:57.767094 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2014/3938] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:29:56 2022] GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 => generated 1604 bytes in 1437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:29:57.791345 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-387bd9c4-1fda-4e62-b43b-ec1d0a2edc7c tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:29:57.796481 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-387bd9c4-1fda-4e62-b43b-ec1d0a2edc7c tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: e13547eb-efb0-4153-8dec-a666d4e6349b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:29:57.818645 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-387bd9c4-1fda-4e62-b43b-ec1d0a2edc7c tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:57.819147 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-387bd9c4-1fda-4e62-b43b-ec1d0a2edc7c tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:57.824887 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-387bd9c4-1fda-4e62-b43b-ec1d0a2edc7c tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:57.828462 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-387bd9c4-1fda-4e62-b43b-ec1d0a2edc7c tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:57.831982 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-387bd9c4-1fda-4e62-b43b-ec1d0a2edc7c tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:57.843677 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-387bd9c4-1fda-4e62-b43b-ec1d0a2edc7c tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:58.387977 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-387bd9c4-1fda-4e62-b43b-ec1d0a2edc7c tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2b0581ad4e4c9787bef838c81870a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dfe251b1e046a995b8ec302cb2ffa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:58.401391 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-387bd9c4-1fda-4e62-b43b-ec1d0a2edc7c tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "GET /compute/v2.1/servers/e13547eb-efb0-4153-8dec-a666d4e6349b" status: 200 len: 1508 microversion: 2.1 time: 0.624914 Oct 19 03:29:58.403217 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2015/3939] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:29:57 2022] GET /compute/v2.1/servers/e13547eb-efb0-4153-8dec-a666d4e6349b => generated 1508 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:29:58.427029 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-06b6d58d-5bfb-4db6-9f56-7f75237ee3b8 tempest-SecurityGroupRulesTestJSON-1243509135 tempest-SecurityGroupRulesTestJSON-1243509135-project] Action: 'create', calling method: .version_select at 0x7fc12beb74c0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-513374834", "description": "tempest-description-699136438"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:29:58.471218 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5d1c227c-46d2-432f-947b-e6d2fbf77fba tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301/action" status: 202 len: 0 microversion: 2.1 time: 6.995130 Oct 19 03:29:58.471887 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1925/3940] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:29:51 2022] POST /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301/action => generated 0 bytes in 6997 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:29:58.480524 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-cf93bd67-2017-440e-8d79-3006983cac93 req-aca26b47-1b90-451d-b0ee-dfd46d0bd167 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58b9ce4c-4a42-40ff-b8ed-b75de752b46f", "name": "network-vif-plugged", "status": "completed", "tag": "ff8c2e3f-1c6f-4ac7-b6b8-751825489845"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:29:58.534687 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-cf93bd67-2017-440e-8d79-3006983cac93 req-aca26b47-1b90-451d-b0ee-dfd46d0bd167 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:58.540571 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-cf93bd67-2017-440e-8d79-3006983cac93 req-aca26b47-1b90-451d-b0ee-dfd46d0bd167 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:58.544141 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-cf93bd67-2017-440e-8d79-3006983cac93 req-aca26b47-1b90-451d-b0ee-dfd46d0bd167 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:58.608731 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-cf93bd67-2017-440e-8d79-3006983cac93 req-aca26b47-1b90-451d-b0ee-dfd46d0bd167 service nova] Creating event network-vif-plugged:ff8c2e3f-1c6f-4ac7-b6b8-751825489845 for instance 58b9ce4c-4a42-40ff-b8ed-b75de752b46f on n-h2-861333-8 Oct 19 03:29:58.641098 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-cf93bd67-2017-440e-8d79-3006983cac93 req-aca26b47-1b90-451d-b0ee-dfd46d0bd167 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.164256 Oct 19 03:29:58.641738 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1926/3941] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:29:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:29:58.671706 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4bafa845-a642-4bf2-9592-cc817899ba8e tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:29:58.672514 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4bafa845-a642-4bf2-9592-cc817899ba8e tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: e13547eb-efb0-4153-8dec-a666d4e6349b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:29:58.705831 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4bafa845-a642-4bf2-9592-cc817899ba8e tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:58.706527 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4bafa845-a642-4bf2-9592-cc817899ba8e tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:58.706972 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4bafa845-a642-4bf2-9592-cc817899ba8e tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:58.707727 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4bafa845-a642-4bf2-9592-cc817899ba8e tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:58.708722 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4bafa845-a642-4bf2-9592-cc817899ba8e tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:58.709590 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4bafa845-a642-4bf2-9592-cc817899ba8e tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:59.294291 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-4bafa845-a642-4bf2-9592-cc817899ba8e tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2b0581ad4e4c9787bef838c81870a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dfe251b1e046a995b8ec302cb2ffa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:59.310555 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4bafa845-a642-4bf2-9592-cc817899ba8e tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "GET /compute/v2.1/servers/e13547eb-efb0-4153-8dec-a666d4e6349b" status: 200 len: 1508 microversion: 2.1 time: 0.659391 Oct 19 03:29:59.311662 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1927/3942] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:29:58 2022] GET /compute/v2.1/servers/e13547eb-efb0-4153-8dec-a666d4e6349b => generated 1508 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:29:59.357017 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7e715546-0946-4d47-baf2-9cebc0c22fe5 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:29:59.358962 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7e715546-0946-4d47-baf2-9cebc0c22fe5 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 89f5f23f-8580-46fa-accf-206b1141c301] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:29:59.381092 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7e715546-0946-4d47-baf2-9cebc0c22fe5 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:59.382029 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7e715546-0946-4d47-baf2-9cebc0c22fe5 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:59.385465 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7e715546-0946-4d47-baf2-9cebc0c22fe5 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:59.387622 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7e715546-0946-4d47-baf2-9cebc0c22fe5 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:59.390216 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7e715546-0946-4d47-baf2-9cebc0c22fe5 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:59.392853 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7e715546-0946-4d47-baf2-9cebc0c22fe5 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:59.664066 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-06b6d58d-5bfb-4db6-9f56-7f75237ee3b8 tempest-SecurityGroupRulesTestJSON-1243509135 tempest-SecurityGroupRulesTestJSON-1243509135-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 1.256078 Oct 19 03:29:59.673575 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2016/3943] 10.222.0.52 () {60 vars in 1180 bytes} [Wed Oct 19 03:29:58 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:29:59.673575 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-09077c07-d6c1-4bff-aa88-fc6aec2c4a8d tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:29:59.673575 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-09077c07-d6c1-4bff-aa88-fc6aec2c4a8d tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] [instance: cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:29:59.698129 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-09077c07-d6c1-4bff-aa88-fc6aec2c4a8d tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:59.698977 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-09077c07-d6c1-4bff-aa88-fc6aec2c4a8d tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:59.700327 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-09077c07-d6c1-4bff-aa88-fc6aec2c4a8d tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:59.705829 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-09077c07-d6c1-4bff-aa88-fc6aec2c4a8d tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:59.708343 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-09077c07-d6c1-4bff-aa88-fc6aec2c4a8d tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:59.708988 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-09077c07-d6c1-4bff-aa88-fc6aec2c4a8d tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:59.842252 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-7e715546-0946-4d47-baf2-9cebc0c22fe5 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:59.849880 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7e715546-0946-4d47-baf2-9cebc0c22fe5 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301" status: 200 len: 1390 microversion: 2.1 time: 0.532974 Oct 19 03:29:59.867215 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1928/3944] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:29:59 2022] GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301 => generated 1390 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:29:59.889425 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-09077c07-d6c1-4bff-aa88-fc6aec2c4a8d tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:59.900482 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e24c963f-ea8a-46d9-9aa5-5db573069e27 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:29:59.900907 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e24c963f-ea8a-46d9-9aa5-5db573069e27 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: e13547eb-efb0-4153-8dec-a666d4e6349b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:29:59.916799 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e24c963f-ea8a-46d9-9aa5-5db573069e27 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:59.917691 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e24c963f-ea8a-46d9-9aa5-5db573069e27 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:59.923504 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e24c963f-ea8a-46d9-9aa5-5db573069e27 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:59.924510 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e24c963f-ea8a-46d9-9aa5-5db573069e27 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:29:59.925123 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e24c963f-ea8a-46d9-9aa5-5db573069e27 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:29:59.925867 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e24c963f-ea8a-46d9-9aa5-5db573069e27 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:29:59.934643 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-09077c07-d6c1-4bff-aa88-fc6aec2c4a8d tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:59.940366 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-09077c07-d6c1-4bff-aa88-fc6aec2c4a8d tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:29:59.944038 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-09077c07-d6c1-4bff-aa88-fc6aec2c4a8d tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] 10.222.0.52 "GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95" status: 200 len: 1604 microversion: 2.42 time: 0.276044 Oct 19 03:29:59.945538 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2017/3945] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:29:59 2022] GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 => generated 1604 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:29:59.959081 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0dbe333f-830b-41dc-95cc-772044ce0f4c tempest-SecurityGroupRulesTestJSON-1243509135 tempest-SecurityGroupRulesTestJSON-1243509135-project] Action: 'create', calling method: .version_select at 0x7fc12bfaa9d0>, body: {"security_group_rule": {"parent_group_id": "903e9f36-87ac-4210-9a68-3309986d5e5e", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:30:00.032355 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e24c963f-ea8a-46d9-9aa5-5db573069e27 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: e13547eb-efb0-4153-8dec-a666d4e6349b] Going to try to terminate instance {{(pid=121134) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:30:00.442776 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e24c963f-ea8a-46d9-9aa5-5db573069e27 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "DELETE /compute/v2.1/servers/e13547eb-efb0-4153-8dec-a666d4e6349b" status: 204 len: 0 microversion: 2.1 time: 0.567480 Oct 19 03:30:00.442776 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1929/3946] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:29:59 2022] DELETE /compute/v2.1/servers/e13547eb-efb0-4153-8dec-a666d4e6349b => generated 0 bytes in 571 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:30:00.828884 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-863e3c4c-ed52-4ced-b0c6-0d0076bacade tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-2097833785", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "networks": [{"uuid": "549a6939-4677-4325-946a-139cb93dc76f"}]}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:30:00.997154 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-863e3c4c-ed52-4ced-b0c6-0d0076bacade tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] validate_networks() for [('549a6939-4677-4325-946a-139cb93dc76f', None, None, None, None, None)] {{(pid=121134) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:30:01.408588 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:30:02.161575 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0dbe333f-830b-41dc-95cc-772044ce0f4c tempest-SecurityGroupRulesTestJSON-1243509135 tempest-SecurityGroupRulesTestJSON-1243509135-project] 10.222.0.52 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 2.214427 Oct 19 03:30:02.162541 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2018/3947] 10.222.0.52 () {60 vars in 1195 bytes} [Wed Oct 19 03:29:59 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 2216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:30:02.167959 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c0f30998-b96c-48f2-ad62-db32549bef5b tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:02.171462 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c0f30998-b96c-48f2-ad62-db32549bef5b tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 89f5f23f-8580-46fa-accf-206b1141c301] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:02.200348 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c0f30998-b96c-48f2-ad62-db32549bef5b tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:02.202434 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c0f30998-b96c-48f2-ad62-db32549bef5b tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:02.206749 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c0f30998-b96c-48f2-ad62-db32549bef5b tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:02.207797 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c0f30998-b96c-48f2-ad62-db32549bef5b tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:02.213690 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c0f30998-b96c-48f2-ad62-db32549bef5b tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:02.216072 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c0f30998-b96c-48f2-ad62-db32549bef5b tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:03.551930 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-863e3c4c-ed52-4ced-b0c6-0d0076bacade tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Flavor limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:30:03.554537 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-863e3c4c-ed52-4ced-b0c6-0d0076bacade tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Image limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:30:03.554537 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-863e3c4c-ed52-4ced-b0c6-0d0076bacade tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Flavor pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:30:03.554537 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-863e3c4c-ed52-4ced-b0c6-0d0076bacade tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Image pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:30:03.554537 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-863e3c4c-ed52-4ced-b0c6-0d0076bacade tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:30:03.579180 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-863e3c4c-ed52-4ced-b0c6-0d0076bacade tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:03.580633 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-863e3c4c-ed52-4ced-b0c6-0d0076bacade tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:03.582285 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-863e3c4c-ed52-4ced-b0c6-0d0076bacade tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:03.587798 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-863e3c4c-ed52-4ced-b0c6-0d0076bacade tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:03.588576 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-863e3c4c-ed52-4ced-b0c6-0d0076bacade tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:03.589095 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-863e3c4c-ed52-4ced-b0c6-0d0076bacade tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:03.640289 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-863e3c4c-ed52-4ced-b0c6-0d0076bacade tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Getting quotas for project c4dfe251b1e046a995b8ec302cb2ffa0. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:30:03.648970 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c0f30998-b96c-48f2-ad62-db32549bef5b tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:03.652992 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-863e3c4c-ed52-4ced-b0c6-0d0076bacade tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Getting quotas for user de2b0581ad4e4c9787bef838c81870a2 and project c4dfe251b1e046a995b8ec302cb2ffa0. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:30:03.663755 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c0f30998-b96c-48f2-ad62-db32549bef5b tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301" status: 200 len: 1390 microversion: 2.1 time: 1.499777 Oct 19 03:30:03.680271 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2019/3948] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:30:02 2022] GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301 => generated 1390 bytes in 1504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:30:03.690796 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-426003d3-fcb3-45a8-9fa2-d0e0b8615aab tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:03.691427 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-426003d3-fcb3-45a8-9fa2-d0e0b8615aab tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] [instance: cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:03.706656 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-863e3c4c-ed52-4ced-b0c6-0d0076bacade tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Going to run 1 instances... {{(pid=121134) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:30:03.716593 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-863e3c4c-ed52-4ced-b0c6-0d0076bacade tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: ba62d863-e7f4-4653-a03b-66b3549bf8d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:30:03.726573 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-426003d3-fcb3-45a8-9fa2-d0e0b8615aab tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:03.727310 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-426003d3-fcb3-45a8-9fa2-d0e0b8615aab tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:03.736109 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-426003d3-fcb3-45a8-9fa2-d0e0b8615aab tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:03.736109 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-426003d3-fcb3-45a8-9fa2-d0e0b8615aab tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:03.736109 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-426003d3-fcb3-45a8-9fa2-d0e0b8615aab tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:03.741606 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-426003d3-fcb3-45a8-9fa2-d0e0b8615aab tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:03.955810 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-863e3c4c-ed52-4ced-b0c6-0d0076bacade tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.133036 Oct 19 03:30:03.970389 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1930/3949] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:30:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 3143 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 03:30:03.980018 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9c963d2b-b143-4414-99e7-ec373bf2a9dc tempest-SecurityGroupRulesTestJSON-1243509135 tempest-SecurityGroupRulesTestJSON-1243509135-project] Action: 'create', calling method: .version_select at 0x7fc1300d1c10>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1577145152", "description": "tempest-description-244602102"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:30:04.079177 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-426003d3-fcb3-45a8-9fa2-d0e0b8615aab tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:04.101630 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-426003d3-fcb3-45a8-9fa2-d0e0b8615aab tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:04.107510 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-426003d3-fcb3-45a8-9fa2-d0e0b8615aab tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:04.119858 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-426003d3-fcb3-45a8-9fa2-d0e0b8615aab tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] 10.222.0.52 "GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95" status: 200 len: 1604 microversion: 2.42 time: 0.447032 Oct 19 03:30:04.120484 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2020/3950] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:30:03 2022] GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 => generated 1604 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:30:04.177503 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-af0cd0b7-08ab-4323-9d32-866db906958f tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:04.180657 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-af0cd0b7-08ab-4323-9d32-866db906958f tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: ba62d863-e7f4-4653-a03b-66b3549bf8d2] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:04.381413 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-af0cd0b7-08ab-4323-9d32-866db906958f tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2b0581ad4e4c9787bef838c81870a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dfe251b1e046a995b8ec302cb2ffa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:04.398586 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-af0cd0b7-08ab-4323-9d32-866db906958f tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "GET /compute/v2.1/servers/ba62d863-e7f4-4653-a03b-66b3549bf8d2" status: 200 len: 1218 microversion: 2.1 time: 0.254058 Oct 19 03:30:04.398586 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2021/3951] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:30:04 2022] GET /compute/v2.1/servers/ba62d863-e7f4-4653-a03b-66b3549bf8d2 => generated 1218 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:30:04.689360 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-694b7759-20a7-4830-91a3-51f5b27f4a8e tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:04.690207 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-694b7759-20a7-4830-91a3-51f5b27f4a8e tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 89f5f23f-8580-46fa-accf-206b1141c301] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:04.707511 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-694b7759-20a7-4830-91a3-51f5b27f4a8e tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:04.714998 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-694b7759-20a7-4830-91a3-51f5b27f4a8e tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:04.715692 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-694b7759-20a7-4830-91a3-51f5b27f4a8e tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:04.719115 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-694b7759-20a7-4830-91a3-51f5b27f4a8e tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:04.720010 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-694b7759-20a7-4830-91a3-51f5b27f4a8e tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:04.720705 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-694b7759-20a7-4830-91a3-51f5b27f4a8e tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:04.739140 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:30:05.337694 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-694b7759-20a7-4830-91a3-51f5b27f4a8e tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:05.355004 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-694b7759-20a7-4830-91a3-51f5b27f4a8e tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301" status: 200 len: 1390 microversion: 2.1 time: 0.663712 Oct 19 03:30:05.379585 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2022/3952] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:30:04 2022] GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301 => generated 1390 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:30:05.401389 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5c6a167a-734c-486e-83ac-2b395c1255b8 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:05.402084 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-5c6a167a-734c-486e-83ac-2b395c1255b8 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] [instance: cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:05.414132 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9c963d2b-b143-4414-99e7-ec373bf2a9dc tempest-SecurityGroupRulesTestJSON-1243509135 tempest-SecurityGroupRulesTestJSON-1243509135-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.445122 Oct 19 03:30:05.414721 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1931/3953] 10.222.0.52 () {60 vars in 1180 bytes} [Wed Oct 19 03:30:03 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1450 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:30:05.426967 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-26925a8b-2496-409c-b173-6a8faa2bc14c req-c0d45577-53ca-41fd-add6-8f469db571d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e13547eb-efb0-4153-8dec-a666d4e6349b", "name": "network-vif-deleted", "tag": "c2a6f65f-751d-40d2-9e77-e8429e7d45d4"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:30:05.440307 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5c6a167a-734c-486e-83ac-2b395c1255b8 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:05.440830 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5c6a167a-734c-486e-83ac-2b395c1255b8 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:05.444302 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5c6a167a-734c-486e-83ac-2b395c1255b8 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:05.447648 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5c6a167a-734c-486e-83ac-2b395c1255b8 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:05.449679 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5c6a167a-734c-486e-83ac-2b395c1255b8 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:05.450626 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5c6a167a-734c-486e-83ac-2b395c1255b8 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:05.469851 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-26925a8b-2496-409c-b173-6a8faa2bc14c req-c0d45577-53ca-41fd-add6-8f469db571d2 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:05.470506 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-26925a8b-2496-409c-b173-6a8faa2bc14c req-c0d45577-53ca-41fd-add6-8f469db571d2 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:05.470971 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-26925a8b-2496-409c-b173-6a8faa2bc14c req-c0d45577-53ca-41fd-add6-8f469db571d2 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:05.521208 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-26925a8b-2496-409c-b173-6a8faa2bc14c req-c0d45577-53ca-41fd-add6-8f469db571d2 service nova] Creating event network-vif-deleted:c2a6f65f-751d-40d2-9e77-e8429e7d45d4 for instance e13547eb-efb0-4153-8dec-a666d4e6349b on n-h1-861333-8 Oct 19 03:30:05.544079 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-26925a8b-2496-409c-b173-6a8faa2bc14c req-c0d45577-53ca-41fd-add6-8f469db571d2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123648 Oct 19 03:30:05.555349 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1932/3954] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:30:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:30:05.577655 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6f080ae1-6c7c-491a-911e-6df398cfedc5 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:05.578749 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6f080ae1-6c7c-491a-911e-6df398cfedc5 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: ba62d863-e7f4-4653-a03b-66b3549bf8d2] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:05.601233 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6f080ae1-6c7c-491a-911e-6df398cfedc5 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:05.602216 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6f080ae1-6c7c-491a-911e-6df398cfedc5 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:05.603401 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6f080ae1-6c7c-491a-911e-6df398cfedc5 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:05.605308 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6f080ae1-6c7c-491a-911e-6df398cfedc5 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:05.608452 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6f080ae1-6c7c-491a-911e-6df398cfedc5 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:05.609144 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6f080ae1-6c7c-491a-911e-6df398cfedc5 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:05.717333 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-5c6a167a-734c-486e-83ac-2b395c1255b8 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:05.735078 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-5c6a167a-734c-486e-83ac-2b395c1255b8 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:05.736926 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-5c6a167a-734c-486e-83ac-2b395c1255b8 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:05.765083 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5c6a167a-734c-486e-83ac-2b395c1255b8 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] 10.222.0.52 "GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95" status: 200 len: 1604 microversion: 2.42 time: 0.377280 Oct 19 03:30:05.766424 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2023/3955] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:30:05 2022] GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 => generated 1604 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:30:05.778744 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1ddd336b-c5e7-404a-bb17-aa78118fc702 tempest-SecurityGroupRulesTestJSON-1243509135 tempest-SecurityGroupRulesTestJSON-1243509135-project] Action: 'create', calling method: .version_select at 0x7fc12becd670>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-2014646578", "description": "tempest-description-194056895"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:30:05.880759 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-6f080ae1-6c7c-491a-911e-6df398cfedc5 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2b0581ad4e4c9787bef838c81870a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dfe251b1e046a995b8ec302cb2ffa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:05.890626 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6f080ae1-6c7c-491a-911e-6df398cfedc5 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "GET /compute/v2.1/servers/ba62d863-e7f4-4653-a03b-66b3549bf8d2" status: 200 len: 1222 microversion: 2.1 time: 0.327801 Oct 19 03:30:05.897419 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1933/3956] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:30:05 2022] GET /compute/v2.1/servers/ba62d863-e7f4-4653-a03b-66b3549bf8d2 => generated 1222 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:30:06.623152 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1ddd336b-c5e7-404a-bb17-aa78118fc702 tempest-SecurityGroupRulesTestJSON-1243509135 tempest-SecurityGroupRulesTestJSON-1243509135-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.854778 Oct 19 03:30:06.625335 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2024/3957] 10.222.0.52 () {60 vars in 1180 bytes} [Wed Oct 19 03:30:05 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:30:06.642027 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6b9ac24f-5ff7-4406-bcec-2371f0c55a2c tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-2036414396", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "networks": [{"uuid": "c355e1ed-c5bf-4f7d-a359-56c801968bb5"}]}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:30:06.649257 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-051c8d31-163a-478a-bf72-dd95d16956be tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:06.651484 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-051c8d31-163a-478a-bf72-dd95d16956be tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 89f5f23f-8580-46fa-accf-206b1141c301] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:06.699787 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-051c8d31-163a-478a-bf72-dd95d16956be tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:06.700285 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-051c8d31-163a-478a-bf72-dd95d16956be tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:06.709724 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-051c8d31-163a-478a-bf72-dd95d16956be tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:06.716326 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-051c8d31-163a-478a-bf72-dd95d16956be tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:06.726067 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-051c8d31-163a-478a-bf72-dd95d16956be tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:06.727248 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-051c8d31-163a-478a-bf72-dd95d16956be tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:06.847860 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-6b9ac24f-5ff7-4406-bcec-2371f0c55a2c tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] validate_networks() for [('c355e1ed-c5bf-4f7d-a359-56c801968bb5', None, None, None, None, None)] {{(pid=121134) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:30:07.275323 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-051c8d31-163a-478a-bf72-dd95d16956be tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:07.286444 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-051c8d31-163a-478a-bf72-dd95d16956be tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301" status: 200 len: 1390 microversion: 2.1 time: 0.659132 Oct 19 03:30:07.303217 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2025/3958] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:30:06 2022] GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301 => generated 1390 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:30:07.319527 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-30e9774b-370e-45a1-a0ac-61983ee258da tempest-SecurityGroupRulesTestJSON-1243509135 tempest-SecurityGroupRulesTestJSON-1243509135-project] Action: 'create', calling method: .version_select at 0x7fc12becd9d0>, body: {"security_group_rule": {"parent_group_id": "9ab6f34c-8fa5-4c9b-92c2-7e64b5a4af3c", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "d1c9e470-6bce-44e5-9570-ca12e860cf44"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:30:08.243807 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-6b9ac24f-5ff7-4406-bcec-2371f0c55a2c tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Flavor limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:30:08.244952 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-6b9ac24f-5ff7-4406-bcec-2371f0c55a2c tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Image limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:30:08.246400 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-6b9ac24f-5ff7-4406-bcec-2371f0c55a2c tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Flavor pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:30:08.247059 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-6b9ac24f-5ff7-4406-bcec-2371f0c55a2c tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Image pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:30:08.247732 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-6b9ac24f-5ff7-4406-bcec-2371f0c55a2c tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:30:08.262038 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6b9ac24f-5ff7-4406-bcec-2371f0c55a2c tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:08.265724 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6b9ac24f-5ff7-4406-bcec-2371f0c55a2c tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:08.265724 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6b9ac24f-5ff7-4406-bcec-2371f0c55a2c tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:08.265724 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6b9ac24f-5ff7-4406-bcec-2371f0c55a2c tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:08.265724 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6b9ac24f-5ff7-4406-bcec-2371f0c55a2c tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:08.266207 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6b9ac24f-5ff7-4406-bcec-2371f0c55a2c tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:08.304194 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-6b9ac24f-5ff7-4406-bcec-2371f0c55a2c tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Getting quotas for project 6f2b45ceb5804744a7d017c20ec90d17. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:30:08.312873 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-6b9ac24f-5ff7-4406-bcec-2371f0c55a2c tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Getting quotas for user 7dc644418a4740eb93ea25523f2dda2b and project 6f2b45ceb5804744a7d017c20ec90d17. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:30:08.332215 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6b9ac24f-5ff7-4406-bcec-2371f0c55a2c tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Going to run 1 instances... {{(pid=121134) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:30:08.334966 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6b9ac24f-5ff7-4406-bcec-2371f0c55a2c tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] [instance: a4d81635-37be-432c-8b90-31b94961465d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:30:08.577204 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6b9ac24f-5ff7-4406-bcec-2371f0c55a2c tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.665543 Oct 19 03:30:08.578405 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1934/3959] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:30:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 2668 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 03:30:08.586422 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a030f499-55aa-4322-9f6b-b222bbeaff54 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:08.587558 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a030f499-55aa-4322-9f6b-b222bbeaff54 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] [instance: cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:08.596819 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a030f499-55aa-4322-9f6b-b222bbeaff54 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:08.597759 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a030f499-55aa-4322-9f6b-b222bbeaff54 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:08.598688 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a030f499-55aa-4322-9f6b-b222bbeaff54 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:08.599806 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a030f499-55aa-4322-9f6b-b222bbeaff54 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:08.600806 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a030f499-55aa-4322-9f6b-b222bbeaff54 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:08.601645 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a030f499-55aa-4322-9f6b-b222bbeaff54 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:08.748854 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a030f499-55aa-4322-9f6b-b222bbeaff54 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:08.762143 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:30:08.779965 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a030f499-55aa-4322-9f6b-b222bbeaff54 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:08.784554 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a030f499-55aa-4322-9f6b-b222bbeaff54 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:08.791824 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a030f499-55aa-4322-9f6b-b222bbeaff54 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] 10.222.0.52 "GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95" status: 200 len: 1604 microversion: 2.42 time: 0.210557 Oct 19 03:30:08.794500 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1935/3960] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:30:08 2022] GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 => generated 1604 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:30:08.816292 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f28bf767-20c6-4e26-99ee-a3f819275e79 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:08.818213 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f28bf767-20c6-4e26-99ee-a3f819275e79 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: ba62d863-e7f4-4653-a03b-66b3549bf8d2] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:08.846700 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f28bf767-20c6-4e26-99ee-a3f819275e79 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:08.847421 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f28bf767-20c6-4e26-99ee-a3f819275e79 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:08.848790 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f28bf767-20c6-4e26-99ee-a3f819275e79 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:08.851276 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f28bf767-20c6-4e26-99ee-a3f819275e79 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:08.856145 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f28bf767-20c6-4e26-99ee-a3f819275e79 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:08.856145 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f28bf767-20c6-4e26-99ee-a3f819275e79 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:08.910805 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-30e9774b-370e-45a1-a0ac-61983ee258da tempest-SecurityGroupRulesTestJSON-1243509135 tempest-SecurityGroupRulesTestJSON-1243509135-project] 10.222.0.52 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 1.605628 Oct 19 03:30:08.911871 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2026/3961] 10.222.0.52 () {60 vars in 1195 bytes} [Wed Oct 19 03:30:07 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 1608 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:30:08.919540 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5cab3c64-0d54-4507-9bc3-fa14b1549f95 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:08.922003 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-5cab3c64-0d54-4507-9bc3-fa14b1549f95 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 89f5f23f-8580-46fa-accf-206b1141c301] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:08.948760 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5cab3c64-0d54-4507-9bc3-fa14b1549f95 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:08.949220 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5cab3c64-0d54-4507-9bc3-fa14b1549f95 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:08.949706 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5cab3c64-0d54-4507-9bc3-fa14b1549f95 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:08.951322 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5cab3c64-0d54-4507-9bc3-fa14b1549f95 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:08.954277 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5cab3c64-0d54-4507-9bc3-fa14b1549f95 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:08.954964 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5cab3c64-0d54-4507-9bc3-fa14b1549f95 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:09.135871 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-f28bf767-20c6-4e26-99ee-a3f819275e79 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2b0581ad4e4c9787bef838c81870a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dfe251b1e046a995b8ec302cb2ffa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:09.156470 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f28bf767-20c6-4e26-99ee-a3f819275e79 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "GET /compute/v2.1/servers/ba62d863-e7f4-4653-a03b-66b3549bf8d2" status: 200 len: 1276 microversion: 2.1 time: 0.353652 Oct 19 03:30:09.173486 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1936/3962] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:30:08 2022] GET /compute/v2.1/servers/ba62d863-e7f4-4653-a03b-66b3549bf8d2 => generated 1276 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:30:09.185209 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1eeee439-bf65-4f43-ab73-f18765c38cb7 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:09.188437 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1eeee439-bf65-4f43-ab73-f18765c38cb7 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] [instance: a4d81635-37be-432c-8b90-31b94961465d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:09.318614 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-1eeee439-bf65-4f43-ab73-f18765c38cb7 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc644418a4740eb93ea25523f2dda2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2b45ceb5804744a7d017c20ec90d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:09.335215 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1eeee439-bf65-4f43-ab73-f18765c38cb7 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] 10.222.0.52 "GET /compute/v2.1/servers/a4d81635-37be-432c-8b90-31b94961465d" status: 200 len: 1216 microversion: 2.1 time: 0.155014 Oct 19 03:30:09.338686 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1937/3963] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:30:09 2022] GET /compute/v2.1/servers/a4d81635-37be-432c-8b90-31b94961465d => generated 1216 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:30:09.349243 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9351c391-f790-45d3-b6f1-def8cacc042a tempest-SecurityGroupRulesTestJSON-1243509135 tempest-SecurityGroupRulesTestJSON-1243509135-project] Action: 'create', calling method: .version_select at 0x7fc1300a03a0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-815346316", "description": "tempest-description-1393047078"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:30:09.459381 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-5cab3c64-0d54-4507-9bc3-fa14b1549f95 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:09.475984 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5cab3c64-0d54-4507-9bc3-fa14b1549f95 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301" status: 200 len: 1390 microversion: 2.1 time: 0.562509 Oct 19 03:30:09.479117 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2027/3964] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:30:08 2022] GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301 => generated 1390 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:30:09.823830 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d6172bfa-62c7-486e-a8ae-654c041fdcf0 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:09.826090 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d6172bfa-62c7-486e-a8ae-654c041fdcf0 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] [instance: cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:09.843443 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d6172bfa-62c7-486e-a8ae-654c041fdcf0 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:09.845684 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d6172bfa-62c7-486e-a8ae-654c041fdcf0 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:09.847120 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d6172bfa-62c7-486e-a8ae-654c041fdcf0 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:09.850430 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d6172bfa-62c7-486e-a8ae-654c041fdcf0 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:09.851611 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d6172bfa-62c7-486e-a8ae-654c041fdcf0 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:09.852912 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d6172bfa-62c7-486e-a8ae-654c041fdcf0 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:10.072969 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9351c391-f790-45d3-b6f1-def8cacc042a tempest-SecurityGroupRulesTestJSON-1243509135 tempest-SecurityGroupRulesTestJSON-1243509135-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.732203 Oct 19 03:30:10.073843 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1938/3965] 10.222.0.52 () {60 vars in 1180 bytes} [Wed Oct 19 03:30:09 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:30:10.084668 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d6172bfa-62c7-486e-a8ae-654c041fdcf0 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:10.094577 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-41ea962e-824c-47da-9bd0-35c7afcc8831 tempest-SecurityGroupRulesTestJSON-1243509135 tempest-SecurityGroupRulesTestJSON-1243509135-project] Action: 'create', calling method: .version_select at 0x7fc1300d1dc0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1587710290", "description": "tempest-description-2094893086"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:30:10.118410 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d6172bfa-62c7-486e-a8ae-654c041fdcf0 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:10.128012 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d6172bfa-62c7-486e-a8ae-654c041fdcf0 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:10.136392 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d6172bfa-62c7-486e-a8ae-654c041fdcf0 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] 10.222.0.52 "GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95" status: 200 len: 1604 microversion: 2.42 time: 0.318731 Oct 19 03:30:10.151360 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2028/3966] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:30:09 2022] GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 => generated 1604 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:30:10.186270 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9c7ab139-1370-4b40-a9e2-164d087b6e4f tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:10.187290 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9c7ab139-1370-4b40-a9e2-164d087b6e4f tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: ba62d863-e7f4-4653-a03b-66b3549bf8d2] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:10.209692 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9c7ab139-1370-4b40-a9e2-164d087b6e4f tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:10.210204 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9c7ab139-1370-4b40-a9e2-164d087b6e4f tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:10.210656 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9c7ab139-1370-4b40-a9e2-164d087b6e4f tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:10.211378 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9c7ab139-1370-4b40-a9e2-164d087b6e4f tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:10.216825 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9c7ab139-1370-4b40-a9e2-164d087b6e4f tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:10.222007 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9c7ab139-1370-4b40-a9e2-164d087b6e4f tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:10.789393 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-9c7ab139-1370-4b40-a9e2-164d087b6e4f tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2b0581ad4e4c9787bef838c81870a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dfe251b1e046a995b8ec302cb2ffa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:10.800857 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9c7ab139-1370-4b40-a9e2-164d087b6e4f tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "GET /compute/v2.1/servers/ba62d863-e7f4-4653-a03b-66b3549bf8d2" status: 200 len: 1318 microversion: 2.1 time: 0.619197 Oct 19 03:30:10.810078 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2029/3967] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:30:10 2022] GET /compute/v2.1/servers/ba62d863-e7f4-4653-a03b-66b3549bf8d2 => generated 1318 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:30:10.842921 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4161e86f-e5e5-4384-813a-a3c8a1e71f72 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:10.843603 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4161e86f-e5e5-4384-813a-a3c8a1e71f72 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] [instance: a4d81635-37be-432c-8b90-31b94961465d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:10.867029 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4161e86f-e5e5-4384-813a-a3c8a1e71f72 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:10.867336 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4161e86f-e5e5-4384-813a-a3c8a1e71f72 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:10.868008 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4161e86f-e5e5-4384-813a-a3c8a1e71f72 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:10.868927 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4161e86f-e5e5-4384-813a-a3c8a1e71f72 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:10.873799 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4161e86f-e5e5-4384-813a-a3c8a1e71f72 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:10.874563 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4161e86f-e5e5-4384-813a-a3c8a1e71f72 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:11.087637 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4161e86f-e5e5-4384-813a-a3c8a1e71f72 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc644418a4740eb93ea25523f2dda2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2b45ceb5804744a7d017c20ec90d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:11.091254 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-41ea962e-824c-47da-9bd0-35c7afcc8831 tempest-SecurityGroupRulesTestJSON-1243509135 tempest-SecurityGroupRulesTestJSON-1243509135-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 1.007327 Oct 19 03:30:11.092429 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1939/3968] 10.222.0.52 () {60 vars in 1180 bytes} [Wed Oct 19 03:30:10 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:30:11.097329 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-cae328ed-a13d-4044-9b57-eb7398f0c06d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:11.101414 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-cae328ed-a13d-4044-9b57-eb7398f0c06d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 89f5f23f-8580-46fa-accf-206b1141c301] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:11.127597 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cae328ed-a13d-4044-9b57-eb7398f0c06d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:11.128030 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cae328ed-a13d-4044-9b57-eb7398f0c06d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:11.128484 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cae328ed-a13d-4044-9b57-eb7398f0c06d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:11.129213 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cae328ed-a13d-4044-9b57-eb7398f0c06d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:11.142709 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4161e86f-e5e5-4384-813a-a3c8a1e71f72 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] 10.222.0.52 "GET /compute/v2.1/servers/a4d81635-37be-432c-8b90-31b94961465d" status: 200 len: 1220 microversion: 2.1 time: 0.331419 Oct 19 03:30:11.143384 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cae328ed-a13d-4044-9b57-eb7398f0c06d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:11.145516 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cae328ed-a13d-4044-9b57-eb7398f0c06d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:11.152299 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2030/3969] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:30:10 2022] GET /compute/v2.1/servers/a4d81635-37be-432c-8b90-31b94961465d => generated 1220 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:30:11.183297 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-8bc051b2-a766-4c52-878e-449c0d5f625b tempest-SecurityGroupRulesTestJSON-1243509135 tempest-SecurityGroupRulesTestJSON-1243509135-project] Action: 'create', calling method: .version_select at 0x7fc12bf093a0>, body: {"security_group_rule": {"parent_group_id": "25fe1f2f-1e89-446a-af22-278095dec83b", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "5e56735f-7b18-4de1-9463-d2191b65b92e"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:30:11.877546 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-cae328ed-a13d-4044-9b57-eb7398f0c06d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:11.899916 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-cae328ed-a13d-4044-9b57-eb7398f0c06d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301" status: 200 len: 1390 microversion: 2.1 time: 0.804912 Oct 19 03:30:11.913461 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1940/3970] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:30:11 2022] GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301 => generated 1390 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:30:11.924640 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-21a24067-e546-4234-bcc6-b518841ffb5f tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:11.929829 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-21a24067-e546-4234-bcc6-b518841ffb5f tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] [instance: cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:11.966342 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-21a24067-e546-4234-bcc6-b518841ffb5f tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:11.966951 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-21a24067-e546-4234-bcc6-b518841ffb5f tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:11.971744 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-21a24067-e546-4234-bcc6-b518841ffb5f tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:11.983351 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-21a24067-e546-4234-bcc6-b518841ffb5f tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:11.984123 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-21a24067-e546-4234-bcc6-b518841ffb5f tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:11.984778 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-21a24067-e546-4234-bcc6-b518841ffb5f tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:12.228995 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-21a24067-e546-4234-bcc6-b518841ffb5f tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:12.247887 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-21a24067-e546-4234-bcc6-b518841ffb5f tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:12.272462 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-21a24067-e546-4234-bcc6-b518841ffb5f tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:12.274493 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-21a24067-e546-4234-bcc6-b518841ffb5f tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] 10.222.0.52 "GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95" status: 200 len: 1604 microversion: 2.42 time: 0.359575 Oct 19 03:30:12.282803 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1941/3971] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:30:11 2022] GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 => generated 1604 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:30:12.300138 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0bf2d337-1ab5-4716-86a5-66c234c781dd tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:12.303313 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0bf2d337-1ab5-4716-86a5-66c234c781dd tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: ba62d863-e7f4-4653-a03b-66b3549bf8d2] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:12.323453 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0bf2d337-1ab5-4716-86a5-66c234c781dd tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:12.325905 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0bf2d337-1ab5-4716-86a5-66c234c781dd tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:12.326571 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0bf2d337-1ab5-4716-86a5-66c234c781dd tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:12.331759 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0bf2d337-1ab5-4716-86a5-66c234c781dd tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:12.333536 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0bf2d337-1ab5-4716-86a5-66c234c781dd tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:12.339886 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0bf2d337-1ab5-4716-86a5-66c234c781dd tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:12.743037 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-8bc051b2-a766-4c52-878e-449c0d5f625b tempest-SecurityGroupRulesTestJSON-1243509135 tempest-SecurityGroupRulesTestJSON-1243509135-project] 10.222.0.52 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 1.587815 Oct 19 03:30:12.751125 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2031/3972] 10.222.0.52 () {60 vars in 1195 bytes} [Wed Oct 19 03:30:11 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 1591 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:30:12.751125 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-170199de-ce01-40e0-a519-3ab62cd306f0 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:12.751125 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-170199de-ce01-40e0-a519-3ab62cd306f0 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] [instance: a4d81635-37be-432c-8b90-31b94961465d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:12.796922 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-170199de-ce01-40e0-a519-3ab62cd306f0 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:12.800637 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-170199de-ce01-40e0-a519-3ab62cd306f0 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:12.803986 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-170199de-ce01-40e0-a519-3ab62cd306f0 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:12.808741 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-170199de-ce01-40e0-a519-3ab62cd306f0 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:12.830024 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-170199de-ce01-40e0-a519-3ab62cd306f0 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:12.834268 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-170199de-ce01-40e0-a519-3ab62cd306f0 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:13.118538 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0bf2d337-1ab5-4716-86a5-66c234c781dd tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2b0581ad4e4c9787bef838c81870a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dfe251b1e046a995b8ec302cb2ffa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:13.129646 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0bf2d337-1ab5-4716-86a5-66c234c781dd tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "GET /compute/v2.1/servers/ba62d863-e7f4-4653-a03b-66b3549bf8d2" status: 200 len: 1318 microversion: 2.1 time: 0.844726 Oct 19 03:30:13.140148 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1942/3973] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:30:12 2022] GET /compute/v2.1/servers/ba62d863-e7f4-4653-a03b-66b3549bf8d2 => generated 1318 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:30:13.159881 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e9ddb7b6-8b7c-4d46-850f-089ad23f2ddd tempest-SecurityGroupRulesTestJSON-1243509135 tempest-SecurityGroupRulesTestJSON-1243509135-project] Calling method '.version_select at 0x7fc1300b45e0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:13.291003 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-170199de-ce01-40e0-a519-3ab62cd306f0 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc644418a4740eb93ea25523f2dda2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2b45ceb5804744a7d017c20ec90d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:13.338473 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-170199de-ce01-40e0-a519-3ab62cd306f0 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] 10.222.0.52 "GET /compute/v2.1/servers/a4d81635-37be-432c-8b90-31b94961465d" status: 200 len: 1276 microversion: 2.1 time: 0.592678 Oct 19 03:30:13.341552 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2032/3974] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:30:12 2022] GET /compute/v2.1/servers/a4d81635-37be-432c-8b90-31b94961465d => generated 1276 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:30:13.385647 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c83ad6da-c772-4c4c-85fb-971e03c7258c tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:13.394997 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c83ad6da-c772-4c4c-85fb-971e03c7258c tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 89f5f23f-8580-46fa-accf-206b1141c301] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:13.431870 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c83ad6da-c772-4c4c-85fb-971e03c7258c tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:13.436368 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c83ad6da-c772-4c4c-85fb-971e03c7258c tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:13.439055 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c83ad6da-c772-4c4c-85fb-971e03c7258c tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:13.442106 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c83ad6da-c772-4c4c-85fb-971e03c7258c tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:13.450627 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c83ad6da-c772-4c4c-85fb-971e03c7258c tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:13.456286 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c83ad6da-c772-4c4c-85fb-971e03c7258c tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:14.109005 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c83ad6da-c772-4c4c-85fb-971e03c7258c tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:14.127674 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c83ad6da-c772-4c4c-85fb-971e03c7258c tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301" status: 200 len: 1390 microversion: 2.1 time: 0.769784 Oct 19 03:30:14.128405 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2033/3975] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:30:13 2022] GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301 => generated 1390 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:30:14.153210 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-72e7a008-40fa-4899-94e3-946a793399f7 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:14.153865 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-72e7a008-40fa-4899-94e3-946a793399f7 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] [instance: cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:14.172435 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e9ddb7b6-8b7c-4d46-850f-089ad23f2ddd tempest-SecurityGroupRulesTestJSON-1243509135 tempest-SecurityGroupRulesTestJSON-1243509135-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/5e56735f-7b18-4de1-9463-d2191b65b92e" status: 202 len: 0 microversion: 2.1 time: 1.025472 Oct 19 03:30:14.172435 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1943/3976] 10.222.0.52 () {58 vars in 1272 bytes} [Wed Oct 19 03:30:13 2022] DELETE /compute/v2.1/os-security-groups/5e56735f-7b18-4de1-9463-d2191b65b92e => generated 0 bytes in 1028 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:30:14.175804 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4c18ef39-8b77-4149-828d-39fe02609a8f tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:14.179588 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4c18ef39-8b77-4149-828d-39fe02609a8f tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: ba62d863-e7f4-4653-a03b-66b3549bf8d2] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:14.199872 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4c18ef39-8b77-4149-828d-39fe02609a8f tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:14.200664 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4c18ef39-8b77-4149-828d-39fe02609a8f tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:14.201914 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4c18ef39-8b77-4149-828d-39fe02609a8f tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:14.202995 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4c18ef39-8b77-4149-828d-39fe02609a8f tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:14.207998 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4c18ef39-8b77-4149-828d-39fe02609a8f tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:14.208784 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-72e7a008-40fa-4899-94e3-946a793399f7 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:14.209001 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4c18ef39-8b77-4149-828d-39fe02609a8f tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:14.209298 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-72e7a008-40fa-4899-94e3-946a793399f7 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:14.230456 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-72e7a008-40fa-4899-94e3-946a793399f7 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:14.231451 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-72e7a008-40fa-4899-94e3-946a793399f7 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:14.236206 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-72e7a008-40fa-4899-94e3-946a793399f7 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:14.236668 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-72e7a008-40fa-4899-94e3-946a793399f7 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:14.411500 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:30:14.487009 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-72e7a008-40fa-4899-94e3-946a793399f7 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:14.511592 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-72e7a008-40fa-4899-94e3-946a793399f7 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:14.517073 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-72e7a008-40fa-4899-94e3-946a793399f7 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:14.520729 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-72e7a008-40fa-4899-94e3-946a793399f7 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] 10.222.0.52 "GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95" status: 200 len: 1604 microversion: 2.42 time: 0.386546 Oct 19 03:30:14.524194 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2034/3977] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:30:14 2022] GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 => generated 1604 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:30:14.541845 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e064bba6-bfa7-4651-a06c-e0790db1f8d5 tempest-SecurityGroupRulesTestJSON-1243509135 tempest-SecurityGroupRulesTestJSON-1243509135-project] Calling method '.version_select at 0x7fc12bf531f0>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:14.566971 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-4c18ef39-8b77-4149-828d-39fe02609a8f tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2b0581ad4e4c9787bef838c81870a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dfe251b1e046a995b8ec302cb2ffa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:14.580668 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4c18ef39-8b77-4149-828d-39fe02609a8f tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "GET /compute/v2.1/servers/ba62d863-e7f4-4653-a03b-66b3549bf8d2" status: 200 len: 1318 microversion: 2.1 time: 0.410404 Oct 19 03:30:14.581319 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1944/3978] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:30:14 2022] GET /compute/v2.1/servers/ba62d863-e7f4-4653-a03b-66b3549bf8d2 => generated 1318 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:30:14.634471 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-95e5eaf8-e1ea-46ef-b3ff-4f4d2da883f2 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:14.635104 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-95e5eaf8-e1ea-46ef-b3ff-4f4d2da883f2 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] [instance: a4d81635-37be-432c-8b90-31b94961465d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:14.677576 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-95e5eaf8-e1ea-46ef-b3ff-4f4d2da883f2 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:14.678177 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-95e5eaf8-e1ea-46ef-b3ff-4f4d2da883f2 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:14.678743 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-95e5eaf8-e1ea-46ef-b3ff-4f4d2da883f2 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:14.679500 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-95e5eaf8-e1ea-46ef-b3ff-4f4d2da883f2 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:14.690104 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-95e5eaf8-e1ea-46ef-b3ff-4f4d2da883f2 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:14.690661 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-95e5eaf8-e1ea-46ef-b3ff-4f4d2da883f2 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:14.783173 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e064bba6-bfa7-4651-a06c-e0790db1f8d5 tempest-SecurityGroupRulesTestJSON-1243509135 tempest-SecurityGroupRulesTestJSON-1243509135-project] 10.222.0.52 "GET /compute/v2.1/os-security-groups/25fe1f2f-1e89-446a-af22-278095dec83b" status: 200 len: 247 microversion: 2.1 time: 0.256784 Oct 19 03:30:14.783932 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2035/3979] 10.222.0.52 () {58 vars in 1269 bytes} [Wed Oct 19 03:30:14 2022] GET /compute/v2.1/os-security-groups/25fe1f2f-1e89-446a-af22-278095dec83b => generated 247 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:30:14.801943 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d705e9d5-45fe-4e52-b590-e14e3c0f578b tempest-SecurityGroupRulesTestJSON-1243509135 tempest-SecurityGroupRulesTestJSON-1243509135-project] Action: 'create', calling method: .version_select at 0x7fc12beb3a60>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-61244644", "description": "tempest-description-58517232"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:30:14.868578 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-95e5eaf8-e1ea-46ef-b3ff-4f4d2da883f2 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc644418a4740eb93ea25523f2dda2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2b45ceb5804744a7d017c20ec90d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:14.882244 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-95e5eaf8-e1ea-46ef-b3ff-4f4d2da883f2 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] 10.222.0.52 "GET /compute/v2.1/servers/a4d81635-37be-432c-8b90-31b94961465d" status: 200 len: 1274 microversion: 2.1 time: 0.268366 Oct 19 03:30:14.883418 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1945/3980] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:30:14 2022] GET /compute/v2.1/servers/a4d81635-37be-432c-8b90-31b94961465d => generated 1274 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:30:15.155206 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8c129e46-83c1-4b5c-bdfd-17b41b5af467 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:15.155897 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8c129e46-83c1-4b5c-bdfd-17b41b5af467 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 89f5f23f-8580-46fa-accf-206b1141c301] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:15.168227 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8c129e46-83c1-4b5c-bdfd-17b41b5af467 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:15.168955 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8c129e46-83c1-4b5c-bdfd-17b41b5af467 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:15.170199 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8c129e46-83c1-4b5c-bdfd-17b41b5af467 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:15.173384 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8c129e46-83c1-4b5c-bdfd-17b41b5af467 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:15.174623 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8c129e46-83c1-4b5c-bdfd-17b41b5af467 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:15.177896 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8c129e46-83c1-4b5c-bdfd-17b41b5af467 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:15.462215 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8c129e46-83c1-4b5c-bdfd-17b41b5af467 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:15.479383 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8c129e46-83c1-4b5c-bdfd-17b41b5af467 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301" status: 200 len: 1390 microversion: 2.1 time: 0.328106 Oct 19 03:30:15.483590 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1946/3981] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:30:15 2022] GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301 => generated 1390 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:30:15.553567 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8b3b9c4c-2ad0-4cec-ad33-4aaf6fea9259 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:15.554097 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8b3b9c4c-2ad0-4cec-ad33-4aaf6fea9259 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] [instance: cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:15.565700 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8b3b9c4c-2ad0-4cec-ad33-4aaf6fea9259 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:15.566511 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8b3b9c4c-2ad0-4cec-ad33-4aaf6fea9259 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:15.567161 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8b3b9c4c-2ad0-4cec-ad33-4aaf6fea9259 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:15.570223 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8b3b9c4c-2ad0-4cec-ad33-4aaf6fea9259 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:15.570949 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8b3b9c4c-2ad0-4cec-ad33-4aaf6fea9259 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:15.571620 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8b3b9c4c-2ad0-4cec-ad33-4aaf6fea9259 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:15.689717 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8b3b9c4c-2ad0-4cec-ad33-4aaf6fea9259 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:15.708406 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8b3b9c4c-2ad0-4cec-ad33-4aaf6fea9259 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:15.710472 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8b3b9c4c-2ad0-4cec-ad33-4aaf6fea9259 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:15.712275 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8b3b9c4c-2ad0-4cec-ad33-4aaf6fea9259 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] 10.222.0.52 "GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95" status: 200 len: 1604 microversion: 2.42 time: 0.162679 Oct 19 03:30:15.718020 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1947/3982] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:30:15 2022] GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 => generated 1604 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:30:15.730917 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d52014b8-48a7-4792-830b-22d269be2cad tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:15.731674 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d52014b8-48a7-4792-830b-22d269be2cad tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: ba62d863-e7f4-4653-a03b-66b3549bf8d2] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:15.739179 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d52014b8-48a7-4792-830b-22d269be2cad tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:15.739663 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d52014b8-48a7-4792-830b-22d269be2cad tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:15.740105 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d52014b8-48a7-4792-830b-22d269be2cad tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:15.740819 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d52014b8-48a7-4792-830b-22d269be2cad tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:15.741272 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d52014b8-48a7-4792-830b-22d269be2cad tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:15.741727 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d52014b8-48a7-4792-830b-22d269be2cad tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:15.753696 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d705e9d5-45fe-4e52-b590-e14e3c0f578b tempest-SecurityGroupRulesTestJSON-1243509135 tempest-SecurityGroupRulesTestJSON-1243509135-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.956258 Oct 19 03:30:15.754823 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2036/3983] 10.222.0.52 () {60 vars in 1180 bytes} [Wed Oct 19 03:30:14 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:30:15.768842 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-82855074-7547-43f0-abe2-93ccd25e4ecd tempest-SecurityGroupRulesTestJSON-1243509135 tempest-SecurityGroupRulesTestJSON-1243509135-project] Action: 'create', calling method: .version_select at 0x7fc12bedcb80>, body: {"security_group_rule": {"parent_group_id": "d263f0d6-14e4-4ce4-ab80-3485eb9ee8d3", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:30:15.983484 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d52014b8-48a7-4792-830b-22d269be2cad tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2b0581ad4e4c9787bef838c81870a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dfe251b1e046a995b8ec302cb2ffa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:16.031120 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d52014b8-48a7-4792-830b-22d269be2cad tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "GET /compute/v2.1/servers/ba62d863-e7f4-4653-a03b-66b3549bf8d2" status: 200 len: 1318 microversion: 2.1 time: 0.306629 Oct 19 03:30:16.031796 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1948/3984] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:30:15 2022] GET /compute/v2.1/servers/ba62d863-e7f4-4653-a03b-66b3549bf8d2 => generated 1318 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:30:16.045802 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-67d5b20f-e0f2-46a7-8a3a-8ea7b9dfe057 req-d114fa44-06ac-4a20-8002-f2e282df368b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba62d863-e7f4-4653-a03b-66b3549bf8d2", "tag": "7d547af1-e25e-409d-af52-381f964bce3e"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:30:16.064066 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:30:16.066603 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-67d5b20f-e0f2-46a7-8a3a-8ea7b9dfe057 req-d114fa44-06ac-4a20-8002-f2e282df368b service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:16.067493 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-67d5b20f-e0f2-46a7-8a3a-8ea7b9dfe057 req-d114fa44-06ac-4a20-8002-f2e282df368b service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:16.068278 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-67d5b20f-e0f2-46a7-8a3a-8ea7b9dfe057 req-d114fa44-06ac-4a20-8002-f2e282df368b service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:16.099546 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-67d5b20f-e0f2-46a7-8a3a-8ea7b9dfe057 req-d114fa44-06ac-4a20-8002-f2e282df368b service nova] Creating event network-changed:7d547af1-e25e-409d-af52-381f964bce3e for instance ba62d863-e7f4-4653-a03b-66b3549bf8d2 on n-h2-861333-8 Oct 19 03:30:16.107412 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-67d5b20f-e0f2-46a7-8a3a-8ea7b9dfe057 req-d114fa44-06ac-4a20-8002-f2e282df368b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072118 Oct 19 03:30:16.108755 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1949/3985] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:30:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:30:16.116646 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a4915b47-16a2-41ff-b8bc-31c90bc3fd25 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:16.116646 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a4915b47-16a2-41ff-b8bc-31c90bc3fd25 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] [instance: a4d81635-37be-432c-8b90-31b94961465d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:16.128725 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a4915b47-16a2-41ff-b8bc-31c90bc3fd25 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:16.129360 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a4915b47-16a2-41ff-b8bc-31c90bc3fd25 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:16.130112 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a4915b47-16a2-41ff-b8bc-31c90bc3fd25 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:16.131172 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a4915b47-16a2-41ff-b8bc-31c90bc3fd25 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:16.131855 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a4915b47-16a2-41ff-b8bc-31c90bc3fd25 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:16.132909 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a4915b47-16a2-41ff-b8bc-31c90bc3fd25 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:17.226856 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a4915b47-16a2-41ff-b8bc-31c90bc3fd25 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc644418a4740eb93ea25523f2dda2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2b45ceb5804744a7d017c20ec90d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:17.238500 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a4915b47-16a2-41ff-b8bc-31c90bc3fd25 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] 10.222.0.52 "GET /compute/v2.1/servers/a4d81635-37be-432c-8b90-31b94961465d" status: 200 len: 1316 microversion: 2.1 time: 1.128260 Oct 19 03:30:17.240481 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1950/3986] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:30:16 2022] GET /compute/v2.1/servers/a4d81635-37be-432c-8b90-31b94961465d => generated 1316 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:30:17.259158 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-cbe7541e-62dc-432d-a845-b6230b5d9dc6 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:17.264569 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-cbe7541e-62dc-432d-a845-b6230b5d9dc6 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 89f5f23f-8580-46fa-accf-206b1141c301] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:17.273952 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cbe7541e-62dc-432d-a845-b6230b5d9dc6 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:17.277022 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cbe7541e-62dc-432d-a845-b6230b5d9dc6 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:17.277721 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cbe7541e-62dc-432d-a845-b6230b5d9dc6 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:17.278626 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cbe7541e-62dc-432d-a845-b6230b5d9dc6 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:17.280685 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cbe7541e-62dc-432d-a845-b6230b5d9dc6 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:17.281291 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cbe7541e-62dc-432d-a845-b6230b5d9dc6 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:17.286072 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-82855074-7547-43f0-abe2-93ccd25e4ecd tempest-SecurityGroupRulesTestJSON-1243509135 tempest-SecurityGroupRulesTestJSON-1243509135-project] 10.222.0.52 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.519163 Oct 19 03:30:17.298482 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2037/3987] 10.222.0.52 () {60 vars in 1195 bytes} [Wed Oct 19 03:30:15 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1524 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:30:17.303241 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b7c6561c-6633-4c22-952b-9b007bd85c5e tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:17.304092 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b7c6561c-6633-4c22-952b-9b007bd85c5e tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] [instance: cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:17.311577 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b7c6561c-6633-4c22-952b-9b007bd85c5e tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:17.312922 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b7c6561c-6633-4c22-952b-9b007bd85c5e tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:17.313831 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b7c6561c-6633-4c22-952b-9b007bd85c5e tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:17.314818 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b7c6561c-6633-4c22-952b-9b007bd85c5e tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:17.315483 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b7c6561c-6633-4c22-952b-9b007bd85c5e tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:17.316165 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b7c6561c-6633-4c22-952b-9b007bd85c5e tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:17.544445 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b7c6561c-6633-4c22-952b-9b007bd85c5e tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:17.561732 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b7c6561c-6633-4c22-952b-9b007bd85c5e tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:17.574639 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b7c6561c-6633-4c22-952b-9b007bd85c5e tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:17.584129 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b7c6561c-6633-4c22-952b-9b007bd85c5e tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] 10.222.0.52 "GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95" status: 200 len: 1604 microversion: 2.42 time: 0.293315 Oct 19 03:30:17.585065 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2038/3988] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:30:17 2022] GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 => generated 1604 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:30:17.592296 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3cd860bc-c20e-4f16-90c1-8e7c56cc34f4 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:17.594077 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-3cd860bc-c20e-4f16-90c1-8e7c56cc34f4 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: ba62d863-e7f4-4653-a03b-66b3549bf8d2] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:17.627754 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3cd860bc-c20e-4f16-90c1-8e7c56cc34f4 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:17.636378 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3cd860bc-c20e-4f16-90c1-8e7c56cc34f4 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:17.649776 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3cd860bc-c20e-4f16-90c1-8e7c56cc34f4 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:17.650988 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3cd860bc-c20e-4f16-90c1-8e7c56cc34f4 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:17.651650 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3cd860bc-c20e-4f16-90c1-8e7c56cc34f4 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:17.652089 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3cd860bc-c20e-4f16-90c1-8e7c56cc34f4 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:17.923192 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-cbe7541e-62dc-432d-a845-b6230b5d9dc6 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:17.935079 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-cbe7541e-62dc-432d-a845-b6230b5d9dc6 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301" status: 200 len: 1390 microversion: 2.1 time: 0.692452 Oct 19 03:30:17.938838 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1951/3989] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:30:17 2022] GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301 => generated 1390 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:30:17.946233 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6a546cd5-6fae-4f98-a12f-17aa2ab0cdf9 tempest-SecurityGroupRulesTestJSON-1243509135 tempest-SecurityGroupRulesTestJSON-1243509135-project] Action: 'create', calling method: .version_select at 0x7fc130541dc0>, body: {"security_group_rule": {"parent_group_id": "d263f0d6-14e4-4ce4-ab80-3485eb9ee8d3", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:30:18.056882 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-3cd860bc-c20e-4f16-90c1-8e7c56cc34f4 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2b0581ad4e4c9787bef838c81870a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dfe251b1e046a995b8ec302cb2ffa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:18.056882 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-3cd860bc-c20e-4f16-90c1-8e7c56cc34f4 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "GET /compute/v2.1/servers/ba62d863-e7f4-4653-a03b-66b3549bf8d2" status: 200 len: 1318 microversion: 2.1 time: 0.466350 Oct 19 03:30:18.056882 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2039/3990] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:30:17 2022] GET /compute/v2.1/servers/ba62d863-e7f4-4653-a03b-66b3549bf8d2 => generated 1318 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:30:18.264697 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7e515aff-1deb-4b5a-b77e-4d1027920245 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:18.265324 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7e515aff-1deb-4b5a-b77e-4d1027920245 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] [instance: a4d81635-37be-432c-8b90-31b94961465d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:18.276877 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7e515aff-1deb-4b5a-b77e-4d1027920245 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:18.276877 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7e515aff-1deb-4b5a-b77e-4d1027920245 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:18.278105 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=4 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:30:18.278555 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7e515aff-1deb-4b5a-b77e-4d1027920245 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:18.288251 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7e515aff-1deb-4b5a-b77e-4d1027920245 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:18.288857 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7e515aff-1deb-4b5a-b77e-4d1027920245 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:18.289299 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7e515aff-1deb-4b5a-b77e-4d1027920245 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:18.900446 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7e515aff-1deb-4b5a-b77e-4d1027920245 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc644418a4740eb93ea25523f2dda2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2b45ceb5804744a7d017c20ec90d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:18.914700 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7e515aff-1deb-4b5a-b77e-4d1027920245 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] 10.222.0.52 "GET /compute/v2.1/servers/a4d81635-37be-432c-8b90-31b94961465d" status: 200 len: 1316 microversion: 2.1 time: 0.653440 Oct 19 03:30:18.922402 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2040/3991] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:30:18 2022] GET /compute/v2.1/servers/a4d81635-37be-432c-8b90-31b94961465d => generated 1316 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:30:18.928081 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-826c3f87-72bb-41f8-a1db-b7c06408ff35 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:18.932988 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-826c3f87-72bb-41f8-a1db-b7c06408ff35 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] [instance: cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:18.937080 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-826c3f87-72bb-41f8-a1db-b7c06408ff35 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:18.937864 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-826c3f87-72bb-41f8-a1db-b7c06408ff35 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:18.938484 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-826c3f87-72bb-41f8-a1db-b7c06408ff35 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:18.939364 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-826c3f87-72bb-41f8-a1db-b7c06408ff35 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:18.939980 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-826c3f87-72bb-41f8-a1db-b7c06408ff35 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:18.940593 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-826c3f87-72bb-41f8-a1db-b7c06408ff35 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:19.095608 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-826c3f87-72bb-41f8-a1db-b7c06408ff35 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:19.111414 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-826c3f87-72bb-41f8-a1db-b7c06408ff35 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:19.113021 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-826c3f87-72bb-41f8-a1db-b7c06408ff35 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:19.114338 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-826c3f87-72bb-41f8-a1db-b7c06408ff35 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] 10.222.0.52 "GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95" status: 200 len: 1604 microversion: 2.42 time: 0.190467 Oct 19 03:30:19.115664 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2041/3992] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:30:18 2022] GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 => generated 1604 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:30:19.126495 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5196f7fc-bdc5-403b-87a3-a03ce8a150eb tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:19.126495 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-5196f7fc-bdc5-403b-87a3-a03ce8a150eb tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 89f5f23f-8580-46fa-accf-206b1141c301] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:19.130499 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5196f7fc-bdc5-403b-87a3-a03ce8a150eb tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:19.131487 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5196f7fc-bdc5-403b-87a3-a03ce8a150eb tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:19.132201 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5196f7fc-bdc5-403b-87a3-a03ce8a150eb tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:19.133149 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5196f7fc-bdc5-403b-87a3-a03ce8a150eb tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:19.135180 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5196f7fc-bdc5-403b-87a3-a03ce8a150eb tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:19.136581 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5196f7fc-bdc5-403b-87a3-a03ce8a150eb tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:19.171960 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6a546cd5-6fae-4f98-a12f-17aa2ab0cdf9 tempest-SecurityGroupRulesTestJSON-1243509135 tempest-SecurityGroupRulesTestJSON-1243509135-project] 10.222.0.52 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 1.230972 Oct 19 03:30:19.173232 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1952/3993] 10.222.0.52 () {60 vars in 1195 bytes} [Wed Oct 19 03:30:17 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:30:19.178746 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-fbeae54f-c889-4edd-870d-b6883e6bd9c9 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:19.179982 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-fbeae54f-c889-4edd-870d-b6883e6bd9c9 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: ba62d863-e7f4-4653-a03b-66b3549bf8d2] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:19.195238 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fbeae54f-c889-4edd-870d-b6883e6bd9c9 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:19.196590 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fbeae54f-c889-4edd-870d-b6883e6bd9c9 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:19.197300 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fbeae54f-c889-4edd-870d-b6883e6bd9c9 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:19.198458 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fbeae54f-c889-4edd-870d-b6883e6bd9c9 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:19.199183 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fbeae54f-c889-4edd-870d-b6883e6bd9c9 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:19.199932 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fbeae54f-c889-4edd-870d-b6883e6bd9c9 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:19.325489 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=14 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:30:19.519603 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-fbeae54f-c889-4edd-870d-b6883e6bd9c9 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2b0581ad4e4c9787bef838c81870a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dfe251b1e046a995b8ec302cb2ffa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:19.534005 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-fbeae54f-c889-4edd-870d-b6883e6bd9c9 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "GET /compute/v2.1/servers/ba62d863-e7f4-4653-a03b-66b3549bf8d2" status: 200 len: 1318 microversion: 2.1 time: 0.356284 Oct 19 03:30:19.536838 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1953/3994] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:30:19 2022] GET /compute/v2.1/servers/ba62d863-e7f4-4653-a03b-66b3549bf8d2 => generated 1318 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:30:19.547782 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6f903069-8943-4633-a848-01de63611bd5 tempest-SecurityGroupRulesTestJSON-1243509135 tempest-SecurityGroupRulesTestJSON-1243509135-project] Calling method '.version_select at 0x7fc1300c4310>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:19.579457 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-5196f7fc-bdc5-403b-87a3-a03ce8a150eb tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:19.588254 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5196f7fc-bdc5-403b-87a3-a03ce8a150eb tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301" status: 200 len: 1390 microversion: 2.1 time: 0.469699 Oct 19 03:30:19.591456 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2042/3995] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:30:19 2022] GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301 => generated 1390 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:30:19.672165 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6f903069-8943-4633-a848-01de63611bd5 tempest-SecurityGroupRulesTestJSON-1243509135 tempest-SecurityGroupRulesTestJSON-1243509135-project] 10.222.0.52 "GET /compute/v2.1/os-security-groups/d263f0d6-14e4-4ce4-ab80-3485eb9ee8d3" status: 200 len: 661 microversion: 2.1 time: 0.128126 Oct 19 03:30:19.672165 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1954/3996] 10.222.0.52 () {58 vars in 1269 bytes} [Wed Oct 19 03:30:19 2022] GET /compute/v2.1/os-security-groups/d263f0d6-14e4-4ce4-ab80-3485eb9ee8d3 => generated 661 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:30:19.683537 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-25fd5d06-c520-4423-b6b2-5bcd434ea61d tempest-SecurityGroupRulesTestJSON-1243509135 tempest-SecurityGroupRulesTestJSON-1243509135-project] Calling method '.version_select at 0x7fc12bf09c10>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:19.818411 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-b8b16df1-6d3a-4764-be5d-ed162b18a4da req-3d2dca11-1d45-4f8a-ab85-66bb84241386 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4d81635-37be-432c-8b90-31b94961465d", "tag": "38e41f94-4c56-44dc-a049-aab57efe8d35"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:30:19.849939 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-b8b16df1-6d3a-4764-be5d-ed162b18a4da req-3d2dca11-1d45-4f8a-ab85-66bb84241386 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:19.850433 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-b8b16df1-6d3a-4764-be5d-ed162b18a4da req-3d2dca11-1d45-4f8a-ab85-66bb84241386 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:19.850872 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-b8b16df1-6d3a-4764-be5d-ed162b18a4da req-3d2dca11-1d45-4f8a-ab85-66bb84241386 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:19.887917 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-b8b16df1-6d3a-4764-be5d-ed162b18a4da req-3d2dca11-1d45-4f8a-ab85-66bb84241386 service nova] Creating event network-changed:38e41f94-4c56-44dc-a049-aab57efe8d35 for instance a4d81635-37be-432c-8b90-31b94961465d on n-h1-861333-8 Oct 19 03:30:19.901732 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-b8b16df1-6d3a-4764-be5d-ed162b18a4da req-3d2dca11-1d45-4f8a-ab85-66bb84241386 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090103 Oct 19 03:30:19.904182 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1955/3997] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:30:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:30:19.956288 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d3b9b5be-6977-4aaa-bd20-67c59e9af74f tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:19.968972 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d3b9b5be-6977-4aaa-bd20-67c59e9af74f tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] [instance: a4d81635-37be-432c-8b90-31b94961465d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:19.992053 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d3b9b5be-6977-4aaa-bd20-67c59e9af74f tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:19.999780 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d3b9b5be-6977-4aaa-bd20-67c59e9af74f tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:20.000678 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d3b9b5be-6977-4aaa-bd20-67c59e9af74f tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:20.001902 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d3b9b5be-6977-4aaa-bd20-67c59e9af74f tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:20.002614 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d3b9b5be-6977-4aaa-bd20-67c59e9af74f tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:20.003222 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d3b9b5be-6977-4aaa-bd20-67c59e9af74f tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:20.170163 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-25fd5d06-c520-4423-b6b2-5bcd434ea61d tempest-SecurityGroupRulesTestJSON-1243509135 tempest-SecurityGroupRulesTestJSON-1243509135-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-group-rules/69150f8f-8d54-42ba-9a13-f7c5d46100a4" status: 202 len: 0 microversion: 2.1 time: 0.492744 Oct 19 03:30:20.170967 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2043/3998] 10.222.0.52 () {58 vars in 1287 bytes} [Wed Oct 19 03:30:19 2022] DELETE /compute/v2.1/os-security-group-rules/69150f8f-8d54-42ba-9a13-f7c5d46100a4 => generated 0 bytes in 495 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:30:20.176350 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c76a4048-2777-4c94-96b3-302a19a05f9e tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:20.177311 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c76a4048-2777-4c94-96b3-302a19a05f9e tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] [instance: cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:20.196222 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c76a4048-2777-4c94-96b3-302a19a05f9e tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:20.202072 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c76a4048-2777-4c94-96b3-302a19a05f9e tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:20.202864 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c76a4048-2777-4c94-96b3-302a19a05f9e tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:20.204060 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c76a4048-2777-4c94-96b3-302a19a05f9e tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:20.205019 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c76a4048-2777-4c94-96b3-302a19a05f9e tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:20.205757 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c76a4048-2777-4c94-96b3-302a19a05f9e tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:20.320427 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d3b9b5be-6977-4aaa-bd20-67c59e9af74f tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc644418a4740eb93ea25523f2dda2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2b45ceb5804744a7d017c20ec90d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:20.332757 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d3b9b5be-6977-4aaa-bd20-67c59e9af74f tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] 10.222.0.52 "GET /compute/v2.1/servers/a4d81635-37be-432c-8b90-31b94961465d" status: 200 len: 1316 microversion: 2.1 time: 0.385894 Oct 19 03:30:20.344433 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1956/3999] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:30:19 2022] GET /compute/v2.1/servers/a4d81635-37be-432c-8b90-31b94961465d => generated 1316 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:30:20.360769 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7b29d8b2-7515-4105-ba93-7e27a3e6f09b tempest-SecurityGroupRulesTestJSON-1243509135 tempest-SecurityGroupRulesTestJSON-1243509135-project] Calling method '.version_select at 0x7fc1300b4790>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:20.397326 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c76a4048-2777-4c94-96b3-302a19a05f9e tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:20.409452 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c76a4048-2777-4c94-96b3-302a19a05f9e tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:20.412999 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c76a4048-2777-4c94-96b3-302a19a05f9e tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:20.414614 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c76a4048-2777-4c94-96b3-302a19a05f9e tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] 10.222.0.52 "GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95" status: 200 len: 1604 microversion: 2.42 time: 0.242327 Oct 19 03:30:20.415576 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2044/4000] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:30:20 2022] GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 => generated 1604 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:30:20.565477 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-455ce824-c04f-47bf-aa29-8343519b0d4b tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:20.566740 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-455ce824-c04f-47bf-aa29-8343519b0d4b tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: ba62d863-e7f4-4653-a03b-66b3549bf8d2] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:20.578785 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-455ce824-c04f-47bf-aa29-8343519b0d4b tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:20.579765 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-455ce824-c04f-47bf-aa29-8343519b0d4b tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:20.581567 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-455ce824-c04f-47bf-aa29-8343519b0d4b tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:20.584855 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-455ce824-c04f-47bf-aa29-8343519b0d4b tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:20.587731 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-455ce824-c04f-47bf-aa29-8343519b0d4b tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:20.588718 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-455ce824-c04f-47bf-aa29-8343519b0d4b tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:21.172842 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-455ce824-c04f-47bf-aa29-8343519b0d4b tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2b0581ad4e4c9787bef838c81870a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dfe251b1e046a995b8ec302cb2ffa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:21.176613 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=100 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:30:21.181708 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-455ce824-c04f-47bf-aa29-8343519b0d4b tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "GET /compute/v2.1/servers/ba62d863-e7f4-4653-a03b-66b3549bf8d2" status: 200 len: 1318 microversion: 2.1 time: 0.624718 Oct 19 03:30:21.183242 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2045/4001] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:30:20 2022] GET /compute/v2.1/servers/ba62d863-e7f4-4653-a03b-66b3549bf8d2 => generated 1318 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:30:21.188778 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0062c635-9d3e-4676-b538-e65533e2f5d4 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:21.190329 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0062c635-9d3e-4676-b538-e65533e2f5d4 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 89f5f23f-8580-46fa-accf-206b1141c301] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:21.197079 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0062c635-9d3e-4676-b538-e65533e2f5d4 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:21.198342 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0062c635-9d3e-4676-b538-e65533e2f5d4 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:21.199032 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0062c635-9d3e-4676-b538-e65533e2f5d4 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:21.199873 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0062c635-9d3e-4676-b538-e65533e2f5d4 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:21.200433 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0062c635-9d3e-4676-b538-e65533e2f5d4 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:21.201603 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0062c635-9d3e-4676-b538-e65533e2f5d4 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:21.645163 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-0062c635-9d3e-4676-b538-e65533e2f5d4 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:21.658283 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0062c635-9d3e-4676-b538-e65533e2f5d4 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301" status: 200 len: 1390 microversion: 2.1 time: 0.473689 Oct 19 03:30:21.685491 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2046/4002] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:30:21 2022] GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301 => generated 1390 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:30:21.696730 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6d433661-44a7-476d-b7d8-286a10a420ab tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:21.697596 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6d433661-44a7-476d-b7d8-286a10a420ab tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] [instance: a4d81635-37be-432c-8b90-31b94961465d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:21.705304 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6d433661-44a7-476d-b7d8-286a10a420ab tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:21.705897 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6d433661-44a7-476d-b7d8-286a10a420ab tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:21.706564 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6d433661-44a7-476d-b7d8-286a10a420ab tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:21.707345 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6d433661-44a7-476d-b7d8-286a10a420ab tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:21.707870 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6d433661-44a7-476d-b7d8-286a10a420ab tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:21.708381 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6d433661-44a7-476d-b7d8-286a10a420ab tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:21.821281 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7b29d8b2-7515-4105-ba93-7e27a3e6f09b tempest-SecurityGroupRulesTestJSON-1243509135 tempest-SecurityGroupRulesTestJSON-1243509135-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/d263f0d6-14e4-4ce4-ab80-3485eb9ee8d3" status: 202 len: 0 microversion: 2.1 time: 1.474570 Oct 19 03:30:21.827308 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1957/4003] 10.222.0.52 () {58 vars in 1272 bytes} [Wed Oct 19 03:30:20 2022] DELETE /compute/v2.1/os-security-groups/d263f0d6-14e4-4ce4-ab80-3485eb9ee8d3 => generated 0 bytes in 1482 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:30:21.844290 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6ded6e4d-47c0-410b-b862-d261cdc3faae tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:21.869604 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6ded6e4d-47c0-410b-b862-d261cdc3faae tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] [instance: cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:21.901096 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6ded6e4d-47c0-410b-b862-d261cdc3faae tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:21.907160 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6ded6e4d-47c0-410b-b862-d261cdc3faae tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:21.907434 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6ded6e4d-47c0-410b-b862-d261cdc3faae tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:21.908411 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6ded6e4d-47c0-410b-b862-d261cdc3faae tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:21.909669 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6ded6e4d-47c0-410b-b862-d261cdc3faae tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:21.916406 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6ded6e4d-47c0-410b-b862-d261cdc3faae tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:22.040364 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-6d433661-44a7-476d-b7d8-286a10a420ab tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc644418a4740eb93ea25523f2dda2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2b45ceb5804744a7d017c20ec90d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:22.053857 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6ded6e4d-47c0-410b-b862-d261cdc3faae tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:22.054039 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6d433661-44a7-476d-b7d8-286a10a420ab tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] 10.222.0.52 "GET /compute/v2.1/servers/a4d81635-37be-432c-8b90-31b94961465d" status: 200 len: 1316 microversion: 2.1 time: 0.363941 Oct 19 03:30:22.054685 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2047/4004] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:30:21 2022] GET /compute/v2.1/servers/a4d81635-37be-432c-8b90-31b94961465d => generated 1316 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:30:22.056130 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6ded6e4d-47c0-410b-b862-d261cdc3faae tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:22.058731 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6ded6e4d-47c0-410b-b862-d261cdc3faae tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:22.062471 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-6ded6e4d-47c0-410b-b862-d261cdc3faae tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lazy-loading 'fault' on Instance uuid cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:30:22.070303 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-779a0d26-98a1-4bc8-91a4-3b36e8a9e0f2 tempest-SecurityGroupRulesTestJSON-1243509135 tempest-SecurityGroupRulesTestJSON-1243509135-project] Calling method '.version_select at 0x7fc12be40670>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:22.132369 n-d-861333-8 devstack@n-api.service[121135]: DEBUG neutronclient.v2_0.client [None req-779a0d26-98a1-4bc8-91a4-3b36e8a9e0f2 tempest-SecurityGroupRulesTestJSON-1243509135 tempest-SecurityGroupRulesTestJSON-1243509135-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 5e56735f-7b18-4de1-9463-d2191b65b92e does not exist", "detail": ""}} {{(pid=121135) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 19 03:30:22.133051 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.network.security_group_api [None req-779a0d26-98a1-4bc8-91a4-3b36e8a9e0f2 tempest-SecurityGroupRulesTestJSON-1243509135 tempest-SecurityGroupRulesTestJSON-1243509135-project] Neutron security group 5e56735f-7b18-4de1-9463-d2191b65b92e not found {{(pid=121135) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 19 03:30:22.133654 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-779a0d26-98a1-4bc8-91a4-3b36e8a9e0f2 tempest-SecurityGroupRulesTestJSON-1243509135 tempest-SecurityGroupRulesTestJSON-1243509135-project] HTTP exception thrown: Security group 5e56735f-7b18-4de1-9463-d2191b65b92e does not exist Oct 19 03:30:22.133654 n-d-861333-8 devstack@n-api.service[121135]: Neutron server returns request_ids: ['req-40b6b0e4-2c80-4861-89f7-2ec6f32368f4'] Oct 19 03:30:22.135617 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-779a0d26-98a1-4bc8-91a4-3b36e8a9e0f2 tempest-SecurityGroupRulesTestJSON-1243509135 tempest-SecurityGroupRulesTestJSON-1243509135-project] Request method failure captured: Oct 19 03:30:22.135617 n-d-861333-8 devstack@n-api.service[121135]: request: DELETE /compute/v2.1/os-security-groups/5e56735f-7b18-4de1-9463-d2191b65b92e HTTP/1.1 Oct 19 03:30:22.135617 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:30:22.135617 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:30:22.135617 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:30:22.135617 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:30:22.135617 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:30:22.135617 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:30:22.135617 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:30:22.135617 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:30:22.135617 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT28vqGbfRklp8YXBXrQVHuWx99h_hCI1CFEOkZ3aWBdhtCi_wtUHlUS5bDCDUNkWJIwVxT9Extz94vdv3Sw1a76YLJYHyn8T_0Q0ptKkxzuXctTfJAIwXPRdR_FSnY_ZzVguwXZUH_zv_MWgnDzxk-5hvpkd7Slqre-MGYdABQ2wdVI Oct 19 03:30:22.135617 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:30:22.135617 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:30:22.135617 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:30:22.135617 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:30:22.135617 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:30:22.135617 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:30:22.135617 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 62e75e5063404aeba07a914fdf3ff5eb Oct 19 03:30:22.135617 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-1243509135 Oct 19 03:30:22.135617 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:30:22.135617 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:30:22.137512 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/62e75e5063404aeba07a914fdf3ff5eb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/62e75e5063404aeba07a914fdf3ff5eb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/62e75e5063404aeba07a914fdf3ff5eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_62e75e5063404aeba07a914fdf3ff5eb", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:30:22.137512 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-SecurityGroupRulesTestJSON-1243509135 Oct 19 03:30:22.137512 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 62e75e5063404aeba07a914fdf3ff5eb Oct 19 03:30:22.137512 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-1243509135 Oct 19 03:30:22.137512 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-SecurityGroupRulesTestJSON-1243509135-project Oct 19 03:30:22.137512 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:30:22.137512 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:30:22.137512 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 893a82951dcd4cf495cc6131368e09c2 Oct 19 03:30:22.137512 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-SecurityGroupRulesTestJSON-1243509135-project Oct 19 03:30:22.137512 n-d-861333-8 devstack@n-api.service[121135]: method: Oct 19 03:30:22.137512 n-d-861333-8 devstack@n-api.service[121135]: exception: Security group 5e56735f-7b18-4de1-9463-d2191b65b92e does not exist Oct 19 03:30:22.137512 n-d-861333-8 devstack@n-api.service[121135]: Neutron server returns request_ids: ['req-40b6b0e4-2c80-4861-89f7-2ec6f32368f4'] Oct 19 03:30:22.137512 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '5e56735f-7b18-4de1-9463-d2191b65b92e'} Oct 19 03:30:22.139013 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:30:22.139013 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:30:22.139013 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 19 03:30:22.139013 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 19 03:30:22.139013 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:30:22.139013 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:30:22.139013 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 19 03:30:22.139013 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 19 03:30:22.139013 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:30:22.139013 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:30:22.139013 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 19 03:30:22.139013 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 19 03:30:22.139013 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:30:22.139013 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:30:22.139013 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 19 03:30:22.139013 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 19 03:30:22.139013 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:30:22.139013 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:30:22.139013 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 19 03:30:22.144176 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 19 03:30:22.144176 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:30:22.144176 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:30:22.144176 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 19 03:30:22.144176 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 19 03:30:22.144176 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 19 03:30:22.144176 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 19 03:30:22.144176 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 5e56735f-7b18-4de1-9463-d2191b65b92e does not exist Oct 19 03:30:22.144176 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-40b6b0e4-2c80-4861-89f7-2ec6f32368f4'] Oct 19 03:30:22.144176 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:30:22.144176 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:30:22.144176 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:30:22.144176 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:30:22.144176 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 19 03:30:22.144176 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 19 03:30:22.144176 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 19 03:30:22.144176 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 19 03:30:22.144176 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 5e56735f-7b18-4de1-9463-d2191b65b92e does not exist Oct 19 03:30:22.145915 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-40b6b0e4-2c80-4861-89f7-2ec6f32368f4'] Oct 19 03:30:22.145915 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:30:22.145915 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:30:22.145915 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:30:22.145915 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:30:22.145915 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:30:22.145915 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:30:22.145915 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:30:22.145915 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:30:22.145915 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 03:30:22.145915 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 03:30:22.145915 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:30:22.145915 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:30:22.145915 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 19 03:30:22.145915 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 19 03:30:22.145915 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 5e56735f-7b18-4de1-9463-d2191b65b92e does not exist Oct 19 03:30:22.145915 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-40b6b0e4-2c80-4861-89f7-2ec6f32368f4'] Oct 19 03:30:22.145915 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:30:22.145915 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:30:22.145915 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:30:22.145915 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:30:22.148088 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:30:22.148088 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:30:22.148088 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:30:22.148088 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:30:22.148088 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 5e56735f-7b18-4de1-9463-d2191b65b92e does not exist Oct 19 03:30:22.148088 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-40b6b0e4-2c80-4861-89f7-2ec6f32368f4'] Oct 19 03:30:22.148088 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:30:22.148088 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-779a0d26-98a1-4bc8-91a4-3b36e8a9e0f2 tempest-SecurityGroupRulesTestJSON-1243509135 tempest-SecurityGroupRulesTestJSON-1243509135-project] Returning 404 to user: Security group 5e56735f-7b18-4de1-9463-d2191b65b92e does not exist Oct 19 03:30:22.148088 n-d-861333-8 devstack@n-api.service[121135]: Neutron server returns request_ids: ['req-40b6b0e4-2c80-4861-89f7-2ec6f32368f4'] {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:30:22.148088 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-779a0d26-98a1-4bc8-91a4-3b36e8a9e0f2 tempest-SecurityGroupRulesTestJSON-1243509135 tempest-SecurityGroupRulesTestJSON-1243509135-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/5e56735f-7b18-4de1-9463-d2191b65b92e" status: 404 len: 194 microversion: 2.1 time: 0.081386 Oct 19 03:30:22.148088 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2048/4005] 10.222.0.52 () {58 vars in 1272 bytes} [Wed Oct 19 03:30:22 2022] DELETE /compute/v2.1/os-security-groups/5e56735f-7b18-4de1-9463-d2191b65b92e => generated 194 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:30:22.150390 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-8bc0484e-0586-4ace-b0ec-8ce19359721e tempest-SecurityGroupRulesTestJSON-1243509135 tempest-SecurityGroupRulesTestJSON-1243509135-project] Calling method '.version_select at 0x7fc12be98820>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:22.213790 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-6ded6e4d-47c0-410b-b862-d261cdc3faae tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:22.236912 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-6ded6e4d-47c0-410b-b862-d261cdc3faae tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:22.248034 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-6ded6e4d-47c0-410b-b862-d261cdc3faae tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:22.249320 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6ded6e4d-47c0-410b-b862-d261cdc3faae tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] 10.222.0.52 "GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95" status: 200 len: 1609 microversion: 2.42 time: 0.420746 Oct 19 03:30:22.249924 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1958/4006] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:30:21 2022] GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 => generated 1609 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:30:22.271347 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-cfe19bc7-69c7-4241-9a4b-b411fc72e346 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:22.278993 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-cfe19bc7-69c7-4241-9a4b-b411fc72e346 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: ba62d863-e7f4-4653-a03b-66b3549bf8d2] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:22.302472 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cfe19bc7-69c7-4241-9a4b-b411fc72e346 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:22.308626 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cfe19bc7-69c7-4241-9a4b-b411fc72e346 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:22.311995 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cfe19bc7-69c7-4241-9a4b-b411fc72e346 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:22.314133 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cfe19bc7-69c7-4241-9a4b-b411fc72e346 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:22.317787 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cfe19bc7-69c7-4241-9a4b-b411fc72e346 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:22.320940 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cfe19bc7-69c7-4241-9a4b-b411fc72e346 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:23.061133 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-cfe19bc7-69c7-4241-9a4b-b411fc72e346 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2b0581ad4e4c9787bef838c81870a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dfe251b1e046a995b8ec302cb2ffa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:23.072123 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-cfe19bc7-69c7-4241-9a4b-b411fc72e346 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "GET /compute/v2.1/servers/ba62d863-e7f4-4653-a03b-66b3549bf8d2" status: 200 len: 1318 microversion: 2.1 time: 0.814138 Oct 19 03:30:23.085567 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1959/4007] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:30:22 2022] GET /compute/v2.1/servers/ba62d863-e7f4-4653-a03b-66b3549bf8d2 => generated 1318 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:30:23.111353 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-80120935-7e85-42ef-a532-db1da1926182 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:23.114052 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-80120935-7e85-42ef-a532-db1da1926182 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 89f5f23f-8580-46fa-accf-206b1141c301] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:23.130978 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-80120935-7e85-42ef-a532-db1da1926182 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:23.131781 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-80120935-7e85-42ef-a532-db1da1926182 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:23.132408 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-80120935-7e85-42ef-a532-db1da1926182 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:23.133330 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-80120935-7e85-42ef-a532-db1da1926182 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:23.134011 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-80120935-7e85-42ef-a532-db1da1926182 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:23.135033 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-80120935-7e85-42ef-a532-db1da1926182 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:23.162470 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=100 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:30:23.175275 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-8bc0484e-0586-4ace-b0ec-8ce19359721e tempest-SecurityGroupRulesTestJSON-1243509135 tempest-SecurityGroupRulesTestJSON-1243509135-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/25fe1f2f-1e89-446a-af22-278095dec83b" status: 202 len: 0 microversion: 2.1 time: 1.030284 Oct 19 03:30:23.176132 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2049/4008] 10.222.0.52 () {58 vars in 1272 bytes} [Wed Oct 19 03:30:22 2022] DELETE /compute/v2.1/os-security-groups/25fe1f2f-1e89-446a-af22-278095dec83b => generated 0 bytes in 1032 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 19 03:30:23.184572 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-dc65a89a-72b1-48e5-84d7-e4a2029bb51b tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:23.185914 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-dc65a89a-72b1-48e5-84d7-e4a2029bb51b tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] [instance: a4d81635-37be-432c-8b90-31b94961465d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:23.199521 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=64 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:30:23.210905 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dc65a89a-72b1-48e5-84d7-e4a2029bb51b tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:23.211421 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dc65a89a-72b1-48e5-84d7-e4a2029bb51b tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:23.211874 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dc65a89a-72b1-48e5-84d7-e4a2029bb51b tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:23.212609 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dc65a89a-72b1-48e5-84d7-e4a2029bb51b tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:23.213071 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dc65a89a-72b1-48e5-84d7-e4a2029bb51b tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:23.219048 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dc65a89a-72b1-48e5-84d7-e4a2029bb51b tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:23.656963 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-80120935-7e85-42ef-a532-db1da1926182 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:23.668946 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-80120935-7e85-42ef-a532-db1da1926182 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301" status: 200 len: 1390 microversion: 2.1 time: 0.582139 Oct 19 03:30:23.676270 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1960/4009] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:30:23 2022] GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301 => generated 1390 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:30:23.697794 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9f4e97b4-883b-4ad9-8f5f-1299f7625bf6 tempest-SecurityGroupRulesTestJSON-1243509135 tempest-SecurityGroupRulesTestJSON-1243509135-project] Calling method '.version_select at 0x7fc1300d1550>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:23.753918 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-dc65a89a-72b1-48e5-84d7-e4a2029bb51b tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc644418a4740eb93ea25523f2dda2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2b45ceb5804744a7d017c20ec90d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:23.765180 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-dc65a89a-72b1-48e5-84d7-e4a2029bb51b tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] 10.222.0.52 "GET /compute/v2.1/servers/a4d81635-37be-432c-8b90-31b94961465d" status: 200 len: 1316 microversion: 2.1 time: 0.587823 Oct 19 03:30:23.765831 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2050/4010] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:30:23 2022] GET /compute/v2.1/servers/a4d81635-37be-432c-8b90-31b94961465d => generated 1316 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:30:23.776878 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b9480556-94a9-4bc1-a836-ad5adeef145b tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:23.777945 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b9480556-94a9-4bc1-a836-ad5adeef145b tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] [instance: cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:23.806214 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b9480556-94a9-4bc1-a836-ad5adeef145b tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:23.806785 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b9480556-94a9-4bc1-a836-ad5adeef145b tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:23.807167 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b9480556-94a9-4bc1-a836-ad5adeef145b tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:23.807875 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b9480556-94a9-4bc1-a836-ad5adeef145b tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:23.808531 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b9480556-94a9-4bc1-a836-ad5adeef145b tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:23.809320 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b9480556-94a9-4bc1-a836-ad5adeef145b tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:23.876834 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b9480556-94a9-4bc1-a836-ad5adeef145b tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:23.878840 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b9480556-94a9-4bc1-a836-ad5adeef145b tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:23.884472 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b9480556-94a9-4bc1-a836-ad5adeef145b tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:23.886686 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-b9480556-94a9-4bc1-a836-ad5adeef145b tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lazy-loading 'fault' on Instance uuid cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:30:23.995053 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b9480556-94a9-4bc1-a836-ad5adeef145b tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:24.005916 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b9480556-94a9-4bc1-a836-ad5adeef145b tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:24.007717 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b9480556-94a9-4bc1-a836-ad5adeef145b tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1804c1df36f347feb017deec5eef9dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de899450062428e8cd4686ae84de2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:24.008994 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b9480556-94a9-4bc1-a836-ad5adeef145b tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] 10.222.0.52 "GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95" status: 200 len: 1609 microversion: 2.42 time: 0.237820 Oct 19 03:30:24.010538 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2051/4011] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:30:23 2022] GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 => generated 1609 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:30:24.109010 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-10ad97e4-8a51-4b3c-8372-57ee5344f39a tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:24.111623 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-10ad97e4-8a51-4b3c-8372-57ee5344f39a tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: ba62d863-e7f4-4653-a03b-66b3549bf8d2] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:24.127770 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-10ad97e4-8a51-4b3c-8372-57ee5344f39a tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:24.128580 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-10ad97e4-8a51-4b3c-8372-57ee5344f39a tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:24.129114 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-10ad97e4-8a51-4b3c-8372-57ee5344f39a tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:24.129948 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-10ad97e4-8a51-4b3c-8372-57ee5344f39a tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:24.137816 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-10ad97e4-8a51-4b3c-8372-57ee5344f39a tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:24.138934 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-10ad97e4-8a51-4b3c-8372-57ee5344f39a tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:24.297538 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9f4e97b4-883b-4ad9-8f5f-1299f7625bf6 tempest-SecurityGroupRulesTestJSON-1243509135 tempest-SecurityGroupRulesTestJSON-1243509135-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/d1c9e470-6bce-44e5-9570-ca12e860cf44" status: 202 len: 0 microversion: 2.1 time: 0.617489 Oct 19 03:30:24.301444 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1961/4012] 10.222.0.52 () {58 vars in 1272 bytes} [Wed Oct 19 03:30:23 2022] DELETE /compute/v2.1/os-security-groups/d1c9e470-6bce-44e5-9570-ca12e860cf44 => generated 0 bytes in 624 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:30:24.307861 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0d305a00-f4e5-44f7-9e6c-945d5092ee68 tempest-SecurityGroupRulesTestJSON-1243509135 tempest-SecurityGroupRulesTestJSON-1243509135-project] Calling method '.version_select at 0x7fc1300a0a60>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:24.417689 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-10ad97e4-8a51-4b3c-8372-57ee5344f39a tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2b0581ad4e4c9787bef838c81870a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dfe251b1e046a995b8ec302cb2ffa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:24.430319 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-10ad97e4-8a51-4b3c-8372-57ee5344f39a tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "GET /compute/v2.1/servers/ba62d863-e7f4-4653-a03b-66b3549bf8d2" status: 200 len: 1318 microversion: 2.1 time: 0.336655 Oct 19 03:30:24.431300 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2052/4013] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:30:24 2022] GET /compute/v2.1/servers/ba62d863-e7f4-4653-a03b-66b3549bf8d2 => generated 1318 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:30:24.436639 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-8789013b-b77b-44cc-9b8e-be3d11cdb12d req-2b92007c-7afd-4f9c-a84a-c560d57f3cd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba62d863-e7f4-4653-a03b-66b3549bf8d2", "name": "network-vif-plugged", "status": "completed", "tag": "7d547af1-e25e-409d-af52-381f964bce3e"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:30:24.446852 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-8789013b-b77b-44cc-9b8e-be3d11cdb12d req-2b92007c-7afd-4f9c-a84a-c560d57f3cd3 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:24.447707 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-8789013b-b77b-44cc-9b8e-be3d11cdb12d req-2b92007c-7afd-4f9c-a84a-c560d57f3cd3 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:24.448386 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-8789013b-b77b-44cc-9b8e-be3d11cdb12d req-2b92007c-7afd-4f9c-a84a-c560d57f3cd3 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:24.465867 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-8789013b-b77b-44cc-9b8e-be3d11cdb12d req-2b92007c-7afd-4f9c-a84a-c560d57f3cd3 service nova] Creating event network-vif-plugged:7d547af1-e25e-409d-af52-381f964bce3e for instance ba62d863-e7f4-4653-a03b-66b3549bf8d2 on n-h2-861333-8 Oct 19 03:30:24.475024 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-8789013b-b77b-44cc-9b8e-be3d11cdb12d req-2b92007c-7afd-4f9c-a84a-c560d57f3cd3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041286 Oct 19 03:30:24.475660 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2053/4014] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:30:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:30:24.665092 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0d305a00-f4e5-44f7-9e6c-945d5092ee68 tempest-SecurityGroupRulesTestJSON-1243509135 tempest-SecurityGroupRulesTestJSON-1243509135-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/9ab6f34c-8fa5-4c9b-92c2-7e64b5a4af3c" status: 202 len: 0 microversion: 2.1 time: 0.362270 Oct 19 03:30:24.671397 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1962/4015] 10.222.0.52 () {58 vars in 1272 bytes} [Wed Oct 19 03:30:24 2022] DELETE /compute/v2.1/os-security-groups/9ab6f34c-8fa5-4c9b-92c2-7e64b5a4af3c => generated 0 bytes in 369 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:30:24.676657 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-73e286bd-f6d4-4ea2-93f9-ee3a8363887d tempest-SecurityGroupRulesTestJSON-1243509135 tempest-SecurityGroupRulesTestJSON-1243509135-project] Calling method '.version_select at 0x7fc12bf67430>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:24.701004 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a5bbd6c2-7216-4450-bf34-69c4c1790d52 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:24.703655 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a5bbd6c2-7216-4450-bf34-69c4c1790d52 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 89f5f23f-8580-46fa-accf-206b1141c301] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:24.717079 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a5bbd6c2-7216-4450-bf34-69c4c1790d52 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:24.717481 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a5bbd6c2-7216-4450-bf34-69c4c1790d52 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:24.718604 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a5bbd6c2-7216-4450-bf34-69c4c1790d52 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:24.719626 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a5bbd6c2-7216-4450-bf34-69c4c1790d52 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:24.720438 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a5bbd6c2-7216-4450-bf34-69c4c1790d52 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:24.720970 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a5bbd6c2-7216-4450-bf34-69c4c1790d52 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:25.025035 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a5bbd6c2-7216-4450-bf34-69c4c1790d52 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:25.035578 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a5bbd6c2-7216-4450-bf34-69c4c1790d52 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301" status: 200 len: 1390 microversion: 2.1 time: 0.339655 Oct 19 03:30:25.039826 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1963/4016] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:30:24 2022] GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301 => generated 1390 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:30:25.050632 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f00820e3-771b-45ee-b00b-0e9d7da28454 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:25.052001 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f00820e3-771b-45ee-b00b-0e9d7da28454 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] [instance: a4d81635-37be-432c-8b90-31b94961465d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:25.063963 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f00820e3-771b-45ee-b00b-0e9d7da28454 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:25.064552 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f00820e3-771b-45ee-b00b-0e9d7da28454 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:25.065079 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f00820e3-771b-45ee-b00b-0e9d7da28454 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:25.067482 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f00820e3-771b-45ee-b00b-0e9d7da28454 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:25.068028 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f00820e3-771b-45ee-b00b-0e9d7da28454 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:25.068661 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f00820e3-771b-45ee-b00b-0e9d7da28454 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:25.193025 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-73e286bd-f6d4-4ea2-93f9-ee3a8363887d tempest-SecurityGroupRulesTestJSON-1243509135 tempest-SecurityGroupRulesTestJSON-1243509135-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/903e9f36-87ac-4210-9a68-3309986d5e5e" status: 202 len: 0 microversion: 2.1 time: 0.520557 Oct 19 03:30:25.193672 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2054/4017] 10.222.0.52 () {58 vars in 1272 bytes} [Wed Oct 19 03:30:24 2022] DELETE /compute/v2.1/os-security-groups/903e9f36-87ac-4210-9a68-3309986d5e5e => generated 0 bytes in 523 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:30:25.198329 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f9745741-3983-4dd0-83b6-10f4f60a1ebd tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:25.199552 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f9745741-3983-4dd0-83b6-10f4f60a1ebd tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] [instance: cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:25.209508 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f9745741-3983-4dd0-83b6-10f4f60a1ebd tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:25.210680 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f9745741-3983-4dd0-83b6-10f4f60a1ebd tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:25.210680 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f9745741-3983-4dd0-83b6-10f4f60a1ebd tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:25.211269 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f9745741-3983-4dd0-83b6-10f4f60a1ebd tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:25.211732 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f9745741-3983-4dd0-83b6-10f4f60a1ebd tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:25.212396 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f9745741-3983-4dd0-83b6-10f4f60a1ebd tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:25.227886 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-f9745741-3983-4dd0-83b6-10f4f60a1ebd tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] HTTP exception thrown: Instance cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 could not be found. Oct 19 03:30:25.229679 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f9745741-3983-4dd0-83b6-10f4f60a1ebd tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Request method failure captured: Oct 19 03:30:25.229679 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 HTTP/1.1 Oct 19 03:30:25.229679 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:30:25.229679 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:30:25.229679 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:30:25.229679 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:30:25.229679 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:30:25.229679 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:30:25.229679 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:30:25.229679 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:30:25.229679 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT21Y1UEaHwIcwrTQrjQ3TtHlXy5fJ-DokkJFYJV8ogZ5MiUXkPDOUwIQWdN36Vj5YMO0Ikk7yymAtKiojqG55D8BdbYTlJTeCtWQNlyXKk3ukS4zX58vIKZc550ViFj8stb7nePUCplgu9q8b0vmhZ4HqwssM9JlwRuDZK_v0FLJHqU Oct 19 03:30:25.229679 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:30:25.229679 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:30:25.229679 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:30:25.229679 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:30:25.229679 n-d-861333-8 devstack@n-api.service[121135]: X-Openstack-Nova-Api-Version: 2.42 Oct 19 03:30:25.229679 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:30:25.229679 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:30:25.229679 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 3de899450062428e8cd4686ae84de2eb Oct 19 03:30:25.229679 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-195615829 Oct 19 03:30:25.229679 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:30:25.229679 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:30:25.235375 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/3de899450062428e8cd4686ae84de2eb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3de899450062428e8cd4686ae84de2eb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3de899450062428e8cd4686ae84de2eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_3de899450062428e8cd4686ae84de2eb", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:30:25.235375 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-TaggedBootDevicesTest_v242-195615829 Oct 19 03:30:25.235375 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 3de899450062428e8cd4686ae84de2eb Oct 19 03:30:25.235375 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-195615829 Oct 19 03:30:25.235375 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-TaggedBootDevicesTest_v242-195615829-project Oct 19 03:30:25.235375 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:30:25.235375 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:30:25.235375 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 1804c1df36f347feb017deec5eef9dbb Oct 19 03:30:25.235375 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-TaggedBootDevicesTest_v242-195615829-project Oct 19 03:30:25.235375 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:30:25.235375 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 could not be found. Oct 19 03:30:25.235375 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': 'cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95'} Oct 19 03:30:25.236455 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:30:25.236455 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:30:25.236455 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:30:25.236455 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:30:25.236455 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:30:25.236455 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:30:25.236455 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:30:25.236455 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:30:25.236455 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:30:25.236455 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:30:25.236455 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 could not be found. Oct 19 03:30:25.236455 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:30:25.236455 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:30:25.236455 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:30:25.236455 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:30:25.236455 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:30:25.236455 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:30:25.236455 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:30:25.236455 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:30:25.236455 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:30:25.238704 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:30:25.238704 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:30:25.238704 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:30:25.238704 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:30:25.238704 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:30:25.238704 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:30:25.238704 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:30:25.238704 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 could not be found. Oct 19 03:30:25.238704 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:30:25.238704 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:30:25.238704 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:30:25.238704 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:30:25.238704 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:30:25.238704 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:30:25.238704 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:30:25.238704 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:30:25.238704 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 could not be found. Oct 19 03:30:25.238704 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:30:25.240762 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f9745741-3983-4dd0-83b6-10f4f60a1ebd tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Returning 404 to user: Instance cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:30:25.240762 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f9745741-3983-4dd0-83b6-10f4f60a1ebd tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] 10.222.0.52 "GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95" status: 404 len: 111 microversion: 2.42 time: 0.036480 Oct 19 03:30:25.240762 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2055/4018] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:30:25 2022] GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 19 03:30:25.240762 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6e9ace23-b0bf-4b5a-b891-18aa1516f186 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:25.240762 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6e9ace23-b0bf-4b5a-b891-18aa1516f186 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:25.264244 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6e9ace23-b0bf-4b5a-b891-18aa1516f186 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:25.267263 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6e9ace23-b0bf-4b5a-b891-18aa1516f186 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:25.269957 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6e9ace23-b0bf-4b5a-b891-18aa1516f186 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:25.270769 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6e9ace23-b0bf-4b5a-b891-18aa1516f186 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:25.273421 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6e9ace23-b0bf-4b5a-b891-18aa1516f186 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:25.275907 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6e9ace23-b0bf-4b5a-b891-18aa1516f186 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:25.279680 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-f00820e3-771b-45ee-b00b-0e9d7da28454 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc644418a4740eb93ea25523f2dda2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2b45ceb5804744a7d017c20ec90d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:25.287711 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f00820e3-771b-45ee-b00b-0e9d7da28454 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] 10.222.0.52 "GET /compute/v2.1/servers/a4d81635-37be-432c-8b90-31b94961465d" status: 200 len: 1316 microversion: 2.1 time: 0.246667 Oct 19 03:30:25.288317 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1964/4019] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:30:25 2022] GET /compute/v2.1/servers/a4d81635-37be-432c-8b90-31b94961465d => generated 1316 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:30:25.299240 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-233b8035-ec02-4865-9af0-f5df8f34ef7b tempest-SecurityGroupRulesTestJSON-1243509135 tempest-SecurityGroupRulesTestJSON-1243509135-project] Calling method '.version_select at 0x7fc1300c49d0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:25.492274 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-6e9ace23-b0bf-4b5a-b891-18aa1516f186 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:25.500335 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6e9ace23-b0bf-4b5a-b891-18aa1516f186 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1670 microversion: 2.1 time: 0.267308 Oct 19 03:30:25.501007 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2056/4020] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:30:25 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1670 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:30:25.505523 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-83742922-71f2-4e0a-8ad5-31157457612c tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Calling method '.version_select at 0x7fc12beffa60>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:25.510985 n-d-861333-8 devstack@n-api.service[121135]: ERROR oslo.messaging._drivers.impl_rabbit [None req-83742922-71f2-4e0a-8ad5-31157457612c tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] [466284c6-cbd7-4ef3-a024-7f40823a5c9c] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 19 03:30:25.688374 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-233b8035-ec02-4865-9af0-f5df8f34ef7b tempest-SecurityGroupRulesTestJSON-1243509135 tempest-SecurityGroupRulesTestJSON-1243509135-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/2f107245-d35b-4218-b5d0-456ea53b5db0" status: 202 len: 0 microversion: 2.1 time: 0.398998 Oct 19 03:30:25.693160 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1965/4021] 10.222.0.52 () {58 vars in 1272 bytes} [Wed Oct 19 03:30:25 2022] DELETE /compute/v2.1/os-security-groups/2f107245-d35b-4218-b5d0-456ea53b5db0 => generated 0 bytes in 401 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:30:25.701938 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3fc36300-02b7-4cfd-9b97-93eda0fbf9ff tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:25.701938 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3fc36300-02b7-4cfd-9b97-93eda0fbf9ff tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: ba62d863-e7f4-4653-a03b-66b3549bf8d2] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:25.709576 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3fc36300-02b7-4cfd-9b97-93eda0fbf9ff tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:25.709920 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3fc36300-02b7-4cfd-9b97-93eda0fbf9ff tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:25.710693 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3fc36300-02b7-4cfd-9b97-93eda0fbf9ff tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:25.711506 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3fc36300-02b7-4cfd-9b97-93eda0fbf9ff tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:25.711860 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3fc36300-02b7-4cfd-9b97-93eda0fbf9ff tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:25.712288 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3fc36300-02b7-4cfd-9b97-93eda0fbf9ff tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:25.878688 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-3fc36300-02b7-4cfd-9b97-93eda0fbf9ff tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2b0581ad4e4c9787bef838c81870a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dfe251b1e046a995b8ec302cb2ffa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:25.891357 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3fc36300-02b7-4cfd-9b97-93eda0fbf9ff tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "GET /compute/v2.1/servers/ba62d863-e7f4-4653-a03b-66b3549bf8d2" status: 200 len: 1318 microversion: 2.1 time: 0.200307 Oct 19 03:30:25.892431 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1966/4022] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:30:25 2022] GET /compute/v2.1/servers/ba62d863-e7f4-4653-a03b-66b3549bf8d2 => generated 1318 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:30:25.897299 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9daf1415-6fe3-4985-8f7f-1905a649231a tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-1042763175"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:30:25.900015 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9daf1415-6fe3-4985-8f7f-1905a649231a tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:25.906871 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9daf1415-6fe3-4985-8f7f-1905a649231a tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:25.907596 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9daf1415-6fe3-4985-8f7f-1905a649231a tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:25.908283 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9daf1415-6fe3-4985-8f7f-1905a649231a tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:25.909192 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9daf1415-6fe3-4985-8f7f-1905a649231a tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:25.909775 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9daf1415-6fe3-4985-8f7f-1905a649231a tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:25.913738 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9daf1415-6fe3-4985-8f7f-1905a649231a tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:26.521893 n-d-861333-8 devstack@n-api.service[121135]: INFO oslo.messaging._drivers.impl_rabbit [None req-83742922-71f2-4e0a-8ad5-31157457612c tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] [466284c6-cbd7-4ef3-a024-7f40823a5c9c] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 44398. Oct 19 03:30:26.523183 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9daf1415-6fe3-4985-8f7f-1905a649231a tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "POST /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f/action" status: 202 len: 0 microversion: 2.1 time: 0.629482 Oct 19 03:30:26.530105 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1967/4023] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:30:25 2022] POST /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f/action => generated 0 bytes in 637 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 19 03:30:26.538914 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9863e640-bdff-4295-a752-6886b7b7aa9c tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:26.539996 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9863e640-bdff-4295-a752-6886b7b7aa9c tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 89f5f23f-8580-46fa-accf-206b1141c301] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:26.550188 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9863e640-bdff-4295-a752-6886b7b7aa9c tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:26.552457 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9863e640-bdff-4295-a752-6886b7b7aa9c tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:26.553190 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9863e640-bdff-4295-a752-6886b7b7aa9c tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:26.554882 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9863e640-bdff-4295-a752-6886b7b7aa9c tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:26.556140 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9863e640-bdff-4295-a752-6886b7b7aa9c tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:26.556945 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9863e640-bdff-4295-a752-6886b7b7aa9c tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:26.709550 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9863e640-bdff-4295-a752-6886b7b7aa9c tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:26.717263 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9863e640-bdff-4295-a752-6886b7b7aa9c tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301" status: 200 len: 1390 microversion: 2.1 time: 0.183205 Oct 19 03:30:26.717975 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1968/4024] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:30:26 2022] GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301 => generated 1390 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:30:26.722868 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-bf626642-5978-49eb-93ae-3395242f3ef9 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:26.723483 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-bf626642-5978-49eb-93ae-3395242f3ef9 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] [instance: a4d81635-37be-432c-8b90-31b94961465d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:26.729291 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bf626642-5978-49eb-93ae-3395242f3ef9 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:26.730002 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bf626642-5978-49eb-93ae-3395242f3ef9 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:26.730651 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bf626642-5978-49eb-93ae-3395242f3ef9 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:26.732488 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bf626642-5978-49eb-93ae-3395242f3ef9 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:26.733124 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bf626642-5978-49eb-93ae-3395242f3ef9 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:26.733761 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bf626642-5978-49eb-93ae-3395242f3ef9 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:26.748452 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-83742922-71f2-4e0a-8ad5-31157457612c tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-394842387" status: 204 len: 0 microversion: 2.42 time: 1.245475 Oct 19 03:30:26.750439 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2057/4025] 10.222.0.52 () {60 vars in 1259 bytes} [Wed Oct 19 03:30:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-394842387 => generated 0 bytes in 1249 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 19 03:30:26.757594 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-aa54136c-5f25-462e-9b7f-f0e25c7c97db tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:26.759014 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-aa54136c-5f25-462e-9b7f-f0e25c7c97db tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:26.768811 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aa54136c-5f25-462e-9b7f-f0e25c7c97db tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:26.770070 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aa54136c-5f25-462e-9b7f-f0e25c7c97db tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:26.772311 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aa54136c-5f25-462e-9b7f-f0e25c7c97db tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:26.774222 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aa54136c-5f25-462e-9b7f-f0e25c7c97db tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:26.778114 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aa54136c-5f25-462e-9b7f-f0e25c7c97db tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:26.779113 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aa54136c-5f25-462e-9b7f-f0e25c7c97db tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:26.965015 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-bf626642-5978-49eb-93ae-3395242f3ef9 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc644418a4740eb93ea25523f2dda2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2b45ceb5804744a7d017c20ec90d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:26.973870 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-bf626642-5978-49eb-93ae-3395242f3ef9 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] 10.222.0.52 "GET /compute/v2.1/servers/a4d81635-37be-432c-8b90-31b94961465d" status: 200 len: 1316 microversion: 2.1 time: 0.254769 Oct 19 03:30:26.974491 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1969/4026] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:30:26 2022] GET /compute/v2.1/servers/a4d81635-37be-432c-8b90-31b94961465d => generated 1316 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:30:27.002763 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d09e39c9-fa97-4592-a5d2-6c2d67455c36 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:27.003378 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d09e39c9-fa97-4592-a5d2-6c2d67455c36 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: ba62d863-e7f4-4653-a03b-66b3549bf8d2] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:27.012729 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d09e39c9-fa97-4592-a5d2-6c2d67455c36 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:27.014349 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d09e39c9-fa97-4592-a5d2-6c2d67455c36 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:27.014983 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d09e39c9-fa97-4592-a5d2-6c2d67455c36 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:27.016596 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d09e39c9-fa97-4592-a5d2-6c2d67455c36 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:27.017269 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d09e39c9-fa97-4592-a5d2-6c2d67455c36 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:27.017901 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d09e39c9-fa97-4592-a5d2-6c2d67455c36 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:27.043197 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-aa54136c-5f25-462e-9b7f-f0e25c7c97db tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:27.061078 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-aa54136c-5f25-462e-9b7f-f0e25c7c97db tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1680 microversion: 2.1 time: 0.306813 Oct 19 03:30:27.062054 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2058/4027] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:30:26 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1680 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:30:27.180596 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d09e39c9-fa97-4592-a5d2-6c2d67455c36 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2b0581ad4e4c9787bef838c81870a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dfe251b1e046a995b8ec302cb2ffa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:27.205564 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d09e39c9-fa97-4592-a5d2-6c2d67455c36 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "GET /compute/v2.1/servers/ba62d863-e7f4-4653-a03b-66b3549bf8d2" status: 200 len: 1509 microversion: 2.1 time: 0.199285 Oct 19 03:30:27.205564 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1970/4028] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:30:26 2022] GET /compute/v2.1/servers/ba62d863-e7f4-4653-a03b-66b3549bf8d2 => generated 1509 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:30:27.218738 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-21647719-83ac-4080-9212-465bac08c3f2 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:27.219377 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-21647719-83ac-4080-9212-465bac08c3f2 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: ba62d863-e7f4-4653-a03b-66b3549bf8d2] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:27.229171 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-21647719-83ac-4080-9212-465bac08c3f2 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:27.229912 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-21647719-83ac-4080-9212-465bac08c3f2 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:27.230386 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-21647719-83ac-4080-9212-465bac08c3f2 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:27.231181 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-21647719-83ac-4080-9212-465bac08c3f2 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:27.231674 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-21647719-83ac-4080-9212-465bac08c3f2 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:27.232281 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-21647719-83ac-4080-9212-465bac08c3f2 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:27.462179 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-21647719-83ac-4080-9212-465bac08c3f2 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2b0581ad4e4c9787bef838c81870a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dfe251b1e046a995b8ec302cb2ffa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:27.470949 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-21647719-83ac-4080-9212-465bac08c3f2 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "GET /compute/v2.1/servers/ba62d863-e7f4-4653-a03b-66b3549bf8d2" status: 200 len: 1509 microversion: 2.1 time: 0.257466 Oct 19 03:30:27.485417 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2059/4029] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:30:27 2022] GET /compute/v2.1/servers/ba62d863-e7f4-4653-a03b-66b3549bf8d2 => generated 1509 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:30:27.498014 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ee116fe8-41b3-487b-9d3a-72e28c127bec tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:30:27.506173 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ee116fe8-41b3-487b-9d3a-72e28c127bec tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: ba62d863-e7f4-4653-a03b-66b3549bf8d2] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:27.524398 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ee116fe8-41b3-487b-9d3a-72e28c127bec tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:27.525680 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ee116fe8-41b3-487b-9d3a-72e28c127bec tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:27.532357 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ee116fe8-41b3-487b-9d3a-72e28c127bec tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:27.532357 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ee116fe8-41b3-487b-9d3a-72e28c127bec tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:27.532357 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ee116fe8-41b3-487b-9d3a-72e28c127bec tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:27.532357 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ee116fe8-41b3-487b-9d3a-72e28c127bec tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:27.748476 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-52dd80ae-feb9-442c-8759-8fcb62368fa5 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:27.749852 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-52dd80ae-feb9-442c-8759-8fcb62368fa5 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 89f5f23f-8580-46fa-accf-206b1141c301] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:27.770397 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-52dd80ae-feb9-442c-8759-8fcb62368fa5 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:27.773429 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-52dd80ae-feb9-442c-8759-8fcb62368fa5 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:27.775181 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-52dd80ae-feb9-442c-8759-8fcb62368fa5 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:27.782413 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-52dd80ae-feb9-442c-8759-8fcb62368fa5 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:27.782413 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-52dd80ae-feb9-442c-8759-8fcb62368fa5 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:27.782413 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-52dd80ae-feb9-442c-8759-8fcb62368fa5 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:27.783443 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ee116fe8-41b3-487b-9d3a-72e28c127bec tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "PUT /compute/v2.1/servers/ba62d863-e7f4-4653-a03b-66b3549bf8d2" status: 200 len: 1081 microversion: 2.1 time: 0.290610 Oct 19 03:30:27.784323 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1971/4030] 10.222.0.52 () {60 vars in 1256 bytes} [Wed Oct 19 03:30:27 2022] PUT /compute/v2.1/servers/ba62d863-e7f4-4653-a03b-66b3549bf8d2 => generated 1081 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:30:27.805498 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4dce2e42-0a09-4be0-a999-b545e0298385 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:27.806426 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4dce2e42-0a09-4be0-a999-b545e0298385 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: ba62d863-e7f4-4653-a03b-66b3549bf8d2] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:27.818791 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4dce2e42-0a09-4be0-a999-b545e0298385 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:27.819665 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4dce2e42-0a09-4be0-a999-b545e0298385 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:27.821166 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4dce2e42-0a09-4be0-a999-b545e0298385 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:27.824359 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4dce2e42-0a09-4be0-a999-b545e0298385 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:27.825106 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4dce2e42-0a09-4be0-a999-b545e0298385 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:27.826332 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4dce2e42-0a09-4be0-a999-b545e0298385 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:28.663519 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-52dd80ae-feb9-442c-8759-8fcb62368fa5 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:28.670104 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-4dce2e42-0a09-4be0-a999-b545e0298385 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2b0581ad4e4c9787bef838c81870a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dfe251b1e046a995b8ec302cb2ffa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:28.682897 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-52dd80ae-feb9-442c-8759-8fcb62368fa5 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301" status: 200 len: 1390 microversion: 2.1 time: 0.943567 Oct 19 03:30:28.684125 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4dce2e42-0a09-4be0-a999-b545e0298385 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "GET /compute/v2.1/servers/ba62d863-e7f4-4653-a03b-66b3549bf8d2" status: 200 len: 1507 microversion: 2.1 time: 0.879390 Oct 19 03:30:28.698041 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1972/4031] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:30:27 2022] GET /compute/v2.1/servers/ba62d863-e7f4-4653-a03b-66b3549bf8d2 => generated 1507 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:30:28.698322 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2060/4032] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:30:27 2022] GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301 => generated 1390 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:30:28.708086 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-956054f2-1e0f-4969-99d4-36af4b808903 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:28.713958 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-956054f2-1e0f-4969-99d4-36af4b808903 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:28.722356 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-956054f2-1e0f-4969-99d4-36af4b808903 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:28.723125 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-956054f2-1e0f-4969-99d4-36af4b808903 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:28.723910 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-956054f2-1e0f-4969-99d4-36af4b808903 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:28.725095 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-956054f2-1e0f-4969-99d4-36af4b808903 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:28.725754 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-956054f2-1e0f-4969-99d4-36af4b808903 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:28.726402 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-956054f2-1e0f-4969-99d4-36af4b808903 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:28.734485 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-abb26762-9422-4c40-9daf-b7bb9307bc46 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:28.738860 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-abb26762-9422-4c40-9daf-b7bb9307bc46 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] [instance: a4d81635-37be-432c-8b90-31b94961465d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:28.761600 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-abb26762-9422-4c40-9daf-b7bb9307bc46 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:28.765092 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-abb26762-9422-4c40-9daf-b7bb9307bc46 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:28.765894 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-abb26762-9422-4c40-9daf-b7bb9307bc46 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:28.767060 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-abb26762-9422-4c40-9daf-b7bb9307bc46 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:28.768599 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-abb26762-9422-4c40-9daf-b7bb9307bc46 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:28.769230 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-abb26762-9422-4c40-9daf-b7bb9307bc46 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:29.573354 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-956054f2-1e0f-4969-99d4-36af4b808903 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:29.584385 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-abb26762-9422-4c40-9daf-b7bb9307bc46 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc644418a4740eb93ea25523f2dda2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2b45ceb5804744a7d017c20ec90d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:29.592865 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-956054f2-1e0f-4969-99d4-36af4b808903 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1688 microversion: 2.1 time: 0.895955 Oct 19 03:30:29.593929 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2061/4033] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:30:28 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1688 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:30:29.600369 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-abb26762-9422-4c40-9daf-b7bb9307bc46 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] 10.222.0.52 "GET /compute/v2.1/servers/a4d81635-37be-432c-8b90-31b94961465d" status: 200 len: 1316 microversion: 2.1 time: 0.909265 Oct 19 03:30:29.600816 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1973/4034] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:30:28 2022] GET /compute/v2.1/servers/a4d81635-37be-432c-8b90-31b94961465d => generated 1316 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:30:29.605661 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a9152115-ccc8-4da4-9ff4-c73eb7c56a25 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:29.607228 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a9152115-ccc8-4da4-9ff4-c73eb7c56a25 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: ba62d863-e7f4-4653-a03b-66b3549bf8d2] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:29.620692 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a9152115-ccc8-4da4-9ff4-c73eb7c56a25 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:29.628878 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a9152115-ccc8-4da4-9ff4-c73eb7c56a25 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:29.629568 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a9152115-ccc8-4da4-9ff4-c73eb7c56a25 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:29.630348 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a9152115-ccc8-4da4-9ff4-c73eb7c56a25 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:29.630825 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a9152115-ccc8-4da4-9ff4-c73eb7c56a25 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:29.631257 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a9152115-ccc8-4da4-9ff4-c73eb7c56a25 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:29.716422 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ece1dda7-f6a5-4ac1-bcc2-883fd6b49117 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:29.717090 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ece1dda7-f6a5-4ac1-bcc2-883fd6b49117 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 89f5f23f-8580-46fa-accf-206b1141c301] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:29.725613 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ece1dda7-f6a5-4ac1-bcc2-883fd6b49117 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:29.726125 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ece1dda7-f6a5-4ac1-bcc2-883fd6b49117 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:29.726760 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ece1dda7-f6a5-4ac1-bcc2-883fd6b49117 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:29.727740 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ece1dda7-f6a5-4ac1-bcc2-883fd6b49117 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:29.728214 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ece1dda7-f6a5-4ac1-bcc2-883fd6b49117 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:29.728658 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ece1dda7-f6a5-4ac1-bcc2-883fd6b49117 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:29.933243 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a9152115-ccc8-4da4-9ff4-c73eb7c56a25 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2b0581ad4e4c9787bef838c81870a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dfe251b1e046a995b8ec302cb2ffa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:29.951861 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a9152115-ccc8-4da4-9ff4-c73eb7c56a25 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "GET /compute/v2.1/servers/ba62d863-e7f4-4653-a03b-66b3549bf8d2" status: 200 len: 1507 microversion: 2.1 time: 0.353936 Oct 19 03:30:29.965396 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2062/4035] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:30:29 2022] GET /compute/v2.1/servers/ba62d863-e7f4-4653-a03b-66b3549bf8d2 => generated 1507 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:30:29.991428 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2f40de4e-bf2e-4a90-ab69-2bb86e854a89 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:30:29.994757 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-2f40de4e-bf2e-4a90-ab69-2bb86e854a89 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: ba62d863-e7f4-4653-a03b-66b3549bf8d2] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:30.011889 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2f40de4e-bf2e-4a90-ab69-2bb86e854a89 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:30.014347 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2f40de4e-bf2e-4a90-ab69-2bb86e854a89 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:30.017504 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2f40de4e-bf2e-4a90-ab69-2bb86e854a89 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:30.021996 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2f40de4e-bf2e-4a90-ab69-2bb86e854a89 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:30.022944 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2f40de4e-bf2e-4a90-ab69-2bb86e854a89 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:30.024906 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2f40de4e-bf2e-4a90-ab69-2bb86e854a89 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:30.188321 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ece1dda7-f6a5-4ac1-bcc2-883fd6b49117 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:30.203900 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ece1dda7-f6a5-4ac1-bcc2-883fd6b49117 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301" status: 200 len: 1390 microversion: 2.1 time: 0.491681 Oct 19 03:30:30.219395 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1974/4036] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:30:29 2022] GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301 => generated 1390 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:30:30.236220 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2f40de4e-bf2e-4a90-ab69-2bb86e854a89 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "PUT /compute/v2.1/servers/ba62d863-e7f4-4653-a03b-66b3549bf8d2" status: 200 len: 1083 microversion: 2.1 time: 0.260806 Oct 19 03:30:30.252960 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2063/4037] 10.222.0.52 () {60 vars in 1256 bytes} [Wed Oct 19 03:30:29 2022] PUT /compute/v2.1/servers/ba62d863-e7f4-4653-a03b-66b3549bf8d2 => generated 1083 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:30:30.263102 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-adf90976-bf30-48a5-b8ba-9150ffaf6ec0 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:30.270064 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-adf90976-bf30-48a5-b8ba-9150ffaf6ec0 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: ba62d863-e7f4-4653-a03b-66b3549bf8d2] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:30.273552 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-adf90976-bf30-48a5-b8ba-9150ffaf6ec0 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:30.274292 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-adf90976-bf30-48a5-b8ba-9150ffaf6ec0 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:30.274741 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-adf90976-bf30-48a5-b8ba-9150ffaf6ec0 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:30.275488 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-adf90976-bf30-48a5-b8ba-9150ffaf6ec0 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:30.275934 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-adf90976-bf30-48a5-b8ba-9150ffaf6ec0 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:30.276364 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-adf90976-bf30-48a5-b8ba-9150ffaf6ec0 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:30.499127 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-3dcad697-8e26-4d0f-a4be-30b39d334bd7 req-2252b5b9-75f5-46b5-b154-2d250aad986c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58b9ce4c-4a42-40ff-b8ed-b75de752b46f", "name": "network-vif-unplugged", "status": "completed", "tag": "ff8c2e3f-1c6f-4ac7-b6b8-751825489845"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:30:30.519407 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-3dcad697-8e26-4d0f-a4be-30b39d334bd7 req-2252b5b9-75f5-46b5-b154-2d250aad986c service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:30.520461 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-3dcad697-8e26-4d0f-a4be-30b39d334bd7 req-2252b5b9-75f5-46b5-b154-2d250aad986c service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:30.521081 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-3dcad697-8e26-4d0f-a4be-30b39d334bd7 req-2252b5b9-75f5-46b5-b154-2d250aad986c service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:30.545084 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-3dcad697-8e26-4d0f-a4be-30b39d334bd7 req-2252b5b9-75f5-46b5-b154-2d250aad986c service nova] Creating event network-vif-unplugged:ff8c2e3f-1c6f-4ac7-b6b8-751825489845 for instance 58b9ce4c-4a42-40ff-b8ed-b75de752b46f on n-h2-861333-8 Oct 19 03:30:30.550064 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-3dcad697-8e26-4d0f-a4be-30b39d334bd7 req-2252b5b9-75f5-46b5-b154-2d250aad986c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.066224 Oct 19 03:30:30.552092 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2064/4038] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:30:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:30:30.636592 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-da094f04-b322-4f40-a659-920faab75cad tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:30.638900 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-da094f04-b322-4f40-a659-920faab75cad tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:30.665145 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-da094f04-b322-4f40-a659-920faab75cad tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:30.665678 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-da094f04-b322-4f40-a659-920faab75cad tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:30.668259 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-da094f04-b322-4f40-a659-920faab75cad tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:30.669048 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-da094f04-b322-4f40-a659-920faab75cad tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:30.679175 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-da094f04-b322-4f40-a659-920faab75cad tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:30.679967 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-da094f04-b322-4f40-a659-920faab75cad tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:31.003687 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-adf90976-bf30-48a5-b8ba-9150ffaf6ec0 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2b0581ad4e4c9787bef838c81870a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dfe251b1e046a995b8ec302cb2ffa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:31.016629 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-adf90976-bf30-48a5-b8ba-9150ffaf6ec0 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "GET /compute/v2.1/servers/ba62d863-e7f4-4653-a03b-66b3549bf8d2" status: 200 len: 1509 microversion: 2.1 time: 0.754895 Oct 19 03:30:31.016629 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1975/4039] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:30:30 2022] GET /compute/v2.1/servers/ba62d863-e7f4-4653-a03b-66b3549bf8d2 => generated 1509 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:30:31.019185 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b109323d-080c-4dd2-b622-bbafbe765a73 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:31.019914 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b109323d-080c-4dd2-b622-bbafbe765a73 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] [instance: a4d81635-37be-432c-8b90-31b94961465d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:31.026824 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b109323d-080c-4dd2-b622-bbafbe765a73 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:31.027586 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b109323d-080c-4dd2-b622-bbafbe765a73 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:31.029164 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b109323d-080c-4dd2-b622-bbafbe765a73 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:31.030212 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b109323d-080c-4dd2-b622-bbafbe765a73 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:31.030914 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b109323d-080c-4dd2-b622-bbafbe765a73 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:31.031740 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b109323d-080c-4dd2-b622-bbafbe765a73 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:31.141268 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-da094f04-b322-4f40-a659-920faab75cad tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:31.158021 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-da094f04-b322-4f40-a659-920faab75cad tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1688 microversion: 2.1 time: 0.535010 Oct 19 03:30:31.158823 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2065/4040] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:30:30 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1688 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:30:31.181595 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-689821d9-603a-4dad-9ed4-6f8bd414d604 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:31.182441 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-689821d9-603a-4dad-9ed4-6f8bd414d604 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: ba62d863-e7f4-4653-a03b-66b3549bf8d2] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:31.189884 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-689821d9-603a-4dad-9ed4-6f8bd414d604 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:31.190377 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-689821d9-603a-4dad-9ed4-6f8bd414d604 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:31.191321 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-689821d9-603a-4dad-9ed4-6f8bd414d604 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:31.191515 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-689821d9-603a-4dad-9ed4-6f8bd414d604 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:31.191971 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-689821d9-603a-4dad-9ed4-6f8bd414d604 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:31.192394 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-689821d9-603a-4dad-9ed4-6f8bd414d604 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:31.410745 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b109323d-080c-4dd2-b622-bbafbe765a73 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc644418a4740eb93ea25523f2dda2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2b45ceb5804744a7d017c20ec90d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:31.424260 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b109323d-080c-4dd2-b622-bbafbe765a73 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] 10.222.0.52 "GET /compute/v2.1/servers/a4d81635-37be-432c-8b90-31b94961465d" status: 200 len: 1316 microversion: 2.1 time: 0.409262 Oct 19 03:30:31.433580 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1976/4041] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:30:31 2022] GET /compute/v2.1/servers/a4d81635-37be-432c-8b90-31b94961465d => generated 1316 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:30:31.433580 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9da3c90d-a82d-47be-8fd6-d3fbe5d3ad59 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:31.433580 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9da3c90d-a82d-47be-8fd6-d3fbe5d3ad59 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 89f5f23f-8580-46fa-accf-206b1141c301] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:31.448939 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9da3c90d-a82d-47be-8fd6-d3fbe5d3ad59 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:31.449840 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9da3c90d-a82d-47be-8fd6-d3fbe5d3ad59 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:31.450970 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9da3c90d-a82d-47be-8fd6-d3fbe5d3ad59 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:31.451876 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9da3c90d-a82d-47be-8fd6-d3fbe5d3ad59 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:31.457100 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9da3c90d-a82d-47be-8fd6-d3fbe5d3ad59 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:31.457828 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9da3c90d-a82d-47be-8fd6-d3fbe5d3ad59 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:31.517443 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-689821d9-603a-4dad-9ed4-6f8bd414d604 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2b0581ad4e4c9787bef838c81870a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dfe251b1e046a995b8ec302cb2ffa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:31.527267 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-689821d9-603a-4dad-9ed4-6f8bd414d604 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "GET /compute/v2.1/servers/ba62d863-e7f4-4653-a03b-66b3549bf8d2" status: 200 len: 1509 microversion: 2.1 time: 0.349955 Oct 19 03:30:31.533522 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2066/4042] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:30:31 2022] GET /compute/v2.1/servers/ba62d863-e7f4-4653-a03b-66b3549bf8d2 => generated 1509 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:30:31.557647 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d3b8b097-b79f-4dc6-a672-5126c3dd4050 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:31.558543 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d3b8b097-b79f-4dc6-a672-5126c3dd4050 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: ba62d863-e7f4-4653-a03b-66b3549bf8d2] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:31.567412 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d3b8b097-b79f-4dc6-a672-5126c3dd4050 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:31.571886 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d3b8b097-b79f-4dc6-a672-5126c3dd4050 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:31.571886 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d3b8b097-b79f-4dc6-a672-5126c3dd4050 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:31.571886 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d3b8b097-b79f-4dc6-a672-5126c3dd4050 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:31.571886 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d3b8b097-b79f-4dc6-a672-5126c3dd4050 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:31.572332 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d3b8b097-b79f-4dc6-a672-5126c3dd4050 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:31.600989 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:30:31.607275 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d3b8b097-b79f-4dc6-a672-5126c3dd4050 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: ba62d863-e7f4-4653-a03b-66b3549bf8d2] Going to try to terminate instance {{(pid=121135) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:30:31.748489 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9da3c90d-a82d-47be-8fd6-d3fbe5d3ad59 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:31.770083 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9da3c90d-a82d-47be-8fd6-d3fbe5d3ad59 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301" status: 200 len: 1390 microversion: 2.1 time: 0.343398 Oct 19 03:30:31.772197 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1977/4043] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:30:31 2022] GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301 => generated 1390 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:30:32.092443 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d3b8b097-b79f-4dc6-a672-5126c3dd4050 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ba62d863-e7f4-4653-a03b-66b3549bf8d2" status: 204 len: 0 microversion: 2.1 time: 0.539305 Oct 19 03:30:32.098536 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2067/4044] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:30:31 2022] DELETE /compute/v2.1/servers/ba62d863-e7f4-4653-a03b-66b3549bf8d2 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:30:32.112189 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f5832cf1-6ab8-492b-b041-11f37d6f48ad tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:32.112189 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f5832cf1-6ab8-492b-b041-11f37d6f48ad tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: ba62d863-e7f4-4653-a03b-66b3549bf8d2] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:32.129410 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f5832cf1-6ab8-492b-b041-11f37d6f48ad tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:32.129772 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f5832cf1-6ab8-492b-b041-11f37d6f48ad tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:32.130217 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f5832cf1-6ab8-492b-b041-11f37d6f48ad tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:32.133013 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f5832cf1-6ab8-492b-b041-11f37d6f48ad tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:32.133551 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f5832cf1-6ab8-492b-b041-11f37d6f48ad tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:32.135502 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f5832cf1-6ab8-492b-b041-11f37d6f48ad tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:32.175443 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:30:32.187155 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-20e49f58-2d59-4854-bf01-a1bf97b4ebf9 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:32.188122 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-20e49f58-2d59-4854-bf01-a1bf97b4ebf9 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:32.207379 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-20e49f58-2d59-4854-bf01-a1bf97b4ebf9 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:32.208627 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-20e49f58-2d59-4854-bf01-a1bf97b4ebf9 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:32.214970 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-20e49f58-2d59-4854-bf01-a1bf97b4ebf9 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:32.220509 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-20e49f58-2d59-4854-bf01-a1bf97b4ebf9 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:32.221716 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-20e49f58-2d59-4854-bf01-a1bf97b4ebf9 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:32.222704 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-20e49f58-2d59-4854-bf01-a1bf97b4ebf9 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:32.268296 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f5832cf1-6ab8-492b-b041-11f37d6f48ad tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: ba62d863-e7f4-4653-a03b-66b3549bf8d2] Going to try to terminate instance {{(pid=121134) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:30:32.463954 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.compute.api [None req-f5832cf1-6ab8-492b-b041-11f37d6f48ad tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: ba62d863-e7f4-4653-a03b-66b3549bf8d2] Instance is already in deleting state, ignoring this request Oct 19 03:30:32.469096 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f5832cf1-6ab8-492b-b041-11f37d6f48ad tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ba62d863-e7f4-4653-a03b-66b3549bf8d2" status: 204 len: 0 microversion: 2.1 time: 0.366921 Oct 19 03:30:32.469914 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1978/4045] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:30:32 2022] DELETE /compute/v2.1/servers/ba62d863-e7f4-4653-a03b-66b3549bf8d2 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:30:32.480964 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-502528d6-3a7d-42c9-9393-b9685141c8d9 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:32.483614 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-502528d6-3a7d-42c9-9393-b9685141c8d9 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] [instance: a4d81635-37be-432c-8b90-31b94961465d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:32.492398 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-502528d6-3a7d-42c9-9393-b9685141c8d9 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:32.493413 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-502528d6-3a7d-42c9-9393-b9685141c8d9 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:32.494061 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-502528d6-3a7d-42c9-9393-b9685141c8d9 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:32.495437 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-502528d6-3a7d-42c9-9393-b9685141c8d9 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:32.496272 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-502528d6-3a7d-42c9-9393-b9685141c8d9 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:32.497902 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-502528d6-3a7d-42c9-9393-b9685141c8d9 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:34.061102 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-20e49f58-2d59-4854-bf01-a1bf97b4ebf9 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:34.070721 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-20e49f58-2d59-4854-bf01-a1bf97b4ebf9 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1683 microversion: 2.1 time: 1.890128 Oct 19 03:30:34.078913 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2068/4046] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:30:32 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1683 bytes in 1899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:30:34.087534 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-cc2f58dc-e793-42af-8947-561521bbd22b tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:34.101758 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-cc2f58dc-e793-42af-8947-561521bbd22b tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: ba62d863-e7f4-4653-a03b-66b3549bf8d2] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:34.124339 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cc2f58dc-e793-42af-8947-561521bbd22b tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:34.125994 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cc2f58dc-e793-42af-8947-561521bbd22b tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:34.126739 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cc2f58dc-e793-42af-8947-561521bbd22b tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:34.127831 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cc2f58dc-e793-42af-8947-561521bbd22b tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:34.128736 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cc2f58dc-e793-42af-8947-561521bbd22b tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:34.129525 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cc2f58dc-e793-42af-8947-561521bbd22b tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:34.885252 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-502528d6-3a7d-42c9-9393-b9685141c8d9 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc644418a4740eb93ea25523f2dda2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2b45ceb5804744a7d017c20ec90d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:34.906575 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-502528d6-3a7d-42c9-9393-b9685141c8d9 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] 10.222.0.52 "GET /compute/v2.1/servers/a4d81635-37be-432c-8b90-31b94961465d" status: 200 len: 1316 microversion: 2.1 time: 2.433543 Oct 19 03:30:34.918125 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1979/4047] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:30:32 2022] GET /compute/v2.1/servers/a4d81635-37be-432c-8b90-31b94961465d => generated 1316 bytes in 2447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:30:34.933931 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-13a1aecc-68b7-49a3-848e-a48d9a16d644 req-690cb87c-6d05-4c8c-af4c-6c58b70c488e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4d81635-37be-432c-8b90-31b94961465d", "name": "network-vif-plugged", "status": "completed", "tag": "38e41f94-4c56-44dc-a049-aab57efe8d35"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:30:34.960956 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-13a1aecc-68b7-49a3-848e-a48d9a16d644 req-690cb87c-6d05-4c8c-af4c-6c58b70c488e service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:34.964015 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-13a1aecc-68b7-49a3-848e-a48d9a16d644 req-690cb87c-6d05-4c8c-af4c-6c58b70c488e service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:34.964819 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-13a1aecc-68b7-49a3-848e-a48d9a16d644 req-690cb87c-6d05-4c8c-af4c-6c58b70c488e service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:34.998915 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-13a1aecc-68b7-49a3-848e-a48d9a16d644 req-690cb87c-6d05-4c8c-af4c-6c58b70c488e service nova] Creating event network-vif-plugged:38e41f94-4c56-44dc-a049-aab57efe8d35 for instance a4d81635-37be-432c-8b90-31b94961465d on n-h1-861333-8 Oct 19 03:30:35.008316 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-13a1aecc-68b7-49a3-848e-a48d9a16d644 req-690cb87c-6d05-4c8c-af4c-6c58b70c488e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088524 Oct 19 03:30:35.013168 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1980/4048] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:30:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:30:35.029261 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0755f868-32b3-4054-8e64-53878419c81f tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:35.029261 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0755f868-32b3-4054-8e64-53878419c81f tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 89f5f23f-8580-46fa-accf-206b1141c301] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:35.081238 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0755f868-32b3-4054-8e64-53878419c81f tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:35.083554 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0755f868-32b3-4054-8e64-53878419c81f tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:35.084128 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0755f868-32b3-4054-8e64-53878419c81f tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:35.088727 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0755f868-32b3-4054-8e64-53878419c81f tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:35.089229 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0755f868-32b3-4054-8e64-53878419c81f tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:35.089753 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0755f868-32b3-4054-8e64-53878419c81f tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:35.150485 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-cc2f58dc-e793-42af-8947-561521bbd22b tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2b0581ad4e4c9787bef838c81870a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dfe251b1e046a995b8ec302cb2ffa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:35.159672 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-cc2f58dc-e793-42af-8947-561521bbd22b tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "GET /compute/v2.1/servers/ba62d863-e7f4-4653-a03b-66b3549bf8d2" status: 200 len: 1515 microversion: 2.1 time: 1.079335 Oct 19 03:30:35.163910 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2069/4049] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:30:34 2022] GET /compute/v2.1/servers/ba62d863-e7f4-4653-a03b-66b3549bf8d2 => generated 1515 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:30:35.177600 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-f3d68be9-7ee4-406a-93e3-0024c2945cff req-2485b1c0-c1bd-43cd-821b-273336215901 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89f5f23f-8580-46fa-accf-206b1141c301", "name": "network-vif-unplugged", "status": "completed", "tag": "a2678fb1-a9fa-4f93-9241-80d9c1c2d9d1"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:30:35.205715 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-f3d68be9-7ee4-406a-93e3-0024c2945cff req-2485b1c0-c1bd-43cd-821b-273336215901 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:35.206958 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-f3d68be9-7ee4-406a-93e3-0024c2945cff req-2485b1c0-c1bd-43cd-821b-273336215901 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:35.209065 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-f3d68be9-7ee4-406a-93e3-0024c2945cff req-2485b1c0-c1bd-43cd-821b-273336215901 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:35.245884 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-f3d68be9-7ee4-406a-93e3-0024c2945cff req-2485b1c0-c1bd-43cd-821b-273336215901 service nova] Creating event network-vif-unplugged:a2678fb1-a9fa-4f93-9241-80d9c1c2d9d1 for instance 89f5f23f-8580-46fa-accf-206b1141c301 on n-h1-861333-8 Oct 19 03:30:35.258165 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-f3d68be9-7ee4-406a-93e3-0024c2945cff req-2485b1c0-c1bd-43cd-821b-273336215901 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.090613 Oct 19 03:30:35.261128 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2070/4050] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:30:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:30:35.266705 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4c859274-560c-41a2-8644-842cd7568900 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:35.269751 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4c859274-560c-41a2-8644-842cd7568900 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:35.287655 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4c859274-560c-41a2-8644-842cd7568900 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:35.288651 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4c859274-560c-41a2-8644-842cd7568900 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:35.289288 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4c859274-560c-41a2-8644-842cd7568900 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:35.290212 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4c859274-560c-41a2-8644-842cd7568900 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:35.292082 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4c859274-560c-41a2-8644-842cd7568900 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:35.294855 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4c859274-560c-41a2-8644-842cd7568900 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:36.058283 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0755f868-32b3-4054-8e64-53878419c81f tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:36.071448 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0755f868-32b3-4054-8e64-53878419c81f tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301" status: 200 len: 1390 microversion: 2.1 time: 1.054303 Oct 19 03:30:36.072687 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1981/4051] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:30:35 2022] GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301 => generated 1390 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:30:36.081345 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f81fca41-8deb-4ba8-a14d-8a2973970328 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:36.089803 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f81fca41-8deb-4ba8-a14d-8a2973970328 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] [instance: a4d81635-37be-432c-8b90-31b94961465d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:36.100162 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f81fca41-8deb-4ba8-a14d-8a2973970328 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:36.107032 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f81fca41-8deb-4ba8-a14d-8a2973970328 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:36.107032 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f81fca41-8deb-4ba8-a14d-8a2973970328 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:36.107032 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f81fca41-8deb-4ba8-a14d-8a2973970328 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:36.107032 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f81fca41-8deb-4ba8-a14d-8a2973970328 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:36.107969 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f81fca41-8deb-4ba8-a14d-8a2973970328 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:36.211088 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4c859274-560c-41a2-8644-842cd7568900 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:36.222082 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4c859274-560c-41a2-8644-842cd7568900 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1683 microversion: 2.1 time: 0.961398 Oct 19 03:30:36.225943 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2071/4052] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:30:35 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1683 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:30:36.246697 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-73375a3c-0951-4df8-90c5-31da48856ff0 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:36.251295 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-73375a3c-0951-4df8-90c5-31da48856ff0 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: ba62d863-e7f4-4653-a03b-66b3549bf8d2] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:36.271128 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-73375a3c-0951-4df8-90c5-31da48856ff0 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:36.271993 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-73375a3c-0951-4df8-90c5-31da48856ff0 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:36.273541 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-73375a3c-0951-4df8-90c5-31da48856ff0 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:36.274340 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-73375a3c-0951-4df8-90c5-31da48856ff0 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:36.275224 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-73375a3c-0951-4df8-90c5-31da48856ff0 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:36.275929 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-73375a3c-0951-4df8-90c5-31da48856ff0 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:36.580310 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-73375a3c-0951-4df8-90c5-31da48856ff0 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2b0581ad4e4c9787bef838c81870a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dfe251b1e046a995b8ec302cb2ffa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:36.609221 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-73375a3c-0951-4df8-90c5-31da48856ff0 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "GET /compute/v2.1/servers/ba62d863-e7f4-4653-a03b-66b3549bf8d2" status: 200 len: 1473 microversion: 2.1 time: 0.379107 Oct 19 03:30:36.612210 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2072/4053] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:30:36 2022] GET /compute/v2.1/servers/ba62d863-e7f4-4653-a03b-66b3549bf8d2 => generated 1473 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:30:36.926678 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-6c4d21e4-5234-4fae-a5dc-51c7d6e17f92 req-cebeff3e-badc-476f-b85b-e26ccd91979f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba62d863-e7f4-4653-a03b-66b3549bf8d2", "name": "network-vif-deleted", "tag": "7d547af1-e25e-409d-af52-381f964bce3e"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:30:36.971433 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-6c4d21e4-5234-4fae-a5dc-51c7d6e17f92 req-cebeff3e-badc-476f-b85b-e26ccd91979f service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:36.978361 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-6c4d21e4-5234-4fae-a5dc-51c7d6e17f92 req-cebeff3e-badc-476f-b85b-e26ccd91979f service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:36.982716 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-6c4d21e4-5234-4fae-a5dc-51c7d6e17f92 req-cebeff3e-badc-476f-b85b-e26ccd91979f service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:37.010408 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-6c4d21e4-5234-4fae-a5dc-51c7d6e17f92 req-cebeff3e-badc-476f-b85b-e26ccd91979f service nova] Creating event network-vif-deleted:7d547af1-e25e-409d-af52-381f964bce3e for instance ba62d863-e7f4-4653-a03b-66b3549bf8d2 on n-h2-861333-8 Oct 19 03:30:37.013878 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-f81fca41-8deb-4ba8-a14d-8a2973970328 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc644418a4740eb93ea25523f2dda2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2b45ceb5804744a7d017c20ec90d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:37.038957 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f81fca41-8deb-4ba8-a14d-8a2973970328 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] 10.222.0.52 "GET /compute/v2.1/servers/a4d81635-37be-432c-8b90-31b94961465d" status: 200 len: 1316 microversion: 2.1 time: 0.959123 Oct 19 03:30:37.045499 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-6c4d21e4-5234-4fae-a5dc-51c7d6e17f92 req-cebeff3e-badc-476f-b85b-e26ccd91979f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118808 Oct 19 03:30:37.046510 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2073/4054] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:30:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:30:37.061858 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1982/4055] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:30:36 2022] GET /compute/v2.1/servers/a4d81635-37be-432c-8b90-31b94961465d => generated 1316 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:30:37.099530 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e78ae586-5cc1-49e5-a239-8af53937cf34 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:37.100620 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e78ae586-5cc1-49e5-a239-8af53937cf34 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 89f5f23f-8580-46fa-accf-206b1141c301] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:37.118570 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e78ae586-5cc1-49e5-a239-8af53937cf34 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:37.126185 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e78ae586-5cc1-49e5-a239-8af53937cf34 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:37.126963 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e78ae586-5cc1-49e5-a239-8af53937cf34 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:37.129598 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e78ae586-5cc1-49e5-a239-8af53937cf34 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:37.131231 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e78ae586-5cc1-49e5-a239-8af53937cf34 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:37.132686 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e78ae586-5cc1-49e5-a239-8af53937cf34 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:37.217336 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-b326f431-688b-47f9-a0a4-ec74afcc6951 req-4538257c-52b7-4dc5-abbd-dafcd400d85e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58b9ce4c-4a42-40ff-b8ed-b75de752b46f", "name": "network-vif-plugged", "status": "completed", "tag": "ff8c2e3f-1c6f-4ac7-b6b8-751825489845"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:30:37.266534 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-b326f431-688b-47f9-a0a4-ec74afcc6951 req-4538257c-52b7-4dc5-abbd-dafcd400d85e service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:37.283456 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-b326f431-688b-47f9-a0a4-ec74afcc6951 req-4538257c-52b7-4dc5-abbd-dafcd400d85e service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:37.292079 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-b326f431-688b-47f9-a0a4-ec74afcc6951 req-4538257c-52b7-4dc5-abbd-dafcd400d85e service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:37.326229 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-b326f431-688b-47f9-a0a4-ec74afcc6951 req-4538257c-52b7-4dc5-abbd-dafcd400d85e service nova] Creating event network-vif-plugged:ff8c2e3f-1c6f-4ac7-b6b8-751825489845 for instance 58b9ce4c-4a42-40ff-b8ed-b75de752b46f on n-h2-861333-8 Oct 19 03:30:37.342203 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-b326f431-688b-47f9-a0a4-ec74afcc6951 req-4538257c-52b7-4dc5-abbd-dafcd400d85e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132772 Oct 19 03:30:37.347518 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1983/4056] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:30:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:30:37.364121 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7ff726f1-fa15-4bb4-908d-35da7db778e8 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:37.366591 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7ff726f1-fa15-4bb4-908d-35da7db778e8 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:37.403822 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7ff726f1-fa15-4bb4-908d-35da7db778e8 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:37.406717 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7ff726f1-fa15-4bb4-908d-35da7db778e8 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:37.407475 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7ff726f1-fa15-4bb4-908d-35da7db778e8 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:37.408565 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7ff726f1-fa15-4bb4-908d-35da7db778e8 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:37.409260 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7ff726f1-fa15-4bb4-908d-35da7db778e8 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:37.412797 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7ff726f1-fa15-4bb4-908d-35da7db778e8 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:38.527199 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-e78ae586-5cc1-49e5-a239-8af53937cf34 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:38.553144 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e78ae586-5cc1-49e5-a239-8af53937cf34 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301" status: 200 len: 1390 microversion: 2.1 time: 1.460241 Oct 19 03:30:38.555703 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2074/4057] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:30:37 2022] GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301 => generated 1390 bytes in 1464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:30:38.573564 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-0682014d-3d06-4ffc-9f82-d680274d711b req-12bb91e0-3e1a-4ca0-ac4f-d224059b703e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89f5f23f-8580-46fa-accf-206b1141c301", "tag": "a2678fb1-a9fa-4f93-9241-80d9c1c2d9d1"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:30:38.577529 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-7ff726f1-fa15-4bb4-908d-35da7db778e8 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:38.593787 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-0682014d-3d06-4ffc-9f82-d680274d711b req-12bb91e0-3e1a-4ca0-ac4f-d224059b703e service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:38.594584 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-0682014d-3d06-4ffc-9f82-d680274d711b req-12bb91e0-3e1a-4ca0-ac4f-d224059b703e service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:38.595276 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-0682014d-3d06-4ffc-9f82-d680274d711b req-12bb91e0-3e1a-4ca0-ac4f-d224059b703e service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:38.612730 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7ff726f1-fa15-4bb4-908d-35da7db778e8 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1683 microversion: 2.1 time: 1.265695 Oct 19 03:30:38.614516 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1984/4058] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:30:37 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1683 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:30:38.624541 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-0682014d-3d06-4ffc-9f82-d680274d711b req-12bb91e0-3e1a-4ca0-ac4f-d224059b703e service nova] Creating event network-changed:a2678fb1-a9fa-4f93-9241-80d9c1c2d9d1 for instance 89f5f23f-8580-46fa-accf-206b1141c301 on n-h1-861333-8 Oct 19 03:30:38.631212 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-0682014d-3d06-4ffc-9f82-d680274d711b req-12bb91e0-3e1a-4ca0-ac4f-d224059b703e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070075 Oct 19 03:30:38.632507 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2075/4059] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:30:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:30:38.647137 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-73924903-474f-4976-9678-101a0e774589 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:38.647137 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-73924903-474f-4976-9678-101a0e774589 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] [instance: a4d81635-37be-432c-8b90-31b94961465d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:38.654837 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-73924903-474f-4976-9678-101a0e774589 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:38.655333 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d2ded077-cd30-418e-ab1e-ca6f5a9332c3 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:38.655937 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-73924903-474f-4976-9678-101a0e774589 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:38.656555 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-73924903-474f-4976-9678-101a0e774589 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:38.657464 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-73924903-474f-4976-9678-101a0e774589 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:38.657785 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d2ded077-cd30-418e-ab1e-ca6f5a9332c3 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: ba62d863-e7f4-4653-a03b-66b3549bf8d2] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:38.658093 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-73924903-474f-4976-9678-101a0e774589 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:38.658535 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-73924903-474f-4976-9678-101a0e774589 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:38.672883 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d2ded077-cd30-418e-ab1e-ca6f5a9332c3 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:38.672883 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d2ded077-cd30-418e-ab1e-ca6f5a9332c3 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:38.672883 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d2ded077-cd30-418e-ab1e-ca6f5a9332c3 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:38.672883 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d2ded077-cd30-418e-ab1e-ca6f5a9332c3 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:38.674203 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d2ded077-cd30-418e-ab1e-ca6f5a9332c3 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:38.674203 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d2ded077-cd30-418e-ab1e-ca6f5a9332c3 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:38.774764 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d2ded077-cd30-418e-ab1e-ca6f5a9332c3 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:38.775795 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d2ded077-cd30-418e-ab1e-ca6f5a9332c3 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:38.776477 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d2ded077-cd30-418e-ab1e-ca6f5a9332c3 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:38.779170 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-d2ded077-cd30-418e-ab1e-ca6f5a9332c3 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lazy-loading 'fault' on Instance uuid ba62d863-e7f4-4653-a03b-66b3549bf8d2 {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:30:38.914626 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d2ded077-cd30-418e-ab1e-ca6f5a9332c3 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2b0581ad4e4c9787bef838c81870a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4dfe251b1e046a995b8ec302cb2ffa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:38.927039 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d2ded077-cd30-418e-ab1e-ca6f5a9332c3 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "GET /compute/v2.1/servers/ba62d863-e7f4-4653-a03b-66b3549bf8d2" status: 200 len: 1308 microversion: 2.1 time: 0.299816 Oct 19 03:30:38.930247 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1985/4060] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:30:38 2022] GET /compute/v2.1/servers/ba62d863-e7f4-4653-a03b-66b3549bf8d2 => generated 1308 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:30:38.939409 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c0f52a64-6d20-4265-8c5c-28fb70961536 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:38.946156 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c0f52a64-6d20-4265-8c5c-28fb70961536 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] [instance: cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:38.958620 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c0f52a64-6d20-4265-8c5c-28fb70961536 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:38.959132 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c0f52a64-6d20-4265-8c5c-28fb70961536 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:38.959584 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c0f52a64-6d20-4265-8c5c-28fb70961536 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:38.960307 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c0f52a64-6d20-4265-8c5c-28fb70961536 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:38.960770 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c0f52a64-6d20-4265-8c5c-28fb70961536 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:38.961208 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c0f52a64-6d20-4265-8c5c-28fb70961536 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:38.987817 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-c0f52a64-6d20-4265-8c5c-28fb70961536 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] HTTP exception thrown: Instance cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 could not be found. Oct 19 03:30:38.991645 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c0f52a64-6d20-4265-8c5c-28fb70961536 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Request method failure captured: Oct 19 03:30:38.991645 n-d-861333-8 devstack@n-api.service[121134]: request: DELETE /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 HTTP/1.1 Oct 19 03:30:38.991645 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:30:38.991645 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:30:38.991645 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:30:38.991645 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:30:38.991645 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:30:38.991645 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:30:38.991645 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:30:38.991645 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:30:38.991645 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT21Y1UEaHwIcwrTQrjQ3TtHlXy5fJ-DokkJFYJV8ogZ5MiUXkPDOUwIQWdN36Vj5YMO0Ikk7yymAtKiojqG55D8BdbYTlJTeCtWQNlyXKk3ukS4zX58vIKZc550ViFj8stb7nePUCplgu9q8b0vmhZ4HqwssM9JlwRuDZK_v0FLJHqU Oct 19 03:30:38.991645 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:30:38.991645 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:30:38.991645 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:30:38.991645 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:30:38.991645 n-d-861333-8 devstack@n-api.service[121134]: X-Openstack-Nova-Api-Version: 2.42 Oct 19 03:30:38.991645 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:30:38.991645 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:30:38.991645 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 3de899450062428e8cd4686ae84de2eb Oct 19 03:30:38.991645 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-195615829 Oct 19 03:30:38.991645 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:30:38.991645 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:30:38.994079 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/3de899450062428e8cd4686ae84de2eb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3de899450062428e8cd4686ae84de2eb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3de899450062428e8cd4686ae84de2eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_3de899450062428e8cd4686ae84de2eb", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:30:38.994079 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-TaggedBootDevicesTest_v242-195615829 Oct 19 03:30:38.994079 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 3de899450062428e8cd4686ae84de2eb Oct 19 03:30:38.994079 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-195615829 Oct 19 03:30:38.994079 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-TaggedBootDevicesTest_v242-195615829-project Oct 19 03:30:38.994079 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:30:38.994079 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:30:38.994079 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 1804c1df36f347feb017deec5eef9dbb Oct 19 03:30:38.994079 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-TaggedBootDevicesTest_v242-195615829-project Oct 19 03:30:38.994079 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:30:38.994079 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 could not be found. Oct 19 03:30:38.994079 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': 'cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95'} Oct 19 03:30:38.995084 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:30:38.995084 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:30:38.995084 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:30:38.995084 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:30:38.995084 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:30:38.995084 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:30:38.995084 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:30:38.995084 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:30:38.995084 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:30:38.995084 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:30:38.995084 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 could not be found. Oct 19 03:30:38.995084 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:30:38.995084 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:30:38.995084 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:30:38.995084 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:30:38.995084 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:30:38.995084 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:30:38.995084 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:30:38.995084 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:30:38.995084 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:30:38.996804 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:30:38.996804 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 03:30:38.996804 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 03:30:38.996804 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 03:30:38.996804 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 03:30:38.996804 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:30:38.996804 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:30:38.996804 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:30:38.996804 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:30:38.996804 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 could not be found. Oct 19 03:30:38.996804 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:30:38.996804 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:30:38.996804 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:30:38.996804 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:30:38.996804 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:30:38.996804 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:30:38.996804 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:30:38.996804 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:30:38.996804 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 could not be found. Oct 19 03:30:38.996804 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:30:38.999354 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c0f52a64-6d20-4265-8c5c-28fb70961536 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Returning 404 to user: Instance cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:30:38.999354 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c0f52a64-6d20-4265-8c5c-28fb70961536 tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] 10.222.0.52 "DELETE /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95" status: 404 len: 111 microversion: 2.42 time: 0.060470 Oct 19 03:30:38.999354 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1986/4061] 10.222.0.52 () {60 vars in 1280 bytes} [Wed Oct 19 03:30:38 2022] DELETE /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 19 03:30:39.003596 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a8e77f2b-e063-45d0-98bf-4c36a99e4d1e tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:39.004496 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a8e77f2b-e063-45d0-98bf-4c36a99e4d1e tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] [instance: cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:39.014465 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a8e77f2b-e063-45d0-98bf-4c36a99e4d1e tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:39.015249 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a8e77f2b-e063-45d0-98bf-4c36a99e4d1e tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:39.018344 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a8e77f2b-e063-45d0-98bf-4c36a99e4d1e tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:39.018344 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a8e77f2b-e063-45d0-98bf-4c36a99e4d1e tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:39.018344 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a8e77f2b-e063-45d0-98bf-4c36a99e4d1e tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:39.019219 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a8e77f2b-e063-45d0-98bf-4c36a99e4d1e tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:39.085662 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-a8e77f2b-e063-45d0-98bf-4c36a99e4d1e tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] HTTP exception thrown: Instance cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 could not be found. Oct 19 03:30:39.087289 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a8e77f2b-e063-45d0-98bf-4c36a99e4d1e tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Request method failure captured: Oct 19 03:30:39.087289 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 HTTP/1.1 Oct 19 03:30:39.087289 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:30:39.087289 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:30:39.087289 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:30:39.087289 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:30:39.087289 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:30:39.087289 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:30:39.087289 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:30:39.087289 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:30:39.087289 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT21Y1UEaHwIcwrTQrjQ3TtHlXy5fJ-DokkJFYJV8ogZ5MiUXkPDOUwIQWdN36Vj5YMO0Ikk7yymAtKiojqG55D8BdbYTlJTeCtWQNlyXKk3ukS4zX58vIKZc550ViFj8stb7nePUCplgu9q8b0vmhZ4HqwssM9JlwRuDZK_v0FLJHqU Oct 19 03:30:39.087289 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:30:39.087289 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:30:39.087289 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:30:39.087289 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:30:39.087289 n-d-861333-8 devstack@n-api.service[121134]: X-Openstack-Nova-Api-Version: 2.42 Oct 19 03:30:39.087289 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:30:39.087289 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:30:39.087289 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 3de899450062428e8cd4686ae84de2eb Oct 19 03:30:39.087289 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-195615829 Oct 19 03:30:39.087289 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:30:39.087289 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:30:39.089035 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/3de899450062428e8cd4686ae84de2eb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3de899450062428e8cd4686ae84de2eb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3de899450062428e8cd4686ae84de2eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_3de899450062428e8cd4686ae84de2eb", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:30:39.089035 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-TaggedBootDevicesTest_v242-195615829 Oct 19 03:30:39.089035 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 3de899450062428e8cd4686ae84de2eb Oct 19 03:30:39.089035 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-195615829 Oct 19 03:30:39.089035 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-TaggedBootDevicesTest_v242-195615829-project Oct 19 03:30:39.089035 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:30:39.089035 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:30:39.089035 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 1804c1df36f347feb017deec5eef9dbb Oct 19 03:30:39.089035 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-TaggedBootDevicesTest_v242-195615829-project Oct 19 03:30:39.089035 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:30:39.089035 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 could not be found. Oct 19 03:30:39.089035 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': 'cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95'} Oct 19 03:30:39.090057 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:30:39.090057 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:30:39.090057 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:30:39.090057 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:30:39.090057 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:30:39.090057 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:30:39.090057 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:30:39.090057 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:30:39.090057 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:30:39.090057 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:30:39.090057 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 could not be found. Oct 19 03:30:39.090057 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:30:39.090057 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:30:39.090057 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:30:39.090057 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:30:39.090057 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:30:39.090057 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:30:39.090057 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:30:39.090057 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:30:39.090057 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:30:39.091470 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:30:39.091470 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:30:39.091470 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:30:39.091470 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:30:39.091470 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:30:39.091470 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:30:39.091470 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:30:39.091470 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 could not be found. Oct 19 03:30:39.091470 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:30:39.091470 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:30:39.091470 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:30:39.091470 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:30:39.091470 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:30:39.091470 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:30:39.091470 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:30:39.091470 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:30:39.091470 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 could not be found. Oct 19 03:30:39.091470 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:30:39.092779 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a8e77f2b-e063-45d0-98bf-4c36a99e4d1e tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] Returning 404 to user: Instance cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:30:39.092779 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a8e77f2b-e063-45d0-98bf-4c36a99e4d1e tempest-TaggedBootDevicesTest_v242-195615829 tempest-TaggedBootDevicesTest_v242-195615829-project] 10.222.0.52 "GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95" status: 404 len: 111 microversion: 2.42 time: 0.092232 Oct 19 03:30:39.114356 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1987/4062] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:30:38 2022] GET /compute/v2.1/servers/cf76aeaa-b5c6-4cd9-9fc4-5cbe7c856a95 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 19 03:30:39.116818 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-73924903-474f-4976-9678-101a0e774589 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc644418a4740eb93ea25523f2dda2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2b45ceb5804744a7d017c20ec90d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:39.129738 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-73924903-474f-4976-9678-101a0e774589 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] 10.222.0.52 "GET /compute/v2.1/servers/a4d81635-37be-432c-8b90-31b94961465d" status: 200 len: 1504 microversion: 2.1 time: 0.495008 Oct 19 03:30:39.139227 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2076/4063] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:30:38 2022] GET /compute/v2.1/servers/a4d81635-37be-432c-8b90-31b94961465d => generated 1504 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:30:39.171250 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-58fe402c-ecdc-4ac2-986d-5c8896e25a69 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:39.171754 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-58fe402c-ecdc-4ac2-986d-5c8896e25a69 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] [instance: a4d81635-37be-432c-8b90-31b94961465d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:39.187181 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-58fe402c-ecdc-4ac2-986d-5c8896e25a69 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:39.187690 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-58fe402c-ecdc-4ac2-986d-5c8896e25a69 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:39.188138 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-58fe402c-ecdc-4ac2-986d-5c8896e25a69 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:39.188867 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-58fe402c-ecdc-4ac2-986d-5c8896e25a69 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:39.191451 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-58fe402c-ecdc-4ac2-986d-5c8896e25a69 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:39.192170 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-58fe402c-ecdc-4ac2-986d-5c8896e25a69 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:39.526724 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-58fe402c-ecdc-4ac2-986d-5c8896e25a69 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] 10.222.0.52 "DELETE /compute/v2.1/servers/a4d81635-37be-432c-8b90-31b94961465d/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.362872 Oct 19 03:30:39.528107 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1988/4064] 10.222.0.52 () {58 vars in 1296 bytes} [Wed Oct 19 03:30:39 2022] DELETE /compute/v2.1/servers/a4d81635-37be-432c-8b90-31b94961465d/os-server-password => generated 0 bytes in 365 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:30:39.541821 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-28e37c3f-c800-4dab-9049-3da388447a2e tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:39.544490 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-28e37c3f-c800-4dab-9049-3da388447a2e tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] [instance: a4d81635-37be-432c-8b90-31b94961465d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:39.571911 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-28e37c3f-c800-4dab-9049-3da388447a2e tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:39.573942 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-28e37c3f-c800-4dab-9049-3da388447a2e tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:39.584380 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-28e37c3f-c800-4dab-9049-3da388447a2e tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:39.584380 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-28e37c3f-c800-4dab-9049-3da388447a2e tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:39.584380 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-28e37c3f-c800-4dab-9049-3da388447a2e tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:39.584380 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-28e37c3f-c800-4dab-9049-3da388447a2e tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:39.586012 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e91480f0-8f27-47e8-b460-4e2040aac6df tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:39.587290 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e91480f0-8f27-47e8-b460-4e2040aac6df tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 89f5f23f-8580-46fa-accf-206b1141c301] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:39.600262 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e91480f0-8f27-47e8-b460-4e2040aac6df tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:39.601138 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e91480f0-8f27-47e8-b460-4e2040aac6df tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:39.601960 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e91480f0-8f27-47e8-b460-4e2040aac6df tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:39.604577 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e91480f0-8f27-47e8-b460-4e2040aac6df tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:39.605337 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e91480f0-8f27-47e8-b460-4e2040aac6df tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:39.606121 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e91480f0-8f27-47e8-b460-4e2040aac6df tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:39.640454 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-28e37c3f-c800-4dab-9049-3da388447a2e tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] 10.222.0.52 "GET /compute/v2.1/servers/a4d81635-37be-432c-8b90-31b94961465d/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.106279 Oct 19 03:30:39.641651 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2077/4065] 10.222.0.52 () {58 vars in 1293 bytes} [Wed Oct 19 03:30:39 2022] GET /compute/v2.1/servers/a4d81635-37be-432c-8b90-31b94961465d/os-server-password => generated 16 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 03:30:39.648573 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-95e808fc-8c42-4c6a-85cc-97218036d83a tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:39.650289 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-95e808fc-8c42-4c6a-85cc-97218036d83a tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:39.672976 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-95e808fc-8c42-4c6a-85cc-97218036d83a tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:39.674409 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-95e808fc-8c42-4c6a-85cc-97218036d83a tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:39.677578 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-95e808fc-8c42-4c6a-85cc-97218036d83a tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:39.683369 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-95e808fc-8c42-4c6a-85cc-97218036d83a tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:39.683369 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-95e808fc-8c42-4c6a-85cc-97218036d83a tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:39.683369 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-95e808fc-8c42-4c6a-85cc-97218036d83a tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:40.603769 n-d-861333-8 devstack@n-api.service[121134]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 03:30:40.605361 n-d-861333-8 devstack@n-api.service[121134]: Wed Oct 19 03:30:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301 (ip 10.222.0.52) !!! Oct 19 03:30:41.309228 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-95e808fc-8c42-4c6a-85cc-97218036d83a tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:41.347580 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-95e808fc-8c42-4c6a-85cc-97218036d83a tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1683 microversion: 2.1 time: 1.704558 Oct 19 03:30:41.352922 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2078/4066] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:30:39 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1683 bytes in 1707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:30:41.361868 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-99851de8-00f1-4e34-b70a-00381634c093 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:41.381562 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-99851de8-00f1-4e34-b70a-00381634c093 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] [instance: a4d81635-37be-432c-8b90-31b94961465d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:41.381562 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-99851de8-00f1-4e34-b70a-00381634c093 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:41.381562 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-99851de8-00f1-4e34-b70a-00381634c093 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:41.383325 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-99851de8-00f1-4e34-b70a-00381634c093 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:41.385992 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-99851de8-00f1-4e34-b70a-00381634c093 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:41.386683 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-99851de8-00f1-4e34-b70a-00381634c093 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:41.391964 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-99851de8-00f1-4e34-b70a-00381634c093 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:41.494217 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-99851de8-00f1-4e34-b70a-00381634c093 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] [instance: a4d81635-37be-432c-8b90-31b94961465d] Going to try to terminate instance {{(pid=121135) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:30:41.748528 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e91480f0-8f27-47e8-b460-4e2040aac6df tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:41.763883 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e91480f0-8f27-47e8-b460-4e2040aac6df tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301" status: 200 len: 1390 microversion: 2.1 time: 2.177321 Oct 19 03:30:41.764567 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1989/4067] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:30:39 2022] GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301 => generated 1390 bytes in 2186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:30:41.781271 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-89daa62c-7894-4bef-8998-7726bf9c7490 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:41.782183 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-89daa62c-7894-4bef-8998-7726bf9c7490 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: ba62d863-e7f4-4653-a03b-66b3549bf8d2] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:41.798343 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-89daa62c-7894-4bef-8998-7726bf9c7490 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:41.798847 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-89daa62c-7894-4bef-8998-7726bf9c7490 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:41.799299 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-89daa62c-7894-4bef-8998-7726bf9c7490 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:41.800013 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-89daa62c-7894-4bef-8998-7726bf9c7490 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:41.800475 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-89daa62c-7894-4bef-8998-7726bf9c7490 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:41.800912 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-89daa62c-7894-4bef-8998-7726bf9c7490 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:41.823313 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-89daa62c-7894-4bef-8998-7726bf9c7490 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] HTTP exception thrown: Instance ba62d863-e7f4-4653-a03b-66b3549bf8d2 could not be found. Oct 19 03:30:41.826441 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-89daa62c-7894-4bef-8998-7726bf9c7490 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Request method failure captured: Oct 19 03:30:41.826441 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/ba62d863-e7f4-4653-a03b-66b3549bf8d2 HTTP/1.1 Oct 19 03:30:41.826441 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:30:41.826441 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:30:41.826441 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:30:41.826441 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:30:41.826441 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:30:41.826441 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:30:41.826441 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:30:41.826441 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:30:41.826441 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT26lpiOzZ8lBaXv6gRPr81okTT9jc0xzO_2xEYpfqjlsQJ5U-qWTSZXYzYMtLUHdKZXkAvx__Slkt5EFJOl8KS48P4KHV8xOGHnxRSODolKsNHdEYCVPJY8ZZz1Y-jzKqZL3HGaeYkYP-EmTFw_mDnG9pElvbuX3hHn6xOHwKDAOQG8 Oct 19 03:30:41.826441 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:30:41.826441 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:30:41.826441 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:30:41.826441 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:30:41.826441 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:30:41.826441 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:30:41.826441 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: c4dfe251b1e046a995b8ec302cb2ffa0 Oct 19 03:30:41.826441 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1442045039 Oct 19 03:30:41.826441 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:30:41.826441 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:30:41.827981 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c4dfe251b1e046a995b8ec302cb2ffa0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c4dfe251b1e046a995b8ec302cb2ffa0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c4dfe251b1e046a995b8ec302cb2ffa0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c4dfe251b1e046a995b8ec302cb2ffa0", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:30:41.827981 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ServerDiskConfigTestJSON-1442045039 Oct 19 03:30:41.827981 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: c4dfe251b1e046a995b8ec302cb2ffa0 Oct 19 03:30:41.827981 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1442045039 Oct 19 03:30:41.827981 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ServerDiskConfigTestJSON-1442045039-project Oct 19 03:30:41.827981 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:30:41.827981 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:30:41.827981 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: de2b0581ad4e4c9787bef838c81870a2 Oct 19 03:30:41.827981 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ServerDiskConfigTestJSON-1442045039-project Oct 19 03:30:41.827981 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:30:41.827981 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance ba62d863-e7f4-4653-a03b-66b3549bf8d2 could not be found. Oct 19 03:30:41.827981 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': 'ba62d863-e7f4-4653-a03b-66b3549bf8d2'} Oct 19 03:30:41.828921 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:30:41.828921 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:30:41.828921 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:30:41.828921 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:30:41.828921 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:30:41.828921 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:30:41.828921 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:30:41.828921 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:30:41.828921 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:30:41.828921 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:30:41.828921 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba62d863-e7f4-4653-a03b-66b3549bf8d2 could not be found. Oct 19 03:30:41.828921 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:30:41.828921 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:30:41.828921 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:30:41.828921 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:30:41.828921 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:30:41.828921 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:30:41.828921 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:30:41.828921 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:30:41.828921 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:30:41.830333 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:30:41.830333 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:30:41.830333 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:30:41.830333 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:30:41.830333 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:30:41.830333 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:30:41.830333 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:30:41.830333 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba62d863-e7f4-4653-a03b-66b3549bf8d2 could not be found. Oct 19 03:30:41.830333 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:30:41.830333 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:30:41.830333 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:30:41.830333 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:30:41.830333 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:30:41.830333 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:30:41.830333 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:30:41.830333 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:30:41.830333 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba62d863-e7f4-4653-a03b-66b3549bf8d2 could not be found. Oct 19 03:30:41.830333 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:30:41.832728 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-89daa62c-7894-4bef-8998-7726bf9c7490 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Returning 404 to user: Instance ba62d863-e7f4-4653-a03b-66b3549bf8d2 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:30:41.833907 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-89daa62c-7894-4bef-8998-7726bf9c7490 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "GET /compute/v2.1/servers/ba62d863-e7f4-4653-a03b-66b3549bf8d2" status: 404 len: 111 microversion: 2.1 time: 0.065856 Oct 19 03:30:41.834993 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1990/4068] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:30:41 2022] GET /compute/v2.1/servers/ba62d863-e7f4-4653-a03b-66b3549bf8d2 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:30:41.846573 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4686f3f0-2d19-4175-a76f-35f535a5823c tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:41.847087 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4686f3f0-2d19-4175-a76f-35f535a5823c tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: e13547eb-efb0-4153-8dec-a666d4e6349b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:41.853519 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4686f3f0-2d19-4175-a76f-35f535a5823c tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:41.853965 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4686f3f0-2d19-4175-a76f-35f535a5823c tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:41.854416 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4686f3f0-2d19-4175-a76f-35f535a5823c tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:41.855131 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4686f3f0-2d19-4175-a76f-35f535a5823c tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:41.855591 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4686f3f0-2d19-4175-a76f-35f535a5823c tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:41.856631 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4686f3f0-2d19-4175-a76f-35f535a5823c tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:41.872618 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-4686f3f0-2d19-4175-a76f-35f535a5823c tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] HTTP exception thrown: Instance e13547eb-efb0-4153-8dec-a666d4e6349b could not be found. Oct 19 03:30:41.874476 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4686f3f0-2d19-4175-a76f-35f535a5823c tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Request method failure captured: Oct 19 03:30:41.874476 n-d-861333-8 devstack@n-api.service[121134]: request: DELETE /compute/v2.1/servers/e13547eb-efb0-4153-8dec-a666d4e6349b HTTP/1.1 Oct 19 03:30:41.874476 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:30:41.874476 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:30:41.874476 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:30:41.874476 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:30:41.874476 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:30:41.874476 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:30:41.874476 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:30:41.874476 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:30:41.874476 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT26lpiOzZ8lBaXv6gRPr81okTT9jc0xzO_2xEYpfqjlsQJ5U-qWTSZXYzYMtLUHdKZXkAvx__Slkt5EFJOl8KS48P4KHV8xOGHnxRSODolKsNHdEYCVPJY8ZZz1Y-jzKqZL3HGaeYkYP-EmTFw_mDnG9pElvbuX3hHn6xOHwKDAOQG8 Oct 19 03:30:41.874476 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:30:41.874476 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:30:41.874476 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:30:41.874476 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:30:41.874476 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:30:41.874476 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:30:41.874476 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: c4dfe251b1e046a995b8ec302cb2ffa0 Oct 19 03:30:41.874476 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1442045039 Oct 19 03:30:41.874476 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:30:41.874476 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:30:41.875953 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c4dfe251b1e046a995b8ec302cb2ffa0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c4dfe251b1e046a995b8ec302cb2ffa0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c4dfe251b1e046a995b8ec302cb2ffa0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c4dfe251b1e046a995b8ec302cb2ffa0", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:30:41.875953 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ServerDiskConfigTestJSON-1442045039 Oct 19 03:30:41.875953 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: c4dfe251b1e046a995b8ec302cb2ffa0 Oct 19 03:30:41.875953 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1442045039 Oct 19 03:30:41.875953 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ServerDiskConfigTestJSON-1442045039-project Oct 19 03:30:41.875953 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:30:41.875953 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:30:41.875953 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: de2b0581ad4e4c9787bef838c81870a2 Oct 19 03:30:41.875953 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ServerDiskConfigTestJSON-1442045039-project Oct 19 03:30:41.875953 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:30:41.875953 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance e13547eb-efb0-4153-8dec-a666d4e6349b could not be found. Oct 19 03:30:41.875953 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': 'e13547eb-efb0-4153-8dec-a666d4e6349b'} Oct 19 03:30:41.876836 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:30:41.876836 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:30:41.876836 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:30:41.876836 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:30:41.876836 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:30:41.876836 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:30:41.876836 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:30:41.876836 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:30:41.876836 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:30:41.876836 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:30:41.876836 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e13547eb-efb0-4153-8dec-a666d4e6349b could not be found. Oct 19 03:30:41.876836 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:30:41.876836 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:30:41.876836 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:30:41.876836 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:30:41.876836 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:30:41.876836 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:30:41.876836 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:30:41.876836 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:30:41.876836 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:30:41.878370 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:30:41.878370 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 03:30:41.878370 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 03:30:41.878370 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 03:30:41.878370 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 03:30:41.878370 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:30:41.878370 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:30:41.878370 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:30:41.878370 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:30:41.878370 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e13547eb-efb0-4153-8dec-a666d4e6349b could not be found. Oct 19 03:30:41.878370 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:30:41.878370 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:30:41.878370 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:30:41.878370 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:30:41.878370 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:30:41.878370 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:30:41.878370 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:30:41.878370 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:30:41.878370 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e13547eb-efb0-4153-8dec-a666d4e6349b could not be found. Oct 19 03:30:41.878370 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:30:41.879727 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4686f3f0-2d19-4175-a76f-35f535a5823c tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Returning 404 to user: Instance e13547eb-efb0-4153-8dec-a666d4e6349b could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:30:41.879727 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4686f3f0-2d19-4175-a76f-35f535a5823c tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "DELETE /compute/v2.1/servers/e13547eb-efb0-4153-8dec-a666d4e6349b" status: 404 len: 111 microversion: 2.1 time: 0.035447 Oct 19 03:30:41.892538 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1991/4069] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:30:41 2022] DELETE /compute/v2.1/servers/e13547eb-efb0-4153-8dec-a666d4e6349b => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:30:41.898212 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1dc048a5-ff3b-4ed4-83c3-53df3029e302 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:41.901349 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1dc048a5-ff3b-4ed4-83c3-53df3029e302 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: e13547eb-efb0-4153-8dec-a666d4e6349b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:41.921355 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1dc048a5-ff3b-4ed4-83c3-53df3029e302 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:41.922074 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1dc048a5-ff3b-4ed4-83c3-53df3029e302 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:41.922730 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1dc048a5-ff3b-4ed4-83c3-53df3029e302 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:41.923650 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1dc048a5-ff3b-4ed4-83c3-53df3029e302 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:41.925124 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1dc048a5-ff3b-4ed4-83c3-53df3029e302 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:41.925797 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1dc048a5-ff3b-4ed4-83c3-53df3029e302 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:41.978039 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-1dc048a5-ff3b-4ed4-83c3-53df3029e302 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] HTTP exception thrown: Instance e13547eb-efb0-4153-8dec-a666d4e6349b could not be found. Oct 19 03:30:41.979762 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1dc048a5-ff3b-4ed4-83c3-53df3029e302 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Request method failure captured: Oct 19 03:30:41.979762 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/e13547eb-efb0-4153-8dec-a666d4e6349b HTTP/1.1 Oct 19 03:30:41.979762 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:30:41.979762 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:30:41.979762 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:30:41.979762 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:30:41.979762 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:30:41.979762 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:30:41.979762 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:30:41.979762 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:30:41.979762 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT26lpiOzZ8lBaXv6gRPr81okTT9jc0xzO_2xEYpfqjlsQJ5U-qWTSZXYzYMtLUHdKZXkAvx__Slkt5EFJOl8KS48P4KHV8xOGHnxRSODolKsNHdEYCVPJY8ZZz1Y-jzKqZL3HGaeYkYP-EmTFw_mDnG9pElvbuX3hHn6xOHwKDAOQG8 Oct 19 03:30:41.979762 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:30:41.979762 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:30:41.979762 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:30:41.979762 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:30:41.979762 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:30:41.979762 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:30:41.979762 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: c4dfe251b1e046a995b8ec302cb2ffa0 Oct 19 03:30:41.979762 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1442045039 Oct 19 03:30:41.979762 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:30:41.979762 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:30:41.982076 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c4dfe251b1e046a995b8ec302cb2ffa0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c4dfe251b1e046a995b8ec302cb2ffa0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c4dfe251b1e046a995b8ec302cb2ffa0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c4dfe251b1e046a995b8ec302cb2ffa0", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:30:41.982076 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ServerDiskConfigTestJSON-1442045039 Oct 19 03:30:41.982076 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: c4dfe251b1e046a995b8ec302cb2ffa0 Oct 19 03:30:41.982076 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1442045039 Oct 19 03:30:41.982076 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ServerDiskConfigTestJSON-1442045039-project Oct 19 03:30:41.982076 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:30:41.982076 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:30:41.982076 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: de2b0581ad4e4c9787bef838c81870a2 Oct 19 03:30:41.982076 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ServerDiskConfigTestJSON-1442045039-project Oct 19 03:30:41.982076 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:30:41.982076 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance e13547eb-efb0-4153-8dec-a666d4e6349b could not be found. Oct 19 03:30:41.982076 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': 'e13547eb-efb0-4153-8dec-a666d4e6349b'} Oct 19 03:30:41.983108 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:30:41.983108 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:30:41.983108 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:30:41.983108 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:30:41.983108 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:30:41.983108 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:30:41.983108 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:30:41.983108 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:30:41.983108 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:30:41.983108 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:30:41.983108 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e13547eb-efb0-4153-8dec-a666d4e6349b could not be found. Oct 19 03:30:41.983108 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:30:41.983108 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:30:41.983108 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:30:41.983108 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:30:41.983108 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:30:41.983108 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:30:41.983108 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:30:41.983108 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:30:41.983108 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:30:41.984818 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:30:41.984818 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:30:41.984818 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:30:41.984818 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:30:41.984818 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:30:41.984818 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:30:41.984818 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:30:41.984818 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e13547eb-efb0-4153-8dec-a666d4e6349b could not be found. Oct 19 03:30:41.984818 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:30:41.984818 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:30:41.984818 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:30:41.984818 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:30:41.984818 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:30:41.984818 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:30:41.984818 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:30:41.984818 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:30:41.984818 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e13547eb-efb0-4153-8dec-a666d4e6349b could not be found. Oct 19 03:30:41.984818 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:30:41.986264 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1dc048a5-ff3b-4ed4-83c3-53df3029e302 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Returning 404 to user: Instance e13547eb-efb0-4153-8dec-a666d4e6349b could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:30:41.997938 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1dc048a5-ff3b-4ed4-83c3-53df3029e302 tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "GET /compute/v2.1/servers/e13547eb-efb0-4153-8dec-a666d4e6349b" status: 404 len: 111 microversion: 2.1 time: 0.087406 Oct 19 03:30:41.998886 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1992/4070] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:30:41 2022] GET /compute/v2.1/servers/e13547eb-efb0-4153-8dec-a666d4e6349b => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:30:42.015079 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5e0dfd6c-613f-48dd-ae15-5b112f3b7e4e tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:42.022291 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5e0dfd6c-613f-48dd-ae15-5b112f3b7e4e tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: 0051ff67-c0d0-4c84-a643-867d6416d8d1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:42.033265 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5e0dfd6c-613f-48dd-ae15-5b112f3b7e4e tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:42.042175 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5e0dfd6c-613f-48dd-ae15-5b112f3b7e4e tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:42.042981 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5e0dfd6c-613f-48dd-ae15-5b112f3b7e4e tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:42.051124 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5e0dfd6c-613f-48dd-ae15-5b112f3b7e4e tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:42.051124 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5e0dfd6c-613f-48dd-ae15-5b112f3b7e4e tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:42.051124 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5e0dfd6c-613f-48dd-ae15-5b112f3b7e4e tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:42.071025 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-5e0dfd6c-613f-48dd-ae15-5b112f3b7e4e tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] HTTP exception thrown: Instance 0051ff67-c0d0-4c84-a643-867d6416d8d1 could not be found. Oct 19 03:30:42.072803 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5e0dfd6c-613f-48dd-ae15-5b112f3b7e4e tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Request method failure captured: Oct 19 03:30:42.072803 n-d-861333-8 devstack@n-api.service[121134]: request: DELETE /compute/v2.1/servers/0051ff67-c0d0-4c84-a643-867d6416d8d1 HTTP/1.1 Oct 19 03:30:42.072803 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:30:42.072803 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:30:42.072803 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:30:42.072803 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:30:42.072803 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:30:42.072803 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:30:42.072803 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:30:42.072803 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:30:42.072803 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT26lpiOzZ8lBaXv6gRPr81okTT9jc0xzO_2xEYpfqjlsQJ5U-qWTSZXYzYMtLUHdKZXkAvx__Slkt5EFJOl8KS48P4KHV8xOGHnxRSODolKsNHdEYCVPJY8ZZz1Y-jzKqZL3HGaeYkYP-EmTFw_mDnG9pElvbuX3hHn6xOHwKDAOQG8 Oct 19 03:30:42.072803 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:30:42.072803 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:30:42.072803 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:30:42.072803 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:30:42.072803 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:30:42.072803 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:30:42.072803 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: c4dfe251b1e046a995b8ec302cb2ffa0 Oct 19 03:30:42.072803 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1442045039 Oct 19 03:30:42.072803 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:30:42.072803 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:30:42.074613 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c4dfe251b1e046a995b8ec302cb2ffa0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c4dfe251b1e046a995b8ec302cb2ffa0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c4dfe251b1e046a995b8ec302cb2ffa0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c4dfe251b1e046a995b8ec302cb2ffa0", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:30:42.074613 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ServerDiskConfigTestJSON-1442045039 Oct 19 03:30:42.074613 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: c4dfe251b1e046a995b8ec302cb2ffa0 Oct 19 03:30:42.074613 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1442045039 Oct 19 03:30:42.074613 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ServerDiskConfigTestJSON-1442045039-project Oct 19 03:30:42.074613 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:30:42.074613 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:30:42.074613 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: de2b0581ad4e4c9787bef838c81870a2 Oct 19 03:30:42.074613 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ServerDiskConfigTestJSON-1442045039-project Oct 19 03:30:42.074613 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:30:42.074613 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance 0051ff67-c0d0-4c84-a643-867d6416d8d1 could not be found. Oct 19 03:30:42.074613 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '0051ff67-c0d0-4c84-a643-867d6416d8d1'} Oct 19 03:30:42.078064 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:30:42.078064 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:30:42.078064 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:30:42.078064 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:30:42.078064 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:30:42.078064 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:30:42.078064 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:30:42.078064 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:30:42.078064 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:30:42.078064 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:30:42.078064 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0051ff67-c0d0-4c84-a643-867d6416d8d1 could not be found. Oct 19 03:30:42.078064 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:30:42.078064 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:30:42.078064 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:30:42.078064 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:30:42.078064 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:30:42.078064 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:30:42.078064 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:30:42.078064 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:30:42.078064 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:30:42.079883 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:30:42.079883 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 03:30:42.079883 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 03:30:42.079883 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 03:30:42.079883 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 03:30:42.079883 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:30:42.079883 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:30:42.079883 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:30:42.079883 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:30:42.079883 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0051ff67-c0d0-4c84-a643-867d6416d8d1 could not be found. Oct 19 03:30:42.079883 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:30:42.079883 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:30:42.079883 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:30:42.079883 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:30:42.079883 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:30:42.079883 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:30:42.079883 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:30:42.079883 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:30:42.079883 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0051ff67-c0d0-4c84-a643-867d6416d8d1 could not be found. Oct 19 03:30:42.079883 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:30:42.082413 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5e0dfd6c-613f-48dd-ae15-5b112f3b7e4e tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Returning 404 to user: Instance 0051ff67-c0d0-4c84-a643-867d6416d8d1 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:30:42.082413 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5e0dfd6c-613f-48dd-ae15-5b112f3b7e4e tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "DELETE /compute/v2.1/servers/0051ff67-c0d0-4c84-a643-867d6416d8d1" status: 404 len: 111 microversion: 2.1 time: 0.071249 Oct 19 03:30:42.089764 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1993/4071] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:30:42 2022] DELETE /compute/v2.1/servers/0051ff67-c0d0-4c84-a643-867d6416d8d1 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 03:30:42.095512 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d28dbba4-6074-4a8f-84ab-b5f241e2baec tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:42.096162 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d28dbba4-6074-4a8f-84ab-b5f241e2baec tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] [instance: 0051ff67-c0d0-4c84-a643-867d6416d8d1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:42.111643 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d28dbba4-6074-4a8f-84ab-b5f241e2baec tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:42.112515 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d28dbba4-6074-4a8f-84ab-b5f241e2baec tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:42.113261 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d28dbba4-6074-4a8f-84ab-b5f241e2baec tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:42.114328 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d28dbba4-6074-4a8f-84ab-b5f241e2baec tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:42.122660 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d28dbba4-6074-4a8f-84ab-b5f241e2baec tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:42.123468 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d28dbba4-6074-4a8f-84ab-b5f241e2baec tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:42.153436 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-d28dbba4-6074-4a8f-84ab-b5f241e2baec tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] HTTP exception thrown: Instance 0051ff67-c0d0-4c84-a643-867d6416d8d1 could not be found. Oct 19 03:30:42.155411 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d28dbba4-6074-4a8f-84ab-b5f241e2baec tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Request method failure captured: Oct 19 03:30:42.155411 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/0051ff67-c0d0-4c84-a643-867d6416d8d1 HTTP/1.1 Oct 19 03:30:42.155411 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:30:42.155411 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:30:42.155411 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:30:42.155411 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:30:42.155411 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:30:42.155411 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:30:42.155411 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:30:42.155411 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:30:42.155411 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT26lpiOzZ8lBaXv6gRPr81okTT9jc0xzO_2xEYpfqjlsQJ5U-qWTSZXYzYMtLUHdKZXkAvx__Slkt5EFJOl8KS48P4KHV8xOGHnxRSODolKsNHdEYCVPJY8ZZz1Y-jzKqZL3HGaeYkYP-EmTFw_mDnG9pElvbuX3hHn6xOHwKDAOQG8 Oct 19 03:30:42.155411 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:30:42.155411 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:30:42.155411 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:30:42.155411 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:30:42.155411 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:30:42.155411 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:30:42.155411 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: c4dfe251b1e046a995b8ec302cb2ffa0 Oct 19 03:30:42.155411 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1442045039 Oct 19 03:30:42.155411 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:30:42.155411 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:30:42.157186 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c4dfe251b1e046a995b8ec302cb2ffa0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c4dfe251b1e046a995b8ec302cb2ffa0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c4dfe251b1e046a995b8ec302cb2ffa0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c4dfe251b1e046a995b8ec302cb2ffa0", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:30:42.157186 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ServerDiskConfigTestJSON-1442045039 Oct 19 03:30:42.157186 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: c4dfe251b1e046a995b8ec302cb2ffa0 Oct 19 03:30:42.157186 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1442045039 Oct 19 03:30:42.157186 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ServerDiskConfigTestJSON-1442045039-project Oct 19 03:30:42.157186 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:30:42.157186 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:30:42.157186 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: de2b0581ad4e4c9787bef838c81870a2 Oct 19 03:30:42.157186 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ServerDiskConfigTestJSON-1442045039-project Oct 19 03:30:42.157186 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:30:42.157186 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance 0051ff67-c0d0-4c84-a643-867d6416d8d1 could not be found. Oct 19 03:30:42.157186 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '0051ff67-c0d0-4c84-a643-867d6416d8d1'} Oct 19 03:30:42.158088 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:30:42.158088 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:30:42.158088 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:30:42.158088 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:30:42.158088 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:30:42.158088 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:30:42.158088 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:30:42.158088 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:30:42.158088 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:30:42.158088 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:30:42.158088 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0051ff67-c0d0-4c84-a643-867d6416d8d1 could not be found. Oct 19 03:30:42.158088 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:30:42.158088 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:30:42.158088 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:30:42.158088 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:30:42.158088 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:30:42.158088 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:30:42.158088 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:30:42.158088 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:30:42.158088 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:30:42.159594 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:30:42.159594 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:30:42.159594 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:30:42.159594 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:30:42.159594 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:30:42.159594 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:30:42.159594 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:30:42.159594 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0051ff67-c0d0-4c84-a643-867d6416d8d1 could not be found. Oct 19 03:30:42.159594 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:30:42.159594 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:30:42.159594 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:30:42.159594 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:30:42.159594 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:30:42.159594 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:30:42.159594 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:30:42.159594 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:30:42.159594 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0051ff67-c0d0-4c84-a643-867d6416d8d1 could not be found. Oct 19 03:30:42.159594 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:30:42.162306 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d28dbba4-6074-4a8f-84ab-b5f241e2baec tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] Returning 404 to user: Instance 0051ff67-c0d0-4c84-a643-867d6416d8d1 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:30:42.163381 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d28dbba4-6074-4a8f-84ab-b5f241e2baec tempest-ServerDiskConfigTestJSON-1442045039 tempest-ServerDiskConfigTestJSON-1442045039-project] 10.222.0.52 "GET /compute/v2.1/servers/0051ff67-c0d0-4c84-a643-867d6416d8d1" status: 404 len: 111 microversion: 2.1 time: 0.071935 Oct 19 03:30:42.167863 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1994/4072] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:30:42 2022] GET /compute/v2.1/servers/0051ff67-c0d0-4c84-a643-867d6416d8d1 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:30:42.381783 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4583eaa9-1b7a-47a1-a731-b31a39799929 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:42.382873 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4583eaa9-1b7a-47a1-a731-b31a39799929 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:42.402673 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4583eaa9-1b7a-47a1-a731-b31a39799929 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:42.404511 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4583eaa9-1b7a-47a1-a731-b31a39799929 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:42.404925 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4583eaa9-1b7a-47a1-a731-b31a39799929 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:42.405703 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4583eaa9-1b7a-47a1-a731-b31a39799929 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:42.408362 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4583eaa9-1b7a-47a1-a731-b31a39799929 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:42.409269 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4583eaa9-1b7a-47a1-a731-b31a39799929 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:42.467998 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-99851de8-00f1-4e34-b70a-00381634c093 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] 10.222.0.52 "DELETE /compute/v2.1/servers/a4d81635-37be-432c-8b90-31b94961465d" status: 204 len: 0 microversion: 2.1 time: 1.113105 Oct 19 03:30:42.469591 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2079/4073] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:30:41 2022] DELETE /compute/v2.1/servers/a4d81635-37be-432c-8b90-31b94961465d => generated 0 bytes in 1116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:30:42.478507 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a1e5cfc4-2d58-4a69-8af1-84bcb1724114 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:42.482274 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a1e5cfc4-2d58-4a69-8af1-84bcb1724114 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] [instance: a4d81635-37be-432c-8b90-31b94961465d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:42.493267 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a1e5cfc4-2d58-4a69-8af1-84bcb1724114 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:42.496275 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a1e5cfc4-2d58-4a69-8af1-84bcb1724114 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:42.497356 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a1e5cfc4-2d58-4a69-8af1-84bcb1724114 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:42.498158 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a1e5cfc4-2d58-4a69-8af1-84bcb1724114 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:42.498655 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a1e5cfc4-2d58-4a69-8af1-84bcb1724114 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:42.499089 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a1e5cfc4-2d58-4a69-8af1-84bcb1724114 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:43.216549 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-4583eaa9-1b7a-47a1-a731-b31a39799929 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:43.225834 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4583eaa9-1b7a-47a1-a731-b31a39799929 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1683 microversion: 2.1 time: 0.849253 Oct 19 03:30:43.229357 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1995/4074] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:30:42 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1683 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:30:43.243428 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-adf67a48-a576-4e0d-86db-9361e9070d3c tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:43.244416 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-adf67a48-a576-4e0d-86db-9361e9070d3c tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 89f5f23f-8580-46fa-accf-206b1141c301] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:43.257542 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-adf67a48-a576-4e0d-86db-9361e9070d3c tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:43.259413 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-adf67a48-a576-4e0d-86db-9361e9070d3c tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:43.261453 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-adf67a48-a576-4e0d-86db-9361e9070d3c tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:43.263893 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-adf67a48-a576-4e0d-86db-9361e9070d3c tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:43.265644 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-adf67a48-a576-4e0d-86db-9361e9070d3c tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:43.268441 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-adf67a48-a576-4e0d-86db-9361e9070d3c tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:43.289914 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a1e5cfc4-2d58-4a69-8af1-84bcb1724114 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc644418a4740eb93ea25523f2dda2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2b45ceb5804744a7d017c20ec90d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:43.303563 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a1e5cfc4-2d58-4a69-8af1-84bcb1724114 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] 10.222.0.52 "GET /compute/v2.1/servers/a4d81635-37be-432c-8b90-31b94961465d" status: 200 len: 1510 microversion: 2.1 time: 0.829232 Oct 19 03:30:43.325450 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2080/4075] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:30:42 2022] GET /compute/v2.1/servers/a4d81635-37be-432c-8b90-31b94961465d => generated 1510 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:30:43.569536 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-adf67a48-a576-4e0d-86db-9361e9070d3c tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:43.579638 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-adf67a48-a576-4e0d-86db-9361e9070d3c tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301" status: 200 len: 1390 microversion: 2.1 time: 0.347973 Oct 19 03:30:43.587872 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1996/4076] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:30:43 2022] GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301 => generated 1390 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:30:44.254326 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6d908320-e830-4aae-9782-f85e68239dfb tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:44.255196 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6d908320-e830-4aae-9782-f85e68239dfb tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:44.280995 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6d908320-e830-4aae-9782-f85e68239dfb tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:44.281546 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6d908320-e830-4aae-9782-f85e68239dfb tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:44.287138 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6d908320-e830-4aae-9782-f85e68239dfb tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:44.290758 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6d908320-e830-4aae-9782-f85e68239dfb tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:44.295041 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6d908320-e830-4aae-9782-f85e68239dfb tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:44.298129 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6d908320-e830-4aae-9782-f85e68239dfb tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:44.332606 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-98c4f5b6-4f90-461a-9ec5-f2265d20f501 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:44.334315 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-98c4f5b6-4f90-461a-9ec5-f2265d20f501 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] [instance: a4d81635-37be-432c-8b90-31b94961465d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:44.343740 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-98c4f5b6-4f90-461a-9ec5-f2265d20f501 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:44.364601 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-98c4f5b6-4f90-461a-9ec5-f2265d20f501 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:44.365255 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-98c4f5b6-4f90-461a-9ec5-f2265d20f501 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:44.366133 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-98c4f5b6-4f90-461a-9ec5-f2265d20f501 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:44.371113 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-98c4f5b6-4f90-461a-9ec5-f2265d20f501 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:44.372683 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-98c4f5b6-4f90-461a-9ec5-f2265d20f501 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:44.956559 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-6d908320-e830-4aae-9782-f85e68239dfb tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:44.970628 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6d908320-e830-4aae-9782-f85e68239dfb tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1683 microversion: 2.1 time: 0.720907 Oct 19 03:30:44.978078 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2081/4077] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:30:44 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1683 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:30:44.996011 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-620715fa-9802-49cd-88f3-dcdeebb2a0af tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:45.000918 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-620715fa-9802-49cd-88f3-dcdeebb2a0af tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 89f5f23f-8580-46fa-accf-206b1141c301] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:45.030016 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-620715fa-9802-49cd-88f3-dcdeebb2a0af tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:45.033924 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-620715fa-9802-49cd-88f3-dcdeebb2a0af tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:45.034704 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-620715fa-9802-49cd-88f3-dcdeebb2a0af tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:45.035485 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-620715fa-9802-49cd-88f3-dcdeebb2a0af tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:45.036580 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-620715fa-9802-49cd-88f3-dcdeebb2a0af tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:45.036580 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-620715fa-9802-49cd-88f3-dcdeebb2a0af tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:45.072510 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-98c4f5b6-4f90-461a-9ec5-f2265d20f501 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc644418a4740eb93ea25523f2dda2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2b45ceb5804744a7d017c20ec90d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:45.077826 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=4 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:30:45.088824 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-98c4f5b6-4f90-461a-9ec5-f2265d20f501 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] 10.222.0.52 "GET /compute/v2.1/servers/a4d81635-37be-432c-8b90-31b94961465d" status: 200 len: 1510 microversion: 2.1 time: 0.760467 Oct 19 03:30:45.091796 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1997/4078] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:30:44 2022] GET /compute/v2.1/servers/a4d81635-37be-432c-8b90-31b94961465d => generated 1510 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:30:45.368038 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-620715fa-9802-49cd-88f3-dcdeebb2a0af tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:45.392117 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-620715fa-9802-49cd-88f3-dcdeebb2a0af tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301" status: 200 len: 1390 microversion: 2.1 time: 0.402144 Oct 19 03:30:45.400457 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2082/4079] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:30:44 2022] GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301 => generated 1390 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:30:46.005853 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3f9e5690-f144-4886-ba61-255b8657649f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:46.007017 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3f9e5690-f144-4886-ba61-255b8657649f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:46.062665 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3f9e5690-f144-4886-ba61-255b8657649f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:46.063326 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3f9e5690-f144-4886-ba61-255b8657649f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:46.063794 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3f9e5690-f144-4886-ba61-255b8657649f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:46.065450 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3f9e5690-f144-4886-ba61-255b8657649f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:46.067366 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3f9e5690-f144-4886-ba61-255b8657649f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:46.067823 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3f9e5690-f144-4886-ba61-255b8657649f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:46.115348 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f5319450-6b0e-419c-af21-03c577b67c12 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:46.116516 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f5319450-6b0e-419c-af21-03c577b67c12 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] [instance: a4d81635-37be-432c-8b90-31b94961465d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:46.127987 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f5319450-6b0e-419c-af21-03c577b67c12 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:46.128935 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f5319450-6b0e-419c-af21-03c577b67c12 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:46.139294 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f5319450-6b0e-419c-af21-03c577b67c12 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:46.144655 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f5319450-6b0e-419c-af21-03c577b67c12 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:46.146910 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f5319450-6b0e-419c-af21-03c577b67c12 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:46.147776 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f5319450-6b0e-419c-af21-03c577b67c12 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:46.204080 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:30:46.715178 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-3f9e5690-f144-4886-ba61-255b8657649f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:46.728177 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3f9e5690-f144-4886-ba61-255b8657649f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1683 microversion: 2.1 time: 0.730470 Oct 19 03:30:46.729336 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1998/4080] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:30:45 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1683 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:30:46.736251 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-258c7c35-d303-4e00-a786-e78a031b0242 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:46.737107 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-258c7c35-d303-4e00-a786-e78a031b0242 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 89f5f23f-8580-46fa-accf-206b1141c301] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:46.754065 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-258c7c35-d303-4e00-a786-e78a031b0242 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:46.755026 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-258c7c35-d303-4e00-a786-e78a031b0242 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:46.755966 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-258c7c35-d303-4e00-a786-e78a031b0242 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:46.758607 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-258c7c35-d303-4e00-a786-e78a031b0242 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:46.759265 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-258c7c35-d303-4e00-a786-e78a031b0242 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:46.760997 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-258c7c35-d303-4e00-a786-e78a031b0242 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:47.034215 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f5319450-6b0e-419c-af21-03c577b67c12 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc644418a4740eb93ea25523f2dda2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2b45ceb5804744a7d017c20ec90d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:47.044475 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f5319450-6b0e-419c-af21-03c577b67c12 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] 10.222.0.52 "GET /compute/v2.1/servers/a4d81635-37be-432c-8b90-31b94961465d" status: 200 len: 1510 microversion: 2.1 time: 0.933183 Oct 19 03:30:47.056896 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2083/4081] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:30:46 2022] GET /compute/v2.1/servers/a4d81635-37be-432c-8b90-31b94961465d => generated 1510 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:30:47.079363 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-6a5fe603-6323-40e0-a900-360e7dd476f1 req-3eb4bc4a-d771-4a10-b7e5-ad87f8774bad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4d81635-37be-432c-8b90-31b94961465d", "name": "network-vif-unplugged", "status": "completed", "tag": "38e41f94-4c56-44dc-a049-aab57efe8d35"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:30:47.144945 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-6a5fe603-6323-40e0-a900-360e7dd476f1 req-3eb4bc4a-d771-4a10-b7e5-ad87f8774bad service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:47.144945 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-6a5fe603-6323-40e0-a900-360e7dd476f1 req-3eb4bc4a-d771-4a10-b7e5-ad87f8774bad service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:47.144945 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-6a5fe603-6323-40e0-a900-360e7dd476f1 req-3eb4bc4a-d771-4a10-b7e5-ad87f8774bad service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:47.166970 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-6a5fe603-6323-40e0-a900-360e7dd476f1 req-3eb4bc4a-d771-4a10-b7e5-ad87f8774bad service nova] Creating event network-vif-unplugged:38e41f94-4c56-44dc-a049-aab57efe8d35 for instance a4d81635-37be-432c-8b90-31b94961465d on n-h1-861333-8 Oct 19 03:30:47.174965 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-6a5fe603-6323-40e0-a900-360e7dd476f1 req-3eb4bc4a-d771-4a10-b7e5-ad87f8774bad service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.116520 Oct 19 03:30:47.185263 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2084/4082] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:30:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:30:47.200583 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-258c7c35-d303-4e00-a786-e78a031b0242 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:47.213389 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-258c7c35-d303-4e00-a786-e78a031b0242 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301" status: 200 len: 1390 microversion: 2.1 time: 0.482740 Oct 19 03:30:47.229413 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 1999/4083] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:30:46 2022] GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301 => generated 1390 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:30:47.709694 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-3897dff6-9d01-47e4-8486-66f181974c2d req-0153bddc-bb50-4c53-84fd-db311bbbec11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4d81635-37be-432c-8b90-31b94961465d", "name": "network-vif-deleted", "tag": "38e41f94-4c56-44dc-a049-aab57efe8d35"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:30:47.749315 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-3897dff6-9d01-47e4-8486-66f181974c2d req-0153bddc-bb50-4c53-84fd-db311bbbec11 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:47.749855 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-3897dff6-9d01-47e4-8486-66f181974c2d req-0153bddc-bb50-4c53-84fd-db311bbbec11 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:47.750308 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-3897dff6-9d01-47e4-8486-66f181974c2d req-0153bddc-bb50-4c53-84fd-db311bbbec11 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:47.756431 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0c72b1c6-7726-4c57-b598-d882fbebffbd tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:47.758010 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0c72b1c6-7726-4c57-b598-d882fbebffbd tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:47.779582 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=94 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:30:47.790863 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-3897dff6-9d01-47e4-8486-66f181974c2d req-0153bddc-bb50-4c53-84fd-db311bbbec11 service nova] Creating event network-vif-deleted:38e41f94-4c56-44dc-a049-aab57efe8d35 for instance a4d81635-37be-432c-8b90-31b94961465d on n-h1-861333-8 Oct 19 03:30:47.796139 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0c72b1c6-7726-4c57-b598-d882fbebffbd tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:47.797070 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0c72b1c6-7726-4c57-b598-d882fbebffbd tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:47.803284 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-3897dff6-9d01-47e4-8486-66f181974c2d req-0153bddc-bb50-4c53-84fd-db311bbbec11 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101080 Oct 19 03:30:47.806735 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0c72b1c6-7726-4c57-b598-d882fbebffbd tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:47.812106 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0c72b1c6-7726-4c57-b598-d882fbebffbd tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:47.813475 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2085/4084] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:30:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:30:47.832811 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0c72b1c6-7726-4c57-b598-d882fbebffbd tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:47.843035 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0c72b1c6-7726-4c57-b598-d882fbebffbd tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:48.080555 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-73e840b6-355f-4e7b-90b3-c24badfc3e3d tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:48.081927 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-73e840b6-355f-4e7b-90b3-c24badfc3e3d tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] [instance: a4d81635-37be-432c-8b90-31b94961465d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:48.106968 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-73e840b6-355f-4e7b-90b3-c24badfc3e3d tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:48.107898 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-73e840b6-355f-4e7b-90b3-c24badfc3e3d tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:48.108547 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-73e840b6-355f-4e7b-90b3-c24badfc3e3d tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:48.109495 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-73e840b6-355f-4e7b-90b3-c24badfc3e3d tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:48.110154 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-73e840b6-355f-4e7b-90b3-c24badfc3e3d tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:48.110764 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-73e840b6-355f-4e7b-90b3-c24badfc3e3d tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:48.205683 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-73e840b6-355f-4e7b-90b3-c24badfc3e3d tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:48.209467 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-73e840b6-355f-4e7b-90b3-c24badfc3e3d tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:48.211568 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-73e840b6-355f-4e7b-90b3-c24badfc3e3d tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:48.212239 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-73e840b6-355f-4e7b-90b3-c24badfc3e3d tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Lazy-loading 'fault' on Instance uuid a4d81635-37be-432c-8b90-31b94961465d {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:30:48.377848 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-73e840b6-355f-4e7b-90b3-c24badfc3e3d tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc644418a4740eb93ea25523f2dda2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2b45ceb5804744a7d017c20ec90d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:48.386972 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-73e840b6-355f-4e7b-90b3-c24badfc3e3d tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] 10.222.0.52 "GET /compute/v2.1/servers/a4d81635-37be-432c-8b90-31b94961465d" status: 200 len: 1306 microversion: 2.1 time: 0.310536 Oct 19 03:30:48.392404 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2086/4085] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:30:48 2022] GET /compute/v2.1/servers/a4d81635-37be-432c-8b90-31b94961465d => generated 1306 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:30:48.423233 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2d99932a-0899-4fde-b7b3-32431389e354 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:48.445141 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-2d99932a-0899-4fde-b7b3-32431389e354 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 89f5f23f-8580-46fa-accf-206b1141c301] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:48.454496 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2d99932a-0899-4fde-b7b3-32431389e354 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:48.455212 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2d99932a-0899-4fde-b7b3-32431389e354 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:48.455979 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2d99932a-0899-4fde-b7b3-32431389e354 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:48.456942 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2d99932a-0899-4fde-b7b3-32431389e354 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:48.457730 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2d99932a-0899-4fde-b7b3-32431389e354 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:48.458639 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2d99932a-0899-4fde-b7b3-32431389e354 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:48.506088 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0c72b1c6-7726-4c57-b598-d882fbebffbd tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:48.518705 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0c72b1c6-7726-4c57-b598-d882fbebffbd tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1683 microversion: 2.1 time: 0.769289 Oct 19 03:30:48.519616 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2000/4086] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:30:47 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1683 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:30:49.221519 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-2d99932a-0899-4fde-b7b3-32431389e354 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:49.235014 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2d99932a-0899-4fde-b7b3-32431389e354 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301" status: 200 len: 1390 microversion: 2.1 time: 0.813243 Oct 19 03:30:49.237174 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2087/4087] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:30:48 2022] GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301 => generated 1390 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:30:49.419767 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1bc66e05-7d57-4243-8183-1b80ca1e459e tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:49.425790 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1bc66e05-7d57-4243-8183-1b80ca1e459e tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] [instance: a4d81635-37be-432c-8b90-31b94961465d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:49.435041 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1bc66e05-7d57-4243-8183-1b80ca1e459e tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:49.436527 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1bc66e05-7d57-4243-8183-1b80ca1e459e tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:49.437214 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1bc66e05-7d57-4243-8183-1b80ca1e459e tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:49.441847 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1bc66e05-7d57-4243-8183-1b80ca1e459e tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:49.443000 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1bc66e05-7d57-4243-8183-1b80ca1e459e tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:49.443794 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1bc66e05-7d57-4243-8183-1b80ca1e459e tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:49.523292 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1bc66e05-7d57-4243-8183-1b80ca1e459e tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:49.532977 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1bc66e05-7d57-4243-8183-1b80ca1e459e tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:49.535330 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1bc66e05-7d57-4243-8183-1b80ca1e459e tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:49.542484 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-1bc66e05-7d57-4243-8183-1b80ca1e459e tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Lazy-loading 'fault' on Instance uuid a4d81635-37be-432c-8b90-31b94961465d {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:30:49.543032 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-bcbc6639-ef26-479e-a263-d168a54d7762 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:49.543703 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-bcbc6639-ef26-479e-a263-d168a54d7762 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:49.559784 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bcbc6639-ef26-479e-a263-d168a54d7762 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:49.563705 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bcbc6639-ef26-479e-a263-d168a54d7762 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:49.564193 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bcbc6639-ef26-479e-a263-d168a54d7762 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:49.564959 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bcbc6639-ef26-479e-a263-d168a54d7762 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:49.565468 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bcbc6639-ef26-479e-a263-d168a54d7762 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:49.569090 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bcbc6639-ef26-479e-a263-d168a54d7762 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:49.656891 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-1bc66e05-7d57-4243-8183-1b80ca1e459e tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc644418a4740eb93ea25523f2dda2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2b45ceb5804744a7d017c20ec90d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:49.672511 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1bc66e05-7d57-4243-8183-1b80ca1e459e tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] 10.222.0.52 "GET /compute/v2.1/servers/a4d81635-37be-432c-8b90-31b94961465d" status: 200 len: 1306 microversion: 2.1 time: 0.255575 Oct 19 03:30:49.674908 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2001/4088] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:30:49 2022] GET /compute/v2.1/servers/a4d81635-37be-432c-8b90-31b94961465d => generated 1306 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:30:49.982167 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-bcbc6639-ef26-479e-a263-d168a54d7762 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:49.992830 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-bcbc6639-ef26-479e-a263-d168a54d7762 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1683 microversion: 2.1 time: 0.454240 Oct 19 03:30:49.997493 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2088/4089] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:30:49 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1683 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:30:50.265628 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a4ce4d72-2408-41b5-a5d0-561b8f7b47b9 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:50.266549 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a4ce4d72-2408-41b5-a5d0-561b8f7b47b9 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 89f5f23f-8580-46fa-accf-206b1141c301] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:50.274740 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a4ce4d72-2408-41b5-a5d0-561b8f7b47b9 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:50.275515 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a4ce4d72-2408-41b5-a5d0-561b8f7b47b9 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:50.276139 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a4ce4d72-2408-41b5-a5d0-561b8f7b47b9 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:50.276957 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a4ce4d72-2408-41b5-a5d0-561b8f7b47b9 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:50.278761 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a4ce4d72-2408-41b5-a5d0-561b8f7b47b9 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:50.278761 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a4ce4d72-2408-41b5-a5d0-561b8f7b47b9 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:50.700436 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d47fc1a3-0c01-4d91-9e9e-ec2e3a5ffee8 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:50.701845 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d47fc1a3-0c01-4d91-9e9e-ec2e3a5ffee8 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] [instance: a4d81635-37be-432c-8b90-31b94961465d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:50.717913 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d47fc1a3-0c01-4d91-9e9e-ec2e3a5ffee8 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:50.720209 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d47fc1a3-0c01-4d91-9e9e-ec2e3a5ffee8 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:50.720973 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d47fc1a3-0c01-4d91-9e9e-ec2e3a5ffee8 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:50.721960 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d47fc1a3-0c01-4d91-9e9e-ec2e3a5ffee8 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:50.722659 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d47fc1a3-0c01-4d91-9e9e-ec2e3a5ffee8 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:50.723259 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d47fc1a3-0c01-4d91-9e9e-ec2e3a5ffee8 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:50.753925 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-d47fc1a3-0c01-4d91-9e9e-ec2e3a5ffee8 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] HTTP exception thrown: Instance a4d81635-37be-432c-8b90-31b94961465d could not be found. Oct 19 03:30:50.757328 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d47fc1a3-0c01-4d91-9e9e-ec2e3a5ffee8 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Request method failure captured: Oct 19 03:30:50.757328 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/a4d81635-37be-432c-8b90-31b94961465d HTTP/1.1 Oct 19 03:30:50.757328 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:30:50.757328 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:30:50.757328 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:30:50.757328 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:30:50.757328 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:30:50.757328 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:30:50.757328 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:30:50.757328 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:30:50.757328 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT289IzdipRG3gxlUGCXzlxMkAEGPuN9jJPR9CsY5CadPSGpWu6W55JSrDm8DN7TYLyfAD_VUgbeNvSLK53vw2G6O5jqmAk1C6LEpb5UKRRR_QBxHrQaA2ouxfdG8vQUXCQdeZvuh599T1eTAfw9iV89wyPjlZ3ATjPaqVRIm4_nst7s Oct 19 03:30:50.757328 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:30:50.757328 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:30:50.757328 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:30:50.757328 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:30:50.757328 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:30:50.757328 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:30:50.757328 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 6f2b45ceb5804744a7d017c20ec90d17 Oct 19 03:30:50.757328 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ServerPasswordTestJSON-1721255674 Oct 19 03:30:50.757328 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:30:50.757328 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:30:50.760669 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6f2b45ceb5804744a7d017c20ec90d17"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6f2b45ceb5804744a7d017c20ec90d17"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6f2b45ceb5804744a7d017c20ec90d17"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6f2b45ceb5804744a7d017c20ec90d17", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:30:50.760669 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ServerPasswordTestJSON-1721255674 Oct 19 03:30:50.760669 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 6f2b45ceb5804744a7d017c20ec90d17 Oct 19 03:30:50.760669 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ServerPasswordTestJSON-1721255674 Oct 19 03:30:50.760669 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ServerPasswordTestJSON-1721255674-project Oct 19 03:30:50.760669 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:30:50.760669 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:30:50.760669 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 7dc644418a4740eb93ea25523f2dda2b Oct 19 03:30:50.760669 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ServerPasswordTestJSON-1721255674-project Oct 19 03:30:50.760669 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:30:50.760669 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance a4d81635-37be-432c-8b90-31b94961465d could not be found. Oct 19 03:30:50.760669 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': 'a4d81635-37be-432c-8b90-31b94961465d'} Oct 19 03:30:50.763770 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:30:50.763770 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:30:50.763770 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:30:50.763770 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:30:50.763770 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:30:50.763770 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:30:50.763770 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:30:50.763770 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:30:50.763770 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:30:50.763770 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:30:50.763770 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4d81635-37be-432c-8b90-31b94961465d could not be found. Oct 19 03:30:50.763770 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:30:50.763770 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:30:50.763770 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:30:50.763770 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:30:50.763770 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:30:50.763770 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:30:50.763770 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:30:50.763770 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:30:50.763770 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:30:50.767845 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:30:50.767845 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:30:50.767845 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:30:50.767845 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:30:50.767845 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:30:50.767845 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:30:50.767845 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:30:50.767845 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4d81635-37be-432c-8b90-31b94961465d could not be found. Oct 19 03:30:50.767845 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:30:50.767845 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:30:50.767845 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:30:50.767845 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:30:50.767845 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:30:50.767845 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:30:50.767845 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:30:50.767845 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:30:50.767845 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4d81635-37be-432c-8b90-31b94961465d could not be found. Oct 19 03:30:50.767845 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:30:50.770224 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d47fc1a3-0c01-4d91-9e9e-ec2e3a5ffee8 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] Returning 404 to user: Instance a4d81635-37be-432c-8b90-31b94961465d could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:30:50.770224 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d47fc1a3-0c01-4d91-9e9e-ec2e3a5ffee8 tempest-ServerPasswordTestJSON-1721255674 tempest-ServerPasswordTestJSON-1721255674-project] 10.222.0.52 "GET /compute/v2.1/servers/a4d81635-37be-432c-8b90-31b94961465d" status: 404 len: 111 microversion: 2.1 time: 0.062892 Oct 19 03:30:50.770224 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2089/4090] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:30:50 2022] GET /compute/v2.1/servers/a4d81635-37be-432c-8b90-31b94961465d => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:30:51.022757 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2dc445b8-50e6-450c-b2de-d79dfc2d0850 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:51.023338 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-2dc445b8-50e6-450c-b2de-d79dfc2d0850 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:51.035594 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2dc445b8-50e6-450c-b2de-d79dfc2d0850 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:51.037893 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2dc445b8-50e6-450c-b2de-d79dfc2d0850 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:51.038360 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2dc445b8-50e6-450c-b2de-d79dfc2d0850 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:51.041520 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2dc445b8-50e6-450c-b2de-d79dfc2d0850 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:51.042114 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2dc445b8-50e6-450c-b2de-d79dfc2d0850 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:51.048672 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2dc445b8-50e6-450c-b2de-d79dfc2d0850 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:51.644752 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a4ce4d72-2408-41b5-a5d0-561b8f7b47b9 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:51.661187 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a4ce4d72-2408-41b5-a5d0-561b8f7b47b9 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301" status: 200 len: 1380 microversion: 2.1 time: 1.400650 Oct 19 03:30:51.662905 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2002/4091] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:30:50 2022] GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301 => generated 1380 bytes in 1403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:30:51.688742 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-06b5e748-04dc-49f1-acc2-e44811a2797b tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Calling method '.version_select at 0x7fc13044a430>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:51.694483 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-06b5e748-04dc-49f1-acc2-e44811a2797b tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:51.695118 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-06b5e748-04dc-49f1-acc2-e44811a2797b tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:51.695447 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-06b5e748-04dc-49f1-acc2-e44811a2797b tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:51.714627 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-06b5e748-04dc-49f1-acc2-e44811a2797b tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] 10.222.0.52 "GET /compute/v2.1/os-migrations" status: 200 len: 1553 microversion: 2.1 time: 0.029356 Oct 19 03:30:51.716009 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2003/4092] 10.222.0.52 () {58 vars in 1143 bytes} [Wed Oct 19 03:30:51 2022] GET /compute/v2.1/os-migrations => generated 1553 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:30:51.733837 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e96bb6c8-55ae-4210-a0fb-b3026228dd69 tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:51.735093 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e96bb6c8-55ae-4210-a0fb-b3026228dd69 tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] [instance: 89f5f23f-8580-46fa-accf-206b1141c301] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:51.751575 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e96bb6c8-55ae-4210-a0fb-b3026228dd69 tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:51.752641 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e96bb6c8-55ae-4210-a0fb-b3026228dd69 tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:51.754124 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e96bb6c8-55ae-4210-a0fb-b3026228dd69 tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:51.755976 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e96bb6c8-55ae-4210-a0fb-b3026228dd69 tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:51.756972 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e96bb6c8-55ae-4210-a0fb-b3026228dd69 tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:51.758117 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e96bb6c8-55ae-4210-a0fb-b3026228dd69 tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:52.270333 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-2dc445b8-50e6-450c-b2de-d79dfc2d0850 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:52.301636 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2dc445b8-50e6-450c-b2de-d79dfc2d0850 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1683 microversion: 2.1 time: 1.280365 Oct 19 03:30:52.309810 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2090/4093] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:30:51 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1683 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:30:52.394849 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e96bb6c8-55ae-4210-a0fb-b3026228dd69 tempest-LiveMigrationTest-186607871 tempest-LiveMigrationTest-186607871-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301" status: 200 len: 1531 microversion: 2.1 time: 0.668054 Oct 19 03:30:52.423649 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2004/4094] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:30:51 2022] GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301 => generated 1531 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:30:52.444947 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c8ebb52a-c2d9-4834-b4c4-fac8193abb57 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:52.445806 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c8ebb52a-c2d9-4834-b4c4-fac8193abb57 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 89f5f23f-8580-46fa-accf-206b1141c301] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:52.461125 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c8ebb52a-c2d9-4834-b4c4-fac8193abb57 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:52.462284 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c8ebb52a-c2d9-4834-b4c4-fac8193abb57 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:52.462952 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c8ebb52a-c2d9-4834-b4c4-fac8193abb57 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:52.463897 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c8ebb52a-c2d9-4834-b4c4-fac8193abb57 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:52.464565 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c8ebb52a-c2d9-4834-b4c4-fac8193abb57 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:52.465885 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c8ebb52a-c2d9-4834-b4c4-fac8193abb57 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:52.540592 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c8ebb52a-c2d9-4834-b4c4-fac8193abb57 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 89f5f23f-8580-46fa-accf-206b1141c301] Going to try to terminate instance {{(pid=121135) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:30:52.923752 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:30:53.065202 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c8ebb52a-c2d9-4834-b4c4-fac8193abb57 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "DELETE /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301" status: 204 len: 0 microversion: 2.1 time: 0.624447 Oct 19 03:30:53.068854 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2091/4095] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:30:52 2022] DELETE /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301 => generated 0 bytes in 626 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:30:53.075209 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-062c190e-9592-429f-b17c-17e9781fa500 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:53.077131 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-062c190e-9592-429f-b17c-17e9781fa500 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 89f5f23f-8580-46fa-accf-206b1141c301] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:53.096778 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-062c190e-9592-429f-b17c-17e9781fa500 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:53.100409 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-062c190e-9592-429f-b17c-17e9781fa500 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:53.101040 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-062c190e-9592-429f-b17c-17e9781fa500 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:53.107428 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-062c190e-9592-429f-b17c-17e9781fa500 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:53.108247 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-062c190e-9592-429f-b17c-17e9781fa500 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:53.112760 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-062c190e-9592-429f-b17c-17e9781fa500 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:53.344207 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-fac253a3-e53e-4ddf-bb10-89b2102fc608 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:53.345044 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-fac253a3-e53e-4ddf-bb10-89b2102fc608 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:53.395773 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fac253a3-e53e-4ddf-bb10-89b2102fc608 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:53.398033 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fac253a3-e53e-4ddf-bb10-89b2102fc608 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:53.399993 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fac253a3-e53e-4ddf-bb10-89b2102fc608 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:53.404249 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fac253a3-e53e-4ddf-bb10-89b2102fc608 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:53.405993 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fac253a3-e53e-4ddf-bb10-89b2102fc608 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:53.407725 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fac253a3-e53e-4ddf-bb10-89b2102fc608 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:53.789044 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-062c190e-9592-429f-b17c-17e9781fa500 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:53.797940 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-062c190e-9592-429f-b17c-17e9781fa500 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301" status: 200 len: 1386 microversion: 2.1 time: 0.727248 Oct 19 03:30:53.810982 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2005/4096] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:30:53 2022] GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301 => generated 1386 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:30:54.312962 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-fac253a3-e53e-4ddf-bb10-89b2102fc608 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:54.327730 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-fac253a3-e53e-4ddf-bb10-89b2102fc608 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1683 microversion: 2.1 time: 0.988744 Oct 19 03:30:54.329037 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2092/4097] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:30:53 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1683 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:30:54.837799 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8e9060ae-d741-4935-8e36-d7dd30e47565 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:54.840534 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8e9060ae-d741-4935-8e36-d7dd30e47565 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 89f5f23f-8580-46fa-accf-206b1141c301] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:54.851439 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8e9060ae-d741-4935-8e36-d7dd30e47565 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:54.858868 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8e9060ae-d741-4935-8e36-d7dd30e47565 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:54.862882 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8e9060ae-d741-4935-8e36-d7dd30e47565 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:54.866742 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8e9060ae-d741-4935-8e36-d7dd30e47565 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:54.867416 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8e9060ae-d741-4935-8e36-d7dd30e47565 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:54.868051 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8e9060ae-d741-4935-8e36-d7dd30e47565 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:55.353927 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c12ca907-2bba-4f0f-b98b-95f48cd4d771 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:55.354725 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c12ca907-2bba-4f0f-b98b-95f48cd4d771 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:55.371928 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c12ca907-2bba-4f0f-b98b-95f48cd4d771 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:55.373410 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c12ca907-2bba-4f0f-b98b-95f48cd4d771 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:55.379749 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c12ca907-2bba-4f0f-b98b-95f48cd4d771 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:55.380804 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c12ca907-2bba-4f0f-b98b-95f48cd4d771 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:55.381545 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c12ca907-2bba-4f0f-b98b-95f48cd4d771 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:55.382253 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c12ca907-2bba-4f0f-b98b-95f48cd4d771 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:55.519371 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8e9060ae-d741-4935-8e36-d7dd30e47565 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:55.530688 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8e9060ae-d741-4935-8e36-d7dd30e47565 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301" status: 200 len: 1386 microversion: 2.1 time: 0.696673 Oct 19 03:30:55.536289 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2006/4098] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:30:54 2022] GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301 => generated 1386 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:30:56.360948 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c12ca907-2bba-4f0f-b98b-95f48cd4d771 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:56.375327 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c12ca907-2bba-4f0f-b98b-95f48cd4d771 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1683 microversion: 2.1 time: 1.025140 Oct 19 03:30:56.392085 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2093/4099] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:30:55 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1683 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:30:56.564812 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b77f55e9-3767-47d8-bfc6-8a0347a025c4 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:56.566113 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b77f55e9-3767-47d8-bfc6-8a0347a025c4 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 89f5f23f-8580-46fa-accf-206b1141c301] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:56.586384 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b77f55e9-3767-47d8-bfc6-8a0347a025c4 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:56.587206 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b77f55e9-3767-47d8-bfc6-8a0347a025c4 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:56.589135 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b77f55e9-3767-47d8-bfc6-8a0347a025c4 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:56.591517 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b77f55e9-3767-47d8-bfc6-8a0347a025c4 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:56.593529 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b77f55e9-3767-47d8-bfc6-8a0347a025c4 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:56.598431 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b77f55e9-3767-47d8-bfc6-8a0347a025c4 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:57.093546 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b77f55e9-3767-47d8-bfc6-8a0347a025c4 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:57.097906 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b77f55e9-3767-47d8-bfc6-8a0347a025c4 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301" status: 200 len: 1344 microversion: 2.1 time: 0.539955 Oct 19 03:30:57.102008 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2007/4100] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:30:56 2022] GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301 => generated 1344 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:30:57.209524 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-97ccb353-8a9f-4fd3-b6e5-c5d6435779fe req-13da1365-1393-4a3f-b690-0c3f2f8d0645 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89f5f23f-8580-46fa-accf-206b1141c301", "name": "network-vif-deleted", "tag": "a2678fb1-a9fa-4f93-9241-80d9c1c2d9d1"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:30:57.238916 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-97ccb353-8a9f-4fd3-b6e5-c5d6435779fe req-13da1365-1393-4a3f-b690-0c3f2f8d0645 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:57.238916 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-97ccb353-8a9f-4fd3-b6e5-c5d6435779fe req-13da1365-1393-4a3f-b690-0c3f2f8d0645 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:57.238916 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-97ccb353-8a9f-4fd3-b6e5-c5d6435779fe req-13da1365-1393-4a3f-b690-0c3f2f8d0645 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:57.282666 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-97ccb353-8a9f-4fd3-b6e5-c5d6435779fe req-13da1365-1393-4a3f-b690-0c3f2f8d0645 service nova] Creating event network-vif-deleted:a2678fb1-a9fa-4f93-9241-80d9c1c2d9d1 for instance 89f5f23f-8580-46fa-accf-206b1141c301 on n-h2-861333-8 Oct 19 03:30:57.292098 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-97ccb353-8a9f-4fd3-b6e5-c5d6435779fe req-13da1365-1393-4a3f-b690-0c3f2f8d0645 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086667 Oct 19 03:30:57.294617 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2094/4101] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:30:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:30:57.399649 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-23fda790-f575-42f2-9b53-6370e61b5fd5 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:57.400685 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-23fda790-f575-42f2-9b53-6370e61b5fd5 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:57.415597 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-23fda790-f575-42f2-9b53-6370e61b5fd5 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:57.416394 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-23fda790-f575-42f2-9b53-6370e61b5fd5 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:57.422451 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-23fda790-f575-42f2-9b53-6370e61b5fd5 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:57.428456 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-23fda790-f575-42f2-9b53-6370e61b5fd5 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:57.429250 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-23fda790-f575-42f2-9b53-6370e61b5fd5 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:57.429979 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-23fda790-f575-42f2-9b53-6370e61b5fd5 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:58.130817 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2ea8be49-ed54-4366-817e-6a5dfc59a62a tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:30:58.132210 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-2ea8be49-ed54-4366-817e-6a5dfc59a62a tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 89f5f23f-8580-46fa-accf-206b1141c301] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:30:58.143763 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2ea8be49-ed54-4366-817e-6a5dfc59a62a tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:58.157833 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2ea8be49-ed54-4366-817e-6a5dfc59a62a tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:58.158577 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2ea8be49-ed54-4366-817e-6a5dfc59a62a tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:58.160761 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2ea8be49-ed54-4366-817e-6a5dfc59a62a tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:30:58.164463 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2ea8be49-ed54-4366-817e-6a5dfc59a62a tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:30:58.167745 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2ea8be49-ed54-4366-817e-6a5dfc59a62a tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:30:58.972971 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-2ea8be49-ed54-4366-817e-6a5dfc59a62a tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:58.995021 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2ea8be49-ed54-4366-817e-6a5dfc59a62a tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301" status: 200 len: 1183 microversion: 2.1 time: 0.868459 Oct 19 03:30:58.996978 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2095/4102] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:30:58 2022] GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301 => generated 1183 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:30:59.432431 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-23fda790-f575-42f2-9b53-6370e61b5fd5 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:30:59.457118 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-23fda790-f575-42f2-9b53-6370e61b5fd5 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1683 microversion: 2.1 time: 2.057066 Oct 19 03:30:59.458074 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2008/4103] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:30:57 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1683 bytes in 2063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:31:00.023050 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b5eaf61c-b0e6-4b09-ae8a-e529c2056edc tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:00.023669 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b5eaf61c-b0e6-4b09-ae8a-e529c2056edc tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 89f5f23f-8580-46fa-accf-206b1141c301] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:00.055392 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b5eaf61c-b0e6-4b09-ae8a-e529c2056edc tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:00.059429 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b5eaf61c-b0e6-4b09-ae8a-e529c2056edc tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:00.070167 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b5eaf61c-b0e6-4b09-ae8a-e529c2056edc tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:00.076686 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b5eaf61c-b0e6-4b09-ae8a-e529c2056edc tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:00.076686 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b5eaf61c-b0e6-4b09-ae8a-e529c2056edc tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:00.076686 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b5eaf61c-b0e6-4b09-ae8a-e529c2056edc tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:00.353674 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b5eaf61c-b0e6-4b09-ae8a-e529c2056edc tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:00.364660 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b5eaf61c-b0e6-4b09-ae8a-e529c2056edc tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301" status: 200 len: 1183 microversion: 2.1 time: 0.345518 Oct 19 03:31:00.377879 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2096/4104] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:31:00 2022] GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301 => generated 1183 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:31:00.496121 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6cab8ac8-f62a-415e-8e7f-38a053b88188 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:00.497563 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6cab8ac8-f62a-415e-8e7f-38a053b88188 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:00.555088 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6cab8ac8-f62a-415e-8e7f-38a053b88188 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:00.618298 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6cab8ac8-f62a-415e-8e7f-38a053b88188 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:00.619143 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6cab8ac8-f62a-415e-8e7f-38a053b88188 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.063s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:00.657614 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6cab8ac8-f62a-415e-8e7f-38a053b88188 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:00.657614 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6cab8ac8-f62a-415e-8e7f-38a053b88188 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:00.657614 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6cab8ac8-f62a-415e-8e7f-38a053b88188 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:01.407865 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-cf67f5c0-46ea-4f87-bfb4-fa3c872d20ad tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:01.409514 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-cf67f5c0-46ea-4f87-bfb4-fa3c872d20ad tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 89f5f23f-8580-46fa-accf-206b1141c301] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:01.448456 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cf67f5c0-46ea-4f87-bfb4-fa3c872d20ad tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:01.448456 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cf67f5c0-46ea-4f87-bfb4-fa3c872d20ad tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:01.448456 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cf67f5c0-46ea-4f87-bfb4-fa3c872d20ad tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:01.448456 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cf67f5c0-46ea-4f87-bfb4-fa3c872d20ad tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:01.450032 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cf67f5c0-46ea-4f87-bfb4-fa3c872d20ad tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:01.450032 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cf67f5c0-46ea-4f87-bfb4-fa3c872d20ad tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:01.514440 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-6cab8ac8-f62a-415e-8e7f-38a053b88188 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:01.539801 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6cab8ac8-f62a-415e-8e7f-38a053b88188 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1683 microversion: 2.1 time: 1.034553 Oct 19 03:31:01.539801 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2009/4105] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:31:00 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1683 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:31:01.927155 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-cf67f5c0-46ea-4f87-bfb4-fa3c872d20ad tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:01.949702 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-cf67f5c0-46ea-4f87-bfb4-fa3c872d20ad tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301" status: 200 len: 1183 microversion: 2.1 time: 0.544435 Oct 19 03:31:01.950616 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2097/4106] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:31:01 2022] GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301 => generated 1183 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:31:02.563933 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9d2b88ac-0956-4db5-9123-190f0155086e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:02.569428 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9d2b88ac-0956-4db5-9123-190f0155086e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:02.593502 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9d2b88ac-0956-4db5-9123-190f0155086e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:02.597666 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9d2b88ac-0956-4db5-9123-190f0155086e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:02.599769 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9d2b88ac-0956-4db5-9123-190f0155086e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:02.605287 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9d2b88ac-0956-4db5-9123-190f0155086e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:02.611269 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9d2b88ac-0956-4db5-9123-190f0155086e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:02.615000 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9d2b88ac-0956-4db5-9123-190f0155086e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:02.976823 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-462296ab-e49b-4840-aeb5-4d419f9d7dc0 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:02.984122 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-462296ab-e49b-4840-aeb5-4d419f9d7dc0 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 89f5f23f-8580-46fa-accf-206b1141c301] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:03.003460 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-462296ab-e49b-4840-aeb5-4d419f9d7dc0 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:03.004100 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-462296ab-e49b-4840-aeb5-4d419f9d7dc0 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:03.004641 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-462296ab-e49b-4840-aeb5-4d419f9d7dc0 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:03.005927 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-462296ab-e49b-4840-aeb5-4d419f9d7dc0 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:03.008469 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-462296ab-e49b-4840-aeb5-4d419f9d7dc0 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:03.010746 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-462296ab-e49b-4840-aeb5-4d419f9d7dc0 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:03.410872 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-462296ab-e49b-4840-aeb5-4d419f9d7dc0 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:03.419699 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-462296ab-e49b-4840-aeb5-4d419f9d7dc0 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301" status: 200 len: 1183 microversion: 2.1 time: 0.447500 Oct 19 03:31:03.420326 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2098/4107] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:31:02 2022] GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301 => generated 1183 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:31:03.682455 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9d2b88ac-0956-4db5-9123-190f0155086e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:03.692076 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9d2b88ac-0956-4db5-9123-190f0155086e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1683 microversion: 2.1 time: 1.132956 Oct 19 03:31:03.694908 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2010/4108] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:31:02 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1683 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:31:04.449621 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2367fd24-da21-4edb-b268-42e6bcc12d21 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:04.449621 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-2367fd24-da21-4edb-b268-42e6bcc12d21 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 89f5f23f-8580-46fa-accf-206b1141c301] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:04.467470 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2367fd24-da21-4edb-b268-42e6bcc12d21 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:04.470355 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2367fd24-da21-4edb-b268-42e6bcc12d21 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:04.475656 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2367fd24-da21-4edb-b268-42e6bcc12d21 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:04.475962 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2367fd24-da21-4edb-b268-42e6bcc12d21 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:04.476692 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2367fd24-da21-4edb-b268-42e6bcc12d21 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:04.482819 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2367fd24-da21-4edb-b268-42e6bcc12d21 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:04.722832 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-25b1595f-f28c-4e0a-831b-84def8e153b1 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:04.724074 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-25b1595f-f28c-4e0a-831b-84def8e153b1 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:04.732543 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-2367fd24-da21-4edb-b268-42e6bcc12d21 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:04.734862 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-25b1595f-f28c-4e0a-831b-84def8e153b1 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:04.735497 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-25b1595f-f28c-4e0a-831b-84def8e153b1 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:04.735818 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-25b1595f-f28c-4e0a-831b-84def8e153b1 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:04.736547 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-25b1595f-f28c-4e0a-831b-84def8e153b1 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:04.737017 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-25b1595f-f28c-4e0a-831b-84def8e153b1 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:04.739690 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2367fd24-da21-4edb-b268-42e6bcc12d21 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301" status: 200 len: 1183 microversion: 2.1 time: 0.298046 Oct 19 03:31:04.742178 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-25b1595f-f28c-4e0a-831b-84def8e153b1 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:04.744264 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2099/4109] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:31:04 2022] GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301 => generated 1183 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:31:05.286287 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-25b1595f-f28c-4e0a-831b-84def8e153b1 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:05.296334 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-25b1595f-f28c-4e0a-831b-84def8e153b1 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1683 microversion: 2.1 time: 0.577785 Oct 19 03:31:05.310486 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2011/4110] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:31:04 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1683 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:31:05.595648 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2eade9bf-8ae5-4842-ba56-34231e6345f0 tempest-SecurityGroupRulesNegativeTestJSON-363727118 tempest-SecurityGroupRulesNegativeTestJSON-363727118-project] Action: 'create', calling method: .version_select at 0x7fc13003a820>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-2035495496", "description": "tempest-description-1823132457"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:31:05.766202 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f545bca9-0942-4d6c-8603-1fbf5d144c5b tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:05.766886 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f545bca9-0942-4d6c-8603-1fbf5d144c5b tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 89f5f23f-8580-46fa-accf-206b1141c301] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:05.783485 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f545bca9-0942-4d6c-8603-1fbf5d144c5b tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:05.783994 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f545bca9-0942-4d6c-8603-1fbf5d144c5b tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:05.784577 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f545bca9-0942-4d6c-8603-1fbf5d144c5b tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:05.785217 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f545bca9-0942-4d6c-8603-1fbf5d144c5b tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:05.785720 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f545bca9-0942-4d6c-8603-1fbf5d144c5b tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:05.786170 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f545bca9-0942-4d6c-8603-1fbf5d144c5b tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:06.072855 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-f545bca9-0942-4d6c-8603-1fbf5d144c5b tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:06.091230 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f545bca9-0942-4d6c-8603-1fbf5d144c5b tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301" status: 200 len: 1183 microversion: 2.1 time: 0.329839 Oct 19 03:31:06.094370 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2012/4111] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:31:05 2022] GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301 => generated 1183 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:31:06.337684 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3a8d1bfe-e6c3-4f81-8c41-484d46a13d52 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:06.338822 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3a8d1bfe-e6c3-4f81-8c41-484d46a13d52 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:06.354287 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3a8d1bfe-e6c3-4f81-8c41-484d46a13d52 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:06.364240 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3a8d1bfe-e6c3-4f81-8c41-484d46a13d52 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:06.364791 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3a8d1bfe-e6c3-4f81-8c41-484d46a13d52 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:06.365610 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3a8d1bfe-e6c3-4f81-8c41-484d46a13d52 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:06.366282 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3a8d1bfe-e6c3-4f81-8c41-484d46a13d52 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:06.366890 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3a8d1bfe-e6c3-4f81-8c41-484d46a13d52 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:06.855980 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2eade9bf-8ae5-4842-ba56-34231e6345f0 tempest-SecurityGroupRulesNegativeTestJSON-363727118 tempest-SecurityGroupRulesNegativeTestJSON-363727118-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 1.959370 Oct 19 03:31:06.865824 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2100/4112] 10.222.0.52 () {60 vars in 1180 bytes} [Wed Oct 19 03:31:04 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 1970 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:31:06.871876 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a437f26d-a848-4d9f-82de-75e68b643346 tempest-SecurityGroupRulesNegativeTestJSON-363727118 tempest-SecurityGroupRulesNegativeTestJSON-363727118-project] Action: 'create', calling method: .version_select at 0x7fc12beb7c10>, body: {"security_group_rule": {"parent_group_id": "f99ed59e-7b5c-408b-b35d-8c84025b082e", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:31:07.039353 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-3a8d1bfe-e6c3-4f81-8c41-484d46a13d52 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:07.051861 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3a8d1bfe-e6c3-4f81-8c41-484d46a13d52 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1670 microversion: 2.1 time: 0.720363 Oct 19 03:31:07.060100 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2013/4113] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:31:06 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1670 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:31:07.121310 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2c12da24-f223-4bdb-85c0-804d2d3f2a25 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:07.122035 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2c12da24-f223-4bdb-85c0-804d2d3f2a25 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 89f5f23f-8580-46fa-accf-206b1141c301] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:07.143573 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2c12da24-f223-4bdb-85c0-804d2d3f2a25 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:07.144374 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2c12da24-f223-4bdb-85c0-804d2d3f2a25 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:07.145019 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2c12da24-f223-4bdb-85c0-804d2d3f2a25 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:07.146406 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2c12da24-f223-4bdb-85c0-804d2d3f2a25 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:07.150796 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2c12da24-f223-4bdb-85c0-804d2d3f2a25 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:07.151855 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2c12da24-f223-4bdb-85c0-804d2d3f2a25 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:07.413212 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-2c12da24-f223-4bdb-85c0-804d2d3f2a25 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:07.418632 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=100 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:31:07.430428 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2c12da24-f223-4bdb-85c0-804d2d3f2a25 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301" status: 200 len: 1183 microversion: 2.1 time: 0.312706 Oct 19 03:31:07.432881 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2014/4114] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:31:07 2022] GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301 => generated 1183 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:31:08.096956 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a437f26d-a848-4d9f-82de-75e68b643346 tempest-SecurityGroupRulesNegativeTestJSON-363727118 tempest-SecurityGroupRulesNegativeTestJSON-363727118-project] 10.222.0.52 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.229945 Oct 19 03:31:08.101769 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2101/4115] 10.222.0.52 () {60 vars in 1195 bytes} [Wed Oct 19 03:31:06 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:31:08.111308 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9df7dd5f-82e4-4629-84d7-a5e691f4ecbf tempest-SecurityGroupRulesNegativeTestJSON-363727118 tempest-SecurityGroupRulesNegativeTestJSON-363727118-project] Action: 'create', calling method: .version_select at 0x7fc13057b040>, body: {"security_group_rule": {"parent_group_id": "f99ed59e-7b5c-408b-b35d-8c84025b082e", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:31:08.375810 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-9df7dd5f-82e4-4629-84d7-a5e691f4ecbf tempest-SecurityGroupRulesNegativeTestJSON-363727118 tempest-SecurityGroupRulesNegativeTestJSON-363727118-project] HTTP exception thrown: This rule already exists in group f99ed59e-7b5c-408b-b35d-8c84025b082e Oct 19 03:31:08.377484 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9df7dd5f-82e4-4629-84d7-a5e691f4ecbf tempest-SecurityGroupRulesNegativeTestJSON-363727118 tempest-SecurityGroupRulesNegativeTestJSON-363727118-project] Request method failure captured: Oct 19 03:31:08.377484 n-d-861333-8 devstack@n-api.service[121134]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 19 03:31:08.377484 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:31:08.377484 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:31:08.377484 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:31:08.377484 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 138 Oct 19 03:31:08.377484 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:31:08.377484 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:31:08.377484 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:31:08.377484 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:31:08.377484 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT294FEZ4Qf7P_oPk3UxAFZIjJKlSxsI7pRpw6olQwQn8PWk7ysV3ZhQbp796YpI5Dq_M9CXZ2K5l6FqJlJAs7KVgCe1F4bBUxEm3qq4IgyG6LiWzq2A23lsxbkK7olgnwEH0_uaYDCw-7hnr2vtxoUqtPOD6oysbSy-N0f1PvF-CH5o Oct 19 03:31:08.377484 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:31:08.377484 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:31:08.377484 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:31:08.377484 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:31:08.377484 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:31:08.377484 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:31:08.377484 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 1fcd6d9154004c5481c7a239f743dfd8 Oct 19 03:31:08.377484 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-363727118 Oct 19 03:31:08.377484 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:31:08.377484 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:31:08.379338 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1fcd6d9154004c5481c7a239f743dfd8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1fcd6d9154004c5481c7a239f743dfd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1fcd6d9154004c5481c7a239f743dfd8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1fcd6d9154004c5481c7a239f743dfd8", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:31:08.379338 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-363727118 Oct 19 03:31:08.379338 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 1fcd6d9154004c5481c7a239f743dfd8 Oct 19 03:31:08.379338 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-363727118 Oct 19 03:31:08.379338 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-363727118-project Oct 19 03:31:08.379338 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:31:08.379338 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:31:08.379338 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 1fc1e253b66c40969197c4e747559024 Oct 19 03:31:08.379338 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-363727118-project Oct 19 03:31:08.379338 n-d-861333-8 devstack@n-api.service[121134]: Oct 19 03:31:08.379338 n-d-861333-8 devstack@n-api.service[121134]: {"security_group_rule": {"parent_group_id": "f99ed59e-7b5c-408b-b35d-8c84025b082e", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 19 03:31:08.379338 n-d-861333-8 devstack@n-api.service[121134]: method: Oct 19 03:31:08.380405 n-d-861333-8 devstack@n-api.service[121134]: exception: This rule already exists in group f99ed59e-7b5c-408b-b35d-8c84025b082e Oct 19 03:31:08.380405 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'f99ed59e-7b5c-408b-b35d-8c84025b082e', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 19 03:31:08.380405 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:31:08.380405 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:31:08.380405 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Oct 19 03:31:08.380405 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Oct 19 03:31:08.380405 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Oct 19 03:31:08.380405 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 19 03:31:08.380405 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group f99ed59e-7b5c-408b-b35d-8c84025b082e Oct 19 03:31:08.380405 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:31:08.380405 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:31:08.380405 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:31:08.380405 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:31:08.380405 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:31:08.380405 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:31:08.380405 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:31:08.380405 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:31:08.380405 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 03:31:08.380405 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 03:31:08.380405 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:31:08.382048 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:31:08.382048 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Oct 19 03:31:08.382048 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 19 03:31:08.382048 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group f99ed59e-7b5c-408b-b35d-8c84025b082e Oct 19 03:31:08.382048 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:31:08.382048 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:31:08.382048 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:31:08.382048 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:31:08.382048 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:31:08.382048 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:31:08.382048 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:31:08.382048 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:31:08.382048 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group f99ed59e-7b5c-408b-b35d-8c84025b082e Oct 19 03:31:08.382048 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:31:08.382048 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9df7dd5f-82e4-4629-84d7-a5e691f4ecbf tempest-SecurityGroupRulesNegativeTestJSON-363727118 tempest-SecurityGroupRulesNegativeTestJSON-363727118-project] Returning 400 to user: This rule already exists in group f99ed59e-7b5c-408b-b35d-8c84025b082e {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:31:08.383317 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9df7dd5f-82e4-4629-84d7-a5e691f4ecbf tempest-SecurityGroupRulesNegativeTestJSON-363727118 tempest-SecurityGroupRulesNegativeTestJSON-363727118-project] 10.222.0.52 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.274121 Oct 19 03:31:08.384390 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2015/4116] 10.222.0.52 () {60 vars in 1195 bytes} [Wed Oct 19 03:31:08 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 279 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 03:31:08.385936 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a514ea43-4ec3-4309-8275-7558aff5bc35 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:08.388489 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a514ea43-4ec3-4309-8275-7558aff5bc35 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:08.395522 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f7eaef59-2929-4a3c-a111-d994088caa3b tempest-SecurityGroupRulesNegativeTestJSON-363727118 tempest-SecurityGroupRulesNegativeTestJSON-363727118-project] Calling method '.version_select at 0x7fc135030a60>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:08.399959 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a514ea43-4ec3-4309-8275-7558aff5bc35 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:08.400600 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a514ea43-4ec3-4309-8275-7558aff5bc35 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:08.402605 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a514ea43-4ec3-4309-8275-7558aff5bc35 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:08.403460 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a514ea43-4ec3-4309-8275-7558aff5bc35 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:08.406006 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a514ea43-4ec3-4309-8275-7558aff5bc35 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:08.407643 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a514ea43-4ec3-4309-8275-7558aff5bc35 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:08.486769 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:31:09.264715 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a514ea43-4ec3-4309-8275-7558aff5bc35 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:09.280468 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f7eaef59-2929-4a3c-a111-d994088caa3b tempest-SecurityGroupRulesNegativeTestJSON-363727118 tempest-SecurityGroupRulesNegativeTestJSON-363727118-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-group-rules/a5849a1d-1b7e-4aae-9f5e-704ed68f3e1a" status: 202 len: 0 microversion: 2.1 time: 0.894908 Oct 19 03:31:09.281424 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2016/4117] 10.222.0.52 () {58 vars in 1287 bytes} [Wed Oct 19 03:31:08 2022] DELETE /compute/v2.1/os-security-group-rules/a5849a1d-1b7e-4aae-9f5e-704ed68f3e1a => generated 0 bytes in 896 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:31:09.282698 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a514ea43-4ec3-4309-8275-7558aff5bc35 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1670 microversion: 2.1 time: 0.911572 Oct 19 03:31:09.286419 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2102/4118] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:31:08 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1670 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:31:09.292982 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2ade5f5c-d57b-42db-9e41-75704d3f3672 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:09.294132 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2ade5f5c-d57b-42db-9e41-75704d3f3672 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 89f5f23f-8580-46fa-accf-206b1141c301] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:09.306695 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d1800083-1771-4250-b909-c2f28e4336ec tempest-SecurityGroupRulesNegativeTestJSON-363727118 tempest-SecurityGroupRulesNegativeTestJSON-363727118-project] Action: 'create', calling method: .version_select at 0x7fc12beaf4c0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-964737134", "description": "tempest-description-1677745776"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:31:09.308504 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2ade5f5c-d57b-42db-9e41-75704d3f3672 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:09.309207 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2ade5f5c-d57b-42db-9e41-75704d3f3672 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:09.310043 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2ade5f5c-d57b-42db-9e41-75704d3f3672 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:09.311072 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2ade5f5c-d57b-42db-9e41-75704d3f3672 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:09.313485 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2ade5f5c-d57b-42db-9e41-75704d3f3672 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:09.317724 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2ade5f5c-d57b-42db-9e41-75704d3f3672 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:09.374714 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-2ade5f5c-d57b-42db-9e41-75704d3f3672 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] HTTP exception thrown: Instance 89f5f23f-8580-46fa-accf-206b1141c301 could not be found. Oct 19 03:31:09.376329 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2ade5f5c-d57b-42db-9e41-75704d3f3672 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Request method failure captured: Oct 19 03:31:09.376329 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301 HTTP/1.1 Oct 19 03:31:09.376329 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:31:09.376329 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:31:09.376329 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:31:09.376329 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:31:09.376329 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:31:09.376329 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:31:09.376329 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:31:09.376329 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:31:09.376329 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT22uzKvAjuhIgc-DP7sPOfn3b9sZBQU9yYusOMtajXQwK7wG_j3ZDvn7Y9QkhMFz7rVu19UO6F9j-GFIsoZ01og7bGTb8cd2FAk3jP7hKJv7GRFFP9AvHjrS1D9SP93D8kxirVlCFlnWTrKXA6F64crO5KpGWGnmfOnzZxnOfR_1F5Y Oct 19 03:31:09.376329 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:31:09.376329 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:31:09.376329 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:31:09.376329 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:31:09.376329 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:31:09.376329 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:31:09.376329 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 8019441bff8642cebf21fd1c4e890196 Oct 19 03:31:09.376329 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-LiveMigrationTest-1310149028 Oct 19 03:31:09.376329 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:31:09.376329 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:31:09.378102 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8019441bff8642cebf21fd1c4e890196"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8019441bff8642cebf21fd1c4e890196"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8019441bff8642cebf21fd1c4e890196"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8019441bff8642cebf21fd1c4e890196", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:31:09.378102 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-LiveMigrationTest-1310149028 Oct 19 03:31:09.378102 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 8019441bff8642cebf21fd1c4e890196 Oct 19 03:31:09.378102 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-LiveMigrationTest-1310149028 Oct 19 03:31:09.378102 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-LiveMigrationTest-1310149028-project Oct 19 03:31:09.378102 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:31:09.378102 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:31:09.378102 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 2b5b2cb1272541dfbc2659cf4adf9026 Oct 19 03:31:09.378102 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-LiveMigrationTest-1310149028-project Oct 19 03:31:09.378102 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:31:09.378102 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance 89f5f23f-8580-46fa-accf-206b1141c301 could not be found. Oct 19 03:31:09.378102 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '89f5f23f-8580-46fa-accf-206b1141c301'} Oct 19 03:31:09.379193 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:31:09.379193 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:31:09.379193 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:31:09.379193 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:31:09.379193 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:31:09.379193 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:31:09.379193 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:31:09.379193 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:31:09.379193 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:31:09.379193 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:31:09.379193 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89f5f23f-8580-46fa-accf-206b1141c301 could not be found. Oct 19 03:31:09.379193 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:31:09.379193 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:31:09.379193 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:31:09.379193 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:31:09.379193 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:31:09.379193 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:31:09.379193 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:31:09.379193 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:31:09.379193 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:31:09.380834 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:31:09.380834 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:31:09.380834 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:31:09.380834 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:31:09.380834 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:31:09.380834 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:31:09.380834 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:31:09.380834 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89f5f23f-8580-46fa-accf-206b1141c301 could not be found. Oct 19 03:31:09.380834 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:31:09.380834 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:31:09.380834 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:31:09.380834 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:31:09.380834 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:31:09.380834 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:31:09.380834 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:31:09.380834 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:31:09.380834 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89f5f23f-8580-46fa-accf-206b1141c301 could not be found. Oct 19 03:31:09.380834 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:31:09.402774 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2ade5f5c-d57b-42db-9e41-75704d3f3672 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Returning 404 to user: Instance 89f5f23f-8580-46fa-accf-206b1141c301 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:31:09.403910 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2ade5f5c-d57b-42db-9e41-75704d3f3672 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301" status: 404 len: 111 microversion: 2.1 time: 0.121169 Oct 19 03:31:09.405028 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2017/4119] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:31:09 2022] GET /compute/v2.1/servers/89f5f23f-8580-46fa-accf-206b1141c301 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:31:10.458587 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d1800083-1771-4250-b909-c2f28e4336ec tempest-SecurityGroupRulesNegativeTestJSON-363727118 tempest-SecurityGroupRulesNegativeTestJSON-363727118-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 1.158784 Oct 19 03:31:10.459880 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2103/4120] 10.222.0.52 () {60 vars in 1180 bytes} [Wed Oct 19 03:31:09 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:31:10.479938 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-89fa5480-97d7-4cc5-a324-35691a6a779d tempest-SecurityGroupRulesNegativeTestJSON-363727118 tempest-SecurityGroupRulesNegativeTestJSON-363727118-project] Action: 'create', calling method: .version_select at 0x7fc1305414c0>, body: {"security_group_rule": {"parent_group_id": "3924db7c-c552-45ac-a206-1d3baadd12bd", "ip_protocol": "tcp", "from_port": 872704409, "to_port": 22}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:31:10.558221 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-89fa5480-97d7-4cc5-a324-35691a6a779d tempest-SecurityGroupRulesNegativeTestJSON-363727118 tempest-SecurityGroupRulesNegativeTestJSON-363727118-project] HTTP exception thrown: Invalid port range 872704409:22. Former value cannot be greater than the later Oct 19 03:31:10.560153 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-89fa5480-97d7-4cc5-a324-35691a6a779d tempest-SecurityGroupRulesNegativeTestJSON-363727118 tempest-SecurityGroupRulesNegativeTestJSON-363727118-project] Request method failure captured: Oct 19 03:31:10.560153 n-d-861333-8 devstack@n-api.service[121134]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 19 03:31:10.560153 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:31:10.560153 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:31:10.560153 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:31:10.560153 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 145 Oct 19 03:31:10.560153 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:31:10.560153 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:31:10.560153 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:31:10.560153 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:31:10.560153 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT294FEZ4Qf7P_oPk3UxAFZIjJKlSxsI7pRpw6olQwQn8PWk7ysV3ZhQbp796YpI5Dq_M9CXZ2K5l6FqJlJAs7KVgCe1F4bBUxEm3qq4IgyG6LiWzq2A23lsxbkK7olgnwEH0_uaYDCw-7hnr2vtxoUqtPOD6oysbSy-N0f1PvF-CH5o Oct 19 03:31:10.560153 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:31:10.560153 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:31:10.560153 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:31:10.560153 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:31:10.560153 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:31:10.560153 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:31:10.560153 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 1fcd6d9154004c5481c7a239f743dfd8 Oct 19 03:31:10.560153 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-363727118 Oct 19 03:31:10.560153 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:31:10.560153 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:31:10.562061 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1fcd6d9154004c5481c7a239f743dfd8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1fcd6d9154004c5481c7a239f743dfd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1fcd6d9154004c5481c7a239f743dfd8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1fcd6d9154004c5481c7a239f743dfd8", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:31:10.562061 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-363727118 Oct 19 03:31:10.562061 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 1fcd6d9154004c5481c7a239f743dfd8 Oct 19 03:31:10.562061 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-363727118 Oct 19 03:31:10.562061 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-363727118-project Oct 19 03:31:10.562061 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:31:10.562061 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:31:10.562061 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 1fc1e253b66c40969197c4e747559024 Oct 19 03:31:10.562061 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-363727118-project Oct 19 03:31:10.562061 n-d-861333-8 devstack@n-api.service[121134]: Oct 19 03:31:10.562061 n-d-861333-8 devstack@n-api.service[121134]: {"security_group_rule": {"parent_group_id": "3924db7c-c552-45ac-a206-1d3baadd12bd", "ip_protocol": "tcp", "from_port": 872704409, "to_port": 22}} Oct 19 03:31:10.562061 n-d-861333-8 devstack@n-api.service[121134]: method: Oct 19 03:31:10.563072 n-d-861333-8 devstack@n-api.service[121134]: exception: Invalid port range 872704409:22. Former value cannot be greater than the later Oct 19 03:31:10.563072 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'body': {'security_group_rule': {'parent_group_id': '3924db7c-c552-45ac-a206-1d3baadd12bd', 'ip_protocol': 'tcp', 'from_port': 872704409, 'to_port': 22}}} Oct 19 03:31:10.563072 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:31:10.563072 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:31:10.563072 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 19 03:31:10.563072 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 19 03:31:10.563072 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 19 03:31:10.563072 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 19 03:31:10.563072 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 19 03:31:10.563072 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 19 03:31:10.563072 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 19 03:31:10.563072 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 19 03:31:10.563072 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 872704409:22. Former value cannot be greater than the later Oct 19 03:31:10.563072 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:31:10.563072 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:31:10.563072 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:31:10.563072 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:31:10.563072 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:31:10.563072 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:31:10.564700 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:31:10.564700 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:31:10.564700 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 03:31:10.564700 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 03:31:10.564700 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:31:10.564700 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:31:10.564700 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 19 03:31:10.564700 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 19 03:31:10.564700 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 872704409:22. Former value cannot be greater than the later Oct 19 03:31:10.564700 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:31:10.564700 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:31:10.564700 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:31:10.564700 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:31:10.564700 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:31:10.564700 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:31:10.564700 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:31:10.564700 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:31:10.564700 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 872704409:22. Former value cannot be greater than the later Oct 19 03:31:10.564700 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:31:10.566390 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-89fa5480-97d7-4cc5-a324-35691a6a779d tempest-SecurityGroupRulesNegativeTestJSON-363727118 tempest-SecurityGroupRulesNegativeTestJSON-363727118-project] Returning 400 to user: Invalid port range 872704409:22. Former value cannot be greater than the later {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:31:10.568014 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-89fa5480-97d7-4cc5-a324-35691a6a779d tempest-SecurityGroupRulesNegativeTestJSON-363727118 tempest-SecurityGroupRulesNegativeTestJSON-363727118-project] 10.222.0.52 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 122 microversion: 2.1 time: 0.096635 Oct 19 03:31:10.568934 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2018/4121] 10.222.0.52 () {60 vars in 1195 bytes} [Wed Oct 19 03:31:10 2022] POST /compute/v2.1/os-security-group-rules => generated 122 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 03:31:10.587853 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d565d138-d385-4687-a88e-7b24716938db tempest-SecurityGroupRulesNegativeTestJSON-363727118 tempest-SecurityGroupRulesNegativeTestJSON-363727118-project] Action: 'create', calling method: .version_select at 0x7fc12be40430>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1330820608", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:31:10.591494 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-d565d138-d385-4687-a88e-7b24716938db tempest-SecurityGroupRulesNegativeTestJSON-363727118 tempest-SecurityGroupRulesNegativeTestJSON-363727118-project] HTTP exception thrown: Security group id should be uuid Oct 19 03:31:10.596381 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d565d138-d385-4687-a88e-7b24716938db tempest-SecurityGroupRulesNegativeTestJSON-363727118 tempest-SecurityGroupRulesNegativeTestJSON-363727118-project] Request method failure captured: Oct 19 03:31:10.596381 n-d-861333-8 devstack@n-api.service[121135]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 19 03:31:10.596381 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:31:10.596381 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:31:10.596381 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:31:10.596381 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 131 Oct 19 03:31:10.596381 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:31:10.596381 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:31:10.596381 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:31:10.596381 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:31:10.596381 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT294FEZ4Qf7P_oPk3UxAFZIjJKlSxsI7pRpw6olQwQn8PWk7ysV3ZhQbp796YpI5Dq_M9CXZ2K5l6FqJlJAs7KVgCe1F4bBUxEm3qq4IgyG6LiWzq2A23lsxbkK7olgnwEH0_uaYDCw-7hnr2vtxoUqtPOD6oysbSy-N0f1PvF-CH5o Oct 19 03:31:10.596381 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:31:10.596381 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:31:10.596381 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:31:10.596381 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:31:10.596381 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:31:10.596381 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:31:10.596381 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 1fcd6d9154004c5481c7a239f743dfd8 Oct 19 03:31:10.596381 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-363727118 Oct 19 03:31:10.596381 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:31:10.596381 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:31:10.600464 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1fcd6d9154004c5481c7a239f743dfd8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1fcd6d9154004c5481c7a239f743dfd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1fcd6d9154004c5481c7a239f743dfd8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1fcd6d9154004c5481c7a239f743dfd8", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:31:10.600464 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-363727118 Oct 19 03:31:10.600464 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 1fcd6d9154004c5481c7a239f743dfd8 Oct 19 03:31:10.600464 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-363727118 Oct 19 03:31:10.600464 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-363727118-project Oct 19 03:31:10.600464 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:31:10.600464 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:31:10.600464 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 1fc1e253b66c40969197c4e747559024 Oct 19 03:31:10.600464 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-363727118-project Oct 19 03:31:10.600464 n-d-861333-8 devstack@n-api.service[121135]: Oct 19 03:31:10.600464 n-d-861333-8 devstack@n-api.service[121135]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1330820608", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 19 03:31:10.600464 n-d-861333-8 devstack@n-api.service[121135]: method: Oct 19 03:31:10.600464 n-d-861333-8 devstack@n-api.service[121135]: exception: Security group id should be uuid Oct 19 03:31:10.601399 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-1330820608', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 19 03:31:10.601399 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:31:10.601399 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:31:10.601399 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Oct 19 03:31:10.601399 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Oct 19 03:31:10.601399 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Oct 19 03:31:10.601399 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 19 03:31:10.601399 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Oct 19 03:31:10.601399 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:31:10.601399 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:31:10.601399 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:31:10.601399 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:31:10.601399 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:31:10.601399 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:31:10.601399 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:31:10.601399 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:31:10.601399 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 03:31:10.601399 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 03:31:10.601399 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:31:10.601399 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:31:10.602786 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 19 03:31:10.602786 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 19 03:31:10.602786 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Oct 19 03:31:10.602786 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:31:10.602786 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:31:10.602786 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:31:10.602786 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:31:10.602786 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:31:10.602786 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:31:10.602786 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:31:10.602786 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:31:10.602786 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Oct 19 03:31:10.602786 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:31:10.602786 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d565d138-d385-4687-a88e-7b24716938db tempest-SecurityGroupRulesNegativeTestJSON-363727118 tempest-SecurityGroupRulesNegativeTestJSON-363727118-project] Returning 400 to user: Security group id should be uuid {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:31:10.604786 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d565d138-d385-4687-a88e-7b24716938db tempest-SecurityGroupRulesNegativeTestJSON-363727118 tempest-SecurityGroupRulesNegativeTestJSON-363727118-project] 10.222.0.52 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.018610 Oct 19 03:31:10.606691 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2104/4122] 10.222.0.52 () {60 vars in 1195 bytes} [Wed Oct 19 03:31:10 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 19 03:31:10.616725 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3333c265-76e2-4558-90af-a3582c6c6bb9 tempest-SecurityGroupRulesNegativeTestJSON-363727118 tempest-SecurityGroupRulesNegativeTestJSON-363727118-project] Action: 'create', calling method: .version_select at 0x7fc131e32e50>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1759676712", "description": "tempest-description-1671315477"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:31:11.554873 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-3aed42f7-99e9-40d4-bf29-139602d87e77 req-6169986a-397c-40d0-ac25-18b86b751dde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58b9ce4c-4a42-40ff-b8ed-b75de752b46f", "name": "network-vif-unplugged", "status": "completed", "tag": "ff8c2e3f-1c6f-4ac7-b6b8-751825489845"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:31:11.609610 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-3aed42f7-99e9-40d4-bf29-139602d87e77 req-6169986a-397c-40d0-ac25-18b86b751dde service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:11.609867 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-3aed42f7-99e9-40d4-bf29-139602d87e77 req-6169986a-397c-40d0-ac25-18b86b751dde service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:11.611651 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-3aed42f7-99e9-40d4-bf29-139602d87e77 req-6169986a-397c-40d0-ac25-18b86b751dde service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:11.679863 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-3aed42f7-99e9-40d4-bf29-139602d87e77 req-6169986a-397c-40d0-ac25-18b86b751dde service nova] Creating event network-vif-unplugged:ff8c2e3f-1c6f-4ac7-b6b8-751825489845 for instance 58b9ce4c-4a42-40ff-b8ed-b75de752b46f on n-h2-861333-8 Oct 19 03:31:11.709988 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-3aed42f7-99e9-40d4-bf29-139602d87e77 req-6169986a-397c-40d0-ac25-18b86b751dde service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.160484 Oct 19 03:31:11.710631 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2105/4123] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:31:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:31:12.490137 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3333c265-76e2-4558-90af-a3582c6c6bb9 tempest-SecurityGroupRulesNegativeTestJSON-363727118 tempest-SecurityGroupRulesNegativeTestJSON-363727118-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 1.877834 Oct 19 03:31:12.491404 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2019/4124] 10.222.0.52 () {60 vars in 1180 bytes} [Wed Oct 19 03:31:10 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 1880 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:31:12.507920 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d3e36a43-4925-4d5b-bcac-79092a84cb99 tempest-SecurityGroupRulesNegativeTestJSON-363727118 tempest-SecurityGroupRulesNegativeTestJSON-363727118-project] Action: 'create', calling method: .version_select at 0x7fc12beaf280>, body: {"security_group_rule": {"parent_group_id": "068b6809-ea41-401b-9d65-9542395b86d7", "ip_protocol": "tempest-999-752386165", "from_port": 22, "to_port": 22}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:31:12.823142 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-d3e36a43-4925-4d5b-bcac-79092a84cb99 tempest-SecurityGroupRulesNegativeTestJSON-363727118 tempest-SecurityGroupRulesNegativeTestJSON-363727118-project] HTTP exception thrown: Invalid IP protocol tempest-999-752386165. Oct 19 03:31:12.825726 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d3e36a43-4925-4d5b-bcac-79092a84cb99 tempest-SecurityGroupRulesNegativeTestJSON-363727118 tempest-SecurityGroupRulesNegativeTestJSON-363727118-project] Request method failure captured: Oct 19 03:31:12.825726 n-d-861333-8 devstack@n-api.service[121135]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 19 03:31:12.825726 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:31:12.825726 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:31:12.825726 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:31:12.825726 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 156 Oct 19 03:31:12.825726 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:31:12.825726 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:31:12.825726 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:31:12.825726 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:31:12.825726 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT294FEZ4Qf7P_oPk3UxAFZIjJKlSxsI7pRpw6olQwQn8PWk7ysV3ZhQbp796YpI5Dq_M9CXZ2K5l6FqJlJAs7KVgCe1F4bBUxEm3qq4IgyG6LiWzq2A23lsxbkK7olgnwEH0_uaYDCw-7hnr2vtxoUqtPOD6oysbSy-N0f1PvF-CH5o Oct 19 03:31:12.825726 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:31:12.825726 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:31:12.825726 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:31:12.825726 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:31:12.825726 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:31:12.825726 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:31:12.825726 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 1fcd6d9154004c5481c7a239f743dfd8 Oct 19 03:31:12.825726 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-363727118 Oct 19 03:31:12.825726 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:31:12.825726 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:31:12.827626 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1fcd6d9154004c5481c7a239f743dfd8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1fcd6d9154004c5481c7a239f743dfd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1fcd6d9154004c5481c7a239f743dfd8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1fcd6d9154004c5481c7a239f743dfd8", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:31:12.827626 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-363727118 Oct 19 03:31:12.827626 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 1fcd6d9154004c5481c7a239f743dfd8 Oct 19 03:31:12.827626 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-363727118 Oct 19 03:31:12.827626 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-363727118-project Oct 19 03:31:12.827626 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:31:12.827626 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:31:12.827626 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 1fc1e253b66c40969197c4e747559024 Oct 19 03:31:12.827626 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-363727118-project Oct 19 03:31:12.827626 n-d-861333-8 devstack@n-api.service[121135]: Oct 19 03:31:12.827626 n-d-861333-8 devstack@n-api.service[121135]: {"security_group_rule": {"parent_group_id": "068b6809-ea41-401b-9d65-9542395b86d7", "ip_protocol": "tempest-999-752386165", "from_port": 22, "to_port": 22}} Oct 19 03:31:12.827626 n-d-861333-8 devstack@n-api.service[121135]: method: Oct 19 03:31:12.828706 n-d-861333-8 devstack@n-api.service[121135]: exception: Invalid IP protocol tempest-999-752386165. Oct 19 03:31:12.828706 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'body': {'security_group_rule': {'parent_group_id': '068b6809-ea41-401b-9d65-9542395b86d7', 'ip_protocol': 'tempest-999-752386165', 'from_port': 22, 'to_port': 22}}} Oct 19 03:31:12.828706 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:31:12.828706 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:31:12.828706 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 19 03:31:12.828706 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 19 03:31:12.828706 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 19 03:31:12.828706 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 19 03:31:12.828706 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 19 03:31:12.828706 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 19 03:31:12.828706 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Oct 19 03:31:12.828706 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Oct 19 03:31:12.828706 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-752386165. Oct 19 03:31:12.828706 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:31:12.828706 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:31:12.828706 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:31:12.828706 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:31:12.828706 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:31:12.828706 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:31:12.830108 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:31:12.830108 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:31:12.830108 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 03:31:12.830108 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 03:31:12.830108 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:31:12.830108 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:31:12.830108 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 19 03:31:12.830108 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 19 03:31:12.830108 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-752386165. Oct 19 03:31:12.830108 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:31:12.830108 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:31:12.830108 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:31:12.830108 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:31:12.830108 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:31:12.830108 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:31:12.830108 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:31:12.830108 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:31:12.830108 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-752386165. Oct 19 03:31:12.830108 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:31:12.831576 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d3e36a43-4925-4d5b-bcac-79092a84cb99 tempest-SecurityGroupRulesNegativeTestJSON-363727118 tempest-SecurityGroupRulesNegativeTestJSON-363727118-project] Returning 400 to user: Invalid IP protocol tempest-999-752386165. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:31:12.831576 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d3e36a43-4925-4d5b-bcac-79092a84cb99 tempest-SecurityGroupRulesNegativeTestJSON-363727118 tempest-SecurityGroupRulesNegativeTestJSON-363727118-project] 10.222.0.52 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 86 microversion: 2.1 time: 0.325510 Oct 19 03:31:12.831576 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2106/4125] 10.222.0.52 () {60 vars in 1195 bytes} [Wed Oct 19 03:31:12 2022] POST /compute/v2.1/os-security-group-rules => generated 86 bytes in 327 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 19 03:31:12.837282 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6bb55816-a84b-42f2-b152-932c485681bb tempest-SecurityGroupRulesNegativeTestJSON-363727118 tempest-SecurityGroupRulesNegativeTestJSON-363727118-project] Action: 'create', calling method: .version_select at 0x7fc1300a0a60>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1740765595", "description": "tempest-description-562302709"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:31:13.721881 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6493bcef-fb79-43d7-b581-e3717654ef7d tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:13.722302 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6493bcef-fb79-43d7-b581-e3717654ef7d tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:13.741560 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6493bcef-fb79-43d7-b581-e3717654ef7d tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:13.742543 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6493bcef-fb79-43d7-b581-e3717654ef7d tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:13.743008 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6493bcef-fb79-43d7-b581-e3717654ef7d tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:13.746097 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6493bcef-fb79-43d7-b581-e3717654ef7d tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:13.748480 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6493bcef-fb79-43d7-b581-e3717654ef7d tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:13.755079 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6493bcef-fb79-43d7-b581-e3717654ef7d tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:14.441559 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6bb55816-a84b-42f2-b152-932c485681bb tempest-SecurityGroupRulesNegativeTestJSON-363727118 tempest-SecurityGroupRulesNegativeTestJSON-363727118-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 1.608197 Oct 19 03:31:14.442787 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2020/4126] 10.222.0.52 () {60 vars in 1180 bytes} [Wed Oct 19 03:31:12 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 1610 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:31:14.458684 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-52c8e09a-0b17-4ab4-a6d4-c0d34b38c310 tempest-SecurityGroupRulesNegativeTestJSON-363727118 tempest-SecurityGroupRulesNegativeTestJSON-363727118-project] Action: 'create', calling method: .version_select at 0x7fc1305051f0>, body: {"security_group_rule": {"parent_group_id": "8bcac45e-00aa-4f69-b996-c4c095a16430", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:31:14.680877 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-52c8e09a-0b17-4ab4-a6d4-c0d34b38c310 tempest-SecurityGroupRulesNegativeTestJSON-363727118 tempest-SecurityGroupRulesNegativeTestJSON-363727118-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Oct 19 03:31:14.682731 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-52c8e09a-0b17-4ab4-a6d4-c0d34b38c310 tempest-SecurityGroupRulesNegativeTestJSON-363727118 tempest-SecurityGroupRulesNegativeTestJSON-363727118-project] Request method failure captured: Oct 19 03:31:14.682731 n-d-861333-8 devstack@n-api.service[121134]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 19 03:31:14.682731 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:31:14.682731 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:31:14.682731 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:31:14.682731 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 138 Oct 19 03:31:14.682731 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:31:14.682731 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:31:14.682731 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:31:14.682731 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:31:14.682731 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT294FEZ4Qf7P_oPk3UxAFZIjJKlSxsI7pRpw6olQwQn8PWk7ysV3ZhQbp796YpI5Dq_M9CXZ2K5l6FqJlJAs7KVgCe1F4bBUxEm3qq4IgyG6LiWzq2A23lsxbkK7olgnwEH0_uaYDCw-7hnr2vtxoUqtPOD6oysbSy-N0f1PvF-CH5o Oct 19 03:31:14.682731 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:31:14.682731 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:31:14.682731 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:31:14.682731 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:31:14.682731 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:31:14.682731 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:31:14.682731 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 1fcd6d9154004c5481c7a239f743dfd8 Oct 19 03:31:14.682731 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-363727118 Oct 19 03:31:14.682731 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:31:14.682731 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:31:14.684522 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1fcd6d9154004c5481c7a239f743dfd8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1fcd6d9154004c5481c7a239f743dfd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1fcd6d9154004c5481c7a239f743dfd8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1fcd6d9154004c5481c7a239f743dfd8", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:31:14.684522 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-363727118 Oct 19 03:31:14.684522 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 1fcd6d9154004c5481c7a239f743dfd8 Oct 19 03:31:14.684522 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-363727118 Oct 19 03:31:14.684522 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-363727118-project Oct 19 03:31:14.684522 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:31:14.684522 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:31:14.684522 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 1fc1e253b66c40969197c4e747559024 Oct 19 03:31:14.684522 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-363727118-project Oct 19 03:31:14.684522 n-d-861333-8 devstack@n-api.service[121134]: Oct 19 03:31:14.684522 n-d-861333-8 devstack@n-api.service[121134]: {"security_group_rule": {"parent_group_id": "8bcac45e-00aa-4f69-b996-c4c095a16430", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Oct 19 03:31:14.684522 n-d-861333-8 devstack@n-api.service[121134]: method: Oct 19 03:31:14.685667 n-d-861333-8 devstack@n-api.service[121134]: exception: Invalid port range 22:21. Former value cannot be greater than the later Oct 19 03:31:14.685667 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'body': {'security_group_rule': {'parent_group_id': '8bcac45e-00aa-4f69-b996-c4c095a16430', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Oct 19 03:31:14.685667 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:31:14.685667 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:31:14.685667 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 19 03:31:14.685667 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 19 03:31:14.685667 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 19 03:31:14.685667 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 19 03:31:14.685667 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 19 03:31:14.685667 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 19 03:31:14.685667 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 19 03:31:14.685667 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 19 03:31:14.685667 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Oct 19 03:31:14.685667 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:31:14.685667 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:31:14.685667 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:31:14.685667 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:31:14.685667 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:31:14.685667 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:31:14.687528 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:31:14.687528 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:31:14.687528 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 03:31:14.687528 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 03:31:14.687528 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:31:14.687528 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:31:14.687528 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 19 03:31:14.687528 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 19 03:31:14.687528 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Oct 19 03:31:14.687528 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:31:14.687528 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:31:14.687528 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:31:14.687528 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:31:14.687528 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:31:14.687528 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:31:14.687528 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:31:14.687528 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:31:14.687528 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Oct 19 03:31:14.687528 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:31:14.690872 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-52c8e09a-0b17-4ab4-a6d4-c0d34b38c310 tempest-SecurityGroupRulesNegativeTestJSON-363727118 tempest-SecurityGroupRulesNegativeTestJSON-363727118-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:31:14.690872 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-52c8e09a-0b17-4ab4-a6d4-c0d34b38c310 tempest-SecurityGroupRulesNegativeTestJSON-363727118 tempest-SecurityGroupRulesNegativeTestJSON-363727118-project] 10.222.0.52 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.231079 Oct 19 03:31:14.690872 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2021/4127] 10.222.0.52 () {60 vars in 1195 bytes} [Wed Oct 19 03:31:14 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 232 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 19 03:31:14.696132 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e4c60b03-f228-485a-b8a0-e495abc2af27 tempest-SecurityGroupRulesNegativeTestJSON-363727118 tempest-SecurityGroupRulesNegativeTestJSON-363727118-project] Action: 'create', calling method: .version_select at 0x7fc130505040>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1629485034", "description": "tempest-description-2072297343"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:31:14.751475 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-6493bcef-fb79-43d7-b581-e3717654ef7d tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:14.760708 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6493bcef-fb79-43d7-b581-e3717654ef7d tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1670 microversion: 2.1 time: 1.043210 Oct 19 03:31:14.775472 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2107/4128] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:31:13 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1670 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:31:14.785649 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b3987b21-6984-46ac-9299-b36bac89d1a9 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:14.786320 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b3987b21-6984-46ac-9299-b36bac89d1a9 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:14.811959 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b3987b21-6984-46ac-9299-b36bac89d1a9 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:14.821446 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b3987b21-6984-46ac-9299-b36bac89d1a9 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:14.822578 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b3987b21-6984-46ac-9299-b36bac89d1a9 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:14.826844 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b3987b21-6984-46ac-9299-b36bac89d1a9 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:14.827526 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b3987b21-6984-46ac-9299-b36bac89d1a9 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:14.828178 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b3987b21-6984-46ac-9299-b36bac89d1a9 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:15.095905 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b3987b21-6984-46ac-9299-b36bac89d1a9 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:15.109083 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b3987b21-6984-46ac-9299-b36bac89d1a9 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1670 microversion: 2.1 time: 0.328419 Oct 19 03:31:15.129851 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2108/4129] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:31:14 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1670 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:31:15.451393 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6a116e5b-0c63-4e77-abbc-104fe941341d tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-153202715", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "networks": "none"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:31:15.586932 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-6a116e5b-0c63-4e77-abbc-104fe941341d tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Flavor limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:31:15.587361 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-6a116e5b-0c63-4e77-abbc-104fe941341d tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Image limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:31:15.587834 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-6a116e5b-0c63-4e77-abbc-104fe941341d tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Flavor pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:31:15.597128 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-6a116e5b-0c63-4e77-abbc-104fe941341d tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Image pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:31:15.597128 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-6a116e5b-0c63-4e77-abbc-104fe941341d tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:31:15.625787 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6a116e5b-0c63-4e77-abbc-104fe941341d tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:15.626312 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6a116e5b-0c63-4e77-abbc-104fe941341d tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:15.626780 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6a116e5b-0c63-4e77-abbc-104fe941341d tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:15.627536 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6a116e5b-0c63-4e77-abbc-104fe941341d tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:15.628002 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6a116e5b-0c63-4e77-abbc-104fe941341d tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:15.628436 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6a116e5b-0c63-4e77-abbc-104fe941341d tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:15.672840 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e4c60b03-f228-485a-b8a0-e495abc2af27 tempest-SecurityGroupRulesNegativeTestJSON-363727118 tempest-SecurityGroupRulesNegativeTestJSON-363727118-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.981683 Oct 19 03:31:15.673806 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2022/4130] 10.222.0.52 () {60 vars in 1180 bytes} [Wed Oct 19 03:31:14 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:31:15.678613 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d49cf6fa-0b4b-4aaa-997c-8a32b1e13cb5 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:15.679479 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d49cf6fa-0b4b-4aaa-997c-8a32b1e13cb5 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:15.690275 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-6a116e5b-0c63-4e77-abbc-104fe941341d tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Getting quotas for project 04fa10fa4a4a4726b3a2c5b373876650. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:31:15.695689 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d49cf6fa-0b4b-4aaa-997c-8a32b1e13cb5 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:15.696268 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d49cf6fa-0b4b-4aaa-997c-8a32b1e13cb5 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:15.696677 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d49cf6fa-0b4b-4aaa-997c-8a32b1e13cb5 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:15.698642 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d49cf6fa-0b4b-4aaa-997c-8a32b1e13cb5 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:15.699110 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d49cf6fa-0b4b-4aaa-997c-8a32b1e13cb5 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:15.699551 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d49cf6fa-0b4b-4aaa-997c-8a32b1e13cb5 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:15.705274 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-6a116e5b-0c63-4e77-abbc-104fe941341d tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Getting quotas for user 3a66063e37d640108cf1c500368ba9b6 and project 04fa10fa4a4a4726b3a2c5b373876650. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:31:15.746601 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6a116e5b-0c63-4e77-abbc-104fe941341d tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Going to run 1 instances... {{(pid=121135) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:31:15.749567 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6a116e5b-0c63-4e77-abbc-104fe941341d tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] [instance: 41c45cc9-0697-4ca0-a968-c982723b2155] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121135) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:31:15.894771 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6a116e5b-0c63-4e77-abbc-104fe941341d tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.763614 Oct 19 03:31:15.899444 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2109/4131] 10.222.0.52 () {62 vars in 1188 bytes} [Wed Oct 19 03:31:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 769 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 19 03:31:15.910916 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6cc9af4d-0844-4f2e-99c3-05d30400abf5 tempest-SecurityGroupRulesNegativeTestJSON-363727118 tempest-SecurityGroupRulesNegativeTestJSON-363727118-project] Action: 'create', calling method: .version_select at 0x7fc1302451f0>, body: {"security_group_rule": {"parent_group_id": "0bdfa4ee-9cd7-4d13-9813-b55d01157236", "ip_protocol": "tcp", "from_port": 22, "to_port": 760091290}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:31:16.039114 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d49cf6fa-0b4b-4aaa-997c-8a32b1e13cb5 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:16.047513 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d49cf6fa-0b4b-4aaa-997c-8a32b1e13cb5 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1670 microversion: 2.1 time: 0.372646 Oct 19 03:31:16.052656 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2023/4132] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:31:15 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1670 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:31:16.059925 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6eb389b3-f910-40a6-9d4c-4f28c087662f tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:16.063251 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6eb389b3-f910-40a6-9d4c-4f28c087662f tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] [instance: 41c45cc9-0697-4ca0-a968-c982723b2155] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:16.077716 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-6cc9af4d-0844-4f2e-99c3-05d30400abf5 tempest-SecurityGroupRulesNegativeTestJSON-363727118 tempest-SecurityGroupRulesNegativeTestJSON-363727118-project] HTTP exception thrown: Invalid port range 22:760091290. Valid TCP ports should be between 1-65535 Oct 19 03:31:16.083883 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6cc9af4d-0844-4f2e-99c3-05d30400abf5 tempest-SecurityGroupRulesNegativeTestJSON-363727118 tempest-SecurityGroupRulesNegativeTestJSON-363727118-project] Request method failure captured: Oct 19 03:31:16.083883 n-d-861333-8 devstack@n-api.service[121135]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 19 03:31:16.083883 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:31:16.083883 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:31:16.083883 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:31:16.083883 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 145 Oct 19 03:31:16.083883 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:31:16.083883 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:31:16.083883 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:31:16.083883 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:31:16.083883 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT294FEZ4Qf7P_oPk3UxAFZIjJKlSxsI7pRpw6olQwQn8PWk7ysV3ZhQbp796YpI5Dq_M9CXZ2K5l6FqJlJAs7KVgCe1F4bBUxEm3qq4IgyG6LiWzq2A23lsxbkK7olgnwEH0_uaYDCw-7hnr2vtxoUqtPOD6oysbSy-N0f1PvF-CH5o Oct 19 03:31:16.083883 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:31:16.083883 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:31:16.083883 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:31:16.083883 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:31:16.083883 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:31:16.083883 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:31:16.083883 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 1fcd6d9154004c5481c7a239f743dfd8 Oct 19 03:31:16.083883 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-363727118 Oct 19 03:31:16.083883 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:31:16.083883 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:31:16.085410 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1fcd6d9154004c5481c7a239f743dfd8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1fcd6d9154004c5481c7a239f743dfd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1fcd6d9154004c5481c7a239f743dfd8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1fcd6d9154004c5481c7a239f743dfd8", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:31:16.085410 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-363727118 Oct 19 03:31:16.085410 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 1fcd6d9154004c5481c7a239f743dfd8 Oct 19 03:31:16.085410 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-363727118 Oct 19 03:31:16.085410 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-363727118-project Oct 19 03:31:16.085410 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:31:16.085410 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:31:16.085410 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 1fc1e253b66c40969197c4e747559024 Oct 19 03:31:16.085410 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-363727118-project Oct 19 03:31:16.085410 n-d-861333-8 devstack@n-api.service[121135]: Oct 19 03:31:16.085410 n-d-861333-8 devstack@n-api.service[121135]: {"security_group_rule": {"parent_group_id": "0bdfa4ee-9cd7-4d13-9813-b55d01157236", "ip_protocol": "tcp", "from_port": 22, "to_port": 760091290}} Oct 19 03:31:16.085410 n-d-861333-8 devstack@n-api.service[121135]: method: Oct 19 03:31:16.086300 n-d-861333-8 devstack@n-api.service[121135]: exception: Invalid port range 22:760091290. Valid TCP ports should be between 1-65535 Oct 19 03:31:16.086300 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'body': {'security_group_rule': {'parent_group_id': '0bdfa4ee-9cd7-4d13-9813-b55d01157236', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 760091290}}} Oct 19 03:31:16.086300 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:31:16.086300 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:31:16.086300 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 19 03:31:16.086300 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 19 03:31:16.086300 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 19 03:31:16.086300 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 19 03:31:16.086300 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 19 03:31:16.086300 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 19 03:31:16.086300 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Oct 19 03:31:16.086300 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 19 03:31:16.086300 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:760091290. Valid TCP ports should be between 1-65535 Oct 19 03:31:16.086300 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:31:16.086300 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:31:16.086300 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:31:16.086300 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:31:16.086300 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:31:16.086300 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:31:16.087614 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:31:16.087614 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:31:16.087614 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 03:31:16.087614 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 03:31:16.087614 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:31:16.087614 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:31:16.087614 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 19 03:31:16.087614 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 19 03:31:16.087614 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:760091290. Valid TCP ports should be between 1-65535 Oct 19 03:31:16.087614 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:31:16.087614 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:31:16.087614 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:31:16.087614 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:31:16.087614 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:31:16.087614 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:31:16.087614 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:31:16.087614 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:31:16.087614 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:760091290. Valid TCP ports should be between 1-65535 Oct 19 03:31:16.087614 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:31:16.088966 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6cc9af4d-0844-4f2e-99c3-05d30400abf5 tempest-SecurityGroupRulesNegativeTestJSON-363727118 tempest-SecurityGroupRulesNegativeTestJSON-363727118-project] Returning 400 to user: Invalid port range 22:760091290. Valid TCP ports should be between 1-65535 {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:31:16.088966 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6cc9af4d-0844-4f2e-99c3-05d30400abf5 tempest-SecurityGroupRulesNegativeTestJSON-363727118 tempest-SecurityGroupRulesNegativeTestJSON-363727118-project] 10.222.0.52 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 118 microversion: 2.1 time: 0.177967 Oct 19 03:31:16.088966 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2110/4133] 10.222.0.52 () {60 vars in 1195 bytes} [Wed Oct 19 03:31:15 2022] POST /compute/v2.1/os-security-group-rules => generated 118 bytes in 180 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 03:31:16.093830 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a8d1cba5-eb3a-4c2f-905e-09a979c32fb2 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:31:16.102512 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a8d1cba5-eb3a-4c2f-905e-09a979c32fb2 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:16.117762 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a8d1cba5-eb3a-4c2f-905e-09a979c32fb2 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:16.118339 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a8d1cba5-eb3a-4c2f-905e-09a979c32fb2 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:16.119830 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a8d1cba5-eb3a-4c2f-905e-09a979c32fb2 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:16.121932 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a8d1cba5-eb3a-4c2f-905e-09a979c32fb2 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:16.125492 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a8d1cba5-eb3a-4c2f-905e-09a979c32fb2 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:16.127428 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a8d1cba5-eb3a-4c2f-905e-09a979c32fb2 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:16.222983 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-6eb389b3-f910-40a6-9d4c-4f28c087662f tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:16.243240 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-6eb389b3-f910-40a6-9d4c-4f28c087662f tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:16.254017 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-6eb389b3-f910-40a6-9d4c-4f28c087662f tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:16.258815 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6eb389b3-f910-40a6-9d4c-4f28c087662f tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] 10.222.0.52 "GET /compute/v2.1/servers/41c45cc9-0697-4ca0-a968-c982723b2155" status: 200 len: 1277 microversion: 2.54 time: 0.204256 Oct 19 03:31:16.271281 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2024/4134] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:31:16 2022] GET /compute/v2.1/servers/41c45cc9-0697-4ca0-a968-c982723b2155 => generated 1277 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:31:16.277421 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5a19b0ea-8aa3-4e24-8f7f-b94dc26402c0 tempest-SecurityGroupRulesNegativeTestJSON-363727118 tempest-SecurityGroupRulesNegativeTestJSON-363727118-project] Action: 'create', calling method: .version_select at 0x7fc12bf07670>, body: {"security_group_rule": {"parent_group_id": "a993e13f-f476-40ec-ba87-76f8528dde63", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:31:16.330939 n-d-861333-8 devstack@n-api.service[121134]: DEBUG neutronclient.v2_0.client [None req-5a19b0ea-8aa3-4e24-8f7f-b94dc26402c0 tempest-SecurityGroupRulesNegativeTestJSON-363727118 tempest-SecurityGroupRulesNegativeTestJSON-363727118-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a993e13f-f476-40ec-ba87-76f8528dde63 does not exist", "detail": ""}} {{(pid=121134) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 19 03:31:16.331670 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.security_group_api [None req-5a19b0ea-8aa3-4e24-8f7f-b94dc26402c0 tempest-SecurityGroupRulesNegativeTestJSON-363727118 tempest-SecurityGroupRulesNegativeTestJSON-363727118-project] Neutron security group a993e13f-f476-40ec-ba87-76f8528dde63 not found {{(pid=121134) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 19 03:31:16.332309 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-5a19b0ea-8aa3-4e24-8f7f-b94dc26402c0 tempest-SecurityGroupRulesNegativeTestJSON-363727118 tempest-SecurityGroupRulesNegativeTestJSON-363727118-project] HTTP exception thrown: Security group a993e13f-f476-40ec-ba87-76f8528dde63 does not exist Oct 19 03:31:16.332309 n-d-861333-8 devstack@n-api.service[121134]: Neutron server returns request_ids: ['req-8c05c1bb-23bc-4db9-ad8c-6c72ea3f9b69'] Oct 19 03:31:16.334583 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5a19b0ea-8aa3-4e24-8f7f-b94dc26402c0 tempest-SecurityGroupRulesNegativeTestJSON-363727118 tempest-SecurityGroupRulesNegativeTestJSON-363727118-project] Request method failure captured: Oct 19 03:31:16.334583 n-d-861333-8 devstack@n-api.service[121134]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 19 03:31:16.334583 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:31:16.334583 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:31:16.334583 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:31:16.334583 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 138 Oct 19 03:31:16.334583 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:31:16.334583 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:31:16.334583 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:31:16.334583 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:31:16.334583 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT294FEZ4Qf7P_oPk3UxAFZIjJKlSxsI7pRpw6olQwQn8PWk7ysV3ZhQbp796YpI5Dq_M9CXZ2K5l6FqJlJAs7KVgCe1F4bBUxEm3qq4IgyG6LiWzq2A23lsxbkK7olgnwEH0_uaYDCw-7hnr2vtxoUqtPOD6oysbSy-N0f1PvF-CH5o Oct 19 03:31:16.334583 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:31:16.334583 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:31:16.334583 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:31:16.334583 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:31:16.334583 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:31:16.334583 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:31:16.334583 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 1fcd6d9154004c5481c7a239f743dfd8 Oct 19 03:31:16.334583 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-363727118 Oct 19 03:31:16.334583 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:31:16.334583 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:31:16.336344 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1fcd6d9154004c5481c7a239f743dfd8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1fcd6d9154004c5481c7a239f743dfd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1fcd6d9154004c5481c7a239f743dfd8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1fcd6d9154004c5481c7a239f743dfd8", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:31:16.336344 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-363727118 Oct 19 03:31:16.336344 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 1fcd6d9154004c5481c7a239f743dfd8 Oct 19 03:31:16.336344 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-363727118 Oct 19 03:31:16.336344 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-363727118-project Oct 19 03:31:16.336344 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:31:16.336344 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:31:16.336344 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 1fc1e253b66c40969197c4e747559024 Oct 19 03:31:16.336344 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-363727118-project Oct 19 03:31:16.336344 n-d-861333-8 devstack@n-api.service[121134]: Oct 19 03:31:16.336344 n-d-861333-8 devstack@n-api.service[121134]: {"security_group_rule": {"parent_group_id": "a993e13f-f476-40ec-ba87-76f8528dde63", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 19 03:31:16.336344 n-d-861333-8 devstack@n-api.service[121134]: method: Oct 19 03:31:16.337351 n-d-861333-8 devstack@n-api.service[121134]: exception: Security group a993e13f-f476-40ec-ba87-76f8528dde63 does not exist Oct 19 03:31:16.337351 n-d-861333-8 devstack@n-api.service[121134]: Neutron server returns request_ids: ['req-8c05c1bb-23bc-4db9-ad8c-6c72ea3f9b69'] Oct 19 03:31:16.337351 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'a993e13f-f476-40ec-ba87-76f8528dde63', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 19 03:31:16.337351 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:31:16.337351 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:31:16.337351 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 19 03:31:16.337351 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 19 03:31:16.337351 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:31:16.337351 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:31:16.337351 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 19 03:31:16.337351 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 19 03:31:16.337351 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:31:16.337351 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:31:16.337351 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 19 03:31:16.337351 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 19 03:31:16.337351 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:31:16.337351 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:31:16.337351 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 19 03:31:16.337351 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 19 03:31:16.339136 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:31:16.339136 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:31:16.339136 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 19 03:31:16.339136 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 19 03:31:16.339136 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:31:16.339136 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:31:16.339136 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 19 03:31:16.339136 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 19 03:31:16.339136 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 19 03:31:16.339136 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 19 03:31:16.339136 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a993e13f-f476-40ec-ba87-76f8528dde63 does not exist Oct 19 03:31:16.339136 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8c05c1bb-23bc-4db9-ad8c-6c72ea3f9b69'] Oct 19 03:31:16.339136 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:31:16.339136 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:31:16.339136 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:31:16.339136 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:31:16.339136 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Oct 19 03:31:16.339136 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Oct 19 03:31:16.339136 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 19 03:31:16.345066 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 19 03:31:16.345066 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a993e13f-f476-40ec-ba87-76f8528dde63 does not exist Oct 19 03:31:16.345066 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8c05c1bb-23bc-4db9-ad8c-6c72ea3f9b69'] Oct 19 03:31:16.345066 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:31:16.345066 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:31:16.345066 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:31:16.345066 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:31:16.345066 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:31:16.345066 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:31:16.345066 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:31:16.345066 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:31:16.345066 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 03:31:16.345066 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 03:31:16.345066 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:31:16.345066 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:31:16.345066 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Oct 19 03:31:16.345066 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 19 03:31:16.345066 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a993e13f-f476-40ec-ba87-76f8528dde63 does not exist Oct 19 03:31:16.345066 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8c05c1bb-23bc-4db9-ad8c-6c72ea3f9b69'] Oct 19 03:31:16.345066 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:31:16.347754 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:31:16.347754 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:31:16.347754 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:31:16.347754 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:31:16.347754 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:31:16.347754 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:31:16.347754 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:31:16.347754 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a993e13f-f476-40ec-ba87-76f8528dde63 does not exist Oct 19 03:31:16.347754 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8c05c1bb-23bc-4db9-ad8c-6c72ea3f9b69'] Oct 19 03:31:16.347754 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:31:16.347754 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5a19b0ea-8aa3-4e24-8f7f-b94dc26402c0 tempest-SecurityGroupRulesNegativeTestJSON-363727118 tempest-SecurityGroupRulesNegativeTestJSON-363727118-project] Returning 404 to user: Security group a993e13f-f476-40ec-ba87-76f8528dde63 does not exist Oct 19 03:31:16.347754 n-d-861333-8 devstack@n-api.service[121134]: Neutron server returns request_ids: ['req-8c05c1bb-23bc-4db9-ad8c-6c72ea3f9b69'] {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:31:16.347754 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5a19b0ea-8aa3-4e24-8f7f-b94dc26402c0 tempest-SecurityGroupRulesNegativeTestJSON-363727118 tempest-SecurityGroupRulesNegativeTestJSON-363727118-project] 10.222.0.52 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.069127 Oct 19 03:31:16.353061 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2025/4135] 10.222.0.52 () {60 vars in 1195 bytes} [Wed Oct 19 03:31:16 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:31:16.367562 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-86178652-8dc6-4685-ac5c-dcf7b9c4ee42 tempest-SecurityGroupRulesNegativeTestJSON-363727118 tempest-SecurityGroupRulesNegativeTestJSON-363727118-project] Calling method '.version_select at 0x7fc13056f160>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:16.448967 n-d-861333-8 devstack@n-api.service[121134]: DEBUG neutronclient.v2_0.client [None req-86178652-8dc6-4685-ac5c-dcf7b9c4ee42 tempest-SecurityGroupRulesNegativeTestJSON-363727118 tempest-SecurityGroupRulesNegativeTestJSON-363727118-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 46300786-214e-466e-835c-b56538a28c55 does not exist", "detail": ""}} {{(pid=121134) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 19 03:31:16.448967 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.security_group_api [None req-86178652-8dc6-4685-ac5c-dcf7b9c4ee42 tempest-SecurityGroupRulesNegativeTestJSON-363727118 tempest-SecurityGroupRulesNegativeTestJSON-363727118-project] Neutron security group rule 46300786-214e-466e-835c-b56538a28c55 not found {{(pid=121134) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Oct 19 03:31:16.448967 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-86178652-8dc6-4685-ac5c-dcf7b9c4ee42 tempest-SecurityGroupRulesNegativeTestJSON-363727118 tempest-SecurityGroupRulesNegativeTestJSON-363727118-project] HTTP exception thrown: Security group rule 46300786-214e-466e-835c-b56538a28c55 does not exist Oct 19 03:31:16.448967 n-d-861333-8 devstack@n-api.service[121134]: Neutron server returns request_ids: ['req-cb21f842-4cd2-4e9a-ba4b-f2bb4032f290'] Oct 19 03:31:16.448967 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-86178652-8dc6-4685-ac5c-dcf7b9c4ee42 tempest-SecurityGroupRulesNegativeTestJSON-363727118 tempest-SecurityGroupRulesNegativeTestJSON-363727118-project] Request method failure captured: Oct 19 03:31:16.448967 n-d-861333-8 devstack@n-api.service[121134]: request: DELETE /compute/v2.1/os-security-group-rules/46300786-214e-466e-835c-b56538a28c55 HTTP/1.1 Oct 19 03:31:16.448967 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:31:16.448967 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:31:16.448967 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:31:16.448967 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:31:16.448967 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:31:16.448967 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:31:16.448967 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:31:16.448967 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:31:16.450362 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT294FEZ4Qf7P_oPk3UxAFZIjJKlSxsI7pRpw6olQwQn8PWk7ysV3ZhQbp796YpI5Dq_M9CXZ2K5l6FqJlJAs7KVgCe1F4bBUxEm3qq4IgyG6LiWzq2A23lsxbkK7olgnwEH0_uaYDCw-7hnr2vtxoUqtPOD6oysbSy-N0f1PvF-CH5o Oct 19 03:31:16.450362 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:31:16.450362 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:31:16.450362 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:31:16.450362 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:31:16.450362 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:31:16.450362 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:31:16.450362 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 1fcd6d9154004c5481c7a239f743dfd8 Oct 19 03:31:16.450362 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-363727118 Oct 19 03:31:16.450362 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:31:16.450362 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:31:16.450362 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1fcd6d9154004c5481c7a239f743dfd8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1fcd6d9154004c5481c7a239f743dfd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1fcd6d9154004c5481c7a239f743dfd8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1fcd6d9154004c5481c7a239f743dfd8", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:31:16.450362 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-363727118 Oct 19 03:31:16.450362 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 1fcd6d9154004c5481c7a239f743dfd8 Oct 19 03:31:16.450362 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-363727118 Oct 19 03:31:16.451404 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-363727118-project Oct 19 03:31:16.451404 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:31:16.451404 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:31:16.451404 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 1fc1e253b66c40969197c4e747559024 Oct 19 03:31:16.451404 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-363727118-project Oct 19 03:31:16.451404 n-d-861333-8 devstack@n-api.service[121134]: method: Oct 19 03:31:16.451404 n-d-861333-8 devstack@n-api.service[121134]: exception: Security group rule 46300786-214e-466e-835c-b56538a28c55 does not exist Oct 19 03:31:16.451404 n-d-861333-8 devstack@n-api.service[121134]: Neutron server returns request_ids: ['req-cb21f842-4cd2-4e9a-ba4b-f2bb4032f290'] Oct 19 03:31:16.451404 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '46300786-214e-466e-835c-b56538a28c55'} Oct 19 03:31:16.451404 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:31:16.451404 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:31:16.451404 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Oct 19 03:31:16.451404 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Oct 19 03:31:16.451404 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:31:16.451404 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:31:16.451404 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1092, in show_security_group_rule Oct 19 03:31:16.451404 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Oct 19 03:31:16.451404 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:31:16.451404 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:31:16.451404 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 19 03:31:16.451404 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 19 03:31:16.451404 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:31:16.451404 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:31:16.453252 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 19 03:31:16.453252 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 19 03:31:16.453252 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:31:16.453252 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:31:16.453252 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 19 03:31:16.453252 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 19 03:31:16.453252 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:31:16.453252 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:31:16.453252 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 19 03:31:16.453252 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 19 03:31:16.453252 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 19 03:31:16.453252 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 19 03:31:16.453252 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 46300786-214e-466e-835c-b56538a28c55 does not exist Oct 19 03:31:16.453252 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cb21f842-4cd2-4e9a-ba4b-f2bb4032f290'] Oct 19 03:31:16.453252 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:31:16.453252 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:31:16.453252 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:31:16.453252 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:31:16.455453 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Oct 19 03:31:16.455453 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Oct 19 03:31:16.455453 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Oct 19 03:31:16.455453 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 19 03:31:16.455453 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 46300786-214e-466e-835c-b56538a28c55 does not exist Oct 19 03:31:16.455453 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cb21f842-4cd2-4e9a-ba4b-f2bb4032f290'] Oct 19 03:31:16.455453 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:31:16.455453 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:31:16.455453 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:31:16.455453 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:31:16.455453 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:31:16.455453 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:31:16.455453 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:31:16.455453 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:31:16.455453 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 03:31:16.455453 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 03:31:16.455453 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:31:16.455453 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:31:16.455453 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Oct 19 03:31:16.458042 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 19 03:31:16.458042 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 46300786-214e-466e-835c-b56538a28c55 does not exist Oct 19 03:31:16.458042 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cb21f842-4cd2-4e9a-ba4b-f2bb4032f290'] Oct 19 03:31:16.458042 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:31:16.458042 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:31:16.458042 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:31:16.458042 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:31:16.458042 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:31:16.458042 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:31:16.458042 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:31:16.458042 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:31:16.458042 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 46300786-214e-466e-835c-b56538a28c55 does not exist Oct 19 03:31:16.458042 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cb21f842-4cd2-4e9a-ba4b-f2bb4032f290'] Oct 19 03:31:16.458042 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:31:16.458042 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-86178652-8dc6-4685-ac5c-dcf7b9c4ee42 tempest-SecurityGroupRulesNegativeTestJSON-363727118 tempest-SecurityGroupRulesNegativeTestJSON-363727118-project] Returning 404 to user: Security group rule 46300786-214e-466e-835c-b56538a28c55 does not exist Oct 19 03:31:16.458042 n-d-861333-8 devstack@n-api.service[121134]: Neutron server returns request_ids: ['req-cb21f842-4cd2-4e9a-ba4b-f2bb4032f290'] {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:31:16.461888 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-86178652-8dc6-4685-ac5c-dcf7b9c4ee42 tempest-SecurityGroupRulesNegativeTestJSON-363727118 tempest-SecurityGroupRulesNegativeTestJSON-363727118-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-group-rules/46300786-214e-466e-835c-b56538a28c55" status: 404 len: 199 microversion: 2.1 time: 0.095700 Oct 19 03:31:16.461888 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2026/4136] 10.222.0.52 () {58 vars in 1287 bytes} [Wed Oct 19 03:31:16 2022] DELETE /compute/v2.1/os-security-group-rules/46300786-214e-466e-835c-b56538a28c55 => generated 199 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:31:16.463074 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-953e088b-fe59-4d44-bbf3-e0bf1402746f tempest-SecurityGroupRulesNegativeTestJSON-363727118 tempest-SecurityGroupRulesNegativeTestJSON-363727118-project] Calling method '.version_select at 0x7fc1303911f0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:16.521405 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a8d1cba5-eb3a-4c2f-905e-09a979c32fb2 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "POST /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f/action" status: 202 len: 0 microversion: 2.1 time: 0.437247 Oct 19 03:31:16.523511 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2111/4137] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:31:16 2022] POST /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f/action => generated 0 bytes in 440 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:31:16.545806 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9afcf7c9-e523-4139-9a1a-99e92ad8665b tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:16.547490 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9afcf7c9-e523-4139-9a1a-99e92ad8665b tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:16.556782 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9afcf7c9-e523-4139-9a1a-99e92ad8665b tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:16.559586 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9afcf7c9-e523-4139-9a1a-99e92ad8665b tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:16.560305 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9afcf7c9-e523-4139-9a1a-99e92ad8665b tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:16.561421 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9afcf7c9-e523-4139-9a1a-99e92ad8665b tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:16.562099 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9afcf7c9-e523-4139-9a1a-99e92ad8665b tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:16.562728 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9afcf7c9-e523-4139-9a1a-99e92ad8665b tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:17.076914 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-9afcf7c9-e523-4139-9a1a-99e92ad8665b tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:17.092554 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9afcf7c9-e523-4139-9a1a-99e92ad8665b tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1672 microversion: 2.1 time: 0.562909 Oct 19 03:31:17.107626 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2112/4138] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:31:16 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1672 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:31:17.263831 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-953e088b-fe59-4d44-bbf3-e0bf1402746f tempest-SecurityGroupRulesNegativeTestJSON-363727118 tempest-SecurityGroupRulesNegativeTestJSON-363727118-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/0bdfa4ee-9cd7-4d13-9813-b55d01157236" status: 202 len: 0 microversion: 2.1 time: 0.805467 Oct 19 03:31:17.265250 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2027/4139] 10.222.0.52 () {58 vars in 1272 bytes} [Wed Oct 19 03:31:16 2022] DELETE /compute/v2.1/os-security-groups/0bdfa4ee-9cd7-4d13-9813-b55d01157236 => generated 0 bytes in 808 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:31:17.275366 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0228efeb-31a4-4796-9a25-71766ecb9535 tempest-SecurityGroupRulesNegativeTestJSON-363727118 tempest-SecurityGroupRulesNegativeTestJSON-363727118-project] Calling method '.version_select at 0x7fc1301e33a0>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:17.301151 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b49fcc33-c41e-4d2a-8642-0759fad4295a tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:17.302193 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b49fcc33-c41e-4d2a-8642-0759fad4295a tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] [instance: 41c45cc9-0697-4ca0-a968-c982723b2155] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:17.528591 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b49fcc33-c41e-4d2a-8642-0759fad4295a tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:17.544792 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b49fcc33-c41e-4d2a-8642-0759fad4295a tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:17.546538 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b49fcc33-c41e-4d2a-8642-0759fad4295a tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:17.547823 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b49fcc33-c41e-4d2a-8642-0759fad4295a tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] 10.222.0.52 "GET /compute/v2.1/servers/41c45cc9-0697-4ca0-a968-c982723b2155" status: 200 len: 1277 microversion: 2.54 time: 0.251343 Oct 19 03:31:17.551519 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2028/4140] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:31:17 2022] GET /compute/v2.1/servers/41c45cc9-0697-4ca0-a968-c982723b2155 => generated 1277 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:31:18.018538 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0228efeb-31a4-4796-9a25-71766ecb9535 tempest-SecurityGroupRulesNegativeTestJSON-363727118 tempest-SecurityGroupRulesNegativeTestJSON-363727118-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/8bcac45e-00aa-4f69-b996-c4c095a16430" status: 202 len: 0 microversion: 2.1 time: 0.748820 Oct 19 03:31:18.019983 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2113/4141] 10.222.0.52 () {58 vars in 1272 bytes} [Wed Oct 19 03:31:17 2022] DELETE /compute/v2.1/os-security-groups/8bcac45e-00aa-4f69-b996-c4c095a16430 => generated 0 bytes in 751 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 19 03:31:18.028668 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d9e49d4b-43d9-4d3a-aab3-05d5c302b1e3 tempest-SecurityGroupRulesNegativeTestJSON-363727118 tempest-SecurityGroupRulesNegativeTestJSON-363727118-project] Calling method '.version_select at 0x7fc1300a0a60>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:18.125757 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-669d3994-c382-4bcf-b603-f10757926dea tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:18.126442 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-669d3994-c382-4bcf-b603-f10757926dea tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:18.143599 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-669d3994-c382-4bcf-b603-f10757926dea tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:18.145701 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-669d3994-c382-4bcf-b603-f10757926dea tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:18.147683 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-669d3994-c382-4bcf-b603-f10757926dea tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:18.149916 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-669d3994-c382-4bcf-b603-f10757926dea tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:18.152984 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-669d3994-c382-4bcf-b603-f10757926dea tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:18.153751 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-669d3994-c382-4bcf-b603-f10757926dea tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:18.455572 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-669d3994-c382-4bcf-b603-f10757926dea tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:18.484047 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-669d3994-c382-4bcf-b603-f10757926dea tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1672 microversion: 2.1 time: 0.365551 Oct 19 03:31:18.488142 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2114/4142] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:31:18 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1672 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:31:18.581862 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-bd9accee-12d1-4d38-8869-bdb49563d897 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:18.582858 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-bd9accee-12d1-4d38-8869-bdb49563d897 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] [instance: 41c45cc9-0697-4ca0-a968-c982723b2155] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:18.607586 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bd9accee-12d1-4d38-8869-bdb49563d897 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:18.608078 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bd9accee-12d1-4d38-8869-bdb49563d897 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:18.609764 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bd9accee-12d1-4d38-8869-bdb49563d897 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:18.614087 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bd9accee-12d1-4d38-8869-bdb49563d897 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:18.614087 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bd9accee-12d1-4d38-8869-bdb49563d897 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:18.614087 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bd9accee-12d1-4d38-8869-bdb49563d897 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:18.641267 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d9e49d4b-43d9-4d3a-aab3-05d5c302b1e3 tempest-SecurityGroupRulesNegativeTestJSON-363727118 tempest-SecurityGroupRulesNegativeTestJSON-363727118-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/068b6809-ea41-401b-9d65-9542395b86d7" status: 202 len: 0 microversion: 2.1 time: 0.616740 Oct 19 03:31:18.643325 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2029/4143] 10.222.0.52 () {58 vars in 1272 bytes} [Wed Oct 19 03:31:18 2022] DELETE /compute/v2.1/os-security-groups/068b6809-ea41-401b-9d65-9542395b86d7 => generated 0 bytes in 620 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:31:18.655514 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-83afb697-98e1-4a53-93d6-a81f2e2fae22 tempest-SecurityGroupRulesNegativeTestJSON-363727118 tempest-SecurityGroupRulesNegativeTestJSON-363727118-project] Calling method '.version_select at 0x7fc1300d15e0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:18.794887 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-bd9accee-12d1-4d38-8869-bdb49563d897 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:18.804948 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-bd9accee-12d1-4d38-8869-bdb49563d897 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:18.806982 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-bd9accee-12d1-4d38-8869-bdb49563d897 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:18.808460 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-bd9accee-12d1-4d38-8869-bdb49563d897 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] 10.222.0.52 "GET /compute/v2.1/servers/41c45cc9-0697-4ca0-a968-c982723b2155" status: 200 len: 1273 microversion: 2.54 time: 0.231526 Oct 19 03:31:18.810029 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2115/4144] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:31:18 2022] GET /compute/v2.1/servers/41c45cc9-0697-4ca0-a968-c982723b2155 => generated 1273 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:31:18.815514 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2e29109f-4323-4e20-a6cd-40be48fb454d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:18.816283 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-2e29109f-4323-4e20-a6cd-40be48fb454d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 5cc2003b-73ef-4a54-a22d-9cef47c6ed3f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:18.822815 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2e29109f-4323-4e20-a6cd-40be48fb454d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:18.827369 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2e29109f-4323-4e20-a6cd-40be48fb454d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:18.828161 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2e29109f-4323-4e20-a6cd-40be48fb454d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:18.829137 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2e29109f-4323-4e20-a6cd-40be48fb454d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:18.829866 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2e29109f-4323-4e20-a6cd-40be48fb454d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:18.831872 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2e29109f-4323-4e20-a6cd-40be48fb454d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:18.880995 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-2e29109f-4323-4e20-a6cd-40be48fb454d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 5cc2003b-73ef-4a54-a22d-9cef47c6ed3f] Going to try to terminate instance {{(pid=121135) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:31:19.159122 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-83afb697-98e1-4a53-93d6-a81f2e2fae22 tempest-SecurityGroupRulesNegativeTestJSON-363727118 tempest-SecurityGroupRulesNegativeTestJSON-363727118-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/3924db7c-c552-45ac-a206-1d3baadd12bd" status: 202 len: 0 microversion: 2.1 time: 0.511301 Oct 19 03:31:19.161913 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2030/4145] 10.222.0.52 () {58 vars in 1272 bytes} [Wed Oct 19 03:31:18 2022] DELETE /compute/v2.1/os-security-groups/3924db7c-c552-45ac-a206-1d3baadd12bd => generated 0 bytes in 515 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:31:19.174507 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ba8d2a1b-6dc8-49c3-8ec7-5af41fd657a5 tempest-SecurityGroupRulesNegativeTestJSON-363727118 tempest-SecurityGroupRulesNegativeTestJSON-363727118-project] Calling method '.version_select at 0x7fc130582820>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:19.229120 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2e29109f-4323-4e20-a6cd-40be48fb454d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "DELETE /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f" status: 204 len: 0 microversion: 2.1 time: 0.416439 Oct 19 03:31:19.230791 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2116/4146] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:31:18 2022] DELETE /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f => generated 0 bytes in 421 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:31:19.241494 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a09f1ddb-8a6d-4f24-81c2-73b4bcd06b1a tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:19.242485 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a09f1ddb-8a6d-4f24-81c2-73b4bcd06b1a tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 5cc2003b-73ef-4a54-a22d-9cef47c6ed3f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:19.252785 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a09f1ddb-8a6d-4f24-81c2-73b4bcd06b1a tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:19.253163 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a09f1ddb-8a6d-4f24-81c2-73b4bcd06b1a tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:19.253816 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a09f1ddb-8a6d-4f24-81c2-73b4bcd06b1a tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:19.255310 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a09f1ddb-8a6d-4f24-81c2-73b4bcd06b1a tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:19.255939 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a09f1ddb-8a6d-4f24-81c2-73b4bcd06b1a tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:19.256526 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a09f1ddb-8a6d-4f24-81c2-73b4bcd06b1a tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:19.565190 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a09f1ddb-8a6d-4f24-81c2-73b4bcd06b1a tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:19.575135 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a09f1ddb-8a6d-4f24-81c2-73b4bcd06b1a tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f" status: 200 len: 1667 microversion: 2.1 time: 0.338233 Oct 19 03:31:19.589400 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2117/4147] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:31:19 2022] GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f => generated 1667 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:31:19.600374 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c41dfe3d-86e1-4fc5-90fe-a6832e8b04d0 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:19.600374 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c41dfe3d-86e1-4fc5-90fe-a6832e8b04d0 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:19.611013 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c41dfe3d-86e1-4fc5-90fe-a6832e8b04d0 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:19.611443 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c41dfe3d-86e1-4fc5-90fe-a6832e8b04d0 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:19.613701 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c41dfe3d-86e1-4fc5-90fe-a6832e8b04d0 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:19.615459 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c41dfe3d-86e1-4fc5-90fe-a6832e8b04d0 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:19.615948 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c41dfe3d-86e1-4fc5-90fe-a6832e8b04d0 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:19.616385 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c41dfe3d-86e1-4fc5-90fe-a6832e8b04d0 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:19.706547 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ba8d2a1b-6dc8-49c3-8ec7-5af41fd657a5 tempest-SecurityGroupRulesNegativeTestJSON-363727118 tempest-SecurityGroupRulesNegativeTestJSON-363727118-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/f99ed59e-7b5c-408b-b35d-8c84025b082e" status: 202 len: 0 microversion: 2.1 time: 0.540276 Oct 19 03:31:19.709557 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2031/4148] 10.222.0.52 () {58 vars in 1272 bytes} [Wed Oct 19 03:31:19 2022] DELETE /compute/v2.1/os-security-groups/f99ed59e-7b5c-408b-b35d-8c84025b082e => generated 0 bytes in 542 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:31:19.844318 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c39f5970-9f3d-4d49-90ec-b2ab1f675e0f tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:19.844318 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c39f5970-9f3d-4d49-90ec-b2ab1f675e0f tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] [instance: 41c45cc9-0697-4ca0-a968-c982723b2155] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:19.844318 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=42 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:31:19.857521 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c39f5970-9f3d-4d49-90ec-b2ab1f675e0f tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:19.868913 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c39f5970-9f3d-4d49-90ec-b2ab1f675e0f tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:19.870612 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c39f5970-9f3d-4d49-90ec-b2ab1f675e0f tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:19.871605 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c39f5970-9f3d-4d49-90ec-b2ab1f675e0f tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:19.874154 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c39f5970-9f3d-4d49-90ec-b2ab1f675e0f tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:19.877961 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c39f5970-9f3d-4d49-90ec-b2ab1f675e0f tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:19.978259 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c41dfe3d-86e1-4fc5-90fe-a6832e8b04d0 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:19.991537 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c41dfe3d-86e1-4fc5-90fe-a6832e8b04d0 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1670 microversion: 2.1 time: 0.409568 Oct 19 03:31:19.996104 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2118/4149] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:31:19 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1670 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:31:20.029151 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-84c29a5d-0bec-42b6-a04e-9454640754bb tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:31:20.035248 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-84c29a5d-0bec-42b6-a04e-9454640754bb tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:20.047191 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-84c29a5d-0bec-42b6-a04e-9454640754bb tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:20.047734 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-84c29a5d-0bec-42b6-a04e-9454640754bb tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:20.047957 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-84c29a5d-0bec-42b6-a04e-9454640754bb tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:20.048738 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-84c29a5d-0bec-42b6-a04e-9454640754bb tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:20.049339 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-84c29a5d-0bec-42b6-a04e-9454640754bb tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:20.057909 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-84c29a5d-0bec-42b6-a04e-9454640754bb tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:20.074094 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c39f5970-9f3d-4d49-90ec-b2ab1f675e0f tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:20.089097 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c39f5970-9f3d-4d49-90ec-b2ab1f675e0f tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:20.094591 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c39f5970-9f3d-4d49-90ec-b2ab1f675e0f tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:20.097295 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c39f5970-9f3d-4d49-90ec-b2ab1f675e0f tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] 10.222.0.52 "GET /compute/v2.1/servers/41c45cc9-0697-4ca0-a968-c982723b2155" status: 200 len: 1329 microversion: 2.54 time: 0.265596 Oct 19 03:31:20.098243 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2032/4150] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:31:19 2022] GET /compute/v2.1/servers/41c45cc9-0697-4ca0-a968-c982723b2155 => generated 1329 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:31:20.161236 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-84c29a5d-0bec-42b6-a04e-9454640754bb tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "POST /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f/action" status: 200 len: 322 microversion: 2.1 time: 0.136203 Oct 19 03:31:20.163244 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2119/4151] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:31:20 2022] POST /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f/action => generated 322 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:31:20.178298 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-242b1fc4-6db5-4237-9742-895de3b630c7 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:20.181983 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-242b1fc4-6db5-4237-9742-895de3b630c7 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:20.193011 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-242b1fc4-6db5-4237-9742-895de3b630c7 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:20.194000 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-242b1fc4-6db5-4237-9742-895de3b630c7 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:20.194882 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-242b1fc4-6db5-4237-9742-895de3b630c7 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:20.198377 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-242b1fc4-6db5-4237-9742-895de3b630c7 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:20.198482 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-242b1fc4-6db5-4237-9742-895de3b630c7 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:20.198921 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-242b1fc4-6db5-4237-9742-895de3b630c7 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:20.387285 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-242b1fc4-6db5-4237-9742-895de3b630c7 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:20.396751 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-242b1fc4-6db5-4237-9742-895de3b630c7 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1670 microversion: 2.1 time: 0.225205 Oct 19 03:31:20.425553 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2033/4152] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:31:20 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1670 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:31:20.425961 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4c8a4630-d71f-444f-9bf2-a215b23f8916 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:20.426684 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4c8a4630-d71f-444f-9bf2-a215b23f8916 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:20.437063 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4c8a4630-d71f-444f-9bf2-a215b23f8916 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:20.437595 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4c8a4630-d71f-444f-9bf2-a215b23f8916 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:20.438042 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4c8a4630-d71f-444f-9bf2-a215b23f8916 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:20.438971 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4c8a4630-d71f-444f-9bf2-a215b23f8916 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:20.439602 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4c8a4630-d71f-444f-9bf2-a215b23f8916 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:20.440201 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4c8a4630-d71f-444f-9bf2-a215b23f8916 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:20.612169 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-68cf1035-0d7e-44dc-92fa-11f698a6713d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:20.613595 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-68cf1035-0d7e-44dc-92fa-11f698a6713d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 5cc2003b-73ef-4a54-a22d-9cef47c6ed3f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:20.623157 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4c8a4630-d71f-444f-9bf2-a215b23f8916 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:20.625514 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-68cf1035-0d7e-44dc-92fa-11f698a6713d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:20.627226 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-68cf1035-0d7e-44dc-92fa-11f698a6713d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:20.629060 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-68cf1035-0d7e-44dc-92fa-11f698a6713d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:20.630065 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-68cf1035-0d7e-44dc-92fa-11f698a6713d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:20.632190 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-68cf1035-0d7e-44dc-92fa-11f698a6713d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:20.633686 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-68cf1035-0d7e-44dc-92fa-11f698a6713d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:20.645794 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4c8a4630-d71f-444f-9bf2-a215b23f8916 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1670 microversion: 2.1 time: 0.225560 Oct 19 03:31:20.657556 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2120/4153] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:31:20 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1670 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:31:20.674978 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-01d22dbb-8b0c-4509-b954-800d1e133c39 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:20.675616 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-01d22dbb-8b0c-4509-b954-800d1e133c39 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:20.682560 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-01d22dbb-8b0c-4509-b954-800d1e133c39 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:20.683060 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-01d22dbb-8b0c-4509-b954-800d1e133c39 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:20.683577 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-01d22dbb-8b0c-4509-b954-800d1e133c39 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:20.684268 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-01d22dbb-8b0c-4509-b954-800d1e133c39 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:20.685288 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-01d22dbb-8b0c-4509-b954-800d1e133c39 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:20.685288 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-01d22dbb-8b0c-4509-b954-800d1e133c39 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:20.937535 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-68cf1035-0d7e-44dc-92fa-11f698a6713d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:20.950075 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-68cf1035-0d7e-44dc-92fa-11f698a6713d tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f" status: 200 len: 1667 microversion: 2.1 time: 0.346116 Oct 19 03:31:20.965960 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2034/4154] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:31:20 2022] GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f => generated 1667 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:31:21.051105 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-01d22dbb-8b0c-4509-b954-800d1e133c39 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:21.060115 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-01d22dbb-8b0c-4509-b954-800d1e133c39 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1670 microversion: 2.1 time: 0.389682 Oct 19 03:31:21.077430 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2121/4155] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:31:20 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1670 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:31:21.084534 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b7c5677b-d4e9-4635-973e-b610f855c902 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:21.096053 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b7c5677b-d4e9-4635-973e-b610f855c902 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:21.096053 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b7c5677b-d4e9-4635-973e-b610f855c902 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:21.096053 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b7c5677b-d4e9-4635-973e-b610f855c902 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:21.096053 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b7c5677b-d4e9-4635-973e-b610f855c902 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:21.096484 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b7c5677b-d4e9-4635-973e-b610f855c902 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:21.096484 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b7c5677b-d4e9-4635-973e-b610f855c902 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:21.096484 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b7c5677b-d4e9-4635-973e-b610f855c902 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:21.125715 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-eaa2fcc4-61b0-4053-941f-c1356bdc98d4 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:21.126235 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-eaa2fcc4-61b0-4053-941f-c1356bdc98d4 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] [instance: 41c45cc9-0697-4ca0-a968-c982723b2155] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:21.133035 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-eaa2fcc4-61b0-4053-941f-c1356bdc98d4 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:21.134617 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-eaa2fcc4-61b0-4053-941f-c1356bdc98d4 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:21.135183 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-eaa2fcc4-61b0-4053-941f-c1356bdc98d4 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:21.136615 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-eaa2fcc4-61b0-4053-941f-c1356bdc98d4 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:21.137813 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-eaa2fcc4-61b0-4053-941f-c1356bdc98d4 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:21.138673 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-eaa2fcc4-61b0-4053-941f-c1356bdc98d4 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:21.285578 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-eaa2fcc4-61b0-4053-941f-c1356bdc98d4 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:21.298908 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-eaa2fcc4-61b0-4053-941f-c1356bdc98d4 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:21.300973 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-eaa2fcc4-61b0-4053-941f-c1356bdc98d4 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:21.303472 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-eaa2fcc4-61b0-4053-941f-c1356bdc98d4 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] 10.222.0.52 "GET /compute/v2.1/servers/41c45cc9-0697-4ca0-a968-c982723b2155" status: 200 len: 1347 microversion: 2.54 time: 0.182480 Oct 19 03:31:21.304593 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2122/4156] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:31:21 2022] GET /compute/v2.1/servers/41c45cc9-0697-4ca0-a968-c982723b2155 => generated 1347 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:31:21.378701 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b7c5677b-d4e9-4635-973e-b610f855c902 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:21.387565 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b7c5677b-d4e9-4635-973e-b610f855c902 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1670 microversion: 2.1 time: 0.306320 Oct 19 03:31:21.388683 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2035/4157] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:31:21 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1670 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:31:21.547478 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-39a6f96d-74a1-480c-85e2-de587c811c25 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-405484879", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "networks": [{"uuid": "6b668808-7c3c-40ac-9532-ec2c53b84149"}]}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:31:21.612778 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.network.neutron [None req-39a6f96d-74a1-480c-85e2-de587c811c25 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] validate_networks() for [('6b668808-7c3c-40ac-9532-ec2c53b84149', None, None, None, None, None)] {{(pid=121135) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:31:21.977095 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9f637574-354e-4b70-9cae-de26152bf2dc tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:21.978529 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9f637574-354e-4b70-9cae-de26152bf2dc tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 5cc2003b-73ef-4a54-a22d-9cef47c6ed3f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:21.991813 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9f637574-354e-4b70-9cae-de26152bf2dc tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:21.993068 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9f637574-354e-4b70-9cae-de26152bf2dc tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:21.994399 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9f637574-354e-4b70-9cae-de26152bf2dc tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:21.996348 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9f637574-354e-4b70-9cae-de26152bf2dc tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:21.997009 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9f637574-354e-4b70-9cae-de26152bf2dc tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:22.007237 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9f637574-354e-4b70-9cae-de26152bf2dc tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:22.668950 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9f637574-354e-4b70-9cae-de26152bf2dc tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:22.668950 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9f637574-354e-4b70-9cae-de26152bf2dc tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f" status: 200 len: 1667 microversion: 2.1 time: 0.489912 Oct 19 03:31:22.668950 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2036/4158] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:31:21 2022] GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f => generated 1667 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:31:22.668950 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-db6f6d1c-f591-40c2-972d-b0b4c83114f5 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:22.671317 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-db6f6d1c-f591-40c2-972d-b0b4c83114f5 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] [instance: 41c45cc9-0697-4ca0-a968-c982723b2155] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:22.671317 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-db6f6d1c-f591-40c2-972d-b0b4c83114f5 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:22.671317 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-db6f6d1c-f591-40c2-972d-b0b4c83114f5 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:22.671317 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-db6f6d1c-f591-40c2-972d-b0b4c83114f5 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:22.671838 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-db6f6d1c-f591-40c2-972d-b0b4c83114f5 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:22.671838 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-db6f6d1c-f591-40c2-972d-b0b4c83114f5 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:22.671838 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-db6f6d1c-f591-40c2-972d-b0b4c83114f5 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:22.983404 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-db6f6d1c-f591-40c2-972d-b0b4c83114f5 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:22.997001 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-db6f6d1c-f591-40c2-972d-b0b4c83114f5 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:23.000352 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-db6f6d1c-f591-40c2-972d-b0b4c83114f5 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:23.001704 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-db6f6d1c-f591-40c2-972d-b0b4c83114f5 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] 10.222.0.52 "GET /compute/v2.1/servers/41c45cc9-0697-4ca0-a968-c982723b2155" status: 200 len: 1335 microversion: 2.54 time: 0.535757 Oct 19 03:31:23.006216 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2037/4159] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:31:22 2022] GET /compute/v2.1/servers/41c45cc9-0697-4ca0-a968-c982723b2155 => generated 1335 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:31:23.093464 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-39a6f96d-74a1-480c-85e2-de587c811c25 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Flavor limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:31:23.093925 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-39a6f96d-74a1-480c-85e2-de587c811c25 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Image limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:31:23.094477 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-39a6f96d-74a1-480c-85e2-de587c811c25 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Flavor pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:31:23.094902 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-39a6f96d-74a1-480c-85e2-de587c811c25 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Image pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:31:23.095321 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-39a6f96d-74a1-480c-85e2-de587c811c25 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:31:23.111392 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-39a6f96d-74a1-480c-85e2-de587c811c25 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:23.111886 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-39a6f96d-74a1-480c-85e2-de587c811c25 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:23.112342 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-39a6f96d-74a1-480c-85e2-de587c811c25 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:23.113083 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-39a6f96d-74a1-480c-85e2-de587c811c25 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:23.115909 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-39a6f96d-74a1-480c-85e2-de587c811c25 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:23.116393 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-39a6f96d-74a1-480c-85e2-de587c811c25 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:23.134639 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:31:23.149933 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-39a6f96d-74a1-480c-85e2-de587c811c25 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Getting quotas for project a5f56376721941f8ae2293f8f969db84. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:31:23.156811 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-39a6f96d-74a1-480c-85e2-de587c811c25 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Getting quotas for user 746e1034a7ee40c1a69c8838c1e17e16 and project a5f56376721941f8ae2293f8f969db84. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:31:23.179468 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-39a6f96d-74a1-480c-85e2-de587c811c25 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Going to run 1 instances... {{(pid=121135) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:31:23.184565 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-39a6f96d-74a1-480c-85e2-de587c811c25 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 4b805c13-68bb-4794-87b6-a63598253193] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121135) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:31:23.347327 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-39a6f96d-74a1-480c-85e2-de587c811c25 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.807348 Oct 19 03:31:23.354987 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2123/4160] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:31:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1816 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 03:31:23.360643 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-875e8d08-0323-4c5f-838c-48a155dd50e0 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:23.361274 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-875e8d08-0323-4c5f-838c-48a155dd50e0 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 4b805c13-68bb-4794-87b6-a63598253193] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:23.471248 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-875e8d08-0323-4c5f-838c-48a155dd50e0 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:23.478570 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-875e8d08-0323-4c5f-838c-48a155dd50e0 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/4b805c13-68bb-4794-87b6-a63598253193" status: 200 len: 1214 microversion: 2.1 time: 0.122171 Oct 19 03:31:23.480046 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2038/4161] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:31:23 2022] GET /compute/v2.1/servers/4b805c13-68bb-4794-87b6-a63598253193 => generated 1214 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:31:23.503310 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-dc5d2843-814c-4088-9d78-0527977e4752 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:23.503938 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-dc5d2843-814c-4088-9d78-0527977e4752 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 5cc2003b-73ef-4a54-a22d-9cef47c6ed3f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:23.526868 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dc5d2843-814c-4088-9d78-0527977e4752 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:23.527506 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dc5d2843-814c-4088-9d78-0527977e4752 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:23.527797 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dc5d2843-814c-4088-9d78-0527977e4752 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:23.531192 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dc5d2843-814c-4088-9d78-0527977e4752 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:23.532652 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dc5d2843-814c-4088-9d78-0527977e4752 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:23.533613 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dc5d2843-814c-4088-9d78-0527977e4752 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:23.728988 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-dc5d2843-814c-4088-9d78-0527977e4752 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:23.740401 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-dc5d2843-814c-4088-9d78-0527977e4752 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f" status: 200 len: 1667 microversion: 2.1 time: 0.240570 Oct 19 03:31:23.741500 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2124/4162] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:31:23 2022] GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f => generated 1667 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:31:24.032627 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-85405a7a-da6c-4a6a-96ba-e81c799fddff tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:24.033250 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-85405a7a-da6c-4a6a-96ba-e81c799fddff tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] [instance: 41c45cc9-0697-4ca0-a968-c982723b2155] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:24.043264 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-85405a7a-da6c-4a6a-96ba-e81c799fddff tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:24.043766 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-85405a7a-da6c-4a6a-96ba-e81c799fddff tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:24.044217 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-85405a7a-da6c-4a6a-96ba-e81c799fddff tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:24.045011 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-85405a7a-da6c-4a6a-96ba-e81c799fddff tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:24.045701 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-85405a7a-da6c-4a6a-96ba-e81c799fddff tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:24.046332 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-85405a7a-da6c-4a6a-96ba-e81c799fddff tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:24.173273 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-85405a7a-da6c-4a6a-96ba-e81c799fddff tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:24.187213 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-85405a7a-da6c-4a6a-96ba-e81c799fddff tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:24.192723 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-85405a7a-da6c-4a6a-96ba-e81c799fddff tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:24.193938 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-85405a7a-da6c-4a6a-96ba-e81c799fddff tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] 10.222.0.52 "GET /compute/v2.1/servers/41c45cc9-0697-4ca0-a968-c982723b2155" status: 200 len: 1335 microversion: 2.54 time: 0.165251 Oct 19 03:31:24.197100 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2039/4163] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:31:24 2022] GET /compute/v2.1/servers/41c45cc9-0697-4ca0-a968-c982723b2155 => generated 1335 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:31:24.509149 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9afcf82e-c136-4f2f-86ea-25001502428f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:24.509843 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9afcf82e-c136-4f2f-86ea-25001502428f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 4b805c13-68bb-4794-87b6-a63598253193] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:24.517040 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:31:24.519280 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9afcf82e-c136-4f2f-86ea-25001502428f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:24.519787 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9afcf82e-c136-4f2f-86ea-25001502428f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:24.520234 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9afcf82e-c136-4f2f-86ea-25001502428f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:24.520958 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9afcf82e-c136-4f2f-86ea-25001502428f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:24.521447 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9afcf82e-c136-4f2f-86ea-25001502428f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:24.521879 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9afcf82e-c136-4f2f-86ea-25001502428f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:24.602140 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-9afcf82e-c136-4f2f-86ea-25001502428f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:24.643578 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9afcf82e-c136-4f2f-86ea-25001502428f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/4b805c13-68bb-4794-87b6-a63598253193" status: 200 len: 1218 microversion: 2.1 time: 0.133386 Oct 19 03:31:24.645673 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2125/4164] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:31:24 2022] GET /compute/v2.1/servers/4b805c13-68bb-4794-87b6-a63598253193 => generated 1218 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:31:24.768794 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-12c133ef-d531-4e39-a013-5ee3e19c5153 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:24.770149 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-12c133ef-d531-4e39-a013-5ee3e19c5153 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 5cc2003b-73ef-4a54-a22d-9cef47c6ed3f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:24.782009 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-12c133ef-d531-4e39-a013-5ee3e19c5153 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:24.784296 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-12c133ef-d531-4e39-a013-5ee3e19c5153 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:24.785961 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-12c133ef-d531-4e39-a013-5ee3e19c5153 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:24.786788 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-12c133ef-d531-4e39-a013-5ee3e19c5153 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:24.789946 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-12c133ef-d531-4e39-a013-5ee3e19c5153 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:24.790523 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-12c133ef-d531-4e39-a013-5ee3e19c5153 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:24.924963 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-12c133ef-d531-4e39-a013-5ee3e19c5153 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:24.959850 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-12c133ef-d531-4e39-a013-5ee3e19c5153 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f" status: 200 len: 1599 microversion: 2.1 time: 0.191982 Oct 19 03:31:24.960698 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2040/4165] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:31:24 2022] GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f => generated 1599 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:31:25.241248 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2cb298a7-1987-46cc-a758-ebaa1da15520 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:25.250149 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-2cb298a7-1987-46cc-a758-ebaa1da15520 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] [instance: 41c45cc9-0697-4ca0-a968-c982723b2155] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:25.260975 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2cb298a7-1987-46cc-a758-ebaa1da15520 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:25.281804 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2cb298a7-1987-46cc-a758-ebaa1da15520 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:25.282361 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2cb298a7-1987-46cc-a758-ebaa1da15520 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:25.283128 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2cb298a7-1987-46cc-a758-ebaa1da15520 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:25.283603 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2cb298a7-1987-46cc-a758-ebaa1da15520 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:25.284101 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2cb298a7-1987-46cc-a758-ebaa1da15520 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:25.446661 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-2cb298a7-1987-46cc-a758-ebaa1da15520 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:25.459259 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-2cb298a7-1987-46cc-a758-ebaa1da15520 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:25.460717 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-2cb298a7-1987-46cc-a758-ebaa1da15520 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:25.461937 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2cb298a7-1987-46cc-a758-ebaa1da15520 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] 10.222.0.52 "GET /compute/v2.1/servers/41c45cc9-0697-4ca0-a968-c982723b2155" status: 200 len: 1335 microversion: 2.54 time: 0.233605 Oct 19 03:31:25.473964 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2126/4166] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:31:25 2022] GET /compute/v2.1/servers/41c45cc9-0697-4ca0-a968-c982723b2155 => generated 1335 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:31:25.602519 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-6351a886-167a-410d-b340-a0d6fb01fda1 req-00c629dd-ac34-4cda-9fe1-e7b07c582c45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cc2003b-73ef-4a54-a22d-9cef47c6ed3f", "name": "network-vif-deleted", "tag": "6c518d82-939f-43bb-ab5f-244d4b674bfe"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:31:25.625723 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-6351a886-167a-410d-b340-a0d6fb01fda1 req-00c629dd-ac34-4cda-9fe1-e7b07c582c45 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:25.626213 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-6351a886-167a-410d-b340-a0d6fb01fda1 req-00c629dd-ac34-4cda-9fe1-e7b07c582c45 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:25.626705 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-6351a886-167a-410d-b340-a0d6fb01fda1 req-00c629dd-ac34-4cda-9fe1-e7b07c582c45 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:25.653751 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-6351a886-167a-410d-b340-a0d6fb01fda1 req-00c629dd-ac34-4cda-9fe1-e7b07c582c45 service nova] Creating event network-vif-deleted:6c518d82-939f-43bb-ab5f-244d4b674bfe for instance 5cc2003b-73ef-4a54-a22d-9cef47c6ed3f on n-h1-861333-8 Oct 19 03:31:25.667126 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3ad436ee-4b9d-4aaa-b02c-c5352ca86d14 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:25.667821 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-3ad436ee-4b9d-4aaa-b02c-c5352ca86d14 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 4b805c13-68bb-4794-87b6-a63598253193] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:25.685184 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3ad436ee-4b9d-4aaa-b02c-c5352ca86d14 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:25.685716 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3ad436ee-4b9d-4aaa-b02c-c5352ca86d14 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:25.686218 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3ad436ee-4b9d-4aaa-b02c-c5352ca86d14 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:25.686933 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3ad436ee-4b9d-4aaa-b02c-c5352ca86d14 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:25.687389 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3ad436ee-4b9d-4aaa-b02c-c5352ca86d14 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:25.687966 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3ad436ee-4b9d-4aaa-b02c-c5352ca86d14 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:25.692392 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-6351a886-167a-410d-b340-a0d6fb01fda1 req-00c629dd-ac34-4cda-9fe1-e7b07c582c45 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093733 Oct 19 03:31:25.693409 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2041/4167] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:31:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:31:25.913016 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-3ad436ee-4b9d-4aaa-b02c-c5352ca86d14 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:25.924745 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-3ad436ee-4b9d-4aaa-b02c-c5352ca86d14 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/4b805c13-68bb-4794-87b6-a63598253193" status: 200 len: 1266 microversion: 2.1 time: 0.259333 Oct 19 03:31:25.925837 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2127/4168] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:31:25 2022] GET /compute/v2.1/servers/4b805c13-68bb-4794-87b6-a63598253193 => generated 1266 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:31:26.000591 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-47833bb7-cfe0-43b0-9bbd-0eda65da2946 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:26.003358 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-47833bb7-cfe0-43b0-9bbd-0eda65da2946 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 5cc2003b-73ef-4a54-a22d-9cef47c6ed3f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:26.016365 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-47833bb7-cfe0-43b0-9bbd-0eda65da2946 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:26.017120 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-47833bb7-cfe0-43b0-9bbd-0eda65da2946 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:26.023137 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-47833bb7-cfe0-43b0-9bbd-0eda65da2946 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:26.023137 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-47833bb7-cfe0-43b0-9bbd-0eda65da2946 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:26.023137 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-47833bb7-cfe0-43b0-9bbd-0eda65da2946 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:26.023137 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-47833bb7-cfe0-43b0-9bbd-0eda65da2946 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:26.194314 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-47833bb7-cfe0-43b0-9bbd-0eda65da2946 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:26.211137 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-47833bb7-cfe0-43b0-9bbd-0eda65da2946 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f" status: 200 len: 1319 microversion: 2.1 time: 0.218299 Oct 19 03:31:26.212082 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2042/4169] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:31:25 2022] GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f => generated 1319 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:31:26.488355 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-cbc6e9a5-92ed-4924-8210-b99d026e1b76 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:26.489428 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-cbc6e9a5-92ed-4924-8210-b99d026e1b76 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] [instance: 41c45cc9-0697-4ca0-a968-c982723b2155] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:26.498113 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cbc6e9a5-92ed-4924-8210-b99d026e1b76 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:26.498843 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cbc6e9a5-92ed-4924-8210-b99d026e1b76 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:26.503688 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cbc6e9a5-92ed-4924-8210-b99d026e1b76 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:26.503688 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cbc6e9a5-92ed-4924-8210-b99d026e1b76 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:26.503688 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cbc6e9a5-92ed-4924-8210-b99d026e1b76 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:26.503688 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cbc6e9a5-92ed-4924-8210-b99d026e1b76 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:26.694059 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-cbc6e9a5-92ed-4924-8210-b99d026e1b76 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:26.706183 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-cbc6e9a5-92ed-4924-8210-b99d026e1b76 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:26.708140 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-cbc6e9a5-92ed-4924-8210-b99d026e1b76 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:26.709650 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-cbc6e9a5-92ed-4924-8210-b99d026e1b76 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] 10.222.0.52 "GET /compute/v2.1/servers/41c45cc9-0697-4ca0-a968-c982723b2155" status: 200 len: 1356 microversion: 2.54 time: 0.225399 Oct 19 03:31:26.711302 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2128/4170] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:31:26 2022] GET /compute/v2.1/servers/41c45cc9-0697-4ca0-a968-c982723b2155 => generated 1356 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:31:26.741730 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-23f56c56-f90e-4428-9eae-bd91569116c2 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Action: 'create', calling method: .version_select at 0x7fc13003c550>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-604637818", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIFBrYUs+w3pnySPctvkOuzW2dFoWFPQ8LaNYfBtvOdhm9pc3ZdyYXJjoSgpdsHW/tiZ0evhb1ZevhL/a11rAx2tLGLuHURyvTIymBl7PJOGffmEO+7MoVs18WfKvBr4dA=="}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:31:26.762805 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-23f56c56-f90e-4428-9eae-bd91569116c2 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Getting quotas for project 04fa10fa4a4a4726b3a2c5b373876650. Resources: {'key_pairs'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:31:26.769756 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-23f56c56-f90e-4428-9eae-bd91569116c2 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Getting quotas for user 3a66063e37d640108cf1c500368ba9b6 and project 04fa10fa4a4a4726b3a2c5b373876650. Resources: {'key_pairs'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:31:26.908564 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-23f56c56-f90e-4428-9eae-bd91569116c2 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 419 microversion: 2.54 time: 0.170572 Oct 19 03:31:26.909919 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2043/4171] 10.222.0.52 () {62 vars in 1200 bytes} [Wed Oct 19 03:31:26 2022] POST /compute/v2.1/os-keypairs => generated 419 bytes in 174 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 19 03:31:26.925144 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c202fcce-3005-4e39-b470-6fd73f12424a tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-604637818", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:31:26.928345 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c202fcce-3005-4e39-b470-6fd73f12424a tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] [instance: 41c45cc9-0697-4ca0-a968-c982723b2155] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:26.935391 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c202fcce-3005-4e39-b470-6fd73f12424a tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:26.936084 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c202fcce-3005-4e39-b470-6fd73f12424a tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:26.936665 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c202fcce-3005-4e39-b470-6fd73f12424a tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:26.937911 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c202fcce-3005-4e39-b470-6fd73f12424a tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:26.938499 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c202fcce-3005-4e39-b470-6fd73f12424a tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:26.939086 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c202fcce-3005-4e39-b470-6fd73f12424a tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:26.954640 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4b157d65-674a-4f59-9813-cc4aea2915f8 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:26.955631 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4b157d65-674a-4f59-9813-cc4aea2915f8 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 4b805c13-68bb-4794-87b6-a63598253193] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:26.964151 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4b157d65-674a-4f59-9813-cc4aea2915f8 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:26.965163 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4b157d65-674a-4f59-9813-cc4aea2915f8 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:26.966223 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4b157d65-674a-4f59-9813-cc4aea2915f8 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:26.967180 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4b157d65-674a-4f59-9813-cc4aea2915f8 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:26.971887 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4b157d65-674a-4f59-9813-cc4aea2915f8 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:26.972777 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4b157d65-674a-4f59-9813-cc4aea2915f8 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:27.107318 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-c202fcce-3005-4e39-b470-6fd73f12424a tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Flavor limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:31:27.107988 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-c202fcce-3005-4e39-b470-6fd73f12424a tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Image limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:31:27.110454 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-c202fcce-3005-4e39-b470-6fd73f12424a tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Flavor pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:31:27.110454 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-c202fcce-3005-4e39-b470-6fd73f12424a tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Image pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:31:27.110454 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-c202fcce-3005-4e39-b470-6fd73f12424a tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:31:27.486373 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-4b157d65-674a-4f59-9813-cc4aea2915f8 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:27.495695 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4b157d65-674a-4f59-9813-cc4aea2915f8 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/4b805c13-68bb-4794-87b6-a63598253193" status: 200 len: 1284 microversion: 2.1 time: 0.547930 Oct 19 03:31:27.496585 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2044/4172] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:31:26 2022] GET /compute/v2.1/servers/4b805c13-68bb-4794-87b6-a63598253193 => generated 1284 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:31:27.502897 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-255c3538-2f1b-48ce-aabd-1d2534afc731 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:27.503793 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-255c3538-2f1b-48ce-aabd-1d2534afc731 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 5cc2003b-73ef-4a54-a22d-9cef47c6ed3f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:27.510898 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-255c3538-2f1b-48ce-aabd-1d2534afc731 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:27.511663 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-255c3538-2f1b-48ce-aabd-1d2534afc731 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:27.512390 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-255c3538-2f1b-48ce-aabd-1d2534afc731 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:27.513633 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-255c3538-2f1b-48ce-aabd-1d2534afc731 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:27.514299 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-255c3538-2f1b-48ce-aabd-1d2534afc731 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:27.514935 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-255c3538-2f1b-48ce-aabd-1d2534afc731 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:27.532788 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-255c3538-2f1b-48ce-aabd-1d2534afc731 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] HTTP exception thrown: Instance 5cc2003b-73ef-4a54-a22d-9cef47c6ed3f could not be found. Oct 19 03:31:27.534839 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-255c3538-2f1b-48ce-aabd-1d2534afc731 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Request method failure captured: Oct 19 03:31:27.534839 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f HTTP/1.1 Oct 19 03:31:27.534839 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:31:27.534839 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:31:27.534839 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:31:27.534839 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:31:27.534839 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:31:27.534839 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:31:27.534839 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:31:27.534839 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:31:27.534839 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT22uzKvAjuhIgc-DP7sPOfn3b9sZBQU9yYusOMtajXQwK7wG_j3ZDvn7Y9QkhMFz7rVu19UO6F9j-GFIsoZ01og7bGTb8cd2FAk3jP7hKJv7GRFFP9AvHjrS1D9SP93D8kxirVlCFlnWTrKXA6F64crO5KpGWGnmfOnzZxnOfR_1F5Y Oct 19 03:31:27.534839 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:31:27.534839 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:31:27.534839 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:31:27.534839 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:31:27.534839 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:31:27.534839 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:31:27.534839 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 8019441bff8642cebf21fd1c4e890196 Oct 19 03:31:27.534839 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-LiveMigrationTest-1310149028 Oct 19 03:31:27.534839 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:31:27.534839 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:31:27.536109 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8019441bff8642cebf21fd1c4e890196"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8019441bff8642cebf21fd1c4e890196"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8019441bff8642cebf21fd1c4e890196"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8019441bff8642cebf21fd1c4e890196", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:31:27.536109 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-LiveMigrationTest-1310149028 Oct 19 03:31:27.536109 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 8019441bff8642cebf21fd1c4e890196 Oct 19 03:31:27.536109 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-LiveMigrationTest-1310149028 Oct 19 03:31:27.536109 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-LiveMigrationTest-1310149028-project Oct 19 03:31:27.536109 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:31:27.536109 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:31:27.536109 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 2b5b2cb1272541dfbc2659cf4adf9026 Oct 19 03:31:27.536109 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-LiveMigrationTest-1310149028-project Oct 19 03:31:27.536109 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:31:27.536109 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance 5cc2003b-73ef-4a54-a22d-9cef47c6ed3f could not be found. Oct 19 03:31:27.536109 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '5cc2003b-73ef-4a54-a22d-9cef47c6ed3f'} Oct 19 03:31:27.536864 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:31:27.536864 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:31:27.536864 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:31:27.536864 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:31:27.536864 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:31:27.536864 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:31:27.536864 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:31:27.536864 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:31:27.536864 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:31:27.536864 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:31:27.536864 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5cc2003b-73ef-4a54-a22d-9cef47c6ed3f could not be found. Oct 19 03:31:27.536864 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:31:27.536864 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:31:27.536864 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:31:27.536864 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:31:27.536864 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:31:27.536864 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:31:27.536864 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:31:27.536864 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:31:27.536864 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:31:27.538130 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:31:27.538130 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:31:27.538130 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:31:27.538130 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:31:27.538130 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:31:27.538130 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:31:27.538130 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:31:27.538130 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5cc2003b-73ef-4a54-a22d-9cef47c6ed3f could not be found. Oct 19 03:31:27.538130 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:31:27.538130 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:31:27.538130 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:31:27.538130 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:31:27.538130 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:31:27.538130 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:31:27.538130 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:31:27.538130 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:31:27.538130 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5cc2003b-73ef-4a54-a22d-9cef47c6ed3f could not be found. Oct 19 03:31:27.538130 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:31:27.539687 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-255c3538-2f1b-48ce-aabd-1d2534afc731 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Returning 404 to user: Instance 5cc2003b-73ef-4a54-a22d-9cef47c6ed3f could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:31:27.540431 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-255c3538-2f1b-48ce-aabd-1d2534afc731 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f" status: 404 len: 111 microversion: 2.1 time: 0.042680 Oct 19 03:31:27.541946 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2045/4173] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:31:27 2022] GET /compute/v2.1/servers/5cc2003b-73ef-4a54-a22d-9cef47c6ed3f => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:31:27.550053 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6d55876a-eec7-4766-9532-98cc6343d77e tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '.version_select at 0x7fc13003c040>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:27.554014 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c202fcce-3005-4e39-b470-6fd73f12424a tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] [instance: 41c45cc9-0697-4ca0-a968-c982723b2155] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:27.581660 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c202fcce-3005-4e39-b470-6fd73f12424a tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:27.582181 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c202fcce-3005-4e39-b470-6fd73f12424a tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:27.582636 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c202fcce-3005-4e39-b470-6fd73f12424a tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:27.587264 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c202fcce-3005-4e39-b470-6fd73f12424a tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:27.587787 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c202fcce-3005-4e39-b470-6fd73f12424a tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:27.588280 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c202fcce-3005-4e39-b470-6fd73f12424a tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:27.657715 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c202fcce-3005-4e39-b470-6fd73f12424a tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] 10.222.0.52 "POST /compute/v2.1/servers/41c45cc9-0697-4ca0-a968-c982723b2155/action" status: 202 len: 1138 microversion: 2.54 time: 0.739278 Oct 19 03:31:27.661134 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2129/4174] 10.222.0.52 () {62 vars in 1320 bytes} [Wed Oct 19 03:31:26 2022] POST /compute/v2.1/servers/41c45cc9-0697-4ca0-a968-c982723b2155/action => generated 1138 bytes in 743 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 19 03:31:27.687083 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6d55876a-eec7-4766-9532-98cc6343d77e tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-167267698" status: 202 len: 0 microversion: 2.1 time: 0.140671 Oct 19 03:31:27.687184 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-310a254e-a4ae-47b3-b87b-956dfd75efd7 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:27.687559 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2046/4175] 10.222.0.52 () {58 vars in 1218 bytes} [Wed Oct 19 03:31:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-167267698 => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 19 03:31:27.691256 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-310a254e-a4ae-47b3-b87b-956dfd75efd7 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] [instance: 41c45cc9-0697-4ca0-a968-c982723b2155] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:27.709484 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-310a254e-a4ae-47b3-b87b-956dfd75efd7 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:27.712362 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-310a254e-a4ae-47b3-b87b-956dfd75efd7 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:27.714486 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-310a254e-a4ae-47b3-b87b-956dfd75efd7 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:27.715527 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-310a254e-a4ae-47b3-b87b-956dfd75efd7 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:27.716680 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-310a254e-a4ae-47b3-b87b-956dfd75efd7 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:27.717236 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-310a254e-a4ae-47b3-b87b-956dfd75efd7 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:27.999131 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-310a254e-a4ae-47b3-b87b-956dfd75efd7 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:28.011669 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-310a254e-a4ae-47b3-b87b-956dfd75efd7 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:28.017734 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-310a254e-a4ae-47b3-b87b-956dfd75efd7 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:28.022102 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-310a254e-a4ae-47b3-b87b-956dfd75efd7 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] 10.222.0.52 "GET /compute/v2.1/servers/41c45cc9-0697-4ca0-a968-c982723b2155" status: 200 len: 1407 microversion: 2.54 time: 0.341316 Oct 19 03:31:28.037872 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2130/4176] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:31:27 2022] GET /compute/v2.1/servers/41c45cc9-0697-4ca0-a968-c982723b2155 => generated 1407 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:31:28.522131 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9b2b3202-f216-4b93-a4b9-d0f0d90bc327 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:28.522757 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9b2b3202-f216-4b93-a4b9-d0f0d90bc327 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 4b805c13-68bb-4794-87b6-a63598253193] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:28.543006 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9b2b3202-f216-4b93-a4b9-d0f0d90bc327 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:28.543516 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9b2b3202-f216-4b93-a4b9-d0f0d90bc327 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:28.543967 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9b2b3202-f216-4b93-a4b9-d0f0d90bc327 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:28.544699 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9b2b3202-f216-4b93-a4b9-d0f0d90bc327 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:28.545159 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9b2b3202-f216-4b93-a4b9-d0f0d90bc327 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:28.545629 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9b2b3202-f216-4b93-a4b9-d0f0d90bc327 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:28.713733 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9b2b3202-f216-4b93-a4b9-d0f0d90bc327 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:28.730471 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9b2b3202-f216-4b93-a4b9-d0f0d90bc327 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/4b805c13-68bb-4794-87b6-a63598253193" status: 200 len: 1272 microversion: 2.1 time: 0.210186 Oct 19 03:31:28.741942 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2047/4177] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:31:28 2022] GET /compute/v2.1/servers/4b805c13-68bb-4794-87b6-a63598253193 => generated 1272 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:31:29.051502 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d5de77a7-b3e1-4452-9435-6dd63e98d215 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:29.052130 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d5de77a7-b3e1-4452-9435-6dd63e98d215 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] [instance: 41c45cc9-0697-4ca0-a968-c982723b2155] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:29.063925 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d5de77a7-b3e1-4452-9435-6dd63e98d215 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:29.064430 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d5de77a7-b3e1-4452-9435-6dd63e98d215 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:29.064878 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d5de77a7-b3e1-4452-9435-6dd63e98d215 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:29.065621 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d5de77a7-b3e1-4452-9435-6dd63e98d215 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:29.066165 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d5de77a7-b3e1-4452-9435-6dd63e98d215 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:29.066577 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d5de77a7-b3e1-4452-9435-6dd63e98d215 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:29.226524 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d5de77a7-b3e1-4452-9435-6dd63e98d215 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:29.236079 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d5de77a7-b3e1-4452-9435-6dd63e98d215 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:29.254746 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d5de77a7-b3e1-4452-9435-6dd63e98d215 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:29.256523 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d5de77a7-b3e1-4452-9435-6dd63e98d215 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] 10.222.0.52 "GET /compute/v2.1/servers/41c45cc9-0697-4ca0-a968-c982723b2155" status: 200 len: 1407 microversion: 2.54 time: 0.209043 Oct 19 03:31:29.263895 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2131/4178] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:31:29 2022] GET /compute/v2.1/servers/41c45cc9-0697-4ca0-a968-c982723b2155 => generated 1407 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:31:29.474256 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d8d21da0-8e25-4e11-b487-b121368d5b82 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-927715073", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "425dc398-fc2a-401d-81ad-2b7cb01decba"}]}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:31:29.571709 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-d8d21da0-8e25-4e11-b487-b121368d5b82 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] validate_networks() for [('425dc398-fc2a-401d-81ad-2b7cb01decba', None, None, None, None, None)] {{(pid=121134) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:31:29.764394 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d5d18370-14b4-4260-a927-4e067e8c4d74 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:29.765241 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d5d18370-14b4-4260-a927-4e067e8c4d74 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 4b805c13-68bb-4794-87b6-a63598253193] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:29.774705 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d5d18370-14b4-4260-a927-4e067e8c4d74 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:29.775561 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d5d18370-14b4-4260-a927-4e067e8c4d74 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:29.776212 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d5d18370-14b4-4260-a927-4e067e8c4d74 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:29.777312 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d5d18370-14b4-4260-a927-4e067e8c4d74 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:29.778046 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d5d18370-14b4-4260-a927-4e067e8c4d74 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:29.778677 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d5d18370-14b4-4260-a927-4e067e8c4d74 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:30.730091 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d5d18370-14b4-4260-a927-4e067e8c4d74 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:30.759212 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d5d18370-14b4-4260-a927-4e067e8c4d74 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/4b805c13-68bb-4794-87b6-a63598253193" status: 200 len: 1314 microversion: 2.1 time: 0.998294 Oct 19 03:31:30.759212 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2132/4179] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:31:29 2022] GET /compute/v2.1/servers/4b805c13-68bb-4794-87b6-a63598253193 => generated 1314 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:31:30.786368 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3504c5db-3b68-4074-8014-c942749f46af tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:30.787088 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-3504c5db-3b68-4074-8014-c942749f46af tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] [instance: 41c45cc9-0697-4ca0-a968-c982723b2155] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:30.836947 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3504c5db-3b68-4074-8014-c942749f46af tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:30.839994 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3504c5db-3b68-4074-8014-c942749f46af tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:30.840556 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3504c5db-3b68-4074-8014-c942749f46af tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:30.842026 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3504c5db-3b68-4074-8014-c942749f46af tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:30.845093 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3504c5db-3b68-4074-8014-c942749f46af tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:30.848454 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3504c5db-3b68-4074-8014-c942749f46af tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:31.093414 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-3504c5db-3b68-4074-8014-c942749f46af tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:31.104380 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-3504c5db-3b68-4074-8014-c942749f46af tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:31.107148 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-3504c5db-3b68-4074-8014-c942749f46af tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:31.109432 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-3504c5db-3b68-4074-8014-c942749f46af tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] 10.222.0.52 "GET /compute/v2.1/servers/41c45cc9-0697-4ca0-a968-c982723b2155" status: 200 len: 1407 microversion: 2.54 time: 0.351067 Oct 19 03:31:31.110542 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2133/4180] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:31:30 2022] GET /compute/v2.1/servers/41c45cc9-0697-4ca0-a968-c982723b2155 => generated 1407 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:31:31.118730 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-804c9731-fc52-4baa-a2c8-db5df4832522 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:31.120446 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-804c9731-fc52-4baa-a2c8-db5df4832522 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:31.129668 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-804c9731-fc52-4baa-a2c8-db5df4832522 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:31.130411 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-804c9731-fc52-4baa-a2c8-db5df4832522 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:31.133145 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-804c9731-fc52-4baa-a2c8-db5df4832522 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:31.133519 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-804c9731-fc52-4baa-a2c8-db5df4832522 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:31.134858 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-804c9731-fc52-4baa-a2c8-db5df4832522 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:31.136066 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-804c9731-fc52-4baa-a2c8-db5df4832522 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:31.171798 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-804c9731-fc52-4baa-a2c8-db5df4832522 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6] Going to try to terminate instance {{(pid=121135) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:31:31.568996 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-804c9731-fc52-4baa-a2c8-db5df4832522 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "DELETE /compute/v2.1/servers/25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6" status: 204 len: 0 microversion: 2.1 time: 0.455916 Oct 19 03:31:31.571002 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2134/4181] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:31:31 2022] DELETE /compute/v2.1/servers/25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:31:31.586271 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-09bb8c78-4bc8-446c-964b-a6185f7c5ae4 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:31.591497 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-09bb8c78-4bc8-446c-964b-a6185f7c5ae4 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:31.623759 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-09bb8c78-4bc8-446c-964b-a6185f7c5ae4 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:31.623759 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-09bb8c78-4bc8-446c-964b-a6185f7c5ae4 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:31.623759 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-09bb8c78-4bc8-446c-964b-a6185f7c5ae4 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:31.641140 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-09bb8c78-4bc8-446c-964b-a6185f7c5ae4 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:31.641140 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-09bb8c78-4bc8-446c-964b-a6185f7c5ae4 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:31.641140 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-09bb8c78-4bc8-446c-964b-a6185f7c5ae4 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:32.011689 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-d8d21da0-8e25-4e11-b487-b121368d5b82 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Flavor limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:31:32.016212 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-d8d21da0-8e25-4e11-b487-b121368d5b82 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Image limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:31:32.016926 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-d8d21da0-8e25-4e11-b487-b121368d5b82 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Flavor pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:31:32.017593 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-d8d21da0-8e25-4e11-b487-b121368d5b82 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Image pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:31:32.018269 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-d8d21da0-8e25-4e11-b487-b121368d5b82 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:31:32.043585 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d8d21da0-8e25-4e11-b487-b121368d5b82 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:32.046373 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d8d21da0-8e25-4e11-b487-b121368d5b82 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:32.049624 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d8d21da0-8e25-4e11-b487-b121368d5b82 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:32.050833 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d8d21da0-8e25-4e11-b487-b121368d5b82 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:32.051552 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d8d21da0-8e25-4e11-b487-b121368d5b82 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:32.053283 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d8d21da0-8e25-4e11-b487-b121368d5b82 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:32.103174 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-d8d21da0-8e25-4e11-b487-b121368d5b82 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Getting quotas for project b21f8ce48b034df68b5b6361dd252095. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:31:32.117941 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-d8d21da0-8e25-4e11-b487-b121368d5b82 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Getting quotas for user 1f134d05b1e449b48d90579b76fe6b94 and project b21f8ce48b034df68b5b6361dd252095. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:31:32.142602 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d8d21da0-8e25-4e11-b487-b121368d5b82 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Going to run 1 instances... {{(pid=121134) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:31:32.147445 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d8d21da0-8e25-4e11-b487-b121368d5b82 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] [instance: 36412f0c-aebd-4ba7-9818-3164375a86c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:31:32.252376 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-09bb8c78-4bc8-446c-964b-a6185f7c5ae4 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:32.263980 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-09bb8c78-4bc8-446c-964b-a6185f7c5ae4 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6" status: 200 len: 1484 microversion: 2.1 time: 0.686705 Oct 19 03:31:32.264584 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2135/4182] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:31:31 2022] GET /compute/v2.1/servers/25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6 => generated 1484 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:31:32.278126 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6c9c1a00-1dbc-48c6-8de6-e5712fd24af0 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:32.278997 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6c9c1a00-1dbc-48c6-8de6-e5712fd24af0 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 4b805c13-68bb-4794-87b6-a63598253193] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:32.299516 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6c9c1a00-1dbc-48c6-8de6-e5712fd24af0 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:32.300273 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6c9c1a00-1dbc-48c6-8de6-e5712fd24af0 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:32.300869 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6c9c1a00-1dbc-48c6-8de6-e5712fd24af0 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:32.301784 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6c9c1a00-1dbc-48c6-8de6-e5712fd24af0 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:32.302421 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6c9c1a00-1dbc-48c6-8de6-e5712fd24af0 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:32.303006 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6c9c1a00-1dbc-48c6-8de6-e5712fd24af0 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:32.340052 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d8d21da0-8e25-4e11-b487-b121368d5b82 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.141252 Oct 19 03:31:32.340762 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2048/4183] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:31:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 3146 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 03:31:32.365549 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-33df9614-d7d3-4f79-9f8e-47510741bc9b tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:32.366661 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-33df9614-d7d3-4f79-9f8e-47510741bc9b tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] [instance: 41c45cc9-0697-4ca0-a968-c982723b2155] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:32.369872 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:31:32.404657 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-33df9614-d7d3-4f79-9f8e-47510741bc9b tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:32.405226 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-33df9614-d7d3-4f79-9f8e-47510741bc9b tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:32.405707 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-33df9614-d7d3-4f79-9f8e-47510741bc9b tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:32.409940 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-33df9614-d7d3-4f79-9f8e-47510741bc9b tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:32.410460 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-33df9614-d7d3-4f79-9f8e-47510741bc9b tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:32.410917 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-33df9614-d7d3-4f79-9f8e-47510741bc9b tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:32.958678 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-33df9614-d7d3-4f79-9f8e-47510741bc9b tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:32.974681 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-33df9614-d7d3-4f79-9f8e-47510741bc9b tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:32.976140 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-33df9614-d7d3-4f79-9f8e-47510741bc9b tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:32.977326 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-33df9614-d7d3-4f79-9f8e-47510741bc9b tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] 10.222.0.52 "GET /compute/v2.1/servers/41c45cc9-0697-4ca0-a968-c982723b2155" status: 200 len: 1407 microversion: 2.54 time: 0.634874 Oct 19 03:31:32.978079 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2049/4184] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:31:32 2022] GET /compute/v2.1/servers/41c45cc9-0697-4ca0-a968-c982723b2155 => generated 1407 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:31:32.982791 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7645997e-4fc8-44d3-846e-cfe2bd794c13 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:32.983385 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7645997e-4fc8-44d3-846e-cfe2bd794c13 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] [instance: 36412f0c-aebd-4ba7-9818-3164375a86c1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:33.125778 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-7645997e-4fc8-44d3-846e-cfe2bd794c13 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f134d05b1e449b48d90579b76fe6b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21f8ce48b034df68b5b6361dd252095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:33.136957 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=4 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:31:33.138860 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7645997e-4fc8-44d3-846e-cfe2bd794c13 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] 10.222.0.52 "GET /compute/v2.1/servers/36412f0c-aebd-4ba7-9818-3164375a86c1" status: 200 len: 1223 microversion: 2.1 time: 0.158987 Oct 19 03:31:33.155521 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2050/4185] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:31:32 2022] GET /compute/v2.1/servers/36412f0c-aebd-4ba7-9818-3164375a86c1 => generated 1223 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:31:33.167661 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-6c9c1a00-1dbc-48c6-8de6-e5712fd24af0 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:33.173905 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=12 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:31:33.209888 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6c9c1a00-1dbc-48c6-8de6-e5712fd24af0 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/4b805c13-68bb-4794-87b6-a63598253193" status: 200 len: 1314 microversion: 2.1 time: 0.933157 Oct 19 03:31:33.209888 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2136/4186] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:31:32 2022] GET /compute/v2.1/servers/4b805c13-68bb-4794-87b6-a63598253193 => generated 1314 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:31:33.293666 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9ce74ef6-efac-4129-a1ad-2948b675837b tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:33.293666 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9ce74ef6-efac-4129-a1ad-2948b675837b tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:33.302574 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9ce74ef6-efac-4129-a1ad-2948b675837b tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:33.306160 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9ce74ef6-efac-4129-a1ad-2948b675837b tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:33.309786 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9ce74ef6-efac-4129-a1ad-2948b675837b tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:33.310858 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9ce74ef6-efac-4129-a1ad-2948b675837b tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:33.312892 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9ce74ef6-efac-4129-a1ad-2948b675837b tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:33.313562 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9ce74ef6-efac-4129-a1ad-2948b675837b tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:33.451587 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9ce74ef6-efac-4129-a1ad-2948b675837b tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:33.459623 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9ce74ef6-efac-4129-a1ad-2948b675837b tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6" status: 200 len: 1442 microversion: 2.1 time: 0.173511 Oct 19 03:31:33.460605 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2051/4187] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:31:33 2022] GET /compute/v2.1/servers/25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6 => generated 1442 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:31:33.724799 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-f70f359e-d88b-4f69-b89b-4e64b9dc82b0 req-0c1b6487-491a-4d69-a5e7-977aa7f1d211 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6", "name": "network-vif-deleted", "tag": "b1a17f00-f144-4de3-b98d-df60b15d0f90"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:31:33.749165 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-f70f359e-d88b-4f69-b89b-4e64b9dc82b0 req-0c1b6487-491a-4d69-a5e7-977aa7f1d211 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:33.750488 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-f70f359e-d88b-4f69-b89b-4e64b9dc82b0 req-0c1b6487-491a-4d69-a5e7-977aa7f1d211 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:33.751199 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-f70f359e-d88b-4f69-b89b-4e64b9dc82b0 req-0c1b6487-491a-4d69-a5e7-977aa7f1d211 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:33.769862 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-f70f359e-d88b-4f69-b89b-4e64b9dc82b0 req-0c1b6487-491a-4d69-a5e7-977aa7f1d211 service nova] Creating event network-vif-deleted:b1a17f00-f144-4de3-b98d-df60b15d0f90 for instance 25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6 on n-h2-861333-8 Oct 19 03:31:33.776815 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-f70f359e-d88b-4f69-b89b-4e64b9dc82b0 req-0c1b6487-491a-4d69-a5e7-977aa7f1d211 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056486 Oct 19 03:31:33.778680 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2137/4188] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:31:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:31:34.004508 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-927c7e1f-eaa3-4eb0-9e87-b9b63d577d3a tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:34.005317 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-927c7e1f-eaa3-4eb0-9e87-b9b63d577d3a tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] [instance: 41c45cc9-0697-4ca0-a968-c982723b2155] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:34.013810 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-927c7e1f-eaa3-4eb0-9e87-b9b63d577d3a tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:34.014488 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-927c7e1f-eaa3-4eb0-9e87-b9b63d577d3a tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:34.015078 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-927c7e1f-eaa3-4eb0-9e87-b9b63d577d3a tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:34.015949 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-927c7e1f-eaa3-4eb0-9e87-b9b63d577d3a tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:34.016413 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-927c7e1f-eaa3-4eb0-9e87-b9b63d577d3a tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:34.016857 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-927c7e1f-eaa3-4eb0-9e87-b9b63d577d3a tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:34.116036 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-927c7e1f-eaa3-4eb0-9e87-b9b63d577d3a tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:34.137428 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-927c7e1f-eaa3-4eb0-9e87-b9b63d577d3a tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:34.139261 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-fb17f1bf-c1cb-49e1-885c-5492b2585337 req-5ea3eca7-d649-473f-9774-0d6aa49e2c5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b805c13-68bb-4794-87b6-a63598253193", "tag": "d00f612c-68eb-47c5-9dd8-614cf83ec5c6"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:31:34.141508 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-927c7e1f-eaa3-4eb0-9e87-b9b63d577d3a tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:34.149873 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-927c7e1f-eaa3-4eb0-9e87-b9b63d577d3a tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] 10.222.0.52 "GET /compute/v2.1/servers/41c45cc9-0697-4ca0-a968-c982723b2155" status: 200 len: 1407 microversion: 2.54 time: 0.142381 Oct 19 03:31:34.169173 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2052/4189] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:31:33 2022] GET /compute/v2.1/servers/41c45cc9-0697-4ca0-a968-c982723b2155 => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:31:34.172831 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-fb17f1bf-c1cb-49e1-885c-5492b2585337 req-5ea3eca7-d649-473f-9774-0d6aa49e2c5c service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:34.175568 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-fb17f1bf-c1cb-49e1-885c-5492b2585337 req-5ea3eca7-d649-473f-9774-0d6aa49e2c5c service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:34.176182 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-fb17f1bf-c1cb-49e1-885c-5492b2585337 req-5ea3eca7-d649-473f-9774-0d6aa49e2c5c service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:34.190757 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-655e8efd-50fa-4742-b424-fda161240311 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:34.191400 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-655e8efd-50fa-4742-b424-fda161240311 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] [instance: 36412f0c-aebd-4ba7-9818-3164375a86c1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:34.195922 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-fb17f1bf-c1cb-49e1-885c-5492b2585337 req-5ea3eca7-d649-473f-9774-0d6aa49e2c5c service nova] Creating event network-changed:d00f612c-68eb-47c5-9dd8-614cf83ec5c6 for instance 4b805c13-68bb-4794-87b6-a63598253193 on n-h2-861333-8 Oct 19 03:31:34.202692 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-fb17f1bf-c1cb-49e1-885c-5492b2585337 req-5ea3eca7-d649-473f-9774-0d6aa49e2c5c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069974 Oct 19 03:31:34.203818 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2138/4190] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:31:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:31:34.206416 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-655e8efd-50fa-4742-b424-fda161240311 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:34.207015 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-655e8efd-50fa-4742-b424-fda161240311 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:34.207836 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-655e8efd-50fa-4742-b424-fda161240311 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:34.209729 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-655e8efd-50fa-4742-b424-fda161240311 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:34.210886 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-655e8efd-50fa-4742-b424-fda161240311 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:34.214014 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-655e8efd-50fa-4742-b424-fda161240311 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:34.252933 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-24681c96-1526-4bcc-a09f-a00c72890768 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:34.254772 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-24681c96-1526-4bcc-a09f-a00c72890768 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 4b805c13-68bb-4794-87b6-a63598253193] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:34.269570 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-24681c96-1526-4bcc-a09f-a00c72890768 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:34.273044 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-24681c96-1526-4bcc-a09f-a00c72890768 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:34.273884 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-24681c96-1526-4bcc-a09f-a00c72890768 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:34.274611 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-24681c96-1526-4bcc-a09f-a00c72890768 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:34.275095 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-24681c96-1526-4bcc-a09f-a00c72890768 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:34.283562 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-24681c96-1526-4bcc-a09f-a00c72890768 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:34.316078 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=100 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:31:34.457072 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-655e8efd-50fa-4742-b424-fda161240311 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f134d05b1e449b48d90579b76fe6b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21f8ce48b034df68b5b6361dd252095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:34.470251 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-655e8efd-50fa-4742-b424-fda161240311 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] 10.222.0.52 "GET /compute/v2.1/servers/36412f0c-aebd-4ba7-9818-3164375a86c1" status: 200 len: 1227 microversion: 2.1 time: 0.299558 Oct 19 03:31:34.494942 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2053/4191] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:31:34 2022] GET /compute/v2.1/servers/36412f0c-aebd-4ba7-9818-3164375a86c1 => generated 1227 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:31:34.506454 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-fea05276-e081-4a99-a3fe-b767a87070f7 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:34.516792 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-fea05276-e081-4a99-a3fe-b767a87070f7 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:34.539217 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fea05276-e081-4a99-a3fe-b767a87070f7 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:34.562566 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fea05276-e081-4a99-a3fe-b767a87070f7 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:34.564698 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fea05276-e081-4a99-a3fe-b767a87070f7 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:34.567492 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fea05276-e081-4a99-a3fe-b767a87070f7 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:34.568001 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fea05276-e081-4a99-a3fe-b767a87070f7 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:34.568452 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fea05276-e081-4a99-a3fe-b767a87070f7 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:34.661081 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fea05276-e081-4a99-a3fe-b767a87070f7 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:34.661620 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fea05276-e081-4a99-a3fe-b767a87070f7 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:34.664573 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fea05276-e081-4a99-a3fe-b767a87070f7 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:34.665463 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-fea05276-e081-4a99-a3fe-b767a87070f7 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lazy-loading 'fault' on Instance uuid 25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6 {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:31:34.702745 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-24681c96-1526-4bcc-a09f-a00c72890768 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:34.710655 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-24681c96-1526-4bcc-a09f-a00c72890768 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/4b805c13-68bb-4794-87b6-a63598253193" status: 200 len: 1314 microversion: 2.1 time: 0.483340 Oct 19 03:31:34.714313 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2139/4192] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:31:34 2022] GET /compute/v2.1/servers/4b805c13-68bb-4794-87b6-a63598253193 => generated 1314 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:31:34.739336 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-fea05276-e081-4a99-a3fe-b767a87070f7 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:34.749936 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-fea05276-e081-4a99-a3fe-b767a87070f7 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6" status: 200 len: 1301 microversion: 2.1 time: 0.253641 Oct 19 03:31:34.751535 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2054/4193] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:31:34 2022] GET /compute/v2.1/servers/25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6 => generated 1301 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:31:35.177520 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-fcbd8e93-e5bb-4edd-9b73-bdc331c16985 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:35.178155 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-fcbd8e93-e5bb-4edd-9b73-bdc331c16985 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] [instance: 41c45cc9-0697-4ca0-a968-c982723b2155] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:35.203729 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fcbd8e93-e5bb-4edd-9b73-bdc331c16985 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:35.204239 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fcbd8e93-e5bb-4edd-9b73-bdc331c16985 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:35.206342 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fcbd8e93-e5bb-4edd-9b73-bdc331c16985 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:35.207090 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fcbd8e93-e5bb-4edd-9b73-bdc331c16985 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:35.207594 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fcbd8e93-e5bb-4edd-9b73-bdc331c16985 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:35.208040 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fcbd8e93-e5bb-4edd-9b73-bdc331c16985 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:35.415766 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-fcbd8e93-e5bb-4edd-9b73-bdc331c16985 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:35.425808 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-fcbd8e93-e5bb-4edd-9b73-bdc331c16985 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:35.427767 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-fcbd8e93-e5bb-4edd-9b73-bdc331c16985 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:35.429176 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-fcbd8e93-e5bb-4edd-9b73-bdc331c16985 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] 10.222.0.52 "GET /compute/v2.1/servers/41c45cc9-0697-4ca0-a968-c982723b2155" status: 200 len: 1407 microversion: 2.54 time: 0.255512 Oct 19 03:31:35.434880 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2140/4194] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:31:35 2022] GET /compute/v2.1/servers/41c45cc9-0697-4ca0-a968-c982723b2155 => generated 1407 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:31:35.504972 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-33215293-cdb0-42f8-9ef3-826ef585cdf8 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:35.506541 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-33215293-cdb0-42f8-9ef3-826ef585cdf8 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] [instance: 36412f0c-aebd-4ba7-9818-3164375a86c1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:35.516885 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-33215293-cdb0-42f8-9ef3-826ef585cdf8 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:35.517409 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-33215293-cdb0-42f8-9ef3-826ef585cdf8 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:35.517998 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-33215293-cdb0-42f8-9ef3-826ef585cdf8 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:35.519082 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-33215293-cdb0-42f8-9ef3-826ef585cdf8 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:35.519546 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-33215293-cdb0-42f8-9ef3-826ef585cdf8 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:35.520005 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-33215293-cdb0-42f8-9ef3-826ef585cdf8 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:35.647554 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-33215293-cdb0-42f8-9ef3-826ef585cdf8 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f134d05b1e449b48d90579b76fe6b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21f8ce48b034df68b5b6361dd252095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:35.659251 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-33215293-cdb0-42f8-9ef3-826ef585cdf8 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] 10.222.0.52 "GET /compute/v2.1/servers/36412f0c-aebd-4ba7-9818-3164375a86c1" status: 200 len: 1275 microversion: 2.1 time: 0.158721 Oct 19 03:31:35.660526 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2055/4195] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:31:35 2022] GET /compute/v2.1/servers/36412f0c-aebd-4ba7-9818-3164375a86c1 => generated 1275 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:31:35.741292 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ed63ab13-d4ed-4053-a2ec-f3023363c2f3 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:35.742809 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ed63ab13-d4ed-4053-a2ec-f3023363c2f3 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 4b805c13-68bb-4794-87b6-a63598253193] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:35.752464 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ed63ab13-d4ed-4053-a2ec-f3023363c2f3 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:35.753128 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ed63ab13-d4ed-4053-a2ec-f3023363c2f3 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:35.753878 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ed63ab13-d4ed-4053-a2ec-f3023363c2f3 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:35.755219 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ed63ab13-d4ed-4053-a2ec-f3023363c2f3 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:35.755950 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ed63ab13-d4ed-4053-a2ec-f3023363c2f3 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:35.757502 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ed63ab13-d4ed-4053-a2ec-f3023363c2f3 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:35.778357 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ad79e8a2-24e3-4e80-b630-f68923eed5f1 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:35.778992 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ad79e8a2-24e3-4e80-b630-f68923eed5f1 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: 25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:35.786690 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ad79e8a2-24e3-4e80-b630-f68923eed5f1 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:35.787259 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ad79e8a2-24e3-4e80-b630-f68923eed5f1 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:35.787701 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ad79e8a2-24e3-4e80-b630-f68923eed5f1 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:35.788754 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ad79e8a2-24e3-4e80-b630-f68923eed5f1 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:35.789223 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ad79e8a2-24e3-4e80-b630-f68923eed5f1 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:35.789694 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ad79e8a2-24e3-4e80-b630-f68923eed5f1 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:35.808435 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-ad79e8a2-24e3-4e80-b630-f68923eed5f1 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] HTTP exception thrown: Instance 25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6 could not be found. Oct 19 03:31:35.810123 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ad79e8a2-24e3-4e80-b630-f68923eed5f1 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Request method failure captured: Oct 19 03:31:35.810123 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6 HTTP/1.1 Oct 19 03:31:35.810123 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:31:35.810123 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:31:35.810123 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:31:35.810123 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:31:35.810123 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:31:35.810123 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:31:35.810123 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:31:35.810123 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:31:35.810123 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT22uzKvAjuhIgc-DP7sPOfn3b9sZBQU9yYusOMtajXQwK7wG_j3ZDvn7Y9QkhMFz7rVu19UO6F9j-GFIsoZ01og7bGTb8cd2FAk3jP7hKJv7GRFFP9AvHjrS1D9SP93D8kxirVlCFlnWTrKXA6F64crO5KpGWGnmfOnzZxnOfR_1F5Y Oct 19 03:31:35.810123 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:31:35.810123 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:31:35.810123 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:31:35.810123 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:31:35.810123 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:31:35.810123 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:31:35.810123 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 8019441bff8642cebf21fd1c4e890196 Oct 19 03:31:35.810123 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-LiveMigrationTest-1310149028 Oct 19 03:31:35.810123 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:31:35.810123 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:31:35.811402 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8019441bff8642cebf21fd1c4e890196"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8019441bff8642cebf21fd1c4e890196"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8019441bff8642cebf21fd1c4e890196"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8019441bff8642cebf21fd1c4e890196", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:31:35.811402 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-LiveMigrationTest-1310149028 Oct 19 03:31:35.811402 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 8019441bff8642cebf21fd1c4e890196 Oct 19 03:31:35.811402 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-LiveMigrationTest-1310149028 Oct 19 03:31:35.811402 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-LiveMigrationTest-1310149028-project Oct 19 03:31:35.811402 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:31:35.811402 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:31:35.811402 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 2b5b2cb1272541dfbc2659cf4adf9026 Oct 19 03:31:35.811402 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-LiveMigrationTest-1310149028-project Oct 19 03:31:35.811402 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:31:35.811402 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance 25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6 could not be found. Oct 19 03:31:35.811402 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6'} Oct 19 03:31:35.812128 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:31:35.812128 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:31:35.812128 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:31:35.812128 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:31:35.812128 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:31:35.812128 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:31:35.812128 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:31:35.812128 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:31:35.812128 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:31:35.812128 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:31:35.812128 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6 could not be found. Oct 19 03:31:35.812128 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:31:35.812128 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:31:35.812128 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:31:35.812128 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:31:35.812128 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:31:35.812128 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:31:35.812128 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:31:35.812128 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:31:35.812128 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:31:35.813230 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:31:35.813230 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:31:35.813230 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:31:35.813230 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:31:35.813230 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:31:35.813230 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:31:35.813230 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:31:35.813230 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6 could not be found. Oct 19 03:31:35.813230 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:31:35.813230 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:31:35.813230 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:31:35.813230 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:31:35.813230 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:31:35.813230 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:31:35.813230 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:31:35.813230 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:31:35.813230 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6 could not be found. Oct 19 03:31:35.813230 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:31:35.814290 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ad79e8a2-24e3-4e80-b630-f68923eed5f1 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Returning 404 to user: Instance 25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:31:35.814290 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ad79e8a2-24e3-4e80-b630-f68923eed5f1 tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6" status: 404 len: 111 microversion: 2.1 time: 0.039768 Oct 19 03:31:35.815126 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2056/4196] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:31:35 2022] GET /compute/v2.1/servers/25b6b4d6-5ec1-4b46-a12f-a6bea2eab9f6 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 03:31:35.826729 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-abbbac56-12a1-4de8-adf9-ba29b677280f tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:35.827245 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-abbbac56-12a1-4de8-adf9-ba29b677280f tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: fc300547-2017-4a58-8afc-350a262b5450] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:35.833425 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-abbbac56-12a1-4de8-adf9-ba29b677280f tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:35.833927 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-abbbac56-12a1-4de8-adf9-ba29b677280f tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:35.834565 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-abbbac56-12a1-4de8-adf9-ba29b677280f tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:35.835274 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-abbbac56-12a1-4de8-adf9-ba29b677280f tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:35.835740 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-abbbac56-12a1-4de8-adf9-ba29b677280f tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:35.836176 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-abbbac56-12a1-4de8-adf9-ba29b677280f tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:35.867438 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-abbbac56-12a1-4de8-adf9-ba29b677280f tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: fc300547-2017-4a58-8afc-350a262b5450] Going to try to terminate instance {{(pid=121134) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:31:35.934492 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ed63ab13-d4ed-4053-a2ec-f3023363c2f3 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:35.943257 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ed63ab13-d4ed-4053-a2ec-f3023363c2f3 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/4b805c13-68bb-4794-87b6-a63598253193" status: 200 len: 1314 microversion: 2.1 time: 0.206875 Oct 19 03:31:35.944332 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2141/4197] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:31:35 2022] GET /compute/v2.1/servers/4b805c13-68bb-4794-87b6-a63598253193 => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:31:36.247935 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-abbbac56-12a1-4de8-adf9-ba29b677280f tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "DELETE /compute/v2.1/servers/fc300547-2017-4a58-8afc-350a262b5450" status: 204 len: 0 microversion: 2.1 time: 0.424633 Oct 19 03:31:36.249156 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2057/4198] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:31:35 2022] DELETE /compute/v2.1/servers/fc300547-2017-4a58-8afc-350a262b5450 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:31:36.261421 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e5c48d38-baa2-4e79-826a-80b9fbeea53c tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:36.261421 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e5c48d38-baa2-4e79-826a-80b9fbeea53c tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: fc300547-2017-4a58-8afc-350a262b5450] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:36.266869 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e5c48d38-baa2-4e79-826a-80b9fbeea53c tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:36.267528 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e5c48d38-baa2-4e79-826a-80b9fbeea53c tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:36.267981 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e5c48d38-baa2-4e79-826a-80b9fbeea53c tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:36.269310 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e5c48d38-baa2-4e79-826a-80b9fbeea53c tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:36.269986 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e5c48d38-baa2-4e79-826a-80b9fbeea53c tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:36.270586 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e5c48d38-baa2-4e79-826a-80b9fbeea53c tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:36.445649 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-e5c48d38-baa2-4e79-826a-80b9fbeea53c tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:36.454516 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e5c48d38-baa2-4e79-826a-80b9fbeea53c tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/fc300547-2017-4a58-8afc-350a262b5450" status: 200 len: 1499 microversion: 2.1 time: 0.201101 Oct 19 03:31:36.455894 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2142/4199] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:31:36 2022] GET /compute/v2.1/servers/fc300547-2017-4a58-8afc-350a262b5450 => generated 1499 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:31:36.457003 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e7b88889-5c97-4e51-944a-d9066c2cf697 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:36.457843 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e7b88889-5c97-4e51-944a-d9066c2cf697 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] [instance: 41c45cc9-0697-4ca0-a968-c982723b2155] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:36.464503 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e7b88889-5c97-4e51-944a-d9066c2cf697 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:36.465070 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e7b88889-5c97-4e51-944a-d9066c2cf697 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:36.465626 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e7b88889-5c97-4e51-944a-d9066c2cf697 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:36.466558 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e7b88889-5c97-4e51-944a-d9066c2cf697 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:36.467214 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e7b88889-5c97-4e51-944a-d9066c2cf697 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:36.467747 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e7b88889-5c97-4e51-944a-d9066c2cf697 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:36.556493 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e7b88889-5c97-4e51-944a-d9066c2cf697 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:36.565520 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e7b88889-5c97-4e51-944a-d9066c2cf697 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:36.566976 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e7b88889-5c97-4e51-944a-d9066c2cf697 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:36.568148 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e7b88889-5c97-4e51-944a-d9066c2cf697 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] 10.222.0.52 "GET /compute/v2.1/servers/41c45cc9-0697-4ca0-a968-c982723b2155" status: 200 len: 1407 microversion: 2.54 time: 0.115713 Oct 19 03:31:36.568712 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2058/4200] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:31:36 2022] GET /compute/v2.1/servers/41c45cc9-0697-4ca0-a968-c982723b2155 => generated 1407 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:31:36.684449 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2d8e5928-c264-4bdf-91f7-06f56b513ff8 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:36.685041 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2d8e5928-c264-4bdf-91f7-06f56b513ff8 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] [instance: 36412f0c-aebd-4ba7-9818-3164375a86c1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:36.691642 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2d8e5928-c264-4bdf-91f7-06f56b513ff8 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:36.692353 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2d8e5928-c264-4bdf-91f7-06f56b513ff8 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:36.692805 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2d8e5928-c264-4bdf-91f7-06f56b513ff8 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:36.693560 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2d8e5928-c264-4bdf-91f7-06f56b513ff8 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:36.694216 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2d8e5928-c264-4bdf-91f7-06f56b513ff8 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:36.702534 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2d8e5928-c264-4bdf-91f7-06f56b513ff8 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:36.772625 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-2d8e5928-c264-4bdf-91f7-06f56b513ff8 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f134d05b1e449b48d90579b76fe6b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21f8ce48b034df68b5b6361dd252095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:36.782689 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2d8e5928-c264-4bdf-91f7-06f56b513ff8 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] 10.222.0.52 "GET /compute/v2.1/servers/36412f0c-aebd-4ba7-9818-3164375a86c1" status: 200 len: 1281 microversion: 2.1 time: 0.103045 Oct 19 03:31:36.784188 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2059/4201] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:31:36 2022] GET /compute/v2.1/servers/36412f0c-aebd-4ba7-9818-3164375a86c1 => generated 1281 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:31:36.937339 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ad792c4e-c0fc-4210-a1b6-fc0d44e9d47d tempest-MultipleCreateNegativeTestJSON-1150796301 tempest-MultipleCreateNegativeTestJSON-1150796301-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1769655549", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:31:36.940769 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-ad792c4e-c0fc-4210-a1b6-fc0d44e9d47d tempest-MultipleCreateNegativeTestJSON-1150796301 tempest-MultipleCreateNegativeTestJSON-1150796301-project] HTTP exception thrown: min_count must be <= max_count Oct 19 03:31:36.942333 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ad792c4e-c0fc-4210-a1b6-fc0d44e9d47d tempest-MultipleCreateNegativeTestJSON-1150796301 tempest-MultipleCreateNegativeTestJSON-1150796301-project] Request method failure captured: Oct 19 03:31:36.942333 n-d-861333-8 devstack@n-api.service[121135]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 19 03:31:36.942333 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:31:36.942333 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:31:36.942333 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:31:36.942333 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 184 Oct 19 03:31:36.942333 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:31:36.942333 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:31:36.942333 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:31:36.942333 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:31:36.942333 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2-YZLXkvDv9Yyt8aGcn1P_aVqfiBlAJKSOkwdEwvdj-lU48_PLrWCuRXSUc7jbk6P2GU49JqAI4YskAVPBxOhPuoYPe3Y1IuqnVEeLlGZRsN2U95750CSaJxEnlrU568Hlt7_3fWBw2ALvtA3yz0w41R1zD07GUFva6dqAAxewu7qg Oct 19 03:31:36.942333 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:31:36.942333 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:31:36.942333 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:31:36.942333 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:31:36.942333 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:31:36.942333 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:31:36.942333 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 405888e04f9842559a4e846b0bb795fe Oct 19 03:31:36.942333 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1150796301 Oct 19 03:31:36.942333 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:31:36.942333 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:31:36.943599 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/405888e04f9842559a4e846b0bb795fe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/405888e04f9842559a4e846b0bb795fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/405888e04f9842559a4e846b0bb795fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_405888e04f9842559a4e846b0bb795fe", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:31:36.943599 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1150796301 Oct 19 03:31:36.943599 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 405888e04f9842559a4e846b0bb795fe Oct 19 03:31:36.943599 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1150796301 Oct 19 03:31:36.943599 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-MultipleCreateNegativeTestJSON-1150796301-project Oct 19 03:31:36.943599 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:31:36.943599 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:31:36.943599 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 6506362bb62f4dddb02c5bbcffbd055e Oct 19 03:31:36.943599 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1150796301-project Oct 19 03:31:36.943599 n-d-861333-8 devstack@n-api.service[121135]: Oct 19 03:31:36.943599 n-d-861333-8 devstack@n-api.service[121135]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1769655549", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "min_count": 3, "max_count": 2}} Oct 19 03:31:36.944268 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:31:36.944268 n-d-861333-8 devstack@n-api.service[121135]: exception: min_count must be <= max_count Oct 19 03:31:36.944268 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1769655549', 'imageRef': '9e16d73e-70ea-4421-aee3-047d80396c02', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Oct 19 03:31:36.944268 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:31:36.944268 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:31:36.944268 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:31:36.944268 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:31:36.944268 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:31:36.944268 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:31:36.944268 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:31:36.944268 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:31:36.944268 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:31:36.944268 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:31:36.944268 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:31:36.944268 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:31:36.944268 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:31:36.944268 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:31:36.944268 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 19 03:31:36.944268 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Oct 19 03:31:36.955149 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 19 03:31:36.955149 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Oct 19 03:31:36.955149 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:31:36.955149 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:31:36.955149 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:31:36.955149 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:31:36.955149 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:31:36.955149 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:31:36.955149 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:31:36.955149 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:31:36.955149 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Oct 19 03:31:36.955149 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:31:36.955149 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ad792c4e-c0fc-4210-a1b6-fc0d44e9d47d tempest-MultipleCreateNegativeTestJSON-1150796301 tempest-MultipleCreateNegativeTestJSON-1150796301-project] Returning 400 to user: min_count must be <= max_count {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:31:36.955149 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ad792c4e-c0fc-4210-a1b6-fc0d44e9d47d tempest-MultipleCreateNegativeTestJSON-1150796301 tempest-MultipleCreateNegativeTestJSON-1150796301-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.277565 Oct 19 03:31:36.955149 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2143/4202] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:31:36 2022] POST /compute/v2.1/servers => generated 74 bytes in 279 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 19 03:31:36.969597 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ddc1c6af-6212-4a50-8c95-f8af732cf0d9 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:36.970220 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ddc1c6af-6212-4a50-8c95-f8af732cf0d9 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 4b805c13-68bb-4794-87b6-a63598253193] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:36.977914 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ddc1c6af-6212-4a50-8c95-f8af732cf0d9 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:36.978453 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ddc1c6af-6212-4a50-8c95-f8af732cf0d9 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:36.979017 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ddc1c6af-6212-4a50-8c95-f8af732cf0d9 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:36.979726 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ddc1c6af-6212-4a50-8c95-f8af732cf0d9 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:36.980193 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ddc1c6af-6212-4a50-8c95-f8af732cf0d9 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:36.980608 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ddc1c6af-6212-4a50-8c95-f8af732cf0d9 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:37.017856 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-db0d0ba5-2f61-4f6c-bc1a-1de9e655aaac tempest-MultipleCreateNegativeTestJSON-1150796301 tempest-MultipleCreateNegativeTestJSON-1150796301-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1473879707", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "max_count": 0}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:31:37.024452 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-db0d0ba5-2f61-4f6c-bc1a-1de9e655aaac tempest-MultipleCreateNegativeTestJSON-1150796301 tempest-MultipleCreateNegativeTestJSON-1150796301-project] Request method failure captured: Oct 19 03:31:37.024452 n-d-861333-8 devstack@n-api.service[121135]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 19 03:31:37.024452 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:31:37.024452 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:31:37.024452 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:31:37.024452 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 168 Oct 19 03:31:37.024452 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:31:37.024452 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:31:37.024452 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:31:37.024452 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:31:37.024452 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2-YZLXkvDv9Yyt8aGcn1P_aVqfiBlAJKSOkwdEwvdj-lU48_PLrWCuRXSUc7jbk6P2GU49JqAI4YskAVPBxOhPuoYPe3Y1IuqnVEeLlGZRsN2U95750CSaJxEnlrU568Hlt7_3fWBw2ALvtA3yz0w41R1zD07GUFva6dqAAxewu7qg Oct 19 03:31:37.024452 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:31:37.024452 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:31:37.024452 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:31:37.024452 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:31:37.024452 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:31:37.024452 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:31:37.024452 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 405888e04f9842559a4e846b0bb795fe Oct 19 03:31:37.024452 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1150796301 Oct 19 03:31:37.024452 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:31:37.024452 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:31:37.025827 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/405888e04f9842559a4e846b0bb795fe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/405888e04f9842559a4e846b0bb795fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/405888e04f9842559a4e846b0bb795fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_405888e04f9842559a4e846b0bb795fe", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:31:37.025827 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1150796301 Oct 19 03:31:37.025827 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 405888e04f9842559a4e846b0bb795fe Oct 19 03:31:37.025827 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1150796301 Oct 19 03:31:37.025827 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-MultipleCreateNegativeTestJSON-1150796301-project Oct 19 03:31:37.025827 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:31:37.025827 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:31:37.025827 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 6506362bb62f4dddb02c5bbcffbd055e Oct 19 03:31:37.025827 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1150796301-project Oct 19 03:31:37.025827 n-d-861333-8 devstack@n-api.service[121135]: Oct 19 03:31:37.025827 n-d-861333-8 devstack@n-api.service[121135]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1473879707", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "max_count": 0}} Oct 19 03:31:37.026484 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:31:37.026484 n-d-861333-8 devstack@n-api.service[121135]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 19 03:31:37.026484 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1473879707', 'imageRef': '9e16d73e-70ea-4421-aee3-047d80396c02', 'flavorRef': '452', 'max_count': 0}}} Oct 19 03:31:37.026484 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:31:37.026484 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:31:37.026484 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 03:31:37.026484 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 03:31:37.026484 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 03:31:37.026484 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise error Oct 19 03:31:37.026484 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 19 03:31:37.026484 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:31:37.026484 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Oct 19 03:31:37.026484 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 19 03:31:37.026484 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 19 03:31:37.026484 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 19 03:31:37.026484 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 19 03:31:37.026484 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:31:37.026484 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 19 03:31:37.026484 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi 0 Oct 19 03:31:37.026484 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:31:37.026484 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:31:37.026484 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:31:37.026484 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:31:37.027592 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:31:37.027592 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:31:37.027592 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:31:37.027592 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:31:37.027592 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:31:37.027592 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:31:37.027592 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:31:37.027592 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:31:37.027592 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 03:31:37.027592 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 03:31:37.027592 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 03:31:37.027592 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 03:31:37.027592 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 03:31:37.027592 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 03:31:37.027592 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 19 03:31:37.027592 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:31:37.027592 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:31:37.027592 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:31:37.027592 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:31:37.028528 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:31:37.028528 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:31:37.028528 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 03:31:37.028528 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 03:31:37.028528 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 19 03:31:37.028528 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:31:37.028528 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-db0d0ba5-2f61-4f6c-bc1a-1de9e655aaac tempest-MultipleCreateNegativeTestJSON-1150796301 tempest-MultipleCreateNegativeTestJSON-1150796301-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:31:37.032157 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-db0d0ba5-2f61-4f6c-bc1a-1de9e655aaac tempest-MultipleCreateNegativeTestJSON-1150796301 tempest-MultipleCreateNegativeTestJSON-1150796301-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.019950 Oct 19 03:31:37.034347 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2144/4203] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:31:37 2022] POST /compute/v2.1/servers => generated 130 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 19 03:31:37.149950 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-87f5b720-557b-49f3-9363-a3fd8db9be82 tempest-MultipleCreateNegativeTestJSON-1150796301 tempest-MultipleCreateNegativeTestJSON-1150796301-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-503907835", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "max_count": 2.5}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:31:37.154475 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-87f5b720-557b-49f3-9363-a3fd8db9be82 tempest-MultipleCreateNegativeTestJSON-1150796301 tempest-MultipleCreateNegativeTestJSON-1150796301-project] Request method failure captured: Oct 19 03:31:37.154475 n-d-861333-8 devstack@n-api.service[121135]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 19 03:31:37.154475 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:31:37.154475 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:31:37.154475 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:31:37.154475 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 169 Oct 19 03:31:37.154475 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:31:37.154475 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:31:37.154475 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:31:37.154475 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:31:37.154475 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2-YZLXkvDv9Yyt8aGcn1P_aVqfiBlAJKSOkwdEwvdj-lU48_PLrWCuRXSUc7jbk6P2GU49JqAI4YskAVPBxOhPuoYPe3Y1IuqnVEeLlGZRsN2U95750CSaJxEnlrU568Hlt7_3fWBw2ALvtA3yz0w41R1zD07GUFva6dqAAxewu7qg Oct 19 03:31:37.154475 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:31:37.154475 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:31:37.154475 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:31:37.154475 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:31:37.154475 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:31:37.154475 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:31:37.154475 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 405888e04f9842559a4e846b0bb795fe Oct 19 03:31:37.154475 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1150796301 Oct 19 03:31:37.154475 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:31:37.154475 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:31:37.156019 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/405888e04f9842559a4e846b0bb795fe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/405888e04f9842559a4e846b0bb795fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/405888e04f9842559a4e846b0bb795fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_405888e04f9842559a4e846b0bb795fe", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:31:37.156019 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1150796301 Oct 19 03:31:37.156019 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 405888e04f9842559a4e846b0bb795fe Oct 19 03:31:37.156019 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1150796301 Oct 19 03:31:37.156019 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-MultipleCreateNegativeTestJSON-1150796301-project Oct 19 03:31:37.156019 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:31:37.156019 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:31:37.156019 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 6506362bb62f4dddb02c5bbcffbd055e Oct 19 03:31:37.156019 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1150796301-project Oct 19 03:31:37.156019 n-d-861333-8 devstack@n-api.service[121135]: Oct 19 03:31:37.156019 n-d-861333-8 devstack@n-api.service[121135]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-503907835", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "max_count": 2.5}} Oct 19 03:31:37.156566 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:31:37.156566 n-d-861333-8 devstack@n-api.service[121135]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 19 03:31:37.156566 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-503907835', 'imageRef': '9e16d73e-70ea-4421-aee3-047d80396c02', 'flavorRef': '452', 'max_count': 2.5}}} Oct 19 03:31:37.156566 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:31:37.156566 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:31:37.156566 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 03:31:37.156566 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 03:31:37.156566 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 03:31:37.156566 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise error Oct 19 03:31:37.156566 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 19 03:31:37.156566 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:31:37.156566 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Oct 19 03:31:37.156566 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 19 03:31:37.156566 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 19 03:31:37.156566 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 19 03:31:37.156566 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 19 03:31:37.156566 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:31:37.156566 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 19 03:31:37.156566 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi 2.5 Oct 19 03:31:37.156566 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:31:37.156566 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:31:37.156566 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:31:37.156566 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:31:37.157757 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:31:37.157757 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:31:37.157757 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:31:37.157757 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:31:37.157757 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:31:37.157757 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:31:37.157757 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:31:37.157757 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:31:37.157757 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 03:31:37.157757 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 03:31:37.157757 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 03:31:37.157757 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 03:31:37.157757 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 03:31:37.157757 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 03:31:37.157757 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 19 03:31:37.157757 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:31:37.157757 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:31:37.157757 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:31:37.157757 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:31:37.158654 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:31:37.158654 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:31:37.158654 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 03:31:37.158654 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 03:31:37.158654 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 19 03:31:37.158654 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:31:37.160452 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-87f5b720-557b-49f3-9363-a3fd8db9be82 tempest-MultipleCreateNegativeTestJSON-1150796301 tempest-MultipleCreateNegativeTestJSON-1150796301-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:31:37.161591 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-87f5b720-557b-49f3-9363-a3fd8db9be82 tempest-MultipleCreateNegativeTestJSON-1150796301 tempest-MultipleCreateNegativeTestJSON-1150796301-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.016023 Oct 19 03:31:37.162374 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2145/4204] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:31:37 2022] POST /compute/v2.1/servers => generated 139 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 03:31:37.183746 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ddc1c6af-6212-4a50-8c95-f8af732cf0d9 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:37.200949 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ddc1c6af-6212-4a50-8c95-f8af732cf0d9 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/4b805c13-68bb-4794-87b6-a63598253193" status: 200 len: 1314 microversion: 2.1 time: 0.235217 Oct 19 03:31:37.224453 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2060/4205] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:31:36 2022] GET /compute/v2.1/servers/4b805c13-68bb-4794-87b6-a63598253193 => generated 1314 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:31:37.242031 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5c01d22c-2d78-41e4-aac7-7ef838c335dc tempest-MultipleCreateNegativeTestJSON-1150796301 tempest-MultipleCreateNegativeTestJSON-1150796301-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2116674444", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "min_count": 0}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:31:37.247447 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5c01d22c-2d78-41e4-aac7-7ef838c335dc tempest-MultipleCreateNegativeTestJSON-1150796301 tempest-MultipleCreateNegativeTestJSON-1150796301-project] Request method failure captured: Oct 19 03:31:37.247447 n-d-861333-8 devstack@n-api.service[121135]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 19 03:31:37.247447 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:31:37.247447 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:31:37.247447 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:31:37.247447 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 168 Oct 19 03:31:37.247447 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:31:37.247447 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:31:37.247447 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:31:37.247447 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:31:37.247447 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2-YZLXkvDv9Yyt8aGcn1P_aVqfiBlAJKSOkwdEwvdj-lU48_PLrWCuRXSUc7jbk6P2GU49JqAI4YskAVPBxOhPuoYPe3Y1IuqnVEeLlGZRsN2U95750CSaJxEnlrU568Hlt7_3fWBw2ALvtA3yz0w41R1zD07GUFva6dqAAxewu7qg Oct 19 03:31:37.247447 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:31:37.247447 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:31:37.247447 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:31:37.247447 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:31:37.247447 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:31:37.247447 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:31:37.247447 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 405888e04f9842559a4e846b0bb795fe Oct 19 03:31:37.247447 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1150796301 Oct 19 03:31:37.247447 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:31:37.247447 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:31:37.250621 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/405888e04f9842559a4e846b0bb795fe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/405888e04f9842559a4e846b0bb795fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/405888e04f9842559a4e846b0bb795fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_405888e04f9842559a4e846b0bb795fe", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:31:37.250621 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1150796301 Oct 19 03:31:37.250621 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 405888e04f9842559a4e846b0bb795fe Oct 19 03:31:37.250621 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1150796301 Oct 19 03:31:37.250621 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-MultipleCreateNegativeTestJSON-1150796301-project Oct 19 03:31:37.250621 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:31:37.250621 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:31:37.250621 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 6506362bb62f4dddb02c5bbcffbd055e Oct 19 03:31:37.250621 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1150796301-project Oct 19 03:31:37.250621 n-d-861333-8 devstack@n-api.service[121135]: Oct 19 03:31:37.250621 n-d-861333-8 devstack@n-api.service[121135]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2116674444", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "min_count": 0}} Oct 19 03:31:37.251283 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:31:37.251283 n-d-861333-8 devstack@n-api.service[121135]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 19 03:31:37.251283 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-2116674444', 'imageRef': '9e16d73e-70ea-4421-aee3-047d80396c02', 'flavorRef': '452', 'min_count': 0}}} Oct 19 03:31:37.251283 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:31:37.251283 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:31:37.251283 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 03:31:37.251283 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 03:31:37.251283 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 03:31:37.251283 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise error Oct 19 03:31:37.251283 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 19 03:31:37.251283 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:31:37.251283 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Oct 19 03:31:37.251283 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 19 03:31:37.251283 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 19 03:31:37.251283 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 19 03:31:37.251283 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 19 03:31:37.251283 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:31:37.251283 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 19 03:31:37.251283 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi 0 Oct 19 03:31:37.251283 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:31:37.251283 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:31:37.251283 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:31:37.251283 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:31:37.252567 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:31:37.252567 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:31:37.252567 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:31:37.252567 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:31:37.252567 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:31:37.252567 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:31:37.252567 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:31:37.252567 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:31:37.252567 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 03:31:37.252567 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 03:31:37.252567 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 03:31:37.252567 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 03:31:37.252567 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 03:31:37.252567 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 03:31:37.252567 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 19 03:31:37.252567 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:31:37.252567 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:31:37.252567 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:31:37.252567 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:31:37.253598 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:31:37.253598 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:31:37.253598 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 03:31:37.253598 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 03:31:37.253598 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 19 03:31:37.253598 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:31:37.253598 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5c01d22c-2d78-41e4-aac7-7ef838c335dc tempest-MultipleCreateNegativeTestJSON-1150796301 tempest-MultipleCreateNegativeTestJSON-1150796301-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:31:37.253598 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5c01d22c-2d78-41e4-aac7-7ef838c335dc tempest-MultipleCreateNegativeTestJSON-1150796301 tempest-MultipleCreateNegativeTestJSON-1150796301-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.012672 Oct 19 03:31:37.266017 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2146/4206] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:31:37 2022] POST /compute/v2.1/servers => generated 130 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 03:31:37.335047 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-09390ca4-5e20-4df7-8f3e-f393e7602622 tempest-MultipleCreateNegativeTestJSON-1150796301 tempest-MultipleCreateNegativeTestJSON-1150796301-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-129230122", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "min_count": 2.5}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:31:37.341616 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-09390ca4-5e20-4df7-8f3e-f393e7602622 tempest-MultipleCreateNegativeTestJSON-1150796301 tempest-MultipleCreateNegativeTestJSON-1150796301-project] Request method failure captured: Oct 19 03:31:37.341616 n-d-861333-8 devstack@n-api.service[121134]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 19 03:31:37.341616 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:31:37.341616 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:31:37.341616 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:31:37.341616 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 169 Oct 19 03:31:37.341616 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:31:37.341616 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:31:37.341616 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:31:37.341616 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:31:37.341616 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT2-YZLXkvDv9Yyt8aGcn1P_aVqfiBlAJKSOkwdEwvdj-lU48_PLrWCuRXSUc7jbk6P2GU49JqAI4YskAVPBxOhPuoYPe3Y1IuqnVEeLlGZRsN2U95750CSaJxEnlrU568Hlt7_3fWBw2ALvtA3yz0w41R1zD07GUFva6dqAAxewu7qg Oct 19 03:31:37.341616 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:31:37.341616 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:31:37.341616 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:31:37.341616 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:31:37.341616 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:31:37.341616 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:31:37.341616 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 405888e04f9842559a4e846b0bb795fe Oct 19 03:31:37.341616 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1150796301 Oct 19 03:31:37.341616 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:31:37.341616 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:31:37.342732 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/405888e04f9842559a4e846b0bb795fe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/405888e04f9842559a4e846b0bb795fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/405888e04f9842559a4e846b0bb795fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_405888e04f9842559a4e846b0bb795fe", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:31:37.342732 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1150796301 Oct 19 03:31:37.342732 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 405888e04f9842559a4e846b0bb795fe Oct 19 03:31:37.342732 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1150796301 Oct 19 03:31:37.342732 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-MultipleCreateNegativeTestJSON-1150796301-project Oct 19 03:31:37.342732 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:31:37.342732 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:31:37.342732 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 6506362bb62f4dddb02c5bbcffbd055e Oct 19 03:31:37.342732 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1150796301-project Oct 19 03:31:37.342732 n-d-861333-8 devstack@n-api.service[121134]: Oct 19 03:31:37.342732 n-d-861333-8 devstack@n-api.service[121134]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-129230122", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "min_count": 2.5}} Oct 19 03:31:37.343354 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:31:37.343354 n-d-861333-8 devstack@n-api.service[121134]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 19 03:31:37.343354 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-129230122', 'imageRef': '9e16d73e-70ea-4421-aee3-047d80396c02', 'flavorRef': '452', 'min_count': 2.5}}} Oct 19 03:31:37.343354 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:31:37.343354 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:31:37.343354 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 03:31:37.343354 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 03:31:37.343354 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 03:31:37.343354 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise error Oct 19 03:31:37.343354 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 19 03:31:37.343354 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:31:37.343354 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Oct 19 03:31:37.343354 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 19 03:31:37.343354 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 19 03:31:37.343354 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 19 03:31:37.343354 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 19 03:31:37.343354 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:31:37.343354 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 19 03:31:37.343354 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi 2.5 Oct 19 03:31:37.343354 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:31:37.343354 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:31:37.343354 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:31:37.343354 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:31:37.344416 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:31:37.344416 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:31:37.344416 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:31:37.344416 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:31:37.344416 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:31:37.344416 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:31:37.344416 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:31:37.344416 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:31:37.344416 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 03:31:37.344416 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 03:31:37.344416 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 03:31:37.344416 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 03:31:37.344416 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 03:31:37.344416 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 03:31:37.344416 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 19 03:31:37.344416 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:31:37.344416 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:31:37.344416 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:31:37.344416 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:31:37.347652 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:31:37.347652 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:31:37.347652 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 03:31:37.347652 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 03:31:37.347652 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 19 03:31:37.347652 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:31:37.350310 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-09390ca4-5e20-4df7-8f3e-f393e7602622 tempest-MultipleCreateNegativeTestJSON-1150796301 tempest-MultipleCreateNegativeTestJSON-1150796301-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:31:37.354234 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-09390ca4-5e20-4df7-8f3e-f393e7602622 tempest-MultipleCreateNegativeTestJSON-1150796301 tempest-MultipleCreateNegativeTestJSON-1150796301-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.022931 Oct 19 03:31:37.355297 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2061/4207] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:31:37 2022] POST /compute/v2.1/servers => generated 139 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 03:31:37.480268 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7067c65b-72d7-4cca-b57c-eaaf874c0e4b tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:37.480898 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7067c65b-72d7-4cca-b57c-eaaf874c0e4b tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: fc300547-2017-4a58-8afc-350a262b5450] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:37.491241 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7067c65b-72d7-4cca-b57c-eaaf874c0e4b tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:37.492078 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7067c65b-72d7-4cca-b57c-eaaf874c0e4b tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:37.492817 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7067c65b-72d7-4cca-b57c-eaaf874c0e4b tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:37.493803 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7067c65b-72d7-4cca-b57c-eaaf874c0e4b tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:37.494848 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7067c65b-72d7-4cca-b57c-eaaf874c0e4b tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:37.495540 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7067c65b-72d7-4cca-b57c-eaaf874c0e4b tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:37.598911 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2e80bef4-0f71-44bd-986f-d5f4b6fa37af tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:37.603203 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2e80bef4-0f71-44bd-986f-d5f4b6fa37af tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] [instance: 41c45cc9-0697-4ca0-a968-c982723b2155] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:37.616495 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2e80bef4-0f71-44bd-986f-d5f4b6fa37af tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:37.618724 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2e80bef4-0f71-44bd-986f-d5f4b6fa37af tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:37.619747 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2e80bef4-0f71-44bd-986f-d5f4b6fa37af tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:37.622605 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2e80bef4-0f71-44bd-986f-d5f4b6fa37af tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:37.623794 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2e80bef4-0f71-44bd-986f-d5f4b6fa37af tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:37.626505 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2e80bef4-0f71-44bd-986f-d5f4b6fa37af tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:37.897917 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-2e80bef4-0f71-44bd-986f-d5f4b6fa37af tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:37.906612 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-2e80bef4-0f71-44bd-986f-d5f4b6fa37af tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:37.908056 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-2e80bef4-0f71-44bd-986f-d5f4b6fa37af tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:37.914868 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2e80bef4-0f71-44bd-986f-d5f4b6fa37af tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] 10.222.0.52 "GET /compute/v2.1/servers/41c45cc9-0697-4ca0-a968-c982723b2155" status: 200 len: 1407 microversion: 2.54 time: 0.321173 Oct 19 03:31:37.918087 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2062/4208] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:31:37 2022] GET /compute/v2.1/servers/41c45cc9-0697-4ca0-a968-c982723b2155 => generated 1407 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:31:37.924455 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d77cf800-1373-4dfc-97cb-bb05f134f5a2 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:37.925172 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d77cf800-1373-4dfc-97cb-bb05f134f5a2 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] [instance: 36412f0c-aebd-4ba7-9818-3164375a86c1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:37.935351 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d77cf800-1373-4dfc-97cb-bb05f134f5a2 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:37.935958 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d77cf800-1373-4dfc-97cb-bb05f134f5a2 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:37.936481 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d77cf800-1373-4dfc-97cb-bb05f134f5a2 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:37.937287 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d77cf800-1373-4dfc-97cb-bb05f134f5a2 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:37.937840 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d77cf800-1373-4dfc-97cb-bb05f134f5a2 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:37.939249 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d77cf800-1373-4dfc-97cb-bb05f134f5a2 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:38.234437 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7067c65b-72d7-4cca-b57c-eaaf874c0e4b tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:38.242359 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7067c65b-72d7-4cca-b57c-eaaf874c0e4b tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/fc300547-2017-4a58-8afc-350a262b5450" status: 200 len: 1499 microversion: 2.1 time: 0.767663 Oct 19 03:31:38.242980 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2147/4209] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:31:37 2022] GET /compute/v2.1/servers/fc300547-2017-4a58-8afc-350a262b5450 => generated 1499 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:31:38.248305 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b448cc3a-b1ad-45cf-8c28-b3acf0c84eca tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:38.249097 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b448cc3a-b1ad-45cf-8c28-b3acf0c84eca tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 4b805c13-68bb-4794-87b6-a63598253193] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:38.255541 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b448cc3a-b1ad-45cf-8c28-b3acf0c84eca tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:38.256261 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b448cc3a-b1ad-45cf-8c28-b3acf0c84eca tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:38.256858 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b448cc3a-b1ad-45cf-8c28-b3acf0c84eca tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:38.257804 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b448cc3a-b1ad-45cf-8c28-b3acf0c84eca tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:38.258439 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b448cc3a-b1ad-45cf-8c28-b3acf0c84eca tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:38.259021 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b448cc3a-b1ad-45cf-8c28-b3acf0c84eca tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:38.474369 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d77cf800-1373-4dfc-97cb-bb05f134f5a2 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f134d05b1e449b48d90579b76fe6b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21f8ce48b034df68b5b6361dd252095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:38.495130 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d77cf800-1373-4dfc-97cb-bb05f134f5a2 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] 10.222.0.52 "GET /compute/v2.1/servers/36412f0c-aebd-4ba7-9818-3164375a86c1" status: 200 len: 1323 microversion: 2.1 time: 0.563257 Oct 19 03:31:38.495708 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2063/4210] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:31:37 2022] GET /compute/v2.1/servers/36412f0c-aebd-4ba7-9818-3164375a86c1 => generated 1323 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:31:38.581025 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b448cc3a-b1ad-45cf-8c28-b3acf0c84eca tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:38.598185 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b448cc3a-b1ad-45cf-8c28-b3acf0c84eca tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/4b805c13-68bb-4794-87b6-a63598253193" status: 200 len: 1314 microversion: 2.1 time: 0.353837 Oct 19 03:31:38.614441 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2148/4211] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:31:38 2022] GET /compute/v2.1/servers/4b805c13-68bb-4794-87b6-a63598253193 => generated 1314 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:31:38.863845 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-c23934c3-12cb-47c3-a9f1-5525f68e8820 req-426315e9-95a3-4be3-8309-575f9b6e8d2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc300547-2017-4a58-8afc-350a262b5450", "name": "network-vif-deleted", "tag": "b4c0ab4e-2e4a-45c0-abba-79284270738d"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:31:38.879404 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:31:38.881837 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-c23934c3-12cb-47c3-a9f1-5525f68e8820 req-426315e9-95a3-4be3-8309-575f9b6e8d2d service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:38.882523 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-c23934c3-12cb-47c3-a9f1-5525f68e8820 req-426315e9-95a3-4be3-8309-575f9b6e8d2d service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:38.883219 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-c23934c3-12cb-47c3-a9f1-5525f68e8820 req-426315e9-95a3-4be3-8309-575f9b6e8d2d service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:38.897441 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-c23934c3-12cb-47c3-a9f1-5525f68e8820 req-426315e9-95a3-4be3-8309-575f9b6e8d2d service nova] Creating event network-vif-deleted:b4c0ab4e-2e4a-45c0-abba-79284270738d for instance fc300547-2017-4a58-8afc-350a262b5450 on n-h2-861333-8 Oct 19 03:31:38.910451 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-c23934c3-12cb-47c3-a9f1-5525f68e8820 req-426315e9-95a3-4be3-8309-575f9b6e8d2d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051491 Oct 19 03:31:38.910451 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2064/4212] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:31:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:31:38.964866 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ab6ea25a-3030-4ec3-b9ec-03e67c71947c tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:38.965516 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ab6ea25a-3030-4ec3-b9ec-03e67c71947c tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] [instance: 41c45cc9-0697-4ca0-a968-c982723b2155] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:38.972378 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ab6ea25a-3030-4ec3-b9ec-03e67c71947c tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:38.973128 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ab6ea25a-3030-4ec3-b9ec-03e67c71947c tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:38.977485 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ab6ea25a-3030-4ec3-b9ec-03e67c71947c tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:38.977485 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ab6ea25a-3030-4ec3-b9ec-03e67c71947c tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:38.977485 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ab6ea25a-3030-4ec3-b9ec-03e67c71947c tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:38.977485 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ab6ea25a-3030-4ec3-b9ec-03e67c71947c tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:39.059629 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ab6ea25a-3030-4ec3-b9ec-03e67c71947c tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:39.089654 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ab6ea25a-3030-4ec3-b9ec-03e67c71947c tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:39.091344 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ab6ea25a-3030-4ec3-b9ec-03e67c71947c tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:39.092583 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ab6ea25a-3030-4ec3-b9ec-03e67c71947c tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] 10.222.0.52 "GET /compute/v2.1/servers/41c45cc9-0697-4ca0-a968-c982723b2155" status: 200 len: 1407 microversion: 2.54 time: 0.132402 Oct 19 03:31:39.093159 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2149/4213] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:31:38 2022] GET /compute/v2.1/servers/41c45cc9-0697-4ca0-a968-c982723b2155 => generated 1407 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:31:39.274558 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-99cad0e7-53d4-49c2-aec6-5d64bfd3de9e tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:39.274558 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-99cad0e7-53d4-49c2-aec6-5d64bfd3de9e tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: fc300547-2017-4a58-8afc-350a262b5450] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:39.306106 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-99cad0e7-53d4-49c2-aec6-5d64bfd3de9e tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:39.307186 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-99cad0e7-53d4-49c2-aec6-5d64bfd3de9e tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:39.307654 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-99cad0e7-53d4-49c2-aec6-5d64bfd3de9e tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:39.308406 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-99cad0e7-53d4-49c2-aec6-5d64bfd3de9e tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:39.312721 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-99cad0e7-53d4-49c2-aec6-5d64bfd3de9e tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:39.313247 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-99cad0e7-53d4-49c2-aec6-5d64bfd3de9e tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:39.423504 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-99cad0e7-53d4-49c2-aec6-5d64bfd3de9e tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:39.424029 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-99cad0e7-53d4-49c2-aec6-5d64bfd3de9e tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:39.424477 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-99cad0e7-53d4-49c2-aec6-5d64bfd3de9e tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:39.431981 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-99cad0e7-53d4-49c2-aec6-5d64bfd3de9e tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lazy-loading 'fault' on Instance uuid fc300547-2017-4a58-8afc-350a262b5450 {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:31:39.517854 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-24cf84fc-7c94-4935-85db-357e5b2f7a92 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:39.519779 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-99cad0e7-53d4-49c2-aec6-5d64bfd3de9e tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5b2cb1272541dfbc2659cf4adf9026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019441bff8642cebf21fd1c4e890196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:39.520945 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-24cf84fc-7c94-4935-85db-357e5b2f7a92 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] [instance: 36412f0c-aebd-4ba7-9818-3164375a86c1] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:39.530060 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-99cad0e7-53d4-49c2-aec6-5d64bfd3de9e tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/fc300547-2017-4a58-8afc-350a262b5450" status: 200 len: 1300 microversion: 2.1 time: 0.265578 Oct 19 03:31:39.532706 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2065/4214] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:31:39 2022] GET /compute/v2.1/servers/fc300547-2017-4a58-8afc-350a262b5450 => generated 1300 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:31:39.554535 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-24cf84fc-7c94-4935-85db-357e5b2f7a92 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:39.555338 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-24cf84fc-7c94-4935-85db-357e5b2f7a92 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:39.555966 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-24cf84fc-7c94-4935-85db-357e5b2f7a92 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:39.559206 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-24cf84fc-7c94-4935-85db-357e5b2f7a92 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:39.559944 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-24cf84fc-7c94-4935-85db-357e5b2f7a92 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:39.560534 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-24cf84fc-7c94-4935-85db-357e5b2f7a92 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:39.631855 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5403245b-c182-425b-a799-4ce97818e8b7 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:39.632550 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5403245b-c182-425b-a799-4ce97818e8b7 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 4b805c13-68bb-4794-87b6-a63598253193] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:39.648247 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5403245b-c182-425b-a799-4ce97818e8b7 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:39.648762 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5403245b-c182-425b-a799-4ce97818e8b7 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:39.649551 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5403245b-c182-425b-a799-4ce97818e8b7 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:39.651204 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5403245b-c182-425b-a799-4ce97818e8b7 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:39.655676 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5403245b-c182-425b-a799-4ce97818e8b7 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:39.656440 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5403245b-c182-425b-a799-4ce97818e8b7 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:40.303050 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-24cf84fc-7c94-4935-85db-357e5b2f7a92 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f134d05b1e449b48d90579b76fe6b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21f8ce48b034df68b5b6361dd252095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:40.311811 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-24cf84fc-7c94-4935-85db-357e5b2f7a92 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] 10.222.0.52 "GET /compute/v2.1/servers/36412f0c-aebd-4ba7-9818-3164375a86c1" status: 200 len: 1323 microversion: 2.1 time: 0.806275 Oct 19 03:31:40.312616 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2150/4215] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:31:39 2022] GET /compute/v2.1/servers/36412f0c-aebd-4ba7-9818-3164375a86c1 => generated 1323 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:31:40.322076 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-4fa0a7b8-eb32-4276-851e-b38a45910bf0 req-583834da-0166-4f19-bae7-f38b2a6b6825 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36412f0c-aebd-4ba7-9818-3164375a86c1", "tag": "3ac0d02e-1d59-4692-bd92-992d8a3f1141"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:31:40.328634 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-4fa0a7b8-eb32-4276-851e-b38a45910bf0 req-583834da-0166-4f19-bae7-f38b2a6b6825 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:40.330734 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-4fa0a7b8-eb32-4276-851e-b38a45910bf0 req-583834da-0166-4f19-bae7-f38b2a6b6825 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:40.331403 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-4fa0a7b8-eb32-4276-851e-b38a45910bf0 req-583834da-0166-4f19-bae7-f38b2a6b6825 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:40.357085 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-4fa0a7b8-eb32-4276-851e-b38a45910bf0 req-583834da-0166-4f19-bae7-f38b2a6b6825 service nova] Creating event network-changed:3ac0d02e-1d59-4692-bd92-992d8a3f1141 for instance 36412f0c-aebd-4ba7-9818-3164375a86c1 on n-h1-861333-8 Oct 19 03:31:40.369687 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-4fa0a7b8-eb32-4276-851e-b38a45910bf0 req-583834da-0166-4f19-bae7-f38b2a6b6825 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055001 Oct 19 03:31:40.372712 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2151/4216] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:31:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:31:40.378529 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-77cde7ec-866f-4154-ba09-78db072ec9f4 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:40.379879 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-77cde7ec-866f-4154-ba09-78db072ec9f4 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] [instance: 41c45cc9-0697-4ca0-a968-c982723b2155] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:40.397974 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5403245b-c182-425b-a799-4ce97818e8b7 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:40.407959 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-77cde7ec-866f-4154-ba09-78db072ec9f4 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:40.408627 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-77cde7ec-866f-4154-ba09-78db072ec9f4 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:40.409231 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-77cde7ec-866f-4154-ba09-78db072ec9f4 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:40.410066 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-77cde7ec-866f-4154-ba09-78db072ec9f4 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:40.410607 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-77cde7ec-866f-4154-ba09-78db072ec9f4 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:40.410899 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5403245b-c182-425b-a799-4ce97818e8b7 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/4b805c13-68bb-4794-87b6-a63598253193" status: 200 len: 1314 microversion: 2.1 time: 0.792468 Oct 19 03:31:40.411199 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-77cde7ec-866f-4154-ba09-78db072ec9f4 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:40.440868 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2066/4217] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:31:39 2022] GET /compute/v2.1/servers/4b805c13-68bb-4794-87b6-a63598253193 => generated 1314 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:31:40.553817 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-77cde7ec-866f-4154-ba09-78db072ec9f4 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:40.557661 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-fed244ea-d4e3-47d8-a56c-34ed4378b4fd tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:40.558300 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-fed244ea-d4e3-47d8-a56c-34ed4378b4fd tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] [instance: fc300547-2017-4a58-8afc-350a262b5450] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:40.566202 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fed244ea-d4e3-47d8-a56c-34ed4378b4fd tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:40.566704 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fed244ea-d4e3-47d8-a56c-34ed4378b4fd tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:40.567149 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fed244ea-d4e3-47d8-a56c-34ed4378b4fd tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:40.567873 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fed244ea-d4e3-47d8-a56c-34ed4378b4fd tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:40.568202 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-77cde7ec-866f-4154-ba09-78db072ec9f4 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:40.568317 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fed244ea-d4e3-47d8-a56c-34ed4378b4fd tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:40.570426 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-77cde7ec-866f-4154-ba09-78db072ec9f4 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:40.574351 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fed244ea-d4e3-47d8-a56c-34ed4378b4fd tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:40.574556 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-77cde7ec-866f-4154-ba09-78db072ec9f4 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] 10.222.0.52 "GET /compute/v2.1/servers/41c45cc9-0697-4ca0-a968-c982723b2155" status: 200 len: 1407 microversion: 2.54 time: 0.198801 Oct 19 03:31:40.575039 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2152/4218] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:31:40 2022] GET /compute/v2.1/servers/41c45cc9-0697-4ca0-a968-c982723b2155 => generated 1407 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:31:40.597317 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-fed244ea-d4e3-47d8-a56c-34ed4378b4fd tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] HTTP exception thrown: Instance fc300547-2017-4a58-8afc-350a262b5450 could not be found. Oct 19 03:31:40.599460 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-fed244ea-d4e3-47d8-a56c-34ed4378b4fd tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Request method failure captured: Oct 19 03:31:40.599460 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/fc300547-2017-4a58-8afc-350a262b5450 HTTP/1.1 Oct 19 03:31:40.599460 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:31:40.599460 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:31:40.599460 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:31:40.599460 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:31:40.599460 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:31:40.599460 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:31:40.599460 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:31:40.599460 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:31:40.599460 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT22uzKvAjuhIgc-DP7sPOfn3b9sZBQU9yYusOMtajXQwK7wG_j3ZDvn7Y9QkhMFz7rVu19UO6F9j-GFIsoZ01og7bGTb8cd2FAk3jP7hKJv7GRFFP9AvHjrS1D9SP93D8kxirVlCFlnWTrKXA6F64crO5KpGWGnmfOnzZxnOfR_1F5Y Oct 19 03:31:40.599460 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:31:40.599460 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:31:40.599460 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:31:40.599460 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:31:40.599460 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:31:40.599460 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:31:40.599460 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 8019441bff8642cebf21fd1c4e890196 Oct 19 03:31:40.599460 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-LiveMigrationTest-1310149028 Oct 19 03:31:40.599460 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:31:40.599460 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:31:40.600782 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8019441bff8642cebf21fd1c4e890196"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8019441bff8642cebf21fd1c4e890196"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8019441bff8642cebf21fd1c4e890196"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8019441bff8642cebf21fd1c4e890196", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:31:40.600782 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-LiveMigrationTest-1310149028 Oct 19 03:31:40.600782 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 8019441bff8642cebf21fd1c4e890196 Oct 19 03:31:40.600782 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-LiveMigrationTest-1310149028 Oct 19 03:31:40.600782 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-LiveMigrationTest-1310149028-project Oct 19 03:31:40.600782 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:31:40.600782 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:31:40.600782 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 2b5b2cb1272541dfbc2659cf4adf9026 Oct 19 03:31:40.600782 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-LiveMigrationTest-1310149028-project Oct 19 03:31:40.600782 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:31:40.600782 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance fc300547-2017-4a58-8afc-350a262b5450 could not be found. Oct 19 03:31:40.600782 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': 'fc300547-2017-4a58-8afc-350a262b5450'} Oct 19 03:31:40.601634 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:31:40.601634 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:31:40.601634 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:31:40.601634 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:31:40.601634 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:31:40.601634 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:31:40.601634 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:31:40.601634 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:31:40.601634 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:31:40.601634 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:31:40.601634 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc300547-2017-4a58-8afc-350a262b5450 could not be found. Oct 19 03:31:40.601634 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:31:40.601634 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:31:40.601634 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:31:40.601634 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:31:40.601634 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:31:40.601634 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:31:40.601634 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:31:40.601634 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:31:40.601634 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:31:40.602841 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:31:40.602841 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:31:40.602841 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:31:40.602841 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:31:40.602841 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:31:40.602841 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:31:40.602841 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:31:40.602841 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc300547-2017-4a58-8afc-350a262b5450 could not be found. Oct 19 03:31:40.602841 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:31:40.602841 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:31:40.602841 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:31:40.602841 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:31:40.602841 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:31:40.602841 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:31:40.602841 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:31:40.602841 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:31:40.602841 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc300547-2017-4a58-8afc-350a262b5450 could not be found. Oct 19 03:31:40.602841 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:31:40.604574 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-fed244ea-d4e3-47d8-a56c-34ed4378b4fd tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] Returning 404 to user: Instance fc300547-2017-4a58-8afc-350a262b5450 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:31:40.605632 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-fed244ea-d4e3-47d8-a56c-34ed4378b4fd tempest-LiveMigrationTest-1310149028 tempest-LiveMigrationTest-1310149028-project] 10.222.0.52 "GET /compute/v2.1/servers/fc300547-2017-4a58-8afc-350a262b5450" status: 404 len: 111 microversion: 2.1 time: 0.052139 Oct 19 03:31:40.606660 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2067/4219] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:31:40 2022] GET /compute/v2.1/servers/fc300547-2017-4a58-8afc-350a262b5450 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:31:40.971783 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-862b7dc6-9c86-4b00-a7bf-73d184d57c6a req-7ce0c91e-25c5-4761-bd72-097a244d82ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b805c13-68bb-4794-87b6-a63598253193", "name": "network-vif-plugged", "status": "completed", "tag": "d00f612c-68eb-47c5-9dd8-614cf83ec5c6"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:31:40.988300 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-862b7dc6-9c86-4b00-a7bf-73d184d57c6a req-7ce0c91e-25c5-4761-bd72-097a244d82ea service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:40.989360 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-862b7dc6-9c86-4b00-a7bf-73d184d57c6a req-7ce0c91e-25c5-4761-bd72-097a244d82ea service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:40.990033 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-862b7dc6-9c86-4b00-a7bf-73d184d57c6a req-7ce0c91e-25c5-4761-bd72-097a244d82ea service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:41.025073 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-862b7dc6-9c86-4b00-a7bf-73d184d57c6a req-7ce0c91e-25c5-4761-bd72-097a244d82ea service nova] Creating event network-vif-plugged:d00f612c-68eb-47c5-9dd8-614cf83ec5c6 for instance 4b805c13-68bb-4794-87b6-a63598253193 on n-h2-861333-8 Oct 19 03:31:41.041359 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-862b7dc6-9c86-4b00-a7bf-73d184d57c6a req-7ce0c91e-25c5-4761-bd72-097a244d82ea service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064343 Oct 19 03:31:41.041359 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2153/4220] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:31:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:31:41.340497 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-79e34c85-941c-43e8-9f56-2ec18b12d1f0 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:41.341751 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-79e34c85-941c-43e8-9f56-2ec18b12d1f0 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] [instance: 36412f0c-aebd-4ba7-9818-3164375a86c1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:41.358627 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-79e34c85-941c-43e8-9f56-2ec18b12d1f0 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:41.359418 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-79e34c85-941c-43e8-9f56-2ec18b12d1f0 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:41.360048 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-79e34c85-941c-43e8-9f56-2ec18b12d1f0 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:41.361207 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-79e34c85-941c-43e8-9f56-2ec18b12d1f0 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:41.363548 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-79e34c85-941c-43e8-9f56-2ec18b12d1f0 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:41.364031 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-79e34c85-941c-43e8-9f56-2ec18b12d1f0 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:41.450067 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f9d8ad97-a03c-4fd3-941f-f25a3024a1bd tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:41.450789 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f9d8ad97-a03c-4fd3-941f-f25a3024a1bd tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 4b805c13-68bb-4794-87b6-a63598253193] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:41.463114 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f9d8ad97-a03c-4fd3-941f-f25a3024a1bd tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:41.464482 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f9d8ad97-a03c-4fd3-941f-f25a3024a1bd tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:41.465225 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f9d8ad97-a03c-4fd3-941f-f25a3024a1bd tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:41.466538 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f9d8ad97-a03c-4fd3-941f-f25a3024a1bd tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:41.467460 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f9d8ad97-a03c-4fd3-941f-f25a3024a1bd tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:41.468076 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f9d8ad97-a03c-4fd3-941f-f25a3024a1bd tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:42.041138 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-79e34c85-941c-43e8-9f56-2ec18b12d1f0 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f134d05b1e449b48d90579b76fe6b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21f8ce48b034df68b5b6361dd252095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:42.057943 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-79e34c85-941c-43e8-9f56-2ec18b12d1f0 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] 10.222.0.52 "GET /compute/v2.1/servers/36412f0c-aebd-4ba7-9818-3164375a86c1" status: 200 len: 1323 microversion: 2.1 time: 0.717242 Oct 19 03:31:42.058643 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2068/4221] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:31:41 2022] GET /compute/v2.1/servers/36412f0c-aebd-4ba7-9818-3164375a86c1 => generated 1323 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:31:42.084838 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0790b63c-ba28-4e79-a9a8-c2c42e0d6bf4 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:42.085768 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0790b63c-ba28-4e79-a9a8-c2c42e0d6bf4 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] [instance: 41c45cc9-0697-4ca0-a968-c982723b2155] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:42.106555 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:31:42.123151 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0790b63c-ba28-4e79-a9a8-c2c42e0d6bf4 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:42.124014 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0790b63c-ba28-4e79-a9a8-c2c42e0d6bf4 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:42.131160 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0790b63c-ba28-4e79-a9a8-c2c42e0d6bf4 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:42.135508 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0790b63c-ba28-4e79-a9a8-c2c42e0d6bf4 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:42.136222 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0790b63c-ba28-4e79-a9a8-c2c42e0d6bf4 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:42.136822 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0790b63c-ba28-4e79-a9a8-c2c42e0d6bf4 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:42.312726 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0790b63c-ba28-4e79-a9a8-c2c42e0d6bf4 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:42.327742 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0790b63c-ba28-4e79-a9a8-c2c42e0d6bf4 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:42.329241 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0790b63c-ba28-4e79-a9a8-c2c42e0d6bf4 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:42.330968 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0790b63c-ba28-4e79-a9a8-c2c42e0d6bf4 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] 10.222.0.52 "GET /compute/v2.1/servers/41c45cc9-0697-4ca0-a968-c982723b2155" status: 200 len: 1407 microversion: 2.54 time: 0.255096 Oct 19 03:31:42.331612 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2069/4222] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:31:42 2022] GET /compute/v2.1/servers/41c45cc9-0697-4ca0-a968-c982723b2155 => generated 1407 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:31:42.450902 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f9d8ad97-a03c-4fd3-941f-f25a3024a1bd tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:42.470739 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f9d8ad97-a03c-4fd3-941f-f25a3024a1bd tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/4b805c13-68bb-4794-87b6-a63598253193" status: 200 len: 1314 microversion: 2.1 time: 1.026051 Oct 19 03:31:42.471575 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2154/4223] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:31:41 2022] GET /compute/v2.1/servers/4b805c13-68bb-4794-87b6-a63598253193 => generated 1314 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:31:43.087281 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4c127b5f-8016-4174-ae78-8bb4024d6a7f tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:43.089544 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4c127b5f-8016-4174-ae78-8bb4024d6a7f tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] [instance: 36412f0c-aebd-4ba7-9818-3164375a86c1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:43.102377 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4c127b5f-8016-4174-ae78-8bb4024d6a7f tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:43.104308 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4c127b5f-8016-4174-ae78-8bb4024d6a7f tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:43.105131 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4c127b5f-8016-4174-ae78-8bb4024d6a7f tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:43.106253 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4c127b5f-8016-4174-ae78-8bb4024d6a7f tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:43.107009 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4c127b5f-8016-4174-ae78-8bb4024d6a7f tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:43.107688 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4c127b5f-8016-4174-ae78-8bb4024d6a7f tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:43.144699 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=18 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:31:43.191851 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:31:43.364230 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9ca24813-6c3b-46e0-9ccd-a59dba78f9b8 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:43.365001 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9ca24813-6c3b-46e0-9ccd-a59dba78f9b8 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] [instance: 41c45cc9-0697-4ca0-a968-c982723b2155] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:43.386025 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9ca24813-6c3b-46e0-9ccd-a59dba78f9b8 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:43.386814 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9ca24813-6c3b-46e0-9ccd-a59dba78f9b8 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:43.387456 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9ca24813-6c3b-46e0-9ccd-a59dba78f9b8 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:43.389528 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9ca24813-6c3b-46e0-9ccd-a59dba78f9b8 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:43.390187 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9ca24813-6c3b-46e0-9ccd-a59dba78f9b8 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:43.390782 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9ca24813-6c3b-46e0-9ccd-a59dba78f9b8 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:43.740282 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-9ca24813-6c3b-46e0-9ccd-a59dba78f9b8 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:43.755694 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-9ca24813-6c3b-46e0-9ccd-a59dba78f9b8 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:43.760869 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-9ca24813-6c3b-46e0-9ccd-a59dba78f9b8 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:43.765290 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9ca24813-6c3b-46e0-9ccd-a59dba78f9b8 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] 10.222.0.52 "GET /compute/v2.1/servers/41c45cc9-0697-4ca0-a968-c982723b2155" status: 200 len: 1407 microversion: 2.54 time: 0.404650 Oct 19 03:31:43.766132 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2155/4224] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:31:43 2022] GET /compute/v2.1/servers/41c45cc9-0697-4ca0-a968-c982723b2155 => generated 1407 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:31:43.780574 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-cd53e72f-852b-4220-ac6d-c66b84159d94 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:43.781502 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-cd53e72f-852b-4220-ac6d-c66b84159d94 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 4b805c13-68bb-4794-87b6-a63598253193] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:43.803315 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cd53e72f-852b-4220-ac6d-c66b84159d94 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:43.803956 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cd53e72f-852b-4220-ac6d-c66b84159d94 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:43.804358 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cd53e72f-852b-4220-ac6d-c66b84159d94 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:43.805146 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cd53e72f-852b-4220-ac6d-c66b84159d94 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:43.805635 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cd53e72f-852b-4220-ac6d-c66b84159d94 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:43.806275 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cd53e72f-852b-4220-ac6d-c66b84159d94 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:44.085694 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-4c127b5f-8016-4174-ae78-8bb4024d6a7f tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f134d05b1e449b48d90579b76fe6b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21f8ce48b034df68b5b6361dd252095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:44.094890 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4c127b5f-8016-4174-ae78-8bb4024d6a7f tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] 10.222.0.52 "GET /compute/v2.1/servers/36412f0c-aebd-4ba7-9818-3164375a86c1" status: 200 len: 1323 microversion: 2.1 time: 1.012684 Oct 19 03:31:44.112133 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2070/4225] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:31:43 2022] GET /compute/v2.1/servers/36412f0c-aebd-4ba7-9818-3164375a86c1 => generated 1323 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:31:44.283098 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-cd53e72f-852b-4220-ac6d-c66b84159d94 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:44.299713 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-cd53e72f-852b-4220-ac6d-c66b84159d94 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/4b805c13-68bb-4794-87b6-a63598253193" status: 200 len: 1501 microversion: 2.1 time: 0.531738 Oct 19 03:31:44.314203 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2156/4226] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:31:43 2022] GET /compute/v2.1/servers/4b805c13-68bb-4794-87b6-a63598253193 => generated 1501 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:31:44.326897 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b4daf48c-6ece-471e-8802-902812817ea7 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:31:44.334617 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b4daf48c-6ece-471e-8802-902812817ea7 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:44.335183 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b4daf48c-6ece-471e-8802-902812817ea7 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:44.335897 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b4daf48c-6ece-471e-8802-902812817ea7 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:44.368325 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b4daf48c-6ece-471e-8802-902812817ea7 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 4b805c13-68bb-4794-87b6-a63598253193] Going to try to stop instance {{(pid=121134) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 19 03:31:44.679280 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b4daf48c-6ece-471e-8802-902812817ea7 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "POST /compute/v2.1/servers/4b805c13-68bb-4794-87b6-a63598253193/action" status: 202 len: 0 microversion: 2.1 time: 0.356449 Oct 19 03:31:44.682797 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2071/4227] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:31:44 2022] POST /compute/v2.1/servers/4b805c13-68bb-4794-87b6-a63598253193/action => generated 0 bytes in 360 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:31:44.688457 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c4ad1191-2450-45ed-975e-77fc3df5cfcf tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:44.690279 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c4ad1191-2450-45ed-975e-77fc3df5cfcf tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 4b805c13-68bb-4794-87b6-a63598253193] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:44.714068 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c4ad1191-2450-45ed-975e-77fc3df5cfcf tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:44.715008 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c4ad1191-2450-45ed-975e-77fc3df5cfcf tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:44.716790 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c4ad1191-2450-45ed-975e-77fc3df5cfcf tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:44.718171 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c4ad1191-2450-45ed-975e-77fc3df5cfcf tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:44.720865 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c4ad1191-2450-45ed-975e-77fc3df5cfcf tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:44.722096 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c4ad1191-2450-45ed-975e-77fc3df5cfcf tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:44.795301 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-53648668-806f-4c07-ab9f-2138023ee2c1 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:44.796192 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-53648668-806f-4c07-ab9f-2138023ee2c1 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] [instance: 41c45cc9-0697-4ca0-a968-c982723b2155] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:44.808015 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-53648668-806f-4c07-ab9f-2138023ee2c1 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:44.808549 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-53648668-806f-4c07-ab9f-2138023ee2c1 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:44.817126 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-53648668-806f-4c07-ab9f-2138023ee2c1 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:44.817966 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-53648668-806f-4c07-ab9f-2138023ee2c1 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:44.818484 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-53648668-806f-4c07-ab9f-2138023ee2c1 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:44.818989 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-53648668-806f-4c07-ab9f-2138023ee2c1 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:44.989812 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-53648668-806f-4c07-ab9f-2138023ee2c1 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:44.998664 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-53648668-806f-4c07-ab9f-2138023ee2c1 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:45.006758 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-53648668-806f-4c07-ab9f-2138023ee2c1 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:45.009890 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-53648668-806f-4c07-ab9f-2138023ee2c1 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] 10.222.0.52 "GET /compute/v2.1/servers/41c45cc9-0697-4ca0-a968-c982723b2155" status: 200 len: 1407 microversion: 2.54 time: 0.217848 Oct 19 03:31:45.022058 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2072/4228] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:31:44 2022] GET /compute/v2.1/servers/41c45cc9-0697-4ca0-a968-c982723b2155 => generated 1407 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:31:45.121919 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-caf7b45c-ff7b-4a9c-998d-5b374dc0827a tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:45.122624 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-caf7b45c-ff7b-4a9c-998d-5b374dc0827a tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] [instance: 36412f0c-aebd-4ba7-9818-3164375a86c1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:45.129325 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-caf7b45c-ff7b-4a9c-998d-5b374dc0827a tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:45.130127 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-caf7b45c-ff7b-4a9c-998d-5b374dc0827a tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:45.130926 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-caf7b45c-ff7b-4a9c-998d-5b374dc0827a tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:45.132166 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-caf7b45c-ff7b-4a9c-998d-5b374dc0827a tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:45.132833 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-caf7b45c-ff7b-4a9c-998d-5b374dc0827a tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:45.133508 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-caf7b45c-ff7b-4a9c-998d-5b374dc0827a tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:45.598113 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c4ad1191-2450-45ed-975e-77fc3df5cfcf tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:45.608985 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c4ad1191-2450-45ed-975e-77fc3df5cfcf tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/4b805c13-68bb-4794-87b6-a63598253193" status: 200 len: 1511 microversion: 2.1 time: 0.923899 Oct 19 03:31:45.609860 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2157/4229] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:31:44 2022] GET /compute/v2.1/servers/4b805c13-68bb-4794-87b6-a63598253193 => generated 1511 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:31:45.897049 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-caf7b45c-ff7b-4a9c-998d-5b374dc0827a tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f134d05b1e449b48d90579b76fe6b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21f8ce48b034df68b5b6361dd252095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:45.909530 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-caf7b45c-ff7b-4a9c-998d-5b374dc0827a tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] 10.222.0.52 "GET /compute/v2.1/servers/36412f0c-aebd-4ba7-9818-3164375a86c1" status: 200 len: 1323 microversion: 2.1 time: 0.792250 Oct 19 03:31:45.910122 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2073/4230] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:31:45 2022] GET /compute/v2.1/servers/36412f0c-aebd-4ba7-9818-3164375a86c1 => generated 1323 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:31:46.036953 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b24318bf-439a-44d4-b1ef-204ca66e44b7 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:46.037883 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b24318bf-439a-44d4-b1ef-204ca66e44b7 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] [instance: 41c45cc9-0697-4ca0-a968-c982723b2155] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:46.048057 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b24318bf-439a-44d4-b1ef-204ca66e44b7 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:46.051619 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b24318bf-439a-44d4-b1ef-204ca66e44b7 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:46.064510 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b24318bf-439a-44d4-b1ef-204ca66e44b7 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:46.064510 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b24318bf-439a-44d4-b1ef-204ca66e44b7 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:46.064510 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b24318bf-439a-44d4-b1ef-204ca66e44b7 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:46.064510 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b24318bf-439a-44d4-b1ef-204ca66e44b7 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:46.230818 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b24318bf-439a-44d4-b1ef-204ca66e44b7 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:46.239822 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b24318bf-439a-44d4-b1ef-204ca66e44b7 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:46.241285 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b24318bf-439a-44d4-b1ef-204ca66e44b7 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:46.246075 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b24318bf-439a-44d4-b1ef-204ca66e44b7 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] 10.222.0.52 "GET /compute/v2.1/servers/41c45cc9-0697-4ca0-a968-c982723b2155" status: 200 len: 1407 microversion: 2.54 time: 0.210832 Oct 19 03:31:46.250387 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2158/4231] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:31:46 2022] GET /compute/v2.1/servers/41c45cc9-0697-4ca0-a968-c982723b2155 => generated 1407 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:31:46.639269 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2ab68f1f-4fbf-4ba2-aed6-a3551fac2aaf tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:46.640119 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2ab68f1f-4fbf-4ba2-aed6-a3551fac2aaf tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 4b805c13-68bb-4794-87b6-a63598253193] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:46.651427 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2ab68f1f-4fbf-4ba2-aed6-a3551fac2aaf tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:46.652185 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2ab68f1f-4fbf-4ba2-aed6-a3551fac2aaf tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:46.652918 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2ab68f1f-4fbf-4ba2-aed6-a3551fac2aaf tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:46.653829 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2ab68f1f-4fbf-4ba2-aed6-a3551fac2aaf tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:46.654793 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2ab68f1f-4fbf-4ba2-aed6-a3551fac2aaf tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:46.655116 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2ab68f1f-4fbf-4ba2-aed6-a3551fac2aaf tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:46.935209 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b9440cbd-8cdc-417a-8126-8d337c1254c7 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:46.936945 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b9440cbd-8cdc-417a-8126-8d337c1254c7 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] [instance: 36412f0c-aebd-4ba7-9818-3164375a86c1] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:46.952207 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b9440cbd-8cdc-417a-8126-8d337c1254c7 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:46.952701 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b9440cbd-8cdc-417a-8126-8d337c1254c7 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:46.954846 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b9440cbd-8cdc-417a-8126-8d337c1254c7 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:46.955746 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b9440cbd-8cdc-417a-8126-8d337c1254c7 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:46.956356 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b9440cbd-8cdc-417a-8126-8d337c1254c7 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:46.957057 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b9440cbd-8cdc-417a-8126-8d337c1254c7 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:47.242668 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-2ab68f1f-4fbf-4ba2-aed6-a3551fac2aaf tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:47.287434 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2ab68f1f-4fbf-4ba2-aed6-a3551fac2aaf tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/4b805c13-68bb-4794-87b6-a63598253193" status: 200 len: 1511 microversion: 2.1 time: 0.653208 Oct 19 03:31:47.291992 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2074/4232] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:31:46 2022] GET /compute/v2.1/servers/4b805c13-68bb-4794-87b6-a63598253193 => generated 1511 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:31:47.305147 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6079909e-c709-4d3a-977b-1b3e81b28270 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:47.308463 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6079909e-c709-4d3a-977b-1b3e81b28270 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] [instance: 41c45cc9-0697-4ca0-a968-c982723b2155] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:47.325654 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6079909e-c709-4d3a-977b-1b3e81b28270 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:47.330434 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6079909e-c709-4d3a-977b-1b3e81b28270 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:47.331986 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6079909e-c709-4d3a-977b-1b3e81b28270 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:47.334971 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6079909e-c709-4d3a-977b-1b3e81b28270 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:47.337167 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6079909e-c709-4d3a-977b-1b3e81b28270 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:47.339885 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6079909e-c709-4d3a-977b-1b3e81b28270 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:47.707585 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-6079909e-c709-4d3a-977b-1b3e81b28270 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:47.719958 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b9440cbd-8cdc-417a-8126-8d337c1254c7 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f134d05b1e449b48d90579b76fe6b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21f8ce48b034df68b5b6361dd252095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:47.720841 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=100 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:31:47.723697 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-6079909e-c709-4d3a-977b-1b3e81b28270 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:47.726489 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-6079909e-c709-4d3a-977b-1b3e81b28270 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:47.728889 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b9440cbd-8cdc-417a-8126-8d337c1254c7 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] 10.222.0.52 "GET /compute/v2.1/servers/36412f0c-aebd-4ba7-9818-3164375a86c1" status: 200 len: 1323 microversion: 2.1 time: 0.799237 Oct 19 03:31:47.729519 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2159/4233] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:31:46 2022] GET /compute/v2.1/servers/36412f0c-aebd-4ba7-9818-3164375a86c1 => generated 1323 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:31:47.729821 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6079909e-c709-4d3a-977b-1b3e81b28270 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] 10.222.0.52 "GET /compute/v2.1/servers/41c45cc9-0697-4ca0-a968-c982723b2155" status: 200 len: 1407 microversion: 2.54 time: 0.435309 Oct 19 03:31:47.741723 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2075/4234] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:31:47 2022] GET /compute/v2.1/servers/41c45cc9-0697-4ca0-a968-c982723b2155 => generated 1407 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:31:48.320017 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e06eaefb-5936-49fb-adec-3584300bb90f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:48.321282 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e06eaefb-5936-49fb-adec-3584300bb90f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 4b805c13-68bb-4794-87b6-a63598253193] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:48.334591 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e06eaefb-5936-49fb-adec-3584300bb90f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:48.337973 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e06eaefb-5936-49fb-adec-3584300bb90f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:48.340776 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e06eaefb-5936-49fb-adec-3584300bb90f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:48.342293 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e06eaefb-5936-49fb-adec-3584300bb90f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:48.343347 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e06eaefb-5936-49fb-adec-3584300bb90f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:48.343861 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e06eaefb-5936-49fb-adec-3584300bb90f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:48.745962 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-e06eaefb-5936-49fb-adec-3584300bb90f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:48.755598 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e06eaefb-5936-49fb-adec-3584300bb90f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/4b805c13-68bb-4794-87b6-a63598253193" status: 200 len: 1511 microversion: 2.1 time: 0.444602 Oct 19 03:31:48.756339 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f2b72724-6c78-46dd-9d72-0fe86e6479d8 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:48.758891 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f2b72724-6c78-46dd-9d72-0fe86e6479d8 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] [instance: 36412f0c-aebd-4ba7-9818-3164375a86c1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:48.770835 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f2b72724-6c78-46dd-9d72-0fe86e6479d8 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:48.771524 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f2b72724-6c78-46dd-9d72-0fe86e6479d8 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:48.772172 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f2b72724-6c78-46dd-9d72-0fe86e6479d8 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:48.773066 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f2b72724-6c78-46dd-9d72-0fe86e6479d8 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:48.773823 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f2b72724-6c78-46dd-9d72-0fe86e6479d8 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:48.775733 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f2b72724-6c78-46dd-9d72-0fe86e6479d8 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:48.781514 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2160/4235] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:31:48 2022] GET /compute/v2.1/servers/4b805c13-68bb-4794-87b6-a63598253193 => generated 1511 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:31:48.787956 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e5d4e812-026e-4314-b0e0-c7c3e7dc8720 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:48.788581 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e5d4e812-026e-4314-b0e0-c7c3e7dc8720 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] [instance: 41c45cc9-0697-4ca0-a968-c982723b2155] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:48.805790 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e5d4e812-026e-4314-b0e0-c7c3e7dc8720 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:48.806918 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e5d4e812-026e-4314-b0e0-c7c3e7dc8720 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:48.807611 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e5d4e812-026e-4314-b0e0-c7c3e7dc8720 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:48.808734 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e5d4e812-026e-4314-b0e0-c7c3e7dc8720 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:48.810026 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e5d4e812-026e-4314-b0e0-c7c3e7dc8720 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:48.810882 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e5d4e812-026e-4314-b0e0-c7c3e7dc8720 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:49.030830 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-e5d4e812-026e-4314-b0e0-c7c3e7dc8720 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:49.046421 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-e5d4e812-026e-4314-b0e0-c7c3e7dc8720 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:49.048248 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-e5d4e812-026e-4314-b0e0-c7c3e7dc8720 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:49.049698 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e5d4e812-026e-4314-b0e0-c7c3e7dc8720 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] 10.222.0.52 "GET /compute/v2.1/servers/41c45cc9-0697-4ca0-a968-c982723b2155" status: 200 len: 1407 microversion: 2.54 time: 0.267053 Oct 19 03:31:49.066511 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2161/4236] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:31:48 2022] GET /compute/v2.1/servers/41c45cc9-0697-4ca0-a968-c982723b2155 => generated 1407 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:31:49.780658 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-58d0d7bb-047a-465e-811b-b8e26a6f02cb tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:49.781280 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-58d0d7bb-047a-465e-811b-b8e26a6f02cb tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 4b805c13-68bb-4794-87b6-a63598253193] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:49.794993 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-58d0d7bb-047a-465e-811b-b8e26a6f02cb tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:49.800554 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-58d0d7bb-047a-465e-811b-b8e26a6f02cb tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:49.800554 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-58d0d7bb-047a-465e-811b-b8e26a6f02cb tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:49.800554 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-58d0d7bb-047a-465e-811b-b8e26a6f02cb tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:49.800554 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-58d0d7bb-047a-465e-811b-b8e26a6f02cb tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:49.800934 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-58d0d7bb-047a-465e-811b-b8e26a6f02cb tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:49.806434 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-f2b72724-6c78-46dd-9d72-0fe86e6479d8 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f134d05b1e449b48d90579b76fe6b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21f8ce48b034df68b5b6361dd252095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:49.816169 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f2b72724-6c78-46dd-9d72-0fe86e6479d8 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] 10.222.0.52 "GET /compute/v2.1/servers/36412f0c-aebd-4ba7-9818-3164375a86c1" status: 200 len: 1323 microversion: 2.1 time: 1.064193 Oct 19 03:31:49.816848 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2076/4237] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:31:48 2022] GET /compute/v2.1/servers/36412f0c-aebd-4ba7-9818-3164375a86c1 => generated 1323 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:31:50.083930 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f5a0bd76-5b83-48b5-a371-28c6aca2b787 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:50.085506 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f5a0bd76-5b83-48b5-a371-28c6aca2b787 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] [instance: 41c45cc9-0697-4ca0-a968-c982723b2155] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:50.101617 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f5a0bd76-5b83-48b5-a371-28c6aca2b787 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:50.103740 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f5a0bd76-5b83-48b5-a371-28c6aca2b787 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:50.108270 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f5a0bd76-5b83-48b5-a371-28c6aca2b787 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:50.109303 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f5a0bd76-5b83-48b5-a371-28c6aca2b787 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:50.110040 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f5a0bd76-5b83-48b5-a371-28c6aca2b787 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:50.110680 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f5a0bd76-5b83-48b5-a371-28c6aca2b787 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:50.362977 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-f5a0bd76-5b83-48b5-a371-28c6aca2b787 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:50.370992 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-58d0d7bb-047a-465e-811b-b8e26a6f02cb tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:50.388492 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-f5a0bd76-5b83-48b5-a371-28c6aca2b787 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:50.389914 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-58d0d7bb-047a-465e-811b-b8e26a6f02cb tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/4b805c13-68bb-4794-87b6-a63598253193" status: 200 len: 1511 microversion: 2.1 time: 0.612526 Oct 19 03:31:50.391042 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2162/4238] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:31:49 2022] GET /compute/v2.1/servers/4b805c13-68bb-4794-87b6-a63598253193 => generated 1511 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:31:50.411079 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-f5a0bd76-5b83-48b5-a371-28c6aca2b787 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:50.417966 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f5a0bd76-5b83-48b5-a371-28c6aca2b787 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] 10.222.0.52 "GET /compute/v2.1/servers/41c45cc9-0697-4ca0-a968-c982723b2155" status: 200 len: 1407 microversion: 2.54 time: 0.338637 Oct 19 03:31:50.419011 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2077/4239] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:31:50 2022] GET /compute/v2.1/servers/41c45cc9-0697-4ca0-a968-c982723b2155 => generated 1407 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:31:50.841976 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-10bbb874-1559-460b-a7f0-23f2f9b4b50c tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:50.844110 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-10bbb874-1559-460b-a7f0-23f2f9b4b50c tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] [instance: 36412f0c-aebd-4ba7-9818-3164375a86c1] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:50.866853 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-c8ccd609-debb-4504-aa89-ae902d9bdf3d req-15b3db84-f961-4578-9fee-c35b8918784a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36412f0c-aebd-4ba7-9818-3164375a86c1", "name": "network-vif-plugged", "status": "completed", "tag": "3ac0d02e-1d59-4692-bd92-992d8a3f1141"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:31:50.870039 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-10bbb874-1559-460b-a7f0-23f2f9b4b50c tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:50.870548 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-10bbb874-1559-460b-a7f0-23f2f9b4b50c tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:50.871048 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-10bbb874-1559-460b-a7f0-23f2f9b4b50c tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:50.872119 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-10bbb874-1559-460b-a7f0-23f2f9b4b50c tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:50.872777 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-10bbb874-1559-460b-a7f0-23f2f9b4b50c tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:50.874723 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-10bbb874-1559-460b-a7f0-23f2f9b4b50c tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:50.894160 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-c8ccd609-debb-4504-aa89-ae902d9bdf3d req-15b3db84-f961-4578-9fee-c35b8918784a service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:50.894737 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-c8ccd609-debb-4504-aa89-ae902d9bdf3d req-15b3db84-f961-4578-9fee-c35b8918784a service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:50.895256 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-c8ccd609-debb-4504-aa89-ae902d9bdf3d req-15b3db84-f961-4578-9fee-c35b8918784a service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:50.926791 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-c8ccd609-debb-4504-aa89-ae902d9bdf3d req-15b3db84-f961-4578-9fee-c35b8918784a service nova] Creating event network-vif-plugged:3ac0d02e-1d59-4692-bd92-992d8a3f1141 for instance 36412f0c-aebd-4ba7-9818-3164375a86c1 on n-h1-861333-8 Oct 19 03:31:50.936833 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-c8ccd609-debb-4504-aa89-ae902d9bdf3d req-15b3db84-f961-4578-9fee-c35b8918784a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075733 Oct 19 03:31:50.941590 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2078/4240] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:31:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:31:51.420664 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-26bba25e-3eac-4ea9-bb27-10dd3be3035e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:51.421342 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-26bba25e-3eac-4ea9-bb27-10dd3be3035e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 4b805c13-68bb-4794-87b6-a63598253193] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:51.434826 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-26bba25e-3eac-4ea9-bb27-10dd3be3035e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:51.435596 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-26bba25e-3eac-4ea9-bb27-10dd3be3035e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:51.436196 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-26bba25e-3eac-4ea9-bb27-10dd3be3035e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:51.437067 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-26bba25e-3eac-4ea9-bb27-10dd3be3035e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:51.441260 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-26bba25e-3eac-4ea9-bb27-10dd3be3035e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:51.445777 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-26bba25e-3eac-4ea9-bb27-10dd3be3035e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:51.516785 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-10bbb874-1559-460b-a7f0-23f2f9b4b50c tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f134d05b1e449b48d90579b76fe6b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21f8ce48b034df68b5b6361dd252095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:51.537591 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-10bbb874-1559-460b-a7f0-23f2f9b4b50c tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] 10.222.0.52 "GET /compute/v2.1/servers/36412f0c-aebd-4ba7-9818-3164375a86c1" status: 200 len: 1323 microversion: 2.1 time: 0.700874 Oct 19 03:31:51.551015 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2163/4241] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:31:50 2022] GET /compute/v2.1/servers/36412f0c-aebd-4ba7-9818-3164375a86c1 => generated 1323 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:31:51.561331 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f0e1ece9-945f-48fb-82fa-bb196316d0bf tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:51.562235 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f0e1ece9-945f-48fb-82fa-bb196316d0bf tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] [instance: 41c45cc9-0697-4ca0-a968-c982723b2155] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:51.568786 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f0e1ece9-945f-48fb-82fa-bb196316d0bf tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:51.569536 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f0e1ece9-945f-48fb-82fa-bb196316d0bf tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:51.570406 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f0e1ece9-945f-48fb-82fa-bb196316d0bf tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:51.571276 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f0e1ece9-945f-48fb-82fa-bb196316d0bf tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:51.572412 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f0e1ece9-945f-48fb-82fa-bb196316d0bf tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:51.573010 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f0e1ece9-945f-48fb-82fa-bb196316d0bf tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:51.767447 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f0e1ece9-945f-48fb-82fa-bb196316d0bf tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:51.779805 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f0e1ece9-945f-48fb-82fa-bb196316d0bf tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:51.788039 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f0e1ece9-945f-48fb-82fa-bb196316d0bf tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:51.789871 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f0e1ece9-945f-48fb-82fa-bb196316d0bf tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] 10.222.0.52 "GET /compute/v2.1/servers/41c45cc9-0697-4ca0-a968-c982723b2155" status: 200 len: 1407 microversion: 2.54 time: 0.233353 Oct 19 03:31:51.793071 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2164/4242] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:31:51 2022] GET /compute/v2.1/servers/41c45cc9-0697-4ca0-a968-c982723b2155 => generated 1407 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:31:51.873208 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-26bba25e-3eac-4ea9-bb27-10dd3be3035e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:51.884079 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-26bba25e-3eac-4ea9-bb27-10dd3be3035e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/4b805c13-68bb-4794-87b6-a63598253193" status: 200 len: 1511 microversion: 2.1 time: 0.472179 Oct 19 03:31:51.885161 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2079/4243] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:31:51 2022] GET /compute/v2.1/servers/4b805c13-68bb-4794-87b6-a63598253193 => generated 1511 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:31:52.565521 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-70ca8b2b-9c9f-4786-9973-f2319f11b482 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:52.566797 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-70ca8b2b-9c9f-4786-9973-f2319f11b482 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] [instance: 36412f0c-aebd-4ba7-9818-3164375a86c1] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:52.577198 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-70ca8b2b-9c9f-4786-9973-f2319f11b482 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:52.577725 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-70ca8b2b-9c9f-4786-9973-f2319f11b482 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:52.578172 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-70ca8b2b-9c9f-4786-9973-f2319f11b482 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:52.583131 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-70ca8b2b-9c9f-4786-9973-f2319f11b482 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:52.583908 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-70ca8b2b-9c9f-4786-9973-f2319f11b482 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:52.584821 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-70ca8b2b-9c9f-4786-9973-f2319f11b482 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:52.819179 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d9115931-e291-40d6-9cbe-88a64aaf17ce tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:52.819951 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d9115931-e291-40d6-9cbe-88a64aaf17ce tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] [instance: 41c45cc9-0697-4ca0-a968-c982723b2155] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:52.828798 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d9115931-e291-40d6-9cbe-88a64aaf17ce tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:52.829296 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d9115931-e291-40d6-9cbe-88a64aaf17ce tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:52.829765 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d9115931-e291-40d6-9cbe-88a64aaf17ce tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:52.830482 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d9115931-e291-40d6-9cbe-88a64aaf17ce tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:52.830939 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d9115931-e291-40d6-9cbe-88a64aaf17ce tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:52.831382 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d9115931-e291-40d6-9cbe-88a64aaf17ce tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:53.079797 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d9115931-e291-40d6-9cbe-88a64aaf17ce tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:53.090337 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d9115931-e291-40d6-9cbe-88a64aaf17ce tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:53.092649 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d9115931-e291-40d6-9cbe-88a64aaf17ce tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:53.094238 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d9115931-e291-40d6-9cbe-88a64aaf17ce tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] 10.222.0.52 "GET /compute/v2.1/servers/41c45cc9-0697-4ca0-a968-c982723b2155" status: 200 len: 1407 microversion: 2.54 time: 0.278814 Oct 19 03:31:53.094916 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2080/4244] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:31:52 2022] GET /compute/v2.1/servers/41c45cc9-0697-4ca0-a968-c982723b2155 => generated 1407 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:31:53.110700 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-449c0a67-a1be-461f-9292-a42d2f00c7f9 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:53.114633 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-449c0a67-a1be-461f-9292-a42d2f00c7f9 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 4b805c13-68bb-4794-87b6-a63598253193] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:53.135262 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-449c0a67-a1be-461f-9292-a42d2f00c7f9 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:53.136086 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-449c0a67-a1be-461f-9292-a42d2f00c7f9 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:53.136705 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-449c0a67-a1be-461f-9292-a42d2f00c7f9 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:53.137907 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-449c0a67-a1be-461f-9292-a42d2f00c7f9 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:53.138823 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-449c0a67-a1be-461f-9292-a42d2f00c7f9 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:53.139435 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-449c0a67-a1be-461f-9292-a42d2f00c7f9 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:53.152300 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-70ca8b2b-9c9f-4786-9973-f2319f11b482 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f134d05b1e449b48d90579b76fe6b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21f8ce48b034df68b5b6361dd252095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:53.170756 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-70ca8b2b-9c9f-4786-9973-f2319f11b482 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] 10.222.0.52 "GET /compute/v2.1/servers/36412f0c-aebd-4ba7-9818-3164375a86c1" status: 200 len: 1323 microversion: 2.1 time: 0.608980 Oct 19 03:31:53.171845 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2165/4245] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:31:52 2022] GET /compute/v2.1/servers/36412f0c-aebd-4ba7-9818-3164375a86c1 => generated 1323 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:31:53.662467 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b147244f-1df7-445f-86e9-2550af2f145b tempest-ServerGroup264TestJSON-1632464843 tempest-ServerGroup264TestJSON-1632464843-project] Action: 'create', calling method: .version_select at 0x7fc134f43c10>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:31:53.680400 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-b147244f-1df7-445f-86e9-2550af2f145b tempest-ServerGroup264TestJSON-1632464843 tempest-ServerGroup264TestJSON-1632464843-project] Getting quotas for project 7120438d784e4ecf8fa227d5c5303416. Resources: {'server_groups'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:31:53.690089 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-b147244f-1df7-445f-86e9-2550af2f145b tempest-ServerGroup264TestJSON-1632464843 tempest-ServerGroup264TestJSON-1632464843-project] Getting quotas for user b14a62e4516b4f089a09661f1ac40ea5 and project 7120438d784e4ecf8fa227d5c5303416. Resources: {'server_groups'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:31:53.709632 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:31:53.715898 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-449c0a67-a1be-461f-9292-a42d2f00c7f9 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:53.724104 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-449c0a67-a1be-461f-9292-a42d2f00c7f9 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/4b805c13-68bb-4794-87b6-a63598253193" status: 200 len: 1511 microversion: 2.1 time: 0.626507 Oct 19 03:31:53.724703 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2081/4246] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:31:53 2022] GET /compute/v2.1/servers/4b805c13-68bb-4794-87b6-a63598253193 => generated 1511 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:31:53.770688 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-b147244f-1df7-445f-86e9-2550af2f145b tempest-ServerGroup264TestJSON-1632464843 tempest-ServerGroup264TestJSON-1632464843-project] Getting quotas for project 7120438d784e4ecf8fa227d5c5303416. Resources: {'server_groups'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:31:53.775839 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-b147244f-1df7-445f-86e9-2550af2f145b tempest-ServerGroup264TestJSON-1632464843 tempest-ServerGroup264TestJSON-1632464843-project] Getting quotas for user b14a62e4516b4f089a09661f1ac40ea5 and project 7120438d784e4ecf8fa227d5c5303416. Resources: {'server_groups'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:31:53.788868 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b147244f-1df7-445f-86e9-2550af2f145b tempest-ServerGroup264TestJSON-1632464843 tempest-ServerGroup264TestJSON-1632464843-project] 10.222.0.52 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.248954 Oct 19 03:31:53.789512 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2166/4247] 10.222.0.52 () {62 vars in 1214 bytes} [Wed Oct 19 03:31:53 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 03:31:53.801093 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e66c3253-cd33-432e-98d2-d2a18870ced3 tempest-ServerGroup264TestJSON-1632464843 tempest-ServerGroup264TestJSON-1632464843-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:53.812369 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e66c3253-cd33-432e-98d2-d2a18870ced3 tempest-ServerGroup264TestJSON-1632464843 tempest-ServerGroup264TestJSON-1632464843-project] 10.222.0.52 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.015078 Oct 19 03:31:53.813126 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2082/4248] 10.222.0.52 () {60 vars in 1193 bytes} [Wed Oct 19 03:31:53 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 03:31:53.824226 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e7ec96a6-9441-4ed8-bf4a-4518c3c4c89d tempest-ServerGroup264TestJSON-1632464843 tempest-ServerGroup264TestJSON-1632464843-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:53.833166 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e7ec96a6-9441-4ed8-bf4a-4518c3c4c89d tempest-ServerGroup264TestJSON-1632464843 tempest-ServerGroup264TestJSON-1632464843-project] 10.222.0.52 "GET /compute/v2.1/os-server-groups/1794acae-b8ab-4c64-a557-884140d5d4e6" status: 200 len: 235 microversion: 2.64 time: 0.012838 Oct 19 03:31:53.834034 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2167/4249] 10.222.0.52 () {60 vars in 1304 bytes} [Wed Oct 19 03:31:53 2022] GET /compute/v2.1/os-server-groups/1794acae-b8ab-4c64-a557-884140d5d4e6 => generated 235 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 03:31:53.844602 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5c40d7a8-e77e-4843-9e4c-cf0b02f1e9f7 tempest-ServerGroup264TestJSON-1632464843 tempest-ServerGroup264TestJSON-1632464843-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:53.921773 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5c40d7a8-e77e-4843-9e4c-cf0b02f1e9f7 tempest-ServerGroup264TestJSON-1632464843 tempest-ServerGroup264TestJSON-1632464843-project] 10.222.0.52 "DELETE /compute/v2.1/os-server-groups/1794acae-b8ab-4c64-a557-884140d5d4e6" status: 204 len: 0 microversion: 2.64 time: 0.080987 Oct 19 03:31:53.922612 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2083/4250] 10.222.0.52 () {60 vars in 1307 bytes} [Wed Oct 19 03:31:53 2022] DELETE /compute/v2.1/os-server-groups/1794acae-b8ab-4c64-a557-884140d5d4e6 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 19 03:31:53.933486 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1e84c8c4-950f-4f10-a4e6-240a31c0bbc4 tempest-ServerGroup264TestJSON-1632464843 tempest-ServerGroup264TestJSON-1632464843-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:53.942842 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-1e84c8c4-950f-4f10-a4e6-240a31c0bbc4 tempest-ServerGroup264TestJSON-1632464843 tempest-ServerGroup264TestJSON-1632464843-project] HTTP exception thrown: Instance group 1794acae-b8ab-4c64-a557-884140d5d4e6 could not be found. Oct 19 03:31:53.946448 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1e84c8c4-950f-4f10-a4e6-240a31c0bbc4 tempest-ServerGroup264TestJSON-1632464843 tempest-ServerGroup264TestJSON-1632464843-project] Request method failure captured: Oct 19 03:31:53.946448 n-d-861333-8 devstack@n-api.service[121135]: request: DELETE /compute/v2.1/os-server-groups/1794acae-b8ab-4c64-a557-884140d5d4e6 HTTP/1.1 Oct 19 03:31:53.946448 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:31:53.946448 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:31:53.946448 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:31:53.946448 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:31:53.946448 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:31:53.946448 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:31:53.946448 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:31:53.946448 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:31:53.946448 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2-pS4IZL470KqmGk2i5dP2TACT8JBYv9vr7O7gnGN0Xrt55wFlq1YgtZbJem-0g08LWaH5JXKB6tS0pghRcaYDa_T0S51bijsgAhauP22o9LoJoFoR_U4DmzXjGzmOMvC2OVuaGdNWPdzvJptIapg1EoIl5tNZIBH-2Ssl5cdwPT78 Oct 19 03:31:53.946448 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:31:53.946448 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:31:53.946448 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:31:53.946448 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:31:53.946448 n-d-861333-8 devstack@n-api.service[121135]: X-Openstack-Nova-Api-Version: 2.64 Oct 19 03:31:53.946448 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:31:53.946448 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:31:53.946448 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 7120438d784e4ecf8fa227d5c5303416 Oct 19 03:31:53.946448 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ServerGroup264TestJSON-1632464843 Oct 19 03:31:53.946448 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:31:53.946448 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:31:53.948114 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7120438d784e4ecf8fa227d5c5303416"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7120438d784e4ecf8fa227d5c5303416"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7120438d784e4ecf8fa227d5c5303416"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7120438d784e4ecf8fa227d5c5303416", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:31:53.948114 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ServerGroup264TestJSON-1632464843 Oct 19 03:31:53.948114 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 7120438d784e4ecf8fa227d5c5303416 Oct 19 03:31:53.948114 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ServerGroup264TestJSON-1632464843 Oct 19 03:31:53.948114 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ServerGroup264TestJSON-1632464843-project Oct 19 03:31:53.948114 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:31:53.948114 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:31:53.948114 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: b14a62e4516b4f089a09661f1ac40ea5 Oct 19 03:31:53.948114 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ServerGroup264TestJSON-1632464843-project Oct 19 03:31:53.948114 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:31:53.948114 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance group 1794acae-b8ab-4c64-a557-884140d5d4e6 could not be found. Oct 19 03:31:53.948114 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '1794acae-b8ab-4c64-a557-884140d5d4e6'} Oct 19 03:31:53.948832 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:31:53.948832 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:31:53.948832 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 19 03:31:53.948832 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 19 03:31:53.948832 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 03:31:53.948832 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 03:31:53.948832 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 19 03:31:53.948832 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 19 03:31:53.948832 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 19 03:31:53.948832 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 19 03:31:53.948832 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 19 03:31:53.948832 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 19 03:31:53.948832 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 1794acae-b8ab-4c64-a557-884140d5d4e6 could not be found. Oct 19 03:31:53.948832 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:31:53.948832 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:31:53.948832 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:31:53.948832 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:31:53.948832 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:31:53.948832 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:31:53.949794 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:31:53.949794 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:31:53.949794 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:31:53.949794 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:31:53.949794 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 19 03:31:53.949794 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:31:53.949794 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 1794acae-b8ab-4c64-a557-884140d5d4e6 could not be found. Oct 19 03:31:53.949794 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:31:53.949794 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:31:53.949794 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:31:53.949794 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:31:53.949794 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:31:53.949794 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:31:53.949794 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:31:53.949794 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:31:53.949794 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 1794acae-b8ab-4c64-a557-884140d5d4e6 could not be found. Oct 19 03:31:53.949794 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:31:53.953579 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1e84c8c4-950f-4f10-a4e6-240a31c0bbc4 tempest-ServerGroup264TestJSON-1632464843 tempest-ServerGroup264TestJSON-1632464843-project] Returning 404 to user: Instance group 1794acae-b8ab-4c64-a557-884140d5d4e6 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:31:53.953579 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1e84c8c4-950f-4f10-a4e6-240a31c0bbc4 tempest-ServerGroup264TestJSON-1632464843 tempest-ServerGroup264TestJSON-1632464843-project] 10.222.0.52 "DELETE /compute/v2.1/os-server-groups/1794acae-b8ab-4c64-a557-884140d5d4e6" status: 404 len: 117 microversion: 2.64 time: 0.020582 Oct 19 03:31:53.953579 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2168/4251] 10.222.0.52 () {60 vars in 1307 bytes} [Wed Oct 19 03:31:53 2022] DELETE /compute/v2.1/os-server-groups/1794acae-b8ab-4c64-a557-884140d5d4e6 => generated 117 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 19 03:31:54.129618 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-bc9a19e2-f962-4b76-9acb-0a1fbab16adb tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:54.132180 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-bc9a19e2-f962-4b76-9acb-0a1fbab16adb tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] [instance: 41c45cc9-0697-4ca0-a968-c982723b2155] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:54.143762 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bc9a19e2-f962-4b76-9acb-0a1fbab16adb tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:54.144672 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bc9a19e2-f962-4b76-9acb-0a1fbab16adb tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:54.145458 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bc9a19e2-f962-4b76-9acb-0a1fbab16adb tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:54.146854 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bc9a19e2-f962-4b76-9acb-0a1fbab16adb tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:54.148111 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bc9a19e2-f962-4b76-9acb-0a1fbab16adb tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:54.149103 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bc9a19e2-f962-4b76-9acb-0a1fbab16adb tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:54.196671 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-8b2ec902-7ddd-4650-8c91-78a772b631aa tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:54.197422 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-8b2ec902-7ddd-4650-8c91-78a772b631aa tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] [instance: 36412f0c-aebd-4ba7-9818-3164375a86c1] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:54.210314 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8b2ec902-7ddd-4650-8c91-78a772b631aa tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:54.212907 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8b2ec902-7ddd-4650-8c91-78a772b631aa tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:54.213534 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8b2ec902-7ddd-4650-8c91-78a772b631aa tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:54.217906 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8b2ec902-7ddd-4650-8c91-78a772b631aa tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:54.218665 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8b2ec902-7ddd-4650-8c91-78a772b631aa tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:54.219262 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8b2ec902-7ddd-4650-8c91-78a772b631aa tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:54.464951 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-bc9a19e2-f962-4b76-9acb-0a1fbab16adb tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:54.480312 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-bc9a19e2-f962-4b76-9acb-0a1fbab16adb tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:54.482106 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-bc9a19e2-f962-4b76-9acb-0a1fbab16adb tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:54.486302 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-bc9a19e2-f962-4b76-9acb-0a1fbab16adb tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] 10.222.0.52 "GET /compute/v2.1/servers/41c45cc9-0697-4ca0-a968-c982723b2155" status: 200 len: 1407 microversion: 2.54 time: 0.365217 Oct 19 03:31:54.491129 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2084/4252] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:31:54 2022] GET /compute/v2.1/servers/41c45cc9-0697-4ca0-a968-c982723b2155 => generated 1407 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:31:54.687414 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-8b2ec902-7ddd-4650-8c91-78a772b631aa tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f134d05b1e449b48d90579b76fe6b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21f8ce48b034df68b5b6361dd252095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:54.710924 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-8b2ec902-7ddd-4650-8c91-78a772b631aa tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] 10.222.0.52 "GET /compute/v2.1/servers/36412f0c-aebd-4ba7-9818-3164375a86c1" status: 200 len: 1520 microversion: 2.1 time: 0.516400 Oct 19 03:31:54.713466 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2169/4253] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:31:54 2022] GET /compute/v2.1/servers/36412f0c-aebd-4ba7-9818-3164375a86c1 => generated 1520 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:31:54.764869 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d7ea5d6c-b714-42b4-b30f-e10df43faa3a tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:54.765317 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d7ea5d6c-b714-42b4-b30f-e10df43faa3a tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 4b805c13-68bb-4794-87b6-a63598253193] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:54.794617 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d7ea5d6c-b714-42b4-b30f-e10df43faa3a tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:54.795128 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d7ea5d6c-b714-42b4-b30f-e10df43faa3a tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:54.795577 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d7ea5d6c-b714-42b4-b30f-e10df43faa3a tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:54.796311 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d7ea5d6c-b714-42b4-b30f-e10df43faa3a tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:54.801902 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d7ea5d6c-b714-42b4-b30f-e10df43faa3a tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:54.801902 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d7ea5d6c-b714-42b4-b30f-e10df43faa3a tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:54.990075 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1809800c-6ea6-4d1c-9c3d-0e5545137278 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1911369027", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "425dc398-fc2a-401d-81ad-2b7cb01decba"}]}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:31:55.000968 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1809800c-6ea6-4d1c-9c3d-0e5545137278 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Request method failure captured: Oct 19 03:31:55.000968 n-d-861333-8 devstack@n-api.service[121135]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 19 03:31:55.000968 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:31:55.000968 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:31:55.000968 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:31:55.000968 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 243 Oct 19 03:31:55.000968 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:31:55.000968 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:31:55.000968 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:31:55.000968 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:31:55.000968 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2-QyA4V-REaMKv6O27P_lPX27y7pPDdbAOABYdtxj4hCe0h2NIkCOh8UMPupkutxUijRkZel7I9QPr9TR2xSdvpmwCfHIVT-vw9SyiuLk0XPN4CE7dLat5qh9Q3y1TfJ1ssuFgPUYG8VCYnk5O0OAL1A3IAXgfaVBoA5wx6gv4jRtY Oct 19 03:31:55.000968 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:31:55.000968 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:31:55.000968 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:31:55.000968 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:31:55.000968 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:31:55.000968 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:31:55.000968 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: b21f8ce48b034df68b5b6361dd252095 Oct 19 03:31:55.000968 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-2089814340 Oct 19 03:31:55.000968 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:31:55.000968 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:31:55.002040 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b21f8ce48b034df68b5b6361dd252095"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b21f8ce48b034df68b5b6361dd252095"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b21f8ce48b034df68b5b6361dd252095"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b21f8ce48b034df68b5b6361dd252095", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:31:55.002040 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-2089814340 Oct 19 03:31:55.002040 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: b21f8ce48b034df68b5b6361dd252095 Oct 19 03:31:55.002040 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-2089814340 Oct 19 03:31:55.002040 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ServerMetadataNegativeTestJSON-2089814340-project Oct 19 03:31:55.002040 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:31:55.002040 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:31:55.002040 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 1f134d05b1e449b48d90579b76fe6b94 Oct 19 03:31:55.002040 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-2089814340-project Oct 19 03:31:55.002040 n-d-861333-8 devstack@n-api.service[121135]: Oct 19 03:31:55.002040 n-d-861333-8 devstack@n-api.service[121135]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1911369027", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "425dc398-fc2a-401d-81ad-2b7cb01decba"}]}} Oct 19 03:31:55.002624 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:31:55.002624 n-d-861333-8 devstack@n-api.service[121135]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 19 03:31:55.002624 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1911369027', 'imageRef': '9e16d73e-70ea-4421-aee3-047d80396c02', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '425dc398-fc2a-401d-81ad-2b7cb01decba'}]}}} Oct 19 03:31:55.002624 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:31:55.002624 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:31:55.002624 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 03:31:55.002624 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 03:31:55.002624 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 03:31:55.002624 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise error Oct 19 03:31:55.002624 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 19 03:31:55.002624 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:31:55.002624 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 19 03:31:55.002624 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 19 03:31:55.002624 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 19 03:31:55.002624 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 19 03:31:55.002624 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 19 03:31:55.002624 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:31:55.002624 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 19 03:31:55.002624 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi {'': 'data1'} Oct 19 03:31:55.003534 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:31:55.003534 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:31:55.003534 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:31:55.003534 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:31:55.003534 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:31:55.003534 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:31:55.003534 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:31:55.003534 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:31:55.003534 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:31:55.003534 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:31:55.003534 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:31:55.003534 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:31:55.003534 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 03:31:55.003534 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 03:31:55.003534 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 03:31:55.003534 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 03:31:55.003534 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 03:31:55.003534 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 03:31:55.003534 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 19 03:31:55.003534 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:31:55.004489 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:31:55.004489 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:31:55.004489 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:31:55.004489 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:31:55.004489 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:31:55.004489 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 03:31:55.004489 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 03:31:55.004489 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 19 03:31:55.004489 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:31:55.004489 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1809800c-6ea6-4d1c-9c3d-0e5545137278 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:31:55.004972 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1809800c-6ea6-4d1c-9c3d-0e5545137278 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.022555 Oct 19 03:31:55.006176 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2170/4254] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:31:54 2022] POST /compute/v2.1/servers => generated 175 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 03:31:55.019181 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4a37e31d-a628-4785-8f0a-36c20a2b5f55 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:55.020837 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4a37e31d-a628-4785-8f0a-36c20a2b5f55 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] [instance: 1d4cd04b-ccc7-449c-bc84-1ca3747d2fb0] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:55.037827 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-4a37e31d-a628-4785-8f0a-36c20a2b5f55 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] HTTP exception thrown: Instance 1d4cd04b-ccc7-449c-bc84-1ca3747d2fb0 could not be found. Oct 19 03:31:55.053146 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4a37e31d-a628-4785-8f0a-36c20a2b5f55 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Request method failure captured: Oct 19 03:31:55.053146 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/1d4cd04b-ccc7-449c-bc84-1ca3747d2fb0/metadata HTTP/1.1 Oct 19 03:31:55.053146 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:31:55.053146 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:31:55.053146 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:31:55.053146 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:31:55.053146 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:31:55.053146 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:31:55.053146 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:31:55.053146 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:31:55.053146 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2-QyA4V-REaMKv6O27P_lPX27y7pPDdbAOABYdtxj4hCe0h2NIkCOh8UMPupkutxUijRkZel7I9QPr9TR2xSdvpmwCfHIVT-vw9SyiuLk0XPN4CE7dLat5qh9Q3y1TfJ1ssuFgPUYG8VCYnk5O0OAL1A3IAXgfaVBoA5wx6gv4jRtY Oct 19 03:31:55.053146 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:31:55.053146 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:31:55.053146 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:31:55.053146 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:31:55.053146 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:31:55.053146 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:31:55.053146 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: b21f8ce48b034df68b5b6361dd252095 Oct 19 03:31:55.053146 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-2089814340 Oct 19 03:31:55.053146 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:31:55.053146 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:31:55.054401 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b21f8ce48b034df68b5b6361dd252095"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b21f8ce48b034df68b5b6361dd252095"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b21f8ce48b034df68b5b6361dd252095"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b21f8ce48b034df68b5b6361dd252095", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:31:55.054401 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-2089814340 Oct 19 03:31:55.054401 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: b21f8ce48b034df68b5b6361dd252095 Oct 19 03:31:55.054401 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-2089814340 Oct 19 03:31:55.054401 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ServerMetadataNegativeTestJSON-2089814340-project Oct 19 03:31:55.054401 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:31:55.054401 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:31:55.054401 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 1f134d05b1e449b48d90579b76fe6b94 Oct 19 03:31:55.054401 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-2089814340-project Oct 19 03:31:55.054401 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:31:55.054401 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance 1d4cd04b-ccc7-449c-bc84-1ca3747d2fb0 could not be found. Oct 19 03:31:55.054984 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'server_id': '1d4cd04b-ccc7-449c-bc84-1ca3747d2fb0'} Oct 19 03:31:55.054984 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:31:55.054984 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:31:55.054984 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:31:55.054984 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:31:55.054984 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:31:55.054984 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:31:55.054984 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 19 03:31:55.054984 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 19 03:31:55.054984 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d4cd04b-ccc7-449c-bc84-1ca3747d2fb0 could not be found. Oct 19 03:31:55.054984 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:31:55.054984 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:31:55.054984 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:31:55.054984 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:31:55.054984 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:31:55.054984 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:31:55.054984 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:31:55.054984 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:31:55.054984 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:31:55.054984 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:31:55.056524 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Oct 19 03:31:55.056524 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 19 03:31:55.056524 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:31:55.056524 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:31:55.056524 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d4cd04b-ccc7-449c-bc84-1ca3747d2fb0 could not be found. Oct 19 03:31:55.056524 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:31:55.056524 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:31:55.056524 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:31:55.056524 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:31:55.056524 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:31:55.056524 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:31:55.056524 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:31:55.056524 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:31:55.056524 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d4cd04b-ccc7-449c-bc84-1ca3747d2fb0 could not be found. Oct 19 03:31:55.056524 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:31:55.056524 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4a37e31d-a628-4785-8f0a-36c20a2b5f55 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Returning 404 to user: Instance 1d4cd04b-ccc7-449c-bc84-1ca3747d2fb0 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:31:55.061645 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4a37e31d-a628-4785-8f0a-36c20a2b5f55 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] 10.222.0.52 "GET /compute/v2.1/servers/1d4cd04b-ccc7-449c-bc84-1ca3747d2fb0/metadata" status: 404 len: 111 microversion: 2.1 time: 0.041094 Oct 19 03:31:55.061645 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2171/4255] 10.222.0.52 () {58 vars in 1263 bytes} [Wed Oct 19 03:31:55 2022] GET /compute/v2.1/servers/1d4cd04b-ccc7-449c-bc84-1ca3747d2fb0/metadata => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:31:55.141216 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d374575b-7483-42be-b94e-163ce49b5ca8 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1674889851", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "425dc398-fc2a-401d-81ad-2b7cb01decba"}]}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:31:55.148626 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d374575b-7483-42be-b94e-163ce49b5ca8 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Request method failure captured: Oct 19 03:31:55.148626 n-d-861333-8 devstack@n-api.service[121135]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 19 03:31:55.148626 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:31:55.148626 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:31:55.148626 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:31:55.148626 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 499 Oct 19 03:31:55.148626 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:31:55.148626 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:31:55.148626 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:31:55.148626 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:31:55.148626 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2-QyA4V-REaMKv6O27P_lPX27y7pPDdbAOABYdtxj4hCe0h2NIkCOh8UMPupkutxUijRkZel7I9QPr9TR2xSdvpmwCfHIVT-vw9SyiuLk0XPN4CE7dLat5qh9Q3y1TfJ1ssuFgPUYG8VCYnk5O0OAL1A3IAXgfaVBoA5wx6gv4jRtY Oct 19 03:31:55.148626 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:31:55.148626 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:31:55.148626 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:31:55.148626 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:31:55.148626 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:31:55.148626 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:31:55.148626 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: b21f8ce48b034df68b5b6361dd252095 Oct 19 03:31:55.148626 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-2089814340 Oct 19 03:31:55.148626 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:31:55.148626 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:31:55.152598 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b21f8ce48b034df68b5b6361dd252095"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b21f8ce48b034df68b5b6361dd252095"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b21f8ce48b034df68b5b6361dd252095"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b21f8ce48b034df68b5b6361dd252095", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:31:55.152598 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-2089814340 Oct 19 03:31:55.152598 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: b21f8ce48b034df68b5b6361dd252095 Oct 19 03:31:55.152598 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-2089814340 Oct 19 03:31:55.152598 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ServerMetadataNegativeTestJSON-2089814340-project Oct 19 03:31:55.152598 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:31:55.152598 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:31:55.152598 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 1f134d05b1e449b48d90579b76fe6b94 Oct 19 03:31:55.152598 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-2089814340-project Oct 19 03:31:55.152598 n-d-861333-8 devstack@n-api.service[121135]: Oct 19 03:31:55.153107 n-d-861333-8 devstack@n-api.service[121135]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1674889851", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "425dc398-fc2a-401d-81ad-2b7cb01decba"}]}} Oct 19 03:31:55.153107 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:31:55.153107 n-d-861333-8 devstack@n-api.service[121135]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 19 03:31:55.153107 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1674889851', 'imageRef': '9e16d73e-70ea-4421-aee3-047d80396c02', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '425dc398-fc2a-401d-81ad-2b7cb01decba'}]}}} Oct 19 03:31:55.153107 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:31:55.153107 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:31:55.153544 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 03:31:55.153544 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 03:31:55.153544 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 03:31:55.153544 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise error Oct 19 03:31:55.153544 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 19 03:31:55.153544 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:31:55.153544 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 19 03:31:55.153544 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 19 03:31:55.153544 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 19 03:31:55.153544 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 19 03:31:55.153544 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 19 03:31:55.153544 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:31:55.153544 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 19 03:31:55.153544 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 19 03:31:55.153544 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:31:55.153544 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:31:55.153544 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:31:55.154367 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:31:55.154367 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:31:55.154367 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:31:55.154367 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:31:55.154367 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:31:55.154367 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:31:55.154367 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:31:55.154367 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:31:55.154367 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:31:55.154367 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 03:31:55.154367 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 03:31:55.154367 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 03:31:55.154367 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 03:31:55.154367 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 03:31:55.154367 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 03:31:55.155103 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 19 03:31:55.155103 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:31:55.155103 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:31:55.155103 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:31:55.155103 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:31:55.155103 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:31:55.155103 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:31:55.155103 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 03:31:55.155103 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 03:31:55.155554 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 19 03:31:55.155554 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:31:55.155554 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d374575b-7483-42be-b94e-163ce49b5ca8 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:31:55.155735 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d374575b-7483-42be-b94e-163ce49b5ca8 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.019510 Oct 19 03:31:55.156530 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2172/4256] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:31:55 2022] POST /compute/v2.1/servers => generated 687 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 19 03:31:55.205536 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6e4e9552-e380-4f51-aabe-bd1c5d204b7e tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1534006174", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "425dc398-fc2a-401d-81ad-2b7cb01decba"}]}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:31:55.210932 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6e4e9552-e380-4f51-aabe-bd1c5d204b7e tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Request method failure captured: Oct 19 03:31:55.210932 n-d-861333-8 devstack@n-api.service[121135]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 19 03:31:55.210932 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:31:55.210932 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:31:55.210932 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:31:55.210932 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 500 Oct 19 03:31:55.210932 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:31:55.210932 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:31:55.210932 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:31:55.210932 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:31:55.210932 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2-QyA4V-REaMKv6O27P_lPX27y7pPDdbAOABYdtxj4hCe0h2NIkCOh8UMPupkutxUijRkZel7I9QPr9TR2xSdvpmwCfHIVT-vw9SyiuLk0XPN4CE7dLat5qh9Q3y1TfJ1ssuFgPUYG8VCYnk5O0OAL1A3IAXgfaVBoA5wx6gv4jRtY Oct 19 03:31:55.210932 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:31:55.210932 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:31:55.210932 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:31:55.210932 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:31:55.210932 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:31:55.210932 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:31:55.210932 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: b21f8ce48b034df68b5b6361dd252095 Oct 19 03:31:55.210932 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-2089814340 Oct 19 03:31:55.210932 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:31:55.210932 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:31:55.215846 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b21f8ce48b034df68b5b6361dd252095"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b21f8ce48b034df68b5b6361dd252095"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b21f8ce48b034df68b5b6361dd252095"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b21f8ce48b034df68b5b6361dd252095", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:31:55.215846 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-2089814340 Oct 19 03:31:55.215846 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: b21f8ce48b034df68b5b6361dd252095 Oct 19 03:31:55.215846 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-2089814340 Oct 19 03:31:55.215846 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ServerMetadataNegativeTestJSON-2089814340-project Oct 19 03:31:55.215846 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:31:55.215846 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:31:55.215846 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 1f134d05b1e449b48d90579b76fe6b94 Oct 19 03:31:55.215846 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-2089814340-project Oct 19 03:31:55.215846 n-d-861333-8 devstack@n-api.service[121135]: Oct 19 03:31:55.216592 n-d-861333-8 devstack@n-api.service[121135]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1534006174", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "425dc398-fc2a-401d-81ad-2b7cb01decba"}]}} Oct 19 03:31:55.216592 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:31:55.216592 n-d-861333-8 devstack@n-api.service[121135]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 19 03:31:55.216592 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1534006174', 'imageRef': '9e16d73e-70ea-4421-aee3-047d80396c02', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '425dc398-fc2a-401d-81ad-2b7cb01decba'}]}}} Oct 19 03:31:55.216592 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:31:55.216592 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:31:55.217029 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 03:31:55.217029 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 03:31:55.217029 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 03:31:55.217029 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise error Oct 19 03:31:55.217029 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 19 03:31:55.217029 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:31:55.217029 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 19 03:31:55.217029 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 19 03:31:55.217029 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 19 03:31:55.217029 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 19 03:31:55.217029 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 19 03:31:55.217029 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:31:55.217029 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 19 03:31:55.217029 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 19 03:31:55.217029 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:31:55.217029 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:31:55.217029 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:31:55.218137 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:31:55.218137 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:31:55.218137 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:31:55.218137 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:31:55.218137 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:31:55.218137 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:31:55.218137 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:31:55.218137 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:31:55.218137 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:31:55.218137 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 03:31:55.218137 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 03:31:55.218137 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 03:31:55.218137 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 03:31:55.218137 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 03:31:55.218137 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 03:31:55.219041 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 19 03:31:55.219041 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:31:55.219041 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:31:55.219041 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:31:55.219041 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:31:55.219041 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:31:55.219041 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:31:55.219041 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 03:31:55.219041 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 03:31:55.221804 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 19 03:31:55.221804 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:31:55.221985 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d7ea5d6c-b714-42b4-b30f-e10df43faa3a tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:55.222472 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6e4e9552-e380-4f51-aabe-bd1c5d204b7e tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:31:55.222472 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6e4e9552-e380-4f51-aabe-bd1c5d204b7e tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.015875 Oct 19 03:31:55.222472 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2173/4257] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:31:55 2022] POST /compute/v2.1/servers => generated 689 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 03:31:55.238749 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d7ea5d6c-b714-42b4-b30f-e10df43faa3a tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/4b805c13-68bb-4794-87b6-a63598253193" status: 200 len: 1511 microversion: 2.1 time: 0.493970 Oct 19 03:31:55.239833 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2085/4258] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:31:54 2022] GET /compute/v2.1/servers/4b805c13-68bb-4794-87b6-a63598253193 => generated 1511 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:31:55.315234 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7496d7d4-4dfa-4c75-bcd3-3c97296384c0 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1088382531", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "425dc398-fc2a-401d-81ad-2b7cb01decba"}]}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:31:55.320481 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7496d7d4-4dfa-4c75-bcd3-3c97296384c0 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Request method failure captured: Oct 19 03:31:55.320481 n-d-861333-8 devstack@n-api.service[121135]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 19 03:31:55.320481 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:31:55.320481 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:31:55.320481 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:31:55.320481 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 754 Oct 19 03:31:55.320481 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:31:55.320481 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:31:55.320481 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:31:55.320481 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:31:55.320481 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2-QyA4V-REaMKv6O27P_lPX27y7pPDdbAOABYdtxj4hCe0h2NIkCOh8UMPupkutxUijRkZel7I9QPr9TR2xSdvpmwCfHIVT-vw9SyiuLk0XPN4CE7dLat5qh9Q3y1TfJ1ssuFgPUYG8VCYnk5O0OAL1A3IAXgfaVBoA5wx6gv4jRtY Oct 19 03:31:55.320481 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:31:55.320481 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:31:55.320481 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:31:55.320481 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:31:55.320481 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:31:55.320481 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:31:55.320481 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: b21f8ce48b034df68b5b6361dd252095 Oct 19 03:31:55.320481 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-2089814340 Oct 19 03:31:55.320481 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:31:55.320481 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:31:55.326334 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b21f8ce48b034df68b5b6361dd252095"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b21f8ce48b034df68b5b6361dd252095"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b21f8ce48b034df68b5b6361dd252095"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b21f8ce48b034df68b5b6361dd252095", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:31:55.326334 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-2089814340 Oct 19 03:31:55.326334 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: b21f8ce48b034df68b5b6361dd252095 Oct 19 03:31:55.326334 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-2089814340 Oct 19 03:31:55.326334 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ServerMetadataNegativeTestJSON-2089814340-project Oct 19 03:31:55.326334 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:31:55.326334 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:31:55.326334 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 1f134d05b1e449b48d90579b76fe6b94 Oct 19 03:31:55.326334 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-2089814340-project Oct 19 03:31:55.326334 n-d-861333-8 devstack@n-api.service[121135]: Oct 19 03:31:55.326843 n-d-861333-8 devstack@n-api.service[121135]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1088382531", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "425dc398-fc2a-401d-81ad-2b7cb01decba"}]}} Oct 19 03:31:55.326843 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:31:55.326843 n-d-861333-8 devstack@n-api.service[121135]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 19 03:31:55.327028 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1088382531', 'imageRef': '9e16d73e-70ea-4421-aee3-047d80396c02', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '425dc398-fc2a-401d-81ad-2b7cb01decba'}]}}} Oct 19 03:31:55.327028 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:31:55.327028 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:31:55.327028 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 03:31:55.327028 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 03:31:55.327028 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 03:31:55.327028 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise error Oct 19 03:31:55.327028 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 19 03:31:55.327457 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:31:55.327457 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 19 03:31:55.327457 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 19 03:31:55.327457 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 19 03:31:55.327457 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 19 03:31:55.327457 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 19 03:31:55.327457 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:31:55.327457 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 19 03:31:55.327457 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 19 03:31:55.327457 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:31:55.327457 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:31:55.327457 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:31:55.327457 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:31:55.327457 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:31:55.327457 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:31:55.327457 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:31:55.327457 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:31:55.328338 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:31:55.328338 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:31:55.328338 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:31:55.328338 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:31:55.328338 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 03:31:55.328338 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 03:31:55.328338 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 03:31:55.328338 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 03:31:55.328338 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 03:31:55.328338 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 03:31:55.328827 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 19 03:31:55.328827 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:31:55.328827 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:31:55.328827 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:31:55.328827 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:31:55.328827 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:31:55.328827 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:31:55.328827 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 03:31:55.328827 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 03:31:55.329398 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 19 03:31:55.329398 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:31:55.329576 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7496d7d4-4dfa-4c75-bcd3-3c97296384c0 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:31:55.329576 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7496d7d4-4dfa-4c75-bcd3-3c97296384c0 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.012237 Oct 19 03:31:55.329739 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2174/4259] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:31:55 2022] POST /compute/v2.1/servers => generated 1197 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Oct 19 03:31:55.408833 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-caf9e2a1-ae09-402a-8dcc-d751dfc060f5 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1521681039", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "425dc398-fc2a-401d-81ad-2b7cb01decba"}]}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:31:55.416211 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-caf9e2a1-ae09-402a-8dcc-d751dfc060f5 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Request method failure captured: Oct 19 03:31:55.416211 n-d-861333-8 devstack@n-api.service[121134]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 19 03:31:55.416211 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:31:55.416211 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:31:55.416211 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:31:55.416211 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 1266 Oct 19 03:31:55.416211 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:31:55.416211 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:31:55.416211 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:31:55.416211 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:31:55.416211 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT2-QyA4V-REaMKv6O27P_lPX27y7pPDdbAOABYdtxj4hCe0h2NIkCOh8UMPupkutxUijRkZel7I9QPr9TR2xSdvpmwCfHIVT-vw9SyiuLk0XPN4CE7dLat5qh9Q3y1TfJ1ssuFgPUYG8VCYnk5O0OAL1A3IAXgfaVBoA5wx6gv4jRtY Oct 19 03:31:55.416211 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:31:55.416211 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:31:55.416211 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:31:55.416211 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:31:55.416211 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:31:55.416211 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:31:55.416211 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: b21f8ce48b034df68b5b6361dd252095 Oct 19 03:31:55.416211 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-2089814340 Oct 19 03:31:55.416211 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:31:55.416211 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:31:55.417778 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b21f8ce48b034df68b5b6361dd252095"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b21f8ce48b034df68b5b6361dd252095"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b21f8ce48b034df68b5b6361dd252095"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b21f8ce48b034df68b5b6361dd252095", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:31:55.417778 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-2089814340 Oct 19 03:31:55.417778 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: b21f8ce48b034df68b5b6361dd252095 Oct 19 03:31:55.417778 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-2089814340 Oct 19 03:31:55.417778 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ServerMetadataNegativeTestJSON-2089814340-project Oct 19 03:31:55.417778 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:31:55.417778 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:31:55.417778 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 1f134d05b1e449b48d90579b76fe6b94 Oct 19 03:31:55.417778 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-2089814340-project Oct 19 03:31:55.417778 n-d-861333-8 devstack@n-api.service[121134]: Oct 19 03:31:55.418416 n-d-861333-8 devstack@n-api.service[121134]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1521681039", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "425dc398-fc2a-401d-81ad-2b7cb01decba"}]}} Oct 19 03:31:55.418416 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:31:55.418602 n-d-861333-8 devstack@n-api.service[121134]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 19 03:31:55.418602 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1521681039', 'imageRef': '9e16d73e-70ea-4421-aee3-047d80396c02', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '425dc398-fc2a-401d-81ad-2b7cb01decba'}]}}} Oct 19 03:31:55.418602 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:31:55.418602 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:31:55.418602 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 03:31:55.418602 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 03:31:55.418602 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 03:31:55.418602 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise error Oct 19 03:31:55.418602 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 19 03:31:55.418602 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:31:55.418602 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 19 03:31:55.418602 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 19 03:31:55.418602 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 19 03:31:55.418602 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 19 03:31:55.418602 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 19 03:31:55.418602 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:31:55.418602 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 19 03:31:55.419688 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 19 03:31:55.419688 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:31:55.419688 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:31:55.419688 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:31:55.419688 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:31:55.419688 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:31:55.419688 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:31:55.419688 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:31:55.419688 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:31:55.419688 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:31:55.419688 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:31:55.419688 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:31:55.419688 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:31:55.419688 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 03:31:55.419688 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 03:31:55.419688 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 03:31:55.419688 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 03:31:55.419688 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 03:31:55.419688 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 03:31:55.419688 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 19 03:31:55.419688 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:31:55.419688 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:31:55.419688 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:31:55.419688 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:31:55.419688 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:31:55.419688 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:31:55.419688 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 03:31:55.419688 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 03:31:55.421311 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 19 03:31:55.421311 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:31:55.422816 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-caf9e2a1-ae09-402a-8dcc-d751dfc060f5 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:31:55.424058 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-caf9e2a1-ae09-402a-8dcc-d751dfc060f5 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.037080 Oct 19 03:31:55.431636 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2086/4260] 10.222.0.52 () {60 vars in 1148 bytes} [Wed Oct 19 03:31:55 2022] POST /compute/v2.1/servers => generated 2221 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Oct 19 03:31:55.439342 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-52f958e2-5e71-4dfe-a119-7a0c1b46098e tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:55.439342 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-52f958e2-5e71-4dfe-a119-7a0c1b46098e tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] [instance: d79a5bc9-38a4-473a-83fa-f89aee207115] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:55.451062 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-52f958e2-5e71-4dfe-a119-7a0c1b46098e tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] HTTP exception thrown: Instance d79a5bc9-38a4-473a-83fa-f89aee207115 could not be found. Oct 19 03:31:55.455414 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-52f958e2-5e71-4dfe-a119-7a0c1b46098e tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Request method failure captured: Oct 19 03:31:55.455414 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/d79a5bc9-38a4-473a-83fa-f89aee207115/metadata/test2 HTTP/1.1 Oct 19 03:31:55.455414 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:31:55.455414 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:31:55.455414 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:31:55.455414 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:31:55.455414 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:31:55.455414 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:31:55.455414 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:31:55.455414 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:31:55.455414 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2-QyA4V-REaMKv6O27P_lPX27y7pPDdbAOABYdtxj4hCe0h2NIkCOh8UMPupkutxUijRkZel7I9QPr9TR2xSdvpmwCfHIVT-vw9SyiuLk0XPN4CE7dLat5qh9Q3y1TfJ1ssuFgPUYG8VCYnk5O0OAL1A3IAXgfaVBoA5wx6gv4jRtY Oct 19 03:31:55.455414 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:31:55.455414 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:31:55.455414 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:31:55.455414 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:31:55.455414 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:31:55.455414 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:31:55.455414 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: b21f8ce48b034df68b5b6361dd252095 Oct 19 03:31:55.455414 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-2089814340 Oct 19 03:31:55.455414 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:31:55.455414 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:31:55.455414 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b21f8ce48b034df68b5b6361dd252095"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b21f8ce48b034df68b5b6361dd252095"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b21f8ce48b034df68b5b6361dd252095"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b21f8ce48b034df68b5b6361dd252095", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:31:55.455414 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-2089814340 Oct 19 03:31:55.455414 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: b21f8ce48b034df68b5b6361dd252095 Oct 19 03:31:55.455414 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-2089814340 Oct 19 03:31:55.455414 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ServerMetadataNegativeTestJSON-2089814340-project Oct 19 03:31:55.455414 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:31:55.455414 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:31:55.455414 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 1f134d05b1e449b48d90579b76fe6b94 Oct 19 03:31:55.455414 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-2089814340-project Oct 19 03:31:55.455414 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:31:55.455414 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance d79a5bc9-38a4-473a-83fa-f89aee207115 could not be found. Oct 19 03:31:55.455414 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'server_id': 'd79a5bc9-38a4-473a-83fa-f89aee207115', 'id': 'test2'} Oct 19 03:31:55.455414 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:31:55.455414 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:31:55.455414 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:31:55.455414 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:31:55.455414 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:31:55.455414 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:31:55.455414 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 19 03:31:55.455414 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 19 03:31:55.455414 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d79a5bc9-38a4-473a-83fa-f89aee207115 could not be found. Oct 19 03:31:55.455414 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:31:55.455414 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:31:55.455414 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:31:55.455414 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:31:55.455414 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:31:55.455414 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:31:55.455414 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:31:55.455414 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:31:55.455414 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:31:55.455414 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:31:55.455414 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Oct 19 03:31:55.455414 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 19 03:31:55.455414 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:31:55.455414 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:31:55.455414 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d79a5bc9-38a4-473a-83fa-f89aee207115 could not be found. Oct 19 03:31:55.455414 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:31:55.455414 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:31:55.455414 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:31:55.455414 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:31:55.455414 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:31:55.455414 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:31:55.459411 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:31:55.459411 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:31:55.459411 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d79a5bc9-38a4-473a-83fa-f89aee207115 could not be found. Oct 19 03:31:55.459411 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:31:55.459411 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-52f958e2-5e71-4dfe-a119-7a0c1b46098e tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Returning 404 to user: Instance d79a5bc9-38a4-473a-83fa-f89aee207115 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:31:55.459411 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-52f958e2-5e71-4dfe-a119-7a0c1b46098e tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] 10.222.0.52 "GET /compute/v2.1/servers/d79a5bc9-38a4-473a-83fa-f89aee207115/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.025843 Oct 19 03:31:55.477861 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-82ed2b68-2e70-4760-9faa-92b1453324fa tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:55.480475 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-82ed2b68-2e70-4760-9faa-92b1453324fa tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] [instance: 36412f0c-aebd-4ba7-9818-3164375a86c1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:55.484541 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2175/4261] 10.222.0.52 () {58 vars in 1281 bytes} [Wed Oct 19 03:31:55 2022] GET /compute/v2.1/servers/d79a5bc9-38a4-473a-83fa-f89aee207115/metadata/test2 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:31:55.492606 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-82ed2b68-2e70-4760-9faa-92b1453324fa tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:55.493195 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-82ed2b68-2e70-4760-9faa-92b1453324fa tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:55.493906 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-82ed2b68-2e70-4760-9faa-92b1453324fa tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:55.494858 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-82ed2b68-2e70-4760-9faa-92b1453324fa tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:55.495528 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-82ed2b68-2e70-4760-9faa-92b1453324fa tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:55.496169 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-82ed2b68-2e70-4760-9faa-92b1453324fa tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:55.519148 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-abbf9f6f-76ec-486b-ba1b-aa84bfd0ad6d tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:55.521899 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-abbf9f6f-76ec-486b-ba1b-aa84bfd0ad6d tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] [instance: 41c45cc9-0697-4ca0-a968-c982723b2155] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:55.535039 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-abbf9f6f-76ec-486b-ba1b-aa84bfd0ad6d tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:55.538493 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-abbf9f6f-76ec-486b-ba1b-aa84bfd0ad6d tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:55.539420 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-abbf9f6f-76ec-486b-ba1b-aa84bfd0ad6d tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:55.545636 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-abbf9f6f-76ec-486b-ba1b-aa84bfd0ad6d tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:55.546455 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-abbf9f6f-76ec-486b-ba1b-aa84bfd0ad6d tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:55.547056 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-abbf9f6f-76ec-486b-ba1b-aa84bfd0ad6d tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:55.552226 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-82ed2b68-2e70-4760-9faa-92b1453324fa tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] [instance: 36412f0c-aebd-4ba7-9818-3164375a86c1] Going to try to terminate instance {{(pid=121134) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:31:55.695000 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-abbf9f6f-76ec-486b-ba1b-aa84bfd0ad6d tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:55.706153 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-abbf9f6f-76ec-486b-ba1b-aa84bfd0ad6d tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:55.707604 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-abbf9f6f-76ec-486b-ba1b-aa84bfd0ad6d tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:55.708845 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-abbf9f6f-76ec-486b-ba1b-aa84bfd0ad6d tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] 10.222.0.52 "GET /compute/v2.1/servers/41c45cc9-0697-4ca0-a968-c982723b2155" status: 200 len: 1407 microversion: 2.54 time: 0.193713 Oct 19 03:31:55.709605 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2176/4262] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:31:55 2022] GET /compute/v2.1/servers/41c45cc9-0697-4ca0-a968-c982723b2155 => generated 1407 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:31:55.941153 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-82ed2b68-2e70-4760-9faa-92b1453324fa tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] 10.222.0.52 "DELETE /compute/v2.1/servers/36412f0c-aebd-4ba7-9818-3164375a86c1" status: 204 len: 0 microversion: 2.1 time: 0.467990 Oct 19 03:31:55.942472 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2087/4263] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:31:55 2022] DELETE /compute/v2.1/servers/36412f0c-aebd-4ba7-9818-3164375a86c1 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:31:55.953025 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e1ac7b25-9119-40fa-a94f-8d53868ee3eb tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:55.953688 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e1ac7b25-9119-40fa-a94f-8d53868ee3eb tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] [instance: 36412f0c-aebd-4ba7-9818-3164375a86c1] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:55.966299 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e1ac7b25-9119-40fa-a94f-8d53868ee3eb tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:55.970391 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e1ac7b25-9119-40fa-a94f-8d53868ee3eb tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:55.970882 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e1ac7b25-9119-40fa-a94f-8d53868ee3eb tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:55.971636 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e1ac7b25-9119-40fa-a94f-8d53868ee3eb tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:55.972105 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e1ac7b25-9119-40fa-a94f-8d53868ee3eb tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:55.981441 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e1ac7b25-9119-40fa-a94f-8d53868ee3eb tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:56.215819 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2f1eab9a-b89a-4876-8b24-53d4311dcf5f tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-736777119", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "f8e54e0d-4fa9-490d-b548-d8787f9da4a7"}]}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:31:56.353345 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-2f1eab9a-b89a-4876-8b24-53d4311dcf5f tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] validate_networks() for [('f8e54e0d-4fa9-490d-b548-d8787f9da4a7', None, None, None, None, None)] {{(pid=121134) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:31:56.521695 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-e1ac7b25-9119-40fa-a94f-8d53868ee3eb tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f134d05b1e449b48d90579b76fe6b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21f8ce48b034df68b5b6361dd252095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:56.533936 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e1ac7b25-9119-40fa-a94f-8d53868ee3eb tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] 10.222.0.52 "GET /compute/v2.1/servers/36412f0c-aebd-4ba7-9818-3164375a86c1" status: 200 len: 1526 microversion: 2.1 time: 0.586019 Oct 19 03:31:56.534524 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2177/4264] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:31:55 2022] GET /compute/v2.1/servers/36412f0c-aebd-4ba7-9818-3164375a86c1 => generated 1526 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:31:56.559948 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-dcf9afc1-213f-4f2b-9769-6d85d516a35d tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:56.566542 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-dcf9afc1-213f-4f2b-9769-6d85d516a35d tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 4b805c13-68bb-4794-87b6-a63598253193] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:56.578643 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dcf9afc1-213f-4f2b-9769-6d85d516a35d tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:56.579390 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dcf9afc1-213f-4f2b-9769-6d85d516a35d tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:56.580000 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dcf9afc1-213f-4f2b-9769-6d85d516a35d tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:56.580887 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dcf9afc1-213f-4f2b-9769-6d85d516a35d tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:56.582090 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dcf9afc1-213f-4f2b-9769-6d85d516a35d tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:56.582679 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dcf9afc1-213f-4f2b-9769-6d85d516a35d tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:57.011157 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-dcf9afc1-213f-4f2b-9769-6d85d516a35d tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:57.030196 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-dcf9afc1-213f-4f2b-9769-6d85d516a35d tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/4b805c13-68bb-4794-87b6-a63598253193" status: 200 len: 1511 microversion: 2.1 time: 0.482185 Oct 19 03:31:57.045434 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2178/4265] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:31:56 2022] GET /compute/v2.1/servers/4b805c13-68bb-4794-87b6-a63598253193 => generated 1511 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:31:57.051264 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-71870a56-7f45-48d0-ac2d-80b035381ea9 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:57.051893 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-71870a56-7f45-48d0-ac2d-80b035381ea9 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] [instance: 41c45cc9-0697-4ca0-a968-c982723b2155] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:57.060231 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-71870a56-7f45-48d0-ac2d-80b035381ea9 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:57.060737 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-71870a56-7f45-48d0-ac2d-80b035381ea9 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:57.061180 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-71870a56-7f45-48d0-ac2d-80b035381ea9 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:57.061931 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-71870a56-7f45-48d0-ac2d-80b035381ea9 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:57.062387 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-71870a56-7f45-48d0-ac2d-80b035381ea9 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:57.062815 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-71870a56-7f45-48d0-ac2d-80b035381ea9 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:57.716486 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-71870a56-7f45-48d0-ac2d-80b035381ea9 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:57.732330 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-71870a56-7f45-48d0-ac2d-80b035381ea9 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:57.735732 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-71870a56-7f45-48d0-ac2d-80b035381ea9 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:57.737265 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-71870a56-7f45-48d0-ac2d-80b035381ea9 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] 10.222.0.52 "GET /compute/v2.1/servers/41c45cc9-0697-4ca0-a968-c982723b2155" status: 200 len: 1425 microversion: 2.54 time: 0.700761 Oct 19 03:31:57.738559 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2179/4266] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:31:57 2022] GET /compute/v2.1/servers/41c45cc9-0697-4ca0-a968-c982723b2155 => generated 1425 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:31:57.747332 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-29a7286e-55af-4f5b-b483-643b8e871547 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:57.754169 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-29a7286e-55af-4f5b-b483-643b8e871547 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] [instance: 36412f0c-aebd-4ba7-9818-3164375a86c1] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:57.764064 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-29a7286e-55af-4f5b-b483-643b8e871547 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:57.767423 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-29a7286e-55af-4f5b-b483-643b8e871547 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:57.768121 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-29a7286e-55af-4f5b-b483-643b8e871547 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:57.771678 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-29a7286e-55af-4f5b-b483-643b8e871547 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:57.772486 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-29a7286e-55af-4f5b-b483-643b8e871547 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:57.773696 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-29a7286e-55af-4f5b-b483-643b8e871547 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:58.457200 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-29a7286e-55af-4f5b-b483-643b8e871547 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f134d05b1e449b48d90579b76fe6b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21f8ce48b034df68b5b6361dd252095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:58.469912 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-29a7286e-55af-4f5b-b483-643b8e871547 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] 10.222.0.52 "GET /compute/v2.1/servers/36412f0c-aebd-4ba7-9818-3164375a86c1" status: 200 len: 1526 microversion: 2.1 time: 0.729884 Oct 19 03:31:58.470517 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2180/4267] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:31:57 2022] GET /compute/v2.1/servers/36412f0c-aebd-4ba7-9818-3164375a86c1 => generated 1526 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:31:58.497940 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c258250d-f61b-46a0-89b2-903f9cafb178 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:58.498568 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c258250d-f61b-46a0-89b2-903f9cafb178 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 4b805c13-68bb-4794-87b6-a63598253193] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:58.522425 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c258250d-f61b-46a0-89b2-903f9cafb178 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:58.523164 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c258250d-f61b-46a0-89b2-903f9cafb178 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:58.523781 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c258250d-f61b-46a0-89b2-903f9cafb178 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:58.525455 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c258250d-f61b-46a0-89b2-903f9cafb178 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:58.526214 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c258250d-f61b-46a0-89b2-903f9cafb178 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:58.526810 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c258250d-f61b-46a0-89b2-903f9cafb178 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:58.538630 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-2f1eab9a-b89a-4876-8b24-53d4311dcf5f tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Flavor limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:31:58.539600 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-2f1eab9a-b89a-4876-8b24-53d4311dcf5f tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Image limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:31:58.540674 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-2f1eab9a-b89a-4876-8b24-53d4311dcf5f tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Flavor pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:31:58.541286 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-2f1eab9a-b89a-4876-8b24-53d4311dcf5f tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Image pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:31:58.541918 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-2f1eab9a-b89a-4876-8b24-53d4311dcf5f tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:31:58.599839 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2f1eab9a-b89a-4876-8b24-53d4311dcf5f tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:58.600333 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2f1eab9a-b89a-4876-8b24-53d4311dcf5f tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:58.600775 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2f1eab9a-b89a-4876-8b24-53d4311dcf5f tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:58.601558 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2f1eab9a-b89a-4876-8b24-53d4311dcf5f tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:58.602049 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2f1eab9a-b89a-4876-8b24-53d4311dcf5f tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:58.602538 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2f1eab9a-b89a-4876-8b24-53d4311dcf5f tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:58.633029 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:31:58.673330 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-2f1eab9a-b89a-4876-8b24-53d4311dcf5f tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Getting quotas for project ba1cd843801f48bebaccda875d5aa647. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:31:58.693456 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-2f1eab9a-b89a-4876-8b24-53d4311dcf5f tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Getting quotas for user b15464bcbb944412bfab92df2d740dc5 and project ba1cd843801f48bebaccda875d5aa647. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:31:58.717963 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2f1eab9a-b89a-4876-8b24-53d4311dcf5f tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Going to run 3 instances... {{(pid=121134) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:31:58.721857 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2f1eab9a-b89a-4876-8b24-53d4311dcf5f tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] [instance: 70a327e7-5c86-4d2b-b7b2-3c18e4027d81] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:31:58.887049 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2f1eab9a-b89a-4876-8b24-53d4311dcf5f tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] [instance: 6fe11b03-fcac-4a7e-af1c-4ae425f2d548] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=70a327e7-5c86-4d2b-b7b2-3c18e4027d81,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:31:58.940755 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c258250d-f61b-46a0-89b2-903f9cafb178 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:58.949587 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c258250d-f61b-46a0-89b2-903f9cafb178 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/4b805c13-68bb-4794-87b6-a63598253193" status: 200 len: 1511 microversion: 2.1 time: 0.466563 Oct 19 03:31:58.958482 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2181/4268] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:31:58 2022] GET /compute/v2.1/servers/4b805c13-68bb-4794-87b6-a63598253193 => generated 1511 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:31:58.980718 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-85588dc9-43fb-47ad-b0a6-f6984fe2f1fe tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:58.981708 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-85588dc9-43fb-47ad-b0a6-f6984fe2f1fe tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] [instance: 41c45cc9-0697-4ca0-a968-c982723b2155] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:58.988094 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-85588dc9-43fb-47ad-b0a6-f6984fe2f1fe tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:58.989447 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-85588dc9-43fb-47ad-b0a6-f6984fe2f1fe tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:58.990147 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-85588dc9-43fb-47ad-b0a6-f6984fe2f1fe tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:58.991105 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-85588dc9-43fb-47ad-b0a6-f6984fe2f1fe tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:58.991775 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-85588dc9-43fb-47ad-b0a6-f6984fe2f1fe tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:58.992375 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-85588dc9-43fb-47ad-b0a6-f6984fe2f1fe tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:59.062886 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2f1eab9a-b89a-4876-8b24-53d4311dcf5f tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] [instance: 4851555c-a35e-4277-ab6e-3099b6e8a72b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=6fe11b03-fcac-4a7e-af1c-4ae425f2d548,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:31:59.148714 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-85588dc9-43fb-47ad-b0a6-f6984fe2f1fe tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:59.161901 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-85588dc9-43fb-47ad-b0a6-f6984fe2f1fe tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:59.163471 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-85588dc9-43fb-47ad-b0a6-f6984fe2f1fe tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:59.175306 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-85588dc9-43fb-47ad-b0a6-f6984fe2f1fe tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] 10.222.0.52 "GET /compute/v2.1/servers/41c45cc9-0697-4ca0-a968-c982723b2155" status: 200 len: 1413 microversion: 2.54 time: 0.215478 Oct 19 03:31:59.178966 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2182/4269] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:31:58 2022] GET /compute/v2.1/servers/41c45cc9-0697-4ca0-a968-c982723b2155 => generated 1413 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:31:59.328774 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2f1eab9a-b89a-4876-8b24-53d4311dcf5f tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.242228 Oct 19 03:31:59.330135 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2088/4270] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:31:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 3244 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 03:31:59.341814 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9697203d-e08a-4a65-ac70-a572e5ff3405 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:59.346808 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-9697203d-e08a-4a65-ac70-a572e5ff3405 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b15464bcbb944412bfab92df2d740dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1cd843801f48bebaccda875d5aa647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:59.347593 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9697203d-e08a-4a65-ac70-a572e5ff3405 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Searching by: {'deleted': False, 'project_id': 'ba1cd843801f48bebaccda875d5aa647'} {{(pid=121135) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 03:31:59.439108 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9697203d-e08a-4a65-ac70-a572e5ff3405 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:59.439896 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9697203d-e08a-4a65-ac70-a572e5ff3405 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:59.442653 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9697203d-e08a-4a65-ac70-a572e5ff3405 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:59.443257 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9697203d-e08a-4a65-ac70-a572e5ff3405 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:59.443923 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9697203d-e08a-4a65-ac70-a572e5ff3405 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:59.444699 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9697203d-e08a-4a65-ac70-a572e5ff3405 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:59.493891 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9697203d-e08a-4a65-ac70-a572e5ff3405 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] 10.222.0.52 "GET /compute/v2.1/servers" status: 200 len: 1015 microversion: 2.1 time: 0.155794 Oct 19 03:31:59.496357 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d0bc526a-91c6-47b4-9fdf-cbd4c64ac5b4 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:59.496995 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d0bc526a-91c6-47b4-9fdf-cbd4c64ac5b4 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] [instance: 36412f0c-aebd-4ba7-9818-3164375a86c1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:59.506253 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2183/4271] 10.222.0.52 () {58 vars in 1125 bytes} [Wed Oct 19 03:31:59 2022] GET /compute/v2.1/servers => generated 1015 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:31:59.509650 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d0bc526a-91c6-47b4-9fdf-cbd4c64ac5b4 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:59.510171 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d0bc526a-91c6-47b4-9fdf-cbd4c64ac5b4 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:59.510630 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d0bc526a-91c6-47b4-9fdf-cbd4c64ac5b4 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:59.517805 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-97910e52-6b0a-4748-8dcb-9edff59648e5 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:59.518711 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-97910e52-6b0a-4748-8dcb-9edff59648e5 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] [instance: 4851555c-a35e-4277-ab6e-3099b6e8a72b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:59.520912 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d0bc526a-91c6-47b4-9fdf-cbd4c64ac5b4 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:59.525154 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d0bc526a-91c6-47b4-9fdf-cbd4c64ac5b4 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:59.528934 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d0bc526a-91c6-47b4-9fdf-cbd4c64ac5b4 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:59.607324 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-97910e52-6b0a-4748-8dcb-9edff59648e5 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15464bcbb944412bfab92df2d740dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1cd843801f48bebaccda875d5aa647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:59.615924 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-97910e52-6b0a-4748-8dcb-9edff59648e5 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] 10.222.0.52 "GET /compute/v2.1/servers/4851555c-a35e-4277-ab6e-3099b6e8a72b" status: 200 len: 1222 microversion: 2.1 time: 0.108323 Oct 19 03:31:59.616517 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2184/4272] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:31:59 2022] GET /compute/v2.1/servers/4851555c-a35e-4277-ab6e-3099b6e8a72b => generated 1222 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:31:59.804615 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d0bc526a-91c6-47b4-9fdf-cbd4c64ac5b4 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f134d05b1e449b48d90579b76fe6b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21f8ce48b034df68b5b6361dd252095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:31:59.818022 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d0bc526a-91c6-47b4-9fdf-cbd4c64ac5b4 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] 10.222.0.52 "GET /compute/v2.1/servers/36412f0c-aebd-4ba7-9818-3164375a86c1" status: 200 len: 1526 microversion: 2.1 time: 0.326669 Oct 19 03:31:59.835346 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2089/4273] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:31:59 2022] GET /compute/v2.1/servers/36412f0c-aebd-4ba7-9818-3164375a86c1 => generated 1526 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:31:59.983812 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-211980be-7eeb-4f8d-ac19-f50ac697dd3e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:31:59.984728 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-211980be-7eeb-4f8d-ac19-f50ac697dd3e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 4b805c13-68bb-4794-87b6-a63598253193] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:31:59.991080 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-211980be-7eeb-4f8d-ac19-f50ac697dd3e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:59.991762 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-211980be-7eeb-4f8d-ac19-f50ac697dd3e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:59.992342 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-211980be-7eeb-4f8d-ac19-f50ac697dd3e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:31:59.994048 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-211980be-7eeb-4f8d-ac19-f50ac697dd3e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:31:59.995048 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-211980be-7eeb-4f8d-ac19-f50ac697dd3e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:31:59.995794 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-211980be-7eeb-4f8d-ac19-f50ac697dd3e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:00.213595 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ad625a01-13ae-470a-b1cc-4b987cf90532 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:00.214431 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ad625a01-13ae-470a-b1cc-4b987cf90532 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] [instance: 41c45cc9-0697-4ca0-a968-c982723b2155] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:00.243448 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ad625a01-13ae-470a-b1cc-4b987cf90532 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:00.243448 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ad625a01-13ae-470a-b1cc-4b987cf90532 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:00.243448 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ad625a01-13ae-470a-b1cc-4b987cf90532 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:00.243448 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ad625a01-13ae-470a-b1cc-4b987cf90532 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:00.252579 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ad625a01-13ae-470a-b1cc-4b987cf90532 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:00.253397 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ad625a01-13ae-470a-b1cc-4b987cf90532 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:00.474009 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ad625a01-13ae-470a-b1cc-4b987cf90532 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:00.493343 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ad625a01-13ae-470a-b1cc-4b987cf90532 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:00.497157 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ad625a01-13ae-470a-b1cc-4b987cf90532 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:00.501320 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ad625a01-13ae-470a-b1cc-4b987cf90532 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] 10.222.0.52 "GET /compute/v2.1/servers/41c45cc9-0697-4ca0-a968-c982723b2155" status: 200 len: 1413 microversion: 2.54 time: 0.297777 Oct 19 03:32:00.504406 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2090/4274] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:32:00 2022] GET /compute/v2.1/servers/41c45cc9-0697-4ca0-a968-c982723b2155 => generated 1413 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:32:00.647875 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ed0ecb77-ae5c-44c8-8ab3-c5a4c6e6f1ee tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:00.647875 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ed0ecb77-ae5c-44c8-8ab3-c5a4c6e6f1ee tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] [instance: 4851555c-a35e-4277-ab6e-3099b6e8a72b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:00.745334 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-211980be-7eeb-4f8d-ac19-f50ac697dd3e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:00.770843 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-211980be-7eeb-4f8d-ac19-f50ac697dd3e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/4b805c13-68bb-4794-87b6-a63598253193" status: 200 len: 1511 microversion: 2.1 time: 0.789872 Oct 19 03:32:00.787084 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2185/4275] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:31:59 2022] GET /compute/v2.1/servers/4b805c13-68bb-4794-87b6-a63598253193 => generated 1511 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:32:00.820739 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ed0ecb77-ae5c-44c8-8ab3-c5a4c6e6f1ee tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15464bcbb944412bfab92df2d740dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1cd843801f48bebaccda875d5aa647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:00.831403 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ed0ecb77-ae5c-44c8-8ab3-c5a4c6e6f1ee tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] 10.222.0.52 "GET /compute/v2.1/servers/4851555c-a35e-4277-ab6e-3099b6e8a72b" status: 200 len: 1222 microversion: 2.1 time: 0.189992 Oct 19 03:32:00.833876 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2091/4276] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:32:00 2022] GET /compute/v2.1/servers/4851555c-a35e-4277-ab6e-3099b6e8a72b => generated 1222 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:32:00.845661 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-fb889612-20b9-4601-8dcf-2fc5852a8fd5 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:00.854687 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-fb889612-20b9-4601-8dcf-2fc5852a8fd5 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] [instance: 36412f0c-aebd-4ba7-9818-3164375a86c1] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:00.861678 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fb889612-20b9-4601-8dcf-2fc5852a8fd5 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:00.862242 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fb889612-20b9-4601-8dcf-2fc5852a8fd5 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:00.862750 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fb889612-20b9-4601-8dcf-2fc5852a8fd5 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:00.863532 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fb889612-20b9-4601-8dcf-2fc5852a8fd5 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:00.863995 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fb889612-20b9-4601-8dcf-2fc5852a8fd5 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:00.864480 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fb889612-20b9-4601-8dcf-2fc5852a8fd5 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:01.386671 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-fb889612-20b9-4601-8dcf-2fc5852a8fd5 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f134d05b1e449b48d90579b76fe6b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21f8ce48b034df68b5b6361dd252095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:01.400095 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-fb889612-20b9-4601-8dcf-2fc5852a8fd5 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] 10.222.0.52 "GET /compute/v2.1/servers/36412f0c-aebd-4ba7-9818-3164375a86c1" status: 200 len: 1526 microversion: 2.1 time: 0.560595 Oct 19 03:32:01.411734 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2186/4277] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:32:00 2022] GET /compute/v2.1/servers/36412f0c-aebd-4ba7-9818-3164375a86c1 => generated 1526 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:32:01.530591 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-867eff3d-475d-46eb-879f-eea370f7d5fe tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:01.531234 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-867eff3d-475d-46eb-879f-eea370f7d5fe tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] [instance: 41c45cc9-0697-4ca0-a968-c982723b2155] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:01.550011 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-867eff3d-475d-46eb-879f-eea370f7d5fe tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:01.550601 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-867eff3d-475d-46eb-879f-eea370f7d5fe tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:01.551132 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-867eff3d-475d-46eb-879f-eea370f7d5fe tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:01.551876 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-867eff3d-475d-46eb-879f-eea370f7d5fe tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:01.552426 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-867eff3d-475d-46eb-879f-eea370f7d5fe tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:01.552862 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-867eff3d-475d-46eb-879f-eea370f7d5fe tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:01.673697 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-c9b0dd1b-6beb-464e-8f3e-500b3b966de6 req-746ff7cf-7c57-4ddb-94e2-f6d74a4418bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36412f0c-aebd-4ba7-9818-3164375a86c1", "name": "network-vif-deleted", "tag": "3ac0d02e-1d59-4692-bd92-992d8a3f1141"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:32:01.721222 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-c9b0dd1b-6beb-464e-8f3e-500b3b966de6 req-746ff7cf-7c57-4ddb-94e2-f6d74a4418bb service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:01.721752 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-c9b0dd1b-6beb-464e-8f3e-500b3b966de6 req-746ff7cf-7c57-4ddb-94e2-f6d74a4418bb service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:01.722385 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-c9b0dd1b-6beb-464e-8f3e-500b3b966de6 req-746ff7cf-7c57-4ddb-94e2-f6d74a4418bb service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:01.730675 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=100 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:32:01.778918 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-c9b0dd1b-6beb-464e-8f3e-500b3b966de6 req-746ff7cf-7c57-4ddb-94e2-f6d74a4418bb service nova] Creating event network-vif-deleted:3ac0d02e-1d59-4692-bd92-992d8a3f1141 for instance 36412f0c-aebd-4ba7-9818-3164375a86c1 on n-h1-861333-8 Oct 19 03:32:01.781025 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-c9b0dd1b-6beb-464e-8f3e-500b3b966de6 req-746ff7cf-7c57-4ddb-94e2-f6d74a4418bb service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116770 Oct 19 03:32:01.784510 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2187/4278] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:32:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:32:01.802155 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ec99d2a4-7e5f-421f-9b61-2325daeaa04b tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:01.803205 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ec99d2a4-7e5f-421f-9b61-2325daeaa04b tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 4b805c13-68bb-4794-87b6-a63598253193] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:01.824726 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ec99d2a4-7e5f-421f-9b61-2325daeaa04b tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:01.826907 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ec99d2a4-7e5f-421f-9b61-2325daeaa04b tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:01.827566 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ec99d2a4-7e5f-421f-9b61-2325daeaa04b tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:01.830792 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ec99d2a4-7e5f-421f-9b61-2325daeaa04b tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:01.832623 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ec99d2a4-7e5f-421f-9b61-2325daeaa04b tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:01.836512 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ec99d2a4-7e5f-421f-9b61-2325daeaa04b tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:01.940951 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-867eff3d-475d-46eb-879f-eea370f7d5fe tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:01.958711 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-867eff3d-475d-46eb-879f-eea370f7d5fe tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:01.974782 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-867eff3d-475d-46eb-879f-eea370f7d5fe tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:01.977128 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-867eff3d-475d-46eb-879f-eea370f7d5fe tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] 10.222.0.52 "GET /compute/v2.1/servers/41c45cc9-0697-4ca0-a968-c982723b2155" status: 200 len: 1413 microversion: 2.54 time: 0.450541 Oct 19 03:32:01.978763 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2092/4279] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:32:01 2022] GET /compute/v2.1/servers/41c45cc9-0697-4ca0-a968-c982723b2155 => generated 1413 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:32:01.986831 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a3e51cdd-9b86-445f-a446-f1e0ae8ec446 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:01.993608 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a3e51cdd-9b86-445f-a446-f1e0ae8ec446 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] [instance: 4851555c-a35e-4277-ab6e-3099b6e8a72b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:02.262309 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a3e51cdd-9b86-445f-a446-f1e0ae8ec446 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15464bcbb944412bfab92df2d740dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1cd843801f48bebaccda875d5aa647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:02.279589 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a3e51cdd-9b86-445f-a446-f1e0ae8ec446 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] 10.222.0.52 "GET /compute/v2.1/servers/4851555c-a35e-4277-ab6e-3099b6e8a72b" status: 200 len: 1222 microversion: 2.1 time: 0.298135 Oct 19 03:32:02.282265 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2093/4280] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:32:01 2022] GET /compute/v2.1/servers/4851555c-a35e-4277-ab6e-3099b6e8a72b => generated 1222 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:32:02.425012 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e3ea0395-4fbf-445f-824a-c932938178e0 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:02.425750 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e3ea0395-4fbf-445f-824a-c932938178e0 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] [instance: 36412f0c-aebd-4ba7-9818-3164375a86c1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:02.440438 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e3ea0395-4fbf-445f-824a-c932938178e0 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:02.440958 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e3ea0395-4fbf-445f-824a-c932938178e0 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:02.441433 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e3ea0395-4fbf-445f-824a-c932938178e0 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:02.442185 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e3ea0395-4fbf-445f-824a-c932938178e0 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:02.442734 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e3ea0395-4fbf-445f-824a-c932938178e0 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:02.445069 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e3ea0395-4fbf-445f-824a-c932938178e0 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:02.537753 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=3,nova_api:UPDATE=1,nova_api:INSERT=9 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:32:02.546511 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e3ea0395-4fbf-445f-824a-c932938178e0 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:02.550755 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e3ea0395-4fbf-445f-824a-c932938178e0 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:02.557905 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e3ea0395-4fbf-445f-824a-c932938178e0 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:02.557905 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-e3ea0395-4fbf-445f-824a-c932938178e0 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Lazy-loading 'fault' on Instance uuid 36412f0c-aebd-4ba7-9818-3164375a86c1 {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:32:02.792362 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e3ea0395-4fbf-445f-824a-c932938178e0 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f134d05b1e449b48d90579b76fe6b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21f8ce48b034df68b5b6361dd252095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:02.805873 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e3ea0395-4fbf-445f-824a-c932938178e0 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] 10.222.0.52 "GET /compute/v2.1/servers/36412f0c-aebd-4ba7-9818-3164375a86c1" status: 200 len: 1313 microversion: 2.1 time: 0.384440 Oct 19 03:32:02.808281 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2094/4281] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:32:02 2022] GET /compute/v2.1/servers/36412f0c-aebd-4ba7-9818-3164375a86c1 => generated 1313 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:32:02.848185 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ec99d2a4-7e5f-421f-9b61-2325daeaa04b tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:02.863956 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ec99d2a4-7e5f-421f-9b61-2325daeaa04b tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/4b805c13-68bb-4794-87b6-a63598253193" status: 200 len: 1511 microversion: 2.1 time: 1.069631 Oct 19 03:32:02.866479 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2188/4282] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:32:01 2022] GET /compute/v2.1/servers/4b805c13-68bb-4794-87b6-a63598253193 => generated 1511 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:32:03.009860 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-70e31980-83af-4ecc-ba27-6ab24fa234d4 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:03.010439 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-70e31980-83af-4ecc-ba27-6ab24fa234d4 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] [instance: 41c45cc9-0697-4ca0-a968-c982723b2155] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:03.019050 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-70e31980-83af-4ecc-ba27-6ab24fa234d4 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:03.038881 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-70e31980-83af-4ecc-ba27-6ab24fa234d4 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:03.043944 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-70e31980-83af-4ecc-ba27-6ab24fa234d4 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:03.044743 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-70e31980-83af-4ecc-ba27-6ab24fa234d4 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:03.046095 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-70e31980-83af-4ecc-ba27-6ab24fa234d4 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:03.047603 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-70e31980-83af-4ecc-ba27-6ab24fa234d4 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:03.190220 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-70e31980-83af-4ecc-ba27-6ab24fa234d4 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:03.213054 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-70e31980-83af-4ecc-ba27-6ab24fa234d4 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:03.215537 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-70e31980-83af-4ecc-ba27-6ab24fa234d4 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:03.220144 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-70e31980-83af-4ecc-ba27-6ab24fa234d4 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] 10.222.0.52 "GET /compute/v2.1/servers/41c45cc9-0697-4ca0-a968-c982723b2155" status: 200 len: 1398 microversion: 2.54 time: 0.213542 Oct 19 03:32:03.223467 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2095/4283] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:32:03 2022] GET /compute/v2.1/servers/41c45cc9-0697-4ca0-a968-c982723b2155 => generated 1398 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:32:03.254423 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4e819a6d-6999-4fa5-be68-378a0e51100a tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Calling method '.version_select at 0x7fc13003a430>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:03.312912 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-86d424ea-134d-4709-80a2-4ea30cc45787 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:03.314589 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-86d424ea-134d-4709-80a2-4ea30cc45787 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] [instance: 4851555c-a35e-4277-ab6e-3099b6e8a72b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:03.389707 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4e819a6d-6999-4fa5-be68-378a0e51100a tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-604637818" status: 204 len: 0 microversion: 2.54 time: 0.139127 Oct 19 03:32:03.390303 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2189/4284] 10.222.0.52 () {60 vars in 1316 bytes} [Wed Oct 19 03:32:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-604637818 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 19 03:32:03.406272 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0ba51662-22f4-4147-b80c-1214b5f43567 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:03.406798 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0ba51662-22f4-4147-b80c-1214b5f43567 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] [instance: 41c45cc9-0697-4ca0-a968-c982723b2155] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:03.416252 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0ba51662-22f4-4147-b80c-1214b5f43567 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:03.417040 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0ba51662-22f4-4147-b80c-1214b5f43567 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:03.417681 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0ba51662-22f4-4147-b80c-1214b5f43567 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:03.418489 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0ba51662-22f4-4147-b80c-1214b5f43567 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:03.419073 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0ba51662-22f4-4147-b80c-1214b5f43567 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:03.420478 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0ba51662-22f4-4147-b80c-1214b5f43567 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:03.446905 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-86d424ea-134d-4709-80a2-4ea30cc45787 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15464bcbb944412bfab92df2d740dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1cd843801f48bebaccda875d5aa647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:03.454939 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-86d424ea-134d-4709-80a2-4ea30cc45787 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] 10.222.0.52 "GET /compute/v2.1/servers/4851555c-a35e-4277-ab6e-3099b6e8a72b" status: 200 len: 1222 microversion: 2.1 time: 0.149998 Oct 19 03:32:03.456746 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0ba51662-22f4-4147-b80c-1214b5f43567 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] [instance: 41c45cc9-0697-4ca0-a968-c982723b2155] Going to try to terminate instance {{(pid=121135) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:32:03.468919 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2096/4285] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:32:03 2022] GET /compute/v2.1/servers/4851555c-a35e-4277-ab6e-3099b6e8a72b => generated 1222 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:32:03.831455 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-458ee0b5-7888-4cdc-93df-2532fe4319d2 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:03.832738 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-458ee0b5-7888-4cdc-93df-2532fe4319d2 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] [instance: 36412f0c-aebd-4ba7-9818-3164375a86c1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:03.840040 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-458ee0b5-7888-4cdc-93df-2532fe4319d2 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:03.840540 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-458ee0b5-7888-4cdc-93df-2532fe4319d2 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:03.850127 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-458ee0b5-7888-4cdc-93df-2532fe4319d2 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:03.851161 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-458ee0b5-7888-4cdc-93df-2532fe4319d2 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:03.851795 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-458ee0b5-7888-4cdc-93df-2532fe4319d2 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:03.852994 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-458ee0b5-7888-4cdc-93df-2532fe4319d2 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:03.873058 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-458ee0b5-7888-4cdc-93df-2532fe4319d2 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] HTTP exception thrown: Instance 36412f0c-aebd-4ba7-9818-3164375a86c1 could not be found. Oct 19 03:32:03.875201 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-458ee0b5-7888-4cdc-93df-2532fe4319d2 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Request method failure captured: Oct 19 03:32:03.875201 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/36412f0c-aebd-4ba7-9818-3164375a86c1 HTTP/1.1 Oct 19 03:32:03.875201 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:32:03.875201 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:32:03.875201 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:32:03.875201 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:32:03.875201 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:32:03.875201 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:32:03.875201 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:32:03.875201 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:32:03.875201 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT2-QyA4V-REaMKv6O27P_lPX27y7pPDdbAOABYdtxj4hCe0h2NIkCOh8UMPupkutxUijRkZel7I9QPr9TR2xSdvpmwCfHIVT-vw9SyiuLk0XPN4CE7dLat5qh9Q3y1TfJ1ssuFgPUYG8VCYnk5O0OAL1A3IAXgfaVBoA5wx6gv4jRtY Oct 19 03:32:03.875201 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:32:03.875201 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:32:03.875201 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:32:03.875201 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:32:03.875201 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:32:03.875201 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:32:03.875201 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: b21f8ce48b034df68b5b6361dd252095 Oct 19 03:32:03.875201 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-2089814340 Oct 19 03:32:03.875201 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:32:03.875201 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:32:03.875201 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b21f8ce48b034df68b5b6361dd252095"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b21f8ce48b034df68b5b6361dd252095"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b21f8ce48b034df68b5b6361dd252095"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b21f8ce48b034df68b5b6361dd252095", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:32:03.875201 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-2089814340 Oct 19 03:32:03.875201 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: b21f8ce48b034df68b5b6361dd252095 Oct 19 03:32:03.875201 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-2089814340 Oct 19 03:32:03.875201 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ServerMetadataNegativeTestJSON-2089814340-project Oct 19 03:32:03.875201 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:32:03.875201 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:32:03.875201 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 1f134d05b1e449b48d90579b76fe6b94 Oct 19 03:32:03.875201 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-2089814340-project Oct 19 03:32:03.875201 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:32:03.875201 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance 36412f0c-aebd-4ba7-9818-3164375a86c1 could not be found. Oct 19 03:32:03.875201 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '36412f0c-aebd-4ba7-9818-3164375a86c1'} Oct 19 03:32:03.875201 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:32:03.875201 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:32:03.875201 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:32:03.875201 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:32:03.875201 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:32:03.875201 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:32:03.875201 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:32:03.875201 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:32:03.875201 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:32:03.875201 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:32:03.875201 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36412f0c-aebd-4ba7-9818-3164375a86c1 could not be found. Oct 19 03:32:03.875201 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:32:03.875201 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:32:03.875201 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:32:03.875201 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:32:03.875201 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:32:03.875201 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:32:03.875201 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:32:03.875201 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:32:03.875201 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:32:03.875201 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:32:03.875201 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:32:03.875201 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:32:03.875201 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:32:03.875201 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:32:03.875201 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:32:03.875201 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:32:03.875201 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36412f0c-aebd-4ba7-9818-3164375a86c1 could not be found. Oct 19 03:32:03.875201 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:32:03.875201 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:32:03.879204 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:32:03.879204 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:32:03.879204 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:32:03.879204 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:32:03.879204 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:32:03.879204 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:32:03.879204 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36412f0c-aebd-4ba7-9818-3164375a86c1 could not be found. Oct 19 03:32:03.879204 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:32:03.880923 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-458ee0b5-7888-4cdc-93df-2532fe4319d2 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] Returning 404 to user: Instance 36412f0c-aebd-4ba7-9818-3164375a86c1 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:32:03.884397 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-458ee0b5-7888-4cdc-93df-2532fe4319d2 tempest-ServerMetadataNegativeTestJSON-2089814340 tempest-ServerMetadataNegativeTestJSON-2089814340-project] 10.222.0.52 "GET /compute/v2.1/servers/36412f0c-aebd-4ba7-9818-3164375a86c1" status: 404 len: 111 microversion: 2.1 time: 0.056144 Oct 19 03:32:03.885516 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2097/4286] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:32:03 2022] GET /compute/v2.1/servers/36412f0c-aebd-4ba7-9818-3164375a86c1 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:32:03.890799 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-eff4376b-8664-422e-a390-2bff04685ad0 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:03.892186 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-eff4376b-8664-422e-a390-2bff04685ad0 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 4b805c13-68bb-4794-87b6-a63598253193] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:03.898635 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eff4376b-8664-422e-a390-2bff04685ad0 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:03.900010 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eff4376b-8664-422e-a390-2bff04685ad0 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:03.900660 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eff4376b-8664-422e-a390-2bff04685ad0 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:03.901632 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eff4376b-8664-422e-a390-2bff04685ad0 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:03.902278 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eff4376b-8664-422e-a390-2bff04685ad0 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:03.902896 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eff4376b-8664-422e-a390-2bff04685ad0 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:03.960299 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0ba51662-22f4-4147-b80c-1214b5f43567 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] 10.222.0.52 "DELETE /compute/v2.1/servers/41c45cc9-0697-4ca0-a968-c982723b2155" status: 204 len: 0 microversion: 2.54 time: 0.560580 Oct 19 03:32:03.961195 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2190/4287] 10.222.0.52 () {60 vars in 1280 bytes} [Wed Oct 19 03:32:03 2022] DELETE /compute/v2.1/servers/41c45cc9-0697-4ca0-a968-c982723b2155 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 19 03:32:03.970781 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-cdaabb91-afe3-42de-ae78-37c3c88cc739 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:03.972205 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-cdaabb91-afe3-42de-ae78-37c3c88cc739 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] [instance: 41c45cc9-0697-4ca0-a968-c982723b2155] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:03.983679 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cdaabb91-afe3-42de-ae78-37c3c88cc739 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:03.984389 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cdaabb91-afe3-42de-ae78-37c3c88cc739 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:03.985000 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cdaabb91-afe3-42de-ae78-37c3c88cc739 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:03.985751 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cdaabb91-afe3-42de-ae78-37c3c88cc739 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:03.986588 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cdaabb91-afe3-42de-ae78-37c3c88cc739 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:03.987590 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cdaabb91-afe3-42de-ae78-37c3c88cc739 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:04.318615 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-cdaabb91-afe3-42de-ae78-37c3c88cc739 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:04.327282 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-cdaabb91-afe3-42de-ae78-37c3c88cc739 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:04.328803 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-cdaabb91-afe3-42de-ae78-37c3c88cc739 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:04.330050 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-cdaabb91-afe3-42de-ae78-37c3c88cc739 tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] 10.222.0.52 "GET /compute/v2.1/servers/41c45cc9-0697-4ca0-a968-c982723b2155" status: 200 len: 1404 microversion: 2.54 time: 0.364468 Oct 19 03:32:04.333400 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2191/4288] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:32:03 2022] GET /compute/v2.1/servers/41c45cc9-0697-4ca0-a968-c982723b2155 => generated 1404 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:32:04.486779 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-31cc6b55-1751-4d6a-8635-f7487582cfdf tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:04.487305 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-31cc6b55-1751-4d6a-8635-f7487582cfdf tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] [instance: 4851555c-a35e-4277-ab6e-3099b6e8a72b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:04.499617 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-31cc6b55-1751-4d6a-8635-f7487582cfdf tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:04.504610 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-31cc6b55-1751-4d6a-8635-f7487582cfdf tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:04.505332 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-31cc6b55-1751-4d6a-8635-f7487582cfdf tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:04.506345 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-31cc6b55-1751-4d6a-8635-f7487582cfdf tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:04.506985 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-31cc6b55-1751-4d6a-8635-f7487582cfdf tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:04.507598 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-31cc6b55-1751-4d6a-8635-f7487582cfdf tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:04.848041 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-31cc6b55-1751-4d6a-8635-f7487582cfdf tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15464bcbb944412bfab92df2d740dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1cd843801f48bebaccda875d5aa647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:04.856798 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-31cc6b55-1751-4d6a-8635-f7487582cfdf tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] 10.222.0.52 "GET /compute/v2.1/servers/4851555c-a35e-4277-ab6e-3099b6e8a72b" status: 200 len: 1274 microversion: 2.1 time: 0.374467 Oct 19 03:32:04.857417 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2192/4289] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:32:04 2022] GET /compute/v2.1/servers/4851555c-a35e-4277-ab6e-3099b6e8a72b => generated 1274 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:32:04.937064 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-eff4376b-8664-422e-a390-2bff04685ad0 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:04.950183 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-eff4376b-8664-422e-a390-2bff04685ad0 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/4b805c13-68bb-4794-87b6-a63598253193" status: 200 len: 1511 microversion: 2.1 time: 1.063284 Oct 19 03:32:04.951341 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2098/4290] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:32:03 2022] GET /compute/v2.1/servers/4b805c13-68bb-4794-87b6-a63598253193 => generated 1511 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:32:05.356867 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-27aa2a70-b391-4cb9-9258-dfcb6f8f60aa tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:05.358150 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-27aa2a70-b391-4cb9-9258-dfcb6f8f60aa tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] [instance: 41c45cc9-0697-4ca0-a968-c982723b2155] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:05.371568 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-27aa2a70-b391-4cb9-9258-dfcb6f8f60aa tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:05.372078 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-27aa2a70-b391-4cb9-9258-dfcb6f8f60aa tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:05.372525 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-27aa2a70-b391-4cb9-9258-dfcb6f8f60aa tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:05.374125 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-27aa2a70-b391-4cb9-9258-dfcb6f8f60aa tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:05.374125 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-27aa2a70-b391-4cb9-9258-dfcb6f8f60aa tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:05.374125 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-27aa2a70-b391-4cb9-9258-dfcb6f8f60aa tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:05.713782 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-27aa2a70-b391-4cb9-9258-dfcb6f8f60aa tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:05.730054 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-27aa2a70-b391-4cb9-9258-dfcb6f8f60aa tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:05.731705 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-27aa2a70-b391-4cb9-9258-dfcb6f8f60aa tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:05.734077 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-27aa2a70-b391-4cb9-9258-dfcb6f8f60aa tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] 10.222.0.52 "GET /compute/v2.1/servers/41c45cc9-0697-4ca0-a968-c982723b2155" status: 200 len: 1404 microversion: 2.54 time: 0.380762 Oct 19 03:32:05.734077 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2193/4291] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:32:05 2022] GET /compute/v2.1/servers/41c45cc9-0697-4ca0-a968-c982723b2155 => generated 1404 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:32:05.881863 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-44c3adb2-6120-493f-b2a7-0f0b63a6b898 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:05.882975 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-44c3adb2-6120-493f-b2a7-0f0b63a6b898 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] [instance: 4851555c-a35e-4277-ab6e-3099b6e8a72b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:05.898080 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-44c3adb2-6120-493f-b2a7-0f0b63a6b898 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:05.899636 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-44c3adb2-6120-493f-b2a7-0f0b63a6b898 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:05.900538 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-44c3adb2-6120-493f-b2a7-0f0b63a6b898 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:05.905668 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-44c3adb2-6120-493f-b2a7-0f0b63a6b898 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:05.905668 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-44c3adb2-6120-493f-b2a7-0f0b63a6b898 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:05.905668 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-44c3adb2-6120-493f-b2a7-0f0b63a6b898 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:05.976403 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1d4fefc2-f108-4a46-92e4-b26073400fcc tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:05.977254 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1d4fefc2-f108-4a46-92e4-b26073400fcc tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 4b805c13-68bb-4794-87b6-a63598253193] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:05.985247 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1d4fefc2-f108-4a46-92e4-b26073400fcc tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:05.986036 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1d4fefc2-f108-4a46-92e4-b26073400fcc tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:05.986636 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1d4fefc2-f108-4a46-92e4-b26073400fcc tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:05.987528 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1d4fefc2-f108-4a46-92e4-b26073400fcc tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:05.988318 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1d4fefc2-f108-4a46-92e4-b26073400fcc tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:05.988943 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1d4fefc2-f108-4a46-92e4-b26073400fcc tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:06.061949 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-44c3adb2-6120-493f-b2a7-0f0b63a6b898 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15464bcbb944412bfab92df2d740dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1cd843801f48bebaccda875d5aa647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:06.072844 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-44c3adb2-6120-493f-b2a7-0f0b63a6b898 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] 10.222.0.52 "GET /compute/v2.1/servers/4851555c-a35e-4277-ab6e-3099b6e8a72b" status: 200 len: 1292 microversion: 2.1 time: 0.196330 Oct 19 03:32:06.089417 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2099/4292] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:32:05 2022] GET /compute/v2.1/servers/4851555c-a35e-4277-ab6e-3099b6e8a72b => generated 1292 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:32:06.609286 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-1d4fefc2-f108-4a46-92e4-b26073400fcc tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:06.620386 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1d4fefc2-f108-4a46-92e4-b26073400fcc tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/4b805c13-68bb-4794-87b6-a63598253193" status: 200 len: 1511 microversion: 2.1 time: 0.648055 Oct 19 03:32:06.621644 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2194/4293] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:32:05 2022] GET /compute/v2.1/servers/4b805c13-68bb-4794-87b6-a63598253193 => generated 1511 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:32:06.766969 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-cfaec827-5717-448a-94ae-7a303c927a4f tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:06.771838 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-cfaec827-5717-448a-94ae-7a303c927a4f tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] [instance: 41c45cc9-0697-4ca0-a968-c982723b2155] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:06.801020 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cfaec827-5717-448a-94ae-7a303c927a4f tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:06.801774 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cfaec827-5717-448a-94ae-7a303c927a4f tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:06.803856 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cfaec827-5717-448a-94ae-7a303c927a4f tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:06.810659 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cfaec827-5717-448a-94ae-7a303c927a4f tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:06.812109 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cfaec827-5717-448a-94ae-7a303c927a4f tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:06.812879 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cfaec827-5717-448a-94ae-7a303c927a4f tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:07.100808 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7a99bcf5-b383-4d52-92c0-0f609584e0b4 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:07.101462 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7a99bcf5-b383-4d52-92c0-0f609584e0b4 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] [instance: 4851555c-a35e-4277-ab6e-3099b6e8a72b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:07.113568 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7a99bcf5-b383-4d52-92c0-0f609584e0b4 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:07.113568 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7a99bcf5-b383-4d52-92c0-0f609584e0b4 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:07.113568 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7a99bcf5-b383-4d52-92c0-0f609584e0b4 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:07.113568 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7a99bcf5-b383-4d52-92c0-0f609584e0b4 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:07.113568 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7a99bcf5-b383-4d52-92c0-0f609584e0b4 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:07.113568 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7a99bcf5-b383-4d52-92c0-0f609584e0b4 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:07.145163 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-cfaec827-5717-448a-94ae-7a303c927a4f tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:07.156044 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-cfaec827-5717-448a-94ae-7a303c927a4f tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:07.157989 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-cfaec827-5717-448a-94ae-7a303c927a4f tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:07.159426 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-cfaec827-5717-448a-94ae-7a303c927a4f tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] 10.222.0.52 "GET /compute/v2.1/servers/41c45cc9-0697-4ca0-a968-c982723b2155" status: 200 len: 1404 microversion: 2.54 time: 0.402636 Oct 19 03:32:07.160469 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2100/4294] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:32:06 2022] GET /compute/v2.1/servers/41c45cc9-0697-4ca0-a968-c982723b2155 => generated 1404 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:32:07.279568 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7a99bcf5-b383-4d52-92c0-0f609584e0b4 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15464bcbb944412bfab92df2d740dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1cd843801f48bebaccda875d5aa647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:07.304519 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7a99bcf5-b383-4d52-92c0-0f609584e0b4 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] 10.222.0.52 "GET /compute/v2.1/servers/4851555c-a35e-4277-ab6e-3099b6e8a72b" status: 200 len: 1280 microversion: 2.1 time: 0.200369 Oct 19 03:32:07.307026 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2195/4295] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:32:07 2022] GET /compute/v2.1/servers/4851555c-a35e-4277-ab6e-3099b6e8a72b => generated 1280 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:32:07.649450 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-316a6f98-e0f1-49fe-a9d0-cc640ce0d5dd tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:07.651140 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-316a6f98-e0f1-49fe-a9d0-cc640ce0d5dd tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 4b805c13-68bb-4794-87b6-a63598253193] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:07.668638 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-316a6f98-e0f1-49fe-a9d0-cc640ce0d5dd tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:07.669352 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-316a6f98-e0f1-49fe-a9d0-cc640ce0d5dd tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:07.670757 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-316a6f98-e0f1-49fe-a9d0-cc640ce0d5dd tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:07.672030 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-316a6f98-e0f1-49fe-a9d0-cc640ce0d5dd tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:07.673094 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-316a6f98-e0f1-49fe-a9d0-cc640ce0d5dd tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:07.674073 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-316a6f98-e0f1-49fe-a9d0-cc640ce0d5dd tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:08.187634 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d2e7057a-4fd2-4f08-9e52-c33b4392824f tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:08.189398 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d2e7057a-4fd2-4f08-9e52-c33b4392824f tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] [instance: 41c45cc9-0697-4ca0-a968-c982723b2155] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:08.200689 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d2e7057a-4fd2-4f08-9e52-c33b4392824f tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:08.200689 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d2e7057a-4fd2-4f08-9e52-c33b4392824f tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:08.200689 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d2e7057a-4fd2-4f08-9e52-c33b4392824f tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:08.200689 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d2e7057a-4fd2-4f08-9e52-c33b4392824f tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:08.201434 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d2e7057a-4fd2-4f08-9e52-c33b4392824f tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:08.202013 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d2e7057a-4fd2-4f08-9e52-c33b4392824f tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:08.241480 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d2e7057a-4fd2-4f08-9e52-c33b4392824f tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:08.241971 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d2e7057a-4fd2-4f08-9e52-c33b4392824f tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:08.242429 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d2e7057a-4fd2-4f08-9e52-c33b4392824f tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:08.243467 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-d2e7057a-4fd2-4f08-9e52-c33b4392824f tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lazy-loading 'fault' on Instance uuid 41c45cc9-0697-4ca0-a968-c982723b2155 {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:32:08.547040 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d2e7057a-4fd2-4f08-9e52-c33b4392824f tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:08.570266 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d2e7057a-4fd2-4f08-9e52-c33b4392824f tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:08.573541 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d2e7057a-4fd2-4f08-9e52-c33b4392824f tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a66063e37d640108cf1c500368ba9b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fa10fa4a4a4726b3a2c5b373876650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:08.576073 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d2e7057a-4fd2-4f08-9e52-c33b4392824f tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] 10.222.0.52 "GET /compute/v2.1/servers/41c45cc9-0697-4ca0-a968-c982723b2155" status: 200 len: 1409 microversion: 2.54 time: 0.394133 Oct 19 03:32:08.577126 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2196/4296] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:32:08 2022] GET /compute/v2.1/servers/41c45cc9-0697-4ca0-a968-c982723b2155 => generated 1409 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:32:08.594167 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9a4beb57-b0f3-4622-9a2d-d3722cfc35e4 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:08.595518 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9a4beb57-b0f3-4622-9a2d-d3722cfc35e4 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] [instance: 4851555c-a35e-4277-ab6e-3099b6e8a72b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:08.605613 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9a4beb57-b0f3-4622-9a2d-d3722cfc35e4 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:08.606595 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9a4beb57-b0f3-4622-9a2d-d3722cfc35e4 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:08.607858 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9a4beb57-b0f3-4622-9a2d-d3722cfc35e4 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:08.608830 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9a4beb57-b0f3-4622-9a2d-d3722cfc35e4 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:08.609389 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9a4beb57-b0f3-4622-9a2d-d3722cfc35e4 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:08.609875 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9a4beb57-b0f3-4622-9a2d-d3722cfc35e4 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:08.654777 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:32:08.702176 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-316a6f98-e0f1-49fe-a9d0-cc640ce0d5dd tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:08.713213 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-316a6f98-e0f1-49fe-a9d0-cc640ce0d5dd tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/4b805c13-68bb-4794-87b6-a63598253193" status: 200 len: 1511 microversion: 2.1 time: 1.071735 Oct 19 03:32:08.717525 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2101/4297] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:32:07 2022] GET /compute/v2.1/servers/4b805c13-68bb-4794-87b6-a63598253193 => generated 1511 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:32:09.341692 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-9a4beb57-b0f3-4622-9a2d-d3722cfc35e4 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15464bcbb944412bfab92df2d740dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1cd843801f48bebaccda875d5aa647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:09.349979 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9a4beb57-b0f3-4622-9a2d-d3722cfc35e4 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] 10.222.0.52 "GET /compute/v2.1/servers/4851555c-a35e-4277-ab6e-3099b6e8a72b" status: 200 len: 1322 microversion: 2.1 time: 0.771427 Oct 19 03:32:09.354273 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2197/4298] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:32:08 2022] GET /compute/v2.1/servers/4851555c-a35e-4277-ab6e-3099b6e8a72b => generated 1322 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:32:09.618602 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d8181e5b-39d7-461d-a45b-33a983376e4f tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:09.619441 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d8181e5b-39d7-461d-a45b-33a983376e4f tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] [instance: 41c45cc9-0697-4ca0-a968-c982723b2155] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:09.627412 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d8181e5b-39d7-461d-a45b-33a983376e4f tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:09.628179 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d8181e5b-39d7-461d-a45b-33a983376e4f tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:09.628881 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d8181e5b-39d7-461d-a45b-33a983376e4f tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:09.629854 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d8181e5b-39d7-461d-a45b-33a983376e4f tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:09.630521 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d8181e5b-39d7-461d-a45b-33a983376e4f tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:09.631222 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d8181e5b-39d7-461d-a45b-33a983376e4f tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:09.654526 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-d8181e5b-39d7-461d-a45b-33a983376e4f tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] HTTP exception thrown: Instance 41c45cc9-0697-4ca0-a968-c982723b2155 could not be found. Oct 19 03:32:09.656978 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d8181e5b-39d7-461d-a45b-33a983376e4f tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Request method failure captured: Oct 19 03:32:09.656978 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/41c45cc9-0697-4ca0-a968-c982723b2155 HTTP/1.1 Oct 19 03:32:09.656978 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:32:09.656978 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:32:09.656978 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:32:09.656978 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:32:09.656978 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:32:09.656978 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:32:09.656978 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:32:09.656978 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:32:09.656978 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT2-C4yklJc0Oxsg0LkMZj0eTMpXCurSJ7IYaKhb3dK9oCQfvzHjc3_aJsthfSIWgvDcNgJvyR_xHLfh1nQpSIcbIZtNvWZb82VEovW3Gm7zYdfJmIIWG-Q4ZOsVMI_1Ed650wy41blyuwLGlLFj7kMbMS4Mj6hJx106OapdaPdNWjvw Oct 19 03:32:09.656978 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:32:09.656978 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:32:09.656978 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:32:09.656978 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:32:09.656978 n-d-861333-8 devstack@n-api.service[121134]: X-Openstack-Nova-Api-Version: 2.54 Oct 19 03:32:09.656978 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:32:09.656978 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:32:09.656978 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 04fa10fa4a4a4726b3a2c5b373876650 Oct 19 03:32:09.656978 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ServerShowV254Test-686477848 Oct 19 03:32:09.656978 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:32:09.656978 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:32:09.656978 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/04fa10fa4a4a4726b3a2c5b373876650"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/04fa10fa4a4a4726b3a2c5b373876650"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/04fa10fa4a4a4726b3a2c5b373876650"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_04fa10fa4a4a4726b3a2c5b373876650", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:32:09.656978 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ServerShowV254Test-686477848 Oct 19 03:32:09.656978 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 04fa10fa4a4a4726b3a2c5b373876650 Oct 19 03:32:09.656978 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ServerShowV254Test-686477848 Oct 19 03:32:09.656978 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ServerShowV254Test-686477848-project Oct 19 03:32:09.656978 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:32:09.656978 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:32:09.656978 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 3a66063e37d640108cf1c500368ba9b6 Oct 19 03:32:09.656978 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ServerShowV254Test-686477848-project Oct 19 03:32:09.656978 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:32:09.656978 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance 41c45cc9-0697-4ca0-a968-c982723b2155 could not be found. Oct 19 03:32:09.656978 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '41c45cc9-0697-4ca0-a968-c982723b2155'} Oct 19 03:32:09.656978 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:32:09.656978 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:32:09.656978 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:32:09.656978 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:32:09.656978 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:32:09.656978 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:32:09.656978 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:32:09.656978 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:32:09.656978 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:32:09.656978 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:32:09.656978 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41c45cc9-0697-4ca0-a968-c982723b2155 could not be found. Oct 19 03:32:09.656978 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:32:09.656978 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:32:09.656978 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:32:09.656978 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:32:09.656978 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:32:09.656978 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:32:09.656978 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:32:09.656978 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:32:09.656978 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:32:09.656978 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:32:09.656978 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:32:09.656978 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:32:09.656978 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:32:09.656978 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:32:09.656978 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:32:09.656978 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:32:09.656978 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41c45cc9-0697-4ca0-a968-c982723b2155 could not be found. Oct 19 03:32:09.656978 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:32:09.656978 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:32:09.656978 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:32:09.661778 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:32:09.661778 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:32:09.661778 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:32:09.661778 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:32:09.661778 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:32:09.661778 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41c45cc9-0697-4ca0-a968-c982723b2155 could not be found. Oct 19 03:32:09.661778 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:32:09.663787 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d8181e5b-39d7-461d-a45b-33a983376e4f tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] Returning 404 to user: Instance 41c45cc9-0697-4ca0-a968-c982723b2155 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:32:09.665489 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d8181e5b-39d7-461d-a45b-33a983376e4f tempest-ServerShowV254Test-686477848 tempest-ServerShowV254Test-686477848-project] 10.222.0.52 "GET /compute/v2.1/servers/41c45cc9-0697-4ca0-a968-c982723b2155" status: 404 len: 111 microversion: 2.54 time: 0.056703 Oct 19 03:32:09.670367 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2102/4299] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:32:09 2022] GET /compute/v2.1/servers/41c45cc9-0697-4ca0-a968-c982723b2155 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 19 03:32:09.738944 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5cf5bf17-212c-43ef-af0a-f5f73756ef5e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:09.739744 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-5cf5bf17-212c-43ef-af0a-f5f73756ef5e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 4b805c13-68bb-4794-87b6-a63598253193] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:09.741880 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:32:09.743184 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=10 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:32:09.748903 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5cf5bf17-212c-43ef-af0a-f5f73756ef5e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:09.749837 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5cf5bf17-212c-43ef-af0a-f5f73756ef5e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:09.750289 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5cf5bf17-212c-43ef-af0a-f5f73756ef5e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:09.751031 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5cf5bf17-212c-43ef-af0a-f5f73756ef5e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:09.751593 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5cf5bf17-212c-43ef-af0a-f5f73756ef5e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:09.752029 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5cf5bf17-212c-43ef-af0a-f5f73756ef5e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:10.242969 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-5cf5bf17-212c-43ef-af0a-f5f73756ef5e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:10.257539 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5cf5bf17-212c-43ef-af0a-f5f73756ef5e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/4b805c13-68bb-4794-87b6-a63598253193" status: 200 len: 1511 microversion: 2.1 time: 0.523162 Oct 19 03:32:10.275854 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2198/4300] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:32:09 2022] GET /compute/v2.1/servers/4b805c13-68bb-4794-87b6-a63598253193 => generated 1511 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:32:10.376793 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c19dd40a-de66-4fe5-98c8-21534ba6c919 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:10.378565 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c19dd40a-de66-4fe5-98c8-21534ba6c919 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] [instance: 4851555c-a35e-4277-ab6e-3099b6e8a72b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:10.391409 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c19dd40a-de66-4fe5-98c8-21534ba6c919 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:10.393319 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c19dd40a-de66-4fe5-98c8-21534ba6c919 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:10.393819 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c19dd40a-de66-4fe5-98c8-21534ba6c919 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:10.394567 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c19dd40a-de66-4fe5-98c8-21534ba6c919 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:10.398282 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c19dd40a-de66-4fe5-98c8-21534ba6c919 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:10.398987 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c19dd40a-de66-4fe5-98c8-21534ba6c919 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:10.989966 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-af68aaa3-9079-48fc-a72d-32f0ea574d67 req-a2aea533-0f31-4b11-975a-bb54d96e9027 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4851555c-a35e-4277-ab6e-3099b6e8a72b", "tag": "6e236f5f-c9bc-4fcf-90f3-65a1eb03ff9a"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:32:11.023248 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-af68aaa3-9079-48fc-a72d-32f0ea574d67 req-a2aea533-0f31-4b11-975a-bb54d96e9027 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:11.023599 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-af68aaa3-9079-48fc-a72d-32f0ea574d67 req-a2aea533-0f31-4b11-975a-bb54d96e9027 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:11.025459 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-af68aaa3-9079-48fc-a72d-32f0ea574d67 req-a2aea533-0f31-4b11-975a-bb54d96e9027 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:11.075797 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-af68aaa3-9079-48fc-a72d-32f0ea574d67 req-a2aea533-0f31-4b11-975a-bb54d96e9027 service nova] Creating event network-changed:6e236f5f-c9bc-4fcf-90f3-65a1eb03ff9a for instance 4851555c-a35e-4277-ab6e-3099b6e8a72b on n-h2-861333-8 Oct 19 03:32:11.090885 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-af68aaa3-9079-48fc-a72d-32f0ea574d67 req-a2aea533-0f31-4b11-975a-bb54d96e9027 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102570 Oct 19 03:32:11.093651 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2199/4301] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:32:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:32:11.536422 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0f0b3b33-2ed8-42ae-bcb5-87d43da803b8 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-839246970", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:32:11.607802 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.network.neutron [None req-0f0b3b33-2ed8-42ae-bcb5-87d43da803b8 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] validate_networks() for None {{(pid=121135) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:32:11.673546 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c19dd40a-de66-4fe5-98c8-21534ba6c919 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15464bcbb944412bfab92df2d740dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1cd843801f48bebaccda875d5aa647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:11.682193 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c19dd40a-de66-4fe5-98c8-21534ba6c919 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] 10.222.0.52 "GET /compute/v2.1/servers/4851555c-a35e-4277-ab6e-3099b6e8a72b" status: 200 len: 1322 microversion: 2.1 time: 1.309275 Oct 19 03:32:11.682785 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2103/4302] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:32:10 2022] GET /compute/v2.1/servers/4851555c-a35e-4277-ab6e-3099b6e8a72b => generated 1322 bytes in 1311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:32:11.695167 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1b78d1d5-d3cb-48b4-82aa-c46f6f05fff7 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:11.702155 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1b78d1d5-d3cb-48b4-82aa-c46f6f05fff7 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 4b805c13-68bb-4794-87b6-a63598253193] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:11.731316 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1b78d1d5-d3cb-48b4-82aa-c46f6f05fff7 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:11.734239 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1b78d1d5-d3cb-48b4-82aa-c46f6f05fff7 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:11.736227 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1b78d1d5-d3cb-48b4-82aa-c46f6f05fff7 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:11.737124 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1b78d1d5-d3cb-48b4-82aa-c46f6f05fff7 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:11.740078 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1b78d1d5-d3cb-48b4-82aa-c46f6f05fff7 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:11.745114 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1b78d1d5-d3cb-48b4-82aa-c46f6f05fff7 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:12.670652 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-1b78d1d5-d3cb-48b4-82aa-c46f6f05fff7 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:12.684849 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1b78d1d5-d3cb-48b4-82aa-c46f6f05fff7 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/4b805c13-68bb-4794-87b6-a63598253193" status: 200 len: 1511 microversion: 2.1 time: 0.996620 Oct 19 03:32:12.685836 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2104/4303] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:32:11 2022] GET /compute/v2.1/servers/4b805c13-68bb-4794-87b6-a63598253193 => generated 1511 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:32:12.710279 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-fe45c3ac-5a62-4076-a193-64e0cc872af0 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:12.710993 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-fe45c3ac-5a62-4076-a193-64e0cc872af0 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] [instance: 4851555c-a35e-4277-ab6e-3099b6e8a72b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:12.731461 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fe45c3ac-5a62-4076-a193-64e0cc872af0 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:12.731966 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fe45c3ac-5a62-4076-a193-64e0cc872af0 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:12.732431 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fe45c3ac-5a62-4076-a193-64e0cc872af0 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:12.733148 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fe45c3ac-5a62-4076-a193-64e0cc872af0 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:12.733640 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fe45c3ac-5a62-4076-a193-64e0cc872af0 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:12.734253 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fe45c3ac-5a62-4076-a193-64e0cc872af0 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:12.889700 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-0f0b3b33-2ed8-42ae-bcb5-87d43da803b8 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Flavor limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:32:12.890651 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-0f0b3b33-2ed8-42ae-bcb5-87d43da803b8 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Image limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:32:12.891349 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-0f0b3b33-2ed8-42ae-bcb5-87d43da803b8 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Flavor pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:32:12.891916 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-0f0b3b33-2ed8-42ae-bcb5-87d43da803b8 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Image pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:32:12.892493 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-0f0b3b33-2ed8-42ae-bcb5-87d43da803b8 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:32:12.912567 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0f0b3b33-2ed8-42ae-bcb5-87d43da803b8 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:12.913934 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0f0b3b33-2ed8-42ae-bcb5-87d43da803b8 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:12.915852 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0f0b3b33-2ed8-42ae-bcb5-87d43da803b8 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:12.917898 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0f0b3b33-2ed8-42ae-bcb5-87d43da803b8 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:12.918599 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0f0b3b33-2ed8-42ae-bcb5-87d43da803b8 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:12.919439 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0f0b3b33-2ed8-42ae-bcb5-87d43da803b8 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:12.941911 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-0f0b3b33-2ed8-42ae-bcb5-87d43da803b8 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Getting quotas for project dc49f9b6a0054092beda3ab313bff1b9. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:32:12.949797 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-0f0b3b33-2ed8-42ae-bcb5-87d43da803b8 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Getting quotas for user 4b748815c10a46d2adc26d5c8a1ba268 and project dc49f9b6a0054092beda3ab313bff1b9. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:32:12.970556 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0f0b3b33-2ed8-42ae-bcb5-87d43da803b8 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Going to run 1 instances... {{(pid=121135) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:32:12.973273 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0f0b3b33-2ed8-42ae-bcb5-87d43da803b8 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] [instance: eb87cd67-6681-435d-9a65-56a2a06aaccb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121135) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:32:13.143014 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-fe45c3ac-5a62-4076-a193-64e0cc872af0 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15464bcbb944412bfab92df2d740dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1cd843801f48bebaccda875d5aa647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:13.156336 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-fe45c3ac-5a62-4076-a193-64e0cc872af0 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] 10.222.0.52 "GET /compute/v2.1/servers/4851555c-a35e-4277-ab6e-3099b6e8a72b" status: 200 len: 1322 microversion: 2.1 time: 0.445102 Oct 19 03:32:13.156947 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2105/4304] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:32:12 2022] GET /compute/v2.1/servers/4851555c-a35e-4277-ab6e-3099b6e8a72b => generated 1322 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:32:13.177059 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0f0b3b33-2ed8-42ae-bcb5-87d43da803b8 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.025620 Oct 19 03:32:13.185898 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2200/4305] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:32:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 2035 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 19 03:32:13.191674 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ac568c3f-ee6c-47d3-ad40-b007efe64d70 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:13.192304 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ac568c3f-ee6c-47d3-ad40-b007efe64d70 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] [instance: eb87cd67-6681-435d-9a65-56a2a06aaccb] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:13.282672 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ac568c3f-ee6c-47d3-ad40-b007efe64d70 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b748815c10a46d2adc26d5c8a1ba268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc49f9b6a0054092beda3ab313bff1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:13.291417 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ac568c3f-ee6c-47d3-ad40-b007efe64d70 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] 10.222.0.52 "GET /compute/v2.1/servers/eb87cd67-6681-435d-9a65-56a2a06aaccb" status: 200 len: 1221 microversion: 2.1 time: 0.104598 Oct 19 03:32:13.293335 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2106/4306] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:32:13 2022] GET /compute/v2.1/servers/eb87cd67-6681-435d-9a65-56a2a06aaccb => generated 1221 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:32:13.409171 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-876abe90-1d8f-4576-8cfb-ee2f8303cd59 req-c7f0b221-cab9-45cc-88d2-1db72ace1da2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70a327e7-5c86-4d2b-b7b2-3c18e4027d81", "tag": "9537c9c7-d9df-46bc-bca0-1ab6eb56e119"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:32:13.450726 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:32:13.454182 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-876abe90-1d8f-4576-8cfb-ee2f8303cd59 req-c7f0b221-cab9-45cc-88d2-1db72ace1da2 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:13.455404 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-876abe90-1d8f-4576-8cfb-ee2f8303cd59 req-c7f0b221-cab9-45cc-88d2-1db72ace1da2 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:13.455404 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-876abe90-1d8f-4576-8cfb-ee2f8303cd59 req-c7f0b221-cab9-45cc-88d2-1db72ace1da2 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:13.480923 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-876abe90-1d8f-4576-8cfb-ee2f8303cd59 req-c7f0b221-cab9-45cc-88d2-1db72ace1da2 service nova] Creating event network-changed:9537c9c7-d9df-46bc-bca0-1ab6eb56e119 for instance 70a327e7-5c86-4d2b-b7b2-3c18e4027d81 on n-h2-861333-8 Oct 19 03:32:13.486503 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-876abe90-1d8f-4576-8cfb-ee2f8303cd59 req-c7f0b221-cab9-45cc-88d2-1db72ace1da2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082749 Oct 19 03:32:13.497094 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2201/4307] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:32:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:32:13.709505 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c3b79d6f-356f-47c3-8ba5-6d5ef278f111 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:13.710131 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c3b79d6f-356f-47c3-8ba5-6d5ef278f111 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 4b805c13-68bb-4794-87b6-a63598253193] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:13.721612 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c3b79d6f-356f-47c3-8ba5-6d5ef278f111 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:13.722416 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c3b79d6f-356f-47c3-8ba5-6d5ef278f111 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:13.723071 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c3b79d6f-356f-47c3-8ba5-6d5ef278f111 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:13.724089 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c3b79d6f-356f-47c3-8ba5-6d5ef278f111 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:13.725238 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c3b79d6f-356f-47c3-8ba5-6d5ef278f111 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:13.726193 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c3b79d6f-356f-47c3-8ba5-6d5ef278f111 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:14.182108 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d8c55c8b-6de3-4807-8a51-0b2a747c721a tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:14.182817 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d8c55c8b-6de3-4807-8a51-0b2a747c721a tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] [instance: 4851555c-a35e-4277-ab6e-3099b6e8a72b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:14.190463 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d8c55c8b-6de3-4807-8a51-0b2a747c721a tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:14.191209 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d8c55c8b-6de3-4807-8a51-0b2a747c721a tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:14.191847 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d8c55c8b-6de3-4807-8a51-0b2a747c721a tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:14.192562 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d8c55c8b-6de3-4807-8a51-0b2a747c721a tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:14.193168 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d8c55c8b-6de3-4807-8a51-0b2a747c721a tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:14.193793 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d8c55c8b-6de3-4807-8a51-0b2a747c721a tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:14.205843 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c3b79d6f-356f-47c3-8ba5-6d5ef278f111 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:14.222033 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c3b79d6f-356f-47c3-8ba5-6d5ef278f111 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/4b805c13-68bb-4794-87b6-a63598253193" status: 200 len: 1511 microversion: 2.1 time: 0.515754 Oct 19 03:32:14.223261 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2107/4308] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:32:13 2022] GET /compute/v2.1/servers/4b805c13-68bb-4794-87b6-a63598253193 => generated 1511 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:32:14.323495 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9254c9e7-5ca4-408a-ad8a-00ccb9bf6b46 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:14.324414 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9254c9e7-5ca4-408a-ad8a-00ccb9bf6b46 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] [instance: eb87cd67-6681-435d-9a65-56a2a06aaccb] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:14.504572 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9254c9e7-5ca4-408a-ad8a-00ccb9bf6b46 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b748815c10a46d2adc26d5c8a1ba268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc49f9b6a0054092beda3ab313bff1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:14.514148 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9254c9e7-5ca4-408a-ad8a-00ccb9bf6b46 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] 10.222.0.52 "GET /compute/v2.1/servers/eb87cd67-6681-435d-9a65-56a2a06aaccb" status: 200 len: 1221 microversion: 2.1 time: 0.196264 Oct 19 03:32:14.514898 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2108/4309] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:32:14 2022] GET /compute/v2.1/servers/eb87cd67-6681-435d-9a65-56a2a06aaccb => generated 1221 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:32:14.719791 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d8c55c8b-6de3-4807-8a51-0b2a747c721a tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15464bcbb944412bfab92df2d740dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1cd843801f48bebaccda875d5aa647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:14.732452 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d8c55c8b-6de3-4807-8a51-0b2a747c721a tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] 10.222.0.52 "GET /compute/v2.1/servers/4851555c-a35e-4277-ab6e-3099b6e8a72b" status: 200 len: 1322 microversion: 2.1 time: 0.555399 Oct 19 03:32:14.746204 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2202/4310] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:32:14 2022] GET /compute/v2.1/servers/4851555c-a35e-4277-ab6e-3099b6e8a72b => generated 1322 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:32:15.248133 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a8c70224-ba2f-4122-a53a-3dc576ea5385 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:15.249534 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a8c70224-ba2f-4122-a53a-3dc576ea5385 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 4b805c13-68bb-4794-87b6-a63598253193] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:15.260609 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a8c70224-ba2f-4122-a53a-3dc576ea5385 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:15.261527 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a8c70224-ba2f-4122-a53a-3dc576ea5385 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:15.262317 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a8c70224-ba2f-4122-a53a-3dc576ea5385 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:15.263500 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a8c70224-ba2f-4122-a53a-3dc576ea5385 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:15.264129 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a8c70224-ba2f-4122-a53a-3dc576ea5385 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:15.264730 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a8c70224-ba2f-4122-a53a-3dc576ea5385 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:15.525828 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-c5adcdbd-36f9-4bea-b43b-bbdaae9036bf req-01c69b53-eaba-4ee1-beb5-e696a5e88676 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fe11b03-fcac-4a7e-af1c-4ae425f2d548", "tag": "1fa56810-33c9-47c1-b22f-2af5be2dec70"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:32:15.538860 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-c5adcdbd-36f9-4bea-b43b-bbdaae9036bf req-01c69b53-eaba-4ee1-beb5-e696a5e88676 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:15.540105 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-c5adcdbd-36f9-4bea-b43b-bbdaae9036bf req-01c69b53-eaba-4ee1-beb5-e696a5e88676 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:15.540950 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-c5adcdbd-36f9-4bea-b43b-bbdaae9036bf req-01c69b53-eaba-4ee1-beb5-e696a5e88676 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:15.563453 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-c5adcdbd-36f9-4bea-b43b-bbdaae9036bf req-01c69b53-eaba-4ee1-beb5-e696a5e88676 service nova] Creating event network-changed:1fa56810-33c9-47c1-b22f-2af5be2dec70 for instance 6fe11b03-fcac-4a7e-af1c-4ae425f2d548 on n-h1-861333-8 Oct 19 03:32:15.569226 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-c5adcdbd-36f9-4bea-b43b-bbdaae9036bf req-01c69b53-eaba-4ee1-beb5-e696a5e88676 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051705 Oct 19 03:32:15.570782 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2203/4311] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:32:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:32:15.576227 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-16e8d073-2340-433e-a00d-08a61660bdfe tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:15.577032 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-16e8d073-2340-433e-a00d-08a61660bdfe tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] [instance: eb87cd67-6681-435d-9a65-56a2a06aaccb] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:15.584120 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-16e8d073-2340-433e-a00d-08a61660bdfe tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:15.584735 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-16e8d073-2340-433e-a00d-08a61660bdfe tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:15.585268 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-16e8d073-2340-433e-a00d-08a61660bdfe tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:15.586722 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-16e8d073-2340-433e-a00d-08a61660bdfe tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:15.587250 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-16e8d073-2340-433e-a00d-08a61660bdfe tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:15.587911 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-16e8d073-2340-433e-a00d-08a61660bdfe tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:15.701685 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a8c70224-ba2f-4122-a53a-3dc576ea5385 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:15.708223 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-16e8d073-2340-433e-a00d-08a61660bdfe tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b748815c10a46d2adc26d5c8a1ba268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc49f9b6a0054092beda3ab313bff1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:15.716412 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a8c70224-ba2f-4122-a53a-3dc576ea5385 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/4b805c13-68bb-4794-87b6-a63598253193" status: 200 len: 1511 microversion: 2.1 time: 0.470913 Oct 19 03:32:15.745440 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-16e8d073-2340-433e-a00d-08a61660bdfe tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] 10.222.0.52 "GET /compute/v2.1/servers/eb87cd67-6681-435d-9a65-56a2a06aaccb" status: 200 len: 1217 microversion: 2.1 time: 0.153444 Oct 19 03:32:15.745440 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2204/4312] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:32:15 2022] GET /compute/v2.1/servers/eb87cd67-6681-435d-9a65-56a2a06aaccb => generated 1217 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:32:15.745630 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2109/4313] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:32:15 2022] GET /compute/v2.1/servers/4b805c13-68bb-4794-87b6-a63598253193 => generated 1511 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:32:15.765082 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1b560d91-347b-4f18-8002-06ca87c1f57c tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:15.766191 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1b560d91-347b-4f18-8002-06ca87c1f57c tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] [instance: 4851555c-a35e-4277-ab6e-3099b6e8a72b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:15.776068 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1b560d91-347b-4f18-8002-06ca87c1f57c tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:15.777724 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1b560d91-347b-4f18-8002-06ca87c1f57c tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:15.778612 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1b560d91-347b-4f18-8002-06ca87c1f57c tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:15.781528 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1b560d91-347b-4f18-8002-06ca87c1f57c tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:15.782643 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1b560d91-347b-4f18-8002-06ca87c1f57c tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:15.783336 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1b560d91-347b-4f18-8002-06ca87c1f57c tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:16.080749 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-1b560d91-347b-4f18-8002-06ca87c1f57c tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15464bcbb944412bfab92df2d740dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1cd843801f48bebaccda875d5aa647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:16.091163 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1b560d91-347b-4f18-8002-06ca87c1f57c tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] 10.222.0.52 "GET /compute/v2.1/servers/4851555c-a35e-4277-ab6e-3099b6e8a72b" status: 200 len: 1322 microversion: 2.1 time: 0.335019 Oct 19 03:32:16.104598 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2205/4314] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:32:15 2022] GET /compute/v2.1/servers/4851555c-a35e-4277-ab6e-3099b6e8a72b => generated 1322 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:32:16.739959 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2bb87706-31a2-4e50-a611-cc5d00533be3 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:16.740835 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2bb87706-31a2-4e50-a611-cc5d00533be3 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 4b805c13-68bb-4794-87b6-a63598253193] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:16.748557 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2bb87706-31a2-4e50-a611-cc5d00533be3 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:16.749066 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2bb87706-31a2-4e50-a611-cc5d00533be3 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:16.749529 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2bb87706-31a2-4e50-a611-cc5d00533be3 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:16.753814 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2bb87706-31a2-4e50-a611-cc5d00533be3 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:16.753814 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2bb87706-31a2-4e50-a611-cc5d00533be3 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:16.753814 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2bb87706-31a2-4e50-a611-cc5d00533be3 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:16.765868 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-cf8a3250-d61a-4c2b-86ce-8140b5f8a737 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:16.766657 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-cf8a3250-d61a-4c2b-86ce-8140b5f8a737 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] [instance: eb87cd67-6681-435d-9a65-56a2a06aaccb] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:16.786942 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cf8a3250-d61a-4c2b-86ce-8140b5f8a737 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:16.787406 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cf8a3250-d61a-4c2b-86ce-8140b5f8a737 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:16.787853 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cf8a3250-d61a-4c2b-86ce-8140b5f8a737 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:16.788571 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cf8a3250-d61a-4c2b-86ce-8140b5f8a737 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:16.789312 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cf8a3250-d61a-4c2b-86ce-8140b5f8a737 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:16.790244 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cf8a3250-d61a-4c2b-86ce-8140b5f8a737 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:16.798205 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:32:17.068636 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-cf8a3250-d61a-4c2b-86ce-8140b5f8a737 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b748815c10a46d2adc26d5c8a1ba268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc49f9b6a0054092beda3ab313bff1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:17.082580 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-cf8a3250-d61a-4c2b-86ce-8140b5f8a737 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] 10.222.0.52 "GET /compute/v2.1/servers/eb87cd67-6681-435d-9a65-56a2a06aaccb" status: 200 len: 1281 microversion: 2.1 time: 0.322254 Oct 19 03:32:17.098828 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2206/4315] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:32:16 2022] GET /compute/v2.1/servers/eb87cd67-6681-435d-9a65-56a2a06aaccb => generated 1281 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:32:17.115848 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e9e0c187-45ef-447c-a93b-62293739724b tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:17.116443 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e9e0c187-45ef-447c-a93b-62293739724b tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] [instance: 4851555c-a35e-4277-ab6e-3099b6e8a72b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:17.123875 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e9e0c187-45ef-447c-a93b-62293739724b tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:17.124455 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e9e0c187-45ef-447c-a93b-62293739724b tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:17.127463 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e9e0c187-45ef-447c-a93b-62293739724b tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:17.127463 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e9e0c187-45ef-447c-a93b-62293739724b tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:17.127463 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e9e0c187-45ef-447c-a93b-62293739724b tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:17.127463 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e9e0c187-45ef-447c-a93b-62293739724b tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:17.233473 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-2bb87706-31a2-4e50-a611-cc5d00533be3 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:17.241825 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2bb87706-31a2-4e50-a611-cc5d00533be3 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/4b805c13-68bb-4794-87b6-a63598253193" status: 200 len: 1488 microversion: 2.1 time: 0.505731 Oct 19 03:32:17.243545 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2110/4316] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:32:16 2022] GET /compute/v2.1/servers/4b805c13-68bb-4794-87b6-a63598253193 => generated 1488 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:32:17.248563 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-0dee6573-9b47-460f-b07e-bf23da527ddb req-093843d2-8e3c-4746-945d-f20785a826e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4851555c-a35e-4277-ab6e-3099b6e8a72b", "name": "network-vif-plugged", "status": "completed", "tag": "6e236f5f-c9bc-4fcf-90f3-65a1eb03ff9a"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:32:17.258296 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-0dee6573-9b47-460f-b07e-bf23da527ddb req-093843d2-8e3c-4746-945d-f20785a826e1 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:17.258788 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-0dee6573-9b47-460f-b07e-bf23da527ddb req-093843d2-8e3c-4746-945d-f20785a826e1 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:17.259227 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-0dee6573-9b47-460f-b07e-bf23da527ddb req-093843d2-8e3c-4746-945d-f20785a826e1 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:17.276274 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-0dee6573-9b47-460f-b07e-bf23da527ddb req-093843d2-8e3c-4746-945d-f20785a826e1 service nova] Creating event network-vif-plugged:6e236f5f-c9bc-4fcf-90f3-65a1eb03ff9a for instance 4851555c-a35e-4277-ab6e-3099b6e8a72b on n-h2-861333-8 Oct 19 03:32:17.282185 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-0dee6573-9b47-460f-b07e-bf23da527ddb req-093843d2-8e3c-4746-945d-f20785a826e1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037238 Oct 19 03:32:17.283340 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2111/4317] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:32:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:32:17.292627 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7899f53f-0803-47b0-bf5d-4193e370c09a tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:32:17.295998 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7899f53f-0803-47b0-bf5d-4193e370c09a tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:17.326143 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7899f53f-0803-47b0-bf5d-4193e370c09a tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:17.326143 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7899f53f-0803-47b0-bf5d-4193e370c09a tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:17.326143 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7899f53f-0803-47b0-bf5d-4193e370c09a tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:17.326143 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7899f53f-0803-47b0-bf5d-4193e370c09a tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:17.326143 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7899f53f-0803-47b0-bf5d-4193e370c09a tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:17.326143 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7899f53f-0803-47b0-bf5d-4193e370c09a tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:17.362895 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=100 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:32:17.462049 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-e9e0c187-45ef-447c-a93b-62293739724b tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15464bcbb944412bfab92df2d740dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1cd843801f48bebaccda875d5aa647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:17.478463 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e9e0c187-45ef-447c-a93b-62293739724b tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] 10.222.0.52 "GET /compute/v2.1/servers/4851555c-a35e-4277-ab6e-3099b6e8a72b" status: 200 len: 1322 microversion: 2.1 time: 0.366185 Oct 19 03:32:17.494503 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2207/4318] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:32:17 2022] GET /compute/v2.1/servers/4851555c-a35e-4277-ab6e-3099b6e8a72b => generated 1322 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:32:17.536046 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7899f53f-0803-47b0-bf5d-4193e370c09a tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "POST /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f/action" status: 200 len: 137 microversion: 2.1 time: 0.250276 Oct 19 03:32:17.537128 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2112/4319] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:32:17 2022] POST /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f/action => generated 137 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:32:17.551009 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1a6c737a-a615-4500-b5a5-d359e4db58cb tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:17.551971 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1a6c737a-a615-4500-b5a5-d359e4db58cb tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:17.567051 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1a6c737a-a615-4500-b5a5-d359e4db58cb tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:17.570136 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1a6c737a-a615-4500-b5a5-d359e4db58cb tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:17.571792 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1a6c737a-a615-4500-b5a5-d359e4db58cb tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:17.574338 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1a6c737a-a615-4500-b5a5-d359e4db58cb tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:17.574896 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1a6c737a-a615-4500-b5a5-d359e4db58cb tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:17.575737 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1a6c737a-a615-4500-b5a5-d359e4db58cb tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:18.112039 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-18d05106-e010-463c-b280-c22885baa3f9 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:18.116903 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-18d05106-e010-463c-b280-c22885baa3f9 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] [instance: eb87cd67-6681-435d-9a65-56a2a06aaccb] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:18.128671 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-18d05106-e010-463c-b280-c22885baa3f9 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:18.129769 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-18d05106-e010-463c-b280-c22885baa3f9 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:18.135671 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-18d05106-e010-463c-b280-c22885baa3f9 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:18.139605 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-18d05106-e010-463c-b280-c22885baa3f9 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:18.141512 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-18d05106-e010-463c-b280-c22885baa3f9 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:18.142879 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-18d05106-e010-463c-b280-c22885baa3f9 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:18.154741 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-1a6c737a-a615-4500-b5a5-d359e4db58cb tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:18.184906 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1a6c737a-a615-4500-b5a5-d359e4db58cb tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1670 microversion: 2.1 time: 0.637051 Oct 19 03:32:18.215385 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2208/4320] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:32:17 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1670 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:32:18.232235 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-123c1319-9154-4de5-9c67-6b9d128ed3f8 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:18.233084 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-123c1319-9154-4de5-9c67-6b9d128ed3f8 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:18.241056 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-123c1319-9154-4de5-9c67-6b9d128ed3f8 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:18.241859 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-123c1319-9154-4de5-9c67-6b9d128ed3f8 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:18.242608 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-123c1319-9154-4de5-9c67-6b9d128ed3f8 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:18.243622 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-123c1319-9154-4de5-9c67-6b9d128ed3f8 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:18.244294 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-123c1319-9154-4de5-9c67-6b9d128ed3f8 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:18.244939 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-123c1319-9154-4de5-9c67-6b9d128ed3f8 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:18.395820 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-18d05106-e010-463c-b280-c22885baa3f9 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b748815c10a46d2adc26d5c8a1ba268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc49f9b6a0054092beda3ab313bff1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:18.418770 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-18d05106-e010-463c-b280-c22885baa3f9 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] 10.222.0.52 "GET /compute/v2.1/servers/eb87cd67-6681-435d-9a65-56a2a06aaccb" status: 200 len: 1281 microversion: 2.1 time: 0.311654 Oct 19 03:32:18.430833 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2113/4321] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:32:18 2022] GET /compute/v2.1/servers/eb87cd67-6681-435d-9a65-56a2a06aaccb => generated 1281 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:32:18.503761 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-00190d24-1895-487e-8548-c39f2fc3dcec tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:18.506244 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-00190d24-1895-487e-8548-c39f2fc3dcec tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] [instance: 4851555c-a35e-4277-ab6e-3099b6e8a72b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:18.527070 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-00190d24-1895-487e-8548-c39f2fc3dcec tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:18.527744 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-00190d24-1895-487e-8548-c39f2fc3dcec tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:18.528209 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-00190d24-1895-487e-8548-c39f2fc3dcec tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:18.528956 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-00190d24-1895-487e-8548-c39f2fc3dcec tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:18.534791 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-00190d24-1895-487e-8548-c39f2fc3dcec tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:18.534791 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-00190d24-1895-487e-8548-c39f2fc3dcec tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:18.807262 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-123c1319-9154-4de5-9c67-6b9d128ed3f8 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:18.826012 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-123c1319-9154-4de5-9c67-6b9d128ed3f8 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1670 microversion: 2.1 time: 0.599927 Oct 19 03:32:18.834527 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2209/4322] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:32:18 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1670 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:32:18.863409 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4065e13b-7ae7-405d-b0f6-1f331c1ed786 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:18.865077 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4065e13b-7ae7-405d-b0f6-1f331c1ed786 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:18.872064 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4065e13b-7ae7-405d-b0f6-1f331c1ed786 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:18.872487 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4065e13b-7ae7-405d-b0f6-1f331c1ed786 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:18.873141 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4065e13b-7ae7-405d-b0f6-1f331c1ed786 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:18.874237 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4065e13b-7ae7-405d-b0f6-1f331c1ed786 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:18.874859 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4065e13b-7ae7-405d-b0f6-1f331c1ed786 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:18.875452 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4065e13b-7ae7-405d-b0f6-1f331c1ed786 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:19.245037 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4065e13b-7ae7-405d-b0f6-1f331c1ed786 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:19.265479 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4065e13b-7ae7-405d-b0f6-1f331c1ed786 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1670 microversion: 2.1 time: 0.406724 Oct 19 03:32:19.273101 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2210/4323] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:32:18 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1670 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:32:19.293141 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-aaf817a2-6d1c-4573-8bd4-3e897bd56389 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:19.294050 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-aaf817a2-6d1c-4573-8bd4-3e897bd56389 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:19.306727 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-00190d24-1895-487e-8548-c39f2fc3dcec tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15464bcbb944412bfab92df2d740dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1cd843801f48bebaccda875d5aa647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:19.307220 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aaf817a2-6d1c-4573-8bd4-3e897bd56389 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:19.307304 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aaf817a2-6d1c-4573-8bd4-3e897bd56389 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:19.308906 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aaf817a2-6d1c-4573-8bd4-3e897bd56389 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:19.309699 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aaf817a2-6d1c-4573-8bd4-3e897bd56389 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:19.311725 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aaf817a2-6d1c-4573-8bd4-3e897bd56389 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:19.318974 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aaf817a2-6d1c-4573-8bd4-3e897bd56389 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:19.319139 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-00190d24-1895-487e-8548-c39f2fc3dcec tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] 10.222.0.52 "GET /compute/v2.1/servers/4851555c-a35e-4277-ab6e-3099b6e8a72b" status: 200 len: 1322 microversion: 2.1 time: 0.817864 Oct 19 03:32:19.321983 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2114/4324] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:32:18 2022] GET /compute/v2.1/servers/4851555c-a35e-4277-ab6e-3099b6e8a72b => generated 1322 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:32:19.449619 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e018f4f7-d3d6-496a-adb9-30f5fe56a8a9 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:19.449619 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e018f4f7-d3d6-496a-adb9-30f5fe56a8a9 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] [instance: eb87cd67-6681-435d-9a65-56a2a06aaccb] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:19.458659 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e018f4f7-d3d6-496a-adb9-30f5fe56a8a9 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:19.459817 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e018f4f7-d3d6-496a-adb9-30f5fe56a8a9 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:19.460273 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e018f4f7-d3d6-496a-adb9-30f5fe56a8a9 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:19.462024 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e018f4f7-d3d6-496a-adb9-30f5fe56a8a9 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:19.462654 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e018f4f7-d3d6-496a-adb9-30f5fe56a8a9 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:19.463139 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e018f4f7-d3d6-496a-adb9-30f5fe56a8a9 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:20.524527 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e018f4f7-d3d6-496a-adb9-30f5fe56a8a9 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b748815c10a46d2adc26d5c8a1ba268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc49f9b6a0054092beda3ab313bff1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:20.537610 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e018f4f7-d3d6-496a-adb9-30f5fe56a8a9 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] 10.222.0.52 "GET /compute/v2.1/servers/eb87cd67-6681-435d-9a65-56a2a06aaccb" status: 200 len: 1279 microversion: 2.1 time: 1.095121 Oct 19 03:32:20.542003 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2115/4325] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:32:19 2022] GET /compute/v2.1/servers/eb87cd67-6681-435d-9a65-56a2a06aaccb => generated 1279 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:32:20.567401 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8e2dcfb2-2bd8-43f0-a11e-d9cca721bd18 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:20.569508 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8e2dcfb2-2bd8-43f0-a11e-d9cca721bd18 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] [instance: 4851555c-a35e-4277-ab6e-3099b6e8a72b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:20.588998 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8e2dcfb2-2bd8-43f0-a11e-d9cca721bd18 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:20.594323 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8e2dcfb2-2bd8-43f0-a11e-d9cca721bd18 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:20.596115 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8e2dcfb2-2bd8-43f0-a11e-d9cca721bd18 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:20.599176 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8e2dcfb2-2bd8-43f0-a11e-d9cca721bd18 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:20.599845 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8e2dcfb2-2bd8-43f0-a11e-d9cca721bd18 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:20.605925 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-aaf817a2-6d1c-4573-8bd4-3e897bd56389 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:20.614761 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8e2dcfb2-2bd8-43f0-a11e-d9cca721bd18 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:20.624024 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-aaf817a2-6d1c-4573-8bd4-3e897bd56389 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1670 microversion: 2.1 time: 1.335155 Oct 19 03:32:20.629612 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2211/4326] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:32:19 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1670 bytes in 1339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:32:20.897821 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e521fc89-eb19-4c14-aeeb-7f3c65eb4542 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-761901284", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "networks": [{"uuid": "6b668808-7c3c-40ac-9532-ec2c53b84149"}]}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:32:21.454795 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.network.neutron [None req-e521fc89-eb19-4c14-aeeb-7f3c65eb4542 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] validate_networks() for [('6b668808-7c3c-40ac-9532-ec2c53b84149', None, None, None, None, None)] {{(pid=121135) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:32:21.650847 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8e2dcfb2-2bd8-43f0-a11e-d9cca721bd18 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15464bcbb944412bfab92df2d740dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1cd843801f48bebaccda875d5aa647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:21.666225 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8e2dcfb2-2bd8-43f0-a11e-d9cca721bd18 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] 10.222.0.52 "GET /compute/v2.1/servers/4851555c-a35e-4277-ab6e-3099b6e8a72b" status: 200 len: 1515 microversion: 2.1 time: 1.122853 Oct 19 03:32:21.667532 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2116/4327] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:32:20 2022] GET /compute/v2.1/servers/4851555c-a35e-4277-ab6e-3099b6e8a72b => generated 1515 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:32:21.682275 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d00214d9-1984-4880-85ba-bba6ffcec55b tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:21.683727 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d00214d9-1984-4880-85ba-bba6ffcec55b tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] [instance: eb87cd67-6681-435d-9a65-56a2a06aaccb] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:21.699796 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d00214d9-1984-4880-85ba-bba6ffcec55b tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:21.700662 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d00214d9-1984-4880-85ba-bba6ffcec55b tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:21.701394 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d00214d9-1984-4880-85ba-bba6ffcec55b tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:21.702350 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d00214d9-1984-4880-85ba-bba6ffcec55b tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:21.703041 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d00214d9-1984-4880-85ba-bba6ffcec55b tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:21.705584 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d00214d9-1984-4880-85ba-bba6ffcec55b tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:22.031741 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d00214d9-1984-4880-85ba-bba6ffcec55b tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b748815c10a46d2adc26d5c8a1ba268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc49f9b6a0054092beda3ab313bff1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:22.044812 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d00214d9-1984-4880-85ba-bba6ffcec55b tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] 10.222.0.52 "GET /compute/v2.1/servers/eb87cd67-6681-435d-9a65-56a2a06aaccb" status: 200 len: 1279 microversion: 2.1 time: 0.375502 Oct 19 03:32:22.061398 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2117/4328] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:32:21 2022] GET /compute/v2.1/servers/eb87cd67-6681-435d-9a65-56a2a06aaccb => generated 1279 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:32:22.076804 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-29fc88b1-2235-4705-94b7-cae2100894f5 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:22.078283 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-29fc88b1-2235-4705-94b7-cae2100894f5 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] [instance: 6fe11b03-fcac-4a7e-af1c-4ae425f2d548] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:22.109501 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-29fc88b1-2235-4705-94b7-cae2100894f5 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:22.110639 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-29fc88b1-2235-4705-94b7-cae2100894f5 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:22.111847 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-29fc88b1-2235-4705-94b7-cae2100894f5 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:22.131027 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-29fc88b1-2235-4705-94b7-cae2100894f5 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:22.133846 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-29fc88b1-2235-4705-94b7-cae2100894f5 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:22.135542 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-29fc88b1-2235-4705-94b7-cae2100894f5 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:22.709006 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-29fc88b1-2235-4705-94b7-cae2100894f5 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15464bcbb944412bfab92df2d740dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1cd843801f48bebaccda875d5aa647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:22.720397 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-29fc88b1-2235-4705-94b7-cae2100894f5 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] 10.222.0.52 "GET /compute/v2.1/servers/6fe11b03-fcac-4a7e-af1c-4ae425f2d548" status: 200 len: 1322 microversion: 2.1 time: 0.670617 Oct 19 03:32:22.721320 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2118/4329] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:32:22 2022] GET /compute/v2.1/servers/6fe11b03-fcac-4a7e-af1c-4ae425f2d548 => generated 1322 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:32:22.931182 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:32:22.952894 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-e521fc89-eb19-4c14-aeeb-7f3c65eb4542 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Flavor limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:32:22.953325 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-e521fc89-eb19-4c14-aeeb-7f3c65eb4542 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Image limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:32:22.953902 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-e521fc89-eb19-4c14-aeeb-7f3c65eb4542 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Flavor pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:32:22.954322 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-e521fc89-eb19-4c14-aeeb-7f3c65eb4542 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Image pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:32:22.954728 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-e521fc89-eb19-4c14-aeeb-7f3c65eb4542 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:32:22.954863 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7605da62-4e3a-41c8-89cb-e375069ada46 tempest-ExtensionsTest-115941505 tempest-ExtensionsTest-115941505-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:22.956587 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7605da62-4e3a-41c8-89cb-e375069ada46 tempest-ExtensionsTest-115941505 tempest-ExtensionsTest-115941505-project] 10.222.0.52 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.232165 Oct 19 03:32:22.957190 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2119/4330] 10.222.0.52 () {58 vars in 1170 bytes} [Wed Oct 19 03:32:22 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:32:22.966886 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-95516958-d266-49f5-a0c7-ab0599b05f73 req-248e8db5-ca71-4530-a81f-04024001d444 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70a327e7-5c86-4d2b-b7b2-3c18e4027d81", "name": "network-vif-plugged", "status": "completed", "tag": "9537c9c7-d9df-46bc-bca0-1ab6eb56e119"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:32:22.969751 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e521fc89-eb19-4c14-aeeb-7f3c65eb4542 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:22.970250 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e521fc89-eb19-4c14-aeeb-7f3c65eb4542 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:22.970696 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e521fc89-eb19-4c14-aeeb-7f3c65eb4542 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:22.971575 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e521fc89-eb19-4c14-aeeb-7f3c65eb4542 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:22.972295 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e521fc89-eb19-4c14-aeeb-7f3c65eb4542 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:22.972735 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e521fc89-eb19-4c14-aeeb-7f3c65eb4542 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:22.988830 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-95516958-d266-49f5-a0c7-ab0599b05f73 req-248e8db5-ca71-4530-a81f-04024001d444 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:22.991403 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-95516958-d266-49f5-a0c7-ab0599b05f73 req-248e8db5-ca71-4530-a81f-04024001d444 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:22.992643 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-95516958-d266-49f5-a0c7-ab0599b05f73 req-248e8db5-ca71-4530-a81f-04024001d444 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:22.999822 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-e521fc89-eb19-4c14-aeeb-7f3c65eb4542 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Getting quotas for project a5f56376721941f8ae2293f8f969db84. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:32:23.007098 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-e521fc89-eb19-4c14-aeeb-7f3c65eb4542 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Getting quotas for user 746e1034a7ee40c1a69c8838c1e17e16 and project a5f56376721941f8ae2293f8f969db84. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:32:23.016255 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-95516958-d266-49f5-a0c7-ab0599b05f73 req-248e8db5-ca71-4530-a81f-04024001d444 service nova] Creating event network-vif-plugged:9537c9c7-d9df-46bc-bca0-1ab6eb56e119 for instance 70a327e7-5c86-4d2b-b7b2-3c18e4027d81 on n-h2-861333-8 Oct 19 03:32:23.025028 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e521fc89-eb19-4c14-aeeb-7f3c65eb4542 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Going to run 1 instances... {{(pid=121135) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:32:23.027978 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e521fc89-eb19-4c14-aeeb-7f3c65eb4542 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 3893d3e4-3a09-4adf-951b-84befacf7489] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121135) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:32:23.032517 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-95516958-d266-49f5-a0c7-ab0599b05f73 req-248e8db5-ca71-4530-a81f-04024001d444 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071437 Oct 19 03:32:23.032882 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2120/4331] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:32:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:32:23.045329 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-811b26e5-365d-4a10-a9ce-160a8b623bcf tempest-ExtensionsTest-115941505 tempest-ExtensionsTest-115941505-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:23.048142 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-811b26e5-365d-4a10-a9ce-160a8b623bcf tempest-ExtensionsTest-115941505 tempest-ExtensionsTest-115941505-project] 10.222.0.52 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.012783 Oct 19 03:32:23.049870 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2121/4332] 10.222.0.52 () {58 vars in 1134 bytes} [Wed Oct 19 03:32:23 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 03:32:23.077194 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-bfbe98bb-50d2-4251-ba92-fa6650c460b7 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:23.078169 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-bfbe98bb-50d2-4251-ba92-fa6650c460b7 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] [instance: eb87cd67-6681-435d-9a65-56a2a06aaccb] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:23.090822 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bfbe98bb-50d2-4251-ba92-fa6650c460b7 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:23.091336 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bfbe98bb-50d2-4251-ba92-fa6650c460b7 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:23.092135 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bfbe98bb-50d2-4251-ba92-fa6650c460b7 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:23.092897 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bfbe98bb-50d2-4251-ba92-fa6650c460b7 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:23.093533 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bfbe98bb-50d2-4251-ba92-fa6650c460b7 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:23.094005 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bfbe98bb-50d2-4251-ba92-fa6650c460b7 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:23.264225 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e521fc89-eb19-4c14-aeeb-7f3c65eb4542 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.371805 Oct 19 03:32:23.265545 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2212/4333] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:32:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 2374 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 19 03:32:23.276996 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-dbf03eaf-2d01-43a7-b146-74e6f6d2965a tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:23.278132 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-dbf03eaf-2d01-43a7-b146-74e6f6d2965a tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 3893d3e4-3a09-4adf-951b-84befacf7489] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:23.661527 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-dbf03eaf-2d01-43a7-b146-74e6f6d2965a tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:23.670240 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-dbf03eaf-2d01-43a7-b146-74e6f6d2965a tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/3893d3e4-3a09-4adf-951b-84befacf7489" status: 200 len: 1214 microversion: 2.1 time: 0.397455 Oct 19 03:32:23.674889 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2213/4334] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:32:23 2022] GET /compute/v2.1/servers/3893d3e4-3a09-4adf-951b-84befacf7489 => generated 1214 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:32:23.747660 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5c37cb25-716a-4fc8-bff6-8ce3889be5ea tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:23.749214 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-5c37cb25-716a-4fc8-bff6-8ce3889be5ea tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] [instance: 6fe11b03-fcac-4a7e-af1c-4ae425f2d548] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:23.760376 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5c37cb25-716a-4fc8-bff6-8ce3889be5ea tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:23.761048 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5c37cb25-716a-4fc8-bff6-8ce3889be5ea tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:23.769037 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5c37cb25-716a-4fc8-bff6-8ce3889be5ea tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:23.770212 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5c37cb25-716a-4fc8-bff6-8ce3889be5ea tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:23.770859 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5c37cb25-716a-4fc8-bff6-8ce3889be5ea tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:23.771461 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5c37cb25-716a-4fc8-bff6-8ce3889be5ea tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:24.097422 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-bfbe98bb-50d2-4251-ba92-fa6650c460b7 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b748815c10a46d2adc26d5c8a1ba268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc49f9b6a0054092beda3ab313bff1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:24.113696 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-bfbe98bb-50d2-4251-ba92-fa6650c460b7 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] 10.222.0.52 "GET /compute/v2.1/servers/eb87cd67-6681-435d-9a65-56a2a06aaccb" status: 200 len: 1321 microversion: 2.1 time: 1.044693 Oct 19 03:32:24.116125 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2122/4335] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:32:23 2022] GET /compute/v2.1/servers/eb87cd67-6681-435d-9a65-56a2a06aaccb => generated 1321 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:32:24.230673 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-5c37cb25-716a-4fc8-bff6-8ce3889be5ea tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15464bcbb944412bfab92df2d740dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1cd843801f48bebaccda875d5aa647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:24.240618 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5c37cb25-716a-4fc8-bff6-8ce3889be5ea tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] 10.222.0.52 "GET /compute/v2.1/servers/6fe11b03-fcac-4a7e-af1c-4ae425f2d548" status: 200 len: 1322 microversion: 2.1 time: 0.498613 Oct 19 03:32:24.256738 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2214/4336] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:32:23 2022] GET /compute/v2.1/servers/6fe11b03-fcac-4a7e-af1c-4ae425f2d548 => generated 1322 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:32:24.699872 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-863c0525-7802-4258-9c47-64fece15e543 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:24.700520 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-863c0525-7802-4258-9c47-64fece15e543 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 3893d3e4-3a09-4adf-951b-84befacf7489] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:24.707570 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=16 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:32:24.709437 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-863c0525-7802-4258-9c47-64fece15e543 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:24.710162 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-863c0525-7802-4258-9c47-64fece15e543 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:24.710974 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-863c0525-7802-4258-9c47-64fece15e543 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:24.712026 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-863c0525-7802-4258-9c47-64fece15e543 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:24.712827 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-863c0525-7802-4258-9c47-64fece15e543 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:24.713471 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-863c0525-7802-4258-9c47-64fece15e543 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:25.137129 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f9393dad-a0c1-4580-a645-f48c981e6e73 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:25.137772 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f9393dad-a0c1-4580-a645-f48c981e6e73 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] [instance: eb87cd67-6681-435d-9a65-56a2a06aaccb] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:25.145291 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f9393dad-a0c1-4580-a645-f48c981e6e73 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:25.146032 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f9393dad-a0c1-4580-a645-f48c981e6e73 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:25.150636 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f9393dad-a0c1-4580-a645-f48c981e6e73 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:25.152315 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f9393dad-a0c1-4580-a645-f48c981e6e73 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:25.152970 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f9393dad-a0c1-4580-a645-f48c981e6e73 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:25.153731 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f9393dad-a0c1-4580-a645-f48c981e6e73 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:25.328745 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-863c0525-7802-4258-9c47-64fece15e543 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:25.340765 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-863c0525-7802-4258-9c47-64fece15e543 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/3893d3e4-3a09-4adf-951b-84befacf7489" status: 200 len: 1218 microversion: 2.1 time: 0.644819 Oct 19 03:32:25.364619 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2123/4337] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:32:24 2022] GET /compute/v2.1/servers/3893d3e4-3a09-4adf-951b-84befacf7489 => generated 1218 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:32:25.372362 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-734fdc9a-a13c-4e1c-b8ac-ae30bce959e9 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:25.373526 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-734fdc9a-a13c-4e1c-b8ac-ae30bce959e9 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] [instance: 6fe11b03-fcac-4a7e-af1c-4ae425f2d548] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:25.401406 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-734fdc9a-a13c-4e1c-b8ac-ae30bce959e9 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:25.401406 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-734fdc9a-a13c-4e1c-b8ac-ae30bce959e9 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:25.401406 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-734fdc9a-a13c-4e1c-b8ac-ae30bce959e9 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:25.401406 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-734fdc9a-a13c-4e1c-b8ac-ae30bce959e9 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:25.401406 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-734fdc9a-a13c-4e1c-b8ac-ae30bce959e9 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:25.401406 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-734fdc9a-a13c-4e1c-b8ac-ae30bce959e9 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:25.675695 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f9393dad-a0c1-4580-a645-f48c981e6e73 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b748815c10a46d2adc26d5c8a1ba268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc49f9b6a0054092beda3ab313bff1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:25.696094 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f9393dad-a0c1-4580-a645-f48c981e6e73 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] 10.222.0.52 "GET /compute/v2.1/servers/eb87cd67-6681-435d-9a65-56a2a06aaccb" status: 200 len: 1321 microversion: 2.1 time: 0.563450 Oct 19 03:32:25.703286 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2215/4338] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:32:25 2022] GET /compute/v2.1/servers/eb87cd67-6681-435d-9a65-56a2a06aaccb => generated 1321 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:32:25.823044 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-734fdc9a-a13c-4e1c-b8ac-ae30bce959e9 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15464bcbb944412bfab92df2d740dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1cd843801f48bebaccda875d5aa647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:25.849399 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-734fdc9a-a13c-4e1c-b8ac-ae30bce959e9 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] 10.222.0.52 "GET /compute/v2.1/servers/6fe11b03-fcac-4a7e-af1c-4ae425f2d548" status: 200 len: 1322 microversion: 2.1 time: 0.481077 Oct 19 03:32:25.850357 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2124/4339] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:32:25 2022] GET /compute/v2.1/servers/6fe11b03-fcac-4a7e-af1c-4ae425f2d548 => generated 1322 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:32:26.125140 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-400cc86a-de4a-4181-8ec3-ad8140c5d69e req-5807d60a-c098-4e24-a4be-c467cee2163f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fe11b03-fcac-4a7e-af1c-4ae425f2d548", "name": "network-vif-plugged", "status": "completed", "tag": "1fa56810-33c9-47c1-b22f-2af5be2dec70"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:32:26.138969 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-400cc86a-de4a-4181-8ec3-ad8140c5d69e req-5807d60a-c098-4e24-a4be-c467cee2163f service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:26.139697 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-400cc86a-de4a-4181-8ec3-ad8140c5d69e req-5807d60a-c098-4e24-a4be-c467cee2163f service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:26.140310 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-400cc86a-de4a-4181-8ec3-ad8140c5d69e req-5807d60a-c098-4e24-a4be-c467cee2163f service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:26.163140 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-400cc86a-de4a-4181-8ec3-ad8140c5d69e req-5807d60a-c098-4e24-a4be-c467cee2163f service nova] Creating event network-vif-plugged:1fa56810-33c9-47c1-b22f-2af5be2dec70 for instance 6fe11b03-fcac-4a7e-af1c-4ae425f2d548 on n-h1-861333-8 Oct 19 03:32:26.177034 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-400cc86a-de4a-4181-8ec3-ad8140c5d69e req-5807d60a-c098-4e24-a4be-c467cee2163f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056202 Oct 19 03:32:26.178608 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2216/4340] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:32:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:32:26.377704 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-188fcfd2-127d-4b77-8e19-f8d7afd8875c tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:26.378343 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-188fcfd2-127d-4b77-8e19-f8d7afd8875c tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 3893d3e4-3a09-4adf-951b-84befacf7489] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:26.392496 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-188fcfd2-127d-4b77-8e19-f8d7afd8875c tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:26.393003 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-188fcfd2-127d-4b77-8e19-f8d7afd8875c tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:26.393480 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-188fcfd2-127d-4b77-8e19-f8d7afd8875c tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:26.399762 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-188fcfd2-127d-4b77-8e19-f8d7afd8875c tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:26.400738 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-188fcfd2-127d-4b77-8e19-f8d7afd8875c tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:26.401628 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-188fcfd2-127d-4b77-8e19-f8d7afd8875c tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:26.730231 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-962e1c4f-9865-485f-a90a-40b81e975061 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:26.730952 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-962e1c4f-9865-485f-a90a-40b81e975061 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] [instance: eb87cd67-6681-435d-9a65-56a2a06aaccb] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:26.739475 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-962e1c4f-9865-485f-a90a-40b81e975061 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:26.740221 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-962e1c4f-9865-485f-a90a-40b81e975061 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:26.740830 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-962e1c4f-9865-485f-a90a-40b81e975061 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:26.741872 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-962e1c4f-9865-485f-a90a-40b81e975061 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:26.742520 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-962e1c4f-9865-485f-a90a-40b81e975061 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:26.743623 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-962e1c4f-9865-485f-a90a-40b81e975061 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:26.787386 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-188fcfd2-127d-4b77-8e19-f8d7afd8875c tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:26.801976 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-188fcfd2-127d-4b77-8e19-f8d7afd8875c tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/3893d3e4-3a09-4adf-951b-84befacf7489" status: 200 len: 1266 microversion: 2.1 time: 0.430397 Oct 19 03:32:26.804389 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2125/4341] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:32:26 2022] GET /compute/v2.1/servers/3893d3e4-3a09-4adf-951b-84befacf7489 => generated 1266 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:32:26.878397 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1d4cff00-4d8d-4d9d-886f-a29f6a1eeb50 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:26.879255 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1d4cff00-4d8d-4d9d-886f-a29f6a1eeb50 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] [instance: 6fe11b03-fcac-4a7e-af1c-4ae425f2d548] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:26.888557 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1d4cff00-4d8d-4d9d-886f-a29f6a1eeb50 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:26.889606 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1d4cff00-4d8d-4d9d-886f-a29f6a1eeb50 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:26.890413 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1d4cff00-4d8d-4d9d-886f-a29f6a1eeb50 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:26.891106 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1d4cff00-4d8d-4d9d-886f-a29f6a1eeb50 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:26.892018 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1d4cff00-4d8d-4d9d-886f-a29f6a1eeb50 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:26.892617 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1d4cff00-4d8d-4d9d-886f-a29f6a1eeb50 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:27.152077 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-962e1c4f-9865-485f-a90a-40b81e975061 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b748815c10a46d2adc26d5c8a1ba268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc49f9b6a0054092beda3ab313bff1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:27.174872 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-962e1c4f-9865-485f-a90a-40b81e975061 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] 10.222.0.52 "GET /compute/v2.1/servers/eb87cd67-6681-435d-9a65-56a2a06aaccb" status: 200 len: 1321 microversion: 2.1 time: 0.450406 Oct 19 03:32:27.189663 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2217/4342] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:32:26 2022] GET /compute/v2.1/servers/eb87cd67-6681-435d-9a65-56a2a06aaccb => generated 1321 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:32:27.294942 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-1d4cff00-4d8d-4d9d-886f-a29f6a1eeb50 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15464bcbb944412bfab92df2d740dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1cd843801f48bebaccda875d5aa647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:27.303941 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1d4cff00-4d8d-4d9d-886f-a29f6a1eeb50 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] 10.222.0.52 "GET /compute/v2.1/servers/6fe11b03-fcac-4a7e-af1c-4ae425f2d548" status: 200 len: 1322 microversion: 2.1 time: 0.431374 Oct 19 03:32:27.313678 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2126/4343] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:32:26 2022] GET /compute/v2.1/servers/6fe11b03-fcac-4a7e-af1c-4ae425f2d548 => generated 1322 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:32:27.839480 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-78e85104-3525-4dc6-9c7a-e2790edce894 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:27.840113 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-78e85104-3525-4dc6-9c7a-e2790edce894 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 3893d3e4-3a09-4adf-951b-84befacf7489] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:27.862650 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-78e85104-3525-4dc6-9c7a-e2790edce894 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:27.862650 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-78e85104-3525-4dc6-9c7a-e2790edce894 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:27.866571 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-78e85104-3525-4dc6-9c7a-e2790edce894 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:27.867424 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-78e85104-3525-4dc6-9c7a-e2790edce894 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:27.871527 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-78e85104-3525-4dc6-9c7a-e2790edce894 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:27.872020 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-78e85104-3525-4dc6-9c7a-e2790edce894 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:27.987190 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-d429b841-3eaa-4547-bfb6-c85e2d91a40b req-a069df5f-291d-45b5-8817-2161512685e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb87cd67-6681-435d-9a65-56a2a06aaccb", "tag": "c3fa2e3d-8e37-42f2-97ea-111ea45b20e5"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:32:28.014902 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-d429b841-3eaa-4547-bfb6-c85e2d91a40b req-a069df5f-291d-45b5-8817-2161512685e4 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:28.018212 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-d429b841-3eaa-4547-bfb6-c85e2d91a40b req-a069df5f-291d-45b5-8817-2161512685e4 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:28.018699 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-d429b841-3eaa-4547-bfb6-c85e2d91a40b req-a069df5f-291d-45b5-8817-2161512685e4 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:28.066303 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-d429b841-3eaa-4547-bfb6-c85e2d91a40b req-a069df5f-291d-45b5-8817-2161512685e4 service nova] Creating event network-changed:c3fa2e3d-8e37-42f2-97ea-111ea45b20e5 for instance eb87cd67-6681-435d-9a65-56a2a06aaccb on n-h1-861333-8 Oct 19 03:32:28.093867 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-d429b841-3eaa-4547-bfb6-c85e2d91a40b req-a069df5f-291d-45b5-8817-2161512685e4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101125 Oct 19 03:32:28.095492 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2127/4344] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:32:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:32:28.210143 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-78e85104-3525-4dc6-9c7a-e2790edce894 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:28.242759 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-78e85104-3525-4dc6-9c7a-e2790edce894 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/3893d3e4-3a09-4adf-951b-84befacf7489" status: 200 len: 1272 microversion: 2.1 time: 0.409820 Oct 19 03:32:28.267058 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2218/4345] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:32:27 2022] GET /compute/v2.1/servers/3893d3e4-3a09-4adf-951b-84befacf7489 => generated 1272 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:32:28.292720 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-30d31f76-e00c-46ae-bd9b-4e2d8f74e471 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:28.296161 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-30d31f76-e00c-46ae-bd9b-4e2d8f74e471 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] [instance: eb87cd67-6681-435d-9a65-56a2a06aaccb] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:28.309329 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-30d31f76-e00c-46ae-bd9b-4e2d8f74e471 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:28.310498 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-30d31f76-e00c-46ae-bd9b-4e2d8f74e471 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:28.315657 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-30d31f76-e00c-46ae-bd9b-4e2d8f74e471 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:28.317200 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-30d31f76-e00c-46ae-bd9b-4e2d8f74e471 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:28.320246 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-30d31f76-e00c-46ae-bd9b-4e2d8f74e471 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:28.322879 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-30d31f76-e00c-46ae-bd9b-4e2d8f74e471 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:28.829265 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-390dd01b-c3b6-4a58-859f-072cac451995 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-641907090", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:32:28.952173 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-390dd01b-c3b6-4a58-859f-072cac451995 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] validate_networks() for [('cad12fd7-9383-43fe-b950-8ddddabe8de2', None, None, None, None, None)] {{(pid=121134) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:32:29.331254 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-30d31f76-e00c-46ae-bd9b-4e2d8f74e471 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b748815c10a46d2adc26d5c8a1ba268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc49f9b6a0054092beda3ab313bff1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:29.345236 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-30d31f76-e00c-46ae-bd9b-4e2d8f74e471 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] 10.222.0.52 "GET /compute/v2.1/servers/eb87cd67-6681-435d-9a65-56a2a06aaccb" status: 200 len: 1321 microversion: 2.1 time: 1.074130 Oct 19 03:32:29.345898 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2219/4346] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:32:28 2022] GET /compute/v2.1/servers/eb87cd67-6681-435d-9a65-56a2a06aaccb => generated 1321 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:32:29.406699 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-643efdda-f607-4da2-ba78-2b069de4bf77 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:29.407340 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-643efdda-f607-4da2-ba78-2b069de4bf77 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] [instance: 6fe11b03-fcac-4a7e-af1c-4ae425f2d548] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:29.449226 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-643efdda-f607-4da2-ba78-2b069de4bf77 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:29.449777 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-643efdda-f607-4da2-ba78-2b069de4bf77 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:29.450239 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-643efdda-f607-4da2-ba78-2b069de4bf77 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:29.450971 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-643efdda-f607-4da2-ba78-2b069de4bf77 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:29.451435 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-643efdda-f607-4da2-ba78-2b069de4bf77 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:29.451873 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-643efdda-f607-4da2-ba78-2b069de4bf77 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:30.892081 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-390dd01b-c3b6-4a58-859f-072cac451995 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Flavor limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:32:30.892760 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-390dd01b-c3b6-4a58-859f-072cac451995 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Image limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:32:30.893257 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-390dd01b-c3b6-4a58-859f-072cac451995 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Flavor pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:32:30.893736 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-390dd01b-c3b6-4a58-859f-072cac451995 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Image pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:32:30.894161 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-390dd01b-c3b6-4a58-859f-072cac451995 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:32:30.918437 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-390dd01b-c3b6-4a58-859f-072cac451995 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:30.918437 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-390dd01b-c3b6-4a58-859f-072cac451995 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:30.918437 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-390dd01b-c3b6-4a58-859f-072cac451995 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:30.918437 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-390dd01b-c3b6-4a58-859f-072cac451995 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:30.918437 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-390dd01b-c3b6-4a58-859f-072cac451995 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:30.918437 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-390dd01b-c3b6-4a58-859f-072cac451995 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:30.978773 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-390dd01b-c3b6-4a58-859f-072cac451995 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Getting quotas for project 2cb0265509744c93b03fa5c28b4e9386. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:32:31.000749 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-390dd01b-c3b6-4a58-859f-072cac451995 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Getting quotas for user b33d07a7db4846ababf001493c6e10d4 and project 2cb0265509744c93b03fa5c28b4e9386. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:32:31.051454 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-390dd01b-c3b6-4a58-859f-072cac451995 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Going to run 1 instances... {{(pid=121134) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:32:31.054046 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-390dd01b-c3b6-4a58-859f-072cac451995 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] [instance: 2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:32:31.114311 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-643efdda-f607-4da2-ba78-2b069de4bf77 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15464bcbb944412bfab92df2d740dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1cd843801f48bebaccda875d5aa647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:31.131181 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-643efdda-f607-4da2-ba78-2b069de4bf77 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] 10.222.0.52 "GET /compute/v2.1/servers/6fe11b03-fcac-4a7e-af1c-4ae425f2d548" status: 200 len: 1514 microversion: 2.1 time: 1.756341 Oct 19 03:32:31.131181 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2220/4347] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:32:29 2022] GET /compute/v2.1/servers/6fe11b03-fcac-4a7e-af1c-4ae425f2d548 => generated 1514 bytes in 1784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:32:31.173494 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-454324ac-007d-4512-ac42-efc7675205b4 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:31.174342 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-454324ac-007d-4512-ac42-efc7675205b4 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 3893d3e4-3a09-4adf-951b-84befacf7489] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:31.195819 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-454324ac-007d-4512-ac42-efc7675205b4 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:31.198152 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-454324ac-007d-4512-ac42-efc7675205b4 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:31.206631 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-454324ac-007d-4512-ac42-efc7675205b4 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:31.207814 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-454324ac-007d-4512-ac42-efc7675205b4 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:31.208628 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-454324ac-007d-4512-ac42-efc7675205b4 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:31.209225 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-454324ac-007d-4512-ac42-efc7675205b4 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:31.338736 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-390dd01b-c3b6-4a58-859f-072cac451995 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.241195 Oct 19 03:32:31.345923 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2128/4348] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:32:28 2022] POST /compute/v2.1/servers => generated 383 bytes in 3243 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 03:32:31.359892 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d5e7bd34-0338-410c-ba08-23e0d62ceec6 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:31.360529 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d5e7bd34-0338-410c-ba08-23e0d62ceec6 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] [instance: eb87cd67-6681-435d-9a65-56a2a06aaccb] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:31.368804 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d5e7bd34-0338-410c-ba08-23e0d62ceec6 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:31.369329 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d5e7bd34-0338-410c-ba08-23e0d62ceec6 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:31.369820 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d5e7bd34-0338-410c-ba08-23e0d62ceec6 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:31.370558 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d5e7bd34-0338-410c-ba08-23e0d62ceec6 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:31.371026 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d5e7bd34-0338-410c-ba08-23e0d62ceec6 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:31.371468 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d5e7bd34-0338-410c-ba08-23e0d62ceec6 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:31.922432 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-454324ac-007d-4512-ac42-efc7675205b4 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:31.932181 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-454324ac-007d-4512-ac42-efc7675205b4 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/3893d3e4-3a09-4adf-951b-84befacf7489" status: 200 len: 1314 microversion: 2.1 time: 0.800583 Oct 19 03:32:31.945325 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2221/4349] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:32:31 2022] GET /compute/v2.1/servers/3893d3e4-3a09-4adf-951b-84befacf7489 => generated 1314 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:32:31.945325 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-81cd29d0-2625-479a-91d7-56bfa7f32a03 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:31.957662 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-81cd29d0-2625-479a-91d7-56bfa7f32a03 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] [instance: 70a327e7-5c86-4d2b-b7b2-3c18e4027d81] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:31.964616 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-81cd29d0-2625-479a-91d7-56bfa7f32a03 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:31.965125 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-81cd29d0-2625-479a-91d7-56bfa7f32a03 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:31.965605 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-81cd29d0-2625-479a-91d7-56bfa7f32a03 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:31.966526 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-81cd29d0-2625-479a-91d7-56bfa7f32a03 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:31.967141 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-81cd29d0-2625-479a-91d7-56bfa7f32a03 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:31.967749 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-81cd29d0-2625-479a-91d7-56bfa7f32a03 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:32.043388 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d5e7bd34-0338-410c-ba08-23e0d62ceec6 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b748815c10a46d2adc26d5c8a1ba268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc49f9b6a0054092beda3ab313bff1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:32.057216 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d5e7bd34-0338-410c-ba08-23e0d62ceec6 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] 10.222.0.52 "GET /compute/v2.1/servers/eb87cd67-6681-435d-9a65-56a2a06aaccb" status: 200 len: 1321 microversion: 2.1 time: 0.716714 Oct 19 03:32:32.059215 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2129/4350] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:32:31 2022] GET /compute/v2.1/servers/eb87cd67-6681-435d-9a65-56a2a06aaccb => generated 1321 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:32:32.065118 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-592479ca-0d4d-4988-a553-0d86cb338e81 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:32.071248 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-592479ca-0d4d-4988-a553-0d86cb338e81 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] [instance: 2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:32.315045 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-592479ca-0d4d-4988-a553-0d86cb338e81 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33d07a7db4846ababf001493c6e10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb0265509744c93b03fa5c28b4e9386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:32.332050 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-592479ca-0d4d-4988-a553-0d86cb338e81 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] 10.222.0.52 "GET /compute/v2.1/servers/2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62" status: 200 len: 1213 microversion: 2.1 time: 0.269678 Oct 19 03:32:32.354291 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2130/4351] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:32:32 2022] GET /compute/v2.1/servers/2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62 => generated 1213 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:32:32.378079 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-81cd29d0-2625-479a-91d7-56bfa7f32a03 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15464bcbb944412bfab92df2d740dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1cd843801f48bebaccda875d5aa647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:32.405997 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-81cd29d0-2625-479a-91d7-56bfa7f32a03 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] 10.222.0.52 "GET /compute/v2.1/servers/70a327e7-5c86-4d2b-b7b2-3c18e4027d81" status: 200 len: 1514 microversion: 2.1 time: 0.465503 Oct 19 03:32:32.406834 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2222/4352] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:32:31 2022] GET /compute/v2.1/servers/70a327e7-5c86-4d2b-b7b2-3c18e4027d81 => generated 1514 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:32:32.434082 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-23004d3c-323e-438a-907e-276ce889b49d tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:32.434941 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-23004d3c-323e-438a-907e-276ce889b49d tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] [instance: 70a327e7-5c86-4d2b-b7b2-3c18e4027d81] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:32.445214 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-23004d3c-323e-438a-907e-276ce889b49d tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:32.445995 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-23004d3c-323e-438a-907e-276ce889b49d tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:32.449545 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-23004d3c-323e-438a-907e-276ce889b49d tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:32.449545 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-23004d3c-323e-438a-907e-276ce889b49d tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:32.449971 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-23004d3c-323e-438a-907e-276ce889b49d tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:32.451327 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-23004d3c-323e-438a-907e-276ce889b49d tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:32.526794 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-23004d3c-323e-438a-907e-276ce889b49d tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] [instance: 70a327e7-5c86-4d2b-b7b2-3c18e4027d81] Going to try to terminate instance {{(pid=121134) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:32:32.966148 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-23004d3c-323e-438a-907e-276ce889b49d tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] 10.222.0.52 "DELETE /compute/v2.1/servers/70a327e7-5c86-4d2b-b7b2-3c18e4027d81" status: 204 len: 0 microversion: 2.1 time: 0.535364 Oct 19 03:32:32.967235 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ce0118c0-4b02-4597-812a-acf00f7dbb4f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:32.968597 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2131/4353] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:32:32 2022] DELETE /compute/v2.1/servers/70a327e7-5c86-4d2b-b7b2-3c18e4027d81 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:32:32.969608 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ce0118c0-4b02-4597-812a-acf00f7dbb4f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 3893d3e4-3a09-4adf-951b-84befacf7489] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:32.977612 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ce0118c0-4b02-4597-812a-acf00f7dbb4f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:32.977925 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7df35edb-34e1-449e-9fae-395773ae48c7 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:32.978887 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7df35edb-34e1-449e-9fae-395773ae48c7 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] [instance: 70a327e7-5c86-4d2b-b7b2-3c18e4027d81] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:32.988850 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ce0118c0-4b02-4597-812a-acf00f7dbb4f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:32.989595 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ce0118c0-4b02-4597-812a-acf00f7dbb4f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:32.990994 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ce0118c0-4b02-4597-812a-acf00f7dbb4f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:32.994529 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ce0118c0-4b02-4597-812a-acf00f7dbb4f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:32.995330 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ce0118c0-4b02-4597-812a-acf00f7dbb4f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:33.006709 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:32:33.010421 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7df35edb-34e1-449e-9fae-395773ae48c7 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:33.014311 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7df35edb-34e1-449e-9fae-395773ae48c7 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:33.014866 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7df35edb-34e1-449e-9fae-395773ae48c7 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:33.015688 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7df35edb-34e1-449e-9fae-395773ae48c7 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:33.018757 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7df35edb-34e1-449e-9fae-395773ae48c7 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:33.019461 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7df35edb-34e1-449e-9fae-395773ae48c7 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:33.065886 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:32:33.407842 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-7df35edb-34e1-449e-9fae-395773ae48c7 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15464bcbb944412bfab92df2d740dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1cd843801f48bebaccda875d5aa647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:33.418719 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7df35edb-34e1-449e-9fae-395773ae48c7 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] 10.222.0.52 "GET /compute/v2.1/servers/70a327e7-5c86-4d2b-b7b2-3c18e4027d81" status: 200 len: 1520 microversion: 2.1 time: 0.446643 Oct 19 03:32:33.421641 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2132/4354] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:32:32 2022] GET /compute/v2.1/servers/70a327e7-5c86-4d2b-b7b2-3c18e4027d81 => generated 1520 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:32:33.432801 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-551ac8cd-5524-4e19-ae36-98b2e54fbafa tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:33.435853 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-551ac8cd-5524-4e19-ae36-98b2e54fbafa tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] [instance: eb87cd67-6681-435d-9a65-56a2a06aaccb] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:33.449485 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-551ac8cd-5524-4e19-ae36-98b2e54fbafa tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:33.453788 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-551ac8cd-5524-4e19-ae36-98b2e54fbafa tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:33.455742 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-551ac8cd-5524-4e19-ae36-98b2e54fbafa tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:33.456535 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-551ac8cd-5524-4e19-ae36-98b2e54fbafa tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:33.459559 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-551ac8cd-5524-4e19-ae36-98b2e54fbafa tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:33.464548 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-551ac8cd-5524-4e19-ae36-98b2e54fbafa tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:33.594015 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ce0118c0-4b02-4597-812a-acf00f7dbb4f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:33.607007 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ce0118c0-4b02-4597-812a-acf00f7dbb4f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/3893d3e4-3a09-4adf-951b-84befacf7489" status: 200 len: 1314 microversion: 2.1 time: 0.643258 Oct 19 03:32:33.625175 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2223/4355] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:32:32 2022] GET /compute/v2.1/servers/3893d3e4-3a09-4adf-951b-84befacf7489 => generated 1314 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:32:33.642093 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0f5d5ef2-41ad-47dd-825d-f743c55a365b tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:33.644540 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0f5d5ef2-41ad-47dd-825d-f743c55a365b tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] [instance: 2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:33.660170 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:32:33.665750 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0f5d5ef2-41ad-47dd-825d-f743c55a365b tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:33.667234 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0f5d5ef2-41ad-47dd-825d-f743c55a365b tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:33.668271 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0f5d5ef2-41ad-47dd-825d-f743c55a365b tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:33.670122 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0f5d5ef2-41ad-47dd-825d-f743c55a365b tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:33.670950 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0f5d5ef2-41ad-47dd-825d-f743c55a365b tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:33.671569 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0f5d5ef2-41ad-47dd-825d-f743c55a365b tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:33.677242 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=14 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:32:33.929336 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-0f5d5ef2-41ad-47dd-825d-f743c55a365b tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33d07a7db4846ababf001493c6e10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb0265509744c93b03fa5c28b4e9386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:33.942147 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0f5d5ef2-41ad-47dd-825d-f743c55a365b tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] 10.222.0.52 "GET /compute/v2.1/servers/2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62" status: 200 len: 1217 microversion: 2.1 time: 0.313490 Oct 19 03:32:33.942965 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2224/4356] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:32:33 2022] GET /compute/v2.1/servers/2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62 => generated 1217 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:32:34.016263 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-51baf344-916d-46ea-99fd-81c591a231b9 req-e5dd7328-a2f4-4e82-b633-e1f291a08c68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3893d3e4-3a09-4adf-951b-84befacf7489", "tag": "f6bdd5bf-f5c9-4dc4-bb82-96c0e06519e1"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:32:34.022209 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-551ac8cd-5524-4e19-ae36-98b2e54fbafa tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b748815c10a46d2adc26d5c8a1ba268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc49f9b6a0054092beda3ab313bff1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:34.029943 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-551ac8cd-5524-4e19-ae36-98b2e54fbafa tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] 10.222.0.52 "GET /compute/v2.1/servers/eb87cd67-6681-435d-9a65-56a2a06aaccb" status: 200 len: 1321 microversion: 2.1 time: 0.607561 Oct 19 03:32:34.031365 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2133/4357] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:32:33 2022] GET /compute/v2.1/servers/eb87cd67-6681-435d-9a65-56a2a06aaccb => generated 1321 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:32:34.036324 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-51baf344-916d-46ea-99fd-81c591a231b9 req-e5dd7328-a2f4-4e82-b633-e1f291a08c68 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:34.036811 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-51baf344-916d-46ea-99fd-81c591a231b9 req-e5dd7328-a2f4-4e82-b633-e1f291a08c68 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:34.037249 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-51baf344-916d-46ea-99fd-81c591a231b9 req-e5dd7328-a2f4-4e82-b633-e1f291a08c68 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:34.041393 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=100 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:32:34.067125 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-51baf344-916d-46ea-99fd-81c591a231b9 req-e5dd7328-a2f4-4e82-b633-e1f291a08c68 service nova] Creating event network-changed:f6bdd5bf-f5c9-4dc4-bb82-96c0e06519e1 for instance 3893d3e4-3a09-4adf-951b-84befacf7489 on n-h1-861333-8 Oct 19 03:32:34.074331 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-51baf344-916d-46ea-99fd-81c591a231b9 req-e5dd7328-a2f4-4e82-b633-e1f291a08c68 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062135 Oct 19 03:32:34.076149 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2225/4358] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:32:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:32:34.443793 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-305e13b7-dd3c-41ad-9acf-6cde02a382e8 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:34.445155 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-305e13b7-dd3c-41ad-9acf-6cde02a382e8 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] [instance: 70a327e7-5c86-4d2b-b7b2-3c18e4027d81] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:34.460780 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-305e13b7-dd3c-41ad-9acf-6cde02a382e8 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:34.462803 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-305e13b7-dd3c-41ad-9acf-6cde02a382e8 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:34.464039 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-305e13b7-dd3c-41ad-9acf-6cde02a382e8 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:34.466144 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-305e13b7-dd3c-41ad-9acf-6cde02a382e8 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:34.467429 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-305e13b7-dd3c-41ad-9acf-6cde02a382e8 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:34.468539 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-305e13b7-dd3c-41ad-9acf-6cde02a382e8 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:34.639662 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-99b6eef9-4e44-417c-90bc-cad9328a5483 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:34.640380 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-99b6eef9-4e44-417c-90bc-cad9328a5483 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 3893d3e4-3a09-4adf-951b-84befacf7489] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:34.661113 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-99b6eef9-4e44-417c-90bc-cad9328a5483 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:34.666317 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-99b6eef9-4e44-417c-90bc-cad9328a5483 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:34.671486 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-99b6eef9-4e44-417c-90bc-cad9328a5483 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:34.674367 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-99b6eef9-4e44-417c-90bc-cad9328a5483 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:34.674867 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-99b6eef9-4e44-417c-90bc-cad9328a5483 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:34.680203 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-99b6eef9-4e44-417c-90bc-cad9328a5483 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:35.100403 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-305e13b7-dd3c-41ad-9acf-6cde02a382e8 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15464bcbb944412bfab92df2d740dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1cd843801f48bebaccda875d5aa647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:35.111274 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-305e13b7-dd3c-41ad-9acf-6cde02a382e8 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] 10.222.0.52 "GET /compute/v2.1/servers/70a327e7-5c86-4d2b-b7b2-3c18e4027d81" status: 200 len: 1520 microversion: 2.1 time: 0.672657 Oct 19 03:32:35.112499 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2134/4359] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:32:34 2022] GET /compute/v2.1/servers/70a327e7-5c86-4d2b-b7b2-3c18e4027d81 => generated 1520 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:32:35.120737 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-99b6eef9-4e44-417c-90bc-cad9328a5483 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:35.124857 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9b32fbee-c611-4b4e-a41d-bf1b6c0ea580 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:35.125768 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9b32fbee-c611-4b4e-a41d-bf1b6c0ea580 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] [instance: 2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:35.135438 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-99b6eef9-4e44-417c-90bc-cad9328a5483 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/3893d3e4-3a09-4adf-951b-84befacf7489" status: 200 len: 1314 microversion: 2.1 time: 0.501267 Oct 19 03:32:35.136191 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2226/4360] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:32:34 2022] GET /compute/v2.1/servers/3893d3e4-3a09-4adf-951b-84befacf7489 => generated 1314 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:32:35.145774 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9b32fbee-c611-4b4e-a41d-bf1b6c0ea580 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:35.145890 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ac8df74b-213e-4c2d-9702-1ec6664a6111 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:35.148685 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ac8df74b-213e-4c2d-9702-1ec6664a6111 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] [instance: eb87cd67-6681-435d-9a65-56a2a06aaccb] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:35.149047 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9b32fbee-c611-4b4e-a41d-bf1b6c0ea580 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:35.149842 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9b32fbee-c611-4b4e-a41d-bf1b6c0ea580 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:35.153631 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9b32fbee-c611-4b4e-a41d-bf1b6c0ea580 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:35.157681 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9b32fbee-c611-4b4e-a41d-bf1b6c0ea580 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:35.159947 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9b32fbee-c611-4b4e-a41d-bf1b6c0ea580 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:35.175021 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ac8df74b-213e-4c2d-9702-1ec6664a6111 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:35.175531 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ac8df74b-213e-4c2d-9702-1ec6664a6111 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:35.175980 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ac8df74b-213e-4c2d-9702-1ec6664a6111 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:35.176732 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ac8df74b-213e-4c2d-9702-1ec6664a6111 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:35.193695 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ac8df74b-213e-4c2d-9702-1ec6664a6111 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:35.193695 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ac8df74b-213e-4c2d-9702-1ec6664a6111 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:35.351884 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9b32fbee-c611-4b4e-a41d-bf1b6c0ea580 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33d07a7db4846ababf001493c6e10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb0265509744c93b03fa5c28b4e9386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:35.365956 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9b32fbee-c611-4b4e-a41d-bf1b6c0ea580 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] 10.222.0.52 "GET /compute/v2.1/servers/2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62" status: 200 len: 1265 microversion: 2.1 time: 0.247471 Oct 19 03:32:35.367762 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2135/4361] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:32:35 2022] GET /compute/v2.1/servers/2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62 => generated 1265 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:32:35.714114 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ac8df74b-213e-4c2d-9702-1ec6664a6111 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b748815c10a46d2adc26d5c8a1ba268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc49f9b6a0054092beda3ab313bff1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:35.723499 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ac8df74b-213e-4c2d-9702-1ec6664a6111 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] 10.222.0.52 "GET /compute/v2.1/servers/eb87cd67-6681-435d-9a65-56a2a06aaccb" status: 200 len: 1321 microversion: 2.1 time: 0.586133 Oct 19 03:32:35.734547 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2227/4362] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:32:35 2022] GET /compute/v2.1/servers/eb87cd67-6681-435d-9a65-56a2a06aaccb => generated 1321 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:32:36.136115 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-15f304f5-08a7-442b-b1f7-b7e6929d2492 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:36.136815 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-15f304f5-08a7-442b-b1f7-b7e6929d2492 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] [instance: 70a327e7-5c86-4d2b-b7b2-3c18e4027d81] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:36.149279 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-15f304f5-08a7-442b-b1f7-b7e6929d2492 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:36.149818 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-15f304f5-08a7-442b-b1f7-b7e6929d2492 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:36.150276 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-15f304f5-08a7-442b-b1f7-b7e6929d2492 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:36.151001 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-15f304f5-08a7-442b-b1f7-b7e6929d2492 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:36.151465 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-15f304f5-08a7-442b-b1f7-b7e6929d2492 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:36.151901 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-15f304f5-08a7-442b-b1f7-b7e6929d2492 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:36.160038 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6112acb0-41e4-4ce5-a9b2-1308683a16b9 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:36.160664 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6112acb0-41e4-4ce5-a9b2-1308683a16b9 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 3893d3e4-3a09-4adf-951b-84befacf7489] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:36.174606 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6112acb0-41e4-4ce5-a9b2-1308683a16b9 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:36.174770 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6112acb0-41e4-4ce5-a9b2-1308683a16b9 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:36.178555 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6112acb0-41e4-4ce5-a9b2-1308683a16b9 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:36.183219 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6112acb0-41e4-4ce5-a9b2-1308683a16b9 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:36.183732 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6112acb0-41e4-4ce5-a9b2-1308683a16b9 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:36.186390 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6112acb0-41e4-4ce5-a9b2-1308683a16b9 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:37.305072 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-6112acb0-41e4-4ce5-a9b2-1308683a16b9 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:37.315182 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6112acb0-41e4-4ce5-a9b2-1308683a16b9 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/3893d3e4-3a09-4adf-951b-84befacf7489" status: 200 len: 1314 microversion: 2.1 time: 1.158779 Oct 19 03:32:37.344634 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2228/4363] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:32:36 2022] GET /compute/v2.1/servers/3893d3e4-3a09-4adf-951b-84befacf7489 => generated 1314 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:32:37.344634 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-93ca96dc-5a67-414a-9426-acb2c65f80d0 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:37.344634 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-93ca96dc-5a67-414a-9426-acb2c65f80d0 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] [instance: 2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:37.344634 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-93ca96dc-5a67-414a-9426-acb2c65f80d0 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:37.344634 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-93ca96dc-5a67-414a-9426-acb2c65f80d0 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:37.344634 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-93ca96dc-5a67-414a-9426-acb2c65f80d0 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:37.344634 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-93ca96dc-5a67-414a-9426-acb2c65f80d0 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:37.344634 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-93ca96dc-5a67-414a-9426-acb2c65f80d0 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:37.344634 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-93ca96dc-5a67-414a-9426-acb2c65f80d0 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:37.493718 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-15f304f5-08a7-442b-b1f7-b7e6929d2492 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15464bcbb944412bfab92df2d740dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1cd843801f48bebaccda875d5aa647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:37.527425 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-15f304f5-08a7-442b-b1f7-b7e6929d2492 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] 10.222.0.52 "GET /compute/v2.1/servers/70a327e7-5c86-4d2b-b7b2-3c18e4027d81" status: 200 len: 1520 microversion: 2.1 time: 1.395199 Oct 19 03:32:37.527979 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2136/4364] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:32:36 2022] GET /compute/v2.1/servers/70a327e7-5c86-4d2b-b7b2-3c18e4027d81 => generated 1520 bytes in 1397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:32:37.535681 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2e28129b-c06a-4744-9ac0-2eec5f142150 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:37.536988 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2e28129b-c06a-4744-9ac0-2eec5f142150 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] [instance: eb87cd67-6681-435d-9a65-56a2a06aaccb] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:37.546227 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2e28129b-c06a-4744-9ac0-2eec5f142150 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:37.547215 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2e28129b-c06a-4744-9ac0-2eec5f142150 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:37.547897 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2e28129b-c06a-4744-9ac0-2eec5f142150 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:37.549004 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2e28129b-c06a-4744-9ac0-2eec5f142150 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:37.549664 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2e28129b-c06a-4744-9ac0-2eec5f142150 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:37.550269 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2e28129b-c06a-4744-9ac0-2eec5f142150 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:37.573810 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-93ca96dc-5a67-414a-9426-acb2c65f80d0 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33d07a7db4846ababf001493c6e10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb0265509744c93b03fa5c28b4e9386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:37.588513 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-93ca96dc-5a67-414a-9426-acb2c65f80d0 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] 10.222.0.52 "GET /compute/v2.1/servers/2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62" status: 200 len: 1271 microversion: 2.1 time: 0.257070 Oct 19 03:32:37.589356 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2229/4365] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:32:37 2022] GET /compute/v2.1/servers/2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62 => generated 1271 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:32:37.606595 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-291d6b9e-e32e-4693-8db4-bb06a7c2e8cd req-efeff67d-e579-4693-b3d4-a5e6bc556195 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70a327e7-5c86-4d2b-b7b2-3c18e4027d81", "name": "network-vif-deleted", "tag": "9537c9c7-d9df-46bc-bca0-1ab6eb56e119"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:32:37.616567 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-291d6b9e-e32e-4693-8db4-bb06a7c2e8cd req-efeff67d-e579-4693-b3d4-a5e6bc556195 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:37.617067 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-291d6b9e-e32e-4693-8db4-bb06a7c2e8cd req-efeff67d-e579-4693-b3d4-a5e6bc556195 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:37.617548 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-291d6b9e-e32e-4693-8db4-bb06a7c2e8cd req-efeff67d-e579-4693-b3d4-a5e6bc556195 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:37.652555 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-291d6b9e-e32e-4693-8db4-bb06a7c2e8cd req-efeff67d-e579-4693-b3d4-a5e6bc556195 service nova] Creating event network-vif-deleted:9537c9c7-d9df-46bc-bca0-1ab6eb56e119 for instance 70a327e7-5c86-4d2b-b7b2-3c18e4027d81 on n-h2-861333-8 Oct 19 03:32:37.667130 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-291d6b9e-e32e-4693-8db4-bb06a7c2e8cd req-efeff67d-e579-4693-b3d4-a5e6bc556195 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073769 Oct 19 03:32:37.667784 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2230/4366] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:32:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:32:38.162619 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-2e28129b-c06a-4744-9ac0-2eec5f142150 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b748815c10a46d2adc26d5c8a1ba268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc49f9b6a0054092beda3ab313bff1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:38.173004 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2e28129b-c06a-4744-9ac0-2eec5f142150 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] 10.222.0.52 "GET /compute/v2.1/servers/eb87cd67-6681-435d-9a65-56a2a06aaccb" status: 200 len: 1321 microversion: 2.1 time: 0.643699 Oct 19 03:32:38.174784 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2137/4367] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:32:37 2022] GET /compute/v2.1/servers/eb87cd67-6681-435d-9a65-56a2a06aaccb => generated 1321 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:32:38.353735 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-bf9b56ae-904a-4131-b60d-d0ae36328d6a tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:38.355102 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-bf9b56ae-904a-4131-b60d-d0ae36328d6a tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 3893d3e4-3a09-4adf-951b-84befacf7489] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:38.389555 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bf9b56ae-904a-4131-b60d-d0ae36328d6a tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:38.395173 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bf9b56ae-904a-4131-b60d-d0ae36328d6a tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:38.398615 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bf9b56ae-904a-4131-b60d-d0ae36328d6a tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:38.399840 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bf9b56ae-904a-4131-b60d-d0ae36328d6a tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:38.407309 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bf9b56ae-904a-4131-b60d-d0ae36328d6a tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:38.413910 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bf9b56ae-904a-4131-b60d-d0ae36328d6a tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:38.555052 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0966dffd-cf86-46ce-a6f5-e98b31ca2a42 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:38.555680 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0966dffd-cf86-46ce-a6f5-e98b31ca2a42 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] [instance: 70a327e7-5c86-4d2b-b7b2-3c18e4027d81] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:38.566591 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0966dffd-cf86-46ce-a6f5-e98b31ca2a42 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:38.567770 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0966dffd-cf86-46ce-a6f5-e98b31ca2a42 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:38.571118 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0966dffd-cf86-46ce-a6f5-e98b31ca2a42 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:38.574999 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0966dffd-cf86-46ce-a6f5-e98b31ca2a42 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:38.575596 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0966dffd-cf86-46ce-a6f5-e98b31ca2a42 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:38.576179 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0966dffd-cf86-46ce-a6f5-e98b31ca2a42 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:38.618005 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0966dffd-cf86-46ce-a6f5-e98b31ca2a42 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:38.620406 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0966dffd-cf86-46ce-a6f5-e98b31ca2a42 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:38.621241 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0966dffd-cf86-46ce-a6f5-e98b31ca2a42 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:38.621919 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-0966dffd-cf86-46ce-a6f5-e98b31ca2a42 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lazy-loading 'fault' on Instance uuid 70a327e7-5c86-4d2b-b7b2-3c18e4027d81 {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:32:38.786444 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0966dffd-cf86-46ce-a6f5-e98b31ca2a42 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15464bcbb944412bfab92df2d740dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1cd843801f48bebaccda875d5aa647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:38.795132 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0966dffd-cf86-46ce-a6f5-e98b31ca2a42 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] 10.222.0.52 "GET /compute/v2.1/servers/70a327e7-5c86-4d2b-b7b2-3c18e4027d81" status: 200 len: 1312 microversion: 2.1 time: 0.245110 Oct 19 03:32:38.797752 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2138/4368] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:32:38 2022] GET /compute/v2.1/servers/70a327e7-5c86-4d2b-b7b2-3c18e4027d81 => generated 1312 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:32:38.805153 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a7849560-14bc-4ffe-837c-a1bf7e9139dc tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:38.807446 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a7849560-14bc-4ffe-837c-a1bf7e9139dc tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] [instance: 2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:38.824426 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a7849560-14bc-4ffe-837c-a1bf7e9139dc tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:38.826162 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a7849560-14bc-4ffe-837c-a1bf7e9139dc tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:38.826823 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a7849560-14bc-4ffe-837c-a1bf7e9139dc tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:38.828259 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a7849560-14bc-4ffe-837c-a1bf7e9139dc tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:38.829555 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a7849560-14bc-4ffe-837c-a1bf7e9139dc tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:38.830158 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a7849560-14bc-4ffe-837c-a1bf7e9139dc tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:38.920719 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-bf9b56ae-904a-4131-b60d-d0ae36328d6a tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:38.938609 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-bf9b56ae-904a-4131-b60d-d0ae36328d6a tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/3893d3e4-3a09-4adf-951b-84befacf7489" status: 200 len: 1314 microversion: 2.1 time: 0.590006 Oct 19 03:32:38.939224 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2231/4369] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:32:38 2022] GET /compute/v2.1/servers/3893d3e4-3a09-4adf-951b-84befacf7489 => generated 1314 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:32:38.981815 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a7849560-14bc-4ffe-837c-a1bf7e9139dc tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33d07a7db4846ababf001493c6e10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb0265509744c93b03fa5c28b4e9386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:38.998084 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a7849560-14bc-4ffe-837c-a1bf7e9139dc tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] 10.222.0.52 "GET /compute/v2.1/servers/2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62" status: 200 len: 1271 microversion: 2.1 time: 0.198500 Oct 19 03:32:38.999312 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2139/4370] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:32:38 2022] GET /compute/v2.1/servers/2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62 => generated 1271 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:32:39.201915 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-29c1bff8-838f-422c-983a-16dce10a3d33 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:39.202554 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-29c1bff8-838f-422c-983a-16dce10a3d33 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] [instance: eb87cd67-6681-435d-9a65-56a2a06aaccb] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:39.215289 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-29c1bff8-838f-422c-983a-16dce10a3d33 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:39.215810 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-29c1bff8-838f-422c-983a-16dce10a3d33 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:39.216272 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-29c1bff8-838f-422c-983a-16dce10a3d33 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:39.218635 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-29c1bff8-838f-422c-983a-16dce10a3d33 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:39.226148 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-29c1bff8-838f-422c-983a-16dce10a3d33 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:39.227008 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-29c1bff8-838f-422c-983a-16dce10a3d33 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:39.538950 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-29c1bff8-838f-422c-983a-16dce10a3d33 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b748815c10a46d2adc26d5c8a1ba268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc49f9b6a0054092beda3ab313bff1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:39.559483 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-29c1bff8-838f-422c-983a-16dce10a3d33 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] 10.222.0.52 "GET /compute/v2.1/servers/eb87cd67-6681-435d-9a65-56a2a06aaccb" status: 200 len: 1321 microversion: 2.1 time: 0.362393 Oct 19 03:32:39.581526 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2232/4371] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:32:39 2022] GET /compute/v2.1/servers/eb87cd67-6681-435d-9a65-56a2a06aaccb => generated 1321 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:32:39.825069 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-fe05f9bd-fceb-4e58-9e2e-6d29172cf1df tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:39.826406 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-fe05f9bd-fceb-4e58-9e2e-6d29172cf1df tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] [instance: 70a327e7-5c86-4d2b-b7b2-3c18e4027d81] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:39.835793 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fe05f9bd-fceb-4e58-9e2e-6d29172cf1df tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:39.836762 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fe05f9bd-fceb-4e58-9e2e-6d29172cf1df tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:39.837692 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fe05f9bd-fceb-4e58-9e2e-6d29172cf1df tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:39.838625 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fe05f9bd-fceb-4e58-9e2e-6d29172cf1df tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:39.839374 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fe05f9bd-fceb-4e58-9e2e-6d29172cf1df tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:39.839948 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fe05f9bd-fceb-4e58-9e2e-6d29172cf1df tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:39.860100 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-fe05f9bd-fceb-4e58-9e2e-6d29172cf1df tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] HTTP exception thrown: Instance 70a327e7-5c86-4d2b-b7b2-3c18e4027d81 could not be found. Oct 19 03:32:39.865005 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-fe05f9bd-fceb-4e58-9e2e-6d29172cf1df tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Request method failure captured: Oct 19 03:32:39.865005 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/70a327e7-5c86-4d2b-b7b2-3c18e4027d81 HTTP/1.1 Oct 19 03:32:39.865005 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:32:39.865005 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:32:39.865005 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:32:39.865005 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:32:39.865005 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:32:39.865005 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:32:39.865005 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:32:39.865005 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:32:39.865005 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT2-r77bNhnlUcEvHp0HPVacCbcATag_3w1CV70F2EvBNcADEoM7Ow93nOGG_fDqN5MWrI5LJ8l8LnMbbKcV-NFNnQ2RtocSElieEI0uDhr6jpWCBt8RWBl1RovgywxTkOk4_ykh3reYAjkq498dGDhCBAKa6GZQzjB21G7GpieP4IWo Oct 19 03:32:39.865005 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:32:39.865005 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:32:39.865005 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:32:39.865005 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:32:39.865005 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:32:39.865005 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:32:39.865005 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: ba1cd843801f48bebaccda875d5aa647 Oct 19 03:32:39.865005 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ListServersNegativeTestJSON-1678437181 Oct 19 03:32:39.865005 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:32:39.865005 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:32:39.865005 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ba1cd843801f48bebaccda875d5aa647"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ba1cd843801f48bebaccda875d5aa647"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ba1cd843801f48bebaccda875d5aa647"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ba1cd843801f48bebaccda875d5aa647", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:32:39.865005 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ListServersNegativeTestJSON-1678437181 Oct 19 03:32:39.865005 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: ba1cd843801f48bebaccda875d5aa647 Oct 19 03:32:39.865005 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1678437181 Oct 19 03:32:39.865005 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ListServersNegativeTestJSON-1678437181-project Oct 19 03:32:39.865005 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:32:39.865005 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:32:39.865005 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: b15464bcbb944412bfab92df2d740dc5 Oct 19 03:32:39.865005 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ListServersNegativeTestJSON-1678437181-project Oct 19 03:32:39.865005 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:32:39.865005 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance 70a327e7-5c86-4d2b-b7b2-3c18e4027d81 could not be found. Oct 19 03:32:39.865005 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '70a327e7-5c86-4d2b-b7b2-3c18e4027d81'} Oct 19 03:32:39.865005 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:32:39.865005 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:32:39.865005 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:32:39.865005 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:32:39.865005 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:32:39.865005 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:32:39.865005 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:32:39.865005 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:32:39.865005 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:32:39.865005 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:32:39.865005 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70a327e7-5c86-4d2b-b7b2-3c18e4027d81 could not be found. Oct 19 03:32:39.865005 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:32:39.865005 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:32:39.865005 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:32:39.865005 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:32:39.865005 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:32:39.865005 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:32:39.865005 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:32:39.865005 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:32:39.865005 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:32:39.865005 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:32:39.865005 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:32:39.865005 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:32:39.865005 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:32:39.865005 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:32:39.865005 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:32:39.865005 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:32:39.865005 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70a327e7-5c86-4d2b-b7b2-3c18e4027d81 could not be found. Oct 19 03:32:39.865005 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:32:39.865005 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:32:39.869584 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:32:39.869584 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:32:39.869584 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:32:39.869584 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:32:39.869584 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:32:39.869584 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:32:39.869584 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70a327e7-5c86-4d2b-b7b2-3c18e4027d81 could not be found. Oct 19 03:32:39.869584 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:32:39.869584 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-fe05f9bd-fceb-4e58-9e2e-6d29172cf1df tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Returning 404 to user: Instance 70a327e7-5c86-4d2b-b7b2-3c18e4027d81 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:32:39.869584 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-fe05f9bd-fceb-4e58-9e2e-6d29172cf1df tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] 10.222.0.52 "GET /compute/v2.1/servers/70a327e7-5c86-4d2b-b7b2-3c18e4027d81" status: 404 len: 111 microversion: 2.1 time: 0.043365 Oct 19 03:32:39.874244 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2140/4372] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:32:39 2022] GET /compute/v2.1/servers/70a327e7-5c86-4d2b-b7b2-3c18e4027d81 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:32:39.885291 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-30a6c981-a31d-4393-842d-5a3863be570b tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:39.895073 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-30a6c981-a31d-4393-842d-5a3863be570b tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b15464bcbb944412bfab92df2d740dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1cd843801f48bebaccda875d5aa647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:39.900358 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-30a6c981-a31d-4393-842d-5a3863be570b tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': 'ba1cd843801f48bebaccda875d5aa647'} {{(pid=121135) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 03:32:39.907637 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-30a6c981-a31d-4393-842d-5a3863be570b tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:39.908390 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-30a6c981-a31d-4393-842d-5a3863be570b tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:39.908990 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-30a6c981-a31d-4393-842d-5a3863be570b tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:39.916329 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-30a6c981-a31d-4393-842d-5a3863be570b tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:39.917270 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-30a6c981-a31d-4393-842d-5a3863be570b tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:39.917894 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-30a6c981-a31d-4393-842d-5a3863be570b tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:39.963814 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-bda30ea9-b6e0-4717-aede-8bd34cf247cd tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:39.964707 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-bda30ea9-b6e0-4717-aede-8bd34cf247cd tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 3893d3e4-3a09-4adf-951b-84befacf7489] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:39.972678 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bda30ea9-b6e0-4717-aede-8bd34cf247cd tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:39.976468 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bda30ea9-b6e0-4717-aede-8bd34cf247cd tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:39.977101 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bda30ea9-b6e0-4717-aede-8bd34cf247cd tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:39.979234 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bda30ea9-b6e0-4717-aede-8bd34cf247cd tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:39.979943 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bda30ea9-b6e0-4717-aede-8bd34cf247cd tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:39.985309 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bda30ea9-b6e0-4717-aede-8bd34cf247cd tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:40.060857 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-30a6c981-a31d-4393-842d-5a3863be570b tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] 10.222.0.52 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.180543 Oct 19 03:32:40.071894 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2233/4373] 10.222.0.52 () {58 vars in 1230 bytes} [Wed Oct 19 03:32:39 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 03:32:40.077076 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-53f2e197-64fc-4a3f-a02f-2dfa774edd98 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:40.077923 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-53f2e197-64fc-4a3f-a02f-2dfa774edd98 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] [instance: 2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:40.084979 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-53f2e197-64fc-4a3f-a02f-2dfa774edd98 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:40.086689 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-53f2e197-64fc-4a3f-a02f-2dfa774edd98 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:40.087346 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-53f2e197-64fc-4a3f-a02f-2dfa774edd98 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:40.088267 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-53f2e197-64fc-4a3f-a02f-2dfa774edd98 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:40.088935 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-53f2e197-64fc-4a3f-a02f-2dfa774edd98 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:40.089588 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-53f2e197-64fc-4a3f-a02f-2dfa774edd98 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:40.437421 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-bda30ea9-b6e0-4717-aede-8bd34cf247cd tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:40.450796 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-bda30ea9-b6e0-4717-aede-8bd34cf247cd tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/3893d3e4-3a09-4adf-951b-84befacf7489" status: 200 len: 1314 microversion: 2.1 time: 0.492409 Oct 19 03:32:40.452381 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2141/4374] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:32:39 2022] GET /compute/v2.1/servers/3893d3e4-3a09-4adf-951b-84befacf7489 => generated 1314 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:32:40.460048 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a3363af0-13ee-449a-a54e-4e085d6f5e0d tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:40.470549 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a3363af0-13ee-449a-a54e-4e085d6f5e0d tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Request method failure captured: Oct 19 03:32:40.470549 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Oct 19 03:32:40.470549 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:32:40.470549 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:32:40.470549 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:32:40.470549 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:32:40.470549 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:32:40.470549 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:32:40.470549 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:32:40.470549 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:32:40.470549 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT2-r77bNhnlUcEvHp0HPVacCbcATag_3w1CV70F2EvBNcADEoM7Ow93nOGG_fDqN5MWrI5LJ8l8LnMbbKcV-NFNnQ2RtocSElieEI0uDhr6jpWCBt8RWBl1RovgywxTkOk4_ykh3reYAjkq498dGDhCBAKa6GZQzjB21G7GpieP4IWo Oct 19 03:32:40.470549 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:32:40.470549 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:32:40.470549 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:32:40.470549 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:32:40.470549 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:32:40.470549 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:32:40.470549 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: ba1cd843801f48bebaccda875d5aa647 Oct 19 03:32:40.470549 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ListServersNegativeTestJSON-1678437181 Oct 19 03:32:40.470549 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:32:40.470549 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:32:40.470549 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ba1cd843801f48bebaccda875d5aa647"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ba1cd843801f48bebaccda875d5aa647"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ba1cd843801f48bebaccda875d5aa647"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ba1cd843801f48bebaccda875d5aa647", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:32:40.470549 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ListServersNegativeTestJSON-1678437181 Oct 19 03:32:40.470549 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: ba1cd843801f48bebaccda875d5aa647 Oct 19 03:32:40.470549 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1678437181 Oct 19 03:32:40.470549 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ListServersNegativeTestJSON-1678437181-project Oct 19 03:32:40.470549 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:32:40.470549 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:32:40.470549 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: b15464bcbb944412bfab92df2d740dc5 Oct 19 03:32:40.470549 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ListServersNegativeTestJSON-1678437181-project Oct 19 03:32:40.470549 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:32:40.470549 n-d-861333-8 devstack@n-api.service[121134]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 19 03:32:40.470549 n-d-861333-8 devstack@n-api.service[121134]: action_args: {} Oct 19 03:32:40.470549 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:32:40.470549 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:32:40.470549 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 03:32:40.470549 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 03:32:40.470549 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 03:32:40.470549 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise error Oct 19 03:32:40.470549 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Oct 19 03:32:40.470549 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:32:40.470549 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Oct 19 03:32:40.470549 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Oct 19 03:32:40.470549 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:32:40.470549 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 19 03:32:40.470549 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi '2011/01/01' Oct 19 03:32:40.470549 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:32:40.470549 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:32:40.470549 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:32:40.470549 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:32:40.470549 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:32:40.470549 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:32:40.470549 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:32:40.470549 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:32:40.470549 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:32:40.470549 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:32:40.470549 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 19 03:32:40.470549 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:32:40.470549 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 19 03:32:40.470549 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:32:40.470549 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 19 03:32:40.470549 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:32:40.470549 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 19 03:32:40.470549 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 19 03:32:40.470549 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 19 03:32:40.470549 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 03:32:40.474673 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 03:32:40.474673 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 03:32:40.474673 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 03:32:40.474673 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 19 03:32:40.474673 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:32:40.474673 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:32:40.474673 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:32:40.474673 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:32:40.474673 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:32:40.474673 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:32:40.474673 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 03:32:40.474673 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 03:32:40.474673 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 19 03:32:40.474673 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:32:40.476746 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a3363af0-13ee-449a-a54e-4e085d6f5e0d tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:32:40.477513 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a3363af0-13ee-449a-a54e-4e085d6f5e0d tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] 10.222.0.52 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.025047 Oct 19 03:32:40.478106 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2142/4375] 10.222.0.52 () {58 vars in 1182 bytes} [Wed Oct 19 03:32:40 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 03:32:40.488691 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-213a72c8-8d29-4b79-8f31-e31891dfa479 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:40.494898 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-213a72c8-8d29-4b79-8f31-e31891dfa479 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b15464bcbb944412bfab92df2d740dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1cd843801f48bebaccda875d5aa647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:40.495791 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-213a72c8-8d29-4b79-8f31-e31891dfa479 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Searching by: {'deleted': False, 'project_id': 'ba1cd843801f48bebaccda875d5aa647'} {{(pid=121134) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 03:32:40.502745 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-213a72c8-8d29-4b79-8f31-e31891dfa479 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:40.503669 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-213a72c8-8d29-4b79-8f31-e31891dfa479 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:40.504119 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-213a72c8-8d29-4b79-8f31-e31891dfa479 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:40.504872 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-213a72c8-8d29-4b79-8f31-e31891dfa479 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:40.505337 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-213a72c8-8d29-4b79-8f31-e31891dfa479 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:40.505929 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-213a72c8-8d29-4b79-8f31-e31891dfa479 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:40.521166 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-53f2e197-64fc-4a3f-a02f-2dfa774edd98 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33d07a7db4846ababf001493c6e10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb0265509744c93b03fa5c28b4e9386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:40.535033 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-53f2e197-64fc-4a3f-a02f-2dfa774edd98 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] 10.222.0.52 "GET /compute/v2.1/servers/2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62" status: 200 len: 1313 microversion: 2.1 time: 0.461071 Oct 19 03:32:40.535666 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.multi_cell_list [None req-213a72c8-8d29-4b79-8f31-e31891dfa479 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=121134) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 03:32:40.537012 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2234/4376] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:32:40 2022] GET /compute/v2.1/servers/2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62 => generated 1313 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:32:40.575837 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-213a72c8-8d29-4b79-8f31-e31891dfa479 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] 10.222.0.52 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.091243 Oct 19 03:32:40.578902 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2143/4377] 10.222.0.52 () {58 vars in 1125 bytes} [Wed Oct 19 03:32:40 2022] GET /compute/v2.1/servers => generated 681 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:32:40.591544 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b9267ae6-f7de-4cd3-98b8-0f92a608f80c tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:40.599403 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-239fad0b-ea8a-4c4e-8baf-b82d7cdeddbc tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:40.601665 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-239fad0b-ea8a-4c4e-8baf-b82d7cdeddbc tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] [instance: eb87cd67-6681-435d-9a65-56a2a06aaccb] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:40.610135 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b9267ae6-f7de-4cd3-98b8-0f92a608f80c tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b15464bcbb944412bfab92df2d740dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1cd843801f48bebaccda875d5aa647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:40.610819 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.compute.servers [None req-b9267ae6-f7de-4cd3-98b8-0f92a608f80c tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Removing options 'limit' from query {{(pid=121134) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1499}} Oct 19 03:32:40.611761 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b9267ae6-f7de-4cd3-98b8-0f92a608f80c tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Searching by: {'deleted': False, 'project_id': 'ba1cd843801f48bebaccda875d5aa647'} {{(pid=121134) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 03:32:40.617049 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-239fad0b-ea8a-4c4e-8baf-b82d7cdeddbc tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:40.617786 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-239fad0b-ea8a-4c4e-8baf-b82d7cdeddbc tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:40.621509 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-239fad0b-ea8a-4c4e-8baf-b82d7cdeddbc tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:40.621509 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-239fad0b-ea8a-4c4e-8baf-b82d7cdeddbc tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:40.621509 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-239fad0b-ea8a-4c4e-8baf-b82d7cdeddbc tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:40.621509 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-239fad0b-ea8a-4c4e-8baf-b82d7cdeddbc tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:40.621928 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b9267ae6-f7de-4cd3-98b8-0f92a608f80c tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:40.621928 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b9267ae6-f7de-4cd3-98b8-0f92a608f80c tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:40.622186 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b9267ae6-f7de-4cd3-98b8-0f92a608f80c tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:40.623880 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b9267ae6-f7de-4cd3-98b8-0f92a608f80c tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:40.625251 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b9267ae6-f7de-4cd3-98b8-0f92a608f80c tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:40.626145 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b9267ae6-f7de-4cd3-98b8-0f92a608f80c tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:40.664069 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.multi_cell_list [None req-b9267ae6-f7de-4cd3-98b8-0f92a608f80c tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=121134) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 03:32:40.713866 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b9267ae6-f7de-4cd3-98b8-0f92a608f80c tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] 10.222.0.52 "GET /compute/v2.1/servers?limit=102" status: 200 len: 681 microversion: 2.1 time: 0.126090 Oct 19 03:32:40.717504 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2144/4378] 10.222.0.52 () {58 vars in 1144 bytes} [Wed Oct 19 03:32:40 2022] GET /compute/v2.1/servers?limit=102 => generated 681 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:32:40.744141 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0b8f15f0-8b88-4250-9d0d-a5f84087e257 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:40.757061 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0b8f15f0-8b88-4250-9d0d-a5f84087e257 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Request method failure captured: Oct 19 03:32:40.757061 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Oct 19 03:32:40.757061 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:32:40.757061 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:32:40.757061 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:32:40.757061 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:32:40.757061 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:32:40.757061 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:32:40.757061 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:32:40.757061 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:32:40.757061 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT2-r77bNhnlUcEvHp0HPVacCbcATag_3w1CV70F2EvBNcADEoM7Ow93nOGG_fDqN5MWrI5LJ8l8LnMbbKcV-NFNnQ2RtocSElieEI0uDhr6jpWCBt8RWBl1RovgywxTkOk4_ykh3reYAjkq498dGDhCBAKa6GZQzjB21G7GpieP4IWo Oct 19 03:32:40.757061 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:32:40.757061 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:32:40.757061 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:32:40.757061 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:32:40.757061 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:32:40.757061 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:32:40.757061 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: ba1cd843801f48bebaccda875d5aa647 Oct 19 03:32:40.757061 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ListServersNegativeTestJSON-1678437181 Oct 19 03:32:40.757061 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:32:40.757061 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:32:40.757061 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ba1cd843801f48bebaccda875d5aa647"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ba1cd843801f48bebaccda875d5aa647"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ba1cd843801f48bebaccda875d5aa647"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ba1cd843801f48bebaccda875d5aa647", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:32:40.757061 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ListServersNegativeTestJSON-1678437181 Oct 19 03:32:40.757061 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: ba1cd843801f48bebaccda875d5aa647 Oct 19 03:32:40.757061 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1678437181 Oct 19 03:32:40.757061 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ListServersNegativeTestJSON-1678437181-project Oct 19 03:32:40.757061 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:32:40.757061 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:32:40.757061 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: b15464bcbb944412bfab92df2d740dc5 Oct 19 03:32:40.757061 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ListServersNegativeTestJSON-1678437181-project Oct 19 03:32:40.757061 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:32:40.757061 n-d-861333-8 devstack@n-api.service[121134]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 19 03:32:40.757061 n-d-861333-8 devstack@n-api.service[121134]: action_args: {} Oct 19 03:32:40.757061 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:32:40.757061 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:32:40.757061 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 03:32:40.757061 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 03:32:40.757061 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 03:32:40.757061 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise error Oct 19 03:32:40.757061 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Oct 19 03:32:40.757061 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:32:40.757061 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 19 03:32:40.757061 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 19 03:32:40.757061 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 19 03:32:40.757061 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 19 03:32:40.757061 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 19 03:32:40.757061 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:32:40.757061 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 19 03:32:40.757061 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi '-1' Oct 19 03:32:40.757061 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:32:40.757061 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:32:40.757061 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:32:40.757061 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:32:40.757061 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:32:40.757061 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:32:40.757061 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:32:40.757061 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:32:40.757061 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:32:40.757061 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:32:40.757061 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 19 03:32:40.757061 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:32:40.757061 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 19 03:32:40.757061 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:32:40.757061 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 19 03:32:40.757061 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:32:40.757061 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 19 03:32:40.757061 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 19 03:32:40.757061 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 19 03:32:40.760928 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 03:32:40.760928 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 03:32:40.760928 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 03:32:40.760928 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 03:32:40.760928 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 19 03:32:40.760928 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:32:40.760928 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:32:40.760928 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:32:40.760928 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:32:40.760928 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:32:40.760928 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:32:40.760928 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 03:32:40.760928 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 03:32:40.760928 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 19 03:32:40.760928 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:32:40.760928 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0b8f15f0-8b88-4250-9d0d-a5f84087e257 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:32:40.760928 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0b8f15f0-8b88-4250-9d0d-a5f84087e257 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] 10.222.0.52 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.029786 Oct 19 03:32:40.767111 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2145/4379] 10.222.0.52 () {58 vars in 1142 bytes} [Wed Oct 19 03:32:40 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 03:32:40.777562 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-715cde33-7526-4c71-90b3-0e675fc3623f tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:40.784019 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-715cde33-7526-4c71-90b3-0e675fc3623f tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Request method failure captured: Oct 19 03:32:40.784019 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Oct 19 03:32:40.784019 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:32:40.784019 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:32:40.784019 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:32:40.784019 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:32:40.784019 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:32:40.784019 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:32:40.784019 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:32:40.784019 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:32:40.784019 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT2-r77bNhnlUcEvHp0HPVacCbcATag_3w1CV70F2EvBNcADEoM7Ow93nOGG_fDqN5MWrI5LJ8l8LnMbbKcV-NFNnQ2RtocSElieEI0uDhr6jpWCBt8RWBl1RovgywxTkOk4_ykh3reYAjkq498dGDhCBAKa6GZQzjB21G7GpieP4IWo Oct 19 03:32:40.784019 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:32:40.784019 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:32:40.784019 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:32:40.784019 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:32:40.784019 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:32:40.784019 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:32:40.784019 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: ba1cd843801f48bebaccda875d5aa647 Oct 19 03:32:40.784019 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ListServersNegativeTestJSON-1678437181 Oct 19 03:32:40.784019 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:32:40.784019 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:32:40.784019 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ba1cd843801f48bebaccda875d5aa647"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ba1cd843801f48bebaccda875d5aa647"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ba1cd843801f48bebaccda875d5aa647"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ba1cd843801f48bebaccda875d5aa647", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:32:40.784019 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ListServersNegativeTestJSON-1678437181 Oct 19 03:32:40.784019 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: ba1cd843801f48bebaccda875d5aa647 Oct 19 03:32:40.784019 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1678437181 Oct 19 03:32:40.784019 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ListServersNegativeTestJSON-1678437181-project Oct 19 03:32:40.784019 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:32:40.784019 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:32:40.784019 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: b15464bcbb944412bfab92df2d740dc5 Oct 19 03:32:40.784019 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ListServersNegativeTestJSON-1678437181-project Oct 19 03:32:40.784019 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:32:40.784019 n-d-861333-8 devstack@n-api.service[121134]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 19 03:32:40.784019 n-d-861333-8 devstack@n-api.service[121134]: action_args: {} Oct 19 03:32:40.784019 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:32:40.784019 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:32:40.784019 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 03:32:40.784019 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 03:32:40.784019 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 03:32:40.784019 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise error Oct 19 03:32:40.784019 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Oct 19 03:32:40.784019 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:32:40.784019 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 19 03:32:40.784019 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 19 03:32:40.784019 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 19 03:32:40.784019 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 19 03:32:40.784019 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 19 03:32:40.784019 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:32:40.784019 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 19 03:32:40.784019 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi 'testing' Oct 19 03:32:40.784019 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:32:40.784019 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:32:40.784019 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:32:40.784019 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:32:40.784019 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:32:40.784019 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:32:40.784019 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:32:40.784019 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:32:40.784019 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:32:40.784019 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:32:40.784019 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 19 03:32:40.784019 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:32:40.784019 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 19 03:32:40.784019 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:32:40.784019 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 19 03:32:40.784019 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:32:40.784019 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 19 03:32:40.784019 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 19 03:32:40.784019 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 19 03:32:40.790268 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 03:32:40.790268 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 03:32:40.790268 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 03:32:40.790268 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 03:32:40.790268 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 19 03:32:40.790268 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:32:40.790268 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:32:40.790268 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:32:40.790268 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:32:40.790268 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:32:40.790268 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:32:40.790268 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 03:32:40.790268 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 03:32:40.790268 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 19 03:32:40.790268 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:32:40.796754 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-715cde33-7526-4c71-90b3-0e675fc3623f tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:32:40.797941 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-715cde33-7526-4c71-90b3-0e675fc3623f tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] 10.222.0.52 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.029711 Oct 19 03:32:40.804631 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2146/4380] 10.222.0.52 () {58 vars in 1152 bytes} [Wed Oct 19 03:32:40 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 03:32:40.817921 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b28360e3-af40-4448-89f7-2be4313eebf5 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:40.821962 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b28360e3-af40-4448-89f7-2be4313eebf5 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b15464bcbb944412bfab92df2d740dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1cd843801f48bebaccda875d5aa647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:40.822653 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b28360e3-af40-4448-89f7-2be4313eebf5 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': 'ba1cd843801f48bebaccda875d5aa647'} {{(pid=121134) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 03:32:40.831113 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.compute.servers [None req-b28360e3-af40-4448-89f7-2be4313eebf5 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Flavor 'non_existing_flavor' could not be found {{(pid=121134) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Oct 19 03:32:40.833289 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b28360e3-af40-4448-89f7-2be4313eebf5 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] 10.222.0.52 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.026445 Oct 19 03:32:40.843377 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2147/4381] 10.222.0.52 () {58 vars in 1178 bytes} [Wed Oct 19 03:32:40 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 03:32:40.848432 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3dc58231-3314-4725-a4f6-125f29e7e7a9 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:40.855465 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-3dc58231-3314-4725-a4f6-125f29e7e7a9 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b15464bcbb944412bfab92df2d740dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1cd843801f48bebaccda875d5aa647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:40.857058 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3dc58231-3314-4725-a4f6-125f29e7e7a9 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': 'ba1cd843801f48bebaccda875d5aa647'} {{(pid=121134) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 03:32:40.866623 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3dc58231-3314-4725-a4f6-125f29e7e7a9 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:40.867360 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3dc58231-3314-4725-a4f6-125f29e7e7a9 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:40.867968 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3dc58231-3314-4725-a4f6-125f29e7e7a9 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:40.868868 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3dc58231-3314-4725-a4f6-125f29e7e7a9 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:40.869516 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3dc58231-3314-4725-a4f6-125f29e7e7a9 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:40.870113 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3dc58231-3314-4725-a4f6-125f29e7e7a9 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:40.979087 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-239fad0b-ea8a-4c4e-8baf-b82d7cdeddbc tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b748815c10a46d2adc26d5c8a1ba268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc49f9b6a0054092beda3ab313bff1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:41.004536 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-239fad0b-ea8a-4c4e-8baf-b82d7cdeddbc tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] 10.222.0.52 "GET /compute/v2.1/servers/eb87cd67-6681-435d-9a65-56a2a06aaccb" status: 200 len: 1321 microversion: 2.1 time: 0.414091 Oct 19 03:32:41.005173 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2235/4382] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:32:40 2022] GET /compute/v2.1/servers/eb87cd67-6681-435d-9a65-56a2a06aaccb => generated 1321 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:32:41.052535 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3dc58231-3314-4725-a4f6-125f29e7e7a9 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] 10.222.0.52 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.207931 Oct 19 03:32:41.053809 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2148/4383] 10.222.0.52 () {58 vars in 1174 bytes} [Wed Oct 19 03:32:40 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 03:32:41.066732 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-232ca5d1-c8a3-49e9-bb2f-e461164fcdbf tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:41.076822 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-232ca5d1-c8a3-49e9-bb2f-e461164fcdbf tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b15464bcbb944412bfab92df2d740dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1cd843801f48bebaccda875d5aa647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:41.078009 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-232ca5d1-c8a3-49e9-bb2f-e461164fcdbf tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': 'ba1cd843801f48bebaccda875d5aa647'} {{(pid=121135) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 03:32:41.086085 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-232ca5d1-c8a3-49e9-bb2f-e461164fcdbf tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:41.087646 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-232ca5d1-c8a3-49e9-bb2f-e461164fcdbf tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:41.088388 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-232ca5d1-c8a3-49e9-bb2f-e461164fcdbf tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:41.089362 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-232ca5d1-c8a3-49e9-bb2f-e461164fcdbf tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:41.090228 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-232ca5d1-c8a3-49e9-bb2f-e461164fcdbf tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:41.091074 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-232ca5d1-c8a3-49e9-bb2f-e461164fcdbf tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:41.234720 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-232ca5d1-c8a3-49e9-bb2f-e461164fcdbf tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] 10.222.0.52 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.172277 Oct 19 03:32:41.243004 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2236/4384] 10.222.0.52 () {58 vars in 1184 bytes} [Wed Oct 19 03:32:41 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 03:32:41.248422 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e25f38eb-ddde-4848-a8ff-82ba7c862974 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:41.261257 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e25f38eb-ddde-4848-a8ff-82ba7c862974 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b15464bcbb944412bfab92df2d740dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1cd843801f48bebaccda875d5aa647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:41.262478 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e25f38eb-ddde-4848-a8ff-82ba7c862974 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Searching by: {'deleted': False, 'project_id': 'ba1cd843801f48bebaccda875d5aa647'} {{(pid=121134) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 03:32:41.272546 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e25f38eb-ddde-4848-a8ff-82ba7c862974 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:41.275417 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e25f38eb-ddde-4848-a8ff-82ba7c862974 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:41.275944 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e25f38eb-ddde-4848-a8ff-82ba7c862974 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:41.277719 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e25f38eb-ddde-4848-a8ff-82ba7c862974 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:41.290278 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e25f38eb-ddde-4848-a8ff-82ba7c862974 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:41.290830 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e25f38eb-ddde-4848-a8ff-82ba7c862974 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:41.356006 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.multi_cell_list [None req-e25f38eb-ddde-4848-a8ff-82ba7c862974 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=121134) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 03:32:41.424379 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e25f38eb-ddde-4848-a8ff-82ba7c862974 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15464bcbb944412bfab92df2d740dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1cd843801f48bebaccda875d5aa647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:41.437947 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e25f38eb-ddde-4848-a8ff-82ba7c862974 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:41.438651 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e25f38eb-ddde-4848-a8ff-82ba7c862974 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:41.441105 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e25f38eb-ddde-4848-a8ff-82ba7c862974 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:41.481597 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f91fcbfe-b0e6-49b8-b4e2-497a3fa27cf6 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:41.482193 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f91fcbfe-b0e6-49b8-b4e2-497a3fa27cf6 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 3893d3e4-3a09-4adf-951b-84befacf7489] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:41.489093 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f91fcbfe-b0e6-49b8-b4e2-497a3fa27cf6 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:41.489646 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f91fcbfe-b0e6-49b8-b4e2-497a3fa27cf6 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:41.490096 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f91fcbfe-b0e6-49b8-b4e2-497a3fa27cf6 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:41.491675 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f91fcbfe-b0e6-49b8-b4e2-497a3fa27cf6 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:41.491793 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f91fcbfe-b0e6-49b8-b4e2-497a3fa27cf6 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:41.492313 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f91fcbfe-b0e6-49b8-b4e2-497a3fa27cf6 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:41.927271 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e25f38eb-ddde-4848-a8ff-82ba7c862974 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] 10.222.0.52 "GET /compute/v2.1/servers/detail" status: 200 len: 3022 microversion: 2.1 time: 0.682540 Oct 19 03:32:41.929106 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2149/4385] 10.222.0.52 () {58 vars in 1146 bytes} [Wed Oct 19 03:32:41 2022] GET /compute/v2.1/servers/detail => generated 3022 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:32:41.948796 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d5507b1a-9d04-459c-8b16-7cee2efc7d24 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:41.950880 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d5507b1a-9d04-459c-8b16-7cee2efc7d24 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] [instance: 2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:41.957086 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f91fcbfe-b0e6-49b8-b4e2-497a3fa27cf6 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:41.963815 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d5507b1a-9d04-459c-8b16-7cee2efc7d24 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:41.964513 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d5507b1a-9d04-459c-8b16-7cee2efc7d24 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:41.965151 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d5507b1a-9d04-459c-8b16-7cee2efc7d24 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:41.966063 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d5507b1a-9d04-459c-8b16-7cee2efc7d24 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:41.966697 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d5507b1a-9d04-459c-8b16-7cee2efc7d24 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:41.967300 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d5507b1a-9d04-459c-8b16-7cee2efc7d24 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:41.968822 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f91fcbfe-b0e6-49b8-b4e2-497a3fa27cf6 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/3893d3e4-3a09-4adf-951b-84befacf7489" status: 200 len: 1314 microversion: 2.1 time: 0.491538 Oct 19 03:32:41.971127 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2237/4386] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:32:41 2022] GET /compute/v2.1/servers/3893d3e4-3a09-4adf-951b-84befacf7489 => generated 1314 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:32:42.264154 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-30e49ff5-0add-441c-b127-3465341edbc5 req-e631ea0c-697f-4ec9-9a30-42dbd36e460e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62", "tag": "7dac7931-fc74-4a9a-a0b2-14471003659c"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:32:42.287211 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-30e49ff5-0add-441c-b127-3465341edbc5 req-e631ea0c-697f-4ec9-9a30-42dbd36e460e service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:42.290399 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-30e49ff5-0add-441c-b127-3465341edbc5 req-e631ea0c-697f-4ec9-9a30-42dbd36e460e service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:42.291180 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-30e49ff5-0add-441c-b127-3465341edbc5 req-e631ea0c-697f-4ec9-9a30-42dbd36e460e service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:42.332704 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-30e49ff5-0add-441c-b127-3465341edbc5 req-e631ea0c-697f-4ec9-9a30-42dbd36e460e service nova] Creating event network-changed:7dac7931-fc74-4a9a-a0b2-14471003659c for instance 2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62 on n-h2-861333-8 Oct 19 03:32:42.349255 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-30e49ff5-0add-441c-b127-3465341edbc5 req-e631ea0c-697f-4ec9-9a30-42dbd36e460e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.378495 Oct 19 03:32:42.354072 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2238/4387] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:32:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:32:42.369280 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-fb92a834-630b-4440-a06f-f863df8ca2be tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:42.381025 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-fb92a834-630b-4440-a06f-f863df8ca2be tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b15464bcbb944412bfab92df2d740dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1cd843801f48bebaccda875d5aa647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:42.402961 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-fb92a834-630b-4440-a06f-f863df8ca2be tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] 10.222.0.52 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.038938 Oct 19 03:32:42.411249 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2239/4388] 10.222.0.52 () {58 vars in 1178 bytes} [Wed Oct 19 03:32:42 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 03:32:42.419647 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-605d1486-c964-47a0-81ba-19a679bb1fa4 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:42.422165 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-605d1486-c964-47a0-81ba-19a679bb1fa4 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] [instance: eb87cd67-6681-435d-9a65-56a2a06aaccb] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:42.443395 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-605d1486-c964-47a0-81ba-19a679bb1fa4 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:42.444835 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-605d1486-c964-47a0-81ba-19a679bb1fa4 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:42.445487 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-605d1486-c964-47a0-81ba-19a679bb1fa4 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:42.449483 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-605d1486-c964-47a0-81ba-19a679bb1fa4 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:42.450212 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-605d1486-c964-47a0-81ba-19a679bb1fa4 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:42.451189 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-605d1486-c964-47a0-81ba-19a679bb1fa4 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:42.872356 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d5507b1a-9d04-459c-8b16-7cee2efc7d24 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33d07a7db4846ababf001493c6e10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb0265509744c93b03fa5c28b4e9386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:42.880925 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d5507b1a-9d04-459c-8b16-7cee2efc7d24 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] 10.222.0.52 "GET /compute/v2.1/servers/2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62" status: 200 len: 1313 microversion: 2.1 time: 0.950458 Oct 19 03:32:42.884582 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2150/4389] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:32:41 2022] GET /compute/v2.1/servers/2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62 => generated 1313 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:32:42.907187 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d3fdd194-814d-48f2-ac84-337e27903955 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:42.931469 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d3fdd194-814d-48f2-ac84-337e27903955 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b15464bcbb944412bfab92df2d740dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1cd843801f48bebaccda875d5aa647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:42.932458 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d3fdd194-814d-48f2-ac84-337e27903955 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Searching by: {'deleted': False, 'project_id': 'ba1cd843801f48bebaccda875d5aa647'} {{(pid=121134) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 03:32:42.947518 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d3fdd194-814d-48f2-ac84-337e27903955 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:42.948025 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d3fdd194-814d-48f2-ac84-337e27903955 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:42.948472 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d3fdd194-814d-48f2-ac84-337e27903955 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:42.949225 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d3fdd194-814d-48f2-ac84-337e27903955 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:42.949760 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d3fdd194-814d-48f2-ac84-337e27903955 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:42.950198 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d3fdd194-814d-48f2-ac84-337e27903955 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:43.004941 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.multi_cell_list [None req-d3fdd194-814d-48f2-ac84-337e27903955 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=121134) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 03:32:43.080325 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d3fdd194-814d-48f2-ac84-337e27903955 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] 10.222.0.52 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.165504 Oct 19 03:32:43.083650 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2151/4390] 10.222.0.52 () {58 vars in 1125 bytes} [Wed Oct 19 03:32:42 2022] GET /compute/v2.1/servers => generated 681 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:32:43.095416 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-b507729a-bcbb-4f04-acb7-4a66ab75efd2 req-58821f99-d28d-4bdd-a5e8-c580b921b3af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb87cd67-6681-435d-9a65-56a2a06aaccb", "name": "network-vif-plugged", "status": "completed", "tag": "c3fa2e3d-8e37-42f2-97ea-111ea45b20e5"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:32:43.119722 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-b507729a-bcbb-4f04-acb7-4a66ab75efd2 req-58821f99-d28d-4bdd-a5e8-c580b921b3af service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:43.120920 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-b507729a-bcbb-4f04-acb7-4a66ab75efd2 req-58821f99-d28d-4bdd-a5e8-c580b921b3af service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:43.121561 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-b507729a-bcbb-4f04-acb7-4a66ab75efd2 req-58821f99-d28d-4bdd-a5e8-c580b921b3af service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:43.149432 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-b507729a-bcbb-4f04-acb7-4a66ab75efd2 req-58821f99-d28d-4bdd-a5e8-c580b921b3af service nova] Creating event network-vif-plugged:c3fa2e3d-8e37-42f2-97ea-111ea45b20e5 for instance eb87cd67-6681-435d-9a65-56a2a06aaccb on n-h1-861333-8 Oct 19 03:32:43.155543 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-b507729a-bcbb-4f04-acb7-4a66ab75efd2 req-58821f99-d28d-4bdd-a5e8-c580b921b3af service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069750 Oct 19 03:32:43.157257 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2152/4391] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:32:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:32:43.169519 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c08a89cb-9da9-43e3-a7d3-0cbb22180778 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:43.170255 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c08a89cb-9da9-43e3-a7d3-0cbb22180778 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 3893d3e4-3a09-4adf-951b-84befacf7489] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:43.180935 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c08a89cb-9da9-43e3-a7d3-0cbb22180778 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:43.185714 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c08a89cb-9da9-43e3-a7d3-0cbb22180778 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:43.186396 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c08a89cb-9da9-43e3-a7d3-0cbb22180778 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:43.187310 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c08a89cb-9da9-43e3-a7d3-0cbb22180778 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:43.189708 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c08a89cb-9da9-43e3-a7d3-0cbb22180778 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:43.190366 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c08a89cb-9da9-43e3-a7d3-0cbb22180778 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:43.204930 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-605d1486-c964-47a0-81ba-19a679bb1fa4 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b748815c10a46d2adc26d5c8a1ba268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc49f9b6a0054092beda3ab313bff1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:43.221546 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-605d1486-c964-47a0-81ba-19a679bb1fa4 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] 10.222.0.52 "GET /compute/v2.1/servers/eb87cd67-6681-435d-9a65-56a2a06aaccb" status: 200 len: 1321 microversion: 2.1 time: 0.815642 Oct 19 03:32:43.221815 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=100 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:32:43.223398 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2240/4392] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:32:42 2022] GET /compute/v2.1/servers/eb87cd67-6681-435d-9a65-56a2a06aaccb => generated 1321 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:32:43.233246 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-18365a42-0177-4356-81b2-1fc8995e4166 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:43.235227 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-18365a42-0177-4356-81b2-1fc8995e4166 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] [instance: 70a327e7-5c86-4d2b-b7b2-3c18e4027d81] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:43.244779 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-18365a42-0177-4356-81b2-1fc8995e4166 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:43.245633 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-18365a42-0177-4356-81b2-1fc8995e4166 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:43.246342 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-18365a42-0177-4356-81b2-1fc8995e4166 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:43.249568 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-18365a42-0177-4356-81b2-1fc8995e4166 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:43.249568 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-18365a42-0177-4356-81b2-1fc8995e4166 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:43.249568 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-18365a42-0177-4356-81b2-1fc8995e4166 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:43.270935 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-18365a42-0177-4356-81b2-1fc8995e4166 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] HTTP exception thrown: Instance 70a327e7-5c86-4d2b-b7b2-3c18e4027d81 could not be found. Oct 19 03:32:43.274667 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-18365a42-0177-4356-81b2-1fc8995e4166 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Request method failure captured: Oct 19 03:32:43.274667 n-d-861333-8 devstack@n-api.service[121135]: request: DELETE /compute/v2.1/servers/70a327e7-5c86-4d2b-b7b2-3c18e4027d81 HTTP/1.1 Oct 19 03:32:43.274667 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:32:43.274667 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:32:43.274667 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:32:43.274667 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:32:43.274667 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:32:43.274667 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:32:43.274667 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:32:43.274667 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:32:43.274667 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2-r77bNhnlUcEvHp0HPVacCbcATag_3w1CV70F2EvBNcADEoM7Ow93nOGG_fDqN5MWrI5LJ8l8LnMbbKcV-NFNnQ2RtocSElieEI0uDhr6jpWCBt8RWBl1RovgywxTkOk4_ykh3reYAjkq498dGDhCBAKa6GZQzjB21G7GpieP4IWo Oct 19 03:32:43.274667 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:32:43.274667 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:32:43.274667 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:32:43.274667 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:32:43.274667 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:32:43.274667 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:32:43.274667 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: ba1cd843801f48bebaccda875d5aa647 Oct 19 03:32:43.274667 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ListServersNegativeTestJSON-1678437181 Oct 19 03:32:43.274667 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:32:43.274667 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:32:43.274667 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ba1cd843801f48bebaccda875d5aa647"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ba1cd843801f48bebaccda875d5aa647"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ba1cd843801f48bebaccda875d5aa647"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ba1cd843801f48bebaccda875d5aa647", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:32:43.274667 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ListServersNegativeTestJSON-1678437181 Oct 19 03:32:43.274667 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: ba1cd843801f48bebaccda875d5aa647 Oct 19 03:32:43.274667 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1678437181 Oct 19 03:32:43.274667 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ListServersNegativeTestJSON-1678437181-project Oct 19 03:32:43.274667 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:32:43.274667 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:32:43.274667 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: b15464bcbb944412bfab92df2d740dc5 Oct 19 03:32:43.274667 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ListServersNegativeTestJSON-1678437181-project Oct 19 03:32:43.274667 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:32:43.274667 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance 70a327e7-5c86-4d2b-b7b2-3c18e4027d81 could not be found. Oct 19 03:32:43.274667 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '70a327e7-5c86-4d2b-b7b2-3c18e4027d81'} Oct 19 03:32:43.274667 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:32:43.274667 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:32:43.274667 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:32:43.274667 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:32:43.274667 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:32:43.274667 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:32:43.274667 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:32:43.274667 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:32:43.274667 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:32:43.274667 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:32:43.274667 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70a327e7-5c86-4d2b-b7b2-3c18e4027d81 could not be found. Oct 19 03:32:43.274667 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:32:43.274667 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:32:43.274667 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:32:43.274667 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:32:43.274667 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:32:43.274667 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:32:43.274667 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:32:43.274667 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:32:43.274667 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:32:43.274667 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:32:43.274667 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 03:32:43.274667 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 03:32:43.274667 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 03:32:43.274667 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 03:32:43.274667 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:32:43.274667 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:32:43.274667 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:32:43.274667 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:32:43.281223 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70a327e7-5c86-4d2b-b7b2-3c18e4027d81 could not be found. Oct 19 03:32:43.281223 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:32:43.281223 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:32:43.281223 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:32:43.281223 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:32:43.281223 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:32:43.281223 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:32:43.281223 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:32:43.281223 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:32:43.281223 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70a327e7-5c86-4d2b-b7b2-3c18e4027d81 could not be found. Oct 19 03:32:43.281223 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:32:43.290664 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-18365a42-0177-4356-81b2-1fc8995e4166 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Returning 404 to user: Instance 70a327e7-5c86-4d2b-b7b2-3c18e4027d81 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:32:43.290664 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-18365a42-0177-4356-81b2-1fc8995e4166 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] 10.222.0.52 "DELETE /compute/v2.1/servers/70a327e7-5c86-4d2b-b7b2-3c18e4027d81" status: 404 len: 111 microversion: 2.1 time: 0.058747 Oct 19 03:32:43.290664 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2241/4393] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:32:43 2022] DELETE /compute/v2.1/servers/70a327e7-5c86-4d2b-b7b2-3c18e4027d81 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:32:43.297893 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-06434d21-4250-4a11-a80d-05be69bb623e tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:43.299068 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-06434d21-4250-4a11-a80d-05be69bb623e tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] [instance: 6fe11b03-fcac-4a7e-af1c-4ae425f2d548] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:43.308699 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-06434d21-4250-4a11-a80d-05be69bb623e tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:43.309826 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-06434d21-4250-4a11-a80d-05be69bb623e tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:43.310515 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-06434d21-4250-4a11-a80d-05be69bb623e tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:43.311562 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-06434d21-4250-4a11-a80d-05be69bb623e tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:43.312263 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-06434d21-4250-4a11-a80d-05be69bb623e tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:43.312941 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-06434d21-4250-4a11-a80d-05be69bb623e tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:43.433893 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-06434d21-4250-4a11-a80d-05be69bb623e tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] [instance: 6fe11b03-fcac-4a7e-af1c-4ae425f2d548] Going to try to terminate instance {{(pid=121135) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:32:43.558970 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c08a89cb-9da9-43e3-a7d3-0cbb22180778 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:43.571429 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c08a89cb-9da9-43e3-a7d3-0cbb22180778 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/3893d3e4-3a09-4adf-951b-84befacf7489" status: 200 len: 1314 microversion: 2.1 time: 0.413005 Oct 19 03:32:43.600048 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2153/4394] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:32:43 2022] GET /compute/v2.1/servers/3893d3e4-3a09-4adf-951b-84befacf7489 => generated 1314 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:32:43.808582 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:32:43.911920 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6fcef48d-f4a0-497b-bdca-d7bc371fa7eb tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:43.913404 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6fcef48d-f4a0-497b-bdca-d7bc371fa7eb tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] [instance: 2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:43.920255 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-06434d21-4250-4a11-a80d-05be69bb623e tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] 10.222.0.52 "DELETE /compute/v2.1/servers/6fe11b03-fcac-4a7e-af1c-4ae425f2d548" status: 204 len: 0 microversion: 2.1 time: 0.628132 Oct 19 03:32:43.921066 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2242/4395] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:32:43 2022] DELETE /compute/v2.1/servers/6fe11b03-fcac-4a7e-af1c-4ae425f2d548 => generated 0 bytes in 631 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:32:43.931260 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b936f9a8-8ec2-4e0f-a40e-46ced5ee10ba tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:43.933730 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b936f9a8-8ec2-4e0f-a40e-46ced5ee10ba tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] [instance: 4851555c-a35e-4277-ab6e-3099b6e8a72b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:43.935560 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6fcef48d-f4a0-497b-bdca-d7bc371fa7eb tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:43.938218 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6fcef48d-f4a0-497b-bdca-d7bc371fa7eb tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:43.941721 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6fcef48d-f4a0-497b-bdca-d7bc371fa7eb tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:43.942715 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6fcef48d-f4a0-497b-bdca-d7bc371fa7eb tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:43.944982 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6fcef48d-f4a0-497b-bdca-d7bc371fa7eb tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:43.945817 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6fcef48d-f4a0-497b-bdca-d7bc371fa7eb tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:43.953209 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b936f9a8-8ec2-4e0f-a40e-46ced5ee10ba tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:43.962615 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b936f9a8-8ec2-4e0f-a40e-46ced5ee10ba tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:43.962615 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b936f9a8-8ec2-4e0f-a40e-46ced5ee10ba tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:43.962615 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b936f9a8-8ec2-4e0f-a40e-46ced5ee10ba tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:43.964233 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b936f9a8-8ec2-4e0f-a40e-46ced5ee10ba tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:43.964954 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b936f9a8-8ec2-4e0f-a40e-46ced5ee10ba tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:44.046690 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b936f9a8-8ec2-4e0f-a40e-46ced5ee10ba tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] [instance: 4851555c-a35e-4277-ab6e-3099b6e8a72b] Going to try to terminate instance {{(pid=121135) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:32:44.266754 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:32:44.314060 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-6fcef48d-f4a0-497b-bdca-d7bc371fa7eb tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33d07a7db4846ababf001493c6e10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb0265509744c93b03fa5c28b4e9386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:44.325060 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6fcef48d-f4a0-497b-bdca-d7bc371fa7eb tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] 10.222.0.52 "GET /compute/v2.1/servers/2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62" status: 200 len: 1313 microversion: 2.1 time: 0.417028 Oct 19 03:32:44.331981 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2154/4396] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:32:43 2022] GET /compute/v2.1/servers/2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62 => generated 1313 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:32:44.345202 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ddb92c26-cc63-42d2-9ba3-ff16a3c906a2 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:44.346096 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ddb92c26-cc63-42d2-9ba3-ff16a3c906a2 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] [instance: eb87cd67-6681-435d-9a65-56a2a06aaccb] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:44.357737 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ddb92c26-cc63-42d2-9ba3-ff16a3c906a2 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:44.360171 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ddb92c26-cc63-42d2-9ba3-ff16a3c906a2 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:44.360638 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ddb92c26-cc63-42d2-9ba3-ff16a3c906a2 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:44.361398 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ddb92c26-cc63-42d2-9ba3-ff16a3c906a2 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:44.361864 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ddb92c26-cc63-42d2-9ba3-ff16a3c906a2 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:44.362303 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ddb92c26-cc63-42d2-9ba3-ff16a3c906a2 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:44.512939 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b936f9a8-8ec2-4e0f-a40e-46ced5ee10ba tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] 10.222.0.52 "DELETE /compute/v2.1/servers/4851555c-a35e-4277-ab6e-3099b6e8a72b" status: 204 len: 0 microversion: 2.1 time: 0.586853 Oct 19 03:32:44.513859 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2243/4397] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:32:43 2022] DELETE /compute/v2.1/servers/4851555c-a35e-4277-ab6e-3099b6e8a72b => generated 0 bytes in 589 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:32:44.522224 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d32074e6-fa5b-4e6e-b02b-9056190713ac tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:44.523373 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d32074e6-fa5b-4e6e-b02b-9056190713ac tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] [instance: 70a327e7-5c86-4d2b-b7b2-3c18e4027d81] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:44.536494 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d32074e6-fa5b-4e6e-b02b-9056190713ac tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:44.536999 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d32074e6-fa5b-4e6e-b02b-9056190713ac tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:44.537462 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d32074e6-fa5b-4e6e-b02b-9056190713ac tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:44.538378 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d32074e6-fa5b-4e6e-b02b-9056190713ac tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:44.539192 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d32074e6-fa5b-4e6e-b02b-9056190713ac tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:44.539841 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d32074e6-fa5b-4e6e-b02b-9056190713ac tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:44.576206 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-d32074e6-fa5b-4e6e-b02b-9056190713ac tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] HTTP exception thrown: Instance 70a327e7-5c86-4d2b-b7b2-3c18e4027d81 could not be found. Oct 19 03:32:44.578191 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d32074e6-fa5b-4e6e-b02b-9056190713ac tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Request method failure captured: Oct 19 03:32:44.578191 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/70a327e7-5c86-4d2b-b7b2-3c18e4027d81 HTTP/1.1 Oct 19 03:32:44.578191 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:32:44.578191 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:32:44.578191 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:32:44.578191 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:32:44.578191 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:32:44.578191 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:32:44.578191 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:32:44.578191 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:32:44.578191 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2-r77bNhnlUcEvHp0HPVacCbcATag_3w1CV70F2EvBNcADEoM7Ow93nOGG_fDqN5MWrI5LJ8l8LnMbbKcV-NFNnQ2RtocSElieEI0uDhr6jpWCBt8RWBl1RovgywxTkOk4_ykh3reYAjkq498dGDhCBAKa6GZQzjB21G7GpieP4IWo Oct 19 03:32:44.578191 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:32:44.578191 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:32:44.578191 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:32:44.578191 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:32:44.578191 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:32:44.578191 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:32:44.578191 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: ba1cd843801f48bebaccda875d5aa647 Oct 19 03:32:44.578191 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ListServersNegativeTestJSON-1678437181 Oct 19 03:32:44.578191 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:32:44.578191 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:32:44.578191 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ba1cd843801f48bebaccda875d5aa647"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ba1cd843801f48bebaccda875d5aa647"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ba1cd843801f48bebaccda875d5aa647"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ba1cd843801f48bebaccda875d5aa647", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:32:44.578191 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ListServersNegativeTestJSON-1678437181 Oct 19 03:32:44.578191 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: ba1cd843801f48bebaccda875d5aa647 Oct 19 03:32:44.578191 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1678437181 Oct 19 03:32:44.578191 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ListServersNegativeTestJSON-1678437181-project Oct 19 03:32:44.578191 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:32:44.578191 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:32:44.578191 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: b15464bcbb944412bfab92df2d740dc5 Oct 19 03:32:44.578191 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ListServersNegativeTestJSON-1678437181-project Oct 19 03:32:44.578191 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:32:44.578191 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance 70a327e7-5c86-4d2b-b7b2-3c18e4027d81 could not be found. Oct 19 03:32:44.578191 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '70a327e7-5c86-4d2b-b7b2-3c18e4027d81'} Oct 19 03:32:44.578191 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:32:44.578191 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:32:44.578191 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:32:44.578191 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:32:44.578191 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:32:44.578191 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:32:44.578191 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:32:44.578191 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:32:44.578191 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:32:44.578191 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:32:44.578191 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70a327e7-5c86-4d2b-b7b2-3c18e4027d81 could not be found. Oct 19 03:32:44.578191 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:32:44.578191 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:32:44.578191 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:32:44.578191 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:32:44.578191 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:32:44.578191 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:32:44.578191 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:32:44.578191 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:32:44.578191 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:32:44.578191 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:32:44.578191 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:32:44.578191 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:32:44.578191 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:32:44.578191 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:32:44.578191 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:32:44.578191 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:32:44.578191 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70a327e7-5c86-4d2b-b7b2-3c18e4027d81 could not be found. Oct 19 03:32:44.578191 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:32:44.578191 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:32:44.586008 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:32:44.586008 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:32:44.586008 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:32:44.586008 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:32:44.586008 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:32:44.586008 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:32:44.586008 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70a327e7-5c86-4d2b-b7b2-3c18e4027d81 could not be found. Oct 19 03:32:44.586008 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:32:44.586008 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d32074e6-fa5b-4e6e-b02b-9056190713ac tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Returning 404 to user: Instance 70a327e7-5c86-4d2b-b7b2-3c18e4027d81 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:32:44.586008 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d32074e6-fa5b-4e6e-b02b-9056190713ac tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] 10.222.0.52 "GET /compute/v2.1/servers/70a327e7-5c86-4d2b-b7b2-3c18e4027d81" status: 404 len: 111 microversion: 2.1 time: 0.062160 Oct 19 03:32:44.586008 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2244/4398] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:32:44 2022] GET /compute/v2.1/servers/70a327e7-5c86-4d2b-b7b2-3c18e4027d81 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 03:32:44.599524 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a1ab01b4-fc31-4a5c-9f31-70bf2ea4c065 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:44.602023 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a1ab01b4-fc31-4a5c-9f31-70bf2ea4c065 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] [instance: 6fe11b03-fcac-4a7e-af1c-4ae425f2d548] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:44.616358 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a1ab01b4-fc31-4a5c-9f31-70bf2ea4c065 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:44.617219 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a1ab01b4-fc31-4a5c-9f31-70bf2ea4c065 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:44.621550 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a1ab01b4-fc31-4a5c-9f31-70bf2ea4c065 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:44.622548 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a1ab01b4-fc31-4a5c-9f31-70bf2ea4c065 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:44.623184 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a1ab01b4-fc31-4a5c-9f31-70bf2ea4c065 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:44.628195 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a1ab01b4-fc31-4a5c-9f31-70bf2ea4c065 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:44.686612 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ddb92c26-cc63-42d2-9ba3-ff16a3c906a2 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b748815c10a46d2adc26d5c8a1ba268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc49f9b6a0054092beda3ab313bff1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:44.697971 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ddb92c26-cc63-42d2-9ba3-ff16a3c906a2 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] 10.222.0.52 "GET /compute/v2.1/servers/eb87cd67-6681-435d-9a65-56a2a06aaccb" status: 200 len: 1321 microversion: 2.1 time: 0.370923 Oct 19 03:32:44.699684 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2155/4399] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:32:44 2022] GET /compute/v2.1/servers/eb87cd67-6681-435d-9a65-56a2a06aaccb => generated 1321 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:32:44.711276 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a5f23a04-70c8-4bc6-9b6b-e39c85925d24 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:44.716334 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a5f23a04-70c8-4bc6-9b6b-e39c85925d24 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 3893d3e4-3a09-4adf-951b-84befacf7489] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:44.735979 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a5f23a04-70c8-4bc6-9b6b-e39c85925d24 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:44.736570 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a5f23a04-70c8-4bc6-9b6b-e39c85925d24 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:44.737696 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a5f23a04-70c8-4bc6-9b6b-e39c85925d24 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:44.744772 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a5f23a04-70c8-4bc6-9b6b-e39c85925d24 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:44.745330 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a5f23a04-70c8-4bc6-9b6b-e39c85925d24 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:44.745884 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a5f23a04-70c8-4bc6-9b6b-e39c85925d24 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:44.989958 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a1ab01b4-fc31-4a5c-9f31-70bf2ea4c065 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15464bcbb944412bfab92df2d740dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1cd843801f48bebaccda875d5aa647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:45.031329 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a1ab01b4-fc31-4a5c-9f31-70bf2ea4c065 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] 10.222.0.52 "GET /compute/v2.1/servers/6fe11b03-fcac-4a7e-af1c-4ae425f2d548" status: 200 len: 1520 microversion: 2.1 time: 0.426924 Oct 19 03:32:45.035244 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2245/4400] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:32:44 2022] GET /compute/v2.1/servers/6fe11b03-fcac-4a7e-af1c-4ae425f2d548 => generated 1520 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:32:45.110933 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a5f23a04-70c8-4bc6-9b6b-e39c85925d24 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:45.124983 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a5f23a04-70c8-4bc6-9b6b-e39c85925d24 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/3893d3e4-3a09-4adf-951b-84befacf7489" status: 200 len: 1314 microversion: 2.1 time: 0.424255 Oct 19 03:32:45.127981 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2156/4401] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:32:44 2022] GET /compute/v2.1/servers/3893d3e4-3a09-4adf-951b-84befacf7489 => generated 1314 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:32:45.351290 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-8bdf1e3a-fc2c-4a67-a46f-0d55fad175aa tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:45.352846 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-8bdf1e3a-fc2c-4a67-a46f-0d55fad175aa tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] [instance: 2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:45.370349 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8bdf1e3a-fc2c-4a67-a46f-0d55fad175aa tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:45.375144 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8bdf1e3a-fc2c-4a67-a46f-0d55fad175aa tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:45.375782 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8bdf1e3a-fc2c-4a67-a46f-0d55fad175aa tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:45.377864 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8bdf1e3a-fc2c-4a67-a46f-0d55fad175aa tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:45.378525 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8bdf1e3a-fc2c-4a67-a46f-0d55fad175aa tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:45.379118 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8bdf1e3a-fc2c-4a67-a46f-0d55fad175aa tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:45.729268 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9f2dce2e-8d5d-45ae-a42e-ffac1c146df5 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:45.730318 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9f2dce2e-8d5d-45ae-a42e-ffac1c146df5 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] [instance: eb87cd67-6681-435d-9a65-56a2a06aaccb] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:45.744550 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9f2dce2e-8d5d-45ae-a42e-ffac1c146df5 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:45.748957 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9f2dce2e-8d5d-45ae-a42e-ffac1c146df5 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:45.750473 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9f2dce2e-8d5d-45ae-a42e-ffac1c146df5 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:45.754561 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9f2dce2e-8d5d-45ae-a42e-ffac1c146df5 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:45.755330 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9f2dce2e-8d5d-45ae-a42e-ffac1c146df5 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:45.756001 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9f2dce2e-8d5d-45ae-a42e-ffac1c146df5 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:45.909137 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-8bdf1e3a-fc2c-4a67-a46f-0d55fad175aa tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33d07a7db4846ababf001493c6e10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb0265509744c93b03fa5c28b4e9386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:45.923415 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-8bdf1e3a-fc2c-4a67-a46f-0d55fad175aa tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] 10.222.0.52 "GET /compute/v2.1/servers/2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62" status: 200 len: 1313 microversion: 2.1 time: 0.576452 Oct 19 03:32:45.924085 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2246/4402] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:32:45 2022] GET /compute/v2.1/servers/2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62 => generated 1313 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:32:46.060184 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d5ce1a8f-59cc-40e5-8e46-f8cc260a1f66 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:46.061051 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d5ce1a8f-59cc-40e5-8e46-f8cc260a1f66 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] [instance: 6fe11b03-fcac-4a7e-af1c-4ae425f2d548] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:46.076507 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d5ce1a8f-59cc-40e5-8e46-f8cc260a1f66 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:46.077267 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d5ce1a8f-59cc-40e5-8e46-f8cc260a1f66 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:46.078422 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d5ce1a8f-59cc-40e5-8e46-f8cc260a1f66 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:46.079496 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d5ce1a8f-59cc-40e5-8e46-f8cc260a1f66 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:46.080107 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d5ce1a8f-59cc-40e5-8e46-f8cc260a1f66 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:46.080693 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d5ce1a8f-59cc-40e5-8e46-f8cc260a1f66 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:46.265856 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9f2dce2e-8d5d-45ae-a42e-ffac1c146df5 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b748815c10a46d2adc26d5c8a1ba268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc49f9b6a0054092beda3ab313bff1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:46.284255 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9f2dce2e-8d5d-45ae-a42e-ffac1c146df5 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] 10.222.0.52 "GET /compute/v2.1/servers/eb87cd67-6681-435d-9a65-56a2a06aaccb" status: 200 len: 1321 microversion: 2.1 time: 0.561895 Oct 19 03:32:46.285832 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2157/4403] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:32:45 2022] GET /compute/v2.1/servers/eb87cd67-6681-435d-9a65-56a2a06aaccb => generated 1321 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:32:46.300813 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4bf23ca0-20bc-4e52-91aa-26cc3bd7888b tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:46.302161 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4bf23ca0-20bc-4e52-91aa-26cc3bd7888b tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 3893d3e4-3a09-4adf-951b-84befacf7489] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:46.331585 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4bf23ca0-20bc-4e52-91aa-26cc3bd7888b tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:46.334654 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4bf23ca0-20bc-4e52-91aa-26cc3bd7888b tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:46.334654 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4bf23ca0-20bc-4e52-91aa-26cc3bd7888b tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:46.335320 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4bf23ca0-20bc-4e52-91aa-26cc3bd7888b tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:46.337473 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4bf23ca0-20bc-4e52-91aa-26cc3bd7888b tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:46.338163 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4bf23ca0-20bc-4e52-91aa-26cc3bd7888b tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:46.536420 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d5ce1a8f-59cc-40e5-8e46-f8cc260a1f66 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15464bcbb944412bfab92df2d740dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1cd843801f48bebaccda875d5aa647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:46.548659 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d5ce1a8f-59cc-40e5-8e46-f8cc260a1f66 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] 10.222.0.52 "GET /compute/v2.1/servers/6fe11b03-fcac-4a7e-af1c-4ae425f2d548" status: 200 len: 1520 microversion: 2.1 time: 0.489492 Oct 19 03:32:46.549519 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2247/4404] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:32:46 2022] GET /compute/v2.1/servers/6fe11b03-fcac-4a7e-af1c-4ae425f2d548 => generated 1520 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:32:46.567744 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-a46038f6-c80d-4a7d-a570-c6e072730bf7 req-35204ef4-bfd2-4636-b6c7-ec35fea9b758 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3893d3e4-3a09-4adf-951b-84befacf7489", "name": "network-vif-plugged", "status": "completed", "tag": "f6bdd5bf-f5c9-4dc4-bb82-96c0e06519e1"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:32:46.585870 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-a46038f6-c80d-4a7d-a570-c6e072730bf7 req-35204ef4-bfd2-4636-b6c7-ec35fea9b758 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:46.586431 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-a46038f6-c80d-4a7d-a570-c6e072730bf7 req-35204ef4-bfd2-4636-b6c7-ec35fea9b758 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:46.586949 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-a46038f6-c80d-4a7d-a570-c6e072730bf7 req-35204ef4-bfd2-4636-b6c7-ec35fea9b758 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:46.613248 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-a46038f6-c80d-4a7d-a570-c6e072730bf7 req-35204ef4-bfd2-4636-b6c7-ec35fea9b758 service nova] Creating event network-vif-plugged:f6bdd5bf-f5c9-4dc4-bb82-96c0e06519e1 for instance 3893d3e4-3a09-4adf-951b-84befacf7489 on n-h1-861333-8 Oct 19 03:32:46.625303 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-a46038f6-c80d-4a7d-a570-c6e072730bf7 req-35204ef4-bfd2-4636-b6c7-ec35fea9b758 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072464 Oct 19 03:32:46.628025 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2248/4405] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:32:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:32:46.894598 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-4bf23ca0-20bc-4e52-91aa-26cc3bd7888b tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:46.902598 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4bf23ca0-20bc-4e52-91aa-26cc3bd7888b tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/3893d3e4-3a09-4adf-951b-84befacf7489" status: 200 len: 1314 microversion: 2.1 time: 0.612811 Oct 19 03:32:46.903230 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2158/4406] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:32:46 2022] GET /compute/v2.1/servers/3893d3e4-3a09-4adf-951b-84befacf7489 => generated 1314 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:32:46.956246 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-8d36707d-4840-4ff3-a5cd-61f3cbd46f00 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:46.957199 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-8d36707d-4840-4ff3-a5cd-61f3cbd46f00 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] [instance: 2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:46.964860 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8d36707d-4840-4ff3-a5cd-61f3cbd46f00 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:46.965585 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8d36707d-4840-4ff3-a5cd-61f3cbd46f00 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:46.966202 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8d36707d-4840-4ff3-a5cd-61f3cbd46f00 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:46.967086 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8d36707d-4840-4ff3-a5cd-61f3cbd46f00 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:46.968447 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8d36707d-4840-4ff3-a5cd-61f3cbd46f00 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:46.969155 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8d36707d-4840-4ff3-a5cd-61f3cbd46f00 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:47.313749 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e8238901-00f6-41f3-884f-fb02f7551fdf tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:47.314785 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e8238901-00f6-41f3-884f-fb02f7551fdf tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] [instance: eb87cd67-6681-435d-9a65-56a2a06aaccb] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:47.324987 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e8238901-00f6-41f3-884f-fb02f7551fdf tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:47.328963 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e8238901-00f6-41f3-884f-fb02f7551fdf tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:47.328963 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e8238901-00f6-41f3-884f-fb02f7551fdf tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:47.328963 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e8238901-00f6-41f3-884f-fb02f7551fdf tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:47.328963 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e8238901-00f6-41f3-884f-fb02f7551fdf tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:47.328963 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e8238901-00f6-41f3-884f-fb02f7551fdf tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:47.639602 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-8d36707d-4840-4ff3-a5cd-61f3cbd46f00 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33d07a7db4846ababf001493c6e10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb0265509744c93b03fa5c28b4e9386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:47.649961 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-8d36707d-4840-4ff3-a5cd-61f3cbd46f00 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] 10.222.0.52 "GET /compute/v2.1/servers/2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62" status: 200 len: 1313 microversion: 2.1 time: 0.699673 Oct 19 03:32:47.651732 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2249/4407] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:32:46 2022] GET /compute/v2.1/servers/2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62 => generated 1313 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:32:47.658258 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1a60c9dd-258b-4179-b5f7-27cdd64287c9 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:47.659091 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1a60c9dd-258b-4179-b5f7-27cdd64287c9 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] [instance: 6fe11b03-fcac-4a7e-af1c-4ae425f2d548] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:47.672209 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1a60c9dd-258b-4179-b5f7-27cdd64287c9 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:47.672744 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1a60c9dd-258b-4179-b5f7-27cdd64287c9 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:47.673168 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1a60c9dd-258b-4179-b5f7-27cdd64287c9 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:47.673908 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1a60c9dd-258b-4179-b5f7-27cdd64287c9 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:47.674362 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1a60c9dd-258b-4179-b5f7-27cdd64287c9 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:47.674798 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1a60c9dd-258b-4179-b5f7-27cdd64287c9 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:47.860912 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e8238901-00f6-41f3-884f-fb02f7551fdf tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b748815c10a46d2adc26d5c8a1ba268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc49f9b6a0054092beda3ab313bff1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:47.873401 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e8238901-00f6-41f3-884f-fb02f7551fdf tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] 10.222.0.52 "GET /compute/v2.1/servers/eb87cd67-6681-435d-9a65-56a2a06aaccb" status: 200 len: 1470 microversion: 2.1 time: 0.567080 Oct 19 03:32:47.878495 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2159/4408] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:32:47 2022] GET /compute/v2.1/servers/eb87cd67-6681-435d-9a65-56a2a06aaccb => generated 1470 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:32:47.962238 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-1a60c9dd-258b-4179-b5f7-27cdd64287c9 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15464bcbb944412bfab92df2d740dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1cd843801f48bebaccda875d5aa647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:47.971244 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1a60c9dd-258b-4179-b5f7-27cdd64287c9 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] 10.222.0.52 "GET /compute/v2.1/servers/6fe11b03-fcac-4a7e-af1c-4ae425f2d548" status: 200 len: 1520 microversion: 2.1 time: 0.318279 Oct 19 03:32:47.973808 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2250/4409] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:32:47 2022] GET /compute/v2.1/servers/6fe11b03-fcac-4a7e-af1c-4ae425f2d548 => generated 1520 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:32:47.979911 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-86ffb21d-ba51-4d1c-914a-5e62b181bbf9 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:47.982408 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-86ffb21d-ba51-4d1c-914a-5e62b181bbf9 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 3893d3e4-3a09-4adf-951b-84befacf7489] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:47.995320 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-86ffb21d-ba51-4d1c-914a-5e62b181bbf9 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:47.996408 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-86ffb21d-ba51-4d1c-914a-5e62b181bbf9 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:47.997010 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-86ffb21d-ba51-4d1c-914a-5e62b181bbf9 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:47.998181 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-86ffb21d-ba51-4d1c-914a-5e62b181bbf9 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:47.998794 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-86ffb21d-ba51-4d1c-914a-5e62b181bbf9 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:47.999437 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-86ffb21d-ba51-4d1c-914a-5e62b181bbf9 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:48.270843 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-86ffb21d-ba51-4d1c-914a-5e62b181bbf9 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:48.284116 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-86ffb21d-ba51-4d1c-914a-5e62b181bbf9 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/3893d3e4-3a09-4adf-951b-84befacf7489" status: 200 len: 1314 microversion: 2.1 time: 0.306399 Oct 19 03:32:48.288083 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2251/4410] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:32:47 2022] GET /compute/v2.1/servers/3893d3e4-3a09-4adf-951b-84befacf7489 => generated 1314 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:32:48.359684 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1c47588b-4e03-4e47-bec4-c42f87362741 tempest-ServersAdminNegativeTestJSON-1716371534 tempest-ServersAdminNegativeTestJSON-1716371534-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:32:48.360251 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1c47588b-4e03-4e47-bec4-c42f87362741 tempest-ServersAdminNegativeTestJSON-1716371534 tempest-ServersAdminNegativeTestJSON-1716371534-project-admin] [instance: 74904bd7-da7f-4529-a00d-a0f0d740b985] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:48.367973 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-1c47588b-4e03-4e47-bec4-c42f87362741 tempest-ServersAdminNegativeTestJSON-1716371534 tempest-ServersAdminNegativeTestJSON-1716371534-project-admin] HTTP exception thrown: Instance 74904bd7-da7f-4529-a00d-a0f0d740b985 could not be found. Oct 19 03:32:48.369585 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1c47588b-4e03-4e47-bec4-c42f87362741 tempest-ServersAdminNegativeTestJSON-1716371534 tempest-ServersAdminNegativeTestJSON-1716371534-project-admin] Request method failure captured: Oct 19 03:32:48.369585 n-d-861333-8 devstack@n-api.service[121134]: request: POST /compute/v2.1/servers/74904bd7-da7f-4529-a00d-a0f0d740b985/action HTTP/1.1 Oct 19 03:32:48.369585 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:32:48.369585 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:32:48.369585 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:32:48.369585 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 15 Oct 19 03:32:48.369585 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:32:48.369585 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:32:48.369585 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:32:48.369585 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:32:48.369585 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT2-6OQkmuXXeGnmybGM9n9uWz4Yu5twJWKgj1uL2LM1Ques3jMY69lUF37IJoUE_xe47lD6ERfwi1jYQABpj1Txn04mstLRqsJ9VKzIxBq_AkFisBMW5vCnXkxzb4PQK7U-TjWqvE40SjSNpXhKWpHcdtqNpZ05_wGtNEK1XCN_8-rc Oct 19 03:32:48.369585 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:32:48.369585 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:32:48.369585 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:32:48.369585 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:32:48.369585 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:32:48.369585 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:32:48.369585 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 60c24e25fed448cfa17977fd99d015d5 Oct 19 03:32:48.369585 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1716371534 Oct 19 03:32:48.369585 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member,admin Oct 19 03:32:48.369585 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member,admin Oct 19 03:32:48.369585 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/60c24e25fed448cfa17977fd99d015d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/60c24e25fed448cfa17977fd99d015d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/60c24e25fed448cfa17977fd99d015d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_60c24e25fed448cfa17977fd99d015d5", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:32:48.369585 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1716371534 Oct 19 03:32:48.369585 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 60c24e25fed448cfa17977fd99d015d5 Oct 19 03:32:48.369585 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1716371534 Oct 19 03:32:48.369585 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ServersAdminNegativeTestJSON-1716371534-project-admin Oct 19 03:32:48.369585 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:32:48.369585 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:32:48.369585 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 937cb8656d304a6f9523d638d15e23a6 Oct 19 03:32:48.369585 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1716371534-project-admin Oct 19 03:32:48.369585 n-d-861333-8 devstack@n-api.service[121134]: Oct 19 03:32:48.369585 n-d-861333-8 devstack@n-api.service[121134]: {"migrate": {}} Oct 19 03:32:48.369585 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:32:48.369585 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance 74904bd7-da7f-4529-a00d-a0f0d740b985 could not be found. Oct 19 03:32:48.369585 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '74904bd7-da7f-4529-a00d-a0f0d740b985', 'body': {'migrate': {}}} Oct 19 03:32:48.369585 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:32:48.369585 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:32:48.369585 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:32:48.369585 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:32:48.369585 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:32:48.369585 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:32:48.369585 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 19 03:32:48.369585 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 19 03:32:48.369585 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74904bd7-da7f-4529-a00d-a0f0d740b985 could not be found. Oct 19 03:32:48.369585 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:32:48.369585 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:32:48.369585 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:32:48.369585 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:32:48.369585 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:32:48.369585 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:32:48.369585 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:32:48.369585 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:32:48.369585 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:32:48.369585 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:32:48.369585 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:32:48.369585 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:32:48.369585 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Oct 19 03:32:48.369585 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Oct 19 03:32:48.369585 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:32:48.369585 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:32:48.369585 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74904bd7-da7f-4529-a00d-a0f0d740b985 could not be found. Oct 19 03:32:48.369585 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:32:48.369585 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:32:48.369585 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:32:48.369585 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:32:48.373619 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:32:48.373619 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:32:48.373619 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:32:48.373619 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:32:48.373619 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74904bd7-da7f-4529-a00d-a0f0d740b985 could not be found. Oct 19 03:32:48.373619 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:32:48.373619 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1c47588b-4e03-4e47-bec4-c42f87362741 tempest-ServersAdminNegativeTestJSON-1716371534 tempest-ServersAdminNegativeTestJSON-1716371534-project-admin] Returning 404 to user: Instance 74904bd7-da7f-4529-a00d-a0f0d740b985 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:32:48.373619 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1c47588b-4e03-4e47-bec4-c42f87362741 tempest-ServersAdminNegativeTestJSON-1716371534 tempest-ServersAdminNegativeTestJSON-1716371534-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/74904bd7-da7f-4529-a00d-a0f0d740b985/action" status: 404 len: 111 microversion: 2.1 time: 0.469165 Oct 19 03:32:48.393199 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2160/4411] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:32:47 2022] POST /compute/v2.1/servers/74904bd7-da7f-4529-a00d-a0f0d740b985/action => generated 111 bytes in 489 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 03:32:48.500190 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e35392c4-1aed-41a8-917b-7eb8664e9099 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1121616440", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:32:48.612106 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.network.neutron [None req-e35392c4-1aed-41a8-917b-7eb8664e9099 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] validate_networks() for None {{(pid=121135) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:32:48.680979 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e2f58b3d-6b70-4ac9-9004-f2419be2b477 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:48.683109 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e2f58b3d-6b70-4ac9-9004-f2419be2b477 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] [instance: 2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:48.712199 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e2f58b3d-6b70-4ac9-9004-f2419be2b477 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:48.714109 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e2f58b3d-6b70-4ac9-9004-f2419be2b477 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:48.718260 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e2f58b3d-6b70-4ac9-9004-f2419be2b477 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:48.721849 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e2f58b3d-6b70-4ac9-9004-f2419be2b477 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:48.722492 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e2f58b3d-6b70-4ac9-9004-f2419be2b477 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:48.724376 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e2f58b3d-6b70-4ac9-9004-f2419be2b477 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:49.102046 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-e35392c4-1aed-41a8-917b-7eb8664e9099 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Flavor limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:32:49.102524 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-e35392c4-1aed-41a8-917b-7eb8664e9099 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Image limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:32:49.102936 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-e35392c4-1aed-41a8-917b-7eb8664e9099 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Flavor pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:32:49.103507 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-e35392c4-1aed-41a8-917b-7eb8664e9099 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Image pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:32:49.104567 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-e35392c4-1aed-41a8-917b-7eb8664e9099 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:32:49.125443 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e35392c4-1aed-41a8-917b-7eb8664e9099 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:49.129612 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e35392c4-1aed-41a8-917b-7eb8664e9099 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:49.130250 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e35392c4-1aed-41a8-917b-7eb8664e9099 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:49.132016 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e35392c4-1aed-41a8-917b-7eb8664e9099 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:49.134254 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e35392c4-1aed-41a8-917b-7eb8664e9099 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:49.136196 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e35392c4-1aed-41a8-917b-7eb8664e9099 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:49.152165 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e2f58b3d-6b70-4ac9-9004-f2419be2b477 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33d07a7db4846ababf001493c6e10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb0265509744c93b03fa5c28b4e9386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:49.158542 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e2f58b3d-6b70-4ac9-9004-f2419be2b477 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] 10.222.0.52 "GET /compute/v2.1/servers/2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62" status: 200 len: 1313 microversion: 2.1 time: 0.487643 Oct 19 03:32:49.161613 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2161/4412] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:32:48 2022] GET /compute/v2.1/servers/2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62 => generated 1313 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:32:49.173385 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-e35392c4-1aed-41a8-917b-7eb8664e9099 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Getting quotas for project dc49f9b6a0054092beda3ab313bff1b9. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:32:49.181061 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-de265f59-df67-4ae8-bc2c-884b7b1b116c tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:49.181854 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-de265f59-df67-4ae8-bc2c-884b7b1b116c tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] [instance: 6fe11b03-fcac-4a7e-af1c-4ae425f2d548] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:49.190320 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-de265f59-df67-4ae8-bc2c-884b7b1b116c tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:49.194943 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-e35392c4-1aed-41a8-917b-7eb8664e9099 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Getting quotas for user 4b748815c10a46d2adc26d5c8a1ba268 and project dc49f9b6a0054092beda3ab313bff1b9. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:32:49.195842 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-de265f59-df67-4ae8-bc2c-884b7b1b116c tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:49.196527 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-de265f59-df67-4ae8-bc2c-884b7b1b116c tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:49.197515 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-de265f59-df67-4ae8-bc2c-884b7b1b116c tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:49.198187 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-de265f59-df67-4ae8-bc2c-884b7b1b116c tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:49.198859 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-de265f59-df67-4ae8-bc2c-884b7b1b116c tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:49.231985 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e35392c4-1aed-41a8-917b-7eb8664e9099 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Going to run 1 instances... {{(pid=121135) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:32:49.234736 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e35392c4-1aed-41a8-917b-7eb8664e9099 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] [instance: a1c0df8b-0120-47bc-92da-36d257f61c8b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121135) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:32:49.355654 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-de265f59-df67-4ae8-bc2c-884b7b1b116c tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15464bcbb944412bfab92df2d740dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1cd843801f48bebaccda875d5aa647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:49.364235 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-de265f59-df67-4ae8-bc2c-884b7b1b116c tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] 10.222.0.52 "GET /compute/v2.1/servers/6fe11b03-fcac-4a7e-af1c-4ae425f2d548" status: 200 len: 1478 microversion: 2.1 time: 0.198096 Oct 19 03:32:49.380942 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2162/4413] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:32:49 2022] GET /compute/v2.1/servers/6fe11b03-fcac-4a7e-af1c-4ae425f2d548 => generated 1478 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:32:49.391340 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-ab1e99eb-c3a9-4e11-8422-d8d25cdbcd1a req-13576112-6b9f-4dd1-94d6-a565c2c79b88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fe11b03-fcac-4a7e-af1c-4ae425f2d548", "name": "network-vif-deleted", "tag": "1fa56810-33c9-47c1-b22f-2af5be2dec70"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:32:49.422187 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e35392c4-1aed-41a8-917b-7eb8664e9099 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.925998 Oct 19 03:32:49.429519 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-ab1e99eb-c3a9-4e11-8422-d8d25cdbcd1a req-13576112-6b9f-4dd1-94d6-a565c2c79b88 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:49.433199 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2252/4414] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:32:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 938 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 03:32:49.434127 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-ab1e99eb-c3a9-4e11-8422-d8d25cdbcd1a req-13576112-6b9f-4dd1-94d6-a565c2c79b88 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:49.437836 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-ab1e99eb-c3a9-4e11-8422-d8d25cdbcd1a req-13576112-6b9f-4dd1-94d6-a565c2c79b88 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:49.442801 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-196945bf-5143-45f9-a954-025a086689ff tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:49.443431 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-196945bf-5143-45f9-a954-025a086689ff tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 3893d3e4-3a09-4adf-951b-84befacf7489] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:49.460833 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-196945bf-5143-45f9-a954-025a086689ff tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:49.461422 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-196945bf-5143-45f9-a954-025a086689ff tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:49.461869 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-196945bf-5143-45f9-a954-025a086689ff tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:49.462598 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-196945bf-5143-45f9-a954-025a086689ff tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:49.466426 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-196945bf-5143-45f9-a954-025a086689ff tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:49.466426 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-196945bf-5143-45f9-a954-025a086689ff tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:49.466708 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-ab1e99eb-c3a9-4e11-8422-d8d25cdbcd1a req-13576112-6b9f-4dd1-94d6-a565c2c79b88 service nova] Creating event network-vif-deleted:1fa56810-33c9-47c1-b22f-2af5be2dec70 for instance 6fe11b03-fcac-4a7e-af1c-4ae425f2d548 on n-h1-861333-8 Oct 19 03:32:49.472687 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-ab1e99eb-c3a9-4e11-8422-d8d25cdbcd1a req-13576112-6b9f-4dd1-94d6-a565c2c79b88 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089665 Oct 19 03:32:49.490649 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2163/4415] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:32:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:32:49.503878 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a45742ac-db19-42e5-ab0e-c33b169a8e25 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:49.508676 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a45742ac-db19-42e5-ab0e-c33b169a8e25 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] [instance: a1c0df8b-0120-47bc-92da-36d257f61c8b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:49.613114 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a45742ac-db19-42e5-ab0e-c33b169a8e25 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b748815c10a46d2adc26d5c8a1ba268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc49f9b6a0054092beda3ab313bff1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:49.620616 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a45742ac-db19-42e5-ab0e-c33b169a8e25 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] 10.222.0.52 "GET /compute/v2.1/servers/a1c0df8b-0120-47bc-92da-36d257f61c8b" status: 200 len: 1222 microversion: 2.1 time: 0.128459 Oct 19 03:32:49.624856 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2164/4416] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:32:49 2022] GET /compute/v2.1/servers/a1c0df8b-0120-47bc-92da-36d257f61c8b => generated 1222 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:32:50.190806 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b6e23d00-6254-4237-93f1-e9c3feb3ce13 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:50.191453 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b6e23d00-6254-4237-93f1-e9c3feb3ce13 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] [instance: 2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:50.203096 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b6e23d00-6254-4237-93f1-e9c3feb3ce13 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:50.203611 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b6e23d00-6254-4237-93f1-e9c3feb3ce13 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:50.204057 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b6e23d00-6254-4237-93f1-e9c3feb3ce13 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:50.209069 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b6e23d00-6254-4237-93f1-e9c3feb3ce13 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:50.209069 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b6e23d00-6254-4237-93f1-e9c3feb3ce13 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:50.209069 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b6e23d00-6254-4237-93f1-e9c3feb3ce13 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:51.103980 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-196945bf-5143-45f9-a954-025a086689ff tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:51.114939 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-196945bf-5143-45f9-a954-025a086689ff tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/3893d3e4-3a09-4adf-951b-84befacf7489" status: 200 len: 1501 microversion: 2.1 time: 1.680572 Oct 19 03:32:51.120356 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2253/4417] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:32:49 2022] GET /compute/v2.1/servers/3893d3e4-3a09-4adf-951b-84befacf7489 => generated 1501 bytes in 1687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:32:51.140756 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-a9d34fd6-86f0-4259-b8bc-03b3a7dcc589 req-fda59c5f-9ba0-4e26-ab35-88235ba77dc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62", "name": "network-vif-plugged", "status": "completed", "tag": "7dac7931-fc74-4a9a-a0b2-14471003659c"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:32:51.159319 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-a9d34fd6-86f0-4259-b8bc-03b3a7dcc589 req-fda59c5f-9ba0-4e26-ab35-88235ba77dc4 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:51.159909 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-a9d34fd6-86f0-4259-b8bc-03b3a7dcc589 req-fda59c5f-9ba0-4e26-ab35-88235ba77dc4 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:51.160420 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-a9d34fd6-86f0-4259-b8bc-03b3a7dcc589 req-fda59c5f-9ba0-4e26-ab35-88235ba77dc4 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:51.180618 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-a9d34fd6-86f0-4259-b8bc-03b3a7dcc589 req-fda59c5f-9ba0-4e26-ab35-88235ba77dc4 service nova] Creating event network-vif-plugged:7dac7931-fc74-4a9a-a0b2-14471003659c for instance 2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62 on n-h2-861333-8 Oct 19 03:32:51.188087 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-a9d34fd6-86f0-4259-b8bc-03b3a7dcc589 req-fda59c5f-9ba0-4e26-ab35-88235ba77dc4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064817 Oct 19 03:32:51.195804 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2254/4418] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:32:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:32:51.302436 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b6e23d00-6254-4237-93f1-e9c3feb3ce13 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33d07a7db4846ababf001493c6e10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb0265509744c93b03fa5c28b4e9386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:51.315326 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b6e23d00-6254-4237-93f1-e9c3feb3ce13 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] 10.222.0.52 "GET /compute/v2.1/servers/2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62" status: 200 len: 1313 microversion: 2.1 time: 1.131393 Oct 19 03:32:51.316893 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2165/4419] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:32:50 2022] GET /compute/v2.1/servers/2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62 => generated 1313 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:32:51.344380 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-63515e0e-e955-49e3-abd6-8e9f0a6b6448 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:51.346083 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-63515e0e-e955-49e3-abd6-8e9f0a6b6448 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] [instance: 6fe11b03-fcac-4a7e-af1c-4ae425f2d548] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:51.371144 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-63515e0e-e955-49e3-abd6-8e9f0a6b6448 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:51.374851 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-63515e0e-e955-49e3-abd6-8e9f0a6b6448 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:51.380056 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-63515e0e-e955-49e3-abd6-8e9f0a6b6448 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:51.380056 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-63515e0e-e955-49e3-abd6-8e9f0a6b6448 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:51.383919 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-63515e0e-e955-49e3-abd6-8e9f0a6b6448 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:51.388511 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-63515e0e-e955-49e3-abd6-8e9f0a6b6448 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:51.442771 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-63515e0e-e955-49e3-abd6-8e9f0a6b6448 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] HTTP exception thrown: Instance 6fe11b03-fcac-4a7e-af1c-4ae425f2d548 could not be found. Oct 19 03:32:51.442771 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-63515e0e-e955-49e3-abd6-8e9f0a6b6448 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Request method failure captured: Oct 19 03:32:51.442771 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/6fe11b03-fcac-4a7e-af1c-4ae425f2d548 HTTP/1.1 Oct 19 03:32:51.442771 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:32:51.442771 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:32:51.442771 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:32:51.442771 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:32:51.442771 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:32:51.442771 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:32:51.442771 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:32:51.442771 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:32:51.442771 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT2-r77bNhnlUcEvHp0HPVacCbcATag_3w1CV70F2EvBNcADEoM7Ow93nOGG_fDqN5MWrI5LJ8l8LnMbbKcV-NFNnQ2RtocSElieEI0uDhr6jpWCBt8RWBl1RovgywxTkOk4_ykh3reYAjkq498dGDhCBAKa6GZQzjB21G7GpieP4IWo Oct 19 03:32:51.442771 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:32:51.442771 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:32:51.442771 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:32:51.442771 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:32:51.442771 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:32:51.442771 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:32:51.442771 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: ba1cd843801f48bebaccda875d5aa647 Oct 19 03:32:51.442771 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ListServersNegativeTestJSON-1678437181 Oct 19 03:32:51.442771 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:32:51.442771 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:32:51.442771 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ba1cd843801f48bebaccda875d5aa647"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ba1cd843801f48bebaccda875d5aa647"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ba1cd843801f48bebaccda875d5aa647"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ba1cd843801f48bebaccda875d5aa647", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:32:51.442771 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ListServersNegativeTestJSON-1678437181 Oct 19 03:32:51.442771 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: ba1cd843801f48bebaccda875d5aa647 Oct 19 03:32:51.442771 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1678437181 Oct 19 03:32:51.442771 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ListServersNegativeTestJSON-1678437181-project Oct 19 03:32:51.442771 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:32:51.442771 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:32:51.442771 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: b15464bcbb944412bfab92df2d740dc5 Oct 19 03:32:51.442771 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ListServersNegativeTestJSON-1678437181-project Oct 19 03:32:51.442771 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:32:51.442771 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance 6fe11b03-fcac-4a7e-af1c-4ae425f2d548 could not be found. Oct 19 03:32:51.442771 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '6fe11b03-fcac-4a7e-af1c-4ae425f2d548'} Oct 19 03:32:51.442771 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:32:51.442771 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:32:51.442771 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:32:51.442771 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:32:51.442771 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:32:51.442771 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:32:51.442771 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:32:51.442771 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:32:51.442771 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:32:51.442771 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:32:51.442771 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6fe11b03-fcac-4a7e-af1c-4ae425f2d548 could not be found. Oct 19 03:32:51.442771 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:32:51.442771 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:32:51.442771 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:32:51.442771 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:32:51.442771 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:32:51.442771 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:32:51.442771 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:32:51.442771 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:32:51.442771 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:32:51.442771 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:32:51.442771 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:32:51.442771 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:32:51.442771 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:32:51.442771 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:32:51.442771 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:32:51.447038 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:32:51.447038 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6fe11b03-fcac-4a7e-af1c-4ae425f2d548 could not be found. Oct 19 03:32:51.447038 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:32:51.447038 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:32:51.447038 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:32:51.447038 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:32:51.447038 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:32:51.447038 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:32:51.447038 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:32:51.447038 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:32:51.447038 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6fe11b03-fcac-4a7e-af1c-4ae425f2d548 could not be found. Oct 19 03:32:51.447038 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:32:51.447038 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-63515e0e-e955-49e3-abd6-8e9f0a6b6448 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Returning 404 to user: Instance 6fe11b03-fcac-4a7e-af1c-4ae425f2d548 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:32:51.447038 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-63515e0e-e955-49e3-abd6-8e9f0a6b6448 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] 10.222.0.52 "GET /compute/v2.1/servers/6fe11b03-fcac-4a7e-af1c-4ae425f2d548" status: 404 len: 111 microversion: 2.1 time: 0.109697 Oct 19 03:32:51.447038 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2166/4420] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:32:51 2022] GET /compute/v2.1/servers/6fe11b03-fcac-4a7e-af1c-4ae425f2d548 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:32:51.455947 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-40c41d94-01ec-4fd0-b89e-89b667259e3e tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:51.456758 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-40c41d94-01ec-4fd0-b89e-89b667259e3e tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] [instance: a1c0df8b-0120-47bc-92da-36d257f61c8b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:51.479507 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-40c41d94-01ec-4fd0-b89e-89b667259e3e tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:51.483139 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-40c41d94-01ec-4fd0-b89e-89b667259e3e tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:51.483770 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-40c41d94-01ec-4fd0-b89e-89b667259e3e tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:51.484609 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-40c41d94-01ec-4fd0-b89e-89b667259e3e tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:51.487224 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-40c41d94-01ec-4fd0-b89e-89b667259e3e tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:51.487803 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-40c41d94-01ec-4fd0-b89e-89b667259e3e tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:51.698874 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1ed40f0e-d4a1-4d9e-a355-20a74a6e2d09 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-1677664745", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "networks": [{"uuid": "3f274025-4319-407b-9be8-583c73eb4163"}]}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:32:51.705897 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-40c41d94-01ec-4fd0-b89e-89b667259e3e tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b748815c10a46d2adc26d5c8a1ba268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc49f9b6a0054092beda3ab313bff1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:51.719710 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-40c41d94-01ec-4fd0-b89e-89b667259e3e tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] 10.222.0.52 "GET /compute/v2.1/servers/a1c0df8b-0120-47bc-92da-36d257f61c8b" status: 200 len: 1226 microversion: 2.1 time: 0.273358 Oct 19 03:32:51.720478 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2167/4421] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:32:51 2022] GET /compute/v2.1/servers/a1c0df8b-0120-47bc-92da-36d257f61c8b => generated 1226 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:32:51.731372 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b53c7d4e-6559-423f-a90e-2aaa84ab8cb7 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:32:51.735183 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b53c7d4e-6559-423f-a90e-2aaa84ab8cb7 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 3893d3e4-3a09-4adf-951b-84befacf7489] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:51.753307 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b53c7d4e-6559-423f-a90e-2aaa84ab8cb7 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:51.757140 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b53c7d4e-6559-423f-a90e-2aaa84ab8cb7 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:51.759406 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b53c7d4e-6559-423f-a90e-2aaa84ab8cb7 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:51.760367 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b53c7d4e-6559-423f-a90e-2aaa84ab8cb7 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:51.760993 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b53c7d4e-6559-423f-a90e-2aaa84ab8cb7 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:51.764337 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b53c7d4e-6559-423f-a90e-2aaa84ab8cb7 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:51.794668 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.network.neutron [None req-1ed40f0e-d4a1-4d9e-a355-20a74a6e2d09 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] validate_networks() for [('3f274025-4319-407b-9be8-583c73eb4163', None, None, None, None, None)] {{(pid=121135) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:32:51.844715 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b53c7d4e-6559-423f-a90e-2aaa84ab8cb7 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "POST /compute/v2.1/servers/3893d3e4-3a09-4adf-951b-84befacf7489/action" status: 200 len: 14 microversion: 2.1 time: 0.121000 Oct 19 03:32:51.845527 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2168/4422] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:32:51 2022] POST /compute/v2.1/servers/3893d3e4-3a09-4adf-951b-84befacf7489/action => generated 14 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 03:32:51.855480 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-217acc92-7bea-41c5-9311-80bb090567a2 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:51.856338 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-217acc92-7bea-41c5-9311-80bb090567a2 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] [instance: 4851555c-a35e-4277-ab6e-3099b6e8a72b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:51.864037 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-217acc92-7bea-41c5-9311-80bb090567a2 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:51.864470 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-217acc92-7bea-41c5-9311-80bb090567a2 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:51.864914 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-217acc92-7bea-41c5-9311-80bb090567a2 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:51.866235 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-217acc92-7bea-41c5-9311-80bb090567a2 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:51.866701 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-217acc92-7bea-41c5-9311-80bb090567a2 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:51.867135 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-217acc92-7bea-41c5-9311-80bb090567a2 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:51.882225 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-217acc92-7bea-41c5-9311-80bb090567a2 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] HTTP exception thrown: Instance 4851555c-a35e-4277-ab6e-3099b6e8a72b could not be found. Oct 19 03:32:51.884025 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-217acc92-7bea-41c5-9311-80bb090567a2 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Request method failure captured: Oct 19 03:32:51.884025 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/4851555c-a35e-4277-ab6e-3099b6e8a72b HTTP/1.1 Oct 19 03:32:51.884025 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:32:51.884025 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:32:51.884025 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:32:51.884025 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:32:51.884025 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:32:51.884025 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:32:51.884025 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:32:51.884025 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:32:51.884025 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT2-r77bNhnlUcEvHp0HPVacCbcATag_3w1CV70F2EvBNcADEoM7Ow93nOGG_fDqN5MWrI5LJ8l8LnMbbKcV-NFNnQ2RtocSElieEI0uDhr6jpWCBt8RWBl1RovgywxTkOk4_ykh3reYAjkq498dGDhCBAKa6GZQzjB21G7GpieP4IWo Oct 19 03:32:51.884025 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:32:51.884025 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:32:51.884025 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:32:51.884025 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:32:51.884025 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:32:51.884025 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:32:51.884025 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: ba1cd843801f48bebaccda875d5aa647 Oct 19 03:32:51.884025 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ListServersNegativeTestJSON-1678437181 Oct 19 03:32:51.884025 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:32:51.884025 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:32:51.884025 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ba1cd843801f48bebaccda875d5aa647"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ba1cd843801f48bebaccda875d5aa647"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ba1cd843801f48bebaccda875d5aa647"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ba1cd843801f48bebaccda875d5aa647", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:32:51.884025 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ListServersNegativeTestJSON-1678437181 Oct 19 03:32:51.884025 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: ba1cd843801f48bebaccda875d5aa647 Oct 19 03:32:51.884025 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1678437181 Oct 19 03:32:51.884025 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ListServersNegativeTestJSON-1678437181-project Oct 19 03:32:51.884025 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:32:51.884025 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:32:51.884025 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: b15464bcbb944412bfab92df2d740dc5 Oct 19 03:32:51.884025 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ListServersNegativeTestJSON-1678437181-project Oct 19 03:32:51.884025 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:32:51.884025 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance 4851555c-a35e-4277-ab6e-3099b6e8a72b could not be found. Oct 19 03:32:51.884025 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '4851555c-a35e-4277-ab6e-3099b6e8a72b'} Oct 19 03:32:51.884025 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:32:51.884025 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:32:51.884025 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:32:51.884025 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:32:51.884025 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:32:51.884025 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:32:51.884025 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:32:51.884025 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:32:51.884025 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:32:51.884025 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:32:51.884025 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4851555c-a35e-4277-ab6e-3099b6e8a72b could not be found. Oct 19 03:32:51.884025 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:32:51.884025 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:32:51.884025 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:32:51.884025 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:32:51.884025 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:32:51.884025 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:32:51.884025 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:32:51.884025 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:32:51.884025 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:32:51.884025 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:32:51.884025 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:32:51.884025 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:32:51.884025 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:32:51.884025 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:32:51.884025 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:32:51.884025 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:32:51.884025 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4851555c-a35e-4277-ab6e-3099b6e8a72b could not be found. Oct 19 03:32:51.884025 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:32:51.884025 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:32:51.888424 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:32:51.888424 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:32:51.888424 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:32:51.888424 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:32:51.888424 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:32:51.888424 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:32:51.888424 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4851555c-a35e-4277-ab6e-3099b6e8a72b could not be found. Oct 19 03:32:51.888424 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:32:51.888424 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-217acc92-7bea-41c5-9311-80bb090567a2 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] Returning 404 to user: Instance 4851555c-a35e-4277-ab6e-3099b6e8a72b could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:32:51.888424 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-217acc92-7bea-41c5-9311-80bb090567a2 tempest-ListServersNegativeTestJSON-1678437181 tempest-ListServersNegativeTestJSON-1678437181-project] 10.222.0.52 "GET /compute/v2.1/servers/4851555c-a35e-4277-ab6e-3099b6e8a72b" status: 404 len: 111 microversion: 2.1 time: 0.038717 Oct 19 03:32:51.888424 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2169/4423] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:32:51 2022] GET /compute/v2.1/servers/4851555c-a35e-4277-ab6e-3099b6e8a72b => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:32:51.893704 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-ab90bc44-e51b-4a38-8030-d272f7d5a5a5 req-59f44394-b86b-4633-828d-cc76ee1bb363 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4851555c-a35e-4277-ab6e-3099b6e8a72b", "name": "network-vif-deleted", "tag": "6e236f5f-c9bc-4fcf-90f3-65a1eb03ff9a"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:32:51.906802 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-ab90bc44-e51b-4a38-8030-d272f7d5a5a5 req-59f44394-b86b-4633-828d-cc76ee1bb363 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:51.907648 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-ab90bc44-e51b-4a38-8030-d272f7d5a5a5 req-59f44394-b86b-4633-828d-cc76ee1bb363 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:51.908415 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-ab90bc44-e51b-4a38-8030-d272f7d5a5a5 req-59f44394-b86b-4633-828d-cc76ee1bb363 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:51.923579 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-ab90bc44-e51b-4a38-8030-d272f7d5a5a5 req-59f44394-b86b-4633-828d-cc76ee1bb363 service nova] Creating event network-vif-deleted:6e236f5f-c9bc-4fcf-90f3-65a1eb03ff9a for instance 4851555c-a35e-4277-ab6e-3099b6e8a72b on n-h2-861333-8 Oct 19 03:32:51.938937 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-ab90bc44-e51b-4a38-8030-d272f7d5a5a5 req-59f44394-b86b-4633-828d-cc76ee1bb363 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047992 Oct 19 03:32:51.938937 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2170/4424] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:32:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:32:52.341807 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e69bfa55-aa06-4cad-bd61-64805d728f2a tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:52.342700 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e69bfa55-aa06-4cad-bd61-64805d728f2a tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] [instance: 2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:52.355225 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e69bfa55-aa06-4cad-bd61-64805d728f2a tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:52.357688 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e69bfa55-aa06-4cad-bd61-64805d728f2a tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:52.358367 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e69bfa55-aa06-4cad-bd61-64805d728f2a tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:52.381271 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e69bfa55-aa06-4cad-bd61-64805d728f2a tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:52.385562 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e69bfa55-aa06-4cad-bd61-64805d728f2a tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:52.386901 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e69bfa55-aa06-4cad-bd61-64805d728f2a tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:52.930556 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e69bfa55-aa06-4cad-bd61-64805d728f2a tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33d07a7db4846ababf001493c6e10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb0265509744c93b03fa5c28b4e9386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:52.942639 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e69bfa55-aa06-4cad-bd61-64805d728f2a tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] 10.222.0.52 "GET /compute/v2.1/servers/2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62" status: 200 len: 1313 microversion: 2.1 time: 0.605985 Oct 19 03:32:52.944760 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2171/4425] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:32:52 2022] GET /compute/v2.1/servers/2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62 => generated 1313 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:32:52.956638 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-71cd8ba2-26c3-4452-879b-bad29e0374d1 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:52.959830 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-71cd8ba2-26c3-4452-879b-bad29e0374d1 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] [instance: a1c0df8b-0120-47bc-92da-36d257f61c8b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:52.974437 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=12 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:32:52.979782 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-71cd8ba2-26c3-4452-879b-bad29e0374d1 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:52.980311 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-71cd8ba2-26c3-4452-879b-bad29e0374d1 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:52.980762 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-71cd8ba2-26c3-4452-879b-bad29e0374d1 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:52.996776 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-71cd8ba2-26c3-4452-879b-bad29e0374d1 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:52.997344 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-71cd8ba2-26c3-4452-879b-bad29e0374d1 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:52.997878 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-71cd8ba2-26c3-4452-879b-bad29e0374d1 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:53.070714 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-1ed40f0e-d4a1-4d9e-a355-20a74a6e2d09 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Flavor limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:32:53.071261 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-1ed40f0e-d4a1-4d9e-a355-20a74a6e2d09 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Image limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:32:53.075561 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-1ed40f0e-d4a1-4d9e-a355-20a74a6e2d09 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Flavor pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:32:53.075561 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-1ed40f0e-d4a1-4d9e-a355-20a74a6e2d09 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Image pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:32:53.075561 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-1ed40f0e-d4a1-4d9e-a355-20a74a6e2d09 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:32:53.091115 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1ed40f0e-d4a1-4d9e-a355-20a74a6e2d09 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:53.093280 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1ed40f0e-d4a1-4d9e-a355-20a74a6e2d09 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:53.094258 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1ed40f0e-d4a1-4d9e-a355-20a74a6e2d09 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:53.096865 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1ed40f0e-d4a1-4d9e-a355-20a74a6e2d09 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:53.097439 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1ed40f0e-d4a1-4d9e-a355-20a74a6e2d09 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:53.097875 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1ed40f0e-d4a1-4d9e-a355-20a74a6e2d09 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:53.140335 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-71cd8ba2-26c3-4452-879b-bad29e0374d1 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b748815c10a46d2adc26d5c8a1ba268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc49f9b6a0054092beda3ab313bff1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:53.162941 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-1ed40f0e-d4a1-4d9e-a355-20a74a6e2d09 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Getting quotas for project eec35cc1c3324178b6314ed3272aa8cd. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:32:53.164178 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-71cd8ba2-26c3-4452-879b-bad29e0374d1 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] 10.222.0.52 "GET /compute/v2.1/servers/a1c0df8b-0120-47bc-92da-36d257f61c8b" status: 200 len: 1274 microversion: 2.1 time: 0.215073 Oct 19 03:32:53.181649 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2172/4426] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:32:52 2022] GET /compute/v2.1/servers/a1c0df8b-0120-47bc-92da-36d257f61c8b => generated 1274 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:32:53.185996 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f91d8c15-f1c3-409a-8b05-258e7557548e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:32:53.191033 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-1ed40f0e-d4a1-4d9e-a355-20a74a6e2d09 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Getting quotas for user d51efba80d21425aa86baa138fb99770 and project eec35cc1c3324178b6314ed3272aa8cd. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:32:53.198178 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f91d8c15-f1c3-409a-8b05-258e7557548e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 3893d3e4-3a09-4adf-951b-84befacf7489] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:53.227420 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1ed40f0e-d4a1-4d9e-a355-20a74a6e2d09 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Going to run 1 instances... {{(pid=121135) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:32:53.227420 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1ed40f0e-d4a1-4d9e-a355-20a74a6e2d09 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] [instance: 61edfb81-28c2-4818-bb73-b141c418e6b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121135) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:32:53.228213 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f91d8c15-f1c3-409a-8b05-258e7557548e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:53.228213 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f91d8c15-f1c3-409a-8b05-258e7557548e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:53.228213 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f91d8c15-f1c3-409a-8b05-258e7557548e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:53.228213 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f91d8c15-f1c3-409a-8b05-258e7557548e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:53.228213 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f91d8c15-f1c3-409a-8b05-258e7557548e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:53.228213 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f91d8c15-f1c3-409a-8b05-258e7557548e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:53.325790 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f91d8c15-f1c3-409a-8b05-258e7557548e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "POST /compute/v2.1/servers/3893d3e4-3a09-4adf-951b-84befacf7489/action" status: 200 len: 14 microversion: 2.1 time: 0.156764 Oct 19 03:32:53.329063 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2173/4427] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:32:53 2022] POST /compute/v2.1/servers/3893d3e4-3a09-4adf-951b-84befacf7489/action => generated 14 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 03:32:53.430791 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1ed40f0e-d4a1-4d9e-a355-20a74a6e2d09 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.233501 Oct 19 03:32:53.436211 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2255/4428] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:32:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 2239 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 03:32:53.443906 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7fed8e92-52db-4ae6-aafd-35f2bfe64c2e tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:53.445505 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7fed8e92-52db-4ae6-aafd-35f2bfe64c2e tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] [instance: 61edfb81-28c2-4818-bb73-b141c418e6b0] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:53.684886 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-7fed8e92-52db-4ae6-aafd-35f2bfe64c2e tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51efba80d21425aa86baa138fb99770', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec35cc1c3324178b6314ed3272aa8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:53.699688 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7fed8e92-52db-4ae6-aafd-35f2bfe64c2e tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] 10.222.0.52 "GET /compute/v2.1/servers/61edfb81-28c2-4818-bb73-b141c418e6b0" status: 200 len: 1228 microversion: 2.1 time: 0.256710 Oct 19 03:32:53.702140 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2174/4429] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:32:53 2022] GET /compute/v2.1/servers/61edfb81-28c2-4818-bb73-b141c418e6b0 => generated 1228 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:32:53.970867 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b577bc34-a677-4a2f-8e07-c9684e189ddd tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:53.971492 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b577bc34-a677-4a2f-8e07-c9684e189ddd tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] [instance: 2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:54.002222 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b577bc34-a677-4a2f-8e07-c9684e189ddd tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:54.003045 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b577bc34-a677-4a2f-8e07-c9684e189ddd tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:54.003701 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b577bc34-a677-4a2f-8e07-c9684e189ddd tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:54.004641 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b577bc34-a677-4a2f-8e07-c9684e189ddd tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:54.005346 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b577bc34-a677-4a2f-8e07-c9684e189ddd tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:54.006808 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b577bc34-a677-4a2f-8e07-c9684e189ddd tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:54.237090 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-efa62539-689f-454f-b5e8-bade24bedbef tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:54.237453 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-efa62539-689f-454f-b5e8-bade24bedbef tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] [instance: a1c0df8b-0120-47bc-92da-36d257f61c8b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:54.260793 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-efa62539-689f-454f-b5e8-bade24bedbef tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:54.270059 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-efa62539-689f-454f-b5e8-bade24bedbef tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:54.272435 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-efa62539-689f-454f-b5e8-bade24bedbef tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:54.275903 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-efa62539-689f-454f-b5e8-bade24bedbef tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:54.279490 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-efa62539-689f-454f-b5e8-bade24bedbef tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:54.280009 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-efa62539-689f-454f-b5e8-bade24bedbef tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:54.462576 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-efa62539-689f-454f-b5e8-bade24bedbef tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b748815c10a46d2adc26d5c8a1ba268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc49f9b6a0054092beda3ab313bff1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:54.465726 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b577bc34-a677-4a2f-8e07-c9684e189ddd tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33d07a7db4846ababf001493c6e10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb0265509744c93b03fa5c28b4e9386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:54.477731 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b577bc34-a677-4a2f-8e07-c9684e189ddd tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] 10.222.0.52 "GET /compute/v2.1/servers/2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62" status: 200 len: 1499 microversion: 2.1 time: 0.511528 Oct 19 03:32:54.486447 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2256/4430] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:32:53 2022] GET /compute/v2.1/servers/2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62 => generated 1499 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:32:54.501434 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-efa62539-689f-454f-b5e8-bade24bedbef tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] 10.222.0.52 "GET /compute/v2.1/servers/a1c0df8b-0120-47bc-92da-36d257f61c8b" status: 200 len: 1292 microversion: 2.1 time: 0.269976 Oct 19 03:32:54.502361 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2175/4431] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:32:54 2022] GET /compute/v2.1/servers/a1c0df8b-0120-47bc-92da-36d257f61c8b => generated 1292 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:32:54.503794 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b1605c09-3651-4231-8032-294654f69ae6 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:32:54.508046 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0d4b8c8c-360a-467e-aac1-18e51fbc6263 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:32:54.508446 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b1605c09-3651-4231-8032-294654f69ae6 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 3893d3e4-3a09-4adf-951b-84befacf7489] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:54.517719 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0d4b8c8c-360a-467e-aac1-18e51fbc6263 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] [instance: 2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:54.519755 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b1605c09-3651-4231-8032-294654f69ae6 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:54.520569 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b1605c09-3651-4231-8032-294654f69ae6 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:54.521324 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b1605c09-3651-4231-8032-294654f69ae6 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:54.522894 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b1605c09-3651-4231-8032-294654f69ae6 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:54.523740 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b1605c09-3651-4231-8032-294654f69ae6 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:54.524258 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b1605c09-3651-4231-8032-294654f69ae6 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:54.540376 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0d4b8c8c-360a-467e-aac1-18e51fbc6263 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:54.540882 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0d4b8c8c-360a-467e-aac1-18e51fbc6263 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:54.541329 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0d4b8c8c-360a-467e-aac1-18e51fbc6263 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:54.542109 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0d4b8c8c-360a-467e-aac1-18e51fbc6263 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:54.542571 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0d4b8c8c-360a-467e-aac1-18e51fbc6263 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:54.543026 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0d4b8c8c-360a-467e-aac1-18e51fbc6263 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:54.547323 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=100 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:32:54.582278 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-0d4b8c8c-360a-467e-aac1-18e51fbc6263 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lazy-loading 'flavor' on Instance uuid 2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62 {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:32:54.611833 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b1605c09-3651-4231-8032-294654f69ae6 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "POST /compute/v2.1/servers/3893d3e4-3a09-4adf-951b-84befacf7489/action" status: 200 len: 14 microversion: 2.1 time: 0.122984 Oct 19 03:32:54.612766 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2257/4432] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:32:54 2022] POST /compute/v2.1/servers/3893d3e4-3a09-4adf-951b-84befacf7489/action => generated 14 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 03:32:54.725348 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-002c0ff1-9790-4f2f-a115-d0f6ff9f1a72 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:54.726325 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-002c0ff1-9790-4f2f-a115-d0f6ff9f1a72 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] [instance: 61edfb81-28c2-4818-bb73-b141c418e6b0] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:54.958363 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-002c0ff1-9790-4f2f-a115-d0f6ff9f1a72 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51efba80d21425aa86baa138fb99770', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec35cc1c3324178b6314ed3272aa8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:54.966678 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-002c0ff1-9790-4f2f-a115-d0f6ff9f1a72 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] 10.222.0.52 "GET /compute/v2.1/servers/61edfb81-28c2-4818-bb73-b141c418e6b0" status: 200 len: 1228 microversion: 2.1 time: 0.246250 Oct 19 03:32:54.973640 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2258/4433] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:32:54 2022] GET /compute/v2.1/servers/61edfb81-28c2-4818-bb73-b141c418e6b0 => generated 1228 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:32:55.045522 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0d4b8c8c-360a-467e-aac1-18e51fbc6263 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] 10.222.0.52 "POST /compute/v2.1/servers/2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62/action" status: 200 len: 32 microversion: 2.1 time: 0.541198 Oct 19 03:32:55.055218 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2176/4434] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:32:54 2022] POST /compute/v2.1/servers/2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62/action => generated 32 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 03:32:55.061502 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-625e1946-bccc-4ad2-aed8-7efa4880114a tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:55.062230 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-625e1946-bccc-4ad2-aed8-7efa4880114a tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] [instance: 2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:55.085496 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-625e1946-bccc-4ad2-aed8-7efa4880114a tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:55.086526 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-625e1946-bccc-4ad2-aed8-7efa4880114a tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:55.087675 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-625e1946-bccc-4ad2-aed8-7efa4880114a tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:55.088576 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-625e1946-bccc-4ad2-aed8-7efa4880114a tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:55.089939 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-625e1946-bccc-4ad2-aed8-7efa4880114a tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:55.090491 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-625e1946-bccc-4ad2-aed8-7efa4880114a tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:55.476777 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-625e1946-bccc-4ad2-aed8-7efa4880114a tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33d07a7db4846ababf001493c6e10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb0265509744c93b03fa5c28b4e9386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:55.487177 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-625e1946-bccc-4ad2-aed8-7efa4880114a tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] 10.222.0.52 "GET /compute/v2.1/servers/2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62" status: 200 len: 1505 microversion: 2.1 time: 0.435240 Oct 19 03:32:55.489079 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2259/4435] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:32:55 2022] GET /compute/v2.1/servers/2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62 => generated 1505 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:32:55.530034 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-24faa200-528a-44f7-9d77-0fc0c4a62207 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:55.530913 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-24faa200-528a-44f7-9d77-0fc0c4a62207 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] [instance: a1c0df8b-0120-47bc-92da-36d257f61c8b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:55.562045 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-24faa200-528a-44f7-9d77-0fc0c4a62207 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:55.564626 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-24faa200-528a-44f7-9d77-0fc0c4a62207 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:55.564626 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-24faa200-528a-44f7-9d77-0fc0c4a62207 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:55.569201 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-24faa200-528a-44f7-9d77-0fc0c4a62207 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:55.569753 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-24faa200-528a-44f7-9d77-0fc0c4a62207 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:55.570553 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-24faa200-528a-44f7-9d77-0fc0c4a62207 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:55.625576 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3804199d-11bf-4e75-8ad8-60601a0896fd tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:32:55.628321 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-3804199d-11bf-4e75-8ad8-60601a0896fd tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 3893d3e4-3a09-4adf-951b-84befacf7489] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:55.652454 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3804199d-11bf-4e75-8ad8-60601a0896fd tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:55.653093 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3804199d-11bf-4e75-8ad8-60601a0896fd tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:55.653792 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3804199d-11bf-4e75-8ad8-60601a0896fd tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:55.656731 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3804199d-11bf-4e75-8ad8-60601a0896fd tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:55.657284 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3804199d-11bf-4e75-8ad8-60601a0896fd tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:55.660333 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3804199d-11bf-4e75-8ad8-60601a0896fd tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:55.767563 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-3804199d-11bf-4e75-8ad8-60601a0896fd tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "POST /compute/v2.1/servers/3893d3e4-3a09-4adf-951b-84befacf7489/action" status: 200 len: 14 microversion: 2.1 time: 0.147492 Oct 19 03:32:55.768209 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2260/4436] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:32:55 2022] POST /compute/v2.1/servers/3893d3e4-3a09-4adf-951b-84befacf7489/action => generated 14 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 03:32:55.781497 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-24faa200-528a-44f7-9d77-0fc0c4a62207 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b748815c10a46d2adc26d5c8a1ba268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc49f9b6a0054092beda3ab313bff1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:55.794279 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-24faa200-528a-44f7-9d77-0fc0c4a62207 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] 10.222.0.52 "GET /compute/v2.1/servers/a1c0df8b-0120-47bc-92da-36d257f61c8b" status: 200 len: 1280 microversion: 2.1 time: 0.269497 Oct 19 03:32:55.798937 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2177/4437] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:32:55 2022] GET /compute/v2.1/servers/a1c0df8b-0120-47bc-92da-36d257f61c8b => generated 1280 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:32:56.000821 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-27743bd7-5811-47ed-97fd-4830149c790c tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:56.002160 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-27743bd7-5811-47ed-97fd-4830149c790c tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] [instance: 61edfb81-28c2-4818-bb73-b141c418e6b0] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:56.015606 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-27743bd7-5811-47ed-97fd-4830149c790c tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:56.016551 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-27743bd7-5811-47ed-97fd-4830149c790c tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:56.017325 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-27743bd7-5811-47ed-97fd-4830149c790c tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:56.018791 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-27743bd7-5811-47ed-97fd-4830149c790c tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:56.019518 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-27743bd7-5811-47ed-97fd-4830149c790c tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:56.020201 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-27743bd7-5811-47ed-97fd-4830149c790c tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:56.272137 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-27743bd7-5811-47ed-97fd-4830149c790c tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51efba80d21425aa86baa138fb99770', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec35cc1c3324178b6314ed3272aa8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:56.308939 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-27743bd7-5811-47ed-97fd-4830149c790c tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] 10.222.0.52 "GET /compute/v2.1/servers/61edfb81-28c2-4818-bb73-b141c418e6b0" status: 200 len: 1224 microversion: 2.1 time: 0.291817 Oct 19 03:32:56.311038 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2261/4438] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:32:55 2022] GET /compute/v2.1/servers/61edfb81-28c2-4818-bb73-b141c418e6b0 => generated 1224 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:32:56.518453 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-14b325bd-2c75-4d37-8f39-5a43abf33f20 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:56.519454 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-14b325bd-2c75-4d37-8f39-5a43abf33f20 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] [instance: 2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:56.531331 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-14b325bd-2c75-4d37-8f39-5a43abf33f20 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:56.532902 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-14b325bd-2c75-4d37-8f39-5a43abf33f20 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:56.535272 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-14b325bd-2c75-4d37-8f39-5a43abf33f20 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:56.536292 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-14b325bd-2c75-4d37-8f39-5a43abf33f20 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:56.538474 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-14b325bd-2c75-4d37-8f39-5a43abf33f20 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:56.540910 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-14b325bd-2c75-4d37-8f39-5a43abf33f20 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:56.780302 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a766ce66-211d-4f8b-815e-e3d9ccd7015d tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:32:56.783544 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a766ce66-211d-4f8b-815e-e3d9ccd7015d tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 3893d3e4-3a09-4adf-951b-84befacf7489] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:56.810154 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a766ce66-211d-4f8b-815e-e3d9ccd7015d tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:56.811066 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a766ce66-211d-4f8b-815e-e3d9ccd7015d tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:56.811762 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a766ce66-211d-4f8b-815e-e3d9ccd7015d tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:56.815037 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a766ce66-211d-4f8b-815e-e3d9ccd7015d tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:56.819153 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a766ce66-211d-4f8b-815e-e3d9ccd7015d tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:56.822011 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a766ce66-211d-4f8b-815e-e3d9ccd7015d tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:56.958892 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a766ce66-211d-4f8b-815e-e3d9ccd7015d tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "POST /compute/v2.1/servers/3893d3e4-3a09-4adf-951b-84befacf7489/action" status: 200 len: 14 microversion: 2.1 time: 0.183811 Oct 19 03:32:56.960351 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2262/4439] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:32:56 2022] POST /compute/v2.1/servers/3893d3e4-3a09-4adf-951b-84befacf7489/action => generated 14 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 03:32:56.984494 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e0381f4a-049a-4036-870f-56e71c1de522 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:56.992147 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e0381f4a-049a-4036-870f-56e71c1de522 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] [instance: a1c0df8b-0120-47bc-92da-36d257f61c8b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:57.025644 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e0381f4a-049a-4036-870f-56e71c1de522 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:57.030102 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e0381f4a-049a-4036-870f-56e71c1de522 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:57.031477 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e0381f4a-049a-4036-870f-56e71c1de522 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:57.032553 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e0381f4a-049a-4036-870f-56e71c1de522 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:57.038061 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e0381f4a-049a-4036-870f-56e71c1de522 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:57.038939 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e0381f4a-049a-4036-870f-56e71c1de522 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:57.588670 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-14b325bd-2c75-4d37-8f39-5a43abf33f20 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33d07a7db4846ababf001493c6e10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb0265509744c93b03fa5c28b4e9386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:57.611129 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-14b325bd-2c75-4d37-8f39-5a43abf33f20 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] 10.222.0.52 "GET /compute/v2.1/servers/2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62" status: 200 len: 1505 microversion: 2.1 time: 1.096215 Oct 19 03:32:57.611968 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2178/4440] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:32:56 2022] GET /compute/v2.1/servers/2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62 => generated 1505 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:32:57.625320 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7a5d7d63-997a-4e46-a426-eb4c8818b426 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:57.634282 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7a5d7d63-997a-4e46-a426-eb4c8818b426 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] [instance: 61edfb81-28c2-4818-bb73-b141c418e6b0] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:57.644872 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7a5d7d63-997a-4e46-a426-eb4c8818b426 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:57.645462 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7a5d7d63-997a-4e46-a426-eb4c8818b426 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:57.646090 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7a5d7d63-997a-4e46-a426-eb4c8818b426 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:57.647025 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7a5d7d63-997a-4e46-a426-eb4c8818b426 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:57.647684 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7a5d7d63-997a-4e46-a426-eb4c8818b426 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:57.648503 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7a5d7d63-997a-4e46-a426-eb4c8818b426 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:57.820139 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-7a5d7d63-997a-4e46-a426-eb4c8818b426 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51efba80d21425aa86baa138fb99770', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec35cc1c3324178b6314ed3272aa8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:57.836132 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7a5d7d63-997a-4e46-a426-eb4c8818b426 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] 10.222.0.52 "GET /compute/v2.1/servers/61edfb81-28c2-4818-bb73-b141c418e6b0" status: 200 len: 1298 microversion: 2.1 time: 0.221795 Oct 19 03:32:57.842384 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2179/4441] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:32:57 2022] GET /compute/v2.1/servers/61edfb81-28c2-4818-bb73-b141c418e6b0 => generated 1298 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:32:57.908203 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-e0381f4a-049a-4036-870f-56e71c1de522 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b748815c10a46d2adc26d5c8a1ba268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc49f9b6a0054092beda3ab313bff1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:57.919733 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e0381f4a-049a-4036-870f-56e71c1de522 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] 10.222.0.52 "GET /compute/v2.1/servers/a1c0df8b-0120-47bc-92da-36d257f61c8b" status: 200 len: 1322 microversion: 2.1 time: 0.957926 Oct 19 03:32:57.929166 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2263/4442] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:32:56 2022] GET /compute/v2.1/servers/a1c0df8b-0120-47bc-92da-36d257f61c8b => generated 1322 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:32:57.973518 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c8376739-da27-40d7-8dee-057c32b87a35 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:32:57.977260 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c8376739-da27-40d7-8dee-057c32b87a35 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 3893d3e4-3a09-4adf-951b-84befacf7489] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:57.990946 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c8376739-da27-40d7-8dee-057c32b87a35 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:57.995445 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c8376739-da27-40d7-8dee-057c32b87a35 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:57.996213 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c8376739-da27-40d7-8dee-057c32b87a35 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:57.997151 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c8376739-da27-40d7-8dee-057c32b87a35 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:58.003708 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c8376739-da27-40d7-8dee-057c32b87a35 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:58.003708 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c8376739-da27-40d7-8dee-057c32b87a35 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:58.103876 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c8376739-da27-40d7-8dee-057c32b87a35 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "POST /compute/v2.1/servers/3893d3e4-3a09-4adf-951b-84befacf7489/action" status: 200 len: 14 microversion: 2.1 time: 0.135015 Oct 19 03:32:58.105513 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2180/4443] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:32:57 2022] POST /compute/v2.1/servers/3893d3e4-3a09-4adf-951b-84befacf7489/action => generated 14 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 03:32:58.639833 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5ef91425-c436-474a-8d2b-84bfb77a1272 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:58.641101 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-5ef91425-c436-474a-8d2b-84bfb77a1272 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] [instance: 2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:58.650497 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5ef91425-c436-474a-8d2b-84bfb77a1272 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:58.653004 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5ef91425-c436-474a-8d2b-84bfb77a1272 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:58.653004 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5ef91425-c436-474a-8d2b-84bfb77a1272 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:58.653790 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5ef91425-c436-474a-8d2b-84bfb77a1272 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:58.654480 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5ef91425-c436-474a-8d2b-84bfb77a1272 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:58.655160 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5ef91425-c436-474a-8d2b-84bfb77a1272 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:58.870799 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-37b43c08-a899-48c9-a7e6-0fdbbcb8cefe tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:58.872114 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-37b43c08-a899-48c9-a7e6-0fdbbcb8cefe tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] [instance: 61edfb81-28c2-4818-bb73-b141c418e6b0] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:58.884357 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=100 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:32:58.884357 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-37b43c08-a899-48c9-a7e6-0fdbbcb8cefe tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:58.884357 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-37b43c08-a899-48c9-a7e6-0fdbbcb8cefe tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:58.884793 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-37b43c08-a899-48c9-a7e6-0fdbbcb8cefe tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:58.885974 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-37b43c08-a899-48c9-a7e6-0fdbbcb8cefe tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:58.886591 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-37b43c08-a899-48c9-a7e6-0fdbbcb8cefe tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:58.887643 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-37b43c08-a899-48c9-a7e6-0fdbbcb8cefe tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:59.138428 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-37b43c08-a899-48c9-a7e6-0fdbbcb8cefe tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51efba80d21425aa86baa138fb99770', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec35cc1c3324178b6314ed3272aa8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:59.159758 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-37b43c08-a899-48c9-a7e6-0fdbbcb8cefe tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] 10.222.0.52 "GET /compute/v2.1/servers/61edfb81-28c2-4818-bb73-b141c418e6b0" status: 200 len: 1286 microversion: 2.1 time: 0.299491 Oct 19 03:32:59.170294 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2181/4444] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:32:58 2022] GET /compute/v2.1/servers/61edfb81-28c2-4818-bb73-b141c418e6b0 => generated 1286 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:32:59.185826 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-5ef91425-c436-474a-8d2b-84bfb77a1272 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33d07a7db4846ababf001493c6e10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb0265509744c93b03fa5c28b4e9386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:59.200651 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7962128b-7a96-4211-baf6-cea598aecc7d tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:32:59.204312 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7962128b-7a96-4211-baf6-cea598aecc7d tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] [instance: a1c0df8b-0120-47bc-92da-36d257f61c8b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:59.206387 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5ef91425-c436-474a-8d2b-84bfb77a1272 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] 10.222.0.52 "GET /compute/v2.1/servers/2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62" status: 200 len: 1505 microversion: 2.1 time: 0.570697 Oct 19 03:32:59.209702 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2264/4445] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:32:58 2022] GET /compute/v2.1/servers/2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62 => generated 1505 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:32:59.222299 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7962128b-7a96-4211-baf6-cea598aecc7d tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:59.223356 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e63527da-6b89-47ba-8020-f15d517e9b36 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:32:59.225762 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7962128b-7a96-4211-baf6-cea598aecc7d tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:59.231530 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7962128b-7a96-4211-baf6-cea598aecc7d tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:59.231530 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7962128b-7a96-4211-baf6-cea598aecc7d tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:59.232284 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7962128b-7a96-4211-baf6-cea598aecc7d tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:59.232981 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7962128b-7a96-4211-baf6-cea598aecc7d tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:59.233409 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e63527da-6b89-47ba-8020-f15d517e9b36 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 3893d3e4-3a09-4adf-951b-84befacf7489] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:32:59.251247 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e63527da-6b89-47ba-8020-f15d517e9b36 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:59.253227 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e63527da-6b89-47ba-8020-f15d517e9b36 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:59.254930 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e63527da-6b89-47ba-8020-f15d517e9b36 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:59.265082 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e63527da-6b89-47ba-8020-f15d517e9b36 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:32:59.265082 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e63527da-6b89-47ba-8020-f15d517e9b36 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:32:59.265082 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e63527da-6b89-47ba-8020-f15d517e9b36 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:32:59.312684 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:32:59.366909 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e63527da-6b89-47ba-8020-f15d517e9b36 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "POST /compute/v2.1/servers/3893d3e4-3a09-4adf-951b-84befacf7489/action" status: 200 len: 14 microversion: 2.1 time: 0.155363 Oct 19 03:32:59.368780 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2265/4446] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:32:59 2022] POST /compute/v2.1/servers/3893d3e4-3a09-4adf-951b-84befacf7489/action => generated 14 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 03:32:59.650056 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-7962128b-7a96-4211-baf6-cea598aecc7d tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b748815c10a46d2adc26d5c8a1ba268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc49f9b6a0054092beda3ab313bff1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:32:59.663807 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7962128b-7a96-4211-baf6-cea598aecc7d tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] 10.222.0.52 "GET /compute/v2.1/servers/a1c0df8b-0120-47bc-92da-36d257f61c8b" status: 200 len: 1322 microversion: 2.1 time: 0.492015 Oct 19 03:32:59.665492 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2182/4447] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:32:59 2022] GET /compute/v2.1/servers/a1c0df8b-0120-47bc-92da-36d257f61c8b => generated 1322 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:33:00.202479 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e695c3e6-ca2c-48c2-9710-038221e419d5 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:00.203209 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e695c3e6-ca2c-48c2-9710-038221e419d5 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] [instance: 61edfb81-28c2-4818-bb73-b141c418e6b0] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:00.216364 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e695c3e6-ca2c-48c2-9710-038221e419d5 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:00.217118 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e695c3e6-ca2c-48c2-9710-038221e419d5 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:00.218044 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e695c3e6-ca2c-48c2-9710-038221e419d5 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:00.219054 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e695c3e6-ca2c-48c2-9710-038221e419d5 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:00.219679 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e695c3e6-ca2c-48c2-9710-038221e419d5 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:00.220446 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e695c3e6-ca2c-48c2-9710-038221e419d5 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:00.235602 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c86b2b8b-6891-4b46-85ac-1bb706f8bd50 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:00.237330 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c86b2b8b-6891-4b46-85ac-1bb706f8bd50 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] [instance: 2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:00.249079 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c86b2b8b-6891-4b46-85ac-1bb706f8bd50 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:00.249622 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c86b2b8b-6891-4b46-85ac-1bb706f8bd50 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:00.266510 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c86b2b8b-6891-4b46-85ac-1bb706f8bd50 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:00.269819 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c86b2b8b-6891-4b46-85ac-1bb706f8bd50 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:00.270837 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c86b2b8b-6891-4b46-85ac-1bb706f8bd50 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:00.271882 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c86b2b8b-6891-4b46-85ac-1bb706f8bd50 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:00.837728 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c86b2b8b-6891-4b46-85ac-1bb706f8bd50 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33d07a7db4846ababf001493c6e10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb0265509744c93b03fa5c28b4e9386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:00.843832 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-e695c3e6-ca2c-48c2-9710-038221e419d5 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51efba80d21425aa86baa138fb99770', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec35cc1c3324178b6314ed3272aa8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:00.849829 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c86b2b8b-6891-4b46-85ac-1bb706f8bd50 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] 10.222.0.52 "GET /compute/v2.1/servers/2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62" status: 200 len: 1505 microversion: 2.1 time: 0.617885 Oct 19 03:33:00.851489 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2183/4448] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:00 2022] GET /compute/v2.1/servers/2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62 => generated 1505 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:33:00.859669 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e695c3e6-ca2c-48c2-9710-038221e419d5 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] 10.222.0.52 "GET /compute/v2.1/servers/61edfb81-28c2-4818-bb73-b141c418e6b0" status: 200 len: 1328 microversion: 2.1 time: 0.669015 Oct 19 03:33:00.869529 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2266/4449] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:00 2022] GET /compute/v2.1/servers/61edfb81-28c2-4818-bb73-b141c418e6b0 => generated 1328 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:33:00.869776 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-f436f56c-72fd-4b2d-899d-6f1c392655ec req-063150de-8dff-41d7-964c-f1b6ec2c8f15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1c0df8b-0120-47bc-92da-36d257f61c8b", "tag": "c171d5d3-26e8-4d7a-9d92-850c79a51e4c"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:33:00.880287 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e5a00052-c79e-47ce-9ed4-31415ee66fba tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:33:00.888637 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e5a00052-c79e-47ce-9ed4-31415ee66fba tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 3893d3e4-3a09-4adf-951b-84befacf7489] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:00.891873 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-f436f56c-72fd-4b2d-899d-6f1c392655ec req-063150de-8dff-41d7-964c-f1b6ec2c8f15 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:00.892755 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-f436f56c-72fd-4b2d-899d-6f1c392655ec req-063150de-8dff-41d7-964c-f1b6ec2c8f15 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:00.893361 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-f436f56c-72fd-4b2d-899d-6f1c392655ec req-063150de-8dff-41d7-964c-f1b6ec2c8f15 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:00.899215 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e5a00052-c79e-47ce-9ed4-31415ee66fba tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:00.899983 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e5a00052-c79e-47ce-9ed4-31415ee66fba tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:00.900661 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e5a00052-c79e-47ce-9ed4-31415ee66fba tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:00.902497 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e5a00052-c79e-47ce-9ed4-31415ee66fba tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:00.903156 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e5a00052-c79e-47ce-9ed4-31415ee66fba tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:00.903788 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e5a00052-c79e-47ce-9ed4-31415ee66fba tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:00.916485 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-f436f56c-72fd-4b2d-899d-6f1c392655ec req-063150de-8dff-41d7-964c-f1b6ec2c8f15 service nova] Creating event network-changed:c171d5d3-26e8-4d7a-9d92-850c79a51e4c for instance a1c0df8b-0120-47bc-92da-36d257f61c8b on n-h2-861333-8 Oct 19 03:33:00.929734 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-f436f56c-72fd-4b2d-899d-6f1c392655ec req-063150de-8dff-41d7-964c-f1b6ec2c8f15 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073471 Oct 19 03:33:00.934438 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2184/4450] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:33:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:33:00.942463 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-49819659-cb5b-4637-bab3-a825f02357b7 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:00.946679 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-49819659-cb5b-4637-bab3-a825f02357b7 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] [instance: a1c0df8b-0120-47bc-92da-36d257f61c8b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:00.964112 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-49819659-cb5b-4637-bab3-a825f02357b7 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:00.969647 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-49819659-cb5b-4637-bab3-a825f02357b7 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:00.969647 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-49819659-cb5b-4637-bab3-a825f02357b7 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:00.970561 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-49819659-cb5b-4637-bab3-a825f02357b7 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:00.971665 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-49819659-cb5b-4637-bab3-a825f02357b7 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:00.972926 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-49819659-cb5b-4637-bab3-a825f02357b7 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:01.011110 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e5a00052-c79e-47ce-9ed4-31415ee66fba tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "POST /compute/v2.1/servers/3893d3e4-3a09-4adf-951b-84befacf7489/action" status: 200 len: 14 microversion: 2.1 time: 0.138623 Oct 19 03:33:01.012461 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2267/4451] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:33:00 2022] POST /compute/v2.1/servers/3893d3e4-3a09-4adf-951b-84befacf7489/action => generated 14 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 03:33:01.213674 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-49819659-cb5b-4637-bab3-a825f02357b7 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b748815c10a46d2adc26d5c8a1ba268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc49f9b6a0054092beda3ab313bff1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:01.222319 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-49819659-cb5b-4637-bab3-a825f02357b7 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] 10.222.0.52 "GET /compute/v2.1/servers/a1c0df8b-0120-47bc-92da-36d257f61c8b" status: 200 len: 1322 microversion: 2.1 time: 0.286436 Oct 19 03:33:01.235288 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2185/4452] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:00 2022] GET /compute/v2.1/servers/a1c0df8b-0120-47bc-92da-36d257f61c8b => generated 1322 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:33:01.872716 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-8a20547a-96a2-4a78-887d-2c665b346ce0 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:01.874230 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-8a20547a-96a2-4a78-887d-2c665b346ce0 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] [instance: 2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:01.889001 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8a20547a-96a2-4a78-887d-2c665b346ce0 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:01.891402 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-498adf52-014a-4efc-bebc-e502a6976fed tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:01.892033 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-498adf52-014a-4efc-bebc-e502a6976fed tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] [instance: 61edfb81-28c2-4818-bb73-b141c418e6b0] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:01.899609 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8a20547a-96a2-4a78-887d-2c665b346ce0 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:01.900092 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8a20547a-96a2-4a78-887d-2c665b346ce0 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:01.900835 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8a20547a-96a2-4a78-887d-2c665b346ce0 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:01.901310 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8a20547a-96a2-4a78-887d-2c665b346ce0 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:01.901831 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8a20547a-96a2-4a78-887d-2c665b346ce0 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:01.908936 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-498adf52-014a-4efc-bebc-e502a6976fed tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:01.910269 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-498adf52-014a-4efc-bebc-e502a6976fed tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:01.910269 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-498adf52-014a-4efc-bebc-e502a6976fed tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:01.911092 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-498adf52-014a-4efc-bebc-e502a6976fed tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:01.911554 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-498adf52-014a-4efc-bebc-e502a6976fed tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:01.912175 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-498adf52-014a-4efc-bebc-e502a6976fed tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:02.208545 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-8a20547a-96a2-4a78-887d-2c665b346ce0 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33d07a7db4846ababf001493c6e10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb0265509744c93b03fa5c28b4e9386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:02.223723 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-8a20547a-96a2-4a78-887d-2c665b346ce0 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] 10.222.0.52 "GET /compute/v2.1/servers/2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62" status: 200 len: 1505 microversion: 2.1 time: 0.355584 Oct 19 03:33:02.231890 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2268/4453] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:01 2022] GET /compute/v2.1/servers/2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62 => generated 1505 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:33:02.237891 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-56d64a51-db05-45de-99b0-45a13c011d78 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:33:02.243465 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-56d64a51-db05-45de-99b0-45a13c011d78 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 3893d3e4-3a09-4adf-951b-84befacf7489] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:02.253554 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-56d64a51-db05-45de-99b0-45a13c011d78 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:02.254449 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-56d64a51-db05-45de-99b0-45a13c011d78 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:02.254907 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-56d64a51-db05-45de-99b0-45a13c011d78 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:02.256300 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-56d64a51-db05-45de-99b0-45a13c011d78 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:02.256766 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-56d64a51-db05-45de-99b0-45a13c011d78 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:02.257196 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-56d64a51-db05-45de-99b0-45a13c011d78 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:02.298273 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-498adf52-014a-4efc-bebc-e502a6976fed tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51efba80d21425aa86baa138fb99770', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec35cc1c3324178b6314ed3272aa8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:02.308011 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-498adf52-014a-4efc-bebc-e502a6976fed tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] 10.222.0.52 "GET /compute/v2.1/servers/61edfb81-28c2-4818-bb73-b141c418e6b0" status: 200 len: 1328 microversion: 2.1 time: 0.420529 Oct 19 03:33:02.308872 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2186/4454] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:01 2022] GET /compute/v2.1/servers/61edfb81-28c2-4818-bb73-b141c418e6b0 => generated 1328 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:33:02.314286 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-45b05637-502e-4329-9e8c-353faae0cf52 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:02.315078 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-45b05637-502e-4329-9e8c-353faae0cf52 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] [instance: a1c0df8b-0120-47bc-92da-36d257f61c8b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:02.327143 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-45b05637-502e-4329-9e8c-353faae0cf52 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:02.328543 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-45b05637-502e-4329-9e8c-353faae0cf52 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:02.328900 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-56d64a51-db05-45de-99b0-45a13c011d78 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "POST /compute/v2.1/servers/3893d3e4-3a09-4adf-951b-84befacf7489/action" status: 200 len: 8205 microversion: 2.1 time: 0.095534 Oct 19 03:33:02.329352 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-45b05637-502e-4329-9e8c-353faae0cf52 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:02.330094 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2269/4455] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:33:02 2022] POST /compute/v2.1/servers/3893d3e4-3a09-4adf-951b-84befacf7489/action => generated 8205 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:33:02.330965 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-45b05637-502e-4329-9e8c-353faae0cf52 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:02.331586 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-45b05637-502e-4329-9e8c-353faae0cf52 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:02.332549 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-45b05637-502e-4329-9e8c-353faae0cf52 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:02.343640 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f4572fe8-1351-4159-8961-ee14e265842c tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:02.344364 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f4572fe8-1351-4159-8961-ee14e265842c tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:02.353206 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f4572fe8-1351-4159-8961-ee14e265842c tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:02.353752 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f4572fe8-1351-4159-8961-ee14e265842c tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:02.354202 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f4572fe8-1351-4159-8961-ee14e265842c tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:02.355093 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f4572fe8-1351-4159-8961-ee14e265842c tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:02.355838 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f4572fe8-1351-4159-8961-ee14e265842c tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:02.356286 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f4572fe8-1351-4159-8961-ee14e265842c tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:02.738883 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f4572fe8-1351-4159-8961-ee14e265842c tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:02.750650 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f4572fe8-1351-4159-8961-ee14e265842c tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1670 microversion: 2.1 time: 0.413090 Oct 19 03:33:02.750650 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2270/4456] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:02 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1670 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:33:02.782088 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e2f59eb7-17cc-4f3f-a919-8115068a22d0 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:02.783140 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e2f59eb7-17cc-4f3f-a919-8115068a22d0 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:02.795992 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e2f59eb7-17cc-4f3f-a919-8115068a22d0 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:02.796693 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e2f59eb7-17cc-4f3f-a919-8115068a22d0 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:02.797188 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-45b05637-502e-4329-9e8c-353faae0cf52 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b748815c10a46d2adc26d5c8a1ba268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc49f9b6a0054092beda3ab313bff1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:02.797330 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e2f59eb7-17cc-4f3f-a919-8115068a22d0 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:02.798020 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e2f59eb7-17cc-4f3f-a919-8115068a22d0 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:02.798711 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e2f59eb7-17cc-4f3f-a919-8115068a22d0 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:02.799292 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e2f59eb7-17cc-4f3f-a919-8115068a22d0 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:02.811239 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-45b05637-502e-4329-9e8c-353faae0cf52 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] 10.222.0.52 "GET /compute/v2.1/servers/a1c0df8b-0120-47bc-92da-36d257f61c8b" status: 200 len: 1322 microversion: 2.1 time: 0.500876 Oct 19 03:33:02.814927 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2187/4457] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:02 2022] GET /compute/v2.1/servers/a1c0df8b-0120-47bc-92da-36d257f61c8b => generated 1322 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:33:03.120958 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=8 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:33:03.142546 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-e2f59eb7-17cc-4f3f-a919-8115068a22d0 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:03.151562 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e2f59eb7-17cc-4f3f-a919-8115068a22d0 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1670 microversion: 2.1 time: 0.373358 Oct 19 03:33:03.165082 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2271/4458] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:02 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1670 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:33:03.178005 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-95db8e6b-4841-4a05-8ecc-00075d7c0034 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:03.179256 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-95db8e6b-4841-4a05-8ecc-00075d7c0034 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:03.191152 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-95db8e6b-4841-4a05-8ecc-00075d7c0034 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:03.191714 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-95db8e6b-4841-4a05-8ecc-00075d7c0034 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:03.192167 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-95db8e6b-4841-4a05-8ecc-00075d7c0034 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:03.192959 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-95db8e6b-4841-4a05-8ecc-00075d7c0034 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:03.193465 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-95db8e6b-4841-4a05-8ecc-00075d7c0034 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:03.193906 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-95db8e6b-4841-4a05-8ecc-00075d7c0034 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:03.255952 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-44407385-992e-49b9-b98c-d09ea3a3d62e tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:03.256925 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-44407385-992e-49b9-b98c-d09ea3a3d62e tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] [instance: 2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:03.269176 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-44407385-992e-49b9-b98c-d09ea3a3d62e tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:03.269620 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-44407385-992e-49b9-b98c-d09ea3a3d62e tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:03.270816 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-44407385-992e-49b9-b98c-d09ea3a3d62e tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:03.272397 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-44407385-992e-49b9-b98c-d09ea3a3d62e tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:03.273726 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-44407385-992e-49b9-b98c-d09ea3a3d62e tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:03.274325 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-44407385-992e-49b9-b98c-d09ea3a3d62e tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:03.695220 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=14 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:33:03.781182 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-95db8e6b-4841-4a05-8ecc-00075d7c0034 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:03.798552 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-44407385-992e-49b9-b98c-d09ea3a3d62e tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33d07a7db4846ababf001493c6e10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb0265509744c93b03fa5c28b4e9386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:03.805510 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-95db8e6b-4841-4a05-8ecc-00075d7c0034 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1670 microversion: 2.1 time: 0.632217 Oct 19 03:33:03.807230 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-44407385-992e-49b9-b98c-d09ea3a3d62e tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] 10.222.0.52 "GET /compute/v2.1/servers/2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62" status: 200 len: 1505 microversion: 2.1 time: 0.555210 Oct 19 03:33:03.807536 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2188/4459] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:03 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1670 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:33:03.807999 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2272/4460] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:03 2022] GET /compute/v2.1/servers/2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62 => generated 1505 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:33:03.814071 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-c75f11ea-0478-41c6-9648-9571d283eec6 req-5848c63c-ab31-48db-8cf6-750d519caa56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61edfb81-28c2-4818-bb73-b141c418e6b0", "tag": "ab8a932f-7561-49a4-9d1a-6e518eaa83d4"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:33:03.826376 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3d87c7ce-1af2-43d8-81d3-28dfdbb144a4 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:03.826994 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-3d87c7ce-1af2-43d8-81d3-28dfdbb144a4 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] [instance: 61edfb81-28c2-4818-bb73-b141c418e6b0] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:03.827191 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-c75f11ea-0478-41c6-9648-9571d283eec6 req-5848c63c-ab31-48db-8cf6-750d519caa56 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:03.827889 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-c75f11ea-0478-41c6-9648-9571d283eec6 req-5848c63c-ab31-48db-8cf6-750d519caa56 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:03.828336 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-c75f11ea-0478-41c6-9648-9571d283eec6 req-5848c63c-ab31-48db-8cf6-750d519caa56 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:03.830003 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:UPDATE=2,nova_api:SELECT=92,nova_api:INSERT=6 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:33:03.835735 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3d87c7ce-1af2-43d8-81d3-28dfdbb144a4 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:03.836478 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3d87c7ce-1af2-43d8-81d3-28dfdbb144a4 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:03.837145 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3d87c7ce-1af2-43d8-81d3-28dfdbb144a4 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:03.838093 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3d87c7ce-1af2-43d8-81d3-28dfdbb144a4 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:03.838866 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3d87c7ce-1af2-43d8-81d3-28dfdbb144a4 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:03.839478 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3d87c7ce-1af2-43d8-81d3-28dfdbb144a4 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:03.847829 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-c75f11ea-0478-41c6-9648-9571d283eec6 req-5848c63c-ab31-48db-8cf6-750d519caa56 service nova] Creating event network-changed:ab8a932f-7561-49a4-9d1a-6e518eaa83d4 for instance 61edfb81-28c2-4818-bb73-b141c418e6b0 on n-h1-861333-8 Oct 19 03:33:03.855358 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-c75f11ea-0478-41c6-9648-9571d283eec6 req-5848c63c-ab31-48db-8cf6-750d519caa56 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044712 Oct 19 03:33:03.856295 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2189/4461] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:33:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:33:03.861966 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8c133a83-cce4-48e3-9433-d456a2ef3303 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:03.862668 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8c133a83-cce4-48e3-9433-d456a2ef3303 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:03.872372 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8c133a83-cce4-48e3-9433-d456a2ef3303 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:03.873228 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8c133a83-cce4-48e3-9433-d456a2ef3303 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:03.873840 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8c133a83-cce4-48e3-9433-d456a2ef3303 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:03.874570 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8c133a83-cce4-48e3-9433-d456a2ef3303 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:03.875071 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8c133a83-cce4-48e3-9433-d456a2ef3303 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:03.875502 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8c133a83-cce4-48e3-9433-d456a2ef3303 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:04.250620 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-3d87c7ce-1af2-43d8-81d3-28dfdbb144a4 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51efba80d21425aa86baa138fb99770', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec35cc1c3324178b6314ed3272aa8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:04.262598 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-3d87c7ce-1af2-43d8-81d3-28dfdbb144a4 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] 10.222.0.52 "GET /compute/v2.1/servers/61edfb81-28c2-4818-bb73-b141c418e6b0" status: 200 len: 1328 microversion: 2.1 time: 0.453292 Oct 19 03:33:04.263770 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2273/4462] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:03 2022] GET /compute/v2.1/servers/61edfb81-28c2-4818-bb73-b141c418e6b0 => generated 1328 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:33:04.269183 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e3d4722f-0db2-46fb-a0dd-186983e3dae7 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:04.270160 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e3d4722f-0db2-46fb-a0dd-186983e3dae7 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] [instance: a1c0df8b-0120-47bc-92da-36d257f61c8b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:04.279540 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e3d4722f-0db2-46fb-a0dd-186983e3dae7 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:04.280411 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e3d4722f-0db2-46fb-a0dd-186983e3dae7 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:04.281078 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e3d4722f-0db2-46fb-a0dd-186983e3dae7 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:04.282013 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e3d4722f-0db2-46fb-a0dd-186983e3dae7 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:04.282652 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e3d4722f-0db2-46fb-a0dd-186983e3dae7 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:04.283263 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e3d4722f-0db2-46fb-a0dd-186983e3dae7 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:04.336393 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8c133a83-cce4-48e3-9433-d456a2ef3303 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:04.347699 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8c133a83-cce4-48e3-9433-d456a2ef3303 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1670 microversion: 2.1 time: 0.489912 Oct 19 03:33:04.365441 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2190/4463] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:03 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1670 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:33:04.371326 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-18410e7e-4e01-479a-9359-b03b9c71f3c5 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:33:04.371969 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-18410e7e-4e01-479a-9359-b03b9c71f3c5 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:04.378236 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-18410e7e-4e01-479a-9359-b03b9c71f3c5 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:04.378737 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-18410e7e-4e01-479a-9359-b03b9c71f3c5 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:04.379185 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-18410e7e-4e01-479a-9359-b03b9c71f3c5 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:04.379959 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-18410e7e-4e01-479a-9359-b03b9c71f3c5 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:04.380945 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-18410e7e-4e01-479a-9359-b03b9c71f3c5 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:04.381398 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-18410e7e-4e01-479a-9359-b03b9c71f3c5 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:04.517118 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:33:04.639307 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-18410e7e-4e01-479a-9359-b03b9c71f3c5 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Locking {{(pid=121134) lock /opt/stack/nova/nova/compute/api.py:4845}} Oct 19 03:33:04.662860 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-e3d4722f-0db2-46fb-a0dd-186983e3dae7 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b748815c10a46d2adc26d5c8a1ba268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc49f9b6a0054092beda3ab313bff1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:04.688109 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e3d4722f-0db2-46fb-a0dd-186983e3dae7 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] 10.222.0.52 "GET /compute/v2.1/servers/a1c0df8b-0120-47bc-92da-36d257f61c8b" status: 200 len: 1322 microversion: 2.1 time: 0.423070 Oct 19 03:33:04.689041 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2274/4464] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:04 2022] GET /compute/v2.1/servers/a1c0df8b-0120-47bc-92da-36d257f61c8b => generated 1322 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:33:04.834112 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-910a59d5-d2a1-4643-a83e-d364d6199808 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:04.835071 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-910a59d5-d2a1-4643-a83e-d364d6199808 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] [instance: 2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:04.842758 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-910a59d5-d2a1-4643-a83e-d364d6199808 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:04.843258 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-910a59d5-d2a1-4643-a83e-d364d6199808 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:04.843714 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-910a59d5-d2a1-4643-a83e-d364d6199808 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:04.846678 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-910a59d5-d2a1-4643-a83e-d364d6199808 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:04.846678 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-910a59d5-d2a1-4643-a83e-d364d6199808 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:04.846678 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-910a59d5-d2a1-4643-a83e-d364d6199808 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:04.871148 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-18410e7e-4e01-479a-9359-b03b9c71f3c5 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "POST /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f/action" status: 202 len: 0 microversion: 2.1 time: 0.503529 Oct 19 03:33:04.882631 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2191/4465] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:33:04 2022] POST /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f/action => generated 0 bytes in 511 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:33:04.885245 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2d8a993e-a4c1-4e62-b34a-2571d8300034 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:04.886646 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2d8a993e-a4c1-4e62-b34a-2571d8300034 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:04.897022 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2d8a993e-a4c1-4e62-b34a-2571d8300034 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:04.897815 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2d8a993e-a4c1-4e62-b34a-2571d8300034 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:04.898566 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2d8a993e-a4c1-4e62-b34a-2571d8300034 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:04.899457 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2d8a993e-a4c1-4e62-b34a-2571d8300034 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:04.900290 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2d8a993e-a4c1-4e62-b34a-2571d8300034 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:04.900895 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2d8a993e-a4c1-4e62-b34a-2571d8300034 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:04.966497 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=14 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:33:05.254795 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-910a59d5-d2a1-4643-a83e-d364d6199808 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33d07a7db4846ababf001493c6e10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb0265509744c93b03fa5c28b4e9386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:05.263311 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-910a59d5-d2a1-4643-a83e-d364d6199808 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] 10.222.0.52 "GET /compute/v2.1/servers/2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62" status: 200 len: 1505 microversion: 2.1 time: 0.433810 Oct 19 03:33:05.263879 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2275/4466] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:04 2022] GET /compute/v2.1/servers/2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62 => generated 1505 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:33:05.288122 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-8b32da38-d122-4e00-87ee-9cb3a5c39b43 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:05.288806 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-8b32da38-d122-4e00-87ee-9cb3a5c39b43 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] [instance: 61edfb81-28c2-4818-bb73-b141c418e6b0] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:05.295025 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8b32da38-d122-4e00-87ee-9cb3a5c39b43 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:05.295515 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8b32da38-d122-4e00-87ee-9cb3a5c39b43 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:05.295957 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-2d8a993e-a4c1-4e62-b34a-2571d8300034 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:05.296208 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8b32da38-d122-4e00-87ee-9cb3a5c39b43 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:05.296860 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8b32da38-d122-4e00-87ee-9cb3a5c39b43 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:05.297319 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8b32da38-d122-4e00-87ee-9cb3a5c39b43 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:05.297775 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8b32da38-d122-4e00-87ee-9cb3a5c39b43 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:05.305046 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2d8a993e-a4c1-4e62-b34a-2571d8300034 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1670 microversion: 2.1 time: 0.425441 Oct 19 03:33:05.305724 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2192/4467] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:04 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1670 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:33:05.334403 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-42155410-73d8-4748-87f7-21d56d19eda4 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:33:05.344981 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-42155410-73d8-4748-87f7-21d56d19eda4 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:05.345545 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-42155410-73d8-4748-87f7-21d56d19eda4 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:05.347676 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-42155410-73d8-4748-87f7-21d56d19eda4 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:05.402227 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-42155410-73d8-4748-87f7-21d56d19eda4 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] HTTP exception thrown: Instance 58b9ce4c-4a42-40ff-b8ed-b75de752b46f is locked Oct 19 03:33:05.409034 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-42155410-73d8-4748-87f7-21d56d19eda4 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Request method failure captured: Oct 19 03:33:05.409034 n-d-861333-8 devstack@n-api.service[121134]: request: POST /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f/action HTTP/1.1 Oct 19 03:33:05.409034 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:33:05.409034 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:33:05.409034 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:33:05.409034 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 15 Oct 19 03:33:05.409034 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:33:05.409034 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:33:05.409034 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:33:05.409034 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:33:05.409034 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT260MiyV65qXgKOsfu6szlvH8BpT6lTW39le6GeB1VFhX0NvYWazEEMcFsPSbHLVkGCs6vY26nud47iZUvRrXjMTSm7xCeqvs3FV0buG-kYWzpyMEv10k1w1En6NH8mRVf9qJ3OJ_AYxVTEN4XseatoNJyXso6kEWPzPG5n5qhJZ8ME Oct 19 03:33:05.409034 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:33:05.409034 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:33:05.409034 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:33:05.409034 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:33:05.409034 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:33:05.409034 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:33:05.409034 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: a5f56376721941f8ae2293f8f969db84 Oct 19 03:33:05.409034 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ServerActionsTestJSON-1598778355 Oct 19 03:33:05.409034 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:33:05.409034 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:33:05.409034 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a5f56376721941f8ae2293f8f969db84"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a5f56376721941f8ae2293f8f969db84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a5f56376721941f8ae2293f8f969db84"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a5f56376721941f8ae2293f8f969db84", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:33:05.409034 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ServerActionsTestJSON-1598778355 Oct 19 03:33:05.409034 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: a5f56376721941f8ae2293f8f969db84 Oct 19 03:33:05.409034 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ServerActionsTestJSON-1598778355 Oct 19 03:33:05.409034 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ServerActionsTestJSON-1598778355-project Oct 19 03:33:05.409034 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:33:05.409034 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:33:05.409034 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 746e1034a7ee40c1a69c8838c1e17e16 Oct 19 03:33:05.409034 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ServerActionsTestJSON-1598778355-project Oct 19 03:33:05.409034 n-d-861333-8 devstack@n-api.service[121134]: Oct 19 03:33:05.409034 n-d-861333-8 devstack@n-api.service[121134]: {"os-stop": {}} Oct 19 03:33:05.409034 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:33:05.409034 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance 58b9ce4c-4a42-40ff-b8ed-b75de752b46f is locked Oct 19 03:33:05.409034 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '58b9ce4c-4a42-40ff-b8ed-b75de752b46f', 'body': {'os-stop': {}}} Oct 19 03:33:05.409034 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:33:05.409034 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:33:05.409034 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1458, in _stop_server Oct 19 03:33:05.409034 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance, clean_shutdown=clean_shutdown) Oct 19 03:33:05.409034 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Oct 19 03:33:05.409034 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Oct 19 03:33:05.409034 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance 58b9ce4c-4a42-40ff-b8ed-b75de752b46f is locked Oct 19 03:33:05.409034 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:33:05.409034 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:33:05.409034 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:33:05.409034 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:33:05.409034 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:33:05.409034 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:33:05.409034 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:33:05.409034 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:33:05.409034 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:33:05.409034 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:33:05.409034 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1460, in _stop_server Oct 19 03:33:05.409034 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Oct 19 03:33:05.409034 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance 58b9ce4c-4a42-40ff-b8ed-b75de752b46f is locked Oct 19 03:33:05.409034 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:33:05.409034 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:33:05.409034 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:33:05.409034 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:33:05.409034 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:33:05.409034 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:33:05.409034 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:33:05.409034 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:33:05.409034 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58b9ce4c-4a42-40ff-b8ed-b75de752b46f is locked Oct 19 03:33:05.409034 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:33:05.413340 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-42155410-73d8-4748-87f7-21d56d19eda4 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Returning 409 to user: Instance 58b9ce4c-4a42-40ff-b8ed-b75de752b46f is locked {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:33:05.413340 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-42155410-73d8-4748-87f7-21d56d19eda4 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "POST /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f/action" status: 409 len: 107 microversion: 2.1 time: 0.082932 Oct 19 03:33:05.414357 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2193/4468] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:33:05 2022] POST /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f/action => generated 107 bytes in 86 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 19 03:33:05.422833 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c879c86c-2fa1-4c4a-8ce6-5010f6100087 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:33:05.423384 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c879c86c-2fa1-4c4a-8ce6-5010f6100087 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:05.448441 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c879c86c-2fa1-4c4a-8ce6-5010f6100087 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:05.448825 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c879c86c-2fa1-4c4a-8ce6-5010f6100087 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:05.449270 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c879c86c-2fa1-4c4a-8ce6-5010f6100087 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:05.451303 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c879c86c-2fa1-4c4a-8ce6-5010f6100087 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:05.459112 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c879c86c-2fa1-4c4a-8ce6-5010f6100087 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:05.460516 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c879c86c-2fa1-4c4a-8ce6-5010f6100087 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:05.591230 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-8b32da38-d122-4e00-87ee-9cb3a5c39b43 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51efba80d21425aa86baa138fb99770', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec35cc1c3324178b6314ed3272aa8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:05.606402 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-8b32da38-d122-4e00-87ee-9cb3a5c39b43 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] 10.222.0.52 "GET /compute/v2.1/servers/61edfb81-28c2-4818-bb73-b141c418e6b0" status: 200 len: 1328 microversion: 2.1 time: 0.320890 Oct 19 03:33:05.607030 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2276/4469] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:05 2022] GET /compute/v2.1/servers/61edfb81-28c2-4818-bb73-b141c418e6b0 => generated 1328 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:33:05.637543 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c879c86c-2fa1-4c4a-8ce6-5010f6100087 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Unlocking {{(pid=121134) unlock /opt/stack/nova/nova/compute/api.py:4874}} Oct 19 03:33:05.711689 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ca5082f1-574f-4445-b5ac-fbdd47b243f1 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:05.713495 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ca5082f1-574f-4445-b5ac-fbdd47b243f1 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] [instance: a1c0df8b-0120-47bc-92da-36d257f61c8b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:05.722439 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ca5082f1-574f-4445-b5ac-fbdd47b243f1 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:05.723681 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ca5082f1-574f-4445-b5ac-fbdd47b243f1 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:05.724860 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ca5082f1-574f-4445-b5ac-fbdd47b243f1 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:05.725874 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ca5082f1-574f-4445-b5ac-fbdd47b243f1 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:05.726570 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ca5082f1-574f-4445-b5ac-fbdd47b243f1 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:05.727786 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ca5082f1-574f-4445-b5ac-fbdd47b243f1 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:05.866762 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c879c86c-2fa1-4c4a-8ce6-5010f6100087 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "POST /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f/action" status: 202 len: 0 microversion: 2.1 time: 0.449147 Oct 19 03:33:05.871845 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2194/4470] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:33:05 2022] POST /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f/action => generated 0 bytes in 455 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 19 03:33:05.878642 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3aaeea89-ccd3-4559-b91c-5b153e720b71 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:33:05.887961 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3aaeea89-ccd3-4559-b91c-5b153e720b71 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:05.888648 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3aaeea89-ccd3-4559-b91c-5b153e720b71 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:05.889397 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3aaeea89-ccd3-4559-b91c-5b153e720b71 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:05.918033 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3aaeea89-ccd3-4559-b91c-5b153e720b71 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Going to try to stop instance {{(pid=121134) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 19 03:33:06.026463 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ca5082f1-574f-4445-b5ac-fbdd47b243f1 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b748815c10a46d2adc26d5c8a1ba268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc49f9b6a0054092beda3ab313bff1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:06.034086 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ca5082f1-574f-4445-b5ac-fbdd47b243f1 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] 10.222.0.52 "GET /compute/v2.1/servers/a1c0df8b-0120-47bc-92da-36d257f61c8b" status: 200 len: 1322 microversion: 2.1 time: 0.326969 Oct 19 03:33:06.034668 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2277/4471] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:05 2022] GET /compute/v2.1/servers/a1c0df8b-0120-47bc-92da-36d257f61c8b => generated 1322 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:33:06.187113 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3aaeea89-ccd3-4559-b91c-5b153e720b71 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "POST /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f/action" status: 202 len: 0 microversion: 2.1 time: 0.312353 Oct 19 03:33:06.188600 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2195/4472] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:33:05 2022] POST /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f/action => generated 0 bytes in 316 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:33:06.198154 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a1c157bf-9f4c-413c-892b-237138584006 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:06.198817 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a1c157bf-9f4c-413c-892b-237138584006 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:06.206490 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a1c157bf-9f4c-413c-892b-237138584006 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:06.207739 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a1c157bf-9f4c-413c-892b-237138584006 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:06.209254 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a1c157bf-9f4c-413c-892b-237138584006 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:06.210239 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a1c157bf-9f4c-413c-892b-237138584006 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:06.210706 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a1c157bf-9f4c-413c-892b-237138584006 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:06.212131 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a1c157bf-9f4c-413c-892b-237138584006 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:06.288051 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c786116f-8512-4579-9c10-d60ac97649a9 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:06.288779 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c786116f-8512-4579-9c10-d60ac97649a9 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] [instance: 2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:06.295798 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c786116f-8512-4579-9c10-d60ac97649a9 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:06.296151 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c786116f-8512-4579-9c10-d60ac97649a9 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:06.296988 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c786116f-8512-4579-9c10-d60ac97649a9 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:06.297803 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c786116f-8512-4579-9c10-d60ac97649a9 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:06.298426 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c786116f-8512-4579-9c10-d60ac97649a9 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:06.299691 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c786116f-8512-4579-9c10-d60ac97649a9 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:06.670718 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a1c157bf-9f4c-413c-892b-237138584006 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:06.691526 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c786116f-8512-4579-9c10-d60ac97649a9 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33d07a7db4846ababf001493c6e10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb0265509744c93b03fa5c28b4e9386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:06.706892 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c786116f-8512-4579-9c10-d60ac97649a9 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] 10.222.0.52 "GET /compute/v2.1/servers/2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62" status: 200 len: 1505 microversion: 2.1 time: 0.423575 Oct 19 03:33:06.707965 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a1c157bf-9f4c-413c-892b-237138584006 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1680 microversion: 2.1 time: 0.514860 Oct 19 03:33:06.709664 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2196/4473] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:06 2022] GET /compute/v2.1/servers/2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62 => generated 1505 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:33:06.711985 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2278/4474] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:06 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1680 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:33:06.721226 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-cb21bf8a-baac-46c8-a3d5-7d84bc11983e tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:06.724639 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-cb21bf8a-baac-46c8-a3d5-7d84bc11983e tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] [instance: 61edfb81-28c2-4818-bb73-b141c418e6b0] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:06.764198 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cb21bf8a-baac-46c8-a3d5-7d84bc11983e tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:06.764198 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cb21bf8a-baac-46c8-a3d5-7d84bc11983e tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:06.764198 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cb21bf8a-baac-46c8-a3d5-7d84bc11983e tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:06.764198 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cb21bf8a-baac-46c8-a3d5-7d84bc11983e tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:06.764198 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cb21bf8a-baac-46c8-a3d5-7d84bc11983e tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:06.769017 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cb21bf8a-baac-46c8-a3d5-7d84bc11983e tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:07.004456 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-cb21bf8a-baac-46c8-a3d5-7d84bc11983e tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51efba80d21425aa86baa138fb99770', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec35cc1c3324178b6314ed3272aa8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:07.018800 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-cb21bf8a-baac-46c8-a3d5-7d84bc11983e tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] 10.222.0.52 "GET /compute/v2.1/servers/61edfb81-28c2-4818-bb73-b141c418e6b0" status: 200 len: 1328 microversion: 2.1 time: 0.305264 Oct 19 03:33:07.020278 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2197/4475] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:06 2022] GET /compute/v2.1/servers/61edfb81-28c2-4818-bb73-b141c418e6b0 => generated 1328 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:33:07.057406 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-258930e9-06a2-414d-815b-51879fb077a3 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:07.058740 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-258930e9-06a2-414d-815b-51879fb077a3 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] [instance: a1c0df8b-0120-47bc-92da-36d257f61c8b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:07.066112 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-258930e9-06a2-414d-815b-51879fb077a3 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:07.066938 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-258930e9-06a2-414d-815b-51879fb077a3 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:07.067567 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-258930e9-06a2-414d-815b-51879fb077a3 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:07.068656 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-258930e9-06a2-414d-815b-51879fb077a3 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:07.069446 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-258930e9-06a2-414d-815b-51879fb077a3 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:07.070191 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-258930e9-06a2-414d-815b-51879fb077a3 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:07.362373 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-258930e9-06a2-414d-815b-51879fb077a3 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b748815c10a46d2adc26d5c8a1ba268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc49f9b6a0054092beda3ab313bff1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:07.383244 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-258930e9-06a2-414d-815b-51879fb077a3 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] 10.222.0.52 "GET /compute/v2.1/servers/a1c0df8b-0120-47bc-92da-36d257f61c8b" status: 200 len: 1322 microversion: 2.1 time: 0.329396 Oct 19 03:33:07.384690 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2279/4476] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:07 2022] GET /compute/v2.1/servers/a1c0df8b-0120-47bc-92da-36d257f61c8b => generated 1322 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:33:07.736412 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-cdf8214c-272e-426d-b53a-43d9832bc5a9 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:07.746444 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-cdf8214c-272e-426d-b53a-43d9832bc5a9 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:07.749160 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f4c4b9a0-3447-4b79-afd4-f97f618ee0fe tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:07.749160 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f4c4b9a0-3447-4b79-afd4-f97f618ee0fe tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] [instance: 2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:07.753507 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cdf8214c-272e-426d-b53a-43d9832bc5a9 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:07.754269 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cdf8214c-272e-426d-b53a-43d9832bc5a9 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:07.754920 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cdf8214c-272e-426d-b53a-43d9832bc5a9 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:07.755665 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f4c4b9a0-3447-4b79-afd4-f97f618ee0fe tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:07.756632 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cdf8214c-272e-426d-b53a-43d9832bc5a9 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:07.757558 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f4c4b9a0-3447-4b79-afd4-f97f618ee0fe tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:07.758243 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cdf8214c-272e-426d-b53a-43d9832bc5a9 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:07.758695 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cdf8214c-272e-426d-b53a-43d9832bc5a9 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:07.759438 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f4c4b9a0-3447-4b79-afd4-f97f618ee0fe tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:07.762564 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f4c4b9a0-3447-4b79-afd4-f97f618ee0fe tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:07.764894 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f4c4b9a0-3447-4b79-afd4-f97f618ee0fe tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:07.765596 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f4c4b9a0-3447-4b79-afd4-f97f618ee0fe tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:08.433114 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f4c4b9a0-3447-4b79-afd4-f97f618ee0fe tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33d07a7db4846ababf001493c6e10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb0265509744c93b03fa5c28b4e9386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:08.448668 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f4c4b9a0-3447-4b79-afd4-f97f618ee0fe tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] 10.222.0.52 "GET /compute/v2.1/servers/2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62" status: 200 len: 1505 microversion: 2.1 time: 0.712774 Oct 19 03:33:08.450200 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2280/4477] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:07 2022] GET /compute/v2.1/servers/2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62 => generated 1505 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:33:08.456229 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-e02cc67d-26f8-49c1-88ec-8b5f207b8cf8 req-f4be4997-e80a-440c-81b5-cbad6cfca5f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1c0df8b-0120-47bc-92da-36d257f61c8b", "name": "network-vif-plugged", "status": "completed", "tag": "c171d5d3-26e8-4d7a-9d92-850c79a51e4c"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:33:08.473591 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-e02cc67d-26f8-49c1-88ec-8b5f207b8cf8 req-f4be4997-e80a-440c-81b5-cbad6cfca5f3 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:08.475027 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-e02cc67d-26f8-49c1-88ec-8b5f207b8cf8 req-f4be4997-e80a-440c-81b5-cbad6cfca5f3 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:08.475762 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-e02cc67d-26f8-49c1-88ec-8b5f207b8cf8 req-f4be4997-e80a-440c-81b5-cbad6cfca5f3 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:08.492690 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-e02cc67d-26f8-49c1-88ec-8b5f207b8cf8 req-f4be4997-e80a-440c-81b5-cbad6cfca5f3 service nova] Creating event network-vif-plugged:c171d5d3-26e8-4d7a-9d92-850c79a51e4c for instance a1c0df8b-0120-47bc-92da-36d257f61c8b on n-h2-861333-8 Oct 19 03:33:08.500076 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-e02cc67d-26f8-49c1-88ec-8b5f207b8cf8 req-f4be4997-e80a-440c-81b5-cbad6cfca5f3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047335 Oct 19 03:33:08.501995 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2281/4478] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:33:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:33:08.511590 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-8f1a0b1a-7892-455b-8b3e-42d8ddfd4636 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:08.513082 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-8f1a0b1a-7892-455b-8b3e-42d8ddfd4636 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] [instance: 61edfb81-28c2-4818-bb73-b141c418e6b0] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:08.524624 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8f1a0b1a-7892-455b-8b3e-42d8ddfd4636 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:08.525125 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8f1a0b1a-7892-455b-8b3e-42d8ddfd4636 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:08.525667 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8f1a0b1a-7892-455b-8b3e-42d8ddfd4636 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:08.526381 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8f1a0b1a-7892-455b-8b3e-42d8ddfd4636 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:08.527116 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8f1a0b1a-7892-455b-8b3e-42d8ddfd4636 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:08.527542 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8f1a0b1a-7892-455b-8b3e-42d8ddfd4636 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:08.562200 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-cdf8214c-272e-426d-b53a-43d9832bc5a9 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:08.579492 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-cdf8214c-272e-426d-b53a-43d9832bc5a9 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1680 microversion: 2.1 time: 0.846907 Oct 19 03:33:08.584436 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2198/4479] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:07 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1680 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:33:08.604880 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4cae8d9b-a2ac-4467-949a-b134cba1c8ad tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:08.605792 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4cae8d9b-a2ac-4467-949a-b134cba1c8ad tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] [instance: a1c0df8b-0120-47bc-92da-36d257f61c8b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:08.613428 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4cae8d9b-a2ac-4467-949a-b134cba1c8ad tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:08.614274 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4cae8d9b-a2ac-4467-949a-b134cba1c8ad tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:08.615784 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4cae8d9b-a2ac-4467-949a-b134cba1c8ad tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:08.616838 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4cae8d9b-a2ac-4467-949a-b134cba1c8ad tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:08.617956 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4cae8d9b-a2ac-4467-949a-b134cba1c8ad tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:08.618663 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4cae8d9b-a2ac-4467-949a-b134cba1c8ad tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:08.968695 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-8f1a0b1a-7892-455b-8b3e-42d8ddfd4636 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51efba80d21425aa86baa138fb99770', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec35cc1c3324178b6314ed3272aa8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:08.993086 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-4cae8d9b-a2ac-4467-949a-b134cba1c8ad tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b748815c10a46d2adc26d5c8a1ba268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc49f9b6a0054092beda3ab313bff1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:09.015593 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4cae8d9b-a2ac-4467-949a-b134cba1c8ad tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] 10.222.0.52 "GET /compute/v2.1/servers/a1c0df8b-0120-47bc-92da-36d257f61c8b" status: 200 len: 1322 microversion: 2.1 time: 0.429557 Oct 19 03:33:09.018227 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-8f1a0b1a-7892-455b-8b3e-42d8ddfd4636 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] 10.222.0.52 "GET /compute/v2.1/servers/61edfb81-28c2-4818-bb73-b141c418e6b0" status: 200 len: 1328 microversion: 2.1 time: 0.514151 Oct 19 03:33:09.018568 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2282/4480] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:08 2022] GET /compute/v2.1/servers/61edfb81-28c2-4818-bb73-b141c418e6b0 => generated 1328 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:33:09.021543 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2199/4481] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:08 2022] GET /compute/v2.1/servers/a1c0df8b-0120-47bc-92da-36d257f61c8b => generated 1322 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:33:09.476419 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b08f32b3-da9f-43af-94ce-6a85803ccedf tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:09.477042 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b08f32b3-da9f-43af-94ce-6a85803ccedf tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] [instance: 2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:09.490978 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b08f32b3-da9f-43af-94ce-6a85803ccedf tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:09.490978 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b08f32b3-da9f-43af-94ce-6a85803ccedf tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:09.491229 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b08f32b3-da9f-43af-94ce-6a85803ccedf tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:09.491736 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b08f32b3-da9f-43af-94ce-6a85803ccedf tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:09.495359 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b08f32b3-da9f-43af-94ce-6a85803ccedf tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:09.496084 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b08f32b3-da9f-43af-94ce-6a85803ccedf tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:09.610101 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7f894c1e-dd30-4de8-8ac2-50d3cee97293 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:09.617722 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7f894c1e-dd30-4de8-8ac2-50d3cee97293 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:09.623633 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7f894c1e-dd30-4de8-8ac2-50d3cee97293 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:09.624387 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7f894c1e-dd30-4de8-8ac2-50d3cee97293 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:09.625216 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7f894c1e-dd30-4de8-8ac2-50d3cee97293 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:09.626403 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7f894c1e-dd30-4de8-8ac2-50d3cee97293 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:09.627062 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7f894c1e-dd30-4de8-8ac2-50d3cee97293 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:09.627872 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7f894c1e-dd30-4de8-8ac2-50d3cee97293 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:09.865543 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b08f32b3-da9f-43af-94ce-6a85803ccedf tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33d07a7db4846ababf001493c6e10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb0265509744c93b03fa5c28b4e9386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:09.872197 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=100 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:33:09.875567 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b08f32b3-da9f-43af-94ce-6a85803ccedf tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] 10.222.0.52 "GET /compute/v2.1/servers/2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62" status: 200 len: 1505 microversion: 2.1 time: 0.403212 Oct 19 03:33:09.882214 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2283/4482] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:09 2022] GET /compute/v2.1/servers/2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62 => generated 1505 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:33:10.047076 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-490e95b0-22c7-47e6-a181-d5783990c509 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:10.047718 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-490e95b0-22c7-47e6-a181-d5783990c509 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] [instance: 61edfb81-28c2-4818-bb73-b141c418e6b0] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:10.062520 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-490e95b0-22c7-47e6-a181-d5783990c509 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:10.063029 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-490e95b0-22c7-47e6-a181-d5783990c509 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:10.063477 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-490e95b0-22c7-47e6-a181-d5783990c509 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:10.064204 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-490e95b0-22c7-47e6-a181-d5783990c509 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:10.064662 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-490e95b0-22c7-47e6-a181-d5783990c509 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:10.065295 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-490e95b0-22c7-47e6-a181-d5783990c509 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:10.188024 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-7f894c1e-dd30-4de8-8ac2-50d3cee97293 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:10.201517 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7f894c1e-dd30-4de8-8ac2-50d3cee97293 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1680 microversion: 2.1 time: 0.593797 Oct 19 03:33:10.204227 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2200/4483] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:09 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1680 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:33:10.214190 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7945c278-10e2-4c60-a3a7-814f7bde9168 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:10.214923 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7945c278-10e2-4c60-a3a7-814f7bde9168 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] [instance: a1c0df8b-0120-47bc-92da-36d257f61c8b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:10.248063 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7945c278-10e2-4c60-a3a7-814f7bde9168 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:10.248063 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7945c278-10e2-4c60-a3a7-814f7bde9168 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:10.248063 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7945c278-10e2-4c60-a3a7-814f7bde9168 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:10.248063 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7945c278-10e2-4c60-a3a7-814f7bde9168 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:10.248063 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7945c278-10e2-4c60-a3a7-814f7bde9168 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:10.248063 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7945c278-10e2-4c60-a3a7-814f7bde9168 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:10.709236 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-490e95b0-22c7-47e6-a181-d5783990c509 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51efba80d21425aa86baa138fb99770', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec35cc1c3324178b6314ed3272aa8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:10.726552 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-490e95b0-22c7-47e6-a181-d5783990c509 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] 10.222.0.52 "GET /compute/v2.1/servers/61edfb81-28c2-4818-bb73-b141c418e6b0" status: 200 len: 1328 microversion: 2.1 time: 0.678602 Oct 19 03:33:10.727614 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2284/4484] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:10 2022] GET /compute/v2.1/servers/61edfb81-28c2-4818-bb73-b141c418e6b0 => generated 1328 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:33:10.729881 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-7945c278-10e2-4c60-a3a7-814f7bde9168 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b748815c10a46d2adc26d5c8a1ba268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc49f9b6a0054092beda3ab313bff1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:10.744095 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7945c278-10e2-4c60-a3a7-814f7bde9168 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] 10.222.0.52 "GET /compute/v2.1/servers/a1c0df8b-0120-47bc-92da-36d257f61c8b" status: 200 len: 1472 microversion: 2.1 time: 0.540342 Oct 19 03:33:10.747146 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2201/4485] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:10 2022] GET /compute/v2.1/servers/a1c0df8b-0120-47bc-92da-36d257f61c8b => generated 1472 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:33:10.769583 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-aadf8d41-3648-4468-9b52-453685909d43 tempest-ServersAdminNegativeTestJSON-1716371534 tempest-ServersAdminNegativeTestJSON-1716371534-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:33:10.770495 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-aadf8d41-3648-4468-9b52-453685909d43 tempest-ServersAdminNegativeTestJSON-1716371534 tempest-ServersAdminNegativeTestJSON-1716371534-project-admin] [instance: a1c0df8b-0120-47bc-92da-36d257f61c8b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:10.791202 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aadf8d41-3648-4468-9b52-453685909d43 tempest-ServersAdminNegativeTestJSON-1716371534 tempest-ServersAdminNegativeTestJSON-1716371534-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:10.793155 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aadf8d41-3648-4468-9b52-453685909d43 tempest-ServersAdminNegativeTestJSON-1716371534 tempest-ServersAdminNegativeTestJSON-1716371534-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:10.794496 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aadf8d41-3648-4468-9b52-453685909d43 tempest-ServersAdminNegativeTestJSON-1716371534 tempest-ServersAdminNegativeTestJSON-1716371534-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:10.804591 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aadf8d41-3648-4468-9b52-453685909d43 tempest-ServersAdminNegativeTestJSON-1716371534 tempest-ServersAdminNegativeTestJSON-1716371534-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:10.805108 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aadf8d41-3648-4468-9b52-453685909d43 tempest-ServersAdminNegativeTestJSON-1716371534 tempest-ServersAdminNegativeTestJSON-1716371534-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:10.805598 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aadf8d41-3648-4468-9b52-453685909d43 tempest-ServersAdminNegativeTestJSON-1716371534 tempest-ServersAdminNegativeTestJSON-1716371534-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:10.857822 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-aadf8d41-3648-4468-9b52-453685909d43 tempest-ServersAdminNegativeTestJSON-1716371534 tempest-ServersAdminNegativeTestJSON-1716371534-project-admin] Lazy-loading 'flavor' on Instance uuid a1c0df8b-0120-47bc-92da-36d257f61c8b {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:33:10.909184 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a0edb61b-aa27-49fa-ba03-6c9acc203a2f tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:10.910304 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a0edb61b-aa27-49fa-ba03-6c9acc203a2f tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] [instance: 2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:10.923380 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a0edb61b-aa27-49fa-ba03-6c9acc203a2f tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:10.924005 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a0edb61b-aa27-49fa-ba03-6c9acc203a2f tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:10.924523 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a0edb61b-aa27-49fa-ba03-6c9acc203a2f tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:10.926324 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a0edb61b-aa27-49fa-ba03-6c9acc203a2f tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:10.927402 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a0edb61b-aa27-49fa-ba03-6c9acc203a2f tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:10.928027 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a0edb61b-aa27-49fa-ba03-6c9acc203a2f tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:11.173815 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a0edb61b-aa27-49fa-ba03-6c9acc203a2f tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33d07a7db4846ababf001493c6e10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb0265509744c93b03fa5c28b4e9386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:11.182384 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a0edb61b-aa27-49fa-ba03-6c9acc203a2f tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] 10.222.0.52 "GET /compute/v2.1/servers/2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62" status: 200 len: 1505 microversion: 2.1 time: 0.277061 Oct 19 03:33:11.199417 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2202/4486] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:10 2022] GET /compute/v2.1/servers/2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62 => generated 1505 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:33:11.232729 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b2a525b3-206c-46a6-aba1-c145a008fcee tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:11.234072 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b2a525b3-206c-46a6-aba1-c145a008fcee tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:11.243980 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b2a525b3-206c-46a6-aba1-c145a008fcee tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:11.244694 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b2a525b3-206c-46a6-aba1-c145a008fcee tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:11.245301 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b2a525b3-206c-46a6-aba1-c145a008fcee tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:11.246281 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b2a525b3-206c-46a6-aba1-c145a008fcee tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:11.246915 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b2a525b3-206c-46a6-aba1-c145a008fcee tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:11.251057 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b2a525b3-206c-46a6-aba1-c145a008fcee tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:11.279243 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=8,nova_cell1:INSERT=3 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:33:11.331387 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-aadf8d41-3648-4468-9b52-453685909d43 tempest-ServersAdminNegativeTestJSON-1716371534 tempest-ServersAdminNegativeTestJSON-1716371534-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/a1c0df8b-0120-47bc-92da-36d257f61c8b/action" status: 202 len: 0 microversion: 2.1 time: 0.565705 Oct 19 03:33:11.332096 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2285/4487] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:33:10 2022] POST /compute/v2.1/servers/a1c0df8b-0120-47bc-92da-36d257f61c8b/action => generated 0 bytes in 567 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:33:11.340860 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ce09fe3c-4e90-4082-b6d3-9b62e0b025f0 tempest-ServersAdminNegativeTestJSON-1716371534 tempest-ServersAdminNegativeTestJSON-1716371534-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:11.347079 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ce09fe3c-4e90-4082-b6d3-9b62e0b025f0 tempest-ServersAdminNegativeTestJSON-1716371534 tempest-ServersAdminNegativeTestJSON-1716371534-project-admin] [instance: a1c0df8b-0120-47bc-92da-36d257f61c8b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:11.371092 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ce09fe3c-4e90-4082-b6d3-9b62e0b025f0 tempest-ServersAdminNegativeTestJSON-1716371534 tempest-ServersAdminNegativeTestJSON-1716371534-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:11.371584 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ce09fe3c-4e90-4082-b6d3-9b62e0b025f0 tempest-ServersAdminNegativeTestJSON-1716371534 tempest-ServersAdminNegativeTestJSON-1716371534-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:11.380865 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ce09fe3c-4e90-4082-b6d3-9b62e0b025f0 tempest-ServersAdminNegativeTestJSON-1716371534 tempest-ServersAdminNegativeTestJSON-1716371534-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:11.388045 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ce09fe3c-4e90-4082-b6d3-9b62e0b025f0 tempest-ServersAdminNegativeTestJSON-1716371534 tempest-ServersAdminNegativeTestJSON-1716371534-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:11.388538 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ce09fe3c-4e90-4082-b6d3-9b62e0b025f0 tempest-ServersAdminNegativeTestJSON-1716371534 tempest-ServersAdminNegativeTestJSON-1716371534-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:11.388982 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ce09fe3c-4e90-4082-b6d3-9b62e0b025f0 tempest-ServersAdminNegativeTestJSON-1716371534 tempest-ServersAdminNegativeTestJSON-1716371534-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:11.456214 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b2a525b3-206c-46a6-aba1-c145a008fcee tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:11.466225 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b2a525b3-206c-46a6-aba1-c145a008fcee tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1680 microversion: 2.1 time: 0.239288 Oct 19 03:33:11.477402 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2203/4488] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:11 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1680 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:33:11.771860 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e110ecfb-a402-43c3-9fd0-e5ea58c2354c tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:11.772804 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e110ecfb-a402-43c3-9fd0-e5ea58c2354c tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] [instance: 61edfb81-28c2-4818-bb73-b141c418e6b0] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:11.779636 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e110ecfb-a402-43c3-9fd0-e5ea58c2354c tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:11.780328 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e110ecfb-a402-43c3-9fd0-e5ea58c2354c tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:11.781063 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e110ecfb-a402-43c3-9fd0-e5ea58c2354c tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:11.782007 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e110ecfb-a402-43c3-9fd0-e5ea58c2354c tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:11.782694 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e110ecfb-a402-43c3-9fd0-e5ea58c2354c tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:11.783317 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e110ecfb-a402-43c3-9fd0-e5ea58c2354c tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:11.954784 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ce09fe3c-4e90-4082-b6d3-9b62e0b025f0 tempest-ServersAdminNegativeTestJSON-1716371534 tempest-ServersAdminNegativeTestJSON-1716371534-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/a1c0df8b-0120-47bc-92da-36d257f61c8b" status: 200 len: 1631 microversion: 2.1 time: 0.618086 Oct 19 03:33:11.957246 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2286/4489] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:11 2022] GET /compute/v2.1/servers/a1c0df8b-0120-47bc-92da-36d257f61c8b => generated 1631 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:33:12.065523 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-5f7b3fb1-ce21-4c88-b885-5c32134b6e64 req-15781d83-f768-4906-84ad-2426bac26eb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61edfb81-28c2-4818-bb73-b141c418e6b0", "name": "network-vif-plugged", "status": "completed", "tag": "ab8a932f-7561-49a4-9d1a-6e518eaa83d4"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:33:12.097710 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e110ecfb-a402-43c3-9fd0-e5ea58c2354c tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51efba80d21425aa86baa138fb99770', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec35cc1c3324178b6314ed3272aa8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:12.105716 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-5f7b3fb1-ce21-4c88-b885-5c32134b6e64 req-15781d83-f768-4906-84ad-2426bac26eb3 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:12.109032 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-5f7b3fb1-ce21-4c88-b885-5c32134b6e64 req-15781d83-f768-4906-84ad-2426bac26eb3 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:12.109982 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-5f7b3fb1-ce21-4c88-b885-5c32134b6e64 req-15781d83-f768-4906-84ad-2426bac26eb3 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:12.113357 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e110ecfb-a402-43c3-9fd0-e5ea58c2354c tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] 10.222.0.52 "GET /compute/v2.1/servers/61edfb81-28c2-4818-bb73-b141c418e6b0" status: 200 len: 1328 microversion: 2.1 time: 0.346244 Oct 19 03:33:12.135026 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2204/4490] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:11 2022] GET /compute/v2.1/servers/61edfb81-28c2-4818-bb73-b141c418e6b0 => generated 1328 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:33:12.151847 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-5f7b3fb1-ce21-4c88-b885-5c32134b6e64 req-15781d83-f768-4906-84ad-2426bac26eb3 service nova] Creating event network-vif-plugged:ab8a932f-7561-49a4-9d1a-6e518eaa83d4 for instance 61edfb81-28c2-4818-bb73-b141c418e6b0 on n-h1-861333-8 Oct 19 03:33:12.165311 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-5f7b3fb1-ce21-4c88-b885-5c32134b6e64 req-15781d83-f768-4906-84ad-2426bac26eb3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104446 Oct 19 03:33:12.167199 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2287/4491] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:33:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:33:12.226275 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-fe66647d-2c14-412d-8270-19b4f8d2e668 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:12.238209 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-fe66647d-2c14-412d-8270-19b4f8d2e668 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] [instance: 2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:12.273158 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fe66647d-2c14-412d-8270-19b4f8d2e668 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:12.275060 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fe66647d-2c14-412d-8270-19b4f8d2e668 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:12.276155 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fe66647d-2c14-412d-8270-19b4f8d2e668 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:12.277146 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fe66647d-2c14-412d-8270-19b4f8d2e668 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:12.279834 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fe66647d-2c14-412d-8270-19b4f8d2e668 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:12.281257 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fe66647d-2c14-412d-8270-19b4f8d2e668 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:12.494064 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-51a7f1a2-67c9-4b0c-af87-c5b9bc6c3f10 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:12.495434 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-51a7f1a2-67c9-4b0c-af87-c5b9bc6c3f10 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:12.515620 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-51a7f1a2-67c9-4b0c-af87-c5b9bc6c3f10 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:12.518608 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-51a7f1a2-67c9-4b0c-af87-c5b9bc6c3f10 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:12.526724 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-51a7f1a2-67c9-4b0c-af87-c5b9bc6c3f10 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:12.529756 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-51a7f1a2-67c9-4b0c-af87-c5b9bc6c3f10 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:12.530654 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-51a7f1a2-67c9-4b0c-af87-c5b9bc6c3f10 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:12.532341 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-51a7f1a2-67c9-4b0c-af87-c5b9bc6c3f10 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:12.741110 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-fe66647d-2c14-412d-8270-19b4f8d2e668 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33d07a7db4846ababf001493c6e10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb0265509744c93b03fa5c28b4e9386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:12.756295 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-fe66647d-2c14-412d-8270-19b4f8d2e668 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] 10.222.0.52 "GET /compute/v2.1/servers/2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62" status: 200 len: 1505 microversion: 2.1 time: 0.536094 Oct 19 03:33:12.779484 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2205/4492] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:12 2022] GET /compute/v2.1/servers/2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62 => generated 1505 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:33:12.902879 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-51a7f1a2-67c9-4b0c-af87-c5b9bc6c3f10 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:12.915327 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-51a7f1a2-67c9-4b0c-af87-c5b9bc6c3f10 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1680 microversion: 2.1 time: 0.426609 Oct 19 03:33:12.918535 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2288/4493] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:12 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1680 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:33:12.980776 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-02f16cc0-69dc-407d-b87b-dff22006cdaf tempest-ServersAdminNegativeTestJSON-1716371534 tempest-ServersAdminNegativeTestJSON-1716371534-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:12.982793 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-02f16cc0-69dc-407d-b87b-dff22006cdaf tempest-ServersAdminNegativeTestJSON-1716371534 tempest-ServersAdminNegativeTestJSON-1716371534-project-admin] [instance: a1c0df8b-0120-47bc-92da-36d257f61c8b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:12.989331 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-02f16cc0-69dc-407d-b87b-dff22006cdaf tempest-ServersAdminNegativeTestJSON-1716371534 tempest-ServersAdminNegativeTestJSON-1716371534-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:12.990484 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-02f16cc0-69dc-407d-b87b-dff22006cdaf tempest-ServersAdminNegativeTestJSON-1716371534 tempest-ServersAdminNegativeTestJSON-1716371534-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:12.991147 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-02f16cc0-69dc-407d-b87b-dff22006cdaf tempest-ServersAdminNegativeTestJSON-1716371534 tempest-ServersAdminNegativeTestJSON-1716371534-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:12.991875 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-02f16cc0-69dc-407d-b87b-dff22006cdaf tempest-ServersAdminNegativeTestJSON-1716371534 tempest-ServersAdminNegativeTestJSON-1716371534-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:12.992514 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-02f16cc0-69dc-407d-b87b-dff22006cdaf tempest-ServersAdminNegativeTestJSON-1716371534 tempest-ServersAdminNegativeTestJSON-1716371534-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:12.992960 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-02f16cc0-69dc-407d-b87b-dff22006cdaf tempest-ServersAdminNegativeTestJSON-1716371534 tempest-ServersAdminNegativeTestJSON-1716371534-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:13.144346 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-41861fcf-d8c5-4255-af65-d96d931a4c30 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:13.145865 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-41861fcf-d8c5-4255-af65-d96d931a4c30 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] [instance: 61edfb81-28c2-4818-bb73-b141c418e6b0] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:13.160346 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-41861fcf-d8c5-4255-af65-d96d931a4c30 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:13.160873 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-41861fcf-d8c5-4255-af65-d96d931a4c30 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:13.161357 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-41861fcf-d8c5-4255-af65-d96d931a4c30 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:13.166119 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-41861fcf-d8c5-4255-af65-d96d931a4c30 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:13.166608 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-41861fcf-d8c5-4255-af65-d96d931a4c30 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:13.167053 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-41861fcf-d8c5-4255-af65-d96d931a4c30 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:13.193247 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-02f16cc0-69dc-407d-b87b-dff22006cdaf tempest-ServersAdminNegativeTestJSON-1716371534 tempest-ServersAdminNegativeTestJSON-1716371534-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/a1c0df8b-0120-47bc-92da-36d257f61c8b" status: 200 len: 1614 microversion: 2.1 time: 0.215664 Oct 19 03:33:13.211524 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2206/4494] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:12 2022] GET /compute/v2.1/servers/a1c0df8b-0120-47bc-92da-36d257f61c8b => generated 1614 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:33:13.221979 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-38f65461-ee0e-466a-b6ae-473f0be46c67 tempest-ServersAdminNegativeTestJSON-1716371534 tempest-ServersAdminNegativeTestJSON-1716371534-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:33:13.226129 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-38f65461-ee0e-466a-b6ae-473f0be46c67 tempest-ServersAdminNegativeTestJSON-1716371534 tempest-ServersAdminNegativeTestJSON-1716371534-project-admin] [instance: a1c0df8b-0120-47bc-92da-36d257f61c8b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:13.240152 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-38f65461-ee0e-466a-b6ae-473f0be46c67 tempest-ServersAdminNegativeTestJSON-1716371534 tempest-ServersAdminNegativeTestJSON-1716371534-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:13.243888 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-38f65461-ee0e-466a-b6ae-473f0be46c67 tempest-ServersAdminNegativeTestJSON-1716371534 tempest-ServersAdminNegativeTestJSON-1716371534-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:13.244353 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-38f65461-ee0e-466a-b6ae-473f0be46c67 tempest-ServersAdminNegativeTestJSON-1716371534 tempest-ServersAdminNegativeTestJSON-1716371534-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:13.245103 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-38f65461-ee0e-466a-b6ae-473f0be46c67 tempest-ServersAdminNegativeTestJSON-1716371534 tempest-ServersAdminNegativeTestJSON-1716371534-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:13.246926 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-38f65461-ee0e-466a-b6ae-473f0be46c67 tempest-ServersAdminNegativeTestJSON-1716371534 tempest-ServersAdminNegativeTestJSON-1716371534-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:13.247387 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-38f65461-ee0e-466a-b6ae-473f0be46c67 tempest-ServersAdminNegativeTestJSON-1716371534 tempest-ServersAdminNegativeTestJSON-1716371534-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:13.277975 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-38f65461-ee0e-466a-b6ae-473f0be46c67 tempest-ServersAdminNegativeTestJSON-1716371534 tempest-ServersAdminNegativeTestJSON-1716371534-project-admin] HTTP exception thrown: Cannot 'migrate' instance a1c0df8b-0120-47bc-92da-36d257f61c8b while it is in vm_state suspended Oct 19 03:33:13.280981 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-38f65461-ee0e-466a-b6ae-473f0be46c67 tempest-ServersAdminNegativeTestJSON-1716371534 tempest-ServersAdminNegativeTestJSON-1716371534-project-admin] Request method failure captured: Oct 19 03:33:13.280981 n-d-861333-8 devstack@n-api.service[121134]: request: POST /compute/v2.1/servers/a1c0df8b-0120-47bc-92da-36d257f61c8b/action HTTP/1.1 Oct 19 03:33:13.280981 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:33:13.280981 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:33:13.280981 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:33:13.280981 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 15 Oct 19 03:33:13.280981 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:33:13.280981 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:33:13.280981 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:33:13.280981 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:33:13.280981 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT2-6OQkmuXXeGnmybGM9n9uWz4Yu5twJWKgj1uL2LM1Ques3jMY69lUF37IJoUE_xe47lD6ERfwi1jYQABpj1Txn04mstLRqsJ9VKzIxBq_AkFisBMW5vCnXkxzb4PQK7U-TjWqvE40SjSNpXhKWpHcdtqNpZ05_wGtNEK1XCN_8-rc Oct 19 03:33:13.280981 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:33:13.280981 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:33:13.280981 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:33:13.280981 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:33:13.280981 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:33:13.280981 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:33:13.280981 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 60c24e25fed448cfa17977fd99d015d5 Oct 19 03:33:13.280981 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1716371534 Oct 19 03:33:13.280981 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member,admin Oct 19 03:33:13.280981 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member,admin Oct 19 03:33:13.280981 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/60c24e25fed448cfa17977fd99d015d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/60c24e25fed448cfa17977fd99d015d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/60c24e25fed448cfa17977fd99d015d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_60c24e25fed448cfa17977fd99d015d5", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:33:13.280981 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1716371534 Oct 19 03:33:13.280981 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 60c24e25fed448cfa17977fd99d015d5 Oct 19 03:33:13.280981 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1716371534 Oct 19 03:33:13.280981 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ServersAdminNegativeTestJSON-1716371534-project-admin Oct 19 03:33:13.280981 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:33:13.280981 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:33:13.280981 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 937cb8656d304a6f9523d638d15e23a6 Oct 19 03:33:13.280981 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1716371534-project-admin Oct 19 03:33:13.280981 n-d-861333-8 devstack@n-api.service[121134]: Oct 19 03:33:13.280981 n-d-861333-8 devstack@n-api.service[121134]: {"migrate": {}} Oct 19 03:33:13.280981 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:33:13.280981 n-d-861333-8 devstack@n-api.service[121134]: exception: Cannot 'migrate' instance a1c0df8b-0120-47bc-92da-36d257f61c8b while it is in vm_state suspended Oct 19 03:33:13.280981 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': 'a1c0df8b-0120-47bc-92da-36d257f61c8b', 'body': {'migrate': {}}} Oct 19 03:33:13.280981 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:33:13.280981 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:33:13.280981 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Oct 19 03:33:13.280981 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Oct 19 03:33:13.280981 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 19 03:33:13.280981 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 19 03:33:13.280981 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 19 03:33:13.280981 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 19 03:33:13.280981 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 19 03:33:13.280981 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 19 03:33:13.280981 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 19 03:33:13.280981 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 19 03:33:13.280981 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 19 03:33:13.280981 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 19 03:33:13.280981 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a1c0df8b-0120-47bc-92da-36d257f61c8b in vm_state suspended. Cannot resize while the instance is in this state. Oct 19 03:33:13.280981 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:33:13.280981 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:33:13.280981 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:33:13.280981 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:33:13.280981 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:33:13.280981 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:33:13.280981 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:33:13.280981 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:33:13.280981 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:33:13.280981 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:33:13.280981 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:33:13.280981 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:33:13.280981 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Oct 19 03:33:13.286704 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 19 03:33:13.286704 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 19 03:33:13.286704 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 19 03:33:13.286704 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance a1c0df8b-0120-47bc-92da-36d257f61c8b while it is in vm_state suspended Oct 19 03:33:13.286704 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:33:13.286704 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:33:13.286704 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:33:13.286704 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:33:13.286704 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:33:13.286704 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:33:13.286704 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:33:13.286704 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:33:13.286704 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance a1c0df8b-0120-47bc-92da-36d257f61c8b while it is in vm_state suspended Oct 19 03:33:13.286704 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:33:13.288555 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-38f65461-ee0e-466a-b6ae-473f0be46c67 tempest-ServersAdminNegativeTestJSON-1716371534 tempest-ServersAdminNegativeTestJSON-1716371534-project-admin] Returning 409 to user: Cannot 'migrate' instance a1c0df8b-0120-47bc-92da-36d257f61c8b while it is in vm_state suspended {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:33:13.290303 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-38f65461-ee0e-466a-b6ae-473f0be46c67 tempest-ServersAdminNegativeTestJSON-1716371534 tempest-ServersAdminNegativeTestJSON-1716371534-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/a1c0df8b-0120-47bc-92da-36d257f61c8b/action" status: 409 len: 148 microversion: 2.1 time: 0.072211 Oct 19 03:33:13.300556 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2207/4495] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:33:13 2022] POST /compute/v2.1/servers/a1c0df8b-0120-47bc-92da-36d257f61c8b/action => generated 148 bytes in 80 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 19 03:33:13.306899 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0b286f95-1618-4485-8cb1-f61af444e693 tempest-ServersAdminNegativeTestJSON-1716371534 tempest-ServersAdminNegativeTestJSON-1716371534-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:33:13.311221 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0b286f95-1618-4485-8cb1-f61af444e693 tempest-ServersAdminNegativeTestJSON-1716371534 tempest-ServersAdminNegativeTestJSON-1716371534-project-admin] Request method failure captured: Oct 19 03:33:13.311221 n-d-861333-8 devstack@n-api.service[121134]: request: POST /compute/v2.1/servers/eb87cd67-6681-435d-9a65-56a2a06aaccb/action HTTP/1.1 Oct 19 03:33:13.311221 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:33:13.311221 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:33:13.311221 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:33:13.311221 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 39 Oct 19 03:33:13.311221 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:33:13.311221 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:33:13.311221 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:33:13.311221 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:33:13.311221 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT2-6OQkmuXXeGnmybGM9n9uWz4Yu5twJWKgj1uL2LM1Ques3jMY69lUF37IJoUE_xe47lD6ERfwi1jYQABpj1Txn04mstLRqsJ9VKzIxBq_AkFisBMW5vCnXkxzb4PQK7U-TjWqvE40SjSNpXhKWpHcdtqNpZ05_wGtNEK1XCN_8-rc Oct 19 03:33:13.311221 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:33:13.311221 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:33:13.311221 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:33:13.311221 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:33:13.311221 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:33:13.311221 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:33:13.311221 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 60c24e25fed448cfa17977fd99d015d5 Oct 19 03:33:13.311221 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1716371534 Oct 19 03:33:13.311221 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member,admin Oct 19 03:33:13.311221 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member,admin Oct 19 03:33:13.311221 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/60c24e25fed448cfa17977fd99d015d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/60c24e25fed448cfa17977fd99d015d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/60c24e25fed448cfa17977fd99d015d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_60c24e25fed448cfa17977fd99d015d5", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:33:13.311221 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1716371534 Oct 19 03:33:13.311221 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 60c24e25fed448cfa17977fd99d015d5 Oct 19 03:33:13.311221 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1716371534 Oct 19 03:33:13.311221 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ServersAdminNegativeTestJSON-1716371534-project-admin Oct 19 03:33:13.311221 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:33:13.311221 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:33:13.311221 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 937cb8656d304a6f9523d638d15e23a6 Oct 19 03:33:13.311221 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1716371534-project-admin Oct 19 03:33:13.311221 n-d-861333-8 devstack@n-api.service[121134]: Oct 19 03:33:13.311221 n-d-861333-8 devstack@n-api.service[121134]: {"os-resetState": {"state": "invalid"}} Oct 19 03:33:13.311221 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:33:13.311221 n-d-861333-8 devstack@n-api.service[121134]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 19 03:33:13.311221 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': 'eb87cd67-6681-435d-9a65-56a2a06aaccb', 'body': {'os-resetState': {'state': 'invalid'}}} Oct 19 03:33:13.311221 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:33:13.311221 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:33:13.311221 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 03:33:13.311221 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 03:33:13.311221 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 03:33:13.311221 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise error Oct 19 03:33:13.311221 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Oct 19 03:33:13.311221 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:33:13.311221 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Oct 19 03:33:13.311221 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 19 03:33:13.311221 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:33:13.311221 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 19 03:33:13.311221 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi 'invalid' Oct 19 03:33:13.311221 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:33:13.311221 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:33:13.311221 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:33:13.311221 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:33:13.311221 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:33:13.311221 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:33:13.311221 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:33:13.311221 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:33:13.311221 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:33:13.311221 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:33:13.311221 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 03:33:13.311221 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 03:33:13.311221 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 03:33:13.311221 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 03:33:13.311221 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 03:33:13.311221 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 03:33:13.326638 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 19 03:33:13.326638 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:33:13.326638 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:33:13.326638 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:33:13.326638 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:33:13.326638 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:33:13.326638 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:33:13.326638 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 03:33:13.326638 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 03:33:13.326638 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 19 03:33:13.326638 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:33:13.326638 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0b286f95-1618-4485-8cb1-f61af444e693 tempest-ServersAdminNegativeTestJSON-1716371534 tempest-ServersAdminNegativeTestJSON-1716371534-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:33:13.326638 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0b286f95-1618-4485-8cb1-f61af444e693 tempest-ServersAdminNegativeTestJSON-1716371534 tempest-ServersAdminNegativeTestJSON-1716371534-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/eb87cd67-6681-435d-9a65-56a2a06aaccb/action" status: 400 len: 144 microversion: 2.1 time: 0.011569 Oct 19 03:33:13.333554 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2208/4496] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:33:13 2022] POST /compute/v2.1/servers/eb87cd67-6681-435d-9a65-56a2a06aaccb/action => generated 144 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 03:33:13.341171 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9e1ef1a5-86a3-41c2-80c1-3a4a2f2115e2 tempest-ServersAdminNegativeTestJSON-1716371534 tempest-ServersAdminNegativeTestJSON-1716371534-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:33:13.347030 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9e1ef1a5-86a3-41c2-80c1-3a4a2f2115e2 tempest-ServersAdminNegativeTestJSON-1716371534 tempest-ServersAdminNegativeTestJSON-1716371534-project-admin] Request method failure captured: Oct 19 03:33:13.347030 n-d-861333-8 devstack@n-api.service[121134]: request: POST /compute/v2.1/servers/eb87cd67-6681-435d-9a65-56a2a06aaccb/action HTTP/1.1 Oct 19 03:33:13.347030 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:33:13.347030 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:33:13.347030 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:33:13.347030 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 31 Oct 19 03:33:13.347030 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:33:13.347030 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:33:13.347030 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:33:13.347030 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:33:13.347030 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT2-6OQkmuXXeGnmybGM9n9uWz4Yu5twJWKgj1uL2LM1Ques3jMY69lUF37IJoUE_xe47lD6ERfwi1jYQABpj1Txn04mstLRqsJ9VKzIxBq_AkFisBMW5vCnXkxzb4PQK7U-TjWqvE40SjSNpXhKWpHcdtqNpZ05_wGtNEK1XCN_8-rc Oct 19 03:33:13.347030 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:33:13.347030 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:33:13.347030 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:33:13.347030 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:33:13.347030 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:33:13.347030 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:33:13.347030 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 60c24e25fed448cfa17977fd99d015d5 Oct 19 03:33:13.347030 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1716371534 Oct 19 03:33:13.347030 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member,admin Oct 19 03:33:13.347030 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member,admin Oct 19 03:33:13.347030 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/60c24e25fed448cfa17977fd99d015d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/60c24e25fed448cfa17977fd99d015d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/60c24e25fed448cfa17977fd99d015d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_60c24e25fed448cfa17977fd99d015d5", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:33:13.347030 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1716371534 Oct 19 03:33:13.347030 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 60c24e25fed448cfa17977fd99d015d5 Oct 19 03:33:13.347030 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1716371534 Oct 19 03:33:13.347030 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ServersAdminNegativeTestJSON-1716371534-project-admin Oct 19 03:33:13.347030 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:33:13.347030 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:33:13.347030 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 937cb8656d304a6f9523d638d15e23a6 Oct 19 03:33:13.347030 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1716371534-project-admin Oct 19 03:33:13.347030 n-d-861333-8 devstack@n-api.service[121134]: Oct 19 03:33:13.347030 n-d-861333-8 devstack@n-api.service[121134]: {"os-resetState": {"state": 1}} Oct 19 03:33:13.347030 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:33:13.347030 n-d-861333-8 devstack@n-api.service[121134]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 19 03:33:13.347030 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': 'eb87cd67-6681-435d-9a65-56a2a06aaccb', 'body': {'os-resetState': {'state': 1}}} Oct 19 03:33:13.347030 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:33:13.347030 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:33:13.347030 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 03:33:13.347030 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 03:33:13.347030 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 03:33:13.347030 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise error Oct 19 03:33:13.347030 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Oct 19 03:33:13.347030 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:33:13.347030 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Oct 19 03:33:13.347030 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 19 03:33:13.347030 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:33:13.347030 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 19 03:33:13.347030 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi 1 Oct 19 03:33:13.347030 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:33:13.347030 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:33:13.347030 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:33:13.347030 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:33:13.347030 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:33:13.347030 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:33:13.347030 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:33:13.347030 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:33:13.347030 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:33:13.347030 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:33:13.347030 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 03:33:13.347030 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 03:33:13.347030 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 03:33:13.347030 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 03:33:13.347030 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 03:33:13.347030 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 03:33:13.347030 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 19 03:33:13.347030 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:33:13.354065 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:33:13.354065 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:33:13.354065 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:33:13.354065 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:33:13.354065 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:33:13.354065 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 03:33:13.354065 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 03:33:13.354065 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 19 03:33:13.354065 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:33:13.354065 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9e1ef1a5-86a3-41c2-80c1-3a4a2f2115e2 tempest-ServersAdminNegativeTestJSON-1716371534 tempest-ServersAdminNegativeTestJSON-1716371534-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:33:13.354065 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9e1ef1a5-86a3-41c2-80c1-3a4a2f2115e2 tempest-ServersAdminNegativeTestJSON-1716371534 tempest-ServersAdminNegativeTestJSON-1716371534-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/eb87cd67-6681-435d-9a65-56a2a06aaccb/action" status: 400 len: 120 microversion: 2.1 time: 0.014421 Oct 19 03:33:13.370637 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2209/4497] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:33:13 2022] POST /compute/v2.1/servers/eb87cd67-6681-435d-9a65-56a2a06aaccb/action => generated 120 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 03:33:13.400961 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e574cd23-28e5-4419-bed7-391f8508eea5 tempest-ServersAdminNegativeTestJSON-1716371534 tempest-ServersAdminNegativeTestJSON-1716371534-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:33:13.405000 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e574cd23-28e5-4419-bed7-391f8508eea5 tempest-ServersAdminNegativeTestJSON-1716371534 tempest-ServersAdminNegativeTestJSON-1716371534-project-admin] Failed to fetch instance by id 999 {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 19 03:33:13.406279 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-e574cd23-28e5-4419-bed7-391f8508eea5 tempest-ServersAdminNegativeTestJSON-1716371534 tempest-ServersAdminNegativeTestJSON-1716371534-project-admin] HTTP exception thrown: Instance 999 could not be found. Oct 19 03:33:13.414439 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e574cd23-28e5-4419-bed7-391f8508eea5 tempest-ServersAdminNegativeTestJSON-1716371534 tempest-ServersAdminNegativeTestJSON-1716371534-project-admin] Request method failure captured: Oct 19 03:33:13.414439 n-d-861333-8 devstack@n-api.service[121134]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Oct 19 03:33:13.414439 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:33:13.414439 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:33:13.414439 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:33:13.414439 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 37 Oct 19 03:33:13.414439 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:33:13.414439 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:33:13.414439 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:33:13.414439 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:33:13.414439 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT2-6OQkmuXXeGnmybGM9n9uWz4Yu5twJWKgj1uL2LM1Ques3jMY69lUF37IJoUE_xe47lD6ERfwi1jYQABpj1Txn04mstLRqsJ9VKzIxBq_AkFisBMW5vCnXkxzb4PQK7U-TjWqvE40SjSNpXhKWpHcdtqNpZ05_wGtNEK1XCN_8-rc Oct 19 03:33:13.414439 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:33:13.414439 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:33:13.414439 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:33:13.414439 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:33:13.414439 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:33:13.414439 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:33:13.414439 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 60c24e25fed448cfa17977fd99d015d5 Oct 19 03:33:13.414439 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1716371534 Oct 19 03:33:13.414439 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member,admin Oct 19 03:33:13.414439 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member,admin Oct 19 03:33:13.414439 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/60c24e25fed448cfa17977fd99d015d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/60c24e25fed448cfa17977fd99d015d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/60c24e25fed448cfa17977fd99d015d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_60c24e25fed448cfa17977fd99d015d5", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:33:13.414439 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1716371534 Oct 19 03:33:13.414439 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 60c24e25fed448cfa17977fd99d015d5 Oct 19 03:33:13.414439 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1716371534 Oct 19 03:33:13.414439 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ServersAdminNegativeTestJSON-1716371534-project-admin Oct 19 03:33:13.414439 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:33:13.414439 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:33:13.414439 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 937cb8656d304a6f9523d638d15e23a6 Oct 19 03:33:13.414439 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1716371534-project-admin Oct 19 03:33:13.414439 n-d-861333-8 devstack@n-api.service[121134]: Oct 19 03:33:13.414439 n-d-861333-8 devstack@n-api.service[121134]: {"os-resetState": {"state": "error"}} Oct 19 03:33:13.414439 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:33:13.414439 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance 999 could not be found. Oct 19 03:33:13.414439 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Oct 19 03:33:13.414439 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:33:13.414439 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:33:13.414439 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:33:13.414439 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:33:13.414439 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 19 03:33:13.414439 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 19 03:33:13.414439 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 19 03:33:13.414439 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:33:13.414439 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:33:13.414439 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:33:13.414439 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:33:13.414439 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:33:13.414439 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:33:13.414439 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:33:13.414439 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:33:13.414439 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:33:13.414439 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:33:13.414439 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:33:13.414439 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:33:13.414439 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Oct 19 03:33:13.414439 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 19 03:33:13.414439 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:33:13.414439 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:33:13.414439 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 19 03:33:13.414439 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:33:13.414439 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:33:13.414439 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:33:13.414439 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:33:13.414439 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:33:13.414439 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:33:13.414439 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:33:13.418924 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:33:13.418924 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 19 03:33:13.418924 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:33:13.421572 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e574cd23-28e5-4419-bed7-391f8508eea5 tempest-ServersAdminNegativeTestJSON-1716371534 tempest-ServersAdminNegativeTestJSON-1716371534-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:33:13.422820 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e574cd23-28e5-4419-bed7-391f8508eea5 tempest-ServersAdminNegativeTestJSON-1716371534 tempest-ServersAdminNegativeTestJSON-1716371534-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.036616 Oct 19 03:33:13.429080 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2210/4498] 10.222.0.52 () {60 vars in 1179 bytes} [Wed Oct 19 03:33:13 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 03:33:13.437828 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f43882cc-9ae9-454b-ace1-0f8e1449db85 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:13.438893 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f43882cc-9ae9-454b-ace1-0f8e1449db85 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] [instance: a1c0df8b-0120-47bc-92da-36d257f61c8b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:13.442323 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-41861fcf-d8c5-4255-af65-d96d931a4c30 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51efba80d21425aa86baa138fb99770', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec35cc1c3324178b6314ed3272aa8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:13.448771 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f43882cc-9ae9-454b-ace1-0f8e1449db85 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:13.450112 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f43882cc-9ae9-454b-ace1-0f8e1449db85 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:13.450818 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f43882cc-9ae9-454b-ace1-0f8e1449db85 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:13.452544 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f43882cc-9ae9-454b-ace1-0f8e1449db85 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:13.453458 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f43882cc-9ae9-454b-ace1-0f8e1449db85 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:13.453578 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-41861fcf-d8c5-4255-af65-d96d931a4c30 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] 10.222.0.52 "GET /compute/v2.1/servers/61edfb81-28c2-4818-bb73-b141c418e6b0" status: 200 len: 1328 microversion: 2.1 time: 0.316639 Oct 19 03:33:13.465395 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2289/4499] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:13 2022] GET /compute/v2.1/servers/61edfb81-28c2-4818-bb73-b141c418e6b0 => generated 1328 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:33:13.467223 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f43882cc-9ae9-454b-ace1-0f8e1449db85 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:13.505716 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f43882cc-9ae9-454b-ace1-0f8e1449db85 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] [instance: a1c0df8b-0120-47bc-92da-36d257f61c8b] Going to try to terminate instance {{(pid=121134) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:33:13.791604 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-240ba3dd-8822-4ee9-a780-72c45e34853a tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:13.792232 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-240ba3dd-8822-4ee9-a780-72c45e34853a tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] [instance: 2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:13.800225 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-240ba3dd-8822-4ee9-a780-72c45e34853a tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:13.800942 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-240ba3dd-8822-4ee9-a780-72c45e34853a tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:13.801907 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-240ba3dd-8822-4ee9-a780-72c45e34853a tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:13.803176 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-240ba3dd-8822-4ee9-a780-72c45e34853a tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:13.803908 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-240ba3dd-8822-4ee9-a780-72c45e34853a tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:13.805347 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-240ba3dd-8822-4ee9-a780-72c45e34853a tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:13.841875 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f43882cc-9ae9-454b-ace1-0f8e1449db85 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] 10.222.0.52 "DELETE /compute/v2.1/servers/a1c0df8b-0120-47bc-92da-36d257f61c8b" status: 204 len: 0 microversion: 2.1 time: 0.409345 Oct 19 03:33:13.846247 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2211/4500] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:33:13 2022] DELETE /compute/v2.1/servers/a1c0df8b-0120-47bc-92da-36d257f61c8b => generated 0 bytes in 416 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:33:13.856265 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b1f64a0c-0164-449f-9a65-7b1d5f8bfdd4 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:13.856982 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b1f64a0c-0164-449f-9a65-7b1d5f8bfdd4 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] [instance: a1c0df8b-0120-47bc-92da-36d257f61c8b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:13.864860 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b1f64a0c-0164-449f-9a65-7b1d5f8bfdd4 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:13.865578 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b1f64a0c-0164-449f-9a65-7b1d5f8bfdd4 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:13.866068 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b1f64a0c-0164-449f-9a65-7b1d5f8bfdd4 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:13.867006 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b1f64a0c-0164-449f-9a65-7b1d5f8bfdd4 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:13.867477 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b1f64a0c-0164-449f-9a65-7b1d5f8bfdd4 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:13.867911 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b1f64a0c-0164-449f-9a65-7b1d5f8bfdd4 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:14.442641 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b1f64a0c-0164-449f-9a65-7b1d5f8bfdd4 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b748815c10a46d2adc26d5c8a1ba268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc49f9b6a0054092beda3ab313bff1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:14.459946 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b1f64a0c-0164-449f-9a65-7b1d5f8bfdd4 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] 10.222.0.52 "GET /compute/v2.1/servers/a1c0df8b-0120-47bc-92da-36d257f61c8b" status: 200 len: 1469 microversion: 2.1 time: 0.605083 Oct 19 03:33:14.467363 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2212/4501] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:13 2022] GET /compute/v2.1/servers/a1c0df8b-0120-47bc-92da-36d257f61c8b => generated 1469 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:33:14.478766 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7c2f2645-c98a-4718-8019-81d496443b8e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:14.481555 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7c2f2645-c98a-4718-8019-81d496443b8e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:14.492743 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-240ba3dd-8822-4ee9-a780-72c45e34853a tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33d07a7db4846ababf001493c6e10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb0265509744c93b03fa5c28b4e9386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:14.495235 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7c2f2645-c98a-4718-8019-81d496443b8e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:14.496128 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7c2f2645-c98a-4718-8019-81d496443b8e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:14.496801 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7c2f2645-c98a-4718-8019-81d496443b8e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:14.498143 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7c2f2645-c98a-4718-8019-81d496443b8e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:14.499087 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7c2f2645-c98a-4718-8019-81d496443b8e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:14.499737 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7c2f2645-c98a-4718-8019-81d496443b8e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:14.502687 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-240ba3dd-8822-4ee9-a780-72c45e34853a tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] 10.222.0.52 "GET /compute/v2.1/servers/2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62" status: 200 len: 1505 microversion: 2.1 time: 0.717483 Oct 19 03:33:14.503286 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2290/4502] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:13 2022] GET /compute/v2.1/servers/2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62 => generated 1505 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:33:14.530918 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-dabc1ed6-5f2a-426f-9fba-ce15362b3e71 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:14.532304 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-dabc1ed6-5f2a-426f-9fba-ce15362b3e71 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] [instance: 61edfb81-28c2-4818-bb73-b141c418e6b0] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:14.581907 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dabc1ed6-5f2a-426f-9fba-ce15362b3e71 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:14.585565 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dabc1ed6-5f2a-426f-9fba-ce15362b3e71 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:14.585565 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dabc1ed6-5f2a-426f-9fba-ce15362b3e71 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:14.595614 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dabc1ed6-5f2a-426f-9fba-ce15362b3e71 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:14.596120 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dabc1ed6-5f2a-426f-9fba-ce15362b3e71 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:14.599926 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dabc1ed6-5f2a-426f-9fba-ce15362b3e71 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:14.856117 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-7c2f2645-c98a-4718-8019-81d496443b8e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:14.872651 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7c2f2645-c98a-4718-8019-81d496443b8e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1680 microversion: 2.1 time: 0.403039 Oct 19 03:33:14.873459 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2213/4503] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:14 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1680 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:33:14.981513 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-dabc1ed6-5f2a-426f-9fba-ce15362b3e71 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51efba80d21425aa86baa138fb99770', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec35cc1c3324178b6314ed3272aa8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:15.014035 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-dabc1ed6-5f2a-426f-9fba-ce15362b3e71 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] 10.222.0.52 "GET /compute/v2.1/servers/61edfb81-28c2-4818-bb73-b141c418e6b0" status: 200 len: 1527 microversion: 2.1 time: 0.499633 Oct 19 03:33:15.023416 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2291/4504] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:14 2022] GET /compute/v2.1/servers/61edfb81-28c2-4818-bb73-b141c418e6b0 => generated 1527 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:33:15.062451 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6eeb5ebf-0658-4231-b5fc-1adf1204ca14 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:15.062451 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6eeb5ebf-0658-4231-b5fc-1adf1204ca14 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] [instance: 61edfb81-28c2-4818-bb73-b141c418e6b0] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:15.067073 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6eeb5ebf-0658-4231-b5fc-1adf1204ca14 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:15.068098 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6eeb5ebf-0658-4231-b5fc-1adf1204ca14 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:15.068730 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6eeb5ebf-0658-4231-b5fc-1adf1204ca14 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:15.070393 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6eeb5ebf-0658-4231-b5fc-1adf1204ca14 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:15.071216 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6eeb5ebf-0658-4231-b5fc-1adf1204ca14 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:15.071656 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6eeb5ebf-0658-4231-b5fc-1adf1204ca14 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:15.323744 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-6eeb5ebf-0658-4231-b5fc-1adf1204ca14 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51efba80d21425aa86baa138fb99770', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec35cc1c3324178b6314ed3272aa8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:15.332276 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6eeb5ebf-0658-4231-b5fc-1adf1204ca14 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] 10.222.0.52 "GET /compute/v2.1/servers/61edfb81-28c2-4818-bb73-b141c418e6b0" status: 200 len: 1527 microversion: 2.1 time: 0.279867 Oct 19 03:33:15.333790 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2214/4505] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:15 2022] GET /compute/v2.1/servers/61edfb81-28c2-4818-bb73-b141c418e6b0 => generated 1527 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:33:15.503939 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d0351306-a68a-479f-aa7f-86d6777d2ae1 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:15.505944 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d0351306-a68a-479f-aa7f-86d6777d2ae1 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] [instance: a1c0df8b-0120-47bc-92da-36d257f61c8b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:15.517890 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d0351306-a68a-479f-aa7f-86d6777d2ae1 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:15.518601 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d0351306-a68a-479f-aa7f-86d6777d2ae1 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:15.519132 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d0351306-a68a-479f-aa7f-86d6777d2ae1 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:15.522222 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d0351306-a68a-479f-aa7f-86d6777d2ae1 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:15.526984 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d0351306-a68a-479f-aa7f-86d6777d2ae1 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:15.527812 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d0351306-a68a-479f-aa7f-86d6777d2ae1 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:15.759744 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d0351306-a68a-479f-aa7f-86d6777d2ae1 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b748815c10a46d2adc26d5c8a1ba268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc49f9b6a0054092beda3ab313bff1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:15.769730 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d0351306-a68a-479f-aa7f-86d6777d2ae1 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] 10.222.0.52 "GET /compute/v2.1/servers/a1c0df8b-0120-47bc-92da-36d257f61c8b" status: 200 len: 1469 microversion: 2.1 time: 0.269940 Oct 19 03:33:15.777443 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2215/4506] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:15 2022] GET /compute/v2.1/servers/a1c0df8b-0120-47bc-92da-36d257f61c8b => generated 1469 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:33:15.785233 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5a3576fe-6f2d-466c-808c-4a5279f8f195 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:15.786776 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5a3576fe-6f2d-466c-808c-4a5279f8f195 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] [instance: 2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:15.806814 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5a3576fe-6f2d-466c-808c-4a5279f8f195 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:15.807389 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5a3576fe-6f2d-466c-808c-4a5279f8f195 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:15.811509 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5a3576fe-6f2d-466c-808c-4a5279f8f195 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:15.812347 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5a3576fe-6f2d-466c-808c-4a5279f8f195 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:15.812886 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5a3576fe-6f2d-466c-808c-4a5279f8f195 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:15.813584 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5a3576fe-6f2d-466c-808c-4a5279f8f195 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:15.883006 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-353e1676-af60-43de-9866-4cca06023873 tempest-ServersNegativeTestMultiTenantJSON-369893341 tempest-ServersNegativeTestMultiTenantJSON-369893341-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:15.883730 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-353e1676-af60-43de-9866-4cca06023873 tempest-ServersNegativeTestMultiTenantJSON-369893341 tempest-ServersNegativeTestMultiTenantJSON-369893341-project] [instance: 61edfb81-28c2-4818-bb73-b141c418e6b0] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:15.895099 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-353e1676-af60-43de-9866-4cca06023873 tempest-ServersNegativeTestMultiTenantJSON-369893341 tempest-ServersNegativeTestMultiTenantJSON-369893341-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:15.895889 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-353e1676-af60-43de-9866-4cca06023873 tempest-ServersNegativeTestMultiTenantJSON-369893341 tempest-ServersNegativeTestMultiTenantJSON-369893341-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:15.900058 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-353e1676-af60-43de-9866-4cca06023873 tempest-ServersNegativeTestMultiTenantJSON-369893341 tempest-ServersNegativeTestMultiTenantJSON-369893341-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:15.901411 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-353e1676-af60-43de-9866-4cca06023873 tempest-ServersNegativeTestMultiTenantJSON-369893341 tempest-ServersNegativeTestMultiTenantJSON-369893341-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:15.902327 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-353e1676-af60-43de-9866-4cca06023873 tempest-ServersNegativeTestMultiTenantJSON-369893341 tempest-ServersNegativeTestMultiTenantJSON-369893341-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:15.907943 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-353e1676-af60-43de-9866-4cca06023873 tempest-ServersNegativeTestMultiTenantJSON-369893341 tempest-ServersNegativeTestMultiTenantJSON-369893341-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:15.939416 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-353e1676-af60-43de-9866-4cca06023873 tempest-ServersNegativeTestMultiTenantJSON-369893341 tempest-ServersNegativeTestMultiTenantJSON-369893341-project] HTTP exception thrown: Instance 61edfb81-28c2-4818-bb73-b141c418e6b0 could not be found. Oct 19 03:33:15.943620 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-353e1676-af60-43de-9866-4cca06023873 tempest-ServersNegativeTestMultiTenantJSON-369893341 tempest-ServersNegativeTestMultiTenantJSON-369893341-project] Request method failure captured: Oct 19 03:33:15.943620 n-d-861333-8 devstack@n-api.service[121135]: request: DELETE /compute/v2.1/servers/61edfb81-28c2-4818-bb73-b141c418e6b0 HTTP/1.1 Oct 19 03:33:15.943620 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:33:15.943620 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:33:15.943620 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:33:15.943620 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:33:15.943620 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:33:15.943620 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:33:15.943620 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:33:15.943620 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:33:15.943620 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2_i66JUVMscHBuoNEv2UkcUqbFtZGh4e5ossy_l9sSNP27tUQ-q8Q_AblZ6LjRUOceqpHA57BlYm7V-IvTNpNW1jAdjkJvyO8dqqQ3UQVxOieLc_H0Vd28sWE1fHFujSeKVZM8koIA9pxn5ZBdh58JiISchLbQm9s5LYLz_g7ESzmw Oct 19 03:33:15.943620 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:33:15.943620 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:33:15.943620 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:33:15.943620 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:33:15.943620 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:33:15.943620 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:33:15.943620 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 9d1ba364808349db871c5db9a37832e0 Oct 19 03:33:15.943620 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-369893341 Oct 19 03:33:15.943620 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:33:15.943620 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:33:15.943620 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9d1ba364808349db871c5db9a37832e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9d1ba364808349db871c5db9a37832e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9d1ba364808349db871c5db9a37832e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9d1ba364808349db871c5db9a37832e0", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:33:15.943620 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-369893341 Oct 19 03:33:15.943620 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 9d1ba364808349db871c5db9a37832e0 Oct 19 03:33:15.943620 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-369893341 Oct 19 03:33:15.943620 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ServersNegativeTestMultiTenantJSON-369893341-project Oct 19 03:33:15.943620 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:33:15.943620 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:33:15.943620 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: f76e1e914e864313aa48756fa14cc8dc Oct 19 03:33:15.943620 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-369893341-project Oct 19 03:33:15.943620 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:33:15.943620 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance 61edfb81-28c2-4818-bb73-b141c418e6b0 could not be found. Oct 19 03:33:15.943620 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '61edfb81-28c2-4818-bb73-b141c418e6b0'} Oct 19 03:33:15.943620 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:33:15.943620 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:33:15.943620 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:33:15.943620 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:33:15.943620 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:33:15.943620 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:33:15.943620 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:33:15.943620 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:33:15.943620 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:33:15.943620 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:33:15.943620 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61edfb81-28c2-4818-bb73-b141c418e6b0 could not be found. Oct 19 03:33:15.943620 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:33:15.943620 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:33:15.943620 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:33:15.943620 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:33:15.943620 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:33:15.943620 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:33:15.943620 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:33:15.943620 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:33:15.943620 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:33:15.943620 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:33:15.943620 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 03:33:15.943620 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 03:33:15.943620 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 03:33:15.943620 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 03:33:15.943620 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:33:15.943620 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:33:15.943620 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:33:15.943620 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:33:15.953799 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61edfb81-28c2-4818-bb73-b141c418e6b0 could not be found. Oct 19 03:33:15.953799 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:33:15.953799 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:33:15.953799 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:33:15.953799 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:33:15.953799 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:33:15.953799 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:33:15.953799 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:33:15.953799 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:33:15.953799 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61edfb81-28c2-4818-bb73-b141c418e6b0 could not be found. Oct 19 03:33:15.953799 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:33:15.953799 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-353e1676-af60-43de-9866-4cca06023873 tempest-ServersNegativeTestMultiTenantJSON-369893341 tempest-ServersNegativeTestMultiTenantJSON-369893341-project] Returning 404 to user: Instance 61edfb81-28c2-4818-bb73-b141c418e6b0 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:33:15.953799 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-353e1676-af60-43de-9866-4cca06023873 tempest-ServersNegativeTestMultiTenantJSON-369893341 tempest-ServersNegativeTestMultiTenantJSON-369893341-project] 10.222.0.52 "DELETE /compute/v2.1/servers/61edfb81-28c2-4818-bb73-b141c418e6b0" status: 404 len: 111 microversion: 2.1 time: 0.593338 Oct 19 03:33:15.959930 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2292/4507] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:33:15 2022] DELETE /compute/v2.1/servers/61edfb81-28c2-4818-bb73-b141c418e6b0 => generated 111 bytes in 606 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:33:15.966183 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-90cc17c5-7de3-407c-a7fb-fea29b984871 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:15.967263 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-90cc17c5-7de3-407c-a7fb-fea29b984871 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:15.975061 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-90cc17c5-7de3-407c-a7fb-fea29b984871 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:15.976188 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-90cc17c5-7de3-407c-a7fb-fea29b984871 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:15.980533 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-90cc17c5-7de3-407c-a7fb-fea29b984871 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:15.980533 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-90cc17c5-7de3-407c-a7fb-fea29b984871 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:15.980533 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-90cc17c5-7de3-407c-a7fb-fea29b984871 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:15.980533 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-90cc17c5-7de3-407c-a7fb-fea29b984871 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:16.268886 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-90cc17c5-7de3-407c-a7fb-fea29b984871 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:16.283338 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-90cc17c5-7de3-407c-a7fb-fea29b984871 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1680 microversion: 2.1 time: 0.316246 Oct 19 03:33:16.283338 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2293/4508] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:15 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1680 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:33:16.295887 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6b8abbd1-ca23-4c96-a5a8-122baa89bf72 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:16.296519 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6b8abbd1-ca23-4c96-a5a8-122baa89bf72 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] [instance: 61edfb81-28c2-4818-bb73-b141c418e6b0] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:16.305530 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6b8abbd1-ca23-4c96-a5a8-122baa89bf72 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:16.305530 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6b8abbd1-ca23-4c96-a5a8-122baa89bf72 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:16.309504 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6b8abbd1-ca23-4c96-a5a8-122baa89bf72 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:16.311294 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6b8abbd1-ca23-4c96-a5a8-122baa89bf72 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:16.323270 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6b8abbd1-ca23-4c96-a5a8-122baa89bf72 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:16.324887 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6b8abbd1-ca23-4c96-a5a8-122baa89bf72 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:16.346308 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5a3576fe-6f2d-466c-808c-4a5279f8f195 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33d07a7db4846ababf001493c6e10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb0265509744c93b03fa5c28b4e9386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:16.354885 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5a3576fe-6f2d-466c-808c-4a5279f8f195 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] 10.222.0.52 "GET /compute/v2.1/servers/2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62" status: 200 len: 1505 microversion: 2.1 time: 0.575976 Oct 19 03:33:16.356854 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2216/4509] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:15 2022] GET /compute/v2.1/servers/2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62 => generated 1505 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:33:16.570538 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-6b8abbd1-ca23-4c96-a5a8-122baa89bf72 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51efba80d21425aa86baa138fb99770', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec35cc1c3324178b6314ed3272aa8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:16.581092 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6b8abbd1-ca23-4c96-a5a8-122baa89bf72 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] 10.222.0.52 "GET /compute/v2.1/servers/61edfb81-28c2-4818-bb73-b141c418e6b0" status: 200 len: 1527 microversion: 2.1 time: 0.301680 Oct 19 03:33:16.588452 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2294/4510] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:16 2022] GET /compute/v2.1/servers/61edfb81-28c2-4818-bb73-b141c418e6b0 => generated 1527 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:33:16.607219 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-939039bb-c0e3-405b-9331-cdf9a4c392d5 tempest-ServersNegativeTestMultiTenantJSON-369893341 tempest-ServersNegativeTestMultiTenantJSON-369893341-project] Action: 'update', calling method: >, body: {"server": {"name": "61edfb81-28c2-4818-bb73-b141c418e6b0_new"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:33:16.612785 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-939039bb-c0e3-405b-9331-cdf9a4c392d5 tempest-ServersNegativeTestMultiTenantJSON-369893341 tempest-ServersNegativeTestMultiTenantJSON-369893341-project] [instance: 61edfb81-28c2-4818-bb73-b141c418e6b0] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:16.617597 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-939039bb-c0e3-405b-9331-cdf9a4c392d5 tempest-ServersNegativeTestMultiTenantJSON-369893341 tempest-ServersNegativeTestMultiTenantJSON-369893341-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:16.618307 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-939039bb-c0e3-405b-9331-cdf9a4c392d5 tempest-ServersNegativeTestMultiTenantJSON-369893341 tempest-ServersNegativeTestMultiTenantJSON-369893341-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:16.618922 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-939039bb-c0e3-405b-9331-cdf9a4c392d5 tempest-ServersNegativeTestMultiTenantJSON-369893341 tempest-ServersNegativeTestMultiTenantJSON-369893341-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:16.619825 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-939039bb-c0e3-405b-9331-cdf9a4c392d5 tempest-ServersNegativeTestMultiTenantJSON-369893341 tempest-ServersNegativeTestMultiTenantJSON-369893341-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:16.620442 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-939039bb-c0e3-405b-9331-cdf9a4c392d5 tempest-ServersNegativeTestMultiTenantJSON-369893341 tempest-ServersNegativeTestMultiTenantJSON-369893341-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:16.621096 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-939039bb-c0e3-405b-9331-cdf9a4c392d5 tempest-ServersNegativeTestMultiTenantJSON-369893341 tempest-ServersNegativeTestMultiTenantJSON-369893341-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:16.652514 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-939039bb-c0e3-405b-9331-cdf9a4c392d5 tempest-ServersNegativeTestMultiTenantJSON-369893341 tempest-ServersNegativeTestMultiTenantJSON-369893341-project] HTTP exception thrown: Instance 61edfb81-28c2-4818-bb73-b141c418e6b0 could not be found. Oct 19 03:33:16.658190 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-939039bb-c0e3-405b-9331-cdf9a4c392d5 tempest-ServersNegativeTestMultiTenantJSON-369893341 tempest-ServersNegativeTestMultiTenantJSON-369893341-project] Request method failure captured: Oct 19 03:33:16.658190 n-d-861333-8 devstack@n-api.service[121134]: request: PUT /compute/v2.1/servers/61edfb81-28c2-4818-bb73-b141c418e6b0 HTTP/1.1 Oct 19 03:33:16.658190 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:33:16.658190 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:33:16.658190 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:33:16.658190 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 64 Oct 19 03:33:16.658190 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:33:16.658190 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:33:16.658190 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:33:16.658190 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:33:16.658190 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT2_i66JUVMscHBuoNEv2UkcUqbFtZGh4e5ossy_l9sSNP27tUQ-q8Q_AblZ6LjRUOceqpHA57BlYm7V-IvTNpNW1jAdjkJvyO8dqqQ3UQVxOieLc_H0Vd28sWE1fHFujSeKVZM8koIA9pxn5ZBdh58JiISchLbQm9s5LYLz_g7ESzmw Oct 19 03:33:16.658190 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:33:16.658190 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:33:16.658190 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:33:16.658190 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:33:16.658190 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:33:16.658190 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:33:16.658190 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 9d1ba364808349db871c5db9a37832e0 Oct 19 03:33:16.658190 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-369893341 Oct 19 03:33:16.658190 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:33:16.658190 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:33:16.658190 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9d1ba364808349db871c5db9a37832e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9d1ba364808349db871c5db9a37832e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9d1ba364808349db871c5db9a37832e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9d1ba364808349db871c5db9a37832e0", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:33:16.658190 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-369893341 Oct 19 03:33:16.658190 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 9d1ba364808349db871c5db9a37832e0 Oct 19 03:33:16.658190 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-369893341 Oct 19 03:33:16.658190 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ServersNegativeTestMultiTenantJSON-369893341-project Oct 19 03:33:16.658190 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:33:16.658190 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:33:16.658190 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: f76e1e914e864313aa48756fa14cc8dc Oct 19 03:33:16.658190 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-369893341-project Oct 19 03:33:16.658190 n-d-861333-8 devstack@n-api.service[121134]: Oct 19 03:33:16.658190 n-d-861333-8 devstack@n-api.service[121134]: {"server": {"name": "61edfb81-28c2-4818-bb73-b141c418e6b0_new"}} Oct 19 03:33:16.658190 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:33:16.658190 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance 61edfb81-28c2-4818-bb73-b141c418e6b0 could not be found. Oct 19 03:33:16.658190 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '61edfb81-28c2-4818-bb73-b141c418e6b0', 'body': {'server': {'name': '61edfb81-28c2-4818-bb73-b141c418e6b0_new'}}} Oct 19 03:33:16.658190 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:33:16.658190 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:33:16.658190 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:33:16.658190 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:33:16.658190 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:33:16.658190 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:33:16.658190 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:33:16.658190 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:33:16.658190 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:33:16.658190 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:33:16.658190 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61edfb81-28c2-4818-bb73-b141c418e6b0 could not be found. Oct 19 03:33:16.658190 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:33:16.658190 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:33:16.658190 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:33:16.658190 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:33:16.658190 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:33:16.658190 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:33:16.658190 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:33:16.658190 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:33:16.658190 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:33:16.658190 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:33:16.658190 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:33:16.658190 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:33:16.658190 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:33:16.658190 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:33:16.658190 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:33:16.658190 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:33:16.658190 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 19 03:33:16.662424 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 19 03:33:16.662424 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 19 03:33:16.662424 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:33:16.662424 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:33:16.662424 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:33:16.662424 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:33:16.662424 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61edfb81-28c2-4818-bb73-b141c418e6b0 could not be found. Oct 19 03:33:16.662424 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:33:16.662424 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:33:16.662424 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:33:16.662424 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:33:16.662424 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:33:16.662424 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:33:16.662424 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:33:16.662424 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:33:16.662424 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61edfb81-28c2-4818-bb73-b141c418e6b0 could not be found. Oct 19 03:33:16.662424 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:33:16.670460 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-939039bb-c0e3-405b-9331-cdf9a4c392d5 tempest-ServersNegativeTestMultiTenantJSON-369893341 tempest-ServersNegativeTestMultiTenantJSON-369893341-project] Returning 404 to user: Instance 61edfb81-28c2-4818-bb73-b141c418e6b0 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:33:16.670460 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-939039bb-c0e3-405b-9331-cdf9a4c392d5 tempest-ServersNegativeTestMultiTenantJSON-369893341 tempest-ServersNegativeTestMultiTenantJSON-369893341-project] 10.222.0.52 "PUT /compute/v2.1/servers/61edfb81-28c2-4818-bb73-b141c418e6b0" status: 404 len: 111 microversion: 2.1 time: 0.064826 Oct 19 03:33:16.670460 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2217/4511] 10.222.0.52 () {60 vars in 1256 bytes} [Wed Oct 19 03:33:16 2022] PUT /compute/v2.1/servers/61edfb81-28c2-4818-bb73-b141c418e6b0 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:33:16.682370 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9fe7e296-f23b-4327-abcc-dd54016cb989 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:16.683177 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9fe7e296-f23b-4327-abcc-dd54016cb989 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] [instance: 61edfb81-28c2-4818-bb73-b141c418e6b0] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:16.695174 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9fe7e296-f23b-4327-abcc-dd54016cb989 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:16.701351 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9fe7e296-f23b-4327-abcc-dd54016cb989 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:16.701849 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9fe7e296-f23b-4327-abcc-dd54016cb989 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:16.702636 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9fe7e296-f23b-4327-abcc-dd54016cb989 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:16.703111 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9fe7e296-f23b-4327-abcc-dd54016cb989 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:16.703545 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9fe7e296-f23b-4327-abcc-dd54016cb989 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:16.750720 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9fe7e296-f23b-4327-abcc-dd54016cb989 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] [instance: 61edfb81-28c2-4818-bb73-b141c418e6b0] Going to try to terminate instance {{(pid=121135) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:33:16.801726 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-da6818ba-c383-4f07-9629-212fbc59eb2d tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:16.802500 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-da6818ba-c383-4f07-9629-212fbc59eb2d tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] [instance: a1c0df8b-0120-47bc-92da-36d257f61c8b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:16.812223 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-da6818ba-c383-4f07-9629-212fbc59eb2d tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:16.812732 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-da6818ba-c383-4f07-9629-212fbc59eb2d tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:16.813399 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-da6818ba-c383-4f07-9629-212fbc59eb2d tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:16.814350 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-da6818ba-c383-4f07-9629-212fbc59eb2d tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:16.814818 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-da6818ba-c383-4f07-9629-212fbc59eb2d tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:16.815258 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-da6818ba-c383-4f07-9629-212fbc59eb2d tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:17.042293 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-da6818ba-c383-4f07-9629-212fbc59eb2d tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b748815c10a46d2adc26d5c8a1ba268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc49f9b6a0054092beda3ab313bff1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:17.058137 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-da6818ba-c383-4f07-9629-212fbc59eb2d tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] 10.222.0.52 "GET /compute/v2.1/servers/a1c0df8b-0120-47bc-92da-36d257f61c8b" status: 200 len: 1469 microversion: 2.1 time: 0.261019 Oct 19 03:33:17.058137 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2218/4512] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:16 2022] GET /compute/v2.1/servers/a1c0df8b-0120-47bc-92da-36d257f61c8b => generated 1469 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:33:17.157156 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9fe7e296-f23b-4327-abcc-dd54016cb989 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] 10.222.0.52 "DELETE /compute/v2.1/servers/61edfb81-28c2-4818-bb73-b141c418e6b0" status: 204 len: 0 microversion: 2.1 time: 0.481996 Oct 19 03:33:17.157781 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2295/4513] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:33:16 2022] DELETE /compute/v2.1/servers/61edfb81-28c2-4818-bb73-b141c418e6b0 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:33:17.166608 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e093829e-2f1e-4d1f-b01f-5dbda61ffe4d tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:17.169659 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e093829e-2f1e-4d1f-b01f-5dbda61ffe4d tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] [instance: 61edfb81-28c2-4818-bb73-b141c418e6b0] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:17.177645 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e093829e-2f1e-4d1f-b01f-5dbda61ffe4d tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:17.178142 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e093829e-2f1e-4d1f-b01f-5dbda61ffe4d tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:17.178583 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e093829e-2f1e-4d1f-b01f-5dbda61ffe4d tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:17.179922 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e093829e-2f1e-4d1f-b01f-5dbda61ffe4d tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:17.180387 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e093829e-2f1e-4d1f-b01f-5dbda61ffe4d tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:17.180889 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e093829e-2f1e-4d1f-b01f-5dbda61ffe4d tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:17.304583 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0447a078-1b8f-414d-ad6c-5d749b500c5a tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:17.305940 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0447a078-1b8f-414d-ad6c-5d749b500c5a tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:17.321531 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0447a078-1b8f-414d-ad6c-5d749b500c5a tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:17.321531 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0447a078-1b8f-414d-ad6c-5d749b500c5a tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:17.321531 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0447a078-1b8f-414d-ad6c-5d749b500c5a tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:17.321531 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0447a078-1b8f-414d-ad6c-5d749b500c5a tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:17.321531 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0447a078-1b8f-414d-ad6c-5d749b500c5a tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:17.321531 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0447a078-1b8f-414d-ad6c-5d749b500c5a tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:17.617297 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e093829e-2f1e-4d1f-b01f-5dbda61ffe4d tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51efba80d21425aa86baa138fb99770', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec35cc1c3324178b6314ed3272aa8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:17.627361 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e093829e-2f1e-4d1f-b01f-5dbda61ffe4d tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] 10.222.0.52 "GET /compute/v2.1/servers/61edfb81-28c2-4818-bb73-b141c418e6b0" status: 200 len: 1533 microversion: 2.1 time: 0.462524 Oct 19 03:33:17.647923 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2219/4514] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:17 2022] GET /compute/v2.1/servers/61edfb81-28c2-4818-bb73-b141c418e6b0 => generated 1533 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:33:17.656732 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2d629f28-fefb-449d-a1c6-4aa1b9e1a9ef tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:17.657354 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2d629f28-fefb-449d-a1c6-4aa1b9e1a9ef tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] [instance: 2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:17.668720 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-0447a078-1b8f-414d-ad6c-5d749b500c5a tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:17.682832 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0447a078-1b8f-414d-ad6c-5d749b500c5a tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1657 microversion: 2.1 time: 0.381255 Oct 19 03:33:17.686052 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2d629f28-fefb-449d-a1c6-4aa1b9e1a9ef tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:17.686732 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2d629f28-fefb-449d-a1c6-4aa1b9e1a9ef tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:17.687408 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2d629f28-fefb-449d-a1c6-4aa1b9e1a9ef tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:17.688274 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2d629f28-fefb-449d-a1c6-4aa1b9e1a9ef tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:17.688879 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2d629f28-fefb-449d-a1c6-4aa1b9e1a9ef tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:17.689518 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2d629f28-fefb-449d-a1c6-4aa1b9e1a9ef tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:17.707609 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2296/4515] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:17 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1657 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:33:17.716756 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2a1ca8e3-b52f-4458-968c-629d2bd1fce6 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:33:17.729474 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2a1ca8e3-b52f-4458-968c-629d2bd1fce6 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:17.733288 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2a1ca8e3-b52f-4458-968c-629d2bd1fce6 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:17.733867 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2a1ca8e3-b52f-4458-968c-629d2bd1fce6 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:17.806723 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-2a1ca8e3-b52f-4458-968c-629d2bd1fce6 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Going to try to start instance {{(pid=121135) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 19 03:33:17.863655 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:33:18.048398 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2a1ca8e3-b52f-4458-968c-629d2bd1fce6 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "POST /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f/action" status: 202 len: 0 microversion: 2.1 time: 0.338513 Oct 19 03:33:18.050354 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2297/4516] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:33:17 2022] POST /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f/action => generated 0 bytes in 342 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:33:18.069624 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-4d45ac8a-9d69-425d-9d0d-14fff4afb677 req-15fef090-18a9-43bb-878f-2221708d6224 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1c0df8b-0120-47bc-92da-36d257f61c8b", "name": "network-vif-deleted", "tag": "c171d5d3-26e8-4d7a-9d92-850c79a51e4c"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:33:18.085225 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-4d45ac8a-9d69-425d-9d0d-14fff4afb677 req-15fef090-18a9-43bb-878f-2221708d6224 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:18.086266 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-4d45ac8a-9d69-425d-9d0d-14fff4afb677 req-15fef090-18a9-43bb-878f-2221708d6224 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:18.091122 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-4d45ac8a-9d69-425d-9d0d-14fff4afb677 req-15fef090-18a9-43bb-878f-2221708d6224 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:18.110889 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-4d45ac8a-9d69-425d-9d0d-14fff4afb677 req-15fef090-18a9-43bb-878f-2221708d6224 service nova] Creating event network-vif-deleted:c171d5d3-26e8-4d7a-9d92-850c79a51e4c for instance a1c0df8b-0120-47bc-92da-36d257f61c8b on n-h2-861333-8 Oct 19 03:33:18.122574 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-4d45ac8a-9d69-425d-9d0d-14fff4afb677 req-15fef090-18a9-43bb-878f-2221708d6224 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067170 Oct 19 03:33:18.123863 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2298/4517] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:33:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:33:18.130910 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c68aab7a-067e-4e4a-9323-8743a399cc09 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:18.131767 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c68aab7a-067e-4e4a-9323-8743a399cc09 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:18.139932 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c68aab7a-067e-4e4a-9323-8743a399cc09 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:18.140913 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c68aab7a-067e-4e4a-9323-8743a399cc09 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:18.141614 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c68aab7a-067e-4e4a-9323-8743a399cc09 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:18.142699 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c68aab7a-067e-4e4a-9323-8743a399cc09 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:18.144199 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c68aab7a-067e-4e4a-9323-8743a399cc09 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:18.157045 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c68aab7a-067e-4e4a-9323-8743a399cc09 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:18.258997 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-2d629f28-fefb-449d-a1c6-4aa1b9e1a9ef tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33d07a7db4846ababf001493c6e10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb0265509744c93b03fa5c28b4e9386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:18.272408 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2d629f28-fefb-449d-a1c6-4aa1b9e1a9ef tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] 10.222.0.52 "GET /compute/v2.1/servers/2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62" status: 200 len: 1505 microversion: 2.1 time: 0.623203 Oct 19 03:33:18.273748 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2220/4518] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:17 2022] GET /compute/v2.1/servers/2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62 => generated 1505 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:33:18.286978 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c4ccd7f1-7221-45c1-8d81-013ca2dec664 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:18.292194 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c4ccd7f1-7221-45c1-8d81-013ca2dec664 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] [instance: a1c0df8b-0120-47bc-92da-36d257f61c8b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:18.304565 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c4ccd7f1-7221-45c1-8d81-013ca2dec664 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:18.308952 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c4ccd7f1-7221-45c1-8d81-013ca2dec664 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:18.316466 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c4ccd7f1-7221-45c1-8d81-013ca2dec664 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:18.316466 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c4ccd7f1-7221-45c1-8d81-013ca2dec664 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:18.316466 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c4ccd7f1-7221-45c1-8d81-013ca2dec664 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:18.316466 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c4ccd7f1-7221-45c1-8d81-013ca2dec664 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:18.388984 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c4ccd7f1-7221-45c1-8d81-013ca2dec664 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:18.389580 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c4ccd7f1-7221-45c1-8d81-013ca2dec664 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:18.390038 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c4ccd7f1-7221-45c1-8d81-013ca2dec664 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:18.390499 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-c4ccd7f1-7221-45c1-8d81-013ca2dec664 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lazy-loading 'fault' on Instance uuid a1c0df8b-0120-47bc-92da-36d257f61c8b {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:33:18.567098 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c4ccd7f1-7221-45c1-8d81-013ca2dec664 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b748815c10a46d2adc26d5c8a1ba268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc49f9b6a0054092beda3ab313bff1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:18.597993 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c4ccd7f1-7221-45c1-8d81-013ca2dec664 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] 10.222.0.52 "GET /compute/v2.1/servers/a1c0df8b-0120-47bc-92da-36d257f61c8b" status: 200 len: 1312 microversion: 2.1 time: 0.322654 Oct 19 03:33:18.598935 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2221/4519] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:18 2022] GET /compute/v2.1/servers/a1c0df8b-0120-47bc-92da-36d257f61c8b => generated 1312 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:33:18.656623 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e993f6ef-2119-4a74-9004-f3dffe4b8a2f tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:18.658318 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e993f6ef-2119-4a74-9004-f3dffe4b8a2f tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] [instance: 61edfb81-28c2-4818-bb73-b141c418e6b0] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:18.668092 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e993f6ef-2119-4a74-9004-f3dffe4b8a2f tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:18.671591 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e993f6ef-2119-4a74-9004-f3dffe4b8a2f tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:18.672818 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e993f6ef-2119-4a74-9004-f3dffe4b8a2f tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:18.674936 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e993f6ef-2119-4a74-9004-f3dffe4b8a2f tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:18.681612 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e993f6ef-2119-4a74-9004-f3dffe4b8a2f tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:18.682331 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e993f6ef-2119-4a74-9004-f3dffe4b8a2f tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:18.694960 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:33:18.767505 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c68aab7a-067e-4e4a-9323-8743a399cc09 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:18.786301 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c68aab7a-067e-4e4a-9323-8743a399cc09 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1666 microversion: 2.1 time: 0.650816 Oct 19 03:33:18.786996 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2299/4520] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:18 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1666 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:33:19.018236 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e993f6ef-2119-4a74-9004-f3dffe4b8a2f tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51efba80d21425aa86baa138fb99770', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec35cc1c3324178b6314ed3272aa8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:19.028318 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e993f6ef-2119-4a74-9004-f3dffe4b8a2f tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] 10.222.0.52 "GET /compute/v2.1/servers/61edfb81-28c2-4818-bb73-b141c418e6b0" status: 200 len: 1533 microversion: 2.1 time: 0.375741 Oct 19 03:33:19.041411 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2222/4521] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:18 2022] GET /compute/v2.1/servers/61edfb81-28c2-4818-bb73-b141c418e6b0 => generated 1533 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:33:19.297066 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6332ac6c-34ad-4ad8-9f1a-8df5305301fd tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:19.298189 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6332ac6c-34ad-4ad8-9f1a-8df5305301fd tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] [instance: 2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:19.307072 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6332ac6c-34ad-4ad8-9f1a-8df5305301fd tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:19.307622 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6332ac6c-34ad-4ad8-9f1a-8df5305301fd tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:19.308188 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6332ac6c-34ad-4ad8-9f1a-8df5305301fd tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:19.308950 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6332ac6c-34ad-4ad8-9f1a-8df5305301fd tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:19.309435 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6332ac6c-34ad-4ad8-9f1a-8df5305301fd tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:19.309889 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6332ac6c-34ad-4ad8-9f1a-8df5305301fd tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:19.585873 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-6332ac6c-34ad-4ad8-9f1a-8df5305301fd tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33d07a7db4846ababf001493c6e10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb0265509744c93b03fa5c28b4e9386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:19.602995 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6332ac6c-34ad-4ad8-9f1a-8df5305301fd tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] 10.222.0.52 "GET /compute/v2.1/servers/2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62" status: 200 len: 1505 microversion: 2.1 time: 0.310283 Oct 19 03:33:19.603832 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2300/4522] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:19 2022] GET /compute/v2.1/servers/2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62 => generated 1505 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:33:19.632356 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3090c4a3-2abb-4791-8996-f291c7f82559 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:19.633548 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3090c4a3-2abb-4791-8996-f291c7f82559 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] [instance: a1c0df8b-0120-47bc-92da-36d257f61c8b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:19.648625 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3090c4a3-2abb-4791-8996-f291c7f82559 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:19.649842 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3090c4a3-2abb-4791-8996-f291c7f82559 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:19.650460 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3090c4a3-2abb-4791-8996-f291c7f82559 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:19.652493 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3090c4a3-2abb-4791-8996-f291c7f82559 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:19.653316 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3090c4a3-2abb-4791-8996-f291c7f82559 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:19.653942 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3090c4a3-2abb-4791-8996-f291c7f82559 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:19.684623 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-3090c4a3-2abb-4791-8996-f291c7f82559 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] HTTP exception thrown: Instance a1c0df8b-0120-47bc-92da-36d257f61c8b could not be found. Oct 19 03:33:19.688872 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3090c4a3-2abb-4791-8996-f291c7f82559 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Request method failure captured: Oct 19 03:33:19.688872 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/a1c0df8b-0120-47bc-92da-36d257f61c8b HTTP/1.1 Oct 19 03:33:19.688872 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:33:19.688872 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:33:19.688872 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:33:19.688872 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:33:19.688872 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:33:19.688872 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:33:19.688872 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:33:19.688872 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:33:19.688872 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT2-5e2XhsXmP35HSRHi_T9p0SfPT3ewtb8uWPfP4h1G2MmuiOYszRcdxSv6HkCeaYyaU8DEwsVXV36vGlBv-0-Coo2xsyCONAY-SUqOmPojFT8wdhzGWw_67t0O74owMxUk4q4eCY-LC_YGZ9O5D28gHpWikSTfVPU3Tu8uQB5NrzW8 Oct 19 03:33:19.688872 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:33:19.688872 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:33:19.688872 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:33:19.688872 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:33:19.688872 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:33:19.688872 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:33:19.688872 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: dc49f9b6a0054092beda3ab313bff1b9 Oct 19 03:33:19.688872 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1782357896 Oct 19 03:33:19.688872 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:33:19.688872 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:33:19.688872 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/dc49f9b6a0054092beda3ab313bff1b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/dc49f9b6a0054092beda3ab313bff1b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/dc49f9b6a0054092beda3ab313bff1b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_dc49f9b6a0054092beda3ab313bff1b9", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:33:19.688872 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1782357896 Oct 19 03:33:19.688872 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: dc49f9b6a0054092beda3ab313bff1b9 Oct 19 03:33:19.688872 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1782357896 Oct 19 03:33:19.688872 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ServersAdminNegativeTestJSON-1782357896-project Oct 19 03:33:19.688872 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:33:19.688872 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:33:19.688872 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 4b748815c10a46d2adc26d5c8a1ba268 Oct 19 03:33:19.688872 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1782357896-project Oct 19 03:33:19.688872 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:33:19.688872 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance a1c0df8b-0120-47bc-92da-36d257f61c8b could not be found. Oct 19 03:33:19.688872 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': 'a1c0df8b-0120-47bc-92da-36d257f61c8b'} Oct 19 03:33:19.688872 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:33:19.688872 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:33:19.688872 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:33:19.688872 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:33:19.688872 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:33:19.688872 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:33:19.688872 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:33:19.688872 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:33:19.688872 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:33:19.688872 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:33:19.688872 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1c0df8b-0120-47bc-92da-36d257f61c8b could not be found. Oct 19 03:33:19.688872 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:33:19.688872 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:33:19.688872 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:33:19.688872 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:33:19.688872 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:33:19.688872 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:33:19.688872 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:33:19.688872 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:33:19.688872 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:33:19.688872 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:33:19.688872 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:33:19.688872 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:33:19.688872 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:33:19.688872 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:33:19.688872 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:33:19.688872 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:33:19.688872 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1c0df8b-0120-47bc-92da-36d257f61c8b could not be found. Oct 19 03:33:19.688872 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:33:19.688872 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:33:19.694082 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:33:19.694082 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:33:19.694082 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:33:19.694082 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:33:19.694082 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:33:19.694082 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:33:19.694082 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1c0df8b-0120-47bc-92da-36d257f61c8b could not be found. Oct 19 03:33:19.694082 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:33:19.694082 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3090c4a3-2abb-4791-8996-f291c7f82559 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Returning 404 to user: Instance a1c0df8b-0120-47bc-92da-36d257f61c8b could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:33:19.697030 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3090c4a3-2abb-4791-8996-f291c7f82559 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] 10.222.0.52 "GET /compute/v2.1/servers/a1c0df8b-0120-47bc-92da-36d257f61c8b" status: 404 len: 111 microversion: 2.1 time: 0.072567 Oct 19 03:33:19.698744 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2223/4523] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:19 2022] GET /compute/v2.1/servers/a1c0df8b-0120-47bc-92da-36d257f61c8b => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:33:19.706344 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b20012fd-9eb7-48d6-b913-0534fdf7a7ad tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:19.706857 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b20012fd-9eb7-48d6-b913-0534fdf7a7ad tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] [instance: eb87cd67-6681-435d-9a65-56a2a06aaccb] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:19.714694 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b20012fd-9eb7-48d6-b913-0534fdf7a7ad tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:19.715258 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b20012fd-9eb7-48d6-b913-0534fdf7a7ad tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:19.715962 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b20012fd-9eb7-48d6-b913-0534fdf7a7ad tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:19.717552 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b20012fd-9eb7-48d6-b913-0534fdf7a7ad tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:19.718783 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b20012fd-9eb7-48d6-b913-0534fdf7a7ad tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:19.719485 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b20012fd-9eb7-48d6-b913-0534fdf7a7ad tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:19.754285 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b20012fd-9eb7-48d6-b913-0534fdf7a7ad tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] [instance: eb87cd67-6681-435d-9a65-56a2a06aaccb] Going to try to terminate instance {{(pid=121135) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:33:19.814446 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ec0f7fe0-1126-4947-9201-6ae3f59a2591 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:19.815410 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ec0f7fe0-1126-4947-9201-6ae3f59a2591 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:19.827776 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ec0f7fe0-1126-4947-9201-6ae3f59a2591 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:19.829392 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ec0f7fe0-1126-4947-9201-6ae3f59a2591 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:19.831399 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ec0f7fe0-1126-4947-9201-6ae3f59a2591 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:19.834111 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ec0f7fe0-1126-4947-9201-6ae3f59a2591 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:19.834826 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ec0f7fe0-1126-4947-9201-6ae3f59a2591 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:19.835464 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ec0f7fe0-1126-4947-9201-6ae3f59a2591 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:20.111118 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b20012fd-9eb7-48d6-b913-0534fdf7a7ad tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] 10.222.0.52 "DELETE /compute/v2.1/servers/eb87cd67-6681-435d-9a65-56a2a06aaccb" status: 204 len: 0 microversion: 2.1 time: 0.404942 Oct 19 03:33:20.115597 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2301/4524] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:33:19 2022] DELETE /compute/v2.1/servers/eb87cd67-6681-435d-9a65-56a2a06aaccb => generated 0 bytes in 414 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:33:20.124488 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c8ec814e-49eb-4d94-ac8c-ffd0c5c2b964 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:20.126873 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c8ec814e-49eb-4d94-ac8c-ffd0c5c2b964 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] [instance: 61edfb81-28c2-4818-bb73-b141c418e6b0] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:20.138790 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c8ec814e-49eb-4d94-ac8c-ffd0c5c2b964 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:20.139375 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c8ec814e-49eb-4d94-ac8c-ffd0c5c2b964 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:20.140875 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c8ec814e-49eb-4d94-ac8c-ffd0c5c2b964 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:20.142025 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c8ec814e-49eb-4d94-ac8c-ffd0c5c2b964 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:20.142609 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c8ec814e-49eb-4d94-ac8c-ffd0c5c2b964 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:20.143599 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c8ec814e-49eb-4d94-ac8c-ffd0c5c2b964 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:20.594891 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ec0f7fe0-1126-4947-9201-6ae3f59a2591 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:20.603705 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ec0f7fe0-1126-4947-9201-6ae3f59a2591 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1666 microversion: 2.1 time: 0.793307 Oct 19 03:33:20.604810 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2224/4525] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:19 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1666 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:33:20.609735 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7bb4f494-56c5-436f-a937-dd5c2d704abc tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:20.610594 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7bb4f494-56c5-436f-a937-dd5c2d704abc tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] [instance: eb87cd67-6681-435d-9a65-56a2a06aaccb] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:20.617187 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7bb4f494-56c5-436f-a937-dd5c2d704abc tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:20.618398 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7bb4f494-56c5-436f-a937-dd5c2d704abc tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:20.619718 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7bb4f494-56c5-436f-a937-dd5c2d704abc tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:20.623599 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7bb4f494-56c5-436f-a937-dd5c2d704abc tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:20.627679 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7bb4f494-56c5-436f-a937-dd5c2d704abc tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:20.630776 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7bb4f494-56c5-436f-a937-dd5c2d704abc tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:20.814275 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c8ec814e-49eb-4d94-ac8c-ffd0c5c2b964 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51efba80d21425aa86baa138fb99770', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec35cc1c3324178b6314ed3272aa8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:20.840107 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c8ec814e-49eb-4d94-ac8c-ffd0c5c2b964 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] 10.222.0.52 "GET /compute/v2.1/servers/61edfb81-28c2-4818-bb73-b141c418e6b0" status: 200 len: 1533 microversion: 2.1 time: 0.722373 Oct 19 03:33:20.841644 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2302/4526] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:20 2022] GET /compute/v2.1/servers/61edfb81-28c2-4818-bb73-b141c418e6b0 => generated 1533 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:33:20.849226 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e135c8a1-666a-44a5-8ab7-786e19e9dc1d tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:20.849888 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e135c8a1-666a-44a5-8ab7-786e19e9dc1d tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] [instance: 2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:20.870090 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e135c8a1-666a-44a5-8ab7-786e19e9dc1d tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:20.870747 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e135c8a1-666a-44a5-8ab7-786e19e9dc1d tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:20.871204 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e135c8a1-666a-44a5-8ab7-786e19e9dc1d tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:20.872495 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e135c8a1-666a-44a5-8ab7-786e19e9dc1d tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:20.872974 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e135c8a1-666a-44a5-8ab7-786e19e9dc1d tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:20.875657 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e135c8a1-666a-44a5-8ab7-786e19e9dc1d tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:21.179665 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-7bb4f494-56c5-436f-a937-dd5c2d704abc tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b748815c10a46d2adc26d5c8a1ba268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc49f9b6a0054092beda3ab313bff1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:21.189628 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7bb4f494-56c5-436f-a937-dd5c2d704abc tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] 10.222.0.52 "GET /compute/v2.1/servers/eb87cd67-6681-435d-9a65-56a2a06aaccb" status: 200 len: 1476 microversion: 2.1 time: 0.583364 Oct 19 03:33:21.191244 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2225/4527] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:20 2022] GET /compute/v2.1/servers/eb87cd67-6681-435d-9a65-56a2a06aaccb => generated 1476 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:33:21.199664 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-5dce1b51-1f96-45c8-9e4d-3dc92ddd8881 req-1fdd91cb-2c22-4235-b0c0-56322078ef09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61edfb81-28c2-4818-bb73-b141c418e6b0", "name": "network-vif-deleted", "tag": "ab8a932f-7561-49a4-9d1a-6e518eaa83d4"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:33:21.225695 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-5dce1b51-1f96-45c8-9e4d-3dc92ddd8881 req-1fdd91cb-2c22-4235-b0c0-56322078ef09 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:21.226186 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-5dce1b51-1f96-45c8-9e4d-3dc92ddd8881 req-1fdd91cb-2c22-4235-b0c0-56322078ef09 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:21.226624 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-5dce1b51-1f96-45c8-9e4d-3dc92ddd8881 req-1fdd91cb-2c22-4235-b0c0-56322078ef09 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:21.249899 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-5dce1b51-1f96-45c8-9e4d-3dc92ddd8881 req-1fdd91cb-2c22-4235-b0c0-56322078ef09 service nova] Creating event network-vif-deleted:ab8a932f-7561-49a4-9d1a-6e518eaa83d4 for instance 61edfb81-28c2-4818-bb73-b141c418e6b0 on n-h1-861333-8 Oct 19 03:33:21.260485 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-5dce1b51-1f96-45c8-9e4d-3dc92ddd8881 req-1fdd91cb-2c22-4235-b0c0-56322078ef09 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066522 Oct 19 03:33:21.261101 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2226/4528] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:33:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:33:21.381549 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-e135c8a1-666a-44a5-8ab7-786e19e9dc1d tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33d07a7db4846ababf001493c6e10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb0265509744c93b03fa5c28b4e9386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:21.396039 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e135c8a1-666a-44a5-8ab7-786e19e9dc1d tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] 10.222.0.52 "GET /compute/v2.1/servers/2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62" status: 200 len: 1505 microversion: 2.1 time: 0.551885 Oct 19 03:33:21.398989 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2303/4529] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:20 2022] GET /compute/v2.1/servers/2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62 => generated 1505 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:33:21.628553 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c95d1386-27b1-4023-854b-ec512c019770 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:21.629171 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c95d1386-27b1-4023-854b-ec512c019770 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:21.637072 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c95d1386-27b1-4023-854b-ec512c019770 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:21.637828 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c95d1386-27b1-4023-854b-ec512c019770 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:21.638854 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c95d1386-27b1-4023-854b-ec512c019770 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:21.640146 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c95d1386-27b1-4023-854b-ec512c019770 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:21.640776 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c95d1386-27b1-4023-854b-ec512c019770 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:21.641360 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c95d1386-27b1-4023-854b-ec512c019770 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:21.652054 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f4f0170d-fbe6-4cf8-89f1-c22bc44d3e21 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-1983632547", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "ba981e5f-e67d-42fb-b57a-98ccc83e6962"}]}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:33:21.717817 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-f4f0170d-fbe6-4cf8-89f1-c22bc44d3e21 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] validate_networks() for [('ba981e5f-e67d-42fb-b57a-98ccc83e6962', None, None, None, None, None)] {{(pid=121134) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:33:21.983575 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c95d1386-27b1-4023-854b-ec512c019770 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:21.994440 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c95d1386-27b1-4023-854b-ec512c019770 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1670 microversion: 2.1 time: 0.370109 Oct 19 03:33:21.997095 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2304/4530] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:21 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1670 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:33:22.000291 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-25786eba-fe93-4c07-a918-adca34a634b8 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:22.001091 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-25786eba-fe93-4c07-a918-adca34a634b8 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] [instance: 61edfb81-28c2-4818-bb73-b141c418e6b0] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:22.011062 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-25786eba-fe93-4c07-a918-adca34a634b8 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:22.012047 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-25786eba-fe93-4c07-a918-adca34a634b8 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:22.014584 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-25786eba-fe93-4c07-a918-adca34a634b8 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:22.017228 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-25786eba-fe93-4c07-a918-adca34a634b8 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:22.019166 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-25786eba-fe93-4c07-a918-adca34a634b8 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:22.019785 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-25786eba-fe93-4c07-a918-adca34a634b8 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:22.058094 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-25786eba-fe93-4c07-a918-adca34a634b8 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:22.059020 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-25786eba-fe93-4c07-a918-adca34a634b8 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:22.059774 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-25786eba-fe93-4c07-a918-adca34a634b8 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:22.061728 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-25786eba-fe93-4c07-a918-adca34a634b8 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Lazy-loading 'fault' on Instance uuid 61edfb81-28c2-4818-bb73-b141c418e6b0 {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:33:22.143324 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-25786eba-fe93-4c07-a918-adca34a634b8 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51efba80d21425aa86baa138fb99770', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec35cc1c3324178b6314ed3272aa8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:22.159999 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-25786eba-fe93-4c07-a918-adca34a634b8 tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] 10.222.0.52 "GET /compute/v2.1/servers/61edfb81-28c2-4818-bb73-b141c418e6b0" status: 200 len: 1318 microversion: 2.1 time: 0.163236 Oct 19 03:33:22.161722 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2305/4531] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:21 2022] GET /compute/v2.1/servers/61edfb81-28c2-4818-bb73-b141c418e6b0 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:33:22.174973 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-31edfed6-f193-4e84-9d03-ccbf33b018f9 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:22.178392 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-31edfed6-f193-4e84-9d03-ccbf33b018f9 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:22.186826 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-31edfed6-f193-4e84-9d03-ccbf33b018f9 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:22.187562 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-31edfed6-f193-4e84-9d03-ccbf33b018f9 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:22.188249 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-31edfed6-f193-4e84-9d03-ccbf33b018f9 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:22.189279 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-31edfed6-f193-4e84-9d03-ccbf33b018f9 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:22.189839 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-31edfed6-f193-4e84-9d03-ccbf33b018f9 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:22.190353 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-31edfed6-f193-4e84-9d03-ccbf33b018f9 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:22.610904 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-31edfed6-f193-4e84-9d03-ccbf33b018f9 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:22.622861 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-31edfed6-f193-4e84-9d03-ccbf33b018f9 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1670 microversion: 2.1 time: 0.458814 Oct 19 03:33:22.623933 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-f4f0170d-fbe6-4cf8-89f1-c22bc44d3e21 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Flavor limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:33:22.624429 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-f4f0170d-fbe6-4cf8-89f1-c22bc44d3e21 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Image limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:33:22.624835 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-f4f0170d-fbe6-4cf8-89f1-c22bc44d3e21 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Flavor pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:33:22.625324 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-f4f0170d-fbe6-4cf8-89f1-c22bc44d3e21 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Image pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:33:22.625775 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-f4f0170d-fbe6-4cf8-89f1-c22bc44d3e21 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:33:22.639381 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2306/4532] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:22 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1670 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:33:22.640269 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f4f0170d-fbe6-4cf8-89f1-c22bc44d3e21 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:22.641818 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f4f0170d-fbe6-4cf8-89f1-c22bc44d3e21 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:22.642745 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f4f0170d-fbe6-4cf8-89f1-c22bc44d3e21 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:22.645784 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f4f0170d-fbe6-4cf8-89f1-c22bc44d3e21 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:22.647066 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f4f0170d-fbe6-4cf8-89f1-c22bc44d3e21 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:22.648212 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f4f0170d-fbe6-4cf8-89f1-c22bc44d3e21 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:22.652455 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-30e66db5-c04f-422d-8ace-539c9991eb94 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:22.653428 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-30e66db5-c04f-422d-8ace-539c9991eb94 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] [instance: eb87cd67-6681-435d-9a65-56a2a06aaccb] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:22.662323 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-30e66db5-c04f-422d-8ace-539c9991eb94 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:22.663221 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-30e66db5-c04f-422d-8ace-539c9991eb94 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:22.663628 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-30e66db5-c04f-422d-8ace-539c9991eb94 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:22.665214 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-30e66db5-c04f-422d-8ace-539c9991eb94 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:22.665984 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-30e66db5-c04f-422d-8ace-539c9991eb94 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:22.666745 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-30e66db5-c04f-422d-8ace-539c9991eb94 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:22.672010 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-f4f0170d-fbe6-4cf8-89f1-c22bc44d3e21 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Getting quotas for project baf68030f15244c79a0d83ab3f3727ec. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:33:22.678505 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:33:22.680212 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-f4f0170d-fbe6-4cf8-89f1-c22bc44d3e21 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Getting quotas for user 34f3337e3ea74d868d2072683e44d472 and project baf68030f15244c79a0d83ab3f3727ec. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:33:22.694478 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f4f0170d-fbe6-4cf8-89f1-c22bc44d3e21 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Going to run 2 instances... {{(pid=121134) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:33:22.697341 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f4f0170d-fbe6-4cf8-89f1-c22bc44d3e21 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] [instance: 3363175a-58e7-4576-bd04-fe51f074f1f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:33:22.864915 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-30e66db5-c04f-422d-8ace-539c9991eb94 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b748815c10a46d2adc26d5c8a1ba268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc49f9b6a0054092beda3ab313bff1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:22.877484 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-30e66db5-c04f-422d-8ace-539c9991eb94 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] 10.222.0.52 "GET /compute/v2.1/servers/eb87cd67-6681-435d-9a65-56a2a06aaccb" status: 200 len: 1476 microversion: 2.1 time: 0.234628 Oct 19 03:33:22.878538 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2307/4533] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:22 2022] GET /compute/v2.1/servers/eb87cd67-6681-435d-9a65-56a2a06aaccb => generated 1476 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:33:22.885115 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-792d2e4f-4286-4705-b29e-c82aff298c93 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:22.886009 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-792d2e4f-4286-4705-b29e-c82aff298c93 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] [instance: 2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:22.892777 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-792d2e4f-4286-4705-b29e-c82aff298c93 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:22.893878 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-792d2e4f-4286-4705-b29e-c82aff298c93 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:22.894566 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-792d2e4f-4286-4705-b29e-c82aff298c93 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:22.896160 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-792d2e4f-4286-4705-b29e-c82aff298c93 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:22.896841 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-792d2e4f-4286-4705-b29e-c82aff298c93 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:22.899087 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-792d2e4f-4286-4705-b29e-c82aff298c93 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:22.958252 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f4f0170d-fbe6-4cf8-89f1-c22bc44d3e21 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] [instance: 5eb74612-283f-4ad9-b523-16b9eadbe7fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=3363175a-58e7-4576-bd04-fe51f074f1f7,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:33:23.216733 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f4f0170d-fbe6-4cf8-89f1-c22bc44d3e21 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.935724 Oct 19 03:33:23.217641 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2227/4534] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:33:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1948 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 03:33:23.233744 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-bb637052-b83c-45ea-aac2-05436150cf7e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:33:23.234602 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-bb637052-b83c-45ea-aac2-05436150cf7e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:23.267681 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bb637052-b83c-45ea-aac2-05436150cf7e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:23.268875 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bb637052-b83c-45ea-aac2-05436150cf7e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:23.269336 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bb637052-b83c-45ea-aac2-05436150cf7e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:23.270134 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bb637052-b83c-45ea-aac2-05436150cf7e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:23.274174 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bb637052-b83c-45ea-aac2-05436150cf7e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:23.274800 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bb637052-b83c-45ea-aac2-05436150cf7e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:23.408023 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-792d2e4f-4286-4705-b29e-c82aff298c93 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33d07a7db4846ababf001493c6e10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb0265509744c93b03fa5c28b4e9386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:23.427699 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-792d2e4f-4286-4705-b29e-c82aff298c93 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] 10.222.0.52 "GET /compute/v2.1/servers/2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62" status: 200 len: 1505 microversion: 2.1 time: 0.546364 Oct 19 03:33:23.428293 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2308/4535] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:22 2022] GET /compute/v2.1/servers/2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62 => generated 1505 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:33:23.448392 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c5ba9203-b75e-4b75-b802-5709c408aa3e tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:23.449033 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c5ba9203-b75e-4b75-b802-5709c408aa3e tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] [instance: 61edfb81-28c2-4818-bb73-b141c418e6b0] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:23.491296 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c5ba9203-b75e-4b75-b802-5709c408aa3e tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:23.492006 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c5ba9203-b75e-4b75-b802-5709c408aa3e tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:23.493707 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c5ba9203-b75e-4b75-b802-5709c408aa3e tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:23.495757 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c5ba9203-b75e-4b75-b802-5709c408aa3e tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:23.500378 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c5ba9203-b75e-4b75-b802-5709c408aa3e tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:23.501159 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c5ba9203-b75e-4b75-b802-5709c408aa3e tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:23.522086 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-bb637052-b83c-45ea-aac2-05436150cf7e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Unlocking {{(pid=121134) unlock /opt/stack/nova/nova/compute/api.py:4874}} Oct 19 03:33:23.543551 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-c5ba9203-b75e-4b75-b802-5709c408aa3e tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] HTTP exception thrown: Instance 61edfb81-28c2-4818-bb73-b141c418e6b0 could not be found. Oct 19 03:33:23.545720 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c5ba9203-b75e-4b75-b802-5709c408aa3e tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Request method failure captured: Oct 19 03:33:23.545720 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/61edfb81-28c2-4818-bb73-b141c418e6b0 HTTP/1.1 Oct 19 03:33:23.545720 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:33:23.545720 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:33:23.545720 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:33:23.545720 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:33:23.545720 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:33:23.545720 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:33:23.545720 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:33:23.545720 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:33:23.545720 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2_QT0n7PkkiFPpKmI3zLdHZw8w57HrYSK4TCqkzZc29X9AfF3UOgU7iKQSJTgryBYlPX2ZXfDF3DWpe2uoOT6w2O4QZYI2V5ueOYuL0Da6BEdsaCm3hA962Q_YxYzZDqUDP6Dq9tZUpSnQ80MeIsuqhthFxgMCeC2-GVFZMY5VzPes Oct 19 03:33:23.545720 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:33:23.545720 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:33:23.545720 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:33:23.545720 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:33:23.545720 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:33:23.545720 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:33:23.545720 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: eec35cc1c3324178b6314ed3272aa8cd Oct 19 03:33:23.545720 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1763412442 Oct 19 03:33:23.545720 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:33:23.545720 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:33:23.545720 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/eec35cc1c3324178b6314ed3272aa8cd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/eec35cc1c3324178b6314ed3272aa8cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/eec35cc1c3324178b6314ed3272aa8cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_eec35cc1c3324178b6314ed3272aa8cd", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:33:23.545720 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1763412442 Oct 19 03:33:23.545720 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: eec35cc1c3324178b6314ed3272aa8cd Oct 19 03:33:23.545720 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1763412442 Oct 19 03:33:23.545720 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1763412442-project Oct 19 03:33:23.545720 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:33:23.545720 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:33:23.545720 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: d51efba80d21425aa86baa138fb99770 Oct 19 03:33:23.545720 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1763412442-project Oct 19 03:33:23.545720 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:33:23.545720 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance 61edfb81-28c2-4818-bb73-b141c418e6b0 could not be found. Oct 19 03:33:23.545720 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '61edfb81-28c2-4818-bb73-b141c418e6b0'} Oct 19 03:33:23.545720 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:33:23.545720 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:33:23.545720 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:33:23.545720 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:33:23.545720 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:33:23.545720 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:33:23.545720 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:33:23.545720 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:33:23.545720 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:33:23.545720 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:33:23.545720 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61edfb81-28c2-4818-bb73-b141c418e6b0 could not be found. Oct 19 03:33:23.545720 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:33:23.545720 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:33:23.545720 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:33:23.545720 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:33:23.545720 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:33:23.545720 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:33:23.545720 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:33:23.545720 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:33:23.545720 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:33:23.545720 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:33:23.545720 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:33:23.545720 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:33:23.545720 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:33:23.545720 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:33:23.545720 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:33:23.545720 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:33:23.545720 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61edfb81-28c2-4818-bb73-b141c418e6b0 could not be found. Oct 19 03:33:23.545720 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:33:23.553797 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:33:23.553797 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:33:23.553797 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:33:23.553797 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:33:23.553797 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:33:23.553797 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:33:23.553797 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:33:23.553797 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61edfb81-28c2-4818-bb73-b141c418e6b0 could not be found. Oct 19 03:33:23.553797 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:33:23.553797 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c5ba9203-b75e-4b75-b802-5709c408aa3e tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] Returning 404 to user: Instance 61edfb81-28c2-4818-bb73-b141c418e6b0 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:33:23.553797 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c5ba9203-b75e-4b75-b802-5709c408aa3e tempest-ServersNegativeTestMultiTenantJSON-1763412442 tempest-ServersNegativeTestMultiTenantJSON-1763412442-project] 10.222.0.52 "GET /compute/v2.1/servers/61edfb81-28c2-4818-bb73-b141c418e6b0" status: 404 len: 111 microversion: 2.1 time: 0.111216 Oct 19 03:33:23.553797 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2309/4536] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:23 2022] GET /compute/v2.1/servers/61edfb81-28c2-4818-bb73-b141c418e6b0 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:33:23.566544 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-77e15753-d183-49df-b757-6b93059cbc25 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:23.588381 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-77e15753-d183-49df-b757-6b93059cbc25 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '34f3337e3ea74d868d2072683e44d472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baf68030f15244c79a0d83ab3f3727ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:23.589498 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-77e15753-d183-49df-b757-6b93059cbc25 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Searching by: {'deleted': False, 'project_id': 'baf68030f15244c79a0d83ab3f3727ec'} {{(pid=121135) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 03:33:23.632888 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-77e15753-d183-49df-b757-6b93059cbc25 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:23.634013 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-77e15753-d183-49df-b757-6b93059cbc25 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:23.634631 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-77e15753-d183-49df-b757-6b93059cbc25 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:23.635522 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-77e15753-d183-49df-b757-6b93059cbc25 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:23.636135 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-77e15753-d183-49df-b757-6b93059cbc25 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:23.636965 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-77e15753-d183-49df-b757-6b93059cbc25 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:23.671798 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-77e15753-d183-49df-b757-6b93059cbc25 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] 10.222.0.52 "GET /compute/v2.1/servers" status: 200 len: 677 microversion: 2.1 time: 0.116873 Oct 19 03:33:23.672551 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2310/4537] 10.222.0.52 () {58 vars in 1125 bytes} [Wed Oct 19 03:33:23 2022] GET /compute/v2.1/servers => generated 677 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:33:23.678506 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-76431cc6-720e-406a-93af-134785de146d req-3c4e7025-10b3-4174-9a0c-c8231b91f5ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb87cd67-6681-435d-9a65-56a2a06aaccb", "name": "network-vif-deleted", "tag": "c3fa2e3d-8e37-42f2-97ea-111ea45b20e5"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:33:23.690964 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-76431cc6-720e-406a-93af-134785de146d req-3c4e7025-10b3-4174-9a0c-c8231b91f5ee service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:23.691704 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-76431cc6-720e-406a-93af-134785de146d req-3c4e7025-10b3-4174-9a0c-c8231b91f5ee service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:23.692883 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-76431cc6-720e-406a-93af-134785de146d req-3c4e7025-10b3-4174-9a0c-c8231b91f5ee service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:23.708716 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-76431cc6-720e-406a-93af-134785de146d req-3c4e7025-10b3-4174-9a0c-c8231b91f5ee service nova] Creating event network-vif-deleted:c3fa2e3d-8e37-42f2-97ea-111ea45b20e5 for instance eb87cd67-6681-435d-9a65-56a2a06aaccb on n-h1-861333-8 Oct 19 03:33:23.717691 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-76431cc6-720e-406a-93af-134785de146d req-3c4e7025-10b3-4174-9a0c-c8231b91f5ee service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041059 Oct 19 03:33:23.719485 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2311/4538] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:33:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:33:23.745200 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-eff78f22-bed5-42fc-bdeb-fb1d2907ff6e tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:23.746012 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-eff78f22-bed5-42fc-bdeb-fb1d2907ff6e tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] [instance: 5eb74612-283f-4ad9-b523-16b9eadbe7fe] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:23.854585 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-bb637052-b83c-45ea-aac2-05436150cf7e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "POST /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f/action" status: 202 len: 0 microversion: 2.1 time: 0.635052 Oct 19 03:33:23.861040 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2228/4539] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:33:23 2022] POST /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f/action => generated 0 bytes in 638 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:33:23.867055 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-cdbde09a-6805-4224-97bb-4878a4f958a3 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:23.867553 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-cdbde09a-6805-4224-97bb-4878a4f958a3 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:23.878991 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cdbde09a-6805-4224-97bb-4878a4f958a3 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:23.885408 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cdbde09a-6805-4224-97bb-4878a4f958a3 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:23.885955 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cdbde09a-6805-4224-97bb-4878a4f958a3 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:23.890667 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cdbde09a-6805-4224-97bb-4878a4f958a3 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:23.890667 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cdbde09a-6805-4224-97bb-4878a4f958a3 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:23.890667 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cdbde09a-6805-4224-97bb-4878a4f958a3 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:23.891920 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-eff78f22-bed5-42fc-bdeb-fb1d2907ff6e tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f3337e3ea74d868d2072683e44d472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baf68030f15244c79a0d83ab3f3727ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:23.901591 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-eff78f22-bed5-42fc-bdeb-fb1d2907ff6e tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] 10.222.0.52 "GET /compute/v2.1/servers/5eb74612-283f-4ad9-b523-16b9eadbe7fe" status: 200 len: 1220 microversion: 2.1 time: 0.179654 Oct 19 03:33:23.906165 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2312/4540] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:23 2022] GET /compute/v2.1/servers/5eb74612-283f-4ad9-b523-16b9eadbe7fe => generated 1220 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:33:23.952607 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7cf9a032-9097-4299-8480-3b1de8c27523 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:23.952607 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7cf9a032-9097-4299-8480-3b1de8c27523 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] [instance: eb87cd67-6681-435d-9a65-56a2a06aaccb] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:23.952607 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7cf9a032-9097-4299-8480-3b1de8c27523 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:23.952607 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7cf9a032-9097-4299-8480-3b1de8c27523 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:23.952607 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7cf9a032-9097-4299-8480-3b1de8c27523 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:23.952607 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7cf9a032-9097-4299-8480-3b1de8c27523 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:23.952607 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7cf9a032-9097-4299-8480-3b1de8c27523 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:23.952607 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7cf9a032-9097-4299-8480-3b1de8c27523 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:24.013236 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7cf9a032-9097-4299-8480-3b1de8c27523 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:24.013939 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7cf9a032-9097-4299-8480-3b1de8c27523 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:24.014322 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7cf9a032-9097-4299-8480-3b1de8c27523 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:24.015021 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-7cf9a032-9097-4299-8480-3b1de8c27523 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lazy-loading 'fault' on Instance uuid eb87cd67-6681-435d-9a65-56a2a06aaccb {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:33:24.341592 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7cf9a032-9097-4299-8480-3b1de8c27523 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b748815c10a46d2adc26d5c8a1ba268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc49f9b6a0054092beda3ab313bff1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:24.352954 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7cf9a032-9097-4299-8480-3b1de8c27523 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] 10.222.0.52 "GET /compute/v2.1/servers/eb87cd67-6681-435d-9a65-56a2a06aaccb" status: 200 len: 1311 microversion: 2.1 time: 0.435702 Oct 19 03:33:24.356929 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2313/4541] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:23 2022] GET /compute/v2.1/servers/eb87cd67-6681-435d-9a65-56a2a06aaccb => generated 1311 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:33:24.471111 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ddc66271-1858-41dd-9643-5b06ff1b78da tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:24.471111 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ddc66271-1858-41dd-9643-5b06ff1b78da tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] [instance: 2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:24.475804 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:33:24.486283 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ddc66271-1858-41dd-9643-5b06ff1b78da tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:24.489518 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ddc66271-1858-41dd-9643-5b06ff1b78da tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:24.490808 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ddc66271-1858-41dd-9643-5b06ff1b78da tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:24.494024 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ddc66271-1858-41dd-9643-5b06ff1b78da tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:24.495448 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ddc66271-1858-41dd-9643-5b06ff1b78da tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:24.496361 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ddc66271-1858-41dd-9643-5b06ff1b78da tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:24.786074 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-cdbde09a-6805-4224-97bb-4878a4f958a3 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:24.792348 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-cdbde09a-6805-4224-97bb-4878a4f958a3 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1670 microversion: 2.1 time: 0.929947 Oct 19 03:33:24.798490 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2229/4542] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:23 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1670 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:33:24.820667 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d1ea4ca1-455c-412b-82a6-a7aadfc5a7ea tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:24.821286 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d1ea4ca1-455c-412b-82a6-a7aadfc5a7ea tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:24.828469 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d1ea4ca1-455c-412b-82a6-a7aadfc5a7ea tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:24.829301 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d1ea4ca1-455c-412b-82a6-a7aadfc5a7ea tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:24.829987 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d1ea4ca1-455c-412b-82a6-a7aadfc5a7ea tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:24.831058 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d1ea4ca1-455c-412b-82a6-a7aadfc5a7ea tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:24.831882 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d1ea4ca1-455c-412b-82a6-a7aadfc5a7ea tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:24.832601 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d1ea4ca1-455c-412b-82a6-a7aadfc5a7ea tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:25.169086 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ddc66271-1858-41dd-9643-5b06ff1b78da tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33d07a7db4846ababf001493c6e10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb0265509744c93b03fa5c28b4e9386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:25.175757 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ddc66271-1858-41dd-9643-5b06ff1b78da tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] 10.222.0.52 "GET /compute/v2.1/servers/2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62" status: 200 len: 1505 microversion: 2.1 time: 0.719318 Oct 19 03:33:25.177337 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2314/4543] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:24 2022] GET /compute/v2.1/servers/2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62 => generated 1505 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:33:25.198143 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a5656ef0-1c69-4d49-aacb-8af6e53de6a8 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:25.198779 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a5656ef0-1c69-4d49-aacb-8af6e53de6a8 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] [instance: 5eb74612-283f-4ad9-b523-16b9eadbe7fe] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:25.375046 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a5656ef0-1c69-4d49-aacb-8af6e53de6a8 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f3337e3ea74d868d2072683e44d472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baf68030f15244c79a0d83ab3f3727ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:25.380117 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a5656ef0-1c69-4d49-aacb-8af6e53de6a8 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] 10.222.0.52 "GET /compute/v2.1/servers/5eb74612-283f-4ad9-b523-16b9eadbe7fe" status: 200 len: 1220 microversion: 2.1 time: 0.198862 Oct 19 03:33:25.380749 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2315/4544] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:25 2022] GET /compute/v2.1/servers/5eb74612-283f-4ad9-b523-16b9eadbe7fe => generated 1220 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:33:25.403113 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4f8bb287-9163-41fa-bcde-afb4bbac8c76 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:25.403754 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4f8bb287-9163-41fa-bcde-afb4bbac8c76 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] [instance: eb87cd67-6681-435d-9a65-56a2a06aaccb] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:25.416534 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4f8bb287-9163-41fa-bcde-afb4bbac8c76 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:25.430801 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4f8bb287-9163-41fa-bcde-afb4bbac8c76 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:25.432143 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4f8bb287-9163-41fa-bcde-afb4bbac8c76 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:25.438355 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4f8bb287-9163-41fa-bcde-afb4bbac8c76 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:25.441632 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4f8bb287-9163-41fa-bcde-afb4bbac8c76 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:25.444041 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4f8bb287-9163-41fa-bcde-afb4bbac8c76 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:25.509332 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-4f8bb287-9163-41fa-bcde-afb4bbac8c76 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] HTTP exception thrown: Instance eb87cd67-6681-435d-9a65-56a2a06aaccb could not be found. Oct 19 03:33:25.515402 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4f8bb287-9163-41fa-bcde-afb4bbac8c76 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Request method failure captured: Oct 19 03:33:25.515402 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/eb87cd67-6681-435d-9a65-56a2a06aaccb HTTP/1.1 Oct 19 03:33:25.515402 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:33:25.515402 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:33:25.515402 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:33:25.515402 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:33:25.515402 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:33:25.515402 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:33:25.515402 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:33:25.515402 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:33:25.515402 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2-5e2XhsXmP35HSRHi_T9p0SfPT3ewtb8uWPfP4h1G2MmuiOYszRcdxSv6HkCeaYyaU8DEwsVXV36vGlBv-0-Coo2xsyCONAY-SUqOmPojFT8wdhzGWw_67t0O74owMxUk4q4eCY-LC_YGZ9O5D28gHpWikSTfVPU3Tu8uQB5NrzW8 Oct 19 03:33:25.515402 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:33:25.515402 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:33:25.515402 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:33:25.515402 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:33:25.515402 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:33:25.515402 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:33:25.515402 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: dc49f9b6a0054092beda3ab313bff1b9 Oct 19 03:33:25.515402 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1782357896 Oct 19 03:33:25.515402 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:33:25.515402 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:33:25.515402 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/dc49f9b6a0054092beda3ab313bff1b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/dc49f9b6a0054092beda3ab313bff1b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/dc49f9b6a0054092beda3ab313bff1b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_dc49f9b6a0054092beda3ab313bff1b9", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:33:25.515402 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1782357896 Oct 19 03:33:25.515402 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: dc49f9b6a0054092beda3ab313bff1b9 Oct 19 03:33:25.515402 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1782357896 Oct 19 03:33:25.515402 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ServersAdminNegativeTestJSON-1782357896-project Oct 19 03:33:25.515402 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:33:25.515402 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:33:25.515402 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 4b748815c10a46d2adc26d5c8a1ba268 Oct 19 03:33:25.515402 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1782357896-project Oct 19 03:33:25.515402 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:33:25.515402 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance eb87cd67-6681-435d-9a65-56a2a06aaccb could not be found. Oct 19 03:33:25.515402 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': 'eb87cd67-6681-435d-9a65-56a2a06aaccb'} Oct 19 03:33:25.515402 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:33:25.515402 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:33:25.515402 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:33:25.515402 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:33:25.515402 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:33:25.515402 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:33:25.515402 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:33:25.515402 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:33:25.515402 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:33:25.515402 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:33:25.515402 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb87cd67-6681-435d-9a65-56a2a06aaccb could not be found. Oct 19 03:33:25.515402 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:33:25.515402 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:33:25.515402 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:33:25.515402 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:33:25.515402 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:33:25.515402 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:33:25.515402 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:33:25.515402 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:33:25.515402 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:33:25.515402 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:33:25.515402 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:33:25.515402 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:33:25.515402 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:33:25.515402 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:33:25.515402 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:33:25.515402 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:33:25.515402 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb87cd67-6681-435d-9a65-56a2a06aaccb could not be found. Oct 19 03:33:25.515402 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:33:25.515402 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:33:25.519755 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:33:25.519755 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:33:25.519755 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:33:25.519755 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:33:25.519755 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:33:25.519755 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:33:25.519755 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb87cd67-6681-435d-9a65-56a2a06aaccb could not be found. Oct 19 03:33:25.519755 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:33:25.519755 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4f8bb287-9163-41fa-bcde-afb4bbac8c76 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] Returning 404 to user: Instance eb87cd67-6681-435d-9a65-56a2a06aaccb could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:33:25.521634 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4f8bb287-9163-41fa-bcde-afb4bbac8c76 tempest-ServersAdminNegativeTestJSON-1782357896 tempest-ServersAdminNegativeTestJSON-1782357896-project] 10.222.0.52 "GET /compute/v2.1/servers/eb87cd67-6681-435d-9a65-56a2a06aaccb" status: 404 len: 111 microversion: 2.1 time: 0.122354 Oct 19 03:33:25.525336 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2316/4545] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:25 2022] GET /compute/v2.1/servers/eb87cd67-6681-435d-9a65-56a2a06aaccb => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:33:25.709052 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d1ea4ca1-455c-412b-82a6-a7aadfc5a7ea tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:25.720687 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d1ea4ca1-455c-412b-82a6-a7aadfc5a7ea tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1670 microversion: 2.1 time: 0.904522 Oct 19 03:33:25.725042 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2230/4546] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:24 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1670 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:33:25.750571 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2a7dd8f2-e5cd-40d0-a738-aefc50a48ed4 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:25.751454 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-2a7dd8f2-e5cd-40d0-a738-aefc50a48ed4 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:25.760875 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2a7dd8f2-e5cd-40d0-a738-aefc50a48ed4 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:25.761596 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2a7dd8f2-e5cd-40d0-a738-aefc50a48ed4 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:25.762997 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2a7dd8f2-e5cd-40d0-a738-aefc50a48ed4 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:25.765643 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2a7dd8f2-e5cd-40d0-a738-aefc50a48ed4 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:25.767905 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2a7dd8f2-e5cd-40d0-a738-aefc50a48ed4 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:25.768497 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2a7dd8f2-e5cd-40d0-a738-aefc50a48ed4 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:25.780253 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:33:26.201710 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-54df9e88-89fd-4e93-9a40-27cbcf9a2d22 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:26.202816 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-54df9e88-89fd-4e93-9a40-27cbcf9a2d22 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] [instance: 2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:26.213857 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-54df9e88-89fd-4e93-9a40-27cbcf9a2d22 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:26.214392 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-54df9e88-89fd-4e93-9a40-27cbcf9a2d22 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:26.215036 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-54df9e88-89fd-4e93-9a40-27cbcf9a2d22 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:26.218423 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-54df9e88-89fd-4e93-9a40-27cbcf9a2d22 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:26.219171 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-54df9e88-89fd-4e93-9a40-27cbcf9a2d22 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:26.220134 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-54df9e88-89fd-4e93-9a40-27cbcf9a2d22 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:26.683311 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-2a7dd8f2-e5cd-40d0-a738-aefc50a48ed4 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:26.690458 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-54df9e88-89fd-4e93-9a40-27cbcf9a2d22 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33d07a7db4846ababf001493c6e10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb0265509744c93b03fa5c28b4e9386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:26.695880 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2a7dd8f2-e5cd-40d0-a738-aefc50a48ed4 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1670 microversion: 2.1 time: 0.947649 Oct 19 03:33:26.696661 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2317/4547] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:25 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1670 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:33:26.700066 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-54df9e88-89fd-4e93-9a40-27cbcf9a2d22 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] 10.222.0.52 "GET /compute/v2.1/servers/2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62" status: 200 len: 1485 microversion: 2.1 time: 0.503837 Oct 19 03:33:26.712331 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-01f80634-a694-4e0a-b90b-32aa0171ecf6 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:26.714209 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2231/4548] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:26 2022] GET /compute/v2.1/servers/2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62 => generated 1485 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:33:26.716661 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-01f80634-a694-4e0a-b90b-32aa0171ecf6 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] [instance: 5eb74612-283f-4ad9-b523-16b9eadbe7fe] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:26.726852 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-750ea2c2-232c-4626-a091-d45a4f4e83c1 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:33:26.727409 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-750ea2c2-232c-4626-a091-d45a4f4e83c1 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:26.735145 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-01f80634-a694-4e0a-b90b-32aa0171ecf6 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:26.736228 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-01f80634-a694-4e0a-b90b-32aa0171ecf6 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:26.742406 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-750ea2c2-232c-4626-a091-d45a4f4e83c1 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:26.743243 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-750ea2c2-232c-4626-a091-d45a4f4e83c1 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:26.743915 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-750ea2c2-232c-4626-a091-d45a4f4e83c1 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:26.744862 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-750ea2c2-232c-4626-a091-d45a4f4e83c1 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:26.745357 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-01f80634-a694-4e0a-b90b-32aa0171ecf6 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:26.745851 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-750ea2c2-232c-4626-a091-d45a4f4e83c1 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:26.746510 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-750ea2c2-232c-4626-a091-d45a4f4e83c1 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:26.752178 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-01f80634-a694-4e0a-b90b-32aa0171ecf6 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:26.752178 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-01f80634-a694-4e0a-b90b-32aa0171ecf6 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:26.754468 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-01f80634-a694-4e0a-b90b-32aa0171ecf6 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:26.907501 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-01f80634-a694-4e0a-b90b-32aa0171ecf6 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f3337e3ea74d868d2072683e44d472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baf68030f15244c79a0d83ab3f3727ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:26.920856 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-01f80634-a694-4e0a-b90b-32aa0171ecf6 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] 10.222.0.52 "GET /compute/v2.1/servers/5eb74612-283f-4ad9-b523-16b9eadbe7fe" status: 200 len: 1224 microversion: 2.1 time: 0.221842 Oct 19 03:33:26.937095 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2318/4549] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:26 2022] GET /compute/v2.1/servers/5eb74612-283f-4ad9-b523-16b9eadbe7fe => generated 1224 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:33:26.937095 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-bca897d7-a764-43d5-b86d-877394eb6dd7 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1412560885", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:33:27.028540 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.network.neutron [None req-bca897d7-a764-43d5-b86d-877394eb6dd7 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] validate_networks() for [('cad12fd7-9383-43fe-b950-8ddddabe8de2', None, None, None, None, None)] {{(pid=121135) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:33:27.113747 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-750ea2c2-232c-4626-a091-d45a4f4e83c1 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "POST /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f/action" status: 202 len: 0 microversion: 2.1 time: 0.391615 Oct 19 03:33:27.117196 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2232/4550] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:33:26 2022] POST /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f/action => generated 0 bytes in 401 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:33:27.130499 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d5fd5b2f-9f78-40db-bb08-da5067cca112 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:27.139564 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d5fd5b2f-9f78-40db-bb08-da5067cca112 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:27.142402 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d5fd5b2f-9f78-40db-bb08-da5067cca112 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:27.143882 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d5fd5b2f-9f78-40db-bb08-da5067cca112 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:27.144574 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d5fd5b2f-9f78-40db-bb08-da5067cca112 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:27.147573 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d5fd5b2f-9f78-40db-bb08-da5067cca112 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:27.149297 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d5fd5b2f-9f78-40db-bb08-da5067cca112 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:27.150787 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d5fd5b2f-9f78-40db-bb08-da5067cca112 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:27.635888 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d5fd5b2f-9f78-40db-bb08-da5067cca112 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:27.647948 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d5fd5b2f-9f78-40db-bb08-da5067cca112 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1675 microversion: 2.1 time: 0.526192 Oct 19 03:33:27.648837 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2233/4551] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:27 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1675 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:33:27.956861 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d22d2f63-0f93-4c21-bc5b-34241fd657d9 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:27.958050 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d22d2f63-0f93-4c21-bc5b-34241fd657d9 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] [instance: 5eb74612-283f-4ad9-b523-16b9eadbe7fe] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:27.967096 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d22d2f63-0f93-4c21-bc5b-34241fd657d9 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:27.967871 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d22d2f63-0f93-4c21-bc5b-34241fd657d9 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:27.968466 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d22d2f63-0f93-4c21-bc5b-34241fd657d9 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:27.969361 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d22d2f63-0f93-4c21-bc5b-34241fd657d9 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:27.972192 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d22d2f63-0f93-4c21-bc5b-34241fd657d9 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:27.972192 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d22d2f63-0f93-4c21-bc5b-34241fd657d9 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:28.308018 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d22d2f63-0f93-4c21-bc5b-34241fd657d9 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f3337e3ea74d868d2072683e44d472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baf68030f15244c79a0d83ab3f3727ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:28.316841 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d22d2f63-0f93-4c21-bc5b-34241fd657d9 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] 10.222.0.52 "GET /compute/v2.1/servers/5eb74612-283f-4ad9-b523-16b9eadbe7fe" status: 200 len: 1272 microversion: 2.1 time: 0.369838 Oct 19 03:33:28.320460 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2234/4552] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:27 2022] GET /compute/v2.1/servers/5eb74612-283f-4ad9-b523-16b9eadbe7fe => generated 1272 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:33:28.632440 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-bca897d7-a764-43d5-b86d-877394eb6dd7 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Flavor limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:33:28.635263 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-bca897d7-a764-43d5-b86d-877394eb6dd7 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Image limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:33:28.637005 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-bca897d7-a764-43d5-b86d-877394eb6dd7 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Flavor pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:33:28.638143 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-bca897d7-a764-43d5-b86d-877394eb6dd7 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Image pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:33:28.639145 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-bca897d7-a764-43d5-b86d-877394eb6dd7 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:33:28.671937 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-edec5243-4159-4ae8-8db5-79d33567f41e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:28.672376 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-edec5243-4159-4ae8-8db5-79d33567f41e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:28.679187 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bca897d7-a764-43d5-b86d-877394eb6dd7 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:28.680205 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bca897d7-a764-43d5-b86d-877394eb6dd7 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:28.680909 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bca897d7-a764-43d5-b86d-877394eb6dd7 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:28.682599 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bca897d7-a764-43d5-b86d-877394eb6dd7 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:28.683458 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bca897d7-a764-43d5-b86d-877394eb6dd7 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:28.684290 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bca897d7-a764-43d5-b86d-877394eb6dd7 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:28.692755 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-edec5243-4159-4ae8-8db5-79d33567f41e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:28.692755 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-edec5243-4159-4ae8-8db5-79d33567f41e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:28.692755 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-edec5243-4159-4ae8-8db5-79d33567f41e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:28.692755 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-edec5243-4159-4ae8-8db5-79d33567f41e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:28.693886 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-edec5243-4159-4ae8-8db5-79d33567f41e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:28.694503 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-edec5243-4159-4ae8-8db5-79d33567f41e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:28.741709 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-bca897d7-a764-43d5-b86d-877394eb6dd7 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Getting quotas for project 2cb0265509744c93b03fa5c28b4e9386. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:33:28.752458 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-bca897d7-a764-43d5-b86d-877394eb6dd7 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Getting quotas for user b33d07a7db4846ababf001493c6e10d4 and project 2cb0265509744c93b03fa5c28b4e9386. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:33:28.781427 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-bca897d7-a764-43d5-b86d-877394eb6dd7 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Going to run 1 instances... {{(pid=121135) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:33:28.789841 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-bca897d7-a764-43d5-b86d-877394eb6dd7 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] [instance: 29a2d62a-83d9-43e2-8907-f4158500d83f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121135) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:33:29.014622 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-bca897d7-a764-43d5-b86d-877394eb6dd7 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.089594 Oct 19 03:33:29.021859 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2319/4553] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:33:26 2022] POST /compute/v2.1/servers => generated 383 bytes in 2093 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 03:33:29.032775 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f6a52f01-2455-4eb0-8b90-178bea1e0d40 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:29.046159 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f6a52f01-2455-4eb0-8b90-178bea1e0d40 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] [instance: 29a2d62a-83d9-43e2-8907-f4158500d83f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:29.525166 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f6a52f01-2455-4eb0-8b90-178bea1e0d40 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33d07a7db4846ababf001493c6e10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb0265509744c93b03fa5c28b4e9386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:29.552627 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f6a52f01-2455-4eb0-8b90-178bea1e0d40 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] 10.222.0.52 "GET /compute/v2.1/servers/29a2d62a-83d9-43e2-8907-f4158500d83f" status: 200 len: 1214 microversion: 2.1 time: 0.527262 Oct 19 03:33:29.555223 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2320/4554] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:29 2022] GET /compute/v2.1/servers/29a2d62a-83d9-43e2-8907-f4158500d83f => generated 1214 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:33:29.573065 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-cfa3baed-978d-4649-ade0-da87c1d85587 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:29.574112 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-cfa3baed-978d-4649-ade0-da87c1d85587 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] [instance: 5eb74612-283f-4ad9-b523-16b9eadbe7fe] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:29.589962 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cfa3baed-978d-4649-ade0-da87c1d85587 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:29.594434 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cfa3baed-978d-4649-ade0-da87c1d85587 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:29.594434 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cfa3baed-978d-4649-ade0-da87c1d85587 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:29.594434 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cfa3baed-978d-4649-ade0-da87c1d85587 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:29.594890 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cfa3baed-978d-4649-ade0-da87c1d85587 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:29.596647 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cfa3baed-978d-4649-ade0-da87c1d85587 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:29.830490 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-cfa3baed-978d-4649-ade0-da87c1d85587 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f3337e3ea74d868d2072683e44d472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baf68030f15244c79a0d83ab3f3727ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:29.832997 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-cfa3baed-978d-4649-ade0-da87c1d85587 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] 10.222.0.52 "GET /compute/v2.1/servers/5eb74612-283f-4ad9-b523-16b9eadbe7fe" status: 200 len: 1278 microversion: 2.1 time: 0.272739 Oct 19 03:33:29.834503 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2321/4555] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:29 2022] GET /compute/v2.1/servers/5eb74612-283f-4ad9-b523-16b9eadbe7fe => generated 1278 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:33:29.844890 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-edec5243-4159-4ae8-8db5-79d33567f41e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:29.881511 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-edec5243-4159-4ae8-8db5-79d33567f41e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1655 microversion: 2.1 time: 1.214040 Oct 19 03:33:29.890802 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2235/4556] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:28 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1655 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:33:29.912614 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b5bb829a-4e10-4b93-b7e5-6dfaddeb44b0 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:33:29.913171 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b5bb829a-4e10-4b93-b7e5-6dfaddeb44b0 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:29.927054 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b5bb829a-4e10-4b93-b7e5-6dfaddeb44b0 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:29.928811 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b5bb829a-4e10-4b93-b7e5-6dfaddeb44b0 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:29.929249 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b5bb829a-4e10-4b93-b7e5-6dfaddeb44b0 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:29.933882 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b5bb829a-4e10-4b93-b7e5-6dfaddeb44b0 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:29.934927 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b5bb829a-4e10-4b93-b7e5-6dfaddeb44b0 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:29.939048 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b5bb829a-4e10-4b93-b7e5-6dfaddeb44b0 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:30.306765 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b5bb829a-4e10-4b93-b7e5-6dfaddeb44b0 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "POST /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f/action" status: 202 len: 0 microversion: 2.1 time: 0.399714 Oct 19 03:33:30.307805 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2322/4557] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:33:29 2022] POST /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f/action => generated 0 bytes in 402 msecs (HTTP/1.1 202) 9 headers in 361 bytes (3 switches on core 0) Oct 19 03:33:30.319230 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-cba73209-1456-487e-87c2-46d996521310 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:30.320106 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-cba73209-1456-487e-87c2-46d996521310 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:30.340730 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cba73209-1456-487e-87c2-46d996521310 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:30.346389 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cba73209-1456-487e-87c2-46d996521310 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:30.346925 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cba73209-1456-487e-87c2-46d996521310 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:30.352583 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cba73209-1456-487e-87c2-46d996521310 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:30.356619 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cba73209-1456-487e-87c2-46d996521310 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:30.358081 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cba73209-1456-487e-87c2-46d996521310 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:30.586777 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-87ea15e6-e1d0-4cc6-b70f-ea2f3e1f0792 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:30.587496 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-87ea15e6-e1d0-4cc6-b70f-ea2f3e1f0792 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] [instance: 29a2d62a-83d9-43e2-8907-f4158500d83f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:30.798640 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-87ea15e6-e1d0-4cc6-b70f-ea2f3e1f0792 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33d07a7db4846ababf001493c6e10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb0265509744c93b03fa5c28b4e9386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:30.810058 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-87ea15e6-e1d0-4cc6-b70f-ea2f3e1f0792 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] 10.222.0.52 "GET /compute/v2.1/servers/29a2d62a-83d9-43e2-8907-f4158500d83f" status: 200 len: 1214 microversion: 2.1 time: 0.229262 Oct 19 03:33:30.821785 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2323/4558] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:30 2022] GET /compute/v2.1/servers/29a2d62a-83d9-43e2-8907-f4158500d83f => generated 1214 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:33:30.868345 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9551ab45-57e4-48fe-abdb-26ebb6565551 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:30.871203 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9551ab45-57e4-48fe-abdb-26ebb6565551 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] [instance: 5eb74612-283f-4ad9-b523-16b9eadbe7fe] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:30.889836 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9551ab45-57e4-48fe-abdb-26ebb6565551 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:30.902288 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9551ab45-57e4-48fe-abdb-26ebb6565551 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:30.904874 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9551ab45-57e4-48fe-abdb-26ebb6565551 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:30.904874 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9551ab45-57e4-48fe-abdb-26ebb6565551 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:30.904874 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9551ab45-57e4-48fe-abdb-26ebb6565551 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:30.907036 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9551ab45-57e4-48fe-abdb-26ebb6565551 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:32.065474 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-cba73209-1456-487e-87c2-46d996521310 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:32.079202 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-cba73209-1456-487e-87c2-46d996521310 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1662 microversion: 2.1 time: 1.763971 Oct 19 03:33:32.079202 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2236/4559] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:30 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1662 bytes in 1768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:33:32.091292 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d3aa88dc-8da8-4580-bb75-070d3f6a1e0b tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:32.092024 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d3aa88dc-8da8-4580-bb75-070d3f6a1e0b tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] [instance: 29a2d62a-83d9-43e2-8907-f4158500d83f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:32.109658 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d3aa88dc-8da8-4580-bb75-070d3f6a1e0b tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:32.128486 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d3aa88dc-8da8-4580-bb75-070d3f6a1e0b tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:32.129088 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d3aa88dc-8da8-4580-bb75-070d3f6a1e0b tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:32.134031 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d3aa88dc-8da8-4580-bb75-070d3f6a1e0b tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:32.134533 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d3aa88dc-8da8-4580-bb75-070d3f6a1e0b tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:32.134977 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d3aa88dc-8da8-4580-bb75-070d3f6a1e0b tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:32.228900 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-9551ab45-57e4-48fe-abdb-26ebb6565551 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f3337e3ea74d868d2072683e44d472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baf68030f15244c79a0d83ab3f3727ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:32.235916 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9551ab45-57e4-48fe-abdb-26ebb6565551 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] 10.222.0.52 "GET /compute/v2.1/servers/5eb74612-283f-4ad9-b523-16b9eadbe7fe" status: 200 len: 1320 microversion: 2.1 time: 1.371910 Oct 19 03:33:32.239301 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:33:32.241425 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2324/4560] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:30 2022] GET /compute/v2.1/servers/5eb74612-283f-4ad9-b523-16b9eadbe7fe => generated 1320 bytes in 1378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:33:32.403595 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d3aa88dc-8da8-4580-bb75-070d3f6a1e0b tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33d07a7db4846ababf001493c6e10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb0265509744c93b03fa5c28b4e9386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:32.412676 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d3aa88dc-8da8-4580-bb75-070d3f6a1e0b tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] 10.222.0.52 "GET /compute/v2.1/servers/29a2d62a-83d9-43e2-8907-f4158500d83f" status: 200 len: 1266 microversion: 2.1 time: 0.331603 Oct 19 03:33:32.419225 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2237/4561] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:32 2022] GET /compute/v2.1/servers/29a2d62a-83d9-43e2-8907-f4158500d83f => generated 1266 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:33:33.111546 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7b7fa565-e94a-4007-8a54-99471d0692bb tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:33.112239 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7b7fa565-e94a-4007-8a54-99471d0692bb tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:33.119794 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7b7fa565-e94a-4007-8a54-99471d0692bb tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:33.123045 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7b7fa565-e94a-4007-8a54-99471d0692bb tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:33.127829 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7b7fa565-e94a-4007-8a54-99471d0692bb tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:33.130407 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7b7fa565-e94a-4007-8a54-99471d0692bb tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:33.130407 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7b7fa565-e94a-4007-8a54-99471d0692bb tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:33.130407 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7b7fa565-e94a-4007-8a54-99471d0692bb tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:33.276703 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a666375d-02aa-4800-ae3e-cac802135ddf tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:33.278147 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a666375d-02aa-4800-ae3e-cac802135ddf tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] [instance: 5eb74612-283f-4ad9-b523-16b9eadbe7fe] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:33.281705 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:33:33.283330 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=6 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:33:33.298154 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a666375d-02aa-4800-ae3e-cac802135ddf tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:33.302747 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a666375d-02aa-4800-ae3e-cac802135ddf tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:33.303360 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a666375d-02aa-4800-ae3e-cac802135ddf tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:33.306492 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a666375d-02aa-4800-ae3e-cac802135ddf tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:33.308102 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a666375d-02aa-4800-ae3e-cac802135ddf tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:33.310433 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a666375d-02aa-4800-ae3e-cac802135ddf tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:34.058501 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7b7fa565-e94a-4007-8a54-99471d0692bb tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:34.073187 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7b7fa565-e94a-4007-8a54-99471d0692bb tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1670 microversion: 2.1 time: 0.965618 Oct 19 03:33:34.075881 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2325/4562] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:33 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1670 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:33:34.085825 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-71ae871a-7ef6-4d32-b65f-d3754504b1c8 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:34.086384 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-71ae871a-7ef6-4d32-b65f-d3754504b1c8 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] [instance: 29a2d62a-83d9-43e2-8907-f4158500d83f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:34.098458 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-71ae871a-7ef6-4d32-b65f-d3754504b1c8 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:34.104061 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-71ae871a-7ef6-4d32-b65f-d3754504b1c8 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:34.104850 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-71ae871a-7ef6-4d32-b65f-d3754504b1c8 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:34.105976 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-71ae871a-7ef6-4d32-b65f-d3754504b1c8 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:34.106843 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-71ae871a-7ef6-4d32-b65f-d3754504b1c8 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:34.107291 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-71ae871a-7ef6-4d32-b65f-d3754504b1c8 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:34.183038 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a666375d-02aa-4800-ae3e-cac802135ddf tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f3337e3ea74d868d2072683e44d472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baf68030f15244c79a0d83ab3f3727ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:34.198248 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a666375d-02aa-4800-ae3e-cac802135ddf tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] 10.222.0.52 "GET /compute/v2.1/servers/5eb74612-283f-4ad9-b523-16b9eadbe7fe" status: 200 len: 1320 microversion: 2.1 time: 0.931454 Oct 19 03:33:34.203027 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2238/4563] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:33 2022] GET /compute/v2.1/servers/5eb74612-283f-4ad9-b523-16b9eadbe7fe => generated 1320 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:33:34.216688 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8cc736d3-b8a7-41aa-81a2-0fe5f63fdedc tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:34.216688 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8cc736d3-b8a7-41aa-81a2-0fe5f63fdedc tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:34.233718 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8cc736d3-b8a7-41aa-81a2-0fe5f63fdedc tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:34.234331 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8cc736d3-b8a7-41aa-81a2-0fe5f63fdedc tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:34.234874 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8cc736d3-b8a7-41aa-81a2-0fe5f63fdedc tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:34.235773 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8cc736d3-b8a7-41aa-81a2-0fe5f63fdedc tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:34.236308 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8cc736d3-b8a7-41aa-81a2-0fe5f63fdedc tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:34.236811 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8cc736d3-b8a7-41aa-81a2-0fe5f63fdedc tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:34.332911 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-71ae871a-7ef6-4d32-b65f-d3754504b1c8 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33d07a7db4846ababf001493c6e10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb0265509744c93b03fa5c28b4e9386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:34.342177 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-71ae871a-7ef6-4d32-b65f-d3754504b1c8 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] 10.222.0.52 "GET /compute/v2.1/servers/29a2d62a-83d9-43e2-8907-f4158500d83f" status: 200 len: 1272 microversion: 2.1 time: 0.265185 Oct 19 03:33:34.343085 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2326/4564] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:34 2022] GET /compute/v2.1/servers/29a2d62a-83d9-43e2-8907-f4158500d83f => generated 1272 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:33:34.483451 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-19860fa1-2abe-4406-960f-4e87c4ac2138 req-0cb04eb6-3b0d-471c-9d2f-22375a50cde5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5eb74612-283f-4ad9-b523-16b9eadbe7fe", "tag": "d0c01678-0a88-4ad6-82fe-1f08e34ac7ff"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:33:34.503812 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-19860fa1-2abe-4406-960f-4e87c4ac2138 req-0cb04eb6-3b0d-471c-9d2f-22375a50cde5 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:34.504378 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-19860fa1-2abe-4406-960f-4e87c4ac2138 req-0cb04eb6-3b0d-471c-9d2f-22375a50cde5 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:34.505413 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-19860fa1-2abe-4406-960f-4e87c4ac2138 req-0cb04eb6-3b0d-471c-9d2f-22375a50cde5 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:34.520829 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-19860fa1-2abe-4406-960f-4e87c4ac2138 req-0cb04eb6-3b0d-471c-9d2f-22375a50cde5 service nova] Creating event network-changed:d0c01678-0a88-4ad6-82fe-1f08e34ac7ff for instance 5eb74612-283f-4ad9-b523-16b9eadbe7fe on n-h1-861333-8 Oct 19 03:33:34.528211 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-19860fa1-2abe-4406-960f-4e87c4ac2138 req-0cb04eb6-3b0d-471c-9d2f-22375a50cde5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048331 Oct 19 03:33:34.528211 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2327/4565] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:33:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:33:35.229069 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3a0972cb-5e1b-4234-b901-8d7f0da23c36 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:35.229837 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-3a0972cb-5e1b-4234-b901-8d7f0da23c36 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] [instance: 5eb74612-283f-4ad9-b523-16b9eadbe7fe] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:35.243718 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3a0972cb-5e1b-4234-b901-8d7f0da23c36 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:35.244227 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3a0972cb-5e1b-4234-b901-8d7f0da23c36 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:35.244677 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3a0972cb-5e1b-4234-b901-8d7f0da23c36 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:35.245841 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3a0972cb-5e1b-4234-b901-8d7f0da23c36 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:35.246311 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3a0972cb-5e1b-4234-b901-8d7f0da23c36 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:35.246756 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3a0972cb-5e1b-4234-b901-8d7f0da23c36 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:35.394239 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8cc736d3-b8a7-41aa-81a2-0fe5f63fdedc tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:35.409699 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8cc736d3-b8a7-41aa-81a2-0fe5f63fdedc tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1670 microversion: 2.1 time: 1.205356 Oct 19 03:33:35.412818 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2239/4566] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:34 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1670 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:33:35.417956 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2d93b59d-fcc6-4539-bdae-42a6881a620d tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:35.430884 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2d93b59d-fcc6-4539-bdae-42a6881a620d tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] [instance: 29a2d62a-83d9-43e2-8907-f4158500d83f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:35.455006 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2d93b59d-fcc6-4539-bdae-42a6881a620d tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:35.455713 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2d93b59d-fcc6-4539-bdae-42a6881a620d tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:35.456785 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2d93b59d-fcc6-4539-bdae-42a6881a620d tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:35.458236 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2d93b59d-fcc6-4539-bdae-42a6881a620d tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:35.458702 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2d93b59d-fcc6-4539-bdae-42a6881a620d tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:35.459142 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2d93b59d-fcc6-4539-bdae-42a6881a620d tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:35.707115 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-2d93b59d-fcc6-4539-bdae-42a6881a620d tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33d07a7db4846ababf001493c6e10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb0265509744c93b03fa5c28b4e9386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:35.715692 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2d93b59d-fcc6-4539-bdae-42a6881a620d tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] 10.222.0.52 "GET /compute/v2.1/servers/29a2d62a-83d9-43e2-8907-f4158500d83f" status: 200 len: 1272 microversion: 2.1 time: 0.301594 Oct 19 03:33:35.716289 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2240/4567] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:35 2022] GET /compute/v2.1/servers/29a2d62a-83d9-43e2-8907-f4158500d83f => generated 1272 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:33:35.721082 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d5c16de5-f14c-4116-b774-36690f5a56d3 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:35.721733 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d5c16de5-f14c-4116-b774-36690f5a56d3 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:35.727991 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d5c16de5-f14c-4116-b774-36690f5a56d3 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:35.730685 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d5c16de5-f14c-4116-b774-36690f5a56d3 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:35.731168 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d5c16de5-f14c-4116-b774-36690f5a56d3 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:35.731904 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d5c16de5-f14c-4116-b774-36690f5a56d3 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:35.732365 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d5c16de5-f14c-4116-b774-36690f5a56d3 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:35.732799 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d5c16de5-f14c-4116-b774-36690f5a56d3 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:36.151592 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-3a0972cb-5e1b-4234-b901-8d7f0da23c36 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f3337e3ea74d868d2072683e44d472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baf68030f15244c79a0d83ab3f3727ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:36.163060 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-3a0972cb-5e1b-4234-b901-8d7f0da23c36 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] 10.222.0.52 "GET /compute/v2.1/servers/5eb74612-283f-4ad9-b523-16b9eadbe7fe" status: 200 len: 1320 microversion: 2.1 time: 0.942195 Oct 19 03:33:36.190875 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2328/4568] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:35 2022] GET /compute/v2.1/servers/5eb74612-283f-4ad9-b523-16b9eadbe7fe => generated 1320 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:33:36.359356 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d5c16de5-f14c-4116-b774-36690f5a56d3 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:36.371548 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d5c16de5-f14c-4116-b774-36690f5a56d3 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1670 microversion: 2.1 time: 0.654029 Oct 19 03:33:36.373631 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2241/4569] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:35 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1670 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:33:36.395196 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3435c7ae-0c74-4619-8f10-86e55ff7e458 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:36.395820 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-3435c7ae-0c74-4619-8f10-86e55ff7e458 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:36.408432 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3435c7ae-0c74-4619-8f10-86e55ff7e458 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:36.408942 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3435c7ae-0c74-4619-8f10-86e55ff7e458 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:36.411687 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3435c7ae-0c74-4619-8f10-86e55ff7e458 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:36.414641 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3435c7ae-0c74-4619-8f10-86e55ff7e458 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:36.414641 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3435c7ae-0c74-4619-8f10-86e55ff7e458 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:36.414641 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3435c7ae-0c74-4619-8f10-86e55ff7e458 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:36.742685 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-91114979-0cb8-470c-b293-b5d144666159 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:36.743308 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-91114979-0cb8-470c-b293-b5d144666159 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] [instance: 29a2d62a-83d9-43e2-8907-f4158500d83f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:36.758039 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-91114979-0cb8-470c-b293-b5d144666159 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:36.761018 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-91114979-0cb8-470c-b293-b5d144666159 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:36.763909 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-91114979-0cb8-470c-b293-b5d144666159 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:36.766249 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-91114979-0cb8-470c-b293-b5d144666159 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:36.771099 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-91114979-0cb8-470c-b293-b5d144666159 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:36.773293 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-91114979-0cb8-470c-b293-b5d144666159 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:36.807901 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-3435c7ae-0c74-4619-8f10-86e55ff7e458 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:36.822929 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-3435c7ae-0c74-4619-8f10-86e55ff7e458 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1670 microversion: 2.1 time: 0.432221 Oct 19 03:33:36.823650 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2329/4570] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:36 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1670 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:33:36.845898 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-89b1c308-e04d-4c19-bb72-5794843e1628 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:36.846718 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-89b1c308-e04d-4c19-bb72-5794843e1628 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:36.853861 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-89b1c308-e04d-4c19-bb72-5794843e1628 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:36.859388 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-89b1c308-e04d-4c19-bb72-5794843e1628 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:36.859388 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-89b1c308-e04d-4c19-bb72-5794843e1628 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:36.859388 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-89b1c308-e04d-4c19-bb72-5794843e1628 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:36.859388 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-89b1c308-e04d-4c19-bb72-5794843e1628 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:36.859388 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-89b1c308-e04d-4c19-bb72-5794843e1628 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:36.930523 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-91114979-0cb8-470c-b293-b5d144666159 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33d07a7db4846ababf001493c6e10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb0265509744c93b03fa5c28b4e9386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:36.939146 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-91114979-0cb8-470c-b293-b5d144666159 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] 10.222.0.52 "GET /compute/v2.1/servers/29a2d62a-83d9-43e2-8907-f4158500d83f" status: 200 len: 1272 microversion: 2.1 time: 0.200387 Oct 19 03:33:36.939750 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2242/4571] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:36 2022] GET /compute/v2.1/servers/29a2d62a-83d9-43e2-8907-f4158500d83f => generated 1272 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:33:37.200487 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-96e6bb79-9b12-456a-8835-084a16e7134c tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:37.201389 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-96e6bb79-9b12-456a-8835-084a16e7134c tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] [instance: 5eb74612-283f-4ad9-b523-16b9eadbe7fe] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:37.215815 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-96e6bb79-9b12-456a-8835-084a16e7134c tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:37.216520 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-96e6bb79-9b12-456a-8835-084a16e7134c tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:37.217147 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-96e6bb79-9b12-456a-8835-084a16e7134c tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:37.218163 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-96e6bb79-9b12-456a-8835-084a16e7134c tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:37.218791 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-96e6bb79-9b12-456a-8835-084a16e7134c tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:37.219390 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-96e6bb79-9b12-456a-8835-084a16e7134c tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:37.275980 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-89b1c308-e04d-4c19-bb72-5794843e1628 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:37.298554 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-89b1c308-e04d-4c19-bb72-5794843e1628 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1670 microversion: 2.1 time: 0.456494 Oct 19 03:33:37.299105 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2330/4572] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:36 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1670 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:33:37.321743 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-549f8c04-ef32-499b-ab55-95920a68622c tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:37.322374 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-549f8c04-ef32-499b-ab55-95920a68622c tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:37.334954 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-549f8c04-ef32-499b-ab55-95920a68622c tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:37.336722 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-549f8c04-ef32-499b-ab55-95920a68622c tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:37.337383 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-549f8c04-ef32-499b-ab55-95920a68622c tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:37.338334 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-549f8c04-ef32-499b-ab55-95920a68622c tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:37.338960 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-549f8c04-ef32-499b-ab55-95920a68622c tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:37.339555 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-549f8c04-ef32-499b-ab55-95920a68622c tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:37.744162 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-96e6bb79-9b12-456a-8835-084a16e7134c tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f3337e3ea74d868d2072683e44d472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baf68030f15244c79a0d83ab3f3727ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:37.757682 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-96e6bb79-9b12-456a-8835-084a16e7134c tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] 10.222.0.52 "GET /compute/v2.1/servers/5eb74612-283f-4ad9-b523-16b9eadbe7fe" status: 200 len: 1320 microversion: 2.1 time: 0.561229 Oct 19 03:33:37.758760 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2243/4573] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:37 2022] GET /compute/v2.1/servers/5eb74612-283f-4ad9-b523-16b9eadbe7fe => generated 1320 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:33:37.808459 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-549f8c04-ef32-499b-ab55-95920a68622c tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:37.824462 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-549f8c04-ef32-499b-ab55-95920a68622c tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1670 microversion: 2.1 time: 0.506650 Oct 19 03:33:37.826588 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2331/4574] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:37 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1670 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:33:37.963389 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-90407ecd-b1db-4c78-b920-5dc2d8a9d63e tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:37.964106 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-90407ecd-b1db-4c78-b920-5dc2d8a9d63e tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] [instance: 29a2d62a-83d9-43e2-8907-f4158500d83f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:37.971540 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-90407ecd-b1db-4c78-b920-5dc2d8a9d63e tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:37.972342 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-90407ecd-b1db-4c78-b920-5dc2d8a9d63e tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:37.973017 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-90407ecd-b1db-4c78-b920-5dc2d8a9d63e tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:37.974181 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-90407ecd-b1db-4c78-b920-5dc2d8a9d63e tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:37.974658 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-90407ecd-b1db-4c78-b920-5dc2d8a9d63e tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:37.975238 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-90407ecd-b1db-4c78-b920-5dc2d8a9d63e tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:38.298409 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-1ad26f04-38c6-457d-b2f3-4eed60f50a7a req-c96a8944-e297-4604-9699-39dbc53da0d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3363175a-58e7-4576-bd04-fe51f074f1f7", "tag": "994a5fee-3245-4c1a-ae1a-cb0b27471ae0"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:33:38.318911 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-1ad26f04-38c6-457d-b2f3-4eed60f50a7a req-c96a8944-e297-4604-9699-39dbc53da0d5 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:38.319779 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-1ad26f04-38c6-457d-b2f3-4eed60f50a7a req-c96a8944-e297-4604-9699-39dbc53da0d5 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:38.320478 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-1ad26f04-38c6-457d-b2f3-4eed60f50a7a req-c96a8944-e297-4604-9699-39dbc53da0d5 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:38.366760 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-1ad26f04-38c6-457d-b2f3-4eed60f50a7a req-c96a8944-e297-4604-9699-39dbc53da0d5 service nova] Creating event network-changed:994a5fee-3245-4c1a-ae1a-cb0b27471ae0 for instance 3363175a-58e7-4576-bd04-fe51f074f1f7 on n-h2-861333-8 Oct 19 03:33:38.388761 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-1ad26f04-38c6-457d-b2f3-4eed60f50a7a req-c96a8944-e297-4604-9699-39dbc53da0d5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094597 Oct 19 03:33:38.392404 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2332/4575] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:33:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:33:38.608419 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-90407ecd-b1db-4c78-b920-5dc2d8a9d63e tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33d07a7db4846ababf001493c6e10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb0265509744c93b03fa5c28b4e9386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:38.641526 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-90407ecd-b1db-4c78-b920-5dc2d8a9d63e tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] 10.222.0.52 "GET /compute/v2.1/servers/29a2d62a-83d9-43e2-8907-f4158500d83f" status: 200 len: 1314 microversion: 2.1 time: 0.679784 Oct 19 03:33:38.642807 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2244/4576] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:37 2022] GET /compute/v2.1/servers/29a2d62a-83d9-43e2-8907-f4158500d83f => generated 1314 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:33:38.781984 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=4 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:33:38.788389 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3933383e-4fb1-4a01-9252-820d288dd825 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:38.789248 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-3933383e-4fb1-4a01-9252-820d288dd825 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] [instance: 5eb74612-283f-4ad9-b523-16b9eadbe7fe] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:38.806682 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3933383e-4fb1-4a01-9252-820d288dd825 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:38.807743 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3933383e-4fb1-4a01-9252-820d288dd825 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:38.808299 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3933383e-4fb1-4a01-9252-820d288dd825 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:38.809219 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3933383e-4fb1-4a01-9252-820d288dd825 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:38.815325 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3933383e-4fb1-4a01-9252-820d288dd825 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:38.815325 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3933383e-4fb1-4a01-9252-820d288dd825 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:39.674529 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f5e434cd-90b5-47b9-bc9c-6b6edc911ea1 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:39.680160 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f5e434cd-90b5-47b9-bc9c-6b6edc911ea1 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] [instance: 29a2d62a-83d9-43e2-8907-f4158500d83f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:39.687408 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f5e434cd-90b5-47b9-bc9c-6b6edc911ea1 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:39.688208 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f5e434cd-90b5-47b9-bc9c-6b6edc911ea1 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:39.688899 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f5e434cd-90b5-47b9-bc9c-6b6edc911ea1 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:39.690677 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f5e434cd-90b5-47b9-bc9c-6b6edc911ea1 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:39.691807 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f5e434cd-90b5-47b9-bc9c-6b6edc911ea1 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:39.692350 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f5e434cd-90b5-47b9-bc9c-6b6edc911ea1 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:39.976450 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-3933383e-4fb1-4a01-9252-820d288dd825 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f3337e3ea74d868d2072683e44d472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baf68030f15244c79a0d83ab3f3727ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:39.991200 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-3933383e-4fb1-4a01-9252-820d288dd825 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] 10.222.0.52 "GET /compute/v2.1/servers/5eb74612-283f-4ad9-b523-16b9eadbe7fe" status: 200 len: 1320 microversion: 2.1 time: 1.212715 Oct 19 03:33:39.992727 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2333/4577] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:38 2022] GET /compute/v2.1/servers/5eb74612-283f-4ad9-b523-16b9eadbe7fe => generated 1320 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:33:40.177666 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-f5e434cd-90b5-47b9-bc9c-6b6edc911ea1 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33d07a7db4846ababf001493c6e10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb0265509744c93b03fa5c28b4e9386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:40.193327 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f5e434cd-90b5-47b9-bc9c-6b6edc911ea1 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] 10.222.0.52 "GET /compute/v2.1/servers/29a2d62a-83d9-43e2-8907-f4158500d83f" status: 200 len: 1314 microversion: 2.1 time: 0.526329 Oct 19 03:33:40.204911 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2245/4578] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:39 2022] GET /compute/v2.1/servers/29a2d62a-83d9-43e2-8907-f4158500d83f => generated 1314 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:33:41.017298 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-34df5973-a844-4f26-9571-6b240d580f88 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:41.018712 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-34df5973-a844-4f26-9571-6b240d580f88 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] [instance: 5eb74612-283f-4ad9-b523-16b9eadbe7fe] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:41.029154 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=14 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:33:41.031603 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-34df5973-a844-4f26-9571-6b240d580f88 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:41.032536 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-34df5973-a844-4f26-9571-6b240d580f88 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:41.033752 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-34df5973-a844-4f26-9571-6b240d580f88 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:41.037157 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-34df5973-a844-4f26-9571-6b240d580f88 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:41.038456 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-34df5973-a844-4f26-9571-6b240d580f88 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:41.043011 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-34df5973-a844-4f26-9571-6b240d580f88 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:41.149354 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-fbc60c89-7430-4e5c-a7dd-67fcb610534f req-e7dbe890-1cfc-4869-ad03-566ecd8d7960 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29a2d62a-83d9-43e2-8907-f4158500d83f", "tag": "d7bf81fc-6464-4f97-a400-1c33007d5ac3"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:33:41.171071 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-fbc60c89-7430-4e5c-a7dd-67fcb610534f req-e7dbe890-1cfc-4869-ad03-566ecd8d7960 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:41.176298 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-fbc60c89-7430-4e5c-a7dd-67fcb610534f req-e7dbe890-1cfc-4869-ad03-566ecd8d7960 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:41.176298 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-fbc60c89-7430-4e5c-a7dd-67fcb610534f req-e7dbe890-1cfc-4869-ad03-566ecd8d7960 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:41.197520 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-fbc60c89-7430-4e5c-a7dd-67fcb610534f req-e7dbe890-1cfc-4869-ad03-566ecd8d7960 service nova] Creating event network-changed:d7bf81fc-6464-4f97-a400-1c33007d5ac3 for instance 29a2d62a-83d9-43e2-8907-f4158500d83f on n-h1-861333-8 Oct 19 03:33:41.213159 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-fbc60c89-7430-4e5c-a7dd-67fcb610534f req-e7dbe890-1cfc-4869-ad03-566ecd8d7960 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069275 Oct 19 03:33:41.213924 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2246/4579] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:33:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:33:41.228347 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-acfee0a7-d496-4257-8d54-60875e5b80f5 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:41.231648 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-acfee0a7-d496-4257-8d54-60875e5b80f5 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] [instance: 29a2d62a-83d9-43e2-8907-f4158500d83f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:41.248778 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-acfee0a7-d496-4257-8d54-60875e5b80f5 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:41.252611 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-acfee0a7-d496-4257-8d54-60875e5b80f5 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:41.253812 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-acfee0a7-d496-4257-8d54-60875e5b80f5 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:41.255216 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-acfee0a7-d496-4257-8d54-60875e5b80f5 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:41.257148 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-acfee0a7-d496-4257-8d54-60875e5b80f5 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:41.261113 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-acfee0a7-d496-4257-8d54-60875e5b80f5 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:41.618566 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-34df5973-a844-4f26-9571-6b240d580f88 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f3337e3ea74d868d2072683e44d472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baf68030f15244c79a0d83ab3f3727ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:41.641221 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-34df5973-a844-4f26-9571-6b240d580f88 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] 10.222.0.52 "GET /compute/v2.1/servers/5eb74612-283f-4ad9-b523-16b9eadbe7fe" status: 200 len: 1320 microversion: 2.1 time: 0.629012 Oct 19 03:33:41.646192 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2334/4580] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:41 2022] GET /compute/v2.1/servers/5eb74612-283f-4ad9-b523-16b9eadbe7fe => generated 1320 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:33:41.871558 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-acfee0a7-d496-4257-8d54-60875e5b80f5 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33d07a7db4846ababf001493c6e10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb0265509744c93b03fa5c28b4e9386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:41.880538 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-acfee0a7-d496-4257-8d54-60875e5b80f5 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] 10.222.0.52 "GET /compute/v2.1/servers/29a2d62a-83d9-43e2-8907-f4158500d83f" status: 200 len: 1314 microversion: 2.1 time: 0.664479 Oct 19 03:33:41.885115 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2247/4581] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:41 2022] GET /compute/v2.1/servers/29a2d62a-83d9-43e2-8907-f4158500d83f => generated 1314 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:33:42.678486 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d10bed29-9db5-460f-b179-d3abe8dcbb14 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:42.679841 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d10bed29-9db5-460f-b179-d3abe8dcbb14 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] [instance: 5eb74612-283f-4ad9-b523-16b9eadbe7fe] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:42.688809 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d10bed29-9db5-460f-b179-d3abe8dcbb14 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:42.689721 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d10bed29-9db5-460f-b179-d3abe8dcbb14 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:42.690322 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d10bed29-9db5-460f-b179-d3abe8dcbb14 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:42.692993 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d10bed29-9db5-460f-b179-d3abe8dcbb14 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:42.693686 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d10bed29-9db5-460f-b179-d3abe8dcbb14 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:42.695115 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d10bed29-9db5-460f-b179-d3abe8dcbb14 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:42.914916 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e1259da2-5f79-4175-97ce-689268e5c817 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:42.915541 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e1259da2-5f79-4175-97ce-689268e5c817 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] [instance: 29a2d62a-83d9-43e2-8907-f4158500d83f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:42.930471 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e1259da2-5f79-4175-97ce-689268e5c817 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:42.931344 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e1259da2-5f79-4175-97ce-689268e5c817 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:42.931795 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e1259da2-5f79-4175-97ce-689268e5c817 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:42.933487 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d10bed29-9db5-460f-b179-d3abe8dcbb14 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f3337e3ea74d868d2072683e44d472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baf68030f15244c79a0d83ab3f3727ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:42.942699 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e1259da2-5f79-4175-97ce-689268e5c817 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:42.943394 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e1259da2-5f79-4175-97ce-689268e5c817 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:42.944011 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e1259da2-5f79-4175-97ce-689268e5c817 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:42.945240 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d10bed29-9db5-460f-b179-d3abe8dcbb14 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] 10.222.0.52 "GET /compute/v2.1/servers/5eb74612-283f-4ad9-b523-16b9eadbe7fe" status: 200 len: 1320 microversion: 2.1 time: 0.274277 Oct 19 03:33:42.947240 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2335/4582] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:42 2022] GET /compute/v2.1/servers/5eb74612-283f-4ad9-b523-16b9eadbe7fe => generated 1320 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:33:43.320461 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e1259da2-5f79-4175-97ce-689268e5c817 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33d07a7db4846ababf001493c6e10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb0265509744c93b03fa5c28b4e9386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:43.331179 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e1259da2-5f79-4175-97ce-689268e5c817 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] 10.222.0.52 "GET /compute/v2.1/servers/29a2d62a-83d9-43e2-8907-f4158500d83f" status: 200 len: 1314 microversion: 2.1 time: 0.419888 Oct 19 03:33:43.332545 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2248/4583] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:42 2022] GET /compute/v2.1/servers/29a2d62a-83d9-43e2-8907-f4158500d83f => generated 1314 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:33:43.972056 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-59a05310-386d-436d-b2b2-c8828271f936 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:43.973688 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-59a05310-386d-436d-b2b2-c8828271f936 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] [instance: 5eb74612-283f-4ad9-b523-16b9eadbe7fe] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:43.981383 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-59a05310-386d-436d-b2b2-c8828271f936 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:43.982037 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-59a05310-386d-436d-b2b2-c8828271f936 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:43.982600 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-59a05310-386d-436d-b2b2-c8828271f936 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:43.983697 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-59a05310-386d-436d-b2b2-c8828271f936 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:43.984340 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-59a05310-386d-436d-b2b2-c8828271f936 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:43.985114 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-59a05310-386d-436d-b2b2-c8828271f936 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:44.229218 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-59a05310-386d-436d-b2b2-c8828271f936 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f3337e3ea74d868d2072683e44d472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baf68030f15244c79a0d83ab3f3727ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:44.232702 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:33:44.239656 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-59a05310-386d-436d-b2b2-c8828271f936 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] 10.222.0.52 "GET /compute/v2.1/servers/5eb74612-283f-4ad9-b523-16b9eadbe7fe" status: 200 len: 1320 microversion: 2.1 time: 0.271533 Oct 19 03:33:44.260660 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2336/4584] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:43 2022] GET /compute/v2.1/servers/5eb74612-283f-4ad9-b523-16b9eadbe7fe => generated 1320 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:33:44.355988 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-31b96050-02a9-4272-8cee-5b2be1a6c861 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:44.357257 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-31b96050-02a9-4272-8cee-5b2be1a6c861 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] [instance: 29a2d62a-83d9-43e2-8907-f4158500d83f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:44.371709 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-31b96050-02a9-4272-8cee-5b2be1a6c861 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:44.372444 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-31b96050-02a9-4272-8cee-5b2be1a6c861 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:44.373038 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-31b96050-02a9-4272-8cee-5b2be1a6c861 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:44.374071 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-31b96050-02a9-4272-8cee-5b2be1a6c861 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:44.374694 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-31b96050-02a9-4272-8cee-5b2be1a6c861 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:44.375314 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-31b96050-02a9-4272-8cee-5b2be1a6c861 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:44.644534 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-31b96050-02a9-4272-8cee-5b2be1a6c861 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33d07a7db4846ababf001493c6e10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb0265509744c93b03fa5c28b4e9386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:44.663790 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-31b96050-02a9-4272-8cee-5b2be1a6c861 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] 10.222.0.52 "GET /compute/v2.1/servers/29a2d62a-83d9-43e2-8907-f4158500d83f" status: 200 len: 1314 microversion: 2.1 time: 0.311550 Oct 19 03:33:44.680155 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2249/4585] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:44 2022] GET /compute/v2.1/servers/29a2d62a-83d9-43e2-8907-f4158500d83f => generated 1314 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:33:45.274685 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-04fc352a-16e7-44b2-8f87-0a4cc88378f6 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:45.277707 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-04fc352a-16e7-44b2-8f87-0a4cc88378f6 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] [instance: 5eb74612-283f-4ad9-b523-16b9eadbe7fe] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:45.293513 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-04fc352a-16e7-44b2-8f87-0a4cc88378f6 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:45.294763 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-04fc352a-16e7-44b2-8f87-0a4cc88378f6 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:45.295128 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-04fc352a-16e7-44b2-8f87-0a4cc88378f6 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:45.296195 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-04fc352a-16e7-44b2-8f87-0a4cc88378f6 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:45.296855 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-04fc352a-16e7-44b2-8f87-0a4cc88378f6 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:45.297508 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-04fc352a-16e7-44b2-8f87-0a4cc88378f6 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:45.536889 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-04fc352a-16e7-44b2-8f87-0a4cc88378f6 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f3337e3ea74d868d2072683e44d472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baf68030f15244c79a0d83ab3f3727ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:45.541967 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-04fc352a-16e7-44b2-8f87-0a4cc88378f6 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] 10.222.0.52 "GET /compute/v2.1/servers/5eb74612-283f-4ad9-b523-16b9eadbe7fe" status: 200 len: 1320 microversion: 2.1 time: 0.280559 Oct 19 03:33:45.545645 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2337/4586] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:45 2022] GET /compute/v2.1/servers/5eb74612-283f-4ad9-b523-16b9eadbe7fe => generated 1320 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:33:45.693224 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-79766459-33f4-4f34-b597-b75446fee50a tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:45.694180 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-79766459-33f4-4f34-b597-b75446fee50a tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] [instance: 29a2d62a-83d9-43e2-8907-f4158500d83f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:45.710363 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-79766459-33f4-4f34-b597-b75446fee50a tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:45.713387 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-79766459-33f4-4f34-b597-b75446fee50a tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:45.716529 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-79766459-33f4-4f34-b597-b75446fee50a tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:45.717653 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-79766459-33f4-4f34-b597-b75446fee50a tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:45.719017 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-79766459-33f4-4f34-b597-b75446fee50a tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:45.720253 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-79766459-33f4-4f34-b597-b75446fee50a tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:45.819526 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-29ec0cdd-ae86-47d6-8a2d-58a1d46cacf5 req-655f6cfc-8211-4cbd-a82f-1b481e36ed5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5eb74612-283f-4ad9-b523-16b9eadbe7fe", "name": "network-vif-plugged", "status": "completed", "tag": "d0c01678-0a88-4ad6-82fe-1f08e34ac7ff"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:33:45.850288 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-29ec0cdd-ae86-47d6-8a2d-58a1d46cacf5 req-655f6cfc-8211-4cbd-a82f-1b481e36ed5e service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:45.852058 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-29ec0cdd-ae86-47d6-8a2d-58a1d46cacf5 req-655f6cfc-8211-4cbd-a82f-1b481e36ed5e service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:45.853882 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-29ec0cdd-ae86-47d6-8a2d-58a1d46cacf5 req-655f6cfc-8211-4cbd-a82f-1b481e36ed5e service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:45.892541 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-29ec0cdd-ae86-47d6-8a2d-58a1d46cacf5 req-655f6cfc-8211-4cbd-a82f-1b481e36ed5e service nova] Creating event network-vif-plugged:d0c01678-0a88-4ad6-82fe-1f08e34ac7ff for instance 5eb74612-283f-4ad9-b523-16b9eadbe7fe on n-h1-861333-8 Oct 19 03:33:45.906581 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-29ec0cdd-ae86-47d6-8a2d-58a1d46cacf5 req-655f6cfc-8211-4cbd-a82f-1b481e36ed5e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.462198 Oct 19 03:33:45.908848 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2250/4587] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:33:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:33:46.569051 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1afb719e-2d32-4b1c-af4c-9ce338442f81 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:46.569809 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1afb719e-2d32-4b1c-af4c-9ce338442f81 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] [instance: 5eb74612-283f-4ad9-b523-16b9eadbe7fe] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:46.587148 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1afb719e-2d32-4b1c-af4c-9ce338442f81 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:46.587878 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1afb719e-2d32-4b1c-af4c-9ce338442f81 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:46.588583 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1afb719e-2d32-4b1c-af4c-9ce338442f81 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:46.589497 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1afb719e-2d32-4b1c-af4c-9ce338442f81 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:46.590111 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1afb719e-2d32-4b1c-af4c-9ce338442f81 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:46.590703 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1afb719e-2d32-4b1c-af4c-9ce338442f81 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:47.455287 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-79766459-33f4-4f34-b597-b75446fee50a tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33d07a7db4846ababf001493c6e10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb0265509744c93b03fa5c28b4e9386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:47.464434 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-79766459-33f4-4f34-b597-b75446fee50a tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] 10.222.0.52 "GET /compute/v2.1/servers/29a2d62a-83d9-43e2-8907-f4158500d83f" status: 200 len: 1314 microversion: 2.1 time: 1.775934 Oct 19 03:33:47.470144 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2338/4588] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:45 2022] GET /compute/v2.1/servers/29a2d62a-83d9-43e2-8907-f4158500d83f => generated 1314 bytes in 1782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:33:47.484518 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-1afb719e-2d32-4b1c-af4c-9ce338442f81 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f3337e3ea74d868d2072683e44d472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baf68030f15244c79a0d83ab3f3727ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:47.502785 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1afb719e-2d32-4b1c-af4c-9ce338442f81 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] 10.222.0.52 "GET /compute/v2.1/servers/5eb74612-283f-4ad9-b523-16b9eadbe7fe" status: 200 len: 1320 microversion: 2.1 time: 0.933939 Oct 19 03:33:47.503951 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2251/4589] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:46 2022] GET /compute/v2.1/servers/5eb74612-283f-4ad9-b523-16b9eadbe7fe => generated 1320 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:33:47.936338 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-a2dbebea-7f4a-4496-98a0-fd3a731b495c req-ff4e302d-5687-445f-b560-c16a347dd238 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3363175a-58e7-4576-bd04-fe51f074f1f7", "name": "network-vif-plugged", "status": "completed", "tag": "994a5fee-3245-4c1a-ae1a-cb0b27471ae0"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:33:47.956979 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-a2dbebea-7f4a-4496-98a0-fd3a731b495c req-ff4e302d-5687-445f-b560-c16a347dd238 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:47.957497 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-a2dbebea-7f4a-4496-98a0-fd3a731b495c req-ff4e302d-5687-445f-b560-c16a347dd238 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:47.957938 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-a2dbebea-7f4a-4496-98a0-fd3a731b495c req-ff4e302d-5687-445f-b560-c16a347dd238 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:47.980696 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-a2dbebea-7f4a-4496-98a0-fd3a731b495c req-ff4e302d-5687-445f-b560-c16a347dd238 service nova] Creating event network-vif-plugged:994a5fee-3245-4c1a-ae1a-cb0b27471ae0 for instance 3363175a-58e7-4576-bd04-fe51f074f1f7 on n-h2-861333-8 Oct 19 03:33:47.988929 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-a2dbebea-7f4a-4496-98a0-fd3a731b495c req-ff4e302d-5687-445f-b560-c16a347dd238 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053623 Oct 19 03:33:47.989675 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2339/4590] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:33:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:33:48.490523 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ee39803a-eb17-4e0c-90fa-ed25bacc808a tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:48.491142 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ee39803a-eb17-4e0c-90fa-ed25bacc808a tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] [instance: 29a2d62a-83d9-43e2-8907-f4158500d83f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:48.513518 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ee39803a-eb17-4e0c-90fa-ed25bacc808a tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:48.515285 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ee39803a-eb17-4e0c-90fa-ed25bacc808a tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:48.516714 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ee39803a-eb17-4e0c-90fa-ed25bacc808a tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:48.518462 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ee39803a-eb17-4e0c-90fa-ed25bacc808a tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:48.532583 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6bf1a8b0-66fe-48d6-8dc7-c1ac4fad2823 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:48.533386 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6bf1a8b0-66fe-48d6-8dc7-c1ac4fad2823 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] [instance: 5eb74612-283f-4ad9-b523-16b9eadbe7fe] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:48.538264 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ee39803a-eb17-4e0c-90fa-ed25bacc808a tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:48.540985 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ee39803a-eb17-4e0c-90fa-ed25bacc808a tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:48.554348 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6bf1a8b0-66fe-48d6-8dc7-c1ac4fad2823 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:48.560990 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6bf1a8b0-66fe-48d6-8dc7-c1ac4fad2823 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:48.570003 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6bf1a8b0-66fe-48d6-8dc7-c1ac4fad2823 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:48.578365 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6bf1a8b0-66fe-48d6-8dc7-c1ac4fad2823 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:48.578594 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6bf1a8b0-66fe-48d6-8dc7-c1ac4fad2823 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:48.580320 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6bf1a8b0-66fe-48d6-8dc7-c1ac4fad2823 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:49.140950 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ee39803a-eb17-4e0c-90fa-ed25bacc808a tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33d07a7db4846ababf001493c6e10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb0265509744c93b03fa5c28b4e9386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:49.161110 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ee39803a-eb17-4e0c-90fa-ed25bacc808a tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] 10.222.0.52 "GET /compute/v2.1/servers/29a2d62a-83d9-43e2-8907-f4158500d83f" status: 200 len: 1314 microversion: 2.1 time: 0.664480 Oct 19 03:33:49.161110 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2252/4591] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:48 2022] GET /compute/v2.1/servers/29a2d62a-83d9-43e2-8907-f4158500d83f => generated 1314 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:33:49.493687 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-6bf1a8b0-66fe-48d6-8dc7-c1ac4fad2823 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f3337e3ea74d868d2072683e44d472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baf68030f15244c79a0d83ab3f3727ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:49.514016 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6bf1a8b0-66fe-48d6-8dc7-c1ac4fad2823 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] 10.222.0.52 "GET /compute/v2.1/servers/5eb74612-283f-4ad9-b523-16b9eadbe7fe" status: 200 len: 1320 microversion: 2.1 time: 0.986432 Oct 19 03:33:49.515034 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2340/4592] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:48 2022] GET /compute/v2.1/servers/5eb74612-283f-4ad9-b523-16b9eadbe7fe => generated 1320 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:33:50.182947 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-01b291ea-cbd6-47ac-a191-e40d6e49600f tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:50.183520 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-01b291ea-cbd6-47ac-a191-e40d6e49600f tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] [instance: 29a2d62a-83d9-43e2-8907-f4158500d83f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:50.204644 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-01b291ea-cbd6-47ac-a191-e40d6e49600f tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:50.210036 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-01b291ea-cbd6-47ac-a191-e40d6e49600f tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:50.213136 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-01b291ea-cbd6-47ac-a191-e40d6e49600f tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:50.215660 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-01b291ea-cbd6-47ac-a191-e40d6e49600f tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:50.216760 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-01b291ea-cbd6-47ac-a191-e40d6e49600f tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:50.220849 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-01b291ea-cbd6-47ac-a191-e40d6e49600f tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:50.547315 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1878cd8a-c200-4196-8604-6596f5d0aa44 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:50.556861 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1878cd8a-c200-4196-8604-6596f5d0aa44 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] [instance: 5eb74612-283f-4ad9-b523-16b9eadbe7fe] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:50.604109 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1878cd8a-c200-4196-8604-6596f5d0aa44 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:50.610490 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1878cd8a-c200-4196-8604-6596f5d0aa44 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:50.613468 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1878cd8a-c200-4196-8604-6596f5d0aa44 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:50.614704 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1878cd8a-c200-4196-8604-6596f5d0aa44 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:50.615419 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1878cd8a-c200-4196-8604-6596f5d0aa44 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:50.619974 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1878cd8a-c200-4196-8604-6596f5d0aa44 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:50.704600 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-01b291ea-cbd6-47ac-a191-e40d6e49600f tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33d07a7db4846ababf001493c6e10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb0265509744c93b03fa5c28b4e9386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:50.718100 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-01b291ea-cbd6-47ac-a191-e40d6e49600f tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] 10.222.0.52 "GET /compute/v2.1/servers/29a2d62a-83d9-43e2-8907-f4158500d83f" status: 200 len: 1314 microversion: 2.1 time: 0.540261 Oct 19 03:33:50.719256 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2253/4593] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:50 2022] GET /compute/v2.1/servers/29a2d62a-83d9-43e2-8907-f4158500d83f => generated 1314 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:33:51.016797 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-1878cd8a-c200-4196-8604-6596f5d0aa44 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f3337e3ea74d868d2072683e44d472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baf68030f15244c79a0d83ab3f3727ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:51.029852 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1878cd8a-c200-4196-8604-6596f5d0aa44 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] 10.222.0.52 "GET /compute/v2.1/servers/5eb74612-283f-4ad9-b523-16b9eadbe7fe" status: 200 len: 1507 microversion: 2.1 time: 0.494150 Oct 19 03:33:51.052138 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2341/4594] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:50 2022] GET /compute/v2.1/servers/5eb74612-283f-4ad9-b523-16b9eadbe7fe => generated 1507 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:33:51.059401 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-360514aa-56ee-432f-9c8f-37a51319dc6e tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:51.060308 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-360514aa-56ee-432f-9c8f-37a51319dc6e tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] [instance: 3363175a-58e7-4576-bd04-fe51f074f1f7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:51.067455 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-360514aa-56ee-432f-9c8f-37a51319dc6e tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:51.067955 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-360514aa-56ee-432f-9c8f-37a51319dc6e tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:51.068403 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-360514aa-56ee-432f-9c8f-37a51319dc6e tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:51.069123 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-360514aa-56ee-432f-9c8f-37a51319dc6e tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:51.069815 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-360514aa-56ee-432f-9c8f-37a51319dc6e tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:51.070253 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-360514aa-56ee-432f-9c8f-37a51319dc6e tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:51.335643 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-360514aa-56ee-432f-9c8f-37a51319dc6e tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f3337e3ea74d868d2072683e44d472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baf68030f15244c79a0d83ab3f3727ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:51.361217 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-360514aa-56ee-432f-9c8f-37a51319dc6e tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] 10.222.0.52 "GET /compute/v2.1/servers/3363175a-58e7-4576-bd04-fe51f074f1f7" status: 200 len: 1507 microversion: 2.1 time: 0.301731 Oct 19 03:33:51.361217 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2254/4595] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:51 2022] GET /compute/v2.1/servers/3363175a-58e7-4576-bd04-fe51f074f1f7 => generated 1507 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:33:51.384760 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d39f15fe-8b5d-4290-bf96-fe3850d1dc90 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:51.392017 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d39f15fe-8b5d-4290-bf96-fe3850d1dc90 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] [instance: 3363175a-58e7-4576-bd04-fe51f074f1f7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:51.403275 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d39f15fe-8b5d-4290-bf96-fe3850d1dc90 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:51.403781 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d39f15fe-8b5d-4290-bf96-fe3850d1dc90 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:51.404226 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d39f15fe-8b5d-4290-bf96-fe3850d1dc90 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:51.404941 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d39f15fe-8b5d-4290-bf96-fe3850d1dc90 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:51.405415 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d39f15fe-8b5d-4290-bf96-fe3850d1dc90 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:51.411699 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d39f15fe-8b5d-4290-bf96-fe3850d1dc90 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:51.439514 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=100 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:33:51.445286 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d39f15fe-8b5d-4290-bf96-fe3850d1dc90 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] [instance: 3363175a-58e7-4576-bd04-fe51f074f1f7] Going to try to terminate instance {{(pid=121134) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:33:51.814821 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ada535ec-ca9f-4271-a09a-9d2ccdfba771 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-714004907", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "networks": [{"uuid": "5183f59e-ff6b-4c70-b0c4-ed31492210e5"}]}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:33:51.870385 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d39f15fe-8b5d-4290-bf96-fe3850d1dc90 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] 10.222.0.52 "DELETE /compute/v2.1/servers/3363175a-58e7-4576-bd04-fe51f074f1f7" status: 204 len: 0 microversion: 2.1 time: 0.490129 Oct 19 03:33:51.871669 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2255/4596] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:33:51 2022] DELETE /compute/v2.1/servers/3363175a-58e7-4576-bd04-fe51f074f1f7 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:33:51.882385 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-9c59278d-6a6e-4d98-a0cf-c48df45fde54 req-b0885b09-4e7f-4ff5-91e7-38dc5c3463e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29a2d62a-83d9-43e2-8907-f4158500d83f", "name": "network-vif-plugged", "status": "completed", "tag": "d7bf81fc-6464-4f97-a400-1c33007d5ac3"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:33:51.882491 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.network.neutron [None req-ada535ec-ca9f-4271-a09a-9d2ccdfba771 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] validate_networks() for [('5183f59e-ff6b-4c70-b0c4-ed31492210e5', None, None, None, None, None)] {{(pid=121135) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:33:51.898630 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-9c59278d-6a6e-4d98-a0cf-c48df45fde54 req-b0885b09-4e7f-4ff5-91e7-38dc5c3463e3 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:51.899119 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-9c59278d-6a6e-4d98-a0cf-c48df45fde54 req-b0885b09-4e7f-4ff5-91e7-38dc5c3463e3 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:51.899568 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-9c59278d-6a6e-4d98-a0cf-c48df45fde54 req-b0885b09-4e7f-4ff5-91e7-38dc5c3463e3 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:51.921219 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-9c59278d-6a6e-4d98-a0cf-c48df45fde54 req-b0885b09-4e7f-4ff5-91e7-38dc5c3463e3 service nova] Creating event network-vif-plugged:d7bf81fc-6464-4f97-a400-1c33007d5ac3 for instance 29a2d62a-83d9-43e2-8907-f4158500d83f on n-h1-861333-8 Oct 19 03:33:51.927977 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-9c59278d-6a6e-4d98-a0cf-c48df45fde54 req-b0885b09-4e7f-4ff5-91e7-38dc5c3463e3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054698 Oct 19 03:33:51.928823 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2256/4597] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:33:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:33:51.937621 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d6f0fdc6-7a15-4f9c-a910-7f9770522d5e tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:51.942468 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d6f0fdc6-7a15-4f9c-a910-7f9770522d5e tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] [instance: 29a2d62a-83d9-43e2-8907-f4158500d83f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:51.947597 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d6f0fdc6-7a15-4f9c-a910-7f9770522d5e tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:51.948410 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d6f0fdc6-7a15-4f9c-a910-7f9770522d5e tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:51.949481 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d6f0fdc6-7a15-4f9c-a910-7f9770522d5e tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:51.950400 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d6f0fdc6-7a15-4f9c-a910-7f9770522d5e tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:51.951040 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d6f0fdc6-7a15-4f9c-a910-7f9770522d5e tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:51.952223 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d6f0fdc6-7a15-4f9c-a910-7f9770522d5e tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:52.471691 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d6f0fdc6-7a15-4f9c-a910-7f9770522d5e tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33d07a7db4846ababf001493c6e10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb0265509744c93b03fa5c28b4e9386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:52.486011 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d6f0fdc6-7a15-4f9c-a910-7f9770522d5e tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] 10.222.0.52 "GET /compute/v2.1/servers/29a2d62a-83d9-43e2-8907-f4158500d83f" status: 200 len: 1314 microversion: 2.1 time: 0.550095 Oct 19 03:33:52.507769 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2257/4598] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:51 2022] GET /compute/v2.1/servers/29a2d62a-83d9-43e2-8907-f4158500d83f => generated 1314 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:33:52.521616 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1d90b7b6-c7f5-483d-bda4-e6519fda7f78 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:52.525345 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1d90b7b6-c7f5-483d-bda4-e6519fda7f78 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] [instance: 5eb74612-283f-4ad9-b523-16b9eadbe7fe] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:52.538770 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1d90b7b6-c7f5-483d-bda4-e6519fda7f78 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:52.539328 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1d90b7b6-c7f5-483d-bda4-e6519fda7f78 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:52.539807 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1d90b7b6-c7f5-483d-bda4-e6519fda7f78 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:52.543501 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1d90b7b6-c7f5-483d-bda4-e6519fda7f78 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:52.543988 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1d90b7b6-c7f5-483d-bda4-e6519fda7f78 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:52.556257 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1d90b7b6-c7f5-483d-bda4-e6519fda7f78 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:52.622193 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1d90b7b6-c7f5-483d-bda4-e6519fda7f78 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] [instance: 5eb74612-283f-4ad9-b523-16b9eadbe7fe] Going to try to terminate instance {{(pid=121134) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:33:52.955168 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1d90b7b6-c7f5-483d-bda4-e6519fda7f78 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] 10.222.0.52 "DELETE /compute/v2.1/servers/5eb74612-283f-4ad9-b523-16b9eadbe7fe" status: 204 len: 0 microversion: 2.1 time: 0.445903 Oct 19 03:33:52.956166 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2258/4599] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:33:52 2022] DELETE /compute/v2.1/servers/5eb74612-283f-4ad9-b523-16b9eadbe7fe => generated 0 bytes in 448 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:33:53.006188 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-ada535ec-ca9f-4271-a09a-9d2ccdfba771 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Flavor limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:33:53.006923 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-ada535ec-ca9f-4271-a09a-9d2ccdfba771 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Image limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:33:53.007484 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-ada535ec-ca9f-4271-a09a-9d2ccdfba771 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Flavor pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:33:53.008093 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-ada535ec-ca9f-4271-a09a-9d2ccdfba771 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Image pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:33:53.008655 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-ada535ec-ca9f-4271-a09a-9d2ccdfba771 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:33:53.035916 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ada535ec-ca9f-4271-a09a-9d2ccdfba771 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:53.037186 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ada535ec-ca9f-4271-a09a-9d2ccdfba771 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:53.039441 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ada535ec-ca9f-4271-a09a-9d2ccdfba771 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:53.044513 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ada535ec-ca9f-4271-a09a-9d2ccdfba771 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:53.051884 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ada535ec-ca9f-4271-a09a-9d2ccdfba771 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:53.052806 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ada535ec-ca9f-4271-a09a-9d2ccdfba771 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:53.121901 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-ada535ec-ca9f-4271-a09a-9d2ccdfba771 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Getting quotas for project 8086dde9fecd4c38bd214e7e87e899eb. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:33:53.129078 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-ada535ec-ca9f-4271-a09a-9d2ccdfba771 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Getting quotas for user bb40699ae023477da8f0ae2265d5585f and project 8086dde9fecd4c38bd214e7e87e899eb. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:33:53.164023 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ada535ec-ca9f-4271-a09a-9d2ccdfba771 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Going to run 1 instances... {{(pid=121135) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:33:53.166847 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ada535ec-ca9f-4271-a09a-9d2ccdfba771 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] [instance: 2255727d-7de0-44dc-a021-8dd243cbda1f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121135) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:33:53.272079 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ada535ec-ca9f-4271-a09a-9d2ccdfba771 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.928672 Oct 19 03:33:53.273066 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2342/4600] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:33:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1930 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 19 03:33:53.285285 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c92b5f46-e882-4845-9720-66f46b561222 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:53.294400 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c92b5f46-e882-4845-9720-66f46b561222 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] [instance: 2255727d-7de0-44dc-a021-8dd243cbda1f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:53.449413 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c92b5f46-e882-4845-9720-66f46b561222 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb40699ae023477da8f0ae2265d5585f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8086dde9fecd4c38bd214e7e87e899eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:53.463046 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c92b5f46-e882-4845-9720-66f46b561222 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] 10.222.0.52 "GET /compute/v2.1/servers/2255727d-7de0-44dc-a021-8dd243cbda1f" status: 200 len: 1215 microversion: 2.1 time: 0.182418 Oct 19 03:33:53.465474 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2259/4601] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:53 2022] GET /compute/v2.1/servers/2255727d-7de0-44dc-a021-8dd243cbda1f => generated 1215 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:33:53.504166 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5cc2c550-4e5a-45a5-b237-c2cd8c62df8f tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-1970165003", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "ba981e5f-e67d-42fb-b57a-98ccc83e6962"}]}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:33:53.515712 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f43982e8-b214-468e-bc92-f4de870c05e1 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:53.516365 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f43982e8-b214-468e-bc92-f4de870c05e1 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] [instance: 29a2d62a-83d9-43e2-8907-f4158500d83f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:53.529278 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f43982e8-b214-468e-bc92-f4de870c05e1 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:53.529278 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f43982e8-b214-468e-bc92-f4de870c05e1 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:53.529278 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f43982e8-b214-468e-bc92-f4de870c05e1 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:53.536289 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f43982e8-b214-468e-bc92-f4de870c05e1 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:53.537036 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f43982e8-b214-468e-bc92-f4de870c05e1 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:53.537546 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f43982e8-b214-468e-bc92-f4de870c05e1 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:53.641629 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.network.neutron [None req-5cc2c550-4e5a-45a5-b237-c2cd8c62df8f tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] validate_networks() for [('ba981e5f-e67d-42fb-b57a-98ccc83e6962', None, None, None, None, None)] {{(pid=121135) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:33:54.082018 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-f43982e8-b214-468e-bc92-f4de870c05e1 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33d07a7db4846ababf001493c6e10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb0265509744c93b03fa5c28b4e9386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:54.093879 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f43982e8-b214-468e-bc92-f4de870c05e1 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] 10.222.0.52 "GET /compute/v2.1/servers/29a2d62a-83d9-43e2-8907-f4158500d83f" status: 200 len: 1314 microversion: 2.1 time: 0.580958 Oct 19 03:33:54.100176 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2260/4602] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:53 2022] GET /compute/v2.1/servers/29a2d62a-83d9-43e2-8907-f4158500d83f => generated 1314 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:33:54.489140 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-15d5308d-7d50-47d7-88d3-3592d9fb951c tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:54.490062 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-15d5308d-7d50-47d7-88d3-3592d9fb951c tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] [instance: 2255727d-7de0-44dc-a021-8dd243cbda1f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:54.507558 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:33:54.580812 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-5cc2c550-4e5a-45a5-b237-c2cd8c62df8f tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Flavor limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:33:54.582445 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-5cc2c550-4e5a-45a5-b237-c2cd8c62df8f tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Image limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:33:54.583081 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-5cc2c550-4e5a-45a5-b237-c2cd8c62df8f tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Flavor pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:33:54.589272 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-5cc2c550-4e5a-45a5-b237-c2cd8c62df8f tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Image pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:33:54.589272 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-5cc2c550-4e5a-45a5-b237-c2cd8c62df8f tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:33:54.598485 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5cc2c550-4e5a-45a5-b237-c2cd8c62df8f tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:54.602136 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5cc2c550-4e5a-45a5-b237-c2cd8c62df8f tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:54.602821 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5cc2c550-4e5a-45a5-b237-c2cd8c62df8f tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:54.605961 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5cc2c550-4e5a-45a5-b237-c2cd8c62df8f tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:54.606649 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5cc2c550-4e5a-45a5-b237-c2cd8c62df8f tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:54.607234 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5cc2c550-4e5a-45a5-b237-c2cd8c62df8f tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:54.630573 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-5cc2c550-4e5a-45a5-b237-c2cd8c62df8f tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Getting quotas for project baf68030f15244c79a0d83ab3f3727ec. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:33:54.637170 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-5cc2c550-4e5a-45a5-b237-c2cd8c62df8f tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Getting quotas for user 34f3337e3ea74d868d2072683e44d472 and project baf68030f15244c79a0d83ab3f3727ec. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:33:54.641556 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:33:54.656966 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-5cc2c550-4e5a-45a5-b237-c2cd8c62df8f tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Going to run 2 instances... {{(pid=121135) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:33:54.659472 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-5cc2c550-4e5a-45a5-b237-c2cd8c62df8f tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] [instance: b3180914-6014-4e72-9b03-a03f52de0145] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121135) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:33:54.719283 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-15d5308d-7d50-47d7-88d3-3592d9fb951c tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb40699ae023477da8f0ae2265d5585f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8086dde9fecd4c38bd214e7e87e899eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:54.732163 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-15d5308d-7d50-47d7-88d3-3592d9fb951c tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] 10.222.0.52 "GET /compute/v2.1/servers/2255727d-7de0-44dc-a021-8dd243cbda1f" status: 200 len: 1215 microversion: 2.1 time: 0.246101 Oct 19 03:33:54.744670 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2261/4603] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:54 2022] GET /compute/v2.1/servers/2255727d-7de0-44dc-a021-8dd243cbda1f => generated 1215 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:33:54.900697 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-5cc2c550-4e5a-45a5-b237-c2cd8c62df8f tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] [instance: 64b50337-325c-4476-9bd1-e38839e22294] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=b3180914-6014-4e72-9b03-a03f52de0145,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121135) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:33:55.120106 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1a460ed6-c52b-4f84-aae0-7b889e77b52e tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:55.121909 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1a460ed6-c52b-4f84-aae0-7b889e77b52e tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] [instance: 29a2d62a-83d9-43e2-8907-f4158500d83f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:55.184458 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1a460ed6-c52b-4f84-aae0-7b889e77b52e tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:55.187842 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1a460ed6-c52b-4f84-aae0-7b889e77b52e tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:55.187842 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1a460ed6-c52b-4f84-aae0-7b889e77b52e tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:55.187842 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1a460ed6-c52b-4f84-aae0-7b889e77b52e tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:55.188811 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1a460ed6-c52b-4f84-aae0-7b889e77b52e tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:55.189949 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1a460ed6-c52b-4f84-aae0-7b889e77b52e tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:55.236753 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5cc2c550-4e5a-45a5-b237-c2cd8c62df8f tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.735689 Oct 19 03:33:55.242330 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2343/4604] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:33:53 2022] POST /compute/v2.1/servers => generated 32 bytes in 1743 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 19 03:33:55.262518 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0101e2f4-2baa-4603-9150-9815d8cbadf2 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:55.282541 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-0101e2f4-2baa-4603-9150-9815d8cbadf2 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '34f3337e3ea74d868d2072683e44d472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baf68030f15244c79a0d83ab3f3727ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:55.286080 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0101e2f4-2baa-4603-9150-9815d8cbadf2 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Searching by: {'deleted': False, 'project_id': 'baf68030f15244c79a0d83ab3f3727ec'} {{(pid=121135) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 03:33:55.335393 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0101e2f4-2baa-4603-9150-9815d8cbadf2 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:55.335393 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0101e2f4-2baa-4603-9150-9815d8cbadf2 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:55.335393 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0101e2f4-2baa-4603-9150-9815d8cbadf2 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:55.336046 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0101e2f4-2baa-4603-9150-9815d8cbadf2 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:55.336744 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0101e2f4-2baa-4603-9150-9815d8cbadf2 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:55.338953 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0101e2f4-2baa-4603-9150-9815d8cbadf2 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:55.412473 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.multi_cell_list [None req-0101e2f4-2baa-4603-9150-9815d8cbadf2 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=121135) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 03:33:55.475654 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0101e2f4-2baa-4603-9150-9815d8cbadf2 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] 10.222.0.52 "GET /compute/v2.1/servers" status: 200 len: 1337 microversion: 2.1 time: 0.228390 Oct 19 03:33:55.487101 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2344/4605] 10.222.0.52 () {58 vars in 1125 bytes} [Wed Oct 19 03:33:55 2022] GET /compute/v2.1/servers => generated 1337 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:33:55.493976 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d5159f58-b349-4f1f-8316-f3b0bb2668aa tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:55.494879 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d5159f58-b349-4f1f-8316-f3b0bb2668aa tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] [instance: 64b50337-325c-4476-9bd1-e38839e22294] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:55.749009 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d5159f58-b349-4f1f-8316-f3b0bb2668aa tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f3337e3ea74d868d2072683e44d472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baf68030f15244c79a0d83ab3f3727ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:55.759462 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d5159f58-b349-4f1f-8316-f3b0bb2668aa tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] 10.222.0.52 "GET /compute/v2.1/servers/64b50337-325c-4476-9bd1-e38839e22294" status: 200 len: 1218 microversion: 2.1 time: 0.268578 Oct 19 03:33:55.761238 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2345/4606] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:55 2022] GET /compute/v2.1/servers/64b50337-325c-4476-9bd1-e38839e22294 => generated 1218 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:33:55.795072 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a77ab1c2-adb6-4730-9bc9-4844c49f99a2 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:55.796017 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a77ab1c2-adb6-4730-9bc9-4844c49f99a2 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] [instance: 2255727d-7de0-44dc-a021-8dd243cbda1f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:55.807512 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a77ab1c2-adb6-4730-9bc9-4844c49f99a2 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:55.808402 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a77ab1c2-adb6-4730-9bc9-4844c49f99a2 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:55.809476 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a77ab1c2-adb6-4730-9bc9-4844c49f99a2 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:55.810600 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a77ab1c2-adb6-4730-9bc9-4844c49f99a2 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:55.811230 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a77ab1c2-adb6-4730-9bc9-4844c49f99a2 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:55.811877 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a77ab1c2-adb6-4730-9bc9-4844c49f99a2 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:56.076044 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a77ab1c2-adb6-4730-9bc9-4844c49f99a2 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb40699ae023477da8f0ae2265d5585f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8086dde9fecd4c38bd214e7e87e899eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:56.083728 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a77ab1c2-adb6-4730-9bc9-4844c49f99a2 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] 10.222.0.52 "GET /compute/v2.1/servers/2255727d-7de0-44dc-a021-8dd243cbda1f" status: 200 len: 1219 microversion: 2.1 time: 0.295754 Oct 19 03:33:56.088504 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2346/4607] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:55 2022] GET /compute/v2.1/servers/2255727d-7de0-44dc-a021-8dd243cbda1f => generated 1219 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:33:56.098017 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-4de775f0-e230-4680-baba-e51721592599 req-37643835-5fd4-4501-b23a-eec4fa373eb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3363175a-58e7-4576-bd04-fe51f074f1f7", "name": "network-vif-deleted", "tag": "994a5fee-3245-4c1a-ae1a-cb0b27471ae0"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:33:56.122776 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-4de775f0-e230-4680-baba-e51721592599 req-37643835-5fd4-4501-b23a-eec4fa373eb7 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:56.123584 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-4de775f0-e230-4680-baba-e51721592599 req-37643835-5fd4-4501-b23a-eec4fa373eb7 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:56.125269 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-4de775f0-e230-4680-baba-e51721592599 req-37643835-5fd4-4501-b23a-eec4fa373eb7 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:56.160764 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-4de775f0-e230-4680-baba-e51721592599 req-37643835-5fd4-4501-b23a-eec4fa373eb7 service nova] Creating event network-vif-deleted:994a5fee-3245-4c1a-ae1a-cb0b27471ae0 for instance 3363175a-58e7-4576-bd04-fe51f074f1f7 on n-h2-861333-8 Oct 19 03:33:56.175841 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-4de775f0-e230-4680-baba-e51721592599 req-37643835-5fd4-4501-b23a-eec4fa373eb7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079540 Oct 19 03:33:56.177947 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2347/4608] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:33:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:33:56.388439 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-1a460ed6-c52b-4f84-aae0-7b889e77b52e tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33d07a7db4846ababf001493c6e10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb0265509744c93b03fa5c28b4e9386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:56.402401 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1a460ed6-c52b-4f84-aae0-7b889e77b52e tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] 10.222.0.52 "GET /compute/v2.1/servers/29a2d62a-83d9-43e2-8907-f4158500d83f" status: 200 len: 1314 microversion: 2.1 time: 1.285160 Oct 19 03:33:56.404398 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2262/4609] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:55 2022] GET /compute/v2.1/servers/29a2d62a-83d9-43e2-8907-f4158500d83f => generated 1314 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:33:56.788932 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-246caed9-5d4e-4d06-b0a7-964f667727cf tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:56.789717 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-246caed9-5d4e-4d06-b0a7-964f667727cf tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] [instance: 64b50337-325c-4476-9bd1-e38839e22294] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:56.949094 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-246caed9-5d4e-4d06-b0a7-964f667727cf tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f3337e3ea74d868d2072683e44d472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baf68030f15244c79a0d83ab3f3727ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:56.957063 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-246caed9-5d4e-4d06-b0a7-964f667727cf tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] 10.222.0.52 "GET /compute/v2.1/servers/64b50337-325c-4476-9bd1-e38839e22294" status: 200 len: 1218 microversion: 2.1 time: 0.175647 Oct 19 03:33:56.960922 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2348/4610] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:56 2022] GET /compute/v2.1/servers/64b50337-325c-4476-9bd1-e38839e22294 => generated 1218 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:33:57.114907 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c016de62-d0da-4436-b3d0-a8b54a78b041 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:57.116048 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c016de62-d0da-4436-b3d0-a8b54a78b041 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] [instance: 2255727d-7de0-44dc-a021-8dd243cbda1f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:57.131832 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c016de62-d0da-4436-b3d0-a8b54a78b041 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:57.132933 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c016de62-d0da-4436-b3d0-a8b54a78b041 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:57.134782 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c016de62-d0da-4436-b3d0-a8b54a78b041 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:57.136761 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c016de62-d0da-4436-b3d0-a8b54a78b041 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:57.138057 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c016de62-d0da-4436-b3d0-a8b54a78b041 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:57.138919 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c016de62-d0da-4436-b3d0-a8b54a78b041 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:57.489228 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c016de62-d0da-4436-b3d0-a8b54a78b041 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb40699ae023477da8f0ae2265d5585f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8086dde9fecd4c38bd214e7e87e899eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:57.505501 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c016de62-d0da-4436-b3d0-a8b54a78b041 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] 10.222.0.52 "GET /compute/v2.1/servers/2255727d-7de0-44dc-a021-8dd243cbda1f" status: 200 len: 1267 microversion: 2.1 time: 0.393539 Oct 19 03:33:57.506863 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2263/4611] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:57 2022] GET /compute/v2.1/servers/2255727d-7de0-44dc-a021-8dd243cbda1f => generated 1267 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:33:57.516252 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-083a8a36-b130-4b8c-bbdc-ef98781dbc5a tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:57.517101 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-083a8a36-b130-4b8c-bbdc-ef98781dbc5a tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] [instance: 29a2d62a-83d9-43e2-8907-f4158500d83f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:57.530164 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-083a8a36-b130-4b8c-bbdc-ef98781dbc5a tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:57.531580 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-083a8a36-b130-4b8c-bbdc-ef98781dbc5a tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:57.532173 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-083a8a36-b130-4b8c-bbdc-ef98781dbc5a tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:57.533550 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-083a8a36-b130-4b8c-bbdc-ef98781dbc5a tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:57.534875 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-083a8a36-b130-4b8c-bbdc-ef98781dbc5a tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:57.536400 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-083a8a36-b130-4b8c-bbdc-ef98781dbc5a tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:57.653460 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6a831651-a17f-447a-8714-031fe551806a tempest-QuotasTestJSON-457780258 tempest-QuotasTestJSON-457780258-project] Calling method '.version_select at 0x7fc130047e50>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:57.782017 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6a831651-a17f-447a-8714-031fe551806a tempest-QuotasTestJSON-457780258 tempest-QuotasTestJSON-457780258-project] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/90b8a8e5dae246c09e58199d3e50d704/defaults" status: 200 len: 371 microversion: 2.1 time: 0.471276 Oct 19 03:33:57.791306 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2349/4612] 10.222.0.52 () {58 vars in 1269 bytes} [Wed Oct 19 03:33:57 2022] GET /compute/v2.1/os-quota-sets/90b8a8e5dae246c09e58199d3e50d704/defaults => generated 371 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:33:57.807077 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-40962b17-97a6-4550-a56e-b961ac07a672 tempest-QuotasTestJSON-457780258 tempest-QuotasTestJSON-457780258-project] Calling method '.version_select at 0x7fc1302cd700>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:58.041194 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-40962b17-97a6-4550-a56e-b961ac07a672 tempest-QuotasTestJSON-457780258 tempest-QuotasTestJSON-457780258-project] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/90b8a8e5dae246c09e58199d3e50d704" status: 200 len: 371 microversion: 2.1 time: 0.242477 Oct 19 03:33:58.042128 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2350/4613] 10.222.0.52 () {58 vars in 1242 bytes} [Wed Oct 19 03:33:57 2022] GET /compute/v2.1/os-quota-sets/90b8a8e5dae246c09e58199d3e50d704 => generated 371 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:33:58.055301 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f54502f8-d5c5-41f8-9310-9f7c510702c9 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:58.064542 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f54502f8-d5c5-41f8-9310-9f7c510702c9 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] [instance: 64b50337-325c-4476-9bd1-e38839e22294] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:58.096301 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f54502f8-d5c5-41f8-9310-9f7c510702c9 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:58.098529 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f54502f8-d5c5-41f8-9310-9f7c510702c9 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:58.101151 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f54502f8-d5c5-41f8-9310-9f7c510702c9 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:58.110497 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f54502f8-d5c5-41f8-9310-9f7c510702c9 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:58.111970 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f54502f8-d5c5-41f8-9310-9f7c510702c9 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:58.120245 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f54502f8-d5c5-41f8-9310-9f7c510702c9 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:58.178838 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-083a8a36-b130-4b8c-bbdc-ef98781dbc5a tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33d07a7db4846ababf001493c6e10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb0265509744c93b03fa5c28b4e9386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:58.195542 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-083a8a36-b130-4b8c-bbdc-ef98781dbc5a tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] 10.222.0.52 "GET /compute/v2.1/servers/29a2d62a-83d9-43e2-8907-f4158500d83f" status: 200 len: 1501 microversion: 2.1 time: 0.685643 Oct 19 03:33:58.206655 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2264/4614] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:57 2022] GET /compute/v2.1/servers/29a2d62a-83d9-43e2-8907-f4158500d83f => generated 1501 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:33:58.245415 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-45d3f9d6-7473-41aa-8722-838fd4e06f3d tempest-QuotasTestJSON-457780258 tempest-QuotasTestJSON-457780258-project] Calling method '.version_select at 0x7fc13043f700>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:58.527816 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f54502f8-d5c5-41f8-9310-9f7c510702c9 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f3337e3ea74d868d2072683e44d472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baf68030f15244c79a0d83ab3f3727ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:58.541766 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f54502f8-d5c5-41f8-9310-9f7c510702c9 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] 10.222.0.52 "GET /compute/v2.1/servers/64b50337-325c-4476-9bd1-e38839e22294" status: 200 len: 1222 microversion: 2.1 time: 0.498125 Oct 19 03:33:58.549992 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2351/4615] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:58 2022] GET /compute/v2.1/servers/64b50337-325c-4476-9bd1-e38839e22294 => generated 1222 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:33:58.561988 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-145361fe-89e7-4673-8e9f-b4cbe3c4aaea tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:33:58.571955 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-145361fe-89e7-4673-8e9f-b4cbe3c4aaea tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] [instance: 29a2d62a-83d9-43e2-8907-f4158500d83f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:58.598428 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-145361fe-89e7-4673-8e9f-b4cbe3c4aaea tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:58.599050 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-145361fe-89e7-4673-8e9f-b4cbe3c4aaea tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:58.599604 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-145361fe-89e7-4673-8e9f-b4cbe3c4aaea tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:58.600425 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-145361fe-89e7-4673-8e9f-b4cbe3c4aaea tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:58.616383 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-145361fe-89e7-4673-8e9f-b4cbe3c4aaea tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:58.616970 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-145361fe-89e7-4673-8e9f-b4cbe3c4aaea tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:58.706491 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-145361fe-89e7-4673-8e9f-b4cbe3c4aaea tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lazy-loading 'flavor' on Instance uuid 29a2d62a-83d9-43e2-8907-f4158500d83f {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:33:58.955421 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-45d3f9d6-7473-41aa-8722-838fd4e06f3d tempest-QuotasTestJSON-457780258 tempest-QuotasTestJSON-457780258-project] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/90b8a8e5dae246c09e58199d3e50d704/defaults" status: 200 len: 371 microversion: 2.1 time: 0.747097 Oct 19 03:33:58.966002 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2265/4616] 10.222.0.52 () {58 vars in 1269 bytes} [Wed Oct 19 03:33:58 2022] GET /compute/v2.1/os-quota-sets/90b8a8e5dae246c09e58199d3e50d704/defaults => generated 371 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:33:58.979486 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-11ed5ca6-e620-4c80-9ffb-d9b0420d4e81 req-f3111bb0-f4fe-4858-acbe-a76e29669cb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5eb74612-283f-4ad9-b523-16b9eadbe7fe", "name": "network-vif-deleted", "tag": "d0c01678-0a88-4ad6-82fe-1f08e34ac7ff"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:33:58.999926 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-11ed5ca6-e620-4c80-9ffb-d9b0420d4e81 req-f3111bb0-f4fe-4858-acbe-a76e29669cb2 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:59.000769 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-11ed5ca6-e620-4c80-9ffb-d9b0420d4e81 req-f3111bb0-f4fe-4858-acbe-a76e29669cb2 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:59.001425 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-11ed5ca6-e620-4c80-9ffb-d9b0420d4e81 req-f3111bb0-f4fe-4858-acbe-a76e29669cb2 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:59.016382 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-11ed5ca6-e620-4c80-9ffb-d9b0420d4e81 req-f3111bb0-f4fe-4858-acbe-a76e29669cb2 service nova] Creating event network-vif-deleted:d0c01678-0a88-4ad6-82fe-1f08e34ac7ff for instance 5eb74612-283f-4ad9-b523-16b9eadbe7fe on n-h1-861333-8 Oct 19 03:33:59.022459 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-11ed5ca6-e620-4c80-9ffb-d9b0420d4e81 req-f3111bb0-f4fe-4858-acbe-a76e29669cb2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054050 Oct 19 03:33:59.023785 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2266/4617] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:33:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:33:59.030736 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ac1bf5fc-701f-476a-a261-3cd220608691 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:59.031706 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ac1bf5fc-701f-476a-a261-3cd220608691 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] [instance: 2255727d-7de0-44dc-a021-8dd243cbda1f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:59.039554 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ac1bf5fc-701f-476a-a261-3cd220608691 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:59.040298 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ac1bf5fc-701f-476a-a261-3cd220608691 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:59.040939 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ac1bf5fc-701f-476a-a261-3cd220608691 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:59.041879 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ac1bf5fc-701f-476a-a261-3cd220608691 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:59.042498 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ac1bf5fc-701f-476a-a261-3cd220608691 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:59.043450 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ac1bf5fc-701f-476a-a261-3cd220608691 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:59.212752 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ac1bf5fc-701f-476a-a261-3cd220608691 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb40699ae023477da8f0ae2265d5585f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8086dde9fecd4c38bd214e7e87e899eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:59.224287 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-145361fe-89e7-4673-8e9f-b4cbe3c4aaea tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] 10.222.0.52 "POST /compute/v2.1/servers/29a2d62a-83d9-43e2-8907-f4158500d83f/action" status: 200 len: 32 microversion: 2.1 time: 0.672988 Oct 19 03:33:59.231376 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2352/4618] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:33:58 2022] POST /compute/v2.1/servers/29a2d62a-83d9-43e2-8907-f4158500d83f/action => generated 32 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 03:33:59.247421 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ac1bf5fc-701f-476a-a261-3cd220608691 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] 10.222.0.52 "GET /compute/v2.1/servers/2255727d-7de0-44dc-a021-8dd243cbda1f" status: 200 len: 1273 microversion: 2.1 time: 0.218548 Oct 19 03:33:59.249686 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2267/4619] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:59 2022] GET /compute/v2.1/servers/2255727d-7de0-44dc-a021-8dd243cbda1f => generated 1273 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:33:59.253799 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-fd63043c-2f5b-491e-94c5-750e0a6f1a9f tempest-QuotasTestJSON-457780258 tempest-QuotasTestJSON-457780258-project] Calling method '.version_select at 0x7fc12bfa5c10>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:59.297211 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8ccbfcd2-97a1-44ab-93e8-6b4efa70eadd tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:59.298733 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8ccbfcd2-97a1-44ab-93e8-6b4efa70eadd tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] [instance: 29a2d62a-83d9-43e2-8907-f4158500d83f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:59.340031 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8ccbfcd2-97a1-44ab-93e8-6b4efa70eadd tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:59.340612 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8ccbfcd2-97a1-44ab-93e8-6b4efa70eadd tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:59.341066 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8ccbfcd2-97a1-44ab-93e8-6b4efa70eadd tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:59.347853 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8ccbfcd2-97a1-44ab-93e8-6b4efa70eadd tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:59.348802 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8ccbfcd2-97a1-44ab-93e8-6b4efa70eadd tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:59.360329 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8ccbfcd2-97a1-44ab-93e8-6b4efa70eadd tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:59.762217 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-fd63043c-2f5b-491e-94c5-750e0a6f1a9f tempest-QuotasTestJSON-457780258 tempest-QuotasTestJSON-457780258-project] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/90b8a8e5dae246c09e58199d3e50d704" status: 200 len: 371 microversion: 2.1 time: 0.525503 Oct 19 03:33:59.774866 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2353/4620] 10.222.0.52 () {58 vars in 1242 bytes} [Wed Oct 19 03:33:59 2022] GET /compute/v2.1/os-quota-sets/90b8a8e5dae246c09e58199d3e50d704 => generated 371 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:33:59.787513 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-20425182-feff-464b-a04e-9f0a4f2dc02c tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:59.791025 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-20425182-feff-464b-a04e-9f0a4f2dc02c tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] [instance: 64b50337-325c-4476-9bd1-e38839e22294] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:33:59.810938 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-20425182-feff-464b-a04e-9f0a4f2dc02c tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:59.811268 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-20425182-feff-464b-a04e-9f0a4f2dc02c tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:59.811938 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-20425182-feff-464b-a04e-9f0a4f2dc02c tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:59.813178 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-20425182-feff-464b-a04e-9f0a4f2dc02c tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:33:59.813987 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-20425182-feff-464b-a04e-9f0a4f2dc02c tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:33:59.814666 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-20425182-feff-464b-a04e-9f0a4f2dc02c tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:33:59.919239 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8ccbfcd2-97a1-44ab-93e8-6b4efa70eadd tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33d07a7db4846ababf001493c6e10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb0265509744c93b03fa5c28b4e9386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:33:59.930022 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8ccbfcd2-97a1-44ab-93e8-6b4efa70eadd tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] 10.222.0.52 "GET /compute/v2.1/servers/29a2d62a-83d9-43e2-8907-f4158500d83f" status: 200 len: 1507 microversion: 2.1 time: 0.675429 Oct 19 03:33:59.950420 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2268/4621] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:59 2022] GET /compute/v2.1/servers/29a2d62a-83d9-43e2-8907-f4158500d83f => generated 1507 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:33:59.962895 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-08e413fc-dde2-417a-b834-1ed00bb5fb14 tempest-QuotasTestJSON-457780258 tempest-QuotasTestJSON-457780258-project] Calling method '.version_select at 0x7fc1301371f0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:33:59.991250 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-20425182-feff-464b-a04e-9f0a4f2dc02c tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f3337e3ea74d868d2072683e44d472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baf68030f15244c79a0d83ab3f3727ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:34:00.008317 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-20425182-feff-464b-a04e-9f0a4f2dc02c tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] 10.222.0.52 "GET /compute/v2.1/servers/64b50337-325c-4476-9bd1-e38839e22294" status: 200 len: 1270 microversion: 2.1 time: 0.231871 Oct 19 03:34:00.014440 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2354/4622] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:33:59 2022] GET /compute/v2.1/servers/64b50337-325c-4476-9bd1-e38839e22294 => generated 1270 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:34:00.141415 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-08e413fc-dde2-417a-b834-1ed00bb5fb14 tempest-QuotasTestJSON-457780258 tempest-QuotasTestJSON-457780258-project] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/90b8a8e5dae246c09e58199d3e50d704?user_id=8e62156444784d1ab06e05317c34b013" status: 200 len: 371 microversion: 2.1 time: 0.189397 Oct 19 03:34:00.142051 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2269/4623] 10.222.0.52 () {58 vars in 1323 bytes} [Wed Oct 19 03:33:59 2022] GET /compute/v2.1/os-quota-sets/90b8a8e5dae246c09e58199d3e50d704?user_id=8e62156444784d1ab06e05317c34b013 => generated 371 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:34:00.286697 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1cc9f6a1-adf8-41c5-9378-2153be2b4635 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:34:00.287137 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1cc9f6a1-adf8-41c5-9378-2153be2b4635 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] [instance: 2255727d-7de0-44dc-a021-8dd243cbda1f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:34:00.302716 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1cc9f6a1-adf8-41c5-9378-2153be2b4635 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:00.307253 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1cc9f6a1-adf8-41c5-9378-2153be2b4635 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:00.308509 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1cc9f6a1-adf8-41c5-9378-2153be2b4635 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:00.310343 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1cc9f6a1-adf8-41c5-9378-2153be2b4635 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:00.313253 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1cc9f6a1-adf8-41c5-9378-2153be2b4635 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:00.316107 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1cc9f6a1-adf8-41c5-9378-2153be2b4635 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:00.506552 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-1cc9f6a1-adf8-41c5-9378-2153be2b4635 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb40699ae023477da8f0ae2265d5585f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8086dde9fecd4c38bd214e7e87e899eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:34:00.519105 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1cc9f6a1-adf8-41c5-9378-2153be2b4635 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] 10.222.0.52 "GET /compute/v2.1/servers/2255727d-7de0-44dc-a021-8dd243cbda1f" status: 200 len: 1273 microversion: 2.1 time: 0.238040 Oct 19 03:34:00.519603 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2355/4624] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:34:00 2022] GET /compute/v2.1/servers/2255727d-7de0-44dc-a021-8dd243cbda1f => generated 1273 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:34:00.966781 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9f90d7c1-cc91-425e-bcf3-446d75126f5b tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:34:00.967394 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9f90d7c1-cc91-425e-bcf3-446d75126f5b tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] [instance: 29a2d62a-83d9-43e2-8907-f4158500d83f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:34:00.983752 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9f90d7c1-cc91-425e-bcf3-446d75126f5b tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:00.984252 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9f90d7c1-cc91-425e-bcf3-446d75126f5b tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:00.984692 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9f90d7c1-cc91-425e-bcf3-446d75126f5b tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:00.985419 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9f90d7c1-cc91-425e-bcf3-446d75126f5b tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:00.985888 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9f90d7c1-cc91-425e-bcf3-446d75126f5b tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:00.986320 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9f90d7c1-cc91-425e-bcf3-446d75126f5b tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:01.043867 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3057a7c7-b907-4391-89ef-d876135eeefb tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:34:01.044494 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-3057a7c7-b907-4391-89ef-d876135eeefb tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] [instance: 64b50337-325c-4476-9bd1-e38839e22294] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:34:01.058612 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3057a7c7-b907-4391-89ef-d876135eeefb tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:01.059115 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3057a7c7-b907-4391-89ef-d876135eeefb tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:01.059799 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3057a7c7-b907-4391-89ef-d876135eeefb tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:01.060296 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3057a7c7-b907-4391-89ef-d876135eeefb tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:01.072283 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3057a7c7-b907-4391-89ef-d876135eeefb tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:01.072601 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3057a7c7-b907-4391-89ef-d876135eeefb tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:01.441573 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-3057a7c7-b907-4391-89ef-d876135eeefb tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f3337e3ea74d868d2072683e44d472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baf68030f15244c79a0d83ab3f3727ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:34:01.451019 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-3057a7c7-b907-4391-89ef-d876135eeefb tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] 10.222.0.52 "GET /compute/v2.1/servers/64b50337-325c-4476-9bd1-e38839e22294" status: 200 len: 1276 microversion: 2.1 time: 0.411883 Oct 19 03:34:01.457358 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2356/4625] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:34:01 2022] GET /compute/v2.1/servers/64b50337-325c-4476-9bd1-e38839e22294 => generated 1276 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:34:01.464732 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-98c9e2f5-779d-46ee-b36e-383e2e72a3ab tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:34:01.473448 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-98c9e2f5-779d-46ee-b36e-383e2e72a3ab tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:34:01.486967 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-98c9e2f5-779d-46ee-b36e-383e2e72a3ab tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:01.488595 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-98c9e2f5-779d-46ee-b36e-383e2e72a3ab tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:01.489217 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-98c9e2f5-779d-46ee-b36e-383e2e72a3ab tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:01.498619 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-98c9e2f5-779d-46ee-b36e-383e2e72a3ab tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:01.499353 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-98c9e2f5-779d-46ee-b36e-383e2e72a3ab tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:01.500000 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-98c9e2f5-779d-46ee-b36e-383e2e72a3ab tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:01.733955 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:34:01.838818 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9f90d7c1-cc91-425e-bcf3-446d75126f5b tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33d07a7db4846ababf001493c6e10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb0265509744c93b03fa5c28b4e9386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:34:01.852199 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9f90d7c1-cc91-425e-bcf3-446d75126f5b tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] 10.222.0.52 "GET /compute/v2.1/servers/29a2d62a-83d9-43e2-8907-f4158500d83f" status: 200 len: 1507 microversion: 2.1 time: 0.899238 Oct 19 03:34:01.852812 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2270/4626] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:34:00 2022] GET /compute/v2.1/servers/29a2d62a-83d9-43e2-8907-f4158500d83f => generated 1507 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:34:01.863241 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-98c9e2f5-779d-46ee-b36e-383e2e72a3ab tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "POST /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f/action" status: 202 len: 0 microversion: 2.1 time: 0.404215 Oct 19 03:34:01.864182 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2357/4627] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:34:01 2022] POST /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f/action => generated 0 bytes in 406 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:34:01.876229 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e9c28857-bafd-4725-9d25-ea399cbd2c52 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:34:01.876229 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e9c28857-bafd-4725-9d25-ea399cbd2c52 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] [instance: 2255727d-7de0-44dc-a021-8dd243cbda1f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:34:01.884510 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0eb716a8-b753-4ef4-8b5b-9f2632d6d982 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:34:01.884510 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0eb716a8-b753-4ef4-8b5b-9f2632d6d982 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:34:01.902200 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e9c28857-bafd-4725-9d25-ea399cbd2c52 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:01.905731 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e9c28857-bafd-4725-9d25-ea399cbd2c52 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:01.905731 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e9c28857-bafd-4725-9d25-ea399cbd2c52 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:01.905731 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e9c28857-bafd-4725-9d25-ea399cbd2c52 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:01.905731 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e9c28857-bafd-4725-9d25-ea399cbd2c52 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:01.905731 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e9c28857-bafd-4725-9d25-ea399cbd2c52 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:01.908088 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0eb716a8-b753-4ef4-8b5b-9f2632d6d982 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:01.908600 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0eb716a8-b753-4ef4-8b5b-9f2632d6d982 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:01.909081 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0eb716a8-b753-4ef4-8b5b-9f2632d6d982 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:01.910037 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0eb716a8-b753-4ef4-8b5b-9f2632d6d982 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:01.922074 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0eb716a8-b753-4ef4-8b5b-9f2632d6d982 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:01.923062 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0eb716a8-b753-4ef4-8b5b-9f2632d6d982 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:02.411906 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-0eb716a8-b753-4ef4-8b5b-9f2632d6d982 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:34:02.412129 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0eb716a8-b753-4ef4-8b5b-9f2632d6d982 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1672 microversion: 2.1 time: 0.534443 Oct 19 03:34:02.425765 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2358/4628] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:34:01 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1672 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:34:02.474278 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-db00c6f8-78da-4d26-9d0a-8a3591cc7b36 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:34:02.476092 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-db00c6f8-78da-4d26-9d0a-8a3591cc7b36 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] [instance: 64b50337-325c-4476-9bd1-e38839e22294] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:34:02.490600 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-db00c6f8-78da-4d26-9d0a-8a3591cc7b36 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:02.491113 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-db00c6f8-78da-4d26-9d0a-8a3591cc7b36 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:02.491567 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-db00c6f8-78da-4d26-9d0a-8a3591cc7b36 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:02.492312 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-db00c6f8-78da-4d26-9d0a-8a3591cc7b36 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:02.492761 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-db00c6f8-78da-4d26-9d0a-8a3591cc7b36 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:02.493206 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-db00c6f8-78da-4d26-9d0a-8a3591cc7b36 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:02.567280 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e9c28857-bafd-4725-9d25-ea399cbd2c52 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb40699ae023477da8f0ae2265d5585f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8086dde9fecd4c38bd214e7e87e899eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:34:02.577644 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e9c28857-bafd-4725-9d25-ea399cbd2c52 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] 10.222.0.52 "GET /compute/v2.1/servers/2255727d-7de0-44dc-a021-8dd243cbda1f" status: 200 len: 1315 microversion: 2.1 time: 0.722939 Oct 19 03:34:02.578156 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2271/4629] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:34:01 2022] GET /compute/v2.1/servers/2255727d-7de0-44dc-a021-8dd243cbda1f => generated 1315 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:34:02.637122 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-db00c6f8-78da-4d26-9d0a-8a3591cc7b36 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f3337e3ea74d868d2072683e44d472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baf68030f15244c79a0d83ab3f3727ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:34:02.646086 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-db00c6f8-78da-4d26-9d0a-8a3591cc7b36 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] 10.222.0.52 "GET /compute/v2.1/servers/64b50337-325c-4476-9bd1-e38839e22294" status: 200 len: 1276 microversion: 2.1 time: 0.175940 Oct 19 03:34:02.649890 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2359/4630] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:34:02 2022] GET /compute/v2.1/servers/64b50337-325c-4476-9bd1-e38839e22294 => generated 1276 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:34:02.880484 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3e75c2a7-4531-4378-b25f-52e2ef0cd331 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:34:02.881569 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3e75c2a7-4531-4378-b25f-52e2ef0cd331 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] [instance: 29a2d62a-83d9-43e2-8907-f4158500d83f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:34:02.892319 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3e75c2a7-4531-4378-b25f-52e2ef0cd331 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:02.894876 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3e75c2a7-4531-4378-b25f-52e2ef0cd331 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:02.894876 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3e75c2a7-4531-4378-b25f-52e2ef0cd331 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:02.894876 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3e75c2a7-4531-4378-b25f-52e2ef0cd331 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:02.894876 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3e75c2a7-4531-4378-b25f-52e2ef0cd331 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:02.899953 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3e75c2a7-4531-4378-b25f-52e2ef0cd331 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:03.444101 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b3f1b424-afab-4653-b382-70acadd2cd1d tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:34:03.444101 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b3f1b424-afab-4653-b382-70acadd2cd1d tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:34:03.473515 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b3f1b424-afab-4653-b382-70acadd2cd1d tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:03.474034 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b3f1b424-afab-4653-b382-70acadd2cd1d tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:03.474488 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b3f1b424-afab-4653-b382-70acadd2cd1d tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:03.475210 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b3f1b424-afab-4653-b382-70acadd2cd1d tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:03.478409 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b3f1b424-afab-4653-b382-70acadd2cd1d tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:03.478409 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b3f1b424-afab-4653-b382-70acadd2cd1d tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:04.347575 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-3e75c2a7-4531-4378-b25f-52e2ef0cd331 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33d07a7db4846ababf001493c6e10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb0265509744c93b03fa5c28b4e9386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:34:04.357357 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3e75c2a7-4531-4378-b25f-52e2ef0cd331 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] 10.222.0.52 "GET /compute/v2.1/servers/29a2d62a-83d9-43e2-8907-f4158500d83f" status: 200 len: 1507 microversion: 2.1 time: 1.481203 Oct 19 03:34:04.366178 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2272/4631] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:34:02 2022] GET /compute/v2.1/servers/29a2d62a-83d9-43e2-8907-f4158500d83f => generated 1507 bytes in 1491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:34:04.371727 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ae558f1e-ebd5-42fa-beab-3731ece30833 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:34:04.372351 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ae558f1e-ebd5-42fa-beab-3731ece30833 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] [instance: 2255727d-7de0-44dc-a021-8dd243cbda1f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:34:04.402647 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ae558f1e-ebd5-42fa-beab-3731ece30833 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:04.403151 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ae558f1e-ebd5-42fa-beab-3731ece30833 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:04.403606 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ae558f1e-ebd5-42fa-beab-3731ece30833 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:04.404458 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ae558f1e-ebd5-42fa-beab-3731ece30833 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:04.405006 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ae558f1e-ebd5-42fa-beab-3731ece30833 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:04.405467 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ae558f1e-ebd5-42fa-beab-3731ece30833 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:05.289027 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b3f1b424-afab-4653-b382-70acadd2cd1d tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:34:05.305780 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b3f1b424-afab-4653-b382-70acadd2cd1d tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1672 microversion: 2.1 time: 1.868527 Oct 19 03:34:05.308723 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2360/4632] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:34:03 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1672 bytes in 1873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:34:05.319140 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a38ffbb0-b033-45b3-bd8b-20a3b7d7c4dc tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:34:05.321228 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a38ffbb0-b033-45b3-bd8b-20a3b7d7c4dc tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] [instance: 64b50337-325c-4476-9bd1-e38839e22294] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:34:05.376334 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=6 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:34:05.382421 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a38ffbb0-b033-45b3-bd8b-20a3b7d7c4dc tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:05.382939 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a38ffbb0-b033-45b3-bd8b-20a3b7d7c4dc tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:05.383387 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a38ffbb0-b033-45b3-bd8b-20a3b7d7c4dc tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:05.406381 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a38ffbb0-b033-45b3-bd8b-20a3b7d7c4dc tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:05.406886 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a38ffbb0-b033-45b3-bd8b-20a3b7d7c4dc tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:05.407503 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a38ffbb0-b033-45b3-bd8b-20a3b7d7c4dc tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:05.637864 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ae558f1e-ebd5-42fa-beab-3731ece30833 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb40699ae023477da8f0ae2265d5585f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8086dde9fecd4c38bd214e7e87e899eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:34:05.654336 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ae558f1e-ebd5-42fa-beab-3731ece30833 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] 10.222.0.52 "GET /compute/v2.1/servers/2255727d-7de0-44dc-a021-8dd243cbda1f" status: 200 len: 1315 microversion: 2.1 time: 1.286891 Oct 19 03:34:05.657389 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2273/4633] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:34:04 2022] GET /compute/v2.1/servers/2255727d-7de0-44dc-a021-8dd243cbda1f => generated 1315 bytes in 1290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:34:05.664119 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-37ee662a-3f93-4a1b-a134-e0ddbc0b2f8e tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:34:05.664966 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-37ee662a-3f93-4a1b-a134-e0ddbc0b2f8e tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] [instance: 29a2d62a-83d9-43e2-8907-f4158500d83f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:34:05.690507 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-37ee662a-3f93-4a1b-a134-e0ddbc0b2f8e tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:05.693135 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-37ee662a-3f93-4a1b-a134-e0ddbc0b2f8e tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:05.693633 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-37ee662a-3f93-4a1b-a134-e0ddbc0b2f8e tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:05.694382 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-37ee662a-3f93-4a1b-a134-e0ddbc0b2f8e tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:05.699255 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-37ee662a-3f93-4a1b-a134-e0ddbc0b2f8e tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:05.699914 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-37ee662a-3f93-4a1b-a134-e0ddbc0b2f8e tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:05.709493 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:34:06.097210 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a38ffbb0-b033-45b3-bd8b-20a3b7d7c4dc tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f3337e3ea74d868d2072683e44d472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baf68030f15244c79a0d83ab3f3727ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:34:06.110261 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a38ffbb0-b033-45b3-bd8b-20a3b7d7c4dc tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] 10.222.0.52 "GET /compute/v2.1/servers/64b50337-325c-4476-9bd1-e38839e22294" status: 200 len: 1318 microversion: 2.1 time: 0.800173 Oct 19 03:34:06.111296 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2361/4634] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:34:05 2022] GET /compute/v2.1/servers/64b50337-325c-4476-9bd1-e38839e22294 => generated 1318 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:34:06.121084 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-f85fb003-8cbd-4c2f-9885-e53dcd5ac65c req-18ea2218-33cd-4245-a9bb-30e975436f51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2255727d-7de0-44dc-a021-8dd243cbda1f", "tag": "1b963f9b-831e-4714-b27c-8913c5b34548"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:34:06.147028 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-f85fb003-8cbd-4c2f-9885-e53dcd5ac65c req-18ea2218-33cd-4245-a9bb-30e975436f51 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:06.147745 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-f85fb003-8cbd-4c2f-9885-e53dcd5ac65c req-18ea2218-33cd-4245-a9bb-30e975436f51 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:06.148579 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-f85fb003-8cbd-4c2f-9885-e53dcd5ac65c req-18ea2218-33cd-4245-a9bb-30e975436f51 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:06.172032 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-f85fb003-8cbd-4c2f-9885-e53dcd5ac65c req-18ea2218-33cd-4245-a9bb-30e975436f51 service nova] Creating event network-changed:1b963f9b-831e-4714-b27c-8913c5b34548 for instance 2255727d-7de0-44dc-a021-8dd243cbda1f on n-h1-861333-8 Oct 19 03:34:06.185256 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-f85fb003-8cbd-4c2f-9885-e53dcd5ac65c req-18ea2218-33cd-4245-a9bb-30e975436f51 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070329 Oct 19 03:34:06.185256 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2362/4635] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:34:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:34:06.334786 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c6b7d823-3703-45ca-92ae-f0476d03c2ce tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:34:06.335954 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c6b7d823-3703-45ca-92ae-f0476d03c2ce tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:34:06.349642 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c6b7d823-3703-45ca-92ae-f0476d03c2ce tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:06.353155 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c6b7d823-3703-45ca-92ae-f0476d03c2ce tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:06.354311 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c6b7d823-3703-45ca-92ae-f0476d03c2ce tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:06.357869 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c6b7d823-3703-45ca-92ae-f0476d03c2ce tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:06.357869 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c6b7d823-3703-45ca-92ae-f0476d03c2ce tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:06.357869 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c6b7d823-3703-45ca-92ae-f0476d03c2ce tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:06.629693 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-37ee662a-3f93-4a1b-a134-e0ddbc0b2f8e tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33d07a7db4846ababf001493c6e10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb0265509744c93b03fa5c28b4e9386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:34:06.650649 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-37ee662a-3f93-4a1b-a134-e0ddbc0b2f8e tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] 10.222.0.52 "GET /compute/v2.1/servers/29a2d62a-83d9-43e2-8907-f4158500d83f" status: 200 len: 1507 microversion: 2.1 time: 0.991156 Oct 19 03:34:06.653483 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2274/4636] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:34:05 2022] GET /compute/v2.1/servers/29a2d62a-83d9-43e2-8907-f4158500d83f => generated 1507 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:34:06.683640 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a3a719af-7b8f-48b0-b87e-e11dcad0daa5 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:34:06.684566 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a3a719af-7b8f-48b0-b87e-e11dcad0daa5 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] [instance: 2255727d-7de0-44dc-a021-8dd243cbda1f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:34:06.697022 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a3a719af-7b8f-48b0-b87e-e11dcad0daa5 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:06.698928 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a3a719af-7b8f-48b0-b87e-e11dcad0daa5 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:06.701222 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a3a719af-7b8f-48b0-b87e-e11dcad0daa5 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:06.706350 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a3a719af-7b8f-48b0-b87e-e11dcad0daa5 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:06.706350 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a3a719af-7b8f-48b0-b87e-e11dcad0daa5 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:06.707435 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a3a719af-7b8f-48b0-b87e-e11dcad0daa5 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:07.295866 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c6b7d823-3703-45ca-92ae-f0476d03c2ce tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:34:07.303415 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c6b7d823-3703-45ca-92ae-f0476d03c2ce tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1670 microversion: 2.1 time: 0.975044 Oct 19 03:34:07.305820 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2363/4637] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:34:06 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1670 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:34:07.323050 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a0c6f215-df33-4f97-8b84-9b74abefa445 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:34:07.324095 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a0c6f215-df33-4f97-8b84-9b74abefa445 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] [instance: 64b50337-325c-4476-9bd1-e38839e22294] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:34:07.341235 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a0c6f215-df33-4f97-8b84-9b74abefa445 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:07.342569 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a0c6f215-df33-4f97-8b84-9b74abefa445 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:07.343248 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a0c6f215-df33-4f97-8b84-9b74abefa445 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:07.344192 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a0c6f215-df33-4f97-8b84-9b74abefa445 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:07.344870 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a0c6f215-df33-4f97-8b84-9b74abefa445 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:07.347788 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a0c6f215-df33-4f97-8b84-9b74abefa445 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:07.411523 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a3a719af-7b8f-48b0-b87e-e11dcad0daa5 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb40699ae023477da8f0ae2265d5585f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8086dde9fecd4c38bd214e7e87e899eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:34:07.417868 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a3a719af-7b8f-48b0-b87e-e11dcad0daa5 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] 10.222.0.52 "GET /compute/v2.1/servers/2255727d-7de0-44dc-a021-8dd243cbda1f" status: 200 len: 1315 microversion: 2.1 time: 0.738365 Oct 19 03:34:07.420851 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2275/4638] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:34:06 2022] GET /compute/v2.1/servers/2255727d-7de0-44dc-a021-8dd243cbda1f => generated 1315 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:34:07.866601 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-9d810631-81ff-4255-84b2-c7aec4373612 req-e71a048c-ddde-4725-af9c-4a065043945a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3180914-6014-4e72-9b03-a03f52de0145", "tag": "12a02252-cdd6-49f6-b787-bab713b86ba2"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:34:07.891898 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-9d810631-81ff-4255-84b2-c7aec4373612 req-e71a048c-ddde-4725-af9c-4a065043945a service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:07.897010 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-9d810631-81ff-4255-84b2-c7aec4373612 req-e71a048c-ddde-4725-af9c-4a065043945a service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:07.900510 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-9d810631-81ff-4255-84b2-c7aec4373612 req-e71a048c-ddde-4725-af9c-4a065043945a service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:07.933174 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-9d810631-81ff-4255-84b2-c7aec4373612 req-e71a048c-ddde-4725-af9c-4a065043945a service nova] Creating event network-changed:12a02252-cdd6-49f6-b787-bab713b86ba2 for instance b3180914-6014-4e72-9b03-a03f52de0145 on n-h1-861333-8 Oct 19 03:34:07.947430 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-9d810631-81ff-4255-84b2-c7aec4373612 req-e71a048c-ddde-4725-af9c-4a065043945a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.504834 Oct 19 03:34:07.948418 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2276/4639] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:34:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:34:07.953766 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0a74a93c-66cf-4ec4-a9d5-a21da8d8dfd5 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:34:07.954484 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0a74a93c-66cf-4ec4-a9d5-a21da8d8dfd5 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] [instance: 29a2d62a-83d9-43e2-8907-f4158500d83f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:34:07.974723 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0a74a93c-66cf-4ec4-a9d5-a21da8d8dfd5 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:07.975588 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0a74a93c-66cf-4ec4-a9d5-a21da8d8dfd5 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:07.976234 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0a74a93c-66cf-4ec4-a9d5-a21da8d8dfd5 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:07.979658 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0a74a93c-66cf-4ec4-a9d5-a21da8d8dfd5 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:07.980523 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0a74a93c-66cf-4ec4-a9d5-a21da8d8dfd5 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:07.980965 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0a74a93c-66cf-4ec4-a9d5-a21da8d8dfd5 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:08.053794 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a0c6f215-df33-4f97-8b84-9b74abefa445 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f3337e3ea74d868d2072683e44d472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baf68030f15244c79a0d83ab3f3727ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:34:08.070516 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a0c6f215-df33-4f97-8b84-9b74abefa445 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] 10.222.0.52 "GET /compute/v2.1/servers/64b50337-325c-4476-9bd1-e38839e22294" status: 200 len: 1318 microversion: 2.1 time: 0.761266 Oct 19 03:34:08.073232 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2364/4640] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:34:07 2022] GET /compute/v2.1/servers/64b50337-325c-4476-9bd1-e38839e22294 => generated 1318 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:34:08.338395 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-4f9773e7-ef86-472d-ab36-9c6ef60aed7d req-26f001dd-d7b9-429d-a21f-75204574ec6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64b50337-325c-4476-9bd1-e38839e22294", "tag": "ff734670-1945-4d93-8bf4-917b29792466"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:34:08.348461 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-4f9773e7-ef86-472d-ab36-9c6ef60aed7d req-26f001dd-d7b9-429d-a21f-75204574ec6a service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:08.350326 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-4f9773e7-ef86-472d-ab36-9c6ef60aed7d req-26f001dd-d7b9-429d-a21f-75204574ec6a service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:08.350994 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-4f9773e7-ef86-472d-ab36-9c6ef60aed7d req-26f001dd-d7b9-429d-a21f-75204574ec6a service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:08.367576 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-4f9773e7-ef86-472d-ab36-9c6ef60aed7d req-26f001dd-d7b9-429d-a21f-75204574ec6a service nova] Creating event network-changed:ff734670-1945-4d93-8bf4-917b29792466 for instance 64b50337-325c-4476-9bd1-e38839e22294 on n-h2-861333-8 Oct 19 03:34:08.374770 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-4f9773e7-ef86-472d-ab36-9c6ef60aed7d req-26f001dd-d7b9-429d-a21f-75204574ec6a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039798 Oct 19 03:34:08.375585 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2365/4641] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:34:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:34:08.406827 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0a74a93c-66cf-4ec4-a9d5-a21da8d8dfd5 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33d07a7db4846ababf001493c6e10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb0265509744c93b03fa5c28b4e9386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:34:08.413827 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0a74a93c-66cf-4ec4-a9d5-a21da8d8dfd5 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] 10.222.0.52 "GET /compute/v2.1/servers/29a2d62a-83d9-43e2-8907-f4158500d83f" status: 200 len: 1507 microversion: 2.1 time: 0.464136 Oct 19 03:34:08.415147 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2277/4642] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:34:07 2022] GET /compute/v2.1/servers/29a2d62a-83d9-43e2-8907-f4158500d83f => generated 1507 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:34:08.445830 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5f138fb1-101b-4157-a677-5b12546c2316 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:34:08.446794 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-5f138fb1-101b-4157-a677-5b12546c2316 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] [instance: 2255727d-7de0-44dc-a021-8dd243cbda1f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:34:08.454370 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5f138fb1-101b-4157-a677-5b12546c2316 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:08.455009 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5f138fb1-101b-4157-a677-5b12546c2316 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:08.456085 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5f138fb1-101b-4157-a677-5b12546c2316 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:08.456919 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5f138fb1-101b-4157-a677-5b12546c2316 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:08.457511 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5f138fb1-101b-4157-a677-5b12546c2316 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:08.458041 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5f138fb1-101b-4157-a677-5b12546c2316 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:09.092411 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0281de26-0eeb-48d0-8ba2-40dfb7e422ba tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:34:09.093136 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0281de26-0eeb-48d0-8ba2-40dfb7e422ba tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] [instance: 64b50337-325c-4476-9bd1-e38839e22294] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:34:09.101059 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0281de26-0eeb-48d0-8ba2-40dfb7e422ba tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:09.102978 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0281de26-0eeb-48d0-8ba2-40dfb7e422ba tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:09.102978 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0281de26-0eeb-48d0-8ba2-40dfb7e422ba tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:09.102978 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0281de26-0eeb-48d0-8ba2-40dfb7e422ba tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:09.103483 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0281de26-0eeb-48d0-8ba2-40dfb7e422ba tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:09.104406 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0281de26-0eeb-48d0-8ba2-40dfb7e422ba tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:09.274739 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-5f138fb1-101b-4157-a677-5b12546c2316 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb40699ae023477da8f0ae2265d5585f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8086dde9fecd4c38bd214e7e87e899eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:34:09.289107 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5f138fb1-101b-4157-a677-5b12546c2316 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] 10.222.0.52 "GET /compute/v2.1/servers/2255727d-7de0-44dc-a021-8dd243cbda1f" status: 200 len: 1315 microversion: 2.1 time: 0.845713 Oct 19 03:34:09.289979 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2366/4643] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:34:08 2022] GET /compute/v2.1/servers/2255727d-7de0-44dc-a021-8dd243cbda1f => generated 1315 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:34:09.441828 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-fed412dc-fb4e-4d1d-b70e-252be2d90e51 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:34:09.443411 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-fed412dc-fb4e-4d1d-b70e-252be2d90e51 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] [instance: 29a2d62a-83d9-43e2-8907-f4158500d83f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:34:09.459069 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fed412dc-fb4e-4d1d-b70e-252be2d90e51 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:09.460451 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fed412dc-fb4e-4d1d-b70e-252be2d90e51 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:09.463427 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fed412dc-fb4e-4d1d-b70e-252be2d90e51 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:09.465354 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fed412dc-fb4e-4d1d-b70e-252be2d90e51 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:09.467079 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fed412dc-fb4e-4d1d-b70e-252be2d90e51 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:09.468453 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fed412dc-fb4e-4d1d-b70e-252be2d90e51 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:09.549800 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0281de26-0eeb-48d0-8ba2-40dfb7e422ba tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f3337e3ea74d868d2072683e44d472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baf68030f15244c79a0d83ab3f3727ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:34:09.558281 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0281de26-0eeb-48d0-8ba2-40dfb7e422ba tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] 10.222.0.52 "GET /compute/v2.1/servers/64b50337-325c-4476-9bd1-e38839e22294" status: 200 len: 1318 microversion: 2.1 time: 0.470059 Oct 19 03:34:09.570146 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2278/4644] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:34:09 2022] GET /compute/v2.1/servers/64b50337-325c-4476-9bd1-e38839e22294 => generated 1318 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:34:09.733279 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=20 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:34:09.812050 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-fed412dc-fb4e-4d1d-b70e-252be2d90e51 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33d07a7db4846ababf001493c6e10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb0265509744c93b03fa5c28b4e9386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:34:09.825186 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-fed412dc-fb4e-4d1d-b70e-252be2d90e51 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] 10.222.0.52 "GET /compute/v2.1/servers/29a2d62a-83d9-43e2-8907-f4158500d83f" status: 200 len: 1507 microversion: 2.1 time: 0.389974 Oct 19 03:34:09.832768 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2367/4645] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:34:09 2022] GET /compute/v2.1/servers/29a2d62a-83d9-43e2-8907-f4158500d83f => generated 1507 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:34:10.316255 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-462a902d-9f23-4d91-affb-545bbf5b8835 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:34:10.317157 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-462a902d-9f23-4d91-affb-545bbf5b8835 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] [instance: 2255727d-7de0-44dc-a021-8dd243cbda1f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:34:10.323672 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=8 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:34:10.326102 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-462a902d-9f23-4d91-affb-545bbf5b8835 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:10.326855 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-462a902d-9f23-4d91-affb-545bbf5b8835 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:10.327510 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-462a902d-9f23-4d91-affb-545bbf5b8835 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:10.328507 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-462a902d-9f23-4d91-affb-545bbf5b8835 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:10.329186 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-462a902d-9f23-4d91-affb-545bbf5b8835 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:10.329930 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-462a902d-9f23-4d91-affb-545bbf5b8835 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:10.597776 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-14334f23-a323-4b38-b1c6-52c037b42014 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:34:10.599064 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-14334f23-a323-4b38-b1c6-52c037b42014 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] [instance: 64b50337-325c-4476-9bd1-e38839e22294] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:34:10.607924 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-14334f23-a323-4b38-b1c6-52c037b42014 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:10.608846 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-14334f23-a323-4b38-b1c6-52c037b42014 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:10.609494 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-14334f23-a323-4b38-b1c6-52c037b42014 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:10.610348 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-14334f23-a323-4b38-b1c6-52c037b42014 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:10.610983 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-14334f23-a323-4b38-b1c6-52c037b42014 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:10.612207 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-14334f23-a323-4b38-b1c6-52c037b42014 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:10.664067 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-462a902d-9f23-4d91-affb-545bbf5b8835 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb40699ae023477da8f0ae2265d5585f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8086dde9fecd4c38bd214e7e87e899eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:34:10.677464 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-462a902d-9f23-4d91-affb-545bbf5b8835 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] 10.222.0.52 "GET /compute/v2.1/servers/2255727d-7de0-44dc-a021-8dd243cbda1f" status: 200 len: 1315 microversion: 2.1 time: 0.364988 Oct 19 03:34:10.679877 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2279/4646] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:34:10 2022] GET /compute/v2.1/servers/2255727d-7de0-44dc-a021-8dd243cbda1f => generated 1315 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:34:10.853308 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-33ce06dc-2b29-4430-a4fd-f0c009ca2dfb tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:34:10.854237 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-33ce06dc-2b29-4430-a4fd-f0c009ca2dfb tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] [instance: 29a2d62a-83d9-43e2-8907-f4158500d83f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:34:10.869163 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-33ce06dc-2b29-4430-a4fd-f0c009ca2dfb tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:10.871696 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-33ce06dc-2b29-4430-a4fd-f0c009ca2dfb tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:10.874895 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-33ce06dc-2b29-4430-a4fd-f0c009ca2dfb tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:10.876240 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-33ce06dc-2b29-4430-a4fd-f0c009ca2dfb tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:10.878437 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-33ce06dc-2b29-4430-a4fd-f0c009ca2dfb tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:10.879058 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-33ce06dc-2b29-4430-a4fd-f0c009ca2dfb tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:11.214670 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-14334f23-a323-4b38-b1c6-52c037b42014 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f3337e3ea74d868d2072683e44d472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baf68030f15244c79a0d83ab3f3727ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:34:11.227473 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-14334f23-a323-4b38-b1c6-52c037b42014 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] 10.222.0.52 "GET /compute/v2.1/servers/64b50337-325c-4476-9bd1-e38839e22294" status: 200 len: 1318 microversion: 2.1 time: 0.635545 Oct 19 03:34:11.231154 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2368/4647] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:34:10 2022] GET /compute/v2.1/servers/64b50337-325c-4476-9bd1-e38839e22294 => generated 1318 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:34:11.319945 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-33ce06dc-2b29-4430-a4fd-f0c009ca2dfb tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33d07a7db4846ababf001493c6e10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb0265509744c93b03fa5c28b4e9386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:34:11.342456 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-33ce06dc-2b29-4430-a4fd-f0c009ca2dfb tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] 10.222.0.52 "GET /compute/v2.1/servers/29a2d62a-83d9-43e2-8907-f4158500d83f" status: 200 len: 1507 microversion: 2.1 time: 0.494112 Oct 19 03:34:11.345596 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2280/4648] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:34:10 2022] GET /compute/v2.1/servers/29a2d62a-83d9-43e2-8907-f4158500d83f => generated 1507 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:34:11.700198 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f3118c7e-fc75-48ee-9529-5f773751145f tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:34:11.701330 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f3118c7e-fc75-48ee-9529-5f773751145f tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] [instance: 2255727d-7de0-44dc-a021-8dd243cbda1f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:34:11.715366 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f3118c7e-fc75-48ee-9529-5f773751145f tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:11.716051 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f3118c7e-fc75-48ee-9529-5f773751145f tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:11.718297 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f3118c7e-fc75-48ee-9529-5f773751145f tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:11.721704 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f3118c7e-fc75-48ee-9529-5f773751145f tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:11.725609 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f3118c7e-fc75-48ee-9529-5f773751145f tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:11.726060 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f3118c7e-fc75-48ee-9529-5f773751145f tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:12.038068 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f3118c7e-fc75-48ee-9529-5f773751145f tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb40699ae023477da8f0ae2265d5585f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8086dde9fecd4c38bd214e7e87e899eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:34:12.047926 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f3118c7e-fc75-48ee-9529-5f773751145f tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] 10.222.0.52 "GET /compute/v2.1/servers/2255727d-7de0-44dc-a021-8dd243cbda1f" status: 200 len: 1315 microversion: 2.1 time: 0.351380 Oct 19 03:34:12.048644 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2369/4649] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:34:11 2022] GET /compute/v2.1/servers/2255727d-7de0-44dc-a021-8dd243cbda1f => generated 1315 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:34:12.253602 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7763c879-b7f5-4787-9f38-6d527cc19b97 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:34:12.254516 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7763c879-b7f5-4787-9f38-6d527cc19b97 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] [instance: 64b50337-325c-4476-9bd1-e38839e22294] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:34:12.260679 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7763c879-b7f5-4787-9f38-6d527cc19b97 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:12.261548 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7763c879-b7f5-4787-9f38-6d527cc19b97 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:12.262213 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7763c879-b7f5-4787-9f38-6d527cc19b97 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:12.263230 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7763c879-b7f5-4787-9f38-6d527cc19b97 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:12.263791 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7763c879-b7f5-4787-9f38-6d527cc19b97 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:12.264311 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7763c879-b7f5-4787-9f38-6d527cc19b97 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:12.370646 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-8eff8cfd-f8de-45f5-91f8-362d1d514198 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:34:12.371518 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-8eff8cfd-f8de-45f5-91f8-362d1d514198 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] [instance: 29a2d62a-83d9-43e2-8907-f4158500d83f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:34:12.384483 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8eff8cfd-f8de-45f5-91f8-362d1d514198 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:12.385258 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8eff8cfd-f8de-45f5-91f8-362d1d514198 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:12.389885 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8eff8cfd-f8de-45f5-91f8-362d1d514198 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:12.390896 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8eff8cfd-f8de-45f5-91f8-362d1d514198 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:12.391873 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8eff8cfd-f8de-45f5-91f8-362d1d514198 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:12.392520 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8eff8cfd-f8de-45f5-91f8-362d1d514198 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:12.686278 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-7763c879-b7f5-4787-9f38-6d527cc19b97 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f3337e3ea74d868d2072683e44d472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baf68030f15244c79a0d83ab3f3727ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:34:12.694832 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7763c879-b7f5-4787-9f38-6d527cc19b97 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] 10.222.0.52 "GET /compute/v2.1/servers/64b50337-325c-4476-9bd1-e38839e22294" status: 200 len: 1318 microversion: 2.1 time: 0.446339 Oct 19 03:34:12.696049 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2281/4650] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:34:12 2022] GET /compute/v2.1/servers/64b50337-325c-4476-9bd1-e38839e22294 => generated 1318 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:34:12.821817 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-8eff8cfd-f8de-45f5-91f8-362d1d514198 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33d07a7db4846ababf001493c6e10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb0265509744c93b03fa5c28b4e9386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:34:12.854522 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-8eff8cfd-f8de-45f5-91f8-362d1d514198 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] 10.222.0.52 "GET /compute/v2.1/servers/29a2d62a-83d9-43e2-8907-f4158500d83f" status: 200 len: 1507 microversion: 2.1 time: 0.487575 Oct 19 03:34:12.855529 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2370/4651] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:34:12 2022] GET /compute/v2.1/servers/29a2d62a-83d9-43e2-8907-f4158500d83f => generated 1507 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:34:13.071342 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-eb85dae1-c897-490c-b2f0-a50e0cfca7aa tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:34:13.072312 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-eb85dae1-c897-490c-b2f0-a50e0cfca7aa tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] [instance: 2255727d-7de0-44dc-a021-8dd243cbda1f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:34:13.079214 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eb85dae1-c897-490c-b2f0-a50e0cfca7aa tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:13.080685 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eb85dae1-c897-490c-b2f0-a50e0cfca7aa tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:13.081294 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eb85dae1-c897-490c-b2f0-a50e0cfca7aa tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:13.084233 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eb85dae1-c897-490c-b2f0-a50e0cfca7aa tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:13.084233 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eb85dae1-c897-490c-b2f0-a50e0cfca7aa tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:13.084233 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eb85dae1-c897-490c-b2f0-a50e0cfca7aa tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:13.425092 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-eb85dae1-c897-490c-b2f0-a50e0cfca7aa tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb40699ae023477da8f0ae2265d5585f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8086dde9fecd4c38bd214e7e87e899eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:34:13.466302 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-eb85dae1-c897-490c-b2f0-a50e0cfca7aa tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] 10.222.0.52 "GET /compute/v2.1/servers/2255727d-7de0-44dc-a021-8dd243cbda1f" status: 200 len: 1315 microversion: 2.1 time: 0.395054 Oct 19 03:34:13.467571 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2282/4652] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:34:13 2022] GET /compute/v2.1/servers/2255727d-7de0-44dc-a021-8dd243cbda1f => generated 1315 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:34:13.483909 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-ba413ba7-153f-4231-bace-d4cba82b0113 req-aa12681f-2814-4298-b87d-4eda19be6d12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2255727d-7de0-44dc-a021-8dd243cbda1f", "name": "network-vif-plugged", "status": "completed", "tag": "1b963f9b-831e-4714-b27c-8913c5b34548"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:34:13.507282 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-ba413ba7-153f-4231-bace-d4cba82b0113 req-aa12681f-2814-4298-b87d-4eda19be6d12 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:13.508049 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-ba413ba7-153f-4231-bace-d4cba82b0113 req-aa12681f-2814-4298-b87d-4eda19be6d12 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:13.510657 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-ba413ba7-153f-4231-bace-d4cba82b0113 req-aa12681f-2814-4298-b87d-4eda19be6d12 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:13.556592 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-ba413ba7-153f-4231-bace-d4cba82b0113 req-aa12681f-2814-4298-b87d-4eda19be6d12 service nova] Creating event network-vif-plugged:1b963f9b-831e-4714-b27c-8913c5b34548 for instance 2255727d-7de0-44dc-a021-8dd243cbda1f on n-h1-861333-8 Oct 19 03:34:13.570012 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-ba413ba7-153f-4231-bace-d4cba82b0113 req-aa12681f-2814-4298-b87d-4eda19be6d12 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090074 Oct 19 03:34:13.573882 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2371/4653] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:34:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:34:13.719442 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3496401c-f188-4ce9-8a27-b288503d1050 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:34:13.720082 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3496401c-f188-4ce9-8a27-b288503d1050 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] [instance: 64b50337-325c-4476-9bd1-e38839e22294] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:34:13.732272 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3496401c-f188-4ce9-8a27-b288503d1050 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:13.732831 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3496401c-f188-4ce9-8a27-b288503d1050 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:13.733286 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3496401c-f188-4ce9-8a27-b288503d1050 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:13.740135 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3496401c-f188-4ce9-8a27-b288503d1050 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:13.740135 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3496401c-f188-4ce9-8a27-b288503d1050 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:13.740135 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3496401c-f188-4ce9-8a27-b288503d1050 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:13.886582 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1aa1c21c-0ea8-4e84-9a7c-c9ac0a79a0d3 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:34:13.887309 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1aa1c21c-0ea8-4e84-9a7c-c9ac0a79a0d3 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] [instance: 29a2d62a-83d9-43e2-8907-f4158500d83f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:34:13.898950 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1aa1c21c-0ea8-4e84-9a7c-c9ac0a79a0d3 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:13.899641 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1aa1c21c-0ea8-4e84-9a7c-c9ac0a79a0d3 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:13.900194 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1aa1c21c-0ea8-4e84-9a7c-c9ac0a79a0d3 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:13.901622 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1aa1c21c-0ea8-4e84-9a7c-c9ac0a79a0d3 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:13.902201 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1aa1c21c-0ea8-4e84-9a7c-c9ac0a79a0d3 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:13.902825 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1aa1c21c-0ea8-4e84-9a7c-c9ac0a79a0d3 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:14.763550 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-1aa1c21c-0ea8-4e84-9a7c-c9ac0a79a0d3 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33d07a7db4846ababf001493c6e10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb0265509744c93b03fa5c28b4e9386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:34:14.765778 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-3496401c-f188-4ce9-8a27-b288503d1050 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f3337e3ea74d868d2072683e44d472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baf68030f15244c79a0d83ab3f3727ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:34:14.796452 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1aa1c21c-0ea8-4e84-9a7c-c9ac0a79a0d3 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] 10.222.0.52 "GET /compute/v2.1/servers/29a2d62a-83d9-43e2-8907-f4158500d83f" status: 200 len: 1507 microversion: 2.1 time: 0.916396 Oct 19 03:34:14.799773 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2372/4654] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:34:13 2022] GET /compute/v2.1/servers/29a2d62a-83d9-43e2-8907-f4158500d83f => generated 1507 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:34:14.807350 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3496401c-f188-4ce9-8a27-b288503d1050 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] 10.222.0.52 "GET /compute/v2.1/servers/64b50337-325c-4476-9bd1-e38839e22294" status: 200 len: 1318 microversion: 2.1 time: 1.083475 Oct 19 03:34:14.808564 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2283/4655] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:34:13 2022] GET /compute/v2.1/servers/64b50337-325c-4476-9bd1-e38839e22294 => generated 1318 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:34:14.817491 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-45082ef8-f953-48d0-aab0-4cb382a1e9ec tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:34:14.818413 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-45082ef8-f953-48d0-aab0-4cb382a1e9ec tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] [instance: 2255727d-7de0-44dc-a021-8dd243cbda1f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:34:14.836852 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-45082ef8-f953-48d0-aab0-4cb382a1e9ec tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:14.837567 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-45082ef8-f953-48d0-aab0-4cb382a1e9ec tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:14.838162 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-45082ef8-f953-48d0-aab0-4cb382a1e9ec tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:14.839034 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-45082ef8-f953-48d0-aab0-4cb382a1e9ec tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:14.841485 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-45082ef8-f953-48d0-aab0-4cb382a1e9ec tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:14.841933 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-45082ef8-f953-48d0-aab0-4cb382a1e9ec tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:15.244187 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-45082ef8-f953-48d0-aab0-4cb382a1e9ec tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb40699ae023477da8f0ae2265d5585f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8086dde9fecd4c38bd214e7e87e899eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:34:15.256366 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-45082ef8-f953-48d0-aab0-4cb382a1e9ec tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] 10.222.0.52 "GET /compute/v2.1/servers/2255727d-7de0-44dc-a021-8dd243cbda1f" status: 200 len: 1315 microversion: 2.1 time: 0.454120 Oct 19 03:34:15.256946 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2373/4656] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:34:14 2022] GET /compute/v2.1/servers/2255727d-7de0-44dc-a021-8dd243cbda1f => generated 1315 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:34:15.820041 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0f2fce7f-cc78-400b-a6e1-09218c06b38b tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:34:15.821509 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0f2fce7f-cc78-400b-a6e1-09218c06b38b tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] [instance: 29a2d62a-83d9-43e2-8907-f4158500d83f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:34:15.832293 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e437c61b-66af-4dd4-89de-8125dd7a14de tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:34:15.833172 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e437c61b-66af-4dd4-89de-8125dd7a14de tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] [instance: 64b50337-325c-4476-9bd1-e38839e22294] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:34:15.846199 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0f2fce7f-cc78-400b-a6e1-09218c06b38b tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:15.847850 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e437c61b-66af-4dd4-89de-8125dd7a14de tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:15.848509 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e437c61b-66af-4dd4-89de-8125dd7a14de tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:15.849704 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e437c61b-66af-4dd4-89de-8125dd7a14de tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:15.851037 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e437c61b-66af-4dd4-89de-8125dd7a14de tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:15.851977 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0f2fce7f-cc78-400b-a6e1-09218c06b38b tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:15.853397 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0f2fce7f-cc78-400b-a6e1-09218c06b38b tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:15.853748 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e437c61b-66af-4dd4-89de-8125dd7a14de tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:15.855154 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e437c61b-66af-4dd4-89de-8125dd7a14de tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:15.859027 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0f2fce7f-cc78-400b-a6e1-09218c06b38b tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:15.859027 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0f2fce7f-cc78-400b-a6e1-09218c06b38b tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:15.859027 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0f2fce7f-cc78-400b-a6e1-09218c06b38b tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:16.384135 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0f2fce7f-cc78-400b-a6e1-09218c06b38b tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33d07a7db4846ababf001493c6e10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb0265509744c93b03fa5c28b4e9386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:34:16.407357 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0f2fce7f-cc78-400b-a6e1-09218c06b38b tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] 10.222.0.52 "GET /compute/v2.1/servers/29a2d62a-83d9-43e2-8907-f4158500d83f" status: 200 len: 1507 microversion: 2.1 time: 0.591502 Oct 19 03:34:16.409410 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2284/4657] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:34:15 2022] GET /compute/v2.1/servers/29a2d62a-83d9-43e2-8907-f4158500d83f => generated 1507 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:34:16.415917 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-692b2824-3539-40c5-a992-4f52788eb68c req-4a6cfd83-8bcd-4dc7-bc4c-0543182129e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64b50337-325c-4476-9bd1-e38839e22294", "name": "network-vif-plugged", "status": "completed", "tag": "ff734670-1945-4d93-8bf4-917b29792466"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:34:16.428352 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-692b2824-3539-40c5-a992-4f52788eb68c req-4a6cfd83-8bcd-4dc7-bc4c-0543182129e0 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:16.429077 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-692b2824-3539-40c5-a992-4f52788eb68c req-4a6cfd83-8bcd-4dc7-bc4c-0543182129e0 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:16.429740 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-692b2824-3539-40c5-a992-4f52788eb68c req-4a6cfd83-8bcd-4dc7-bc4c-0543182129e0 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:16.431975 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-e437c61b-66af-4dd4-89de-8125dd7a14de tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f3337e3ea74d868d2072683e44d472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baf68030f15244c79a0d83ab3f3727ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:34:16.442607 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e437c61b-66af-4dd4-89de-8125dd7a14de tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] 10.222.0.52 "GET /compute/v2.1/servers/64b50337-325c-4476-9bd1-e38839e22294" status: 200 len: 1318 microversion: 2.1 time: 0.615102 Oct 19 03:34:16.452499 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-692b2824-3539-40c5-a992-4f52788eb68c req-4a6cfd83-8bcd-4dc7-bc4c-0543182129e0 service nova] Creating event network-vif-plugged:ff734670-1945-4d93-8bf4-917b29792466 for instance 64b50337-325c-4476-9bd1-e38839e22294 on n-h2-861333-8 Oct 19 03:34:16.454743 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2374/4658] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:34:15 2022] GET /compute/v2.1/servers/64b50337-325c-4476-9bd1-e38839e22294 => generated 1318 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:34:16.462315 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-692b2824-3539-40c5-a992-4f52788eb68c req-4a6cfd83-8bcd-4dc7-bc4c-0543182129e0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051463 Oct 19 03:34:16.463238 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2285/4659] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:34:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:34:16.469305 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-789e54e6-2850-4c0e-975f-6d946e3f13f1 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:34:16.469950 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-789e54e6-2850-4c0e-975f-6d946e3f13f1 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] [instance: 2255727d-7de0-44dc-a021-8dd243cbda1f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:34:16.480369 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-789e54e6-2850-4c0e-975f-6d946e3f13f1 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:16.481116 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-789e54e6-2850-4c0e-975f-6d946e3f13f1 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:16.481773 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-789e54e6-2850-4c0e-975f-6d946e3f13f1 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:16.482684 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-789e54e6-2850-4c0e-975f-6d946e3f13f1 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:16.483523 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-789e54e6-2850-4c0e-975f-6d946e3f13f1 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:16.484940 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-789e54e6-2850-4c0e-975f-6d946e3f13f1 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:16.858160 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-789e54e6-2850-4c0e-975f-6d946e3f13f1 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb40699ae023477da8f0ae2265d5585f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8086dde9fecd4c38bd214e7e87e899eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:34:16.875255 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-789e54e6-2850-4c0e-975f-6d946e3f13f1 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] 10.222.0.52 "GET /compute/v2.1/servers/2255727d-7de0-44dc-a021-8dd243cbda1f" status: 200 len: 1502 microversion: 2.1 time: 0.418368 Oct 19 03:34:16.876153 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2375/4660] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:34:16 2022] GET /compute/v2.1/servers/2255727d-7de0-44dc-a021-8dd243cbda1f => generated 1502 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:34:16.907279 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a2c9dedb-4494-4d4d-857a-d5acbe345dd6 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:34:16.908676 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a2c9dedb-4494-4d4d-857a-d5acbe345dd6 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] [instance: 2255727d-7de0-44dc-a021-8dd243cbda1f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:34:16.917245 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a2c9dedb-4494-4d4d-857a-d5acbe345dd6 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:16.918058 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a2c9dedb-4494-4d4d-857a-d5acbe345dd6 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:16.918796 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a2c9dedb-4494-4d4d-857a-d5acbe345dd6 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:16.919662 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a2c9dedb-4494-4d4d-857a-d5acbe345dd6 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:16.920321 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a2c9dedb-4494-4d4d-857a-d5acbe345dd6 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:16.920933 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a2c9dedb-4494-4d4d-857a-d5acbe345dd6 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:16.954398 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a2c9dedb-4494-4d4d-857a-d5acbe345dd6 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] [instance: 2255727d-7de0-44dc-a021-8dd243cbda1f] Going to try to terminate instance {{(pid=121134) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:34:17.394769 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a2c9dedb-4494-4d4d-857a-d5acbe345dd6 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] 10.222.0.52 "DELETE /compute/v2.1/servers/2255727d-7de0-44dc-a021-8dd243cbda1f" status: 204 len: 0 microversion: 2.1 time: 0.493592 Oct 19 03:34:17.399578 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2286/4661] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:34:16 2022] DELETE /compute/v2.1/servers/2255727d-7de0-44dc-a021-8dd243cbda1f => generated 0 bytes in 497 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:34:17.410512 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-29d095f3-c218-4acc-bc4e-bde85c783cf1 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:34:17.411868 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-29d095f3-c218-4acc-bc4e-bde85c783cf1 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] [instance: 2255727d-7de0-44dc-a021-8dd243cbda1f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:34:17.422531 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-29d095f3-c218-4acc-bc4e-bde85c783cf1 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:17.427059 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-29d095f3-c218-4acc-bc4e-bde85c783cf1 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:17.427767 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-29d095f3-c218-4acc-bc4e-bde85c783cf1 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:17.428750 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-29d095f3-c218-4acc-bc4e-bde85c783cf1 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:17.432833 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-29d095f3-c218-4acc-bc4e-bde85c783cf1 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:17.436555 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-29d095f3-c218-4acc-bc4e-bde85c783cf1 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:17.441072 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3005dbde-455e-450b-bc98-3f19c479a37c tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:34:17.442371 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3005dbde-455e-450b-bc98-3f19c479a37c tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] [instance: 29a2d62a-83d9-43e2-8907-f4158500d83f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:34:17.460223 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3005dbde-455e-450b-bc98-3f19c479a37c tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:17.461091 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3005dbde-455e-450b-bc98-3f19c479a37c tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:17.461750 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3005dbde-455e-450b-bc98-3f19c479a37c tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:17.462664 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3005dbde-455e-450b-bc98-3f19c479a37c tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:17.466851 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3005dbde-455e-450b-bc98-3f19c479a37c tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:17.467827 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3005dbde-455e-450b-bc98-3f19c479a37c tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:17.480912 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=100 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:34:17.876261 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-3005dbde-455e-450b-bc98-3f19c479a37c tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33d07a7db4846ababf001493c6e10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb0265509744c93b03fa5c28b4e9386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:34:17.886854 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3005dbde-455e-450b-bc98-3f19c479a37c tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] 10.222.0.52 "GET /compute/v2.1/servers/29a2d62a-83d9-43e2-8907-f4158500d83f" status: 200 len: 1507 microversion: 2.1 time: 0.454308 Oct 19 03:34:17.888453 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2287/4662] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:34:17 2022] GET /compute/v2.1/servers/29a2d62a-83d9-43e2-8907-f4158500d83f => generated 1507 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:34:17.894750 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-154a8764-d955-4e7d-a350-241e91225892 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:34:17.895625 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-154a8764-d955-4e7d-a350-241e91225892 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] [instance: 64b50337-325c-4476-9bd1-e38839e22294] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:34:17.906366 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-154a8764-d955-4e7d-a350-241e91225892 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:17.907131 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-154a8764-d955-4e7d-a350-241e91225892 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:17.907750 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-154a8764-d955-4e7d-a350-241e91225892 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:17.909967 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-154a8764-d955-4e7d-a350-241e91225892 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:17.910584 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-154a8764-d955-4e7d-a350-241e91225892 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:17.911263 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-154a8764-d955-4e7d-a350-241e91225892 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:17.971628 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-29d095f3-c218-4acc-bc4e-bde85c783cf1 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb40699ae023477da8f0ae2265d5585f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8086dde9fecd4c38bd214e7e87e899eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:34:17.983540 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-29d095f3-c218-4acc-bc4e-bde85c783cf1 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] 10.222.0.52 "GET /compute/v2.1/servers/2255727d-7de0-44dc-a021-8dd243cbda1f" status: 200 len: 1508 microversion: 2.1 time: 0.581919 Oct 19 03:34:18.000251 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2376/4663] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:34:17 2022] GET /compute/v2.1/servers/2255727d-7de0-44dc-a021-8dd243cbda1f => generated 1508 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:34:18.251981 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-154a8764-d955-4e7d-a350-241e91225892 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f3337e3ea74d868d2072683e44d472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baf68030f15244c79a0d83ab3f3727ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:34:18.262839 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-154a8764-d955-4e7d-a350-241e91225892 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] 10.222.0.52 "GET /compute/v2.1/servers/64b50337-325c-4476-9bd1-e38839e22294" status: 200 len: 1318 microversion: 2.1 time: 0.373114 Oct 19 03:34:18.263913 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2288/4664] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:34:17 2022] GET /compute/v2.1/servers/64b50337-325c-4476-9bd1-e38839e22294 => generated 1318 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:34:18.491174 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-be979150-4dda-4872-bda5-bc71d7a6b2c8 req-b677bc10-a2d5-46c4-ba9b-426b0a9f0058 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3180914-6014-4e72-9b03-a03f52de0145", "name": "network-vif-plugged", "status": "completed", "tag": "12a02252-cdd6-49f6-b787-bab713b86ba2"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:34:18.503355 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-be979150-4dda-4872-bda5-bc71d7a6b2c8 req-b677bc10-a2d5-46c4-ba9b-426b0a9f0058 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:18.504238 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-be979150-4dda-4872-bda5-bc71d7a6b2c8 req-b677bc10-a2d5-46c4-ba9b-426b0a9f0058 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:18.504886 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-be979150-4dda-4872-bda5-bc71d7a6b2c8 req-b677bc10-a2d5-46c4-ba9b-426b0a9f0058 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:18.518289 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-be979150-4dda-4872-bda5-bc71d7a6b2c8 req-b677bc10-a2d5-46c4-ba9b-426b0a9f0058 service nova] Creating event network-vif-plugged:12a02252-cdd6-49f6-b787-bab713b86ba2 for instance b3180914-6014-4e72-9b03-a03f52de0145 on n-h1-861333-8 Oct 19 03:34:18.524675 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-be979150-4dda-4872-bda5-bc71d7a6b2c8 req-b677bc10-a2d5-46c4-ba9b-426b0a9f0058 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038423 Oct 19 03:34:18.526604 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2377/4665] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:34:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:34:18.914519 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9566d01f-6652-47d3-8575-82a06b20e8fb tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:34:18.915141 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9566d01f-6652-47d3-8575-82a06b20e8fb tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] [instance: 29a2d62a-83d9-43e2-8907-f4158500d83f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:34:18.928404 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9566d01f-6652-47d3-8575-82a06b20e8fb tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:18.932414 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9566d01f-6652-47d3-8575-82a06b20e8fb tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:18.932414 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9566d01f-6652-47d3-8575-82a06b20e8fb tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:18.932414 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9566d01f-6652-47d3-8575-82a06b20e8fb tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:18.932414 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9566d01f-6652-47d3-8575-82a06b20e8fb tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:18.932414 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9566d01f-6652-47d3-8575-82a06b20e8fb tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:19.015600 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-df20c707-fd1b-4b5d-acda-9c5e952da602 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:34:19.016703 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-df20c707-fd1b-4b5d-acda-9c5e952da602 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] [instance: 2255727d-7de0-44dc-a021-8dd243cbda1f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:34:19.025452 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-df20c707-fd1b-4b5d-acda-9c5e952da602 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:19.026854 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-df20c707-fd1b-4b5d-acda-9c5e952da602 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:19.034962 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-df20c707-fd1b-4b5d-acda-9c5e952da602 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:19.036299 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-df20c707-fd1b-4b5d-acda-9c5e952da602 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:19.037034 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-df20c707-fd1b-4b5d-acda-9c5e952da602 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:19.038150 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-df20c707-fd1b-4b5d-acda-9c5e952da602 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:19.933975 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9566d01f-6652-47d3-8575-82a06b20e8fb tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33d07a7db4846ababf001493c6e10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb0265509744c93b03fa5c28b4e9386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:34:19.954038 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9566d01f-6652-47d3-8575-82a06b20e8fb tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] 10.222.0.52 "GET /compute/v2.1/servers/29a2d62a-83d9-43e2-8907-f4158500d83f" status: 200 len: 1507 microversion: 2.1 time: 1.038778 Oct 19 03:34:19.975933 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2289/4666] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:34:18 2022] GET /compute/v2.1/servers/29a2d62a-83d9-43e2-8907-f4158500d83f => generated 1507 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:34:19.987199 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ff313e5a-8b53-4677-a29e-4d6dfcb7361a tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:34:19.987841 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ff313e5a-8b53-4677-a29e-4d6dfcb7361a tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] [instance: 64b50337-325c-4476-9bd1-e38839e22294] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:34:19.995884 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ff313e5a-8b53-4677-a29e-4d6dfcb7361a tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:19.996460 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ff313e5a-8b53-4677-a29e-4d6dfcb7361a tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:19.996905 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ff313e5a-8b53-4677-a29e-4d6dfcb7361a tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:19.997790 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ff313e5a-8b53-4677-a29e-4d6dfcb7361a tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:19.998469 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ff313e5a-8b53-4677-a29e-4d6dfcb7361a tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:19.999553 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ff313e5a-8b53-4677-a29e-4d6dfcb7361a tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:20.022539 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:34:20.209832 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-df20c707-fd1b-4b5d-acda-9c5e952da602 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb40699ae023477da8f0ae2265d5585f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8086dde9fecd4c38bd214e7e87e899eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:34:20.230091 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-df20c707-fd1b-4b5d-acda-9c5e952da602 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] 10.222.0.52 "GET /compute/v2.1/servers/2255727d-7de0-44dc-a021-8dd243cbda1f" status: 200 len: 1508 microversion: 2.1 time: 1.221985 Oct 19 03:34:20.230942 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2378/4667] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:34:19 2022] GET /compute/v2.1/servers/2255727d-7de0-44dc-a021-8dd243cbda1f => generated 1508 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:34:20.615642 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ff313e5a-8b53-4677-a29e-4d6dfcb7361a tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f3337e3ea74d868d2072683e44d472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baf68030f15244c79a0d83ab3f3727ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:34:20.625131 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ff313e5a-8b53-4677-a29e-4d6dfcb7361a tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] 10.222.0.52 "GET /compute/v2.1/servers/64b50337-325c-4476-9bd1-e38839e22294" status: 200 len: 1505 microversion: 2.1 time: 0.646357 Oct 19 03:34:20.629118 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2290/4668] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:34:19 2022] GET /compute/v2.1/servers/64b50337-325c-4476-9bd1-e38839e22294 => generated 1505 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:34:20.648666 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5196a865-f4f2-4df1-a8e3-1d508c156086 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:34:20.649307 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-5196a865-f4f2-4df1-a8e3-1d508c156086 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] [instance: b3180914-6014-4e72-9b03-a03f52de0145] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:34:20.672211 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5196a865-f4f2-4df1-a8e3-1d508c156086 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:20.680654 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5196a865-f4f2-4df1-a8e3-1d508c156086 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:20.681401 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5196a865-f4f2-4df1-a8e3-1d508c156086 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:20.682444 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5196a865-f4f2-4df1-a8e3-1d508c156086 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:20.683101 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5196a865-f4f2-4df1-a8e3-1d508c156086 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:20.683811 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5196a865-f4f2-4df1-a8e3-1d508c156086 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:20.975530 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b3391ffe-eb2c-40bb-b8df-568870535887 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:34:20.976157 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b3391ffe-eb2c-40bb-b8df-568870535887 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] [instance: 29a2d62a-83d9-43e2-8907-f4158500d83f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:34:20.991873 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b3391ffe-eb2c-40bb-b8df-568870535887 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:20.992553 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b3391ffe-eb2c-40bb-b8df-568870535887 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:20.993078 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b3391ffe-eb2c-40bb-b8df-568870535887 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:20.996678 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b3391ffe-eb2c-40bb-b8df-568870535887 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:20.997274 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b3391ffe-eb2c-40bb-b8df-568870535887 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:20.997827 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b3391ffe-eb2c-40bb-b8df-568870535887 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:21.838872 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-5196a865-f4f2-4df1-a8e3-1d508c156086 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f3337e3ea74d868d2072683e44d472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baf68030f15244c79a0d83ab3f3727ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:34:21.851505 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5196a865-f4f2-4df1-a8e3-1d508c156086 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] 10.222.0.52 "GET /compute/v2.1/servers/b3180914-6014-4e72-9b03-a03f52de0145" status: 200 len: 1318 microversion: 2.1 time: 1.206691 Oct 19 03:34:21.852544 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b3391ffe-eb2c-40bb-b8df-568870535887 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33d07a7db4846ababf001493c6e10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb0265509744c93b03fa5c28b4e9386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:34:21.853284 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2379/4669] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:34:20 2022] GET /compute/v2.1/servers/b3180914-6014-4e72-9b03-a03f52de0145 => generated 1318 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:34:21.868640 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-cefe42e2-e19f-493f-96f7-2f40347ff5cb tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:34:21.868640 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-cefe42e2-e19f-493f-96f7-2f40347ff5cb tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] [instance: 2255727d-7de0-44dc-a021-8dd243cbda1f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:34:21.886802 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b3391ffe-eb2c-40bb-b8df-568870535887 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] 10.222.0.52 "GET /compute/v2.1/servers/29a2d62a-83d9-43e2-8907-f4158500d83f" status: 200 len: 1507 microversion: 2.1 time: 0.915967 Oct 19 03:34:21.888214 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2291/4670] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:34:20 2022] GET /compute/v2.1/servers/29a2d62a-83d9-43e2-8907-f4158500d83f => generated 1507 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:34:21.893781 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-0f7494b0-b301-4e47-8c5a-a760d748ec93 req-1c79751e-f325-4c02-a217-3ecfb7cd86d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2255727d-7de0-44dc-a021-8dd243cbda1f", "name": "network-vif-deleted", "tag": "1b963f9b-831e-4714-b27c-8913c5b34548"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:34:21.919006 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cefe42e2-e19f-493f-96f7-2f40347ff5cb tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:21.919006 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cefe42e2-e19f-493f-96f7-2f40347ff5cb tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:21.919006 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cefe42e2-e19f-493f-96f7-2f40347ff5cb tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:21.919006 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cefe42e2-e19f-493f-96f7-2f40347ff5cb tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:21.919006 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cefe42e2-e19f-493f-96f7-2f40347ff5cb tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:21.919006 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cefe42e2-e19f-493f-96f7-2f40347ff5cb tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:21.919842 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-0f7494b0-b301-4e47-8c5a-a760d748ec93 req-1c79751e-f325-4c02-a217-3ecfb7cd86d7 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:21.926456 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-0f7494b0-b301-4e47-8c5a-a760d748ec93 req-1c79751e-f325-4c02-a217-3ecfb7cd86d7 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:21.927123 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-0f7494b0-b301-4e47-8c5a-a760d748ec93 req-1c79751e-f325-4c02-a217-3ecfb7cd86d7 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:21.961268 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-0f7494b0-b301-4e47-8c5a-a760d748ec93 req-1c79751e-f325-4c02-a217-3ecfb7cd86d7 service nova] Creating event network-vif-deleted:1b963f9b-831e-4714-b27c-8913c5b34548 for instance 2255727d-7de0-44dc-a021-8dd243cbda1f on n-h1-861333-8 Oct 19 03:34:21.974586 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-0f7494b0-b301-4e47-8c5a-a760d748ec93 req-1c79751e-f325-4c02-a217-3ecfb7cd86d7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084277 Oct 19 03:34:21.975956 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2292/4671] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:34:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:34:22.153022 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-cefe42e2-e19f-493f-96f7-2f40347ff5cb tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb40699ae023477da8f0ae2265d5585f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8086dde9fecd4c38bd214e7e87e899eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:34:22.165090 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-cefe42e2-e19f-493f-96f7-2f40347ff5cb tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] 10.222.0.52 "GET /compute/v2.1/servers/2255727d-7de0-44dc-a021-8dd243cbda1f" status: 200 len: 1466 microversion: 2.1 time: 0.305967 Oct 19 03:34:22.180262 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2380/4672] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:34:21 2022] GET /compute/v2.1/servers/2255727d-7de0-44dc-a021-8dd243cbda1f => generated 1466 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:34:22.787857 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-342013e1-a425-4a21-ad42-d2c80d5bb3b4 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Action: 'create', calling method: .version_select at 0x7fc130c1f550>, body: {"keypair": {"name": "tempest-keypair-1486848484", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIzwwhfTnPQv8X/eAw7CzHSwQv4kWv0srkZ4kDaIKbPuFZGuf7kj0/4NKTeOgDbwJZJPISW+8cX/if5beuPw0yEUy9GKoqpN7r8MtqSBOF7RQIRf9zWXQm2VM0grrziOnQ=="}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:34:22.807563 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-342013e1-a425-4a21-ad42-d2c80d5bb3b4 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Getting quotas for project fa4001edd1474947a94243a620a6013a. Resources: {'key_pairs'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:34:22.817681 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-342013e1-a425-4a21-ad42-d2c80d5bb3b4 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Getting quotas for user 4c65a497e16e4e41b5cf1287042f3a68 and project fa4001edd1474947a94243a620a6013a. Resources: {'key_pairs'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:34:22.882245 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6accf153-2c5f-412d-8736-c8592ae79d8e tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:34:22.883493 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6accf153-2c5f-412d-8736-c8592ae79d8e tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] [instance: b3180914-6014-4e72-9b03-a03f52de0145] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:34:22.902562 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6accf153-2c5f-412d-8736-c8592ae79d8e tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:22.903249 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6accf153-2c5f-412d-8736-c8592ae79d8e tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:22.903854 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6accf153-2c5f-412d-8736-c8592ae79d8e tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:22.904758 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6accf153-2c5f-412d-8736-c8592ae79d8e tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:22.905395 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6accf153-2c5f-412d-8736-c8592ae79d8e tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:22.906057 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6accf153-2c5f-412d-8736-c8592ae79d8e tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:22.963340 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-342013e1-a425-4a21-ad42-d2c80d5bb3b4 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.357391 Oct 19 03:34:22.971117 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2293/4673] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Oct 19 03:34:22 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:34:22.986996 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f29e6933-ddfd-4606-942a-05a98c49f27f tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:34:22.988642 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f29e6933-ddfd-4606-942a-05a98c49f27f tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] [instance: 29a2d62a-83d9-43e2-8907-f4158500d83f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:34:23.004477 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f29e6933-ddfd-4606-942a-05a98c49f27f tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:23.005201 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f29e6933-ddfd-4606-942a-05a98c49f27f tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:23.005817 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f29e6933-ddfd-4606-942a-05a98c49f27f tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:23.011223 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f29e6933-ddfd-4606-942a-05a98c49f27f tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:23.011223 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f29e6933-ddfd-4606-942a-05a98c49f27f tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:23.011223 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f29e6933-ddfd-4606-942a-05a98c49f27f tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:23.459735 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-f29e6933-ddfd-4606-942a-05a98c49f27f tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33d07a7db4846ababf001493c6e10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb0265509744c93b03fa5c28b4e9386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:34:23.473916 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f29e6933-ddfd-4606-942a-05a98c49f27f tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] 10.222.0.52 "GET /compute/v2.1/servers/29a2d62a-83d9-43e2-8907-f4158500d83f" status: 200 len: 1507 microversion: 2.1 time: 0.500945 Oct 19 03:34:23.474580 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2294/4674] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:34:22 2022] GET /compute/v2.1/servers/29a2d62a-83d9-43e2-8907-f4158500d83f => generated 1507 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:34:23.496584 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2a3f9efc-6dca-4ac2-8380-bf4ce020779e tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:34:23.497559 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2a3f9efc-6dca-4ac2-8380-bf4ce020779e tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] [instance: 2255727d-7de0-44dc-a021-8dd243cbda1f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:34:23.505286 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-6accf153-2c5f-412d-8736-c8592ae79d8e tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f3337e3ea74d868d2072683e44d472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baf68030f15244c79a0d83ab3f3727ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:34:23.515641 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6accf153-2c5f-412d-8736-c8592ae79d8e tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] 10.222.0.52 "GET /compute/v2.1/servers/b3180914-6014-4e72-9b03-a03f52de0145" status: 200 len: 1506 microversion: 2.1 time: 0.637604 Oct 19 03:34:23.521123 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2381/4675] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:34:22 2022] GET /compute/v2.1/servers/b3180914-6014-4e72-9b03-a03f52de0145 => generated 1506 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:34:23.529176 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2a3f9efc-6dca-4ac2-8380-bf4ce020779e tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:23.532400 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2a3f9efc-6dca-4ac2-8380-bf4ce020779e tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:23.533710 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2a3f9efc-6dca-4ac2-8380-bf4ce020779e tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:23.534671 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2a3f9efc-6dca-4ac2-8380-bf4ce020779e tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:23.537967 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2a3f9efc-6dca-4ac2-8380-bf4ce020779e tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:23.539209 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2a3f9efc-6dca-4ac2-8380-bf4ce020779e tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:23.557195 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0c405c67-aaf0-45de-a8b9-aaeb1d5d05f9 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:34:23.557732 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0c405c67-aaf0-45de-a8b9-aaeb1d5d05f9 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] [instance: b3180914-6014-4e72-9b03-a03f52de0145] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:34:23.567688 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0c405c67-aaf0-45de-a8b9-aaeb1d5d05f9 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:23.569127 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0c405c67-aaf0-45de-a8b9-aaeb1d5d05f9 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:23.570591 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0c405c67-aaf0-45de-a8b9-aaeb1d5d05f9 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:23.571968 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0c405c67-aaf0-45de-a8b9-aaeb1d5d05f9 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:23.572630 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0c405c67-aaf0-45de-a8b9-aaeb1d5d05f9 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:23.573533 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0c405c67-aaf0-45de-a8b9-aaeb1d5d05f9 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:23.585649 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-2a3f9efc-6dca-4ac2-8380-bf4ce020779e tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] HTTP exception thrown: Instance 2255727d-7de0-44dc-a021-8dd243cbda1f could not be found. Oct 19 03:34:23.585649 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2a3f9efc-6dca-4ac2-8380-bf4ce020779e tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Request method failure captured: Oct 19 03:34:23.585649 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/2255727d-7de0-44dc-a021-8dd243cbda1f HTTP/1.1 Oct 19 03:34:23.585649 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:34:23.585649 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:34:23.585649 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:34:23.585649 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:34:23.585649 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:34:23.585649 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:34:23.585649 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:34:23.585649 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:34:23.585649 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3AewzG0MImyDGMJpr6iLU6_b2sjKr8OB3itIqxnUZNAcDXOx9YIIqaUE4fMgcaubxtbATg-dx4rew2UvYwLvg7QPyNzfQrYYOclN55jkzx3W-72FK4PEb1EVzlxV7uWSUMWOCMPEnVi4jNlpDC7b6bjmnQu_hlPphbB0VqQjFrmSAM Oct 19 03:34:23.585649 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:34:23.585649 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:34:23.585649 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:34:23.585649 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:34:23.585649 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:34:23.585649 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:34:23.585649 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 8086dde9fecd4c38bd214e7e87e899eb Oct 19 03:34:23.585649 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ImagesNegativeTestJSON-1001016267 Oct 19 03:34:23.585649 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:34:23.585649 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:34:23.585649 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8086dde9fecd4c38bd214e7e87e899eb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8086dde9fecd4c38bd214e7e87e899eb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8086dde9fecd4c38bd214e7e87e899eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8086dde9fecd4c38bd214e7e87e899eb", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:34:23.585649 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ImagesNegativeTestJSON-1001016267 Oct 19 03:34:23.585649 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 8086dde9fecd4c38bd214e7e87e899eb Oct 19 03:34:23.585649 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1001016267 Oct 19 03:34:23.585649 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ImagesNegativeTestJSON-1001016267-project Oct 19 03:34:23.585649 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:34:23.585649 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:34:23.585649 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: bb40699ae023477da8f0ae2265d5585f Oct 19 03:34:23.585649 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ImagesNegativeTestJSON-1001016267-project Oct 19 03:34:23.585649 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:34:23.585649 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance 2255727d-7de0-44dc-a021-8dd243cbda1f could not be found. Oct 19 03:34:23.585649 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '2255727d-7de0-44dc-a021-8dd243cbda1f'} Oct 19 03:34:23.585649 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:34:23.585649 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:34:23.585649 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:34:23.585649 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:34:23.585649 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:34:23.585649 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:34:23.585649 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:34:23.585649 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:34:23.585649 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:34:23.585649 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:34:23.585649 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2255727d-7de0-44dc-a021-8dd243cbda1f could not be found. Oct 19 03:34:23.585649 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:34:23.585649 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:34:23.585649 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:34:23.585649 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:34:23.585649 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:34:23.585649 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:34:23.585649 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:34:23.585649 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:34:23.585649 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:34:23.585649 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:34:23.585649 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:34:23.585649 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:34:23.585649 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:34:23.585649 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:34:23.585649 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:34:23.585649 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:34:23.590403 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2255727d-7de0-44dc-a021-8dd243cbda1f could not be found. Oct 19 03:34:23.590403 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:34:23.590403 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:34:23.590403 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:34:23.590403 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:34:23.590403 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:34:23.590403 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:34:23.590403 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:34:23.590403 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:34:23.590403 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2255727d-7de0-44dc-a021-8dd243cbda1f could not be found. Oct 19 03:34:23.590403 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:34:23.590403 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2a3f9efc-6dca-4ac2-8380-bf4ce020779e tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Returning 404 to user: Instance 2255727d-7de0-44dc-a021-8dd243cbda1f could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:34:23.592038 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2a3f9efc-6dca-4ac2-8380-bf4ce020779e tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] 10.222.0.52 "GET /compute/v2.1/servers/2255727d-7de0-44dc-a021-8dd243cbda1f" status: 404 len: 111 microversion: 2.1 time: 0.101557 Oct 19 03:34:23.596186 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2295/4676] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:34:23 2022] GET /compute/v2.1/servers/2255727d-7de0-44dc-a021-8dd243cbda1f => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:34:23.612883 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0ca79747-5a4d-44ed-a4bb-d018705eb40e tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1635012062", "metadata": {"image_type": "test"}}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:34:23.613593 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0c405c67-aaf0-45de-a8b9-aaeb1d5d05f9 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] [instance: b3180914-6014-4e72-9b03-a03f52de0145] Going to try to terminate instance {{(pid=121135) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:34:23.616168 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0ca79747-5a4d-44ed-a4bb-d018705eb40e tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] [instance: 2255727d-7de0-44dc-a021-8dd243cbda1f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:34:23.643049 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0ca79747-5a4d-44ed-a4bb-d018705eb40e tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:23.660400 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0ca79747-5a4d-44ed-a4bb-d018705eb40e tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:23.660400 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0ca79747-5a4d-44ed-a4bb-d018705eb40e tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:23.660400 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0ca79747-5a4d-44ed-a4bb-d018705eb40e tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:23.660400 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0ca79747-5a4d-44ed-a4bb-d018705eb40e tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:23.660400 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0ca79747-5a4d-44ed-a4bb-d018705eb40e tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:23.666096 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-0ca79747-5a4d-44ed-a4bb-d018705eb40e tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] HTTP exception thrown: Instance 2255727d-7de0-44dc-a021-8dd243cbda1f could not be found. Oct 19 03:34:23.668114 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0ca79747-5a4d-44ed-a4bb-d018705eb40e tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Request method failure captured: Oct 19 03:34:23.668114 n-d-861333-8 devstack@n-api.service[121134]: request: POST /compute/v2.1/servers/2255727d-7de0-44dc-a021-8dd243cbda1f/action HTTP/1.1 Oct 19 03:34:23.668114 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:34:23.668114 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:34:23.668114 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:34:23.668114 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 112 Oct 19 03:34:23.668114 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:34:23.668114 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:34:23.668114 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:34:23.668114 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:34:23.668114 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3AewzG0MImyDGMJpr6iLU6_b2sjKr8OB3itIqxnUZNAcDXOx9YIIqaUE4fMgcaubxtbATg-dx4rew2UvYwLvg7QPyNzfQrYYOclN55jkzx3W-72FK4PEb1EVzlxV7uWSUMWOCMPEnVi4jNlpDC7b6bjmnQu_hlPphbB0VqQjFrmSAM Oct 19 03:34:23.668114 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:34:23.668114 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:34:23.668114 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:34:23.668114 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:34:23.668114 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:34:23.668114 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:34:23.668114 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 8086dde9fecd4c38bd214e7e87e899eb Oct 19 03:34:23.668114 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ImagesNegativeTestJSON-1001016267 Oct 19 03:34:23.668114 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:34:23.668114 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:34:23.668114 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8086dde9fecd4c38bd214e7e87e899eb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8086dde9fecd4c38bd214e7e87e899eb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8086dde9fecd4c38bd214e7e87e899eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8086dde9fecd4c38bd214e7e87e899eb", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:34:23.668114 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ImagesNegativeTestJSON-1001016267 Oct 19 03:34:23.668114 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 8086dde9fecd4c38bd214e7e87e899eb Oct 19 03:34:23.668114 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1001016267 Oct 19 03:34:23.668114 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ImagesNegativeTestJSON-1001016267-project Oct 19 03:34:23.668114 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:34:23.668114 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:34:23.668114 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: bb40699ae023477da8f0ae2265d5585f Oct 19 03:34:23.668114 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ImagesNegativeTestJSON-1001016267-project Oct 19 03:34:23.668114 n-d-861333-8 devstack@n-api.service[121134]: Oct 19 03:34:23.668114 n-d-861333-8 devstack@n-api.service[121134]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1635012062", "metadata": {"image_type": "test"}}} Oct 19 03:34:23.668114 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:34:23.668114 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance 2255727d-7de0-44dc-a021-8dd243cbda1f could not be found. Oct 19 03:34:23.668114 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '2255727d-7de0-44dc-a021-8dd243cbda1f', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1635012062', 'metadata': {'image_type': 'test'}}}} Oct 19 03:34:23.668114 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:34:23.668114 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:34:23.668114 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:34:23.668114 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:34:23.668114 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:34:23.668114 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:34:23.668114 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:34:23.668114 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:34:23.668114 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:34:23.668114 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:34:23.668114 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2255727d-7de0-44dc-a021-8dd243cbda1f could not be found. Oct 19 03:34:23.668114 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:34:23.668114 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:34:23.668114 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:34:23.668114 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:34:23.668114 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:34:23.668114 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:34:23.668114 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:34:23.668114 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:34:23.668114 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:34:23.668114 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:34:23.668114 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:34:23.668114 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:34:23.668114 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:34:23.668114 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:34:23.668114 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 19 03:34:23.668114 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 19 03:34:23.672084 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:34:23.672084 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:34:23.672084 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:34:23.672084 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:34:23.672084 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2255727d-7de0-44dc-a021-8dd243cbda1f could not be found. Oct 19 03:34:23.672084 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:34:23.672084 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:34:23.672084 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:34:23.672084 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:34:23.672084 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:34:23.672084 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:34:23.672084 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:34:23.672084 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:34:23.672084 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2255727d-7de0-44dc-a021-8dd243cbda1f could not be found. Oct 19 03:34:23.672084 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:34:23.672084 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0ca79747-5a4d-44ed-a4bb-d018705eb40e tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Returning 404 to user: Instance 2255727d-7de0-44dc-a021-8dd243cbda1f could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:34:23.672084 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0ca79747-5a4d-44ed-a4bb-d018705eb40e tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] 10.222.0.52 "POST /compute/v2.1/servers/2255727d-7de0-44dc-a021-8dd243cbda1f/action" status: 404 len: 111 microversion: 2.1 time: 0.067367 Oct 19 03:34:23.672084 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2296/4677] 10.222.0.52 () {60 vars in 1279 bytes} [Wed Oct 19 03:34:23 2022] POST /compute/v2.1/servers/2255727d-7de0-44dc-a021-8dd243cbda1f/action => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 03:34:23.689401 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-201981e2-b61d-4f3d-8434-cb9843ce8c56 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-2041285206", "metadata": {"image_type": "test"}}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:34:23.697394 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-201981e2-b61d-4f3d-8434-cb9843ce8c56 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Failed to fetch instance by id tempest-invalid-1648772066 {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 19 03:34:23.699450 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-201981e2-b61d-4f3d-8434-cb9843ce8c56 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] HTTP exception thrown: Instance tempest-invalid-1648772066 could not be found. Oct 19 03:34:23.702567 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-201981e2-b61d-4f3d-8434-cb9843ce8c56 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Request method failure captured: Oct 19 03:34:23.702567 n-d-861333-8 devstack@n-api.service[121134]: request: POST /compute/v2.1/servers/tempest-invalid-1648772066/action HTTP/1.1 Oct 19 03:34:23.702567 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:34:23.702567 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:34:23.702567 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:34:23.702567 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 112 Oct 19 03:34:23.702567 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:34:23.702567 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:34:23.702567 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:34:23.702567 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:34:23.702567 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3AewzG0MImyDGMJpr6iLU6_b2sjKr8OB3itIqxnUZNAcDXOx9YIIqaUE4fMgcaubxtbATg-dx4rew2UvYwLvg7QPyNzfQrYYOclN55jkzx3W-72FK4PEb1EVzlxV7uWSUMWOCMPEnVi4jNlpDC7b6bjmnQu_hlPphbB0VqQjFrmSAM Oct 19 03:34:23.702567 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:34:23.702567 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:34:23.702567 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:34:23.702567 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:34:23.702567 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:34:23.702567 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:34:23.702567 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 8086dde9fecd4c38bd214e7e87e899eb Oct 19 03:34:23.702567 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ImagesNegativeTestJSON-1001016267 Oct 19 03:34:23.702567 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:34:23.702567 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:34:23.702567 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8086dde9fecd4c38bd214e7e87e899eb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8086dde9fecd4c38bd214e7e87e899eb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8086dde9fecd4c38bd214e7e87e899eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8086dde9fecd4c38bd214e7e87e899eb", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:34:23.702567 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ImagesNegativeTestJSON-1001016267 Oct 19 03:34:23.702567 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 8086dde9fecd4c38bd214e7e87e899eb Oct 19 03:34:23.702567 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1001016267 Oct 19 03:34:23.702567 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ImagesNegativeTestJSON-1001016267-project Oct 19 03:34:23.702567 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:34:23.702567 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:34:23.702567 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: bb40699ae023477da8f0ae2265d5585f Oct 19 03:34:23.702567 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ImagesNegativeTestJSON-1001016267-project Oct 19 03:34:23.702567 n-d-861333-8 devstack@n-api.service[121134]: Oct 19 03:34:23.702567 n-d-861333-8 devstack@n-api.service[121134]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-2041285206", "metadata": {"image_type": "test"}}} Oct 19 03:34:23.702567 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:34:23.702567 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance tempest-invalid-1648772066 could not be found. Oct 19 03:34:23.702567 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': 'tempest-invalid-1648772066', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-2041285206', 'metadata': {'image_type': 'test'}}}} Oct 19 03:34:23.702567 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:34:23.702567 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:34:23.702567 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:34:23.702567 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:34:23.702567 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 19 03:34:23.702567 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 19 03:34:23.702567 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-1648772066 could not be found. Oct 19 03:34:23.702567 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:34:23.702567 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:34:23.702567 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:34:23.702567 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:34:23.702567 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:34:23.702567 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:34:23.702567 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:34:23.702567 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:34:23.702567 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:34:23.702567 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:34:23.702567 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:34:23.702567 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:34:23.702567 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:34:23.702567 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:34:23.702567 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 19 03:34:23.702567 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 19 03:34:23.702567 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:34:23.702567 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:34:23.702567 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:34:23.702567 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:34:23.702567 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-1648772066 could not be found. Oct 19 03:34:23.718922 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:34:23.718922 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:34:23.718922 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:34:23.718922 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:34:23.718922 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:34:23.718922 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:34:23.718922 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:34:23.718922 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:34:23.718922 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-1648772066 could not be found. Oct 19 03:34:23.718922 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:34:23.718922 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-201981e2-b61d-4f3d-8434-cb9843ce8c56 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Returning 404 to user: Instance tempest-invalid-1648772066 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:34:23.718922 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-201981e2-b61d-4f3d-8434-cb9843ce8c56 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] 10.222.0.52 "POST /compute/v2.1/servers/tempest-invalid-1648772066/action" status: 404 len: 101 microversion: 2.1 time: 0.034348 Oct 19 03:34:23.718922 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2297/4678] 10.222.0.52 () {60 vars in 1249 bytes} [Wed Oct 19 03:34:23 2022] POST /compute/v2.1/servers/tempest-invalid-1648772066/action => generated 101 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:34:23.727588 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-343e2a33-a46a-47d9-afc1-ae29e3d32428 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-862391655"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:34:23.731088 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-343e2a33-a46a-47d9-afc1-ae29e3d32428 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 19 03:34:23.731624 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-343e2a33-a46a-47d9-afc1-ae29e3d32428 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 19 03:34:23.733199 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-343e2a33-a46a-47d9-afc1-ae29e3d32428 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Request method failure captured: Oct 19 03:34:23.733199 n-d-861333-8 devstack@n-api.service[121134]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 19 03:34:23.733199 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:34:23.733199 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:34:23.733199 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:34:23.733199 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 56 Oct 19 03:34:23.733199 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:34:23.733199 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:34:23.733199 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:34:23.733199 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:34:23.733199 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3AewzG0MImyDGMJpr6iLU6_b2sjKr8OB3itIqxnUZNAcDXOx9YIIqaUE4fMgcaubxtbATg-dx4rew2UvYwLvg7QPyNzfQrYYOclN55jkzx3W-72FK4PEb1EVzlxV7uWSUMWOCMPEnVi4jNlpDC7b6bjmnQu_hlPphbB0VqQjFrmSAM Oct 19 03:34:23.733199 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:34:23.733199 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:34:23.733199 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:34:23.733199 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:34:23.733199 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:34:23.733199 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:34:23.733199 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 8086dde9fecd4c38bd214e7e87e899eb Oct 19 03:34:23.733199 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ImagesNegativeTestJSON-1001016267 Oct 19 03:34:23.733199 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:34:23.733199 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:34:23.733199 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8086dde9fecd4c38bd214e7e87e899eb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8086dde9fecd4c38bd214e7e87e899eb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8086dde9fecd4c38bd214e7e87e899eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8086dde9fecd4c38bd214e7e87e899eb", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:34:23.733199 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ImagesNegativeTestJSON-1001016267 Oct 19 03:34:23.733199 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 8086dde9fecd4c38bd214e7e87e899eb Oct 19 03:34:23.733199 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1001016267 Oct 19 03:34:23.733199 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ImagesNegativeTestJSON-1001016267-project Oct 19 03:34:23.733199 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:34:23.733199 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:34:23.733199 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: bb40699ae023477da8f0ae2265d5585f Oct 19 03:34:23.733199 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ImagesNegativeTestJSON-1001016267-project Oct 19 03:34:23.733199 n-d-861333-8 devstack@n-api.service[121134]: Oct 19 03:34:23.733199 n-d-861333-8 devstack@n-api.service[121134]: {"createImage": {"name": "tempest-test-snap-862391655"}} Oct 19 03:34:23.733199 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:34:23.733199 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 19 03:34:23.733199 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-862391655'}}} Oct 19 03:34:23.733199 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:34:23.733199 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:34:23.733199 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:34:23.733199 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:34:23.733199 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 19 03:34:23.733199 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 19 03:34:23.733199 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 19 03:34:23.733199 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:34:23.733199 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:34:23.733199 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:34:23.733199 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:34:23.733199 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:34:23.733199 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:34:23.733199 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:34:23.733199 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:34:23.733199 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:34:23.733199 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:34:23.733199 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:34:23.733199 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:34:23.733199 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:34:23.733199 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:34:23.733199 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 19 03:34:23.733199 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 19 03:34:23.733199 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:34:23.733199 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:34:23.733199 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:34:23.733199 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:34:23.733199 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 19 03:34:23.733199 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:34:23.745528 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:34:23.745528 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:34:23.745528 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:34:23.745528 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:34:23.745528 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:34:23.745528 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:34:23.745528 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:34:23.745528 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 19 03:34:23.745528 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:34:23.745528 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-343e2a33-a46a-47d9-afc1-ae29e3d32428 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:34:23.745528 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-343e2a33-a46a-47d9-afc1-ae29e3d32428 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] 10.222.0.52 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.016657 Oct 19 03:34:23.745528 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2298/4679] 10.222.0.52 () {60 vars in 1275 bytes} [Wed Oct 19 03:34:23 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:34:23.754460 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3737571c-cc8d-4fe0-806c-800cfc11517b tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1476212564"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:34:23.758091 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3737571c-cc8d-4fe0-806c-800cfc11517b tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 19 03:34:23.758635 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-3737571c-cc8d-4fe0-806c-800cfc11517b tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 19 03:34:23.760198 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3737571c-cc8d-4fe0-806c-800cfc11517b tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Request method failure captured: Oct 19 03:34:23.760198 n-d-861333-8 devstack@n-api.service[121134]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 19 03:34:23.760198 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:34:23.760198 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:34:23.760198 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:34:23.760198 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 57 Oct 19 03:34:23.760198 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:34:23.760198 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:34:23.760198 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:34:23.760198 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:34:23.760198 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3AewzG0MImyDGMJpr6iLU6_b2sjKr8OB3itIqxnUZNAcDXOx9YIIqaUE4fMgcaubxtbATg-dx4rew2UvYwLvg7QPyNzfQrYYOclN55jkzx3W-72FK4PEb1EVzlxV7uWSUMWOCMPEnVi4jNlpDC7b6bjmnQu_hlPphbB0VqQjFrmSAM Oct 19 03:34:23.760198 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:34:23.760198 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:34:23.760198 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:34:23.760198 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:34:23.760198 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:34:23.760198 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:34:23.760198 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 8086dde9fecd4c38bd214e7e87e899eb Oct 19 03:34:23.760198 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ImagesNegativeTestJSON-1001016267 Oct 19 03:34:23.760198 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:34:23.760198 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:34:23.760198 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8086dde9fecd4c38bd214e7e87e899eb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8086dde9fecd4c38bd214e7e87e899eb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8086dde9fecd4c38bd214e7e87e899eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8086dde9fecd4c38bd214e7e87e899eb", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:34:23.760198 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ImagesNegativeTestJSON-1001016267 Oct 19 03:34:23.760198 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 8086dde9fecd4c38bd214e7e87e899eb Oct 19 03:34:23.760198 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1001016267 Oct 19 03:34:23.760198 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ImagesNegativeTestJSON-1001016267-project Oct 19 03:34:23.760198 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:34:23.760198 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:34:23.760198 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: bb40699ae023477da8f0ae2265d5585f Oct 19 03:34:23.760198 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ImagesNegativeTestJSON-1001016267-project Oct 19 03:34:23.760198 n-d-861333-8 devstack@n-api.service[121134]: Oct 19 03:34:23.760198 n-d-861333-8 devstack@n-api.service[121134]: {"createImage": {"name": "tempest-test-snap-1476212564"}} Oct 19 03:34:23.760198 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:34:23.760198 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 19 03:34:23.760198 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1476212564'}}} Oct 19 03:34:23.760198 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:34:23.760198 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:34:23.760198 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:34:23.760198 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:34:23.760198 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 19 03:34:23.760198 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 19 03:34:23.760198 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 19 03:34:23.760198 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:34:23.760198 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:34:23.760198 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:34:23.760198 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:34:23.760198 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:34:23.760198 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:34:23.760198 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:34:23.760198 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:34:23.760198 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:34:23.760198 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:34:23.760198 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:34:23.760198 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:34:23.760198 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:34:23.760198 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:34:23.760198 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 19 03:34:23.760198 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 19 03:34:23.760198 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:34:23.760198 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:34:23.760198 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:34:23.760198 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:34:23.760198 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 19 03:34:23.760198 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:34:23.764599 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:34:23.764599 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:34:23.764599 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:34:23.764599 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:34:23.764599 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:34:23.764599 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:34:23.764599 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:34:23.764599 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 19 03:34:23.764599 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:34:23.764599 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3737571c-cc8d-4fe0-806c-800cfc11517b tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:34:23.764599 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3737571c-cc8d-4fe0-806c-800cfc11517b tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] 10.222.0.52 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.012165 Oct 19 03:34:23.764599 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2299/4680] 10.222.0.52 () {60 vars in 1281 bytes} [Wed Oct 19 03:34:23 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:34:23.780527 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e76bee31-7287-43bb-b79a-3c5d00fa2859 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:34:23.781037 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e76bee31-7287-43bb-b79a-3c5d00fa2859 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] [instance: 2255727d-7de0-44dc-a021-8dd243cbda1f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:34:23.794404 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e76bee31-7287-43bb-b79a-3c5d00fa2859 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:23.795580 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e76bee31-7287-43bb-b79a-3c5d00fa2859 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:23.803307 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e76bee31-7287-43bb-b79a-3c5d00fa2859 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:23.808111 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e76bee31-7287-43bb-b79a-3c5d00fa2859 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:23.809394 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e76bee31-7287-43bb-b79a-3c5d00fa2859 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:23.815343 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e76bee31-7287-43bb-b79a-3c5d00fa2859 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:23.844021 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-e76bee31-7287-43bb-b79a-3c5d00fa2859 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] HTTP exception thrown: Instance 2255727d-7de0-44dc-a021-8dd243cbda1f could not be found. Oct 19 03:34:23.844021 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e76bee31-7287-43bb-b79a-3c5d00fa2859 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Request method failure captured: Oct 19 03:34:23.844021 n-d-861333-8 devstack@n-api.service[121134]: request: DELETE /compute/v2.1/servers/2255727d-7de0-44dc-a021-8dd243cbda1f HTTP/1.1 Oct 19 03:34:23.844021 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:34:23.844021 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:34:23.844021 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:34:23.844021 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:34:23.844021 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:34:23.844021 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:34:23.844021 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:34:23.844021 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:34:23.844021 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3AewzG0MImyDGMJpr6iLU6_b2sjKr8OB3itIqxnUZNAcDXOx9YIIqaUE4fMgcaubxtbATg-dx4rew2UvYwLvg7QPyNzfQrYYOclN55jkzx3W-72FK4PEb1EVzlxV7uWSUMWOCMPEnVi4jNlpDC7b6bjmnQu_hlPphbB0VqQjFrmSAM Oct 19 03:34:23.844021 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:34:23.844021 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:34:23.844021 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:34:23.844021 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:34:23.844021 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:34:23.844021 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:34:23.844021 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 8086dde9fecd4c38bd214e7e87e899eb Oct 19 03:34:23.844021 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ImagesNegativeTestJSON-1001016267 Oct 19 03:34:23.844021 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:34:23.844021 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:34:23.844021 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8086dde9fecd4c38bd214e7e87e899eb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8086dde9fecd4c38bd214e7e87e899eb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8086dde9fecd4c38bd214e7e87e899eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8086dde9fecd4c38bd214e7e87e899eb", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:34:23.844021 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ImagesNegativeTestJSON-1001016267 Oct 19 03:34:23.844021 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 8086dde9fecd4c38bd214e7e87e899eb Oct 19 03:34:23.844021 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1001016267 Oct 19 03:34:23.844021 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ImagesNegativeTestJSON-1001016267-project Oct 19 03:34:23.844021 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:34:23.844021 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:34:23.844021 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: bb40699ae023477da8f0ae2265d5585f Oct 19 03:34:23.844021 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ImagesNegativeTestJSON-1001016267-project Oct 19 03:34:23.844021 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:34:23.844021 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance 2255727d-7de0-44dc-a021-8dd243cbda1f could not be found. Oct 19 03:34:23.844021 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '2255727d-7de0-44dc-a021-8dd243cbda1f'} Oct 19 03:34:23.844021 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:34:23.844021 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:34:23.844021 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:34:23.844021 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:34:23.844021 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:34:23.844021 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:34:23.844021 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:34:23.844021 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:34:23.844021 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:34:23.844021 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:34:23.844021 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2255727d-7de0-44dc-a021-8dd243cbda1f could not be found. Oct 19 03:34:23.844021 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:34:23.844021 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:34:23.844021 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:34:23.844021 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:34:23.844021 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:34:23.844021 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:34:23.844021 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:34:23.844021 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:34:23.844021 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:34:23.844021 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:34:23.844021 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 03:34:23.844021 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 03:34:23.844021 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 03:34:23.844021 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 03:34:23.844021 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:34:23.844021 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:34:23.850149 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:34:23.850149 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:34:23.850149 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2255727d-7de0-44dc-a021-8dd243cbda1f could not be found. Oct 19 03:34:23.850149 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:34:23.850149 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:34:23.850149 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:34:23.850149 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:34:23.850149 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:34:23.850149 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:34:23.850149 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:34:23.850149 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:34:23.850149 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2255727d-7de0-44dc-a021-8dd243cbda1f could not be found. Oct 19 03:34:23.850149 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:34:23.850149 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e76bee31-7287-43bb-b79a-3c5d00fa2859 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Returning 404 to user: Instance 2255727d-7de0-44dc-a021-8dd243cbda1f could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:34:23.853462 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e76bee31-7287-43bb-b79a-3c5d00fa2859 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] 10.222.0.52 "DELETE /compute/v2.1/servers/2255727d-7de0-44dc-a021-8dd243cbda1f" status: 404 len: 111 microversion: 2.1 time: 0.077908 Oct 19 03:34:23.856486 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2300/4681] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:34:23 2022] DELETE /compute/v2.1/servers/2255727d-7de0-44dc-a021-8dd243cbda1f => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:34:23.863437 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9ac29db2-124f-4e72-97cf-84e2f87b8194 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:34:23.865799 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9ac29db2-124f-4e72-97cf-84e2f87b8194 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] [instance: 2255727d-7de0-44dc-a021-8dd243cbda1f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:34:23.884592 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9ac29db2-124f-4e72-97cf-84e2f87b8194 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:23.886820 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9ac29db2-124f-4e72-97cf-84e2f87b8194 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:23.890499 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9ac29db2-124f-4e72-97cf-84e2f87b8194 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:23.891614 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9ac29db2-124f-4e72-97cf-84e2f87b8194 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:23.892499 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9ac29db2-124f-4e72-97cf-84e2f87b8194 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:23.894079 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9ac29db2-124f-4e72-97cf-84e2f87b8194 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:23.949180 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-9ac29db2-124f-4e72-97cf-84e2f87b8194 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] HTTP exception thrown: Instance 2255727d-7de0-44dc-a021-8dd243cbda1f could not be found. Oct 19 03:34:23.951845 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9ac29db2-124f-4e72-97cf-84e2f87b8194 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Request method failure captured: Oct 19 03:34:23.951845 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/2255727d-7de0-44dc-a021-8dd243cbda1f HTTP/1.1 Oct 19 03:34:23.951845 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:34:23.951845 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:34:23.951845 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:34:23.951845 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:34:23.951845 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:34:23.951845 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:34:23.951845 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:34:23.951845 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:34:23.951845 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3AewzG0MImyDGMJpr6iLU6_b2sjKr8OB3itIqxnUZNAcDXOx9YIIqaUE4fMgcaubxtbATg-dx4rew2UvYwLvg7QPyNzfQrYYOclN55jkzx3W-72FK4PEb1EVzlxV7uWSUMWOCMPEnVi4jNlpDC7b6bjmnQu_hlPphbB0VqQjFrmSAM Oct 19 03:34:23.951845 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:34:23.951845 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:34:23.951845 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:34:23.951845 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:34:23.951845 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:34:23.951845 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:34:23.951845 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 8086dde9fecd4c38bd214e7e87e899eb Oct 19 03:34:23.951845 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ImagesNegativeTestJSON-1001016267 Oct 19 03:34:23.951845 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:34:23.951845 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:34:23.951845 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8086dde9fecd4c38bd214e7e87e899eb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8086dde9fecd4c38bd214e7e87e899eb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8086dde9fecd4c38bd214e7e87e899eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8086dde9fecd4c38bd214e7e87e899eb", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:34:23.951845 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ImagesNegativeTestJSON-1001016267 Oct 19 03:34:23.951845 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 8086dde9fecd4c38bd214e7e87e899eb Oct 19 03:34:23.951845 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1001016267 Oct 19 03:34:23.951845 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ImagesNegativeTestJSON-1001016267-project Oct 19 03:34:23.951845 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:34:23.951845 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:34:23.951845 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: bb40699ae023477da8f0ae2265d5585f Oct 19 03:34:23.951845 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ImagesNegativeTestJSON-1001016267-project Oct 19 03:34:23.951845 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:34:23.951845 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance 2255727d-7de0-44dc-a021-8dd243cbda1f could not be found. Oct 19 03:34:23.951845 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '2255727d-7de0-44dc-a021-8dd243cbda1f'} Oct 19 03:34:23.951845 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:34:23.951845 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:34:23.951845 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:34:23.951845 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:34:23.951845 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:34:23.951845 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:34:23.951845 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:34:23.951845 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:34:23.951845 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:34:23.951845 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:34:23.951845 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2255727d-7de0-44dc-a021-8dd243cbda1f could not be found. Oct 19 03:34:23.951845 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:34:23.951845 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:34:23.951845 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:34:23.951845 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:34:23.951845 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:34:23.951845 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:34:23.951845 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:34:23.951845 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:34:23.951845 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:34:23.951845 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:34:23.951845 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:34:23.951845 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:34:23.951845 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:34:23.951845 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:34:23.951845 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:34:23.951845 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:34:23.951845 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2255727d-7de0-44dc-a021-8dd243cbda1f could not be found. Oct 19 03:34:23.951845 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:34:23.951845 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:34:23.951845 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:34:23.957048 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:34:23.957048 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:34:23.957048 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:34:23.957048 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:34:23.957048 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:34:23.957048 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2255727d-7de0-44dc-a021-8dd243cbda1f could not be found. Oct 19 03:34:23.957048 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:34:23.961077 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9ac29db2-124f-4e72-97cf-84e2f87b8194 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] Returning 404 to user: Instance 2255727d-7de0-44dc-a021-8dd243cbda1f could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:34:23.964175 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9ac29db2-124f-4e72-97cf-84e2f87b8194 tempest-ImagesNegativeTestJSON-1001016267 tempest-ImagesNegativeTestJSON-1001016267-project] 10.222.0.52 "GET /compute/v2.1/servers/2255727d-7de0-44dc-a021-8dd243cbda1f" status: 404 len: 111 microversion: 2.1 time: 0.104834 Oct 19 03:34:23.965061 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2301/4682] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:34:23 2022] GET /compute/v2.1/servers/2255727d-7de0-44dc-a021-8dd243cbda1f => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:34:23.984874 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:34:24.058210 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0c405c67-aaf0-45de-a8b9-aaeb1d5d05f9 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] 10.222.0.52 "DELETE /compute/v2.1/servers/b3180914-6014-4e72-9b03-a03f52de0145" status: 204 len: 0 microversion: 2.1 time: 0.504760 Oct 19 03:34:24.059675 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2382/4683] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:34:23 2022] DELETE /compute/v2.1/servers/b3180914-6014-4e72-9b03-a03f52de0145 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 19 03:34:24.069113 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ac1fa9df-fdfb-46ca-947c-9a130d2221e9 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:34:24.076589 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ac1fa9df-fdfb-46ca-947c-9a130d2221e9 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] [instance: 64b50337-325c-4476-9bd1-e38839e22294] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:34:24.091977 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ac1fa9df-fdfb-46ca-947c-9a130d2221e9 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:24.094268 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ac1fa9df-fdfb-46ca-947c-9a130d2221e9 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:24.096363 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ac1fa9df-fdfb-46ca-947c-9a130d2221e9 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:24.098100 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ac1fa9df-fdfb-46ca-947c-9a130d2221e9 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:24.102387 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ac1fa9df-fdfb-46ca-947c-9a130d2221e9 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:24.103161 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ac1fa9df-fdfb-46ca-947c-9a130d2221e9 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:24.170025 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ac1fa9df-fdfb-46ca-947c-9a130d2221e9 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] [instance: 64b50337-325c-4476-9bd1-e38839e22294] Going to try to terminate instance {{(pid=121134) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:34:24.499381 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:34:24.499751 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a26175b9-aa18-4c50-a98d-6a71091fb6f2 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:34:24.502089 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a26175b9-aa18-4c50-a98d-6a71091fb6f2 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] [instance: 29a2d62a-83d9-43e2-8907-f4158500d83f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:34:24.516707 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a26175b9-aa18-4c50-a98d-6a71091fb6f2 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:24.517746 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a26175b9-aa18-4c50-a98d-6a71091fb6f2 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:24.519451 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a26175b9-aa18-4c50-a98d-6a71091fb6f2 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:24.522189 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a26175b9-aa18-4c50-a98d-6a71091fb6f2 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:24.523757 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a26175b9-aa18-4c50-a98d-6a71091fb6f2 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:24.524877 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a26175b9-aa18-4c50-a98d-6a71091fb6f2 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:24.653573 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ac1fa9df-fdfb-46ca-947c-9a130d2221e9 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] 10.222.0.52 "DELETE /compute/v2.1/servers/64b50337-325c-4476-9bd1-e38839e22294" status: 204 len: 0 microversion: 2.1 time: 0.588462 Oct 19 03:34:24.654183 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2302/4684] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:34:24 2022] DELETE /compute/v2.1/servers/64b50337-325c-4476-9bd1-e38839e22294 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:34:24.663336 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f984e697-1916-40ee-9a81-8e3a3ac11917 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:34:24.665253 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f984e697-1916-40ee-9a81-8e3a3ac11917 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] [instance: b3180914-6014-4e72-9b03-a03f52de0145] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:34:24.675988 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f984e697-1916-40ee-9a81-8e3a3ac11917 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:24.678341 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f984e697-1916-40ee-9a81-8e3a3ac11917 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:24.684907 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f984e697-1916-40ee-9a81-8e3a3ac11917 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:24.690206 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f984e697-1916-40ee-9a81-8e3a3ac11917 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:24.690206 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f984e697-1916-40ee-9a81-8e3a3ac11917 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:24.690206 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f984e697-1916-40ee-9a81-8e3a3ac11917 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:25.100214 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-f984e697-1916-40ee-9a81-8e3a3ac11917 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f3337e3ea74d868d2072683e44d472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baf68030f15244c79a0d83ab3f3727ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:34:25.112700 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f984e697-1916-40ee-9a81-8e3a3ac11917 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] 10.222.0.52 "GET /compute/v2.1/servers/b3180914-6014-4e72-9b03-a03f52de0145" status: 200 len: 1512 microversion: 2.1 time: 0.452222 Oct 19 03:34:25.113609 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2303/4685] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:34:24 2022] GET /compute/v2.1/servers/b3180914-6014-4e72-9b03-a03f52de0145 => generated 1512 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:34:25.169758 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a26175b9-aa18-4c50-a98d-6a71091fb6f2 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33d07a7db4846ababf001493c6e10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb0265509744c93b03fa5c28b4e9386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:34:25.182441 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a26175b9-aa18-4c50-a98d-6a71091fb6f2 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] 10.222.0.52 "GET /compute/v2.1/servers/29a2d62a-83d9-43e2-8907-f4158500d83f" status: 200 len: 1507 microversion: 2.1 time: 0.685636 Oct 19 03:34:25.183947 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2383/4686] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:34:24 2022] GET /compute/v2.1/servers/29a2d62a-83d9-43e2-8907-f4158500d83f => generated 1507 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:34:26.142805 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b6e7e185-b160-4e3d-839f-bebed648facb tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:34:26.144069 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b6e7e185-b160-4e3d-839f-bebed648facb tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] [instance: b3180914-6014-4e72-9b03-a03f52de0145] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:34:26.171581 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b6e7e185-b160-4e3d-839f-bebed648facb tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:26.172612 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b6e7e185-b160-4e3d-839f-bebed648facb tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:26.174395 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b6e7e185-b160-4e3d-839f-bebed648facb tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:26.175351 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b6e7e185-b160-4e3d-839f-bebed648facb tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:26.177849 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b6e7e185-b160-4e3d-839f-bebed648facb tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:26.180573 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b6e7e185-b160-4e3d-839f-bebed648facb tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:26.208129 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-112076ce-8893-40ad-83f5-ffd0b133c974 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:34:26.208972 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-112076ce-8893-40ad-83f5-ffd0b133c974 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] [instance: 29a2d62a-83d9-43e2-8907-f4158500d83f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:34:26.245777 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-112076ce-8893-40ad-83f5-ffd0b133c974 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:26.248655 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-112076ce-8893-40ad-83f5-ffd0b133c974 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:26.249912 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-112076ce-8893-40ad-83f5-ffd0b133c974 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:26.252353 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-112076ce-8893-40ad-83f5-ffd0b133c974 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:26.254000 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-112076ce-8893-40ad-83f5-ffd0b133c974 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:26.256551 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-112076ce-8893-40ad-83f5-ffd0b133c974 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:26.962738 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-112076ce-8893-40ad-83f5-ffd0b133c974 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33d07a7db4846ababf001493c6e10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb0265509744c93b03fa5c28b4e9386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:34:26.974777 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-112076ce-8893-40ad-83f5-ffd0b133c974 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] 10.222.0.52 "GET /compute/v2.1/servers/29a2d62a-83d9-43e2-8907-f4158500d83f" status: 200 len: 1507 microversion: 2.1 time: 0.771869 Oct 19 03:34:26.978105 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2384/4687] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:34:26 2022] GET /compute/v2.1/servers/29a2d62a-83d9-43e2-8907-f4158500d83f => generated 1507 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:34:27.265719 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b6e7e185-b160-4e3d-839f-bebed648facb tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f3337e3ea74d868d2072683e44d472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baf68030f15244c79a0d83ab3f3727ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:34:27.281794 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b6e7e185-b160-4e3d-839f-bebed648facb tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] 10.222.0.52 "GET /compute/v2.1/servers/b3180914-6014-4e72-9b03-a03f52de0145" status: 200 len: 1512 microversion: 2.1 time: 1.143842 Oct 19 03:34:27.285889 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2304/4688] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:34:26 2022] GET /compute/v2.1/servers/b3180914-6014-4e72-9b03-a03f52de0145 => generated 1512 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:34:28.002675 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-dee11b61-5141-4122-9ad5-d9fd38d6bdee tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:34:28.003884 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-dee11b61-5141-4122-9ad5-d9fd38d6bdee tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] [instance: 29a2d62a-83d9-43e2-8907-f4158500d83f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:34:28.018046 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dee11b61-5141-4122-9ad5-d9fd38d6bdee tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:28.018046 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dee11b61-5141-4122-9ad5-d9fd38d6bdee tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:28.018046 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dee11b61-5141-4122-9ad5-d9fd38d6bdee tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:28.018046 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dee11b61-5141-4122-9ad5-d9fd38d6bdee tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:28.018046 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dee11b61-5141-4122-9ad5-d9fd38d6bdee tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:28.019522 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dee11b61-5141-4122-9ad5-d9fd38d6bdee tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:28.311679 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-230108c9-a7db-489c-a543-022901a6a31f tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:34:28.313040 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-230108c9-a7db-489c-a543-022901a6a31f tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] [instance: b3180914-6014-4e72-9b03-a03f52de0145] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:34:28.330334 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-230108c9-a7db-489c-a543-022901a6a31f tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:28.331544 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-230108c9-a7db-489c-a543-022901a6a31f tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:28.332192 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-230108c9-a7db-489c-a543-022901a6a31f tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:28.333120 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-230108c9-a7db-489c-a543-022901a6a31f tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:28.333792 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-230108c9-a7db-489c-a543-022901a6a31f tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:28.334415 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-230108c9-a7db-489c-a543-022901a6a31f tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:29.275110 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-230108c9-a7db-489c-a543-022901a6a31f tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f3337e3ea74d868d2072683e44d472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baf68030f15244c79a0d83ab3f3727ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:34:29.289008 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-230108c9-a7db-489c-a543-022901a6a31f tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] 10.222.0.52 "GET /compute/v2.1/servers/b3180914-6014-4e72-9b03-a03f52de0145" status: 200 len: 1512 microversion: 2.1 time: 0.979221 Oct 19 03:34:29.290200 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2305/4689] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:34:28 2022] GET /compute/v2.1/servers/b3180914-6014-4e72-9b03-a03f52de0145 => generated 1512 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:34:29.301064 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4d099734-58e9-43bd-9d6c-a94379773f13 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-666650672", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "18068c67-95f3-4a2f-9645-3680587e605d"}], "security_groups": [{"name": "tempest-securitygroup--500809850"}], "key_name": "tempest-keypair-1486848484", "user_data": "}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:34:29.481417 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-dee11b61-5141-4122-9ad5-d9fd38d6bdee tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33d07a7db4846ababf001493c6e10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb0265509744c93b03fa5c28b4e9386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:34:29.490192 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-dee11b61-5141-4122-9ad5-d9fd38d6bdee tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] 10.222.0.52 "GET /compute/v2.1/servers/29a2d62a-83d9-43e2-8907-f4158500d83f" status: 200 len: 1507 microversion: 2.1 time: 1.492038 Oct 19 03:34:29.491848 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2385/4690] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:34:27 2022] GET /compute/v2.1/servers/29a2d62a-83d9-43e2-8907-f4158500d83f => generated 1507 bytes in 1494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:34:29.509461 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-849505f8-64a2-4f8d-9e59-695cc6ab2b05 req-c1e6f57f-9b6e-4ad2-a3d3-84248ca32797 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64b50337-325c-4476-9bd1-e38839e22294", "name": "network-vif-deleted", "tag": "ff734670-1945-4d93-8bf4-917b29792466"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:34:29.535852 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-849505f8-64a2-4f8d-9e59-695cc6ab2b05 req-c1e6f57f-9b6e-4ad2-a3d3-84248ca32797 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:29.537654 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-849505f8-64a2-4f8d-9e59-695cc6ab2b05 req-c1e6f57f-9b6e-4ad2-a3d3-84248ca32797 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:29.541413 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-849505f8-64a2-4f8d-9e59-695cc6ab2b05 req-c1e6f57f-9b6e-4ad2-a3d3-84248ca32797 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:29.557665 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-849505f8-64a2-4f8d-9e59-695cc6ab2b05 req-c1e6f57f-9b6e-4ad2-a3d3-84248ca32797 service nova] Creating event network-vif-deleted:ff734670-1945-4d93-8bf4-917b29792466 for instance 64b50337-325c-4476-9bd1-e38839e22294 on n-h2-861333-8 Oct 19 03:34:29.563345 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-849505f8-64a2-4f8d-9e59-695cc6ab2b05 req-c1e6f57f-9b6e-4ad2-a3d3-84248ca32797 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070041 Oct 19 03:34:29.567120 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2386/4691] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:34:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:34:29.579210 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-2a19f88d-a7bd-4098-84bc-d60abb911562 req-e7246284-99ca-4120-851d-3825cc5b2d97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3180914-6014-4e72-9b03-a03f52de0145", "name": "network-vif-unplugged", "status": "completed", "tag": "12a02252-cdd6-49f6-b787-bab713b86ba2"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:34:29.601679 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-4d099734-58e9-43bd-9d6c-a94379773f13 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] validate_networks() for [('18068c67-95f3-4a2f-9645-3680587e605d', None, None, None, None, None)] {{(pid=121134) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:34:29.617477 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-2a19f88d-a7bd-4098-84bc-d60abb911562 req-e7246284-99ca-4120-851d-3825cc5b2d97 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:29.618731 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-2a19f88d-a7bd-4098-84bc-d60abb911562 req-e7246284-99ca-4120-851d-3825cc5b2d97 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:29.621293 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-2a19f88d-a7bd-4098-84bc-d60abb911562 req-e7246284-99ca-4120-851d-3825cc5b2d97 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:29.656236 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-2a19f88d-a7bd-4098-84bc-d60abb911562 req-e7246284-99ca-4120-851d-3825cc5b2d97 service nova] Creating event network-vif-unplugged:12a02252-cdd6-49f6-b787-bab713b86ba2 for instance b3180914-6014-4e72-9b03-a03f52de0145 on n-h1-861333-8 Oct 19 03:34:29.662534 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-2a19f88d-a7bd-4098-84bc-d60abb911562 req-e7246284-99ca-4120-851d-3825cc5b2d97 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.093818 Oct 19 03:34:29.663412 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2387/4692] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:34:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:34:30.322491 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5fdcbc76-dcdb-452a-b452-7bcf24578659 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:34:30.325527 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-5fdcbc76-dcdb-452a-b452-7bcf24578659 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] [instance: b3180914-6014-4e72-9b03-a03f52de0145] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:34:30.347292 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5fdcbc76-dcdb-452a-b452-7bcf24578659 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:30.347957 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5fdcbc76-dcdb-452a-b452-7bcf24578659 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:30.348638 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5fdcbc76-dcdb-452a-b452-7bcf24578659 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:30.351484 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5fdcbc76-dcdb-452a-b452-7bcf24578659 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:30.352047 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5fdcbc76-dcdb-452a-b452-7bcf24578659 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:30.352501 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5fdcbc76-dcdb-452a-b452-7bcf24578659 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:30.562825 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-5fdcbc76-dcdb-452a-b452-7bcf24578659 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f3337e3ea74d868d2072683e44d472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baf68030f15244c79a0d83ab3f3727ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:34:30.589979 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5fdcbc76-dcdb-452a-b452-7bcf24578659 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] 10.222.0.52 "GET /compute/v2.1/servers/b3180914-6014-4e72-9b03-a03f52de0145" status: 200 len: 1470 microversion: 2.1 time: 0.272705 Oct 19 03:34:30.609239 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2388/4693] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:34:30 2022] GET /compute/v2.1/servers/b3180914-6014-4e72-9b03-a03f52de0145 => generated 1470 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:34:30.617481 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3fbebde1-f4ea-4afd-a873-86f32a4349a2 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:34:30.622050 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-3fbebde1-f4ea-4afd-a873-86f32a4349a2 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] [instance: 29a2d62a-83d9-43e2-8907-f4158500d83f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:34:30.633658 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3fbebde1-f4ea-4afd-a873-86f32a4349a2 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:30.634572 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3fbebde1-f4ea-4afd-a873-86f32a4349a2 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:30.635412 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3fbebde1-f4ea-4afd-a873-86f32a4349a2 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:30.636712 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3fbebde1-f4ea-4afd-a873-86f32a4349a2 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:30.637425 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3fbebde1-f4ea-4afd-a873-86f32a4349a2 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:30.638045 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3fbebde1-f4ea-4afd-a873-86f32a4349a2 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:30.863958 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-4d099734-58e9-43bd-9d6c-a94379773f13 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Flavor limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:34:30.864551 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-4d099734-58e9-43bd-9d6c-a94379773f13 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Image limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:34:30.864850 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-4d099734-58e9-43bd-9d6c-a94379773f13 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Flavor pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:34:30.865269 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-4d099734-58e9-43bd-9d6c-a94379773f13 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Image pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:34:30.865738 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-4d099734-58e9-43bd-9d6c-a94379773f13 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:34:30.884036 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4d099734-58e9-43bd-9d6c-a94379773f13 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:30.884635 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4d099734-58e9-43bd-9d6c-a94379773f13 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:30.885150 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4d099734-58e9-43bd-9d6c-a94379773f13 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:30.886337 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4d099734-58e9-43bd-9d6c-a94379773f13 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:30.887082 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4d099734-58e9-43bd-9d6c-a94379773f13 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:30.887592 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4d099734-58e9-43bd-9d6c-a94379773f13 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:30.919070 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-4d099734-58e9-43bd-9d6c-a94379773f13 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Getting quotas for project fa4001edd1474947a94243a620a6013a. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:34:30.927010 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-4d099734-58e9-43bd-9d6c-a94379773f13 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Getting quotas for user 4c65a497e16e4e41b5cf1287042f3a68 and project fa4001edd1474947a94243a620a6013a. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:34:30.963461 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4d099734-58e9-43bd-9d6c-a94379773f13 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Going to run 1 instances... {{(pid=121134) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:34:30.967038 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4d099734-58e9-43bd-9d6c-a94379773f13 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] [instance: ddbf7afb-1d7b-4d33-b6fb-1f1608c11985] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:34:30.972303 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-3fbebde1-f4ea-4afd-a873-86f32a4349a2 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33d07a7db4846ababf001493c6e10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb0265509744c93b03fa5c28b4e9386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:34:30.987828 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-3fbebde1-f4ea-4afd-a873-86f32a4349a2 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] 10.222.0.52 "GET /compute/v2.1/servers/29a2d62a-83d9-43e2-8907-f4158500d83f" status: 200 len: 1487 microversion: 2.1 time: 0.370896 Oct 19 03:34:30.989942 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2389/4694] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:34:30 2022] GET /compute/v2.1/servers/29a2d62a-83d9-43e2-8907-f4158500d83f => generated 1487 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:34:31.017681 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-81d6371a-ab78-4f8d-9fe0-b560e0b11a32 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:34:31.018325 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-81d6371a-ab78-4f8d-9fe0-b560e0b11a32 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] [instance: 29a2d62a-83d9-43e2-8907-f4158500d83f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:34:31.027206 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-81d6371a-ab78-4f8d-9fe0-b560e0b11a32 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:31.030892 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-81d6371a-ab78-4f8d-9fe0-b560e0b11a32 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:31.031425 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-81d6371a-ab78-4f8d-9fe0-b560e0b11a32 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:31.032243 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-81d6371a-ab78-4f8d-9fe0-b560e0b11a32 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:31.035118 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-81d6371a-ab78-4f8d-9fe0-b560e0b11a32 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:31.040012 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-81d6371a-ab78-4f8d-9fe0-b560e0b11a32 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:31.198929 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4d099734-58e9-43bd-9d6c-a94379773f13 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.905479 Oct 19 03:34:31.200693 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2306/4695] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:34:29 2022] POST /compute/v2.1/servers => generated 401 bytes in 1910 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 03:34:31.225146 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-124a0dc5-9d05-4f8b-88e4-2d3d369f725c tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:34:31.233649 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-124a0dc5-9d05-4f8b-88e4-2d3d369f725c tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] [instance: ddbf7afb-1d7b-4d33-b6fb-1f1608c11985] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:34:31.300776 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-81d6371a-ab78-4f8d-9fe0-b560e0b11a32 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] 10.222.0.52 "POST /compute/v2.1/servers/29a2d62a-83d9-43e2-8907-f4158500d83f/action" status: 202 len: 0 microversion: 2.1 time: 0.293188 Oct 19 03:34:31.302072 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2390/4696] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:34:31 2022] POST /compute/v2.1/servers/29a2d62a-83d9-43e2-8907-f4158500d83f/action => generated 0 bytes in 295 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 19 03:34:31.310126 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c9a1a804-ca82-4881-8c98-c09e4eab01b1 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:34:31.310841 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c9a1a804-ca82-4881-8c98-c09e4eab01b1 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] [instance: 29a2d62a-83d9-43e2-8907-f4158500d83f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:34:31.346277 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-124a0dc5-9d05-4f8b-88e4-2d3d369f725c tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c65a497e16e4e41b5cf1287042f3a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4001edd1474947a94243a620a6013a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:34:31.349822 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c9a1a804-ca82-4881-8c98-c09e4eab01b1 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:31.350607 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c9a1a804-ca82-4881-8c98-c09e4eab01b1 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:31.351230 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c9a1a804-ca82-4881-8c98-c09e4eab01b1 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:31.358662 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c9a1a804-ca82-4881-8c98-c09e4eab01b1 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:31.360448 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c9a1a804-ca82-4881-8c98-c09e4eab01b1 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:31.361189 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-124a0dc5-9d05-4f8b-88e4-2d3d369f725c tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] 10.222.0.52 "GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985" status: 200 len: 1237 microversion: 2.1 time: 0.143261 Oct 19 03:34:31.362615 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2307/4697] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:34:31 2022] GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985 => generated 1237 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:34:31.382768 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c9a1a804-ca82-4881-8c98-c09e4eab01b1 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:31.615047 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-468429c5-d8fb-4872-8b13-7b1f446e5c43 req-96575ce1-5494-433b-9d5b-0cd9997c9afe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3180914-6014-4e72-9b03-a03f52de0145", "name": "network-vif-deleted", "tag": "12a02252-cdd6-49f6-b787-bab713b86ba2"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:34:31.631888 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-468429c5-d8fb-4872-8b13-7b1f446e5c43 req-96575ce1-5494-433b-9d5b-0cd9997c9afe service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:31.636311 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-468429c5-d8fb-4872-8b13-7b1f446e5c43 req-96575ce1-5494-433b-9d5b-0cd9997c9afe service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:31.638616 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-468429c5-d8fb-4872-8b13-7b1f446e5c43 req-96575ce1-5494-433b-9d5b-0cd9997c9afe service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:31.668057 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-468429c5-d8fb-4872-8b13-7b1f446e5c43 req-96575ce1-5494-433b-9d5b-0cd9997c9afe service nova] Creating event network-vif-deleted:12a02252-cdd6-49f6-b787-bab713b86ba2 for instance b3180914-6014-4e72-9b03-a03f52de0145 on n-h1-861333-8 Oct 19 03:34:31.675841 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-468429c5-d8fb-4872-8b13-7b1f446e5c43 req-96575ce1-5494-433b-9d5b-0cd9997c9afe service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068677 Oct 19 03:34:31.676869 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2308/4698] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:34:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:34:31.683262 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6cf34edc-d65d-4aaa-bc6b-ce25067da9d3 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:34:31.684177 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6cf34edc-d65d-4aaa-bc6b-ce25067da9d3 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] [instance: b3180914-6014-4e72-9b03-a03f52de0145] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:34:31.694408 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6cf34edc-d65d-4aaa-bc6b-ce25067da9d3 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:31.695373 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6cf34edc-d65d-4aaa-bc6b-ce25067da9d3 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:31.696155 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6cf34edc-d65d-4aaa-bc6b-ce25067da9d3 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:31.697120 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6cf34edc-d65d-4aaa-bc6b-ce25067da9d3 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:31.698254 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6cf34edc-d65d-4aaa-bc6b-ce25067da9d3 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:31.698946 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6cf34edc-d65d-4aaa-bc6b-ce25067da9d3 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:31.727852 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c9a1a804-ca82-4881-8c98-c09e4eab01b1 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33d07a7db4846ababf001493c6e10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb0265509744c93b03fa5c28b4e9386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:34:31.742037 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c9a1a804-ca82-4881-8c98-c09e4eab01b1 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] 10.222.0.52 "GET /compute/v2.1/servers/29a2d62a-83d9-43e2-8907-f4158500d83f" status: 200 len: 1495 microversion: 2.1 time: 0.435468 Oct 19 03:34:31.742841 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2391/4699] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:34:31 2022] GET /compute/v2.1/servers/29a2d62a-83d9-43e2-8907-f4158500d83f => generated 1495 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:34:31.762739 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6cf34edc-d65d-4aaa-bc6b-ce25067da9d3 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:31.763525 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6cf34edc-d65d-4aaa-bc6b-ce25067da9d3 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:31.764251 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6cf34edc-d65d-4aaa-bc6b-ce25067da9d3 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:31.765509 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-6cf34edc-d65d-4aaa-bc6b-ce25067da9d3 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lazy-loading 'fault' on Instance uuid b3180914-6014-4e72-9b03-a03f52de0145 {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:34:31.836281 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-6cf34edc-d65d-4aaa-bc6b-ce25067da9d3 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f3337e3ea74d868d2072683e44d472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baf68030f15244c79a0d83ab3f3727ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:34:31.850078 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6cf34edc-d65d-4aaa-bc6b-ce25067da9d3 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] 10.222.0.52 "GET /compute/v2.1/servers/b3180914-6014-4e72-9b03-a03f52de0145" status: 200 len: 1308 microversion: 2.1 time: 0.171847 Oct 19 03:34:31.851058 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2309/4700] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:34:31 2022] GET /compute/v2.1/servers/b3180914-6014-4e72-9b03-a03f52de0145 => generated 1308 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:34:32.386745 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-80e430c9-50bb-4b9b-a5e1-a0e664d369ba tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:34:32.387750 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-80e430c9-50bb-4b9b-a5e1-a0e664d369ba tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] [instance: ddbf7afb-1d7b-4d33-b6fb-1f1608c11985] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:34:32.538553 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-80e430c9-50bb-4b9b-a5e1-a0e664d369ba tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c65a497e16e4e41b5cf1287042f3a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4001edd1474947a94243a620a6013a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:34:32.548609 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-80e430c9-50bb-4b9b-a5e1-a0e664d369ba tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] 10.222.0.52 "GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985" status: 200 len: 1237 microversion: 2.1 time: 0.166165 Oct 19 03:34:32.552117 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2392/4701] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:34:32 2022] GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985 => generated 1237 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:34:32.780190 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-69752c49-5e9e-4dd8-aea2-0c0727b09ac3 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:34:32.782301 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-69752c49-5e9e-4dd8-aea2-0c0727b09ac3 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] [instance: 29a2d62a-83d9-43e2-8907-f4158500d83f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:34:32.792395 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-69752c49-5e9e-4dd8-aea2-0c0727b09ac3 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:32.796602 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-69752c49-5e9e-4dd8-aea2-0c0727b09ac3 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:32.809683 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-69752c49-5e9e-4dd8-aea2-0c0727b09ac3 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:32.814079 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-69752c49-5e9e-4dd8-aea2-0c0727b09ac3 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:32.814990 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-69752c49-5e9e-4dd8-aea2-0c0727b09ac3 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:32.838912 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-69752c49-5e9e-4dd8-aea2-0c0727b09ac3 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:32.882988 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-49bdcab8-0450-438c-90c1-acd23eb781d7 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:34:32.884309 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-49bdcab8-0450-438c-90c1-acd23eb781d7 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] [instance: b3180914-6014-4e72-9b03-a03f52de0145] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:34:32.901187 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-49bdcab8-0450-438c-90c1-acd23eb781d7 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:32.905148 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-49bdcab8-0450-438c-90c1-acd23eb781d7 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:32.905934 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-49bdcab8-0450-438c-90c1-acd23eb781d7 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:32.906732 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-49bdcab8-0450-438c-90c1-acd23eb781d7 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:32.907419 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-49bdcab8-0450-438c-90c1-acd23eb781d7 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:32.907858 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-49bdcab8-0450-438c-90c1-acd23eb781d7 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:32.941381 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-49bdcab8-0450-438c-90c1-acd23eb781d7 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] HTTP exception thrown: Instance b3180914-6014-4e72-9b03-a03f52de0145 could not be found. Oct 19 03:34:32.943430 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-49bdcab8-0450-438c-90c1-acd23eb781d7 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Request method failure captured: Oct 19 03:34:32.943430 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/b3180914-6014-4e72-9b03-a03f52de0145 HTTP/1.1 Oct 19 03:34:32.943430 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:34:32.943430 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:34:32.943430 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:34:32.943430 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:34:32.943430 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:34:32.943430 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:34:32.943430 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:34:32.943430 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:34:32.943430 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT3AA6QPYyw6w6_8INwyHqwaUrBQgwZpb44GdXKf-LcIXwjFd2pZamODTTubx81JQO7Amgq7uJ9ulSyRycMFxqPaBnFaLYpKwgGjcDqRZB3DGlDGGAIHoLdHI3dCQyJ3pPlsKIKs-Ylp5bdZvL9aX5_cE5CI-D_lpfGtyLFYeFDYEcDY Oct 19 03:34:32.943430 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:34:32.943430 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:34:32.943430 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:34:32.943430 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:34:32.943430 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:34:32.943430 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:34:32.943430 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: baf68030f15244c79a0d83ab3f3727ec Oct 19 03:34:32.943430 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-MultipleCreateTestJSON-1590512752 Oct 19 03:34:32.943430 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:34:32.943430 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:34:32.943430 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/baf68030f15244c79a0d83ab3f3727ec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/baf68030f15244c79a0d83ab3f3727ec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/baf68030f15244c79a0d83ab3f3727ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_baf68030f15244c79a0d83ab3f3727ec", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:34:32.943430 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-MultipleCreateTestJSON-1590512752 Oct 19 03:34:32.943430 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: baf68030f15244c79a0d83ab3f3727ec Oct 19 03:34:32.943430 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1590512752 Oct 19 03:34:32.943430 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-MultipleCreateTestJSON-1590512752-project Oct 19 03:34:32.943430 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:34:32.943430 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:34:32.943430 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 34f3337e3ea74d868d2072683e44d472 Oct 19 03:34:32.943430 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-MultipleCreateTestJSON-1590512752-project Oct 19 03:34:32.943430 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:34:32.943430 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance b3180914-6014-4e72-9b03-a03f52de0145 could not be found. Oct 19 03:34:32.943430 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': 'b3180914-6014-4e72-9b03-a03f52de0145'} Oct 19 03:34:32.943430 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:34:32.943430 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:34:32.943430 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:34:32.943430 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:34:32.943430 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:34:32.943430 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:34:32.943430 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:34:32.943430 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:34:32.943430 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:34:32.943430 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:34:32.943430 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3180914-6014-4e72-9b03-a03f52de0145 could not be found. Oct 19 03:34:32.943430 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:34:32.943430 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:34:32.943430 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:34:32.943430 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:34:32.943430 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:34:32.943430 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:34:32.943430 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:34:32.943430 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:34:32.943430 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:34:32.943430 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:34:32.943430 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:34:32.943430 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:34:32.943430 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:34:32.943430 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:34:32.943430 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:34:32.943430 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:34:32.943430 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3180914-6014-4e72-9b03-a03f52de0145 could not be found. Oct 19 03:34:32.943430 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:34:32.943430 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:34:32.943430 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:34:32.948576 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:34:32.948576 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:34:32.948576 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:34:32.948576 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:34:32.948576 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:34:32.948576 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3180914-6014-4e72-9b03-a03f52de0145 could not be found. Oct 19 03:34:32.948576 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:34:32.953157 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-49bdcab8-0450-438c-90c1-acd23eb781d7 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Returning 404 to user: Instance b3180914-6014-4e72-9b03-a03f52de0145 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:34:32.956450 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-49bdcab8-0450-438c-90c1-acd23eb781d7 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] 10.222.0.52 "GET /compute/v2.1/servers/b3180914-6014-4e72-9b03-a03f52de0145" status: 404 len: 111 microversion: 2.1 time: 0.080934 Oct 19 03:34:32.962916 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2393/4702] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:34:32 2022] GET /compute/v2.1/servers/b3180914-6014-4e72-9b03-a03f52de0145 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 03:34:32.987341 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b68110b7-ae4f-4826-9855-9821ddfcb7e6 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:34:32.988408 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b68110b7-ae4f-4826-9855-9821ddfcb7e6 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] [instance: 64b50337-325c-4476-9bd1-e38839e22294] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:34:33.014781 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b68110b7-ae4f-4826-9855-9821ddfcb7e6 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:33.019460 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b68110b7-ae4f-4826-9855-9821ddfcb7e6 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:33.019460 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b68110b7-ae4f-4826-9855-9821ddfcb7e6 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:33.022526 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b68110b7-ae4f-4826-9855-9821ddfcb7e6 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:33.024309 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b68110b7-ae4f-4826-9855-9821ddfcb7e6 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:33.024771 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b68110b7-ae4f-4826-9855-9821ddfcb7e6 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:33.052630 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:34:33.054354 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-b68110b7-ae4f-4826-9855-9821ddfcb7e6 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] HTTP exception thrown: Instance 64b50337-325c-4476-9bd1-e38839e22294 could not be found. Oct 19 03:34:33.057412 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b68110b7-ae4f-4826-9855-9821ddfcb7e6 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Request method failure captured: Oct 19 03:34:33.057412 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/64b50337-325c-4476-9bd1-e38839e22294 HTTP/1.1 Oct 19 03:34:33.057412 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:34:33.057412 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:34:33.057412 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:34:33.057412 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:34:33.057412 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:34:33.057412 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:34:33.057412 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:34:33.057412 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:34:33.057412 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT3AA6QPYyw6w6_8INwyHqwaUrBQgwZpb44GdXKf-LcIXwjFd2pZamODTTubx81JQO7Amgq7uJ9ulSyRycMFxqPaBnFaLYpKwgGjcDqRZB3DGlDGGAIHoLdHI3dCQyJ3pPlsKIKs-Ylp5bdZvL9aX5_cE5CI-D_lpfGtyLFYeFDYEcDY Oct 19 03:34:33.057412 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:34:33.057412 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:34:33.057412 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:34:33.057412 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:34:33.057412 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:34:33.057412 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:34:33.057412 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: baf68030f15244c79a0d83ab3f3727ec Oct 19 03:34:33.057412 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-MultipleCreateTestJSON-1590512752 Oct 19 03:34:33.057412 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:34:33.057412 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:34:33.057412 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/baf68030f15244c79a0d83ab3f3727ec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/baf68030f15244c79a0d83ab3f3727ec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/baf68030f15244c79a0d83ab3f3727ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_baf68030f15244c79a0d83ab3f3727ec", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:34:33.057412 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-MultipleCreateTestJSON-1590512752 Oct 19 03:34:33.057412 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: baf68030f15244c79a0d83ab3f3727ec Oct 19 03:34:33.057412 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1590512752 Oct 19 03:34:33.057412 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-MultipleCreateTestJSON-1590512752-project Oct 19 03:34:33.057412 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:34:33.057412 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:34:33.057412 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 34f3337e3ea74d868d2072683e44d472 Oct 19 03:34:33.057412 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-MultipleCreateTestJSON-1590512752-project Oct 19 03:34:33.057412 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:34:33.057412 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance 64b50337-325c-4476-9bd1-e38839e22294 could not be found. Oct 19 03:34:33.057412 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '64b50337-325c-4476-9bd1-e38839e22294'} Oct 19 03:34:33.057412 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:34:33.057412 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:34:33.057412 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:34:33.057412 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:34:33.057412 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:34:33.057412 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:34:33.057412 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:34:33.057412 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:34:33.057412 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:34:33.057412 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:34:33.057412 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64b50337-325c-4476-9bd1-e38839e22294 could not be found. Oct 19 03:34:33.057412 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:34:33.057412 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:34:33.057412 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:34:33.057412 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:34:33.057412 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:34:33.057412 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:34:33.057412 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:34:33.057412 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:34:33.057412 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:34:33.057412 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:34:33.057412 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:34:33.057412 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:34:33.057412 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:34:33.057412 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:34:33.057412 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:34:33.057412 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:34:33.057412 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64b50337-325c-4476-9bd1-e38839e22294 could not be found. Oct 19 03:34:33.057412 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:34:33.057412 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:34:33.057412 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:34:33.062048 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:34:33.062048 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:34:33.062048 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:34:33.062048 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:34:33.062048 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:34:33.062048 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64b50337-325c-4476-9bd1-e38839e22294 could not be found. Oct 19 03:34:33.062048 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:34:33.063328 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b68110b7-ae4f-4826-9855-9821ddfcb7e6 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] Returning 404 to user: Instance 64b50337-325c-4476-9bd1-e38839e22294 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:34:33.065031 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b68110b7-ae4f-4826-9855-9821ddfcb7e6 tempest-MultipleCreateTestJSON-1590512752 tempest-MultipleCreateTestJSON-1590512752-project] 10.222.0.52 "GET /compute/v2.1/servers/64b50337-325c-4476-9bd1-e38839e22294" status: 404 len: 111 microversion: 2.1 time: 0.100547 Oct 19 03:34:33.068112 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2394/4703] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:34:32 2022] GET /compute/v2.1/servers/64b50337-325c-4476-9bd1-e38839e22294 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:34:33.334851 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-69752c49-5e9e-4dd8-aea2-0c0727b09ac3 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33d07a7db4846ababf001493c6e10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb0265509744c93b03fa5c28b4e9386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:34:33.343491 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-69752c49-5e9e-4dd8-aea2-0c0727b09ac3 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] 10.222.0.52 "GET /compute/v2.1/servers/29a2d62a-83d9-43e2-8907-f4158500d83f" status: 200 len: 1495 microversion: 2.1 time: 0.577026 Oct 19 03:34:33.349125 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2310/4704] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:34:32 2022] GET /compute/v2.1/servers/29a2d62a-83d9-43e2-8907-f4158500d83f => generated 1495 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:34:33.578895 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-eb01f5f1-8d6d-4fd8-9465-fb79cd79f2c4 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:34:33.580079 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-eb01f5f1-8d6d-4fd8-9465-fb79cd79f2c4 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] [instance: ddbf7afb-1d7b-4d33-b6fb-1f1608c11985] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:34:33.589569 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-eb01f5f1-8d6d-4fd8-9465-fb79cd79f2c4 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:33.590385 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-eb01f5f1-8d6d-4fd8-9465-fb79cd79f2c4 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:33.591052 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-eb01f5f1-8d6d-4fd8-9465-fb79cd79f2c4 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:33.591982 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-eb01f5f1-8d6d-4fd8-9465-fb79cd79f2c4 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:33.592637 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-eb01f5f1-8d6d-4fd8-9465-fb79cd79f2c4 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:33.593302 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-eb01f5f1-8d6d-4fd8-9465-fb79cd79f2c4 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:33.745237 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-eb01f5f1-8d6d-4fd8-9465-fb79cd79f2c4 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c65a497e16e4e41b5cf1287042f3a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4001edd1474947a94243a620a6013a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:34:33.753843 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-eb01f5f1-8d6d-4fd8-9465-fb79cd79f2c4 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] 10.222.0.52 "GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985" status: 200 len: 1233 microversion: 2.1 time: 0.178910 Oct 19 03:34:33.754510 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2395/4705] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:34:33 2022] GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985 => generated 1233 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:34:34.379258 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-59559ef1-e735-4ae6-8315-5351d609b3fd tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:34:34.379981 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-59559ef1-e735-4ae6-8315-5351d609b3fd tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] [instance: 29a2d62a-83d9-43e2-8907-f4158500d83f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:34:34.411921 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-59559ef1-e735-4ae6-8315-5351d609b3fd tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:34.416788 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-59559ef1-e735-4ae6-8315-5351d609b3fd tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:34.417508 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-59559ef1-e735-4ae6-8315-5351d609b3fd tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:34.419863 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-59559ef1-e735-4ae6-8315-5351d609b3fd tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:34.420593 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-59559ef1-e735-4ae6-8315-5351d609b3fd tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:34.420977 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-59559ef1-e735-4ae6-8315-5351d609b3fd tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:34.738562 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-59559ef1-e735-4ae6-8315-5351d609b3fd tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33d07a7db4846ababf001493c6e10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb0265509744c93b03fa5c28b4e9386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:34:34.757185 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-59559ef1-e735-4ae6-8315-5351d609b3fd tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] 10.222.0.52 "GET /compute/v2.1/servers/29a2d62a-83d9-43e2-8907-f4158500d83f" status: 200 len: 1495 microversion: 2.1 time: 0.383476 Oct 19 03:34:34.757810 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2311/4706] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:34:34 2022] GET /compute/v2.1/servers/29a2d62a-83d9-43e2-8907-f4158500d83f => generated 1495 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:34:34.780091 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-47ade5cb-1f90-43ee-a372-452a1fefb9a2 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:34:34.781328 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-47ade5cb-1f90-43ee-a372-452a1fefb9a2 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] [instance: ddbf7afb-1d7b-4d33-b6fb-1f1608c11985] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:34:34.794089 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-47ade5cb-1f90-43ee-a372-452a1fefb9a2 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:34.794595 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-47ade5cb-1f90-43ee-a372-452a1fefb9a2 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:34.795039 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-47ade5cb-1f90-43ee-a372-452a1fefb9a2 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:34.795766 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-47ade5cb-1f90-43ee-a372-452a1fefb9a2 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:34.796222 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-47ade5cb-1f90-43ee-a372-452a1fefb9a2 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:34.799836 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-47ade5cb-1f90-43ee-a372-452a1fefb9a2 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:35.033605 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-47ade5cb-1f90-43ee-a372-452a1fefb9a2 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c65a497e16e4e41b5cf1287042f3a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4001edd1474947a94243a620a6013a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:34:35.043846 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-47ade5cb-1f90-43ee-a372-452a1fefb9a2 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] 10.222.0.52 "GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985" status: 200 len: 1297 microversion: 2.1 time: 0.269073 Oct 19 03:34:35.054895 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2396/4707] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:34:34 2022] GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985 => generated 1297 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:34:35.786863 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ddd9bd9a-7185-4807-b3ba-c95d4cfe7c60 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:34:35.787486 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ddd9bd9a-7185-4807-b3ba-c95d4cfe7c60 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] [instance: 29a2d62a-83d9-43e2-8907-f4158500d83f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:34:35.796016 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ddd9bd9a-7185-4807-b3ba-c95d4cfe7c60 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:35.796912 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ddd9bd9a-7185-4807-b3ba-c95d4cfe7c60 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:35.797809 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ddd9bd9a-7185-4807-b3ba-c95d4cfe7c60 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:35.798701 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ddd9bd9a-7185-4807-b3ba-c95d4cfe7c60 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:35.799323 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ddd9bd9a-7185-4807-b3ba-c95d4cfe7c60 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:35.799918 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ddd9bd9a-7185-4807-b3ba-c95d4cfe7c60 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:36.068274 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-17c565b0-de0a-4a65-81ab-ceb2973b5163 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:34:36.069640 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-17c565b0-de0a-4a65-81ab-ceb2973b5163 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] [instance: ddbf7afb-1d7b-4d33-b6fb-1f1608c11985] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:34:36.092800 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-17c565b0-de0a-4a65-81ab-ceb2973b5163 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:36.092800 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-17c565b0-de0a-4a65-81ab-ceb2973b5163 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:36.092800 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-17c565b0-de0a-4a65-81ab-ceb2973b5163 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:36.092800 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-17c565b0-de0a-4a65-81ab-ceb2973b5163 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:36.098816 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-17c565b0-de0a-4a65-81ab-ceb2973b5163 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:36.103557 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-17c565b0-de0a-4a65-81ab-ceb2973b5163 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:36.426431 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-17c565b0-de0a-4a65-81ab-ceb2973b5163 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c65a497e16e4e41b5cf1287042f3a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4001edd1474947a94243a620a6013a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:34:36.439415 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-17c565b0-de0a-4a65-81ab-ceb2973b5163 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] 10.222.0.52 "GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985" status: 200 len: 1295 microversion: 2.1 time: 0.375946 Oct 19 03:34:36.446138 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2397/4708] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:34:36 2022] GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985 => generated 1295 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:34:36.566186 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ddd9bd9a-7185-4807-b3ba-c95d4cfe7c60 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33d07a7db4846ababf001493c6e10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb0265509744c93b03fa5c28b4e9386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:34:36.577849 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ddd9bd9a-7185-4807-b3ba-c95d4cfe7c60 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] 10.222.0.52 "GET /compute/v2.1/servers/29a2d62a-83d9-43e2-8907-f4158500d83f" status: 200 len: 1501 microversion: 2.1 time: 0.796346 Oct 19 03:34:36.581958 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2312/4709] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:34:35 2022] GET /compute/v2.1/servers/29a2d62a-83d9-43e2-8907-f4158500d83f => generated 1501 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:34:36.608775 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c97c7462-71c2-41f1-ac02-af38a5834311 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:34:36.609272 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c97c7462-71c2-41f1-ac02-af38a5834311 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] [instance: 29a2d62a-83d9-43e2-8907-f4158500d83f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:34:36.624866 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c97c7462-71c2-41f1-ac02-af38a5834311 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:36.625389 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c97c7462-71c2-41f1-ac02-af38a5834311 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:36.626658 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c97c7462-71c2-41f1-ac02-af38a5834311 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:36.627377 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c97c7462-71c2-41f1-ac02-af38a5834311 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:36.627837 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c97c7462-71c2-41f1-ac02-af38a5834311 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:36.628265 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c97c7462-71c2-41f1-ac02-af38a5834311 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:36.672835 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c97c7462-71c2-41f1-ac02-af38a5834311 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] [instance: 29a2d62a-83d9-43e2-8907-f4158500d83f] Going to try to terminate instance {{(pid=121135) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:34:36.891842 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4a5de1f3-b12e-441f-8ce2-514a5959e612 tempest-ListImageFiltersNegativeTestJSON-210441876 tempest-ListImageFiltersNegativeTestJSON-210441876-project] Calling method '.version_select at 0x7fc1300aa4c0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:34:36.925837 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-4a5de1f3-b12e-441f-8ce2-514a5959e612 tempest-ListImageFiltersNegativeTestJSON-210441876 tempest-ListImageFiltersNegativeTestJSON-210441876-project] HTTP exception thrown: Image not found. Oct 19 03:34:36.931017 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4a5de1f3-b12e-441f-8ce2-514a5959e612 tempest-ListImageFiltersNegativeTestJSON-210441876 tempest-ListImageFiltersNegativeTestJSON-210441876-project] Request method failure captured: Oct 19 03:34:36.931017 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/images/61078a1d-8c70-43b2-940f-9b4c9e3bcfdc HTTP/1.1 Oct 19 03:34:36.931017 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:34:36.931017 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:34:36.931017 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:34:36.931017 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:34:36.931017 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:34:36.931017 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:34:36.931017 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:34:36.931017 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:34:36.931017 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3BMUBt4o92l0EPk5GBH4znh5WnQics6LI7TkJEQPf6OxxHbfZIVOTfaqMZ0kh_2Dd-RMjrzzNEtkhBlppXclK0ydcSDCU-nqHNOcdEk4bcoWk1DGyCCA4o8ziOgI5ysC4jWK7KIT_0AVKHly9VfPvHKSIEujd_3VCFIqRrdRwidCb4 Oct 19 03:34:36.931017 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:34:36.931017 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:34:36.931017 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:34:36.931017 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:34:36.931017 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:34:36.931017 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:34:36.931017 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: aa28a4842ab14ea2a4dc3389b9b1573f Oct 19 03:34:36.931017 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-210441876 Oct 19 03:34:36.931017 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:34:36.931017 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:34:36.931017 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/aa28a4842ab14ea2a4dc3389b9b1573f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/aa28a4842ab14ea2a4dc3389b9b1573f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/aa28a4842ab14ea2a4dc3389b9b1573f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_aa28a4842ab14ea2a4dc3389b9b1573f", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:34:36.931017 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-210441876 Oct 19 03:34:36.931017 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: aa28a4842ab14ea2a4dc3389b9b1573f Oct 19 03:34:36.931017 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-210441876 Oct 19 03:34:36.931017 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ListImageFiltersNegativeTestJSON-210441876-project Oct 19 03:34:36.931017 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:34:36.931017 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:34:36.931017 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: ac68f64308014794a2002b72e4b10461 Oct 19 03:34:36.931017 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-210441876-project Oct 19 03:34:36.931017 n-d-861333-8 devstack@n-api.service[121134]: method: Oct 19 03:34:36.931017 n-d-861333-8 devstack@n-api.service[121134]: exception: Image not found. Oct 19 03:34:36.931017 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '61078a1d-8c70-43b2-940f-9b4c9e3bcfdc'} Oct 19 03:34:36.931017 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:34:36.931017 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:34:36.931017 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 19 03:34:36.931017 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 19 03:34:36.931017 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 19 03:34:36.931017 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 19 03:34:36.931017 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 19 03:34:36.931017 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 19 03:34:36.931017 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 19 03:34:36.931017 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 19 03:34:36.931017 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 19 03:34:36.931017 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 19 03:34:36.931017 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 19 03:34:36.931017 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 19 03:34:36.931017 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 19 03:34:36.931017 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 19 03:34:36.931017 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 19 03:34:36.931017 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 19 03:34:36.931017 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 61078a1d-8c70-43b2-940f-9b4c9e3bcfdc Oct 19 03:34:36.931017 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:34:36.931017 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:34:36.931017 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:34:36.931017 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:34:36.931017 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 19 03:34:36.931017 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 19 03:34:36.931017 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 19 03:34:36.931017 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 19 03:34:36.931017 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 19 03:34:36.931017 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 19 03:34:36.931017 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 19 03:34:36.935523 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 19 03:34:36.935523 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 19 03:34:36.935523 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 19 03:34:36.935523 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 19 03:34:36.935523 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 19 03:34:36.935523 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 19 03:34:36.935523 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 19 03:34:36.935523 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 19 03:34:36.935523 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 19 03:34:36.935523 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 19 03:34:36.935523 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 19 03:34:36.935523 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 19 03:34:36.935523 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 19 03:34:36.935523 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 19 03:34:36.935523 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 19 03:34:36.935523 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 19 03:34:36.935523 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 19 03:34:36.935523 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 61078a1d-8c70-43b2-940f-9b4c9e3bcfdc could not be found. Oct 19 03:34:36.935523 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:34:36.935523 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:34:36.935523 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:34:36.935523 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:34:36.935523 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:34:36.935523 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:34:36.935523 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:34:36.935523 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:34:36.935523 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 03:34:36.935523 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 03:34:36.935523 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:34:36.935523 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:34:36.935523 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 19 03:34:36.935523 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 19 03:34:36.935523 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 19 03:34:36.935523 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:34:36.935523 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:34:36.935523 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:34:36.935523 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:34:36.935523 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:34:36.935523 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:34:36.935523 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:34:36.935523 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:34:36.935523 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 19 03:34:36.935523 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:34:36.935523 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4a5de1f3-b12e-441f-8ce2-514a5959e612 tempest-ListImageFiltersNegativeTestJSON-210441876 tempest-ListImageFiltersNegativeTestJSON-210441876-project] Returning 404 to user: Image not found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:34:36.935523 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4a5de1f3-b12e-441f-8ce2-514a5959e612 tempest-ListImageFiltersNegativeTestJSON-210441876 tempest-ListImageFiltersNegativeTestJSON-210441876-project] 10.222.0.52 "GET /compute/v2.1/images/61078a1d-8c70-43b2-940f-9b4c9e3bcfdc" status: 404 len: 62 microversion: 2.1 time: 0.216031 Oct 19 03:34:36.935523 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2313/4710] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 19 03:34:36 2022] GET /compute/v2.1/images/61078a1d-8c70-43b2-940f-9b4c9e3bcfdc => generated 62 bytes in 218 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 03:34:37.036525 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c97c7462-71c2-41f1-ac02-af38a5834311 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] 10.222.0.52 "DELETE /compute/v2.1/servers/29a2d62a-83d9-43e2-8907-f4158500d83f" status: 204 len: 0 microversion: 2.1 time: 0.430001 Oct 19 03:34:37.038242 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2398/4711] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:34:36 2022] DELETE /compute/v2.1/servers/29a2d62a-83d9-43e2-8907-f4158500d83f => generated 0 bytes in 433 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:34:37.045751 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f4074175-9c7c-4f08-8e3e-c6b0a535a580 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:34:37.046595 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f4074175-9c7c-4f08-8e3e-c6b0a535a580 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] [instance: 29a2d62a-83d9-43e2-8907-f4158500d83f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:34:37.057333 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f4074175-9c7c-4f08-8e3e-c6b0a535a580 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:37.057870 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f4074175-9c7c-4f08-8e3e-c6b0a535a580 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:37.058327 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f4074175-9c7c-4f08-8e3e-c6b0a535a580 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:37.066812 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f4074175-9c7c-4f08-8e3e-c6b0a535a580 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:37.070784 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f4074175-9c7c-4f08-8e3e-c6b0a535a580 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:37.073469 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f4074175-9c7c-4f08-8e3e-c6b0a535a580 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:37.468218 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-cc0f4356-6d9b-47fe-96ad-a6918a4df4c0 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:34:37.469944 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-cc0f4356-6d9b-47fe-96ad-a6918a4df4c0 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] [instance: ddbf7afb-1d7b-4d33-b6fb-1f1608c11985] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:34:37.484223 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cc0f4356-6d9b-47fe-96ad-a6918a4df4c0 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:37.485814 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cc0f4356-6d9b-47fe-96ad-a6918a4df4c0 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:37.486941 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cc0f4356-6d9b-47fe-96ad-a6918a4df4c0 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:37.488716 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cc0f4356-6d9b-47fe-96ad-a6918a4df4c0 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:37.490536 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cc0f4356-6d9b-47fe-96ad-a6918a4df4c0 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:37.496246 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cc0f4356-6d9b-47fe-96ad-a6918a4df4c0 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:37.720117 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-cc0f4356-6d9b-47fe-96ad-a6918a4df4c0 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c65a497e16e4e41b5cf1287042f3a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4001edd1474947a94243a620a6013a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:34:37.732229 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-cc0f4356-6d9b-47fe-96ad-a6918a4df4c0 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] 10.222.0.52 "GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985" status: 200 len: 1295 microversion: 2.1 time: 0.268215 Oct 19 03:34:37.732805 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2399/4712] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:34:37 2022] GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985 => generated 1295 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:34:38.131029 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-f4074175-9c7c-4f08-8e3e-c6b0a535a580 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33d07a7db4846ababf001493c6e10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb0265509744c93b03fa5c28b4e9386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:34:38.141850 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f4074175-9c7c-4f08-8e3e-c6b0a535a580 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] 10.222.0.52 "GET /compute/v2.1/servers/29a2d62a-83d9-43e2-8907-f4158500d83f" status: 200 len: 1507 microversion: 2.1 time: 1.099981 Oct 19 03:34:38.145878 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2314/4713] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:34:37 2022] GET /compute/v2.1/servers/29a2d62a-83d9-43e2-8907-f4158500d83f => generated 1507 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:34:38.777715 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-84fe146e-fc63-420c-970a-7f525e0b9a04 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:34:38.780815 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-84fe146e-fc63-420c-970a-7f525e0b9a04 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] [instance: ddbf7afb-1d7b-4d33-b6fb-1f1608c11985] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:34:38.797389 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-84fe146e-fc63-420c-970a-7f525e0b9a04 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:38.799228 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-84fe146e-fc63-420c-970a-7f525e0b9a04 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:38.799680 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-84fe146e-fc63-420c-970a-7f525e0b9a04 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:38.801960 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-84fe146e-fc63-420c-970a-7f525e0b9a04 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:38.802730 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-84fe146e-fc63-420c-970a-7f525e0b9a04 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:38.805783 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-84fe146e-fc63-420c-970a-7f525e0b9a04 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:39.088551 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-84fe146e-fc63-420c-970a-7f525e0b9a04 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c65a497e16e4e41b5cf1287042f3a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4001edd1474947a94243a620a6013a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:34:39.102411 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-84fe146e-fc63-420c-970a-7f525e0b9a04 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] 10.222.0.52 "GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985" status: 200 len: 1362 microversion: 2.1 time: 0.346034 Oct 19 03:34:39.103010 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2400/4714] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:34:38 2022] GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985 => generated 1362 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:34:39.169188 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-61dc11e1-e832-4b6b-b91b-c68282ee816c tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:34:39.170467 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-61dc11e1-e832-4b6b-b91b-c68282ee816c tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] [instance: 29a2d62a-83d9-43e2-8907-f4158500d83f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:34:39.181542 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-61dc11e1-e832-4b6b-b91b-c68282ee816c tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:39.182034 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-61dc11e1-e832-4b6b-b91b-c68282ee816c tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:39.182476 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-61dc11e1-e832-4b6b-b91b-c68282ee816c tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:39.183193 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-61dc11e1-e832-4b6b-b91b-c68282ee816c tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:39.183654 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-61dc11e1-e832-4b6b-b91b-c68282ee816c tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:39.184119 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-61dc11e1-e832-4b6b-b91b-c68282ee816c tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:39.788900 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-61dc11e1-e832-4b6b-b91b-c68282ee816c tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33d07a7db4846ababf001493c6e10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb0265509744c93b03fa5c28b4e9386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:34:39.823758 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:34:39.831720 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-61dc11e1-e832-4b6b-b91b-c68282ee816c tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] 10.222.0.52 "GET /compute/v2.1/servers/29a2d62a-83d9-43e2-8907-f4158500d83f" status: 200 len: 1507 microversion: 2.1 time: 0.667356 Oct 19 03:34:39.838897 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2315/4715] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:34:39 2022] GET /compute/v2.1/servers/29a2d62a-83d9-43e2-8907-f4158500d83f => generated 1507 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:34:40.137739 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b54b0d57-f3fc-4529-987c-5a92638cd196 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:34:40.140533 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b54b0d57-f3fc-4529-987c-5a92638cd196 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] [instance: ddbf7afb-1d7b-4d33-b6fb-1f1608c11985] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:34:40.164012 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b54b0d57-f3fc-4529-987c-5a92638cd196 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:40.165511 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b54b0d57-f3fc-4529-987c-5a92638cd196 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:40.166317 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b54b0d57-f3fc-4529-987c-5a92638cd196 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:40.167170 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b54b0d57-f3fc-4529-987c-5a92638cd196 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:40.167879 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b54b0d57-f3fc-4529-987c-5a92638cd196 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:40.168408 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b54b0d57-f3fc-4529-987c-5a92638cd196 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:40.369998 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f6267953-a83d-40de-a36e-1e1250357dab tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:34:40.370617 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f6267953-a83d-40de-a36e-1e1250357dab tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:34:40.412790 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f6267953-a83d-40de-a36e-1e1250357dab tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:40.417903 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f6267953-a83d-40de-a36e-1e1250357dab tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:40.419207 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f6267953-a83d-40de-a36e-1e1250357dab tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:40.420186 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f6267953-a83d-40de-a36e-1e1250357dab tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:40.421061 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f6267953-a83d-40de-a36e-1e1250357dab tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:40.424552 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f6267953-a83d-40de-a36e-1e1250357dab tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:40.617226 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b54b0d57-f3fc-4529-987c-5a92638cd196 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c65a497e16e4e41b5cf1287042f3a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4001edd1474947a94243a620a6013a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:34:40.631476 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b54b0d57-f3fc-4529-987c-5a92638cd196 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] 10.222.0.52 "GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985" status: 200 len: 1362 microversion: 2.1 time: 0.508143 Oct 19 03:34:40.634800 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2401/4716] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:34:40 2022] GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985 => generated 1362 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:34:40.762469 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-f6267953-a83d-40de-a36e-1e1250357dab tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:34:40.778318 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f6267953-a83d-40de-a36e-1e1250357dab tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1670 microversion: 2.1 time: 0.413018 Oct 19 03:34:40.784169 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2316/4717] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:34:40 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1670 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:34:40.809304 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a1adb536-21e2-4c29-bd0c-8e5ccaa28476 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:34:40.810303 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a1adb536-21e2-4c29-bd0c-8e5ccaa28476 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:34:40.831136 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a1adb536-21e2-4c29-bd0c-8e5ccaa28476 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:40.831136 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a1adb536-21e2-4c29-bd0c-8e5ccaa28476 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:40.831136 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a1adb536-21e2-4c29-bd0c-8e5ccaa28476 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:40.838410 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a1adb536-21e2-4c29-bd0c-8e5ccaa28476 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:40.839039 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a1adb536-21e2-4c29-bd0c-8e5ccaa28476 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:40.839742 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a1adb536-21e2-4c29-bd0c-8e5ccaa28476 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:40.871504 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8c00aa9b-441f-4d36-a751-32fd5481a6d6 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:34:40.872597 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8c00aa9b-441f-4d36-a751-32fd5481a6d6 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] [instance: 29a2d62a-83d9-43e2-8907-f4158500d83f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:34:40.892917 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8c00aa9b-441f-4d36-a751-32fd5481a6d6 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:40.913969 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8c00aa9b-441f-4d36-a751-32fd5481a6d6 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:40.917817 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8c00aa9b-441f-4d36-a751-32fd5481a6d6 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:40.918773 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8c00aa9b-441f-4d36-a751-32fd5481a6d6 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:40.924300 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8c00aa9b-441f-4d36-a751-32fd5481a6d6 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:40.928278 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8c00aa9b-441f-4d36-a751-32fd5481a6d6 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:40.928278 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:34:41.176622 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a1adb536-21e2-4c29-bd0c-8e5ccaa28476 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:34:41.192098 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a1adb536-21e2-4c29-bd0c-8e5ccaa28476 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1670 microversion: 2.1 time: 0.386742 Oct 19 03:34:41.195030 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2402/4718] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:34:40 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1670 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:34:41.243116 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7a312800-0ca3-4e24-895c-4d9cc06fb80d tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:34:41.245692 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7a312800-0ca3-4e24-895c-4d9cc06fb80d tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:34:41.267605 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7a312800-0ca3-4e24-895c-4d9cc06fb80d tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:41.268217 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7a312800-0ca3-4e24-895c-4d9cc06fb80d tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:41.276199 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7a312800-0ca3-4e24-895c-4d9cc06fb80d tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:41.278523 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7a312800-0ca3-4e24-895c-4d9cc06fb80d tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:41.279128 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7a312800-0ca3-4e24-895c-4d9cc06fb80d tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:41.283082 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7a312800-0ca3-4e24-895c-4d9cc06fb80d tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:41.349603 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8c00aa9b-441f-4d36-a751-32fd5481a6d6 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33d07a7db4846ababf001493c6e10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb0265509744c93b03fa5c28b4e9386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:34:41.352148 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=12 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:34:41.368108 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8c00aa9b-441f-4d36-a751-32fd5481a6d6 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] 10.222.0.52 "GET /compute/v2.1/servers/29a2d62a-83d9-43e2-8907-f4158500d83f" status: 200 len: 1507 microversion: 2.1 time: 0.506117 Oct 19 03:34:41.389353 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2317/4719] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:34:40 2022] GET /compute/v2.1/servers/29a2d62a-83d9-43e2-8907-f4158500d83f => generated 1507 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:34:41.561763 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-dc71ae07-177c-4c64-918e-9334531b5902 req-1b572fcc-b97b-497b-983f-4bf8ab19dca2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ddbf7afb-1d7b-4d33-b6fb-1f1608c11985", "tag": "bfb7e67f-f9af-4eb9-93e7-64332e835840"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:34:41.575569 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-dc71ae07-177c-4c64-918e-9334531b5902 req-1b572fcc-b97b-497b-983f-4bf8ab19dca2 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:41.576298 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-dc71ae07-177c-4c64-918e-9334531b5902 req-1b572fcc-b97b-497b-983f-4bf8ab19dca2 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:41.577026 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-dc71ae07-177c-4c64-918e-9334531b5902 req-1b572fcc-b97b-497b-983f-4bf8ab19dca2 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:41.592356 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-dc71ae07-177c-4c64-918e-9334531b5902 req-1b572fcc-b97b-497b-983f-4bf8ab19dca2 service nova] Creating event network-changed:bfb7e67f-f9af-4eb9-93e7-64332e835840 for instance ddbf7afb-1d7b-4d33-b6fb-1f1608c11985 on n-h2-861333-8 Oct 19 03:34:41.601478 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-dc71ae07-177c-4c64-918e-9334531b5902 req-1b572fcc-b97b-497b-983f-4bf8ab19dca2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044420 Oct 19 03:34:41.603266 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2318/4720] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:34:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:34:41.663278 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-77c4252b-fccb-4c0f-bb0c-f3921edf9de0 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:34:41.664021 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-77c4252b-fccb-4c0f-bb0c-f3921edf9de0 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] [instance: ddbf7afb-1d7b-4d33-b6fb-1f1608c11985] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:34:41.671205 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-77c4252b-fccb-4c0f-bb0c-f3921edf9de0 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:41.672031 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-77c4252b-fccb-4c0f-bb0c-f3921edf9de0 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:41.672705 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-77c4252b-fccb-4c0f-bb0c-f3921edf9de0 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:41.673642 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-77c4252b-fccb-4c0f-bb0c-f3921edf9de0 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:41.674308 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-77c4252b-fccb-4c0f-bb0c-f3921edf9de0 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:41.674967 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-77c4252b-fccb-4c0f-bb0c-f3921edf9de0 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:41.704292 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7a312800-0ca3-4e24-895c-4d9cc06fb80d tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:34:41.718531 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7a312800-0ca3-4e24-895c-4d9cc06fb80d tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1670 microversion: 2.1 time: 0.499148 Oct 19 03:34:41.720054 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2403/4721] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:34:41 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1670 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:34:41.752687 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-cf1d7e31-c85f-4a74-a1db-af5844ebb204 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:34:41.753648 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-cf1d7e31-c85f-4a74-a1db-af5844ebb204 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:34:41.761722 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cf1d7e31-c85f-4a74-a1db-af5844ebb204 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:41.763026 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cf1d7e31-c85f-4a74-a1db-af5844ebb204 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:41.763711 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cf1d7e31-c85f-4a74-a1db-af5844ebb204 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:41.764709 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cf1d7e31-c85f-4a74-a1db-af5844ebb204 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:41.765413 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cf1d7e31-c85f-4a74-a1db-af5844ebb204 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:41.766749 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cf1d7e31-c85f-4a74-a1db-af5844ebb204 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:42.047578 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-cf1d7e31-c85f-4a74-a1db-af5844ebb204 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:34:42.058608 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-77c4252b-fccb-4c0f-bb0c-f3921edf9de0 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c65a497e16e4e41b5cf1287042f3a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4001edd1474947a94243a620a6013a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:34:42.058608 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-77c4252b-fccb-4c0f-bb0c-f3921edf9de0 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] 10.222.0.52 "GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985" status: 200 len: 1362 microversion: 2.1 time: 0.398875 Oct 19 03:34:42.058608 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2319/4722] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:34:41 2022] GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985 => generated 1362 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:34:42.108945 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-cf1d7e31-c85f-4a74-a1db-af5844ebb204 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1670 microversion: 2.1 time: 0.365549 Oct 19 03:34:42.112879 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2404/4723] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:34:41 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1670 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:34:42.275481 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7db98350-24aa-490c-8c47-15e4f71c4c8b tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1827390635", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "networks": [{"uuid": "6b668808-7c3c-40ac-9532-ec2c53b84149"}]}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:34:42.341634 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.network.neutron [None req-7db98350-24aa-490c-8c47-15e4f71c4c8b tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] validate_networks() for [('6b668808-7c3c-40ac-9532-ec2c53b84149', None, None, None, None, None)] {{(pid=121135) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:34:42.498245 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-745cdf34-22b0-4181-8c3e-8aa53987dc50 tempest-KeyPairsNegativeTestJSON-1042630428 tempest-KeyPairsNegativeTestJSON-1042630428-project] Action: 'create', calling method: .version_select at 0x7fc13043fa60>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBESDmKoiY3H9tR1dpl7/m1YVL/n46L206j+EyRMsFUbARxxu0TB8OXWE+GZIHsQlYf6rftpKeVevHNURvrt1W+lUvGXIklnZL08dpf5fT1IzzsTA5MzpxMOAVAX8RtQdEg=="}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:34:42.504436 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-745cdf34-22b0-4181-8c3e-8aa53987dc50 tempest-KeyPairsNegativeTestJSON-1042630428 tempest-KeyPairsNegativeTestJSON-1042630428-project] Request method failure captured: Oct 19 03:34:42.504436 n-d-861333-8 devstack@n-api.service[121134]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 19 03:34:42.504436 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:34:42.504436 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:34:42.504436 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:34:42.504436 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 257 Oct 19 03:34:42.504436 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:34:42.504436 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:34:42.504436 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:34:42.504436 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:34:42.504436 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3BSkziNdp68TF5rUFzgXJrTsNvP6tQOpPQ5A97IEAcK8_AO6XbVk20fyJ_UpCXhw3axL0tRi3QIw_D7ssPglGVXiDzAVes6aT7G7GSCgV3HsWuSg5VYQtmvOjcZoBnS_MrNfHlZFnttKNPm2BSuug3Esi2SP9jPLpnAuaAvCZ4C8Hc Oct 19 03:34:42.504436 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:34:42.504436 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:34:42.504436 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:34:42.504436 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:34:42.504436 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:34:42.504436 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:34:42.504436 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 915dfb0f6811458eb1b6c6e65806ef24 Oct 19 03:34:42.504436 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1042630428 Oct 19 03:34:42.504436 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:34:42.504436 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:34:42.504436 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/915dfb0f6811458eb1b6c6e65806ef24"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/915dfb0f6811458eb1b6c6e65806ef24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/915dfb0f6811458eb1b6c6e65806ef24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_915dfb0f6811458eb1b6c6e65806ef24", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:34:42.504436 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1042630428 Oct 19 03:34:42.504436 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 915dfb0f6811458eb1b6c6e65806ef24 Oct 19 03:34:42.504436 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1042630428 Oct 19 03:34:42.504436 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-KeyPairsNegativeTestJSON-1042630428-project Oct 19 03:34:42.504436 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:34:42.504436 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:34:42.504436 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 4093da306bef4da39a2a43aef41bc4a1 Oct 19 03:34:42.504436 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1042630428-project Oct 19 03:34:42.504436 n-d-861333-8 devstack@n-api.service[121134]: Oct 19 03:34:42.504436 n-d-861333-8 devstack@n-api.service[121134]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBESDmKoiY3H9tR1dpl7/m1YVL/n46L206j+EyRMsFUbARxxu0TB8OXWE+GZIHsQlYf6rftpKeVevHNURvrt1W+lUvGXIklnZL08dpf5fT1IzzsTA5MzpxMOAVAX8RtQdEg=="}} Oct 19 03:34:42.504436 n-d-861333-8 devstack@n-api.service[121134]: method: Oct 19 03:34:42.504436 n-d-861333-8 devstack@n-api.service[121134]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 19 03:34:42.504436 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBESDmKoiY3H9tR1dpl7/m1YVL/n46L206j+EyRMsFUbARxxu0TB8OXWE+GZIHsQlYf6rftpKeVevHNURvrt1W+lUvGXIklnZL08dpf5fT1IzzsTA5MzpxMOAVAX8RtQdEg=='}}} Oct 19 03:34:42.504436 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:34:42.504436 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:34:42.504436 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 19 03:34:42.504436 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 19 03:34:42.504436 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Oct 19 03:34:42.504436 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Oct 19 03:34:42.504436 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Oct 19 03:34:42.504436 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Oct 19 03:34:42.504436 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 19 03:34:42.504436 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:34:42.504436 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 19 03:34:42.504436 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:34:42.504436 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:34:42.504436 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 03:34:42.504436 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 03:34:42.504436 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 03:34:42.504436 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise error Oct 19 03:34:42.504436 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Oct 19 03:34:42.504436 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:34:42.504436 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Oct 19 03:34:42.504436 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Oct 19 03:34:42.504436 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Oct 19 03:34:42.504436 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi 'minLength': 1, Oct 19 03:34:42.504436 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 19 03:34:42.504436 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:34:42.504436 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Oct 19 03:34:42.504436 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Oct 19 03:34:42.504436 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:34:42.510700 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:34:42.510700 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:34:42.510700 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:34:42.510700 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:34:42.510700 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:34:42.510700 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:34:42.510700 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:34:42.510700 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 03:34:42.510700 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 03:34:42.510700 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:34:42.510700 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:34:42.510700 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:34:42.510700 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:34:42.510700 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 03:34:42.510700 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 03:34:42.510700 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 03:34:42.510700 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 03:34:42.510700 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 03:34:42.510700 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 03:34:42.510700 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 19 03:34:42.510700 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:34:42.510700 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:34:42.510700 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:34:42.510700 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:34:42.510700 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:34:42.510700 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:34:42.510700 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 03:34:42.510700 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 03:34:42.510700 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 19 03:34:42.510700 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:34:42.510700 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-745cdf34-22b0-4181-8c3e-8aa53987dc50 tempest-KeyPairsNegativeTestJSON-1042630428 tempest-KeyPairsNegativeTestJSON-1042630428-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:34:42.510700 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-745cdf34-22b0-4181-8c3e-8aa53987dc50 tempest-KeyPairsNegativeTestJSON-1042630428 tempest-KeyPairsNegativeTestJSON-1042630428-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.235339 Oct 19 03:34:42.510700 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2320/4724] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Oct 19 03:34:42 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 237 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 03:34:42.518441 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-21276d61-452b-4fb7-bf37-5e5d01a2de9e tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:34:42.519365 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-21276d61-452b-4fb7-bf37-5e5d01a2de9e tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] [instance: 29a2d62a-83d9-43e2-8907-f4158500d83f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:34:42.527207 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-21276d61-452b-4fb7-bf37-5e5d01a2de9e tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:42.527800 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-21276d61-452b-4fb7-bf37-5e5d01a2de9e tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:42.528384 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-21276d61-452b-4fb7-bf37-5e5d01a2de9e tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:42.529096 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-21276d61-452b-4fb7-bf37-5e5d01a2de9e tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:42.529624 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-21276d61-452b-4fb7-bf37-5e5d01a2de9e tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:42.536745 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-21276d61-452b-4fb7-bf37-5e5d01a2de9e tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:42.544788 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:34:43.133825 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-21276d61-452b-4fb7-bf37-5e5d01a2de9e tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33d07a7db4846ababf001493c6e10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb0265509744c93b03fa5c28b4e9386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:34:43.143330 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-21276d61-452b-4fb7-bf37-5e5d01a2de9e tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] 10.222.0.52 "GET /compute/v2.1/servers/29a2d62a-83d9-43e2-8907-f4158500d83f" status: 200 len: 1465 microversion: 2.1 time: 0.635203 Oct 19 03:34:43.144065 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2321/4725] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:34:42 2022] GET /compute/v2.1/servers/29a2d62a-83d9-43e2-8907-f4158500d83f => generated 1465 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:34:43.148841 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-44dee157-a586-4113-befe-50e80ba21da8 req-8a641189-37ea-4a69-8512-c056dd30a247 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29a2d62a-83d9-43e2-8907-f4158500d83f", "name": "network-vif-deleted", "tag": "d7bf81fc-6464-4f97-a400-1c33007d5ac3"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:34:43.158403 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-44dee157-a586-4113-befe-50e80ba21da8 req-8a641189-37ea-4a69-8512-c056dd30a247 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:43.159099 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-44dee157-a586-4113-befe-50e80ba21da8 req-8a641189-37ea-4a69-8512-c056dd30a247 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:43.159827 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-44dee157-a586-4113-befe-50e80ba21da8 req-8a641189-37ea-4a69-8512-c056dd30a247 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:43.171514 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-44dee157-a586-4113-befe-50e80ba21da8 req-8a641189-37ea-4a69-8512-c056dd30a247 service nova] Creating event network-vif-deleted:d7bf81fc-6464-4f97-a400-1c33007d5ac3 for instance 29a2d62a-83d9-43e2-8907-f4158500d83f on n-h1-861333-8 Oct 19 03:34:43.177327 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-44dee157-a586-4113-befe-50e80ba21da8 req-8a641189-37ea-4a69-8512-c056dd30a247 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032078 Oct 19 03:34:43.178074 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2322/4726] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:34:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:34:43.183314 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9fde11ac-5b2c-49ff-ab15-c560b250ea4c tempest-KeyPairsNegativeTestJSON-1042630428 tempest-KeyPairsNegativeTestJSON-1042630428-project] Action: 'create', calling method: .version_select at 0x7fc1300aa310>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-530773531", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:34:43.200583 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-9fde11ac-5b2c-49ff-ab15-c560b250ea4c tempest-KeyPairsNegativeTestJSON-1042630428 tempest-KeyPairsNegativeTestJSON-1042630428-project] Getting quotas for project 915dfb0f6811458eb1b6c6e65806ef24. Resources: {'key_pairs'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:34:43.206241 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-9fde11ac-5b2c-49ff-ab15-c560b250ea4c tempest-KeyPairsNegativeTestJSON-1042630428 tempest-KeyPairsNegativeTestJSON-1042630428-project] Getting quotas for user 4093da306bef4da39a2a43aef41bc4a1 and project 915dfb0f6811458eb1b6c6e65806ef24. Resources: {'key_pairs'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:34:43.228609 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-9fde11ac-5b2c-49ff-ab15-c560b250ea4c tempest-KeyPairsNegativeTestJSON-1042630428 tempest-KeyPairsNegativeTestJSON-1042630428-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 19 03:34:43.250220 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9fde11ac-5b2c-49ff-ab15-c560b250ea4c tempest-KeyPairsNegativeTestJSON-1042630428 tempest-KeyPairsNegativeTestJSON-1042630428-project] Request method failure captured: Oct 19 03:34:43.250220 n-d-861333-8 devstack@n-api.service[121134]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 19 03:34:43.250220 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:34:43.250220 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:34:43.250220 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:34:43.250220 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 2166 Oct 19 03:34:43.250220 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:34:43.250220 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:34:43.250220 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:34:43.250220 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:34:43.250220 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3BSkziNdp68TF5rUFzgXJrTsNvP6tQOpPQ5A97IEAcK8_AO6XbVk20fyJ_UpCXhw3axL0tRi3QIw_D7ssPglGVXiDzAVes6aT7G7GSCgV3HsWuSg5VYQtmvOjcZoBnS_MrNfHlZFnttKNPm2BSuug3Esi2SP9jPLpnAuaAvCZ4C8Hc Oct 19 03:34:43.250220 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:34:43.250220 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:34:43.250220 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:34:43.250220 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:34:43.250220 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:34:43.250220 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:34:43.250220 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 915dfb0f6811458eb1b6c6e65806ef24 Oct 19 03:34:43.250220 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1042630428 Oct 19 03:34:43.250220 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:34:43.250220 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:34:43.250220 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/915dfb0f6811458eb1b6c6e65806ef24"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/915dfb0f6811458eb1b6c6e65806ef24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/915dfb0f6811458eb1b6c6e65806ef24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_915dfb0f6811458eb1b6c6e65806ef24", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:34:43.250220 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1042630428 Oct 19 03:34:43.250220 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 915dfb0f6811458eb1b6c6e65806ef24 Oct 19 03:34:43.250220 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1042630428 Oct 19 03:34:43.250220 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-KeyPairsNegativeTestJSON-1042630428-project Oct 19 03:34:43.250220 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:34:43.250220 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:34:43.250220 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 4093da306bef4da39a2a43aef41bc4a1 Oct 19 03:34:43.250220 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1042630428-project Oct 19 03:34:43.250220 n-d-861333-8 devstack@n-api.service[121134]: Oct 19 03:34:43.250220 n-d-861333-8 devstack@n-api.service[121134]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-530773531", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Oct 19 03:34:43.250220 n-d-861333-8 devstack@n-api.service[121134]: method: Oct 19 03:34:43.250220 n-d-861333-8 devstack@n-api.service[121134]: exception: Keypair data is invalid: failed to generate fingerprint Oct 19 03:34:43.253531 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-530773531', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Oct 19 03:34:43.253531 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:34:43.253531 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:34:43.253531 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 19 03:34:43.253531 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 19 03:34:43.253531 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Oct 19 03:34:43.253531 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Oct 19 03:34:43.253531 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Oct 19 03:34:43.253531 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:34:43.253531 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:34:43.253531 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:34:43.253531 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:34:43.253531 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 19 03:34:43.253531 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 19 03:34:43.253531 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 19 03:34:43.253531 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 19 03:34:43.253531 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 03:34:43.253531 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 03:34:43.253531 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 03:34:43.253531 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 03:34:43.253531 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 19 03:34:43.253531 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 19 03:34:43.253531 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 19 03:34:43.253531 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 19 03:34:43.253531 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 19 03:34:43.253531 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 19 03:34:43.253531 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 19 03:34:43.253531 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 19 03:34:43.253531 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 19 03:34:43.253531 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:34:43.253531 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:34:43.253531 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:34:43.253531 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:34:43.253531 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:34:43.253531 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:34:43.253531 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:34:43.253531 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:34:43.253531 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 03:34:43.253531 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 03:34:43.253531 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:34:43.253531 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:34:43.256524 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:34:43.256524 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:34:43.256524 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:34:43.256524 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:34:43.256524 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 19 03:34:43.256524 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 19 03:34:43.256524 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 19 03:34:43.256524 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 19 03:34:43.256524 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 19 03:34:43.256524 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:34:43.256524 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:34:43.256524 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:34:43.256524 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:34:43.256524 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:34:43.256524 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:34:43.256524 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:34:43.256524 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:34:43.256524 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 19 03:34:43.256524 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:34:43.256524 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9fde11ac-5b2c-49ff-ab15-c560b250ea4c tempest-KeyPairsNegativeTestJSON-1042630428 tempest-KeyPairsNegativeTestJSON-1042630428-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:34:43.256524 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9fde11ac-5b2c-49ff-ab15-c560b250ea4c tempest-KeyPairsNegativeTestJSON-1042630428 tempest-KeyPairsNegativeTestJSON-1042630428-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.073724 Oct 19 03:34:43.256524 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2323/4727] 10.222.0.52 () {60 vars in 1160 bytes} [Wed Oct 19 03:34:43 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 75 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 19 03:34:43.265197 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7dabaadd-f06c-450f-882f-147aab93e8bc tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:34:43.267680 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7dabaadd-f06c-450f-882f-147aab93e8bc tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] [instance: ddbf7afb-1d7b-4d33-b6fb-1f1608c11985] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:34:43.318260 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7dabaadd-f06c-450f-882f-147aab93e8bc tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:43.319696 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7dabaadd-f06c-450f-882f-147aab93e8bc tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:43.321967 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7dabaadd-f06c-450f-882f-147aab93e8bc tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:43.322893 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7dabaadd-f06c-450f-882f-147aab93e8bc tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:43.323572 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7dabaadd-f06c-450f-882f-147aab93e8bc tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:43.324145 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7dabaadd-f06c-450f-882f-147aab93e8bc tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:43.829792 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-7dabaadd-f06c-450f-882f-147aab93e8bc tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c65a497e16e4e41b5cf1287042f3a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4001edd1474947a94243a620a6013a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:34:43.842551 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7dabaadd-f06c-450f-882f-147aab93e8bc tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] 10.222.0.52 "GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985" status: 200 len: 1362 microversion: 2.1 time: 0.585797 Oct 19 03:34:43.862225 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2324/4728] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:34:43 2022] GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985 => generated 1362 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:34:43.865018 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-53f6a68f-c805-4f58-b716-971a312be521 tempest-KeyPairsNegativeTestJSON-1042630428 tempest-KeyPairsNegativeTestJSON-1042630428-project] Action: 'create', calling method: .version_select at 0x7fc130cc4e50>, body: {"keypair": {"name": "tempest-keypair-221169044", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO7EYDSpnXBXuPo8cxwV+B94w0S9vvTW8aCTbf2uiGaEziBE6aSovRILYnErgnLvU0jF8zqsU/GvrP7LV+TmyUph9VHU8XSuaeCbYAWeHj1m5Xf8yvdgschO1GBppOqz4A=="}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:34:43.908661 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-53f6a68f-c805-4f58-b716-971a312be521 tempest-KeyPairsNegativeTestJSON-1042630428 tempest-KeyPairsNegativeTestJSON-1042630428-project] Getting quotas for project 915dfb0f6811458eb1b6c6e65806ef24. Resources: {'key_pairs'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:34:43.919202 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-53f6a68f-c805-4f58-b716-971a312be521 tempest-KeyPairsNegativeTestJSON-1042630428 tempest-KeyPairsNegativeTestJSON-1042630428-project] Getting quotas for user 4093da306bef4da39a2a43aef41bc4a1 and project 915dfb0f6811458eb1b6c6e65806ef24. Resources: {'key_pairs'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:34:43.935863 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-7db98350-24aa-490c-8c47-15e4f71c4c8b tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Flavor limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:34:43.936621 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-7db98350-24aa-490c-8c47-15e4f71c4c8b tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Image limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:34:43.937703 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-7db98350-24aa-490c-8c47-15e4f71c4c8b tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Flavor pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:34:43.938732 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-7db98350-24aa-490c-8c47-15e4f71c4c8b tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Image pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:34:43.941672 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-7db98350-24aa-490c-8c47-15e4f71c4c8b tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:34:43.958331 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7db98350-24aa-490c-8c47-15e4f71c4c8b tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:43.959394 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7db98350-24aa-490c-8c47-15e4f71c4c8b tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:43.960090 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7db98350-24aa-490c-8c47-15e4f71c4c8b tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:43.961857 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7db98350-24aa-490c-8c47-15e4f71c4c8b tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:43.962090 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7db98350-24aa-490c-8c47-15e4f71c4c8b tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:43.962704 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7db98350-24aa-490c-8c47-15e4f71c4c8b tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:43.985777 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-7db98350-24aa-490c-8c47-15e4f71c4c8b tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Getting quotas for project a5f56376721941f8ae2293f8f969db84. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:34:43.992577 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-7db98350-24aa-490c-8c47-15e4f71c4c8b tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Getting quotas for user 746e1034a7ee40c1a69c8838c1e17e16 and project a5f56376721941f8ae2293f8f969db84. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:34:44.007552 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7db98350-24aa-490c-8c47-15e4f71c4c8b tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Going to run 1 instances... {{(pid=121135) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:34:44.010174 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7db98350-24aa-490c-8c47-15e4f71c4c8b tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 04f651af-d26c-4307-bb5a-bf3a61160dbb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121135) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:34:44.022486 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-53f6a68f-c805-4f58-b716-971a312be521 tempest-KeyPairsNegativeTestJSON-1042630428 tempest-KeyPairsNegativeTestJSON-1042630428-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.170027 Oct 19 03:34:44.023398 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2325/4729] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Oct 19 03:34:43 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:34:44.044767 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-37548a87-1e01-4b9e-adff-f9795afb256a tempest-KeyPairsNegativeTestJSON-1042630428 tempest-KeyPairsNegativeTestJSON-1042630428-project] Action: 'create', calling method: .version_select at 0x7fc12bf82e50>, body: {"keypair": {"name": "tempest-keypair-221169044", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8OCGWhw9Oao9PCTl0ipB+weIVAaXyQXBjtIco5jX/RtKKv6K3y3/Qx6wL0jzTm7eM1PMYamXH7/pIwcaC8abul6BQ+wsRsmmzNEsWFfuNVNVZ0CeUB/VnkcwtOul8auA=="}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:34:44.076219 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-37548a87-1e01-4b9e-adff-f9795afb256a tempest-KeyPairsNegativeTestJSON-1042630428 tempest-KeyPairsNegativeTestJSON-1042630428-project] Getting quotas for project 915dfb0f6811458eb1b6c6e65806ef24. Resources: {'key_pairs'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:34:44.084645 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-37548a87-1e01-4b9e-adff-f9795afb256a tempest-KeyPairsNegativeTestJSON-1042630428 tempest-KeyPairsNegativeTestJSON-1042630428-project] Getting quotas for user 4093da306bef4da39a2a43aef41bc4a1 and project 915dfb0f6811458eb1b6c6e65806ef24. Resources: {'key_pairs'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:34:44.144904 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-37548a87-1e01-4b9e-adff-f9795afb256a tempest-KeyPairsNegativeTestJSON-1042630428 tempest-KeyPairsNegativeTestJSON-1042630428-project] HTTP exception thrown: Key pair 'tempest-keypair-221169044' already exists. Oct 19 03:34:44.156103 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-37548a87-1e01-4b9e-adff-f9795afb256a tempest-KeyPairsNegativeTestJSON-1042630428 tempest-KeyPairsNegativeTestJSON-1042630428-project] Request method failure captured: Oct 19 03:34:44.156103 n-d-861333-8 devstack@n-api.service[121134]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 19 03:34:44.156103 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:34:44.156103 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:34:44.156103 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:34:44.156103 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 272 Oct 19 03:34:44.156103 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:34:44.156103 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:34:44.156103 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:34:44.156103 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:34:44.156103 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3BSkziNdp68TF5rUFzgXJrTsNvP6tQOpPQ5A97IEAcK8_AO6XbVk20fyJ_UpCXhw3axL0tRi3QIw_D7ssPglGVXiDzAVes6aT7G7GSCgV3HsWuSg5VYQtmvOjcZoBnS_MrNfHlZFnttKNPm2BSuug3Esi2SP9jPLpnAuaAvCZ4C8Hc Oct 19 03:34:44.156103 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:34:44.156103 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:34:44.156103 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:34:44.156103 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:34:44.156103 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:34:44.156103 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:34:44.156103 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 915dfb0f6811458eb1b6c6e65806ef24 Oct 19 03:34:44.156103 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1042630428 Oct 19 03:34:44.156103 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:34:44.156103 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:34:44.156103 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/915dfb0f6811458eb1b6c6e65806ef24"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/915dfb0f6811458eb1b6c6e65806ef24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/915dfb0f6811458eb1b6c6e65806ef24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_915dfb0f6811458eb1b6c6e65806ef24", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:34:44.156103 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1042630428 Oct 19 03:34:44.156103 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 915dfb0f6811458eb1b6c6e65806ef24 Oct 19 03:34:44.156103 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1042630428 Oct 19 03:34:44.156103 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-KeyPairsNegativeTestJSON-1042630428-project Oct 19 03:34:44.156103 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:34:44.156103 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:34:44.156103 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 4093da306bef4da39a2a43aef41bc4a1 Oct 19 03:34:44.156103 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1042630428-project Oct 19 03:34:44.156103 n-d-861333-8 devstack@n-api.service[121134]: Oct 19 03:34:44.156103 n-d-861333-8 devstack@n-api.service[121134]: {"keypair": {"name": "tempest-keypair-221169044", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8OCGWhw9Oao9PCTl0ipB+weIVAaXyQXBjtIco5jX/RtKKv6K3y3/Qx6wL0jzTm7eM1PMYamXH7/pIwcaC8abul6BQ+wsRsmmzNEsWFfuNVNVZ0CeUB/VnkcwtOul8auA=="}} Oct 19 03:34:44.156103 n-d-861333-8 devstack@n-api.service[121134]: method: Oct 19 03:34:44.156103 n-d-861333-8 devstack@n-api.service[121134]: exception: Key pair 'tempest-keypair-221169044' already exists. Oct 19 03:34:44.156103 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-221169044', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8OCGWhw9Oao9PCTl0ipB+weIVAaXyQXBjtIco5jX/RtKKv6K3y3/Qx6wL0jzTm7eM1PMYamXH7/pIwcaC8abul6BQ+wsRsmmzNEsWFfuNVNVZ0CeUB/VnkcwtOul8auA=='}}} Oct 19 03:34:44.156103 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:34:44.156103 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:34:44.156103 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 19 03:34:44.156103 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 19 03:34:44.156103 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 19 03:34:44.156103 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 19 03:34:44.156103 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 19 03:34:44.156103 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 19 03:34:44.156103 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 19 03:34:44.156103 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 19 03:34:44.156103 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 19 03:34:44.156103 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 19 03:34:44.156103 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 19 03:34:44.156103 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi result.read() Oct 19 03:34:44.156103 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 19 03:34:44.156103 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 19 03:34:44.156103 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 19 03:34:44.156103 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 19 03:34:44.156103 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 19 03:34:44.156103 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 19 03:34:44.156103 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 19 03:34:44.156103 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 19 03:34:44.156103 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '4093da306bef4da39a2a43aef41bc4a1-tempest-keypair-221169044' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 19 03:34:44.156103 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:34:44.164151 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 19 03:34:44.164151 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:34:44.164151 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:34:44.164151 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Oct 19 03:34:44.164151 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi kp.save(context.session) Oct 19 03:34:44.164151 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 19 03:34:44.164151 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi session.flush() Oct 19 03:34:44.164151 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 19 03:34:44.164151 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 19 03:34:44.164151 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 19 03:34:44.164151 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 19 03:34:44.164151 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 19 03:34:44.164151 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 19 03:34:44.164151 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 19 03:34:44.164151 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception Oct 19 03:34:44.164151 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 19 03:34:44.164151 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 19 03:34:44.164151 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 19 03:34:44.164151 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 19 03:34:44.164151 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 19 03:34:44.164151 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 19 03:34:44.164151 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 19 03:34:44.164151 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 19 03:34:44.164151 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 19 03:34:44.164151 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 19 03:34:44.164151 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 19 03:34:44.164151 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 19 03:34:44.164151 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 19 03:34:44.164151 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 19 03:34:44.164151 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 19 03:34:44.164151 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 19 03:34:44.164151 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 19 03:34:44.164151 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 19 03:34:44.164151 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 19 03:34:44.164151 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 19 03:34:44.164151 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 19 03:34:44.164151 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception Oct 19 03:34:44.164151 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 19 03:34:44.164151 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 19 03:34:44.164151 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 19 03:34:44.164151 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 19 03:34:44.164151 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 19 03:34:44.164151 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 19 03:34:44.164151 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 19 03:34:44.164151 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 19 03:34:44.164151 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 19 03:34:44.164151 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 19 03:34:44.164151 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 19 03:34:44.164151 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi result.read() Oct 19 03:34:44.164151 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 19 03:34:44.164151 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 19 03:34:44.164151 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 19 03:34:44.164151 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 19 03:34:44.164151 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 19 03:34:44.164151 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 19 03:34:44.164151 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 19 03:34:44.168318 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 19 03:34:44.168318 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '4093da306bef4da39a2a43aef41bc4a1-tempest-keypair-221169044' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 19 03:34:44.168318 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Oct 19 03:34:44.168318 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 19, 3, 34, 44, 105883), 'updated_at': None, 'name': 'tempest-keypair-221169044', 'user_id': '4093da306bef4da39a2a43aef41bc4a1', 'fingerprint': 'e4:86:e0:69:10:68:40:c9:30:98:b0:88:ee:31:60:49', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8OCGWhw9Oao9PCTl0ipB+weIVAaXyQXBjtIco5jX/RtKKv6K3y3/Qx6wL0jzTm7eM1PMYamXH7/pIwcaC8abul6BQ+wsRsmmzNEsWFfuNVNVZ0CeUB/VnkcwtOul8auA==', 'type': 'ssh'}] Oct 19 03:34:44.168318 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 19 03:34:44.168318 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:34:44.168318 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:34:44.168318 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:34:44.168318 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:34:44.168318 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 19 03:34:44.168318 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 19 03:34:44.168318 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 19 03:34:44.168318 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 19 03:34:44.168318 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 03:34:44.168318 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 03:34:44.168318 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 03:34:44.168318 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 03:34:44.168318 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 19 03:34:44.168318 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 19 03:34:44.168318 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6777, in import_key_pair Oct 19 03:34:44.168318 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi keypair.create() Oct 19 03:34:44.168318 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 19 03:34:44.168318 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 19 03:34:44.168318 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Oct 19 03:34:44.168318 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self._create() Oct 19 03:34:44.168318 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Oct 19 03:34:44.168318 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Oct 19 03:34:44.168318 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Oct 19 03:34:44.168318 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Oct 19 03:34:44.168318 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 19 03:34:44.168318 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 19 03:34:44.168318 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Oct 19 03:34:44.168318 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Oct 19 03:34:44.168318 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-221169044' already exists. Oct 19 03:34:44.168318 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:34:44.168318 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:34:44.168318 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:34:44.168318 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:34:44.168318 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:34:44.168318 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:34:44.168318 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:34:44.168318 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:34:44.168318 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 03:34:44.168318 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 03:34:44.168318 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:34:44.168318 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:34:44.168318 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:34:44.168318 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:34:44.168318 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:34:44.168318 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:34:44.168318 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 19 03:34:44.168318 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 19 03:34:44.168318 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Oct 19 03:34:44.168318 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Oct 19 03:34:44.168318 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-221169044' already exists. Oct 19 03:34:44.172636 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:34:44.172636 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:34:44.172636 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:34:44.172636 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:34:44.172636 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:34:44.172636 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:34:44.172636 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:34:44.172636 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:34:44.172636 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-221169044' already exists. Oct 19 03:34:44.172636 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:34:44.172636 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-37548a87-1e01-4b9e-adff-f9795afb256a tempest-KeyPairsNegativeTestJSON-1042630428 tempest-KeyPairsNegativeTestJSON-1042630428-project] Returning 409 to user: Key pair 'tempest-keypair-221169044' already exists. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:34:44.172636 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-37548a87-1e01-4b9e-adff-f9795afb256a tempest-KeyPairsNegativeTestJSON-1042630428 tempest-KeyPairsNegativeTestJSON-1042630428-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 409 len: 104 microversion: 2.1 time: 0.125344 Oct 19 03:34:44.173715 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7db98350-24aa-490c-8c47-15e4f71c4c8b tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.889414 Oct 19 03:34:44.173849 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2326/4730] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Oct 19 03:34:44 2022] POST /compute/v2.1/os-keypairs => generated 104 bytes in 129 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 19 03:34:44.173849 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-79c1a432-c375-4c1d-9b38-72027529bd1a tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:34:44.173849 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-79c1a432-c375-4c1d-9b38-72027529bd1a tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] [instance: 29a2d62a-83d9-43e2-8907-f4158500d83f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:34:44.179798 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2405/4731] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:34:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1909 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 03:34:44.192573 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-63b39c88-a8fd-4329-8da6-2bee31475f2a tempest-KeyPairsNegativeTestJSON-1042630428 tempest-KeyPairsNegativeTestJSON-1042630428-project] Calling method '.version_select at 0x7fc12bfaa280>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:34:44.200872 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-79c1a432-c375-4c1d-9b38-72027529bd1a tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:44.201405 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-79c1a432-c375-4c1d-9b38-72027529bd1a tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:44.201857 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-79c1a432-c375-4c1d-9b38-72027529bd1a tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:44.202664 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-79c1a432-c375-4c1d-9b38-72027529bd1a tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:44.203302 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-79c1a432-c375-4c1d-9b38-72027529bd1a tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:44.204771 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-79c1a432-c375-4c1d-9b38-72027529bd1a tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:44.228297 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-79c1a432-c375-4c1d-9b38-72027529bd1a tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] HTTP exception thrown: Instance 29a2d62a-83d9-43e2-8907-f4158500d83f could not be found. Oct 19 03:34:44.230519 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-79c1a432-c375-4c1d-9b38-72027529bd1a tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Request method failure captured: Oct 19 03:34:44.230519 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/29a2d62a-83d9-43e2-8907-f4158500d83f HTTP/1.1 Oct 19 03:34:44.230519 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:34:44.230519 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:34:44.230519 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:34:44.230519 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:34:44.230519 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:34:44.230519 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:34:44.230519 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:34:44.230519 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:34:44.230519 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT2_LCiOHRzNv8M8alihz4V0LrLZyPSpczfSufvB-oE6s-qWL5YugEd3Msxc6jnkwmuht4VeX0YTQZTeUlPtR1MS144U9i8-RR-NL8i_3FGAuyDY28hvtXsT8_l7FqUeVJBnpnl9b-AZLRYLNb-33ys_OAOIdJ76SSwlC1dKzc9Fnepc Oct 19 03:34:44.230519 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:34:44.230519 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:34:44.230519 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:34:44.230519 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:34:44.230519 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:34:44.230519 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:34:44.230519 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 2cb0265509744c93b03fa5c28b4e9386 Oct 19 03:34:44.230519 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ServerRescueTestJSON-508703240 Oct 19 03:34:44.230519 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:34:44.230519 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:34:44.230519 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2cb0265509744c93b03fa5c28b4e9386"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2cb0265509744c93b03fa5c28b4e9386"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2cb0265509744c93b03fa5c28b4e9386"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2cb0265509744c93b03fa5c28b4e9386", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:34:44.230519 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ServerRescueTestJSON-508703240 Oct 19 03:34:44.230519 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 2cb0265509744c93b03fa5c28b4e9386 Oct 19 03:34:44.230519 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ServerRescueTestJSON-508703240 Oct 19 03:34:44.230519 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ServerRescueTestJSON-508703240-project Oct 19 03:34:44.230519 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:34:44.230519 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:34:44.230519 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: b33d07a7db4846ababf001493c6e10d4 Oct 19 03:34:44.230519 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ServerRescueTestJSON-508703240-project Oct 19 03:34:44.230519 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:34:44.230519 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance 29a2d62a-83d9-43e2-8907-f4158500d83f could not be found. Oct 19 03:34:44.230519 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '29a2d62a-83d9-43e2-8907-f4158500d83f'} Oct 19 03:34:44.230519 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:34:44.230519 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:34:44.230519 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:34:44.230519 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:34:44.230519 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:34:44.230519 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:34:44.230519 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:34:44.230519 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:34:44.230519 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:34:44.230519 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:34:44.230519 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29a2d62a-83d9-43e2-8907-f4158500d83f could not be found. Oct 19 03:34:44.230519 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:34:44.230519 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:34:44.230519 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:34:44.230519 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:34:44.230519 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:34:44.230519 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:34:44.230519 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:34:44.230519 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:34:44.230519 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:34:44.230519 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:34:44.230519 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:34:44.230519 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:34:44.230519 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:34:44.230519 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:34:44.230519 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:34:44.230519 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:34:44.230519 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29a2d62a-83d9-43e2-8907-f4158500d83f could not be found. Oct 19 03:34:44.230519 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:34:44.230519 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:34:44.230519 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:34:44.237877 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:34:44.237877 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:34:44.237877 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:34:44.237877 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:34:44.237877 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:34:44.237877 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29a2d62a-83d9-43e2-8907-f4158500d83f could not be found. Oct 19 03:34:44.237877 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:34:44.237877 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-79c1a432-c375-4c1d-9b38-72027529bd1a tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Returning 404 to user: Instance 29a2d62a-83d9-43e2-8907-f4158500d83f could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:34:44.237877 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-79c1a432-c375-4c1d-9b38-72027529bd1a tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] 10.222.0.52 "GET /compute/v2.1/servers/29a2d62a-83d9-43e2-8907-f4158500d83f" status: 404 len: 111 microversion: 2.1 time: 0.068960 Oct 19 03:34:44.237877 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2327/4732] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:34:44 2022] GET /compute/v2.1/servers/29a2d62a-83d9-43e2-8907-f4158500d83f => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:34:44.240685 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6833242b-7e03-4805-88ab-908f1384faa8 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:34:44.240685 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6833242b-7e03-4805-88ab-908f1384faa8 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 04f651af-d26c-4307-bb5a-bf3a61160dbb] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:34:44.246702 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=5 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:34:44.270589 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-63b39c88-a8fd-4329-8da6-2bee31475f2a tempest-KeyPairsNegativeTestJSON-1042630428 tempest-KeyPairsNegativeTestJSON-1042630428-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-221169044" status: 202 len: 0 microversion: 2.1 time: 0.084465 Oct 19 03:34:44.279780 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2406/4733] 10.222.0.52 () {58 vars in 1218 bytes} [Wed Oct 19 03:34:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-221169044 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:34:44.294746 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-91f85722-6475-4900-96a3-32c129da52d7 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:34:44.296574 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-91f85722-6475-4900-96a3-32c129da52d7 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] [instance: 2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:34:44.312009 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-91f85722-6475-4900-96a3-32c129da52d7 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:44.314684 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-91f85722-6475-4900-96a3-32c129da52d7 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:44.316917 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-91f85722-6475-4900-96a3-32c129da52d7 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:44.318347 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-91f85722-6475-4900-96a3-32c129da52d7 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:44.320144 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-91f85722-6475-4900-96a3-32c129da52d7 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:44.322537 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-91f85722-6475-4900-96a3-32c129da52d7 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:44.352880 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-6833242b-7e03-4805-88ab-908f1384faa8 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:34:44.364074 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6833242b-7e03-4805-88ab-908f1384faa8 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/04f651af-d26c-4307-bb5a-bf3a61160dbb" status: 200 len: 1215 microversion: 2.1 time: 0.130012 Oct 19 03:34:44.364760 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2328/4734] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:34:44 2022] GET /compute/v2.1/servers/04f651af-d26c-4307-bb5a-bf3a61160dbb => generated 1215 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:34:44.380659 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4d8b0ae0-e654-42a7-93f3-82026587d15c tempest-KeyPairsNegativeTestJSON-1042630428 tempest-KeyPairsNegativeTestJSON-1042630428-project] Action: 'create', calling method: .version_select at 0x7fc130582820>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG0BVlh7h76kLQL7XQiQarndrsaC2U/2assZCHUE8wOkPxefacIsESMYuTPMc68y+LAa8EhnumOeBrFisWWb/wjhI3Yje4dIoGZ6sZfJsY6dWT3I+ScBO59IIww0J0TdEQ=="}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:34:44.382348 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-91f85722-6475-4900-96a3-32c129da52d7 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] [instance: 2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62] Going to try to terminate instance {{(pid=121135) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:34:44.403298 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4d8b0ae0-e654-42a7-93f3-82026587d15c tempest-KeyPairsNegativeTestJSON-1042630428 tempest-KeyPairsNegativeTestJSON-1042630428-project] Request method failure captured: Oct 19 03:34:44.403298 n-d-861333-8 devstack@n-api.service[121134]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 19 03:34:44.403298 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:34:44.403298 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:34:44.403298 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:34:44.403298 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 247 Oct 19 03:34:44.403298 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:34:44.403298 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:34:44.403298 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:34:44.403298 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:34:44.403298 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3BSkziNdp68TF5rUFzgXJrTsNvP6tQOpPQ5A97IEAcK8_AO6XbVk20fyJ_UpCXhw3axL0tRi3QIw_D7ssPglGVXiDzAVes6aT7G7GSCgV3HsWuSg5VYQtmvOjcZoBnS_MrNfHlZFnttKNPm2BSuug3Esi2SP9jPLpnAuaAvCZ4C8Hc Oct 19 03:34:44.403298 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:34:44.403298 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:34:44.403298 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:34:44.403298 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:34:44.403298 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:34:44.403298 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:34:44.403298 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 915dfb0f6811458eb1b6c6e65806ef24 Oct 19 03:34:44.403298 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1042630428 Oct 19 03:34:44.403298 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:34:44.403298 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:34:44.403298 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/915dfb0f6811458eb1b6c6e65806ef24"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/915dfb0f6811458eb1b6c6e65806ef24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/915dfb0f6811458eb1b6c6e65806ef24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_915dfb0f6811458eb1b6c6e65806ef24", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:34:44.403298 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1042630428 Oct 19 03:34:44.403298 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 915dfb0f6811458eb1b6c6e65806ef24 Oct 19 03:34:44.403298 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1042630428 Oct 19 03:34:44.403298 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-KeyPairsNegativeTestJSON-1042630428-project Oct 19 03:34:44.403298 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:34:44.403298 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:34:44.403298 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 4093da306bef4da39a2a43aef41bc4a1 Oct 19 03:34:44.403298 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1042630428-project Oct 19 03:34:44.403298 n-d-861333-8 devstack@n-api.service[121134]: Oct 19 03:34:44.403298 n-d-861333-8 devstack@n-api.service[121134]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG0BVlh7h76kLQL7XQiQarndrsaC2U/2assZCHUE8wOkPxefacIsESMYuTPMc68y+LAa8EhnumOeBrFisWWb/wjhI3Yje4dIoGZ6sZfJsY6dWT3I+ScBO59IIww0J0TdEQ=="}} Oct 19 03:34:44.403298 n-d-861333-8 devstack@n-api.service[121134]: method: Oct 19 03:34:44.403298 n-d-861333-8 devstack@n-api.service[121134]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 19 03:34:44.403298 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG0BVlh7h76kLQL7XQiQarndrsaC2U/2assZCHUE8wOkPxefacIsESMYuTPMc68y+LAa8EhnumOeBrFisWWb/wjhI3Yje4dIoGZ6sZfJsY6dWT3I+ScBO59IIww0J0TdEQ=='}}} Oct 19 03:34:44.403298 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:34:44.403298 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:34:44.403298 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 03:34:44.403298 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 03:34:44.403298 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 03:34:44.403298 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise error Oct 19 03:34:44.403298 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 19 03:34:44.403298 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:34:44.403298 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 19 03:34:44.403298 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 19 03:34:44.403298 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:34:44.403298 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 19 03:34:44.403298 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi '' Oct 19 03:34:44.403298 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:34:44.403298 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:34:44.403298 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:34:44.403298 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:34:44.403298 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:34:44.403298 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:34:44.403298 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:34:44.403298 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:34:44.403298 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 03:34:44.403298 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 03:34:44.403298 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:34:44.403298 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:34:44.403298 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:34:44.403298 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:34:44.403298 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 03:34:44.403298 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 03:34:44.411384 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 03:34:44.411384 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 03:34:44.411384 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 03:34:44.411384 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 03:34:44.411384 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 19 03:34:44.411384 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:34:44.411384 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:34:44.411384 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:34:44.411384 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:34:44.411384 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:34:44.411384 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:34:44.411384 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 03:34:44.411384 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 03:34:44.411384 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 19 03:34:44.411384 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:34:44.411384 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4d8b0ae0-e654-42a7-93f3-82026587d15c tempest-KeyPairsNegativeTestJSON-1042630428 tempest-KeyPairsNegativeTestJSON-1042630428-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:34:44.411384 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4d8b0ae0-e654-42a7-93f3-82026587d15c tempest-KeyPairsNegativeTestJSON-1042630428 tempest-KeyPairsNegativeTestJSON-1042630428-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.037993 Oct 19 03:34:44.423066 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2329/4735] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Oct 19 03:34:44 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 47 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 03:34:44.425954 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6699b975-5bd4-4b03-b8f4-68baf1b9fb9f tempest-KeyPairsNegativeTestJSON-1042630428 tempest-KeyPairsNegativeTestJSON-1042630428-project] Action: 'create', calling method: .version_select at 0x7fc13024bdc0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1995301112", "public_key": " "}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:34:44.459810 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-6699b975-5bd4-4b03-b8f4-68baf1b9fb9f tempest-KeyPairsNegativeTestJSON-1042630428 tempest-KeyPairsNegativeTestJSON-1042630428-project] Getting quotas for project 915dfb0f6811458eb1b6c6e65806ef24. Resources: {'key_pairs'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:34:44.475239 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-6699b975-5bd4-4b03-b8f4-68baf1b9fb9f tempest-KeyPairsNegativeTestJSON-1042630428 tempest-KeyPairsNegativeTestJSON-1042630428-project] Getting quotas for user 4093da306bef4da39a2a43aef41bc4a1 and project 915dfb0f6811458eb1b6c6e65806ef24. Resources: {'key_pairs'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:34:44.508160 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-6699b975-5bd4-4b03-b8f4-68baf1b9fb9f tempest-KeyPairsNegativeTestJSON-1042630428 tempest-KeyPairsNegativeTestJSON-1042630428-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 19 03:34:44.510510 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6699b975-5bd4-4b03-b8f4-68baf1b9fb9f tempest-KeyPairsNegativeTestJSON-1042630428 tempest-KeyPairsNegativeTestJSON-1042630428-project] Request method failure captured: Oct 19 03:34:44.510510 n-d-861333-8 devstack@n-api.service[121134]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 19 03:34:44.510510 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:34:44.510510 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:34:44.510510 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:34:44.510510 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 95 Oct 19 03:34:44.510510 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:34:44.510510 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:34:44.510510 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:34:44.510510 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:34:44.510510 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3BSkziNdp68TF5rUFzgXJrTsNvP6tQOpPQ5A97IEAcK8_AO6XbVk20fyJ_UpCXhw3axL0tRi3QIw_D7ssPglGVXiDzAVes6aT7G7GSCgV3HsWuSg5VYQtmvOjcZoBnS_MrNfHlZFnttKNPm2BSuug3Esi2SP9jPLpnAuaAvCZ4C8Hc Oct 19 03:34:44.510510 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:34:44.510510 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:34:44.510510 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:34:44.510510 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:34:44.510510 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:34:44.510510 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:34:44.510510 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 915dfb0f6811458eb1b6c6e65806ef24 Oct 19 03:34:44.510510 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1042630428 Oct 19 03:34:44.510510 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:34:44.510510 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:34:44.510510 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/915dfb0f6811458eb1b6c6e65806ef24"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/915dfb0f6811458eb1b6c6e65806ef24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/915dfb0f6811458eb1b6c6e65806ef24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_915dfb0f6811458eb1b6c6e65806ef24", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:34:44.510510 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1042630428 Oct 19 03:34:44.510510 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 915dfb0f6811458eb1b6c6e65806ef24 Oct 19 03:34:44.510510 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1042630428 Oct 19 03:34:44.510510 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-KeyPairsNegativeTestJSON-1042630428-project Oct 19 03:34:44.510510 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:34:44.510510 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:34:44.510510 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 4093da306bef4da39a2a43aef41bc4a1 Oct 19 03:34:44.510510 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1042630428-project Oct 19 03:34:44.510510 n-d-861333-8 devstack@n-api.service[121134]: Oct 19 03:34:44.510510 n-d-861333-8 devstack@n-api.service[121134]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1995301112", "public_key": " "}} Oct 19 03:34:44.510510 n-d-861333-8 devstack@n-api.service[121134]: method: Oct 19 03:34:44.510510 n-d-861333-8 devstack@n-api.service[121134]: exception: Keypair data is invalid: failed to generate fingerprint Oct 19 03:34:44.510510 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1995301112', 'public_key': ' '}}} Oct 19 03:34:44.510510 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:34:44.510510 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:34:44.510510 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 19 03:34:44.510510 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 19 03:34:44.510510 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Oct 19 03:34:44.510510 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Oct 19 03:34:44.510510 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Oct 19 03:34:44.510510 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:34:44.510510 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:34:44.510510 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:34:44.510510 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:34:44.510510 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 19 03:34:44.510510 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 19 03:34:44.510510 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 19 03:34:44.510510 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 19 03:34:44.510510 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 03:34:44.510510 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 03:34:44.510510 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 03:34:44.510510 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 03:34:44.510510 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 19 03:34:44.510510 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 19 03:34:44.510510 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 19 03:34:44.510510 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 19 03:34:44.510510 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 19 03:34:44.510510 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 19 03:34:44.510510 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 19 03:34:44.510510 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 19 03:34:44.510510 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 19 03:34:44.510510 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:34:44.510510 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:34:44.510510 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:34:44.514729 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:34:44.514729 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:34:44.514729 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:34:44.514729 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:34:44.514729 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:34:44.514729 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 03:34:44.514729 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 03:34:44.514729 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:34:44.514729 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:34:44.514729 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:34:44.514729 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:34:44.514729 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:34:44.514729 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:34:44.514729 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 19 03:34:44.514729 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 19 03:34:44.514729 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 19 03:34:44.514729 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 19 03:34:44.514729 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 19 03:34:44.514729 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:34:44.514729 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:34:44.514729 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:34:44.514729 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:34:44.514729 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:34:44.514729 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:34:44.514729 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:34:44.514729 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:34:44.514729 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 19 03:34:44.514729 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:34:44.514729 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6699b975-5bd4-4b03-b8f4-68baf1b9fb9f tempest-KeyPairsNegativeTestJSON-1042630428 tempest-KeyPairsNegativeTestJSON-1042630428-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:34:44.514729 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6699b975-5bd4-4b03-b8f4-68baf1b9fb9f tempest-KeyPairsNegativeTestJSON-1042630428 tempest-KeyPairsNegativeTestJSON-1042630428-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.096458 Oct 19 03:34:44.514729 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2330/4736] 10.222.0.52 () {60 vars in 1158 bytes} [Wed Oct 19 03:34:44 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 98 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 19 03:34:44.526276 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-43bc2120-2075-4158-9989-69601bfcb70c tempest-KeyPairsNegativeTestJSON-1042630428 tempest-KeyPairsNegativeTestJSON-1042630428-project] Action: 'create', calling method: .version_select at 0x7fc12bf37160>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL7lCosVuF5fZuzcBDhSo4+4oenmqc4b65RUBbDGITKwKLcz0CTTn+x3kVh4CTuXWQPuiqcMJSK/i4h85nlxgka+5WMG+stdXkekTwEoYxtayDFZ6/OP3SZ0b/fYbyUmbw=="}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:34:44.530656 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-43bc2120-2075-4158-9989-69601bfcb70c tempest-KeyPairsNegativeTestJSON-1042630428 tempest-KeyPairsNegativeTestJSON-1042630428-project] Request method failure captured: Oct 19 03:34:44.530656 n-d-861333-8 devstack@n-api.service[121134]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 19 03:34:44.530656 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:34:44.530656 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:34:44.530656 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:34:44.530656 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 507 Oct 19 03:34:44.530656 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:34:44.530656 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:34:44.530656 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:34:44.530656 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:34:44.530656 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3BSkziNdp68TF5rUFzgXJrTsNvP6tQOpPQ5A97IEAcK8_AO6XbVk20fyJ_UpCXhw3axL0tRi3QIw_D7ssPglGVXiDzAVes6aT7G7GSCgV3HsWuSg5VYQtmvOjcZoBnS_MrNfHlZFnttKNPm2BSuug3Esi2SP9jPLpnAuaAvCZ4C8Hc Oct 19 03:34:44.530656 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:34:44.530656 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:34:44.530656 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:34:44.530656 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:34:44.530656 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:34:44.530656 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:34:44.530656 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 915dfb0f6811458eb1b6c6e65806ef24 Oct 19 03:34:44.530656 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1042630428 Oct 19 03:34:44.530656 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:34:44.530656 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:34:44.530656 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/915dfb0f6811458eb1b6c6e65806ef24"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/915dfb0f6811458eb1b6c6e65806ef24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/915dfb0f6811458eb1b6c6e65806ef24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_915dfb0f6811458eb1b6c6e65806ef24", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:34:44.530656 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1042630428 Oct 19 03:34:44.530656 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 915dfb0f6811458eb1b6c6e65806ef24 Oct 19 03:34:44.530656 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1042630428 Oct 19 03:34:44.530656 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-KeyPairsNegativeTestJSON-1042630428-project Oct 19 03:34:44.530656 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:34:44.530656 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:34:44.530656 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 4093da306bef4da39a2a43aef41bc4a1 Oct 19 03:34:44.530656 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1042630428-project Oct 19 03:34:44.530656 n-d-861333-8 devstack@n-api.service[121134]: Oct 19 03:34:44.530656 n-d-861333-8 devstack@n-api.service[121134]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL7lCosVuF5fZuzcBDhSo4+4oenmqc4b65RUBbDGITKwKLcz0CTTn+x3kVh4CTuXWQPuiqcMJSK/i4h85nlxgka+5WMG+stdXkekTwEoYxtayDFZ6/OP3SZ0b/fYbyUmbw=="}} Oct 19 03:34:44.530656 n-d-861333-8 devstack@n-api.service[121134]: method: Oct 19 03:34:44.530656 n-d-861333-8 devstack@n-api.service[121134]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 19 03:34:44.530656 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL7lCosVuF5fZuzcBDhSo4+4oenmqc4b65RUBbDGITKwKLcz0CTTn+x3kVh4CTuXWQPuiqcMJSK/i4h85nlxgka+5WMG+stdXkekTwEoYxtayDFZ6/OP3SZ0b/fYbyUmbw=='}}} Oct 19 03:34:44.530656 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:34:44.530656 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:34:44.530656 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 03:34:44.530656 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 03:34:44.530656 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 03:34:44.530656 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise error Oct 19 03:34:44.530656 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 19 03:34:44.530656 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:34:44.530656 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 19 03:34:44.530656 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 19 03:34:44.530656 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:34:44.530656 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 19 03:34:44.530656 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Oct 19 03:34:44.534281 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:34:44.534281 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:34:44.534281 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:34:44.534281 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:34:44.534281 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:34:44.534281 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:34:44.534281 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:34:44.534281 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:34:44.534281 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 03:34:44.534281 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 03:34:44.534281 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:34:44.534281 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:34:44.534281 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:34:44.534281 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:34:44.534281 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 03:34:44.534281 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 03:34:44.534281 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 03:34:44.534281 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 03:34:44.534281 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 03:34:44.534281 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 03:34:44.534281 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 19 03:34:44.534281 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:34:44.534281 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:34:44.534281 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:34:44.534281 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:34:44.534281 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:34:44.534281 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:34:44.534281 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 03:34:44.534281 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 03:34:44.534281 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 19 03:34:44.534281 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:34:44.534281 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-43bc2120-2075-4158-9989-69601bfcb70c tempest-KeyPairsNegativeTestJSON-1042630428 tempest-KeyPairsNegativeTestJSON-1042630428-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:34:44.534281 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-43bc2120-2075-4158-9989-69601bfcb70c tempest-KeyPairsNegativeTestJSON-1042630428 tempest-KeyPairsNegativeTestJSON-1042630428-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.010913 Oct 19 03:34:44.538935 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2331/4737] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Oct 19 03:34:44 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 03:34:44.544768 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2dbbc2e1-bdb6-4090-ab5c-f125b094a68d tempest-KeyPairsNegativeTestJSON-1042630428 tempest-KeyPairsNegativeTestJSON-1042630428-project] Action: 'create', calling method: .version_select at 0x7fc13004c9d0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-248666177", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:34:44.561129 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-2dbbc2e1-bdb6-4090-ab5c-f125b094a68d tempest-KeyPairsNegativeTestJSON-1042630428 tempest-KeyPairsNegativeTestJSON-1042630428-project] Getting quotas for project 915dfb0f6811458eb1b6c6e65806ef24. Resources: {'key_pairs'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:34:44.567232 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-2dbbc2e1-bdb6-4090-ab5c-f125b094a68d tempest-KeyPairsNegativeTestJSON-1042630428 tempest-KeyPairsNegativeTestJSON-1042630428-project] Getting quotas for user 4093da306bef4da39a2a43aef41bc4a1 and project 915dfb0f6811458eb1b6c6e65806ef24. Resources: {'key_pairs'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:34:44.586659 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-2dbbc2e1-bdb6-4090-ab5c-f125b094a68d tempest-KeyPairsNegativeTestJSON-1042630428 tempest-KeyPairsNegativeTestJSON-1042630428-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 19 03:34:44.588651 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2dbbc2e1-bdb6-4090-ab5c-f125b094a68d tempest-KeyPairsNegativeTestJSON-1042630428 tempest-KeyPairsNegativeTestJSON-1042630428-project] Request method failure captured: Oct 19 03:34:44.588651 n-d-861333-8 devstack@n-api.service[121134]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 19 03:34:44.588651 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:34:44.588651 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:34:44.588651 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:34:44.588651 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 117 Oct 19 03:34:44.588651 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:34:44.588651 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:34:44.588651 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:34:44.588651 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:34:44.588651 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3BSkziNdp68TF5rUFzgXJrTsNvP6tQOpPQ5A97IEAcK8_AO6XbVk20fyJ_UpCXhw3axL0tRi3QIw_D7ssPglGVXiDzAVes6aT7G7GSCgV3HsWuSg5VYQtmvOjcZoBnS_MrNfHlZFnttKNPm2BSuug3Esi2SP9jPLpnAuaAvCZ4C8Hc Oct 19 03:34:44.588651 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:34:44.588651 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:34:44.588651 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:34:44.588651 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:34:44.588651 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:34:44.588651 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:34:44.588651 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 915dfb0f6811458eb1b6c6e65806ef24 Oct 19 03:34:44.588651 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1042630428 Oct 19 03:34:44.588651 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:34:44.588651 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:34:44.588651 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/915dfb0f6811458eb1b6c6e65806ef24"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/915dfb0f6811458eb1b6c6e65806ef24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/915dfb0f6811458eb1b6c6e65806ef24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_915dfb0f6811458eb1b6c6e65806ef24", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:34:44.588651 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1042630428 Oct 19 03:34:44.588651 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 915dfb0f6811458eb1b6c6e65806ef24 Oct 19 03:34:44.588651 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1042630428 Oct 19 03:34:44.588651 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-KeyPairsNegativeTestJSON-1042630428-project Oct 19 03:34:44.588651 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:34:44.588651 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:34:44.588651 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 4093da306bef4da39a2a43aef41bc4a1 Oct 19 03:34:44.588651 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1042630428-project Oct 19 03:34:44.588651 n-d-861333-8 devstack@n-api.service[121134]: Oct 19 03:34:44.588651 n-d-861333-8 devstack@n-api.service[121134]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-248666177", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Oct 19 03:34:44.588651 n-d-861333-8 devstack@n-api.service[121134]: method: Oct 19 03:34:44.588651 n-d-861333-8 devstack@n-api.service[121134]: exception: Keypair data is invalid: failed to generate fingerprint Oct 19 03:34:44.588651 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-248666177', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Oct 19 03:34:44.588651 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:34:44.588651 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:34:44.588651 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 19 03:34:44.588651 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 19 03:34:44.588651 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Oct 19 03:34:44.588651 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Oct 19 03:34:44.588651 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Oct 19 03:34:44.588651 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Oct 19 03:34:44.588651 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Oct 19 03:34:44.588651 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Oct 19 03:34:44.588651 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Oct 19 03:34:44.588651 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:34:44.588651 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:34:44.588651 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:34:44.588651 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:34:44.588651 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 19 03:34:44.588651 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 19 03:34:44.588651 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 19 03:34:44.588651 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 19 03:34:44.588651 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 03:34:44.588651 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 03:34:44.588651 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 03:34:44.588651 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 03:34:44.588651 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 19 03:34:44.588651 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 19 03:34:44.588651 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 19 03:34:44.588651 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 19 03:34:44.588651 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 19 03:34:44.588651 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 19 03:34:44.593972 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 19 03:34:44.593972 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 19 03:34:44.593972 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 19 03:34:44.593972 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:34:44.593972 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:34:44.593972 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:34:44.593972 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:34:44.593972 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:34:44.593972 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:34:44.593972 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:34:44.593972 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:34:44.593972 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 03:34:44.593972 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 03:34:44.593972 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:34:44.593972 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:34:44.593972 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:34:44.593972 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:34:44.593972 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:34:44.593972 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:34:44.593972 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 19 03:34:44.593972 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 19 03:34:44.593972 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 19 03:34:44.593972 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 19 03:34:44.593972 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 19 03:34:44.593972 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:34:44.593972 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:34:44.593972 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:34:44.593972 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:34:44.593972 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:34:44.593972 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:34:44.593972 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:34:44.593972 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:34:44.593972 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 19 03:34:44.593972 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:34:44.593972 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2dbbc2e1-bdb6-4090-ab5c-f125b094a68d tempest-KeyPairsNegativeTestJSON-1042630428 tempest-KeyPairsNegativeTestJSON-1042630428-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:34:44.593972 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2dbbc2e1-bdb6-4090-ab5c-f125b094a68d tempest-KeyPairsNegativeTestJSON-1042630428 tempest-KeyPairsNegativeTestJSON-1042630428-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.050250 Oct 19 03:34:44.597409 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2332/4738] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Oct 19 03:34:44 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 57 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 19 03:34:44.600770 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-57d49409-c306-41ec-9389-85628066ec52 tempest-KeyPairsNegativeTestJSON-1042630428 tempest-KeyPairsNegativeTestJSON-1042630428-project] Calling method '.version_select at 0x7fc12bf82820>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:34:44.626584 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-57d49409-c306-41ec-9389-85628066ec52 tempest-KeyPairsNegativeTestJSON-1042630428 tempest-KeyPairsNegativeTestJSON-1042630428-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-1986330365 not found for user 4093da306bef4da39a2a43aef41bc4a1 Oct 19 03:34:44.628775 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-57d49409-c306-41ec-9389-85628066ec52 tempest-KeyPairsNegativeTestJSON-1042630428 tempest-KeyPairsNegativeTestJSON-1042630428-project] Request method failure captured: Oct 19 03:34:44.628775 n-d-861333-8 devstack@n-api.service[121134]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1986330365 HTTP/1.1 Oct 19 03:34:44.628775 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:34:44.628775 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:34:44.628775 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:34:44.628775 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:34:44.628775 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:34:44.628775 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:34:44.628775 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:34:44.628775 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:34:44.628775 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3BSkziNdp68TF5rUFzgXJrTsNvP6tQOpPQ5A97IEAcK8_AO6XbVk20fyJ_UpCXhw3axL0tRi3QIw_D7ssPglGVXiDzAVes6aT7G7GSCgV3HsWuSg5VYQtmvOjcZoBnS_MrNfHlZFnttKNPm2BSuug3Esi2SP9jPLpnAuaAvCZ4C8Hc Oct 19 03:34:44.628775 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:34:44.628775 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:34:44.628775 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:34:44.628775 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:34:44.628775 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:34:44.628775 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:34:44.628775 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 915dfb0f6811458eb1b6c6e65806ef24 Oct 19 03:34:44.628775 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1042630428 Oct 19 03:34:44.628775 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:34:44.628775 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:34:44.628775 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/915dfb0f6811458eb1b6c6e65806ef24"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/915dfb0f6811458eb1b6c6e65806ef24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/915dfb0f6811458eb1b6c6e65806ef24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_915dfb0f6811458eb1b6c6e65806ef24", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:34:44.628775 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1042630428 Oct 19 03:34:44.628775 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 915dfb0f6811458eb1b6c6e65806ef24 Oct 19 03:34:44.628775 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1042630428 Oct 19 03:34:44.628775 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-KeyPairsNegativeTestJSON-1042630428-project Oct 19 03:34:44.628775 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:34:44.628775 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:34:44.628775 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 4093da306bef4da39a2a43aef41bc4a1 Oct 19 03:34:44.628775 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1042630428-project Oct 19 03:34:44.628775 n-d-861333-8 devstack@n-api.service[121134]: method: Oct 19 03:34:44.628775 n-d-861333-8 devstack@n-api.service[121134]: exception: Keypair tempest-keypair-non-existent-1986330365 not found for user 4093da306bef4da39a2a43aef41bc4a1 Oct 19 03:34:44.628775 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': 'tempest-keypair-non-existent-1986330365'} Oct 19 03:34:44.628775 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:34:44.628775 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:34:44.628775 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Oct 19 03:34:44.628775 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Oct 19 03:34:44.628775 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 19 03:34:44.628775 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 19 03:34:44.628775 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 03:34:44.628775 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 03:34:44.628775 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 03:34:44.628775 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 03:34:44.628775 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 19 03:34:44.628775 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 19 03:34:44.628775 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6861, in delete_key_pair Oct 19 03:34:44.628775 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Oct 19 03:34:44.628775 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6882, in get_key_pair Oct 19 03:34:44.628775 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Oct 19 03:34:44.628775 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 03:34:44.628775 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 03:34:44.628775 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 19 03:34:44.628775 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 19 03:34:44.628775 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 19 03:34:44.628775 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 19 03:34:44.628775 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 19 03:34:44.628775 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 19 03:34:44.628775 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 19 03:34:44.628775 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 19 03:34:44.628775 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-1986330365 not found for user 4093da306bef4da39a2a43aef41bc4a1 Oct 19 03:34:44.628775 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:34:44.628775 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:34:44.633235 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:34:44.633235 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:34:44.633235 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:34:44.633235 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:34:44.633235 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:34:44.633235 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:34:44.633235 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 03:34:44.633235 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 03:34:44.633235 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 19 03:34:44.633235 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:34:44.633235 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:34:44.633235 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:34:44.633235 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Oct 19 03:34:44.633235 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self._delete(req, id) Oct 19 03:34:44.633235 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Oct 19 03:34:44.633235 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Oct 19 03:34:44.633235 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-1986330365 not found for user 4093da306bef4da39a2a43aef41bc4a1 Oct 19 03:34:44.633235 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:34:44.633235 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:34:44.633235 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:34:44.633235 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:34:44.633235 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:34:44.633235 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:34:44.633235 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:34:44.633235 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:34:44.633235 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-1986330365 not found for user 4093da306bef4da39a2a43aef41bc4a1 Oct 19 03:34:44.633235 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:34:44.633235 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-57d49409-c306-41ec-9389-85628066ec52 tempest-KeyPairsNegativeTestJSON-1042630428 tempest-KeyPairsNegativeTestJSON-1042630428-project] Returning 404 to user: Keypair tempest-keypair-non-existent-1986330365 not found for user 4093da306bef4da39a2a43aef41bc4a1 {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:34:44.633235 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-57d49409-c306-41ec-9389-85628066ec52 tempest-KeyPairsNegativeTestJSON-1042630428 tempest-KeyPairsNegativeTestJSON-1042630428-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1986330365" status: 404 len: 145 microversion: 2.1 time: 0.033193 Oct 19 03:34:44.633235 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2333/4739] 10.222.0.52 () {58 vars in 1260 bytes} [Wed Oct 19 03:34:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1986330365 => generated 145 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:34:44.845286 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-91f85722-6475-4900-96a3-32c129da52d7 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] 10.222.0.52 "DELETE /compute/v2.1/servers/2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62" status: 204 len: 0 microversion: 2.1 time: 0.569014 Oct 19 03:34:44.845926 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2407/4740] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:34:44 2022] DELETE /compute/v2.1/servers/2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:34:44.879576 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b796c637-8283-41f5-afa6-11aca4bc6ed4 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:34:44.881644 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b796c637-8283-41f5-afa6-11aca4bc6ed4 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] [instance: ddbf7afb-1d7b-4d33-b6fb-1f1608c11985] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:34:44.888653 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-24c79d05-5774-429b-aecf-c5f27efc55de tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:34:44.891464 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-24c79d05-5774-429b-aecf-c5f27efc55de tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] [instance: 2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:34:44.891883 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b796c637-8283-41f5-afa6-11aca4bc6ed4 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:44.892609 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b796c637-8283-41f5-afa6-11aca4bc6ed4 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:44.895433 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b796c637-8283-41f5-afa6-11aca4bc6ed4 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:44.896294 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b796c637-8283-41f5-afa6-11aca4bc6ed4 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:44.896853 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b796c637-8283-41f5-afa6-11aca4bc6ed4 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:44.897818 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b796c637-8283-41f5-afa6-11aca4bc6ed4 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:44.908516 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-24c79d05-5774-429b-aecf-c5f27efc55de tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:44.909582 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-24c79d05-5774-429b-aecf-c5f27efc55de tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:44.919795 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-24c79d05-5774-429b-aecf-c5f27efc55de tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:44.919795 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-24c79d05-5774-429b-aecf-c5f27efc55de tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:44.919795 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-24c79d05-5774-429b-aecf-c5f27efc55de tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:44.919795 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-24c79d05-5774-429b-aecf-c5f27efc55de tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:45.350079 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b796c637-8283-41f5-afa6-11aca4bc6ed4 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c65a497e16e4e41b5cf1287042f3a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4001edd1474947a94243a620a6013a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:34:45.363242 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b796c637-8283-41f5-afa6-11aca4bc6ed4 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] 10.222.0.52 "GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985" status: 200 len: 1362 microversion: 2.1 time: 0.493758 Oct 19 03:34:45.366236 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2408/4741] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:34:44 2022] GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985 => generated 1362 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:34:45.399842 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-562e6580-0910-42c9-b6f8-2d700db3f98b tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:34:45.404701 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-24c79d05-5774-429b-aecf-c5f27efc55de tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33d07a7db4846ababf001493c6e10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb0265509744c93b03fa5c28b4e9386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:34:45.405302 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-562e6580-0910-42c9-b6f8-2d700db3f98b tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 04f651af-d26c-4307-bb5a-bf3a61160dbb] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:34:45.413555 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-24c79d05-5774-429b-aecf-c5f27efc55de tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] 10.222.0.52 "GET /compute/v2.1/servers/2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62" status: 200 len: 1491 microversion: 2.1 time: 0.550791 Oct 19 03:34:45.416648 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2334/4742] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:34:44 2022] GET /compute/v2.1/servers/2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62 => generated 1491 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:34:45.471035 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-562e6580-0910-42c9-b6f8-2d700db3f98b tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:34:45.478987 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-562e6580-0910-42c9-b6f8-2d700db3f98b tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/04f651af-d26c-4307-bb5a-bf3a61160dbb" status: 200 len: 1215 microversion: 2.1 time: 0.090326 Oct 19 03:34:45.479965 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2409/4743] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:34:45 2022] GET /compute/v2.1/servers/04f651af-d26c-4307-bb5a-bf3a61160dbb => generated 1215 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:34:46.407538 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d3918095-0ca6-4fd2-88cb-875cad6925a0 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:34:46.408199 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d3918095-0ca6-4fd2-88cb-875cad6925a0 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] [instance: ddbf7afb-1d7b-4d33-b6fb-1f1608c11985] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:34:46.417685 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d3918095-0ca6-4fd2-88cb-875cad6925a0 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:46.418196 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d3918095-0ca6-4fd2-88cb-875cad6925a0 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:46.418892 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d3918095-0ca6-4fd2-88cb-875cad6925a0 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:46.419527 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d3918095-0ca6-4fd2-88cb-875cad6925a0 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:46.419996 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d3918095-0ca6-4fd2-88cb-875cad6925a0 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:46.420424 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d3918095-0ca6-4fd2-88cb-875cad6925a0 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:46.445809 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c2738786-dbe8-4a7c-9596-f925c5354d60 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:34:46.447526 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c2738786-dbe8-4a7c-9596-f925c5354d60 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] [instance: 2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:34:46.461545 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c2738786-dbe8-4a7c-9596-f925c5354d60 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:46.462412 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c2738786-dbe8-4a7c-9596-f925c5354d60 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:46.463214 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c2738786-dbe8-4a7c-9596-f925c5354d60 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:46.463934 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c2738786-dbe8-4a7c-9596-f925c5354d60 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:46.464460 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c2738786-dbe8-4a7c-9596-f925c5354d60 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:46.465041 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c2738786-dbe8-4a7c-9596-f925c5354d60 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:46.746709 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d3918095-0ca6-4fd2-88cb-875cad6925a0 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c65a497e16e4e41b5cf1287042f3a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4001edd1474947a94243a620a6013a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:34:46.759545 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c2738786-dbe8-4a7c-9596-f925c5354d60 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33d07a7db4846ababf001493c6e10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb0265509744c93b03fa5c28b4e9386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:34:46.759971 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d3918095-0ca6-4fd2-88cb-875cad6925a0 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] 10.222.0.52 "GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985" status: 200 len: 1362 microversion: 2.1 time: 0.367520 Oct 19 03:34:46.761492 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2335/4744] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:34:46 2022] GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985 => generated 1362 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:34:46.764329 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:34:46.770430 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c2738786-dbe8-4a7c-9596-f925c5354d60 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] 10.222.0.52 "GET /compute/v2.1/servers/2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62" status: 200 len: 1491 microversion: 2.1 time: 0.329550 Oct 19 03:34:46.772797 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-45c36488-c312-4df0-b708-5f08a20ec82b tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:34:46.773225 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2410/4745] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:34:46 2022] GET /compute/v2.1/servers/2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62 => generated 1491 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:34:46.790070 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-45c36488-c312-4df0-b708-5f08a20ec82b tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 04f651af-d26c-4307-bb5a-bf3a61160dbb] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:34:46.790070 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-45c36488-c312-4df0-b708-5f08a20ec82b tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:46.790070 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-45c36488-c312-4df0-b708-5f08a20ec82b tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:46.790070 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-45c36488-c312-4df0-b708-5f08a20ec82b tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:46.790070 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-45c36488-c312-4df0-b708-5f08a20ec82b tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:46.790070 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-45c36488-c312-4df0-b708-5f08a20ec82b tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:46.790775 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-45c36488-c312-4df0-b708-5f08a20ec82b tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:46.883496 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-45c36488-c312-4df0-b708-5f08a20ec82b tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:34:46.893098 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-45c36488-c312-4df0-b708-5f08a20ec82b tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/04f651af-d26c-4307-bb5a-bf3a61160dbb" status: 200 len: 1267 microversion: 2.1 time: 0.130422 Oct 19 03:34:46.893956 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2336/4746] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:34:46 2022] GET /compute/v2.1/servers/04f651af-d26c-4307-bb5a-bf3a61160dbb => generated 1267 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:34:47.790334 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-8ebdd10f-cea6-4bfa-b334-acf8eb72aa80 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:34:47.792036 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-8ebdd10f-cea6-4bfa-b334-acf8eb72aa80 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] [instance: ddbf7afb-1d7b-4d33-b6fb-1f1608c11985] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:34:47.804579 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8ebdd10f-cea6-4bfa-b334-acf8eb72aa80 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:47.805888 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f3b8192d-0df1-471f-9801-cee7c617e525 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:34:47.806854 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8ebdd10f-cea6-4bfa-b334-acf8eb72aa80 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:47.807604 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f3b8192d-0df1-471f-9801-cee7c617e525 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] [instance: 2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:34:47.807993 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8ebdd10f-cea6-4bfa-b334-acf8eb72aa80 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:47.813490 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8ebdd10f-cea6-4bfa-b334-acf8eb72aa80 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:47.813490 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8ebdd10f-cea6-4bfa-b334-acf8eb72aa80 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:47.813490 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8ebdd10f-cea6-4bfa-b334-acf8eb72aa80 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:47.823437 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f3b8192d-0df1-471f-9801-cee7c617e525 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:47.824207 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f3b8192d-0df1-471f-9801-cee7c617e525 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:47.825408 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f3b8192d-0df1-471f-9801-cee7c617e525 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:47.826306 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f3b8192d-0df1-471f-9801-cee7c617e525 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:47.829892 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f3b8192d-0df1-471f-9801-cee7c617e525 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:47.830523 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f3b8192d-0df1-471f-9801-cee7c617e525 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:48.385517 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-f3b8192d-0df1-471f-9801-cee7c617e525 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33d07a7db4846ababf001493c6e10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb0265509744c93b03fa5c28b4e9386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:34:48.387298 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-8ebdd10f-cea6-4bfa-b334-acf8eb72aa80 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c65a497e16e4e41b5cf1287042f3a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4001edd1474947a94243a620a6013a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:34:48.419132 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-8ebdd10f-cea6-4bfa-b334-acf8eb72aa80 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] 10.222.0.52 "GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985" status: 200 len: 1362 microversion: 2.1 time: 0.632557 Oct 19 03:34:48.419343 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f3b8192d-0df1-471f-9801-cee7c617e525 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] 10.222.0.52 "GET /compute/v2.1/servers/2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62" status: 200 len: 1491 microversion: 2.1 time: 0.617683 Oct 19 03:34:48.421133 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2411/4747] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:34:47 2022] GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985 => generated 1362 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:34:48.421538 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2337/4748] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:34:47 2022] GET /compute/v2.1/servers/2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62 => generated 1491 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:34:48.430295 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d76d56ac-70f0-48ae-b2c3-4b3a08f780f0 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:34:48.431302 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d76d56ac-70f0-48ae-b2c3-4b3a08f780f0 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 04f651af-d26c-4307-bb5a-bf3a61160dbb] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:34:48.453105 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d76d56ac-70f0-48ae-b2c3-4b3a08f780f0 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:48.454470 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d76d56ac-70f0-48ae-b2c3-4b3a08f780f0 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:48.455009 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d76d56ac-70f0-48ae-b2c3-4b3a08f780f0 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:48.456869 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d76d56ac-70f0-48ae-b2c3-4b3a08f780f0 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:48.457579 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d76d56ac-70f0-48ae-b2c3-4b3a08f780f0 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:48.458222 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d76d56ac-70f0-48ae-b2c3-4b3a08f780f0 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:48.586937 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d76d56ac-70f0-48ae-b2c3-4b3a08f780f0 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:34:48.599871 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d76d56ac-70f0-48ae-b2c3-4b3a08f780f0 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/04f651af-d26c-4307-bb5a-bf3a61160dbb" status: 200 len: 1273 microversion: 2.1 time: 0.175402 Oct 19 03:34:48.610020 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2412/4749] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:34:48 2022] GET /compute/v2.1/servers/04f651af-d26c-4307-bb5a-bf3a61160dbb => generated 1273 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:34:48.681061 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-068dc66f-a80b-44cc-bd33-3b270320e91e tempest-AbsoluteLimitsTestJSON-140085694 tempest-AbsoluteLimitsTestJSON-140085694-project] Calling method '.version_select at 0x7fc12bfe9af0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:34:48.693960 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-068dc66f-a80b-44cc-bd33-3b270320e91e tempest-AbsoluteLimitsTestJSON-140085694 tempest-AbsoluteLimitsTestJSON-140085694-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:48.694663 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-068dc66f-a80b-44cc-bd33-3b270320e91e tempest-AbsoluteLimitsTestJSON-140085694 tempest-AbsoluteLimitsTestJSON-140085694-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:48.695099 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-068dc66f-a80b-44cc-bd33-3b270320e91e tempest-AbsoluteLimitsTestJSON-140085694 tempest-AbsoluteLimitsTestJSON-140085694-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:48.695823 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-068dc66f-a80b-44cc-bd33-3b270320e91e tempest-AbsoluteLimitsTestJSON-140085694 tempest-AbsoluteLimitsTestJSON-140085694-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:48.696277 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-068dc66f-a80b-44cc-bd33-3b270320e91e tempest-AbsoluteLimitsTestJSON-140085694 tempest-AbsoluteLimitsTestJSON-140085694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:48.696707 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-068dc66f-a80b-44cc-bd33-3b270320e91e tempest-AbsoluteLimitsTestJSON-140085694 tempest-AbsoluteLimitsTestJSON-140085694-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:48.719438 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-068dc66f-a80b-44cc-bd33-3b270320e91e tempest-AbsoluteLimitsTestJSON-140085694 tempest-AbsoluteLimitsTestJSON-140085694-project] 10.222.0.52 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.296489 Oct 19 03:34:48.720046 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2338/4750] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Oct 19 03:34:48 2022] GET /compute/v2.1/limits => generated 511 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:34:49.191052 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-96eedb3b-4031-4a2e-ac85-5c829dd2409e req-4cde9fb2-feb8-4d36-ba3e-f1a15019efe2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62", "name": "network-vif-deleted", "tag": "7dac7931-fc74-4a9a-a0b2-14471003659c"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:34:49.211786 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-96eedb3b-4031-4a2e-ac85-5c829dd2409e req-4cde9fb2-feb8-4d36-ba3e-f1a15019efe2 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:49.212530 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-96eedb3b-4031-4a2e-ac85-5c829dd2409e req-4cde9fb2-feb8-4d36-ba3e-f1a15019efe2 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:49.213044 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-96eedb3b-4031-4a2e-ac85-5c829dd2409e req-4cde9fb2-feb8-4d36-ba3e-f1a15019efe2 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:49.230198 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-96eedb3b-4031-4a2e-ac85-5c829dd2409e req-4cde9fb2-feb8-4d36-ba3e-f1a15019efe2 service nova] Creating event network-vif-deleted:7dac7931-fc74-4a9a-a0b2-14471003659c for instance 2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62 on n-h2-861333-8 Oct 19 03:34:49.237279 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-96eedb3b-4031-4a2e-ac85-5c829dd2409e req-4cde9fb2-feb8-4d36-ba3e-f1a15019efe2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051752 Oct 19 03:34:49.238667 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2413/4751] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:34:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:34:49.457302 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-90fc920b-81f7-41a0-9e97-a5604c9296b7 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:34:49.457942 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-90fc920b-81f7-41a0-9e97-a5604c9296b7 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] [instance: ddbf7afb-1d7b-4d33-b6fb-1f1608c11985] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:34:49.459559 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d97aa04a-02c7-4da1-b6d3-c810198ce1e3 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:34:49.461108 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d97aa04a-02c7-4da1-b6d3-c810198ce1e3 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] [instance: 2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:34:49.472835 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d97aa04a-02c7-4da1-b6d3-c810198ce1e3 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:49.474625 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-90fc920b-81f7-41a0-9e97-a5604c9296b7 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:49.475317 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d97aa04a-02c7-4da1-b6d3-c810198ce1e3 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:49.475977 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-90fc920b-81f7-41a0-9e97-a5604c9296b7 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:49.476587 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d97aa04a-02c7-4da1-b6d3-c810198ce1e3 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:49.477215 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-90fc920b-81f7-41a0-9e97-a5604c9296b7 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:49.479444 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d97aa04a-02c7-4da1-b6d3-c810198ce1e3 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:49.479965 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d97aa04a-02c7-4da1-b6d3-c810198ce1e3 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:49.480351 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d97aa04a-02c7-4da1-b6d3-c810198ce1e3 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:49.483573 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-90fc920b-81f7-41a0-9e97-a5604c9296b7 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:49.484492 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-90fc920b-81f7-41a0-9e97-a5604c9296b7 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:49.503572 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-90fc920b-81f7-41a0-9e97-a5604c9296b7 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:49.712539 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d97aa04a-02c7-4da1-b6d3-c810198ce1e3 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33d07a7db4846ababf001493c6e10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb0265509744c93b03fa5c28b4e9386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:34:49.739018 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d97aa04a-02c7-4da1-b6d3-c810198ce1e3 tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] 10.222.0.52 "GET /compute/v2.1/servers/2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62" status: 200 len: 1284 microversion: 2.1 time: 0.282139 Oct 19 03:34:49.739018 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2414/4752] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:34:49 2022] GET /compute/v2.1/servers/2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62 => generated 1284 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:34:49.744782 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f7064cc2-0ea9-4c4a-8971-57564cc1da92 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:34:49.745806 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f7064cc2-0ea9-4c4a-8971-57564cc1da92 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 04f651af-d26c-4307-bb5a-bf3a61160dbb] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:34:49.758157 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:UPDATE=3,nova_api:SELECT=93,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:34:49.760409 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f7064cc2-0ea9-4c4a-8971-57564cc1da92 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:49.763770 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f7064cc2-0ea9-4c4a-8971-57564cc1da92 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:49.764489 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f7064cc2-0ea9-4c4a-8971-57564cc1da92 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:49.766528 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f7064cc2-0ea9-4c4a-8971-57564cc1da92 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:49.767415 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f7064cc2-0ea9-4c4a-8971-57564cc1da92 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:49.768814 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f7064cc2-0ea9-4c4a-8971-57564cc1da92 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:50.129611 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-90fc920b-81f7-41a0-9e97-a5604c9296b7 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c65a497e16e4e41b5cf1287042f3a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4001edd1474947a94243a620a6013a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:34:50.138846 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-90fc920b-81f7-41a0-9e97-a5604c9296b7 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] 10.222.0.52 "GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985" status: 200 len: 1362 microversion: 2.1 time: 0.692771 Oct 19 03:34:50.141936 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2339/4753] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:34:49 2022] GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985 => generated 1362 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:34:50.270660 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f7064cc2-0ea9-4c4a-8971-57564cc1da92 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:34:50.284688 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f7064cc2-0ea9-4c4a-8971-57564cc1da92 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/04f651af-d26c-4307-bb5a-bf3a61160dbb" status: 200 len: 1315 microversion: 2.1 time: 0.547491 Oct 19 03:34:50.285627 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2415/4754] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:34:49 2022] GET /compute/v2.1/servers/04f651af-d26c-4307-bb5a-bf3a61160dbb => generated 1315 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:34:50.408467 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-d3c9a689-0f72-4daa-98e6-3c83c0d3837f req-4ab233b6-de72-41a5-873e-024b6d503f01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddbf7afb-1d7b-4d33-b6fb-1f1608c11985", "name": "network-vif-plugged", "status": "completed", "tag": "bfb7e67f-f9af-4eb9-93e7-64332e835840"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:34:50.424246 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-d3c9a689-0f72-4daa-98e6-3c83c0d3837f req-4ab233b6-de72-41a5-873e-024b6d503f01 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:50.424748 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-d3c9a689-0f72-4daa-98e6-3c83c0d3837f req-4ab233b6-de72-41a5-873e-024b6d503f01 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:50.425193 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-d3c9a689-0f72-4daa-98e6-3c83c0d3837f req-4ab233b6-de72-41a5-873e-024b6d503f01 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:50.456494 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-d3c9a689-0f72-4daa-98e6-3c83c0d3837f req-4ab233b6-de72-41a5-873e-024b6d503f01 service nova] Creating event network-vif-plugged:bfb7e67f-f9af-4eb9-93e7-64332e835840 for instance ddbf7afb-1d7b-4d33-b6fb-1f1608c11985 on n-h2-861333-8 Oct 19 03:34:50.475265 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-d3c9a689-0f72-4daa-98e6-3c83c0d3837f req-4ab233b6-de72-41a5-873e-024b6d503f01 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070891 Oct 19 03:34:50.476052 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2340/4755] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:34:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:34:50.763591 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-07d387c2-b4f2-42d3-80c3-2b04f4a2df8c tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:34:50.764487 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-07d387c2-b4f2-42d3-80c3-2b04f4a2df8c tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] [instance: 2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:34:50.780904 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-99a85a84-8e7b-4340-93f9-ffa1c64a10be req-dc5ee36a-207a-495d-a87f-8087c7a5d39f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04f651af-d26c-4307-bb5a-bf3a61160dbb", "tag": "0715ea39-28fd-4185-92f0-be5a375273f1"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:34:50.797848 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-07d387c2-b4f2-42d3-80c3-2b04f4a2df8c tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:50.798462 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-07d387c2-b4f2-42d3-80c3-2b04f4a2df8c tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:50.798992 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-07d387c2-b4f2-42d3-80c3-2b04f4a2df8c tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:50.800972 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-99a85a84-8e7b-4340-93f9-ffa1c64a10be req-dc5ee36a-207a-495d-a87f-8087c7a5d39f service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:50.801894 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-07d387c2-b4f2-42d3-80c3-2b04f4a2df8c tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:50.805555 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-07d387c2-b4f2-42d3-80c3-2b04f4a2df8c tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:50.806334 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-07d387c2-b4f2-42d3-80c3-2b04f4a2df8c tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:50.806937 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-99a85a84-8e7b-4340-93f9-ffa1c64a10be req-dc5ee36a-207a-495d-a87f-8087c7a5d39f service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:50.808014 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-99a85a84-8e7b-4340-93f9-ffa1c64a10be req-dc5ee36a-207a-495d-a87f-8087c7a5d39f service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:50.849146 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-07d387c2-b4f2-42d3-80c3-2b04f4a2df8c tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] HTTP exception thrown: Instance 2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62 could not be found. Oct 19 03:34:50.849687 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-99a85a84-8e7b-4340-93f9-ffa1c64a10be req-dc5ee36a-207a-495d-a87f-8087c7a5d39f service nova] Creating event network-changed:0715ea39-28fd-4185-92f0-be5a375273f1 for instance 04f651af-d26c-4307-bb5a-bf3a61160dbb on n-h1-861333-8 Oct 19 03:34:50.854677 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-07d387c2-b4f2-42d3-80c3-2b04f4a2df8c tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Request method failure captured: Oct 19 03:34:50.854677 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62 HTTP/1.1 Oct 19 03:34:50.854677 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:34:50.854677 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:34:50.854677 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:34:50.854677 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:34:50.854677 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:34:50.854677 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:34:50.854677 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:34:50.854677 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:34:50.854677 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT2_LCiOHRzNv8M8alihz4V0LrLZyPSpczfSufvB-oE6s-qWL5YugEd3Msxc6jnkwmuht4VeX0YTQZTeUlPtR1MS144U9i8-RR-NL8i_3FGAuyDY28hvtXsT8_l7FqUeVJBnpnl9b-AZLRYLNb-33ys_OAOIdJ76SSwlC1dKzc9Fnepc Oct 19 03:34:50.854677 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:34:50.854677 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:34:50.854677 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:34:50.854677 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:34:50.854677 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:34:50.854677 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:34:50.854677 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 2cb0265509744c93b03fa5c28b4e9386 Oct 19 03:34:50.854677 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ServerRescueTestJSON-508703240 Oct 19 03:34:50.854677 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:34:50.854677 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:34:50.854677 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2cb0265509744c93b03fa5c28b4e9386"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2cb0265509744c93b03fa5c28b4e9386"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2cb0265509744c93b03fa5c28b4e9386"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2cb0265509744c93b03fa5c28b4e9386", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:34:50.854677 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ServerRescueTestJSON-508703240 Oct 19 03:34:50.854677 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 2cb0265509744c93b03fa5c28b4e9386 Oct 19 03:34:50.854677 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ServerRescueTestJSON-508703240 Oct 19 03:34:50.854677 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ServerRescueTestJSON-508703240-project Oct 19 03:34:50.854677 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:34:50.854677 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:34:50.854677 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: b33d07a7db4846ababf001493c6e10d4 Oct 19 03:34:50.854677 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ServerRescueTestJSON-508703240-project Oct 19 03:34:50.854677 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:34:50.854677 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance 2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62 could not be found. Oct 19 03:34:50.854677 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62'} Oct 19 03:34:50.854677 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:34:50.854677 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:34:50.854677 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:34:50.854677 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:34:50.854677 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:34:50.854677 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:34:50.854677 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:34:50.854677 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:34:50.854677 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:34:50.854677 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:34:50.854677 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62 could not be found. Oct 19 03:34:50.854677 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:34:50.854677 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:34:50.854677 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:34:50.854677 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:34:50.854677 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:34:50.854677 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:34:50.854677 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:34:50.854677 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:34:50.854677 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:34:50.854677 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:34:50.854677 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:34:50.854677 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:34:50.854677 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:34:50.854677 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:34:50.854677 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:34:50.854677 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:34:50.854677 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62 could not be found. Oct 19 03:34:50.854677 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:34:50.854677 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:34:50.854677 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:34:50.858978 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:34:50.858978 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:34:50.858978 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:34:50.858978 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:34:50.858978 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:34:50.858978 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62 could not be found. Oct 19 03:34:50.858978 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:34:50.862399 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-07d387c2-b4f2-42d3-80c3-2b04f4a2df8c tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] Returning 404 to user: Instance 2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:34:50.864351 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-99a85a84-8e7b-4340-93f9-ffa1c64a10be req-dc5ee36a-207a-495d-a87f-8087c7a5d39f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094047 Oct 19 03:34:50.865770 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-07d387c2-b4f2-42d3-80c3-2b04f4a2df8c tempest-ServerRescueTestJSON-508703240 tempest-ServerRescueTestJSON-508703240-project] 10.222.0.52 "GET /compute/v2.1/servers/2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62" status: 404 len: 111 microversion: 2.1 time: 0.105239 Oct 19 03:34:50.868488 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2416/4756] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:34:50 2022] GET /compute/v2.1/servers/2fccc5b4-b3a4-4459-9d5c-2a38ad79fd62 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:34:50.877557 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2341/4757] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:34:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 19 03:34:51.163512 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-bf7f19fc-8c40-4601-8e14-79ac5c30b0b2 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:34:51.170060 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-bf7f19fc-8c40-4601-8e14-79ac5c30b0b2 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] [instance: ddbf7afb-1d7b-4d33-b6fb-1f1608c11985] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:34:51.177785 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bf7f19fc-8c40-4601-8e14-79ac5c30b0b2 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:51.178295 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bf7f19fc-8c40-4601-8e14-79ac5c30b0b2 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:51.183333 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bf7f19fc-8c40-4601-8e14-79ac5c30b0b2 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:51.185260 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bf7f19fc-8c40-4601-8e14-79ac5c30b0b2 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:51.192851 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bf7f19fc-8c40-4601-8e14-79ac5c30b0b2 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:51.193880 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bf7f19fc-8c40-4601-8e14-79ac5c30b0b2 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:51.312234 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f1943d87-ed29-465d-916f-44162c080ceb tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:34:51.313894 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f1943d87-ed29-465d-916f-44162c080ceb tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 04f651af-d26c-4307-bb5a-bf3a61160dbb] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:34:51.352138 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f1943d87-ed29-465d-916f-44162c080ceb tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:51.355184 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f1943d87-ed29-465d-916f-44162c080ceb tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:51.364623 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f1943d87-ed29-465d-916f-44162c080ceb tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:51.365966 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f1943d87-ed29-465d-916f-44162c080ceb tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:51.367691 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f1943d87-ed29-465d-916f-44162c080ceb tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:51.375017 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f1943d87-ed29-465d-916f-44162c080ceb tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:51.545782 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-bf7f19fc-8c40-4601-8e14-79ac5c30b0b2 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c65a497e16e4e41b5cf1287042f3a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4001edd1474947a94243a620a6013a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:34:51.562007 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-bf7f19fc-8c40-4601-8e14-79ac5c30b0b2 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] 10.222.0.52 "GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985" status: 200 len: 1362 microversion: 2.1 time: 0.402951 Oct 19 03:34:51.563018 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2417/4758] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:34:51 2022] GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985 => generated 1362 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:34:51.818931 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-f1943d87-ed29-465d-916f-44162c080ceb tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:34:51.830152 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f1943d87-ed29-465d-916f-44162c080ceb tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/04f651af-d26c-4307-bb5a-bf3a61160dbb" status: 200 len: 1315 microversion: 2.1 time: 0.521121 Oct 19 03:34:51.845779 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2342/4759] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:34:51 2022] GET /compute/v2.1/servers/04f651af-d26c-4307-bb5a-bf3a61160dbb => generated 1315 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:34:52.589322 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f3916aee-e0f0-4142-a76c-1f46d89600e3 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:34:52.589973 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f3916aee-e0f0-4142-a76c-1f46d89600e3 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] [instance: ddbf7afb-1d7b-4d33-b6fb-1f1608c11985] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:34:52.606076 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f3916aee-e0f0-4142-a76c-1f46d89600e3 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:52.606234 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f3916aee-e0f0-4142-a76c-1f46d89600e3 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:52.606695 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f3916aee-e0f0-4142-a76c-1f46d89600e3 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:52.607426 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f3916aee-e0f0-4142-a76c-1f46d89600e3 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:52.607886 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f3916aee-e0f0-4142-a76c-1f46d89600e3 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:52.609305 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f3916aee-e0f0-4142-a76c-1f46d89600e3 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:52.863609 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-47961ff9-19b6-4afb-8ef5-8ff923852915 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:34:52.864226 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-47961ff9-19b6-4afb-8ef5-8ff923852915 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 04f651af-d26c-4307-bb5a-bf3a61160dbb] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:34:52.872630 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-47961ff9-19b6-4afb-8ef5-8ff923852915 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:52.877039 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-47961ff9-19b6-4afb-8ef5-8ff923852915 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:52.889300 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-47961ff9-19b6-4afb-8ef5-8ff923852915 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:52.889300 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-47961ff9-19b6-4afb-8ef5-8ff923852915 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:52.890684 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-47961ff9-19b6-4afb-8ef5-8ff923852915 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:52.891335 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-47961ff9-19b6-4afb-8ef5-8ff923852915 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:53.555223 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f3916aee-e0f0-4142-a76c-1f46d89600e3 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c65a497e16e4e41b5cf1287042f3a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4001edd1474947a94243a620a6013a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:34:53.570527 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f3916aee-e0f0-4142-a76c-1f46d89600e3 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] 10.222.0.52 "GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985" status: 200 len: 1548 microversion: 2.1 time: 0.986546 Oct 19 03:34:53.588152 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2418/4760] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:34:52 2022] GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985 => generated 1548 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:34:53.870067 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a7c41fc8-1dc3-4c6c-a0ed-8e7239ed063e tempest-AbsoluteLimitsNegativeTestJSON-656110788 tempest-AbsoluteLimitsNegativeTestJSON-656110788-project] Calling method '.version_select at 0x7fc12bef1d30>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:34:53.884025 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a7c41fc8-1dc3-4c6c-a0ed-8e7239ed063e tempest-AbsoluteLimitsNegativeTestJSON-656110788 tempest-AbsoluteLimitsNegativeTestJSON-656110788-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:53.885152 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a7c41fc8-1dc3-4c6c-a0ed-8e7239ed063e tempest-AbsoluteLimitsNegativeTestJSON-656110788 tempest-AbsoluteLimitsNegativeTestJSON-656110788-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:53.886123 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a7c41fc8-1dc3-4c6c-a0ed-8e7239ed063e tempest-AbsoluteLimitsNegativeTestJSON-656110788 tempest-AbsoluteLimitsNegativeTestJSON-656110788-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:53.887106 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a7c41fc8-1dc3-4c6c-a0ed-8e7239ed063e tempest-AbsoluteLimitsNegativeTestJSON-656110788 tempest-AbsoluteLimitsNegativeTestJSON-656110788-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:53.887778 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a7c41fc8-1dc3-4c6c-a0ed-8e7239ed063e tempest-AbsoluteLimitsNegativeTestJSON-656110788 tempest-AbsoluteLimitsNegativeTestJSON-656110788-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:53.888460 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a7c41fc8-1dc3-4c6c-a0ed-8e7239ed063e tempest-AbsoluteLimitsNegativeTestJSON-656110788 tempest-AbsoluteLimitsNegativeTestJSON-656110788-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:53.905797 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-47961ff9-19b6-4afb-8ef5-8ff923852915 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:34:53.920863 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-47961ff9-19b6-4afb-8ef5-8ff923852915 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/04f651af-d26c-4307-bb5a-bf3a61160dbb" status: 200 len: 1315 microversion: 2.1 time: 1.061557 Oct 19 03:34:53.922970 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2343/4761] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:34:52 2022] GET /compute/v2.1/servers/04f651af-d26c-4307-bb5a-bf3a61160dbb => generated 1315 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:34:53.923383 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a7c41fc8-1dc3-4c6c-a0ed-8e7239ed063e tempest-AbsoluteLimitsNegativeTestJSON-656110788 tempest-AbsoluteLimitsNegativeTestJSON-656110788-project] 10.222.0.52 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.332651 Oct 19 03:34:53.926014 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2419/4762] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Oct 19 03:34:53 2022] GET /compute/v2.1/limits => generated 511 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:34:53.944504 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ed14e0c2-aa72-4343-b483-46bc7f2f716e tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:34:53.945080 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ed14e0c2-aa72-4343-b483-46bc7f2f716e tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] [instance: ddbf7afb-1d7b-4d33-b6fb-1f1608c11985] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:34:53.953770 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ed14e0c2-aa72-4343-b483-46bc7f2f716e tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:53.954556 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ed14e0c2-aa72-4343-b483-46bc7f2f716e tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:53.955167 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ed14e0c2-aa72-4343-b483-46bc7f2f716e tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:53.956312 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ed14e0c2-aa72-4343-b483-46bc7f2f716e tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:53.957095 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ed14e0c2-aa72-4343-b483-46bc7f2f716e tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:53.958289 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ed14e0c2-aa72-4343-b483-46bc7f2f716e tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:54.004360 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-8acb06bc-c006-49b4-a05a-0fcf6b24b987 tempest-AbsoluteLimitsNegativeTestJSON-656110788 tempest-AbsoluteLimitsNegativeTestJSON-656110788-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-794890739", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:34:54.071692 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.network.neutron [None req-8acb06bc-c006-49b4-a05a-0fcf6b24b987 tempest-AbsoluteLimitsNegativeTestJSON-656110788 tempest-AbsoluteLimitsNegativeTestJSON-656110788-project] validate_networks() for None {{(pid=121135) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:34:54.163733 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ed14e0c2-aa72-4343-b483-46bc7f2f716e tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] 10.222.0.52 "GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.239036 Oct 19 03:34:54.165315 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2344/4763] 10.222.0.52 () {58 vars in 1275 bytes} [Wed Oct 19 03:34:53 2022] GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985/os-interface => generated 285 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:34:54.798652 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-8acb06bc-c006-49b4-a05a-0fcf6b24b987 tempest-AbsoluteLimitsNegativeTestJSON-656110788 tempest-AbsoluteLimitsNegativeTestJSON-656110788-project] Getting quotas for project c24e979a74a94ce88692ce5e8454ce8c. Resources: dict_keys(['metadata_items']) {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:34:54.805160 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-8acb06bc-c006-49b4-a05a-0fcf6b24b987 tempest-AbsoluteLimitsNegativeTestJSON-656110788 tempest-AbsoluteLimitsNegativeTestJSON-656110788-project] Getting quotas for user 4854d61720a74ea88f73036982451c30 and project c24e979a74a94ce88692ce5e8454ce8c. Resources: dict_keys(['metadata_items']) {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:34:54.819482 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-8acb06bc-c006-49b4-a05a-0fcf6b24b987 tempest-AbsoluteLimitsNegativeTestJSON-656110788 tempest-AbsoluteLimitsNegativeTestJSON-656110788-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Oct 19 03:34:54.821898 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-8acb06bc-c006-49b4-a05a-0fcf6b24b987 tempest-AbsoluteLimitsNegativeTestJSON-656110788 tempest-AbsoluteLimitsNegativeTestJSON-656110788-project] Request method failure captured: Oct 19 03:34:54.821898 n-d-861333-8 devstack@n-api.service[121135]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 19 03:34:54.821898 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:34:54.821898 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:34:54.821898 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:34:54.821898 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 1751 Oct 19 03:34:54.821898 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:34:54.821898 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:34:54.821898 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:34:54.821898 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:34:54.821898 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT3Bc5zksTyJhbFSAzkyLKcNXYpCKb2XcLXkKWxNgBWBiDiJjPX2zU3ykvVZpQJ-8lxKln_QArjE1FddHdI05Z1csvDFSnb8HvVgfRP5UQNsmQpajtXFUPfLhlYEdro3nHYY39yFyK2g7r44O-PVx09IUjEzQF3oplwjSHs9szt6nmnk Oct 19 03:34:54.821898 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:34:54.821898 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:34:54.821898 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:34:54.821898 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:34:54.821898 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:34:54.821898 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:34:54.821898 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: c24e979a74a94ce88692ce5e8454ce8c Oct 19 03:34:54.821898 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-656110788 Oct 19 03:34:54.821898 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:34:54.821898 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:34:54.821898 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c24e979a74a94ce88692ce5e8454ce8c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c24e979a74a94ce88692ce5e8454ce8c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c24e979a74a94ce88692ce5e8454ce8c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c24e979a74a94ce88692ce5e8454ce8c", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:34:54.821898 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-656110788 Oct 19 03:34:54.821898 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: c24e979a74a94ce88692ce5e8454ce8c Oct 19 03:34:54.821898 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-656110788 Oct 19 03:34:54.821898 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-656110788-project Oct 19 03:34:54.821898 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:34:54.821898 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:34:54.821898 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 4854d61720a74ea88f73036982451c30 Oct 19 03:34:54.821898 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-656110788-project Oct 19 03:34:54.821898 n-d-861333-8 devstack@n-api.service[121135]: Oct 19 03:34:54.821898 n-d-861333-8 devstack@n-api.service[121135]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-794890739", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Oct 19 03:34:54.821898 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:34:54.821898 n-d-861333-8 devstack@n-api.service[121135]: exception: Maximum number of metadata items exceeds 128 Oct 19 03:34:54.824102 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-794890739', 'imageRef': '9e16d73e-70ea-4421-aee3-047d80396c02', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Oct 19 03:34:54.824102 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:34:54.824102 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:34:54.824102 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Oct 19 03:34:54.824102 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Oct 19 03:34:54.824102 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 03:34:54.824102 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 03:34:54.824102 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Oct 19 03:34:54.824102 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Oct 19 03:34:54.824102 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Oct 19 03:34:54.824102 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Oct 19 03:34:54.824102 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Oct 19 03:34:54.824102 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Oct 19 03:34:54.824102 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Oct 19 03:34:54.824102 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:34:54.824102 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:34:54.824102 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:34:54.824102 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:34:54.824102 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 19 03:34:54.824102 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 19 03:34:54.824102 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 19 03:34:54.824102 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 19 03:34:54.824102 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 19 03:34:54.824102 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 19 03:34:54.824102 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Oct 19 03:34:54.824102 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Oct 19 03:34:54.824102 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Oct 19 03:34:54.824102 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Oct 19 03:34:54.824102 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Oct 19 03:34:54.824102 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:34:54.824102 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:34:54.824102 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:34:54.824102 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:34:54.824102 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:34:54.824102 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:34:54.824102 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:34:54.824102 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:34:54.824102 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:34:54.824102 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:34:54.824102 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:34:54.824102 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:34:54.824102 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:34:54.824102 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:34:54.824102 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:34:54.826725 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:34:54.826725 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 19 03:34:54.826725 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 19 03:34:54.826725 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 19 03:34:54.826725 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Oct 19 03:34:54.826725 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:34:54.826725 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:34:54.826725 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:34:54.826725 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:34:54.826725 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:34:54.826725 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:34:54.826725 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:34:54.826725 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:34:54.826725 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Oct 19 03:34:54.826725 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:34:54.830678 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-8acb06bc-c006-49b4-a05a-0fcf6b24b987 tempest-AbsoluteLimitsNegativeTestJSON-656110788 tempest-AbsoluteLimitsNegativeTestJSON-656110788-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:34:54.831699 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-8acb06bc-c006-49b4-a05a-0fcf6b24b987 tempest-AbsoluteLimitsNegativeTestJSON-656110788 tempest-AbsoluteLimitsNegativeTestJSON-656110788-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.831595 Oct 19 03:34:54.832697 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2420/4764] 10.222.0.52 () {60 vars in 1148 bytes} [Wed Oct 19 03:34:53 2022] POST /compute/v2.1/servers => generated 87 bytes in 833 msecs (HTTP/1.1 403) 9 headers in 378 bytes (2 switches on core 0) Oct 19 03:34:54.946160 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-26f63cec-e2b3-4532-8470-5fb6551e0bab tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:34:54.947407 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-26f63cec-e2b3-4532-8470-5fb6551e0bab tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 04f651af-d26c-4307-bb5a-bf3a61160dbb] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:34:54.966320 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-26f63cec-e2b3-4532-8470-5fb6551e0bab tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:54.966845 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-26f63cec-e2b3-4532-8470-5fb6551e0bab tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:54.967297 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-26f63cec-e2b3-4532-8470-5fb6551e0bab tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:54.986478 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-26f63cec-e2b3-4532-8470-5fb6551e0bab tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:54.986987 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-26f63cec-e2b3-4532-8470-5fb6551e0bab tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:54.987443 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-26f63cec-e2b3-4532-8470-5fb6551e0bab tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:55.115661 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-dc94147c-3d8f-4e6d-b315-3f37780fedb0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1515487815 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1515487815-project-admin] Calling method '.version_select at 0x7fc130b2d1f0>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:34:55.118248 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dc94147c-3d8f-4e6d-b315-3f37780fedb0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1515487815 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1515487815-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:55.118762 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dc94147c-3d8f-4e6d-b315-3f37780fedb0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1515487815 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1515487815-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:55.119264 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dc94147c-3d8f-4e6d-b315-3f37780fedb0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1515487815 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1515487815-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:55.163696 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dc94147c-3d8f-4e6d-b315-3f37780fedb0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1515487815 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1515487815-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:55.164212 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dc94147c-3d8f-4e6d-b315-3f37780fedb0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1515487815 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1515487815-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:55.164663 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dc94147c-3d8f-4e6d-b315-3f37780fedb0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1515487815 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1515487815-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:55.197215 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dc94147c-3d8f-4e6d-b315-3f37780fedb0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1515487815 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1515487815-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:55.198017 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dc94147c-3d8f-4e6d-b315-3f37780fedb0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1515487815 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1515487815-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:55.198671 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dc94147c-3d8f-4e6d-b315-3f37780fedb0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1515487815 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1515487815-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:55.235530 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-dc94147c-3d8f-4e6d-b315-3f37780fedb0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1515487815 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1515487815-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.207768 Oct 19 03:34:55.244959 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2421/4765] 10.222.0.52 () {58 vars in 1146 bytes} [Wed Oct 19 03:34:55 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:34:55.635412 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-26f63cec-e2b3-4532-8470-5fb6551e0bab tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:34:55.654215 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-26f63cec-e2b3-4532-8470-5fb6551e0bab tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/04f651af-d26c-4307-bb5a-bf3a61160dbb" status: 200 len: 1315 microversion: 2.1 time: 0.711989 Oct 19 03:34:55.655138 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2345/4766] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:34:54 2022] GET /compute/v2.1/servers/04f651af-d26c-4307-bb5a-bf3a61160dbb => generated 1315 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:34:56.690905 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d4af5d76-4a80-44df-8d5d-346cdb3a8043 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:34:56.693316 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d4af5d76-4a80-44df-8d5d-346cdb3a8043 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 04f651af-d26c-4307-bb5a-bf3a61160dbb] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:34:56.732115 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d4af5d76-4a80-44df-8d5d-346cdb3a8043 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:56.733921 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d4af5d76-4a80-44df-8d5d-346cdb3a8043 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:56.735271 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d4af5d76-4a80-44df-8d5d-346cdb3a8043 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:56.736979 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d4af5d76-4a80-44df-8d5d-346cdb3a8043 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:56.738441 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d4af5d76-4a80-44df-8d5d-346cdb3a8043 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:56.739962 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d4af5d76-4a80-44df-8d5d-346cdb3a8043 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:57.117068 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d4af5d76-4a80-44df-8d5d-346cdb3a8043 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:34:57.142438 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d4af5d76-4a80-44df-8d5d-346cdb3a8043 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/04f651af-d26c-4307-bb5a-bf3a61160dbb" status: 200 len: 1315 microversion: 2.1 time: 0.466331 Oct 19 03:34:57.143712 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2422/4767] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:34:56 2022] GET /compute/v2.1/servers/04f651af-d26c-4307-bb5a-bf3a61160dbb => generated 1315 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:34:58.174365 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-bd2b4aab-bc7c-47af-892a-78d7a8ee0f1e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:34:58.178289 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-bd2b4aab-bc7c-47af-892a-78d7a8ee0f1e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 04f651af-d26c-4307-bb5a-bf3a61160dbb] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:34:58.196727 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bd2b4aab-bc7c-47af-892a-78d7a8ee0f1e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:58.197560 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bd2b4aab-bc7c-47af-892a-78d7a8ee0f1e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:58.199312 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bd2b4aab-bc7c-47af-892a-78d7a8ee0f1e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:58.201820 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bd2b4aab-bc7c-47af-892a-78d7a8ee0f1e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:58.203137 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-f4be357f-6eb4-47eb-b6f5-cb9f852f93c4 req-86014242-9aa9-4c42-9ccc-65c99efeacea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04f651af-d26c-4307-bb5a-bf3a61160dbb", "name": "network-vif-plugged", "status": "completed", "tag": "0715ea39-28fd-4185-92f0-be5a375273f1"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:34:58.207191 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bd2b4aab-bc7c-47af-892a-78d7a8ee0f1e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:58.212896 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bd2b4aab-bc7c-47af-892a-78d7a8ee0f1e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:58.221888 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-f4be357f-6eb4-47eb-b6f5-cb9f852f93c4 req-86014242-9aa9-4c42-9ccc-65c99efeacea service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:58.222390 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-f4be357f-6eb4-47eb-b6f5-cb9f852f93c4 req-86014242-9aa9-4c42-9ccc-65c99efeacea service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:58.222837 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-f4be357f-6eb4-47eb-b6f5-cb9f852f93c4 req-86014242-9aa9-4c42-9ccc-65c99efeacea service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:58.252001 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-f4be357f-6eb4-47eb-b6f5-cb9f852f93c4 req-86014242-9aa9-4c42-9ccc-65c99efeacea service nova] Creating event network-vif-plugged:0715ea39-28fd-4185-92f0-be5a375273f1 for instance 04f651af-d26c-4307-bb5a-bf3a61160dbb on n-h1-861333-8 Oct 19 03:34:58.266458 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-f4be357f-6eb4-47eb-b6f5-cb9f852f93c4 req-86014242-9aa9-4c42-9ccc-65c99efeacea service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068503 Oct 19 03:34:58.270384 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2423/4768] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:34:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:34:58.692596 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=24 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:34:58.710108 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:34:58.797783 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-bd2b4aab-bc7c-47af-892a-78d7a8ee0f1e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:34:58.800086 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=100 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:34:58.806836 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-bd2b4aab-bc7c-47af-892a-78d7a8ee0f1e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/04f651af-d26c-4307-bb5a-bf3a61160dbb" status: 200 len: 1315 microversion: 2.1 time: 0.639769 Oct 19 03:34:58.807549 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2346/4769] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:34:58 2022] GET /compute/v2.1/servers/04f651af-d26c-4307-bb5a-bf3a61160dbb => generated 1315 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:34:59.151562 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-69198036-2e17-4f96-926f-e179419b9d53 req-7b1a53fc-aeef-48a1-b80b-f3ca9ad4297b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ddbf7afb-1d7b-4d33-b6fb-1f1608c11985", "tag": "bfb7e67f-f9af-4eb9-93e7-64332e835840"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:34:59.164787 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-69198036-2e17-4f96-926f-e179419b9d53 req-7b1a53fc-aeef-48a1-b80b-f3ca9ad4297b service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:59.165529 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-69198036-2e17-4f96-926f-e179419b9d53 req-7b1a53fc-aeef-48a1-b80b-f3ca9ad4297b service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:59.166338 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-69198036-2e17-4f96-926f-e179419b9d53 req-7b1a53fc-aeef-48a1-b80b-f3ca9ad4297b service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:59.180631 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-69198036-2e17-4f96-926f-e179419b9d53 req-7b1a53fc-aeef-48a1-b80b-f3ca9ad4297b service nova] Creating event network-changed:bfb7e67f-f9af-4eb9-93e7-64332e835840 for instance ddbf7afb-1d7b-4d33-b6fb-1f1608c11985 on n-h2-861333-8 Oct 19 03:34:59.187072 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-69198036-2e17-4f96-926f-e179419b9d53 req-7b1a53fc-aeef-48a1-b80b-f3ca9ad4297b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041413 Oct 19 03:34:59.189702 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2424/4770] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:34:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:34:59.830046 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3c5f2817-162c-4783-ac12-1e6d7426598d tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:34:59.831438 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3c5f2817-162c-4783-ac12-1e6d7426598d tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 04f651af-d26c-4307-bb5a-bf3a61160dbb] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:34:59.841003 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3c5f2817-162c-4783-ac12-1e6d7426598d tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:59.841907 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3c5f2817-162c-4783-ac12-1e6d7426598d tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:59.842527 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3c5f2817-162c-4783-ac12-1e6d7426598d tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:34:59.844030 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3c5f2817-162c-4783-ac12-1e6d7426598d tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:34:59.854590 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3c5f2817-162c-4783-ac12-1e6d7426598d tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:34:59.854590 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3c5f2817-162c-4783-ac12-1e6d7426598d tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:00.905561 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-3c5f2817-162c-4783-ac12-1e6d7426598d tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:35:00.914821 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3c5f2817-162c-4783-ac12-1e6d7426598d tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/04f651af-d26c-4307-bb5a-bf3a61160dbb" status: 200 len: 1315 microversion: 2.1 time: 1.088609 Oct 19 03:35:00.915728 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2347/4771] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:34:59 2022] GET /compute/v2.1/servers/04f651af-d26c-4307-bb5a-bf3a61160dbb => generated 1315 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:35:01.942502 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-11554202-dfd6-4bab-ac2e-64e7e622d69a tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:35:01.945686 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-11554202-dfd6-4bab-ac2e-64e7e622d69a tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 04f651af-d26c-4307-bb5a-bf3a61160dbb] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:35:01.954292 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-11554202-dfd6-4bab-ac2e-64e7e622d69a tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:01.959277 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-11554202-dfd6-4bab-ac2e-64e7e622d69a tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:01.959277 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-11554202-dfd6-4bab-ac2e-64e7e622d69a tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:01.959277 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-11554202-dfd6-4bab-ac2e-64e7e622d69a tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:01.959277 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-11554202-dfd6-4bab-ac2e-64e7e622d69a tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:01.959277 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-11554202-dfd6-4bab-ac2e-64e7e622d69a tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:02.272067 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-11554202-dfd6-4bab-ac2e-64e7e622d69a tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:35:02.282113 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-11554202-dfd6-4bab-ac2e-64e7e622d69a tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/04f651af-d26c-4307-bb5a-bf3a61160dbb" status: 200 len: 1502 microversion: 2.1 time: 0.345315 Oct 19 03:35:02.283890 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2425/4772] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:35:01 2022] GET /compute/v2.1/servers/04f651af-d26c-4307-bb5a-bf3a61160dbb => generated 1502 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:35:02.308085 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-56f66feb-8b65-4857-9c84-19db62bfdc20 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:35:02.309285 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-56f66feb-8b65-4857-9c84-19db62bfdc20 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 04f651af-d26c-4307-bb5a-bf3a61160dbb] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:35:02.318180 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-56f66feb-8b65-4857-9c84-19db62bfdc20 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:02.318736 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-56f66feb-8b65-4857-9c84-19db62bfdc20 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:02.319041 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-56f66feb-8b65-4857-9c84-19db62bfdc20 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:02.319768 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-56f66feb-8b65-4857-9c84-19db62bfdc20 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:02.320222 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-56f66feb-8b65-4857-9c84-19db62bfdc20 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:02.320881 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-56f66feb-8b65-4857-9c84-19db62bfdc20 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:02.662929 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.network.security_group_api [None req-56f66feb-8b65-4857-9c84-19db62bfdc20 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Removing security group cc4b1364-05bd-43aa-8df9-8d29ead0cbcf from port 0715ea39-28fd-4185-92f0-be5a375273f1 Oct 19 03:35:03.145926 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-24db4932-aa99-411a-9277-6562142823c4 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1921455876", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:35:03.237893 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.network.neutron [None req-24db4932-aa99-411a-9277-6562142823c4 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] validate_networks() for [('75d594ba-6262-405c-928b-1cea9334995a', None, None, None, None, None)] {{(pid=121135) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:35:03.901649 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=4 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:35:03.970146 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-56f66feb-8b65-4857-9c84-19db62bfdc20 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "POST /compute/v2.1/servers/04f651af-d26c-4307-bb5a-bf3a61160dbb/action" status: 202 len: 0 microversion: 2.1 time: 1.662558 Oct 19 03:35:03.983498 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2348/4773] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:35:02 2022] POST /compute/v2.1/servers/04f651af-d26c-4307-bb5a-bf3a61160dbb/action => generated 0 bytes in 1680 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:35:03.997966 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c7bdbcba-541f-40f3-b309-8a1afd69c8c5 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:35:03.998694 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c7bdbcba-541f-40f3-b309-8a1afd69c8c5 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 04f651af-d26c-4307-bb5a-bf3a61160dbb] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:35:04.012058 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c7bdbcba-541f-40f3-b309-8a1afd69c8c5 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:04.016068 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c7bdbcba-541f-40f3-b309-8a1afd69c8c5 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:04.018309 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c7bdbcba-541f-40f3-b309-8a1afd69c8c5 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:04.019322 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c7bdbcba-541f-40f3-b309-8a1afd69c8c5 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:04.023300 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c7bdbcba-541f-40f3-b309-8a1afd69c8c5 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:04.023937 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c7bdbcba-541f-40f3-b309-8a1afd69c8c5 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:04.434528 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c7bdbcba-541f-40f3-b309-8a1afd69c8c5 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:35:04.446459 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c7bdbcba-541f-40f3-b309-8a1afd69c8c5 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/04f651af-d26c-4307-bb5a-bf3a61160dbb" status: 200 len: 1460 microversion: 2.1 time: 0.458609 Oct 19 03:35:04.450008 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2349/4774] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:35:03 2022] GET /compute/v2.1/servers/04f651af-d26c-4307-bb5a-bf3a61160dbb => generated 1460 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:35:04.463960 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-1f850ec3-a55c-4b59-8509-07fff12f4905 req-1aa65f79-bd80-4de5-a5c5-6bf09ab1b026 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04f651af-d26c-4307-bb5a-bf3a61160dbb", "tag": "0715ea39-28fd-4185-92f0-be5a375273f1"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:35:04.477152 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-1f850ec3-a55c-4b59-8509-07fff12f4905 req-1aa65f79-bd80-4de5-a5c5-6bf09ab1b026 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:04.477152 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-1f850ec3-a55c-4b59-8509-07fff12f4905 req-1aa65f79-bd80-4de5-a5c5-6bf09ab1b026 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:04.477541 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-1f850ec3-a55c-4b59-8509-07fff12f4905 req-1aa65f79-bd80-4de5-a5c5-6bf09ab1b026 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:04.495284 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-1f850ec3-a55c-4b59-8509-07fff12f4905 req-1aa65f79-bd80-4de5-a5c5-6bf09ab1b026 service nova] Creating event network-changed:0715ea39-28fd-4185-92f0-be5a375273f1 for instance 04f651af-d26c-4307-bb5a-bf3a61160dbb on n-h1-861333-8 Oct 19 03:35:04.511280 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-1f850ec3-a55c-4b59-8509-07fff12f4905 req-1aa65f79-bd80-4de5-a5c5-6bf09ab1b026 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055007 Oct 19 03:35:04.512335 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2350/4775] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:35:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:35:04.519047 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b5ce0acf-6045-49e0-8079-3a3e9f920983 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:35:04.519990 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b5ce0acf-6045-49e0-8079-3a3e9f920983 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:35:04.527121 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b5ce0acf-6045-49e0-8079-3a3e9f920983 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:04.527905 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b5ce0acf-6045-49e0-8079-3a3e9f920983 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:04.529007 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b5ce0acf-6045-49e0-8079-3a3e9f920983 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:04.530549 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b5ce0acf-6045-49e0-8079-3a3e9f920983 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:04.531357 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b5ce0acf-6045-49e0-8079-3a3e9f920983 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:04.532353 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b5ce0acf-6045-49e0-8079-3a3e9f920983 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:04.659459 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-24db4932-aa99-411a-9277-6562142823c4 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Flavor limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:35:04.660035 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-24db4932-aa99-411a-9277-6562142823c4 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Image limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:35:04.660429 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-24db4932-aa99-411a-9277-6562142823c4 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Flavor pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:35:04.660829 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-24db4932-aa99-411a-9277-6562142823c4 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Image pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:35:04.661242 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-24db4932-aa99-411a-9277-6562142823c4 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:35:04.704950 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-24db4932-aa99-411a-9277-6562142823c4 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:04.705847 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-24db4932-aa99-411a-9277-6562142823c4 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:04.710771 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-24db4932-aa99-411a-9277-6562142823c4 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:04.711814 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-24db4932-aa99-411a-9277-6562142823c4 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:04.712161 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-24db4932-aa99-411a-9277-6562142823c4 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:04.712596 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-24db4932-aa99-411a-9277-6562142823c4 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:04.772089 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-24db4932-aa99-411a-9277-6562142823c4 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Getting quotas for project 2ce5e9f9a4644b27a24b2f4c06df97bc. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:35:04.783947 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-24db4932-aa99-411a-9277-6562142823c4 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Getting quotas for user b4729a0afd69480f99642266e0eec17e and project 2ce5e9f9a4644b27a24b2f4c06df97bc. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:35:04.823220 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-24db4932-aa99-411a-9277-6562142823c4 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Going to run 1 instances... {{(pid=121135) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:35:04.825778 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-24db4932-aa99-411a-9277-6562142823c4 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 8955f425-23eb-423e-8ed4-eea1bd5dbc08] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121135) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:35:05.040959 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-24db4932-aa99-411a-9277-6562142823c4 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.130701 Oct 19 03:35:05.049914 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2426/4776] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:35:02 2022] POST /compute/v2.1/servers => generated 383 bytes in 2142 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 03:35:05.061911 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2c2bf8a8-a434-4584-81e0-cb5b3399db43 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:35:05.062544 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-2c2bf8a8-a434-4584-81e0-cb5b3399db43 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 8955f425-23eb-423e-8ed4-eea1bd5dbc08] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:35:05.183087 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-2c2bf8a8-a434-4584-81e0-cb5b3399db43 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4729a0afd69480f99642266e0eec17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce5e9f9a4644b27a24b2f4c06df97bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:35:05.206955 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2c2bf8a8-a434-4584-81e0-cb5b3399db43 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/8955f425-23eb-423e-8ed4-eea1bd5dbc08" status: 200 len: 1222 microversion: 2.1 time: 0.146487 Oct 19 03:35:05.209924 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2427/4777] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:35:05 2022] GET /compute/v2.1/servers/8955f425-23eb-423e-8ed4-eea1bd5dbc08 => generated 1222 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:35:05.231156 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b5ce0acf-6045-49e0-8079-3a3e9f920983 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:35:05.256331 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b5ce0acf-6045-49e0-8079-3a3e9f920983 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1670 microversion: 2.1 time: 0.736071 Oct 19 03:35:05.259307 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2351/4778] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:35:04 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1670 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:35:05.300897 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1b6e6819-41a0-4353-aa6c-34df8cd97787 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:35:05.304398 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1b6e6819-41a0-4353-aa6c-34df8cd97787 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:35:05.323646 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1b6e6819-41a0-4353-aa6c-34df8cd97787 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:05.343058 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1b6e6819-41a0-4353-aa6c-34df8cd97787 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:05.343058 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1b6e6819-41a0-4353-aa6c-34df8cd97787 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:05.343058 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1b6e6819-41a0-4353-aa6c-34df8cd97787 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:05.343058 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1b6e6819-41a0-4353-aa6c-34df8cd97787 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:05.344736 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1b6e6819-41a0-4353-aa6c-34df8cd97787 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:05.492506 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-879a6c21-5bb7-4f55-8d9f-0943eedc7411 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1143844094", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:35:05.581930 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-879a6c21-5bb7-4f55-8d9f-0943eedc7411 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] validate_networks() for [('75d594ba-6262-405c-928b-1cea9334995a', None, None, None, None, None)] {{(pid=121134) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:35:06.047048 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-1b6e6819-41a0-4353-aa6c-34df8cd97787 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:35:06.072195 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1b6e6819-41a0-4353-aa6c-34df8cd97787 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1670 microversion: 2.1 time: 0.770641 Oct 19 03:35:06.078764 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2428/4779] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:35:05 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1670 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:35:06.086427 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-64a337c8-c351-4ce9-9565-ec305e840059 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:35:06.087337 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-64a337c8-c351-4ce9-9565-ec305e840059 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:35:06.093967 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-64a337c8-c351-4ce9-9565-ec305e840059 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:06.094628 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-64a337c8-c351-4ce9-9565-ec305e840059 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:06.095534 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-64a337c8-c351-4ce9-9565-ec305e840059 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:06.096514 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-64a337c8-c351-4ce9-9565-ec305e840059 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:06.097462 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-64a337c8-c351-4ce9-9565-ec305e840059 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:06.098396 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-64a337c8-c351-4ce9-9565-ec305e840059 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:06.490129 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-64a337c8-c351-4ce9-9565-ec305e840059 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:35:06.508564 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-64a337c8-c351-4ce9-9565-ec305e840059 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1670 microversion: 2.1 time: 0.427242 Oct 19 03:35:06.509012 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2429/4780] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:35:06 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1670 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:35:06.535949 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-62043b8e-59c0-4358-80cd-1ca331de69aa tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:35:06.536835 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-62043b8e-59c0-4358-80cd-1ca331de69aa tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:35:06.544294 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-62043b8e-59c0-4358-80cd-1ca331de69aa tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:06.545160 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-62043b8e-59c0-4358-80cd-1ca331de69aa tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:06.545839 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-62043b8e-59c0-4358-80cd-1ca331de69aa tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:06.546817 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-62043b8e-59c0-4358-80cd-1ca331de69aa tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:06.548294 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-62043b8e-59c0-4358-80cd-1ca331de69aa tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:06.548955 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-62043b8e-59c0-4358-80cd-1ca331de69aa tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:06.922718 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-62043b8e-59c0-4358-80cd-1ca331de69aa tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:35:06.932559 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-62043b8e-59c0-4358-80cd-1ca331de69aa tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1670 microversion: 2.1 time: 0.401595 Oct 19 03:35:06.954317 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2430/4781] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:35:06 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1670 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:35:07.201717 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4b86730b-b786-42fc-8d43-62e26978459f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-43836138", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "networks": [{"uuid": "6b668808-7c3c-40ac-9532-ec2c53b84149"}]}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:35:07.298733 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.network.neutron [None req-4b86730b-b786-42fc-8d43-62e26978459f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] validate_networks() for [('6b668808-7c3c-40ac-9532-ec2c53b84149', None, None, None, None, None)] {{(pid=121135) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:35:07.818079 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-879a6c21-5bb7-4f55-8d9f-0943eedc7411 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Flavor limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:35:07.818628 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-879a6c21-5bb7-4f55-8d9f-0943eedc7411 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Image limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:35:07.828607 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-879a6c21-5bb7-4f55-8d9f-0943eedc7411 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Flavor pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:35:07.828607 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-879a6c21-5bb7-4f55-8d9f-0943eedc7411 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Image pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:35:07.828607 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-879a6c21-5bb7-4f55-8d9f-0943eedc7411 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:35:07.842415 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-879a6c21-5bb7-4f55-8d9f-0943eedc7411 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:07.844930 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-879a6c21-5bb7-4f55-8d9f-0943eedc7411 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:07.851163 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-879a6c21-5bb7-4f55-8d9f-0943eedc7411 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:07.851163 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-879a6c21-5bb7-4f55-8d9f-0943eedc7411 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:07.851163 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-879a6c21-5bb7-4f55-8d9f-0943eedc7411 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:07.851163 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-879a6c21-5bb7-4f55-8d9f-0943eedc7411 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:07.898143 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-879a6c21-5bb7-4f55-8d9f-0943eedc7411 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Getting quotas for project 2ce5e9f9a4644b27a24b2f4c06df97bc. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:35:07.911214 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-879a6c21-5bb7-4f55-8d9f-0943eedc7411 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Getting quotas for user b4729a0afd69480f99642266e0eec17e and project 2ce5e9f9a4644b27a24b2f4c06df97bc. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:35:07.960852 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-879a6c21-5bb7-4f55-8d9f-0943eedc7411 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Going to run 1 instances... {{(pid=121134) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:35:07.963244 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-879a6c21-5bb7-4f55-8d9f-0943eedc7411 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 06b5db2c-baea-4e51-8506-6443bbd9daeb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:35:08.155157 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-879a6c21-5bb7-4f55-8d9f-0943eedc7411 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.666860 Oct 19 03:35:08.158383 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2352/4782] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:35:05 2022] POST /compute/v2.1/servers => generated 383 bytes in 2671 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 19 03:35:08.171036 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e77256b8-c9f2-426f-9f27-59b6ff5fd4bf tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:35:08.175067 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e77256b8-c9f2-426f-9f27-59b6ff5fd4bf tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 06b5db2c-baea-4e51-8506-6443bbd9daeb] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:35:08.327678 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e77256b8-c9f2-426f-9f27-59b6ff5fd4bf tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4729a0afd69480f99642266e0eec17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce5e9f9a4644b27a24b2f4c06df97bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:35:08.357978 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e77256b8-c9f2-426f-9f27-59b6ff5fd4bf tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/06b5db2c-baea-4e51-8506-6443bbd9daeb" status: 200 len: 1222 microversion: 2.1 time: 0.176515 Oct 19 03:35:08.359304 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2353/4783] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:35:08 2022] GET /compute/v2.1/servers/06b5db2c-baea-4e51-8506-6443bbd9daeb => generated 1222 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:35:09.007332 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-4b86730b-b786-42fc-8d43-62e26978459f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Flavor limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:35:09.008477 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-4b86730b-b786-42fc-8d43-62e26978459f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Image limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:35:09.009435 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-4b86730b-b786-42fc-8d43-62e26978459f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Flavor pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:35:09.009999 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-4b86730b-b786-42fc-8d43-62e26978459f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Image pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:35:09.020385 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-4b86730b-b786-42fc-8d43-62e26978459f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:35:09.035766 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4b86730b-b786-42fc-8d43-62e26978459f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:09.036744 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4b86730b-b786-42fc-8d43-62e26978459f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:09.037839 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4b86730b-b786-42fc-8d43-62e26978459f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:09.038764 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4b86730b-b786-42fc-8d43-62e26978459f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:09.039217 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4b86730b-b786-42fc-8d43-62e26978459f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:09.039692 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4b86730b-b786-42fc-8d43-62e26978459f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:09.071056 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-4b86730b-b786-42fc-8d43-62e26978459f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Getting quotas for project a5f56376721941f8ae2293f8f969db84. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:35:09.090820 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-4b86730b-b786-42fc-8d43-62e26978459f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Getting quotas for user 746e1034a7ee40c1a69c8838c1e17e16 and project a5f56376721941f8ae2293f8f969db84. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:35:09.107214 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4b86730b-b786-42fc-8d43-62e26978459f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Going to run 1 instances... {{(pid=121135) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:35:09.110822 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4b86730b-b786-42fc-8d43-62e26978459f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121135) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:35:09.322204 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4b86730b-b786-42fc-8d43-62e26978459f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.121755 Oct 19 03:35:09.325335 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2431/4784] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:35:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 2128 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 19 03:35:09.334434 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-292e6d0c-66f6-447a-92dc-f7c13ae444fc tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:35:09.334889 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-292e6d0c-66f6-447a-92dc-f7c13ae444fc tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:35:09.378627 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b28c9cd6-cfc4-4fe2-b98a-53edf1210c95 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:35:09.380513 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b28c9cd6-cfc4-4fe2-b98a-53edf1210c95 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 06b5db2c-baea-4e51-8506-6443bbd9daeb] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:35:09.632169 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-292e6d0c-66f6-447a-92dc-f7c13ae444fc tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:35:09.649478 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-292e6d0c-66f6-447a-92dc-f7c13ae444fc tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21" status: 200 len: 1213 microversion: 2.1 time: 0.313043 Oct 19 03:35:09.659471 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2354/4785] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:35:09 2022] GET /compute/v2.1/servers/e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21 => generated 1213 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:35:09.742665 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b28c9cd6-cfc4-4fe2-b98a-53edf1210c95 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4729a0afd69480f99642266e0eec17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce5e9f9a4644b27a24b2f4c06df97bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:35:09.756324 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b28c9cd6-cfc4-4fe2-b98a-53edf1210c95 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/06b5db2c-baea-4e51-8506-6443bbd9daeb" status: 200 len: 1222 microversion: 2.1 time: 0.387964 Oct 19 03:35:09.757076 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2432/4786] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:35:09 2022] GET /compute/v2.1/servers/06b5db2c-baea-4e51-8506-6443bbd9daeb => generated 1222 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:35:10.666679 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ed18f0bd-c320-4298-a713-7883a76aac6a tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:35:10.667306 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ed18f0bd-c320-4298-a713-7883a76aac6a tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:35:10.689768 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ed18f0bd-c320-4298-a713-7883a76aac6a tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:10.694285 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ed18f0bd-c320-4298-a713-7883a76aac6a tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:10.706020 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ed18f0bd-c320-4298-a713-7883a76aac6a tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:10.707073 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ed18f0bd-c320-4298-a713-7883a76aac6a tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:10.709993 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ed18f0bd-c320-4298-a713-7883a76aac6a tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:10.710644 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ed18f0bd-c320-4298-a713-7883a76aac6a tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:10.779731 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-bc4d07c5-1ad2-4d22-a85b-08bc1b125cb2 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:35:10.782462 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-bc4d07c5-1ad2-4d22-a85b-08bc1b125cb2 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 06b5db2c-baea-4e51-8506-6443bbd9daeb] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:35:10.796996 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bc4d07c5-1ad2-4d22-a85b-08bc1b125cb2 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:10.797531 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bc4d07c5-1ad2-4d22-a85b-08bc1b125cb2 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:10.797980 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bc4d07c5-1ad2-4d22-a85b-08bc1b125cb2 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:10.805638 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bc4d07c5-1ad2-4d22-a85b-08bc1b125cb2 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:10.806684 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bc4d07c5-1ad2-4d22-a85b-08bc1b125cb2 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:10.807525 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bc4d07c5-1ad2-4d22-a85b-08bc1b125cb2 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:10.928253 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ed18f0bd-c320-4298-a713-7883a76aac6a tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:35:10.942801 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ed18f0bd-c320-4298-a713-7883a76aac6a tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21" status: 200 len: 1217 microversion: 2.1 time: 0.280005 Oct 19 03:35:10.963235 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2355/4787] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:35:10 2022] GET /compute/v2.1/servers/e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21 => generated 1217 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:35:11.378282 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-bc4d07c5-1ad2-4d22-a85b-08bc1b125cb2 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4729a0afd69480f99642266e0eec17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce5e9f9a4644b27a24b2f4c06df97bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:35:11.411989 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-bc4d07c5-1ad2-4d22-a85b-08bc1b125cb2 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/06b5db2c-baea-4e51-8506-6443bbd9daeb" status: 200 len: 1274 microversion: 2.1 time: 0.634537 Oct 19 03:35:11.414823 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2433/4788] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:35:10 2022] GET /compute/v2.1/servers/06b5db2c-baea-4e51-8506-6443bbd9daeb => generated 1274 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:35:11.969804 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-45b013a1-d5a3-443a-a29e-5955a36d1767 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:35:11.970545 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-45b013a1-d5a3-443a-a29e-5955a36d1767 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:35:11.989743 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-45b013a1-d5a3-443a-a29e-5955a36d1767 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:11.990361 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-45b013a1-d5a3-443a-a29e-5955a36d1767 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:11.990913 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-45b013a1-d5a3-443a-a29e-5955a36d1767 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:11.991743 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-45b013a1-d5a3-443a-a29e-5955a36d1767 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:11.992457 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-45b013a1-d5a3-443a-a29e-5955a36d1767 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:11.993138 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-45b013a1-d5a3-443a-a29e-5955a36d1767 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:12.261807 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-45b013a1-d5a3-443a-a29e-5955a36d1767 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:35:12.276458 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-45b013a1-d5a3-443a-a29e-5955a36d1767 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21" status: 200 len: 1265 microversion: 2.1 time: 0.311289 Oct 19 03:35:12.300872 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2356/4789] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:35:11 2022] GET /compute/v2.1/servers/e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21 => generated 1265 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:35:12.439364 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4a03a528-dda6-4396-b195-05267058e8b3 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:35:12.440687 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4a03a528-dda6-4396-b195-05267058e8b3 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 06b5db2c-baea-4e51-8506-6443bbd9daeb] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:35:12.457774 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4a03a528-dda6-4396-b195-05267058e8b3 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:12.459422 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4a03a528-dda6-4396-b195-05267058e8b3 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:12.459422 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4a03a528-dda6-4396-b195-05267058e8b3 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:12.462207 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4a03a528-dda6-4396-b195-05267058e8b3 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:12.462688 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4a03a528-dda6-4396-b195-05267058e8b3 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:12.465828 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4a03a528-dda6-4396-b195-05267058e8b3 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:12.596093 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4a03a528-dda6-4396-b195-05267058e8b3 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4729a0afd69480f99642266e0eec17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce5e9f9a4644b27a24b2f4c06df97bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:35:12.613716 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4a03a528-dda6-4396-b195-05267058e8b3 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/06b5db2c-baea-4e51-8506-6443bbd9daeb" status: 200 len: 1280 microversion: 2.1 time: 0.178270 Oct 19 03:35:12.615074 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2434/4790] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:35:12 2022] GET /compute/v2.1/servers/06b5db2c-baea-4e51-8506-6443bbd9daeb => generated 1280 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:35:13.308935 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b9ec25c1-a6ee-419f-ad0c-14e6fdb82cdf tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:35:13.309593 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b9ec25c1-a6ee-419f-ad0c-14e6fdb82cdf tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:35:13.322219 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b9ec25c1-a6ee-419f-ad0c-14e6fdb82cdf tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:13.322737 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b9ec25c1-a6ee-419f-ad0c-14e6fdb82cdf tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:13.323355 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b9ec25c1-a6ee-419f-ad0c-14e6fdb82cdf tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:13.324094 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b9ec25c1-a6ee-419f-ad0c-14e6fdb82cdf tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:13.324561 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b9ec25c1-a6ee-419f-ad0c-14e6fdb82cdf tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:13.326000 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b9ec25c1-a6ee-419f-ad0c-14e6fdb82cdf tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:13.596739 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b9ec25c1-a6ee-419f-ad0c-14e6fdb82cdf tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:35:13.616155 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b9ec25c1-a6ee-419f-ad0c-14e6fdb82cdf tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21" status: 200 len: 1283 microversion: 2.1 time: 0.311511 Oct 19 03:35:13.620198 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2357/4791] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:35:13 2022] GET /compute/v2.1/servers/e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21 => generated 1283 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:35:13.645638 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-397f700a-6ff8-4559-bbd9-f0d5f9246b93 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:35:13.647115 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-397f700a-6ff8-4559-bbd9-f0d5f9246b93 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 06b5db2c-baea-4e51-8506-6443bbd9daeb] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:35:13.662055 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-397f700a-6ff8-4559-bbd9-f0d5f9246b93 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:13.663478 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-397f700a-6ff8-4559-bbd9-f0d5f9246b93 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:13.664492 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-397f700a-6ff8-4559-bbd9-f0d5f9246b93 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:13.665510 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-397f700a-6ff8-4559-bbd9-f0d5f9246b93 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:13.666133 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-397f700a-6ff8-4559-bbd9-f0d5f9246b93 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:13.671721 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-397f700a-6ff8-4559-bbd9-f0d5f9246b93 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:13.677201 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=100 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:35:13.814621 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-a6555b00-989c-4e20-b561-395792671d5d req-e1fb272f-301a-40f1-8dd5-eb961f664686 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8955f425-23eb-423e-8ed4-eea1bd5dbc08", "tag": "c7d4574f-83f0-421d-a051-54cd58016e11"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:35:13.828175 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-397f700a-6ff8-4559-bbd9-f0d5f9246b93 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4729a0afd69480f99642266e0eec17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce5e9f9a4644b27a24b2f4c06df97bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:35:13.841258 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-a6555b00-989c-4e20-b561-395792671d5d req-e1fb272f-301a-40f1-8dd5-eb961f664686 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:13.841782 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-a6555b00-989c-4e20-b561-395792671d5d req-e1fb272f-301a-40f1-8dd5-eb961f664686 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:13.842206 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-397f700a-6ff8-4559-bbd9-f0d5f9246b93 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/06b5db2c-baea-4e51-8506-6443bbd9daeb" status: 200 len: 1280 microversion: 2.1 time: 0.196874 Oct 19 03:35:13.842359 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-a6555b00-989c-4e20-b561-395792671d5d req-e1fb272f-301a-40f1-8dd5-eb961f664686 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:13.858103 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2435/4792] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:35:13 2022] GET /compute/v2.1/servers/06b5db2c-baea-4e51-8506-6443bbd9daeb => generated 1280 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:35:13.892231 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-a6555b00-989c-4e20-b561-395792671d5d req-e1fb272f-301a-40f1-8dd5-eb961f664686 service nova] Creating event network-changed:c7d4574f-83f0-421d-a051-54cd58016e11 for instance 8955f425-23eb-423e-8ed4-eea1bd5dbc08 on n-h1-861333-8 Oct 19 03:35:13.906619 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-a6555b00-989c-4e20-b561-395792671d5d req-e1fb272f-301a-40f1-8dd5-eb961f664686 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101640 Oct 19 03:35:13.915239 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2358/4793] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:35:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:35:14.648273 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-cce7bafb-7c59-4bf6-818c-113924aecf56 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:35:14.648988 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-cce7bafb-7c59-4bf6-818c-113924aecf56 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:35:14.662604 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cce7bafb-7c59-4bf6-818c-113924aecf56 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:14.662604 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cce7bafb-7c59-4bf6-818c-113924aecf56 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:14.662604 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cce7bafb-7c59-4bf6-818c-113924aecf56 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:14.662604 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cce7bafb-7c59-4bf6-818c-113924aecf56 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:14.663044 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cce7bafb-7c59-4bf6-818c-113924aecf56 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:14.663481 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cce7bafb-7c59-4bf6-818c-113924aecf56 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:14.874345 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d9ff0331-e5d9-4414-a473-58445487503e tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:35:14.875138 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d9ff0331-e5d9-4414-a473-58445487503e tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 06b5db2c-baea-4e51-8506-6443bbd9daeb] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:35:14.905063 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-cce7bafb-7c59-4bf6-818c-113924aecf56 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:35:14.908717 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d9ff0331-e5d9-4414-a473-58445487503e tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:14.911692 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d9ff0331-e5d9-4414-a473-58445487503e tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:14.912885 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d9ff0331-e5d9-4414-a473-58445487503e tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:14.915194 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d9ff0331-e5d9-4414-a473-58445487503e tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:14.917083 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d9ff0331-e5d9-4414-a473-58445487503e tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:14.918378 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d9ff0331-e5d9-4414-a473-58445487503e tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:14.935121 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-cce7bafb-7c59-4bf6-818c-113924aecf56 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21" status: 200 len: 1271 microversion: 2.1 time: 0.290566 Oct 19 03:35:14.938297 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2436/4794] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:35:14 2022] GET /compute/v2.1/servers/e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21 => generated 1271 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:35:15.541894 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d9ff0331-e5d9-4414-a473-58445487503e tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4729a0afd69480f99642266e0eec17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce5e9f9a4644b27a24b2f4c06df97bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:35:15.580864 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d9ff0331-e5d9-4414-a473-58445487503e tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/06b5db2c-baea-4e51-8506-6443bbd9daeb" status: 200 len: 1322 microversion: 2.1 time: 0.713313 Oct 19 03:35:15.600188 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2359/4795] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:35:14 2022] GET /compute/v2.1/servers/06b5db2c-baea-4e51-8506-6443bbd9daeb => generated 1322 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:35:15.966157 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c586fecc-e80d-4e0e-8003-974efc3d50f6 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:35:15.968344 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c586fecc-e80d-4e0e-8003-974efc3d50f6 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:35:15.979924 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c586fecc-e80d-4e0e-8003-974efc3d50f6 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:15.990659 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c586fecc-e80d-4e0e-8003-974efc3d50f6 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:15.991326 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c586fecc-e80d-4e0e-8003-974efc3d50f6 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:15.992263 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c586fecc-e80d-4e0e-8003-974efc3d50f6 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:15.992881 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c586fecc-e80d-4e0e-8003-974efc3d50f6 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:15.993579 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c586fecc-e80d-4e0e-8003-974efc3d50f6 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:16.580430 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c586fecc-e80d-4e0e-8003-974efc3d50f6 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:35:16.589588 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c586fecc-e80d-4e0e-8003-974efc3d50f6 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21" status: 200 len: 1313 microversion: 2.1 time: 0.632120 Oct 19 03:35:16.605644 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2437/4796] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:35:15 2022] GET /compute/v2.1/servers/e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21 => generated 1313 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:35:16.621190 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e9c5dfa2-ee32-41cf-8b51-68dddaf4de07 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:35:16.622155 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e9c5dfa2-ee32-41cf-8b51-68dddaf4de07 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 06b5db2c-baea-4e51-8506-6443bbd9daeb] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:35:16.629675 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e9c5dfa2-ee32-41cf-8b51-68dddaf4de07 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:16.630383 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e9c5dfa2-ee32-41cf-8b51-68dddaf4de07 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:16.631166 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e9c5dfa2-ee32-41cf-8b51-68dddaf4de07 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:16.632096 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e9c5dfa2-ee32-41cf-8b51-68dddaf4de07 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:16.634371 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e9c5dfa2-ee32-41cf-8b51-68dddaf4de07 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:16.634371 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e9c5dfa2-ee32-41cf-8b51-68dddaf4de07 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:16.663305 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-574777a6-4329-4c96-8804-24b72394af8d tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Action: 'create', calling method: .version_select at 0x7fc12bece310>, body: {"keypair": {"name": "tempest-keypair-1263498779", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBESbl4SJU6zjKPA3QOC+tFANDL4cigfbIuDDMDYEw9vFjyKac5L7mQtTHAZkUDe2PoMsdiuOr/VpcLmVIiuig2ADTlWPVd+Ga5DK93uLxXcklbSNicP7Sw+bIjAmuOMyrg=="}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:35:16.679066 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:35:16.704274 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-574777a6-4329-4c96-8804-24b72394af8d tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Getting quotas for project 32cec9540e5e498dbaf34714cf3a36f7. Resources: {'key_pairs'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:35:16.717867 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-574777a6-4329-4c96-8804-24b72394af8d tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Getting quotas for user 4cb021cc6411420ab9e01353f671e8cb and project 32cec9540e5e498dbaf34714cf3a36f7. Resources: {'key_pairs'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:35:16.837487 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-e9c5dfa2-ee32-41cf-8b51-68dddaf4de07 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4729a0afd69480f99642266e0eec17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce5e9f9a4644b27a24b2f4c06df97bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:35:16.847335 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e9c5dfa2-ee32-41cf-8b51-68dddaf4de07 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/06b5db2c-baea-4e51-8506-6443bbd9daeb" status: 200 len: 1322 microversion: 2.1 time: 0.230325 Oct 19 03:35:16.850857 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2438/4797] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:35:16 2022] GET /compute/v2.1/servers/06b5db2c-baea-4e51-8506-6443bbd9daeb => generated 1322 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:35:16.863476 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-574777a6-4329-4c96-8804-24b72394af8d tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.717646 Oct 19 03:35:16.865542 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2360/4798] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Oct 19 03:35:16 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:35:17.255124 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-1c033e38-345f-428e-b220-301a1ca8890d req-41d6244b-3bea-4792-96c9-b9abbaa262f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21", "tag": "01eed7bc-5062-4113-9784-b44646110510"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:35:17.269027 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-1c033e38-345f-428e-b220-301a1ca8890d req-41d6244b-3bea-4792-96c9-b9abbaa262f7 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:17.269397 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-1c033e38-345f-428e-b220-301a1ca8890d req-41d6244b-3bea-4792-96c9-b9abbaa262f7 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:17.274438 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-1c033e38-345f-428e-b220-301a1ca8890d req-41d6244b-3bea-4792-96c9-b9abbaa262f7 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:17.311989 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-1c033e38-345f-428e-b220-301a1ca8890d req-41d6244b-3bea-4792-96c9-b9abbaa262f7 service nova] Creating event network-changed:01eed7bc-5062-4113-9784-b44646110510 for instance e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21 on n-h2-861333-8 Oct 19 03:35:17.340098 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-1c033e38-345f-428e-b220-301a1ca8890d req-41d6244b-3bea-4792-96c9-b9abbaa262f7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071135 Oct 19 03:35:17.342100 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2439/4799] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:35:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:35:17.616830 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-007d22a1-3425-46e5-97ab-8c855c19a880 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:35:17.617963 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-007d22a1-3425-46e5-97ab-8c855c19a880 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:35:17.631937 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-007d22a1-3425-46e5-97ab-8c855c19a880 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:17.632870 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-007d22a1-3425-46e5-97ab-8c855c19a880 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:17.634971 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-007d22a1-3425-46e5-97ab-8c855c19a880 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:17.636287 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-007d22a1-3425-46e5-97ab-8c855c19a880 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:17.637953 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-007d22a1-3425-46e5-97ab-8c855c19a880 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:17.639960 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-007d22a1-3425-46e5-97ab-8c855c19a880 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:17.834015 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-ed3233b7-3632-4add-a081-0b9e761947b8 req-90619fa3-22ad-449a-b1d3-dd64ffe7ac80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06b5db2c-baea-4e51-8506-6443bbd9daeb", "tag": "cbd4142a-4e2a-43a9-8188-c3e7cfe4f5ec"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:35:17.855110 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-ed3233b7-3632-4add-a081-0b9e761947b8 req-90619fa3-22ad-449a-b1d3-dd64ffe7ac80 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:17.857459 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-ed3233b7-3632-4add-a081-0b9e761947b8 req-90619fa3-22ad-449a-b1d3-dd64ffe7ac80 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:17.858153 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-ed3233b7-3632-4add-a081-0b9e761947b8 req-90619fa3-22ad-449a-b1d3-dd64ffe7ac80 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:17.875389 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:35:17.888459 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-ed3233b7-3632-4add-a081-0b9e761947b8 req-90619fa3-22ad-449a-b1d3-dd64ffe7ac80 service nova] Creating event network-changed:cbd4142a-4e2a-43a9-8188-c3e7cfe4f5ec for instance 06b5db2c-baea-4e51-8506-6443bbd9daeb on n-h2-861333-8 Oct 19 03:35:17.904596 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-ed3233b7-3632-4add-a081-0b9e761947b8 req-90619fa3-22ad-449a-b1d3-dd64ffe7ac80 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071941 Oct 19 03:35:17.905532 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2440/4800] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:35:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:35:17.925436 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-594c4d1d-d78b-466c-bf8e-fc4f09f96044 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:35:17.927641 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-594c4d1d-d78b-466c-bf8e-fc4f09f96044 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 06b5db2c-baea-4e51-8506-6443bbd9daeb] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:35:17.935866 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-594c4d1d-d78b-466c-bf8e-fc4f09f96044 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:17.937037 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-594c4d1d-d78b-466c-bf8e-fc4f09f96044 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:17.937492 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-594c4d1d-d78b-466c-bf8e-fc4f09f96044 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:17.938474 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-594c4d1d-d78b-466c-bf8e-fc4f09f96044 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:17.939201 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-594c4d1d-d78b-466c-bf8e-fc4f09f96044 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:17.940074 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-594c4d1d-d78b-466c-bf8e-fc4f09f96044 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:18.081530 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-007d22a1-3425-46e5-97ab-8c855c19a880 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:35:18.091494 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-007d22a1-3425-46e5-97ab-8c855c19a880 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21" status: 200 len: 1313 microversion: 2.1 time: 0.479474 Oct 19 03:35:18.109820 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2361/4801] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:35:17 2022] GET /compute/v2.1/servers/e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21 => generated 1313 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:35:18.232983 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-594c4d1d-d78b-466c-bf8e-fc4f09f96044 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4729a0afd69480f99642266e0eec17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce5e9f9a4644b27a24b2f4c06df97bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:35:18.245779 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-594c4d1d-d78b-466c-bf8e-fc4f09f96044 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/06b5db2c-baea-4e51-8506-6443bbd9daeb" status: 200 len: 1322 microversion: 2.1 time: 0.338884 Oct 19 03:35:18.246667 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2441/4802] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:35:17 2022] GET /compute/v2.1/servers/06b5db2c-baea-4e51-8506-6443bbd9daeb => generated 1322 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:35:19.124890 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1682de74-24f8-46fc-9313-408eed48f1f0 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:35:19.124890 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1682de74-24f8-46fc-9313-408eed48f1f0 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:35:19.130210 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1682de74-24f8-46fc-9313-408eed48f1f0 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:19.130706 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1682de74-24f8-46fc-9313-408eed48f1f0 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:19.131156 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1682de74-24f8-46fc-9313-408eed48f1f0 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:19.131877 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1682de74-24f8-46fc-9313-408eed48f1f0 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:19.132341 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1682de74-24f8-46fc-9313-408eed48f1f0 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:19.132776 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1682de74-24f8-46fc-9313-408eed48f1f0 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:19.272699 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-18e651ed-6b02-46bb-b67a-25c3a8c24fc8 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:35:19.273343 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-18e651ed-6b02-46bb-b67a-25c3a8c24fc8 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 06b5db2c-baea-4e51-8506-6443bbd9daeb] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:35:19.276256 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=4 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:35:19.278367 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:35:19.283292 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-18e651ed-6b02-46bb-b67a-25c3a8c24fc8 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:19.283797 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-18e651ed-6b02-46bb-b67a-25c3a8c24fc8 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:19.284428 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-18e651ed-6b02-46bb-b67a-25c3a8c24fc8 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:19.285394 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-18e651ed-6b02-46bb-b67a-25c3a8c24fc8 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:19.286048 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-18e651ed-6b02-46bb-b67a-25c3a8c24fc8 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:19.286484 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-18e651ed-6b02-46bb-b67a-25c3a8c24fc8 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:19.755476 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=30 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:35:20.100913 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-18e651ed-6b02-46bb-b67a-25c3a8c24fc8 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4729a0afd69480f99642266e0eec17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce5e9f9a4644b27a24b2f4c06df97bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:35:20.109468 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-18e651ed-6b02-46bb-b67a-25c3a8c24fc8 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/06b5db2c-baea-4e51-8506-6443bbd9daeb" status: 200 len: 1322 microversion: 2.1 time: 0.840585 Oct 19 03:35:20.130292 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-1682de74-24f8-46fc-9313-408eed48f1f0 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:35:20.139720 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2442/4803] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:35:19 2022] GET /compute/v2.1/servers/06b5db2c-baea-4e51-8506-6443bbd9daeb => generated 1322 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:35:20.140995 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1682de74-24f8-46fc-9313-408eed48f1f0 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21" status: 200 len: 1313 microversion: 2.1 time: 1.026356 Oct 19 03:35:20.157327 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2362/4804] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:35:19 2022] GET /compute/v2.1/servers/e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21 => generated 1313 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:35:21.136191 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e37b9701-9310-407b-976b-1cce64486bcb tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:35:21.136812 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e37b9701-9310-407b-976b-1cce64486bcb tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 06b5db2c-baea-4e51-8506-6443bbd9daeb] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:35:21.145138 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e37b9701-9310-407b-976b-1cce64486bcb tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:21.145664 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e37b9701-9310-407b-976b-1cce64486bcb tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:21.146112 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e37b9701-9310-407b-976b-1cce64486bcb tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:21.146807 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e37b9701-9310-407b-976b-1cce64486bcb tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:21.147267 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e37b9701-9310-407b-976b-1cce64486bcb tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:21.147703 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e37b9701-9310-407b-976b-1cce64486bcb tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:21.163909 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-38e37540-9bfa-4c69-9f37-d816b3485d7f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:35:21.175536 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-38e37540-9bfa-4c69-9f37-d816b3485d7f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:35:21.175536 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-38e37540-9bfa-4c69-9f37-d816b3485d7f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:21.175536 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-38e37540-9bfa-4c69-9f37-d816b3485d7f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:21.175536 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-38e37540-9bfa-4c69-9f37-d816b3485d7f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:21.175536 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-38e37540-9bfa-4c69-9f37-d816b3485d7f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:21.175536 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-38e37540-9bfa-4c69-9f37-d816b3485d7f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:21.175536 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-38e37540-9bfa-4c69-9f37-d816b3485d7f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:21.574566 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-e37b9701-9310-407b-976b-1cce64486bcb tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4729a0afd69480f99642266e0eec17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce5e9f9a4644b27a24b2f4c06df97bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:35:21.576802 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-38e37540-9bfa-4c69-9f37-d816b3485d7f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:35:21.592749 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-38e37540-9bfa-4c69-9f37-d816b3485d7f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21" status: 200 len: 1313 microversion: 2.1 time: 0.429310 Oct 19 03:35:21.594156 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2363/4805] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:35:21 2022] GET /compute/v2.1/servers/e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21 => generated 1313 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:35:21.598413 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e37b9701-9310-407b-976b-1cce64486bcb tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/06b5db2c-baea-4e51-8506-6443bbd9daeb" status: 200 len: 1322 microversion: 2.1 time: 0.466145 Oct 19 03:35:21.599843 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2443/4806] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:35:21 2022] GET /compute/v2.1/servers/06b5db2c-baea-4e51-8506-6443bbd9daeb => generated 1322 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:35:22.263555 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-84843eeb-8605-40a4-abeb-aadd98911fc8 req-0a4cef9b-41bd-47cb-89c3-a178b309c0e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8955f425-23eb-423e-8ed4-eea1bd5dbc08", "name": "network-vif-plugged", "status": "completed", "tag": "c7d4574f-83f0-421d-a051-54cd58016e11"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:35:22.302792 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-84843eeb-8605-40a4-abeb-aadd98911fc8 req-0a4cef9b-41bd-47cb-89c3-a178b309c0e4 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:22.303404 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-84843eeb-8605-40a4-abeb-aadd98911fc8 req-0a4cef9b-41bd-47cb-89c3-a178b309c0e4 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:22.303916 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-84843eeb-8605-40a4-abeb-aadd98911fc8 req-0a4cef9b-41bd-47cb-89c3-a178b309c0e4 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:22.316753 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-84843eeb-8605-40a4-abeb-aadd98911fc8 req-0a4cef9b-41bd-47cb-89c3-a178b309c0e4 service nova] Creating event network-vif-plugged:c7d4574f-83f0-421d-a051-54cd58016e11 for instance 8955f425-23eb-423e-8ed4-eea1bd5dbc08 on n-h1-861333-8 Oct 19 03:35:22.331041 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-84843eeb-8605-40a4-abeb-aadd98911fc8 req-0a4cef9b-41bd-47cb-89c3-a178b309c0e4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078236 Oct 19 03:35:22.332586 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2364/4807] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:35:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:35:22.347900 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-527ecac3-ed4e-4362-a37a-e22188d731f9 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-1081089516", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "1b837066-f15b-43a6-837d-36df97ee3692"}], "security_groups": [{"name": "tempest-securitygroup--773924777"}], "key_name": "tempest-keypair-1263498779", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:35:22.568344 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.network.neutron [None req-527ecac3-ed4e-4362-a37a-e22188d731f9 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] validate_networks() for [('1b837066-f15b-43a6-837d-36df97ee3692', None, None, None, None, None)] {{(pid=121135) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:35:22.622585 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1c8e78af-b33a-46b1-8d8e-13428d2d4134 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:35:22.623312 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1c8e78af-b33a-46b1-8d8e-13428d2d4134 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:35:22.631193 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1c8e78af-b33a-46b1-8d8e-13428d2d4134 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:22.631700 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1c8e78af-b33a-46b1-8d8e-13428d2d4134 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:22.632137 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1c8e78af-b33a-46b1-8d8e-13428d2d4134 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:22.633064 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1c8e78af-b33a-46b1-8d8e-13428d2d4134 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:22.633571 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1c8e78af-b33a-46b1-8d8e-13428d2d4134 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:22.634002 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1c8e78af-b33a-46b1-8d8e-13428d2d4134 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:22.872904 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-1c8e78af-b33a-46b1-8d8e-13428d2d4134 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:35:22.886551 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1c8e78af-b33a-46b1-8d8e-13428d2d4134 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21" status: 200 len: 1313 microversion: 2.1 time: 0.266175 Oct 19 03:35:22.888295 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2365/4808] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:35:22 2022] GET /compute/v2.1/servers/e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21 => generated 1313 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:35:22.905941 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4d288c0b-cca1-4e02-9b85-8e13d01f6e6a tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:35:22.908951 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4d288c0b-cca1-4e02-9b85-8e13d01f6e6a tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 06b5db2c-baea-4e51-8506-6443bbd9daeb] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:35:22.929511 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4d288c0b-cca1-4e02-9b85-8e13d01f6e6a tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:22.929869 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4d288c0b-cca1-4e02-9b85-8e13d01f6e6a tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:22.933621 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4d288c0b-cca1-4e02-9b85-8e13d01f6e6a tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:22.935010 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4d288c0b-cca1-4e02-9b85-8e13d01f6e6a tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:22.937349 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4d288c0b-cca1-4e02-9b85-8e13d01f6e6a tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:22.937349 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4d288c0b-cca1-4e02-9b85-8e13d01f6e6a tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:23.176632 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-4d288c0b-cca1-4e02-9b85-8e13d01f6e6a tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4729a0afd69480f99642266e0eec17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce5e9f9a4644b27a24b2f4c06df97bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:35:23.184632 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4d288c0b-cca1-4e02-9b85-8e13d01f6e6a tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/06b5db2c-baea-4e51-8506-6443bbd9daeb" status: 200 len: 1322 microversion: 2.1 time: 0.295240 Oct 19 03:35:23.190773 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2366/4809] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:35:22 2022] GET /compute/v2.1/servers/06b5db2c-baea-4e51-8506-6443bbd9daeb => generated 1322 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:35:23.311817 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-527ecac3-ed4e-4362-a37a-e22188d731f9 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Getting quotas for project 32cec9540e5e498dbaf34714cf3a36f7. Resources: dict_keys(['metadata_items']) {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:35:23.321715 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-527ecac3-ed4e-4362-a37a-e22188d731f9 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Getting quotas for user 4cb021cc6411420ab9e01353f671e8cb and project 32cec9540e5e498dbaf34714cf3a36f7. Resources: dict_keys(['metadata_items']) {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:35:23.332225 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-527ecac3-ed4e-4362-a37a-e22188d731f9 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Flavor limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:35:23.332669 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-527ecac3-ed4e-4362-a37a-e22188d731f9 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Image limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:35:23.333382 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-527ecac3-ed4e-4362-a37a-e22188d731f9 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Flavor pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:35:23.333865 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-527ecac3-ed4e-4362-a37a-e22188d731f9 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Image pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:35:23.334444 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-527ecac3-ed4e-4362-a37a-e22188d731f9 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:35:23.344874 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-527ecac3-ed4e-4362-a37a-e22188d731f9 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:23.344874 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-527ecac3-ed4e-4362-a37a-e22188d731f9 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:23.344874 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-527ecac3-ed4e-4362-a37a-e22188d731f9 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:23.345130 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-527ecac3-ed4e-4362-a37a-e22188d731f9 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:23.349996 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-527ecac3-ed4e-4362-a37a-e22188d731f9 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:23.349996 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-527ecac3-ed4e-4362-a37a-e22188d731f9 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:23.363953 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-527ecac3-ed4e-4362-a37a-e22188d731f9 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Getting quotas for project 32cec9540e5e498dbaf34714cf3a36f7. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:35:23.369981 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-527ecac3-ed4e-4362-a37a-e22188d731f9 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Getting quotas for user 4cb021cc6411420ab9e01353f671e8cb and project 32cec9540e5e498dbaf34714cf3a36f7. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:35:23.386224 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-527ecac3-ed4e-4362-a37a-e22188d731f9 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Going to run 1 instances... {{(pid=121135) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:35:23.386561 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-527ecac3-ed4e-4362-a37a-e22188d731f9 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] [instance: c38f0173-a3d2-4254-96cd-ef24f8f0b989] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121135) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:35:23.527501 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-527ecac3-ed4e-4362-a37a-e22188d731f9 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.184671 Oct 19 03:35:23.529419 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2444/4810] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:35:22 2022] POST /compute/v2.1/servers => generated 408 bytes in 1186 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 19 03:35:23.539051 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-00073894-7e35-41b2-a69f-dfe18e546159 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:35:23.539671 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-00073894-7e35-41b2-a69f-dfe18e546159 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] [instance: c38f0173-a3d2-4254-96cd-ef24f8f0b989] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:35:23.661081 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-00073894-7e35-41b2-a69f-dfe18e546159 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb021cc6411420ab9e01353f671e8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cec9540e5e498dbaf34714cf3a36f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:35:23.672859 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-00073894-7e35-41b2-a69f-dfe18e546159 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] 10.222.0.52 "GET /compute/v2.1/servers/c38f0173-a3d2-4254-96cd-ef24f8f0b989" status: 200 len: 1278 microversion: 2.1 time: 0.137630 Oct 19 03:35:23.674823 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2367/4811] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:35:23 2022] GET /compute/v2.1/servers/c38f0173-a3d2-4254-96cd-ef24f8f0b989 => generated 1278 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:35:23.917009 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2af9c231-1078-4d61-a231-6cead9bd3fc2 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:35:23.917684 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-2af9c231-1078-4d61-a231-6cead9bd3fc2 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:35:23.937029 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2af9c231-1078-4d61-a231-6cead9bd3fc2 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:23.939715 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2af9c231-1078-4d61-a231-6cead9bd3fc2 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:23.940180 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2af9c231-1078-4d61-a231-6cead9bd3fc2 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:23.941410 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2af9c231-1078-4d61-a231-6cead9bd3fc2 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:23.942269 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2af9c231-1078-4d61-a231-6cead9bd3fc2 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:23.942918 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2af9c231-1078-4d61-a231-6cead9bd3fc2 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:24.227444 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a6f6cd71-b623-4f00-8178-9a65f29329c1 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:35:24.234842 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a6f6cd71-b623-4f00-8178-9a65f29329c1 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 06b5db2c-baea-4e51-8506-6443bbd9daeb] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:35:24.250852 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a6f6cd71-b623-4f00-8178-9a65f29329c1 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:24.253537 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a6f6cd71-b623-4f00-8178-9a65f29329c1 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:24.256457 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a6f6cd71-b623-4f00-8178-9a65f29329c1 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:24.270284 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a6f6cd71-b623-4f00-8178-9a65f29329c1 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:24.270846 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a6f6cd71-b623-4f00-8178-9a65f29329c1 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:24.271349 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a6f6cd71-b623-4f00-8178-9a65f29329c1 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:24.303941 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-2af9c231-1078-4d61-a231-6cead9bd3fc2 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:35:24.316637 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2af9c231-1078-4d61-a231-6cead9bd3fc2 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21" status: 200 len: 1313 microversion: 2.1 time: 0.404320 Oct 19 03:35:24.320746 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2445/4812] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:35:23 2022] GET /compute/v2.1/servers/e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21 => generated 1313 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:35:24.536318 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a6f6cd71-b623-4f00-8178-9a65f29329c1 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4729a0afd69480f99642266e0eec17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce5e9f9a4644b27a24b2f4c06df97bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:35:24.544771 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a6f6cd71-b623-4f00-8178-9a65f29329c1 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/06b5db2c-baea-4e51-8506-6443bbd9daeb" status: 200 len: 1322 microversion: 2.1 time: 0.333060 Oct 19 03:35:24.546302 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2368/4813] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:35:24 2022] GET /compute/v2.1/servers/06b5db2c-baea-4e51-8506-6443bbd9daeb => generated 1322 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:35:24.696780 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-106c588e-bf9c-4302-a902-f7509e2c2e37 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:35:24.697334 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-106c588e-bf9c-4302-a902-f7509e2c2e37 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] [instance: c38f0173-a3d2-4254-96cd-ef24f8f0b989] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:35:24.713618 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-baa1331e-34cf-4cdc-8267-ce6e69034ae9 req-123c1607-e396-4545-829a-6ccfcd68a3a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21", "name": "network-vif-plugged", "status": "completed", "tag": "01eed7bc-5062-4113-9784-b44646110510"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:35:24.753864 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-baa1331e-34cf-4cdc-8267-ce6e69034ae9 req-123c1607-e396-4545-829a-6ccfcd68a3a9 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:24.756444 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-baa1331e-34cf-4cdc-8267-ce6e69034ae9 req-123c1607-e396-4545-829a-6ccfcd68a3a9 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:24.758497 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-baa1331e-34cf-4cdc-8267-ce6e69034ae9 req-123c1607-e396-4545-829a-6ccfcd68a3a9 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:24.783043 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-baa1331e-34cf-4cdc-8267-ce6e69034ae9 req-123c1607-e396-4545-829a-6ccfcd68a3a9 service nova] Creating event network-vif-plugged:01eed7bc-5062-4113-9784-b44646110510 for instance e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21 on n-h2-861333-8 Oct 19 03:35:24.799899 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-baa1331e-34cf-4cdc-8267-ce6e69034ae9 req-123c1607-e396-4545-829a-6ccfcd68a3a9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089886 Oct 19 03:35:24.800097 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-106c588e-bf9c-4302-a902-f7509e2c2e37 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb021cc6411420ab9e01353f671e8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cec9540e5e498dbaf34714cf3a36f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:35:24.812076 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-106c588e-bf9c-4302-a902-f7509e2c2e37 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] 10.222.0.52 "GET /compute/v2.1/servers/c38f0173-a3d2-4254-96cd-ef24f8f0b989" status: 200 len: 1278 microversion: 2.1 time: 0.116095 Oct 19 03:35:24.814026 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2446/4815] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:35:24 2022] GET /compute/v2.1/servers/c38f0173-a3d2-4254-96cd-ef24f8f0b989 => generated 1278 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:35:24.814705 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2369/4815] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:35:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:35:25.343584 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0cb3e51e-22bc-45ff-a862-ea40be4d7f26 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:35:25.344274 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0cb3e51e-22bc-45ff-a862-ea40be4d7f26 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:35:25.363428 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0cb3e51e-22bc-45ff-a862-ea40be4d7f26 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:25.364473 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0cb3e51e-22bc-45ff-a862-ea40be4d7f26 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:25.364473 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0cb3e51e-22bc-45ff-a862-ea40be4d7f26 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:25.365219 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0cb3e51e-22bc-45ff-a862-ea40be4d7f26 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:25.365699 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0cb3e51e-22bc-45ff-a862-ea40be4d7f26 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:25.366135 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0cb3e51e-22bc-45ff-a862-ea40be4d7f26 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:25.571157 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-43a2c0f0-15b4-429f-a3a9-08dcde7488ae tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:35:25.572262 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-43a2c0f0-15b4-429f-a3a9-08dcde7488ae tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 06b5db2c-baea-4e51-8506-6443bbd9daeb] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:35:25.588901 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-43a2c0f0-15b4-429f-a3a9-08dcde7488ae tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:25.592042 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-43a2c0f0-15b4-429f-a3a9-08dcde7488ae tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:25.592583 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-43a2c0f0-15b4-429f-a3a9-08dcde7488ae tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:25.599520 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-43a2c0f0-15b4-429f-a3a9-08dcde7488ae tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:25.600877 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-43a2c0f0-15b4-429f-a3a9-08dcde7488ae tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:25.608440 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-43a2c0f0-15b4-429f-a3a9-08dcde7488ae tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:26.288423 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-0cb3e51e-22bc-45ff-a862-ea40be4d7f26 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:35:26.301006 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0cb3e51e-22bc-45ff-a862-ea40be4d7f26 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21" status: 200 len: 1313 microversion: 2.1 time: 0.962470 Oct 19 03:35:26.301626 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2447/4816] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:35:25 2022] GET /compute/v2.1/servers/e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21 => generated 1313 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:35:26.321198 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-04ad13b2-74b3-46cd-b40b-069cab16495b tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:35:26.322348 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-04ad13b2-74b3-46cd-b40b-069cab16495b tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] [instance: c38f0173-a3d2-4254-96cd-ef24f8f0b989] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:35:26.335560 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-04ad13b2-74b3-46cd-b40b-069cab16495b tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:26.336503 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-04ad13b2-74b3-46cd-b40b-069cab16495b tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:26.337178 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-04ad13b2-74b3-46cd-b40b-069cab16495b tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:26.338286 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-04ad13b2-74b3-46cd-b40b-069cab16495b tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:26.338743 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-04ad13b2-74b3-46cd-b40b-069cab16495b tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:26.343261 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-04ad13b2-74b3-46cd-b40b-069cab16495b tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:26.483118 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-43a2c0f0-15b4-429f-a3a9-08dcde7488ae tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4729a0afd69480f99642266e0eec17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce5e9f9a4644b27a24b2f4c06df97bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:35:26.501326 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-43a2c0f0-15b4-429f-a3a9-08dcde7488ae tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/06b5db2c-baea-4e51-8506-6443bbd9daeb" status: 200 len: 1322 microversion: 2.1 time: 0.932590 Oct 19 03:35:26.503576 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2370/4817] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:35:25 2022] GET /compute/v2.1/servers/06b5db2c-baea-4e51-8506-6443bbd9daeb => generated 1322 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:35:26.528119 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-04ad13b2-74b3-46cd-b40b-069cab16495b tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb021cc6411420ab9e01353f671e8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cec9540e5e498dbaf34714cf3a36f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:35:26.548123 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-04ad13b2-74b3-46cd-b40b-069cab16495b tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] 10.222.0.52 "GET /compute/v2.1/servers/c38f0173-a3d2-4254-96cd-ef24f8f0b989" status: 200 len: 1330 microversion: 2.1 time: 0.235945 Oct 19 03:35:26.553753 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2448/4818] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:35:26 2022] GET /compute/v2.1/servers/c38f0173-a3d2-4254-96cd-ef24f8f0b989 => generated 1330 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:35:27.328661 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1ccd663a-1534-40ab-a869-b037071f81c8 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:35:27.329338 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1ccd663a-1534-40ab-a869-b037071f81c8 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:35:27.340127 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1ccd663a-1534-40ab-a869-b037071f81c8 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:27.346609 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1ccd663a-1534-40ab-a869-b037071f81c8 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:27.352385 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1ccd663a-1534-40ab-a869-b037071f81c8 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:27.353646 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1ccd663a-1534-40ab-a869-b037071f81c8 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:27.354405 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1ccd663a-1534-40ab-a869-b037071f81c8 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:27.355384 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1ccd663a-1534-40ab-a869-b037071f81c8 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:27.378166 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=100 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:35:27.528424 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a4471c9f-2b2c-46a1-a580-221bcb1b5760 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:35:27.529208 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a4471c9f-2b2c-46a1-a580-221bcb1b5760 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 06b5db2c-baea-4e51-8506-6443bbd9daeb] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:35:27.536445 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a4471c9f-2b2c-46a1-a580-221bcb1b5760 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:27.536944 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a4471c9f-2b2c-46a1-a580-221bcb1b5760 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:27.537390 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a4471c9f-2b2c-46a1-a580-221bcb1b5760 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:27.538100 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a4471c9f-2b2c-46a1-a580-221bcb1b5760 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:27.538559 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a4471c9f-2b2c-46a1-a580-221bcb1b5760 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:27.539143 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a4471c9f-2b2c-46a1-a580-221bcb1b5760 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:27.954229 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a4471c9f-2b2c-46a1-a580-221bcb1b5760 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4729a0afd69480f99642266e0eec17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce5e9f9a4644b27a24b2f4c06df97bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:35:27.966295 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-1ccd663a-1534-40ab-a869-b037071f81c8 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:35:27.982872 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1ccd663a-1534-40ab-a869-b037071f81c8 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21" status: 200 len: 1500 microversion: 2.1 time: 0.654172 Oct 19 03:35:27.994055 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2371/4819] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:35:27 2022] GET /compute/v2.1/servers/e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21 => generated 1500 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:35:28.016752 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-92dad05e-fb5a-4d2c-a98b-176fdb344ada tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:35:28.016980 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a4471c9f-2b2c-46a1-a580-221bcb1b5760 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/06b5db2c-baea-4e51-8506-6443bbd9daeb" status: 200 len: 1322 microversion: 2.1 time: 0.486436 Oct 19 03:35:28.017089 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-92dad05e-fb5a-4d2c-a98b-176fdb344ada tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] [instance: c38f0173-a3d2-4254-96cd-ef24f8f0b989] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:35:28.020636 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2449/4820] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:35:27 2022] GET /compute/v2.1/servers/06b5db2c-baea-4e51-8506-6443bbd9daeb => generated 1322 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:35:28.026754 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-92dad05e-fb5a-4d2c-a98b-176fdb344ada tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:28.027491 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-92dad05e-fb5a-4d2c-a98b-176fdb344ada tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:28.028083 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-92dad05e-fb5a-4d2c-a98b-176fdb344ada tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:28.028942 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-92dad05e-fb5a-4d2c-a98b-176fdb344ada tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:28.030290 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-92dad05e-fb5a-4d2c-a98b-176fdb344ada tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:28.030878 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-92dad05e-fb5a-4d2c-a98b-176fdb344ada tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:28.050995 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0cf904e3-44f2-45b2-ad3e-3db6e58c632d tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:35:28.054323 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0cf904e3-44f2-45b2-ad3e-3db6e58c632d tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:35:28.098055 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0cf904e3-44f2-45b2-ad3e-3db6e58c632d tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:28.105281 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0cf904e3-44f2-45b2-ad3e-3db6e58c632d tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:28.105788 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0cf904e3-44f2-45b2-ad3e-3db6e58c632d tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:28.109217 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0cf904e3-44f2-45b2-ad3e-3db6e58c632d tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:28.113849 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0cf904e3-44f2-45b2-ad3e-3db6e58c632d tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:28.115057 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0cf904e3-44f2-45b2-ad3e-3db6e58c632d tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:28.269325 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-92dad05e-fb5a-4d2c-a98b-176fdb344ada tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb021cc6411420ab9e01353f671e8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cec9540e5e498dbaf34714cf3a36f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:35:28.280814 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-92dad05e-fb5a-4d2c-a98b-176fdb344ada tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] 10.222.0.52 "GET /compute/v2.1/servers/c38f0173-a3d2-4254-96cd-ef24f8f0b989" status: 200 len: 1336 microversion: 2.1 time: 0.285565 Oct 19 03:35:28.283125 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2372/4821] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:35:27 2022] GET /compute/v2.1/servers/c38f0173-a3d2-4254-96cd-ef24f8f0b989 => generated 1336 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:35:28.489170 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0cf904e3-44f2-45b2-ad3e-3db6e58c632d tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "POST /compute/v2.1/servers/e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21/action" status: 202 len: 0 microversion: 2.1 time: 0.467036 Oct 19 03:35:28.493800 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2450/4822] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:35:28 2022] POST /compute/v2.1/servers/e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21/action => generated 0 bytes in 472 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:35:28.499442 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-582b4766-8f04-4d4c-a899-bbab7081be75 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:35:28.500058 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-582b4766-8f04-4d4c-a899-bbab7081be75 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:35:28.511565 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-582b4766-8f04-4d4c-a899-bbab7081be75 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:28.520310 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-582b4766-8f04-4d4c-a899-bbab7081be75 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:28.520310 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-582b4766-8f04-4d4c-a899-bbab7081be75 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:28.520828 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-582b4766-8f04-4d4c-a899-bbab7081be75 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:28.521291 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-582b4766-8f04-4d4c-a899-bbab7081be75 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:28.522166 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-582b4766-8f04-4d4c-a899-bbab7081be75 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:28.943872 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-582b4766-8f04-4d4c-a899-bbab7081be75 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:35:28.956388 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-582b4766-8f04-4d4c-a899-bbab7081be75 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21" status: 200 len: 1505 microversion: 2.1 time: 0.461741 Oct 19 03:35:28.957659 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2373/4823] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:35:28 2022] GET /compute/v2.1/servers/e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21 => generated 1505 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:35:29.054459 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d02a94ac-6e11-414e-a47b-aeda129cfe3b tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:35:29.055846 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d02a94ac-6e11-414e-a47b-aeda129cfe3b tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 06b5db2c-baea-4e51-8506-6443bbd9daeb] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:35:29.073163 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d02a94ac-6e11-414e-a47b-aeda129cfe3b tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:29.073710 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d02a94ac-6e11-414e-a47b-aeda129cfe3b tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:29.074170 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d02a94ac-6e11-414e-a47b-aeda129cfe3b tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:29.081736 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d02a94ac-6e11-414e-a47b-aeda129cfe3b tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:29.081736 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d02a94ac-6e11-414e-a47b-aeda129cfe3b tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:29.081736 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d02a94ac-6e11-414e-a47b-aeda129cfe3b tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:29.107019 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-c219be47-ec11-458a-ab74-0750551cc53b req-1fa4d162-6db2-4d8a-a82c-59054ce4c9b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06b5db2c-baea-4e51-8506-6443bbd9daeb", "name": "network-vif-plugged", "status": "completed", "tag": "cbd4142a-4e2a-43a9-8188-c3e7cfe4f5ec"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:35:29.133892 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-c219be47-ec11-458a-ab74-0750551cc53b req-1fa4d162-6db2-4d8a-a82c-59054ce4c9b2 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:29.134054 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-c219be47-ec11-458a-ab74-0750551cc53b req-1fa4d162-6db2-4d8a-a82c-59054ce4c9b2 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:29.140471 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-c219be47-ec11-458a-ab74-0750551cc53b req-1fa4d162-6db2-4d8a-a82c-59054ce4c9b2 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:29.170164 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-c219be47-ec11-458a-ab74-0750551cc53b req-1fa4d162-6db2-4d8a-a82c-59054ce4c9b2 service nova] Creating event network-vif-plugged:cbd4142a-4e2a-43a9-8188-c3e7cfe4f5ec for instance 06b5db2c-baea-4e51-8506-6443bbd9daeb on n-h2-861333-8 Oct 19 03:35:29.180361 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-c219be47-ec11-458a-ab74-0750551cc53b req-1fa4d162-6db2-4d8a-a82c-59054ce4c9b2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077660 Oct 19 03:35:29.181535 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2374/4824] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:35:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:35:29.323475 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6864a97d-c313-4cd0-b2fb-458ff17a0bd8 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:35:29.324432 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6864a97d-c313-4cd0-b2fb-458ff17a0bd8 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] [instance: c38f0173-a3d2-4254-96cd-ef24f8f0b989] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:35:29.338433 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6864a97d-c313-4cd0-b2fb-458ff17a0bd8 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:29.342856 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6864a97d-c313-4cd0-b2fb-458ff17a0bd8 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:29.343515 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6864a97d-c313-4cd0-b2fb-458ff17a0bd8 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:29.348302 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6864a97d-c313-4cd0-b2fb-458ff17a0bd8 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:29.349054 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6864a97d-c313-4cd0-b2fb-458ff17a0bd8 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:29.350125 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6864a97d-c313-4cd0-b2fb-458ff17a0bd8 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:29.822239 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d02a94ac-6e11-414e-a47b-aeda129cfe3b tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4729a0afd69480f99642266e0eec17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce5e9f9a4644b27a24b2f4c06df97bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:35:29.862926 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d02a94ac-6e11-414e-a47b-aeda129cfe3b tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/06b5db2c-baea-4e51-8506-6443bbd9daeb" status: 200 len: 1322 microversion: 2.1 time: 0.818428 Oct 19 03:35:29.867262 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2451/4825] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:35:29 2022] GET /compute/v2.1/servers/06b5db2c-baea-4e51-8506-6443bbd9daeb => generated 1322 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:35:29.986808 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-6864a97d-c313-4cd0-b2fb-458ff17a0bd8 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb021cc6411420ab9e01353f671e8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cec9540e5e498dbaf34714cf3a36f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:35:29.990122 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e3c973a1-0dab-40a4-8eb5-c54b6789d725 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:35:29.991166 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e3c973a1-0dab-40a4-8eb5-c54b6789d725 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:35:30.002282 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e3c973a1-0dab-40a4-8eb5-c54b6789d725 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:30.004323 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e3c973a1-0dab-40a4-8eb5-c54b6789d725 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:30.005001 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e3c973a1-0dab-40a4-8eb5-c54b6789d725 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:30.006588 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e3c973a1-0dab-40a4-8eb5-c54b6789d725 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:30.009541 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e3c973a1-0dab-40a4-8eb5-c54b6789d725 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:30.010512 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e3c973a1-0dab-40a4-8eb5-c54b6789d725 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:30.023003 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6864a97d-c313-4cd0-b2fb-458ff17a0bd8 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] 10.222.0.52 "GET /compute/v2.1/servers/c38f0173-a3d2-4254-96cd-ef24f8f0b989" status: 200 len: 1403 microversion: 2.1 time: 0.704069 Oct 19 03:35:30.053187 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2375/4826] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:35:29 2022] GET /compute/v2.1/servers/c38f0173-a3d2-4254-96cd-ef24f8f0b989 => generated 1403 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:35:30.568403 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-e3c973a1-0dab-40a4-8eb5-c54b6789d725 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:35:30.581147 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e3c973a1-0dab-40a4-8eb5-c54b6789d725 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21" status: 200 len: 1485 microversion: 2.1 time: 0.603360 Oct 19 03:35:30.584810 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2452/4827] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:35:29 2022] GET /compute/v2.1/servers/e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21 => generated 1485 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:35:30.613301 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6c7e027e-2107-4315-83e2-865f1ed46e1e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:35:30.614273 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6c7e027e-2107-4315-83e2-865f1ed46e1e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:35:30.632554 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6c7e027e-2107-4315-83e2-865f1ed46e1e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:30.633072 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6c7e027e-2107-4315-83e2-865f1ed46e1e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:30.636438 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6c7e027e-2107-4315-83e2-865f1ed46e1e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:30.637357 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6c7e027e-2107-4315-83e2-865f1ed46e1e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:30.638096 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6c7e027e-2107-4315-83e2-865f1ed46e1e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:30.638899 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6c7e027e-2107-4315-83e2-865f1ed46e1e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:30.727779 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-6c7e027e-2107-4315-83e2-865f1ed46e1e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lazy-loading 'flavor' on Instance uuid e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21 {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:35:30.910374 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-dd94e52f-a0b1-4be8-b4ff-bbd17959bcd0 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:35:30.911262 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-dd94e52f-a0b1-4be8-b4ff-bbd17959bcd0 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 06b5db2c-baea-4e51-8506-6443bbd9daeb] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:35:30.946457 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dd94e52f-a0b1-4be8-b4ff-bbd17959bcd0 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:30.948132 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dd94e52f-a0b1-4be8-b4ff-bbd17959bcd0 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:30.950609 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dd94e52f-a0b1-4be8-b4ff-bbd17959bcd0 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:30.954050 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dd94e52f-a0b1-4be8-b4ff-bbd17959bcd0 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:30.957971 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dd94e52f-a0b1-4be8-b4ff-bbd17959bcd0 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:30.963810 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dd94e52f-a0b1-4be8-b4ff-bbd17959bcd0 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:31.554810 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6c7e027e-2107-4315-83e2-865f1ed46e1e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "POST /compute/v2.1/servers/e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21/action" status: 202 len: 0 microversion: 2.1 time: 0.941327 Oct 19 03:35:31.556717 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2376/4828] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:35:30 2022] POST /compute/v2.1/servers/e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21/action => generated 0 bytes in 948 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:35:31.588226 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2e039612-f07c-4828-8fe6-c0fd5984f067 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:35:31.594021 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2e039612-f07c-4828-8fe6-c0fd5984f067 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] [instance: c38f0173-a3d2-4254-96cd-ef24f8f0b989] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:35:31.628385 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2e039612-f07c-4828-8fe6-c0fd5984f067 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:31.628900 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2e039612-f07c-4828-8fe6-c0fd5984f067 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:31.633656 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2e039612-f07c-4828-8fe6-c0fd5984f067 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:31.638843 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2e039612-f07c-4828-8fe6-c0fd5984f067 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:31.641172 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2e039612-f07c-4828-8fe6-c0fd5984f067 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:31.641881 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2e039612-f07c-4828-8fe6-c0fd5984f067 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:31.644852 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-dd94e52f-a0b1-4be8-b4ff-bbd17959bcd0 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4729a0afd69480f99642266e0eec17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce5e9f9a4644b27a24b2f4c06df97bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:35:31.674082 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:35:31.681256 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-dd94e52f-a0b1-4be8-b4ff-bbd17959bcd0 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/06b5db2c-baea-4e51-8506-6443bbd9daeb" status: 200 len: 1322 microversion: 2.1 time: 0.779987 Oct 19 03:35:31.711533 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2453/4829] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:35:30 2022] GET /compute/v2.1/servers/06b5db2c-baea-4e51-8506-6443bbd9daeb => generated 1322 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:35:31.727284 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0e2b4479-f32a-484a-a8cf-26e865393ea8 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:35:31.732085 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0e2b4479-f32a-484a-a8cf-26e865393ea8 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:35:31.752731 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0e2b4479-f32a-484a-a8cf-26e865393ea8 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:31.754077 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0e2b4479-f32a-484a-a8cf-26e865393ea8 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:31.755121 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0e2b4479-f32a-484a-a8cf-26e865393ea8 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:31.756976 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0e2b4479-f32a-484a-a8cf-26e865393ea8 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:31.758138 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0e2b4479-f32a-484a-a8cf-26e865393ea8 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:31.759207 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0e2b4479-f32a-484a-a8cf-26e865393ea8 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:32.384030 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-2e039612-f07c-4828-8fe6-c0fd5984f067 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb021cc6411420ab9e01353f671e8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cec9540e5e498dbaf34714cf3a36f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:35:32.384030 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2e039612-f07c-4828-8fe6-c0fd5984f067 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] 10.222.0.52 "GET /compute/v2.1/servers/c38f0173-a3d2-4254-96cd-ef24f8f0b989" status: 200 len: 1403 microversion: 2.1 time: 0.805658 Oct 19 03:35:32.384030 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2377/4830] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:35:31 2022] GET /compute/v2.1/servers/c38f0173-a3d2-4254-96cd-ef24f8f0b989 => generated 1403 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:35:32.503774 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-0e2b4479-f32a-484a-a8cf-26e865393ea8 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:35:32.518443 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0e2b4479-f32a-484a-a8cf-26e865393ea8 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21" status: 200 len: 1491 microversion: 2.1 time: 0.805036 Oct 19 03:35:32.534167 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2454/4831] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:35:31 2022] GET /compute/v2.1/servers/e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21 => generated 1491 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:35:32.722388 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5c411d13-104e-4edb-8f5c-add21170d4f9 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:35:32.722388 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5c411d13-104e-4edb-8f5c-add21170d4f9 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 06b5db2c-baea-4e51-8506-6443bbd9daeb] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:35:32.737679 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5c411d13-104e-4edb-8f5c-add21170d4f9 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:32.738496 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5c411d13-104e-4edb-8f5c-add21170d4f9 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:32.739131 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5c411d13-104e-4edb-8f5c-add21170d4f9 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:32.740236 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5c411d13-104e-4edb-8f5c-add21170d4f9 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:32.740970 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5c411d13-104e-4edb-8f5c-add21170d4f9 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:32.741608 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5c411d13-104e-4edb-8f5c-add21170d4f9 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:32.959157 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5279a112-295b-4829-bad8-f4c2e3c2b84d tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:35:32.960256 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-5279a112-295b-4829-bad8-f4c2e3c2b84d tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] [instance: ddbf7afb-1d7b-4d33-b6fb-1f1608c11985] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:35:32.974410 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5279a112-295b-4829-bad8-f4c2e3c2b84d tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:32.974938 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5279a112-295b-4829-bad8-f4c2e3c2b84d tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:32.975839 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5279a112-295b-4829-bad8-f4c2e3c2b84d tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:32.976674 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5279a112-295b-4829-bad8-f4c2e3c2b84d tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:32.977139 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5279a112-295b-4829-bad8-f4c2e3c2b84d tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:32.977657 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5279a112-295b-4829-bad8-f4c2e3c2b84d tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:33.024247 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5279a112-295b-4829-bad8-f4c2e3c2b84d tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] 10.222.0.52 "GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985/ips" status: 200 len: 145 microversion: 2.1 time: 0.071809 Oct 19 03:35:33.047847 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2455/4832] 10.222.0.52 () {58 vars in 1248 bytes} [Wed Oct 19 03:35:32 2022] GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985/ips => generated 145 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:35:33.099749 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-16c772c2-282d-4326-9e65-be07985820e0 req-57726e0d-2731-4442-8bca-87544bca80e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c38f0173-a3d2-4254-96cd-ef24f8f0b989", "tag": "353b752a-9601-4dc9-9c18-c51d25b98599"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:35:33.169161 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-16c772c2-282d-4326-9e65-be07985820e0 req-57726e0d-2731-4442-8bca-87544bca80e3 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:33.172324 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-16c772c2-282d-4326-9e65-be07985820e0 req-57726e0d-2731-4442-8bca-87544bca80e3 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:33.173735 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-16c772c2-282d-4326-9e65-be07985820e0 req-57726e0d-2731-4442-8bca-87544bca80e3 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:33.211187 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-16c772c2-282d-4326-9e65-be07985820e0 req-57726e0d-2731-4442-8bca-87544bca80e3 service nova] Creating event network-changed:353b752a-9601-4dc9-9c18-c51d25b98599 for instance c38f0173-a3d2-4254-96cd-ef24f8f0b989 on n-h1-861333-8 Oct 19 03:35:33.217883 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-16c772c2-282d-4326-9e65-be07985820e0 req-57726e0d-2731-4442-8bca-87544bca80e3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133990 Oct 19 03:35:33.219327 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2456/4833] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:35:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:35:33.319689 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5c411d13-104e-4edb-8f5c-add21170d4f9 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4729a0afd69480f99642266e0eec17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce5e9f9a4644b27a24b2f4c06df97bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:35:33.349212 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5c411d13-104e-4edb-8f5c-add21170d4f9 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/06b5db2c-baea-4e51-8506-6443bbd9daeb" status: 200 len: 1517 microversion: 2.1 time: 0.633111 Oct 19 03:35:33.362341 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2378/4834] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:35:32 2022] GET /compute/v2.1/servers/06b5db2c-baea-4e51-8506-6443bbd9daeb => generated 1517 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:35:33.373945 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:35:33.378977 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c210c815-171f-477f-8840-9df90502a6b6 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:35:33.384615 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c210c815-171f-477f-8840-9df90502a6b6 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 06b5db2c-baea-4e51-8506-6443bbd9daeb] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:35:33.408959 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-dd9354c0-8533-4ee4-850f-327854441706 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:35:33.409874 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-dd9354c0-8533-4ee4-850f-327854441706 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] [instance: c38f0173-a3d2-4254-96cd-ef24f8f0b989] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:35:33.417831 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c210c815-171f-477f-8840-9df90502a6b6 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:33.424944 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c210c815-171f-477f-8840-9df90502a6b6 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:33.426036 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c210c815-171f-477f-8840-9df90502a6b6 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:33.431491 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c210c815-171f-477f-8840-9df90502a6b6 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:33.431491 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c210c815-171f-477f-8840-9df90502a6b6 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:33.431491 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c210c815-171f-477f-8840-9df90502a6b6 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:33.436968 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dd9354c0-8533-4ee4-850f-327854441706 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:33.438368 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dd9354c0-8533-4ee4-850f-327854441706 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:33.439320 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dd9354c0-8533-4ee4-850f-327854441706 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:33.442934 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dd9354c0-8533-4ee4-850f-327854441706 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:33.443973 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dd9354c0-8533-4ee4-850f-327854441706 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:33.445450 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dd9354c0-8533-4ee4-850f-327854441706 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:33.541887 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-c210c815-171f-477f-8840-9df90502a6b6 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lazy-loading 'flavor' on Instance uuid 06b5db2c-baea-4e51-8506-6443bbd9daeb {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:35:33.667462 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=16 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:35:33.953501 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c210c815-171f-477f-8840-9df90502a6b6 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "POST /compute/v2.1/servers/06b5db2c-baea-4e51-8506-6443bbd9daeb/action" status: 200 len: 32 microversion: 2.1 time: 0.581961 Oct 19 03:35:33.954536 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2457/4835] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:35:33 2022] POST /compute/v2.1/servers/06b5db2c-baea-4e51-8506-6443bbd9daeb/action => generated 32 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 03:35:33.977311 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-11911654-5b8f-4483-a25f-239bff9897ea tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:35:33.981910 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-11911654-5b8f-4483-a25f-239bff9897ea tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:35:33.990555 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-11911654-5b8f-4483-a25f-239bff9897ea tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:33.991221 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-11911654-5b8f-4483-a25f-239bff9897ea tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:33.991757 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-11911654-5b8f-4483-a25f-239bff9897ea tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:33.992994 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-11911654-5b8f-4483-a25f-239bff9897ea tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:33.993728 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-11911654-5b8f-4483-a25f-239bff9897ea tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:33.994371 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-11911654-5b8f-4483-a25f-239bff9897ea tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:34.409749 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-dd9354c0-8533-4ee4-850f-327854441706 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb021cc6411420ab9e01353f671e8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cec9540e5e498dbaf34714cf3a36f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:35:34.426160 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-dd9354c0-8533-4ee4-850f-327854441706 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] 10.222.0.52 "GET /compute/v2.1/servers/c38f0173-a3d2-4254-96cd-ef24f8f0b989" status: 200 len: 1403 microversion: 2.1 time: 1.024284 Oct 19 03:35:34.427440 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2379/4836] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:35:33 2022] GET /compute/v2.1/servers/c38f0173-a3d2-4254-96cd-ef24f8f0b989 => generated 1403 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:35:34.442147 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1bf537c8-5463-43b7-b7d9-fbb2badfa4c9 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:35:34.443032 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1bf537c8-5463-43b7-b7d9-fbb2badfa4c9 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 06b5db2c-baea-4e51-8506-6443bbd9daeb] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:35:34.453647 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1bf537c8-5463-43b7-b7d9-fbb2badfa4c9 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:34.455912 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1bf537c8-5463-43b7-b7d9-fbb2badfa4c9 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:34.456698 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1bf537c8-5463-43b7-b7d9-fbb2badfa4c9 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:34.458252 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1bf537c8-5463-43b7-b7d9-fbb2badfa4c9 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:34.459050 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1bf537c8-5463-43b7-b7d9-fbb2badfa4c9 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:34.459750 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1bf537c8-5463-43b7-b7d9-fbb2badfa4c9 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:34.808330 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=12 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:35:35.015857 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-11911654-5b8f-4483-a25f-239bff9897ea tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:35:35.042262 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-11911654-5b8f-4483-a25f-239bff9897ea tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21" status: 200 len: 1512 microversion: 2.1 time: 1.086210 Oct 19 03:35:35.055341 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2458/4837] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:35:33 2022] GET /compute/v2.1/servers/e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21 => generated 1512 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:35:35.377921 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-1bf537c8-5463-43b7-b7d9-fbb2badfa4c9 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4729a0afd69480f99642266e0eec17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce5e9f9a4644b27a24b2f4c06df97bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:35:35.406863 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1bf537c8-5463-43b7-b7d9-fbb2badfa4c9 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/06b5db2c-baea-4e51-8506-6443bbd9daeb" status: 200 len: 1523 microversion: 2.1 time: 0.977703 Oct 19 03:35:35.413749 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2380/4838] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:35:34 2022] GET /compute/v2.1/servers/06b5db2c-baea-4e51-8506-6443bbd9daeb => generated 1523 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:35:35.451798 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7cb9836c-1036-458c-ad2d-af152a2c9e79 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:35:35.452666 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7cb9836c-1036-458c-ad2d-af152a2c9e79 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] [instance: c38f0173-a3d2-4254-96cd-ef24f8f0b989] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:35:35.515464 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7cb9836c-1036-458c-ad2d-af152a2c9e79 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:35.516203 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7cb9836c-1036-458c-ad2d-af152a2c9e79 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:35.517914 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7cb9836c-1036-458c-ad2d-af152a2c9e79 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:35.519369 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7cb9836c-1036-458c-ad2d-af152a2c9e79 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:35.521271 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7cb9836c-1036-458c-ad2d-af152a2c9e79 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:35.525117 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7cb9836c-1036-458c-ad2d-af152a2c9e79 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:36.089078 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e0254e10-6fe5-4237-b747-fc9fa3cc85cd tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:35:36.089706 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e0254e10-6fe5-4237-b747-fc9fa3cc85cd tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:35:36.111347 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7cb9836c-1036-458c-ad2d-af152a2c9e79 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb021cc6411420ab9e01353f671e8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cec9540e5e498dbaf34714cf3a36f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:35:36.124500 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7cb9836c-1036-458c-ad2d-af152a2c9e79 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] 10.222.0.52 "GET /compute/v2.1/servers/c38f0173-a3d2-4254-96cd-ef24f8f0b989" status: 200 len: 1403 microversion: 2.1 time: 0.677448 Oct 19 03:35:36.126275 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2459/4839] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:35:35 2022] GET /compute/v2.1/servers/c38f0173-a3d2-4254-96cd-ef24f8f0b989 => generated 1403 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:35:36.133886 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e0254e10-6fe5-4237-b747-fc9fa3cc85cd tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:36.137264 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e0254e10-6fe5-4237-b747-fc9fa3cc85cd tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:36.137900 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e0254e10-6fe5-4237-b747-fc9fa3cc85cd tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:36.138787 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e0254e10-6fe5-4237-b747-fc9fa3cc85cd tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:36.139361 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e0254e10-6fe5-4237-b747-fc9fa3cc85cd tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:36.143414 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e0254e10-6fe5-4237-b747-fc9fa3cc85cd tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:36.462631 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-93b456b8-a06c-4e7f-bbd0-94489b751bc3 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:35:36.463422 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-93b456b8-a06c-4e7f-bbd0-94489b751bc3 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 06b5db2c-baea-4e51-8506-6443bbd9daeb] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:35:36.495295 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-93b456b8-a06c-4e7f-bbd0-94489b751bc3 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:36.497186 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-93b456b8-a06c-4e7f-bbd0-94489b751bc3 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:36.500299 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-93b456b8-a06c-4e7f-bbd0-94489b751bc3 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:36.501174 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-93b456b8-a06c-4e7f-bbd0-94489b751bc3 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:36.507816 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-93b456b8-a06c-4e7f-bbd0-94489b751bc3 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:36.509182 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-93b456b8-a06c-4e7f-bbd0-94489b751bc3 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:37.267787 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e0254e10-6fe5-4237-b747-fc9fa3cc85cd tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:35:37.284413 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e0254e10-6fe5-4237-b747-fc9fa3cc85cd tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21" status: 200 len: 1507 microversion: 2.1 time: 1.200609 Oct 19 03:35:37.290724 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2381/4840] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:35:36 2022] GET /compute/v2.1/servers/e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21 => generated 1507 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:35:37.305085 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-aaa33348-8478-4c55-b151-b9682678f5f3 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:35:37.314943 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-aaa33348-8478-4c55-b151-b9682678f5f3 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] [instance: c38f0173-a3d2-4254-96cd-ef24f8f0b989] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:35:37.342180 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-aaa33348-8478-4c55-b151-b9682678f5f3 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:37.342819 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-aaa33348-8478-4c55-b151-b9682678f5f3 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:37.343483 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-aaa33348-8478-4c55-b151-b9682678f5f3 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:37.345039 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-aaa33348-8478-4c55-b151-b9682678f5f3 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:37.345039 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-aaa33348-8478-4c55-b151-b9682678f5f3 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:37.345558 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-aaa33348-8478-4c55-b151-b9682678f5f3 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:37.353120 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-93b456b8-a06c-4e7f-bbd0-94489b751bc3 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4729a0afd69480f99642266e0eec17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce5e9f9a4644b27a24b2f4c06df97bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:35:37.362734 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-93b456b8-a06c-4e7f-bbd0-94489b751bc3 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/06b5db2c-baea-4e51-8506-6443bbd9daeb" status: 200 len: 1523 microversion: 2.1 time: 0.912175 Oct 19 03:35:37.367688 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2460/4841] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:35:36 2022] GET /compute/v2.1/servers/06b5db2c-baea-4e51-8506-6443bbd9daeb => generated 1523 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:35:37.822060 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-aaa33348-8478-4c55-b151-b9682678f5f3 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb021cc6411420ab9e01353f671e8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cec9540e5e498dbaf34714cf3a36f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:35:37.832471 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-aaa33348-8478-4c55-b151-b9682678f5f3 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] 10.222.0.52 "GET /compute/v2.1/servers/c38f0173-a3d2-4254-96cd-ef24f8f0b989" status: 200 len: 1403 microversion: 2.1 time: 0.536109 Oct 19 03:35:37.833770 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2382/4842] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:35:37 2022] GET /compute/v2.1/servers/c38f0173-a3d2-4254-96cd-ef24f8f0b989 => generated 1403 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:35:38.316333 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f6de275a-6322-40e4-899f-844ddb016c7e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:35:38.318116 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f6de275a-6322-40e4-899f-844ddb016c7e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:35:38.347754 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f6de275a-6322-40e4-899f-844ddb016c7e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:38.348446 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f6de275a-6322-40e4-899f-844ddb016c7e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:38.348914 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f6de275a-6322-40e4-899f-844ddb016c7e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:38.352087 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f6de275a-6322-40e4-899f-844ddb016c7e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:38.352603 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f6de275a-6322-40e4-899f-844ddb016c7e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:38.353058 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f6de275a-6322-40e4-899f-844ddb016c7e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:38.418171 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-816463ac-0af2-4038-b679-2a730ca33dd2 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:35:38.425745 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-816463ac-0af2-4038-b679-2a730ca33dd2 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 06b5db2c-baea-4e51-8506-6443bbd9daeb] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:35:38.442379 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-816463ac-0af2-4038-b679-2a730ca33dd2 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:38.445427 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-816463ac-0af2-4038-b679-2a730ca33dd2 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:38.446295 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-816463ac-0af2-4038-b679-2a730ca33dd2 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:38.453191 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-816463ac-0af2-4038-b679-2a730ca33dd2 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:38.453971 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-816463ac-0af2-4038-b679-2a730ca33dd2 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:38.455959 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-816463ac-0af2-4038-b679-2a730ca33dd2 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:38.852375 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f6de275a-6322-40e4-899f-844ddb016c7e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:35:38.881006 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f6de275a-6322-40e4-899f-844ddb016c7e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21" status: 200 len: 1507 microversion: 2.1 time: 0.551985 Oct 19 03:35:38.881006 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2461/4843] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:35:38 2022] GET /compute/v2.1/servers/e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21 => generated 1507 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:35:38.889771 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-57f13b21-b5af-4b6e-9fcc-d4952618cdb0 req-5a8f5547-4c18-4fda-b516-a56ad476b674 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21", "name": "network-vif-plugged", "status": "completed", "tag": "01eed7bc-5062-4113-9784-b44646110510"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:35:38.903621 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-57f13b21-b5af-4b6e-9fcc-d4952618cdb0 req-5a8f5547-4c18-4fda-b516-a56ad476b674 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:38.904662 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-57f13b21-b5af-4b6e-9fcc-d4952618cdb0 req-5a8f5547-4c18-4fda-b516-a56ad476b674 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:38.905109 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-57f13b21-b5af-4b6e-9fcc-d4952618cdb0 req-5a8f5547-4c18-4fda-b516-a56ad476b674 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:38.939705 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-57f13b21-b5af-4b6e-9fcc-d4952618cdb0 req-5a8f5547-4c18-4fda-b516-a56ad476b674 service nova] Creating event network-vif-plugged:01eed7bc-5062-4113-9784-b44646110510 for instance e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21 on n-h2-861333-8 Oct 19 03:35:38.962939 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-57f13b21-b5af-4b6e-9fcc-d4952618cdb0 req-5a8f5547-4c18-4fda-b516-a56ad476b674 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092795 Oct 19 03:35:38.967696 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2462/4844] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:35:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:35:38.985720 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-217b5538-6e2b-4a11-897e-387026350f92 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:35:38.986826 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-217b5538-6e2b-4a11-897e-387026350f92 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] [instance: c38f0173-a3d2-4254-96cd-ef24f8f0b989] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:35:39.010346 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-217b5538-6e2b-4a11-897e-387026350f92 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:39.010638 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-217b5538-6e2b-4a11-897e-387026350f92 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:39.016646 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-217b5538-6e2b-4a11-897e-387026350f92 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:39.021278 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-217b5538-6e2b-4a11-897e-387026350f92 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:39.022218 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-217b5538-6e2b-4a11-897e-387026350f92 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:39.022872 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-217b5538-6e2b-4a11-897e-387026350f92 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:39.219181 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-816463ac-0af2-4038-b679-2a730ca33dd2 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4729a0afd69480f99642266e0eec17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce5e9f9a4644b27a24b2f4c06df97bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:35:39.233257 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-816463ac-0af2-4038-b679-2a730ca33dd2 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/06b5db2c-baea-4e51-8506-6443bbd9daeb" status: 200 len: 1523 microversion: 2.1 time: 0.823871 Oct 19 03:35:39.239314 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2383/4845] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:35:38 2022] GET /compute/v2.1/servers/06b5db2c-baea-4e51-8506-6443bbd9daeb => generated 1523 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:35:39.281017 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4fd0b939-9232-425e-bcc9-514932453958 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f785d734-0827-4795-8c24-7fadbb07a1a9"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:35:39.284847 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4fd0b939-9232-425e-bcc9-514932453958 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] [instance: ddbf7afb-1d7b-4d33-b6fb-1f1608c11985] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:35:39.294218 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4fd0b939-9232-425e-bcc9-514932453958 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:39.297424 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4fd0b939-9232-425e-bcc9-514932453958 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:39.298481 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4fd0b939-9232-425e-bcc9-514932453958 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:39.300028 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4fd0b939-9232-425e-bcc9-514932453958 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:39.300677 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4fd0b939-9232-425e-bcc9-514932453958 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:39.301288 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4fd0b939-9232-425e-bcc9-514932453958 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:39.865743 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-217b5538-6e2b-4a11-897e-387026350f92 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb021cc6411420ab9e01353f671e8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cec9540e5e498dbaf34714cf3a36f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:35:39.876936 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-217b5538-6e2b-4a11-897e-387026350f92 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] 10.222.0.52 "GET /compute/v2.1/servers/c38f0173-a3d2-4254-96cd-ef24f8f0b989" status: 200 len: 1403 microversion: 2.1 time: 0.905834 Oct 19 03:35:39.881486 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2463/4846] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:35:38 2022] GET /compute/v2.1/servers/c38f0173-a3d2-4254-96cd-ef24f8f0b989 => generated 1403 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:35:39.897464 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-fb756dbe-6673-4392-95f5-e897b0b383a7 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:35:39.899321 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-fb756dbe-6673-4392-95f5-e897b0b383a7 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:35:39.913998 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fb756dbe-6673-4392-95f5-e897b0b383a7 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:39.917741 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fb756dbe-6673-4392-95f5-e897b0b383a7 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:39.928545 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fb756dbe-6673-4392-95f5-e897b0b383a7 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:39.928545 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fb756dbe-6673-4392-95f5-e897b0b383a7 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:39.928545 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fb756dbe-6673-4392-95f5-e897b0b383a7 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:39.928545 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fb756dbe-6673-4392-95f5-e897b0b383a7 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:40.456648 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4fd0b939-9232-425e-bcc9-514932453958 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] 10.222.0.52 "POST /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.177907 Oct 19 03:35:40.456648 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2384/4847] 10.222.0.52 () {60 vars in 1323 bytes} [Wed Oct 19 03:35:39 2022] POST /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985/os-volume_attachments => generated 194 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:35:40.487961 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-265bb5b7-4ef4-4b47-a2d9-63095e4f5d03 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:35:40.492630 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-265bb5b7-4ef4-4b47-a2d9-63095e4f5d03 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 06b5db2c-baea-4e51-8506-6443bbd9daeb] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:35:40.520049 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-265bb5b7-4ef4-4b47-a2d9-63095e4f5d03 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:40.523466 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-265bb5b7-4ef4-4b47-a2d9-63095e4f5d03 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:40.529125 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-265bb5b7-4ef4-4b47-a2d9-63095e4f5d03 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:40.530269 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-265bb5b7-4ef4-4b47-a2d9-63095e4f5d03 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:40.531169 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-265bb5b7-4ef4-4b47-a2d9-63095e4f5d03 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:40.531891 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-265bb5b7-4ef4-4b47-a2d9-63095e4f5d03 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:40.580151 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:35:40.999329 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-fb756dbe-6673-4392-95f5-e897b0b383a7 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:35:41.010549 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-fb756dbe-6673-4392-95f5-e897b0b383a7 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21" status: 200 len: 1507 microversion: 2.1 time: 1.116838 Oct 19 03:35:41.011788 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2464/4848] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:35:39 2022] GET /compute/v2.1/servers/e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21 => generated 1507 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:35:41.030878 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3a4b027a-d164-487b-9c29-4285fdca836d tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:35:41.033852 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-3a4b027a-d164-487b-9c29-4285fdca836d tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] [instance: c38f0173-a3d2-4254-96cd-ef24f8f0b989] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:35:41.040956 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3a4b027a-d164-487b-9c29-4285fdca836d tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:41.042148 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3a4b027a-d164-487b-9c29-4285fdca836d tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:41.043776 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3a4b027a-d164-487b-9c29-4285fdca836d tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:41.053560 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3a4b027a-d164-487b-9c29-4285fdca836d tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:41.054319 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3a4b027a-d164-487b-9c29-4285fdca836d tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:41.054932 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3a4b027a-d164-487b-9c29-4285fdca836d tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:41.274381 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-265bb5b7-4ef4-4b47-a2d9-63095e4f5d03 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4729a0afd69480f99642266e0eec17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce5e9f9a4644b27a24b2f4c06df97bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:35:41.287795 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-265bb5b7-4ef4-4b47-a2d9-63095e4f5d03 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/06b5db2c-baea-4e51-8506-6443bbd9daeb" status: 200 len: 1523 microversion: 2.1 time: 0.831178 Oct 19 03:35:41.288476 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2385/4849] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:35:40 2022] GET /compute/v2.1/servers/06b5db2c-baea-4e51-8506-6443bbd9daeb => generated 1523 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:35:41.486834 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-3a4b027a-d164-487b-9c29-4285fdca836d tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb021cc6411420ab9e01353f671e8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cec9540e5e498dbaf34714cf3a36f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:35:41.496400 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-3a4b027a-d164-487b-9c29-4285fdca836d tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] 10.222.0.52 "GET /compute/v2.1/servers/c38f0173-a3d2-4254-96cd-ef24f8f0b989" status: 200 len: 1403 microversion: 2.1 time: 0.483099 Oct 19 03:35:41.500851 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2465/4850] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:35:41 2022] GET /compute/v2.1/servers/c38f0173-a3d2-4254-96cd-ef24f8f0b989 => generated 1403 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:35:42.034478 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c2403a0e-c880-4d95-9dc6-cc52a1c8eb2d tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:35:42.035104 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c2403a0e-c880-4d95-9dc6-cc52a1c8eb2d tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:35:42.042932 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c2403a0e-c880-4d95-9dc6-cc52a1c8eb2d tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:42.043430 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c2403a0e-c880-4d95-9dc6-cc52a1c8eb2d tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:42.043874 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c2403a0e-c880-4d95-9dc6-cc52a1c8eb2d tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:42.045136 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c2403a0e-c880-4d95-9dc6-cc52a1c8eb2d tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:42.045657 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c2403a0e-c880-4d95-9dc6-cc52a1c8eb2d tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:42.046096 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c2403a0e-c880-4d95-9dc6-cc52a1c8eb2d tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:42.312621 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-947a40e7-5f66-4a44-b72c-fe49fd8dcb85 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:35:42.313210 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-947a40e7-5f66-4a44-b72c-fe49fd8dcb85 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 06b5db2c-baea-4e51-8506-6443bbd9daeb] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:35:42.327546 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-947a40e7-5f66-4a44-b72c-fe49fd8dcb85 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:42.328022 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-947a40e7-5f66-4a44-b72c-fe49fd8dcb85 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:42.328465 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-947a40e7-5f66-4a44-b72c-fe49fd8dcb85 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:42.329181 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-947a40e7-5f66-4a44-b72c-fe49fd8dcb85 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:42.329670 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-947a40e7-5f66-4a44-b72c-fe49fd8dcb85 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:42.330095 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-947a40e7-5f66-4a44-b72c-fe49fd8dcb85 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:42.775354 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c2403a0e-c880-4d95-9dc6-cc52a1c8eb2d tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:35:42.789676 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c2403a0e-c880-4d95-9dc6-cc52a1c8eb2d tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21" status: 200 len: 1507 microversion: 2.1 time: 0.756964 Oct 19 03:35:42.792036 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2386/4851] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:35:42 2022] GET /compute/v2.1/servers/e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21 => generated 1507 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:35:42.799798 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0aa71ee9-771f-4aa2-9c6d-11bc2d77d0e8 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:35:42.803637 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0aa71ee9-771f-4aa2-9c6d-11bc2d77d0e8 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] [instance: c38f0173-a3d2-4254-96cd-ef24f8f0b989] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:35:42.820130 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0aa71ee9-771f-4aa2-9c6d-11bc2d77d0e8 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:42.823226 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0aa71ee9-771f-4aa2-9c6d-11bc2d77d0e8 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:42.823858 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0aa71ee9-771f-4aa2-9c6d-11bc2d77d0e8 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:42.843180 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0aa71ee9-771f-4aa2-9c6d-11bc2d77d0e8 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:42.843180 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0aa71ee9-771f-4aa2-9c6d-11bc2d77d0e8 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:42.843580 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0aa71ee9-771f-4aa2-9c6d-11bc2d77d0e8 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:43.047190 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-947a40e7-5f66-4a44-b72c-fe49fd8dcb85 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4729a0afd69480f99642266e0eec17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce5e9f9a4644b27a24b2f4c06df97bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:35:43.057404 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-947a40e7-5f66-4a44-b72c-fe49fd8dcb85 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/06b5db2c-baea-4e51-8506-6443bbd9daeb" status: 200 len: 1523 microversion: 2.1 time: 0.748760 Oct 19 03:35:43.057597 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2466/4852] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:35:42 2022] GET /compute/v2.1/servers/06b5db2c-baea-4e51-8506-6443bbd9daeb => generated 1523 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:35:43.411000 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0aa71ee9-771f-4aa2-9c6d-11bc2d77d0e8 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb021cc6411420ab9e01353f671e8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cec9540e5e498dbaf34714cf3a36f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:35:43.423265 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0aa71ee9-771f-4aa2-9c6d-11bc2d77d0e8 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] 10.222.0.52 "GET /compute/v2.1/servers/c38f0173-a3d2-4254-96cd-ef24f8f0b989" status: 200 len: 1403 microversion: 2.1 time: 0.628572 Oct 19 03:35:43.426147 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2387/4853] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:35:42 2022] GET /compute/v2.1/servers/c38f0173-a3d2-4254-96cd-ef24f8f0b989 => generated 1403 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:35:43.822087 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-520eb63a-eb3a-47f3-adb8-468d0a12cc7a tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:35:43.823412 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-520eb63a-eb3a-47f3-adb8-468d0a12cc7a tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:35:43.835593 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-520eb63a-eb3a-47f3-adb8-468d0a12cc7a tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:43.836347 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-520eb63a-eb3a-47f3-adb8-468d0a12cc7a tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:43.836973 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-520eb63a-eb3a-47f3-adb8-468d0a12cc7a tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:43.838393 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-520eb63a-eb3a-47f3-adb8-468d0a12cc7a tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:43.839002 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-520eb63a-eb3a-47f3-adb8-468d0a12cc7a tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:43.839444 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-520eb63a-eb3a-47f3-adb8-468d0a12cc7a tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:44.080603 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b24a34b2-4c1a-4db7-b474-bc955288593b tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:35:44.081757 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b24a34b2-4c1a-4db7-b474-bc955288593b tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 06b5db2c-baea-4e51-8506-6443bbd9daeb] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:35:44.103457 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b24a34b2-4c1a-4db7-b474-bc955288593b tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:44.104921 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b24a34b2-4c1a-4db7-b474-bc955288593b tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:44.108162 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b24a34b2-4c1a-4db7-b474-bc955288593b tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:44.110324 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b24a34b2-4c1a-4db7-b474-bc955288593b tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:44.113842 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b24a34b2-4c1a-4db7-b474-bc955288593b tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:44.114386 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b24a34b2-4c1a-4db7-b474-bc955288593b tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:44.853618 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-520eb63a-eb3a-47f3-adb8-468d0a12cc7a tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:35:44.865348 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-520eb63a-eb3a-47f3-adb8-468d0a12cc7a tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21" status: 200 len: 1507 microversion: 2.1 time: 1.049083 Oct 19 03:35:44.868902 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2467/4854] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:35:43 2022] GET /compute/v2.1/servers/e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21 => generated 1507 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:35:44.875342 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-84c85017-8ca7-46a4-ba75-f9b00490848b req-a50cf5e2-8c7b-426f-9c3c-4442aa24af17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c38f0173-a3d2-4254-96cd-ef24f8f0b989", "name": "network-vif-plugged", "status": "completed", "tag": "353b752a-9601-4dc9-9c18-c51d25b98599"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:35:44.899435 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-84c85017-8ca7-46a4-ba75-f9b00490848b req-a50cf5e2-8c7b-426f-9c3c-4442aa24af17 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:44.900693 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-84c85017-8ca7-46a4-ba75-f9b00490848b req-a50cf5e2-8c7b-426f-9c3c-4442aa24af17 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:44.901541 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-84c85017-8ca7-46a4-ba75-f9b00490848b req-a50cf5e2-8c7b-426f-9c3c-4442aa24af17 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:44.918835 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-84c85017-8ca7-46a4-ba75-f9b00490848b req-a50cf5e2-8c7b-426f-9c3c-4442aa24af17 service nova] Creating event network-vif-plugged:353b752a-9601-4dc9-9c18-c51d25b98599 for instance c38f0173-a3d2-4254-96cd-ef24f8f0b989 on n-h1-861333-8 Oct 19 03:35:44.926085 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-84c85017-8ca7-46a4-ba75-f9b00490848b req-a50cf5e2-8c7b-426f-9c3c-4442aa24af17 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058163 Oct 19 03:35:44.927473 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2468/4855] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:35:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:35:44.934176 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-fe5b30ed-a6e2-4a03-a15a-15c2a75b14a6 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:35:44.934922 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-fe5b30ed-a6e2-4a03-a15a-15c2a75b14a6 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] [instance: c38f0173-a3d2-4254-96cd-ef24f8f0b989] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:35:44.941668 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fe5b30ed-a6e2-4a03-a15a-15c2a75b14a6 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:44.942168 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fe5b30ed-a6e2-4a03-a15a-15c2a75b14a6 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:44.942795 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fe5b30ed-a6e2-4a03-a15a-15c2a75b14a6 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:44.943762 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fe5b30ed-a6e2-4a03-a15a-15c2a75b14a6 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:44.944228 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fe5b30ed-a6e2-4a03-a15a-15c2a75b14a6 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:44.944663 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fe5b30ed-a6e2-4a03-a15a-15c2a75b14a6 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:45.118571 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b24a34b2-4c1a-4db7-b474-bc955288593b tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4729a0afd69480f99642266e0eec17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce5e9f9a4644b27a24b2f4c06df97bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:35:45.128107 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b24a34b2-4c1a-4db7-b474-bc955288593b tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/06b5db2c-baea-4e51-8506-6443bbd9daeb" status: 200 len: 1523 microversion: 2.1 time: 1.052115 Oct 19 03:35:45.141993 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2388/4856] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:35:44 2022] GET /compute/v2.1/servers/06b5db2c-baea-4e51-8506-6443bbd9daeb => generated 1523 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:35:45.181993 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-fe5b30ed-a6e2-4a03-a15a-15c2a75b14a6 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb021cc6411420ab9e01353f671e8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cec9540e5e498dbaf34714cf3a36f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:35:45.196486 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-fe5b30ed-a6e2-4a03-a15a-15c2a75b14a6 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] 10.222.0.52 "GET /compute/v2.1/servers/c38f0173-a3d2-4254-96cd-ef24f8f0b989" status: 200 len: 1403 microversion: 2.1 time: 0.266145 Oct 19 03:35:45.201506 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2469/4857] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:35:44 2022] GET /compute/v2.1/servers/c38f0173-a3d2-4254-96cd-ef24f8f0b989 => generated 1403 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:35:45.899817 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2021296e-6c3f-4f90-8c94-6af6ae89843c tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:35:45.900706 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2021296e-6c3f-4f90-8c94-6af6ae89843c tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:35:45.910894 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2021296e-6c3f-4f90-8c94-6af6ae89843c tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:45.912031 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2021296e-6c3f-4f90-8c94-6af6ae89843c tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:45.912479 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2021296e-6c3f-4f90-8c94-6af6ae89843c tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:45.914465 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2021296e-6c3f-4f90-8c94-6af6ae89843c tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:45.917089 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2021296e-6c3f-4f90-8c94-6af6ae89843c tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:45.917759 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2021296e-6c3f-4f90-8c94-6af6ae89843c tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:46.164334 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-dbb20d4e-1a40-4149-a560-336cc1ac8e64 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:35:46.164939 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-dbb20d4e-1a40-4149-a560-336cc1ac8e64 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 06b5db2c-baea-4e51-8506-6443bbd9daeb] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:35:46.191674 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dbb20d4e-1a40-4149-a560-336cc1ac8e64 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:46.192313 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dbb20d4e-1a40-4149-a560-336cc1ac8e64 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:46.192780 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dbb20d4e-1a40-4149-a560-336cc1ac8e64 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:46.193570 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dbb20d4e-1a40-4149-a560-336cc1ac8e64 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:46.194032 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dbb20d4e-1a40-4149-a560-336cc1ac8e64 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:46.194529 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dbb20d4e-1a40-4149-a560-336cc1ac8e64 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:46.235279 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-2021296e-6c3f-4f90-8c94-6af6ae89843c tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:35:46.246184 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2021296e-6c3f-4f90-8c94-6af6ae89843c tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21" status: 200 len: 1507 microversion: 2.1 time: 0.350425 Oct 19 03:35:46.246777 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2389/4858] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:35:45 2022] GET /compute/v2.1/servers/e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21 => generated 1507 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:35:46.268037 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ab24cd80-0680-430d-b725-0866029cf75c tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:35:46.268734 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ab24cd80-0680-430d-b725-0866029cf75c tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] [instance: c38f0173-a3d2-4254-96cd-ef24f8f0b989] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:35:46.275093 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ab24cd80-0680-430d-b725-0866029cf75c tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:46.275691 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ab24cd80-0680-430d-b725-0866029cf75c tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:46.276144 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ab24cd80-0680-430d-b725-0866029cf75c tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:46.277350 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ab24cd80-0680-430d-b725-0866029cf75c tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:46.278238 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ab24cd80-0680-430d-b725-0866029cf75c tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:46.279675 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ab24cd80-0680-430d-b725-0866029cf75c tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:46.857413 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ab24cd80-0680-430d-b725-0866029cf75c tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb021cc6411420ab9e01353f671e8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cec9540e5e498dbaf34714cf3a36f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:35:46.872451 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ab24cd80-0680-430d-b725-0866029cf75c tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] 10.222.0.52 "GET /compute/v2.1/servers/c38f0173-a3d2-4254-96cd-ef24f8f0b989" status: 200 len: 1403 microversion: 2.1 time: 0.604602 Oct 19 03:35:46.873653 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2390/4859] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:35:46 2022] GET /compute/v2.1/servers/c38f0173-a3d2-4254-96cd-ef24f8f0b989 => generated 1403 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:35:47.133991 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-dbb20d4e-1a40-4149-a560-336cc1ac8e64 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4729a0afd69480f99642266e0eec17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce5e9f9a4644b27a24b2f4c06df97bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:35:47.139000 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:35:47.145886 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-dbb20d4e-1a40-4149-a560-336cc1ac8e64 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/06b5db2c-baea-4e51-8506-6443bbd9daeb" status: 200 len: 1523 microversion: 2.1 time: 0.985512 Oct 19 03:35:47.146491 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2470/4860] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:35:46 2022] GET /compute/v2.1/servers/06b5db2c-baea-4e51-8506-6443bbd9daeb => generated 1523 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:35:47.275624 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3ac7f6fc-a764-44d8-a044-3bd8d821d06e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:35:47.282511 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3ac7f6fc-a764-44d8-a044-3bd8d821d06e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:35:47.305845 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3ac7f6fc-a764-44d8-a044-3bd8d821d06e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:47.306366 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3ac7f6fc-a764-44d8-a044-3bd8d821d06e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:47.306824 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3ac7f6fc-a764-44d8-a044-3bd8d821d06e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:47.307560 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3ac7f6fc-a764-44d8-a044-3bd8d821d06e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:47.317301 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3ac7f6fc-a764-44d8-a044-3bd8d821d06e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:47.321162 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3ac7f6fc-a764-44d8-a044-3bd8d821d06e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:47.802782 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-3ac7f6fc-a764-44d8-a044-3bd8d821d06e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:35:47.812979 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3ac7f6fc-a764-44d8-a044-3bd8d821d06e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21" status: 200 len: 1507 microversion: 2.1 time: 0.542531 Oct 19 03:35:47.829036 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2391/4861] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:35:47 2022] GET /compute/v2.1/servers/e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21 => generated 1507 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:35:47.901997 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a2dd1387-e212-4698-92f5-67701037cb4f tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:35:47.905468 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a2dd1387-e212-4698-92f5-67701037cb4f tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] [instance: c38f0173-a3d2-4254-96cd-ef24f8f0b989] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:35:47.910632 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a2dd1387-e212-4698-92f5-67701037cb4f tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:47.917235 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a2dd1387-e212-4698-92f5-67701037cb4f tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:47.917837 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a2dd1387-e212-4698-92f5-67701037cb4f tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:47.920187 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a2dd1387-e212-4698-92f5-67701037cb4f tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:47.921513 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a2dd1387-e212-4698-92f5-67701037cb4f tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:47.924706 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a2dd1387-e212-4698-92f5-67701037cb4f tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:48.174477 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c7adf93d-846a-4550-860c-a7765729aa50 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:35:48.175470 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c7adf93d-846a-4550-860c-a7765729aa50 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 06b5db2c-baea-4e51-8506-6443bbd9daeb] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:35:48.189131 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c7adf93d-846a-4550-860c-a7765729aa50 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:48.190669 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c7adf93d-846a-4550-860c-a7765729aa50 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:48.191467 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c7adf93d-846a-4550-860c-a7765729aa50 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:48.193998 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c7adf93d-846a-4550-860c-a7765729aa50 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:48.194642 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c7adf93d-846a-4550-860c-a7765729aa50 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:48.195667 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c7adf93d-846a-4550-860c-a7765729aa50 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:48.248873 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a2dd1387-e212-4698-92f5-67701037cb4f tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb021cc6411420ab9e01353f671e8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cec9540e5e498dbaf34714cf3a36f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:35:48.270116 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a2dd1387-e212-4698-92f5-67701037cb4f tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] 10.222.0.52 "GET /compute/v2.1/servers/c38f0173-a3d2-4254-96cd-ef24f8f0b989" status: 200 len: 1590 microversion: 2.1 time: 0.371836 Oct 19 03:35:48.272130 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2471/4862] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:35:47 2022] GET /compute/v2.1/servers/c38f0173-a3d2-4254-96cd-ef24f8f0b989 => generated 1590 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:35:48.299101 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ed494e66-14cc-4b4f-b8b0-05f9dc308e98 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:35:48.312609 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ed494e66-14cc-4b4f-b8b0-05f9dc308e98 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] [instance: c38f0173-a3d2-4254-96cd-ef24f8f0b989] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:35:48.340379 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ed494e66-14cc-4b4f-b8b0-05f9dc308e98 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:48.343882 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ed494e66-14cc-4b4f-b8b0-05f9dc308e98 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:48.344346 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ed494e66-14cc-4b4f-b8b0-05f9dc308e98 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:48.345086 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ed494e66-14cc-4b4f-b8b0-05f9dc308e98 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:48.360808 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ed494e66-14cc-4b4f-b8b0-05f9dc308e98 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:48.360808 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ed494e66-14cc-4b4f-b8b0-05f9dc308e98 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:48.557708 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ed494e66-14cc-4b4f-b8b0-05f9dc308e98 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] 10.222.0.52 "GET /compute/v2.1/servers/c38f0173-a3d2-4254-96cd-ef24f8f0b989/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.263393 Oct 19 03:35:48.566698 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2472/4863] 10.222.0.52 () {58 vars in 1275 bytes} [Wed Oct 19 03:35:48 2022] GET /compute/v2.1/servers/c38f0173-a3d2-4254-96cd-ef24f8f0b989/os-interface => generated 284 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:35:48.566698 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ff985505-48e0-4015-8685-dfa4eee695ba tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1908201239", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "networks": [{"uuid": "26b53b4a-b6d3-4ee1-8686-7885ab4fdecb"}]}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:35:48.691242 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.network.neutron [None req-ff985505-48e0-4015-8685-dfa4eee695ba tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] validate_networks() for [('26b53b4a-b6d3-4ee1-8686-7885ab4fdecb', None, None, None, None, None)] {{(pid=121135) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:35:49.353464 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c7adf93d-846a-4550-860c-a7765729aa50 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4729a0afd69480f99642266e0eec17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce5e9f9a4644b27a24b2f4c06df97bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:35:49.364267 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c7adf93d-846a-4550-860c-a7765729aa50 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/06b5db2c-baea-4e51-8506-6443bbd9daeb" status: 200 len: 1523 microversion: 2.1 time: 1.196275 Oct 19 03:35:49.372834 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2392/4864] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:35:48 2022] GET /compute/v2.1/servers/06b5db2c-baea-4e51-8506-6443bbd9daeb => generated 1523 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:35:49.393714 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8c264b60-2f7e-4001-8084-bbee146833d7 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:35:49.398834 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8c264b60-2f7e-4001-8084-bbee146833d7 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:35:49.409123 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:35:49.440607 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8c264b60-2f7e-4001-8084-bbee146833d7 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:49.441183 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8c264b60-2f7e-4001-8084-bbee146833d7 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:49.444531 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8c264b60-2f7e-4001-8084-bbee146833d7 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:49.447631 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8c264b60-2f7e-4001-8084-bbee146833d7 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:49.453194 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8c264b60-2f7e-4001-8084-bbee146833d7 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:49.455917 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8c264b60-2f7e-4001-8084-bbee146833d7 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:49.958316 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8c264b60-2f7e-4001-8084-bbee146833d7 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:35:49.970028 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8c264b60-2f7e-4001-8084-bbee146833d7 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21" status: 200 len: 1507 microversion: 2.1 time: 0.595947 Oct 19 03:35:49.987350 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2393/4865] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:35:49 2022] GET /compute/v2.1/servers/e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21 => generated 1507 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:35:50.388659 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4cb28ba7-aabb-48c2-8fc9-2d8a996e19af tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:35:50.390055 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4cb28ba7-aabb-48c2-8fc9-2d8a996e19af tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 06b5db2c-baea-4e51-8506-6443bbd9daeb] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:35:50.399920 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4cb28ba7-aabb-48c2-8fc9-2d8a996e19af tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:50.410220 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4cb28ba7-aabb-48c2-8fc9-2d8a996e19af tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:50.428704 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4cb28ba7-aabb-48c2-8fc9-2d8a996e19af tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:50.430019 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4cb28ba7-aabb-48c2-8fc9-2d8a996e19af tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:50.430715 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4cb28ba7-aabb-48c2-8fc9-2d8a996e19af tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:50.432350 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4cb28ba7-aabb-48c2-8fc9-2d8a996e19af tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:51.140561 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-ff985505-48e0-4015-8685-dfa4eee695ba tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Flavor limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:35:51.141524 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-4cb28ba7-aabb-48c2-8fc9-2d8a996e19af tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4729a0afd69480f99642266e0eec17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce5e9f9a4644b27a24b2f4c06df97bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:35:51.144000 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-ff985505-48e0-4015-8685-dfa4eee695ba tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Image limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:35:51.144669 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-ff985505-48e0-4015-8685-dfa4eee695ba tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Flavor pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:35:51.147211 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-ff985505-48e0-4015-8685-dfa4eee695ba tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Image pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:35:51.147927 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-ff985505-48e0-4015-8685-dfa4eee695ba tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:35:51.154412 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=3 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:35:51.162317 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4cb28ba7-aabb-48c2-8fc9-2d8a996e19af tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/06b5db2c-baea-4e51-8506-6443bbd9daeb" status: 200 len: 1523 microversion: 2.1 time: 0.778019 Oct 19 03:35:51.180854 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2394/4866] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:35:50 2022] GET /compute/v2.1/servers/06b5db2c-baea-4e51-8506-6443bbd9daeb => generated 1523 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:35:51.181251 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ff985505-48e0-4015-8685-dfa4eee695ba tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:51.182079 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ff985505-48e0-4015-8685-dfa4eee695ba tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:51.187480 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ff985505-48e0-4015-8685-dfa4eee695ba tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:51.189091 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ff985505-48e0-4015-8685-dfa4eee695ba tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:51.191513 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ff985505-48e0-4015-8685-dfa4eee695ba tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:51.192312 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ff985505-48e0-4015-8685-dfa4eee695ba tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:51.199826 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4e9bb03b-bb0b-4511-843e-a6742d0979d0 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:35:51.205062 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4e9bb03b-bb0b-4511-843e-a6742d0979d0 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:35:51.212867 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4e9bb03b-bb0b-4511-843e-a6742d0979d0 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:51.213922 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4e9bb03b-bb0b-4511-843e-a6742d0979d0 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:51.214652 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4e9bb03b-bb0b-4511-843e-a6742d0979d0 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:51.215599 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4e9bb03b-bb0b-4511-843e-a6742d0979d0 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:51.217034 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4e9bb03b-bb0b-4511-843e-a6742d0979d0 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:51.217753 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4e9bb03b-bb0b-4511-843e-a6742d0979d0 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:51.284947 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-ff985505-48e0-4015-8685-dfa4eee695ba tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Getting quotas for project 5e1c0b7015a5430c831865ab53a3006e. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:35:51.307030 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-ff985505-48e0-4015-8685-dfa4eee695ba tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Getting quotas for user 1ab48b332e534992a5bfa32168c2bb6d and project 5e1c0b7015a5430c831865ab53a3006e. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:35:51.329629 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ff985505-48e0-4015-8685-dfa4eee695ba tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Going to run 1 instances... {{(pid=121135) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:35:51.332369 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ff985505-48e0-4015-8685-dfa4eee695ba tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] [instance: 4bc45105-f45f-4240-bd2a-9da8a5e5118b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121135) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:35:51.577964 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ff985505-48e0-4015-8685-dfa4eee695ba tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.015305 Oct 19 03:35:51.580292 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2473/4867] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:35:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 3020 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 03:35:51.599945 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ed7f16d8-d8bf-4637-82d8-8ded0c301b85 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:35:51.600497 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ed7f16d8-d8bf-4637-82d8-8ded0c301b85 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] [instance: 4bc45105-f45f-4240-bd2a-9da8a5e5118b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:35:51.616345 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-4e9bb03b-bb0b-4511-843e-a6742d0979d0 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:35:51.641118 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4e9bb03b-bb0b-4511-843e-a6742d0979d0 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21" status: 200 len: 1507 microversion: 2.1 time: 0.455724 Oct 19 03:35:51.642174 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2395/4868] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:35:51 2022] GET /compute/v2.1/servers/e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21 => generated 1507 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:35:52.192459 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-614f657f-c8f8-47f0-926c-230d16ff14dc tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:35:52.193298 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-614f657f-c8f8-47f0-926c-230d16ff14dc tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 06b5db2c-baea-4e51-8506-6443bbd9daeb] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:35:52.203419 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-614f657f-c8f8-47f0-926c-230d16ff14dc tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:52.203928 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-614f657f-c8f8-47f0-926c-230d16ff14dc tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:52.204375 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-614f657f-c8f8-47f0-926c-230d16ff14dc tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:52.205156 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-614f657f-c8f8-47f0-926c-230d16ff14dc tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:52.209099 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-614f657f-c8f8-47f0-926c-230d16ff14dc tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:52.209599 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-614f657f-c8f8-47f0-926c-230d16ff14dc tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:52.356266 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ed7f16d8-d8bf-4637-82d8-8ded0c301b85 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab48b332e534992a5bfa32168c2bb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1c0b7015a5430c831865ab53a3006e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:35:52.369162 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ed7f16d8-d8bf-4637-82d8-8ded0c301b85 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] 10.222.0.52 "GET /compute/v2.1/servers/4bc45105-f45f-4240-bd2a-9da8a5e5118b" status: 200 len: 1214 microversion: 2.1 time: 0.779675 Oct 19 03:35:52.370390 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2474/4869] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:35:51 2022] GET /compute/v2.1/servers/4bc45105-f45f-4240-bd2a-9da8a5e5118b => generated 1214 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:35:52.579216 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-254c54a6-9a11-42af-b295-9fa9e634cf3e tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:35:52.584893 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-254c54a6-9a11-42af-b295-9fa9e634cf3e tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] [instance: c38f0173-a3d2-4254-96cd-ef24f8f0b989] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:35:52.604003 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-254c54a6-9a11-42af-b295-9fa9e634cf3e tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:52.604613 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-254c54a6-9a11-42af-b295-9fa9e634cf3e tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:52.604995 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-254c54a6-9a11-42af-b295-9fa9e634cf3e tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:52.605782 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-254c54a6-9a11-42af-b295-9fa9e634cf3e tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:52.607560 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-254c54a6-9a11-42af-b295-9fa9e634cf3e tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:52.607560 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-254c54a6-9a11-42af-b295-9fa9e634cf3e tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:52.644451 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-614f657f-c8f8-47f0-926c-230d16ff14dc tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4729a0afd69480f99642266e0eec17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce5e9f9a4644b27a24b2f4c06df97bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:35:52.655686 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-614f657f-c8f8-47f0-926c-230d16ff14dc tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/06b5db2c-baea-4e51-8506-6443bbd9daeb" status: 200 len: 1523 microversion: 2.1 time: 0.468006 Oct 19 03:35:52.656293 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2396/4870] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:35:52 2022] GET /compute/v2.1/servers/06b5db2c-baea-4e51-8506-6443bbd9daeb => generated 1523 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:35:52.688925 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-6815683f-a5b2-4836-9ece-c4f76938c318 req-7bd5a4fb-8cde-40c2-8817-3f25d7cc4167 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c38f0173-a3d2-4254-96cd-ef24f8f0b989", "tag": "353b752a-9601-4dc9-9c18-c51d25b98599"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:35:52.747855 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-6815683f-a5b2-4836-9ece-c4f76938c318 req-7bd5a4fb-8cde-40c2-8817-3f25d7cc4167 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:52.766541 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-6815683f-a5b2-4836-9ece-c4f76938c318 req-7bd5a4fb-8cde-40c2-8817-3f25d7cc4167 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:52.767117 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-6815683f-a5b2-4836-9ece-c4f76938c318 req-7bd5a4fb-8cde-40c2-8817-3f25d7cc4167 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:52.793010 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-6815683f-a5b2-4836-9ece-c4f76938c318 req-7bd5a4fb-8cde-40c2-8817-3f25d7cc4167 service nova] Creating event network-changed:353b752a-9601-4dc9-9c18-c51d25b98599 for instance c38f0173-a3d2-4254-96cd-ef24f8f0b989 on n-h1-861333-8 Oct 19 03:35:52.802373 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-6815683f-a5b2-4836-9ece-c4f76938c318 req-7bd5a4fb-8cde-40c2-8817-3f25d7cc4167 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132943 Oct 19 03:35:52.803591 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2397/4871] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:35:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:35:52.821542 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ba02ce23-485f-404b-80c2-0324333a7ee6 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:35:52.822987 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ba02ce23-485f-404b-80c2-0324333a7ee6 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:35:52.834185 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ba02ce23-485f-404b-80c2-0324333a7ee6 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:52.834957 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ba02ce23-485f-404b-80c2-0324333a7ee6 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:52.836692 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ba02ce23-485f-404b-80c2-0324333a7ee6 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:52.838322 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ba02ce23-485f-404b-80c2-0324333a7ee6 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:52.839163 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ba02ce23-485f-404b-80c2-0324333a7ee6 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:52.839828 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ba02ce23-485f-404b-80c2-0324333a7ee6 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:53.134818 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-254c54a6-9a11-42af-b295-9fa9e634cf3e tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb021cc6411420ab9e01353f671e8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cec9540e5e498dbaf34714cf3a36f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:35:53.140250 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ba02ce23-485f-404b-80c2-0324333a7ee6 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:35:53.151726 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ba02ce23-485f-404b-80c2-0324333a7ee6 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21" status: 200 len: 1507 microversion: 2.1 time: 0.345786 Oct 19 03:35:53.152339 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2398/4872] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:35:52 2022] GET /compute/v2.1/servers/e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21 => generated 1507 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:35:53.175559 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-254c54a6-9a11-42af-b295-9fa9e634cf3e tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] 10.222.0.52 "GET /compute/v2.1/servers/c38f0173-a3d2-4254-96cd-ef24f8f0b989" status: 200 len: 1590 microversion: 2.1 time: 0.611655 Oct 19 03:35:53.205122 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2475/4873] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:35:52 2022] GET /compute/v2.1/servers/c38f0173-a3d2-4254-96cd-ef24f8f0b989 => generated 1590 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:35:53.420985 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a6bb8124-3d84-4f59-98a2-9b4c7f744ca9 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:35:53.422015 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a6bb8124-3d84-4f59-98a2-9b4c7f744ca9 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] [instance: 4bc45105-f45f-4240-bd2a-9da8a5e5118b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:35:53.681502 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-90c47029-1d3b-4809-8f0e-0f1f6defadda tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:35:53.682278 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-90c47029-1d3b-4809-8f0e-0f1f6defadda tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 06b5db2c-baea-4e51-8506-6443bbd9daeb] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:35:53.690324 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-90c47029-1d3b-4809-8f0e-0f1f6defadda tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:53.690822 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-90c47029-1d3b-4809-8f0e-0f1f6defadda tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:53.691258 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-90c47029-1d3b-4809-8f0e-0f1f6defadda tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:53.692669 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a6bb8124-3d84-4f59-98a2-9b4c7f744ca9 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab48b332e534992a5bfa32168c2bb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1c0b7015a5430c831865ab53a3006e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:35:53.696542 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-90c47029-1d3b-4809-8f0e-0f1f6defadda tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:53.697615 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-90c47029-1d3b-4809-8f0e-0f1f6defadda tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:53.698089 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-90c47029-1d3b-4809-8f0e-0f1f6defadda tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:53.703040 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a6bb8124-3d84-4f59-98a2-9b4c7f744ca9 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] 10.222.0.52 "GET /compute/v2.1/servers/4bc45105-f45f-4240-bd2a-9da8a5e5118b" status: 200 len: 1214 microversion: 2.1 time: 0.301703 Oct 19 03:35:53.713539 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2399/4874] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:35:53 2022] GET /compute/v2.1/servers/4bc45105-f45f-4240-bd2a-9da8a5e5118b => generated 1214 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:35:54.176816 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d87268ef-93c9-4cc7-b045-c143e9dbc427 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:35:54.177627 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d87268ef-93c9-4cc7-b045-c143e9dbc427 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:35:54.192836 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d87268ef-93c9-4cc7-b045-c143e9dbc427 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:54.194832 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d87268ef-93c9-4cc7-b045-c143e9dbc427 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:54.195504 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d87268ef-93c9-4cc7-b045-c143e9dbc427 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:54.196359 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d87268ef-93c9-4cc7-b045-c143e9dbc427 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:54.197983 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d87268ef-93c9-4cc7-b045-c143e9dbc427 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:54.198983 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d87268ef-93c9-4cc7-b045-c143e9dbc427 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:54.566822 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-90c47029-1d3b-4809-8f0e-0f1f6defadda tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4729a0afd69480f99642266e0eec17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce5e9f9a4644b27a24b2f4c06df97bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:35:54.577326 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-90c47029-1d3b-4809-8f0e-0f1f6defadda tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/06b5db2c-baea-4e51-8506-6443bbd9daeb" status: 200 len: 1523 microversion: 2.1 time: 0.901513 Oct 19 03:35:54.582257 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2476/4875] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:35:53 2022] GET /compute/v2.1/servers/06b5db2c-baea-4e51-8506-6443bbd9daeb => generated 1523 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:35:54.627361 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d87268ef-93c9-4cc7-b045-c143e9dbc427 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:35:54.655677 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d87268ef-93c9-4cc7-b045-c143e9dbc427 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21" status: 200 len: 1507 microversion: 2.1 time: 0.482964 Oct 19 03:35:54.662119 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2400/4876] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:35:54 2022] GET /compute/v2.1/servers/e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21 => generated 1507 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:35:54.734459 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-41cb2650-898d-44a7-a22f-fc3b3743dbbb tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:35:54.736289 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-41cb2650-898d-44a7-a22f-fc3b3743dbbb tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] [instance: 4bc45105-f45f-4240-bd2a-9da8a5e5118b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:35:54.751104 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-41cb2650-898d-44a7-a22f-fc3b3743dbbb tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:54.755391 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-41cb2650-898d-44a7-a22f-fc3b3743dbbb tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:54.755984 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-41cb2650-898d-44a7-a22f-fc3b3743dbbb tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:54.757727 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-41cb2650-898d-44a7-a22f-fc3b3743dbbb tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:54.758288 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-41cb2650-898d-44a7-a22f-fc3b3743dbbb tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:54.759149 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-41cb2650-898d-44a7-a22f-fc3b3743dbbb tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:54.898434 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-41cb2650-898d-44a7-a22f-fc3b3743dbbb tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab48b332e534992a5bfa32168c2bb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1c0b7015a5430c831865ab53a3006e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:35:54.910488 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-41cb2650-898d-44a7-a22f-fc3b3743dbbb tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] 10.222.0.52 "GET /compute/v2.1/servers/4bc45105-f45f-4240-bd2a-9da8a5e5118b" status: 200 len: 1266 microversion: 2.1 time: 0.179232 Oct 19 03:35:54.913293 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2477/4877] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:35:54 2022] GET /compute/v2.1/servers/4bc45105-f45f-4240-bd2a-9da8a5e5118b => generated 1266 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:35:55.617763 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5163c514-86dc-4e7f-889f-c53356211e96 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:35:55.619608 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5163c514-86dc-4e7f-889f-c53356211e96 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 06b5db2c-baea-4e51-8506-6443bbd9daeb] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:35:55.634487 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5163c514-86dc-4e7f-889f-c53356211e96 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:55.636148 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5163c514-86dc-4e7f-889f-c53356211e96 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:55.637220 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5163c514-86dc-4e7f-889f-c53356211e96 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:55.641269 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5163c514-86dc-4e7f-889f-c53356211e96 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:55.642247 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5163c514-86dc-4e7f-889f-c53356211e96 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:55.642847 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5163c514-86dc-4e7f-889f-c53356211e96 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:55.692631 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-452be256-06e2-4f9d-879d-413e06c63a1f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:35:55.693264 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-452be256-06e2-4f9d-879d-413e06c63a1f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:35:55.719961 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-452be256-06e2-4f9d-879d-413e06c63a1f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:55.722116 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-452be256-06e2-4f9d-879d-413e06c63a1f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:55.735893 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-452be256-06e2-4f9d-879d-413e06c63a1f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:55.736843 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-452be256-06e2-4f9d-879d-413e06c63a1f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:55.737363 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-452be256-06e2-4f9d-879d-413e06c63a1f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:55.744861 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-452be256-06e2-4f9d-879d-413e06c63a1f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:56.349395 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5163c514-86dc-4e7f-889f-c53356211e96 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4729a0afd69480f99642266e0eec17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce5e9f9a4644b27a24b2f4c06df97bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:35:56.362844 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5163c514-86dc-4e7f-889f-c53356211e96 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/06b5db2c-baea-4e51-8506-6443bbd9daeb" status: 200 len: 1523 microversion: 2.1 time: 0.755733 Oct 19 03:35:56.363652 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2401/4878] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:35:55 2022] GET /compute/v2.1/servers/06b5db2c-baea-4e51-8506-6443bbd9daeb => generated 1523 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:35:56.374771 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-abd38c2f-22a7-4e9f-8f08-ef7b6d2af7ba tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:35:56.376751 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-abd38c2f-22a7-4e9f-8f08-ef7b6d2af7ba tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] [instance: 4bc45105-f45f-4240-bd2a-9da8a5e5118b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:35:56.385733 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-452be256-06e2-4f9d-879d-413e06c63a1f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:35:56.386765 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-abd38c2f-22a7-4e9f-8f08-ef7b6d2af7ba tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:56.387480 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-abd38c2f-22a7-4e9f-8f08-ef7b6d2af7ba tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:56.388362 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-abd38c2f-22a7-4e9f-8f08-ef7b6d2af7ba tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:56.389215 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-abd38c2f-22a7-4e9f-8f08-ef7b6d2af7ba tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:56.389782 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-abd38c2f-22a7-4e9f-8f08-ef7b6d2af7ba tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:56.390465 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-abd38c2f-22a7-4e9f-8f08-ef7b6d2af7ba tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:56.434777 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-452be256-06e2-4f9d-879d-413e06c63a1f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21" status: 200 len: 1507 microversion: 2.1 time: 0.750401 Oct 19 03:35:56.435813 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2478/4879] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:35:55 2022] GET /compute/v2.1/servers/e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21 => generated 1507 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:35:56.477562 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-abd38c2f-22a7-4e9f-8f08-ef7b6d2af7ba tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab48b332e534992a5bfa32168c2bb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1c0b7015a5430c831865ab53a3006e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:35:56.487672 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-abd38c2f-22a7-4e9f-8f08-ef7b6d2af7ba tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] 10.222.0.52 "GET /compute/v2.1/servers/4bc45105-f45f-4240-bd2a-9da8a5e5118b" status: 200 len: 1272 microversion: 2.1 time: 0.122553 Oct 19 03:35:56.488694 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2402/4880] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:35:56 2022] GET /compute/v2.1/servers/4bc45105-f45f-4240-bd2a-9da8a5e5118b => generated 1272 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:35:57.226833 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-007ca787-066c-4ca0-8958-6bb69fde5e6e tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:35:57.244311 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-007ca787-066c-4ca0-8958-6bb69fde5e6e tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:57.244812 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-007ca787-066c-4ca0-8958-6bb69fde5e6e tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:57.245254 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-007ca787-066c-4ca0-8958-6bb69fde5e6e tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:57.275557 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-007ca787-066c-4ca0-8958-6bb69fde5e6e tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] [instance: ddbf7afb-1d7b-4d33-b6fb-1f1608c11985] Going to try to stop instance {{(pid=121135) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 19 03:35:57.391674 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-bc57396c-303b-4b6b-9b01-04b534fa19c7 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:35:57.416874 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-bc57396c-303b-4b6b-9b01-04b534fa19c7 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 06b5db2c-baea-4e51-8506-6443bbd9daeb] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:35:57.416874 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bc57396c-303b-4b6b-9b01-04b534fa19c7 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:57.416874 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bc57396c-303b-4b6b-9b01-04b534fa19c7 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:57.416874 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bc57396c-303b-4b6b-9b01-04b534fa19c7 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:57.416874 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bc57396c-303b-4b6b-9b01-04b534fa19c7 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:57.416874 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bc57396c-303b-4b6b-9b01-04b534fa19c7 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:57.416874 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bc57396c-303b-4b6b-9b01-04b534fa19c7 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:57.427048 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=100 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:35:57.572120 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-bc57396c-303b-4b6b-9b01-04b534fa19c7 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4729a0afd69480f99642266e0eec17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce5e9f9a4644b27a24b2f4c06df97bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:35:57.581630 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-bc57396c-303b-4b6b-9b01-04b534fa19c7 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/06b5db2c-baea-4e51-8506-6443bbd9daeb" status: 200 len: 1523 microversion: 2.1 time: 0.196733 Oct 19 03:35:57.582589 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2403/4881] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:35:57 2022] GET /compute/v2.1/servers/06b5db2c-baea-4e51-8506-6443bbd9daeb => generated 1523 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:35:57.587817 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3563331d-ffee-4161-a13b-8670b652eafc tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:35:57.588756 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3563331d-ffee-4161-a13b-8670b652eafc tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:35:57.595509 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3563331d-ffee-4161-a13b-8670b652eafc tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:57.595812 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-007ca787-066c-4ca0-8958-6bb69fde5e6e tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] 10.222.0.52 "POST /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985/action" status: 202 len: 0 microversion: 2.1 time: 0.376146 Oct 19 03:35:57.596547 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2479/4882] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:35:57 2022] POST /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985/action => generated 0 bytes in 378 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:35:57.600069 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3563331d-ffee-4161-a13b-8670b652eafc tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:57.600903 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3563331d-ffee-4161-a13b-8670b652eafc tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:57.601894 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3563331d-ffee-4161-a13b-8670b652eafc tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:57.607875 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3563331d-ffee-4161-a13b-8670b652eafc tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:57.607875 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3563331d-ffee-4161-a13b-8670b652eafc tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:57.608129 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-617c7c79-47bc-4458-8bb7-31e4854e0e8b tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:35:57.608129 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-617c7c79-47bc-4458-8bb7-31e4854e0e8b tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] [instance: 4bc45105-f45f-4240-bd2a-9da8a5e5118b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:35:57.627312 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-617c7c79-47bc-4458-8bb7-31e4854e0e8b tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:57.627871 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-617c7c79-47bc-4458-8bb7-31e4854e0e8b tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:57.630028 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-617c7c79-47bc-4458-8bb7-31e4854e0e8b tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:57.630937 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-617c7c79-47bc-4458-8bb7-31e4854e0e8b tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:57.631586 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-617c7c79-47bc-4458-8bb7-31e4854e0e8b tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:57.632189 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-617c7c79-47bc-4458-8bb7-31e4854e0e8b tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:57.860886 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-3563331d-ffee-4161-a13b-8670b652eafc tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:35:57.872896 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3563331d-ffee-4161-a13b-8670b652eafc tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21" status: 200 len: 1507 microversion: 2.1 time: 0.285483 Oct 19 03:35:57.873961 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2404/4883] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:35:57 2022] GET /compute/v2.1/servers/e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21 => generated 1507 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:35:57.890361 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-617c7c79-47bc-4458-8bb7-31e4854e0e8b tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab48b332e534992a5bfa32168c2bb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1c0b7015a5430c831865ab53a3006e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:35:57.896671 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2296c7e7-6803-4438-bef0-71f035871dc2 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:35:57.897416 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2296c7e7-6803-4438-bef0-71f035871dc2 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] [instance: ddbf7afb-1d7b-4d33-b6fb-1f1608c11985] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:35:57.903949 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2296c7e7-6803-4438-bef0-71f035871dc2 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:57.904518 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2296c7e7-6803-4438-bef0-71f035871dc2 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:57.904889 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2296c7e7-6803-4438-bef0-71f035871dc2 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:57.907473 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2296c7e7-6803-4438-bef0-71f035871dc2 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:57.907473 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2296c7e7-6803-4438-bef0-71f035871dc2 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:57.907473 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2296c7e7-6803-4438-bef0-71f035871dc2 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:57.908554 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-617c7c79-47bc-4458-8bb7-31e4854e0e8b tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] 10.222.0.52 "GET /compute/v2.1/servers/4bc45105-f45f-4240-bd2a-9da8a5e5118b" status: 200 len: 1314 microversion: 2.1 time: 0.310153 Oct 19 03:35:57.909153 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2480/4884] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:35:57 2022] GET /compute/v2.1/servers/4bc45105-f45f-4240-bd2a-9da8a5e5118b => generated 1314 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:35:58.201250 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-2296c7e7-6803-4438-bef0-71f035871dc2 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c65a497e16e4e41b5cf1287042f3a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4001edd1474947a94243a620a6013a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:35:58.214189 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2296c7e7-6803-4438-bef0-71f035871dc2 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] 10.222.0.52 "GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985" status: 200 len: 1722 microversion: 2.1 time: 0.326886 Oct 19 03:35:58.221743 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2405/4885] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:35:57 2022] GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985 => generated 1722 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:35:58.609233 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d3c2ce8e-3006-4e7d-bbd9-0becca993a7c tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:35:58.610022 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d3c2ce8e-3006-4e7d-bbd9-0becca993a7c tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 06b5db2c-baea-4e51-8506-6443bbd9daeb] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:35:58.616931 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d3c2ce8e-3006-4e7d-bbd9-0becca993a7c tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:58.618033 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d3c2ce8e-3006-4e7d-bbd9-0becca993a7c tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:58.618746 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d3c2ce8e-3006-4e7d-bbd9-0becca993a7c tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:58.619671 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d3c2ce8e-3006-4e7d-bbd9-0becca993a7c tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:58.620135 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d3c2ce8e-3006-4e7d-bbd9-0becca993a7c tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:58.620567 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d3c2ce8e-3006-4e7d-bbd9-0becca993a7c tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:58.784310 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d3c2ce8e-3006-4e7d-bbd9-0becca993a7c tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4729a0afd69480f99642266e0eec17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce5e9f9a4644b27a24b2f4c06df97bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:35:58.792605 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d3c2ce8e-3006-4e7d-bbd9-0becca993a7c tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/06b5db2c-baea-4e51-8506-6443bbd9daeb" status: 200 len: 1523 microversion: 2.1 time: 0.187273 Oct 19 03:35:58.793206 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2481/4886] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:35:58 2022] GET /compute/v2.1/servers/06b5db2c-baea-4e51-8506-6443bbd9daeb => generated 1523 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:35:58.900316 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ba4cd5ac-cf48-4d5e-bd02-1c4403296e29 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:35:58.901216 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ba4cd5ac-cf48-4d5e-bd02-1c4403296e29 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:35:58.914002 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ba4cd5ac-cf48-4d5e-bd02-1c4403296e29 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:58.919286 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ba4cd5ac-cf48-4d5e-bd02-1c4403296e29 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:58.919887 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ba4cd5ac-cf48-4d5e-bd02-1c4403296e29 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:58.921226 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ba4cd5ac-cf48-4d5e-bd02-1c4403296e29 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:58.923200 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ba4cd5ac-cf48-4d5e-bd02-1c4403296e29 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:58.923770 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ba4cd5ac-cf48-4d5e-bd02-1c4403296e29 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:58.936341 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-22c3e8ca-ebb0-4d45-81db-52894fdfe570 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:35:58.937244 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-22c3e8ca-ebb0-4d45-81db-52894fdfe570 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] [instance: 4bc45105-f45f-4240-bd2a-9da8a5e5118b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:35:58.944617 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-22c3e8ca-ebb0-4d45-81db-52894fdfe570 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:58.945110 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-22c3e8ca-ebb0-4d45-81db-52894fdfe570 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:58.945586 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-22c3e8ca-ebb0-4d45-81db-52894fdfe570 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:58.951252 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-22c3e8ca-ebb0-4d45-81db-52894fdfe570 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:58.951932 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-22c3e8ca-ebb0-4d45-81db-52894fdfe570 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:58.952860 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-22c3e8ca-ebb0-4d45-81db-52894fdfe570 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:59.523773 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-22c3e8ca-ebb0-4d45-81db-52894fdfe570 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab48b332e534992a5bfa32168c2bb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1c0b7015a5430c831865ab53a3006e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:35:59.527967 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ba4cd5ac-cf48-4d5e-bd02-1c4403296e29 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:35:59.533151 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-22c3e8ca-ebb0-4d45-81db-52894fdfe570 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] 10.222.0.52 "GET /compute/v2.1/servers/4bc45105-f45f-4240-bd2a-9da8a5e5118b" status: 200 len: 1314 microversion: 2.1 time: 0.602755 Oct 19 03:35:59.534798 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2482/4887] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:35:58 2022] GET /compute/v2.1/servers/4bc45105-f45f-4240-bd2a-9da8a5e5118b => generated 1314 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:35:59.539972 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ba4cd5ac-cf48-4d5e-bd02-1c4403296e29 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21" status: 200 len: 1507 microversion: 2.1 time: 0.643843 Oct 19 03:35:59.541461 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5851ed05-bf18-4422-a2c8-a01cecc92164 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:35:59.542399 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-5851ed05-bf18-4422-a2c8-a01cecc92164 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] [instance: ddbf7afb-1d7b-4d33-b6fb-1f1608c11985] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:35:59.550187 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2406/4888] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:35:58 2022] GET /compute/v2.1/servers/e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21 => generated 1507 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:35:59.551654 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5851ed05-bf18-4422-a2c8-a01cecc92164 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:59.552222 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5851ed05-bf18-4422-a2c8-a01cecc92164 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:59.552740 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5851ed05-bf18-4422-a2c8-a01cecc92164 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:59.553573 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5851ed05-bf18-4422-a2c8-a01cecc92164 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:59.554238 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5851ed05-bf18-4422-a2c8-a01cecc92164 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:59.554870 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5851ed05-bf18-4422-a2c8-a01cecc92164 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:59.649654 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-65b49dd0-a53a-43c8-80a5-6f0ec7cfe5c9 req-15a1205d-6152-4c75-ae9e-e08a4a4faa7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4bc45105-f45f-4240-bd2a-9da8a5e5118b", "tag": "ecaf169e-f46b-4198-bb48-b54112886170"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:35:59.666127 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-65b49dd0-a53a-43c8-80a5-6f0ec7cfe5c9 req-15a1205d-6152-4c75-ae9e-e08a4a4faa7f service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:59.666627 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-65b49dd0-a53a-43c8-80a5-6f0ec7cfe5c9 req-15a1205d-6152-4c75-ae9e-e08a4a4faa7f service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:59.669265 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-65b49dd0-a53a-43c8-80a5-6f0ec7cfe5c9 req-15a1205d-6152-4c75-ae9e-e08a4a4faa7f service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:59.703446 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-65b49dd0-a53a-43c8-80a5-6f0ec7cfe5c9 req-15a1205d-6152-4c75-ae9e-e08a4a4faa7f service nova] Creating event network-changed:ecaf169e-f46b-4198-bb48-b54112886170 for instance 4bc45105-f45f-4240-bd2a-9da8a5e5118b on n-h1-861333-8 Oct 19 03:35:59.711507 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-65b49dd0-a53a-43c8-80a5-6f0ec7cfe5c9 req-15a1205d-6152-4c75-ae9e-e08a4a4faa7f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067108 Oct 19 03:35:59.716142 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2407/4889] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:35:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:35:59.818073 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c888e293-b865-413b-9677-ff7cdd1b9bc4 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:35:59.818777 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c888e293-b865-413b-9677-ff7cdd1b9bc4 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 06b5db2c-baea-4e51-8506-6443bbd9daeb] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:35:59.828854 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c888e293-b865-413b-9677-ff7cdd1b9bc4 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:59.829355 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c888e293-b865-413b-9677-ff7cdd1b9bc4 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:59.829820 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c888e293-b865-413b-9677-ff7cdd1b9bc4 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:59.837613 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c888e293-b865-413b-9677-ff7cdd1b9bc4 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:35:59.839012 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c888e293-b865-413b-9677-ff7cdd1b9bc4 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:35:59.839556 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c888e293-b865-413b-9677-ff7cdd1b9bc4 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:35:59.872850 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-5851ed05-bf18-4422-a2c8-a01cecc92164 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c65a497e16e4e41b5cf1287042f3a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4001edd1474947a94243a620a6013a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:35:59.891915 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5851ed05-bf18-4422-a2c8-a01cecc92164 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] 10.222.0.52 "GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985" status: 200 len: 1722 microversion: 2.1 time: 0.355651 Oct 19 03:35:59.892824 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2483/4890] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:35:59 2022] GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985 => generated 1722 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:36:00.128576 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c888e293-b865-413b-9677-ff7cdd1b9bc4 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4729a0afd69480f99642266e0eec17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce5e9f9a4644b27a24b2f4c06df97bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:00.141440 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c888e293-b865-413b-9677-ff7cdd1b9bc4 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/06b5db2c-baea-4e51-8506-6443bbd9daeb" status: 200 len: 1523 microversion: 2.1 time: 0.328408 Oct 19 03:36:00.142647 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2408/4891] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:35:59 2022] GET /compute/v2.1/servers/06b5db2c-baea-4e51-8506-6443bbd9daeb => generated 1523 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:36:00.558771 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d5de7263-6ab0-4dcf-9cfc-287c5cc3f7d2 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:00.563032 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d5de7263-6ab0-4dcf-9cfc-287c5cc3f7d2 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] [instance: 4bc45105-f45f-4240-bd2a-9da8a5e5118b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:00.570904 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9799c927-cc58-4a4c-8dd0-509ee0c916de tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:00.573714 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9799c927-cc58-4a4c-8dd0-509ee0c916de tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:00.576414 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d5de7263-6ab0-4dcf-9cfc-287c5cc3f7d2 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:00.577864 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d5de7263-6ab0-4dcf-9cfc-287c5cc3f7d2 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:00.579603 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d5de7263-6ab0-4dcf-9cfc-287c5cc3f7d2 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:00.580923 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d5de7263-6ab0-4dcf-9cfc-287c5cc3f7d2 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:00.585525 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d5de7263-6ab0-4dcf-9cfc-287c5cc3f7d2 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:00.587627 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d5de7263-6ab0-4dcf-9cfc-287c5cc3f7d2 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:00.588169 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9799c927-cc58-4a4c-8dd0-509ee0c916de tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:00.589999 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9799c927-cc58-4a4c-8dd0-509ee0c916de tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:00.590680 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9799c927-cc58-4a4c-8dd0-509ee0c916de tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:00.594952 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9799c927-cc58-4a4c-8dd0-509ee0c916de tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:00.595667 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9799c927-cc58-4a4c-8dd0-509ee0c916de tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:00.596396 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9799c927-cc58-4a4c-8dd0-509ee0c916de tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:00.973203 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9799c927-cc58-4a4c-8dd0-509ee0c916de tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:00.986128 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9799c927-cc58-4a4c-8dd0-509ee0c916de tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21" status: 200 len: 1507 microversion: 2.1 time: 0.421805 Oct 19 03:36:00.989393 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2409/4892] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:00 2022] GET /compute/v2.1/servers/e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21 => generated 1507 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:36:01.001996 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6baff528-d9e7-4390-b603-dddedfe2d771 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:01.002639 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6baff528-d9e7-4390-b603-dddedfe2d771 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] [instance: ddbf7afb-1d7b-4d33-b6fb-1f1608c11985] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:01.004040 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d5de7263-6ab0-4dcf-9cfc-287c5cc3f7d2 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab48b332e534992a5bfa32168c2bb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1c0b7015a5430c831865ab53a3006e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:01.015134 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d5de7263-6ab0-4dcf-9cfc-287c5cc3f7d2 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] 10.222.0.52 "GET /compute/v2.1/servers/4bc45105-f45f-4240-bd2a-9da8a5e5118b" status: 200 len: 1314 microversion: 2.1 time: 0.460033 Oct 19 03:36:01.030425 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2484/4893] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:00 2022] GET /compute/v2.1/servers/4bc45105-f45f-4240-bd2a-9da8a5e5118b => generated 1314 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:36:01.030801 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6baff528-d9e7-4390-b603-dddedfe2d771 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:01.030801 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6baff528-d9e7-4390-b603-dddedfe2d771 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:01.030801 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6baff528-d9e7-4390-b603-dddedfe2d771 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:01.031398 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6baff528-d9e7-4390-b603-dddedfe2d771 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:01.032371 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6baff528-d9e7-4390-b603-dddedfe2d771 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:01.032839 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6baff528-d9e7-4390-b603-dddedfe2d771 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:01.165473 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-fa2e0e70-012d-4019-81e1-c71c16543faf tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:01.166163 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-fa2e0e70-012d-4019-81e1-c71c16543faf tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 06b5db2c-baea-4e51-8506-6443bbd9daeb] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:01.181096 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fa2e0e70-012d-4019-81e1-c71c16543faf tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:01.182398 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fa2e0e70-012d-4019-81e1-c71c16543faf tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:01.182856 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fa2e0e70-012d-4019-81e1-c71c16543faf tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:01.183577 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fa2e0e70-012d-4019-81e1-c71c16543faf tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:01.184154 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fa2e0e70-012d-4019-81e1-c71c16543faf tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:01.185016 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fa2e0e70-012d-4019-81e1-c71c16543faf tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:01.219024 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:36:01.375151 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-6baff528-d9e7-4390-b603-dddedfe2d771 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c65a497e16e4e41b5cf1287042f3a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4001edd1474947a94243a620a6013a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:01.390628 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6baff528-d9e7-4390-b603-dddedfe2d771 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] 10.222.0.52 "GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985" status: 200 len: 1722 microversion: 2.1 time: 0.399231 Oct 19 03:36:01.391268 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2410/4894] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:00 2022] GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985 => generated 1722 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:36:01.507932 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-fa2e0e70-012d-4019-81e1-c71c16543faf tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4729a0afd69480f99642266e0eec17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce5e9f9a4644b27a24b2f4c06df97bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:01.525738 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-fa2e0e70-012d-4019-81e1-c71c16543faf tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/06b5db2c-baea-4e51-8506-6443bbd9daeb" status: 200 len: 1523 microversion: 2.1 time: 0.359488 Oct 19 03:36:01.525738 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2485/4895] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:01 2022] GET /compute/v2.1/servers/06b5db2c-baea-4e51-8506-6443bbd9daeb => generated 1523 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:36:02.012748 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c2ec1f8d-623f-4144-9a17-2884cec5ab3e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:02.013288 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c2ec1f8d-623f-4144-9a17-2884cec5ab3e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:02.021592 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c2ec1f8d-623f-4144-9a17-2884cec5ab3e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:02.022093 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c2ec1f8d-623f-4144-9a17-2884cec5ab3e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:02.024769 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c2ec1f8d-623f-4144-9a17-2884cec5ab3e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:02.030815 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c2ec1f8d-623f-4144-9a17-2884cec5ab3e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:02.030815 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c2ec1f8d-623f-4144-9a17-2884cec5ab3e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:02.041336 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7e61a7ff-47fe-4683-9786-e8fceba41cd7 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:02.041976 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7e61a7ff-47fe-4683-9786-e8fceba41cd7 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] [instance: 4bc45105-f45f-4240-bd2a-9da8a5e5118b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:02.045716 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c2ec1f8d-623f-4144-9a17-2884cec5ab3e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:02.061884 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7e61a7ff-47fe-4683-9786-e8fceba41cd7 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:02.062378 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7e61a7ff-47fe-4683-9786-e8fceba41cd7 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:02.062954 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7e61a7ff-47fe-4683-9786-e8fceba41cd7 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:02.063674 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7e61a7ff-47fe-4683-9786-e8fceba41cd7 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:02.064129 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7e61a7ff-47fe-4683-9786-e8fceba41cd7 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:02.064558 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7e61a7ff-47fe-4683-9786-e8fceba41cd7 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:02.336659 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7e61a7ff-47fe-4683-9786-e8fceba41cd7 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab48b332e534992a5bfa32168c2bb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1c0b7015a5430c831865ab53a3006e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:02.364046 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7e61a7ff-47fe-4683-9786-e8fceba41cd7 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] 10.222.0.52 "GET /compute/v2.1/servers/4bc45105-f45f-4240-bd2a-9da8a5e5118b" status: 200 len: 1314 microversion: 2.1 time: 0.326524 Oct 19 03:36:02.377403 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2486/4896] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:02 2022] GET /compute/v2.1/servers/4bc45105-f45f-4240-bd2a-9da8a5e5118b => generated 1314 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:36:02.415902 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-8ccd0b11-d6a9-4542-b46f-2ae2d21ac1f7 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:02.416526 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-8ccd0b11-d6a9-4542-b46f-2ae2d21ac1f7 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] [instance: ddbf7afb-1d7b-4d33-b6fb-1f1608c11985] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:02.422199 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=8 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:36:02.424270 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8ccd0b11-d6a9-4542-b46f-2ae2d21ac1f7 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:02.424768 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8ccd0b11-d6a9-4542-b46f-2ae2d21ac1f7 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:02.425209 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8ccd0b11-d6a9-4542-b46f-2ae2d21ac1f7 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:02.425945 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8ccd0b11-d6a9-4542-b46f-2ae2d21ac1f7 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:02.426404 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8ccd0b11-d6a9-4542-b46f-2ae2d21ac1f7 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:02.426834 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8ccd0b11-d6a9-4542-b46f-2ae2d21ac1f7 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:02.453053 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c2ec1f8d-623f-4144-9a17-2884cec5ab3e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:02.461940 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c2ec1f8d-623f-4144-9a17-2884cec5ab3e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21" status: 200 len: 1504 microversion: 2.1 time: 0.453433 Oct 19 03:36:02.463044 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2411/4897] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:02 2022] GET /compute/v2.1/servers/e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21 => generated 1504 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:36:02.548532 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-29a20424-6518-42f2-9e45-ce2f5de53682 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:02.549407 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-29a20424-6518-42f2-9e45-ce2f5de53682 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 06b5db2c-baea-4e51-8506-6443bbd9daeb] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:02.559231 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-29a20424-6518-42f2-9e45-ce2f5de53682 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:02.573151 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-29a20424-6518-42f2-9e45-ce2f5de53682 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:02.573151 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-29a20424-6518-42f2-9e45-ce2f5de53682 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:02.574123 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-29a20424-6518-42f2-9e45-ce2f5de53682 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:02.578472 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-29a20424-6518-42f2-9e45-ce2f5de53682 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:02.579019 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-29a20424-6518-42f2-9e45-ce2f5de53682 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:02.764055 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-8ccd0b11-d6a9-4542-b46f-2ae2d21ac1f7 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c65a497e16e4e41b5cf1287042f3a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4001edd1474947a94243a620a6013a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:02.776094 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-8ccd0b11-d6a9-4542-b46f-2ae2d21ac1f7 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] 10.222.0.52 "GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985" status: 200 len: 1722 microversion: 2.1 time: 0.364951 Oct 19 03:36:02.780626 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2487/4898] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:02 2022] GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985 => generated 1722 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:36:02.993188 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-29a20424-6518-42f2-9e45-ce2f5de53682 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4729a0afd69480f99642266e0eec17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce5e9f9a4644b27a24b2f4c06df97bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:03.010237 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-29a20424-6518-42f2-9e45-ce2f5de53682 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/06b5db2c-baea-4e51-8506-6443bbd9daeb" status: 200 len: 1523 microversion: 2.1 time: 0.460393 Oct 19 03:36:03.011104 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2412/4899] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:02 2022] GET /compute/v2.1/servers/06b5db2c-baea-4e51-8506-6443bbd9daeb => generated 1523 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:36:03.394881 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-594ef86e-b881-4a76-8447-75dc475ab4dd tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:03.395498 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-594ef86e-b881-4a76-8447-75dc475ab4dd tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] [instance: 4bc45105-f45f-4240-bd2a-9da8a5e5118b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:03.402939 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-594ef86e-b881-4a76-8447-75dc475ab4dd tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:03.403424 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-594ef86e-b881-4a76-8447-75dc475ab4dd tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:03.403864 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-594ef86e-b881-4a76-8447-75dc475ab4dd tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:03.404566 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-594ef86e-b881-4a76-8447-75dc475ab4dd tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:03.405021 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-594ef86e-b881-4a76-8447-75dc475ab4dd tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:03.405585 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-594ef86e-b881-4a76-8447-75dc475ab4dd tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:03.424037 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:36:03.491484 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-159670b3-8593-461e-ae4a-750763f87f04 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:03.492748 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-159670b3-8593-461e-ae4a-750763f87f04 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:03.504272 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-159670b3-8593-461e-ae4a-750763f87f04 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:03.505131 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-159670b3-8593-461e-ae4a-750763f87f04 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:03.505934 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-159670b3-8593-461e-ae4a-750763f87f04 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:03.507161 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-159670b3-8593-461e-ae4a-750763f87f04 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:03.507639 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-159670b3-8593-461e-ae4a-750763f87f04 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:03.508079 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-159670b3-8593-461e-ae4a-750763f87f04 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:03.577821 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-594ef86e-b881-4a76-8447-75dc475ab4dd tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab48b332e534992a5bfa32168c2bb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1c0b7015a5430c831865ab53a3006e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:03.596009 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-594ef86e-b881-4a76-8447-75dc475ab4dd tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] 10.222.0.52 "GET /compute/v2.1/servers/4bc45105-f45f-4240-bd2a-9da8a5e5118b" status: 200 len: 1314 microversion: 2.1 time: 0.205390 Oct 19 03:36:03.597485 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2488/4900] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:03 2022] GET /compute/v2.1/servers/4bc45105-f45f-4240-bd2a-9da8a5e5118b => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:36:03.698925 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:36:03.710726 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-159670b3-8593-461e-ae4a-750763f87f04 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:03.720865 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-159670b3-8593-461e-ae4a-750763f87f04 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21" status: 200 len: 1504 microversion: 2.1 time: 0.233873 Oct 19 03:36:03.721862 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2413/4901] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:03 2022] GET /compute/v2.1/servers/e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21 => generated 1504 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:36:03.803738 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b4a77671-2af8-4380-9d0d-17094251e050 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:03.804623 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b4a77671-2af8-4380-9d0d-17094251e050 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] [instance: ddbf7afb-1d7b-4d33-b6fb-1f1608c11985] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:03.811820 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b4a77671-2af8-4380-9d0d-17094251e050 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:03.812467 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b4a77671-2af8-4380-9d0d-17094251e050 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:03.812917 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b4a77671-2af8-4380-9d0d-17094251e050 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:03.813952 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b4a77671-2af8-4380-9d0d-17094251e050 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:03.814859 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b4a77671-2af8-4380-9d0d-17094251e050 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:03.816100 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b4a77671-2af8-4380-9d0d-17094251e050 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:04.040191 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-839a2526-f5b7-498b-ae6f-6726acc8e707 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:04.040969 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-839a2526-f5b7-498b-ae6f-6726acc8e707 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 06b5db2c-baea-4e51-8506-6443bbd9daeb] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:04.048510 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-839a2526-f5b7-498b-ae6f-6726acc8e707 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:04.057844 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b4a77671-2af8-4380-9d0d-17094251e050 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c65a497e16e4e41b5cf1287042f3a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4001edd1474947a94243a620a6013a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:04.058118 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-839a2526-f5b7-498b-ae6f-6726acc8e707 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:04.063760 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-839a2526-f5b7-498b-ae6f-6726acc8e707 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:04.068879 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-839a2526-f5b7-498b-ae6f-6726acc8e707 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:04.068879 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-839a2526-f5b7-498b-ae6f-6726acc8e707 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:04.068879 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-839a2526-f5b7-498b-ae6f-6726acc8e707 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:04.070231 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b4a77671-2af8-4380-9d0d-17094251e050 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] 10.222.0.52 "GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985" status: 200 len: 1722 microversion: 2.1 time: 0.270326 Oct 19 03:36:04.070984 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2489/4902] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:03 2022] GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985 => generated 1722 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:36:04.343905 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-839a2526-f5b7-498b-ae6f-6726acc8e707 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4729a0afd69480f99642266e0eec17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce5e9f9a4644b27a24b2f4c06df97bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:04.357338 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-839a2526-f5b7-498b-ae6f-6726acc8e707 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/06b5db2c-baea-4e51-8506-6443bbd9daeb" status: 200 len: 1523 microversion: 2.1 time: 0.321015 Oct 19 03:36:04.364152 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2414/4903] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:04 2022] GET /compute/v2.1/servers/06b5db2c-baea-4e51-8506-6443bbd9daeb => generated 1523 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:36:04.388054 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-3b019eb2-aac6-4ffc-a8a5-06db68605950 req-cf9e1a7b-856e-417d-b8a1-0279abfec5be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21", "name": "network-vif-unplugged", "status": "completed", "tag": "01eed7bc-5062-4113-9784-b44646110510"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:36:04.407078 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-3b019eb2-aac6-4ffc-a8a5-06db68605950 req-cf9e1a7b-856e-417d-b8a1-0279abfec5be service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:04.408683 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-3b019eb2-aac6-4ffc-a8a5-06db68605950 req-cf9e1a7b-856e-417d-b8a1-0279abfec5be service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:04.409119 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-3b019eb2-aac6-4ffc-a8a5-06db68605950 req-cf9e1a7b-856e-417d-b8a1-0279abfec5be service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:04.425196 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-3b019eb2-aac6-4ffc-a8a5-06db68605950 req-cf9e1a7b-856e-417d-b8a1-0279abfec5be service nova] Creating event network-vif-unplugged:01eed7bc-5062-4113-9784-b44646110510 for instance e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21 on n-h2-861333-8 Oct 19 03:36:04.431167 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-3b019eb2-aac6-4ffc-a8a5-06db68605950 req-cf9e1a7b-856e-417d-b8a1-0279abfec5be service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049537 Oct 19 03:36:04.432415 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2490/4904] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:36:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:36:04.625928 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-64998b3c-9d43-420d-8590-1ed420fb1537 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:04.626645 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-64998b3c-9d43-420d-8590-1ed420fb1537 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] [instance: 4bc45105-f45f-4240-bd2a-9da8a5e5118b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:04.641215 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-64998b3c-9d43-420d-8590-1ed420fb1537 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:04.641769 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-64998b3c-9d43-420d-8590-1ed420fb1537 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:04.642214 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-64998b3c-9d43-420d-8590-1ed420fb1537 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:04.642931 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-64998b3c-9d43-420d-8590-1ed420fb1537 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:04.643391 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-64998b3c-9d43-420d-8590-1ed420fb1537 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:04.643828 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-64998b3c-9d43-420d-8590-1ed420fb1537 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:04.744135 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a3a95696-9a85-4375-affb-0b013b46d11a tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:04.744852 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a3a95696-9a85-4375-affb-0b013b46d11a tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:04.763646 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a3a95696-9a85-4375-affb-0b013b46d11a tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:04.764151 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a3a95696-9a85-4375-affb-0b013b46d11a tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:04.764597 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a3a95696-9a85-4375-affb-0b013b46d11a tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:04.769762 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a3a95696-9a85-4375-affb-0b013b46d11a tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:04.770739 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a3a95696-9a85-4375-affb-0b013b46d11a tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:04.771184 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a3a95696-9a85-4375-affb-0b013b46d11a tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:04.893137 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-64998b3c-9d43-420d-8590-1ed420fb1537 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab48b332e534992a5bfa32168c2bb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1c0b7015a5430c831865ab53a3006e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:04.908173 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-64998b3c-9d43-420d-8590-1ed420fb1537 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] 10.222.0.52 "GET /compute/v2.1/servers/4bc45105-f45f-4240-bd2a-9da8a5e5118b" status: 200 len: 1314 microversion: 2.1 time: 0.286827 Oct 19 03:36:04.909149 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2415/4905] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:04 2022] GET /compute/v2.1/servers/4bc45105-f45f-4240-bd2a-9da8a5e5118b => generated 1314 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:36:05.095006 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-782fa7b9-ab65-4fb9-9930-001f2f96c909 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:05.095710 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-782fa7b9-ab65-4fb9-9930-001f2f96c909 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] [instance: ddbf7afb-1d7b-4d33-b6fb-1f1608c11985] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:05.097561 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a3a95696-9a85-4375-affb-0b013b46d11a tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:05.108534 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-782fa7b9-ab65-4fb9-9930-001f2f96c909 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:05.110999 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a3a95696-9a85-4375-affb-0b013b46d11a tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21" status: 200 len: 1504 microversion: 2.1 time: 0.369648 Oct 19 03:36:05.111608 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-782fa7b9-ab65-4fb9-9930-001f2f96c909 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:05.111761 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2491/4906] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:04 2022] GET /compute/v2.1/servers/e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21 => generated 1504 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:36:05.112431 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-782fa7b9-ab65-4fb9-9930-001f2f96c909 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:05.113560 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-782fa7b9-ab65-4fb9-9930-001f2f96c909 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:05.122662 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-782fa7b9-ab65-4fb9-9930-001f2f96c909 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:05.124679 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-782fa7b9-ab65-4fb9-9930-001f2f96c909 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:05.382672 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-43081efa-4175-4396-8210-536d5e91bf86 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:05.383319 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-782fa7b9-ab65-4fb9-9930-001f2f96c909 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c65a497e16e4e41b5cf1287042f3a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4001edd1474947a94243a620a6013a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:05.400101 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-43081efa-4175-4396-8210-536d5e91bf86 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 06b5db2c-baea-4e51-8506-6443bbd9daeb] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:05.410930 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-782fa7b9-ab65-4fb9-9930-001f2f96c909 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] 10.222.0.52 "GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985" status: 200 len: 1722 microversion: 2.1 time: 0.320503 Oct 19 03:36:05.414686 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2416/4907] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:05 2022] GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985 => generated 1722 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:36:05.417157 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-43081efa-4175-4396-8210-536d5e91bf86 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:05.417692 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-43081efa-4175-4396-8210-536d5e91bf86 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:05.419860 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-43081efa-4175-4396-8210-536d5e91bf86 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:05.421602 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-43081efa-4175-4396-8210-536d5e91bf86 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:05.422439 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-43081efa-4175-4396-8210-536d5e91bf86 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:05.423089 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-43081efa-4175-4396-8210-536d5e91bf86 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:05.597408 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-43081efa-4175-4396-8210-536d5e91bf86 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4729a0afd69480f99642266e0eec17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce5e9f9a4644b27a24b2f4c06df97bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:05.620683 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-43081efa-4175-4396-8210-536d5e91bf86 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/06b5db2c-baea-4e51-8506-6443bbd9daeb" status: 200 len: 1523 microversion: 2.1 time: 0.242027 Oct 19 03:36:05.622068 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2492/4908] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:05 2022] GET /compute/v2.1/servers/06b5db2c-baea-4e51-8506-6443bbd9daeb => generated 1523 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:36:05.932183 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-cfc6c4bf-35cb-49dd-9f79-39728372d4aa tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:05.933052 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-cfc6c4bf-35cb-49dd-9f79-39728372d4aa tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] [instance: 4bc45105-f45f-4240-bd2a-9da8a5e5118b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:05.940188 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cfc6c4bf-35cb-49dd-9f79-39728372d4aa tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:05.940670 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cfc6c4bf-35cb-49dd-9f79-39728372d4aa tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:05.941103 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cfc6c4bf-35cb-49dd-9f79-39728372d4aa tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:05.941818 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cfc6c4bf-35cb-49dd-9f79-39728372d4aa tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:05.942269 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cfc6c4bf-35cb-49dd-9f79-39728372d4aa tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:05.942713 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cfc6c4bf-35cb-49dd-9f79-39728372d4aa tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:06.114585 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-cfc6c4bf-35cb-49dd-9f79-39728372d4aa tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab48b332e534992a5bfa32168c2bb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1c0b7015a5430c831865ab53a3006e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:06.123016 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-cfc6c4bf-35cb-49dd-9f79-39728372d4aa tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] 10.222.0.52 "GET /compute/v2.1/servers/4bc45105-f45f-4240-bd2a-9da8a5e5118b" status: 200 len: 1314 microversion: 2.1 time: 0.194737 Oct 19 03:36:06.133610 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2417/4909] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:05 2022] GET /compute/v2.1/servers/4bc45105-f45f-4240-bd2a-9da8a5e5118b => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:36:06.144715 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1a75b896-efe9-4b4e-ab56-b4d0c40dab92 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:06.145713 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1a75b896-efe9-4b4e-ab56-b4d0c40dab92 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:06.153556 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1a75b896-efe9-4b4e-ab56-b4d0c40dab92 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:06.155064 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1a75b896-efe9-4b4e-ab56-b4d0c40dab92 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:06.155711 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1a75b896-efe9-4b4e-ab56-b4d0c40dab92 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:06.159738 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1a75b896-efe9-4b4e-ab56-b4d0c40dab92 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:06.159738 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1a75b896-efe9-4b4e-ab56-b4d0c40dab92 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:06.159738 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1a75b896-efe9-4b4e-ab56-b4d0c40dab92 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:06.377799 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-1a75b896-efe9-4b4e-ab56-b4d0c40dab92 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:06.426533 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1a75b896-efe9-4b4e-ab56-b4d0c40dab92 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21" status: 200 len: 1507 microversion: 2.1 time: 0.287832 Oct 19 03:36:06.427276 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2493/4910] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:06 2022] GET /compute/v2.1/servers/e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21 => generated 1507 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:36:06.440484 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1f3c871d-d657-45a8-9fb4-b9c43074dcfe tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:06.441194 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1f3c871d-d657-45a8-9fb4-b9c43074dcfe tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] [instance: ddbf7afb-1d7b-4d33-b6fb-1f1608c11985] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:06.449005 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1f3c871d-d657-45a8-9fb4-b9c43074dcfe tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:06.451538 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1f3c871d-d657-45a8-9fb4-b9c43074dcfe tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:06.451538 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1f3c871d-d657-45a8-9fb4-b9c43074dcfe tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:06.451538 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1f3c871d-d657-45a8-9fb4-b9c43074dcfe tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:06.452622 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1f3c871d-d657-45a8-9fb4-b9c43074dcfe tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:06.453627 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1f3c871d-d657-45a8-9fb4-b9c43074dcfe tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:06.460286 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-753d3917-9e75-4e85-b2e8-114146c3d93a tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:06.460918 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-753d3917-9e75-4e85-b2e8-114146c3d93a tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:06.476475 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-753d3917-9e75-4e85-b2e8-114146c3d93a tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:06.487361 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-753d3917-9e75-4e85-b2e8-114146c3d93a tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:06.487361 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-753d3917-9e75-4e85-b2e8-114146c3d93a tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:06.487361 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-753d3917-9e75-4e85-b2e8-114146c3d93a tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:06.487361 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-753d3917-9e75-4e85-b2e8-114146c3d93a tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:06.487361 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-753d3917-9e75-4e85-b2e8-114146c3d93a tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:06.791344 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-1f3c871d-d657-45a8-9fb4-b9c43074dcfe tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c65a497e16e4e41b5cf1287042f3a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4001edd1474947a94243a620a6013a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:06.802163 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1f3c871d-d657-45a8-9fb4-b9c43074dcfe tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] 10.222.0.52 "GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985" status: 200 len: 1722 microversion: 2.1 time: 0.365729 Oct 19 03:36:06.807718 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2418/4911] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:06 2022] GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985 => generated 1722 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:36:06.815884 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-753d3917-9e75-4e85-b2e8-114146c3d93a tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:06.822482 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-eb07cf5d-85cc-47b1-8c13-c36bfab521c9 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:06.824277 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-753d3917-9e75-4e85-b2e8-114146c3d93a tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1670 microversion: 2.1 time: 0.369714 Oct 19 03:36:06.830340 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-eb07cf5d-85cc-47b1-8c13-c36bfab521c9 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 06b5db2c-baea-4e51-8506-6443bbd9daeb] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:06.830588 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2494/4912] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:06 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1670 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:36:06.834354 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eb07cf5d-85cc-47b1-8c13-c36bfab521c9 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:06.835061 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eb07cf5d-85cc-47b1-8c13-c36bfab521c9 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:06.835676 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eb07cf5d-85cc-47b1-8c13-c36bfab521c9 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:06.836684 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eb07cf5d-85cc-47b1-8c13-c36bfab521c9 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:06.837292 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eb07cf5d-85cc-47b1-8c13-c36bfab521c9 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:06.837929 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eb07cf5d-85cc-47b1-8c13-c36bfab521c9 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:06.869173 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-04455a66-95d3-43a1-af28-f3924c77d7fc tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:06.870802 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-04455a66-95d3-43a1-af28-f3924c77d7fc tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:06.878560 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-04455a66-95d3-43a1-af28-f3924c77d7fc tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:06.879230 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-04455a66-95d3-43a1-af28-f3924c77d7fc tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:06.879673 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-04455a66-95d3-43a1-af28-f3924c77d7fc tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:06.880385 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-04455a66-95d3-43a1-af28-f3924c77d7fc tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:06.880819 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-04455a66-95d3-43a1-af28-f3924c77d7fc tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:06.881634 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-04455a66-95d3-43a1-af28-f3924c77d7fc tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:07.113742 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-eb07cf5d-85cc-47b1-8c13-c36bfab521c9 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4729a0afd69480f99642266e0eec17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce5e9f9a4644b27a24b2f4c06df97bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:07.114281 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-04455a66-95d3-43a1-af28-f3924c77d7fc tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:07.122725 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-04455a66-95d3-43a1-af28-f3924c77d7fc tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1670 microversion: 2.1 time: 0.258333 Oct 19 03:36:07.125279 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-eb07cf5d-85cc-47b1-8c13-c36bfab521c9 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/06b5db2c-baea-4e51-8506-6443bbd9daeb" status: 200 len: 1503 microversion: 2.1 time: 0.315234 Oct 19 03:36:07.128109 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2419/4913] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:06 2022] GET /compute/v2.1/servers/06b5db2c-baea-4e51-8506-6443bbd9daeb => generated 1503 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:36:07.137076 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2495/4914] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:06 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1670 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:36:07.149159 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ac54ed3a-6369-4e78-8fbc-879ee27930e8 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:07.151056 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ac54ed3a-6369-4e78-8fbc-879ee27930e8 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] [instance: 4bc45105-f45f-4240-bd2a-9da8a5e5118b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:07.158938 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-3b229b48-b053-4d73-9880-6339b0d5a25d req-d73a81ac-c2fd-4f5e-b724-2c0e45142b95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bc45105-f45f-4240-bd2a-9da8a5e5118b", "name": "network-vif-plugged", "status": "completed", "tag": "ecaf169e-f46b-4198-bb48-b54112886170"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:36:07.159245 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ac54ed3a-6369-4e78-8fbc-879ee27930e8 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:07.159911 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ac54ed3a-6369-4e78-8fbc-879ee27930e8 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:07.160665 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ac54ed3a-6369-4e78-8fbc-879ee27930e8 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:07.161681 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ac54ed3a-6369-4e78-8fbc-879ee27930e8 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:07.162421 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ac54ed3a-6369-4e78-8fbc-879ee27930e8 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:07.163098 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ac54ed3a-6369-4e78-8fbc-879ee27930e8 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:07.179587 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-3b229b48-b053-4d73-9880-6339b0d5a25d req-d73a81ac-c2fd-4f5e-b724-2c0e45142b95 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:07.180950 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-3b229b48-b053-4d73-9880-6339b0d5a25d req-d73a81ac-c2fd-4f5e-b724-2c0e45142b95 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:07.181701 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-3b229b48-b053-4d73-9880-6339b0d5a25d req-d73a81ac-c2fd-4f5e-b724-2c0e45142b95 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:07.195682 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-3b229b48-b053-4d73-9880-6339b0d5a25d req-d73a81ac-c2fd-4f5e-b724-2c0e45142b95 service nova] Creating event network-vif-plugged:ecaf169e-f46b-4198-bb48-b54112886170 for instance 4bc45105-f45f-4240-bd2a-9da8a5e5118b on n-h1-861333-8 Oct 19 03:36:07.201443 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-3b229b48-b053-4d73-9880-6339b0d5a25d req-d73a81ac-c2fd-4f5e-b724-2c0e45142b95 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071692 Oct 19 03:36:07.202294 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2420/4915] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:36:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:36:07.210703 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-da5a7ea3-3bb3-4dac-a87f-0ca5f1010590 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:07.213895 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-da5a7ea3-3bb3-4dac-a87f-0ca5f1010590 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:07.223615 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-da5a7ea3-3bb3-4dac-a87f-0ca5f1010590 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:07.224222 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-da5a7ea3-3bb3-4dac-a87f-0ca5f1010590 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:07.224676 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-da5a7ea3-3bb3-4dac-a87f-0ca5f1010590 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:07.225447 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-da5a7ea3-3bb3-4dac-a87f-0ca5f1010590 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:07.226285 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-da5a7ea3-3bb3-4dac-a87f-0ca5f1010590 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:07.227086 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-da5a7ea3-3bb3-4dac-a87f-0ca5f1010590 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:07.246099 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=100 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:36:07.457237 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-da5a7ea3-3bb3-4dac-a87f-0ca5f1010590 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:07.462999 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-da5a7ea3-3bb3-4dac-a87f-0ca5f1010590 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1670 microversion: 2.1 time: 0.259087 Oct 19 03:36:07.463962 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2421/4916] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:07 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1670 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:36:07.486236 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6ab66bdb-c116-4acb-878e-75fb8e3c1d52 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:07.486588 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6ab66bdb-c116-4acb-878e-75fb8e3c1d52 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 8955f425-23eb-423e-8ed4-eea1bd5dbc08] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:07.487402 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ac54ed3a-6369-4e78-8fbc-879ee27930e8 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab48b332e534992a5bfa32168c2bb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1c0b7015a5430c831865ab53a3006e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:07.495276 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6ab66bdb-c116-4acb-878e-75fb8e3c1d52 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:07.495878 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6ab66bdb-c116-4acb-878e-75fb8e3c1d52 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:07.496853 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6ab66bdb-c116-4acb-878e-75fb8e3c1d52 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:07.497679 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6ab66bdb-c116-4acb-878e-75fb8e3c1d52 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:07.497847 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ac54ed3a-6369-4e78-8fbc-879ee27930e8 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] 10.222.0.52 "GET /compute/v2.1/servers/4bc45105-f45f-4240-bd2a-9da8a5e5118b" status: 200 len: 1314 microversion: 2.1 time: 0.352308 Oct 19 03:36:07.498229 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6ab66bdb-c116-4acb-878e-75fb8e3c1d52 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:07.498919 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2496/4917] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:07 2022] GET /compute/v2.1/servers/4bc45105-f45f-4240-bd2a-9da8a5e5118b => generated 1314 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:36:07.502407 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6ab66bdb-c116-4acb-878e-75fb8e3c1d52 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:07.504208 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5bb3970f-62e3-4233-a423-5dc64bf30ef0 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:07.504928 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-5bb3970f-62e3-4233-a423-5dc64bf30ef0 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:07.511420 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5bb3970f-62e3-4233-a423-5dc64bf30ef0 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:07.512750 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5bb3970f-62e3-4233-a423-5dc64bf30ef0 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:07.513527 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5bb3970f-62e3-4233-a423-5dc64bf30ef0 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:07.514664 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5bb3970f-62e3-4233-a423-5dc64bf30ef0 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:07.515233 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5bb3970f-62e3-4233-a423-5dc64bf30ef0 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:07.515768 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5bb3970f-62e3-4233-a423-5dc64bf30ef0 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:08.112061 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-6ab66bdb-c116-4acb-878e-75fb8e3c1d52 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4729a0afd69480f99642266e0eec17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce5e9f9a4644b27a24b2f4c06df97bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:08.125861 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6ab66bdb-c116-4acb-878e-75fb8e3c1d52 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/8955f425-23eb-423e-8ed4-eea1bd5dbc08" status: 200 len: 1517 microversion: 2.1 time: 0.660541 Oct 19 03:36:08.133430 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2422/4918] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:07 2022] GET /compute/v2.1/servers/8955f425-23eb-423e-8ed4-eea1bd5dbc08 => generated 1517 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:36:08.138086 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-5bb3970f-62e3-4233-a423-5dc64bf30ef0 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:08.146879 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5bb3970f-62e3-4233-a423-5dc64bf30ef0 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1670 microversion: 2.1 time: 0.646773 Oct 19 03:36:08.152018 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f6646016-697a-458a-b080-596ab972c47d tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:08.153226 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2497/4919] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:07 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1670 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:36:08.161736 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f6646016-697a-458a-b080-596ab972c47d tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] [instance: ddbf7afb-1d7b-4d33-b6fb-1f1608c11985] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:08.180918 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-020e961e-2814-4fba-bbc0-eb8df4dda334 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:36:08.183564 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-020e961e-2814-4fba-bbc0-eb8df4dda334 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 1d00fbd0-378e-4564-ba3a-36295b4c6404] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:08.187911 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f6646016-697a-458a-b080-596ab972c47d tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:08.191982 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f6646016-697a-458a-b080-596ab972c47d tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:08.192659 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f6646016-697a-458a-b080-596ab972c47d tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:08.195861 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f6646016-697a-458a-b080-596ab972c47d tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:08.196631 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f6646016-697a-458a-b080-596ab972c47d tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:08.198768 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f6646016-697a-458a-b080-596ab972c47d tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:08.204659 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-020e961e-2814-4fba-bbc0-eb8df4dda334 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] HTTP exception thrown: Instance 1d00fbd0-378e-4564-ba3a-36295b4c6404 could not be found. Oct 19 03:36:08.215250 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-020e961e-2814-4fba-bbc0-eb8df4dda334 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Request method failure captured: Oct 19 03:36:08.215250 n-d-861333-8 devstack@n-api.service[121135]: request: POST /compute/v2.1/servers/1d00fbd0-378e-4564-ba3a-36295b4c6404/action HTTP/1.1 Oct 19 03:36:08.215250 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:36:08.215250 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:36:08.215250 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:36:08.215250 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 14 Oct 19 03:36:08.215250 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:36:08.215250 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:36:08.215250 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:36:08.215250 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:36:08.215250 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT3BmoEKz0EhW7NaUKeOkQsZRXl8ERfsAKAMxU0GUBdc2f_V_CqkDPpZu62NL2einDTJrDUFbtRF7OMHEg091oC7NSi4gfYN6KT9w4SCkkHNILzmL1G1frQPfKMrDDDqTbb0782yvc_4ZYCpfzt0d6J1jKWlIQL4vx50kauya3LDEzsA Oct 19 03:36:08.215250 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:36:08.215250 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:36:08.215250 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:36:08.215250 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:36:08.215250 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:36:08.215250 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:36:08.215250 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 2ce5e9f9a4644b27a24b2f4c06df97bc Oct 19 03:36:08.215250 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-684190061 Oct 19 03:36:08.215250 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:36:08.215250 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:36:08.215250 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2ce5e9f9a4644b27a24b2f4c06df97bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2ce5e9f9a4644b27a24b2f4c06df97bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2ce5e9f9a4644b27a24b2f4c06df97bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2ce5e9f9a4644b27a24b2f4c06df97bc", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:36:08.215250 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ServerRescueNegativeTestJSON-684190061 Oct 19 03:36:08.215250 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 2ce5e9f9a4644b27a24b2f4c06df97bc Oct 19 03:36:08.215250 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-684190061 Oct 19 03:36:08.215250 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ServerRescueNegativeTestJSON-684190061-project Oct 19 03:36:08.215250 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:36:08.215250 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:36:08.215250 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: b4729a0afd69480f99642266e0eec17e Oct 19 03:36:08.215250 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ServerRescueNegativeTestJSON-684190061-project Oct 19 03:36:08.215250 n-d-861333-8 devstack@n-api.service[121135]: Oct 19 03:36:08.215250 n-d-861333-8 devstack@n-api.service[121135]: {"rescue": {}} Oct 19 03:36:08.215250 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:36:08.215250 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance 1d00fbd0-378e-4564-ba3a-36295b4c6404 could not be found. Oct 19 03:36:08.215250 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '1d00fbd0-378e-4564-ba3a-36295b4c6404', 'body': {'rescue': {}}} Oct 19 03:36:08.215250 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:36:08.215250 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:36:08.215250 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:36:08.215250 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:36:08.215250 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:36:08.215250 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:36:08.215250 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 19 03:36:08.215250 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 19 03:36:08.215250 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d00fbd0-378e-4564-ba3a-36295b4c6404 could not be found. Oct 19 03:36:08.215250 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:36:08.215250 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:36:08.215250 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:36:08.215250 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:36:08.215250 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:36:08.215250 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:36:08.215250 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:36:08.215250 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:36:08.215250 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:36:08.215250 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:36:08.215250 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:36:08.215250 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:36:08.215250 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Oct 19 03:36:08.215250 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 19 03:36:08.215250 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:36:08.215250 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:36:08.215250 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d00fbd0-378e-4564-ba3a-36295b4c6404 could not be found. Oct 19 03:36:08.215250 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:36:08.215250 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:36:08.215250 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:36:08.215250 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:36:08.221407 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:36:08.221407 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:36:08.221407 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:36:08.221407 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:36:08.221407 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d00fbd0-378e-4564-ba3a-36295b4c6404 could not be found. Oct 19 03:36:08.221407 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:36:08.222871 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-020e961e-2814-4fba-bbc0-eb8df4dda334 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Returning 404 to user: Instance 1d00fbd0-378e-4564-ba3a-36295b4c6404 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:36:08.223261 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-020e961e-2814-4fba-bbc0-eb8df4dda334 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "POST /compute/v2.1/servers/1d00fbd0-378e-4564-ba3a-36295b4c6404/action" status: 404 len: 111 microversion: 2.1 time: 0.063903 Oct 19 03:36:08.224463 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2498/4920] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:36:08 2022] POST /compute/v2.1/servers/1d00fbd0-378e-4564-ba3a-36295b4c6404/action => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:36:08.234260 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b88d83ce-7cdf-442e-8e77-0906a4bae123 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:36:08.244683 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b88d83ce-7cdf-442e-8e77-0906a4bae123 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:08.245072 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b88d83ce-7cdf-442e-8e77-0906a4bae123 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:08.245765 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b88d83ce-7cdf-442e-8e77-0906a4bae123 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:08.278142 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b88d83ce-7cdf-442e-8e77-0906a4bae123 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Going to try to stop instance {{(pid=121135) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 19 03:36:08.406633 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-f6646016-697a-458a-b080-596ab972c47d tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c65a497e16e4e41b5cf1287042f3a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4001edd1474947a94243a620a6013a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:08.415915 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f6646016-697a-458a-b080-596ab972c47d tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] 10.222.0.52 "GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985" status: 200 len: 1722 microversion: 2.1 time: 0.283561 Oct 19 03:36:08.417220 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2423/4921] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:08 2022] GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985 => generated 1722 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:36:08.422722 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-947364f9-d2af-461f-a236-af6ab0af22b9 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:36:08.423334 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-947364f9-d2af-461f-a236-af6ab0af22b9 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 8955f425-23eb-423e-8ed4-eea1bd5dbc08] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:08.430338 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-947364f9-d2af-461f-a236-af6ab0af22b9 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:08.430832 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-947364f9-d2af-461f-a236-af6ab0af22b9 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:08.431278 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-947364f9-d2af-461f-a236-af6ab0af22b9 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:08.431966 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-947364f9-d2af-461f-a236-af6ab0af22b9 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:08.432423 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-947364f9-d2af-461f-a236-af6ab0af22b9 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:08.432855 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-947364f9-d2af-461f-a236-af6ab0af22b9 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:08.649711 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b88d83ce-7cdf-442e-8e77-0906a4bae123 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "POST /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f/action" status: 202 len: 0 microversion: 2.1 time: 0.423659 Oct 19 03:36:08.655913 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2499/4922] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:36:08 2022] POST /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f/action => generated 0 bytes in 430 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:36:08.661998 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2f25667d-3527-4c46-b935-1e2f279c9289 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:08.663359 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-2f25667d-3527-4c46-b935-1e2f279c9289 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] [instance: 4bc45105-f45f-4240-bd2a-9da8a5e5118b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:08.671680 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2f25667d-3527-4c46-b935-1e2f279c9289 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:08.672825 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2f25667d-3527-4c46-b935-1e2f279c9289 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:08.673587 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2f25667d-3527-4c46-b935-1e2f279c9289 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:08.675564 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2f25667d-3527-4c46-b935-1e2f279c9289 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:08.678373 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2f25667d-3527-4c46-b935-1e2f279c9289 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:08.679047 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2f25667d-3527-4c46-b935-1e2f279c9289 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:08.831357 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-2f25667d-3527-4c46-b935-1e2f279c9289 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab48b332e534992a5bfa32168c2bb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1c0b7015a5430c831865ab53a3006e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:08.839130 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2f25667d-3527-4c46-b935-1e2f279c9289 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] 10.222.0.52 "GET /compute/v2.1/servers/4bc45105-f45f-4240-bd2a-9da8a5e5118b" status: 200 len: 1314 microversion: 2.1 time: 0.181604 Oct 19 03:36:08.839651 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2500/4923] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:08 2022] GET /compute/v2.1/servers/4bc45105-f45f-4240-bd2a-9da8a5e5118b => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:36:08.844668 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7bc78cf9-9c3a-47f9-8345-f08207cab753 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:08.845280 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7bc78cf9-9c3a-47f9-8345-f08207cab753 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:08.851029 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7bc78cf9-9c3a-47f9-8345-f08207cab753 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:08.851526 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7bc78cf9-9c3a-47f9-8345-f08207cab753 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:08.853199 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7bc78cf9-9c3a-47f9-8345-f08207cab753 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:08.853935 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7bc78cf9-9c3a-47f9-8345-f08207cab753 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:08.854483 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7bc78cf9-9c3a-47f9-8345-f08207cab753 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:08.857256 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7bc78cf9-9c3a-47f9-8345-f08207cab753 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:08.885142 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-947364f9-d2af-461f-a236-af6ab0af22b9 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "POST /compute/v2.1/servers/8955f425-23eb-423e-8ed4-eea1bd5dbc08/action" status: 202 len: 0 microversion: 2.1 time: 0.465680 Oct 19 03:36:08.890801 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2424/4924] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:36:08 2022] POST /compute/v2.1/servers/8955f425-23eb-423e-8ed4-eea1bd5dbc08/action => generated 0 bytes in 470 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:36:08.923493 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-dc9de9fc-f80b-44bd-8190-5448bee706a2 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:08.924147 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-dc9de9fc-f80b-44bd-8190-5448bee706a2 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 8955f425-23eb-423e-8ed4-eea1bd5dbc08] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:08.931861 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dc9de9fc-f80b-44bd-8190-5448bee706a2 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:08.932789 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dc9de9fc-f80b-44bd-8190-5448bee706a2 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:08.932789 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dc9de9fc-f80b-44bd-8190-5448bee706a2 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:08.933637 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dc9de9fc-f80b-44bd-8190-5448bee706a2 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:08.938404 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dc9de9fc-f80b-44bd-8190-5448bee706a2 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:08.938404 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dc9de9fc-f80b-44bd-8190-5448bee706a2 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:09.121748 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-dc9de9fc-f80b-44bd-8190-5448bee706a2 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4729a0afd69480f99642266e0eec17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce5e9f9a4644b27a24b2f4c06df97bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:09.132622 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-dc9de9fc-f80b-44bd-8190-5448bee706a2 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/8955f425-23eb-423e-8ed4-eea1bd5dbc08" status: 200 len: 1522 microversion: 2.1 time: 0.225061 Oct 19 03:36:09.149801 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2425/4925] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:08 2022] GET /compute/v2.1/servers/8955f425-23eb-423e-8ed4-eea1bd5dbc08 => generated 1522 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:36:09.173137 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7bc78cf9-9c3a-47f9-8345-f08207cab753 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:09.183773 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7bc78cf9-9c3a-47f9-8345-f08207cab753 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1680 microversion: 2.1 time: 0.342394 Oct 19 03:36:09.185414 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2501/4926] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:08 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1680 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:36:09.440867 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a6268d25-4d8a-437a-88c5-d5a001c9fc21 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:09.441699 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a6268d25-4d8a-437a-88c5-d5a001c9fc21 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] [instance: ddbf7afb-1d7b-4d33-b6fb-1f1608c11985] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:09.449043 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a6268d25-4d8a-437a-88c5-d5a001c9fc21 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:09.449786 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a6268d25-4d8a-437a-88c5-d5a001c9fc21 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:09.451141 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a6268d25-4d8a-437a-88c5-d5a001c9fc21 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:09.453127 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a6268d25-4d8a-437a-88c5-d5a001c9fc21 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:09.453910 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a6268d25-4d8a-437a-88c5-d5a001c9fc21 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:09.454693 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a6268d25-4d8a-437a-88c5-d5a001c9fc21 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:09.768589 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a6268d25-4d8a-437a-88c5-d5a001c9fc21 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c65a497e16e4e41b5cf1287042f3a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4001edd1474947a94243a620a6013a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:09.780799 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a6268d25-4d8a-437a-88c5-d5a001c9fc21 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] 10.222.0.52 "GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985" status: 200 len: 1722 microversion: 2.1 time: 0.343210 Oct 19 03:36:09.782249 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2426/4927] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:09 2022] GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985 => generated 1722 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:36:09.867320 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-cac31311-aa73-4f57-8616-4cbd3fb7098b tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:09.868936 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-cac31311-aa73-4f57-8616-4cbd3fb7098b tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] [instance: 4bc45105-f45f-4240-bd2a-9da8a5e5118b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:09.879438 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cac31311-aa73-4f57-8616-4cbd3fb7098b tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:09.885079 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cac31311-aa73-4f57-8616-4cbd3fb7098b tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:09.885647 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cac31311-aa73-4f57-8616-4cbd3fb7098b tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:09.887078 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cac31311-aa73-4f57-8616-4cbd3fb7098b tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:09.887703 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cac31311-aa73-4f57-8616-4cbd3fb7098b tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:09.888147 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cac31311-aa73-4f57-8616-4cbd3fb7098b tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:10.159125 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-75a4ef90-75a5-49d7-bb79-7a11770d83a8 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:10.159947 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-75a4ef90-75a5-49d7-bb79-7a11770d83a8 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 8955f425-23eb-423e-8ed4-eea1bd5dbc08] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:10.167945 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-75a4ef90-75a5-49d7-bb79-7a11770d83a8 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:10.171807 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-75a4ef90-75a5-49d7-bb79-7a11770d83a8 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:10.171807 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-75a4ef90-75a5-49d7-bb79-7a11770d83a8 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:10.171807 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-75a4ef90-75a5-49d7-bb79-7a11770d83a8 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:10.171807 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-75a4ef90-75a5-49d7-bb79-7a11770d83a8 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:10.172801 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-75a4ef90-75a5-49d7-bb79-7a11770d83a8 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:10.326633 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-cac31311-aa73-4f57-8616-4cbd3fb7098b tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab48b332e534992a5bfa32168c2bb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1c0b7015a5430c831865ab53a3006e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:10.335433 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-cac31311-aa73-4f57-8616-4cbd3fb7098b tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] 10.222.0.52 "GET /compute/v2.1/servers/4bc45105-f45f-4240-bd2a-9da8a5e5118b" status: 200 len: 1499 microversion: 2.1 time: 0.472858 Oct 19 03:36:10.350171 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2502/4928] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:09 2022] GET /compute/v2.1/servers/4bc45105-f45f-4240-bd2a-9da8a5e5118b => generated 1499 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:36:10.350171 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9761dca9-87c5-4757-a075-a47e6aa5cfec tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:10.350171 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9761dca9-87c5-4757-a075-a47e6aa5cfec tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:10.350171 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9761dca9-87c5-4757-a075-a47e6aa5cfec tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:10.350171 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9761dca9-87c5-4757-a075-a47e6aa5cfec tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:10.351308 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9761dca9-87c5-4757-a075-a47e6aa5cfec tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:10.352310 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9761dca9-87c5-4757-a075-a47e6aa5cfec tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:10.353001 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9761dca9-87c5-4757-a075-a47e6aa5cfec tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:10.354114 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9761dca9-87c5-4757-a075-a47e6aa5cfec tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:10.436841 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-75a4ef90-75a5-49d7-bb79-7a11770d83a8 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4729a0afd69480f99642266e0eec17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce5e9f9a4644b27a24b2f4c06df97bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:10.446780 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-75a4ef90-75a5-49d7-bb79-7a11770d83a8 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/8955f425-23eb-423e-8ed4-eea1bd5dbc08" status: 200 len: 1502 microversion: 2.1 time: 0.294265 Oct 19 03:36:10.465673 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2427/4929] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:10 2022] GET /compute/v2.1/servers/8955f425-23eb-423e-8ed4-eea1bd5dbc08 => generated 1502 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:36:10.472595 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-79d4ab6f-6cd1-40e6-a6b4-867fba98bcea tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:36:10.476352 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-79d4ab6f-6cd1-40e6-a6b4-867fba98bcea tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 8955f425-23eb-423e-8ed4-eea1bd5dbc08] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:10.499571 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-79d4ab6f-6cd1-40e6-a6b4-867fba98bcea tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:10.500907 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-79d4ab6f-6cd1-40e6-a6b4-867fba98bcea tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:10.502141 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-79d4ab6f-6cd1-40e6-a6b4-867fba98bcea tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:10.503604 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-79d4ab6f-6cd1-40e6-a6b4-867fba98bcea tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:10.505611 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-79d4ab6f-6cd1-40e6-a6b4-867fba98bcea tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:10.506405 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-79d4ab6f-6cd1-40e6-a6b4-867fba98bcea tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:10.573504 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-79d4ab6f-6cd1-40e6-a6b4-867fba98bcea tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lazy-loading 'flavor' on Instance uuid 8955f425-23eb-423e-8ed4-eea1bd5dbc08 {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:36:10.590652 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-79d4ab6f-6cd1-40e6-a6b4-867fba98bcea tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] HTTP exception thrown: Cannot 'rescue' instance 8955f425-23eb-423e-8ed4-eea1bd5dbc08 while it is in vm_state paused Oct 19 03:36:10.593195 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-79d4ab6f-6cd1-40e6-a6b4-867fba98bcea tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Request method failure captured: Oct 19 03:36:10.593195 n-d-861333-8 devstack@n-api.service[121134]: request: POST /compute/v2.1/servers/8955f425-23eb-423e-8ed4-eea1bd5dbc08/action HTTP/1.1 Oct 19 03:36:10.593195 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:36:10.593195 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:36:10.593195 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:36:10.593195 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 14 Oct 19 03:36:10.593195 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:36:10.593195 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:36:10.593195 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:36:10.593195 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:36:10.593195 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3BmoEKz0EhW7NaUKeOkQsZRXl8ERfsAKAMxU0GUBdc2f_V_CqkDPpZu62NL2einDTJrDUFbtRF7OMHEg091oC7NSi4gfYN6KT9w4SCkkHNILzmL1G1frQPfKMrDDDqTbb0782yvc_4ZYCpfzt0d6J1jKWlIQL4vx50kauya3LDEzsA Oct 19 03:36:10.593195 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:36:10.593195 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:36:10.593195 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:36:10.593195 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:36:10.593195 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:36:10.593195 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:36:10.593195 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 2ce5e9f9a4644b27a24b2f4c06df97bc Oct 19 03:36:10.593195 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-684190061 Oct 19 03:36:10.593195 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:36:10.593195 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:36:10.593195 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2ce5e9f9a4644b27a24b2f4c06df97bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2ce5e9f9a4644b27a24b2f4c06df97bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2ce5e9f9a4644b27a24b2f4c06df97bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2ce5e9f9a4644b27a24b2f4c06df97bc", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:36:10.593195 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ServerRescueNegativeTestJSON-684190061 Oct 19 03:36:10.593195 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 2ce5e9f9a4644b27a24b2f4c06df97bc Oct 19 03:36:10.593195 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-684190061 Oct 19 03:36:10.593195 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ServerRescueNegativeTestJSON-684190061-project Oct 19 03:36:10.593195 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:36:10.593195 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:36:10.593195 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: b4729a0afd69480f99642266e0eec17e Oct 19 03:36:10.593195 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ServerRescueNegativeTestJSON-684190061-project Oct 19 03:36:10.593195 n-d-861333-8 devstack@n-api.service[121134]: Oct 19 03:36:10.593195 n-d-861333-8 devstack@n-api.service[121134]: {"rescue": {}} Oct 19 03:36:10.593195 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:36:10.593195 n-d-861333-8 devstack@n-api.service[121134]: exception: Cannot 'rescue' instance 8955f425-23eb-423e-8ed4-eea1bd5dbc08 while it is in vm_state paused Oct 19 03:36:10.593195 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '8955f425-23eb-423e-8ed4-eea1bd5dbc08', 'body': {'rescue': {}}} Oct 19 03:36:10.593195 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:36:10.593195 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:36:10.593195 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Oct 19 03:36:10.593195 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Oct 19 03:36:10.593195 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 19 03:36:10.593195 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 19 03:36:10.593195 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 19 03:36:10.593195 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 19 03:36:10.593195 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 19 03:36:10.593195 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 19 03:36:10.593195 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8955f425-23eb-423e-8ed4-eea1bd5dbc08 in vm_state paused. Cannot rescue while the instance is in this state. Oct 19 03:36:10.593195 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:36:10.593195 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:36:10.593195 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:36:10.593195 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:36:10.593195 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:36:10.593195 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:36:10.593195 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:36:10.593195 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:36:10.593195 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:36:10.593195 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:36:10.593195 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:36:10.593195 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:36:10.593195 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Oct 19 03:36:10.593195 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 19 03:36:10.593195 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 19 03:36:10.593195 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 19 03:36:10.593195 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance 8955f425-23eb-423e-8ed4-eea1bd5dbc08 while it is in vm_state paused Oct 19 03:36:10.593195 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:36:10.600033 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:36:10.600033 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:36:10.600033 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:36:10.600033 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:36:10.600033 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:36:10.600033 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:36:10.600033 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:36:10.600033 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance 8955f425-23eb-423e-8ed4-eea1bd5dbc08 while it is in vm_state paused Oct 19 03:36:10.600033 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:36:10.600033 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-79d4ab6f-6cd1-40e6-a6b4-867fba98bcea tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Returning 409 to user: Cannot 'rescue' instance 8955f425-23eb-423e-8ed4-eea1bd5dbc08 while it is in vm_state paused {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:36:10.603951 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-79d4ab6f-6cd1-40e6-a6b4-867fba98bcea tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "POST /compute/v2.1/servers/8955f425-23eb-423e-8ed4-eea1bd5dbc08/action" status: 409 len: 144 microversion: 2.1 time: 0.134685 Oct 19 03:36:10.609679 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2428/4930] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:36:10 2022] POST /compute/v2.1/servers/8955f425-23eb-423e-8ed4-eea1bd5dbc08/action => generated 144 bytes in 142 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 19 03:36:10.616113 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e62e5822-0ba5-4b74-a144-0a98450cfdf9 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:36:10.617034 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e62e5822-0ba5-4b74-a144-0a98450cfdf9 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 8955f425-23eb-423e-8ed4-eea1bd5dbc08] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:10.625986 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e62e5822-0ba5-4b74-a144-0a98450cfdf9 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:10.626920 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e62e5822-0ba5-4b74-a144-0a98450cfdf9 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:10.627608 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e62e5822-0ba5-4b74-a144-0a98450cfdf9 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:10.629033 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e62e5822-0ba5-4b74-a144-0a98450cfdf9 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:10.630373 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e62e5822-0ba5-4b74-a144-0a98450cfdf9 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:10.631138 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e62e5822-0ba5-4b74-a144-0a98450cfdf9 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:10.675035 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-9761dca9-87c5-4757-a075-a47e6aa5cfec tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:10.684123 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9761dca9-87c5-4757-a075-a47e6aa5cfec tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1680 microversion: 2.1 time: 0.345850 Oct 19 03:36:10.691954 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2503/4931] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:10 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1680 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:36:10.805006 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2962030b-c736-445c-a679-0e05642381fe tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:10.806379 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-2962030b-c736-445c-a679-0e05642381fe tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] [instance: ddbf7afb-1d7b-4d33-b6fb-1f1608c11985] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:10.829153 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2962030b-c736-445c-a679-0e05642381fe tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:10.830084 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2962030b-c736-445c-a679-0e05642381fe tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:10.830796 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2962030b-c736-445c-a679-0e05642381fe tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:10.831755 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2962030b-c736-445c-a679-0e05642381fe tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:10.832904 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2962030b-c736-445c-a679-0e05642381fe tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:10.833571 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2962030b-c736-445c-a679-0e05642381fe tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:10.924390 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e62e5822-0ba5-4b74-a144-0a98450cfdf9 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "POST /compute/v2.1/servers/8955f425-23eb-423e-8ed4-eea1bd5dbc08/action" status: 202 len: 0 microversion: 2.1 time: 0.312157 Oct 19 03:36:10.924844 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2429/4932] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:36:10 2022] POST /compute/v2.1/servers/8955f425-23eb-423e-8ed4-eea1bd5dbc08/action => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:36:10.960684 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c39abf6f-e9b8-47ab-904e-b57cb77518b0 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:10.965079 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c39abf6f-e9b8-47ab-904e-b57cb77518b0 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 8955f425-23eb-423e-8ed4-eea1bd5dbc08] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:10.975001 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c39abf6f-e9b8-47ab-904e-b57cb77518b0 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:10.975743 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c39abf6f-e9b8-47ab-904e-b57cb77518b0 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:10.976460 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c39abf6f-e9b8-47ab-904e-b57cb77518b0 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:10.977514 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c39abf6f-e9b8-47ab-904e-b57cb77518b0 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:10.978131 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c39abf6f-e9b8-47ab-904e-b57cb77518b0 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:10.980333 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c39abf6f-e9b8-47ab-904e-b57cb77518b0 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:11.315321 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c39abf6f-e9b8-47ab-904e-b57cb77518b0 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4729a0afd69480f99642266e0eec17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce5e9f9a4644b27a24b2f4c06df97bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:11.317071 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-2962030b-c736-445c-a679-0e05642381fe tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c65a497e16e4e41b5cf1287042f3a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4001edd1474947a94243a620a6013a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:11.329418 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2962030b-c736-445c-a679-0e05642381fe tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] 10.222.0.52 "GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985" status: 200 len: 1722 microversion: 2.1 time: 0.528966 Oct 19 03:36:11.331717 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c39abf6f-e9b8-47ab-904e-b57cb77518b0 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/8955f425-23eb-423e-8ed4-eea1bd5dbc08" status: 200 len: 1509 microversion: 2.1 time: 0.388156 Oct 19 03:36:11.334320 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2430/4933] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:10 2022] GET /compute/v2.1/servers/8955f425-23eb-423e-8ed4-eea1bd5dbc08 => generated 1509 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:36:11.352913 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2504/4934] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:10 2022] GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985 => generated 1722 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:36:11.651402 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5e2655b9-0fcb-414d-b9cc-3963972e72fc tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:11.651740 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5e2655b9-0fcb-414d-b9cc-3963972e72fc tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] [instance: 4bc45105-f45f-4240-bd2a-9da8a5e5118b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:11.663620 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5e2655b9-0fcb-414d-b9cc-3963972e72fc tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:11.663832 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5e2655b9-0fcb-414d-b9cc-3963972e72fc tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:11.664196 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5e2655b9-0fcb-414d-b9cc-3963972e72fc tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:11.675840 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5e2655b9-0fcb-414d-b9cc-3963972e72fc tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:11.676595 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5e2655b9-0fcb-414d-b9cc-3963972e72fc tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:11.680596 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5e2655b9-0fcb-414d-b9cc-3963972e72fc tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:11.711876 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6d3875b5-3bd6-4201-a445-5b2a19e49175 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:11.711876 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6d3875b5-3bd6-4201-a445-5b2a19e49175 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:11.723977 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6d3875b5-3bd6-4201-a445-5b2a19e49175 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:11.724477 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6d3875b5-3bd6-4201-a445-5b2a19e49175 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:11.725017 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6d3875b5-3bd6-4201-a445-5b2a19e49175 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:11.725758 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6d3875b5-3bd6-4201-a445-5b2a19e49175 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:11.726226 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6d3875b5-3bd6-4201-a445-5b2a19e49175 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:11.726654 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6d3875b5-3bd6-4201-a445-5b2a19e49175 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:11.735237 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5e2655b9-0fcb-414d-b9cc-3963972e72fc tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] [instance: 4bc45105-f45f-4240-bd2a-9da8a5e5118b] Going to try to terminate instance {{(pid=121134) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:36:12.099703 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-6d3875b5-3bd6-4201-a445-5b2a19e49175 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:12.103740 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:36:12.114256 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6d3875b5-3bd6-4201-a445-5b2a19e49175 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1680 microversion: 2.1 time: 0.407575 Oct 19 03:36:12.125944 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2505/4935] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:11 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1680 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:36:12.167282 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5e2655b9-0fcb-414d-b9cc-3963972e72fc tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] 10.222.0.52 "DELETE /compute/v2.1/servers/4bc45105-f45f-4240-bd2a-9da8a5e5118b" status: 204 len: 0 microversion: 2.1 time: 0.520221 Oct 19 03:36:12.169259 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2431/4936] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:36:11 2022] DELETE /compute/v2.1/servers/4bc45105-f45f-4240-bd2a-9da8a5e5118b => generated 0 bytes in 523 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:36:12.178739 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-bb7bd310-4d30-43f4-b046-9b17f185aa28 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:12.178739 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-bb7bd310-4d30-43f4-b046-9b17f185aa28 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] [instance: 4bc45105-f45f-4240-bd2a-9da8a5e5118b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:12.208369 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bb7bd310-4d30-43f4-b046-9b17f185aa28 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:12.209141 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bb7bd310-4d30-43f4-b046-9b17f185aa28 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:12.211179 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bb7bd310-4d30-43f4-b046-9b17f185aa28 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:12.215628 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bb7bd310-4d30-43f4-b046-9b17f185aa28 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:12.216201 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bb7bd310-4d30-43f4-b046-9b17f185aa28 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:12.216729 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bb7bd310-4d30-43f4-b046-9b17f185aa28 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:12.361767 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2eac4735-4fe3-46f2-b48b-105fcd2729be tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:12.367692 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2eac4735-4fe3-46f2-b48b-105fcd2729be tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 8955f425-23eb-423e-8ed4-eea1bd5dbc08] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:12.369879 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2eac4735-4fe3-46f2-b48b-105fcd2729be tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:12.370633 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2eac4735-4fe3-46f2-b48b-105fcd2729be tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:12.371885 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2eac4735-4fe3-46f2-b48b-105fcd2729be tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:12.372849 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2eac4735-4fe3-46f2-b48b-105fcd2729be tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:12.373684 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2eac4735-4fe3-46f2-b48b-105fcd2729be tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:12.374356 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2eac4735-4fe3-46f2-b48b-105fcd2729be tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:12.695423 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-bb7bd310-4d30-43f4-b046-9b17f185aa28 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab48b332e534992a5bfa32168c2bb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1c0b7015a5430c831865ab53a3006e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:12.703894 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-bb7bd310-4d30-43f4-b046-9b17f185aa28 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] 10.222.0.52 "GET /compute/v2.1/servers/4bc45105-f45f-4240-bd2a-9da8a5e5118b" status: 200 len: 1505 microversion: 2.1 time: 0.530172 Oct 19 03:36:12.704524 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2506/4937] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:12 2022] GET /compute/v2.1/servers/4bc45105-f45f-4240-bd2a-9da8a5e5118b => generated 1505 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:36:12.719162 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-87ba18cb-7d2d-4e2a-9c18-964d63a82451 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:12.719162 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-87ba18cb-7d2d-4e2a-9c18-964d63a82451 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] [instance: ddbf7afb-1d7b-4d33-b6fb-1f1608c11985] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:12.727400 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-87ba18cb-7d2d-4e2a-9c18-964d63a82451 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:12.727974 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-87ba18cb-7d2d-4e2a-9c18-964d63a82451 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:12.728428 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-87ba18cb-7d2d-4e2a-9c18-964d63a82451 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:12.729167 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-87ba18cb-7d2d-4e2a-9c18-964d63a82451 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:12.729683 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-87ba18cb-7d2d-4e2a-9c18-964d63a82451 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:12.730204 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-87ba18cb-7d2d-4e2a-9c18-964d63a82451 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:12.873294 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-2eac4735-4fe3-46f2-b48b-105fcd2729be tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4729a0afd69480f99642266e0eec17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce5e9f9a4644b27a24b2f4c06df97bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:12.890172 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2eac4735-4fe3-46f2-b48b-105fcd2729be tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/8955f425-23eb-423e-8ed4-eea1bd5dbc08" status: 200 len: 1517 microversion: 2.1 time: 0.538267 Oct 19 03:36:12.909878 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2432/4938] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:12 2022] GET /compute/v2.1/servers/8955f425-23eb-423e-8ed4-eea1bd5dbc08 => generated 1517 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:36:12.977116 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-87ba18cb-7d2d-4e2a-9c18-964d63a82451 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c65a497e16e4e41b5cf1287042f3a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4001edd1474947a94243a620a6013a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:12.989853 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-87ba18cb-7d2d-4e2a-9c18-964d63a82451 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] 10.222.0.52 "GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985" status: 200 len: 1722 microversion: 2.1 time: 0.284232 Oct 19 03:36:12.991260 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2507/4939] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:12 2022] GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985 => generated 1722 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:36:13.139271 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-42e25ac0-2224-4182-84d4-cbab7c51ea21 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:13.144338 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-42e25ac0-2224-4182-84d4-cbab7c51ea21 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:13.147308 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-42e25ac0-2224-4182-84d4-cbab7c51ea21 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:13.147809 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-42e25ac0-2224-4182-84d4-cbab7c51ea21 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:13.148251 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-42e25ac0-2224-4182-84d4-cbab7c51ea21 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:13.149007 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-42e25ac0-2224-4182-84d4-cbab7c51ea21 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:13.149534 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-42e25ac0-2224-4182-84d4-cbab7c51ea21 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:13.149970 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-42e25ac0-2224-4182-84d4-cbab7c51ea21 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:13.354743 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-42e25ac0-2224-4182-84d4-cbab7c51ea21 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:13.365194 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-42e25ac0-2224-4182-84d4-cbab7c51ea21 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1680 microversion: 2.1 time: 0.231246 Oct 19 03:36:13.369666 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2433/4940] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:13 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1680 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:36:13.735277 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f2c05786-13b8-4d5d-8a4c-d3ea328ab6ae tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:13.740479 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f2c05786-13b8-4d5d-8a4c-d3ea328ab6ae tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] [instance: 4bc45105-f45f-4240-bd2a-9da8a5e5118b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:13.764689 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f2c05786-13b8-4d5d-8a4c-d3ea328ab6ae tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:13.765233 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f2c05786-13b8-4d5d-8a4c-d3ea328ab6ae tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:13.765691 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f2c05786-13b8-4d5d-8a4c-d3ea328ab6ae tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:13.766422 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f2c05786-13b8-4d5d-8a4c-d3ea328ab6ae tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:13.766888 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f2c05786-13b8-4d5d-8a4c-d3ea328ab6ae tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:13.767321 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f2c05786-13b8-4d5d-8a4c-d3ea328ab6ae tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:14.015011 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-88794a4a-ad2f-402f-a29a-22d907084af7 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:14.016184 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-88794a4a-ad2f-402f-a29a-22d907084af7 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] [instance: ddbf7afb-1d7b-4d33-b6fb-1f1608c11985] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:14.023383 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-88794a4a-ad2f-402f-a29a-22d907084af7 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:14.024228 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-88794a4a-ad2f-402f-a29a-22d907084af7 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:14.024891 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-88794a4a-ad2f-402f-a29a-22d907084af7 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:14.026533 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-88794a4a-ad2f-402f-a29a-22d907084af7 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:14.027703 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-88794a4a-ad2f-402f-a29a-22d907084af7 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:14.028449 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-88794a4a-ad2f-402f-a29a-22d907084af7 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:14.050854 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:36:14.110727 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f2c05786-13b8-4d5d-8a4c-d3ea328ab6ae tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab48b332e534992a5bfa32168c2bb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1c0b7015a5430c831865ab53a3006e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:14.119930 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f2c05786-13b8-4d5d-8a4c-d3ea328ab6ae tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] 10.222.0.52 "GET /compute/v2.1/servers/4bc45105-f45f-4240-bd2a-9da8a5e5118b" status: 200 len: 1505 microversion: 2.1 time: 0.392000 Oct 19 03:36:14.142661 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2508/4941] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:13 2022] GET /compute/v2.1/servers/4bc45105-f45f-4240-bd2a-9da8a5e5118b => generated 1505 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:36:14.297445 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-88794a4a-ad2f-402f-a29a-22d907084af7 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c65a497e16e4e41b5cf1287042f3a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4001edd1474947a94243a620a6013a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:14.307754 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-88794a4a-ad2f-402f-a29a-22d907084af7 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] 10.222.0.52 "GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985" status: 200 len: 1722 microversion: 2.1 time: 0.295959 Oct 19 03:36:14.307754 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2434/4942] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:14 2022] GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985 => generated 1722 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:36:14.397915 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4d72a98e-406a-4afb-96bb-a6862cbe17ae tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:14.398815 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4d72a98e-406a-4afb-96bb-a6862cbe17ae tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:14.407590 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4d72a98e-406a-4afb-96bb-a6862cbe17ae tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:14.408404 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4d72a98e-406a-4afb-96bb-a6862cbe17ae tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:14.409025 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4d72a98e-406a-4afb-96bb-a6862cbe17ae tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:14.409956 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4d72a98e-406a-4afb-96bb-a6862cbe17ae tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:14.410617 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4d72a98e-406a-4afb-96bb-a6862cbe17ae tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:14.411242 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4d72a98e-406a-4afb-96bb-a6862cbe17ae tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:14.657898 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4d72a98e-406a-4afb-96bb-a6862cbe17ae tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:14.672144 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4d72a98e-406a-4afb-96bb-a6862cbe17ae tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1680 microversion: 2.1 time: 0.277891 Oct 19 03:36:14.680742 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2509/4943] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:14 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1680 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:36:15.150591 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-37803cc9-d399-41fd-9061-8837833e8ee5 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:15.153892 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-37803cc9-d399-41fd-9061-8837833e8ee5 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] [instance: 4bc45105-f45f-4240-bd2a-9da8a5e5118b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:15.174782 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-37803cc9-d399-41fd-9061-8837833e8ee5 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:15.175657 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-37803cc9-d399-41fd-9061-8837833e8ee5 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:15.178860 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-37803cc9-d399-41fd-9061-8837833e8ee5 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:15.182666 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-37803cc9-d399-41fd-9061-8837833e8ee5 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:15.182666 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-37803cc9-d399-41fd-9061-8837833e8ee5 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:15.185053 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-37803cc9-d399-41fd-9061-8837833e8ee5 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:15.331149 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c1b81bf4-73f6-4685-b5c7-802210b96001 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:15.331776 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c1b81bf4-73f6-4685-b5c7-802210b96001 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] [instance: ddbf7afb-1d7b-4d33-b6fb-1f1608c11985] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:15.351887 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c1b81bf4-73f6-4685-b5c7-802210b96001 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:15.352437 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c1b81bf4-73f6-4685-b5c7-802210b96001 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:15.352898 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c1b81bf4-73f6-4685-b5c7-802210b96001 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:15.353675 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c1b81bf4-73f6-4685-b5c7-802210b96001 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:15.354077 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c1b81bf4-73f6-4685-b5c7-802210b96001 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:15.354598 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c1b81bf4-73f6-4685-b5c7-802210b96001 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:15.406988 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-37803cc9-d399-41fd-9061-8837833e8ee5 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab48b332e534992a5bfa32168c2bb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1c0b7015a5430c831865ab53a3006e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:15.428882 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-37803cc9-d399-41fd-9061-8837833e8ee5 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] 10.222.0.52 "GET /compute/v2.1/servers/4bc45105-f45f-4240-bd2a-9da8a5e5118b" status: 200 len: 1505 microversion: 2.1 time: 0.280143 Oct 19 03:36:15.444185 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2435/4944] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:15 2022] GET /compute/v2.1/servers/4bc45105-f45f-4240-bd2a-9da8a5e5118b => generated 1505 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:36:15.647504 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-59e374f7-edce-4125-ab43-9f8c802a832f req-cb01a4d6-17bf-4e2d-93e9-cece98046126 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bc45105-f45f-4240-bd2a-9da8a5e5118b", "name": "network-vif-deleted", "tag": "ecaf169e-f46b-4198-bb48-b54112886170"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:36:15.660611 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c1b81bf4-73f6-4685-b5c7-802210b96001 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c65a497e16e4e41b5cf1287042f3a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4001edd1474947a94243a620a6013a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:15.667664 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-59e374f7-edce-4125-ab43-9f8c802a832f req-cb01a4d6-17bf-4e2d-93e9-cece98046126 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:15.668723 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-59e374f7-edce-4125-ab43-9f8c802a832f req-cb01a4d6-17bf-4e2d-93e9-cece98046126 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:15.669165 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-59e374f7-edce-4125-ab43-9f8c802a832f req-cb01a4d6-17bf-4e2d-93e9-cece98046126 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:15.672828 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c1b81bf4-73f6-4685-b5c7-802210b96001 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] 10.222.0.52 "GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985" status: 200 len: 1722 microversion: 2.1 time: 0.344867 Oct 19 03:36:15.689398 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2510/4945] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:15 2022] GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985 => generated 1722 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:36:15.697839 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-59e374f7-edce-4125-ab43-9f8c802a832f req-cb01a4d6-17bf-4e2d-93e9-cece98046126 service nova] Creating event network-vif-deleted:ecaf169e-f46b-4198-bb48-b54112886170 for instance 4bc45105-f45f-4240-bd2a-9da8a5e5118b on n-h1-861333-8 Oct 19 03:36:15.705198 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-815f82b3-4c60-4ed8-9f80-f39cff603217 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:15.707974 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-815f82b3-4c60-4ed8-9f80-f39cff603217 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:15.715256 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-59e374f7-edce-4125-ab43-9f8c802a832f req-cb01a4d6-17bf-4e2d-93e9-cece98046126 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076924 Oct 19 03:36:15.716102 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2436/4946] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:36:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:36:15.717236 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-815f82b3-4c60-4ed8-9f80-f39cff603217 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:15.718055 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-815f82b3-4c60-4ed8-9f80-f39cff603217 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:15.718642 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-815f82b3-4c60-4ed8-9f80-f39cff603217 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:15.719373 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-815f82b3-4c60-4ed8-9f80-f39cff603217 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:15.719913 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-815f82b3-4c60-4ed8-9f80-f39cff603217 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:15.720310 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-815f82b3-4c60-4ed8-9f80-f39cff603217 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:15.912814 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-815f82b3-4c60-4ed8-9f80-f39cff603217 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:15.925465 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-815f82b3-4c60-4ed8-9f80-f39cff603217 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1680 microversion: 2.1 time: 0.224373 Oct 19 03:36:15.941431 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2511/4947] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:15 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1680 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:36:15.976257 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-31699c5f-4b11-4e81-b121-600cd46e4feb tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:36:15.978819 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-31699c5f-4b11-4e81-b121-600cd46e4feb tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 8955f425-23eb-423e-8ed4-eea1bd5dbc08] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:15.986479 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-31699c5f-4b11-4e81-b121-600cd46e4feb tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:15.987030 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-31699c5f-4b11-4e81-b121-600cd46e4feb tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:15.987506 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-31699c5f-4b11-4e81-b121-600cd46e4feb tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:15.988202 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-31699c5f-4b11-4e81-b121-600cd46e4feb tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:15.988829 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-31699c5f-4b11-4e81-b121-600cd46e4feb tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:15.989265 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-31699c5f-4b11-4e81-b121-600cd46e4feb tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:16.013138 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-31699c5f-4b11-4e81-b121-600cd46e4feb tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lazy-loading 'flavor' on Instance uuid 8955f425-23eb-423e-8ed4-eea1bd5dbc08 {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:36:16.318215 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-31699c5f-4b11-4e81-b121-600cd46e4feb tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "POST /compute/v2.1/servers/8955f425-23eb-423e-8ed4-eea1bd5dbc08/action" status: 200 len: 32 microversion: 2.1 time: 0.345898 Oct 19 03:36:16.319927 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2437/4948] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:36:15 2022] POST /compute/v2.1/servers/8955f425-23eb-423e-8ed4-eea1bd5dbc08/action => generated 32 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 03:36:16.329250 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-155289e4-ad5d-481a-a979-14cf2387219a tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:16.330139 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-155289e4-ad5d-481a-a979-14cf2387219a tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 8955f425-23eb-423e-8ed4-eea1bd5dbc08] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:16.338563 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-155289e4-ad5d-481a-a979-14cf2387219a tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:16.339203 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-155289e4-ad5d-481a-a979-14cf2387219a tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:16.339487 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-155289e4-ad5d-481a-a979-14cf2387219a tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:16.340721 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-155289e4-ad5d-481a-a979-14cf2387219a tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:16.341179 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-155289e4-ad5d-481a-a979-14cf2387219a tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:16.341791 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-155289e4-ad5d-481a-a979-14cf2387219a tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:16.456954 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a3fe55a7-8239-4437-969d-55d961924f84 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:16.458408 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a3fe55a7-8239-4437-969d-55d961924f84 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] [instance: 4bc45105-f45f-4240-bd2a-9da8a5e5118b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:16.468238 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a3fe55a7-8239-4437-969d-55d961924f84 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:16.468967 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a3fe55a7-8239-4437-969d-55d961924f84 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:16.470500 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a3fe55a7-8239-4437-969d-55d961924f84 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:16.471755 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a3fe55a7-8239-4437-969d-55d961924f84 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:16.472976 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a3fe55a7-8239-4437-969d-55d961924f84 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:16.473687 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a3fe55a7-8239-4437-969d-55d961924f84 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:16.534962 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-155289e4-ad5d-481a-a979-14cf2387219a tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4729a0afd69480f99642266e0eec17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce5e9f9a4644b27a24b2f4c06df97bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:16.545346 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-155289e4-ad5d-481a-a979-14cf2387219a tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/8955f425-23eb-423e-8ed4-eea1bd5dbc08" status: 200 len: 1523 microversion: 2.1 time: 0.217261 Oct 19 03:36:16.550379 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2512/4949] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:16 2022] GET /compute/v2.1/servers/8955f425-23eb-423e-8ed4-eea1bd5dbc08 => generated 1523 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:36:16.699709 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0b41b2fe-dc7c-4f2d-99f4-62a69cf43e90 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:16.700534 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0b41b2fe-dc7c-4f2d-99f4-62a69cf43e90 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] [instance: ddbf7afb-1d7b-4d33-b6fb-1f1608c11985] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:16.711661 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0b41b2fe-dc7c-4f2d-99f4-62a69cf43e90 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:16.712335 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0b41b2fe-dc7c-4f2d-99f4-62a69cf43e90 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:16.713102 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0b41b2fe-dc7c-4f2d-99f4-62a69cf43e90 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:16.715875 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0b41b2fe-dc7c-4f2d-99f4-62a69cf43e90 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:16.717103 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0b41b2fe-dc7c-4f2d-99f4-62a69cf43e90 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:16.718082 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0b41b2fe-dc7c-4f2d-99f4-62a69cf43e90 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:16.783761 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:36:16.787880 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a3fe55a7-8239-4437-969d-55d961924f84 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:16.793029 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a3fe55a7-8239-4437-969d-55d961924f84 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:16.793029 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a3fe55a7-8239-4437-969d-55d961924f84 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:16.793029 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-a3fe55a7-8239-4437-969d-55d961924f84 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lazy-loading 'fault' on Instance uuid 4bc45105-f45f-4240-bd2a-9da8a5e5118b {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:36:16.914966 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a3fe55a7-8239-4437-969d-55d961924f84 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab48b332e534992a5bfa32168c2bb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1c0b7015a5430c831865ab53a3006e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:16.924723 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a3fe55a7-8239-4437-969d-55d961924f84 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] 10.222.0.52 "GET /compute/v2.1/servers/4bc45105-f45f-4240-bd2a-9da8a5e5118b" status: 200 len: 1304 microversion: 2.1 time: 0.472066 Oct 19 03:36:16.942044 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2438/4950] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:16 2022] GET /compute/v2.1/servers/4bc45105-f45f-4240-bd2a-9da8a5e5118b => generated 1304 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:36:16.949805 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c0fcc8c0-f0b3-45c8-a6b0-8ec6bf4e1ab9 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:16.950425 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c0fcc8c0-f0b3-45c8-a6b0-8ec6bf4e1ab9 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:16.956413 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c0fcc8c0-f0b3-45c8-a6b0-8ec6bf4e1ab9 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:16.956897 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c0fcc8c0-f0b3-45c8-a6b0-8ec6bf4e1ab9 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:16.957338 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c0fcc8c0-f0b3-45c8-a6b0-8ec6bf4e1ab9 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:16.958076 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c0fcc8c0-f0b3-45c8-a6b0-8ec6bf4e1ab9 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:16.958598 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c0fcc8c0-f0b3-45c8-a6b0-8ec6bf4e1ab9 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:16.965164 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c0fcc8c0-f0b3-45c8-a6b0-8ec6bf4e1ab9 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:17.137269 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-0b41b2fe-dc7c-4f2d-99f4-62a69cf43e90 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c65a497e16e4e41b5cf1287042f3a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4001edd1474947a94243a620a6013a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:17.146009 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0b41b2fe-dc7c-4f2d-99f4-62a69cf43e90 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] 10.222.0.52 "GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985" status: 200 len: 1722 microversion: 2.1 time: 0.450876 Oct 19 03:36:17.146601 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2513/4951] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:16 2022] GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985 => generated 1722 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:36:17.226263 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c0fcc8c0-f0b3-45c8-a6b0-8ec6bf4e1ab9 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:17.235016 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c0fcc8c0-f0b3-45c8-a6b0-8ec6bf4e1ab9 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1680 microversion: 2.1 time: 0.289181 Oct 19 03:36:17.235682 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2439/4952] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:16 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1680 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:36:17.572466 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c29a2090-3458-45b5-bf70-53acdcf434aa tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:17.574603 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c29a2090-3458-45b5-bf70-53acdcf434aa tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 8955f425-23eb-423e-8ed4-eea1bd5dbc08] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:17.581697 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c29a2090-3458-45b5-bf70-53acdcf434aa tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:17.582190 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c29a2090-3458-45b5-bf70-53acdcf434aa tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:17.582787 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c29a2090-3458-45b5-bf70-53acdcf434aa tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:17.583504 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c29a2090-3458-45b5-bf70-53acdcf434aa tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:17.583957 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c29a2090-3458-45b5-bf70-53acdcf434aa tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:17.584381 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c29a2090-3458-45b5-bf70-53acdcf434aa tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:17.959531 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-840f5008-7aa4-4170-ab46-15fe23e761d0 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:17.964169 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-840f5008-7aa4-4170-ab46-15fe23e761d0 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] [instance: 4bc45105-f45f-4240-bd2a-9da8a5e5118b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:17.971176 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-840f5008-7aa4-4170-ab46-15fe23e761d0 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:17.971650 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-840f5008-7aa4-4170-ab46-15fe23e761d0 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:17.972811 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-840f5008-7aa4-4170-ab46-15fe23e761d0 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:17.973740 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-840f5008-7aa4-4170-ab46-15fe23e761d0 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:17.974360 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-840f5008-7aa4-4170-ab46-15fe23e761d0 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:17.979153 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-840f5008-7aa4-4170-ab46-15fe23e761d0 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:17.982935 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c29a2090-3458-45b5-bf70-53acdcf434aa tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4729a0afd69480f99642266e0eec17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce5e9f9a4644b27a24b2f4c06df97bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:17.990191 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-840f5008-7aa4-4170-ab46-15fe23e761d0 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] HTTP exception thrown: Instance 4bc45105-f45f-4240-bd2a-9da8a5e5118b could not be found. Oct 19 03:36:17.991687 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c29a2090-3458-45b5-bf70-53acdcf434aa tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/8955f425-23eb-423e-8ed4-eea1bd5dbc08" status: 200 len: 1523 microversion: 2.1 time: 0.423312 Oct 19 03:36:17.991859 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-840f5008-7aa4-4170-ab46-15fe23e761d0 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Request method failure captured: Oct 19 03:36:17.991859 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/4bc45105-f45f-4240-bd2a-9da8a5e5118b HTTP/1.1 Oct 19 03:36:17.991859 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:36:17.991859 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:36:17.991859 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:36:17.991859 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:36:17.991859 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:36:17.991859 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:36:17.991859 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:36:17.991859 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:36:17.991859 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3CPqHO32whUtQW32WYKcvyEuLRPBQLRLWZg6UyqGC5OT-X-SLALdOGUebjEB1XUWSQgecMXmJxSdBocuPt5hNS896vXPx6oLnh_L1q3W-vXtA_CT_d3TPWsDmTAt6-IMDZ8vuDaPaVeW76JqkYOG9YF9tyfzxCJ1gWHuJEd7I4eOdY Oct 19 03:36:17.991859 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:36:17.991859 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:36:17.991859 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:36:17.991859 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:36:17.991859 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:36:17.991859 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:36:17.991859 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 5e1c0b7015a5430c831865ab53a3006e Oct 19 03:36:17.991859 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-VolumesActionsTest-224645505 Oct 19 03:36:17.991859 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:36:17.991859 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:36:17.991859 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5e1c0b7015a5430c831865ab53a3006e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5e1c0b7015a5430c831865ab53a3006e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5e1c0b7015a5430c831865ab53a3006e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5e1c0b7015a5430c831865ab53a3006e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:36:17.991859 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-VolumesActionsTest-224645505 Oct 19 03:36:17.991859 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 5e1c0b7015a5430c831865ab53a3006e Oct 19 03:36:17.991859 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-VolumesActionsTest-224645505 Oct 19 03:36:17.991859 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-VolumesActionsTest-224645505-project Oct 19 03:36:17.991859 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:36:17.991859 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:36:17.991859 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 1ab48b332e534992a5bfa32168c2bb6d Oct 19 03:36:17.991859 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-VolumesActionsTest-224645505-project Oct 19 03:36:17.991859 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:36:17.991859 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance 4bc45105-f45f-4240-bd2a-9da8a5e5118b could not be found. Oct 19 03:36:17.991859 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '4bc45105-f45f-4240-bd2a-9da8a5e5118b'} Oct 19 03:36:17.991859 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:36:17.991859 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:36:17.991859 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:36:17.991859 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:36:17.991859 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:36:17.991859 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:36:17.991859 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:36:17.991859 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:36:17.991859 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:36:17.991859 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:36:17.991859 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4bc45105-f45f-4240-bd2a-9da8a5e5118b could not be found. Oct 19 03:36:17.991859 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:36:17.991859 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:36:17.991859 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:36:17.991859 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:36:17.991859 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:36:17.991859 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:36:17.991859 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:36:17.991859 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:36:17.991859 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:36:17.991859 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:36:17.991859 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:36:17.991859 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:36:17.991859 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:36:17.991859 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:36:17.991859 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:36:17.991859 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:36:17.991859 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4bc45105-f45f-4240-bd2a-9da8a5e5118b could not be found. Oct 19 03:36:17.991859 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:36:17.991859 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:36:17.991859 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:36:17.996828 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:36:17.996828 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:36:17.996828 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:36:17.996828 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:36:17.996828 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:36:17.996828 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4bc45105-f45f-4240-bd2a-9da8a5e5118b could not be found. Oct 19 03:36:17.996828 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:36:17.996828 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-840f5008-7aa4-4170-ab46-15fe23e761d0 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Returning 404 to user: Instance 4bc45105-f45f-4240-bd2a-9da8a5e5118b could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:36:17.996828 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-840f5008-7aa4-4170-ab46-15fe23e761d0 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] 10.222.0.52 "GET /compute/v2.1/servers/4bc45105-f45f-4240-bd2a-9da8a5e5118b" status: 404 len: 111 microversion: 2.1 time: 0.045146 Oct 19 03:36:17.996828 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2440/4953] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:17 2022] GET /compute/v2.1/servers/4bc45105-f45f-4240-bd2a-9da8a5e5118b => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:36:18.001783 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2514/4954] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:17 2022] GET /compute/v2.1/servers/8955f425-23eb-423e-8ed4-eea1bd5dbc08 => generated 1523 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:36:18.100555 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-bf6227cd-e1e3-416d-9cd3-76b65dd506dc tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2061604584", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "networks": [{"uuid": "26b53b4a-b6d3-4ee1-8686-7885ab4fdecb"}]}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:36:18.156845 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-bf6227cd-e1e3-416d-9cd3-76b65dd506dc tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] validate_networks() for [('26b53b4a-b6d3-4ee1-8686-7885ab4fdecb', None, None, None, None, None)] {{(pid=121134) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:36:18.170749 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-8977844b-d0bf-4813-a8d1-3e96783023e2 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:18.171439 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-8977844b-d0bf-4813-a8d1-3e96783023e2 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] [instance: ddbf7afb-1d7b-4d33-b6fb-1f1608c11985] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:18.177873 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8977844b-d0bf-4813-a8d1-3e96783023e2 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:18.178488 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8977844b-d0bf-4813-a8d1-3e96783023e2 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:18.179176 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8977844b-d0bf-4813-a8d1-3e96783023e2 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:18.179983 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8977844b-d0bf-4813-a8d1-3e96783023e2 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:18.180560 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8977844b-d0bf-4813-a8d1-3e96783023e2 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:18.181196 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8977844b-d0bf-4813-a8d1-3e96783023e2 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:18.400453 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-8977844b-d0bf-4813-a8d1-3e96783023e2 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c65a497e16e4e41b5cf1287042f3a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4001edd1474947a94243a620a6013a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:18.416893 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-8977844b-d0bf-4813-a8d1-3e96783023e2 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] 10.222.0.52 "GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985" status: 200 len: 1722 microversion: 2.1 time: 0.251058 Oct 19 03:36:18.425310 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2515/4955] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:18 2022] GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985 => generated 1722 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:36:18.439042 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c37b0580-339e-4fec-82e9-a3adddf15981 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:18.440493 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c37b0580-339e-4fec-82e9-a3adddf15981 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:18.441585 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:36:18.452218 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c37b0580-339e-4fec-82e9-a3adddf15981 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:18.452719 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c37b0580-339e-4fec-82e9-a3adddf15981 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:18.453162 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c37b0580-339e-4fec-82e9-a3adddf15981 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:18.454363 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c37b0580-339e-4fec-82e9-a3adddf15981 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:18.454833 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c37b0580-339e-4fec-82e9-a3adddf15981 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:18.455271 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c37b0580-339e-4fec-82e9-a3adddf15981 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:18.677590 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c37b0580-339e-4fec-82e9-a3adddf15981 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:18.687344 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c37b0580-339e-4fec-82e9-a3adddf15981 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1680 microversion: 2.1 time: 0.258036 Oct 19 03:36:18.689234 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2516/4956] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:18 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1680 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:36:18.796088 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-bf6227cd-e1e3-416d-9cd3-76b65dd506dc tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Flavor limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:36:18.796764 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-bf6227cd-e1e3-416d-9cd3-76b65dd506dc tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Image limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:36:18.797621 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-bf6227cd-e1e3-416d-9cd3-76b65dd506dc tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Flavor pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:36:18.798359 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-bf6227cd-e1e3-416d-9cd3-76b65dd506dc tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Image pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:36:18.799447 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-bf6227cd-e1e3-416d-9cd3-76b65dd506dc tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:36:18.811408 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bf6227cd-e1e3-416d-9cd3-76b65dd506dc tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:18.812184 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bf6227cd-e1e3-416d-9cd3-76b65dd506dc tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:18.812683 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bf6227cd-e1e3-416d-9cd3-76b65dd506dc tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:18.813544 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bf6227cd-e1e3-416d-9cd3-76b65dd506dc tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:18.814082 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bf6227cd-e1e3-416d-9cd3-76b65dd506dc tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:18.814732 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bf6227cd-e1e3-416d-9cd3-76b65dd506dc tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:18.835882 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-bf6227cd-e1e3-416d-9cd3-76b65dd506dc tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Getting quotas for project 5e1c0b7015a5430c831865ab53a3006e. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:36:18.841895 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-bf6227cd-e1e3-416d-9cd3-76b65dd506dc tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Getting quotas for user 1ab48b332e534992a5bfa32168c2bb6d and project 5e1c0b7015a5430c831865ab53a3006e. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:36:18.854105 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-bf6227cd-e1e3-416d-9cd3-76b65dd506dc tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Going to run 1 instances... {{(pid=121134) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:36:18.857076 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-bf6227cd-e1e3-416d-9cd3-76b65dd506dc tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] [instance: edf52be3-bcff-4fa6-8ae3-0351aaadd579] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:36:18.980323 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-bf6227cd-e1e3-416d-9cd3-76b65dd506dc tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.883236 Oct 19 03:36:18.982344 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2441/4957] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:36:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 886 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 19 03:36:18.993190 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9ec3d67d-40bb-4efb-81eb-789d987a834f tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:18.996231 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9ec3d67d-40bb-4efb-81eb-789d987a834f tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] [instance: edf52be3-bcff-4fa6-8ae3-0351aaadd579] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:19.020258 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ec00bf9f-c77e-4254-bf5a-4f0dc06fed75 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:19.021722 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ec00bf9f-c77e-4254-bf5a-4f0dc06fed75 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 8955f425-23eb-423e-8ed4-eea1bd5dbc08] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:19.034040 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ec00bf9f-c77e-4254-bf5a-4f0dc06fed75 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:19.037207 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ec00bf9f-c77e-4254-bf5a-4f0dc06fed75 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:19.039162 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ec00bf9f-c77e-4254-bf5a-4f0dc06fed75 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:19.041104 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ec00bf9f-c77e-4254-bf5a-4f0dc06fed75 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:19.044050 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ec00bf9f-c77e-4254-bf5a-4f0dc06fed75 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:19.045212 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ec00bf9f-c77e-4254-bf5a-4f0dc06fed75 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:19.187978 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-9ec3d67d-40bb-4efb-81eb-789d987a834f tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab48b332e534992a5bfa32168c2bb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1c0b7015a5430c831865ab53a3006e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:19.203578 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9ec3d67d-40bb-4efb-81eb-789d987a834f tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] 10.222.0.52 "GET /compute/v2.1/servers/edf52be3-bcff-4fa6-8ae3-0351aaadd579" status: 200 len: 1214 microversion: 2.1 time: 0.214115 Oct 19 03:36:19.206583 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2517/4958] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:18 2022] GET /compute/v2.1/servers/edf52be3-bcff-4fa6-8ae3-0351aaadd579 => generated 1214 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:36:19.344419 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ec00bf9f-c77e-4254-bf5a-4f0dc06fed75 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4729a0afd69480f99642266e0eec17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce5e9f9a4644b27a24b2f4c06df97bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:19.352416 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ec00bf9f-c77e-4254-bf5a-4f0dc06fed75 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/8955f425-23eb-423e-8ed4-eea1bd5dbc08" status: 200 len: 1523 microversion: 2.1 time: 0.338540 Oct 19 03:36:19.352988 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2442/4959] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:19 2022] GET /compute/v2.1/servers/8955f425-23eb-423e-8ed4-eea1bd5dbc08 => generated 1523 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:36:19.454257 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-56f74f3f-fb36-4f3e-b838-607934591362 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:19.455061 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-56f74f3f-fb36-4f3e-b838-607934591362 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] [instance: ddbf7afb-1d7b-4d33-b6fb-1f1608c11985] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:19.463072 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-56f74f3f-fb36-4f3e-b838-607934591362 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:19.463813 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-56f74f3f-fb36-4f3e-b838-607934591362 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:19.464469 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-56f74f3f-fb36-4f3e-b838-607934591362 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:19.465357 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-56f74f3f-fb36-4f3e-b838-607934591362 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:19.465899 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-56f74f3f-fb36-4f3e-b838-607934591362 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:19.466488 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-56f74f3f-fb36-4f3e-b838-607934591362 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:19.680350 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-56f74f3f-fb36-4f3e-b838-607934591362 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c65a497e16e4e41b5cf1287042f3a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4001edd1474947a94243a620a6013a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:19.691730 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-56f74f3f-fb36-4f3e-b838-607934591362 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] 10.222.0.52 "GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985" status: 200 len: 1722 microversion: 2.1 time: 0.243922 Oct 19 03:36:19.694510 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2518/4960] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:19 2022] GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985 => generated 1722 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:36:19.720246 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b73c6242-b52d-4d59-bfc6-bf0ff9917414 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:19.720873 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b73c6242-b52d-4d59-bfc6-bf0ff9917414 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:19.729899 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b73c6242-b52d-4d59-bfc6-bf0ff9917414 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:19.730927 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b73c6242-b52d-4d59-bfc6-bf0ff9917414 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:19.731662 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b73c6242-b52d-4d59-bfc6-bf0ff9917414 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:19.732262 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b73c6242-b52d-4d59-bfc6-bf0ff9917414 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:19.732733 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b73c6242-b52d-4d59-bfc6-bf0ff9917414 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:19.733171 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b73c6242-b52d-4d59-bfc6-bf0ff9917414 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:19.997616 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b73c6242-b52d-4d59-bfc6-bf0ff9917414 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:20.007815 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b73c6242-b52d-4d59-bfc6-bf0ff9917414 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1657 microversion: 2.1 time: 0.291583 Oct 19 03:36:20.008414 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2443/4961] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:19 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1657 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:36:20.043437 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a55fb91b-26dc-4804-b16f-419e9321f3da tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:36:20.049865 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a55fb91b-26dc-4804-b16f-419e9321f3da tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:20.050474 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a55fb91b-26dc-4804-b16f-419e9321f3da tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:20.051120 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a55fb91b-26dc-4804-b16f-419e9321f3da tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:20.079515 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a55fb91b-26dc-4804-b16f-419e9321f3da tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Going to try to start instance {{(pid=121135) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 19 03:36:20.234809 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-afbf1f71-94c4-4a6d-a9ee-69a95099a53b tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:20.235590 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-afbf1f71-94c4-4a6d-a9ee-69a95099a53b tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] [instance: edf52be3-bcff-4fa6-8ae3-0351aaadd579] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:20.291614 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a55fb91b-26dc-4804-b16f-419e9321f3da tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "POST /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f/action" status: 202 len: 0 microversion: 2.1 time: 0.252678 Oct 19 03:36:20.299330 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2519/4962] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:36:20 2022] POST /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f/action => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 19 03:36:20.304660 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-56a30796-266d-4f53-b059-665626fa6904 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:20.305404 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-56a30796-266d-4f53-b059-665626fa6904 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:20.311838 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-afbf1f71-94c4-4a6d-a9ee-69a95099a53b tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab48b332e534992a5bfa32168c2bb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1c0b7015a5430c831865ab53a3006e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:20.321488 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-afbf1f71-94c4-4a6d-a9ee-69a95099a53b tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] 10.222.0.52 "GET /compute/v2.1/servers/edf52be3-bcff-4fa6-8ae3-0351aaadd579" status: 200 len: 1214 microversion: 2.1 time: 0.091807 Oct 19 03:36:20.337582 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-56a30796-266d-4f53-b059-665626fa6904 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:20.337582 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-56a30796-266d-4f53-b059-665626fa6904 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:20.337582 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-56a30796-266d-4f53-b059-665626fa6904 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:20.337916 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2444/4963] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:20 2022] GET /compute/v2.1/servers/edf52be3-bcff-4fa6-8ae3-0351aaadd579 => generated 1214 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:36:20.338014 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-56a30796-266d-4f53-b059-665626fa6904 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:20.338014 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-56a30796-266d-4f53-b059-665626fa6904 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:20.338014 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-56a30796-266d-4f53-b059-665626fa6904 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:20.380273 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b9b8b531-5eba-4003-9897-24db4a642694 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:20.380899 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b9b8b531-5eba-4003-9897-24db4a642694 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 8955f425-23eb-423e-8ed4-eea1bd5dbc08] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:20.408523 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b9b8b531-5eba-4003-9897-24db4a642694 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:20.409321 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b9b8b531-5eba-4003-9897-24db4a642694 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:20.409972 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b9b8b531-5eba-4003-9897-24db4a642694 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:20.410899 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b9b8b531-5eba-4003-9897-24db4a642694 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:20.411528 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b9b8b531-5eba-4003-9897-24db4a642694 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:20.418276 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b9b8b531-5eba-4003-9897-24db4a642694 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:20.906241 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b9b8b531-5eba-4003-9897-24db4a642694 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4729a0afd69480f99642266e0eec17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce5e9f9a4644b27a24b2f4c06df97bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:20.914318 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b9b8b531-5eba-4003-9897-24db4a642694 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/8955f425-23eb-423e-8ed4-eea1bd5dbc08" status: 200 len: 1523 microversion: 2.1 time: 0.537801 Oct 19 03:36:20.914889 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2445/4964] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:20 2022] GET /compute/v2.1/servers/8955f425-23eb-423e-8ed4-eea1bd5dbc08 => generated 1523 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:36:20.927494 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c4022828-81e8-42ec-b2d2-d0f0e1402316 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:20.939299 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c4022828-81e8-42ec-b2d2-d0f0e1402316 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] [instance: ddbf7afb-1d7b-4d33-b6fb-1f1608c11985] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:20.947579 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c4022828-81e8-42ec-b2d2-d0f0e1402316 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:20.948089 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c4022828-81e8-42ec-b2d2-d0f0e1402316 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:20.948539 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c4022828-81e8-42ec-b2d2-d0f0e1402316 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:20.953126 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c4022828-81e8-42ec-b2d2-d0f0e1402316 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:20.953701 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c4022828-81e8-42ec-b2d2-d0f0e1402316 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:20.954664 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c4022828-81e8-42ec-b2d2-d0f0e1402316 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:21.026880 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-56a30796-266d-4f53-b059-665626fa6904 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:21.042594 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-56a30796-266d-4f53-b059-665626fa6904 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1666 microversion: 2.1 time: 0.742008 Oct 19 03:36:21.049525 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2520/4965] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:20 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1666 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:36:21.307495 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c4022828-81e8-42ec-b2d2-d0f0e1402316 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c65a497e16e4e41b5cf1287042f3a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4001edd1474947a94243a620a6013a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:21.320958 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c4022828-81e8-42ec-b2d2-d0f0e1402316 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] 10.222.0.52 "GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985" status: 200 len: 1722 microversion: 2.1 time: 0.400227 Oct 19 03:36:21.323203 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2446/4966] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:20 2022] GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985 => generated 1722 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:36:21.351077 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6ee1a381-34b7-4b49-9996-2e103a50719f tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:21.351936 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6ee1a381-34b7-4b49-9996-2e103a50719f tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] [instance: edf52be3-bcff-4fa6-8ae3-0351aaadd579] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:21.364864 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6ee1a381-34b7-4b49-9996-2e103a50719f tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:21.365413 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6ee1a381-34b7-4b49-9996-2e103a50719f tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:21.365841 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6ee1a381-34b7-4b49-9996-2e103a50719f tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:21.367818 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6ee1a381-34b7-4b49-9996-2e103a50719f tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:21.369160 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6ee1a381-34b7-4b49-9996-2e103a50719f tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:21.370275 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6ee1a381-34b7-4b49-9996-2e103a50719f tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:21.588746 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-6ee1a381-34b7-4b49-9996-2e103a50719f tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab48b332e534992a5bfa32168c2bb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1c0b7015a5430c831865ab53a3006e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:21.588746 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6ee1a381-34b7-4b49-9996-2e103a50719f tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] 10.222.0.52 "GET /compute/v2.1/servers/edf52be3-bcff-4fa6-8ae3-0351aaadd579" status: 200 len: 1266 microversion: 2.1 time: 0.237297 Oct 19 03:36:21.588746 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2521/4967] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:21 2022] GET /compute/v2.1/servers/edf52be3-bcff-4fa6-8ae3-0351aaadd579 => generated 1266 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:36:21.943615 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f95b80b6-4fda-4fd3-8df5-69135a345af7 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:21.943615 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f95b80b6-4fda-4fd3-8df5-69135a345af7 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 8955f425-23eb-423e-8ed4-eea1bd5dbc08] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:21.953840 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f95b80b6-4fda-4fd3-8df5-69135a345af7 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:21.955113 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f95b80b6-4fda-4fd3-8df5-69135a345af7 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:21.957071 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f95b80b6-4fda-4fd3-8df5-69135a345af7 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:21.957942 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f95b80b6-4fda-4fd3-8df5-69135a345af7 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:21.960556 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f95b80b6-4fda-4fd3-8df5-69135a345af7 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:21.961727 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f95b80b6-4fda-4fd3-8df5-69135a345af7 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:22.078546 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1998c696-dcb0-4f7e-be0a-c548f093fdca tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:22.079876 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1998c696-dcb0-4f7e-be0a-c548f093fdca tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:22.091782 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1998c696-dcb0-4f7e-be0a-c548f093fdca tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:22.092785 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1998c696-dcb0-4f7e-be0a-c548f093fdca tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:22.093494 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1998c696-dcb0-4f7e-be0a-c548f093fdca tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:22.096702 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1998c696-dcb0-4f7e-be0a-c548f093fdca tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:22.097194 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1998c696-dcb0-4f7e-be0a-c548f093fdca tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:22.097672 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1998c696-dcb0-4f7e-be0a-c548f093fdca tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:22.124450 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:36:22.258266 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-f95b80b6-4fda-4fd3-8df5-69135a345af7 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4729a0afd69480f99642266e0eec17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce5e9f9a4644b27a24b2f4c06df97bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:22.275450 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f95b80b6-4fda-4fd3-8df5-69135a345af7 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/8955f425-23eb-423e-8ed4-eea1bd5dbc08" status: 200 len: 1523 microversion: 2.1 time: 0.334270 Oct 19 03:36:22.286398 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2447/4968] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:21 2022] GET /compute/v2.1/servers/8955f425-23eb-423e-8ed4-eea1bd5dbc08 => generated 1523 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:36:22.355454 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-095ae757-3289-4b04-803c-3876b605365e tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:22.356150 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-095ae757-3289-4b04-803c-3876b605365e tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] [instance: ddbf7afb-1d7b-4d33-b6fb-1f1608c11985] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:22.371165 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-095ae757-3289-4b04-803c-3876b605365e tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:22.384485 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-095ae757-3289-4b04-803c-3876b605365e tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:22.386114 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-095ae757-3289-4b04-803c-3876b605365e tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:22.389037 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-095ae757-3289-4b04-803c-3876b605365e tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:22.391133 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-095ae757-3289-4b04-803c-3876b605365e tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:22.391893 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-095ae757-3289-4b04-803c-3876b605365e tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:22.406656 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-1998c696-dcb0-4f7e-be0a-c548f093fdca tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:22.418009 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1998c696-dcb0-4f7e-be0a-c548f093fdca tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1666 microversion: 2.1 time: 0.346302 Oct 19 03:36:22.435750 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2522/4969] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:22 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1666 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:36:22.617853 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c6d25a2b-e91b-45b5-9638-7eed5a642675 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:22.621195 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c6d25a2b-e91b-45b5-9638-7eed5a642675 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] [instance: edf52be3-bcff-4fa6-8ae3-0351aaadd579] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:22.643921 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c6d25a2b-e91b-45b5-9638-7eed5a642675 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:22.646398 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c6d25a2b-e91b-45b5-9638-7eed5a642675 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:22.649667 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c6d25a2b-e91b-45b5-9638-7eed5a642675 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:22.650189 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c6d25a2b-e91b-45b5-9638-7eed5a642675 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:22.650830 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c6d25a2b-e91b-45b5-9638-7eed5a642675 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:22.651274 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c6d25a2b-e91b-45b5-9638-7eed5a642675 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:22.658703 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-095ae757-3289-4b04-803c-3876b605365e tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c65a497e16e4e41b5cf1287042f3a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4001edd1474947a94243a620a6013a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:22.671681 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-095ae757-3289-4b04-803c-3876b605365e tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] 10.222.0.52 "GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985" status: 200 len: 1722 microversion: 2.1 time: 0.322268 Oct 19 03:36:22.674514 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2448/4970] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:22 2022] GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985 => generated 1722 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:36:22.786065 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c6d25a2b-e91b-45b5-9638-7eed5a642675 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab48b332e534992a5bfa32168c2bb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1c0b7015a5430c831865ab53a3006e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:22.809046 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c6d25a2b-e91b-45b5-9638-7eed5a642675 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] 10.222.0.52 "GET /compute/v2.1/servers/edf52be3-bcff-4fa6-8ae3-0351aaadd579" status: 200 len: 1284 microversion: 2.1 time: 0.191599 Oct 19 03:36:22.812177 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2523/4971] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:22 2022] GET /compute/v2.1/servers/edf52be3-bcff-4fa6-8ae3-0351aaadd579 => generated 1284 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:36:23.306157 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-58399eed-ad8b-4b88-a2e8-c7f04a50e550 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:23.306837 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-58399eed-ad8b-4b88-a2e8-c7f04a50e550 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 8955f425-23eb-423e-8ed4-eea1bd5dbc08] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:23.323824 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-58399eed-ad8b-4b88-a2e8-c7f04a50e550 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:23.324633 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-58399eed-ad8b-4b88-a2e8-c7f04a50e550 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:23.325271 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-58399eed-ad8b-4b88-a2e8-c7f04a50e550 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:23.326206 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-58399eed-ad8b-4b88-a2e8-c7f04a50e550 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:23.326831 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-58399eed-ad8b-4b88-a2e8-c7f04a50e550 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:23.327430 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-58399eed-ad8b-4b88-a2e8-c7f04a50e550 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:23.455837 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-56903985-e164-4d88-aa7e-b7597e53bc6f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:23.467794 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-56903985-e164-4d88-aa7e-b7597e53bc6f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:23.483446 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-56903985-e164-4d88-aa7e-b7597e53bc6f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:23.485600 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-56903985-e164-4d88-aa7e-b7597e53bc6f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:23.487894 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-56903985-e164-4d88-aa7e-b7597e53bc6f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:23.490428 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-56903985-e164-4d88-aa7e-b7597e53bc6f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:23.493645 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-56903985-e164-4d88-aa7e-b7597e53bc6f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:23.494459 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-56903985-e164-4d88-aa7e-b7597e53bc6f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:23.553947 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-58399eed-ad8b-4b88-a2e8-c7f04a50e550 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4729a0afd69480f99642266e0eec17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce5e9f9a4644b27a24b2f4c06df97bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:23.563802 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-58399eed-ad8b-4b88-a2e8-c7f04a50e550 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/8955f425-23eb-423e-8ed4-eea1bd5dbc08" status: 200 len: 1523 microversion: 2.1 time: 0.261423 Oct 19 03:36:23.569352 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2449/4972] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:23 2022] GET /compute/v2.1/servers/8955f425-23eb-423e-8ed4-eea1bd5dbc08 => generated 1523 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:36:23.702605 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-36d5b89e-86ff-440d-84a5-89c2f2c83132 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:23.703739 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-36d5b89e-86ff-440d-84a5-89c2f2c83132 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] [instance: ddbf7afb-1d7b-4d33-b6fb-1f1608c11985] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:23.711014 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-36d5b89e-86ff-440d-84a5-89c2f2c83132 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:23.712542 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-36d5b89e-86ff-440d-84a5-89c2f2c83132 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:23.712542 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-36d5b89e-86ff-440d-84a5-89c2f2c83132 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:23.712747 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-36d5b89e-86ff-440d-84a5-89c2f2c83132 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:23.713099 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-36d5b89e-86ff-440d-84a5-89c2f2c83132 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:23.723340 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-36d5b89e-86ff-440d-84a5-89c2f2c83132 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:23.965832 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-56903985-e164-4d88-aa7e-b7597e53bc6f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:23.977940 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-56903985-e164-4d88-aa7e-b7597e53bc6f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1670 microversion: 2.1 time: 0.534935 Oct 19 03:36:23.978821 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2524/4973] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:23 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1670 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:36:23.991858 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-96f4471e-e0ae-4e6a-b52d-cf328df837d9 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:23.992498 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-96f4471e-e0ae-4e6a-b52d-cf328df837d9 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] [instance: edf52be3-bcff-4fa6-8ae3-0351aaadd579] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:24.007012 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-96f4471e-e0ae-4e6a-b52d-cf328df837d9 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:24.007704 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-96f4471e-e0ae-4e6a-b52d-cf328df837d9 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:24.008158 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-96f4471e-e0ae-4e6a-b52d-cf328df837d9 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:24.010596 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-96f4471e-e0ae-4e6a-b52d-cf328df837d9 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:24.011944 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-96f4471e-e0ae-4e6a-b52d-cf328df837d9 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:24.012635 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-96f4471e-e0ae-4e6a-b52d-cf328df837d9 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:24.085169 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-36d5b89e-86ff-440d-84a5-89c2f2c83132 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c65a497e16e4e41b5cf1287042f3a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4001edd1474947a94243a620a6013a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:24.099039 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-36d5b89e-86ff-440d-84a5-89c2f2c83132 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] 10.222.0.52 "GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985" status: 200 len: 1699 microversion: 2.1 time: 0.401176 Oct 19 03:36:24.099639 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2450/4974] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:23 2022] GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985 => generated 1699 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:36:24.124397 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-53712ffb-ede5-4958-a8ae-55109244c7bf tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:24.125098 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-53712ffb-ede5-4958-a8ae-55109244c7bf tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:24.135616 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-53712ffb-ede5-4958-a8ae-55109244c7bf tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:24.136149 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-53712ffb-ede5-4958-a8ae-55109244c7bf tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:24.136631 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-53712ffb-ede5-4958-a8ae-55109244c7bf tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:24.137353 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-53712ffb-ede5-4958-a8ae-55109244c7bf tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:24.137927 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-53712ffb-ede5-4958-a8ae-55109244c7bf tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:24.138351 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-53712ffb-ede5-4958-a8ae-55109244c7bf tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:24.290436 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-96f4471e-e0ae-4e6a-b52d-cf328df837d9 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab48b332e534992a5bfa32168c2bb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1c0b7015a5430c831865ab53a3006e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:24.302886 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-96f4471e-e0ae-4e6a-b52d-cf328df837d9 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] 10.222.0.52 "GET /compute/v2.1/servers/edf52be3-bcff-4fa6-8ae3-0351aaadd579" status: 200 len: 1314 microversion: 2.1 time: 0.318137 Oct 19 03:36:24.303529 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2525/4975] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:23 2022] GET /compute/v2.1/servers/edf52be3-bcff-4fa6-8ae3-0351aaadd579 => generated 1314 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:36:24.308570 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-90a0643e-c602-41b4-b3f6-3b1fc4763ad5 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:36:24.321119 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-90a0643e-c602-41b4-b3f6-3b1fc4763ad5 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:24.326025 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-90a0643e-c602-41b4-b3f6-3b1fc4763ad5 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:24.326482 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-90a0643e-c602-41b4-b3f6-3b1fc4763ad5 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:24.363306 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-53712ffb-ede5-4958-a8ae-55109244c7bf tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:24.368070 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:36:24.372870 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-90a0643e-c602-41b4-b3f6-3b1fc4763ad5 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] [instance: ddbf7afb-1d7b-4d33-b6fb-1f1608c11985] Going to try to start instance {{(pid=121135) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 19 03:36:24.373285 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-53712ffb-ede5-4958-a8ae-55109244c7bf tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1670 microversion: 2.1 time: 0.261455 Oct 19 03:36:24.373962 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2451/4976] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:24 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1670 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:36:24.403359 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-73104a34-cbc2-42ae-b000-2af0e32778ba tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:24.404611 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-73104a34-cbc2-42ae-b000-2af0e32778ba tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:24.424463 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-73104a34-cbc2-42ae-b000-2af0e32778ba tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:24.425249 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-73104a34-cbc2-42ae-b000-2af0e32778ba tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:24.425888 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-73104a34-cbc2-42ae-b000-2af0e32778ba tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:24.426685 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-73104a34-cbc2-42ae-b000-2af0e32778ba tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:24.427156 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-73104a34-cbc2-42ae-b000-2af0e32778ba tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:24.427591 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-73104a34-cbc2-42ae-b000-2af0e32778ba tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:24.571774 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-73104a34-cbc2-42ae-b000-2af0e32778ba tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:24.581347 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-73104a34-cbc2-42ae-b000-2af0e32778ba tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1670 microversion: 2.1 time: 0.183765 Oct 19 03:36:24.581963 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2452/4977] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:24 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1670 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:36:24.600882 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f3b2ed04-fca1-4b19-b7a9-3e6ee9711072 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:24.601664 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f3b2ed04-fca1-4b19-b7a9-3e6ee9711072 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 8955f425-23eb-423e-8ed4-eea1bd5dbc08] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:24.609514 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f3b2ed04-fca1-4b19-b7a9-3e6ee9711072 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:24.610115 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f3b2ed04-fca1-4b19-b7a9-3e6ee9711072 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:24.610847 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f3b2ed04-fca1-4b19-b7a9-3e6ee9711072 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:24.611660 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f3b2ed04-fca1-4b19-b7a9-3e6ee9711072 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:24.612189 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f3b2ed04-fca1-4b19-b7a9-3e6ee9711072 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:24.612688 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f3b2ed04-fca1-4b19-b7a9-3e6ee9711072 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:24.623794 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-90a0643e-c602-41b4-b3f6-3b1fc4763ad5 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] 10.222.0.52 "POST /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985/action" status: 202 len: 0 microversion: 2.1 time: 0.318809 Oct 19 03:36:24.628591 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2526/4978] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:36:24 2022] POST /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985/action => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:36:24.630965 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d2b2a0d5-68e9-4891-ad71-ca3f7b9b83c7 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:24.631693 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d2b2a0d5-68e9-4891-ad71-ca3f7b9b83c7 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:24.638833 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d2b2a0d5-68e9-4891-ad71-ca3f7b9b83c7 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:24.639625 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d2b2a0d5-68e9-4891-ad71-ca3f7b9b83c7 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:24.640312 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d2b2a0d5-68e9-4891-ad71-ca3f7b9b83c7 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:24.641242 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d2b2a0d5-68e9-4891-ad71-ca3f7b9b83c7 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:24.641752 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d2b2a0d5-68e9-4891-ad71-ca3f7b9b83c7 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:24.642289 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d2b2a0d5-68e9-4891-ad71-ca3f7b9b83c7 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:24.961151 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-f3b2ed04-fca1-4b19-b7a9-3e6ee9711072 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4729a0afd69480f99642266e0eec17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce5e9f9a4644b27a24b2f4c06df97bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:24.969925 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f3b2ed04-fca1-4b19-b7a9-3e6ee9711072 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/8955f425-23eb-423e-8ed4-eea1bd5dbc08" status: 200 len: 1523 microversion: 2.1 time: 0.373687 Oct 19 03:36:24.970623 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2453/4979] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:24 2022] GET /compute/v2.1/servers/8955f425-23eb-423e-8ed4-eea1bd5dbc08 => generated 1523 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:36:24.988800 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-18d8a759-040d-4c38-b7bd-ced84e08b55f tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:24.989699 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-18d8a759-040d-4c38-b7bd-ced84e08b55f tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] [instance: ddbf7afb-1d7b-4d33-b6fb-1f1608c11985] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:25.000794 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-18d8a759-040d-4c38-b7bd-ced84e08b55f tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:25.001318 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-18d8a759-040d-4c38-b7bd-ced84e08b55f tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:25.001850 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-18d8a759-040d-4c38-b7bd-ced84e08b55f tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:25.002898 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-18d8a759-040d-4c38-b7bd-ced84e08b55f tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:25.003366 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-18d8a759-040d-4c38-b7bd-ced84e08b55f tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:25.004035 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-18d8a759-040d-4c38-b7bd-ced84e08b55f tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:25.112743 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d2b2a0d5-68e9-4891-ad71-ca3f7b9b83c7 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:25.132603 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d2b2a0d5-68e9-4891-ad71-ca3f7b9b83c7 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1670 microversion: 2.1 time: 0.506287 Oct 19 03:36:25.142220 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2527/4980] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:24 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1670 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:36:25.162271 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-138a0459-8557-411b-88d6-296e18d071cf tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:25.163488 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-138a0459-8557-411b-88d6-296e18d071cf tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:25.175075 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-138a0459-8557-411b-88d6-296e18d071cf tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:25.178552 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-138a0459-8557-411b-88d6-296e18d071cf tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:25.179538 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-138a0459-8557-411b-88d6-296e18d071cf tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:25.180131 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-138a0459-8557-411b-88d6-296e18d071cf tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:25.181011 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-138a0459-8557-411b-88d6-296e18d071cf tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:25.182555 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-138a0459-8557-411b-88d6-296e18d071cf tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:25.461549 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-18d8a759-040d-4c38-b7bd-ced84e08b55f tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c65a497e16e4e41b5cf1287042f3a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4001edd1474947a94243a620a6013a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:25.470944 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-18d8a759-040d-4c38-b7bd-ced84e08b55f tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] 10.222.0.52 "GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985" status: 200 len: 1708 microversion: 2.1 time: 0.498934 Oct 19 03:36:25.471542 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2454/4981] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:24 2022] GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985 => generated 1708 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:36:25.492174 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-bd958a3f-9812-4468-a52f-3bb4acc8678a tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:25.492814 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-bd958a3f-9812-4468-a52f-3bb4acc8678a tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] [instance: edf52be3-bcff-4fa6-8ae3-0351aaadd579] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:25.499374 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bd958a3f-9812-4468-a52f-3bb4acc8678a tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:25.499880 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bd958a3f-9812-4468-a52f-3bb4acc8678a tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:25.500330 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bd958a3f-9812-4468-a52f-3bb4acc8678a tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:25.501045 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bd958a3f-9812-4468-a52f-3bb4acc8678a tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:25.501533 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bd958a3f-9812-4468-a52f-3bb4acc8678a tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:25.502036 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bd958a3f-9812-4468-a52f-3bb4acc8678a tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:25.701754 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-138a0459-8557-411b-88d6-296e18d071cf tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:25.711155 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-138a0459-8557-411b-88d6-296e18d071cf tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1670 microversion: 2.1 time: 0.553861 Oct 19 03:36:25.716221 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2528/4982] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:25 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1670 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:36:25.741699 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-98a1561c-ff73-432c-9c43-ff48dd14e707 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:36:25.749038 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-98a1561c-ff73-432c-9c43-ff48dd14e707 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:25.760235 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-98a1561c-ff73-432c-9c43-ff48dd14e707 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:25.762271 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-98a1561c-ff73-432c-9c43-ff48dd14e707 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:25.769402 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-98a1561c-ff73-432c-9c43-ff48dd14e707 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:25.769402 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-98a1561c-ff73-432c-9c43-ff48dd14e707 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:25.769402 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-98a1561c-ff73-432c-9c43-ff48dd14e707 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:25.769402 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-98a1561c-ff73-432c-9c43-ff48dd14e707 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:25.815888 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-98a1561c-ff73-432c-9c43-ff48dd14e707 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lazy-loading 'flavor' on Instance uuid 58b9ce4c-4a42-40ff-b8ed-b75de752b46f {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:36:26.041848 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-bd958a3f-9812-4468-a52f-3bb4acc8678a tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab48b332e534992a5bfa32168c2bb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1c0b7015a5430c831865ab53a3006e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:26.060105 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-bd958a3f-9812-4468-a52f-3bb4acc8678a tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] 10.222.0.52 "GET /compute/v2.1/servers/edf52be3-bcff-4fa6-8ae3-0351aaadd579" status: 200 len: 1314 microversion: 2.1 time: 0.573267 Oct 19 03:36:26.061261 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2455/4983] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:25 2022] GET /compute/v2.1/servers/edf52be3-bcff-4fa6-8ae3-0351aaadd579 => generated 1314 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:36:26.068800 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-aabdaeff-71a1-44da-9cb7-95e1552b5861 req-6d4fe7d3-36ea-488c-9386-cabdaf469c45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "edf52be3-bcff-4fa6-8ae3-0351aaadd579", "tag": "7d372a74-7a61-47f3-96d5-83f1bbe331fa"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:36:26.084713 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-aabdaeff-71a1-44da-9cb7-95e1552b5861 req-6d4fe7d3-36ea-488c-9386-cabdaf469c45 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:26.086269 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-aabdaeff-71a1-44da-9cb7-95e1552b5861 req-6d4fe7d3-36ea-488c-9386-cabdaf469c45 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:26.087182 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-aabdaeff-71a1-44da-9cb7-95e1552b5861 req-6d4fe7d3-36ea-488c-9386-cabdaf469c45 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:26.108839 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-aabdaeff-71a1-44da-9cb7-95e1552b5861 req-6d4fe7d3-36ea-488c-9386-cabdaf469c45 service nova] Creating event network-changed:7d372a74-7a61-47f3-96d5-83f1bbe331fa for instance edf52be3-bcff-4fa6-8ae3-0351aaadd579 on n-h2-861333-8 Oct 19 03:36:26.119675 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-aabdaeff-71a1-44da-9cb7-95e1552b5861 req-6d4fe7d3-36ea-488c-9386-cabdaf469c45 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056722 Oct 19 03:36:26.121990 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2456/4984] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:36:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:36:26.130322 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f5357b2d-a413-4a8b-9cb4-102ef98309ec tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:26.131691 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f5357b2d-a413-4a8b-9cb4-102ef98309ec tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 8955f425-23eb-423e-8ed4-eea1bd5dbc08] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:26.142127 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f5357b2d-a413-4a8b-9cb4-102ef98309ec tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:26.143235 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f5357b2d-a413-4a8b-9cb4-102ef98309ec tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:26.144537 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f5357b2d-a413-4a8b-9cb4-102ef98309ec tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:26.146569 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f5357b2d-a413-4a8b-9cb4-102ef98309ec tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:26.147257 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f5357b2d-a413-4a8b-9cb4-102ef98309ec tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:26.148003 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f5357b2d-a413-4a8b-9cb4-102ef98309ec tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:26.226119 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-98a1561c-ff73-432c-9c43-ff48dd14e707 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "POST /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f/action" status: 202 len: 0 microversion: 2.1 time: 0.494926 Oct 19 03:36:26.227349 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2529/4985] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:36:25 2022] POST /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f/action => generated 0 bytes in 498 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:36:26.254235 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f888e2eb-2de2-4cc0-ab8a-71f050aaa6a7 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:26.255341 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f888e2eb-2de2-4cc0-ab8a-71f050aaa6a7 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:26.270978 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f888e2eb-2de2-4cc0-ab8a-71f050aaa6a7 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:26.271845 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f888e2eb-2de2-4cc0-ab8a-71f050aaa6a7 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:26.272476 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f888e2eb-2de2-4cc0-ab8a-71f050aaa6a7 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:26.273529 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f888e2eb-2de2-4cc0-ab8a-71f050aaa6a7 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:26.277766 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f888e2eb-2de2-4cc0-ab8a-71f050aaa6a7 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:26.278588 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f888e2eb-2de2-4cc0-ab8a-71f050aaa6a7 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:26.943671 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f888e2eb-2de2-4cc0-ab8a-71f050aaa6a7 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:26.965787 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f888e2eb-2de2-4cc0-ab8a-71f050aaa6a7 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1678 microversion: 2.1 time: 0.711732 Oct 19 03:36:26.966452 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2530/4986] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:26 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1678 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:36:26.971508 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3f625c6b-1361-4a03-a317-3691f1b5877d tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:26.972405 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-3f625c6b-1361-4a03-a317-3691f1b5877d tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] [instance: ddbf7afb-1d7b-4d33-b6fb-1f1608c11985] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:26.988215 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3f625c6b-1361-4a03-a317-3691f1b5877d tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:26.988760 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3f625c6b-1361-4a03-a317-3691f1b5877d tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:26.989206 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3f625c6b-1361-4a03-a317-3691f1b5877d tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:26.997696 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3f625c6b-1361-4a03-a317-3691f1b5877d tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:26.997696 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3f625c6b-1361-4a03-a317-3691f1b5877d tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:26.997696 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3f625c6b-1361-4a03-a317-3691f1b5877d tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:27.237557 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-f5357b2d-a413-4a8b-9cb4-102ef98309ec tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4729a0afd69480f99642266e0eec17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce5e9f9a4644b27a24b2f4c06df97bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:27.248370 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f5357b2d-a413-4a8b-9cb4-102ef98309ec tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/8955f425-23eb-423e-8ed4-eea1bd5dbc08" status: 200 len: 1523 microversion: 2.1 time: 1.124410 Oct 19 03:36:27.253891 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2457/4987] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:26 2022] GET /compute/v2.1/servers/8955f425-23eb-423e-8ed4-eea1bd5dbc08 => generated 1523 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:36:27.270784 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-862911df-5135-4ded-8b16-54ca4e1c82e2 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:27.272877 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-862911df-5135-4ded-8b16-54ca4e1c82e2 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] [instance: edf52be3-bcff-4fa6-8ae3-0351aaadd579] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:27.295440 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-862911df-5135-4ded-8b16-54ca4e1c82e2 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:27.299192 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-862911df-5135-4ded-8b16-54ca4e1c82e2 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:27.301047 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-862911df-5135-4ded-8b16-54ca4e1c82e2 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:27.301952 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-862911df-5135-4ded-8b16-54ca4e1c82e2 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:27.302535 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-862911df-5135-4ded-8b16-54ca4e1c82e2 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:27.303103 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-862911df-5135-4ded-8b16-54ca4e1c82e2 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:27.436769 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-3f625c6b-1361-4a03-a317-3691f1b5877d tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c65a497e16e4e41b5cf1287042f3a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4001edd1474947a94243a620a6013a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:27.446560 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-3f625c6b-1361-4a03-a317-3691f1b5877d tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] 10.222.0.52 "GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985" status: 200 len: 1708 microversion: 2.1 time: 0.478654 Oct 19 03:36:27.447223 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2531/4988] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:26 2022] GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985 => generated 1708 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:36:27.530242 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-862911df-5135-4ded-8b16-54ca4e1c82e2 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab48b332e534992a5bfa32168c2bb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1c0b7015a5430c831865ab53a3006e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:27.533043 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-862911df-5135-4ded-8b16-54ca4e1c82e2 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] 10.222.0.52 "GET /compute/v2.1/servers/edf52be3-bcff-4fa6-8ae3-0351aaadd579" status: 200 len: 1314 microversion: 2.1 time: 0.277839 Oct 19 03:36:27.533717 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2458/4989] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:27 2022] GET /compute/v2.1/servers/edf52be3-bcff-4fa6-8ae3-0351aaadd579 => generated 1314 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:36:27.993685 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3fe26154-6772-413c-88b7-0f4c35998c17 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:27.995131 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-3fe26154-6772-413c-88b7-0f4c35998c17 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:28.004182 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3fe26154-6772-413c-88b7-0f4c35998c17 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:28.004760 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3fe26154-6772-413c-88b7-0f4c35998c17 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:28.005593 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3fe26154-6772-413c-88b7-0f4c35998c17 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:28.006647 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3fe26154-6772-413c-88b7-0f4c35998c17 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:28.007447 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3fe26154-6772-413c-88b7-0f4c35998c17 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:28.014207 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3fe26154-6772-413c-88b7-0f4c35998c17 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:28.272059 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e9e500a1-cea4-4cba-9ce1-e1b7fd97564c tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:28.272835 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e9e500a1-cea4-4cba-9ce1-e1b7fd97564c tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 8955f425-23eb-423e-8ed4-eea1bd5dbc08] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:28.282618 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e9e500a1-cea4-4cba-9ce1-e1b7fd97564c tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:28.283489 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e9e500a1-cea4-4cba-9ce1-e1b7fd97564c tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:28.286163 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e9e500a1-cea4-4cba-9ce1-e1b7fd97564c tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:28.288366 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e9e500a1-cea4-4cba-9ce1-e1b7fd97564c tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:28.289077 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e9e500a1-cea4-4cba-9ce1-e1b7fd97564c tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:28.289784 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e9e500a1-cea4-4cba-9ce1-e1b7fd97564c tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:28.331850 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-3fe26154-6772-413c-88b7-0f4c35998c17 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:28.340737 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-3fe26154-6772-413c-88b7-0f4c35998c17 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1661 microversion: 2.1 time: 0.353312 Oct 19 03:36:28.349547 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2532/4990] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:27 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1661 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:36:28.365015 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e086a5d3-e249-4b0b-bf0c-a4bd68c734df tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:36:28.368874 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e086a5d3-e249-4b0b-bf0c-a4bd68c734df tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:28.376855 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e086a5d3-e249-4b0b-bf0c-a4bd68c734df tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:28.378127 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e086a5d3-e249-4b0b-bf0c-a4bd68c734df tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:28.378377 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e086a5d3-e249-4b0b-bf0c-a4bd68c734df tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:28.379159 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e086a5d3-e249-4b0b-bf0c-a4bd68c734df tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:28.379623 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e086a5d3-e249-4b0b-bf0c-a4bd68c734df tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:28.380061 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e086a5d3-e249-4b0b-bf0c-a4bd68c734df tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:28.558735 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e9e500a1-cea4-4cba-9ce1-e1b7fd97564c tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4729a0afd69480f99642266e0eec17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce5e9f9a4644b27a24b2f4c06df97bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:28.566827 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e9e500a1-cea4-4cba-9ce1-e1b7fd97564c tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/8955f425-23eb-423e-8ed4-eea1bd5dbc08" status: 200 len: 1523 microversion: 2.1 time: 0.298608 Oct 19 03:36:28.567899 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2459/4991] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:28 2022] GET /compute/v2.1/servers/8955f425-23eb-423e-8ed4-eea1bd5dbc08 => generated 1523 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:36:28.571937 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ff96e5cd-03a2-4cbb-a567-2bf103518675 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:28.572719 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ff96e5cd-03a2-4cbb-a567-2bf103518675 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] [instance: ddbf7afb-1d7b-4d33-b6fb-1f1608c11985] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:28.579426 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ff96e5cd-03a2-4cbb-a567-2bf103518675 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:28.580105 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ff96e5cd-03a2-4cbb-a567-2bf103518675 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:28.580705 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ff96e5cd-03a2-4cbb-a567-2bf103518675 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:28.581586 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ff96e5cd-03a2-4cbb-a567-2bf103518675 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:28.582191 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ff96e5cd-03a2-4cbb-a567-2bf103518675 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:28.582768 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ff96e5cd-03a2-4cbb-a567-2bf103518675 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:28.691107 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e086a5d3-e249-4b0b-bf0c-a4bd68c734df tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "POST /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f/action" status: 202 len: 0 microversion: 2.1 time: 0.329077 Oct 19 03:36:28.692991 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2533/4992] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:36:28 2022] POST /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f/action => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 19 03:36:28.705347 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-da092cd9-0de9-4ffb-b9b1-3998c48dab34 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:28.706187 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-da092cd9-0de9-4ffb-b9b1-3998c48dab34 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] [instance: edf52be3-bcff-4fa6-8ae3-0351aaadd579] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:28.713577 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-da092cd9-0de9-4ffb-b9b1-3998c48dab34 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:28.714950 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-da092cd9-0de9-4ffb-b9b1-3998c48dab34 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:28.714950 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-da092cd9-0de9-4ffb-b9b1-3998c48dab34 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:28.716217 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-da092cd9-0de9-4ffb-b9b1-3998c48dab34 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:28.716217 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-da092cd9-0de9-4ffb-b9b1-3998c48dab34 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:28.716596 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-da092cd9-0de9-4ffb-b9b1-3998c48dab34 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:28.826033 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:36:29.001447 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ff96e5cd-03a2-4cbb-a567-2bf103518675 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c65a497e16e4e41b5cf1287042f3a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4001edd1474947a94243a620a6013a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:29.007195 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-da092cd9-0de9-4ffb-b9b1-3998c48dab34 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab48b332e534992a5bfa32168c2bb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1c0b7015a5430c831865ab53a3006e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:29.030902 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ff96e5cd-03a2-4cbb-a567-2bf103518675 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] 10.222.0.52 "GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985" status: 200 len: 1712 microversion: 2.1 time: 0.461953 Oct 19 03:36:29.033197 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2460/4993] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:28 2022] GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985 => generated 1712 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:36:29.045305 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6fe81ac6-8e0d-4b46-be4e-984092f25af8 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:29.047011 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6fe81ac6-8e0d-4b46-be4e-984092f25af8 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:29.059167 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6fe81ac6-8e0d-4b46-be4e-984092f25af8 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:29.068198 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6fe81ac6-8e0d-4b46-be4e-984092f25af8 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:29.068198 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6fe81ac6-8e0d-4b46-be4e-984092f25af8 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:29.068198 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6fe81ac6-8e0d-4b46-be4e-984092f25af8 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:29.068198 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6fe81ac6-8e0d-4b46-be4e-984092f25af8 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:29.068198 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6fe81ac6-8e0d-4b46-be4e-984092f25af8 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:29.080728 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-da092cd9-0de9-4ffb-b9b1-3998c48dab34 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] 10.222.0.52 "GET /compute/v2.1/servers/edf52be3-bcff-4fa6-8ae3-0351aaadd579" status: 200 len: 1314 microversion: 2.1 time: 0.384442 Oct 19 03:36:29.082528 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2534/4994] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:28 2022] GET /compute/v2.1/servers/edf52be3-bcff-4fa6-8ae3-0351aaadd579 => generated 1314 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:36:29.391500 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-6fe81ac6-8e0d-4b46-be4e-984092f25af8 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:29.407111 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6fe81ac6-8e0d-4b46-be4e-984092f25af8 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1667 microversion: 2.1 time: 0.371386 Oct 19 03:36:29.407896 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2461/4995] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:29 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1667 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:36:29.592588 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-230810e9-fa39-4f62-baa6-efcfff279553 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:29.593212 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-230810e9-fa39-4f62-baa6-efcfff279553 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 8955f425-23eb-423e-8ed4-eea1bd5dbc08] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:29.599016 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:36:29.606403 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-230810e9-fa39-4f62-baa6-efcfff279553 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:29.612656 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-230810e9-fa39-4f62-baa6-efcfff279553 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:29.612656 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-230810e9-fa39-4f62-baa6-efcfff279553 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:29.612656 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-230810e9-fa39-4f62-baa6-efcfff279553 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:29.612656 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-230810e9-fa39-4f62-baa6-efcfff279553 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:29.623258 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-230810e9-fa39-4f62-baa6-efcfff279553 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:29.914114 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:36:30.120226 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-230810e9-fa39-4f62-baa6-efcfff279553 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4729a0afd69480f99642266e0eec17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce5e9f9a4644b27a24b2f4c06df97bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:30.121190 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8ba7a669-b607-46cc-9796-82772b29731f tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:30.121850 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8ba7a669-b607-46cc-9796-82772b29731f tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] [instance: edf52be3-bcff-4fa6-8ae3-0351aaadd579] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:30.134937 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-230810e9-fa39-4f62-baa6-efcfff279553 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/8955f425-23eb-423e-8ed4-eea1bd5dbc08" status: 200 len: 1523 microversion: 2.1 time: 0.545959 Oct 19 03:36:30.139635 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8ba7a669-b607-46cc-9796-82772b29731f tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:30.143004 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8ba7a669-b607-46cc-9796-82772b29731f tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:30.143004 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8ba7a669-b607-46cc-9796-82772b29731f tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:30.143452 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2535/4996] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:29 2022] GET /compute/v2.1/servers/8955f425-23eb-423e-8ed4-eea1bd5dbc08 => generated 1523 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:36:30.143724 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8ba7a669-b607-46cc-9796-82772b29731f tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:30.143724 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8ba7a669-b607-46cc-9796-82772b29731f tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:30.143724 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8ba7a669-b607-46cc-9796-82772b29731f tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:30.321286 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=8 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:36:30.350067 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8ba7a669-b607-46cc-9796-82772b29731f tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab48b332e534992a5bfa32168c2bb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1c0b7015a5430c831865ab53a3006e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:30.359707 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8ba7a669-b607-46cc-9796-82772b29731f tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] 10.222.0.52 "GET /compute/v2.1/servers/edf52be3-bcff-4fa6-8ae3-0351aaadd579" status: 200 len: 1314 microversion: 2.1 time: 0.252536 Oct 19 03:36:30.360668 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2462/4997] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:30 2022] GET /compute/v2.1/servers/edf52be3-bcff-4fa6-8ae3-0351aaadd579 => generated 1314 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:36:30.433564 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-932eef1b-308a-46aa-b08d-043ddc08e1da tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:30.434199 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-932eef1b-308a-46aa-b08d-043ddc08e1da tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:30.443924 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-932eef1b-308a-46aa-b08d-043ddc08e1da tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:30.446801 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-932eef1b-308a-46aa-b08d-043ddc08e1da tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:30.446801 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-932eef1b-308a-46aa-b08d-043ddc08e1da tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:30.446801 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-932eef1b-308a-46aa-b08d-043ddc08e1da tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:30.446801 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-932eef1b-308a-46aa-b08d-043ddc08e1da tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:30.446801 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-932eef1b-308a-46aa-b08d-043ddc08e1da tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:30.609426 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-932eef1b-308a-46aa-b08d-043ddc08e1da tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:30.618621 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-932eef1b-308a-46aa-b08d-043ddc08e1da tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1667 microversion: 2.1 time: 0.190255 Oct 19 03:36:30.619331 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2536/4998] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:30 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1667 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:36:31.170204 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0f861e71-1991-4432-85ea-91be569b492f tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:31.174761 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0f861e71-1991-4432-85ea-91be569b492f tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 8955f425-23eb-423e-8ed4-eea1bd5dbc08] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:31.184441 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0f861e71-1991-4432-85ea-91be569b492f tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:31.188111 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0f861e71-1991-4432-85ea-91be569b492f tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:31.191587 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0f861e71-1991-4432-85ea-91be569b492f tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:31.195434 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0f861e71-1991-4432-85ea-91be569b492f tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:31.195434 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0f861e71-1991-4432-85ea-91be569b492f tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:31.195434 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0f861e71-1991-4432-85ea-91be569b492f tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:31.370848 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0f861e71-1991-4432-85ea-91be569b492f tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4729a0afd69480f99642266e0eec17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce5e9f9a4644b27a24b2f4c06df97bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:31.382421 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0f861e71-1991-4432-85ea-91be569b492f tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/8955f425-23eb-423e-8ed4-eea1bd5dbc08" status: 200 len: 1503 microversion: 2.1 time: 0.221611 Oct 19 03:36:31.391280 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2463/4999] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:31 2022] GET /compute/v2.1/servers/8955f425-23eb-423e-8ed4-eea1bd5dbc08 => generated 1503 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:36:31.402048 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-40edd1c5-7d36-4560-8eb1-ec003c557c17 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:31.402048 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-40edd1c5-7d36-4560-8eb1-ec003c557c17 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] [instance: edf52be3-bcff-4fa6-8ae3-0351aaadd579] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:31.412665 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4c511ca2-0e42-48d6-b2fe-a31c76cbe301 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0a05d9cb-4610-41d5-a520-023f258db00f"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:36:31.414842 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-40edd1c5-7d36-4560-8eb1-ec003c557c17 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:31.418114 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-40edd1c5-7d36-4560-8eb1-ec003c557c17 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:31.422912 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-40edd1c5-7d36-4560-8eb1-ec003c557c17 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:31.422912 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-40edd1c5-7d36-4560-8eb1-ec003c557c17 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:31.422912 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-40edd1c5-7d36-4560-8eb1-ec003c557c17 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:31.422912 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-40edd1c5-7d36-4560-8eb1-ec003c557c17 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:31.423296 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4c511ca2-0e42-48d6-b2fe-a31c76cbe301 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 8955f425-23eb-423e-8ed4-eea1bd5dbc08] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:31.429686 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4c511ca2-0e42-48d6-b2fe-a31c76cbe301 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:31.430324 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4c511ca2-0e42-48d6-b2fe-a31c76cbe301 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:31.430775 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4c511ca2-0e42-48d6-b2fe-a31c76cbe301 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:31.431498 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4c511ca2-0e42-48d6-b2fe-a31c76cbe301 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:31.431959 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4c511ca2-0e42-48d6-b2fe-a31c76cbe301 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:31.432541 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4c511ca2-0e42-48d6-b2fe-a31c76cbe301 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:31.463928 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-4c511ca2-0e42-48d6-b2fe-a31c76cbe301 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] HTTP exception thrown: Cannot 'attach_volume' instance 8955f425-23eb-423e-8ed4-eea1bd5dbc08 while it is in vm_state rescued Oct 19 03:36:31.465997 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4c511ca2-0e42-48d6-b2fe-a31c76cbe301 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Request method failure captured: Oct 19 03:36:31.465997 n-d-861333-8 devstack@n-api.service[121134]: request: POST /compute/v2.1/servers/8955f425-23eb-423e-8ed4-eea1bd5dbc08/os-volume_attachments HTTP/1.1 Oct 19 03:36:31.465997 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:36:31.465997 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:36:31.465997 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:36:31.465997 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 74 Oct 19 03:36:31.465997 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:36:31.465997 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:36:31.465997 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:36:31.465997 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:36:31.465997 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3BmoEKz0EhW7NaUKeOkQsZRXl8ERfsAKAMxU0GUBdc2f_V_CqkDPpZu62NL2einDTJrDUFbtRF7OMHEg091oC7NSi4gfYN6KT9w4SCkkHNILzmL1G1frQPfKMrDDDqTbb0782yvc_4ZYCpfzt0d6J1jKWlIQL4vx50kauya3LDEzsA Oct 19 03:36:31.465997 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:36:31.465997 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:36:31.465997 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:36:31.465997 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:36:31.465997 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:36:31.465997 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:36:31.465997 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 2ce5e9f9a4644b27a24b2f4c06df97bc Oct 19 03:36:31.465997 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-684190061 Oct 19 03:36:31.465997 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:36:31.465997 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:36:31.465997 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2ce5e9f9a4644b27a24b2f4c06df97bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2ce5e9f9a4644b27a24b2f4c06df97bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2ce5e9f9a4644b27a24b2f4c06df97bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2ce5e9f9a4644b27a24b2f4c06df97bc", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:36:31.465997 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ServerRescueNegativeTestJSON-684190061 Oct 19 03:36:31.465997 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 2ce5e9f9a4644b27a24b2f4c06df97bc Oct 19 03:36:31.465997 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-684190061 Oct 19 03:36:31.465997 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ServerRescueNegativeTestJSON-684190061-project Oct 19 03:36:31.465997 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:36:31.465997 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:36:31.465997 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: b4729a0afd69480f99642266e0eec17e Oct 19 03:36:31.465997 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ServerRescueNegativeTestJSON-684190061-project Oct 19 03:36:31.465997 n-d-861333-8 devstack@n-api.service[121134]: Oct 19 03:36:31.465997 n-d-861333-8 devstack@n-api.service[121134]: {"volumeAttachment": {"volumeId": "0a05d9cb-4610-41d5-a520-023f258db00f"}} Oct 19 03:36:31.465997 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:36:31.465997 n-d-861333-8 devstack@n-api.service[121134]: exception: Cannot 'attach_volume' instance 8955f425-23eb-423e-8ed4-eea1bd5dbc08 while it is in vm_state rescued Oct 19 03:36:31.465997 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'server_id': '8955f425-23eb-423e-8ed4-eea1bd5dbc08', 'body': {'volumeAttachment': {'volumeId': '0a05d9cb-4610-41d5-a520-023f258db00f'}}} Oct 19 03:36:31.465997 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:36:31.465997 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:36:31.465997 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 19 03:36:31.465997 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 19 03:36:31.465997 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 19 03:36:31.465997 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 19 03:36:31.465997 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 19 03:36:31.465997 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 19 03:36:31.465997 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8955f425-23eb-423e-8ed4-eea1bd5dbc08 in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 19 03:36:31.465997 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:36:31.465997 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:36:31.465997 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:36:31.465997 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:36:31.465997 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:36:31.465997 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:36:31.465997 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:36:31.465997 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:36:31.465997 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:36:31.465997 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:36:31.465997 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:36:31.465997 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:36:31.465997 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:36:31.465997 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:36:31.465997 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:36:31.465997 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:36:31.465997 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 19 03:36:31.465997 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 19 03:36:31.476821 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 19 03:36:31.476821 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 19 03:36:31.476821 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 8955f425-23eb-423e-8ed4-eea1bd5dbc08 while it is in vm_state rescued Oct 19 03:36:31.476821 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:36:31.476821 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:36:31.476821 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:36:31.476821 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:36:31.476821 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:36:31.476821 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:36:31.476821 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:36:31.476821 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:36:31.476821 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 8955f425-23eb-423e-8ed4-eea1bd5dbc08 while it is in vm_state rescued Oct 19 03:36:31.476821 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:36:31.476821 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4c511ca2-0e42-48d6-b2fe-a31c76cbe301 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Returning 409 to user: Cannot 'attach_volume' instance 8955f425-23eb-423e-8ed4-eea1bd5dbc08 while it is in vm_state rescued {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:36:31.476821 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4c511ca2-0e42-48d6-b2fe-a31c76cbe301 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "POST /compute/v2.1/servers/8955f425-23eb-423e-8ed4-eea1bd5dbc08/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.059304 Oct 19 03:36:31.476821 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2464/5000] 10.222.0.52 () {60 vars in 1323 bytes} [Wed Oct 19 03:36:31 2022] POST /compute/v2.1/servers/8955f425-23eb-423e-8ed4-eea1bd5dbc08/os-volume_attachments => generated 152 bytes in 61 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 19 03:36:31.476821 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-69acd3d7-f347-4f18-8266-47c27e10f160 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:36:31.488571 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-69acd3d7-f347-4f18-8266-47c27e10f160 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 8955f425-23eb-423e-8ed4-eea1bd5dbc08] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:31.488571 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-69acd3d7-f347-4f18-8266-47c27e10f160 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:31.488571 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-69acd3d7-f347-4f18-8266-47c27e10f160 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:31.488571 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-69acd3d7-f347-4f18-8266-47c27e10f160 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:31.488571 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-69acd3d7-f347-4f18-8266-47c27e10f160 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:31.488571 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-69acd3d7-f347-4f18-8266-47c27e10f160 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:31.488571 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-69acd3d7-f347-4f18-8266-47c27e10f160 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:31.600889 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-40edd1c5-7d36-4560-8eb1-ec003c557c17 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab48b332e534992a5bfa32168c2bb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1c0b7015a5430c831865ab53a3006e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:31.610050 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-40edd1c5-7d36-4560-8eb1-ec003c557c17 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] 10.222.0.52 "GET /compute/v2.1/servers/edf52be3-bcff-4fa6-8ae3-0351aaadd579" status: 200 len: 1314 microversion: 2.1 time: 0.229659 Oct 19 03:36:31.615634 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2537/5001] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:31 2022] GET /compute/v2.1/servers/edf52be3-bcff-4fa6-8ae3-0351aaadd579 => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:36:31.648591 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3ecd726d-9597-464c-8a1a-a61adc21787d tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:31.649442 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-3ecd726d-9597-464c-8a1a-a61adc21787d tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:31.659343 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3ecd726d-9597-464c-8a1a-a61adc21787d tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:31.659343 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3ecd726d-9597-464c-8a1a-a61adc21787d tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:31.659343 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3ecd726d-9597-464c-8a1a-a61adc21787d tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:31.659343 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3ecd726d-9597-464c-8a1a-a61adc21787d tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:31.659343 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3ecd726d-9597-464c-8a1a-a61adc21787d tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:31.660002 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3ecd726d-9597-464c-8a1a-a61adc21787d tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:31.724185 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-69acd3d7-f347-4f18-8266-47c27e10f160 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "POST /compute/v2.1/servers/8955f425-23eb-423e-8ed4-eea1bd5dbc08/action" status: 202 len: 0 microversion: 2.1 time: 0.251245 Oct 19 03:36:31.733428 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2465/5002] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:36:31 2022] POST /compute/v2.1/servers/8955f425-23eb-423e-8ed4-eea1bd5dbc08/action => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:36:31.746801 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9a439a10-b94b-4de5-b560-f20551223526 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:31.747677 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9a439a10-b94b-4de5-b560-f20551223526 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 8955f425-23eb-423e-8ed4-eea1bd5dbc08] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:31.770500 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9a439a10-b94b-4de5-b560-f20551223526 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:31.771215 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9a439a10-b94b-4de5-b560-f20551223526 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:31.772046 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9a439a10-b94b-4de5-b560-f20551223526 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:31.772880 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9a439a10-b94b-4de5-b560-f20551223526 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:31.774889 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9a439a10-b94b-4de5-b560-f20551223526 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:31.780317 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9a439a10-b94b-4de5-b560-f20551223526 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:32.006609 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-3ecd726d-9597-464c-8a1a-a61adc21787d tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:32.025753 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-3ecd726d-9597-464c-8a1a-a61adc21787d tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1670 microversion: 2.1 time: 0.382621 Oct 19 03:36:32.025753 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2538/5003] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:31 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1670 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:36:32.068052 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9a439a10-b94b-4de5-b560-f20551223526 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4729a0afd69480f99642266e0eec17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce5e9f9a4644b27a24b2f4c06df97bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:32.072739 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e219e385-27aa-448a-b940-7a3e7d622969 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:32.076535 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e219e385-27aa-448a-b940-7a3e7d622969 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:32.080394 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9a439a10-b94b-4de5-b560-f20551223526 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/8955f425-23eb-423e-8ed4-eea1bd5dbc08" status: 200 len: 1511 microversion: 2.1 time: 0.344249 Oct 19 03:36:32.081966 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2466/5004] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:31 2022] GET /compute/v2.1/servers/8955f425-23eb-423e-8ed4-eea1bd5dbc08 => generated 1511 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:36:32.100634 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e219e385-27aa-448a-b940-7a3e7d622969 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:32.101272 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e219e385-27aa-448a-b940-7a3e7d622969 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:32.102007 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e219e385-27aa-448a-b940-7a3e7d622969 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:32.102779 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e219e385-27aa-448a-b940-7a3e7d622969 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:32.103244 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e219e385-27aa-448a-b940-7a3e7d622969 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:32.103674 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e219e385-27aa-448a-b940-7a3e7d622969 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:32.332299 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-e219e385-27aa-448a-b940-7a3e7d622969 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:32.381228 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e219e385-27aa-448a-b940-7a3e7d622969 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1670 microversion: 2.1 time: 0.323235 Oct 19 03:36:32.383558 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2539/5005] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:32 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1670 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:36:32.411876 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c5d0122f-ef99-478b-ab79-6c85229e6df2 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:32.412400 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c5d0122f-ef99-478b-ab79-6c85229e6df2 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:32.423240 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c5d0122f-ef99-478b-ab79-6c85229e6df2 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:32.423765 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c5d0122f-ef99-478b-ab79-6c85229e6df2 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:32.424200 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c5d0122f-ef99-478b-ab79-6c85229e6df2 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:32.424919 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c5d0122f-ef99-478b-ab79-6c85229e6df2 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:32.425400 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c5d0122f-ef99-478b-ab79-6c85229e6df2 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:32.432253 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c5d0122f-ef99-478b-ab79-6c85229e6df2 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:32.498098 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c5d0122f-ef99-478b-ab79-6c85229e6df2 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21] Going to try to terminate instance {{(pid=121134) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:36:32.519738 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.compute.api [None req-c5d0122f-ef99-478b-ab79-6c85229e6df2 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21] Working on deleting snapshot 3bb26c8e-a5a5-4d4f-905f-8cf0b0f33059 from shelved instance... Oct 19 03:36:32.638750 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1d620891-0d8b-45cd-9546-57614d916572 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:32.639369 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1d620891-0d8b-45cd-9546-57614d916572 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] [instance: edf52be3-bcff-4fa6-8ae3-0351aaadd579] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:32.671539 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1d620891-0d8b-45cd-9546-57614d916572 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:32.672514 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1d620891-0d8b-45cd-9546-57614d916572 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:32.673660 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1d620891-0d8b-45cd-9546-57614d916572 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:32.674608 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1d620891-0d8b-45cd-9546-57614d916572 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:32.675490 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1d620891-0d8b-45cd-9546-57614d916572 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:32.676685 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1d620891-0d8b-45cd-9546-57614d916572 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:32.888566 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-1d620891-0d8b-45cd-9546-57614d916572 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab48b332e534992a5bfa32168c2bb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1c0b7015a5430c831865ab53a3006e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:32.899798 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1d620891-0d8b-45cd-9546-57614d916572 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] 10.222.0.52 "GET /compute/v2.1/servers/edf52be3-bcff-4fa6-8ae3-0351aaadd579" status: 200 len: 1314 microversion: 2.1 time: 0.265727 Oct 19 03:36:32.900535 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2540/5006] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:32 2022] GET /compute/v2.1/servers/edf52be3-bcff-4fa6-8ae3-0351aaadd579 => generated 1314 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:36:33.109290 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-8637a851-86e5-4809-ba06-e82bc6d9bde5 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:33.111510 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-8637a851-86e5-4809-ba06-e82bc6d9bde5 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 8955f425-23eb-423e-8ed4-eea1bd5dbc08] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:33.126951 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8637a851-86e5-4809-ba06-e82bc6d9bde5 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:33.130157 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8637a851-86e5-4809-ba06-e82bc6d9bde5 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:33.131115 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8637a851-86e5-4809-ba06-e82bc6d9bde5 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:33.134131 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8637a851-86e5-4809-ba06-e82bc6d9bde5 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:33.137857 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8637a851-86e5-4809-ba06-e82bc6d9bde5 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:33.139723 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8637a851-86e5-4809-ba06-e82bc6d9bde5 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:33.351465 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-8637a851-86e5-4809-ba06-e82bc6d9bde5 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4729a0afd69480f99642266e0eec17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce5e9f9a4644b27a24b2f4c06df97bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:33.362039 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-8637a851-86e5-4809-ba06-e82bc6d9bde5 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/8955f425-23eb-423e-8ed4-eea1bd5dbc08" status: 200 len: 1511 microversion: 2.1 time: 0.259690 Oct 19 03:36:33.368460 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2541/5007] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:33 2022] GET /compute/v2.1/servers/8955f425-23eb-423e-8ed4-eea1bd5dbc08 => generated 1511 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:36:33.927943 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-cad2e5ea-ec54-4b17-ab0a-52e9d4f92eb2 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:33.930939 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-cad2e5ea-ec54-4b17-ab0a-52e9d4f92eb2 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] [instance: edf52be3-bcff-4fa6-8ae3-0351aaadd579] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:33.962620 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cad2e5ea-ec54-4b17-ab0a-52e9d4f92eb2 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:33.973115 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cad2e5ea-ec54-4b17-ab0a-52e9d4f92eb2 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:33.973693 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cad2e5ea-ec54-4b17-ab0a-52e9d4f92eb2 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:33.977238 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cad2e5ea-ec54-4b17-ab0a-52e9d4f92eb2 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:33.978391 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cad2e5ea-ec54-4b17-ab0a-52e9d4f92eb2 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:33.981103 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cad2e5ea-ec54-4b17-ab0a-52e9d4f92eb2 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:34.214143 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-cad2e5ea-ec54-4b17-ab0a-52e9d4f92eb2 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab48b332e534992a5bfa32168c2bb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1c0b7015a5430c831865ab53a3006e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:34.228181 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-cad2e5ea-ec54-4b17-ab0a-52e9d4f92eb2 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] 10.222.0.52 "GET /compute/v2.1/servers/edf52be3-bcff-4fa6-8ae3-0351aaadd579" status: 200 len: 1314 microversion: 2.1 time: 0.305769 Oct 19 03:36:34.229971 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2542/5008] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:33 2022] GET /compute/v2.1/servers/edf52be3-bcff-4fa6-8ae3-0351aaadd579 => generated 1314 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:36:34.367873 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:36:34.398200 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f298d53d-ebc9-4817-b69c-ac12498fab48 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:34.399586 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f298d53d-ebc9-4817-b69c-ac12498fab48 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 8955f425-23eb-423e-8ed4-eea1bd5dbc08] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:34.411313 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f298d53d-ebc9-4817-b69c-ac12498fab48 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:34.412375 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f298d53d-ebc9-4817-b69c-ac12498fab48 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:34.413264 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f298d53d-ebc9-4817-b69c-ac12498fab48 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:34.419821 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f298d53d-ebc9-4817-b69c-ac12498fab48 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:34.419821 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f298d53d-ebc9-4817-b69c-ac12498fab48 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:34.419821 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f298d53d-ebc9-4817-b69c-ac12498fab48 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:34.467313 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c5d0122f-ef99-478b-ab79-6c85229e6df2 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21] Doing local delete in cell d204a9a6-30d3-4569-8922-0d4cbe966b78(cell1) {{(pid=121134) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 19 03:36:34.468732 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c5d0122f-ef99-478b-ab79-6c85229e6df2 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:34.471239 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c5d0122f-ef99-478b-ab79-6c85229e6df2 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:34.471828 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c5d0122f-ef99-478b-ab79-6c85229e6df2 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:34.472984 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.compute.api [None req-c5d0122f-ef99-478b-ab79-6c85229e6df2 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 19 03:36:34.481449 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-c5d0122f-ef99-478b-ab79-6c85229e6df2 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21] deallocate_for_instance() {{(pid=121134) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 19 03:36:34.852682 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f298d53d-ebc9-4817-b69c-ac12498fab48 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4729a0afd69480f99642266e0eec17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce5e9f9a4644b27a24b2f4c06df97bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:34.867385 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f298d53d-ebc9-4817-b69c-ac12498fab48 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/8955f425-23eb-423e-8ed4-eea1bd5dbc08" status: 200 len: 1511 microversion: 2.1 time: 0.480036 Oct 19 03:36:34.867385 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2543/5009] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:34 2022] GET /compute/v2.1/servers/8955f425-23eb-423e-8ed4-eea1bd5dbc08 => generated 1511 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:36:34.878896 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-e43227d3-2c72-4f65-9606-23c49ac4074a req-e8e2d7e4-50ba-42e7-92f7-d951cda369a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edf52be3-bcff-4fa6-8ae3-0351aaadd579", "name": "network-vif-plugged", "status": "completed", "tag": "7d372a74-7a61-47f3-96d5-83f1bbe331fa"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:36:34.900491 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-e43227d3-2c72-4f65-9606-23c49ac4074a req-e8e2d7e4-50ba-42e7-92f7-d951cda369a5 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:34.901528 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-e43227d3-2c72-4f65-9606-23c49ac4074a req-e8e2d7e4-50ba-42e7-92f7-d951cda369a5 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:34.902236 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-e43227d3-2c72-4f65-9606-23c49ac4074a req-e8e2d7e4-50ba-42e7-92f7-d951cda369a5 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:34.919930 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-e43227d3-2c72-4f65-9606-23c49ac4074a req-e8e2d7e4-50ba-42e7-92f7-d951cda369a5 service nova] Creating event network-vif-plugged:7d372a74-7a61-47f3-96d5-83f1bbe331fa for instance edf52be3-bcff-4fa6-8ae3-0351aaadd579 on n-h2-861333-8 Oct 19 03:36:34.927178 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-e43227d3-2c72-4f65-9606-23c49ac4074a req-e8e2d7e4-50ba-42e7-92f7-d951cda369a5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056310 Oct 19 03:36:34.928415 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2544/5010] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:36:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:36:35.258636 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-141c78c8-a8cd-4c9a-b2c7-06ea93c8d37b tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:35.259906 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-141c78c8-a8cd-4c9a-b2c7-06ea93c8d37b tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] [instance: edf52be3-bcff-4fa6-8ae3-0351aaadd579] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:35.278562 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-141c78c8-a8cd-4c9a-b2c7-06ea93c8d37b tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:35.279155 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-141c78c8-a8cd-4c9a-b2c7-06ea93c8d37b tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:35.279644 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-141c78c8-a8cd-4c9a-b2c7-06ea93c8d37b tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:35.283475 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-141c78c8-a8cd-4c9a-b2c7-06ea93c8d37b tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:35.284427 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-141c78c8-a8cd-4c9a-b2c7-06ea93c8d37b tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:35.286614 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-141c78c8-a8cd-4c9a-b2c7-06ea93c8d37b tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:35.592492 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-141c78c8-a8cd-4c9a-b2c7-06ea93c8d37b tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab48b332e534992a5bfa32168c2bb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1c0b7015a5430c831865ab53a3006e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:35.602025 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-141c78c8-a8cd-4c9a-b2c7-06ea93c8d37b tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] 10.222.0.52 "GET /compute/v2.1/servers/edf52be3-bcff-4fa6-8ae3-0351aaadd579" status: 200 len: 1314 microversion: 2.1 time: 0.348601 Oct 19 03:36:35.603570 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2545/5011] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:35 2022] GET /compute/v2.1/servers/edf52be3-bcff-4fa6-8ae3-0351aaadd579 => generated 1314 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:36:35.698674 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-5d501f0b-6d58-41c6-8128-cae0780ad5dc req-8deafbcb-fd11-42d5-9cd9-a5bca9e859da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21", "name": "network-vif-deleted", "tag": "01eed7bc-5062-4113-9784-b44646110510"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:36:35.710821 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-5d501f0b-6d58-41c6-8128-cae0780ad5dc req-8deafbcb-fd11-42d5-9cd9-a5bca9e859da service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:35.711313 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-5d501f0b-6d58-41c6-8128-cae0780ad5dc req-8deafbcb-fd11-42d5-9cd9-a5bca9e859da service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:35.711806 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-5d501f0b-6d58-41c6-8128-cae0780ad5dc req-8deafbcb-fd11-42d5-9cd9-a5bca9e859da service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:35.726520 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.compute.server_external_events [req-5d501f0b-6d58-41c6-8128-cae0780ad5dc req-8deafbcb-fd11-42d5-9cd9-a5bca9e859da service nova] Unable to find a host for instance e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21. Dropping event network-vif-deleted {{(pid=121135) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 19 03:36:35.727805 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-5d501f0b-6d58-41c6-8128-cae0780ad5dc req-8deafbcb-fd11-42d5-9cd9-a5bca9e859da service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.033862 Oct 19 03:36:35.732652 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2546/5012] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:36:35 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 39 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Oct 19 03:36:35.808722 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-c5d0122f-ef99-478b-ab79-6c85229e6df2 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21] Updating instance_info_cache with network_info: [] {{(pid=121134) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 19 03:36:35.894190 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-50d432be-891f-4c27-a89d-588ae8ae4f4c tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:35.895520 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-50d432be-891f-4c27-a89d-588ae8ae4f4c tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 8955f425-23eb-423e-8ed4-eea1bd5dbc08] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:35.902258 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-50d432be-891f-4c27-a89d-588ae8ae4f4c tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:35.903110 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-50d432be-891f-4c27-a89d-588ae8ae4f4c tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:35.903543 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-50d432be-891f-4c27-a89d-588ae8ae4f4c tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:35.904314 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-50d432be-891f-4c27-a89d-588ae8ae4f4c tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:35.904799 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-50d432be-891f-4c27-a89d-588ae8ae4f4c tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:35.905234 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-50d432be-891f-4c27-a89d-588ae8ae4f4c tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:36.100245 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-50d432be-891f-4c27-a89d-588ae8ae4f4c tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4729a0afd69480f99642266e0eec17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce5e9f9a4644b27a24b2f4c06df97bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:36.114770 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-50d432be-891f-4c27-a89d-588ae8ae4f4c tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/8955f425-23eb-423e-8ed4-eea1bd5dbc08" status: 200 len: 1511 microversion: 2.1 time: 0.225349 Oct 19 03:36:36.130060 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2547/5013] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:35 2022] GET /compute/v2.1/servers/8955f425-23eb-423e-8ed4-eea1bd5dbc08 => generated 1511 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:36:36.627857 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-005d76d4-1923-4c28-b5ea-53b3a12bd919 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:36.628375 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-005d76d4-1923-4c28-b5ea-53b3a12bd919 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] [instance: edf52be3-bcff-4fa6-8ae3-0351aaadd579] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:36.642534 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-005d76d4-1923-4c28-b5ea-53b3a12bd919 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:36.645314 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-005d76d4-1923-4c28-b5ea-53b3a12bd919 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:36.645968 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-005d76d4-1923-4c28-b5ea-53b3a12bd919 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:36.650524 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-005d76d4-1923-4c28-b5ea-53b3a12bd919 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:36.655479 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-005d76d4-1923-4c28-b5ea-53b3a12bd919 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:36.655479 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-005d76d4-1923-4c28-b5ea-53b3a12bd919 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:36.681251 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c5d0122f-ef99-478b-ab79-6c85229e6df2 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "DELETE /compute/v2.1/servers/e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21" status: 204 len: 0 microversion: 2.1 time: 4.275538 Oct 19 03:36:36.688156 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2467/5014] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:36:32 2022] DELETE /compute/v2.1/servers/e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21 => generated 0 bytes in 4277 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:36:36.691221 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c4b46f47-d6f7-4df3-9b9f-a70c970e41a6 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:36.691955 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c4b46f47-d6f7-4df3-9b9f-a70c970e41a6 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:36.718154 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c4b46f47-d6f7-4df3-9b9f-a70c970e41a6 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:36.718154 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c4b46f47-d6f7-4df3-9b9f-a70c970e41a6 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:36.720680 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c4b46f47-d6f7-4df3-9b9f-a70c970e41a6 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:36.723309 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c4b46f47-d6f7-4df3-9b9f-a70c970e41a6 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:36.724137 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c4b46f47-d6f7-4df3-9b9f-a70c970e41a6 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:36.724756 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c4b46f47-d6f7-4df3-9b9f-a70c970e41a6 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:36.744351 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-c4b46f47-d6f7-4df3-9b9f-a70c970e41a6 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] HTTP exception thrown: Instance e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21 could not be found. Oct 19 03:36:36.746865 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c4b46f47-d6f7-4df3-9b9f-a70c970e41a6 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Request method failure captured: Oct 19 03:36:36.746865 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21 HTTP/1.1 Oct 19 03:36:36.746865 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:36:36.746865 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:36:36.746865 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:36:36.746865 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:36:36.746865 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:36:36.746865 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:36:36.746865 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:36:36.746865 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:36:36.746865 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT260MiyV65qXgKOsfu6szlvH8BpT6lTW39le6GeB1VFhX0NvYWazEEMcFsPSbHLVkGCs6vY26nud47iZUvRrXjMTSm7xCeqvs3FV0buG-kYWzpyMEv10k1w1En6NH8mRVf9qJ3OJ_AYxVTEN4XseatoNJyXso6kEWPzPG5n5qhJZ8ME Oct 19 03:36:36.746865 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:36:36.746865 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:36:36.746865 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:36:36.746865 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:36:36.746865 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:36:36.746865 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:36:36.746865 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: a5f56376721941f8ae2293f8f969db84 Oct 19 03:36:36.746865 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ServerActionsTestJSON-1598778355 Oct 19 03:36:36.746865 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:36:36.746865 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:36:36.746865 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a5f56376721941f8ae2293f8f969db84"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a5f56376721941f8ae2293f8f969db84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a5f56376721941f8ae2293f8f969db84"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a5f56376721941f8ae2293f8f969db84", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:36:36.746865 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ServerActionsTestJSON-1598778355 Oct 19 03:36:36.746865 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: a5f56376721941f8ae2293f8f969db84 Oct 19 03:36:36.746865 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ServerActionsTestJSON-1598778355 Oct 19 03:36:36.746865 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ServerActionsTestJSON-1598778355-project Oct 19 03:36:36.746865 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:36:36.746865 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:36:36.746865 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 746e1034a7ee40c1a69c8838c1e17e16 Oct 19 03:36:36.746865 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ServerActionsTestJSON-1598778355-project Oct 19 03:36:36.746865 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:36:36.746865 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21 could not be found. Oct 19 03:36:36.746865 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': 'e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21'} Oct 19 03:36:36.746865 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:36:36.746865 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:36:36.746865 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:36:36.746865 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:36:36.746865 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:36:36.746865 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:36:36.746865 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:36:36.746865 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:36:36.746865 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:36:36.746865 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:36:36.746865 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21 could not be found. Oct 19 03:36:36.746865 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:36:36.746865 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:36:36.746865 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:36:36.746865 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:36:36.746865 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:36:36.746865 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:36:36.746865 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:36:36.746865 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:36:36.746865 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:36:36.746865 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:36:36.746865 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:36:36.746865 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:36:36.746865 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:36:36.746865 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:36:36.746865 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:36:36.746865 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:36:36.746865 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21 could not be found. Oct 19 03:36:36.746865 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:36:36.746865 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:36:36.746865 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:36:36.752133 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:36:36.752133 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:36:36.752133 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:36:36.752133 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:36:36.752133 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:36:36.752133 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21 could not be found. Oct 19 03:36:36.752133 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:36:36.755667 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c4b46f47-d6f7-4df3-9b9f-a70c970e41a6 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Returning 404 to user: Instance e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:36:36.755667 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c4b46f47-d6f7-4df3-9b9f-a70c970e41a6 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21" status: 404 len: 111 microversion: 2.1 time: 0.068334 Oct 19 03:36:36.756183 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2468/5015] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:36 2022] GET /compute/v2.1/servers/e92793fc-6c9f-4e1b-bc19-cc1aa27d9e21 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 03:36:36.764719 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5f88cd22-e865-479b-82f0-d4d6902d61e6 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:36.765685 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5f88cd22-e865-479b-82f0-d4d6902d61e6 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 04f651af-d26c-4307-bb5a-bf3a61160dbb] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:36.774498 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5f88cd22-e865-479b-82f0-d4d6902d61e6 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:36.774498 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5f88cd22-e865-479b-82f0-d4d6902d61e6 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:36.777064 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5f88cd22-e865-479b-82f0-d4d6902d61e6 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:36.778078 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5f88cd22-e865-479b-82f0-d4d6902d61e6 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:36.778703 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5f88cd22-e865-479b-82f0-d4d6902d61e6 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:36.779303 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5f88cd22-e865-479b-82f0-d4d6902d61e6 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:36.812941 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5f88cd22-e865-479b-82f0-d4d6902d61e6 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 04f651af-d26c-4307-bb5a-bf3a61160dbb] Going to try to terminate instance {{(pid=121134) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:36:36.946266 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-005d76d4-1923-4c28-b5ea-53b3a12bd919 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab48b332e534992a5bfa32168c2bb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1c0b7015a5430c831865ab53a3006e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:36.958747 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-005d76d4-1923-4c28-b5ea-53b3a12bd919 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] 10.222.0.52 "GET /compute/v2.1/servers/edf52be3-bcff-4fa6-8ae3-0351aaadd579" status: 200 len: 1314 microversion: 2.1 time: 0.335579 Oct 19 03:36:36.959442 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2548/5016] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:36 2022] GET /compute/v2.1/servers/edf52be3-bcff-4fa6-8ae3-0351aaadd579 => generated 1314 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:36:37.145791 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-241281c8-e1a6-488e-bf3c-555b9ce63bc1 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:37.146524 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-241281c8-e1a6-488e-bf3c-555b9ce63bc1 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 8955f425-23eb-423e-8ed4-eea1bd5dbc08] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:37.152122 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5f88cd22-e865-479b-82f0-d4d6902d61e6 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "DELETE /compute/v2.1/servers/04f651af-d26c-4307-bb5a-bf3a61160dbb" status: 204 len: 0 microversion: 2.1 time: 0.391481 Oct 19 03:36:37.153602 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-241281c8-e1a6-488e-bf3c-555b9ce63bc1 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:37.153993 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2469/5017] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:36:36 2022] DELETE /compute/v2.1/servers/04f651af-d26c-4307-bb5a-bf3a61160dbb => generated 0 bytes in 395 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:36:37.154843 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-241281c8-e1a6-488e-bf3c-555b9ce63bc1 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:37.155297 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-241281c8-e1a6-488e-bf3c-555b9ce63bc1 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:37.156040 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-241281c8-e1a6-488e-bf3c-555b9ce63bc1 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:37.156641 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-241281c8-e1a6-488e-bf3c-555b9ce63bc1 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:37.157295 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-241281c8-e1a6-488e-bf3c-555b9ce63bc1 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:37.173850 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-560b5a29-ddfc-4909-9952-cf780a2a1d92 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:37.174637 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-560b5a29-ddfc-4909-9952-cf780a2a1d92 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 04f651af-d26c-4307-bb5a-bf3a61160dbb] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:37.187548 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-560b5a29-ddfc-4909-9952-cf780a2a1d92 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:37.188055 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-560b5a29-ddfc-4909-9952-cf780a2a1d92 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:37.188505 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-560b5a29-ddfc-4909-9952-cf780a2a1d92 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:37.192960 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-560b5a29-ddfc-4909-9952-cf780a2a1d92 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:37.192960 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-560b5a29-ddfc-4909-9952-cf780a2a1d92 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:37.192960 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-560b5a29-ddfc-4909-9952-cf780a2a1d92 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:37.328506 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-560b5a29-ddfc-4909-9952-cf780a2a1d92 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:37.340283 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-560b5a29-ddfc-4909-9952-cf780a2a1d92 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/04f651af-d26c-4307-bb5a-bf3a61160dbb" status: 200 len: 1466 microversion: 2.1 time: 0.181794 Oct 19 03:36:37.341319 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2470/5018] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:37 2022] GET /compute/v2.1/servers/04f651af-d26c-4307-bb5a-bf3a61160dbb => generated 1466 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:36:37.370598 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-241281c8-e1a6-488e-bf3c-555b9ce63bc1 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4729a0afd69480f99642266e0eec17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce5e9f9a4644b27a24b2f4c06df97bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:37.379580 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-241281c8-e1a6-488e-bf3c-555b9ce63bc1 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/8955f425-23eb-423e-8ed4-eea1bd5dbc08" status: 200 len: 1517 microversion: 2.1 time: 0.239319 Oct 19 03:36:37.380510 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2549/5019] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:37 2022] GET /compute/v2.1/servers/8955f425-23eb-423e-8ed4-eea1bd5dbc08 => generated 1517 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:36:37.987832 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-df539c95-7937-4436-b8d4-35bbda874a10 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:37.989149 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-df539c95-7937-4436-b8d4-35bbda874a10 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] [instance: edf52be3-bcff-4fa6-8ae3-0351aaadd579] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:38.000382 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-df539c95-7937-4436-b8d4-35bbda874a10 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:38.002992 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-df539c95-7937-4436-b8d4-35bbda874a10 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:38.005306 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-df539c95-7937-4436-b8d4-35bbda874a10 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:38.006459 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-df539c95-7937-4436-b8d4-35bbda874a10 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:38.010172 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-df539c95-7937-4436-b8d4-35bbda874a10 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:38.010927 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-df539c95-7937-4436-b8d4-35bbda874a10 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:38.301796 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-df539c95-7937-4436-b8d4-35bbda874a10 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab48b332e534992a5bfa32168c2bb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1c0b7015a5430c831865ab53a3006e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:38.321620 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-df539c95-7937-4436-b8d4-35bbda874a10 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] 10.222.0.52 "GET /compute/v2.1/servers/edf52be3-bcff-4fa6-8ae3-0351aaadd579" status: 200 len: 1499 microversion: 2.1 time: 0.339596 Oct 19 03:36:38.322363 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2471/5020] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:37 2022] GET /compute/v2.1/servers/edf52be3-bcff-4fa6-8ae3-0351aaadd579 => generated 1499 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:36:38.366583 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-071fd6eb-4c63-4bfe-901a-43201ee66898 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:38.367957 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-071fd6eb-4c63-4bfe-901a-43201ee66898 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 04f651af-d26c-4307-bb5a-bf3a61160dbb] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:38.384653 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-071fd6eb-4c63-4bfe-901a-43201ee66898 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:38.389313 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-071fd6eb-4c63-4bfe-901a-43201ee66898 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:38.396429 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-071fd6eb-4c63-4bfe-901a-43201ee66898 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:38.396429 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-071fd6eb-4c63-4bfe-901a-43201ee66898 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:38.396429 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-071fd6eb-4c63-4bfe-901a-43201ee66898 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:38.396716 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-071fd6eb-4c63-4bfe-901a-43201ee66898 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:38.605271 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-071fd6eb-4c63-4bfe-901a-43201ee66898 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:38.616662 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-071fd6eb-4c63-4bfe-901a-43201ee66898 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/04f651af-d26c-4307-bb5a-bf3a61160dbb" status: 200 len: 1466 microversion: 2.1 time: 0.256381 Oct 19 03:36:38.618467 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2550/5021] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:38 2022] GET /compute/v2.1/servers/04f651af-d26c-4307-bb5a-bf3a61160dbb => generated 1466 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:36:39.610033 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-1075ad35-534a-4b93-a558-e130a59422b4 req-cdb0713e-a8a7-42db-b036-695b77c7679b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04f651af-d26c-4307-bb5a-bf3a61160dbb", "name": "network-vif-deleted", "tag": "0715ea39-28fd-4185-92f0-be5a375273f1"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:36:39.644867 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d9f1959b-cbc5-4ecf-bc31-28088122fb03 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:39.646954 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d9f1959b-cbc5-4ecf-bc31-28088122fb03 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 04f651af-d26c-4307-bb5a-bf3a61160dbb] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:39.650636 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-1075ad35-534a-4b93-a558-e130a59422b4 req-cdb0713e-a8a7-42db-b036-695b77c7679b service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:39.651390 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-1075ad35-534a-4b93-a558-e130a59422b4 req-cdb0713e-a8a7-42db-b036-695b77c7679b service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:39.658818 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-1075ad35-534a-4b93-a558-e130a59422b4 req-cdb0713e-a8a7-42db-b036-695b77c7679b service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:39.669213 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d9f1959b-cbc5-4ecf-bc31-28088122fb03 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:39.671823 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d9f1959b-cbc5-4ecf-bc31-28088122fb03 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:39.672794 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d9f1959b-cbc5-4ecf-bc31-28088122fb03 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:39.676237 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d9f1959b-cbc5-4ecf-bc31-28088122fb03 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:39.678690 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d9f1959b-cbc5-4ecf-bc31-28088122fb03 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:39.679400 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d9f1959b-cbc5-4ecf-bc31-28088122fb03 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:39.713837 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-1075ad35-534a-4b93-a558-e130a59422b4 req-cdb0713e-a8a7-42db-b036-695b77c7679b service nova] Creating event network-vif-deleted:0715ea39-28fd-4185-92f0-be5a375273f1 for instance 04f651af-d26c-4307-bb5a-bf3a61160dbb on n-h1-861333-8 Oct 19 03:36:39.713837 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-1075ad35-534a-4b93-a558-e130a59422b4 req-cdb0713e-a8a7-42db-b036-695b77c7679b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103129 Oct 19 03:36:39.714425 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2472/5022] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:36:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:36:39.813577 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d9f1959b-cbc5-4ecf-bc31-28088122fb03 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:39.842769 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d9f1959b-cbc5-4ecf-bc31-28088122fb03 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/04f651af-d26c-4307-bb5a-bf3a61160dbb" status: 200 len: 1466 microversion: 2.1 time: 0.202938 Oct 19 03:36:39.843382 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2551/5023] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:39 2022] GET /compute/v2.1/servers/04f651af-d26c-4307-bb5a-bf3a61160dbb => generated 1466 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:36:39.953031 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a3ac443a-3123-4657-b123-38d062226686 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:39.953667 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a3ac443a-3123-4657-b123-38d062226686 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] [instance: edf52be3-bcff-4fa6-8ae3-0351aaadd579] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:39.955758 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:36:39.966034 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a3ac443a-3123-4657-b123-38d062226686 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:39.966907 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a3ac443a-3123-4657-b123-38d062226686 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:39.967539 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a3ac443a-3123-4657-b123-38d062226686 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:39.968441 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a3ac443a-3123-4657-b123-38d062226686 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:39.969067 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a3ac443a-3123-4657-b123-38d062226686 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:39.969702 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a3ac443a-3123-4657-b123-38d062226686 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:40.030930 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a3ac443a-3123-4657-b123-38d062226686 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] [instance: edf52be3-bcff-4fa6-8ae3-0351aaadd579] Going to try to terminate instance {{(pid=121134) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:36:40.437852 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-52621051-0250-4c64-a818-4f6fa4c1351c tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Action: 'create', calling method: .version_select at 0x7fc12be3a700>, body: {"keypair": {"name": "tempest-keypair-1877360926", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGIiQo3JVZ6tcxH8fiVTKwNwiax5+h97XpzTBlszzhgy6lzbjYvN2nuiuKEK7qazAqEZQoLaOBDPoOTwOtpxfb9IhMNRbZKvnZZeGMOi+CGiY6hk9iBz2yrqzY0AQUKpGQ=="}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:36:40.472536 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-52621051-0250-4c64-a818-4f6fa4c1351c tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Getting quotas for project 2ce5e9f9a4644b27a24b2f4c06df97bc. Resources: {'key_pairs'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:36:40.485110 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-52621051-0250-4c64-a818-4f6fa4c1351c tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Getting quotas for user b4729a0afd69480f99642266e0eec17e and project 2ce5e9f9a4644b27a24b2f4c06df97bc. Resources: {'key_pairs'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:36:40.533919 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a3ac443a-3123-4657-b123-38d062226686 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] 10.222.0.52 "DELETE /compute/v2.1/servers/edf52be3-bcff-4fa6-8ae3-0351aaadd579" status: 204 len: 0 microversion: 2.1 time: 0.585608 Oct 19 03:36:40.536871 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2473/5024] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:36:39 2022] DELETE /compute/v2.1/servers/edf52be3-bcff-4fa6-8ae3-0351aaadd579 => generated 0 bytes in 589 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:36:40.545422 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-52cde65d-9cf3-49a6-8b0f-a34f00be9739 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:40.548502 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-52cde65d-9cf3-49a6-8b0f-a34f00be9739 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] [instance: edf52be3-bcff-4fa6-8ae3-0351aaadd579] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:40.575502 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-52cde65d-9cf3-49a6-8b0f-a34f00be9739 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:40.576000 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-52cde65d-9cf3-49a6-8b0f-a34f00be9739 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:40.576453 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-52cde65d-9cf3-49a6-8b0f-a34f00be9739 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:40.577186 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-52cde65d-9cf3-49a6-8b0f-a34f00be9739 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:40.577716 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-52cde65d-9cf3-49a6-8b0f-a34f00be9739 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:40.582804 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-52cde65d-9cf3-49a6-8b0f-a34f00be9739 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:40.627700 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-52621051-0250-4c64-a818-4f6fa4c1351c tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.192287 Oct 19 03:36:40.629754 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2552/5025] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Oct 19 03:36:40 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:36:40.867212 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b1fc93e7-9965-42e2-af03-aef52d4068a7 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:40.867922 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b1fc93e7-9965-42e2-af03-aef52d4068a7 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 04f651af-d26c-4307-bb5a-bf3a61160dbb] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:40.879680 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b1fc93e7-9965-42e2-af03-aef52d4068a7 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:40.881085 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b1fc93e7-9965-42e2-af03-aef52d4068a7 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:40.881838 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b1fc93e7-9965-42e2-af03-aef52d4068a7 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:40.887008 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b1fc93e7-9965-42e2-af03-aef52d4068a7 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:40.889123 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b1fc93e7-9965-42e2-af03-aef52d4068a7 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:40.889959 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b1fc93e7-9965-42e2-af03-aef52d4068a7 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:40.928513 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b1fc93e7-9965-42e2-af03-aef52d4068a7 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:40.929026 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b1fc93e7-9965-42e2-af03-aef52d4068a7 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:40.929488 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b1fc93e7-9965-42e2-af03-aef52d4068a7 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:40.933239 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-b1fc93e7-9965-42e2-af03-aef52d4068a7 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lazy-loading 'fault' on Instance uuid 04f651af-d26c-4307-bb5a-bf3a61160dbb {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:36:41.247780 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b1fc93e7-9965-42e2-af03-aef52d4068a7 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:41.256987 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b1fc93e7-9965-42e2-af03-aef52d4068a7 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/04f651af-d26c-4307-bb5a-bf3a61160dbb" status: 200 len: 1305 microversion: 2.1 time: 0.395274 Oct 19 03:36:41.257606 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2553/5026] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:40 2022] GET /compute/v2.1/servers/04f651af-d26c-4307-bb5a-bf3a61160dbb => generated 1305 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:36:41.279502 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-52cde65d-9cf3-49a6-8b0f-a34f00be9739 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab48b332e534992a5bfa32168c2bb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1c0b7015a5430c831865ab53a3006e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:41.287480 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-52cde65d-9cf3-49a6-8b0f-a34f00be9739 tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] 10.222.0.52 "GET /compute/v2.1/servers/edf52be3-bcff-4fa6-8ae3-0351aaadd579" status: 200 len: 1505 microversion: 2.1 time: 0.746375 Oct 19 03:36:41.288030 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2474/5027] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:40 2022] GET /compute/v2.1/servers/edf52be3-bcff-4fa6-8ae3-0351aaadd579 => generated 1505 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:36:42.280236 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1a44753a-15d8-435f-832e-6bc7c707236b tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:42.281034 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1a44753a-15d8-435f-832e-6bc7c707236b tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 04f651af-d26c-4307-bb5a-bf3a61160dbb] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:42.288052 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1a44753a-15d8-435f-832e-6bc7c707236b tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:42.288802 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1a44753a-15d8-435f-832e-6bc7c707236b tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:42.289626 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1a44753a-15d8-435f-832e-6bc7c707236b tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:42.290501 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1a44753a-15d8-435f-832e-6bc7c707236b tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:42.291952 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1a44753a-15d8-435f-832e-6bc7c707236b tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:42.293082 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1a44753a-15d8-435f-832e-6bc7c707236b tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:42.299192 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=100 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:36:42.312838 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-16c47e47-dc41-4070-9b80-a620777b0aec tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:42.314123 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-16c47e47-dc41-4070-9b80-a620777b0aec tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] [instance: edf52be3-bcff-4fa6-8ae3-0351aaadd579] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:42.320549 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-1a44753a-15d8-435f-832e-6bc7c707236b tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] HTTP exception thrown: Instance 04f651af-d26c-4307-bb5a-bf3a61160dbb could not be found. Oct 19 03:36:42.325700 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-16c47e47-dc41-4070-9b80-a620777b0aec tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:42.327721 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1a44753a-15d8-435f-832e-6bc7c707236b tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Request method failure captured: Oct 19 03:36:42.327721 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/04f651af-d26c-4307-bb5a-bf3a61160dbb HTTP/1.1 Oct 19 03:36:42.327721 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:36:42.327721 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:36:42.327721 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:36:42.327721 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:36:42.327721 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:36:42.327721 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:36:42.327721 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:36:42.327721 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:36:42.327721 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT260MiyV65qXgKOsfu6szlvH8BpT6lTW39le6GeB1VFhX0NvYWazEEMcFsPSbHLVkGCs6vY26nud47iZUvRrXjMTSm7xCeqvs3FV0buG-kYWzpyMEv10k1w1En6NH8mRVf9qJ3OJ_AYxVTEN4XseatoNJyXso6kEWPzPG5n5qhJZ8ME Oct 19 03:36:42.327721 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:36:42.327721 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:36:42.327721 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:36:42.327721 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:36:42.327721 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:36:42.327721 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:36:42.327721 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: a5f56376721941f8ae2293f8f969db84 Oct 19 03:36:42.327721 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ServerActionsTestJSON-1598778355 Oct 19 03:36:42.327721 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:36:42.327721 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:36:42.327721 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a5f56376721941f8ae2293f8f969db84"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a5f56376721941f8ae2293f8f969db84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a5f56376721941f8ae2293f8f969db84"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a5f56376721941f8ae2293f8f969db84", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:36:42.327721 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ServerActionsTestJSON-1598778355 Oct 19 03:36:42.327721 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: a5f56376721941f8ae2293f8f969db84 Oct 19 03:36:42.327721 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ServerActionsTestJSON-1598778355 Oct 19 03:36:42.327721 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ServerActionsTestJSON-1598778355-project Oct 19 03:36:42.327721 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:36:42.327721 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:36:42.327721 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 746e1034a7ee40c1a69c8838c1e17e16 Oct 19 03:36:42.327721 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ServerActionsTestJSON-1598778355-project Oct 19 03:36:42.327721 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:36:42.327721 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance 04f651af-d26c-4307-bb5a-bf3a61160dbb could not be found. Oct 19 03:36:42.327721 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '04f651af-d26c-4307-bb5a-bf3a61160dbb'} Oct 19 03:36:42.327721 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:36:42.327721 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:36:42.327721 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:36:42.327721 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:36:42.327721 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:36:42.327721 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:36:42.327721 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:36:42.327721 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:36:42.327721 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:36:42.327721 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:36:42.327721 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04f651af-d26c-4307-bb5a-bf3a61160dbb could not be found. Oct 19 03:36:42.327721 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:36:42.327721 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:36:42.327721 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:36:42.327721 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:36:42.327721 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:36:42.327721 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:36:42.327721 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:36:42.327721 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:36:42.327721 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:36:42.327721 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:36:42.327721 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:36:42.327721 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:36:42.327721 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:36:42.327721 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:36:42.327721 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:36:42.327721 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:36:42.327721 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04f651af-d26c-4307-bb5a-bf3a61160dbb could not be found. Oct 19 03:36:42.327721 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:36:42.327721 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:36:42.327721 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:36:42.332912 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:36:42.332912 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:36:42.332912 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:36:42.332912 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:36:42.332912 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:36:42.332912 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04f651af-d26c-4307-bb5a-bf3a61160dbb could not be found. Oct 19 03:36:42.332912 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:36:42.339827 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1a44753a-15d8-435f-832e-6bc7c707236b tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Returning 404 to user: Instance 04f651af-d26c-4307-bb5a-bf3a61160dbb could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:36:42.339827 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1a44753a-15d8-435f-832e-6bc7c707236b tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/04f651af-d26c-4307-bb5a-bf3a61160dbb" status: 404 len: 111 microversion: 2.1 time: 0.059052 Oct 19 03:36:42.339827 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2554/5028] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:42 2022] GET /compute/v2.1/servers/04f651af-d26c-4307-bb5a-bf3a61160dbb => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:36:42.340196 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-16c47e47-dc41-4070-9b80-a620777b0aec tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:42.340196 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-16c47e47-dc41-4070-9b80-a620777b0aec tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:42.340196 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-16c47e47-dc41-4070-9b80-a620777b0aec tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:42.340196 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-16c47e47-dc41-4070-9b80-a620777b0aec tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:42.340196 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-16c47e47-dc41-4070-9b80-a620777b0aec tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:42.348995 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ea53159c-af77-4347-897f-a8146d746e57 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:42.349849 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ea53159c-af77-4347-897f-a8146d746e57 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 3893d3e4-3a09-4adf-951b-84befacf7489] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:42.367441 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ea53159c-af77-4347-897f-a8146d746e57 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:42.368351 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ea53159c-af77-4347-897f-a8146d746e57 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:42.369022 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ea53159c-af77-4347-897f-a8146d746e57 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:42.370638 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ea53159c-af77-4347-897f-a8146d746e57 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:42.371304 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ea53159c-af77-4347-897f-a8146d746e57 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:42.371934 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ea53159c-af77-4347-897f-a8146d746e57 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:42.419231 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ea53159c-af77-4347-897f-a8146d746e57 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 3893d3e4-3a09-4adf-951b-84befacf7489] Going to try to terminate instance {{(pid=121135) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:36:42.817664 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ea53159c-af77-4347-897f-a8146d746e57 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "DELETE /compute/v2.1/servers/3893d3e4-3a09-4adf-951b-84befacf7489" status: 204 len: 0 microversion: 2.1 time: 0.476913 Oct 19 03:36:42.821735 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2555/5029] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:36:42 2022] DELETE /compute/v2.1/servers/3893d3e4-3a09-4adf-951b-84befacf7489 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:36:42.829585 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-16c47e47-dc41-4070-9b80-a620777b0aec tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab48b332e534992a5bfa32168c2bb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1c0b7015a5430c831865ab53a3006e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:42.833261 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c3abe9d7-637e-4230-925c-8817d2f3f822 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:42.835614 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c3abe9d7-637e-4230-925c-8817d2f3f822 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 3893d3e4-3a09-4adf-951b-84befacf7489] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:42.840671 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-16c47e47-dc41-4070-9b80-a620777b0aec tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] 10.222.0.52 "GET /compute/v2.1/servers/edf52be3-bcff-4fa6-8ae3-0351aaadd579" status: 200 len: 1505 microversion: 2.1 time: 0.529799 Oct 19 03:36:42.841611 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2475/5030] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:42 2022] GET /compute/v2.1/servers/edf52be3-bcff-4fa6-8ae3-0351aaadd579 => generated 1505 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:36:42.848294 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:36:42.850661 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c3abe9d7-637e-4230-925c-8817d2f3f822 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:42.852851 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c3abe9d7-637e-4230-925c-8817d2f3f822 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:42.853552 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c3abe9d7-637e-4230-925c-8817d2f3f822 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:42.854753 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c3abe9d7-637e-4230-925c-8817d2f3f822 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:42.856399 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c3abe9d7-637e-4230-925c-8817d2f3f822 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:42.857056 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c3abe9d7-637e-4230-925c-8817d2f3f822 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:43.131927 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-057a6199-e167-4c52-82c1-6ca31d22c4ae req-bdec6c22-a471-4b39-aa58-8ec38f914a6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edf52be3-bcff-4fa6-8ae3-0351aaadd579", "name": "network-vif-deleted", "tag": "7d372a74-7a61-47f3-96d5-83f1bbe331fa"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:36:43.157518 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-057a6199-e167-4c52-82c1-6ca31d22c4ae req-bdec6c22-a471-4b39-aa58-8ec38f914a6d service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:43.158160 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-057a6199-e167-4c52-82c1-6ca31d22c4ae req-bdec6c22-a471-4b39-aa58-8ec38f914a6d service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:43.158680 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-057a6199-e167-4c52-82c1-6ca31d22c4ae req-bdec6c22-a471-4b39-aa58-8ec38f914a6d service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:43.178127 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c3abe9d7-637e-4230-925c-8817d2f3f822 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:43.180146 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-057a6199-e167-4c52-82c1-6ca31d22c4ae req-bdec6c22-a471-4b39-aa58-8ec38f914a6d service nova] Creating event network-vif-deleted:7d372a74-7a61-47f3-96d5-83f1bbe331fa for instance edf52be3-bcff-4fa6-8ae3-0351aaadd579 on n-h2-861333-8 Oct 19 03:36:43.187936 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c3abe9d7-637e-4230-925c-8817d2f3f822 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/3893d3e4-3a09-4adf-951b-84befacf7489" status: 200 len: 1507 microversion: 2.1 time: 0.360619 Oct 19 03:36:43.192772 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2556/5031] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:42 2022] GET /compute/v2.1/servers/3893d3e4-3a09-4adf-951b-84befacf7489 => generated 1507 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:36:43.194914 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-057a6199-e167-4c52-82c1-6ca31d22c4ae req-bdec6c22-a471-4b39-aa58-8ec38f914a6d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067026 Oct 19 03:36:43.196527 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2476/5032] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:36:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:36:43.866470 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5de976d8-c873-4368-923f-3ab411aee82e tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:43.867790 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-5de976d8-c873-4368-923f-3ab411aee82e tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] [instance: edf52be3-bcff-4fa6-8ae3-0351aaadd579] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:43.876053 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5de976d8-c873-4368-923f-3ab411aee82e tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:43.876786 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5de976d8-c873-4368-923f-3ab411aee82e tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:43.877440 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5de976d8-c873-4368-923f-3ab411aee82e tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:43.878372 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5de976d8-c873-4368-923f-3ab411aee82e tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:43.879028 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5de976d8-c873-4368-923f-3ab411aee82e tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:43.879690 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5de976d8-c873-4368-923f-3ab411aee82e tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:43.917614 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5de976d8-c873-4368-923f-3ab411aee82e tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:43.918472 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5de976d8-c873-4368-923f-3ab411aee82e tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:43.919144 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5de976d8-c873-4368-923f-3ab411aee82e tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:43.919806 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-5de976d8-c873-4368-923f-3ab411aee82e tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lazy-loading 'fault' on Instance uuid edf52be3-bcff-4fa6-8ae3-0351aaadd579 {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:36:43.997917 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-5de976d8-c873-4368-923f-3ab411aee82e tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab48b332e534992a5bfa32168c2bb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1c0b7015a5430c831865ab53a3006e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:44.011535 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5de976d8-c873-4368-923f-3ab411aee82e tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] 10.222.0.52 "GET /compute/v2.1/servers/edf52be3-bcff-4fa6-8ae3-0351aaadd579" status: 200 len: 1304 microversion: 2.1 time: 0.149024 Oct 19 03:36:44.014252 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2557/5033] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:43 2022] GET /compute/v2.1/servers/edf52be3-bcff-4fa6-8ae3-0351aaadd579 => generated 1304 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:36:44.218883 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3c5cbec8-fac7-4123-9d62-7b34ad11660f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:44.221671 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3c5cbec8-fac7-4123-9d62-7b34ad11660f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 3893d3e4-3a09-4adf-951b-84befacf7489] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:44.240731 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3c5cbec8-fac7-4123-9d62-7b34ad11660f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:44.241314 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3c5cbec8-fac7-4123-9d62-7b34ad11660f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:44.251388 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3c5cbec8-fac7-4123-9d62-7b34ad11660f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:44.251388 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3c5cbec8-fac7-4123-9d62-7b34ad11660f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:44.251388 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3c5cbec8-fac7-4123-9d62-7b34ad11660f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:44.251388 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3c5cbec8-fac7-4123-9d62-7b34ad11660f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:44.262907 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=18,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:36:44.788292 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c404da21-bd5c-4e08-928a-d8978e03f535 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-108009996", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "75d594ba-6262-405c-928b-1cea9334995a"}], "security_groups": [{"name": "tempest-securitygroup--330022688"}], "key_name": "tempest-keypair-1877360926", "user_data": "}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:36:44.900581 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-3c5cbec8-fac7-4123-9d62-7b34ad11660f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:44.916997 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3c5cbec8-fac7-4123-9d62-7b34ad11660f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/3893d3e4-3a09-4adf-951b-84befacf7489" status: 200 len: 1507 microversion: 2.1 time: 0.701022 Oct 19 03:36:44.917927 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2477/5034] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:44 2022] GET /compute/v2.1/servers/3893d3e4-3a09-4adf-951b-84befacf7489 => generated 1507 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:36:44.984833 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.network.neutron [None req-c404da21-bd5c-4e08-928a-d8978e03f535 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] validate_networks() for [('75d594ba-6262-405c-928b-1cea9334995a', None, None, None, None, None)] {{(pid=121135) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:36:45.036957 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3870d0b6-78b4-4a43-8e6e-b0ddb3b88a7d tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:45.037626 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3870d0b6-78b4-4a43-8e6e-b0ddb3b88a7d tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] [instance: edf52be3-bcff-4fa6-8ae3-0351aaadd579] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:45.048771 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3870d0b6-78b4-4a43-8e6e-b0ddb3b88a7d tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:45.049271 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3870d0b6-78b4-4a43-8e6e-b0ddb3b88a7d tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:45.049742 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3870d0b6-78b4-4a43-8e6e-b0ddb3b88a7d tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:45.050462 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3870d0b6-78b4-4a43-8e6e-b0ddb3b88a7d tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:45.050916 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3870d0b6-78b4-4a43-8e6e-b0ddb3b88a7d tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:45.051364 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3870d0b6-78b4-4a43-8e6e-b0ddb3b88a7d tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:45.076389 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-3870d0b6-78b4-4a43-8e6e-b0ddb3b88a7d tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] HTTP exception thrown: Instance edf52be3-bcff-4fa6-8ae3-0351aaadd579 could not be found. Oct 19 03:36:45.078708 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3870d0b6-78b4-4a43-8e6e-b0ddb3b88a7d tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Request method failure captured: Oct 19 03:36:45.078708 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/edf52be3-bcff-4fa6-8ae3-0351aaadd579 HTTP/1.1 Oct 19 03:36:45.078708 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:36:45.078708 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:36:45.078708 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:36:45.078708 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:36:45.078708 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:36:45.078708 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:36:45.078708 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:36:45.078708 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:36:45.078708 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3CPqHO32whUtQW32WYKcvyEuLRPBQLRLWZg6UyqGC5OT-X-SLALdOGUebjEB1XUWSQgecMXmJxSdBocuPt5hNS896vXPx6oLnh_L1q3W-vXtA_CT_d3TPWsDmTAt6-IMDZ8vuDaPaVeW76JqkYOG9YF9tyfzxCJ1gWHuJEd7I4eOdY Oct 19 03:36:45.078708 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:36:45.078708 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:36:45.078708 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:36:45.078708 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:36:45.078708 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:36:45.078708 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:36:45.078708 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 5e1c0b7015a5430c831865ab53a3006e Oct 19 03:36:45.078708 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-VolumesActionsTest-224645505 Oct 19 03:36:45.078708 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:36:45.078708 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:36:45.078708 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5e1c0b7015a5430c831865ab53a3006e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5e1c0b7015a5430c831865ab53a3006e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5e1c0b7015a5430c831865ab53a3006e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5e1c0b7015a5430c831865ab53a3006e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:36:45.078708 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-VolumesActionsTest-224645505 Oct 19 03:36:45.078708 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 5e1c0b7015a5430c831865ab53a3006e Oct 19 03:36:45.078708 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-VolumesActionsTest-224645505 Oct 19 03:36:45.078708 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-VolumesActionsTest-224645505-project Oct 19 03:36:45.078708 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:36:45.078708 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:36:45.078708 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 1ab48b332e534992a5bfa32168c2bb6d Oct 19 03:36:45.078708 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-VolumesActionsTest-224645505-project Oct 19 03:36:45.078708 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:36:45.078708 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance edf52be3-bcff-4fa6-8ae3-0351aaadd579 could not be found. Oct 19 03:36:45.078708 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': 'edf52be3-bcff-4fa6-8ae3-0351aaadd579'} Oct 19 03:36:45.078708 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:36:45.078708 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:36:45.078708 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:36:45.078708 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:36:45.078708 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:36:45.078708 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:36:45.078708 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:36:45.078708 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:36:45.078708 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:36:45.078708 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:36:45.078708 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edf52be3-bcff-4fa6-8ae3-0351aaadd579 could not be found. Oct 19 03:36:45.078708 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:36:45.078708 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:36:45.078708 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:36:45.078708 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:36:45.078708 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:36:45.078708 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:36:45.078708 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:36:45.078708 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:36:45.078708 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:36:45.078708 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:36:45.078708 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:36:45.078708 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:36:45.078708 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:36:45.078708 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:36:45.078708 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:36:45.078708 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:36:45.078708 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edf52be3-bcff-4fa6-8ae3-0351aaadd579 could not be found. Oct 19 03:36:45.078708 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:36:45.078708 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:36:45.078708 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:36:45.083667 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:36:45.083667 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:36:45.083667 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:36:45.083667 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:36:45.083667 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:36:45.083667 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edf52be3-bcff-4fa6-8ae3-0351aaadd579 could not be found. Oct 19 03:36:45.083667 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:36:45.086307 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3870d0b6-78b4-4a43-8e6e-b0ddb3b88a7d tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] Returning 404 to user: Instance edf52be3-bcff-4fa6-8ae3-0351aaadd579 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:36:45.088911 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3870d0b6-78b4-4a43-8e6e-b0ddb3b88a7d tempest-VolumesActionsTest-224645505 tempest-VolumesActionsTest-224645505-project] 10.222.0.52 "GET /compute/v2.1/servers/edf52be3-bcff-4fa6-8ae3-0351aaadd579" status: 404 len: 111 microversion: 2.1 time: 0.055273 Oct 19 03:36:45.090082 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2478/5035] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:45 2022] GET /compute/v2.1/servers/edf52be3-bcff-4fa6-8ae3-0351aaadd579 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 03:36:45.893062 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-c404da21-bd5c-4e08-928a-d8978e03f535 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Flavor limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:36:45.893817 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-c404da21-bd5c-4e08-928a-d8978e03f535 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Image limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:36:45.895243 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-c404da21-bd5c-4e08-928a-d8978e03f535 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Flavor pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:36:45.896392 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-c404da21-bd5c-4e08-928a-d8978e03f535 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Image pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:36:45.896998 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-c404da21-bd5c-4e08-928a-d8978e03f535 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:36:45.913927 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c404da21-bd5c-4e08-928a-d8978e03f535 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:45.913927 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c404da21-bd5c-4e08-928a-d8978e03f535 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:45.913927 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c404da21-bd5c-4e08-928a-d8978e03f535 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:45.913927 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c404da21-bd5c-4e08-928a-d8978e03f535 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:45.913927 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c404da21-bd5c-4e08-928a-d8978e03f535 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:45.913927 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c404da21-bd5c-4e08-928a-d8978e03f535 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:45.948059 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-c404da21-bd5c-4e08-928a-d8978e03f535 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Getting quotas for project 2ce5e9f9a4644b27a24b2f4c06df97bc. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:36:45.948280 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ea447635-2b65-4afa-97cb-81e9e21b3894 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:45.948925 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ea447635-2b65-4afa-97cb-81e9e21b3894 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 3893d3e4-3a09-4adf-951b-84befacf7489] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:45.956602 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ea447635-2b65-4afa-97cb-81e9e21b3894 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:45.957137 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-c404da21-bd5c-4e08-928a-d8978e03f535 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Getting quotas for user b4729a0afd69480f99642266e0eec17e and project 2ce5e9f9a4644b27a24b2f4c06df97bc. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:36:45.967692 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ea447635-2b65-4afa-97cb-81e9e21b3894 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:45.968175 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ea447635-2b65-4afa-97cb-81e9e21b3894 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:45.968934 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ea447635-2b65-4afa-97cb-81e9e21b3894 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:45.969436 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ea447635-2b65-4afa-97cb-81e9e21b3894 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:45.969882 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ea447635-2b65-4afa-97cb-81e9e21b3894 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:46.015687 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c404da21-bd5c-4e08-928a-d8978e03f535 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Going to run 1 instances... {{(pid=121135) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:36:46.018441 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c404da21-bd5c-4e08-928a-d8978e03f535 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 4fab83b8-8862-4295-adb7-e2bf5462a2d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121135) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:36:46.117873 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ea447635-2b65-4afa-97cb-81e9e21b3894 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:46.127139 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ea447635-2b65-4afa-97cb-81e9e21b3894 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/3893d3e4-3a09-4adf-951b-84befacf7489" status: 200 len: 1465 microversion: 2.1 time: 0.183797 Oct 19 03:36:46.127729 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2479/5036] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:45 2022] GET /compute/v2.1/servers/3893d3e4-3a09-4adf-951b-84befacf7489 => generated 1465 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:36:46.224973 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c404da21-bd5c-4e08-928a-d8978e03f535 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.447135 Oct 19 03:36:46.226142 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2558/5037] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:36:44 2022] POST /compute/v2.1/servers => generated 408 bytes in 1449 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 19 03:36:46.237981 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c9a111c6-e5b5-4653-a8fc-c95ccc0d7a70 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:46.239155 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c9a111c6-e5b5-4653-a8fc-c95ccc0d7a70 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 4fab83b8-8862-4295-adb7-e2bf5462a2d9] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:46.326455 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-ce2552ec-bc25-49f9-a674-1b1f258fd216 req-28087c56-4911-4fd4-a241-e9e8fd6b4c9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3893d3e4-3a09-4adf-951b-84befacf7489", "name": "network-vif-deleted", "tag": "f6bdd5bf-f5c9-4dc4-bb82-96c0e06519e1"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:36:46.356369 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-ce2552ec-bc25-49f9-a674-1b1f258fd216 req-28087c56-4911-4fd4-a241-e9e8fd6b4c9e service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:46.357093 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-ce2552ec-bc25-49f9-a674-1b1f258fd216 req-28087c56-4911-4fd4-a241-e9e8fd6b4c9e service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:46.357799 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-ce2552ec-bc25-49f9-a674-1b1f258fd216 req-28087c56-4911-4fd4-a241-e9e8fd6b4c9e service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:46.372855 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c9a111c6-e5b5-4653-a8fc-c95ccc0d7a70 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4729a0afd69480f99642266e0eec17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce5e9f9a4644b27a24b2f4c06df97bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:46.382446 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c9a111c6-e5b5-4653-a8fc-c95ccc0d7a70 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/4fab83b8-8862-4295-adb7-e2bf5462a2d9" status: 200 len: 1245 microversion: 2.1 time: 0.147485 Oct 19 03:36:46.386254 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2480/5038] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:46 2022] GET /compute/v2.1/servers/4fab83b8-8862-4295-adb7-e2bf5462a2d9 => generated 1245 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:36:46.391054 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-ce2552ec-bc25-49f9-a674-1b1f258fd216 req-28087c56-4911-4fd4-a241-e9e8fd6b4c9e service nova] Creating event network-vif-deleted:f6bdd5bf-f5c9-4dc4-bb82-96c0e06519e1 for instance 3893d3e4-3a09-4adf-951b-84befacf7489 on n-h1-861333-8 Oct 19 03:36:46.402965 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-ce2552ec-bc25-49f9-a674-1b1f258fd216 req-28087c56-4911-4fd4-a241-e9e8fd6b4c9e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085377 Oct 19 03:36:46.404818 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2559/5039] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:36:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:36:47.151643 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d37195c4-0812-4fca-8b15-2a7ab91c9c7e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:47.152274 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d37195c4-0812-4fca-8b15-2a7ab91c9c7e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 3893d3e4-3a09-4adf-951b-84befacf7489] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:47.167254 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d37195c4-0812-4fca-8b15-2a7ab91c9c7e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:47.167546 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d37195c4-0812-4fca-8b15-2a7ab91c9c7e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:47.169455 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d37195c4-0812-4fca-8b15-2a7ab91c9c7e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:47.170339 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d37195c4-0812-4fca-8b15-2a7ab91c9c7e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:47.170978 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d37195c4-0812-4fca-8b15-2a7ab91c9c7e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:47.171734 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d37195c4-0812-4fca-8b15-2a7ab91c9c7e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:47.212186 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d37195c4-0812-4fca-8b15-2a7ab91c9c7e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:47.212980 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d37195c4-0812-4fca-8b15-2a7ab91c9c7e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:47.214228 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d37195c4-0812-4fca-8b15-2a7ab91c9c7e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:47.214846 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-d37195c4-0812-4fca-8b15-2a7ab91c9c7e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lazy-loading 'fault' on Instance uuid 3893d3e4-3a09-4adf-951b-84befacf7489 {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:36:47.416079 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e2ce8995-66c0-418b-95c7-05206cd1b39d tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:47.417623 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e2ce8995-66c0-418b-95c7-05206cd1b39d tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 4fab83b8-8862-4295-adb7-e2bf5462a2d9] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:47.432258 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d37195c4-0812-4fca-8b15-2a7ab91c9c7e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:47.440941 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d37195c4-0812-4fca-8b15-2a7ab91c9c7e tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/3893d3e4-3a09-4adf-951b-84befacf7489" status: 200 len: 1304 microversion: 2.1 time: 0.294007 Oct 19 03:36:47.444035 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2481/5040] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:47 2022] GET /compute/v2.1/servers/3893d3e4-3a09-4adf-951b-84befacf7489 => generated 1304 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:36:47.528922 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-e2ce8995-66c0-418b-95c7-05206cd1b39d tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4729a0afd69480f99642266e0eec17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce5e9f9a4644b27a24b2f4c06df97bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:47.536412 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e2ce8995-66c0-418b-95c7-05206cd1b39d tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/4fab83b8-8862-4295-adb7-e2bf5462a2d9" status: 200 len: 1245 microversion: 2.1 time: 0.126250 Oct 19 03:36:47.536974 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2560/5041] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:47 2022] GET /compute/v2.1/servers/4fab83b8-8862-4295-adb7-e2bf5462a2d9 => generated 1245 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:36:48.471233 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-28212336-5d23-4dd9-b6d3-0de330decb53 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:48.471860 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-28212336-5d23-4dd9-b6d3-0de330decb53 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 3893d3e4-3a09-4adf-951b-84befacf7489] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:48.480135 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-28212336-5d23-4dd9-b6d3-0de330decb53 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:48.480637 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-28212336-5d23-4dd9-b6d3-0de330decb53 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:48.481273 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-28212336-5d23-4dd9-b6d3-0de330decb53 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:48.482028 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-28212336-5d23-4dd9-b6d3-0de330decb53 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:48.482759 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-28212336-5d23-4dd9-b6d3-0de330decb53 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:48.483273 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-28212336-5d23-4dd9-b6d3-0de330decb53 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:48.499208 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-28212336-5d23-4dd9-b6d3-0de330decb53 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] HTTP exception thrown: Instance 3893d3e4-3a09-4adf-951b-84befacf7489 could not be found. Oct 19 03:36:48.500897 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-28212336-5d23-4dd9-b6d3-0de330decb53 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Request method failure captured: Oct 19 03:36:48.500897 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/3893d3e4-3a09-4adf-951b-84befacf7489 HTTP/1.1 Oct 19 03:36:48.500897 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:36:48.500897 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:36:48.500897 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:36:48.500897 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:36:48.500897 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:36:48.500897 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:36:48.500897 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:36:48.500897 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:36:48.500897 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT260MiyV65qXgKOsfu6szlvH8BpT6lTW39le6GeB1VFhX0NvYWazEEMcFsPSbHLVkGCs6vY26nud47iZUvRrXjMTSm7xCeqvs3FV0buG-kYWzpyMEv10k1w1En6NH8mRVf9qJ3OJ_AYxVTEN4XseatoNJyXso6kEWPzPG5n5qhJZ8ME Oct 19 03:36:48.500897 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:36:48.500897 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:36:48.500897 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:36:48.500897 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:36:48.500897 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:36:48.500897 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:36:48.500897 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: a5f56376721941f8ae2293f8f969db84 Oct 19 03:36:48.500897 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ServerActionsTestJSON-1598778355 Oct 19 03:36:48.500897 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:36:48.500897 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:36:48.500897 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a5f56376721941f8ae2293f8f969db84"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a5f56376721941f8ae2293f8f969db84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a5f56376721941f8ae2293f8f969db84"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a5f56376721941f8ae2293f8f969db84", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:36:48.500897 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ServerActionsTestJSON-1598778355 Oct 19 03:36:48.500897 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: a5f56376721941f8ae2293f8f969db84 Oct 19 03:36:48.500897 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ServerActionsTestJSON-1598778355 Oct 19 03:36:48.500897 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ServerActionsTestJSON-1598778355-project Oct 19 03:36:48.500897 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:36:48.500897 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:36:48.500897 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 746e1034a7ee40c1a69c8838c1e17e16 Oct 19 03:36:48.500897 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ServerActionsTestJSON-1598778355-project Oct 19 03:36:48.500897 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:36:48.500897 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance 3893d3e4-3a09-4adf-951b-84befacf7489 could not be found. Oct 19 03:36:48.500897 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '3893d3e4-3a09-4adf-951b-84befacf7489'} Oct 19 03:36:48.500897 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:36:48.500897 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:36:48.500897 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:36:48.500897 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:36:48.500897 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:36:48.500897 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:36:48.500897 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:36:48.500897 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:36:48.500897 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:36:48.500897 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:36:48.500897 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3893d3e4-3a09-4adf-951b-84befacf7489 could not be found. Oct 19 03:36:48.500897 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:36:48.500897 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:36:48.500897 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:36:48.500897 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:36:48.500897 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:36:48.500897 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:36:48.500897 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:36:48.500897 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:36:48.500897 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:36:48.500897 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:36:48.500897 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:36:48.500897 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:36:48.500897 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:36:48.500897 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:36:48.500897 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:36:48.500897 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:36:48.500897 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3893d3e4-3a09-4adf-951b-84befacf7489 could not be found. Oct 19 03:36:48.500897 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:36:48.500897 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:36:48.500897 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:36:48.505892 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:36:48.505892 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:36:48.505892 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:36:48.505892 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:36:48.505892 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:36:48.505892 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3893d3e4-3a09-4adf-951b-84befacf7489 could not be found. Oct 19 03:36:48.505892 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:36:48.505892 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-28212336-5d23-4dd9-b6d3-0de330decb53 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Returning 404 to user: Instance 3893d3e4-3a09-4adf-951b-84befacf7489 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:36:48.505892 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-28212336-5d23-4dd9-b6d3-0de330decb53 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/3893d3e4-3a09-4adf-951b-84befacf7489" status: 404 len: 111 microversion: 2.1 time: 0.036336 Oct 19 03:36:48.505892 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2482/5042] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:48 2022] GET /compute/v2.1/servers/3893d3e4-3a09-4adf-951b-84befacf7489 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:36:48.512510 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b100f2a0-9f02-4406-acb6-f72506c5adaa tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:48.513054 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b100f2a0-9f02-4406-acb6-f72506c5adaa tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 4b805c13-68bb-4794-87b6-a63598253193] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:48.537848 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b100f2a0-9f02-4406-acb6-f72506c5adaa tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:48.538446 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b100f2a0-9f02-4406-acb6-f72506c5adaa tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:48.538903 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b100f2a0-9f02-4406-acb6-f72506c5adaa tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:48.539871 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b100f2a0-9f02-4406-acb6-f72506c5adaa tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:48.540508 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b100f2a0-9f02-4406-acb6-f72506c5adaa tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:48.541891 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b100f2a0-9f02-4406-acb6-f72506c5adaa tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:48.562316 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f7fd8887-6fc5-49e6-8712-0c2b447171f2 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:48.562957 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f7fd8887-6fc5-49e6-8712-0c2b447171f2 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 4fab83b8-8862-4295-adb7-e2bf5462a2d9] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:48.583838 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f7fd8887-6fc5-49e6-8712-0c2b447171f2 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:48.589419 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f7fd8887-6fc5-49e6-8712-0c2b447171f2 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:48.589939 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f7fd8887-6fc5-49e6-8712-0c2b447171f2 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:48.590698 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f7fd8887-6fc5-49e6-8712-0c2b447171f2 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:48.591154 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f7fd8887-6fc5-49e6-8712-0c2b447171f2 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:48.591601 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f7fd8887-6fc5-49e6-8712-0c2b447171f2 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:48.636569 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b100f2a0-9f02-4406-acb6-f72506c5adaa tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 4b805c13-68bb-4794-87b6-a63598253193] Going to try to terminate instance {{(pid=121135) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:36:48.884079 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-f7fd8887-6fc5-49e6-8712-0c2b447171f2 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4729a0afd69480f99642266e0eec17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce5e9f9a4644b27a24b2f4c06df97bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:48.895141 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f7fd8887-6fc5-49e6-8712-0c2b447171f2 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/4fab83b8-8862-4295-adb7-e2bf5462a2d9" status: 200 len: 1297 microversion: 2.1 time: 0.338039 Oct 19 03:36:48.896287 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2483/5043] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:48 2022] GET /compute/v2.1/servers/4fab83b8-8862-4295-adb7-e2bf5462a2d9 => generated 1297 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:36:49.212354 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b100f2a0-9f02-4406-acb6-f72506c5adaa tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "DELETE /compute/v2.1/servers/4b805c13-68bb-4794-87b6-a63598253193" status: 204 len: 0 microversion: 2.1 time: 0.700976 Oct 19 03:36:49.214195 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2561/5044] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:36:48 2022] DELETE /compute/v2.1/servers/4b805c13-68bb-4794-87b6-a63598253193 => generated 0 bytes in 707 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:36:49.234212 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-bb08c9cb-921b-4581-85c3-8088ef8d3223 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:49.235529 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-bb08c9cb-921b-4581-85c3-8088ef8d3223 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 4b805c13-68bb-4794-87b6-a63598253193] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:49.258368 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bb08c9cb-921b-4581-85c3-8088ef8d3223 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:49.263049 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bb08c9cb-921b-4581-85c3-8088ef8d3223 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:49.282128 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bb08c9cb-921b-4581-85c3-8088ef8d3223 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:49.286109 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bb08c9cb-921b-4581-85c3-8088ef8d3223 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:49.287911 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bb08c9cb-921b-4581-85c3-8088ef8d3223 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:49.290339 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bb08c9cb-921b-4581-85c3-8088ef8d3223 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:49.921419 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9563577f-b942-4fe9-b46c-dd7be72d2e5f tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:49.923834 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9563577f-b942-4fe9-b46c-dd7be72d2e5f tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 4fab83b8-8862-4295-adb7-e2bf5462a2d9] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:49.937141 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9563577f-b942-4fe9-b46c-dd7be72d2e5f tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:49.940267 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9563577f-b942-4fe9-b46c-dd7be72d2e5f tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:49.942214 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9563577f-b942-4fe9-b46c-dd7be72d2e5f tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:49.948844 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9563577f-b942-4fe9-b46c-dd7be72d2e5f tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:49.949803 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9563577f-b942-4fe9-b46c-dd7be72d2e5f tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:49.952505 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9563577f-b942-4fe9-b46c-dd7be72d2e5f tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:50.151354 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-bb08c9cb-921b-4581-85c3-8088ef8d3223 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:50.166872 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-bb08c9cb-921b-4581-85c3-8088ef8d3223 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/4b805c13-68bb-4794-87b6-a63598253193" status: 200 len: 1494 microversion: 2.1 time: 0.941536 Oct 19 03:36:50.168309 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2484/5045] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:49 2022] GET /compute/v2.1/servers/4b805c13-68bb-4794-87b6-a63598253193 => generated 1494 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:36:50.174597 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-9563577f-b942-4fe9-b46c-dd7be72d2e5f tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4729a0afd69480f99642266e0eec17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce5e9f9a4644b27a24b2f4c06df97bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:50.191716 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9563577f-b942-4fe9-b46c-dd7be72d2e5f tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/4fab83b8-8862-4295-adb7-e2bf5462a2d9" status: 200 len: 1303 microversion: 2.1 time: 0.276202 Oct 19 03:36:50.192638 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2562/5046] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:49 2022] GET /compute/v2.1/servers/4fab83b8-8862-4295-adb7-e2bf5462a2d9 => generated 1303 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:36:51.193875 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2e11536c-c049-45a1-bc70-529f0af8156f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:51.200060 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2e11536c-c049-45a1-bc70-529f0af8156f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 4b805c13-68bb-4794-87b6-a63598253193] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:51.213651 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2e11536c-c049-45a1-bc70-529f0af8156f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:51.214452 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2e11536c-c049-45a1-bc70-529f0af8156f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:51.216362 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2e11536c-c049-45a1-bc70-529f0af8156f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:51.217300 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2e11536c-c049-45a1-bc70-529f0af8156f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:51.219079 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2e11536c-c049-45a1-bc70-529f0af8156f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:51.225690 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-8028f889-a212-48ee-aaa9-9329dc80ffc8 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:51.226460 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-8028f889-a212-48ee-aaa9-9329dc80ffc8 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 4fab83b8-8862-4295-adb7-e2bf5462a2d9] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:51.230937 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2e11536c-c049-45a1-bc70-529f0af8156f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:51.244703 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8028f889-a212-48ee-aaa9-9329dc80ffc8 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:51.248615 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8028f889-a212-48ee-aaa9-9329dc80ffc8 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:51.249245 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8028f889-a212-48ee-aaa9-9329dc80ffc8 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:51.250223 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8028f889-a212-48ee-aaa9-9329dc80ffc8 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:51.252954 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8028f889-a212-48ee-aaa9-9329dc80ffc8 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:51.253965 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8028f889-a212-48ee-aaa9-9329dc80ffc8 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:51.602772 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-2e11536c-c049-45a1-bc70-529f0af8156f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:51.629723 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2e11536c-c049-45a1-bc70-529f0af8156f tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/4b805c13-68bb-4794-87b6-a63598253193" status: 200 len: 1452 microversion: 2.1 time: 0.439142 Oct 19 03:36:51.631933 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2485/5047] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:51 2022] GET /compute/v2.1/servers/4b805c13-68bb-4794-87b6-a63598253193 => generated 1452 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:36:51.648091 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-971e0ab7-d627-49ed-b09d-a3c0559de825 req-f520fe14-bd33-4c48-a6af-de412dce3cdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b805c13-68bb-4794-87b6-a63598253193", "name": "network-vif-deleted", "tag": "d00f612c-68eb-47c5-9dd8-614cf83ec5c6"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:36:51.661077 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-971e0ab7-d627-49ed-b09d-a3c0559de825 req-f520fe14-bd33-4c48-a6af-de412dce3cdc service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:51.662165 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-971e0ab7-d627-49ed-b09d-a3c0559de825 req-f520fe14-bd33-4c48-a6af-de412dce3cdc service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:51.662779 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-971e0ab7-d627-49ed-b09d-a3c0559de825 req-f520fe14-bd33-4c48-a6af-de412dce3cdc service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:51.706561 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-971e0ab7-d627-49ed-b09d-a3c0559de825 req-f520fe14-bd33-4c48-a6af-de412dce3cdc service nova] Creating event network-vif-deleted:d00f612c-68eb-47c5-9dd8-614cf83ec5c6 for instance 4b805c13-68bb-4794-87b6-a63598253193 on n-h2-861333-8 Oct 19 03:36:51.720792 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-971e0ab7-d627-49ed-b09d-a3c0559de825 req-f520fe14-bd33-4c48-a6af-de412dce3cdc service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085099 Oct 19 03:36:51.724896 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2486/5048] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:36:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:36:52.003607 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-8028f889-a212-48ee-aaa9-9329dc80ffc8 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4729a0afd69480f99642266e0eec17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce5e9f9a4644b27a24b2f4c06df97bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:52.025633 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-8028f889-a212-48ee-aaa9-9329dc80ffc8 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/4fab83b8-8862-4295-adb7-e2bf5462a2d9" status: 200 len: 1370 microversion: 2.1 time: 0.798364 Oct 19 03:36:52.037998 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2563/5049] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:51 2022] GET /compute/v2.1/servers/4fab83b8-8862-4295-adb7-e2bf5462a2d9 => generated 1370 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:36:52.660100 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a70e67c5-047e-4b33-b22a-193d9f59d255 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:52.660696 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a70e67c5-047e-4b33-b22a-193d9f59d255 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 4b805c13-68bb-4794-87b6-a63598253193] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:52.683282 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a70e67c5-047e-4b33-b22a-193d9f59d255 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:52.694092 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a70e67c5-047e-4b33-b22a-193d9f59d255 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:52.696349 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a70e67c5-047e-4b33-b22a-193d9f59d255 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:52.698588 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a70e67c5-047e-4b33-b22a-193d9f59d255 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:52.700006 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a70e67c5-047e-4b33-b22a-193d9f59d255 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:52.703693 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a70e67c5-047e-4b33-b22a-193d9f59d255 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:52.840373 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a70e67c5-047e-4b33-b22a-193d9f59d255 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:52.843409 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a70e67c5-047e-4b33-b22a-193d9f59d255 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:52.844151 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a70e67c5-047e-4b33-b22a-193d9f59d255 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:52.844854 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-a70e67c5-047e-4b33-b22a-193d9f59d255 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lazy-loading 'fault' on Instance uuid 4b805c13-68bb-4794-87b6-a63598253193 {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:36:53.062321 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c2416380-58f5-48af-a4f8-91af1a11d884 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:53.063989 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c2416380-58f5-48af-a4f8-91af1a11d884 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 4fab83b8-8862-4295-adb7-e2bf5462a2d9] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:53.081165 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c2416380-58f5-48af-a4f8-91af1a11d884 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:53.082447 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c2416380-58f5-48af-a4f8-91af1a11d884 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:53.083178 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c2416380-58f5-48af-a4f8-91af1a11d884 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:53.085953 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c2416380-58f5-48af-a4f8-91af1a11d884 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:53.094408 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a70e67c5-047e-4b33-b22a-193d9f59d255 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:53.102183 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c2416380-58f5-48af-a4f8-91af1a11d884 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:53.106856 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a70e67c5-047e-4b33-b22a-193d9f59d255 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/4b805c13-68bb-4794-87b6-a63598253193" status: 200 len: 1304 microversion: 2.1 time: 0.451451 Oct 19 03:36:53.107240 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c2416380-58f5-48af-a4f8-91af1a11d884 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:53.109989 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2487/5050] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:52 2022] GET /compute/v2.1/servers/4b805c13-68bb-4794-87b6-a63598253193 => generated 1304 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:36:53.566340 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c2416380-58f5-48af-a4f8-91af1a11d884 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4729a0afd69480f99642266e0eec17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce5e9f9a4644b27a24b2f4c06df97bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:53.591106 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c2416380-58f5-48af-a4f8-91af1a11d884 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/4fab83b8-8862-4295-adb7-e2bf5462a2d9" status: 200 len: 1370 microversion: 2.1 time: 0.530774 Oct 19 03:36:53.605440 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2564/5051] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:53 2022] GET /compute/v2.1/servers/4fab83b8-8862-4295-adb7-e2bf5462a2d9 => generated 1370 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:36:53.666901 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-d75c49a3-2950-4226-bb92-cc00f304defe req-f32c718e-60c2-44fe-ac37-cf84c2748f90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fab83b8-8862-4295-adb7-e2bf5462a2d9", "tag": "277d3b94-8060-453a-baed-babf7a3dbed3"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:36:53.700936 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-d75c49a3-2950-4226-bb92-cc00f304defe req-f32c718e-60c2-44fe-ac37-cf84c2748f90 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:53.705443 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-d75c49a3-2950-4226-bb92-cc00f304defe req-f32c718e-60c2-44fe-ac37-cf84c2748f90 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:53.713618 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-d75c49a3-2950-4226-bb92-cc00f304defe req-f32c718e-60c2-44fe-ac37-cf84c2748f90 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:53.772145 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-d75c49a3-2950-4226-bb92-cc00f304defe req-f32c718e-60c2-44fe-ac37-cf84c2748f90 service nova] Creating event network-changed:277d3b94-8060-453a-baed-babf7a3dbed3 for instance 4fab83b8-8862-4295-adb7-e2bf5462a2d9 on n-h1-861333-8 Oct 19 03:36:53.785166 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-d75c49a3-2950-4226-bb92-cc00f304defe req-f32c718e-60c2-44fe-ac37-cf84c2748f90 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117372 Oct 19 03:36:53.785166 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2488/5052] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:36:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:36:54.139878 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e5bef335-d09b-4323-85cf-892e0bbc67b7 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:54.140484 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e5bef335-d09b-4323-85cf-892e0bbc67b7 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 4b805c13-68bb-4794-87b6-a63598253193] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:54.172362 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e5bef335-d09b-4323-85cf-892e0bbc67b7 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:54.173158 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e5bef335-d09b-4323-85cf-892e0bbc67b7 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:54.176544 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e5bef335-d09b-4323-85cf-892e0bbc67b7 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:54.181608 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e5bef335-d09b-4323-85cf-892e0bbc67b7 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:54.184572 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e5bef335-d09b-4323-85cf-892e0bbc67b7 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:54.185742 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e5bef335-d09b-4323-85cf-892e0bbc67b7 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:54.259492 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-e5bef335-d09b-4323-85cf-892e0bbc67b7 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] HTTP exception thrown: Instance 4b805c13-68bb-4794-87b6-a63598253193 could not be found. Oct 19 03:36:54.270008 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e5bef335-d09b-4323-85cf-892e0bbc67b7 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Request method failure captured: Oct 19 03:36:54.270008 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/4b805c13-68bb-4794-87b6-a63598253193 HTTP/1.1 Oct 19 03:36:54.270008 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:36:54.270008 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:36:54.270008 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:36:54.270008 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:36:54.270008 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:36:54.270008 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:36:54.270008 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:36:54.270008 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:36:54.270008 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT260MiyV65qXgKOsfu6szlvH8BpT6lTW39le6GeB1VFhX0NvYWazEEMcFsPSbHLVkGCs6vY26nud47iZUvRrXjMTSm7xCeqvs3FV0buG-kYWzpyMEv10k1w1En6NH8mRVf9qJ3OJ_AYxVTEN4XseatoNJyXso6kEWPzPG5n5qhJZ8ME Oct 19 03:36:54.270008 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:36:54.270008 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:36:54.270008 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:36:54.270008 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:36:54.270008 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:36:54.270008 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:36:54.270008 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: a5f56376721941f8ae2293f8f969db84 Oct 19 03:36:54.270008 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ServerActionsTestJSON-1598778355 Oct 19 03:36:54.270008 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:36:54.270008 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:36:54.270008 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a5f56376721941f8ae2293f8f969db84"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a5f56376721941f8ae2293f8f969db84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a5f56376721941f8ae2293f8f969db84"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a5f56376721941f8ae2293f8f969db84", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:36:54.270008 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ServerActionsTestJSON-1598778355 Oct 19 03:36:54.270008 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: a5f56376721941f8ae2293f8f969db84 Oct 19 03:36:54.270008 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ServerActionsTestJSON-1598778355 Oct 19 03:36:54.270008 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ServerActionsTestJSON-1598778355-project Oct 19 03:36:54.270008 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:36:54.270008 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:36:54.270008 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 746e1034a7ee40c1a69c8838c1e17e16 Oct 19 03:36:54.270008 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ServerActionsTestJSON-1598778355-project Oct 19 03:36:54.270008 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:36:54.270008 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance 4b805c13-68bb-4794-87b6-a63598253193 could not be found. Oct 19 03:36:54.270008 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '4b805c13-68bb-4794-87b6-a63598253193'} Oct 19 03:36:54.270008 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:36:54.270008 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:36:54.270008 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:36:54.270008 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:36:54.270008 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:36:54.270008 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:36:54.270008 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:36:54.270008 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:36:54.270008 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:36:54.270008 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:36:54.270008 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b805c13-68bb-4794-87b6-a63598253193 could not be found. Oct 19 03:36:54.270008 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:36:54.270008 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:36:54.270008 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:36:54.270008 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:36:54.270008 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:36:54.270008 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:36:54.270008 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:36:54.270008 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:36:54.270008 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:36:54.270008 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:36:54.270008 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:36:54.270008 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:36:54.270008 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:36:54.270008 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:36:54.270008 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:36:54.270008 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:36:54.270008 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b805c13-68bb-4794-87b6-a63598253193 could not be found. Oct 19 03:36:54.270008 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:36:54.270008 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:36:54.270008 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:36:54.287564 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:36:54.287564 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:36:54.287564 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:36:54.287564 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:36:54.287564 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:36:54.287564 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b805c13-68bb-4794-87b6-a63598253193 could not be found. Oct 19 03:36:54.287564 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:36:54.287564 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e5bef335-d09b-4323-85cf-892e0bbc67b7 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Returning 404 to user: Instance 4b805c13-68bb-4794-87b6-a63598253193 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:36:54.287564 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e5bef335-d09b-4323-85cf-892e0bbc67b7 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/4b805c13-68bb-4794-87b6-a63598253193" status: 404 len: 111 microversion: 2.1 time: 0.149144 Oct 19 03:36:54.287564 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2565/5053] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:54 2022] GET /compute/v2.1/servers/4b805c13-68bb-4794-87b6-a63598253193 => generated 111 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:36:54.297563 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-33624c60-db1f-483c-abcd-93a94a01a5b3 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:54.298823 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-33624c60-db1f-483c-abcd-93a94a01a5b3 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:54.312717 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-33624c60-db1f-483c-abcd-93a94a01a5b3 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:54.316305 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-33624c60-db1f-483c-abcd-93a94a01a5b3 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:54.319016 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-33624c60-db1f-483c-abcd-93a94a01a5b3 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:54.331061 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-33624c60-db1f-483c-abcd-93a94a01a5b3 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:54.331061 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-33624c60-db1f-483c-abcd-93a94a01a5b3 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:54.331061 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-33624c60-db1f-483c-abcd-93a94a01a5b3 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:54.425048 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-33624c60-db1f-483c-abcd-93a94a01a5b3 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Going to try to terminate instance {{(pid=121134) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:36:54.622772 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b29180e4-c00e-4290-a82a-9ffaf1c0f26b tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:54.623401 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b29180e4-c00e-4290-a82a-9ffaf1c0f26b tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 4fab83b8-8862-4295-adb7-e2bf5462a2d9] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:54.645222 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b29180e4-c00e-4290-a82a-9ffaf1c0f26b tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:54.645752 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b29180e4-c00e-4290-a82a-9ffaf1c0f26b tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:54.646193 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b29180e4-c00e-4290-a82a-9ffaf1c0f26b tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:54.646915 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b29180e4-c00e-4290-a82a-9ffaf1c0f26b tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:54.647372 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b29180e4-c00e-4290-a82a-9ffaf1c0f26b tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:54.647787 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b29180e4-c00e-4290-a82a-9ffaf1c0f26b tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:55.079998 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b29180e4-c00e-4290-a82a-9ffaf1c0f26b tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4729a0afd69480f99642266e0eec17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce5e9f9a4644b27a24b2f4c06df97bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:55.093622 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b29180e4-c00e-4290-a82a-9ffaf1c0f26b tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/4fab83b8-8862-4295-adb7-e2bf5462a2d9" status: 200 len: 1370 microversion: 2.1 time: 0.474632 Oct 19 03:36:55.098548 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2566/5054] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:54 2022] GET /compute/v2.1/servers/4fab83b8-8862-4295-adb7-e2bf5462a2d9 => generated 1370 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:36:55.184637 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-33624c60-db1f-483c-abcd-93a94a01a5b3 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "DELETE /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 204 len: 0 microversion: 2.1 time: 0.893314 Oct 19 03:36:55.186158 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2489/5055] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:36:54 2022] DELETE /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 0 bytes in 896 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:36:55.195108 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f6941b60-f42d-43e3-b343-5a7b37d39eec tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:55.196565 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f6941b60-f42d-43e3-b343-5a7b37d39eec tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:55.216986 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f6941b60-f42d-43e3-b343-5a7b37d39eec tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:55.224266 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f6941b60-f42d-43e3-b343-5a7b37d39eec tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:55.224266 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f6941b60-f42d-43e3-b343-5a7b37d39eec tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:55.227254 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f6941b60-f42d-43e3-b343-5a7b37d39eec tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:55.231466 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f6941b60-f42d-43e3-b343-5a7b37d39eec tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:55.233209 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f6941b60-f42d-43e3-b343-5a7b37d39eec tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:55.800836 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f6941b60-f42d-43e3-b343-5a7b37d39eec tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:55.812356 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f6941b60-f42d-43e3-b343-5a7b37d39eec tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1676 microversion: 2.1 time: 0.622039 Oct 19 03:36:55.813205 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2567/5056] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:55 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1676 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:36:56.126507 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f88b10bc-4ff1-41da-bf06-5d2e0c82abfb tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:56.129879 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f88b10bc-4ff1-41da-bf06-5d2e0c82abfb tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 4fab83b8-8862-4295-adb7-e2bf5462a2d9] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:56.153216 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f88b10bc-4ff1-41da-bf06-5d2e0c82abfb tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:56.154799 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f88b10bc-4ff1-41da-bf06-5d2e0c82abfb tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:56.159717 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f88b10bc-4ff1-41da-bf06-5d2e0c82abfb tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:56.160951 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f88b10bc-4ff1-41da-bf06-5d2e0c82abfb tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:56.161691 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f88b10bc-4ff1-41da-bf06-5d2e0c82abfb tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:56.162381 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f88b10bc-4ff1-41da-bf06-5d2e0c82abfb tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:56.382062 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:36:56.497039 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-f88b10bc-4ff1-41da-bf06-5d2e0c82abfb tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4729a0afd69480f99642266e0eec17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce5e9f9a4644b27a24b2f4c06df97bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:56.507637 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f88b10bc-4ff1-41da-bf06-5d2e0c82abfb tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/4fab83b8-8862-4295-adb7-e2bf5462a2d9" status: 200 len: 1370 microversion: 2.1 time: 0.391573 Oct 19 03:36:56.518568 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2490/5057] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:56 2022] GET /compute/v2.1/servers/4fab83b8-8862-4295-adb7-e2bf5462a2d9 => generated 1370 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:36:56.839022 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-77c18661-e3bb-40b3-bc8e-3cf6d9796374 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:56.839735 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-77c18661-e3bb-40b3-bc8e-3cf6d9796374 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:56.852412 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:36:56.855731 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-77c18661-e3bb-40b3-bc8e-3cf6d9796374 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:56.856241 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-77c18661-e3bb-40b3-bc8e-3cf6d9796374 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:56.856689 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-77c18661-e3bb-40b3-bc8e-3cf6d9796374 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:56.865744 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-77c18661-e3bb-40b3-bc8e-3cf6d9796374 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:56.866444 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-77c18661-e3bb-40b3-bc8e-3cf6d9796374 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:56.867061 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-77c18661-e3bb-40b3-bc8e-3cf6d9796374 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:57.308592 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-77c18661-e3bb-40b3-bc8e-3cf6d9796374 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:57.320040 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-77c18661-e3bb-40b3-bc8e-3cf6d9796374 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1676 microversion: 2.1 time: 0.482150 Oct 19 03:36:57.320674 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2568/5058] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:56 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1676 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:36:57.555776 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0f803621-2353-4098-aadf-a4580d3d9280 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:57.555776 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0f803621-2353-4098-aadf-a4580d3d9280 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 4fab83b8-8862-4295-adb7-e2bf5462a2d9] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:57.555776 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0f803621-2353-4098-aadf-a4580d3d9280 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:57.555776 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0f803621-2353-4098-aadf-a4580d3d9280 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:57.555776 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0f803621-2353-4098-aadf-a4580d3d9280 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:57.555776 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0f803621-2353-4098-aadf-a4580d3d9280 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:57.555776 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0f803621-2353-4098-aadf-a4580d3d9280 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:57.555776 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0f803621-2353-4098-aadf-a4580d3d9280 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:57.823214 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0f803621-2353-4098-aadf-a4580d3d9280 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4729a0afd69480f99642266e0eec17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce5e9f9a4644b27a24b2f4c06df97bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:57.834581 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0f803621-2353-4098-aadf-a4580d3d9280 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/4fab83b8-8862-4295-adb7-e2bf5462a2d9" status: 200 len: 1370 microversion: 2.1 time: 0.302894 Oct 19 03:36:57.837517 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2491/5059] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:57 2022] GET /compute/v2.1/servers/4fab83b8-8862-4295-adb7-e2bf5462a2d9 => generated 1370 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:36:58.348761 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5be3f040-17f3-43c2-89bd-7f9dc0ad8c32 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:58.348761 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-5be3f040-17f3-43c2-89bd-7f9dc0ad8c32 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:58.350097 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=12 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:36:58.362677 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5be3f040-17f3-43c2-89bd-7f9dc0ad8c32 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:58.365969 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5be3f040-17f3-43c2-89bd-7f9dc0ad8c32 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:58.367997 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5be3f040-17f3-43c2-89bd-7f9dc0ad8c32 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:58.372895 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5be3f040-17f3-43c2-89bd-7f9dc0ad8c32 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:58.373807 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5be3f040-17f3-43c2-89bd-7f9dc0ad8c32 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:58.374508 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5be3f040-17f3-43c2-89bd-7f9dc0ad8c32 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:58.518544 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-5be3f040-17f3-43c2-89bd-7f9dc0ad8c32 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:58.529797 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5be3f040-17f3-43c2-89bd-7f9dc0ad8c32 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1608 microversion: 2.1 time: 0.190616 Oct 19 03:36:58.531184 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2569/5060] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:58 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1608 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:36:58.865166 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d487e87b-fe4d-4b90-bbda-2bb56d673d5b tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:58.866911 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d487e87b-fe4d-4b90-bbda-2bb56d673d5b tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 4fab83b8-8862-4295-adb7-e2bf5462a2d9] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:58.903549 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d487e87b-fe4d-4b90-bbda-2bb56d673d5b tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:58.905003 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d487e87b-fe4d-4b90-bbda-2bb56d673d5b tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:58.906274 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d487e87b-fe4d-4b90-bbda-2bb56d673d5b tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:58.908679 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d487e87b-fe4d-4b90-bbda-2bb56d673d5b tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:58.912633 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d487e87b-fe4d-4b90-bbda-2bb56d673d5b tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:58.921715 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d487e87b-fe4d-4b90-bbda-2bb56d673d5b tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:59.291883 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-bd974819-0ad1-4f3e-96ce-58c1bdc29858 req-06b692c4-d23a-4bb3-a37f-97e32f12f64b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58b9ce4c-4a42-40ff-b8ed-b75de752b46f", "name": "network-vif-deleted", "tag": "ff8c2e3f-1c6f-4ac7-b6b8-751825489845"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:36:59.311037 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-bd974819-0ad1-4f3e-96ce-58c1bdc29858 req-06b692c4-d23a-4bb3-a37f-97e32f12f64b service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:59.313723 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-bd974819-0ad1-4f3e-96ce-58c1bdc29858 req-06b692c4-d23a-4bb3-a37f-97e32f12f64b service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:59.314172 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-bd974819-0ad1-4f3e-96ce-58c1bdc29858 req-06b692c4-d23a-4bb3-a37f-97e32f12f64b service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:59.350822 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-bd974819-0ad1-4f3e-96ce-58c1bdc29858 req-06b692c4-d23a-4bb3-a37f-97e32f12f64b service nova] Creating event network-vif-deleted:ff8c2e3f-1c6f-4ac7-b6b8-751825489845 for instance 58b9ce4c-4a42-40ff-b8ed-b75de752b46f on n-h2-861333-8 Oct 19 03:36:59.362143 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-bd974819-0ad1-4f3e-96ce-58c1bdc29858 req-06b692c4-d23a-4bb3-a37f-97e32f12f64b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075732 Oct 19 03:36:59.365227 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2570/5061] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:36:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:36:59.449235 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d487e87b-fe4d-4b90-bbda-2bb56d673d5b tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4729a0afd69480f99642266e0eec17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce5e9f9a4644b27a24b2f4c06df97bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:59.460849 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d487e87b-fe4d-4b90-bbda-2bb56d673d5b tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/4fab83b8-8862-4295-adb7-e2bf5462a2d9" status: 200 len: 1370 microversion: 2.1 time: 0.604146 Oct 19 03:36:59.462003 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2492/5062] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:58 2022] GET /compute/v2.1/servers/4fab83b8-8862-4295-adb7-e2bf5462a2d9 => generated 1370 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:36:59.559985 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3b51ff0e-81ba-41b5-bcd7-f8ab85247c1d tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:36:59.561627 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-3b51ff0e-81ba-41b5-bcd7-f8ab85247c1d tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:36:59.575073 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3b51ff0e-81ba-41b5-bcd7-f8ab85247c1d tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:59.575884 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3b51ff0e-81ba-41b5-bcd7-f8ab85247c1d tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:59.590004 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3b51ff0e-81ba-41b5-bcd7-f8ab85247c1d tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:59.591730 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3b51ff0e-81ba-41b5-bcd7-f8ab85247c1d tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:36:59.592224 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3b51ff0e-81ba-41b5-bcd7-f8ab85247c1d tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:36:59.592667 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3b51ff0e-81ba-41b5-bcd7-f8ab85247c1d tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:36:59.680961 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:36:59.809554 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-3b51ff0e-81ba-41b5-bcd7-f8ab85247c1d tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:36:59.819070 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-3b51ff0e-81ba-41b5-bcd7-f8ab85247c1d tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1323 microversion: 2.1 time: 0.264815 Oct 19 03:36:59.838922 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2571/5063] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:36:59 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1323 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:37:00.496430 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-18353737-6bcd-4680-a780-4468f61c6e2a tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:37:00.501013 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-18353737-6bcd-4680-a780-4468f61c6e2a tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 4fab83b8-8862-4295-adb7-e2bf5462a2d9] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:37:00.543860 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-18353737-6bcd-4680-a780-4468f61c6e2a tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:37:00.544355 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-18353737-6bcd-4680-a780-4468f61c6e2a tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:37:00.544797 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-18353737-6bcd-4680-a780-4468f61c6e2a tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:37:00.545547 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-18353737-6bcd-4680-a780-4468f61c6e2a tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:37:00.547822 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-18353737-6bcd-4680-a780-4468f61c6e2a tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:37:00.550627 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-18353737-6bcd-4680-a780-4468f61c6e2a tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:37:00.858347 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-217d79d0-14ae-4120-83e5-9b8387492732 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:37:00.859622 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-217d79d0-14ae-4120-83e5-9b8387492732 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:37:00.907757 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-217d79d0-14ae-4120-83e5-9b8387492732 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:37:00.908270 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-217d79d0-14ae-4120-83e5-9b8387492732 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:37:00.908718 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-217d79d0-14ae-4120-83e5-9b8387492732 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:37:00.914682 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-217d79d0-14ae-4120-83e5-9b8387492732 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:37:00.915185 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-217d79d0-14ae-4120-83e5-9b8387492732 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:37:00.919548 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-217d79d0-14ae-4120-83e5-9b8387492732 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:37:01.012654 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-18353737-6bcd-4680-a780-4468f61c6e2a tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4729a0afd69480f99642266e0eec17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce5e9f9a4644b27a24b2f4c06df97bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:37:01.037168 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-18353737-6bcd-4680-a780-4468f61c6e2a tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/4fab83b8-8862-4295-adb7-e2bf5462a2d9" status: 200 len: 1370 microversion: 2.1 time: 0.531585 Oct 19 03:37:01.038024 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2493/5064] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:37:00 2022] GET /compute/v2.1/servers/4fab83b8-8862-4295-adb7-e2bf5462a2d9 => generated 1370 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:37:01.071717 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-217d79d0-14ae-4120-83e5-9b8387492732 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:37:01.072234 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-217d79d0-14ae-4120-83e5-9b8387492732 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:37:01.073124 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-217d79d0-14ae-4120-83e5-9b8387492732 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:37:01.076663 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-217d79d0-14ae-4120-83e5-9b8387492732 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lazy-loading 'fault' on Instance uuid 58b9ce4c-4a42-40ff-b8ed-b75de752b46f {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:37:01.169462 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-217d79d0-14ae-4120-83e5-9b8387492732 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746e1034a7ee40c1a69c8838c1e17e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f56376721941f8ae2293f8f969db84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:37:01.177858 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-217d79d0-14ae-4120-83e5-9b8387492732 tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 200 len: 1328 microversion: 2.1 time: 0.328029 Oct 19 03:37:01.179454 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2572/5065] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:37:00 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 1328 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:37:01.975121 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-3a5d8768-05f0-43de-b843-8c85ae85e7c2 req-101526c6-39ee-450a-8326-485abcf7033a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fab83b8-8862-4295-adb7-e2bf5462a2d9", "name": "network-vif-plugged", "status": "completed", "tag": "277d3b94-8060-453a-baed-babf7a3dbed3"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:37:02.008513 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-3a5d8768-05f0-43de-b843-8c85ae85e7c2 req-101526c6-39ee-450a-8326-485abcf7033a service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:37:02.009327 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-3a5d8768-05f0-43de-b843-8c85ae85e7c2 req-101526c6-39ee-450a-8326-485abcf7033a service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:37:02.010024 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-3a5d8768-05f0-43de-b843-8c85ae85e7c2 req-101526c6-39ee-450a-8326-485abcf7033a service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:37:02.053943 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-3a5d8768-05f0-43de-b843-8c85ae85e7c2 req-101526c6-39ee-450a-8326-485abcf7033a service nova] Creating event network-vif-plugged:277d3b94-8060-453a-baed-babf7a3dbed3 for instance 4fab83b8-8862-4295-adb7-e2bf5462a2d9 on n-h1-861333-8 Oct 19 03:37:02.067269 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-3a5d8768-05f0-43de-b843-8c85ae85e7c2 req-101526c6-39ee-450a-8326-485abcf7033a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096816 Oct 19 03:37:02.067493 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6df8ed2c-8dbf-43ce-aecb-86ad52515663 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:37:02.069116 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6df8ed2c-8dbf-43ce-aecb-86ad52515663 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 4fab83b8-8862-4295-adb7-e2bf5462a2d9] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:37:02.072067 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2494/5066] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:37:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:37:02.093008 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6df8ed2c-8dbf-43ce-aecb-86ad52515663 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:37:02.093542 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6df8ed2c-8dbf-43ce-aecb-86ad52515663 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:37:02.093987 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6df8ed2c-8dbf-43ce-aecb-86ad52515663 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:37:02.094720 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6df8ed2c-8dbf-43ce-aecb-86ad52515663 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:37:02.100082 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6df8ed2c-8dbf-43ce-aecb-86ad52515663 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:37:02.100638 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6df8ed2c-8dbf-43ce-aecb-86ad52515663 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:37:02.206015 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-97e6cf73-e3bd-4d41-9200-5665031d00ec tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:37:02.207532 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-97e6cf73-e3bd-4d41-9200-5665031d00ec tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] [instance: 58b9ce4c-4a42-40ff-b8ed-b75de752b46f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:37:02.233223 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-97e6cf73-e3bd-4d41-9200-5665031d00ec tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:37:02.237201 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-97e6cf73-e3bd-4d41-9200-5665031d00ec tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:37:02.237969 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-97e6cf73-e3bd-4d41-9200-5665031d00ec tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:37:02.246820 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-97e6cf73-e3bd-4d41-9200-5665031d00ec tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:37:02.246820 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-97e6cf73-e3bd-4d41-9200-5665031d00ec tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:37:02.246820 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-97e6cf73-e3bd-4d41-9200-5665031d00ec tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:37:02.261423 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-97e6cf73-e3bd-4d41-9200-5665031d00ec tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] HTTP exception thrown: Instance 58b9ce4c-4a42-40ff-b8ed-b75de752b46f could not be found. Oct 19 03:37:02.263763 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-97e6cf73-e3bd-4d41-9200-5665031d00ec tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Request method failure captured: Oct 19 03:37:02.263763 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f HTTP/1.1 Oct 19 03:37:02.263763 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:37:02.263763 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:37:02.263763 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:37:02.263763 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:37:02.263763 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:37:02.263763 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:37:02.263763 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:37:02.263763 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:37:02.263763 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT260MiyV65qXgKOsfu6szlvH8BpT6lTW39le6GeB1VFhX0NvYWazEEMcFsPSbHLVkGCs6vY26nud47iZUvRrXjMTSm7xCeqvs3FV0buG-kYWzpyMEv10k1w1En6NH8mRVf9qJ3OJ_AYxVTEN4XseatoNJyXso6kEWPzPG5n5qhJZ8ME Oct 19 03:37:02.263763 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:37:02.263763 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:37:02.263763 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:37:02.263763 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:37:02.263763 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:37:02.263763 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:37:02.263763 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: a5f56376721941f8ae2293f8f969db84 Oct 19 03:37:02.263763 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ServerActionsTestJSON-1598778355 Oct 19 03:37:02.263763 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:37:02.263763 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:37:02.263763 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a5f56376721941f8ae2293f8f969db84"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a5f56376721941f8ae2293f8f969db84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a5f56376721941f8ae2293f8f969db84"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a5f56376721941f8ae2293f8f969db84", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:37:02.263763 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ServerActionsTestJSON-1598778355 Oct 19 03:37:02.263763 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: a5f56376721941f8ae2293f8f969db84 Oct 19 03:37:02.263763 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ServerActionsTestJSON-1598778355 Oct 19 03:37:02.263763 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ServerActionsTestJSON-1598778355-project Oct 19 03:37:02.263763 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:37:02.263763 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:37:02.263763 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 746e1034a7ee40c1a69c8838c1e17e16 Oct 19 03:37:02.263763 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ServerActionsTestJSON-1598778355-project Oct 19 03:37:02.263763 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:37:02.263763 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance 58b9ce4c-4a42-40ff-b8ed-b75de752b46f could not be found. Oct 19 03:37:02.263763 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '58b9ce4c-4a42-40ff-b8ed-b75de752b46f'} Oct 19 03:37:02.263763 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:37:02.263763 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:37:02.263763 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:37:02.263763 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:37:02.263763 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:37:02.263763 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:37:02.263763 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:37:02.263763 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:37:02.263763 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:37:02.263763 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:37:02.263763 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58b9ce4c-4a42-40ff-b8ed-b75de752b46f could not be found. Oct 19 03:37:02.263763 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:37:02.263763 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:37:02.263763 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:37:02.263763 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:37:02.263763 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:37:02.263763 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:37:02.263763 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:37:02.263763 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:37:02.263763 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:37:02.263763 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:37:02.263763 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:37:02.263763 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:37:02.263763 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:37:02.263763 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:37:02.263763 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:37:02.263763 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:37:02.263763 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58b9ce4c-4a42-40ff-b8ed-b75de752b46f could not be found. Oct 19 03:37:02.263763 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:37:02.263763 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:37:02.263763 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:37:02.270768 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:37:02.270768 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:37:02.270768 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:37:02.270768 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:37:02.270768 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:37:02.270768 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58b9ce4c-4a42-40ff-b8ed-b75de752b46f could not be found. Oct 19 03:37:02.270768 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:37:02.272694 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-97e6cf73-e3bd-4d41-9200-5665031d00ec tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Returning 404 to user: Instance 58b9ce4c-4a42-40ff-b8ed-b75de752b46f could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:37:02.273992 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-97e6cf73-e3bd-4d41-9200-5665031d00ec tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f" status: 404 len: 111 microversion: 2.1 time: 0.074624 Oct 19 03:37:02.278819 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2495/5067] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:37:02 2022] GET /compute/v2.1/servers/58b9ce4c-4a42-40ff-b8ed-b75de752b46f => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 03:37:02.286870 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-480f24d0-e869-4b21-9a69-e3b0d4b994ba tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] Calling method '.version_select at 0x7fc130b4e940>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:37:02.444719 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-480f24d0-e869-4b21-9a69-e3b0d4b994ba tempest-ServerActionsTestJSON-1598778355 tempest-ServerActionsTestJSON-1598778355-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-876596665" status: 202 len: 0 microversion: 2.1 time: 0.163584 Oct 19 03:37:02.445333 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2496/5068] 10.222.0.52 () {58 vars in 1218 bytes} [Wed Oct 19 03:37:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-876596665 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:37:02.706230 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-6df8ed2c-8dbf-43ce-aecb-86ad52515663 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4729a0afd69480f99642266e0eec17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce5e9f9a4644b27a24b2f4c06df97bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:37:02.715437 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6df8ed2c-8dbf-43ce-aecb-86ad52515663 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/4fab83b8-8862-4295-adb7-e2bf5462a2d9" status: 200 len: 1370 microversion: 2.1 time: 0.653781 Oct 19 03:37:02.716023 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2573/5069] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:37:02 2022] GET /compute/v2.1/servers/4fab83b8-8862-4295-adb7-e2bf5462a2d9 => generated 1370 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:37:03.742279 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-359d6044-400b-450a-a6c5-939cbddb424d tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:37:03.743046 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-359d6044-400b-450a-a6c5-939cbddb424d tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 4fab83b8-8862-4295-adb7-e2bf5462a2d9] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:37:03.776086 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-359d6044-400b-450a-a6c5-939cbddb424d tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:37:03.781292 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-359d6044-400b-450a-a6c5-939cbddb424d tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:37:03.782026 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-359d6044-400b-450a-a6c5-939cbddb424d tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:37:03.782992 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-359d6044-400b-450a-a6c5-939cbddb424d tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:37:03.783634 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-359d6044-400b-450a-a6c5-939cbddb424d tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:37:03.784252 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-359d6044-400b-450a-a6c5-939cbddb424d tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:37:04.663386 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-359d6044-400b-450a-a6c5-939cbddb424d tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4729a0afd69480f99642266e0eec17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce5e9f9a4644b27a24b2f4c06df97bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:37:04.673703 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:37:04.676951 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-359d6044-400b-450a-a6c5-939cbddb424d tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/4fab83b8-8862-4295-adb7-e2bf5462a2d9" status: 200 len: 1370 microversion: 2.1 time: 0.940493 Oct 19 03:37:04.678786 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2497/5070] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:37:03 2022] GET /compute/v2.1/servers/4fab83b8-8862-4295-adb7-e2bf5462a2d9 => generated 1370 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:37:05.701444 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9460e84d-0b98-4d74-8d7c-8f98366ddb2d tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:37:05.705466 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9460e84d-0b98-4d74-8d7c-8f98366ddb2d tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 4fab83b8-8862-4295-adb7-e2bf5462a2d9] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:37:05.715225 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9460e84d-0b98-4d74-8d7c-8f98366ddb2d tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:37:05.716122 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9460e84d-0b98-4d74-8d7c-8f98366ddb2d tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:37:05.716819 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9460e84d-0b98-4d74-8d7c-8f98366ddb2d tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:37:05.718254 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9460e84d-0b98-4d74-8d7c-8f98366ddb2d tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:37:05.718970 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9460e84d-0b98-4d74-8d7c-8f98366ddb2d tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:37:05.719737 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9460e84d-0b98-4d74-8d7c-8f98366ddb2d tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:37:06.825336 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-9460e84d-0b98-4d74-8d7c-8f98366ddb2d tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4729a0afd69480f99642266e0eec17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce5e9f9a4644b27a24b2f4c06df97bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:37:06.835896 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9460e84d-0b98-4d74-8d7c-8f98366ddb2d tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/4fab83b8-8862-4295-adb7-e2bf5462a2d9" status: 200 len: 1564 microversion: 2.1 time: 1.139005 Oct 19 03:37:06.837824 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2574/5071] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:37:05 2022] GET /compute/v2.1/servers/4fab83b8-8862-4295-adb7-e2bf5462a2d9 => generated 1564 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:37:06.864919 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4b2565f0-863e-4f7b-9821-12d3cc437e88 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:37:06.865482 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4b2565f0-863e-4f7b-9821-12d3cc437e88 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 4fab83b8-8862-4295-adb7-e2bf5462a2d9] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:37:06.875570 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4b2565f0-863e-4f7b-9821-12d3cc437e88 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:37:06.876428 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4b2565f0-863e-4f7b-9821-12d3cc437e88 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:37:06.877234 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4b2565f0-863e-4f7b-9821-12d3cc437e88 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:37:06.878188 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4b2565f0-863e-4f7b-9821-12d3cc437e88 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:37:06.878813 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4b2565f0-863e-4f7b-9821-12d3cc437e88 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:37:06.879478 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4b2565f0-863e-4f7b-9821-12d3cc437e88 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:37:07.053618 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-64cf11ad-61cb-4700-91c3-39476f4c94da tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:37:07.054605 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-64cf11ad-61cb-4700-91c3-39476f4c94da tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] [instance: ddbf7afb-1d7b-4d33-b6fb-1f1608c11985] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:37:07.063224 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4b2565f0-863e-4f7b-9821-12d3cc437e88 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/4fab83b8-8862-4295-adb7-e2bf5462a2d9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.204374 Oct 19 03:37:07.063960 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2498/5072] 10.222.0.52 () {58 vars in 1275 bytes} [Wed Oct 19 03:37:06 2022] GET /compute/v2.1/servers/4fab83b8-8862-4295-adb7-e2bf5462a2d9/os-interface => generated 284 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:37:07.075382 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-64cf11ad-61cb-4700-91c3-39476f4c94da tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:37:07.075382 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-64cf11ad-61cb-4700-91c3-39476f4c94da tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:37:07.075735 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-64cf11ad-61cb-4700-91c3-39476f4c94da tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:37:07.076210 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-64cf11ad-61cb-4700-91c3-39476f4c94da tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:37:07.076860 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-64cf11ad-61cb-4700-91c3-39476f4c94da tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:37:07.077509 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-64cf11ad-61cb-4700-91c3-39476f4c94da tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:37:07.184506 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-64cf11ad-61cb-4700-91c3-39476f4c94da tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lazy-loading 'services' on Instance uuid ddbf7afb-1d7b-4d33-b6fb-1f1608c11985 {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:37:07.470899 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-64cf11ad-61cb-4700-91c3-39476f4c94da tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985/os-volume_attachments/f785d734-0827-4795-8c24-7fadbb07a1a9" status: 202 len: 0 microversion: 2.1 time: 0.421102 Oct 19 03:37:07.471875 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2575/5073] 10.222.0.52 () {58 vars in 1416 bytes} [Wed Oct 19 03:37:07 2022] DELETE /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985/os-volume_attachments/f785d734-0827-4795-8c24-7fadbb07a1a9 => generated 0 bytes in 423 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:37:08.333790 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-fb65eda9-14c7-4b29-9a1e-7bce2ee71d90 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:37:08.350766 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-fb65eda9-14c7-4b29-9a1e-7bce2ee71d90 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4cb021cc6411420ab9e01353f671e8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cec9540e5e498dbaf34714cf3a36f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:37:08.351580 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-fb65eda9-14c7-4b29-9a1e-7bce2ee71d90 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Searching by: {'deleted': False, 'project_id': '32cec9540e5e498dbaf34714cf3a36f7'} {{(pid=121134) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 03:37:08.395793 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fb65eda9-14c7-4b29-9a1e-7bce2ee71d90 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:37:08.400695 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fb65eda9-14c7-4b29-9a1e-7bce2ee71d90 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:37:08.403910 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fb65eda9-14c7-4b29-9a1e-7bce2ee71d90 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:37:08.405783 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fb65eda9-14c7-4b29-9a1e-7bce2ee71d90 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:37:08.409452 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fb65eda9-14c7-4b29-9a1e-7bce2ee71d90 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:37:08.411195 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fb65eda9-14c7-4b29-9a1e-7bce2ee71d90 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:37:08.541844 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.multi_cell_list [None req-fb65eda9-14c7-4b29-9a1e-7bce2ee71d90 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121134) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 03:37:08.711603 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-fb65eda9-14c7-4b29-9a1e-7bce2ee71d90 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] 10.222.0.52 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.382619 Oct 19 03:37:08.722888 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2499/5074] 10.222.0.52 () {58 vars in 1125 bytes} [Wed Oct 19 03:37:08 2022] GET /compute/v2.1/servers => generated 340 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:37:08.736232 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-8116b5d1-1da6-4287-9bb3-122e38833b45 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:37:08.752248 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-8116b5d1-1da6-4287-9bb3-122e38833b45 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4cb021cc6411420ab9e01353f671e8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cec9540e5e498dbaf34714cf3a36f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:37:08.752248 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-8116b5d1-1da6-4287-9bb3-122e38833b45 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Searching by: {'deleted': False, 'project_id': '32cec9540e5e498dbaf34714cf3a36f7'} {{(pid=121135) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 03:37:08.789544 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8116b5d1-1da6-4287-9bb3-122e38833b45 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:37:08.790674 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8116b5d1-1da6-4287-9bb3-122e38833b45 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:37:08.793787 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8116b5d1-1da6-4287-9bb3-122e38833b45 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:37:08.795889 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8116b5d1-1da6-4287-9bb3-122e38833b45 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:37:08.803920 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8116b5d1-1da6-4287-9bb3-122e38833b45 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:37:08.803920 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8116b5d1-1da6-4287-9bb3-122e38833b45 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:37:08.889237 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.multi_cell_list [None req-8116b5d1-1da6-4287-9bb3-122e38833b45 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121135) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 03:37:08.984163 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-8116b5d1-1da6-4287-9bb3-122e38833b45 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb021cc6411420ab9e01353f671e8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cec9540e5e498dbaf34714cf3a36f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:37:08.995492 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8116b5d1-1da6-4287-9bb3-122e38833b45 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:37:08.996290 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8116b5d1-1da6-4287-9bb3-122e38833b45 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:37:08.998966 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8116b5d1-1da6-4287-9bb3-122e38833b45 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:37:09.248478 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-5fc24fd0-c075-490f-9562-3a70384ca708 req-d2eb5a2d-8f35-497d-a0b8-abc3b7e503e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fab83b8-8862-4295-adb7-e2bf5462a2d9", "tag": "277d3b94-8060-453a-baed-babf7a3dbed3"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:37:09.269499 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-8116b5d1-1da6-4287-9bb3-122e38833b45 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] 10.222.0.52 "GET /compute/v2.1/servers/detail" status: 200 len: 1711 microversion: 2.1 time: 0.538648 Oct 19 03:37:09.270234 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2576/5075] 10.222.0.52 () {58 vars in 1146 bytes} [Wed Oct 19 03:37:08 2022] GET /compute/v2.1/servers/detail => generated 1711 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:37:09.298132 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-5fc24fd0-c075-490f-9562-3a70384ca708 req-d2eb5a2d-8f35-497d-a0b8-abc3b7e503e5 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:37:09.303537 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f7970d65-553f-47e3-8089-6f62fe265cf1 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:37:09.310861 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-5fc24fd0-c075-490f-9562-3a70384ca708 req-d2eb5a2d-8f35-497d-a0b8-abc3b7e503e5 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:37:09.318939 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f7970d65-553f-47e3-8089-6f62fe265cf1 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] 10.222.0.52 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015269 Oct 19 03:37:09.319160 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-5fc24fd0-c075-490f-9562-3a70384ca708 req-d2eb5a2d-8f35-497d-a0b8-abc3b7e503e5 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:37:09.331806 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2577/5076] 10.222.0.52 () {58 vars in 1137 bytes} [Wed Oct 19 03:37:09 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:37:09.367044 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-5fc24fd0-c075-490f-9562-3a70384ca708 req-d2eb5a2d-8f35-497d-a0b8-abc3b7e503e5 service nova] Creating event network-changed:277d3b94-8060-453a-baed-babf7a3dbed3 for instance 4fab83b8-8862-4295-adb7-e2bf5462a2d9 on n-h1-861333-8 Oct 19 03:37:09.386488 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-5fc24fd0-c075-490f-9562-3a70384ca708 req-d2eb5a2d-8f35-497d-a0b8-abc3b7e503e5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142220 Oct 19 03:37:09.387875 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2500/5077] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:37:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:37:09.662961 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0c4b638d-fcbb-4644-a679-969e90f4ce51 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:37:09.663972 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0c4b638d-fcbb-4644-a679-969e90f4ce51 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] [instance: c38f0173-a3d2-4254-96cd-ef24f8f0b989] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:37:09.676332 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0c4b638d-fcbb-4644-a679-969e90f4ce51 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:37:09.681778 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0c4b638d-fcbb-4644-a679-969e90f4ce51 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:37:09.682359 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0c4b638d-fcbb-4644-a679-969e90f4ce51 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:37:09.683863 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0c4b638d-fcbb-4644-a679-969e90f4ce51 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:37:09.685482 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0c4b638d-fcbb-4644-a679-969e90f4ce51 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:37:09.686847 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0c4b638d-fcbb-4644-a679-969e90f4ce51 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:37:09.759590 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0c4b638d-fcbb-4644-a679-969e90f4ce51 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] [instance: c38f0173-a3d2-4254-96cd-ef24f8f0b989] Going to try to terminate instance {{(pid=121135) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:37:10.247443 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0c4b638d-fcbb-4644-a679-969e90f4ce51 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] 10.222.0.52 "DELETE /compute/v2.1/servers/c38f0173-a3d2-4254-96cd-ef24f8f0b989" status: 204 len: 0 microversion: 2.1 time: 0.588458 Oct 19 03:37:10.248585 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2578/5078] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:37:09 2022] DELETE /compute/v2.1/servers/c38f0173-a3d2-4254-96cd-ef24f8f0b989 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:37:10.260667 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c6cec23a-a636-451f-a316-d7303b15d52b tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:37:10.261409 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c6cec23a-a636-451f-a316-d7303b15d52b tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] [instance: c38f0173-a3d2-4254-96cd-ef24f8f0b989] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:37:10.275874 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c6cec23a-a636-451f-a316-d7303b15d52b tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:37:10.278633 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c6cec23a-a636-451f-a316-d7303b15d52b tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:37:10.281889 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c6cec23a-a636-451f-a316-d7303b15d52b tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:37:10.284936 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c6cec23a-a636-451f-a316-d7303b15d52b tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:37:10.291099 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c6cec23a-a636-451f-a316-d7303b15d52b tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:37:10.291803 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c6cec23a-a636-451f-a316-d7303b15d52b tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:37:10.951065 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c6cec23a-a636-451f-a316-d7303b15d52b tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb021cc6411420ab9e01353f671e8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cec9540e5e498dbaf34714cf3a36f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:37:10.967796 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c6cec23a-a636-451f-a316-d7303b15d52b tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] 10.222.0.52 "GET /compute/v2.1/servers/c38f0173-a3d2-4254-96cd-ef24f8f0b989" status: 200 len: 1714 microversion: 2.1 time: 0.711858 Oct 19 03:37:10.973891 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2501/5079] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:37:10 2022] GET /compute/v2.1/servers/c38f0173-a3d2-4254-96cd-ef24f8f0b989 => generated 1714 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:37:12.003537 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ea7ced60-824e-4d07-90c9-e8d8e27bee56 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:37:12.004361 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ea7ced60-824e-4d07-90c9-e8d8e27bee56 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] [instance: c38f0173-a3d2-4254-96cd-ef24f8f0b989] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:37:12.019575 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ea7ced60-824e-4d07-90c9-e8d8e27bee56 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:37:12.021364 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ea7ced60-824e-4d07-90c9-e8d8e27bee56 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:37:12.022146 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ea7ced60-824e-4d07-90c9-e8d8e27bee56 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:37:12.023115 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ea7ced60-824e-4d07-90c9-e8d8e27bee56 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:37:12.023922 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ea7ced60-824e-4d07-90c9-e8d8e27bee56 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:37:12.024605 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ea7ced60-824e-4d07-90c9-e8d8e27bee56 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:37:12.817176 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ea7ced60-824e-4d07-90c9-e8d8e27bee56 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb021cc6411420ab9e01353f671e8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cec9540e5e498dbaf34714cf3a36f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:37:12.828489 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ea7ced60-824e-4d07-90c9-e8d8e27bee56 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] 10.222.0.52 "GET /compute/v2.1/servers/c38f0173-a3d2-4254-96cd-ef24f8f0b989" status: 200 len: 1714 microversion: 2.1 time: 0.829238 Oct 19 03:37:12.832305 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2579/5080] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:37:11 2022] GET /compute/v2.1/servers/c38f0173-a3d2-4254-96cd-ef24f8f0b989 => generated 1714 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:37:13.858809 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2a32e22a-f9b6-4b43-9dcf-515aeccbee6e tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:37:13.860691 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2a32e22a-f9b6-4b43-9dcf-515aeccbee6e tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] [instance: c38f0173-a3d2-4254-96cd-ef24f8f0b989] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:37:13.872198 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2a32e22a-f9b6-4b43-9dcf-515aeccbee6e tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:37:13.882737 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2a32e22a-f9b6-4b43-9dcf-515aeccbee6e tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:37:13.885442 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2a32e22a-f9b6-4b43-9dcf-515aeccbee6e tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:37:13.891532 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2a32e22a-f9b6-4b43-9dcf-515aeccbee6e tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:37:13.892320 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2a32e22a-f9b6-4b43-9dcf-515aeccbee6e tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:37:13.900691 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2a32e22a-f9b6-4b43-9dcf-515aeccbee6e tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:37:14.963312 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-2a32e22a-f9b6-4b43-9dcf-515aeccbee6e tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb021cc6411420ab9e01353f671e8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cec9540e5e498dbaf34714cf3a36f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:37:14.978354 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2a32e22a-f9b6-4b43-9dcf-515aeccbee6e tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] 10.222.0.52 "GET /compute/v2.1/servers/c38f0173-a3d2-4254-96cd-ef24f8f0b989" status: 200 len: 1714 microversion: 2.1 time: 1.124108 Oct 19 03:37:14.978991 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2502/5081] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:37:13 2022] GET /compute/v2.1/servers/c38f0173-a3d2-4254-96cd-ef24f8f0b989 => generated 1714 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:37:16.007174 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-df448ae8-f34c-493d-b593-4a431e9afbf1 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:37:16.007865 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-df448ae8-f34c-493d-b593-4a431e9afbf1 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] [instance: c38f0173-a3d2-4254-96cd-ef24f8f0b989] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:37:16.039668 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:37:16.047525 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-df448ae8-f34c-493d-b593-4a431e9afbf1 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:37:16.049785 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-df448ae8-f34c-493d-b593-4a431e9afbf1 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:37:16.051127 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-df448ae8-f34c-493d-b593-4a431e9afbf1 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:37:16.054886 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-df448ae8-f34c-493d-b593-4a431e9afbf1 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:37:16.058988 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-df448ae8-f34c-493d-b593-4a431e9afbf1 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:37:16.079581 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-df448ae8-f34c-493d-b593-4a431e9afbf1 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:37:17.206454 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-df448ae8-f34c-493d-b593-4a431e9afbf1 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb021cc6411420ab9e01353f671e8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cec9540e5e498dbaf34714cf3a36f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:37:17.219527 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-df448ae8-f34c-493d-b593-4a431e9afbf1 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] 10.222.0.52 "GET /compute/v2.1/servers/c38f0173-a3d2-4254-96cd-ef24f8f0b989" status: 200 len: 1647 microversion: 2.1 time: 1.216961 Oct 19 03:37:17.220138 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2580/5082] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:37:16 2022] GET /compute/v2.1/servers/c38f0173-a3d2-4254-96cd-ef24f8f0b989 => generated 1647 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:37:17.418771 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-b375923c-e0e8-403e-a0d5-73dad50d6ae5 req-8003e856-9d5b-44b0-86fc-86197bfa50bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c38f0173-a3d2-4254-96cd-ef24f8f0b989", "name": "network-vif-deleted", "tag": "353b752a-9601-4dc9-9c18-c51d25b98599"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:37:17.429038 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:37:17.445516 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-b375923c-e0e8-403e-a0d5-73dad50d6ae5 req-8003e856-9d5b-44b0-86fc-86197bfa50bc service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:37:17.447366 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-b375923c-e0e8-403e-a0d5-73dad50d6ae5 req-8003e856-9d5b-44b0-86fc-86197bfa50bc service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:37:17.447972 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-b375923c-e0e8-403e-a0d5-73dad50d6ae5 req-8003e856-9d5b-44b0-86fc-86197bfa50bc service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:37:17.466281 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-b375923c-e0e8-403e-a0d5-73dad50d6ae5 req-8003e856-9d5b-44b0-86fc-86197bfa50bc service nova] Creating event network-vif-deleted:353b752a-9601-4dc9-9c18-c51d25b98599 for instance c38f0173-a3d2-4254-96cd-ef24f8f0b989 on n-h1-861333-8 Oct 19 03:37:17.493929 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-b375923c-e0e8-403e-a0d5-73dad50d6ae5 req-8003e856-9d5b-44b0-86fc-86197bfa50bc service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074883 Oct 19 03:37:17.493929 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2503/5083] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:37:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:37:18.245777 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7d184991-1dad-4a63-a3fa-2d0a203a4438 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:37:18.250728 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7d184991-1dad-4a63-a3fa-2d0a203a4438 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] [instance: c38f0173-a3d2-4254-96cd-ef24f8f0b989] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:37:18.263565 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7d184991-1dad-4a63-a3fa-2d0a203a4438 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:37:18.266737 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7d184991-1dad-4a63-a3fa-2d0a203a4438 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:37:18.267419 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7d184991-1dad-4a63-a3fa-2d0a203a4438 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:37:18.270901 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7d184991-1dad-4a63-a3fa-2d0a203a4438 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:37:18.272523 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7d184991-1dad-4a63-a3fa-2d0a203a4438 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:37:18.280828 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7d184991-1dad-4a63-a3fa-2d0a203a4438 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:37:18.377837 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7d184991-1dad-4a63-a3fa-2d0a203a4438 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:37:18.379260 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7d184991-1dad-4a63-a3fa-2d0a203a4438 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:37:18.379715 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7d184991-1dad-4a63-a3fa-2d0a203a4438 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:37:18.381150 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-7d184991-1dad-4a63-a3fa-2d0a203a4438 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Lazy-loading 'fault' on Instance uuid c38f0173-a3d2-4254-96cd-ef24f8f0b989 {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:37:18.595370 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7d184991-1dad-4a63-a3fa-2d0a203a4438 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb021cc6411420ab9e01353f671e8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cec9540e5e498dbaf34714cf3a36f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:37:18.617588 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7d184991-1dad-4a63-a3fa-2d0a203a4438 tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] 10.222.0.52 "GET /compute/v2.1/servers/c38f0173-a3d2-4254-96cd-ef24f8f0b989" status: 200 len: 1368 microversion: 2.1 time: 0.370261 Oct 19 03:37:18.628623 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2581/5084] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:37:18 2022] GET /compute/v2.1/servers/c38f0173-a3d2-4254-96cd-ef24f8f0b989 => generated 1368 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:37:19.648403 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:37:19.654527 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-396a8421-67b4-4fbc-9e94-e76d28ebe42c tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:37:19.655254 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-396a8421-67b4-4fbc-9e94-e76d28ebe42c tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] [instance: c38f0173-a3d2-4254-96cd-ef24f8f0b989] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:37:19.674265 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-396a8421-67b4-4fbc-9e94-e76d28ebe42c tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:37:19.677826 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-396a8421-67b4-4fbc-9e94-e76d28ebe42c tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:37:19.678473 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-396a8421-67b4-4fbc-9e94-e76d28ebe42c tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:37:19.682741 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-396a8421-67b4-4fbc-9e94-e76d28ebe42c tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:37:19.685084 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-396a8421-67b4-4fbc-9e94-e76d28ebe42c tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:37:19.685084 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-396a8421-67b4-4fbc-9e94-e76d28ebe42c tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:37:19.742002 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-396a8421-67b4-4fbc-9e94-e76d28ebe42c tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] HTTP exception thrown: Instance c38f0173-a3d2-4254-96cd-ef24f8f0b989 could not be found. Oct 19 03:37:19.744326 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-396a8421-67b4-4fbc-9e94-e76d28ebe42c tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Request method failure captured: Oct 19 03:37:19.744326 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/c38f0173-a3d2-4254-96cd-ef24f8f0b989 HTTP/1.1 Oct 19 03:37:19.744326 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:37:19.744326 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:37:19.744326 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:37:19.744326 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:37:19.744326 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:37:19.744326 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:37:19.744326 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:37:19.744326 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:37:19.744326 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3BzRFvFLFeob1XrZbjaW8Fy4TXuDIGWqjOsnAZN54Ji91craQxFbfAlHw3C_EGsIQ1dghUiLduf33vQjrbB7VG_gUuDM-De10WxN4LmduMe99l7Ip2MU1eRQSFvWjCQVz7BR7OCen4TVxFmDpV0dDLZxh836_j6IP_hnTj5sCIyVfo Oct 19 03:37:19.744326 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:37:19.744326 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:37:19.744326 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:37:19.744326 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:37:19.744326 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:37:19.744326 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:37:19.744326 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 32cec9540e5e498dbaf34714cf3a36f7 Oct 19 03:37:19.744326 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ServersTestManualDisk-1433617113 Oct 19 03:37:19.744326 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:37:19.744326 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:37:19.744326 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/32cec9540e5e498dbaf34714cf3a36f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/32cec9540e5e498dbaf34714cf3a36f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/32cec9540e5e498dbaf34714cf3a36f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_32cec9540e5e498dbaf34714cf3a36f7", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:37:19.744326 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ServersTestManualDisk-1433617113 Oct 19 03:37:19.744326 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 32cec9540e5e498dbaf34714cf3a36f7 Oct 19 03:37:19.744326 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ServersTestManualDisk-1433617113 Oct 19 03:37:19.744326 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ServersTestManualDisk-1433617113-project Oct 19 03:37:19.744326 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:37:19.744326 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:37:19.744326 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 4cb021cc6411420ab9e01353f671e8cb Oct 19 03:37:19.744326 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ServersTestManualDisk-1433617113-project Oct 19 03:37:19.744326 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:37:19.744326 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance c38f0173-a3d2-4254-96cd-ef24f8f0b989 could not be found. Oct 19 03:37:19.744326 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': 'c38f0173-a3d2-4254-96cd-ef24f8f0b989'} Oct 19 03:37:19.744326 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:37:19.744326 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:37:19.744326 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:37:19.744326 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:37:19.744326 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:37:19.744326 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:37:19.744326 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:37:19.744326 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:37:19.744326 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:37:19.744326 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:37:19.744326 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c38f0173-a3d2-4254-96cd-ef24f8f0b989 could not be found. Oct 19 03:37:19.744326 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:37:19.744326 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:37:19.744326 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:37:19.744326 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:37:19.744326 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:37:19.744326 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:37:19.744326 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:37:19.744326 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:37:19.744326 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:37:19.744326 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:37:19.744326 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:37:19.744326 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:37:19.744326 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:37:19.744326 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:37:19.744326 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:37:19.744326 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:37:19.744326 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c38f0173-a3d2-4254-96cd-ef24f8f0b989 could not be found. Oct 19 03:37:19.744326 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:37:19.744326 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:37:19.744326 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:37:19.752059 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:37:19.752059 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:37:19.752059 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:37:19.752059 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:37:19.752059 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:37:19.752059 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c38f0173-a3d2-4254-96cd-ef24f8f0b989 could not be found. Oct 19 03:37:19.752059 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:37:19.752059 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-396a8421-67b4-4fbc-9e94-e76d28ebe42c tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Returning 404 to user: Instance c38f0173-a3d2-4254-96cd-ef24f8f0b989 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:37:19.769240 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-396a8421-67b4-4fbc-9e94-e76d28ebe42c tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] 10.222.0.52 "GET /compute/v2.1/servers/c38f0173-a3d2-4254-96cd-ef24f8f0b989" status: 404 len: 111 microversion: 2.1 time: 0.115553 Oct 19 03:37:19.781655 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d0c2524d-62b9-4b46-ad4e-ce332a73ba2c tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] Calling method '.version_select at 0x7fc12be3b3a0>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:37:19.782896 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2504/5085] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:37:19 2022] GET /compute/v2.1/servers/c38f0173-a3d2-4254-96cd-ef24f8f0b989 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:37:19.796278 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:37:19.798061 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:37:19.893510 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d0c2524d-62b9-4b46-ad4e-ce332a73ba2c tempest-ServersTestManualDisk-1433617113 tempest-ServersTestManualDisk-1433617113-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1263498779" status: 202 len: 0 microversion: 2.1 time: 0.116946 Oct 19 03:37:19.904629 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2582/5086] 10.222.0.52 () {58 vars in 1221 bytes} [Wed Oct 19 03:37:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1263498779 => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 19 03:37:21.741876 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f2abffcf-9189-4396-9add-7d20a1fb6d5e tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:37:21.771317 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f2abffcf-9189-4396-9add-7d20a1fb6d5e tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:37:21.771317 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f2abffcf-9189-4396-9add-7d20a1fb6d5e tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:37:21.771317 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f2abffcf-9189-4396-9add-7d20a1fb6d5e tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:37:21.920678 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f2abffcf-9189-4396-9add-7d20a1fb6d5e tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] [instance: ddbf7afb-1d7b-4d33-b6fb-1f1608c11985] Going to try to stop instance {{(pid=121134) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 19 03:37:22.218132 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f2abffcf-9189-4396-9add-7d20a1fb6d5e tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] 10.222.0.52 "POST /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985/action" status: 202 len: 0 microversion: 2.1 time: 0.478309 Oct 19 03:37:22.218964 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2505/5087] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:37:21 2022] POST /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985/action => generated 0 bytes in 482 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:37:22.228853 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-09bd3e19-f27f-4568-9230-76ad537415bc tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:37:22.230179 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-09bd3e19-f27f-4568-9230-76ad537415bc tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] [instance: ddbf7afb-1d7b-4d33-b6fb-1f1608c11985] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:37:22.253121 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-09bd3e19-f27f-4568-9230-76ad537415bc tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:37:22.254002 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-09bd3e19-f27f-4568-9230-76ad537415bc tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:37:22.254806 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-09bd3e19-f27f-4568-9230-76ad537415bc tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:37:22.255924 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-09bd3e19-f27f-4568-9230-76ad537415bc tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:37:22.256619 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-09bd3e19-f27f-4568-9230-76ad537415bc tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:37:22.258013 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-09bd3e19-f27f-4568-9230-76ad537415bc tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:37:23.307938 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-09bd3e19-f27f-4568-9230-76ad537415bc tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c65a497e16e4e41b5cf1287042f3a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4001edd1474947a94243a620a6013a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:37:23.361152 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-09bd3e19-f27f-4568-9230-76ad537415bc tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] 10.222.0.52 "GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985" status: 200 len: 1676 microversion: 2.1 time: 1.137357 Oct 19 03:37:23.388664 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2583/5088] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:37:22 2022] GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985 => generated 1676 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:37:24.402830 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2e5265c1-2679-449e-9a27-d338a280280e tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:37:24.416897 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2e5265c1-2679-449e-9a27-d338a280280e tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] [instance: ddbf7afb-1d7b-4d33-b6fb-1f1608c11985] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:37:24.435851 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2e5265c1-2679-449e-9a27-d338a280280e tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:37:24.438243 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2e5265c1-2679-449e-9a27-d338a280280e tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:37:24.438757 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2e5265c1-2679-449e-9a27-d338a280280e tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:37:24.466627 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2e5265c1-2679-449e-9a27-d338a280280e tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:37:24.467386 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2e5265c1-2679-449e-9a27-d338a280280e tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:37:24.468167 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2e5265c1-2679-449e-9a27-d338a280280e tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:37:25.321853 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-2e5265c1-2679-449e-9a27-d338a280280e tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c65a497e16e4e41b5cf1287042f3a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4001edd1474947a94243a620a6013a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:37:25.344425 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2e5265c1-2679-449e-9a27-d338a280280e tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] 10.222.0.52 "GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985" status: 200 len: 1676 microversion: 2.1 time: 0.948235 Oct 19 03:37:25.350941 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2506/5089] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:37:24 2022] GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985 => generated 1676 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:37:26.372517 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f272db78-c405-47a8-82cb-66e1e487420a tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:37:26.374073 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f272db78-c405-47a8-82cb-66e1e487420a tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] [instance: ddbf7afb-1d7b-4d33-b6fb-1f1608c11985] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:37:26.385443 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f272db78-c405-47a8-82cb-66e1e487420a tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:37:26.393010 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f272db78-c405-47a8-82cb-66e1e487420a tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:37:26.395636 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f272db78-c405-47a8-82cb-66e1e487420a tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:37:26.396863 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f272db78-c405-47a8-82cb-66e1e487420a tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:37:26.399933 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f272db78-c405-47a8-82cb-66e1e487420a tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:37:26.400851 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f272db78-c405-47a8-82cb-66e1e487420a tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:37:26.817877 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f272db78-c405-47a8-82cb-66e1e487420a tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c65a497e16e4e41b5cf1287042f3a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4001edd1474947a94243a620a6013a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:37:26.833049 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f272db78-c405-47a8-82cb-66e1e487420a tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] 10.222.0.52 "GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985" status: 200 len: 1676 microversion: 2.1 time: 0.460614 Oct 19 03:37:26.834229 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2584/5090] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:37:26 2022] GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985 => generated 1676 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:37:27.931857 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1c1ffeff-b103-4f97-a76a-452b92b9715b tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:37:27.931857 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1c1ffeff-b103-4f97-a76a-452b92b9715b tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] [instance: ddbf7afb-1d7b-4d33-b6fb-1f1608c11985] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:37:27.931857 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1c1ffeff-b103-4f97-a76a-452b92b9715b tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:37:27.931857 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1c1ffeff-b103-4f97-a76a-452b92b9715b tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:37:27.931857 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1c1ffeff-b103-4f97-a76a-452b92b9715b tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:37:27.931857 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1c1ffeff-b103-4f97-a76a-452b92b9715b tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:37:27.931857 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1c1ffeff-b103-4f97-a76a-452b92b9715b tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:37:27.931857 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1c1ffeff-b103-4f97-a76a-452b92b9715b tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:37:29.511751 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-1c1ffeff-b103-4f97-a76a-452b92b9715b tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c65a497e16e4e41b5cf1287042f3a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4001edd1474947a94243a620a6013a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:37:29.522334 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1c1ffeff-b103-4f97-a76a-452b92b9715b tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] 10.222.0.52 "GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985" status: 200 len: 1676 microversion: 2.1 time: 1.668133 Oct 19 03:37:29.526261 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2507/5091] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:37:27 2022] GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985 => generated 1676 bytes in 1672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:37:30.553147 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-8f73ca15-62c2-4f39-8e2d-26e255eee6bf tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:37:30.562944 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-8f73ca15-62c2-4f39-8e2d-26e255eee6bf tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] [instance: ddbf7afb-1d7b-4d33-b6fb-1f1608c11985] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:37:30.568356 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8f73ca15-62c2-4f39-8e2d-26e255eee6bf tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:37:30.568890 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8f73ca15-62c2-4f39-8e2d-26e255eee6bf tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:37:30.569351 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8f73ca15-62c2-4f39-8e2d-26e255eee6bf tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:37:30.570122 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8f73ca15-62c2-4f39-8e2d-26e255eee6bf tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:37:30.571211 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8f73ca15-62c2-4f39-8e2d-26e255eee6bf tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:37:30.577458 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8f73ca15-62c2-4f39-8e2d-26e255eee6bf tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:37:31.013230 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-8f73ca15-62c2-4f39-8e2d-26e255eee6bf tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c65a497e16e4e41b5cf1287042f3a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4001edd1474947a94243a620a6013a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:37:31.023102 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-8f73ca15-62c2-4f39-8e2d-26e255eee6bf tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] 10.222.0.52 "GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985" status: 200 len: 1676 microversion: 2.1 time: 0.474590 Oct 19 03:37:31.025964 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2585/5092] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:37:30 2022] GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985 => generated 1676 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:37:32.048843 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-eddb038e-7a5b-4f43-b58c-aad882accb68 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:37:32.050172 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-eddb038e-7a5b-4f43-b58c-aad882accb68 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] [instance: ddbf7afb-1d7b-4d33-b6fb-1f1608c11985] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:37:32.068978 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eddb038e-7a5b-4f43-b58c-aad882accb68 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:37:32.069927 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eddb038e-7a5b-4f43-b58c-aad882accb68 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:37:32.071688 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eddb038e-7a5b-4f43-b58c-aad882accb68 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:37:32.072859 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eddb038e-7a5b-4f43-b58c-aad882accb68 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:37:32.073683 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eddb038e-7a5b-4f43-b58c-aad882accb68 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:37:32.076501 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eddb038e-7a5b-4f43-b58c-aad882accb68 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:37:32.881542 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-eddb038e-7a5b-4f43-b58c-aad882accb68 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c65a497e16e4e41b5cf1287042f3a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4001edd1474947a94243a620a6013a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:37:32.900974 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-eddb038e-7a5b-4f43-b58c-aad882accb68 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] 10.222.0.52 "GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985" status: 200 len: 1676 microversion: 2.1 time: 0.853456 Oct 19 03:37:32.903198 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2508/5093] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:37:32 2022] GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985 => generated 1676 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:37:33.927812 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-029f4bf4-a426-4cf2-8e1c-5a491727fe0a tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:37:33.934633 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-029f4bf4-a426-4cf2-8e1c-5a491727fe0a tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] [instance: ddbf7afb-1d7b-4d33-b6fb-1f1608c11985] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:37:33.944014 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-029f4bf4-a426-4cf2-8e1c-5a491727fe0a tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:37:33.946272 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-029f4bf4-a426-4cf2-8e1c-5a491727fe0a tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:37:33.947519 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-029f4bf4-a426-4cf2-8e1c-5a491727fe0a tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:37:33.949260 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-029f4bf4-a426-4cf2-8e1c-5a491727fe0a tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:37:33.953909 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-029f4bf4-a426-4cf2-8e1c-5a491727fe0a tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:37:33.954660 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-029f4bf4-a426-4cf2-8e1c-5a491727fe0a tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:37:34.019062 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:37:34.772772 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-029f4bf4-a426-4cf2-8e1c-5a491727fe0a tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c65a497e16e4e41b5cf1287042f3a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4001edd1474947a94243a620a6013a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:37:34.814310 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-029f4bf4-a426-4cf2-8e1c-5a491727fe0a tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] 10.222.0.52 "GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985" status: 200 len: 1676 microversion: 2.1 time: 0.891224 Oct 19 03:37:34.832148 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2586/5094] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:37:33 2022] GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985 => generated 1676 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:37:35.856496 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f60b589f-0764-42fb-aa63-26ba8f36d2e0 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:37:35.857701 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f60b589f-0764-42fb-aa63-26ba8f36d2e0 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] [instance: ddbf7afb-1d7b-4d33-b6fb-1f1608c11985] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:37:35.890426 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f60b589f-0764-42fb-aa63-26ba8f36d2e0 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:37:35.890989 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f60b589f-0764-42fb-aa63-26ba8f36d2e0 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:37:35.893079 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f60b589f-0764-42fb-aa63-26ba8f36d2e0 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:37:35.896429 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f60b589f-0764-42fb-aa63-26ba8f36d2e0 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:37:35.898796 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f60b589f-0764-42fb-aa63-26ba8f36d2e0 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:37:35.900790 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f60b589f-0764-42fb-aa63-26ba8f36d2e0 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:37:37.973159 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-f60b589f-0764-42fb-aa63-26ba8f36d2e0 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c65a497e16e4e41b5cf1287042f3a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4001edd1474947a94243a620a6013a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:37:37.988399 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f60b589f-0764-42fb-aa63-26ba8f36d2e0 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] 10.222.0.52 "GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985" status: 200 len: 1676 microversion: 2.1 time: 2.134475 Oct 19 03:37:37.991269 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2509/5095] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:37:35 2022] GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985 => generated 1676 bytes in 2141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:37:39.028158 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7ddcf9ea-5a12-419a-a5e8-91de2f6d39d7 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:37:39.057897 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7ddcf9ea-5a12-419a-a5e8-91de2f6d39d7 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] [instance: ddbf7afb-1d7b-4d33-b6fb-1f1608c11985] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:37:39.098173 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7ddcf9ea-5a12-419a-a5e8-91de2f6d39d7 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:37:39.098934 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7ddcf9ea-5a12-419a-a5e8-91de2f6d39d7 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:37:39.102950 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7ddcf9ea-5a12-419a-a5e8-91de2f6d39d7 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:37:39.103922 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7ddcf9ea-5a12-419a-a5e8-91de2f6d39d7 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:37:39.104579 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7ddcf9ea-5a12-419a-a5e8-91de2f6d39d7 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:37:39.105456 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7ddcf9ea-5a12-419a-a5e8-91de2f6d39d7 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:37:40.240977 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7ddcf9ea-5a12-419a-a5e8-91de2f6d39d7 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c65a497e16e4e41b5cf1287042f3a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4001edd1474947a94243a620a6013a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:37:40.260837 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7ddcf9ea-5a12-419a-a5e8-91de2f6d39d7 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] 10.222.0.52 "GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985" status: 200 len: 1653 microversion: 2.1 time: 1.239156 Oct 19 03:37:40.276508 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2587/5096] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:37:39 2022] GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985 => generated 1653 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:37:40.299408 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-82b91be0-775c-4e60-891b-9229f49666a3 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:37:40.308479 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-82b91be0-775c-4e60-891b-9229f49666a3 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:37:40.309362 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-82b91be0-775c-4e60-891b-9229f49666a3 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:37:40.310074 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-82b91be0-775c-4e60-891b-9229f49666a3 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:37:40.333805 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:37:40.343586 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-82b91be0-775c-4e60-891b-9229f49666a3 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] [instance: ddbf7afb-1d7b-4d33-b6fb-1f1608c11985] Going to try to start instance {{(pid=121134) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 19 03:37:40.785400 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-82b91be0-775c-4e60-891b-9229f49666a3 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] 10.222.0.52 "POST /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985/action" status: 202 len: 0 microversion: 2.1 time: 0.489645 Oct 19 03:37:40.786345 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2510/5097] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:37:40 2022] POST /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985/action => generated 0 bytes in 491 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:37:40.803426 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9e3829e0-69fc-4878-8b84-420de7db2f55 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:37:40.804292 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9e3829e0-69fc-4878-8b84-420de7db2f55 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] [instance: ddbf7afb-1d7b-4d33-b6fb-1f1608c11985] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:37:40.817522 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9e3829e0-69fc-4878-8b84-420de7db2f55 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:37:40.824790 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9e3829e0-69fc-4878-8b84-420de7db2f55 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:37:40.825657 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9e3829e0-69fc-4878-8b84-420de7db2f55 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:37:40.826676 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9e3829e0-69fc-4878-8b84-420de7db2f55 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:37:40.827643 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9e3829e0-69fc-4878-8b84-420de7db2f55 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:37:40.828305 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9e3829e0-69fc-4878-8b84-420de7db2f55 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:37:42.083019 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-9e3829e0-69fc-4878-8b84-420de7db2f55 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c65a497e16e4e41b5cf1287042f3a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4001edd1474947a94243a620a6013a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:37:42.109641 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9e3829e0-69fc-4878-8b84-420de7db2f55 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] 10.222.0.52 "GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985" status: 200 len: 1662 microversion: 2.1 time: 1.319127 Oct 19 03:37:42.110249 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2588/5098] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:37:40 2022] GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985 => generated 1662 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:37:43.138721 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-bc05a09e-f1ce-4915-af8f-265195e969c1 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:37:43.139434 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-bc05a09e-f1ce-4915-af8f-265195e969c1 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] [instance: ddbf7afb-1d7b-4d33-b6fb-1f1608c11985] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:37:43.160041 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bc05a09e-f1ce-4915-af8f-265195e969c1 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:37:43.160726 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bc05a09e-f1ce-4915-af8f-265195e969c1 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:37:43.161338 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bc05a09e-f1ce-4915-af8f-265195e969c1 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:37:43.162313 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bc05a09e-f1ce-4915-af8f-265195e969c1 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:37:43.162951 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bc05a09e-f1ce-4915-af8f-265195e969c1 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:37:43.164080 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bc05a09e-f1ce-4915-af8f-265195e969c1 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:37:43.544719 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-bc05a09e-f1ce-4915-af8f-265195e969c1 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c65a497e16e4e41b5cf1287042f3a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4001edd1474947a94243a620a6013a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:37:43.579578 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-bc05a09e-f1ce-4915-af8f-265195e969c1 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] 10.222.0.52 "GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985" status: 200 len: 1662 microversion: 2.1 time: 0.442765 Oct 19 03:37:43.582437 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2511/5099] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:37:43 2022] GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985 => generated 1662 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:37:44.608204 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c2d25cce-3957-43a3-be15-831eabc4d7a9 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:37:44.608735 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c2d25cce-3957-43a3-be15-831eabc4d7a9 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] [instance: ddbf7afb-1d7b-4d33-b6fb-1f1608c11985] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:37:44.626275 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c2d25cce-3957-43a3-be15-831eabc4d7a9 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:37:44.626781 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c2d25cce-3957-43a3-be15-831eabc4d7a9 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:37:44.627227 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c2d25cce-3957-43a3-be15-831eabc4d7a9 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:37:44.627946 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c2d25cce-3957-43a3-be15-831eabc4d7a9 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:37:44.628409 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c2d25cce-3957-43a3-be15-831eabc4d7a9 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:37:44.628840 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c2d25cce-3957-43a3-be15-831eabc4d7a9 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:37:45.325649 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c2d25cce-3957-43a3-be15-831eabc4d7a9 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c65a497e16e4e41b5cf1287042f3a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4001edd1474947a94243a620a6013a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:37:45.342174 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c2d25cce-3957-43a3-be15-831eabc4d7a9 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] 10.222.0.52 "GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985" status: 200 len: 1662 microversion: 2.1 time: 0.739010 Oct 19 03:37:45.343189 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2589/5100] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:37:44 2022] GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985 => generated 1662 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:37:46.373691 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3725e762-9987-4eb3-8082-61cc3aa6412a tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:37:46.374930 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3725e762-9987-4eb3-8082-61cc3aa6412a tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] [instance: ddbf7afb-1d7b-4d33-b6fb-1f1608c11985] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:37:46.400954 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3725e762-9987-4eb3-8082-61cc3aa6412a tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:37:46.401500 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3725e762-9987-4eb3-8082-61cc3aa6412a tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:37:46.401958 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3725e762-9987-4eb3-8082-61cc3aa6412a tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:37:46.402690 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3725e762-9987-4eb3-8082-61cc3aa6412a tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:37:46.416615 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3725e762-9987-4eb3-8082-61cc3aa6412a tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:37:46.417190 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3725e762-9987-4eb3-8082-61cc3aa6412a tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:37:47.004530 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-3725e762-9987-4eb3-8082-61cc3aa6412a tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c65a497e16e4e41b5cf1287042f3a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4001edd1474947a94243a620a6013a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:37:47.015210 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3725e762-9987-4eb3-8082-61cc3aa6412a tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] 10.222.0.52 "GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985" status: 200 len: 1666 microversion: 2.1 time: 0.645549 Oct 19 03:37:47.021666 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2512/5101] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:37:46 2022] GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985 => generated 1666 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:37:47.217569 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2641d326-7f9e-4e56-843f-71dbc46864f0 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1062995077", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "networks": [{"uuid": "3ecd8896-b7a4-4c3a-b3cd-dc6769233813"}]}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:37:47.356987 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.network.neutron [None req-2641d326-7f9e-4e56-843f-71dbc46864f0 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] validate_networks() for [('3ecd8896-b7a4-4c3a-b3cd-dc6769233813', None, None, None, None, None)] {{(pid=121135) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:37:48.867083 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-2641d326-7f9e-4e56-843f-71dbc46864f0 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Flavor limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:37:48.867697 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-2641d326-7f9e-4e56-843f-71dbc46864f0 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Image limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:37:48.868028 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-2641d326-7f9e-4e56-843f-71dbc46864f0 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Flavor pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:37:48.868459 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-2641d326-7f9e-4e56-843f-71dbc46864f0 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Image pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:37:48.868858 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-2641d326-7f9e-4e56-843f-71dbc46864f0 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:37:48.888889 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=25,nova_api:DELETE=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:37:48.918754 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2641d326-7f9e-4e56-843f-71dbc46864f0 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:37:48.919349 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2641d326-7f9e-4e56-843f-71dbc46864f0 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:37:48.919794 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2641d326-7f9e-4e56-843f-71dbc46864f0 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:37:48.923839 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2641d326-7f9e-4e56-843f-71dbc46864f0 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:37:48.924450 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2641d326-7f9e-4e56-843f-71dbc46864f0 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:37:48.924934 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2641d326-7f9e-4e56-843f-71dbc46864f0 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:37:48.977090 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-2641d326-7f9e-4e56-843f-71dbc46864f0 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Getting quotas for project 34bd94983fbf4a8aa49aff65c076e9e3. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:37:48.988086 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-2641d326-7f9e-4e56-843f-71dbc46864f0 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Getting quotas for user 771feb133bc046588552d3af98f8e0a1 and project 34bd94983fbf4a8aa49aff65c076e9e3. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:37:49.022804 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-2641d326-7f9e-4e56-843f-71dbc46864f0 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Going to run 1 instances... {{(pid=121135) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:37:49.028113 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-2641d326-7f9e-4e56-843f-71dbc46864f0 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121135) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:37:49.286291 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2641d326-7f9e-4e56-843f-71dbc46864f0 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.800574 Oct 19 03:37:49.289457 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2590/5102] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:37:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 2805 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 03:37:49.302404 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6458ad33-c4cd-4051-b606-e704123b179f tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:37:49.303101 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6458ad33-c4cd-4051-b606-e704123b179f tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:37:49.418430 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-6458ad33-c4cd-4051-b606-e704123b179f tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:37:49.429774 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6458ad33-c4cd-4051-b606-e704123b179f tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1217 microversion: 2.1 time: 0.129898 Oct 19 03:37:49.432695 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2513/5103] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:37:49 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1217 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:37:50.466320 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a340b771-88d4-4ff0-b48a-a3a74a156e6f tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:37:50.469261 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a340b771-88d4-4ff0-b48a-a3a74a156e6f tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:37:50.689862 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a340b771-88d4-4ff0-b48a-a3a74a156e6f tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:37:50.712243 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a340b771-88d4-4ff0-b48a-a3a74a156e6f tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1217 microversion: 2.1 time: 0.248143 Oct 19 03:37:50.714768 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2591/5104] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:37:50 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1217 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:37:51.735954 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-83445996-77a3-448f-ba99-a8a43a1ed0fd tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:37:51.737017 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-83445996-77a3-448f-ba99-a8a43a1ed0fd tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:37:51.776395 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-83445996-77a3-448f-ba99-a8a43a1ed0fd tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:37:51.786224 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-83445996-77a3-448f-ba99-a8a43a1ed0fd tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:37:51.787085 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-83445996-77a3-448f-ba99-a8a43a1ed0fd tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:37:51.788716 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-83445996-77a3-448f-ba99-a8a43a1ed0fd tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:37:51.789438 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-83445996-77a3-448f-ba99-a8a43a1ed0fd tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:37:51.790109 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-83445996-77a3-448f-ba99-a8a43a1ed0fd tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:37:51.954944 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-83445996-77a3-448f-ba99-a8a43a1ed0fd tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:37:51.975177 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-83445996-77a3-448f-ba99-a8a43a1ed0fd tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1221 microversion: 2.1 time: 0.240457 Oct 19 03:37:51.995506 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2514/5105] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:37:51 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1221 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:37:53.019206 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e673567f-eced-4707-8f25-9c66137754a8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:37:53.020030 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e673567f-eced-4707-8f25-9c66137754a8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:37:53.047399 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e673567f-eced-4707-8f25-9c66137754a8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:37:53.049333 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e673567f-eced-4707-8f25-9c66137754a8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:37:53.049983 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e673567f-eced-4707-8f25-9c66137754a8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:37:53.052395 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e673567f-eced-4707-8f25-9c66137754a8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:37:53.053140 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e673567f-eced-4707-8f25-9c66137754a8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:37:53.056920 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e673567f-eced-4707-8f25-9c66137754a8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:37:53.258067 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-e673567f-eced-4707-8f25-9c66137754a8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:37:53.279726 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e673567f-eced-4707-8f25-9c66137754a8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1269 microversion: 2.1 time: 0.271651 Oct 19 03:37:53.281219 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2592/5106] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:37:53 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1269 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:37:54.308294 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5b2648a8-7871-4338-b56d-68ae3348dfa8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:37:54.309182 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-5b2648a8-7871-4338-b56d-68ae3348dfa8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:37:54.331942 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5b2648a8-7871-4338-b56d-68ae3348dfa8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:37:54.332876 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5b2648a8-7871-4338-b56d-68ae3348dfa8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:37:54.333755 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5b2648a8-7871-4338-b56d-68ae3348dfa8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:37:54.334681 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5b2648a8-7871-4338-b56d-68ae3348dfa8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:37:54.335884 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5b2648a8-7871-4338-b56d-68ae3348dfa8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:37:54.337146 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5b2648a8-7871-4338-b56d-68ae3348dfa8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:37:54.574393 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-bdcea286-2893-47bd-b560-41bf3a5d50bb tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-995096752", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "networks": [{"uuid": "c7fc46f7-f975-4fb5-83e4-9e9303a4a241"}]}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:37:54.591246 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-5b2648a8-7871-4338-b56d-68ae3348dfa8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:37:54.593896 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=26 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:37:54.599375 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5b2648a8-7871-4338-b56d-68ae3348dfa8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1275 microversion: 2.1 time: 0.295864 Oct 19 03:37:54.613953 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2593/5107] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:37:54 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1275 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:37:54.665227 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-bdcea286-2893-47bd-b560-41bf3a5d50bb tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] validate_networks() for [('c7fc46f7-f975-4fb5-83e4-9e9303a4a241', None, None, None, None, None)] {{(pid=121134) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:37:55.624698 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-95618b07-24f6-4cc4-923e-0e109b032bfa tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:37:55.625945 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-95618b07-24f6-4cc4-923e-0e109b032bfa tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:37:55.643185 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-95618b07-24f6-4cc4-923e-0e109b032bfa tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:37:55.643680 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-95618b07-24f6-4cc4-923e-0e109b032bfa tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:37:55.650755 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-95618b07-24f6-4cc4-923e-0e109b032bfa tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:37:55.653963 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-95618b07-24f6-4cc4-923e-0e109b032bfa tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:37:55.656188 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-95618b07-24f6-4cc4-923e-0e109b032bfa tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:37:55.657668 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-95618b07-24f6-4cc4-923e-0e109b032bfa tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:37:55.779220 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-bdcea286-2893-47bd-b560-41bf3a5d50bb tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Flavor limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:37:55.779714 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-bdcea286-2893-47bd-b560-41bf3a5d50bb tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Image limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:37:55.780127 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-bdcea286-2893-47bd-b560-41bf3a5d50bb tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Flavor pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:37:55.780600 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-bdcea286-2893-47bd-b560-41bf3a5d50bb tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Image pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:37:55.781171 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-bdcea286-2893-47bd-b560-41bf3a5d50bb tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:37:55.804155 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bdcea286-2893-47bd-b560-41bf3a5d50bb tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:37:55.804662 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bdcea286-2893-47bd-b560-41bf3a5d50bb tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:37:55.805116 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bdcea286-2893-47bd-b560-41bf3a5d50bb tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:37:55.811754 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bdcea286-2893-47bd-b560-41bf3a5d50bb tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:37:55.812273 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bdcea286-2893-47bd-b560-41bf3a5d50bb tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:37:55.812735 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bdcea286-2893-47bd-b560-41bf3a5d50bb tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:37:55.862292 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-bdcea286-2893-47bd-b560-41bf3a5d50bb tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Getting quotas for project 224417be63ba4c679b0256a27fb9f104. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:37:55.870804 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-bdcea286-2893-47bd-b560-41bf3a5d50bb tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Getting quotas for user d099c5070710485f83d528d3d2bb1c71 and project 224417be63ba4c679b0256a27fb9f104. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:37:55.889348 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-95618b07-24f6-4cc4-923e-0e109b032bfa tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:37:55.914547 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-95618b07-24f6-4cc4-923e-0e109b032bfa tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1275 microversion: 2.1 time: 0.294644 Oct 19 03:37:55.915821 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2594/5108] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:37:55 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1275 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:37:55.930546 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-bdcea286-2893-47bd-b560-41bf3a5d50bb tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Going to run 1 instances... {{(pid=121134) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:37:55.933418 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-bdcea286-2893-47bd-b560-41bf3a5d50bb tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 532ba404-fc1a-44d7-93dc-8e5d9f01c8e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:37:56.200916 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-bdcea286-2893-47bd-b560-41bf3a5d50bb tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.934335 Oct 19 03:37:56.201341 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2515/5109] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:37:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1936 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 03:37:56.214289 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-aa78226d-d88f-4602-8a90-6e58f739cd12 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:37:56.215309 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-aa78226d-d88f-4602-8a90-6e58f739cd12 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 532ba404-fc1a-44d7-93dc-8e5d9f01c8e4] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:37:56.340619 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-aa78226d-d88f-4602-8a90-6e58f739cd12 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:37:56.353041 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-aa78226d-d88f-4602-8a90-6e58f739cd12 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/532ba404-fc1a-44d7-93dc-8e5d9f01c8e4" status: 200 len: 1214 microversion: 2.1 time: 0.139806 Oct 19 03:37:56.354304 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2595/5110] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:37:56 2022] GET /compute/v2.1/servers/532ba404-fc1a-44d7-93dc-8e5d9f01c8e4 => generated 1214 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:37:56.947935 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-13559ca1-d3ca-4f32-ab30-fcc7a43a2a99 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:37:56.949665 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-13559ca1-d3ca-4f32-ab30-fcc7a43a2a99 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:37:56.971809 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-13559ca1-d3ca-4f32-ab30-fcc7a43a2a99 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:37:56.975836 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-13559ca1-d3ca-4f32-ab30-fcc7a43a2a99 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:37:56.976817 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-13559ca1-d3ca-4f32-ab30-fcc7a43a2a99 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:37:56.978096 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-13559ca1-d3ca-4f32-ab30-fcc7a43a2a99 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:37:56.978801 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-13559ca1-d3ca-4f32-ab30-fcc7a43a2a99 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:37:56.980096 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-13559ca1-d3ca-4f32-ab30-fcc7a43a2a99 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:37:57.383790 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-557d1286-c25c-41c1-ad41-dafdd59138b1 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:37:57.399548 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-557d1286-c25c-41c1-ad41-dafdd59138b1 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 532ba404-fc1a-44d7-93dc-8e5d9f01c8e4] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:37:57.511127 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-557d1286-c25c-41c1-ad41-dafdd59138b1 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:37:57.519273 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-557d1286-c25c-41c1-ad41-dafdd59138b1 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/532ba404-fc1a-44d7-93dc-8e5d9f01c8e4" status: 200 len: 1214 microversion: 2.1 time: 0.144770 Oct 19 03:37:57.521808 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2596/5111] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:37:57 2022] GET /compute/v2.1/servers/532ba404-fc1a-44d7-93dc-8e5d9f01c8e4 => generated 1214 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:37:57.738542 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-13559ca1-d3ca-4f32-ab30-fcc7a43a2a99 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:37:57.773409 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-13559ca1-d3ca-4f32-ab30-fcc7a43a2a99 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1317 microversion: 2.1 time: 0.836964 Oct 19 03:37:57.781837 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2516/5112] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:37:56 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1317 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:37:58.548894 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-585f7201-8722-43d3-b31d-e737ffaaa3e9 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:37:58.555775 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-585f7201-8722-43d3-b31d-e737ffaaa3e9 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 532ba404-fc1a-44d7-93dc-8e5d9f01c8e4] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:37:58.572190 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-585f7201-8722-43d3-b31d-e737ffaaa3e9 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:37:58.572713 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-585f7201-8722-43d3-b31d-e737ffaaa3e9 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:37:58.580910 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-585f7201-8722-43d3-b31d-e737ffaaa3e9 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:37:58.581873 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-585f7201-8722-43d3-b31d-e737ffaaa3e9 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:37:58.582368 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-585f7201-8722-43d3-b31d-e737ffaaa3e9 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:37:58.582826 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-585f7201-8722-43d3-b31d-e737ffaaa3e9 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:37:58.848059 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ca170d0c-4160-4b23-bc1f-39125f811652 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:37:58.848059 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ca170d0c-4160-4b23-bc1f-39125f811652 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:37:58.848059 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ca170d0c-4160-4b23-bc1f-39125f811652 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:37:58.848059 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ca170d0c-4160-4b23-bc1f-39125f811652 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:37:58.848059 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ca170d0c-4160-4b23-bc1f-39125f811652 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:37:58.853198 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-585f7201-8722-43d3-b31d-e737ffaaa3e9 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:37:58.854852 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ca170d0c-4160-4b23-bc1f-39125f811652 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:37:58.854852 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ca170d0c-4160-4b23-bc1f-39125f811652 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:37:58.854852 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ca170d0c-4160-4b23-bc1f-39125f811652 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:37:58.855932 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-585f7201-8722-43d3-b31d-e737ffaaa3e9 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/532ba404-fc1a-44d7-93dc-8e5d9f01c8e4" status: 200 len: 1218 microversion: 2.1 time: 0.288101 Oct 19 03:37:58.855932 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2597/5113] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:37:58 2022] GET /compute/v2.1/servers/532ba404-fc1a-44d7-93dc-8e5d9f01c8e4 => generated 1218 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:37:59.873078 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-86d0a5f5-3174-4466-b63d-46109b30714c tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:37:59.873078 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-86d0a5f5-3174-4466-b63d-46109b30714c tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 532ba404-fc1a-44d7-93dc-8e5d9f01c8e4] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:37:59.881030 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:37:59.886881 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-86d0a5f5-3174-4466-b63d-46109b30714c tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:37:59.889048 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-86d0a5f5-3174-4466-b63d-46109b30714c tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:37:59.891374 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-86d0a5f5-3174-4466-b63d-46109b30714c tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:37:59.894186 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-86d0a5f5-3174-4466-b63d-46109b30714c tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:37:59.894677 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-86d0a5f5-3174-4466-b63d-46109b30714c tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:37:59.898706 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-86d0a5f5-3174-4466-b63d-46109b30714c tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:00.235582 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ca170d0c-4160-4b23-bc1f-39125f811652 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:38:00.250604 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ca170d0c-4160-4b23-bc1f-39125f811652 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1317 microversion: 2.1 time: 1.452173 Oct 19 03:38:00.255803 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-86d0a5f5-3174-4466-b63d-46109b30714c tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:38:00.277764 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-86d0a5f5-3174-4466-b63d-46109b30714c tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/532ba404-fc1a-44d7-93dc-8e5d9f01c8e4" status: 200 len: 1266 microversion: 2.1 time: 0.409854 Oct 19 03:38:00.277764 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2598/5114] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:37:59 2022] GET /compute/v2.1/servers/532ba404-fc1a-44d7-93dc-8e5d9f01c8e4 => generated 1266 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:38:00.285969 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2517/5115] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:37:58 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1317 bytes in 1488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:38:01.300589 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3c606a73-4f1d-4a72-83a4-22cf1c2b1325 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:38:01.302044 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-3c606a73-4f1d-4a72-83a4-22cf1c2b1325 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:38:01.302356 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d455ca64-4ecb-43a1-85bc-8aa41138b60b tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:38:01.303130 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d455ca64-4ecb-43a1-85bc-8aa41138b60b tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 532ba404-fc1a-44d7-93dc-8e5d9f01c8e4] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:38:01.312691 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d455ca64-4ecb-43a1-85bc-8aa41138b60b tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:01.315226 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d455ca64-4ecb-43a1-85bc-8aa41138b60b tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:01.318287 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d455ca64-4ecb-43a1-85bc-8aa41138b60b tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:01.324327 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d455ca64-4ecb-43a1-85bc-8aa41138b60b tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:01.324327 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d455ca64-4ecb-43a1-85bc-8aa41138b60b tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:01.324548 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3c606a73-4f1d-4a72-83a4-22cf1c2b1325 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:01.324548 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3c606a73-4f1d-4a72-83a4-22cf1c2b1325 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:01.324548 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3c606a73-4f1d-4a72-83a4-22cf1c2b1325 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:01.325022 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d455ca64-4ecb-43a1-85bc-8aa41138b60b tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:01.329981 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3c606a73-4f1d-4a72-83a4-22cf1c2b1325 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:01.330466 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3c606a73-4f1d-4a72-83a4-22cf1c2b1325 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:01.330915 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3c606a73-4f1d-4a72-83a4-22cf1c2b1325 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:01.536507 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d455ca64-4ecb-43a1-85bc-8aa41138b60b tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:38:01.558741 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d455ca64-4ecb-43a1-85bc-8aa41138b60b tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/532ba404-fc1a-44d7-93dc-8e5d9f01c8e4" status: 200 len: 1284 microversion: 2.1 time: 0.254479 Oct 19 03:38:01.558741 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2518/5116] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:38:01 2022] GET /compute/v2.1/servers/532ba404-fc1a-44d7-93dc-8e5d9f01c8e4 => generated 1284 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:38:01.711616 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-6e4d1526-54ad-443f-b10f-fb09f8a8cd34 req-a52f539b-6c3f-47db-a0a1-a5038df727e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a830928-6d51-4dbd-97ad-8cca44de3770", "tag": "9779d73d-72bb-47da-820f-5576b587d824"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:38:01.744459 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-6e4d1526-54ad-443f-b10f-fb09f8a8cd34 req-a52f539b-6c3f-47db-a0a1-a5038df727e4 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:01.745478 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-6e4d1526-54ad-443f-b10f-fb09f8a8cd34 req-a52f539b-6c3f-47db-a0a1-a5038df727e4 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:01.746172 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-6e4d1526-54ad-443f-b10f-fb09f8a8cd34 req-a52f539b-6c3f-47db-a0a1-a5038df727e4 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:01.779840 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-6e4d1526-54ad-443f-b10f-fb09f8a8cd34 req-a52f539b-6c3f-47db-a0a1-a5038df727e4 service nova] Creating event network-changed:9779d73d-72bb-47da-820f-5576b587d824 for instance 5a830928-6d51-4dbd-97ad-8cca44de3770 on n-h2-861333-8 Oct 19 03:38:01.794304 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-6e4d1526-54ad-443f-b10f-fb09f8a8cd34 req-a52f539b-6c3f-47db-a0a1-a5038df727e4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.235195 Oct 19 03:38:01.794304 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2519/5117] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:38:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:38:02.202209 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-3c606a73-4f1d-4a72-83a4-22cf1c2b1325 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:38:02.214157 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-3c606a73-4f1d-4a72-83a4-22cf1c2b1325 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1317 microversion: 2.1 time: 0.923800 Oct 19 03:38:02.214774 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2599/5118] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:38:01 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1317 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:38:02.587100 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4695f6b8-f23c-476f-aeba-4267febd741c tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:38:02.587100 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4695f6b8-f23c-476f-aeba-4267febd741c tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 532ba404-fc1a-44d7-93dc-8e5d9f01c8e4] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:38:02.606052 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4695f6b8-f23c-476f-aeba-4267febd741c tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:02.606816 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4695f6b8-f23c-476f-aeba-4267febd741c tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:02.609109 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4695f6b8-f23c-476f-aeba-4267febd741c tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:02.620156 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4695f6b8-f23c-476f-aeba-4267febd741c tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:02.620156 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4695f6b8-f23c-476f-aeba-4267febd741c tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:02.625607 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4695f6b8-f23c-476f-aeba-4267febd741c tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:02.795090 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-4695f6b8-f23c-476f-aeba-4267febd741c tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:38:02.805525 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4695f6b8-f23c-476f-aeba-4267febd741c tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/532ba404-fc1a-44d7-93dc-8e5d9f01c8e4" status: 200 len: 1272 microversion: 2.1 time: 0.229007 Oct 19 03:38:02.808121 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2520/5119] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:38:02 2022] GET /compute/v2.1/servers/532ba404-fc1a-44d7-93dc-8e5d9f01c8e4 => generated 1272 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:38:03.245540 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-280997ab-5842-4ee3-98ee-7260e763aa91 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:38:03.247189 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-280997ab-5842-4ee3-98ee-7260e763aa91 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:38:03.291173 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-280997ab-5842-4ee3-98ee-7260e763aa91 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:03.293049 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-280997ab-5842-4ee3-98ee-7260e763aa91 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:03.293787 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-280997ab-5842-4ee3-98ee-7260e763aa91 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:03.297670 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-280997ab-5842-4ee3-98ee-7260e763aa91 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:03.302434 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-280997ab-5842-4ee3-98ee-7260e763aa91 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:03.303369 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-280997ab-5842-4ee3-98ee-7260e763aa91 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:03.533108 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-280997ab-5842-4ee3-98ee-7260e763aa91 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:38:03.542082 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-280997ab-5842-4ee3-98ee-7260e763aa91 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1317 microversion: 2.1 time: 0.307853 Oct 19 03:38:03.543327 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2600/5120] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:38:03 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1317 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:38:03.829742 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e5d36f1b-3e21-432c-9844-d41e39ffd8db tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:38:03.831537 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e5d36f1b-3e21-432c-9844-d41e39ffd8db tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 532ba404-fc1a-44d7-93dc-8e5d9f01c8e4] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:38:03.842223 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e5d36f1b-3e21-432c-9844-d41e39ffd8db tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:03.842846 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e5d36f1b-3e21-432c-9844-d41e39ffd8db tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:03.843632 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e5d36f1b-3e21-432c-9844-d41e39ffd8db tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:03.844542 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e5d36f1b-3e21-432c-9844-d41e39ffd8db tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:03.845107 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e5d36f1b-3e21-432c-9844-d41e39ffd8db tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:03.845755 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e5d36f1b-3e21-432c-9844-d41e39ffd8db tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:04.238822 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e5d36f1b-3e21-432c-9844-d41e39ffd8db tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:38:04.255641 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e5d36f1b-3e21-432c-9844-d41e39ffd8db tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/532ba404-fc1a-44d7-93dc-8e5d9f01c8e4" status: 200 len: 1314 microversion: 2.1 time: 0.428622 Oct 19 03:38:04.256679 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2521/5121] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:38:03 2022] GET /compute/v2.1/servers/532ba404-fc1a-44d7-93dc-8e5d9f01c8e4 => generated 1314 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:38:04.570466 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-efbd9401-0872-404f-93f4-aaee43a2aa44 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:38:04.572188 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-efbd9401-0872-404f-93f4-aaee43a2aa44 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:38:04.588567 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-efbd9401-0872-404f-93f4-aaee43a2aa44 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:04.596859 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-efbd9401-0872-404f-93f4-aaee43a2aa44 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:04.597738 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-efbd9401-0872-404f-93f4-aaee43a2aa44 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:04.599363 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-efbd9401-0872-404f-93f4-aaee43a2aa44 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:04.603288 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-efbd9401-0872-404f-93f4-aaee43a2aa44 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:04.604340 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-efbd9401-0872-404f-93f4-aaee43a2aa44 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:05.289552 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d463a97e-3de2-485f-ad7e-cc058767cb4c tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:38:05.289552 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d463a97e-3de2-485f-ad7e-cc058767cb4c tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 532ba404-fc1a-44d7-93dc-8e5d9f01c8e4] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:38:05.305326 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d463a97e-3de2-485f-ad7e-cc058767cb4c tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:05.306199 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d463a97e-3de2-485f-ad7e-cc058767cb4c tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:05.306855 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d463a97e-3de2-485f-ad7e-cc058767cb4c tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:05.315322 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d463a97e-3de2-485f-ad7e-cc058767cb4c tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:05.317184 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d463a97e-3de2-485f-ad7e-cc058767cb4c tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:05.317699 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d463a97e-3de2-485f-ad7e-cc058767cb4c tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:05.849139 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:38:05.922135 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=8 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:38:06.019337 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-efbd9401-0872-404f-93f4-aaee43a2aa44 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:38:06.030808 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-efbd9401-0872-404f-93f4-aaee43a2aa44 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1317 microversion: 2.1 time: 1.467637 Oct 19 03:38:06.064469 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2601/5122] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:38:04 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1317 bytes in 1477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:38:06.108101 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d463a97e-3de2-485f-ad7e-cc058767cb4c tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:38:06.129854 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d463a97e-3de2-485f-ad7e-cc058767cb4c tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/532ba404-fc1a-44d7-93dc-8e5d9f01c8e4" status: 200 len: 1314 microversion: 2.1 time: 0.848364 Oct 19 03:38:06.139800 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2522/5123] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:38:05 2022] GET /compute/v2.1/servers/532ba404-fc1a-44d7-93dc-8e5d9f01c8e4 => generated 1314 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:38:06.799518 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-c9480d1d-cd70-4c38-badc-b468113b4c6c req-db2a04d5-111b-4c73-a6f3-1047bfc8a3af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "532ba404-fc1a-44d7-93dc-8e5d9f01c8e4", "tag": "a7f369ed-03c4-4362-9021-9b8637095ea2"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:38:06.810724 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-c9480d1d-cd70-4c38-badc-b468113b4c6c req-db2a04d5-111b-4c73-a6f3-1047bfc8a3af service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:06.811097 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-c9480d1d-cd70-4c38-badc-b468113b4c6c req-db2a04d5-111b-4c73-a6f3-1047bfc8a3af service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:06.811730 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-c9480d1d-cd70-4c38-badc-b468113b4c6c req-db2a04d5-111b-4c73-a6f3-1047bfc8a3af service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:06.827350 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-c9480d1d-cd70-4c38-badc-b468113b4c6c req-db2a04d5-111b-4c73-a6f3-1047bfc8a3af service nova] Creating event network-changed:a7f369ed-03c4-4362-9021-9b8637095ea2 for instance 532ba404-fc1a-44d7-93dc-8e5d9f01c8e4 on n-h1-861333-8 Oct 19 03:38:06.858886 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-c9480d1d-cd70-4c38-badc-b468113b4c6c req-db2a04d5-111b-4c73-a6f3-1047bfc8a3af service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051034 Oct 19 03:38:06.859667 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2602/5124] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:38:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:38:07.066006 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2b20f132-fcd7-4b55-ad4d-85cd69d08c06 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:38:07.066629 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2b20f132-fcd7-4b55-ad4d-85cd69d08c06 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:38:07.074509 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2b20f132-fcd7-4b55-ad4d-85cd69d08c06 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:07.075244 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2b20f132-fcd7-4b55-ad4d-85cd69d08c06 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:07.075890 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2b20f132-fcd7-4b55-ad4d-85cd69d08c06 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:07.076768 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2b20f132-fcd7-4b55-ad4d-85cd69d08c06 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:07.077397 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2b20f132-fcd7-4b55-ad4d-85cd69d08c06 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:07.078002 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2b20f132-fcd7-4b55-ad4d-85cd69d08c06 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:07.163618 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-958a061d-1665-442c-9644-a6204c5a084a tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:38:07.177634 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-958a061d-1665-442c-9644-a6204c5a084a tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 532ba404-fc1a-44d7-93dc-8e5d9f01c8e4] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:38:07.182105 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-958a061d-1665-442c-9644-a6204c5a084a tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:07.185423 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-958a061d-1665-442c-9644-a6204c5a084a tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:07.188159 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-958a061d-1665-442c-9644-a6204c5a084a tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:07.188922 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-958a061d-1665-442c-9644-a6204c5a084a tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:07.189545 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-958a061d-1665-442c-9644-a6204c5a084a tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:07.189873 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-958a061d-1665-442c-9644-a6204c5a084a tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:07.518807 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=12 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:38:07.609749 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-2b20f132-fcd7-4b55-ad4d-85cd69d08c06 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:38:07.620944 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2b20f132-fcd7-4b55-ad4d-85cd69d08c06 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1317 microversion: 2.1 time: 0.558176 Oct 19 03:38:07.622333 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2523/5125] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:38:07 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1317 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:38:07.654118 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-958a061d-1665-442c-9644-a6204c5a084a tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:38:07.665774 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-958a061d-1665-442c-9644-a6204c5a084a tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/532ba404-fc1a-44d7-93dc-8e5d9f01c8e4" status: 200 len: 1314 microversion: 2.1 time: 0.507571 Oct 19 03:38:07.667230 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2603/5126] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:38:07 2022] GET /compute/v2.1/servers/532ba404-fc1a-44d7-93dc-8e5d9f01c8e4 => generated 1314 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:38:08.654685 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8107507d-f4cb-4317-b685-c8bef46b0ffc tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:38:08.655438 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8107507d-f4cb-4317-b685-c8bef46b0ffc tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:38:08.685361 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8107507d-f4cb-4317-b685-c8bef46b0ffc tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:08.693329 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c841f072-4624-4281-9dea-0e72a54ff044 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:38:08.693995 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c841f072-4624-4281-9dea-0e72a54ff044 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 532ba404-fc1a-44d7-93dc-8e5d9f01c8e4] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:38:08.701775 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8107507d-f4cb-4317-b685-c8bef46b0ffc tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:08.701775 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8107507d-f4cb-4317-b685-c8bef46b0ffc tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:08.701775 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8107507d-f4cb-4317-b685-c8bef46b0ffc tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:08.706856 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8107507d-f4cb-4317-b685-c8bef46b0ffc tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:08.709506 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8107507d-f4cb-4317-b685-c8bef46b0ffc tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:08.713405 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c841f072-4624-4281-9dea-0e72a54ff044 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:08.713959 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c841f072-4624-4281-9dea-0e72a54ff044 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:08.714411 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c841f072-4624-4281-9dea-0e72a54ff044 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:08.715246 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c841f072-4624-4281-9dea-0e72a54ff044 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:08.715702 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c841f072-4624-4281-9dea-0e72a54ff044 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:08.719774 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c841f072-4624-4281-9dea-0e72a54ff044 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:09.146089 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8107507d-f4cb-4317-b685-c8bef46b0ffc tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:38:09.156826 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8107507d-f4cb-4317-b685-c8bef46b0ffc tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1317 microversion: 2.1 time: 0.506632 Oct 19 03:38:09.174029 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2524/5127] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:38:08 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1317 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:38:09.185714 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-31e8ef56-810e-448e-bc70-032a0bb37941 req-fe172a34-56ce-4557-b115-b446e35eac8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a830928-6d51-4dbd-97ad-8cca44de3770", "name": "network-vif-plugged", "status": "completed", "tag": "9779d73d-72bb-47da-820f-5576b587d824"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:38:09.208394 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c841f072-4624-4281-9dea-0e72a54ff044 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:38:09.214918 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-31e8ef56-810e-448e-bc70-032a0bb37941 req-fe172a34-56ce-4557-b115-b446e35eac8b service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:09.215741 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-31e8ef56-810e-448e-bc70-032a0bb37941 req-fe172a34-56ce-4557-b115-b446e35eac8b service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:09.216380 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-31e8ef56-810e-448e-bc70-032a0bb37941 req-fe172a34-56ce-4557-b115-b446e35eac8b service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:09.217244 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=86 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:38:09.221109 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c841f072-4624-4281-9dea-0e72a54ff044 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/532ba404-fc1a-44d7-93dc-8e5d9f01c8e4" status: 200 len: 1314 microversion: 2.1 time: 0.531760 Oct 19 03:38:09.222298 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2604/5128] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:38:08 2022] GET /compute/v2.1/servers/532ba404-fc1a-44d7-93dc-8e5d9f01c8e4 => generated 1314 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:38:09.241722 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-31e8ef56-810e-448e-bc70-032a0bb37941 req-fe172a34-56ce-4557-b115-b446e35eac8b service nova] Creating event network-vif-plugged:9779d73d-72bb-47da-820f-5576b587d824 for instance 5a830928-6d51-4dbd-97ad-8cca44de3770 on n-h2-861333-8 Oct 19 03:38:09.251202 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-31e8ef56-810e-448e-bc70-032a0bb37941 req-fe172a34-56ce-4557-b115-b446e35eac8b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077453 Oct 19 03:38:09.252307 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2525/5129] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:38:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:38:10.187857 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c24468a1-95a0-430c-9a3a-77488d8487bf tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:38:10.188634 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c24468a1-95a0-430c-9a3a-77488d8487bf tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:38:10.203069 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c24468a1-95a0-430c-9a3a-77488d8487bf tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:10.203576 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c24468a1-95a0-430c-9a3a-77488d8487bf tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:10.204020 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c24468a1-95a0-430c-9a3a-77488d8487bf tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:10.204739 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c24468a1-95a0-430c-9a3a-77488d8487bf tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:10.205195 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c24468a1-95a0-430c-9a3a-77488d8487bf tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:10.205655 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c24468a1-95a0-430c-9a3a-77488d8487bf tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:10.249482 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-82290abd-55bf-4cdc-96ef-66a79b206d1f tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:38:10.250748 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-82290abd-55bf-4cdc-96ef-66a79b206d1f tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 532ba404-fc1a-44d7-93dc-8e5d9f01c8e4] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:38:10.271127 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-82290abd-55bf-4cdc-96ef-66a79b206d1f tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:10.274734 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-82290abd-55bf-4cdc-96ef-66a79b206d1f tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:10.274734 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-82290abd-55bf-4cdc-96ef-66a79b206d1f tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:10.275747 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-82290abd-55bf-4cdc-96ef-66a79b206d1f tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:10.277850 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-82290abd-55bf-4cdc-96ef-66a79b206d1f tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:10.278726 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-82290abd-55bf-4cdc-96ef-66a79b206d1f tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:10.749356 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-82290abd-55bf-4cdc-96ef-66a79b206d1f tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:38:10.761845 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-82290abd-55bf-4cdc-96ef-66a79b206d1f tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/532ba404-fc1a-44d7-93dc-8e5d9f01c8e4" status: 200 len: 1314 microversion: 2.1 time: 0.519784 Oct 19 03:38:10.781823 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2526/5130] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:38:10 2022] GET /compute/v2.1/servers/532ba404-fc1a-44d7-93dc-8e5d9f01c8e4 => generated 1314 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:38:10.792960 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c24468a1-95a0-430c-9a3a-77488d8487bf tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:38:10.810412 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c24468a1-95a0-430c-9a3a-77488d8487bf tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1317 microversion: 2.1 time: 0.627894 Oct 19 03:38:10.815569 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2605/5131] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:38:10 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1317 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:38:11.792810 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a84124a6-b083-49bb-ab96-b6ba992def07 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:38:11.793823 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a84124a6-b083-49bb-ab96-b6ba992def07 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 532ba404-fc1a-44d7-93dc-8e5d9f01c8e4] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:38:11.805674 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a84124a6-b083-49bb-ab96-b6ba992def07 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:11.807497 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a84124a6-b083-49bb-ab96-b6ba992def07 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:11.808054 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a84124a6-b083-49bb-ab96-b6ba992def07 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:11.810377 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a84124a6-b083-49bb-ab96-b6ba992def07 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:11.816821 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a84124a6-b083-49bb-ab96-b6ba992def07 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:11.819334 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a84124a6-b083-49bb-ab96-b6ba992def07 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:11.840610 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-02cf6c92-257b-4a17-b6a8-36e1846b2244 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:38:11.842194 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-02cf6c92-257b-4a17-b6a8-36e1846b2244 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:38:11.859881 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-02cf6c92-257b-4a17-b6a8-36e1846b2244 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:11.861651 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-02cf6c92-257b-4a17-b6a8-36e1846b2244 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:11.863752 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-02cf6c92-257b-4a17-b6a8-36e1846b2244 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:11.866356 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-02cf6c92-257b-4a17-b6a8-36e1846b2244 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:11.869971 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-02cf6c92-257b-4a17-b6a8-36e1846b2244 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:11.873298 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-02cf6c92-257b-4a17-b6a8-36e1846b2244 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:12.328320 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-02cf6c92-257b-4a17-b6a8-36e1846b2244 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:38:12.348231 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-02cf6c92-257b-4a17-b6a8-36e1846b2244 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1506 microversion: 2.1 time: 0.511804 Oct 19 03:38:12.356704 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2606/5132] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:38:11 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1506 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:38:12.371706 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a84124a6-b083-49bb-ab96-b6ba992def07 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:38:12.413097 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a84124a6-b083-49bb-ab96-b6ba992def07 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/532ba404-fc1a-44d7-93dc-8e5d9f01c8e4" status: 200 len: 1314 microversion: 2.1 time: 0.628625 Oct 19 03:38:12.435055 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2527/5133] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:38:11 2022] GET /compute/v2.1/servers/532ba404-fc1a-44d7-93dc-8e5d9f01c8e4 => generated 1314 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:38:12.540097 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0efe7cd6-cf8d-4f5d-a789-e2ae3416b347 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-491137913", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "networks": [{"uuid": "3ecd8896-b7a4-4c3a-b3cd-dc6769233813"}]}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:38:12.650621 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.network.neutron [None req-0efe7cd6-cf8d-4f5d-a789-e2ae3416b347 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] validate_networks() for [('3ecd8896-b7a4-4c3a-b3cd-dc6769233813', None, None, None, None, None)] {{(pid=121135) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:38:13.235135 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-0efe7cd6-cf8d-4f5d-a789-e2ae3416b347 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Flavor limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:38:13.235749 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-0efe7cd6-cf8d-4f5d-a789-e2ae3416b347 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Image limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:38:13.236182 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-0efe7cd6-cf8d-4f5d-a789-e2ae3416b347 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Flavor pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:38:13.236794 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-0efe7cd6-cf8d-4f5d-a789-e2ae3416b347 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Image pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:38:13.237429 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-0efe7cd6-cf8d-4f5d-a789-e2ae3416b347 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:38:13.248921 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0efe7cd6-cf8d-4f5d-a789-e2ae3416b347 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:13.249653 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0efe7cd6-cf8d-4f5d-a789-e2ae3416b347 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:13.249923 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0efe7cd6-cf8d-4f5d-a789-e2ae3416b347 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:13.250859 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0efe7cd6-cf8d-4f5d-a789-e2ae3416b347 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:13.251492 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0efe7cd6-cf8d-4f5d-a789-e2ae3416b347 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:13.252309 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0efe7cd6-cf8d-4f5d-a789-e2ae3416b347 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:13.283564 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-0efe7cd6-cf8d-4f5d-a789-e2ae3416b347 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Getting quotas for project 34bd94983fbf4a8aa49aff65c076e9e3. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:38:13.290491 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-0efe7cd6-cf8d-4f5d-a789-e2ae3416b347 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Getting quotas for user 771feb133bc046588552d3af98f8e0a1 and project 34bd94983fbf4a8aa49aff65c076e9e3. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:38:13.311179 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0efe7cd6-cf8d-4f5d-a789-e2ae3416b347 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Going to run 1 instances... {{(pid=121135) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:38:13.314271 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0efe7cd6-cf8d-4f5d-a789-e2ae3416b347 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 6d1dc6d7-9e63-46a2-9bd6-97073fc26565] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121135) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:38:13.449045 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0efe7cd6-cf8d-4f5d-a789-e2ae3416b347 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.908681 Oct 19 03:38:13.452548 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7ae5ce6f-d13b-4037-9088-4bb6e98e7b7e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:38:13.453387 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7ae5ce6f-d13b-4037-9088-4bb6e98e7b7e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 532ba404-fc1a-44d7-93dc-8e5d9f01c8e4] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:38:13.456406 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2607/5134] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:38:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 922 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 03:38:13.467062 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6830793a-5c4a-4312-9e1a-aa6d3c48984b tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:38:13.467381 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6830793a-5c4a-4312-9e1a-aa6d3c48984b tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 6d1dc6d7-9e63-46a2-9bd6-97073fc26565] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:38:13.473410 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7ae5ce6f-d13b-4037-9088-4bb6e98e7b7e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:13.479845 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7ae5ce6f-d13b-4037-9088-4bb6e98e7b7e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:13.481603 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7ae5ce6f-d13b-4037-9088-4bb6e98e7b7e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:13.486222 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7ae5ce6f-d13b-4037-9088-4bb6e98e7b7e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:13.487879 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7ae5ce6f-d13b-4037-9088-4bb6e98e7b7e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:13.488408 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7ae5ce6f-d13b-4037-9088-4bb6e98e7b7e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:13.597957 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-6830793a-5c4a-4312-9e1a-aa6d3c48984b tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:38:13.605325 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6830793a-5c4a-4312-9e1a-aa6d3c48984b tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/6d1dc6d7-9e63-46a2-9bd6-97073fc26565" status: 200 len: 1216 microversion: 2.1 time: 0.147738 Oct 19 03:38:13.605946 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2608/5135] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:38:13 2022] GET /compute/v2.1/servers/6d1dc6d7-9e63-46a2-9bd6-97073fc26565 => generated 1216 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:38:13.785793 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-7ae5ce6f-d13b-4037-9088-4bb6e98e7b7e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:38:13.785793 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:38:13.798334 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7ae5ce6f-d13b-4037-9088-4bb6e98e7b7e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/532ba404-fc1a-44d7-93dc-8e5d9f01c8e4" status: 200 len: 1314 microversion: 2.1 time: 0.358017 Oct 19 03:38:13.814003 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2528/5136] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:38:13 2022] GET /compute/v2.1/servers/532ba404-fc1a-44d7-93dc-8e5d9f01c8e4 => generated 1314 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:38:14.632700 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b22be9bd-a828-47c1-9970-64d53f71059d tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:38:14.633638 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b22be9bd-a828-47c1-9970-64d53f71059d tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 6d1dc6d7-9e63-46a2-9bd6-97073fc26565] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:38:14.790684 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b22be9bd-a828-47c1-9970-64d53f71059d tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:38:14.798821 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b22be9bd-a828-47c1-9970-64d53f71059d tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/6d1dc6d7-9e63-46a2-9bd6-97073fc26565" status: 200 len: 1216 microversion: 2.1 time: 0.170439 Oct 19 03:38:14.799438 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2609/5137] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:38:14 2022] GET /compute/v2.1/servers/6d1dc6d7-9e63-46a2-9bd6-97073fc26565 => generated 1216 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:38:14.831294 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-82515c98-e7a9-4666-bf3b-387ede206de3 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:38:14.832360 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-82515c98-e7a9-4666-bf3b-387ede206de3 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 532ba404-fc1a-44d7-93dc-8e5d9f01c8e4] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:38:14.861986 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-82515c98-e7a9-4666-bf3b-387ede206de3 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:14.862807 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-82515c98-e7a9-4666-bf3b-387ede206de3 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:14.863447 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-82515c98-e7a9-4666-bf3b-387ede206de3 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:14.864360 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-82515c98-e7a9-4666-bf3b-387ede206de3 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:14.865215 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-82515c98-e7a9-4666-bf3b-387ede206de3 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:14.866686 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-82515c98-e7a9-4666-bf3b-387ede206de3 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:15.467190 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-82515c98-e7a9-4666-bf3b-387ede206de3 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:38:15.480030 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-82515c98-e7a9-4666-bf3b-387ede206de3 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/532ba404-fc1a-44d7-93dc-8e5d9f01c8e4" status: 200 len: 1314 microversion: 2.1 time: 0.658919 Oct 19 03:38:15.490872 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2529/5138] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:38:14 2022] GET /compute/v2.1/servers/532ba404-fc1a-44d7-93dc-8e5d9f01c8e4 => generated 1314 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:38:15.828921 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b4f3c656-dbfd-4ef2-b73a-e89d7721f9b5 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:38:15.831414 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b4f3c656-dbfd-4ef2-b73a-e89d7721f9b5 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 6d1dc6d7-9e63-46a2-9bd6-97073fc26565] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:38:15.856071 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b4f3c656-dbfd-4ef2-b73a-e89d7721f9b5 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:15.857126 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b4f3c656-dbfd-4ef2-b73a-e89d7721f9b5 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:15.857763 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b4f3c656-dbfd-4ef2-b73a-e89d7721f9b5 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:15.864430 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b4f3c656-dbfd-4ef2-b73a-e89d7721f9b5 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:15.866038 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b4f3c656-dbfd-4ef2-b73a-e89d7721f9b5 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:15.866657 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b4f3c656-dbfd-4ef2-b73a-e89d7721f9b5 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:16.136764 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b4f3c656-dbfd-4ef2-b73a-e89d7721f9b5 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:38:16.153609 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b4f3c656-dbfd-4ef2-b73a-e89d7721f9b5 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/6d1dc6d7-9e63-46a2-9bd6-97073fc26565" status: 200 len: 1268 microversion: 2.1 time: 0.328119 Oct 19 03:38:16.154867 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2610/5139] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:38:15 2022] GET /compute/v2.1/servers/6d1dc6d7-9e63-46a2-9bd6-97073fc26565 => generated 1268 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:38:16.288617 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-f353faec-9eab-4530-9f3d-6e623d23ed6f req-da7f6507-7f06-457b-abe8-23cab206d07c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "532ba404-fc1a-44d7-93dc-8e5d9f01c8e4", "name": "network-vif-plugged", "status": "completed", "tag": "a7f369ed-03c4-4362-9021-9b8637095ea2"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:38:16.311109 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-f353faec-9eab-4530-9f3d-6e623d23ed6f req-da7f6507-7f06-457b-abe8-23cab206d07c service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:16.311873 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-f353faec-9eab-4530-9f3d-6e623d23ed6f req-da7f6507-7f06-457b-abe8-23cab206d07c service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:16.312500 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-f353faec-9eab-4530-9f3d-6e623d23ed6f req-da7f6507-7f06-457b-abe8-23cab206d07c service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:16.332613 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-f353faec-9eab-4530-9f3d-6e623d23ed6f req-da7f6507-7f06-457b-abe8-23cab206d07c service nova] Creating event network-vif-plugged:a7f369ed-03c4-4362-9021-9b8637095ea2 for instance 532ba404-fc1a-44d7-93dc-8e5d9f01c8e4 on n-h1-861333-8 Oct 19 03:38:16.338750 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-f353faec-9eab-4530-9f3d-6e623d23ed6f req-da7f6507-7f06-457b-abe8-23cab206d07c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054636 Oct 19 03:38:16.339974 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2530/5140] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:38:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:38:16.522632 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ba714472-070d-4099-b290-e568c5cb4a23 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:38:16.523313 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ba714472-070d-4099-b290-e568c5cb4a23 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 532ba404-fc1a-44d7-93dc-8e5d9f01c8e4] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:38:16.537919 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ba714472-070d-4099-b290-e568c5cb4a23 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:16.538477 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ba714472-070d-4099-b290-e568c5cb4a23 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:16.538928 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ba714472-070d-4099-b290-e568c5cb4a23 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:16.542179 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ba714472-070d-4099-b290-e568c5cb4a23 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:16.542699 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ba714472-070d-4099-b290-e568c5cb4a23 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:16.544038 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ba714472-070d-4099-b290-e568c5cb4a23 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:17.183466 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-63a8db49-78fe-418d-8d5b-5269fa2b09a3 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:38:17.184489 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-63a8db49-78fe-418d-8d5b-5269fa2b09a3 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 6d1dc6d7-9e63-46a2-9bd6-97073fc26565] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:38:17.201851 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-63a8db49-78fe-418d-8d5b-5269fa2b09a3 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:17.209075 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-63a8db49-78fe-418d-8d5b-5269fa2b09a3 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:17.211761 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-63a8db49-78fe-418d-8d5b-5269fa2b09a3 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:17.212903 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-63a8db49-78fe-418d-8d5b-5269fa2b09a3 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:17.213572 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-63a8db49-78fe-418d-8d5b-5269fa2b09a3 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:17.214132 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-63a8db49-78fe-418d-8d5b-5269fa2b09a3 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:17.539736 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-63a8db49-78fe-418d-8d5b-5269fa2b09a3 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:38:17.549434 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-63a8db49-78fe-418d-8d5b-5269fa2b09a3 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/6d1dc6d7-9e63-46a2-9bd6-97073fc26565" status: 200 len: 1286 microversion: 2.1 time: 0.370338 Oct 19 03:38:17.553321 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2531/5141] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:38:17 2022] GET /compute/v2.1/servers/6d1dc6d7-9e63-46a2-9bd6-97073fc26565 => generated 1286 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:38:17.575050 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ba714472-070d-4099-b290-e568c5cb4a23 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:38:17.597226 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ba714472-070d-4099-b290-e568c5cb4a23 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/532ba404-fc1a-44d7-93dc-8e5d9f01c8e4" status: 200 len: 1314 microversion: 2.1 time: 1.078949 Oct 19 03:38:17.607750 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2611/5142] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:38:16 2022] GET /compute/v2.1/servers/532ba404-fc1a-44d7-93dc-8e5d9f01c8e4 => generated 1314 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:38:18.582769 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1d52690a-2eef-4b0a-8d89-a0233d16ce9d tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:38:18.584363 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1d52690a-2eef-4b0a-8d89-a0233d16ce9d tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 6d1dc6d7-9e63-46a2-9bd6-97073fc26565] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:38:18.611918 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1d52690a-2eef-4b0a-8d89-a0233d16ce9d tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:18.612426 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1d52690a-2eef-4b0a-8d89-a0233d16ce9d tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:18.612886 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1d52690a-2eef-4b0a-8d89-a0233d16ce9d tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:18.617769 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1d52690a-2eef-4b0a-8d89-a0233d16ce9d tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:18.618947 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1d52690a-2eef-4b0a-8d89-a0233d16ce9d tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:18.619669 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1d52690a-2eef-4b0a-8d89-a0233d16ce9d tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:18.634694 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3646ff06-868b-472a-9043-a8f5c91e7396 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:38:18.635324 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-3646ff06-868b-472a-9043-a8f5c91e7396 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 532ba404-fc1a-44d7-93dc-8e5d9f01c8e4] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:38:18.653061 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3646ff06-868b-472a-9043-a8f5c91e7396 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:18.657524 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3646ff06-868b-472a-9043-a8f5c91e7396 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:18.658974 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3646ff06-868b-472a-9043-a8f5c91e7396 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:18.659996 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3646ff06-868b-472a-9043-a8f5c91e7396 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:18.663876 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3646ff06-868b-472a-9043-a8f5c91e7396 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:18.664977 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3646ff06-868b-472a-9043-a8f5c91e7396 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:19.471987 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-1d52690a-2eef-4b0a-8d89-a0233d16ce9d tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:38:19.482097 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1d52690a-2eef-4b0a-8d89-a0233d16ce9d tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/6d1dc6d7-9e63-46a2-9bd6-97073fc26565" status: 200 len: 1274 microversion: 2.1 time: 0.904546 Oct 19 03:38:19.482917 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2532/5143] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:38:18 2022] GET /compute/v2.1/servers/6d1dc6d7-9e63-46a2-9bd6-97073fc26565 => generated 1274 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:38:19.694357 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a7dd6aa1-28e3-47b2-9d47-a11829107428 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:38:19.700294 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a7dd6aa1-28e3-47b2-9d47-a11829107428 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] [instance: ddbf7afb-1d7b-4d33-b6fb-1f1608c11985] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:38:19.716037 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a7dd6aa1-28e3-47b2-9d47-a11829107428 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:19.716978 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a7dd6aa1-28e3-47b2-9d47-a11829107428 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:19.717668 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a7dd6aa1-28e3-47b2-9d47-a11829107428 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:19.722924 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a7dd6aa1-28e3-47b2-9d47-a11829107428 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:19.722924 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a7dd6aa1-28e3-47b2-9d47-a11829107428 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:19.722924 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a7dd6aa1-28e3-47b2-9d47-a11829107428 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:19.813106 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a7dd6aa1-28e3-47b2-9d47-a11829107428 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] 10.222.0.52 "GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.131830 Oct 19 03:38:19.813811 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2533/5144] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Oct 19 03:38:19 2022] GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985/os-volume_attachments => generated 25 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 03:38:19.829956 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-3646ff06-868b-472a-9043-a8f5c91e7396 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:38:19.846359 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-3646ff06-868b-472a-9043-a8f5c91e7396 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/532ba404-fc1a-44d7-93dc-8e5d9f01c8e4" status: 200 len: 1314 microversion: 2.1 time: 1.213591 Oct 19 03:38:19.849838 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2612/5145] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:38:18 2022] GET /compute/v2.1/servers/532ba404-fc1a-44d7-93dc-8e5d9f01c8e4 => generated 1314 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:38:19.923191 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-613c9054-0675-4149-8444-ee7bc09dd965 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:38:19.923696 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-613c9054-0675-4149-8444-ee7bc09dd965 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] [instance: ddbf7afb-1d7b-4d33-b6fb-1f1608c11985] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:38:19.936983 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-613c9054-0675-4149-8444-ee7bc09dd965 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:19.937513 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-613c9054-0675-4149-8444-ee7bc09dd965 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:19.937961 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-613c9054-0675-4149-8444-ee7bc09dd965 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:19.938681 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-613c9054-0675-4149-8444-ee7bc09dd965 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:19.946199 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-613c9054-0675-4149-8444-ee7bc09dd965 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:19.946601 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-613c9054-0675-4149-8444-ee7bc09dd965 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:20.073048 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-613c9054-0675-4149-8444-ee7bc09dd965 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] [instance: ddbf7afb-1d7b-4d33-b6fb-1f1608c11985] Going to try to terminate instance {{(pid=121134) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:38:20.480835 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-613c9054-0675-4149-8444-ee7bc09dd965 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985" status: 204 len: 0 microversion: 2.1 time: 0.557953 Oct 19 03:38:20.484282 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2534/5146] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:38:19 2022] DELETE /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:38:20.492338 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7835f967-1412-4772-a8b8-7f18085c026f tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:38:20.492974 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7835f967-1412-4772-a8b8-7f18085c026f tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] [instance: ddbf7afb-1d7b-4d33-b6fb-1f1608c11985] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:38:20.509196 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7835f967-1412-4772-a8b8-7f18085c026f tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:20.509196 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7835f967-1412-4772-a8b8-7f18085c026f tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:20.509196 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7835f967-1412-4772-a8b8-7f18085c026f tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:20.509196 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7835f967-1412-4772-a8b8-7f18085c026f tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:20.509196 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7835f967-1412-4772-a8b8-7f18085c026f tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:20.509685 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7835f967-1412-4772-a8b8-7f18085c026f tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:20.519142 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-089af3ed-f90c-43eb-a8a6-04713a499584 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:38:20.519865 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-089af3ed-f90c-43eb-a8a6-04713a499584 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 6d1dc6d7-9e63-46a2-9bd6-97073fc26565] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:38:20.542737 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-089af3ed-f90c-43eb-a8a6-04713a499584 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:20.543233 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-089af3ed-f90c-43eb-a8a6-04713a499584 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:20.544020 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-089af3ed-f90c-43eb-a8a6-04713a499584 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:20.544395 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-089af3ed-f90c-43eb-a8a6-04713a499584 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:20.544855 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-089af3ed-f90c-43eb-a8a6-04713a499584 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:20.545650 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-089af3ed-f90c-43eb-a8a6-04713a499584 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:21.094830 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-089af3ed-f90c-43eb-a8a6-04713a499584 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:38:21.096159 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7835f967-1412-4772-a8b8-7f18085c026f tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c65a497e16e4e41b5cf1287042f3a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4001edd1474947a94243a620a6013a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:38:21.103497 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-089af3ed-f90c-43eb-a8a6-04713a499584 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/6d1dc6d7-9e63-46a2-9bd6-97073fc26565" status: 200 len: 1316 microversion: 2.1 time: 0.592261 Oct 19 03:38:21.107317 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7835f967-1412-4772-a8b8-7f18085c026f tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] 10.222.0.52 "GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985" status: 200 len: 1672 microversion: 2.1 time: 0.618648 Oct 19 03:38:21.107903 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2535/5147] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:38:20 2022] GET /compute/v2.1/servers/6d1dc6d7-9e63-46a2-9bd6-97073fc26565 => generated 1316 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:38:21.108990 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2613/5148] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:38:20 2022] GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985 => generated 1672 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:38:21.114911 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5682c73e-e01c-46b6-8848-fa8b26e0315e tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ecd82c24-c4d4-4e21-8b87-481a44c64ae1"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:38:21.118379 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-5682c73e-e01c-46b6-8848-fa8b26e0315e tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 4fab83b8-8862-4295-adb7-e2bf5462a2d9] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:38:21.125325 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5682c73e-e01c-46b6-8848-fa8b26e0315e tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:21.126406 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5682c73e-e01c-46b6-8848-fa8b26e0315e tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:21.127176 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5682c73e-e01c-46b6-8848-fa8b26e0315e tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:21.129208 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5682c73e-e01c-46b6-8848-fa8b26e0315e tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:21.130181 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5682c73e-e01c-46b6-8848-fa8b26e0315e tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:21.131034 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5682c73e-e01c-46b6-8848-fa8b26e0315e tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:21.139420 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f37fa273-ca76-4922-a7b4-2fb6b93c18b1 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:38:21.140141 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f37fa273-ca76-4922-a7b4-2fb6b93c18b1 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 532ba404-fc1a-44d7-93dc-8e5d9f01c8e4] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:38:21.151195 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f37fa273-ca76-4922-a7b4-2fb6b93c18b1 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:21.151712 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f37fa273-ca76-4922-a7b4-2fb6b93c18b1 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:21.156479 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f37fa273-ca76-4922-a7b4-2fb6b93c18b1 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:21.157567 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f37fa273-ca76-4922-a7b4-2fb6b93c18b1 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:21.158335 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f37fa273-ca76-4922-a7b4-2fb6b93c18b1 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:21.159064 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f37fa273-ca76-4922-a7b4-2fb6b93c18b1 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:21.635818 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-f37fa273-ca76-4922-a7b4-2fb6b93c18b1 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:38:21.649301 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f37fa273-ca76-4922-a7b4-2fb6b93c18b1 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/532ba404-fc1a-44d7-93dc-8e5d9f01c8e4" status: 200 len: 1501 microversion: 2.1 time: 0.540265 Oct 19 03:38:21.650010 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2536/5149] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:38:21 2022] GET /compute/v2.1/servers/532ba404-fc1a-44d7-93dc-8e5d9f01c8e4 => generated 1501 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:38:21.679503 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-daa75a71-b8fa-4cc0-b1ce-182e3be72760 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:38:21.680014 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-daa75a71-b8fa-4cc0-b1ce-182e3be72760 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 532ba404-fc1a-44d7-93dc-8e5d9f01c8e4] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:38:21.691328 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-daa75a71-b8fa-4cc0-b1ce-182e3be72760 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:21.692118 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-daa75a71-b8fa-4cc0-b1ce-182e3be72760 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:21.693295 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-daa75a71-b8fa-4cc0-b1ce-182e3be72760 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:21.696419 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-daa75a71-b8fa-4cc0-b1ce-182e3be72760 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:21.696419 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-daa75a71-b8fa-4cc0-b1ce-182e3be72760 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:21.696419 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-daa75a71-b8fa-4cc0-b1ce-182e3be72760 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:21.813793 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-daa75a71-b8fa-4cc0-b1ce-182e3be72760 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 532ba404-fc1a-44d7-93dc-8e5d9f01c8e4] Going to try to terminate instance {{(pid=121134) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:38:22.215442 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5682c73e-e01c-46b6-8848-fa8b26e0315e tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "POST /compute/v2.1/servers/4fab83b8-8862-4295-adb7-e2bf5462a2d9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.104119 Oct 19 03:38:22.224873 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2614/5150] 10.222.0.52 () {60 vars in 1323 bytes} [Wed Oct 19 03:38:21 2022] POST /compute/v2.1/servers/4fab83b8-8862-4295-adb7-e2bf5462a2d9/os-volume_attachments => generated 194 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:38:22.234892 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-daa75a71-b8fa-4cc0-b1ce-182e3be72760 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "DELETE /compute/v2.1/servers/532ba404-fc1a-44d7-93dc-8e5d9f01c8e4" status: 204 len: 0 microversion: 2.1 time: 0.559562 Oct 19 03:38:22.235972 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2537/5151] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:38:21 2022] DELETE /compute/v2.1/servers/532ba404-fc1a-44d7-93dc-8e5d9f01c8e4 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 19 03:38:22.243283 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-044be6b8-50de-4dce-8baa-df729028e2aa tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:38:22.244015 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-044be6b8-50de-4dce-8baa-df729028e2aa tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 6d1dc6d7-9e63-46a2-9bd6-97073fc26565] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:38:22.244384 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4035b3c3-c52c-422d-b8ad-10691bfc7ae9 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:38:22.245344 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4035b3c3-c52c-422d-b8ad-10691bfc7ae9 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] [instance: ddbf7afb-1d7b-4d33-b6fb-1f1608c11985] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:38:22.256623 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4035b3c3-c52c-422d-b8ad-10691bfc7ae9 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:22.258854 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4035b3c3-c52c-422d-b8ad-10691bfc7ae9 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:22.260219 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4035b3c3-c52c-422d-b8ad-10691bfc7ae9 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:22.260988 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-044be6b8-50de-4dce-8baa-df729028e2aa tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:22.261544 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-044be6b8-50de-4dce-8baa-df729028e2aa tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:22.263933 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-044be6b8-50de-4dce-8baa-df729028e2aa tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:22.264963 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4035b3c3-c52c-422d-b8ad-10691bfc7ae9 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:22.265591 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-044be6b8-50de-4dce-8baa-df729028e2aa tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:22.265874 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4035b3c3-c52c-422d-b8ad-10691bfc7ae9 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:22.266534 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4035b3c3-c52c-422d-b8ad-10691bfc7ae9 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:22.268025 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-044be6b8-50de-4dce-8baa-df729028e2aa tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:22.269909 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-044be6b8-50de-4dce-8baa-df729028e2aa tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:22.838547 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-044be6b8-50de-4dce-8baa-df729028e2aa tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:38:22.850028 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-044be6b8-50de-4dce-8baa-df729028e2aa tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/6d1dc6d7-9e63-46a2-9bd6-97073fc26565" status: 200 len: 1316 microversion: 2.1 time: 0.631465 Oct 19 03:38:22.850629 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2615/5152] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:38:22 2022] GET /compute/v2.1/servers/6d1dc6d7-9e63-46a2-9bd6-97073fc26565 => generated 1316 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:38:22.879394 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b97288fb-780f-4a70-aa9b-c6cef880131d tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:38:22.880020 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b97288fb-780f-4a70-aa9b-c6cef880131d tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 532ba404-fc1a-44d7-93dc-8e5d9f01c8e4] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:38:22.910760 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b97288fb-780f-4a70-aa9b-c6cef880131d tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:22.911269 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b97288fb-780f-4a70-aa9b-c6cef880131d tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:22.911740 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b97288fb-780f-4a70-aa9b-c6cef880131d tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:22.912454 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b97288fb-780f-4a70-aa9b-c6cef880131d tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:22.912911 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b97288fb-780f-4a70-aa9b-c6cef880131d tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:22.915240 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b97288fb-780f-4a70-aa9b-c6cef880131d tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:23.087375 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-4035b3c3-c52c-422d-b8ad-10691bfc7ae9 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c65a497e16e4e41b5cf1287042f3a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4001edd1474947a94243a620a6013a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:38:23.100881 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4035b3c3-c52c-422d-b8ad-10691bfc7ae9 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] 10.222.0.52 "GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985" status: 200 len: 1672 microversion: 2.1 time: 0.861650 Oct 19 03:38:23.109343 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2538/5153] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:38:22 2022] GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985 => generated 1672 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:38:23.115859 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-84b20fc8-9d7c-49ce-bc3b-6ba243d2a18d req-092799ce-d834-433d-b0d4-b1ac33cace9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d1dc6d7-9e63-46a2-9bd6-97073fc26565", "tag": "ec962ac9-9f7d-4901-b44f-8efeb7d700dc"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:38:23.129701 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-84b20fc8-9d7c-49ce-bc3b-6ba243d2a18d req-092799ce-d834-433d-b0d4-b1ac33cace9c service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:23.144500 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-84b20fc8-9d7c-49ce-bc3b-6ba243d2a18d req-092799ce-d834-433d-b0d4-b1ac33cace9c service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:23.145405 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-84b20fc8-9d7c-49ce-bc3b-6ba243d2a18d req-092799ce-d834-433d-b0d4-b1ac33cace9c service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:23.164276 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-84b20fc8-9d7c-49ce-bc3b-6ba243d2a18d req-092799ce-d834-433d-b0d4-b1ac33cace9c service nova] Creating event network-changed:ec962ac9-9f7d-4901-b44f-8efeb7d700dc for instance 6d1dc6d7-9e63-46a2-9bd6-97073fc26565 on n-h2-861333-8 Oct 19 03:38:23.170982 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-84b20fc8-9d7c-49ce-bc3b-6ba243d2a18d req-092799ce-d834-433d-b0d4-b1ac33cace9c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060008 Oct 19 03:38:23.173420 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2539/5154] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:38:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:38:23.264518 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:38:23.790837 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b97288fb-780f-4a70-aa9b-c6cef880131d tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:38:23.808128 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b97288fb-780f-4a70-aa9b-c6cef880131d tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/532ba404-fc1a-44d7-93dc-8e5d9f01c8e4" status: 200 len: 1507 microversion: 2.1 time: 0.948857 Oct 19 03:38:23.808513 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2616/5155] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:38:22 2022] GET /compute/v2.1/servers/532ba404-fc1a-44d7-93dc-8e5d9f01c8e4 => generated 1507 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:38:23.874327 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-283e6e29-1127-4933-93b7-7f19028d34da tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:38:23.876013 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-283e6e29-1127-4933-93b7-7f19028d34da tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 6d1dc6d7-9e63-46a2-9bd6-97073fc26565] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:38:23.903194 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-283e6e29-1127-4933-93b7-7f19028d34da tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:23.904063 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-283e6e29-1127-4933-93b7-7f19028d34da tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:23.905571 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-283e6e29-1127-4933-93b7-7f19028d34da tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:23.906549 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-283e6e29-1127-4933-93b7-7f19028d34da tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:23.907251 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-283e6e29-1127-4933-93b7-7f19028d34da tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:23.907912 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-283e6e29-1127-4933-93b7-7f19028d34da tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:24.136117 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-8006c907-0084-4212-80cc-2c30e1814b4a tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:38:24.136749 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-8006c907-0084-4212-80cc-2c30e1814b4a tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] [instance: ddbf7afb-1d7b-4d33-b6fb-1f1608c11985] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:38:24.149714 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=6 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:38:24.158038 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8006c907-0084-4212-80cc-2c30e1814b4a tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:24.158566 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8006c907-0084-4212-80cc-2c30e1814b4a tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:24.159670 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8006c907-0084-4212-80cc-2c30e1814b4a tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:24.160424 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8006c907-0084-4212-80cc-2c30e1814b4a tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:24.160893 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8006c907-0084-4212-80cc-2c30e1814b4a tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:24.161929 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8006c907-0084-4212-80cc-2c30e1814b4a tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:24.800312 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=10 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:38:24.865310 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-283e6e29-1127-4933-93b7-7f19028d34da tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:38:24.889906 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-283e6e29-1127-4933-93b7-7f19028d34da tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/6d1dc6d7-9e63-46a2-9bd6-97073fc26565" status: 200 len: 1316 microversion: 2.1 time: 1.014615 Oct 19 03:38:24.891614 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2540/5156] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:38:23 2022] GET /compute/v2.1/servers/6d1dc6d7-9e63-46a2-9bd6-97073fc26565 => generated 1316 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:38:24.902954 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-52c3b818-fa43-4b04-a230-6fcd82b5ee17 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:38:24.904554 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-52c3b818-fa43-4b04-a230-6fcd82b5ee17 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 532ba404-fc1a-44d7-93dc-8e5d9f01c8e4] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:38:24.932666 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-52c3b818-fa43-4b04-a230-6fcd82b5ee17 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:24.936275 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-52c3b818-fa43-4b04-a230-6fcd82b5ee17 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:24.938411 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-52c3b818-fa43-4b04-a230-6fcd82b5ee17 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:24.951087 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-52c3b818-fa43-4b04-a230-6fcd82b5ee17 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:24.951844 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-52c3b818-fa43-4b04-a230-6fcd82b5ee17 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:24.952571 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-52c3b818-fa43-4b04-a230-6fcd82b5ee17 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:25.076577 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-8006c907-0084-4212-80cc-2c30e1814b4a tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c65a497e16e4e41b5cf1287042f3a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4001edd1474947a94243a620a6013a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:38:25.090473 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-8006c907-0084-4212-80cc-2c30e1814b4a tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] 10.222.0.52 "GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985" status: 200 len: 1672 microversion: 2.1 time: 0.958965 Oct 19 03:38:25.091427 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2617/5157] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:38:24 2022] GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985 => generated 1672 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:38:25.408615 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-52c3b818-fa43-4b04-a230-6fcd82b5ee17 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:38:25.417930 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-52c3b818-fa43-4b04-a230-6fcd82b5ee17 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/532ba404-fc1a-44d7-93dc-8e5d9f01c8e4" status: 200 len: 1507 microversion: 2.1 time: 0.524822 Oct 19 03:38:25.421695 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2541/5158] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:38:24 2022] GET /compute/v2.1/servers/532ba404-fc1a-44d7-93dc-8e5d9f01c8e4 => generated 1507 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:38:25.919344 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-59bc114b-5975-4083-a4d5-185fb786eeb2 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:38:25.920094 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-59bc114b-5975-4083-a4d5-185fb786eeb2 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 6d1dc6d7-9e63-46a2-9bd6-97073fc26565] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:38:25.940739 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-59bc114b-5975-4083-a4d5-185fb786eeb2 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:25.946688 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-59bc114b-5975-4083-a4d5-185fb786eeb2 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:25.951654 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-59bc114b-5975-4083-a4d5-185fb786eeb2 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:25.954696 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-59bc114b-5975-4083-a4d5-185fb786eeb2 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:25.955464 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-59bc114b-5975-4083-a4d5-185fb786eeb2 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:25.957032 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-59bc114b-5975-4083-a4d5-185fb786eeb2 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:26.118961 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-fcc6f0ac-b9cc-4af1-8d3e-2c2d1f2ddc09 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:38:26.119646 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-fcc6f0ac-b9cc-4af1-8d3e-2c2d1f2ddc09 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] [instance: ddbf7afb-1d7b-4d33-b6fb-1f1608c11985] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:38:26.137038 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:38:26.138821 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fcc6f0ac-b9cc-4af1-8d3e-2c2d1f2ddc09 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:26.139324 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fcc6f0ac-b9cc-4af1-8d3e-2c2d1f2ddc09 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:26.139849 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fcc6f0ac-b9cc-4af1-8d3e-2c2d1f2ddc09 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:26.154225 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fcc6f0ac-b9cc-4af1-8d3e-2c2d1f2ddc09 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:26.156699 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fcc6f0ac-b9cc-4af1-8d3e-2c2d1f2ddc09 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:26.157808 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fcc6f0ac-b9cc-4af1-8d3e-2c2d1f2ddc09 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:26.559439 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-fcc6f0ac-b9cc-4af1-8d3e-2c2d1f2ddc09 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c65a497e16e4e41b5cf1287042f3a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4001edd1474947a94243a620a6013a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:38:26.585581 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-fcc6f0ac-b9cc-4af1-8d3e-2c2d1f2ddc09 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] 10.222.0.52 "GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985" status: 200 len: 1605 microversion: 2.1 time: 0.458256 Oct 19 03:38:26.585581 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2542/5159] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:38:26 2022] GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985 => generated 1605 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:38:26.596119 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ba51db5a-2d2e-49e3-b232-20dc88dc25a7 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:38:26.597738 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ba51db5a-2d2e-49e3-b232-20dc88dc25a7 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 532ba404-fc1a-44d7-93dc-8e5d9f01c8e4] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:38:26.621896 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ba51db5a-2d2e-49e3-b232-20dc88dc25a7 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:26.623502 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ba51db5a-2d2e-49e3-b232-20dc88dc25a7 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:26.630720 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ba51db5a-2d2e-49e3-b232-20dc88dc25a7 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:26.631705 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ba51db5a-2d2e-49e3-b232-20dc88dc25a7 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:26.633821 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ba51db5a-2d2e-49e3-b232-20dc88dc25a7 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:26.634442 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ba51db5a-2d2e-49e3-b232-20dc88dc25a7 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:26.673188 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:38:26.759286 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-59bc114b-5975-4083-a4d5-185fb786eeb2 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:38:26.772357 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-59bc114b-5975-4083-a4d5-185fb786eeb2 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/6d1dc6d7-9e63-46a2-9bd6-97073fc26565" status: 200 len: 1316 microversion: 2.1 time: 0.857482 Oct 19 03:38:26.772961 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2618/5160] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:38:25 2022] GET /compute/v2.1/servers/6d1dc6d7-9e63-46a2-9bd6-97073fc26565 => generated 1316 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:38:26.783289 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-58b403eb-062f-45c6-b94e-f26180ef1e1a req-8ef2f79b-d305-4aac-b760-f5c50d3b2e5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "532ba404-fc1a-44d7-93dc-8e5d9f01c8e4", "name": "network-vif-deleted", "tag": "a7f369ed-03c4-4362-9021-9b8637095ea2"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:38:26.817055 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-58b403eb-062f-45c6-b94e-f26180ef1e1a req-8ef2f79b-d305-4aac-b760-f5c50d3b2e5e service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:26.822683 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-58b403eb-062f-45c6-b94e-f26180ef1e1a req-8ef2f79b-d305-4aac-b760-f5c50d3b2e5e service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:26.832622 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-58b403eb-062f-45c6-b94e-f26180ef1e1a req-8ef2f79b-d305-4aac-b760-f5c50d3b2e5e service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:26.851875 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-58b403eb-062f-45c6-b94e-f26180ef1e1a req-8ef2f79b-d305-4aac-b760-f5c50d3b2e5e service nova] Creating event network-vif-deleted:a7f369ed-03c4-4362-9021-9b8637095ea2 for instance 532ba404-fc1a-44d7-93dc-8e5d9f01c8e4 on n-h1-861333-8 Oct 19 03:38:26.867373 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-58b403eb-062f-45c6-b94e-f26180ef1e1a req-8ef2f79b-d305-4aac-b760-f5c50d3b2e5e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092350 Oct 19 03:38:26.868498 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2619/5161] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:38:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:38:26.917539 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ba51db5a-2d2e-49e3-b232-20dc88dc25a7 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:38:26.928971 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ba51db5a-2d2e-49e3-b232-20dc88dc25a7 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/532ba404-fc1a-44d7-93dc-8e5d9f01c8e4" status: 200 len: 1465 microversion: 2.1 time: 0.351580 Oct 19 03:38:26.935191 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2543/5162] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:38:26 2022] GET /compute/v2.1/servers/532ba404-fc1a-44d7-93dc-8e5d9f01c8e4 => generated 1465 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:38:27.600591 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6daf291d-6f92-4b1c-b794-059479c4f3dd tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:38:27.601545 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6daf291d-6f92-4b1c-b794-059479c4f3dd tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] [instance: ddbf7afb-1d7b-4d33-b6fb-1f1608c11985] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:38:27.619190 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6daf291d-6f92-4b1c-b794-059479c4f3dd tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:27.619970 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6daf291d-6f92-4b1c-b794-059479c4f3dd tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:27.620663 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6daf291d-6f92-4b1c-b794-059479c4f3dd tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:27.622213 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6daf291d-6f92-4b1c-b794-059479c4f3dd tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:27.622907 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6daf291d-6f92-4b1c-b794-059479c4f3dd tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:27.623568 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6daf291d-6f92-4b1c-b794-059479c4f3dd tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:27.801470 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-57137fed-7b0f-486e-9ea1-9df51147e147 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:38:27.807321 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-57137fed-7b0f-486e-9ea1-9df51147e147 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 6d1dc6d7-9e63-46a2-9bd6-97073fc26565] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:38:27.834697 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-57137fed-7b0f-486e-9ea1-9df51147e147 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:27.836490 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-57137fed-7b0f-486e-9ea1-9df51147e147 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:27.837141 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-57137fed-7b0f-486e-9ea1-9df51147e147 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:27.839541 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-57137fed-7b0f-486e-9ea1-9df51147e147 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:27.843311 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-57137fed-7b0f-486e-9ea1-9df51147e147 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:27.843982 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-57137fed-7b0f-486e-9ea1-9df51147e147 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:27.921995 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-6daf291d-6f92-4b1c-b794-059479c4f3dd tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c65a497e16e4e41b5cf1287042f3a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4001edd1474947a94243a620a6013a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:38:27.937044 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6daf291d-6f92-4b1c-b794-059479c4f3dd tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] 10.222.0.52 "GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985" status: 200 len: 1605 microversion: 2.1 time: 0.340103 Oct 19 03:38:27.952946 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2620/5163] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:38:27 2022] GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985 => generated 1605 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:38:28.002536 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-87d3cd08-2366-4a3c-9f10-de339777540a tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:38:28.003671 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-87d3cd08-2366-4a3c-9f10-de339777540a tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 532ba404-fc1a-44d7-93dc-8e5d9f01c8e4] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:38:28.012949 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-87d3cd08-2366-4a3c-9f10-de339777540a tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:28.014180 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-87d3cd08-2366-4a3c-9f10-de339777540a tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:28.015090 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-87d3cd08-2366-4a3c-9f10-de339777540a tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:28.016229 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-87d3cd08-2366-4a3c-9f10-de339777540a tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:28.016695 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-87d3cd08-2366-4a3c-9f10-de339777540a tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:28.017135 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-87d3cd08-2366-4a3c-9f10-de339777540a tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:28.068781 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-87d3cd08-2366-4a3c-9f10-de339777540a tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:28.068781 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-87d3cd08-2366-4a3c-9f10-de339777540a tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:28.069103 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-87d3cd08-2366-4a3c-9f10-de339777540a tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:28.070762 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-87d3cd08-2366-4a3c-9f10-de339777540a tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lazy-loading 'fault' on Instance uuid 532ba404-fc1a-44d7-93dc-8e5d9f01c8e4 {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:38:28.315848 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-87d3cd08-2366-4a3c-9f10-de339777540a tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:38:28.324366 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-87d3cd08-2366-4a3c-9f10-de339777540a tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/532ba404-fc1a-44d7-93dc-8e5d9f01c8e4" status: 200 len: 1304 microversion: 2.1 time: 0.360739 Oct 19 03:38:28.338568 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2621/5164] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:38:27 2022] GET /compute/v2.1/servers/532ba404-fc1a-44d7-93dc-8e5d9f01c8e4 => generated 1304 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:38:28.499596 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-57137fed-7b0f-486e-9ea1-9df51147e147 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:38:28.508190 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-57137fed-7b0f-486e-9ea1-9df51147e147 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/6d1dc6d7-9e63-46a2-9bd6-97073fc26565" status: 200 len: 1316 microversion: 2.1 time: 0.712583 Oct 19 03:38:28.511492 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2544/5165] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:38:27 2022] GET /compute/v2.1/servers/6d1dc6d7-9e63-46a2-9bd6-97073fc26565 => generated 1316 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:38:28.913692 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-c4470c8a-29a1-4e66-b892-8c0d4ccadb51 req-3ffaa707-a403-4932-a5c3-f599fda1dcdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddbf7afb-1d7b-4d33-b6fb-1f1608c11985", "name": "network-vif-deleted", "tag": "bfb7e67f-f9af-4eb9-93e7-64332e835840"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:38:28.939805 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-c4470c8a-29a1-4e66-b892-8c0d4ccadb51 req-3ffaa707-a403-4932-a5c3-f599fda1dcdd service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:28.946934 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-c4470c8a-29a1-4e66-b892-8c0d4ccadb51 req-3ffaa707-a403-4932-a5c3-f599fda1dcdd service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:28.947854 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-c4470c8a-29a1-4e66-b892-8c0d4ccadb51 req-3ffaa707-a403-4932-a5c3-f599fda1dcdd service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:28.969503 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-728825fd-6b41-4ac0-992d-ca780e36a7f5 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:38:28.970959 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-728825fd-6b41-4ac0-992d-ca780e36a7f5 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] [instance: ddbf7afb-1d7b-4d33-b6fb-1f1608c11985] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:38:28.988829 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-728825fd-6b41-4ac0-992d-ca780e36a7f5 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:28.993500 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-728825fd-6b41-4ac0-992d-ca780e36a7f5 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:28.994792 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-728825fd-6b41-4ac0-992d-ca780e36a7f5 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:29.000430 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-c4470c8a-29a1-4e66-b892-8c0d4ccadb51 req-3ffaa707-a403-4932-a5c3-f599fda1dcdd service nova] Creating event network-vif-deleted:bfb7e67f-f9af-4eb9-93e7-64332e835840 for instance ddbf7afb-1d7b-4d33-b6fb-1f1608c11985 on n-h2-861333-8 Oct 19 03:38:29.000999 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-728825fd-6b41-4ac0-992d-ca780e36a7f5 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:29.005747 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-728825fd-6b41-4ac0-992d-ca780e36a7f5 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:29.007055 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-728825fd-6b41-4ac0-992d-ca780e36a7f5 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:29.021223 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-c4470c8a-29a1-4e66-b892-8c0d4ccadb51 req-3ffaa707-a403-4932-a5c3-f599fda1dcdd service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115400 Oct 19 03:38:29.024830 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2622/5166] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:38:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:38:29.190014 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-bd04afe6-4a9f-4c68-8ee1-c0454ae3988f req-8acc7911-f78c-4921-b2bf-a96e3fd0a48e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d1dc6d7-9e63-46a2-9bd6-97073fc26565", "name": "network-vif-plugged", "status": "completed", "tag": "ec962ac9-9f7d-4901-b44f-8efeb7d700dc"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:38:29.210418 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-bd04afe6-4a9f-4c68-8ee1-c0454ae3988f req-8acc7911-f78c-4921-b2bf-a96e3fd0a48e service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:29.210554 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-bd04afe6-4a9f-4c68-8ee1-c0454ae3988f req-8acc7911-f78c-4921-b2bf-a96e3fd0a48e service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:29.211101 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-bd04afe6-4a9f-4c68-8ee1-c0454ae3988f req-8acc7911-f78c-4921-b2bf-a96e3fd0a48e service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:29.224073 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-bd04afe6-4a9f-4c68-8ee1-c0454ae3988f req-8acc7911-f78c-4921-b2bf-a96e3fd0a48e service nova] Creating event network-vif-plugged:ec962ac9-9f7d-4901-b44f-8efeb7d700dc for instance 6d1dc6d7-9e63-46a2-9bd6-97073fc26565 on n-h2-861333-8 Oct 19 03:38:29.230795 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-bd04afe6-4a9f-4c68-8ee1-c0454ae3988f req-8acc7911-f78c-4921-b2bf-a96e3fd0a48e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048805 Oct 19 03:38:29.232390 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2623/5167] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:38:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:38:29.355975 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2b2b0c7f-4075-4ff2-b8fd-0b52cd91b853 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:38:29.356933 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-2b2b0c7f-4075-4ff2-b8fd-0b52cd91b853 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 532ba404-fc1a-44d7-93dc-8e5d9f01c8e4] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:38:29.403781 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2b2b0c7f-4075-4ff2-b8fd-0b52cd91b853 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:29.406058 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2b2b0c7f-4075-4ff2-b8fd-0b52cd91b853 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:29.406413 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2b2b0c7f-4075-4ff2-b8fd-0b52cd91b853 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:29.407181 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2b2b0c7f-4075-4ff2-b8fd-0b52cd91b853 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:29.407652 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2b2b0c7f-4075-4ff2-b8fd-0b52cd91b853 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:29.408100 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2b2b0c7f-4075-4ff2-b8fd-0b52cd91b853 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:29.476143 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-2b2b0c7f-4075-4ff2-b8fd-0b52cd91b853 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] HTTP exception thrown: Instance 532ba404-fc1a-44d7-93dc-8e5d9f01c8e4 could not be found. Oct 19 03:38:29.488635 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2b2b0c7f-4075-4ff2-b8fd-0b52cd91b853 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Request method failure captured: Oct 19 03:38:29.488635 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/532ba404-fc1a-44d7-93dc-8e5d9f01c8e4 HTTP/1.1 Oct 19 03:38:29.488635 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:38:29.488635 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:38:29.488635 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:38:29.488635 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:38:29.488635 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:38:29.488635 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:38:29.488635 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:38:29.488635 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:38:29.488635 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT3ER8Vi4kdm7o4uGCDWtKZWQ50YHYh4kO6eywBcR15sWt_VOUdg3SdiEQ00NlpD4-_UkP7cbx60NOPjR2_ogmh3qtcCqHFYMrk6ithnKX7Frq8eCjVqAngAFsiOR8FhKAXItaxrviXq7LiRs8ykPsJTrY1v2OiG3mT4ycQKs5qNWF0I Oct 19 03:38:29.488635 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:38:29.488635 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:38:29.488635 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:38:29.488635 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:38:29.488635 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:38:29.488635 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:38:29.488635 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 224417be63ba4c679b0256a27fb9f104 Oct 19 03:38:29.488635 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-DeleteServersTestJSON-1651632054 Oct 19 03:38:29.488635 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:38:29.488635 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:38:29.488635 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/224417be63ba4c679b0256a27fb9f104"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/224417be63ba4c679b0256a27fb9f104"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/224417be63ba4c679b0256a27fb9f104"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_224417be63ba4c679b0256a27fb9f104", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:38:29.488635 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-DeleteServersTestJSON-1651632054 Oct 19 03:38:29.488635 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 224417be63ba4c679b0256a27fb9f104 Oct 19 03:38:29.488635 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-DeleteServersTestJSON-1651632054 Oct 19 03:38:29.488635 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-DeleteServersTestJSON-1651632054-project Oct 19 03:38:29.488635 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:38:29.488635 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:38:29.488635 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: d099c5070710485f83d528d3d2bb1c71 Oct 19 03:38:29.488635 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-DeleteServersTestJSON-1651632054-project Oct 19 03:38:29.488635 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:38:29.488635 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance 532ba404-fc1a-44d7-93dc-8e5d9f01c8e4 could not be found. Oct 19 03:38:29.488635 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '532ba404-fc1a-44d7-93dc-8e5d9f01c8e4'} Oct 19 03:38:29.488635 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:38:29.488635 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:38:29.488635 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:38:29.488635 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:38:29.488635 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:38:29.488635 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:38:29.488635 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:38:29.488635 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:38:29.488635 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:38:29.488635 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:38:29.488635 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 532ba404-fc1a-44d7-93dc-8e5d9f01c8e4 could not be found. Oct 19 03:38:29.488635 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:38:29.488635 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:38:29.488635 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:38:29.488635 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:38:29.488635 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:38:29.488635 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:38:29.488635 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:38:29.488635 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:38:29.488635 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:38:29.488635 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:38:29.488635 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:38:29.488635 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:38:29.488635 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:38:29.488635 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:38:29.488635 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:38:29.488635 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:38:29.488635 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 532ba404-fc1a-44d7-93dc-8e5d9f01c8e4 could not be found. Oct 19 03:38:29.488635 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:38:29.488635 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:38:29.488635 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:38:29.494339 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:38:29.494339 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:38:29.494339 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:38:29.494339 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:38:29.494339 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:38:29.494339 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 532ba404-fc1a-44d7-93dc-8e5d9f01c8e4 could not be found. Oct 19 03:38:29.494339 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:38:29.494339 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2b2b0c7f-4075-4ff2-b8fd-0b52cd91b853 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Returning 404 to user: Instance 532ba404-fc1a-44d7-93dc-8e5d9f01c8e4 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:38:29.494942 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2b2b0c7f-4075-4ff2-b8fd-0b52cd91b853 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/532ba404-fc1a-44d7-93dc-8e5d9f01c8e4" status: 404 len: 111 microversion: 2.1 time: 0.147007 Oct 19 03:38:29.495325 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2624/5168] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:38:29 2022] GET /compute/v2.1/servers/532ba404-fc1a-44d7-93dc-8e5d9f01c8e4 => generated 111 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:38:29.537079 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-22afed1d-f3a9-456b-a952-c64e089217c6 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:38:29.537921 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-22afed1d-f3a9-456b-a952-c64e089217c6 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 6d1dc6d7-9e63-46a2-9bd6-97073fc26565] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:38:29.546896 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-22afed1d-f3a9-456b-a952-c64e089217c6 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:29.547402 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-22afed1d-f3a9-456b-a952-c64e089217c6 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:29.561304 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-22afed1d-f3a9-456b-a952-c64e089217c6 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:29.562316 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-22afed1d-f3a9-456b-a952-c64e089217c6 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:29.563278 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-22afed1d-f3a9-456b-a952-c64e089217c6 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:29.568848 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-22afed1d-f3a9-456b-a952-c64e089217c6 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:29.581335 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:38:30.195823 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-728825fd-6b41-4ac0-992d-ca780e36a7f5 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c65a497e16e4e41b5cf1287042f3a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4001edd1474947a94243a620a6013a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:38:30.217958 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-728825fd-6b41-4ac0-992d-ca780e36a7f5 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] 10.222.0.52 "GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985" status: 200 len: 1322 microversion: 2.1 time: 1.253765 Oct 19 03:38:30.218582 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2545/5169] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:38:28 2022] GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985 => generated 1322 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:38:30.260319 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-cdac2c86-6344-473d-a4d3-050b5c265155 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1864368591", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "networks": [{"uuid": "c7fc46f7-f975-4fb5-83e4-9e9303a4a241"}]}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:38:30.410457 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-cdac2c86-6344-473d-a4d3-050b5c265155 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] validate_networks() for [('c7fc46f7-f975-4fb5-83e4-9e9303a4a241', None, None, None, None, None)] {{(pid=121134) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:38:30.806733 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-22afed1d-f3a9-456b-a952-c64e089217c6 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:38:30.821855 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-22afed1d-f3a9-456b-a952-c64e089217c6 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/6d1dc6d7-9e63-46a2-9bd6-97073fc26565" status: 200 len: 1316 microversion: 2.1 time: 1.291474 Oct 19 03:38:30.822449 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2625/5170] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:38:29 2022] GET /compute/v2.1/servers/6d1dc6d7-9e63-46a2-9bd6-97073fc26565 => generated 1316 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:38:31.251413 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ae01db12-1d6c-4e49-8ec5-9e6d7fef7941 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:38:31.252257 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ae01db12-1d6c-4e49-8ec5-9e6d7fef7941 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] [instance: ddbf7afb-1d7b-4d33-b6fb-1f1608c11985] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:38:31.265843 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ae01db12-1d6c-4e49-8ec5-9e6d7fef7941 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:31.269186 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ae01db12-1d6c-4e49-8ec5-9e6d7fef7941 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:31.270213 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ae01db12-1d6c-4e49-8ec5-9e6d7fef7941 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:31.271696 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ae01db12-1d6c-4e49-8ec5-9e6d7fef7941 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:31.274109 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ae01db12-1d6c-4e49-8ec5-9e6d7fef7941 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:31.274771 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ae01db12-1d6c-4e49-8ec5-9e6d7fef7941 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:31.305847 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-ae01db12-1d6c-4e49-8ec5-9e6d7fef7941 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] HTTP exception thrown: Instance ddbf7afb-1d7b-4d33-b6fb-1f1608c11985 could not be found. Oct 19 03:38:31.307702 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ae01db12-1d6c-4e49-8ec5-9e6d7fef7941 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Request method failure captured: Oct 19 03:38:31.307702 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985 HTTP/1.1 Oct 19 03:38:31.307702 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:38:31.307702 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:38:31.307702 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:38:31.307702 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:38:31.307702 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:38:31.307702 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:38:31.307702 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:38:31.307702 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:38:31.307702 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT3A-J8gkSeK-jC5SkwldeX2fzHDW9yQloVnq9w2JWN_JbOIlJSI50_hnA7Y-GPIEwyuvwrDEjFnM41r0iLy-FdL3R3ciqTPdXWgB2rbzESKYvw_2cPHI89nLZNBftmcKk7VKZvl3lBPw28mJ2rNa1xBb7pb4TRKC6xWHwLh7-7tORZ4 Oct 19 03:38:31.307702 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:38:31.307702 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:38:31.307702 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:38:31.307702 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:38:31.307702 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:38:31.307702 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:38:31.307702 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: fa4001edd1474947a94243a620a6013a Oct 19 03:38:31.307702 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-AttachVolumeTestJSON-691414608 Oct 19 03:38:31.307702 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:38:31.307702 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:38:31.307702 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/fa4001edd1474947a94243a620a6013a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fa4001edd1474947a94243a620a6013a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fa4001edd1474947a94243a620a6013a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_fa4001edd1474947a94243a620a6013a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:38:31.307702 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-AttachVolumeTestJSON-691414608 Oct 19 03:38:31.307702 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: fa4001edd1474947a94243a620a6013a Oct 19 03:38:31.307702 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-AttachVolumeTestJSON-691414608 Oct 19 03:38:31.307702 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-AttachVolumeTestJSON-691414608-project Oct 19 03:38:31.307702 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:38:31.307702 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:38:31.307702 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 4c65a497e16e4e41b5cf1287042f3a68 Oct 19 03:38:31.307702 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-AttachVolumeTestJSON-691414608-project Oct 19 03:38:31.307702 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:38:31.307702 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance ddbf7afb-1d7b-4d33-b6fb-1f1608c11985 could not be found. Oct 19 03:38:31.307702 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': 'ddbf7afb-1d7b-4d33-b6fb-1f1608c11985'} Oct 19 03:38:31.307702 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:38:31.307702 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:38:31.307702 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:38:31.307702 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:38:31.307702 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:38:31.307702 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:38:31.307702 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:38:31.307702 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:38:31.307702 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:38:31.307702 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:38:31.307702 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ddbf7afb-1d7b-4d33-b6fb-1f1608c11985 could not be found. Oct 19 03:38:31.307702 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:38:31.307702 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:38:31.307702 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:38:31.307702 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:38:31.307702 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:38:31.307702 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:38:31.307702 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:38:31.307702 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:38:31.307702 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:38:31.307702 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:38:31.307702 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:38:31.307702 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:38:31.307702 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:38:31.307702 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:38:31.307702 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:38:31.307702 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:38:31.307702 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ddbf7afb-1d7b-4d33-b6fb-1f1608c11985 could not be found. Oct 19 03:38:31.307702 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:38:31.307702 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:38:31.307702 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:38:31.313176 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:38:31.313176 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:38:31.313176 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:38:31.313176 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:38:31.313176 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:38:31.313176 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ddbf7afb-1d7b-4d33-b6fb-1f1608c11985 could not be found. Oct 19 03:38:31.313176 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:38:31.316878 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ae01db12-1d6c-4e49-8ec5-9e6d7fef7941 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Returning 404 to user: Instance ddbf7afb-1d7b-4d33-b6fb-1f1608c11985 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:38:31.316878 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ae01db12-1d6c-4e49-8ec5-9e6d7fef7941 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] 10.222.0.52 "GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985" status: 404 len: 111 microversion: 2.1 time: 0.071040 Oct 19 03:38:31.322327 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2626/5171] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:38:31 2022] GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 03:38:31.330556 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1e50a591-b95d-44d6-a3ea-3d47fb95a0e4 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Calling method '.version_select at 0x7fc1301f9e50>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:38:31.405028 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-cdac2c86-6344-473d-a4d3-050b5c265155 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Flavor limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:38:31.408518 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-cdac2c86-6344-473d-a4d3-050b5c265155 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Image limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:38:31.408518 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-cdac2c86-6344-473d-a4d3-050b5c265155 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Flavor pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:38:31.408518 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-cdac2c86-6344-473d-a4d3-050b5c265155 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Image pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:38:31.408518 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-cdac2c86-6344-473d-a4d3-050b5c265155 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:38:31.418009 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cdac2c86-6344-473d-a4d3-050b5c265155 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:31.418449 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cdac2c86-6344-473d-a4d3-050b5c265155 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:31.418900 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cdac2c86-6344-473d-a4d3-050b5c265155 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:31.419704 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cdac2c86-6344-473d-a4d3-050b5c265155 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:31.420425 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cdac2c86-6344-473d-a4d3-050b5c265155 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:31.420878 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cdac2c86-6344-473d-a4d3-050b5c265155 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:31.442933 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-cdac2c86-6344-473d-a4d3-050b5c265155 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Getting quotas for project 224417be63ba4c679b0256a27fb9f104. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:38:31.449148 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-cdac2c86-6344-473d-a4d3-050b5c265155 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Getting quotas for user d099c5070710485f83d528d3d2bb1c71 and project 224417be63ba4c679b0256a27fb9f104. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:38:31.456122 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1e50a591-b95d-44d6-a3ea-3d47fb95a0e4 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1486848484" status: 202 len: 0 microversion: 2.1 time: 0.129379 Oct 19 03:38:31.457219 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2627/5172] 10.222.0.52 () {58 vars in 1221 bytes} [Wed Oct 19 03:38:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1486848484 => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:38:31.470885 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-cdac2c86-6344-473d-a4d3-050b5c265155 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Going to run 1 instances... {{(pid=121134) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:38:31.473658 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-cdac2c86-6344-473d-a4d3-050b5c265155 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: c6045b08-8c91-4cdb-be37-c079e7ffe23a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:38:31.599564 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-cdac2c86-6344-473d-a4d3-050b5c265155 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.379881 Oct 19 03:38:31.605101 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2546/5173] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:38:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1385 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 03:38:31.616440 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f7fce7b5-6f1c-4a8e-80e8-a135337ded8b tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:38:31.617400 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f7fce7b5-6f1c-4a8e-80e8-a135337ded8b tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: c6045b08-8c91-4cdb-be37-c079e7ffe23a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:38:31.736289 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f7fce7b5-6f1c-4a8e-80e8-a135337ded8b tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:38:31.746051 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f7fce7b5-6f1c-4a8e-80e8-a135337ded8b tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/c6045b08-8c91-4cdb-be37-c079e7ffe23a" status: 200 len: 1215 microversion: 2.1 time: 0.134441 Oct 19 03:38:31.746640 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2628/5174] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:38:31 2022] GET /compute/v2.1/servers/c6045b08-8c91-4cdb-be37-c079e7ffe23a => generated 1215 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:38:31.850349 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-75050847-88a0-494e-8b8f-203f334f3a7a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:38:31.850349 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-75050847-88a0-494e-8b8f-203f334f3a7a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 6d1dc6d7-9e63-46a2-9bd6-97073fc26565] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:38:31.853922 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-75050847-88a0-494e-8b8f-203f334f3a7a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:31.858388 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-75050847-88a0-494e-8b8f-203f334f3a7a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:31.859064 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-75050847-88a0-494e-8b8f-203f334f3a7a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:31.860922 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-75050847-88a0-494e-8b8f-203f334f3a7a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:31.862297 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-75050847-88a0-494e-8b8f-203f334f3a7a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:31.873768 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-75050847-88a0-494e-8b8f-203f334f3a7a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:32.312470 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-75050847-88a0-494e-8b8f-203f334f3a7a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:38:32.323905 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-75050847-88a0-494e-8b8f-203f334f3a7a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/6d1dc6d7-9e63-46a2-9bd6-97073fc26565" status: 200 len: 1316 microversion: 2.1 time: 0.481348 Oct 19 03:38:32.351840 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2547/5175] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:38:31 2022] GET /compute/v2.1/servers/6d1dc6d7-9e63-46a2-9bd6-97073fc26565 => generated 1316 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:38:32.774367 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-fbd756c6-e5c4-4ac8-a833-540d3afe0516 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:38:32.775657 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-fbd756c6-e5c4-4ac8-a833-540d3afe0516 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: c6045b08-8c91-4cdb-be37-c079e7ffe23a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:38:32.864439 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-fbd756c6-e5c4-4ac8-a833-540d3afe0516 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:38:32.872989 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-fbd756c6-e5c4-4ac8-a833-540d3afe0516 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/c6045b08-8c91-4cdb-be37-c079e7ffe23a" status: 200 len: 1215 microversion: 2.1 time: 0.103138 Oct 19 03:38:32.876240 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2629/5176] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:38:32 2022] GET /compute/v2.1/servers/c6045b08-8c91-4cdb-be37-c079e7ffe23a => generated 1215 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:38:33.160208 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0ac6d6b1-6c91-45fb-87f9-3414fbb7d004 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Action: 'create', calling method: .version_select at 0x7fc130cb98b0>, body: {"keypair": {"name": "tempest-keypair-18999575", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAa2rXgTIcJi3b7ubvJqwuM9tyH7TqkQkiIOXVWfMcPZY7qpEhjfa172akmNmOeZLB8wjMSzNuRciDltdRNMaaoyPvLQrBLNwvnYFqxxFV2601cFM2qIeu2pSVru0x1jvQ=="}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:38:33.176157 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-0ac6d6b1-6c91-45fb-87f9-3414fbb7d004 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Getting quotas for project fa4001edd1474947a94243a620a6013a. Resources: {'key_pairs'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:38:33.185661 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-0ac6d6b1-6c91-45fb-87f9-3414fbb7d004 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Getting quotas for user 4c65a497e16e4e41b5cf1287042f3a68 and project fa4001edd1474947a94243a620a6013a. Resources: {'key_pairs'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:38:33.292097 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0ac6d6b1-6c91-45fb-87f9-3414fbb7d004 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.139859 Oct 19 03:38:33.293006 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2548/5177] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Oct 19 03:38:33 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:38:33.347584 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c7a12896-3ed7-4ba6-85b0-c7a2fd3598d3 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:38:33.348830 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c7a12896-3ed7-4ba6-85b0-c7a2fd3598d3 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 6d1dc6d7-9e63-46a2-9bd6-97073fc26565] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:38:33.361484 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c7a12896-3ed7-4ba6-85b0-c7a2fd3598d3 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:33.362360 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c7a12896-3ed7-4ba6-85b0-c7a2fd3598d3 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:33.363071 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c7a12896-3ed7-4ba6-85b0-c7a2fd3598d3 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:33.364528 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c7a12896-3ed7-4ba6-85b0-c7a2fd3598d3 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:33.365284 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c7a12896-3ed7-4ba6-85b0-c7a2fd3598d3 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:33.365917 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c7a12896-3ed7-4ba6-85b0-c7a2fd3598d3 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:33.637688 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c7a12896-3ed7-4ba6-85b0-c7a2fd3598d3 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:38:33.649423 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c7a12896-3ed7-4ba6-85b0-c7a2fd3598d3 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/6d1dc6d7-9e63-46a2-9bd6-97073fc26565" status: 200 len: 1504 microversion: 2.1 time: 0.305743 Oct 19 03:38:33.652092 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2630/5178] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:38:33 2022] GET /compute/v2.1/servers/6d1dc6d7-9e63-46a2-9bd6-97073fc26565 => generated 1504 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:38:33.674642 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-27622bbd-ffeb-455f-8fdf-1e64fbee92a6 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:38:33.675126 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-27622bbd-ffeb-455f-8fdf-1e64fbee92a6 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 6d1dc6d7-9e63-46a2-9bd6-97073fc26565] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:38:33.687067 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-27622bbd-ffeb-455f-8fdf-1e64fbee92a6 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:33.687965 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-27622bbd-ffeb-455f-8fdf-1e64fbee92a6 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:33.688841 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-27622bbd-ffeb-455f-8fdf-1e64fbee92a6 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:33.689831 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-27622bbd-ffeb-455f-8fdf-1e64fbee92a6 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:33.690483 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-27622bbd-ffeb-455f-8fdf-1e64fbee92a6 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:33.691690 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-27622bbd-ffeb-455f-8fdf-1e64fbee92a6 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:33.733915 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-27622bbd-ffeb-455f-8fdf-1e64fbee92a6 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 6d1dc6d7-9e63-46a2-9bd6-97073fc26565] Going to try to terminate instance {{(pid=121134) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:38:33.901266 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-81428e2c-3f74-4e46-9fee-186a228ee72f tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:38:33.902231 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-81428e2c-3f74-4e46-9fee-186a228ee72f tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: c6045b08-8c91-4cdb-be37-c079e7ffe23a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:38:33.912601 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-81428e2c-3f74-4e46-9fee-186a228ee72f tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:33.916390 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-81428e2c-3f74-4e46-9fee-186a228ee72f tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:33.916390 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-81428e2c-3f74-4e46-9fee-186a228ee72f tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:33.916390 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-81428e2c-3f74-4e46-9fee-186a228ee72f tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:33.916390 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-81428e2c-3f74-4e46-9fee-186a228ee72f tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:33.916390 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-81428e2c-3f74-4e46-9fee-186a228ee72f tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:34.096298 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-81428e2c-3f74-4e46-9fee-186a228ee72f tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:38:34.117835 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-27622bbd-ffeb-455f-8fdf-1e64fbee92a6 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "DELETE /compute/v2.1/servers/6d1dc6d7-9e63-46a2-9bd6-97073fc26565" status: 204 len: 0 microversion: 2.1 time: 0.447009 Oct 19 03:38:34.118442 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2549/5179] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:38:33 2022] DELETE /compute/v2.1/servers/6d1dc6d7-9e63-46a2-9bd6-97073fc26565 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:38:34.120444 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-81428e2c-3f74-4e46-9fee-186a228ee72f tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/c6045b08-8c91-4cdb-be37-c079e7ffe23a" status: 200 len: 1267 microversion: 2.1 time: 0.225050 Oct 19 03:38:34.128092 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-233ed9fa-228e-4dd3-b78b-361c4a153058 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:38:34.130418 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-233ed9fa-228e-4dd3-b78b-361c4a153058 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 6d1dc6d7-9e63-46a2-9bd6-97073fc26565] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:38:34.135133 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2631/5180] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:38:33 2022] GET /compute/v2.1/servers/c6045b08-8c91-4cdb-be37-c079e7ffe23a => generated 1267 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:38:34.144398 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-233ed9fa-228e-4dd3-b78b-361c4a153058 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:34.146017 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-233ed9fa-228e-4dd3-b78b-361c4a153058 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:34.147870 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-233ed9fa-228e-4dd3-b78b-361c4a153058 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:34.148761 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-233ed9fa-228e-4dd3-b78b-361c4a153058 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:34.151584 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-233ed9fa-228e-4dd3-b78b-361c4a153058 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:34.153009 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-233ed9fa-228e-4dd3-b78b-361c4a153058 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:34.422801 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-233ed9fa-228e-4dd3-b78b-361c4a153058 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:38:34.433170 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-233ed9fa-228e-4dd3-b78b-361c4a153058 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/6d1dc6d7-9e63-46a2-9bd6-97073fc26565" status: 200 len: 1510 microversion: 2.1 time: 0.309801 Oct 19 03:38:34.433879 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2550/5181] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:38:34 2022] GET /compute/v2.1/servers/6d1dc6d7-9e63-46a2-9bd6-97073fc26565 => generated 1510 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:38:35.144268 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a80645ca-983b-4630-af08-5dabfb0bfb16 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:38:35.146148 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a80645ca-983b-4630-af08-5dabfb0bfb16 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: c6045b08-8c91-4cdb-be37-c079e7ffe23a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:38:35.162212 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a80645ca-983b-4630-af08-5dabfb0bfb16 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:35.162719 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a80645ca-983b-4630-af08-5dabfb0bfb16 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:35.163169 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a80645ca-983b-4630-af08-5dabfb0bfb16 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:35.163904 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a80645ca-983b-4630-af08-5dabfb0bfb16 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:35.164364 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a80645ca-983b-4630-af08-5dabfb0bfb16 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:35.164799 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a80645ca-983b-4630-af08-5dabfb0bfb16 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:35.281760 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a80645ca-983b-4630-af08-5dabfb0bfb16 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:38:35.292953 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a80645ca-983b-4630-af08-5dabfb0bfb16 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/c6045b08-8c91-4cdb-be37-c079e7ffe23a" status: 200 len: 1285 microversion: 2.1 time: 0.152042 Oct 19 03:38:35.294862 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2632/5182] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:38:35 2022] GET /compute/v2.1/servers/c6045b08-8c91-4cdb-be37-c079e7ffe23a => generated 1285 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:38:35.461758 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ba1cbfa5-191a-449a-a1bb-3a1b7f1f6583 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:38:35.461758 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ba1cbfa5-191a-449a-a1bb-3a1b7f1f6583 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 6d1dc6d7-9e63-46a2-9bd6-97073fc26565] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:38:35.466276 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ba1cbfa5-191a-449a-a1bb-3a1b7f1f6583 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:35.466917 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ba1cbfa5-191a-449a-a1bb-3a1b7f1f6583 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:35.467652 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ba1cbfa5-191a-449a-a1bb-3a1b7f1f6583 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:35.468491 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ba1cbfa5-191a-449a-a1bb-3a1b7f1f6583 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:35.469064 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ba1cbfa5-191a-449a-a1bb-3a1b7f1f6583 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:35.469771 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ba1cbfa5-191a-449a-a1bb-3a1b7f1f6583 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:35.951746 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ba1cbfa5-191a-449a-a1bb-3a1b7f1f6583 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:38:35.960300 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ba1cbfa5-191a-449a-a1bb-3a1b7f1f6583 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/6d1dc6d7-9e63-46a2-9bd6-97073fc26565" status: 200 len: 1510 microversion: 2.1 time: 0.507238 Oct 19 03:38:35.961119 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2551/5183] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:38:35 2022] GET /compute/v2.1/servers/6d1dc6d7-9e63-46a2-9bd6-97073fc26565 => generated 1510 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:38:36.327407 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c6a739bd-37f2-4e1f-88ee-719dcab17c66 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:38:36.332856 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c6a739bd-37f2-4e1f-88ee-719dcab17c66 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: c6045b08-8c91-4cdb-be37-c079e7ffe23a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:38:36.335762 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c6a739bd-37f2-4e1f-88ee-719dcab17c66 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:36.336554 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c6a739bd-37f2-4e1f-88ee-719dcab17c66 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:36.337159 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c6a739bd-37f2-4e1f-88ee-719dcab17c66 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:36.338263 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c6a739bd-37f2-4e1f-88ee-719dcab17c66 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:36.338896 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c6a739bd-37f2-4e1f-88ee-719dcab17c66 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:36.339808 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c6a739bd-37f2-4e1f-88ee-719dcab17c66 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:36.528944 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c6a739bd-37f2-4e1f-88ee-719dcab17c66 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:38:36.580036 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c6a739bd-37f2-4e1f-88ee-719dcab17c66 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/c6045b08-8c91-4cdb-be37-c079e7ffe23a" status: 200 len: 1273 microversion: 2.1 time: 0.254536 Oct 19 03:38:36.603077 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2633/5184] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:38:36 2022] GET /compute/v2.1/servers/c6045b08-8c91-4cdb-be37-c079e7ffe23a => generated 1273 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:38:36.984792 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4721e8fc-101c-4e49-a0e0-0e5f8df54944 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:38:36.987045 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4721e8fc-101c-4e49-a0e0-0e5f8df54944 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 6d1dc6d7-9e63-46a2-9bd6-97073fc26565] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:38:37.007228 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4721e8fc-101c-4e49-a0e0-0e5f8df54944 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:37.008040 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4721e8fc-101c-4e49-a0e0-0e5f8df54944 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:37.012059 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4721e8fc-101c-4e49-a0e0-0e5f8df54944 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:37.014059 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4721e8fc-101c-4e49-a0e0-0e5f8df54944 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:37.017216 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4721e8fc-101c-4e49-a0e0-0e5f8df54944 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:37.018048 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4721e8fc-101c-4e49-a0e0-0e5f8df54944 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:37.059958 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-70fe628f-c1a1-4fdb-84b1-48b95fd4eec8 req-fe3645f4-e262-4d40-9fa5-70e396bfae1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d1dc6d7-9e63-46a2-9bd6-97073fc26565", "name": "network-vif-deleted", "tag": "ec962ac9-9f7d-4901-b44f-8efeb7d700dc"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:38:37.083888 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-70fe628f-c1a1-4fdb-84b1-48b95fd4eec8 req-fe3645f4-e262-4d40-9fa5-70e396bfae1b service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:37.089726 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-70fe628f-c1a1-4fdb-84b1-48b95fd4eec8 req-fe3645f4-e262-4d40-9fa5-70e396bfae1b service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:37.091926 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-70fe628f-c1a1-4fdb-84b1-48b95fd4eec8 req-fe3645f4-e262-4d40-9fa5-70e396bfae1b service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:37.137239 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-70fe628f-c1a1-4fdb-84b1-48b95fd4eec8 req-fe3645f4-e262-4d40-9fa5-70e396bfae1b service nova] Creating event network-vif-deleted:ec962ac9-9f7d-4901-b44f-8efeb7d700dc for instance 6d1dc6d7-9e63-46a2-9bd6-97073fc26565 on n-h2-861333-8 Oct 19 03:38:37.147120 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-70fe628f-c1a1-4fdb-84b1-48b95fd4eec8 req-fe3645f4-e262-4d40-9fa5-70e396bfae1b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088990 Oct 19 03:38:37.148496 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2634/5185] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:38:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:38:37.295555 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-4721e8fc-101c-4e49-a0e0-0e5f8df54944 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:38:37.304963 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4721e8fc-101c-4e49-a0e0-0e5f8df54944 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/6d1dc6d7-9e63-46a2-9bd6-97073fc26565" status: 200 len: 1468 microversion: 2.1 time: 0.324544 Oct 19 03:38:37.313733 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2552/5186] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:38:36 2022] GET /compute/v2.1/servers/6d1dc6d7-9e63-46a2-9bd6-97073fc26565 => generated 1468 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:38:37.615721 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5c1e4782-ff5a-4ad6-b7c0-026cd6aa320b tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:38:37.618315 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-5c1e4782-ff5a-4ad6-b7c0-026cd6aa320b tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: c6045b08-8c91-4cdb-be37-c079e7ffe23a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:38:37.641038 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5c1e4782-ff5a-4ad6-b7c0-026cd6aa320b tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:37.641890 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5c1e4782-ff5a-4ad6-b7c0-026cd6aa320b tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:37.644615 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5c1e4782-ff5a-4ad6-b7c0-026cd6aa320b tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:37.647330 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5c1e4782-ff5a-4ad6-b7c0-026cd6aa320b tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:37.647330 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5c1e4782-ff5a-4ad6-b7c0-026cd6aa320b tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:37.647330 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5c1e4782-ff5a-4ad6-b7c0-026cd6aa320b tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:37.966165 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-5c1e4782-ff5a-4ad6-b7c0-026cd6aa320b tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:38:37.975617 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5c1e4782-ff5a-4ad6-b7c0-026cd6aa320b tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/c6045b08-8c91-4cdb-be37-c079e7ffe23a" status: 200 len: 1315 microversion: 2.1 time: 0.367584 Oct 19 03:38:37.976298 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2635/5187] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:38:37 2022] GET /compute/v2.1/servers/c6045b08-8c91-4cdb-be37-c079e7ffe23a => generated 1315 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:38:38.340546 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-218806b7-6bcb-4621-87f5-dbd34fca39ec tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:38:38.341301 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-218806b7-6bcb-4621-87f5-dbd34fca39ec tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 6d1dc6d7-9e63-46a2-9bd6-97073fc26565] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:38:38.357854 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-218806b7-6bcb-4621-87f5-dbd34fca39ec tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:38.358744 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-218806b7-6bcb-4621-87f5-dbd34fca39ec tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:38.360704 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-218806b7-6bcb-4621-87f5-dbd34fca39ec tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:38.362875 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-218806b7-6bcb-4621-87f5-dbd34fca39ec tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:38.363454 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-218806b7-6bcb-4621-87f5-dbd34fca39ec tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:38.364663 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-218806b7-6bcb-4621-87f5-dbd34fca39ec tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:38.468988 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-218806b7-6bcb-4621-87f5-dbd34fca39ec tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:38.470254 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-218806b7-6bcb-4621-87f5-dbd34fca39ec tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:38.472207 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-218806b7-6bcb-4621-87f5-dbd34fca39ec tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:38.473796 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-218806b7-6bcb-4621-87f5-dbd34fca39ec tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lazy-loading 'fault' on Instance uuid 6d1dc6d7-9e63-46a2-9bd6-97073fc26565 {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:38:38.687373 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-fccedc37-5ea2-4d8b-8664-74b68fae43f0 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1352707832", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "18068c67-95f3-4a2f-9645-3680587e605d"}], "security_groups": [{"name": "tempest-securitygroup--855817663"}], "key_name": "tempest-keypair-18999575", "user_data": "}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:38:38.876201 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-218806b7-6bcb-4621-87f5-dbd34fca39ec tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:38:38.877597 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-218806b7-6bcb-4621-87f5-dbd34fca39ec tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/6d1dc6d7-9e63-46a2-9bd6-97073fc26565" status: 200 len: 1306 microversion: 2.1 time: 0.542260 Oct 19 03:38:38.878775 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2553/5188] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:38:38 2022] GET /compute/v2.1/servers/6d1dc6d7-9e63-46a2-9bd6-97073fc26565 => generated 1306 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:38:38.971702 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.network.neutron [None req-fccedc37-5ea2-4d8b-8664-74b68fae43f0 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] validate_networks() for [('18068c67-95f3-4a2f-9645-3680587e605d', None, None, None, None, None)] {{(pid=121135) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:38:39.000141 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-cfc078a1-3ab7-4bb1-85ba-122beddef188 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:38:39.000793 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-cfc078a1-3ab7-4bb1-85ba-122beddef188 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: c6045b08-8c91-4cdb-be37-c079e7ffe23a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:38:39.012425 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cfc078a1-3ab7-4bb1-85ba-122beddef188 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:39.014898 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cfc078a1-3ab7-4bb1-85ba-122beddef188 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:39.015613 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cfc078a1-3ab7-4bb1-85ba-122beddef188 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:39.016755 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cfc078a1-3ab7-4bb1-85ba-122beddef188 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:39.018966 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cfc078a1-3ab7-4bb1-85ba-122beddef188 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:39.020385 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cfc078a1-3ab7-4bb1-85ba-122beddef188 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:39.448722 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-cfc078a1-3ab7-4bb1-85ba-122beddef188 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:38:39.456449 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-cfc078a1-3ab7-4bb1-85ba-122beddef188 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/c6045b08-8c91-4cdb-be37-c079e7ffe23a" status: 200 len: 1315 microversion: 2.1 time: 0.461115 Oct 19 03:38:39.465725 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2554/5189] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:38:38 2022] GET /compute/v2.1/servers/c6045b08-8c91-4cdb-be37-c079e7ffe23a => generated 1315 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:38:39.654409 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-5349bcc4-66a2-42e8-bcf0-50c2e46b5aff req-6e6fa9ec-91e6-41c9-911f-d0bd33da6126 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6045b08-8c91-4cdb-be37-c079e7ffe23a", "tag": "4e2605b6-c38c-4154-93ae-04ca20dd249c"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:38:39.681242 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-5349bcc4-66a2-42e8-bcf0-50c2e46b5aff req-6e6fa9ec-91e6-41c9-911f-d0bd33da6126 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:39.684182 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-5349bcc4-66a2-42e8-bcf0-50c2e46b5aff req-6e6fa9ec-91e6-41c9-911f-d0bd33da6126 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:39.684661 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-5349bcc4-66a2-42e8-bcf0-50c2e46b5aff req-6e6fa9ec-91e6-41c9-911f-d0bd33da6126 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:39.737093 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-5349bcc4-66a2-42e8-bcf0-50c2e46b5aff req-6e6fa9ec-91e6-41c9-911f-d0bd33da6126 service nova] Creating event network-changed:4e2605b6-c38c-4154-93ae-04ca20dd249c for instance c6045b08-8c91-4cdb-be37-c079e7ffe23a on n-h1-861333-8 Oct 19 03:38:39.747917 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-5349bcc4-66a2-42e8-bcf0-50c2e46b5aff req-6e6fa9ec-91e6-41c9-911f-d0bd33da6126 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097255 Oct 19 03:38:39.749169 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2555/5190] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:38:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:38:39.924854 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-87234361-f6d4-4c9b-ac4c-7b1586fb7d94 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:38:39.926026 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-87234361-f6d4-4c9b-ac4c-7b1586fb7d94 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 6d1dc6d7-9e63-46a2-9bd6-97073fc26565] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:38:39.952306 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-87234361-f6d4-4c9b-ac4c-7b1586fb7d94 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:39.953952 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-87234361-f6d4-4c9b-ac4c-7b1586fb7d94 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:39.962532 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-87234361-f6d4-4c9b-ac4c-7b1586fb7d94 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:39.965223 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-87234361-f6d4-4c9b-ac4c-7b1586fb7d94 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:39.967268 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-87234361-f6d4-4c9b-ac4c-7b1586fb7d94 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:39.969327 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-87234361-f6d4-4c9b-ac4c-7b1586fb7d94 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:40.003463 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-87234361-f6d4-4c9b-ac4c-7b1586fb7d94 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] HTTP exception thrown: Instance 6d1dc6d7-9e63-46a2-9bd6-97073fc26565 could not be found. Oct 19 03:38:40.006859 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-87234361-f6d4-4c9b-ac4c-7b1586fb7d94 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Request method failure captured: Oct 19 03:38:40.006859 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/6d1dc6d7-9e63-46a2-9bd6-97073fc26565 HTTP/1.1 Oct 19 03:38:40.006859 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:38:40.006859 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:38:40.006859 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:38:40.006859 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:38:40.006859 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:38:40.006859 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:38:40.006859 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:38:40.006859 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:38:40.006859 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3EK4yDar5R5kGdpWRPopK281fOgxjiWCAZdy3tbDZzFYZxrN53hSsTq0YyAxsfcVRT4cF0jU61e6walOKxMx_njT0L3WOIYEymBjzmNzdXOa-UhYNf83BpQOShCJts2aNodNdu7YjeLcAcuRF0ZOjoH0xsH4HoNSzc8IfQzKhRz4vw Oct 19 03:38:40.006859 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:38:40.006859 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:38:40.006859 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:38:40.006859 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:38:40.006859 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:38:40.006859 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:38:40.006859 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 34bd94983fbf4a8aa49aff65c076e9e3 Oct 19 03:38:40.006859 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:38:40.006859 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:38:40.006859 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:38:40.006859 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_34bd94983fbf4a8aa49aff65c076e9e3", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:38:40.006859 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:38:40.006859 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 34bd94983fbf4a8aa49aff65c076e9e3 Oct 19 03:38:40.006859 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:38:40.006859 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ServersNegativeTestJSON-553742303-project Oct 19 03:38:40.006859 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:38:40.006859 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:38:40.006859 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 771feb133bc046588552d3af98f8e0a1 Oct 19 03:38:40.006859 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ServersNegativeTestJSON-553742303-project Oct 19 03:38:40.006859 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:38:40.006859 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance 6d1dc6d7-9e63-46a2-9bd6-97073fc26565 could not be found. Oct 19 03:38:40.006859 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '6d1dc6d7-9e63-46a2-9bd6-97073fc26565'} Oct 19 03:38:40.006859 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:38:40.006859 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:38:40.006859 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:38:40.006859 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:38:40.006859 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:38:40.006859 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:38:40.006859 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:38:40.006859 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:38:40.006859 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:38:40.006859 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:38:40.006859 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d1dc6d7-9e63-46a2-9bd6-97073fc26565 could not be found. Oct 19 03:38:40.006859 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:38:40.006859 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:38:40.006859 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:38:40.006859 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:38:40.006859 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:38:40.006859 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:38:40.006859 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:38:40.006859 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:38:40.006859 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:38:40.006859 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:38:40.006859 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:38:40.006859 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:38:40.006859 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:38:40.006859 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:38:40.006859 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:38:40.006859 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:38:40.006859 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d1dc6d7-9e63-46a2-9bd6-97073fc26565 could not be found. Oct 19 03:38:40.006859 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:38:40.006859 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:38:40.006859 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:38:40.018861 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:38:40.018861 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:38:40.018861 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:38:40.018861 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:38:40.018861 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:38:40.018861 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d1dc6d7-9e63-46a2-9bd6-97073fc26565 could not be found. Oct 19 03:38:40.018861 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:38:40.020889 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-fccedc37-5ea2-4d8b-8664-74b68fae43f0 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Flavor limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:38:40.022421 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-fccedc37-5ea2-4d8b-8664-74b68fae43f0 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Image limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:38:40.023247 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-fccedc37-5ea2-4d8b-8664-74b68fae43f0 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Flavor pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:38:40.023883 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-fccedc37-5ea2-4d8b-8664-74b68fae43f0 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Image pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:38:40.024495 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-fccedc37-5ea2-4d8b-8664-74b68fae43f0 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:38:40.039608 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-87234361-f6d4-4c9b-ac4c-7b1586fb7d94 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Returning 404 to user: Instance 6d1dc6d7-9e63-46a2-9bd6-97073fc26565 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:38:40.041740 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-87234361-f6d4-4c9b-ac4c-7b1586fb7d94 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/6d1dc6d7-9e63-46a2-9bd6-97073fc26565" status: 404 len: 111 microversion: 2.1 time: 0.143189 Oct 19 03:38:40.047550 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2556/5191] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:38:39 2022] GET /compute/v2.1/servers/6d1dc6d7-9e63-46a2-9bd6-97073fc26565 => generated 111 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:38:40.048293 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fccedc37-5ea2-4d8b-8664-74b68fae43f0 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:40.049108 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fccedc37-5ea2-4d8b-8664-74b68fae43f0 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:40.052117 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fccedc37-5ea2-4d8b-8664-74b68fae43f0 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:40.053323 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fccedc37-5ea2-4d8b-8664-74b68fae43f0 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:40.054039 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fccedc37-5ea2-4d8b-8664-74b68fae43f0 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:40.056095 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-43508cda-02db-4292-9dfb-632ab6707580 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:38:40.060676 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-43508cda-02db-4292-9dfb-632ab6707580 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:38:40.073939 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fccedc37-5ea2-4d8b-8664-74b68fae43f0 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:40.081216 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-43508cda-02db-4292-9dfb-632ab6707580 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:40.088752 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-43508cda-02db-4292-9dfb-632ab6707580 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:40.088752 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-43508cda-02db-4292-9dfb-632ab6707580 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:40.088752 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-43508cda-02db-4292-9dfb-632ab6707580 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:40.089233 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-43508cda-02db-4292-9dfb-632ab6707580 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:40.089684 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-43508cda-02db-4292-9dfb-632ab6707580 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:40.125348 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-fccedc37-5ea2-4d8b-8664-74b68fae43f0 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Getting quotas for project fa4001edd1474947a94243a620a6013a. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:38:40.135280 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-fccedc37-5ea2-4d8b-8664-74b68fae43f0 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Getting quotas for user 4c65a497e16e4e41b5cf1287042f3a68 and project fa4001edd1474947a94243a620a6013a. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:38:40.150966 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-fccedc37-5ea2-4d8b-8664-74b68fae43f0 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Going to run 1 instances... {{(pid=121135) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:38:40.153929 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-fccedc37-5ea2-4d8b-8664-74b68fae43f0 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] [instance: 1f354001-86ee-4951-a9cb-23fcd9e678a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121135) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:38:40.291445 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-fccedc37-5ea2-4d8b-8664-74b68fae43f0 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.604512 Oct 19 03:38:40.291445 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2636/5192] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:38:38 2022] POST /compute/v2.1/servers => generated 401 bytes in 1606 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 19 03:38:40.329310 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b96b7001-7ade-4f0a-ae75-b5ce98bfc3ad tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:38:40.340833 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b96b7001-7ade-4f0a-ae75-b5ce98bfc3ad tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 4fab83b8-8862-4295-adb7-e2bf5462a2d9] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:38:40.361624 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b96b7001-7ade-4f0a-ae75-b5ce98bfc3ad tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:40.362573 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b96b7001-7ade-4f0a-ae75-b5ce98bfc3ad tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:40.363824 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b96b7001-7ade-4f0a-ae75-b5ce98bfc3ad tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:40.364871 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b96b7001-7ade-4f0a-ae75-b5ce98bfc3ad tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:40.365552 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b96b7001-7ade-4f0a-ae75-b5ce98bfc3ad tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:40.366937 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b96b7001-7ade-4f0a-ae75-b5ce98bfc3ad tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:40.415098 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-b96b7001-7ade-4f0a-ae75-b5ce98bfc3ad tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lazy-loading 'flavor' on Instance uuid 4fab83b8-8862-4295-adb7-e2bf5462a2d9 {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:38:40.425290 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-43508cda-02db-4292-9dfb-632ab6707580 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:38:40.437342 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-43508cda-02db-4292-9dfb-632ab6707580 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1506 microversion: 2.1 time: 0.388198 Oct 19 03:38:40.439415 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2557/5193] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:38:40 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1506 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:38:40.452173 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a928d4c8-8872-4b91-8bc8-ef05eb1c7d17 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:38:40.452847 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a928d4c8-8872-4b91-8bc8-ef05eb1c7d17 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] [instance: 1f354001-86ee-4951-a9cb-23fcd9e678a9] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:38:40.628656 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a928d4c8-8872-4b91-8bc8-ef05eb1c7d17 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c65a497e16e4e41b5cf1287042f3a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4001edd1474947a94243a620a6013a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:38:40.644795 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a928d4c8-8872-4b91-8bc8-ef05eb1c7d17 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] 10.222.0.52 "GET /compute/v2.1/servers/1f354001-86ee-4951-a9cb-23fcd9e678a9" status: 200 len: 1236 microversion: 2.1 time: 0.204041 Oct 19 03:38:40.665299 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2558/5194] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:38:40 2022] GET /compute/v2.1/servers/1f354001-86ee-4951-a9cb-23fcd9e678a9 => generated 1236 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:38:40.684416 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-282258bc-ae99-4a3e-8e55-531c5aaf04aa tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:38:40.686826 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-282258bc-ae99-4a3e-8e55-531c5aaf04aa tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: c6045b08-8c91-4cdb-be37-c079e7ffe23a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:38:40.704476 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-282258bc-ae99-4a3e-8e55-531c5aaf04aa tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:40.704476 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-282258bc-ae99-4a3e-8e55-531c5aaf04aa tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:40.704476 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-282258bc-ae99-4a3e-8e55-531c5aaf04aa tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:40.704476 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-282258bc-ae99-4a3e-8e55-531c5aaf04aa tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:40.705518 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-282258bc-ae99-4a3e-8e55-531c5aaf04aa tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:40.705518 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-282258bc-ae99-4a3e-8e55-531c5aaf04aa tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:40.988617 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b96b7001-7ade-4f0a-ae75-b5ce98bfc3ad tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "POST /compute/v2.1/servers/4fab83b8-8862-4295-adb7-e2bf5462a2d9/action" status: 200 len: 32 microversion: 2.1 time: 0.688502 Oct 19 03:38:40.997129 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2637/5195] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:38:40 2022] POST /compute/v2.1/servers/4fab83b8-8862-4295-adb7-e2bf5462a2d9/action => generated 32 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 03:38:41.004280 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-484d1cd0-8902-4abe-a0e2-a5a224ccefa6 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "networks": [{"uuid": "3ecd8896-b7a4-4c3a-b3cd-dc6769233813"}]}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:38:41.018202 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-484d1cd0-8902-4abe-a0e2-a5a224ccefa6 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Request method failure captured: Oct 19 03:38:41.018202 n-d-861333-8 devstack@n-api.service[121135]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 19 03:38:41.018202 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:38:41.018202 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:38:41.018202 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:38:41.018202 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 163 Oct 19 03:38:41.018202 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:38:41.018202 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:38:41.018202 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:38:41.018202 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:38:41.018202 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT3EK4yDar5R5kGdpWRPopK281fOgxjiWCAZdy3tbDZzFYZxrN53hSsTq0YyAxsfcVRT4cF0jU61e6walOKxMx_njT0L3WOIYEymBjzmNzdXOa-UhYNf83BpQOShCJts2aNodNdu7YjeLcAcuRF0ZOjoH0xsH4HoNSzc8IfQzKhRz4vw Oct 19 03:38:41.018202 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:38:41.018202 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:38:41.018202 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:38:41.018202 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:38:41.018202 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:38:41.018202 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:38:41.018202 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 34bd94983fbf4a8aa49aff65c076e9e3 Oct 19 03:38:41.018202 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:38:41.018202 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:38:41.018202 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:38:41.018202 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_34bd94983fbf4a8aa49aff65c076e9e3", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:38:41.018202 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:38:41.018202 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 34bd94983fbf4a8aa49aff65c076e9e3 Oct 19 03:38:41.018202 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:38:41.018202 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ServersNegativeTestJSON-553742303-project Oct 19 03:38:41.018202 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:38:41.018202 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:38:41.018202 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 771feb133bc046588552d3af98f8e0a1 Oct 19 03:38:41.018202 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ServersNegativeTestJSON-553742303-project Oct 19 03:38:41.018202 n-d-861333-8 devstack@n-api.service[121135]: Oct 19 03:38:41.018202 n-d-861333-8 devstack@n-api.service[121135]: {"server": {"name": 12345, "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "networks": [{"uuid": "3ecd8896-b7a4-4c3a-b3cd-dc6769233813"}]}} Oct 19 03:38:41.018202 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:38:41.018202 n-d-861333-8 devstack@n-api.service[121135]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 19 03:38:41.018202 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'body': {'server': {'name': 12345, 'imageRef': '9e16d73e-70ea-4421-aee3-047d80396c02', 'flavorRef': '452', 'networks': [{'uuid': '3ecd8896-b7a4-4c3a-b3cd-dc6769233813'}]}}} Oct 19 03:38:41.018202 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:38:41.018202 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:38:41.018202 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 03:38:41.018202 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 03:38:41.018202 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 03:38:41.018202 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise error Oct 19 03:38:41.018202 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Oct 19 03:38:41.018202 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:38:41.018202 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Oct 19 03:38:41.018202 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 19 03:38:41.018202 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:38:41.018202 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 19 03:38:41.018202 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi 12345 Oct 19 03:38:41.018202 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:38:41.018202 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:38:41.018202 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:38:41.018202 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:38:41.018202 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:38:41.018202 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:38:41.018202 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:38:41.018202 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:38:41.018202 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:38:41.018202 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:38:41.018202 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:38:41.018202 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:38:41.018202 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 03:38:41.018202 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 03:38:41.018202 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 03:38:41.018202 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 03:38:41.018202 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 03:38:41.024257 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 03:38:41.024257 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 19 03:38:41.024257 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:38:41.024257 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:38:41.024257 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:38:41.024257 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:38:41.024257 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:38:41.024257 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:38:41.024257 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 03:38:41.024257 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 03:38:41.024257 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 19 03:38:41.024257 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:38:41.026299 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-484d1cd0-8902-4abe-a0e2-a5a224ccefa6 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:38:41.028678 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-484d1cd0-8902-4abe-a0e2-a5a224ccefa6 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.029597 Oct 19 03:38:41.029971 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2638/5196] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:38:40 2022] POST /compute/v2.1/servers => generated 127 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 03:38:41.048831 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-89b0af26-3b4a-4672-9380-34abefaf0e33 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:38:41.051991 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-89b0af26-3b4a-4672-9380-34abefaf0e33 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 4fab83b8-8862-4295-adb7-e2bf5462a2d9] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:38:41.064471 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-89b0af26-3b4a-4672-9380-34abefaf0e33 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:41.065249 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-89b0af26-3b4a-4672-9380-34abefaf0e33 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:41.069124 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-89b0af26-3b4a-4672-9380-34abefaf0e33 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:41.069124 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-89b0af26-3b4a-4672-9380-34abefaf0e33 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:41.070337 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-89b0af26-3b4a-4672-9380-34abefaf0e33 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:41.073760 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-89b0af26-3b4a-4672-9380-34abefaf0e33 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:41.231527 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-282258bc-ae99-4a3e-8e55-531c5aaf04aa tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:38:41.255188 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-282258bc-ae99-4a3e-8e55-531c5aaf04aa tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/c6045b08-8c91-4cdb-be37-c079e7ffe23a" status: 200 len: 1315 microversion: 2.1 time: 0.582305 Oct 19 03:38:41.256316 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2559/5197] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:38:40 2022] GET /compute/v2.1/servers/c6045b08-8c91-4cdb-be37-c079e7ffe23a => generated 1315 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:38:41.265176 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f6a5fc38-815a-4517-87df-d40095a0e630 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:38:41.266073 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f6a5fc38-815a-4517-87df-d40095a0e630 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:38:41.276352 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f6a5fc38-815a-4517-87df-d40095a0e630 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:41.277884 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f6a5fc38-815a-4517-87df-d40095a0e630 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:41.280258 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f6a5fc38-815a-4517-87df-d40095a0e630 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:41.283167 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f6a5fc38-815a-4517-87df-d40095a0e630 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:41.283721 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f6a5fc38-815a-4517-87df-d40095a0e630 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:41.284385 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f6a5fc38-815a-4517-87df-d40095a0e630 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:41.434071 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:38:41.681681 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-89b0af26-3b4a-4672-9380-34abefaf0e33 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4729a0afd69480f99642266e0eec17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce5e9f9a4644b27a24b2f4c06df97bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:38:41.696038 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-89b0af26-3b4a-4672-9380-34abefaf0e33 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/4fab83b8-8862-4295-adb7-e2bf5462a2d9" status: 200 len: 1734 microversion: 2.1 time: 0.656121 Oct 19 03:38:41.697002 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2639/5198] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:38:41 2022] GET /compute/v2.1/servers/4fab83b8-8862-4295-adb7-e2bf5462a2d9 => generated 1734 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:38:41.712737 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-f6a5fc38-815a-4517-87df-d40095a0e630 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:38:41.713703 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-bd0ee286-0bef-42f2-b72a-2895187d1108 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:38:41.714852 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-bd0ee286-0bef-42f2-b72a-2895187d1108 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] [instance: 1f354001-86ee-4951-a9cb-23fcd9e678a9] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:38:41.734885 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f6a5fc38-815a-4517-87df-d40095a0e630 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1506 microversion: 2.1 time: 0.477250 Oct 19 03:38:41.739547 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2560/5199] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:38:41 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1506 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:38:41.761359 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0612c623-70b1-4b92-af77-1e1dd1af9a13 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:38:41.762396 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0612c623-70b1-4b92-af77-1e1dd1af9a13 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:38:41.771265 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0612c623-70b1-4b92-af77-1e1dd1af9a13 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:41.772167 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0612c623-70b1-4b92-af77-1e1dd1af9a13 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:41.772853 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0612c623-70b1-4b92-af77-1e1dd1af9a13 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:41.774804 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0612c623-70b1-4b92-af77-1e1dd1af9a13 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:41.775504 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0612c623-70b1-4b92-af77-1e1dd1af9a13 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:41.776147 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0612c623-70b1-4b92-af77-1e1dd1af9a13 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:41.823400 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-bd0ee286-0bef-42f2-b72a-2895187d1108 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c65a497e16e4e41b5cf1287042f3a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4001edd1474947a94243a620a6013a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:38:41.837982 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-bd0ee286-0bef-42f2-b72a-2895187d1108 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] 10.222.0.52 "GET /compute/v2.1/servers/1f354001-86ee-4951-a9cb-23fcd9e678a9" status: 200 len: 1236 microversion: 2.1 time: 0.135393 Oct 19 03:38:41.839511 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2640/5200] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:38:41 2022] GET /compute/v2.1/servers/1f354001-86ee-4951-a9cb-23fcd9e678a9 => generated 1236 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:38:42.282361 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b7798108-e280-4ca9-baee-68a65ea3dd3d tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:38:42.283726 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b7798108-e280-4ca9-baee-68a65ea3dd3d tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: c6045b08-8c91-4cdb-be37-c079e7ffe23a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:38:42.297071 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b7798108-e280-4ca9-baee-68a65ea3dd3d tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:42.297936 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b7798108-e280-4ca9-baee-68a65ea3dd3d tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:42.298621 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b7798108-e280-4ca9-baee-68a65ea3dd3d tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:42.299643 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0612c623-70b1-4b92-af77-1e1dd1af9a13 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:38:42.300667 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b7798108-e280-4ca9-baee-68a65ea3dd3d tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:42.302357 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b7798108-e280-4ca9-baee-68a65ea3dd3d tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:42.303512 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b7798108-e280-4ca9-baee-68a65ea3dd3d tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:42.314522 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0612c623-70b1-4b92-af77-1e1dd1af9a13 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1506 microversion: 2.1 time: 0.556605 Oct 19 03:38:42.315187 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2561/5201] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:38:41 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1506 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:38:42.725213 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5820219d-cf47-4007-9ead-8afa70d24ac1 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:38:42.725807 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5820219d-cf47-4007-9ead-8afa70d24ac1 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 4fab83b8-8862-4295-adb7-e2bf5462a2d9] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:38:42.736093 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5820219d-cf47-4007-9ead-8afa70d24ac1 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:42.737088 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5820219d-cf47-4007-9ead-8afa70d24ac1 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:42.737748 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5820219d-cf47-4007-9ead-8afa70d24ac1 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:42.739309 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5820219d-cf47-4007-9ead-8afa70d24ac1 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:42.739948 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5820219d-cf47-4007-9ead-8afa70d24ac1 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:42.740952 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5820219d-cf47-4007-9ead-8afa70d24ac1 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:42.746762 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:38:42.810730 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b7798108-e280-4ca9-baee-68a65ea3dd3d tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:38:42.833597 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b7798108-e280-4ca9-baee-68a65ea3dd3d tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/c6045b08-8c91-4cdb-be37-c079e7ffe23a" status: 200 len: 1315 microversion: 2.1 time: 0.555237 Oct 19 03:38:42.834590 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2641/5202] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:38:42 2022] GET /compute/v2.1/servers/c6045b08-8c91-4cdb-be37-c079e7ffe23a => generated 1315 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:38:42.866361 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-283a8ed6-9730-4d8c-a80b-b7140e9395b7 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:38:42.867263 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-283a8ed6-9730-4d8c-a80b-b7140e9395b7 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] [instance: 1f354001-86ee-4951-a9cb-23fcd9e678a9] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:38:42.874481 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-283a8ed6-9730-4d8c-a80b-b7140e9395b7 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:42.875284 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-283a8ed6-9730-4d8c-a80b-b7140e9395b7 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:42.876357 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-283a8ed6-9730-4d8c-a80b-b7140e9395b7 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:42.877298 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-283a8ed6-9730-4d8c-a80b-b7140e9395b7 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:42.877988 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-283a8ed6-9730-4d8c-a80b-b7140e9395b7 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:42.878760 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-283a8ed6-9730-4d8c-a80b-b7140e9395b7 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:43.103748 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-283a8ed6-9730-4d8c-a80b-b7140e9395b7 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c65a497e16e4e41b5cf1287042f3a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4001edd1474947a94243a620a6013a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:38:43.121508 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-283a8ed6-9730-4d8c-a80b-b7140e9395b7 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] 10.222.0.52 "GET /compute/v2.1/servers/1f354001-86ee-4951-a9cb-23fcd9e678a9" status: 200 len: 1232 microversion: 2.1 time: 0.260297 Oct 19 03:38:43.125855 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2642/5203] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:38:42 2022] GET /compute/v2.1/servers/1f354001-86ee-4951-a9cb-23fcd9e678a9 => generated 1232 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:38:43.687365 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5820219d-cf47-4007-9ead-8afa70d24ac1 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4729a0afd69480f99642266e0eec17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce5e9f9a4644b27a24b2f4c06df97bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:38:43.704914 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5820219d-cf47-4007-9ead-8afa70d24ac1 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/4fab83b8-8862-4295-adb7-e2bf5462a2d9" status: 200 len: 1734 microversion: 2.1 time: 0.981727 Oct 19 03:38:43.706221 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2562/5204] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:38:42 2022] GET /compute/v2.1/servers/4fab83b8-8862-4295-adb7-e2bf5462a2d9 => generated 1734 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:38:43.858858 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-969670cb-52f2-411e-871f-ab1a63dc2fe2 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:38:43.859456 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-969670cb-52f2-411e-871f-ab1a63dc2fe2 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: c6045b08-8c91-4cdb-be37-c079e7ffe23a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:38:43.883206 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-969670cb-52f2-411e-871f-ab1a63dc2fe2 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:43.884219 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-969670cb-52f2-411e-871f-ab1a63dc2fe2 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:43.884951 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-969670cb-52f2-411e-871f-ab1a63dc2fe2 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:43.889238 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-969670cb-52f2-411e-871f-ab1a63dc2fe2 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:43.890075 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-969670cb-52f2-411e-871f-ab1a63dc2fe2 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:43.890723 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-969670cb-52f2-411e-871f-ab1a63dc2fe2 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:44.164524 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c777cd69-a142-4d17-97db-dd5540240b40 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:38:44.179698 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c777cd69-a142-4d17-97db-dd5540240b40 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] [instance: 1f354001-86ee-4951-a9cb-23fcd9e678a9] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:38:44.189856 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c777cd69-a142-4d17-97db-dd5540240b40 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:44.193752 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c777cd69-a142-4d17-97db-dd5540240b40 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:44.199263 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c777cd69-a142-4d17-97db-dd5540240b40 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:44.202220 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c777cd69-a142-4d17-97db-dd5540240b40 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:44.208199 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c777cd69-a142-4d17-97db-dd5540240b40 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:44.210165 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c777cd69-a142-4d17-97db-dd5540240b40 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:45.072801 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c777cd69-a142-4d17-97db-dd5540240b40 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c65a497e16e4e41b5cf1287042f3a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4001edd1474947a94243a620a6013a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:38:45.101307 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c777cd69-a142-4d17-97db-dd5540240b40 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] 10.222.0.52 "GET /compute/v2.1/servers/1f354001-86ee-4951-a9cb-23fcd9e678a9" status: 200 len: 1296 microversion: 2.1 time: 0.946270 Oct 19 03:38:45.116491 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2563/5205] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:38:44 2022] GET /compute/v2.1/servers/1f354001-86ee-4951-a9cb-23fcd9e678a9 => generated 1296 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:38:45.128636 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-48077ec8-1c0a-4449-b847-3eee88da6a00 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:38:45.129652 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-48077ec8-1c0a-4449-b847-3eee88da6a00 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 4fab83b8-8862-4295-adb7-e2bf5462a2d9] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:38:45.137734 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-48077ec8-1c0a-4449-b847-3eee88da6a00 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:45.138556 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-48077ec8-1c0a-4449-b847-3eee88da6a00 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:45.143072 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-48077ec8-1c0a-4449-b847-3eee88da6a00 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:45.143072 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-48077ec8-1c0a-4449-b847-3eee88da6a00 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:45.143072 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-48077ec8-1c0a-4449-b847-3eee88da6a00 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:45.143072 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-48077ec8-1c0a-4449-b847-3eee88da6a00 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:45.291895 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-969670cb-52f2-411e-871f-ab1a63dc2fe2 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:38:45.310675 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-969670cb-52f2-411e-871f-ab1a63dc2fe2 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/c6045b08-8c91-4cdb-be37-c079e7ffe23a" status: 200 len: 1315 microversion: 2.1 time: 1.455832 Oct 19 03:38:45.311529 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2643/5206] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:38:43 2022] GET /compute/v2.1/servers/c6045b08-8c91-4cdb-be37-c079e7ffe23a => generated 1315 bytes in 1457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:38:45.744928 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-48077ec8-1c0a-4449-b847-3eee88da6a00 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4729a0afd69480f99642266e0eec17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce5e9f9a4644b27a24b2f4c06df97bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:38:45.768129 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-48077ec8-1c0a-4449-b847-3eee88da6a00 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/4fab83b8-8862-4295-adb7-e2bf5462a2d9" status: 200 len: 1734 microversion: 2.1 time: 0.650211 Oct 19 03:38:45.769854 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2564/5207] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:38:45 2022] GET /compute/v2.1/servers/4fab83b8-8862-4295-adb7-e2bf5462a2d9 => generated 1734 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:38:46.116099 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e0280954-ba41-4d93-9463-4a25449c6301 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-671743220", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "fb336648-79d5-429a-9639-735666d5fc11", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "3ecd8896-b7a4-4c3a-b3cd-dc6769233813"}]}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:38:46.133300 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5cd16dec-efe7-416a-9d8e-71be71a08ad6 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:38:46.133977 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5cd16dec-efe7-416a-9d8e-71be71a08ad6 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] [instance: 1f354001-86ee-4951-a9cb-23fcd9e678a9] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:38:46.143279 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5cd16dec-efe7-416a-9d8e-71be71a08ad6 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:46.145715 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5cd16dec-efe7-416a-9d8e-71be71a08ad6 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:46.146711 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5cd16dec-efe7-416a-9d8e-71be71a08ad6 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:46.147297 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5cd16dec-efe7-416a-9d8e-71be71a08ad6 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:46.149540 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5cd16dec-efe7-416a-9d8e-71be71a08ad6 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:46.150161 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5cd16dec-efe7-416a-9d8e-71be71a08ad6 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:46.267024 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-e0280954-ba41-4d93-9463-4a25449c6301 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] HTTP exception thrown: Block Device fb336648-79d5-429a-9639-735666d5fc11 is not bootable. Oct 19 03:38:46.281922 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e0280954-ba41-4d93-9463-4a25449c6301 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Request method failure captured: Oct 19 03:38:46.281922 n-d-861333-8 devstack@n-api.service[121135]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 19 03:38:46.281922 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:38:46.281922 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:38:46.281922 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:38:46.281922 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 357 Oct 19 03:38:46.281922 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:38:46.281922 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:38:46.281922 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:38:46.281922 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:38:46.281922 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT3EK4yDar5R5kGdpWRPopK281fOgxjiWCAZdy3tbDZzFYZxrN53hSsTq0YyAxsfcVRT4cF0jU61e6walOKxMx_njT0L3WOIYEymBjzmNzdXOa-UhYNf83BpQOShCJts2aNodNdu7YjeLcAcuRF0ZOjoH0xsH4HoNSzc8IfQzKhRz4vw Oct 19 03:38:46.281922 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:38:46.281922 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:38:46.281922 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:38:46.281922 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:38:46.281922 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:38:46.281922 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:38:46.281922 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 34bd94983fbf4a8aa49aff65c076e9e3 Oct 19 03:38:46.281922 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:38:46.281922 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:38:46.281922 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:38:46.281922 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_34bd94983fbf4a8aa49aff65c076e9e3", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:38:46.281922 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:38:46.281922 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 34bd94983fbf4a8aa49aff65c076e9e3 Oct 19 03:38:46.281922 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:38:46.281922 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ServersNegativeTestJSON-553742303-project Oct 19 03:38:46.281922 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:38:46.281922 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:38:46.281922 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 771feb133bc046588552d3af98f8e0a1 Oct 19 03:38:46.281922 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ServersNegativeTestJSON-553742303-project Oct 19 03:38:46.281922 n-d-861333-8 devstack@n-api.service[121135]: Oct 19 03:38:46.281922 n-d-861333-8 devstack@n-api.service[121135]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-671743220", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "fb336648-79d5-429a-9639-735666d5fc11", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "3ecd8896-b7a4-4c3a-b3cd-dc6769233813"}]}} Oct 19 03:38:46.281922 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:38:46.281922 n-d-861333-8 devstack@n-api.service[121135]: exception: Block Device fb336648-79d5-429a-9639-735666d5fc11 is not bootable. Oct 19 03:38:46.281922 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-671743220', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': 'fb336648-79d5-429a-9639-735666d5fc11'}], 'networks': [{'uuid': '3ecd8896-b7a4-4c3a-b3cd-dc6769233813'}]}}} Oct 19 03:38:46.281922 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:38:46.281922 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:38:46.281922 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 19 03:38:46.281922 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 19 03:38:46.281922 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 19 03:38:46.281922 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 19 03:38:46.281922 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Oct 19 03:38:46.281922 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Oct 19 03:38:46.281922 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Oct 19 03:38:46.281922 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Oct 19 03:38:46.281922 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device fb336648-79d5-429a-9639-735666d5fc11 is not bootable. Oct 19 03:38:46.281922 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:38:46.281922 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:38:46.281922 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:38:46.281922 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:38:46.281922 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:38:46.281922 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:38:46.281922 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:38:46.281922 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:38:46.281922 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:38:46.281922 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:38:46.281922 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:38:46.281922 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:38:46.281922 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:38:46.289019 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:38:46.289019 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:38:46.289019 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:38:46.289019 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 19 03:38:46.289019 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 19 03:38:46.289019 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 19 03:38:46.289019 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device fb336648-79d5-429a-9639-735666d5fc11 is not bootable. Oct 19 03:38:46.289019 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:38:46.289019 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:38:46.289019 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:38:46.289019 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:38:46.289019 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:38:46.289019 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:38:46.289019 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:38:46.289019 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:38:46.289019 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device fb336648-79d5-429a-9639-735666d5fc11 is not bootable. Oct 19 03:38:46.289019 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:38:46.289019 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e0280954-ba41-4d93-9463-4a25449c6301 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Returning 400 to user: Block Device fb336648-79d5-429a-9639-735666d5fc11 is not bootable. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:38:46.289019 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e0280954-ba41-4d93-9463-4a25449c6301 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.176342 Oct 19 03:38:46.289019 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2644/5208] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:38:46 2022] POST /compute/v2.1/servers => generated 110 bytes in 178 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 03:38:46.298844 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a1ebc323-14fa-4beb-a088-67e705753001 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:38:46.306276 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a1ebc323-14fa-4beb-a088-67e705753001 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:38:46.314320 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a1ebc323-14fa-4beb-a088-67e705753001 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:46.314835 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a1ebc323-14fa-4beb-a088-67e705753001 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:46.316036 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a1ebc323-14fa-4beb-a088-67e705753001 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:46.318308 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a1ebc323-14fa-4beb-a088-67e705753001 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:46.320224 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a1ebc323-14fa-4beb-a088-67e705753001 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:46.321332 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a1ebc323-14fa-4beb-a088-67e705753001 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:46.351967 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5cd16dec-efe7-416a-9d8e-71be71a08ad6 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c65a497e16e4e41b5cf1287042f3a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4001edd1474947a94243a620a6013a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:38:46.374390 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5cd16dec-efe7-416a-9d8e-71be71a08ad6 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] 10.222.0.52 "GET /compute/v2.1/servers/1f354001-86ee-4951-a9cb-23fcd9e678a9" status: 200 len: 1294 microversion: 2.1 time: 0.245914 Oct 19 03:38:46.376792 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2565/5209] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:38:46 2022] GET /compute/v2.1/servers/1f354001-86ee-4951-a9cb-23fcd9e678a9 => generated 1294 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:38:46.406468 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e8d75b09-6b34-4d1e-88e1-c7f813c15a4b tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:38:46.409034 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e8d75b09-6b34-4d1e-88e1-c7f813c15a4b tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: c6045b08-8c91-4cdb-be37-c079e7ffe23a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:38:46.427225 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e8d75b09-6b34-4d1e-88e1-c7f813c15a4b tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:46.432619 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e8d75b09-6b34-4d1e-88e1-c7f813c15a4b tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:46.433050 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e8d75b09-6b34-4d1e-88e1-c7f813c15a4b tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:46.439369 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e8d75b09-6b34-4d1e-88e1-c7f813c15a4b tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:46.439369 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e8d75b09-6b34-4d1e-88e1-c7f813c15a4b tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:46.439369 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e8d75b09-6b34-4d1e-88e1-c7f813c15a4b tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:47.054077 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a1ebc323-14fa-4beb-a088-67e705753001 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:38:47.055796 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e8d75b09-6b34-4d1e-88e1-c7f813c15a4b tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:38:47.066705 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e8d75b09-6b34-4d1e-88e1-c7f813c15a4b tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/c6045b08-8c91-4cdb-be37-c079e7ffe23a" status: 200 len: 1315 microversion: 2.1 time: 0.685090 Oct 19 03:38:47.083430 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2566/5210] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:38:46 2022] GET /compute/v2.1/servers/c6045b08-8c91-4cdb-be37-c079e7ffe23a => generated 1315 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:38:47.089643 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-79d31130-ecce-4e19-9826-11f9b7afc09a tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:38:47.090883 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-79d31130-ecce-4e19-9826-11f9b7afc09a tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 4fab83b8-8862-4295-adb7-e2bf5462a2d9] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:38:47.098695 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-79d31130-ecce-4e19-9826-11f9b7afc09a tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:47.101267 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-79d31130-ecce-4e19-9826-11f9b7afc09a tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:47.101267 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-79d31130-ecce-4e19-9826-11f9b7afc09a tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:47.101267 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-79d31130-ecce-4e19-9826-11f9b7afc09a tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:47.102110 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-79d31130-ecce-4e19-9826-11f9b7afc09a tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:47.102736 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-79d31130-ecce-4e19-9826-11f9b7afc09a tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:47.104118 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a1ebc323-14fa-4beb-a088-67e705753001 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1506 microversion: 2.1 time: 0.806792 Oct 19 03:38:47.107263 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2645/5211] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:38:46 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1506 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:38:47.135150 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a6fa8b04-5b17-4dfd-b9f1-fee8ed3e143a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:38:47.136631 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a6fa8b04-5b17-4dfd-b9f1-fee8ed3e143a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:38:47.146782 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a6fa8b04-5b17-4dfd-b9f1-fee8ed3e143a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:47.147557 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a6fa8b04-5b17-4dfd-b9f1-fee8ed3e143a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:47.148204 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a6fa8b04-5b17-4dfd-b9f1-fee8ed3e143a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:47.162834 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a6fa8b04-5b17-4dfd-b9f1-fee8ed3e143a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:47.174397 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a6fa8b04-5b17-4dfd-b9f1-fee8ed3e143a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:47.174397 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a6fa8b04-5b17-4dfd-b9f1-fee8ed3e143a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:47.527928 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-79d31130-ecce-4e19-9826-11f9b7afc09a tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4729a0afd69480f99642266e0eec17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce5e9f9a4644b27a24b2f4c06df97bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:38:47.542398 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-79d31130-ecce-4e19-9826-11f9b7afc09a tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/4fab83b8-8862-4295-adb7-e2bf5462a2d9" status: 200 len: 1734 microversion: 2.1 time: 0.451457 Oct 19 03:38:47.542398 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2567/5212] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:38:47 2022] GET /compute/v2.1/servers/4fab83b8-8862-4295-adb7-e2bf5462a2d9 => generated 1734 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:38:47.555281 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-09dff76d-658b-4897-b7c7-1a756d468cd8 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:38:47.556022 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-09dff76d-658b-4897-b7c7-1a756d468cd8 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] [instance: 1f354001-86ee-4951-a9cb-23fcd9e678a9] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:38:47.588397 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-09dff76d-658b-4897-b7c7-1a756d468cd8 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:47.588999 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-09dff76d-658b-4897-b7c7-1a756d468cd8 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:47.589724 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-09dff76d-658b-4897-b7c7-1a756d468cd8 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:47.590907 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-09dff76d-658b-4897-b7c7-1a756d468cd8 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:47.591635 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-09dff76d-658b-4897-b7c7-1a756d468cd8 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:47.592266 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-09dff76d-658b-4897-b7c7-1a756d468cd8 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:47.593352 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a6fa8b04-5b17-4dfd-b9f1-fee8ed3e143a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:38:47.604805 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a6fa8b04-5b17-4dfd-b9f1-fee8ed3e143a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1506 microversion: 2.1 time: 0.475714 Oct 19 03:38:47.617419 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2646/5213] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:38:47 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1506 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:38:48.091892 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-413c681b-0cd4-4c20-abe2-e89582bf84ef tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:38:48.092826 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-413c681b-0cd4-4c20-abe2-e89582bf84ef tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: c6045b08-8c91-4cdb-be37-c079e7ffe23a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:38:48.112887 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-413c681b-0cd4-4c20-abe2-e89582bf84ef tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:48.115230 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-413c681b-0cd4-4c20-abe2-e89582bf84ef tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:48.119849 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-413c681b-0cd4-4c20-abe2-e89582bf84ef tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:48.120695 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-413c681b-0cd4-4c20-abe2-e89582bf84ef tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:48.121143 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-413c681b-0cd4-4c20-abe2-e89582bf84ef tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:48.121649 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-413c681b-0cd4-4c20-abe2-e89582bf84ef tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:48.574777 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-09dff76d-658b-4897-b7c7-1a756d468cd8 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c65a497e16e4e41b5cf1287042f3a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4001edd1474947a94243a620a6013a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:38:48.586057 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-09dff76d-658b-4897-b7c7-1a756d468cd8 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] 10.222.0.52 "GET /compute/v2.1/servers/1f354001-86ee-4951-a9cb-23fcd9e678a9" status: 200 len: 1361 microversion: 2.1 time: 1.047282 Oct 19 03:38:48.592695 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2568/5214] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:38:47 2022] GET /compute/v2.1/servers/1f354001-86ee-4951-a9cb-23fcd9e678a9 => generated 1361 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:38:48.606033 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-36aacd7c-df51-4597-860d-14ce0c8de6f8 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:38:48.606033 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-36aacd7c-df51-4597-860d-14ce0c8de6f8 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 4fab83b8-8862-4295-adb7-e2bf5462a2d9] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:38:48.619396 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-36aacd7c-df51-4597-860d-14ce0c8de6f8 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:48.619808 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-36aacd7c-df51-4597-860d-14ce0c8de6f8 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:48.628122 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-36aacd7c-df51-4597-860d-14ce0c8de6f8 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:48.628122 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-36aacd7c-df51-4597-860d-14ce0c8de6f8 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:48.628122 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-36aacd7c-df51-4597-860d-14ce0c8de6f8 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:48.628122 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-36aacd7c-df51-4597-860d-14ce0c8de6f8 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:48.867926 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-413c681b-0cd4-4c20-abe2-e89582bf84ef tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:38:48.867926 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:38:48.872906 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-413c681b-0cd4-4c20-abe2-e89582bf84ef tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/c6045b08-8c91-4cdb-be37-c079e7ffe23a" status: 200 len: 1315 microversion: 2.1 time: 0.787938 Oct 19 03:38:48.887619 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2647/5215] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:38:48 2022] GET /compute/v2.1/servers/c6045b08-8c91-4cdb-be37-c079e7ffe23a => generated 1315 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:38:49.443334 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-36aacd7c-df51-4597-860d-14ce0c8de6f8 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4729a0afd69480f99642266e0eec17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce5e9f9a4644b27a24b2f4c06df97bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:38:49.484005 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-36aacd7c-df51-4597-860d-14ce0c8de6f8 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/4fab83b8-8862-4295-adb7-e2bf5462a2d9" status: 200 len: 1734 microversion: 2.1 time: 0.892831 Oct 19 03:38:49.500907 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2569/5216] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:38:48 2022] GET /compute/v2.1/servers/4fab83b8-8862-4295-adb7-e2bf5462a2d9 => generated 1734 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:38:49.622645 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a71bfb31-1a68-45a0-89df-8d310848a171 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:38:49.623155 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a71bfb31-1a68-45a0-89df-8d310848a171 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] [instance: 1f354001-86ee-4951-a9cb-23fcd9e678a9] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:38:49.636874 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a71bfb31-1a68-45a0-89df-8d310848a171 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:49.637400 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a71bfb31-1a68-45a0-89df-8d310848a171 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:49.638071 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a71bfb31-1a68-45a0-89df-8d310848a171 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:49.653350 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a71bfb31-1a68-45a0-89df-8d310848a171 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:49.653883 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a71bfb31-1a68-45a0-89df-8d310848a171 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:49.660479 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a71bfb31-1a68-45a0-89df-8d310848a171 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:49.918201 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-da584e4e-1a26-44fa-a0b0-7829b605e676 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:38:49.919031 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-da584e4e-1a26-44fa-a0b0-7829b605e676 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: c6045b08-8c91-4cdb-be37-c079e7ffe23a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:38:49.939639 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-da584e4e-1a26-44fa-a0b0-7829b605e676 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:49.940193 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-da584e4e-1a26-44fa-a0b0-7829b605e676 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:49.940672 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-da584e4e-1a26-44fa-a0b0-7829b605e676 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:49.943790 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-da584e4e-1a26-44fa-a0b0-7829b605e676 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:49.944259 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-da584e4e-1a26-44fa-a0b0-7829b605e676 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:49.946461 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-da584e4e-1a26-44fa-a0b0-7829b605e676 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:50.098686 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:38:50.611944 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a71bfb31-1a68-45a0-89df-8d310848a171 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c65a497e16e4e41b5cf1287042f3a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4001edd1474947a94243a620a6013a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:38:50.626693 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a71bfb31-1a68-45a0-89df-8d310848a171 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] 10.222.0.52 "GET /compute/v2.1/servers/1f354001-86ee-4951-a9cb-23fcd9e678a9" status: 200 len: 1361 microversion: 2.1 time: 1.010358 Oct 19 03:38:50.640789 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2648/5217] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:38:49 2022] GET /compute/v2.1/servers/1f354001-86ee-4951-a9cb-23fcd9e678a9 => generated 1361 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:38:50.641131 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=12 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:38:50.663121 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-bfe10a78-672a-48a9-bbd0-07da5eaf2227 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:38:50.663809 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-bfe10a78-672a-48a9-bbd0-07da5eaf2227 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 4fab83b8-8862-4295-adb7-e2bf5462a2d9] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:38:50.678420 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bfe10a78-672a-48a9-bbd0-07da5eaf2227 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:50.686392 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bfe10a78-672a-48a9-bbd0-07da5eaf2227 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:50.686392 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bfe10a78-672a-48a9-bbd0-07da5eaf2227 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:50.686392 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bfe10a78-672a-48a9-bbd0-07da5eaf2227 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:50.686392 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bfe10a78-672a-48a9-bbd0-07da5eaf2227 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:50.686392 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bfe10a78-672a-48a9-bbd0-07da5eaf2227 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:50.828929 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-da584e4e-1a26-44fa-a0b0-7829b605e676 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:38:50.854484 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-da584e4e-1a26-44fa-a0b0-7829b605e676 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/c6045b08-8c91-4cdb-be37-c079e7ffe23a" status: 200 len: 1315 microversion: 2.1 time: 0.946710 Oct 19 03:38:50.859501 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2570/5218] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:38:49 2022] GET /compute/v2.1/servers/c6045b08-8c91-4cdb-be37-c079e7ffe23a => generated 1315 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:38:51.235198 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-2d2a1cb4-2f24-4f74-a430-bae350745280 req-0a46e74f-8aa0-4f96-b05c-b11f0a8af3e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6045b08-8c91-4cdb-be37-c079e7ffe23a", "name": "network-vif-plugged", "status": "completed", "tag": "4e2605b6-c38c-4154-93ae-04ca20dd249c"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:38:51.272092 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-2d2a1cb4-2f24-4f74-a430-bae350745280 req-0a46e74f-8aa0-4f96-b05c-b11f0a8af3e2 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:51.273412 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-2d2a1cb4-2f24-4f74-a430-bae350745280 req-0a46e74f-8aa0-4f96-b05c-b11f0a8af3e2 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:51.274990 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-2d2a1cb4-2f24-4f74-a430-bae350745280 req-0a46e74f-8aa0-4f96-b05c-b11f0a8af3e2 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:51.305889 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-2d2a1cb4-2f24-4f74-a430-bae350745280 req-0a46e74f-8aa0-4f96-b05c-b11f0a8af3e2 service nova] Creating event network-vif-plugged:4e2605b6-c38c-4154-93ae-04ca20dd249c for instance c6045b08-8c91-4cdb-be37-c079e7ffe23a on n-h1-861333-8 Oct 19 03:38:51.313658 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-2d2a1cb4-2f24-4f74-a430-bae350745280 req-0a46e74f-8aa0-4f96-b05c-b11f0a8af3e2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.380808 Oct 19 03:38:51.314280 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2571/5219] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:38:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:38:51.330807 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4700ac75-c6d8-437c-be95-522fdc013970 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-961061215", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "9e16d73e-70ea-4421-aee3-047d80396c02", "destination_type": "local"}, {"source_type": "volume", "uuid": "6caf9da9-a131-48b0-80ce-1383c5df4eaa", "destination_type": "invalid"}], "networks": [{"uuid": "3ecd8896-b7a4-4c3a-b3cd-dc6769233813"}]}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:38:51.343024 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4700ac75-c6d8-437c-be95-522fdc013970 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Request method failure captured: Oct 19 03:38:51.343024 n-d-861333-8 devstack@n-api.service[121134]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 19 03:38:51.343024 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:38:51.343024 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:38:51.343024 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:38:51.343024 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 494 Oct 19 03:38:51.343024 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:38:51.343024 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:38:51.343024 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:38:51.343024 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:38:51.343024 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3EK4yDar5R5kGdpWRPopK281fOgxjiWCAZdy3tbDZzFYZxrN53hSsTq0YyAxsfcVRT4cF0jU61e6walOKxMx_njT0L3WOIYEymBjzmNzdXOa-UhYNf83BpQOShCJts2aNodNdu7YjeLcAcuRF0ZOjoH0xsH4HoNSzc8IfQzKhRz4vw Oct 19 03:38:51.343024 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:38:51.343024 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:38:51.343024 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:38:51.343024 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:38:51.343024 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:38:51.343024 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:38:51.343024 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 34bd94983fbf4a8aa49aff65c076e9e3 Oct 19 03:38:51.343024 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:38:51.343024 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:38:51.343024 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:38:51.343024 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_34bd94983fbf4a8aa49aff65c076e9e3", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:38:51.343024 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:38:51.343024 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 34bd94983fbf4a8aa49aff65c076e9e3 Oct 19 03:38:51.343024 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:38:51.343024 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ServersNegativeTestJSON-553742303-project Oct 19 03:38:51.343024 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:38:51.343024 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:38:51.343024 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 771feb133bc046588552d3af98f8e0a1 Oct 19 03:38:51.343024 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ServersNegativeTestJSON-553742303-project Oct 19 03:38:51.343024 n-d-861333-8 devstack@n-api.service[121134]: Oct 19 03:38:51.343024 n-d-861333-8 devstack@n-api.service[121134]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-961061215", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "9e16d73e-70ea-4421-aee3-047d80396c02", "destination_type": "local"}, {"source_type": "volume", "uuid": "6caf9da9-a131-48b0-80ce-1383c5df4eaa", "destination_type": "invalid"}], "networks": [{"uuid": "3ecd8896-b7a4-4c3a-b3cd-dc6769233813"}]}} Oct 19 03:38:51.343024 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:38:51.343024 n-d-861333-8 devstack@n-api.service[121134]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 19 03:38:51.343024 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-961061215', 'imageRef': '9e16d73e-70ea-4421-aee3-047d80396c02', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': '9e16d73e-70ea-4421-aee3-047d80396c02', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '6caf9da9-a131-48b0-80ce-1383c5df4eaa', 'destination_type': 'invalid'}], 'networks': [{'uuid': '3ecd8896-b7a4-4c3a-b3cd-dc6769233813'}]}}} Oct 19 03:38:51.343024 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:38:51.343024 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:38:51.343024 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 03:38:51.343024 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 03:38:51.343024 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 03:38:51.343024 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise error Oct 19 03:38:51.343024 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Oct 19 03:38:51.343024 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:38:51.343024 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Oct 19 03:38:51.343024 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Oct 19 03:38:51.343024 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:38:51.343024 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Oct 19 03:38:51.343024 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi 'invalid' Oct 19 03:38:51.343024 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:38:51.343024 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:38:51.343024 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:38:51.343024 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:38:51.343024 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:38:51.343024 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:38:51.343024 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:38:51.343024 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:38:51.343024 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:38:51.343024 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:38:51.353955 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:38:51.353955 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:38:51.353955 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 03:38:51.353955 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 03:38:51.353955 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 03:38:51.353955 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 03:38:51.353955 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 03:38:51.353955 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 03:38:51.353955 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 19 03:38:51.353955 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:38:51.353955 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:38:51.353955 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:38:51.353955 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:38:51.353955 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:38:51.353955 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:38:51.353955 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 03:38:51.353955 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 03:38:51.353955 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 19 03:38:51.353955 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:38:51.353955 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4700ac75-c6d8-437c-be95-522fdc013970 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:38:51.353955 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4700ac75-c6d8-437c-be95-522fdc013970 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.025912 Oct 19 03:38:51.353955 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2572/5220] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:38:51 2022] POST /compute/v2.1/servers => generated 155 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 03:38:51.375589 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d4ef05e5-4c7b-48b8-8cdd-e09ce05dc453 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:38:51.378005 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d4ef05e5-4c7b-48b8-8cdd-e09ce05dc453 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:38:51.396901 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d4ef05e5-4c7b-48b8-8cdd-e09ce05dc453 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:51.397789 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d4ef05e5-4c7b-48b8-8cdd-e09ce05dc453 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:51.403926 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d4ef05e5-4c7b-48b8-8cdd-e09ce05dc453 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:51.404584 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d4ef05e5-4c7b-48b8-8cdd-e09ce05dc453 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:51.405031 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d4ef05e5-4c7b-48b8-8cdd-e09ce05dc453 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:51.405506 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d4ef05e5-4c7b-48b8-8cdd-e09ce05dc453 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:51.829125 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=12 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:38:51.953703 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-bfe10a78-672a-48a9-bbd0-07da5eaf2227 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4729a0afd69480f99642266e0eec17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce5e9f9a4644b27a24b2f4c06df97bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:38:51.970141 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-bfe10a78-672a-48a9-bbd0-07da5eaf2227 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/4fab83b8-8862-4295-adb7-e2bf5462a2d9" status: 200 len: 1734 microversion: 2.1 time: 1.330013 Oct 19 03:38:51.974038 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2649/5221] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:38:50 2022] GET /compute/v2.1/servers/4fab83b8-8862-4295-adb7-e2bf5462a2d9 => generated 1734 bytes in 1334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:38:51.989053 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2183e342-54ab-49a6-af56-e67edae8956c tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:38:51.992275 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-2183e342-54ab-49a6-af56-e67edae8956c tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] [instance: 1f354001-86ee-4951-a9cb-23fcd9e678a9] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:38:52.013940 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2183e342-54ab-49a6-af56-e67edae8956c tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:52.016966 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2183e342-54ab-49a6-af56-e67edae8956c tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:52.019392 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2183e342-54ab-49a6-af56-e67edae8956c tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:52.020978 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2183e342-54ab-49a6-af56-e67edae8956c tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:52.023151 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2183e342-54ab-49a6-af56-e67edae8956c tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:52.025514 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2183e342-54ab-49a6-af56-e67edae8956c tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:52.082128 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d4ef05e5-4c7b-48b8-8cdd-e09ce05dc453 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:38:52.091025 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d4ef05e5-4c7b-48b8-8cdd-e09ce05dc453 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1506 microversion: 2.1 time: 0.726717 Oct 19 03:38:52.114192 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2573/5222] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:38:51 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1506 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:38:52.132072 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-22a36653-ea02-4275-845d-f5cffe5d7ca4 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:38:52.139646 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-22a36653-ea02-4275-845d-f5cffe5d7ca4 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: c6045b08-8c91-4cdb-be37-c079e7ffe23a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:38:52.155922 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-22a36653-ea02-4275-845d-f5cffe5d7ca4 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:52.156737 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-22a36653-ea02-4275-845d-f5cffe5d7ca4 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:52.157406 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-22a36653-ea02-4275-845d-f5cffe5d7ca4 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:52.158312 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-22a36653-ea02-4275-845d-f5cffe5d7ca4 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:52.158953 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-22a36653-ea02-4275-845d-f5cffe5d7ca4 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:52.159561 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-22a36653-ea02-4275-845d-f5cffe5d7ca4 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:52.505401 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-2183e342-54ab-49a6-af56-e67edae8956c tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c65a497e16e4e41b5cf1287042f3a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4001edd1474947a94243a620a6013a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:38:52.518531 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2183e342-54ab-49a6-af56-e67edae8956c tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] 10.222.0.52 "GET /compute/v2.1/servers/1f354001-86ee-4951-a9cb-23fcd9e678a9" status: 200 len: 1361 microversion: 2.1 time: 0.542316 Oct 19 03:38:52.523221 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2650/5223] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:38:51 2022] GET /compute/v2.1/servers/1f354001-86ee-4951-a9cb-23fcd9e678a9 => generated 1361 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:38:52.528266 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-eec54ad2-1747-4d49-9115-e0e702b59cd9 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Action: 'create', calling method: .version_select at 0x7fc1301f9d30>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-418828847", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGDPqBirM3eFOpyKYIH5J61NnLNeJtkxxjUj4I+6Fxrw7+hOylfAX+EgCnWs/EVxDQ9sKYl7Oph4PWFdtj6xVTZyyhda4HV+PHQinV928Chie2p9RpYm/3pGgMPUeqXKyg=="}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:38:52.580515 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-eec54ad2-1747-4d49-9115-e0e702b59cd9 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Getting quotas for project 3bf91777fa414ddaa797d735e7d2a275. Resources: {'key_pairs'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:38:52.592705 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-eec54ad2-1747-4d49-9115-e0e702b59cd9 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Getting quotas for user 4670fd4408d4454784251a880d5a72f5 and project 3bf91777fa414ddaa797d735e7d2a275. Resources: {'key_pairs'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:38:52.634281 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:38:52.673920 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-22a36653-ea02-4275-845d-f5cffe5d7ca4 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:38:52.686466 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-22a36653-ea02-4275-845d-f5cffe5d7ca4 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/c6045b08-8c91-4cdb-be37-c079e7ffe23a" status: 200 len: 1315 microversion: 2.1 time: 0.569293 Oct 19 03:38:52.705041 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2574/5224] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:38:52 2022] GET /compute/v2.1/servers/c6045b08-8c91-4cdb-be37-c079e7ffe23a => generated 1315 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:38:52.711319 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-35543173-8cb9-488c-a81d-7446f6c0292b tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:38:52.711965 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-35543173-8cb9-488c-a81d-7446f6c0292b tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:38:52.713411 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-eec54ad2-1747-4d49-9115-e0e702b59cd9 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.188724 Oct 19 03:38:52.714341 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2651/5225] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Oct 19 03:38:52 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:38:52.723850 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-35543173-8cb9-488c-a81d-7446f6c0292b tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:52.724651 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-35543173-8cb9-488c-a81d-7446f6c0292b tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:52.736469 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-35543173-8cb9-488c-a81d-7446f6c0292b tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:52.737635 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-35543173-8cb9-488c-a81d-7446f6c0292b tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:52.742916 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-35543173-8cb9-488c-a81d-7446f6c0292b tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:52.743542 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-35543173-8cb9-488c-a81d-7446f6c0292b tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:52.986627 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-35543173-8cb9-488c-a81d-7446f6c0292b tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:38:53.001156 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d5077ba6-bb9f-4287-82fa-cdc6a6358c56 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:38:53.002883 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d5077ba6-bb9f-4287-82fa-cdc6a6358c56 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 4fab83b8-8862-4295-adb7-e2bf5462a2d9] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:38:53.004362 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-35543173-8cb9-488c-a81d-7446f6c0292b tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1506 microversion: 2.1 time: 0.297467 Oct 19 03:38:53.007827 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2575/5226] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:38:52 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1506 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:38:53.018105 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d5077ba6-bb9f-4287-82fa-cdc6a6358c56 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:53.020697 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d5077ba6-bb9f-4287-82fa-cdc6a6358c56 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:53.021760 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d5077ba6-bb9f-4287-82fa-cdc6a6358c56 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:53.023099 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d5077ba6-bb9f-4287-82fa-cdc6a6358c56 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:53.023871 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d5077ba6-bb9f-4287-82fa-cdc6a6358c56 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:53.025228 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d5077ba6-bb9f-4287-82fa-cdc6a6358c56 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:53.061149 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-0cff3fa5-a679-4e31-93e5-116b9dae443d req-c086efa7-3c3b-4ad1-9ab9-8f17f723857f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f354001-86ee-4951-a9cb-23fcd9e678a9", "tag": "df2c5d9b-837d-4ae2-918d-8eef7876b140"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:38:53.075578 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:38:53.089450 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-0cff3fa5-a679-4e31-93e5-116b9dae443d req-c086efa7-3c3b-4ad1-9ab9-8f17f723857f service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:53.089947 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-0cff3fa5-a679-4e31-93e5-116b9dae443d req-c086efa7-3c3b-4ad1-9ab9-8f17f723857f service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:53.094255 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-0cff3fa5-a679-4e31-93e5-116b9dae443d req-c086efa7-3c3b-4ad1-9ab9-8f17f723857f service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:53.120177 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-0cff3fa5-a679-4e31-93e5-116b9dae443d req-c086efa7-3c3b-4ad1-9ab9-8f17f723857f service nova] Creating event network-changed:df2c5d9b-837d-4ae2-918d-8eef7876b140 for instance 1f354001-86ee-4951-a9cb-23fcd9e678a9 on n-h2-861333-8 Oct 19 03:38:53.125093 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-0cff3fa5-a679-4e31-93e5-116b9dae443d req-c086efa7-3c3b-4ad1-9ab9-8f17f723857f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075903 Oct 19 03:38:53.126884 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2576/5227] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:38:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:38:53.133248 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-bbb8d347-ad2c-4a05-8ce0-fcdcaff17729 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1213349795", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "3ecd8896-b7a4-4c3a-b3cd-dc6769233813"}]}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:38:53.159271 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-bbb8d347-ad2c-4a05-8ce0-fcdcaff17729 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Request method failure captured: Oct 19 03:38:53.159271 n-d-861333-8 devstack@n-api.service[121134]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 19 03:38:53.159271 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:38:53.159271 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:38:53.159271 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:38:53.159271 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 492 Oct 19 03:38:53.159271 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:38:53.159271 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:38:53.159271 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:38:53.159271 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:38:53.159271 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3EK4yDar5R5kGdpWRPopK281fOgxjiWCAZdy3tbDZzFYZxrN53hSsTq0YyAxsfcVRT4cF0jU61e6walOKxMx_njT0L3WOIYEymBjzmNzdXOa-UhYNf83BpQOShCJts2aNodNdu7YjeLcAcuRF0ZOjoH0xsH4HoNSzc8IfQzKhRz4vw Oct 19 03:38:53.159271 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:38:53.159271 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:38:53.159271 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:38:53.159271 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:38:53.159271 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:38:53.159271 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:38:53.159271 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 34bd94983fbf4a8aa49aff65c076e9e3 Oct 19 03:38:53.159271 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:38:53.159271 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:38:53.159271 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:38:53.159271 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_34bd94983fbf4a8aa49aff65c076e9e3", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:38:53.159271 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:38:53.159271 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 34bd94983fbf4a8aa49aff65c076e9e3 Oct 19 03:38:53.159271 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:38:53.159271 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ServersNegativeTestJSON-553742303-project Oct 19 03:38:53.159271 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:38:53.159271 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:38:53.159271 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 771feb133bc046588552d3af98f8e0a1 Oct 19 03:38:53.159271 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ServersNegativeTestJSON-553742303-project Oct 19 03:38:53.159271 n-d-861333-8 devstack@n-api.service[121134]: Oct 19 03:38:53.159271 n-d-861333-8 devstack@n-api.service[121134]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1213349795", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "3ecd8896-b7a4-4c3a-b3cd-dc6769233813"}]}} Oct 19 03:38:53.159271 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:38:53.159271 n-d-861333-8 devstack@n-api.service[121134]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 19 03:38:53.159271 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1213349795', 'imageRef': '9e16d73e-70ea-4421-aee3-047d80396c02', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '3ecd8896-b7a4-4c3a-b3cd-dc6769233813'}]}}} Oct 19 03:38:53.159271 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:38:53.159271 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:38:53.159271 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 03:38:53.159271 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 03:38:53.159271 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 03:38:53.159271 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise error Oct 19 03:38:53.159271 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 19 03:38:53.159271 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:38:53.159271 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Oct 19 03:38:53.159271 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Oct 19 03:38:53.159271 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:38:53.159271 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Oct 19 03:38:53.164051 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Oct 19 03:38:53.164051 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:38:53.164051 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:38:53.164051 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:38:53.164051 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:38:53.164051 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:38:53.164051 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:38:53.164051 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:38:53.164051 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:38:53.164051 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:38:53.164051 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:38:53.164051 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:38:53.164051 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:38:53.164051 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 03:38:53.164051 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 03:38:53.164051 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 03:38:53.164051 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 03:38:53.164051 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 03:38:53.164051 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 03:38:53.164051 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 19 03:38:53.164051 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:38:53.164051 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:38:53.164051 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:38:53.164051 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:38:53.164051 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:38:53.164051 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:38:53.164051 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 03:38:53.164051 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 03:38:53.164051 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 19 03:38:53.164051 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:38:53.164051 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-bbb8d347-ad2c-4a05-8ce0-fcdcaff17729 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:38:53.164051 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-bbb8d347-ad2c-4a05-8ce0-fcdcaff17729 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.033226 Oct 19 03:38:53.171668 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2577/5228] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:38:53 2022] POST /compute/v2.1/servers => generated 624 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 03:38:53.181323 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-94fc5af8-6135-4dfc-a7ee-1a38be693440 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:38:53.182160 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-94fc5af8-6135-4dfc-a7ee-1a38be693440 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:38:53.197964 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-94fc5af8-6135-4dfc-a7ee-1a38be693440 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:53.204818 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-94fc5af8-6135-4dfc-a7ee-1a38be693440 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:53.204818 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-94fc5af8-6135-4dfc-a7ee-1a38be693440 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:53.204818 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-94fc5af8-6135-4dfc-a7ee-1a38be693440 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:53.204818 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-94fc5af8-6135-4dfc-a7ee-1a38be693440 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:53.204818 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-94fc5af8-6135-4dfc-a7ee-1a38be693440 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:53.544484 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d5077ba6-bb9f-4287-82fa-cdc6a6358c56 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4729a0afd69480f99642266e0eec17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce5e9f9a4644b27a24b2f4c06df97bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:38:53.554823 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d5077ba6-bb9f-4287-82fa-cdc6a6358c56 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/4fab83b8-8862-4295-adb7-e2bf5462a2d9" status: 200 len: 1734 microversion: 2.1 time: 0.557699 Oct 19 03:38:53.556000 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2652/5229] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:38:52 2022] GET /compute/v2.1/servers/4fab83b8-8862-4295-adb7-e2bf5462a2d9 => generated 1734 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:38:53.560984 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-abafa04c-fa97-4b24-b728-7ee54b618557 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:38:53.561827 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-abafa04c-fa97-4b24-b728-7ee54b618557 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] [instance: 1f354001-86ee-4951-a9cb-23fcd9e678a9] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:38:53.568916 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-abafa04c-fa97-4b24-b728-7ee54b618557 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:53.570438 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-abafa04c-fa97-4b24-b728-7ee54b618557 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:53.571071 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-abafa04c-fa97-4b24-b728-7ee54b618557 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:53.571971 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-abafa04c-fa97-4b24-b728-7ee54b618557 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:53.572611 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-abafa04c-fa97-4b24-b728-7ee54b618557 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:53.573231 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-abafa04c-fa97-4b24-b728-7ee54b618557 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:53.696676 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-94fc5af8-6135-4dfc-a7ee-1a38be693440 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:38:53.726408 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-94fc5af8-6135-4dfc-a7ee-1a38be693440 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1506 microversion: 2.1 time: 0.553516 Oct 19 03:38:53.731976 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2578/5230] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:38:53 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1506 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:38:53.742789 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5b28f8e6-4a9e-49cf-9a2b-6c06e1ec782c tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:38:53.743702 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5b28f8e6-4a9e-49cf-9a2b-6c06e1ec782c tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: c6045b08-8c91-4cdb-be37-c079e7ffe23a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:38:53.753029 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5b28f8e6-4a9e-49cf-9a2b-6c06e1ec782c tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:53.755703 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5b28f8e6-4a9e-49cf-9a2b-6c06e1ec782c tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:53.756345 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5b28f8e6-4a9e-49cf-9a2b-6c06e1ec782c tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:53.757311 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5b28f8e6-4a9e-49cf-9a2b-6c06e1ec782c tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:53.762828 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5b28f8e6-4a9e-49cf-9a2b-6c06e1ec782c tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:53.762828 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5b28f8e6-4a9e-49cf-9a2b-6c06e1ec782c tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:54.119504 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5b28f8e6-4a9e-49cf-9a2b-6c06e1ec782c tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:38:54.128707 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5b28f8e6-4a9e-49cf-9a2b-6c06e1ec782c tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/c6045b08-8c91-4cdb-be37-c079e7ffe23a" status: 200 len: 1315 microversion: 2.1 time: 0.392250 Oct 19 03:38:54.129303 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2579/5231] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:38:53 2022] GET /compute/v2.1/servers/c6045b08-8c91-4cdb-be37-c079e7ffe23a => generated 1315 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:38:54.140234 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c0b38855-b53c-4502-b75e-21d2693c08c6 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:38:54.141590 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c0b38855-b53c-4502-b75e-21d2693c08c6 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:38:54.155930 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c0b38855-b53c-4502-b75e-21d2693c08c6 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:54.157951 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c0b38855-b53c-4502-b75e-21d2693c08c6 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:54.158619 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c0b38855-b53c-4502-b75e-21d2693c08c6 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:54.161179 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c0b38855-b53c-4502-b75e-21d2693c08c6 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:54.161849 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c0b38855-b53c-4502-b75e-21d2693c08c6 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:54.162679 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c0b38855-b53c-4502-b75e-21d2693c08c6 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:54.357014 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-abafa04c-fa97-4b24-b728-7ee54b618557 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c65a497e16e4e41b5cf1287042f3a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4001edd1474947a94243a620a6013a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:38:54.366953 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-abafa04c-fa97-4b24-b728-7ee54b618557 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] 10.222.0.52 "GET /compute/v2.1/servers/1f354001-86ee-4951-a9cb-23fcd9e678a9" status: 200 len: 1361 microversion: 2.1 time: 0.809681 Oct 19 03:38:54.369014 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2653/5232] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:38:53 2022] GET /compute/v2.1/servers/1f354001-86ee-4951-a9cb-23fcd9e678a9 => generated 1361 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:38:54.574859 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c0b38855-b53c-4502-b75e-21d2693c08c6 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:38:54.586876 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b22a5cb2-19fb-4c9a-bf49-bbab58338fd4 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:38:54.593435 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b22a5cb2-19fb-4c9a-bf49-bbab58338fd4 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 4fab83b8-8862-4295-adb7-e2bf5462a2d9] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:38:54.601823 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c0b38855-b53c-4502-b75e-21d2693c08c6 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1506 microversion: 2.1 time: 0.471369 Oct 19 03:38:54.607822 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b22a5cb2-19fb-4c9a-bf49-bbab58338fd4 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:54.607822 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b22a5cb2-19fb-4c9a-bf49-bbab58338fd4 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:54.607822 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b22a5cb2-19fb-4c9a-bf49-bbab58338fd4 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:54.607822 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b22a5cb2-19fb-4c9a-bf49-bbab58338fd4 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:54.607822 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b22a5cb2-19fb-4c9a-bf49-bbab58338fd4 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:54.613631 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2580/5233] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:38:54 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1506 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:38:54.615312 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b22a5cb2-19fb-4c9a-bf49-bbab58338fd4 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:54.711353 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f43a1ff9-9830-4b13-a276-c2bc9559fb69 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "networks": [{"uuid": "3ecd8896-b7a4-4c3a-b3cd-dc6769233813"}]}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:38:54.720273 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f43a1ff9-9830-4b13-a276-c2bc9559fb69 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Request method failure captured: Oct 19 03:38:54.720273 n-d-861333-8 devstack@n-api.service[121134]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 19 03:38:54.720273 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:38:54.720273 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:38:54.720273 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:38:54.720273 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 416 Oct 19 03:38:54.720273 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:38:54.720273 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:38:54.720273 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:38:54.720273 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:38:54.720273 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3EK4yDar5R5kGdpWRPopK281fOgxjiWCAZdy3tbDZzFYZxrN53hSsTq0YyAxsfcVRT4cF0jU61e6walOKxMx_njT0L3WOIYEymBjzmNzdXOa-UhYNf83BpQOShCJts2aNodNdu7YjeLcAcuRF0ZOjoH0xsH4HoNSzc8IfQzKhRz4vw Oct 19 03:38:54.720273 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:38:54.720273 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:38:54.720273 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:38:54.720273 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:38:54.720273 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:38:54.720273 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:38:54.720273 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 34bd94983fbf4a8aa49aff65c076e9e3 Oct 19 03:38:54.720273 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:38:54.720273 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:38:54.720273 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:38:54.720273 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_34bd94983fbf4a8aa49aff65c076e9e3", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:38:54.720273 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:38:54.720273 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 34bd94983fbf4a8aa49aff65c076e9e3 Oct 19 03:38:54.720273 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:38:54.720273 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ServersNegativeTestJSON-553742303-project Oct 19 03:38:54.720273 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:38:54.720273 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:38:54.720273 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 771feb133bc046588552d3af98f8e0a1 Oct 19 03:38:54.720273 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ServersNegativeTestJSON-553742303-project Oct 19 03:38:54.720273 n-d-861333-8 devstack@n-api.service[121134]: Oct 19 03:38:54.720273 n-d-861333-8 devstack@n-api.service[121134]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "networks": [{"uuid": "3ecd8896-b7a4-4c3a-b3cd-dc6769233813"}]}} Oct 19 03:38:54.720273 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:38:54.720273 n-d-861333-8 devstack@n-api.service[121134]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 19 03:38:54.720273 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': '9e16d73e-70ea-4421-aee3-047d80396c02', 'flavorRef': '452', 'networks': [{'uuid': '3ecd8896-b7a4-4c3a-b3cd-dc6769233813'}]}}} Oct 19 03:38:54.720273 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:38:54.720273 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:38:54.720273 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 03:38:54.720273 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 03:38:54.720273 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 03:38:54.720273 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise error Oct 19 03:38:54.720273 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 19 03:38:54.720273 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:38:54.720273 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 19 03:38:54.720273 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 19 03:38:54.720273 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:38:54.720273 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 19 03:38:54.720273 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 19 03:38:54.720273 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:38:54.720273 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:38:54.724570 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:38:54.724570 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:38:54.724570 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:38:54.724570 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:38:54.724570 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:38:54.724570 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:38:54.724570 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:38:54.724570 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:38:54.724570 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:38:54.724570 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:38:54.724570 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 03:38:54.724570 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 03:38:54.724570 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 03:38:54.724570 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 03:38:54.724570 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 03:38:54.724570 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 03:38:54.724570 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 19 03:38:54.724570 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:38:54.724570 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:38:54.724570 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:38:54.724570 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:38:54.724570 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:38:54.724570 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:38:54.724570 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 03:38:54.724570 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 03:38:54.724570 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 19 03:38:54.724570 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:38:54.727966 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f43a1ff9-9830-4b13-a276-c2bc9559fb69 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:38:54.729330 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f43a1ff9-9830-4b13-a276-c2bc9559fb69 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.022976 Oct 19 03:38:54.733408 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2581/5234] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:38:54 2022] POST /compute/v2.1/servers => generated 619 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 03:38:54.747159 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a8cb4893-4a2f-496a-968c-6cf16e6c6ce0 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:38:54.747805 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a8cb4893-4a2f-496a-968c-6cf16e6c6ce0 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:38:54.766019 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a8cb4893-4a2f-496a-968c-6cf16e6c6ce0 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:54.766544 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a8cb4893-4a2f-496a-968c-6cf16e6c6ce0 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:54.768196 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a8cb4893-4a2f-496a-968c-6cf16e6c6ce0 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:54.771260 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a8cb4893-4a2f-496a-968c-6cf16e6c6ce0 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:54.774821 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a8cb4893-4a2f-496a-968c-6cf16e6c6ce0 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:54.774821 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a8cb4893-4a2f-496a-968c-6cf16e6c6ce0 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:55.119389 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b22a5cb2-19fb-4c9a-bf49-bbab58338fd4 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4729a0afd69480f99642266e0eec17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce5e9f9a4644b27a24b2f4c06df97bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:38:55.147863 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b22a5cb2-19fb-4c9a-bf49-bbab58338fd4 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/4fab83b8-8862-4295-adb7-e2bf5462a2d9" status: 200 len: 1734 microversion: 2.1 time: 0.567455 Oct 19 03:38:55.173183 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2654/5235] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:38:54 2022] GET /compute/v2.1/servers/4fab83b8-8862-4295-adb7-e2bf5462a2d9 => generated 1734 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:38:55.180265 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-10edf951-c4c9-44d1-b32b-a3ae78aad945 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:38:55.187041 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-10edf951-c4c9-44d1-b32b-a3ae78aad945 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: c6045b08-8c91-4cdb-be37-c079e7ffe23a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:38:55.196488 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-10edf951-c4c9-44d1-b32b-a3ae78aad945 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:55.197016 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-10edf951-c4c9-44d1-b32b-a3ae78aad945 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:55.197621 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-10edf951-c4c9-44d1-b32b-a3ae78aad945 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:55.198368 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-10edf951-c4c9-44d1-b32b-a3ae78aad945 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:55.198885 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-10edf951-c4c9-44d1-b32b-a3ae78aad945 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:55.199339 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-10edf951-c4c9-44d1-b32b-a3ae78aad945 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:55.250419 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a8cb4893-4a2f-496a-968c-6cf16e6c6ce0 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:38:55.265091 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a8cb4893-4a2f-496a-968c-6cf16e6c6ce0 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1506 microversion: 2.1 time: 0.524703 Oct 19 03:38:55.265091 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2582/5236] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:38:54 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1506 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:38:55.301869 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c3be3af8-ad0f-453c-87a9-81d73944d788 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:38:55.302499 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c3be3af8-ad0f-453c-87a9-81d73944d788 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:38:55.315036 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c3be3af8-ad0f-453c-87a9-81d73944d788 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:55.315557 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c3be3af8-ad0f-453c-87a9-81d73944d788 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:55.316784 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c3be3af8-ad0f-453c-87a9-81d73944d788 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:55.318928 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c3be3af8-ad0f-453c-87a9-81d73944d788 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:55.319077 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c3be3af8-ad0f-453c-87a9-81d73944d788 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:55.319433 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c3be3af8-ad0f-453c-87a9-81d73944d788 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:55.322734 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=100 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:38:55.624401 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-10edf951-c4c9-44d1-b32b-a3ae78aad945 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:38:55.640361 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-10edf951-c4c9-44d1-b32b-a3ae78aad945 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/c6045b08-8c91-4cdb-be37-c079e7ffe23a" status: 200 len: 1503 microversion: 2.1 time: 0.465849 Oct 19 03:38:55.641312 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2655/5237] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:38:55 2022] GET /compute/v2.1/servers/c6045b08-8c91-4cdb-be37-c079e7ffe23a => generated 1503 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:38:55.653592 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a5ca2ca4-0fca-4cae-a135-945d2e63994f tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:38:55.654448 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a5ca2ca4-0fca-4cae-a135-945d2e63994f tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] [instance: 1f354001-86ee-4951-a9cb-23fcd9e678a9] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:38:55.671732 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a5ca2ca4-0fca-4cae-a135-945d2e63994f tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:55.671732 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a5ca2ca4-0fca-4cae-a135-945d2e63994f tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:55.679311 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a5ca2ca4-0fca-4cae-a135-945d2e63994f tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:55.680463 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a5ca2ca4-0fca-4cae-a135-945d2e63994f tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:55.681144 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a5ca2ca4-0fca-4cae-a135-945d2e63994f tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:55.681799 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a5ca2ca4-0fca-4cae-a135-945d2e63994f tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:55.714741 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c3be3af8-ad0f-453c-87a9-81d73944d788 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:38:55.725998 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c3be3af8-ad0f-453c-87a9-81d73944d788 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1506 microversion: 2.1 time: 0.432465 Oct 19 03:38:55.746680 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2583/5238] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:38:55 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1506 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:38:55.820425 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-21fc296b-6354-431e-900c-d2a5ddd9b86d tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-531574675", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": -1, "networks": [{"uuid": "3ecd8896-b7a4-4c3a-b3cd-dc6769233813"}]}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:38:55.838287 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-21fc296b-6354-431e-900c-d2a5ddd9b86d tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] HTTP exception thrown: Flavor -1 could not be found. Oct 19 03:38:55.851104 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-21fc296b-6354-431e-900c-d2a5ddd9b86d tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Request method failure captured: Oct 19 03:38:55.851104 n-d-861333-8 devstack@n-api.service[121134]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 19 03:38:55.851104 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:38:55.851104 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:38:55.851104 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:38:55.851104 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 205 Oct 19 03:38:55.851104 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:38:55.851104 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:38:55.851104 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:38:55.851104 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:38:55.851104 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3EK4yDar5R5kGdpWRPopK281fOgxjiWCAZdy3tbDZzFYZxrN53hSsTq0YyAxsfcVRT4cF0jU61e6walOKxMx_njT0L3WOIYEymBjzmNzdXOa-UhYNf83BpQOShCJts2aNodNdu7YjeLcAcuRF0ZOjoH0xsH4HoNSzc8IfQzKhRz4vw Oct 19 03:38:55.851104 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:38:55.851104 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:38:55.851104 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:38:55.851104 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:38:55.851104 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:38:55.851104 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:38:55.851104 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 34bd94983fbf4a8aa49aff65c076e9e3 Oct 19 03:38:55.851104 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:38:55.851104 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:38:55.851104 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:38:55.851104 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_34bd94983fbf4a8aa49aff65c076e9e3", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:38:55.851104 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:38:55.851104 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 34bd94983fbf4a8aa49aff65c076e9e3 Oct 19 03:38:55.851104 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:38:55.851104 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ServersNegativeTestJSON-553742303-project Oct 19 03:38:55.851104 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:38:55.851104 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:38:55.851104 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 771feb133bc046588552d3af98f8e0a1 Oct 19 03:38:55.851104 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ServersNegativeTestJSON-553742303-project Oct 19 03:38:55.851104 n-d-861333-8 devstack@n-api.service[121134]: Oct 19 03:38:55.851104 n-d-861333-8 devstack@n-api.service[121134]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-531574675", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": -1, "networks": [{"uuid": "3ecd8896-b7a4-4c3a-b3cd-dc6769233813"}]}} Oct 19 03:38:55.851104 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:38:55.851104 n-d-861333-8 devstack@n-api.service[121134]: exception: Flavor -1 could not be found. Oct 19 03:38:55.851104 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-531574675', 'imageRef': '9e16d73e-70ea-4421-aee3-047d80396c02', 'flavorRef': -1, 'networks': [{'uuid': '3ecd8896-b7a4-4c3a-b3cd-dc6769233813'}]}}} Oct 19 03:38:55.851104 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:38:55.851104 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:38:55.851104 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 19 03:38:55.851104 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 19 03:38:55.851104 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 19 03:38:55.851104 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 19 03:38:55.851104 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 03:38:55.851104 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 03:38:55.851104 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 19 03:38:55.851104 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 19 03:38:55.851104 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 19 03:38:55.851104 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:38:55.851104 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 19 03:38:55.851104 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 19 03:38:55.851104 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Oct 19 03:38:55.851104 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:38:55.851104 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:38:55.851104 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:38:55.851104 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:38:55.851104 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:38:55.851104 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:38:55.851104 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:38:55.851104 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:38:55.851104 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:38:55.851104 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:38:55.851104 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:38:55.851104 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:38:55.861520 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:38:55.861520 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:38:55.861520 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:38:55.861520 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:38:55.861520 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 19 03:38:55.861520 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 19 03:38:55.861520 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 19 03:38:55.861520 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Oct 19 03:38:55.861520 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:38:55.861520 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:38:55.861520 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:38:55.861520 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:38:55.861520 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:38:55.861520 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:38:55.861520 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:38:55.861520 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:38:55.861520 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Oct 19 03:38:55.861520 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:38:55.861520 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-21fc296b-6354-431e-900c-d2a5ddd9b86d tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:38:55.861520 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-21fc296b-6354-431e-900c-d2a5ddd9b86d tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.050199 Oct 19 03:38:55.864351 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2584/5239] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:38:55 2022] POST /compute/v2.1/servers => generated 73 bytes in 54 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 19 03:38:55.883563 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5c291231-335a-4ef9-8bad-1c1b7c7f9ff9 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:38:55.884198 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5c291231-335a-4ef9-8bad-1c1b7c7f9ff9 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:38:55.902421 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5c291231-335a-4ef9-8bad-1c1b7c7f9ff9 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:55.904113 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5c291231-335a-4ef9-8bad-1c1b7c7f9ff9 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:55.906577 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5c291231-335a-4ef9-8bad-1c1b7c7f9ff9 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:55.907966 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5c291231-335a-4ef9-8bad-1c1b7c7f9ff9 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:55.908681 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5c291231-335a-4ef9-8bad-1c1b7c7f9ff9 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:55.910869 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5c291231-335a-4ef9-8bad-1c1b7c7f9ff9 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:56.181250 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a5ca2ca4-0fca-4cae-a135-945d2e63994f tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c65a497e16e4e41b5cf1287042f3a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4001edd1474947a94243a620a6013a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:38:56.199608 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a5ca2ca4-0fca-4cae-a135-945d2e63994f tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] 10.222.0.52 "GET /compute/v2.1/servers/1f354001-86ee-4951-a9cb-23fcd9e678a9" status: 200 len: 1361 microversion: 2.1 time: 0.556321 Oct 19 03:38:56.213428 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2656/5240] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:38:55 2022] GET /compute/v2.1/servers/1f354001-86ee-4951-a9cb-23fcd9e678a9 => generated 1361 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:38:56.214270 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7b2f72f4-c7a6-4725-b30c-29cec1f653fc tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:38:56.216305 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7b2f72f4-c7a6-4725-b30c-29cec1f653fc tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 4fab83b8-8862-4295-adb7-e2bf5462a2d9] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:38:56.229474 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5c291231-335a-4ef9-8bad-1c1b7c7f9ff9 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:38:56.233821 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7b2f72f4-c7a6-4725-b30c-29cec1f653fc tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:56.234307 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7b2f72f4-c7a6-4725-b30c-29cec1f653fc tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:56.234770 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7b2f72f4-c7a6-4725-b30c-29cec1f653fc tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:56.237660 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5c291231-335a-4ef9-8bad-1c1b7c7f9ff9 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1506 microversion: 2.1 time: 0.365625 Oct 19 03:38:56.240831 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7b2f72f4-c7a6-4725-b30c-29cec1f653fc tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:56.240982 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2585/5241] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:38:55 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1506 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:38:56.241496 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7b2f72f4-c7a6-4725-b30c-29cec1f653fc tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:56.242032 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7b2f72f4-c7a6-4725-b30c-29cec1f653fc tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:56.267851 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1684a149-f743-4fed-9b49-2d1417a19261 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:38:56.268761 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1684a149-f743-4fed-9b49-2d1417a19261 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:38:56.284011 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1684a149-f743-4fed-9b49-2d1417a19261 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:56.285923 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1684a149-f743-4fed-9b49-2d1417a19261 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:56.289551 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1684a149-f743-4fed-9b49-2d1417a19261 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:56.290570 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1684a149-f743-4fed-9b49-2d1417a19261 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:56.291230 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1684a149-f743-4fed-9b49-2d1417a19261 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:56.291922 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1684a149-f743-4fed-9b49-2d1417a19261 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:56.781854 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7b2f72f4-c7a6-4725-b30c-29cec1f653fc tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4729a0afd69480f99642266e0eec17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce5e9f9a4644b27a24b2f4c06df97bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:38:56.797568 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7b2f72f4-c7a6-4725-b30c-29cec1f653fc tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/4fab83b8-8862-4295-adb7-e2bf5462a2d9" status: 200 len: 1734 microversion: 2.1 time: 0.591866 Oct 19 03:38:56.799206 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2657/5242] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:38:56 2022] GET /compute/v2.1/servers/4fab83b8-8862-4295-adb7-e2bf5462a2d9 => generated 1734 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:38:56.858419 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-1684a149-f743-4fed-9b49-2d1417a19261 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:38:56.868170 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1684a149-f743-4fed-9b49-2d1417a19261 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1506 microversion: 2.1 time: 0.604253 Oct 19 03:38:56.872064 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2586/5243] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:38:56 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1506 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:38:56.951426 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2daaa471-fc9a-4a37-97f9-f3370005860e tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-73787199", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "3ecd8896-b7a4-4c3a-b3cd-dc6769233813"}]}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:38:56.956138 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2daaa471-fc9a-4a37-97f9-f3370005860e tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Request method failure captured: Oct 19 03:38:56.956138 n-d-861333-8 devstack@n-api.service[121135]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 19 03:38:56.956138 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:38:56.956138 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:38:56.956138 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:38:56.956138 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 171 Oct 19 03:38:56.956138 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:38:56.956138 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:38:56.956138 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:38:56.956138 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:38:56.956138 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT3EK4yDar5R5kGdpWRPopK281fOgxjiWCAZdy3tbDZzFYZxrN53hSsTq0YyAxsfcVRT4cF0jU61e6walOKxMx_njT0L3WOIYEymBjzmNzdXOa-UhYNf83BpQOShCJts2aNodNdu7YjeLcAcuRF0ZOjoH0xsH4HoNSzc8IfQzKhRz4vw Oct 19 03:38:56.956138 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:38:56.956138 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:38:56.956138 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:38:56.956138 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:38:56.956138 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:38:56.956138 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:38:56.956138 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 34bd94983fbf4a8aa49aff65c076e9e3 Oct 19 03:38:56.956138 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:38:56.956138 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:38:56.956138 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:38:56.956138 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_34bd94983fbf4a8aa49aff65c076e9e3", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:38:56.956138 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:38:56.956138 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 34bd94983fbf4a8aa49aff65c076e9e3 Oct 19 03:38:56.956138 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:38:56.956138 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ServersNegativeTestJSON-553742303-project Oct 19 03:38:56.956138 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:38:56.956138 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:38:56.956138 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 771feb133bc046588552d3af98f8e0a1 Oct 19 03:38:56.956138 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ServersNegativeTestJSON-553742303-project Oct 19 03:38:56.956138 n-d-861333-8 devstack@n-api.service[121135]: Oct 19 03:38:56.956138 n-d-861333-8 devstack@n-api.service[121135]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-73787199", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "3ecd8896-b7a4-4c3a-b3cd-dc6769233813"}]}} Oct 19 03:38:56.956138 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:38:56.956138 n-d-861333-8 devstack@n-api.service[121135]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 19 03:38:56.956138 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-73787199', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '3ecd8896-b7a4-4c3a-b3cd-dc6769233813'}]}}} Oct 19 03:38:56.956138 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:38:56.956138 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:38:56.956138 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 03:38:56.956138 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 03:38:56.956138 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 03:38:56.956138 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise error Oct 19 03:38:56.956138 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Oct 19 03:38:56.956138 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:38:56.956138 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Oct 19 03:38:56.956138 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Oct 19 03:38:56.956138 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Oct 19 03:38:56.956138 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:38:56.956138 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 19 03:38:56.956138 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi -1 Oct 19 03:38:56.956138 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:38:56.956138 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:38:56.956138 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:38:56.956138 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:38:56.956138 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:38:56.956138 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:38:56.956138 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:38:56.956138 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:38:56.956138 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:38:56.956138 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:38:56.956138 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:38:56.956138 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:38:56.956138 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 03:38:56.956138 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 03:38:56.956138 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 03:38:56.956138 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 03:38:56.967870 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 03:38:56.967870 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 03:38:56.967870 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 19 03:38:56.967870 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:38:56.967870 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:38:56.967870 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:38:56.967870 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:38:56.967870 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:38:56.967870 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:38:56.967870 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 03:38:56.967870 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 03:38:56.967870 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 19 03:38:56.967870 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:38:56.967870 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2daaa471-fc9a-4a37-97f9-f3370005860e tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:38:56.967870 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2daaa471-fc9a-4a37-97f9-f3370005860e tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.011451 Oct 19 03:38:56.967870 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2658/5244] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:38:56 2022] POST /compute/v2.1/servers => generated 145 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 03:38:56.976089 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3187b8e5-5e82-4218-b501-706060d91556 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:38:56.977084 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3187b8e5-5e82-4218-b501-706060d91556 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:38:56.983793 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3187b8e5-5e82-4218-b501-706060d91556 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:56.984576 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3187b8e5-5e82-4218-b501-706060d91556 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:56.985322 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3187b8e5-5e82-4218-b501-706060d91556 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:56.986570 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3187b8e5-5e82-4218-b501-706060d91556 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:56.987225 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3187b8e5-5e82-4218-b501-706060d91556 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:56.991112 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3187b8e5-5e82-4218-b501-706060d91556 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:57.208995 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-3187b8e5-5e82-4218-b501-706060d91556 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:38:57.218863 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3187b8e5-5e82-4218-b501-706060d91556 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1506 microversion: 2.1 time: 0.247602 Oct 19 03:38:57.230816 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2587/5245] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:38:56 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1506 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:38:57.236792 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-92fed403-7791-435d-ba77-63f22e627068 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:38:57.236792 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-92fed403-7791-435d-ba77-63f22e627068 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] [instance: 1f354001-86ee-4951-a9cb-23fcd9e678a9] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:38:57.245746 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-62f3f558-8128-419d-9eae-d67bcb1055c9 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:38:57.247403 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-62f3f558-8128-419d-9eae-d67bcb1055c9 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:38:57.247983 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-92fed403-7791-435d-ba77-63f22e627068 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:57.248664 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-92fed403-7791-435d-ba77-63f22e627068 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:57.249327 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-92fed403-7791-435d-ba77-63f22e627068 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:57.250466 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-92fed403-7791-435d-ba77-63f22e627068 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:57.251231 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-92fed403-7791-435d-ba77-63f22e627068 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:57.251727 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-92fed403-7791-435d-ba77-63f22e627068 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:57.258689 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-62f3f558-8128-419d-9eae-d67bcb1055c9 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:57.258689 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-62f3f558-8128-419d-9eae-d67bcb1055c9 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:57.258689 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-62f3f558-8128-419d-9eae-d67bcb1055c9 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:57.258689 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-62f3f558-8128-419d-9eae-d67bcb1055c9 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:57.259247 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-62f3f558-8128-419d-9eae-d67bcb1055c9 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:57.261825 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-62f3f558-8128-419d-9eae-d67bcb1055c9 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:57.600088 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-92fed403-7791-435d-ba77-63f22e627068 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c65a497e16e4e41b5cf1287042f3a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4001edd1474947a94243a620a6013a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:38:57.609637 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-92fed403-7791-435d-ba77-63f22e627068 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] 10.222.0.52 "GET /compute/v2.1/servers/1f354001-86ee-4951-a9cb-23fcd9e678a9" status: 200 len: 1361 microversion: 2.1 time: 0.387571 Oct 19 03:38:57.630941 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-62f3f558-8128-419d-9eae-d67bcb1055c9 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:38:57.637766 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2659/5246] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:38:57 2022] GET /compute/v2.1/servers/1f354001-86ee-4951-a9cb-23fcd9e678a9 => generated 1361 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:38:57.640816 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-62f3f558-8128-419d-9eae-d67bcb1055c9 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1506 microversion: 2.1 time: 0.399358 Oct 19 03:38:57.657914 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2588/5247] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:38:57 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1506 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:38:57.786477 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2b7ba114-d499-435b-8a6f-a1f0bebb3f0e tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-77860307", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:38:57.802567 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-2b7ba114-d499-435b-8a6f-a1f0bebb3f0e tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 19 03:38:57.806163 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2b7ba114-d499-435b-8a6f-a1f0bebb3f0e tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Request method failure captured: Oct 19 03:38:57.806163 n-d-861333-8 devstack@n-api.service[121135]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 19 03:38:57.806163 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:38:57.806163 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:38:57.806163 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:38:57.806163 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 214 Oct 19 03:38:57.806163 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:38:57.806163 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:38:57.806163 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:38:57.806163 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:38:57.806163 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT3EK4yDar5R5kGdpWRPopK281fOgxjiWCAZdy3tbDZzFYZxrN53hSsTq0YyAxsfcVRT4cF0jU61e6walOKxMx_njT0L3WOIYEymBjzmNzdXOa-UhYNf83BpQOShCJts2aNodNdu7YjeLcAcuRF0ZOjoH0xsH4HoNSzc8IfQzKhRz4vw Oct 19 03:38:57.806163 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:38:57.806163 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:38:57.806163 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:38:57.806163 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:38:57.806163 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:38:57.806163 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:38:57.806163 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 34bd94983fbf4a8aa49aff65c076e9e3 Oct 19 03:38:57.806163 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:38:57.806163 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:38:57.806163 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:38:57.806163 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_34bd94983fbf4a8aa49aff65c076e9e3", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:38:57.806163 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:38:57.806163 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 34bd94983fbf4a8aa49aff65c076e9e3 Oct 19 03:38:57.806163 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:38:57.806163 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ServersNegativeTestJSON-553742303-project Oct 19 03:38:57.806163 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:38:57.806163 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:38:57.806163 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 771feb133bc046588552d3af98f8e0a1 Oct 19 03:38:57.806163 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ServersNegativeTestJSON-553742303-project Oct 19 03:38:57.806163 n-d-861333-8 devstack@n-api.service[121135]: Oct 19 03:38:57.806163 n-d-861333-8 devstack@n-api.service[121135]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-77860307", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Oct 19 03:38:57.806163 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:38:57.806163 n-d-861333-8 devstack@n-api.service[121135]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 19 03:38:57.806163 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-77860307', 'imageRef': '9e16d73e-70ea-4421-aee3-047d80396c02', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Oct 19 03:38:57.806163 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:38:57.806163 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:38:57.806163 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:38:57.806163 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:38:57.806163 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:38:57.806163 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:38:57.806163 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:38:57.806163 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:38:57.806163 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:38:57.806163 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:38:57.806163 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:38:57.806163 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:38:57.806163 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:38:57.806163 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:38:57.806163 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 19 03:38:57.806163 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Oct 19 03:38:57.806163 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Oct 19 03:38:57.806163 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Oct 19 03:38:57.806163 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Oct 19 03:38:57.806163 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Oct 19 03:38:57.806163 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self._validate_network_id( Oct 19 03:38:57.806163 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Oct 19 03:38:57.806163 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 19 03:38:57.806163 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 19 03:38:57.806163 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:38:57.806163 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:38:57.806163 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:38:57.812564 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:38:57.812564 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:38:57.812564 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:38:57.812564 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:38:57.812564 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:38:57.812564 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 19 03:38:57.812564 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:38:57.812564 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2b7ba114-d499-435b-8a6f-a1f0bebb3f0e tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:38:57.812564 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2b7ba114-d499-435b-8a6f-a1f0bebb3f0e tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.027051 Oct 19 03:38:57.818478 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1f419bf6-bb08-457f-a082-5ac42b09242a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:38:57.819355 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1f419bf6-bb08-457f-a082-5ac42b09242a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:38:57.829850 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2660/5248] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:38:57 2022] POST /compute/v2.1/servers => generated 123 bytes in 50 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 03:38:57.836172 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1f419bf6-bb08-457f-a082-5ac42b09242a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:57.836935 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1f419bf6-bb08-457f-a082-5ac42b09242a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:57.837642 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1f419bf6-bb08-457f-a082-5ac42b09242a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:57.839111 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1f419bf6-bb08-457f-a082-5ac42b09242a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:57.839738 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1f419bf6-bb08-457f-a082-5ac42b09242a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:57.840335 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1f419bf6-bb08-457f-a082-5ac42b09242a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:57.843597 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9fa4081c-a9e0-4cc6-9b39-ac48f52d17be tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:38:57.845108 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9fa4081c-a9e0-4cc6-9b39-ac48f52d17be tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 4fab83b8-8862-4295-adb7-e2bf5462a2d9] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:38:57.858717 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9fa4081c-a9e0-4cc6-9b39-ac48f52d17be tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:57.859544 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9fa4081c-a9e0-4cc6-9b39-ac48f52d17be tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:57.860710 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9fa4081c-a9e0-4cc6-9b39-ac48f52d17be tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:57.861838 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9fa4081c-a9e0-4cc6-9b39-ac48f52d17be tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:57.862378 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9fa4081c-a9e0-4cc6-9b39-ac48f52d17be tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:57.863035 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9fa4081c-a9e0-4cc6-9b39-ac48f52d17be tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:58.112161 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-1f419bf6-bb08-457f-a082-5ac42b09242a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:38:58.135983 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1f419bf6-bb08-457f-a082-5ac42b09242a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1506 microversion: 2.1 time: 0.320849 Oct 19 03:38:58.138898 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2589/5249] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:38:57 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1506 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:38:58.167128 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2f19a60c-0ecc-46dc-a820-64d591c1c71e tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:38:58.168029 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2f19a60c-0ecc-46dc-a820-64d591c1c71e tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:38:58.174419 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2f19a60c-0ecc-46dc-a820-64d591c1c71e tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:58.174924 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2f19a60c-0ecc-46dc-a820-64d591c1c71e tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:58.176005 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2f19a60c-0ecc-46dc-a820-64d591c1c71e tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:58.176730 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2f19a60c-0ecc-46dc-a820-64d591c1c71e tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:58.177257 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2f19a60c-0ecc-46dc-a820-64d591c1c71e tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:58.180874 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2f19a60c-0ecc-46dc-a820-64d591c1c71e tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:58.272463 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-9fa4081c-a9e0-4cc6-9b39-ac48f52d17be tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4729a0afd69480f99642266e0eec17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce5e9f9a4644b27a24b2f4c06df97bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:38:58.282780 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9fa4081c-a9e0-4cc6-9b39-ac48f52d17be tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/4fab83b8-8862-4295-adb7-e2bf5462a2d9" status: 200 len: 1734 microversion: 2.1 time: 0.451364 Oct 19 03:38:58.299390 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2661/5250] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:38:57 2022] GET /compute/v2.1/servers/4fab83b8-8862-4295-adb7-e2bf5462a2d9 => generated 1734 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:38:58.470746 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-2f19a60c-0ecc-46dc-a820-64d591c1c71e tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:38:58.479793 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2f19a60c-0ecc-46dc-a820-64d591c1c71e tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1506 microversion: 2.1 time: 0.316671 Oct 19 03:38:58.494340 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2590/5251] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:38:58 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1506 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:38:58.584908 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e407e08c-b965-44bc-975b-68dd197d5b16 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2084208015", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "key_name": "tempest-key-189038463", "networks": [{"uuid": "3ecd8896-b7a4-4c3a-b3cd-dc6769233813"}]}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:38:58.640143 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-66f2c029-8e72-420b-a607-9de6191ffdc3 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:38:58.640663 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-66f2c029-8e72-420b-a607-9de6191ffdc3 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] [instance: 1f354001-86ee-4951-a9cb-23fcd9e678a9] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:38:58.655707 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-66f2c029-8e72-420b-a607-9de6191ffdc3 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:58.656225 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-66f2c029-8e72-420b-a607-9de6191ffdc3 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:58.662512 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-66f2c029-8e72-420b-a607-9de6191ffdc3 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:58.667017 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-66f2c029-8e72-420b-a607-9de6191ffdc3 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:58.669834 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-66f2c029-8e72-420b-a607-9de6191ffdc3 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:58.670387 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-66f2c029-8e72-420b-a607-9de6191ffdc3 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:58.742679 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.network.neutron [None req-e407e08c-b965-44bc-975b-68dd197d5b16 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] validate_networks() for [('3ecd8896-b7a4-4c3a-b3cd-dc6769233813', None, None, None, None, None)] {{(pid=121135) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:38:59.188657 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-66f2c029-8e72-420b-a607-9de6191ffdc3 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c65a497e16e4e41b5cf1287042f3a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4001edd1474947a94243a620a6013a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:38:59.200607 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-66f2c029-8e72-420b-a607-9de6191ffdc3 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] 10.222.0.52 "GET /compute/v2.1/servers/1f354001-86ee-4951-a9cb-23fcd9e678a9" status: 200 len: 1361 microversion: 2.1 time: 0.565200 Oct 19 03:38:59.214169 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2591/5252] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:38:58 2022] GET /compute/v2.1/servers/1f354001-86ee-4951-a9cb-23fcd9e678a9 => generated 1361 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:38:59.224394 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-98e610a6-58f8-47a9-8521-372d125f676a tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1403576175", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "networks": [{"uuid": "c6370f81-8407-43b6-8230-33a5baa9fc8c"}], "key_name": "tempest-TestNetworkBasicOps-418828847", "security_groups": [{"name": "tempest-secgroup-smoke-219044056"}]}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:38:59.237329 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-e407e08c-b965-44bc-975b-68dd197d5b16 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] HTTP exception thrown: Invalid key_name provided. Oct 19 03:38:59.240122 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e407e08c-b965-44bc-975b-68dd197d5b16 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Request method failure captured: Oct 19 03:38:59.240122 n-d-861333-8 devstack@n-api.service[121135]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 19 03:38:59.240122 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:38:59.240122 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:38:59.240122 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:38:59.240122 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 246 Oct 19 03:38:59.240122 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:38:59.240122 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:38:59.240122 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:38:59.240122 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:38:59.240122 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT3EK4yDar5R5kGdpWRPopK281fOgxjiWCAZdy3tbDZzFYZxrN53hSsTq0YyAxsfcVRT4cF0jU61e6walOKxMx_njT0L3WOIYEymBjzmNzdXOa-UhYNf83BpQOShCJts2aNodNdu7YjeLcAcuRF0ZOjoH0xsH4HoNSzc8IfQzKhRz4vw Oct 19 03:38:59.240122 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:38:59.240122 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:38:59.240122 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:38:59.240122 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:38:59.240122 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:38:59.240122 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:38:59.240122 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 34bd94983fbf4a8aa49aff65c076e9e3 Oct 19 03:38:59.240122 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:38:59.240122 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:38:59.240122 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:38:59.240122 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_34bd94983fbf4a8aa49aff65c076e9e3", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:38:59.240122 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:38:59.240122 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 34bd94983fbf4a8aa49aff65c076e9e3 Oct 19 03:38:59.240122 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:38:59.240122 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ServersNegativeTestJSON-553742303-project Oct 19 03:38:59.240122 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:38:59.240122 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:38:59.240122 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 771feb133bc046588552d3af98f8e0a1 Oct 19 03:38:59.240122 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ServersNegativeTestJSON-553742303-project Oct 19 03:38:59.240122 n-d-861333-8 devstack@n-api.service[121135]: Oct 19 03:38:59.240122 n-d-861333-8 devstack@n-api.service[121135]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2084208015", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "key_name": "tempest-key-189038463", "networks": [{"uuid": "3ecd8896-b7a4-4c3a-b3cd-dc6769233813"}]}} Oct 19 03:38:59.240122 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:38:59.240122 n-d-861333-8 devstack@n-api.service[121135]: exception: Invalid key_name provided. Oct 19 03:38:59.240122 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2084208015', 'imageRef': '9e16d73e-70ea-4421-aee3-047d80396c02', 'flavorRef': '452', 'key_name': 'tempest-key-189038463', 'networks': [{'uuid': '3ecd8896-b7a4-4c3a-b3cd-dc6769233813'}]}}} Oct 19 03:38:59.240122 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:38:59.240122 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:38:59.240122 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 19 03:38:59.240122 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 19 03:38:59.240122 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 19 03:38:59.240122 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 19 03:38:59.240122 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 19 03:38:59.240122 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 19 03:38:59.240122 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Oct 19 03:38:59.240122 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Oct 19 03:38:59.240122 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 03:38:59.240122 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 03:38:59.240122 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 19 03:38:59.240122 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 19 03:38:59.240122 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 19 03:38:59.240122 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 19 03:38:59.240122 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 19 03:38:59.240122 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 19 03:38:59.240122 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 19 03:38:59.240122 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 19 03:38:59.240122 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-189038463 not found for user 771feb133bc046588552d3af98f8e0a1 Oct 19 03:38:59.240122 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:38:59.240122 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:38:59.240122 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:38:59.240122 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:38:59.240122 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:38:59.247209 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:38:59.247209 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:38:59.247209 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:38:59.247209 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:38:59.247209 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:38:59.247209 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:38:59.247209 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:38:59.247209 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:38:59.247209 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:38:59.247209 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:38:59.247209 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:38:59.247209 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 19 03:38:59.247209 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Oct 19 03:38:59.247209 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 19 03:38:59.247209 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Oct 19 03:38:59.247209 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:38:59.247209 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:38:59.247209 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:38:59.247209 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:38:59.247209 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:38:59.247209 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:38:59.247209 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:38:59.247209 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:38:59.247209 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Oct 19 03:38:59.247209 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:38:59.256532 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e407e08c-b965-44bc-975b-68dd197d5b16 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Returning 400 to user: Invalid key_name provided. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:38:59.258206 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e407e08c-b965-44bc-975b-68dd197d5b16 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.677120 Oct 19 03:38:59.268038 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2662/5253] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:38:58 2022] POST /compute/v2.1/servers => generated 70 bytes in 688 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 19 03:38:59.282409 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-866436ea-6909-4b43-a914-94c6bf4172f9 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8ef45b62-76bc-4079-84ec-3c166781d2c0"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:38:59.287907 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-866436ea-6909-4b43-a914-94c6bf4172f9 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: c6045b08-8c91-4cdb-be37-c079e7ffe23a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:38:59.309761 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-866436ea-6909-4b43-a914-94c6bf4172f9 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:59.310336 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-866436ea-6909-4b43-a914-94c6bf4172f9 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:59.310927 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-866436ea-6909-4b43-a914-94c6bf4172f9 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:59.317576 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-866436ea-6909-4b43-a914-94c6bf4172f9 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:38:59.317576 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-866436ea-6909-4b43-a914-94c6bf4172f9 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:38:59.317576 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-866436ea-6909-4b43-a914-94c6bf4172f9 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:38:59.525392 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-98e610a6-58f8-47a9-8521-372d125f676a tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] validate_networks() for [('c6370f81-8407-43b6-8230-33a5baa9fc8c', None, None, None, None, None)] {{(pid=121134) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:39:00.017828 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-98e610a6-58f8-47a9-8521-372d125f676a tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Flavor limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:39:00.018257 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-98e610a6-58f8-47a9-8521-372d125f676a tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Image limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:39:00.019289 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-98e610a6-58f8-47a9-8521-372d125f676a tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Flavor pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:39:00.020266 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-98e610a6-58f8-47a9-8521-372d125f676a tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Image pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:39:00.020691 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-98e610a6-58f8-47a9-8521-372d125f676a tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:39:00.031397 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-98e610a6-58f8-47a9-8521-372d125f676a tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:00.032524 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-98e610a6-58f8-47a9-8521-372d125f676a tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:00.047393 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-98e610a6-58f8-47a9-8521-372d125f676a tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:00.047393 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-98e610a6-58f8-47a9-8521-372d125f676a tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:00.048117 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-98e610a6-58f8-47a9-8521-372d125f676a tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:00.048439 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-98e610a6-58f8-47a9-8521-372d125f676a tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:00.069493 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-98e610a6-58f8-47a9-8521-372d125f676a tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Getting quotas for project 3bf91777fa414ddaa797d735e7d2a275. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:39:00.075320 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-98e610a6-58f8-47a9-8521-372d125f676a tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Getting quotas for user 4670fd4408d4454784251a880d5a72f5 and project 3bf91777fa414ddaa797d735e7d2a275. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:39:00.088877 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-98e610a6-58f8-47a9-8521-372d125f676a tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Going to run 1 instances... {{(pid=121134) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:39:00.091262 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-98e610a6-58f8-47a9-8521-372d125f676a tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] [instance: d368a182-a350-4d0c-803d-2972af3aeb7d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:39:00.269733 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-866436ea-6909-4b43-a914-94c6bf4172f9 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "POST /compute/v2.1/servers/c6045b08-8c91-4cdb-be37-c079e7ffe23a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.998453 Oct 19 03:39:00.283716 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-98e610a6-58f8-47a9-8521-372d125f676a tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.068270 Oct 19 03:39:00.285841 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2663/5254] 10.222.0.52 () {60 vars in 1323 bytes} [Wed Oct 19 03:38:59 2022] POST /compute/v2.1/servers/c6045b08-8c91-4cdb-be37-c079e7ffe23a/os-volume_attachments => generated 194 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:39:00.292045 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2592/5255] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:38:59 2022] POST /compute/v2.1/servers => generated 405 bytes in 1077 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 03:39:00.297198 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-e8de4236-1bb3-4ca8-8f76-d817fd4679d6 req-48b3c637-51fe-4524-8e33-cbbb681b2a29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f354001-86ee-4951-a9cb-23fcd9e678a9", "name": "network-vif-plugged", "status": "completed", "tag": "df2c5d9b-837d-4ae2-918d-8eef7876b140"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:39:00.307564 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-e8de4236-1bb3-4ca8-8f76-d817fd4679d6 req-48b3c637-51fe-4524-8e33-cbbb681b2a29 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:00.308020 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-e8de4236-1bb3-4ca8-8f76-d817fd4679d6 req-48b3c637-51fe-4524-8e33-cbbb681b2a29 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:00.308686 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-e8de4236-1bb3-4ca8-8f76-d817fd4679d6 req-48b3c637-51fe-4524-8e33-cbbb681b2a29 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:00.328410 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-58d9c504-41d2-4482-a5bb-d4410dcc7b11 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:00.328410 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-58d9c504-41d2-4482-a5bb-d4410dcc7b11 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:00.335555 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-e8de4236-1bb3-4ca8-8f76-d817fd4679d6 req-48b3c637-51fe-4524-8e33-cbbb681b2a29 service nova] Creating event network-vif-plugged:df2c5d9b-837d-4ae2-918d-8eef7876b140 for instance 1f354001-86ee-4951-a9cb-23fcd9e678a9 on n-h2-861333-8 Oct 19 03:39:00.345329 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-58d9c504-41d2-4482-a5bb-d4410dcc7b11 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:00.349032 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-58d9c504-41d2-4482-a5bb-d4410dcc7b11 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:00.351095 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-e8de4236-1bb3-4ca8-8f76-d817fd4679d6 req-48b3c637-51fe-4524-8e33-cbbb681b2a29 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056264 Oct 19 03:39:00.354372 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2593/5256] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:39:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:39:00.354703 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-58d9c504-41d2-4482-a5bb-d4410dcc7b11 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:00.358055 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-58d9c504-41d2-4482-a5bb-d4410dcc7b11 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:00.361285 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-58d9c504-41d2-4482-a5bb-d4410dcc7b11 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:00.361285 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-58d9c504-41d2-4482-a5bb-d4410dcc7b11 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:00.377712 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-66c6b732-abb0-47d0-b38a-c1335ccd1167 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:00.383368 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-66c6b732-abb0-47d0-b38a-c1335ccd1167 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 4fab83b8-8862-4295-adb7-e2bf5462a2d9] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:00.434289 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-66c6b732-abb0-47d0-b38a-c1335ccd1167 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:00.434802 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-66c6b732-abb0-47d0-b38a-c1335ccd1167 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:00.435354 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-66c6b732-abb0-47d0-b38a-c1335ccd1167 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:00.436006 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-66c6b732-abb0-47d0-b38a-c1335ccd1167 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:00.436989 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-66c6b732-abb0-47d0-b38a-c1335ccd1167 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:00.437667 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-66c6b732-abb0-47d0-b38a-c1335ccd1167 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:00.796472 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-66c6b732-abb0-47d0-b38a-c1335ccd1167 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4729a0afd69480f99642266e0eec17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce5e9f9a4644b27a24b2f4c06df97bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:00.807594 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-66c6b732-abb0-47d0-b38a-c1335ccd1167 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/4fab83b8-8862-4295-adb7-e2bf5462a2d9" status: 200 len: 1734 microversion: 2.1 time: 0.451511 Oct 19 03:39:00.808667 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2594/5257] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:00 2022] GET /compute/v2.1/servers/4fab83b8-8862-4295-adb7-e2bf5462a2d9 => generated 1734 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:39:00.826825 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-46bd0574-76f9-45b2-927b-015224d21f15 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:00.827767 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-46bd0574-76f9-45b2-927b-015224d21f15 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] [instance: 1f354001-86ee-4951-a9cb-23fcd9e678a9] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:00.840082 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-46bd0574-76f9-45b2-927b-015224d21f15 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:00.847899 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-46bd0574-76f9-45b2-927b-015224d21f15 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:00.847899 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-46bd0574-76f9-45b2-927b-015224d21f15 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:00.848402 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-46bd0574-76f9-45b2-927b-015224d21f15 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:00.849809 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-46bd0574-76f9-45b2-927b-015224d21f15 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:00.853850 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-46bd0574-76f9-45b2-927b-015224d21f15 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:00.856779 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-58d9c504-41d2-4482-a5bb-d4410dcc7b11 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:00.871022 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-58d9c504-41d2-4482-a5bb-d4410dcc7b11 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1506 microversion: 2.1 time: 0.566662 Oct 19 03:39:00.872272 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2664/5258] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:00 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1506 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:39:00.879187 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-864afa0b-161c-4729-8e19-8547693ce65e tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:00.880334 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-864afa0b-161c-4729-8e19-8547693ce65e tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] [instance: d368a182-a350-4d0c-803d-2972af3aeb7d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:00.993634 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-864afa0b-161c-4729-8e19-8547693ce65e tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4670fd4408d4454784251a880d5a72f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf91777fa414ddaa797d735e7d2a275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:01.013081 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-864afa0b-161c-4729-8e19-8547693ce65e tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] 10.222.0.52 "GET /compute/v2.1/servers/d368a182-a350-4d0c-803d-2972af3aeb7d" status: 200 len: 1248 microversion: 2.1 time: 0.139511 Oct 19 03:39:01.016578 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2665/5259] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:00 2022] GET /compute/v2.1/servers/d368a182-a350-4d0c-803d-2972af3aeb7d => generated 1248 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:39:01.051926 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-960f4d51-af55-470d-bcbd-416b2d572bb8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:01.054694 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-960f4d51-af55-470d-bcbd-416b2d572bb8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:01.063114 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-960f4d51-af55-470d-bcbd-416b2d572bb8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:01.064084 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-960f4d51-af55-470d-bcbd-416b2d572bb8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:01.064713 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-960f4d51-af55-470d-bcbd-416b2d572bb8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:01.065857 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-960f4d51-af55-470d-bcbd-416b2d572bb8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:01.066507 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-960f4d51-af55-470d-bcbd-416b2d572bb8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:01.067119 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-960f4d51-af55-470d-bcbd-416b2d572bb8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:01.117336 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-46bd0574-76f9-45b2-927b-015224d21f15 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c65a497e16e4e41b5cf1287042f3a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4001edd1474947a94243a620a6013a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:01.127994 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-46bd0574-76f9-45b2-927b-015224d21f15 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] 10.222.0.52 "GET /compute/v2.1/servers/1f354001-86ee-4951-a9cb-23fcd9e678a9" status: 200 len: 1361 microversion: 2.1 time: 0.317890 Oct 19 03:39:01.131248 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2595/5260] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:00 2022] GET /compute/v2.1/servers/1f354001-86ee-4951-a9cb-23fcd9e678a9 => generated 1361 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:39:01.281247 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-960f4d51-af55-470d-bcbd-416b2d572bb8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:01.297021 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-960f4d51-af55-470d-bcbd-416b2d572bb8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1506 microversion: 2.1 time: 0.263633 Oct 19 03:39:01.298230 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2666/5261] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:01 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1506 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:39:01.364570 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-fbe8ca58-df92-4ee8-953c-c70a4712c100 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1085220096", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "3ecd8896-b7a4-4c3a-b3cd-dc6769233813"}]}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:39:01.477441 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.security_group_api [None req-fbe8ca58-df92-4ee8-953c-c70a4712c100 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Neutron security group does_not_exist not found {{(pid=121134) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Oct 19 03:39:01.478099 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-fbe8ca58-df92-4ee8-953c-c70a4712c100 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Oct 19 03:39:01.490268 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-fbe8ca58-df92-4ee8-953c-c70a4712c100 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Request method failure captured: Oct 19 03:39:01.490268 n-d-861333-8 devstack@n-api.service[121134]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 19 03:39:01.490268 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:39:01.490268 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:39:01.490268 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:39:01.490268 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 258 Oct 19 03:39:01.490268 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:39:01.490268 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:39:01.490268 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:39:01.490268 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:39:01.490268 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3EK4yDar5R5kGdpWRPopK281fOgxjiWCAZdy3tbDZzFYZxrN53hSsTq0YyAxsfcVRT4cF0jU61e6walOKxMx_njT0L3WOIYEymBjzmNzdXOa-UhYNf83BpQOShCJts2aNodNdu7YjeLcAcuRF0ZOjoH0xsH4HoNSzc8IfQzKhRz4vw Oct 19 03:39:01.490268 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:39:01.490268 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:39:01.490268 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:39:01.490268 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:39:01.490268 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:39:01.490268 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:39:01.490268 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 34bd94983fbf4a8aa49aff65c076e9e3 Oct 19 03:39:01.490268 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:39:01.490268 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:39:01.490268 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:39:01.490268 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_34bd94983fbf4a8aa49aff65c076e9e3", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:39:01.490268 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:39:01.490268 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 34bd94983fbf4a8aa49aff65c076e9e3 Oct 19 03:39:01.490268 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:39:01.490268 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ServersNegativeTestJSON-553742303-project Oct 19 03:39:01.490268 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:39:01.490268 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:39:01.490268 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 771feb133bc046588552d3af98f8e0a1 Oct 19 03:39:01.490268 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ServersNegativeTestJSON-553742303-project Oct 19 03:39:01.490268 n-d-861333-8 devstack@n-api.service[121134]: Oct 19 03:39:01.490268 n-d-861333-8 devstack@n-api.service[121134]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1085220096", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "3ecd8896-b7a4-4c3a-b3cd-dc6769233813"}]}} Oct 19 03:39:01.490268 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:39:01.490268 n-d-861333-8 devstack@n-api.service[121134]: exception: Unable to find security_group with name or id 'does_not_exist' Oct 19 03:39:01.490268 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1085220096', 'imageRef': '9e16d73e-70ea-4421-aee3-047d80396c02', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '3ecd8896-b7a4-4c3a-b3cd-dc6769233813'}]}}} Oct 19 03:39:01.490268 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:39:01.490268 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:39:01.490268 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Oct 19 03:39:01.490268 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Oct 19 03:39:01.490268 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:39:01.490268 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:39:01.490268 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Oct 19 03:39:01.490268 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 19 03:39:01.490268 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Oct 19 03:39:01.490268 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:39:01.490268 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:39:01.490268 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:39:01.490268 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:39:01.490268 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Oct 19 03:39:01.490268 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Oct 19 03:39:01.490268 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:39:01.490268 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:39:01.490268 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Oct 19 03:39:01.490268 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 19 03:39:01.490268 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Oct 19 03:39:01.490268 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:39:01.490268 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:39:01.490268 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:39:01.490268 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:39:01.490268 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Oct 19 03:39:01.490268 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Oct 19 03:39:01.496334 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Oct 19 03:39:01.496334 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Oct 19 03:39:01.496334 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Oct 19 03:39:01.496334 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Oct 19 03:39:01.496334 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 03:39:01.496334 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 03:39:01.496334 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Oct 19 03:39:01.496334 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Oct 19 03:39:01.496334 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Oct 19 03:39:01.496334 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:39:01.496334 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:39:01.496334 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:39:01.496334 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:39:01.496334 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 19 03:39:01.496334 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 19 03:39:01.496334 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 19 03:39:01.496334 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 19 03:39:01.496334 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 19 03:39:01.496334 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 19 03:39:01.496334 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Oct 19 03:39:01.496334 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Oct 19 03:39:01.496334 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Oct 19 03:39:01.496334 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Oct 19 03:39:01.496334 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Oct 19 03:39:01.496334 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 19 03:39:01.496334 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Oct 19 03:39:01.496334 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:39:01.496334 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:39:01.496334 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:39:01.496334 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:39:01.496334 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:39:01.496334 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:39:01.496334 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:39:01.496334 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:39:01.496334 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:39:01.496334 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:39:01.496334 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:39:01.496334 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:39:01.496334 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:39:01.496334 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:39:01.496334 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:39:01.496334 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:39:01.496334 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 19 03:39:01.496334 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 19 03:39:01.496334 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 19 03:39:01.496334 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Oct 19 03:39:01.496334 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:39:01.496334 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:39:01.496334 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:39:01.496334 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:39:01.496334 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:39:01.496334 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:39:01.496334 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:39:01.496334 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:39:01.496334 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Oct 19 03:39:01.496334 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:39:01.496334 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-fbe8ca58-df92-4ee8-953c-c70a4712c100 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:39:01.503131 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-fbe8ca58-df92-4ee8-953c-c70a4712c100 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.136840 Oct 19 03:39:01.503131 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2596/5262] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:39:01 2022] POST /compute/v2.1/servers => generated 106 bytes in 141 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 03:39:01.513124 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-275ac3d2-818b-4bc5-b0b0-29d7e929c60f tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:01.513124 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-275ac3d2-818b-4bc5-b0b0-29d7e929c60f tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:01.518988 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-275ac3d2-818b-4bc5-b0b0-29d7e929c60f tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:01.519714 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-275ac3d2-818b-4bc5-b0b0-29d7e929c60f tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:01.520159 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-275ac3d2-818b-4bc5-b0b0-29d7e929c60f tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:01.520876 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-275ac3d2-818b-4bc5-b0b0-29d7e929c60f tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:01.521340 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-275ac3d2-818b-4bc5-b0b0-29d7e929c60f tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:01.521851 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-275ac3d2-818b-4bc5-b0b0-29d7e929c60f tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:01.743820 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-275ac3d2-818b-4bc5-b0b0-29d7e929c60f tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:01.754005 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-275ac3d2-818b-4bc5-b0b0-29d7e929c60f tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1506 microversion: 2.1 time: 0.247529 Oct 19 03:39:01.755219 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2667/5263] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:01 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1506 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:39:01.781715 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2de7851d-996b-4984-b375-e8c514d41b99 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:01.782349 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2de7851d-996b-4984-b375-e8c514d41b99 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:01.789056 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2de7851d-996b-4984-b375-e8c514d41b99 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:01.789736 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2de7851d-996b-4984-b375-e8c514d41b99 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:01.790030 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2de7851d-996b-4984-b375-e8c514d41b99 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:01.790753 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2de7851d-996b-4984-b375-e8c514d41b99 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:01.791223 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2de7851d-996b-4984-b375-e8c514d41b99 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:01.791918 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2de7851d-996b-4984-b375-e8c514d41b99 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:01.839434 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-55e9b26b-3092-4402-9fc8-241c68626505 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:01.840154 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-55e9b26b-3092-4402-9fc8-241c68626505 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 4fab83b8-8862-4295-adb7-e2bf5462a2d9] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:01.853481 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-55e9b26b-3092-4402-9fc8-241c68626505 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:01.853481 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-55e9b26b-3092-4402-9fc8-241c68626505 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:01.853481 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-55e9b26b-3092-4402-9fc8-241c68626505 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:01.867916 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-55e9b26b-3092-4402-9fc8-241c68626505 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:01.868824 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-55e9b26b-3092-4402-9fc8-241c68626505 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:01.869817 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-55e9b26b-3092-4402-9fc8-241c68626505 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:01.891903 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:39:03.156178 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-2de7851d-996b-4984-b375-e8c514d41b99 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:03.168515 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-55e9b26b-3092-4402-9fc8-241c68626505 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4729a0afd69480f99642266e0eec17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce5e9f9a4644b27a24b2f4c06df97bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:03.173479 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2de7851d-996b-4984-b375-e8c514d41b99 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1506 microversion: 2.1 time: 1.392659 Oct 19 03:39:03.173479 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2597/5264] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:01 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1506 bytes in 1395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:39:03.183278 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-55e9b26b-3092-4402-9fc8-241c68626505 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/4fab83b8-8862-4295-adb7-e2bf5462a2d9" status: 200 len: 1734 microversion: 2.1 time: 1.349565 Oct 19 03:39:03.186534 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-dcc6df0b-e7e8-453b-bda4-fb64d55025de tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:03.187324 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-dcc6df0b-e7e8-453b-bda4-fb64d55025de tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] [instance: d368a182-a350-4d0c-803d-2972af3aeb7d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:03.197974 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2668/5265] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:01 2022] GET /compute/v2.1/servers/4fab83b8-8862-4295-adb7-e2bf5462a2d9 => generated 1734 bytes in 1365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:39:03.199852 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dcc6df0b-e7e8-453b-bda4-fb64d55025de tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:03.200621 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dcc6df0b-e7e8-453b-bda4-fb64d55025de tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:03.208865 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dcc6df0b-e7e8-453b-bda4-fb64d55025de tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:03.208865 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dcc6df0b-e7e8-453b-bda4-fb64d55025de tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:03.209081 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dcc6df0b-e7e8-453b-bda4-fb64d55025de tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:03.209569 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dcc6df0b-e7e8-453b-bda4-fb64d55025de tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:03.218813 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a1e67acd-47be-425d-a810-0699d6685755 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:03.219717 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a1e67acd-47be-425d-a810-0699d6685755 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] [instance: 1f354001-86ee-4951-a9cb-23fcd9e678a9] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:03.242970 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a1e67acd-47be-425d-a810-0699d6685755 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:03.243739 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a1e67acd-47be-425d-a810-0699d6685755 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:03.250035 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a1e67acd-47be-425d-a810-0699d6685755 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:03.251159 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a1e67acd-47be-425d-a810-0699d6685755 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:03.252577 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a1e67acd-47be-425d-a810-0699d6685755 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:03.253780 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a1e67acd-47be-425d-a810-0699d6685755 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:03.403590 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-dcc6df0b-e7e8-453b-bda4-fb64d55025de tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4670fd4408d4454784251a880d5a72f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf91777fa414ddaa797d735e7d2a275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:03.414731 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-dcc6df0b-e7e8-453b-bda4-fb64d55025de tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] 10.222.0.52 "GET /compute/v2.1/servers/d368a182-a350-4d0c-803d-2972af3aeb7d" status: 200 len: 1300 microversion: 2.1 time: 0.241478 Oct 19 03:39:03.415605 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2598/5266] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:03 2022] GET /compute/v2.1/servers/d368a182-a350-4d0c-803d-2972af3aeb7d => generated 1300 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:39:03.432196 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7bc50f29-1b9c-49a8-b77a-1129b3692aa5 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:03.439965 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7bc50f29-1b9c-49a8-b77a-1129b3692aa5 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 146db974-89f9-439e-a56e-7449c17c2271] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:03.449256 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-7bc50f29-1b9c-49a8-b77a-1129b3692aa5 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] HTTP exception thrown: Instance 146db974-89f9-439e-a56e-7449c17c2271 could not be found. Oct 19 03:39:03.456035 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7bc50f29-1b9c-49a8-b77a-1129b3692aa5 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Request method failure captured: Oct 19 03:39:03.456035 n-d-861333-8 devstack@n-api.service[121134]: request: DELETE /compute/v2.1/servers/146db974-89f9-439e-a56e-7449c17c2271 HTTP/1.1 Oct 19 03:39:03.456035 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:39:03.456035 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:39:03.456035 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:39:03.456035 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:39:03.456035 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:39:03.456035 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:39:03.456035 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:39:03.456035 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:39:03.456035 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3EK4yDar5R5kGdpWRPopK281fOgxjiWCAZdy3tbDZzFYZxrN53hSsTq0YyAxsfcVRT4cF0jU61e6walOKxMx_njT0L3WOIYEymBjzmNzdXOa-UhYNf83BpQOShCJts2aNodNdu7YjeLcAcuRF0ZOjoH0xsH4HoNSzc8IfQzKhRz4vw Oct 19 03:39:03.456035 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:39:03.456035 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:39:03.456035 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:39:03.456035 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:39:03.456035 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:39:03.456035 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:39:03.456035 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 34bd94983fbf4a8aa49aff65c076e9e3 Oct 19 03:39:03.456035 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:39:03.456035 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:39:03.456035 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:39:03.456035 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_34bd94983fbf4a8aa49aff65c076e9e3", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:39:03.456035 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:39:03.456035 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 34bd94983fbf4a8aa49aff65c076e9e3 Oct 19 03:39:03.456035 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:39:03.456035 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ServersNegativeTestJSON-553742303-project Oct 19 03:39:03.456035 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:39:03.456035 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:39:03.456035 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 771feb133bc046588552d3af98f8e0a1 Oct 19 03:39:03.456035 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ServersNegativeTestJSON-553742303-project Oct 19 03:39:03.456035 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:39:03.456035 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance 146db974-89f9-439e-a56e-7449c17c2271 could not be found. Oct 19 03:39:03.456035 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '146db974-89f9-439e-a56e-7449c17c2271'} Oct 19 03:39:03.456035 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:39:03.456035 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:39:03.456035 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:39:03.456035 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:39:03.456035 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:39:03.456035 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:39:03.456035 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 19 03:39:03.456035 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 19 03:39:03.456035 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 146db974-89f9-439e-a56e-7449c17c2271 could not be found. Oct 19 03:39:03.456035 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:39:03.456035 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:39:03.456035 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:39:03.456035 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:39:03.456035 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:39:03.456035 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:39:03.456035 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:39:03.456035 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:39:03.456035 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:39:03.456035 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:39:03.456035 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 03:39:03.456035 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 03:39:03.456035 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 03:39:03.456035 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 03:39:03.456035 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:39:03.456035 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:39:03.456035 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:39:03.456035 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:39:03.456035 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 146db974-89f9-439e-a56e-7449c17c2271 could not be found. Oct 19 03:39:03.456035 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:39:03.456035 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:39:03.461595 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:39:03.461595 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:39:03.461595 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:39:03.461595 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:39:03.461595 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:39:03.461595 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:39:03.461595 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 146db974-89f9-439e-a56e-7449c17c2271 could not be found. Oct 19 03:39:03.461595 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:39:03.468159 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7bc50f29-1b9c-49a8-b77a-1129b3692aa5 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Returning 404 to user: Instance 146db974-89f9-439e-a56e-7449c17c2271 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:39:03.469115 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7bc50f29-1b9c-49a8-b77a-1129b3692aa5 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "DELETE /compute/v2.1/servers/146db974-89f9-439e-a56e-7449c17c2271" status: 404 len: 111 microversion: 2.1 time: 0.051759 Oct 19 03:39:03.475474 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2599/5267] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:39:03 2022] DELETE /compute/v2.1/servers/146db974-89f9-439e-a56e-7449c17c2271 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:39:03.487298 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1cb9da73-f5e4-49e0-98b6-5c646847ba6d tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:03.495742 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1cb9da73-f5e4-49e0-98b6-5c646847ba6d tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:03.510490 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1cb9da73-f5e4-49e0-98b6-5c646847ba6d tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:03.514625 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1cb9da73-f5e4-49e0-98b6-5c646847ba6d tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:03.515279 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1cb9da73-f5e4-49e0-98b6-5c646847ba6d tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:03.516212 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1cb9da73-f5e4-49e0-98b6-5c646847ba6d tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:03.517598 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1cb9da73-f5e4-49e0-98b6-5c646847ba6d tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:03.522340 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1cb9da73-f5e4-49e0-98b6-5c646847ba6d tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:03.640220 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a1e67acd-47be-425d-a810-0699d6685755 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c65a497e16e4e41b5cf1287042f3a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4001edd1474947a94243a620a6013a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:03.657859 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a1e67acd-47be-425d-a810-0699d6685755 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] 10.222.0.52 "GET /compute/v2.1/servers/1f354001-86ee-4951-a9cb-23fcd9e678a9" status: 200 len: 1546 microversion: 2.1 time: 0.458319 Oct 19 03:39:03.673213 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2669/5268] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:03 2022] GET /compute/v2.1/servers/1f354001-86ee-4951-a9cb-23fcd9e678a9 => generated 1546 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:39:03.695892 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-569c9594-4eba-462f-b26d-ab4bac05137f tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:03.701567 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-569c9594-4eba-462f-b26d-ab4bac05137f tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] [instance: 1f354001-86ee-4951-a9cb-23fcd9e678a9] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:03.710871 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-569c9594-4eba-462f-b26d-ab4bac05137f tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:03.711387 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-569c9594-4eba-462f-b26d-ab4bac05137f tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:03.711834 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-569c9594-4eba-462f-b26d-ab4bac05137f tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:03.712620 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-569c9594-4eba-462f-b26d-ab4bac05137f tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:03.713085 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-569c9594-4eba-462f-b26d-ab4bac05137f tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:03.713553 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-569c9594-4eba-462f-b26d-ab4bac05137f tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:03.837091 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-569c9594-4eba-462f-b26d-ab4bac05137f tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] 10.222.0.52 "GET /compute/v2.1/servers/1f354001-86ee-4951-a9cb-23fcd9e678a9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.154520 Oct 19 03:39:03.846275 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2670/5269] 10.222.0.52 () {58 vars in 1275 bytes} [Wed Oct 19 03:39:03 2022] GET /compute/v2.1/servers/1f354001-86ee-4951-a9cb-23fcd9e678a9/os-interface => generated 284 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:39:04.024174 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-1cb9da73-f5e4-49e0-98b6-5c646847ba6d tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:04.046150 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1cb9da73-f5e4-49e0-98b6-5c646847ba6d tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1506 microversion: 2.1 time: 0.568550 Oct 19 03:39:04.048083 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2600/5270] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:03 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1506 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:39:04.079940 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9566949b-1635-449d-b16c-4c39808033d8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:04.080775 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9566949b-1635-449d-b16c-4c39808033d8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:04.090072 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9566949b-1635-449d-b16c-4c39808033d8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:04.090574 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9566949b-1635-449d-b16c-4c39808033d8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:04.091234 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9566949b-1635-449d-b16c-4c39808033d8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:04.092248 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9566949b-1635-449d-b16c-4c39808033d8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:04.093035 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9566949b-1635-449d-b16c-4c39808033d8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:04.094024 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9566949b-1635-449d-b16c-4c39808033d8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:04.216276 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5e78c5bc-6ffe-4d19-8e8a-a6b1241d4f47 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:04.216910 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5e78c5bc-6ffe-4d19-8e8a-a6b1241d4f47 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 4fab83b8-8862-4295-adb7-e2bf5462a2d9] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:04.224896 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5e78c5bc-6ffe-4d19-8e8a-a6b1241d4f47 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:04.225420 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5e78c5bc-6ffe-4d19-8e8a-a6b1241d4f47 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:04.230671 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5e78c5bc-6ffe-4d19-8e8a-a6b1241d4f47 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:04.241097 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5e78c5bc-6ffe-4d19-8e8a-a6b1241d4f47 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:04.241097 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5e78c5bc-6ffe-4d19-8e8a-a6b1241d4f47 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:04.241097 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5e78c5bc-6ffe-4d19-8e8a-a6b1241d4f47 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:04.987965 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-9566949b-1635-449d-b16c-4c39808033d8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:05.011909 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9566949b-1635-449d-b16c-4c39808033d8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1506 microversion: 2.1 time: 0.941663 Oct 19 03:39:05.037848 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2671/5271] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:04 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1506 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:39:05.059094 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-433b4d1d-b406-4d7d-abc0-4ca9a5750087 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:05.059094 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-433b4d1d-b406-4d7d-abc0-4ca9a5750087 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] [instance: d368a182-a350-4d0c-803d-2972af3aeb7d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:05.083202 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-433b4d1d-b406-4d7d-abc0-4ca9a5750087 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:05.083887 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-433b4d1d-b406-4d7d-abc0-4ca9a5750087 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:05.084519 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-433b4d1d-b406-4d7d-abc0-4ca9a5750087 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:05.085486 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-433b4d1d-b406-4d7d-abc0-4ca9a5750087 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:05.086111 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-433b4d1d-b406-4d7d-abc0-4ca9a5750087 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:05.086732 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-433b4d1d-b406-4d7d-abc0-4ca9a5750087 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:05.235601 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5e78c5bc-6ffe-4d19-8e8a-a6b1241d4f47 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4729a0afd69480f99642266e0eec17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce5e9f9a4644b27a24b2f4c06df97bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:05.246092 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5e78c5bc-6ffe-4d19-8e8a-a6b1241d4f47 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/4fab83b8-8862-4295-adb7-e2bf5462a2d9" status: 200 len: 1734 microversion: 2.1 time: 1.033762 Oct 19 03:39:05.247040 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2601/5272] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:04 2022] GET /compute/v2.1/servers/4fab83b8-8862-4295-adb7-e2bf5462a2d9 => generated 1734 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:39:05.252246 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-bc657e06-eae0-4a18-a726-9b0e00aa8c51 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:05.253562 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-bc657e06-eae0-4a18-a726-9b0e00aa8c51 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Failed to fetch instance by id 9223372036854775808 {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 19 03:39:05.254431 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-bc657e06-eae0-4a18-a726-9b0e00aa8c51 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Oct 19 03:39:05.256243 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-bc657e06-eae0-4a18-a726-9b0e00aa8c51 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Request method failure captured: Oct 19 03:39:05.256243 n-d-861333-8 devstack@n-api.service[121134]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Oct 19 03:39:05.256243 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:39:05.256243 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:39:05.256243 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:39:05.256243 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:39:05.256243 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:39:05.256243 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:39:05.256243 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:39:05.256243 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:39:05.256243 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3EK4yDar5R5kGdpWRPopK281fOgxjiWCAZdy3tbDZzFYZxrN53hSsTq0YyAxsfcVRT4cF0jU61e6walOKxMx_njT0L3WOIYEymBjzmNzdXOa-UhYNf83BpQOShCJts2aNodNdu7YjeLcAcuRF0ZOjoH0xsH4HoNSzc8IfQzKhRz4vw Oct 19 03:39:05.256243 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:39:05.256243 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:39:05.256243 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:39:05.256243 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:39:05.256243 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:39:05.256243 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:39:05.256243 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 34bd94983fbf4a8aa49aff65c076e9e3 Oct 19 03:39:05.256243 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:39:05.256243 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:39:05.256243 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:39:05.256243 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_34bd94983fbf4a8aa49aff65c076e9e3", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:39:05.256243 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:39:05.256243 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 34bd94983fbf4a8aa49aff65c076e9e3 Oct 19 03:39:05.256243 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:39:05.256243 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ServersNegativeTestJSON-553742303-project Oct 19 03:39:05.256243 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:39:05.256243 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:39:05.256243 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 771feb133bc046588552d3af98f8e0a1 Oct 19 03:39:05.256243 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ServersNegativeTestJSON-553742303-project Oct 19 03:39:05.256243 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:39:05.256243 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance 9223372036854775808 could not be found. Oct 19 03:39:05.256243 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '9223372036854775808'} Oct 19 03:39:05.256243 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:39:05.256243 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:39:05.256243 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:39:05.256243 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:39:05.256243 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 19 03:39:05.256243 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 19 03:39:05.256243 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Oct 19 03:39:05.256243 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:39:05.256243 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:39:05.256243 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:39:05.256243 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:39:05.256243 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:39:05.256243 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:39:05.256243 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:39:05.256243 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:39:05.256243 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:39:05.256243 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:39:05.256243 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 03:39:05.256243 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 03:39:05.256243 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 03:39:05.256243 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 03:39:05.256243 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:39:05.256243 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:39:05.256243 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:39:05.256243 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:39:05.256243 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Oct 19 03:39:05.256243 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:39:05.256243 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:39:05.256243 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:39:05.256243 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:39:05.256243 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:39:05.261202 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:39:05.261202 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:39:05.261202 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:39:05.261202 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Oct 19 03:39:05.261202 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:39:05.265839 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-bc657e06-eae0-4a18-a726-9b0e00aa8c51 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:39:05.267033 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-bc657e06-eae0-4a18-a726-9b0e00aa8c51 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.018775 Oct 19 03:39:05.268123 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2602/5273] 10.222.0.52 () {58 vars in 1188 bytes} [Wed Oct 19 03:39:05 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 03:39:05.286357 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d716997e-8807-4452-aeae-24ef2dbfcb04 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:05.287590 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d716997e-8807-4452-aeae-24ef2dbfcb04 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:05.303314 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d716997e-8807-4452-aeae-24ef2dbfcb04 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:05.307366 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d716997e-8807-4452-aeae-24ef2dbfcb04 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:05.307366 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d716997e-8807-4452-aeae-24ef2dbfcb04 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:05.310231 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d716997e-8807-4452-aeae-24ef2dbfcb04 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:05.311180 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d716997e-8807-4452-aeae-24ef2dbfcb04 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:05.313642 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d716997e-8807-4452-aeae-24ef2dbfcb04 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:05.350801 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-433b4d1d-b406-4d7d-abc0-4ca9a5750087 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4670fd4408d4454784251a880d5a72f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf91777fa414ddaa797d735e7d2a275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:05.362470 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-433b4d1d-b406-4d7d-abc0-4ca9a5750087 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] 10.222.0.52 "GET /compute/v2.1/servers/d368a182-a350-4d0c-803d-2972af3aeb7d" status: 200 len: 1306 microversion: 2.1 time: 0.322967 Oct 19 03:39:05.365304 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2672/5274] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:05 2022] GET /compute/v2.1/servers/d368a182-a350-4d0c-803d-2972af3aeb7d => generated 1306 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:39:05.675379 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d716997e-8807-4452-aeae-24ef2dbfcb04 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:05.684814 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d716997e-8807-4452-aeae-24ef2dbfcb04 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1506 microversion: 2.1 time: 0.403389 Oct 19 03:39:05.685740 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2603/5275] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:05 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1506 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:39:05.708861 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0e14c5b5-155a-4434-9fa4-e303649eb154 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:05.709513 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0e14c5b5-155a-4434-9fa4-e303649eb154 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:05.716171 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0e14c5b5-155a-4434-9fa4-e303649eb154 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:05.716666 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0e14c5b5-155a-4434-9fa4-e303649eb154 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:05.717108 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0e14c5b5-155a-4434-9fa4-e303649eb154 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:05.718036 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0e14c5b5-155a-4434-9fa4-e303649eb154 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:05.718676 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0e14c5b5-155a-4434-9fa4-e303649eb154 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:05.719114 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0e14c5b5-155a-4434-9fa4-e303649eb154 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:06.165713 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-0e14c5b5-155a-4434-9fa4-e303649eb154 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:06.185524 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0e14c5b5-155a-4434-9fa4-e303649eb154 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1506 microversion: 2.1 time: 0.480939 Oct 19 03:39:06.191417 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2673/5276] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:05 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1506 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:39:06.213121 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a53abdac-0031-407f-9cc9-1f691540655b tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:06.213914 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a53abdac-0031-407f-9cc9-1f691540655b tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Failed to fetch instance by id -1 {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 19 03:39:06.214681 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-a53abdac-0031-407f-9cc9-1f691540655b tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] HTTP exception thrown: Instance -1 could not be found. Oct 19 03:39:06.217020 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a53abdac-0031-407f-9cc9-1f691540655b tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Request method failure captured: Oct 19 03:39:06.217020 n-d-861333-8 devstack@n-api.service[121134]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Oct 19 03:39:06.217020 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:39:06.217020 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:39:06.217020 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:39:06.217020 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:39:06.217020 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:39:06.217020 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:39:06.217020 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:39:06.217020 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:39:06.217020 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3EK4yDar5R5kGdpWRPopK281fOgxjiWCAZdy3tbDZzFYZxrN53hSsTq0YyAxsfcVRT4cF0jU61e6walOKxMx_njT0L3WOIYEymBjzmNzdXOa-UhYNf83BpQOShCJts2aNodNdu7YjeLcAcuRF0ZOjoH0xsH4HoNSzc8IfQzKhRz4vw Oct 19 03:39:06.217020 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:39:06.217020 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:39:06.217020 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:39:06.217020 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:39:06.217020 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:39:06.217020 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:39:06.217020 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 34bd94983fbf4a8aa49aff65c076e9e3 Oct 19 03:39:06.217020 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:39:06.217020 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:39:06.217020 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:39:06.217020 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_34bd94983fbf4a8aa49aff65c076e9e3", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:39:06.217020 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:39:06.217020 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 34bd94983fbf4a8aa49aff65c076e9e3 Oct 19 03:39:06.217020 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:39:06.217020 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ServersNegativeTestJSON-553742303-project Oct 19 03:39:06.217020 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:39:06.217020 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:39:06.217020 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 771feb133bc046588552d3af98f8e0a1 Oct 19 03:39:06.217020 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ServersNegativeTestJSON-553742303-project Oct 19 03:39:06.217020 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:39:06.217020 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance -1 could not be found. Oct 19 03:39:06.217020 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '-1'} Oct 19 03:39:06.217020 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:39:06.217020 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:39:06.217020 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:39:06.217020 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:39:06.217020 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 19 03:39:06.217020 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 19 03:39:06.217020 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Oct 19 03:39:06.217020 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:39:06.217020 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:39:06.217020 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:39:06.217020 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:39:06.217020 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:39:06.217020 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:39:06.217020 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:39:06.217020 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:39:06.217020 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:39:06.217020 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:39:06.217020 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 03:39:06.217020 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 03:39:06.217020 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 03:39:06.217020 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 03:39:06.217020 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:39:06.217020 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:39:06.217020 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:39:06.217020 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:39:06.217020 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Oct 19 03:39:06.217020 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:39:06.217020 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:39:06.217020 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:39:06.217020 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:39:06.217020 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:39:06.217020 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:39:06.221828 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:39:06.221828 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:39:06.221828 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Oct 19 03:39:06.221828 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:39:06.225932 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a53abdac-0031-407f-9cc9-1f691540655b tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Returning 404 to user: Instance -1 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:39:06.225932 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a53abdac-0031-407f-9cc9-1f691540655b tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.015206 Oct 19 03:39:06.233471 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-91291ba8-8eed-4f71-bfb3-556e96dfba25 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:06.234961 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-91291ba8-8eed-4f71-bfb3-556e96dfba25 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:06.241473 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2604/5277] 10.222.0.52 () {58 vars in 1137 bytes} [Wed Oct 19 03:39:06 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 03:39:06.253792 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-91291ba8-8eed-4f71-bfb3-556e96dfba25 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:06.253792 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-91291ba8-8eed-4f71-bfb3-556e96dfba25 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:06.253792 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-91291ba8-8eed-4f71-bfb3-556e96dfba25 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:06.253792 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-91291ba8-8eed-4f71-bfb3-556e96dfba25 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:06.253792 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-91291ba8-8eed-4f71-bfb3-556e96dfba25 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:06.253792 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-91291ba8-8eed-4f71-bfb3-556e96dfba25 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:06.273547 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-19be1258-948c-4db5-a50a-b9e469d9c94e tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:06.277599 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-19be1258-948c-4db5-a50a-b9e469d9c94e tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 4fab83b8-8862-4295-adb7-e2bf5462a2d9] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:06.289535 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-19be1258-948c-4db5-a50a-b9e469d9c94e tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:06.291408 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-19be1258-948c-4db5-a50a-b9e469d9c94e tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:06.291950 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-19be1258-948c-4db5-a50a-b9e469d9c94e tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:06.294158 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-19be1258-948c-4db5-a50a-b9e469d9c94e tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:06.294779 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-19be1258-948c-4db5-a50a-b9e469d9c94e tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:06.302756 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-19be1258-948c-4db5-a50a-b9e469d9c94e tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:06.780016 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-91291ba8-8eed-4f71-bfb3-556e96dfba25 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:06.785019 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-19be1258-948c-4db5-a50a-b9e469d9c94e tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4729a0afd69480f99642266e0eec17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce5e9f9a4644b27a24b2f4c06df97bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:06.791222 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-91291ba8-8eed-4f71-bfb3-556e96dfba25 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1506 microversion: 2.1 time: 0.559902 Oct 19 03:39:06.791222 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2674/5278] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:06 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1506 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:39:06.795296 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d9c0098f-328d-4b6e-8d64-e27846f097b5 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:06.796190 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d9c0098f-328d-4b6e-8d64-e27846f097b5 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] [instance: d368a182-a350-4d0c-803d-2972af3aeb7d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:06.802892 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d9c0098f-328d-4b6e-8d64-e27846f097b5 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:06.803702 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d9c0098f-328d-4b6e-8d64-e27846f097b5 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:06.804426 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d9c0098f-328d-4b6e-8d64-e27846f097b5 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:06.807403 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d9c0098f-328d-4b6e-8d64-e27846f097b5 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:06.808168 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d9c0098f-328d-4b6e-8d64-e27846f097b5 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:06.808831 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d9c0098f-328d-4b6e-8d64-e27846f097b5 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:06.812002 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-19be1258-948c-4db5-a50a-b9e469d9c94e tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/4fab83b8-8862-4295-adb7-e2bf5462a2d9" status: 200 len: 1714 microversion: 2.1 time: 0.545342 Oct 19 03:39:06.813081 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2605/5279] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:06 2022] GET /compute/v2.1/servers/4fab83b8-8862-4295-adb7-e2bf5462a2d9 => generated 1714 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:39:06.818122 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5f908abb-d95e-4228-a635-79b7cf383b84 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:06.818984 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5f908abb-d95e-4228-a635-79b7cf383b84 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:06.825336 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5f908abb-d95e-4228-a635-79b7cf383b84 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:06.827956 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5f908abb-d95e-4228-a635-79b7cf383b84 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:06.827956 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5f908abb-d95e-4228-a635-79b7cf383b84 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:06.827956 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5f908abb-d95e-4228-a635-79b7cf383b84 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:06.827956 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5f908abb-d95e-4228-a635-79b7cf383b84 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:06.828638 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5f908abb-d95e-4228-a635-79b7cf383b84 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:06.833776 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=100 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:39:06.964692 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d9c0098f-328d-4b6e-8d64-e27846f097b5 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4670fd4408d4454784251a880d5a72f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf91777fa414ddaa797d735e7d2a275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:06.975714 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d9c0098f-328d-4b6e-8d64-e27846f097b5 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] 10.222.0.52 "GET /compute/v2.1/servers/d368a182-a350-4d0c-803d-2972af3aeb7d" status: 200 len: 1306 microversion: 2.1 time: 0.184591 Oct 19 03:39:06.990900 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2675/5280] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:06 2022] GET /compute/v2.1/servers/d368a182-a350-4d0c-803d-2972af3aeb7d => generated 1306 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:39:07.041775 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-b59546c9-8178-4385-9705-1acd8c120761 req-9cb5dc39-8d50-4522-934f-39c36b2e0ae5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f354001-86ee-4951-a9cb-23fcd9e678a9", "tag": "df2c5d9b-837d-4ae2-918d-8eef7876b140"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:39:07.082225 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-b59546c9-8178-4385-9705-1acd8c120761 req-9cb5dc39-8d50-4522-934f-39c36b2e0ae5 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:07.082885 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-b59546c9-8178-4385-9705-1acd8c120761 req-9cb5dc39-8d50-4522-934f-39c36b2e0ae5 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:07.085670 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-b59546c9-8178-4385-9705-1acd8c120761 req-9cb5dc39-8d50-4522-934f-39c36b2e0ae5 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:07.107368 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-b59546c9-8178-4385-9705-1acd8c120761 req-9cb5dc39-8d50-4522-934f-39c36b2e0ae5 service nova] Creating event network-changed:df2c5d9b-837d-4ae2-918d-8eef7876b140 for instance 1f354001-86ee-4951-a9cb-23fcd9e678a9 on n-h2-861333-8 Oct 19 03:39:07.115251 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-b59546c9-8178-4385-9705-1acd8c120761 req-9cb5dc39-8d50-4522-934f-39c36b2e0ae5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085100 Oct 19 03:39:07.118631 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2676/5281] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:39:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:39:07.126358 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e974922e-3d0f-4278-9d02-83d678ebdda4 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:07.131212 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e974922e-3d0f-4278-9d02-83d678ebdda4 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 4fab83b8-8862-4295-adb7-e2bf5462a2d9] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:07.146287 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e974922e-3d0f-4278-9d02-83d678ebdda4 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:07.147494 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e974922e-3d0f-4278-9d02-83d678ebdda4 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:07.148129 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e974922e-3d0f-4278-9d02-83d678ebdda4 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:07.149319 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e974922e-3d0f-4278-9d02-83d678ebdda4 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:07.150554 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e974922e-3d0f-4278-9d02-83d678ebdda4 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:07.151213 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e974922e-3d0f-4278-9d02-83d678ebdda4 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:07.307980 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5f908abb-d95e-4228-a635-79b7cf383b84 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:07.317680 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5f908abb-d95e-4228-a635-79b7cf383b84 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1506 microversion: 2.1 time: 0.503223 Oct 19 03:39:07.346561 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-e974922e-3d0f-4278-9d02-83d678ebdda4 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] HTTP exception thrown: Cannot 'detach_volume' instance 4fab83b8-8862-4295-adb7-e2bf5462a2d9 while it is in vm_state rescued Oct 19 03:39:07.355852 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e974922e-3d0f-4278-9d02-83d678ebdda4 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Request method failure captured: Oct 19 03:39:07.355852 n-d-861333-8 devstack@n-api.service[121135]: request: DELETE /compute/v2.1/servers/4fab83b8-8862-4295-adb7-e2bf5462a2d9/os-volume_attachments/ecd82c24-c4d4-4e21-8b87-481a44c64ae1 HTTP/1.1 Oct 19 03:39:07.355852 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:39:07.355852 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:39:07.355852 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:39:07.355852 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:39:07.355852 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:39:07.355852 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:39:07.355852 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:39:07.355852 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:39:07.355852 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT3BmoEKz0EhW7NaUKeOkQsZRXl8ERfsAKAMxU0GUBdc2f_V_CqkDPpZu62NL2einDTJrDUFbtRF7OMHEg091oC7NSi4gfYN6KT9w4SCkkHNILzmL1G1frQPfKMrDDDqTbb0782yvc_4ZYCpfzt0d6J1jKWlIQL4vx50kauya3LDEzsA Oct 19 03:39:07.355852 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:39:07.355852 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:39:07.355852 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:39:07.355852 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:39:07.355852 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:39:07.355852 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:39:07.355852 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 2ce5e9f9a4644b27a24b2f4c06df97bc Oct 19 03:39:07.355852 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-684190061 Oct 19 03:39:07.355852 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:39:07.355852 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:39:07.355852 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2ce5e9f9a4644b27a24b2f4c06df97bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2ce5e9f9a4644b27a24b2f4c06df97bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2ce5e9f9a4644b27a24b2f4c06df97bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2ce5e9f9a4644b27a24b2f4c06df97bc", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:39:07.355852 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ServerRescueNegativeTestJSON-684190061 Oct 19 03:39:07.355852 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 2ce5e9f9a4644b27a24b2f4c06df97bc Oct 19 03:39:07.355852 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-684190061 Oct 19 03:39:07.355852 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ServerRescueNegativeTestJSON-684190061-project Oct 19 03:39:07.355852 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:39:07.355852 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:39:07.355852 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: b4729a0afd69480f99642266e0eec17e Oct 19 03:39:07.355852 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ServerRescueNegativeTestJSON-684190061-project Oct 19 03:39:07.355852 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:39:07.355852 n-d-861333-8 devstack@n-api.service[121135]: exception: Cannot 'detach_volume' instance 4fab83b8-8862-4295-adb7-e2bf5462a2d9 while it is in vm_state rescued Oct 19 03:39:07.355852 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'server_id': '4fab83b8-8862-4295-adb7-e2bf5462a2d9', 'id': 'ecd82c24-c4d4-4e21-8b87-481a44c64ae1'} Oct 19 03:39:07.355852 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:39:07.355852 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:39:07.355852 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 19 03:39:07.355852 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 19 03:39:07.355852 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 19 03:39:07.355852 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 19 03:39:07.355852 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 19 03:39:07.355852 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 19 03:39:07.355852 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4fab83b8-8862-4295-adb7-e2bf5462a2d9 in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 19 03:39:07.355852 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:39:07.355852 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:39:07.355852 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:39:07.355852 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:39:07.355852 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:39:07.355852 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:39:07.355852 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:39:07.355852 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:39:07.355852 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:39:07.355852 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:39:07.355852 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 19 03:39:07.355852 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 19 03:39:07.355852 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 19 03:39:07.355852 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 19 03:39:07.355852 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 4fab83b8-8862-4295-adb7-e2bf5462a2d9 while it is in vm_state rescued Oct 19 03:39:07.355852 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:39:07.355852 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:39:07.355852 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:39:07.355852 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:39:07.360827 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:39:07.360827 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:39:07.360827 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:39:07.360827 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:39:07.360827 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 4fab83b8-8862-4295-adb7-e2bf5462a2d9 while it is in vm_state rescued Oct 19 03:39:07.360827 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:39:07.360827 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e974922e-3d0f-4278-9d02-83d678ebdda4 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Returning 409 to user: Cannot 'detach_volume' instance 4fab83b8-8862-4295-adb7-e2bf5462a2d9 while it is in vm_state rescued {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:39:07.360827 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e974922e-3d0f-4278-9d02-83d678ebdda4 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "DELETE /compute/v2.1/servers/4fab83b8-8862-4295-adb7-e2bf5462a2d9/os-volume_attachments/ecd82c24-c4d4-4e21-8b87-481a44c64ae1" status: 409 len: 152 microversion: 2.1 time: 0.231314 Oct 19 03:39:07.360827 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2677/5282] 10.222.0.52 () {58 vars in 1416 bytes} [Wed Oct 19 03:39:07 2022] DELETE /compute/v2.1/servers/4fab83b8-8862-4295-adb7-e2bf5462a2d9/os-volume_attachments/ecd82c24-c4d4-4e21-8b87-481a44c64ae1 => generated 152 bytes in 232 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 19 03:39:07.363296 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2606/5283] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:06 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1506 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:39:07.368592 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7e97e0f1-16fb-4fda-9015-a45fe79f7b8e tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:39:07.382001 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-02069b0b-04bc-4f47-a5f4-294f1ca3f5b6 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:39:07.383166 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7e97e0f1-16fb-4fda-9015-a45fe79f7b8e tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: a55cfa11-dc68-4303-b619-4d760ee4d808] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:07.383372 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-02069b0b-04bc-4f47-a5f4-294f1ca3f5b6 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 4fab83b8-8862-4295-adb7-e2bf5462a2d9] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:07.407492 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-7e97e0f1-16fb-4fda-9015-a45fe79f7b8e tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] HTTP exception thrown: Instance a55cfa11-dc68-4303-b619-4d760ee4d808 could not be found. Oct 19 03:39:07.409737 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-02069b0b-04bc-4f47-a5f4-294f1ca3f5b6 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:07.410465 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-02069b0b-04bc-4f47-a5f4-294f1ca3f5b6 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:07.411097 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-02069b0b-04bc-4f47-a5f4-294f1ca3f5b6 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:07.412058 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-02069b0b-04bc-4f47-a5f4-294f1ca3f5b6 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:07.412700 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-02069b0b-04bc-4f47-a5f4-294f1ca3f5b6 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:07.413315 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-02069b0b-04bc-4f47-a5f4-294f1ca3f5b6 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:07.421030 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7e97e0f1-16fb-4fda-9015-a45fe79f7b8e tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Request method failure captured: Oct 19 03:39:07.421030 n-d-861333-8 devstack@n-api.service[121135]: request: POST /compute/v2.1/servers/a55cfa11-dc68-4303-b619-4d760ee4d808/action HTTP/1.1 Oct 19 03:39:07.421030 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:39:07.421030 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:39:07.421030 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:39:07.421030 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 19 Oct 19 03:39:07.421030 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:39:07.421030 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:39:07.421030 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:39:07.421030 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:39:07.421030 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT3EK4yDar5R5kGdpWRPopK281fOgxjiWCAZdy3tbDZzFYZxrN53hSsTq0YyAxsfcVRT4cF0jU61e6walOKxMx_njT0L3WOIYEymBjzmNzdXOa-UhYNf83BpQOShCJts2aNodNdu7YjeLcAcuRF0ZOjoH0xsH4HoNSzc8IfQzKhRz4vw Oct 19 03:39:07.421030 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:39:07.421030 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:39:07.421030 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:39:07.421030 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:39:07.421030 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:39:07.421030 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:39:07.421030 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 34bd94983fbf4a8aa49aff65c076e9e3 Oct 19 03:39:07.421030 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:39:07.421030 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:39:07.421030 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:39:07.421030 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_34bd94983fbf4a8aa49aff65c076e9e3", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:39:07.421030 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:39:07.421030 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 34bd94983fbf4a8aa49aff65c076e9e3 Oct 19 03:39:07.421030 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:39:07.421030 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ServersNegativeTestJSON-553742303-project Oct 19 03:39:07.421030 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:39:07.421030 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:39:07.421030 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 771feb133bc046588552d3af98f8e0a1 Oct 19 03:39:07.421030 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ServersNegativeTestJSON-553742303-project Oct 19 03:39:07.421030 n-d-861333-8 devstack@n-api.service[121135]: Oct 19 03:39:07.421030 n-d-861333-8 devstack@n-api.service[121135]: {"forceDelete": {}} Oct 19 03:39:07.421030 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:39:07.421030 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance a55cfa11-dc68-4303-b619-4d760ee4d808 could not be found. Oct 19 03:39:07.421030 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': 'a55cfa11-dc68-4303-b619-4d760ee4d808', 'body': {'forceDelete': {}}} Oct 19 03:39:07.421030 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:39:07.421030 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:39:07.421030 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:39:07.421030 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:39:07.421030 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:39:07.421030 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:39:07.421030 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 19 03:39:07.421030 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 19 03:39:07.421030 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a55cfa11-dc68-4303-b619-4d760ee4d808 could not be found. Oct 19 03:39:07.421030 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:39:07.421030 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:39:07.421030 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:39:07.421030 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:39:07.421030 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:39:07.421030 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:39:07.421030 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:39:07.421030 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:39:07.421030 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:39:07.421030 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:39:07.421030 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Oct 19 03:39:07.421030 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 19 03:39:07.421030 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:39:07.421030 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:39:07.421030 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a55cfa11-dc68-4303-b619-4d760ee4d808 could not be found. Oct 19 03:39:07.421030 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:39:07.421030 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:39:07.421030 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:39:07.421030 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:39:07.421030 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:39:07.421030 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:39:07.427143 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:39:07.427143 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:39:07.427143 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a55cfa11-dc68-4303-b619-4d760ee4d808 could not be found. Oct 19 03:39:07.427143 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:39:07.428305 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7e97e0f1-16fb-4fda-9015-a45fe79f7b8e tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Returning 404 to user: Instance a55cfa11-dc68-4303-b619-4d760ee4d808 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:39:07.429358 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7e97e0f1-16fb-4fda-9015-a45fe79f7b8e tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "POST /compute/v2.1/servers/a55cfa11-dc68-4303-b619-4d760ee4d808/action" status: 404 len: 111 microversion: 2.1 time: 0.064823 Oct 19 03:39:07.433741 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2678/5284] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:39:07 2022] POST /compute/v2.1/servers/a55cfa11-dc68-4303-b619-4d760ee4d808/action => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:39:07.445805 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a1ab8f08-a50b-45c0-8097-cbcd6479dcbb tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:07.446833 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a1ab8f08-a50b-45c0-8097-cbcd6479dcbb tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:07.472783 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a1ab8f08-a50b-45c0-8097-cbcd6479dcbb tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:07.473626 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a1ab8f08-a50b-45c0-8097-cbcd6479dcbb tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:07.474325 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a1ab8f08-a50b-45c0-8097-cbcd6479dcbb tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:07.475288 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a1ab8f08-a50b-45c0-8097-cbcd6479dcbb tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:07.475930 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a1ab8f08-a50b-45c0-8097-cbcd6479dcbb tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:07.476571 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a1ab8f08-a50b-45c0-8097-cbcd6479dcbb tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:07.743786 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-02069b0b-04bc-4f47-a5f4-294f1ca3f5b6 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "POST /compute/v2.1/servers/4fab83b8-8862-4295-adb7-e2bf5462a2d9/action" status: 202 len: 0 microversion: 2.1 time: 0.380471 Oct 19 03:39:07.744411 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2607/5285] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:39:07 2022] POST /compute/v2.1/servers/4fab83b8-8862-4295-adb7-e2bf5462a2d9/action => generated 0 bytes in 382 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:39:07.753612 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ca0766a2-9d98-4c4d-98a1-9250ac069973 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:07.758583 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ca0766a2-9d98-4c4d-98a1-9250ac069973 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 4fab83b8-8862-4295-adb7-e2bf5462a2d9] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:07.770557 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ca0766a2-9d98-4c4d-98a1-9250ac069973 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:07.771485 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ca0766a2-9d98-4c4d-98a1-9250ac069973 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:07.772212 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ca0766a2-9d98-4c4d-98a1-9250ac069973 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:07.773231 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ca0766a2-9d98-4c4d-98a1-9250ac069973 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:07.773967 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ca0766a2-9d98-4c4d-98a1-9250ac069973 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:07.774651 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ca0766a2-9d98-4c4d-98a1-9250ac069973 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:07.949197 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a1ab8f08-a50b-45c0-8097-cbcd6479dcbb tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:07.960024 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a1ab8f08-a50b-45c0-8097-cbcd6479dcbb tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1506 microversion: 2.1 time: 0.522605 Oct 19 03:39:07.960728 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2679/5286] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:07 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1506 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:39:07.989929 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-51bda1ff-cf95-41f7-b3ad-2b592918c698 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:07.990832 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-51bda1ff-cf95-41f7-b3ad-2b592918c698 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:08.004419 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-51bda1ff-cf95-41f7-b3ad-2b592918c698 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:08.005290 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-51bda1ff-cf95-41f7-b3ad-2b592918c698 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:08.006467 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-51bda1ff-cf95-41f7-b3ad-2b592918c698 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:08.007727 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-51bda1ff-cf95-41f7-b3ad-2b592918c698 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:08.011823 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-51bda1ff-cf95-41f7-b3ad-2b592918c698 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:08.012521 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-51bda1ff-cf95-41f7-b3ad-2b592918c698 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:09.302459 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ca0766a2-9d98-4c4d-98a1-9250ac069973 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4729a0afd69480f99642266e0eec17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce5e9f9a4644b27a24b2f4c06df97bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:09.320204 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ca0766a2-9d98-4c4d-98a1-9250ac069973 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/4fab83b8-8862-4295-adb7-e2bf5462a2d9" status: 200 len: 1722 microversion: 2.1 time: 1.570704 Oct 19 03:39:09.322231 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2608/5287] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:07 2022] GET /compute/v2.1/servers/4fab83b8-8862-4295-adb7-e2bf5462a2d9 => generated 1722 bytes in 1574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:39:09.341846 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a04dc3e4-8706-43f1-a5a3-481773f93bcc tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:09.343131 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a04dc3e4-8706-43f1-a5a3-481773f93bcc tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] [instance: d368a182-a350-4d0c-803d-2972af3aeb7d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:09.350500 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a04dc3e4-8706-43f1-a5a3-481773f93bcc tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:09.351409 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a04dc3e4-8706-43f1-a5a3-481773f93bcc tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:09.352274 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a04dc3e4-8706-43f1-a5a3-481773f93bcc tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:09.353506 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a04dc3e4-8706-43f1-a5a3-481773f93bcc tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:09.354216 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a04dc3e4-8706-43f1-a5a3-481773f93bcc tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:09.354879 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a04dc3e4-8706-43f1-a5a3-481773f93bcc tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:09.438847 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-51bda1ff-cf95-41f7-b3ad-2b592918c698 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:09.464018 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-51bda1ff-cf95-41f7-b3ad-2b592918c698 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1506 microversion: 2.1 time: 1.480185 Oct 19 03:39:09.465124 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2680/5288] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:07 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1506 bytes in 1482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:39:09.503059 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a2b32ef1-7cff-4a62-a274-09009bccc81c tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:39:09.506772 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a2b32ef1-7cff-4a62-a274-09009bccc81c tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 3b0aeecf-dc8f-4367-8dfe-983c9606395e] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:09.516126 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-a2b32ef1-7cff-4a62-a274-09009bccc81c tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] HTTP exception thrown: Instance 3b0aeecf-dc8f-4367-8dfe-983c9606395e could not be found. Oct 19 03:39:09.535412 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a2b32ef1-7cff-4a62-a274-09009bccc81c tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Request method failure captured: Oct 19 03:39:09.535412 n-d-861333-8 devstack@n-api.service[121135]: request: POST /compute/v2.1/servers/3b0aeecf-dc8f-4367-8dfe-983c9606395e/action HTTP/1.1 Oct 19 03:39:09.535412 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:39:09.535412 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:39:09.535412 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:39:09.535412 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 39 Oct 19 03:39:09.535412 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:39:09.535412 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:39:09.535412 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:39:09.535412 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:39:09.535412 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT3EK4yDar5R5kGdpWRPopK281fOgxjiWCAZdy3tbDZzFYZxrN53hSsTq0YyAxsfcVRT4cF0jU61e6walOKxMx_njT0L3WOIYEymBjzmNzdXOa-UhYNf83BpQOShCJts2aNodNdu7YjeLcAcuRF0ZOjoH0xsH4HoNSzc8IfQzKhRz4vw Oct 19 03:39:09.535412 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:39:09.535412 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:39:09.535412 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:39:09.535412 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:39:09.535412 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:39:09.535412 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:39:09.535412 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 34bd94983fbf4a8aa49aff65c076e9e3 Oct 19 03:39:09.535412 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:39:09.535412 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:39:09.535412 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:39:09.535412 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_34bd94983fbf4a8aa49aff65c076e9e3", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:39:09.535412 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:39:09.535412 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 34bd94983fbf4a8aa49aff65c076e9e3 Oct 19 03:39:09.535412 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:39:09.535412 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ServersNegativeTestJSON-553742303-project Oct 19 03:39:09.535412 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:39:09.535412 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:39:09.535412 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 771feb133bc046588552d3af98f8e0a1 Oct 19 03:39:09.535412 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ServersNegativeTestJSON-553742303-project Oct 19 03:39:09.535412 n-d-861333-8 devstack@n-api.service[121135]: Oct 19 03:39:09.535412 n-d-861333-8 devstack@n-api.service[121135]: {"os-getConsoleOutput": {"length": 10}} Oct 19 03:39:09.535412 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:39:09.535412 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance 3b0aeecf-dc8f-4367-8dfe-983c9606395e could not be found. Oct 19 03:39:09.535412 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '3b0aeecf-dc8f-4367-8dfe-983c9606395e', 'body': {'os-getConsoleOutput': {'length': 10}}} Oct 19 03:39:09.535412 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:39:09.535412 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:39:09.535412 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:39:09.535412 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:39:09.535412 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:39:09.535412 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:39:09.535412 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 19 03:39:09.535412 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 19 03:39:09.535412 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b0aeecf-dc8f-4367-8dfe-983c9606395e could not be found. Oct 19 03:39:09.535412 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:39:09.535412 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:39:09.535412 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:39:09.535412 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:39:09.535412 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:39:09.535412 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:39:09.535412 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:39:09.535412 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:39:09.535412 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:39:09.535412 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:39:09.535412 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:39:09.535412 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:39:09.535412 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Oct 19 03:39:09.535412 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 19 03:39:09.535412 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:39:09.535412 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:39:09.535412 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b0aeecf-dc8f-4367-8dfe-983c9606395e could not be found. Oct 19 03:39:09.535412 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:39:09.535412 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:39:09.535412 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:39:09.535412 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:39:09.540991 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:39:09.540991 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:39:09.540991 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:39:09.540991 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:39:09.540991 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b0aeecf-dc8f-4367-8dfe-983c9606395e could not be found. Oct 19 03:39:09.540991 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:39:09.552826 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a2b32ef1-7cff-4a62-a274-09009bccc81c tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Returning 404 to user: Instance 3b0aeecf-dc8f-4367-8dfe-983c9606395e could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:39:09.552826 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a2b32ef1-7cff-4a62-a274-09009bccc81c tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "POST /compute/v2.1/servers/3b0aeecf-dc8f-4367-8dfe-983c9606395e/action" status: 404 len: 111 microversion: 2.1 time: 0.054983 Oct 19 03:39:09.552826 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2681/5289] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:39:09 2022] POST /compute/v2.1/servers/3b0aeecf-dc8f-4367-8dfe-983c9606395e/action => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 03:39:09.560536 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-52572e7b-08f9-462f-ad1d-eddb24897962 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:09.561252 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-52572e7b-08f9-462f-ad1d-eddb24897962 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:09.583290 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-52572e7b-08f9-462f-ad1d-eddb24897962 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:09.585174 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-52572e7b-08f9-462f-ad1d-eddb24897962 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:09.585881 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-52572e7b-08f9-462f-ad1d-eddb24897962 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:09.588106 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-52572e7b-08f9-462f-ad1d-eddb24897962 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:09.588573 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-52572e7b-08f9-462f-ad1d-eddb24897962 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:09.589021 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-52572e7b-08f9-462f-ad1d-eddb24897962 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:10.060378 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:39:10.082271 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=6 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:39:10.101738 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a04dc3e4-8706-43f1-a5a3-481773f93bcc tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4670fd4408d4454784251a880d5a72f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf91777fa414ddaa797d735e7d2a275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:10.103343 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-52572e7b-08f9-462f-ad1d-eddb24897962 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:10.115457 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-52572e7b-08f9-462f-ad1d-eddb24897962 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1506 microversion: 2.1 time: 0.558832 Oct 19 03:39:10.115605 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a04dc3e4-8706-43f1-a5a3-481773f93bcc tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] 10.222.0.52 "GET /compute/v2.1/servers/d368a182-a350-4d0c-803d-2972af3aeb7d" status: 200 len: 1373 microversion: 2.1 time: 0.792053 Oct 19 03:39:10.120981 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2682/5290] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:09 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1506 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:39:10.150861 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2609/5291] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:09 2022] GET /compute/v2.1/servers/d368a182-a350-4d0c-803d-2972af3aeb7d => generated 1373 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:39:10.156782 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-93e9eb00-ab51-4870-bb16-6e579f6b010d tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:10.158528 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-93e9eb00-ab51-4870-bb16-6e579f6b010d tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:10.174876 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-93e9eb00-ab51-4870-bb16-6e579f6b010d tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:10.175623 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-93e9eb00-ab51-4870-bb16-6e579f6b010d tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:10.176084 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-93e9eb00-ab51-4870-bb16-6e579f6b010d tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:10.178321 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-93e9eb00-ab51-4870-bb16-6e579f6b010d tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:10.179271 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-93e9eb00-ab51-4870-bb16-6e579f6b010d tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:10.180890 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-93e9eb00-ab51-4870-bb16-6e579f6b010d tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:10.355379 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c3c187da-09f0-43ff-8fe4-f3515b96fb4c tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:10.359204 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c3c187da-09f0-43ff-8fe4-f3515b96fb4c tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 4fab83b8-8862-4295-adb7-e2bf5462a2d9] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:10.376650 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c3c187da-09f0-43ff-8fe4-f3515b96fb4c tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:10.376650 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c3c187da-09f0-43ff-8fe4-f3515b96fb4c tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:10.376650 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c3c187da-09f0-43ff-8fe4-f3515b96fb4c tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:10.377081 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c3c187da-09f0-43ff-8fe4-f3515b96fb4c tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:10.377653 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c3c187da-09f0-43ff-8fe4-f3515b96fb4c tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:10.378819 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c3c187da-09f0-43ff-8fe4-f3515b96fb4c tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:10.585568 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-93e9eb00-ab51-4870-bb16-6e579f6b010d tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:10.603007 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-93e9eb00-ab51-4870-bb16-6e579f6b010d tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1506 microversion: 2.1 time: 0.454496 Oct 19 03:39:10.604529 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2683/5292] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:10 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1506 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:39:10.631216 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d5b47179-0a46-4974-8f6f-21912a4932d8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:10.631216 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d5b47179-0a46-4974-8f6f-21912a4932d8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: c5956065-65c8-40a9-a2de-7814880aee50] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:10.635822 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-d5b47179-0a46-4974-8f6f-21912a4932d8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] HTTP exception thrown: Instance c5956065-65c8-40a9-a2de-7814880aee50 could not be found. Oct 19 03:39:10.637653 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d5b47179-0a46-4974-8f6f-21912a4932d8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Request method failure captured: Oct 19 03:39:10.637653 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/c5956065-65c8-40a9-a2de-7814880aee50 HTTP/1.1 Oct 19 03:39:10.637653 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:39:10.637653 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:39:10.637653 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:39:10.637653 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:39:10.637653 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:39:10.637653 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:39:10.637653 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:39:10.637653 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:39:10.637653 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT3EK4yDar5R5kGdpWRPopK281fOgxjiWCAZdy3tbDZzFYZxrN53hSsTq0YyAxsfcVRT4cF0jU61e6walOKxMx_njT0L3WOIYEymBjzmNzdXOa-UhYNf83BpQOShCJts2aNodNdu7YjeLcAcuRF0ZOjoH0xsH4HoNSzc8IfQzKhRz4vw Oct 19 03:39:10.637653 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:39:10.637653 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:39:10.637653 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:39:10.637653 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:39:10.637653 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:39:10.637653 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:39:10.637653 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 34bd94983fbf4a8aa49aff65c076e9e3 Oct 19 03:39:10.637653 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:39:10.637653 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:39:10.637653 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:39:10.637653 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_34bd94983fbf4a8aa49aff65c076e9e3", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:39:10.637653 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:39:10.637653 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 34bd94983fbf4a8aa49aff65c076e9e3 Oct 19 03:39:10.637653 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:39:10.637653 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ServersNegativeTestJSON-553742303-project Oct 19 03:39:10.637653 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:39:10.637653 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:39:10.637653 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 771feb133bc046588552d3af98f8e0a1 Oct 19 03:39:10.637653 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ServersNegativeTestJSON-553742303-project Oct 19 03:39:10.637653 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:39:10.637653 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance c5956065-65c8-40a9-a2de-7814880aee50 could not be found. Oct 19 03:39:10.637653 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': 'c5956065-65c8-40a9-a2de-7814880aee50'} Oct 19 03:39:10.637653 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:39:10.637653 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:39:10.637653 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:39:10.637653 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:39:10.637653 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:39:10.637653 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:39:10.637653 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 19 03:39:10.637653 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 19 03:39:10.637653 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5956065-65c8-40a9-a2de-7814880aee50 could not be found. Oct 19 03:39:10.637653 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:39:10.637653 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:39:10.637653 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:39:10.637653 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:39:10.637653 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:39:10.637653 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:39:10.637653 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:39:10.637653 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:39:10.637653 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:39:10.637653 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:39:10.637653 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:39:10.637653 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:39:10.637653 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:39:10.637653 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:39:10.637653 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:39:10.637653 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:39:10.637653 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5956065-65c8-40a9-a2de-7814880aee50 could not be found. Oct 19 03:39:10.637653 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:39:10.637653 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:39:10.637653 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:39:10.637653 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:39:10.637653 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:39:10.642498 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:39:10.642498 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:39:10.642498 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:39:10.642498 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5956065-65c8-40a9-a2de-7814880aee50 could not be found. Oct 19 03:39:10.642498 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:39:10.642498 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d5b47179-0a46-4974-8f6f-21912a4932d8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Returning 404 to user: Instance c5956065-65c8-40a9-a2de-7814880aee50 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:39:10.642498 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d5b47179-0a46-4974-8f6f-21912a4932d8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/c5956065-65c8-40a9-a2de-7814880aee50" status: 404 len: 111 microversion: 2.1 time: 0.014618 Oct 19 03:39:10.642498 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2684/5293] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:10 2022] GET /compute/v2.1/servers/c5956065-65c8-40a9-a2de-7814880aee50 => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 03:39:10.648960 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-dc2e5984-0ef4-49c2-b379-408724e37da8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:10.649643 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-dc2e5984-0ef4-49c2-b379-408724e37da8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:10.661638 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dc2e5984-0ef4-49c2-b379-408724e37da8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:10.672555 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dc2e5984-0ef4-49c2-b379-408724e37da8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:10.672555 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dc2e5984-0ef4-49c2-b379-408724e37da8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:10.672555 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dc2e5984-0ef4-49c2-b379-408724e37da8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:10.672555 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dc2e5984-0ef4-49c2-b379-408724e37da8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:10.672555 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dc2e5984-0ef4-49c2-b379-408724e37da8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:10.756888 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c3c187da-09f0-43ff-8fe4-f3515b96fb4c tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4729a0afd69480f99642266e0eec17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce5e9f9a4644b27a24b2f4c06df97bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:10.766019 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c3c187da-09f0-43ff-8fe4-f3515b96fb4c tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/4fab83b8-8862-4295-adb7-e2bf5462a2d9" status: 200 len: 1722 microversion: 2.1 time: 0.420490 Oct 19 03:39:10.785657 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2610/5294] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:10 2022] GET /compute/v2.1/servers/4fab83b8-8862-4295-adb7-e2bf5462a2d9 => generated 1722 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:39:11.001556 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=6 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:39:11.058069 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-dc2e5984-0ef4-49c2-b379-408724e37da8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:11.071711 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-dc2e5984-0ef4-49c2-b379-408724e37da8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1506 microversion: 2.1 time: 0.426644 Oct 19 03:39:11.080733 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2685/5295] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:10 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1506 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:39:11.106242 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d0f59a3f-9577-4ddd-8d9b-4ec97e027626 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:11.107590 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d0f59a3f-9577-4ddd-8d9b-4ec97e027626 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:11.122197 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d0f59a3f-9577-4ddd-8d9b-4ec97e027626 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:11.124416 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d0f59a3f-9577-4ddd-8d9b-4ec97e027626 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:11.126097 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d0f59a3f-9577-4ddd-8d9b-4ec97e027626 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:11.128228 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d0f59a3f-9577-4ddd-8d9b-4ec97e027626 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:11.130278 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d0f59a3f-9577-4ddd-8d9b-4ec97e027626 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:11.130816 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d0f59a3f-9577-4ddd-8d9b-4ec97e027626 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:11.144003 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-37dc0a88-a32c-40fa-963b-c413de5ce53c tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:11.144757 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-37dc0a88-a32c-40fa-963b-c413de5ce53c tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] [instance: d368a182-a350-4d0c-803d-2972af3aeb7d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:11.155241 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-37dc0a88-a32c-40fa-963b-c413de5ce53c tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:11.160379 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-37dc0a88-a32c-40fa-963b-c413de5ce53c tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:11.162041 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-37dc0a88-a32c-40fa-963b-c413de5ce53c tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:11.163018 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-37dc0a88-a32c-40fa-963b-c413de5ce53c tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:11.165576 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-37dc0a88-a32c-40fa-963b-c413de5ce53c tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:11.166373 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-37dc0a88-a32c-40fa-963b-c413de5ce53c tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:11.730650 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-37dc0a88-a32c-40fa-963b-c413de5ce53c tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4670fd4408d4454784251a880d5a72f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf91777fa414ddaa797d735e7d2a275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:11.743357 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-37dc0a88-a32c-40fa-963b-c413de5ce53c tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] 10.222.0.52 "GET /compute/v2.1/servers/d368a182-a350-4d0c-803d-2972af3aeb7d" status: 200 len: 1373 microversion: 2.1 time: 0.603664 Oct 19 03:39:11.744796 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2686/5296] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:11 2022] GET /compute/v2.1/servers/d368a182-a350-4d0c-803d-2972af3aeb7d => generated 1373 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:39:11.754316 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d0f59a3f-9577-4ddd-8d9b-4ec97e027626 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:11.771140 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d0f59a3f-9577-4ddd-8d9b-4ec97e027626 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1506 microversion: 2.1 time: 0.665150 Oct 19 03:39:11.771140 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2611/5297] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:11 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1506 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:39:11.793308 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1220af12-7b54-4134-a7fc-ad2745e3633c tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:11.800791 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1220af12-7b54-4134-a7fc-ad2745e3633c tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 4fab83b8-8862-4295-adb7-e2bf5462a2d9] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:11.805592 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-03e3331b-36aa-4978-a479-03ce7b487e6e req-1c05dda1-149b-49fb-acb7-7da80ef601ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d368a182-a350-4d0c-803d-2972af3aeb7d", "tag": "76e9dcc7-fe11-440c-8253-409dfac2a873"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:39:11.818202 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1220af12-7b54-4134-a7fc-ad2745e3633c tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:11.822877 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1220af12-7b54-4134-a7fc-ad2745e3633c tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:11.824571 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1220af12-7b54-4134-a7fc-ad2745e3633c tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:11.826859 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1220af12-7b54-4134-a7fc-ad2745e3633c tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:11.830435 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1220af12-7b54-4134-a7fc-ad2745e3633c tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:11.831331 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1220af12-7b54-4134-a7fc-ad2745e3633c tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:11.831764 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-03e3331b-36aa-4978-a479-03ce7b487e6e req-1c05dda1-149b-49fb-acb7-7da80ef601ca service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:11.833264 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-03e3331b-36aa-4978-a479-03ce7b487e6e req-1c05dda1-149b-49fb-acb7-7da80ef601ca service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:11.835307 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-03e3331b-36aa-4978-a479-03ce7b487e6e req-1c05dda1-149b-49fb-acb7-7da80ef601ca service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:11.872473 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-03e3331b-36aa-4978-a479-03ce7b487e6e req-1c05dda1-149b-49fb-acb7-7da80ef601ca service nova] Creating event network-changed:76e9dcc7-fe11-440c-8253-409dfac2a873 for instance d368a182-a350-4d0c-803d-2972af3aeb7d on n-h2-861333-8 Oct 19 03:39:11.884989 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-03e3331b-36aa-4978-a479-03ce7b487e6e req-1c05dda1-149b-49fb-acb7-7da80ef601ca service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098780 Oct 19 03:39:11.887206 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2687/5298] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:39:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:39:12.024717 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4b62c0e1-9444-4855-be7b-be2e38b382c2 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-994257287", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "3ecd8896-b7a4-4c3a-b3cd-dc6769233813"}]}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:39:12.041956 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4b62c0e1-9444-4855-be7b-be2e38b382c2 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Request method failure captured: Oct 19 03:39:12.041956 n-d-861333-8 devstack@n-api.service[121135]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 19 03:39:12.041956 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:39:12.041956 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:39:12.041956 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:39:12.041956 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 237 Oct 19 03:39:12.041956 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:39:12.041956 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:39:12.041956 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:39:12.041956 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:39:12.041956 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT3EK4yDar5R5kGdpWRPopK281fOgxjiWCAZdy3tbDZzFYZxrN53hSsTq0YyAxsfcVRT4cF0jU61e6walOKxMx_njT0L3WOIYEymBjzmNzdXOa-UhYNf83BpQOShCJts2aNodNdu7YjeLcAcuRF0ZOjoH0xsH4HoNSzc8IfQzKhRz4vw Oct 19 03:39:12.041956 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:39:12.041956 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:39:12.041956 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:39:12.041956 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:39:12.041956 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:39:12.041956 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:39:12.041956 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 34bd94983fbf4a8aa49aff65c076e9e3 Oct 19 03:39:12.041956 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:39:12.041956 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:39:12.041956 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:39:12.041956 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_34bd94983fbf4a8aa49aff65c076e9e3", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:39:12.041956 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:39:12.041956 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 34bd94983fbf4a8aa49aff65c076e9e3 Oct 19 03:39:12.041956 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:39:12.041956 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ServersNegativeTestJSON-553742303-project Oct 19 03:39:12.041956 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:39:12.041956 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:39:12.041956 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 771feb133bc046588552d3af98f8e0a1 Oct 19 03:39:12.041956 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ServersNegativeTestJSON-553742303-project Oct 19 03:39:12.041956 n-d-861333-8 devstack@n-api.service[121135]: Oct 19 03:39:12.041956 n-d-861333-8 devstack@n-api.service[121135]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-994257287", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "3ecd8896-b7a4-4c3a-b3cd-dc6769233813"}]}} Oct 19 03:39:12.041956 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:39:12.041956 n-d-861333-8 devstack@n-api.service[121135]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 19 03:39:12.041956 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-994257287', 'imageRef': '9e16d73e-70ea-4421-aee3-047d80396c02', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '3ecd8896-b7a4-4c3a-b3cd-dc6769233813'}]}}} Oct 19 03:39:12.041956 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:39:12.041956 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:39:12.041956 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 19 03:39:12.041956 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 19 03:39:12.041956 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 253, in is_ipv4 Oct 19 03:39:12.041956 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Oct 19 03:39:12.041956 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Oct 19 03:39:12.041956 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 19 03:39:12.041956 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Oct 19 03:39:12.041956 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Oct 19 03:39:12.041956 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Oct 19 03:39:12.041956 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:39:12.041956 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 19 03:39:12.041956 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:39:12.041956 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:39:12.041956 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 03:39:12.041956 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 03:39:12.041956 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 03:39:12.041956 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise error Oct 19 03:39:12.041956 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Oct 19 03:39:12.041956 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:39:12.041956 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Oct 19 03:39:12.041956 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Oct 19 03:39:12.041956 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:39:12.041956 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 19 03:39:12.041956 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Oct 19 03:39:12.041956 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:39:12.041956 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:39:12.041956 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:39:12.041956 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:39:12.047948 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:39:12.047948 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:39:12.047948 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:39:12.047948 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:39:12.047948 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:39:12.047948 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:39:12.047948 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:39:12.047948 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:39:12.047948 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 03:39:12.047948 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 03:39:12.047948 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 03:39:12.047948 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 03:39:12.047948 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 03:39:12.047948 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 03:39:12.047948 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 19 03:39:12.047948 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:39:12.047948 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:39:12.047948 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:39:12.047948 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:39:12.047948 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:39:12.047948 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:39:12.047948 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 03:39:12.047948 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 03:39:12.047948 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 19 03:39:12.047948 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:39:12.047948 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4b62c0e1-9444-4855-be7b-be2e38b382c2 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:39:12.052706 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4b62c0e1-9444-4855-be7b-be2e38b382c2 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.028034 Oct 19 03:39:12.052706 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2688/5299] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:39:12 2022] POST /compute/v2.1/servers => generated 139 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 03:39:12.059352 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-bd08da5d-0302-4960-9e43-483149971e9f tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:12.065952 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-bd08da5d-0302-4960-9e43-483149971e9f tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:12.074199 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bd08da5d-0302-4960-9e43-483149971e9f tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:12.075095 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bd08da5d-0302-4960-9e43-483149971e9f tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:12.075801 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bd08da5d-0302-4960-9e43-483149971e9f tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:12.076771 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bd08da5d-0302-4960-9e43-483149971e9f tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:12.077499 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bd08da5d-0302-4960-9e43-483149971e9f tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:12.078161 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bd08da5d-0302-4960-9e43-483149971e9f tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:12.706816 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-1220af12-7b54-4134-a7fc-ad2745e3633c tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4729a0afd69480f99642266e0eec17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce5e9f9a4644b27a24b2f4c06df97bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:12.717896 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1220af12-7b54-4134-a7fc-ad2745e3633c tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/4fab83b8-8862-4295-adb7-e2bf5462a2d9" status: 200 len: 1722 microversion: 2.1 time: 0.928714 Oct 19 03:39:12.719262 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2612/5300] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:11 2022] GET /compute/v2.1/servers/4fab83b8-8862-4295-adb7-e2bf5462a2d9 => generated 1722 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:39:12.829663 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-907f5464-4cef-4547-aeaf-533a00f0525e tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:12.832923 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-907f5464-4cef-4547-aeaf-533a00f0525e tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] [instance: d368a182-a350-4d0c-803d-2972af3aeb7d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:12.851127 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-907f5464-4cef-4547-aeaf-533a00f0525e tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:12.855848 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-907f5464-4cef-4547-aeaf-533a00f0525e tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:12.857666 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-907f5464-4cef-4547-aeaf-533a00f0525e tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:12.864185 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-907f5464-4cef-4547-aeaf-533a00f0525e tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:12.867394 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-907f5464-4cef-4547-aeaf-533a00f0525e tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:12.870761 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-907f5464-4cef-4547-aeaf-533a00f0525e tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:12.879919 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-bd08da5d-0302-4960-9e43-483149971e9f tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:12.897946 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-bd08da5d-0302-4960-9e43-483149971e9f tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1506 microversion: 2.1 time: 0.841966 Oct 19 03:39:12.898741 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2689/5301] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:12 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1506 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:39:12.926113 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-970479ef-975c-4111-b5a8-15b229dc0684 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:12.930223 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-970479ef-975c-4111-b5a8-15b229dc0684 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:12.964297 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-970479ef-975c-4111-b5a8-15b229dc0684 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:12.965623 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-970479ef-975c-4111-b5a8-15b229dc0684 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:12.969624 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-970479ef-975c-4111-b5a8-15b229dc0684 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:12.971324 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-970479ef-975c-4111-b5a8-15b229dc0684 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:12.974048 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-970479ef-975c-4111-b5a8-15b229dc0684 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:12.974642 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-970479ef-975c-4111-b5a8-15b229dc0684 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:12.993910 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=100 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:39:13.320542 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-970479ef-975c-4111-b5a8-15b229dc0684 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:13.329695 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-970479ef-975c-4111-b5a8-15b229dc0684 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1506 microversion: 2.1 time: 0.408621 Oct 19 03:39:13.331337 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2690/5302] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:12 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1506 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:39:13.364729 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-907f5464-4cef-4547-aeaf-533a00f0525e tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4670fd4408d4454784251a880d5a72f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf91777fa414ddaa797d735e7d2a275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:13.372814 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-907f5464-4cef-4547-aeaf-533a00f0525e tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] 10.222.0.52 "GET /compute/v2.1/servers/d368a182-a350-4d0c-803d-2972af3aeb7d" status: 200 len: 1373 microversion: 2.1 time: 0.553190 Oct 19 03:39:13.373881 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2613/5303] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:12 2022] GET /compute/v2.1/servers/d368a182-a350-4d0c-803d-2972af3aeb7d => generated 1373 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:39:13.404710 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6e8b471a-ccc3-4af2-b785-d015e6f8fbd4 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-529310448", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "3ecd8896-b7a4-4c3a-b3cd-dc6769233813"}]}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:39:13.409198 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6e8b471a-ccc3-4af2-b785-d015e6f8fbd4 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Request method failure captured: Oct 19 03:39:13.409198 n-d-861333-8 devstack@n-api.service[121135]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 19 03:39:13.409198 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:39:13.409198 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:39:13.409198 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:39:13.409198 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 234 Oct 19 03:39:13.409198 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:39:13.409198 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:39:13.409198 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:39:13.409198 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:39:13.409198 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT3EK4yDar5R5kGdpWRPopK281fOgxjiWCAZdy3tbDZzFYZxrN53hSsTq0YyAxsfcVRT4cF0jU61e6walOKxMx_njT0L3WOIYEymBjzmNzdXOa-UhYNf83BpQOShCJts2aNodNdu7YjeLcAcuRF0ZOjoH0xsH4HoNSzc8IfQzKhRz4vw Oct 19 03:39:13.409198 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:39:13.409198 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:39:13.409198 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:39:13.409198 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:39:13.409198 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:39:13.409198 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:39:13.409198 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 34bd94983fbf4a8aa49aff65c076e9e3 Oct 19 03:39:13.409198 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:39:13.409198 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:39:13.409198 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:39:13.409198 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_34bd94983fbf4a8aa49aff65c076e9e3", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:39:13.409198 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:39:13.409198 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 34bd94983fbf4a8aa49aff65c076e9e3 Oct 19 03:39:13.409198 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:39:13.409198 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ServersNegativeTestJSON-553742303-project Oct 19 03:39:13.409198 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:39:13.409198 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:39:13.409198 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 771feb133bc046588552d3af98f8e0a1 Oct 19 03:39:13.409198 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ServersNegativeTestJSON-553742303-project Oct 19 03:39:13.409198 n-d-861333-8 devstack@n-api.service[121135]: Oct 19 03:39:13.409198 n-d-861333-8 devstack@n-api.service[121135]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-529310448", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "3ecd8896-b7a4-4c3a-b3cd-dc6769233813"}]}} Oct 19 03:39:13.409198 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:39:13.409198 n-d-861333-8 devstack@n-api.service[121135]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 19 03:39:13.409198 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-529310448', 'imageRef': '9e16d73e-70ea-4421-aee3-047d80396c02', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '3ecd8896-b7a4-4c3a-b3cd-dc6769233813'}]}}} Oct 19 03:39:13.409198 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:39:13.409198 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:39:13.409198 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 19 03:39:13.409198 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 19 03:39:13.409198 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 260, in is_ipv6 Oct 19 03:39:13.409198 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Oct 19 03:39:13.409198 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Oct 19 03:39:13.409198 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 19 03:39:13.409198 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Oct 19 03:39:13.409198 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Oct 19 03:39:13.409198 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Oct 19 03:39:13.409198 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:39:13.409198 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 19 03:39:13.409198 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:39:13.409198 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:39:13.409198 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 03:39:13.409198 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 03:39:13.409198 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 03:39:13.409198 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise error Oct 19 03:39:13.409198 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Oct 19 03:39:13.409198 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:39:13.409198 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Oct 19 03:39:13.409198 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Oct 19 03:39:13.409198 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:39:13.409198 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 19 03:39:13.409198 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi 'notvalid' Oct 19 03:39:13.409198 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:39:13.409198 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:39:13.409198 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:39:13.409198 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:39:13.416257 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:39:13.416257 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:39:13.416257 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:39:13.416257 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:39:13.416257 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:39:13.416257 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:39:13.416257 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:39:13.416257 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:39:13.416257 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 03:39:13.416257 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 03:39:13.416257 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 03:39:13.416257 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 03:39:13.416257 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 03:39:13.416257 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 03:39:13.416257 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 19 03:39:13.416257 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:39:13.416257 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:39:13.416257 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:39:13.416257 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:39:13.416257 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:39:13.416257 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:39:13.416257 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 03:39:13.416257 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 03:39:13.416257 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 19 03:39:13.416257 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:39:13.416257 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6e8b471a-ccc3-4af2-b785-d015e6f8fbd4 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:39:13.416257 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6e8b471a-ccc3-4af2-b785-d015e6f8fbd4 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.010635 Oct 19 03:39:13.416257 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2691/5304] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:39:13 2022] POST /compute/v2.1/servers => generated 133 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 03:39:13.425460 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7ba00377-c5ac-44bd-9c11-cf756cb8f436 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:13.425460 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7ba00377-c5ac-44bd-9c11-cf756cb8f436 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:13.429908 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7ba00377-c5ac-44bd-9c11-cf756cb8f436 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:13.430495 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7ba00377-c5ac-44bd-9c11-cf756cb8f436 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:13.431031 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7ba00377-c5ac-44bd-9c11-cf756cb8f436 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:13.431814 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7ba00377-c5ac-44bd-9c11-cf756cb8f436 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:13.432355 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7ba00377-c5ac-44bd-9c11-cf756cb8f436 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:13.433152 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7ba00377-c5ac-44bd-9c11-cf756cb8f436 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:13.614687 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-7ba00377-c5ac-44bd-9c11-cf756cb8f436 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:13.623820 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7ba00377-c5ac-44bd-9c11-cf756cb8f436 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1506 microversion: 2.1 time: 0.207821 Oct 19 03:39:13.624704 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2614/5305] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:13 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1506 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:39:13.647441 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5f49cfce-c03d-42cb-9d09-0a06b55a0eb8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:13.648065 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-5f49cfce-c03d-42cb-9d09-0a06b55a0eb8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:13.655868 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5f49cfce-c03d-42cb-9d09-0a06b55a0eb8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:13.656585 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5f49cfce-c03d-42cb-9d09-0a06b55a0eb8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:13.663758 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5f49cfce-c03d-42cb-9d09-0a06b55a0eb8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:13.663758 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5f49cfce-c03d-42cb-9d09-0a06b55a0eb8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:13.663758 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5f49cfce-c03d-42cb-9d09-0a06b55a0eb8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:13.663758 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5f49cfce-c03d-42cb-9d09-0a06b55a0eb8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:13.748933 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-238aa647-e7e8-4d06-b193-acc1bfe4cef2 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:13.749600 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-238aa647-e7e8-4d06-b193-acc1bfe4cef2 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 4fab83b8-8862-4295-adb7-e2bf5462a2d9] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:13.756268 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-238aa647-e7e8-4d06-b193-acc1bfe4cef2 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:13.756787 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-238aa647-e7e8-4d06-b193-acc1bfe4cef2 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:13.757736 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-238aa647-e7e8-4d06-b193-acc1bfe4cef2 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:13.758588 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-238aa647-e7e8-4d06-b193-acc1bfe4cef2 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:13.759056 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-238aa647-e7e8-4d06-b193-acc1bfe4cef2 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:13.759485 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-238aa647-e7e8-4d06-b193-acc1bfe4cef2 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:13.852693 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-5f49cfce-c03d-42cb-9d09-0a06b55a0eb8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:13.860925 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5f49cfce-c03d-42cb-9d09-0a06b55a0eb8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1506 microversion: 2.1 time: 0.217761 Oct 19 03:39:13.864523 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2692/5306] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:13 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1506 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:39:13.887296 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-50c30a60-277d-4732-a481-8d477c24b748 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:39:13.887296 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-50c30a60-277d-4732-a481-8d477c24b748 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: cb054108-223d-4eaf-a401-030cabdecf29] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:13.892610 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-50c30a60-277d-4732-a481-8d477c24b748 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] HTTP exception thrown: Instance cb054108-223d-4eaf-a401-030cabdecf29 could not be found. Oct 19 03:39:13.902171 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-50c30a60-277d-4732-a481-8d477c24b748 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Request method failure captured: Oct 19 03:39:13.902171 n-d-861333-8 devstack@n-api.service[121135]: request: POST /compute/v2.1/servers/cb054108-223d-4eaf-a401-030cabdecf29/action HTTP/1.1 Oct 19 03:39:13.902171 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:39:13.902171 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:39:13.902171 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:39:13.902171 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 13 Oct 19 03:39:13.902171 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:39:13.902171 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:39:13.902171 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:39:13.902171 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:39:13.902171 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT3EK4yDar5R5kGdpWRPopK281fOgxjiWCAZdy3tbDZzFYZxrN53hSsTq0YyAxsfcVRT4cF0jU61e6walOKxMx_njT0L3WOIYEymBjzmNzdXOa-UhYNf83BpQOShCJts2aNodNdu7YjeLcAcuRF0ZOjoH0xsH4HoNSzc8IfQzKhRz4vw Oct 19 03:39:13.902171 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:39:13.902171 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:39:13.902171 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:39:13.902171 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:39:13.902171 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:39:13.902171 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:39:13.902171 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 34bd94983fbf4a8aa49aff65c076e9e3 Oct 19 03:39:13.902171 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:39:13.902171 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:39:13.902171 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:39:13.902171 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_34bd94983fbf4a8aa49aff65c076e9e3", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:39:13.902171 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:39:13.902171 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 34bd94983fbf4a8aa49aff65c076e9e3 Oct 19 03:39:13.902171 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:39:13.902171 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ServersNegativeTestJSON-553742303-project Oct 19 03:39:13.902171 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:39:13.902171 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:39:13.902171 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 771feb133bc046588552d3af98f8e0a1 Oct 19 03:39:13.902171 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ServersNegativeTestJSON-553742303-project Oct 19 03:39:13.902171 n-d-861333-8 devstack@n-api.service[121135]: Oct 19 03:39:13.902171 n-d-861333-8 devstack@n-api.service[121135]: {"pause": {}} Oct 19 03:39:13.902171 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:39:13.902171 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance cb054108-223d-4eaf-a401-030cabdecf29 could not be found. Oct 19 03:39:13.902171 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': 'cb054108-223d-4eaf-a401-030cabdecf29', 'body': {'pause': {}}} Oct 19 03:39:13.902171 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:39:13.902171 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:39:13.902171 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:39:13.902171 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:39:13.902171 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:39:13.902171 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:39:13.902171 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 19 03:39:13.902171 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 19 03:39:13.902171 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb054108-223d-4eaf-a401-030cabdecf29 could not be found. Oct 19 03:39:13.902171 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:39:13.902171 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:39:13.902171 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:39:13.902171 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:39:13.902171 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:39:13.902171 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:39:13.902171 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:39:13.902171 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:39:13.902171 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:39:13.902171 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:39:13.902171 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Oct 19 03:39:13.902171 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 19 03:39:13.902171 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:39:13.902171 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:39:13.902171 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb054108-223d-4eaf-a401-030cabdecf29 could not be found. Oct 19 03:39:13.902171 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:39:13.902171 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:39:13.902171 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:39:13.902171 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:39:13.902171 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:39:13.902171 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:39:13.906825 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:39:13.906825 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:39:13.906825 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb054108-223d-4eaf-a401-030cabdecf29 could not be found. Oct 19 03:39:13.906825 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:39:13.906825 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-50c30a60-277d-4732-a481-8d477c24b748 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Returning 404 to user: Instance cb054108-223d-4eaf-a401-030cabdecf29 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:39:13.906825 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-50c30a60-277d-4732-a481-8d477c24b748 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "POST /compute/v2.1/servers/cb054108-223d-4eaf-a401-030cabdecf29/action" status: 404 len: 111 microversion: 2.1 time: 0.022510 Oct 19 03:39:13.906825 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2693/5307] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:39:13 2022] POST /compute/v2.1/servers/cb054108-223d-4eaf-a401-030cabdecf29/action => generated 111 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 03:39:13.915594 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a7554e43-660d-45a7-ba76-aa082b97890c tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:13.916295 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a7554e43-660d-45a7-ba76-aa082b97890c tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:13.928295 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a7554e43-660d-45a7-ba76-aa082b97890c tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:13.928804 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a7554e43-660d-45a7-ba76-aa082b97890c tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:13.929287 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a7554e43-660d-45a7-ba76-aa082b97890c tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:13.930488 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a7554e43-660d-45a7-ba76-aa082b97890c tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:13.930954 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a7554e43-660d-45a7-ba76-aa082b97890c tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:13.931403 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a7554e43-660d-45a7-ba76-aa082b97890c tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:13.968280 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-238aa647-e7e8-4d06-b193-acc1bfe4cef2 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4729a0afd69480f99642266e0eec17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce5e9f9a4644b27a24b2f4c06df97bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:13.975623 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-238aa647-e7e8-4d06-b193-acc1bfe4cef2 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/4fab83b8-8862-4295-adb7-e2bf5462a2d9" status: 200 len: 1728 microversion: 2.1 time: 0.230800 Oct 19 03:39:13.994211 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2615/5308] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:13 2022] GET /compute/v2.1/servers/4fab83b8-8862-4295-adb7-e2bf5462a2d9 => generated 1728 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:39:14.000679 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a39ad6ca-332f-4b77-9dcb-608ffd9b4e18 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:14.001809 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a39ad6ca-332f-4b77-9dcb-608ffd9b4e18 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 4fab83b8-8862-4295-adb7-e2bf5462a2d9] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:14.011510 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a39ad6ca-332f-4b77-9dcb-608ffd9b4e18 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:14.012081 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a39ad6ca-332f-4b77-9dcb-608ffd9b4e18 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:14.025032 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a39ad6ca-332f-4b77-9dcb-608ffd9b4e18 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:14.035628 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a39ad6ca-332f-4b77-9dcb-608ffd9b4e18 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:14.036375 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a39ad6ca-332f-4b77-9dcb-608ffd9b4e18 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:14.038061 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a39ad6ca-332f-4b77-9dcb-608ffd9b4e18 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:14.149763 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a7554e43-660d-45a7-ba76-aa082b97890c tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:14.160184 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a39ad6ca-332f-4b77-9dcb-608ffd9b4e18 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/4fab83b8-8862-4295-adb7-e2bf5462a2d9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.164300 Oct 19 03:39:14.161011 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2616/5309] 10.222.0.52 () {58 vars in 1275 bytes} [Wed Oct 19 03:39:13 2022] GET /compute/v2.1/servers/4fab83b8-8862-4295-adb7-e2bf5462a2d9/os-interface => generated 284 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:39:14.175400 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a7554e43-660d-45a7-ba76-aa082b97890c tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1506 microversion: 2.1 time: 0.264217 Oct 19 03:39:14.175981 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2694/5310] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:13 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1506 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:39:14.200571 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4ef20c6e-004f-49ab-8518-cdcd40e71d49 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:14.202105 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4ef20c6e-004f-49ab-8518-cdcd40e71d49 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:14.208307 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4ef20c6e-004f-49ab-8518-cdcd40e71d49 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:14.215307 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4ef20c6e-004f-49ab-8518-cdcd40e71d49 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:14.215307 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4ef20c6e-004f-49ab-8518-cdcd40e71d49 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:14.215307 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4ef20c6e-004f-49ab-8518-cdcd40e71d49 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:14.215307 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4ef20c6e-004f-49ab-8518-cdcd40e71d49 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:14.215307 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4ef20c6e-004f-49ab-8518-cdcd40e71d49 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:14.362645 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-4ef20c6e-004f-49ab-8518-cdcd40e71d49 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:14.371377 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4ef20c6e-004f-49ab-8518-cdcd40e71d49 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1506 microversion: 2.1 time: 0.175475 Oct 19 03:39:14.371971 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2617/5311] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:14 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1506 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:39:14.404085 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-17c6f18d-fc0f-4456-b26b-a754af33f2bc tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:14.404085 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-17c6f18d-fc0f-4456-b26b-a754af33f2bc tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] [instance: d368a182-a350-4d0c-803d-2972af3aeb7d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:14.412481 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4f14af57-bdb8-4608-a9cf-87b45670a02a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:39:14.413029 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4f14af57-bdb8-4608-a9cf-87b45670a02a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:14.417298 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-17c6f18d-fc0f-4456-b26b-a754af33f2bc tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:14.417844 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-17c6f18d-fc0f-4456-b26b-a754af33f2bc tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:14.418297 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-17c6f18d-fc0f-4456-b26b-a754af33f2bc tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:14.419018 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-17c6f18d-fc0f-4456-b26b-a754af33f2bc tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:14.419668 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-17c6f18d-fc0f-4456-b26b-a754af33f2bc tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:14.420108 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-17c6f18d-fc0f-4456-b26b-a754af33f2bc tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:14.431497 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4f14af57-bdb8-4608-a9cf-87b45670a02a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:14.432236 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4f14af57-bdb8-4608-a9cf-87b45670a02a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:14.432928 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4f14af57-bdb8-4608-a9cf-87b45670a02a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:14.434153 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4f14af57-bdb8-4608-a9cf-87b45670a02a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:14.434822 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4f14af57-bdb8-4608-a9cf-87b45670a02a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:14.435249 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4f14af57-bdb8-4608-a9cf-87b45670a02a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:14.683212 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-17c6f18d-fc0f-4456-b26b-a754af33f2bc tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4670fd4408d4454784251a880d5a72f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf91777fa414ddaa797d735e7d2a275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:14.714212 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-17c6f18d-fc0f-4456-b26b-a754af33f2bc tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] 10.222.0.52 "GET /compute/v2.1/servers/d368a182-a350-4d0c-803d-2972af3aeb7d" status: 200 len: 1373 microversion: 2.1 time: 0.317505 Oct 19 03:39:14.715531 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4f14af57-bdb8-4608-a9cf-87b45670a02a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "POST /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770/action" status: 202 len: 0 microversion: 2.1 time: 0.306923 Oct 19 03:39:14.722017 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2618/5312] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:39:14 2022] POST /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770/action => generated 0 bytes in 315 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:39:14.730730 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2695/5313] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:14 2022] GET /compute/v2.1/servers/d368a182-a350-4d0c-803d-2972af3aeb7d => generated 1373 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:39:14.746479 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-82a77f03-9d2f-43eb-ade7-4c4b746050cf tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:14.748791 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-82a77f03-9d2f-43eb-ade7-4c4b746050cf tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:14.769320 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-82a77f03-9d2f-43eb-ade7-4c4b746050cf tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:14.774204 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-82a77f03-9d2f-43eb-ade7-4c4b746050cf tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:14.776888 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-82a77f03-9d2f-43eb-ade7-4c4b746050cf tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:14.778165 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-82a77f03-9d2f-43eb-ade7-4c4b746050cf tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:14.784473 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-82a77f03-9d2f-43eb-ade7-4c4b746050cf tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:14.784473 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-82a77f03-9d2f-43eb-ade7-4c4b746050cf tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:15.107429 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-82a77f03-9d2f-43eb-ade7-4c4b746050cf tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:15.117410 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-82a77f03-9d2f-43eb-ade7-4c4b746050cf tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1511 microversion: 2.1 time: 0.392647 Oct 19 03:39:15.118663 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2619/5314] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:14 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1511 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:39:15.746078 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-98453855-aaf1-4bf6-af40-57a231a73d1f tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:15.747425 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-98453855-aaf1-4bf6-af40-57a231a73d1f tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] [instance: d368a182-a350-4d0c-803d-2972af3aeb7d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:15.756230 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-98453855-aaf1-4bf6-af40-57a231a73d1f tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:15.756732 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-98453855-aaf1-4bf6-af40-57a231a73d1f tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:15.757188 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-98453855-aaf1-4bf6-af40-57a231a73d1f tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:15.758231 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-98453855-aaf1-4bf6-af40-57a231a73d1f tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:15.758996 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-98453855-aaf1-4bf6-af40-57a231a73d1f tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:15.759759 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-98453855-aaf1-4bf6-af40-57a231a73d1f tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:15.960618 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-98453855-aaf1-4bf6-af40-57a231a73d1f tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4670fd4408d4454784251a880d5a72f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf91777fa414ddaa797d735e7d2a275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:15.970692 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-98453855-aaf1-4bf6-af40-57a231a73d1f tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] 10.222.0.52 "GET /compute/v2.1/servers/d368a182-a350-4d0c-803d-2972af3aeb7d" status: 200 len: 1373 microversion: 2.1 time: 0.228585 Oct 19 03:39:15.971895 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2696/5315] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:15 2022] GET /compute/v2.1/servers/d368a182-a350-4d0c-803d-2972af3aeb7d => generated 1373 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:39:16.038820 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3a5dcd29-6ce0-44c0-bf2d-d16e8cf87ba5 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:16.039978 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3a5dcd29-6ce0-44c0-bf2d-d16e8cf87ba5 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: c6045b08-8c91-4cdb-be37-c079e7ffe23a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:16.046188 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3a5dcd29-6ce0-44c0-bf2d-d16e8cf87ba5 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:16.046820 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3a5dcd29-6ce0-44c0-bf2d-d16e8cf87ba5 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:16.047523 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3a5dcd29-6ce0-44c0-bf2d-d16e8cf87ba5 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:16.048548 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3a5dcd29-6ce0-44c0-bf2d-d16e8cf87ba5 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:16.049285 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3a5dcd29-6ce0-44c0-bf2d-d16e8cf87ba5 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:16.049980 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3a5dcd29-6ce0-44c0-bf2d-d16e8cf87ba5 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:16.086854 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3a5dcd29-6ce0-44c0-bf2d-d16e8cf87ba5 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: c6045b08-8c91-4cdb-be37-c079e7ffe23a] Going to try to terminate instance {{(pid=121134) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:39:16.102893 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:39:16.142381 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3ef9e7ac-f368-480f-bc60-59b0f4c97b25 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:16.142946 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-3ef9e7ac-f368-480f-bc60-59b0f4c97b25 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:16.151093 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3ef9e7ac-f368-480f-bc60-59b0f4c97b25 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:16.151586 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3ef9e7ac-f368-480f-bc60-59b0f4c97b25 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:16.152029 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3ef9e7ac-f368-480f-bc60-59b0f4c97b25 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:16.153297 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3ef9e7ac-f368-480f-bc60-59b0f4c97b25 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:16.153826 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3ef9e7ac-f368-480f-bc60-59b0f4c97b25 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:16.154533 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3ef9e7ac-f368-480f-bc60-59b0f4c97b25 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:16.308372 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-3ef9e7ac-f368-480f-bc60-59b0f4c97b25 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:16.317629 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-3ef9e7ac-f368-480f-bc60-59b0f4c97b25 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1491 microversion: 2.1 time: 0.179873 Oct 19 03:39:16.318502 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2697/5316] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:16 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1491 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:39:16.341301 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3a08d5d9-dbda-40ba-868e-aadf5f274f12 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:39:16.341895 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-3a08d5d9-dbda-40ba-868e-aadf5f274f12 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:16.348786 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3a08d5d9-dbda-40ba-868e-aadf5f274f12 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:16.349189 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3a08d5d9-dbda-40ba-868e-aadf5f274f12 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:16.349688 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3a08d5d9-dbda-40ba-868e-aadf5f274f12 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:16.350404 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3a08d5d9-dbda-40ba-868e-aadf5f274f12 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:16.350870 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3a08d5d9-dbda-40ba-868e-aadf5f274f12 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:16.351361 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3a08d5d9-dbda-40ba-868e-aadf5f274f12 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:16.375452 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-3a08d5d9-dbda-40ba-868e-aadf5f274f12 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] HTTP exception thrown: Cannot 'pause' instance 5a830928-6d51-4dbd-97ad-8cca44de3770 while it is in vm_state paused Oct 19 03:39:16.377253 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3a08d5d9-dbda-40ba-868e-aadf5f274f12 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Request method failure captured: Oct 19 03:39:16.377253 n-d-861333-8 devstack@n-api.service[121135]: request: POST /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770/action HTTP/1.1 Oct 19 03:39:16.377253 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:39:16.377253 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:39:16.377253 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:39:16.377253 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 13 Oct 19 03:39:16.377253 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:39:16.377253 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:39:16.377253 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:39:16.377253 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:39:16.377253 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT3EK4yDar5R5kGdpWRPopK281fOgxjiWCAZdy3tbDZzFYZxrN53hSsTq0YyAxsfcVRT4cF0jU61e6walOKxMx_njT0L3WOIYEymBjzmNzdXOa-UhYNf83BpQOShCJts2aNodNdu7YjeLcAcuRF0ZOjoH0xsH4HoNSzc8IfQzKhRz4vw Oct 19 03:39:16.377253 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:39:16.377253 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:39:16.377253 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:39:16.377253 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:39:16.377253 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:39:16.377253 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:39:16.377253 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 34bd94983fbf4a8aa49aff65c076e9e3 Oct 19 03:39:16.377253 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:39:16.377253 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:39:16.377253 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:39:16.377253 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_34bd94983fbf4a8aa49aff65c076e9e3", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:39:16.377253 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:39:16.377253 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 34bd94983fbf4a8aa49aff65c076e9e3 Oct 19 03:39:16.377253 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:39:16.377253 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ServersNegativeTestJSON-553742303-project Oct 19 03:39:16.377253 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:39:16.377253 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:39:16.377253 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 771feb133bc046588552d3af98f8e0a1 Oct 19 03:39:16.377253 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ServersNegativeTestJSON-553742303-project Oct 19 03:39:16.377253 n-d-861333-8 devstack@n-api.service[121135]: Oct 19 03:39:16.377253 n-d-861333-8 devstack@n-api.service[121135]: {"pause": {}} Oct 19 03:39:16.377253 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:39:16.377253 n-d-861333-8 devstack@n-api.service[121135]: exception: Cannot 'pause' instance 5a830928-6d51-4dbd-97ad-8cca44de3770 while it is in vm_state paused Oct 19 03:39:16.377253 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '5a830928-6d51-4dbd-97ad-8cca44de3770', 'body': {'pause': {}}} Oct 19 03:39:16.377253 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:39:16.377253 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:39:16.377253 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Oct 19 03:39:16.377253 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Oct 19 03:39:16.377253 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 19 03:39:16.377253 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 19 03:39:16.377253 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 19 03:39:16.377253 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 19 03:39:16.377253 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5a830928-6d51-4dbd-97ad-8cca44de3770 in vm_state paused. Cannot pause while the instance is in this state. Oct 19 03:39:16.377253 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:39:16.377253 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:39:16.377253 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:39:16.377253 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:39:16.377253 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:39:16.377253 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:39:16.377253 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:39:16.377253 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:39:16.377253 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:39:16.377253 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:39:16.377253 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Oct 19 03:39:16.377253 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 19 03:39:16.377253 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 19 03:39:16.377253 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 19 03:39:16.377253 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 5a830928-6d51-4dbd-97ad-8cca44de3770 while it is in vm_state paused Oct 19 03:39:16.377253 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:39:16.377253 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:39:16.377253 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:39:16.377253 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:39:16.377253 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:39:16.389756 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:39:16.389756 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:39:16.389756 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:39:16.389756 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 5a830928-6d51-4dbd-97ad-8cca44de3770 while it is in vm_state paused Oct 19 03:39:16.389756 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:39:16.389756 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3a08d5d9-dbda-40ba-868e-aadf5f274f12 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Returning 409 to user: Cannot 'pause' instance 5a830928-6d51-4dbd-97ad-8cca44de3770 while it is in vm_state paused {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:39:16.396960 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-3a08d5d9-dbda-40ba-868e-aadf5f274f12 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "POST /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770/action" status: 409 len: 143 microversion: 2.1 time: 0.046468 Oct 19 03:39:16.401706 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2698/5317] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:39:16 2022] POST /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770/action => generated 143 bytes in 65 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 19 03:39:16.409775 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:39:16.411572 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-00bcda1d-a4d0-431e-8b5d-15795896b8d7 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:39:16.412328 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-00bcda1d-a4d0-431e-8b5d-15795896b8d7 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:16.418371 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-00bcda1d-a4d0-431e-8b5d-15795896b8d7 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:16.420869 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-00bcda1d-a4d0-431e-8b5d-15795896b8d7 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:16.420869 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-00bcda1d-a4d0-431e-8b5d-15795896b8d7 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:16.420869 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-00bcda1d-a4d0-431e-8b5d-15795896b8d7 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:16.420869 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-00bcda1d-a4d0-431e-8b5d-15795896b8d7 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:16.420869 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-00bcda1d-a4d0-431e-8b5d-15795896b8d7 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:16.483522 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3a5dcd29-6ce0-44c0-bf2d-d16e8cf87ba5 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "DELETE /compute/v2.1/servers/c6045b08-8c91-4cdb-be37-c079e7ffe23a" status: 204 len: 0 microversion: 2.1 time: 0.449567 Oct 19 03:39:16.484560 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2620/5318] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:39:16 2022] DELETE /compute/v2.1/servers/c6045b08-8c91-4cdb-be37-c079e7ffe23a => generated 0 bytes in 452 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:39:16.493805 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f4789724-deb7-4ed0-9c35-c9c1cbbf2700 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:16.494678 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f4789724-deb7-4ed0-9c35-c9c1cbbf2700 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: c6045b08-8c91-4cdb-be37-c079e7ffe23a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:16.505605 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f4789724-deb7-4ed0-9c35-c9c1cbbf2700 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:16.506165 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f4789724-deb7-4ed0-9c35-c9c1cbbf2700 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:16.506838 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f4789724-deb7-4ed0-9c35-c9c1cbbf2700 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:16.508456 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f4789724-deb7-4ed0-9c35-c9c1cbbf2700 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:16.508456 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f4789724-deb7-4ed0-9c35-c9c1cbbf2700 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:16.508938 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f4789724-deb7-4ed0-9c35-c9c1cbbf2700 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:16.659607 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-f4789724-deb7-4ed0-9c35-c9c1cbbf2700 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:16.668588 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f4789724-deb7-4ed0-9c35-c9c1cbbf2700 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/c6045b08-8c91-4cdb-be37-c079e7ffe23a" status: 200 len: 1555 microversion: 2.1 time: 0.179593 Oct 19 03:39:16.669571 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2621/5319] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:16 2022] GET /compute/v2.1/servers/c6045b08-8c91-4cdb-be37-c079e7ffe23a => generated 1555 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:39:16.684536 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-00bcda1d-a4d0-431e-8b5d-15795896b8d7 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "POST /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770/action" status: 202 len: 0 microversion: 2.1 time: 0.276275 Oct 19 03:39:16.685845 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2699/5320] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:39:16 2022] POST /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770/action => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:39:16.694396 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ff0a23c7-8f8e-42a0-b705-92fa226fbc5d tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:16.695703 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ff0a23c7-8f8e-42a0-b705-92fa226fbc5d tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:16.702856 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ff0a23c7-8f8e-42a0-b705-92fa226fbc5d tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:16.703400 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ff0a23c7-8f8e-42a0-b705-92fa226fbc5d tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:16.703850 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ff0a23c7-8f8e-42a0-b705-92fa226fbc5d tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:16.704569 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ff0a23c7-8f8e-42a0-b705-92fa226fbc5d tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:16.706745 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ff0a23c7-8f8e-42a0-b705-92fa226fbc5d tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:16.707400 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ff0a23c7-8f8e-42a0-b705-92fa226fbc5d tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:16.911626 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ff0a23c7-8f8e-42a0-b705-92fa226fbc5d tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:16.921328 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ff0a23c7-8f8e-42a0-b705-92fa226fbc5d tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1498 microversion: 2.1 time: 0.231457 Oct 19 03:39:16.934980 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2622/5321] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:16 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1498 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:39:16.952392 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-69c89e5c-4727-43cc-8eeb-e7b0d9555918 req-ec4f30eb-bfe4-4d9d-bd2d-a7997c02fd55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fab83b8-8862-4295-adb7-e2bf5462a2d9", "tag": "277d3b94-8060-453a-baed-babf7a3dbed3"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:39:16.963563 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-69c89e5c-4727-43cc-8eeb-e7b0d9555918 req-ec4f30eb-bfe4-4d9d-bd2d-a7997c02fd55 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:16.964051 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-69c89e5c-4727-43cc-8eeb-e7b0d9555918 req-ec4f30eb-bfe4-4d9d-bd2d-a7997c02fd55 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:16.964513 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-69c89e5c-4727-43cc-8eeb-e7b0d9555918 req-ec4f30eb-bfe4-4d9d-bd2d-a7997c02fd55 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:16.979906 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-69c89e5c-4727-43cc-8eeb-e7b0d9555918 req-ec4f30eb-bfe4-4d9d-bd2d-a7997c02fd55 service nova] Creating event network-changed:277d3b94-8060-453a-baed-babf7a3dbed3 for instance 4fab83b8-8862-4295-adb7-e2bf5462a2d9 on n-h1-861333-8 Oct 19 03:39:16.985258 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-69c89e5c-4727-43cc-8eeb-e7b0d9555918 req-ec4f30eb-bfe4-4d9d-bd2d-a7997c02fd55 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.272023 Oct 19 03:39:16.990215 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2700/5322] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:39:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:39:17.003501 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a4fc3499-c1d2-4183-9f15-e34884bcd439 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:17.004302 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a4fc3499-c1d2-4183-9f15-e34884bcd439 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] [instance: d368a182-a350-4d0c-803d-2972af3aeb7d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:17.052393 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a4fc3499-c1d2-4183-9f15-e34884bcd439 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:17.053292 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a4fc3499-c1d2-4183-9f15-e34884bcd439 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:17.058988 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a4fc3499-c1d2-4183-9f15-e34884bcd439 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:17.060682 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a4fc3499-c1d2-4183-9f15-e34884bcd439 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:17.061385 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a4fc3499-c1d2-4183-9f15-e34884bcd439 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:17.062138 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a4fc3499-c1d2-4183-9f15-e34884bcd439 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:17.408635 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a4fc3499-c1d2-4183-9f15-e34884bcd439 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4670fd4408d4454784251a880d5a72f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf91777fa414ddaa797d735e7d2a275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:17.422616 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a4fc3499-c1d2-4183-9f15-e34884bcd439 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] 10.222.0.52 "GET /compute/v2.1/servers/d368a182-a350-4d0c-803d-2972af3aeb7d" status: 200 len: 1373 microversion: 2.1 time: 0.426860 Oct 19 03:39:17.423762 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2623/5323] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:16 2022] GET /compute/v2.1/servers/d368a182-a350-4d0c-803d-2972af3aeb7d => generated 1373 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:39:17.693736 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-845e561b-e468-4a38-bd63-982937d723e2 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:17.694673 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-845e561b-e468-4a38-bd63-982937d723e2 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: c6045b08-8c91-4cdb-be37-c079e7ffe23a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:17.707550 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-845e561b-e468-4a38-bd63-982937d723e2 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:17.709259 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-845e561b-e468-4a38-bd63-982937d723e2 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:17.710360 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-845e561b-e468-4a38-bd63-982937d723e2 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:17.713743 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-845e561b-e468-4a38-bd63-982937d723e2 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:17.714350 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-845e561b-e468-4a38-bd63-982937d723e2 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:17.715900 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-845e561b-e468-4a38-bd63-982937d723e2 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:17.950263 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-49d8be38-ef0a-49ea-9e2f-5a9694310f2e tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:17.951367 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-49d8be38-ef0a-49ea-9e2f-5a9694310f2e tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:17.967025 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-49d8be38-ef0a-49ea-9e2f-5a9694310f2e tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:17.968113 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-49d8be38-ef0a-49ea-9e2f-5a9694310f2e tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:17.973569 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-49d8be38-ef0a-49ea-9e2f-5a9694310f2e tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:17.977070 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-49d8be38-ef0a-49ea-9e2f-5a9694310f2e tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:17.977816 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-49d8be38-ef0a-49ea-9e2f-5a9694310f2e tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:17.978478 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-49d8be38-ef0a-49ea-9e2f-5a9694310f2e tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:18.194858 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-845e561b-e468-4a38-bd63-982937d723e2 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:18.204597 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-845e561b-e468-4a38-bd63-982937d723e2 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/c6045b08-8c91-4cdb-be37-c079e7ffe23a" status: 200 len: 1555 microversion: 2.1 time: 0.516011 Oct 19 03:39:18.221966 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2701/5324] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:17 2022] GET /compute/v2.1/servers/c6045b08-8c91-4cdb-be37-c079e7ffe23a => generated 1555 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:39:18.415362 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-49d8be38-ef0a-49ea-9e2f-5a9694310f2e tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:18.432776 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-49d8be38-ef0a-49ea-9e2f-5a9694310f2e tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1506 microversion: 2.1 time: 0.486136 Oct 19 03:39:18.437278 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2624/5325] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:17 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1506 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:39:18.447743 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-832774da-4c99-469c-9395-bba7c0b8c7eb tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:18.448743 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-832774da-4c99-469c-9395-bba7c0b8c7eb tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] [instance: d368a182-a350-4d0c-803d-2972af3aeb7d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:18.454664 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:39:18.458108 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-832774da-4c99-469c-9395-bba7c0b8c7eb tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:18.458916 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-832774da-4c99-469c-9395-bba7c0b8c7eb tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:18.459808 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-832774da-4c99-469c-9395-bba7c0b8c7eb tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:18.463402 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3c0843e2-54d7-4d85-a3a4-5dad2fcbc160 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:18.464035 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3c0843e2-54d7-4d85-a3a4-5dad2fcbc160 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:18.476249 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-832774da-4c99-469c-9395-bba7c0b8c7eb tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:18.478100 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-832774da-4c99-469c-9395-bba7c0b8c7eb tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:18.478943 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-832774da-4c99-469c-9395-bba7c0b8c7eb tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:18.483840 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3c0843e2-54d7-4d85-a3a4-5dad2fcbc160 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:18.486811 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3c0843e2-54d7-4d85-a3a4-5dad2fcbc160 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:18.489601 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3c0843e2-54d7-4d85-a3a4-5dad2fcbc160 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:18.490683 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3c0843e2-54d7-4d85-a3a4-5dad2fcbc160 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:18.491501 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3c0843e2-54d7-4d85-a3a4-5dad2fcbc160 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:18.492119 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3c0843e2-54d7-4d85-a3a4-5dad2fcbc160 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:18.908294 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-3c0843e2-54d7-4d85-a3a4-5dad2fcbc160 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:18.944377 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3c0843e2-54d7-4d85-a3a4-5dad2fcbc160 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1506 microversion: 2.1 time: 0.485295 Oct 19 03:39:18.949141 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2625/5326] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:18 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1506 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:39:18.979606 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e6c90c24-fbad-4698-b44e-030e48fc89a1 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:39:18.996812 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e6c90c24-fbad-4698-b44e-030e48fc89a1 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 6d1dc6d7-9e63-46a2-9bd6-97073fc26565] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:19.008906 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e6c90c24-fbad-4698-b44e-030e48fc89a1 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:19.010889 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e6c90c24-fbad-4698-b44e-030e48fc89a1 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:19.012016 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e6c90c24-fbad-4698-b44e-030e48fc89a1 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:19.017667 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e6c90c24-fbad-4698-b44e-030e48fc89a1 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:19.017667 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e6c90c24-fbad-4698-b44e-030e48fc89a1 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:19.017667 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e6c90c24-fbad-4698-b44e-030e48fc89a1 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:19.048167 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-e6c90c24-fbad-4698-b44e-030e48fc89a1 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] HTTP exception thrown: Instance 6d1dc6d7-9e63-46a2-9bd6-97073fc26565 could not be found. Oct 19 03:39:19.051642 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e6c90c24-fbad-4698-b44e-030e48fc89a1 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Request method failure captured: Oct 19 03:39:19.051642 n-d-861333-8 devstack@n-api.service[121134]: request: POST /compute/v2.1/servers/6d1dc6d7-9e63-46a2-9bd6-97073fc26565/action HTTP/1.1 Oct 19 03:39:19.051642 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:39:19.051642 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:39:19.051642 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:39:19.051642 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 28 Oct 19 03:39:19.051642 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:39:19.051642 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:39:19.051642 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:39:19.051642 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:39:19.051642 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3EK4yDar5R5kGdpWRPopK281fOgxjiWCAZdy3tbDZzFYZxrN53hSsTq0YyAxsfcVRT4cF0jU61e6walOKxMx_njT0L3WOIYEymBjzmNzdXOa-UhYNf83BpQOShCJts2aNodNdu7YjeLcAcuRF0ZOjoH0xsH4HoNSzc8IfQzKhRz4vw Oct 19 03:39:19.051642 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:39:19.051642 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:39:19.051642 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:39:19.051642 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:39:19.051642 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:39:19.051642 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:39:19.051642 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 34bd94983fbf4a8aa49aff65c076e9e3 Oct 19 03:39:19.051642 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:39:19.051642 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:39:19.051642 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:39:19.051642 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_34bd94983fbf4a8aa49aff65c076e9e3", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:39:19.051642 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:39:19.051642 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 34bd94983fbf4a8aa49aff65c076e9e3 Oct 19 03:39:19.051642 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:39:19.051642 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ServersNegativeTestJSON-553742303-project Oct 19 03:39:19.051642 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:39:19.051642 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:39:19.051642 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 771feb133bc046588552d3af98f8e0a1 Oct 19 03:39:19.051642 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ServersNegativeTestJSON-553742303-project Oct 19 03:39:19.051642 n-d-861333-8 devstack@n-api.service[121134]: Oct 19 03:39:19.051642 n-d-861333-8 devstack@n-api.service[121134]: {"reboot": {"type": "SOFT"}} Oct 19 03:39:19.051642 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:39:19.051642 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance 6d1dc6d7-9e63-46a2-9bd6-97073fc26565 could not be found. Oct 19 03:39:19.051642 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '6d1dc6d7-9e63-46a2-9bd6-97073fc26565', 'body': {'reboot': {'type': 'SOFT'}}} Oct 19 03:39:19.051642 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:39:19.051642 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:39:19.051642 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:39:19.051642 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:39:19.051642 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:39:19.051642 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:39:19.051642 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:39:19.051642 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:39:19.051642 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:39:19.051642 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:39:19.051642 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d1dc6d7-9e63-46a2-9bd6-97073fc26565 could not be found. Oct 19 03:39:19.051642 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:39:19.051642 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:39:19.051642 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:39:19.051642 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:39:19.051642 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:39:19.051642 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:39:19.051642 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:39:19.051642 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:39:19.051642 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:39:19.051642 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:39:19.051642 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:39:19.051642 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:39:19.051642 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 19 03:39:19.051642 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 19 03:39:19.051642 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:39:19.051642 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:39:19.051642 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:39:19.051642 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:39:19.059462 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d1dc6d7-9e63-46a2-9bd6-97073fc26565 could not be found. Oct 19 03:39:19.059462 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:39:19.059462 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:39:19.059462 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:39:19.059462 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:39:19.059462 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:39:19.059462 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:39:19.059462 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:39:19.059462 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:39:19.059462 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d1dc6d7-9e63-46a2-9bd6-97073fc26565 could not be found. Oct 19 03:39:19.059462 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:39:19.065476 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e6c90c24-fbad-4698-b44e-030e48fc89a1 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Returning 404 to user: Instance 6d1dc6d7-9e63-46a2-9bd6-97073fc26565 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:39:19.073261 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e6c90c24-fbad-4698-b44e-030e48fc89a1 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "POST /compute/v2.1/servers/6d1dc6d7-9e63-46a2-9bd6-97073fc26565/action" status: 404 len: 111 microversion: 2.1 time: 0.096310 Oct 19 03:39:19.073261 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2626/5327] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:39:18 2022] POST /compute/v2.1/servers/6d1dc6d7-9e63-46a2-9bd6-97073fc26565/action => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:39:19.077583 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-95f590df-4ca1-4bbc-a78d-680fb20090a0 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:19.082183 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-95f590df-4ca1-4bbc-a78d-680fb20090a0 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:19.095170 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-95f590df-4ca1-4bbc-a78d-680fb20090a0 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:19.095811 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-95f590df-4ca1-4bbc-a78d-680fb20090a0 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:19.096572 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-95f590df-4ca1-4bbc-a78d-680fb20090a0 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:19.097528 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-95f590df-4ca1-4bbc-a78d-680fb20090a0 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:19.098062 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-95f590df-4ca1-4bbc-a78d-680fb20090a0 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:19.098588 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-95f590df-4ca1-4bbc-a78d-680fb20090a0 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:19.200895 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-832774da-4c99-469c-9395-bba7c0b8c7eb tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4670fd4408d4454784251a880d5a72f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf91777fa414ddaa797d735e7d2a275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:19.212202 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-832774da-4c99-469c-9395-bba7c0b8c7eb tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] 10.222.0.52 "GET /compute/v2.1/servers/d368a182-a350-4d0c-803d-2972af3aeb7d" status: 200 len: 1373 microversion: 2.1 time: 0.768764 Oct 19 03:39:19.231980 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2702/5328] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:18 2022] GET /compute/v2.1/servers/d368a182-a350-4d0c-803d-2972af3aeb7d => generated 1373 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:39:19.239602 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-5ac54815-f3fd-4b2d-89c5-d186756f7aaa req-04ff3af4-b999-4feb-b9c5-8be474eb265f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fab83b8-8862-4295-adb7-e2bf5462a2d9", "tag": "277d3b94-8060-453a-baed-babf7a3dbed3"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:39:19.250778 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-5ac54815-f3fd-4b2d-89c5-d186756f7aaa req-04ff3af4-b999-4feb-b9c5-8be474eb265f service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:19.251903 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-5ac54815-f3fd-4b2d-89c5-d186756f7aaa req-04ff3af4-b999-4feb-b9c5-8be474eb265f service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:19.252632 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-5ac54815-f3fd-4b2d-89c5-d186756f7aaa req-04ff3af4-b999-4feb-b9c5-8be474eb265f service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:19.268663 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-5ac54815-f3fd-4b2d-89c5-d186756f7aaa req-04ff3af4-b999-4feb-b9c5-8be474eb265f service nova] Creating event network-changed:277d3b94-8060-453a-baed-babf7a3dbed3 for instance 4fab83b8-8862-4295-adb7-e2bf5462a2d9 on n-h1-861333-8 Oct 19 03:39:19.274949 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-5ac54815-f3fd-4b2d-89c5-d186756f7aaa req-04ff3af4-b999-4feb-b9c5-8be474eb265f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041065 Oct 19 03:39:19.276593 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2703/5329] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:39:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:39:19.281979 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ba733f4a-08c9-443b-acea-d584334b10d5 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:19.282993 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ba733f4a-08c9-443b-acea-d584334b10d5 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: c6045b08-8c91-4cdb-be37-c079e7ffe23a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:19.292201 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ba733f4a-08c9-443b-acea-d584334b10d5 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:19.297439 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ba733f4a-08c9-443b-acea-d584334b10d5 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:19.297439 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ba733f4a-08c9-443b-acea-d584334b10d5 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:19.297439 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ba733f4a-08c9-443b-acea-d584334b10d5 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:19.297439 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ba733f4a-08c9-443b-acea-d584334b10d5 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:19.297439 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ba733f4a-08c9-443b-acea-d584334b10d5 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:19.584898 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-95f590df-4ca1-4bbc-a78d-680fb20090a0 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:19.592715 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-95f590df-4ca1-4bbc-a78d-680fb20090a0 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1506 microversion: 2.1 time: 0.520048 Oct 19 03:39:19.609852 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2627/5330] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:19 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1506 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:39:19.618217 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9ae19836-6852-4ab2-a198-37f832d2a3aa tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:19.619088 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9ae19836-6852-4ab2-a198-37f832d2a3aa tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:19.625704 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9ae19836-6852-4ab2-a198-37f832d2a3aa tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:19.626443 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9ae19836-6852-4ab2-a198-37f832d2a3aa tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:19.627053 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9ae19836-6852-4ab2-a198-37f832d2a3aa tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:19.628527 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9ae19836-6852-4ab2-a198-37f832d2a3aa tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:19.629158 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9ae19836-6852-4ab2-a198-37f832d2a3aa tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:19.629829 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9ae19836-6852-4ab2-a198-37f832d2a3aa tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:19.771726 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ba733f4a-08c9-443b-acea-d584334b10d5 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:19.781871 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ba733f4a-08c9-443b-acea-d584334b10d5 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/c6045b08-8c91-4cdb-be37-c079e7ffe23a" status: 200 len: 1555 microversion: 2.1 time: 0.503797 Oct 19 03:39:19.789575 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2704/5331] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:19 2022] GET /compute/v2.1/servers/c6045b08-8c91-4cdb-be37-c079e7ffe23a => generated 1555 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:39:19.894273 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9ae19836-6852-4ab2-a198-37f832d2a3aa tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:19.903254 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9ae19836-6852-4ab2-a198-37f832d2a3aa tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1506 microversion: 2.1 time: 0.288973 Oct 19 03:39:19.908232 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2628/5332] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:19 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1506 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:39:19.938345 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-38493d0c-90a9-4efc-ac20-c498fd4a09ec tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:39:19.943160 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-38493d0c-90a9-4efc-ac20-c498fd4a09ec tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: d1ecf1ef-8b0e-4496-9f6b-2d7b1c0091c0] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:19.949653 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-38493d0c-90a9-4efc-ac20-c498fd4a09ec tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] HTTP exception thrown: Instance d1ecf1ef-8b0e-4496-9f6b-2d7b1c0091c0 could not be found. Oct 19 03:39:19.952581 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-38493d0c-90a9-4efc-ac20-c498fd4a09ec tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Request method failure captured: Oct 19 03:39:19.952581 n-d-861333-8 devstack@n-api.service[121135]: request: POST /compute/v2.1/servers/d1ecf1ef-8b0e-4496-9f6b-2d7b1c0091c0/action HTTP/1.1 Oct 19 03:39:19.952581 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:39:19.952581 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:39:19.952581 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:39:19.952581 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 28 Oct 19 03:39:19.952581 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:39:19.952581 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:39:19.952581 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:39:19.952581 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:39:19.952581 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT3EK4yDar5R5kGdpWRPopK281fOgxjiWCAZdy3tbDZzFYZxrN53hSsTq0YyAxsfcVRT4cF0jU61e6walOKxMx_njT0L3WOIYEymBjzmNzdXOa-UhYNf83BpQOShCJts2aNodNdu7YjeLcAcuRF0ZOjoH0xsH4HoNSzc8IfQzKhRz4vw Oct 19 03:39:19.952581 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:39:19.952581 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:39:19.952581 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:39:19.952581 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:39:19.952581 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:39:19.952581 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:39:19.952581 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 34bd94983fbf4a8aa49aff65c076e9e3 Oct 19 03:39:19.952581 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:39:19.952581 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:39:19.952581 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:39:19.952581 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_34bd94983fbf4a8aa49aff65c076e9e3", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:39:19.952581 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:39:19.952581 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 34bd94983fbf4a8aa49aff65c076e9e3 Oct 19 03:39:19.952581 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:39:19.952581 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ServersNegativeTestJSON-553742303-project Oct 19 03:39:19.952581 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:39:19.952581 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:39:19.952581 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 771feb133bc046588552d3af98f8e0a1 Oct 19 03:39:19.952581 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ServersNegativeTestJSON-553742303-project Oct 19 03:39:19.952581 n-d-861333-8 devstack@n-api.service[121135]: Oct 19 03:39:19.952581 n-d-861333-8 devstack@n-api.service[121135]: {"reboot": {"type": "SOFT"}} Oct 19 03:39:19.952581 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:39:19.952581 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance d1ecf1ef-8b0e-4496-9f6b-2d7b1c0091c0 could not be found. Oct 19 03:39:19.952581 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': 'd1ecf1ef-8b0e-4496-9f6b-2d7b1c0091c0', 'body': {'reboot': {'type': 'SOFT'}}} Oct 19 03:39:19.952581 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:39:19.952581 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:39:19.952581 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:39:19.952581 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:39:19.952581 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:39:19.952581 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:39:19.952581 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 19 03:39:19.952581 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 19 03:39:19.952581 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1ecf1ef-8b0e-4496-9f6b-2d7b1c0091c0 could not be found. Oct 19 03:39:19.952581 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:39:19.952581 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:39:19.952581 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:39:19.952581 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:39:19.952581 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:39:19.952581 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:39:19.952581 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:39:19.952581 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:39:19.952581 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:39:19.952581 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:39:19.952581 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:39:19.952581 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:39:19.952581 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 19 03:39:19.952581 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 19 03:39:19.952581 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:39:19.952581 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:39:19.952581 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:39:19.952581 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:39:19.952581 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1ecf1ef-8b0e-4496-9f6b-2d7b1c0091c0 could not be found. Oct 19 03:39:19.952581 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:39:19.960567 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:39:19.960567 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:39:19.960567 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:39:19.960567 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:39:19.960567 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:39:19.960567 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:39:19.960567 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:39:19.960567 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1ecf1ef-8b0e-4496-9f6b-2d7b1c0091c0 could not be found. Oct 19 03:39:19.960567 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:39:19.960567 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-38493d0c-90a9-4efc-ac20-c498fd4a09ec tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Returning 404 to user: Instance d1ecf1ef-8b0e-4496-9f6b-2d7b1c0091c0 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:39:19.960567 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-38493d0c-90a9-4efc-ac20-c498fd4a09ec tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "POST /compute/v2.1/servers/d1ecf1ef-8b0e-4496-9f6b-2d7b1c0091c0/action" status: 404 len: 111 microversion: 2.1 time: 0.021522 Oct 19 03:39:19.979181 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ad0159ca-1c16-44c9-ba4a-146d7bc0e054 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:19.983926 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ad0159ca-1c16-44c9-ba4a-146d7bc0e054 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:19.994376 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2705/5333] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:39:19 2022] POST /compute/v2.1/servers/d1ecf1ef-8b0e-4496-9f6b-2d7b1c0091c0/action => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:39:19.996156 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ad0159ca-1c16-44c9-ba4a-146d7bc0e054 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:19.997024 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ad0159ca-1c16-44c9-ba4a-146d7bc0e054 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:19.998056 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ad0159ca-1c16-44c9-ba4a-146d7bc0e054 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:19.998797 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ad0159ca-1c16-44c9-ba4a-146d7bc0e054 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:19.999260 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ad0159ca-1c16-44c9-ba4a-146d7bc0e054 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:19.999902 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ad0159ca-1c16-44c9-ba4a-146d7bc0e054 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:20.240947 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e4764ad6-1909-462a-8737-60693cf48cfd tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:20.242206 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e4764ad6-1909-462a-8737-60693cf48cfd tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] [instance: d368a182-a350-4d0c-803d-2972af3aeb7d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:20.255977 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e4764ad6-1909-462a-8737-60693cf48cfd tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:20.256493 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e4764ad6-1909-462a-8737-60693cf48cfd tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:20.256938 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e4764ad6-1909-462a-8737-60693cf48cfd tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:20.257947 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e4764ad6-1909-462a-8737-60693cf48cfd tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:20.258405 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e4764ad6-1909-462a-8737-60693cf48cfd tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:20.258836 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e4764ad6-1909-462a-8737-60693cf48cfd tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:20.379429 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ad0159ca-1c16-44c9-ba4a-146d7bc0e054 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:20.417450 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ad0159ca-1c16-44c9-ba4a-146d7bc0e054 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1506 microversion: 2.1 time: 0.442983 Oct 19 03:39:20.419595 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2629/5334] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:19 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1506 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:39:20.443680 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-525ce623-0ff1-4259-9474-7b9f49ca4cbe tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:20.446506 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-525ce623-0ff1-4259-9474-7b9f49ca4cbe tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:20.450371 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-525ce623-0ff1-4259-9474-7b9f49ca4cbe tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:20.451103 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-525ce623-0ff1-4259-9474-7b9f49ca4cbe tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:20.451712 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-525ce623-0ff1-4259-9474-7b9f49ca4cbe tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:20.452611 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-525ce623-0ff1-4259-9474-7b9f49ca4cbe tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:20.453237 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-525ce623-0ff1-4259-9474-7b9f49ca4cbe tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:20.453851 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-525ce623-0ff1-4259-9474-7b9f49ca4cbe tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:20.596832 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-e4764ad6-1909-462a-8737-60693cf48cfd tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4670fd4408d4454784251a880d5a72f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf91777fa414ddaa797d735e7d2a275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:20.611580 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e4764ad6-1909-462a-8737-60693cf48cfd tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] 10.222.0.52 "GET /compute/v2.1/servers/d368a182-a350-4d0c-803d-2972af3aeb7d" status: 200 len: 1373 microversion: 2.1 time: 0.374348 Oct 19 03:39:20.614268 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2706/5335] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:20 2022] GET /compute/v2.1/servers/d368a182-a350-4d0c-803d-2972af3aeb7d => generated 1373 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:39:20.809122 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-476ae650-64d3-4ca1-84ed-90f6f604ce79 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:20.810202 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-476ae650-64d3-4ca1-84ed-90f6f604ce79 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: c6045b08-8c91-4cdb-be37-c079e7ffe23a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:20.821154 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-525ce623-0ff1-4259-9474-7b9f49ca4cbe tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:20.832394 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-525ce623-0ff1-4259-9474-7b9f49ca4cbe tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1506 microversion: 2.1 time: 0.393286 Oct 19 03:39:20.836439 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2630/5336] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:20 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1506 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:39:20.849335 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-476ae650-64d3-4ca1-84ed-90f6f604ce79 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:20.851184 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-476ae650-64d3-4ca1-84ed-90f6f604ce79 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:20.854553 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-476ae650-64d3-4ca1-84ed-90f6f604ce79 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:20.855533 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-476ae650-64d3-4ca1-84ed-90f6f604ce79 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:20.861236 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a30d2840-a0bc-443a-92f2-6b5eb383332d tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:39:20.864282 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a30d2840-a0bc-443a-92f2-6b5eb383332d tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 6d1dc6d7-9e63-46a2-9bd6-97073fc26565] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:20.866826 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-476ae650-64d3-4ca1-84ed-90f6f604ce79 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:20.870202 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-476ae650-64d3-4ca1-84ed-90f6f604ce79 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:20.889753 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a30d2840-a0bc-443a-92f2-6b5eb383332d tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:20.889753 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a30d2840-a0bc-443a-92f2-6b5eb383332d tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:20.889753 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a30d2840-a0bc-443a-92f2-6b5eb383332d tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:20.889753 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a30d2840-a0bc-443a-92f2-6b5eb383332d tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:20.898320 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a30d2840-a0bc-443a-92f2-6b5eb383332d tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:20.899851 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a30d2840-a0bc-443a-92f2-6b5eb383332d tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:20.940055 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-a30d2840-a0bc-443a-92f2-6b5eb383332d tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] HTTP exception thrown: Instance 6d1dc6d7-9e63-46a2-9bd6-97073fc26565 could not be found. Oct 19 03:39:20.944084 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a30d2840-a0bc-443a-92f2-6b5eb383332d tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Request method failure captured: Oct 19 03:39:20.944084 n-d-861333-8 devstack@n-api.service[121134]: request: POST /compute/v2.1/servers/6d1dc6d7-9e63-46a2-9bd6-97073fc26565/action HTTP/1.1 Oct 19 03:39:20.944084 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:39:20.944084 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:39:20.944084 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:39:20.944084 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 65 Oct 19 03:39:20.944084 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:39:20.944084 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:39:20.944084 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:39:20.944084 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:39:20.944084 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3EK4yDar5R5kGdpWRPopK281fOgxjiWCAZdy3tbDZzFYZxrN53hSsTq0YyAxsfcVRT4cF0jU61e6walOKxMx_njT0L3WOIYEymBjzmNzdXOa-UhYNf83BpQOShCJts2aNodNdu7YjeLcAcuRF0ZOjoH0xsH4HoNSzc8IfQzKhRz4vw Oct 19 03:39:20.944084 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:39:20.944084 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:39:20.944084 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:39:20.944084 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:39:20.944084 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:39:20.944084 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:39:20.944084 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 34bd94983fbf4a8aa49aff65c076e9e3 Oct 19 03:39:20.944084 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:39:20.944084 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:39:20.944084 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:39:20.944084 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_34bd94983fbf4a8aa49aff65c076e9e3", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:39:20.944084 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:39:20.944084 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 34bd94983fbf4a8aa49aff65c076e9e3 Oct 19 03:39:20.944084 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:39:20.944084 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ServersNegativeTestJSON-553742303-project Oct 19 03:39:20.944084 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:39:20.944084 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:39:20.944084 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 771feb133bc046588552d3af98f8e0a1 Oct 19 03:39:20.944084 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ServersNegativeTestJSON-553742303-project Oct 19 03:39:20.944084 n-d-861333-8 devstack@n-api.service[121134]: Oct 19 03:39:20.944084 n-d-861333-8 devstack@n-api.service[121134]: {"rebuild": {"imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02"}} Oct 19 03:39:20.944084 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:39:20.944084 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance 6d1dc6d7-9e63-46a2-9bd6-97073fc26565 could not be found. Oct 19 03:39:20.944084 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '6d1dc6d7-9e63-46a2-9bd6-97073fc26565', 'body': {'rebuild': {'imageRef': '9e16d73e-70ea-4421-aee3-047d80396c02'}}} Oct 19 03:39:20.944084 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:39:20.944084 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:39:20.944084 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:39:20.944084 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:39:20.944084 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:39:20.944084 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:39:20.944084 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:39:20.944084 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:39:20.944084 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:39:20.944084 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:39:20.944084 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d1dc6d7-9e63-46a2-9bd6-97073fc26565 could not be found. Oct 19 03:39:20.944084 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:39:20.944084 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:39:20.944084 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:39:20.944084 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:39:20.944084 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:39:20.944084 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:39:20.944084 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:39:20.944084 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:39:20.944084 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:39:20.944084 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:39:20.944084 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:39:20.944084 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:39:20.944084 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:39:20.944084 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:39:20.944084 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:39:20.944084 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:39:20.944084 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 19 03:39:20.944084 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 19 03:39:20.948743 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 19 03:39:20.948743 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:39:20.948743 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:39:20.948743 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:39:20.948743 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:39:20.948743 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d1dc6d7-9e63-46a2-9bd6-97073fc26565 could not be found. Oct 19 03:39:20.948743 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:39:20.948743 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:39:20.948743 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:39:20.948743 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:39:20.948743 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:39:20.948743 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:39:20.948743 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:39:20.948743 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:39:20.948743 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d1dc6d7-9e63-46a2-9bd6-97073fc26565 could not be found. Oct 19 03:39:20.948743 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:39:20.948743 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a30d2840-a0bc-443a-92f2-6b5eb383332d tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Returning 404 to user: Instance 6d1dc6d7-9e63-46a2-9bd6-97073fc26565 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:39:20.948743 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a30d2840-a0bc-443a-92f2-6b5eb383332d tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "POST /compute/v2.1/servers/6d1dc6d7-9e63-46a2-9bd6-97073fc26565/action" status: 404 len: 111 microversion: 2.1 time: 0.091493 Oct 19 03:39:20.952980 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2631/5337] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:39:20 2022] POST /compute/v2.1/servers/6d1dc6d7-9e63-46a2-9bd6-97073fc26565/action => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 03:39:20.963799 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-bc980a69-ff33-4b56-8ddd-e6789f01681e tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:20.967305 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-bc980a69-ff33-4b56-8ddd-e6789f01681e tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:20.985234 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bc980a69-ff33-4b56-8ddd-e6789f01681e tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:20.985808 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bc980a69-ff33-4b56-8ddd-e6789f01681e tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:20.986304 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bc980a69-ff33-4b56-8ddd-e6789f01681e tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:20.987662 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bc980a69-ff33-4b56-8ddd-e6789f01681e tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:20.988130 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bc980a69-ff33-4b56-8ddd-e6789f01681e tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:20.988568 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bc980a69-ff33-4b56-8ddd-e6789f01681e tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:21.020915 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-476ae650-64d3-4ca1-84ed-90f6f604ce79 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:21.034934 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-476ae650-64d3-4ca1-84ed-90f6f604ce79 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/c6045b08-8c91-4cdb-be37-c079e7ffe23a" status: 200 len: 1346 microversion: 2.1 time: 0.234043 Oct 19 03:39:21.037804 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2707/5338] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:20 2022] GET /compute/v2.1/servers/c6045b08-8c91-4cdb-be37-c079e7ffe23a => generated 1346 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:39:21.258508 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-bc980a69-ff33-4b56-8ddd-e6789f01681e tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:21.264482 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-bc980a69-ff33-4b56-8ddd-e6789f01681e tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1506 microversion: 2.1 time: 0.310153 Oct 19 03:39:21.265057 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2632/5339] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:20 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1506 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:39:21.283756 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-dc84bcfa-70e7-4637-8102-e635b00425f0 req-2f977444-7af6-4d85-89c9-c2b4a5bb69fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d368a182-a350-4d0c-803d-2972af3aeb7d", "name": "network-vif-plugged", "status": "completed", "tag": "76e9dcc7-fe11-440c-8253-409dfac2a873"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:39:21.293548 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ae78ab00-df84-4f85-8baa-2fffa979517d tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:21.294399 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ae78ab00-df84-4f85-8baa-2fffa979517d tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:21.295475 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-dc84bcfa-70e7-4637-8102-e635b00425f0 req-2f977444-7af6-4d85-89c9-c2b4a5bb69fb service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:21.296230 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-dc84bcfa-70e7-4637-8102-e635b00425f0 req-2f977444-7af6-4d85-89c9-c2b4a5bb69fb service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:21.296878 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-dc84bcfa-70e7-4637-8102-e635b00425f0 req-2f977444-7af6-4d85-89c9-c2b4a5bb69fb service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:21.305585 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ae78ab00-df84-4f85-8baa-2fffa979517d tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:21.306183 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ae78ab00-df84-4f85-8baa-2fffa979517d tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:21.306557 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ae78ab00-df84-4f85-8baa-2fffa979517d tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:21.309688 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ae78ab00-df84-4f85-8baa-2fffa979517d tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:21.310219 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ae78ab00-df84-4f85-8baa-2fffa979517d tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:21.313424 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-dc84bcfa-70e7-4637-8102-e635b00425f0 req-2f977444-7af6-4d85-89c9-c2b4a5bb69fb service nova] Creating event network-vif-plugged:76e9dcc7-fe11-440c-8253-409dfac2a873 for instance d368a182-a350-4d0c-803d-2972af3aeb7d on n-h2-861333-8 Oct 19 03:39:21.319943 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ae78ab00-df84-4f85-8baa-2fffa979517d tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:21.320801 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-dc84bcfa-70e7-4637-8102-e635b00425f0 req-2f977444-7af6-4d85-89c9-c2b4a5bb69fb service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041433 Oct 19 03:39:21.322433 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2708/5340] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:39:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:39:21.350266 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-84479d7e-5f63-419c-9bde-1c6661aa8bcf req-59331ccb-a9e7-4f0b-954a-ded98d6f443a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6045b08-8c91-4cdb-be37-c079e7ffe23a", "name": "network-vif-deleted", "tag": "4e2605b6-c38c-4154-93ae-04ca20dd249c"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:39:21.362713 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-84479d7e-5f63-419c-9bde-1c6661aa8bcf req-59331ccb-a9e7-4f0b-954a-ded98d6f443a service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:21.363562 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-84479d7e-5f63-419c-9bde-1c6661aa8bcf req-59331ccb-a9e7-4f0b-954a-ded98d6f443a service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:21.364223 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-84479d7e-5f63-419c-9bde-1c6661aa8bcf req-59331ccb-a9e7-4f0b-954a-ded98d6f443a service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:21.376305 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-84479d7e-5f63-419c-9bde-1c6661aa8bcf req-59331ccb-a9e7-4f0b-954a-ded98d6f443a service nova] Creating event network-vif-deleted:4e2605b6-c38c-4154-93ae-04ca20dd249c for instance c6045b08-8c91-4cdb-be37-c079e7ffe23a on n-h1-861333-8 Oct 19 03:39:21.384016 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-84479d7e-5f63-419c-9bde-1c6661aa8bcf req-59331ccb-a9e7-4f0b-954a-ded98d6f443a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038238 Oct 19 03:39:21.385005 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2709/5341] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:39:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:39:21.546971 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ae78ab00-df84-4f85-8baa-2fffa979517d tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:21.869540 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ae78ab00-df84-4f85-8baa-2fffa979517d tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1506 microversion: 2.1 time: 0.270140 Oct 19 03:39:21.869540 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2633/5342] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:21 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1506 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:39:21.871050 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-edc71b5d-2e1c-4483-9d3e-ccb966124906 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:39:21.871050 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-edc71b5d-2e1c-4483-9d3e-ccb966124906 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 1728d4fe-63f1-47f9-9975-7d9dabab6846] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:21.871050 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-edc71b5d-2e1c-4483-9d3e-ccb966124906 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] HTTP exception thrown: Instance 1728d4fe-63f1-47f9-9975-7d9dabab6846 could not be found. Oct 19 03:39:21.871050 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-edc71b5d-2e1c-4483-9d3e-ccb966124906 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Request method failure captured: Oct 19 03:39:21.871050 n-d-861333-8 devstack@n-api.service[121135]: request: POST /compute/v2.1/servers/1728d4fe-63f1-47f9-9975-7d9dabab6846/action HTTP/1.1 Oct 19 03:39:21.871050 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:39:21.871050 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:39:21.871050 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:39:21.871050 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 65 Oct 19 03:39:21.871050 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:39:21.871050 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:39:21.871050 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:39:21.871050 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:39:21.871050 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT3EK4yDar5R5kGdpWRPopK281fOgxjiWCAZdy3tbDZzFYZxrN53hSsTq0YyAxsfcVRT4cF0jU61e6walOKxMx_njT0L3WOIYEymBjzmNzdXOa-UhYNf83BpQOShCJts2aNodNdu7YjeLcAcuRF0ZOjoH0xsH4HoNSzc8IfQzKhRz4vw Oct 19 03:39:21.871050 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:39:21.871050 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:39:21.871050 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:39:21.871050 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:39:21.871050 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:39:21.871050 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:39:21.871050 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 34bd94983fbf4a8aa49aff65c076e9e3 Oct 19 03:39:21.871050 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:39:21.871050 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:39:21.871050 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:39:21.871050 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_34bd94983fbf4a8aa49aff65c076e9e3", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:39:21.871050 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:39:21.871050 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 34bd94983fbf4a8aa49aff65c076e9e3 Oct 19 03:39:21.871050 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:39:21.871050 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ServersNegativeTestJSON-553742303-project Oct 19 03:39:21.871050 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:39:21.871050 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:39:21.871050 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 771feb133bc046588552d3af98f8e0a1 Oct 19 03:39:21.871050 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ServersNegativeTestJSON-553742303-project Oct 19 03:39:21.871050 n-d-861333-8 devstack@n-api.service[121135]: Oct 19 03:39:21.871050 n-d-861333-8 devstack@n-api.service[121135]: {"rebuild": {"imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02"}} Oct 19 03:39:21.871050 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:39:21.871050 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance 1728d4fe-63f1-47f9-9975-7d9dabab6846 could not be found. Oct 19 03:39:21.871050 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '1728d4fe-63f1-47f9-9975-7d9dabab6846', 'body': {'rebuild': {'imageRef': '9e16d73e-70ea-4421-aee3-047d80396c02'}}} Oct 19 03:39:21.871050 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:39:21.871050 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:39:21.871050 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:39:21.871050 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:39:21.871050 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:39:21.871050 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:39:21.871050 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 19 03:39:21.871050 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 19 03:39:21.871050 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1728d4fe-63f1-47f9-9975-7d9dabab6846 could not be found. Oct 19 03:39:21.871050 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:39:21.871050 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:39:21.871050 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:39:21.871050 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:39:21.871050 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:39:21.871050 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:39:21.871050 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:39:21.871050 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:39:21.874953 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:39:21.874953 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:39:21.874953 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:39:21.874953 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:39:21.874953 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:39:21.874953 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:39:21.874953 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:39:21.874953 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:39:21.874953 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 19 03:39:21.874953 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 19 03:39:21.874953 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 19 03:39:21.874953 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:39:21.874953 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:39:21.874953 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:39:21.874953 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:39:21.874953 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1728d4fe-63f1-47f9-9975-7d9dabab6846 could not be found. Oct 19 03:39:21.874953 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:39:21.874953 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:39:21.874953 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:39:21.874953 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:39:21.874953 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:39:21.874953 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:39:21.874953 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:39:21.874953 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:39:21.874953 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1728d4fe-63f1-47f9-9975-7d9dabab6846 could not be found. Oct 19 03:39:21.874953 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:39:21.874953 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-edc71b5d-2e1c-4483-9d3e-ccb966124906 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Returning 404 to user: Instance 1728d4fe-63f1-47f9-9975-7d9dabab6846 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:39:21.874953 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-edc71b5d-2e1c-4483-9d3e-ccb966124906 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "POST /compute/v2.1/servers/1728d4fe-63f1-47f9-9975-7d9dabab6846/action" status: 404 len: 111 microversion: 2.1 time: 0.019691 Oct 19 03:39:21.874953 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2710/5343] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:39:21 2022] POST /compute/v2.1/servers/1728d4fe-63f1-47f9-9975-7d9dabab6846/action => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:39:21.877287 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-fb526b55-2e96-4f59-9ed2-54cf9c93144a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:21.877287 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-fb526b55-2e96-4f59-9ed2-54cf9c93144a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:21.877287 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fb526b55-2e96-4f59-9ed2-54cf9c93144a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:21.877287 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fb526b55-2e96-4f59-9ed2-54cf9c93144a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:21.877287 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fb526b55-2e96-4f59-9ed2-54cf9c93144a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:21.877287 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fb526b55-2e96-4f59-9ed2-54cf9c93144a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:21.877287 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fb526b55-2e96-4f59-9ed2-54cf9c93144a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:21.877287 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fb526b55-2e96-4f59-9ed2-54cf9c93144a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:21.877954 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c48e3672-8ade-4a94-b88f-112c0c3330ba tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:21.877954 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c48e3672-8ade-4a94-b88f-112c0c3330ba tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] [instance: d368a182-a350-4d0c-803d-2972af3aeb7d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:21.877954 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c48e3672-8ade-4a94-b88f-112c0c3330ba tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:21.877954 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c48e3672-8ade-4a94-b88f-112c0c3330ba tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:21.877954 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c48e3672-8ade-4a94-b88f-112c0c3330ba tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:21.877954 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c48e3672-8ade-4a94-b88f-112c0c3330ba tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:21.877954 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c48e3672-8ade-4a94-b88f-112c0c3330ba tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:21.877954 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c48e3672-8ade-4a94-b88f-112c0c3330ba tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:21.878918 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-fb526b55-2e96-4f59-9ed2-54cf9c93144a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:21.878918 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-fb526b55-2e96-4f59-9ed2-54cf9c93144a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1506 microversion: 2.1 time: 0.261164 Oct 19 03:39:21.878918 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2634/5344] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:21 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1506 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:39:21.894993 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-07018211-47d1-4b51-9060-91edf3b47c5f tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:21.895801 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-07018211-47d1-4b51-9060-91edf3b47c5f tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:21.904791 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-07018211-47d1-4b51-9060-91edf3b47c5f tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:21.904791 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-07018211-47d1-4b51-9060-91edf3b47c5f tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:21.905280 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-07018211-47d1-4b51-9060-91edf3b47c5f tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:21.906821 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-07018211-47d1-4b51-9060-91edf3b47c5f tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:21.907762 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-07018211-47d1-4b51-9060-91edf3b47c5f tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:21.908237 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-07018211-47d1-4b51-9060-91edf3b47c5f tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:21.910354 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c48e3672-8ade-4a94-b88f-112c0c3330ba tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4670fd4408d4454784251a880d5a72f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf91777fa414ddaa797d735e7d2a275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:21.919079 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c48e3672-8ade-4a94-b88f-112c0c3330ba tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] 10.222.0.52 "GET /compute/v2.1/servers/d368a182-a350-4d0c-803d-2972af3aeb7d" status: 200 len: 1373 microversion: 2.1 time: 0.287679 Oct 19 03:39:21.920019 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2711/5345] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:21 2022] GET /compute/v2.1/servers/d368a182-a350-4d0c-803d-2972af3aeb7d => generated 1373 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:39:22.062401 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-07018211-47d1-4b51-9060-91edf3b47c5f tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:22.068522 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e373a521-7b52-42e9-82dc-537af31a8be6 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:22.068522 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e373a521-7b52-42e9-82dc-537af31a8be6 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: c6045b08-8c91-4cdb-be37-c079e7ffe23a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:22.072247 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e373a521-7b52-42e9-82dc-537af31a8be6 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:22.072976 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e373a521-7b52-42e9-82dc-537af31a8be6 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:22.073126 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-07018211-47d1-4b51-9060-91edf3b47c5f tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1506 microversion: 2.1 time: 0.183510 Oct 19 03:39:22.073619 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e373a521-7b52-42e9-82dc-537af31a8be6 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:22.074342 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e373a521-7b52-42e9-82dc-537af31a8be6 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:22.074697 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2635/5346] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:21 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1506 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:39:22.074793 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e373a521-7b52-42e9-82dc-537af31a8be6 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:22.075292 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e373a521-7b52-42e9-82dc-537af31a8be6 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:22.108974 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8d59db19-be73-4fc3-b799-ca1b27fae270 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:39:22.111438 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8d59db19-be73-4fc3-b799-ca1b27fae270 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: bfb3b525-6fd9-4ad1-9d8c-557c2883ff06] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:22.128963 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-8d59db19-be73-4fc3-b799-ca1b27fae270 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] HTTP exception thrown: Instance bfb3b525-6fd9-4ad1-9d8c-557c2883ff06 could not be found. Oct 19 03:39:22.132663 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8d59db19-be73-4fc3-b799-ca1b27fae270 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Request method failure captured: Oct 19 03:39:22.132663 n-d-861333-8 devstack@n-api.service[121134]: request: POST /compute/v2.1/servers/bfb3b525-6fd9-4ad1-9d8c-557c2883ff06/action HTTP/1.1 Oct 19 03:39:22.132663 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:39:22.132663 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:39:22.132663 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:39:22.132663 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 15 Oct 19 03:39:22.132663 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:39:22.132663 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:39:22.132663 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:39:22.132663 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:39:22.132663 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3EK4yDar5R5kGdpWRPopK281fOgxjiWCAZdy3tbDZzFYZxrN53hSsTq0YyAxsfcVRT4cF0jU61e6walOKxMx_njT0L3WOIYEymBjzmNzdXOa-UhYNf83BpQOShCJts2aNodNdu7YjeLcAcuRF0ZOjoH0xsH4HoNSzc8IfQzKhRz4vw Oct 19 03:39:22.132663 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:39:22.132663 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:39:22.132663 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:39:22.132663 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:39:22.132663 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:39:22.132663 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:39:22.132663 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 34bd94983fbf4a8aa49aff65c076e9e3 Oct 19 03:39:22.132663 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:39:22.132663 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:39:22.132663 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:39:22.132663 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_34bd94983fbf4a8aa49aff65c076e9e3", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:39:22.132663 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:39:22.132663 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 34bd94983fbf4a8aa49aff65c076e9e3 Oct 19 03:39:22.132663 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:39:22.132663 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ServersNegativeTestJSON-553742303-project Oct 19 03:39:22.132663 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:39:22.132663 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:39:22.132663 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 771feb133bc046588552d3af98f8e0a1 Oct 19 03:39:22.132663 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ServersNegativeTestJSON-553742303-project Oct 19 03:39:22.132663 n-d-861333-8 devstack@n-api.service[121134]: Oct 19 03:39:22.132663 n-d-861333-8 devstack@n-api.service[121134]: {"restore": {}} Oct 19 03:39:22.132663 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:39:22.132663 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance bfb3b525-6fd9-4ad1-9d8c-557c2883ff06 could not be found. Oct 19 03:39:22.132663 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': 'bfb3b525-6fd9-4ad1-9d8c-557c2883ff06', 'body': {'restore': {}}} Oct 19 03:39:22.132663 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:39:22.132663 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:39:22.132663 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:39:22.132663 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:39:22.132663 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:39:22.132663 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:39:22.132663 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 19 03:39:22.132663 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 19 03:39:22.132663 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bfb3b525-6fd9-4ad1-9d8c-557c2883ff06 could not be found. Oct 19 03:39:22.132663 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:39:22.132663 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:39:22.132663 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:39:22.132663 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:39:22.132663 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:39:22.132663 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:39:22.132663 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:39:22.132663 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:39:22.132663 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:39:22.132663 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:39:22.132663 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Oct 19 03:39:22.132663 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 19 03:39:22.132663 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:39:22.132663 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:39:22.132663 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfb3b525-6fd9-4ad1-9d8c-557c2883ff06 could not be found. Oct 19 03:39:22.132663 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:39:22.132663 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:39:22.132663 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:39:22.132663 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:39:22.132663 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:39:22.132663 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:39:22.135528 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:39:22.135528 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:39:22.135528 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfb3b525-6fd9-4ad1-9d8c-557c2883ff06 could not be found. Oct 19 03:39:22.135528 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:39:22.140526 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8d59db19-be73-4fc3-b799-ca1b27fae270 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Returning 404 to user: Instance bfb3b525-6fd9-4ad1-9d8c-557c2883ff06 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:39:22.141885 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8d59db19-be73-4fc3-b799-ca1b27fae270 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "POST /compute/v2.1/servers/bfb3b525-6fd9-4ad1-9d8c-557c2883ff06/action" status: 404 len: 111 microversion: 2.1 time: 0.044538 Oct 19 03:39:22.142459 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-e373a521-7b52-42e9-82dc-537af31a8be6 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:22.143886 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2636/5347] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:39:22 2022] POST /compute/v2.1/servers/bfb3b525-6fd9-4ad1-9d8c-557c2883ff06/action => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:39:22.153292 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e373a521-7b52-42e9-82dc-537af31a8be6 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/c6045b08-8c91-4cdb-be37-c079e7ffe23a" status: 200 len: 1346 microversion: 2.1 time: 0.092469 Oct 19 03:39:22.155708 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2712/5348] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:22 2022] GET /compute/v2.1/servers/c6045b08-8c91-4cdb-be37-c079e7ffe23a => generated 1346 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:39:22.156764 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-431a5589-572f-4b6d-acb0-57d3f5868f45 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:22.157961 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-431a5589-572f-4b6d-acb0-57d3f5868f45 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:22.172141 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-431a5589-572f-4b6d-acb0-57d3f5868f45 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:22.172660 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-431a5589-572f-4b6d-acb0-57d3f5868f45 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:22.173212 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-431a5589-572f-4b6d-acb0-57d3f5868f45 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:22.174008 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-431a5589-572f-4b6d-acb0-57d3f5868f45 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:22.174634 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-431a5589-572f-4b6d-acb0-57d3f5868f45 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:22.175215 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-431a5589-572f-4b6d-acb0-57d3f5868f45 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:22.426630 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-431a5589-572f-4b6d-acb0-57d3f5868f45 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:22.435695 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-431a5589-572f-4b6d-acb0-57d3f5868f45 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1506 microversion: 2.1 time: 0.287363 Oct 19 03:39:22.436506 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2637/5349] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:22 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1506 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:39:22.459981 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ac5ae30a-f9a4-4024-9836-c16d77b67c63 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:22.461173 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ac5ae30a-f9a4-4024-9836-c16d77b67c63 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:22.467556 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ac5ae30a-f9a4-4024-9836-c16d77b67c63 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:22.468056 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ac5ae30a-f9a4-4024-9836-c16d77b67c63 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:22.468691 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ac5ae30a-f9a4-4024-9836-c16d77b67c63 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:22.469433 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ac5ae30a-f9a4-4024-9836-c16d77b67c63 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:22.469902 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ac5ae30a-f9a4-4024-9836-c16d77b67c63 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:22.470340 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ac5ae30a-f9a4-4024-9836-c16d77b67c63 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:22.474734 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:39:22.691677 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ac5ae30a-f9a4-4024-9836-c16d77b67c63 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:22.705579 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ac5ae30a-f9a4-4024-9836-c16d77b67c63 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1506 microversion: 2.1 time: 0.246687 Oct 19 03:39:22.717533 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2713/5350] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:22 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1506 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:39:22.730302 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d15be5e3-aff4-46fb-8d5d-c65acca0a718 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:39:22.731391 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d15be5e3-aff4-46fb-8d5d-c65acca0a718 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:22.738452 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d15be5e3-aff4-46fb-8d5d-c65acca0a718 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:22.743345 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d15be5e3-aff4-46fb-8d5d-c65acca0a718 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:22.743345 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d15be5e3-aff4-46fb-8d5d-c65acca0a718 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:22.743345 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d15be5e3-aff4-46fb-8d5d-c65acca0a718 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:22.743345 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d15be5e3-aff4-46fb-8d5d-c65acca0a718 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:22.743345 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d15be5e3-aff4-46fb-8d5d-c65acca0a718 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:22.769497 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:39:22.790921 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-d15be5e3-aff4-46fb-8d5d-c65acca0a718 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] HTTP exception thrown: Cannot 'restore' instance 5a830928-6d51-4dbd-97ad-8cca44de3770 while it is in vm_state active Oct 19 03:39:22.793725 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d15be5e3-aff4-46fb-8d5d-c65acca0a718 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Request method failure captured: Oct 19 03:39:22.793725 n-d-861333-8 devstack@n-api.service[121134]: request: POST /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770/action HTTP/1.1 Oct 19 03:39:22.793725 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:39:22.793725 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:39:22.793725 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:39:22.793725 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 15 Oct 19 03:39:22.793725 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:39:22.793725 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:39:22.793725 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:39:22.793725 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:39:22.793725 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3EK4yDar5R5kGdpWRPopK281fOgxjiWCAZdy3tbDZzFYZxrN53hSsTq0YyAxsfcVRT4cF0jU61e6walOKxMx_njT0L3WOIYEymBjzmNzdXOa-UhYNf83BpQOShCJts2aNodNdu7YjeLcAcuRF0ZOjoH0xsH4HoNSzc8IfQzKhRz4vw Oct 19 03:39:22.793725 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:39:22.793725 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:39:22.793725 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:39:22.793725 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:39:22.793725 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:39:22.793725 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:39:22.793725 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 34bd94983fbf4a8aa49aff65c076e9e3 Oct 19 03:39:22.793725 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:39:22.793725 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:39:22.793725 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:39:22.793725 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_34bd94983fbf4a8aa49aff65c076e9e3", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:39:22.793725 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:39:22.793725 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 34bd94983fbf4a8aa49aff65c076e9e3 Oct 19 03:39:22.793725 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:39:22.793725 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ServersNegativeTestJSON-553742303-project Oct 19 03:39:22.793725 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:39:22.793725 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:39:22.793725 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 771feb133bc046588552d3af98f8e0a1 Oct 19 03:39:22.793725 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ServersNegativeTestJSON-553742303-project Oct 19 03:39:22.793725 n-d-861333-8 devstack@n-api.service[121134]: Oct 19 03:39:22.793725 n-d-861333-8 devstack@n-api.service[121134]: {"restore": {}} Oct 19 03:39:22.793725 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:39:22.793725 n-d-861333-8 devstack@n-api.service[121134]: exception: Cannot 'restore' instance 5a830928-6d51-4dbd-97ad-8cca44de3770 while it is in vm_state active Oct 19 03:39:22.793725 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '5a830928-6d51-4dbd-97ad-8cca44de3770', 'body': {'restore': {}}} Oct 19 03:39:22.793725 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:39:22.793725 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:39:22.793725 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Oct 19 03:39:22.793725 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Oct 19 03:39:22.793725 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 19 03:39:22.793725 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 19 03:39:22.793725 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 19 03:39:22.793725 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 19 03:39:22.793725 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5a830928-6d51-4dbd-97ad-8cca44de3770 in vm_state active. Cannot restore while the instance is in this state. Oct 19 03:39:22.793725 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:39:22.793725 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:39:22.793725 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:39:22.793725 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:39:22.793725 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:39:22.793725 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:39:22.793725 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:39:22.793725 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:39:22.793725 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:39:22.793725 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:39:22.793725 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Oct 19 03:39:22.793725 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 19 03:39:22.793725 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 19 03:39:22.793725 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 19 03:39:22.793725 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 5a830928-6d51-4dbd-97ad-8cca44de3770 while it is in vm_state active Oct 19 03:39:22.793725 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:39:22.793725 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:39:22.793725 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:39:22.793725 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:39:22.793725 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:39:22.797271 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:39:22.797271 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:39:22.797271 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:39:22.797271 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 5a830928-6d51-4dbd-97ad-8cca44de3770 while it is in vm_state active Oct 19 03:39:22.797271 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:39:22.798298 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d15be5e3-aff4-46fb-8d5d-c65acca0a718 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Returning 409 to user: Cannot 'restore' instance 5a830928-6d51-4dbd-97ad-8cca44de3770 while it is in vm_state active {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:39:22.800187 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d15be5e3-aff4-46fb-8d5d-c65acca0a718 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "POST /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770/action" status: 409 len: 145 microversion: 2.1 time: 0.074048 Oct 19 03:39:22.804447 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2638/5351] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:39:22 2022] POST /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770/action => generated 145 bytes in 76 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 19 03:39:22.812501 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4b1bd1f2-4160-4b82-925b-47ae5b3df28a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:22.812501 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4b1bd1f2-4160-4b82-925b-47ae5b3df28a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:22.825765 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4b1bd1f2-4160-4b82-925b-47ae5b3df28a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:22.826270 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4b1bd1f2-4160-4b82-925b-47ae5b3df28a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:22.826716 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4b1bd1f2-4160-4b82-925b-47ae5b3df28a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:22.827604 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4b1bd1f2-4160-4b82-925b-47ae5b3df28a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:22.828260 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4b1bd1f2-4160-4b82-925b-47ae5b3df28a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:22.828694 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4b1bd1f2-4160-4b82-925b-47ae5b3df28a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:22.943111 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-37497015-4061-4392-ad1f-8cb465f7160a tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:22.943749 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-37497015-4061-4392-ad1f-8cb465f7160a tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] [instance: d368a182-a350-4d0c-803d-2972af3aeb7d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:22.961971 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-37497015-4061-4392-ad1f-8cb465f7160a tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:22.962495 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-37497015-4061-4392-ad1f-8cb465f7160a tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:22.962952 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-37497015-4061-4392-ad1f-8cb465f7160a tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:22.963685 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-37497015-4061-4392-ad1f-8cb465f7160a tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:22.964156 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-37497015-4061-4392-ad1f-8cb465f7160a tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:22.964624 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-37497015-4061-4392-ad1f-8cb465f7160a tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:23.228771 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4b1bd1f2-4160-4b82-925b-47ae5b3df28a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:23.237574 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4b1bd1f2-4160-4b82-925b-47ae5b3df28a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1506 microversion: 2.1 time: 0.431933 Oct 19 03:39:23.238236 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2714/5352] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:22 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1506 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:39:23.246184 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ac3d5c3a-c485-4daf-9661-6b5c7270c1a7 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:23.247533 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ac3d5c3a-c485-4daf-9661-6b5c7270c1a7 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: c6045b08-8c91-4cdb-be37-c079e7ffe23a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:23.254194 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ac3d5c3a-c485-4daf-9661-6b5c7270c1a7 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:23.255751 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ac3d5c3a-c485-4daf-9661-6b5c7270c1a7 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:23.256266 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ac3d5c3a-c485-4daf-9661-6b5c7270c1a7 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:23.257600 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ac3d5c3a-c485-4daf-9661-6b5c7270c1a7 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:23.258248 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ac3d5c3a-c485-4daf-9661-6b5c7270c1a7 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:23.258858 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ac3d5c3a-c485-4daf-9661-6b5c7270c1a7 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:23.289600 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-37497015-4061-4392-ad1f-8cb465f7160a tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4670fd4408d4454784251a880d5a72f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf91777fa414ddaa797d735e7d2a275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:23.297927 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-37497015-4061-4392-ad1f-8cb465f7160a tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] 10.222.0.52 "GET /compute/v2.1/servers/d368a182-a350-4d0c-803d-2972af3aeb7d" status: 200 len: 1373 microversion: 2.1 time: 0.358634 Oct 19 03:39:23.298513 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2639/5353] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:22 2022] GET /compute/v2.1/servers/d368a182-a350-4d0c-803d-2972af3aeb7d => generated 1373 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:39:23.305676 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-76493669-a40f-4ebe-9c1e-cabd9ea4bb10 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:23.307177 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-76493669-a40f-4ebe-9c1e-cabd9ea4bb10 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:23.313671 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-76493669-a40f-4ebe-9c1e-cabd9ea4bb10 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:23.314367 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-76493669-a40f-4ebe-9c1e-cabd9ea4bb10 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:23.314998 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-76493669-a40f-4ebe-9c1e-cabd9ea4bb10 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:23.315723 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-76493669-a40f-4ebe-9c1e-cabd9ea4bb10 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:23.316188 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-76493669-a40f-4ebe-9c1e-cabd9ea4bb10 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:23.316631 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-76493669-a40f-4ebe-9c1e-cabd9ea4bb10 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:23.330678 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ac3d5c3a-c485-4daf-9661-6b5c7270c1a7 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:23.338747 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ac3d5c3a-c485-4daf-9661-6b5c7270c1a7 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/c6045b08-8c91-4cdb-be37-c079e7ffe23a" status: 200 len: 1346 microversion: 2.1 time: 0.099164 Oct 19 03:39:23.339577 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2715/5354] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:23 2022] GET /compute/v2.1/servers/c6045b08-8c91-4cdb-be37-c079e7ffe23a => generated 1346 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:39:23.521481 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-76493669-a40f-4ebe-9c1e-cabd9ea4bb10 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:23.531149 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-76493669-a40f-4ebe-9c1e-cabd9ea4bb10 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1506 microversion: 2.1 time: 0.231220 Oct 19 03:39:23.542172 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2640/5355] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:23 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1506 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:39:23.565605 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6f93693d-786d-4f15-a64a-e2227ab5c464 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:39:23.571473 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6f93693d-786d-4f15-a64a-e2227ab5c464 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: a0eb1a06-838c-4e7b-93d0-dea1b59c0c92] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:23.584891 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-6f93693d-786d-4f15-a64a-e2227ab5c464 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] HTTP exception thrown: Instance a0eb1a06-838c-4e7b-93d0-dea1b59c0c92 could not be found. Oct 19 03:39:23.589601 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6f93693d-786d-4f15-a64a-e2227ab5c464 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Request method failure captured: Oct 19 03:39:23.589601 n-d-861333-8 devstack@n-api.service[121135]: request: POST /compute/v2.1/servers/a0eb1a06-838c-4e7b-93d0-dea1b59c0c92/action HTTP/1.1 Oct 19 03:39:23.589601 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:39:23.589601 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:39:23.589601 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:39:23.589601 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 14 Oct 19 03:39:23.589601 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:39:23.589601 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:39:23.589601 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:39:23.589601 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:39:23.589601 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT3EK4yDar5R5kGdpWRPopK281fOgxjiWCAZdy3tbDZzFYZxrN53hSsTq0YyAxsfcVRT4cF0jU61e6walOKxMx_njT0L3WOIYEymBjzmNzdXOa-UhYNf83BpQOShCJts2aNodNdu7YjeLcAcuRF0ZOjoH0xsH4HoNSzc8IfQzKhRz4vw Oct 19 03:39:23.589601 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:39:23.589601 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:39:23.589601 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:39:23.589601 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:39:23.589601 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:39:23.589601 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:39:23.589601 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 34bd94983fbf4a8aa49aff65c076e9e3 Oct 19 03:39:23.589601 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:39:23.589601 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:39:23.589601 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:39:23.589601 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_34bd94983fbf4a8aa49aff65c076e9e3", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:39:23.589601 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:39:23.589601 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 34bd94983fbf4a8aa49aff65c076e9e3 Oct 19 03:39:23.589601 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:39:23.589601 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ServersNegativeTestJSON-553742303-project Oct 19 03:39:23.589601 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:39:23.589601 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:39:23.589601 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 771feb133bc046588552d3af98f8e0a1 Oct 19 03:39:23.589601 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ServersNegativeTestJSON-553742303-project Oct 19 03:39:23.589601 n-d-861333-8 devstack@n-api.service[121135]: Oct 19 03:39:23.589601 n-d-861333-8 devstack@n-api.service[121135]: {"resume": {}} Oct 19 03:39:23.589601 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:39:23.589601 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance a0eb1a06-838c-4e7b-93d0-dea1b59c0c92 could not be found. Oct 19 03:39:23.589601 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': 'a0eb1a06-838c-4e7b-93d0-dea1b59c0c92', 'body': {'resume': {}}} Oct 19 03:39:23.589601 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:39:23.589601 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:39:23.589601 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:39:23.589601 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:39:23.589601 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:39:23.589601 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:39:23.589601 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 19 03:39:23.589601 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 19 03:39:23.589601 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0eb1a06-838c-4e7b-93d0-dea1b59c0c92 could not be found. Oct 19 03:39:23.589601 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:39:23.589601 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:39:23.589601 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:39:23.589601 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:39:23.589601 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:39:23.589601 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:39:23.589601 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:39:23.589601 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:39:23.589601 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:39:23.589601 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:39:23.589601 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Oct 19 03:39:23.589601 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 19 03:39:23.589601 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:39:23.589601 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:39:23.589601 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0eb1a06-838c-4e7b-93d0-dea1b59c0c92 could not be found. Oct 19 03:39:23.589601 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:39:23.589601 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:39:23.589601 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:39:23.589601 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:39:23.589601 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:39:23.589601 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:39:23.592635 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:39:23.592635 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:39:23.592635 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0eb1a06-838c-4e7b-93d0-dea1b59c0c92 could not be found. Oct 19 03:39:23.592635 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:39:23.592635 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6f93693d-786d-4f15-a64a-e2227ab5c464 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Returning 404 to user: Instance a0eb1a06-838c-4e7b-93d0-dea1b59c0c92 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:39:23.592635 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6f93693d-786d-4f15-a64a-e2227ab5c464 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "POST /compute/v2.1/servers/a0eb1a06-838c-4e7b-93d0-dea1b59c0c92/action" status: 404 len: 111 microversion: 2.1 time: 0.034920 Oct 19 03:39:23.594480 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2716/5356] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:39:23 2022] POST /compute/v2.1/servers/a0eb1a06-838c-4e7b-93d0-dea1b59c0c92/action => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:39:23.608536 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5bd26655-02a1-476a-8e76-32630036235e tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:23.609180 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5bd26655-02a1-476a-8e76-32630036235e tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:23.618078 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5bd26655-02a1-476a-8e76-32630036235e tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:23.618583 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5bd26655-02a1-476a-8e76-32630036235e tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:23.619033 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5bd26655-02a1-476a-8e76-32630036235e tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:23.619769 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5bd26655-02a1-476a-8e76-32630036235e tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:23.621254 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5bd26655-02a1-476a-8e76-32630036235e tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:23.621254 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5bd26655-02a1-476a-8e76-32630036235e tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:23.844359 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5bd26655-02a1-476a-8e76-32630036235e tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:23.856969 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5bd26655-02a1-476a-8e76-32630036235e tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1506 microversion: 2.1 time: 0.253389 Oct 19 03:39:23.862796 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2641/5357] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:23 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1506 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:39:23.881750 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e0741799-8fd4-4615-bd47-17e076316cf8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:23.883439 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e0741799-8fd4-4615-bd47-17e076316cf8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:23.892164 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e0741799-8fd4-4615-bd47-17e076316cf8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:23.892906 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e0741799-8fd4-4615-bd47-17e076316cf8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:23.893778 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e0741799-8fd4-4615-bd47-17e076316cf8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:23.894643 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e0741799-8fd4-4615-bd47-17e076316cf8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:23.895250 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e0741799-8fd4-4615-bd47-17e076316cf8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:23.895823 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e0741799-8fd4-4615-bd47-17e076316cf8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:24.067120 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-e0741799-8fd4-4615-bd47-17e076316cf8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:24.105207 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e0741799-8fd4-4615-bd47-17e076316cf8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1506 microversion: 2.1 time: 0.227818 Oct 19 03:39:24.120003 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2717/5358] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:23 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1506 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:39:24.145972 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-bfd7593e-f797-4405-9f9b-8105f6a4ca69 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:39:24.147070 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-bfd7593e-f797-4405-9f9b-8105f6a4ca69 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:24.167398 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bfd7593e-f797-4405-9f9b-8105f6a4ca69 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:24.175065 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bfd7593e-f797-4405-9f9b-8105f6a4ca69 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:24.175065 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bfd7593e-f797-4405-9f9b-8105f6a4ca69 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:24.175065 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bfd7593e-f797-4405-9f9b-8105f6a4ca69 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:24.176177 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bfd7593e-f797-4405-9f9b-8105f6a4ca69 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:24.177016 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bfd7593e-f797-4405-9f9b-8105f6a4ca69 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:24.209135 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-bfd7593e-f797-4405-9f9b-8105f6a4ca69 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] HTTP exception thrown: Cannot 'resume' instance 5a830928-6d51-4dbd-97ad-8cca44de3770 while it is in vm_state active Oct 19 03:39:24.218989 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-bfd7593e-f797-4405-9f9b-8105f6a4ca69 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Request method failure captured: Oct 19 03:39:24.218989 n-d-861333-8 devstack@n-api.service[121134]: request: POST /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770/action HTTP/1.1 Oct 19 03:39:24.218989 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:39:24.218989 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:39:24.218989 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:39:24.218989 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 14 Oct 19 03:39:24.218989 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:39:24.218989 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:39:24.218989 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:39:24.218989 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:39:24.218989 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3EK4yDar5R5kGdpWRPopK281fOgxjiWCAZdy3tbDZzFYZxrN53hSsTq0YyAxsfcVRT4cF0jU61e6walOKxMx_njT0L3WOIYEymBjzmNzdXOa-UhYNf83BpQOShCJts2aNodNdu7YjeLcAcuRF0ZOjoH0xsH4HoNSzc8IfQzKhRz4vw Oct 19 03:39:24.218989 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:39:24.218989 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:39:24.218989 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:39:24.218989 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:39:24.218989 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:39:24.218989 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:39:24.218989 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 34bd94983fbf4a8aa49aff65c076e9e3 Oct 19 03:39:24.218989 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:39:24.218989 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:39:24.218989 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:39:24.218989 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_34bd94983fbf4a8aa49aff65c076e9e3", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:39:24.218989 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:39:24.218989 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 34bd94983fbf4a8aa49aff65c076e9e3 Oct 19 03:39:24.218989 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:39:24.218989 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ServersNegativeTestJSON-553742303-project Oct 19 03:39:24.218989 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:39:24.218989 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:39:24.218989 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 771feb133bc046588552d3af98f8e0a1 Oct 19 03:39:24.218989 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ServersNegativeTestJSON-553742303-project Oct 19 03:39:24.218989 n-d-861333-8 devstack@n-api.service[121134]: Oct 19 03:39:24.218989 n-d-861333-8 devstack@n-api.service[121134]: {"resume": {}} Oct 19 03:39:24.218989 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:39:24.218989 n-d-861333-8 devstack@n-api.service[121134]: exception: Cannot 'resume' instance 5a830928-6d51-4dbd-97ad-8cca44de3770 while it is in vm_state active Oct 19 03:39:24.218989 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '5a830928-6d51-4dbd-97ad-8cca44de3770', 'body': {'resume': {}}} Oct 19 03:39:24.218989 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:39:24.218989 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:39:24.218989 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Oct 19 03:39:24.218989 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Oct 19 03:39:24.218989 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 19 03:39:24.218989 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 19 03:39:24.218989 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 19 03:39:24.218989 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 19 03:39:24.218989 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 19 03:39:24.218989 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 19 03:39:24.218989 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5a830928-6d51-4dbd-97ad-8cca44de3770 in vm_state active. Cannot resume while the instance is in this state. Oct 19 03:39:24.218989 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:39:24.218989 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:39:24.218989 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:39:24.218989 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:39:24.218989 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:39:24.218989 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:39:24.218989 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:39:24.218989 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:39:24.218989 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:39:24.218989 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:39:24.218989 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Oct 19 03:39:24.218989 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 19 03:39:24.218989 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 19 03:39:24.218989 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 19 03:39:24.218989 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 5a830928-6d51-4dbd-97ad-8cca44de3770 while it is in vm_state active Oct 19 03:39:24.218989 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:39:24.218989 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:39:24.218989 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:39:24.227868 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:39:24.227868 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:39:24.227868 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:39:24.227868 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:39:24.227868 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:39:24.227868 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 5a830928-6d51-4dbd-97ad-8cca44de3770 while it is in vm_state active Oct 19 03:39:24.227868 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:39:24.227868 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-bfd7593e-f797-4405-9f9b-8105f6a4ca69 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Returning 409 to user: Cannot 'resume' instance 5a830928-6d51-4dbd-97ad-8cca44de3770 while it is in vm_state active {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:39:24.227868 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-bfd7593e-f797-4405-9f9b-8105f6a4ca69 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "POST /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770/action" status: 409 len: 144 microversion: 2.1 time: 0.083951 Oct 19 03:39:24.227868 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2642/5359] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:39:24 2022] POST /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770/action => generated 144 bytes in 86 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 19 03:39:24.234895 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-957b0e13-b44f-4eba-9cff-8a1444e4e1d4 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:24.235712 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-957b0e13-b44f-4eba-9cff-8a1444e4e1d4 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:24.243556 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-957b0e13-b44f-4eba-9cff-8a1444e4e1d4 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:24.245073 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-957b0e13-b44f-4eba-9cff-8a1444e4e1d4 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:24.252087 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-957b0e13-b44f-4eba-9cff-8a1444e4e1d4 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:24.252087 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-957b0e13-b44f-4eba-9cff-8a1444e4e1d4 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:24.252087 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-957b0e13-b44f-4eba-9cff-8a1444e4e1d4 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:24.252087 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-957b0e13-b44f-4eba-9cff-8a1444e4e1d4 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:24.320358 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ceb5343b-b8df-433b-8125-61eb40ce4c81 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:24.321014 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ceb5343b-b8df-433b-8125-61eb40ce4c81 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] [instance: d368a182-a350-4d0c-803d-2972af3aeb7d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:24.345529 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ceb5343b-b8df-433b-8125-61eb40ce4c81 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:24.346566 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ceb5343b-b8df-433b-8125-61eb40ce4c81 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:24.349962 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ceb5343b-b8df-433b-8125-61eb40ce4c81 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:24.353357 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ceb5343b-b8df-433b-8125-61eb40ce4c81 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:24.353626 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ceb5343b-b8df-433b-8125-61eb40ce4c81 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:24.357989 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ceb5343b-b8df-433b-8125-61eb40ce4c81 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:24.616937 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-957b0e13-b44f-4eba-9cff-8a1444e4e1d4 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:24.631803 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-957b0e13-b44f-4eba-9cff-8a1444e4e1d4 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1506 microversion: 2.1 time: 0.401139 Oct 19 03:39:24.632669 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2718/5360] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:24 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1506 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:39:24.657919 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5abf01be-7903-4208-ae2a-f8943a8704b4 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:24.658931 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-5abf01be-7903-4208-ae2a-f8943a8704b4 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: c6045b08-8c91-4cdb-be37-c079e7ffe23a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:24.666506 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5abf01be-7903-4208-ae2a-f8943a8704b4 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:24.667347 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5abf01be-7903-4208-ae2a-f8943a8704b4 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:24.667979 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5abf01be-7903-4208-ae2a-f8943a8704b4 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:24.668885 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5abf01be-7903-4208-ae2a-f8943a8704b4 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:24.675668 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5abf01be-7903-4208-ae2a-f8943a8704b4 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:24.675668 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5abf01be-7903-4208-ae2a-f8943a8704b4 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:24.693173 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ceb5343b-b8df-433b-8125-61eb40ce4c81 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4670fd4408d4454784251a880d5a72f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf91777fa414ddaa797d735e7d2a275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:24.708448 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ceb5343b-b8df-433b-8125-61eb40ce4c81 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] 10.222.0.52 "GET /compute/v2.1/servers/d368a182-a350-4d0c-803d-2972af3aeb7d" status: 200 len: 1546 microversion: 2.1 time: 0.391679 Oct 19 03:39:24.708975 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2643/5361] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:24 2022] GET /compute/v2.1/servers/d368a182-a350-4d0c-803d-2972af3aeb7d => generated 1546 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:39:24.714247 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2dd5fac2-862e-442a-8a25-32a214259e4a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:24.715129 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2dd5fac2-862e-442a-8a25-32a214259e4a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:24.748263 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2dd5fac2-862e-442a-8a25-32a214259e4a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:24.749768 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2dd5fac2-862e-442a-8a25-32a214259e4a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:24.750897 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2dd5fac2-862e-442a-8a25-32a214259e4a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:24.755436 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2dd5fac2-862e-442a-8a25-32a214259e4a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:24.756151 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2dd5fac2-862e-442a-8a25-32a214259e4a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:24.756777 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2dd5fac2-862e-442a-8a25-32a214259e4a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:24.783285 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-5abf01be-7903-4208-ae2a-f8943a8704b4 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:24.792765 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5abf01be-7903-4208-ae2a-f8943a8704b4 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/c6045b08-8c91-4cdb-be37-c079e7ffe23a" status: 200 len: 1346 microversion: 2.1 time: 0.145021 Oct 19 03:39:24.793960 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2719/5362] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:24 2022] GET /compute/v2.1/servers/c6045b08-8c91-4cdb-be37-c079e7ffe23a => generated 1346 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:39:24.809666 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-35909e6d-0dff-41f9-9dc6-cc372bea6875 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:24.810982 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-35909e6d-0dff-41f9-9dc6-cc372bea6875 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] [instance: d368a182-a350-4d0c-803d-2972af3aeb7d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:24.823110 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-35909e6d-0dff-41f9-9dc6-cc372bea6875 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:24.823487 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-35909e6d-0dff-41f9-9dc6-cc372bea6875 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:24.823996 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-35909e6d-0dff-41f9-9dc6-cc372bea6875 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:24.824906 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-35909e6d-0dff-41f9-9dc6-cc372bea6875 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:24.825466 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-35909e6d-0dff-41f9-9dc6-cc372bea6875 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:24.827585 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-35909e6d-0dff-41f9-9dc6-cc372bea6875 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:25.099239 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-2dd5fac2-862e-442a-8a25-32a214259e4a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:25.113593 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2dd5fac2-862e-442a-8a25-32a214259e4a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1506 microversion: 2.1 time: 0.403412 Oct 19 03:39:25.114208 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2644/5363] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:24 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1506 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:39:25.193244 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-35909e6d-0dff-41f9-9dc6-cc372bea6875 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4670fd4408d4454784251a880d5a72f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf91777fa414ddaa797d735e7d2a275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:25.205056 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-35909e6d-0dff-41f9-9dc6-cc372bea6875 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] 10.222.0.52 "GET /compute/v2.1/servers/d368a182-a350-4d0c-803d-2972af3aeb7d" status: 200 len: 1546 microversion: 2.1 time: 0.406189 Oct 19 03:39:25.206105 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2720/5364] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:24 2022] GET /compute/v2.1/servers/d368a182-a350-4d0c-803d-2972af3aeb7d => generated 1546 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:39:25.300697 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e88dfaeb-a34c-45e2-93d1-9580c28ca5ba tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "networks": [{"uuid": "3ecd8896-b7a4-4c3a-b3cd-dc6769233813"}]}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:39:25.304350 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e88dfaeb-a34c-45e2-93d1-9580c28ca5ba tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Request method failure captured: Oct 19 03:39:25.304350 n-d-861333-8 devstack@n-api.service[121134]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 19 03:39:25.304350 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:39:25.304350 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:39:25.304350 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:39:25.304350 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 160 Oct 19 03:39:25.304350 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:39:25.304350 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:39:25.304350 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:39:25.304350 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:39:25.304350 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3EK4yDar5R5kGdpWRPopK281fOgxjiWCAZdy3tbDZzFYZxrN53hSsTq0YyAxsfcVRT4cF0jU61e6walOKxMx_njT0L3WOIYEymBjzmNzdXOa-UhYNf83BpQOShCJts2aNodNdu7YjeLcAcuRF0ZOjoH0xsH4HoNSzc8IfQzKhRz4vw Oct 19 03:39:25.304350 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:39:25.304350 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:39:25.304350 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:39:25.304350 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:39:25.304350 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:39:25.304350 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:39:25.304350 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 34bd94983fbf4a8aa49aff65c076e9e3 Oct 19 03:39:25.304350 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:39:25.304350 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:39:25.304350 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:39:25.304350 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_34bd94983fbf4a8aa49aff65c076e9e3", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:39:25.304350 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:39:25.304350 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 34bd94983fbf4a8aa49aff65c076e9e3 Oct 19 03:39:25.304350 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:39:25.304350 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ServersNegativeTestJSON-553742303-project Oct 19 03:39:25.304350 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:39:25.304350 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:39:25.304350 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 771feb133bc046588552d3af98f8e0a1 Oct 19 03:39:25.304350 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ServersNegativeTestJSON-553742303-project Oct 19 03:39:25.304350 n-d-861333-8 devstack@n-api.service[121134]: Oct 19 03:39:25.304350 n-d-861333-8 devstack@n-api.service[121134]: {"server": {"name": "", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "networks": [{"uuid": "3ecd8896-b7a4-4c3a-b3cd-dc6769233813"}]}} Oct 19 03:39:25.304350 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:39:25.304350 n-d-861333-8 devstack@n-api.service[121134]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 19 03:39:25.304350 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'body': {'server': {'name': '', 'imageRef': '9e16d73e-70ea-4421-aee3-047d80396c02', 'flavorRef': '452', 'networks': [{'uuid': '3ecd8896-b7a4-4c3a-b3cd-dc6769233813'}]}}} Oct 19 03:39:25.304350 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:39:25.304350 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:39:25.304350 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 03:39:25.304350 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 03:39:25.304350 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 03:39:25.304350 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise error Oct 19 03:39:25.304350 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 19 03:39:25.304350 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:39:25.304350 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 19 03:39:25.304350 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 19 03:39:25.304350 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:39:25.304350 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 19 03:39:25.304350 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi '' Oct 19 03:39:25.304350 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:39:25.304350 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:39:25.304350 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:39:25.304350 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:39:25.304350 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:39:25.304350 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:39:25.304350 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:39:25.304350 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:39:25.304350 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:39:25.304350 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:39:25.304350 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:39:25.304350 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:39:25.304350 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 03:39:25.304350 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 03:39:25.304350 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 03:39:25.304350 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 03:39:25.304350 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 03:39:25.308350 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 03:39:25.308350 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 19 03:39:25.308350 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:39:25.308350 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:39:25.308350 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:39:25.308350 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:39:25.308350 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:39:25.308350 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:39:25.308350 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 03:39:25.308350 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 03:39:25.308350 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 19 03:39:25.308350 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:39:25.313404 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e88dfaeb-a34c-45e2-93d1-9580c28ca5ba tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:39:25.314503 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e88dfaeb-a34c-45e2-93d1-9580c28ca5ba tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.021178 Oct 19 03:39:25.315221 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2645/5365] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:39:25 2022] POST /compute/v2.1/servers => generated 108 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 03:39:25.324137 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b3160743-8bd4-4a00-a647-22e131ad46ca tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:25.324766 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b3160743-8bd4-4a00-a647-22e131ad46ca tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:25.336141 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b3160743-8bd4-4a00-a647-22e131ad46ca tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:25.336654 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b3160743-8bd4-4a00-a647-22e131ad46ca tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:25.337103 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b3160743-8bd4-4a00-a647-22e131ad46ca tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:25.337872 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b3160743-8bd4-4a00-a647-22e131ad46ca tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:25.338339 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b3160743-8bd4-4a00-a647-22e131ad46ca tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:25.338778 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b3160743-8bd4-4a00-a647-22e131ad46ca tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:25.606892 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b3160743-8bd4-4a00-a647-22e131ad46ca tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:25.615493 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b3160743-8bd4-4a00-a647-22e131ad46ca tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1506 microversion: 2.1 time: 0.295279 Oct 19 03:39:25.620647 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2721/5366] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:25 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1506 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:39:25.647876 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-654b747e-97bd-48f0-b73a-68b4df28c949 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:25.648557 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-654b747e-97bd-48f0-b73a-68b4df28c949 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:25.658617 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-654b747e-97bd-48f0-b73a-68b4df28c949 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:25.666243 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-654b747e-97bd-48f0-b73a-68b4df28c949 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:25.667273 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-654b747e-97bd-48f0-b73a-68b4df28c949 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:25.669020 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-654b747e-97bd-48f0-b73a-68b4df28c949 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:25.669790 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-654b747e-97bd-48f0-b73a-68b4df28c949 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:25.670576 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-654b747e-97bd-48f0-b73a-68b4df28c949 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:25.822894 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b0e03ca5-ba2c-4b93-81ca-eefc97ade3b7 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:25.824990 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b0e03ca5-ba2c-4b93-81ca-eefc97ade3b7 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: c6045b08-8c91-4cdb-be37-c079e7ffe23a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:25.856567 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b0e03ca5-ba2c-4b93-81ca-eefc97ade3b7 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:25.858549 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b0e03ca5-ba2c-4b93-81ca-eefc97ade3b7 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:25.859101 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b0e03ca5-ba2c-4b93-81ca-eefc97ade3b7 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:25.862014 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b0e03ca5-ba2c-4b93-81ca-eefc97ade3b7 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:25.863718 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b0e03ca5-ba2c-4b93-81ca-eefc97ade3b7 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:25.864244 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b0e03ca5-ba2c-4b93-81ca-eefc97ade3b7 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:25.921224 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-654b747e-97bd-48f0-b73a-68b4df28c949 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:25.940952 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-654b747e-97bd-48f0-b73a-68b4df28c949 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1506 microversion: 2.1 time: 0.291546 Oct 19 03:39:25.942125 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2646/5367] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:25 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1506 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:39:25.973006 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a366b30d-cc11-4634-a1a7-177bb941dd4a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:39:25.983816 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a366b30d-cc11-4634-a1a7-177bb941dd4a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: ef76ed07-ce8b-48f0-b514-8889222da977] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:25.995447 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-a366b30d-cc11-4634-a1a7-177bb941dd4a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] HTTP exception thrown: Instance ef76ed07-ce8b-48f0-b514-8889222da977 could not be found. Oct 19 03:39:26.005565 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a366b30d-cc11-4634-a1a7-177bb941dd4a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Request method failure captured: Oct 19 03:39:26.005565 n-d-861333-8 devstack@n-api.service[121134]: request: POST /compute/v2.1/servers/ef76ed07-ce8b-48f0-b514-8889222da977/action HTTP/1.1 Oct 19 03:39:26.005565 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:39:26.005565 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:39:26.005565 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:39:26.005565 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 14 Oct 19 03:39:26.005565 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:39:26.005565 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:39:26.005565 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:39:26.005565 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:39:26.005565 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3EK4yDar5R5kGdpWRPopK281fOgxjiWCAZdy3tbDZzFYZxrN53hSsTq0YyAxsfcVRT4cF0jU61e6walOKxMx_njT0L3WOIYEymBjzmNzdXOa-UhYNf83BpQOShCJts2aNodNdu7YjeLcAcuRF0ZOjoH0xsH4HoNSzc8IfQzKhRz4vw Oct 19 03:39:26.005565 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:39:26.005565 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:39:26.005565 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:39:26.005565 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:39:26.005565 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:39:26.005565 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:39:26.005565 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 34bd94983fbf4a8aa49aff65c076e9e3 Oct 19 03:39:26.005565 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:39:26.005565 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:39:26.005565 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:39:26.005565 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_34bd94983fbf4a8aa49aff65c076e9e3", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:39:26.005565 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:39:26.005565 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 34bd94983fbf4a8aa49aff65c076e9e3 Oct 19 03:39:26.005565 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:39:26.005565 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ServersNegativeTestJSON-553742303-project Oct 19 03:39:26.005565 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:39:26.005565 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:39:26.005565 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 771feb133bc046588552d3af98f8e0a1 Oct 19 03:39:26.005565 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ServersNegativeTestJSON-553742303-project Oct 19 03:39:26.005565 n-d-861333-8 devstack@n-api.service[121134]: Oct 19 03:39:26.005565 n-d-861333-8 devstack@n-api.service[121134]: {"shelve": {}} Oct 19 03:39:26.005565 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:39:26.005565 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance ef76ed07-ce8b-48f0-b514-8889222da977 could not be found. Oct 19 03:39:26.005565 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': 'ef76ed07-ce8b-48f0-b514-8889222da977', 'body': {'shelve': {}}} Oct 19 03:39:26.005565 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:39:26.005565 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:39:26.005565 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:39:26.005565 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:39:26.005565 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:39:26.005565 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:39:26.005565 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 19 03:39:26.005565 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 19 03:39:26.005565 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef76ed07-ce8b-48f0-b514-8889222da977 could not be found. Oct 19 03:39:26.005565 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:39:26.005565 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:39:26.005565 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:39:26.005565 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:39:26.005565 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:39:26.005565 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:39:26.005565 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:39:26.005565 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:39:26.005565 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:39:26.005565 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:39:26.005565 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Oct 19 03:39:26.005565 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 19 03:39:26.005565 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:39:26.005565 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:39:26.005565 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef76ed07-ce8b-48f0-b514-8889222da977 could not be found. Oct 19 03:39:26.005565 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:39:26.005565 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:39:26.005565 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:39:26.005565 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:39:26.005565 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:39:26.005565 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:39:26.008946 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:39:26.008946 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:39:26.008946 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef76ed07-ce8b-48f0-b514-8889222da977 could not be found. Oct 19 03:39:26.008946 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:39:26.010577 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a366b30d-cc11-4634-a1a7-177bb941dd4a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Returning 404 to user: Instance ef76ed07-ce8b-48f0-b514-8889222da977 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:39:26.012815 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a366b30d-cc11-4634-a1a7-177bb941dd4a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "POST /compute/v2.1/servers/ef76ed07-ce8b-48f0-b514-8889222da977/action" status: 404 len: 111 microversion: 2.1 time: 0.044405 Oct 19 03:39:26.017113 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2647/5368] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:39:25 2022] POST /compute/v2.1/servers/ef76ed07-ce8b-48f0-b514-8889222da977/action => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 03:39:26.032615 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-36645aaf-bad7-4bdb-ad54-31b117552e87 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:26.034542 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-36645aaf-bad7-4bdb-ad54-31b117552e87 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:26.048418 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-36645aaf-bad7-4bdb-ad54-31b117552e87 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:26.049208 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-36645aaf-bad7-4bdb-ad54-31b117552e87 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:26.049851 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-36645aaf-bad7-4bdb-ad54-31b117552e87 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:26.053067 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-36645aaf-bad7-4bdb-ad54-31b117552e87 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:26.056469 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-36645aaf-bad7-4bdb-ad54-31b117552e87 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:26.057130 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-36645aaf-bad7-4bdb-ad54-31b117552e87 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:26.097647 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b0e03ca5-ba2c-4b93-81ca-eefc97ade3b7 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:26.107596 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b0e03ca5-ba2c-4b93-81ca-eefc97ade3b7 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/c6045b08-8c91-4cdb-be37-c079e7ffe23a" status: 200 len: 1346 microversion: 2.1 time: 0.292809 Oct 19 03:39:26.110011 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2722/5369] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:25 2022] GET /compute/v2.1/servers/c6045b08-8c91-4cdb-be37-c079e7ffe23a => generated 1346 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:39:26.338583 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-36645aaf-bad7-4bdb-ad54-31b117552e87 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:26.350486 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-36645aaf-bad7-4bdb-ad54-31b117552e87 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1506 microversion: 2.1 time: 0.330549 Oct 19 03:39:26.351725 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2648/5370] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:26 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1506 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:39:26.375409 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-cb9a31b6-5bef-4df6-9282-69dadc551525 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:26.376041 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-cb9a31b6-5bef-4df6-9282-69dadc551525 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:26.403619 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cb9a31b6-5bef-4df6-9282-69dadc551525 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:26.404238 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cb9a31b6-5bef-4df6-9282-69dadc551525 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:26.407452 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cb9a31b6-5bef-4df6-9282-69dadc551525 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:26.409072 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cb9a31b6-5bef-4df6-9282-69dadc551525 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:26.409755 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cb9a31b6-5bef-4df6-9282-69dadc551525 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:26.410340 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cb9a31b6-5bef-4df6-9282-69dadc551525 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:27.135960 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2f05a6f5-6ca9-45fa-9ec5-fb47015e80fa tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:27.136585 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2f05a6f5-6ca9-45fa-9ec5-fb47015e80fa tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: c6045b08-8c91-4cdb-be37-c079e7ffe23a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:27.148764 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2f05a6f5-6ca9-45fa-9ec5-fb47015e80fa tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:27.151162 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2f05a6f5-6ca9-45fa-9ec5-fb47015e80fa tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:27.151641 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2f05a6f5-6ca9-45fa-9ec5-fb47015e80fa tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:27.156175 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2f05a6f5-6ca9-45fa-9ec5-fb47015e80fa tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:27.156680 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2f05a6f5-6ca9-45fa-9ec5-fb47015e80fa tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:27.160663 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2f05a6f5-6ca9-45fa-9ec5-fb47015e80fa tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:27.206364 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-cb9a31b6-5bef-4df6-9282-69dadc551525 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:27.215875 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-cb9a31b6-5bef-4df6-9282-69dadc551525 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1506 microversion: 2.1 time: 0.844941 Oct 19 03:39:27.232634 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2f05a6f5-6ca9-45fa-9ec5-fb47015e80fa tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:27.233561 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2f05a6f5-6ca9-45fa-9ec5-fb47015e80fa tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:27.234190 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2f05a6f5-6ca9-45fa-9ec5-fb47015e80fa tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:27.234833 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-2f05a6f5-6ca9-45fa-9ec5-fb47015e80fa tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lazy-loading 'fault' on Instance uuid c6045b08-8c91-4cdb-be37-c079e7ffe23a {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:39:27.236018 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2723/5371] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:26 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1506 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:39:27.255590 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9c0a8d29-afda-4430-8e9b-9a369158adce tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:39:27.259719 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9c0a8d29-afda-4430-8e9b-9a369158adce tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:27.277862 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9c0a8d29-afda-4430-8e9b-9a369158adce tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:27.278777 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9c0a8d29-afda-4430-8e9b-9a369158adce tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:27.279084 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9c0a8d29-afda-4430-8e9b-9a369158adce tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:27.279734 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9c0a8d29-afda-4430-8e9b-9a369158adce tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:27.280201 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9c0a8d29-afda-4430-8e9b-9a369158adce tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:27.280636 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9c0a8d29-afda-4430-8e9b-9a369158adce tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:27.335249 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-9c0a8d29-afda-4430-8e9b-9a369158adce tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lazy-loading 'flavor' on Instance uuid 5a830928-6d51-4dbd-97ad-8cca44de3770 {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:39:27.379158 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-2f05a6f5-6ca9-45fa-9ec5-fb47015e80fa tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:27.393042 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2f05a6f5-6ca9-45fa-9ec5-fb47015e80fa tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/c6045b08-8c91-4cdb-be37-c079e7ffe23a" status: 200 len: 1351 microversion: 2.1 time: 0.261100 Oct 19 03:39:27.393668 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2649/5372] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:27 2022] GET /compute/v2.1/servers/c6045b08-8c91-4cdb-be37-c079e7ffe23a => generated 1351 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:39:27.933821 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9c0a8d29-afda-4430-8e9b-9a369158adce tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "POST /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770/action" status: 202 len: 0 microversion: 2.1 time: 0.685868 Oct 19 03:39:27.935010 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2724/5373] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:39:27 2022] POST /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770/action => generated 0 bytes in 692 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:39:27.943992 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-02830ed3-6b06-4225-9b8e-609d0f8cab63 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:27.944912 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-02830ed3-6b06-4225-9b8e-609d0f8cab63 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:27.966472 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-02830ed3-6b06-4225-9b8e-609d0f8cab63 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:27.968731 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-02830ed3-6b06-4225-9b8e-609d0f8cab63 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:27.970337 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-02830ed3-6b06-4225-9b8e-609d0f8cab63 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:27.972755 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-02830ed3-6b06-4225-9b8e-609d0f8cab63 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:27.973683 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-02830ed3-6b06-4225-9b8e-609d0f8cab63 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:27.974294 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-02830ed3-6b06-4225-9b8e-609d0f8cab63 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:28.352679 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-02830ed3-6b06-4225-9b8e-609d0f8cab63 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:28.360950 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-02830ed3-6b06-4225-9b8e-609d0f8cab63 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1512 microversion: 2.1 time: 0.421598 Oct 19 03:39:28.362172 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2650/5374] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:27 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1512 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:39:28.418839 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-40ad4d4c-8023-4e42-90a2-3fd3eaa91a79 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:28.419555 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-40ad4d4c-8023-4e42-90a2-3fd3eaa91a79 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: c6045b08-8c91-4cdb-be37-c079e7ffe23a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:28.427185 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-40ad4d4c-8023-4e42-90a2-3fd3eaa91a79 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:28.428008 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-40ad4d4c-8023-4e42-90a2-3fd3eaa91a79 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:28.428655 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-40ad4d4c-8023-4e42-90a2-3fd3eaa91a79 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:28.434550 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-40ad4d4c-8023-4e42-90a2-3fd3eaa91a79 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:28.434550 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-40ad4d4c-8023-4e42-90a2-3fd3eaa91a79 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:28.434550 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-40ad4d4c-8023-4e42-90a2-3fd3eaa91a79 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:28.444928 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-40ad4d4c-8023-4e42-90a2-3fd3eaa91a79 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] HTTP exception thrown: Instance c6045b08-8c91-4cdb-be37-c079e7ffe23a could not be found. Oct 19 03:39:28.446813 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-40ad4d4c-8023-4e42-90a2-3fd3eaa91a79 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Request method failure captured: Oct 19 03:39:28.446813 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/c6045b08-8c91-4cdb-be37-c079e7ffe23a HTTP/1.1 Oct 19 03:39:28.446813 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:39:28.446813 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:39:28.446813 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:39:28.446813 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:39:28.446813 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:39:28.446813 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:39:28.446813 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:39:28.446813 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:39:28.446813 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT3ER8Vi4kdm7o4uGCDWtKZWQ50YHYh4kO6eywBcR15sWt_VOUdg3SdiEQ00NlpD4-_UkP7cbx60NOPjR2_ogmh3qtcCqHFYMrk6ithnKX7Frq8eCjVqAngAFsiOR8FhKAXItaxrviXq7LiRs8ykPsJTrY1v2OiG3mT4ycQKs5qNWF0I Oct 19 03:39:28.446813 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:39:28.446813 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:39:28.446813 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:39:28.446813 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:39:28.446813 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:39:28.446813 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:39:28.446813 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 224417be63ba4c679b0256a27fb9f104 Oct 19 03:39:28.446813 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-DeleteServersTestJSON-1651632054 Oct 19 03:39:28.446813 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:39:28.446813 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:39:28.446813 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/224417be63ba4c679b0256a27fb9f104"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/224417be63ba4c679b0256a27fb9f104"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/224417be63ba4c679b0256a27fb9f104"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_224417be63ba4c679b0256a27fb9f104", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:39:28.446813 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-DeleteServersTestJSON-1651632054 Oct 19 03:39:28.446813 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 224417be63ba4c679b0256a27fb9f104 Oct 19 03:39:28.446813 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-DeleteServersTestJSON-1651632054 Oct 19 03:39:28.446813 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-DeleteServersTestJSON-1651632054-project Oct 19 03:39:28.446813 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:39:28.446813 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:39:28.446813 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: d099c5070710485f83d528d3d2bb1c71 Oct 19 03:39:28.446813 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-DeleteServersTestJSON-1651632054-project Oct 19 03:39:28.446813 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:39:28.446813 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance c6045b08-8c91-4cdb-be37-c079e7ffe23a could not be found. Oct 19 03:39:28.446813 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': 'c6045b08-8c91-4cdb-be37-c079e7ffe23a'} Oct 19 03:39:28.446813 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:39:28.446813 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:39:28.446813 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:39:28.446813 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:39:28.446813 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:39:28.446813 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:39:28.446813 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:39:28.446813 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:39:28.446813 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:39:28.446813 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:39:28.446813 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6045b08-8c91-4cdb-be37-c079e7ffe23a could not be found. Oct 19 03:39:28.446813 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:39:28.446813 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:39:28.446813 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:39:28.446813 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:39:28.446813 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:39:28.446813 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:39:28.446813 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:39:28.446813 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:39:28.446813 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:39:28.446813 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:39:28.446813 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:39:28.446813 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:39:28.446813 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:39:28.446813 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:39:28.446813 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:39:28.446813 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:39:28.446813 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6045b08-8c91-4cdb-be37-c079e7ffe23a could not be found. Oct 19 03:39:28.446813 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:39:28.446813 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:39:28.446813 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:39:28.449981 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:39:28.449981 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:39:28.449981 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:39:28.449981 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:39:28.449981 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:39:28.449981 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6045b08-8c91-4cdb-be37-c079e7ffe23a could not be found. Oct 19 03:39:28.449981 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:39:28.451690 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-40ad4d4c-8023-4e42-90a2-3fd3eaa91a79 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Returning 404 to user: Instance c6045b08-8c91-4cdb-be37-c079e7ffe23a could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:39:28.452764 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-40ad4d4c-8023-4e42-90a2-3fd3eaa91a79 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/c6045b08-8c91-4cdb-be37-c079e7ffe23a" status: 404 len: 111 microversion: 2.1 time: 0.039111 Oct 19 03:39:28.458128 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2725/5375] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:28 2022] GET /compute/v2.1/servers/c6045b08-8c91-4cdb-be37-c079e7ffe23a => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:39:28.613612 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-278ff5c3-feb6-4b0f-a361-0e264fe7961e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:28.616031 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-278ff5c3-feb6-4b0f-a361-0e264fe7961e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: c6045b08-8c91-4cdb-be37-c079e7ffe23a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:28.622237 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-278ff5c3-feb6-4b0f-a361-0e264fe7961e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:28.622734 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-278ff5c3-feb6-4b0f-a361-0e264fe7961e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:28.623171 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-278ff5c3-feb6-4b0f-a361-0e264fe7961e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:28.623908 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-278ff5c3-feb6-4b0f-a361-0e264fe7961e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:28.624364 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-278ff5c3-feb6-4b0f-a361-0e264fe7961e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:28.624838 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-278ff5c3-feb6-4b0f-a361-0e264fe7961e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:28.642003 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-278ff5c3-feb6-4b0f-a361-0e264fe7961e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] HTTP exception thrown: Instance c6045b08-8c91-4cdb-be37-c079e7ffe23a could not be found. Oct 19 03:39:28.643941 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-278ff5c3-feb6-4b0f-a361-0e264fe7961e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Request method failure captured: Oct 19 03:39:28.643941 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/c6045b08-8c91-4cdb-be37-c079e7ffe23a/os-volume_attachments HTTP/1.1 Oct 19 03:39:28.643941 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:39:28.643941 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:39:28.643941 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:39:28.643941 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:39:28.643941 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:39:28.643941 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:39:28.643941 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:39:28.643941 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:39:28.643941 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3ER8Vi4kdm7o4uGCDWtKZWQ50YHYh4kO6eywBcR15sWt_VOUdg3SdiEQ00NlpD4-_UkP7cbx60NOPjR2_ogmh3qtcCqHFYMrk6ithnKX7Frq8eCjVqAngAFsiOR8FhKAXItaxrviXq7LiRs8ykPsJTrY1v2OiG3mT4ycQKs5qNWF0I Oct 19 03:39:28.643941 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:39:28.643941 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:39:28.643941 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:39:28.643941 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:39:28.643941 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:39:28.643941 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:39:28.643941 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 224417be63ba4c679b0256a27fb9f104 Oct 19 03:39:28.643941 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-DeleteServersTestJSON-1651632054 Oct 19 03:39:28.643941 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:39:28.643941 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:39:28.643941 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/224417be63ba4c679b0256a27fb9f104"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/224417be63ba4c679b0256a27fb9f104"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/224417be63ba4c679b0256a27fb9f104"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_224417be63ba4c679b0256a27fb9f104", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:39:28.643941 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-DeleteServersTestJSON-1651632054 Oct 19 03:39:28.643941 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 224417be63ba4c679b0256a27fb9f104 Oct 19 03:39:28.643941 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-DeleteServersTestJSON-1651632054 Oct 19 03:39:28.643941 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-DeleteServersTestJSON-1651632054-project Oct 19 03:39:28.643941 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:39:28.643941 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:39:28.643941 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: d099c5070710485f83d528d3d2bb1c71 Oct 19 03:39:28.643941 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-DeleteServersTestJSON-1651632054-project Oct 19 03:39:28.643941 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:39:28.643941 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance c6045b08-8c91-4cdb-be37-c079e7ffe23a could not be found. Oct 19 03:39:28.643941 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'server_id': 'c6045b08-8c91-4cdb-be37-c079e7ffe23a'} Oct 19 03:39:28.643941 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:39:28.643941 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:39:28.643941 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:39:28.643941 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:39:28.643941 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:39:28.643941 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:39:28.643941 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:39:28.643941 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:39:28.643941 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:39:28.643941 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:39:28.643941 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6045b08-8c91-4cdb-be37-c079e7ffe23a could not be found. Oct 19 03:39:28.643941 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:39:28.643941 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:39:28.643941 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:39:28.643941 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:39:28.643941 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:39:28.643941 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:39:28.643941 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:39:28.643941 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:39:28.643941 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:39:28.643941 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:39:28.643941 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 19 03:39:28.643941 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:39:28.643941 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 19 03:39:28.643941 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:39:28.643941 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 19 03:39:28.643941 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 19 03:39:28.643941 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:39:28.643941 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:39:28.647185 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6045b08-8c91-4cdb-be37-c079e7ffe23a could not be found. Oct 19 03:39:28.647185 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:39:28.647185 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:39:28.647185 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:39:28.647185 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:39:28.647185 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:39:28.647185 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:39:28.647185 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:39:28.647185 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:39:28.647185 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6045b08-8c91-4cdb-be37-c079e7ffe23a could not be found. Oct 19 03:39:28.647185 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:39:28.649461 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-278ff5c3-feb6-4b0f-a361-0e264fe7961e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Returning 404 to user: Instance c6045b08-8c91-4cdb-be37-c079e7ffe23a could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:39:28.650632 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-278ff5c3-feb6-4b0f-a361-0e264fe7961e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/c6045b08-8c91-4cdb-be37-c079e7ffe23a/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.041672 Oct 19 03:39:28.651186 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2651/5376] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Oct 19 03:39:28 2022] GET /compute/v2.1/servers/c6045b08-8c91-4cdb-be37-c079e7ffe23a/os-volume_attachments => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:39:28.894748 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9962ce1c-03d7-4f0d-80e9-c4f12bd8ad1d tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-462169498", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "networks": [{"uuid": "c7fc46f7-f975-4fb5-83e4-9e9303a4a241"}]}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:39:28.969281 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.network.neutron [None req-9962ce1c-03d7-4f0d-80e9-c4f12bd8ad1d tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] validate_networks() for [('c7fc46f7-f975-4fb5-83e4-9e9303a4a241', None, None, None, None, None)] {{(pid=121135) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:39:29.393658 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-cd35579d-b4a8-4c2d-bf06-c9524707fe83 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:29.394692 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-cd35579d-b4a8-4c2d-bf06-c9524707fe83 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:29.413601 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cd35579d-b4a8-4c2d-bf06-c9524707fe83 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:29.414408 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cd35579d-b4a8-4c2d-bf06-c9524707fe83 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:29.415049 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cd35579d-b4a8-4c2d-bf06-c9524707fe83 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:29.417714 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cd35579d-b4a8-4c2d-bf06-c9524707fe83 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:29.418420 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cd35579d-b4a8-4c2d-bf06-c9524707fe83 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:29.419165 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cd35579d-b4a8-4c2d-bf06-c9524707fe83 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:29.828301 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-cd35579d-b4a8-4c2d-bf06-c9524707fe83 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:29.841587 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-cd35579d-b4a8-4c2d-bf06-c9524707fe83 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1512 microversion: 2.1 time: 0.457962 Oct 19 03:39:29.842242 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2652/5377] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:29 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1512 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:39:29.932086 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-9962ce1c-03d7-4f0d-80e9-c4f12bd8ad1d tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Flavor limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:39:29.933202 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-9962ce1c-03d7-4f0d-80e9-c4f12bd8ad1d tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Image limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:39:29.934638 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-9962ce1c-03d7-4f0d-80e9-c4f12bd8ad1d tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Flavor pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:39:29.935430 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-9962ce1c-03d7-4f0d-80e9-c4f12bd8ad1d tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Image pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:39:29.936006 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-9962ce1c-03d7-4f0d-80e9-c4f12bd8ad1d tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:39:29.953553 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9962ce1c-03d7-4f0d-80e9-c4f12bd8ad1d tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:29.954071 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9962ce1c-03d7-4f0d-80e9-c4f12bd8ad1d tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:29.957294 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9962ce1c-03d7-4f0d-80e9-c4f12bd8ad1d tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:29.960298 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9962ce1c-03d7-4f0d-80e9-c4f12bd8ad1d tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:29.960978 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9962ce1c-03d7-4f0d-80e9-c4f12bd8ad1d tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:29.965550 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9962ce1c-03d7-4f0d-80e9-c4f12bd8ad1d tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:30.048189 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-9962ce1c-03d7-4f0d-80e9-c4f12bd8ad1d tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Getting quotas for project 224417be63ba4c679b0256a27fb9f104. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:39:30.059055 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-9962ce1c-03d7-4f0d-80e9-c4f12bd8ad1d tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Getting quotas for user d099c5070710485f83d528d3d2bb1c71 and project 224417be63ba4c679b0256a27fb9f104. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:39:30.079209 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9962ce1c-03d7-4f0d-80e9-c4f12bd8ad1d tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Going to run 1 instances... {{(pid=121135) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:39:30.088396 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9962ce1c-03d7-4f0d-80e9-c4f12bd8ad1d tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 83af58ab-841f-4579-a9fa-7e7d410ee18d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121135) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:39:30.115666 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-3e714d69-0b69-4454-a599-ca63fdae96c7 req-bd5f1196-4dc8-464c-b03b-de11d66d819b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d368a182-a350-4d0c-803d-2972af3aeb7d", "tag": "76e9dcc7-fe11-440c-8253-409dfac2a873"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:39:30.134134 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-3e714d69-0b69-4454-a599-ca63fdae96c7 req-bd5f1196-4dc8-464c-b03b-de11d66d819b service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:30.134640 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-3e714d69-0b69-4454-a599-ca63fdae96c7 req-bd5f1196-4dc8-464c-b03b-de11d66d819b service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:30.135078 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-3e714d69-0b69-4454-a599-ca63fdae96c7 req-bd5f1196-4dc8-464c-b03b-de11d66d819b service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:30.172510 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-3e714d69-0b69-4454-a599-ca63fdae96c7 req-bd5f1196-4dc8-464c-b03b-de11d66d819b service nova] Creating event network-changed:76e9dcc7-fe11-440c-8253-409dfac2a873 for instance d368a182-a350-4d0c-803d-2972af3aeb7d on n-h2-861333-8 Oct 19 03:39:30.183478 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-3e714d69-0b69-4454-a599-ca63fdae96c7 req-bd5f1196-4dc8-464c-b03b-de11d66d819b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071397 Oct 19 03:39:30.185180 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2653/5378] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:39:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:39:30.239026 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9962ce1c-03d7-4f0d-80e9-c4f12bd8ad1d tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.348417 Oct 19 03:39:30.240778 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2726/5379] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:39:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1351 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 03:39:30.255802 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d10ef05b-c95c-4910-9fa4-5230fb66821a tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:30.257010 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d10ef05b-c95c-4910-9fa4-5230fb66821a tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 83af58ab-841f-4579-a9fa-7e7d410ee18d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:30.359928 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d10ef05b-c95c-4910-9fa4-5230fb66821a tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:30.370563 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d10ef05b-c95c-4910-9fa4-5230fb66821a tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/83af58ab-841f-4579-a9fa-7e7d410ee18d" status: 200 len: 1214 microversion: 2.1 time: 0.122615 Oct 19 03:39:30.372190 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2654/5380] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:30 2022] GET /compute/v2.1/servers/83af58ab-841f-4579-a9fa-7e7d410ee18d => generated 1214 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:39:30.401585 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4c0e8241-57f7-4aba-beda-c5ed793f7f9a tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:30.402096 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4c0e8241-57f7-4aba-beda-c5ed793f7f9a tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 83af58ab-841f-4579-a9fa-7e7d410ee18d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:30.426212 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4c0e8241-57f7-4aba-beda-c5ed793f7f9a tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 83af58ab-841f-4579-a9fa-7e7d410ee18d] Going to try to terminate instance {{(pid=121135) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:39:30.868118 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5bf4efb0-898c-45bb-adfc-a809badac4cc tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:30.869025 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5bf4efb0-898c-45bb-adfc-a809badac4cc tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:30.883895 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5bf4efb0-898c-45bb-adfc-a809badac4cc tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:30.885861 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5bf4efb0-898c-45bb-adfc-a809badac4cc tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:30.886807 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5bf4efb0-898c-45bb-adfc-a809badac4cc tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:30.888722 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5bf4efb0-898c-45bb-adfc-a809badac4cc tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:30.890715 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5bf4efb0-898c-45bb-adfc-a809badac4cc tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:30.892974 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5bf4efb0-898c-45bb-adfc-a809badac4cc tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:31.075118 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4c0e8241-57f7-4aba-beda-c5ed793f7f9a tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "DELETE /compute/v2.1/servers/83af58ab-841f-4579-a9fa-7e7d410ee18d" status: 204 len: 0 microversion: 2.1 time: 0.678483 Oct 19 03:39:31.076563 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2727/5381] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:39:30 2022] DELETE /compute/v2.1/servers/83af58ab-841f-4579-a9fa-7e7d410ee18d => generated 0 bytes in 681 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:39:31.086774 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ef54ae1b-580c-4898-8955-82ed2ce63756 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:31.088308 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ef54ae1b-580c-4898-8955-82ed2ce63756 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 83af58ab-841f-4579-a9fa-7e7d410ee18d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:31.126508 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-ef54ae1b-580c-4898-8955-82ed2ce63756 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] HTTP exception thrown: Instance 83af58ab-841f-4579-a9fa-7e7d410ee18d could not be found. Oct 19 03:39:31.132770 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ef54ae1b-580c-4898-8955-82ed2ce63756 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Request method failure captured: Oct 19 03:39:31.132770 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/83af58ab-841f-4579-a9fa-7e7d410ee18d HTTP/1.1 Oct 19 03:39:31.132770 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:39:31.132770 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:39:31.132770 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:39:31.132770 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:39:31.132770 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:39:31.132770 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:39:31.132770 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:39:31.132770 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:39:31.132770 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT3ER8Vi4kdm7o4uGCDWtKZWQ50YHYh4kO6eywBcR15sWt_VOUdg3SdiEQ00NlpD4-_UkP7cbx60NOPjR2_ogmh3qtcCqHFYMrk6ithnKX7Frq8eCjVqAngAFsiOR8FhKAXItaxrviXq7LiRs8ykPsJTrY1v2OiG3mT4ycQKs5qNWF0I Oct 19 03:39:31.132770 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:39:31.132770 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:39:31.132770 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:39:31.132770 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:39:31.132770 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:39:31.132770 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:39:31.132770 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 224417be63ba4c679b0256a27fb9f104 Oct 19 03:39:31.132770 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-DeleteServersTestJSON-1651632054 Oct 19 03:39:31.132770 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:39:31.132770 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:39:31.132770 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/224417be63ba4c679b0256a27fb9f104"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/224417be63ba4c679b0256a27fb9f104"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/224417be63ba4c679b0256a27fb9f104"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_224417be63ba4c679b0256a27fb9f104", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:39:31.132770 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-DeleteServersTestJSON-1651632054 Oct 19 03:39:31.132770 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 224417be63ba4c679b0256a27fb9f104 Oct 19 03:39:31.132770 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-DeleteServersTestJSON-1651632054 Oct 19 03:39:31.132770 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-DeleteServersTestJSON-1651632054-project Oct 19 03:39:31.132770 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:39:31.132770 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:39:31.132770 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: d099c5070710485f83d528d3d2bb1c71 Oct 19 03:39:31.132770 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-DeleteServersTestJSON-1651632054-project Oct 19 03:39:31.132770 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:39:31.132770 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance 83af58ab-841f-4579-a9fa-7e7d410ee18d could not be found. Oct 19 03:39:31.132770 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '83af58ab-841f-4579-a9fa-7e7d410ee18d'} Oct 19 03:39:31.132770 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:39:31.132770 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:39:31.132770 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2932, in _get_instance Oct 19 03:39:31.132770 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi build_req = objects.BuildRequest.get_by_instance_uuid( Oct 19 03:39:31.132770 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 03:39:31.132770 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 03:39:31.132770 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 177, in get_by_instance_uuid Oct 19 03:39:31.132770 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi db_req = cls._get_by_instance_uuid_from_db(context, instance_uuid) Oct 19 03:39:31.132770 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 19 03:39:31.132770 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 19 03:39:31.132770 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 172, in _get_by_instance_uuid_from_db Oct 19 03:39:31.132770 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.BuildRequestNotFound(uuid=instance_uuid) Oct 19 03:39:31.132770 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.BuildRequestNotFound: BuildRequest not found for instance 83af58ab-841f-4579-a9fa-7e7d410ee18d Oct 19 03:39:31.132770 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:39:31.132770 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:39:31.132770 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:39:31.132770 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:39:31.132770 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:39:31.132770 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:39:31.132770 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:39:31.132770 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:39:31.132770 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2944, in _get_instance Oct 19 03:39:31.132770 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 19 03:39:31.132770 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83af58ab-841f-4579-a9fa-7e7d410ee18d could not be found. Oct 19 03:39:31.132770 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:39:31.132770 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:39:31.132770 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:39:31.132770 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:39:31.132770 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:39:31.132770 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:39:31.135946 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:39:31.135946 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:39:31.135946 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:39:31.135946 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:39:31.135946 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:39:31.135946 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:39:31.135946 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:39:31.135946 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:39:31.135946 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:39:31.135946 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:39:31.135946 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83af58ab-841f-4579-a9fa-7e7d410ee18d could not be found. Oct 19 03:39:31.135946 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:39:31.135946 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:39:31.135946 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:39:31.135946 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:39:31.135946 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:39:31.135946 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:39:31.135946 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:39:31.135946 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:39:31.135946 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83af58ab-841f-4579-a9fa-7e7d410ee18d could not be found. Oct 19 03:39:31.135946 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:39:31.138953 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ef54ae1b-580c-4898-8955-82ed2ce63756 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Returning 404 to user: Instance 83af58ab-841f-4579-a9fa-7e7d410ee18d could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:39:31.141830 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ef54ae1b-580c-4898-8955-82ed2ce63756 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/83af58ab-841f-4579-a9fa-7e7d410ee18d" status: 404 len: 111 microversion: 2.1 time: 0.058649 Oct 19 03:39:31.142740 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2728/5382] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:31 2022] GET /compute/v2.1/servers/83af58ab-841f-4579-a9fa-7e7d410ee18d => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:39:31.355407 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-46eb9499-59f7-47ff-8d17-494e3ca2739b tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1510000113", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "networks": [{"uuid": "c7fc46f7-f975-4fb5-83e4-9e9303a4a241"}]}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:39:31.419954 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5bf4efb0-898c-45bb-adfc-a809badac4cc tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:31.432694 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5bf4efb0-898c-45bb-adfc-a809badac4cc tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1512 microversion: 2.1 time: 0.569171 Oct 19 03:39:31.438444 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2655/5383] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:30 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1512 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:39:31.469074 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.network.neutron [None req-46eb9499-59f7-47ff-8d17-494e3ca2739b tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] validate_networks() for [('c7fc46f7-f975-4fb5-83e4-9e9303a4a241', None, None, None, None, None)] {{(pid=121135) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:39:32.241125 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-46eb9499-59f7-47ff-8d17-494e3ca2739b tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Flavor limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:39:32.241707 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-46eb9499-59f7-47ff-8d17-494e3ca2739b tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Image limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:39:32.242067 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-46eb9499-59f7-47ff-8d17-494e3ca2739b tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Flavor pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:39:32.242485 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-46eb9499-59f7-47ff-8d17-494e3ca2739b tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Image pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:39:32.242903 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-46eb9499-59f7-47ff-8d17-494e3ca2739b tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:39:32.271995 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-46eb9499-59f7-47ff-8d17-494e3ca2739b tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:32.273092 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-46eb9499-59f7-47ff-8d17-494e3ca2739b tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:32.274696 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-46eb9499-59f7-47ff-8d17-494e3ca2739b tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:32.275741 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-46eb9499-59f7-47ff-8d17-494e3ca2739b tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:32.276274 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-46eb9499-59f7-47ff-8d17-494e3ca2739b tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:32.276977 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-46eb9499-59f7-47ff-8d17-494e3ca2739b tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:32.299709 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-46eb9499-59f7-47ff-8d17-494e3ca2739b tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Getting quotas for project 224417be63ba4c679b0256a27fb9f104. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:39:32.305433 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-46eb9499-59f7-47ff-8d17-494e3ca2739b tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Getting quotas for user d099c5070710485f83d528d3d2bb1c71 and project 224417be63ba4c679b0256a27fb9f104. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:39:32.319502 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-46eb9499-59f7-47ff-8d17-494e3ca2739b tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Going to run 1 instances... {{(pid=121135) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:39:32.321844 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-46eb9499-59f7-47ff-8d17-494e3ca2739b tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 3ec066e4-f1f9-4dbe-a874-0378b95cf1d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121135) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:39:32.363188 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:39:32.468664 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b970b582-5bc6-4979-9305-f6c531169784 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:32.469285 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b970b582-5bc6-4979-9305-f6c531169784 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:32.490631 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b970b582-5bc6-4979-9305-f6c531169784 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:32.491262 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b970b582-5bc6-4979-9305-f6c531169784 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:32.491835 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b970b582-5bc6-4979-9305-f6c531169784 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:32.492781 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b970b582-5bc6-4979-9305-f6c531169784 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:32.493354 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b970b582-5bc6-4979-9305-f6c531169784 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:32.493903 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b970b582-5bc6-4979-9305-f6c531169784 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:32.504074 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-46eb9499-59f7-47ff-8d17-494e3ca2739b tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.153754 Oct 19 03:39:32.504742 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2729/5384] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:39:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1155 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 19 03:39:32.516121 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-02ad9385-5a7d-4c1b-a681-ff8caa8088da tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:32.516761 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-02ad9385-5a7d-4c1b-a681-ff8caa8088da tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 3ec066e4-f1f9-4dbe-a874-0378b95cf1d9] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:33.111137 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-02ad9385-5a7d-4c1b-a681-ff8caa8088da tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:33.119791 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-02ad9385-5a7d-4c1b-a681-ff8caa8088da tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/3ec066e4-f1f9-4dbe-a874-0378b95cf1d9" status: 200 len: 1215 microversion: 2.1 time: 0.607441 Oct 19 03:39:33.120841 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2730/5385] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:32 2022] GET /compute/v2.1/servers/3ec066e4-f1f9-4dbe-a874-0378b95cf1d9 => generated 1215 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:39:33.198379 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b970b582-5bc6-4979-9305-f6c531169784 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:33.206792 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b970b582-5bc6-4979-9305-f6c531169784 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1512 microversion: 2.1 time: 0.742144 Oct 19 03:39:33.207368 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2656/5386] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:32 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1512 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:39:34.145932 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ec40e4ea-e203-407e-abe5-81feb1cd8ec1 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:34.147311 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ec40e4ea-e203-407e-abe5-81feb1cd8ec1 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 3ec066e4-f1f9-4dbe-a874-0378b95cf1d9] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:34.166219 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ec40e4ea-e203-407e-abe5-81feb1cd8ec1 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:34.166219 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ec40e4ea-e203-407e-abe5-81feb1cd8ec1 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:34.166219 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ec40e4ea-e203-407e-abe5-81feb1cd8ec1 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:34.166219 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ec40e4ea-e203-407e-abe5-81feb1cd8ec1 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:34.166219 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ec40e4ea-e203-407e-abe5-81feb1cd8ec1 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:34.166219 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ec40e4ea-e203-407e-abe5-81feb1cd8ec1 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:34.230633 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-767cbbd5-786f-41c4-841e-62216b6213d7 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:34.232031 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-767cbbd5-786f-41c4-841e-62216b6213d7 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:34.236766 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ec40e4ea-e203-407e-abe5-81feb1cd8ec1 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:34.240052 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-767cbbd5-786f-41c4-841e-62216b6213d7 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:34.240559 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-767cbbd5-786f-41c4-841e-62216b6213d7 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:34.241268 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-767cbbd5-786f-41c4-841e-62216b6213d7 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:34.242205 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-767cbbd5-786f-41c4-841e-62216b6213d7 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:34.242825 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-767cbbd5-786f-41c4-841e-62216b6213d7 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:34.243459 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-767cbbd5-786f-41c4-841e-62216b6213d7 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:34.245515 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ec40e4ea-e203-407e-abe5-81feb1cd8ec1 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/3ec066e4-f1f9-4dbe-a874-0378b95cf1d9" status: 200 len: 1211 microversion: 2.1 time: 0.106920 Oct 19 03:39:34.261919 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2731/5387] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:34 2022] GET /compute/v2.1/servers/3ec066e4-f1f9-4dbe-a874-0378b95cf1d9 => generated 1211 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:39:34.381204 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-767cbbd5-786f-41c4-841e-62216b6213d7 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:34.390937 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-767cbbd5-786f-41c4-841e-62216b6213d7 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1512 microversion: 2.1 time: 0.164390 Oct 19 03:39:34.393845 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2657/5388] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:34 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1512 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:39:35.275678 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f0800dfb-3152-423e-8d09-8d9d3167321b tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:35.276464 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f0800dfb-3152-423e-8d09-8d9d3167321b tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 3ec066e4-f1f9-4dbe-a874-0378b95cf1d9] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:35.284895 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f0800dfb-3152-423e-8d09-8d9d3167321b tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:35.285611 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f0800dfb-3152-423e-8d09-8d9d3167321b tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:35.286173 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f0800dfb-3152-423e-8d09-8d9d3167321b tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:35.286987 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f0800dfb-3152-423e-8d09-8d9d3167321b tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:35.287678 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f0800dfb-3152-423e-8d09-8d9d3167321b tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:35.288351 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f0800dfb-3152-423e-8d09-8d9d3167321b tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:35.391544 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f0800dfb-3152-423e-8d09-8d9d3167321b tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:35.405464 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f0800dfb-3152-423e-8d09-8d9d3167321b tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/3ec066e4-f1f9-4dbe-a874-0378b95cf1d9" status: 200 len: 1285 microversion: 2.1 time: 0.133506 Oct 19 03:39:35.406054 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2732/5389] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:35 2022] GET /compute/v2.1/servers/3ec066e4-f1f9-4dbe-a874-0378b95cf1d9 => generated 1285 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:39:35.422198 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-21f64802-73c1-483e-b8f9-e15e741c8a94 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:35.422198 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-21f64802-73c1-483e-b8f9-e15e741c8a94 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:35.432842 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-21f64802-73c1-483e-b8f9-e15e741c8a94 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:35.432842 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-21f64802-73c1-483e-b8f9-e15e741c8a94 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:35.432842 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-21f64802-73c1-483e-b8f9-e15e741c8a94 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:35.432842 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-21f64802-73c1-483e-b8f9-e15e741c8a94 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:35.432842 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-21f64802-73c1-483e-b8f9-e15e741c8a94 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:35.432842 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-21f64802-73c1-483e-b8f9-e15e741c8a94 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:35.639096 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-21f64802-73c1-483e-b8f9-e15e741c8a94 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:35.648608 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-21f64802-73c1-483e-b8f9-e15e741c8a94 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1512 microversion: 2.1 time: 0.235126 Oct 19 03:39:35.649203 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2658/5390] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:35 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1512 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:39:36.432026 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f31587e0-0aac-406a-a446-80b53fffb439 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:36.433129 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f31587e0-0aac-406a-a446-80b53fffb439 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 3ec066e4-f1f9-4dbe-a874-0378b95cf1d9] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:36.440814 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f31587e0-0aac-406a-a446-80b53fffb439 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:36.441557 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f31587e0-0aac-406a-a446-80b53fffb439 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:36.442025 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f31587e0-0aac-406a-a446-80b53fffb439 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:36.443021 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f31587e0-0aac-406a-a446-80b53fffb439 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:36.443488 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f31587e0-0aac-406a-a446-80b53fffb439 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:36.443923 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f31587e0-0aac-406a-a446-80b53fffb439 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:36.649936 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f31587e0-0aac-406a-a446-80b53fffb439 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:36.653010 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:39:36.673061 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f8bfdd91-f62d-4d98-b10c-eb43b192c23d tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:36.675000 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f8bfdd91-f62d-4d98-b10c-eb43b192c23d tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:36.678337 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f31587e0-0aac-406a-a446-80b53fffb439 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/3ec066e4-f1f9-4dbe-a874-0378b95cf1d9" status: 200 len: 1315 microversion: 2.1 time: 0.251326 Oct 19 03:39:36.694570 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2733/5391] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:36 2022] GET /compute/v2.1/servers/3ec066e4-f1f9-4dbe-a874-0378b95cf1d9 => generated 1315 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:39:36.694800 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f8bfdd91-f62d-4d98-b10c-eb43b192c23d tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:36.694800 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f8bfdd91-f62d-4d98-b10c-eb43b192c23d tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:36.694800 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f8bfdd91-f62d-4d98-b10c-eb43b192c23d tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:36.694800 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f8bfdd91-f62d-4d98-b10c-eb43b192c23d tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:36.694800 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f8bfdd91-f62d-4d98-b10c-eb43b192c23d tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:36.694800 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f8bfdd91-f62d-4d98-b10c-eb43b192c23d tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:36.983033 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-f8bfdd91-f62d-4d98-b10c-eb43b192c23d tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:36.985613 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=100 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:39:36.992570 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f8bfdd91-f62d-4d98-b10c-eb43b192c23d tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1512 microversion: 2.1 time: 0.323838 Oct 19 03:39:37.008886 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2659/5392] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:36 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1512 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:39:37.330214 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-8aefb8e0-c611-43f8-a0d9-29c1f68752c8 req-814fd684-de31-48f6-afab-884486702c2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ec066e4-f1f9-4dbe-a874-0378b95cf1d9", "tag": "0f790222-9a02-4e4b-ad9c-4f7fe433e1ca"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:39:37.341951 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-8aefb8e0-c611-43f8-a0d9-29c1f68752c8 req-814fd684-de31-48f6-afab-884486702c2b service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:37.342578 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-8aefb8e0-c611-43f8-a0d9-29c1f68752c8 req-814fd684-de31-48f6-afab-884486702c2b service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:37.343163 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-8aefb8e0-c611-43f8-a0d9-29c1f68752c8 req-814fd684-de31-48f6-afab-884486702c2b service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:37.355695 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-8aefb8e0-c611-43f8-a0d9-29c1f68752c8 req-814fd684-de31-48f6-afab-884486702c2b service nova] Creating event network-changed:0f790222-9a02-4e4b-ad9c-4f7fe433e1ca for instance 3ec066e4-f1f9-4dbe-a874-0378b95cf1d9 on n-h1-861333-8 Oct 19 03:39:37.361577 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-8aefb8e0-c611-43f8-a0d9-29c1f68752c8 req-814fd684-de31-48f6-afab-884486702c2b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037007 Oct 19 03:39:37.362459 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2734/5393] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:39:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:39:37.707947 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0442a5c4-479b-44ac-873a-132877950f72 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:37.709003 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0442a5c4-479b-44ac-873a-132877950f72 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 3ec066e4-f1f9-4dbe-a874-0378b95cf1d9] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:37.719132 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0442a5c4-479b-44ac-873a-132877950f72 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:37.720523 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0442a5c4-479b-44ac-873a-132877950f72 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:37.724734 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0442a5c4-479b-44ac-873a-132877950f72 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:37.724734 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0442a5c4-479b-44ac-873a-132877950f72 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:37.724734 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0442a5c4-479b-44ac-873a-132877950f72 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:37.724734 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0442a5c4-479b-44ac-873a-132877950f72 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:38.019003 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0e0ba232-9788-4770-b0d0-28a5d8398c0a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:38.019722 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0e0ba232-9788-4770-b0d0-28a5d8398c0a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:38.026840 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0e0ba232-9788-4770-b0d0-28a5d8398c0a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:38.027339 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0e0ba232-9788-4770-b0d0-28a5d8398c0a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:38.027938 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0e0ba232-9788-4770-b0d0-28a5d8398c0a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:38.032346 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0e0ba232-9788-4770-b0d0-28a5d8398c0a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:38.032346 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0e0ba232-9788-4770-b0d0-28a5d8398c0a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:38.032346 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0e0ba232-9788-4770-b0d0-28a5d8398c0a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:38.260406 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0442a5c4-479b-44ac-873a-132877950f72 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:38.278802 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-0e0ba232-9788-4770-b0d0-28a5d8398c0a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:38.284074 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0442a5c4-479b-44ac-873a-132877950f72 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/3ec066e4-f1f9-4dbe-a874-0378b95cf1d9" status: 200 len: 1315 microversion: 2.1 time: 0.567522 Oct 19 03:39:38.285073 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2660/5394] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:37 2022] GET /compute/v2.1/servers/3ec066e4-f1f9-4dbe-a874-0378b95cf1d9 => generated 1315 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:39:38.288045 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0e0ba232-9788-4770-b0d0-28a5d8398c0a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1512 microversion: 2.1 time: 0.275200 Oct 19 03:39:38.288776 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2735/5395] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:38 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1512 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:39:39.324740 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e58beec0-2686-45e6-bb2b-5d7ca98a0fee tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:39.325705 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-812c4003-2523-4acb-8d2c-55333a4651ef tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:39.326146 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e58beec0-2686-45e6-bb2b-5d7ca98a0fee tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 3ec066e4-f1f9-4dbe-a874-0378b95cf1d9] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:39.327899 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-812c4003-2523-4acb-8d2c-55333a4651ef tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:39.337618 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-812c4003-2523-4acb-8d2c-55333a4651ef tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:39.337950 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e58beec0-2686-45e6-bb2b-5d7ca98a0fee tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:39.338448 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e58beec0-2686-45e6-bb2b-5d7ca98a0fee tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:39.338769 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-812c4003-2523-4acb-8d2c-55333a4651ef tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:39.339241 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e58beec0-2686-45e6-bb2b-5d7ca98a0fee tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:39.339374 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-812c4003-2523-4acb-8d2c-55333a4651ef tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:39.340341 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-812c4003-2523-4acb-8d2c-55333a4651ef tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:39.340452 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e58beec0-2686-45e6-bb2b-5d7ca98a0fee tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:39.340863 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e58beec0-2686-45e6-bb2b-5d7ca98a0fee tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:39.341266 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-812c4003-2523-4acb-8d2c-55333a4651ef tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:39.341424 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e58beec0-2686-45e6-bb2b-5d7ca98a0fee tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:39.342148 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-812c4003-2523-4acb-8d2c-55333a4651ef tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:39.612484 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e58beec0-2686-45e6-bb2b-5d7ca98a0fee tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:39.623960 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e58beec0-2686-45e6-bb2b-5d7ca98a0fee tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/3ec066e4-f1f9-4dbe-a874-0378b95cf1d9" status: 200 len: 1315 microversion: 2.1 time: 0.306370 Oct 19 03:39:39.643204 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2661/5396] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:39 2022] GET /compute/v2.1/servers/3ec066e4-f1f9-4dbe-a874-0378b95cf1d9 => generated 1315 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:39:39.645931 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-812c4003-2523-4acb-8d2c-55333a4651ef tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:39.654159 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-812c4003-2523-4acb-8d2c-55333a4651ef tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1512 microversion: 2.1 time: 0.333728 Oct 19 03:39:39.671707 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2736/5397] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:39 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1512 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:39:40.652178 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-eb5d8bd7-671a-4271-97fa-80aad8ded93d tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:40.652884 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-eb5d8bd7-671a-4271-97fa-80aad8ded93d tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 3ec066e4-f1f9-4dbe-a874-0378b95cf1d9] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:40.655681 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:39:40.661508 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eb5d8bd7-671a-4271-97fa-80aad8ded93d tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:40.662077 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eb5d8bd7-671a-4271-97fa-80aad8ded93d tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:40.662770 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eb5d8bd7-671a-4271-97fa-80aad8ded93d tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:40.663575 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eb5d8bd7-671a-4271-97fa-80aad8ded93d tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:40.664045 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eb5d8bd7-671a-4271-97fa-80aad8ded93d tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:40.664514 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eb5d8bd7-671a-4271-97fa-80aad8ded93d tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:40.682287 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5c67c5bd-a3b9-4637-a2aa-a38b66a52ca1 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:40.683309 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-5c67c5bd-a3b9-4637-a2aa-a38b66a52ca1 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:40.694765 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5c67c5bd-a3b9-4637-a2aa-a38b66a52ca1 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:40.695322 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5c67c5bd-a3b9-4637-a2aa-a38b66a52ca1 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:40.701964 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5c67c5bd-a3b9-4637-a2aa-a38b66a52ca1 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:40.702930 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5c67c5bd-a3b9-4637-a2aa-a38b66a52ca1 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:40.709458 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5c67c5bd-a3b9-4637-a2aa-a38b66a52ca1 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:40.709458 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5c67c5bd-a3b9-4637-a2aa-a38b66a52ca1 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:40.996327 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-eb5d8bd7-671a-4271-97fa-80aad8ded93d tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:41.007652 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-eb5d8bd7-671a-4271-97fa-80aad8ded93d tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/3ec066e4-f1f9-4dbe-a874-0378b95cf1d9" status: 200 len: 1315 microversion: 2.1 time: 0.359056 Oct 19 03:39:41.010095 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2662/5398] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:40 2022] GET /compute/v2.1/servers/3ec066e4-f1f9-4dbe-a874-0378b95cf1d9 => generated 1315 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:39:41.063216 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-5c67c5bd-a3b9-4637-a2aa-a38b66a52ca1 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:41.078860 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5c67c5bd-a3b9-4637-a2aa-a38b66a52ca1 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1512 microversion: 2.1 time: 0.403181 Oct 19 03:39:41.082120 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2737/5399] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:40 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1512 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:39:41.375153 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7a5f0587-2aea-40d0-b497-ee05583b595b tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:41.375909 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7a5f0587-2aea-40d0-b497-ee05583b595b tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] [instance: 1f354001-86ee-4951-a9cb-23fcd9e678a9] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:41.382827 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7a5f0587-2aea-40d0-b497-ee05583b595b tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:41.383605 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7a5f0587-2aea-40d0-b497-ee05583b595b tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:41.384291 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7a5f0587-2aea-40d0-b497-ee05583b595b tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:41.385183 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7a5f0587-2aea-40d0-b497-ee05583b595b tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:41.385682 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7a5f0587-2aea-40d0-b497-ee05583b595b tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:41.386120 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7a5f0587-2aea-40d0-b497-ee05583b595b tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:41.415956 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7a5f0587-2aea-40d0-b497-ee05583b595b tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] 10.222.0.52 "GET /compute/v2.1/servers/1f354001-86ee-4951-a9cb-23fcd9e678a9/ips" status: 200 len: 145 microversion: 2.1 time: 0.403665 Oct 19 03:39:41.416554 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2663/5400] 10.222.0.52 () {58 vars in 1248 bytes} [Wed Oct 19 03:39:41 2022] GET /compute/v2.1/servers/1f354001-86ee-4951-a9cb-23fcd9e678a9/ips => generated 145 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:39:42.033145 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4bccf799-d3e7-4801-b024-28b8046593d5 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:42.033967 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4bccf799-d3e7-4801-b024-28b8046593d5 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 3ec066e4-f1f9-4dbe-a874-0378b95cf1d9] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:42.048974 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4bccf799-d3e7-4801-b024-28b8046593d5 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:42.049537 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4bccf799-d3e7-4801-b024-28b8046593d5 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:42.049980 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4bccf799-d3e7-4801-b024-28b8046593d5 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:42.050707 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4bccf799-d3e7-4801-b024-28b8046593d5 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:42.051172 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4bccf799-d3e7-4801-b024-28b8046593d5 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:42.051618 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4bccf799-d3e7-4801-b024-28b8046593d5 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:42.113174 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6b3c2074-003d-4697-a9c1-b5cebfaffb83 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:42.114694 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6b3c2074-003d-4697-a9c1-b5cebfaffb83 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:42.124374 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6b3c2074-003d-4697-a9c1-b5cebfaffb83 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:42.125157 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6b3c2074-003d-4697-a9c1-b5cebfaffb83 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:42.126692 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6b3c2074-003d-4697-a9c1-b5cebfaffb83 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:42.127827 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6b3c2074-003d-4697-a9c1-b5cebfaffb83 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:42.128485 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6b3c2074-003d-4697-a9c1-b5cebfaffb83 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:42.132684 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6b3c2074-003d-4697-a9c1-b5cebfaffb83 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:42.288957 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=4 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:39:42.551204 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4bccf799-d3e7-4801-b024-28b8046593d5 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:42.562146 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4bccf799-d3e7-4801-b024-28b8046593d5 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/3ec066e4-f1f9-4dbe-a874-0378b95cf1d9" status: 200 len: 1315 microversion: 2.1 time: 0.533289 Oct 19 03:39:42.562758 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2738/5401] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:42 2022] GET /compute/v2.1/servers/3ec066e4-f1f9-4dbe-a874-0378b95cf1d9 => generated 1315 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:39:42.609439 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-6b3c2074-003d-4697-a9c1-b5cebfaffb83 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:42.625510 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6b3c2074-003d-4697-a9c1-b5cebfaffb83 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1512 microversion: 2.1 time: 0.521646 Oct 19 03:39:42.627540 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2664/5402] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:42 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1512 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:39:43.590034 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3d2cf885-06cd-4300-b34e-8a0cd320aba0 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:43.591335 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-3d2cf885-06cd-4300-b34e-8a0cd320aba0 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 3ec066e4-f1f9-4dbe-a874-0378b95cf1d9] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:43.595646 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=16 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:39:43.601508 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3d2cf885-06cd-4300-b34e-8a0cd320aba0 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:43.602281 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3d2cf885-06cd-4300-b34e-8a0cd320aba0 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:43.602878 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3d2cf885-06cd-4300-b34e-8a0cd320aba0 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:43.603943 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3d2cf885-06cd-4300-b34e-8a0cd320aba0 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:43.604560 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3d2cf885-06cd-4300-b34e-8a0cd320aba0 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:43.605438 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3d2cf885-06cd-4300-b34e-8a0cd320aba0 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:43.651088 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8d01f2e7-cfa1-423f-8d56-d47a745554b6 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:43.652677 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8d01f2e7-cfa1-423f-8d56-d47a745554b6 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:43.667798 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8d01f2e7-cfa1-423f-8d56-d47a745554b6 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:43.668380 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8d01f2e7-cfa1-423f-8d56-d47a745554b6 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:43.672581 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8d01f2e7-cfa1-423f-8d56-d47a745554b6 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:43.672581 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8d01f2e7-cfa1-423f-8d56-d47a745554b6 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:43.672581 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8d01f2e7-cfa1-423f-8d56-d47a745554b6 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:43.674786 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8d01f2e7-cfa1-423f-8d56-d47a745554b6 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:43.826886 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-3d2cf885-06cd-4300-b34e-8a0cd320aba0 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:43.837190 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-3d2cf885-06cd-4300-b34e-8a0cd320aba0 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/3ec066e4-f1f9-4dbe-a874-0378b95cf1d9" status: 200 len: 1315 microversion: 2.1 time: 0.251327 Oct 19 03:39:43.838065 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2739/5403] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:43 2022] GET /compute/v2.1/servers/3ec066e4-f1f9-4dbe-a874-0378b95cf1d9 => generated 1315 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:39:43.863673 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8d01f2e7-cfa1-423f-8d56-d47a745554b6 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:43.871836 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8d01f2e7-cfa1-423f-8d56-d47a745554b6 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1533 microversion: 2.1 time: 0.224987 Oct 19 03:39:43.872632 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2665/5404] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:43 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1533 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:39:44.180426 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-f19de858-c013-455e-b31e-1be6937c9cf3 req-07b39863-1af4-45f1-bfdd-0193c9dbbdd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ec066e4-f1f9-4dbe-a874-0378b95cf1d9", "name": "network-vif-plugged", "status": "completed", "tag": "0f790222-9a02-4e4b-ad9c-4f7fe433e1ca"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:39:44.191278 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-f19de858-c013-455e-b31e-1be6937c9cf3 req-07b39863-1af4-45f1-bfdd-0193c9dbbdd6 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:44.192195 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-f19de858-c013-455e-b31e-1be6937c9cf3 req-07b39863-1af4-45f1-bfdd-0193c9dbbdd6 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:44.192766 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-f19de858-c013-455e-b31e-1be6937c9cf3 req-07b39863-1af4-45f1-bfdd-0193c9dbbdd6 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:44.205392 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-f19de858-c013-455e-b31e-1be6937c9cf3 req-07b39863-1af4-45f1-bfdd-0193c9dbbdd6 service nova] Creating event network-vif-plugged:0f790222-9a02-4e4b-ad9c-4f7fe433e1ca for instance 3ec066e4-f1f9-4dbe-a874-0378b95cf1d9 on n-h1-861333-8 Oct 19 03:39:44.210534 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-f19de858-c013-455e-b31e-1be6937c9cf3 req-07b39863-1af4-45f1-bfdd-0193c9dbbdd6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034094 Oct 19 03:39:44.211223 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2740/5405] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:39:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:39:44.384716 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-46da8db2-58d3-4aa1-a994-8009d9584b09 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "46184d76-dddb-40d6-b77c-a3eff590659e"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:39:44.387441 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-46da8db2-58d3-4aa1-a994-8009d9584b09 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] [instance: 1f354001-86ee-4951-a9cb-23fcd9e678a9] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:44.394654 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-46da8db2-58d3-4aa1-a994-8009d9584b09 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:44.395384 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-46da8db2-58d3-4aa1-a994-8009d9584b09 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:44.395988 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-46da8db2-58d3-4aa1-a994-8009d9584b09 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:44.396859 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-46da8db2-58d3-4aa1-a994-8009d9584b09 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:44.397501 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-46da8db2-58d3-4aa1-a994-8009d9584b09 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:44.398270 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-46da8db2-58d3-4aa1-a994-8009d9584b09 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:44.863502 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f6756c55-2ba2-44b0-8293-3da7b9bd0215 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:44.864380 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f6756c55-2ba2-44b0-8293-3da7b9bd0215 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 3ec066e4-f1f9-4dbe-a874-0378b95cf1d9] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:44.871110 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f6756c55-2ba2-44b0-8293-3da7b9bd0215 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:44.871905 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f6756c55-2ba2-44b0-8293-3da7b9bd0215 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:44.872461 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f6756c55-2ba2-44b0-8293-3da7b9bd0215 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:44.873389 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f6756c55-2ba2-44b0-8293-3da7b9bd0215 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:44.874158 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f6756c55-2ba2-44b0-8293-3da7b9bd0215 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:44.874606 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f6756c55-2ba2-44b0-8293-3da7b9bd0215 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:45.109652 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f6756c55-2ba2-44b0-8293-3da7b9bd0215 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:45.118196 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f6756c55-2ba2-44b0-8293-3da7b9bd0215 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/3ec066e4-f1f9-4dbe-a874-0378b95cf1d9" status: 200 len: 1315 microversion: 2.1 time: 0.261437 Oct 19 03:39:45.118780 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2741/5406] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:44 2022] GET /compute/v2.1/servers/3ec066e4-f1f9-4dbe-a874-0378b95cf1d9 => generated 1315 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:39:45.123808 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-47b820c2-e06e-4cfe-99f3-6a867ddb9a92 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:45.124560 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-47b820c2-e06e-4cfe-99f3-6a867ddb9a92 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:45.130732 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-47b820c2-e06e-4cfe-99f3-6a867ddb9a92 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:45.131318 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-47b820c2-e06e-4cfe-99f3-6a867ddb9a92 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:45.132206 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-47b820c2-e06e-4cfe-99f3-6a867ddb9a92 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:45.133096 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-47b820c2-e06e-4cfe-99f3-6a867ddb9a92 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:45.134582 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-47b820c2-e06e-4cfe-99f3-6a867ddb9a92 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:45.135212 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-47b820c2-e06e-4cfe-99f3-6a867ddb9a92 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:45.155154 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-46da8db2-58d3-4aa1-a994-8009d9584b09 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] 10.222.0.52 "POST /compute/v2.1/servers/1f354001-86ee-4951-a9cb-23fcd9e678a9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.768499 Oct 19 03:39:45.155154 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2666/5407] 10.222.0.52 () {60 vars in 1323 bytes} [Wed Oct 19 03:39:44 2022] POST /compute/v2.1/servers/1f354001-86ee-4951-a9cb-23fcd9e678a9/os-volume_attachments => generated 194 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:39:45.389672 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-47b820c2-e06e-4cfe-99f3-6a867ddb9a92 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:45.397759 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-47b820c2-e06e-4cfe-99f3-6a867ddb9a92 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1533 microversion: 2.1 time: 0.277611 Oct 19 03:39:45.413821 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2742/5408] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:45 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1533 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:39:46.151073 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-db1b86b2-df2f-4b5c-9838-3d84326f0570 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:46.152315 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-db1b86b2-df2f-4b5c-9838-3d84326f0570 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 3ec066e4-f1f9-4dbe-a874-0378b95cf1d9] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:46.176323 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-db1b86b2-df2f-4b5c-9838-3d84326f0570 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:46.180213 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-db1b86b2-df2f-4b5c-9838-3d84326f0570 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:46.182089 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-db1b86b2-df2f-4b5c-9838-3d84326f0570 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:46.187300 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-db1b86b2-df2f-4b5c-9838-3d84326f0570 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:46.188797 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-db1b86b2-df2f-4b5c-9838-3d84326f0570 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:46.189593 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-db1b86b2-df2f-4b5c-9838-3d84326f0570 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:46.424972 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-346d89fa-cf09-4bab-9fcf-d5963049cba3 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:46.425566 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-346d89fa-cf09-4bab-9fcf-d5963049cba3 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:46.438403 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-346d89fa-cf09-4bab-9fcf-d5963049cba3 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:46.451234 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-346d89fa-cf09-4bab-9fcf-d5963049cba3 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:46.458798 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-346d89fa-cf09-4bab-9fcf-d5963049cba3 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:46.460928 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-346d89fa-cf09-4bab-9fcf-d5963049cba3 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:46.461664 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-346d89fa-cf09-4bab-9fcf-d5963049cba3 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:46.462122 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-346d89fa-cf09-4bab-9fcf-d5963049cba3 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:46.546222 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-db1b86b2-df2f-4b5c-9838-3d84326f0570 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:46.561277 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-db1b86b2-df2f-4b5c-9838-3d84326f0570 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/3ec066e4-f1f9-4dbe-a874-0378b95cf1d9" status: 200 len: 1315 microversion: 2.1 time: 0.417735 Oct 19 03:39:46.568132 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2667/5409] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:46 2022] GET /compute/v2.1/servers/3ec066e4-f1f9-4dbe-a874-0378b95cf1d9 => generated 1315 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:39:46.752169 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-346d89fa-cf09-4bab-9fcf-d5963049cba3 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:46.764605 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-346d89fa-cf09-4bab-9fcf-d5963049cba3 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1528 microversion: 2.1 time: 0.344235 Oct 19 03:39:46.765625 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2743/5410] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:46 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1528 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:39:47.412833 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-49ea6eb4-7a97-4a38-8bbd-0fa666361974 req-7a17678f-fed2-4bc6-b478-c0827324d24c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a830928-6d51-4dbd-97ad-8cca44de3770", "name": "network-vif-plugged", "status": "completed", "tag": "9779d73d-72bb-47da-820f-5576b587d824"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:39:47.431730 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:39:47.436817 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-49ea6eb4-7a97-4a38-8bbd-0fa666361974 req-7a17678f-fed2-4bc6-b478-c0827324d24c service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:47.437351 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-49ea6eb4-7a97-4a38-8bbd-0fa666361974 req-7a17678f-fed2-4bc6-b478-c0827324d24c service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:47.437930 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-49ea6eb4-7a97-4a38-8bbd-0fa666361974 req-7a17678f-fed2-4bc6-b478-c0827324d24c service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:47.456720 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-49ea6eb4-7a97-4a38-8bbd-0fa666361974 req-7a17678f-fed2-4bc6-b478-c0827324d24c service nova] Creating event network-vif-plugged:9779d73d-72bb-47da-820f-5576b587d824 for instance 5a830928-6d51-4dbd-97ad-8cca44de3770 on n-h2-861333-8 Oct 19 03:39:47.462723 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-49ea6eb4-7a97-4a38-8bbd-0fa666361974 req-7a17678f-fed2-4bc6-b478-c0827324d24c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053365 Oct 19 03:39:47.467614 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2668/5411] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:39:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:39:47.594183 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d00e923a-3625-4ded-a38e-f68c7f43845a tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:47.596215 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d00e923a-3625-4ded-a38e-f68c7f43845a tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 3ec066e4-f1f9-4dbe-a874-0378b95cf1d9] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:47.628243 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d00e923a-3625-4ded-a38e-f68c7f43845a tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:47.632800 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d00e923a-3625-4ded-a38e-f68c7f43845a tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:47.633267 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d00e923a-3625-4ded-a38e-f68c7f43845a tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:47.634510 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d00e923a-3625-4ded-a38e-f68c7f43845a tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:47.634982 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d00e923a-3625-4ded-a38e-f68c7f43845a tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:47.636331 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d00e923a-3625-4ded-a38e-f68c7f43845a tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:47.791978 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9f83c21a-e43f-4caa-b632-cf7901321915 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:47.792613 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9f83c21a-e43f-4caa-b632-cf7901321915 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:47.805265 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9f83c21a-e43f-4caa-b632-cf7901321915 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:47.805811 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9f83c21a-e43f-4caa-b632-cf7901321915 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:47.806259 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9f83c21a-e43f-4caa-b632-cf7901321915 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:47.806988 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9f83c21a-e43f-4caa-b632-cf7901321915 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:47.843187 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9f83c21a-e43f-4caa-b632-cf7901321915 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:47.843904 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9f83c21a-e43f-4caa-b632-cf7901321915 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.036s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:47.956328 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d00e923a-3625-4ded-a38e-f68c7f43845a tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:47.970542 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d00e923a-3625-4ded-a38e-f68c7f43845a tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/3ec066e4-f1f9-4dbe-a874-0378b95cf1d9" status: 200 len: 1503 microversion: 2.1 time: 0.380705 Oct 19 03:39:47.975508 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2744/5412] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:47 2022] GET /compute/v2.1/servers/3ec066e4-f1f9-4dbe-a874-0378b95cf1d9 => generated 1503 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:39:48.000543 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-afa0428f-05d9-44a5-a940-0e1cfaef1b76 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:39:48.001945 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-afa0428f-05d9-44a5-a940-0e1cfaef1b76 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 3ec066e4-f1f9-4dbe-a874-0378b95cf1d9] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:48.022537 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-afa0428f-05d9-44a5-a940-0e1cfaef1b76 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:48.024907 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-afa0428f-05d9-44a5-a940-0e1cfaef1b76 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:48.029806 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-afa0428f-05d9-44a5-a940-0e1cfaef1b76 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:48.030505 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-afa0428f-05d9-44a5-a940-0e1cfaef1b76 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:48.031008 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-afa0428f-05d9-44a5-a940-0e1cfaef1b76 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:48.031449 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-afa0428f-05d9-44a5-a940-0e1cfaef1b76 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:48.200083 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9f83c21a-e43f-4caa-b632-cf7901321915 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:48.212793 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9f83c21a-e43f-4caa-b632-cf7901321915 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1528 microversion: 2.1 time: 0.426979 Oct 19 03:39:48.213711 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2669/5413] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:47 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1528 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:39:48.290067 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-afa0428f-05d9-44a5-a940-0e1cfaef1b76 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "POST /compute/v2.1/servers/3ec066e4-f1f9-4dbe-a874-0378b95cf1d9/action" status: 202 len: 0 microversion: 2.1 time: 0.293685 Oct 19 03:39:48.291287 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2745/5414] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:39:47 2022] POST /compute/v2.1/servers/3ec066e4-f1f9-4dbe-a874-0378b95cf1d9/action => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:39:48.305513 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a98d9080-64a9-4eb3-a3ec-871276ec9d10 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:48.306160 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a98d9080-64a9-4eb3-a3ec-871276ec9d10 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 3ec066e4-f1f9-4dbe-a874-0378b95cf1d9] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:48.317315 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a98d9080-64a9-4eb3-a3ec-871276ec9d10 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:48.319638 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a98d9080-64a9-4eb3-a3ec-871276ec9d10 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:48.320161 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a98d9080-64a9-4eb3-a3ec-871276ec9d10 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:48.320931 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a98d9080-64a9-4eb3-a3ec-871276ec9d10 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:48.323635 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a98d9080-64a9-4eb3-a3ec-871276ec9d10 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:48.324104 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a98d9080-64a9-4eb3-a3ec-871276ec9d10 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:48.627252 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a98d9080-64a9-4eb3-a3ec-871276ec9d10 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:48.642801 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a98d9080-64a9-4eb3-a3ec-871276ec9d10 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/3ec066e4-f1f9-4dbe-a874-0378b95cf1d9" status: 200 len: 1508 microversion: 2.1 time: 0.347336 Oct 19 03:39:48.643814 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2670/5415] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:48 2022] GET /compute/v2.1/servers/3ec066e4-f1f9-4dbe-a874-0378b95cf1d9 => generated 1508 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:39:49.238411 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e11b06a1-32c4-42fc-a295-f03c75b16ae3 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:49.239872 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e11b06a1-32c4-42fc-a295-f03c75b16ae3 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:49.248468 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e11b06a1-32c4-42fc-a295-f03c75b16ae3 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:49.262121 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e11b06a1-32c4-42fc-a295-f03c75b16ae3 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:49.263026 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e11b06a1-32c4-42fc-a295-f03c75b16ae3 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:49.263953 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e11b06a1-32c4-42fc-a295-f03c75b16ae3 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:49.265639 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e11b06a1-32c4-42fc-a295-f03c75b16ae3 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:49.269600 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e11b06a1-32c4-42fc-a295-f03c75b16ae3 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:49.532221 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-e11b06a1-32c4-42fc-a295-f03c75b16ae3 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:49.540748 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e11b06a1-32c4-42fc-a295-f03c75b16ae3 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1528 microversion: 2.1 time: 0.308267 Oct 19 03:39:49.541765 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2746/5416] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:49 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1528 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:39:49.667780 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-fe82d99b-a3b0-4577-9ac1-b12bec30b945 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:49.668642 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-fe82d99b-a3b0-4577-9ac1-b12bec30b945 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 3ec066e4-f1f9-4dbe-a874-0378b95cf1d9] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:49.691667 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fe82d99b-a3b0-4577-9ac1-b12bec30b945 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:49.692484 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fe82d99b-a3b0-4577-9ac1-b12bec30b945 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:49.693188 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fe82d99b-a3b0-4577-9ac1-b12bec30b945 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:49.694219 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fe82d99b-a3b0-4577-9ac1-b12bec30b945 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:49.699286 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fe82d99b-a3b0-4577-9ac1-b12bec30b945 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:49.701226 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fe82d99b-a3b0-4577-9ac1-b12bec30b945 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:49.978835 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-fe82d99b-a3b0-4577-9ac1-b12bec30b945 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:49.988854 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-fe82d99b-a3b0-4577-9ac1-b12bec30b945 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/3ec066e4-f1f9-4dbe-a874-0378b95cf1d9" status: 200 len: 1488 microversion: 2.1 time: 0.325273 Oct 19 03:39:49.992440 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2671/5417] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:49 2022] GET /compute/v2.1/servers/3ec066e4-f1f9-4dbe-a874-0378b95cf1d9 => generated 1488 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:39:50.024453 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-04a12a64-b040-435a-82fc-385bdaefc029 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:50.025199 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-04a12a64-b040-435a-82fc-385bdaefc029 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 3ec066e4-f1f9-4dbe-a874-0378b95cf1d9] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:50.033967 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-04a12a64-b040-435a-82fc-385bdaefc029 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:50.034731 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-04a12a64-b040-435a-82fc-385bdaefc029 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:50.035377 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-04a12a64-b040-435a-82fc-385bdaefc029 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:50.036247 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-04a12a64-b040-435a-82fc-385bdaefc029 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:50.036858 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-04a12a64-b040-435a-82fc-385bdaefc029 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:50.037475 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-04a12a64-b040-435a-82fc-385bdaefc029 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:50.071358 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-04a12a64-b040-435a-82fc-385bdaefc029 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 3ec066e4-f1f9-4dbe-a874-0378b95cf1d9] Going to try to terminate instance {{(pid=121135) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:39:50.564848 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-43ab595c-be3d-4729-a64f-e6c152772843 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:50.565510 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-43ab595c-be3d-4729-a64f-e6c152772843 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:50.578032 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-43ab595c-be3d-4729-a64f-e6c152772843 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:50.581508 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-43ab595c-be3d-4729-a64f-e6c152772843 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:50.582597 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-43ab595c-be3d-4729-a64f-e6c152772843 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:50.596013 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-43ab595c-be3d-4729-a64f-e6c152772843 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:50.600371 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-43ab595c-be3d-4729-a64f-e6c152772843 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:50.602544 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-43ab595c-be3d-4729-a64f-e6c152772843 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:50.612955 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-04a12a64-b040-435a-82fc-385bdaefc029 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "DELETE /compute/v2.1/servers/3ec066e4-f1f9-4dbe-a874-0378b95cf1d9" status: 204 len: 0 microversion: 2.1 time: 0.592735 Oct 19 03:39:50.614516 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2747/5418] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:39:50 2022] DELETE /compute/v2.1/servers/3ec066e4-f1f9-4dbe-a874-0378b95cf1d9 => generated 0 bytes in 595 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:39:50.625190 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-fc92ad51-bab1-4c34-b8f4-9f6bf8a27740 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:50.628771 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-fc92ad51-bab1-4c34-b8f4-9f6bf8a27740 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 3ec066e4-f1f9-4dbe-a874-0378b95cf1d9] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:50.647331 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fc92ad51-bab1-4c34-b8f4-9f6bf8a27740 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:50.650764 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fc92ad51-bab1-4c34-b8f4-9f6bf8a27740 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:50.658217 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fc92ad51-bab1-4c34-b8f4-9f6bf8a27740 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:50.659216 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fc92ad51-bab1-4c34-b8f4-9f6bf8a27740 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:50.659850 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fc92ad51-bab1-4c34-b8f4-9f6bf8a27740 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:50.661027 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fc92ad51-bab1-4c34-b8f4-9f6bf8a27740 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:51.083511 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-43ab595c-be3d-4729-a64f-e6c152772843 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:51.098336 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-43ab595c-be3d-4729-a64f-e6c152772843 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1528 microversion: 2.1 time: 0.537940 Oct 19 03:39:51.100145 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2672/5419] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:50 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1528 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:39:51.187158 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-fc92ad51-bab1-4c34-b8f4-9f6bf8a27740 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:51.196570 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-fc92ad51-bab1-4c34-b8f4-9f6bf8a27740 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/3ec066e4-f1f9-4dbe-a874-0378b95cf1d9" status: 200 len: 1494 microversion: 2.1 time: 0.576340 Oct 19 03:39:51.197416 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2748/5420] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:50 2022] GET /compute/v2.1/servers/3ec066e4-f1f9-4dbe-a874-0378b95cf1d9 => generated 1494 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:39:51.308147 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f09a34a0-22bd-4b2d-bea5-db3fd404d1f7 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:39:51.310525 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f09a34a0-22bd-4b2d-bea5-db3fd404d1f7 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] [instance: d368a182-a350-4d0c-803d-2972af3aeb7d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:51.317117 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f09a34a0-22bd-4b2d-bea5-db3fd404d1f7 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:51.317953 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f09a34a0-22bd-4b2d-bea5-db3fd404d1f7 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:51.318399 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f09a34a0-22bd-4b2d-bea5-db3fd404d1f7 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:51.319139 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f09a34a0-22bd-4b2d-bea5-db3fd404d1f7 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:51.319755 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f09a34a0-22bd-4b2d-bea5-db3fd404d1f7 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:51.320183 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f09a34a0-22bd-4b2d-bea5-db3fd404d1f7 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:51.390377 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f09a34a0-22bd-4b2d-bea5-db3fd404d1f7 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] 10.222.0.52 "POST /compute/v2.1/servers/d368a182-a350-4d0c-803d-2972af3aeb7d/action" status: 200 len: 24570 microversion: 2.1 time: 0.080056 Oct 19 03:39:51.395090 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2673/5421] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:39:51 2022] POST /compute/v2.1/servers/d368a182-a350-4d0c-803d-2972af3aeb7d/action => generated 24570 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 03:39:52.127927 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-8f61d7d5-ceae-4d54-b120-17eddc268fee tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:52.128593 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-8f61d7d5-ceae-4d54-b120-17eddc268fee tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:52.149127 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8f61d7d5-ceae-4d54-b120-17eddc268fee tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:52.149722 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8f61d7d5-ceae-4d54-b120-17eddc268fee tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:52.150336 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8f61d7d5-ceae-4d54-b120-17eddc268fee tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:52.154135 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8f61d7d5-ceae-4d54-b120-17eddc268fee tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:52.154898 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8f61d7d5-ceae-4d54-b120-17eddc268fee tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:52.155573 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8f61d7d5-ceae-4d54-b120-17eddc268fee tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:52.167652 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:39:52.223709 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4c4b8f91-3c3a-44d7-8003-69baa3b6fa9e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:52.225290 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4c4b8f91-3c3a-44d7-8003-69baa3b6fa9e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 3ec066e4-f1f9-4dbe-a874-0378b95cf1d9] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:52.236144 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4c4b8f91-3c3a-44d7-8003-69baa3b6fa9e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:52.236921 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4c4b8f91-3c3a-44d7-8003-69baa3b6fa9e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:52.237596 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4c4b8f91-3c3a-44d7-8003-69baa3b6fa9e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:52.238567 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4c4b8f91-3c3a-44d7-8003-69baa3b6fa9e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:52.239173 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4c4b8f91-3c3a-44d7-8003-69baa3b6fa9e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:52.240078 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4c4b8f91-3c3a-44d7-8003-69baa3b6fa9e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:52.930371 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-8f61d7d5-ceae-4d54-b120-17eddc268fee tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:52.943454 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-8f61d7d5-ceae-4d54-b120-17eddc268fee tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1528 microversion: 2.1 time: 0.820367 Oct 19 03:39:52.944287 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2749/5422] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:52 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1528 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:39:52.981690 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-4c4b8f91-3c3a-44d7-8003-69baa3b6fa9e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:52.990336 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4c4b8f91-3c3a-44d7-8003-69baa3b6fa9e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/3ec066e4-f1f9-4dbe-a874-0378b95cf1d9" status: 200 len: 1494 microversion: 2.1 time: 0.773437 Oct 19 03:39:53.005802 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2674/5423] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:52 2022] GET /compute/v2.1/servers/3ec066e4-f1f9-4dbe-a874-0378b95cf1d9 => generated 1494 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:39:53.557205 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-5667e546-fbfc-49c8-b118-cdb57b33b8e6 req-acca5a41-ab0e-4075-b6c6-8eb0b5ab45ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ec066e4-f1f9-4dbe-a874-0378b95cf1d9", "name": "network-vif-deleted", "tag": "0f790222-9a02-4e4b-ad9c-4f7fe433e1ca"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:39:53.578670 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-5667e546-fbfc-49c8-b118-cdb57b33b8e6 req-acca5a41-ab0e-4075-b6c6-8eb0b5ab45ca service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:53.580014 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-5667e546-fbfc-49c8-b118-cdb57b33b8e6 req-acca5a41-ab0e-4075-b6c6-8eb0b5ab45ca service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:53.581055 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-5667e546-fbfc-49c8-b118-cdb57b33b8e6 req-acca5a41-ab0e-4075-b6c6-8eb0b5ab45ca service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:53.615340 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-5667e546-fbfc-49c8-b118-cdb57b33b8e6 req-acca5a41-ab0e-4075-b6c6-8eb0b5ab45ca service nova] Creating event network-vif-deleted:0f790222-9a02-4e4b-ad9c-4f7fe433e1ca for instance 3ec066e4-f1f9-4dbe-a874-0378b95cf1d9 on n-h1-861333-8 Oct 19 03:39:53.627959 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-5667e546-fbfc-49c8-b118-cdb57b33b8e6 req-acca5a41-ab0e-4075-b6c6-8eb0b5ab45ca service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072855 Oct 19 03:39:53.630876 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2750/5424] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:39:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:39:53.968455 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-224df8a6-fb53-4c81-9760-b12ab9659e3f tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:53.969086 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-224df8a6-fb53-4c81-9760-b12ab9659e3f tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:53.989020 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-224df8a6-fb53-4c81-9760-b12ab9659e3f tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:53.989550 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-224df8a6-fb53-4c81-9760-b12ab9659e3f tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:53.996834 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-224df8a6-fb53-4c81-9760-b12ab9659e3f tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:53.998014 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-224df8a6-fb53-4c81-9760-b12ab9659e3f tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:53.998637 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-224df8a6-fb53-4c81-9760-b12ab9659e3f tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:53.999219 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-224df8a6-fb53-4c81-9760-b12ab9659e3f tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:54.020044 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a2257e6b-c955-4abb-a7cb-68dd9bcdc3da tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:54.030681 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a2257e6b-c955-4abb-a7cb-68dd9bcdc3da tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 3ec066e4-f1f9-4dbe-a874-0378b95cf1d9] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:54.057815 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a2257e6b-c955-4abb-a7cb-68dd9bcdc3da tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:54.060133 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a2257e6b-c955-4abb-a7cb-68dd9bcdc3da tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:54.076140 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a2257e6b-c955-4abb-a7cb-68dd9bcdc3da tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:54.079545 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a2257e6b-c955-4abb-a7cb-68dd9bcdc3da tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:54.080302 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a2257e6b-c955-4abb-a7cb-68dd9bcdc3da tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:54.080945 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a2257e6b-c955-4abb-a7cb-68dd9bcdc3da tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:54.223109 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a2257e6b-c955-4abb-a7cb-68dd9bcdc3da tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:54.224732 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a2257e6b-c955-4abb-a7cb-68dd9bcdc3da tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:54.226213 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a2257e6b-c955-4abb-a7cb-68dd9bcdc3da tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:54.228794 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-a2257e6b-c955-4abb-a7cb-68dd9bcdc3da tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lazy-loading 'fault' on Instance uuid 3ec066e4-f1f9-4dbe-a874-0378b95cf1d9 {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:39:54.319173 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-224df8a6-fb53-4c81-9760-b12ab9659e3f tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:54.329228 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-224df8a6-fb53-4c81-9760-b12ab9659e3f tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1528 microversion: 2.1 time: 0.364275 Oct 19 03:39:54.334444 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2675/5425] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:53 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1528 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:39:54.399111 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a2257e6b-c955-4abb-a7cb-68dd9bcdc3da tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:54.410774 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a2257e6b-c955-4abb-a7cb-68dd9bcdc3da tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/3ec066e4-f1f9-4dbe-a874-0378b95cf1d9" status: 200 len: 1305 microversion: 2.1 time: 0.398198 Oct 19 03:39:54.415068 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2751/5426] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:54 2022] GET /compute/v2.1/servers/3ec066e4-f1f9-4dbe-a874-0378b95cf1d9 => generated 1305 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:39:55.366121 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-137f22da-473a-410e-9731-ebf246565e44 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:55.366810 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-137f22da-473a-410e-9731-ebf246565e44 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:55.400459 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-137f22da-473a-410e-9731-ebf246565e44 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:55.400459 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-137f22da-473a-410e-9731-ebf246565e44 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:55.400459 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-137f22da-473a-410e-9731-ebf246565e44 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:55.400459 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-137f22da-473a-410e-9731-ebf246565e44 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:55.400459 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-137f22da-473a-410e-9731-ebf246565e44 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:55.400459 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-137f22da-473a-410e-9731-ebf246565e44 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:55.429972 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:39:55.450869 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-043d55fd-5d0c-4128-9296-93ec898de8b7 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:55.454432 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-043d55fd-5d0c-4128-9296-93ec898de8b7 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 3ec066e4-f1f9-4dbe-a874-0378b95cf1d9] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:55.472230 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-043d55fd-5d0c-4128-9296-93ec898de8b7 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:55.473222 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-043d55fd-5d0c-4128-9296-93ec898de8b7 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:55.473895 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-043d55fd-5d0c-4128-9296-93ec898de8b7 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:55.479639 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-043d55fd-5d0c-4128-9296-93ec898de8b7 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:55.479639 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-043d55fd-5d0c-4128-9296-93ec898de8b7 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:55.479639 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-043d55fd-5d0c-4128-9296-93ec898de8b7 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:55.511115 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-043d55fd-5d0c-4128-9296-93ec898de8b7 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] HTTP exception thrown: Instance 3ec066e4-f1f9-4dbe-a874-0378b95cf1d9 could not be found. Oct 19 03:39:55.519590 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-043d55fd-5d0c-4128-9296-93ec898de8b7 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Request method failure captured: Oct 19 03:39:55.519590 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/3ec066e4-f1f9-4dbe-a874-0378b95cf1d9 HTTP/1.1 Oct 19 03:39:55.519590 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:39:55.519590 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:39:55.519590 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:39:55.519590 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:39:55.519590 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:39:55.519590 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:39:55.519590 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:39:55.519590 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:39:55.519590 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT3ER8Vi4kdm7o4uGCDWtKZWQ50YHYh4kO6eywBcR15sWt_VOUdg3SdiEQ00NlpD4-_UkP7cbx60NOPjR2_ogmh3qtcCqHFYMrk6ithnKX7Frq8eCjVqAngAFsiOR8FhKAXItaxrviXq7LiRs8ykPsJTrY1v2OiG3mT4ycQKs5qNWF0I Oct 19 03:39:55.519590 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:39:55.519590 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:39:55.519590 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:39:55.519590 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:39:55.519590 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:39:55.519590 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:39:55.519590 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 224417be63ba4c679b0256a27fb9f104 Oct 19 03:39:55.519590 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-DeleteServersTestJSON-1651632054 Oct 19 03:39:55.519590 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:39:55.519590 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:39:55.519590 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/224417be63ba4c679b0256a27fb9f104"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/224417be63ba4c679b0256a27fb9f104"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/224417be63ba4c679b0256a27fb9f104"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_224417be63ba4c679b0256a27fb9f104", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:39:55.519590 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-DeleteServersTestJSON-1651632054 Oct 19 03:39:55.519590 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 224417be63ba4c679b0256a27fb9f104 Oct 19 03:39:55.519590 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-DeleteServersTestJSON-1651632054 Oct 19 03:39:55.519590 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-DeleteServersTestJSON-1651632054-project Oct 19 03:39:55.519590 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:39:55.519590 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:39:55.519590 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: d099c5070710485f83d528d3d2bb1c71 Oct 19 03:39:55.519590 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-DeleteServersTestJSON-1651632054-project Oct 19 03:39:55.519590 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:39:55.519590 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance 3ec066e4-f1f9-4dbe-a874-0378b95cf1d9 could not be found. Oct 19 03:39:55.519590 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '3ec066e4-f1f9-4dbe-a874-0378b95cf1d9'} Oct 19 03:39:55.519590 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:39:55.519590 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:39:55.519590 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:39:55.519590 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:39:55.519590 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:39:55.519590 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:39:55.519590 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:39:55.519590 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:39:55.519590 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:39:55.519590 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:39:55.519590 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ec066e4-f1f9-4dbe-a874-0378b95cf1d9 could not be found. Oct 19 03:39:55.519590 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:39:55.519590 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:39:55.519590 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:39:55.519590 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:39:55.519590 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:39:55.519590 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:39:55.519590 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:39:55.519590 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:39:55.519590 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:39:55.519590 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:39:55.519590 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:39:55.519590 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:39:55.519590 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:39:55.519590 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:39:55.519590 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:39:55.519590 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:39:55.519590 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ec066e4-f1f9-4dbe-a874-0378b95cf1d9 could not be found. Oct 19 03:39:55.519590 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:39:55.519590 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:39:55.519590 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:39:55.523822 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:39:55.523822 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:39:55.523822 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:39:55.523822 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:39:55.523822 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:39:55.523822 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ec066e4-f1f9-4dbe-a874-0378b95cf1d9 could not be found. Oct 19 03:39:55.523822 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:39:55.524722 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-043d55fd-5d0c-4128-9296-93ec898de8b7 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Returning 404 to user: Instance 3ec066e4-f1f9-4dbe-a874-0378b95cf1d9 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:39:55.526251 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-043d55fd-5d0c-4128-9296-93ec898de8b7 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/3ec066e4-f1f9-4dbe-a874-0378b95cf1d9" status: 404 len: 111 microversion: 2.1 time: 0.083608 Oct 19 03:39:55.527876 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2752/5427] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:55 2022] GET /compute/v2.1/servers/3ec066e4-f1f9-4dbe-a874-0378b95cf1d9 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 03:39:55.778086 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c3bed2f5-b0c9-4458-92ad-67617f07b0d3 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1557750094", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "networks": [{"uuid": "c7fc46f7-f975-4fb5-83e4-9e9303a4a241"}]}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:39:55.790882 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-137f22da-473a-410e-9731-ebf246565e44 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:55.802205 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-137f22da-473a-410e-9731-ebf246565e44 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1528 microversion: 2.1 time: 0.443479 Oct 19 03:39:55.806789 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2676/5428] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:55 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1528 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:39:55.882353 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.network.neutron [None req-c3bed2f5-b0c9-4458-92ad-67617f07b0d3 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] validate_networks() for [('c7fc46f7-f975-4fb5-83e4-9e9303a4a241', None, None, None, None, None)] {{(pid=121135) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:39:56.616323 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-c3bed2f5-b0c9-4458-92ad-67617f07b0d3 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Flavor limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:39:56.616884 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-c3bed2f5-b0c9-4458-92ad-67617f07b0d3 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Image limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:39:56.617234 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-c3bed2f5-b0c9-4458-92ad-67617f07b0d3 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Flavor pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:39:56.617681 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-c3bed2f5-b0c9-4458-92ad-67617f07b0d3 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Image pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:39:56.618098 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-c3bed2f5-b0c9-4458-92ad-67617f07b0d3 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:39:56.636985 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c3bed2f5-b0c9-4458-92ad-67617f07b0d3 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:56.643324 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c3bed2f5-b0c9-4458-92ad-67617f07b0d3 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:56.644021 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c3bed2f5-b0c9-4458-92ad-67617f07b0d3 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:56.645271 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c3bed2f5-b0c9-4458-92ad-67617f07b0d3 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:56.645788 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c3bed2f5-b0c9-4458-92ad-67617f07b0d3 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:56.646381 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c3bed2f5-b0c9-4458-92ad-67617f07b0d3 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:56.695716 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-c3bed2f5-b0c9-4458-92ad-67617f07b0d3 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Getting quotas for project 224417be63ba4c679b0256a27fb9f104. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:39:56.713329 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-c3bed2f5-b0c9-4458-92ad-67617f07b0d3 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Getting quotas for user d099c5070710485f83d528d3d2bb1c71 and project 224417be63ba4c679b0256a27fb9f104. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:39:56.749304 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c3bed2f5-b0c9-4458-92ad-67617f07b0d3 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Going to run 1 instances... {{(pid=121135) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:39:56.758933 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c3bed2f5-b0c9-4458-92ad-67617f07b0d3 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 7e633743-2b38-4c08-be9e-fdfde600b48b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121135) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:39:56.833951 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-45f553bf-6a5a-4bcf-b476-6d0269d09ab7 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:56.835305 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-45f553bf-6a5a-4bcf-b476-6d0269d09ab7 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:56.852306 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-45f553bf-6a5a-4bcf-b476-6d0269d09ab7 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:56.855630 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-45f553bf-6a5a-4bcf-b476-6d0269d09ab7 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:56.856440 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-45f553bf-6a5a-4bcf-b476-6d0269d09ab7 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:56.860846 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-45f553bf-6a5a-4bcf-b476-6d0269d09ab7 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:56.861956 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-45f553bf-6a5a-4bcf-b476-6d0269d09ab7 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:56.864186 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-45f553bf-6a5a-4bcf-b476-6d0269d09ab7 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:56.993946 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c3bed2f5-b0c9-4458-92ad-67617f07b0d3 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.214076 Oct 19 03:39:57.005879 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2753/5429] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:39:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1234 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 19 03:39:57.039723 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b496ba5e-d1f0-49af-88d1-38d2885a5378 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:57.041223 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b496ba5e-d1f0-49af-88d1-38d2885a5378 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 7e633743-2b38-4c08-be9e-fdfde600b48b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:57.154473 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-45f553bf-6a5a-4bcf-b476-6d0269d09ab7 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:57.167748 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-45f553bf-6a5a-4bcf-b476-6d0269d09ab7 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1528 microversion: 2.1 time: 0.339148 Oct 19 03:39:57.175638 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2677/5430] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:56 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1528 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:39:57.226506 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b496ba5e-d1f0-49af-88d1-38d2885a5378 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:57.235262 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b496ba5e-d1f0-49af-88d1-38d2885a5378 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b" status: 200 len: 1215 microversion: 2.1 time: 0.227747 Oct 19 03:39:57.238306 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2754/5431] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:57 2022] GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b => generated 1215 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:39:58.197678 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c9a1b9a7-2fbf-4291-885f-bbe23ade4390 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:58.198679 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c9a1b9a7-2fbf-4291-885f-bbe23ade4390 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:58.210586 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c9a1b9a7-2fbf-4291-885f-bbe23ade4390 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:58.215009 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c9a1b9a7-2fbf-4291-885f-bbe23ade4390 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:58.215009 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c9a1b9a7-2fbf-4291-885f-bbe23ade4390 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:58.215009 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c9a1b9a7-2fbf-4291-885f-bbe23ade4390 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:58.215009 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c9a1b9a7-2fbf-4291-885f-bbe23ade4390 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:58.215009 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c9a1b9a7-2fbf-4291-885f-bbe23ade4390 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:58.263193 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-76e42c19-4c73-48dd-b2be-87827bc82530 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:58.263810 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-76e42c19-4c73-48dd-b2be-87827bc82530 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 7e633743-2b38-4c08-be9e-fdfde600b48b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:58.292051 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-76e42c19-4c73-48dd-b2be-87827bc82530 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:58.292606 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-76e42c19-4c73-48dd-b2be-87827bc82530 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:58.293057 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-76e42c19-4c73-48dd-b2be-87827bc82530 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:58.293830 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-76e42c19-4c73-48dd-b2be-87827bc82530 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:58.294286 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-76e42c19-4c73-48dd-b2be-87827bc82530 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:58.294718 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-76e42c19-4c73-48dd-b2be-87827bc82530 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:58.625701 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-76e42c19-4c73-48dd-b2be-87827bc82530 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:58.641501 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-76e42c19-4c73-48dd-b2be-87827bc82530 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b" status: 200 len: 1219 microversion: 2.1 time: 0.376660 Oct 19 03:39:58.642209 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2755/5432] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:58 2022] GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b => generated 1219 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:39:58.949101 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c9a1b9a7-2fbf-4291-885f-bbe23ade4390 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:39:58.958334 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c9a1b9a7-2fbf-4291-885f-bbe23ade4390 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1528 microversion: 2.1 time: 0.767523 Oct 19 03:39:58.962210 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2678/5433] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:58 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1528 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:39:59.664620 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-fa076293-38d2-4c5e-ad8c-467a72803ab8 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:59.665293 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-fa076293-38d2-4c5e-ad8c-467a72803ab8 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 7e633743-2b38-4c08-be9e-fdfde600b48b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:39:59.677529 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fa076293-38d2-4c5e-ad8c-467a72803ab8 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:59.678298 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fa076293-38d2-4c5e-ad8c-467a72803ab8 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:59.680292 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fa076293-38d2-4c5e-ad8c-467a72803ab8 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:59.681644 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fa076293-38d2-4c5e-ad8c-467a72803ab8 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:39:59.684315 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fa076293-38d2-4c5e-ad8c-467a72803ab8 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:39:59.684789 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fa076293-38d2-4c5e-ad8c-467a72803ab8 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:39:59.986657 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e818ae16-41a2-4012-a124-81322b48de6a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:39:59.999518 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e818ae16-41a2-4012-a124-81322b48de6a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:00.014079 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e818ae16-41a2-4012-a124-81322b48de6a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:00.017534 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e818ae16-41a2-4012-a124-81322b48de6a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:00.017534 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e818ae16-41a2-4012-a124-81322b48de6a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:00.017534 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e818ae16-41a2-4012-a124-81322b48de6a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:00.017534 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e818ae16-41a2-4012-a124-81322b48de6a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:00.017534 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e818ae16-41a2-4012-a124-81322b48de6a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:00.028975 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-fa076293-38d2-4c5e-ad8c-467a72803ab8 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:40:00.044849 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-fa076293-38d2-4c5e-ad8c-467a72803ab8 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b" status: 200 len: 1267 microversion: 2.1 time: 0.384496 Oct 19 03:40:00.046390 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2756/5434] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:59 2022] GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b => generated 1267 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:40:00.136871 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-76a2f002-b05f-4898-af54-7f31b0371afd tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:00.142709 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-76a2f002-b05f-4898-af54-7f31b0371afd tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] [instance: 1f354001-86ee-4951-a9cb-23fcd9e678a9] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:00.151211 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-76a2f002-b05f-4898-af54-7f31b0371afd tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:00.151930 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-76a2f002-b05f-4898-af54-7f31b0371afd tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:00.152434 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-76a2f002-b05f-4898-af54-7f31b0371afd tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:00.165318 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-76a2f002-b05f-4898-af54-7f31b0371afd tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:00.166074 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-76a2f002-b05f-4898-af54-7f31b0371afd tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:00.169830 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-76a2f002-b05f-4898-af54-7f31b0371afd tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:00.223818 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-76a2f002-b05f-4898-af54-7f31b0371afd tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] 10.222.0.52 "GET /compute/v2.1/servers/1f354001-86ee-4951-a9cb-23fcd9e678a9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091121 Oct 19 03:40:00.230404 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2757/5435] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Oct 19 03:40:00 2022] GET /compute/v2.1/servers/1f354001-86ee-4951-a9cb-23fcd9e678a9/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:40:00.236321 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d8739f77-c839-410a-a8fc-692896d17acd tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:00.238378 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d8739f77-c839-410a-a8fc-692896d17acd tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] [instance: 1f354001-86ee-4951-a9cb-23fcd9e678a9] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:00.249548 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d8739f77-c839-410a-a8fc-692896d17acd tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:00.249548 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d8739f77-c839-410a-a8fc-692896d17acd tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:00.249548 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d8739f77-c839-410a-a8fc-692896d17acd tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:00.249548 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d8739f77-c839-410a-a8fc-692896d17acd tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:00.249548 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d8739f77-c839-410a-a8fc-692896d17acd tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:00.249548 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d8739f77-c839-410a-a8fc-692896d17acd tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:00.328204 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d8739f77-c839-410a-a8fc-692896d17acd tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] 10.222.0.52 "GET /compute/v2.1/servers/1f354001-86ee-4951-a9cb-23fcd9e678a9/os-volume_attachments/46184d76-dddb-40d6-b77c-a3eff590659e" status: 200 len: 194 microversion: 2.1 time: 0.096368 Oct 19 03:40:00.338643 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2758/5436] 10.222.0.52 () {58 vars in 1413 bytes} [Wed Oct 19 03:40:00 2022] GET /compute/v2.1/servers/1f354001-86ee-4951-a9cb-23fcd9e678a9/os-volume_attachments/46184d76-dddb-40d6-b77c-a3eff590659e => generated 194 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:40:00.362360 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e818ae16-41a2-4012-a124-81322b48de6a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:40:00.418272 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e818ae16-41a2-4012-a124-81322b48de6a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1528 microversion: 2.1 time: 0.436832 Oct 19 03:40:00.422501 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2679/5437] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:39:59 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1528 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:40:01.072537 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0bd45418-de17-421e-8e28-facbad6004ea tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:01.074346 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0bd45418-de17-421e-8e28-facbad6004ea tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 7e633743-2b38-4c08-be9e-fdfde600b48b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:01.107681 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0bd45418-de17-421e-8e28-facbad6004ea tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:01.113195 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0bd45418-de17-421e-8e28-facbad6004ea tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:01.113195 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0bd45418-de17-421e-8e28-facbad6004ea tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:01.113598 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0bd45418-de17-421e-8e28-facbad6004ea tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:01.114064 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0bd45418-de17-421e-8e28-facbad6004ea tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:01.137680 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0bd45418-de17-421e-8e28-facbad6004ea tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:01.453851 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-10e4fd3a-a583-4fdc-a074-4ea7e7bc0159 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:01.453851 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-10e4fd3a-a583-4fdc-a074-4ea7e7bc0159 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:01.461642 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-10e4fd3a-a583-4fdc-a074-4ea7e7bc0159 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:01.462372 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-10e4fd3a-a583-4fdc-a074-4ea7e7bc0159 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:01.462812 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-10e4fd3a-a583-4fdc-a074-4ea7e7bc0159 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:01.463529 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-10e4fd3a-a583-4fdc-a074-4ea7e7bc0159 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:01.463985 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-10e4fd3a-a583-4fdc-a074-4ea7e7bc0159 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:01.464416 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-10e4fd3a-a583-4fdc-a074-4ea7e7bc0159 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:01.497668 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-0bd45418-de17-421e-8e28-facbad6004ea tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:40:01.512365 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0bd45418-de17-421e-8e28-facbad6004ea tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b" status: 200 len: 1273 microversion: 2.1 time: 0.442727 Oct 19 03:40:01.517202 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2759/5438] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:40:01 2022] GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b => generated 1273 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:40:02.293083 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-10e4fd3a-a583-4fdc-a074-4ea7e7bc0159 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:40:02.314785 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-10e4fd3a-a583-4fdc-a074-4ea7e7bc0159 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1528 microversion: 2.1 time: 0.873720 Oct 19 03:40:02.319380 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2680/5439] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:40:01 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1528 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:40:02.542456 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b2ea49a0-dd81-4035-a653-3018573fd69e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:02.543855 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b2ea49a0-dd81-4035-a653-3018573fd69e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 7e633743-2b38-4c08-be9e-fdfde600b48b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:02.557774 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b2ea49a0-dd81-4035-a653-3018573fd69e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:02.558701 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b2ea49a0-dd81-4035-a653-3018573fd69e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:02.560137 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b2ea49a0-dd81-4035-a653-3018573fd69e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:02.563237 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b2ea49a0-dd81-4035-a653-3018573fd69e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:02.565133 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b2ea49a0-dd81-4035-a653-3018573fd69e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:02.568492 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b2ea49a0-dd81-4035-a653-3018573fd69e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:02.779277 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b2ea49a0-dd81-4035-a653-3018573fd69e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:40:02.796447 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b2ea49a0-dd81-4035-a653-3018573fd69e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b" status: 200 len: 1273 microversion: 2.1 time: 0.258096 Oct 19 03:40:02.801236 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2760/5440] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:40:02 2022] GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b => generated 1273 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:40:03.354841 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7278d976-82b1-4245-a401-0bf62d333e95 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:03.355474 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7278d976-82b1-4245-a401-0bf62d333e95 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:03.376067 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7278d976-82b1-4245-a401-0bf62d333e95 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:03.390107 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7278d976-82b1-4245-a401-0bf62d333e95 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:03.393057 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7278d976-82b1-4245-a401-0bf62d333e95 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:03.394084 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7278d976-82b1-4245-a401-0bf62d333e95 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:03.397859 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7278d976-82b1-4245-a401-0bf62d333e95 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:03.398551 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7278d976-82b1-4245-a401-0bf62d333e95 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:03.798952 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-7278d976-82b1-4245-a401-0bf62d333e95 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:40:03.820312 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7278d976-82b1-4245-a401-0bf62d333e95 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1528 microversion: 2.1 time: 0.472605 Oct 19 03:40:03.825547 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-973a61e8-e73b-4ec1-8a81-4dd55bf3ea40 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:03.827050 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-973a61e8-e73b-4ec1-8a81-4dd55bf3ea40 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 7e633743-2b38-4c08-be9e-fdfde600b48b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:03.839057 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2681/5441] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:40:03 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1528 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:40:03.842119 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-973a61e8-e73b-4ec1-8a81-4dd55bf3ea40 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:03.842920 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-973a61e8-e73b-4ec1-8a81-4dd55bf3ea40 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:03.846408 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-973a61e8-e73b-4ec1-8a81-4dd55bf3ea40 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:03.848187 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-973a61e8-e73b-4ec1-8a81-4dd55bf3ea40 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:03.850441 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-973a61e8-e73b-4ec1-8a81-4dd55bf3ea40 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:03.851102 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-973a61e8-e73b-4ec1-8a81-4dd55bf3ea40 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:04.199747 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-973a61e8-e73b-4ec1-8a81-4dd55bf3ea40 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:40:04.214680 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-973a61e8-e73b-4ec1-8a81-4dd55bf3ea40 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b" status: 200 len: 1315 microversion: 2.1 time: 0.393503 Oct 19 03:40:04.215269 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2761/5442] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:40:03 2022] GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b => generated 1315 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:40:04.722057 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7877bfb7-191e-4d84-aded-039a40bdcfe9 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "29eb064c-89a5-4b55-904f-5e6b2ff76d3a"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:40:04.725080 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7877bfb7-191e-4d84-aded-039a40bdcfe9 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] [instance: 1f354001-86ee-4951-a9cb-23fcd9e678a9] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:04.739177 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7877bfb7-191e-4d84-aded-039a40bdcfe9 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:04.739914 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7877bfb7-191e-4d84-aded-039a40bdcfe9 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:04.740738 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7877bfb7-191e-4d84-aded-039a40bdcfe9 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:04.741996 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7877bfb7-191e-4d84-aded-039a40bdcfe9 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:04.742744 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7877bfb7-191e-4d84-aded-039a40bdcfe9 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:04.743392 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7877bfb7-191e-4d84-aded-039a40bdcfe9 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:04.855277 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-87e948a7-f0c2-45b8-9c1b-0ba4424b394a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:04.856494 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-87e948a7-f0c2-45b8-9c1b-0ba4424b394a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:04.874134 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-87e948a7-f0c2-45b8-9c1b-0ba4424b394a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:04.875609 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-87e948a7-f0c2-45b8-9c1b-0ba4424b394a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:04.876785 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-87e948a7-f0c2-45b8-9c1b-0ba4424b394a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:04.877484 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-87e948a7-f0c2-45b8-9c1b-0ba4424b394a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:04.878343 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-87e948a7-f0c2-45b8-9c1b-0ba4424b394a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:04.879079 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-87e948a7-f0c2-45b8-9c1b-0ba4424b394a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:05.481948 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-87e948a7-f0c2-45b8-9c1b-0ba4424b394a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:40:05.493416 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-87e948a7-f0c2-45b8-9c1b-0ba4424b394a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1528 microversion: 2.1 time: 0.642031 Oct 19 03:40:05.497875 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2762/5443] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:40:04 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1528 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:40:05.516418 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f9d8fb2a-5ef4-4b17-b830-061641030b42 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:05.517395 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f9d8fb2a-5ef4-4b17-b830-061641030b42 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 7e633743-2b38-4c08-be9e-fdfde600b48b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:05.534336 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f9d8fb2a-5ef4-4b17-b830-061641030b42 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:05.534336 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f9d8fb2a-5ef4-4b17-b830-061641030b42 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:05.534336 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f9d8fb2a-5ef4-4b17-b830-061641030b42 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:05.538331 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f9d8fb2a-5ef4-4b17-b830-061641030b42 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:05.541850 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f9d8fb2a-5ef4-4b17-b830-061641030b42 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:05.542827 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f9d8fb2a-5ef4-4b17-b830-061641030b42 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:05.879594 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7877bfb7-191e-4d84-aded-039a40bdcfe9 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] 10.222.0.52 "POST /compute/v2.1/servers/1f354001-86ee-4951-a9cb-23fcd9e678a9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.163766 Oct 19 03:40:05.882806 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2682/5444] 10.222.0.52 () {60 vars in 1323 bytes} [Wed Oct 19 03:40:04 2022] POST /compute/v2.1/servers/1f354001-86ee-4951-a9cb-23fcd9e678a9/os-volume_attachments => generated 194 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:40:06.558623 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-76319dab-b7aa-4d21-bd50-6b72b5b90b43 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:06.558623 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-76319dab-b7aa-4d21-bd50-6b72b5b90b43 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:06.561297 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-76319dab-b7aa-4d21-bd50-6b72b5b90b43 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:06.567406 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-76319dab-b7aa-4d21-bd50-6b72b5b90b43 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:06.574233 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-76319dab-b7aa-4d21-bd50-6b72b5b90b43 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:06.576061 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-76319dab-b7aa-4d21-bd50-6b72b5b90b43 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:06.581762 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-76319dab-b7aa-4d21-bd50-6b72b5b90b43 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:06.583461 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-76319dab-b7aa-4d21-bd50-6b72b5b90b43 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:06.671136 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:40:06.940384 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f9d8fb2a-5ef4-4b17-b830-061641030b42 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:40:07.002272 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f9d8fb2a-5ef4-4b17-b830-061641030b42 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b" status: 200 len: 1315 microversion: 2.1 time: 1.454031 Oct 19 03:40:07.002272 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2763/5445] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:40:05 2022] GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b => generated 1315 bytes in 1460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:40:07.121888 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-76319dab-b7aa-4d21-bd50-6b72b5b90b43 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:40:07.135324 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-76319dab-b7aa-4d21-bd50-6b72b5b90b43 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1528 microversion: 2.1 time: 0.604366 Oct 19 03:40:07.138246 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2683/5446] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:40:06 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1528 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:40:07.244562 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-996212ce-4b93-4486-b743-109e59001ed4 req-9e331325-3d2b-4336-982a-5924f59c9a6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e633743-2b38-4c08-be9e-fdfde600b48b", "tag": "990064fc-01d2-4577-a71f-88694fc1b668"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:40:07.255883 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=8 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:40:07.257532 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:40:07.276700 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-996212ce-4b93-4486-b743-109e59001ed4 req-9e331325-3d2b-4336-982a-5924f59c9a6f service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:07.285010 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-996212ce-4b93-4486-b743-109e59001ed4 req-9e331325-3d2b-4336-982a-5924f59c9a6f service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:07.286329 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-996212ce-4b93-4486-b743-109e59001ed4 req-9e331325-3d2b-4336-982a-5924f59c9a6f service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:07.349652 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-996212ce-4b93-4486-b743-109e59001ed4 req-9e331325-3d2b-4336-982a-5924f59c9a6f service nova] Creating event network-changed:990064fc-01d2-4577-a71f-88694fc1b668 for instance 7e633743-2b38-4c08-be9e-fdfde600b48b on n-h1-861333-8 Oct 19 03:40:07.365354 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-996212ce-4b93-4486-b743-109e59001ed4 req-9e331325-3d2b-4336-982a-5924f59c9a6f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124895 Oct 19 03:40:07.374471 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2764/5447] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:40:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:40:08.022593 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b6f71706-2502-453e-a695-fc621b6e218f tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:08.023264 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b6f71706-2502-453e-a695-fc621b6e218f tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 7e633743-2b38-4c08-be9e-fdfde600b48b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:08.039777 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b6f71706-2502-453e-a695-fc621b6e218f tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:08.040280 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b6f71706-2502-453e-a695-fc621b6e218f tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:08.048117 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b6f71706-2502-453e-a695-fc621b6e218f tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:08.050716 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b6f71706-2502-453e-a695-fc621b6e218f tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:08.054227 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b6f71706-2502-453e-a695-fc621b6e218f tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:08.056687 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b6f71706-2502-453e-a695-fc621b6e218f tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:08.171210 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c8b2dda1-3cbf-41ed-875e-a26c3b78c459 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:08.171952 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c8b2dda1-3cbf-41ed-875e-a26c3b78c459 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:08.212761 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c8b2dda1-3cbf-41ed-875e-a26c3b78c459 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:08.213277 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c8b2dda1-3cbf-41ed-875e-a26c3b78c459 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:08.213753 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c8b2dda1-3cbf-41ed-875e-a26c3b78c459 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:08.214486 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c8b2dda1-3cbf-41ed-875e-a26c3b78c459 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:08.214945 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c8b2dda1-3cbf-41ed-875e-a26c3b78c459 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:08.215378 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c8b2dda1-3cbf-41ed-875e-a26c3b78c459 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:08.448442 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b6f71706-2502-453e-a695-fc621b6e218f tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:40:08.464764 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b6f71706-2502-453e-a695-fc621b6e218f tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b" status: 200 len: 1315 microversion: 2.1 time: 0.443913 Oct 19 03:40:08.484829 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2684/5448] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:40:08 2022] GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b => generated 1315 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:40:08.761131 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c8b2dda1-3cbf-41ed-875e-a26c3b78c459 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:40:08.795322 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c8b2dda1-3cbf-41ed-875e-a26c3b78c459 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1528 microversion: 2.1 time: 0.618510 Oct 19 03:40:08.795322 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2765/5449] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:40:08 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1528 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:40:09.496531 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4c948036-0307-4035-9c8c-1f3cd11da1fb tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:09.497925 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4c948036-0307-4035-9c8c-1f3cd11da1fb tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 7e633743-2b38-4c08-be9e-fdfde600b48b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:09.506392 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4c948036-0307-4035-9c8c-1f3cd11da1fb tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:09.507732 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4c948036-0307-4035-9c8c-1f3cd11da1fb tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:09.508384 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4c948036-0307-4035-9c8c-1f3cd11da1fb tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:09.509494 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4c948036-0307-4035-9c8c-1f3cd11da1fb tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:09.510219 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4c948036-0307-4035-9c8c-1f3cd11da1fb tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:09.510865 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4c948036-0307-4035-9c8c-1f3cd11da1fb tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:09.770811 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-4c948036-0307-4035-9c8c-1f3cd11da1fb tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:40:09.785101 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4c948036-0307-4035-9c8c-1f3cd11da1fb tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b" status: 200 len: 1315 microversion: 2.1 time: 0.297028 Oct 19 03:40:09.791118 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2685/5450] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:40:09 2022] GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b => generated 1315 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:40:09.819709 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-fc2f549d-ec87-431a-8027-187e99de107e tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:09.820345 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-fc2f549d-ec87-431a-8027-187e99de107e tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:09.844234 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fc2f549d-ec87-431a-8027-187e99de107e tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:09.846228 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fc2f549d-ec87-431a-8027-187e99de107e tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:09.846705 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fc2f549d-ec87-431a-8027-187e99de107e tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:09.847488 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fc2f549d-ec87-431a-8027-187e99de107e tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:09.847967 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fc2f549d-ec87-431a-8027-187e99de107e tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:09.848425 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fc2f549d-ec87-431a-8027-187e99de107e tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:10.188863 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-fc2f549d-ec87-431a-8027-187e99de107e tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:40:10.204443 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-fc2f549d-ec87-431a-8027-187e99de107e tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1528 microversion: 2.1 time: 0.394486 Oct 19 03:40:10.206216 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2766/5451] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:40:09 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1528 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:40:10.545173 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-88189e43-40c5-413a-899d-d848f61ea8b7 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Action: 'create', calling method: .version_select at 0x7fc1300548b0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1954405414", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMsWlpGI2yQyTb3sSqMifR6/7AQcO/yZIH4n7Rfxr1RCGYqkxRvR1q7qr4z61kNJoB/V7sxn03lFyAIHN07dkVq6grC/Fdp2NSmJ1R8nBRFqdiVIUZuNARmjGcZ/bg7WIw=="}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:40:10.583353 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-88189e43-40c5-413a-899d-d848f61ea8b7 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Getting quotas for project 3bf91777fa414ddaa797d735e7d2a275. Resources: {'key_pairs'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:40:10.602656 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-88189e43-40c5-413a-899d-d848f61ea8b7 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Getting quotas for user 4670fd4408d4454784251a880d5a72f5 and project 3bf91777fa414ddaa797d735e7d2a275. Resources: {'key_pairs'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:40:10.732994 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-88189e43-40c5-413a-899d-d848f61ea8b7 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.192021 Oct 19 03:40:10.733686 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2686/5452] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Oct 19 03:40:10 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:40:10.811363 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-83d51d20-79cc-4e74-914e-0d7ea3789d88 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:10.812949 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-83d51d20-79cc-4e74-914e-0d7ea3789d88 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 7e633743-2b38-4c08-be9e-fdfde600b48b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:10.825875 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-83d51d20-79cc-4e74-914e-0d7ea3789d88 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:10.827097 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-83d51d20-79cc-4e74-914e-0d7ea3789d88 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:10.831505 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-83d51d20-79cc-4e74-914e-0d7ea3789d88 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:10.832494 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-83d51d20-79cc-4e74-914e-0d7ea3789d88 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:10.833926 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-83d51d20-79cc-4e74-914e-0d7ea3789d88 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:10.838062 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-83d51d20-79cc-4e74-914e-0d7ea3789d88 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:11.230180 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4416010a-3ec6-4e83-87ae-f74b49ef73c6 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:11.230902 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4416010a-3ec6-4e83-87ae-f74b49ef73c6 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:11.251537 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4416010a-3ec6-4e83-87ae-f74b49ef73c6 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:11.253582 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4416010a-3ec6-4e83-87ae-f74b49ef73c6 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:11.257288 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4416010a-3ec6-4e83-87ae-f74b49ef73c6 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:11.259017 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4416010a-3ec6-4e83-87ae-f74b49ef73c6 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:11.260605 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4416010a-3ec6-4e83-87ae-f74b49ef73c6 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:11.263657 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4416010a-3ec6-4e83-87ae-f74b49ef73c6 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:11.575440 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-83d51d20-79cc-4e74-914e-0d7ea3789d88 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:40:11.586914 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-83d51d20-79cc-4e74-914e-0d7ea3789d88 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b" status: 200 len: 1315 microversion: 2.1 time: 0.780086 Oct 19 03:40:11.600008 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2767/5453] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:40:10 2022] GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b => generated 1315 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:40:11.979457 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-4416010a-3ec6-4e83-87ae-f74b49ef73c6 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:40:12.001591 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4416010a-3ec6-4e83-87ae-f74b49ef73c6 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1510 microversion: 2.1 time: 0.777179 Oct 19 03:40:12.002206 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2687/5454] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:40:11 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1510 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:40:12.181244 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6d974101-f80b-4fb8-be9b-3c349d4c56ab tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:12.181819 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6d974101-f80b-4fb8-be9b-3c349d4c56ab tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 4fab83b8-8862-4295-adb7-e2bf5462a2d9] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:12.200254 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6d974101-f80b-4fb8-be9b-3c349d4c56ab tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:12.201001 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6d974101-f80b-4fb8-be9b-3c349d4c56ab tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:12.201360 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6d974101-f80b-4fb8-be9b-3c349d4c56ab tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:12.202321 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6d974101-f80b-4fb8-be9b-3c349d4c56ab tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:12.203596 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6d974101-f80b-4fb8-be9b-3c349d4c56ab tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:12.204179 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6d974101-f80b-4fb8-be9b-3c349d4c56ab tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:12.406508 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-6d974101-f80b-4fb8-be9b-3c349d4c56ab tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lazy-loading 'services' on Instance uuid 4fab83b8-8862-4295-adb7-e2bf5462a2d9 {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:40:12.448667 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=100 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:40:12.614784 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-21f781cc-334a-4054-a90f-f3872d0f8c42 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:12.615419 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-21f781cc-334a-4054-a90f-f3872d0f8c42 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 7e633743-2b38-4c08-be9e-fdfde600b48b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:12.626956 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-21f781cc-334a-4054-a90f-f3872d0f8c42 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:12.627477 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-21f781cc-334a-4054-a90f-f3872d0f8c42 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:12.629515 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-21f781cc-334a-4054-a90f-f3872d0f8c42 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:12.630272 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-21f781cc-334a-4054-a90f-f3872d0f8c42 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:12.651225 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-21f781cc-334a-4054-a90f-f3872d0f8c42 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:12.651731 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-21f781cc-334a-4054-a90f-f3872d0f8c42 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:12.810153 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6d974101-f80b-4fb8-be9b-3c349d4c56ab tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "DELETE /compute/v2.1/servers/4fab83b8-8862-4295-adb7-e2bf5462a2d9/os-volume_attachments/ecd82c24-c4d4-4e21-8b87-481a44c64ae1" status: 202 len: 0 microversion: 2.1 time: 0.633027 Oct 19 03:40:12.810723 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2768/5455] 10.222.0.52 () {58 vars in 1416 bytes} [Wed Oct 19 03:40:12 2022] DELETE /compute/v2.1/servers/4fab83b8-8862-4295-adb7-e2bf5462a2d9/os-volume_attachments/ecd82c24-c4d4-4e21-8b87-481a44c64ae1 => generated 0 bytes in 635 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:40:12.850983 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f5fdd93c-d6e6-4f67-b485-153227f4ad5d tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:12.855016 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f5fdd93c-d6e6-4f67-b485-153227f4ad5d tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 4fab83b8-8862-4295-adb7-e2bf5462a2d9] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:12.907848 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f5fdd93c-d6e6-4f67-b485-153227f4ad5d tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:12.908353 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f5fdd93c-d6e6-4f67-b485-153227f4ad5d tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:12.908797 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f5fdd93c-d6e6-4f67-b485-153227f4ad5d tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:12.915393 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f5fdd93c-d6e6-4f67-b485-153227f4ad5d tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:12.916148 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f5fdd93c-d6e6-4f67-b485-153227f4ad5d tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:12.916610 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f5fdd93c-d6e6-4f67-b485-153227f4ad5d tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:12.999274 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f5fdd93c-d6e6-4f67-b485-153227f4ad5d tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/4fab83b8-8862-4295-adb7-e2bf5462a2d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.172989 Oct 19 03:40:13.006871 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2769/5456] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Oct 19 03:40:12 2022] GET /compute/v2.1/servers/4fab83b8-8862-4295-adb7-e2bf5462a2d9/os-volume_attachments => generated 197 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:40:13.038755 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3eab7c7a-006c-4497-b17f-c56e077f6667 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:13.040389 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-3eab7c7a-006c-4497-b17f-c56e077f6667 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:13.063851 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3eab7c7a-006c-4497-b17f-c56e077f6667 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:13.067243 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3eab7c7a-006c-4497-b17f-c56e077f6667 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:13.070465 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3eab7c7a-006c-4497-b17f-c56e077f6667 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:13.074077 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3eab7c7a-006c-4497-b17f-c56e077f6667 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:13.081535 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3eab7c7a-006c-4497-b17f-c56e077f6667 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:13.085093 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3eab7c7a-006c-4497-b17f-c56e077f6667 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:13.104414 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-21f781cc-334a-4054-a90f-f3872d0f8c42 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:40:13.117422 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-21f781cc-334a-4054-a90f-f3872d0f8c42 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b" status: 200 len: 1315 microversion: 2.1 time: 0.506383 Oct 19 03:40:13.121002 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2688/5457] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:40:12 2022] GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b => generated 1315 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:40:13.549640 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-3eab7c7a-006c-4497-b17f-c56e077f6667 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:40:13.562953 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-3eab7c7a-006c-4497-b17f-c56e077f6667 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1510 microversion: 2.1 time: 0.535057 Oct 19 03:40:13.564048 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2770/5458] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:40:13 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1510 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:40:13.832880 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-651a0a8d-e85f-48d5-919d-9a57efed101f req-74cea481-9cc8-4fb1-a3d6-fbf9ef900346 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a830928-6d51-4dbd-97ad-8cca44de3770", "name": "network-vif-unplugged", "status": "completed", "tag": "9779d73d-72bb-47da-820f-5576b587d824"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:40:13.860544 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-651a0a8d-e85f-48d5-919d-9a57efed101f req-74cea481-9cc8-4fb1-a3d6-fbf9ef900346 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:13.864379 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-651a0a8d-e85f-48d5-919d-9a57efed101f req-74cea481-9cc8-4fb1-a3d6-fbf9ef900346 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:13.864379 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-651a0a8d-e85f-48d5-919d-9a57efed101f req-74cea481-9cc8-4fb1-a3d6-fbf9ef900346 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:13.880618 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-651a0a8d-e85f-48d5-919d-9a57efed101f req-74cea481-9cc8-4fb1-a3d6-fbf9ef900346 service nova] Creating event network-vif-unplugged:9779d73d-72bb-47da-820f-5576b587d824 for instance 5a830928-6d51-4dbd-97ad-8cca44de3770 on n-h2-861333-8 Oct 19 03:40:13.890972 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-651a0a8d-e85f-48d5-919d-9a57efed101f req-74cea481-9cc8-4fb1-a3d6-fbf9ef900346 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.066475 Oct 19 03:40:13.893562 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2689/5459] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:40:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:40:14.019690 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-12413ec0-eda3-465f-84f3-e76398db6102 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:14.022927 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-12413ec0-eda3-465f-84f3-e76398db6102 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 4fab83b8-8862-4295-adb7-e2bf5462a2d9] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:14.040179 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-12413ec0-eda3-465f-84f3-e76398db6102 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:14.042110 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-12413ec0-eda3-465f-84f3-e76398db6102 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:14.043566 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-12413ec0-eda3-465f-84f3-e76398db6102 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:14.045907 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-12413ec0-eda3-465f-84f3-e76398db6102 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:14.050188 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-12413ec0-eda3-465f-84f3-e76398db6102 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:14.051127 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-12413ec0-eda3-465f-84f3-e76398db6102 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:14.147640 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5ec5dab2-2a66-4d1a-bf60-6ba838de22ed tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:14.150537 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5ec5dab2-2a66-4d1a-bf60-6ba838de22ed tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 7e633743-2b38-4c08-be9e-fdfde600b48b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:14.156825 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-12413ec0-eda3-465f-84f3-e76398db6102 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/4fab83b8-8862-4295-adb7-e2bf5462a2d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.142460 Oct 19 03:40:14.159467 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2771/5460] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Oct 19 03:40:14 2022] GET /compute/v2.1/servers/4fab83b8-8862-4295-adb7-e2bf5462a2d9/os-volume_attachments => generated 197 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:40:14.170769 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5ec5dab2-2a66-4d1a-bf60-6ba838de22ed tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:14.171786 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5ec5dab2-2a66-4d1a-bf60-6ba838de22ed tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:14.176192 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5ec5dab2-2a66-4d1a-bf60-6ba838de22ed tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:14.177167 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5ec5dab2-2a66-4d1a-bf60-6ba838de22ed tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:14.182162 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5ec5dab2-2a66-4d1a-bf60-6ba838de22ed tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:14.183010 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5ec5dab2-2a66-4d1a-bf60-6ba838de22ed tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:14.529793 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5ec5dab2-2a66-4d1a-bf60-6ba838de22ed tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:40:14.542392 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5ec5dab2-2a66-4d1a-bf60-6ba838de22ed tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b" status: 200 len: 1315 microversion: 2.1 time: 0.405826 Oct 19 03:40:14.543209 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2690/5461] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:40:14 2022] GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b => generated 1315 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:40:14.597822 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c4d80916-b330-4652-91e7-515ce277255a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:14.597822 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c4d80916-b330-4652-91e7-515ce277255a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:14.602493 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c4d80916-b330-4652-91e7-515ce277255a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:14.603727 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c4d80916-b330-4652-91e7-515ce277255a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:14.605886 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c4d80916-b330-4652-91e7-515ce277255a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:14.606823 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c4d80916-b330-4652-91e7-515ce277255a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:14.607455 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c4d80916-b330-4652-91e7-515ce277255a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:14.608045 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c4d80916-b330-4652-91e7-515ce277255a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:15.139800 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c4d80916-b330-4652-91e7-515ce277255a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:40:15.171014 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7e1d8b43-542c-412d-828b-e638bb63c7d9 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:15.174213 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7e1d8b43-542c-412d-828b-e638bb63c7d9 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 4fab83b8-8862-4295-adb7-e2bf5462a2d9] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:15.177933 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c4d80916-b330-4652-91e7-515ce277255a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1510 microversion: 2.1 time: 0.593923 Oct 19 03:40:15.186608 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7e1d8b43-542c-412d-828b-e638bb63c7d9 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:15.187651 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7e1d8b43-542c-412d-828b-e638bb63c7d9 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:15.192399 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7e1d8b43-542c-412d-828b-e638bb63c7d9 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:15.193276 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7e1d8b43-542c-412d-828b-e638bb63c7d9 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:15.193806 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7e1d8b43-542c-412d-828b-e638bb63c7d9 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:15.194252 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7e1d8b43-542c-412d-828b-e638bb63c7d9 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:15.195246 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2772/5462] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:40:14 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1510 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:40:15.278576 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7e1d8b43-542c-412d-828b-e638bb63c7d9 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/4fab83b8-8862-4295-adb7-e2bf5462a2d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.111505 Oct 19 03:40:15.279536 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2691/5463] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Oct 19 03:40:15 2022] GET /compute/v2.1/servers/4fab83b8-8862-4295-adb7-e2bf5462a2d9/os-volume_attachments => generated 197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:40:15.570898 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-aa4460f1-2802-4615-b65c-c9caedfdd2a7 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:15.572109 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-aa4460f1-2802-4615-b65c-c9caedfdd2a7 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 7e633743-2b38-4c08-be9e-fdfde600b48b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:15.597613 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aa4460f1-2802-4615-b65c-c9caedfdd2a7 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:15.599141 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aa4460f1-2802-4615-b65c-c9caedfdd2a7 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:15.600279 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aa4460f1-2802-4615-b65c-c9caedfdd2a7 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:15.603938 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aa4460f1-2802-4615-b65c-c9caedfdd2a7 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:15.604655 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aa4460f1-2802-4615-b65c-c9caedfdd2a7 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:15.605482 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aa4460f1-2802-4615-b65c-c9caedfdd2a7 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:15.645197 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f0cb7c15-e58d-45df-b641-47d1c00dc6b9 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1693212999", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "networks": [{"uuid": "2cec011e-2b33-44ba-a59c-dc978f55c8ac"}], "key_name": "tempest-TestNetworkBasicOps-1954405414", "security_groups": [{"name": "tempest-secgroup-smoke-348495964"}]}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:40:15.916620 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-f0cb7c15-e58d-45df-b641-47d1c00dc6b9 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] validate_networks() for [('2cec011e-2b33-44ba-a59c-dc978f55c8ac', None, None, None, None, None)] {{(pid=121134) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:40:16.016082 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-aa4460f1-2802-4615-b65c-c9caedfdd2a7 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:40:16.029936 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-aa4460f1-2802-4615-b65c-c9caedfdd2a7 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b" status: 200 len: 1315 microversion: 2.1 time: 0.464290 Oct 19 03:40:16.034185 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2773/5464] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:40:15 2022] GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b => generated 1315 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:40:16.223608 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-8df8314c-6d85-45c9-b9c9-984928af9f3a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:16.224242 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-8df8314c-6d85-45c9-b9c9-984928af9f3a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:16.235519 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8df8314c-6d85-45c9-b9c9-984928af9f3a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:16.237866 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8df8314c-6d85-45c9-b9c9-984928af9f3a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:16.238304 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8df8314c-6d85-45c9-b9c9-984928af9f3a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:16.240663 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8df8314c-6d85-45c9-b9c9-984928af9f3a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:16.241151 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8df8314c-6d85-45c9-b9c9-984928af9f3a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:16.243968 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8df8314c-6d85-45c9-b9c9-984928af9f3a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:16.682264 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-8df8314c-6d85-45c9-b9c9-984928af9f3a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:40:16.693521 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-8df8314c-6d85-45c9-b9c9-984928af9f3a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1453 microversion: 2.1 time: 0.479102 Oct 19 03:40:16.694361 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2774/5465] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:40:16 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1453 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:40:16.709356 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-012b460c-607e-4fef-9256-51316344a03b tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:16.711602 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-012b460c-607e-4fef-9256-51316344a03b tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 4fab83b8-8862-4295-adb7-e2bf5462a2d9] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:16.731639 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-012b460c-607e-4fef-9256-51316344a03b tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:16.732275 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-012b460c-607e-4fef-9256-51316344a03b tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:16.732742 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-012b460c-607e-4fef-9256-51316344a03b tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:16.734281 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-012b460c-607e-4fef-9256-51316344a03b tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:16.734758 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-012b460c-607e-4fef-9256-51316344a03b tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:16.735194 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-012b460c-607e-4fef-9256-51316344a03b tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:16.804590 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-012b460c-607e-4fef-9256-51316344a03b tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/4fab83b8-8862-4295-adb7-e2bf5462a2d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.108965 Oct 19 03:40:16.813251 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2775/5466] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Oct 19 03:40:16 2022] GET /compute/v2.1/servers/4fab83b8-8862-4295-adb7-e2bf5462a2d9/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:40:16.822954 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2bb9a18f-83c6-453c-b58e-aecdd75d7d80 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:16.824952 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-2bb9a18f-83c6-453c-b58e-aecdd75d7d80 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:16.838513 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2bb9a18f-83c6-453c-b58e-aecdd75d7d80 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:16.839021 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2bb9a18f-83c6-453c-b58e-aecdd75d7d80 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:16.839472 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2bb9a18f-83c6-453c-b58e-aecdd75d7d80 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:16.840191 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2bb9a18f-83c6-453c-b58e-aecdd75d7d80 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:16.840650 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2bb9a18f-83c6-453c-b58e-aecdd75d7d80 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:16.841084 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2bb9a18f-83c6-453c-b58e-aecdd75d7d80 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:17.075889 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-f0cb7c15-e58d-45df-b641-47d1c00dc6b9 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Flavor limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:40:17.076410 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-f0cb7c15-e58d-45df-b641-47d1c00dc6b9 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Image limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:40:17.077120 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-f0cb7c15-e58d-45df-b641-47d1c00dc6b9 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Flavor pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:40:17.078288 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-f0cb7c15-e58d-45df-b641-47d1c00dc6b9 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Image pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:40:17.078919 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-f0cb7c15-e58d-45df-b641-47d1c00dc6b9 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:40:17.119799 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f0cb7c15-e58d-45df-b641-47d1c00dc6b9 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:17.122706 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f0cb7c15-e58d-45df-b641-47d1c00dc6b9 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:17.126796 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f0cb7c15-e58d-45df-b641-47d1c00dc6b9 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:17.129595 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f0cb7c15-e58d-45df-b641-47d1c00dc6b9 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:17.130501 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f0cb7c15-e58d-45df-b641-47d1c00dc6b9 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:17.136197 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f0cb7c15-e58d-45df-b641-47d1c00dc6b9 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:17.144297 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-2bb9a18f-83c6-453c-b58e-aecdd75d7d80 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:40:17.158408 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2bb9a18f-83c6-453c-b58e-aecdd75d7d80 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1453 microversion: 2.1 time: 0.342658 Oct 19 03:40:17.163033 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2776/5467] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:40:16 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1453 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:40:17.168717 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d14ee274-235a-4081-9c0a-f29f294bfce9 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:17.169667 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d14ee274-235a-4081-9c0a-f29f294bfce9 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 7e633743-2b38-4c08-be9e-fdfde600b48b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:17.203432 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-f0cb7c15-e58d-45df-b641-47d1c00dc6b9 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Getting quotas for project 3bf91777fa414ddaa797d735e7d2a275. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:40:17.215743 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-f0cb7c15-e58d-45df-b641-47d1c00dc6b9 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Getting quotas for user 4670fd4408d4454784251a880d5a72f5 and project 3bf91777fa414ddaa797d735e7d2a275. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:40:17.225931 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d14ee274-235a-4081-9c0a-f29f294bfce9 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:17.227772 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d14ee274-235a-4081-9c0a-f29f294bfce9 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:17.228222 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d14ee274-235a-4081-9c0a-f29f294bfce9 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:17.238268 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d14ee274-235a-4081-9c0a-f29f294bfce9 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:17.239491 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d14ee274-235a-4081-9c0a-f29f294bfce9 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:17.249074 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f0cb7c15-e58d-45df-b641-47d1c00dc6b9 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Going to run 1 instances... {{(pid=121134) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:40:17.252286 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d14ee274-235a-4081-9c0a-f29f294bfce9 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:17.254600 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f0cb7c15-e58d-45df-b641-47d1c00dc6b9 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] [instance: eff2dc27-f6d3-41b6-96ac-c964b1d07419] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:40:17.449423 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f0cb7c15-e58d-45df-b641-47d1c00dc6b9 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.806333 Oct 19 03:40:17.450337 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2692/5468] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:40:15 2022] POST /compute/v2.1/servers => generated 405 bytes in 1811 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 19 03:40:17.461579 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-80779c7d-152b-4013-87b0-b53fb55f2e67 req-0908520f-16a4-4fb8-97b5-9445057e5f97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e633743-2b38-4c08-be9e-fdfde600b48b", "name": "network-vif-plugged", "status": "completed", "tag": "990064fc-01d2-4577-a71f-88694fc1b668"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:40:17.486038 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-80779c7d-152b-4013-87b0-b53fb55f2e67 req-0908520f-16a4-4fb8-97b5-9445057e5f97 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:17.489827 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-80779c7d-152b-4013-87b0-b53fb55f2e67 req-0908520f-16a4-4fb8-97b5-9445057e5f97 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:17.490747 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-80779c7d-152b-4013-87b0-b53fb55f2e67 req-0908520f-16a4-4fb8-97b5-9445057e5f97 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:17.506342 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-80779c7d-152b-4013-87b0-b53fb55f2e67 req-0908520f-16a4-4fb8-97b5-9445057e5f97 service nova] Creating event network-vif-plugged:990064fc-01d2-4577-a71f-88694fc1b668 for instance 7e633743-2b38-4c08-be9e-fdfde600b48b on n-h1-861333-8 Oct 19 03:40:17.513297 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-80779c7d-152b-4013-87b0-b53fb55f2e67 req-0908520f-16a4-4fb8-97b5-9445057e5f97 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060465 Oct 19 03:40:17.515927 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2693/5469] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:40:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:40:17.521917 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-da0c9175-41c1-4feb-a621-61ae6ee225b1 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:40:17.523387 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-da0c9175-41c1-4feb-a621-61ae6ee225b1 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:17.530622 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-da0c9175-41c1-4feb-a621-61ae6ee225b1 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:17.531389 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-da0c9175-41c1-4feb-a621-61ae6ee225b1 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:17.531979 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-da0c9175-41c1-4feb-a621-61ae6ee225b1 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:17.533080 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-da0c9175-41c1-4feb-a621-61ae6ee225b1 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:17.533722 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-da0c9175-41c1-4feb-a621-61ae6ee225b1 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:17.534359 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-da0c9175-41c1-4feb-a621-61ae6ee225b1 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:17.576188 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-da0c9175-41c1-4feb-a621-61ae6ee225b1 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lazy-loading 'flavor' on Instance uuid 5a830928-6d51-4dbd-97ad-8cca44de3770 {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:40:17.581926 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:40:17.591271 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-da0c9175-41c1-4feb-a621-61ae6ee225b1 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] HTTP exception thrown: Cannot 'shelve' instance 5a830928-6d51-4dbd-97ad-8cca44de3770 while it is in vm_state shelved_offloaded Oct 19 03:40:17.593739 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-da0c9175-41c1-4feb-a621-61ae6ee225b1 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Request method failure captured: Oct 19 03:40:17.593739 n-d-861333-8 devstack@n-api.service[121134]: request: POST /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770/action HTTP/1.1 Oct 19 03:40:17.593739 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:40:17.593739 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:40:17.593739 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:40:17.593739 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 14 Oct 19 03:40:17.593739 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:40:17.593739 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:40:17.593739 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:40:17.593739 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:40:17.593739 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3EK4yDar5R5kGdpWRPopK281fOgxjiWCAZdy3tbDZzFYZxrN53hSsTq0YyAxsfcVRT4cF0jU61e6walOKxMx_njT0L3WOIYEymBjzmNzdXOa-UhYNf83BpQOShCJts2aNodNdu7YjeLcAcuRF0ZOjoH0xsH4HoNSzc8IfQzKhRz4vw Oct 19 03:40:17.593739 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:40:17.593739 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:40:17.593739 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:40:17.593739 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:40:17.593739 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:40:17.593739 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:40:17.593739 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 34bd94983fbf4a8aa49aff65c076e9e3 Oct 19 03:40:17.593739 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:40:17.593739 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:40:17.593739 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:40:17.593739 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_34bd94983fbf4a8aa49aff65c076e9e3", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:40:17.593739 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:40:17.593739 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 34bd94983fbf4a8aa49aff65c076e9e3 Oct 19 03:40:17.593739 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:40:17.593739 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ServersNegativeTestJSON-553742303-project Oct 19 03:40:17.593739 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:40:17.593739 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:40:17.593739 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 771feb133bc046588552d3af98f8e0a1 Oct 19 03:40:17.593739 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ServersNegativeTestJSON-553742303-project Oct 19 03:40:17.593739 n-d-861333-8 devstack@n-api.service[121134]: Oct 19 03:40:17.593739 n-d-861333-8 devstack@n-api.service[121134]: {"shelve": {}} Oct 19 03:40:17.593739 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:40:17.593739 n-d-861333-8 devstack@n-api.service[121134]: exception: Cannot 'shelve' instance 5a830928-6d51-4dbd-97ad-8cca44de3770 while it is in vm_state shelved_offloaded Oct 19 03:40:17.593739 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '5a830928-6d51-4dbd-97ad-8cca44de3770', 'body': {'shelve': {}}} Oct 19 03:40:17.593739 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:40:17.593739 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:40:17.593739 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Oct 19 03:40:17.593739 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Oct 19 03:40:17.593739 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 19 03:40:17.593739 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 19 03:40:17.593739 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 19 03:40:17.593739 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 19 03:40:17.593739 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 19 03:40:17.593739 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 19 03:40:17.593739 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 19 03:40:17.593739 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 19 03:40:17.593739 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 19 03:40:17.593739 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 19 03:40:17.593739 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5a830928-6d51-4dbd-97ad-8cca44de3770 in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Oct 19 03:40:17.593739 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:40:17.593739 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:40:17.593739 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:40:17.593739 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:40:17.593739 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:40:17.593739 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:40:17.593739 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:40:17.593739 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:40:17.593739 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:40:17.593739 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:40:17.593739 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Oct 19 03:40:17.593739 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 19 03:40:17.593739 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 19 03:40:17.593739 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 19 03:40:17.597602 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 5a830928-6d51-4dbd-97ad-8cca44de3770 while it is in vm_state shelved_offloaded Oct 19 03:40:17.597602 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:40:17.597602 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:40:17.597602 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:40:17.597602 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:40:17.597602 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:40:17.597602 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:40:17.597602 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:40:17.597602 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:40:17.597602 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 5a830928-6d51-4dbd-97ad-8cca44de3770 while it is in vm_state shelved_offloaded Oct 19 03:40:17.597602 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:40:17.600785 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-da0c9175-41c1-4feb-a621-61ae6ee225b1 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Returning 409 to user: Cannot 'shelve' instance 5a830928-6d51-4dbd-97ad-8cca44de3770 while it is in vm_state shelved_offloaded {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:40:17.602021 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-da0c9175-41c1-4feb-a621-61ae6ee225b1 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "POST /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770/action" status: 409 len: 155 microversion: 2.1 time: 0.084599 Oct 19 03:40:17.602798 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2694/5470] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:40:17 2022] POST /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770/action => generated 155 bytes in 86 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 19 03:40:17.611282 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-dd81d8b6-5bfb-405f-84ea-c1d53baf9ef6 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:17.612815 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-dd81d8b6-5bfb-405f-84ea-c1d53baf9ef6 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] [instance: eff2dc27-f6d3-41b6-96ac-c964b1d07419] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:17.968748 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d14ee274-235a-4081-9c0a-f29f294bfce9 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:40:17.986459 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d14ee274-235a-4081-9c0a-f29f294bfce9 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b" status: 200 len: 1315 microversion: 2.1 time: 0.820962 Oct 19 03:40:17.987346 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2777/5471] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:40:17 2022] GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b => generated 1315 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:40:17.998941 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-88fffc92-a52a-4ac6-b977-07054a96c88b tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:40:18.000680 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-88fffc92-a52a-4ac6-b977-07054a96c88b tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:18.019399 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-88fffc92-a52a-4ac6-b977-07054a96c88b tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:18.020474 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-88fffc92-a52a-4ac6-b977-07054a96c88b tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:18.021120 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-88fffc92-a52a-4ac6-b977-07054a96c88b tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:18.022220 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-88fffc92-a52a-4ac6-b977-07054a96c88b tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:18.022931 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-88fffc92-a52a-4ac6-b977-07054a96c88b tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:18.023547 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-88fffc92-a52a-4ac6-b977-07054a96c88b tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:18.191773 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-88fffc92-a52a-4ac6-b977-07054a96c88b tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121135) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 19 03:40:18.273669 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-dd81d8b6-5bfb-405f-84ea-c1d53baf9ef6 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4670fd4408d4454784251a880d5a72f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf91777fa414ddaa797d735e7d2a275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:40:18.298607 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-dd81d8b6-5bfb-405f-84ea-c1d53baf9ef6 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] 10.222.0.52 "GET /compute/v2.1/servers/eff2dc27-f6d3-41b6-96ac-c964b1d07419" status: 200 len: 1249 microversion: 2.1 time: 0.691244 Oct 19 03:40:18.299304 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2695/5472] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:40:17 2022] GET /compute/v2.1/servers/eff2dc27-f6d3-41b6-96ac-c964b1d07419 => generated 1249 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:40:18.321301 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-356b55cf-b571-493c-a083-003c80aeb8f1 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:18.324458 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-356b55cf-b571-493c-a083-003c80aeb8f1 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 4fab83b8-8862-4295-adb7-e2bf5462a2d9] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:18.355214 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-356b55cf-b571-493c-a083-003c80aeb8f1 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:18.361871 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-356b55cf-b571-493c-a083-003c80aeb8f1 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:18.362433 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-356b55cf-b571-493c-a083-003c80aeb8f1 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:18.369067 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-356b55cf-b571-493c-a083-003c80aeb8f1 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:18.369631 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-356b55cf-b571-493c-a083-003c80aeb8f1 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:18.370117 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-356b55cf-b571-493c-a083-003c80aeb8f1 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:18.480683 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-356b55cf-b571-493c-a083-003c80aeb8f1 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/4fab83b8-8862-4295-adb7-e2bf5462a2d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.177184 Oct 19 03:40:18.485693 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2696/5473] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Oct 19 03:40:18 2022] GET /compute/v2.1/servers/4fab83b8-8862-4295-adb7-e2bf5462a2d9/os-volume_attachments => generated 197 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:40:18.633782 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-88fffc92-a52a-4ac6-b977-07054a96c88b tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "POST /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770/action" status: 202 len: 0 microversion: 2.1 time: 0.645055 Oct 19 03:40:18.640796 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2778/5474] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:40:17 2022] POST /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770/action => generated 0 bytes in 652 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:40:18.646009 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-af3198d8-bc27-4956-9902-778c88311ab2 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:18.646656 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-af3198d8-bc27-4956-9902-778c88311ab2 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:18.656948 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=4 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:40:18.662035 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-af3198d8-bc27-4956-9902-778c88311ab2 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:18.662562 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-af3198d8-bc27-4956-9902-778c88311ab2 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:18.663077 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-af3198d8-bc27-4956-9902-778c88311ab2 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:18.663733 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-af3198d8-bc27-4956-9902-778c88311ab2 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:18.664333 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-af3198d8-bc27-4956-9902-778c88311ab2 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:18.666666 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-af3198d8-bc27-4956-9902-778c88311ab2 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:19.011154 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6af53667-2494-4e6f-a137-d1aa6d029a7c tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:19.012377 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6af53667-2494-4e6f-a137-d1aa6d029a7c tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 7e633743-2b38-4c08-be9e-fdfde600b48b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:19.026138 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6af53667-2494-4e6f-a137-d1aa6d029a7c tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:19.026138 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6af53667-2494-4e6f-a137-d1aa6d029a7c tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:19.026138 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6af53667-2494-4e6f-a137-d1aa6d029a7c tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:19.026138 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6af53667-2494-4e6f-a137-d1aa6d029a7c tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:19.026138 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6af53667-2494-4e6f-a137-d1aa6d029a7c tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:19.026138 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6af53667-2494-4e6f-a137-d1aa6d029a7c tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:19.055817 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-af3198d8-bc27-4956-9902-778c88311ab2 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:40:19.064261 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-af3198d8-bc27-4956-9902-778c88311ab2 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1461 microversion: 2.1 time: 0.422051 Oct 19 03:40:19.083311 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2697/5475] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:40:18 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1461 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:40:19.324149 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8aecb773-4f1f-470c-8faa-d30c715bec67 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:19.325491 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8aecb773-4f1f-470c-8faa-d30c715bec67 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] [instance: eff2dc27-f6d3-41b6-96ac-c964b1d07419] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:19.333112 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8aecb773-4f1f-470c-8faa-d30c715bec67 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:19.333640 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8aecb773-4f1f-470c-8faa-d30c715bec67 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:19.334086 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8aecb773-4f1f-470c-8faa-d30c715bec67 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:19.334802 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8aecb773-4f1f-470c-8faa-d30c715bec67 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:19.335261 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8aecb773-4f1f-470c-8faa-d30c715bec67 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:19.335690 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8aecb773-4f1f-470c-8faa-d30c715bec67 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:19.935906 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-6af53667-2494-4e6f-a137-d1aa6d029a7c tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:40:19.948286 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6af53667-2494-4e6f-a137-d1aa6d029a7c tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b" status: 200 len: 1315 microversion: 2.1 time: 0.940465 Oct 19 03:40:19.951257 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2779/5476] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:40:19 2022] GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b => generated 1315 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:40:19.961124 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5bd688da-4678-4693-a6b3-de3da35eadfb tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:19.974850 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-5bd688da-4678-4693-a6b3-de3da35eadfb tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 4fab83b8-8862-4295-adb7-e2bf5462a2d9] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:19.999052 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5bd688da-4678-4693-a6b3-de3da35eadfb tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:19.999657 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5bd688da-4678-4693-a6b3-de3da35eadfb tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:20.000931 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5bd688da-4678-4693-a6b3-de3da35eadfb tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:20.006659 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5bd688da-4678-4693-a6b3-de3da35eadfb tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:20.010108 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5bd688da-4678-4693-a6b3-de3da35eadfb tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:20.011452 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5bd688da-4678-4693-a6b3-de3da35eadfb tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:20.081168 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8aecb773-4f1f-470c-8faa-d30c715bec67 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4670fd4408d4454784251a880d5a72f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf91777fa414ddaa797d735e7d2a275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:40:20.092205 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5bd688da-4678-4693-a6b3-de3da35eadfb tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/4fab83b8-8862-4295-adb7-e2bf5462a2d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.139539 Oct 19 03:40:20.094513 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2780/5477] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Oct 19 03:40:19 2022] GET /compute/v2.1/servers/4fab83b8-8862-4295-adb7-e2bf5462a2d9/os-volume_attachments => generated 197 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:40:20.100128 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d915e32e-cb87-4261-bbb8-a05b9e424df9 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:20.100976 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d915e32e-cb87-4261-bbb8-a05b9e424df9 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:20.107761 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d915e32e-cb87-4261-bbb8-a05b9e424df9 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:20.108626 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d915e32e-cb87-4261-bbb8-a05b9e424df9 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:20.110777 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d915e32e-cb87-4261-bbb8-a05b9e424df9 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:20.111738 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d915e32e-cb87-4261-bbb8-a05b9e424df9 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:20.112660 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d915e32e-cb87-4261-bbb8-a05b9e424df9 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:20.117882 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d915e32e-cb87-4261-bbb8-a05b9e424df9 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:20.133352 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8aecb773-4f1f-470c-8faa-d30c715bec67 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] 10.222.0.52 "GET /compute/v2.1/servers/eff2dc27-f6d3-41b6-96ac-c964b1d07419" status: 200 len: 1253 microversion: 2.1 time: 0.813580 Oct 19 03:40:20.158301 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2698/5478] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:40:19 2022] GET /compute/v2.1/servers/eff2dc27-f6d3-41b6-96ac-c964b1d07419 => generated 1253 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:40:20.528729 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d915e32e-cb87-4261-bbb8-a05b9e424df9 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:40:20.539009 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d915e32e-cb87-4261-bbb8-a05b9e424df9 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1461 microversion: 2.1 time: 0.443178 Oct 19 03:40:20.548748 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2781/5479] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:40:20 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1461 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:40:20.976236 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e84d976c-961a-430b-8473-63c7c23f639f tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:20.976861 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e84d976c-961a-430b-8473-63c7c23f639f tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 7e633743-2b38-4c08-be9e-fdfde600b48b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:20.995197 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e84d976c-961a-430b-8473-63c7c23f639f tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:20.995969 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e84d976c-961a-430b-8473-63c7c23f639f tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:20.997404 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e84d976c-961a-430b-8473-63c7c23f639f tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:21.003813 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e84d976c-961a-430b-8473-63c7c23f639f tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:21.004569 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e84d976c-961a-430b-8473-63c7c23f639f tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:21.006108 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e84d976c-961a-430b-8473-63c7c23f639f tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:21.106537 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a31d3e98-b29b-4bbb-b422-330228a4b561 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:21.110089 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a31d3e98-b29b-4bbb-b422-330228a4b561 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 4fab83b8-8862-4295-adb7-e2bf5462a2d9] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:21.133937 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a31d3e98-b29b-4bbb-b422-330228a4b561 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:21.133937 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a31d3e98-b29b-4bbb-b422-330228a4b561 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:21.133937 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a31d3e98-b29b-4bbb-b422-330228a4b561 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:21.133937 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a31d3e98-b29b-4bbb-b422-330228a4b561 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:21.133937 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a31d3e98-b29b-4bbb-b422-330228a4b561 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:21.133937 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a31d3e98-b29b-4bbb-b422-330228a4b561 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:21.192324 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a31d3e98-b29b-4bbb-b422-330228a4b561 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/4fab83b8-8862-4295-adb7-e2bf5462a2d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090034 Oct 19 03:40:21.192926 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2782/5480] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Oct 19 03:40:21 2022] GET /compute/v2.1/servers/4fab83b8-8862-4295-adb7-e2bf5462a2d9/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:40:21.204161 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9bfa9307-0c5a-418e-b864-2ad9f61d82dd tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:21.205138 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9bfa9307-0c5a-418e-b864-2ad9f61d82dd tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] [instance: eff2dc27-f6d3-41b6-96ac-c964b1d07419] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:21.230991 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9bfa9307-0c5a-418e-b864-2ad9f61d82dd tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:21.231900 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9bfa9307-0c5a-418e-b864-2ad9f61d82dd tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:21.232398 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9bfa9307-0c5a-418e-b864-2ad9f61d82dd tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:21.233303 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9bfa9307-0c5a-418e-b864-2ad9f61d82dd tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:21.235452 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9bfa9307-0c5a-418e-b864-2ad9f61d82dd tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:21.235904 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9bfa9307-0c5a-418e-b864-2ad9f61d82dd tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:21.451281 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-9bfa9307-0c5a-418e-b864-2ad9f61d82dd tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4670fd4408d4454784251a880d5a72f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf91777fa414ddaa797d735e7d2a275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:40:21.464185 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9bfa9307-0c5a-418e-b864-2ad9f61d82dd tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] 10.222.0.52 "GET /compute/v2.1/servers/eff2dc27-f6d3-41b6-96ac-c964b1d07419" status: 200 len: 1319 microversion: 2.1 time: 0.268882 Oct 19 03:40:21.465297 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2783/5481] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:40:21 2022] GET /compute/v2.1/servers/eff2dc27-f6d3-41b6-96ac-c964b1d07419 => generated 1319 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:40:21.515328 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e84d976c-961a-430b-8473-63c7c23f639f tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:40:21.528655 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e84d976c-961a-430b-8473-63c7c23f639f tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b" status: 200 len: 1502 microversion: 2.1 time: 0.556172 Oct 19 03:40:21.559818 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2699/5482] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:40:20 2022] GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b => generated 1502 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:40:21.562660 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-965b2cf2-b077-4ac5-b8ea-14c406e5eab8 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:40:21.563303 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-965b2cf2-b077-4ac5-b8ea-14c406e5eab8 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 7e633743-2b38-4c08-be9e-fdfde600b48b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:21.574069 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-97c57481-3d0b-45fd-a622-b179c64aefa8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:21.574693 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-97c57481-3d0b-45fd-a622-b179c64aefa8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:21.575064 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-965b2cf2-b077-4ac5-b8ea-14c406e5eab8 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:21.577312 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-965b2cf2-b077-4ac5-b8ea-14c406e5eab8 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:21.577901 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-965b2cf2-b077-4ac5-b8ea-14c406e5eab8 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:21.578753 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-965b2cf2-b077-4ac5-b8ea-14c406e5eab8 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:21.583084 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-965b2cf2-b077-4ac5-b8ea-14c406e5eab8 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:21.583615 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-965b2cf2-b077-4ac5-b8ea-14c406e5eab8 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:21.586123 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-97c57481-3d0b-45fd-a622-b179c64aefa8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:21.591288 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-97c57481-3d0b-45fd-a622-b179c64aefa8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:21.591288 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-97c57481-3d0b-45fd-a622-b179c64aefa8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:21.591288 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-97c57481-3d0b-45fd-a622-b179c64aefa8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:21.591288 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-97c57481-3d0b-45fd-a622-b179c64aefa8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:21.591288 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-97c57481-3d0b-45fd-a622-b179c64aefa8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:21.642912 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:40:21.649242 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-965b2cf2-b077-4ac5-b8ea-14c406e5eab8 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lazy-loading 'flavor' on Instance uuid 7e633743-2b38-4c08-be9e-fdfde600b48b {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:40:21.960075 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-97c57481-3d0b-45fd-a622-b179c64aefa8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:40:21.973843 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-97c57481-3d0b-45fd-a622-b179c64aefa8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1461 microversion: 2.1 time: 0.403861 Oct 19 03:40:21.974493 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2700/5483] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:40:21 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1461 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:40:22.211084 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f1518ef6-f379-4143-826e-1fedd77b3ae5 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:22.213463 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f1518ef6-f379-4143-826e-1fedd77b3ae5 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 4fab83b8-8862-4295-adb7-e2bf5462a2d9] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:22.239788 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f1518ef6-f379-4143-826e-1fedd77b3ae5 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:22.245189 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f1518ef6-f379-4143-826e-1fedd77b3ae5 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:22.245705 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f1518ef6-f379-4143-826e-1fedd77b3ae5 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:22.246923 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f1518ef6-f379-4143-826e-1fedd77b3ae5 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:22.247402 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f1518ef6-f379-4143-826e-1fedd77b3ae5 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:22.247908 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f1518ef6-f379-4143-826e-1fedd77b3ae5 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:22.349307 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f1518ef6-f379-4143-826e-1fedd77b3ae5 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/4fab83b8-8862-4295-adb7-e2bf5462a2d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.144489 Oct 19 03:40:22.355852 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2701/5484] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Oct 19 03:40:22 2022] GET /compute/v2.1/servers/4fab83b8-8862-4295-adb7-e2bf5462a2d9/os-volume_attachments => generated 197 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:40:22.446648 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-965b2cf2-b077-4ac5-b8ea-14c406e5eab8 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "POST /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b/action" status: 202 len: 0 microversion: 2.1 time: 0.889712 Oct 19 03:40:22.447598 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2784/5485] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:40:21 2022] POST /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b/action => generated 0 bytes in 892 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:40:22.455737 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e431265b-902a-486b-ae77-3babab34a57a tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:22.456360 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e431265b-902a-486b-ae77-3babab34a57a tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 7e633743-2b38-4c08-be9e-fdfde600b48b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:22.466617 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e431265b-902a-486b-ae77-3babab34a57a tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:22.467126 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e431265b-902a-486b-ae77-3babab34a57a tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:22.468803 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e431265b-902a-486b-ae77-3babab34a57a tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:22.469775 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e431265b-902a-486b-ae77-3babab34a57a tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:22.472017 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e431265b-902a-486b-ae77-3babab34a57a tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:22.472632 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e431265b-902a-486b-ae77-3babab34a57a tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:22.495694 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ea392dd9-8a1a-4890-94aa-5be45c0b2d11 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:22.496472 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ea392dd9-8a1a-4890-94aa-5be45c0b2d11 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] [instance: eff2dc27-f6d3-41b6-96ac-c964b1d07419] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:22.545468 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ea392dd9-8a1a-4890-94aa-5be45c0b2d11 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:22.548799 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ea392dd9-8a1a-4890-94aa-5be45c0b2d11 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:22.549510 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ea392dd9-8a1a-4890-94aa-5be45c0b2d11 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:22.550451 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ea392dd9-8a1a-4890-94aa-5be45c0b2d11 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:22.551082 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ea392dd9-8a1a-4890-94aa-5be45c0b2d11 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:22.553091 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ea392dd9-8a1a-4890-94aa-5be45c0b2d11 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:22.940335 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ea392dd9-8a1a-4890-94aa-5be45c0b2d11 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4670fd4408d4454784251a880d5a72f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf91777fa414ddaa797d735e7d2a275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:40:22.940335 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ea392dd9-8a1a-4890-94aa-5be45c0b2d11 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] 10.222.0.52 "GET /compute/v2.1/servers/eff2dc27-f6d3-41b6-96ac-c964b1d07419" status: 200 len: 1307 microversion: 2.1 time: 0.321253 Oct 19 03:40:22.940335 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2785/5486] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:40:22 2022] GET /compute/v2.1/servers/eff2dc27-f6d3-41b6-96ac-c964b1d07419 => generated 1307 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:40:22.940335 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f1357049-9dd5-4c9e-b264-10c62ee2a95d tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:22.940335 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f1357049-9dd5-4c9e-b264-10c62ee2a95d tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] [instance: 1f354001-86ee-4951-a9cb-23fcd9e678a9] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:22.940335 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f1357049-9dd5-4c9e-b264-10c62ee2a95d tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:22.940335 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f1357049-9dd5-4c9e-b264-10c62ee2a95d tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:22.940335 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f1357049-9dd5-4c9e-b264-10c62ee2a95d tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:22.940335 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f1357049-9dd5-4c9e-b264-10c62ee2a95d tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:22.940335 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f1357049-9dd5-4c9e-b264-10c62ee2a95d tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:22.940335 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f1357049-9dd5-4c9e-b264-10c62ee2a95d tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:22.940335 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f1357049-9dd5-4c9e-b264-10c62ee2a95d tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] 10.222.0.52 "GET /compute/v2.1/servers/1f354001-86ee-4951-a9cb-23fcd9e678a9/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.051187 Oct 19 03:40:22.940335 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2786/5487] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Oct 19 03:40:22 2022] GET /compute/v2.1/servers/1f354001-86ee-4951-a9cb-23fcd9e678a9/os-volume_attachments => generated 371 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:40:22.941834 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e431265b-902a-486b-ae77-3babab34a57a tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:40:22.941834 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e431265b-902a-486b-ae77-3babab34a57a tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b" status: 200 len: 1508 microversion: 2.1 time: 0.464593 Oct 19 03:40:22.941834 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2702/5488] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:40:22 2022] GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b => generated 1508 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:40:23.017915 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-24964f4e-c2ee-40c7-8868-bf82d030d671 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:23.017915 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-24964f4e-c2ee-40c7-8868-bf82d030d671 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:23.017915 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-24964f4e-c2ee-40c7-8868-bf82d030d671 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:23.018162 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-24964f4e-c2ee-40c7-8868-bf82d030d671 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:23.018520 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-24964f4e-c2ee-40c7-8868-bf82d030d671 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:23.019253 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-24964f4e-c2ee-40c7-8868-bf82d030d671 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:23.019714 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-24964f4e-c2ee-40c7-8868-bf82d030d671 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:23.020150 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-24964f4e-c2ee-40c7-8868-bf82d030d671 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:23.095116 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0fcf595c-3cd7-4c8f-bd79-cc57d1ce98e4 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:23.095116 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0fcf595c-3cd7-4c8f-bd79-cc57d1ce98e4 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] [instance: 1f354001-86ee-4951-a9cb-23fcd9e678a9] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:23.104163 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0fcf595c-3cd7-4c8f-bd79-cc57d1ce98e4 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:23.104759 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0fcf595c-3cd7-4c8f-bd79-cc57d1ce98e4 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:23.105951 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0fcf595c-3cd7-4c8f-bd79-cc57d1ce98e4 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:23.106897 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0fcf595c-3cd7-4c8f-bd79-cc57d1ce98e4 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:23.107516 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0fcf595c-3cd7-4c8f-bd79-cc57d1ce98e4 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:23.107952 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0fcf595c-3cd7-4c8f-bd79-cc57d1ce98e4 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:23.186583 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0fcf595c-3cd7-4c8f-bd79-cc57d1ce98e4 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] 10.222.0.52 "GET /compute/v2.1/servers/1f354001-86ee-4951-a9cb-23fcd9e678a9/os-volume_attachments/46184d76-dddb-40d6-b77c-a3eff590659e" status: 200 len: 194 microversion: 2.1 time: 0.103123 Oct 19 03:40:23.195919 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2703/5489] 10.222.0.52 () {58 vars in 1413 bytes} [Wed Oct 19 03:40:23 2022] GET /compute/v2.1/servers/1f354001-86ee-4951-a9cb-23fcd9e678a9/os-volume_attachments/46184d76-dddb-40d6-b77c-a3eff590659e => generated 194 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:40:23.198531 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-605056a4-313b-4795-85ca-b4b8ba18cd99 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:23.199252 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-605056a4-313b-4795-85ca-b4b8ba18cd99 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] [instance: 1f354001-86ee-4951-a9cb-23fcd9e678a9] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:23.206687 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-605056a4-313b-4795-85ca-b4b8ba18cd99 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:23.207534 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-605056a4-313b-4795-85ca-b4b8ba18cd99 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:23.208176 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-605056a4-313b-4795-85ca-b4b8ba18cd99 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:23.209075 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-605056a4-313b-4795-85ca-b4b8ba18cd99 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:23.209734 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-605056a4-313b-4795-85ca-b4b8ba18cd99 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:23.210343 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-605056a4-313b-4795-85ca-b4b8ba18cd99 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:23.433736 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-605056a4-313b-4795-85ca-b4b8ba18cd99 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lazy-loading 'services' on Instance uuid 1f354001-86ee-4951-a9cb-23fcd9e678a9 {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:40:23.507291 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-24964f4e-c2ee-40c7-8868-bf82d030d671 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:40:23.517047 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-24964f4e-c2ee-40c7-8868-bf82d030d671 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1519 microversion: 2.1 time: 0.515098 Oct 19 03:40:23.535710 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2787/5490] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:40:23 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1519 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:40:23.545178 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-cbcbcf24-039b-415f-a5a3-f5493d83818d tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:23.551669 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-cbcbcf24-039b-415f-a5a3-f5493d83818d tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 4fab83b8-8862-4295-adb7-e2bf5462a2d9] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:23.564043 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cbcbcf24-039b-415f-a5a3-f5493d83818d tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:23.564767 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cbcbcf24-039b-415f-a5a3-f5493d83818d tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:23.565462 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cbcbcf24-039b-415f-a5a3-f5493d83818d tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:23.566428 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cbcbcf24-039b-415f-a5a3-f5493d83818d tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:23.567042 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cbcbcf24-039b-415f-a5a3-f5493d83818d tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:23.567628 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cbcbcf24-039b-415f-a5a3-f5493d83818d tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:23.629446 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-cbcbcf24-039b-415f-a5a3-f5493d83818d tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/4fab83b8-8862-4295-adb7-e2bf5462a2d9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.092222 Oct 19 03:40:23.630591 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2788/5491] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Oct 19 03:40:23 2022] GET /compute/v2.1/servers/4fab83b8-8862-4295-adb7-e2bf5462a2d9/os-volume_attachments => generated 25 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 03:40:23.751042 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b1fdad44-4ef7-43d4-bf53-9cfa66a0e348 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:40:23.758411 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b1fdad44-4ef7-43d4-bf53-9cfa66a0e348 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 06b5db2c-baea-4e51-8506-6443bbd9daeb] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:23.766643 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b1fdad44-4ef7-43d4-bf53-9cfa66a0e348 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:23.767415 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b1fdad44-4ef7-43d4-bf53-9cfa66a0e348 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:23.768039 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b1fdad44-4ef7-43d4-bf53-9cfa66a0e348 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:23.768937 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b1fdad44-4ef7-43d4-bf53-9cfa66a0e348 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:23.769591 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b1fdad44-4ef7-43d4-bf53-9cfa66a0e348 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:23.770185 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b1fdad44-4ef7-43d4-bf53-9cfa66a0e348 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:23.781466 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-605056a4-313b-4795-85ca-b4b8ba18cd99 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1f354001-86ee-4951-a9cb-23fcd9e678a9/os-volume_attachments/46184d76-dddb-40d6-b77c-a3eff590659e" status: 202 len: 0 microversion: 2.1 time: 0.586720 Oct 19 03:40:23.785861 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2704/5492] 10.222.0.52 () {58 vars in 1416 bytes} [Wed Oct 19 03:40:23 2022] DELETE /compute/v2.1/servers/1f354001-86ee-4951-a9cb-23fcd9e678a9/os-volume_attachments/46184d76-dddb-40d6-b77c-a3eff590659e => generated 0 bytes in 592 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:40:23.805560 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-b1fdad44-4ef7-43d4-bf53-9cfa66a0e348 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] HTTP exception thrown: Cannot 'reboot' instance 06b5db2c-baea-4e51-8506-6443bbd9daeb while it is in vm_state rescued Oct 19 03:40:23.812296 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b1fdad44-4ef7-43d4-bf53-9cfa66a0e348 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Request method failure captured: Oct 19 03:40:23.812296 n-d-861333-8 devstack@n-api.service[121135]: request: POST /compute/v2.1/servers/06b5db2c-baea-4e51-8506-6443bbd9daeb/action HTTP/1.1 Oct 19 03:40:23.812296 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:40:23.812296 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:40:23.812296 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:40:23.812296 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 28 Oct 19 03:40:23.812296 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:40:23.812296 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:40:23.812296 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:40:23.812296 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:40:23.812296 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT3BmoEKz0EhW7NaUKeOkQsZRXl8ERfsAKAMxU0GUBdc2f_V_CqkDPpZu62NL2einDTJrDUFbtRF7OMHEg091oC7NSi4gfYN6KT9w4SCkkHNILzmL1G1frQPfKMrDDDqTbb0782yvc_4ZYCpfzt0d6J1jKWlIQL4vx50kauya3LDEzsA Oct 19 03:40:23.812296 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:40:23.812296 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:40:23.812296 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:40:23.812296 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:40:23.812296 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:40:23.812296 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:40:23.812296 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 2ce5e9f9a4644b27a24b2f4c06df97bc Oct 19 03:40:23.812296 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-684190061 Oct 19 03:40:23.812296 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:40:23.812296 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:40:23.812296 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2ce5e9f9a4644b27a24b2f4c06df97bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2ce5e9f9a4644b27a24b2f4c06df97bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2ce5e9f9a4644b27a24b2f4c06df97bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2ce5e9f9a4644b27a24b2f4c06df97bc", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:40:23.812296 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ServerRescueNegativeTestJSON-684190061 Oct 19 03:40:23.812296 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 2ce5e9f9a4644b27a24b2f4c06df97bc Oct 19 03:40:23.812296 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-684190061 Oct 19 03:40:23.812296 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ServerRescueNegativeTestJSON-684190061-project Oct 19 03:40:23.812296 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:40:23.812296 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:40:23.812296 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: b4729a0afd69480f99642266e0eec17e Oct 19 03:40:23.812296 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ServerRescueNegativeTestJSON-684190061-project Oct 19 03:40:23.812296 n-d-861333-8 devstack@n-api.service[121135]: Oct 19 03:40:23.812296 n-d-861333-8 devstack@n-api.service[121135]: {"reboot": {"type": "HARD"}} Oct 19 03:40:23.812296 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:40:23.812296 n-d-861333-8 devstack@n-api.service[121135]: exception: Cannot 'reboot' instance 06b5db2c-baea-4e51-8506-6443bbd9daeb while it is in vm_state rescued Oct 19 03:40:23.812296 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '06b5db2c-baea-4e51-8506-6443bbd9daeb', 'body': {'reboot': {'type': 'HARD'}}} Oct 19 03:40:23.812296 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:40:23.812296 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:40:23.812296 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Oct 19 03:40:23.812296 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Oct 19 03:40:23.812296 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 19 03:40:23.812296 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 19 03:40:23.812296 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Oct 19 03:40:23.812296 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Oct 19 03:40:23.812296 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 19 03:40:23.812296 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 19 03:40:23.812296 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 06b5db2c-baea-4e51-8506-6443bbd9daeb in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Oct 19 03:40:23.812296 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:40:23.812296 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:40:23.812296 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:40:23.812296 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:40:23.812296 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:40:23.812296 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:40:23.812296 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:40:23.812296 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:40:23.812296 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:40:23.812296 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:40:23.812296 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:40:23.812296 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:40:23.812296 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Oct 19 03:40:23.812296 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 19 03:40:23.812296 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 19 03:40:23.812296 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 19 03:40:23.816658 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance 06b5db2c-baea-4e51-8506-6443bbd9daeb while it is in vm_state rescued Oct 19 03:40:23.816658 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:40:23.816658 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:40:23.816658 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:40:23.816658 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:40:23.816658 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:40:23.816658 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:40:23.816658 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:40:23.816658 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:40:23.816658 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance 06b5db2c-baea-4e51-8506-6443bbd9daeb while it is in vm_state rescued Oct 19 03:40:23.816658 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:40:23.820126 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b1fdad44-4ef7-43d4-bf53-9cfa66a0e348 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Returning 409 to user: Cannot 'reboot' instance 06b5db2c-baea-4e51-8506-6443bbd9daeb while it is in vm_state rescued {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:40:23.823398 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b1fdad44-4ef7-43d4-bf53-9cfa66a0e348 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "POST /compute/v2.1/servers/06b5db2c-baea-4e51-8506-6443bbd9daeb/action" status: 409 len: 145 microversion: 2.1 time: 0.073891 Oct 19 03:40:23.824400 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2789/5493] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:40:23 2022] POST /compute/v2.1/servers/06b5db2c-baea-4e51-8506-6443bbd9daeb/action => generated 145 bytes in 79 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 19 03:40:23.836048 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-615493b8-187a-46a5-81bd-0ded460b103d tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:40:23.844783 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-615493b8-187a-46a5-81bd-0ded460b103d tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 06b5db2c-baea-4e51-8506-6443bbd9daeb] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:23.856131 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-615493b8-187a-46a5-81bd-0ded460b103d tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:23.860390 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-615493b8-187a-46a5-81bd-0ded460b103d tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:23.861096 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-615493b8-187a-46a5-81bd-0ded460b103d tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:23.862807 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-615493b8-187a-46a5-81bd-0ded460b103d tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:23.865887 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-615493b8-187a-46a5-81bd-0ded460b103d tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:23.866524 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-615493b8-187a-46a5-81bd-0ded460b103d tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:23.933771 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-615493b8-187a-46a5-81bd-0ded460b103d tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] HTTP exception thrown: Cannot 'rebuild' instance 06b5db2c-baea-4e51-8506-6443bbd9daeb while it is in vm_state rescued Oct 19 03:40:23.942089 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-26b8b878-dd43-4ae3-b086-dfb3e578900d tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:23.942726 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-26b8b878-dd43-4ae3-b086-dfb3e578900d tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 7e633743-2b38-4c08-be9e-fdfde600b48b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:23.950893 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-26b8b878-dd43-4ae3-b086-dfb3e578900d tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:23.956324 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-26b8b878-dd43-4ae3-b086-dfb3e578900d tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:23.962174 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-26b8b878-dd43-4ae3-b086-dfb3e578900d tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:23.962174 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-26b8b878-dd43-4ae3-b086-dfb3e578900d tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:23.962174 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-26b8b878-dd43-4ae3-b086-dfb3e578900d tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:23.962174 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-26b8b878-dd43-4ae3-b086-dfb3e578900d tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:23.962595 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-615493b8-187a-46a5-81bd-0ded460b103d tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Request method failure captured: Oct 19 03:40:23.962595 n-d-861333-8 devstack@n-api.service[121134]: request: POST /compute/v2.1/servers/06b5db2c-baea-4e51-8506-6443bbd9daeb/action HTTP/1.1 Oct 19 03:40:23.962595 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:40:23.962595 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:40:23.962595 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:40:23.962595 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 65 Oct 19 03:40:23.962595 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:40:23.962595 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:40:23.962595 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:40:23.962595 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:40:23.962595 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3BmoEKz0EhW7NaUKeOkQsZRXl8ERfsAKAMxU0GUBdc2f_V_CqkDPpZu62NL2einDTJrDUFbtRF7OMHEg091oC7NSi4gfYN6KT9w4SCkkHNILzmL1G1frQPfKMrDDDqTbb0782yvc_4ZYCpfzt0d6J1jKWlIQL4vx50kauya3LDEzsA Oct 19 03:40:23.962595 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:40:23.962595 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:40:23.962595 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:40:23.962595 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:40:23.962595 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:40:23.962595 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:40:23.962595 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 2ce5e9f9a4644b27a24b2f4c06df97bc Oct 19 03:40:23.962595 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-684190061 Oct 19 03:40:23.962595 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:40:23.962595 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:40:23.962595 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2ce5e9f9a4644b27a24b2f4c06df97bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2ce5e9f9a4644b27a24b2f4c06df97bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2ce5e9f9a4644b27a24b2f4c06df97bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2ce5e9f9a4644b27a24b2f4c06df97bc", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:40:23.962595 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ServerRescueNegativeTestJSON-684190061 Oct 19 03:40:23.962595 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 2ce5e9f9a4644b27a24b2f4c06df97bc Oct 19 03:40:23.962595 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-684190061 Oct 19 03:40:23.962595 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ServerRescueNegativeTestJSON-684190061-project Oct 19 03:40:23.962595 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:40:23.962595 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:40:23.962595 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: b4729a0afd69480f99642266e0eec17e Oct 19 03:40:23.962595 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ServerRescueNegativeTestJSON-684190061-project Oct 19 03:40:23.962595 n-d-861333-8 devstack@n-api.service[121134]: Oct 19 03:40:23.962595 n-d-861333-8 devstack@n-api.service[121134]: {"rebuild": {"imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02"}} Oct 19 03:40:23.962595 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:40:23.962595 n-d-861333-8 devstack@n-api.service[121134]: exception: Cannot 'rebuild' instance 06b5db2c-baea-4e51-8506-6443bbd9daeb while it is in vm_state rescued Oct 19 03:40:23.962595 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '06b5db2c-baea-4e51-8506-6443bbd9daeb', 'body': {'rebuild': {'imageRef': '9e16d73e-70ea-4421-aee3-047d80396c02'}}} Oct 19 03:40:23.962595 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:40:23.962595 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:40:23.962595 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1223, in _action_rebuild Oct 19 03:40:23.962595 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Oct 19 03:40:23.962595 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 19 03:40:23.962595 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 19 03:40:23.962595 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 19 03:40:23.962595 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 19 03:40:23.962595 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 19 03:40:23.962595 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 19 03:40:23.962595 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 19 03:40:23.962595 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 19 03:40:23.962595 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 06b5db2c-baea-4e51-8506-6443bbd9daeb in vm_state rescued. Cannot rebuild while the instance is in this state. Oct 19 03:40:23.962595 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:40:23.962595 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:40:23.962595 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:40:23.962595 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:40:23.962595 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:40:23.962595 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:40:23.962595 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:40:23.962595 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:40:23.962595 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:40:23.962595 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:40:23.962595 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:40:23.962595 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:40:23.962595 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:40:23.962595 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:40:23.962595 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:40:23.966072 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:40:23.966072 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 19 03:40:23.966072 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1231, in _action_rebuild Oct 19 03:40:23.966072 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 19 03:40:23.966072 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 19 03:40:23.966072 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 19 03:40:23.966072 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance 06b5db2c-baea-4e51-8506-6443bbd9daeb while it is in vm_state rescued Oct 19 03:40:23.966072 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:40:23.966072 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:40:23.966072 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:40:23.966072 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:40:23.966072 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:40:23.966072 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:40:23.966072 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:40:23.966072 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:40:23.966072 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance 06b5db2c-baea-4e51-8506-6443bbd9daeb while it is in vm_state rescued Oct 19 03:40:23.966072 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:40:23.966072 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-615493b8-187a-46a5-81bd-0ded460b103d tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Returning 409 to user: Cannot 'rebuild' instance 06b5db2c-baea-4e51-8506-6443bbd9daeb while it is in vm_state rescued {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:40:23.966072 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-615493b8-187a-46a5-81bd-0ded460b103d tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "POST /compute/v2.1/servers/06b5db2c-baea-4e51-8506-6443bbd9daeb/action" status: 409 len: 146 microversion: 2.1 time: 0.129222 Oct 19 03:40:23.966072 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2705/5494] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:40:23 2022] POST /compute/v2.1/servers/06b5db2c-baea-4e51-8506-6443bbd9daeb/action => generated 146 bytes in 131 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 19 03:40:23.980434 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d57da87e-d927-45e7-877e-07e993c5e275 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:23.981055 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d57da87e-d927-45e7-877e-07e993c5e275 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] [instance: eff2dc27-f6d3-41b6-96ac-c964b1d07419] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:24.008473 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d57da87e-d927-45e7-877e-07e993c5e275 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:24.010249 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d57da87e-d927-45e7-877e-07e993c5e275 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:24.012450 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d57da87e-d927-45e7-877e-07e993c5e275 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:24.013495 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d57da87e-d927-45e7-877e-07e993c5e275 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:24.013986 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d57da87e-d927-45e7-877e-07e993c5e275 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:24.014436 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d57da87e-d927-45e7-877e-07e993c5e275 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:24.556414 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-26b8b878-dd43-4ae3-b086-dfb3e578900d tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:40:24.565050 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-26b8b878-dd43-4ae3-b086-dfb3e578900d tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b" status: 200 len: 1508 microversion: 2.1 time: 0.628752 Oct 19 03:40:24.565683 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2790/5495] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:40:23 2022] GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b => generated 1508 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:40:24.580767 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d57da87e-d927-45e7-877e-07e993c5e275 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4670fd4408d4454784251a880d5a72f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf91777fa414ddaa797d735e7d2a275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:40:24.583163 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-42cc05fe-9701-4503-847a-119df81e58d3 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:24.583857 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-42cc05fe-9701-4503-847a-119df81e58d3 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 4fab83b8-8862-4295-adb7-e2bf5462a2d9] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:24.590086 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d57da87e-d927-45e7-877e-07e993c5e275 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] 10.222.0.52 "GET /compute/v2.1/servers/eff2dc27-f6d3-41b6-96ac-c964b1d07419" status: 200 len: 1374 microversion: 2.1 time: 0.628088 Oct 19 03:40:24.593956 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-42cc05fe-9701-4503-847a-119df81e58d3 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:24.605409 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2706/5496] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:40:23 2022] GET /compute/v2.1/servers/eff2dc27-f6d3-41b6-96ac-c964b1d07419 => generated 1374 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:40:24.606158 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b0d22a36-0612-42f9-aa30-35a6116abef8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:24.606633 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-42cc05fe-9701-4503-847a-119df81e58d3 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:24.607384 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b0d22a36-0612-42f9-aa30-35a6116abef8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:24.608019 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-42cc05fe-9701-4503-847a-119df81e58d3 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:24.613142 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-42cc05fe-9701-4503-847a-119df81e58d3 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:24.613744 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-42cc05fe-9701-4503-847a-119df81e58d3 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:24.614194 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-42cc05fe-9701-4503-847a-119df81e58d3 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:24.633395 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b0d22a36-0612-42f9-aa30-35a6116abef8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:24.634287 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b0d22a36-0612-42f9-aa30-35a6116abef8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:24.634952 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b0d22a36-0612-42f9-aa30-35a6116abef8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:24.635783 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b0d22a36-0612-42f9-aa30-35a6116abef8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:24.636328 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b0d22a36-0612-42f9-aa30-35a6116abef8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:24.637133 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b0d22a36-0612-42f9-aa30-35a6116abef8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:24.652065 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-42cc05fe-9701-4503-847a-119df81e58d3 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 4fab83b8-8862-4295-adb7-e2bf5462a2d9] Going to try to terminate instance {{(pid=121135) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:40:24.948831 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b0d22a36-0612-42f9-aa30-35a6116abef8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:40:24.962764 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b0d22a36-0612-42f9-aa30-35a6116abef8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1519 microversion: 2.1 time: 0.365897 Oct 19 03:40:24.969001 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2707/5497] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:40:24 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1519 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:40:25.022678 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-42cc05fe-9701-4503-847a-119df81e58d3 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "DELETE /compute/v2.1/servers/4fab83b8-8862-4295-adb7-e2bf5462a2d9" status: 204 len: 0 microversion: 2.1 time: 0.443615 Oct 19 03:40:25.025074 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2791/5498] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:40:24 2022] DELETE /compute/v2.1/servers/4fab83b8-8862-4295-adb7-e2bf5462a2d9 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:40:25.036580 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-cc71481f-c40f-47cd-a09a-8e5e98b062c2 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:25.037393 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-cc71481f-c40f-47cd-a09a-8e5e98b062c2 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 4fab83b8-8862-4295-adb7-e2bf5462a2d9] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:25.049107 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cc71481f-c40f-47cd-a09a-8e5e98b062c2 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:25.049804 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cc71481f-c40f-47cd-a09a-8e5e98b062c2 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:25.050366 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cc71481f-c40f-47cd-a09a-8e5e98b062c2 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:25.051207 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cc71481f-c40f-47cd-a09a-8e5e98b062c2 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:25.051794 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cc71481f-c40f-47cd-a09a-8e5e98b062c2 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:25.052336 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cc71481f-c40f-47cd-a09a-8e5e98b062c2 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:25.102090 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-ecd1e87f-7b50-4e07-a60c-ae6d545afda7 req-6f34f77f-ed8c-494a-9115-3ce9092348df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a830928-6d51-4dbd-97ad-8cca44de3770", "tag": "9779d73d-72bb-47da-820f-5576b587d824"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:40:25.124550 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-ecd1e87f-7b50-4e07-a60c-ae6d545afda7 req-6f34f77f-ed8c-494a-9115-3ce9092348df service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:25.126406 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-ecd1e87f-7b50-4e07-a60c-ae6d545afda7 req-6f34f77f-ed8c-494a-9115-3ce9092348df service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:25.132564 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-ecd1e87f-7b50-4e07-a60c-ae6d545afda7 req-6f34f77f-ed8c-494a-9115-3ce9092348df service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:25.157475 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-ecd1e87f-7b50-4e07-a60c-ae6d545afda7 req-6f34f77f-ed8c-494a-9115-3ce9092348df service nova] Creating event network-changed:9779d73d-72bb-47da-820f-5576b587d824 for instance 5a830928-6d51-4dbd-97ad-8cca44de3770 on n-h1-861333-8 Oct 19 03:40:25.166993 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-ecd1e87f-7b50-4e07-a60c-ae6d545afda7 req-6f34f77f-ed8c-494a-9115-3ce9092348df service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069220 Oct 19 03:40:25.168298 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2792/5499] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:40:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:40:25.451816 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-cc71481f-c40f-47cd-a09a-8e5e98b062c2 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4729a0afd69480f99642266e0eec17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce5e9f9a4644b27a24b2f4c06df97bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:40:25.461223 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-cc71481f-c40f-47cd-a09a-8e5e98b062c2 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/4fab83b8-8862-4295-adb7-e2bf5462a2d9" status: 200 len: 1688 microversion: 2.1 time: 0.428366 Oct 19 03:40:25.461854 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2708/5500] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:40:25 2022] GET /compute/v2.1/servers/4fab83b8-8862-4295-adb7-e2bf5462a2d9 => generated 1688 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:40:25.593677 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-33ffd5a4-9f37-464c-b495-7eda3ea37fae tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:25.594421 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-33ffd5a4-9f37-464c-b495-7eda3ea37fae tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 7e633743-2b38-4c08-be9e-fdfde600b48b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:25.603790 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-33ffd5a4-9f37-464c-b495-7eda3ea37fae tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:25.605850 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-33ffd5a4-9f37-464c-b495-7eda3ea37fae tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:25.607755 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-33ffd5a4-9f37-464c-b495-7eda3ea37fae tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:25.612570 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-33ffd5a4-9f37-464c-b495-7eda3ea37fae tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:25.613420 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-33ffd5a4-9f37-464c-b495-7eda3ea37fae tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:25.614088 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-33ffd5a4-9f37-464c-b495-7eda3ea37fae tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:25.616255 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ca96c71f-e486-4588-9329-cb42f67b6cc4 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:25.617429 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ca96c71f-e486-4588-9329-cb42f67b6cc4 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] [instance: eff2dc27-f6d3-41b6-96ac-c964b1d07419] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:25.626398 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ca96c71f-e486-4588-9329-cb42f67b6cc4 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:25.639694 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ca96c71f-e486-4588-9329-cb42f67b6cc4 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:25.641082 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ca96c71f-e486-4588-9329-cb42f67b6cc4 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:25.643126 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ca96c71f-e486-4588-9329-cb42f67b6cc4 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:25.647129 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ca96c71f-e486-4588-9329-cb42f67b6cc4 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:25.647129 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ca96c71f-e486-4588-9329-cb42f67b6cc4 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:25.968505 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-33ffd5a4-9f37-464c-b495-7eda3ea37fae tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:40:25.980323 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-33ffd5a4-9f37-464c-b495-7eda3ea37fae tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b" status: 200 len: 1508 microversion: 2.1 time: 0.391932 Oct 19 03:40:26.001994 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2793/5501] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:40:25 2022] GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b => generated 1508 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:40:26.007383 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f43e01ea-9c6a-4d3c-b4a8-1ef675631506 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:26.008014 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f43e01ea-9c6a-4d3c-b4a8-1ef675631506 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:26.018960 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ca96c71f-e486-4588-9329-cb42f67b6cc4 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4670fd4408d4454784251a880d5a72f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf91777fa414ddaa797d735e7d2a275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:40:26.029941 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f43e01ea-9c6a-4d3c-b4a8-1ef675631506 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:26.031279 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f43e01ea-9c6a-4d3c-b4a8-1ef675631506 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:26.032098 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f43e01ea-9c6a-4d3c-b4a8-1ef675631506 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:26.033109 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f43e01ea-9c6a-4d3c-b4a8-1ef675631506 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:26.035000 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ca96c71f-e486-4588-9329-cb42f67b6cc4 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] 10.222.0.52 "GET /compute/v2.1/servers/eff2dc27-f6d3-41b6-96ac-c964b1d07419" status: 200 len: 1374 microversion: 2.1 time: 0.422775 Oct 19 03:40:26.037459 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f43e01ea-9c6a-4d3c-b4a8-1ef675631506 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:26.038127 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f43e01ea-9c6a-4d3c-b4a8-1ef675631506 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:26.065716 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2709/5502] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:40:25 2022] GET /compute/v2.1/servers/eff2dc27-f6d3-41b6-96ac-c964b1d07419 => generated 1374 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:40:26.485033 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f43e01ea-9c6a-4d3c-b4a8-1ef675631506 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:40:26.492051 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a0c12603-3c80-4ffa-98b4-8adcf8c44446 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:26.492692 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a0c12603-3c80-4ffa-98b4-8adcf8c44446 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 4fab83b8-8862-4295-adb7-e2bf5462a2d9] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:26.498270 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f43e01ea-9c6a-4d3c-b4a8-1ef675631506 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1519 microversion: 2.1 time: 0.495038 Oct 19 03:40:26.503346 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2794/5503] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:40:26 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1519 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:40:26.506706 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a0c12603-3c80-4ffa-98b4-8adcf8c44446 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:26.507213 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a0c12603-3c80-4ffa-98b4-8adcf8c44446 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:26.507722 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a0c12603-3c80-4ffa-98b4-8adcf8c44446 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:26.510014 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a0c12603-3c80-4ffa-98b4-8adcf8c44446 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:26.510493 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a0c12603-3c80-4ffa-98b4-8adcf8c44446 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:26.510936 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a0c12603-3c80-4ffa-98b4-8adcf8c44446 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:26.809892 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a0c12603-3c80-4ffa-98b4-8adcf8c44446 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4729a0afd69480f99642266e0eec17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce5e9f9a4644b27a24b2f4c06df97bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:40:26.822900 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a0c12603-3c80-4ffa-98b4-8adcf8c44446 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/4fab83b8-8862-4295-adb7-e2bf5462a2d9" status: 200 len: 1688 microversion: 2.1 time: 0.335764 Oct 19 03:40:26.830814 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2710/5504] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:40:26 2022] GET /compute/v2.1/servers/4fab83b8-8862-4295-adb7-e2bf5462a2d9 => generated 1688 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:40:27.010118 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b0e5fc11-fd27-4f1f-96c7-038a4409237e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:27.010118 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b0e5fc11-fd27-4f1f-96c7-038a4409237e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 7e633743-2b38-4c08-be9e-fdfde600b48b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:27.019231 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b0e5fc11-fd27-4f1f-96c7-038a4409237e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:27.023781 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b0e5fc11-fd27-4f1f-96c7-038a4409237e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:27.024371 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b0e5fc11-fd27-4f1f-96c7-038a4409237e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:27.025240 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b0e5fc11-fd27-4f1f-96c7-038a4409237e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:27.025822 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b0e5fc11-fd27-4f1f-96c7-038a4409237e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:27.026329 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b0e5fc11-fd27-4f1f-96c7-038a4409237e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:27.063483 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-71872b30-33c9-4c97-b927-1f99848c10a5 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:27.064117 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-71872b30-33c9-4c97-b927-1f99848c10a5 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] [instance: eff2dc27-f6d3-41b6-96ac-c964b1d07419] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:27.074067 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-71872b30-33c9-4c97-b927-1f99848c10a5 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:27.074586 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-71872b30-33c9-4c97-b927-1f99848c10a5 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:27.075040 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-71872b30-33c9-4c97-b927-1f99848c10a5 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:27.080386 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-71872b30-33c9-4c97-b927-1f99848c10a5 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:27.082849 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-71872b30-33c9-4c97-b927-1f99848c10a5 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:27.083318 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-71872b30-33c9-4c97-b927-1f99848c10a5 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:27.181871 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:40:27.829727 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-71872b30-33c9-4c97-b927-1f99848c10a5 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4670fd4408d4454784251a880d5a72f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf91777fa414ddaa797d735e7d2a275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:40:27.843078 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-71872b30-33c9-4c97-b927-1f99848c10a5 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] 10.222.0.52 "GET /compute/v2.1/servers/eff2dc27-f6d3-41b6-96ac-c964b1d07419" status: 200 len: 1374 microversion: 2.1 time: 0.783580 Oct 19 03:40:27.847923 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2711/5505] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:40:27 2022] GET /compute/v2.1/servers/eff2dc27-f6d3-41b6-96ac-c964b1d07419 => generated 1374 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:40:27.859887 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b0e5fc11-fd27-4f1f-96c7-038a4409237e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:40:27.860273 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-095f9559-cae8-4b9a-9add-b59693bfd8d0 req-56c39157-e9ff-453f-87a6-0f050588e276 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eff2dc27-f6d3-41b6-96ac-c964b1d07419", "tag": "b34422b6-02a3-46a0-bf74-de756bcea9cb"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:40:27.872406 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-095f9559-cae8-4b9a-9add-b59693bfd8d0 req-56c39157-e9ff-453f-87a6-0f050588e276 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:27.872906 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-095f9559-cae8-4b9a-9add-b59693bfd8d0 req-56c39157-e9ff-453f-87a6-0f050588e276 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:27.873347 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-095f9559-cae8-4b9a-9add-b59693bfd8d0 req-56c39157-e9ff-453f-87a6-0f050588e276 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:27.877742 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:40:27.883146 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b0e5fc11-fd27-4f1f-96c7-038a4409237e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b" status: 200 len: 1508 microversion: 2.1 time: 0.878026 Oct 19 03:40:27.893489 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2795/5506] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:40:27 2022] GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b => generated 1508 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:40:27.893489 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3f516ad6-ff1b-44bf-a416-b41b1f09da17 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:27.893489 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-3f516ad6-ff1b-44bf-a416-b41b1f09da17 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:27.903348 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3f516ad6-ff1b-44bf-a416-b41b1f09da17 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:27.903348 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3f516ad6-ff1b-44bf-a416-b41b1f09da17 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:27.903348 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3f516ad6-ff1b-44bf-a416-b41b1f09da17 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:27.903348 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3f516ad6-ff1b-44bf-a416-b41b1f09da17 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:27.903348 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3f516ad6-ff1b-44bf-a416-b41b1f09da17 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:27.906045 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-095f9559-cae8-4b9a-9add-b59693bfd8d0 req-56c39157-e9ff-453f-87a6-0f050588e276 service nova] Creating event network-changed:b34422b6-02a3-46a0-bf74-de756bcea9cb for instance eff2dc27-f6d3-41b6-96ac-c964b1d07419 on n-h2-861333-8 Oct 19 03:40:27.910029 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3f516ad6-ff1b-44bf-a416-b41b1f09da17 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:27.928657 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-095f9559-cae8-4b9a-9add-b59693bfd8d0 req-56c39157-e9ff-453f-87a6-0f050588e276 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074650 Oct 19 03:40:27.929735 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2712/5507] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:40:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:40:27.956488 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-edbc25cb-bab4-4d90-a48b-df32c4fe23af tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:27.957638 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-edbc25cb-bab4-4d90-a48b-df32c4fe23af tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 4fab83b8-8862-4295-adb7-e2bf5462a2d9] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:27.973018 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-edbc25cb-bab4-4d90-a48b-df32c4fe23af tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:27.973968 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-edbc25cb-bab4-4d90-a48b-df32c4fe23af tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:27.974576 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-edbc25cb-bab4-4d90-a48b-df32c4fe23af tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:27.975462 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-edbc25cb-bab4-4d90-a48b-df32c4fe23af tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:27.976074 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-edbc25cb-bab4-4d90-a48b-df32c4fe23af tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:27.979010 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-edbc25cb-bab4-4d90-a48b-df32c4fe23af tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:28.296768 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=12 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:40:28.491322 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-edbc25cb-bab4-4d90-a48b-df32c4fe23af tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4729a0afd69480f99642266e0eec17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce5e9f9a4644b27a24b2f4c06df97bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:40:28.502427 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-edbc25cb-bab4-4d90-a48b-df32c4fe23af tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/4fab83b8-8862-4295-adb7-e2bf5462a2d9" status: 200 len: 1688 microversion: 2.1 time: 0.566205 Oct 19 03:40:28.503221 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2713/5508] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:40:27 2022] GET /compute/v2.1/servers/4fab83b8-8862-4295-adb7-e2bf5462a2d9 => generated 1688 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:40:28.516255 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-3f516ad6-ff1b-44bf-a416-b41b1f09da17 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:40:28.525987 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-3f516ad6-ff1b-44bf-a416-b41b1f09da17 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1519 microversion: 2.1 time: 0.640466 Oct 19 03:40:28.527192 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2796/5509] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:40:27 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1519 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:40:28.868041 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7e5f4603-849b-4ea7-893c-587a9e99d388 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:28.868653 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7e5f4603-849b-4ea7-893c-587a9e99d388 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] [instance: eff2dc27-f6d3-41b6-96ac-c964b1d07419] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:28.877347 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7e5f4603-849b-4ea7-893c-587a9e99d388 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:28.878600 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7e5f4603-849b-4ea7-893c-587a9e99d388 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:28.879583 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7e5f4603-849b-4ea7-893c-587a9e99d388 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:28.882118 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7e5f4603-849b-4ea7-893c-587a9e99d388 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:28.882767 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7e5f4603-849b-4ea7-893c-587a9e99d388 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:28.883356 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7e5f4603-849b-4ea7-893c-587a9e99d388 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:28.911635 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1d7a131d-85f6-4ded-9b94-7c2d38cb1611 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:28.912193 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1d7a131d-85f6-4ded-9b94-7c2d38cb1611 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 7e633743-2b38-4c08-be9e-fdfde600b48b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:28.921201 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1d7a131d-85f6-4ded-9b94-7c2d38cb1611 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:28.921735 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1d7a131d-85f6-4ded-9b94-7c2d38cb1611 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:28.929962 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1d7a131d-85f6-4ded-9b94-7c2d38cb1611 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:28.930896 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1d7a131d-85f6-4ded-9b94-7c2d38cb1611 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:28.931530 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1d7a131d-85f6-4ded-9b94-7c2d38cb1611 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:28.934737 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1d7a131d-85f6-4ded-9b94-7c2d38cb1611 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:29.338203 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-7e5f4603-849b-4ea7-893c-587a9e99d388 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4670fd4408d4454784251a880d5a72f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf91777fa414ddaa797d735e7d2a275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:40:29.357607 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7e5f4603-849b-4ea7-893c-587a9e99d388 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] 10.222.0.52 "GET /compute/v2.1/servers/eff2dc27-f6d3-41b6-96ac-c964b1d07419" status: 200 len: 1374 microversion: 2.1 time: 0.493099 Oct 19 03:40:29.363203 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-1d7a131d-85f6-4ded-9b94-7c2d38cb1611 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:40:29.376545 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2714/5510] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:40:28 2022] GET /compute/v2.1/servers/eff2dc27-f6d3-41b6-96ac-c964b1d07419 => generated 1374 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:40:29.380518 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1d7a131d-85f6-4ded-9b94-7c2d38cb1611 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b" status: 200 len: 1508 microversion: 2.1 time: 0.472739 Oct 19 03:40:29.399466 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2797/5511] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:40:28 2022] GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b => generated 1508 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:40:29.527679 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d9f64616-e23d-405b-9d26-66dcb09d8929 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:29.529116 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d9f64616-e23d-405b-9d26-66dcb09d8929 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 4fab83b8-8862-4295-adb7-e2bf5462a2d9] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:29.545037 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d9f64616-e23d-405b-9d26-66dcb09d8929 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:29.546224 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d9f64616-e23d-405b-9d26-66dcb09d8929 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:29.547625 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d9f64616-e23d-405b-9d26-66dcb09d8929 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:29.549809 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d9f64616-e23d-405b-9d26-66dcb09d8929 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:29.549809 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d9f64616-e23d-405b-9d26-66dcb09d8929 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:29.555432 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6972a781-5cca-4974-bc5c-da937fd2b034 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:29.556214 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6972a781-5cca-4974-bc5c-da937fd2b034 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:29.564319 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d9f64616-e23d-405b-9d26-66dcb09d8929 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:29.570202 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6972a781-5cca-4974-bc5c-da937fd2b034 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:29.570877 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6972a781-5cca-4974-bc5c-da937fd2b034 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:29.574323 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6972a781-5cca-4974-bc5c-da937fd2b034 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:29.576496 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6972a781-5cca-4974-bc5c-da937fd2b034 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:29.577620 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6972a781-5cca-4974-bc5c-da937fd2b034 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:29.579720 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6972a781-5cca-4974-bc5c-da937fd2b034 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:29.639091 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:40:30.112240 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d9f64616-e23d-405b-9d26-66dcb09d8929 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4729a0afd69480f99642266e0eec17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce5e9f9a4644b27a24b2f4c06df97bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:40:30.117638 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-6972a781-5cca-4974-bc5c-da937fd2b034 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:40:30.138324 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6972a781-5cca-4974-bc5c-da937fd2b034 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1519 microversion: 2.1 time: 0.585958 Oct 19 03:40:30.138949 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2798/5512] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:40:29 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1519 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:40:30.140407 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d9f64616-e23d-405b-9d26-66dcb09d8929 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/4fab83b8-8862-4295-adb7-e2bf5462a2d9" status: 200 len: 1688 microversion: 2.1 time: 0.618021 Oct 19 03:40:30.147998 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2715/5513] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:40:29 2022] GET /compute/v2.1/servers/4fab83b8-8862-4295-adb7-e2bf5462a2d9 => generated 1688 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:40:30.383236 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-dbeee605-ece7-4179-b4ed-e0cd4f036241 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:30.388103 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-dbeee605-ece7-4179-b4ed-e0cd4f036241 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] [instance: eff2dc27-f6d3-41b6-96ac-c964b1d07419] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:30.393834 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dbeee605-ece7-4179-b4ed-e0cd4f036241 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:30.398196 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dbeee605-ece7-4179-b4ed-e0cd4f036241 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:30.405882 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-006a5ec9-9c42-4644-b3df-39cca1181f4d tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:30.406732 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-006a5ec9-9c42-4644-b3df-39cca1181f4d tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 7e633743-2b38-4c08-be9e-fdfde600b48b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:30.411799 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dbeee605-ece7-4179-b4ed-e0cd4f036241 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:30.418071 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dbeee605-ece7-4179-b4ed-e0cd4f036241 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:30.418239 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dbeee605-ece7-4179-b4ed-e0cd4f036241 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:30.418718 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dbeee605-ece7-4179-b4ed-e0cd4f036241 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:30.425860 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-006a5ec9-9c42-4644-b3df-39cca1181f4d tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:30.430667 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-006a5ec9-9c42-4644-b3df-39cca1181f4d tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:30.430667 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-006a5ec9-9c42-4644-b3df-39cca1181f4d tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:30.430667 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-006a5ec9-9c42-4644-b3df-39cca1181f4d tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:30.430667 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-006a5ec9-9c42-4644-b3df-39cca1181f4d tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:30.432034 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-006a5ec9-9c42-4644-b3df-39cca1181f4d tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:30.978277 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-dbeee605-ece7-4179-b4ed-e0cd4f036241 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4670fd4408d4454784251a880d5a72f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf91777fa414ddaa797d735e7d2a275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:40:30.992184 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-dbeee605-ece7-4179-b4ed-e0cd4f036241 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] 10.222.0.52 "GET /compute/v2.1/servers/eff2dc27-f6d3-41b6-96ac-c964b1d07419" status: 200 len: 1374 microversion: 2.1 time: 0.612832 Oct 19 03:40:30.993635 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2799/5514] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:40:30 2022] GET /compute/v2.1/servers/eff2dc27-f6d3-41b6-96ac-c964b1d07419 => generated 1374 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:40:31.035391 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-006a5ec9-9c42-4644-b3df-39cca1181f4d tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:40:31.053353 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-006a5ec9-9c42-4644-b3df-39cca1181f4d tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b" status: 200 len: 1508 microversion: 2.1 time: 0.651772 Oct 19 03:40:31.054758 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2716/5515] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:40:30 2022] GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b => generated 1508 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:40:31.179889 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-93fbf1c7-b534-4ede-b32f-fffc84a5b01d tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:31.185480 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-68b54289-f494-4ac4-b016-044e836c150e tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:31.186240 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-93fbf1c7-b534-4ede-b32f-fffc84a5b01d tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 4fab83b8-8862-4295-adb7-e2bf5462a2d9] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:31.187705 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-68b54289-f494-4ac4-b016-044e836c150e tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:31.211421 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-93fbf1c7-b534-4ede-b32f-fffc84a5b01d tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:31.214707 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-68b54289-f494-4ac4-b016-044e836c150e tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:31.215871 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-93fbf1c7-b534-4ede-b32f-fffc84a5b01d tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:31.216580 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-68b54289-f494-4ac4-b016-044e836c150e tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:31.218322 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-68b54289-f494-4ac4-b016-044e836c150e tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:31.219491 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-93fbf1c7-b534-4ede-b32f-fffc84a5b01d tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:31.220399 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-68b54289-f494-4ac4-b016-044e836c150e tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:31.221171 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-93fbf1c7-b534-4ede-b32f-fffc84a5b01d tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:31.221873 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-68b54289-f494-4ac4-b016-044e836c150e tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:31.222460 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-93fbf1c7-b534-4ede-b32f-fffc84a5b01d tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:31.223022 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-68b54289-f494-4ac4-b016-044e836c150e tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:31.223565 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-93fbf1c7-b534-4ede-b32f-fffc84a5b01d tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:32.000376 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-93fbf1c7-b534-4ede-b32f-fffc84a5b01d tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4729a0afd69480f99642266e0eec17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce5e9f9a4644b27a24b2f4c06df97bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:40:32.010497 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-93fbf1c7-b534-4ede-b32f-fffc84a5b01d tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/4fab83b8-8862-4295-adb7-e2bf5462a2d9" status: 200 len: 1621 microversion: 2.1 time: 0.845241 Oct 19 03:40:32.026627 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2717/5516] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:40:31 2022] GET /compute/v2.1/servers/4fab83b8-8862-4295-adb7-e2bf5462a2d9 => generated 1621 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:40:32.044698 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-206517ca-1604-446a-9572-9128fafe2a4e req-fe39b4bd-bc85-47cb-8a2f-7f85197e71c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fab83b8-8862-4295-adb7-e2bf5462a2d9", "name": "network-vif-deleted", "tag": "277d3b94-8060-453a-baed-babf7a3dbed3"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:40:32.070394 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-206517ca-1604-446a-9572-9128fafe2a4e req-fe39b4bd-bc85-47cb-8a2f-7f85197e71c3 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:32.073721 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-206517ca-1604-446a-9572-9128fafe2a4e req-fe39b4bd-bc85-47cb-8a2f-7f85197e71c3 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:32.075443 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-206517ca-1604-446a-9572-9128fafe2a4e req-fe39b4bd-bc85-47cb-8a2f-7f85197e71c3 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:32.111427 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-206517ca-1604-446a-9572-9128fafe2a4e req-fe39b4bd-bc85-47cb-8a2f-7f85197e71c3 service nova] Creating event network-vif-deleted:277d3b94-8060-453a-baed-babf7a3dbed3 for instance 4fab83b8-8862-4295-adb7-e2bf5462a2d9 on n-h1-861333-8 Oct 19 03:40:32.127514 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-206517ca-1604-446a-9572-9128fafe2a4e req-fe39b4bd-bc85-47cb-8a2f-7f85197e71c3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099365 Oct 19 03:40:32.129686 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2718/5517] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:40:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:40:32.144443 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5aae86e7-a2b3-423b-9aa1-d187aecde6d4 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:32.146284 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5aae86e7-a2b3-423b-9aa1-d187aecde6d4 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] [instance: 1f354001-86ee-4951-a9cb-23fcd9e678a9] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:32.161670 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5aae86e7-a2b3-423b-9aa1-d187aecde6d4 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:32.162461 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5aae86e7-a2b3-423b-9aa1-d187aecde6d4 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:32.163067 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5aae86e7-a2b3-423b-9aa1-d187aecde6d4 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:32.166767 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5aae86e7-a2b3-423b-9aa1-d187aecde6d4 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:32.168733 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5aae86e7-a2b3-423b-9aa1-d187aecde6d4 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:32.171509 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5aae86e7-a2b3-423b-9aa1-d187aecde6d4 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:32.231751 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5aae86e7-a2b3-423b-9aa1-d187aecde6d4 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] 10.222.0.52 "GET /compute/v2.1/servers/1f354001-86ee-4951-a9cb-23fcd9e678a9/os-volume_attachments/29eb064c-89a5-4b55-904f-5e6b2ff76d3a" status: 200 len: 194 microversion: 2.1 time: 0.100526 Oct 19 03:40:32.240388 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2719/5518] 10.222.0.52 () {58 vars in 1413 bytes} [Wed Oct 19 03:40:32 2022] GET /compute/v2.1/servers/1f354001-86ee-4951-a9cb-23fcd9e678a9/os-volume_attachments/29eb064c-89a5-4b55-904f-5e6b2ff76d3a => generated 194 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:40:32.246252 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-68b54289-f494-4ac4-b016-044e836c150e tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:40:32.263329 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-68b54289-f494-4ac4-b016-044e836c150e tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1519 microversion: 2.1 time: 1.100305 Oct 19 03:40:32.263974 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2800/5519] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:40:31 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1519 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:40:32.269516 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-766dbc48-025f-4e5f-8949-297487a6ef5a tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:32.270364 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-766dbc48-025f-4e5f-8949-297487a6ef5a tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] [instance: eff2dc27-f6d3-41b6-96ac-c964b1d07419] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:32.277564 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-74defe5d-8ccb-4bac-a6b4-c4c1b100c2e1 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:32.278199 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-74defe5d-8ccb-4bac-a6b4-c4c1b100c2e1 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 7e633743-2b38-4c08-be9e-fdfde600b48b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:32.291428 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-766dbc48-025f-4e5f-8949-297487a6ef5a tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:32.292001 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-766dbc48-025f-4e5f-8949-297487a6ef5a tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:32.292371 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-766dbc48-025f-4e5f-8949-297487a6ef5a tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:32.293088 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-766dbc48-025f-4e5f-8949-297487a6ef5a tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:32.293586 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-766dbc48-025f-4e5f-8949-297487a6ef5a tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:32.294022 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-766dbc48-025f-4e5f-8949-297487a6ef5a tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:32.309018 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-74defe5d-8ccb-4bac-a6b4-c4c1b100c2e1 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:32.309565 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-74defe5d-8ccb-4bac-a6b4-c4c1b100c2e1 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:32.310017 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-74defe5d-8ccb-4bac-a6b4-c4c1b100c2e1 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:32.310733 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-74defe5d-8ccb-4bac-a6b4-c4c1b100c2e1 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:32.311808 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-74defe5d-8ccb-4bac-a6b4-c4c1b100c2e1 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:32.312247 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-74defe5d-8ccb-4bac-a6b4-c4c1b100c2e1 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:33.083682 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-766dbc48-025f-4e5f-8949-297487a6ef5a tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4670fd4408d4454784251a880d5a72f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf91777fa414ddaa797d735e7d2a275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:40:33.147449 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-766dbc48-025f-4e5f-8949-297487a6ef5a tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] 10.222.0.52 "GET /compute/v2.1/servers/eff2dc27-f6d3-41b6-96ac-c964b1d07419" status: 200 len: 1374 microversion: 2.1 time: 0.905527 Oct 19 03:40:33.175495 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2720/5520] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:40:32 2022] GET /compute/v2.1/servers/eff2dc27-f6d3-41b6-96ac-c964b1d07419 => generated 1374 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:40:33.197163 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8a84abdb-ca5b-4f31-bb55-27a8ff0fe19e tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:33.199663 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8a84abdb-ca5b-4f31-bb55-27a8ff0fe19e tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] [instance: 1f354001-86ee-4951-a9cb-23fcd9e678a9] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:33.231573 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8a84abdb-ca5b-4f31-bb55-27a8ff0fe19e tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:33.235722 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8a84abdb-ca5b-4f31-bb55-27a8ff0fe19e tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:33.242910 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8a84abdb-ca5b-4f31-bb55-27a8ff0fe19e tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:33.242910 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8a84abdb-ca5b-4f31-bb55-27a8ff0fe19e tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:33.242910 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8a84abdb-ca5b-4f31-bb55-27a8ff0fe19e tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:33.247557 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8a84abdb-ca5b-4f31-bb55-27a8ff0fe19e tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:33.401416 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-74defe5d-8ccb-4bac-a6b4-c4c1b100c2e1 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:40:33.422469 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-74defe5d-8ccb-4bac-a6b4-c4c1b100c2e1 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b" status: 200 len: 1508 microversion: 2.1 time: 1.146939 Oct 19 03:40:33.429305 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2801/5521] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:40:32 2022] GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b => generated 1508 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:40:33.437462 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-8bf9b77e-fa69-4f6d-9c6a-46d80ef02122 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:33.444769 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-8bf9b77e-fa69-4f6d-9c6a-46d80ef02122 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 4fab83b8-8862-4295-adb7-e2bf5462a2d9] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:33.466144 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8bf9b77e-fa69-4f6d-9c6a-46d80ef02122 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:33.471345 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8bf9b77e-fa69-4f6d-9c6a-46d80ef02122 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:33.476536 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8bf9b77e-fa69-4f6d-9c6a-46d80ef02122 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:33.481847 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8bf9b77e-fa69-4f6d-9c6a-46d80ef02122 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:33.482630 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8bf9b77e-fa69-4f6d-9c6a-46d80ef02122 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:33.487454 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8bf9b77e-fa69-4f6d-9c6a-46d80ef02122 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:33.541399 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-8a84abdb-ca5b-4f31-bb55-27a8ff0fe19e tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lazy-loading 'services' on Instance uuid 1f354001-86ee-4951-a9cb-23fcd9e678a9 {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:40:33.572544 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8bf9b77e-fa69-4f6d-9c6a-46d80ef02122 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:33.576293 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8bf9b77e-fa69-4f6d-9c6a-46d80ef02122 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:33.576997 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8bf9b77e-fa69-4f6d-9c6a-46d80ef02122 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:33.577661 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-8bf9b77e-fa69-4f6d-9c6a-46d80ef02122 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lazy-loading 'fault' on Instance uuid 4fab83b8-8862-4295-adb7-e2bf5462a2d9 {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:40:33.682393 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-8bf9b77e-fa69-4f6d-9c6a-46d80ef02122 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4729a0afd69480f99642266e0eec17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce5e9f9a4644b27a24b2f4c06df97bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:40:33.694128 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-8bf9b77e-fa69-4f6d-9c6a-46d80ef02122 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/4fab83b8-8862-4295-adb7-e2bf5462a2d9" status: 200 len: 1335 microversion: 2.1 time: 0.260467 Oct 19 03:40:33.712548 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2802/5522] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:40:33 2022] GET /compute/v2.1/servers/4fab83b8-8862-4295-adb7-e2bf5462a2d9 => generated 1335 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:40:33.723149 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e2cd7807-8e53-4adb-97be-df0b4d890fd5 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:33.725530 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e2cd7807-8e53-4adb-97be-df0b4d890fd5 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:33.735136 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e2cd7807-8e53-4adb-97be-df0b4d890fd5 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:33.735910 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e2cd7807-8e53-4adb-97be-df0b4d890fd5 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:33.736528 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e2cd7807-8e53-4adb-97be-df0b4d890fd5 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:33.738132 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e2cd7807-8e53-4adb-97be-df0b4d890fd5 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:33.739127 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e2cd7807-8e53-4adb-97be-df0b4d890fd5 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:33.739759 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e2cd7807-8e53-4adb-97be-df0b4d890fd5 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:33.987711 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-e2cd7807-8e53-4adb-97be-df0b4d890fd5 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:40:34.004714 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e2cd7807-8e53-4adb-97be-df0b4d890fd5 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1519 microversion: 2.1 time: 0.290337 Oct 19 03:40:34.006862 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2803/5523] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:40:33 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1519 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:40:34.034123 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8a84abdb-ca5b-4f31-bb55-27a8ff0fe19e tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1f354001-86ee-4951-a9cb-23fcd9e678a9/os-volume_attachments/29eb064c-89a5-4b55-904f-5e6b2ff76d3a" status: 202 len: 0 microversion: 2.1 time: 0.856056 Oct 19 03:40:34.035827 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2721/5524] 10.222.0.52 () {58 vars in 1416 bytes} [Wed Oct 19 03:40:33 2022] DELETE /compute/v2.1/servers/1f354001-86ee-4951-a9cb-23fcd9e678a9/os-volume_attachments/29eb064c-89a5-4b55-904f-5e6b2ff76d3a => generated 0 bytes in 859 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:40:34.182129 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-8498ce6b-a4fb-45f4-9282-7d91071cc5b7 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:34.183722 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-8498ce6b-a4fb-45f4-9282-7d91071cc5b7 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] [instance: eff2dc27-f6d3-41b6-96ac-c964b1d07419] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:34.204536 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8498ce6b-a4fb-45f4-9282-7d91071cc5b7 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:34.205219 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8498ce6b-a4fb-45f4-9282-7d91071cc5b7 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:34.212402 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8498ce6b-a4fb-45f4-9282-7d91071cc5b7 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:34.212402 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8498ce6b-a4fb-45f4-9282-7d91071cc5b7 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:34.212402 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8498ce6b-a4fb-45f4-9282-7d91071cc5b7 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:34.212402 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8498ce6b-a4fb-45f4-9282-7d91071cc5b7 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:34.461082 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0c15c33b-d6f4-4817-b9b7-f618adf02970 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:34.464030 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0c15c33b-d6f4-4817-b9b7-f618adf02970 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 7e633743-2b38-4c08-be9e-fdfde600b48b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:34.484438 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0c15c33b-d6f4-4817-b9b7-f618adf02970 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:34.485190 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0c15c33b-d6f4-4817-b9b7-f618adf02970 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:34.486115 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0c15c33b-d6f4-4817-b9b7-f618adf02970 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:34.487612 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0c15c33b-d6f4-4817-b9b7-f618adf02970 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:34.488476 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0c15c33b-d6f4-4817-b9b7-f618adf02970 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:34.489071 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0c15c33b-d6f4-4817-b9b7-f618adf02970 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:34.597279 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-8498ce6b-a4fb-45f4-9282-7d91071cc5b7 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4670fd4408d4454784251a880d5a72f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf91777fa414ddaa797d735e7d2a275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:40:34.605660 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-8498ce6b-a4fb-45f4-9282-7d91071cc5b7 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] 10.222.0.52 "GET /compute/v2.1/servers/eff2dc27-f6d3-41b6-96ac-c964b1d07419" status: 200 len: 1374 microversion: 2.1 time: 0.427316 Oct 19 03:40:34.621458 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2804/5525] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:40:34 2022] GET /compute/v2.1/servers/eff2dc27-f6d3-41b6-96ac-c964b1d07419 => generated 1374 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:40:34.732765 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-57669f62-feee-47e4-8d28-57fdf6fb4d27 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:34.732765 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-57669f62-feee-47e4-8d28-57fdf6fb4d27 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 4fab83b8-8862-4295-adb7-e2bf5462a2d9] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:34.739074 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-57669f62-feee-47e4-8d28-57fdf6fb4d27 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:34.739585 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-57669f62-feee-47e4-8d28-57fdf6fb4d27 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:34.740037 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-57669f62-feee-47e4-8d28-57fdf6fb4d27 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:34.740841 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-57669f62-feee-47e4-8d28-57fdf6fb4d27 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:34.741224 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-57669f62-feee-47e4-8d28-57fdf6fb4d27 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:34.741701 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-57669f62-feee-47e4-8d28-57fdf6fb4d27 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:34.765015 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-57669f62-feee-47e4-8d28-57fdf6fb4d27 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] HTTP exception thrown: Instance 4fab83b8-8862-4295-adb7-e2bf5462a2d9 could not be found. Oct 19 03:40:34.768727 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-57669f62-feee-47e4-8d28-57fdf6fb4d27 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Request method failure captured: Oct 19 03:40:34.768727 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/4fab83b8-8862-4295-adb7-e2bf5462a2d9 HTTP/1.1 Oct 19 03:40:34.768727 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:40:34.768727 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:40:34.768727 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:40:34.768727 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:40:34.768727 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:40:34.768727 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:40:34.768727 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:40:34.768727 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:40:34.768727 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT3BmoEKz0EhW7NaUKeOkQsZRXl8ERfsAKAMxU0GUBdc2f_V_CqkDPpZu62NL2einDTJrDUFbtRF7OMHEg091oC7NSi4gfYN6KT9w4SCkkHNILzmL1G1frQPfKMrDDDqTbb0782yvc_4ZYCpfzt0d6J1jKWlIQL4vx50kauya3LDEzsA Oct 19 03:40:34.768727 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:40:34.768727 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:40:34.768727 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:40:34.768727 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:40:34.768727 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:40:34.768727 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:40:34.768727 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 2ce5e9f9a4644b27a24b2f4c06df97bc Oct 19 03:40:34.768727 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-684190061 Oct 19 03:40:34.768727 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:40:34.768727 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:40:34.768727 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2ce5e9f9a4644b27a24b2f4c06df97bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2ce5e9f9a4644b27a24b2f4c06df97bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2ce5e9f9a4644b27a24b2f4c06df97bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2ce5e9f9a4644b27a24b2f4c06df97bc", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:40:34.768727 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ServerRescueNegativeTestJSON-684190061 Oct 19 03:40:34.768727 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 2ce5e9f9a4644b27a24b2f4c06df97bc Oct 19 03:40:34.768727 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-684190061 Oct 19 03:40:34.768727 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ServerRescueNegativeTestJSON-684190061-project Oct 19 03:40:34.768727 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:40:34.768727 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:40:34.768727 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: b4729a0afd69480f99642266e0eec17e Oct 19 03:40:34.768727 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ServerRescueNegativeTestJSON-684190061-project Oct 19 03:40:34.768727 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:40:34.768727 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance 4fab83b8-8862-4295-adb7-e2bf5462a2d9 could not be found. Oct 19 03:40:34.768727 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '4fab83b8-8862-4295-adb7-e2bf5462a2d9'} Oct 19 03:40:34.768727 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:40:34.768727 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:40:34.768727 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:40:34.768727 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:40:34.768727 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:40:34.768727 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:40:34.768727 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:40:34.768727 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:40:34.768727 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:40:34.768727 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:40:34.768727 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fab83b8-8862-4295-adb7-e2bf5462a2d9 could not be found. Oct 19 03:40:34.768727 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:40:34.768727 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:40:34.768727 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:40:34.768727 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:40:34.768727 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:40:34.768727 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:40:34.768727 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:40:34.768727 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:40:34.768727 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:40:34.768727 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:40:34.768727 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:40:34.768727 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:40:34.768727 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:40:34.768727 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:40:34.768727 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:40:34.768727 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:40:34.768727 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fab83b8-8862-4295-adb7-e2bf5462a2d9 could not be found. Oct 19 03:40:34.768727 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:40:34.768727 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:40:34.772796 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:40:34.772796 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:40:34.772796 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:40:34.772796 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:40:34.772796 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:40:34.772796 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:40:34.772796 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fab83b8-8862-4295-adb7-e2bf5462a2d9 could not be found. Oct 19 03:40:34.772796 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:40:34.772796 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-57669f62-feee-47e4-8d28-57fdf6fb4d27 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Returning 404 to user: Instance 4fab83b8-8862-4295-adb7-e2bf5462a2d9 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:40:34.785851 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-57669f62-feee-47e4-8d28-57fdf6fb4d27 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/4fab83b8-8862-4295-adb7-e2bf5462a2d9" status: 404 len: 111 microversion: 2.1 time: 0.051978 Oct 19 03:40:34.790823 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2805/5526] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:40:34 2022] GET /compute/v2.1/servers/4fab83b8-8862-4295-adb7-e2bf5462a2d9 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 03:40:34.798061 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3e7ac654-d5f7-47f3-8c29-e5fc9c0476b8 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '.version_select at 0x7fc1350c7430>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:34.841813 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:40:34.916289 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-3e7ac654-d5f7-47f3-8c29-e5fc9c0476b8 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1877360926" status: 202 len: 0 microversion: 2.1 time: 0.123926 Oct 19 03:40:34.922761 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2806/5527] 10.222.0.52 () {58 vars in 1221 bytes} [Wed Oct 19 03:40:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1877360926 => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:40:35.033401 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-205f551d-2fca-4866-b0ee-f00ffa7e86db tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:35.034395 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-205f551d-2fca-4866-b0ee-f00ffa7e86db tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:35.051480 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-205f551d-2fca-4866-b0ee-f00ffa7e86db tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:35.052305 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-205f551d-2fca-4866-b0ee-f00ffa7e86db tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:35.053057 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-205f551d-2fca-4866-b0ee-f00ffa7e86db tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:35.054025 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-205f551d-2fca-4866-b0ee-f00ffa7e86db tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:35.054638 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-205f551d-2fca-4866-b0ee-f00ffa7e86db tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:35.055411 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-205f551d-2fca-4866-b0ee-f00ffa7e86db tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:35.064084 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0c15c33b-d6f4-4817-b9b7-f618adf02970 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:40:35.089214 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0c15c33b-d6f4-4817-b9b7-f618adf02970 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b" status: 200 len: 1508 microversion: 2.1 time: 0.636579 Oct 19 03:40:35.095266 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2722/5528] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:40:34 2022] GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b => generated 1508 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:40:35.646372 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-42cff21d-d8c0-4e5d-81e3-c6a333cccfe9 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:35.646980 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-42cff21d-d8c0-4e5d-81e3-c6a333cccfe9 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] [instance: eff2dc27-f6d3-41b6-96ac-c964b1d07419] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:35.660155 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-42cff21d-d8c0-4e5d-81e3-c6a333cccfe9 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:35.660733 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-42cff21d-d8c0-4e5d-81e3-c6a333cccfe9 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:35.670942 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-42cff21d-d8c0-4e5d-81e3-c6a333cccfe9 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:35.670942 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-42cff21d-d8c0-4e5d-81e3-c6a333cccfe9 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:35.670942 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-42cff21d-d8c0-4e5d-81e3-c6a333cccfe9 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:35.676570 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-42cff21d-d8c0-4e5d-81e3-c6a333cccfe9 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:36.019506 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-205f551d-2fca-4866-b0ee-f00ffa7e86db tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:40:36.036165 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-205f551d-2fca-4866-b0ee-f00ffa7e86db tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1519 microversion: 2.1 time: 1.007247 Oct 19 03:40:36.037591 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2807/5529] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:40:35 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1519 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:40:36.101878 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-42cff21d-d8c0-4e5d-81e3-c6a333cccfe9 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4670fd4408d4454784251a880d5a72f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf91777fa414ddaa797d735e7d2a275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:40:36.110909 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-42cff21d-d8c0-4e5d-81e3-c6a333cccfe9 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] 10.222.0.52 "GET /compute/v2.1/servers/eff2dc27-f6d3-41b6-96ac-c964b1d07419" status: 200 len: 1374 microversion: 2.1 time: 0.468810 Oct 19 03:40:36.122623 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2723/5530] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:40:35 2022] GET /compute/v2.1/servers/eff2dc27-f6d3-41b6-96ac-c964b1d07419 => generated 1374 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:40:36.143055 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ef676938-d1b1-4c64-91ad-1aefa72d6063 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:36.144649 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ef676938-d1b1-4c64-91ad-1aefa72d6063 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 7e633743-2b38-4c08-be9e-fdfde600b48b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:36.153476 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ef676938-d1b1-4c64-91ad-1aefa72d6063 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:36.154216 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ef676938-d1b1-4c64-91ad-1aefa72d6063 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:36.155499 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ef676938-d1b1-4c64-91ad-1aefa72d6063 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:36.156389 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ef676938-d1b1-4c64-91ad-1aefa72d6063 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:36.156996 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ef676938-d1b1-4c64-91ad-1aefa72d6063 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:36.157642 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ef676938-d1b1-4c64-91ad-1aefa72d6063 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:36.456750 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ef676938-d1b1-4c64-91ad-1aefa72d6063 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:40:36.466028 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ef676938-d1b1-4c64-91ad-1aefa72d6063 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b" status: 200 len: 1508 microversion: 2.1 time: 0.340398 Oct 19 03:40:36.469030 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2808/5531] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:40:36 2022] GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b => generated 1508 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:40:36.577408 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-9b711022-a13f-4c0d-a01c-76bc3de59556 req-64b443c6-328d-48fa-929a-c5c3d458ac5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eff2dc27-f6d3-41b6-96ac-c964b1d07419", "name": "network-vif-plugged", "status": "completed", "tag": "b34422b6-02a3-46a0-bf74-de756bcea9cb"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:40:36.604622 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-9b711022-a13f-4c0d-a01c-76bc3de59556 req-64b443c6-328d-48fa-929a-c5c3d458ac5c service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:36.610253 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-9b711022-a13f-4c0d-a01c-76bc3de59556 req-64b443c6-328d-48fa-929a-c5c3d458ac5c service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:36.610972 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-9b711022-a13f-4c0d-a01c-76bc3de59556 req-64b443c6-328d-48fa-929a-c5c3d458ac5c service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:36.642854 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-9b711022-a13f-4c0d-a01c-76bc3de59556 req-64b443c6-328d-48fa-929a-c5c3d458ac5c service nova] Creating event network-vif-plugged:b34422b6-02a3-46a0-bf74-de756bcea9cb for instance eff2dc27-f6d3-41b6-96ac-c964b1d07419 on n-h2-861333-8 Oct 19 03:40:36.650305 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-9b711022-a13f-4c0d-a01c-76bc3de59556 req-64b443c6-328d-48fa-929a-c5c3d458ac5c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077669 Oct 19 03:40:36.653925 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2724/5532] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:40:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:40:37.067141 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6ff3c540-fcf0-4eed-ae40-6425b5ad7ec2 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:37.068649 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6ff3c540-fcf0-4eed-ae40-6425b5ad7ec2 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:37.093211 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6ff3c540-fcf0-4eed-ae40-6425b5ad7ec2 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:37.094257 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6ff3c540-fcf0-4eed-ae40-6425b5ad7ec2 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:37.098230 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6ff3c540-fcf0-4eed-ae40-6425b5ad7ec2 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:37.099829 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6ff3c540-fcf0-4eed-ae40-6425b5ad7ec2 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:37.101281 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6ff3c540-fcf0-4eed-ae40-6425b5ad7ec2 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:37.102352 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6ff3c540-fcf0-4eed-ae40-6425b5ad7ec2 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:37.157746 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-257ea84a-c3bc-460f-9a09-11a365d96faf tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:37.159033 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-257ea84a-c3bc-460f-9a09-11a365d96faf tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] [instance: eff2dc27-f6d3-41b6-96ac-c964b1d07419] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:37.186253 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-257ea84a-c3bc-460f-9a09-11a365d96faf tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:37.187058 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-257ea84a-c3bc-460f-9a09-11a365d96faf tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:37.190061 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-257ea84a-c3bc-460f-9a09-11a365d96faf tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:37.191084 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-257ea84a-c3bc-460f-9a09-11a365d96faf tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:37.191624 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-257ea84a-c3bc-460f-9a09-11a365d96faf tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:37.192187 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-257ea84a-c3bc-460f-9a09-11a365d96faf tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:37.463352 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-6ff3c540-fcf0-4eed-ae40-6425b5ad7ec2 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:40:37.472866 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6ff3c540-fcf0-4eed-ae40-6425b5ad7ec2 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1519 microversion: 2.1 time: 0.412939 Oct 19 03:40:37.480601 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2809/5533] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:40:37 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1519 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:40:37.501690 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7f42c806-e211-48df-8f79-6e7c4e48c7aa tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:37.502336 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7f42c806-e211-48df-8f79-6e7c4e48c7aa tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 7e633743-2b38-4c08-be9e-fdfde600b48b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:37.518891 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7f42c806-e211-48df-8f79-6e7c4e48c7aa tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:37.519458 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7f42c806-e211-48df-8f79-6e7c4e48c7aa tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:37.524689 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7f42c806-e211-48df-8f79-6e7c4e48c7aa tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:37.524689 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7f42c806-e211-48df-8f79-6e7c4e48c7aa tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:37.524689 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7f42c806-e211-48df-8f79-6e7c4e48c7aa tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:37.524689 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7f42c806-e211-48df-8f79-6e7c4e48c7aa tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:37.558322 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-257ea84a-c3bc-460f-9a09-11a365d96faf tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4670fd4408d4454784251a880d5a72f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf91777fa414ddaa797d735e7d2a275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:40:37.570975 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-257ea84a-c3bc-460f-9a09-11a365d96faf tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] 10.222.0.52 "GET /compute/v2.1/servers/eff2dc27-f6d3-41b6-96ac-c964b1d07419" status: 200 len: 1374 microversion: 2.1 time: 0.432066 Oct 19 03:40:37.575651 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2725/5534] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:40:37 2022] GET /compute/v2.1/servers/eff2dc27-f6d3-41b6-96ac-c964b1d07419 => generated 1374 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:40:37.804299 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7f42c806-e211-48df-8f79-6e7c4e48c7aa tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:40:37.817054 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7f42c806-e211-48df-8f79-6e7c4e48c7aa tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b" status: 200 len: 1508 microversion: 2.1 time: 0.320516 Oct 19 03:40:37.818058 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2810/5535] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:40:37 2022] GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b => generated 1508 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:40:38.510811 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7c6e51e4-5bbd-4f35-b1c3-613ec5cdb24c tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:38.512213 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7c6e51e4-5bbd-4f35-b1c3-613ec5cdb24c tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:38.536155 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7c6e51e4-5bbd-4f35-b1c3-613ec5cdb24c tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:38.537772 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7c6e51e4-5bbd-4f35-b1c3-613ec5cdb24c tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:38.540304 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7c6e51e4-5bbd-4f35-b1c3-613ec5cdb24c tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:38.561799 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7c6e51e4-5bbd-4f35-b1c3-613ec5cdb24c tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:38.563437 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7c6e51e4-5bbd-4f35-b1c3-613ec5cdb24c tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:38.574975 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7c6e51e4-5bbd-4f35-b1c3-613ec5cdb24c tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:38.601014 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a74b0fbf-cf6e-44d6-a5f1-35d77a28662a tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:38.608494 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a74b0fbf-cf6e-44d6-a5f1-35d77a28662a tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] [instance: eff2dc27-f6d3-41b6-96ac-c964b1d07419] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:38.622274 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a74b0fbf-cf6e-44d6-a5f1-35d77a28662a tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:38.627914 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a74b0fbf-cf6e-44d6-a5f1-35d77a28662a tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:38.636119 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a74b0fbf-cf6e-44d6-a5f1-35d77a28662a tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:38.636119 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a74b0fbf-cf6e-44d6-a5f1-35d77a28662a tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:38.636119 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a74b0fbf-cf6e-44d6-a5f1-35d77a28662a tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:38.636777 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a74b0fbf-cf6e-44d6-a5f1-35d77a28662a tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:39.205191 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-7c6e51e4-5bbd-4f35-b1c3-613ec5cdb24c tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:40:39.222366 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7c6e51e4-5bbd-4f35-b1c3-613ec5cdb24c tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1519 microversion: 2.1 time: 0.716461 Oct 19 03:40:39.225469 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2726/5536] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:40:38 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1519 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:40:39.237245 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a74b0fbf-cf6e-44d6-a5f1-35d77a28662a tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4670fd4408d4454784251a880d5a72f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf91777fa414ddaa797d735e7d2a275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:40:39.246009 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6dfbd005-7d1c-41eb-87f1-8729598fd1a8 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:39.249221 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6dfbd005-7d1c-41eb-87f1-8729598fd1a8 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 7e633743-2b38-4c08-be9e-fdfde600b48b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:39.253924 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a74b0fbf-cf6e-44d6-a5f1-35d77a28662a tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] 10.222.0.52 "GET /compute/v2.1/servers/eff2dc27-f6d3-41b6-96ac-c964b1d07419" status: 200 len: 1546 microversion: 2.1 time: 0.658104 Oct 19 03:40:39.258343 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2811/5537] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:40:38 2022] GET /compute/v2.1/servers/eff2dc27-f6d3-41b6-96ac-c964b1d07419 => generated 1546 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:40:39.275553 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6dfbd005-7d1c-41eb-87f1-8729598fd1a8 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:39.276072 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6dfbd005-7d1c-41eb-87f1-8729598fd1a8 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:39.281035 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6dfbd005-7d1c-41eb-87f1-8729598fd1a8 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:39.292941 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6dfbd005-7d1c-41eb-87f1-8729598fd1a8 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:39.292941 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6dfbd005-7d1c-41eb-87f1-8729598fd1a8 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:39.292941 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6dfbd005-7d1c-41eb-87f1-8729598fd1a8 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:39.293345 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-260d54be-e6f9-4fb0-a0ab-c3a81e404474 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:39.293345 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-260d54be-e6f9-4fb0-a0ab-c3a81e404474 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] [instance: eff2dc27-f6d3-41b6-96ac-c964b1d07419] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:39.310495 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-260d54be-e6f9-4fb0-a0ab-c3a81e404474 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:39.311691 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-260d54be-e6f9-4fb0-a0ab-c3a81e404474 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:39.312150 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-260d54be-e6f9-4fb0-a0ab-c3a81e404474 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:39.317413 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-260d54be-e6f9-4fb0-a0ab-c3a81e404474 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:39.317413 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-260d54be-e6f9-4fb0-a0ab-c3a81e404474 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:39.317413 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-260d54be-e6f9-4fb0-a0ab-c3a81e404474 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:39.732204 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-6dfbd005-7d1c-41eb-87f1-8729598fd1a8 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:40:39.741272 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6dfbd005-7d1c-41eb-87f1-8729598fd1a8 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b" status: 200 len: 1508 microversion: 2.1 time: 0.510761 Oct 19 03:40:39.758125 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2727/5538] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:40:39 2022] GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b => generated 1508 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:40:39.911637 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-260d54be-e6f9-4fb0-a0ab-c3a81e404474 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4670fd4408d4454784251a880d5a72f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf91777fa414ddaa797d735e7d2a275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:40:39.922902 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-260d54be-e6f9-4fb0-a0ab-c3a81e404474 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] 10.222.0.52 "GET /compute/v2.1/servers/eff2dc27-f6d3-41b6-96ac-c964b1d07419" status: 200 len: 1546 microversion: 2.1 time: 0.639128 Oct 19 03:40:39.926007 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2812/5539] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:40:39 2022] GET /compute/v2.1/servers/eff2dc27-f6d3-41b6-96ac-c964b1d07419 => generated 1546 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:40:40.249029 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d57292a2-07fe-4560-8b61-4e283ff480e1 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:40.249953 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d57292a2-07fe-4560-8b61-4e283ff480e1 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:40.259902 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d57292a2-07fe-4560-8b61-4e283ff480e1 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:40.265981 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d57292a2-07fe-4560-8b61-4e283ff480e1 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:40.266652 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d57292a2-07fe-4560-8b61-4e283ff480e1 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:40.267727 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d57292a2-07fe-4560-8b61-4e283ff480e1 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:40.268345 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d57292a2-07fe-4560-8b61-4e283ff480e1 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:40.268950 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d57292a2-07fe-4560-8b61-4e283ff480e1 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:40.745363 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d57292a2-07fe-4560-8b61-4e283ff480e1 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:40:40.772214 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a7a3444d-21cb-496d-9307-2d45a265e450 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:40.774085 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a7a3444d-21cb-496d-9307-2d45a265e450 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 7e633743-2b38-4c08-be9e-fdfde600b48b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:40.785549 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d57292a2-07fe-4560-8b61-4e283ff480e1 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1519 microversion: 2.1 time: 0.535026 Oct 19 03:40:40.796218 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2728/5540] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:40:40 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1519 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:40:40.801226 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a7a3444d-21cb-496d-9307-2d45a265e450 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:40.802065 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a7a3444d-21cb-496d-9307-2d45a265e450 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:40.802970 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a7a3444d-21cb-496d-9307-2d45a265e450 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:40.803906 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a7a3444d-21cb-496d-9307-2d45a265e450 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:40.804563 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a7a3444d-21cb-496d-9307-2d45a265e450 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:40.806257 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a7a3444d-21cb-496d-9307-2d45a265e450 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:41.306162 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a7a3444d-21cb-496d-9307-2d45a265e450 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:40:41.320039 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a7a3444d-21cb-496d-9307-2d45a265e450 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b" status: 200 len: 1508 microversion: 2.1 time: 0.554644 Oct 19 03:40:41.323341 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2813/5541] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:40:40 2022] GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b => generated 1508 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:40:41.823144 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9eebf8a1-db58-406f-ae45-e15e76b0b002 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:41.824780 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9eebf8a1-db58-406f-ae45-e15e76b0b002 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:41.841196 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9eebf8a1-db58-406f-ae45-e15e76b0b002 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:41.842802 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9eebf8a1-db58-406f-ae45-e15e76b0b002 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:41.856869 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9eebf8a1-db58-406f-ae45-e15e76b0b002 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:41.858813 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9eebf8a1-db58-406f-ae45-e15e76b0b002 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:41.861926 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9eebf8a1-db58-406f-ae45-e15e76b0b002 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:41.863366 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9eebf8a1-db58-406f-ae45-e15e76b0b002 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:42.366106 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0085a251-fe0b-4a3c-9955-55368ed432c8 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:42.366644 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0085a251-fe0b-4a3c-9955-55368ed432c8 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 7e633743-2b38-4c08-be9e-fdfde600b48b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:42.378163 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0085a251-fe0b-4a3c-9955-55368ed432c8 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:42.387487 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0085a251-fe0b-4a3c-9955-55368ed432c8 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:42.394953 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0085a251-fe0b-4a3c-9955-55368ed432c8 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:42.397208 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0085a251-fe0b-4a3c-9955-55368ed432c8 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:42.400946 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0085a251-fe0b-4a3c-9955-55368ed432c8 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:42.402286 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0085a251-fe0b-4a3c-9955-55368ed432c8 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:42.941952 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9eebf8a1-db58-406f-ae45-e15e76b0b002 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:40:42.959907 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9eebf8a1-db58-406f-ae45-e15e76b0b002 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1519 microversion: 2.1 time: 1.143711 Oct 19 03:40:42.977088 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2729/5542] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:40:41 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1519 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:40:43.184344 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-0085a251-fe0b-4a3c-9955-55368ed432c8 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:40:43.217644 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0085a251-fe0b-4a3c-9955-55368ed432c8 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b" status: 200 len: 1508 microversion: 2.1 time: 0.839190 Oct 19 03:40:43.224758 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2814/5543] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:40:42 2022] GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b => generated 1508 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:40:43.984294 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b6e0d409-4a61-4e62-9ab5-863e653e402b tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:43.985601 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b6e0d409-4a61-4e62-9ab5-863e653e402b tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:44.009611 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b6e0d409-4a61-4e62-9ab5-863e653e402b tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:44.010399 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b6e0d409-4a61-4e62-9ab5-863e653e402b tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:44.011019 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b6e0d409-4a61-4e62-9ab5-863e653e402b tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:44.012506 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b6e0d409-4a61-4e62-9ab5-863e653e402b tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:44.018439 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b6e0d409-4a61-4e62-9ab5-863e653e402b tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:44.019427 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b6e0d409-4a61-4e62-9ab5-863e653e402b tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:44.075255 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:40:44.248761 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-26b6375d-3de8-48c2-b4ff-73954ab0fe94 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:44.250955 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-26b6375d-3de8-48c2-b4ff-73954ab0fe94 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 7e633743-2b38-4c08-be9e-fdfde600b48b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:44.261262 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-26b6375d-3de8-48c2-b4ff-73954ab0fe94 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:44.264633 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-26b6375d-3de8-48c2-b4ff-73954ab0fe94 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:44.269919 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-26b6375d-3de8-48c2-b4ff-73954ab0fe94 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:44.270938 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-26b6375d-3de8-48c2-b4ff-73954ab0fe94 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:44.271609 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-26b6375d-3de8-48c2-b4ff-73954ab0fe94 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:44.272259 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-26b6375d-3de8-48c2-b4ff-73954ab0fe94 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:44.709295 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b6e0d409-4a61-4e62-9ab5-863e653e402b tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:40:44.725523 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b6e0d409-4a61-4e62-9ab5-863e653e402b tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1519 microversion: 2.1 time: 0.739995 Oct 19 03:40:44.725523 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2730/5544] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:40:43 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1519 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:40:44.739662 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7305dc92-cb78-412a-8cda-f314964b2b74 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:44.742546 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7305dc92-cb78-412a-8cda-f314964b2b74 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] [instance: 1f354001-86ee-4951-a9cb-23fcd9e678a9] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:44.773704 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7305dc92-cb78-412a-8cda-f314964b2b74 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:44.779450 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7305dc92-cb78-412a-8cda-f314964b2b74 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:44.779450 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7305dc92-cb78-412a-8cda-f314964b2b74 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:44.779450 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7305dc92-cb78-412a-8cda-f314964b2b74 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:44.779450 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7305dc92-cb78-412a-8cda-f314964b2b74 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:44.779450 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7305dc92-cb78-412a-8cda-f314964b2b74 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:44.839294 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7305dc92-cb78-412a-8cda-f314964b2b74 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] 10.222.0.52 "GET /compute/v2.1/servers/1f354001-86ee-4951-a9cb-23fcd9e678a9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.115543 Oct 19 03:40:44.840886 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2731/5545] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Oct 19 03:40:44 2022] GET /compute/v2.1/servers/1f354001-86ee-4951-a9cb-23fcd9e678a9/os-volume_attachments => generated 25 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 03:40:44.864926 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-26b6375d-3de8-48c2-b4ff-73954ab0fe94 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:40:44.886669 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-26b6375d-3de8-48c2-b4ff-73954ab0fe94 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b" status: 200 len: 1508 microversion: 2.1 time: 0.642258 Oct 19 03:40:44.889316 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2815/5546] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:40:44 2022] GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b => generated 1508 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:40:45.040303 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-28fba5f4-e551-44fc-81a5-012a181ab482 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:45.043374 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-28fba5f4-e551-44fc-81a5-012a181ab482 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] [instance: 1f354001-86ee-4951-a9cb-23fcd9e678a9] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:45.052075 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-28fba5f4-e551-44fc-81a5-012a181ab482 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:45.052822 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-28fba5f4-e551-44fc-81a5-012a181ab482 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:45.053799 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-28fba5f4-e551-44fc-81a5-012a181ab482 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:45.054850 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-28fba5f4-e551-44fc-81a5-012a181ab482 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:45.055594 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-28fba5f4-e551-44fc-81a5-012a181ab482 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:45.056363 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-28fba5f4-e551-44fc-81a5-012a181ab482 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:45.118091 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-28fba5f4-e551-44fc-81a5-012a181ab482 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] 10.222.0.52 "GET /compute/v2.1/servers/1f354001-86ee-4951-a9cb-23fcd9e678a9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.081923 Oct 19 03:40:45.121443 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2732/5547] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Oct 19 03:40:45 2022] GET /compute/v2.1/servers/1f354001-86ee-4951-a9cb-23fcd9e678a9/os-volume_attachments => generated 25 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 03:40:45.267375 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-8c9723bd-f82c-436a-b777-2542fb9414f7 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:45.267969 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-8c9723bd-f82c-436a-b777-2542fb9414f7 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] [instance: 1f354001-86ee-4951-a9cb-23fcd9e678a9] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:45.288601 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8c9723bd-f82c-436a-b777-2542fb9414f7 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:45.288779 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8c9723bd-f82c-436a-b777-2542fb9414f7 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:45.295855 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8c9723bd-f82c-436a-b777-2542fb9414f7 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:45.296809 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8c9723bd-f82c-436a-b777-2542fb9414f7 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:45.299657 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8c9723bd-f82c-436a-b777-2542fb9414f7 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:45.303160 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8c9723bd-f82c-436a-b777-2542fb9414f7 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:45.403736 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=100 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:40:45.422913 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-8c9723bd-f82c-436a-b777-2542fb9414f7 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] [instance: 1f354001-86ee-4951-a9cb-23fcd9e678a9] Going to try to terminate instance {{(pid=121135) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:40:45.745919 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-fd79ba9d-0406-45a0-bdee-d00ef6998053 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:45.746530 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-fd79ba9d-0406-45a0-bdee-d00ef6998053 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:45.765878 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fd79ba9d-0406-45a0-bdee-d00ef6998053 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:45.773827 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fd79ba9d-0406-45a0-bdee-d00ef6998053 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:45.787705 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fd79ba9d-0406-45a0-bdee-d00ef6998053 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:45.787705 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fd79ba9d-0406-45a0-bdee-d00ef6998053 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:45.787705 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fd79ba9d-0406-45a0-bdee-d00ef6998053 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:45.787705 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fd79ba9d-0406-45a0-bdee-d00ef6998053 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:45.867420 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-8c9723bd-f82c-436a-b777-2542fb9414f7 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1f354001-86ee-4951-a9cb-23fcd9e678a9" status: 204 len: 0 microversion: 2.1 time: 0.605283 Oct 19 03:40:45.868323 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2816/5548] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:40:45 2022] DELETE /compute/v2.1/servers/1f354001-86ee-4951-a9cb-23fcd9e678a9 => generated 0 bytes in 607 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:40:45.882674 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-46b58bca-8b0a-4220-ad74-b93a84a8b4b4 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:45.883681 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-46b58bca-8b0a-4220-ad74-b93a84a8b4b4 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] [instance: 1f354001-86ee-4951-a9cb-23fcd9e678a9] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:45.920856 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-46b58bca-8b0a-4220-ad74-b93a84a8b4b4 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:45.921401 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-46b58bca-8b0a-4220-ad74-b93a84a8b4b4 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:45.921873 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-46b58bca-8b0a-4220-ad74-b93a84a8b4b4 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:45.922733 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-46b58bca-8b0a-4220-ad74-b93a84a8b4b4 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:45.923131 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-46b58bca-8b0a-4220-ad74-b93a84a8b4b4 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:45.928938 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-46b58bca-8b0a-4220-ad74-b93a84a8b4b4 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:46.366607 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-fd79ba9d-0406-45a0-bdee-d00ef6998053 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:40:46.366607 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-fd79ba9d-0406-45a0-bdee-d00ef6998053 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1519 microversion: 2.1 time: 0.601241 Oct 19 03:40:46.366607 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2733/5549] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:40:45 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1519 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:40:46.366607 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3410d639-9713-462d-8a19-2d00972ac2d3 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:46.366607 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3410d639-9713-462d-8a19-2d00972ac2d3 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 7e633743-2b38-4c08-be9e-fdfde600b48b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:46.366607 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3410d639-9713-462d-8a19-2d00972ac2d3 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:46.366607 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3410d639-9713-462d-8a19-2d00972ac2d3 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:46.366607 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3410d639-9713-462d-8a19-2d00972ac2d3 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:46.366607 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3410d639-9713-462d-8a19-2d00972ac2d3 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:46.370123 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3410d639-9713-462d-8a19-2d00972ac2d3 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:46.370759 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3410d639-9713-462d-8a19-2d00972ac2d3 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:46.423442 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-46b58bca-8b0a-4220-ad74-b93a84a8b4b4 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c65a497e16e4e41b5cf1287042f3a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4001edd1474947a94243a620a6013a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:40:46.473733 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-46b58bca-8b0a-4220-ad74-b93a84a8b4b4 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] 10.222.0.52 "GET /compute/v2.1/servers/1f354001-86ee-4951-a9cb-23fcd9e678a9" status: 200 len: 1671 microversion: 2.1 time: 0.599747 Oct 19 03:40:46.475944 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2817/5550] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:40:45 2022] GET /compute/v2.1/servers/1f354001-86ee-4951-a9cb-23fcd9e678a9 => generated 1671 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:40:46.892196 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-3410d639-9713-462d-8a19-2d00972ac2d3 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:40:46.892196 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3410d639-9713-462d-8a19-2d00972ac2d3 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b" status: 200 len: 1508 microversion: 2.1 time: 0.532238 Oct 19 03:40:46.892196 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2734/5551] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:40:46 2022] GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b => generated 1508 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:40:47.374514 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e74f1efc-2f75-491c-a111-7fabfcfdd651 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:47.375435 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e74f1efc-2f75-491c-a111-7fabfcfdd651 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:47.388104 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e74f1efc-2f75-491c-a111-7fabfcfdd651 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:47.392987 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e74f1efc-2f75-491c-a111-7fabfcfdd651 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:47.394452 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e74f1efc-2f75-491c-a111-7fabfcfdd651 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:47.399633 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e74f1efc-2f75-491c-a111-7fabfcfdd651 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:47.400384 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e74f1efc-2f75-491c-a111-7fabfcfdd651 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:47.401902 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e74f1efc-2f75-491c-a111-7fabfcfdd651 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:47.504508 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-bbac9ade-561f-4a6a-9595-5f5dd272f833 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:47.505849 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-bbac9ade-561f-4a6a-9595-5f5dd272f833 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] [instance: 1f354001-86ee-4951-a9cb-23fcd9e678a9] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:47.524297 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bbac9ade-561f-4a6a-9595-5f5dd272f833 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:47.524297 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bbac9ade-561f-4a6a-9595-5f5dd272f833 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:47.524297 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bbac9ade-561f-4a6a-9595-5f5dd272f833 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:47.524297 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bbac9ade-561f-4a6a-9595-5f5dd272f833 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:47.524297 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bbac9ade-561f-4a6a-9595-5f5dd272f833 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:47.527402 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bbac9ade-561f-4a6a-9595-5f5dd272f833 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:48.488190 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-e74f1efc-2f75-491c-a111-7fabfcfdd651 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:40:48.499824 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e74f1efc-2f75-491c-a111-7fabfcfdd651 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1519 microversion: 2.1 time: 1.129532 Oct 19 03:40:48.500665 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2818/5552] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:40:47 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1519 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:40:48.517808 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-15a85691-3c78-48dc-8c22-a4b9ee7feecf tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:48.518439 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-15a85691-3c78-48dc-8c22-a4b9ee7feecf tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 7e633743-2b38-4c08-be9e-fdfde600b48b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:48.530874 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-15a85691-3c78-48dc-8c22-a4b9ee7feecf tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:48.531644 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-15a85691-3c78-48dc-8c22-a4b9ee7feecf tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:48.532288 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-15a85691-3c78-48dc-8c22-a4b9ee7feecf tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:48.536076 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-15a85691-3c78-48dc-8c22-a4b9ee7feecf tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:48.536761 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-15a85691-3c78-48dc-8c22-a4b9ee7feecf tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:48.537426 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-15a85691-3c78-48dc-8c22-a4b9ee7feecf tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:48.561834 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-bbac9ade-561f-4a6a-9595-5f5dd272f833 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c65a497e16e4e41b5cf1287042f3a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4001edd1474947a94243a620a6013a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:40:48.617359 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-bbac9ade-561f-4a6a-9595-5f5dd272f833 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] 10.222.0.52 "GET /compute/v2.1/servers/1f354001-86ee-4951-a9cb-23fcd9e678a9" status: 200 len: 1671 microversion: 2.1 time: 1.111240 Oct 19 03:40:48.618256 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2735/5553] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:40:47 2022] GET /compute/v2.1/servers/1f354001-86ee-4951-a9cb-23fcd9e678a9 => generated 1671 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:40:49.069101 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-15a85691-3c78-48dc-8c22-a4b9ee7feecf tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:40:49.084538 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-15a85691-3c78-48dc-8c22-a4b9ee7feecf tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b" status: 200 len: 1508 microversion: 2.1 time: 0.582388 Oct 19 03:40:49.086227 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2819/5554] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:40:48 2022] GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b => generated 1508 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:40:49.526013 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ac10113e-8b7c-42bb-8b6e-077eb919a8ae tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:49.526648 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ac10113e-8b7c-42bb-8b6e-077eb919a8ae tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:49.557691 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ac10113e-8b7c-42bb-8b6e-077eb919a8ae tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:49.557691 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ac10113e-8b7c-42bb-8b6e-077eb919a8ae tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:49.557691 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ac10113e-8b7c-42bb-8b6e-077eb919a8ae tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:49.559805 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ac10113e-8b7c-42bb-8b6e-077eb919a8ae tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:49.560847 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ac10113e-8b7c-42bb-8b6e-077eb919a8ae tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:49.562406 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ac10113e-8b7c-42bb-8b6e-077eb919a8ae tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:49.651270 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-eb9c9c3c-c1a5-4432-b5b2-00c3080fa1b3 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:49.652666 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-eb9c9c3c-c1a5-4432-b5b2-00c3080fa1b3 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] [instance: 1f354001-86ee-4951-a9cb-23fcd9e678a9] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:49.689540 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-eb9c9c3c-c1a5-4432-b5b2-00c3080fa1b3 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:49.690374 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-eb9c9c3c-c1a5-4432-b5b2-00c3080fa1b3 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:49.691857 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-eb9c9c3c-c1a5-4432-b5b2-00c3080fa1b3 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:49.693141 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-eb9c9c3c-c1a5-4432-b5b2-00c3080fa1b3 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:49.694221 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-eb9c9c3c-c1a5-4432-b5b2-00c3080fa1b3 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:49.697007 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-eb9c9c3c-c1a5-4432-b5b2-00c3080fa1b3 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:49.986306 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-eb9c9c3c-c1a5-4432-b5b2-00c3080fa1b3 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c65a497e16e4e41b5cf1287042f3a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4001edd1474947a94243a620a6013a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:40:49.990822 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ac10113e-8b7c-42bb-8b6e-077eb919a8ae tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:40:50.001023 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ac10113e-8b7c-42bb-8b6e-077eb919a8ae tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1519 microversion: 2.1 time: 0.480018 Oct 19 03:40:50.001918 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-eb9c9c3c-c1a5-4432-b5b2-00c3080fa1b3 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] 10.222.0.52 "GET /compute/v2.1/servers/1f354001-86ee-4951-a9cb-23fcd9e678a9" status: 200 len: 1671 microversion: 2.1 time: 0.347927 Oct 19 03:40:50.003031 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2820/5555] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:40:49 2022] GET /compute/v2.1/servers/1f354001-86ee-4951-a9cb-23fcd9e678a9 => generated 1671 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:40:50.003601 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2736/5556] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:40:49 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1519 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:40:50.116649 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-75d22656-41c4-46d3-b104-9a921a778a7d tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:50.117293 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-75d22656-41c4-46d3-b104-9a921a778a7d tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 7e633743-2b38-4c08-be9e-fdfde600b48b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:50.130550 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-75d22656-41c4-46d3-b104-9a921a778a7d tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:50.139819 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-75d22656-41c4-46d3-b104-9a921a778a7d tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:50.141833 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-75d22656-41c4-46d3-b104-9a921a778a7d tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:50.141833 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-75d22656-41c4-46d3-b104-9a921a778a7d tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:50.141833 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-75d22656-41c4-46d3-b104-9a921a778a7d tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:50.142120 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-75d22656-41c4-46d3-b104-9a921a778a7d tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:50.715890 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-b65ad72d-881a-43bd-8d29-dbf0f04a4b64 req-60c3b50b-afe4-4c78-b4f8-0c17d6f8414c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f354001-86ee-4951-a9cb-23fcd9e678a9", "name": "network-vif-deleted", "tag": "df2c5d9b-837d-4ae2-918d-8eef7876b140"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:40:50.751432 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=80 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:40:50.753591 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-b65ad72d-881a-43bd-8d29-dbf0f04a4b64 req-60c3b50b-afe4-4c78-b4f8-0c17d6f8414c service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:50.754140 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-b65ad72d-881a-43bd-8d29-dbf0f04a4b64 req-60c3b50b-afe4-4c78-b4f8-0c17d6f8414c service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:50.754576 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-b65ad72d-881a-43bd-8d29-dbf0f04a4b64 req-60c3b50b-afe4-4c78-b4f8-0c17d6f8414c service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:50.769580 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-75d22656-41c4-46d3-b104-9a921a778a7d tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:40:50.785486 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-75d22656-41c4-46d3-b104-9a921a778a7d tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b" status: 200 len: 1508 microversion: 2.1 time: 0.677890 Oct 19 03:40:50.791956 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2821/5557] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:40:50 2022] GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b => generated 1508 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:40:50.802389 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-b65ad72d-881a-43bd-8d29-dbf0f04a4b64 req-60c3b50b-afe4-4c78-b4f8-0c17d6f8414c service nova] Creating event network-vif-deleted:df2c5d9b-837d-4ae2-918d-8eef7876b140 for instance 1f354001-86ee-4951-a9cb-23fcd9e678a9 on n-h2-861333-8 Oct 19 03:40:50.819268 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-b65ad72d-881a-43bd-8d29-dbf0f04a4b64 req-60c3b50b-afe4-4c78-b4f8-0c17d6f8414c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107639 Oct 19 03:40:50.827400 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2737/5558] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:40:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:40:51.037125 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a8d129f3-bad9-4153-8537-aa6007515118 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:51.038284 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-472180f2-2694-45fa-ae01-3d09e4581e19 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:51.039207 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a8d129f3-bad9-4153-8537-aa6007515118 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:51.040018 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-472180f2-2694-45fa-ae01-3d09e4581e19 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] [instance: 1f354001-86ee-4951-a9cb-23fcd9e678a9] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:51.054794 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-472180f2-2694-45fa-ae01-3d09e4581e19 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:51.065291 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a8d129f3-bad9-4153-8537-aa6007515118 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:51.068175 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-472180f2-2694-45fa-ae01-3d09e4581e19 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:51.073784 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a8d129f3-bad9-4153-8537-aa6007515118 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:51.078530 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-472180f2-2694-45fa-ae01-3d09e4581e19 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:51.078530 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-472180f2-2694-45fa-ae01-3d09e4581e19 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:51.078530 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-472180f2-2694-45fa-ae01-3d09e4581e19 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:51.080925 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a8d129f3-bad9-4153-8537-aa6007515118 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:51.082440 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a8d129f3-bad9-4153-8537-aa6007515118 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:51.087975 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-472180f2-2694-45fa-ae01-3d09e4581e19 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:51.088389 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a8d129f3-bad9-4153-8537-aa6007515118 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:51.089699 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a8d129f3-bad9-4153-8537-aa6007515118 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:51.315769 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-472180f2-2694-45fa-ae01-3d09e4581e19 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c65a497e16e4e41b5cf1287042f3a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4001edd1474947a94243a620a6013a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:40:51.329002 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-472180f2-2694-45fa-ae01-3d09e4581e19 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] 10.222.0.52 "GET /compute/v2.1/servers/1f354001-86ee-4951-a9cb-23fcd9e678a9" status: 200 len: 1321 microversion: 2.1 time: 0.305263 Oct 19 03:40:51.330453 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2822/5559] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:40:51 2022] GET /compute/v2.1/servers/1f354001-86ee-4951-a9cb-23fcd9e678a9 => generated 1321 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:40:51.540310 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a8d129f3-bad9-4153-8537-aa6007515118 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:40:51.563649 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a8d129f3-bad9-4153-8537-aa6007515118 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1519 microversion: 2.1 time: 0.534613 Oct 19 03:40:51.564024 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2738/5560] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:40:51 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1519 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:40:51.818823 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1cc5c66f-a54a-4d88-80b0-ed8098c006c0 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:51.819462 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1cc5c66f-a54a-4d88-80b0-ed8098c006c0 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 7e633743-2b38-4c08-be9e-fdfde600b48b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:51.827832 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1cc5c66f-a54a-4d88-80b0-ed8098c006c0 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:51.828608 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1cc5c66f-a54a-4d88-80b0-ed8098c006c0 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:51.829197 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1cc5c66f-a54a-4d88-80b0-ed8098c006c0 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:51.830092 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1cc5c66f-a54a-4d88-80b0-ed8098c006c0 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:51.830687 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1cc5c66f-a54a-4d88-80b0-ed8098c006c0 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:51.831260 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1cc5c66f-a54a-4d88-80b0-ed8098c006c0 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:52.042991 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-1cc5c66f-a54a-4d88-80b0-ed8098c006c0 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:40:52.052684 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1cc5c66f-a54a-4d88-80b0-ed8098c006c0 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b" status: 200 len: 1508 microversion: 2.1 time: 0.237154 Oct 19 03:40:52.076839 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2823/5561] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:40:51 2022] GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b => generated 1508 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:40:52.355804 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-76a8a15a-c4cd-433f-865b-aa73e173de17 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:52.359162 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-76a8a15a-c4cd-433f-865b-aa73e173de17 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] [instance: 1f354001-86ee-4951-a9cb-23fcd9e678a9] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:52.379816 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-76a8a15a-c4cd-433f-865b-aa73e173de17 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:52.380556 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-76a8a15a-c4cd-433f-865b-aa73e173de17 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:52.381808 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-76a8a15a-c4cd-433f-865b-aa73e173de17 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:52.382746 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-76a8a15a-c4cd-433f-865b-aa73e173de17 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:52.383425 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-76a8a15a-c4cd-433f-865b-aa73e173de17 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:52.384096 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-76a8a15a-c4cd-433f-865b-aa73e173de17 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:52.444313 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-76a8a15a-c4cd-433f-865b-aa73e173de17 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:52.448975 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-76a8a15a-c4cd-433f-865b-aa73e173de17 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:52.449589 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-76a8a15a-c4cd-433f-865b-aa73e173de17 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:52.458953 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-76a8a15a-c4cd-433f-865b-aa73e173de17 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lazy-loading 'fault' on Instance uuid 1f354001-86ee-4951-a9cb-23fcd9e678a9 {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:40:52.549862 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-76a8a15a-c4cd-433f-865b-aa73e173de17 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c65a497e16e4e41b5cf1287042f3a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4001edd1474947a94243a620a6013a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:40:52.561758 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-76a8a15a-c4cd-433f-865b-aa73e173de17 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] 10.222.0.52 "GET /compute/v2.1/servers/1f354001-86ee-4951-a9cb-23fcd9e678a9" status: 200 len: 1326 microversion: 2.1 time: 0.209854 Oct 19 03:40:52.562362 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2739/5562] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:40:52 2022] GET /compute/v2.1/servers/1f354001-86ee-4951-a9cb-23fcd9e678a9 => generated 1326 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:40:52.587159 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-bdae3492-b7a6-47f6-a1e3-5a30e8c483a7 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:52.591042 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-bdae3492-b7a6-47f6-a1e3-5a30e8c483a7 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:52.607277 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bdae3492-b7a6-47f6-a1e3-5a30e8c483a7 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:52.608251 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bdae3492-b7a6-47f6-a1e3-5a30e8c483a7 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:52.609802 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bdae3492-b7a6-47f6-a1e3-5a30e8c483a7 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:52.613054 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bdae3492-b7a6-47f6-a1e3-5a30e8c483a7 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:52.614202 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bdae3492-b7a6-47f6-a1e3-5a30e8c483a7 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:52.614765 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bdae3492-b7a6-47f6-a1e3-5a30e8c483a7 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:52.842811 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-bdae3492-b7a6-47f6-a1e3-5a30e8c483a7 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:40:52.852369 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-bdae3492-b7a6-47f6-a1e3-5a30e8c483a7 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1519 microversion: 2.1 time: 0.269011 Oct 19 03:40:52.853493 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2824/5563] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:40:52 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1519 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:40:53.082728 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-176e8441-e490-425a-bea3-0a4029523a95 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:53.083678 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-176e8441-e490-425a-bea3-0a4029523a95 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 7e633743-2b38-4c08-be9e-fdfde600b48b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:53.091946 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-176e8441-e490-425a-bea3-0a4029523a95 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:53.092571 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-176e8441-e490-425a-bea3-0a4029523a95 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:53.093120 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-176e8441-e490-425a-bea3-0a4029523a95 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:53.093994 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-176e8441-e490-425a-bea3-0a4029523a95 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:53.094558 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-176e8441-e490-425a-bea3-0a4029523a95 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:53.095214 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-176e8441-e490-425a-bea3-0a4029523a95 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:53.591929 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a3124e98-600d-4459-8597-d889b58f3bd1 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:53.593083 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a3124e98-600d-4459-8597-d889b58f3bd1 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] [instance: 1f354001-86ee-4951-a9cb-23fcd9e678a9] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:53.601509 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-176e8441-e490-425a-bea3-0a4029523a95 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:40:53.601974 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a3124e98-600d-4459-8597-d889b58f3bd1 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:53.601974 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a3124e98-600d-4459-8597-d889b58f3bd1 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:53.602355 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a3124e98-600d-4459-8597-d889b58f3bd1 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:53.603133 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a3124e98-600d-4459-8597-d889b58f3bd1 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:53.603594 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a3124e98-600d-4459-8597-d889b58f3bd1 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:53.604033 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a3124e98-600d-4459-8597-d889b58f3bd1 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:53.615838 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-176e8441-e490-425a-bea3-0a4029523a95 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b" status: 200 len: 1508 microversion: 2.1 time: 0.538082 Oct 19 03:40:53.634835 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2740/5564] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:40:53 2022] GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b => generated 1508 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:40:53.644535 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-a3124e98-600d-4459-8597-d889b58f3bd1 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] HTTP exception thrown: Instance 1f354001-86ee-4951-a9cb-23fcd9e678a9 could not be found. Oct 19 03:40:53.653174 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a3124e98-600d-4459-8597-d889b58f3bd1 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Request method failure captured: Oct 19 03:40:53.653174 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/1f354001-86ee-4951-a9cb-23fcd9e678a9 HTTP/1.1 Oct 19 03:40:53.653174 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:40:53.653174 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:40:53.653174 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:40:53.653174 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:40:53.653174 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:40:53.653174 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:40:53.653174 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:40:53.653174 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:40:53.653174 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT3A-J8gkSeK-jC5SkwldeX2fzHDW9yQloVnq9w2JWN_JbOIlJSI50_hnA7Y-GPIEwyuvwrDEjFnM41r0iLy-FdL3R3ciqTPdXWgB2rbzESKYvw_2cPHI89nLZNBftmcKk7VKZvl3lBPw28mJ2rNa1xBb7pb4TRKC6xWHwLh7-7tORZ4 Oct 19 03:40:53.653174 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:40:53.653174 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:40:53.653174 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:40:53.653174 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:40:53.653174 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:40:53.653174 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:40:53.653174 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: fa4001edd1474947a94243a620a6013a Oct 19 03:40:53.653174 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-AttachVolumeTestJSON-691414608 Oct 19 03:40:53.653174 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:40:53.653174 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:40:53.653174 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/fa4001edd1474947a94243a620a6013a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fa4001edd1474947a94243a620a6013a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fa4001edd1474947a94243a620a6013a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_fa4001edd1474947a94243a620a6013a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:40:53.653174 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-AttachVolumeTestJSON-691414608 Oct 19 03:40:53.653174 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: fa4001edd1474947a94243a620a6013a Oct 19 03:40:53.653174 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-AttachVolumeTestJSON-691414608 Oct 19 03:40:53.653174 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-AttachVolumeTestJSON-691414608-project Oct 19 03:40:53.653174 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:40:53.653174 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:40:53.653174 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 4c65a497e16e4e41b5cf1287042f3a68 Oct 19 03:40:53.653174 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-AttachVolumeTestJSON-691414608-project Oct 19 03:40:53.653174 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:40:53.653174 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance 1f354001-86ee-4951-a9cb-23fcd9e678a9 could not be found. Oct 19 03:40:53.653174 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '1f354001-86ee-4951-a9cb-23fcd9e678a9'} Oct 19 03:40:53.653174 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:40:53.653174 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:40:53.653174 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:40:53.653174 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:40:53.653174 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:40:53.653174 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:40:53.653174 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:40:53.653174 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:40:53.653174 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:40:53.653174 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:40:53.653174 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f354001-86ee-4951-a9cb-23fcd9e678a9 could not be found. Oct 19 03:40:53.653174 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:40:53.653174 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:40:53.653174 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:40:53.653174 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:40:53.653174 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:40:53.653174 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:40:53.653174 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:40:53.653174 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:40:53.653174 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:40:53.653174 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:40:53.653174 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:40:53.653174 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:40:53.653174 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:40:53.653174 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:40:53.653174 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:40:53.653174 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:40:53.653174 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f354001-86ee-4951-a9cb-23fcd9e678a9 could not be found. Oct 19 03:40:53.653174 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:40:53.653174 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:40:53.653174 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:40:53.658468 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:40:53.658468 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:40:53.658468 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:40:53.658468 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:40:53.658468 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:40:53.658468 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f354001-86ee-4951-a9cb-23fcd9e678a9 could not be found. Oct 19 03:40:53.658468 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:40:53.658468 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a3124e98-600d-4459-8597-d889b58f3bd1 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Returning 404 to user: Instance 1f354001-86ee-4951-a9cb-23fcd9e678a9 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:40:53.658468 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a3124e98-600d-4459-8597-d889b58f3bd1 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] 10.222.0.52 "GET /compute/v2.1/servers/1f354001-86ee-4951-a9cb-23fcd9e678a9" status: 404 len: 111 microversion: 2.1 time: 0.068586 Oct 19 03:40:53.661504 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2825/5565] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:40:53 2022] GET /compute/v2.1/servers/1f354001-86ee-4951-a9cb-23fcd9e678a9 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 03:40:53.667901 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ced98385-a0fa-4b4c-92c8-ff97726016a5 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Calling method '.version_select at 0x7fc12bf070d0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:53.829893 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ced98385-a0fa-4b4c-92c8-ff97726016a5 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-18999575" status: 202 len: 0 microversion: 2.1 time: 0.166160 Oct 19 03:40:53.830818 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2741/5566] 10.222.0.52 () {58 vars in 1215 bytes} [Wed Oct 19 03:40:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-18999575 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:40:53.876609 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e21d6d4b-5630-49e7-9d71-89e884fa434a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:53.877747 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e21d6d4b-5630-49e7-9d71-89e884fa434a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:53.894587 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e21d6d4b-5630-49e7-9d71-89e884fa434a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:53.896351 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e21d6d4b-5630-49e7-9d71-89e884fa434a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:53.898347 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e21d6d4b-5630-49e7-9d71-89e884fa434a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:53.899985 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e21d6d4b-5630-49e7-9d71-89e884fa434a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:53.901033 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e21d6d4b-5630-49e7-9d71-89e884fa434a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:53.901670 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e21d6d4b-5630-49e7-9d71-89e884fa434a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:54.218627 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-e21d6d4b-5630-49e7-9d71-89e884fa434a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:40:54.231498 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e21d6d4b-5630-49e7-9d71-89e884fa434a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1519 microversion: 2.1 time: 0.358832 Oct 19 03:40:54.235941 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2826/5567] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:40:53 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1519 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:40:54.642131 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7a574917-d47f-464c-8a01-289dfc5fd866 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:54.642757 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7a574917-d47f-464c-8a01-289dfc5fd866 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 7e633743-2b38-4c08-be9e-fdfde600b48b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:54.656559 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7a574917-d47f-464c-8a01-289dfc5fd866 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:54.657097 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7a574917-d47f-464c-8a01-289dfc5fd866 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:54.657579 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7a574917-d47f-464c-8a01-289dfc5fd866 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:54.658298 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7a574917-d47f-464c-8a01-289dfc5fd866 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:54.658758 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7a574917-d47f-464c-8a01-289dfc5fd866 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:54.659198 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7a574917-d47f-464c-8a01-289dfc5fd866 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:54.920479 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b9dd27a3-12d6-4338-89fd-247682f426aa tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:54.921561 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b9dd27a3-12d6-4338-89fd-247682f426aa tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 06b5db2c-baea-4e51-8506-6443bbd9daeb] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:54.931520 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b9dd27a3-12d6-4338-89fd-247682f426aa tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:54.932242 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b9dd27a3-12d6-4338-89fd-247682f426aa tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:54.932986 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b9dd27a3-12d6-4338-89fd-247682f426aa tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:54.934084 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b9dd27a3-12d6-4338-89fd-247682f426aa tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:54.935477 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b9dd27a3-12d6-4338-89fd-247682f426aa tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:54.936089 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b9dd27a3-12d6-4338-89fd-247682f426aa tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:54.994149 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b9dd27a3-12d6-4338-89fd-247682f426aa tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 06b5db2c-baea-4e51-8506-6443bbd9daeb] Going to try to terminate instance {{(pid=121135) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:40:55.069905 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-7a574917-d47f-464c-8a01-289dfc5fd866 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:40:55.089212 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7a574917-d47f-464c-8a01-289dfc5fd866 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b" status: 200 len: 1529 microversion: 2.1 time: 0.450893 Oct 19 03:40:55.092837 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2742/5568] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:40:54 2022] GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b => generated 1529 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:40:55.128704 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-b43ec992-9324-4914-8fde-013d2d64937e req-a510cf8f-a082-4955-8aef-535540bbfe93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e633743-2b38-4c08-be9e-fdfde600b48b", "name": "network-vif-plugged", "status": "completed", "tag": "990064fc-01d2-4577-a71f-88694fc1b668"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:40:55.176903 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-b43ec992-9324-4914-8fde-013d2d64937e req-a510cf8f-a082-4955-8aef-535540bbfe93 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:55.177454 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-b43ec992-9324-4914-8fde-013d2d64937e req-a510cf8f-a082-4955-8aef-535540bbfe93 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:55.177906 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-b43ec992-9324-4914-8fde-013d2d64937e req-a510cf8f-a082-4955-8aef-535540bbfe93 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:55.193325 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-b43ec992-9324-4914-8fde-013d2d64937e req-a510cf8f-a082-4955-8aef-535540bbfe93 service nova] Creating event network-vif-plugged:990064fc-01d2-4577-a71f-88694fc1b668 for instance 7e633743-2b38-4c08-be9e-fdfde600b48b on n-h1-861333-8 Oct 19 03:40:55.202048 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-b43ec992-9324-4914-8fde-013d2d64937e req-a510cf8f-a082-4955-8aef-535540bbfe93 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107239 Oct 19 03:40:55.203354 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2743/5569] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:40:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:40:55.282605 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8fb54bef-4526-4948-b298-6f60c59b59b2 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:55.283335 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8fb54bef-4526-4948-b298-6f60c59b59b2 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:55.314925 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8fb54bef-4526-4948-b298-6f60c59b59b2 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:55.315536 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8fb54bef-4526-4948-b298-6f60c59b59b2 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:55.315955 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8fb54bef-4526-4948-b298-6f60c59b59b2 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:55.316681 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8fb54bef-4526-4948-b298-6f60c59b59b2 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:55.318880 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8fb54bef-4526-4948-b298-6f60c59b59b2 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:55.319330 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8fb54bef-4526-4948-b298-6f60c59b59b2 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:55.475293 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b9dd27a3-12d6-4338-89fd-247682f426aa tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "DELETE /compute/v2.1/servers/06b5db2c-baea-4e51-8506-6443bbd9daeb" status: 204 len: 0 microversion: 2.1 time: 0.558926 Oct 19 03:40:55.479033 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2827/5570] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:40:54 2022] DELETE /compute/v2.1/servers/06b5db2c-baea-4e51-8506-6443bbd9daeb => generated 0 bytes in 562 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 19 03:40:55.486992 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-16854588-3898-4cb4-b86e-318e8bfc0788 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:55.488342 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-16854588-3898-4cb4-b86e-318e8bfc0788 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 06b5db2c-baea-4e51-8506-6443bbd9daeb] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:55.503663 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-16854588-3898-4cb4-b86e-318e8bfc0788 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:55.505625 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-16854588-3898-4cb4-b86e-318e8bfc0788 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:55.506748 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-16854588-3898-4cb4-b86e-318e8bfc0788 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:55.510314 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-16854588-3898-4cb4-b86e-318e8bfc0788 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:55.511196 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-16854588-3898-4cb4-b86e-318e8bfc0788 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:55.512774 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-16854588-3898-4cb4-b86e-318e8bfc0788 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:55.671937 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8fb54bef-4526-4948-b298-6f60c59b59b2 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:40:55.686584 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8fb54bef-4526-4948-b298-6f60c59b59b2 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1519 microversion: 2.1 time: 0.431947 Oct 19 03:40:55.690512 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2744/5571] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:40:55 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1519 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:40:55.781102 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-16854588-3898-4cb4-b86e-318e8bfc0788 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4729a0afd69480f99642266e0eec17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce5e9f9a4644b27a24b2f4c06df97bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:40:55.790139 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-16854588-3898-4cb4-b86e-318e8bfc0788 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/06b5db2c-baea-4e51-8506-6443bbd9daeb" status: 200 len: 1509 microversion: 2.1 time: 0.309106 Oct 19 03:40:55.791688 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2828/5572] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:40:55 2022] GET /compute/v2.1/servers/06b5db2c-baea-4e51-8506-6443bbd9daeb => generated 1509 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:40:56.116026 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b4cad5ac-9620-4f79-81ff-435ce759b261 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:56.116647 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b4cad5ac-9620-4f79-81ff-435ce759b261 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 7e633743-2b38-4c08-be9e-fdfde600b48b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:56.123981 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b4cad5ac-9620-4f79-81ff-435ce759b261 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:56.124480 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b4cad5ac-9620-4f79-81ff-435ce759b261 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:56.124934 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b4cad5ac-9620-4f79-81ff-435ce759b261 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:56.125865 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b4cad5ac-9620-4f79-81ff-435ce759b261 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:56.127311 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b4cad5ac-9620-4f79-81ff-435ce759b261 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:56.127924 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b4cad5ac-9620-4f79-81ff-435ce759b261 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:56.406553 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b4cad5ac-9620-4f79-81ff-435ce759b261 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:40:56.415860 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b4cad5ac-9620-4f79-81ff-435ce759b261 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b" status: 200 len: 1529 microversion: 2.1 time: 0.303675 Oct 19 03:40:56.417698 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2745/5573] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:40:56 2022] GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b => generated 1529 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:40:56.716180 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e44adaea-fbb7-46b6-a193-2fb148b80cbd tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:56.717412 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e44adaea-fbb7-46b6-a193-2fb148b80cbd tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:56.725264 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e44adaea-fbb7-46b6-a193-2fb148b80cbd tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:56.725818 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e44adaea-fbb7-46b6-a193-2fb148b80cbd tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:56.728487 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e44adaea-fbb7-46b6-a193-2fb148b80cbd tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:56.728487 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e44adaea-fbb7-46b6-a193-2fb148b80cbd tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:56.728487 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e44adaea-fbb7-46b6-a193-2fb148b80cbd tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:56.728487 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e44adaea-fbb7-46b6-a193-2fb148b80cbd tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:56.831535 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-81ff4c10-c198-40b7-89fa-dba7f7d53102 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:56.832269 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-81ff4c10-c198-40b7-89fa-dba7f7d53102 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 06b5db2c-baea-4e51-8506-6443bbd9daeb] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:56.842276 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-81ff4c10-c198-40b7-89fa-dba7f7d53102 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:56.842761 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-81ff4c10-c198-40b7-89fa-dba7f7d53102 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:56.843201 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-81ff4c10-c198-40b7-89fa-dba7f7d53102 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:56.843913 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-81ff4c10-c198-40b7-89fa-dba7f7d53102 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:56.848154 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-81ff4c10-c198-40b7-89fa-dba7f7d53102 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:56.848646 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-81ff4c10-c198-40b7-89fa-dba7f7d53102 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:57.432631 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-e44adaea-fbb7-46b6-a193-2fb148b80cbd tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:40:57.442385 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e44adaea-fbb7-46b6-a193-2fb148b80cbd tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1519 microversion: 2.1 time: 0.730144 Oct 19 03:40:57.442985 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2829/5574] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:40:56 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1519 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:40:57.477786 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a9777430-778e-4562-8584-9cc1daee9cad tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:57.478404 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a9777430-778e-4562-8584-9cc1daee9cad tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 7e633743-2b38-4c08-be9e-fdfde600b48b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:57.512306 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a9777430-778e-4562-8584-9cc1daee9cad tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:57.516910 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-81ff4c10-c198-40b7-89fa-dba7f7d53102 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4729a0afd69480f99642266e0eec17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce5e9f9a4644b27a24b2f4c06df97bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:40:57.518777 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a9777430-778e-4562-8584-9cc1daee9cad tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:57.519338 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a9777430-778e-4562-8584-9cc1daee9cad tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:57.523115 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a9777430-778e-4562-8584-9cc1daee9cad tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:57.526331 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a9777430-778e-4562-8584-9cc1daee9cad tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:57.526831 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a9777430-778e-4562-8584-9cc1daee9cad tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:57.529449 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-81ff4c10-c198-40b7-89fa-dba7f7d53102 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/06b5db2c-baea-4e51-8506-6443bbd9daeb" status: 200 len: 1509 microversion: 2.1 time: 0.710811 Oct 19 03:40:57.533104 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2746/5575] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:40:56 2022] GET /compute/v2.1/servers/06b5db2c-baea-4e51-8506-6443bbd9daeb => generated 1509 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:40:57.537967 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-7e576c94-4d3b-43b0-a179-b0a68237ff2b req-22bdbb4c-4fb7-4e15-b547-7cc7812adeac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a830928-6d51-4dbd-97ad-8cca44de3770", "name": "network-vif-plugged", "status": "completed", "tag": "9779d73d-72bb-47da-820f-5576b587d824"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:40:57.541151 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:40:57.553642 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-7e576c94-4d3b-43b0-a179-b0a68237ff2b req-22bdbb4c-4fb7-4e15-b547-7cc7812adeac service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:57.557187 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-7e576c94-4d3b-43b0-a179-b0a68237ff2b req-22bdbb4c-4fb7-4e15-b547-7cc7812adeac service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:57.557187 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-7e576c94-4d3b-43b0-a179-b0a68237ff2b req-22bdbb4c-4fb7-4e15-b547-7cc7812adeac service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:57.570673 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-7e576c94-4d3b-43b0-a179-b0a68237ff2b req-22bdbb4c-4fb7-4e15-b547-7cc7812adeac service nova] Creating event network-vif-plugged:9779d73d-72bb-47da-820f-5576b587d824 for instance 5a830928-6d51-4dbd-97ad-8cca44de3770 on n-h1-861333-8 Oct 19 03:40:57.577979 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-7e576c94-4d3b-43b0-a179-b0a68237ff2b req-22bdbb4c-4fb7-4e15-b547-7cc7812adeac service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043391 Oct 19 03:40:57.582543 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2747/5576] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:40:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:40:57.831904 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a9777430-778e-4562-8584-9cc1daee9cad tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:40:57.839708 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a9777430-778e-4562-8584-9cc1daee9cad tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b" status: 200 len: 1529 microversion: 2.1 time: 0.395693 Oct 19 03:40:57.840873 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2830/5577] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:40:57 2022] GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b => generated 1529 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:40:58.198662 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-63f9feee-9ba1-47d1-964e-94d9ff272cc0 req-13b261ff-f81b-49f7-839e-cd0cdcb2ce09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06b5db2c-baea-4e51-8506-6443bbd9daeb", "name": "network-vif-deleted", "tag": "cbd4142a-4e2a-43a9-8188-c3e7cfe4f5ec"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:40:58.215212 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-63f9feee-9ba1-47d1-964e-94d9ff272cc0 req-13b261ff-f81b-49f7-839e-cd0cdcb2ce09 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:58.216420 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-63f9feee-9ba1-47d1-964e-94d9ff272cc0 req-13b261ff-f81b-49f7-839e-cd0cdcb2ce09 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:58.217008 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-63f9feee-9ba1-47d1-964e-94d9ff272cc0 req-13b261ff-f81b-49f7-839e-cd0cdcb2ce09 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:58.243641 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-63f9feee-9ba1-47d1-964e-94d9ff272cc0 req-13b261ff-f81b-49f7-839e-cd0cdcb2ce09 service nova] Creating event network-vif-deleted:cbd4142a-4e2a-43a9-8188-c3e7cfe4f5ec for instance 06b5db2c-baea-4e51-8506-6443bbd9daeb on n-h2-861333-8 Oct 19 03:40:58.249182 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-63f9feee-9ba1-47d1-964e-94d9ff272cc0 req-13b261ff-f81b-49f7-839e-cd0cdcb2ce09 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056035 Oct 19 03:40:58.253028 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2748/5578] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:40:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:40:58.472989 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a174b904-8149-4cc1-a6cb-a8e576836541 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:58.474273 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a174b904-8149-4cc1-a6cb-a8e576836541 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:58.480127 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a174b904-8149-4cc1-a6cb-a8e576836541 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:58.480698 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a174b904-8149-4cc1-a6cb-a8e576836541 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:58.481344 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a174b904-8149-4cc1-a6cb-a8e576836541 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:58.482739 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a174b904-8149-4cc1-a6cb-a8e576836541 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:58.483288 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a174b904-8149-4cc1-a6cb-a8e576836541 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:58.483926 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a174b904-8149-4cc1-a6cb-a8e576836541 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:58.556951 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-85635bf7-000b-4f6a-b92a-b3d53f6c1057 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:58.557983 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-85635bf7-000b-4f6a-b92a-b3d53f6c1057 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 06b5db2c-baea-4e51-8506-6443bbd9daeb] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:58.570893 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-85635bf7-000b-4f6a-b92a-b3d53f6c1057 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:58.571786 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-85635bf7-000b-4f6a-b92a-b3d53f6c1057 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:58.572285 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-85635bf7-000b-4f6a-b92a-b3d53f6c1057 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:58.573033 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-85635bf7-000b-4f6a-b92a-b3d53f6c1057 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:58.576201 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-85635bf7-000b-4f6a-b92a-b3d53f6c1057 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:58.576662 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-85635bf7-000b-4f6a-b92a-b3d53f6c1057 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:58.677991 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a174b904-8149-4cc1-a6cb-a8e576836541 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:40:58.690315 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a174b904-8149-4cc1-a6cb-a8e576836541 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1519 microversion: 2.1 time: 0.221442 Oct 19 03:40:58.691135 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2831/5579] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:40:58 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1519 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:40:58.700384 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-85635bf7-000b-4f6a-b92a-b3d53f6c1057 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:58.700913 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-85635bf7-000b-4f6a-b92a-b3d53f6c1057 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:58.701387 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-85635bf7-000b-4f6a-b92a-b3d53f6c1057 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:58.703071 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-85635bf7-000b-4f6a-b92a-b3d53f6c1057 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lazy-loading 'fault' on Instance uuid 06b5db2c-baea-4e51-8506-6443bbd9daeb {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:40:58.762209 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-85635bf7-000b-4f6a-b92a-b3d53f6c1057 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4729a0afd69480f99642266e0eec17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce5e9f9a4644b27a24b2f4c06df97bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:40:58.768203 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=100 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:40:58.805146 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-85635bf7-000b-4f6a-b92a-b3d53f6c1057 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/06b5db2c-baea-4e51-8506-6443bbd9daeb" status: 200 len: 1312 microversion: 2.1 time: 0.250655 Oct 19 03:40:58.808113 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2749/5580] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:40:58 2022] GET /compute/v2.1/servers/06b5db2c-baea-4e51-8506-6443bbd9daeb => generated 1312 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:40:58.864193 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-96f70e73-3a9c-4172-96fa-22d99968c472 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:58.864931 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-96f70e73-3a9c-4172-96fa-22d99968c472 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 7e633743-2b38-4c08-be9e-fdfde600b48b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:58.875334 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-96f70e73-3a9c-4172-96fa-22d99968c472 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:58.884412 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-96f70e73-3a9c-4172-96fa-22d99968c472 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:58.885160 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-96f70e73-3a9c-4172-96fa-22d99968c472 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:58.886178 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-96f70e73-3a9c-4172-96fa-22d99968c472 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:58.886784 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-96f70e73-3a9c-4172-96fa-22d99968c472 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:58.887461 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-96f70e73-3a9c-4172-96fa-22d99968c472 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:59.089854 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-96f70e73-3a9c-4172-96fa-22d99968c472 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:40:59.099982 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-96f70e73-3a9c-4172-96fa-22d99968c472 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b" status: 200 len: 1529 microversion: 2.1 time: 0.239920 Oct 19 03:40:59.100565 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2832/5581] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:40:58 2022] GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b => generated 1529 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:40:59.718652 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c09728ca-13d4-4230-bdc6-f1047f5e4582 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:59.719360 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c09728ca-13d4-4230-bdc6-f1047f5e4582 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:59.731311 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c09728ca-13d4-4230-bdc6-f1047f5e4582 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:59.731311 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c09728ca-13d4-4230-bdc6-f1047f5e4582 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:59.731311 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c09728ca-13d4-4230-bdc6-f1047f5e4582 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:59.731311 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c09728ca-13d4-4230-bdc6-f1047f5e4582 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:59.731311 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c09728ca-13d4-4230-bdc6-f1047f5e4582 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:59.731311 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c09728ca-13d4-4230-bdc6-f1047f5e4582 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:59.840842 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2ad5dfc8-278f-4086-9720-c63100f3e2ef tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:59.842005 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-2ad5dfc8-278f-4086-9720-c63100f3e2ef tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 06b5db2c-baea-4e51-8506-6443bbd9daeb] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:59.882177 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2ad5dfc8-278f-4086-9720-c63100f3e2ef tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:59.882177 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2ad5dfc8-278f-4086-9720-c63100f3e2ef tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:59.882177 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2ad5dfc8-278f-4086-9720-c63100f3e2ef tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:59.882177 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2ad5dfc8-278f-4086-9720-c63100f3e2ef tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:59.882177 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2ad5dfc8-278f-4086-9720-c63100f3e2ef tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:59.882177 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2ad5dfc8-278f-4086-9720-c63100f3e2ef tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:59.923242 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-2ad5dfc8-278f-4086-9720-c63100f3e2ef tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] HTTP exception thrown: Instance 06b5db2c-baea-4e51-8506-6443bbd9daeb could not be found. Oct 19 03:40:59.924961 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2ad5dfc8-278f-4086-9720-c63100f3e2ef tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Request method failure captured: Oct 19 03:40:59.924961 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/06b5db2c-baea-4e51-8506-6443bbd9daeb HTTP/1.1 Oct 19 03:40:59.924961 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:40:59.924961 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:40:59.924961 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:40:59.924961 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:40:59.924961 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:40:59.924961 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:40:59.924961 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:40:59.924961 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:40:59.924961 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT3BmoEKz0EhW7NaUKeOkQsZRXl8ERfsAKAMxU0GUBdc2f_V_CqkDPpZu62NL2einDTJrDUFbtRF7OMHEg091oC7NSi4gfYN6KT9w4SCkkHNILzmL1G1frQPfKMrDDDqTbb0782yvc_4ZYCpfzt0d6J1jKWlIQL4vx50kauya3LDEzsA Oct 19 03:40:59.924961 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:40:59.924961 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:40:59.924961 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:40:59.924961 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:40:59.924961 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:40:59.924961 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:40:59.924961 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 2ce5e9f9a4644b27a24b2f4c06df97bc Oct 19 03:40:59.924961 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-684190061 Oct 19 03:40:59.924961 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:40:59.924961 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:40:59.924961 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2ce5e9f9a4644b27a24b2f4c06df97bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2ce5e9f9a4644b27a24b2f4c06df97bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2ce5e9f9a4644b27a24b2f4c06df97bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2ce5e9f9a4644b27a24b2f4c06df97bc", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:40:59.924961 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ServerRescueNegativeTestJSON-684190061 Oct 19 03:40:59.924961 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 2ce5e9f9a4644b27a24b2f4c06df97bc Oct 19 03:40:59.924961 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-684190061 Oct 19 03:40:59.924961 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ServerRescueNegativeTestJSON-684190061-project Oct 19 03:40:59.924961 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:40:59.924961 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:40:59.924961 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: b4729a0afd69480f99642266e0eec17e Oct 19 03:40:59.924961 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ServerRescueNegativeTestJSON-684190061-project Oct 19 03:40:59.924961 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:40:59.924961 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance 06b5db2c-baea-4e51-8506-6443bbd9daeb could not be found. Oct 19 03:40:59.924961 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '06b5db2c-baea-4e51-8506-6443bbd9daeb'} Oct 19 03:40:59.924961 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:40:59.924961 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:40:59.924961 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:40:59.924961 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:40:59.924961 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:40:59.924961 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:40:59.924961 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:40:59.924961 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:40:59.924961 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:40:59.924961 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:40:59.924961 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06b5db2c-baea-4e51-8506-6443bbd9daeb could not be found. Oct 19 03:40:59.924961 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:40:59.924961 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:40:59.924961 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:40:59.924961 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:40:59.924961 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:40:59.924961 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:40:59.924961 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:40:59.924961 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:40:59.924961 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:40:59.924961 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:40:59.924961 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:40:59.924961 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:40:59.924961 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:40:59.924961 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:40:59.924961 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:40:59.924961 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:40:59.924961 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06b5db2c-baea-4e51-8506-6443bbd9daeb could not be found. Oct 19 03:40:59.924961 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:40:59.924961 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:40:59.929351 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:40:59.929351 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:40:59.929351 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:40:59.929351 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:40:59.929351 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:40:59.929351 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:40:59.929351 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06b5db2c-baea-4e51-8506-6443bbd9daeb could not be found. Oct 19 03:40:59.929351 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:40:59.929351 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2ad5dfc8-278f-4086-9720-c63100f3e2ef tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Returning 404 to user: Instance 06b5db2c-baea-4e51-8506-6443bbd9daeb could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:40:59.933921 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2ad5dfc8-278f-4086-9720-c63100f3e2ef tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/06b5db2c-baea-4e51-8506-6443bbd9daeb" status: 404 len: 111 microversion: 2.1 time: 0.104769 Oct 19 03:40:59.934563 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2833/5582] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:40:59 2022] GET /compute/v2.1/servers/06b5db2c-baea-4e51-8506-6443bbd9daeb => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:40:59.947992 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-65d59124-ed67-4de9-b13b-61cde529f8b1 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:40:59.947992 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-65d59124-ed67-4de9-b13b-61cde529f8b1 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 8955f425-23eb-423e-8ed4-eea1bd5dbc08] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:40:59.956065 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-65d59124-ed67-4de9-b13b-61cde529f8b1 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:59.956789 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-65d59124-ed67-4de9-b13b-61cde529f8b1 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:59.957538 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-65d59124-ed67-4de9-b13b-61cde529f8b1 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:59.958414 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-65d59124-ed67-4de9-b13b-61cde529f8b1 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:40:59.959089 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-65d59124-ed67-4de9-b13b-61cde529f8b1 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:40:59.959721 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-65d59124-ed67-4de9-b13b-61cde529f8b1 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:40:59.969970 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c09728ca-13d4-4230-bdc6-f1047f5e4582 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:40:59.982558 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c09728ca-13d4-4230-bdc6-f1047f5e4582 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1519 microversion: 2.1 time: 0.268671 Oct 19 03:40:59.983789 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2750/5583] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:40:59 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1519 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:40:59.997829 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-65d59124-ed67-4de9-b13b-61cde529f8b1 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 8955f425-23eb-423e-8ed4-eea1bd5dbc08] Going to try to terminate instance {{(pid=121135) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:41:00.125785 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2c678204-f64c-459f-a154-050b0d76d125 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:00.131690 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2c678204-f64c-459f-a154-050b0d76d125 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 7e633743-2b38-4c08-be9e-fdfde600b48b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:41:00.144012 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2c678204-f64c-459f-a154-050b0d76d125 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:00.144012 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2c678204-f64c-459f-a154-050b0d76d125 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:00.144012 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2c678204-f64c-459f-a154-050b0d76d125 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:00.144714 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2c678204-f64c-459f-a154-050b0d76d125 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:00.144926 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2c678204-f64c-459f-a154-050b0d76d125 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:00.145691 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2c678204-f64c-459f-a154-050b0d76d125 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:00.353524 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-2c678204-f64c-459f-a154-050b0d76d125 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:41:00.364569 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2c678204-f64c-459f-a154-050b0d76d125 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b" status: 200 len: 1524 microversion: 2.1 time: 0.244804 Oct 19 03:41:00.379982 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2751/5584] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:41:00 2022] GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b => generated 1524 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:41:00.410406 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-65d59124-ed67-4de9-b13b-61cde529f8b1 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "DELETE /compute/v2.1/servers/8955f425-23eb-423e-8ed4-eea1bd5dbc08" status: 204 len: 0 microversion: 2.1 time: 0.470412 Oct 19 03:41:00.414247 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2834/5585] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:40:59 2022] DELETE /compute/v2.1/servers/8955f425-23eb-423e-8ed4-eea1bd5dbc08 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:41:00.419863 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-22ae5074-5691-4d4f-96ec-a48b6e8f2287 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:00.420957 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-22ae5074-5691-4d4f-96ec-a48b6e8f2287 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 8955f425-23eb-423e-8ed4-eea1bd5dbc08] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:41:00.428115 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-22ae5074-5691-4d4f-96ec-a48b6e8f2287 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:00.429234 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-22ae5074-5691-4d4f-96ec-a48b6e8f2287 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:00.437080 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-22ae5074-5691-4d4f-96ec-a48b6e8f2287 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:00.437994 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-22ae5074-5691-4d4f-96ec-a48b6e8f2287 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:00.438473 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-22ae5074-5691-4d4f-96ec-a48b6e8f2287 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:00.439096 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-22ae5074-5691-4d4f-96ec-a48b6e8f2287 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:00.642870 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-22ae5074-5691-4d4f-96ec-a48b6e8f2287 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4729a0afd69480f99642266e0eec17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce5e9f9a4644b27a24b2f4c06df97bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:41:00.657852 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-22ae5074-5691-4d4f-96ec-a48b6e8f2287 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/8955f425-23eb-423e-8ed4-eea1bd5dbc08" status: 200 len: 1523 microversion: 2.1 time: 0.242150 Oct 19 03:41:00.659995 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2752/5586] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:41:00 2022] GET /compute/v2.1/servers/8955f425-23eb-423e-8ed4-eea1bd5dbc08 => generated 1523 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:41:01.007926 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-37242414-5e54-4d5e-af79-5dbf62061e8c tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:01.008631 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-37242414-5e54-4d5e-af79-5dbf62061e8c tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:41:01.025558 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-37242414-5e54-4d5e-af79-5dbf62061e8c tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:01.026335 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-37242414-5e54-4d5e-af79-5dbf62061e8c tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:01.026952 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-37242414-5e54-4d5e-af79-5dbf62061e8c tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:01.027820 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-37242414-5e54-4d5e-af79-5dbf62061e8c tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:01.029005 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-37242414-5e54-4d5e-af79-5dbf62061e8c tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:01.030559 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-37242414-5e54-4d5e-af79-5dbf62061e8c tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:01.275137 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-37242414-5e54-4d5e-af79-5dbf62061e8c tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:41:01.284300 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-37242414-5e54-4d5e-af79-5dbf62061e8c tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1519 microversion: 2.1 time: 0.280988 Oct 19 03:41:01.289705 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2835/5587] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:41:01 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1519 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:41:01.399877 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c508407d-9ab2-4b25-bb73-c7d30ac141d6 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:01.400502 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c508407d-9ab2-4b25-bb73-c7d30ac141d6 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 7e633743-2b38-4c08-be9e-fdfde600b48b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:41:01.411029 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c508407d-9ab2-4b25-bb73-c7d30ac141d6 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:01.411914 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c508407d-9ab2-4b25-bb73-c7d30ac141d6 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:01.412555 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c508407d-9ab2-4b25-bb73-c7d30ac141d6 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:01.419321 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c508407d-9ab2-4b25-bb73-c7d30ac141d6 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:01.420347 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c508407d-9ab2-4b25-bb73-c7d30ac141d6 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:01.422144 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c508407d-9ab2-4b25-bb73-c7d30ac141d6 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:01.657267 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c508407d-9ab2-4b25-bb73-c7d30ac141d6 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:41:01.668299 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c508407d-9ab2-4b25-bb73-c7d30ac141d6 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b" status: 200 len: 1524 microversion: 2.1 time: 0.276599 Oct 19 03:41:01.668685 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2753/5588] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:41:01 2022] GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b => generated 1524 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:41:01.687768 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-87e26216-3de0-4583-852b-ea346d70b1e7 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:01.688856 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-87e26216-3de0-4583-852b-ea346d70b1e7 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 8955f425-23eb-423e-8ed4-eea1bd5dbc08] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:41:01.715534 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-87e26216-3de0-4583-852b-ea346d70b1e7 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:01.716495 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-87e26216-3de0-4583-852b-ea346d70b1e7 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:01.717204 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-87e26216-3de0-4583-852b-ea346d70b1e7 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:01.718245 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-87e26216-3de0-4583-852b-ea346d70b1e7 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:01.719004 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-87e26216-3de0-4583-852b-ea346d70b1e7 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:01.719646 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-87e26216-3de0-4583-852b-ea346d70b1e7 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:01.953391 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-87e26216-3de0-4583-852b-ea346d70b1e7 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4729a0afd69480f99642266e0eec17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce5e9f9a4644b27a24b2f4c06df97bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:41:01.962280 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-87e26216-3de0-4583-852b-ea346d70b1e7 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/8955f425-23eb-423e-8ed4-eea1bd5dbc08" status: 200 len: 1523 microversion: 2.1 time: 0.279467 Oct 19 03:41:01.963660 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2836/5589] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:41:01 2022] GET /compute/v2.1/servers/8955f425-23eb-423e-8ed4-eea1bd5dbc08 => generated 1523 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:41:02.317566 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5b63667d-e26e-4714-861b-8ae904db55c8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:02.318455 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5b63667d-e26e-4714-861b-8ae904db55c8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:41:02.324893 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5b63667d-e26e-4714-861b-8ae904db55c8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:02.326230 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5b63667d-e26e-4714-861b-8ae904db55c8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:02.326877 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5b63667d-e26e-4714-861b-8ae904db55c8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:02.327795 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5b63667d-e26e-4714-861b-8ae904db55c8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:02.328622 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5b63667d-e26e-4714-861b-8ae904db55c8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:02.329224 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5b63667d-e26e-4714-861b-8ae904db55c8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:02.497982 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5b63667d-e26e-4714-861b-8ae904db55c8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:41:02.528008 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5b63667d-e26e-4714-861b-8ae904db55c8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1519 microversion: 2.1 time: 0.214656 Oct 19 03:41:02.531704 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2754/5590] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:41:02 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1519 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:41:02.693692 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0bc6da49-10c1-4b41-a689-beb20c42f785 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:02.694411 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0bc6da49-10c1-4b41-a689-beb20c42f785 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 7e633743-2b38-4c08-be9e-fdfde600b48b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:41:02.718197 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0bc6da49-10c1-4b41-a689-beb20c42f785 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:02.721038 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0bc6da49-10c1-4b41-a689-beb20c42f785 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:02.721554 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0bc6da49-10c1-4b41-a689-beb20c42f785 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:02.727796 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0bc6da49-10c1-4b41-a689-beb20c42f785 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:02.728349 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0bc6da49-10c1-4b41-a689-beb20c42f785 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:02.728802 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0bc6da49-10c1-4b41-a689-beb20c42f785 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:02.939657 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-0bc6da49-10c1-4b41-a689-beb20c42f785 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:41:02.958294 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0bc6da49-10c1-4b41-a689-beb20c42f785 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b" status: 200 len: 1524 microversion: 2.1 time: 0.270550 Oct 19 03:41:02.959133 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2837/5591] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:41:02 2022] GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b => generated 1524 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:41:02.988375 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5c76d802-6a33-4820-9bff-06b2a92ef16a tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:02.989413 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5c76d802-6a33-4820-9bff-06b2a92ef16a tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 8955f425-23eb-423e-8ed4-eea1bd5dbc08] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:41:03.010280 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5c76d802-6a33-4820-9bff-06b2a92ef16a tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:03.011093 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5c76d802-6a33-4820-9bff-06b2a92ef16a tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:03.011753 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5c76d802-6a33-4820-9bff-06b2a92ef16a tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:03.012676 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5c76d802-6a33-4820-9bff-06b2a92ef16a tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:03.013133 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5c76d802-6a33-4820-9bff-06b2a92ef16a tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:03.013680 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5c76d802-6a33-4820-9bff-06b2a92ef16a tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:03.183621 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5c76d802-6a33-4820-9bff-06b2a92ef16a tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4729a0afd69480f99642266e0eec17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce5e9f9a4644b27a24b2f4c06df97bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:41:03.192824 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5c76d802-6a33-4820-9bff-06b2a92ef16a tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/8955f425-23eb-423e-8ed4-eea1bd5dbc08" status: 200 len: 1523 microversion: 2.1 time: 0.208335 Oct 19 03:41:03.193759 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2755/5592] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:41:02 2022] GET /compute/v2.1/servers/8955f425-23eb-423e-8ed4-eea1bd5dbc08 => generated 1523 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:41:03.556878 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a23c20e9-d893-47c2-92ac-ae1ed030ee11 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:03.557827 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a23c20e9-d893-47c2-92ac-ae1ed030ee11 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:41:03.569620 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a23c20e9-d893-47c2-92ac-ae1ed030ee11 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:03.577722 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a23c20e9-d893-47c2-92ac-ae1ed030ee11 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:03.578492 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a23c20e9-d893-47c2-92ac-ae1ed030ee11 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:03.579663 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a23c20e9-d893-47c2-92ac-ae1ed030ee11 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:03.580315 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a23c20e9-d893-47c2-92ac-ae1ed030ee11 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:03.580951 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a23c20e9-d893-47c2-92ac-ae1ed030ee11 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:03.986378 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5dd44060-a530-4966-89f1-5b9d59b45ddf tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:03.992697 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5dd44060-a530-4966-89f1-5b9d59b45ddf tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 7e633743-2b38-4c08-be9e-fdfde600b48b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:41:04.014204 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5dd44060-a530-4966-89f1-5b9d59b45ddf tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:04.014969 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5dd44060-a530-4966-89f1-5b9d59b45ddf tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:04.015455 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5dd44060-a530-4966-89f1-5b9d59b45ddf tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:04.016195 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5dd44060-a530-4966-89f1-5b9d59b45ddf tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:04.016658 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5dd44060-a530-4966-89f1-5b9d59b45ddf tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:04.017091 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5dd44060-a530-4966-89f1-5b9d59b45ddf tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:04.018669 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a23c20e9-d893-47c2-92ac-ae1ed030ee11 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:41:04.055909 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a23c20e9-d893-47c2-92ac-ae1ed030ee11 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1506 microversion: 2.1 time: 0.503098 Oct 19 03:41:04.063647 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2838/5593] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:41:03 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1506 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:41:04.064833 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-d0a30694-5007-4499-8ea0-cff1cb80841c req-a05b998c-9599-4426-be24-85e08dcc1db5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8955f425-23eb-423e-8ed4-eea1bd5dbc08", "name": "network-vif-deleted", "tag": "c7d4574f-83f0-421d-a051-54cd58016e11"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:41:04.082125 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-d0a30694-5007-4499-8ea0-cff1cb80841c req-a05b998c-9599-4426-be24-85e08dcc1db5 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:04.083193 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-d0a30694-5007-4499-8ea0-cff1cb80841c req-a05b998c-9599-4426-be24-85e08dcc1db5 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:04.084578 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-d0a30694-5007-4499-8ea0-cff1cb80841c req-a05b998c-9599-4426-be24-85e08dcc1db5 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:04.117814 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-d0a30694-5007-4499-8ea0-cff1cb80841c req-a05b998c-9599-4426-be24-85e08dcc1db5 service nova] Creating event network-vif-deleted:c7d4574f-83f0-421d-a051-54cd58016e11 for instance 8955f425-23eb-423e-8ed4-eea1bd5dbc08 on n-h1-861333-8 Oct 19 03:41:04.128327 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-d0a30694-5007-4499-8ea0-cff1cb80841c req-a05b998c-9599-4426-be24-85e08dcc1db5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068954 Oct 19 03:41:04.129849 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2839/5594] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:41:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:41:04.141448 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b853b624-6326-40f8-b453-e8dd66a16115 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:04.142525 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b853b624-6326-40f8-b453-e8dd66a16115 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:41:04.159668 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b853b624-6326-40f8-b453-e8dd66a16115 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:04.160522 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b853b624-6326-40f8-b453-e8dd66a16115 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:04.161345 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b853b624-6326-40f8-b453-e8dd66a16115 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:04.162325 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b853b624-6326-40f8-b453-e8dd66a16115 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:04.163014 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b853b624-6326-40f8-b453-e8dd66a16115 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:04.164717 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b853b624-6326-40f8-b453-e8dd66a16115 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:04.258306 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5dd44060-a530-4966-89f1-5b9d59b45ddf tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:41:04.275776 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5dd44060-a530-4966-89f1-5b9d59b45ddf tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b" status: 200 len: 1524 microversion: 2.1 time: 0.294541 Oct 19 03:41:04.281959 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2756/5595] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:41:03 2022] GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b => generated 1524 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:41:04.296336 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4eaca9e6-2f86-463f-90e1-8efcbb809bbb tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:04.296981 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4eaca9e6-2f86-463f-90e1-8efcbb809bbb tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 8955f425-23eb-423e-8ed4-eea1bd5dbc08] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:41:04.333386 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4eaca9e6-2f86-463f-90e1-8efcbb809bbb tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:04.341527 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4eaca9e6-2f86-463f-90e1-8efcbb809bbb tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:04.341527 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4eaca9e6-2f86-463f-90e1-8efcbb809bbb tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:04.341527 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4eaca9e6-2f86-463f-90e1-8efcbb809bbb tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:04.341527 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4eaca9e6-2f86-463f-90e1-8efcbb809bbb tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:04.341527 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4eaca9e6-2f86-463f-90e1-8efcbb809bbb tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:04.511713 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-4eaca9e6-2f86-463f-90e1-8efcbb809bbb tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4729a0afd69480f99642266e0eec17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce5e9f9a4644b27a24b2f4c06df97bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:41:04.538817 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4eaca9e6-2f86-463f-90e1-8efcbb809bbb tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/8955f425-23eb-423e-8ed4-eea1bd5dbc08" status: 200 len: 1307 microversion: 2.1 time: 0.255689 Oct 19 03:41:04.555280 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2757/5596] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:41:04 2022] GET /compute/v2.1/servers/8955f425-23eb-423e-8ed4-eea1bd5dbc08 => generated 1307 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:41:04.570884 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b853b624-6326-40f8-b453-e8dd66a16115 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:41:04.580013 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b853b624-6326-40f8-b453-e8dd66a16115 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1506 microversion: 2.1 time: 0.444607 Oct 19 03:41:04.603360 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2840/5597] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:41:04 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1506 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:41:04.615230 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ee1bca71-8336-475a-a577-8b6d8c8105af tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:04.616356 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ee1bca71-8336-475a-a577-8b6d8c8105af tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:41:04.623405 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ee1bca71-8336-475a-a577-8b6d8c8105af tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:04.623910 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ee1bca71-8336-475a-a577-8b6d8c8105af tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:04.624357 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ee1bca71-8336-475a-a577-8b6d8c8105af tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:04.625074 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ee1bca71-8336-475a-a577-8b6d8c8105af tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:04.625574 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ee1bca71-8336-475a-a577-8b6d8c8105af tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:04.626008 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ee1bca71-8336-475a-a577-8b6d8c8105af tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:04.817128 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ee1bca71-8336-475a-a577-8b6d8c8105af tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:41:04.830876 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ee1bca71-8336-475a-a577-8b6d8c8105af tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1506 microversion: 2.1 time: 0.222268 Oct 19 03:41:04.841831 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2758/5598] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:41:04 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1506 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:41:04.844321 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-8364cfc9-4322-4c71-8fe4-4bb34072fa52 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:04.844830 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-8364cfc9-4322-4c71-8fe4-4bb34072fa52 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] [instance: 1f354001-86ee-4951-a9cb-23fcd9e678a9] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:41:04.851636 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8364cfc9-4322-4c71-8fe4-4bb34072fa52 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:04.852400 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8364cfc9-4322-4c71-8fe4-4bb34072fa52 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:04.853104 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8364cfc9-4322-4c71-8fe4-4bb34072fa52 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:04.854171 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8364cfc9-4322-4c71-8fe4-4bb34072fa52 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:04.854890 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8364cfc9-4322-4c71-8fe4-4bb34072fa52 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:04.855579 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8364cfc9-4322-4c71-8fe4-4bb34072fa52 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:04.869115 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c7ce0e10-afd5-4bfe-963d-e6609474f627 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:41:04.877769 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-8364cfc9-4322-4c71-8fe4-4bb34072fa52 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] HTTP exception thrown: Instance 1f354001-86ee-4951-a9cb-23fcd9e678a9 could not be found. Oct 19 03:41:04.879955 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-8364cfc9-4322-4c71-8fe4-4bb34072fa52 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Request method failure captured: Oct 19 03:41:04.879955 n-d-861333-8 devstack@n-api.service[121135]: request: DELETE /compute/v2.1/servers/1f354001-86ee-4951-a9cb-23fcd9e678a9 HTTP/1.1 Oct 19 03:41:04.879955 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:41:04.879955 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:41:04.879955 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:41:04.879955 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:41:04.879955 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:41:04.879955 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:41:04.879955 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:41:04.879955 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:41:04.879955 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT3A-J8gkSeK-jC5SkwldeX2fzHDW9yQloVnq9w2JWN_JbOIlJSI50_hnA7Y-GPIEwyuvwrDEjFnM41r0iLy-FdL3R3ciqTPdXWgB2rbzESKYvw_2cPHI89nLZNBftmcKk7VKZvl3lBPw28mJ2rNa1xBb7pb4TRKC6xWHwLh7-7tORZ4 Oct 19 03:41:04.879955 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:41:04.879955 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:41:04.879955 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:41:04.879955 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:41:04.879955 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:41:04.879955 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:41:04.879955 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: fa4001edd1474947a94243a620a6013a Oct 19 03:41:04.879955 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-AttachVolumeTestJSON-691414608 Oct 19 03:41:04.879955 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:41:04.879955 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:41:04.879955 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/fa4001edd1474947a94243a620a6013a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fa4001edd1474947a94243a620a6013a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fa4001edd1474947a94243a620a6013a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_fa4001edd1474947a94243a620a6013a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:41:04.879955 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-AttachVolumeTestJSON-691414608 Oct 19 03:41:04.879955 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: fa4001edd1474947a94243a620a6013a Oct 19 03:41:04.879955 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-AttachVolumeTestJSON-691414608 Oct 19 03:41:04.879955 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-AttachVolumeTestJSON-691414608-project Oct 19 03:41:04.879955 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:41:04.879955 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:41:04.879955 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 4c65a497e16e4e41b5cf1287042f3a68 Oct 19 03:41:04.879955 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-AttachVolumeTestJSON-691414608-project Oct 19 03:41:04.879955 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:41:04.879955 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance 1f354001-86ee-4951-a9cb-23fcd9e678a9 could not be found. Oct 19 03:41:04.879955 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '1f354001-86ee-4951-a9cb-23fcd9e678a9'} Oct 19 03:41:04.879955 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:41:04.879955 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:41:04.879955 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:41:04.879955 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:41:04.879955 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:41:04.879955 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:41:04.879955 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:41:04.879955 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:41:04.879955 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:41:04.879955 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:41:04.879955 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f354001-86ee-4951-a9cb-23fcd9e678a9 could not be found. Oct 19 03:41:04.879955 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:41:04.879955 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:41:04.879955 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:41:04.879955 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:41:04.879955 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:41:04.879955 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:41:04.879955 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:41:04.879955 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:41:04.879955 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:41:04.879955 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:41:04.879955 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 03:41:04.879955 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 03:41:04.879955 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 03:41:04.879955 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 03:41:04.879955 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:41:04.879955 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:41:04.879955 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:41:04.879955 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:41:04.883804 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f354001-86ee-4951-a9cb-23fcd9e678a9 could not be found. Oct 19 03:41:04.883804 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:41:04.883804 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:41:04.883804 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:41:04.883804 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:41:04.883804 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:41:04.883804 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:41:04.883804 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:41:04.883804 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:41:04.883804 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f354001-86ee-4951-a9cb-23fcd9e678a9 could not be found. Oct 19 03:41:04.883804 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:41:04.884476 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-c7ce0e10-afd5-4bfe-963d-e6609474f627 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] HTTP exception thrown: Instance fb878c34-7361-46b8-9561-1e5c12ae1478 has no mapping to a cell. Oct 19 03:41:04.885977 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-8364cfc9-4322-4c71-8fe4-4bb34072fa52 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Returning 404 to user: Instance 1f354001-86ee-4951-a9cb-23fcd9e678a9 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:41:04.894181 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-8364cfc9-4322-4c71-8fe4-4bb34072fa52 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1f354001-86ee-4951-a9cb-23fcd9e678a9" status: 404 len: 111 microversion: 2.1 time: 0.047911 Oct 19 03:41:04.894181 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2841/5599] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:41:04 2022] DELETE /compute/v2.1/servers/1f354001-86ee-4951-a9cb-23fcd9e678a9 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:41:04.894396 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c7ce0e10-afd5-4bfe-963d-e6609474f627 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Request method failure captured: Oct 19 03:41:04.894396 n-d-861333-8 devstack@n-api.service[121134]: request: POST /compute/v2.1/servers/fb878c34-7361-46b8-9561-1e5c12ae1478/action HTTP/1.1 Oct 19 03:41:04.894396 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:41:04.894396 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:41:04.894396 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:41:04.894396 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 15 Oct 19 03:41:04.894396 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:41:04.894396 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:41:04.894396 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:41:04.894396 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:41:04.894396 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3EK4yDar5R5kGdpWRPopK281fOgxjiWCAZdy3tbDZzFYZxrN53hSsTq0YyAxsfcVRT4cF0jU61e6walOKxMx_njT0L3WOIYEymBjzmNzdXOa-UhYNf83BpQOShCJts2aNodNdu7YjeLcAcuRF0ZOjoH0xsH4HoNSzc8IfQzKhRz4vw Oct 19 03:41:04.894396 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:41:04.894396 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:41:04.894396 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:41:04.894396 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:41:04.894396 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:41:04.894396 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:41:04.894396 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 34bd94983fbf4a8aa49aff65c076e9e3 Oct 19 03:41:04.894396 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:41:04.894396 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:41:04.894396 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:41:04.894396 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_34bd94983fbf4a8aa49aff65c076e9e3", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:41:04.894396 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:41:04.894396 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 34bd94983fbf4a8aa49aff65c076e9e3 Oct 19 03:41:04.894396 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:41:04.894396 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ServersNegativeTestJSON-553742303-project Oct 19 03:41:04.894396 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:41:04.894396 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:41:04.894396 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 771feb133bc046588552d3af98f8e0a1 Oct 19 03:41:04.894396 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ServersNegativeTestJSON-553742303-project Oct 19 03:41:04.894396 n-d-861333-8 devstack@n-api.service[121134]: Oct 19 03:41:04.894396 n-d-861333-8 devstack@n-api.service[121134]: {"os-stop": {}} Oct 19 03:41:04.894396 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:41:04.894396 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance fb878c34-7361-46b8-9561-1e5c12ae1478 has no mapping to a cell. Oct 19 03:41:04.894396 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': 'fb878c34-7361-46b8-9561-1e5c12ae1478', 'body': {'os-stop': {}}} Oct 19 03:41:04.894396 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:41:04.894396 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:41:04.894396 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1411, in _get_instance Oct 19 03:41:04.894396 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Oct 19 03:41:04.894396 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 03:41:04.894396 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 03:41:04.894396 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Oct 19 03:41:04.894396 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Oct 19 03:41:04.894396 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 19 03:41:04.894396 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 19 03:41:04.894396 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Oct 19 03:41:04.894396 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Oct 19 03:41:04.894396 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance fb878c34-7361-46b8-9561-1e5c12ae1478 has no mapping to a cell. Oct 19 03:41:04.894396 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:41:04.894396 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:41:04.894396 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:41:04.894396 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:41:04.894396 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:41:04.894396 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:41:04.894396 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:41:04.894396 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:41:04.894396 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:41:04.894396 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:41:04.894396 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1444, in _stop_server Oct 19 03:41:04.894396 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Oct 19 03:41:04.894396 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1418, in _get_instance Oct 19 03:41:04.894396 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:41:04.894396 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb878c34-7361-46b8-9561-1e5c12ae1478 has no mapping to a cell. Oct 19 03:41:04.898291 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:41:04.898291 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:41:04.898291 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:41:04.898291 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:41:04.898291 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:41:04.898291 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:41:04.898291 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:41:04.898291 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:41:04.898291 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb878c34-7361-46b8-9561-1e5c12ae1478 has no mapping to a cell. Oct 19 03:41:04.898291 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:41:04.898291 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c7ce0e10-afd5-4bfe-963d-e6609474f627 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Returning 404 to user: Instance fb878c34-7361-46b8-9561-1e5c12ae1478 has no mapping to a cell. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:41:04.898291 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c7ce0e10-afd5-4bfe-963d-e6609474f627 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "POST /compute/v2.1/servers/fb878c34-7361-46b8-9561-1e5c12ae1478/action" status: 404 len: 117 microversion: 2.1 time: 0.033751 Oct 19 03:41:04.898941 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-903cfde0-adc6-457a-83d4-7a91d2aefbd0 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:04.898941 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-903cfde0-adc6-457a-83d4-7a91d2aefbd0 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] [instance: 1f354001-86ee-4951-a9cb-23fcd9e678a9] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:41:04.899625 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2759/5600] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:41:04 2022] POST /compute/v2.1/servers/fb878c34-7361-46b8-9561-1e5c12ae1478/action => generated 117 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:41:04.905093 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-903cfde0-adc6-457a-83d4-7a91d2aefbd0 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:04.906668 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-903cfde0-adc6-457a-83d4-7a91d2aefbd0 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:04.907223 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-903cfde0-adc6-457a-83d4-7a91d2aefbd0 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:04.908034 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-903cfde0-adc6-457a-83d4-7a91d2aefbd0 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:04.908603 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-903cfde0-adc6-457a-83d4-7a91d2aefbd0 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:04.909146 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-903cfde0-adc6-457a-83d4-7a91d2aefbd0 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:04.910196 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6714e656-6094-4762-b50a-3037c8d97078 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:04.916552 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6714e656-6094-4762-b50a-3037c8d97078 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:41:04.930599 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-903cfde0-adc6-457a-83d4-7a91d2aefbd0 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] HTTP exception thrown: Instance 1f354001-86ee-4951-a9cb-23fcd9e678a9 could not be found. Oct 19 03:41:04.932320 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6714e656-6094-4762-b50a-3037c8d97078 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:04.944370 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-903cfde0-adc6-457a-83d4-7a91d2aefbd0 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Request method failure captured: Oct 19 03:41:04.944370 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/1f354001-86ee-4951-a9cb-23fcd9e678a9 HTTP/1.1 Oct 19 03:41:04.944370 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:41:04.944370 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:41:04.944370 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:41:04.944370 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:41:04.944370 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:41:04.944370 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:41:04.944370 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:41:04.944370 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:41:04.944370 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT3A-J8gkSeK-jC5SkwldeX2fzHDW9yQloVnq9w2JWN_JbOIlJSI50_hnA7Y-GPIEwyuvwrDEjFnM41r0iLy-FdL3R3ciqTPdXWgB2rbzESKYvw_2cPHI89nLZNBftmcKk7VKZvl3lBPw28mJ2rNa1xBb7pb4TRKC6xWHwLh7-7tORZ4 Oct 19 03:41:04.944370 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:41:04.944370 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:41:04.944370 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:41:04.944370 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:41:04.944370 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:41:04.944370 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:41:04.944370 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: fa4001edd1474947a94243a620a6013a Oct 19 03:41:04.944370 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-AttachVolumeTestJSON-691414608 Oct 19 03:41:04.944370 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:41:04.944370 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:41:04.944370 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/fa4001edd1474947a94243a620a6013a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fa4001edd1474947a94243a620a6013a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fa4001edd1474947a94243a620a6013a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_fa4001edd1474947a94243a620a6013a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:41:04.944370 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-AttachVolumeTestJSON-691414608 Oct 19 03:41:04.944370 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: fa4001edd1474947a94243a620a6013a Oct 19 03:41:04.944370 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-AttachVolumeTestJSON-691414608 Oct 19 03:41:04.944370 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-AttachVolumeTestJSON-691414608-project Oct 19 03:41:04.944370 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:41:04.944370 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:41:04.944370 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 4c65a497e16e4e41b5cf1287042f3a68 Oct 19 03:41:04.944370 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-AttachVolumeTestJSON-691414608-project Oct 19 03:41:04.944370 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:41:04.944370 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance 1f354001-86ee-4951-a9cb-23fcd9e678a9 could not be found. Oct 19 03:41:04.944370 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '1f354001-86ee-4951-a9cb-23fcd9e678a9'} Oct 19 03:41:04.944370 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:41:04.944370 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:41:04.944370 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:41:04.944370 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:41:04.944370 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:41:04.944370 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:41:04.944370 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:41:04.944370 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:41:04.944370 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:41:04.944370 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:41:04.944370 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f354001-86ee-4951-a9cb-23fcd9e678a9 could not be found. Oct 19 03:41:04.944370 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:41:04.944370 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:41:04.944370 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:41:04.944370 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:41:04.944370 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:41:04.944370 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:41:04.944370 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:41:04.944370 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:41:04.944370 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:41:04.944370 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:41:04.944370 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:41:04.944370 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:41:04.944370 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:41:04.944370 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:41:04.944370 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:41:04.944370 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:41:04.944370 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f354001-86ee-4951-a9cb-23fcd9e678a9 could not be found. Oct 19 03:41:04.944370 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:41:04.944370 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:41:04.944370 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:41:04.947896 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:41:04.947896 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:41:04.947896 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:41:04.947896 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:41:04.947896 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:41:04.947896 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f354001-86ee-4951-a9cb-23fcd9e678a9 could not be found. Oct 19 03:41:04.947896 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:41:04.948370 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6714e656-6094-4762-b50a-3037c8d97078 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:04.948447 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-903cfde0-adc6-457a-83d4-7a91d2aefbd0 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Returning 404 to user: Instance 1f354001-86ee-4951-a9cb-23fcd9e678a9 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:41:04.948526 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6714e656-6094-4762-b50a-3037c8d97078 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:04.948605 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-903cfde0-adc6-457a-83d4-7a91d2aefbd0 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] 10.222.0.52 "GET /compute/v2.1/servers/1f354001-86ee-4951-a9cb-23fcd9e678a9" status: 404 len: 111 microversion: 2.1 time: 0.042123 Oct 19 03:41:04.948605 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2842/5601] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:41:04 2022] GET /compute/v2.1/servers/1f354001-86ee-4951-a9cb-23fcd9e678a9 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 03:41:04.949205 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6714e656-6094-4762-b50a-3037c8d97078 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:04.949205 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6714e656-6094-4762-b50a-3037c8d97078 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:04.949205 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6714e656-6094-4762-b50a-3037c8d97078 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:05.149352 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-6714e656-6094-4762-b50a-3037c8d97078 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:41:05.161691 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6714e656-6094-4762-b50a-3037c8d97078 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1506 microversion: 2.1 time: 0.260505 Oct 19 03:41:05.162408 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2760/5602] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:41:04 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1506 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:41:05.189692 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4c0aa173-e903-4838-8f52-26dab25ed87d tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:05.190827 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4c0aa173-e903-4838-8f52-26dab25ed87d tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:41:05.205149 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4c0aa173-e903-4838-8f52-26dab25ed87d tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:05.212609 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4c0aa173-e903-4838-8f52-26dab25ed87d tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:05.227085 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4c0aa173-e903-4838-8f52-26dab25ed87d tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:05.231806 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4c0aa173-e903-4838-8f52-26dab25ed87d tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:05.231806 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4c0aa173-e903-4838-8f52-26dab25ed87d tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:05.231806 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4c0aa173-e903-4838-8f52-26dab25ed87d tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:05.312968 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4562d8bd-5c3f-41fd-9cae-2a5ca71f0966 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:05.316435 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4562d8bd-5c3f-41fd-9cae-2a5ca71f0966 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 7e633743-2b38-4c08-be9e-fdfde600b48b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:41:05.327517 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4562d8bd-5c3f-41fd-9cae-2a5ca71f0966 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:05.332666 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4562d8bd-5c3f-41fd-9cae-2a5ca71f0966 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:05.333267 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4562d8bd-5c3f-41fd-9cae-2a5ca71f0966 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:05.334488 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4562d8bd-5c3f-41fd-9cae-2a5ca71f0966 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:05.334969 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4562d8bd-5c3f-41fd-9cae-2a5ca71f0966 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:05.335407 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4562d8bd-5c3f-41fd-9cae-2a5ca71f0966 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:05.820320 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4c0aa173-e903-4838-8f52-26dab25ed87d tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:41:05.828897 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4c0aa173-e903-4838-8f52-26dab25ed87d tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1506 microversion: 2.1 time: 0.643018 Oct 19 03:41:05.829510 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2843/5603] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:41:05 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1506 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:41:05.870717 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-650b4a7a-7f61-4c3f-abe5-d814368172f7 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:05.871348 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-650b4a7a-7f61-4c3f-abe5-d814368172f7 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] [instance: 8955f425-23eb-423e-8ed4-eea1bd5dbc08] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:41:05.900252 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-4562d8bd-5c3f-41fd-9cae-2a5ca71f0966 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:41:05.909627 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=3 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:41:05.914360 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-650b4a7a-7f61-4c3f-abe5-d814368172f7 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:05.914826 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-650b4a7a-7f61-4c3f-abe5-d814368172f7 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:05.918111 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-650b4a7a-7f61-4c3f-abe5-d814368172f7 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:05.918282 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4562d8bd-5c3f-41fd-9cae-2a5ca71f0966 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b" status: 200 len: 1524 microversion: 2.1 time: 0.611198 Oct 19 03:41:05.920116 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-650b4a7a-7f61-4c3f-abe5-d814368172f7 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:05.921750 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-650b4a7a-7f61-4c3f-abe5-d814368172f7 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:05.922199 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-650b4a7a-7f61-4c3f-abe5-d814368172f7 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:05.923375 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2761/5604] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:41:05 2022] GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b => generated 1524 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:41:05.948136 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8e38e646-290b-4d4a-ad0a-094db2336749 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:41:05.949102 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8e38e646-290b-4d4a-ad0a-094db2336749 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 19681648-7bad-4752-aafa-27008c8d4230] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:41:05.968466 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-650b4a7a-7f61-4c3f-abe5-d814368172f7 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] HTTP exception thrown: Instance 8955f425-23eb-423e-8ed4-eea1bd5dbc08 could not be found. Oct 19 03:41:05.968673 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-8e38e646-290b-4d4a-ad0a-094db2336749 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] HTTP exception thrown: Instance 19681648-7bad-4752-aafa-27008c8d4230 could not be found. Oct 19 03:41:05.970657 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-650b4a7a-7f61-4c3f-abe5-d814368172f7 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Request method failure captured: Oct 19 03:41:05.970657 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/8955f425-23eb-423e-8ed4-eea1bd5dbc08 HTTP/1.1 Oct 19 03:41:05.970657 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:41:05.970657 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:41:05.970657 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:41:05.970657 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:41:05.970657 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:41:05.970657 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:41:05.970657 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:41:05.970657 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:41:05.970657 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT3BmoEKz0EhW7NaUKeOkQsZRXl8ERfsAKAMxU0GUBdc2f_V_CqkDPpZu62NL2einDTJrDUFbtRF7OMHEg091oC7NSi4gfYN6KT9w4SCkkHNILzmL1G1frQPfKMrDDDqTbb0782yvc_4ZYCpfzt0d6J1jKWlIQL4vx50kauya3LDEzsA Oct 19 03:41:05.970657 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:41:05.970657 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:41:05.970657 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:41:05.970657 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:41:05.970657 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:41:05.970657 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:41:05.970657 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 2ce5e9f9a4644b27a24b2f4c06df97bc Oct 19 03:41:05.970657 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-684190061 Oct 19 03:41:05.970657 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:41:05.970657 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:41:05.970657 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2ce5e9f9a4644b27a24b2f4c06df97bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2ce5e9f9a4644b27a24b2f4c06df97bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2ce5e9f9a4644b27a24b2f4c06df97bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2ce5e9f9a4644b27a24b2f4c06df97bc", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:41:05.970657 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ServerRescueNegativeTestJSON-684190061 Oct 19 03:41:05.970657 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 2ce5e9f9a4644b27a24b2f4c06df97bc Oct 19 03:41:05.970657 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-684190061 Oct 19 03:41:05.970657 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ServerRescueNegativeTestJSON-684190061-project Oct 19 03:41:05.970657 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:41:05.970657 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:41:05.970657 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: b4729a0afd69480f99642266e0eec17e Oct 19 03:41:05.970657 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ServerRescueNegativeTestJSON-684190061-project Oct 19 03:41:05.970657 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:41:05.970657 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance 8955f425-23eb-423e-8ed4-eea1bd5dbc08 could not be found. Oct 19 03:41:05.970657 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '8955f425-23eb-423e-8ed4-eea1bd5dbc08'} Oct 19 03:41:05.970657 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:41:05.970657 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:41:05.970657 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:41:05.970657 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:41:05.970657 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:41:05.970657 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:41:05.970657 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:41:05.970657 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:41:05.970657 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:41:05.970657 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:41:05.970657 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8955f425-23eb-423e-8ed4-eea1bd5dbc08 could not be found. Oct 19 03:41:05.970657 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:41:05.970657 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:41:05.970657 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:41:05.970657 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:41:05.970657 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:41:05.970657 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:41:05.970657 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:41:05.970657 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:41:05.970657 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:41:05.970657 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:41:05.970657 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:41:05.970657 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:41:05.970657 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:41:05.970657 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:41:05.970657 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:41:05.970657 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:41:05.970657 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8955f425-23eb-423e-8ed4-eea1bd5dbc08 could not be found. Oct 19 03:41:05.970657 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:41:05.970657 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:41:05.979090 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:41:05.979090 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:41:05.979090 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:41:05.979090 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:41:05.979090 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:41:05.979090 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:41:05.979090 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8955f425-23eb-423e-8ed4-eea1bd5dbc08 could not be found. Oct 19 03:41:05.979090 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:41:05.979090 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-650b4a7a-7f61-4c3f-abe5-d814368172f7 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] Returning 404 to user: Instance 8955f425-23eb-423e-8ed4-eea1bd5dbc08 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:41:05.979090 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-650b4a7a-7f61-4c3f-abe5-d814368172f7 tempest-ServerRescueNegativeTestJSON-684190061 tempest-ServerRescueNegativeTestJSON-684190061-project] 10.222.0.52 "GET /compute/v2.1/servers/8955f425-23eb-423e-8ed4-eea1bd5dbc08" status: 404 len: 111 microversion: 2.1 time: 0.125433 Oct 19 03:41:05.979090 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2844/5605] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:41:05 2022] GET /compute/v2.1/servers/8955f425-23eb-423e-8ed4-eea1bd5dbc08 => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:41:05.979910 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8e38e646-290b-4d4a-ad0a-094db2336749 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Request method failure captured: Oct 19 03:41:05.979910 n-d-861333-8 devstack@n-api.service[121134]: request: POST /compute/v2.1/servers/19681648-7bad-4752-aafa-27008c8d4230/action HTTP/1.1 Oct 19 03:41:05.979910 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:41:05.979910 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:41:05.979910 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:41:05.979910 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 15 Oct 19 03:41:05.979910 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:41:05.979910 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:41:05.979910 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:41:05.979910 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:41:05.979910 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3EK4yDar5R5kGdpWRPopK281fOgxjiWCAZdy3tbDZzFYZxrN53hSsTq0YyAxsfcVRT4cF0jU61e6walOKxMx_njT0L3WOIYEymBjzmNzdXOa-UhYNf83BpQOShCJts2aNodNdu7YjeLcAcuRF0ZOjoH0xsH4HoNSzc8IfQzKhRz4vw Oct 19 03:41:05.979910 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:41:05.979910 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:41:05.979910 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:41:05.979910 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:41:05.979910 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:41:05.979910 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:41:05.979910 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 34bd94983fbf4a8aa49aff65c076e9e3 Oct 19 03:41:05.979910 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:41:05.979910 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:41:05.979910 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:41:05.979910 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_34bd94983fbf4a8aa49aff65c076e9e3", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:41:05.979910 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:41:05.979910 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 34bd94983fbf4a8aa49aff65c076e9e3 Oct 19 03:41:05.979910 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:41:05.979910 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ServersNegativeTestJSON-553742303-project Oct 19 03:41:05.979910 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:41:05.979910 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:41:05.979910 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 771feb133bc046588552d3af98f8e0a1 Oct 19 03:41:05.979910 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ServersNegativeTestJSON-553742303-project Oct 19 03:41:05.979910 n-d-861333-8 devstack@n-api.service[121134]: Oct 19 03:41:05.979910 n-d-861333-8 devstack@n-api.service[121134]: {"suspend": {}} Oct 19 03:41:05.979910 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:41:05.979910 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance 19681648-7bad-4752-aafa-27008c8d4230 could not be found. Oct 19 03:41:05.979910 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '19681648-7bad-4752-aafa-27008c8d4230', 'body': {'suspend': {}}} Oct 19 03:41:05.979910 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:41:05.979910 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:41:05.979910 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:41:05.979910 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:41:05.979910 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:41:05.979910 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:41:05.979910 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 19 03:41:05.979910 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 19 03:41:05.979910 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19681648-7bad-4752-aafa-27008c8d4230 could not be found. Oct 19 03:41:05.979910 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:41:05.979910 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:41:05.979910 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:41:05.979910 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:41:05.979910 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:41:05.979910 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:41:05.979910 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:41:05.979910 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:41:05.979910 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:41:05.979910 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:41:05.979910 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Oct 19 03:41:05.979910 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 19 03:41:05.979910 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:41:05.979910 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:41:05.979910 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19681648-7bad-4752-aafa-27008c8d4230 could not be found. Oct 19 03:41:05.979910 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:41:05.979910 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:41:05.979910 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:41:05.979910 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:41:05.979910 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:41:05.979910 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:41:05.984132 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:41:05.984132 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:41:05.984132 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19681648-7bad-4752-aafa-27008c8d4230 could not be found. Oct 19 03:41:05.984132 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:41:05.985439 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8e38e646-290b-4d4a-ad0a-094db2336749 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Returning 404 to user: Instance 19681648-7bad-4752-aafa-27008c8d4230 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:41:06.001943 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8e38e646-290b-4d4a-ad0a-094db2336749 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "POST /compute/v2.1/servers/19681648-7bad-4752-aafa-27008c8d4230/action" status: 404 len: 111 microversion: 2.1 time: 0.074715 Oct 19 03:41:06.002897 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2762/5606] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:41:05 2022] POST /compute/v2.1/servers/19681648-7bad-4752-aafa-27008c8d4230/action => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:41:06.012914 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-789f31b0-5c4b-4ca4-90a4-e9ebd22c64ef tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:06.013882 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-789f31b0-5c4b-4ca4-90a4-e9ebd22c64ef tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:41:06.027227 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-789f31b0-5c4b-4ca4-90a4-e9ebd22c64ef tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:06.027765 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-789f31b0-5c4b-4ca4-90a4-e9ebd22c64ef tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:06.034796 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-789f31b0-5c4b-4ca4-90a4-e9ebd22c64ef tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:06.035837 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-789f31b0-5c4b-4ca4-90a4-e9ebd22c64ef tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:06.040207 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-789f31b0-5c4b-4ca4-90a4-e9ebd22c64ef tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:06.040890 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-789f31b0-5c4b-4ca4-90a4-e9ebd22c64ef tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:06.421306 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-789f31b0-5c4b-4ca4-90a4-e9ebd22c64ef tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:41:06.431834 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-789f31b0-5c4b-4ca4-90a4-e9ebd22c64ef tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1506 microversion: 2.1 time: 0.424077 Oct 19 03:41:06.441893 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2845/5607] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:41:06 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1506 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:41:06.462108 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4c0cf971-aa02-4aa5-9dbb-e85b69177f74 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:06.462746 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4c0cf971-aa02-4aa5-9dbb-e85b69177f74 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:41:06.536239 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4c0cf971-aa02-4aa5-9dbb-e85b69177f74 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:06.536239 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4c0cf971-aa02-4aa5-9dbb-e85b69177f74 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:06.536474 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4c0cf971-aa02-4aa5-9dbb-e85b69177f74 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:06.540383 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4c0cf971-aa02-4aa5-9dbb-e85b69177f74 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:06.542887 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4c0cf971-aa02-4aa5-9dbb-e85b69177f74 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:06.543606 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4c0cf971-aa02-4aa5-9dbb-e85b69177f74 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:06.869939 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-4c0cf971-aa02-4aa5-9dbb-e85b69177f74 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:41:06.883151 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4c0cf971-aa02-4aa5-9dbb-e85b69177f74 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1506 microversion: 2.1 time: 0.426766 Oct 19 03:41:06.883999 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2763/5608] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:41:06 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1506 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:41:06.911296 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c81e3f9d-377d-4d8e-bb88-df28deaebc6f tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:41:06.911845 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c81e3f9d-377d-4d8e-bb88-df28deaebc6f tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:41:06.929057 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c81e3f9d-377d-4d8e-bb88-df28deaebc6f tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:06.929595 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c81e3f9d-377d-4d8e-bb88-df28deaebc6f tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:06.930042 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c81e3f9d-377d-4d8e-bb88-df28deaebc6f tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:06.930767 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c81e3f9d-377d-4d8e-bb88-df28deaebc6f tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:06.931228 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c81e3f9d-377d-4d8e-bb88-df28deaebc6f tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:06.931663 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c81e3f9d-377d-4d8e-bb88-df28deaebc6f tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:06.949410 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-19df64c1-9d67-468e-a22b-46921cfc3727 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:06.950455 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-19df64c1-9d67-468e-a22b-46921cfc3727 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 7e633743-2b38-4c08-be9e-fdfde600b48b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:41:06.964517 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-19df64c1-9d67-468e-a22b-46921cfc3727 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:06.966922 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-19df64c1-9d67-468e-a22b-46921cfc3727 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:06.969336 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-19df64c1-9d67-468e-a22b-46921cfc3727 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:06.970576 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-19df64c1-9d67-468e-a22b-46921cfc3727 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:06.973886 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-19df64c1-9d67-468e-a22b-46921cfc3727 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:06.975899 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-19df64c1-9d67-468e-a22b-46921cfc3727 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:07.008493 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-c81e3f9d-377d-4d8e-bb88-df28deaebc6f tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lazy-loading 'flavor' on Instance uuid 5a830928-6d51-4dbd-97ad-8cca44de3770 {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:41:07.317828 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:41:07.437292 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c81e3f9d-377d-4d8e-bb88-df28deaebc6f tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "POST /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770/action" status: 202 len: 0 microversion: 2.1 time: 0.529916 Oct 19 03:41:07.441107 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2846/5609] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:41:06 2022] POST /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770/action => generated 0 bytes in 534 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:41:07.449364 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d6b26766-3316-402a-8c9e-d5e318a1370e tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:07.461305 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d6b26766-3316-402a-8c9e-d5e318a1370e tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:41:07.491335 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d6b26766-3316-402a-8c9e-d5e318a1370e tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:07.491335 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d6b26766-3316-402a-8c9e-d5e318a1370e tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:07.491335 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d6b26766-3316-402a-8c9e-d5e318a1370e tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:07.491335 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d6b26766-3316-402a-8c9e-d5e318a1370e tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:07.491335 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d6b26766-3316-402a-8c9e-d5e318a1370e tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:07.495918 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d6b26766-3316-402a-8c9e-d5e318a1370e tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:07.507108 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-19df64c1-9d67-468e-a22b-46921cfc3727 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:41:07.517413 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-19df64c1-9d67-468e-a22b-46921cfc3727 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b" status: 200 len: 1524 microversion: 2.1 time: 0.571999 Oct 19 03:41:07.528452 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2764/5610] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:41:06 2022] GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b => generated 1524 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:41:07.771503 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d6b26766-3316-402a-8c9e-d5e318a1370e tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:41:07.779927 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d6b26766-3316-402a-8c9e-d5e318a1370e tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1514 microversion: 2.1 time: 0.337336 Oct 19 03:41:07.780471 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2847/5611] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:41:07 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1514 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:41:08.561713 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-50a7cf73-57b9-458a-ac69-942c508b09be tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:08.562354 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-50a7cf73-57b9-458a-ac69-942c508b09be tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 7e633743-2b38-4c08-be9e-fdfde600b48b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:41:08.579128 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-50a7cf73-57b9-458a-ac69-942c508b09be tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:08.581592 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-50a7cf73-57b9-458a-ac69-942c508b09be tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:08.585628 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-50a7cf73-57b9-458a-ac69-942c508b09be tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:08.589658 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-50a7cf73-57b9-458a-ac69-942c508b09be tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:08.592547 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-50a7cf73-57b9-458a-ac69-942c508b09be tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:08.594160 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-50a7cf73-57b9-458a-ac69-942c508b09be tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:08.821561 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1a38f006-a6db-490e-9689-661d199eeebd tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:08.824230 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1a38f006-a6db-490e-9689-661d199eeebd tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:41:08.840347 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1a38f006-a6db-490e-9689-661d199eeebd tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:08.841839 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1a38f006-a6db-490e-9689-661d199eeebd tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:08.842443 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1a38f006-a6db-490e-9689-661d199eeebd tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:08.847056 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1a38f006-a6db-490e-9689-661d199eeebd tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:08.848536 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1a38f006-a6db-490e-9689-661d199eeebd tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:08.850482 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1a38f006-a6db-490e-9689-661d199eeebd tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:09.298443 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-50a7cf73-57b9-458a-ac69-942c508b09be tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:41:09.325066 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-50a7cf73-57b9-458a-ac69-942c508b09be tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b" status: 200 len: 1524 microversion: 2.1 time: 0.773025 Oct 19 03:41:09.334539 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2765/5612] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:41:08 2022] GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b => generated 1524 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:41:09.364763 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-1a38f006-a6db-490e-9689-661d199eeebd tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:41:09.377054 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1a38f006-a6db-490e-9689-661d199eeebd tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1497 microversion: 2.1 time: 0.566021 Oct 19 03:41:09.381540 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2848/5613] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:41:08 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1497 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:41:09.405287 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9961ed7f-3898-4533-9897-a811b22c3690 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:41:09.410269 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9961ed7f-3898-4533-9897-a811b22c3690 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:41:09.432860 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9961ed7f-3898-4533-9897-a811b22c3690 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:09.433357 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9961ed7f-3898-4533-9897-a811b22c3690 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:09.433827 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9961ed7f-3898-4533-9897-a811b22c3690 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:09.449552 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9961ed7f-3898-4533-9897-a811b22c3690 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:09.450433 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9961ed7f-3898-4533-9897-a811b22c3690 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:09.450902 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9961ed7f-3898-4533-9897-a811b22c3690 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:09.529461 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-9961ed7f-3898-4533-9897-a811b22c3690 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lazy-loading 'flavor' on Instance uuid 5a830928-6d51-4dbd-97ad-8cca44de3770 {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:41:09.571519 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-9961ed7f-3898-4533-9897-a811b22c3690 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] HTTP exception thrown: Cannot 'suspend' instance 5a830928-6d51-4dbd-97ad-8cca44de3770 while it is in vm_state suspended Oct 19 03:41:09.577966 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9961ed7f-3898-4533-9897-a811b22c3690 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Request method failure captured: Oct 19 03:41:09.577966 n-d-861333-8 devstack@n-api.service[121134]: request: POST /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770/action HTTP/1.1 Oct 19 03:41:09.577966 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:41:09.577966 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:41:09.577966 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:41:09.577966 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 15 Oct 19 03:41:09.577966 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:41:09.577966 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:41:09.577966 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:41:09.577966 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:41:09.577966 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3EK4yDar5R5kGdpWRPopK281fOgxjiWCAZdy3tbDZzFYZxrN53hSsTq0YyAxsfcVRT4cF0jU61e6walOKxMx_njT0L3WOIYEymBjzmNzdXOa-UhYNf83BpQOShCJts2aNodNdu7YjeLcAcuRF0ZOjoH0xsH4HoNSzc8IfQzKhRz4vw Oct 19 03:41:09.577966 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:41:09.577966 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:41:09.577966 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:41:09.577966 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:41:09.577966 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:41:09.577966 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:41:09.577966 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 34bd94983fbf4a8aa49aff65c076e9e3 Oct 19 03:41:09.577966 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:41:09.577966 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:41:09.577966 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:41:09.577966 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_34bd94983fbf4a8aa49aff65c076e9e3", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:41:09.577966 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:41:09.577966 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 34bd94983fbf4a8aa49aff65c076e9e3 Oct 19 03:41:09.577966 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:41:09.577966 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ServersNegativeTestJSON-553742303-project Oct 19 03:41:09.577966 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:41:09.577966 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:41:09.577966 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 771feb133bc046588552d3af98f8e0a1 Oct 19 03:41:09.577966 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ServersNegativeTestJSON-553742303-project Oct 19 03:41:09.577966 n-d-861333-8 devstack@n-api.service[121134]: Oct 19 03:41:09.577966 n-d-861333-8 devstack@n-api.service[121134]: {"suspend": {}} Oct 19 03:41:09.577966 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:41:09.577966 n-d-861333-8 devstack@n-api.service[121134]: exception: Cannot 'suspend' instance 5a830928-6d51-4dbd-97ad-8cca44de3770 while it is in vm_state suspended Oct 19 03:41:09.577966 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '5a830928-6d51-4dbd-97ad-8cca44de3770', 'body': {'suspend': {}}} Oct 19 03:41:09.577966 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:41:09.577966 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:41:09.577966 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Oct 19 03:41:09.577966 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Oct 19 03:41:09.577966 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 19 03:41:09.577966 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 19 03:41:09.577966 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 19 03:41:09.577966 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 19 03:41:09.577966 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 19 03:41:09.577966 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 19 03:41:09.577966 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 19 03:41:09.577966 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 19 03:41:09.577966 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 19 03:41:09.577966 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 19 03:41:09.577966 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 19 03:41:09.577966 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 19 03:41:09.577966 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5a830928-6d51-4dbd-97ad-8cca44de3770 in vm_state suspended. Cannot suspend while the instance is in this state. Oct 19 03:41:09.577966 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:41:09.577966 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:41:09.577966 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:41:09.577966 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:41:09.577966 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:41:09.577966 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:41:09.577966 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:41:09.577966 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:41:09.577966 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:41:09.577966 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:41:09.577966 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Oct 19 03:41:09.577966 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 19 03:41:09.582069 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 19 03:41:09.582069 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 19 03:41:09.582069 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 5a830928-6d51-4dbd-97ad-8cca44de3770 while it is in vm_state suspended Oct 19 03:41:09.582069 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:41:09.582069 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:41:09.582069 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:41:09.582069 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:41:09.582069 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:41:09.582069 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:41:09.582069 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:41:09.582069 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:41:09.582069 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 5a830928-6d51-4dbd-97ad-8cca44de3770 while it is in vm_state suspended Oct 19 03:41:09.582069 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:41:09.582069 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9961ed7f-3898-4533-9897-a811b22c3690 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Returning 409 to user: Cannot 'suspend' instance 5a830928-6d51-4dbd-97ad-8cca44de3770 while it is in vm_state suspended {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:41:09.582069 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9961ed7f-3898-4533-9897-a811b22c3690 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "POST /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770/action" status: 409 len: 148 microversion: 2.1 time: 0.178867 Oct 19 03:41:09.588734 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-29c04d52-ed77-4f11-8bd6-8d061870ce10 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:41:09.589279 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-29c04d52-ed77-4f11-8bd6-8d061870ce10 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:41:09.596547 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-29c04d52-ed77-4f11-8bd6-8d061870ce10 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:09.597048 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-29c04d52-ed77-4f11-8bd6-8d061870ce10 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:09.597524 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-29c04d52-ed77-4f11-8bd6-8d061870ce10 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:09.598259 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-29c04d52-ed77-4f11-8bd6-8d061870ce10 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:09.598697 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-29c04d52-ed77-4f11-8bd6-8d061870ce10 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:09.599300 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-29c04d52-ed77-4f11-8bd6-8d061870ce10 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:09.603637 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2766/5614] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:41:09 2022] POST /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770/action => generated 148 bytes in 203 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 19 03:41:09.890551 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-29c04d52-ed77-4f11-8bd6-8d061870ce10 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "POST /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770/action" status: 202 len: 0 microversion: 2.1 time: 0.301684 Oct 19 03:41:09.896330 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2849/5615] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:41:09 2022] POST /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770/action => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:41:09.901343 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8d459acc-e8a3-4dca-9b64-8f1aa06dd5bf tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:09.901997 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8d459acc-e8a3-4dca-9b64-8f1aa06dd5bf tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:41:09.921020 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8d459acc-e8a3-4dca-9b64-8f1aa06dd5bf tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:09.921704 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8d459acc-e8a3-4dca-9b64-8f1aa06dd5bf tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:09.922430 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8d459acc-e8a3-4dca-9b64-8f1aa06dd5bf tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:09.923343 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8d459acc-e8a3-4dca-9b64-8f1aa06dd5bf tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:09.923819 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8d459acc-e8a3-4dca-9b64-8f1aa06dd5bf tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:09.924254 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8d459acc-e8a3-4dca-9b64-8f1aa06dd5bf tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:09.948845 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1bb2a7db-4889-4c1a-ad75-4591f944ad6c tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:09.968014 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1bb2a7db-4889-4c1a-ad75-4591f944ad6c tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] [instance: eff2dc27-f6d3-41b6-96ac-c964b1d07419] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:41:09.991601 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1bb2a7db-4889-4c1a-ad75-4591f944ad6c tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:09.994554 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1bb2a7db-4889-4c1a-ad75-4591f944ad6c tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:09.995829 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1bb2a7db-4889-4c1a-ad75-4591f944ad6c tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:09.998062 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1bb2a7db-4889-4c1a-ad75-4591f944ad6c tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:09.998718 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1bb2a7db-4889-4c1a-ad75-4591f944ad6c tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:09.999317 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1bb2a7db-4889-4c1a-ad75-4591f944ad6c tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:10.048261 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1bb2a7db-4889-4c1a-ad75-4591f944ad6c tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] [instance: eff2dc27-f6d3-41b6-96ac-c964b1d07419] Going to try to terminate instance {{(pid=121135) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:41:10.438807 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1bb2a7db-4889-4c1a-ad75-4591f944ad6c tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] 10.222.0.52 "DELETE /compute/v2.1/servers/eff2dc27-f6d3-41b6-96ac-c964b1d07419" status: 204 len: 0 microversion: 2.1 time: 0.499326 Oct 19 03:41:10.439668 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2850/5616] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:41:09 2022] DELETE /compute/v2.1/servers/eff2dc27-f6d3-41b6-96ac-c964b1d07419 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:41:10.447615 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5fc750ff-0fc5-4bd8-b4d3-ed3bc9f6f05a tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:10.448330 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-5fc750ff-0fc5-4bd8-b4d3-ed3bc9f6f05a tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 7e633743-2b38-4c08-be9e-fdfde600b48b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:41:10.461095 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5fc750ff-0fc5-4bd8-b4d3-ed3bc9f6f05a tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:10.464694 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5fc750ff-0fc5-4bd8-b4d3-ed3bc9f6f05a tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:10.465247 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5fc750ff-0fc5-4bd8-b4d3-ed3bc9f6f05a tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:10.466055 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5fc750ff-0fc5-4bd8-b4d3-ed3bc9f6f05a tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:10.466541 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5fc750ff-0fc5-4bd8-b4d3-ed3bc9f6f05a tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:10.466994 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5fc750ff-0fc5-4bd8-b4d3-ed3bc9f6f05a tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:11.247977 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8d459acc-e8a3-4dca-9b64-8f1aa06dd5bf tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:41:11.261772 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8d459acc-e8a3-4dca-9b64-8f1aa06dd5bf tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1503 microversion: 2.1 time: 1.360075 Oct 19 03:41:11.263196 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2767/5617] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:41:09 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1503 bytes in 1367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:41:11.268526 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9e1ea619-e265-47f8-be58-fdf8bfde80bb tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:11.273681 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9e1ea619-e265-47f8-be58-fdf8bfde80bb tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] [instance: eff2dc27-f6d3-41b6-96ac-c964b1d07419] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:41:11.304481 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9e1ea619-e265-47f8-be58-fdf8bfde80bb tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:11.305006 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9e1ea619-e265-47f8-be58-fdf8bfde80bb tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:11.307853 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9e1ea619-e265-47f8-be58-fdf8bfde80bb tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:11.308651 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9e1ea619-e265-47f8-be58-fdf8bfde80bb tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:11.311447 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9e1ea619-e265-47f8-be58-fdf8bfde80bb tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:11.320999 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9e1ea619-e265-47f8-be58-fdf8bfde80bb tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:11.358116 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=100 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:41:11.616682 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-5fc750ff-0fc5-4bd8-b4d3-ed3bc9f6f05a tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:41:11.630929 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5fc750ff-0fc5-4bd8-b4d3-ed3bc9f6f05a tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b" status: 200 len: 1524 microversion: 2.1 time: 1.189687 Oct 19 03:41:11.636814 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2851/5618] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:41:10 2022] GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b => generated 1524 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:41:11.988796 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-91300305-8485-4abd-81df-15c3aeab384c tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:11.989706 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-91300305-8485-4abd-81df-15c3aeab384c tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] [instance: ddbf7afb-1d7b-4d33-b6fb-1f1608c11985] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:41:12.003023 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-91300305-8485-4abd-81df-15c3aeab384c tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:12.006791 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-91300305-8485-4abd-81df-15c3aeab384c tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:12.014593 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-91300305-8485-4abd-81df-15c3aeab384c tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:12.015743 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-91300305-8485-4abd-81df-15c3aeab384c tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:12.017662 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-91300305-8485-4abd-81df-15c3aeab384c tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:12.018755 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-91300305-8485-4abd-81df-15c3aeab384c tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:12.087763 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-91300305-8485-4abd-81df-15c3aeab384c tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] HTTP exception thrown: Instance ddbf7afb-1d7b-4d33-b6fb-1f1608c11985 could not be found. Oct 19 03:41:12.092344 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-91300305-8485-4abd-81df-15c3aeab384c tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Request method failure captured: Oct 19 03:41:12.092344 n-d-861333-8 devstack@n-api.service[121135]: request: DELETE /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985 HTTP/1.1 Oct 19 03:41:12.092344 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:41:12.092344 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:41:12.092344 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:41:12.092344 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:41:12.092344 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:41:12.092344 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:41:12.092344 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:41:12.092344 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:41:12.092344 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT3A-J8gkSeK-jC5SkwldeX2fzHDW9yQloVnq9w2JWN_JbOIlJSI50_hnA7Y-GPIEwyuvwrDEjFnM41r0iLy-FdL3R3ciqTPdXWgB2rbzESKYvw_2cPHI89nLZNBftmcKk7VKZvl3lBPw28mJ2rNa1xBb7pb4TRKC6xWHwLh7-7tORZ4 Oct 19 03:41:12.092344 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:41:12.092344 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:41:12.092344 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:41:12.092344 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:41:12.092344 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:41:12.092344 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:41:12.092344 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: fa4001edd1474947a94243a620a6013a Oct 19 03:41:12.092344 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-AttachVolumeTestJSON-691414608 Oct 19 03:41:12.092344 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:41:12.092344 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:41:12.092344 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/fa4001edd1474947a94243a620a6013a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fa4001edd1474947a94243a620a6013a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fa4001edd1474947a94243a620a6013a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_fa4001edd1474947a94243a620a6013a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:41:12.092344 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-AttachVolumeTestJSON-691414608 Oct 19 03:41:12.092344 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: fa4001edd1474947a94243a620a6013a Oct 19 03:41:12.092344 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-AttachVolumeTestJSON-691414608 Oct 19 03:41:12.092344 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-AttachVolumeTestJSON-691414608-project Oct 19 03:41:12.092344 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:41:12.092344 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:41:12.092344 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 4c65a497e16e4e41b5cf1287042f3a68 Oct 19 03:41:12.092344 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-AttachVolumeTestJSON-691414608-project Oct 19 03:41:12.092344 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:41:12.092344 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance ddbf7afb-1d7b-4d33-b6fb-1f1608c11985 could not be found. Oct 19 03:41:12.092344 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': 'ddbf7afb-1d7b-4d33-b6fb-1f1608c11985'} Oct 19 03:41:12.092344 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:41:12.092344 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:41:12.092344 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:41:12.092344 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:41:12.092344 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:41:12.092344 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:41:12.092344 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:41:12.092344 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:41:12.092344 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:41:12.092344 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:41:12.092344 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ddbf7afb-1d7b-4d33-b6fb-1f1608c11985 could not be found. Oct 19 03:41:12.092344 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:41:12.092344 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:41:12.092344 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:41:12.092344 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:41:12.092344 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:41:12.092344 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:41:12.092344 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:41:12.092344 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:41:12.092344 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:41:12.092344 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:41:12.092344 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 03:41:12.092344 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 03:41:12.092344 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 03:41:12.092344 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 03:41:12.092344 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:41:12.092344 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:41:12.092344 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:41:12.092344 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:41:12.096354 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ddbf7afb-1d7b-4d33-b6fb-1f1608c11985 could not be found. Oct 19 03:41:12.096354 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:41:12.096354 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:41:12.096354 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:41:12.096354 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:41:12.096354 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:41:12.096354 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:41:12.096354 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:41:12.096354 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:41:12.096354 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ddbf7afb-1d7b-4d33-b6fb-1f1608c11985 could not be found. Oct 19 03:41:12.096354 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:41:12.101429 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-91300305-8485-4abd-81df-15c3aeab384c tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Returning 404 to user: Instance ddbf7afb-1d7b-4d33-b6fb-1f1608c11985 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:41:12.105962 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-91300305-8485-4abd-81df-15c3aeab384c tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985" status: 404 len: 111 microversion: 2.1 time: 0.119085 Oct 19 03:41:12.110025 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2852/5619] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:41:11 2022] DELETE /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:41:12.138380 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d696e37a-964f-4525-a124-3dabe19fea70 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:12.139372 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d696e37a-964f-4525-a124-3dabe19fea70 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] [instance: ddbf7afb-1d7b-4d33-b6fb-1f1608c11985] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:41:12.158574 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d696e37a-964f-4525-a124-3dabe19fea70 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:12.159361 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d696e37a-964f-4525-a124-3dabe19fea70 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:12.161179 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d696e37a-964f-4525-a124-3dabe19fea70 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:12.162221 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d696e37a-964f-4525-a124-3dabe19fea70 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:12.164023 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d696e37a-964f-4525-a124-3dabe19fea70 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:12.166527 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d696e37a-964f-4525-a124-3dabe19fea70 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:12.220323 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-d696e37a-964f-4525-a124-3dabe19fea70 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] HTTP exception thrown: Instance ddbf7afb-1d7b-4d33-b6fb-1f1608c11985 could not be found. Oct 19 03:41:12.231411 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d696e37a-964f-4525-a124-3dabe19fea70 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Request method failure captured: Oct 19 03:41:12.231411 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985 HTTP/1.1 Oct 19 03:41:12.231411 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:41:12.231411 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:41:12.231411 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:41:12.231411 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:41:12.231411 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:41:12.231411 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:41:12.231411 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:41:12.231411 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:41:12.231411 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT3A-J8gkSeK-jC5SkwldeX2fzHDW9yQloVnq9w2JWN_JbOIlJSI50_hnA7Y-GPIEwyuvwrDEjFnM41r0iLy-FdL3R3ciqTPdXWgB2rbzESKYvw_2cPHI89nLZNBftmcKk7VKZvl3lBPw28mJ2rNa1xBb7pb4TRKC6xWHwLh7-7tORZ4 Oct 19 03:41:12.231411 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:41:12.231411 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:41:12.231411 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:41:12.231411 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:41:12.231411 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:41:12.231411 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:41:12.231411 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: fa4001edd1474947a94243a620a6013a Oct 19 03:41:12.231411 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-AttachVolumeTestJSON-691414608 Oct 19 03:41:12.231411 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:41:12.231411 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:41:12.231411 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/fa4001edd1474947a94243a620a6013a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fa4001edd1474947a94243a620a6013a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fa4001edd1474947a94243a620a6013a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_fa4001edd1474947a94243a620a6013a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:41:12.231411 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-AttachVolumeTestJSON-691414608 Oct 19 03:41:12.231411 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: fa4001edd1474947a94243a620a6013a Oct 19 03:41:12.231411 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-AttachVolumeTestJSON-691414608 Oct 19 03:41:12.231411 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-AttachVolumeTestJSON-691414608-project Oct 19 03:41:12.231411 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:41:12.231411 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:41:12.231411 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 4c65a497e16e4e41b5cf1287042f3a68 Oct 19 03:41:12.231411 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-AttachVolumeTestJSON-691414608-project Oct 19 03:41:12.231411 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:41:12.231411 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance ddbf7afb-1d7b-4d33-b6fb-1f1608c11985 could not be found. Oct 19 03:41:12.231411 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': 'ddbf7afb-1d7b-4d33-b6fb-1f1608c11985'} Oct 19 03:41:12.231411 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:41:12.231411 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:41:12.231411 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:41:12.231411 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:41:12.231411 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:41:12.231411 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:41:12.231411 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:41:12.231411 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:41:12.231411 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:41:12.231411 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:41:12.231411 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ddbf7afb-1d7b-4d33-b6fb-1f1608c11985 could not be found. Oct 19 03:41:12.231411 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:41:12.231411 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:41:12.231411 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:41:12.231411 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:41:12.231411 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:41:12.231411 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:41:12.231411 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:41:12.231411 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:41:12.231411 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:41:12.231411 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:41:12.231411 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:41:12.231411 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:41:12.231411 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:41:12.231411 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:41:12.231411 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:41:12.231411 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:41:12.231411 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ddbf7afb-1d7b-4d33-b6fb-1f1608c11985 could not be found. Oct 19 03:41:12.231411 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:41:12.231411 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:41:12.231411 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:41:12.235752 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:41:12.235752 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:41:12.235752 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:41:12.235752 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:41:12.235752 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:41:12.235752 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ddbf7afb-1d7b-4d33-b6fb-1f1608c11985 could not be found. Oct 19 03:41:12.235752 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:41:12.241481 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d696e37a-964f-4525-a124-3dabe19fea70 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] Returning 404 to user: Instance ddbf7afb-1d7b-4d33-b6fb-1f1608c11985 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:41:12.244060 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d696e37a-964f-4525-a124-3dabe19fea70 tempest-AttachVolumeTestJSON-691414608 tempest-AttachVolumeTestJSON-691414608-project] 10.222.0.52 "GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985" status: 404 len: 111 microversion: 2.1 time: 0.130283 Oct 19 03:41:12.249211 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2853/5620] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:41:12 2022] GET /compute/v2.1/servers/ddbf7afb-1d7b-4d33-b6fb-1f1608c11985 => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:41:12.288145 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9e1ea619-e265-47f8-be58-fdf8bfde80bb tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4670fd4408d4454784251a880d5a72f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf91777fa414ddaa797d735e7d2a275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:41:12.294519 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-df0be991-cc97-4078-838c-acce6cc2bd3a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:12.295368 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-df0be991-cc97-4078-838c-acce6cc2bd3a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:41:12.304223 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-df0be991-cc97-4078-838c-acce6cc2bd3a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:12.305820 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9e1ea619-e265-47f8-be58-fdf8bfde80bb tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] 10.222.0.52 "GET /compute/v2.1/servers/eff2dc27-f6d3-41b6-96ac-c964b1d07419" status: 200 len: 1552 microversion: 2.1 time: 1.032618 Oct 19 03:41:12.313072 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-df0be991-cc97-4078-838c-acce6cc2bd3a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:12.313794 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-df0be991-cc97-4078-838c-acce6cc2bd3a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:12.314734 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-df0be991-cc97-4078-838c-acce6cc2bd3a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:12.315355 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-df0be991-cc97-4078-838c-acce6cc2bd3a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:12.316711 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-df0be991-cc97-4078-838c-acce6cc2bd3a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:12.323648 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2768/5621] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:41:11 2022] GET /compute/v2.1/servers/eff2dc27-f6d3-41b6-96ac-c964b1d07419 => generated 1552 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:41:12.663322 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-96100ff7-cee0-464d-ad69-cc6bce3d2583 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:12.663949 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-96100ff7-cee0-464d-ad69-cc6bce3d2583 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 7e633743-2b38-4c08-be9e-fdfde600b48b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:41:12.671594 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-96100ff7-cee0-464d-ad69-cc6bce3d2583 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:12.672095 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-96100ff7-cee0-464d-ad69-cc6bce3d2583 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:12.689639 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-96100ff7-cee0-464d-ad69-cc6bce3d2583 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:12.696757 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-96100ff7-cee0-464d-ad69-cc6bce3d2583 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:12.697719 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-96100ff7-cee0-464d-ad69-cc6bce3d2583 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:12.698329 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-96100ff7-cee0-464d-ad69-cc6bce3d2583 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:13.432973 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-df0be991-cc97-4078-838c-acce6cc2bd3a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:41:13.446137 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-df0be991-cc97-4078-838c-acce6cc2bd3a tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1503 microversion: 2.1 time: 1.157871 Oct 19 03:41:13.446711 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2854/5622] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:41:12 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1503 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:41:13.474521 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-61256c61-1c16-49d8-bf4d-fe1f2f31fb2e tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:13.475385 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-61256c61-1c16-49d8-bf4d-fe1f2f31fb2e tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] [instance: eff2dc27-f6d3-41b6-96ac-c964b1d07419] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:41:13.489400 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-61256c61-1c16-49d8-bf4d-fe1f2f31fb2e tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:13.490135 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-61256c61-1c16-49d8-bf4d-fe1f2f31fb2e tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:13.490728 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-61256c61-1c16-49d8-bf4d-fe1f2f31fb2e tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:13.491592 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-61256c61-1c16-49d8-bf4d-fe1f2f31fb2e tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:13.492198 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-61256c61-1c16-49d8-bf4d-fe1f2f31fb2e tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:13.492813 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-61256c61-1c16-49d8-bf4d-fe1f2f31fb2e tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:13.842246 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-96100ff7-cee0-464d-ad69-cc6bce3d2583 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:41:13.854781 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-96100ff7-cee0-464d-ad69-cc6bce3d2583 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b" status: 200 len: 1524 microversion: 2.1 time: 1.195175 Oct 19 03:41:13.874706 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2769/5623] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:41:12 2022] GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b => generated 1524 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:41:14.471632 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-051e794c-2eb3-4190-9941-b464fb7c15f4 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:14.472253 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-051e794c-2eb3-4190-9941-b464fb7c15f4 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:41:14.484509 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-051e794c-2eb3-4190-9941-b464fb7c15f4 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:14.489275 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-051e794c-2eb3-4190-9941-b464fb7c15f4 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:14.489895 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-051e794c-2eb3-4190-9941-b464fb7c15f4 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:14.490730 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-051e794c-2eb3-4190-9941-b464fb7c15f4 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:14.491202 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-051e794c-2eb3-4190-9941-b464fb7c15f4 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:14.491732 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-051e794c-2eb3-4190-9941-b464fb7c15f4 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:14.628231 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-61256c61-1c16-49d8-bf4d-fe1f2f31fb2e tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4670fd4408d4454784251a880d5a72f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf91777fa414ddaa797d735e7d2a275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:41:14.651927 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-61256c61-1c16-49d8-bf4d-fe1f2f31fb2e tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] 10.222.0.52 "GET /compute/v2.1/servers/eff2dc27-f6d3-41b6-96ac-c964b1d07419" status: 200 len: 1552 microversion: 2.1 time: 1.200302 Oct 19 03:41:14.652640 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2855/5624] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:41:13 2022] GET /compute/v2.1/servers/eff2dc27-f6d3-41b6-96ac-c964b1d07419 => generated 1552 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:41:14.891687 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-10ca97d9-97a1-470d-8e43-cf5f920e75ae tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:14.891687 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-10ca97d9-97a1-470d-8e43-cf5f920e75ae tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 7e633743-2b38-4c08-be9e-fdfde600b48b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:41:14.901469 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-10ca97d9-97a1-470d-8e43-cf5f920e75ae tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:14.906180 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-10ca97d9-97a1-470d-8e43-cf5f920e75ae tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:14.910369 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-10ca97d9-97a1-470d-8e43-cf5f920e75ae tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:14.911417 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-10ca97d9-97a1-470d-8e43-cf5f920e75ae tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:14.911893 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-10ca97d9-97a1-470d-8e43-cf5f920e75ae tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:14.912322 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-10ca97d9-97a1-470d-8e43-cf5f920e75ae tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:15.469174 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-051e794c-2eb3-4190-9941-b464fb7c15f4 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:41:15.485349 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-051e794c-2eb3-4190-9941-b464fb7c15f4 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1503 microversion: 2.1 time: 1.017847 Oct 19 03:41:15.487628 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2770/5625] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:41:14 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1503 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:41:15.680738 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f41d7db7-76ac-446d-ae07-74e3e501dbdf tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:15.681404 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f41d7db7-76ac-446d-ae07-74e3e501dbdf tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] [instance: eff2dc27-f6d3-41b6-96ac-c964b1d07419] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:41:15.712865 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f41d7db7-76ac-446d-ae07-74e3e501dbdf tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:15.715754 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f41d7db7-76ac-446d-ae07-74e3e501dbdf tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:15.717222 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f41d7db7-76ac-446d-ae07-74e3e501dbdf tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:15.721918 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f41d7db7-76ac-446d-ae07-74e3e501dbdf tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:15.727084 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f41d7db7-76ac-446d-ae07-74e3e501dbdf tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:15.727550 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f41d7db7-76ac-446d-ae07-74e3e501dbdf tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:16.177112 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-10ca97d9-97a1-470d-8e43-cf5f920e75ae tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:41:16.198347 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-10ca97d9-97a1-470d-8e43-cf5f920e75ae tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b" status: 200 len: 1524 microversion: 2.1 time: 1.309680 Oct 19 03:41:16.199299 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2856/5626] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:41:14 2022] GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b => generated 1524 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:41:16.495615 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-c6974784-2141-49d2-a337-74f595041440 req-a660bfc2-0e59-4df5-9bf0-195b9edd7ddd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eff2dc27-f6d3-41b6-96ac-c964b1d07419", "name": "network-vif-deleted", "tag": "b34422b6-02a3-46a0-bf74-de756bcea9cb"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:41:16.513147 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-f41d7db7-76ac-446d-ae07-74e3e501dbdf tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4670fd4408d4454784251a880d5a72f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf91777fa414ddaa797d735e7d2a275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:41:16.518412 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-c6974784-2141-49d2-a337-74f595041440 req-a660bfc2-0e59-4df5-9bf0-195b9edd7ddd service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:16.521624 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-c6974784-2141-49d2-a337-74f595041440 req-a660bfc2-0e59-4df5-9bf0-195b9edd7ddd service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:16.522365 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-c6974784-2141-49d2-a337-74f595041440 req-a660bfc2-0e59-4df5-9bf0-195b9edd7ddd service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:16.533995 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f41d7db7-76ac-446d-ae07-74e3e501dbdf tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] 10.222.0.52 "GET /compute/v2.1/servers/eff2dc27-f6d3-41b6-96ac-c964b1d07419" status: 200 len: 1485 microversion: 2.1 time: 0.858451 Oct 19 03:41:16.545841 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-c6974784-2141-49d2-a337-74f595041440 req-a660bfc2-0e59-4df5-9bf0-195b9edd7ddd service nova] Creating event network-vif-deleted:b34422b6-02a3-46a0-bf74-de756bcea9cb for instance eff2dc27-f6d3-41b6-96ac-c964b1d07419 on n-h2-861333-8 Oct 19 03:41:16.563105 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-c6974784-2141-49d2-a337-74f595041440 req-a660bfc2-0e59-4df5-9bf0-195b9edd7ddd service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069173 Oct 19 03:41:16.564310 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2857/5627] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:41:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:41:16.566773 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2771/5628] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:41:15 2022] GET /compute/v2.1/servers/eff2dc27-f6d3-41b6-96ac-c964b1d07419 => generated 1485 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:41:16.583303 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-bc706bd5-c0da-4e50-9ba7-1ecc1dcdad1c tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:16.584030 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-bc706bd5-c0da-4e50-9ba7-1ecc1dcdad1c tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:41:16.601723 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bc706bd5-c0da-4e50-9ba7-1ecc1dcdad1c tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:16.609864 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bc706bd5-c0da-4e50-9ba7-1ecc1dcdad1c tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:16.610608 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bc706bd5-c0da-4e50-9ba7-1ecc1dcdad1c tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:16.613089 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bc706bd5-c0da-4e50-9ba7-1ecc1dcdad1c tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:16.624519 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bc706bd5-c0da-4e50-9ba7-1ecc1dcdad1c tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:16.625474 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bc706bd5-c0da-4e50-9ba7-1ecc1dcdad1c tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:17.072581 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-bc706bd5-c0da-4e50-9ba7-1ecc1dcdad1c tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:41:17.085468 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-bc706bd5-c0da-4e50-9ba7-1ecc1dcdad1c tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1506 microversion: 2.1 time: 0.511867 Oct 19 03:41:17.086198 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2858/5629] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:41:16 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1506 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:41:17.118908 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5765793b-f214-4354-bea3-8c32b7bd26f3 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:17.269483 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5765793b-f214-4354-bea3-8c32b7bd26f3 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:41:17.269483 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5765793b-f214-4354-bea3-8c32b7bd26f3 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:17.269483 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5765793b-f214-4354-bea3-8c32b7bd26f3 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:17.269483 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5765793b-f214-4354-bea3-8c32b7bd26f3 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:17.269483 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5765793b-f214-4354-bea3-8c32b7bd26f3 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:17.269483 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5765793b-f214-4354-bea3-8c32b7bd26f3 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:17.269483 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5765793b-f214-4354-bea3-8c32b7bd26f3 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:17.271569 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5423f084-3f40-4627-920d-89c83b8cc6a8 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:17.271569 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-5423f084-3f40-4627-920d-89c83b8cc6a8 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 7e633743-2b38-4c08-be9e-fdfde600b48b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:41:17.271569 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5423f084-3f40-4627-920d-89c83b8cc6a8 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:17.271569 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5423f084-3f40-4627-920d-89c83b8cc6a8 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:17.271569 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5423f084-3f40-4627-920d-89c83b8cc6a8 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:17.271569 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5423f084-3f40-4627-920d-89c83b8cc6a8 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:17.271569 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5423f084-3f40-4627-920d-89c83b8cc6a8 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:17.271569 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5423f084-3f40-4627-920d-89c83b8cc6a8 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:17.376893 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5765793b-f214-4354-bea3-8c32b7bd26f3 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:41:17.386321 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5765793b-f214-4354-bea3-8c32b7bd26f3 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1506 microversion: 2.1 time: 0.272998 Oct 19 03:41:17.388403 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2772/5630] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:41:17 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1506 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:41:17.420733 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-856b662c-4a2a-487e-8b9c-bcc7db1e47ba tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:41:17.421284 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-856b662c-4a2a-487e-8b9c-bcc7db1e47ba tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 03a1c7ec-0e6b-437f-adfe-a0a370fc048f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:41:17.431707 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-856b662c-4a2a-487e-8b9c-bcc7db1e47ba tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] HTTP exception thrown: Instance 03a1c7ec-0e6b-437f-adfe-a0a370fc048f could not be found. Oct 19 03:41:17.434607 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-856b662c-4a2a-487e-8b9c-bcc7db1e47ba tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Request method failure captured: Oct 19 03:41:17.434607 n-d-861333-8 devstack@n-api.service[121134]: request: POST /compute/v2.1/servers/03a1c7ec-0e6b-437f-adfe-a0a370fc048f/action HTTP/1.1 Oct 19 03:41:17.434607 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:41:17.434607 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:41:17.434607 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:41:17.434607 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 15 Oct 19 03:41:17.434607 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:41:17.434607 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:41:17.434607 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:41:17.434607 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:41:17.434607 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3EK4yDar5R5kGdpWRPopK281fOgxjiWCAZdy3tbDZzFYZxrN53hSsTq0YyAxsfcVRT4cF0jU61e6walOKxMx_njT0L3WOIYEymBjzmNzdXOa-UhYNf83BpQOShCJts2aNodNdu7YjeLcAcuRF0ZOjoH0xsH4HoNSzc8IfQzKhRz4vw Oct 19 03:41:17.434607 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:41:17.434607 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:41:17.434607 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:41:17.434607 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:41:17.434607 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:41:17.434607 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:41:17.434607 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 34bd94983fbf4a8aa49aff65c076e9e3 Oct 19 03:41:17.434607 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:41:17.434607 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:41:17.434607 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:41:17.434607 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_34bd94983fbf4a8aa49aff65c076e9e3", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:41:17.434607 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:41:17.434607 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 34bd94983fbf4a8aa49aff65c076e9e3 Oct 19 03:41:17.434607 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:41:17.434607 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ServersNegativeTestJSON-553742303-project Oct 19 03:41:17.434607 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:41:17.434607 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:41:17.434607 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 771feb133bc046588552d3af98f8e0a1 Oct 19 03:41:17.434607 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ServersNegativeTestJSON-553742303-project Oct 19 03:41:17.434607 n-d-861333-8 devstack@n-api.service[121134]: Oct 19 03:41:17.434607 n-d-861333-8 devstack@n-api.service[121134]: {"unpause": {}} Oct 19 03:41:17.434607 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:41:17.434607 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance 03a1c7ec-0e6b-437f-adfe-a0a370fc048f could not be found. Oct 19 03:41:17.434607 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '03a1c7ec-0e6b-437f-adfe-a0a370fc048f', 'body': {'unpause': {}}} Oct 19 03:41:17.434607 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:41:17.434607 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:41:17.434607 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:41:17.434607 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:41:17.434607 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:41:17.434607 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:41:17.434607 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 19 03:41:17.434607 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 19 03:41:17.434607 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03a1c7ec-0e6b-437f-adfe-a0a370fc048f could not be found. Oct 19 03:41:17.434607 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:41:17.434607 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:41:17.434607 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:41:17.434607 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:41:17.434607 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:41:17.434607 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:41:17.434607 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:41:17.434607 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:41:17.434607 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:41:17.434607 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:41:17.434607 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Oct 19 03:41:17.434607 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 19 03:41:17.434607 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:41:17.434607 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:41:17.434607 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03a1c7ec-0e6b-437f-adfe-a0a370fc048f could not be found. Oct 19 03:41:17.434607 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:41:17.434607 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:41:17.434607 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:41:17.434607 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:41:17.434607 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:41:17.434607 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:41:17.438243 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:41:17.438243 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:41:17.438243 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03a1c7ec-0e6b-437f-adfe-a0a370fc048f could not be found. Oct 19 03:41:17.438243 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:41:17.438243 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-856b662c-4a2a-487e-8b9c-bcc7db1e47ba tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Returning 404 to user: Instance 03a1c7ec-0e6b-437f-adfe-a0a370fc048f could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:41:17.438243 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-856b662c-4a2a-487e-8b9c-bcc7db1e47ba tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "POST /compute/v2.1/servers/03a1c7ec-0e6b-437f-adfe-a0a370fc048f/action" status: 404 len: 111 microversion: 2.1 time: 0.028095 Oct 19 03:41:17.441362 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2773/5631] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:41:17 2022] POST /compute/v2.1/servers/03a1c7ec-0e6b-437f-adfe-a0a370fc048f/action => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:41:17.451727 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2e22af1b-2668-4e20-aafa-8ac6d28f32d2 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:17.453347 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2e22af1b-2668-4e20-aafa-8ac6d28f32d2 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:41:17.462412 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2e22af1b-2668-4e20-aafa-8ac6d28f32d2 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:17.462955 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2e22af1b-2668-4e20-aafa-8ac6d28f32d2 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:17.463810 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2e22af1b-2668-4e20-aafa-8ac6d28f32d2 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:17.464493 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2e22af1b-2668-4e20-aafa-8ac6d28f32d2 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:17.465530 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2e22af1b-2668-4e20-aafa-8ac6d28f32d2 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:17.466149 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2e22af1b-2668-4e20-aafa-8ac6d28f32d2 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:17.504483 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-5423f084-3f40-4627-920d-89c83b8cc6a8 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:41:17.519536 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5423f084-3f40-4627-920d-89c83b8cc6a8 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b" status: 200 len: 1524 microversion: 2.1 time: 0.296516 Oct 19 03:41:17.520231 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2859/5632] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:41:17 2022] GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b => generated 1524 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:41:17.562850 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-acff9b67-1035-4990-9e19-627d5bc047f5 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:17.563640 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-acff9b67-1035-4990-9e19-627d5bc047f5 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] [instance: eff2dc27-f6d3-41b6-96ac-c964b1d07419] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:41:17.575745 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-acff9b67-1035-4990-9e19-627d5bc047f5 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:17.576330 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-acff9b67-1035-4990-9e19-627d5bc047f5 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:17.599362 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-acff9b67-1035-4990-9e19-627d5bc047f5 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:17.602659 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-acff9b67-1035-4990-9e19-627d5bc047f5 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:17.606769 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-acff9b67-1035-4990-9e19-627d5bc047f5 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:17.610387 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-acff9b67-1035-4990-9e19-627d5bc047f5 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:17.722623 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-acff9b67-1035-4990-9e19-627d5bc047f5 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:17.722623 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-acff9b67-1035-4990-9e19-627d5bc047f5 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:17.722623 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-acff9b67-1035-4990-9e19-627d5bc047f5 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:17.722623 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-acff9b67-1035-4990-9e19-627d5bc047f5 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lazy-loading 'fault' on Instance uuid eff2dc27-f6d3-41b6-96ac-c964b1d07419 {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:41:17.723487 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-2e22af1b-2668-4e20-aafa-8ac6d28f32d2 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:41:17.723487 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2e22af1b-2668-4e20-aafa-8ac6d28f32d2 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1506 microversion: 2.1 time: 0.270519 Oct 19 03:41:17.723487 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2774/5633] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:41:17 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1506 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:41:17.753387 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d3721dde-3fdf-4e80-ba05-44c6e1a34cfa tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:17.761709 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d3721dde-3fdf-4e80-ba05-44c6e1a34cfa tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:41:17.776377 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d3721dde-3fdf-4e80-ba05-44c6e1a34cfa tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:17.778719 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d3721dde-3fdf-4e80-ba05-44c6e1a34cfa tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:17.779263 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d3721dde-3fdf-4e80-ba05-44c6e1a34cfa tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:17.781032 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d3721dde-3fdf-4e80-ba05-44c6e1a34cfa tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:17.783777 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d3721dde-3fdf-4e80-ba05-44c6e1a34cfa tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:17.785539 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d3721dde-3fdf-4e80-ba05-44c6e1a34cfa tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:17.851201 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-acff9b67-1035-4990-9e19-627d5bc047f5 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4670fd4408d4454784251a880d5a72f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf91777fa414ddaa797d735e7d2a275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:41:17.867533 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-acff9b67-1035-4990-9e19-627d5bc047f5 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] 10.222.0.52 "GET /compute/v2.1/servers/eff2dc27-f6d3-41b6-96ac-c964b1d07419" status: 200 len: 1339 microversion: 2.1 time: 0.308633 Oct 19 03:41:17.869425 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2860/5634] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:41:17 2022] GET /compute/v2.1/servers/eff2dc27-f6d3-41b6-96ac-c964b1d07419 => generated 1339 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:41:18.544938 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-06e4bed5-408c-49bd-90de-3f325fc8ba0c tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:18.545603 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-06e4bed5-408c-49bd-90de-3f325fc8ba0c tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 7e633743-2b38-4c08-be9e-fdfde600b48b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:41:18.557244 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-06e4bed5-408c-49bd-90de-3f325fc8ba0c tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:18.557773 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-06e4bed5-408c-49bd-90de-3f325fc8ba0c tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:18.562468 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-06e4bed5-408c-49bd-90de-3f325fc8ba0c tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:18.567530 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-06e4bed5-408c-49bd-90de-3f325fc8ba0c tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:18.568258 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-06e4bed5-408c-49bd-90de-3f325fc8ba0c tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:18.569017 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-06e4bed5-408c-49bd-90de-3f325fc8ba0c tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:18.658741 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d3721dde-3fdf-4e80-ba05-44c6e1a34cfa tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:41:18.696122 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d3721dde-3fdf-4e80-ba05-44c6e1a34cfa tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1506 microversion: 2.1 time: 0.926806 Oct 19 03:41:18.698317 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2775/5635] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:41:17 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1506 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:41:18.756116 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-79b231ba-dde9-4986-9de3-482054d55f6c tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:41:18.756839 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-79b231ba-dde9-4986-9de3-482054d55f6c tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:41:18.794610 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-79b231ba-dde9-4986-9de3-482054d55f6c tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:18.805176 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-79b231ba-dde9-4986-9de3-482054d55f6c tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:18.805176 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-79b231ba-dde9-4986-9de3-482054d55f6c tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:18.805176 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-79b231ba-dde9-4986-9de3-482054d55f6c tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:18.805176 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-79b231ba-dde9-4986-9de3-482054d55f6c tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:18.805176 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-79b231ba-dde9-4986-9de3-482054d55f6c tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:18.878053 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-79b231ba-dde9-4986-9de3-482054d55f6c tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] HTTP exception thrown: Cannot 'unpause' instance 5a830928-6d51-4dbd-97ad-8cca44de3770 while it is in vm_state active Oct 19 03:41:18.884812 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-79b231ba-dde9-4986-9de3-482054d55f6c tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Request method failure captured: Oct 19 03:41:18.884812 n-d-861333-8 devstack@n-api.service[121134]: request: POST /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770/action HTTP/1.1 Oct 19 03:41:18.884812 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:41:18.884812 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:41:18.884812 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:41:18.884812 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 15 Oct 19 03:41:18.884812 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:41:18.884812 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:41:18.884812 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:41:18.884812 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:41:18.884812 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3EK4yDar5R5kGdpWRPopK281fOgxjiWCAZdy3tbDZzFYZxrN53hSsTq0YyAxsfcVRT4cF0jU61e6walOKxMx_njT0L3WOIYEymBjzmNzdXOa-UhYNf83BpQOShCJts2aNodNdu7YjeLcAcuRF0ZOjoH0xsH4HoNSzc8IfQzKhRz4vw Oct 19 03:41:18.884812 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:41:18.884812 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:41:18.884812 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:41:18.884812 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:41:18.884812 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:41:18.884812 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:41:18.884812 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 34bd94983fbf4a8aa49aff65c076e9e3 Oct 19 03:41:18.884812 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:41:18.884812 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:41:18.884812 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:41:18.884812 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_34bd94983fbf4a8aa49aff65c076e9e3", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:41:18.884812 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:41:18.884812 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 34bd94983fbf4a8aa49aff65c076e9e3 Oct 19 03:41:18.884812 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:41:18.884812 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ServersNegativeTestJSON-553742303-project Oct 19 03:41:18.884812 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:41:18.884812 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:41:18.884812 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 771feb133bc046588552d3af98f8e0a1 Oct 19 03:41:18.884812 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ServersNegativeTestJSON-553742303-project Oct 19 03:41:18.884812 n-d-861333-8 devstack@n-api.service[121134]: Oct 19 03:41:18.884812 n-d-861333-8 devstack@n-api.service[121134]: {"unpause": {}} Oct 19 03:41:18.884812 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:41:18.884812 n-d-861333-8 devstack@n-api.service[121134]: exception: Cannot 'unpause' instance 5a830928-6d51-4dbd-97ad-8cca44de3770 while it is in vm_state active Oct 19 03:41:18.884812 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '5a830928-6d51-4dbd-97ad-8cca44de3770', 'body': {'unpause': {}}} Oct 19 03:41:18.884812 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:41:18.884812 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:41:18.884812 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Oct 19 03:41:18.884812 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Oct 19 03:41:18.884812 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 19 03:41:18.884812 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 19 03:41:18.884812 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 19 03:41:18.884812 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 19 03:41:18.884812 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5a830928-6d51-4dbd-97ad-8cca44de3770 in vm_state active. Cannot unpause while the instance is in this state. Oct 19 03:41:18.884812 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:41:18.884812 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:41:18.884812 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:41:18.884812 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:41:18.884812 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:41:18.884812 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:41:18.884812 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:41:18.884812 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:41:18.884812 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:41:18.884812 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:41:18.884812 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Oct 19 03:41:18.884812 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 19 03:41:18.884812 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 19 03:41:18.884812 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 19 03:41:18.884812 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 5a830928-6d51-4dbd-97ad-8cca44de3770 while it is in vm_state active Oct 19 03:41:18.884812 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:41:18.884812 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:41:18.884812 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:41:18.884812 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:41:18.884812 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:41:18.889344 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:41:18.889344 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:41:18.889344 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:41:18.889344 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 5a830928-6d51-4dbd-97ad-8cca44de3770 while it is in vm_state active Oct 19 03:41:18.889344 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:41:18.891417 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-79b231ba-dde9-4986-9de3-482054d55f6c tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Returning 409 to user: Cannot 'unpause' instance 5a830928-6d51-4dbd-97ad-8cca44de3770 while it is in vm_state active {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:41:18.894104 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-79b231ba-dde9-4986-9de3-482054d55f6c tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "POST /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770/action" status: 409 len: 145 microversion: 2.1 time: 0.168066 Oct 19 03:41:18.894928 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2776/5636] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:41:18 2022] POST /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770/action => generated 145 bytes in 175 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 19 03:41:18.906069 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-71abde27-411d-44be-b4b7-adceab74f314 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:18.909647 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-71abde27-411d-44be-b4b7-adceab74f314 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] [instance: eff2dc27-f6d3-41b6-96ac-c964b1d07419] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:41:18.922403 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-71abde27-411d-44be-b4b7-adceab74f314 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:18.924990 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-71abde27-411d-44be-b4b7-adceab74f314 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:18.931477 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-71abde27-411d-44be-b4b7-adceab74f314 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:18.932508 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-71abde27-411d-44be-b4b7-adceab74f314 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:18.933150 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-71abde27-411d-44be-b4b7-adceab74f314 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:18.934824 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-71abde27-411d-44be-b4b7-adceab74f314 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:18.970956 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-71abde27-411d-44be-b4b7-adceab74f314 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] HTTP exception thrown: Instance eff2dc27-f6d3-41b6-96ac-c964b1d07419 could not be found. Oct 19 03:41:18.973509 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-71abde27-411d-44be-b4b7-adceab74f314 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Request method failure captured: Oct 19 03:41:18.973509 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/eff2dc27-f6d3-41b6-96ac-c964b1d07419 HTTP/1.1 Oct 19 03:41:18.973509 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:41:18.973509 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:41:18.973509 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:41:18.973509 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:41:18.973509 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:41:18.973509 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:41:18.973509 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:41:18.973509 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:41:18.973509 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3E2AeEMoW-TTWkIwJnaLXssujmdVopIaG0EauE5_lUPoQTPXJr_To2XzFAqBfAgjt-sPXSPB3mvNMM18FY3GNXGy_BQraJqqj4NrkmCgvvRj_VFWZkfvbr7DfNxGYC3Lfg6fBpJNpJhOEVxFRdxu6128Rtc8ehjMT3Rm5I83ry8sPg Oct 19 03:41:18.973509 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:41:18.973509 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:41:18.973509 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:41:18.973509 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:41:18.973509 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:41:18.973509 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:41:18.973509 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 3bf91777fa414ddaa797d735e7d2a275 Oct 19 03:41:18.973509 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-TestNetworkBasicOps-1176039654 Oct 19 03:41:18.973509 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:41:18.973509 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:41:18.973509 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/3bf91777fa414ddaa797d735e7d2a275"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3bf91777fa414ddaa797d735e7d2a275"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3bf91777fa414ddaa797d735e7d2a275"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_3bf91777fa414ddaa797d735e7d2a275", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:41:18.973509 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-TestNetworkBasicOps-1176039654 Oct 19 03:41:18.973509 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 3bf91777fa414ddaa797d735e7d2a275 Oct 19 03:41:18.973509 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-TestNetworkBasicOps-1176039654 Oct 19 03:41:18.973509 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-TestNetworkBasicOps-1176039654-project Oct 19 03:41:18.973509 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:41:18.973509 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:41:18.973509 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 4670fd4408d4454784251a880d5a72f5 Oct 19 03:41:18.973509 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-TestNetworkBasicOps-1176039654-project Oct 19 03:41:18.973509 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:41:18.973509 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance eff2dc27-f6d3-41b6-96ac-c964b1d07419 could not be found. Oct 19 03:41:18.973509 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': 'eff2dc27-f6d3-41b6-96ac-c964b1d07419'} Oct 19 03:41:18.973509 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:41:18.973509 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:41:18.973509 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:41:18.973509 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:41:18.973509 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:41:18.973509 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:41:18.973509 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:41:18.973509 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:41:18.973509 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:41:18.973509 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:41:18.973509 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eff2dc27-f6d3-41b6-96ac-c964b1d07419 could not be found. Oct 19 03:41:18.973509 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:41:18.973509 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:41:18.973509 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:41:18.973509 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:41:18.973509 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:41:18.973509 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:41:18.973509 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:41:18.973509 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:41:18.973509 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:41:18.973509 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:41:18.973509 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:41:18.973509 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:41:18.973509 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:41:18.973509 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:41:18.973509 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:41:18.973509 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:41:18.973509 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eff2dc27-f6d3-41b6-96ac-c964b1d07419 could not be found. Oct 19 03:41:18.973509 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:41:18.973509 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:41:18.973509 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:41:18.977215 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:41:18.977215 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:41:18.977215 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:41:18.977215 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:41:18.977215 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:41:18.977215 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eff2dc27-f6d3-41b6-96ac-c964b1d07419 could not be found. Oct 19 03:41:18.977215 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:41:18.983215 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-71abde27-411d-44be-b4b7-adceab74f314 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Returning 404 to user: Instance eff2dc27-f6d3-41b6-96ac-c964b1d07419 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:41:18.984943 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-71abde27-411d-44be-b4b7-adceab74f314 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] 10.222.0.52 "GET /compute/v2.1/servers/eff2dc27-f6d3-41b6-96ac-c964b1d07419" status: 404 len: 111 microversion: 2.1 time: 0.086068 Oct 19 03:41:18.987744 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2777/5637] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:41:18 2022] GET /compute/v2.1/servers/eff2dc27-f6d3-41b6-96ac-c964b1d07419 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:41:19.024130 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ddfd1c30-de45-4dcc-b22d-224909d88a05 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:19.028020 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ddfd1c30-de45-4dcc-b22d-224909d88a05 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:41:19.057698 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ddfd1c30-de45-4dcc-b22d-224909d88a05 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:19.057698 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ddfd1c30-de45-4dcc-b22d-224909d88a05 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:19.060495 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ddfd1c30-de45-4dcc-b22d-224909d88a05 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:19.064420 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ddfd1c30-de45-4dcc-b22d-224909d88a05 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:19.065143 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ddfd1c30-de45-4dcc-b22d-224909d88a05 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:19.065830 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ddfd1c30-de45-4dcc-b22d-224909d88a05 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:19.780292 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-06e4bed5-408c-49bd-90de-3f325fc8ba0c tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:41:19.796844 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-06e4bed5-408c-49bd-90de-3f325fc8ba0c tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b" status: 200 len: 1524 microversion: 2.1 time: 1.256328 Oct 19 03:41:19.800261 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2861/5638] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:41:18 2022] GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b => generated 1524 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:41:19.812325 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-63a7822d-db75-4ab6-aa3a-a282719a9a4f tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Calling method '.version_select at 0x7fc13012f700>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:19.924868 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-63a7822d-db75-4ab6-aa3a-a282719a9a4f tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1954405414" status: 202 len: 0 microversion: 2.1 time: 0.121962 Oct 19 03:41:19.925336 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2862/5639] 10.222.0.52 () {58 vars in 1257 bytes} [Wed Oct 19 03:41:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1954405414 => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:41:20.049896 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ddfd1c30-de45-4dcc-b22d-224909d88a05 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:41:20.072592 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ddfd1c30-de45-4dcc-b22d-224909d88a05 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1506 microversion: 2.1 time: 1.075448 Oct 19 03:41:20.075753 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2778/5640] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:41:18 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1506 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:41:20.100560 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-fa89e3b9-eb3f-49fb-9d67-1c244d0dfead tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:20.102427 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-fa89e3b9-eb3f-49fb-9d67-1c244d0dfead tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:41:20.119185 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fa89e3b9-eb3f-49fb-9d67-1c244d0dfead tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:20.123108 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fa89e3b9-eb3f-49fb-9d67-1c244d0dfead tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:20.124080 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fa89e3b9-eb3f-49fb-9d67-1c244d0dfead tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:20.128803 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fa89e3b9-eb3f-49fb-9d67-1c244d0dfead tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:20.131192 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fa89e3b9-eb3f-49fb-9d67-1c244d0dfead tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:20.142717 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fa89e3b9-eb3f-49fb-9d67-1c244d0dfead tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:20.250348 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=95,nova_cell1:UPDATE=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:41:20.826021 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-85f03996-2833-415f-acbe-6ad0fbc92427 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:20.826643 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-85f03996-2833-415f-acbe-6ad0fbc92427 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 7e633743-2b38-4c08-be9e-fdfde600b48b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:41:20.842286 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-85f03996-2833-415f-acbe-6ad0fbc92427 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:20.847481 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-85f03996-2833-415f-acbe-6ad0fbc92427 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:20.851194 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-85f03996-2833-415f-acbe-6ad0fbc92427 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:20.859274 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-85f03996-2833-415f-acbe-6ad0fbc92427 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:20.864800 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-85f03996-2833-415f-acbe-6ad0fbc92427 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:20.865609 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-85f03996-2833-415f-acbe-6ad0fbc92427 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:20.944558 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-fa89e3b9-eb3f-49fb-9d67-1c244d0dfead tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:41:20.960724 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-fa89e3b9-eb3f-49fb-9d67-1c244d0dfead tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1506 microversion: 2.1 time: 0.860399 Oct 19 03:41:20.972345 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2863/5641] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:41:20 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1506 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:41:20.996786 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2b45b589-1da8-4678-a24b-c80bb7036098 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:41:20.997409 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-2b45b589-1da8-4678-a24b-c80bb7036098 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: c9c92a83-7a5e-4990-80da-48454f5e77c0] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:41:21.010488 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-2b45b589-1da8-4678-a24b-c80bb7036098 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] HTTP exception thrown: Instance c9c92a83-7a5e-4990-80da-48454f5e77c0 could not be found. Oct 19 03:41:21.013081 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2b45b589-1da8-4678-a24b-c80bb7036098 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Request method failure captured: Oct 19 03:41:21.013081 n-d-861333-8 devstack@n-api.service[121135]: request: POST /compute/v2.1/servers/c9c92a83-7a5e-4990-80da-48454f5e77c0/action HTTP/1.1 Oct 19 03:41:21.013081 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:41:21.013081 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:41:21.013081 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:41:21.013081 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 18 Oct 19 03:41:21.013081 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:41:21.013081 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:41:21.013081 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:41:21.013081 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:41:21.013081 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT3EK4yDar5R5kGdpWRPopK281fOgxjiWCAZdy3tbDZzFYZxrN53hSsTq0YyAxsfcVRT4cF0jU61e6walOKxMx_njT0L3WOIYEymBjzmNzdXOa-UhYNf83BpQOShCJts2aNodNdu7YjeLcAcuRF0ZOjoH0xsH4HoNSzc8IfQzKhRz4vw Oct 19 03:41:21.013081 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:41:21.013081 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:41:21.013081 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:41:21.013081 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:41:21.013081 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:41:21.013081 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:41:21.013081 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 34bd94983fbf4a8aa49aff65c076e9e3 Oct 19 03:41:21.013081 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:41:21.013081 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:41:21.013081 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:41:21.013081 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_34bd94983fbf4a8aa49aff65c076e9e3", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:41:21.013081 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:41:21.013081 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 34bd94983fbf4a8aa49aff65c076e9e3 Oct 19 03:41:21.013081 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:41:21.013081 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ServersNegativeTestJSON-553742303-project Oct 19 03:41:21.013081 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:41:21.013081 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:41:21.013081 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 771feb133bc046588552d3af98f8e0a1 Oct 19 03:41:21.013081 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ServersNegativeTestJSON-553742303-project Oct 19 03:41:21.013081 n-d-861333-8 devstack@n-api.service[121135]: Oct 19 03:41:21.013081 n-d-861333-8 devstack@n-api.service[121135]: {"unshelve": null} Oct 19 03:41:21.013081 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:41:21.013081 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance c9c92a83-7a5e-4990-80da-48454f5e77c0 could not be found. Oct 19 03:41:21.013081 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': 'c9c92a83-7a5e-4990-80da-48454f5e77c0', 'body': {'unshelve': None}} Oct 19 03:41:21.013081 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:41:21.013081 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:41:21.013081 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:41:21.013081 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:41:21.013081 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:41:21.013081 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:41:21.013081 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 19 03:41:21.013081 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 19 03:41:21.013081 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9c92a83-7a5e-4990-80da-48454f5e77c0 could not be found. Oct 19 03:41:21.013081 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:41:21.013081 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:41:21.013081 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:41:21.013081 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:41:21.013081 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:41:21.013081 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:41:21.013081 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:41:21.013081 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:41:21.013081 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:41:21.013081 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:41:21.013081 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:41:21.013081 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:41:21.013081 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:41:21.013081 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:41:21.013081 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Oct 19 03:41:21.013081 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 19 03:41:21.013081 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:41:21.013081 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:41:21.013081 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9c92a83-7a5e-4990-80da-48454f5e77c0 could not be found. Oct 19 03:41:21.013081 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:41:21.013081 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:41:21.023461 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:41:21.023461 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:41:21.023461 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:41:21.023461 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:41:21.023461 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:41:21.023461 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:41:21.023461 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9c92a83-7a5e-4990-80da-48454f5e77c0 could not be found. Oct 19 03:41:21.023461 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:41:21.023461 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2b45b589-1da8-4678-a24b-c80bb7036098 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Returning 404 to user: Instance c9c92a83-7a5e-4990-80da-48454f5e77c0 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:41:21.023461 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2b45b589-1da8-4678-a24b-c80bb7036098 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "POST /compute/v2.1/servers/c9c92a83-7a5e-4990-80da-48454f5e77c0/action" status: 404 len: 111 microversion: 2.1 time: 0.023040 Oct 19 03:41:21.028875 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2864/5642] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:41:20 2022] POST /compute/v2.1/servers/c9c92a83-7a5e-4990-80da-48454f5e77c0/action => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 03:41:21.039038 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-8381bb2a-734c-429e-a4ce-d570ae5bd687 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:21.049206 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-8381bb2a-734c-429e-a4ce-d570ae5bd687 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:41:21.071177 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8381bb2a-734c-429e-a4ce-d570ae5bd687 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:21.074645 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8381bb2a-734c-429e-a4ce-d570ae5bd687 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:21.074645 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8381bb2a-734c-429e-a4ce-d570ae5bd687 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:21.074645 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8381bb2a-734c-429e-a4ce-d570ae5bd687 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:21.075053 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8381bb2a-734c-429e-a4ce-d570ae5bd687 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:21.075663 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8381bb2a-734c-429e-a4ce-d570ae5bd687 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:21.667441 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-85f03996-2833-415f-acbe-6ad0fbc92427 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:41:21.687501 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-85f03996-2833-415f-acbe-6ad0fbc92427 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b" status: 200 len: 1524 microversion: 2.1 time: 0.866862 Oct 19 03:41:21.688126 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2779/5643] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:41:20 2022] GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b => generated 1524 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:41:21.713130 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-8381bb2a-734c-429e-a4ce-d570ae5bd687 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:41:21.723960 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-8381bb2a-734c-429e-a4ce-d570ae5bd687 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1506 microversion: 2.1 time: 0.689473 Oct 19 03:41:21.742843 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2865/5644] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:41:21 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1506 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:41:21.764963 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-047a8c95-877a-46ef-a346-223df60ac467 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:21.766544 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-047a8c95-877a-46ef-a346-223df60ac467 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:41:21.779572 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-047a8c95-877a-46ef-a346-223df60ac467 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:21.783953 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-047a8c95-877a-46ef-a346-223df60ac467 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:21.787325 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-047a8c95-877a-46ef-a346-223df60ac467 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:21.788432 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-047a8c95-877a-46ef-a346-223df60ac467 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:21.789989 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-047a8c95-877a-46ef-a346-223df60ac467 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:21.793539 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-047a8c95-877a-46ef-a346-223df60ac467 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:22.127664 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e298f04a-face-4298-8041-72578f0bee61 tempest-VolumesSnapshotsTestJSON-159090315 tempest-VolumesSnapshotsTestJSON-159090315-project] Action: 'create', calling method: .version_select at 0x7fc131966e50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-496645625"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:41:22.299962 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-047a8c95-877a-46ef-a346-223df60ac467 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:41:22.311973 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-047a8c95-877a-46ef-a346-223df60ac467 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1506 microversion: 2.1 time: 0.557285 Oct 19 03:41:22.338256 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2866/5645] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:41:21 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1506 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:41:22.348858 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c2bf234c-2889-4e01-9e5c-433e217ca0a8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:41:22.353454 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c2bf234c-2889-4e01-9e5c-433e217ca0a8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:41:22.371779 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c2bf234c-2889-4e01-9e5c-433e217ca0a8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:22.371779 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c2bf234c-2889-4e01-9e5c-433e217ca0a8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:22.371779 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c2bf234c-2889-4e01-9e5c-433e217ca0a8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:22.373704 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c2bf234c-2889-4e01-9e5c-433e217ca0a8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:22.374343 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c2bf234c-2889-4e01-9e5c-433e217ca0a8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:22.377124 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c2bf234c-2889-4e01-9e5c-433e217ca0a8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:22.451508 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-c2bf234c-2889-4e01-9e5c-433e217ca0a8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] HTTP exception thrown: Cannot 'unshelve' instance 5a830928-6d51-4dbd-97ad-8cca44de3770 while it is in vm_state active Oct 19 03:41:22.456518 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c2bf234c-2889-4e01-9e5c-433e217ca0a8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Request method failure captured: Oct 19 03:41:22.456518 n-d-861333-8 devstack@n-api.service[121135]: request: POST /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770/action HTTP/1.1 Oct 19 03:41:22.456518 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:41:22.456518 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:41:22.456518 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:41:22.456518 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 18 Oct 19 03:41:22.456518 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:41:22.456518 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:41:22.456518 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:41:22.456518 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:41:22.456518 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT3EK4yDar5R5kGdpWRPopK281fOgxjiWCAZdy3tbDZzFYZxrN53hSsTq0YyAxsfcVRT4cF0jU61e6walOKxMx_njT0L3WOIYEymBjzmNzdXOa-UhYNf83BpQOShCJts2aNodNdu7YjeLcAcuRF0ZOjoH0xsH4HoNSzc8IfQzKhRz4vw Oct 19 03:41:22.456518 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:41:22.456518 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:41:22.456518 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:41:22.456518 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:41:22.456518 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:41:22.456518 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:41:22.456518 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 34bd94983fbf4a8aa49aff65c076e9e3 Oct 19 03:41:22.456518 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:41:22.456518 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:41:22.456518 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:41:22.456518 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_34bd94983fbf4a8aa49aff65c076e9e3", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:41:22.456518 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:41:22.456518 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 34bd94983fbf4a8aa49aff65c076e9e3 Oct 19 03:41:22.456518 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:41:22.456518 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ServersNegativeTestJSON-553742303-project Oct 19 03:41:22.456518 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:41:22.456518 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:41:22.456518 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 771feb133bc046588552d3af98f8e0a1 Oct 19 03:41:22.456518 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ServersNegativeTestJSON-553742303-project Oct 19 03:41:22.456518 n-d-861333-8 devstack@n-api.service[121135]: Oct 19 03:41:22.456518 n-d-861333-8 devstack@n-api.service[121135]: {"unshelve": null} Oct 19 03:41:22.456518 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:41:22.456518 n-d-861333-8 devstack@n-api.service[121135]: exception: Cannot 'unshelve' instance 5a830928-6d51-4dbd-97ad-8cca44de3770 while it is in vm_state active Oct 19 03:41:22.456518 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '5a830928-6d51-4dbd-97ad-8cca44de3770', 'body': {'unshelve': None}} Oct 19 03:41:22.456518 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:41:22.456518 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:41:22.456518 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Oct 19 03:41:22.456518 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Oct 19 03:41:22.456518 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 19 03:41:22.456518 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 19 03:41:22.456518 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 19 03:41:22.456518 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 19 03:41:22.456518 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 19 03:41:22.456518 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 19 03:41:22.456518 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5a830928-6d51-4dbd-97ad-8cca44de3770 in vm_state active. Cannot unshelve while the instance is in this state. Oct 19 03:41:22.456518 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:41:22.456518 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:41:22.456518 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:41:22.456518 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:41:22.456518 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:41:22.456518 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:41:22.456518 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:41:22.456518 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:41:22.456518 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:41:22.456518 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:41:22.456518 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:41:22.456518 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:41:22.456518 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:41:22.456518 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:41:22.456518 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Oct 19 03:41:22.456518 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 19 03:41:22.456518 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 19 03:41:22.456518 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 19 03:41:22.468945 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 5a830928-6d51-4dbd-97ad-8cca44de3770 while it is in vm_state active Oct 19 03:41:22.468945 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:41:22.468945 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:41:22.468945 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:41:22.468945 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:41:22.468945 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:41:22.468945 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:41:22.468945 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:41:22.468945 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:41:22.468945 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 5a830928-6d51-4dbd-97ad-8cca44de3770 while it is in vm_state active Oct 19 03:41:22.468945 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:41:22.468945 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c2bf234c-2889-4e01-9e5c-433e217ca0a8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Returning 409 to user: Cannot 'unshelve' instance 5a830928-6d51-4dbd-97ad-8cca44de3770 while it is in vm_state active {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:41:22.468945 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c2bf234c-2889-4e01-9e5c-433e217ca0a8 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "POST /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770/action" status: 409 len: 146 microversion: 2.1 time: 0.118688 Oct 19 03:41:22.468945 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2867/5646] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:41:22 2022] POST /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770/action => generated 146 bytes in 120 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 19 03:41:22.477782 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1347c466-90e0-4db4-8863-d0c81eb9dbe5 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:22.482469 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1347c466-90e0-4db4-8863-d0c81eb9dbe5 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:41:22.502442 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1347c466-90e0-4db4-8863-d0c81eb9dbe5 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:22.502958 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1347c466-90e0-4db4-8863-d0c81eb9dbe5 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:22.508219 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1347c466-90e0-4db4-8863-d0c81eb9dbe5 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:22.509660 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1347c466-90e0-4db4-8863-d0c81eb9dbe5 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:22.511876 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1347c466-90e0-4db4-8863-d0c81eb9dbe5 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:22.512722 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1347c466-90e0-4db4-8863-d0c81eb9dbe5 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:23.265188 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e298f04a-face-4298-8041-72578f0bee61 tempest-VolumesSnapshotsTestJSON-159090315 tempest-VolumesSnapshotsTestJSON-159090315-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 1.568938 Oct 19 03:41:23.267003 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2780/5647] 10.222.0.52 () {60 vars in 1155 bytes} [Wed Oct 19 03:41:21 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 1578 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 19 03:41:23.273384 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-75aacbe9-b95c-414c-80ad-d39c2913f7e7 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:23.274886 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-75aacbe9-b95c-414c-80ad-d39c2913f7e7 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 7e633743-2b38-4c08-be9e-fdfde600b48b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:41:23.281922 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:41:23.290362 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-75aacbe9-b95c-414c-80ad-d39c2913f7e7 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:23.290362 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-75aacbe9-b95c-414c-80ad-d39c2913f7e7 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:23.290362 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-75aacbe9-b95c-414c-80ad-d39c2913f7e7 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:23.290362 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-75aacbe9-b95c-414c-80ad-d39c2913f7e7 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:23.290362 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-75aacbe9-b95c-414c-80ad-d39c2913f7e7 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:23.290362 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-75aacbe9-b95c-414c-80ad-d39c2913f7e7 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:23.376003 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-1347c466-90e0-4db4-8863-d0c81eb9dbe5 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:41:23.391650 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1347c466-90e0-4db4-8863-d0c81eb9dbe5 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1506 microversion: 2.1 time: 0.924070 Oct 19 03:41:23.392536 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2868/5648] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:41:22 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1506 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:41:23.427668 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f6c2b350-9c12-4810-9091-c43f85c78458 tempest-VolumesSnapshotsTestJSON-159090315 tempest-VolumesSnapshotsTestJSON-159090315-project] Calling method '.version_select at 0x7fc13003ab80>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:23.624034 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f6c2b350-9c12-4810-9091-c43f85c78458 tempest-VolumesSnapshotsTestJSON-159090315 tempest-VolumesSnapshotsTestJSON-159090315-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/13714734-84a8-4d6a-a54c-c715fa827207" status: 200 len: 344 microversion: 2.1 time: 0.211443 Oct 19 03:41:23.625078 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2869/5649] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Oct 19 03:41:23 2022] GET /compute/v2.1/os-volumes/13714734-84a8-4d6a-a54c-c715fa827207 => generated 344 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:41:23.630359 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a251a7dc-8fd6-4efd-bb44-76db22d57a6e tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:23.631488 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a251a7dc-8fd6-4efd-bb44-76db22d57a6e tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:41:23.659472 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a251a7dc-8fd6-4efd-bb44-76db22d57a6e tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:23.660097 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a251a7dc-8fd6-4efd-bb44-76db22d57a6e tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:23.660554 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a251a7dc-8fd6-4efd-bb44-76db22d57a6e tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:23.661293 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a251a7dc-8fd6-4efd-bb44-76db22d57a6e tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:23.668885 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a251a7dc-8fd6-4efd-bb44-76db22d57a6e tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:23.669700 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a251a7dc-8fd6-4efd-bb44-76db22d57a6e tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:23.709403 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-75aacbe9-b95c-414c-80ad-d39c2913f7e7 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:41:23.718338 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-75aacbe9-b95c-414c-80ad-d39c2913f7e7 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b" status: 200 len: 1524 microversion: 2.1 time: 0.449977 Oct 19 03:41:23.732592 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2781/5650] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:41:23 2022] GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b => generated 1524 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:41:24.293768 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a251a7dc-8fd6-4efd-bb44-76db22d57a6e tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:41:24.316071 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a251a7dc-8fd6-4efd-bb44-76db22d57a6e tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1506 microversion: 2.1 time: 0.689512 Oct 19 03:41:24.316672 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2870/5651] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:41:23 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1506 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:41:24.340689 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-642e76fa-6202-47ea-baa6-144953fe70f0 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1331599375_updated"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:41:24.344822 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-642e76fa-6202-47ea-baa6-144953fe70f0 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 9840d995-a68b-4627-a4e4-d6f390dddbd1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:41:24.352705 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-642e76fa-6202-47ea-baa6-144953fe70f0 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] HTTP exception thrown: Instance 9840d995-a68b-4627-a4e4-d6f390dddbd1 could not be found. Oct 19 03:41:24.356036 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-642e76fa-6202-47ea-baa6-144953fe70f0 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Request method failure captured: Oct 19 03:41:24.356036 n-d-861333-8 devstack@n-api.service[121134]: request: PUT /compute/v2.1/servers/9840d995-a68b-4627-a4e4-d6f390dddbd1 HTTP/1.1 Oct 19 03:41:24.356036 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:41:24.356036 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:41:24.356036 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:41:24.356036 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 81 Oct 19 03:41:24.356036 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:41:24.356036 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:41:24.356036 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:41:24.356036 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:41:24.356036 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3EK4yDar5R5kGdpWRPopK281fOgxjiWCAZdy3tbDZzFYZxrN53hSsTq0YyAxsfcVRT4cF0jU61e6walOKxMx_njT0L3WOIYEymBjzmNzdXOa-UhYNf83BpQOShCJts2aNodNdu7YjeLcAcuRF0ZOjoH0xsH4HoNSzc8IfQzKhRz4vw Oct 19 03:41:24.356036 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:41:24.356036 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:41:24.356036 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:41:24.356036 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:41:24.356036 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:41:24.356036 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:41:24.356036 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 34bd94983fbf4a8aa49aff65c076e9e3 Oct 19 03:41:24.356036 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:41:24.356036 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:41:24.356036 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:41:24.356036 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_34bd94983fbf4a8aa49aff65c076e9e3", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:41:24.356036 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:41:24.356036 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 34bd94983fbf4a8aa49aff65c076e9e3 Oct 19 03:41:24.356036 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:41:24.356036 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ServersNegativeTestJSON-553742303-project Oct 19 03:41:24.356036 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:41:24.356036 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:41:24.356036 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 771feb133bc046588552d3af98f8e0a1 Oct 19 03:41:24.356036 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ServersNegativeTestJSON-553742303-project Oct 19 03:41:24.356036 n-d-861333-8 devstack@n-api.service[121134]: Oct 19 03:41:24.356036 n-d-861333-8 devstack@n-api.service[121134]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1331599375_updated"}} Oct 19 03:41:24.356036 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:41:24.356036 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance 9840d995-a68b-4627-a4e4-d6f390dddbd1 could not be found. Oct 19 03:41:24.356036 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '9840d995-a68b-4627-a4e4-d6f390dddbd1', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1331599375_updated'}}} Oct 19 03:41:24.356036 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:41:24.356036 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:41:24.356036 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:41:24.356036 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:41:24.356036 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:41:24.356036 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:41:24.356036 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 19 03:41:24.356036 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 19 03:41:24.356036 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9840d995-a68b-4627-a4e4-d6f390dddbd1 could not be found. Oct 19 03:41:24.356036 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:41:24.356036 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:41:24.356036 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:41:24.356036 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:41:24.356036 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:41:24.356036 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:41:24.356036 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:41:24.356036 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:41:24.356036 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:41:24.356036 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:41:24.356036 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:41:24.356036 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:41:24.356036 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:41:24.356036 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:41:24.356036 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:41:24.356036 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:41:24.356036 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 19 03:41:24.356036 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 19 03:41:24.356036 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 19 03:41:24.356036 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:41:24.359590 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:41:24.359590 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:41:24.359590 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:41:24.359590 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9840d995-a68b-4627-a4e4-d6f390dddbd1 could not be found. Oct 19 03:41:24.359590 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:41:24.359590 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:41:24.359590 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:41:24.359590 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:41:24.359590 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:41:24.359590 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:41:24.359590 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:41:24.359590 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:41:24.359590 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9840d995-a68b-4627-a4e4-d6f390dddbd1 could not be found. Oct 19 03:41:24.359590 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:41:24.362915 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-642e76fa-6202-47ea-baa6-144953fe70f0 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Returning 404 to user: Instance 9840d995-a68b-4627-a4e4-d6f390dddbd1 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:41:24.364078 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-642e76fa-6202-47ea-baa6-144953fe70f0 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "PUT /compute/v2.1/servers/9840d995-a68b-4627-a4e4-d6f390dddbd1" status: 404 len: 111 microversion: 2.1 time: 0.028482 Oct 19 03:41:24.368659 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2782/5652] 10.222.0.52 () {60 vars in 1256 bytes} [Wed Oct 19 03:41:24 2022] PUT /compute/v2.1/servers/9840d995-a68b-4627-a4e4-d6f390dddbd1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:41:24.374203 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-23f28599-4568-43d6-9957-1ee0b5c05642 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:24.374861 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-23f28599-4568-43d6-9957-1ee0b5c05642 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:41:24.395341 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-23f28599-4568-43d6-9957-1ee0b5c05642 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:24.396000 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-23f28599-4568-43d6-9957-1ee0b5c05642 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:24.396304 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-23f28599-4568-43d6-9957-1ee0b5c05642 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:24.399294 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-23f28599-4568-43d6-9957-1ee0b5c05642 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:24.399787 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-23f28599-4568-43d6-9957-1ee0b5c05642 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:24.402161 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-23f28599-4568-43d6-9957-1ee0b5c05642 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:24.643945 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-12e1374c-b212-4209-ac6a-97f16c4be503 tempest-VolumesSnapshotsTestJSON-159090315 tempest-VolumesSnapshotsTestJSON-159090315-project] Calling method '.version_select at 0x7fc12be93790>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:24.851748 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-12e1374c-b212-4209-ac6a-97f16c4be503 tempest-VolumesSnapshotsTestJSON-159090315 tempest-VolumesSnapshotsTestJSON-159090315-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/13714734-84a8-4d6a-a54c-c715fa827207" status: 200 len: 344 microversion: 2.1 time: 0.216491 Oct 19 03:41:24.852330 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2783/5653] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Oct 19 03:41:24 2022] GET /compute/v2.1/os-volumes/13714734-84a8-4d6a-a54c-c715fa827207 => generated 344 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:41:24.858807 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e2a13482-369d-4b90-b9fe-2fd2272a3800 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:24.859656 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e2a13482-369d-4b90-b9fe-2fd2272a3800 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 7e633743-2b38-4c08-be9e-fdfde600b48b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:41:24.897113 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e2a13482-369d-4b90-b9fe-2fd2272a3800 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:24.897113 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e2a13482-369d-4b90-b9fe-2fd2272a3800 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:24.897113 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e2a13482-369d-4b90-b9fe-2fd2272a3800 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:24.897113 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e2a13482-369d-4b90-b9fe-2fd2272a3800 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:24.907523 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e2a13482-369d-4b90-b9fe-2fd2272a3800 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:24.908121 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e2a13482-369d-4b90-b9fe-2fd2272a3800 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:25.043605 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-23f28599-4568-43d6-9957-1ee0b5c05642 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:41:25.057156 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-23f28599-4568-43d6-9957-1ee0b5c05642 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1506 microversion: 2.1 time: 0.687702 Oct 19 03:41:25.068910 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2871/5654] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:41:24 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1506 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:41:25.099086 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-dba926a0-694c-4181-8a7d-c3a8702d99b5 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:25.103100 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-dba926a0-694c-4181-8a7d-c3a8702d99b5 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:41:25.111741 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dba926a0-694c-4181-8a7d-c3a8702d99b5 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:25.129448 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dba926a0-694c-4181-8a7d-c3a8702d99b5 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:25.130221 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dba926a0-694c-4181-8a7d-c3a8702d99b5 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:25.138369 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dba926a0-694c-4181-8a7d-c3a8702d99b5 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:25.139176 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dba926a0-694c-4181-8a7d-c3a8702d99b5 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:25.139634 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dba926a0-694c-4181-8a7d-c3a8702d99b5 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:25.586968 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-dba926a0-694c-4181-8a7d-c3a8702d99b5 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:41:25.604450 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-dba926a0-694c-4181-8a7d-c3a8702d99b5 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1506 microversion: 2.1 time: 0.503766 Oct 19 03:41:25.605770 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2872/5655] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:41:25 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1506 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:41:25.638997 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-74d6f4c7-2ab4-40d3-985e-60d4f33fa617 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:41:25.658619 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-74d6f4c7-2ab4-40d3-985e-60d4f33fa617 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Request method failure captured: Oct 19 03:41:25.658619 n-d-861333-8 devstack@n-api.service[121135]: request: PUT /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 HTTP/1.1 Oct 19 03:41:25.658619 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:41:25.658619 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:41:25.658619 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:41:25.658619 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 280 Oct 19 03:41:25.658619 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:41:25.658619 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:41:25.658619 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:41:25.658619 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:41:25.658619 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT3EK4yDar5R5kGdpWRPopK281fOgxjiWCAZdy3tbDZzFYZxrN53hSsTq0YyAxsfcVRT4cF0jU61e6walOKxMx_njT0L3WOIYEymBjzmNzdXOa-UhYNf83BpQOShCJts2aNodNdu7YjeLcAcuRF0ZOjoH0xsH4HoNSzc8IfQzKhRz4vw Oct 19 03:41:25.658619 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:41:25.658619 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:41:25.658619 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:41:25.658619 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:41:25.658619 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:41:25.658619 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:41:25.658619 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 34bd94983fbf4a8aa49aff65c076e9e3 Oct 19 03:41:25.658619 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:41:25.658619 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:41:25.658619 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:41:25.658619 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_34bd94983fbf4a8aa49aff65c076e9e3", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:41:25.658619 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:41:25.658619 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 34bd94983fbf4a8aa49aff65c076e9e3 Oct 19 03:41:25.658619 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:41:25.658619 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ServersNegativeTestJSON-553742303-project Oct 19 03:41:25.658619 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:41:25.658619 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:41:25.658619 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 771feb133bc046588552d3af98f8e0a1 Oct 19 03:41:25.658619 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ServersNegativeTestJSON-553742303-project Oct 19 03:41:25.658619 n-d-861333-8 devstack@n-api.service[121135]: Oct 19 03:41:25.658619 n-d-861333-8 devstack@n-api.service[121135]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 19 03:41:25.658619 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:41:25.658619 n-d-861333-8 devstack@n-api.service[121135]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 19 03:41:25.658619 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '5a830928-6d51-4dbd-97ad-8cca44de3770', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 19 03:41:25.658619 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:41:25.658619 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:41:25.658619 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 03:41:25.658619 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 03:41:25.658619 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 03:41:25.658619 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise error Oct 19 03:41:25.658619 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 19 03:41:25.658619 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:41:25.658619 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 19 03:41:25.658619 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 19 03:41:25.658619 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:41:25.658619 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 19 03:41:25.658619 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 19 03:41:25.658619 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:41:25.658619 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:41:25.658619 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:41:25.658619 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:41:25.661826 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:41:25.661826 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:41:25.661826 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:41:25.661826 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:41:25.661826 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:41:25.661826 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:41:25.661826 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:41:25.661826 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:41:25.661826 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 03:41:25.661826 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 03:41:25.661826 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 03:41:25.661826 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 03:41:25.661826 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 03:41:25.661826 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 03:41:25.661826 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 19 03:41:25.661826 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:41:25.661826 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:41:25.661826 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:41:25.661826 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:41:25.661826 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:41:25.661826 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:41:25.661826 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 03:41:25.661826 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 03:41:25.661826 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 19 03:41:25.661826 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:41:25.668358 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-74d6f4c7-2ab4-40d3-985e-60d4f33fa617 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:41:25.672254 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-74d6f4c7-2ab4-40d3-985e-60d4f33fa617 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "PUT /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 400 len: 619 microversion: 2.1 time: 0.044681 Oct 19 03:41:25.676464 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2873/5656] 10.222.0.52 () {60 vars in 1257 bytes} [Wed Oct 19 03:41:25 2022] PUT /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 619 bytes in 49 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 03:41:25.713778 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0ba409da-17c9-4fe4-a576-9db3b0503bb3 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:25.723082 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0ba409da-17c9-4fe4-a576-9db3b0503bb3 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:41:25.764696 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0ba409da-17c9-4fe4-a576-9db3b0503bb3 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:25.767707 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0ba409da-17c9-4fe4-a576-9db3b0503bb3 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:25.767707 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0ba409da-17c9-4fe4-a576-9db3b0503bb3 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:25.767707 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0ba409da-17c9-4fe4-a576-9db3b0503bb3 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:25.767707 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0ba409da-17c9-4fe4-a576-9db3b0503bb3 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:25.767707 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0ba409da-17c9-4fe4-a576-9db3b0503bb3 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:25.911973 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e2a13482-369d-4b90-b9fe-2fd2272a3800 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:41:25.930791 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e2a13482-369d-4b90-b9fe-2fd2272a3800 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b" status: 200 len: 1524 microversion: 2.1 time: 1.073891 Oct 19 03:41:25.934725 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2784/5657] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:41:24 2022] GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b => generated 1524 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:41:25.961675 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-66139d8a-fec6-437f-9108-f0e4466b7f78 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:25.966711 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-66139d8a-fec6-437f-9108-f0e4466b7f78 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] [instance: d368a182-a350-4d0c-803d-2972af3aeb7d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:41:25.984881 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-66139d8a-fec6-437f-9108-f0e4466b7f78 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:25.986657 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-66139d8a-fec6-437f-9108-f0e4466b7f78 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:25.987309 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-66139d8a-fec6-437f-9108-f0e4466b7f78 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:25.989098 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-66139d8a-fec6-437f-9108-f0e4466b7f78 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:25.989836 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-66139d8a-fec6-437f-9108-f0e4466b7f78 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:25.993006 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-66139d8a-fec6-437f-9108-f0e4466b7f78 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:26.037126 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-66139d8a-fec6-437f-9108-f0e4466b7f78 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] [instance: d368a182-a350-4d0c-803d-2972af3aeb7d] Going to try to terminate instance {{(pid=121134) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:41:26.184418 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-0ba409da-17c9-4fe4-a576-9db3b0503bb3 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:41:26.204449 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0ba409da-17c9-4fe4-a576-9db3b0503bb3 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1506 microversion: 2.1 time: 0.523751 Oct 19 03:41:26.225338 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2874/5658] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:41:25 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1506 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:41:26.235289 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-a1f3d6a8-41c9-42e2-befc-7a5282dc33ed req-24511318-641c-4d39-818a-88f46b1b2b61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d368a182-a350-4d0c-803d-2972af3aeb7d", "tag": "76e9dcc7-fe11-440c-8253-409dfac2a873"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:41:26.245022 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-a1f3d6a8-41c9-42e2-befc-7a5282dc33ed req-24511318-641c-4d39-818a-88f46b1b2b61 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:26.246472 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-a1f3d6a8-41c9-42e2-befc-7a5282dc33ed req-24511318-641c-4d39-818a-88f46b1b2b61 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:26.247169 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-a1f3d6a8-41c9-42e2-befc-7a5282dc33ed req-24511318-641c-4d39-818a-88f46b1b2b61 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:26.260570 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-a1f3d6a8-41c9-42e2-befc-7a5282dc33ed req-24511318-641c-4d39-818a-88f46b1b2b61 service nova] Creating event network-changed:76e9dcc7-fe11-440c-8253-409dfac2a873 for instance d368a182-a350-4d0c-803d-2972af3aeb7d on n-h2-861333-8 Oct 19 03:41:26.272778 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-a1f3d6a8-41c9-42e2-befc-7a5282dc33ed req-24511318-641c-4d39-818a-88f46b1b2b61 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045585 Oct 19 03:41:26.274273 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2875/5659] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:41:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:41:26.282170 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e44dca40-f33a-4481-b039-dafdf2ee4960 tempest-VolumesSnapshotsTestJSON-159090315 tempest-VolumesSnapshotsTestJSON-159090315-project] Calling method '.version_select at 0x7fc12bfb2790>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:26.434870 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e44dca40-f33a-4481-b039-dafdf2ee4960 tempest-VolumesSnapshotsTestJSON-159090315 tempest-VolumesSnapshotsTestJSON-159090315-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/13714734-84a8-4d6a-a54c-c715fa827207" status: 200 len: 345 microversion: 2.1 time: 0.156857 Oct 19 03:41:26.436252 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2876/5660] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Oct 19 03:41:26 2022] GET /compute/v2.1/os-volumes/13714734-84a8-4d6a-a54c-c715fa827207 => generated 345 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:41:26.443865 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c829e89c-e134-4e02-ba28-a40a5e5dbb2c tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:26.445244 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c829e89c-e134-4e02-ba28-a40a5e5dbb2c tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:41:26.454376 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c829e89c-e134-4e02-ba28-a40a5e5dbb2c tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:26.455098 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c829e89c-e134-4e02-ba28-a40a5e5dbb2c tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:26.455546 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c829e89c-e134-4e02-ba28-a40a5e5dbb2c tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:26.456252 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c829e89c-e134-4e02-ba28-a40a5e5dbb2c tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:26.456717 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c829e89c-e134-4e02-ba28-a40a5e5dbb2c tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:26.457148 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c829e89c-e134-4e02-ba28-a40a5e5dbb2c tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:26.637117 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-66139d8a-fec6-437f-9108-f0e4466b7f78 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] 10.222.0.52 "DELETE /compute/v2.1/servers/d368a182-a350-4d0c-803d-2972af3aeb7d" status: 204 len: 0 microversion: 2.1 time: 0.697549 Oct 19 03:41:26.638219 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2785/5661] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:41:25 2022] DELETE /compute/v2.1/servers/d368a182-a350-4d0c-803d-2972af3aeb7d => generated 0 bytes in 701 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:41:26.645825 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f154f7e5-73b8-4bdf-be13-d25d47b9fdb1 tempest-VolumesSnapshotsTestJSON-159090315 tempest-VolumesSnapshotsTestJSON-159090315-project] Action: 'create', calling method: .version_select at 0x7fc12be934c0>, body: {"snapshot": {"volume_id": "13714734-84a8-4d6a-a54c-c715fa827207", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-2054050022"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:41:27.028496 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c829e89c-e134-4e02-ba28-a40a5e5dbb2c tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:41:27.037391 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c829e89c-e134-4e02-ba28-a40a5e5dbb2c tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1506 microversion: 2.1 time: 0.598671 Oct 19 03:41:27.038454 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2877/5662] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:41:26 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1506 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:41:27.043460 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-87fa50ad-7559-4bdc-a4d6-5c0926b41249 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:27.044252 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-87fa50ad-7559-4bdc-a4d6-5c0926b41249 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] [instance: d368a182-a350-4d0c-803d-2972af3aeb7d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:41:27.050991 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-87fa50ad-7559-4bdc-a4d6-5c0926b41249 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:27.052139 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-87fa50ad-7559-4bdc-a4d6-5c0926b41249 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:27.052742 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-87fa50ad-7559-4bdc-a4d6-5c0926b41249 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:27.053809 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-87fa50ad-7559-4bdc-a4d6-5c0926b41249 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:27.054444 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-87fa50ad-7559-4bdc-a4d6-5c0926b41249 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:27.055081 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-87fa50ad-7559-4bdc-a4d6-5c0926b41249 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:27.279058 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-87fa50ad-7559-4bdc-a4d6-5c0926b41249 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4670fd4408d4454784251a880d5a72f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf91777fa414ddaa797d735e7d2a275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:41:27.289772 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f154f7e5-73b8-4bdf-be13-d25d47b9fdb1 tempest-VolumesSnapshotsTestJSON-159090315 tempest-VolumesSnapshotsTestJSON-159090315-project] 10.222.0.52 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.649480 Oct 19 03:41:27.298116 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2786/5663] 10.222.0.52 () {60 vars in 1162 bytes} [Wed Oct 19 03:41:26 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:41:27.303282 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-032e29d6-0ad6-4930-a2a6-e4cbfa218f0e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:27.304332 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-032e29d6-0ad6-4930-a2a6-e4cbfa218f0e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 7e633743-2b38-4c08-be9e-fdfde600b48b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:41:27.315202 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-87fa50ad-7559-4bdc-a4d6-5c0926b41249 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] 10.222.0.52 "GET /compute/v2.1/servers/d368a182-a350-4d0c-803d-2972af3aeb7d" status: 200 len: 1671 microversion: 2.1 time: 0.273156 Oct 19 03:41:27.315595 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2878/5664] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:41:27 2022] GET /compute/v2.1/servers/d368a182-a350-4d0c-803d-2972af3aeb7d => generated 1671 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:41:27.324233 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4f11410b-7638-49d7-87f0-9731edc3fcb0 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:41:27.328759 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-032e29d6-0ad6-4930-a2a6-e4cbfa218f0e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:27.329489 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-032e29d6-0ad6-4930-a2a6-e4cbfa218f0e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:27.330086 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-032e29d6-0ad6-4930-a2a6-e4cbfa218f0e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:27.331049 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-032e29d6-0ad6-4930-a2a6-e4cbfa218f0e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:27.331658 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-032e29d6-0ad6-4930-a2a6-e4cbfa218f0e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:27.332242 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-032e29d6-0ad6-4930-a2a6-e4cbfa218f0e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:27.335589 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4f11410b-7638-49d7-87f0-9731edc3fcb0 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Request method failure captured: Oct 19 03:41:27.335589 n-d-861333-8 devstack@n-api.service[121135]: request: PUT /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 HTTP/1.1 Oct 19 03:41:27.335589 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:41:27.335589 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:41:27.335589 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:41:27.335589 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 24 Oct 19 03:41:27.335589 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:41:27.335589 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:41:27.335589 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:41:27.335589 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:41:27.335589 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT3EK4yDar5R5kGdpWRPopK281fOgxjiWCAZdy3tbDZzFYZxrN53hSsTq0YyAxsfcVRT4cF0jU61e6walOKxMx_njT0L3WOIYEymBjzmNzdXOa-UhYNf83BpQOShCJts2aNodNdu7YjeLcAcuRF0ZOjoH0xsH4HoNSzc8IfQzKhRz4vw Oct 19 03:41:27.335589 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:41:27.335589 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:41:27.335589 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:41:27.335589 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:41:27.335589 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:41:27.335589 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:41:27.335589 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 34bd94983fbf4a8aa49aff65c076e9e3 Oct 19 03:41:27.335589 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:41:27.335589 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:41:27.335589 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:41:27.335589 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_34bd94983fbf4a8aa49aff65c076e9e3", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:41:27.335589 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:41:27.335589 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 34bd94983fbf4a8aa49aff65c076e9e3 Oct 19 03:41:27.335589 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:41:27.335589 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ServersNegativeTestJSON-553742303-project Oct 19 03:41:27.335589 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:41:27.335589 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:41:27.335589 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 771feb133bc046588552d3af98f8e0a1 Oct 19 03:41:27.335589 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ServersNegativeTestJSON-553742303-project Oct 19 03:41:27.335589 n-d-861333-8 devstack@n-api.service[121135]: Oct 19 03:41:27.335589 n-d-861333-8 devstack@n-api.service[121135]: {"server": {"name": ""}} Oct 19 03:41:27.335589 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:41:27.335589 n-d-861333-8 devstack@n-api.service[121135]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 19 03:41:27.335589 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '5a830928-6d51-4dbd-97ad-8cca44de3770', 'body': {'server': {'name': ''}}} Oct 19 03:41:27.335589 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:41:27.335589 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:41:27.335589 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 03:41:27.335589 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 03:41:27.335589 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 03:41:27.335589 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise error Oct 19 03:41:27.335589 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 19 03:41:27.335589 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:41:27.335589 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 19 03:41:27.335589 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 19 03:41:27.335589 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:41:27.335589 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 19 03:41:27.335589 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi '' Oct 19 03:41:27.335589 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:41:27.335589 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:41:27.335589 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:41:27.335589 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:41:27.335589 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:41:27.335589 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:41:27.335589 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:41:27.335589 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:41:27.335589 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:41:27.335589 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:41:27.335589 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:41:27.335589 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:41:27.335589 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 03:41:27.335589 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 03:41:27.335589 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 03:41:27.335589 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 03:41:27.335589 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 03:41:27.335589 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 03:41:27.335589 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 19 03:41:27.343529 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:41:27.343529 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:41:27.343529 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:41:27.343529 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:41:27.343529 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:41:27.343529 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:41:27.343529 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 03:41:27.343529 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 03:41:27.343529 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 19 03:41:27.343529 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:41:27.343529 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4f11410b-7638-49d7-87f0-9731edc3fcb0 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:41:27.348516 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4f11410b-7638-49d7-87f0-9731edc3fcb0 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "PUT /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 400 len: 108 microversion: 2.1 time: 0.031496 Oct 19 03:41:27.350055 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2879/5665] 10.222.0.52 () {60 vars in 1256 bytes} [Wed Oct 19 03:41:27 2022] PUT /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 108 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 03:41:27.369862 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1a475363-8f20-4a74-813e-97eb7ff2d349 tempest-VolumesSnapshotsTestJSON-159090315 tempest-VolumesSnapshotsTestJSON-159090315-project] Calling method '.version_select at 0x7fc1305f4dc0>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:27.531281 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1a475363-8f20-4a74-813e-97eb7ff2d349 tempest-VolumesSnapshotsTestJSON-159090315 tempest-VolumesSnapshotsTestJSON-159090315-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/132b6707-7d8d-4f96-9784-f38720ab6ad9" status: 200 len: 287 microversion: 2.1 time: 0.177092 Oct 19 03:41:27.537801 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2880/5666] 10.222.0.52 () {58 vars in 1251 bytes} [Wed Oct 19 03:41:27 2022] GET /compute/v2.1/os-snapshots/132b6707-7d8d-4f96-9784-f38720ab6ad9 => generated 287 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:41:27.545718 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-45a87c21-8c2e-4d0b-abb6-e9f0557716ee tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:27.550556 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-45a87c21-8c2e-4d0b-abb6-e9f0557716ee tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:41:27.569444 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-45a87c21-8c2e-4d0b-abb6-e9f0557716ee tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:27.572151 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-45a87c21-8c2e-4d0b-abb6-e9f0557716ee tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:27.576572 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-45a87c21-8c2e-4d0b-abb6-e9f0557716ee tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:27.587676 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-45a87c21-8c2e-4d0b-abb6-e9f0557716ee tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:27.590317 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-45a87c21-8c2e-4d0b-abb6-e9f0557716ee tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:27.591135 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-45a87c21-8c2e-4d0b-abb6-e9f0557716ee tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:27.691214 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-032e29d6-0ad6-4930-a2a6-e4cbfa218f0e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:41:27.704271 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-032e29d6-0ad6-4930-a2a6-e4cbfa218f0e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b" status: 200 len: 1524 microversion: 2.1 time: 0.404836 Oct 19 03:41:27.707391 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2787/5667] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:41:27 2022] GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b => generated 1524 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:41:27.717800 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ebe039af-2a4c-441e-9b3c-d55c87162ba2 tempest-VolumesSnapshotsTestJSON-159090315 tempest-VolumesSnapshotsTestJSON-159090315-project] Calling method '.version_select at 0x7fc12beb9ca0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:27.800175 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ebe039af-2a4c-441e-9b3c-d55c87162ba2 tempest-VolumesSnapshotsTestJSON-159090315 tempest-VolumesSnapshotsTestJSON-159090315-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.091448 Oct 19 03:41:27.802485 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2788/5668] 10.222.0.52 () {58 vars in 1140 bytes} [Wed Oct 19 03:41:27 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:41:27.818679 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-593b7f5e-dd90-4255-b957-2bf14c27e626 tempest-VolumesSnapshotsTestJSON-159090315 tempest-VolumesSnapshotsTestJSON-159090315-project] Calling method '.version_select at 0x7fc1305828b0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:27.882854 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-593b7f5e-dd90-4255-b957-2bf14c27e626 tempest-VolumesSnapshotsTestJSON-159090315 tempest-VolumesSnapshotsTestJSON-159090315-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/132b6707-7d8d-4f96-9784-f38720ab6ad9" status: 200 len: 287 microversion: 2.1 time: 0.071074 Oct 19 03:41:27.885301 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2789/5669] 10.222.0.52 () {58 vars in 1251 bytes} [Wed Oct 19 03:41:27 2022] GET /compute/v2.1/os-snapshots/132b6707-7d8d-4f96-9784-f38720ab6ad9 => generated 287 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:41:27.895292 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-45a87c21-8c2e-4d0b-abb6-e9f0557716ee tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:41:27.904684 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-45a87c21-8c2e-4d0b-abb6-e9f0557716ee tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1506 microversion: 2.1 time: 0.364948 Oct 19 03:41:27.918378 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2881/5670] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:41:27 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1506 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:41:28.339059 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-135fe37c-1555-434a-b56c-e439453b10a3 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:28.340700 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-135fe37c-1555-434a-b56c-e439453b10a3 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] [instance: d368a182-a350-4d0c-803d-2972af3aeb7d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:41:28.364816 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-135fe37c-1555-434a-b56c-e439453b10a3 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:28.366949 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-135fe37c-1555-434a-b56c-e439453b10a3 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:28.371268 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-135fe37c-1555-434a-b56c-e439453b10a3 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:28.371669 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-135fe37c-1555-434a-b56c-e439453b10a3 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:28.373322 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-135fe37c-1555-434a-b56c-e439453b10a3 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:28.375511 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-135fe37c-1555-434a-b56c-e439453b10a3 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:28.730636 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f63168f4-a22b-4286-b9a7-af0125cf4923 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:28.731342 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f63168f4-a22b-4286-b9a7-af0125cf4923 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 7e633743-2b38-4c08-be9e-fdfde600b48b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:41:28.744188 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f63168f4-a22b-4286-b9a7-af0125cf4923 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:28.747733 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f63168f4-a22b-4286-b9a7-af0125cf4923 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:28.748403 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f63168f4-a22b-4286-b9a7-af0125cf4923 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:28.749688 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f63168f4-a22b-4286-b9a7-af0125cf4923 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:28.751975 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f63168f4-a22b-4286-b9a7-af0125cf4923 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:28.755694 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f63168f4-a22b-4286-b9a7-af0125cf4923 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:28.803814 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-135fe37c-1555-434a-b56c-e439453b10a3 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4670fd4408d4454784251a880d5a72f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf91777fa414ddaa797d735e7d2a275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:41:28.823106 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-135fe37c-1555-434a-b56c-e439453b10a3 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] 10.222.0.52 "GET /compute/v2.1/servers/d368a182-a350-4d0c-803d-2972af3aeb7d" status: 200 len: 1671 microversion: 2.1 time: 0.482974 Oct 19 03:41:28.826735 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2790/5671] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:41:28 2022] GET /compute/v2.1/servers/d368a182-a350-4d0c-803d-2972af3aeb7d => generated 1671 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:41:28.896943 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a5d01697-9667-43a6-92f1-a9e219c9afca tempest-VolumesSnapshotsTestJSON-159090315 tempest-VolumesSnapshotsTestJSON-159090315-project] Calling method '.version_select at 0x7fc12be93f70>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:28.951584 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a5d01697-9667-43a6-92f1-a9e219c9afca tempest-VolumesSnapshotsTestJSON-159090315 tempest-VolumesSnapshotsTestJSON-159090315-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/132b6707-7d8d-4f96-9784-f38720ab6ad9" status: 200 len: 287 microversion: 2.1 time: 0.059320 Oct 19 03:41:28.952798 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2791/5672] 10.222.0.52 () {58 vars in 1251 bytes} [Wed Oct 19 03:41:28 2022] GET /compute/v2.1/os-snapshots/132b6707-7d8d-4f96-9784-f38720ab6ad9 => generated 287 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:41:29.388325 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f63168f4-a22b-4286-b9a7-af0125cf4923 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:41:29.409986 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f63168f4-a22b-4286-b9a7-af0125cf4923 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b" status: 200 len: 1524 microversion: 2.1 time: 0.683861 Oct 19 03:41:29.425633 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2882/5673] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:41:28 2022] GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b => generated 1524 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:41:29.866861 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a5359bad-a14e-4338-92b9-d6fc2f2ebefe tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:29.867499 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a5359bad-a14e-4338-92b9-d6fc2f2ebefe tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] [instance: d368a182-a350-4d0c-803d-2972af3aeb7d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:41:29.882019 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-a23afc7c-0822-463c-ac16-841813142055 req-8a1244f8-f139-4593-9420-9b795d9e7399 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d368a182-a350-4d0c-803d-2972af3aeb7d", "name": "network-vif-deleted", "tag": "76e9dcc7-fe11-440c-8253-409dfac2a873"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:41:29.925486 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-a23afc7c-0822-463c-ac16-841813142055 req-8a1244f8-f139-4593-9420-9b795d9e7399 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:29.926410 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-a23afc7c-0822-463c-ac16-841813142055 req-8a1244f8-f139-4593-9420-9b795d9e7399 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:29.927121 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-a23afc7c-0822-463c-ac16-841813142055 req-8a1244f8-f139-4593-9420-9b795d9e7399 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:29.985689 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a5359bad-a14e-4338-92b9-d6fc2f2ebefe tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:29.986366 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a5359bad-a14e-4338-92b9-d6fc2f2ebefe tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:29.986822 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a5359bad-a14e-4338-92b9-d6fc2f2ebefe tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:29.987589 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a5359bad-a14e-4338-92b9-d6fc2f2ebefe tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:29.988063 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a5359bad-a14e-4338-92b9-d6fc2f2ebefe tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:29.988497 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a5359bad-a14e-4338-92b9-d6fc2f2ebefe tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:30.006046 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-a23afc7c-0822-463c-ac16-841813142055 req-8a1244f8-f139-4593-9420-9b795d9e7399 service nova] Creating event network-vif-deleted:76e9dcc7-fe11-440c-8253-409dfac2a873 for instance d368a182-a350-4d0c-803d-2972af3aeb7d on n-h2-861333-8 Oct 19 03:41:30.037669 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-a23afc7c-0822-463c-ac16-841813142055 req-8a1244f8-f139-4593-9420-9b795d9e7399 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.167708 Oct 19 03:41:30.038899 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2883/5674] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:41:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:41:30.067908 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-fb114af9-4d2a-4c1d-ae1a-4ba45d20de82 tempest-VolumesSnapshotsTestJSON-159090315 tempest-VolumesSnapshotsTestJSON-159090315-project] Calling method '.version_select at 0x7fc134f43940>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:30.086037 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:41:30.165750 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-fb114af9-4d2a-4c1d-ae1a-4ba45d20de82 tempest-VolumesSnapshotsTestJSON-159090315 tempest-VolumesSnapshotsTestJSON-159090315-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/132b6707-7d8d-4f96-9784-f38720ab6ad9" status: 200 len: 287 microversion: 2.1 time: 0.116604 Oct 19 03:41:30.165750 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2884/5675] 10.222.0.52 () {58 vars in 1251 bytes} [Wed Oct 19 03:41:30 2022] GET /compute/v2.1/os-snapshots/132b6707-7d8d-4f96-9784-f38720ab6ad9 => generated 287 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:41:30.297274 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a5359bad-a14e-4338-92b9-d6fc2f2ebefe tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4670fd4408d4454784251a880d5a72f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf91777fa414ddaa797d735e7d2a275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:41:30.302204 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a5359bad-a14e-4338-92b9-d6fc2f2ebefe tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] 10.222.0.52 "GET /compute/v2.1/servers/d368a182-a350-4d0c-803d-2972af3aeb7d" status: 200 len: 1333 microversion: 2.1 time: 0.451877 Oct 19 03:41:30.303481 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2792/5676] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:41:29 2022] GET /compute/v2.1/servers/d368a182-a350-4d0c-803d-2972af3aeb7d => generated 1333 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:41:30.443469 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-bca74bd3-fcfb-49bd-8187-74611242f0c3 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:30.444204 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-bca74bd3-fcfb-49bd-8187-74611242f0c3 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 7e633743-2b38-4c08-be9e-fdfde600b48b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:41:30.459766 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bca74bd3-fcfb-49bd-8187-74611242f0c3 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:30.460526 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bca74bd3-fcfb-49bd-8187-74611242f0c3 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:30.460976 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bca74bd3-fcfb-49bd-8187-74611242f0c3 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:30.462007 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bca74bd3-fcfb-49bd-8187-74611242f0c3 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:30.462468 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bca74bd3-fcfb-49bd-8187-74611242f0c3 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:30.462921 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bca74bd3-fcfb-49bd-8187-74611242f0c3 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:30.769884 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-bca74bd3-fcfb-49bd-8187-74611242f0c3 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:41:30.778885 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-bca74bd3-fcfb-49bd-8187-74611242f0c3 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b" status: 200 len: 1506 microversion: 2.1 time: 0.346720 Oct 19 03:41:30.779479 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2885/5677] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:41:30 2022] GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b => generated 1506 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:41:31.172386 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ed31cb4f-cd16-402a-9b51-2e714dd507f2 tempest-VolumesSnapshotsTestJSON-159090315 tempest-VolumesSnapshotsTestJSON-159090315-project] Calling method '.version_select at 0x7fc12be930d0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:31.212181 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ed31cb4f-cd16-402a-9b51-2e714dd507f2 tempest-VolumesSnapshotsTestJSON-159090315 tempest-VolumesSnapshotsTestJSON-159090315-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/132b6707-7d8d-4f96-9784-f38720ab6ad9" status: 200 len: 288 microversion: 2.1 time: 0.043565 Oct 19 03:41:31.215016 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2793/5678] 10.222.0.52 () {58 vars in 1251 bytes} [Wed Oct 19 03:41:31 2022] GET /compute/v2.1/os-snapshots/132b6707-7d8d-4f96-9784-f38720ab6ad9 => generated 288 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:41:31.224462 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6e372a0f-257d-454f-9fe8-81b28ff87e39 tempest-VolumesSnapshotsTestJSON-159090315 tempest-VolumesSnapshotsTestJSON-159090315-project] Calling method '.version_select at 0x7fc134f431f0>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:31.326464 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0852e66e-9467-4eb0-8fab-820af340e48c tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:31.327318 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0852e66e-9467-4eb0-8fab-820af340e48c tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] [instance: d368a182-a350-4d0c-803d-2972af3aeb7d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:41:31.334599 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0852e66e-9467-4eb0-8fab-820af340e48c tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:31.335182 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0852e66e-9467-4eb0-8fab-820af340e48c tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:31.335698 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0852e66e-9467-4eb0-8fab-820af340e48c tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:31.336501 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0852e66e-9467-4eb0-8fab-820af340e48c tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:31.337029 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0852e66e-9467-4eb0-8fab-820af340e48c tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:31.337501 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0852e66e-9467-4eb0-8fab-820af340e48c tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:31.350879 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-0852e66e-9467-4eb0-8fab-820af340e48c tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] HTTP exception thrown: Instance d368a182-a350-4d0c-803d-2972af3aeb7d could not be found. Oct 19 03:41:31.352540 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0852e66e-9467-4eb0-8fab-820af340e48c tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Request method failure captured: Oct 19 03:41:31.352540 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/d368a182-a350-4d0c-803d-2972af3aeb7d HTTP/1.1 Oct 19 03:41:31.352540 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:41:31.352540 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:41:31.352540 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:41:31.352540 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:41:31.352540 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:41:31.352540 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:41:31.352540 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:41:31.352540 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:41:31.352540 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3E2AeEMoW-TTWkIwJnaLXssujmdVopIaG0EauE5_lUPoQTPXJr_To2XzFAqBfAgjt-sPXSPB3mvNMM18FY3GNXGy_BQraJqqj4NrkmCgvvRj_VFWZkfvbr7DfNxGYC3Lfg6fBpJNpJhOEVxFRdxu6128Rtc8ehjMT3Rm5I83ry8sPg Oct 19 03:41:31.352540 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:41:31.352540 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:41:31.352540 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:41:31.352540 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:41:31.352540 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:41:31.352540 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:41:31.352540 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 3bf91777fa414ddaa797d735e7d2a275 Oct 19 03:41:31.352540 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-TestNetworkBasicOps-1176039654 Oct 19 03:41:31.352540 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:41:31.352540 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:41:31.352540 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/3bf91777fa414ddaa797d735e7d2a275"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3bf91777fa414ddaa797d735e7d2a275"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3bf91777fa414ddaa797d735e7d2a275"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_3bf91777fa414ddaa797d735e7d2a275", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:41:31.352540 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-TestNetworkBasicOps-1176039654 Oct 19 03:41:31.352540 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 3bf91777fa414ddaa797d735e7d2a275 Oct 19 03:41:31.352540 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-TestNetworkBasicOps-1176039654 Oct 19 03:41:31.352540 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-TestNetworkBasicOps-1176039654-project Oct 19 03:41:31.352540 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:41:31.352540 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:41:31.352540 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 4670fd4408d4454784251a880d5a72f5 Oct 19 03:41:31.352540 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-TestNetworkBasicOps-1176039654-project Oct 19 03:41:31.352540 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:41:31.352540 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance d368a182-a350-4d0c-803d-2972af3aeb7d could not be found. Oct 19 03:41:31.352540 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': 'd368a182-a350-4d0c-803d-2972af3aeb7d'} Oct 19 03:41:31.352540 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:41:31.352540 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:41:31.352540 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:41:31.352540 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:41:31.352540 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:41:31.352540 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:41:31.352540 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:41:31.352540 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:41:31.352540 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:41:31.352540 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:41:31.352540 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d368a182-a350-4d0c-803d-2972af3aeb7d could not be found. Oct 19 03:41:31.352540 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:41:31.352540 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:41:31.352540 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:41:31.352540 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:41:31.352540 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:41:31.352540 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:41:31.352540 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:41:31.352540 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:41:31.352540 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:41:31.352540 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:41:31.352540 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:41:31.352540 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:41:31.352540 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:41:31.352540 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:41:31.352540 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:41:31.352540 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:41:31.352540 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d368a182-a350-4d0c-803d-2972af3aeb7d could not be found. Oct 19 03:41:31.352540 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:41:31.352540 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:41:31.352540 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:41:31.357656 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:41:31.357656 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:41:31.357656 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:41:31.357656 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:41:31.357656 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:41:31.357656 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d368a182-a350-4d0c-803d-2972af3aeb7d could not be found. Oct 19 03:41:31.357656 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:41:31.359074 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0852e66e-9467-4eb0-8fab-820af340e48c tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Returning 404 to user: Instance d368a182-a350-4d0c-803d-2972af3aeb7d could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:41:31.359982 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0852e66e-9467-4eb0-8fab-820af340e48c tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] 10.222.0.52 "GET /compute/v2.1/servers/d368a182-a350-4d0c-803d-2972af3aeb7d" status: 404 len: 111 microversion: 2.1 time: 0.038349 Oct 19 03:41:31.360557 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2794/5679] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:41:31 2022] GET /compute/v2.1/servers/d368a182-a350-4d0c-803d-2972af3aeb7d => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 03:41:31.447201 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6e372a0f-257d-454f-9fe8-81b28ff87e39 tempest-VolumesSnapshotsTestJSON-159090315 tempest-VolumesSnapshotsTestJSON-159090315-project] 10.222.0.52 "DELETE /compute/v2.1/os-snapshots/132b6707-7d8d-4f96-9784-f38720ab6ad9" status: 202 len: 0 microversion: 2.1 time: 0.226839 Oct 19 03:41:31.448613 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2886/5680] 10.222.0.52 () {58 vars in 1254 bytes} [Wed Oct 19 03:41:31 2022] DELETE /compute/v2.1/os-snapshots/132b6707-7d8d-4f96-9784-f38720ab6ad9 => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 19 03:41:31.465047 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5c41e762-5196-44ad-9972-0c1aac614bdb tempest-VolumesSnapshotsTestJSON-159090315 tempest-VolumesSnapshotsTestJSON-159090315-project] Calling method '.version_select at 0x7fc12bf07280>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:31.505031 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5c41e762-5196-44ad-9972-0c1aac614bdb tempest-VolumesSnapshotsTestJSON-159090315 tempest-VolumesSnapshotsTestJSON-159090315-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/132b6707-7d8d-4f96-9784-f38720ab6ad9" status: 200 len: 287 microversion: 2.1 time: 0.049062 Oct 19 03:41:31.505031 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2795/5681] 10.222.0.52 () {58 vars in 1251 bytes} [Wed Oct 19 03:41:31 2022] GET /compute/v2.1/os-snapshots/132b6707-7d8d-4f96-9784-f38720ab6ad9 => generated 287 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:41:31.743456 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-79dfd201-8de4-408d-8eba-5638072cff53 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Calling method '.version_select at 0x7fc12bfb24c0>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:31.803447 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9fea6123-c37c-4051-b9f3-b214d499f508 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:31.815263 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9fea6123-c37c-4051-b9f3-b214d499f508 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 7e633743-2b38-4c08-be9e-fdfde600b48b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:41:31.829914 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9fea6123-c37c-4051-b9f3-b214d499f508 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:31.830653 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9fea6123-c37c-4051-b9f3-b214d499f508 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:31.831251 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9fea6123-c37c-4051-b9f3-b214d499f508 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:31.832323 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9fea6123-c37c-4051-b9f3-b214d499f508 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:31.832932 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9fea6123-c37c-4051-b9f3-b214d499f508 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:31.833550 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9fea6123-c37c-4051-b9f3-b214d499f508 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:31.866948 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-79dfd201-8de4-408d-8eba-5638072cff53 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-418828847" status: 202 len: 0 microversion: 2.1 time: 0.135462 Oct 19 03:41:31.867795 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2887/5682] 10.222.0.52 () {58 vars in 1254 bytes} [Wed Oct 19 03:41:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-418828847 => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:41:32.052340 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9fea6123-c37c-4051-b9f3-b214d499f508 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:41:32.061265 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9fea6123-c37c-4051-b9f3-b214d499f508 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b" status: 200 len: 1506 microversion: 2.1 time: 0.261734 Oct 19 03:41:32.068408 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2796/5683] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:41:31 2022] GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b => generated 1506 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:41:32.518878 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-97e384ea-2264-4226-a476-7a57dde4eaac tempest-VolumesSnapshotsTestJSON-159090315 tempest-VolumesSnapshotsTestJSON-159090315-project] Calling method '.version_select at 0x7fc130bcd280>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:32.564575 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-97e384ea-2264-4226-a476-7a57dde4eaac tempest-VolumesSnapshotsTestJSON-159090315 tempest-VolumesSnapshotsTestJSON-159090315-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/132b6707-7d8d-4f96-9784-f38720ab6ad9" status: 200 len: 287 microversion: 2.1 time: 0.050431 Oct 19 03:41:32.565230 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2888/5684] 10.222.0.52 () {58 vars in 1251 bytes} [Wed Oct 19 03:41:32 2022] GET /compute/v2.1/os-snapshots/132b6707-7d8d-4f96-9784-f38720ab6ad9 => generated 287 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:41:33.095638 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-edc5b013-9a5c-4744-9c6b-1cc023111eaa tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:33.096832 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-edc5b013-9a5c-4744-9c6b-1cc023111eaa tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 7e633743-2b38-4c08-be9e-fdfde600b48b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:41:33.097522 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-58074409-fa78-49f0-9dde-095741d57876 tempest-VolumesTestJSON-299758881 tempest-VolumesTestJSON-299758881-project] Calling method '.version_select at 0x7fc134f86dc0>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:33.120168 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-edc5b013-9a5c-4744-9c6b-1cc023111eaa tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:33.122358 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-edc5b013-9a5c-4744-9c6b-1cc023111eaa tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:33.124257 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-edc5b013-9a5c-4744-9c6b-1cc023111eaa tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:33.126450 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-edc5b013-9a5c-4744-9c6b-1cc023111eaa tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:33.128377 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-edc5b013-9a5c-4744-9c6b-1cc023111eaa tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:33.129057 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-edc5b013-9a5c-4744-9c6b-1cc023111eaa tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:33.183292 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-58074409-fa78-49f0-9dde-095741d57876 tempest-VolumesTestJSON-299758881 tempest-VolumesTestJSON-299758881-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/933f4e01-da0f-405e-8cc9-d3a5fb7b5867" status: 200 len: 350 microversion: 2.1 time: 0.089381 Oct 19 03:41:33.183988 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2889/5685] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Oct 19 03:41:33 2022] GET /compute/v2.1/os-volumes/933f4e01-da0f-405e-8cc9-d3a5fb7b5867 => generated 350 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:41:33.523712 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-edc5b013-9a5c-4744-9c6b-1cc023111eaa tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:41:33.532326 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-edc5b013-9a5c-4744-9c6b-1cc023111eaa tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b" status: 200 len: 1509 microversion: 2.1 time: 0.441985 Oct 19 03:41:33.536687 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2797/5686] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:41:33 2022] GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b => generated 1509 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:41:33.561564 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-64b1f413-6e39-4d3b-b010-a20f0f688160 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:33.562092 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-64b1f413-6e39-4d3b-b010-a20f0f688160 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 7e633743-2b38-4c08-be9e-fdfde600b48b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:41:33.582603 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-070dc137-5ec6-42e7-bfdd-63df77e6b6e8 tempest-VolumesSnapshotsTestJSON-159090315 tempest-VolumesSnapshotsTestJSON-159090315-project] Calling method '.version_select at 0x7fc1300aae50>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:33.582935 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-64b1f413-6e39-4d3b-b010-a20f0f688160 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:33.583461 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-64b1f413-6e39-4d3b-b010-a20f0f688160 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:33.583907 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-64b1f413-6e39-4d3b-b010-a20f0f688160 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:33.584628 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-64b1f413-6e39-4d3b-b010-a20f0f688160 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:33.585094 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-64b1f413-6e39-4d3b-b010-a20f0f688160 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:33.590659 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-64b1f413-6e39-4d3b-b010-a20f0f688160 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:33.668643 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-64b1f413-6e39-4d3b-b010-a20f0f688160 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 7e633743-2b38-4c08-be9e-fdfde600b48b] Going to try to terminate instance {{(pid=121135) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:41:33.688347 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.compute.api [None req-64b1f413-6e39-4d3b-b010-a20f0f688160 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 7e633743-2b38-4c08-be9e-fdfde600b48b] Working on deleting snapshot 914c758a-caf4-485b-b144-2f7590fd9569 from shelved instance... Oct 19 03:41:33.816257 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-070dc137-5ec6-42e7-bfdd-63df77e6b6e8 tempest-VolumesSnapshotsTestJSON-159090315 tempest-VolumesSnapshotsTestJSON-159090315-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/132b6707-7d8d-4f96-9784-f38720ab6ad9" status: 200 len: 287 microversion: 2.1 time: 0.242216 Oct 19 03:41:33.817914 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2798/5687] 10.222.0.52 () {58 vars in 1251 bytes} [Wed Oct 19 03:41:33 2022] GET /compute/v2.1/os-snapshots/132b6707-7d8d-4f96-9784-f38720ab6ad9 => generated 287 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:41:33.831900 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-e6f11608-fbe2-4a0d-a639-751e25999bd1 req-82e4c13a-3708-4478-bf48-5de87fdffef5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e633743-2b38-4c08-be9e-fdfde600b48b", "name": "network-vif-unplugged", "status": "completed", "tag": "990064fc-01d2-4577-a71f-88694fc1b668"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:41:33.867963 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-e6f11608-fbe2-4a0d-a639-751e25999bd1 req-82e4c13a-3708-4478-bf48-5de87fdffef5 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:33.868466 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-e6f11608-fbe2-4a0d-a639-751e25999bd1 req-82e4c13a-3708-4478-bf48-5de87fdffef5 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:33.868908 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-e6f11608-fbe2-4a0d-a639-751e25999bd1 req-82e4c13a-3708-4478-bf48-5de87fdffef5 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:33.912207 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.compute.server_external_events [req-e6f11608-fbe2-4a0d-a639-751e25999bd1 req-82e4c13a-3708-4478-bf48-5de87fdffef5 service nova] Unable to find a host for instance 7e633743-2b38-4c08-be9e-fdfde600b48b. Dropping event network-vif-unplugged {{(pid=121134) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 19 03:41:33.919922 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-e6f11608-fbe2-4a0d-a639-751e25999bd1 req-82e4c13a-3708-4478-bf48-5de87fdffef5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.097027 Oct 19 03:41:33.922096 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2799/5688] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:41:33 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 103 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 19 03:41:34.831295 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-73600559-c422-4dd4-945e-a4e2c9509a03 tempest-VolumesSnapshotsTestJSON-159090315 tempest-VolumesSnapshotsTestJSON-159090315-project] Calling method '.version_select at 0x7fc130cc4a60>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:34.892158 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-73600559-c422-4dd4-945e-a4e2c9509a03 tempest-VolumesSnapshotsTestJSON-159090315 tempest-VolumesSnapshotsTestJSON-159090315-project] HTTP exception thrown: Snapshot 132b6707-7d8d-4f96-9784-f38720ab6ad9 could not be found. Oct 19 03:41:34.898438 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-73600559-c422-4dd4-945e-a4e2c9509a03 tempest-VolumesSnapshotsTestJSON-159090315 tempest-VolumesSnapshotsTestJSON-159090315-project] Request method failure captured: Oct 19 03:41:34.898438 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/os-snapshots/132b6707-7d8d-4f96-9784-f38720ab6ad9 HTTP/1.1 Oct 19 03:41:34.898438 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:41:34.898438 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:41:34.898438 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:41:34.898438 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:41:34.898438 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:41:34.898438 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:41:34.898438 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:41:34.898438 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:41:34.898438 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3Hg2So9etMQBfyjdoMRSlHf1-i8BY8F0nHnVBz8MRIbl0el6Ee0hiPYKvEU4KQH4lzMcpok26mhAYlfoWjnobrcHcarkktsaeuDePWwccvFRLOSxBx0ufgEF046f51vO1uBs-iqOvh5ozXDStW9lH9p6cRAez3PjdKiwmPt33L3PIA Oct 19 03:41:34.898438 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:41:34.898438 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:41:34.898438 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:41:34.898438 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:41:34.898438 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:41:34.898438 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:41:34.898438 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: b51d6b8b7ef04391b8b14cc4c15a71a3 Oct 19 03:41:34.898438 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-159090315 Oct 19 03:41:34.898438 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:41:34.898438 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:41:34.898438 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b51d6b8b7ef04391b8b14cc4c15a71a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b51d6b8b7ef04391b8b14cc4c15a71a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b51d6b8b7ef04391b8b14cc4c15a71a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b51d6b8b7ef04391b8b14cc4c15a71a3", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:41:34.898438 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-VolumesSnapshotsTestJSON-159090315 Oct 19 03:41:34.898438 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: b51d6b8b7ef04391b8b14cc4c15a71a3 Oct 19 03:41:34.898438 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-159090315 Oct 19 03:41:34.898438 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-VolumesSnapshotsTestJSON-159090315-project Oct 19 03:41:34.898438 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:41:34.898438 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:41:34.898438 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 48565fc47ecf46adafc801ecb173447f Oct 19 03:41:34.898438 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-VolumesSnapshotsTestJSON-159090315-project Oct 19 03:41:34.898438 n-d-861333-8 devstack@n-api.service[121134]: method: Oct 19 03:41:34.898438 n-d-861333-8 devstack@n-api.service[121134]: exception: Snapshot 132b6707-7d8d-4f96-9784-f38720ab6ad9 could not be found. Oct 19 03:41:34.898438 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '132b6707-7d8d-4f96-9784-f38720ab6ad9'} Oct 19 03:41:34.898438 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:41:34.898438 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:41:34.898438 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 19 03:41:34.898438 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 19 03:41:34.898438 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 19 03:41:34.898438 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 19 03:41:34.898438 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 19 03:41:34.898438 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 19 03:41:34.898438 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 19 03:41:34.898438 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 19 03:41:34.898438 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 19 03:41:34.898438 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 19 03:41:34.898438 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 03:41:34.898438 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 03:41:34.898438 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 03:41:34.898438 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 03:41:34.898438 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 132b6707-7d8d-4f96-9784-f38720ab6ad9 could not be found. (HTTP 404) (Request-ID: req-008ceffa-7a58-493d-849b-31ec5db1766d) Oct 19 03:41:34.898438 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:41:34.898438 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:41:34.898438 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:41:34.898438 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:41:34.898438 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 19 03:41:34.898438 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 19 03:41:34.898438 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 19 03:41:34.898438 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 19 03:41:34.898438 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 19 03:41:34.898438 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 19 03:41:34.898438 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 19 03:41:34.898438 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 19 03:41:34.906037 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 19 03:41:34.906037 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 19 03:41:34.906037 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 19 03:41:34.906037 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 19 03:41:34.906037 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 19 03:41:34.906037 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 19 03:41:34.906037 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 19 03:41:34.906037 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 19 03:41:34.906037 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 19 03:41:34.906037 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 19 03:41:34.906037 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 03:41:34.906037 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 03:41:34.906037 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 03:41:34.906037 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 03:41:34.906037 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 132b6707-7d8d-4f96-9784-f38720ab6ad9 could not be found. Oct 19 03:41:34.906037 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:41:34.906037 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:41:34.906037 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:41:34.906037 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:41:34.906037 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:41:34.906037 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:41:34.906037 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:41:34.906037 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:41:34.906037 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 03:41:34.906037 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 03:41:34.906037 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:41:34.906037 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:41:34.906037 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 19 03:41:34.906037 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:41:34.906037 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 132b6707-7d8d-4f96-9784-f38720ab6ad9 could not be found. Oct 19 03:41:34.906037 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:41:34.906037 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:41:34.906037 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:41:34.906037 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:41:34.906037 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:41:34.906037 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:41:34.906037 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:41:34.906037 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:41:34.906037 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 132b6707-7d8d-4f96-9784-f38720ab6ad9 could not be found. Oct 19 03:41:34.906037 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:41:34.906037 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-73600559-c422-4dd4-945e-a4e2c9509a03 tempest-VolumesSnapshotsTestJSON-159090315 tempest-VolumesSnapshotsTestJSON-159090315-project] Returning 404 to user: Snapshot 132b6707-7d8d-4f96-9784-f38720ab6ad9 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:41:34.906037 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-73600559-c422-4dd4-945e-a4e2c9509a03 tempest-VolumesSnapshotsTestJSON-159090315 tempest-VolumesSnapshotsTestJSON-159090315-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/132b6707-7d8d-4f96-9784-f38720ab6ad9" status: 404 len: 111 microversion: 2.1 time: 0.073831 Oct 19 03:41:34.906037 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2800/5689] 10.222.0.52 () {58 vars in 1251 bytes} [Wed Oct 19 03:41:34 2022] GET /compute/v2.1/os-snapshots/132b6707-7d8d-4f96-9784-f38720ab6ad9 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:41:34.909899 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4d61a2bb-5b27-4ace-be37-64f9c3285fc3 tempest-VolumesSnapshotsTestJSON-159090315 tempest-VolumesSnapshotsTestJSON-159090315-project] Calling method '.version_select at 0x7fc130d731f0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:35.215450 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4d61a2bb-5b27-4ace-be37-64f9c3285fc3 tempest-VolumesSnapshotsTestJSON-159090315 tempest-VolumesSnapshotsTestJSON-159090315-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/13714734-84a8-4d6a-a54c-c715fa827207" status: 202 len: 0 microversion: 2.1 time: 0.310410 Oct 19 03:41:35.216071 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2801/5690] 10.222.0.52 () {58 vars in 1248 bytes} [Wed Oct 19 03:41:34 2022] DELETE /compute/v2.1/os-volumes/13714734-84a8-4d6a-a54c-c715fa827207 => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:41:35.225524 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-519f09ff-912f-4ee2-b748-15940b6cb7dc tempest-VolumesSnapshotsTestJSON-159090315 tempest-VolumesSnapshotsTestJSON-159090315-project] Calling method '.version_select at 0x7fc1300aac10>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:35.394325 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-519f09ff-912f-4ee2-b748-15940b6cb7dc tempest-VolumesSnapshotsTestJSON-159090315 tempest-VolumesSnapshotsTestJSON-159090315-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/13714734-84a8-4d6a-a54c-c715fa827207" status: 200 len: 344 microversion: 2.1 time: 0.173828 Oct 19 03:41:35.394974 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2802/5691] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Oct 19 03:41:35 2022] GET /compute/v2.1/os-volumes/13714734-84a8-4d6a-a54c-c715fa827207 => generated 344 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:41:35.994769 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-64b1f413-6e39-4d3b-b010-a20f0f688160 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 7e633743-2b38-4c08-be9e-fdfde600b48b] Doing local delete in cell d204a9a6-30d3-4569-8922-0d4cbe966b78(cell1) {{(pid=121135) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 19 03:41:36.002660 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-64b1f413-6e39-4d3b-b010-a20f0f688160 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:36.003481 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-64b1f413-6e39-4d3b-b010-a20f0f688160 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:36.004085 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-64b1f413-6e39-4d3b-b010-a20f0f688160 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:36.004685 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.compute.api [None req-64b1f413-6e39-4d3b-b010-a20f0f688160 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 7e633743-2b38-4c08-be9e-fdfde600b48b] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 19 03:41:36.013423 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.network.neutron [None req-64b1f413-6e39-4d3b-b010-a20f0f688160 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 7e633743-2b38-4c08-be9e-fdfde600b48b] deallocate_for_instance() {{(pid=121135) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 19 03:41:36.413238 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6f0c5b6a-7c5d-4e2e-b4d0-ad7d723de219 tempest-VolumesSnapshotsTestJSON-159090315 tempest-VolumesSnapshotsTestJSON-159090315-project] Calling method '.version_select at 0x7fc1300d14c0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:36.663996 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6f0c5b6a-7c5d-4e2e-b4d0-ad7d723de219 tempest-VolumesSnapshotsTestJSON-159090315 tempest-VolumesSnapshotsTestJSON-159090315-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/13714734-84a8-4d6a-a54c-c715fa827207" status: 200 len: 344 microversion: 2.1 time: 0.256720 Oct 19 03:41:36.665116 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2803/5692] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Oct 19 03:41:36 2022] GET /compute/v2.1/os-volumes/13714734-84a8-4d6a-a54c-c715fa827207 => generated 344 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:41:37.597724 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-bc2a8f7f-5960-48ef-bd83-f20071f9e982 req-fe39d008-f986-4b50-a042-04871b843584 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e633743-2b38-4c08-be9e-fdfde600b48b", "name": "network-vif-deleted", "tag": "990064fc-01d2-4577-a71f-88694fc1b668"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:41:37.619226 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-bc2a8f7f-5960-48ef-bd83-f20071f9e982 req-fe39d008-f986-4b50-a042-04871b843584 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:37.624051 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-bc2a8f7f-5960-48ef-bd83-f20071f9e982 req-fe39d008-f986-4b50-a042-04871b843584 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:37.627549 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-bc2a8f7f-5960-48ef-bd83-f20071f9e982 req-fe39d008-f986-4b50-a042-04871b843584 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:37.637326 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.network.neutron [None req-64b1f413-6e39-4d3b-b010-a20f0f688160 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 7e633743-2b38-4c08-be9e-fdfde600b48b] Updating instance_info_cache with network_info: [] {{(pid=121135) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 19 03:41:37.649830 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:SAVEPOINT=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:41:37.677205 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.compute.server_external_events [req-bc2a8f7f-5960-48ef-bd83-f20071f9e982 req-fe39d008-f986-4b50-a042-04871b843584 service nova] Unable to find a host for instance 7e633743-2b38-4c08-be9e-fdfde600b48b. Dropping event network-vif-deleted {{(pid=121134) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 19 03:41:37.677205 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-bc2a8f7f-5960-48ef-bd83-f20071f9e982 req-fe39d008-f986-4b50-a042-04871b843584 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.080011 Oct 19 03:41:37.677205 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2804/5693] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:41:37 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 85 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 19 03:41:37.683884 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-43bd2145-971c-4bad-80af-ffee46749f86 tempest-VolumesSnapshotsTestJSON-159090315 tempest-VolumesSnapshotsTestJSON-159090315-project] Calling method '.version_select at 0x7fc130cc4040>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:37.826262 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-43bd2145-971c-4bad-80af-ffee46749f86 tempest-VolumesSnapshotsTestJSON-159090315 tempest-VolumesSnapshotsTestJSON-159090315-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/13714734-84a8-4d6a-a54c-c715fa827207" status: 200 len: 344 microversion: 2.1 time: 0.147794 Oct 19 03:41:37.826868 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2805/5694] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Oct 19 03:41:37 2022] GET /compute/v2.1/os-volumes/13714734-84a8-4d6a-a54c-c715fa827207 => generated 344 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:41:37.832554 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-cc921b40-c9e8-4b29-9ec0-784b751c0737 tempest-VolumesTestJSON-299758881 tempest-VolumesTestJSON-299758881-project] Calling method '.version_select at 0x7fc1300d11f0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:37.952801 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-cc921b40-c9e8-4b29-9ec0-784b751c0737 tempest-VolumesTestJSON-299758881 tempest-VolumesTestJSON-299758881-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/7f4b513b-95f1-4b5c-9293-0e5fa233ea81" status: 200 len: 351 microversion: 2.1 time: 0.124280 Oct 19 03:41:37.962485 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2806/5695] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Oct 19 03:41:37 2022] GET /compute/v2.1/os-volumes/7f4b513b-95f1-4b5c-9293-0e5fa233ea81 => generated 351 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:41:38.065501 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:41:38.368573 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-64b1f413-6e39-4d3b-b010-a20f0f688160 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "DELETE /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b" status: 204 len: 0 microversion: 2.1 time: 4.812856 Oct 19 03:41:38.371683 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2890/5696] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:41:33 2022] DELETE /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b => generated 0 bytes in 4817 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:41:38.381026 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-72f142d0-a3bf-4a63-8247-8c23fe08bcb5 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:38.381825 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-72f142d0-a3bf-4a63-8247-8c23fe08bcb5 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 7e633743-2b38-4c08-be9e-fdfde600b48b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:41:38.394625 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-72f142d0-a3bf-4a63-8247-8c23fe08bcb5 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:38.396334 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-72f142d0-a3bf-4a63-8247-8c23fe08bcb5 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:38.396843 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-72f142d0-a3bf-4a63-8247-8c23fe08bcb5 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:38.397623 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-72f142d0-a3bf-4a63-8247-8c23fe08bcb5 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:38.398103 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-72f142d0-a3bf-4a63-8247-8c23fe08bcb5 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:38.398528 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-72f142d0-a3bf-4a63-8247-8c23fe08bcb5 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:38.424362 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-72f142d0-a3bf-4a63-8247-8c23fe08bcb5 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] HTTP exception thrown: Instance 7e633743-2b38-4c08-be9e-fdfde600b48b could not be found. Oct 19 03:41:38.426053 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-72f142d0-a3bf-4a63-8247-8c23fe08bcb5 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Request method failure captured: Oct 19 03:41:38.426053 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b HTTP/1.1 Oct 19 03:41:38.426053 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:41:38.426053 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:41:38.426053 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:41:38.426053 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:41:38.426053 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:41:38.426053 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:41:38.426053 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:41:38.426053 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:41:38.426053 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3ER8Vi4kdm7o4uGCDWtKZWQ50YHYh4kO6eywBcR15sWt_VOUdg3SdiEQ00NlpD4-_UkP7cbx60NOPjR2_ogmh3qtcCqHFYMrk6ithnKX7Frq8eCjVqAngAFsiOR8FhKAXItaxrviXq7LiRs8ykPsJTrY1v2OiG3mT4ycQKs5qNWF0I Oct 19 03:41:38.426053 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:41:38.426053 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:41:38.426053 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:41:38.426053 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:41:38.426053 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:41:38.426053 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:41:38.426053 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 224417be63ba4c679b0256a27fb9f104 Oct 19 03:41:38.426053 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-DeleteServersTestJSON-1651632054 Oct 19 03:41:38.426053 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:41:38.426053 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:41:38.426053 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/224417be63ba4c679b0256a27fb9f104"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/224417be63ba4c679b0256a27fb9f104"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/224417be63ba4c679b0256a27fb9f104"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_224417be63ba4c679b0256a27fb9f104", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:41:38.426053 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-DeleteServersTestJSON-1651632054 Oct 19 03:41:38.426053 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 224417be63ba4c679b0256a27fb9f104 Oct 19 03:41:38.426053 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-DeleteServersTestJSON-1651632054 Oct 19 03:41:38.426053 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-DeleteServersTestJSON-1651632054-project Oct 19 03:41:38.426053 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:41:38.426053 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:41:38.426053 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: d099c5070710485f83d528d3d2bb1c71 Oct 19 03:41:38.426053 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-DeleteServersTestJSON-1651632054-project Oct 19 03:41:38.426053 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:41:38.426053 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance 7e633743-2b38-4c08-be9e-fdfde600b48b could not be found. Oct 19 03:41:38.426053 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '7e633743-2b38-4c08-be9e-fdfde600b48b'} Oct 19 03:41:38.426053 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:41:38.426053 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:41:38.426053 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:41:38.426053 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:41:38.426053 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:41:38.426053 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:41:38.426053 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:41:38.426053 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:41:38.426053 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:41:38.426053 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:41:38.426053 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e633743-2b38-4c08-be9e-fdfde600b48b could not be found. Oct 19 03:41:38.426053 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:41:38.426053 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:41:38.426053 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:41:38.426053 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:41:38.426053 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:41:38.426053 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:41:38.426053 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:41:38.426053 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:41:38.426053 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:41:38.426053 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:41:38.426053 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:41:38.426053 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:41:38.426053 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:41:38.426053 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:41:38.426053 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:41:38.426053 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:41:38.426053 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e633743-2b38-4c08-be9e-fdfde600b48b could not be found. Oct 19 03:41:38.426053 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:41:38.426053 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:41:38.426053 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:41:38.430421 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:41:38.430421 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:41:38.430421 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:41:38.430421 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:41:38.430421 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:41:38.430421 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e633743-2b38-4c08-be9e-fdfde600b48b could not be found. Oct 19 03:41:38.430421 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:41:38.432547 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-72f142d0-a3bf-4a63-8247-8c23fe08bcb5 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Returning 404 to user: Instance 7e633743-2b38-4c08-be9e-fdfde600b48b could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:41:38.433680 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-72f142d0-a3bf-4a63-8247-8c23fe08bcb5 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b" status: 404 len: 111 microversion: 2.1 time: 0.057917 Oct 19 03:41:38.434936 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2807/5697] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:41:38 2022] GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:41:38.674156 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-82da6fe1-93f5-4d7b-a047-6c4b54653ba8 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-597353050", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "networks": [{"uuid": "c7fc46f7-f975-4fb5-83e4-9e9303a4a241"}]}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:41:38.748277 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c715d5a9-0681-419a-b2e3-636d7380333f tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:38.748775 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c715d5a9-0681-419a-b2e3-636d7380333f tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 6d1dc6d7-9e63-46a2-9bd6-97073fc26565] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:41:38.775852 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c715d5a9-0681-419a-b2e3-636d7380333f tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:38.778851 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c715d5a9-0681-419a-b2e3-636d7380333f tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:38.779255 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c715d5a9-0681-419a-b2e3-636d7380333f tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:38.780003 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c715d5a9-0681-419a-b2e3-636d7380333f tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:38.786039 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c715d5a9-0681-419a-b2e3-636d7380333f tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:38.792672 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c715d5a9-0681-419a-b2e3-636d7380333f tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:38.795491 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.network.neutron [None req-82da6fe1-93f5-4d7b-a047-6c4b54653ba8 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] validate_networks() for [('c7fc46f7-f975-4fb5-83e4-9e9303a4a241', None, None, None, None, None)] {{(pid=121135) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:41:38.824347 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-c715d5a9-0681-419a-b2e3-636d7380333f tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] HTTP exception thrown: Instance 6d1dc6d7-9e63-46a2-9bd6-97073fc26565 could not be found. Oct 19 03:41:38.826083 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c715d5a9-0681-419a-b2e3-636d7380333f tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Request method failure captured: Oct 19 03:41:38.826083 n-d-861333-8 devstack@n-api.service[121134]: request: DELETE /compute/v2.1/servers/6d1dc6d7-9e63-46a2-9bd6-97073fc26565 HTTP/1.1 Oct 19 03:41:38.826083 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:41:38.826083 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:41:38.826083 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:41:38.826083 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:41:38.826083 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:41:38.826083 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:41:38.826083 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:41:38.826083 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:41:38.826083 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3EK4yDar5R5kGdpWRPopK281fOgxjiWCAZdy3tbDZzFYZxrN53hSsTq0YyAxsfcVRT4cF0jU61e6walOKxMx_njT0L3WOIYEymBjzmNzdXOa-UhYNf83BpQOShCJts2aNodNdu7YjeLcAcuRF0ZOjoH0xsH4HoNSzc8IfQzKhRz4vw Oct 19 03:41:38.826083 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:41:38.826083 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:41:38.826083 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:41:38.826083 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:41:38.826083 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:41:38.826083 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:41:38.826083 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 34bd94983fbf4a8aa49aff65c076e9e3 Oct 19 03:41:38.826083 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:41:38.826083 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:41:38.826083 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:41:38.826083 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_34bd94983fbf4a8aa49aff65c076e9e3", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:41:38.826083 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:41:38.826083 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 34bd94983fbf4a8aa49aff65c076e9e3 Oct 19 03:41:38.826083 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:41:38.826083 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ServersNegativeTestJSON-553742303-project Oct 19 03:41:38.826083 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:41:38.826083 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:41:38.826083 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 771feb133bc046588552d3af98f8e0a1 Oct 19 03:41:38.826083 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ServersNegativeTestJSON-553742303-project Oct 19 03:41:38.826083 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:41:38.826083 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance 6d1dc6d7-9e63-46a2-9bd6-97073fc26565 could not be found. Oct 19 03:41:38.826083 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '6d1dc6d7-9e63-46a2-9bd6-97073fc26565'} Oct 19 03:41:38.826083 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:41:38.826083 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:41:38.826083 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:41:38.826083 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:41:38.826083 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:41:38.826083 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:41:38.826083 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:41:38.826083 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:41:38.826083 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:41:38.826083 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:41:38.826083 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d1dc6d7-9e63-46a2-9bd6-97073fc26565 could not be found. Oct 19 03:41:38.826083 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:41:38.826083 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:41:38.826083 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:41:38.826083 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:41:38.826083 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:41:38.826083 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:41:38.826083 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:41:38.826083 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:41:38.826083 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:41:38.826083 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:41:38.826083 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 03:41:38.826083 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 03:41:38.826083 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 03:41:38.826083 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 03:41:38.826083 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:41:38.826083 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:41:38.826083 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:41:38.826083 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:41:38.830571 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d1dc6d7-9e63-46a2-9bd6-97073fc26565 could not be found. Oct 19 03:41:38.830571 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:41:38.830571 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:41:38.830571 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:41:38.830571 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:41:38.830571 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:41:38.830571 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:41:38.830571 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:41:38.830571 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:41:38.830571 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d1dc6d7-9e63-46a2-9bd6-97073fc26565 could not be found. Oct 19 03:41:38.830571 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:41:38.832247 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c715d5a9-0681-419a-b2e3-636d7380333f tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Returning 404 to user: Instance 6d1dc6d7-9e63-46a2-9bd6-97073fc26565 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:41:38.833546 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c715d5a9-0681-419a-b2e3-636d7380333f tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "DELETE /compute/v2.1/servers/6d1dc6d7-9e63-46a2-9bd6-97073fc26565" status: 404 len: 111 microversion: 2.1 time: 0.089735 Oct 19 03:41:38.835964 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2808/5698] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:41:38 2022] DELETE /compute/v2.1/servers/6d1dc6d7-9e63-46a2-9bd6-97073fc26565 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 03:41:38.846068 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-92224b82-da82-4bb8-be05-4aaf9445e77d tempest-VolumesSnapshotsTestJSON-159090315 tempest-VolumesSnapshotsTestJSON-159090315-project] Calling method '.version_select at 0x7fc1304de700>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:38.963111 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-92224b82-da82-4bb8-be05-4aaf9445e77d tempest-VolumesSnapshotsTestJSON-159090315 tempest-VolumesSnapshotsTestJSON-159090315-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/13714734-84a8-4d6a-a54c-c715fa827207" status: 200 len: 344 microversion: 2.1 time: 0.125913 Oct 19 03:41:38.964876 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2809/5699] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Oct 19 03:41:38 2022] GET /compute/v2.1/os-volumes/13714734-84a8-4d6a-a54c-c715fa827207 => generated 344 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:41:38.969722 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-973d925f-15c8-462d-a9b7-6aa968416376 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:38.970613 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-973d925f-15c8-462d-a9b7-6aa968416376 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 6d1dc6d7-9e63-46a2-9bd6-97073fc26565] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:41:38.988511 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-973d925f-15c8-462d-a9b7-6aa968416376 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:38.989474 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-973d925f-15c8-462d-a9b7-6aa968416376 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:38.994344 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-973d925f-15c8-462d-a9b7-6aa968416376 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:38.996026 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-973d925f-15c8-462d-a9b7-6aa968416376 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:38.996712 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-973d925f-15c8-462d-a9b7-6aa968416376 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:38.997386 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-973d925f-15c8-462d-a9b7-6aa968416376 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:39.029090 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-973d925f-15c8-462d-a9b7-6aa968416376 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] HTTP exception thrown: Instance 6d1dc6d7-9e63-46a2-9bd6-97073fc26565 could not be found. Oct 19 03:41:39.031373 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-973d925f-15c8-462d-a9b7-6aa968416376 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Request method failure captured: Oct 19 03:41:39.031373 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/6d1dc6d7-9e63-46a2-9bd6-97073fc26565 HTTP/1.1 Oct 19 03:41:39.031373 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:41:39.031373 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:41:39.031373 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:41:39.031373 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:41:39.031373 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:41:39.031373 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:41:39.031373 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:41:39.031373 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:41:39.031373 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3EK4yDar5R5kGdpWRPopK281fOgxjiWCAZdy3tbDZzFYZxrN53hSsTq0YyAxsfcVRT4cF0jU61e6walOKxMx_njT0L3WOIYEymBjzmNzdXOa-UhYNf83BpQOShCJts2aNodNdu7YjeLcAcuRF0ZOjoH0xsH4HoNSzc8IfQzKhRz4vw Oct 19 03:41:39.031373 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:41:39.031373 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:41:39.031373 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:41:39.031373 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:41:39.031373 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:41:39.031373 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:41:39.031373 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 34bd94983fbf4a8aa49aff65c076e9e3 Oct 19 03:41:39.031373 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:41:39.031373 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:41:39.031373 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:41:39.031373 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_34bd94983fbf4a8aa49aff65c076e9e3", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:41:39.031373 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:41:39.031373 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 34bd94983fbf4a8aa49aff65c076e9e3 Oct 19 03:41:39.031373 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:41:39.031373 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ServersNegativeTestJSON-553742303-project Oct 19 03:41:39.031373 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:41:39.031373 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:41:39.031373 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 771feb133bc046588552d3af98f8e0a1 Oct 19 03:41:39.031373 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ServersNegativeTestJSON-553742303-project Oct 19 03:41:39.031373 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:41:39.031373 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance 6d1dc6d7-9e63-46a2-9bd6-97073fc26565 could not be found. Oct 19 03:41:39.031373 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '6d1dc6d7-9e63-46a2-9bd6-97073fc26565'} Oct 19 03:41:39.031373 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:41:39.031373 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:41:39.031373 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:41:39.031373 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:41:39.031373 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:41:39.031373 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:41:39.031373 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:41:39.031373 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:41:39.031373 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:41:39.031373 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:41:39.031373 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d1dc6d7-9e63-46a2-9bd6-97073fc26565 could not be found. Oct 19 03:41:39.031373 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:41:39.031373 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:41:39.031373 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:41:39.031373 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:41:39.031373 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:41:39.031373 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:41:39.031373 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:41:39.031373 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:41:39.031373 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:41:39.031373 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:41:39.031373 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:41:39.031373 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:41:39.031373 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:41:39.031373 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:41:39.031373 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:41:39.031373 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:41:39.031373 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d1dc6d7-9e63-46a2-9bd6-97073fc26565 could not be found. Oct 19 03:41:39.031373 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:41:39.031373 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:41:39.031373 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:41:39.035463 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:41:39.035463 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:41:39.035463 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:41:39.035463 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:41:39.035463 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:41:39.035463 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d1dc6d7-9e63-46a2-9bd6-97073fc26565 could not be found. Oct 19 03:41:39.035463 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:41:39.038148 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-973d925f-15c8-462d-a9b7-6aa968416376 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Returning 404 to user: Instance 6d1dc6d7-9e63-46a2-9bd6-97073fc26565 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:41:39.039939 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-973d925f-15c8-462d-a9b7-6aa968416376 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/6d1dc6d7-9e63-46a2-9bd6-97073fc26565" status: 404 len: 111 microversion: 2.1 time: 0.073085 Oct 19 03:41:39.045565 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2810/5700] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:41:38 2022] GET /compute/v2.1/servers/6d1dc6d7-9e63-46a2-9bd6-97073fc26565 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:41:39.050825 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6e100133-12da-4ea5-81ef-f1917524138c tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:39.055119 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6e100133-12da-4ea5-81ef-f1917524138c tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:41:39.070032 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6e100133-12da-4ea5-81ef-f1917524138c tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:39.071874 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6e100133-12da-4ea5-81ef-f1917524138c tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:39.079951 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6e100133-12da-4ea5-81ef-f1917524138c tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:39.081309 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6e100133-12da-4ea5-81ef-f1917524138c tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:39.082041 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6e100133-12da-4ea5-81ef-f1917524138c tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:39.082696 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6e100133-12da-4ea5-81ef-f1917524138c tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:39.145567 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6e100133-12da-4ea5-81ef-f1917524138c tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Going to try to terminate instance {{(pid=121134) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:41:39.557086 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6e100133-12da-4ea5-81ef-f1917524138c tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "DELETE /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 204 len: 0 microversion: 2.1 time: 0.509869 Oct 19 03:41:39.558333 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2811/5701] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:41:39 2022] DELETE /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:41:39.569271 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-57e75d16-0028-4c89-9ab3-dcae3cbb6bb2 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:39.570137 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-57e75d16-0028-4c89-9ab3-dcae3cbb6bb2 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:41:39.601446 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-57e75d16-0028-4c89-9ab3-dcae3cbb6bb2 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:39.602565 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-57e75d16-0028-4c89-9ab3-dcae3cbb6bb2 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:39.608352 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-57e75d16-0028-4c89-9ab3-dcae3cbb6bb2 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:39.608352 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-57e75d16-0028-4c89-9ab3-dcae3cbb6bb2 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:39.608352 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-57e75d16-0028-4c89-9ab3-dcae3cbb6bb2 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:39.608352 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-57e75d16-0028-4c89-9ab3-dcae3cbb6bb2 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:40.087452 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-57e75d16-0028-4c89-9ab3-dcae3cbb6bb2 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:41:40.104096 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-57e75d16-0028-4c89-9ab3-dcae3cbb6bb2 tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1512 microversion: 2.1 time: 0.538692 Oct 19 03:41:40.106714 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2812/5702] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:41:39 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1512 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:41:40.136074 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c431c3e7-5170-4a21-82c6-f536f9cf5955 tempest-VolumesSnapshotsTestJSON-159090315 tempest-VolumesSnapshotsTestJSON-159090315-project] Calling method '.version_select at 0x7fc12bf7fe50>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:40.172750 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-82da6fe1-93f5-4d7b-a047-6c4b54653ba8 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Flavor limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:41:40.173254 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-82da6fe1-93f5-4d7b-a047-6c4b54653ba8 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Image limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:41:40.174007 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-82da6fe1-93f5-4d7b-a047-6c4b54653ba8 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Flavor pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:41:40.174526 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-82da6fe1-93f5-4d7b-a047-6c4b54653ba8 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Image pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:41:40.175378 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-82da6fe1-93f5-4d7b-a047-6c4b54653ba8 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:41:40.192417 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-82da6fe1-93f5-4d7b-a047-6c4b54653ba8 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:40.194009 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-82da6fe1-93f5-4d7b-a047-6c4b54653ba8 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:40.194569 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-82da6fe1-93f5-4d7b-a047-6c4b54653ba8 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:40.197115 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-82da6fe1-93f5-4d7b-a047-6c4b54653ba8 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:40.199354 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-82da6fe1-93f5-4d7b-a047-6c4b54653ba8 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:40.200305 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-82da6fe1-93f5-4d7b-a047-6c4b54653ba8 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:40.228977 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c431c3e7-5170-4a21-82c6-f536f9cf5955 tempest-VolumesSnapshotsTestJSON-159090315 tempest-VolumesSnapshotsTestJSON-159090315-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/13714734-84a8-4d6a-a54c-c715fa827207" status: 200 len: 344 microversion: 2.1 time: 0.119373 Oct 19 03:41:40.237422 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2813/5703] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Oct 19 03:41:40 2022] GET /compute/v2.1/os-volumes/13714734-84a8-4d6a-a54c-c715fa827207 => generated 344 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:41:40.245667 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-82da6fe1-93f5-4d7b-a047-6c4b54653ba8 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Getting quotas for project 224417be63ba4c679b0256a27fb9f104. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:41:40.252681 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-82da6fe1-93f5-4d7b-a047-6c4b54653ba8 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Getting quotas for user d099c5070710485f83d528d3d2bb1c71 and project 224417be63ba4c679b0256a27fb9f104. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:41:40.303452 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-82da6fe1-93f5-4d7b-a047-6c4b54653ba8 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Going to run 1 instances... {{(pid=121135) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:41:40.314371 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-82da6fe1-93f5-4d7b-a047-6c4b54653ba8 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: d813bf3b-04b6-4dea-8b53-a6223779622f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121135) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:41:40.540849 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-82da6fe1-93f5-4d7b-a047-6c4b54653ba8 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.871597 Oct 19 03:41:40.552338 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2891/5704] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:41:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1884 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 03:41:40.558798 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4909d580-2aa3-4685-8740-1b0edf71e00e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:40.559424 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4909d580-2aa3-4685-8740-1b0edf71e00e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: d813bf3b-04b6-4dea-8b53-a6223779622f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:41:40.725851 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-4909d580-2aa3-4685-8740-1b0edf71e00e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:41:40.738528 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4909d580-2aa3-4685-8740-1b0edf71e00e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/d813bf3b-04b6-4dea-8b53-a6223779622f" status: 200 len: 1214 microversion: 2.1 time: 0.184280 Oct 19 03:41:40.753400 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2814/5705] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:41:40 2022] GET /compute/v2.1/servers/d813bf3b-04b6-4dea-8b53-a6223779622f => generated 1214 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:41:41.132513 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-97ae232f-f6b6-48ad-af5b-bd584ebd6d0f tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:41.133605 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-97ae232f-f6b6-48ad-af5b-bd584ebd6d0f tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:41:41.144289 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-97ae232f-f6b6-48ad-af5b-bd584ebd6d0f tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:41.145175 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-97ae232f-f6b6-48ad-af5b-bd584ebd6d0f tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:41.145292 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-97ae232f-f6b6-48ad-af5b-bd584ebd6d0f tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:41.146412 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-97ae232f-f6b6-48ad-af5b-bd584ebd6d0f tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:41.146878 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-97ae232f-f6b6-48ad-af5b-bd584ebd6d0f tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:41.147312 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-97ae232f-f6b6-48ad-af5b-bd584ebd6d0f tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:41.187485 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8c0bda23-3c33-4288-a66f-df6e54e6f35d tempest-VolumesTestJSON-299758881 tempest-VolumesTestJSON-299758881-project] Calling method '.version_select at 0x7fc1300d1c10>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:41.313833 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8c0bda23-3c33-4288-a66f-df6e54e6f35d tempest-VolumesTestJSON-299758881 tempest-VolumesTestJSON-299758881-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/46038397-ccca-42a7-afef-13c0dbbcd02e" status: 200 len: 349 microversion: 2.1 time: 0.130839 Oct 19 03:41:41.314916 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2815/5706] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Oct 19 03:41:41 2022] GET /compute/v2.1/os-volumes/46038397-ccca-42a7-afef-13c0dbbcd02e => generated 349 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:41:41.319909 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8387e684-0ba1-4e33-8d98-dcadf125b639 tempest-VolumesSnapshotsTestJSON-159090315 tempest-VolumesSnapshotsTestJSON-159090315-project] Calling method '.version_select at 0x7fc1304fe430>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:41.363920 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-8387e684-0ba1-4e33-8d98-dcadf125b639 tempest-VolumesSnapshotsTestJSON-159090315 tempest-VolumesSnapshotsTestJSON-159090315-project] HTTP exception thrown: Volume 13714734-84a8-4d6a-a54c-c715fa827207 could not be found. Oct 19 03:41:41.366686 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8387e684-0ba1-4e33-8d98-dcadf125b639 tempest-VolumesSnapshotsTestJSON-159090315 tempest-VolumesSnapshotsTestJSON-159090315-project] Request method failure captured: Oct 19 03:41:41.366686 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/os-volumes/13714734-84a8-4d6a-a54c-c715fa827207 HTTP/1.1 Oct 19 03:41:41.366686 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:41:41.366686 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:41:41.366686 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:41:41.366686 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:41:41.366686 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:41:41.366686 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:41:41.366686 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:41:41.366686 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:41:41.366686 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3Hg2So9etMQBfyjdoMRSlHf1-i8BY8F0nHnVBz8MRIbl0el6Ee0hiPYKvEU4KQH4lzMcpok26mhAYlfoWjnobrcHcarkktsaeuDePWwccvFRLOSxBx0ufgEF046f51vO1uBs-iqOvh5ozXDStW9lH9p6cRAez3PjdKiwmPt33L3PIA Oct 19 03:41:41.366686 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:41:41.366686 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:41:41.366686 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:41:41.366686 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:41:41.366686 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:41:41.366686 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:41:41.366686 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: b51d6b8b7ef04391b8b14cc4c15a71a3 Oct 19 03:41:41.366686 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-159090315 Oct 19 03:41:41.366686 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:41:41.366686 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:41:41.366686 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b51d6b8b7ef04391b8b14cc4c15a71a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b51d6b8b7ef04391b8b14cc4c15a71a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b51d6b8b7ef04391b8b14cc4c15a71a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b51d6b8b7ef04391b8b14cc4c15a71a3", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:41:41.366686 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-VolumesSnapshotsTestJSON-159090315 Oct 19 03:41:41.366686 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: b51d6b8b7ef04391b8b14cc4c15a71a3 Oct 19 03:41:41.366686 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-159090315 Oct 19 03:41:41.366686 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-VolumesSnapshotsTestJSON-159090315-project Oct 19 03:41:41.366686 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:41:41.366686 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:41:41.366686 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 48565fc47ecf46adafc801ecb173447f Oct 19 03:41:41.366686 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-VolumesSnapshotsTestJSON-159090315-project Oct 19 03:41:41.366686 n-d-861333-8 devstack@n-api.service[121134]: method: Oct 19 03:41:41.366686 n-d-861333-8 devstack@n-api.service[121134]: exception: Volume 13714734-84a8-4d6a-a54c-c715fa827207 could not be found. Oct 19 03:41:41.366686 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '13714734-84a8-4d6a-a54c-c715fa827207'} Oct 19 03:41:41.366686 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:41:41.366686 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:41:41.366686 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 03:41:41.366686 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 03:41:41.366686 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 19 03:41:41.366686 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 19 03:41:41.366686 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 19 03:41:41.366686 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 19 03:41:41.366686 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 19 03:41:41.366686 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 19 03:41:41.366686 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 19 03:41:41.366686 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 19 03:41:41.366686 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 03:41:41.366686 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 03:41:41.366686 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 03:41:41.366686 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 03:41:41.366686 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 13714734-84a8-4d6a-a54c-c715fa827207 could not be found. (HTTP 404) (Request-ID: req-c49b1a9d-63be-46cb-b55e-f0d954d4d6e1) Oct 19 03:41:41.366686 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:41:41.366686 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:41:41.366686 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:41:41.366686 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:41:41.366686 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 19 03:41:41.366686 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 19 03:41:41.366686 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 19 03:41:41.366686 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 19 03:41:41.366686 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 19 03:41:41.366686 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 19 03:41:41.366686 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 19 03:41:41.366686 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 19 03:41:41.366686 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 03:41:41.370957 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 03:41:41.370957 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 19 03:41:41.370957 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 19 03:41:41.370957 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 19 03:41:41.370957 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 19 03:41:41.370957 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 19 03:41:41.370957 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 19 03:41:41.370957 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 19 03:41:41.370957 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 19 03:41:41.370957 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 03:41:41.370957 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 03:41:41.370957 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 03:41:41.370957 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 03:41:41.370957 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 13714734-84a8-4d6a-a54c-c715fa827207 could not be found. Oct 19 03:41:41.370957 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:41:41.370957 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:41:41.370957 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:41:41.370957 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:41:41.370957 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:41:41.370957 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:41:41.370957 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:41:41.370957 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:41:41.370957 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 03:41:41.370957 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 03:41:41.370957 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:41:41.370957 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:41:41.370957 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 19 03:41:41.370957 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:41:41.370957 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 13714734-84a8-4d6a-a54c-c715fa827207 could not be found. Oct 19 03:41:41.370957 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:41:41.370957 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:41:41.370957 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:41:41.370957 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:41:41.370957 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:41:41.370957 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:41:41.370957 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:41:41.370957 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:41:41.370957 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 13714734-84a8-4d6a-a54c-c715fa827207 could not be found. Oct 19 03:41:41.370957 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:41:41.370957 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8387e684-0ba1-4e33-8d98-dcadf125b639 tempest-VolumesSnapshotsTestJSON-159090315 tempest-VolumesSnapshotsTestJSON-159090315-project] Returning 404 to user: Volume 13714734-84a8-4d6a-a54c-c715fa827207 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:41:41.370957 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8387e684-0ba1-4e33-8d98-dcadf125b639 tempest-VolumesSnapshotsTestJSON-159090315 tempest-VolumesSnapshotsTestJSON-159090315-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/13714734-84a8-4d6a-a54c-c715fa827207" status: 404 len: 109 microversion: 2.1 time: 0.052059 Oct 19 03:41:41.375373 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2816/5707] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Oct 19 03:41:41 2022] GET /compute/v2.1/os-volumes/13714734-84a8-4d6a-a54c-c715fa827207 => generated 109 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:41:41.388295 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ddf78a27-2d73-4d6b-b6ba-dd74eada5a19 tempest-VolumesTestJSON-299758881 tempest-VolumesTestJSON-299758881-project] Calling method '.version_select at 0x7fc1300d11f0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:41.486483 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-97ae232f-f6b6-48ad-af5b-bd584ebd6d0f tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:41:41.490474 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ddf78a27-2d73-4d6b-b6ba-dd74eada5a19 tempest-VolumesTestJSON-299758881 tempest-VolumesTestJSON-299758881-project] 10.222.0.52 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.115410 Oct 19 03:41:41.492012 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2817/5708] 10.222.0.52 () {58 vars in 1134 bytes} [Wed Oct 19 03:41:41 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:41:41.501304 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-97ae232f-f6b6-48ad-af5b-bd584ebd6d0f tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1512 microversion: 2.1 time: 0.370590 Oct 19 03:41:41.507439 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-85a7eaf9-cd5a-4c63-aa64-d2f0f526bbaa tempest-VolumesSnapshotsTestJSON-159090315 tempest-VolumesSnapshotsTestJSON-159090315-project] Calling method '.version_select at 0x7fc1300aa790>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:41.514406 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2892/5709] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:41:41 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1512 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:41:41.525575 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0ae3153d-c2f1-477f-8144-4086892495cc tempest-VolumesTestJSON-299758881 tempest-VolumesTestJSON-299758881-project] Calling method '.version_select at 0x7fc13126c3a0>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:41.560684 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-85a7eaf9-cd5a-4c63-aa64-d2f0f526bbaa tempest-VolumesSnapshotsTestJSON-159090315 tempest-VolumesSnapshotsTestJSON-159090315-project] HTTP exception thrown: Volume 13714734-84a8-4d6a-a54c-c715fa827207 could not be found. Oct 19 03:41:41.563368 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-85a7eaf9-cd5a-4c63-aa64-d2f0f526bbaa tempest-VolumesSnapshotsTestJSON-159090315 tempest-VolumesSnapshotsTestJSON-159090315-project] Request method failure captured: Oct 19 03:41:41.563368 n-d-861333-8 devstack@n-api.service[121134]: request: DELETE /compute/v2.1/os-volumes/13714734-84a8-4d6a-a54c-c715fa827207 HTTP/1.1 Oct 19 03:41:41.563368 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:41:41.563368 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:41:41.563368 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:41:41.563368 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:41:41.563368 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:41:41.563368 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:41:41.563368 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:41:41.563368 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:41:41.563368 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3Hg2So9etMQBfyjdoMRSlHf1-i8BY8F0nHnVBz8MRIbl0el6Ee0hiPYKvEU4KQH4lzMcpok26mhAYlfoWjnobrcHcarkktsaeuDePWwccvFRLOSxBx0ufgEF046f51vO1uBs-iqOvh5ozXDStW9lH9p6cRAez3PjdKiwmPt33L3PIA Oct 19 03:41:41.563368 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:41:41.563368 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:41:41.563368 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:41:41.563368 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:41:41.563368 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:41:41.563368 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:41:41.563368 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: b51d6b8b7ef04391b8b14cc4c15a71a3 Oct 19 03:41:41.563368 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-159090315 Oct 19 03:41:41.563368 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:41:41.563368 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:41:41.563368 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b51d6b8b7ef04391b8b14cc4c15a71a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b51d6b8b7ef04391b8b14cc4c15a71a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b51d6b8b7ef04391b8b14cc4c15a71a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b51d6b8b7ef04391b8b14cc4c15a71a3", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:41:41.563368 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-VolumesSnapshotsTestJSON-159090315 Oct 19 03:41:41.563368 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: b51d6b8b7ef04391b8b14cc4c15a71a3 Oct 19 03:41:41.563368 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-159090315 Oct 19 03:41:41.563368 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-VolumesSnapshotsTestJSON-159090315-project Oct 19 03:41:41.563368 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:41:41.563368 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:41:41.563368 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 48565fc47ecf46adafc801ecb173447f Oct 19 03:41:41.563368 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-VolumesSnapshotsTestJSON-159090315-project Oct 19 03:41:41.563368 n-d-861333-8 devstack@n-api.service[121134]: method: Oct 19 03:41:41.563368 n-d-861333-8 devstack@n-api.service[121134]: exception: Volume 13714734-84a8-4d6a-a54c-c715fa827207 could not be found. Oct 19 03:41:41.563368 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '13714734-84a8-4d6a-a54c-c715fa827207'} Oct 19 03:41:41.563368 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:41:41.563368 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:41:41.563368 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 03:41:41.563368 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 03:41:41.563368 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 19 03:41:41.563368 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 19 03:41:41.563368 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 19 03:41:41.563368 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 19 03:41:41.563368 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 19 03:41:41.563368 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 19 03:41:41.563368 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 19 03:41:41.563368 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 19 03:41:41.563368 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 03:41:41.563368 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 03:41:41.563368 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 03:41:41.563368 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 03:41:41.563368 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 13714734-84a8-4d6a-a54c-c715fa827207 could not be found. (HTTP 404) (Request-ID: req-27167114-b28f-41d3-a445-feb91c2e66e6) Oct 19 03:41:41.563368 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:41:41.563368 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:41:41.563368 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:41:41.563368 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:41:41.563368 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 19 03:41:41.563368 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 19 03:41:41.563368 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 19 03:41:41.563368 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 19 03:41:41.563368 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 19 03:41:41.563368 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 19 03:41:41.563368 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 19 03:41:41.563368 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 19 03:41:41.563368 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 03:41:41.567780 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 03:41:41.567780 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 19 03:41:41.567780 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 19 03:41:41.567780 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 19 03:41:41.567780 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 19 03:41:41.567780 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 19 03:41:41.567780 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 19 03:41:41.567780 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 19 03:41:41.567780 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 19 03:41:41.567780 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 03:41:41.567780 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 03:41:41.567780 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 03:41:41.567780 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 03:41:41.567780 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 13714734-84a8-4d6a-a54c-c715fa827207 could not be found. Oct 19 03:41:41.567780 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:41:41.567780 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:41:41.567780 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:41:41.567780 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:41:41.567780 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:41:41.567780 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:41:41.567780 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:41:41.567780 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:41:41.567780 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 03:41:41.567780 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 03:41:41.567780 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:41:41.567780 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:41:41.567780 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 19 03:41:41.567780 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:41:41.567780 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 13714734-84a8-4d6a-a54c-c715fa827207 could not be found. Oct 19 03:41:41.567780 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:41:41.567780 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:41:41.567780 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:41:41.567780 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:41:41.567780 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:41:41.567780 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:41:41.567780 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:41:41.567780 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:41:41.567780 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 13714734-84a8-4d6a-a54c-c715fa827207 could not be found. Oct 19 03:41:41.567780 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:41:41.573289 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-85a7eaf9-cd5a-4c63-aa64-d2f0f526bbaa tempest-VolumesSnapshotsTestJSON-159090315 tempest-VolumesSnapshotsTestJSON-159090315-project] Returning 404 to user: Volume 13714734-84a8-4d6a-a54c-c715fa827207 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:41:41.573289 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-85a7eaf9-cd5a-4c63-aa64-d2f0f526bbaa tempest-VolumesSnapshotsTestJSON-159090315 tempest-VolumesSnapshotsTestJSON-159090315-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/13714734-84a8-4d6a-a54c-c715fa827207" status: 404 len: 109 microversion: 2.1 time: 0.069198 Oct 19 03:41:41.573289 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2818/5710] 10.222.0.52 () {58 vars in 1248 bytes} [Wed Oct 19 03:41:41 2022] DELETE /compute/v2.1/os-volumes/13714734-84a8-4d6a-a54c-c715fa827207 => generated 109 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:41:41.585297 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5f54839e-f0c1-46ec-82e9-880b75ad4434 tempest-VolumesSnapshotsTestJSON-159090315 tempest-VolumesSnapshotsTestJSON-159090315-project] Calling method '.version_select at 0x7fc12bed9a60>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:41.632626 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-5f54839e-f0c1-46ec-82e9-880b75ad4434 tempest-VolumesSnapshotsTestJSON-159090315 tempest-VolumesSnapshotsTestJSON-159090315-project] HTTP exception thrown: Volume 13714734-84a8-4d6a-a54c-c715fa827207 could not be found. Oct 19 03:41:41.634790 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5f54839e-f0c1-46ec-82e9-880b75ad4434 tempest-VolumesSnapshotsTestJSON-159090315 tempest-VolumesSnapshotsTestJSON-159090315-project] Request method failure captured: Oct 19 03:41:41.634790 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/os-volumes/13714734-84a8-4d6a-a54c-c715fa827207 HTTP/1.1 Oct 19 03:41:41.634790 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:41:41.634790 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:41:41.634790 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:41:41.634790 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:41:41.634790 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:41:41.634790 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:41:41.634790 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:41:41.634790 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:41:41.634790 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3Hg2So9etMQBfyjdoMRSlHf1-i8BY8F0nHnVBz8MRIbl0el6Ee0hiPYKvEU4KQH4lzMcpok26mhAYlfoWjnobrcHcarkktsaeuDePWwccvFRLOSxBx0ufgEF046f51vO1uBs-iqOvh5ozXDStW9lH9p6cRAez3PjdKiwmPt33L3PIA Oct 19 03:41:41.634790 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:41:41.634790 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:41:41.634790 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:41:41.634790 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:41:41.634790 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:41:41.634790 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:41:41.634790 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: b51d6b8b7ef04391b8b14cc4c15a71a3 Oct 19 03:41:41.634790 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-159090315 Oct 19 03:41:41.634790 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:41:41.634790 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:41:41.634790 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b51d6b8b7ef04391b8b14cc4c15a71a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b51d6b8b7ef04391b8b14cc4c15a71a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b51d6b8b7ef04391b8b14cc4c15a71a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b51d6b8b7ef04391b8b14cc4c15a71a3", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:41:41.634790 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-VolumesSnapshotsTestJSON-159090315 Oct 19 03:41:41.634790 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: b51d6b8b7ef04391b8b14cc4c15a71a3 Oct 19 03:41:41.634790 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-159090315 Oct 19 03:41:41.634790 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-VolumesSnapshotsTestJSON-159090315-project Oct 19 03:41:41.634790 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:41:41.634790 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:41:41.634790 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 48565fc47ecf46adafc801ecb173447f Oct 19 03:41:41.634790 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-VolumesSnapshotsTestJSON-159090315-project Oct 19 03:41:41.634790 n-d-861333-8 devstack@n-api.service[121134]: method: Oct 19 03:41:41.634790 n-d-861333-8 devstack@n-api.service[121134]: exception: Volume 13714734-84a8-4d6a-a54c-c715fa827207 could not be found. Oct 19 03:41:41.634790 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '13714734-84a8-4d6a-a54c-c715fa827207'} Oct 19 03:41:41.634790 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:41:41.634790 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:41:41.634790 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 03:41:41.634790 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 03:41:41.634790 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 19 03:41:41.634790 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 19 03:41:41.634790 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 19 03:41:41.634790 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 19 03:41:41.634790 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 19 03:41:41.634790 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 19 03:41:41.634790 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 19 03:41:41.634790 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 19 03:41:41.634790 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 03:41:41.634790 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 03:41:41.634790 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 03:41:41.634790 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 03:41:41.634790 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 13714734-84a8-4d6a-a54c-c715fa827207 could not be found. (HTTP 404) (Request-ID: req-6e85a1da-f7a1-4cb4-877f-edfe466bfe9c) Oct 19 03:41:41.634790 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:41:41.634790 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:41:41.634790 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:41:41.634790 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:41:41.634790 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 19 03:41:41.634790 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 19 03:41:41.634790 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 19 03:41:41.634790 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 19 03:41:41.634790 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 19 03:41:41.634790 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 19 03:41:41.634790 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 19 03:41:41.634790 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 19 03:41:41.634790 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 03:41:41.638997 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 03:41:41.638997 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 19 03:41:41.638997 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 19 03:41:41.638997 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 19 03:41:41.638997 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 19 03:41:41.638997 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 19 03:41:41.638997 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 19 03:41:41.638997 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 19 03:41:41.638997 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 19 03:41:41.638997 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 03:41:41.638997 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 03:41:41.638997 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 03:41:41.638997 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 03:41:41.638997 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 13714734-84a8-4d6a-a54c-c715fa827207 could not be found. Oct 19 03:41:41.638997 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:41:41.638997 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:41:41.638997 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:41:41.638997 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:41:41.638997 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:41:41.638997 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:41:41.638997 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:41:41.638997 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:41:41.638997 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 03:41:41.638997 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 03:41:41.638997 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:41:41.638997 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:41:41.638997 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 19 03:41:41.638997 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:41:41.638997 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 13714734-84a8-4d6a-a54c-c715fa827207 could not be found. Oct 19 03:41:41.638997 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:41:41.638997 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:41:41.638997 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:41:41.638997 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:41:41.638997 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:41:41.638997 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:41:41.638997 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:41:41.638997 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:41:41.638997 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 13714734-84a8-4d6a-a54c-c715fa827207 could not be found. Oct 19 03:41:41.638997 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:41:41.644749 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5f54839e-f0c1-46ec-82e9-880b75ad4434 tempest-VolumesSnapshotsTestJSON-159090315 tempest-VolumesSnapshotsTestJSON-159090315-project] Returning 404 to user: Volume 13714734-84a8-4d6a-a54c-c715fa827207 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:41:41.645831 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5f54839e-f0c1-46ec-82e9-880b75ad4434 tempest-VolumesSnapshotsTestJSON-159090315 tempest-VolumesSnapshotsTestJSON-159090315-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/13714734-84a8-4d6a-a54c-c715fa827207" status: 404 len: 109 microversion: 2.1 time: 0.066720 Oct 19 03:41:41.646900 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2819/5711] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Oct 19 03:41:41 2022] GET /compute/v2.1/os-volumes/13714734-84a8-4d6a-a54c-c715fa827207 => generated 109 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:41:41.695040 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0ae3153d-c2f1-477f-8144-4086892495cc tempest-VolumesTestJSON-299758881 tempest-VolumesTestJSON-299758881-project] 10.222.0.52 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.179379 Oct 19 03:41:41.695908 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2893/5712] 10.222.0.52 () {58 vars in 1149 bytes} [Wed Oct 19 03:41:41 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:41:41.725956 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1b894029-5304-43de-88da-172f0d7627fa tempest-VolumesTestJSON-299758881 tempest-VolumesTestJSON-299758881-project] Calling method '.version_select at 0x7fc1300d1ca0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:41.769617 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b2dc4c47-d60c-473d-adf1-788d8534903c tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:41.770463 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b2dc4c47-d60c-473d-adf1-788d8534903c tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: d813bf3b-04b6-4dea-8b53-a6223779622f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:41:41.903239 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1b894029-5304-43de-88da-172f0d7627fa tempest-VolumesTestJSON-299758881 tempest-VolumesTestJSON-299758881-project] 10.222.0.52 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.193717 Oct 19 03:41:41.904360 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2820/5713] 10.222.0.52 () {58 vars in 1134 bytes} [Wed Oct 19 03:41:41 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:41:41.919056 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7cc186ed-ef4e-4f90-b221-5bfa9b938320 tempest-VolumesTestJSON-299758881 tempest-VolumesTestJSON-299758881-project] Calling method '.version_select at 0x7fc1300d1160>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:41.927560 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b2dc4c47-d60c-473d-adf1-788d8534903c tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:41:41.950162 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b2dc4c47-d60c-473d-adf1-788d8534903c tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/d813bf3b-04b6-4dea-8b53-a6223779622f" status: 200 len: 1214 microversion: 2.1 time: 0.185011 Oct 19 03:41:41.952155 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2894/5714] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:41:41 2022] GET /compute/v2.1/servers/d813bf3b-04b6-4dea-8b53-a6223779622f => generated 1214 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:41:42.083678 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7cc186ed-ef4e-4f90-b221-5bfa9b938320 tempest-VolumesTestJSON-299758881 tempest-VolumesTestJSON-299758881-project] 10.222.0.52 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.169107 Oct 19 03:41:42.093566 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2821/5715] 10.222.0.52 () {58 vars in 1167 bytes} [Wed Oct 19 03:41:41 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:41:42.099608 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ac24d437-600f-4178-bf48-8f6dcbe39559 tempest-VolumesTestJSON-299758881 tempest-VolumesTestJSON-299758881-project] Calling method '.version_select at 0x7fc1325bf1f0>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:42.302088 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ac24d437-600f-4178-bf48-8f6dcbe39559 tempest-VolumesTestJSON-299758881 tempest-VolumesTestJSON-299758881-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.206161 Oct 19 03:41:42.302809 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2895/5716] 10.222.0.52 () {58 vars in 1170 bytes} [Wed Oct 19 03:41:42 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:41:42.327441 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b6e6dcdb-25c3-4e18-ba33-71bd0e3a9873 tempest-VolumesTestJSON-299758881 tempest-VolumesTestJSON-299758881-project] Calling method '.version_select at 0x7fc12beb9550>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:42.530275 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-860836e8-fd3f-4b8a-a43c-1e814222155c tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:42.531999 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-860836e8-fd3f-4b8a-a43c-1e814222155c tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:41:42.542003 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-860836e8-fd3f-4b8a-a43c-1e814222155c tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:42.543944 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-860836e8-fd3f-4b8a-a43c-1e814222155c tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:42.544625 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-860836e8-fd3f-4b8a-a43c-1e814222155c tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:42.545720 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-860836e8-fd3f-4b8a-a43c-1e814222155c tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:42.546454 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-860836e8-fd3f-4b8a-a43c-1e814222155c tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:42.547122 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-860836e8-fd3f-4b8a-a43c-1e814222155c tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:42.574164 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b6e6dcdb-25c3-4e18-ba33-71bd0e3a9873 tempest-VolumesTestJSON-299758881 tempest-VolumesTestJSON-299758881-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.255168 Oct 19 03:41:42.574947 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2822/5717] 10.222.0.52 () {58 vars in 1155 bytes} [Wed Oct 19 03:41:42 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:41:42.592539 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5f5fb82a-f3a2-4b3c-8293-78a54414c21c tempest-VolumesTestJSON-299758881 tempest-VolumesTestJSON-299758881-project] Calling method '.version_select at 0x7fc130fadaf0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:42.747048 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5f5fb82a-f3a2-4b3c-8293-78a54414c21c tempest-VolumesTestJSON-299758881 tempest-VolumesTestJSON-299758881-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.160628 Oct 19 03:41:42.757792 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2823/5718] 10.222.0.52 () {58 vars in 1188 bytes} [Wed Oct 19 03:41:42 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:41:42.765704 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6b193d1b-023b-45d2-baf3-5ce0054e2e77 tempest-VolumesTestJSON-299758881 tempest-VolumesTestJSON-299758881-project] Calling method '.version_select at 0x7fc12bed9280>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:43.003622 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6b193d1b-023b-45d2-baf3-5ce0054e2e77 tempest-VolumesTestJSON-299758881 tempest-VolumesTestJSON-299758881-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.243453 Oct 19 03:41:43.004200 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2824/5719] 10.222.0.52 () {58 vars in 1155 bytes} [Wed Oct 19 03:41:42 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:41:43.012741 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c67007f8-b586-49e3-9418-162f2efeb69d tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:43.014668 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c67007f8-b586-49e3-9418-162f2efeb69d tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: d813bf3b-04b6-4dea-8b53-a6223779622f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:41:43.045519 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c67007f8-b586-49e3-9418-162f2efeb69d tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:43.050659 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c67007f8-b586-49e3-9418-162f2efeb69d tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:43.051129 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c67007f8-b586-49e3-9418-162f2efeb69d tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:43.051924 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c67007f8-b586-49e3-9418-162f2efeb69d tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:43.052399 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c67007f8-b586-49e3-9418-162f2efeb69d tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:43.052840 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c67007f8-b586-49e3-9418-162f2efeb69d tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:43.304371 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c67007f8-b586-49e3-9418-162f2efeb69d tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:41:43.316305 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c67007f8-b586-49e3-9418-162f2efeb69d tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/d813bf3b-04b6-4dea-8b53-a6223779622f" status: 200 len: 1266 microversion: 2.1 time: 0.308375 Oct 19 03:41:43.343140 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2825/5720] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:41:43 2022] GET /compute/v2.1/servers/d813bf3b-04b6-4dea-8b53-a6223779622f => generated 1266 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:41:43.443167 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-860836e8-fd3f-4b8a-a43c-1e814222155c tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:41:43.452058 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-860836e8-fd3f-4b8a-a43c-1e814222155c tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1512 microversion: 2.1 time: 0.927055 Oct 19 03:41:43.452744 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2896/5721] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:41:42 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1512 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:41:44.240225 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-7af62ff3-ab24-4424-afb1-ffd9ad6765ba req-4e82c603-f18a-4603-876f-511169312942 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a830928-6d51-4dbd-97ad-8cca44de3770", "name": "network-vif-deleted", "tag": "9779d73d-72bb-47da-820f-5576b587d824"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:41:44.266589 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-7af62ff3-ab24-4424-afb1-ffd9ad6765ba req-4e82c603-f18a-4603-876f-511169312942 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:44.267189 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-7af62ff3-ab24-4424-afb1-ffd9ad6765ba req-4e82c603-f18a-4603-876f-511169312942 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:44.267848 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-7af62ff3-ab24-4424-afb1-ffd9ad6765ba req-4e82c603-f18a-4603-876f-511169312942 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:44.322360 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-7af62ff3-ab24-4424-afb1-ffd9ad6765ba req-4e82c603-f18a-4603-876f-511169312942 service nova] Creating event network-vif-deleted:9779d73d-72bb-47da-820f-5576b587d824 for instance 5a830928-6d51-4dbd-97ad-8cca44de3770 on n-h1-861333-8 Oct 19 03:41:44.336697 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-7af62ff3-ab24-4424-afb1-ffd9ad6765ba req-4e82c603-f18a-4603-876f-511169312942 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099863 Oct 19 03:41:44.340657 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2826/5722] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:41:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:41:44.342426 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a9ad65ed-a356-4f85-9ef1-6eaea78b6747 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:44.343055 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a9ad65ed-a356-4f85-9ef1-6eaea78b6747 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: d813bf3b-04b6-4dea-8b53-a6223779622f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:41:44.352471 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a9ad65ed-a356-4f85-9ef1-6eaea78b6747 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:44.361532 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a9ad65ed-a356-4f85-9ef1-6eaea78b6747 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:44.362264 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a9ad65ed-a356-4f85-9ef1-6eaea78b6747 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:44.365013 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a9ad65ed-a356-4f85-9ef1-6eaea78b6747 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:44.365686 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a9ad65ed-a356-4f85-9ef1-6eaea78b6747 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:44.366881 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a9ad65ed-a356-4f85-9ef1-6eaea78b6747 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:44.482049 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e3bcf973-aaf5-448b-bd29-4d74eee2d0dc tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:44.482720 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e3bcf973-aaf5-448b-bd29-4d74eee2d0dc tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:41:44.495970 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e3bcf973-aaf5-448b-bd29-4d74eee2d0dc tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:44.496466 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e3bcf973-aaf5-448b-bd29-4d74eee2d0dc tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:44.497054 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e3bcf973-aaf5-448b-bd29-4d74eee2d0dc tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:44.501431 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e3bcf973-aaf5-448b-bd29-4d74eee2d0dc tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:44.501844 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e3bcf973-aaf5-448b-bd29-4d74eee2d0dc tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:44.502288 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e3bcf973-aaf5-448b-bd29-4d74eee2d0dc tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:44.569592 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a9ad65ed-a356-4f85-9ef1-6eaea78b6747 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:41:44.587489 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a9ad65ed-a356-4f85-9ef1-6eaea78b6747 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/d813bf3b-04b6-4dea-8b53-a6223779622f" status: 200 len: 1284 microversion: 2.1 time: 0.242173 Oct 19 03:41:44.589609 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2897/5723] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:41:44 2022] GET /compute/v2.1/servers/d813bf3b-04b6-4dea-8b53-a6223779622f => generated 1284 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:41:44.753223 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e3bcf973-aaf5-448b-bd29-4d74eee2d0dc tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771feb133bc046588552d3af98f8e0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd94983fbf4a8aa49aff65c076e9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:41:44.763413 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e3bcf973-aaf5-448b-bd29-4d74eee2d0dc tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 200 len: 1302 microversion: 2.1 time: 0.288612 Oct 19 03:41:44.764006 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2827/5724] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:41:44 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 1302 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:41:45.616800 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-842f5578-e7f1-4dc6-ad31-f128553417c8 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:45.617573 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-842f5578-e7f1-4dc6-ad31-f128553417c8 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: d813bf3b-04b6-4dea-8b53-a6223779622f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:41:45.633310 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-842f5578-e7f1-4dc6-ad31-f128553417c8 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:45.633844 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-842f5578-e7f1-4dc6-ad31-f128553417c8 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:45.634310 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-842f5578-e7f1-4dc6-ad31-f128553417c8 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:45.635782 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-842f5578-e7f1-4dc6-ad31-f128553417c8 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:45.646234 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-842f5578-e7f1-4dc6-ad31-f128553417c8 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:45.646234 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-842f5578-e7f1-4dc6-ad31-f128553417c8 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:45.786575 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-eeec0997-32ce-4beb-8e43-7b03716accca tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:45.787215 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-eeec0997-32ce-4beb-8e43-7b03716accca tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] [instance: 5a830928-6d51-4dbd-97ad-8cca44de3770] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:41:45.796809 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-842f5578-e7f1-4dc6-ad31-f128553417c8 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:41:45.805762 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-842f5578-e7f1-4dc6-ad31-f128553417c8 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/d813bf3b-04b6-4dea-8b53-a6223779622f" status: 200 len: 1272 microversion: 2.1 time: 0.192851 Oct 19 03:41:45.812311 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2898/5725] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:41:45 2022] GET /compute/v2.1/servers/d813bf3b-04b6-4dea-8b53-a6223779622f => generated 1272 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:41:45.815354 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eeec0997-32ce-4beb-8e43-7b03716accca tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:45.816415 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eeec0997-32ce-4beb-8e43-7b03716accca tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:45.817086 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eeec0997-32ce-4beb-8e43-7b03716accca tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:45.818053 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eeec0997-32ce-4beb-8e43-7b03716accca tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:45.819788 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eeec0997-32ce-4beb-8e43-7b03716accca tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:45.820435 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eeec0997-32ce-4beb-8e43-7b03716accca tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:45.862078 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-eeec0997-32ce-4beb-8e43-7b03716accca tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] HTTP exception thrown: Instance 5a830928-6d51-4dbd-97ad-8cca44de3770 could not be found. Oct 19 03:41:45.864261 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-eeec0997-32ce-4beb-8e43-7b03716accca tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Request method failure captured: Oct 19 03:41:45.864261 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 HTTP/1.1 Oct 19 03:41:45.864261 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:41:45.864261 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:41:45.864261 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:41:45.864261 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:41:45.864261 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:41:45.864261 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:41:45.864261 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:41:45.864261 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:41:45.864261 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3EK4yDar5R5kGdpWRPopK281fOgxjiWCAZdy3tbDZzFYZxrN53hSsTq0YyAxsfcVRT4cF0jU61e6walOKxMx_njT0L3WOIYEymBjzmNzdXOa-UhYNf83BpQOShCJts2aNodNdu7YjeLcAcuRF0ZOjoH0xsH4HoNSzc8IfQzKhRz4vw Oct 19 03:41:45.864261 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:41:45.864261 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:41:45.864261 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:41:45.864261 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:41:45.864261 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:41:45.864261 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:41:45.864261 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 34bd94983fbf4a8aa49aff65c076e9e3 Oct 19 03:41:45.864261 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:41:45.864261 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:41:45.864261 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:41:45.864261 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/34bd94983fbf4a8aa49aff65c076e9e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_34bd94983fbf4a8aa49aff65c076e9e3", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:41:45.864261 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:41:45.864261 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 34bd94983fbf4a8aa49aff65c076e9e3 Oct 19 03:41:45.864261 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ServersNegativeTestJSON-553742303 Oct 19 03:41:45.864261 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ServersNegativeTestJSON-553742303-project Oct 19 03:41:45.864261 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:41:45.864261 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:41:45.864261 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 771feb133bc046588552d3af98f8e0a1 Oct 19 03:41:45.864261 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ServersNegativeTestJSON-553742303-project Oct 19 03:41:45.864261 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:41:45.864261 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance 5a830928-6d51-4dbd-97ad-8cca44de3770 could not be found. Oct 19 03:41:45.864261 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '5a830928-6d51-4dbd-97ad-8cca44de3770'} Oct 19 03:41:45.864261 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:41:45.864261 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:41:45.864261 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:41:45.864261 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:41:45.864261 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:41:45.864261 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:41:45.864261 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:41:45.864261 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:41:45.864261 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:41:45.864261 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:41:45.864261 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a830928-6d51-4dbd-97ad-8cca44de3770 could not be found. Oct 19 03:41:45.864261 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:41:45.864261 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:41:45.864261 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:41:45.864261 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:41:45.864261 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:41:45.864261 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:41:45.864261 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:41:45.864261 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:41:45.864261 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:41:45.864261 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:41:45.864261 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:41:45.864261 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:41:45.864261 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:41:45.864261 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:41:45.864261 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:41:45.864261 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:41:45.864261 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a830928-6d51-4dbd-97ad-8cca44de3770 could not be found. Oct 19 03:41:45.864261 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:41:45.864261 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:41:45.864261 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:41:45.870889 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:41:45.870889 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:41:45.870889 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:41:45.870889 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:41:45.870889 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:41:45.870889 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a830928-6d51-4dbd-97ad-8cca44de3770 could not be found. Oct 19 03:41:45.870889 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:41:45.872699 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-eeec0997-32ce-4beb-8e43-7b03716accca tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] Returning 404 to user: Instance 5a830928-6d51-4dbd-97ad-8cca44de3770 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:41:45.873863 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-eeec0997-32ce-4beb-8e43-7b03716accca tempest-ServersNegativeTestJSON-553742303 tempest-ServersNegativeTestJSON-553742303-project] 10.222.0.52 "GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770" status: 404 len: 111 microversion: 2.1 time: 0.091167 Oct 19 03:41:45.881644 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2828/5726] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:41:45 2022] GET /compute/v2.1/servers/5a830928-6d51-4dbd-97ad-8cca44de3770 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:41:46.838254 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6119a919-7780-4996-99c3-fe9aecb0a165 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:46.840108 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6119a919-7780-4996-99c3-fe9aecb0a165 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: d813bf3b-04b6-4dea-8b53-a6223779622f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:41:46.856835 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6119a919-7780-4996-99c3-fe9aecb0a165 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:46.864898 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6119a919-7780-4996-99c3-fe9aecb0a165 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:46.864898 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6119a919-7780-4996-99c3-fe9aecb0a165 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:46.864898 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6119a919-7780-4996-99c3-fe9aecb0a165 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:46.864898 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6119a919-7780-4996-99c3-fe9aecb0a165 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:46.865273 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6119a919-7780-4996-99c3-fe9aecb0a165 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:47.556671 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-6119a919-7780-4996-99c3-fe9aecb0a165 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:41:47.571019 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6119a919-7780-4996-99c3-fe9aecb0a165 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/d813bf3b-04b6-4dea-8b53-a6223779622f" status: 200 len: 1314 microversion: 2.1 time: 0.737295 Oct 19 03:41:47.577532 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2899/5727] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:41:46 2022] GET /compute/v2.1/servers/d813bf3b-04b6-4dea-8b53-a6223779622f => generated 1314 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:41:48.658567 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7aa326fe-87c9-4a8a-beeb-a15c28c301d8 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:48.658567 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7aa326fe-87c9-4a8a-beeb-a15c28c301d8 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: d813bf3b-04b6-4dea-8b53-a6223779622f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:41:48.658567 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7aa326fe-87c9-4a8a-beeb-a15c28c301d8 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:48.658567 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7aa326fe-87c9-4a8a-beeb-a15c28c301d8 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:48.658567 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7aa326fe-87c9-4a8a-beeb-a15c28c301d8 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:48.658567 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7aa326fe-87c9-4a8a-beeb-a15c28c301d8 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:48.658567 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7aa326fe-87c9-4a8a-beeb-a15c28c301d8 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:48.658567 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7aa326fe-87c9-4a8a-beeb-a15c28c301d8 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:49.210850 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-f65a1f3a-d545-4ae0-b1a5-e0053157da66 req-4f67694a-726b-4ccb-a912-e412c5dacfb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d813bf3b-04b6-4dea-8b53-a6223779622f", "tag": "fcddfc18-18d4-4fc4-8616-b6cc9c2f79b7"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:41:49.285128 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-f65a1f3a-d545-4ae0-b1a5-e0053157da66 req-4f67694a-726b-4ccb-a912-e412c5dacfb4 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:49.288640 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-f65a1f3a-d545-4ae0-b1a5-e0053157da66 req-4f67694a-726b-4ccb-a912-e412c5dacfb4 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:49.290062 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-f65a1f3a-d545-4ae0-b1a5-e0053157da66 req-4f67694a-726b-4ccb-a912-e412c5dacfb4 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:49.325779 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-f65a1f3a-d545-4ae0-b1a5-e0053157da66 req-4f67694a-726b-4ccb-a912-e412c5dacfb4 service nova] Creating event network-changed:fcddfc18-18d4-4fc4-8616-b6cc9c2f79b7 for instance d813bf3b-04b6-4dea-8b53-a6223779622f on n-h2-861333-8 Oct 19 03:41:49.340300 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-f65a1f3a-d545-4ae0-b1a5-e0053157da66 req-4f67694a-726b-4ccb-a912-e412c5dacfb4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127645 Oct 19 03:41:49.342117 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2900/5728] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:41:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:41:50.077184 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-7aa326fe-87c9-4a8a-beeb-a15c28c301d8 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:41:50.121273 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7aa326fe-87c9-4a8a-beeb-a15c28c301d8 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/d813bf3b-04b6-4dea-8b53-a6223779622f" status: 200 len: 1314 microversion: 2.1 time: 1.496019 Oct 19 03:41:50.121273 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2829/5729] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:41:48 2022] GET /compute/v2.1/servers/d813bf3b-04b6-4dea-8b53-a6223779622f => generated 1314 bytes in 1512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:41:51.132952 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ea3fb2ff-addd-4279-9f9f-29c515cc5c3a tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:51.141195 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ea3fb2ff-addd-4279-9f9f-29c515cc5c3a tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: d813bf3b-04b6-4dea-8b53-a6223779622f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:41:51.141195 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:41:51.156321 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ea3fb2ff-addd-4279-9f9f-29c515cc5c3a tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:51.156846 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ea3fb2ff-addd-4279-9f9f-29c515cc5c3a tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:51.157303 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ea3fb2ff-addd-4279-9f9f-29c515cc5c3a tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:51.158067 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ea3fb2ff-addd-4279-9f9f-29c515cc5c3a tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:51.181636 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ea3fb2ff-addd-4279-9f9f-29c515cc5c3a tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:51.183584 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ea3fb2ff-addd-4279-9f9f-29c515cc5c3a tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:51.874138 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ea3fb2ff-addd-4279-9f9f-29c515cc5c3a tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:41:51.891237 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ea3fb2ff-addd-4279-9f9f-29c515cc5c3a tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/d813bf3b-04b6-4dea-8b53-a6223779622f" status: 200 len: 1314 microversion: 2.1 time: 0.759871 Oct 19 03:41:51.891237 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2901/5730] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:41:51 2022] GET /compute/v2.1/servers/d813bf3b-04b6-4dea-8b53-a6223779622f => generated 1314 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:41:52.913480 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-17175714-b8ca-481d-a89e-7a6c84981e8b tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:52.914398 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-17175714-b8ca-481d-a89e-7a6c84981e8b tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: d813bf3b-04b6-4dea-8b53-a6223779622f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:41:52.924603 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:41:52.929766 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-17175714-b8ca-481d-a89e-7a6c84981e8b tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:52.930538 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-17175714-b8ca-481d-a89e-7a6c84981e8b tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:52.931738 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-17175714-b8ca-481d-a89e-7a6c84981e8b tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:52.936910 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-17175714-b8ca-481d-a89e-7a6c84981e8b tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:52.938701 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-17175714-b8ca-481d-a89e-7a6c84981e8b tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:52.939180 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-17175714-b8ca-481d-a89e-7a6c84981e8b tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:53.327182 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-17175714-b8ca-481d-a89e-7a6c84981e8b tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:41:53.336551 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-17175714-b8ca-481d-a89e-7a6c84981e8b tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/d813bf3b-04b6-4dea-8b53-a6223779622f" status: 200 len: 1314 microversion: 2.1 time: 0.427440 Oct 19 03:41:53.338368 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2830/5731] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:41:52 2022] GET /compute/v2.1/servers/d813bf3b-04b6-4dea-8b53-a6223779622f => generated 1314 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:41:54.361188 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f04b8f20-f6dd-4931-89ae-dc1726f419b0 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:54.362599 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f04b8f20-f6dd-4931-89ae-dc1726f419b0 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: d813bf3b-04b6-4dea-8b53-a6223779622f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:41:54.371340 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=8 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:41:54.378395 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f04b8f20-f6dd-4931-89ae-dc1726f419b0 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:54.379904 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f04b8f20-f6dd-4931-89ae-dc1726f419b0 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:54.381898 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f04b8f20-f6dd-4931-89ae-dc1726f419b0 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:54.382787 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f04b8f20-f6dd-4931-89ae-dc1726f419b0 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:54.389896 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f04b8f20-f6dd-4931-89ae-dc1726f419b0 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:54.391198 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f04b8f20-f6dd-4931-89ae-dc1726f419b0 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:55.084600 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f04b8f20-f6dd-4931-89ae-dc1726f419b0 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:41:55.104428 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f04b8f20-f6dd-4931-89ae-dc1726f419b0 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/d813bf3b-04b6-4dea-8b53-a6223779622f" status: 200 len: 1314 microversion: 2.1 time: 0.743811 Oct 19 03:41:55.106768 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2902/5732] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:41:54 2022] GET /compute/v2.1/servers/d813bf3b-04b6-4dea-8b53-a6223779622f => generated 1314 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:41:56.130277 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-849bc24f-a0db-4f2c-a2ff-bc6c5e37d08e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:56.133149 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-849bc24f-a0db-4f2c-a2ff-bc6c5e37d08e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: d813bf3b-04b6-4dea-8b53-a6223779622f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:41:56.151657 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:41:56.156449 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-849bc24f-a0db-4f2c-a2ff-bc6c5e37d08e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:56.158933 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-849bc24f-a0db-4f2c-a2ff-bc6c5e37d08e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:56.167218 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-849bc24f-a0db-4f2c-a2ff-bc6c5e37d08e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:56.167218 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-849bc24f-a0db-4f2c-a2ff-bc6c5e37d08e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:56.174657 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-849bc24f-a0db-4f2c-a2ff-bc6c5e37d08e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:56.175418 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-849bc24f-a0db-4f2c-a2ff-bc6c5e37d08e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:56.775644 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-849bc24f-a0db-4f2c-a2ff-bc6c5e37d08e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:41:56.785080 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-849bc24f-a0db-4f2c-a2ff-bc6c5e37d08e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/d813bf3b-04b6-4dea-8b53-a6223779622f" status: 200 len: 1314 microversion: 2.1 time: 0.659490 Oct 19 03:41:56.788680 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2831/5733] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:41:56 2022] GET /compute/v2.1/servers/d813bf3b-04b6-4dea-8b53-a6223779622f => generated 1314 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:41:57.813422 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2d09763e-24be-4262-b591-3d76ca67227f tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:57.815540 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-2d09763e-24be-4262-b591-3d76ca67227f tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: d813bf3b-04b6-4dea-8b53-a6223779622f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:41:57.835742 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2d09763e-24be-4262-b591-3d76ca67227f tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:57.837795 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2d09763e-24be-4262-b591-3d76ca67227f tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:57.840160 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2d09763e-24be-4262-b591-3d76ca67227f tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:57.842150 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2d09763e-24be-4262-b591-3d76ca67227f tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:57.843959 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2d09763e-24be-4262-b591-3d76ca67227f tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:57.845093 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2d09763e-24be-4262-b591-3d76ca67227f tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:58.422740 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-74437a21-e5f7-45d4-b28e-03a6000d0d18 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Action: 'create', calling method: .version_select at 0x7fc1304dee50>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1295549042", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN3k0sKgLObSklN9D1YbwRxDEfT4j2q1wZa3HWY4ejztweWfd1tEfGgiyqOIUyAZcT5wYFBR0AZYREceFFHer2zcwuSk0hQ7P96iJechk5etQTyv4B/LYTw2iHkW1ajVXw=="}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:41:58.454713 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-74437a21-e5f7-45d4-b28e-03a6000d0d18 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Getting quotas for project 3bf91777fa414ddaa797d735e7d2a275. Resources: {'key_pairs'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:41:58.469316 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-74437a21-e5f7-45d4-b28e-03a6000d0d18 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Getting quotas for user 4670fd4408d4454784251a880d5a72f5 and project 3bf91777fa414ddaa797d735e7d2a275. Resources: {'key_pairs'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:41:58.575284 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-74437a21-e5f7-45d4-b28e-03a6000d0d18 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.156902 Oct 19 03:41:58.576123 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2832/5734] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Oct 19 03:41:58 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:41:58.690676 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-2d09763e-24be-4262-b591-3d76ca67227f tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:41:58.720358 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2d09763e-24be-4262-b591-3d76ca67227f tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/d813bf3b-04b6-4dea-8b53-a6223779622f" status: 200 len: 1314 microversion: 2.1 time: 0.912450 Oct 19 03:41:58.728436 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2903/5735] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:41:57 2022] GET /compute/v2.1/servers/d813bf3b-04b6-4dea-8b53-a6223779622f => generated 1314 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:41:59.355048 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-0206b628-9b08-47fb-b858-d8e63f68d64e req-aef137b1-1163-4523-8150-6cd41b20c400 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d813bf3b-04b6-4dea-8b53-a6223779622f", "name": "network-vif-plugged", "status": "completed", "tag": "fcddfc18-18d4-4fc4-8616-b6cc9c2f79b7"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:41:59.437232 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-0206b628-9b08-47fb-b858-d8e63f68d64e req-aef137b1-1163-4523-8150-6cd41b20c400 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:59.439686 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-0206b628-9b08-47fb-b858-d8e63f68d64e req-aef137b1-1163-4523-8150-6cd41b20c400 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:59.445426 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-0206b628-9b08-47fb-b858-d8e63f68d64e req-aef137b1-1163-4523-8150-6cd41b20c400 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:59.473330 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-0206b628-9b08-47fb-b858-d8e63f68d64e req-aef137b1-1163-4523-8150-6cd41b20c400 service nova] Creating event network-vif-plugged:fcddfc18-18d4-4fc4-8616-b6cc9c2f79b7 for instance d813bf3b-04b6-4dea-8b53-a6223779622f on n-h2-861333-8 Oct 19 03:41:59.490907 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-0206b628-9b08-47fb-b858-d8e63f68d64e req-aef137b1-1163-4523-8150-6cd41b20c400 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.171226 Oct 19 03:41:59.493441 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2833/5736] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:41:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:41:59.751234 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ab53517f-862a-4757-a280-efbb1c83d042 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:41:59.752466 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ab53517f-862a-4757-a280-efbb1c83d042 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: d813bf3b-04b6-4dea-8b53-a6223779622f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:41:59.792570 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ab53517f-862a-4757-a280-efbb1c83d042 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:59.793098 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ab53517f-862a-4757-a280-efbb1c83d042 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:59.794561 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ab53517f-862a-4757-a280-efbb1c83d042 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:41:59.797151 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ab53517f-862a-4757-a280-efbb1c83d042 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:41:59.797849 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ab53517f-862a-4757-a280-efbb1c83d042 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:41:59.798453 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ab53517f-862a-4757-a280-efbb1c83d042 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:00.216569 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ab53517f-862a-4757-a280-efbb1c83d042 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:42:00.225617 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ab53517f-862a-4757-a280-efbb1c83d042 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/d813bf3b-04b6-4dea-8b53-a6223779622f" status: 200 len: 1314 microversion: 2.1 time: 0.478273 Oct 19 03:42:00.238610 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2904/5737] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:41:59 2022] GET /compute/v2.1/servers/d813bf3b-04b6-4dea-8b53-a6223779622f => generated 1314 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:42:00.823977 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-36bee0f0-7ea1-49fc-a7fb-034922f70118 tempest-VolumesNegativeTest-1767927661 tempest-VolumesNegativeTest-1767927661-project] Action: 'create', calling method: .version_select at 0x7fc1300aac10>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-412817332", "metadata": {"Type": "work"}}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:42:00.831340 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-36bee0f0-7ea1-49fc-a7fb-034922f70118 tempest-VolumesNegativeTest-1767927661 tempest-VolumesNegativeTest-1767927661-project] Request method failure captured: Oct 19 03:42:00.831340 n-d-861333-8 devstack@n-api.service[121134]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 19 03:42:00.831340 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:42:00.831340 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:42:00.831340 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:42:00.831340 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 121 Oct 19 03:42:00.831340 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:42:00.831340 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:42:00.831340 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:42:00.831340 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:42:00.831340 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3IHZ-KHUOVAGKWnFFNZsdPd67S8QtMJ-qEWQqpWB28ZYOrsHOy3O8BTbQOLu8-k4qqDQMxCCnSsBoAk1SI8B1P25L3fQHqEi7AgOSy08zQ-dmha8dUKI7k5zgFN_6-EzcCU8ro8tJzU3gOsfc9285hrISMSDZrXenjO_dgeJcBw9NU Oct 19 03:42:00.831340 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:42:00.831340 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:42:00.831340 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:42:00.831340 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:42:00.831340 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:42:00.831340 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:42:00.831340 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 9e810d9e57d84678bea492492d13f0cd Oct 19 03:42:00.831340 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-VolumesNegativeTest-1767927661 Oct 19 03:42:00.831340 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:42:00.831340 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:42:00.831340 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9e810d9e57d84678bea492492d13f0cd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9e810d9e57d84678bea492492d13f0cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9e810d9e57d84678bea492492d13f0cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9e810d9e57d84678bea492492d13f0cd", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:42:00.831340 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-VolumesNegativeTest-1767927661 Oct 19 03:42:00.831340 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 9e810d9e57d84678bea492492d13f0cd Oct 19 03:42:00.831340 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-VolumesNegativeTest-1767927661 Oct 19 03:42:00.831340 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-VolumesNegativeTest-1767927661-project Oct 19 03:42:00.831340 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:42:00.831340 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:42:00.831340 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 72347d38678e41fea77b050fc8a9edb4 Oct 19 03:42:00.831340 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-VolumesNegativeTest-1767927661-project Oct 19 03:42:00.831340 n-d-861333-8 devstack@n-api.service[121134]: Oct 19 03:42:00.831340 n-d-861333-8 devstack@n-api.service[121134]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-412817332", "metadata": {"Type": "work"}}} Oct 19 03:42:00.831340 n-d-861333-8 devstack@n-api.service[121134]: method: Oct 19 03:42:00.831340 n-d-861333-8 devstack@n-api.service[121134]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 19 03:42:00.831340 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-412817332', 'metadata': {'Type': 'work'}}}} Oct 19 03:42:00.831340 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:42:00.831340 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:42:00.831340 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 03:42:00.831340 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 03:42:00.831340 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 03:42:00.831340 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise error Oct 19 03:42:00.831340 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 19 03:42:00.831340 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:42:00.831340 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 19 03:42:00.831340 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 19 03:42:00.831340 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:42:00.831340 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 19 03:42:00.831340 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi '#$%' Oct 19 03:42:00.831340 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:42:00.831340 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:42:00.831340 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:42:00.831340 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:42:00.831340 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:42:00.831340 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:42:00.831340 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:42:00.831340 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:42:00.831340 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 03:42:00.831340 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 03:42:00.831340 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:42:00.831340 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:42:00.831340 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 03:42:00.831340 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 03:42:00.831340 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 03:42:00.831340 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 03:42:00.831340 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 03:42:00.831340 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 03:42:00.836111 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 19 03:42:00.836111 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:42:00.836111 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:42:00.836111 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:42:00.836111 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:42:00.836111 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:42:00.836111 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:42:00.836111 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 03:42:00.836111 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 03:42:00.836111 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 19 03:42:00.836111 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:42:00.836111 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-36bee0f0-7ea1-49fc-a7fb-034922f70118 tempest-VolumesNegativeTest-1767927661 tempest-VolumesNegativeTest-1767927661-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:42:00.836111 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-36bee0f0-7ea1-49fc-a7fb-034922f70118 tempest-VolumesNegativeTest-1767927661 tempest-VolumesNegativeTest-1767927661-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.663213 Oct 19 03:42:00.836111 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2834/5738] 10.222.0.52 () {60 vars in 1156 bytes} [Wed Oct 19 03:42:00 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 665 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 19 03:42:00.851290 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-8259ed5c-8099-4616-a072-45c41945a18d tempest-VolumesNegativeTest-1767927661 tempest-VolumesNegativeTest-1767927661-project] Action: 'create', calling method: .version_select at 0x7fc12be0a040>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1352195218", "metadata": {"Type": "work"}}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:42:00.862505 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-8259ed5c-8099-4616-a072-45c41945a18d tempest-VolumesNegativeTest-1767927661 tempest-VolumesNegativeTest-1767927661-project] Request method failure captured: Oct 19 03:42:00.862505 n-d-861333-8 devstack@n-api.service[121135]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 19 03:42:00.862505 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:42:00.862505 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:42:00.862505 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:42:00.862505 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 120 Oct 19 03:42:00.862505 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:42:00.862505 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:42:00.862505 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:42:00.862505 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:42:00.862505 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT3IHZ-KHUOVAGKWnFFNZsdPd67S8QtMJ-qEWQqpWB28ZYOrsHOy3O8BTbQOLu8-k4qqDQMxCCnSsBoAk1SI8B1P25L3fQHqEi7AgOSy08zQ-dmha8dUKI7k5zgFN_6-EzcCU8ro8tJzU3gOsfc9285hrISMSDZrXenjO_dgeJcBw9NU Oct 19 03:42:00.862505 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:42:00.862505 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:42:00.862505 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:42:00.862505 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:42:00.862505 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:42:00.862505 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:42:00.862505 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 9e810d9e57d84678bea492492d13f0cd Oct 19 03:42:00.862505 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-VolumesNegativeTest-1767927661 Oct 19 03:42:00.862505 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:42:00.862505 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:42:00.862505 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9e810d9e57d84678bea492492d13f0cd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9e810d9e57d84678bea492492d13f0cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9e810d9e57d84678bea492492d13f0cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9e810d9e57d84678bea492492d13f0cd", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:42:00.862505 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-VolumesNegativeTest-1767927661 Oct 19 03:42:00.862505 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 9e810d9e57d84678bea492492d13f0cd Oct 19 03:42:00.862505 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-VolumesNegativeTest-1767927661 Oct 19 03:42:00.862505 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-VolumesNegativeTest-1767927661-project Oct 19 03:42:00.862505 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:42:00.862505 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:42:00.862505 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 72347d38678e41fea77b050fc8a9edb4 Oct 19 03:42:00.862505 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-VolumesNegativeTest-1767927661-project Oct 19 03:42:00.862505 n-d-861333-8 devstack@n-api.service[121135]: Oct 19 03:42:00.862505 n-d-861333-8 devstack@n-api.service[121135]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1352195218", "metadata": {"Type": "work"}}} Oct 19 03:42:00.862505 n-d-861333-8 devstack@n-api.service[121135]: method: Oct 19 03:42:00.862505 n-d-861333-8 devstack@n-api.service[121135]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 19 03:42:00.862505 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1352195218', 'metadata': {'Type': 'work'}}}} Oct 19 03:42:00.862505 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:42:00.862505 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:42:00.862505 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 03:42:00.862505 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 03:42:00.862505 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 03:42:00.862505 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise error Oct 19 03:42:00.862505 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 19 03:42:00.862505 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:42:00.862505 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 19 03:42:00.862505 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 19 03:42:00.862505 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:42:00.862505 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 19 03:42:00.862505 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi '0' Oct 19 03:42:00.862505 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:42:00.862505 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:42:00.862505 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:42:00.862505 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:42:00.862505 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:42:00.862505 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:42:00.862505 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:42:00.862505 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:42:00.862505 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 03:42:00.862505 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 03:42:00.862505 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:42:00.862505 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:42:00.862505 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 03:42:00.862505 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 03:42:00.862505 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 03:42:00.862505 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 03:42:00.862505 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 03:42:00.862505 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 03:42:00.866633 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 19 03:42:00.866633 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:42:00.866633 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:42:00.866633 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:42:00.866633 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:42:00.866633 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:42:00.866633 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:42:00.866633 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 03:42:00.866633 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 03:42:00.866633 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 19 03:42:00.866633 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:42:00.866633 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-8259ed5c-8099-4616-a072-45c41945a18d tempest-VolumesNegativeTest-1767927661 tempest-VolumesNegativeTest-1767927661-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:42:00.866633 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-8259ed5c-8099-4616-a072-45c41945a18d tempest-VolumesNegativeTest-1767927661 tempest-VolumesNegativeTest-1767927661-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.018783 Oct 19 03:42:00.876584 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-34299d42-4e0c-4f21-89fb-4204c080c6cb tempest-VolumesNegativeTest-1767927661 tempest-VolumesNegativeTest-1767927661-project] Action: 'create', calling method: .version_select at 0x7fc1300a0a60>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-413926944", "metadata": {"Type": "work"}}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:42:00.878366 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2905/5739] 10.222.0.52 () {60 vars in 1156 bytes} [Wed Oct 19 03:42:00 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 03:42:00.881094 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-34299d42-4e0c-4f21-89fb-4204c080c6cb tempest-VolumesNegativeTest-1767927661 tempest-VolumesNegativeTest-1767927661-project] Request method failure captured: Oct 19 03:42:00.881094 n-d-861333-8 devstack@n-api.service[121134]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 19 03:42:00.881094 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:42:00.881094 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:42:00.881094 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:42:00.881094 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 118 Oct 19 03:42:00.881094 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:42:00.881094 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:42:00.881094 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:42:00.881094 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:42:00.881094 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3IHZ-KHUOVAGKWnFFNZsdPd67S8QtMJ-qEWQqpWB28ZYOrsHOy3O8BTbQOLu8-k4qqDQMxCCnSsBoAk1SI8B1P25L3fQHqEi7AgOSy08zQ-dmha8dUKI7k5zgFN_6-EzcCU8ro8tJzU3gOsfc9285hrISMSDZrXenjO_dgeJcBw9NU Oct 19 03:42:00.881094 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:42:00.881094 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:42:00.881094 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:42:00.881094 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:42:00.881094 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:42:00.881094 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:42:00.881094 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 9e810d9e57d84678bea492492d13f0cd Oct 19 03:42:00.881094 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-VolumesNegativeTest-1767927661 Oct 19 03:42:00.881094 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:42:00.881094 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:42:00.881094 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9e810d9e57d84678bea492492d13f0cd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9e810d9e57d84678bea492492d13f0cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9e810d9e57d84678bea492492d13f0cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9e810d9e57d84678bea492492d13f0cd", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:42:00.881094 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-VolumesNegativeTest-1767927661 Oct 19 03:42:00.881094 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 9e810d9e57d84678bea492492d13f0cd Oct 19 03:42:00.881094 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-VolumesNegativeTest-1767927661 Oct 19 03:42:00.881094 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-VolumesNegativeTest-1767927661-project Oct 19 03:42:00.881094 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:42:00.881094 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:42:00.881094 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 72347d38678e41fea77b050fc8a9edb4 Oct 19 03:42:00.881094 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-VolumesNegativeTest-1767927661-project Oct 19 03:42:00.881094 n-d-861333-8 devstack@n-api.service[121134]: Oct 19 03:42:00.881094 n-d-861333-8 devstack@n-api.service[121134]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-413926944", "metadata": {"Type": "work"}}} Oct 19 03:42:00.881094 n-d-861333-8 devstack@n-api.service[121134]: method: Oct 19 03:42:00.881094 n-d-861333-8 devstack@n-api.service[121134]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 19 03:42:00.881094 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-413926944', 'metadata': {'Type': 'work'}}}} Oct 19 03:42:00.881094 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:42:00.881094 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:42:00.881094 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 03:42:00.881094 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 03:42:00.881094 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 03:42:00.881094 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise error Oct 19 03:42:00.881094 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 19 03:42:00.881094 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:42:00.881094 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 19 03:42:00.881094 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 19 03:42:00.881094 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:42:00.881094 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 19 03:42:00.881094 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi '' Oct 19 03:42:00.881094 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:42:00.881094 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:42:00.881094 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:42:00.881094 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:42:00.881094 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:42:00.881094 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:42:00.881094 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:42:00.881094 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:42:00.881094 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 03:42:00.881094 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 03:42:00.881094 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:42:00.881094 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:42:00.881094 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 03:42:00.881094 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 03:42:00.881094 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 03:42:00.881094 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 03:42:00.881094 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 03:42:00.881094 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 03:42:00.889812 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 19 03:42:00.889812 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:42:00.889812 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:42:00.889812 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:42:00.889812 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:42:00.889812 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:42:00.889812 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:42:00.889812 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 03:42:00.889812 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 03:42:00.889812 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 19 03:42:00.889812 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:42:00.889812 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-34299d42-4e0c-4f21-89fb-4204c080c6cb tempest-VolumesNegativeTest-1767927661 tempest-VolumesNegativeTest-1767927661-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:42:00.889812 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-34299d42-4e0c-4f21-89fb-4204c080c6cb tempest-VolumesNegativeTest-1767927661 tempest-VolumesNegativeTest-1767927661-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.011778 Oct 19 03:42:00.889812 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2835/5740] 10.222.0.52 () {60 vars in 1156 bytes} [Wed Oct 19 03:42:00 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 19 03:42:00.899850 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b5933bb2-3784-4cd1-9c9a-b1d2f355a5b8 tempest-VolumesNegativeTest-1767927661 tempest-VolumesNegativeTest-1767927661-project] Calling method '.version_select at 0x7fc12bfb2a60>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:42:00.990559 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-b5933bb2-3784-4cd1-9c9a-b1d2f355a5b8 tempest-VolumesNegativeTest-1767927661 tempest-VolumesNegativeTest-1767927661-project] HTTP exception thrown: Volume tempest-invalid-156215585 could not be found. Oct 19 03:42:00.993388 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b5933bb2-3784-4cd1-9c9a-b1d2f355a5b8 tempest-VolumesNegativeTest-1767927661 tempest-VolumesNegativeTest-1767927661-project] Request method failure captured: Oct 19 03:42:00.993388 n-d-861333-8 devstack@n-api.service[121135]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-156215585 HTTP/1.1 Oct 19 03:42:00.993388 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:42:00.993388 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:42:00.993388 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:42:00.993388 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:42:00.993388 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:42:00.993388 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:42:00.993388 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:42:00.993388 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:42:00.993388 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT3IHZ-KHUOVAGKWnFFNZsdPd67S8QtMJ-qEWQqpWB28ZYOrsHOy3O8BTbQOLu8-k4qqDQMxCCnSsBoAk1SI8B1P25L3fQHqEi7AgOSy08zQ-dmha8dUKI7k5zgFN_6-EzcCU8ro8tJzU3gOsfc9285hrISMSDZrXenjO_dgeJcBw9NU Oct 19 03:42:00.993388 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:42:00.993388 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:42:00.993388 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:42:00.993388 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:42:00.993388 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:42:00.993388 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:42:00.993388 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 9e810d9e57d84678bea492492d13f0cd Oct 19 03:42:00.993388 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-VolumesNegativeTest-1767927661 Oct 19 03:42:00.993388 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:42:00.993388 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:42:00.993388 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9e810d9e57d84678bea492492d13f0cd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9e810d9e57d84678bea492492d13f0cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9e810d9e57d84678bea492492d13f0cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9e810d9e57d84678bea492492d13f0cd", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:42:00.993388 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-VolumesNegativeTest-1767927661 Oct 19 03:42:00.993388 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 9e810d9e57d84678bea492492d13f0cd Oct 19 03:42:00.993388 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-VolumesNegativeTest-1767927661 Oct 19 03:42:00.993388 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-VolumesNegativeTest-1767927661-project Oct 19 03:42:00.993388 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:42:00.993388 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:42:00.993388 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 72347d38678e41fea77b050fc8a9edb4 Oct 19 03:42:00.993388 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-VolumesNegativeTest-1767927661-project Oct 19 03:42:00.993388 n-d-861333-8 devstack@n-api.service[121135]: method: Oct 19 03:42:00.993388 n-d-861333-8 devstack@n-api.service[121135]: exception: Volume tempest-invalid-156215585 could not be found. Oct 19 03:42:00.993388 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': 'tempest-invalid-156215585'} Oct 19 03:42:00.993388 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:42:00.993388 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:42:00.993388 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 03:42:00.993388 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 03:42:00.993388 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 19 03:42:00.993388 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 19 03:42:00.993388 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 19 03:42:00.993388 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 19 03:42:00.993388 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 19 03:42:00.993388 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 19 03:42:00.993388 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 19 03:42:00.993388 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 19 03:42:00.993388 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 03:42:00.993388 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 03:42:00.993388 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 03:42:00.993388 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 03:42:00.993388 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-156215585 could not be found. (HTTP 404) (Request-ID: req-22d7c5a8-aae1-4314-9895-bca5773f4130) Oct 19 03:42:00.993388 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:42:00.993388 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:42:00.993388 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:42:00.993388 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:42:00.993388 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 19 03:42:00.993388 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 19 03:42:00.993388 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 19 03:42:00.993388 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 19 03:42:00.993388 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 19 03:42:00.993388 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 19 03:42:00.993388 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 19 03:42:00.993388 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 19 03:42:00.993388 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 03:42:00.997450 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 03:42:00.997450 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 19 03:42:00.997450 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 19 03:42:00.997450 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 19 03:42:00.997450 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 19 03:42:00.997450 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 19 03:42:00.997450 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 19 03:42:00.997450 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 19 03:42:00.997450 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 19 03:42:00.997450 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 03:42:00.997450 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 03:42:00.997450 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 03:42:00.997450 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 03:42:00.997450 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-156215585 could not be found. Oct 19 03:42:00.997450 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:42:00.997450 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:42:00.997450 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:42:00.997450 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:42:00.997450 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:42:00.997450 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:42:00.997450 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:42:00.997450 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:42:00.997450 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 03:42:00.997450 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 03:42:00.997450 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:42:00.997450 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:42:00.997450 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 19 03:42:00.997450 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:42:00.997450 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-156215585 could not be found. Oct 19 03:42:00.997450 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:42:00.997450 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:42:00.997450 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:42:00.997450 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:42:00.997450 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:42:00.997450 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:42:00.997450 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:42:00.997450 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:42:00.997450 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-156215585 could not be found. Oct 19 03:42:00.997450 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:42:00.997450 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b5933bb2-3784-4cd1-9c9a-b1d2f355a5b8 tempest-VolumesNegativeTest-1767927661 tempest-VolumesNegativeTest-1767927661-project] Returning 404 to user: Volume tempest-invalid-156215585 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:42:00.997450 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b5933bb2-3784-4cd1-9c9a-b1d2f355a5b8 tempest-VolumesNegativeTest-1767927661 tempest-VolumesNegativeTest-1767927661-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/tempest-invalid-156215585" status: 404 len: 98 microversion: 2.1 time: 0.100292 Oct 19 03:42:00.997450 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2906/5741] 10.222.0.52 () {58 vars in 1215 bytes} [Wed Oct 19 03:42:00 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-156215585 => generated 98 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 03:42:01.008514 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ee86f1b6-2f64-4d7b-a468-921fdc7cdfe0 tempest-VolumesNegativeTest-1767927661 tempest-VolumesNegativeTest-1767927661-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004417 Oct 19 03:42:01.008964 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2836/5742] 10.222.0.52 () {58 vars in 1140 bytes} [Wed Oct 19 03:42:01 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 19 03:42:01.024717 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7922ad41-4a2c-4779-9804-177b99642aef tempest-VolumesNegativeTest-1767927661 tempest-VolumesNegativeTest-1767927661-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004721 Oct 19 03:42:01.026764 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2907/5743] 10.222.0.52 () {58 vars in 1137 bytes} [Wed Oct 19 03:42:01 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 19 03:42:01.037149 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1201eeb1-c9c0-4f45-880e-059c4972541b tempest-VolumesNegativeTest-1767927661 tempest-VolumesNegativeTest-1767927661-project] Calling method '.version_select at 0x7fc131966670>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:42:01.096603 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-1201eeb1-c9c0-4f45-880e-059c4972541b tempest-VolumesNegativeTest-1767927661 tempest-VolumesNegativeTest-1767927661-project] HTTP exception thrown: Volume 6d07835f-8590-4fc1-b6d8-639ecb1745d0 could not be found. Oct 19 03:42:01.099030 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1201eeb1-c9c0-4f45-880e-059c4972541b tempest-VolumesNegativeTest-1767927661 tempest-VolumesNegativeTest-1767927661-project] Request method failure captured: Oct 19 03:42:01.099030 n-d-861333-8 devstack@n-api.service[121134]: request: DELETE /compute/v2.1/os-volumes/6d07835f-8590-4fc1-b6d8-639ecb1745d0 HTTP/1.1 Oct 19 03:42:01.099030 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:42:01.099030 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:42:01.099030 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:42:01.099030 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:42:01.099030 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:42:01.099030 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:42:01.099030 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:42:01.099030 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:42:01.099030 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3IHZ-KHUOVAGKWnFFNZsdPd67S8QtMJ-qEWQqpWB28ZYOrsHOy3O8BTbQOLu8-k4qqDQMxCCnSsBoAk1SI8B1P25L3fQHqEi7AgOSy08zQ-dmha8dUKI7k5zgFN_6-EzcCU8ro8tJzU3gOsfc9285hrISMSDZrXenjO_dgeJcBw9NU Oct 19 03:42:01.099030 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:42:01.099030 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:42:01.099030 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:42:01.099030 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:42:01.099030 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:42:01.099030 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:42:01.099030 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 9e810d9e57d84678bea492492d13f0cd Oct 19 03:42:01.099030 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-VolumesNegativeTest-1767927661 Oct 19 03:42:01.099030 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:42:01.099030 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:42:01.099030 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9e810d9e57d84678bea492492d13f0cd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9e810d9e57d84678bea492492d13f0cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9e810d9e57d84678bea492492d13f0cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9e810d9e57d84678bea492492d13f0cd", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:42:01.099030 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-VolumesNegativeTest-1767927661 Oct 19 03:42:01.099030 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 9e810d9e57d84678bea492492d13f0cd Oct 19 03:42:01.099030 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-VolumesNegativeTest-1767927661 Oct 19 03:42:01.099030 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-VolumesNegativeTest-1767927661-project Oct 19 03:42:01.099030 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:42:01.099030 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:42:01.099030 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 72347d38678e41fea77b050fc8a9edb4 Oct 19 03:42:01.099030 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-VolumesNegativeTest-1767927661-project Oct 19 03:42:01.099030 n-d-861333-8 devstack@n-api.service[121134]: method: Oct 19 03:42:01.099030 n-d-861333-8 devstack@n-api.service[121134]: exception: Volume 6d07835f-8590-4fc1-b6d8-639ecb1745d0 could not be found. Oct 19 03:42:01.099030 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '6d07835f-8590-4fc1-b6d8-639ecb1745d0'} Oct 19 03:42:01.099030 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:42:01.099030 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:42:01.099030 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 03:42:01.099030 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 03:42:01.099030 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 19 03:42:01.099030 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 19 03:42:01.099030 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 19 03:42:01.099030 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 19 03:42:01.099030 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 19 03:42:01.099030 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 19 03:42:01.099030 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 19 03:42:01.099030 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 19 03:42:01.099030 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 03:42:01.099030 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 03:42:01.099030 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 03:42:01.099030 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 03:42:01.099030 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6d07835f-8590-4fc1-b6d8-639ecb1745d0 could not be found. (HTTP 404) (Request-ID: req-295c5202-a163-48ee-b6c2-cc44717d99e1) Oct 19 03:42:01.099030 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:42:01.099030 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:42:01.099030 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:42:01.099030 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:42:01.099030 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 19 03:42:01.099030 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 19 03:42:01.099030 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 19 03:42:01.099030 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 19 03:42:01.099030 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 19 03:42:01.099030 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 19 03:42:01.099030 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 19 03:42:01.099030 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 19 03:42:01.099030 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 03:42:01.103896 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 03:42:01.103896 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 19 03:42:01.103896 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 19 03:42:01.103896 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 19 03:42:01.103896 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 19 03:42:01.103896 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 19 03:42:01.103896 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 19 03:42:01.103896 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 19 03:42:01.103896 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 19 03:42:01.103896 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 03:42:01.103896 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 03:42:01.103896 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 03:42:01.103896 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 03:42:01.103896 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6d07835f-8590-4fc1-b6d8-639ecb1745d0 could not be found. Oct 19 03:42:01.103896 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:42:01.103896 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:42:01.103896 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:42:01.103896 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:42:01.103896 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:42:01.103896 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:42:01.103896 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:42:01.103896 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:42:01.103896 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 03:42:01.103896 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 03:42:01.103896 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:42:01.103896 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:42:01.103896 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 19 03:42:01.103896 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:42:01.103896 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6d07835f-8590-4fc1-b6d8-639ecb1745d0 could not be found. Oct 19 03:42:01.103896 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:42:01.103896 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:42:01.103896 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:42:01.103896 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:42:01.103896 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:42:01.103896 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:42:01.103896 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:42:01.103896 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:42:01.103896 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6d07835f-8590-4fc1-b6d8-639ecb1745d0 could not be found. Oct 19 03:42:01.103896 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:42:01.103896 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1201eeb1-c9c0-4f45-880e-059c4972541b tempest-VolumesNegativeTest-1767927661 tempest-VolumesNegativeTest-1767927661-project] Returning 404 to user: Volume 6d07835f-8590-4fc1-b6d8-639ecb1745d0 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:42:01.103896 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1201eeb1-c9c0-4f45-880e-059c4972541b tempest-VolumesNegativeTest-1767927661 tempest-VolumesNegativeTest-1767927661-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/6d07835f-8590-4fc1-b6d8-639ecb1745d0" status: 404 len: 109 microversion: 2.1 time: 0.069069 Oct 19 03:42:01.103896 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2837/5744] 10.222.0.52 () {58 vars in 1248 bytes} [Wed Oct 19 03:42:01 2022] DELETE /compute/v2.1/os-volumes/6d07835f-8590-4fc1-b6d8-639ecb1745d0 => generated 109 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:42:01.111671 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e95e1511-b6c1-41d1-8e87-b412ba6b7598 tempest-VolumesNegativeTest-1767927661 tempest-VolumesNegativeTest-1767927661-project] Calling method '.version_select at 0x7fc13126c040>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:42:01.178804 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-e95e1511-b6c1-41d1-8e87-b412ba6b7598 tempest-VolumesNegativeTest-1767927661 tempest-VolumesNegativeTest-1767927661-project] HTTP exception thrown: Volume 49212d9f-d740-4138-9231-b40bc533dc70 could not be found. Oct 19 03:42:01.180797 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e95e1511-b6c1-41d1-8e87-b412ba6b7598 tempest-VolumesNegativeTest-1767927661 tempest-VolumesNegativeTest-1767927661-project] Request method failure captured: Oct 19 03:42:01.180797 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/os-volumes/49212d9f-d740-4138-9231-b40bc533dc70 HTTP/1.1 Oct 19 03:42:01.180797 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:42:01.180797 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:42:01.180797 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:42:01.180797 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:42:01.180797 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:42:01.180797 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:42:01.180797 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:42:01.180797 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:42:01.180797 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT3IHZ-KHUOVAGKWnFFNZsdPd67S8QtMJ-qEWQqpWB28ZYOrsHOy3O8BTbQOLu8-k4qqDQMxCCnSsBoAk1SI8B1P25L3fQHqEi7AgOSy08zQ-dmha8dUKI7k5zgFN_6-EzcCU8ro8tJzU3gOsfc9285hrISMSDZrXenjO_dgeJcBw9NU Oct 19 03:42:01.180797 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:42:01.180797 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:42:01.180797 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:42:01.180797 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:42:01.180797 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:42:01.180797 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:42:01.180797 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 9e810d9e57d84678bea492492d13f0cd Oct 19 03:42:01.180797 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-VolumesNegativeTest-1767927661 Oct 19 03:42:01.180797 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:42:01.180797 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:42:01.180797 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9e810d9e57d84678bea492492d13f0cd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9e810d9e57d84678bea492492d13f0cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9e810d9e57d84678bea492492d13f0cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9e810d9e57d84678bea492492d13f0cd", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:42:01.180797 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-VolumesNegativeTest-1767927661 Oct 19 03:42:01.180797 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 9e810d9e57d84678bea492492d13f0cd Oct 19 03:42:01.180797 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-VolumesNegativeTest-1767927661 Oct 19 03:42:01.180797 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-VolumesNegativeTest-1767927661-project Oct 19 03:42:01.180797 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:42:01.180797 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:42:01.180797 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 72347d38678e41fea77b050fc8a9edb4 Oct 19 03:42:01.180797 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-VolumesNegativeTest-1767927661-project Oct 19 03:42:01.180797 n-d-861333-8 devstack@n-api.service[121135]: method: Oct 19 03:42:01.180797 n-d-861333-8 devstack@n-api.service[121135]: exception: Volume 49212d9f-d740-4138-9231-b40bc533dc70 could not be found. Oct 19 03:42:01.180797 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '49212d9f-d740-4138-9231-b40bc533dc70'} Oct 19 03:42:01.180797 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:42:01.180797 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:42:01.180797 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 03:42:01.180797 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 03:42:01.180797 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 19 03:42:01.180797 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 19 03:42:01.180797 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 19 03:42:01.180797 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 19 03:42:01.180797 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 19 03:42:01.180797 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 19 03:42:01.180797 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 19 03:42:01.180797 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 19 03:42:01.180797 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 03:42:01.180797 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 03:42:01.180797 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 03:42:01.180797 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 03:42:01.180797 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 49212d9f-d740-4138-9231-b40bc533dc70 could not be found. (HTTP 404) (Request-ID: req-0064f0b1-14a3-4080-9e35-8951aedc68a7) Oct 19 03:42:01.180797 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:42:01.180797 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:42:01.180797 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:42:01.180797 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:42:01.180797 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 19 03:42:01.180797 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 19 03:42:01.180797 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 19 03:42:01.180797 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 19 03:42:01.180797 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 19 03:42:01.180797 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 19 03:42:01.180797 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 19 03:42:01.180797 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 19 03:42:01.180797 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 03:42:01.185811 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 03:42:01.185811 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 19 03:42:01.185811 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 19 03:42:01.185811 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 19 03:42:01.185811 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 19 03:42:01.185811 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 19 03:42:01.185811 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 19 03:42:01.185811 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 19 03:42:01.185811 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 19 03:42:01.185811 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 03:42:01.185811 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 03:42:01.185811 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 03:42:01.185811 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 03:42:01.185811 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 49212d9f-d740-4138-9231-b40bc533dc70 could not be found. Oct 19 03:42:01.185811 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:42:01.185811 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:42:01.185811 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:42:01.185811 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:42:01.185811 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:42:01.185811 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:42:01.185811 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:42:01.185811 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:42:01.185811 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 03:42:01.185811 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 03:42:01.185811 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:42:01.185811 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:42:01.185811 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 19 03:42:01.185811 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:42:01.185811 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 49212d9f-d740-4138-9231-b40bc533dc70 could not be found. Oct 19 03:42:01.185811 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:42:01.185811 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:42:01.185811 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:42:01.185811 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:42:01.185811 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:42:01.185811 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:42:01.185811 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:42:01.185811 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:42:01.185811 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 49212d9f-d740-4138-9231-b40bc533dc70 could not be found. Oct 19 03:42:01.185811 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:42:01.185811 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e95e1511-b6c1-41d1-8e87-b412ba6b7598 tempest-VolumesNegativeTest-1767927661 tempest-VolumesNegativeTest-1767927661-project] Returning 404 to user: Volume 49212d9f-d740-4138-9231-b40bc533dc70 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:42:01.185811 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e95e1511-b6c1-41d1-8e87-b412ba6b7598 tempest-VolumesNegativeTest-1767927661 tempest-VolumesNegativeTest-1767927661-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/49212d9f-d740-4138-9231-b40bc533dc70" status: 404 len: 109 microversion: 2.1 time: 0.075564 Oct 19 03:42:01.185811 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2908/5745] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Oct 19 03:42:01 2022] GET /compute/v2.1/os-volumes/49212d9f-d740-4138-9231-b40bc533dc70 => generated 109 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:42:01.258562 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-bb5eb527-ac52-446a-9a1b-968a1e5f3fa5 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:42:01.261784 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-bb5eb527-ac52-446a-9a1b-968a1e5f3fa5 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: d813bf3b-04b6-4dea-8b53-a6223779622f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:42:01.284772 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bb5eb527-ac52-446a-9a1b-968a1e5f3fa5 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:01.285494 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bb5eb527-ac52-446a-9a1b-968a1e5f3fa5 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:01.286478 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bb5eb527-ac52-446a-9a1b-968a1e5f3fa5 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:01.290579 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bb5eb527-ac52-446a-9a1b-968a1e5f3fa5 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:01.290579 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bb5eb527-ac52-446a-9a1b-968a1e5f3fa5 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:01.290579 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bb5eb527-ac52-446a-9a1b-968a1e5f3fa5 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:01.369006 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:42:01.658708 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-bb5eb527-ac52-446a-9a1b-968a1e5f3fa5 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:42:01.669297 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-bb5eb527-ac52-446a-9a1b-968a1e5f3fa5 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/d813bf3b-04b6-4dea-8b53-a6223779622f" status: 200 len: 1314 microversion: 2.1 time: 0.421003 Oct 19 03:42:01.674297 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2838/5746] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:42:01 2022] GET /compute/v2.1/servers/d813bf3b-04b6-4dea-8b53-a6223779622f => generated 1314 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:42:02.700937 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b2fe29aa-d206-40ef-9676-5e931a422b96 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:42:02.701740 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b2fe29aa-d206-40ef-9676-5e931a422b96 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: d813bf3b-04b6-4dea-8b53-a6223779622f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:42:02.708614 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b2fe29aa-d206-40ef-9676-5e931a422b96 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:02.709117 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b2fe29aa-d206-40ef-9676-5e931a422b96 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:02.709629 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b2fe29aa-d206-40ef-9676-5e931a422b96 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:02.710608 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b2fe29aa-d206-40ef-9676-5e931a422b96 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:02.710813 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b2fe29aa-d206-40ef-9676-5e931a422b96 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:02.711254 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b2fe29aa-d206-40ef-9676-5e931a422b96 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:02.896047 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b2fe29aa-d206-40ef-9676-5e931a422b96 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:42:02.905829 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b2fe29aa-d206-40ef-9676-5e931a422b96 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/d813bf3b-04b6-4dea-8b53-a6223779622f" status: 200 len: 1501 microversion: 2.1 time: 0.210497 Oct 19 03:42:02.907162 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2909/5747] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:42:02 2022] GET /compute/v2.1/servers/d813bf3b-04b6-4dea-8b53-a6223779622f => generated 1501 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:42:02.929499 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-99b567ab-52e0-41eb-8b26-3aa603743fb1 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:42:02.937863 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-99b567ab-52e0-41eb-8b26-3aa603743fb1 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:02.938359 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-99b567ab-52e0-41eb-8b26-3aa603743fb1 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:02.938979 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-99b567ab-52e0-41eb-8b26-3aa603743fb1 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:02.993107 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-99b567ab-52e0-41eb-8b26-3aa603743fb1 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: d813bf3b-04b6-4dea-8b53-a6223779622f] Going to try to stop instance {{(pid=121134) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 19 03:42:03.162553 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-23854b35-6c50-42bb-a813-468754d0dd9b tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1153672756", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "networks": [{"uuid": "1887c64a-916e-4e4a-8de3-0b2205c37365"}], "key_name": "tempest-TestNetworkBasicOps-1295549042", "security_groups": [{"name": "tempest-secgroup-smoke-279186132"}]}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:42:03.274046 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-99b567ab-52e0-41eb-8b26-3aa603743fb1 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "POST /compute/v2.1/servers/d813bf3b-04b6-4dea-8b53-a6223779622f/action" status: 202 len: 0 microversion: 2.1 time: 0.347759 Oct 19 03:42:03.276425 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2839/5748] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:42:02 2022] POST /compute/v2.1/servers/d813bf3b-04b6-4dea-8b53-a6223779622f/action => generated 0 bytes in 350 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:42:03.305689 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8b15745e-d2ad-45a6-950b-338fccd38326 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:42:03.307643 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8b15745e-d2ad-45a6-950b-338fccd38326 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: d813bf3b-04b6-4dea-8b53-a6223779622f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:42:03.322322 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8b15745e-d2ad-45a6-950b-338fccd38326 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:03.322521 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8b15745e-d2ad-45a6-950b-338fccd38326 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:03.322963 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8b15745e-d2ad-45a6-950b-338fccd38326 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:03.325995 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8b15745e-d2ad-45a6-950b-338fccd38326 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:03.327012 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8b15745e-d2ad-45a6-950b-338fccd38326 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:03.327646 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8b15745e-d2ad-45a6-950b-338fccd38326 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:03.354255 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.network.neutron [None req-23854b35-6c50-42bb-a813-468754d0dd9b tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] validate_networks() for [('1887c64a-916e-4e4a-8de3-0b2205c37365', None, None, None, None, None)] {{(pid=121135) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:42:03.664909 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8b15745e-d2ad-45a6-950b-338fccd38326 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:42:03.687103 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8b15745e-d2ad-45a6-950b-338fccd38326 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/d813bf3b-04b6-4dea-8b53-a6223779622f" status: 200 len: 1511 microversion: 2.1 time: 0.393090 Oct 19 03:42:03.687897 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2840/5749] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:42:03 2022] GET /compute/v2.1/servers/d813bf3b-04b6-4dea-8b53-a6223779622f => generated 1511 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:42:04.395812 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-23854b35-6c50-42bb-a813-468754d0dd9b tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Flavor limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:42:04.396774 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-23854b35-6c50-42bb-a813-468754d0dd9b tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Image limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:42:04.397330 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-23854b35-6c50-42bb-a813-468754d0dd9b tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Flavor pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:42:04.397869 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-23854b35-6c50-42bb-a813-468754d0dd9b tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Image pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:42:04.398361 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-23854b35-6c50-42bb-a813-468754d0dd9b tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:42:04.420650 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-23854b35-6c50-42bb-a813-468754d0dd9b tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:04.421413 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-23854b35-6c50-42bb-a813-468754d0dd9b tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:04.439280 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-23854b35-6c50-42bb-a813-468754d0dd9b tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:04.440390 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-23854b35-6c50-42bb-a813-468754d0dd9b tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:04.441822 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-23854b35-6c50-42bb-a813-468754d0dd9b tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:04.442346 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-23854b35-6c50-42bb-a813-468754d0dd9b tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:04.475133 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-23854b35-6c50-42bb-a813-468754d0dd9b tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Getting quotas for project 3bf91777fa414ddaa797d735e7d2a275. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:42:04.481463 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-23854b35-6c50-42bb-a813-468754d0dd9b tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Getting quotas for user 4670fd4408d4454784251a880d5a72f5 and project 3bf91777fa414ddaa797d735e7d2a275. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:42:04.499821 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-23854b35-6c50-42bb-a813-468754d0dd9b tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Going to run 1 instances... {{(pid=121135) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:42:04.503280 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-23854b35-6c50-42bb-a813-468754d0dd9b tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] [instance: a5cf37d5-2405-4ca7-b637-070a456f667f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121135) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:42:04.623701 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-23854b35-6c50-42bb-a813-468754d0dd9b tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.466387 Oct 19 03:42:04.624762 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2910/5750] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:42:03 2022] POST /compute/v2.1/servers => generated 405 bytes in 1468 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 19 03:42:04.636051 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d055b045-5b32-4c7b-9f40-e495ebe9d59f tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:42:04.636744 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d055b045-5b32-4c7b-9f40-e495ebe9d59f tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] [instance: a5cf37d5-2405-4ca7-b637-070a456f667f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:42:04.710498 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d055b045-5b32-4c7b-9f40-e495ebe9d59f tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4670fd4408d4454784251a880d5a72f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf91777fa414ddaa797d735e7d2a275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:42:04.719677 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e33614d4-304c-4c95-85a7-30e4f4c4a939 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:42:04.720349 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e33614d4-304c-4c95-85a7-30e4f4c4a939 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: d813bf3b-04b6-4dea-8b53-a6223779622f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:42:04.722733 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d055b045-5b32-4c7b-9f40-e495ebe9d59f tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] 10.222.0.52 "GET /compute/v2.1/servers/a5cf37d5-2405-4ca7-b637-070a456f667f" status: 200 len: 1249 microversion: 2.1 time: 0.090526 Oct 19 03:42:04.724563 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2841/5751] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:42:04 2022] GET /compute/v2.1/servers/a5cf37d5-2405-4ca7-b637-070a456f667f => generated 1249 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:42:04.742010 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e33614d4-304c-4c95-85a7-30e4f4c4a939 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:04.753137 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e33614d4-304c-4c95-85a7-30e4f4c4a939 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:04.753137 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e33614d4-304c-4c95-85a7-30e4f4c4a939 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:04.753137 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e33614d4-304c-4c95-85a7-30e4f4c4a939 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:04.753137 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e33614d4-304c-4c95-85a7-30e4f4c4a939 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:04.753137 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e33614d4-304c-4c95-85a7-30e4f4c4a939 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:04.994841 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-e33614d4-304c-4c95-85a7-30e4f4c4a939 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:42:05.006266 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e33614d4-304c-4c95-85a7-30e4f4c4a939 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/d813bf3b-04b6-4dea-8b53-a6223779622f" status: 200 len: 1511 microversion: 2.1 time: 0.299637 Oct 19 03:42:05.007071 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2911/5752] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:42:04 2022] GET /compute/v2.1/servers/d813bf3b-04b6-4dea-8b53-a6223779622f => generated 1511 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:42:05.769683 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7b5db8fe-ffbe-4d61-9952-e9295a5f1237 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:42:05.771615 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7b5db8fe-ffbe-4d61-9952-e9295a5f1237 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] [instance: a5cf37d5-2405-4ca7-b637-070a456f667f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:42:05.913022 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-7b5db8fe-ffbe-4d61-9952-e9295a5f1237 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4670fd4408d4454784251a880d5a72f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf91777fa414ddaa797d735e7d2a275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:42:05.923148 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7b5db8fe-ffbe-4d61-9952-e9295a5f1237 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] 10.222.0.52 "GET /compute/v2.1/servers/a5cf37d5-2405-4ca7-b637-070a456f667f" status: 200 len: 1249 microversion: 2.1 time: 0.175265 Oct 19 03:42:05.924023 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2842/5753] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:42:05 2022] GET /compute/v2.1/servers/a5cf37d5-2405-4ca7-b637-070a456f667f => generated 1249 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:42:06.029991 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f0cb86d6-4d3f-4532-8ac2-86f07f4840cc tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:42:06.030620 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f0cb86d6-4d3f-4532-8ac2-86f07f4840cc tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: d813bf3b-04b6-4dea-8b53-a6223779622f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:42:06.045192 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f0cb86d6-4d3f-4532-8ac2-86f07f4840cc tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:06.045727 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f0cb86d6-4d3f-4532-8ac2-86f07f4840cc tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:06.046174 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f0cb86d6-4d3f-4532-8ac2-86f07f4840cc tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:06.050265 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f0cb86d6-4d3f-4532-8ac2-86f07f4840cc tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:06.050265 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f0cb86d6-4d3f-4532-8ac2-86f07f4840cc tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:06.050265 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f0cb86d6-4d3f-4532-8ac2-86f07f4840cc tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:06.098394 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:UPDATE=14,nova_cell1:RELEASE=1,nova_cell1:SELECT=83,nova_cell1:DELETE=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:42:06.378400 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f0cb86d6-4d3f-4532-8ac2-86f07f4840cc tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:42:06.393037 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f0cb86d6-4d3f-4532-8ac2-86f07f4840cc tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/d813bf3b-04b6-4dea-8b53-a6223779622f" status: 200 len: 1511 microversion: 2.1 time: 0.366756 Oct 19 03:42:06.408441 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2912/5754] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:42:06 2022] GET /compute/v2.1/servers/d813bf3b-04b6-4dea-8b53-a6223779622f => generated 1511 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:42:06.954089 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4648d835-7e1f-4ec5-bb69-4eb5b492c659 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:42:06.969982 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4648d835-7e1f-4ec5-bb69-4eb5b492c659 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] [instance: a5cf37d5-2405-4ca7-b637-070a456f667f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:42:06.994652 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4648d835-7e1f-4ec5-bb69-4eb5b492c659 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:06.994652 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4648d835-7e1f-4ec5-bb69-4eb5b492c659 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:06.994652 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4648d835-7e1f-4ec5-bb69-4eb5b492c659 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:06.994652 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4648d835-7e1f-4ec5-bb69-4eb5b492c659 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:06.994652 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4648d835-7e1f-4ec5-bb69-4eb5b492c659 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:06.994652 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4648d835-7e1f-4ec5-bb69-4eb5b492c659 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:07.103693 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-4648d835-7e1f-4ec5-bb69-4eb5b492c659 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4670fd4408d4454784251a880d5a72f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf91777fa414ddaa797d735e7d2a275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:42:07.119768 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4648d835-7e1f-4ec5-bb69-4eb5b492c659 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] 10.222.0.52 "GET /compute/v2.1/servers/a5cf37d5-2405-4ca7-b637-070a456f667f" status: 200 len: 1301 microversion: 2.1 time: 0.167745 Oct 19 03:42:07.121485 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2843/5755] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:42:06 2022] GET /compute/v2.1/servers/a5cf37d5-2405-4ca7-b637-070a456f667f => generated 1301 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:42:07.418407 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-148ee2d3-ba34-42ee-95e0-f56a5bda06f3 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:42:07.420036 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-148ee2d3-ba34-42ee-95e0-f56a5bda06f3 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: d813bf3b-04b6-4dea-8b53-a6223779622f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:42:07.434304 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-148ee2d3-ba34-42ee-95e0-f56a5bda06f3 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:07.434304 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-148ee2d3-ba34-42ee-95e0-f56a5bda06f3 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:07.434304 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-148ee2d3-ba34-42ee-95e0-f56a5bda06f3 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:07.434304 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-148ee2d3-ba34-42ee-95e0-f56a5bda06f3 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:07.434304 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-148ee2d3-ba34-42ee-95e0-f56a5bda06f3 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:07.434304 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-148ee2d3-ba34-42ee-95e0-f56a5bda06f3 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:07.859331 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-148ee2d3-ba34-42ee-95e0-f56a5bda06f3 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:42:07.875953 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-148ee2d3-ba34-42ee-95e0-f56a5bda06f3 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/d813bf3b-04b6-4dea-8b53-a6223779622f" status: 200 len: 1511 microversion: 2.1 time: 0.462945 Oct 19 03:42:07.891491 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2913/5756] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:42:07 2022] GET /compute/v2.1/servers/d813bf3b-04b6-4dea-8b53-a6223779622f => generated 1511 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:42:08.144427 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-87e7214a-b145-4c72-bd00-671db9676d53 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:42:08.145650 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-87e7214a-b145-4c72-bd00-671db9676d53 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] [instance: a5cf37d5-2405-4ca7-b637-070a456f667f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:42:08.167088 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-87e7214a-b145-4c72-bd00-671db9676d53 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:08.167592 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-87e7214a-b145-4c72-bd00-671db9676d53 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:08.168041 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-87e7214a-b145-4c72-bd00-671db9676d53 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:08.172031 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-87e7214a-b145-4c72-bd00-671db9676d53 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:08.172031 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-87e7214a-b145-4c72-bd00-671db9676d53 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:08.172031 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-87e7214a-b145-4c72-bd00-671db9676d53 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:08.285618 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-87e7214a-b145-4c72-bd00-671db9676d53 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4670fd4408d4454784251a880d5a72f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf91777fa414ddaa797d735e7d2a275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:42:08.297571 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-87e7214a-b145-4c72-bd00-671db9676d53 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] 10.222.0.52 "GET /compute/v2.1/servers/a5cf37d5-2405-4ca7-b637-070a456f667f" status: 200 len: 1307 microversion: 2.1 time: 0.156861 Oct 19 03:42:08.316566 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2844/5757] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:42:08 2022] GET /compute/v2.1/servers/a5cf37d5-2405-4ca7-b637-070a456f667f => generated 1307 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:42:08.905712 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-05880c84-6e55-43b8-bb24-aefd1b0d6a75 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:42:08.906340 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-05880c84-6e55-43b8-bb24-aefd1b0d6a75 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: d813bf3b-04b6-4dea-8b53-a6223779622f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:42:08.910183 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:42:08.919204 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-05880c84-6e55-43b8-bb24-aefd1b0d6a75 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:08.921461 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-05880c84-6e55-43b8-bb24-aefd1b0d6a75 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:08.922087 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-05880c84-6e55-43b8-bb24-aefd1b0d6a75 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:08.922812 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-05880c84-6e55-43b8-bb24-aefd1b0d6a75 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:08.926844 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-05880c84-6e55-43b8-bb24-aefd1b0d6a75 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:08.927305 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-05880c84-6e55-43b8-bb24-aefd1b0d6a75 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:09.248792 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-05880c84-6e55-43b8-bb24-aefd1b0d6a75 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:42:09.262862 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-05880c84-6e55-43b8-bb24-aefd1b0d6a75 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/d813bf3b-04b6-4dea-8b53-a6223779622f" status: 200 len: 1511 microversion: 2.1 time: 0.361112 Oct 19 03:42:09.264462 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2914/5758] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:42:08 2022] GET /compute/v2.1/servers/d813bf3b-04b6-4dea-8b53-a6223779622f => generated 1511 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:42:09.327376 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f3ae4572-b1fb-4315-b807-9e4ee52bef5d tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:42:09.328109 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f3ae4572-b1fb-4315-b807-9e4ee52bef5d tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] [instance: a5cf37d5-2405-4ca7-b637-070a456f667f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:42:09.370911 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f3ae4572-b1fb-4315-b807-9e4ee52bef5d tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:09.386229 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f3ae4572-b1fb-4315-b807-9e4ee52bef5d tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:09.393276 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f3ae4572-b1fb-4315-b807-9e4ee52bef5d tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:09.393276 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f3ae4572-b1fb-4315-b807-9e4ee52bef5d tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:09.393276 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f3ae4572-b1fb-4315-b807-9e4ee52bef5d tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:09.393276 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f3ae4572-b1fb-4315-b807-9e4ee52bef5d tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:09.691016 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-f3ae4572-b1fb-4315-b807-9e4ee52bef5d tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4670fd4408d4454784251a880d5a72f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf91777fa414ddaa797d735e7d2a275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:42:09.702233 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f3ae4572-b1fb-4315-b807-9e4ee52bef5d tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] 10.222.0.52 "GET /compute/v2.1/servers/a5cf37d5-2405-4ca7-b637-070a456f667f" status: 200 len: 1374 microversion: 2.1 time: 0.380065 Oct 19 03:42:09.703881 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2845/5759] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:42:09 2022] GET /compute/v2.1/servers/a5cf37d5-2405-4ca7-b637-070a456f667f => generated 1374 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:42:10.292217 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f6965cb9-0308-4558-bb7d-d88b1c1d0466 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:42:10.292849 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f6965cb9-0308-4558-bb7d-d88b1c1d0466 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: d813bf3b-04b6-4dea-8b53-a6223779622f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:42:10.300094 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f6965cb9-0308-4558-bb7d-d88b1c1d0466 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:10.304185 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f6965cb9-0308-4558-bb7d-d88b1c1d0466 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:10.304623 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f6965cb9-0308-4558-bb7d-d88b1c1d0466 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:10.305328 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f6965cb9-0308-4558-bb7d-d88b1c1d0466 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:10.305827 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f6965cb9-0308-4558-bb7d-d88b1c1d0466 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:10.306278 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f6965cb9-0308-4558-bb7d-d88b1c1d0466 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:10.471927 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-d71606cf-f92e-4ec2-8066-c2a5160701ae req-7e334900-5018-4d9b-b749-176f4db2a99e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5cf37d5-2405-4ca7-b637-070a456f667f", "tag": "68555c4d-503f-438a-ad62-45fd83f555da"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:42:10.487159 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-d71606cf-f92e-4ec2-8066-c2a5160701ae req-7e334900-5018-4d9b-b749-176f4db2a99e service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:10.488035 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-d71606cf-f92e-4ec2-8066-c2a5160701ae req-7e334900-5018-4d9b-b749-176f4db2a99e service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:10.492719 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-d71606cf-f92e-4ec2-8066-c2a5160701ae req-7e334900-5018-4d9b-b749-176f4db2a99e service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:10.510803 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-d71606cf-f92e-4ec2-8066-c2a5160701ae req-7e334900-5018-4d9b-b749-176f4db2a99e service nova] Creating event network-changed:68555c4d-503f-438a-ad62-45fd83f555da for instance a5cf37d5-2405-4ca7-b637-070a456f667f on n-h1-861333-8 Oct 19 03:42:10.517221 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-d71606cf-f92e-4ec2-8066-c2a5160701ae req-7e334900-5018-4d9b-b749-176f4db2a99e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051894 Oct 19 03:42:10.522562 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2846/5760] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:42:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:42:10.650552 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f6965cb9-0308-4558-bb7d-d88b1c1d0466 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:42:10.678888 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f6965cb9-0308-4558-bb7d-d88b1c1d0466 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/d813bf3b-04b6-4dea-8b53-a6223779622f" status: 200 len: 1511 microversion: 2.1 time: 0.390378 Oct 19 03:42:10.684822 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2915/5761] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:42:10 2022] GET /compute/v2.1/servers/d813bf3b-04b6-4dea-8b53-a6223779622f => generated 1511 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:42:10.734816 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0d45e630-f869-478b-823f-6b878ad0e3fc tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:42:10.736084 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0d45e630-f869-478b-823f-6b878ad0e3fc tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] [instance: a5cf37d5-2405-4ca7-b637-070a456f667f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:42:10.754061 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0d45e630-f869-478b-823f-6b878ad0e3fc tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:10.755602 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0d45e630-f869-478b-823f-6b878ad0e3fc tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:10.756589 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0d45e630-f869-478b-823f-6b878ad0e3fc tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:10.757666 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0d45e630-f869-478b-823f-6b878ad0e3fc tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:10.758144 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0d45e630-f869-478b-823f-6b878ad0e3fc tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:10.758588 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0d45e630-f869-478b-823f-6b878ad0e3fc tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:11.232984 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0d45e630-f869-478b-823f-6b878ad0e3fc tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4670fd4408d4454784251a880d5a72f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf91777fa414ddaa797d735e7d2a275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:42:11.241034 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0d45e630-f869-478b-823f-6b878ad0e3fc tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] 10.222.0.52 "GET /compute/v2.1/servers/a5cf37d5-2405-4ca7-b637-070a456f667f" status: 200 len: 1374 microversion: 2.1 time: 0.513816 Oct 19 03:42:11.253622 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2847/5762] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:42:10 2022] GET /compute/v2.1/servers/a5cf37d5-2405-4ca7-b637-070a456f667f => generated 1374 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:42:11.702659 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-98ee7fda-22c3-40f6-85fe-14ec5422a599 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:42:11.703403 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-98ee7fda-22c3-40f6-85fe-14ec5422a599 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: d813bf3b-04b6-4dea-8b53-a6223779622f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:42:11.724955 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-98ee7fda-22c3-40f6-85fe-14ec5422a599 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:11.731400 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-98ee7fda-22c3-40f6-85fe-14ec5422a599 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:11.731400 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-98ee7fda-22c3-40f6-85fe-14ec5422a599 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:11.732685 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-98ee7fda-22c3-40f6-85fe-14ec5422a599 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:11.737982 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-98ee7fda-22c3-40f6-85fe-14ec5422a599 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:11.738713 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-98ee7fda-22c3-40f6-85fe-14ec5422a599 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:12.121041 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-98ee7fda-22c3-40f6-85fe-14ec5422a599 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:42:12.145549 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-98ee7fda-22c3-40f6-85fe-14ec5422a599 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/d813bf3b-04b6-4dea-8b53-a6223779622f" status: 200 len: 1511 microversion: 2.1 time: 0.443252 Oct 19 03:42:12.153675 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2916/5763] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:42:11 2022] GET /compute/v2.1/servers/d813bf3b-04b6-4dea-8b53-a6223779622f => generated 1511 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:42:12.269461 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0bcb3b72-287d-483f-845a-8e4b75eb2384 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:42:12.269461 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0bcb3b72-287d-483f-845a-8e4b75eb2384 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] [instance: a5cf37d5-2405-4ca7-b637-070a456f667f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:42:12.273487 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0bcb3b72-287d-483f-845a-8e4b75eb2384 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:12.279162 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0bcb3b72-287d-483f-845a-8e4b75eb2384 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:12.279707 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0bcb3b72-287d-483f-845a-8e4b75eb2384 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:12.280635 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0bcb3b72-287d-483f-845a-8e4b75eb2384 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:12.281170 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0bcb3b72-287d-483f-845a-8e4b75eb2384 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:12.282236 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0bcb3b72-287d-483f-845a-8e4b75eb2384 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:12.570302 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0bcb3b72-287d-483f-845a-8e4b75eb2384 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4670fd4408d4454784251a880d5a72f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf91777fa414ddaa797d735e7d2a275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:42:12.579711 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0bcb3b72-287d-483f-845a-8e4b75eb2384 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] 10.222.0.52 "GET /compute/v2.1/servers/a5cf37d5-2405-4ca7-b637-070a456f667f" status: 200 len: 1374 microversion: 2.1 time: 0.318619 Oct 19 03:42:12.580296 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2848/5764] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:42:12 2022] GET /compute/v2.1/servers/a5cf37d5-2405-4ca7-b637-070a456f667f => generated 1374 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:42:13.178035 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a57e923c-c2bb-40ad-8abe-94b76cef4c5f tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:42:13.178704 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a57e923c-c2bb-40ad-8abe-94b76cef4c5f tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: d813bf3b-04b6-4dea-8b53-a6223779622f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:42:13.186667 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a57e923c-c2bb-40ad-8abe-94b76cef4c5f tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:13.187461 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a57e923c-c2bb-40ad-8abe-94b76cef4c5f tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:13.188016 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a57e923c-c2bb-40ad-8abe-94b76cef4c5f tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:13.188945 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a57e923c-c2bb-40ad-8abe-94b76cef4c5f tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:13.193765 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a57e923c-c2bb-40ad-8abe-94b76cef4c5f tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:13.194616 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a57e923c-c2bb-40ad-8abe-94b76cef4c5f tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:13.336030 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a57e923c-c2bb-40ad-8abe-94b76cef4c5f tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:42:13.351337 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a57e923c-c2bb-40ad-8abe-94b76cef4c5f tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/d813bf3b-04b6-4dea-8b53-a6223779622f" status: 200 len: 1511 microversion: 2.1 time: 0.173415 Oct 19 03:42:13.356420 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2917/5765] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:42:13 2022] GET /compute/v2.1/servers/d813bf3b-04b6-4dea-8b53-a6223779622f => generated 1511 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:42:13.605061 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0c43db42-4d0c-4bc6-900e-2fa697331ce1 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:42:13.606349 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0c43db42-4d0c-4bc6-900e-2fa697331ce1 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] [instance: a5cf37d5-2405-4ca7-b637-070a456f667f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:42:13.614424 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0c43db42-4d0c-4bc6-900e-2fa697331ce1 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:13.614925 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0c43db42-4d0c-4bc6-900e-2fa697331ce1 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:13.615370 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0c43db42-4d0c-4bc6-900e-2fa697331ce1 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:13.616414 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0c43db42-4d0c-4bc6-900e-2fa697331ce1 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:13.617027 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0c43db42-4d0c-4bc6-900e-2fa697331ce1 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:13.617645 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0c43db42-4d0c-4bc6-900e-2fa697331ce1 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:13.792854 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0c43db42-4d0c-4bc6-900e-2fa697331ce1 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4670fd4408d4454784251a880d5a72f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf91777fa414ddaa797d735e7d2a275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:42:13.799200 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0c43db42-4d0c-4bc6-900e-2fa697331ce1 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] 10.222.0.52 "GET /compute/v2.1/servers/a5cf37d5-2405-4ca7-b637-070a456f667f" status: 200 len: 1374 microversion: 2.1 time: 0.198824 Oct 19 03:42:13.799733 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2849/5766] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:42:13 2022] GET /compute/v2.1/servers/a5cf37d5-2405-4ca7-b637-070a456f667f => generated 1374 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:42:14.380680 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-cf87421d-0d0f-4a16-a800-58585916deda tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:42:14.385867 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-cf87421d-0d0f-4a16-a800-58585916deda tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: d813bf3b-04b6-4dea-8b53-a6223779622f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:42:14.441914 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cf87421d-0d0f-4a16-a800-58585916deda tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:14.442791 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cf87421d-0d0f-4a16-a800-58585916deda tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:14.443389 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cf87421d-0d0f-4a16-a800-58585916deda tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:14.444269 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cf87421d-0d0f-4a16-a800-58585916deda tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:14.444889 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cf87421d-0d0f-4a16-a800-58585916deda tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:14.445502 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cf87421d-0d0f-4a16-a800-58585916deda tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:14.468336 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:42:14.499136 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=6 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:42:14.651242 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-cf87421d-0d0f-4a16-a800-58585916deda tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:42:14.651242 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-cf87421d-0d0f-4a16-a800-58585916deda tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/d813bf3b-04b6-4dea-8b53-a6223779622f" status: 200 len: 1511 microversion: 2.1 time: 0.272112 Oct 19 03:42:14.651242 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2918/5767] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:42:14 2022] GET /compute/v2.1/servers/d813bf3b-04b6-4dea-8b53-a6223779622f => generated 1511 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:42:14.823159 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4c955b54-3789-43d2-bae8-518ef0f71e53 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:42:14.823795 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4c955b54-3789-43d2-bae8-518ef0f71e53 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] [instance: a5cf37d5-2405-4ca7-b637-070a456f667f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:42:14.830705 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4c955b54-3789-43d2-bae8-518ef0f71e53 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:14.831198 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4c955b54-3789-43d2-bae8-518ef0f71e53 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:14.831673 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4c955b54-3789-43d2-bae8-518ef0f71e53 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:14.832374 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4c955b54-3789-43d2-bae8-518ef0f71e53 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:14.832913 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4c955b54-3789-43d2-bae8-518ef0f71e53 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:14.833355 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4c955b54-3789-43d2-bae8-518ef0f71e53 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:15.041784 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-4c955b54-3789-43d2-bae8-518ef0f71e53 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4670fd4408d4454784251a880d5a72f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf91777fa414ddaa797d735e7d2a275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:42:15.050064 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4c955b54-3789-43d2-bae8-518ef0f71e53 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] 10.222.0.52 "GET /compute/v2.1/servers/a5cf37d5-2405-4ca7-b637-070a456f667f" status: 200 len: 1374 microversion: 2.1 time: 0.231517 Oct 19 03:42:15.051347 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2850/5768] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:42:14 2022] GET /compute/v2.1/servers/a5cf37d5-2405-4ca7-b637-070a456f667f => generated 1374 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:42:15.678971 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ca84eeb6-c984-40c7-a39c-13f9739e1be0 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:42:15.679618 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ca84eeb6-c984-40c7-a39c-13f9739e1be0 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: d813bf3b-04b6-4dea-8b53-a6223779622f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:42:15.689472 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ca84eeb6-c984-40c7-a39c-13f9739e1be0 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:15.689995 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ca84eeb6-c984-40c7-a39c-13f9739e1be0 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:15.690493 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ca84eeb6-c984-40c7-a39c-13f9739e1be0 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:15.691278 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ca84eeb6-c984-40c7-a39c-13f9739e1be0 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:15.691779 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ca84eeb6-c984-40c7-a39c-13f9739e1be0 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:15.692267 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ca84eeb6-c984-40c7-a39c-13f9739e1be0 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:15.838138 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ca84eeb6-c984-40c7-a39c-13f9739e1be0 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:42:15.847997 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ca84eeb6-c984-40c7-a39c-13f9739e1be0 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/d813bf3b-04b6-4dea-8b53-a6223779622f" status: 200 len: 1511 microversion: 2.1 time: 0.173712 Oct 19 03:42:15.848898 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2919/5769] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:42:15 2022] GET /compute/v2.1/servers/d813bf3b-04b6-4dea-8b53-a6223779622f => generated 1511 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:42:16.073000 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7dde7534-ce08-4ac0-b075-1e86c2d605e5 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:42:16.074336 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7dde7534-ce08-4ac0-b075-1e86c2d605e5 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] [instance: a5cf37d5-2405-4ca7-b637-070a456f667f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:42:16.082257 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=8 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:42:16.088283 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7dde7534-ce08-4ac0-b075-1e86c2d605e5 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:16.088783 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7dde7534-ce08-4ac0-b075-1e86c2d605e5 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:16.089234 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7dde7534-ce08-4ac0-b075-1e86c2d605e5 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:16.090118 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7dde7534-ce08-4ac0-b075-1e86c2d605e5 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:16.090581 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7dde7534-ce08-4ac0-b075-1e86c2d605e5 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:16.091016 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7dde7534-ce08-4ac0-b075-1e86c2d605e5 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:16.249114 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-7dde7534-ce08-4ac0-b075-1e86c2d605e5 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4670fd4408d4454784251a880d5a72f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf91777fa414ddaa797d735e7d2a275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:42:16.256620 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7dde7534-ce08-4ac0-b075-1e86c2d605e5 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] 10.222.0.52 "GET /compute/v2.1/servers/a5cf37d5-2405-4ca7-b637-070a456f667f" status: 200 len: 1374 microversion: 2.1 time: 0.187236 Oct 19 03:42:16.281654 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2851/5770] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:42:16 2022] GET /compute/v2.1/servers/a5cf37d5-2405-4ca7-b637-070a456f667f => generated 1374 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:42:16.875159 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-228761bd-15ba-4ea5-b4b8-4431d5061a90 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:42:16.875774 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-228761bd-15ba-4ea5-b4b8-4431d5061a90 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: d813bf3b-04b6-4dea-8b53-a6223779622f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:42:16.887542 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-228761bd-15ba-4ea5-b4b8-4431d5061a90 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:16.889871 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-228761bd-15ba-4ea5-b4b8-4431d5061a90 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:16.890324 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-228761bd-15ba-4ea5-b4b8-4431d5061a90 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:16.891253 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-228761bd-15ba-4ea5-b4b8-4431d5061a90 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:16.894937 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-228761bd-15ba-4ea5-b4b8-4431d5061a90 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:16.895393 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-228761bd-15ba-4ea5-b4b8-4431d5061a90 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:17.114248 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-228761bd-15ba-4ea5-b4b8-4431d5061a90 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:42:17.122778 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-228761bd-15ba-4ea5-b4b8-4431d5061a90 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/d813bf3b-04b6-4dea-8b53-a6223779622f" status: 200 len: 1511 microversion: 2.1 time: 0.252715 Oct 19 03:42:17.125500 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2920/5771] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:42:16 2022] GET /compute/v2.1/servers/d813bf3b-04b6-4dea-8b53-a6223779622f => generated 1511 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:42:17.301569 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0269fd5c-e95d-4b68-ad71-4cb7e448225a tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:42:17.303023 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0269fd5c-e95d-4b68-ad71-4cb7e448225a tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] [instance: a5cf37d5-2405-4ca7-b637-070a456f667f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:42:17.315814 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0269fd5c-e95d-4b68-ad71-4cb7e448225a tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:17.316703 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0269fd5c-e95d-4b68-ad71-4cb7e448225a tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:17.317220 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0269fd5c-e95d-4b68-ad71-4cb7e448225a tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:17.318313 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0269fd5c-e95d-4b68-ad71-4cb7e448225a tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:17.319097 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0269fd5c-e95d-4b68-ad71-4cb7e448225a tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:17.319960 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0269fd5c-e95d-4b68-ad71-4cb7e448225a tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:17.495407 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0269fd5c-e95d-4b68-ad71-4cb7e448225a tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4670fd4408d4454784251a880d5a72f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf91777fa414ddaa797d735e7d2a275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:42:17.504016 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0269fd5c-e95d-4b68-ad71-4cb7e448225a tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] 10.222.0.52 "GET /compute/v2.1/servers/a5cf37d5-2405-4ca7-b637-070a456f667f" status: 200 len: 1374 microversion: 2.1 time: 0.208633 Oct 19 03:42:17.505103 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2852/5772] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:42:17 2022] GET /compute/v2.1/servers/a5cf37d5-2405-4ca7-b637-070a456f667f => generated 1374 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:42:17.987940 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-2af46394-10cb-4cd9-a613-67df6797ad43 req-65010b06-75dc-4312-88ed-99b53d66a9af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5cf37d5-2405-4ca7-b637-070a456f667f", "name": "network-vif-plugged", "status": "completed", "tag": "68555c4d-503f-438a-ad62-45fd83f555da"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:42:18.000073 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-2af46394-10cb-4cd9-a613-67df6797ad43 req-65010b06-75dc-4312-88ed-99b53d66a9af service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:18.000558 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-2af46394-10cb-4cd9-a613-67df6797ad43 req-65010b06-75dc-4312-88ed-99b53d66a9af service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:18.000987 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-2af46394-10cb-4cd9-a613-67df6797ad43 req-65010b06-75dc-4312-88ed-99b53d66a9af service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:18.016228 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-2af46394-10cb-4cd9-a613-67df6797ad43 req-65010b06-75dc-4312-88ed-99b53d66a9af service nova] Creating event network-vif-plugged:68555c4d-503f-438a-ad62-45fd83f555da for instance a5cf37d5-2405-4ca7-b637-070a456f667f on n-h1-861333-8 Oct 19 03:42:18.020789 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-2af46394-10cb-4cd9-a613-67df6797ad43 req-65010b06-75dc-4312-88ed-99b53d66a9af service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036566 Oct 19 03:42:18.021896 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2921/5773] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:42:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:42:18.148345 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-532f3741-ba36-449f-b9c7-316f0ff82ddb tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:42:18.152821 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-532f3741-ba36-449f-b9c7-316f0ff82ddb tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: d813bf3b-04b6-4dea-8b53-a6223779622f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:42:18.165294 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-532f3741-ba36-449f-b9c7-316f0ff82ddb tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:18.178631 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-532f3741-ba36-449f-b9c7-316f0ff82ddb tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:18.179101 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-532f3741-ba36-449f-b9c7-316f0ff82ddb tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:18.180201 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-532f3741-ba36-449f-b9c7-316f0ff82ddb tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:18.181195 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-532f3741-ba36-449f-b9c7-316f0ff82ddb tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:18.188378 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-532f3741-ba36-449f-b9c7-316f0ff82ddb tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:18.397661 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-532f3741-ba36-449f-b9c7-316f0ff82ddb tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:42:18.409276 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-532f3741-ba36-449f-b9c7-316f0ff82ddb tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/d813bf3b-04b6-4dea-8b53-a6223779622f" status: 200 len: 1511 microversion: 2.1 time: 0.266141 Oct 19 03:42:18.409905 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2853/5774] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:42:18 2022] GET /compute/v2.1/servers/d813bf3b-04b6-4dea-8b53-a6223779622f => generated 1511 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:42:18.529101 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3e4c8203-57f7-412e-ae00-555a459138ed tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:42:18.529842 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-3e4c8203-57f7-412e-ae00-555a459138ed tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] [instance: a5cf37d5-2405-4ca7-b637-070a456f667f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:42:18.546863 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3e4c8203-57f7-412e-ae00-555a459138ed tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:18.547792 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3e4c8203-57f7-412e-ae00-555a459138ed tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:18.548537 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3e4c8203-57f7-412e-ae00-555a459138ed tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:18.549564 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3e4c8203-57f7-412e-ae00-555a459138ed tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:18.551286 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3e4c8203-57f7-412e-ae00-555a459138ed tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:18.551975 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3e4c8203-57f7-412e-ae00-555a459138ed tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:18.774157 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-3e4c8203-57f7-412e-ae00-555a459138ed tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4670fd4408d4454784251a880d5a72f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf91777fa414ddaa797d735e7d2a275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:42:18.786354 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-3e4c8203-57f7-412e-ae00-555a459138ed tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] 10.222.0.52 "GET /compute/v2.1/servers/a5cf37d5-2405-4ca7-b637-070a456f667f" status: 200 len: 1374 microversion: 2.1 time: 0.262023 Oct 19 03:42:18.787180 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2922/5775] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:42:18 2022] GET /compute/v2.1/servers/a5cf37d5-2405-4ca7-b637-070a456f667f => generated 1374 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:42:19.435702 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8a580c22-e35c-43b4-9ecd-09de7029c1d5 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:42:19.436421 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8a580c22-e35c-43b4-9ecd-09de7029c1d5 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: d813bf3b-04b6-4dea-8b53-a6223779622f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:42:19.444382 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8a580c22-e35c-43b4-9ecd-09de7029c1d5 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:19.444905 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8a580c22-e35c-43b4-9ecd-09de7029c1d5 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:19.445341 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8a580c22-e35c-43b4-9ecd-09de7029c1d5 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:19.449302 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8a580c22-e35c-43b4-9ecd-09de7029c1d5 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:19.449302 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8a580c22-e35c-43b4-9ecd-09de7029c1d5 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:19.449302 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8a580c22-e35c-43b4-9ecd-09de7029c1d5 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:19.625900 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8a580c22-e35c-43b4-9ecd-09de7029c1d5 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:42:19.634355 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8a580c22-e35c-43b4-9ecd-09de7029c1d5 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/d813bf3b-04b6-4dea-8b53-a6223779622f" status: 200 len: 1511 microversion: 2.1 time: 0.202677 Oct 19 03:42:19.636168 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2854/5776] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:42:19 2022] GET /compute/v2.1/servers/d813bf3b-04b6-4dea-8b53-a6223779622f => generated 1511 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:42:19.809939 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d6743263-fc5c-485d-94cf-6b7e18e3d430 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:42:19.810502 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d6743263-fc5c-485d-94cf-6b7e18e3d430 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] [instance: a5cf37d5-2405-4ca7-b637-070a456f667f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:42:19.829794 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d6743263-fc5c-485d-94cf-6b7e18e3d430 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:19.829794 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d6743263-fc5c-485d-94cf-6b7e18e3d430 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:19.829794 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d6743263-fc5c-485d-94cf-6b7e18e3d430 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:19.829794 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d6743263-fc5c-485d-94cf-6b7e18e3d430 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:19.829794 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d6743263-fc5c-485d-94cf-6b7e18e3d430 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:19.829794 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d6743263-fc5c-485d-94cf-6b7e18e3d430 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:20.049326 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d6743263-fc5c-485d-94cf-6b7e18e3d430 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4670fd4408d4454784251a880d5a72f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf91777fa414ddaa797d735e7d2a275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:42:20.057686 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d6743263-fc5c-485d-94cf-6b7e18e3d430 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] 10.222.0.52 "GET /compute/v2.1/servers/a5cf37d5-2405-4ca7-b637-070a456f667f" status: 200 len: 1374 microversion: 2.1 time: 0.251628 Oct 19 03:42:20.058622 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2923/5777] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:42:19 2022] GET /compute/v2.1/servers/a5cf37d5-2405-4ca7-b637-070a456f667f => generated 1374 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:42:20.663739 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-80982de3-f1f1-47dd-ac6c-316a77cd971f tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:42:20.664429 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-80982de3-f1f1-47dd-ac6c-316a77cd971f tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: d813bf3b-04b6-4dea-8b53-a6223779622f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:42:20.672397 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-80982de3-f1f1-47dd-ac6c-316a77cd971f tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:20.672958 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-80982de3-f1f1-47dd-ac6c-316a77cd971f tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:20.673406 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-80982de3-f1f1-47dd-ac6c-316a77cd971f tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:20.674111 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-80982de3-f1f1-47dd-ac6c-316a77cd971f tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:20.674574 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-80982de3-f1f1-47dd-ac6c-316a77cd971f tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:20.675073 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-80982de3-f1f1-47dd-ac6c-316a77cd971f tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:20.902269 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-80982de3-f1f1-47dd-ac6c-316a77cd971f tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:42:20.928084 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-80982de3-f1f1-47dd-ac6c-316a77cd971f tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/d813bf3b-04b6-4dea-8b53-a6223779622f" status: 200 len: 1511 microversion: 2.1 time: 0.268434 Oct 19 03:42:20.930963 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2855/5778] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:42:20 2022] GET /compute/v2.1/servers/d813bf3b-04b6-4dea-8b53-a6223779622f => generated 1511 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:42:21.083374 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c6b585ae-eba7-4f90-ae21-274a216465e3 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:42:21.083374 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c6b585ae-eba7-4f90-ae21-274a216465e3 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] [instance: a5cf37d5-2405-4ca7-b637-070a456f667f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:42:21.118614 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c6b585ae-eba7-4f90-ae21-274a216465e3 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:21.122952 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c6b585ae-eba7-4f90-ae21-274a216465e3 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:21.126115 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c6b585ae-eba7-4f90-ae21-274a216465e3 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:21.126866 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c6b585ae-eba7-4f90-ae21-274a216465e3 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:21.127330 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c6b585ae-eba7-4f90-ae21-274a216465e3 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:21.128312 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c6b585ae-eba7-4f90-ae21-274a216465e3 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:21.307555 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c6b585ae-eba7-4f90-ae21-274a216465e3 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4670fd4408d4454784251a880d5a72f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf91777fa414ddaa797d735e7d2a275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:42:21.319857 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c6b585ae-eba7-4f90-ae21-274a216465e3 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] 10.222.0.52 "GET /compute/v2.1/servers/a5cf37d5-2405-4ca7-b637-070a456f667f" status: 200 len: 1546 microversion: 2.1 time: 0.243379 Oct 19 03:42:21.321455 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2924/5779] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:42:21 2022] GET /compute/v2.1/servers/a5cf37d5-2405-4ca7-b637-070a456f667f => generated 1546 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:42:21.343831 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5cc5077f-b45e-4c66-a0a7-a80552c0b4c6 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:42:21.345738 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5cc5077f-b45e-4c66-a0a7-a80552c0b4c6 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] [instance: a5cf37d5-2405-4ca7-b637-070a456f667f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:42:21.355190 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5cc5077f-b45e-4c66-a0a7-a80552c0b4c6 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:21.355710 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5cc5077f-b45e-4c66-a0a7-a80552c0b4c6 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:21.360172 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5cc5077f-b45e-4c66-a0a7-a80552c0b4c6 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:21.361011 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5cc5077f-b45e-4c66-a0a7-a80552c0b4c6 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:21.361570 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5cc5077f-b45e-4c66-a0a7-a80552c0b4c6 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:21.362003 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5cc5077f-b45e-4c66-a0a7-a80552c0b4c6 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:21.382028 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:42:21.522593 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5cc5077f-b45e-4c66-a0a7-a80552c0b4c6 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4670fd4408d4454784251a880d5a72f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf91777fa414ddaa797d735e7d2a275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:42:21.535504 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5cc5077f-b45e-4c66-a0a7-a80552c0b4c6 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] 10.222.0.52 "GET /compute/v2.1/servers/a5cf37d5-2405-4ca7-b637-070a456f667f" status: 200 len: 1546 microversion: 2.1 time: 0.195377 Oct 19 03:42:21.549396 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2856/5780] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:42:21 2022] GET /compute/v2.1/servers/a5cf37d5-2405-4ca7-b637-070a456f667f => generated 1546 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:42:21.961064 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7c609966-ed99-4dd0-a973-0076ea156164 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:42:21.962709 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7c609966-ed99-4dd0-a973-0076ea156164 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: d813bf3b-04b6-4dea-8b53-a6223779622f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:42:21.972157 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7c609966-ed99-4dd0-a973-0076ea156164 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:21.973152 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7c609966-ed99-4dd0-a973-0076ea156164 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:21.973836 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7c609966-ed99-4dd0-a973-0076ea156164 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:21.974845 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7c609966-ed99-4dd0-a973-0076ea156164 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:21.975868 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7c609966-ed99-4dd0-a973-0076ea156164 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:21.976568 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7c609966-ed99-4dd0-a973-0076ea156164 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:22.325022 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7c609966-ed99-4dd0-a973-0076ea156164 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:42:22.333453 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7c609966-ed99-4dd0-a973-0076ea156164 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/d813bf3b-04b6-4dea-8b53-a6223779622f" status: 200 len: 1511 microversion: 2.1 time: 0.384004 Oct 19 03:42:22.337898 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2925/5781] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:42:21 2022] GET /compute/v2.1/servers/d813bf3b-04b6-4dea-8b53-a6223779622f => generated 1511 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:42:23.365168 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-cd93e61c-81d7-4b46-ae9c-3705a33341b6 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:42:23.366494 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-cd93e61c-81d7-4b46-ae9c-3705a33341b6 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: d813bf3b-04b6-4dea-8b53-a6223779622f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:42:23.372442 n-d-861333-8 devstack@n-api.service[121134]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 03:42:23.372825 n-d-861333-8 devstack@n-api.service[121134]: Wed Oct 19 03:42:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d813bf3b-04b6-4dea-8b53-a6223779622f (ip 10.222.0.52) !!! Oct 19 03:42:23.378147 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cd93e61c-81d7-4b46-ae9c-3705a33341b6 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:23.378881 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cd93e61c-81d7-4b46-ae9c-3705a33341b6 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:23.379538 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cd93e61c-81d7-4b46-ae9c-3705a33341b6 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:23.380736 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cd93e61c-81d7-4b46-ae9c-3705a33341b6 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:23.381319 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cd93e61c-81d7-4b46-ae9c-3705a33341b6 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:23.381855 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cd93e61c-81d7-4b46-ae9c-3705a33341b6 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:23.623632 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-cd93e61c-81d7-4b46-ae9c-3705a33341b6 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:42:23.634612 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-cd93e61c-81d7-4b46-ae9c-3705a33341b6 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/d813bf3b-04b6-4dea-8b53-a6223779622f" status: 200 len: 1511 microversion: 2.1 time: 0.272907 Oct 19 03:42:23.638947 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2857/5782] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:42:23 2022] GET /compute/v2.1/servers/d813bf3b-04b6-4dea-8b53-a6223779622f => generated 1511 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:42:24.556743 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-34cf40a5-cd62-486f-950d-7cb20f38d12e req-1d094da4-3589-4369-9810-152eb56a5f89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5cf37d5-2405-4ca7-b637-070a456f667f", "tag": "68555c4d-503f-438a-ad62-45fd83f555da"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:42:24.577153 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-34cf40a5-cd62-486f-950d-7cb20f38d12e req-1d094da4-3589-4369-9810-152eb56a5f89 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:24.577664 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-34cf40a5-cd62-486f-950d-7cb20f38d12e req-1d094da4-3589-4369-9810-152eb56a5f89 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:24.578108 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-34cf40a5-cd62-486f-950d-7cb20f38d12e req-1d094da4-3589-4369-9810-152eb56a5f89 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:24.599696 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-34cf40a5-cd62-486f-950d-7cb20f38d12e req-1d094da4-3589-4369-9810-152eb56a5f89 service nova] Creating event network-changed:68555c4d-503f-438a-ad62-45fd83f555da for instance a5cf37d5-2405-4ca7-b637-070a456f667f on n-h1-861333-8 Oct 19 03:42:24.611620 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-34cf40a5-cd62-486f-950d-7cb20f38d12e req-1d094da4-3589-4369-9810-152eb56a5f89 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058981 Oct 19 03:42:24.616298 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2926/5783] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:42:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:42:24.674921 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-40e188e3-f477-4b22-92ad-4e19466d8a37 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:42:24.679250 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-40e188e3-f477-4b22-92ad-4e19466d8a37 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: d813bf3b-04b6-4dea-8b53-a6223779622f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:42:24.714267 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-40e188e3-f477-4b22-92ad-4e19466d8a37 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:24.714775 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-40e188e3-f477-4b22-92ad-4e19466d8a37 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:24.715228 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-40e188e3-f477-4b22-92ad-4e19466d8a37 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:24.718976 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-40e188e3-f477-4b22-92ad-4e19466d8a37 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:24.722707 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-40e188e3-f477-4b22-92ad-4e19466d8a37 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:24.724058 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-40e188e3-f477-4b22-92ad-4e19466d8a37 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:25.658008 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-40e188e3-f477-4b22-92ad-4e19466d8a37 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:42:25.666679 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-40e188e3-f477-4b22-92ad-4e19466d8a37 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/d813bf3b-04b6-4dea-8b53-a6223779622f" status: 200 len: 1511 microversion: 2.1 time: 1.005540 Oct 19 03:42:25.667483 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2858/5784] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:42:24 2022] GET /compute/v2.1/servers/d813bf3b-04b6-4dea-8b53-a6223779622f => generated 1511 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:42:26.692995 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4ef887e1-3a69-48d7-a50f-29b085910e61 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:42:26.693794 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4ef887e1-3a69-48d7-a50f-29b085910e61 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: d813bf3b-04b6-4dea-8b53-a6223779622f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:42:26.703319 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4ef887e1-3a69-48d7-a50f-29b085910e61 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:26.703913 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4ef887e1-3a69-48d7-a50f-29b085910e61 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:26.704588 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4ef887e1-3a69-48d7-a50f-29b085910e61 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:26.705700 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4ef887e1-3a69-48d7-a50f-29b085910e61 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:26.706188 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4ef887e1-3a69-48d7-a50f-29b085910e61 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:26.714029 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4ef887e1-3a69-48d7-a50f-29b085910e61 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:27.283425 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4ef887e1-3a69-48d7-a50f-29b085910e61 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:42:27.292303 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4ef887e1-3a69-48d7-a50f-29b085910e61 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/d813bf3b-04b6-4dea-8b53-a6223779622f" status: 200 len: 1511 microversion: 2.1 time: 0.603965 Oct 19 03:42:27.292887 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2927/5785] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:42:26 2022] GET /compute/v2.1/servers/d813bf3b-04b6-4dea-8b53-a6223779622f => generated 1511 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:42:28.317696 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-50d5ed71-7639-446f-8a25-42e050d17b2a tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:42:28.318621 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-50d5ed71-7639-446f-8a25-42e050d17b2a tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: d813bf3b-04b6-4dea-8b53-a6223779622f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:42:28.326962 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:42:28.332278 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-50d5ed71-7639-446f-8a25-42e050d17b2a tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:28.333484 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-50d5ed71-7639-446f-8a25-42e050d17b2a tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:28.334246 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-50d5ed71-7639-446f-8a25-42e050d17b2a tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:28.335538 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-50d5ed71-7639-446f-8a25-42e050d17b2a tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:28.336853 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-50d5ed71-7639-446f-8a25-42e050d17b2a tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:28.337504 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-50d5ed71-7639-446f-8a25-42e050d17b2a tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:28.506832 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-50d5ed71-7639-446f-8a25-42e050d17b2a tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:42:28.519866 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-50d5ed71-7639-446f-8a25-42e050d17b2a tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/d813bf3b-04b6-4dea-8b53-a6223779622f" status: 200 len: 1511 microversion: 2.1 time: 0.206414 Oct 19 03:42:28.521107 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2859/5786] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:42:28 2022] GET /compute/v2.1/servers/d813bf3b-04b6-4dea-8b53-a6223779622f => generated 1511 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:42:29.547223 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7d00cd81-8c21-4375-992a-aefdfb7ac67a tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:42:29.548247 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7d00cd81-8c21-4375-992a-aefdfb7ac67a tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: d813bf3b-04b6-4dea-8b53-a6223779622f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:42:29.562189 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7d00cd81-8c21-4375-992a-aefdfb7ac67a tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:29.562980 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7d00cd81-8c21-4375-992a-aefdfb7ac67a tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:29.563913 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7d00cd81-8c21-4375-992a-aefdfb7ac67a tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:29.565836 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7d00cd81-8c21-4375-992a-aefdfb7ac67a tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:29.569524 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7d00cd81-8c21-4375-992a-aefdfb7ac67a tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:29.569524 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7d00cd81-8c21-4375-992a-aefdfb7ac67a tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:29.736575 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7d00cd81-8c21-4375-992a-aefdfb7ac67a tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:42:29.745145 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7d00cd81-8c21-4375-992a-aefdfb7ac67a tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/d813bf3b-04b6-4dea-8b53-a6223779622f" status: 200 len: 1488 microversion: 2.1 time: 0.202766 Oct 19 03:42:29.745889 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2928/5787] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:42:29 2022] GET /compute/v2.1/servers/d813bf3b-04b6-4dea-8b53-a6223779622f => generated 1488 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:42:29.770340 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-916304f1-1cda-4638-9a49-d33ee6156b30 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:42:29.771965 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-916304f1-1cda-4638-9a49-d33ee6156b30 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: d813bf3b-04b6-4dea-8b53-a6223779622f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:42:29.780738 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-916304f1-1cda-4638-9a49-d33ee6156b30 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:29.781800 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-916304f1-1cda-4638-9a49-d33ee6156b30 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:29.782491 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-916304f1-1cda-4638-9a49-d33ee6156b30 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:29.786033 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-916304f1-1cda-4638-9a49-d33ee6156b30 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:29.786033 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-916304f1-1cda-4638-9a49-d33ee6156b30 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:29.786033 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-916304f1-1cda-4638-9a49-d33ee6156b30 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:29.821919 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-916304f1-1cda-4638-9a49-d33ee6156b30 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: d813bf3b-04b6-4dea-8b53-a6223779622f] Going to try to terminate instance {{(pid=121134) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:42:30.247597 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-916304f1-1cda-4638-9a49-d33ee6156b30 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "DELETE /compute/v2.1/servers/d813bf3b-04b6-4dea-8b53-a6223779622f" status: 204 len: 0 microversion: 2.1 time: 0.481245 Oct 19 03:42:30.250376 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2860/5788] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:42:29 2022] DELETE /compute/v2.1/servers/d813bf3b-04b6-4dea-8b53-a6223779622f => generated 0 bytes in 485 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:42:30.264837 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c0357f69-a879-4ed2-a6ca-93779ed3820e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:42:30.265792 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c0357f69-a879-4ed2-a6ca-93779ed3820e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: d813bf3b-04b6-4dea-8b53-a6223779622f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:42:30.274163 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c0357f69-a879-4ed2-a6ca-93779ed3820e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:30.274653 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c0357f69-a879-4ed2-a6ca-93779ed3820e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:30.275094 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c0357f69-a879-4ed2-a6ca-93779ed3820e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:30.275795 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c0357f69-a879-4ed2-a6ca-93779ed3820e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:30.276426 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c0357f69-a879-4ed2-a6ca-93779ed3820e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:30.277999 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c0357f69-a879-4ed2-a6ca-93779ed3820e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:30.511825 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c0357f69-a879-4ed2-a6ca-93779ed3820e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:42:30.519845 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c0357f69-a879-4ed2-a6ca-93779ed3820e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/d813bf3b-04b6-4dea-8b53-a6223779622f" status: 200 len: 1494 microversion: 2.1 time: 0.265037 Oct 19 03:42:30.520422 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2929/5789] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:42:30 2022] GET /compute/v2.1/servers/d813bf3b-04b6-4dea-8b53-a6223779622f => generated 1494 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:42:31.543715 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-031745a4-b322-4ac3-b64d-cff1d3d89aed tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:42:31.544433 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-031745a4-b322-4ac3-b64d-cff1d3d89aed tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: d813bf3b-04b6-4dea-8b53-a6223779622f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:42:31.551042 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-031745a4-b322-4ac3-b64d-cff1d3d89aed tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:31.551535 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-031745a4-b322-4ac3-b64d-cff1d3d89aed tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:31.551983 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-031745a4-b322-4ac3-b64d-cff1d3d89aed tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:31.552683 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-031745a4-b322-4ac3-b64d-cff1d3d89aed tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:31.553233 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-031745a4-b322-4ac3-b64d-cff1d3d89aed tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:31.553601 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-031745a4-b322-4ac3-b64d-cff1d3d89aed tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:31.779301 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-031745a4-b322-4ac3-b64d-cff1d3d89aed tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:42:31.788511 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-031745a4-b322-4ac3-b64d-cff1d3d89aed tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/d813bf3b-04b6-4dea-8b53-a6223779622f" status: 200 len: 1494 microversion: 2.1 time: 0.248793 Oct 19 03:42:31.789396 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2861/5790] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:42:31 2022] GET /compute/v2.1/servers/d813bf3b-04b6-4dea-8b53-a6223779622f => generated 1494 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:42:32.719812 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-67604324-4e28-4d6c-870c-6f4e30d9309c req-604fb430-dbe7-459a-b548-64c91134d9d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d813bf3b-04b6-4dea-8b53-a6223779622f", "name": "network-vif-deleted", "tag": "fcddfc18-18d4-4fc4-8616-b6cc9c2f79b7"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:42:32.742013 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-67604324-4e28-4d6c-870c-6f4e30d9309c req-604fb430-dbe7-459a-b548-64c91134d9d8 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:32.743347 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-67604324-4e28-4d6c-870c-6f4e30d9309c req-604fb430-dbe7-459a-b548-64c91134d9d8 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:32.743937 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-67604324-4e28-4d6c-870c-6f4e30d9309c req-604fb430-dbe7-459a-b548-64c91134d9d8 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:32.769925 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=100 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:42:32.772137 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-67604324-4e28-4d6c-870c-6f4e30d9309c req-604fb430-dbe7-459a-b548-64c91134d9d8 service nova] Creating event network-vif-deleted:fcddfc18-18d4-4fc4-8616-b6cc9c2f79b7 for instance d813bf3b-04b6-4dea-8b53-a6223779622f on n-h2-861333-8 Oct 19 03:42:32.793400 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-67604324-4e28-4d6c-870c-6f4e30d9309c req-604fb430-dbe7-459a-b548-64c91134d9d8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078362 Oct 19 03:42:32.794030 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2930/5791] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:42:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:42:32.819199 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d51f787e-66dd-4838-a326-1c292b10625e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:42:32.819199 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d51f787e-66dd-4838-a326-1c292b10625e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: d813bf3b-04b6-4dea-8b53-a6223779622f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:42:32.833445 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d51f787e-66dd-4838-a326-1c292b10625e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:32.833945 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d51f787e-66dd-4838-a326-1c292b10625e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:32.834384 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d51f787e-66dd-4838-a326-1c292b10625e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:32.835093 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d51f787e-66dd-4838-a326-1c292b10625e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:32.835748 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d51f787e-66dd-4838-a326-1c292b10625e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:32.836393 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d51f787e-66dd-4838-a326-1c292b10625e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:32.953888 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d51f787e-66dd-4838-a326-1c292b10625e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:42:32.963340 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d51f787e-66dd-4838-a326-1c292b10625e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/d813bf3b-04b6-4dea-8b53-a6223779622f" status: 200 len: 1452 microversion: 2.1 time: 0.152453 Oct 19 03:42:32.963953 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2862/5792] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:42:32 2022] GET /compute/v2.1/servers/d813bf3b-04b6-4dea-8b53-a6223779622f => generated 1452 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:42:33.996908 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-adc42623-e19f-43f3-976b-ea9b02f01058 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:42:33.997511 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-adc42623-e19f-43f3-976b-ea9b02f01058 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: d813bf3b-04b6-4dea-8b53-a6223779622f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:42:34.006664 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-adc42623-e19f-43f3-976b-ea9b02f01058 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:34.007420 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-adc42623-e19f-43f3-976b-ea9b02f01058 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:34.008851 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-adc42623-e19f-43f3-976b-ea9b02f01058 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:34.018048 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-adc42623-e19f-43f3-976b-ea9b02f01058 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:34.018048 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-adc42623-e19f-43f3-976b-ea9b02f01058 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:34.018048 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-adc42623-e19f-43f3-976b-ea9b02f01058 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:34.029269 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-adc42623-e19f-43f3-976b-ea9b02f01058 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] HTTP exception thrown: Instance d813bf3b-04b6-4dea-8b53-a6223779622f could not be found. Oct 19 03:42:34.031513 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-adc42623-e19f-43f3-976b-ea9b02f01058 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Request method failure captured: Oct 19 03:42:34.031513 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/d813bf3b-04b6-4dea-8b53-a6223779622f HTTP/1.1 Oct 19 03:42:34.031513 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:42:34.031513 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:42:34.031513 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:42:34.031513 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:42:34.031513 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:42:34.031513 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:42:34.031513 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:42:34.031513 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:42:34.031513 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT3ER8Vi4kdm7o4uGCDWtKZWQ50YHYh4kO6eywBcR15sWt_VOUdg3SdiEQ00NlpD4-_UkP7cbx60NOPjR2_ogmh3qtcCqHFYMrk6ithnKX7Frq8eCjVqAngAFsiOR8FhKAXItaxrviXq7LiRs8ykPsJTrY1v2OiG3mT4ycQKs5qNWF0I Oct 19 03:42:34.031513 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:42:34.031513 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:42:34.031513 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:42:34.031513 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:42:34.031513 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:42:34.031513 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:42:34.031513 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 224417be63ba4c679b0256a27fb9f104 Oct 19 03:42:34.031513 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-DeleteServersTestJSON-1651632054 Oct 19 03:42:34.031513 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:42:34.031513 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:42:34.031513 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/224417be63ba4c679b0256a27fb9f104"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/224417be63ba4c679b0256a27fb9f104"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/224417be63ba4c679b0256a27fb9f104"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_224417be63ba4c679b0256a27fb9f104", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:42:34.031513 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-DeleteServersTestJSON-1651632054 Oct 19 03:42:34.031513 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 224417be63ba4c679b0256a27fb9f104 Oct 19 03:42:34.031513 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-DeleteServersTestJSON-1651632054 Oct 19 03:42:34.031513 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-DeleteServersTestJSON-1651632054-project Oct 19 03:42:34.031513 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:42:34.031513 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:42:34.031513 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: d099c5070710485f83d528d3d2bb1c71 Oct 19 03:42:34.031513 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-DeleteServersTestJSON-1651632054-project Oct 19 03:42:34.031513 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:42:34.031513 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance d813bf3b-04b6-4dea-8b53-a6223779622f could not be found. Oct 19 03:42:34.031513 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': 'd813bf3b-04b6-4dea-8b53-a6223779622f'} Oct 19 03:42:34.031513 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:42:34.031513 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:42:34.031513 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:42:34.031513 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:42:34.031513 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:42:34.031513 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:42:34.031513 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:42:34.031513 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:42:34.031513 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:42:34.031513 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:42:34.031513 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d813bf3b-04b6-4dea-8b53-a6223779622f could not be found. Oct 19 03:42:34.031513 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:42:34.031513 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:42:34.031513 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:42:34.031513 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:42:34.031513 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:42:34.031513 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:42:34.031513 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:42:34.031513 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:42:34.031513 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:42:34.031513 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:42:34.031513 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:42:34.031513 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:42:34.031513 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:42:34.031513 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:42:34.031513 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:42:34.031513 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:42:34.031513 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d813bf3b-04b6-4dea-8b53-a6223779622f could not be found. Oct 19 03:42:34.031513 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:42:34.031513 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:42:34.031513 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:42:34.039195 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:42:34.039195 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:42:34.039195 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:42:34.039195 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:42:34.039195 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:42:34.039195 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d813bf3b-04b6-4dea-8b53-a6223779622f could not be found. Oct 19 03:42:34.039195 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:42:34.039195 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-adc42623-e19f-43f3-976b-ea9b02f01058 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Returning 404 to user: Instance d813bf3b-04b6-4dea-8b53-a6223779622f could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:42:34.039195 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-adc42623-e19f-43f3-976b-ea9b02f01058 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/d813bf3b-04b6-4dea-8b53-a6223779622f" status: 404 len: 111 microversion: 2.1 time: 0.046545 Oct 19 03:42:34.039195 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2931/5793] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:42:33 2022] GET /compute/v2.1/servers/d813bf3b-04b6-4dea-8b53-a6223779622f => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:42:34.239923 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b7a8d266-495c-44c8-bc61-eb13c053adcb tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1302485775", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "networks": [{"uuid": "c7fc46f7-f975-4fb5-83e4-9e9303a4a241"}]}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:42:34.304638 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-b7a8d266-495c-44c8-bc61-eb13c053adcb tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] validate_networks() for [('c7fc46f7-f975-4fb5-83e4-9e9303a4a241', None, None, None, None, None)] {{(pid=121134) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:42:34.761409 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-b7a8d266-495c-44c8-bc61-eb13c053adcb tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Flavor limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:42:34.761828 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-b7a8d266-495c-44c8-bc61-eb13c053adcb tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Image limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:42:34.762307 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-b7a8d266-495c-44c8-bc61-eb13c053adcb tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Flavor pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:42:34.762932 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-b7a8d266-495c-44c8-bc61-eb13c053adcb tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Image pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:42:34.763483 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-b7a8d266-495c-44c8-bc61-eb13c053adcb tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:42:34.772485 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b7a8d266-495c-44c8-bc61-eb13c053adcb tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:34.773945 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b7a8d266-495c-44c8-bc61-eb13c053adcb tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:34.773945 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b7a8d266-495c-44c8-bc61-eb13c053adcb tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:34.774815 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b7a8d266-495c-44c8-bc61-eb13c053adcb tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:34.775273 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b7a8d266-495c-44c8-bc61-eb13c053adcb tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:34.775704 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b7a8d266-495c-44c8-bc61-eb13c053adcb tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:34.793327 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-b7a8d266-495c-44c8-bc61-eb13c053adcb tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Getting quotas for project 224417be63ba4c679b0256a27fb9f104. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:42:34.798704 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-b7a8d266-495c-44c8-bc61-eb13c053adcb tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Getting quotas for user d099c5070710485f83d528d3d2bb1c71 and project 224417be63ba4c679b0256a27fb9f104. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:42:34.811185 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b7a8d266-495c-44c8-bc61-eb13c053adcb tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Going to run 1 instances... {{(pid=121134) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:42:34.813723 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b7a8d266-495c-44c8-bc61-eb13c053adcb tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 73dec0f6-f5c6-494e-834f-90bbcd4e22ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:42:34.943354 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b7a8d266-495c-44c8-bc61-eb13c053adcb tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.707214 Oct 19 03:42:34.944459 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2863/5794] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:42:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 709 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 03:42:34.956592 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-391833e2-ac73-4699-b73a-98be847a288d tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:42:34.959183 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-391833e2-ac73-4699-b73a-98be847a288d tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 73dec0f6-f5c6-494e-834f-90bbcd4e22ad] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:42:35.022630 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-391833e2-ac73-4699-b73a-98be847a288d tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:42:35.033174 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-391833e2-ac73-4699-b73a-98be847a288d tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/73dec0f6-f5c6-494e-834f-90bbcd4e22ad" status: 200 len: 1215 microversion: 2.1 time: 0.080711 Oct 19 03:42:35.034167 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2932/5795] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:42:34 2022] GET /compute/v2.1/servers/73dec0f6-f5c6-494e-834f-90bbcd4e22ad => generated 1215 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:42:36.063318 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-673708b7-2417-4f89-98a6-2ff592af0d2f tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:42:36.063938 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-673708b7-2417-4f89-98a6-2ff592af0d2f tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 73dec0f6-f5c6-494e-834f-90bbcd4e22ad] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:42:36.083002 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-673708b7-2417-4f89-98a6-2ff592af0d2f tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:36.089503 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-673708b7-2417-4f89-98a6-2ff592af0d2f tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:36.090287 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-673708b7-2417-4f89-98a6-2ff592af0d2f tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:36.091258 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-673708b7-2417-4f89-98a6-2ff592af0d2f tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:36.091884 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-673708b7-2417-4f89-98a6-2ff592af0d2f tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:36.092468 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-673708b7-2417-4f89-98a6-2ff592af0d2f tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:36.181516 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-673708b7-2417-4f89-98a6-2ff592af0d2f tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:42:36.189637 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-673708b7-2417-4f89-98a6-2ff592af0d2f tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/73dec0f6-f5c6-494e-834f-90bbcd4e22ad" status: 200 len: 1219 microversion: 2.1 time: 0.131513 Oct 19 03:42:36.190844 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2864/5796] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:42:36 2022] GET /compute/v2.1/servers/73dec0f6-f5c6-494e-834f-90bbcd4e22ad => generated 1219 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:42:37.222552 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a70a827c-3602-4459-b991-e4b5973930c7 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:42:37.223954 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a70a827c-3602-4459-b991-e4b5973930c7 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 73dec0f6-f5c6-494e-834f-90bbcd4e22ad] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:42:37.232429 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a70a827c-3602-4459-b991-e4b5973930c7 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:37.234527 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a70a827c-3602-4459-b991-e4b5973930c7 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:37.234527 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a70a827c-3602-4459-b991-e4b5973930c7 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:37.234527 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a70a827c-3602-4459-b991-e4b5973930c7 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:37.235730 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a70a827c-3602-4459-b991-e4b5973930c7 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:37.236554 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a70a827c-3602-4459-b991-e4b5973930c7 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:37.331697 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a70a827c-3602-4459-b991-e4b5973930c7 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:42:37.341022 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a70a827c-3602-4459-b991-e4b5973930c7 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/73dec0f6-f5c6-494e-834f-90bbcd4e22ad" status: 200 len: 1267 microversion: 2.1 time: 0.131257 Oct 19 03:42:37.341948 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2933/5797] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:42:37 2022] GET /compute/v2.1/servers/73dec0f6-f5c6-494e-834f-90bbcd4e22ad => generated 1267 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:42:38.364261 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-bf68a0b5-e332-4d44-a7a0-34be5a6d05ab tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:42:38.364878 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-bf68a0b5-e332-4d44-a7a0-34be5a6d05ab tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 73dec0f6-f5c6-494e-834f-90bbcd4e22ad] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:42:38.371255 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bf68a0b5-e332-4d44-a7a0-34be5a6d05ab tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:38.376480 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bf68a0b5-e332-4d44-a7a0-34be5a6d05ab tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:38.377111 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bf68a0b5-e332-4d44-a7a0-34be5a6d05ab tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:38.378029 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bf68a0b5-e332-4d44-a7a0-34be5a6d05ab tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:38.382298 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bf68a0b5-e332-4d44-a7a0-34be5a6d05ab tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:38.383435 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bf68a0b5-e332-4d44-a7a0-34be5a6d05ab tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:38.724652 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-bf68a0b5-e332-4d44-a7a0-34be5a6d05ab tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:42:38.733200 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-bf68a0b5-e332-4d44-a7a0-34be5a6d05ab tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/73dec0f6-f5c6-494e-834f-90bbcd4e22ad" status: 200 len: 1315 microversion: 2.1 time: 0.372804 Oct 19 03:42:38.750254 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2865/5798] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:42:38 2022] GET /compute/v2.1/servers/73dec0f6-f5c6-494e-834f-90bbcd4e22ad => generated 1315 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:42:39.759555 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0d954497-9721-46ea-83fc-ff804f7acfc3 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:42:39.760320 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0d954497-9721-46ea-83fc-ff804f7acfc3 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 73dec0f6-f5c6-494e-834f-90bbcd4e22ad] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:42:39.766845 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0d954497-9721-46ea-83fc-ff804f7acfc3 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:39.767346 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0d954497-9721-46ea-83fc-ff804f7acfc3 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:39.767773 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0d954497-9721-46ea-83fc-ff804f7acfc3 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:39.768548 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0d954497-9721-46ea-83fc-ff804f7acfc3 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:39.769004 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0d954497-9721-46ea-83fc-ff804f7acfc3 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:39.769474 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0d954497-9721-46ea-83fc-ff804f7acfc3 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:39.868901 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-422c43a2-1911-47a7-8bc9-ddf8a51d0651 req-8cdb32df-20fb-4a16-bf17-229b5f3a029b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73dec0f6-f5c6-494e-834f-90bbcd4e22ad", "tag": "f6b7cace-1769-4b9c-ad7b-c22ebb3a4fb5"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:42:39.879951 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-422c43a2-1911-47a7-8bc9-ddf8a51d0651 req-8cdb32df-20fb-4a16-bf17-229b5f3a029b service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:39.882118 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-422c43a2-1911-47a7-8bc9-ddf8a51d0651 req-8cdb32df-20fb-4a16-bf17-229b5f3a029b service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:39.882118 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-422c43a2-1911-47a7-8bc9-ddf8a51d0651 req-8cdb32df-20fb-4a16-bf17-229b5f3a029b service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:39.892724 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-422c43a2-1911-47a7-8bc9-ddf8a51d0651 req-8cdb32df-20fb-4a16-bf17-229b5f3a029b service nova] Creating event network-changed:f6b7cace-1769-4b9c-ad7b-c22ebb3a4fb5 for instance 73dec0f6-f5c6-494e-834f-90bbcd4e22ad on n-h2-861333-8 Oct 19 03:42:39.899368 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-422c43a2-1911-47a7-8bc9-ddf8a51d0651 req-8cdb32df-20fb-4a16-bf17-229b5f3a029b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034850 Oct 19 03:42:39.899975 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2866/5799] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:42:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:42:40.022908 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-0d954497-9721-46ea-83fc-ff804f7acfc3 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:42:40.034836 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0d954497-9721-46ea-83fc-ff804f7acfc3 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/73dec0f6-f5c6-494e-834f-90bbcd4e22ad" status: 200 len: 1315 microversion: 2.1 time: 0.280299 Oct 19 03:42:40.068461 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2934/5800] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:42:39 2022] GET /compute/v2.1/servers/73dec0f6-f5c6-494e-834f-90bbcd4e22ad => generated 1315 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:42:41.101612 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-638ce48a-d45a-4b53-a01a-a1ae3dc1083f tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:42:41.103165 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-638ce48a-d45a-4b53-a01a-a1ae3dc1083f tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 73dec0f6-f5c6-494e-834f-90bbcd4e22ad] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:42:41.113149 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-638ce48a-d45a-4b53-a01a-a1ae3dc1083f tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:41.123053 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-638ce48a-d45a-4b53-a01a-a1ae3dc1083f tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:41.123529 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-638ce48a-d45a-4b53-a01a-a1ae3dc1083f tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:41.124395 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-638ce48a-d45a-4b53-a01a-a1ae3dc1083f tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:41.124912 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-638ce48a-d45a-4b53-a01a-a1ae3dc1083f tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:41.125302 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-638ce48a-d45a-4b53-a01a-a1ae3dc1083f tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:41.400852 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-638ce48a-d45a-4b53-a01a-a1ae3dc1083f tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:42:41.411383 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-638ce48a-d45a-4b53-a01a-a1ae3dc1083f tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/73dec0f6-f5c6-494e-834f-90bbcd4e22ad" status: 200 len: 1315 microversion: 2.1 time: 0.315857 Oct 19 03:42:41.412669 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2867/5801] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:42:41 2022] GET /compute/v2.1/servers/73dec0f6-f5c6-494e-834f-90bbcd4e22ad => generated 1315 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:42:42.439912 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-696fb274-2564-402c-8cfe-3c299ba4be93 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:42:42.439912 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-696fb274-2564-402c-8cfe-3c299ba4be93 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 73dec0f6-f5c6-494e-834f-90bbcd4e22ad] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:42:42.439912 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=44 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:42:42.443227 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-696fb274-2564-402c-8cfe-3c299ba4be93 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:42.443721 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-696fb274-2564-402c-8cfe-3c299ba4be93 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:42.444175 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-696fb274-2564-402c-8cfe-3c299ba4be93 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:42.444878 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-696fb274-2564-402c-8cfe-3c299ba4be93 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:42.445339 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-696fb274-2564-402c-8cfe-3c299ba4be93 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:42.445800 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-696fb274-2564-402c-8cfe-3c299ba4be93 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:42.599317 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-696fb274-2564-402c-8cfe-3c299ba4be93 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:42:42.705480 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-696fb274-2564-402c-8cfe-3c299ba4be93 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/73dec0f6-f5c6-494e-834f-90bbcd4e22ad" status: 200 len: 1315 microversion: 2.1 time: 0.274254 Oct 19 03:42:42.705999 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2935/5802] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:42:42 2022] GET /compute/v2.1/servers/73dec0f6-f5c6-494e-834f-90bbcd4e22ad => generated 1315 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:42:43.729349 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-72feb555-e76f-4e0a-907e-83640cf51a7b tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:42:43.730009 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-72feb555-e76f-4e0a-907e-83640cf51a7b tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 73dec0f6-f5c6-494e-834f-90bbcd4e22ad] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:42:43.737220 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-72feb555-e76f-4e0a-907e-83640cf51a7b tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:43.738046 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-72feb555-e76f-4e0a-907e-83640cf51a7b tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:43.738501 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-72feb555-e76f-4e0a-907e-83640cf51a7b tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:43.739215 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-72feb555-e76f-4e0a-907e-83640cf51a7b tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:43.739726 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-72feb555-e76f-4e0a-907e-83640cf51a7b tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:43.740087 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-72feb555-e76f-4e0a-907e-83640cf51a7b tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:43.934804 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-72feb555-e76f-4e0a-907e-83640cf51a7b tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:42:43.945293 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-72feb555-e76f-4e0a-907e-83640cf51a7b tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/73dec0f6-f5c6-494e-834f-90bbcd4e22ad" status: 200 len: 1315 microversion: 2.1 time: 0.220819 Oct 19 03:42:43.949783 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2868/5803] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:42:43 2022] GET /compute/v2.1/servers/73dec0f6-f5c6-494e-834f-90bbcd4e22ad => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:42:44.971148 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2c8f02b6-8816-4441-90ee-d2cce90ac82b tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:42:44.971779 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-2c8f02b6-8816-4441-90ee-d2cce90ac82b tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 73dec0f6-f5c6-494e-834f-90bbcd4e22ad] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:42:44.981415 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2c8f02b6-8816-4441-90ee-d2cce90ac82b tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:44.981864 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2c8f02b6-8816-4441-90ee-d2cce90ac82b tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:44.982309 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2c8f02b6-8816-4441-90ee-d2cce90ac82b tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:44.983018 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2c8f02b6-8816-4441-90ee-d2cce90ac82b tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:44.983478 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2c8f02b6-8816-4441-90ee-d2cce90ac82b tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:44.983909 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2c8f02b6-8816-4441-90ee-d2cce90ac82b tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:45.055667 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:42:45.190228 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-2c8f02b6-8816-4441-90ee-d2cce90ac82b tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:42:45.199001 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2c8f02b6-8816-4441-90ee-d2cce90ac82b tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/73dec0f6-f5c6-494e-834f-90bbcd4e22ad" status: 200 len: 1315 microversion: 2.1 time: 0.231744 Oct 19 03:42:45.205046 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2936/5804] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:42:44 2022] GET /compute/v2.1/servers/73dec0f6-f5c6-494e-834f-90bbcd4e22ad => generated 1315 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:42:46.222230 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6c8d119c-db41-4216-8607-829b2706b881 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:42:46.222871 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6c8d119c-db41-4216-8607-829b2706b881 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 73dec0f6-f5c6-494e-834f-90bbcd4e22ad] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:42:46.229038 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:42:46.229735 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=6 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:42:46.231323 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6c8d119c-db41-4216-8607-829b2706b881 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:46.231814 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6c8d119c-db41-4216-8607-829b2706b881 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:46.232255 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6c8d119c-db41-4216-8607-829b2706b881 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:46.232956 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6c8d119c-db41-4216-8607-829b2706b881 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:46.233464 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6c8d119c-db41-4216-8607-829b2706b881 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:46.233864 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6c8d119c-db41-4216-8607-829b2706b881 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:46.400936 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-6c8d119c-db41-4216-8607-829b2706b881 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:42:46.411719 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6c8d119c-db41-4216-8607-829b2706b881 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/73dec0f6-f5c6-494e-834f-90bbcd4e22ad" status: 200 len: 1315 microversion: 2.1 time: 0.193305 Oct 19 03:42:46.412799 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2869/5805] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:42:46 2022] GET /compute/v2.1/servers/73dec0f6-f5c6-494e-834f-90bbcd4e22ad => generated 1315 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:42:46.706206 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-7347a0cc-17de-44e5-b23c-76e23cd0fbe4 req-69151ce4-9722-4354-8221-019901c28af1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73dec0f6-f5c6-494e-834f-90bbcd4e22ad", "name": "network-vif-plugged", "status": "completed", "tag": "f6b7cace-1769-4b9c-ad7b-c22ebb3a4fb5"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:42:46.719898 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-7347a0cc-17de-44e5-b23c-76e23cd0fbe4 req-69151ce4-9722-4354-8221-019901c28af1 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:46.724001 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-7347a0cc-17de-44e5-b23c-76e23cd0fbe4 req-69151ce4-9722-4354-8221-019901c28af1 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:46.724001 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-7347a0cc-17de-44e5-b23c-76e23cd0fbe4 req-69151ce4-9722-4354-8221-019901c28af1 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:46.733189 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-7347a0cc-17de-44e5-b23c-76e23cd0fbe4 req-69151ce4-9722-4354-8221-019901c28af1 service nova] Creating event network-vif-plugged:f6b7cace-1769-4b9c-ad7b-c22ebb3a4fb5 for instance 73dec0f6-f5c6-494e-834f-90bbcd4e22ad on n-h2-861333-8 Oct 19 03:42:46.738930 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-7347a0cc-17de-44e5-b23c-76e23cd0fbe4 req-69151ce4-9722-4354-8221-019901c28af1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036405 Oct 19 03:42:46.740020 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2937/5806] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:42:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:42:47.436339 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-460aafa1-d5f3-4eed-b8bb-beba8f4b956e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:42:47.437834 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-460aafa1-d5f3-4eed-b8bb-beba8f4b956e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 73dec0f6-f5c6-494e-834f-90bbcd4e22ad] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:42:47.447602 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-460aafa1-d5f3-4eed-b8bb-beba8f4b956e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:47.448369 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-460aafa1-d5f3-4eed-b8bb-beba8f4b956e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:47.449007 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-460aafa1-d5f3-4eed-b8bb-beba8f4b956e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:47.450771 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-460aafa1-d5f3-4eed-b8bb-beba8f4b956e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:47.450771 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-460aafa1-d5f3-4eed-b8bb-beba8f4b956e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:47.451322 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-460aafa1-d5f3-4eed-b8bb-beba8f4b956e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:47.638803 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-460aafa1-d5f3-4eed-b8bb-beba8f4b956e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:42:47.647395 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-460aafa1-d5f3-4eed-b8bb-beba8f4b956e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/73dec0f6-f5c6-494e-834f-90bbcd4e22ad" status: 200 len: 1315 microversion: 2.1 time: 0.215420 Oct 19 03:42:47.648174 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2870/5807] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:42:47 2022] GET /compute/v2.1/servers/73dec0f6-f5c6-494e-834f-90bbcd4e22ad => generated 1315 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:42:48.673920 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e5c39e65-4b1a-483a-a756-0dd95f6139d8 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:42:48.674622 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e5c39e65-4b1a-483a-a756-0dd95f6139d8 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 73dec0f6-f5c6-494e-834f-90bbcd4e22ad] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:42:48.681298 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e5c39e65-4b1a-483a-a756-0dd95f6139d8 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:48.681822 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e5c39e65-4b1a-483a-a756-0dd95f6139d8 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:48.683604 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e5c39e65-4b1a-483a-a756-0dd95f6139d8 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:48.683604 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e5c39e65-4b1a-483a-a756-0dd95f6139d8 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:48.683604 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e5c39e65-4b1a-483a-a756-0dd95f6139d8 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:48.683933 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e5c39e65-4b1a-483a-a756-0dd95f6139d8 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:48.829697 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-e5c39e65-4b1a-483a-a756-0dd95f6139d8 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:42:48.838421 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e5c39e65-4b1a-483a-a756-0dd95f6139d8 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/73dec0f6-f5c6-494e-834f-90bbcd4e22ad" status: 200 len: 1502 microversion: 2.1 time: 0.169621 Oct 19 03:42:48.839131 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2938/5808] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:42:48 2022] GET /compute/v2.1/servers/73dec0f6-f5c6-494e-834f-90bbcd4e22ad => generated 1502 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:42:48.860955 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3fec08b1-4d73-425a-af6a-b4a35a877898 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:42:48.861637 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3fec08b1-4d73-425a-af6a-b4a35a877898 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 73dec0f6-f5c6-494e-834f-90bbcd4e22ad] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:42:48.868501 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3fec08b1-4d73-425a-af6a-b4a35a877898 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:48.869068 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3fec08b1-4d73-425a-af6a-b4a35a877898 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:48.869573 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3fec08b1-4d73-425a-af6a-b4a35a877898 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:48.870272 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3fec08b1-4d73-425a-af6a-b4a35a877898 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:48.870727 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3fec08b1-4d73-425a-af6a-b4a35a877898 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:48.871162 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3fec08b1-4d73-425a-af6a-b4a35a877898 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:48.895386 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-3fec08b1-4d73-425a-af6a-b4a35a877898 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lazy-loading 'flavor' on Instance uuid 73dec0f6-f5c6-494e-834f-90bbcd4e22ad {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:42:49.033000 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:42:49.176425 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3fec08b1-4d73-425a-af6a-b4a35a877898 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "POST /compute/v2.1/servers/73dec0f6-f5c6-494e-834f-90bbcd4e22ad/action" status: 202 len: 0 microversion: 2.1 time: 0.319229 Oct 19 03:42:49.183339 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2871/5809] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:42:48 2022] POST /compute/v2.1/servers/73dec0f6-f5c6-494e-834f-90bbcd4e22ad/action => generated 0 bytes in 324 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:42:49.189040 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-45ce01dd-da7f-49ee-a550-99b7d05bc795 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:42:49.189833 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-45ce01dd-da7f-49ee-a550-99b7d05bc795 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 73dec0f6-f5c6-494e-834f-90bbcd4e22ad] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:42:49.198073 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-45ce01dd-da7f-49ee-a550-99b7d05bc795 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:49.199354 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-45ce01dd-da7f-49ee-a550-99b7d05bc795 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:49.200371 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-45ce01dd-da7f-49ee-a550-99b7d05bc795 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:49.201237 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-45ce01dd-da7f-49ee-a550-99b7d05bc795 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:49.201862 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-45ce01dd-da7f-49ee-a550-99b7d05bc795 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:49.202437 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-45ce01dd-da7f-49ee-a550-99b7d05bc795 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:49.367898 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-45ce01dd-da7f-49ee-a550-99b7d05bc795 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:42:49.376110 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-45ce01dd-da7f-49ee-a550-99b7d05bc795 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/73dec0f6-f5c6-494e-834f-90bbcd4e22ad" status: 200 len: 1510 microversion: 2.1 time: 0.191305 Oct 19 03:42:49.377775 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2939/5810] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:42:49 2022] GET /compute/v2.1/servers/73dec0f6-f5c6-494e-834f-90bbcd4e22ad => generated 1510 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:42:50.409906 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a82007e2-0403-482b-a85a-87e405ffe82d tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:42:50.410683 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a82007e2-0403-482b-a85a-87e405ffe82d tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 73dec0f6-f5c6-494e-834f-90bbcd4e22ad] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:42:50.417723 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a82007e2-0403-482b-a85a-87e405ffe82d tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:50.418281 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a82007e2-0403-482b-a85a-87e405ffe82d tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:50.418793 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a82007e2-0403-482b-a85a-87e405ffe82d tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:50.419561 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a82007e2-0403-482b-a85a-87e405ffe82d tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:50.420136 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a82007e2-0403-482b-a85a-87e405ffe82d tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:50.420767 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a82007e2-0403-482b-a85a-87e405ffe82d tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:50.582216 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a82007e2-0403-482b-a85a-87e405ffe82d tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:42:50.591020 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a82007e2-0403-482b-a85a-87e405ffe82d tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/73dec0f6-f5c6-494e-834f-90bbcd4e22ad" status: 200 len: 1493 microversion: 2.1 time: 0.189535 Oct 19 03:42:50.591703 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2872/5811] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:42:50 2022] GET /compute/v2.1/servers/73dec0f6-f5c6-494e-834f-90bbcd4e22ad => generated 1493 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:42:50.613987 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0b11c71f-42dc-405f-b847-3845dc0d20cd tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:42:50.614615 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0b11c71f-42dc-405f-b847-3845dc0d20cd tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 73dec0f6-f5c6-494e-834f-90bbcd4e22ad] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:42:50.622133 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0b11c71f-42dc-405f-b847-3845dc0d20cd tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:50.622627 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0b11c71f-42dc-405f-b847-3845dc0d20cd tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:50.623078 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0b11c71f-42dc-405f-b847-3845dc0d20cd tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:50.623797 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0b11c71f-42dc-405f-b847-3845dc0d20cd tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:50.624292 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0b11c71f-42dc-405f-b847-3845dc0d20cd tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:50.624751 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0b11c71f-42dc-405f-b847-3845dc0d20cd tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:50.653412 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0b11c71f-42dc-405f-b847-3845dc0d20cd tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 73dec0f6-f5c6-494e-834f-90bbcd4e22ad] Going to try to terminate instance {{(pid=121135) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:42:51.028579 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0b11c71f-42dc-405f-b847-3845dc0d20cd tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "DELETE /compute/v2.1/servers/73dec0f6-f5c6-494e-834f-90bbcd4e22ad" status: 204 len: 0 microversion: 2.1 time: 0.419211 Oct 19 03:42:51.034868 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2940/5812] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:42:50 2022] DELETE /compute/v2.1/servers/73dec0f6-f5c6-494e-834f-90bbcd4e22ad => generated 0 bytes in 421 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:42:51.037661 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5fe25878-4103-48d0-b3e4-f6e063dca8b5 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:42:51.038385 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5fe25878-4103-48d0-b3e4-f6e063dca8b5 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 73dec0f6-f5c6-494e-834f-90bbcd4e22ad] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:42:51.044375 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5fe25878-4103-48d0-b3e4-f6e063dca8b5 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:51.044865 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5fe25878-4103-48d0-b3e4-f6e063dca8b5 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:51.045330 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5fe25878-4103-48d0-b3e4-f6e063dca8b5 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:51.046062 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5fe25878-4103-48d0-b3e4-f6e063dca8b5 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:51.046520 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5fe25878-4103-48d0-b3e4-f6e063dca8b5 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:51.046947 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5fe25878-4103-48d0-b3e4-f6e063dca8b5 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:51.196036 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5fe25878-4103-48d0-b3e4-f6e063dca8b5 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:42:51.203914 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5fe25878-4103-48d0-b3e4-f6e063dca8b5 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/73dec0f6-f5c6-494e-834f-90bbcd4e22ad" status: 200 len: 1499 microversion: 2.1 time: 0.170193 Oct 19 03:42:51.204529 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2873/5813] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:42:51 2022] GET /compute/v2.1/servers/73dec0f6-f5c6-494e-834f-90bbcd4e22ad => generated 1499 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:42:52.232071 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6ca77771-42cb-4168-a170-90d44b8b9421 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:42:52.232071 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6ca77771-42cb-4168-a170-90d44b8b9421 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 73dec0f6-f5c6-494e-834f-90bbcd4e22ad] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:42:52.235465 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6ca77771-42cb-4168-a170-90d44b8b9421 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:52.235954 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6ca77771-42cb-4168-a170-90d44b8b9421 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:52.236396 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6ca77771-42cb-4168-a170-90d44b8b9421 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:52.237090 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6ca77771-42cb-4168-a170-90d44b8b9421 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:52.237586 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6ca77771-42cb-4168-a170-90d44b8b9421 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:52.238014 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6ca77771-42cb-4168-a170-90d44b8b9421 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:52.375411 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-6ca77771-42cb-4168-a170-90d44b8b9421 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:42:52.398683 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6ca77771-42cb-4168-a170-90d44b8b9421 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/73dec0f6-f5c6-494e-834f-90bbcd4e22ad" status: 200 len: 1499 microversion: 2.1 time: 0.169722 Oct 19 03:42:52.402485 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2941/5814] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:42:52 2022] GET /compute/v2.1/servers/73dec0f6-f5c6-494e-834f-90bbcd4e22ad => generated 1499 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:42:53.649860 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-ddb47997-b2e5-4cff-954e-b4da1ebe75ea req-3a856549-91d0-4ac3-8284-6cef3fc6fd71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73dec0f6-f5c6-494e-834f-90bbcd4e22ad", "name": "network-vif-deleted", "tag": "f6b7cace-1769-4b9c-ad7b-c22ebb3a4fb5"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:42:53.663612 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-ddb47997-b2e5-4cff-954e-b4da1ebe75ea req-3a856549-91d0-4ac3-8284-6cef3fc6fd71 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:53.664152 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-ddb47997-b2e5-4cff-954e-b4da1ebe75ea req-3a856549-91d0-4ac3-8284-6cef3fc6fd71 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:53.664653 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-ddb47997-b2e5-4cff-954e-b4da1ebe75ea req-3a856549-91d0-4ac3-8284-6cef3fc6fd71 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:53.677143 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-ddb47997-b2e5-4cff-954e-b4da1ebe75ea req-3a856549-91d0-4ac3-8284-6cef3fc6fd71 service nova] Creating event network-vif-deleted:f6b7cace-1769-4b9c-ad7b-c22ebb3a4fb5 for instance 73dec0f6-f5c6-494e-834f-90bbcd4e22ad on n-h2-861333-8 Oct 19 03:42:53.683145 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-ddb47997-b2e5-4cff-954e-b4da1ebe75ea req-3a856549-91d0-4ac3-8284-6cef3fc6fd71 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043599 Oct 19 03:42:53.684049 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2942/5815] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:42:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:42:54.178078 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-88686966-f2bc-471c-a2ce-1c145b4705a5 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:42:54.179270 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-88686966-f2bc-471c-a2ce-1c145b4705a5 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 73dec0f6-f5c6-494e-834f-90bbcd4e22ad] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:42:54.185355 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-88686966-f2bc-471c-a2ce-1c145b4705a5 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:54.185965 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-88686966-f2bc-471c-a2ce-1c145b4705a5 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:54.186402 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-88686966-f2bc-471c-a2ce-1c145b4705a5 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:54.187104 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-88686966-f2bc-471c-a2ce-1c145b4705a5 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:54.187559 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-88686966-f2bc-471c-a2ce-1c145b4705a5 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:54.188025 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-88686966-f2bc-471c-a2ce-1c145b4705a5 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:54.232831 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-88686966-f2bc-471c-a2ce-1c145b4705a5 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:54.233328 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-88686966-f2bc-471c-a2ce-1c145b4705a5 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:54.233803 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-88686966-f2bc-471c-a2ce-1c145b4705a5 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:54.234267 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-88686966-f2bc-471c-a2ce-1c145b4705a5 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lazy-loading 'fault' on Instance uuid 73dec0f6-f5c6-494e-834f-90bbcd4e22ad {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:42:54.279835 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-88686966-f2bc-471c-a2ce-1c145b4705a5 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099c5070710485f83d528d3d2bb1c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224417be63ba4c679b0256a27fb9f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:42:54.288106 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-88686966-f2bc-471c-a2ce-1c145b4705a5 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/73dec0f6-f5c6-494e-834f-90bbcd4e22ad" status: 200 len: 1305 microversion: 2.1 time: 0.865793 Oct 19 03:42:54.294252 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2874/5816] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:42:53 2022] GET /compute/v2.1/servers/73dec0f6-f5c6-494e-834f-90bbcd4e22ad => generated 1305 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:42:55.312547 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-da754cbc-4a1e-4ddd-aedf-1a00deb5c8f1 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:42:55.316049 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-da754cbc-4a1e-4ddd-aedf-1a00deb5c8f1 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 73dec0f6-f5c6-494e-834f-90bbcd4e22ad] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:42:55.332243 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-da754cbc-4a1e-4ddd-aedf-1a00deb5c8f1 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:55.332988 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-da754cbc-4a1e-4ddd-aedf-1a00deb5c8f1 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:55.333671 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-da754cbc-4a1e-4ddd-aedf-1a00deb5c8f1 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:55.335438 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-da754cbc-4a1e-4ddd-aedf-1a00deb5c8f1 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:55.335905 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-da754cbc-4a1e-4ddd-aedf-1a00deb5c8f1 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:55.336705 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-da754cbc-4a1e-4ddd-aedf-1a00deb5c8f1 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:55.354664 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-da754cbc-4a1e-4ddd-aedf-1a00deb5c8f1 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] HTTP exception thrown: Instance 73dec0f6-f5c6-494e-834f-90bbcd4e22ad could not be found. Oct 19 03:42:55.356483 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-da754cbc-4a1e-4ddd-aedf-1a00deb5c8f1 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Request method failure captured: Oct 19 03:42:55.356483 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/73dec0f6-f5c6-494e-834f-90bbcd4e22ad HTTP/1.1 Oct 19 03:42:55.356483 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:42:55.356483 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:42:55.356483 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:42:55.356483 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:42:55.356483 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:42:55.356483 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:42:55.356483 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:42:55.356483 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:42:55.356483 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT3ER8Vi4kdm7o4uGCDWtKZWQ50YHYh4kO6eywBcR15sWt_VOUdg3SdiEQ00NlpD4-_UkP7cbx60NOPjR2_ogmh3qtcCqHFYMrk6ithnKX7Frq8eCjVqAngAFsiOR8FhKAXItaxrviXq7LiRs8ykPsJTrY1v2OiG3mT4ycQKs5qNWF0I Oct 19 03:42:55.356483 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:42:55.356483 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:42:55.356483 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:42:55.356483 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:42:55.356483 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:42:55.356483 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:42:55.356483 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 224417be63ba4c679b0256a27fb9f104 Oct 19 03:42:55.356483 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-DeleteServersTestJSON-1651632054 Oct 19 03:42:55.356483 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:42:55.356483 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:42:55.356483 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/224417be63ba4c679b0256a27fb9f104"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/224417be63ba4c679b0256a27fb9f104"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/224417be63ba4c679b0256a27fb9f104"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_224417be63ba4c679b0256a27fb9f104", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:42:55.356483 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-DeleteServersTestJSON-1651632054 Oct 19 03:42:55.356483 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 224417be63ba4c679b0256a27fb9f104 Oct 19 03:42:55.356483 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-DeleteServersTestJSON-1651632054 Oct 19 03:42:55.356483 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-DeleteServersTestJSON-1651632054-project Oct 19 03:42:55.356483 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:42:55.356483 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:42:55.356483 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: d099c5070710485f83d528d3d2bb1c71 Oct 19 03:42:55.356483 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-DeleteServersTestJSON-1651632054-project Oct 19 03:42:55.356483 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:42:55.356483 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance 73dec0f6-f5c6-494e-834f-90bbcd4e22ad could not be found. Oct 19 03:42:55.356483 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '73dec0f6-f5c6-494e-834f-90bbcd4e22ad'} Oct 19 03:42:55.356483 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:42:55.356483 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:42:55.356483 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:42:55.356483 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:42:55.356483 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:42:55.356483 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:42:55.356483 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:42:55.356483 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:42:55.356483 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:42:55.356483 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:42:55.356483 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73dec0f6-f5c6-494e-834f-90bbcd4e22ad could not be found. Oct 19 03:42:55.356483 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:42:55.356483 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:42:55.356483 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:42:55.356483 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:42:55.356483 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:42:55.356483 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:42:55.356483 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:42:55.356483 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:42:55.356483 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:42:55.356483 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:42:55.356483 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:42:55.356483 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:42:55.356483 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:42:55.356483 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:42:55.356483 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:42:55.356483 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:42:55.356483 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73dec0f6-f5c6-494e-834f-90bbcd4e22ad could not be found. Oct 19 03:42:55.356483 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:42:55.356483 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:42:55.356483 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:42:55.362656 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:42:55.362656 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:42:55.362656 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:42:55.362656 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:42:55.362656 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:42:55.362656 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73dec0f6-f5c6-494e-834f-90bbcd4e22ad could not be found. Oct 19 03:42:55.362656 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:42:55.362656 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-da754cbc-4a1e-4ddd-aedf-1a00deb5c8f1 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Returning 404 to user: Instance 73dec0f6-f5c6-494e-834f-90bbcd4e22ad could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:42:55.362656 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-da754cbc-4a1e-4ddd-aedf-1a00deb5c8f1 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/73dec0f6-f5c6-494e-834f-90bbcd4e22ad" status: 404 len: 111 microversion: 2.1 time: 0.050272 Oct 19 03:42:55.362656 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2943/5817] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:42:55 2022] GET /compute/v2.1/servers/73dec0f6-f5c6-494e-834f-90bbcd4e22ad => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:42:55.372499 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-657c0842-30a4-4f4c-a3ed-45a80ed50966 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:42:55.373959 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-657c0842-30a4-4f4c-a3ed-45a80ed50966 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 73dec0f6-f5c6-494e-834f-90bbcd4e22ad] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:42:55.385638 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-657c0842-30a4-4f4c-a3ed-45a80ed50966 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:55.385638 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-657c0842-30a4-4f4c-a3ed-45a80ed50966 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:55.385638 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-657c0842-30a4-4f4c-a3ed-45a80ed50966 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:55.385638 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-657c0842-30a4-4f4c-a3ed-45a80ed50966 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:55.385638 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-657c0842-30a4-4f4c-a3ed-45a80ed50966 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:55.385638 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-657c0842-30a4-4f4c-a3ed-45a80ed50966 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:55.407575 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-657c0842-30a4-4f4c-a3ed-45a80ed50966 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] HTTP exception thrown: Instance 73dec0f6-f5c6-494e-834f-90bbcd4e22ad could not be found. Oct 19 03:42:55.410278 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-657c0842-30a4-4f4c-a3ed-45a80ed50966 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Request method failure captured: Oct 19 03:42:55.410278 n-d-861333-8 devstack@n-api.service[121134]: request: DELETE /compute/v2.1/servers/73dec0f6-f5c6-494e-834f-90bbcd4e22ad HTTP/1.1 Oct 19 03:42:55.410278 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:42:55.410278 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:42:55.410278 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:42:55.410278 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:42:55.410278 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:42:55.410278 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:42:55.410278 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:42:55.410278 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:42:55.410278 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3ER8Vi4kdm7o4uGCDWtKZWQ50YHYh4kO6eywBcR15sWt_VOUdg3SdiEQ00NlpD4-_UkP7cbx60NOPjR2_ogmh3qtcCqHFYMrk6ithnKX7Frq8eCjVqAngAFsiOR8FhKAXItaxrviXq7LiRs8ykPsJTrY1v2OiG3mT4ycQKs5qNWF0I Oct 19 03:42:55.410278 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:42:55.410278 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:42:55.410278 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:42:55.410278 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:42:55.410278 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:42:55.410278 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:42:55.410278 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 224417be63ba4c679b0256a27fb9f104 Oct 19 03:42:55.410278 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-DeleteServersTestJSON-1651632054 Oct 19 03:42:55.410278 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:42:55.410278 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:42:55.410278 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/224417be63ba4c679b0256a27fb9f104"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/224417be63ba4c679b0256a27fb9f104"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/224417be63ba4c679b0256a27fb9f104"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_224417be63ba4c679b0256a27fb9f104", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:42:55.410278 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-DeleteServersTestJSON-1651632054 Oct 19 03:42:55.410278 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 224417be63ba4c679b0256a27fb9f104 Oct 19 03:42:55.410278 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-DeleteServersTestJSON-1651632054 Oct 19 03:42:55.410278 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-DeleteServersTestJSON-1651632054-project Oct 19 03:42:55.410278 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:42:55.410278 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:42:55.410278 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: d099c5070710485f83d528d3d2bb1c71 Oct 19 03:42:55.410278 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-DeleteServersTestJSON-1651632054-project Oct 19 03:42:55.410278 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:42:55.410278 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance 73dec0f6-f5c6-494e-834f-90bbcd4e22ad could not be found. Oct 19 03:42:55.410278 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '73dec0f6-f5c6-494e-834f-90bbcd4e22ad'} Oct 19 03:42:55.410278 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:42:55.410278 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:42:55.410278 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:42:55.410278 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:42:55.410278 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:42:55.410278 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:42:55.410278 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:42:55.410278 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:42:55.410278 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:42:55.410278 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:42:55.410278 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73dec0f6-f5c6-494e-834f-90bbcd4e22ad could not be found. Oct 19 03:42:55.410278 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:42:55.410278 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:42:55.410278 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:42:55.410278 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:42:55.410278 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:42:55.410278 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:42:55.410278 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:42:55.410278 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:42:55.410278 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:42:55.410278 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:42:55.410278 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 03:42:55.410278 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 03:42:55.410278 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 03:42:55.410278 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 03:42:55.410278 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:42:55.410278 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:42:55.410278 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:42:55.410278 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:42:55.425552 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73dec0f6-f5c6-494e-834f-90bbcd4e22ad could not be found. Oct 19 03:42:55.425552 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:42:55.425552 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:42:55.425552 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:42:55.425552 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:42:55.425552 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:42:55.425552 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:42:55.425552 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:42:55.425552 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:42:55.425552 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73dec0f6-f5c6-494e-834f-90bbcd4e22ad could not be found. Oct 19 03:42:55.425552 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:42:55.425552 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-657c0842-30a4-4f4c-a3ed-45a80ed50966 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Returning 404 to user: Instance 73dec0f6-f5c6-494e-834f-90bbcd4e22ad could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:42:55.425552 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-657c0842-30a4-4f4c-a3ed-45a80ed50966 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "DELETE /compute/v2.1/servers/73dec0f6-f5c6-494e-834f-90bbcd4e22ad" status: 404 len: 111 microversion: 2.1 time: 0.043351 Oct 19 03:42:55.425552 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2875/5818] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:42:55 2022] DELETE /compute/v2.1/servers/73dec0f6-f5c6-494e-834f-90bbcd4e22ad => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:42:55.426719 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6e824f8a-ccfa-4fae-8ed1-ff434372434c tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:42:55.426719 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6e824f8a-ccfa-4fae-8ed1-ff434372434c tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 73dec0f6-f5c6-494e-834f-90bbcd4e22ad] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:42:55.431989 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6e824f8a-ccfa-4fae-8ed1-ff434372434c tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:55.432482 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6e824f8a-ccfa-4fae-8ed1-ff434372434c tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:55.432922 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6e824f8a-ccfa-4fae-8ed1-ff434372434c tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:55.433641 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6e824f8a-ccfa-4fae-8ed1-ff434372434c tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:55.434269 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6e824f8a-ccfa-4fae-8ed1-ff434372434c tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:55.434864 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6e824f8a-ccfa-4fae-8ed1-ff434372434c tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:55.453066 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-6e824f8a-ccfa-4fae-8ed1-ff434372434c tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] HTTP exception thrown: Instance 73dec0f6-f5c6-494e-834f-90bbcd4e22ad could not be found. Oct 19 03:42:55.454671 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6e824f8a-ccfa-4fae-8ed1-ff434372434c tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Request method failure captured: Oct 19 03:42:55.454671 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/73dec0f6-f5c6-494e-834f-90bbcd4e22ad HTTP/1.1 Oct 19 03:42:55.454671 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:42:55.454671 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:42:55.454671 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:42:55.454671 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:42:55.454671 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:42:55.454671 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:42:55.454671 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:42:55.454671 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:42:55.454671 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT3ER8Vi4kdm7o4uGCDWtKZWQ50YHYh4kO6eywBcR15sWt_VOUdg3SdiEQ00NlpD4-_UkP7cbx60NOPjR2_ogmh3qtcCqHFYMrk6ithnKX7Frq8eCjVqAngAFsiOR8FhKAXItaxrviXq7LiRs8ykPsJTrY1v2OiG3mT4ycQKs5qNWF0I Oct 19 03:42:55.454671 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:42:55.454671 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:42:55.454671 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:42:55.454671 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:42:55.454671 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:42:55.454671 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:42:55.454671 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 224417be63ba4c679b0256a27fb9f104 Oct 19 03:42:55.454671 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-DeleteServersTestJSON-1651632054 Oct 19 03:42:55.454671 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:42:55.454671 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:42:55.454671 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/224417be63ba4c679b0256a27fb9f104"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/224417be63ba4c679b0256a27fb9f104"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/224417be63ba4c679b0256a27fb9f104"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_224417be63ba4c679b0256a27fb9f104", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:42:55.454671 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-DeleteServersTestJSON-1651632054 Oct 19 03:42:55.454671 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 224417be63ba4c679b0256a27fb9f104 Oct 19 03:42:55.454671 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-DeleteServersTestJSON-1651632054 Oct 19 03:42:55.454671 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-DeleteServersTestJSON-1651632054-project Oct 19 03:42:55.454671 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:42:55.454671 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:42:55.454671 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: d099c5070710485f83d528d3d2bb1c71 Oct 19 03:42:55.454671 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-DeleteServersTestJSON-1651632054-project Oct 19 03:42:55.454671 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:42:55.454671 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance 73dec0f6-f5c6-494e-834f-90bbcd4e22ad could not be found. Oct 19 03:42:55.454671 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '73dec0f6-f5c6-494e-834f-90bbcd4e22ad'} Oct 19 03:42:55.454671 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:42:55.454671 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:42:55.454671 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:42:55.454671 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:42:55.454671 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:42:55.454671 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:42:55.454671 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:42:55.454671 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:42:55.454671 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:42:55.454671 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:42:55.454671 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73dec0f6-f5c6-494e-834f-90bbcd4e22ad could not be found. Oct 19 03:42:55.454671 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:42:55.454671 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:42:55.454671 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:42:55.454671 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:42:55.454671 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:42:55.454671 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:42:55.454671 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:42:55.454671 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:42:55.454671 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:42:55.454671 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:42:55.454671 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:42:55.454671 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:42:55.454671 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:42:55.454671 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:42:55.454671 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:42:55.454671 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:42:55.454671 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73dec0f6-f5c6-494e-834f-90bbcd4e22ad could not be found. Oct 19 03:42:55.454671 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:42:55.454671 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:42:55.454671 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:42:55.459492 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:42:55.459492 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:42:55.459492 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:42:55.459492 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:42:55.459492 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:42:55.459492 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73dec0f6-f5c6-494e-834f-90bbcd4e22ad could not be found. Oct 19 03:42:55.459492 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:42:55.459492 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6e824f8a-ccfa-4fae-8ed1-ff434372434c tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Returning 404 to user: Instance 73dec0f6-f5c6-494e-834f-90bbcd4e22ad could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:42:55.459492 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6e824f8a-ccfa-4fae-8ed1-ff434372434c tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/73dec0f6-f5c6-494e-834f-90bbcd4e22ad" status: 404 len: 111 microversion: 2.1 time: 0.038694 Oct 19 03:42:55.459492 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2944/5819] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:42:55 2022] GET /compute/v2.1/servers/73dec0f6-f5c6-494e-834f-90bbcd4e22ad => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 03:42:55.464984 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f3508131-3029-47f7-ab36-d57ab61bf08e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:42:55.465541 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f3508131-3029-47f7-ab36-d57ab61bf08e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: d813bf3b-04b6-4dea-8b53-a6223779622f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:42:55.473988 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f3508131-3029-47f7-ab36-d57ab61bf08e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:55.474556 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f3508131-3029-47f7-ab36-d57ab61bf08e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:55.475011 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f3508131-3029-47f7-ab36-d57ab61bf08e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:55.476233 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f3508131-3029-47f7-ab36-d57ab61bf08e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:55.476702 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f3508131-3029-47f7-ab36-d57ab61bf08e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:55.477145 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f3508131-3029-47f7-ab36-d57ab61bf08e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:55.499291 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-f3508131-3029-47f7-ab36-d57ab61bf08e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] HTTP exception thrown: Instance d813bf3b-04b6-4dea-8b53-a6223779622f could not be found. Oct 19 03:42:55.501581 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f3508131-3029-47f7-ab36-d57ab61bf08e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Request method failure captured: Oct 19 03:42:55.501581 n-d-861333-8 devstack@n-api.service[121134]: request: DELETE /compute/v2.1/servers/d813bf3b-04b6-4dea-8b53-a6223779622f HTTP/1.1 Oct 19 03:42:55.501581 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:42:55.501581 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:42:55.501581 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:42:55.501581 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:42:55.501581 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:42:55.501581 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:42:55.501581 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:42:55.501581 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:42:55.501581 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3ER8Vi4kdm7o4uGCDWtKZWQ50YHYh4kO6eywBcR15sWt_VOUdg3SdiEQ00NlpD4-_UkP7cbx60NOPjR2_ogmh3qtcCqHFYMrk6ithnKX7Frq8eCjVqAngAFsiOR8FhKAXItaxrviXq7LiRs8ykPsJTrY1v2OiG3mT4ycQKs5qNWF0I Oct 19 03:42:55.501581 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:42:55.501581 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:42:55.501581 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:42:55.501581 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:42:55.501581 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:42:55.501581 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:42:55.501581 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 224417be63ba4c679b0256a27fb9f104 Oct 19 03:42:55.501581 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-DeleteServersTestJSON-1651632054 Oct 19 03:42:55.501581 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:42:55.501581 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:42:55.501581 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/224417be63ba4c679b0256a27fb9f104"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/224417be63ba4c679b0256a27fb9f104"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/224417be63ba4c679b0256a27fb9f104"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_224417be63ba4c679b0256a27fb9f104", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:42:55.501581 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-DeleteServersTestJSON-1651632054 Oct 19 03:42:55.501581 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 224417be63ba4c679b0256a27fb9f104 Oct 19 03:42:55.501581 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-DeleteServersTestJSON-1651632054 Oct 19 03:42:55.501581 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-DeleteServersTestJSON-1651632054-project Oct 19 03:42:55.501581 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:42:55.501581 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:42:55.501581 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: d099c5070710485f83d528d3d2bb1c71 Oct 19 03:42:55.501581 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-DeleteServersTestJSON-1651632054-project Oct 19 03:42:55.501581 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:42:55.501581 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance d813bf3b-04b6-4dea-8b53-a6223779622f could not be found. Oct 19 03:42:55.501581 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': 'd813bf3b-04b6-4dea-8b53-a6223779622f'} Oct 19 03:42:55.501581 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:42:55.501581 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:42:55.501581 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:42:55.501581 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:42:55.501581 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:42:55.501581 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:42:55.501581 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:42:55.501581 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:42:55.501581 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:42:55.501581 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:42:55.501581 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d813bf3b-04b6-4dea-8b53-a6223779622f could not be found. Oct 19 03:42:55.501581 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:42:55.501581 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:42:55.501581 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:42:55.501581 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:42:55.501581 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:42:55.501581 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:42:55.501581 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:42:55.501581 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:42:55.501581 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:42:55.501581 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:42:55.501581 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 03:42:55.501581 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 03:42:55.501581 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 03:42:55.501581 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 03:42:55.501581 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:42:55.501581 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:42:55.501581 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:42:55.501581 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:42:55.506340 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d813bf3b-04b6-4dea-8b53-a6223779622f could not be found. Oct 19 03:42:55.506340 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:42:55.506340 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:42:55.506340 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:42:55.506340 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:42:55.506340 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:42:55.506340 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:42:55.506340 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:42:55.506340 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:42:55.506340 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d813bf3b-04b6-4dea-8b53-a6223779622f could not be found. Oct 19 03:42:55.506340 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:42:55.507592 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f3508131-3029-47f7-ab36-d57ab61bf08e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Returning 404 to user: Instance d813bf3b-04b6-4dea-8b53-a6223779622f could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:42:55.508450 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f3508131-3029-47f7-ab36-d57ab61bf08e tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "DELETE /compute/v2.1/servers/d813bf3b-04b6-4dea-8b53-a6223779622f" status: 404 len: 111 microversion: 2.1 time: 0.047729 Oct 19 03:42:55.509190 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2876/5820] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:42:55 2022] DELETE /compute/v2.1/servers/d813bf3b-04b6-4dea-8b53-a6223779622f => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:42:55.519308 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-56508e92-c6a7-41eb-8bdb-55a2424e9bae tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:42:55.520667 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-56508e92-c6a7-41eb-8bdb-55a2424e9bae tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: d813bf3b-04b6-4dea-8b53-a6223779622f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:42:55.528647 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-56508e92-c6a7-41eb-8bdb-55a2424e9bae tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:55.528647 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-56508e92-c6a7-41eb-8bdb-55a2424e9bae tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:55.529549 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-56508e92-c6a7-41eb-8bdb-55a2424e9bae tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:55.530754 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-56508e92-c6a7-41eb-8bdb-55a2424e9bae tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:55.531435 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-56508e92-c6a7-41eb-8bdb-55a2424e9bae tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:55.531868 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-56508e92-c6a7-41eb-8bdb-55a2424e9bae tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:55.547009 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-56508e92-c6a7-41eb-8bdb-55a2424e9bae tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] HTTP exception thrown: Instance d813bf3b-04b6-4dea-8b53-a6223779622f could not be found. Oct 19 03:42:55.548587 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-56508e92-c6a7-41eb-8bdb-55a2424e9bae tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Request method failure captured: Oct 19 03:42:55.548587 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/d813bf3b-04b6-4dea-8b53-a6223779622f HTTP/1.1 Oct 19 03:42:55.548587 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:42:55.548587 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:42:55.548587 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:42:55.548587 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:42:55.548587 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:42:55.548587 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:42:55.548587 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:42:55.548587 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:42:55.548587 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT3ER8Vi4kdm7o4uGCDWtKZWQ50YHYh4kO6eywBcR15sWt_VOUdg3SdiEQ00NlpD4-_UkP7cbx60NOPjR2_ogmh3qtcCqHFYMrk6ithnKX7Frq8eCjVqAngAFsiOR8FhKAXItaxrviXq7LiRs8ykPsJTrY1v2OiG3mT4ycQKs5qNWF0I Oct 19 03:42:55.548587 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:42:55.548587 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:42:55.548587 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:42:55.548587 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:42:55.548587 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:42:55.548587 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:42:55.548587 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 224417be63ba4c679b0256a27fb9f104 Oct 19 03:42:55.548587 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-DeleteServersTestJSON-1651632054 Oct 19 03:42:55.548587 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:42:55.548587 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:42:55.548587 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/224417be63ba4c679b0256a27fb9f104"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/224417be63ba4c679b0256a27fb9f104"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/224417be63ba4c679b0256a27fb9f104"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_224417be63ba4c679b0256a27fb9f104", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:42:55.548587 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-DeleteServersTestJSON-1651632054 Oct 19 03:42:55.548587 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 224417be63ba4c679b0256a27fb9f104 Oct 19 03:42:55.548587 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-DeleteServersTestJSON-1651632054 Oct 19 03:42:55.548587 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-DeleteServersTestJSON-1651632054-project Oct 19 03:42:55.548587 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:42:55.548587 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:42:55.548587 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: d099c5070710485f83d528d3d2bb1c71 Oct 19 03:42:55.548587 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-DeleteServersTestJSON-1651632054-project Oct 19 03:42:55.548587 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:42:55.548587 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance d813bf3b-04b6-4dea-8b53-a6223779622f could not be found. Oct 19 03:42:55.548587 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': 'd813bf3b-04b6-4dea-8b53-a6223779622f'} Oct 19 03:42:55.548587 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:42:55.548587 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:42:55.548587 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:42:55.548587 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:42:55.548587 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:42:55.548587 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:42:55.548587 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:42:55.548587 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:42:55.548587 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:42:55.548587 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:42:55.548587 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d813bf3b-04b6-4dea-8b53-a6223779622f could not be found. Oct 19 03:42:55.548587 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:42:55.548587 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:42:55.548587 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:42:55.548587 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:42:55.548587 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:42:55.548587 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:42:55.548587 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:42:55.548587 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:42:55.548587 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:42:55.548587 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:42:55.548587 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:42:55.548587 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:42:55.548587 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:42:55.548587 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:42:55.548587 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:42:55.548587 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:42:55.548587 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d813bf3b-04b6-4dea-8b53-a6223779622f could not be found. Oct 19 03:42:55.548587 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:42:55.548587 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:42:55.548587 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:42:55.552990 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:42:55.552990 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:42:55.552990 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:42:55.552990 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:42:55.552990 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:42:55.552990 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d813bf3b-04b6-4dea-8b53-a6223779622f could not be found. Oct 19 03:42:55.552990 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:42:55.552990 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-56508e92-c6a7-41eb-8bdb-55a2424e9bae tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Returning 404 to user: Instance d813bf3b-04b6-4dea-8b53-a6223779622f could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:42:55.552990 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-56508e92-c6a7-41eb-8bdb-55a2424e9bae tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/d813bf3b-04b6-4dea-8b53-a6223779622f" status: 404 len: 111 microversion: 2.1 time: 0.036340 Oct 19 03:42:55.554234 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2945/5821] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:42:55 2022] GET /compute/v2.1/servers/d813bf3b-04b6-4dea-8b53-a6223779622f => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 03:42:55.561541 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c8c2ef05-7a2a-4a4b-bfd3-1a1e4fd46b6b tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:42:55.561541 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c8c2ef05-7a2a-4a4b-bfd3-1a1e4fd46b6b tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 7e633743-2b38-4c08-be9e-fdfde600b48b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:42:55.566916 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c8c2ef05-7a2a-4a4b-bfd3-1a1e4fd46b6b tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:55.567407 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c8c2ef05-7a2a-4a4b-bfd3-1a1e4fd46b6b tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:55.567851 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c8c2ef05-7a2a-4a4b-bfd3-1a1e4fd46b6b tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:55.568551 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c8c2ef05-7a2a-4a4b-bfd3-1a1e4fd46b6b tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:55.569009 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c8c2ef05-7a2a-4a4b-bfd3-1a1e4fd46b6b tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:55.569544 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c8c2ef05-7a2a-4a4b-bfd3-1a1e4fd46b6b tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:55.588858 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-c8c2ef05-7a2a-4a4b-bfd3-1a1e4fd46b6b tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] HTTP exception thrown: Instance 7e633743-2b38-4c08-be9e-fdfde600b48b could not be found. Oct 19 03:42:55.590483 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c8c2ef05-7a2a-4a4b-bfd3-1a1e4fd46b6b tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Request method failure captured: Oct 19 03:42:55.590483 n-d-861333-8 devstack@n-api.service[121134]: request: DELETE /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b HTTP/1.1 Oct 19 03:42:55.590483 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:42:55.590483 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:42:55.590483 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:42:55.590483 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:42:55.590483 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:42:55.590483 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:42:55.590483 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:42:55.590483 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:42:55.590483 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3ER8Vi4kdm7o4uGCDWtKZWQ50YHYh4kO6eywBcR15sWt_VOUdg3SdiEQ00NlpD4-_UkP7cbx60NOPjR2_ogmh3qtcCqHFYMrk6ithnKX7Frq8eCjVqAngAFsiOR8FhKAXItaxrviXq7LiRs8ykPsJTrY1v2OiG3mT4ycQKs5qNWF0I Oct 19 03:42:55.590483 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:42:55.590483 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:42:55.590483 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:42:55.590483 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:42:55.590483 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:42:55.590483 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:42:55.590483 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 224417be63ba4c679b0256a27fb9f104 Oct 19 03:42:55.590483 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-DeleteServersTestJSON-1651632054 Oct 19 03:42:55.590483 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:42:55.590483 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:42:55.590483 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/224417be63ba4c679b0256a27fb9f104"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/224417be63ba4c679b0256a27fb9f104"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/224417be63ba4c679b0256a27fb9f104"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_224417be63ba4c679b0256a27fb9f104", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:42:55.590483 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-DeleteServersTestJSON-1651632054 Oct 19 03:42:55.590483 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 224417be63ba4c679b0256a27fb9f104 Oct 19 03:42:55.590483 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-DeleteServersTestJSON-1651632054 Oct 19 03:42:55.590483 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-DeleteServersTestJSON-1651632054-project Oct 19 03:42:55.590483 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:42:55.590483 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:42:55.590483 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: d099c5070710485f83d528d3d2bb1c71 Oct 19 03:42:55.590483 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-DeleteServersTestJSON-1651632054-project Oct 19 03:42:55.590483 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:42:55.590483 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance 7e633743-2b38-4c08-be9e-fdfde600b48b could not be found. Oct 19 03:42:55.590483 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '7e633743-2b38-4c08-be9e-fdfde600b48b'} Oct 19 03:42:55.590483 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:42:55.590483 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:42:55.590483 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:42:55.590483 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:42:55.590483 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:42:55.590483 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:42:55.590483 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:42:55.590483 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:42:55.590483 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:42:55.590483 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:42:55.590483 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e633743-2b38-4c08-be9e-fdfde600b48b could not be found. Oct 19 03:42:55.590483 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:42:55.590483 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:42:55.590483 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:42:55.590483 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:42:55.590483 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:42:55.590483 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:42:55.590483 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:42:55.590483 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:42:55.590483 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:42:55.590483 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:42:55.590483 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 03:42:55.590483 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 03:42:55.590483 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 03:42:55.590483 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 03:42:55.590483 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:42:55.590483 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:42:55.590483 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:42:55.590483 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:42:55.595026 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e633743-2b38-4c08-be9e-fdfde600b48b could not be found. Oct 19 03:42:55.595026 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:42:55.595026 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:42:55.595026 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:42:55.595026 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:42:55.595026 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:42:55.595026 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:42:55.595026 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:42:55.595026 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:42:55.595026 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e633743-2b38-4c08-be9e-fdfde600b48b could not be found. Oct 19 03:42:55.595026 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:42:55.595026 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c8c2ef05-7a2a-4a4b-bfd3-1a1e4fd46b6b tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Returning 404 to user: Instance 7e633743-2b38-4c08-be9e-fdfde600b48b could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:42:55.595026 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c8c2ef05-7a2a-4a4b-bfd3-1a1e4fd46b6b tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "DELETE /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b" status: 404 len: 111 microversion: 2.1 time: 0.036277 Oct 19 03:42:55.595026 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2877/5822] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:42:55 2022] DELETE /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:42:55.601112 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6d1ace06-b18f-44fc-8a7e-ff86c35a503c tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:42:55.601763 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6d1ace06-b18f-44fc-8a7e-ff86c35a503c tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 7e633743-2b38-4c08-be9e-fdfde600b48b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:42:55.607745 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6d1ace06-b18f-44fc-8a7e-ff86c35a503c tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:55.608229 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6d1ace06-b18f-44fc-8a7e-ff86c35a503c tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:55.609336 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6d1ace06-b18f-44fc-8a7e-ff86c35a503c tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:55.610106 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6d1ace06-b18f-44fc-8a7e-ff86c35a503c tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:55.610556 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6d1ace06-b18f-44fc-8a7e-ff86c35a503c tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:55.616824 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6d1ace06-b18f-44fc-8a7e-ff86c35a503c tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:55.625404 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-6d1ace06-b18f-44fc-8a7e-ff86c35a503c tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] HTTP exception thrown: Instance 7e633743-2b38-4c08-be9e-fdfde600b48b could not be found. Oct 19 03:42:55.626998 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6d1ace06-b18f-44fc-8a7e-ff86c35a503c tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Request method failure captured: Oct 19 03:42:55.626998 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b HTTP/1.1 Oct 19 03:42:55.626998 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:42:55.626998 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:42:55.626998 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:42:55.626998 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:42:55.626998 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:42:55.626998 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:42:55.626998 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:42:55.626998 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:42:55.626998 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT3ER8Vi4kdm7o4uGCDWtKZWQ50YHYh4kO6eywBcR15sWt_VOUdg3SdiEQ00NlpD4-_UkP7cbx60NOPjR2_ogmh3qtcCqHFYMrk6ithnKX7Frq8eCjVqAngAFsiOR8FhKAXItaxrviXq7LiRs8ykPsJTrY1v2OiG3mT4ycQKs5qNWF0I Oct 19 03:42:55.626998 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:42:55.626998 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:42:55.626998 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:42:55.626998 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:42:55.626998 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:42:55.626998 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:42:55.626998 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 224417be63ba4c679b0256a27fb9f104 Oct 19 03:42:55.626998 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-DeleteServersTestJSON-1651632054 Oct 19 03:42:55.626998 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:42:55.626998 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:42:55.626998 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/224417be63ba4c679b0256a27fb9f104"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/224417be63ba4c679b0256a27fb9f104"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/224417be63ba4c679b0256a27fb9f104"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_224417be63ba4c679b0256a27fb9f104", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:42:55.626998 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-DeleteServersTestJSON-1651632054 Oct 19 03:42:55.626998 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 224417be63ba4c679b0256a27fb9f104 Oct 19 03:42:55.626998 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-DeleteServersTestJSON-1651632054 Oct 19 03:42:55.626998 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-DeleteServersTestJSON-1651632054-project Oct 19 03:42:55.626998 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:42:55.626998 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:42:55.626998 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: d099c5070710485f83d528d3d2bb1c71 Oct 19 03:42:55.626998 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-DeleteServersTestJSON-1651632054-project Oct 19 03:42:55.626998 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:42:55.626998 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance 7e633743-2b38-4c08-be9e-fdfde600b48b could not be found. Oct 19 03:42:55.626998 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '7e633743-2b38-4c08-be9e-fdfde600b48b'} Oct 19 03:42:55.626998 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:42:55.626998 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:42:55.626998 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:42:55.626998 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:42:55.626998 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:42:55.626998 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:42:55.626998 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:42:55.626998 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:42:55.626998 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:42:55.626998 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:42:55.626998 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e633743-2b38-4c08-be9e-fdfde600b48b could not be found. Oct 19 03:42:55.626998 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:42:55.626998 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:42:55.626998 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:42:55.626998 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:42:55.626998 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:42:55.626998 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:42:55.626998 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:42:55.626998 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:42:55.626998 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:42:55.626998 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:42:55.626998 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:42:55.626998 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:42:55.626998 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:42:55.626998 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:42:55.626998 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:42:55.626998 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:42:55.626998 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e633743-2b38-4c08-be9e-fdfde600b48b could not be found. Oct 19 03:42:55.626998 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:42:55.626998 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:42:55.626998 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:42:55.631949 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:42:55.631949 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:42:55.631949 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:42:55.631949 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:42:55.631949 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:42:55.631949 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e633743-2b38-4c08-be9e-fdfde600b48b could not be found. Oct 19 03:42:55.631949 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:42:55.631949 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6d1ace06-b18f-44fc-8a7e-ff86c35a503c tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Returning 404 to user: Instance 7e633743-2b38-4c08-be9e-fdfde600b48b could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:42:55.631949 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6d1ace06-b18f-44fc-8a7e-ff86c35a503c tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b" status: 404 len: 111 microversion: 2.1 time: 0.031786 Oct 19 03:42:55.631949 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2946/5823] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:42:55 2022] GET /compute/v2.1/servers/7e633743-2b38-4c08-be9e-fdfde600b48b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:42:55.637385 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-79d52e33-9fd0-41c0-b3da-3bb0609bfefa tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:42:55.637901 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-79d52e33-9fd0-41c0-b3da-3bb0609bfefa tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 3ec066e4-f1f9-4dbe-a874-0378b95cf1d9] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:42:55.643922 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-79d52e33-9fd0-41c0-b3da-3bb0609bfefa tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:55.644403 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-79d52e33-9fd0-41c0-b3da-3bb0609bfefa tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:55.644843 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-79d52e33-9fd0-41c0-b3da-3bb0609bfefa tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:55.645613 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-79d52e33-9fd0-41c0-b3da-3bb0609bfefa tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:55.646066 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-79d52e33-9fd0-41c0-b3da-3bb0609bfefa tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:55.646493 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-79d52e33-9fd0-41c0-b3da-3bb0609bfefa tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:55.660514 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-79d52e33-9fd0-41c0-b3da-3bb0609bfefa tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] HTTP exception thrown: Instance 3ec066e4-f1f9-4dbe-a874-0378b95cf1d9 could not be found. Oct 19 03:42:55.662060 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-79d52e33-9fd0-41c0-b3da-3bb0609bfefa tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Request method failure captured: Oct 19 03:42:55.662060 n-d-861333-8 devstack@n-api.service[121134]: request: DELETE /compute/v2.1/servers/3ec066e4-f1f9-4dbe-a874-0378b95cf1d9 HTTP/1.1 Oct 19 03:42:55.662060 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:42:55.662060 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:42:55.662060 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:42:55.662060 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:42:55.662060 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:42:55.662060 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:42:55.662060 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:42:55.662060 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:42:55.662060 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3ER8Vi4kdm7o4uGCDWtKZWQ50YHYh4kO6eywBcR15sWt_VOUdg3SdiEQ00NlpD4-_UkP7cbx60NOPjR2_ogmh3qtcCqHFYMrk6ithnKX7Frq8eCjVqAngAFsiOR8FhKAXItaxrviXq7LiRs8ykPsJTrY1v2OiG3mT4ycQKs5qNWF0I Oct 19 03:42:55.662060 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:42:55.662060 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:42:55.662060 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:42:55.662060 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:42:55.662060 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:42:55.662060 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:42:55.662060 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 224417be63ba4c679b0256a27fb9f104 Oct 19 03:42:55.662060 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-DeleteServersTestJSON-1651632054 Oct 19 03:42:55.662060 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:42:55.662060 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:42:55.662060 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/224417be63ba4c679b0256a27fb9f104"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/224417be63ba4c679b0256a27fb9f104"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/224417be63ba4c679b0256a27fb9f104"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_224417be63ba4c679b0256a27fb9f104", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:42:55.662060 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-DeleteServersTestJSON-1651632054 Oct 19 03:42:55.662060 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 224417be63ba4c679b0256a27fb9f104 Oct 19 03:42:55.662060 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-DeleteServersTestJSON-1651632054 Oct 19 03:42:55.662060 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-DeleteServersTestJSON-1651632054-project Oct 19 03:42:55.662060 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:42:55.662060 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:42:55.662060 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: d099c5070710485f83d528d3d2bb1c71 Oct 19 03:42:55.662060 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-DeleteServersTestJSON-1651632054-project Oct 19 03:42:55.662060 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:42:55.662060 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance 3ec066e4-f1f9-4dbe-a874-0378b95cf1d9 could not be found. Oct 19 03:42:55.662060 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '3ec066e4-f1f9-4dbe-a874-0378b95cf1d9'} Oct 19 03:42:55.662060 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:42:55.662060 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:42:55.662060 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:42:55.662060 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:42:55.662060 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:42:55.662060 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:42:55.662060 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:42:55.662060 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:42:55.662060 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:42:55.662060 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:42:55.662060 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ec066e4-f1f9-4dbe-a874-0378b95cf1d9 could not be found. Oct 19 03:42:55.662060 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:42:55.662060 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:42:55.662060 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:42:55.662060 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:42:55.662060 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:42:55.662060 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:42:55.662060 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:42:55.662060 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:42:55.662060 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:42:55.662060 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:42:55.662060 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 03:42:55.662060 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 03:42:55.662060 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 03:42:55.662060 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 03:42:55.662060 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:42:55.662060 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:42:55.662060 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:42:55.662060 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:42:55.666679 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ec066e4-f1f9-4dbe-a874-0378b95cf1d9 could not be found. Oct 19 03:42:55.666679 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:42:55.666679 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:42:55.666679 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:42:55.666679 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:42:55.666679 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:42:55.666679 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:42:55.666679 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:42:55.666679 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:42:55.666679 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ec066e4-f1f9-4dbe-a874-0378b95cf1d9 could not be found. Oct 19 03:42:55.666679 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:42:55.666679 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-79d52e33-9fd0-41c0-b3da-3bb0609bfefa tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Returning 404 to user: Instance 3ec066e4-f1f9-4dbe-a874-0378b95cf1d9 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:42:55.666679 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-79d52e33-9fd0-41c0-b3da-3bb0609bfefa tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "DELETE /compute/v2.1/servers/3ec066e4-f1f9-4dbe-a874-0378b95cf1d9" status: 404 len: 111 microversion: 2.1 time: 0.030818 Oct 19 03:42:55.666679 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2878/5824] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:42:55 2022] DELETE /compute/v2.1/servers/3ec066e4-f1f9-4dbe-a874-0378b95cf1d9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:42:55.672714 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e4c39ed8-bb53-4496-b0ea-81d4986a7cc1 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:42:55.677478 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e4c39ed8-bb53-4496-b0ea-81d4986a7cc1 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 3ec066e4-f1f9-4dbe-a874-0378b95cf1d9] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:42:55.679604 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e4c39ed8-bb53-4496-b0ea-81d4986a7cc1 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:55.680124 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e4c39ed8-bb53-4496-b0ea-81d4986a7cc1 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:55.680569 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e4c39ed8-bb53-4496-b0ea-81d4986a7cc1 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:55.681290 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e4c39ed8-bb53-4496-b0ea-81d4986a7cc1 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:55.681777 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e4c39ed8-bb53-4496-b0ea-81d4986a7cc1 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:55.682208 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e4c39ed8-bb53-4496-b0ea-81d4986a7cc1 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:55.695535 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-e4c39ed8-bb53-4496-b0ea-81d4986a7cc1 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] HTTP exception thrown: Instance 3ec066e4-f1f9-4dbe-a874-0378b95cf1d9 could not be found. Oct 19 03:42:55.697048 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e4c39ed8-bb53-4496-b0ea-81d4986a7cc1 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Request method failure captured: Oct 19 03:42:55.697048 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/3ec066e4-f1f9-4dbe-a874-0378b95cf1d9 HTTP/1.1 Oct 19 03:42:55.697048 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:42:55.697048 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:42:55.697048 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:42:55.697048 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:42:55.697048 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:42:55.697048 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:42:55.697048 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:42:55.697048 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:42:55.697048 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT3ER8Vi4kdm7o4uGCDWtKZWQ50YHYh4kO6eywBcR15sWt_VOUdg3SdiEQ00NlpD4-_UkP7cbx60NOPjR2_ogmh3qtcCqHFYMrk6ithnKX7Frq8eCjVqAngAFsiOR8FhKAXItaxrviXq7LiRs8ykPsJTrY1v2OiG3mT4ycQKs5qNWF0I Oct 19 03:42:55.697048 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:42:55.697048 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:42:55.697048 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:42:55.697048 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:42:55.697048 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:42:55.697048 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:42:55.697048 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 224417be63ba4c679b0256a27fb9f104 Oct 19 03:42:55.697048 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-DeleteServersTestJSON-1651632054 Oct 19 03:42:55.697048 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:42:55.697048 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:42:55.697048 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/224417be63ba4c679b0256a27fb9f104"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/224417be63ba4c679b0256a27fb9f104"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/224417be63ba4c679b0256a27fb9f104"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_224417be63ba4c679b0256a27fb9f104", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:42:55.697048 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-DeleteServersTestJSON-1651632054 Oct 19 03:42:55.697048 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 224417be63ba4c679b0256a27fb9f104 Oct 19 03:42:55.697048 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-DeleteServersTestJSON-1651632054 Oct 19 03:42:55.697048 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-DeleteServersTestJSON-1651632054-project Oct 19 03:42:55.697048 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:42:55.697048 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:42:55.697048 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: d099c5070710485f83d528d3d2bb1c71 Oct 19 03:42:55.697048 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-DeleteServersTestJSON-1651632054-project Oct 19 03:42:55.697048 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:42:55.697048 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance 3ec066e4-f1f9-4dbe-a874-0378b95cf1d9 could not be found. Oct 19 03:42:55.697048 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '3ec066e4-f1f9-4dbe-a874-0378b95cf1d9'} Oct 19 03:42:55.697048 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:42:55.697048 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:42:55.697048 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:42:55.697048 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:42:55.697048 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:42:55.697048 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:42:55.697048 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:42:55.697048 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:42:55.697048 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:42:55.697048 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:42:55.697048 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ec066e4-f1f9-4dbe-a874-0378b95cf1d9 could not be found. Oct 19 03:42:55.697048 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:42:55.697048 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:42:55.697048 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:42:55.697048 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:42:55.697048 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:42:55.697048 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:42:55.697048 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:42:55.697048 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:42:55.697048 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:42:55.697048 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:42:55.697048 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:42:55.697048 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:42:55.697048 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:42:55.697048 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:42:55.697048 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:42:55.697048 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:42:55.697048 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ec066e4-f1f9-4dbe-a874-0378b95cf1d9 could not be found. Oct 19 03:42:55.697048 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:42:55.697048 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:42:55.697048 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:42:55.701604 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:42:55.701604 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:42:55.701604 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:42:55.701604 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:42:55.701604 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:42:55.701604 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ec066e4-f1f9-4dbe-a874-0378b95cf1d9 could not be found. Oct 19 03:42:55.701604 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:42:55.701604 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e4c39ed8-bb53-4496-b0ea-81d4986a7cc1 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Returning 404 to user: Instance 3ec066e4-f1f9-4dbe-a874-0378b95cf1d9 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:42:55.701604 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e4c39ed8-bb53-4496-b0ea-81d4986a7cc1 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/3ec066e4-f1f9-4dbe-a874-0378b95cf1d9" status: 404 len: 111 microversion: 2.1 time: 0.029780 Oct 19 03:42:55.701604 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2947/5825] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:42:55 2022] GET /compute/v2.1/servers/3ec066e4-f1f9-4dbe-a874-0378b95cf1d9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 03:42:55.707699 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-849bca49-9075-4910-b8fe-1d454cca652b tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:42:55.708401 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-849bca49-9075-4910-b8fe-1d454cca652b tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 83af58ab-841f-4579-a9fa-7e7d410ee18d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:42:55.715691 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-849bca49-9075-4910-b8fe-1d454cca652b tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] HTTP exception thrown: Instance 83af58ab-841f-4579-a9fa-7e7d410ee18d could not be found. Oct 19 03:42:55.717474 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-849bca49-9075-4910-b8fe-1d454cca652b tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Request method failure captured: Oct 19 03:42:55.717474 n-d-861333-8 devstack@n-api.service[121134]: request: DELETE /compute/v2.1/servers/83af58ab-841f-4579-a9fa-7e7d410ee18d HTTP/1.1 Oct 19 03:42:55.717474 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:42:55.717474 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:42:55.717474 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:42:55.717474 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:42:55.717474 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:42:55.717474 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:42:55.717474 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:42:55.717474 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:42:55.717474 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3ER8Vi4kdm7o4uGCDWtKZWQ50YHYh4kO6eywBcR15sWt_VOUdg3SdiEQ00NlpD4-_UkP7cbx60NOPjR2_ogmh3qtcCqHFYMrk6ithnKX7Frq8eCjVqAngAFsiOR8FhKAXItaxrviXq7LiRs8ykPsJTrY1v2OiG3mT4ycQKs5qNWF0I Oct 19 03:42:55.717474 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:42:55.717474 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:42:55.717474 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:42:55.717474 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:42:55.717474 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:42:55.717474 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:42:55.717474 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 224417be63ba4c679b0256a27fb9f104 Oct 19 03:42:55.717474 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-DeleteServersTestJSON-1651632054 Oct 19 03:42:55.717474 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:42:55.717474 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:42:55.717474 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/224417be63ba4c679b0256a27fb9f104"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/224417be63ba4c679b0256a27fb9f104"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/224417be63ba4c679b0256a27fb9f104"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_224417be63ba4c679b0256a27fb9f104", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:42:55.717474 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-DeleteServersTestJSON-1651632054 Oct 19 03:42:55.717474 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 224417be63ba4c679b0256a27fb9f104 Oct 19 03:42:55.717474 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-DeleteServersTestJSON-1651632054 Oct 19 03:42:55.717474 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-DeleteServersTestJSON-1651632054-project Oct 19 03:42:55.717474 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:42:55.717474 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:42:55.717474 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: d099c5070710485f83d528d3d2bb1c71 Oct 19 03:42:55.717474 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-DeleteServersTestJSON-1651632054-project Oct 19 03:42:55.717474 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:42:55.717474 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance 83af58ab-841f-4579-a9fa-7e7d410ee18d could not be found. Oct 19 03:42:55.717474 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '83af58ab-841f-4579-a9fa-7e7d410ee18d'} Oct 19 03:42:55.717474 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:42:55.717474 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:42:55.717474 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:42:55.717474 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:42:55.717474 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:42:55.717474 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:42:55.717474 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 19 03:42:55.717474 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 19 03:42:55.717474 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83af58ab-841f-4579-a9fa-7e7d410ee18d could not be found. Oct 19 03:42:55.717474 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:42:55.717474 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:42:55.717474 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:42:55.717474 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:42:55.717474 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:42:55.717474 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:42:55.717474 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:42:55.717474 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:42:55.717474 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:42:55.717474 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:42:55.717474 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 03:42:55.717474 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 03:42:55.717474 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 03:42:55.717474 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 03:42:55.717474 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:42:55.717474 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:42:55.717474 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:42:55.717474 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:42:55.717474 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83af58ab-841f-4579-a9fa-7e7d410ee18d could not be found. Oct 19 03:42:55.717474 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:42:55.717474 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:42:55.732993 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:42:55.732993 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:42:55.732993 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:42:55.732993 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:42:55.732993 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:42:55.732993 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:42:55.732993 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83af58ab-841f-4579-a9fa-7e7d410ee18d could not be found. Oct 19 03:42:55.732993 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:42:55.732993 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-849bca49-9075-4910-b8fe-1d454cca652b tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Returning 404 to user: Instance 83af58ab-841f-4579-a9fa-7e7d410ee18d could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:42:55.732993 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-849bca49-9075-4910-b8fe-1d454cca652b tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "DELETE /compute/v2.1/servers/83af58ab-841f-4579-a9fa-7e7d410ee18d" status: 404 len: 111 microversion: 2.1 time: 0.015595 Oct 19 03:42:55.732993 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2879/5826] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:42:55 2022] DELETE /compute/v2.1/servers/83af58ab-841f-4579-a9fa-7e7d410ee18d => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 03:42:55.734620 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b87f195c-ce3f-4779-a87d-76c9f330485f tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:42:55.734620 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b87f195c-ce3f-4779-a87d-76c9f330485f tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 83af58ab-841f-4579-a9fa-7e7d410ee18d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:42:55.739600 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-b87f195c-ce3f-4779-a87d-76c9f330485f tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] HTTP exception thrown: Instance 83af58ab-841f-4579-a9fa-7e7d410ee18d could not be found. Oct 19 03:42:55.741403 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b87f195c-ce3f-4779-a87d-76c9f330485f tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Request method failure captured: Oct 19 03:42:55.741403 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/83af58ab-841f-4579-a9fa-7e7d410ee18d HTTP/1.1 Oct 19 03:42:55.741403 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:42:55.741403 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:42:55.741403 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:42:55.741403 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:42:55.741403 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:42:55.741403 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:42:55.741403 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:42:55.741403 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:42:55.741403 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT3ER8Vi4kdm7o4uGCDWtKZWQ50YHYh4kO6eywBcR15sWt_VOUdg3SdiEQ00NlpD4-_UkP7cbx60NOPjR2_ogmh3qtcCqHFYMrk6ithnKX7Frq8eCjVqAngAFsiOR8FhKAXItaxrviXq7LiRs8ykPsJTrY1v2OiG3mT4ycQKs5qNWF0I Oct 19 03:42:55.741403 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:42:55.741403 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:42:55.741403 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:42:55.741403 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:42:55.741403 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:42:55.741403 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:42:55.741403 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 224417be63ba4c679b0256a27fb9f104 Oct 19 03:42:55.741403 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-DeleteServersTestJSON-1651632054 Oct 19 03:42:55.741403 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:42:55.741403 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:42:55.741403 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/224417be63ba4c679b0256a27fb9f104"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/224417be63ba4c679b0256a27fb9f104"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/224417be63ba4c679b0256a27fb9f104"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_224417be63ba4c679b0256a27fb9f104", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:42:55.741403 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-DeleteServersTestJSON-1651632054 Oct 19 03:42:55.741403 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 224417be63ba4c679b0256a27fb9f104 Oct 19 03:42:55.741403 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-DeleteServersTestJSON-1651632054 Oct 19 03:42:55.741403 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-DeleteServersTestJSON-1651632054-project Oct 19 03:42:55.741403 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:42:55.741403 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:42:55.741403 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: d099c5070710485f83d528d3d2bb1c71 Oct 19 03:42:55.741403 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-DeleteServersTestJSON-1651632054-project Oct 19 03:42:55.741403 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:42:55.741403 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance 83af58ab-841f-4579-a9fa-7e7d410ee18d could not be found. Oct 19 03:42:55.741403 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '83af58ab-841f-4579-a9fa-7e7d410ee18d'} Oct 19 03:42:55.741403 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:42:55.741403 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:42:55.741403 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:42:55.741403 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:42:55.741403 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:42:55.741403 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:42:55.741403 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 19 03:42:55.741403 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 19 03:42:55.741403 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83af58ab-841f-4579-a9fa-7e7d410ee18d could not be found. Oct 19 03:42:55.741403 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:42:55.741403 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:42:55.741403 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:42:55.741403 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:42:55.741403 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:42:55.741403 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:42:55.741403 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:42:55.741403 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:42:55.741403 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:42:55.741403 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:42:55.741403 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:42:55.741403 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:42:55.741403 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:42:55.741403 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:42:55.741403 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:42:55.741403 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:42:55.741403 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83af58ab-841f-4579-a9fa-7e7d410ee18d could not be found. Oct 19 03:42:55.741403 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:42:55.741403 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:42:55.741403 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:42:55.741403 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:42:55.741403 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:42:55.746170 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:42:55.746170 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:42:55.746170 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:42:55.746170 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83af58ab-841f-4579-a9fa-7e7d410ee18d could not be found. Oct 19 03:42:55.746170 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:42:55.746170 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b87f195c-ce3f-4779-a87d-76c9f330485f tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Returning 404 to user: Instance 83af58ab-841f-4579-a9fa-7e7d410ee18d could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:42:55.746170 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b87f195c-ce3f-4779-a87d-76c9f330485f tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/83af58ab-841f-4579-a9fa-7e7d410ee18d" status: 404 len: 111 microversion: 2.1 time: 0.013750 Oct 19 03:42:55.746170 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2948/5827] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:42:55 2022] GET /compute/v2.1/servers/83af58ab-841f-4579-a9fa-7e7d410ee18d => generated 111 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:42:59.035165 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-93323a0a-21bc-4d1a-8c07-3a7f362b9804 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:42:59.039567 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-93323a0a-21bc-4d1a-8c07-3a7f362b9804 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] [instance: a5cf37d5-2405-4ca7-b637-070a456f667f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:42:59.047670 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-93323a0a-21bc-4d1a-8c07-3a7f362b9804 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:59.048160 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-93323a0a-21bc-4d1a-8c07-3a7f362b9804 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:59.048679 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-93323a0a-21bc-4d1a-8c07-3a7f362b9804 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:59.049428 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-93323a0a-21bc-4d1a-8c07-3a7f362b9804 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:42:59.050222 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-93323a0a-21bc-4d1a-8c07-3a7f362b9804 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:42:59.050659 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-93323a0a-21bc-4d1a-8c07-3a7f362b9804 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:42:59.135794 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-93323a0a-21bc-4d1a-8c07-3a7f362b9804 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] 10.222.0.52 "POST /compute/v2.1/servers/a5cf37d5-2405-4ca7-b637-070a456f667f/action" status: 200 len: 24578 microversion: 2.1 time: 0.117955 Oct 19 03:42:59.136475 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2880/5828] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:42:59 2022] POST /compute/v2.1/servers/a5cf37d5-2405-4ca7-b637-070a456f667f/action => generated 24578 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 03:43:00.421726 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-054ea84d-b344-4dd0-996f-42415a4b6369 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:43:00.422315 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-054ea84d-b344-4dd0-996f-42415a4b6369 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: c6045b08-8c91-4cdb-be37-c079e7ffe23a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:43:00.436585 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-054ea84d-b344-4dd0-996f-42415a4b6369 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:43:00.436585 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-054ea84d-b344-4dd0-996f-42415a4b6369 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:43:00.436585 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-054ea84d-b344-4dd0-996f-42415a4b6369 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:43:00.436585 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-054ea84d-b344-4dd0-996f-42415a4b6369 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:43:00.436585 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-054ea84d-b344-4dd0-996f-42415a4b6369 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:43:00.436585 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-054ea84d-b344-4dd0-996f-42415a4b6369 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:43:00.449635 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-054ea84d-b344-4dd0-996f-42415a4b6369 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] HTTP exception thrown: Instance c6045b08-8c91-4cdb-be37-c079e7ffe23a could not be found. Oct 19 03:43:00.452504 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-054ea84d-b344-4dd0-996f-42415a4b6369 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Request method failure captured: Oct 19 03:43:00.452504 n-d-861333-8 devstack@n-api.service[121135]: request: DELETE /compute/v2.1/servers/c6045b08-8c91-4cdb-be37-c079e7ffe23a HTTP/1.1 Oct 19 03:43:00.452504 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:43:00.452504 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:43:00.452504 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:43:00.452504 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:43:00.452504 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:43:00.452504 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:43:00.452504 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:43:00.452504 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:43:00.452504 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT3ER8Vi4kdm7o4uGCDWtKZWQ50YHYh4kO6eywBcR15sWt_VOUdg3SdiEQ00NlpD4-_UkP7cbx60NOPjR2_ogmh3qtcCqHFYMrk6ithnKX7Frq8eCjVqAngAFsiOR8FhKAXItaxrviXq7LiRs8ykPsJTrY1v2OiG3mT4ycQKs5qNWF0I Oct 19 03:43:00.452504 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:43:00.452504 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:43:00.452504 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:43:00.452504 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:43:00.452504 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:43:00.452504 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:43:00.452504 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 224417be63ba4c679b0256a27fb9f104 Oct 19 03:43:00.452504 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-DeleteServersTestJSON-1651632054 Oct 19 03:43:00.452504 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:43:00.452504 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:43:00.452504 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/224417be63ba4c679b0256a27fb9f104"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/224417be63ba4c679b0256a27fb9f104"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/224417be63ba4c679b0256a27fb9f104"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_224417be63ba4c679b0256a27fb9f104", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:43:00.452504 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-DeleteServersTestJSON-1651632054 Oct 19 03:43:00.452504 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 224417be63ba4c679b0256a27fb9f104 Oct 19 03:43:00.452504 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-DeleteServersTestJSON-1651632054 Oct 19 03:43:00.452504 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-DeleteServersTestJSON-1651632054-project Oct 19 03:43:00.452504 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:43:00.452504 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:43:00.452504 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: d099c5070710485f83d528d3d2bb1c71 Oct 19 03:43:00.452504 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-DeleteServersTestJSON-1651632054-project Oct 19 03:43:00.452504 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:43:00.452504 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance c6045b08-8c91-4cdb-be37-c079e7ffe23a could not be found. Oct 19 03:43:00.452504 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': 'c6045b08-8c91-4cdb-be37-c079e7ffe23a'} Oct 19 03:43:00.452504 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:43:00.452504 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:43:00.452504 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:43:00.452504 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:43:00.452504 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:43:00.452504 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:43:00.452504 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:43:00.452504 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:43:00.452504 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:43:00.452504 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:43:00.452504 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6045b08-8c91-4cdb-be37-c079e7ffe23a could not be found. Oct 19 03:43:00.452504 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:43:00.452504 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:43:00.452504 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:43:00.452504 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:43:00.452504 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:43:00.452504 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:43:00.452504 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:43:00.452504 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:43:00.452504 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:43:00.452504 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:43:00.452504 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 03:43:00.452504 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 03:43:00.452504 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 03:43:00.452504 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 03:43:00.452504 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:43:00.452504 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:43:00.452504 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:43:00.452504 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:43:00.457270 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6045b08-8c91-4cdb-be37-c079e7ffe23a could not be found. Oct 19 03:43:00.457270 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:43:00.457270 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:43:00.457270 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:43:00.457270 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:43:00.457270 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:43:00.457270 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:43:00.457270 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:43:00.457270 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:43:00.457270 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6045b08-8c91-4cdb-be37-c079e7ffe23a could not be found. Oct 19 03:43:00.457270 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:43:00.460352 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-054ea84d-b344-4dd0-996f-42415a4b6369 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Returning 404 to user: Instance c6045b08-8c91-4cdb-be37-c079e7ffe23a could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:43:00.461860 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-054ea84d-b344-4dd0-996f-42415a4b6369 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "DELETE /compute/v2.1/servers/c6045b08-8c91-4cdb-be37-c079e7ffe23a" status: 404 len: 111 microversion: 2.1 time: 0.044360 Oct 19 03:43:00.462927 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2949/5829] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:43:00 2022] DELETE /compute/v2.1/servers/c6045b08-8c91-4cdb-be37-c079e7ffe23a => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:43:00.476304 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-377605c7-96be-4ea8-b807-4f74e63d9c98 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:43:00.476304 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-377605c7-96be-4ea8-b807-4f74e63d9c98 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: c6045b08-8c91-4cdb-be37-c079e7ffe23a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:43:00.476304 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:43:00.479993 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-377605c7-96be-4ea8-b807-4f74e63d9c98 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:43:00.480489 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-377605c7-96be-4ea8-b807-4f74e63d9c98 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:43:00.480936 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-377605c7-96be-4ea8-b807-4f74e63d9c98 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:43:00.481685 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-377605c7-96be-4ea8-b807-4f74e63d9c98 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:43:00.482148 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-377605c7-96be-4ea8-b807-4f74e63d9c98 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:43:00.482642 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-377605c7-96be-4ea8-b807-4f74e63d9c98 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:43:00.505916 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-377605c7-96be-4ea8-b807-4f74e63d9c98 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] HTTP exception thrown: Instance c6045b08-8c91-4cdb-be37-c079e7ffe23a could not be found. Oct 19 03:43:00.508281 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-377605c7-96be-4ea8-b807-4f74e63d9c98 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Request method failure captured: Oct 19 03:43:00.508281 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/c6045b08-8c91-4cdb-be37-c079e7ffe23a HTTP/1.1 Oct 19 03:43:00.508281 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:43:00.508281 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:43:00.508281 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:43:00.508281 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:43:00.508281 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:43:00.508281 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:43:00.508281 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:43:00.508281 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:43:00.508281 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3ER8Vi4kdm7o4uGCDWtKZWQ50YHYh4kO6eywBcR15sWt_VOUdg3SdiEQ00NlpD4-_UkP7cbx60NOPjR2_ogmh3qtcCqHFYMrk6ithnKX7Frq8eCjVqAngAFsiOR8FhKAXItaxrviXq7LiRs8ykPsJTrY1v2OiG3mT4ycQKs5qNWF0I Oct 19 03:43:00.508281 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:43:00.508281 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:43:00.508281 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:43:00.508281 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:43:00.508281 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:43:00.508281 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:43:00.508281 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 224417be63ba4c679b0256a27fb9f104 Oct 19 03:43:00.508281 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-DeleteServersTestJSON-1651632054 Oct 19 03:43:00.508281 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:43:00.508281 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:43:00.508281 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/224417be63ba4c679b0256a27fb9f104"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/224417be63ba4c679b0256a27fb9f104"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/224417be63ba4c679b0256a27fb9f104"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_224417be63ba4c679b0256a27fb9f104", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:43:00.508281 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-DeleteServersTestJSON-1651632054 Oct 19 03:43:00.508281 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 224417be63ba4c679b0256a27fb9f104 Oct 19 03:43:00.508281 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-DeleteServersTestJSON-1651632054 Oct 19 03:43:00.508281 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-DeleteServersTestJSON-1651632054-project Oct 19 03:43:00.508281 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:43:00.508281 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:43:00.508281 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: d099c5070710485f83d528d3d2bb1c71 Oct 19 03:43:00.508281 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-DeleteServersTestJSON-1651632054-project Oct 19 03:43:00.508281 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:43:00.508281 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance c6045b08-8c91-4cdb-be37-c079e7ffe23a could not be found. Oct 19 03:43:00.508281 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': 'c6045b08-8c91-4cdb-be37-c079e7ffe23a'} Oct 19 03:43:00.508281 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:43:00.508281 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:43:00.508281 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:43:00.508281 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:43:00.508281 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:43:00.508281 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:43:00.508281 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:43:00.508281 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:43:00.508281 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:43:00.508281 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:43:00.508281 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6045b08-8c91-4cdb-be37-c079e7ffe23a could not be found. Oct 19 03:43:00.508281 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:43:00.508281 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:43:00.508281 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:43:00.508281 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:43:00.508281 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:43:00.508281 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:43:00.508281 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:43:00.508281 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:43:00.508281 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:43:00.508281 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:43:00.508281 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:43:00.508281 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:43:00.508281 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:43:00.508281 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:43:00.508281 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:43:00.508281 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:43:00.508281 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6045b08-8c91-4cdb-be37-c079e7ffe23a could not be found. Oct 19 03:43:00.508281 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:43:00.508281 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:43:00.508281 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:43:00.513219 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:43:00.513219 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:43:00.513219 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:43:00.513219 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:43:00.513219 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:43:00.513219 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6045b08-8c91-4cdb-be37-c079e7ffe23a could not be found. Oct 19 03:43:00.513219 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:43:00.513219 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-377605c7-96be-4ea8-b807-4f74e63d9c98 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Returning 404 to user: Instance c6045b08-8c91-4cdb-be37-c079e7ffe23a could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:43:00.513219 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-377605c7-96be-4ea8-b807-4f74e63d9c98 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/c6045b08-8c91-4cdb-be37-c079e7ffe23a" status: 404 len: 111 microversion: 2.1 time: 0.044122 Oct 19 03:43:00.513219 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2881/5830] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:43:00 2022] GET /compute/v2.1/servers/c6045b08-8c91-4cdb-be37-c079e7ffe23a => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:43:00.520994 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f3e57738-960b-4801-af81-44ec0c39d3fc tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:43:00.521720 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f3e57738-960b-4801-af81-44ec0c39d3fc tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 532ba404-fc1a-44d7-93dc-8e5d9f01c8e4] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:43:00.528359 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f3e57738-960b-4801-af81-44ec0c39d3fc tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:43:00.529062 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f3e57738-960b-4801-af81-44ec0c39d3fc tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:43:00.529547 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f3e57738-960b-4801-af81-44ec0c39d3fc tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:43:00.530247 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f3e57738-960b-4801-af81-44ec0c39d3fc tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:43:00.530828 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f3e57738-960b-4801-af81-44ec0c39d3fc tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:43:00.531337 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f3e57738-960b-4801-af81-44ec0c39d3fc tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:43:00.547107 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-f3e57738-960b-4801-af81-44ec0c39d3fc tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] HTTP exception thrown: Instance 532ba404-fc1a-44d7-93dc-8e5d9f01c8e4 could not be found. Oct 19 03:43:00.548736 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f3e57738-960b-4801-af81-44ec0c39d3fc tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Request method failure captured: Oct 19 03:43:00.548736 n-d-861333-8 devstack@n-api.service[121135]: request: DELETE /compute/v2.1/servers/532ba404-fc1a-44d7-93dc-8e5d9f01c8e4 HTTP/1.1 Oct 19 03:43:00.548736 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:43:00.548736 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:43:00.548736 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:43:00.548736 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:43:00.548736 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:43:00.548736 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:43:00.548736 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:43:00.548736 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:43:00.548736 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT3ER8Vi4kdm7o4uGCDWtKZWQ50YHYh4kO6eywBcR15sWt_VOUdg3SdiEQ00NlpD4-_UkP7cbx60NOPjR2_ogmh3qtcCqHFYMrk6ithnKX7Frq8eCjVqAngAFsiOR8FhKAXItaxrviXq7LiRs8ykPsJTrY1v2OiG3mT4ycQKs5qNWF0I Oct 19 03:43:00.548736 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:43:00.548736 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:43:00.548736 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:43:00.548736 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:43:00.548736 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:43:00.548736 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:43:00.548736 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 224417be63ba4c679b0256a27fb9f104 Oct 19 03:43:00.548736 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-DeleteServersTestJSON-1651632054 Oct 19 03:43:00.548736 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:43:00.548736 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:43:00.548736 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/224417be63ba4c679b0256a27fb9f104"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/224417be63ba4c679b0256a27fb9f104"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/224417be63ba4c679b0256a27fb9f104"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_224417be63ba4c679b0256a27fb9f104", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:43:00.548736 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-DeleteServersTestJSON-1651632054 Oct 19 03:43:00.548736 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 224417be63ba4c679b0256a27fb9f104 Oct 19 03:43:00.548736 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-DeleteServersTestJSON-1651632054 Oct 19 03:43:00.548736 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-DeleteServersTestJSON-1651632054-project Oct 19 03:43:00.548736 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:43:00.548736 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:43:00.548736 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: d099c5070710485f83d528d3d2bb1c71 Oct 19 03:43:00.548736 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-DeleteServersTestJSON-1651632054-project Oct 19 03:43:00.548736 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:43:00.548736 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance 532ba404-fc1a-44d7-93dc-8e5d9f01c8e4 could not be found. Oct 19 03:43:00.548736 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '532ba404-fc1a-44d7-93dc-8e5d9f01c8e4'} Oct 19 03:43:00.548736 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:43:00.548736 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:43:00.548736 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:43:00.548736 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:43:00.548736 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:43:00.548736 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:43:00.548736 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:43:00.548736 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:43:00.548736 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:43:00.548736 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:43:00.548736 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 532ba404-fc1a-44d7-93dc-8e5d9f01c8e4 could not be found. Oct 19 03:43:00.548736 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:43:00.548736 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:43:00.548736 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:43:00.548736 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:43:00.548736 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:43:00.548736 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:43:00.548736 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:43:00.548736 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:43:00.548736 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:43:00.548736 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:43:00.548736 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 03:43:00.548736 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 03:43:00.548736 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 03:43:00.548736 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 03:43:00.548736 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:43:00.548736 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:43:00.548736 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:43:00.548736 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:43:00.552707 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 532ba404-fc1a-44d7-93dc-8e5d9f01c8e4 could not be found. Oct 19 03:43:00.552707 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:43:00.552707 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:43:00.552707 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:43:00.552707 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:43:00.552707 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:43:00.552707 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:43:00.552707 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:43:00.552707 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:43:00.552707 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 532ba404-fc1a-44d7-93dc-8e5d9f01c8e4 could not be found. Oct 19 03:43:00.552707 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:43:00.555331 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f3e57738-960b-4801-af81-44ec0c39d3fc tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Returning 404 to user: Instance 532ba404-fc1a-44d7-93dc-8e5d9f01c8e4 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:43:00.556264 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f3e57738-960b-4801-af81-44ec0c39d3fc tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "DELETE /compute/v2.1/servers/532ba404-fc1a-44d7-93dc-8e5d9f01c8e4" status: 404 len: 111 microversion: 2.1 time: 0.039264 Oct 19 03:43:00.557413 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2950/5831] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:43:00 2022] DELETE /compute/v2.1/servers/532ba404-fc1a-44d7-93dc-8e5d9f01c8e4 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:43:00.578714 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ce1537c6-6881-47e6-aa05-102f9d1ed6f8 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:43:00.578714 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ce1537c6-6881-47e6-aa05-102f9d1ed6f8 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] [instance: 532ba404-fc1a-44d7-93dc-8e5d9f01c8e4] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:43:00.582883 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ce1537c6-6881-47e6-aa05-102f9d1ed6f8 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:43:00.583635 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ce1537c6-6881-47e6-aa05-102f9d1ed6f8 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:43:00.584382 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ce1537c6-6881-47e6-aa05-102f9d1ed6f8 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:43:00.585419 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ce1537c6-6881-47e6-aa05-102f9d1ed6f8 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:43:00.586178 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ce1537c6-6881-47e6-aa05-102f9d1ed6f8 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:43:00.586835 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ce1537c6-6881-47e6-aa05-102f9d1ed6f8 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:43:00.608232 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-ce1537c6-6881-47e6-aa05-102f9d1ed6f8 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] HTTP exception thrown: Instance 532ba404-fc1a-44d7-93dc-8e5d9f01c8e4 could not be found. Oct 19 03:43:00.609522 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ce1537c6-6881-47e6-aa05-102f9d1ed6f8 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Request method failure captured: Oct 19 03:43:00.609522 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/532ba404-fc1a-44d7-93dc-8e5d9f01c8e4 HTTP/1.1 Oct 19 03:43:00.609522 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:43:00.609522 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:43:00.609522 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:43:00.609522 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:43:00.609522 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:43:00.609522 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:43:00.609522 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:43:00.609522 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:43:00.609522 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3ER8Vi4kdm7o4uGCDWtKZWQ50YHYh4kO6eywBcR15sWt_VOUdg3SdiEQ00NlpD4-_UkP7cbx60NOPjR2_ogmh3qtcCqHFYMrk6ithnKX7Frq8eCjVqAngAFsiOR8FhKAXItaxrviXq7LiRs8ykPsJTrY1v2OiG3mT4ycQKs5qNWF0I Oct 19 03:43:00.609522 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:43:00.609522 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:43:00.609522 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:43:00.609522 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:43:00.609522 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:43:00.609522 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:43:00.609522 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 224417be63ba4c679b0256a27fb9f104 Oct 19 03:43:00.609522 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-DeleteServersTestJSON-1651632054 Oct 19 03:43:00.609522 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:43:00.609522 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:43:00.609522 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/224417be63ba4c679b0256a27fb9f104"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/224417be63ba4c679b0256a27fb9f104"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/224417be63ba4c679b0256a27fb9f104"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_224417be63ba4c679b0256a27fb9f104", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:43:00.609522 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-DeleteServersTestJSON-1651632054 Oct 19 03:43:00.609522 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 224417be63ba4c679b0256a27fb9f104 Oct 19 03:43:00.609522 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-DeleteServersTestJSON-1651632054 Oct 19 03:43:00.609522 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-DeleteServersTestJSON-1651632054-project Oct 19 03:43:00.609522 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:43:00.609522 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:43:00.609522 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: d099c5070710485f83d528d3d2bb1c71 Oct 19 03:43:00.609522 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-DeleteServersTestJSON-1651632054-project Oct 19 03:43:00.609522 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:43:00.609522 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance 532ba404-fc1a-44d7-93dc-8e5d9f01c8e4 could not be found. Oct 19 03:43:00.609522 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '532ba404-fc1a-44d7-93dc-8e5d9f01c8e4'} Oct 19 03:43:00.609522 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:43:00.609522 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:43:00.609522 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:43:00.609522 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:43:00.609522 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:43:00.609522 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:43:00.609522 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:43:00.609522 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:43:00.609522 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:43:00.609522 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:43:00.609522 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 532ba404-fc1a-44d7-93dc-8e5d9f01c8e4 could not be found. Oct 19 03:43:00.609522 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:43:00.609522 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:43:00.609522 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:43:00.609522 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:43:00.609522 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:43:00.609522 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:43:00.609522 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:43:00.609522 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:43:00.609522 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:43:00.609522 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:43:00.609522 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:43:00.609522 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:43:00.609522 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:43:00.609522 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:43:00.609522 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:43:00.609522 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:43:00.609522 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 532ba404-fc1a-44d7-93dc-8e5d9f01c8e4 could not be found. Oct 19 03:43:00.609522 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:43:00.609522 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:43:00.609522 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:43:00.614328 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:43:00.614328 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:43:00.614328 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:43:00.614328 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:43:00.614328 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:43:00.614328 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 532ba404-fc1a-44d7-93dc-8e5d9f01c8e4 could not be found. Oct 19 03:43:00.614328 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:43:00.616284 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ce1537c6-6881-47e6-aa05-102f9d1ed6f8 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] Returning 404 to user: Instance 532ba404-fc1a-44d7-93dc-8e5d9f01c8e4 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:43:00.617610 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ce1537c6-6881-47e6-aa05-102f9d1ed6f8 tempest-DeleteServersTestJSON-1651632054 tempest-DeleteServersTestJSON-1651632054-project] 10.222.0.52 "GET /compute/v2.1/servers/532ba404-fc1a-44d7-93dc-8e5d9f01c8e4" status: 404 len: 111 microversion: 2.1 time: 0.055642 Oct 19 03:43:00.618946 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2882/5832] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:43:00 2022] GET /compute/v2.1/servers/532ba404-fc1a-44d7-93dc-8e5d9f01c8e4 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:43:20.998169 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:43:20.999592 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:43:21.211243 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-acffd954-a54c-46dc-a427-c525d79000a7 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-472402255", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "networks": [{"uuid": "425bc529-919b-4ae0-a9cf-5be444a90d2f"}]}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:43:21.329394 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.network.neutron [None req-acffd954-a54c-46dc-a427-c525d79000a7 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] validate_networks() for [('425bc529-919b-4ae0-a9cf-5be444a90d2f', None, None, None, None, None)] {{(pid=121135) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:43:22.132092 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-acffd954-a54c-46dc-a427-c525d79000a7 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Flavor limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:43:22.132691 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-acffd954-a54c-46dc-a427-c525d79000a7 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Image limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:43:22.133188 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-acffd954-a54c-46dc-a427-c525d79000a7 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Flavor pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:43:22.134151 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-acffd954-a54c-46dc-a427-c525d79000a7 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Image pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:43:22.134833 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-acffd954-a54c-46dc-a427-c525d79000a7 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:43:22.150059 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-acffd954-a54c-46dc-a427-c525d79000a7 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:43:22.152505 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-acffd954-a54c-46dc-a427-c525d79000a7 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:43:22.153310 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-acffd954-a54c-46dc-a427-c525d79000a7 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:43:22.158455 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-acffd954-a54c-46dc-a427-c525d79000a7 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:43:22.158455 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-acffd954-a54c-46dc-a427-c525d79000a7 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:43:22.158455 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-acffd954-a54c-46dc-a427-c525d79000a7 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:43:22.210760 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-acffd954-a54c-46dc-a427-c525d79000a7 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Getting quotas for project 2eba8c9b474649f39f90b39d0789c2ee. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:43:22.230859 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-acffd954-a54c-46dc-a427-c525d79000a7 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Getting quotas for user e75a39c9dd3e4213b01e4d7d7a5bdd65 and project 2eba8c9b474649f39f90b39d0789c2ee. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:43:22.272586 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-acffd954-a54c-46dc-a427-c525d79000a7 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Going to run 1 instances... {{(pid=121135) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:43:22.277700 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-acffd954-a54c-46dc-a427-c525d79000a7 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] [instance: 9951ce3f-2f16-41d6-b1e6-dab4016d294d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121135) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:43:22.484593 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-acffd954-a54c-46dc-a427-c525d79000a7 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.491901 Oct 19 03:43:22.485569 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2951/5833] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:43:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1494 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 19 03:43:22.516708 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5250a8b0-d43e-47de-b6c8-bc764de1dc04 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:43:22.518510 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5250a8b0-d43e-47de-b6c8-bc764de1dc04 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] [instance: 9951ce3f-2f16-41d6-b1e6-dab4016d294d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:43:22.544012 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:43:22.655966 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5250a8b0-d43e-47de-b6c8-bc764de1dc04 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a39c9dd3e4213b01e4d7d7a5bdd65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eba8c9b474649f39f90b39d0789c2ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:43:22.667404 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5250a8b0-d43e-47de-b6c8-bc764de1dc04 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] 10.222.0.52 "GET /compute/v2.1/servers/9951ce3f-2f16-41d6-b1e6-dab4016d294d" status: 200 len: 1224 microversion: 2.1 time: 0.171729 Oct 19 03:43:22.670129 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2883/5834] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:43:22 2022] GET /compute/v2.1/servers/9951ce3f-2f16-41d6-b1e6-dab4016d294d => generated 1224 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:43:23.719110 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2414155a-47e7-4acc-be71-9d2ce6dce5de tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:43:23.719759 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-2414155a-47e7-4acc-be71-9d2ce6dce5de tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] [instance: 9951ce3f-2f16-41d6-b1e6-dab4016d294d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:43:23.857295 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-2414155a-47e7-4acc-be71-9d2ce6dce5de tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a39c9dd3e4213b01e4d7d7a5bdd65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eba8c9b474649f39f90b39d0789c2ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:43:23.870991 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2414155a-47e7-4acc-be71-9d2ce6dce5de tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] 10.222.0.52 "GET /compute/v2.1/servers/9951ce3f-2f16-41d6-b1e6-dab4016d294d" status: 200 len: 1224 microversion: 2.1 time: 0.178761 Oct 19 03:43:23.871607 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2952/5835] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:43:23 2022] GET /compute/v2.1/servers/9951ce3f-2f16-41d6-b1e6-dab4016d294d => generated 1224 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:43:24.901338 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ccfb1b1c-215b-43c8-95c6-9af3231671a9 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:43:24.909268 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ccfb1b1c-215b-43c8-95c6-9af3231671a9 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] [instance: 9951ce3f-2f16-41d6-b1e6-dab4016d294d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:43:24.910587 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ccfb1b1c-215b-43c8-95c6-9af3231671a9 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:43:24.911292 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ccfb1b1c-215b-43c8-95c6-9af3231671a9 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:43:24.911951 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ccfb1b1c-215b-43c8-95c6-9af3231671a9 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:43:24.912865 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ccfb1b1c-215b-43c8-95c6-9af3231671a9 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:43:24.913531 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ccfb1b1c-215b-43c8-95c6-9af3231671a9 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:43:24.914130 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ccfb1b1c-215b-43c8-95c6-9af3231671a9 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:43:25.081595 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ccfb1b1c-215b-43c8-95c6-9af3231671a9 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a39c9dd3e4213b01e4d7d7a5bdd65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eba8c9b474649f39f90b39d0789c2ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:43:25.096349 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ccfb1b1c-215b-43c8-95c6-9af3231671a9 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] 10.222.0.52 "GET /compute/v2.1/servers/9951ce3f-2f16-41d6-b1e6-dab4016d294d" status: 200 len: 1228 microversion: 2.1 time: 0.197865 Oct 19 03:43:25.097719 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2884/5836] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:43:24 2022] GET /compute/v2.1/servers/9951ce3f-2f16-41d6-b1e6-dab4016d294d => generated 1228 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:43:26.122266 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0323572f-16d6-475a-b2d8-5b7a51a09613 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:43:26.123762 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0323572f-16d6-475a-b2d8-5b7a51a09613 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] [instance: 9951ce3f-2f16-41d6-b1e6-dab4016d294d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:43:26.139116 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0323572f-16d6-475a-b2d8-5b7a51a09613 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:43:26.152302 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0323572f-16d6-475a-b2d8-5b7a51a09613 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:43:26.152774 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0323572f-16d6-475a-b2d8-5b7a51a09613 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:43:26.157071 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0323572f-16d6-475a-b2d8-5b7a51a09613 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:43:26.160081 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0323572f-16d6-475a-b2d8-5b7a51a09613 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:43:26.160563 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0323572f-16d6-475a-b2d8-5b7a51a09613 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:43:26.312768 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-0323572f-16d6-475a-b2d8-5b7a51a09613 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a39c9dd3e4213b01e4d7d7a5bdd65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eba8c9b474649f39f90b39d0789c2ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:43:26.325121 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0323572f-16d6-475a-b2d8-5b7a51a09613 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] 10.222.0.52 "GET /compute/v2.1/servers/9951ce3f-2f16-41d6-b1e6-dab4016d294d" status: 200 len: 1276 microversion: 2.1 time: 0.208949 Oct 19 03:43:26.331864 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2953/5837] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:43:26 2022] GET /compute/v2.1/servers/9951ce3f-2f16-41d6-b1e6-dab4016d294d => generated 1276 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:43:27.370821 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0b6e343c-13c9-4c37-90e0-ecd03a842c56 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:43:27.380415 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0b6e343c-13c9-4c37-90e0-ecd03a842c56 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] [instance: 9951ce3f-2f16-41d6-b1e6-dab4016d294d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:43:27.392083 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0b6e343c-13c9-4c37-90e0-ecd03a842c56 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:43:27.393192 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0b6e343c-13c9-4c37-90e0-ecd03a842c56 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:43:27.395150 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0b6e343c-13c9-4c37-90e0-ecd03a842c56 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:43:27.397320 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0b6e343c-13c9-4c37-90e0-ecd03a842c56 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:43:27.398327 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0b6e343c-13c9-4c37-90e0-ecd03a842c56 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:43:27.399541 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0b6e343c-13c9-4c37-90e0-ecd03a842c56 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:43:27.596384 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0b6e343c-13c9-4c37-90e0-ecd03a842c56 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a39c9dd3e4213b01e4d7d7a5bdd65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eba8c9b474649f39f90b39d0789c2ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:43:27.608455 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0b6e343c-13c9-4c37-90e0-ecd03a842c56 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] 10.222.0.52 "GET /compute/v2.1/servers/9951ce3f-2f16-41d6-b1e6-dab4016d294d" status: 200 len: 1282 microversion: 2.1 time: 0.245275 Oct 19 03:43:27.629208 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2885/5838] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:43:27 2022] GET /compute/v2.1/servers/9951ce3f-2f16-41d6-b1e6-dab4016d294d => generated 1282 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:43:28.639838 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-54340a58-5c09-45f3-bb3a-e4374c1f9987 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:43:28.641890 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-54340a58-5c09-45f3-bb3a-e4374c1f9987 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] [instance: 9951ce3f-2f16-41d6-b1e6-dab4016d294d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:43:28.651943 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-54340a58-5c09-45f3-bb3a-e4374c1f9987 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:43:28.652699 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-54340a58-5c09-45f3-bb3a-e4374c1f9987 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:43:28.667950 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-54340a58-5c09-45f3-bb3a-e4374c1f9987 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:43:28.669919 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-54340a58-5c09-45f3-bb3a-e4374c1f9987 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:43:28.672691 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-54340a58-5c09-45f3-bb3a-e4374c1f9987 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:43:28.674579 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-54340a58-5c09-45f3-bb3a-e4374c1f9987 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:43:29.029487 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-54340a58-5c09-45f3-bb3a-e4374c1f9987 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a39c9dd3e4213b01e4d7d7a5bdd65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eba8c9b474649f39f90b39d0789c2ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:43:29.044750 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-54340a58-5c09-45f3-bb3a-e4374c1f9987 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] 10.222.0.52 "GET /compute/v2.1/servers/9951ce3f-2f16-41d6-b1e6-dab4016d294d" status: 200 len: 1324 microversion: 2.1 time: 0.412543 Oct 19 03:43:29.063556 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2954/5839] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:43:28 2022] GET /compute/v2.1/servers/9951ce3f-2f16-41d6-b1e6-dab4016d294d => generated 1324 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:43:29.994053 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-291fde97-9655-4415-966c-e5dc681d0b54 req-be500bf7-c7cd-4822-b732-e1971ae471f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9951ce3f-2f16-41d6-b1e6-dab4016d294d", "tag": "d6f9f528-0991-4ab0-a97c-375bc43d83c8"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:43:30.004242 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-291fde97-9655-4415-966c-e5dc681d0b54 req-be500bf7-c7cd-4822-b732-e1971ae471f7 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:43:30.005582 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-291fde97-9655-4415-966c-e5dc681d0b54 req-be500bf7-c7cd-4822-b732-e1971ae471f7 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:43:30.020135 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-291fde97-9655-4415-966c-e5dc681d0b54 req-be500bf7-c7cd-4822-b732-e1971ae471f7 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:43:30.058182 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-291fde97-9655-4415-966c-e5dc681d0b54 req-be500bf7-c7cd-4822-b732-e1971ae471f7 service nova] Creating event network-changed:d6f9f528-0991-4ab0-a97c-375bc43d83c8 for instance 9951ce3f-2f16-41d6-b1e6-dab4016d294d on n-h2-861333-8 Oct 19 03:43:30.070147 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-afa2b7d9-e695-4adc-abb8-1b958c94d1ea tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:43:30.070856 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-afa2b7d9-e695-4adc-abb8-1b958c94d1ea tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] [instance: 9951ce3f-2f16-41d6-b1e6-dab4016d294d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:43:30.077108 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-291fde97-9655-4415-966c-e5dc681d0b54 req-be500bf7-c7cd-4822-b732-e1971ae471f7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.338373 Oct 19 03:43:30.077767 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2886/5840] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:43:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:43:30.080223 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-afa2b7d9-e695-4adc-abb8-1b958c94d1ea tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:43:30.080930 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-afa2b7d9-e695-4adc-abb8-1b958c94d1ea tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:43:30.081576 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-afa2b7d9-e695-4adc-abb8-1b958c94d1ea tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:43:30.082592 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-afa2b7d9-e695-4adc-abb8-1b958c94d1ea tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:43:30.082955 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-afa2b7d9-e695-4adc-abb8-1b958c94d1ea tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:43:30.083917 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-afa2b7d9-e695-4adc-abb8-1b958c94d1ea tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:43:30.325210 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-afa2b7d9-e695-4adc-abb8-1b958c94d1ea tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a39c9dd3e4213b01e4d7d7a5bdd65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eba8c9b474649f39f90b39d0789c2ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:43:30.334209 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-afa2b7d9-e695-4adc-abb8-1b958c94d1ea tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] 10.222.0.52 "GET /compute/v2.1/servers/9951ce3f-2f16-41d6-b1e6-dab4016d294d" status: 200 len: 1324 microversion: 2.1 time: 0.268431 Oct 19 03:43:30.344697 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2955/5841] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:43:30 2022] GET /compute/v2.1/servers/9951ce3f-2f16-41d6-b1e6-dab4016d294d => generated 1324 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:43:31.360206 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-922d6fbf-8688-499f-bf0d-f9d609f933b5 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:43:31.360913 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-922d6fbf-8688-499f-bf0d-f9d609f933b5 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] [instance: 9951ce3f-2f16-41d6-b1e6-dab4016d294d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:43:31.373752 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-922d6fbf-8688-499f-bf0d-f9d609f933b5 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:43:31.374267 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-922d6fbf-8688-499f-bf0d-f9d609f933b5 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:43:31.374701 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-922d6fbf-8688-499f-bf0d-f9d609f933b5 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:43:31.377667 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-922d6fbf-8688-499f-bf0d-f9d609f933b5 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:43:31.378126 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-922d6fbf-8688-499f-bf0d-f9d609f933b5 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:43:31.379345 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-922d6fbf-8688-499f-bf0d-f9d609f933b5 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:43:31.614015 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-922d6fbf-8688-499f-bf0d-f9d609f933b5 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a39c9dd3e4213b01e4d7d7a5bdd65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eba8c9b474649f39f90b39d0789c2ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:43:31.630467 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-922d6fbf-8688-499f-bf0d-f9d609f933b5 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] 10.222.0.52 "GET /compute/v2.1/servers/9951ce3f-2f16-41d6-b1e6-dab4016d294d" status: 200 len: 1324 microversion: 2.1 time: 0.273592 Oct 19 03:43:31.647883 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2887/5842] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:43:31 2022] GET /compute/v2.1/servers/9951ce3f-2f16-41d6-b1e6-dab4016d294d => generated 1324 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:43:32.660948 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:43:32.669451 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-87d2e02d-4552-4944-ac0d-485973af5994 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:43:32.670347 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-87d2e02d-4552-4944-ac0d-485973af5994 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] [instance: 9951ce3f-2f16-41d6-b1e6-dab4016d294d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:43:32.689682 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-87d2e02d-4552-4944-ac0d-485973af5994 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:43:32.690176 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-87d2e02d-4552-4944-ac0d-485973af5994 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:43:32.698481 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-87d2e02d-4552-4944-ac0d-485973af5994 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:43:32.700404 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-87d2e02d-4552-4944-ac0d-485973af5994 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:43:32.704352 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-87d2e02d-4552-4944-ac0d-485973af5994 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:43:32.705055 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-87d2e02d-4552-4944-ac0d-485973af5994 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:43:33.008314 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-87d2e02d-4552-4944-ac0d-485973af5994 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a39c9dd3e4213b01e4d7d7a5bdd65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eba8c9b474649f39f90b39d0789c2ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:43:33.018933 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-87d2e02d-4552-4944-ac0d-485973af5994 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] 10.222.0.52 "GET /compute/v2.1/servers/9951ce3f-2f16-41d6-b1e6-dab4016d294d" status: 200 len: 1324 microversion: 2.1 time: 0.361094 Oct 19 03:43:33.026131 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2956/5843] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:43:32 2022] GET /compute/v2.1/servers/9951ce3f-2f16-41d6-b1e6-dab4016d294d => generated 1324 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:43:34.051195 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-692e82d5-6d85-4b9c-8eb0-4bcd062a84ba tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:43:34.051938 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-692e82d5-6d85-4b9c-8eb0-4bcd062a84ba tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] [instance: 9951ce3f-2f16-41d6-b1e6-dab4016d294d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:43:34.059052 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:43:34.062063 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-692e82d5-6d85-4b9c-8eb0-4bcd062a84ba tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:43:34.062979 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-692e82d5-6d85-4b9c-8eb0-4bcd062a84ba tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:43:34.063453 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-692e82d5-6d85-4b9c-8eb0-4bcd062a84ba tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:43:34.064357 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-692e82d5-6d85-4b9c-8eb0-4bcd062a84ba tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:43:34.064929 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-692e82d5-6d85-4b9c-8eb0-4bcd062a84ba tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:43:34.065256 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-692e82d5-6d85-4b9c-8eb0-4bcd062a84ba tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:43:34.267780 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-692e82d5-6d85-4b9c-8eb0-4bcd062a84ba tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a39c9dd3e4213b01e4d7d7a5bdd65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eba8c9b474649f39f90b39d0789c2ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:43:34.286366 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-692e82d5-6d85-4b9c-8eb0-4bcd062a84ba tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] 10.222.0.52 "GET /compute/v2.1/servers/9951ce3f-2f16-41d6-b1e6-dab4016d294d" status: 200 len: 1324 microversion: 2.1 time: 0.239419 Oct 19 03:43:34.288675 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2888/5844] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:43:34 2022] GET /compute/v2.1/servers/9951ce3f-2f16-41d6-b1e6-dab4016d294d => generated 1324 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:43:35.031973 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-f83e8beb-047d-4e07-9938-f606bd535475 req-364e1343-ce46-49b1-b8b3-328ccf58446b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9951ce3f-2f16-41d6-b1e6-dab4016d294d", "name": "network-vif-plugged", "status": "completed", "tag": "d6f9f528-0991-4ab0-a97c-375bc43d83c8"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:43:35.038584 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=8 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:43:35.044351 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-f83e8beb-047d-4e07-9938-f606bd535475 req-364e1343-ce46-49b1-b8b3-328ccf58446b service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:43:35.044655 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-f83e8beb-047d-4e07-9938-f606bd535475 req-364e1343-ce46-49b1-b8b3-328ccf58446b service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:43:35.045017 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-f83e8beb-047d-4e07-9938-f606bd535475 req-364e1343-ce46-49b1-b8b3-328ccf58446b service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:43:35.057127 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-f83e8beb-047d-4e07-9938-f606bd535475 req-364e1343-ce46-49b1-b8b3-328ccf58446b service nova] Creating event network-vif-plugged:d6f9f528-0991-4ab0-a97c-375bc43d83c8 for instance 9951ce3f-2f16-41d6-b1e6-dab4016d294d on n-h2-861333-8 Oct 19 03:43:35.065387 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-f83e8beb-047d-4e07-9938-f606bd535475 req-364e1343-ce46-49b1-b8b3-328ccf58446b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037949 Oct 19 03:43:35.066316 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2957/5845] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:43:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:43:35.315174 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b2f951eb-168d-4d3f-a3c0-e489c0ed82ee tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:43:35.315174 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b2f951eb-168d-4d3f-a3c0-e489c0ed82ee tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] [instance: 9951ce3f-2f16-41d6-b1e6-dab4016d294d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:43:35.330146 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b2f951eb-168d-4d3f-a3c0-e489c0ed82ee tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:43:35.330785 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b2f951eb-168d-4d3f-a3c0-e489c0ed82ee tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:43:35.332464 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b2f951eb-168d-4d3f-a3c0-e489c0ed82ee tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:43:35.334493 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b2f951eb-168d-4d3f-a3c0-e489c0ed82ee tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:43:35.336675 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b2f951eb-168d-4d3f-a3c0-e489c0ed82ee tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:43:35.338368 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b2f951eb-168d-4d3f-a3c0-e489c0ed82ee tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:43:35.630219 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b2f951eb-168d-4d3f-a3c0-e489c0ed82ee tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a39c9dd3e4213b01e4d7d7a5bdd65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eba8c9b474649f39f90b39d0789c2ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:43:35.643391 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b2f951eb-168d-4d3f-a3c0-e489c0ed82ee tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] 10.222.0.52 "GET /compute/v2.1/servers/9951ce3f-2f16-41d6-b1e6-dab4016d294d" status: 200 len: 1324 microversion: 2.1 time: 0.335503 Oct 19 03:43:35.645616 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2889/5846] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:43:35 2022] GET /compute/v2.1/servers/9951ce3f-2f16-41d6-b1e6-dab4016d294d => generated 1324 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:43:36.670366 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5a1b298e-07b3-4122-b200-3854f533f252 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:43:36.683719 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-5a1b298e-07b3-4122-b200-3854f533f252 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] [instance: 9951ce3f-2f16-41d6-b1e6-dab4016d294d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:43:36.694406 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5a1b298e-07b3-4122-b200-3854f533f252 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:43:36.697693 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5a1b298e-07b3-4122-b200-3854f533f252 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:43:36.698146 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5a1b298e-07b3-4122-b200-3854f533f252 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:43:36.699136 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5a1b298e-07b3-4122-b200-3854f533f252 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:43:36.699605 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5a1b298e-07b3-4122-b200-3854f533f252 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:43:36.700044 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5a1b298e-07b3-4122-b200-3854f533f252 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:43:36.992349 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-5a1b298e-07b3-4122-b200-3854f533f252 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a39c9dd3e4213b01e4d7d7a5bdd65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eba8c9b474649f39f90b39d0789c2ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:43:37.005840 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5a1b298e-07b3-4122-b200-3854f533f252 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] 10.222.0.52 "GET /compute/v2.1/servers/9951ce3f-2f16-41d6-b1e6-dab4016d294d" status: 200 len: 1324 microversion: 2.1 time: 0.338639 Oct 19 03:43:37.019204 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2958/5847] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:43:36 2022] GET /compute/v2.1/servers/9951ce3f-2f16-41d6-b1e6-dab4016d294d => generated 1324 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:43:38.034075 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b1663df0-35b0-4a4e-9204-dfd27b9377bb tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:43:38.034692 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b1663df0-35b0-4a4e-9204-dfd27b9377bb tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] [instance: 9951ce3f-2f16-41d6-b1e6-dab4016d294d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:43:38.045401 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b1663df0-35b0-4a4e-9204-dfd27b9377bb tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:43:38.049515 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b1663df0-35b0-4a4e-9204-dfd27b9377bb tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:43:38.050125 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b1663df0-35b0-4a4e-9204-dfd27b9377bb tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:43:38.054589 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b1663df0-35b0-4a4e-9204-dfd27b9377bb tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:43:38.054589 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b1663df0-35b0-4a4e-9204-dfd27b9377bb tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:43:38.054589 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b1663df0-35b0-4a4e-9204-dfd27b9377bb tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:43:38.386318 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b1663df0-35b0-4a4e-9204-dfd27b9377bb tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a39c9dd3e4213b01e4d7d7a5bdd65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eba8c9b474649f39f90b39d0789c2ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:43:38.403966 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b1663df0-35b0-4a4e-9204-dfd27b9377bb tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] 10.222.0.52 "GET /compute/v2.1/servers/9951ce3f-2f16-41d6-b1e6-dab4016d294d" status: 200 len: 1522 microversion: 2.1 time: 0.372140 Oct 19 03:43:38.404697 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2890/5848] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:43:38 2022] GET /compute/v2.1/servers/9951ce3f-2f16-41d6-b1e6-dab4016d294d => generated 1522 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:43:38.433892 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c5e62568-07d0-4946-a7fe-3db205253781 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:43:38.438824 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c5e62568-07d0-4946-a7fe-3db205253781 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] [instance: 9951ce3f-2f16-41d6-b1e6-dab4016d294d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:43:38.446308 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c5e62568-07d0-4946-a7fe-3db205253781 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:43:38.449194 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c5e62568-07d0-4946-a7fe-3db205253781 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:43:38.449802 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c5e62568-07d0-4946-a7fe-3db205253781 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:43:38.456665 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c5e62568-07d0-4946-a7fe-3db205253781 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:43:38.457259 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c5e62568-07d0-4946-a7fe-3db205253781 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:43:38.460030 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c5e62568-07d0-4946-a7fe-3db205253781 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:43:38.471288 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4a116a6b-9f0b-4478-a0be-4bc36ee040e5 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:43:38.476122 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4a116a6b-9f0b-4478-a0be-4bc36ee040e5 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] [instance: a5cf37d5-2405-4ca7-b637-070a456f667f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:43:38.486116 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4a116a6b-9f0b-4478-a0be-4bc36ee040e5 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:43:38.486869 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4a116a6b-9f0b-4478-a0be-4bc36ee040e5 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:43:38.488420 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4a116a6b-9f0b-4478-a0be-4bc36ee040e5 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:43:38.490691 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4a116a6b-9f0b-4478-a0be-4bc36ee040e5 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:43:38.492027 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4a116a6b-9f0b-4478-a0be-4bc36ee040e5 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:43:38.492631 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4a116a6b-9f0b-4478-a0be-4bc36ee040e5 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:43:38.540795 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-c5e62568-07d0-4946-a7fe-3db205253781 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] HTTP exception thrown: Action 999 not found Oct 19 03:43:38.550855 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c5e62568-07d0-4946-a7fe-3db205253781 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Request method failure captured: Oct 19 03:43:38.550855 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/9951ce3f-2f16-41d6-b1e6-dab4016d294d/os-instance-actions/999 HTTP/1.1 Oct 19 03:43:38.550855 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:43:38.550855 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:43:38.550855 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:43:38.550855 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:43:38.550855 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:43:38.550855 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:43:38.550855 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:43:38.550855 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:43:38.550855 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT3JYXv2gK49TeqRmqRJXHdMVHDvagnZxY4oOgKuXeRz4vKe6O0SajiowQ6uE6Y4WED1wb9dmNKGEKRss2BWRkiV_bW-TuIiKdA-zKnGtVoyi43b3AgOJPwIOV_CA2QxYCqWu1PiWMD86z0-D7aNZibr7whNz4euCHWAJxSd_39Zom4o Oct 19 03:43:38.550855 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:43:38.550855 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:43:38.550855 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:43:38.550855 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:43:38.550855 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:43:38.550855 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:43:38.550855 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 2eba8c9b474649f39f90b39d0789c2ee Oct 19 03:43:38.550855 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-418138705 Oct 19 03:43:38.550855 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:43:38.550855 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:43:38.550855 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2eba8c9b474649f39f90b39d0789c2ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2eba8c9b474649f39f90b39d0789c2ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2eba8c9b474649f39f90b39d0789c2ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2eba8c9b474649f39f90b39d0789c2ee", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:43:38.550855 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-418138705 Oct 19 03:43:38.550855 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 2eba8c9b474649f39f90b39d0789c2ee Oct 19 03:43:38.550855 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-418138705 Oct 19 03:43:38.550855 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-InstanceActionsNegativeTestJSON-418138705-project Oct 19 03:43:38.550855 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:43:38.550855 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:43:38.550855 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: e75a39c9dd3e4213b01e4d7d7a5bdd65 Oct 19 03:43:38.550855 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-418138705-project Oct 19 03:43:38.550855 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:43:38.550855 n-d-861333-8 devstack@n-api.service[121135]: exception: Action 999 not found Oct 19 03:43:38.550855 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'server_id': '9951ce3f-2f16-41d6-b1e6-dab4016d294d', 'id': '999'} Oct 19 03:43:38.550855 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:43:38.550855 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:43:38.550855 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:43:38.550855 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:43:38.550855 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:43:38.550855 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:43:38.550855 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:43:38.550855 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:43:38.550855 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Oct 19 03:43:38.550855 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 19 03:43:38.550855 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Oct 19 03:43:38.550855 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:43:38.550855 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:43:38.550855 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:43:38.550855 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:43:38.550855 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:43:38.550855 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:43:38.550855 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:43:38.550855 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:43:38.550855 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Oct 19 03:43:38.550855 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:43:38.557858 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c5e62568-07d0-4946-a7fe-3db205253781 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Returning 404 to user: Action 999 not found {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:43:38.559016 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c5e62568-07d0-4946-a7fe-3db205253781 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] 10.222.0.52 "GET /compute/v2.1/servers/9951ce3f-2f16-41d6-b1e6-dab4016d294d/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.130147 Oct 19 03:43:38.560205 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2959/5849] 10.222.0.52 () {58 vars in 1308 bytes} [Wed Oct 19 03:43:38 2022] GET /compute/v2.1/servers/9951ce3f-2f16-41d6-b1e6-dab4016d294d/os-instance-actions/999 => generated 66 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 03:43:38.570521 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e53d7b75-20de-47de-9986-d205c69f51b2 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Calling method '.version_select at 0x7fc12bd62280>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:43:38.572751 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e53d7b75-20de-47de-9986-d205c69f51b2 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] [instance: da6cdc63-df87-4231-9b59-3552b280eb87] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:43:38.576317 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4a116a6b-9f0b-4478-a0be-4bc36ee040e5 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] 10.222.0.52 "POST /compute/v2.1/servers/a5cf37d5-2405-4ca7-b637-070a456f667f/action" status: 200 len: 32635 microversion: 2.1 time: 0.114760 Oct 19 03:43:38.577013 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2891/5850] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:43:38 2022] POST /compute/v2.1/servers/a5cf37d5-2405-4ca7-b637-070a456f667f/action => generated 32635 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 03:43:38.587279 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-e53d7b75-20de-47de-9986-d205c69f51b2 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] HTTP exception thrown: Instance da6cdc63-df87-4231-9b59-3552b280eb87 could not be found. Oct 19 03:43:38.591962 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e53d7b75-20de-47de-9986-d205c69f51b2 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Request method failure captured: Oct 19 03:43:38.591962 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/da6cdc63-df87-4231-9b59-3552b280eb87/os-instance-actions HTTP/1.1 Oct 19 03:43:38.591962 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:43:38.591962 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:43:38.591962 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:43:38.591962 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:43:38.591962 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:43:38.591962 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:43:38.591962 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:43:38.591962 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:43:38.591962 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT3JYXv2gK49TeqRmqRJXHdMVHDvagnZxY4oOgKuXeRz4vKe6O0SajiowQ6uE6Y4WED1wb9dmNKGEKRss2BWRkiV_bW-TuIiKdA-zKnGtVoyi43b3AgOJPwIOV_CA2QxYCqWu1PiWMD86z0-D7aNZibr7whNz4euCHWAJxSd_39Zom4o Oct 19 03:43:38.591962 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:43:38.591962 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:43:38.591962 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:43:38.591962 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:43:38.591962 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:43:38.591962 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:43:38.591962 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 2eba8c9b474649f39f90b39d0789c2ee Oct 19 03:43:38.591962 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-418138705 Oct 19 03:43:38.591962 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:43:38.591962 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:43:38.591962 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2eba8c9b474649f39f90b39d0789c2ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2eba8c9b474649f39f90b39d0789c2ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2eba8c9b474649f39f90b39d0789c2ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2eba8c9b474649f39f90b39d0789c2ee", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:43:38.591962 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-418138705 Oct 19 03:43:38.591962 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 2eba8c9b474649f39f90b39d0789c2ee Oct 19 03:43:38.591962 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-418138705 Oct 19 03:43:38.591962 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-InstanceActionsNegativeTestJSON-418138705-project Oct 19 03:43:38.591962 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:43:38.591962 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:43:38.591962 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: e75a39c9dd3e4213b01e4d7d7a5bdd65 Oct 19 03:43:38.591962 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-418138705-project Oct 19 03:43:38.591962 n-d-861333-8 devstack@n-api.service[121135]: method: Oct 19 03:43:38.591962 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance da6cdc63-df87-4231-9b59-3552b280eb87 could not be found. Oct 19 03:43:38.591962 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'server_id': 'da6cdc63-df87-4231-9b59-3552b280eb87'} Oct 19 03:43:38.591962 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:43:38.591962 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:43:38.591962 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:43:38.591962 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:43:38.591962 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:43:38.591962 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:43:38.591962 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 19 03:43:38.591962 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 19 03:43:38.591962 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da6cdc63-df87-4231-9b59-3552b280eb87 could not be found. Oct 19 03:43:38.591962 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:43:38.591962 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:43:38.591962 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:43:38.591962 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:43:38.591962 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:43:38.591962 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:43:38.591962 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:43:38.591962 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:43:38.591962 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 03:43:38.591962 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 03:43:38.591962 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:43:38.591962 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:43:38.591962 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Oct 19 03:43:38.591962 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Oct 19 03:43:38.591962 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 03:43:38.591962 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 03:43:38.591962 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Oct 19 03:43:38.591962 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Oct 19 03:43:38.591962 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:43:38.591962 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:43:38.596031 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da6cdc63-df87-4231-9b59-3552b280eb87 could not be found. Oct 19 03:43:38.596031 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:43:38.596031 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:43:38.596031 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:43:38.596031 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:43:38.596031 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:43:38.596031 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:43:38.596031 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:43:38.596031 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:43:38.596031 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da6cdc63-df87-4231-9b59-3552b280eb87 could not be found. Oct 19 03:43:38.596031 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:43:38.602962 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e53d7b75-20de-47de-9986-d205c69f51b2 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Returning 404 to user: Instance da6cdc63-df87-4231-9b59-3552b280eb87 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:43:38.608459 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e53d7b75-20de-47de-9986-d205c69f51b2 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] 10.222.0.52 "GET /compute/v2.1/servers/da6cdc63-df87-4231-9b59-3552b280eb87/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.043000 Oct 19 03:43:38.610245 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2960/5851] 10.222.0.52 () {58 vars in 1296 bytes} [Wed Oct 19 03:43:38 2022] GET /compute/v2.1/servers/da6cdc63-df87-4231-9b59-3552b280eb87/os-instance-actions => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 03:43:38.619576 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8877e3ab-8221-4b55-9cca-9224dd2175ec tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:43:38.620256 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8877e3ab-8221-4b55-9cca-9224dd2175ec tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] [instance: 9951ce3f-2f16-41d6-b1e6-dab4016d294d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:43:38.656444 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8877e3ab-8221-4b55-9cca-9224dd2175ec tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:43:38.656444 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8877e3ab-8221-4b55-9cca-9224dd2175ec tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:43:38.656444 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8877e3ab-8221-4b55-9cca-9224dd2175ec tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:43:38.656444 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8877e3ab-8221-4b55-9cca-9224dd2175ec tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:43:38.656444 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8877e3ab-8221-4b55-9cca-9224dd2175ec tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:43:38.656444 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8877e3ab-8221-4b55-9cca-9224dd2175ec tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:43:38.683070 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8877e3ab-8221-4b55-9cca-9224dd2175ec tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] [instance: 9951ce3f-2f16-41d6-b1e6-dab4016d294d] Going to try to terminate instance {{(pid=121134) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:43:39.068804 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8877e3ab-8221-4b55-9cca-9224dd2175ec tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] 10.222.0.52 "DELETE /compute/v2.1/servers/9951ce3f-2f16-41d6-b1e6-dab4016d294d" status: 204 len: 0 microversion: 2.1 time: 0.453088 Oct 19 03:43:39.070715 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2892/5852] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:43:38 2022] DELETE /compute/v2.1/servers/9951ce3f-2f16-41d6-b1e6-dab4016d294d => generated 0 bytes in 456 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:43:39.079591 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ce31436d-9bf8-4ec9-95fd-9716b29b21a2 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:43:39.080362 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ce31436d-9bf8-4ec9-95fd-9716b29b21a2 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] [instance: 9951ce3f-2f16-41d6-b1e6-dab4016d294d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:43:39.096123 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ce31436d-9bf8-4ec9-95fd-9716b29b21a2 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:43:39.096728 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ce31436d-9bf8-4ec9-95fd-9716b29b21a2 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:43:39.097276 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ce31436d-9bf8-4ec9-95fd-9716b29b21a2 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:43:39.098169 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ce31436d-9bf8-4ec9-95fd-9716b29b21a2 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:43:39.098733 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ce31436d-9bf8-4ec9-95fd-9716b29b21a2 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:43:39.110042 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ce31436d-9bf8-4ec9-95fd-9716b29b21a2 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:43:39.404532 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ce31436d-9bf8-4ec9-95fd-9716b29b21a2 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a39c9dd3e4213b01e4d7d7a5bdd65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eba8c9b474649f39f90b39d0789c2ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:43:39.427478 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ce31436d-9bf8-4ec9-95fd-9716b29b21a2 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] 10.222.0.52 "GET /compute/v2.1/servers/9951ce3f-2f16-41d6-b1e6-dab4016d294d" status: 200 len: 1528 microversion: 2.1 time: 0.350994 Oct 19 03:43:39.431273 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2961/5853] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:43:39 2022] GET /compute/v2.1/servers/9951ce3f-2f16-41d6-b1e6-dab4016d294d => generated 1528 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:43:40.453181 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a94b5da2-3421-460f-9df3-cf1fed8babdc tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:43:40.454200 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a94b5da2-3421-460f-9df3-cf1fed8babdc tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] [instance: 9951ce3f-2f16-41d6-b1e6-dab4016d294d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:43:40.478010 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a94b5da2-3421-460f-9df3-cf1fed8babdc tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:43:40.478010 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a94b5da2-3421-460f-9df3-cf1fed8babdc tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:43:40.480188 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a94b5da2-3421-460f-9df3-cf1fed8babdc tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:43:40.481043 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a94b5da2-3421-460f-9df3-cf1fed8babdc tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:43:40.484156 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a94b5da2-3421-460f-9df3-cf1fed8babdc tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:43:40.484683 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a94b5da2-3421-460f-9df3-cf1fed8babdc tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:43:41.792949 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a94b5da2-3421-460f-9df3-cf1fed8babdc tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a39c9dd3e4213b01e4d7d7a5bdd65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eba8c9b474649f39f90b39d0789c2ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:43:41.802178 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a94b5da2-3421-460f-9df3-cf1fed8babdc tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] 10.222.0.52 "GET /compute/v2.1/servers/9951ce3f-2f16-41d6-b1e6-dab4016d294d" status: 200 len: 1528 microversion: 2.1 time: 1.352557 Oct 19 03:43:41.822349 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2893/5854] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:43:40 2022] GET /compute/v2.1/servers/9951ce3f-2f16-41d6-b1e6-dab4016d294d => generated 1528 bytes in 1374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:43:42.377305 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a4a84587-4de3-4cef-9a0f-6a986d94c12d tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:43:42.378150 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a4a84587-4de3-4cef-9a0f-6a986d94c12d tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] [instance: a5cf37d5-2405-4ca7-b637-070a456f667f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:43:42.387130 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a4a84587-4de3-4cef-9a0f-6a986d94c12d tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:43:42.387950 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a4a84587-4de3-4cef-9a0f-6a986d94c12d tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:43:42.388778 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a4a84587-4de3-4cef-9a0f-6a986d94c12d tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:43:42.389750 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a4a84587-4de3-4cef-9a0f-6a986d94c12d tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:43:42.390576 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a4a84587-4de3-4cef-9a0f-6a986d94c12d tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:43:42.391507 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a4a84587-4de3-4cef-9a0f-6a986d94c12d tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:43:42.430563 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a4a84587-4de3-4cef-9a0f-6a986d94c12d tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] [instance: a5cf37d5-2405-4ca7-b637-070a456f667f] Going to try to terminate instance {{(pid=121135) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:43:42.555809 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-dfed81a5-87da-490c-a4b5-4376f246a30b req-b6a6b59c-f099-4c8f-965c-31e98d28797b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5cf37d5-2405-4ca7-b637-070a456f667f", "tag": "68555c4d-503f-438a-ad62-45fd83f555da"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:43:42.575768 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-dfed81a5-87da-490c-a4b5-4376f246a30b req-b6a6b59c-f099-4c8f-965c-31e98d28797b service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:43:42.576251 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-dfed81a5-87da-490c-a4b5-4376f246a30b req-b6a6b59c-f099-4c8f-965c-31e98d28797b service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:43:42.581086 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-dfed81a5-87da-490c-a4b5-4376f246a30b req-b6a6b59c-f099-4c8f-965c-31e98d28797b service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:43:42.608911 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-dfed81a5-87da-490c-a4b5-4376f246a30b req-b6a6b59c-f099-4c8f-965c-31e98d28797b service nova] Creating event network-changed:68555c4d-503f-438a-ad62-45fd83f555da for instance a5cf37d5-2405-4ca7-b637-070a456f667f on n-h1-861333-8 Oct 19 03:43:42.616302 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-dfed81a5-87da-490c-a4b5-4376f246a30b req-b6a6b59c-f099-4c8f-965c-31e98d28797b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066100 Oct 19 03:43:42.617412 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2894/5855] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:43:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:43:42.833983 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a4a84587-4de3-4cef-9a0f-6a986d94c12d tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] 10.222.0.52 "DELETE /compute/v2.1/servers/a5cf37d5-2405-4ca7-b637-070a456f667f" status: 204 len: 0 microversion: 2.1 time: 0.460437 Oct 19 03:43:42.840363 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ea2487d7-47dc-4405-a5c4-c47827988d51 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:43:42.840363 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ea2487d7-47dc-4405-a5c4-c47827988d51 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] [instance: 9951ce3f-2f16-41d6-b1e6-dab4016d294d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:43:42.841883 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2962/5856] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:43:42 2022] DELETE /compute/v2.1/servers/a5cf37d5-2405-4ca7-b637-070a456f667f => generated 0 bytes in 469 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:43:42.856708 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-773e5fb8-d28b-4ed5-8dd7-a2964ffff3cd tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:43:42.860524 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-773e5fb8-d28b-4ed5-8dd7-a2964ffff3cd tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] [instance: a5cf37d5-2405-4ca7-b637-070a456f667f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:43:42.866602 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ea2487d7-47dc-4405-a5c4-c47827988d51 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:43:42.871354 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ea2487d7-47dc-4405-a5c4-c47827988d51 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:43:42.871903 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ea2487d7-47dc-4405-a5c4-c47827988d51 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:43:42.872887 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ea2487d7-47dc-4405-a5c4-c47827988d51 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:43:42.874999 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-773e5fb8-d28b-4ed5-8dd7-a2964ffff3cd tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:43:42.876972 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ea2487d7-47dc-4405-a5c4-c47827988d51 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:43:42.878772 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ea2487d7-47dc-4405-a5c4-c47827988d51 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:43:42.881580 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-773e5fb8-d28b-4ed5-8dd7-a2964ffff3cd tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:43:42.882342 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-773e5fb8-d28b-4ed5-8dd7-a2964ffff3cd tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:43:42.883422 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-773e5fb8-d28b-4ed5-8dd7-a2964ffff3cd tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:43:42.886971 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-773e5fb8-d28b-4ed5-8dd7-a2964ffff3cd tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:43:42.887816 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-773e5fb8-d28b-4ed5-8dd7-a2964ffff3cd tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:43:43.712274 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-773e5fb8-d28b-4ed5-8dd7-a2964ffff3cd tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4670fd4408d4454784251a880d5a72f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf91777fa414ddaa797d735e7d2a275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:43:43.745984 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-773e5fb8-d28b-4ed5-8dd7-a2964ffff3cd tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] 10.222.0.52 "GET /compute/v2.1/servers/a5cf37d5-2405-4ca7-b637-070a456f667f" status: 200 len: 1670 microversion: 2.1 time: 0.899308 Oct 19 03:43:43.748220 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2963/5857] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:43:42 2022] GET /compute/v2.1/servers/a5cf37d5-2405-4ca7-b637-070a456f667f => generated 1670 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:43:43.997483 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ea2487d7-47dc-4405-a5c4-c47827988d51 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a39c9dd3e4213b01e4d7d7a5bdd65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eba8c9b474649f39f90b39d0789c2ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:43:44.005569 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ea2487d7-47dc-4405-a5c4-c47827988d51 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] 10.222.0.52 "GET /compute/v2.1/servers/9951ce3f-2f16-41d6-b1e6-dab4016d294d" status: 200 len: 1528 microversion: 2.1 time: 1.175694 Oct 19 03:43:44.008892 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2895/5858] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:43:42 2022] GET /compute/v2.1/servers/9951ce3f-2f16-41d6-b1e6-dab4016d294d => generated 1528 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:43:44.654000 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-4e1ff81c-b979-4508-8dea-4cf4355a7fbe req-c9f5bc0d-654f-43b3-8078-419e6088685c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9951ce3f-2f16-41d6-b1e6-dab4016d294d", "name": "network-vif-deleted", "tag": "d6f9f528-0991-4ab0-a97c-375bc43d83c8"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:43:44.698555 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-4e1ff81c-b979-4508-8dea-4cf4355a7fbe req-c9f5bc0d-654f-43b3-8078-419e6088685c service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:43:44.714188 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-4e1ff81c-b979-4508-8dea-4cf4355a7fbe req-c9f5bc0d-654f-43b3-8078-419e6088685c service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:43:44.714903 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-4e1ff81c-b979-4508-8dea-4cf4355a7fbe req-c9f5bc0d-654f-43b3-8078-419e6088685c service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:43:44.746757 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-4e1ff81c-b979-4508-8dea-4cf4355a7fbe req-c9f5bc0d-654f-43b3-8078-419e6088685c service nova] Creating event network-vif-deleted:d6f9f528-0991-4ab0-a97c-375bc43d83c8 for instance 9951ce3f-2f16-41d6-b1e6-dab4016d294d on n-h2-861333-8 Oct 19 03:43:44.763206 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-4e1ff81c-b979-4508-8dea-4cf4355a7fbe req-c9f5bc0d-654f-43b3-8078-419e6088685c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114796 Oct 19 03:43:44.765411 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2964/5859] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:43:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:43:44.776466 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8b8970e6-9a84-402a-83ca-8fff6e24f742 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:43:44.780183 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8b8970e6-9a84-402a-83ca-8fff6e24f742 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] [instance: a5cf37d5-2405-4ca7-b637-070a456f667f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:43:44.789389 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8b8970e6-9a84-402a-83ca-8fff6e24f742 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:43:44.793070 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8b8970e6-9a84-402a-83ca-8fff6e24f742 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:43:44.793804 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8b8970e6-9a84-402a-83ca-8fff6e24f742 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:43:44.794964 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8b8970e6-9a84-402a-83ca-8fff6e24f742 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:43:44.796099 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8b8970e6-9a84-402a-83ca-8fff6e24f742 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:43:44.797567 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8b8970e6-9a84-402a-83ca-8fff6e24f742 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:43:45.033236 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5c9d2726-a83d-429b-a787-977c10eddbd1 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:43:45.034248 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-5c9d2726-a83d-429b-a787-977c10eddbd1 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] [instance: 9951ce3f-2f16-41d6-b1e6-dab4016d294d] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:43:45.048410 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5c9d2726-a83d-429b-a787-977c10eddbd1 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:43:45.049164 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5c9d2726-a83d-429b-a787-977c10eddbd1 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:43:45.049846 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5c9d2726-a83d-429b-a787-977c10eddbd1 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:43:45.050793 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5c9d2726-a83d-429b-a787-977c10eddbd1 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:43:45.052835 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5c9d2726-a83d-429b-a787-977c10eddbd1 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:43:45.053689 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5c9d2726-a83d-429b-a787-977c10eddbd1 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:43:45.118325 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5c9d2726-a83d-429b-a787-977c10eddbd1 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:43:45.119179 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5c9d2726-a83d-429b-a787-977c10eddbd1 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:43:45.119812 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5c9d2726-a83d-429b-a787-977c10eddbd1 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:43:45.120489 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-5c9d2726-a83d-429b-a787-977c10eddbd1 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Lazy-loading 'fault' on Instance uuid 9951ce3f-2f16-41d6-b1e6-dab4016d294d {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:43:45.349248 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-5c9d2726-a83d-429b-a787-977c10eddbd1 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a39c9dd3e4213b01e4d7d7a5bdd65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eba8c9b474649f39f90b39d0789c2ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:43:45.360389 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5c9d2726-a83d-429b-a787-977c10eddbd1 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] 10.222.0.52 "GET /compute/v2.1/servers/9951ce3f-2f16-41d6-b1e6-dab4016d294d" status: 200 len: 1314 microversion: 2.1 time: 0.331803 Oct 19 03:43:45.364203 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2965/5860] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:43:45 2022] GET /compute/v2.1/servers/9951ce3f-2f16-41d6-b1e6-dab4016d294d => generated 1314 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:43:45.421899 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8b8970e6-9a84-402a-83ca-8fff6e24f742 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4670fd4408d4454784251a880d5a72f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf91777fa414ddaa797d735e7d2a275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:43:45.434517 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8b8970e6-9a84-402a-83ca-8fff6e24f742 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] 10.222.0.52 "GET /compute/v2.1/servers/a5cf37d5-2405-4ca7-b637-070a456f667f" status: 200 len: 1670 microversion: 2.1 time: 0.660201 Oct 19 03:43:45.443247 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2896/5861] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:43:44 2022] GET /compute/v2.1/servers/a5cf37d5-2405-4ca7-b637-070a456f667f => generated 1670 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:43:45.552859 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-517c7178-2dce-4c5d-94e2-17a8c04cfee5 req-9362b7a9-c333-4770-bdc8-64325469c2c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5cf37d5-2405-4ca7-b637-070a456f667f", "name": "network-vif-deleted", "tag": "68555c4d-503f-438a-ad62-45fd83f555da"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:43:45.579298 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-517c7178-2dce-4c5d-94e2-17a8c04cfee5 req-9362b7a9-c333-4770-bdc8-64325469c2c7 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:43:45.584902 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-517c7178-2dce-4c5d-94e2-17a8c04cfee5 req-9362b7a9-c333-4770-bdc8-64325469c2c7 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:43:45.584902 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-517c7178-2dce-4c5d-94e2-17a8c04cfee5 req-9362b7a9-c333-4770-bdc8-64325469c2c7 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:43:45.592079 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-517c7178-2dce-4c5d-94e2-17a8c04cfee5 req-9362b7a9-c333-4770-bdc8-64325469c2c7 service nova] Creating event network-vif-deleted:68555c4d-503f-438a-ad62-45fd83f555da for instance a5cf37d5-2405-4ca7-b637-070a456f667f on n-h1-861333-8 Oct 19 03:43:45.607665 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-517c7178-2dce-4c5d-94e2-17a8c04cfee5 req-9362b7a9-c333-4770-bdc8-64325469c2c7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059263 Oct 19 03:43:45.608276 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2966/5862] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:43:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:43:46.391781 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-85e4142f-4fa7-4189-a8e7-5b7730e6a310 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:43:46.392419 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-85e4142f-4fa7-4189-a8e7-5b7730e6a310 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] [instance: 9951ce3f-2f16-41d6-b1e6-dab4016d294d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:43:46.409662 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-85e4142f-4fa7-4189-a8e7-5b7730e6a310 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:43:46.411405 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-85e4142f-4fa7-4189-a8e7-5b7730e6a310 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:43:46.418961 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-85e4142f-4fa7-4189-a8e7-5b7730e6a310 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:43:46.418961 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-85e4142f-4fa7-4189-a8e7-5b7730e6a310 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:43:46.418961 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-85e4142f-4fa7-4189-a8e7-5b7730e6a310 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:43:46.418961 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-85e4142f-4fa7-4189-a8e7-5b7730e6a310 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:43:46.457772 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-85e4142f-4fa7-4189-a8e7-5b7730e6a310 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] HTTP exception thrown: Instance 9951ce3f-2f16-41d6-b1e6-dab4016d294d could not be found. Oct 19 03:43:46.463829 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-85e4142f-4fa7-4189-a8e7-5b7730e6a310 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Request method failure captured: Oct 19 03:43:46.463829 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/9951ce3f-2f16-41d6-b1e6-dab4016d294d HTTP/1.1 Oct 19 03:43:46.463829 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:43:46.463829 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:43:46.463829 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:43:46.463829 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:43:46.463829 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:43:46.463829 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:43:46.463829 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:43:46.463829 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:43:46.463829 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3JYXv2gK49TeqRmqRJXHdMVHDvagnZxY4oOgKuXeRz4vKe6O0SajiowQ6uE6Y4WED1wb9dmNKGEKRss2BWRkiV_bW-TuIiKdA-zKnGtVoyi43b3AgOJPwIOV_CA2QxYCqWu1PiWMD86z0-D7aNZibr7whNz4euCHWAJxSd_39Zom4o Oct 19 03:43:46.463829 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:43:46.463829 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:43:46.463829 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:43:46.463829 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:43:46.463829 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:43:46.463829 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:43:46.463829 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 2eba8c9b474649f39f90b39d0789c2ee Oct 19 03:43:46.463829 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-418138705 Oct 19 03:43:46.463829 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:43:46.463829 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:43:46.463829 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2eba8c9b474649f39f90b39d0789c2ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2eba8c9b474649f39f90b39d0789c2ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2eba8c9b474649f39f90b39d0789c2ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2eba8c9b474649f39f90b39d0789c2ee", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:43:46.463829 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-418138705 Oct 19 03:43:46.463829 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 2eba8c9b474649f39f90b39d0789c2ee Oct 19 03:43:46.463829 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-418138705 Oct 19 03:43:46.463829 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-InstanceActionsNegativeTestJSON-418138705-project Oct 19 03:43:46.463829 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:43:46.463829 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:43:46.463829 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: e75a39c9dd3e4213b01e4d7d7a5bdd65 Oct 19 03:43:46.463829 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-418138705-project Oct 19 03:43:46.463829 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:43:46.463829 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance 9951ce3f-2f16-41d6-b1e6-dab4016d294d could not be found. Oct 19 03:43:46.463829 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '9951ce3f-2f16-41d6-b1e6-dab4016d294d'} Oct 19 03:43:46.463829 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:43:46.463829 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:43:46.463829 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:43:46.463829 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:43:46.463829 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:43:46.463829 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:43:46.463829 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:43:46.463829 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:43:46.463829 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:43:46.463829 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:43:46.463829 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9951ce3f-2f16-41d6-b1e6-dab4016d294d could not be found. Oct 19 03:43:46.463829 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:43:46.463829 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:43:46.463829 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:43:46.463829 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:43:46.463829 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:43:46.463829 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:43:46.463829 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:43:46.463829 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:43:46.463829 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:43:46.463829 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:43:46.463829 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:43:46.463829 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:43:46.463829 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:43:46.463829 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:43:46.463829 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:43:46.463829 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:43:46.463829 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9951ce3f-2f16-41d6-b1e6-dab4016d294d could not be found. Oct 19 03:43:46.463829 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:43:46.463829 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:43:46.475277 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:43:46.475277 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:43:46.475277 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:43:46.475277 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:43:46.475277 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:43:46.475277 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:43:46.475277 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9951ce3f-2f16-41d6-b1e6-dab4016d294d could not be found. Oct 19 03:43:46.475277 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:43:46.476825 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-55644e6a-f902-449b-9d81-9d9f7408089b tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:43:46.477259 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-85e4142f-4fa7-4189-a8e7-5b7730e6a310 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] Returning 404 to user: Instance 9951ce3f-2f16-41d6-b1e6-dab4016d294d could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:43:46.477449 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-55644e6a-f902-449b-9d81-9d9f7408089b tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] [instance: a5cf37d5-2405-4ca7-b637-070a456f667f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:43:46.477596 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-85e4142f-4fa7-4189-a8e7-5b7730e6a310 tempest-InstanceActionsNegativeTestJSON-418138705 tempest-InstanceActionsNegativeTestJSON-418138705-project] 10.222.0.52 "GET /compute/v2.1/servers/9951ce3f-2f16-41d6-b1e6-dab4016d294d" status: 404 len: 111 microversion: 2.1 time: 0.083096 Oct 19 03:43:46.477596 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2897/5863] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:43:46 2022] GET /compute/v2.1/servers/9951ce3f-2f16-41d6-b1e6-dab4016d294d => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:43:46.480681 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-55644e6a-f902-449b-9d81-9d9f7408089b tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:43:46.481183 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-55644e6a-f902-449b-9d81-9d9f7408089b tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:43:46.481666 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-55644e6a-f902-449b-9d81-9d9f7408089b tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:43:46.484141 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-55644e6a-f902-449b-9d81-9d9f7408089b tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:43:46.484639 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-55644e6a-f902-449b-9d81-9d9f7408089b tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:43:46.487548 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-55644e6a-f902-449b-9d81-9d9f7408089b tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:43:46.531829 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-55644e6a-f902-449b-9d81-9d9f7408089b tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:43:46.532706 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-55644e6a-f902-449b-9d81-9d9f7408089b tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:43:46.533396 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-55644e6a-f902-449b-9d81-9d9f7408089b tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:43:46.534078 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-55644e6a-f902-449b-9d81-9d9f7408089b tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lazy-loading 'fault' on Instance uuid a5cf37d5-2405-4ca7-b637-070a456f667f {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:43:46.594335 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-55644e6a-f902-449b-9d81-9d9f7408089b tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4670fd4408d4454784251a880d5a72f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf91777fa414ddaa797d735e7d2a275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:43:46.605578 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-55644e6a-f902-449b-9d81-9d9f7408089b tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] 10.222.0.52 "GET /compute/v2.1/servers/a5cf37d5-2405-4ca7-b637-070a456f667f" status: 200 len: 1339 microversion: 2.1 time: 0.148396 Oct 19 03:43:46.606708 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2967/5864] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:43:46 2022] GET /compute/v2.1/servers/a5cf37d5-2405-4ca7-b637-070a456f667f => generated 1339 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:43:47.631765 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-39a871e6-5f8f-4195-8123-5dbf6da74297 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:43:47.633266 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-39a871e6-5f8f-4195-8123-5dbf6da74297 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] [instance: a5cf37d5-2405-4ca7-b637-070a456f667f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:43:47.658282 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-39a871e6-5f8f-4195-8123-5dbf6da74297 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:43:47.659330 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-39a871e6-5f8f-4195-8123-5dbf6da74297 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:43:47.662071 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-39a871e6-5f8f-4195-8123-5dbf6da74297 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:43:47.665677 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-39a871e6-5f8f-4195-8123-5dbf6da74297 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:43:47.668016 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-39a871e6-5f8f-4195-8123-5dbf6da74297 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:43:47.668684 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-39a871e6-5f8f-4195-8123-5dbf6da74297 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:43:47.748700 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-39a871e6-5f8f-4195-8123-5dbf6da74297 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] HTTP exception thrown: Instance a5cf37d5-2405-4ca7-b637-070a456f667f could not be found. Oct 19 03:43:47.748700 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-39a871e6-5f8f-4195-8123-5dbf6da74297 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Request method failure captured: Oct 19 03:43:47.748700 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/a5cf37d5-2405-4ca7-b637-070a456f667f HTTP/1.1 Oct 19 03:43:47.748700 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:43:47.748700 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:43:47.748700 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:43:47.748700 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:43:47.748700 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:43:47.748700 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:43:47.748700 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:43:47.748700 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:43:47.748700 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3E2AeEMoW-TTWkIwJnaLXssujmdVopIaG0EauE5_lUPoQTPXJr_To2XzFAqBfAgjt-sPXSPB3mvNMM18FY3GNXGy_BQraJqqj4NrkmCgvvRj_VFWZkfvbr7DfNxGYC3Lfg6fBpJNpJhOEVxFRdxu6128Rtc8ehjMT3Rm5I83ry8sPg Oct 19 03:43:47.748700 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:43:47.748700 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:43:47.748700 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:43:47.748700 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:43:47.748700 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:43:47.748700 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:43:47.748700 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 3bf91777fa414ddaa797d735e7d2a275 Oct 19 03:43:47.748700 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-TestNetworkBasicOps-1176039654 Oct 19 03:43:47.748700 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:43:47.748700 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:43:47.748700 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/3bf91777fa414ddaa797d735e7d2a275"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3bf91777fa414ddaa797d735e7d2a275"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3bf91777fa414ddaa797d735e7d2a275"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_3bf91777fa414ddaa797d735e7d2a275", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:43:47.748700 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-TestNetworkBasicOps-1176039654 Oct 19 03:43:47.748700 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 3bf91777fa414ddaa797d735e7d2a275 Oct 19 03:43:47.748700 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-TestNetworkBasicOps-1176039654 Oct 19 03:43:47.748700 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-TestNetworkBasicOps-1176039654-project Oct 19 03:43:47.748700 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:43:47.748700 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:43:47.748700 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 4670fd4408d4454784251a880d5a72f5 Oct 19 03:43:47.748700 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-TestNetworkBasicOps-1176039654-project Oct 19 03:43:47.748700 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:43:47.748700 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance a5cf37d5-2405-4ca7-b637-070a456f667f could not be found. Oct 19 03:43:47.748700 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': 'a5cf37d5-2405-4ca7-b637-070a456f667f'} Oct 19 03:43:47.748700 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:43:47.748700 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:43:47.748700 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:43:47.748700 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:43:47.748700 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:43:47.748700 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:43:47.748700 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:43:47.748700 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:43:47.748700 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:43:47.748700 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:43:47.748700 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5cf37d5-2405-4ca7-b637-070a456f667f could not be found. Oct 19 03:43:47.748700 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:43:47.748700 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:43:47.748700 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:43:47.748700 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:43:47.748700 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:43:47.748700 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:43:47.748700 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:43:47.748700 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:43:47.748700 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:43:47.748700 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:43:47.748700 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:43:47.748700 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:43:47.748700 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:43:47.748700 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:43:47.748700 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:43:47.748700 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:43:47.754569 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5cf37d5-2405-4ca7-b637-070a456f667f could not be found. Oct 19 03:43:47.754569 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:43:47.754569 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:43:47.754569 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:43:47.754569 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:43:47.754569 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:43:47.754569 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:43:47.754569 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:43:47.754569 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:43:47.754569 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5cf37d5-2405-4ca7-b637-070a456f667f could not be found. Oct 19 03:43:47.754569 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:43:47.754569 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-39a871e6-5f8f-4195-8123-5dbf6da74297 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Returning 404 to user: Instance a5cf37d5-2405-4ca7-b637-070a456f667f could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:43:47.754569 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-39a871e6-5f8f-4195-8123-5dbf6da74297 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] 10.222.0.52 "GET /compute/v2.1/servers/a5cf37d5-2405-4ca7-b637-070a456f667f" status: 404 len: 111 microversion: 2.1 time: 0.099344 Oct 19 03:43:47.754569 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2898/5865] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:43:47 2022] GET /compute/v2.1/servers/a5cf37d5-2405-4ca7-b637-070a456f667f => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:43:48.181643 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-34620323-ec35-4492-8e12-37fa7fe49908 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] Calling method '.version_select at 0x7fc12bd66a60>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:43:48.309731 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-34620323-ec35-4492-8e12-37fa7fe49908 tempest-TestNetworkBasicOps-1176039654 tempest-TestNetworkBasicOps-1176039654-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1295549042" status: 202 len: 0 microversion: 2.1 time: 0.136499 Oct 19 03:43:48.319376 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2968/5866] 10.222.0.52 () {58 vars in 1257 bytes} [Wed Oct 19 03:43:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1295549042 => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:43:50.161006 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1ace1d09-d0a8-4b4a-a833-64abbc0867f9 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-1856287482", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:43:50.230520 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-1ace1d09-d0a8-4b4a-a833-64abbc0867f9 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] validate_networks() for None {{(pid=121134) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:43:50.622709 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-1ace1d09-d0a8-4b4a-a833-64abbc0867f9 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Flavor limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:43:50.623626 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-1ace1d09-d0a8-4b4a-a833-64abbc0867f9 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Image limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:43:50.629685 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-1ace1d09-d0a8-4b4a-a833-64abbc0867f9 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Flavor pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:43:50.629685 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-1ace1d09-d0a8-4b4a-a833-64abbc0867f9 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Image pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:43:50.629685 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-1ace1d09-d0a8-4b4a-a833-64abbc0867f9 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:43:50.638330 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1ace1d09-d0a8-4b4a-a833-64abbc0867f9 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:43:50.638821 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1ace1d09-d0a8-4b4a-a833-64abbc0867f9 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:43:50.639259 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1ace1d09-d0a8-4b4a-a833-64abbc0867f9 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:43:50.640178 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1ace1d09-d0a8-4b4a-a833-64abbc0867f9 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:43:50.641073 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1ace1d09-d0a8-4b4a-a833-64abbc0867f9 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:43:50.641544 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1ace1d09-d0a8-4b4a-a833-64abbc0867f9 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:43:50.662803 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-1ace1d09-d0a8-4b4a-a833-64abbc0867f9 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Getting quotas for project 8dd3b552d16542e888d8205cc983c1b1. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:43:50.668541 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-1ace1d09-d0a8-4b4a-a833-64abbc0867f9 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Getting quotas for user d5eda27d8b6c47b3acd19492f6ecc462 and project 8dd3b552d16542e888d8205cc983c1b1. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:43:50.683866 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1ace1d09-d0a8-4b4a-a833-64abbc0867f9 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Going to run 1 instances... {{(pid=121134) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:43:50.686724 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1ace1d09-d0a8-4b4a-a833-64abbc0867f9 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] [instance: 77e68020-0c84-433d-8a03-c4319aeb99b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:43:50.828381 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1ace1d09-d0a8-4b4a-a833-64abbc0867f9 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.671544 Oct 19 03:43:50.842338 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-18b67f78-fd56-4a0f-8c01-45b4189a925e tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:43:50.843580 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-18b67f78-fd56-4a0f-8c01-45b4189a925e tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] [instance: 77e68020-0c84-433d-8a03-c4319aeb99b6] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:43:50.849916 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2899/5867] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:43:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 694 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 03:43:50.947126 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-18b67f78-fd56-4a0f-8c01-45b4189a925e tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eda27d8b6c47b3acd19492f6ecc462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd3b552d16542e888d8205cc983c1b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:43:50.959296 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-18b67f78-fd56-4a0f-8c01-45b4189a925e tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] 10.222.0.52 "GET /compute/v2.1/servers/77e68020-0c84-433d-8a03-c4319aeb99b6" status: 200 len: 1214 microversion: 2.1 time: 0.121820 Oct 19 03:43:50.968351 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2969/5868] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:43:50 2022] GET /compute/v2.1/servers/77e68020-0c84-433d-8a03-c4319aeb99b6 => generated 1214 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:43:51.985772 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0cabdb11-b52f-4639-8629-e3d6979b1bc5 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:43:51.986453 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0cabdb11-b52f-4639-8629-e3d6979b1bc5 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] [instance: 77e68020-0c84-433d-8a03-c4319aeb99b6] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:43:52.067428 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0cabdb11-b52f-4639-8629-e3d6979b1bc5 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eda27d8b6c47b3acd19492f6ecc462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd3b552d16542e888d8205cc983c1b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:43:52.075583 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0cabdb11-b52f-4639-8629-e3d6979b1bc5 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] 10.222.0.52 "GET /compute/v2.1/servers/77e68020-0c84-433d-8a03-c4319aeb99b6" status: 200 len: 1214 microversion: 2.1 time: 0.094525 Oct 19 03:43:52.076184 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2900/5869] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:43:51 2022] GET /compute/v2.1/servers/77e68020-0c84-433d-8a03-c4319aeb99b6 => generated 1214 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:43:53.102892 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9e98df90-b99c-41c3-a63c-6b4e9d0e5af3 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:43:53.105519 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9e98df90-b99c-41c3-a63c-6b4e9d0e5af3 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] [instance: 77e68020-0c84-433d-8a03-c4319aeb99b6] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:43:53.116741 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9e98df90-b99c-41c3-a63c-6b4e9d0e5af3 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:43:53.123512 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9e98df90-b99c-41c3-a63c-6b4e9d0e5af3 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:43:53.123512 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9e98df90-b99c-41c3-a63c-6b4e9d0e5af3 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:43:53.123512 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9e98df90-b99c-41c3-a63c-6b4e9d0e5af3 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:43:53.123512 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9e98df90-b99c-41c3-a63c-6b4e9d0e5af3 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:43:53.123512 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9e98df90-b99c-41c3-a63c-6b4e9d0e5af3 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:43:53.747334 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-9e98df90-b99c-41c3-a63c-6b4e9d0e5af3 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eda27d8b6c47b3acd19492f6ecc462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd3b552d16542e888d8205cc983c1b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:43:53.765163 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9e98df90-b99c-41c3-a63c-6b4e9d0e5af3 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] 10.222.0.52 "GET /compute/v2.1/servers/77e68020-0c84-433d-8a03-c4319aeb99b6" status: 200 len: 1266 microversion: 2.1 time: 0.665745 Oct 19 03:43:53.766000 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2970/5870] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:43:53 2022] GET /compute/v2.1/servers/77e68020-0c84-433d-8a03-c4319aeb99b6 => generated 1266 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:43:54.808733 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c825f33c-1cfc-4de7-b67e-69b5010194de tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:43:54.812285 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c825f33c-1cfc-4de7-b67e-69b5010194de tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] [instance: 77e68020-0c84-433d-8a03-c4319aeb99b6] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:43:54.823423 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c825f33c-1cfc-4de7-b67e-69b5010194de tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:43:54.825321 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c825f33c-1cfc-4de7-b67e-69b5010194de tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:43:54.826017 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c825f33c-1cfc-4de7-b67e-69b5010194de tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:43:54.827056 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c825f33c-1cfc-4de7-b67e-69b5010194de tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:43:54.827888 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c825f33c-1cfc-4de7-b67e-69b5010194de tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:43:54.828548 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c825f33c-1cfc-4de7-b67e-69b5010194de tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:43:55.021280 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c825f33c-1cfc-4de7-b67e-69b5010194de tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eda27d8b6c47b3acd19492f6ecc462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd3b552d16542e888d8205cc983c1b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:43:55.037641 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c825f33c-1cfc-4de7-b67e-69b5010194de tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] 10.222.0.52 "GET /compute/v2.1/servers/77e68020-0c84-433d-8a03-c4319aeb99b6" status: 200 len: 1272 microversion: 2.1 time: 0.238578 Oct 19 03:43:55.074696 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2901/5871] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:43:54 2022] GET /compute/v2.1/servers/77e68020-0c84-433d-8a03-c4319aeb99b6 => generated 1272 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:43:56.081422 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5747243c-3250-4505-86de-2985b93f9c88 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:43:56.084742 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-5747243c-3250-4505-86de-2985b93f9c88 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] [instance: 77e68020-0c84-433d-8a03-c4319aeb99b6] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:43:56.085981 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:43:56.091448 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5747243c-3250-4505-86de-2985b93f9c88 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:43:56.092932 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5747243c-3250-4505-86de-2985b93f9c88 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:43:56.093640 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5747243c-3250-4505-86de-2985b93f9c88 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:43:56.094632 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5747243c-3250-4505-86de-2985b93f9c88 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:43:56.095317 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5747243c-3250-4505-86de-2985b93f9c88 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:43:56.095840 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5747243c-3250-4505-86de-2985b93f9c88 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:43:56.261175 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-5747243c-3250-4505-86de-2985b93f9c88 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eda27d8b6c47b3acd19492f6ecc462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd3b552d16542e888d8205cc983c1b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:43:56.263721 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:43:56.275728 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5747243c-3250-4505-86de-2985b93f9c88 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] 10.222.0.52 "GET /compute/v2.1/servers/77e68020-0c84-433d-8a03-c4319aeb99b6" status: 200 len: 1272 microversion: 2.1 time: 0.196567 Oct 19 03:43:56.278540 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2971/5872] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:43:56 2022] GET /compute/v2.1/servers/77e68020-0c84-433d-8a03-c4319aeb99b6 => generated 1272 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:43:57.300866 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-bad9ecd0-1689-4378-9c53-fe7151d7d74b tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:43:57.301575 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-bad9ecd0-1689-4378-9c53-fe7151d7d74b tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] [instance: 77e68020-0c84-433d-8a03-c4319aeb99b6] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:43:57.312672 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bad9ecd0-1689-4378-9c53-fe7151d7d74b tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:43:57.312672 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bad9ecd0-1689-4378-9c53-fe7151d7d74b tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:43:57.312672 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bad9ecd0-1689-4378-9c53-fe7151d7d74b tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:43:57.320951 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bad9ecd0-1689-4378-9c53-fe7151d7d74b tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:43:57.320951 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bad9ecd0-1689-4378-9c53-fe7151d7d74b tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:43:57.320951 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bad9ecd0-1689-4378-9c53-fe7151d7d74b tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:43:58.127781 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-bad9ecd0-1689-4378-9c53-fe7151d7d74b tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eda27d8b6c47b3acd19492f6ecc462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd3b552d16542e888d8205cc983c1b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:43:58.148812 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-bad9ecd0-1689-4378-9c53-fe7151d7d74b tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] 10.222.0.52 "GET /compute/v2.1/servers/77e68020-0c84-433d-8a03-c4319aeb99b6" status: 200 len: 1314 microversion: 2.1 time: 0.850664 Oct 19 03:43:58.148812 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2902/5873] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:43:57 2022] GET /compute/v2.1/servers/77e68020-0c84-433d-8a03-c4319aeb99b6 => generated 1314 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:43:59.171900 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7fcb2443-ab75-4131-8e63-734771a7a62d tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:43:59.172549 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7fcb2443-ab75-4131-8e63-734771a7a62d tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] [instance: 77e68020-0c84-433d-8a03-c4319aeb99b6] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:43:59.180879 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7fcb2443-ab75-4131-8e63-734771a7a62d tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:43:59.181397 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7fcb2443-ab75-4131-8e63-734771a7a62d tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:43:59.182033 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7fcb2443-ab75-4131-8e63-734771a7a62d tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:43:59.182749 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7fcb2443-ab75-4131-8e63-734771a7a62d tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:43:59.183418 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7fcb2443-ab75-4131-8e63-734771a7a62d tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:43:59.183665 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7fcb2443-ab75-4131-8e63-734771a7a62d tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:43:59.700914 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7fcb2443-ab75-4131-8e63-734771a7a62d tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eda27d8b6c47b3acd19492f6ecc462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd3b552d16542e888d8205cc983c1b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:43:59.714224 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7fcb2443-ab75-4131-8e63-734771a7a62d tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] 10.222.0.52 "GET /compute/v2.1/servers/77e68020-0c84-433d-8a03-c4319aeb99b6" status: 200 len: 1314 microversion: 2.1 time: 0.546186 Oct 19 03:43:59.717051 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2972/5874] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:43:59 2022] GET /compute/v2.1/servers/77e68020-0c84-433d-8a03-c4319aeb99b6 => generated 1314 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:43:59.936228 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-270ac42d-8f39-44f4-b7e5-2ae2bacec4ae req-177f6b90-e8ea-41be-8afd-e4ad334ce890 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77e68020-0c84-433d-8a03-c4319aeb99b6", "tag": "dbd9ba88-f51c-4822-b494-6ebfe2da0279"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:43:59.946312 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:43:59.948755 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-270ac42d-8f39-44f4-b7e5-2ae2bacec4ae req-177f6b90-e8ea-41be-8afd-e4ad334ce890 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:43:59.949486 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-270ac42d-8f39-44f4-b7e5-2ae2bacec4ae req-177f6b90-e8ea-41be-8afd-e4ad334ce890 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:43:59.950108 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-270ac42d-8f39-44f4-b7e5-2ae2bacec4ae req-177f6b90-e8ea-41be-8afd-e4ad334ce890 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:43:59.954783 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:43:59.962403 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-270ac42d-8f39-44f4-b7e5-2ae2bacec4ae req-177f6b90-e8ea-41be-8afd-e4ad334ce890 service nova] Creating event network-changed:dbd9ba88-f51c-4822-b494-6ebfe2da0279 for instance 77e68020-0c84-433d-8a03-c4319aeb99b6 on n-h2-861333-8 Oct 19 03:43:59.967962 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-270ac42d-8f39-44f4-b7e5-2ae2bacec4ae req-177f6b90-e8ea-41be-8afd-e4ad334ce890 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036713 Oct 19 03:43:59.969322 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2903/5875] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:43:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:44:00.740278 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-8b7cf12a-0bec-4ac1-80e6-50660029dfb2 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:44:00.741487 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-8b7cf12a-0bec-4ac1-80e6-50660029dfb2 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] [instance: 77e68020-0c84-433d-8a03-c4319aeb99b6] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:44:00.756548 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8b7cf12a-0bec-4ac1-80e6-50660029dfb2 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:00.757485 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8b7cf12a-0bec-4ac1-80e6-50660029dfb2 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:00.761687 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8b7cf12a-0bec-4ac1-80e6-50660029dfb2 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:00.762747 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8b7cf12a-0bec-4ac1-80e6-50660029dfb2 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:00.768350 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8b7cf12a-0bec-4ac1-80e6-50660029dfb2 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:00.768350 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8b7cf12a-0bec-4ac1-80e6-50660029dfb2 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:00.965458 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:44:01.178343 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-8b7cf12a-0bec-4ac1-80e6-50660029dfb2 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eda27d8b6c47b3acd19492f6ecc462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd3b552d16542e888d8205cc983c1b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:44:01.198931 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-8b7cf12a-0bec-4ac1-80e6-50660029dfb2 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] 10.222.0.52 "GET /compute/v2.1/servers/77e68020-0c84-433d-8a03-c4319aeb99b6" status: 200 len: 1314 microversion: 2.1 time: 0.461631 Oct 19 03:44:01.200430 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2973/5876] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:44:00 2022] GET /compute/v2.1/servers/77e68020-0c84-433d-8a03-c4319aeb99b6 => generated 1314 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:44:01.846193 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:44:02.005217 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5a0283e1-0e5a-42bf-aa69-ff58fd31fb24 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-110299381", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "networks": [{"uuid": "9fdd4e19-7978-451e-8b13-a55b49570cfe"}]}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:44:02.071646 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=8 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:44:02.093788 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-5a0283e1-0e5a-42bf-aa69-ff58fd31fb24 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] validate_networks() for [('9fdd4e19-7978-451e-8b13-a55b49570cfe', None, None, None, None, None)] {{(pid=121134) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:44:02.226606 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9bad6287-2099-46b3-acc2-119f3f0243ab tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:44:02.226606 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9bad6287-2099-46b3-acc2-119f3f0243ab tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] [instance: 77e68020-0c84-433d-8a03-c4319aeb99b6] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:44:02.231817 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9bad6287-2099-46b3-acc2-119f3f0243ab tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:02.232312 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9bad6287-2099-46b3-acc2-119f3f0243ab tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:02.232781 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9bad6287-2099-46b3-acc2-119f3f0243ab tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:02.233493 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9bad6287-2099-46b3-acc2-119f3f0243ab tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:02.233956 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9bad6287-2099-46b3-acc2-119f3f0243ab tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:02.242688 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9bad6287-2099-46b3-acc2-119f3f0243ab tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:02.885190 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-9bad6287-2099-46b3-acc2-119f3f0243ab tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eda27d8b6c47b3acd19492f6ecc462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd3b552d16542e888d8205cc983c1b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:44:02.904195 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9bad6287-2099-46b3-acc2-119f3f0243ab tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] 10.222.0.52 "GET /compute/v2.1/servers/77e68020-0c84-433d-8a03-c4319aeb99b6" status: 200 len: 1314 microversion: 2.1 time: 0.679063 Oct 19 03:44:02.904195 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2974/5877] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:44:02 2022] GET /compute/v2.1/servers/77e68020-0c84-433d-8a03-c4319aeb99b6 => generated 1314 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:44:03.371693 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-5a0283e1-0e5a-42bf-aa69-ff58fd31fb24 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Flavor limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:44:03.372254 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-5a0283e1-0e5a-42bf-aa69-ff58fd31fb24 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Image limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:44:03.372918 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-5a0283e1-0e5a-42bf-aa69-ff58fd31fb24 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Flavor pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:44:03.373623 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-5a0283e1-0e5a-42bf-aa69-ff58fd31fb24 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Image pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:44:03.374168 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-5a0283e1-0e5a-42bf-aa69-ff58fd31fb24 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:44:03.418850 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5a0283e1-0e5a-42bf-aa69-ff58fd31fb24 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:03.424055 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5a0283e1-0e5a-42bf-aa69-ff58fd31fb24 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:03.424564 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5a0283e1-0e5a-42bf-aa69-ff58fd31fb24 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:03.425800 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5a0283e1-0e5a-42bf-aa69-ff58fd31fb24 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:03.427750 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5a0283e1-0e5a-42bf-aa69-ff58fd31fb24 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:03.428794 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5a0283e1-0e5a-42bf-aa69-ff58fd31fb24 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:03.480872 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-5a0283e1-0e5a-42bf-aa69-ff58fd31fb24 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Getting quotas for project d36c639ebfd347b28afeb5724b3e1d67. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:44:03.495598 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-5a0283e1-0e5a-42bf-aa69-ff58fd31fb24 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Getting quotas for user c81e63d09bd94a9faf9530e911acf0a3 and project d36c639ebfd347b28afeb5724b3e1d67. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:44:03.528359 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5a0283e1-0e5a-42bf-aa69-ff58fd31fb24 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Going to run 1 instances... {{(pid=121134) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:44:03.533261 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5a0283e1-0e5a-42bf-aa69-ff58fd31fb24 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] [instance: ac91ce38-2d07-43e1-91c5-ebf68341e491] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:44:03.741027 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5a0283e1-0e5a-42bf-aa69-ff58fd31fb24 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.899673 Oct 19 03:44:03.741879 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2904/5878] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:44:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1902 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 03:44:03.896179 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2bd195f7-862e-4cf4-beaf-d6b4a480313e tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1991496856", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "networks": [{"uuid": "9fdd4e19-7978-451e-8b13-a55b49570cfe"}]}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:44:03.928557 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d70b846e-bddb-43c3-86e2-d019b40bd212 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:44:03.929414 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d70b846e-bddb-43c3-86e2-d019b40bd212 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] [instance: 77e68020-0c84-433d-8a03-c4319aeb99b6] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:44:03.947543 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d70b846e-bddb-43c3-86e2-d019b40bd212 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:03.948050 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d70b846e-bddb-43c3-86e2-d019b40bd212 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:03.948500 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d70b846e-bddb-43c3-86e2-d019b40bd212 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:03.949240 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d70b846e-bddb-43c3-86e2-d019b40bd212 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:03.952820 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d70b846e-bddb-43c3-86e2-d019b40bd212 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:03.954615 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d70b846e-bddb-43c3-86e2-d019b40bd212 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:04.024304 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.network.neutron [None req-2bd195f7-862e-4cf4-beaf-d6b4a480313e tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] validate_networks() for [('9fdd4e19-7978-451e-8b13-a55b49570cfe', None, None, None, None, None)] {{(pid=121135) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:44:04.518964 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d70b846e-bddb-43c3-86e2-d019b40bd212 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eda27d8b6c47b3acd19492f6ecc462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd3b552d16542e888d8205cc983c1b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:44:04.542663 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d70b846e-bddb-43c3-86e2-d019b40bd212 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] 10.222.0.52 "GET /compute/v2.1/servers/77e68020-0c84-433d-8a03-c4319aeb99b6" status: 200 len: 1314 microversion: 2.1 time: 0.619261 Oct 19 03:44:04.547981 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2905/5879] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:44:03 2022] GET /compute/v2.1/servers/77e68020-0c84-433d-8a03-c4319aeb99b6 => generated 1314 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:44:05.214615 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-2bd195f7-862e-4cf4-beaf-d6b4a480313e tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Flavor limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:44:05.214615 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-2bd195f7-862e-4cf4-beaf-d6b4a480313e tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Image limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:44:05.214615 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-2bd195f7-862e-4cf4-beaf-d6b4a480313e tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Flavor pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:44:05.214615 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-2bd195f7-862e-4cf4-beaf-d6b4a480313e tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Image pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:44:05.214615 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-2bd195f7-862e-4cf4-beaf-d6b4a480313e tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:44:05.229823 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2bd195f7-862e-4cf4-beaf-d6b4a480313e tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:05.239618 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2bd195f7-862e-4cf4-beaf-d6b4a480313e tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:05.240153 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2bd195f7-862e-4cf4-beaf-d6b4a480313e tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:05.242941 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2bd195f7-862e-4cf4-beaf-d6b4a480313e tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:05.242941 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2bd195f7-862e-4cf4-beaf-d6b4a480313e tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:05.242941 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2bd195f7-862e-4cf4-beaf-d6b4a480313e tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:05.301607 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-2bd195f7-862e-4cf4-beaf-d6b4a480313e tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Getting quotas for project d36c639ebfd347b28afeb5724b3e1d67. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:44:05.313075 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-2bd195f7-862e-4cf4-beaf-d6b4a480313e tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Getting quotas for user c81e63d09bd94a9faf9530e911acf0a3 and project d36c639ebfd347b28afeb5724b3e1d67. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:44:05.327752 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-2bd195f7-862e-4cf4-beaf-d6b4a480313e tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Going to run 1 instances... {{(pid=121135) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:44:05.330440 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-2bd195f7-862e-4cf4-beaf-d6b4a480313e tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] [instance: a339021c-b7c6-4e4c-abc9-e91fefca9b98] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121135) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:44:05.471385 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2bd195f7-862e-4cf4-beaf-d6b4a480313e tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.579554 Oct 19 03:44:05.476425 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2975/5880] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:44:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1585 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 03:44:05.575743 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-fb54c958-5009-4688-893f-0c63ac054743 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:44:05.576381 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-fb54c958-5009-4688-893f-0c63ac054743 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] [instance: 77e68020-0c84-433d-8a03-c4319aeb99b6] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:44:05.596465 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fb54c958-5009-4688-893f-0c63ac054743 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:05.598850 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fb54c958-5009-4688-893f-0c63ac054743 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:05.599303 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fb54c958-5009-4688-893f-0c63ac054743 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:05.620717 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fb54c958-5009-4688-893f-0c63ac054743 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:05.620717 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fb54c958-5009-4688-893f-0c63ac054743 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:05.620717 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fb54c958-5009-4688-893f-0c63ac054743 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:05.645268 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-71a32a54-3253-4fcc-aa84-d689366c5282 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-396288725", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "451", "networks": [{"uuid": "9fdd4e19-7978-451e-8b13-a55b49570cfe"}]}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:44:05.718870 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.network.neutron [None req-71a32a54-3253-4fcc-aa84-d689366c5282 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] validate_networks() for [('9fdd4e19-7978-451e-8b13-a55b49570cfe', None, None, None, None, None)] {{(pid=121135) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:44:06.263550 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-fb54c958-5009-4688-893f-0c63ac054743 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eda27d8b6c47b3acd19492f6ecc462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd3b552d16542e888d8205cc983c1b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:44:06.291113 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-fb54c958-5009-4688-893f-0c63ac054743 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] 10.222.0.52 "GET /compute/v2.1/servers/77e68020-0c84-433d-8a03-c4319aeb99b6" status: 200 len: 1314 microversion: 2.1 time: 0.722022 Oct 19 03:44:06.313403 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2906/5881] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:44:05 2022] GET /compute/v2.1/servers/77e68020-0c84-433d-8a03-c4319aeb99b6 => generated 1314 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:44:06.886223 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-71a32a54-3253-4fcc-aa84-d689366c5282 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Flavor limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:44:06.887234 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-71a32a54-3253-4fcc-aa84-d689366c5282 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Image limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:44:06.887717 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-71a32a54-3253-4fcc-aa84-d689366c5282 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Flavor pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:44:06.888132 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-71a32a54-3253-4fcc-aa84-d689366c5282 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Image pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:44:06.888586 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-71a32a54-3253-4fcc-aa84-d689366c5282 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:44:06.900639 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-71a32a54-3253-4fcc-aa84-d689366c5282 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:06.901347 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-71a32a54-3253-4fcc-aa84-d689366c5282 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:06.908141 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-71a32a54-3253-4fcc-aa84-d689366c5282 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:06.909107 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-71a32a54-3253-4fcc-aa84-d689366c5282 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:06.909732 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-71a32a54-3253-4fcc-aa84-d689366c5282 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:06.910175 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-71a32a54-3253-4fcc-aa84-d689366c5282 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:06.930224 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-71a32a54-3253-4fcc-aa84-d689366c5282 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Getting quotas for project d36c639ebfd347b28afeb5724b3e1d67. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:44:06.948521 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-71a32a54-3253-4fcc-aa84-d689366c5282 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Getting quotas for user c81e63d09bd94a9faf9530e911acf0a3 and project d36c639ebfd347b28afeb5724b3e1d67. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:44:06.961793 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-71a32a54-3253-4fcc-aa84-d689366c5282 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Going to run 1 instances... {{(pid=121135) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:44:06.964310 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-71a32a54-3253-4fcc-aa84-d689366c5282 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] [instance: ceedb58f-1285-4292-8eb7-d741f2919484] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121135) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:44:07.229305 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-71a32a54-3253-4fcc-aa84-d689366c5282 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.589424 Oct 19 03:44:07.237723 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2976/5882] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:44:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1599 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 19 03:44:07.246045 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1c5e52f9-5d07-4a62-82b6-d0fe8e0cdbff tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:44:07.248695 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1c5e52f9-5d07-4a62-82b6-d0fe8e0cdbff tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] [instance: ceedb58f-1285-4292-8eb7-d741f2919484] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:44:07.601228 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-1c5e52f9-5d07-4a62-82b6-d0fe8e0cdbff tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81e63d09bd94a9faf9530e911acf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36c639ebfd347b28afeb5724b3e1d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:44:07.619365 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1c5e52f9-5d07-4a62-82b6-d0fe8e0cdbff tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] 10.222.0.52 "GET /compute/v2.1/servers/ceedb58f-1285-4292-8eb7-d741f2919484" status: 200 len: 1220 microversion: 2.1 time: 0.379439 Oct 19 03:44:07.623174 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2977/5883] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:44:07 2022] GET /compute/v2.1/servers/ceedb58f-1285-4292-8eb7-d741f2919484 => generated 1220 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:44:07.631891 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-fa54b2f0-e012-4e3d-8265-f2ed4c85a3c7 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:44:07.632520 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-fa54b2f0-e012-4e3d-8265-f2ed4c85a3c7 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] [instance: 77e68020-0c84-433d-8a03-c4319aeb99b6] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:44:07.667587 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fa54b2f0-e012-4e3d-8265-f2ed4c85a3c7 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:07.668130 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fa54b2f0-e012-4e3d-8265-f2ed4c85a3c7 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:07.669508 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-d932d379-e861-4f27-a54a-a4bd0d0afad8 req-8dede637-60bb-4bf8-b602-dc49cdccfdf7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77e68020-0c84-433d-8a03-c4319aeb99b6", "name": "network-vif-plugged", "status": "completed", "tag": "dbd9ba88-f51c-4822-b494-6ebfe2da0279"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:44:07.670014 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fa54b2f0-e012-4e3d-8265-f2ed4c85a3c7 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:07.688127 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fa54b2f0-e012-4e3d-8265-f2ed4c85a3c7 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:07.688127 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fa54b2f0-e012-4e3d-8265-f2ed4c85a3c7 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:07.688127 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fa54b2f0-e012-4e3d-8265-f2ed4c85a3c7 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:07.709235 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-d932d379-e861-4f27-a54a-a4bd0d0afad8 req-8dede637-60bb-4bf8-b602-dc49cdccfdf7 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:07.710019 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-d932d379-e861-4f27-a54a-a4bd0d0afad8 req-8dede637-60bb-4bf8-b602-dc49cdccfdf7 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:07.710607 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-d932d379-e861-4f27-a54a-a4bd0d0afad8 req-8dede637-60bb-4bf8-b602-dc49cdccfdf7 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:07.744477 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-d932d379-e861-4f27-a54a-a4bd0d0afad8 req-8dede637-60bb-4bf8-b602-dc49cdccfdf7 service nova] Creating event network-vif-plugged:dbd9ba88-f51c-4822-b494-6ebfe2da0279 for instance 77e68020-0c84-433d-8a03-c4319aeb99b6 on n-h2-861333-8 Oct 19 03:44:07.751437 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-d932d379-e861-4f27-a54a-a4bd0d0afad8 req-8dede637-60bb-4bf8-b602-dc49cdccfdf7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.547427 Oct 19 03:44:07.752052 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2907/5884] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:44:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:44:08.147903 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-fa54b2f0-e012-4e3d-8265-f2ed4c85a3c7 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eda27d8b6c47b3acd19492f6ecc462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd3b552d16542e888d8205cc983c1b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:44:08.158769 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-fa54b2f0-e012-4e3d-8265-f2ed4c85a3c7 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] 10.222.0.52 "GET /compute/v2.1/servers/77e68020-0c84-433d-8a03-c4319aeb99b6" status: 200 len: 1314 microversion: 2.1 time: 0.534465 Oct 19 03:44:08.162492 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2978/5885] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:44:07 2022] GET /compute/v2.1/servers/77e68020-0c84-433d-8a03-c4319aeb99b6 => generated 1314 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:44:08.649537 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8169bbd6-11c4-4772-a5ff-6ad14e022344 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:44:08.650884 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8169bbd6-11c4-4772-a5ff-6ad14e022344 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] [instance: ceedb58f-1285-4292-8eb7-d741f2919484] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:44:08.744894 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8169bbd6-11c4-4772-a5ff-6ad14e022344 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81e63d09bd94a9faf9530e911acf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36c639ebfd347b28afeb5724b3e1d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:44:08.754871 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8169bbd6-11c4-4772-a5ff-6ad14e022344 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] 10.222.0.52 "GET /compute/v2.1/servers/ceedb58f-1285-4292-8eb7-d741f2919484" status: 200 len: 1220 microversion: 2.1 time: 0.110064 Oct 19 03:44:08.756078 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2908/5886] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:44:08 2022] GET /compute/v2.1/servers/ceedb58f-1285-4292-8eb7-d741f2919484 => generated 1220 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:44:09.185350 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ead038bc-446f-474b-9b7e-5f67f8af40e5 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:44:09.185921 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ead038bc-446f-474b-9b7e-5f67f8af40e5 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] [instance: 77e68020-0c84-433d-8a03-c4319aeb99b6] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:44:09.194310 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ead038bc-446f-474b-9b7e-5f67f8af40e5 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:09.195127 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ead038bc-446f-474b-9b7e-5f67f8af40e5 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:09.195811 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ead038bc-446f-474b-9b7e-5f67f8af40e5 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:09.196765 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ead038bc-446f-474b-9b7e-5f67f8af40e5 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:09.197460 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ead038bc-446f-474b-9b7e-5f67f8af40e5 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:09.200630 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ead038bc-446f-474b-9b7e-5f67f8af40e5 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:09.540026 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ead038bc-446f-474b-9b7e-5f67f8af40e5 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eda27d8b6c47b3acd19492f6ecc462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd3b552d16542e888d8205cc983c1b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:44:09.549275 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ead038bc-446f-474b-9b7e-5f67f8af40e5 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] 10.222.0.52 "GET /compute/v2.1/servers/77e68020-0c84-433d-8a03-c4319aeb99b6" status: 200 len: 1314 microversion: 2.1 time: 0.368426 Oct 19 03:44:09.551441 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2979/5887] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:44:09 2022] GET /compute/v2.1/servers/77e68020-0c84-433d-8a03-c4319aeb99b6 => generated 1314 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:44:09.777820 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6ce03370-4bfa-4049-a3c6-7d3b8d65859d tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:44:09.778446 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6ce03370-4bfa-4049-a3c6-7d3b8d65859d tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] [instance: ceedb58f-1285-4292-8eb7-d741f2919484] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:44:09.786831 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6ce03370-4bfa-4049-a3c6-7d3b8d65859d tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:09.787326 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6ce03370-4bfa-4049-a3c6-7d3b8d65859d tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:09.787771 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6ce03370-4bfa-4049-a3c6-7d3b8d65859d tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:09.788486 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6ce03370-4bfa-4049-a3c6-7d3b8d65859d tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:09.788989 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6ce03370-4bfa-4049-a3c6-7d3b8d65859d tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:09.789730 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6ce03370-4bfa-4049-a3c6-7d3b8d65859d tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:09.881079 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-6ce03370-4bfa-4049-a3c6-7d3b8d65859d tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81e63d09bd94a9faf9530e911acf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36c639ebfd347b28afeb5724b3e1d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:44:09.895369 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6ce03370-4bfa-4049-a3c6-7d3b8d65859d tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] 10.222.0.52 "GET /compute/v2.1/servers/ceedb58f-1285-4292-8eb7-d741f2919484" status: 200 len: 1272 microversion: 2.1 time: 0.120617 Oct 19 03:44:09.896498 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2909/5888] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:44:09 2022] GET /compute/v2.1/servers/ceedb58f-1285-4292-8eb7-d741f2919484 => generated 1272 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:44:10.573319 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-fb9bd3a0-dfda-4b0f-bccf-cc775e27995c tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:44:10.576077 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-fb9bd3a0-dfda-4b0f-bccf-cc775e27995c tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] [instance: 77e68020-0c84-433d-8a03-c4319aeb99b6] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:44:10.584152 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fb9bd3a0-dfda-4b0f-bccf-cc775e27995c tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:10.584654 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fb9bd3a0-dfda-4b0f-bccf-cc775e27995c tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:10.585096 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fb9bd3a0-dfda-4b0f-bccf-cc775e27995c tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:10.585835 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fb9bd3a0-dfda-4b0f-bccf-cc775e27995c tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:10.586485 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fb9bd3a0-dfda-4b0f-bccf-cc775e27995c tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:10.586908 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fb9bd3a0-dfda-4b0f-bccf-cc775e27995c tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:10.836542 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-bd92660f-02d5-4560-aad8-9c76d0137573 req-a7ae272e-73da-4a48-9c45-080fab2a1841 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac91ce38-2d07-43e1-91c5-ebf68341e491", "tag": "85cb2801-42de-49e1-b975-d26594d01f2b"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:44:10.851620 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-bd92660f-02d5-4560-aad8-9c76d0137573 req-a7ae272e-73da-4a48-9c45-080fab2a1841 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:10.852116 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-bd92660f-02d5-4560-aad8-9c76d0137573 req-a7ae272e-73da-4a48-9c45-080fab2a1841 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:10.852544 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-bd92660f-02d5-4560-aad8-9c76d0137573 req-a7ae272e-73da-4a48-9c45-080fab2a1841 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:10.886973 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-fb9bd3a0-dfda-4b0f-bccf-cc775e27995c tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eda27d8b6c47b3acd19492f6ecc462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd3b552d16542e888d8205cc983c1b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:44:10.894993 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-bd92660f-02d5-4560-aad8-9c76d0137573 req-a7ae272e-73da-4a48-9c45-080fab2a1841 service nova] Creating event network-changed:85cb2801-42de-49e1-b975-d26594d01f2b for instance ac91ce38-2d07-43e1-91c5-ebf68341e491 on n-h1-861333-8 Oct 19 03:44:10.908416 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-bd92660f-02d5-4560-aad8-9c76d0137573 req-a7ae272e-73da-4a48-9c45-080fab2a1841 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076826 Oct 19 03:44:10.912057 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-fb9bd3a0-dfda-4b0f-bccf-cc775e27995c tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] 10.222.0.52 "GET /compute/v2.1/servers/77e68020-0c84-433d-8a03-c4319aeb99b6" status: 200 len: 1464 microversion: 2.1 time: 0.342781 Oct 19 03:44:10.912664 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2980/5889] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:44:10 2022] GET /compute/v2.1/servers/77e68020-0c84-433d-8a03-c4319aeb99b6 => generated 1464 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:44:10.914162 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2910/5890] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:44:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:44:10.932071 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-335c0803-55b0-41f5-9c84-d769f0c13378 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:44:10.933004 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-335c0803-55b0-41f5-9c84-d769f0c13378 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] [instance: ceedb58f-1285-4292-8eb7-d741f2919484] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:44:10.938328 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-eb63cc84-9723-4663-8d47-3a38efea8693 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c5eb3e95-effc-4de9-b0b2-a6ab7228334f", "device": "/dev/sdb"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:44:10.941752 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-eb63cc84-9723-4663-8d47-3a38efea8693 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] [instance: 77e68020-0c84-433d-8a03-c4319aeb99b6] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:44:10.943030 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-335c0803-55b0-41f5-9c84-d769f0c13378 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:10.944159 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-335c0803-55b0-41f5-9c84-d769f0c13378 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:10.944954 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-335c0803-55b0-41f5-9c84-d769f0c13378 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:10.946139 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-335c0803-55b0-41f5-9c84-d769f0c13378 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:10.947419 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-335c0803-55b0-41f5-9c84-d769f0c13378 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:10.948866 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-335c0803-55b0-41f5-9c84-d769f0c13378 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:10.954070 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eb63cc84-9723-4663-8d47-3a38efea8693 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:10.955766 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eb63cc84-9723-4663-8d47-3a38efea8693 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:10.958587 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eb63cc84-9723-4663-8d47-3a38efea8693 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:10.961251 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eb63cc84-9723-4663-8d47-3a38efea8693 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:10.963009 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eb63cc84-9723-4663-8d47-3a38efea8693 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:10.964988 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eb63cc84-9723-4663-8d47-3a38efea8693 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:11.069454 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-335c0803-55b0-41f5-9c84-d769f0c13378 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81e63d09bd94a9faf9530e911acf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36c639ebfd347b28afeb5724b3e1d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:44:11.091163 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-335c0803-55b0-41f5-9c84-d769f0c13378 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] 10.222.0.52 "GET /compute/v2.1/servers/ceedb58f-1285-4292-8eb7-d741f2919484" status: 200 len: 1278 microversion: 2.1 time: 0.166496 Oct 19 03:44:11.091624 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2981/5891] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:44:10 2022] GET /compute/v2.1/servers/ceedb58f-1285-4292-8eb7-d741f2919484 => generated 1278 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:44:11.823128 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-eb63cc84-9723-4663-8d47-3a38efea8693 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] 10.222.0.52 "POST /compute/v2.1/servers/77e68020-0c84-433d-8a03-c4319aeb99b6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.889785 Oct 19 03:44:11.825042 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2911/5892] 10.222.0.52 () {60 vars in 1323 bytes} [Wed Oct 19 03:44:10 2022] POST /compute/v2.1/servers/77e68020-0c84-433d-8a03-c4319aeb99b6/os-volume_attachments => generated 194 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:44:12.117012 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-fdaa7809-de21-4a31-801e-0a5fcc581d29 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:44:12.118229 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-fdaa7809-de21-4a31-801e-0a5fcc581d29 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] [instance: ceedb58f-1285-4292-8eb7-d741f2919484] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:44:12.127249 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fdaa7809-de21-4a31-801e-0a5fcc581d29 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:12.128040 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fdaa7809-de21-4a31-801e-0a5fcc581d29 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:12.128880 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fdaa7809-de21-4a31-801e-0a5fcc581d29 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:12.129622 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fdaa7809-de21-4a31-801e-0a5fcc581d29 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:12.130082 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fdaa7809-de21-4a31-801e-0a5fcc581d29 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:12.130511 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fdaa7809-de21-4a31-801e-0a5fcc581d29 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:12.202824 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-fdaa7809-de21-4a31-801e-0a5fcc581d29 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81e63d09bd94a9faf9530e911acf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36c639ebfd347b28afeb5724b3e1d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:44:12.219610 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-fdaa7809-de21-4a31-801e-0a5fcc581d29 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] 10.222.0.52 "GET /compute/v2.1/servers/ceedb58f-1285-4292-8eb7-d741f2919484" status: 200 len: 1278 microversion: 2.1 time: 0.104799 Oct 19 03:44:12.219610 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2982/5893] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:44:12 2022] GET /compute/v2.1/servers/ceedb58f-1285-4292-8eb7-d741f2919484 => generated 1278 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:44:13.241567 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-472d9b09-6594-47ad-be49-a15e8c0fa405 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:44:13.242287 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-472d9b09-6594-47ad-be49-a15e8c0fa405 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] [instance: ceedb58f-1285-4292-8eb7-d741f2919484] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:44:13.251472 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-472d9b09-6594-47ad-be49-a15e8c0fa405 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:13.251972 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-472d9b09-6594-47ad-be49-a15e8c0fa405 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:13.253917 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-472d9b09-6594-47ad-be49-a15e8c0fa405 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:13.253917 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-472d9b09-6594-47ad-be49-a15e8c0fa405 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:13.254446 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-472d9b09-6594-47ad-be49-a15e8c0fa405 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:13.255069 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-472d9b09-6594-47ad-be49-a15e8c0fa405 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:13.407232 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-472d9b09-6594-47ad-be49-a15e8c0fa405 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81e63d09bd94a9faf9530e911acf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36c639ebfd347b28afeb5724b3e1d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:44:13.416252 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-472d9b09-6594-47ad-be49-a15e8c0fa405 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] 10.222.0.52 "GET /compute/v2.1/servers/ceedb58f-1285-4292-8eb7-d741f2919484" status: 200 len: 1320 microversion: 2.1 time: 0.178953 Oct 19 03:44:13.417429 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2912/5894] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:44:13 2022] GET /compute/v2.1/servers/ceedb58f-1285-4292-8eb7-d741f2919484 => generated 1320 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:44:13.894357 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-cd64c287-9f43-49c6-9d26-ce8c3740c948 req-0adf4084-ca69-4955-96e0-64d52552a79d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ceedb58f-1285-4292-8eb7-d741f2919484", "tag": "638eb330-be96-4029-bc36-77117c7fd896"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:44:13.915134 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-cd64c287-9f43-49c6-9d26-ce8c3740c948 req-0adf4084-ca69-4955-96e0-64d52552a79d service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:13.917004 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-cd64c287-9f43-49c6-9d26-ce8c3740c948 req-0adf4084-ca69-4955-96e0-64d52552a79d service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:13.920914 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-cd64c287-9f43-49c6-9d26-ce8c3740c948 req-0adf4084-ca69-4955-96e0-64d52552a79d service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:13.933518 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-cd64c287-9f43-49c6-9d26-ce8c3740c948 req-0adf4084-ca69-4955-96e0-64d52552a79d service nova] Creating event network-changed:638eb330-be96-4029-bc36-77117c7fd896 for instance ceedb58f-1285-4292-8eb7-d741f2919484 on n-h2-861333-8 Oct 19 03:44:13.939975 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-cd64c287-9f43-49c6-9d26-ce8c3740c948 req-0adf4084-ca69-4955-96e0-64d52552a79d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049238 Oct 19 03:44:13.942096 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2983/5895] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:44:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:44:14.443416 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3e226858-763e-47e2-b309-36a65329ab16 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:44:14.444790 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3e226858-763e-47e2-b309-36a65329ab16 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] [instance: ceedb58f-1285-4292-8eb7-d741f2919484] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:44:14.451089 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:44:14.454033 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3e226858-763e-47e2-b309-36a65329ab16 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:14.454839 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3e226858-763e-47e2-b309-36a65329ab16 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:14.455521 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3e226858-763e-47e2-b309-36a65329ab16 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:14.456518 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3e226858-763e-47e2-b309-36a65329ab16 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:14.457207 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3e226858-763e-47e2-b309-36a65329ab16 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:14.458278 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3e226858-763e-47e2-b309-36a65329ab16 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:14.927235 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-3e226858-763e-47e2-b309-36a65329ab16 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81e63d09bd94a9faf9530e911acf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36c639ebfd347b28afeb5724b3e1d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:44:14.943417 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3e226858-763e-47e2-b309-36a65329ab16 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] 10.222.0.52 "GET /compute/v2.1/servers/ceedb58f-1285-4292-8eb7-d741f2919484" status: 200 len: 1320 microversion: 2.1 time: 0.507535 Oct 19 03:44:14.964373 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2913/5896] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:44:14 2022] GET /compute/v2.1/servers/ceedb58f-1285-4292-8eb7-d741f2919484 => generated 1320 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:44:15.968061 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-93149b76-cac4-41ae-946c-782400c32b36 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:44:15.968796 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-93149b76-cac4-41ae-946c-782400c32b36 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] [instance: ceedb58f-1285-4292-8eb7-d741f2919484] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:44:15.983297 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-93149b76-cac4-41ae-946c-782400c32b36 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:15.983819 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-93149b76-cac4-41ae-946c-782400c32b36 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:15.984266 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-93149b76-cac4-41ae-946c-782400c32b36 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:15.984996 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-93149b76-cac4-41ae-946c-782400c32b36 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:15.985489 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-93149b76-cac4-41ae-946c-782400c32b36 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:15.986114 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-93149b76-cac4-41ae-946c-782400c32b36 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:16.435406 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-93149b76-cac4-41ae-946c-782400c32b36 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81e63d09bd94a9faf9530e911acf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36c639ebfd347b28afeb5724b3e1d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:44:16.449083 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-93149b76-cac4-41ae-946c-782400c32b36 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] 10.222.0.52 "GET /compute/v2.1/servers/ceedb58f-1285-4292-8eb7-d741f2919484" status: 200 len: 1320 microversion: 2.1 time: 0.485253 Oct 19 03:44:16.461883 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2984/5897] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:44:15 2022] GET /compute/v2.1/servers/ceedb58f-1285-4292-8eb7-d741f2919484 => generated 1320 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:44:16.993033 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-01d1ae64-5877-4256-b515-0f722b62770a req-03c7190a-6c13-4771-aa98-7e2561337bcf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a339021c-b7c6-4e4c-abc9-e91fefca9b98", "tag": "6667d343-03b8-4c21-a012-56d60b3eec91"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:44:17.005258 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-01d1ae64-5877-4256-b515-0f722b62770a req-03c7190a-6c13-4771-aa98-7e2561337bcf service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:17.006274 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-01d1ae64-5877-4256-b515-0f722b62770a req-03c7190a-6c13-4771-aa98-7e2561337bcf service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:17.006878 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-01d1ae64-5877-4256-b515-0f722b62770a req-03c7190a-6c13-4771-aa98-7e2561337bcf service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:17.028469 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-01d1ae64-5877-4256-b515-0f722b62770a req-03c7190a-6c13-4771-aa98-7e2561337bcf service nova] Creating event network-changed:6667d343-03b8-4c21-a012-56d60b3eec91 for instance a339021c-b7c6-4e4c-abc9-e91fefca9b98 on n-h1-861333-8 Oct 19 03:44:17.035090 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-01d1ae64-5877-4256-b515-0f722b62770a req-03c7190a-6c13-4771-aa98-7e2561337bcf service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.203584 Oct 19 03:44:17.036558 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2914/5898] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:44:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:44:17.473503 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-35f636a3-b36a-4e9a-ba30-115921464df4 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:44:17.474106 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-35f636a3-b36a-4e9a-ba30-115921464df4 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] [instance: ceedb58f-1285-4292-8eb7-d741f2919484] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:44:17.476242 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=4 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:44:17.482533 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-35f636a3-b36a-4e9a-ba30-115921464df4 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:17.483026 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-35f636a3-b36a-4e9a-ba30-115921464df4 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:17.484544 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-35f636a3-b36a-4e9a-ba30-115921464df4 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:17.485298 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-35f636a3-b36a-4e9a-ba30-115921464df4 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:17.485982 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-35f636a3-b36a-4e9a-ba30-115921464df4 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:17.486484 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-35f636a3-b36a-4e9a-ba30-115921464df4 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:17.614599 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=14 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:44:17.723715 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-35f636a3-b36a-4e9a-ba30-115921464df4 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81e63d09bd94a9faf9530e911acf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36c639ebfd347b28afeb5724b3e1d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:44:17.732320 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-35f636a3-b36a-4e9a-ba30-115921464df4 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] 10.222.0.52 "GET /compute/v2.1/servers/ceedb58f-1285-4292-8eb7-d741f2919484" status: 200 len: 1320 microversion: 2.1 time: 0.263770 Oct 19 03:44:17.745455 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2985/5899] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:44:17 2022] GET /compute/v2.1/servers/ceedb58f-1285-4292-8eb7-d741f2919484 => generated 1320 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:44:18.308830 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-f448eb74-210c-48df-afc3-d15eae4d5af6 req-346206e7-d07a-46ce-8dd7-1bd344ccfc77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac91ce38-2d07-43e1-91c5-ebf68341e491", "name": "network-vif-plugged", "status": "completed", "tag": "85cb2801-42de-49e1-b975-d26594d01f2b"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:44:18.320138 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-f448eb74-210c-48df-afc3-d15eae4d5af6 req-346206e7-d07a-46ce-8dd7-1bd344ccfc77 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:18.320890 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-f448eb74-210c-48df-afc3-d15eae4d5af6 req-346206e7-d07a-46ce-8dd7-1bd344ccfc77 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:18.321551 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-f448eb74-210c-48df-afc3-d15eae4d5af6 req-346206e7-d07a-46ce-8dd7-1bd344ccfc77 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:18.335083 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-f448eb74-210c-48df-afc3-d15eae4d5af6 req-346206e7-d07a-46ce-8dd7-1bd344ccfc77 service nova] Creating event network-vif-plugged:85cb2801-42de-49e1-b975-d26594d01f2b for instance ac91ce38-2d07-43e1-91c5-ebf68341e491 on n-h1-861333-8 Oct 19 03:44:18.339921 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-f448eb74-210c-48df-afc3-d15eae4d5af6 req-346206e7-d07a-46ce-8dd7-1bd344ccfc77 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036149 Oct 19 03:44:18.340557 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2915/5900] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:44:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:44:18.774411 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-8b4ebc04-cfab-4306-9efb-b4cebcf1e2b8 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:44:18.774411 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-8b4ebc04-cfab-4306-9efb-b4cebcf1e2b8 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] [instance: ceedb58f-1285-4292-8eb7-d741f2919484] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:44:18.777031 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8b4ebc04-cfab-4306-9efb-b4cebcf1e2b8 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:18.777842 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8b4ebc04-cfab-4306-9efb-b4cebcf1e2b8 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:18.778589 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8b4ebc04-cfab-4306-9efb-b4cebcf1e2b8 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:18.779526 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8b4ebc04-cfab-4306-9efb-b4cebcf1e2b8 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:18.780288 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8b4ebc04-cfab-4306-9efb-b4cebcf1e2b8 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:18.780879 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8b4ebc04-cfab-4306-9efb-b4cebcf1e2b8 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:19.203353 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-8b4ebc04-cfab-4306-9efb-b4cebcf1e2b8 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81e63d09bd94a9faf9530e911acf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36c639ebfd347b28afeb5724b3e1d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:44:19.225975 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-8b4ebc04-cfab-4306-9efb-b4cebcf1e2b8 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] 10.222.0.52 "GET /compute/v2.1/servers/ceedb58f-1285-4292-8eb7-d741f2919484" status: 200 len: 1320 microversion: 2.1 time: 0.465907 Oct 19 03:44:19.227749 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2986/5901] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:44:18 2022] GET /compute/v2.1/servers/ceedb58f-1285-4292-8eb7-d741f2919484 => generated 1320 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:44:20.252795 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b323920e-4298-4d61-be3f-46d5e9ee295f tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:44:20.253915 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b323920e-4298-4d61-be3f-46d5e9ee295f tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] [instance: ceedb58f-1285-4292-8eb7-d741f2919484] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:44:20.261271 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=8 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:44:20.263820 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b323920e-4298-4d61-be3f-46d5e9ee295f tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:20.264335 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b323920e-4298-4d61-be3f-46d5e9ee295f tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:20.264762 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b323920e-4298-4d61-be3f-46d5e9ee295f tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:20.265810 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b323920e-4298-4d61-be3f-46d5e9ee295f tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:20.266292 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b323920e-4298-4d61-be3f-46d5e9ee295f tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:20.271155 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b323920e-4298-4d61-be3f-46d5e9ee295f tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:20.691812 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b323920e-4298-4d61-be3f-46d5e9ee295f tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81e63d09bd94a9faf9530e911acf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36c639ebfd347b28afeb5724b3e1d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:44:20.700402 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b323920e-4298-4d61-be3f-46d5e9ee295f tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] 10.222.0.52 "GET /compute/v2.1/servers/ceedb58f-1285-4292-8eb7-d741f2919484" status: 200 len: 1320 microversion: 2.1 time: 0.452455 Oct 19 03:44:20.700992 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2916/5902] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:44:20 2022] GET /compute/v2.1/servers/ceedb58f-1285-4292-8eb7-d741f2919484 => generated 1320 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:44:21.449659 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-78d5f95a-e616-4194-a451-46ce3671938f req-9d7d3ec8-4618-469f-ae62-d442c2f7a14e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ceedb58f-1285-4292-8eb7-d741f2919484", "name": "network-vif-plugged", "status": "completed", "tag": "638eb330-be96-4029-bc36-77117c7fd896"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:44:21.468359 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-78d5f95a-e616-4194-a451-46ce3671938f req-9d7d3ec8-4618-469f-ae62-d442c2f7a14e service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:21.468870 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-78d5f95a-e616-4194-a451-46ce3671938f req-9d7d3ec8-4618-469f-ae62-d442c2f7a14e service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:21.469802 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-78d5f95a-e616-4194-a451-46ce3671938f req-9d7d3ec8-4618-469f-ae62-d442c2f7a14e service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:21.492505 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-78d5f95a-e616-4194-a451-46ce3671938f req-9d7d3ec8-4618-469f-ae62-d442c2f7a14e service nova] Creating event network-vif-plugged:638eb330-be96-4029-bc36-77117c7fd896 for instance ceedb58f-1285-4292-8eb7-d741f2919484 on n-h2-861333-8 Oct 19 03:44:21.498598 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-78d5f95a-e616-4194-a451-46ce3671938f req-9d7d3ec8-4618-469f-ae62-d442c2f7a14e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055005 Oct 19 03:44:21.500304 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2987/5903] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:44:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:44:21.735598 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6a118c94-579d-48fb-b52a-e8a551ffbf00 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:44:21.736194 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6a118c94-579d-48fb-b52a-e8a551ffbf00 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] [instance: ceedb58f-1285-4292-8eb7-d741f2919484] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:44:21.764382 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6a118c94-579d-48fb-b52a-e8a551ffbf00 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:21.765145 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6a118c94-579d-48fb-b52a-e8a551ffbf00 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:21.765846 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6a118c94-579d-48fb-b52a-e8a551ffbf00 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:21.766872 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6a118c94-579d-48fb-b52a-e8a551ffbf00 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:21.767557 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6a118c94-579d-48fb-b52a-e8a551ffbf00 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:21.768945 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6a118c94-579d-48fb-b52a-e8a551ffbf00 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:22.429653 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-6a118c94-579d-48fb-b52a-e8a551ffbf00 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81e63d09bd94a9faf9530e911acf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36c639ebfd347b28afeb5724b3e1d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:44:22.441271 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6a118c94-579d-48fb-b52a-e8a551ffbf00 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] 10.222.0.52 "GET /compute/v2.1/servers/ceedb58f-1285-4292-8eb7-d741f2919484" status: 200 len: 1320 microversion: 2.1 time: 0.709335 Oct 19 03:44:22.442865 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2917/5904] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:44:21 2022] GET /compute/v2.1/servers/ceedb58f-1285-4292-8eb7-d741f2919484 => generated 1320 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:44:23.479928 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ddd9311c-9aa5-44ad-80ae-b85a649ddc66 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:44:23.480699 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ddd9311c-9aa5-44ad-80ae-b85a649ddc66 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] [instance: ceedb58f-1285-4292-8eb7-d741f2919484] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:44:23.489931 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ddd9311c-9aa5-44ad-80ae-b85a649ddc66 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:23.490789 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ddd9311c-9aa5-44ad-80ae-b85a649ddc66 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:23.491311 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ddd9311c-9aa5-44ad-80ae-b85a649ddc66 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:23.492156 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ddd9311c-9aa5-44ad-80ae-b85a649ddc66 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:23.492665 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ddd9311c-9aa5-44ad-80ae-b85a649ddc66 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:23.493141 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ddd9311c-9aa5-44ad-80ae-b85a649ddc66 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:23.707034 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ddd9311c-9aa5-44ad-80ae-b85a649ddc66 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81e63d09bd94a9faf9530e911acf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36c639ebfd347b28afeb5724b3e1d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:44:23.715976 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ddd9311c-9aa5-44ad-80ae-b85a649ddc66 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] 10.222.0.52 "GET /compute/v2.1/servers/ceedb58f-1285-4292-8eb7-d741f2919484" status: 200 len: 1320 microversion: 2.1 time: 0.241817 Oct 19 03:44:23.717236 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2988/5905] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:44:23 2022] GET /compute/v2.1/servers/ceedb58f-1285-4292-8eb7-d741f2919484 => generated 1320 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:44:24.631770 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-78f0c4df-1b67-48da-a785-ccc4a9f0b86b req-da765f45-76d1-4b10-89a8-5ee12cf3fb30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a339021c-b7c6-4e4c-abc9-e91fefca9b98", "name": "network-vif-plugged", "status": "completed", "tag": "6667d343-03b8-4c21-a012-56d60b3eec91"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:44:24.643838 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-78f0c4df-1b67-48da-a785-ccc4a9f0b86b req-da765f45-76d1-4b10-89a8-5ee12cf3fb30 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:24.644824 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-78f0c4df-1b67-48da-a785-ccc4a9f0b86b req-da765f45-76d1-4b10-89a8-5ee12cf3fb30 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:24.645455 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-78f0c4df-1b67-48da-a785-ccc4a9f0b86b req-da765f45-76d1-4b10-89a8-5ee12cf3fb30 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:24.658617 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-78f0c4df-1b67-48da-a785-ccc4a9f0b86b req-da765f45-76d1-4b10-89a8-5ee12cf3fb30 service nova] Creating event network-vif-plugged:6667d343-03b8-4c21-a012-56d60b3eec91 for instance a339021c-b7c6-4e4c-abc9-e91fefca9b98 on n-h1-861333-8 Oct 19 03:44:24.665463 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-78f0c4df-1b67-48da-a785-ccc4a9f0b86b req-da765f45-76d1-4b10-89a8-5ee12cf3fb30 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041555 Oct 19 03:44:24.666404 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2918/5906] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:44:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:44:24.743079 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-27498ebd-5756-44e0-8bd8-99b41635f2d8 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:44:24.743829 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-27498ebd-5756-44e0-8bd8-99b41635f2d8 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] [instance: ceedb58f-1285-4292-8eb7-d741f2919484] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:44:24.759711 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-27498ebd-5756-44e0-8bd8-99b41635f2d8 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:24.761785 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-27498ebd-5756-44e0-8bd8-99b41635f2d8 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:24.762308 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-27498ebd-5756-44e0-8bd8-99b41635f2d8 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:24.766370 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-27498ebd-5756-44e0-8bd8-99b41635f2d8 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:24.766939 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-27498ebd-5756-44e0-8bd8-99b41635f2d8 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:24.775348 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-27498ebd-5756-44e0-8bd8-99b41635f2d8 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:25.110001 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-27498ebd-5756-44e0-8bd8-99b41635f2d8 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81e63d09bd94a9faf9530e911acf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36c639ebfd347b28afeb5724b3e1d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:44:25.127218 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-27498ebd-5756-44e0-8bd8-99b41635f2d8 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] 10.222.0.52 "GET /compute/v2.1/servers/ceedb58f-1285-4292-8eb7-d741f2919484" status: 200 len: 1512 microversion: 2.1 time: 0.389541 Oct 19 03:44:25.145905 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2989/5907] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:44:24 2022] GET /compute/v2.1/servers/ceedb58f-1285-4292-8eb7-d741f2919484 => generated 1512 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:44:25.155330 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9f61c724-f233-4f4e-9c33-c577b693184b tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:44:25.159923 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9f61c724-f233-4f4e-9c33-c577b693184b tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] [instance: ac91ce38-2d07-43e1-91c5-ebf68341e491] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:44:25.163707 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9f61c724-f233-4f4e-9c33-c577b693184b tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:25.164400 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9f61c724-f233-4f4e-9c33-c577b693184b tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:25.165057 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9f61c724-f233-4f4e-9c33-c577b693184b tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:25.165962 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9f61c724-f233-4f4e-9c33-c577b693184b tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:25.166634 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9f61c724-f233-4f4e-9c33-c577b693184b tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:25.167215 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9f61c724-f233-4f4e-9c33-c577b693184b tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:25.472476 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9f61c724-f233-4f4e-9c33-c577b693184b tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81e63d09bd94a9faf9530e911acf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36c639ebfd347b28afeb5724b3e1d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:44:25.481485 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9f61c724-f233-4f4e-9c33-c577b693184b tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] 10.222.0.52 "GET /compute/v2.1/servers/ac91ce38-2d07-43e1-91c5-ebf68341e491" status: 200 len: 1511 microversion: 2.1 time: 0.330653 Oct 19 03:44:25.482448 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2919/5908] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:44:25 2022] GET /compute/v2.1/servers/ac91ce38-2d07-43e1-91c5-ebf68341e491 => generated 1511 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:44:25.505199 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c9fbcdc8-473c-45e4-b952-c33ec50e1eaa tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:44:25.506209 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c9fbcdc8-473c-45e4-b952-c33ec50e1eaa tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] [instance: a339021c-b7c6-4e4c-abc9-e91fefca9b98] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:44:25.512944 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c9fbcdc8-473c-45e4-b952-c33ec50e1eaa tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:25.513764 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c9fbcdc8-473c-45e4-b952-c33ec50e1eaa tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:25.514422 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c9fbcdc8-473c-45e4-b952-c33ec50e1eaa tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:25.515377 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c9fbcdc8-473c-45e4-b952-c33ec50e1eaa tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:25.516009 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c9fbcdc8-473c-45e4-b952-c33ec50e1eaa tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:25.516639 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c9fbcdc8-473c-45e4-b952-c33ec50e1eaa tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:25.765473 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c9fbcdc8-473c-45e4-b952-c33ec50e1eaa tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81e63d09bd94a9faf9530e911acf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36c639ebfd347b28afeb5724b3e1d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:44:25.780465 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c9fbcdc8-473c-45e4-b952-c33ec50e1eaa tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] 10.222.0.52 "GET /compute/v2.1/servers/a339021c-b7c6-4e4c-abc9-e91fefca9b98" status: 200 len: 1321 microversion: 2.1 time: 0.279467 Oct 19 03:44:25.781340 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2990/5909] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:44:25 2022] GET /compute/v2.1/servers/a339021c-b7c6-4e4c-abc9-e91fefca9b98 => generated 1321 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:44:26.804674 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8b9c5f68-31a1-462f-9d21-d7ad10bc2cc7 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:44:26.805292 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8b9c5f68-31a1-462f-9d21-d7ad10bc2cc7 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] [instance: a339021c-b7c6-4e4c-abc9-e91fefca9b98] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:44:26.813171 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8b9c5f68-31a1-462f-9d21-d7ad10bc2cc7 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:26.813940 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8b9c5f68-31a1-462f-9d21-d7ad10bc2cc7 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:26.814598 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8b9c5f68-31a1-462f-9d21-d7ad10bc2cc7 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:26.815547 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8b9c5f68-31a1-462f-9d21-d7ad10bc2cc7 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:26.816163 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8b9c5f68-31a1-462f-9d21-d7ad10bc2cc7 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:26.816888 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8b9c5f68-31a1-462f-9d21-d7ad10bc2cc7 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:27.071149 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8b9c5f68-31a1-462f-9d21-d7ad10bc2cc7 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81e63d09bd94a9faf9530e911acf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36c639ebfd347b28afeb5724b3e1d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:44:27.087035 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8b9c5f68-31a1-462f-9d21-d7ad10bc2cc7 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] 10.222.0.52 "GET /compute/v2.1/servers/a339021c-b7c6-4e4c-abc9-e91fefca9b98" status: 200 len: 1513 microversion: 2.1 time: 0.285787 Oct 19 03:44:27.089402 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2920/5910] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:44:26 2022] GET /compute/v2.1/servers/a339021c-b7c6-4e4c-abc9-e91fefca9b98 => generated 1513 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:44:27.110806 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e3723c4a-40ba-4d1a-87c5-0d335316d12b tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:44:27.119856 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-e3723c4a-40ba-4d1a-87c5-0d335316d12b tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c81e63d09bd94a9faf9530e911acf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36c639ebfd347b28afeb5724b3e1d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:44:27.121143 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e3723c4a-40ba-4d1a-87c5-0d335316d12b tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'd36c639ebfd347b28afeb5724b3e1d67'} {{(pid=121135) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 03:44:27.135877 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e3723c4a-40ba-4d1a-87c5-0d335316d12b tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:27.136777 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e3723c4a-40ba-4d1a-87c5-0d335316d12b tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:27.137497 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e3723c4a-40ba-4d1a-87c5-0d335316d12b tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:27.138495 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e3723c4a-40ba-4d1a-87c5-0d335316d12b tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:27.139222 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e3723c4a-40ba-4d1a-87c5-0d335316d12b tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:27.139875 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e3723c4a-40ba-4d1a-87c5-0d335316d12b tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:27.256796 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.multi_cell_list [None req-e3723c4a-40ba-4d1a-87c5-0d335316d12b tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121135) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 03:44:27.274926 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=100 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:44:27.342596 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-e3723c4a-40ba-4d1a-87c5-0d335316d12b tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81e63d09bd94a9faf9530e911acf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36c639ebfd347b28afeb5724b3e1d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:44:27.350012 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e3723c4a-40ba-4d1a-87c5-0d335316d12b tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:27.350533 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e3723c4a-40ba-4d1a-87c5-0d335316d12b tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:27.350985 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e3723c4a-40ba-4d1a-87c5-0d335316d12b tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:27.698459 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e3723c4a-40ba-4d1a-87c5-0d335316d12b tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] 10.222.0.52 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1515 microversion: 2.1 time: 0.591387 Oct 19 03:44:27.702021 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2991/5911] 10.222.0.52 () {58 vars in 1167 bytes} [Wed Oct 19 03:44:27 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1515 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:44:27.738163 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0cdeef10-2fbf-44ee-80f8-8af01410b548 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:44:27.759302 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0cdeef10-2fbf-44ee-80f8-8af01410b548 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c81e63d09bd94a9faf9530e911acf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36c639ebfd347b28afeb5724b3e1d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:44:27.761470 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0cdeef10-2fbf-44ee-80f8-8af01410b548 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-110299381', 'deleted': False, 'project_id': 'd36c639ebfd347b28afeb5724b3e1d67'} {{(pid=121134) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 03:44:27.782466 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0cdeef10-2fbf-44ee-80f8-8af01410b548 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:27.782961 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0cdeef10-2fbf-44ee-80f8-8af01410b548 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:27.784636 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0cdeef10-2fbf-44ee-80f8-8af01410b548 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:27.785694 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0cdeef10-2fbf-44ee-80f8-8af01410b548 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:27.787535 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0cdeef10-2fbf-44ee-80f8-8af01410b548 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:27.787535 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0cdeef10-2fbf-44ee-80f8-8af01410b548 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:27.947908 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.multi_cell_list [None req-0cdeef10-2fbf-44ee-80f8-8af01410b548 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121134) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 03:44:28.045418 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0cdeef10-2fbf-44ee-80f8-8af01410b548 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81e63d09bd94a9faf9530e911acf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36c639ebfd347b28afeb5724b3e1d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:44:28.052433 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0cdeef10-2fbf-44ee-80f8-8af01410b548 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:28.053173 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0cdeef10-2fbf-44ee-80f8-8af01410b548 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:28.053648 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0cdeef10-2fbf-44ee-80f8-8af01410b548 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:28.307932 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0cdeef10-2fbf-44ee-80f8-8af01410b548 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] 10.222.0.52 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-110299381" status: 200 len: 1514 microversion: 2.1 time: 0.577690 Oct 19 03:44:28.310773 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2921/5912] 10.222.0.52 () {58 vars in 1261 bytes} [Wed Oct 19 03:44:27 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-110299381 => generated 1514 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:44:28.336238 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-55ce15a0-88cb-46e5-a447-24e7653bd650 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:44:28.342275 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-55ce15a0-88cb-46e5-a447-24e7653bd650 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c81e63d09bd94a9faf9530e911acf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36c639ebfd347b28afeb5724b3e1d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:44:28.343161 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-55ce15a0-88cb-46e5-a447-24e7653bd650 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'd36c639ebfd347b28afeb5724b3e1d67'} {{(pid=121135) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 03:44:28.350040 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-55ce15a0-88cb-46e5-a447-24e7653bd650 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:28.350775 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-55ce15a0-88cb-46e5-a447-24e7653bd650 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:28.351414 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-55ce15a0-88cb-46e5-a447-24e7653bd650 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:28.352653 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-55ce15a0-88cb-46e5-a447-24e7653bd650 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:28.353313 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-55ce15a0-88cb-46e5-a447-24e7653bd650 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:28.353975 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-55ce15a0-88cb-46e5-a447-24e7653bd650 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:28.455604 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.multi_cell_list [None req-55ce15a0-88cb-46e5-a447-24e7653bd650 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=121135) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 03:44:28.541463 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-55ce15a0-88cb-46e5-a447-24e7653bd650 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81e63d09bd94a9faf9530e911acf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36c639ebfd347b28afeb5724b3e1d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:44:28.548237 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-55ce15a0-88cb-46e5-a447-24e7653bd650 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:28.549400 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-55ce15a0-88cb-46e5-a447-24e7653bd650 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:28.549867 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-55ce15a0-88cb-46e5-a447-24e7653bd650 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:29.124152 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-55ce15a0-88cb-46e5-a447-24e7653bd650 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] 10.222.0.52 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4519 microversion: 2.1 time: 0.792005 Oct 19 03:44:29.125017 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2992/5913] 10.222.0.52 () {58 vars in 1173 bytes} [Wed Oct 19 03:44:28 2022] GET /compute/v2.1/servers/detail?status=active => generated 4519 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:44:29.156828 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0f60e190-6329-4c87-8566-161738ace998 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:44:29.162562 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0f60e190-6329-4c87-8566-161738ace998 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c81e63d09bd94a9faf9530e911acf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36c639ebfd347b28afeb5724b3e1d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:44:29.163134 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.compute.servers [None req-0f60e190-6329-4c87-8566-161738ace998 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Removing options 'limit' from query {{(pid=121134) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1499}} Oct 19 03:44:29.164110 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0f60e190-6329-4c87-8566-161738ace998 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Searching by: {'deleted': False, 'project_id': 'd36c639ebfd347b28afeb5724b3e1d67'} {{(pid=121134) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 03:44:29.170634 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0f60e190-6329-4c87-8566-161738ace998 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:29.171429 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0f60e190-6329-4c87-8566-161738ace998 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:29.172104 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0f60e190-6329-4c87-8566-161738ace998 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:29.173065 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0f60e190-6329-4c87-8566-161738ace998 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:29.173809 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0f60e190-6329-4c87-8566-161738ace998 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:29.174482 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0f60e190-6329-4c87-8566-161738ace998 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:29.216137 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0f60e190-6329-4c87-8566-161738ace998 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81e63d09bd94a9faf9530e911acf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36c639ebfd347b28afeb5724b3e1d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:44:29.224881 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0f60e190-6329-4c87-8566-161738ace998 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:29.225722 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0f60e190-6329-4c87-8566-161738ace998 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:29.226336 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0f60e190-6329-4c87-8566-161738ace998 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:29.436706 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0f60e190-6329-4c87-8566-161738ace998 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] 10.222.0.52 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1661 microversion: 2.1 time: 0.285023 Oct 19 03:44:29.454358 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2922/5914] 10.222.0.52 () {58 vars in 1161 bytes} [Wed Oct 19 03:44:29 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1661 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:44:29.465150 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0e7e6492-5534-46c3-bbfb-6540414ae241 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:44:29.482857 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-0e7e6492-5534-46c3-bbfb-6540414ae241 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c81e63d09bd94a9faf9530e911acf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36c639ebfd347b28afeb5724b3e1d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:44:29.487724 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0e7e6492-5534-46c3-bbfb-6540414ae241 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'd36c639ebfd347b28afeb5724b3e1d67'} {{(pid=121135) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 03:44:29.494926 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0e7e6492-5534-46c3-bbfb-6540414ae241 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:29.495882 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0e7e6492-5534-46c3-bbfb-6540414ae241 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:29.496699 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0e7e6492-5534-46c3-bbfb-6540414ae241 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:29.497848 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0e7e6492-5534-46c3-bbfb-6540414ae241 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:29.498476 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0e7e6492-5534-46c3-bbfb-6540414ae241 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:29.499064 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0e7e6492-5534-46c3-bbfb-6540414ae241 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:29.530337 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.multi_cell_list [None req-0e7e6492-5534-46c3-bbfb-6540414ae241 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=121135) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 03:44:29.569229 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0e7e6492-5534-46c3-bbfb-6540414ae241 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] 10.222.0.52 "GET /compute/v2.1/servers?status=active" status: 200 len: 1010 microversion: 2.1 time: 0.109186 Oct 19 03:44:29.571087 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2993/5915] 10.222.0.52 () {58 vars in 1152 bytes} [Wed Oct 19 03:44:29 2022] GET /compute/v2.1/servers?status=active => generated 1010 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:44:29.583685 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6efa51ad-2f96-4259-824a-cfd73253a342 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:44:29.588837 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-6efa51ad-2f96-4259-824a-cfd73253a342 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c81e63d09bd94a9faf9530e911acf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36c639ebfd347b28afeb5724b3e1d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:44:29.589394 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.compute.servers [None req-6efa51ad-2f96-4259-824a-cfd73253a342 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Removing options 'limit' from query {{(pid=121134) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1499}} Oct 19 03:44:29.590084 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6efa51ad-2f96-4259-824a-cfd73253a342 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Searching by: {'deleted': False, 'project_id': 'd36c639ebfd347b28afeb5724b3e1d67'} {{(pid=121134) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 03:44:29.595486 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6efa51ad-2f96-4259-824a-cfd73253a342 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:29.595982 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6efa51ad-2f96-4259-824a-cfd73253a342 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:29.596619 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6efa51ad-2f96-4259-824a-cfd73253a342 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:29.597653 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6efa51ad-2f96-4259-824a-cfd73253a342 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:29.598283 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6efa51ad-2f96-4259-824a-cfd73253a342 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:29.598871 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6efa51ad-2f96-4259-824a-cfd73253a342 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:29.632020 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.multi_cell_list [None req-6efa51ad-2f96-4259-824a-cfd73253a342 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=121134) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 03:44:29.661053 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:44:29.663822 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6efa51ad-2f96-4259-824a-cfd73253a342 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] 10.222.0.52 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1010 microversion: 2.1 time: 0.084014 Oct 19 03:44:29.664596 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2923/5916] 10.222.0.52 () {58 vars in 1150 bytes} [Wed Oct 19 03:44:29 2022] GET /compute/v2.1/servers?limit=100000 => generated 1010 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:44:29.676781 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0989bb97-5247-48ab-92fa-270d1ba06033 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:44:29.681709 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-0989bb97-5247-48ab-92fa-270d1ba06033 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c81e63d09bd94a9faf9530e911acf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36c639ebfd347b28afeb5724b3e1d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:44:29.682581 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0989bb97-5247-48ab-92fa-270d1ba06033 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Searching by: {'deleted': False, 'project_id': 'd36c639ebfd347b28afeb5724b3e1d67'} {{(pid=121135) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 03:44:29.688006 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0989bb97-5247-48ab-92fa-270d1ba06033 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:29.688723 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0989bb97-5247-48ab-92fa-270d1ba06033 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:29.689458 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0989bb97-5247-48ab-92fa-270d1ba06033 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:29.690369 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0989bb97-5247-48ab-92fa-270d1ba06033 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:29.691040 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0989bb97-5247-48ab-92fa-270d1ba06033 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:29.691616 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0989bb97-5247-48ab-92fa-270d1ba06033 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:29.721805 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.multi_cell_list [None req-0989bb97-5247-48ab-92fa-270d1ba06033 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=121135) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 03:44:29.760884 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0989bb97-5247-48ab-92fa-270d1ba06033 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] 10.222.0.52 "GET /compute/v2.1/servers" status: 200 len: 1010 microversion: 2.1 time: 0.088115 Oct 19 03:44:29.763498 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2994/5917] 10.222.0.52 () {58 vars in 1125 bytes} [Wed Oct 19 03:44:29 2022] GET /compute/v2.1/servers => generated 1010 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:44:29.777421 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ad09acc5-e0e9-460b-9a68-aa62ed164856 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:44:29.783098 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ad09acc5-e0e9-460b-9a68-aa62ed164856 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c81e63d09bd94a9faf9530e911acf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36c639ebfd347b28afeb5724b3e1d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:44:29.784070 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ad09acc5-e0e9-460b-9a68-aa62ed164856 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'd36c639ebfd347b28afeb5724b3e1d67'} {{(pid=121134) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 03:44:29.798710 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ad09acc5-e0e9-460b-9a68-aa62ed164856 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:29.798710 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ad09acc5-e0e9-460b-9a68-aa62ed164856 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:29.798710 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ad09acc5-e0e9-460b-9a68-aa62ed164856 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:29.798710 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ad09acc5-e0e9-460b-9a68-aa62ed164856 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:29.798710 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ad09acc5-e0e9-460b-9a68-aa62ed164856 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:29.798710 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ad09acc5-e0e9-460b-9a68-aa62ed164856 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:29.917282 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.multi_cell_list [None req-ad09acc5-e0e9-460b-9a68-aa62ed164856 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121134) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 03:44:29.989948 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ad09acc5-e0e9-460b-9a68-aa62ed164856 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] 10.222.0.52 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 345 microversion: 2.1 time: 0.216378 Oct 19 03:44:29.991115 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2924/5918] 10.222.0.52 () {58 vars in 1146 bytes} [Wed Oct 19 03:44:29 2022] GET /compute/v2.1/servers?flavor=451 => generated 345 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:44:30.004239 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-030e7d63-a390-4461-ba9b-f93cc78002fb tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:44:30.013241 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-030e7d63-a390-4461-ba9b-f93cc78002fb tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c81e63d09bd94a9faf9530e911acf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36c639ebfd347b28afeb5724b3e1d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:44:30.016764 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.compute.servers [None req-030e7d63-a390-4461-ba9b-f93cc78002fb tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Removing options 'limit' from query {{(pid=121135) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1499}} Oct 19 03:44:30.019717 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-030e7d63-a390-4461-ba9b-f93cc78002fb tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Searching by: {'deleted': False, 'project_id': 'd36c639ebfd347b28afeb5724b3e1d67'} {{(pid=121135) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 03:44:30.035461 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-030e7d63-a390-4461-ba9b-f93cc78002fb tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:30.036548 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-030e7d63-a390-4461-ba9b-f93cc78002fb tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:30.038594 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-030e7d63-a390-4461-ba9b-f93cc78002fb tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:30.040671 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-030e7d63-a390-4461-ba9b-f93cc78002fb tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:30.044946 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-030e7d63-a390-4461-ba9b-f93cc78002fb tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:30.044946 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-030e7d63-a390-4461-ba9b-f93cc78002fb tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:30.089920 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-030e7d63-a390-4461-ba9b-f93cc78002fb tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] 10.222.0.52 "GET /compute/v2.1/servers?limit=1" status: 200 len: 484 microversion: 2.1 time: 0.085389 Oct 19 03:44:30.098897 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2995/5919] 10.222.0.52 () {58 vars in 1140 bytes} [Wed Oct 19 03:44:29 2022] GET /compute/v2.1/servers?limit=1 => generated 484 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:44:30.105286 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e2b22d07-5534-4332-a5c6-5dfba8eae7de tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:44:30.112159 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e2b22d07-5534-4332-a5c6-5dfba8eae7de tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c81e63d09bd94a9faf9530e911acf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36c639ebfd347b28afeb5724b3e1d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:44:30.117317 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e2b22d07-5534-4332-a5c6-5dfba8eae7de tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-110299381', 'deleted': False, 'project_id': 'd36c639ebfd347b28afeb5724b3e1d67'} {{(pid=121134) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 03:44:30.130611 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e2b22d07-5534-4332-a5c6-5dfba8eae7de tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:30.131102 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e2b22d07-5534-4332-a5c6-5dfba8eae7de tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:30.137722 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e2b22d07-5534-4332-a5c6-5dfba8eae7de tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:30.137722 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e2b22d07-5534-4332-a5c6-5dfba8eae7de tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:30.137722 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e2b22d07-5534-4332-a5c6-5dfba8eae7de tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:30.137722 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e2b22d07-5534-4332-a5c6-5dfba8eae7de tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:30.278192 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.multi_cell_list [None req-e2b22d07-5534-4332-a5c6-5dfba8eae7de tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121134) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 03:44:30.365027 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e2b22d07-5534-4332-a5c6-5dfba8eae7de tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] 10.222.0.52 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-110299381" status: 200 len: 345 microversion: 2.1 time: 0.264007 Oct 19 03:44:30.365879 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2925/5920] 10.222.0.52 () {58 vars in 1240 bytes} [Wed Oct 19 03:44:30 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-110299381 => generated 345 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:44:30.385657 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2215bf84-03f2-4401-af09-9f12847374f9 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:44:30.398860 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2215bf84-03f2-4401-af09-9f12847374f9 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:30.399727 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2215bf84-03f2-4401-af09-9f12847374f9 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:30.400937 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2215bf84-03f2-4401-af09-9f12847374f9 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:30.425662 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-2215bf84-03f2-4401-af09-9f12847374f9 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] [instance: ac91ce38-2d07-43e1-91c5-ebf68341e491] Going to try to stop instance {{(pid=121135) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 19 03:44:30.659156 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2215bf84-03f2-4401-af09-9f12847374f9 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] 10.222.0.52 "POST /compute/v2.1/servers/ac91ce38-2d07-43e1-91c5-ebf68341e491/action" status: 202 len: 0 microversion: 2.1 time: 0.282820 Oct 19 03:44:30.664541 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2996/5921] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:44:30 2022] POST /compute/v2.1/servers/ac91ce38-2d07-43e1-91c5-ebf68341e491/action => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:44:30.669645 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-bd295b64-ee9a-496b-8cb9-5934d80943bf tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:44:30.670009 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-bd295b64-ee9a-496b-8cb9-5934d80943bf tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] [instance: ac91ce38-2d07-43e1-91c5-ebf68341e491] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:44:30.685391 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bd295b64-ee9a-496b-8cb9-5934d80943bf tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:30.687194 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bd295b64-ee9a-496b-8cb9-5934d80943bf tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:30.687972 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bd295b64-ee9a-496b-8cb9-5934d80943bf tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:30.689011 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bd295b64-ee9a-496b-8cb9-5934d80943bf tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:30.689839 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bd295b64-ee9a-496b-8cb9-5934d80943bf tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:30.690790 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bd295b64-ee9a-496b-8cb9-5934d80943bf tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:31.357714 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-bd295b64-ee9a-496b-8cb9-5934d80943bf tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81e63d09bd94a9faf9530e911acf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36c639ebfd347b28afeb5724b3e1d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:44:31.366363 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-bd295b64-ee9a-496b-8cb9-5934d80943bf tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] 10.222.0.52 "GET /compute/v2.1/servers/ac91ce38-2d07-43e1-91c5-ebf68341e491" status: 200 len: 1521 microversion: 2.1 time: 0.701113 Oct 19 03:44:31.379153 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2926/5922] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:44:30 2022] GET /compute/v2.1/servers/ac91ce38-2d07-43e1-91c5-ebf68341e491 => generated 1521 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:44:32.407484 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2e202557-ddda-4ed3-ad96-b21be4faa396 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:44:32.408266 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-2e202557-ddda-4ed3-ad96-b21be4faa396 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] [instance: ac91ce38-2d07-43e1-91c5-ebf68341e491] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:44:32.410256 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=6 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:44:32.427073 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2e202557-ddda-4ed3-ad96-b21be4faa396 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:32.427992 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2e202557-ddda-4ed3-ad96-b21be4faa396 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:32.428494 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2e202557-ddda-4ed3-ad96-b21be4faa396 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:32.429342 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2e202557-ddda-4ed3-ad96-b21be4faa396 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:32.430076 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2e202557-ddda-4ed3-ad96-b21be4faa396 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:32.430627 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2e202557-ddda-4ed3-ad96-b21be4faa396 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:32.591631 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-2e202557-ddda-4ed3-ad96-b21be4faa396 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81e63d09bd94a9faf9530e911acf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36c639ebfd347b28afeb5724b3e1d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:44:32.605280 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2e202557-ddda-4ed3-ad96-b21be4faa396 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] 10.222.0.52 "GET /compute/v2.1/servers/ac91ce38-2d07-43e1-91c5-ebf68341e491" status: 200 len: 1521 microversion: 2.1 time: 0.203215 Oct 19 03:44:32.609455 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2997/5923] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:44:32 2022] GET /compute/v2.1/servers/ac91ce38-2d07-43e1-91c5-ebf68341e491 => generated 1521 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:44:33.644289 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2ba87b25-1946-456b-852f-dc373cf5178f tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:44:33.644903 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2ba87b25-1946-456b-852f-dc373cf5178f tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] [instance: ac91ce38-2d07-43e1-91c5-ebf68341e491] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:44:33.656462 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:44:33.659487 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2ba87b25-1946-456b-852f-dc373cf5178f tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:33.662175 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2ba87b25-1946-456b-852f-dc373cf5178f tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:33.663084 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2ba87b25-1946-456b-852f-dc373cf5178f tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:33.664088 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2ba87b25-1946-456b-852f-dc373cf5178f tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:33.665729 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2ba87b25-1946-456b-852f-dc373cf5178f tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:33.666669 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2ba87b25-1946-456b-852f-dc373cf5178f tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:33.980773 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-2ba87b25-1946-456b-852f-dc373cf5178f tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81e63d09bd94a9faf9530e911acf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36c639ebfd347b28afeb5724b3e1d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:44:34.004159 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2ba87b25-1946-456b-852f-dc373cf5178f tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] 10.222.0.52 "GET /compute/v2.1/servers/ac91ce38-2d07-43e1-91c5-ebf68341e491" status: 200 len: 1521 microversion: 2.1 time: 0.363804 Oct 19 03:44:34.023149 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2927/5924] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:44:33 2022] GET /compute/v2.1/servers/ac91ce38-2d07-43e1-91c5-ebf68341e491 => generated 1521 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:44:35.038517 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7cd5f41a-7603-4899-ab4f-1489fa7f5863 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:44:35.039904 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7cd5f41a-7603-4899-ab4f-1489fa7f5863 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] [instance: ac91ce38-2d07-43e1-91c5-ebf68341e491] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:44:35.047587 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7cd5f41a-7603-4899-ab4f-1489fa7f5863 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:35.048326 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7cd5f41a-7603-4899-ab4f-1489fa7f5863 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:35.048961 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7cd5f41a-7603-4899-ab4f-1489fa7f5863 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:35.050099 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7cd5f41a-7603-4899-ab4f-1489fa7f5863 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:35.050727 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7cd5f41a-7603-4899-ab4f-1489fa7f5863 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:35.051373 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7cd5f41a-7603-4899-ab4f-1489fa7f5863 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:35.297298 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7cd5f41a-7603-4899-ab4f-1489fa7f5863 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81e63d09bd94a9faf9530e911acf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36c639ebfd347b28afeb5724b3e1d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:44:35.352115 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7cd5f41a-7603-4899-ab4f-1489fa7f5863 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] 10.222.0.52 "GET /compute/v2.1/servers/ac91ce38-2d07-43e1-91c5-ebf68341e491" status: 200 len: 1521 microversion: 2.1 time: 0.318404 Oct 19 03:44:35.360139 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2998/5925] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:44:35 2022] GET /compute/v2.1/servers/ac91ce38-2d07-43e1-91c5-ebf68341e491 => generated 1521 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:44:36.375907 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c86843cd-3762-4bcc-a3d1-121990ea44e6 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:44:36.376529 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c86843cd-3762-4bcc-a3d1-121990ea44e6 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] [instance: ac91ce38-2d07-43e1-91c5-ebf68341e491] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:44:36.384322 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c86843cd-3762-4bcc-a3d1-121990ea44e6 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:36.385142 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c86843cd-3762-4bcc-a3d1-121990ea44e6 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:36.392518 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c86843cd-3762-4bcc-a3d1-121990ea44e6 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:36.401281 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c86843cd-3762-4bcc-a3d1-121990ea44e6 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:36.401847 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c86843cd-3762-4bcc-a3d1-121990ea44e6 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:36.402304 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c86843cd-3762-4bcc-a3d1-121990ea44e6 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:36.707144 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c86843cd-3762-4bcc-a3d1-121990ea44e6 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81e63d09bd94a9faf9530e911acf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36c639ebfd347b28afeb5724b3e1d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:44:36.717864 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c86843cd-3762-4bcc-a3d1-121990ea44e6 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] 10.222.0.52 "GET /compute/v2.1/servers/ac91ce38-2d07-43e1-91c5-ebf68341e491" status: 200 len: 1521 microversion: 2.1 time: 0.345602 Oct 19 03:44:36.744751 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2928/5926] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:44:36 2022] GET /compute/v2.1/servers/ac91ce38-2d07-43e1-91c5-ebf68341e491 => generated 1521 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:44:37.754159 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-fff1070b-3813-4311-adf3-ce16c9ab699f tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:44:37.755597 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-fff1070b-3813-4311-adf3-ce16c9ab699f tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] [instance: ac91ce38-2d07-43e1-91c5-ebf68341e491] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:44:37.764159 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fff1070b-3813-4311-adf3-ce16c9ab699f tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:37.764766 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fff1070b-3813-4311-adf3-ce16c9ab699f tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:37.772364 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fff1070b-3813-4311-adf3-ce16c9ab699f tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:37.772364 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fff1070b-3813-4311-adf3-ce16c9ab699f tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:37.772364 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fff1070b-3813-4311-adf3-ce16c9ab699f tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:37.772364 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fff1070b-3813-4311-adf3-ce16c9ab699f tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:37.992779 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-fff1070b-3813-4311-adf3-ce16c9ab699f tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81e63d09bd94a9faf9530e911acf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36c639ebfd347b28afeb5724b3e1d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:44:38.000760 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-fff1070b-3813-4311-adf3-ce16c9ab699f tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] 10.222.0.52 "GET /compute/v2.1/servers/ac91ce38-2d07-43e1-91c5-ebf68341e491" status: 200 len: 1521 microversion: 2.1 time: 0.261567 Oct 19 03:44:38.003331 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 2999/5927] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:44:37 2022] GET /compute/v2.1/servers/ac91ce38-2d07-43e1-91c5-ebf68341e491 => generated 1521 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:44:39.027778 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-91385731-3cfe-48e6-a311-4ef45e9de574 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:44:39.028447 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-91385731-3cfe-48e6-a311-4ef45e9de574 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] [instance: ac91ce38-2d07-43e1-91c5-ebf68341e491] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:44:39.035768 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-91385731-3cfe-48e6-a311-4ef45e9de574 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:39.036276 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-91385731-3cfe-48e6-a311-4ef45e9de574 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:39.036712 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-91385731-3cfe-48e6-a311-4ef45e9de574 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:39.037691 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-91385731-3cfe-48e6-a311-4ef45e9de574 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:39.038318 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-91385731-3cfe-48e6-a311-4ef45e9de574 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:39.038906 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-91385731-3cfe-48e6-a311-4ef45e9de574 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:39.214579 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=4 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:44:39.353883 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-91385731-3cfe-48e6-a311-4ef45e9de574 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81e63d09bd94a9faf9530e911acf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36c639ebfd347b28afeb5724b3e1d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:44:39.370615 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-91385731-3cfe-48e6-a311-4ef45e9de574 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] 10.222.0.52 "GET /compute/v2.1/servers/ac91ce38-2d07-43e1-91c5-ebf68341e491" status: 200 len: 1521 microversion: 2.1 time: 0.346589 Oct 19 03:44:39.372163 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2929/5928] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:44:39 2022] GET /compute/v2.1/servers/ac91ce38-2d07-43e1-91c5-ebf68341e491 => generated 1521 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:44:40.395596 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5b91514b-828c-423c-b77b-ae53869e1e5f tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:44:40.406541 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-5b91514b-828c-423c-b77b-ae53869e1e5f tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] [instance: ac91ce38-2d07-43e1-91c5-ebf68341e491] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:44:40.418702 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=4 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:44:40.420857 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=10 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:44:40.425122 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5b91514b-828c-423c-b77b-ae53869e1e5f tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:40.426073 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5b91514b-828c-423c-b77b-ae53869e1e5f tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:40.427891 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5b91514b-828c-423c-b77b-ae53869e1e5f tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:40.430089 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5b91514b-828c-423c-b77b-ae53869e1e5f tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:40.430733 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5b91514b-828c-423c-b77b-ae53869e1e5f tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:40.431317 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5b91514b-828c-423c-b77b-ae53869e1e5f tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:40.680182 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-5b91514b-828c-423c-b77b-ae53869e1e5f tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81e63d09bd94a9faf9530e911acf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36c639ebfd347b28afeb5724b3e1d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:44:40.688878 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5b91514b-828c-423c-b77b-ae53869e1e5f tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] 10.222.0.52 "GET /compute/v2.1/servers/ac91ce38-2d07-43e1-91c5-ebf68341e491" status: 200 len: 1521 microversion: 2.1 time: 0.297880 Oct 19 03:44:40.689768 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3000/5929] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:44:40 2022] GET /compute/v2.1/servers/ac91ce38-2d07-43e1-91c5-ebf68341e491 => generated 1521 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:44:41.719979 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-30760e41-69f4-4f87-b40a-54027f703695 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:44:41.721241 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-30760e41-69f4-4f87-b40a-54027f703695 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] [instance: ac91ce38-2d07-43e1-91c5-ebf68341e491] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:44:41.724521 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=10 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:44:41.742072 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-30760e41-69f4-4f87-b40a-54027f703695 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:41.742585 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-30760e41-69f4-4f87-b40a-54027f703695 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:41.743036 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-30760e41-69f4-4f87-b40a-54027f703695 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:41.744115 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-30760e41-69f4-4f87-b40a-54027f703695 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:41.744792 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-30760e41-69f4-4f87-b40a-54027f703695 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:41.745233 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-30760e41-69f4-4f87-b40a-54027f703695 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:41.938490 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-30760e41-69f4-4f87-b40a-54027f703695 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81e63d09bd94a9faf9530e911acf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36c639ebfd347b28afeb5724b3e1d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:44:41.947655 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-30760e41-69f4-4f87-b40a-54027f703695 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] 10.222.0.52 "GET /compute/v2.1/servers/ac91ce38-2d07-43e1-91c5-ebf68341e491" status: 200 len: 1521 microversion: 2.1 time: 0.235834 Oct 19 03:44:41.948384 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2930/5930] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:44:41 2022] GET /compute/v2.1/servers/ac91ce38-2d07-43e1-91c5-ebf68341e491 => generated 1521 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:44:42.972199 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-bcd36ba7-eb32-45a3-9a0e-c97e01520126 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:44:42.973645 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-bcd36ba7-eb32-45a3-9a0e-c97e01520126 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] [instance: ac91ce38-2d07-43e1-91c5-ebf68341e491] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:44:42.982764 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bcd36ba7-eb32-45a3-9a0e-c97e01520126 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:42.983527 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bcd36ba7-eb32-45a3-9a0e-c97e01520126 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:42.984152 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bcd36ba7-eb32-45a3-9a0e-c97e01520126 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:42.985053 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bcd36ba7-eb32-45a3-9a0e-c97e01520126 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:42.986187 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bcd36ba7-eb32-45a3-9a0e-c97e01520126 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:42.986771 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bcd36ba7-eb32-45a3-9a0e-c97e01520126 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:43.157140 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-bcd36ba7-eb32-45a3-9a0e-c97e01520126 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81e63d09bd94a9faf9530e911acf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36c639ebfd347b28afeb5724b3e1d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:44:43.167865 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-bcd36ba7-eb32-45a3-9a0e-c97e01520126 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] 10.222.0.52 "GET /compute/v2.1/servers/ac91ce38-2d07-43e1-91c5-ebf68341e491" status: 200 len: 1521 microversion: 2.1 time: 0.198267 Oct 19 03:44:43.182070 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3001/5931] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:44:42 2022] GET /compute/v2.1/servers/ac91ce38-2d07-43e1-91c5-ebf68341e491 => generated 1521 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:44:44.207150 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-59b4a0bb-9a2d-48d6-ad81-ea389bce4fde tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:44:44.208456 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-59b4a0bb-9a2d-48d6-ad81-ea389bce4fde tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] [instance: ac91ce38-2d07-43e1-91c5-ebf68341e491] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:44:44.220678 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-59b4a0bb-9a2d-48d6-ad81-ea389bce4fde tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:44.221174 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-59b4a0bb-9a2d-48d6-ad81-ea389bce4fde tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:44.227653 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-59b4a0bb-9a2d-48d6-ad81-ea389bce4fde tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:44.228498 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-59b4a0bb-9a2d-48d6-ad81-ea389bce4fde tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:44.229007 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-59b4a0bb-9a2d-48d6-ad81-ea389bce4fde tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:44.232225 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-59b4a0bb-9a2d-48d6-ad81-ea389bce4fde tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:44.639600 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-59b4a0bb-9a2d-48d6-ad81-ea389bce4fde tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81e63d09bd94a9faf9530e911acf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36c639ebfd347b28afeb5724b3e1d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:44:44.647987 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-59b4a0bb-9a2d-48d6-ad81-ea389bce4fde tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] 10.222.0.52 "GET /compute/v2.1/servers/ac91ce38-2d07-43e1-91c5-ebf68341e491" status: 200 len: 1521 microversion: 2.1 time: 0.455006 Oct 19 03:44:44.648591 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2931/5932] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:44:44 2022] GET /compute/v2.1/servers/ac91ce38-2d07-43e1-91c5-ebf68341e491 => generated 1521 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:44:45.680773 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-fe6ff142-e882-41ad-92f3-cff74e6917c8 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:44:45.681506 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-fe6ff142-e882-41ad-92f3-cff74e6917c8 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] [instance: ac91ce38-2d07-43e1-91c5-ebf68341e491] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:44:45.689180 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fe6ff142-e882-41ad-92f3-cff74e6917c8 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:45.690384 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fe6ff142-e882-41ad-92f3-cff74e6917c8 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:45.691022 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fe6ff142-e882-41ad-92f3-cff74e6917c8 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:45.691942 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fe6ff142-e882-41ad-92f3-cff74e6917c8 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:45.692685 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fe6ff142-e882-41ad-92f3-cff74e6917c8 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:45.693330 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fe6ff142-e882-41ad-92f3-cff74e6917c8 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:45.972725 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-fe6ff142-e882-41ad-92f3-cff74e6917c8 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81e63d09bd94a9faf9530e911acf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36c639ebfd347b28afeb5724b3e1d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:44:46.018157 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-fe6ff142-e882-41ad-92f3-cff74e6917c8 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] 10.222.0.52 "GET /compute/v2.1/servers/ac91ce38-2d07-43e1-91c5-ebf68341e491" status: 200 len: 1521 microversion: 2.1 time: 0.338291 Oct 19 03:44:46.018157 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3002/5933] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:44:45 2022] GET /compute/v2.1/servers/ac91ce38-2d07-43e1-91c5-ebf68341e491 => generated 1521 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:44:47.040713 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4218d11c-df08-4fa4-bfc9-d4bdbaf90dab tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:44:47.041270 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4218d11c-df08-4fa4-bfc9-d4bdbaf90dab tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] [instance: ac91ce38-2d07-43e1-91c5-ebf68341e491] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:44:47.108110 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4218d11c-df08-4fa4-bfc9-d4bdbaf90dab tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:47.108877 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4218d11c-df08-4fa4-bfc9-d4bdbaf90dab tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:47.114222 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4218d11c-df08-4fa4-bfc9-d4bdbaf90dab tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:47.115930 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4218d11c-df08-4fa4-bfc9-d4bdbaf90dab tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:47.118327 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4218d11c-df08-4fa4-bfc9-d4bdbaf90dab tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:47.118837 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4218d11c-df08-4fa4-bfc9-d4bdbaf90dab tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:47.447736 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-4218d11c-df08-4fa4-bfc9-d4bdbaf90dab tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81e63d09bd94a9faf9530e911acf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36c639ebfd347b28afeb5724b3e1d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:44:47.458126 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4218d11c-df08-4fa4-bfc9-d4bdbaf90dab tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] 10.222.0.52 "GET /compute/v2.1/servers/ac91ce38-2d07-43e1-91c5-ebf68341e491" status: 200 len: 1521 microversion: 2.1 time: 0.423122 Oct 19 03:44:47.458738 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2932/5934] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:44:47 2022] GET /compute/v2.1/servers/ac91ce38-2d07-43e1-91c5-ebf68341e491 => generated 1521 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:44:48.481915 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e9d5b250-a012-4d59-92d0-855b7cf5e0c6 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:44:48.482535 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e9d5b250-a012-4d59-92d0-855b7cf5e0c6 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] [instance: ac91ce38-2d07-43e1-91c5-ebf68341e491] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:44:48.491680 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e9d5b250-a012-4d59-92d0-855b7cf5e0c6 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:48.494719 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e9d5b250-a012-4d59-92d0-855b7cf5e0c6 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:48.494719 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e9d5b250-a012-4d59-92d0-855b7cf5e0c6 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:48.494719 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e9d5b250-a012-4d59-92d0-855b7cf5e0c6 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:48.494719 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e9d5b250-a012-4d59-92d0-855b7cf5e0c6 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:48.494719 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e9d5b250-a012-4d59-92d0-855b7cf5e0c6 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:48.698772 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-e9d5b250-a012-4d59-92d0-855b7cf5e0c6 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81e63d09bd94a9faf9530e911acf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36c639ebfd347b28afeb5724b3e1d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:44:48.712982 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e9d5b250-a012-4d59-92d0-855b7cf5e0c6 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] 10.222.0.52 "GET /compute/v2.1/servers/ac91ce38-2d07-43e1-91c5-ebf68341e491" status: 200 len: 1521 microversion: 2.1 time: 0.235245 Oct 19 03:44:48.713818 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3003/5935] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:44:48 2022] GET /compute/v2.1/servers/ac91ce38-2d07-43e1-91c5-ebf68341e491 => generated 1521 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:44:49.745635 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ff6db66e-11a4-46ea-b435-c027ad0dc71f tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:44:49.747264 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ff6db66e-11a4-46ea-b435-c027ad0dc71f tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] [instance: ac91ce38-2d07-43e1-91c5-ebf68341e491] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:44:49.755353 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ff6db66e-11a4-46ea-b435-c027ad0dc71f tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:49.756120 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ff6db66e-11a4-46ea-b435-c027ad0dc71f tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:49.757036 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ff6db66e-11a4-46ea-b435-c027ad0dc71f tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:49.757959 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ff6db66e-11a4-46ea-b435-c027ad0dc71f tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:49.758628 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ff6db66e-11a4-46ea-b435-c027ad0dc71f tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:49.759266 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ff6db66e-11a4-46ea-b435-c027ad0dc71f tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:50.033787 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ff6db66e-11a4-46ea-b435-c027ad0dc71f tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81e63d09bd94a9faf9530e911acf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36c639ebfd347b28afeb5724b3e1d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:44:50.047091 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ff6db66e-11a4-46ea-b435-c027ad0dc71f tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] 10.222.0.52 "GET /compute/v2.1/servers/ac91ce38-2d07-43e1-91c5-ebf68341e491" status: 200 len: 1521 microversion: 2.1 time: 0.305942 Oct 19 03:44:50.049741 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2933/5936] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:44:49 2022] GET /compute/v2.1/servers/ac91ce38-2d07-43e1-91c5-ebf68341e491 => generated 1521 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:44:51.073975 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-506b8adb-4929-4fef-a568-ab0a15560507 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:44:51.073975 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-506b8adb-4929-4fef-a568-ab0a15560507 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] [instance: ac91ce38-2d07-43e1-91c5-ebf68341e491] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:44:51.080354 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-506b8adb-4929-4fef-a568-ab0a15560507 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:51.080846 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-506b8adb-4929-4fef-a568-ab0a15560507 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:51.081282 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-506b8adb-4929-4fef-a568-ab0a15560507 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:51.082018 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-506b8adb-4929-4fef-a568-ab0a15560507 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:51.082469 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-506b8adb-4929-4fef-a568-ab0a15560507 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:51.082892 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-506b8adb-4929-4fef-a568-ab0a15560507 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:51.291771 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-506b8adb-4929-4fef-a568-ab0a15560507 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81e63d09bd94a9faf9530e911acf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36c639ebfd347b28afeb5724b3e1d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:44:51.306746 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-506b8adb-4929-4fef-a568-ab0a15560507 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] 10.222.0.52 "GET /compute/v2.1/servers/ac91ce38-2d07-43e1-91c5-ebf68341e491" status: 200 len: 1521 microversion: 2.1 time: 0.238103 Oct 19 03:44:51.308078 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3004/5937] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:44:51 2022] GET /compute/v2.1/servers/ac91ce38-2d07-43e1-91c5-ebf68341e491 => generated 1521 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:44:52.332201 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c0dd900d-c776-44b3-913b-1708c207666b tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:44:52.332844 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c0dd900d-c776-44b3-913b-1708c207666b tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] [instance: ac91ce38-2d07-43e1-91c5-ebf68341e491] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:44:52.346633 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c0dd900d-c776-44b3-913b-1708c207666b tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:52.347434 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c0dd900d-c776-44b3-913b-1708c207666b tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:52.348816 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c0dd900d-c776-44b3-913b-1708c207666b tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:52.350376 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c0dd900d-c776-44b3-913b-1708c207666b tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:52.352396 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c0dd900d-c776-44b3-913b-1708c207666b tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:52.353897 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c0dd900d-c776-44b3-913b-1708c207666b tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:52.566651 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c0dd900d-c776-44b3-913b-1708c207666b tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81e63d09bd94a9faf9530e911acf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36c639ebfd347b28afeb5724b3e1d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:44:52.577335 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c0dd900d-c776-44b3-913b-1708c207666b tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] 10.222.0.52 "GET /compute/v2.1/servers/ac91ce38-2d07-43e1-91c5-ebf68341e491" status: 200 len: 1498 microversion: 2.1 time: 0.249118 Oct 19 03:44:52.578314 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2934/5938] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:44:52 2022] GET /compute/v2.1/servers/ac91ce38-2d07-43e1-91c5-ebf68341e491 => generated 1498 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:44:52.601164 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4a4617e8-97c4-4159-9119-50ad6ab3b41d tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:44:52.608676 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4a4617e8-97c4-4159-9119-50ad6ab3b41d tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c81e63d09bd94a9faf9530e911acf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36c639ebfd347b28afeb5724b3e1d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:44:52.610548 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4a4617e8-97c4-4159-9119-50ad6ab3b41d tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': 'd36c639ebfd347b28afeb5724b3e1d67'} {{(pid=121135) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 03:44:52.618956 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4a4617e8-97c4-4159-9119-50ad6ab3b41d tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:52.619675 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4a4617e8-97c4-4159-9119-50ad6ab3b41d tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:52.620310 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4a4617e8-97c4-4159-9119-50ad6ab3b41d tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:52.621295 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4a4617e8-97c4-4159-9119-50ad6ab3b41d tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:52.622009 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4a4617e8-97c4-4159-9119-50ad6ab3b41d tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:52.622811 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4a4617e8-97c4-4159-9119-50ad6ab3b41d tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:52.656242 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.multi_cell_list [None req-4a4617e8-97c4-4159-9119-50ad6ab3b41d tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121135) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 03:44:52.694299 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:44:52.703328 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4a4617e8-97c4-4159-9119-50ad6ab3b41d tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] 10.222.0.52 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 345 microversion: 2.1 time: 0.106364 Oct 19 03:44:52.713275 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3005/5939] 10.222.0.52 () {58 vars in 1154 bytes} [Wed Oct 19 03:44:52 2022] GET /compute/v2.1/servers?status=shutoff => generated 345 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:44:52.717950 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-22375f5a-d22a-4127-8759-7518d6a28ae0 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:44:52.727344 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-22375f5a-d22a-4127-8759-7518d6a28ae0 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:52.731028 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-22375f5a-d22a-4127-8759-7518d6a28ae0 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:52.731644 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-22375f5a-d22a-4127-8759-7518d6a28ae0 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:52.769016 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-22375f5a-d22a-4127-8759-7518d6a28ae0 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] [instance: ac91ce38-2d07-43e1-91c5-ebf68341e491] Going to try to start instance {{(pid=121134) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 19 03:44:53.061725 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-22375f5a-d22a-4127-8759-7518d6a28ae0 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] 10.222.0.52 "POST /compute/v2.1/servers/ac91ce38-2d07-43e1-91c5-ebf68341e491/action" status: 202 len: 0 microversion: 2.1 time: 0.347279 Oct 19 03:44:53.065224 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2935/5940] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:44:52 2022] POST /compute/v2.1/servers/ac91ce38-2d07-43e1-91c5-ebf68341e491/action => generated 0 bytes in 352 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:44:53.072504 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b66350bd-0270-4ff6-9a62-1e7d23e11021 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:44:53.073594 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b66350bd-0270-4ff6-9a62-1e7d23e11021 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] [instance: ac91ce38-2d07-43e1-91c5-ebf68341e491] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:44:53.097715 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b66350bd-0270-4ff6-9a62-1e7d23e11021 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:53.103254 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b66350bd-0270-4ff6-9a62-1e7d23e11021 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:53.103254 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b66350bd-0270-4ff6-9a62-1e7d23e11021 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:53.103254 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b66350bd-0270-4ff6-9a62-1e7d23e11021 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:53.103254 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b66350bd-0270-4ff6-9a62-1e7d23e11021 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:53.103254 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b66350bd-0270-4ff6-9a62-1e7d23e11021 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:53.401301 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b66350bd-0270-4ff6-9a62-1e7d23e11021 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81e63d09bd94a9faf9530e911acf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36c639ebfd347b28afeb5724b3e1d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:44:53.411909 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b66350bd-0270-4ff6-9a62-1e7d23e11021 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] 10.222.0.52 "GET /compute/v2.1/servers/ac91ce38-2d07-43e1-91c5-ebf68341e491" status: 200 len: 1507 microversion: 2.1 time: 0.344290 Oct 19 03:44:53.412697 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3006/5941] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:44:53 2022] GET /compute/v2.1/servers/ac91ce38-2d07-43e1-91c5-ebf68341e491 => generated 1507 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:44:54.437979 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d1835ebb-7e82-44e3-80e7-f51793e45db1 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:44:54.456967 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d1835ebb-7e82-44e3-80e7-f51793e45db1 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] [instance: ac91ce38-2d07-43e1-91c5-ebf68341e491] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:44:54.456967 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d1835ebb-7e82-44e3-80e7-f51793e45db1 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:54.456967 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d1835ebb-7e82-44e3-80e7-f51793e45db1 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:54.456967 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d1835ebb-7e82-44e3-80e7-f51793e45db1 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:54.456967 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d1835ebb-7e82-44e3-80e7-f51793e45db1 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:54.456967 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d1835ebb-7e82-44e3-80e7-f51793e45db1 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:54.456967 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d1835ebb-7e82-44e3-80e7-f51793e45db1 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:54.700237 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d1835ebb-7e82-44e3-80e7-f51793e45db1 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81e63d09bd94a9faf9530e911acf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36c639ebfd347b28afeb5724b3e1d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:44:54.711893 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d1835ebb-7e82-44e3-80e7-f51793e45db1 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] 10.222.0.52 "GET /compute/v2.1/servers/ac91ce38-2d07-43e1-91c5-ebf68341e491" status: 200 len: 1507 microversion: 2.1 time: 0.279823 Oct 19 03:44:54.713274 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2936/5942] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:44:54 2022] GET /compute/v2.1/servers/ac91ce38-2d07-43e1-91c5-ebf68341e491 => generated 1507 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:44:55.736652 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f3f76e2d-02d5-468b-970a-5e301655d1d6 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:44:55.737299 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f3f76e2d-02d5-468b-970a-5e301655d1d6 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] [instance: ac91ce38-2d07-43e1-91c5-ebf68341e491] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:44:55.744650 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f3f76e2d-02d5-468b-970a-5e301655d1d6 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:55.745207 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f3f76e2d-02d5-468b-970a-5e301655d1d6 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:55.745734 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f3f76e2d-02d5-468b-970a-5e301655d1d6 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:55.746486 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f3f76e2d-02d5-468b-970a-5e301655d1d6 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:55.747006 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f3f76e2d-02d5-468b-970a-5e301655d1d6 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:55.747559 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f3f76e2d-02d5-468b-970a-5e301655d1d6 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:55.906252 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f3f76e2d-02d5-468b-970a-5e301655d1d6 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81e63d09bd94a9faf9530e911acf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36c639ebfd347b28afeb5724b3e1d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:44:55.930481 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f3f76e2d-02d5-468b-970a-5e301655d1d6 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] 10.222.0.52 "GET /compute/v2.1/servers/ac91ce38-2d07-43e1-91c5-ebf68341e491" status: 200 len: 1511 microversion: 2.1 time: 0.197493 Oct 19 03:44:55.931686 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3007/5943] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:44:55 2022] GET /compute/v2.1/servers/ac91ce38-2d07-43e1-91c5-ebf68341e491 => generated 1511 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:44:55.971513 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-fcfbbc45-1fbd-47a8-af52-7e6f8e8176d0 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:44:55.983332 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-fcfbbc45-1fbd-47a8-af52-7e6f8e8176d0 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c81e63d09bd94a9faf9530e911acf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36c639ebfd347b28afeb5724b3e1d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:44:55.984979 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.compute.servers [None req-fcfbbc45-1fbd-47a8-af52-7e6f8e8176d0 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Removing options 'limit' from query {{(pid=121134) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1499}} Oct 19 03:44:55.989355 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-fcfbbc45-1fbd-47a8-af52-7e6f8e8176d0 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Searching by: {'deleted': False, 'project_id': 'd36c639ebfd347b28afeb5724b3e1d67'} {{(pid=121134) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 03:44:55.989355 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fcfbbc45-1fbd-47a8-af52-7e6f8e8176d0 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:55.990633 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fcfbbc45-1fbd-47a8-af52-7e6f8e8176d0 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:55.991094 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fcfbbc45-1fbd-47a8-af52-7e6f8e8176d0 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:55.994314 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fcfbbc45-1fbd-47a8-af52-7e6f8e8176d0 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:55.994826 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fcfbbc45-1fbd-47a8-af52-7e6f8e8176d0 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:56.019551 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fcfbbc45-1fbd-47a8-af52-7e6f8e8176d0 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:56.027899 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-fcfbbc45-1fbd-47a8-af52-7e6f8e8176d0 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] 10.222.0.52 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.067542 Oct 19 03:44:56.038783 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2937/5944] 10.222.0.52 () {58 vars in 1140 bytes} [Wed Oct 19 03:44:55 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 03:44:56.042683 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-00e6cf81-43d3-42c4-8aa7-057dffa47239 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:44:56.043564 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-00e6cf81-43d3-42c4-8aa7-057dffa47239 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] [instance: ac91ce38-2d07-43e1-91c5-ebf68341e491] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:44:56.057291 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-00e6cf81-43d3-42c4-8aa7-057dffa47239 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:56.060047 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-00e6cf81-43d3-42c4-8aa7-057dffa47239 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:56.060800 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-00e6cf81-43d3-42c4-8aa7-057dffa47239 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:56.061921 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-00e6cf81-43d3-42c4-8aa7-057dffa47239 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:56.062555 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-00e6cf81-43d3-42c4-8aa7-057dffa47239 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:56.063688 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-00e6cf81-43d3-42c4-8aa7-057dffa47239 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:56.380075 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-00e6cf81-43d3-42c4-8aa7-057dffa47239 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81e63d09bd94a9faf9530e911acf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36c639ebfd347b28afeb5724b3e1d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:44:56.389888 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-00e6cf81-43d3-42c4-8aa7-057dffa47239 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] 10.222.0.52 "GET /compute/v2.1/servers/ac91ce38-2d07-43e1-91c5-ebf68341e491" status: 200 len: 1511 microversion: 2.1 time: 0.351280 Oct 19 03:44:56.390966 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3008/5945] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:44:56 2022] GET /compute/v2.1/servers/ac91ce38-2d07-43e1-91c5-ebf68341e491 => generated 1511 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:44:56.412735 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-42f7aaab-57b3-4d31-8792-c34cb0d5f01a tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:44:56.413609 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-42f7aaab-57b3-4d31-8792-c34cb0d5f01a tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] [instance: a339021c-b7c6-4e4c-abc9-e91fefca9b98] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:44:56.426416 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-42f7aaab-57b3-4d31-8792-c34cb0d5f01a tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:56.427233 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-42f7aaab-57b3-4d31-8792-c34cb0d5f01a tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:56.427887 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-42f7aaab-57b3-4d31-8792-c34cb0d5f01a tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:56.429068 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-42f7aaab-57b3-4d31-8792-c34cb0d5f01a tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:56.429764 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-42f7aaab-57b3-4d31-8792-c34cb0d5f01a tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:56.430384 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-42f7aaab-57b3-4d31-8792-c34cb0d5f01a tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:56.590840 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-42f7aaab-57b3-4d31-8792-c34cb0d5f01a tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81e63d09bd94a9faf9530e911acf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36c639ebfd347b28afeb5724b3e1d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:44:56.606646 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-42f7aaab-57b3-4d31-8792-c34cb0d5f01a tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] 10.222.0.52 "GET /compute/v2.1/servers/a339021c-b7c6-4e4c-abc9-e91fefca9b98" status: 200 len: 1513 microversion: 2.1 time: 0.197680 Oct 19 03:44:56.607944 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2938/5946] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:44:56 2022] GET /compute/v2.1/servers/a339021c-b7c6-4e4c-abc9-e91fefca9b98 => generated 1513 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:44:56.638473 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f6b52f2b-6b8f-42ce-bf57-5bc7ec884954 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:44:56.638473 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f6b52f2b-6b8f-42ce-bf57-5bc7ec884954 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] [instance: ceedb58f-1285-4292-8eb7-d741f2919484] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:44:56.641457 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f6b52f2b-6b8f-42ce-bf57-5bc7ec884954 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:56.642824 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f6b52f2b-6b8f-42ce-bf57-5bc7ec884954 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:56.643458 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f6b52f2b-6b8f-42ce-bf57-5bc7ec884954 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:56.644656 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f6b52f2b-6b8f-42ce-bf57-5bc7ec884954 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:56.645283 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f6b52f2b-6b8f-42ce-bf57-5bc7ec884954 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:56.645901 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f6b52f2b-6b8f-42ce-bf57-5bc7ec884954 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:56.979287 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f6b52f2b-6b8f-42ce-bf57-5bc7ec884954 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81e63d09bd94a9faf9530e911acf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36c639ebfd347b28afeb5724b3e1d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:44:56.988827 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f6b52f2b-6b8f-42ce-bf57-5bc7ec884954 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] 10.222.0.52 "GET /compute/v2.1/servers/ceedb58f-1285-4292-8eb7-d741f2919484" status: 200 len: 1512 microversion: 2.1 time: 0.359322 Oct 19 03:44:56.989561 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3009/5947] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:44:56 2022] GET /compute/v2.1/servers/ceedb58f-1285-4292-8eb7-d741f2919484 => generated 1512 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:44:57.012586 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-740d5286-eccc-4f7d-9728-8dbdfb3cacee tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:44:57.018905 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-740d5286-eccc-4f7d-9728-8dbdfb3cacee tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c81e63d09bd94a9faf9530e911acf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36c639ebfd347b28afeb5724b3e1d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:44:57.019910 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-740d5286-eccc-4f7d-9728-8dbdfb3cacee tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Searching by: {'ip': '172.20.0.14', 'deleted': False, 'project_id': 'd36c639ebfd347b28afeb5724b3e1d67'} {{(pid=121134) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 03:44:57.213798 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-740d5286-eccc-4f7d-9728-8dbdfb3cacee tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:57.214405 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-740d5286-eccc-4f7d-9728-8dbdfb3cacee tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:57.215362 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-740d5286-eccc-4f7d-9728-8dbdfb3cacee tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:57.221927 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-740d5286-eccc-4f7d-9728-8dbdfb3cacee tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:57.221927 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-740d5286-eccc-4f7d-9728-8dbdfb3cacee tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:57.221927 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-740d5286-eccc-4f7d-9728-8dbdfb3cacee tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:57.345976 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:44:57.372244 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.multi_cell_list [None req-740d5286-eccc-4f7d-9728-8dbdfb3cacee tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121134) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 03:44:57.463827 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-740d5286-eccc-4f7d-9728-8dbdfb3cacee tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] 10.222.0.52 "GET /compute/v2.1/servers?ip=172.20.0.14" status: 200 len: 346 microversion: 2.1 time: 0.455064 Oct 19 03:44:57.468553 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2939/5948] 10.222.0.52 () {58 vars in 1154 bytes} [Wed Oct 19 03:44:57 2022] GET /compute/v2.1/servers?ip=172.20.0.14 => generated 346 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:44:57.478387 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-78d6443e-56e0-43e4-9462-79b34f13ac5f tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:44:57.480470 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-78d6443e-56e0-43e4-9462-79b34f13ac5f tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] [instance: ac91ce38-2d07-43e1-91c5-ebf68341e491] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:44:57.498270 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-78d6443e-56e0-43e4-9462-79b34f13ac5f tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:57.498843 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-78d6443e-56e0-43e4-9462-79b34f13ac5f tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:57.499425 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-78d6443e-56e0-43e4-9462-79b34f13ac5f tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:57.500212 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-78d6443e-56e0-43e4-9462-79b34f13ac5f tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:57.501550 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-78d6443e-56e0-43e4-9462-79b34f13ac5f tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:57.502298 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-78d6443e-56e0-43e4-9462-79b34f13ac5f tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:57.805735 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-78d6443e-56e0-43e4-9462-79b34f13ac5f tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81e63d09bd94a9faf9530e911acf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36c639ebfd347b28afeb5724b3e1d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:44:57.816354 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-78d6443e-56e0-43e4-9462-79b34f13ac5f tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] 10.222.0.52 "GET /compute/v2.1/servers/ac91ce38-2d07-43e1-91c5-ebf68341e491" status: 200 len: 1511 microversion: 2.1 time: 0.340536 Oct 19 03:44:57.827356 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3010/5949] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:44:57 2022] GET /compute/v2.1/servers/ac91ce38-2d07-43e1-91c5-ebf68341e491 => generated 1511 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:44:57.846884 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7a71b69f-4d22-4ed0-9d30-0b9a51d1ee17 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:44:57.846884 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7a71b69f-4d22-4ed0-9d30-0b9a51d1ee17 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] [instance: a339021c-b7c6-4e4c-abc9-e91fefca9b98] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:44:57.848652 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7a71b69f-4d22-4ed0-9d30-0b9a51d1ee17 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:57.849341 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7a71b69f-4d22-4ed0-9d30-0b9a51d1ee17 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:57.850015 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7a71b69f-4d22-4ed0-9d30-0b9a51d1ee17 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:57.851130 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7a71b69f-4d22-4ed0-9d30-0b9a51d1ee17 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:57.852335 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7a71b69f-4d22-4ed0-9d30-0b9a51d1ee17 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:57.852950 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7a71b69f-4d22-4ed0-9d30-0b9a51d1ee17 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:58.097533 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-7a71b69f-4d22-4ed0-9d30-0b9a51d1ee17 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81e63d09bd94a9faf9530e911acf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36c639ebfd347b28afeb5724b3e1d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:44:58.107993 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7a71b69f-4d22-4ed0-9d30-0b9a51d1ee17 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] 10.222.0.52 "GET /compute/v2.1/servers/a339021c-b7c6-4e4c-abc9-e91fefca9b98" status: 200 len: 1513 microversion: 2.1 time: 0.273007 Oct 19 03:44:58.108595 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2940/5950] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:44:57 2022] GET /compute/v2.1/servers/a339021c-b7c6-4e4c-abc9-e91fefca9b98 => generated 1513 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:44:58.132144 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4c4233d6-2c04-460f-bdc3-b3b5679039dd tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:44:58.133595 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4c4233d6-2c04-460f-bdc3-b3b5679039dd tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] [instance: ceedb58f-1285-4292-8eb7-d741f2919484] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:44:58.140216 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4c4233d6-2c04-460f-bdc3-b3b5679039dd tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:58.141658 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4c4233d6-2c04-460f-bdc3-b3b5679039dd tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:58.142296 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4c4233d6-2c04-460f-bdc3-b3b5679039dd tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:58.143168 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4c4233d6-2c04-460f-bdc3-b3b5679039dd tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:58.143635 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4c4233d6-2c04-460f-bdc3-b3b5679039dd tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:58.144244 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4c4233d6-2c04-460f-bdc3-b3b5679039dd tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:58.448223 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4c4233d6-2c04-460f-bdc3-b3b5679039dd tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81e63d09bd94a9faf9530e911acf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36c639ebfd347b28afeb5724b3e1d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:44:58.457423 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4c4233d6-2c04-460f-bdc3-b3b5679039dd tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] 10.222.0.52 "GET /compute/v2.1/servers/ceedb58f-1285-4292-8eb7-d741f2919484" status: 200 len: 1512 microversion: 2.1 time: 0.329525 Oct 19 03:44:58.458247 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3011/5951] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:44:58 2022] GET /compute/v2.1/servers/ceedb58f-1285-4292-8eb7-d741f2919484 => generated 1512 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:44:58.481132 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a9fde25e-0b9a-4954-a0c6-99a25a317a37 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:44:58.486452 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a9fde25e-0b9a-4954-a0c6-99a25a317a37 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c81e63d09bd94a9faf9530e911acf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36c639ebfd347b28afeb5724b3e1d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:44:58.487586 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a9fde25e-0b9a-4954-a0c6-99a25a317a37 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Searching by: {'deleted': False, 'project_id': 'd36c639ebfd347b28afeb5724b3e1d67'} {{(pid=121134) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 03:44:58.493970 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a9fde25e-0b9a-4954-a0c6-99a25a317a37 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:58.494468 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a9fde25e-0b9a-4954-a0c6-99a25a317a37 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:58.494943 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a9fde25e-0b9a-4954-a0c6-99a25a317a37 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:58.495676 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a9fde25e-0b9a-4954-a0c6-99a25a317a37 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:58.496343 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a9fde25e-0b9a-4954-a0c6-99a25a317a37 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:58.496789 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a9fde25e-0b9a-4954-a0c6-99a25a317a37 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:58.532337 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.multi_cell_list [None req-a9fde25e-0b9a-4954-a0c6-99a25a317a37 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=121134) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 03:44:58.586074 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a9fde25e-0b9a-4954-a0c6-99a25a317a37 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81e63d09bd94a9faf9530e911acf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36c639ebfd347b28afeb5724b3e1d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:44:58.593714 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a9fde25e-0b9a-4954-a0c6-99a25a317a37 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:58.594836 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a9fde25e-0b9a-4954-a0c6-99a25a317a37 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:58.595414 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a9fde25e-0b9a-4954-a0c6-99a25a317a37 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:58.879660 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a9fde25e-0b9a-4954-a0c6-99a25a317a37 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] 10.222.0.52 "GET /compute/v2.1/servers/detail" status: 200 len: 4519 microversion: 2.1 time: 0.403441 Oct 19 03:44:58.881529 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2941/5952] 10.222.0.52 () {58 vars in 1146 bytes} [Wed Oct 19 03:44:58 2022] GET /compute/v2.1/servers/detail => generated 4519 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:44:58.908669 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-44ae9fc6-8c55-413f-8649-a2997e6b6af4 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:44:58.913933 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-44ae9fc6-8c55-413f-8649-a2997e6b6af4 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c81e63d09bd94a9faf9530e911acf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36c639ebfd347b28afeb5724b3e1d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:44:58.914845 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-44ae9fc6-8c55-413f-8649-a2997e6b6af4 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': 'd36c639ebfd347b28afeb5724b3e1d67'} {{(pid=121135) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 03:44:59.051233 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-44ae9fc6-8c55-413f-8649-a2997e6b6af4 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:59.051823 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-44ae9fc6-8c55-413f-8649-a2997e6b6af4 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:59.052557 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-44ae9fc6-8c55-413f-8649-a2997e6b6af4 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:59.053409 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-44ae9fc6-8c55-413f-8649-a2997e6b6af4 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:59.054217 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-44ae9fc6-8c55-413f-8649-a2997e6b6af4 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:59.054892 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-44ae9fc6-8c55-413f-8649-a2997e6b6af4 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:59.180228 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.multi_cell_list [None req-44ae9fc6-8c55-413f-8649-a2997e6b6af4 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=121135) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 03:44:59.247454 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-44ae9fc6-8c55-413f-8649-a2997e6b6af4 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] 10.222.0.52 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1010 microversion: 2.1 time: 0.342448 Oct 19 03:44:59.248570 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3012/5953] 10.222.0.52 () {58 vars in 1150 bytes} [Wed Oct 19 03:44:58 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1010 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:44:59.263390 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-cd82bbbd-b7da-4c13-ae9e-9b1fdd799325 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:44:59.269266 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-cd82bbbd-b7da-4c13-ae9e-9b1fdd799325 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c81e63d09bd94a9faf9530e911acf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36c639ebfd347b28afeb5724b3e1d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:44:59.271115 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-cd82bbbd-b7da-4c13-ae9e-9b1fdd799325 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': 'd36c639ebfd347b28afeb5724b3e1d67'} {{(pid=121134) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 03:44:59.276524 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cd82bbbd-b7da-4c13-ae9e-9b1fdd799325 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:59.277163 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cd82bbbd-b7da-4c13-ae9e-9b1fdd799325 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:59.278352 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cd82bbbd-b7da-4c13-ae9e-9b1fdd799325 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:59.279178 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cd82bbbd-b7da-4c13-ae9e-9b1fdd799325 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:59.279761 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cd82bbbd-b7da-4c13-ae9e-9b1fdd799325 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:59.280917 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cd82bbbd-b7da-4c13-ae9e-9b1fdd799325 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:59.405566 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.multi_cell_list [None req-cd82bbbd-b7da-4c13-ae9e-9b1fdd799325 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=121134) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 03:44:59.482991 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-cd82bbbd-b7da-4c13-ae9e-9b1fdd799325 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] 10.222.0.52 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1010 microversion: 2.1 time: 0.224173 Oct 19 03:44:59.483599 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2942/5954] 10.222.0.52 () {58 vars in 1212 bytes} [Wed Oct 19 03:44:59 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1010 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:44:59.496930 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4b5ff392-b416-4c83-863f-61e625b1274a tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:44:59.502702 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4b5ff392-b416-4c83-863f-61e625b1274a tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c81e63d09bd94a9faf9530e911acf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36c639ebfd347b28afeb5724b3e1d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:44:59.503370 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4b5ff392-b416-4c83-863f-61e625b1274a tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': 'd36c639ebfd347b28afeb5724b3e1d67'} {{(pid=121135) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 03:44:59.508687 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4b5ff392-b416-4c83-863f-61e625b1274a tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:59.509420 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4b5ff392-b416-4c83-863f-61e625b1274a tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:59.509834 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4b5ff392-b416-4c83-863f-61e625b1274a tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:59.510549 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4b5ff392-b416-4c83-863f-61e625b1274a tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:59.510997 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4b5ff392-b416-4c83-863f-61e625b1274a tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:59.511602 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4b5ff392-b416-4c83-863f-61e625b1274a tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:59.863719 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.multi_cell_list [None req-4b5ff392-b416-4c83-863f-61e625b1274a tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=121135) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 03:44:59.928744 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4b5ff392-b416-4c83-863f-61e625b1274a tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] 10.222.0.52 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1010 microversion: 2.1 time: 0.436238 Oct 19 03:44:59.929330 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3013/5955] 10.222.0.52 () {58 vars in 1196 bytes} [Wed Oct 19 03:44:59 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1010 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:44:59.943568 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6853e880-acb0-452c-afed-e4af9eba348d tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:44:59.948997 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-6853e880-acb0-452c-afed-e4af9eba348d tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c81e63d09bd94a9faf9530e911acf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36c639ebfd347b28afeb5724b3e1d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:44:59.949784 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6853e880-acb0-452c-afed-e4af9eba348d tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Searching by: {'name': '-110299381', 'deleted': False, 'project_id': 'd36c639ebfd347b28afeb5724b3e1d67'} {{(pid=121134) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 03:44:59.959037 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6853e880-acb0-452c-afed-e4af9eba348d tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:59.961592 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6853e880-acb0-452c-afed-e4af9eba348d tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:59.961592 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6853e880-acb0-452c-afed-e4af9eba348d tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:44:59.961592 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6853e880-acb0-452c-afed-e4af9eba348d tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:44:59.962609 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6853e880-acb0-452c-afed-e4af9eba348d tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:44:59.962991 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6853e880-acb0-452c-afed-e4af9eba348d tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:45:00.059015 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.multi_cell_list [None req-6853e880-acb0-452c-afed-e4af9eba348d tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121134) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 03:45:00.124222 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6853e880-acb0-452c-afed-e4af9eba348d tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] 10.222.0.52 "GET /compute/v2.1/servers?name=-110299381" status: 200 len: 345 microversion: 2.1 time: 0.186104 Oct 19 03:45:00.129599 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2943/5956] 10.222.0.52 () {58 vars in 1156 bytes} [Wed Oct 19 03:44:59 2022] GET /compute/v2.1/servers?name=-110299381 => generated 345 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:45:00.138097 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-86adea16-ead5-498f-b0a2-1093bd1e9d97 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:45:00.144076 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-86adea16-ead5-498f-b0a2-1093bd1e9d97 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c81e63d09bd94a9faf9530e911acf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36c639ebfd347b28afeb5724b3e1d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:45:00.144967 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-86adea16-ead5-498f-b0a2-1093bd1e9d97 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': 'd36c639ebfd347b28afeb5724b3e1d67'} {{(pid=121135) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 03:45:00.155830 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-86adea16-ead5-498f-b0a2-1093bd1e9d97 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:45:00.155830 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-86adea16-ead5-498f-b0a2-1093bd1e9d97 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:45:00.155830 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-86adea16-ead5-498f-b0a2-1093bd1e9d97 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:45:00.155830 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-86adea16-ead5-498f-b0a2-1093bd1e9d97 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:45:00.157364 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-86adea16-ead5-498f-b0a2-1093bd1e9d97 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:45:00.157834 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-86adea16-ead5-498f-b0a2-1093bd1e9d97 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:45:00.249489 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.multi_cell_list [None req-86adea16-ead5-498f-b0a2-1093bd1e9d97 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=121135) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 03:45:00.350909 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-86adea16-ead5-498f-b0a2-1093bd1e9d97 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] 10.222.0.52 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1010 microversion: 2.1 time: 0.216594 Oct 19 03:45:00.358689 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3014/5957] 10.222.0.52 () {58 vars in 1154 bytes} [Wed Oct 19 03:45:00 2022] GET /compute/v2.1/servers?name=-instance => generated 1010 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:45:00.364627 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-28158276-5238-4166-bbc7-264189c97862 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:45:00.372315 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-28158276-5238-4166-bbc7-264189c97862 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c81e63d09bd94a9faf9530e911acf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36c639ebfd347b28afeb5724b3e1d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:45:00.373402 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-28158276-5238-4166-bbc7-264189c97862 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-11029938', 'deleted': False, 'project_id': 'd36c639ebfd347b28afeb5724b3e1d67'} {{(pid=121134) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 03:45:00.381810 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-28158276-5238-4166-bbc7-264189c97862 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:45:00.382636 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-28158276-5238-4166-bbc7-264189c97862 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:45:00.383585 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-28158276-5238-4166-bbc7-264189c97862 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:45:00.390195 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-28158276-5238-4166-bbc7-264189c97862 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:45:00.390195 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-28158276-5238-4166-bbc7-264189c97862 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:45:00.390195 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-28158276-5238-4166-bbc7-264189c97862 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:45:00.530459 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.multi_cell_list [None req-28158276-5238-4166-bbc7-264189c97862 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121134) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 03:45:00.628554 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-28158276-5238-4166-bbc7-264189c97862 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] 10.222.0.52 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-11029938" status: 200 len: 345 microversion: 2.1 time: 0.268529 Oct 19 03:45:00.636352 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2944/5958] 10.222.0.52 () {58 vars in 1226 bytes} [Wed Oct 19 03:45:00 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-11029938 => generated 345 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:45:00.641694 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d7e6fcdb-98a1-4221-bb45-0d8380618b90 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:45:00.642194 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d7e6fcdb-98a1-4221-bb45-0d8380618b90 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] [instance: ceedb58f-1285-4292-8eb7-d741f2919484] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:45:00.652194 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d7e6fcdb-98a1-4221-bb45-0d8380618b90 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:45:00.652618 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d7e6fcdb-98a1-4221-bb45-0d8380618b90 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:45:00.653053 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d7e6fcdb-98a1-4221-bb45-0d8380618b90 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:45:00.653999 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d7e6fcdb-98a1-4221-bb45-0d8380618b90 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:45:00.654612 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d7e6fcdb-98a1-4221-bb45-0d8380618b90 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:45:00.655208 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d7e6fcdb-98a1-4221-bb45-0d8380618b90 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:45:00.686804 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d7e6fcdb-98a1-4221-bb45-0d8380618b90 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] [instance: ceedb58f-1285-4292-8eb7-d741f2919484] Going to try to terminate instance {{(pid=121135) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:45:01.099985 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d7e6fcdb-98a1-4221-bb45-0d8380618b90 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ceedb58f-1285-4292-8eb7-d741f2919484" status: 204 len: 0 microversion: 2.1 time: 0.461416 Oct 19 03:45:01.102198 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3015/5959] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:45:00 2022] DELETE /compute/v2.1/servers/ceedb58f-1285-4292-8eb7-d741f2919484 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:45:01.123498 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9720e21a-6e9e-498d-9ddb-b5d2f513efcc tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:45:01.124767 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9720e21a-6e9e-498d-9ddb-b5d2f513efcc tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] [instance: ceedb58f-1285-4292-8eb7-d741f2919484] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:45:01.133568 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9720e21a-6e9e-498d-9ddb-b5d2f513efcc tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:45:01.134376 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9720e21a-6e9e-498d-9ddb-b5d2f513efcc tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:45:01.135052 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9720e21a-6e9e-498d-9ddb-b5d2f513efcc tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:45:01.135998 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9720e21a-6e9e-498d-9ddb-b5d2f513efcc tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:45:01.136763 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9720e21a-6e9e-498d-9ddb-b5d2f513efcc tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:45:01.137427 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9720e21a-6e9e-498d-9ddb-b5d2f513efcc tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:45:01.337722 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9720e21a-6e9e-498d-9ddb-b5d2f513efcc tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81e63d09bd94a9faf9530e911acf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36c639ebfd347b28afeb5724b3e1d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:45:01.349071 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9720e21a-6e9e-498d-9ddb-b5d2f513efcc tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] 10.222.0.52 "GET /compute/v2.1/servers/ceedb58f-1285-4292-8eb7-d741f2919484" status: 200 len: 1518 microversion: 2.1 time: 0.230167 Oct 19 03:45:01.352631 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2945/5960] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:45:01 2022] GET /compute/v2.1/servers/ceedb58f-1285-4292-8eb7-d741f2919484 => generated 1518 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:45:02.377685 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-179f558c-5cff-4720-be02-aec102487053 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:45:02.378332 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-179f558c-5cff-4720-be02-aec102487053 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] [instance: ceedb58f-1285-4292-8eb7-d741f2919484] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:45:02.394520 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-179f558c-5cff-4720-be02-aec102487053 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:45:02.395277 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-179f558c-5cff-4720-be02-aec102487053 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:45:02.395878 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-179f558c-5cff-4720-be02-aec102487053 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:45:02.396807 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-179f558c-5cff-4720-be02-aec102487053 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:45:02.401649 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-179f558c-5cff-4720-be02-aec102487053 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:45:02.402365 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-179f558c-5cff-4720-be02-aec102487053 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:45:02.578913 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-179f558c-5cff-4720-be02-aec102487053 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81e63d09bd94a9faf9530e911acf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36c639ebfd347b28afeb5724b3e1d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:45:02.594676 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-179f558c-5cff-4720-be02-aec102487053 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] 10.222.0.52 "GET /compute/v2.1/servers/ceedb58f-1285-4292-8eb7-d741f2919484" status: 200 len: 1518 microversion: 2.1 time: 0.222041 Oct 19 03:45:02.595453 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3016/5961] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:45:02 2022] GET /compute/v2.1/servers/ceedb58f-1285-4292-8eb7-d741f2919484 => generated 1518 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:45:03.537840 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-b623dfb0-007b-4803-a6c8-0e2dc52af4bf req-33b84d38-f173-441b-b876-1e0b71e3c920 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ceedb58f-1285-4292-8eb7-d741f2919484", "name": "network-vif-deleted", "tag": "638eb330-be96-4029-bc36-77117c7fd896"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:45:03.563823 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-b623dfb0-007b-4803-a6c8-0e2dc52af4bf req-33b84d38-f173-441b-b876-1e0b71e3c920 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:45:03.564424 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-b623dfb0-007b-4803-a6c8-0e2dc52af4bf req-33b84d38-f173-441b-b876-1e0b71e3c920 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:45:03.564970 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-b623dfb0-007b-4803-a6c8-0e2dc52af4bf req-33b84d38-f173-441b-b876-1e0b71e3c920 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:45:03.607220 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-b623dfb0-007b-4803-a6c8-0e2dc52af4bf req-33b84d38-f173-441b-b876-1e0b71e3c920 service nova] Creating event network-vif-deleted:638eb330-be96-4029-bc36-77117c7fd896 for instance ceedb58f-1285-4292-8eb7-d741f2919484 on n-h2-861333-8 Oct 19 03:45:03.626684 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-b623dfb0-007b-4803-a6c8-0e2dc52af4bf req-33b84d38-f173-441b-b876-1e0b71e3c920 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092915 Oct 19 03:45:03.630748 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4788b8f2-4a09-4e0e-bd68-f0c7bff0b9ee tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:45:03.632156 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2946/5962] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:45:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:45:03.635439 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4788b8f2-4a09-4e0e-bd68-f0c7bff0b9ee tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] [instance: ceedb58f-1285-4292-8eb7-d741f2919484] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:45:03.667164 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4788b8f2-4a09-4e0e-bd68-f0c7bff0b9ee tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:45:03.668602 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4788b8f2-4a09-4e0e-bd68-f0c7bff0b9ee tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:45:03.676594 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4788b8f2-4a09-4e0e-bd68-f0c7bff0b9ee tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:45:03.677713 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4788b8f2-4a09-4e0e-bd68-f0c7bff0b9ee tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:45:03.678154 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4788b8f2-4a09-4e0e-bd68-f0c7bff0b9ee tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:45:03.679140 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4788b8f2-4a09-4e0e-bd68-f0c7bff0b9ee tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:45:03.814221 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4788b8f2-4a09-4e0e-bd68-f0c7bff0b9ee tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81e63d09bd94a9faf9530e911acf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36c639ebfd347b28afeb5724b3e1d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:45:03.839670 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4788b8f2-4a09-4e0e-bd68-f0c7bff0b9ee tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] 10.222.0.52 "GET /compute/v2.1/servers/ceedb58f-1285-4292-8eb7-d741f2919484" status: 200 len: 1476 microversion: 2.1 time: 0.218466 Oct 19 03:45:03.848934 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3017/5963] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:45:03 2022] GET /compute/v2.1/servers/ceedb58f-1285-4292-8eb7-d741f2919484 => generated 1476 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:45:04.866866 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-854af133-9eff-4121-a792-421f668206e3 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:45:04.867590 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-854af133-9eff-4121-a792-421f668206e3 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] [instance: ceedb58f-1285-4292-8eb7-d741f2919484] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:45:04.883604 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-854af133-9eff-4121-a792-421f668206e3 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:45:04.885537 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-854af133-9eff-4121-a792-421f668206e3 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:45:04.885537 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-854af133-9eff-4121-a792-421f668206e3 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:45:04.887076 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-854af133-9eff-4121-a792-421f668206e3 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:45:04.887578 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-854af133-9eff-4121-a792-421f668206e3 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:45:04.888027 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-854af133-9eff-4121-a792-421f668206e3 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:45:04.968402 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-854af133-9eff-4121-a792-421f668206e3 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:45:04.971005 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-854af133-9eff-4121-a792-421f668206e3 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:45:04.971488 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-854af133-9eff-4121-a792-421f668206e3 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:45:04.972757 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-854af133-9eff-4121-a792-421f668206e3 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lazy-loading 'fault' on Instance uuid ceedb58f-1285-4292-8eb7-d741f2919484 {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:45:05.040116 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-854af133-9eff-4121-a792-421f668206e3 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81e63d09bd94a9faf9530e911acf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36c639ebfd347b28afeb5724b3e1d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:45:05.050628 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-854af133-9eff-4121-a792-421f668206e3 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] 10.222.0.52 "GET /compute/v2.1/servers/ceedb58f-1285-4292-8eb7-d741f2919484" status: 200 len: 1310 microversion: 2.1 time: 0.190875 Oct 19 03:45:05.051332 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2947/5964] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:45:04 2022] GET /compute/v2.1/servers/ceedb58f-1285-4292-8eb7-d741f2919484 => generated 1310 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:45:06.074671 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ee59370b-5a3e-4d23-bf06-377b391502e3 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:45:06.075302 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ee59370b-5a3e-4d23-bf06-377b391502e3 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] [instance: ceedb58f-1285-4292-8eb7-d741f2919484] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:45:06.078993 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:45:06.085349 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ee59370b-5a3e-4d23-bf06-377b391502e3 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:45:06.086371 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ee59370b-5a3e-4d23-bf06-377b391502e3 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:45:06.086996 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ee59370b-5a3e-4d23-bf06-377b391502e3 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:45:06.087791 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ee59370b-5a3e-4d23-bf06-377b391502e3 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:45:06.088960 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ee59370b-5a3e-4d23-bf06-377b391502e3 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:45:06.088960 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ee59370b-5a3e-4d23-bf06-377b391502e3 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:45:06.105497 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-ee59370b-5a3e-4d23-bf06-377b391502e3 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] HTTP exception thrown: Instance ceedb58f-1285-4292-8eb7-d741f2919484 could not be found. Oct 19 03:45:06.118444 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ee59370b-5a3e-4d23-bf06-377b391502e3 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Request method failure captured: Oct 19 03:45:06.118444 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/ceedb58f-1285-4292-8eb7-d741f2919484 HTTP/1.1 Oct 19 03:45:06.118444 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:45:06.118444 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:45:06.118444 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:45:06.118444 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:45:06.118444 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:45:06.118444 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:45:06.118444 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:45:06.118444 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:45:06.118444 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT3KBZXq2ZE4g71PjzqWypPsYe_zEH9DB4sEzW9Qt3tDYva_1tL62jWCidHBRiHRaLmbUFdMQ9QHj3xYTzi0HL1_UOtcD1-rzYcZGhga7txHWku_O-v31H9V33sbpnInFhwTwFDSH75RvUJSGmGfTebtSlbvpE87yURICThZlKt76t2A Oct 19 03:45:06.118444 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:45:06.118444 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:45:06.118444 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:45:06.118444 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:45:06.118444 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:45:06.118444 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:45:06.118444 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: d36c639ebfd347b28afeb5724b3e1d67 Oct 19 03:45:06.118444 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ListServerFiltersTestJSON-567370122 Oct 19 03:45:06.118444 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:45:06.118444 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:45:06.118444 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d36c639ebfd347b28afeb5724b3e1d67"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d36c639ebfd347b28afeb5724b3e1d67"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d36c639ebfd347b28afeb5724b3e1d67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d36c639ebfd347b28afeb5724b3e1d67", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:45:06.118444 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ListServerFiltersTestJSON-567370122 Oct 19 03:45:06.118444 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: d36c639ebfd347b28afeb5724b3e1d67 Oct 19 03:45:06.118444 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-567370122 Oct 19 03:45:06.118444 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ListServerFiltersTestJSON-567370122-project Oct 19 03:45:06.118444 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:45:06.118444 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:45:06.118444 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: c81e63d09bd94a9faf9530e911acf0a3 Oct 19 03:45:06.118444 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ListServerFiltersTestJSON-567370122-project Oct 19 03:45:06.118444 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:45:06.118444 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance ceedb58f-1285-4292-8eb7-d741f2919484 could not be found. Oct 19 03:45:06.118444 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': 'ceedb58f-1285-4292-8eb7-d741f2919484'} Oct 19 03:45:06.118444 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:45:06.118444 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:45:06.118444 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:45:06.118444 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:45:06.118444 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:45:06.118444 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:45:06.118444 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:45:06.118444 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:45:06.118444 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:45:06.118444 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:45:06.118444 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ceedb58f-1285-4292-8eb7-d741f2919484 could not be found. Oct 19 03:45:06.118444 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:45:06.118444 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:45:06.118444 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:45:06.118444 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:45:06.118444 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:45:06.118444 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:45:06.118444 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:45:06.118444 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:45:06.118444 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:45:06.118444 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:45:06.118444 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:45:06.118444 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:45:06.118444 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:45:06.118444 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:45:06.118444 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:45:06.118444 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:45:06.118444 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ceedb58f-1285-4292-8eb7-d741f2919484 could not be found. Oct 19 03:45:06.118444 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:45:06.118444 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:45:06.118444 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:45:06.124369 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:45:06.124369 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:45:06.124369 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:45:06.124369 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:45:06.124369 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:45:06.124369 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ceedb58f-1285-4292-8eb7-d741f2919484 could not be found. Oct 19 03:45:06.124369 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:45:06.124369 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ee59370b-5a3e-4d23-bf06-377b391502e3 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Returning 404 to user: Instance ceedb58f-1285-4292-8eb7-d741f2919484 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:45:06.124369 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ee59370b-5a3e-4d23-bf06-377b391502e3 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] 10.222.0.52 "GET /compute/v2.1/servers/ceedb58f-1285-4292-8eb7-d741f2919484" status: 404 len: 111 microversion: 2.1 time: 0.049495 Oct 19 03:45:06.124369 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3018/5965] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:45:06 2022] GET /compute/v2.1/servers/ceedb58f-1285-4292-8eb7-d741f2919484 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:45:06.130056 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9bdcfe16-ad29-4873-a508-f7c4c3bd59b5 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:45:06.131156 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9bdcfe16-ad29-4873-a508-f7c4c3bd59b5 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] [instance: a339021c-b7c6-4e4c-abc9-e91fefca9b98] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:45:06.141618 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9bdcfe16-ad29-4873-a508-f7c4c3bd59b5 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:45:06.141618 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9bdcfe16-ad29-4873-a508-f7c4c3bd59b5 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:45:06.142060 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9bdcfe16-ad29-4873-a508-f7c4c3bd59b5 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:45:06.143436 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9bdcfe16-ad29-4873-a508-f7c4c3bd59b5 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:45:06.144306 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9bdcfe16-ad29-4873-a508-f7c4c3bd59b5 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:45:06.145395 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9bdcfe16-ad29-4873-a508-f7c4c3bd59b5 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:45:06.175822 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9bdcfe16-ad29-4873-a508-f7c4c3bd59b5 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] [instance: a339021c-b7c6-4e4c-abc9-e91fefca9b98] Going to try to terminate instance {{(pid=121134) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:45:06.502257 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=44 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:45:06.627105 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9bdcfe16-ad29-4873-a508-f7c4c3bd59b5 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] 10.222.0.52 "DELETE /compute/v2.1/servers/a339021c-b7c6-4e4c-abc9-e91fefca9b98" status: 204 len: 0 microversion: 2.1 time: 0.500870 Oct 19 03:45:06.641920 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2948/5966] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:45:06 2022] DELETE /compute/v2.1/servers/a339021c-b7c6-4e4c-abc9-e91fefca9b98 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:45:06.653960 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e60af56e-a60b-4314-9794-5f398b67640e tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:45:06.655482 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e60af56e-a60b-4314-9794-5f398b67640e tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] [instance: a339021c-b7c6-4e4c-abc9-e91fefca9b98] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:45:06.665748 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e60af56e-a60b-4314-9794-5f398b67640e tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:45:06.672766 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e60af56e-a60b-4314-9794-5f398b67640e tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:45:06.678589 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e60af56e-a60b-4314-9794-5f398b67640e tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:45:06.681843 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e60af56e-a60b-4314-9794-5f398b67640e tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:45:06.682565 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e60af56e-a60b-4314-9794-5f398b67640e tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:45:06.683179 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e60af56e-a60b-4314-9794-5f398b67640e tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:45:07.106518 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-e60af56e-a60b-4314-9794-5f398b67640e tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81e63d09bd94a9faf9530e911acf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36c639ebfd347b28afeb5724b3e1d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:45:07.118760 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e60af56e-a60b-4314-9794-5f398b67640e tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] 10.222.0.52 "GET /compute/v2.1/servers/a339021c-b7c6-4e4c-abc9-e91fefca9b98" status: 200 len: 1519 microversion: 2.1 time: 0.471664 Oct 19 03:45:07.120843 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3019/5967] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:45:06 2022] GET /compute/v2.1/servers/a339021c-b7c6-4e4c-abc9-e91fefca9b98 => generated 1519 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:45:08.146832 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9bb42540-d8d3-4237-b2b3-1b5195509e6f tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:45:08.148225 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9bb42540-d8d3-4237-b2b3-1b5195509e6f tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] [instance: a339021c-b7c6-4e4c-abc9-e91fefca9b98] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:45:08.159625 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9bb42540-d8d3-4237-b2b3-1b5195509e6f tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:45:08.162002 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9bb42540-d8d3-4237-b2b3-1b5195509e6f tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:45:08.162622 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9bb42540-d8d3-4237-b2b3-1b5195509e6f tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:45:08.164791 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9bb42540-d8d3-4237-b2b3-1b5195509e6f tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:45:08.166660 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9bb42540-d8d3-4237-b2b3-1b5195509e6f tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:45:08.168563 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9bb42540-d8d3-4237-b2b3-1b5195509e6f tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:45:08.516442 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9bb42540-d8d3-4237-b2b3-1b5195509e6f tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81e63d09bd94a9faf9530e911acf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36c639ebfd347b28afeb5724b3e1d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:45:08.531614 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9bb42540-d8d3-4237-b2b3-1b5195509e6f tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] 10.222.0.52 "GET /compute/v2.1/servers/a339021c-b7c6-4e4c-abc9-e91fefca9b98" status: 200 len: 1519 microversion: 2.1 time: 0.391038 Oct 19 03:45:08.532364 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2949/5968] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:45:08 2022] GET /compute/v2.1/servers/a339021c-b7c6-4e4c-abc9-e91fefca9b98 => generated 1519 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:45:09.563987 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f7c17088-0e75-439a-8be7-79686f434fb7 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:45:09.565279 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f7c17088-0e75-439a-8be7-79686f434fb7 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] [instance: a339021c-b7c6-4e4c-abc9-e91fefca9b98] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:45:09.581038 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f7c17088-0e75-439a-8be7-79686f434fb7 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:45:09.581575 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f7c17088-0e75-439a-8be7-79686f434fb7 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:45:09.582030 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f7c17088-0e75-439a-8be7-79686f434fb7 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:45:09.582933 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f7c17088-0e75-439a-8be7-79686f434fb7 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:45:09.583214 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f7c17088-0e75-439a-8be7-79686f434fb7 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:45:09.583746 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f7c17088-0e75-439a-8be7-79686f434fb7 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:45:09.619839 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:45:09.820344 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f7c17088-0e75-439a-8be7-79686f434fb7 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81e63d09bd94a9faf9530e911acf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36c639ebfd347b28afeb5724b3e1d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:45:09.830657 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f7c17088-0e75-439a-8be7-79686f434fb7 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] 10.222.0.52 "GET /compute/v2.1/servers/a339021c-b7c6-4e4c-abc9-e91fefca9b98" status: 200 len: 1519 microversion: 2.1 time: 0.271118 Oct 19 03:45:09.832104 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3020/5969] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:45:09 2022] GET /compute/v2.1/servers/a339021c-b7c6-4e4c-abc9-e91fefca9b98 => generated 1519 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:45:10.258301 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-c7f2e60f-ae82-40b4-a30b-de99733d3844 req-e4a2de6c-5005-486e-9711-de261cff67ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a339021c-b7c6-4e4c-abc9-e91fefca9b98", "name": "network-vif-deleted", "tag": "6667d343-03b8-4c21-a012-56d60b3eec91"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:45:10.275728 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:45:10.296567 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-c7f2e60f-ae82-40b4-a30b-de99733d3844 req-e4a2de6c-5005-486e-9711-de261cff67ed service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:45:10.304110 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-c7f2e60f-ae82-40b4-a30b-de99733d3844 req-e4a2de6c-5005-486e-9711-de261cff67ed service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:45:10.304930 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-c7f2e60f-ae82-40b4-a30b-de99733d3844 req-e4a2de6c-5005-486e-9711-de261cff67ed service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:45:10.321483 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-c7f2e60f-ae82-40b4-a30b-de99733d3844 req-e4a2de6c-5005-486e-9711-de261cff67ed service nova] Creating event network-vif-deleted:6667d343-03b8-4c21-a012-56d60b3eec91 for instance a339021c-b7c6-4e4c-abc9-e91fefca9b98 on n-h1-861333-8 Oct 19 03:45:10.351181 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-c7f2e60f-ae82-40b4-a30b-de99733d3844 req-e4a2de6c-5005-486e-9711-de261cff67ed service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096922 Oct 19 03:45:10.353288 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2950/5970] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:45:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:45:10.855134 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d200902d-904a-48a2-bdea-9555e543da94 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:45:10.855933 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d200902d-904a-48a2-bdea-9555e543da94 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] [instance: a339021c-b7c6-4e4c-abc9-e91fefca9b98] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:45:10.871496 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=8 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:45:10.875020 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d200902d-904a-48a2-bdea-9555e543da94 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:45:10.875835 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d200902d-904a-48a2-bdea-9555e543da94 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:45:10.876499 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d200902d-904a-48a2-bdea-9555e543da94 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:45:10.877981 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d200902d-904a-48a2-bdea-9555e543da94 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:45:10.878838 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d200902d-904a-48a2-bdea-9555e543da94 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:45:10.879637 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d200902d-904a-48a2-bdea-9555e543da94 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:45:10.959355 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d200902d-904a-48a2-bdea-9555e543da94 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:45:10.959355 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d200902d-904a-48a2-bdea-9555e543da94 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:45:10.972948 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d200902d-904a-48a2-bdea-9555e543da94 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:45:10.974560 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-d200902d-904a-48a2-bdea-9555e543da94 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lazy-loading 'fault' on Instance uuid a339021c-b7c6-4e4c-abc9-e91fefca9b98 {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:45:11.427881 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d200902d-904a-48a2-bdea-9555e543da94 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81e63d09bd94a9faf9530e911acf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36c639ebfd347b28afeb5724b3e1d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:45:11.443821 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d200902d-904a-48a2-bdea-9555e543da94 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] 10.222.0.52 "GET /compute/v2.1/servers/a339021c-b7c6-4e4c-abc9-e91fefca9b98" status: 200 len: 1311 microversion: 2.1 time: 0.592919 Oct 19 03:45:11.444419 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3021/5971] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:45:10 2022] GET /compute/v2.1/servers/a339021c-b7c6-4e4c-abc9-e91fefca9b98 => generated 1311 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:45:12.472812 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6a4e5572-e35e-4f0c-a82f-5b3caf4b58c5 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:45:12.476361 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6a4e5572-e35e-4f0c-a82f-5b3caf4b58c5 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] [instance: a339021c-b7c6-4e4c-abc9-e91fefca9b98] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:45:12.486468 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=10 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:45:12.489418 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6a4e5572-e35e-4f0c-a82f-5b3caf4b58c5 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:45:12.489927 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6a4e5572-e35e-4f0c-a82f-5b3caf4b58c5 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:45:12.491718 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6a4e5572-e35e-4f0c-a82f-5b3caf4b58c5 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:45:12.492592 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6a4e5572-e35e-4f0c-a82f-5b3caf4b58c5 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:45:12.500614 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6a4e5572-e35e-4f0c-a82f-5b3caf4b58c5 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:45:12.501247 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6a4e5572-e35e-4f0c-a82f-5b3caf4b58c5 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:45:12.528627 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-6a4e5572-e35e-4f0c-a82f-5b3caf4b58c5 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] HTTP exception thrown: Instance a339021c-b7c6-4e4c-abc9-e91fefca9b98 could not be found. Oct 19 03:45:12.554143 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6a4e5572-e35e-4f0c-a82f-5b3caf4b58c5 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Request method failure captured: Oct 19 03:45:12.554143 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/a339021c-b7c6-4e4c-abc9-e91fefca9b98 HTTP/1.1 Oct 19 03:45:12.554143 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:45:12.554143 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:45:12.554143 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:45:12.554143 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:45:12.554143 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:45:12.554143 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:45:12.554143 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:45:12.554143 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:45:12.554143 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3KBZXq2ZE4g71PjzqWypPsYe_zEH9DB4sEzW9Qt3tDYva_1tL62jWCidHBRiHRaLmbUFdMQ9QHj3xYTzi0HL1_UOtcD1-rzYcZGhga7txHWku_O-v31H9V33sbpnInFhwTwFDSH75RvUJSGmGfTebtSlbvpE87yURICThZlKt76t2A Oct 19 03:45:12.554143 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:45:12.554143 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:45:12.554143 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:45:12.554143 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:45:12.554143 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:45:12.554143 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:45:12.554143 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: d36c639ebfd347b28afeb5724b3e1d67 Oct 19 03:45:12.554143 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ListServerFiltersTestJSON-567370122 Oct 19 03:45:12.554143 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:45:12.554143 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:45:12.554143 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d36c639ebfd347b28afeb5724b3e1d67"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d36c639ebfd347b28afeb5724b3e1d67"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d36c639ebfd347b28afeb5724b3e1d67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d36c639ebfd347b28afeb5724b3e1d67", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:45:12.554143 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ListServerFiltersTestJSON-567370122 Oct 19 03:45:12.554143 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: d36c639ebfd347b28afeb5724b3e1d67 Oct 19 03:45:12.554143 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-567370122 Oct 19 03:45:12.554143 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ListServerFiltersTestJSON-567370122-project Oct 19 03:45:12.554143 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:45:12.554143 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:45:12.554143 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: c81e63d09bd94a9faf9530e911acf0a3 Oct 19 03:45:12.554143 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ListServerFiltersTestJSON-567370122-project Oct 19 03:45:12.554143 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:45:12.554143 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance a339021c-b7c6-4e4c-abc9-e91fefca9b98 could not be found. Oct 19 03:45:12.554143 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': 'a339021c-b7c6-4e4c-abc9-e91fefca9b98'} Oct 19 03:45:12.554143 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:45:12.554143 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:45:12.554143 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:45:12.554143 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:45:12.554143 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:45:12.554143 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:45:12.554143 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:45:12.554143 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:45:12.554143 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:45:12.554143 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:45:12.554143 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a339021c-b7c6-4e4c-abc9-e91fefca9b98 could not be found. Oct 19 03:45:12.554143 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:45:12.554143 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:45:12.554143 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:45:12.554143 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:45:12.554143 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:45:12.554143 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:45:12.554143 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:45:12.554143 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:45:12.554143 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:45:12.554143 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:45:12.554143 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:45:12.554143 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:45:12.554143 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:45:12.554143 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:45:12.554143 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:45:12.554143 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:45:12.554143 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a339021c-b7c6-4e4c-abc9-e91fefca9b98 could not be found. Oct 19 03:45:12.554143 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:45:12.554143 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:45:12.554143 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:45:12.566131 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:45:12.566131 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:45:12.566131 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:45:12.566131 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:45:12.566131 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:45:12.566131 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a339021c-b7c6-4e4c-abc9-e91fefca9b98 could not be found. Oct 19 03:45:12.566131 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:45:12.566131 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6a4e5572-e35e-4f0c-a82f-5b3caf4b58c5 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Returning 404 to user: Instance a339021c-b7c6-4e4c-abc9-e91fefca9b98 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:45:12.579088 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6a4e5572-e35e-4f0c-a82f-5b3caf4b58c5 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] 10.222.0.52 "GET /compute/v2.1/servers/a339021c-b7c6-4e4c-abc9-e91fefca9b98" status: 404 len: 111 microversion: 2.1 time: 0.090954 Oct 19 03:45:12.580214 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2951/5972] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:45:12 2022] GET /compute/v2.1/servers/a339021c-b7c6-4e4c-abc9-e91fefca9b98 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:45:12.588042 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-89192d6c-0428-4bf6-94eb-af13c20212c4 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:45:12.591221 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-89192d6c-0428-4bf6-94eb-af13c20212c4 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] [instance: ac91ce38-2d07-43e1-91c5-ebf68341e491] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:45:12.596585 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-89192d6c-0428-4bf6-94eb-af13c20212c4 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:45:12.597090 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-89192d6c-0428-4bf6-94eb-af13c20212c4 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:45:12.597612 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-89192d6c-0428-4bf6-94eb-af13c20212c4 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:45:12.598325 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-89192d6c-0428-4bf6-94eb-af13c20212c4 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:45:12.598837 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-89192d6c-0428-4bf6-94eb-af13c20212c4 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:45:12.599276 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-89192d6c-0428-4bf6-94eb-af13c20212c4 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:45:12.666112 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-89192d6c-0428-4bf6-94eb-af13c20212c4 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] [instance: ac91ce38-2d07-43e1-91c5-ebf68341e491] Going to try to terminate instance {{(pid=121135) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:45:13.163616 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-89192d6c-0428-4bf6-94eb-af13c20212c4 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ac91ce38-2d07-43e1-91c5-ebf68341e491" status: 204 len: 0 microversion: 2.1 time: 0.579277 Oct 19 03:45:13.172622 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3022/5973] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:45:12 2022] DELETE /compute/v2.1/servers/ac91ce38-2d07-43e1-91c5-ebf68341e491 => generated 0 bytes in 586 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:45:13.179157 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e25c7a6e-2da8-4352-8bff-631e7a336c20 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:45:13.182103 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e25c7a6e-2da8-4352-8bff-631e7a336c20 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] [instance: ac91ce38-2d07-43e1-91c5-ebf68341e491] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:45:13.196697 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e25c7a6e-2da8-4352-8bff-631e7a336c20 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:45:13.197794 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e25c7a6e-2da8-4352-8bff-631e7a336c20 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:45:13.198402 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e25c7a6e-2da8-4352-8bff-631e7a336c20 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:45:13.200788 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e25c7a6e-2da8-4352-8bff-631e7a336c20 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:45:13.201471 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e25c7a6e-2da8-4352-8bff-631e7a336c20 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:45:13.202070 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e25c7a6e-2da8-4352-8bff-631e7a336c20 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:45:13.544694 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e25c7a6e-2da8-4352-8bff-631e7a336c20 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81e63d09bd94a9faf9530e911acf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36c639ebfd347b28afeb5724b3e1d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:45:13.553738 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e25c7a6e-2da8-4352-8bff-631e7a336c20 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] 10.222.0.52 "GET /compute/v2.1/servers/ac91ce38-2d07-43e1-91c5-ebf68341e491" status: 200 len: 1517 microversion: 2.1 time: 0.379705 Oct 19 03:45:13.554724 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2952/5974] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:45:13 2022] GET /compute/v2.1/servers/ac91ce38-2d07-43e1-91c5-ebf68341e491 => generated 1517 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:45:14.581012 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-27964bb6-6068-4486-a385-868ec96498c9 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:45:14.583255 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-27964bb6-6068-4486-a385-868ec96498c9 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] [instance: ac91ce38-2d07-43e1-91c5-ebf68341e491] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:45:14.592333 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-27964bb6-6068-4486-a385-868ec96498c9 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:45:14.593058 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-27964bb6-6068-4486-a385-868ec96498c9 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:45:14.594277 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-27964bb6-6068-4486-a385-868ec96498c9 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:45:14.595409 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-27964bb6-6068-4486-a385-868ec96498c9 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:45:14.596090 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-27964bb6-6068-4486-a385-868ec96498c9 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:45:14.597301 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-27964bb6-6068-4486-a385-868ec96498c9 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:45:14.757686 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-27964bb6-6068-4486-a385-868ec96498c9 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81e63d09bd94a9faf9530e911acf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36c639ebfd347b28afeb5724b3e1d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:45:14.766355 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-27964bb6-6068-4486-a385-868ec96498c9 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] 10.222.0.52 "GET /compute/v2.1/servers/ac91ce38-2d07-43e1-91c5-ebf68341e491" status: 200 len: 1517 microversion: 2.1 time: 0.192175 Oct 19 03:45:14.766938 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3023/5975] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:45:14 2022] GET /compute/v2.1/servers/ac91ce38-2d07-43e1-91c5-ebf68341e491 => generated 1517 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:45:15.790422 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9d0948f2-6a50-49ea-a4c5-46100657b5f8 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:45:15.791028 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9d0948f2-6a50-49ea-a4c5-46100657b5f8 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] [instance: ac91ce38-2d07-43e1-91c5-ebf68341e491] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:45:15.802674 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9d0948f2-6a50-49ea-a4c5-46100657b5f8 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:45:15.803183 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9d0948f2-6a50-49ea-a4c5-46100657b5f8 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:45:15.803641 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9d0948f2-6a50-49ea-a4c5-46100657b5f8 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:45:15.806660 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9d0948f2-6a50-49ea-a4c5-46100657b5f8 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:45:15.813027 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9d0948f2-6a50-49ea-a4c5-46100657b5f8 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:45:15.813704 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9d0948f2-6a50-49ea-a4c5-46100657b5f8 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:45:15.974045 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9d0948f2-6a50-49ea-a4c5-46100657b5f8 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81e63d09bd94a9faf9530e911acf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36c639ebfd347b28afeb5724b3e1d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:45:15.987946 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-11436214-ef68-4aa3-a654-dfa87460cc48 req-01b11681-23b6-4f11-a2ec-996f10a648b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac91ce38-2d07-43e1-91c5-ebf68341e491", "name": "network-vif-deleted", "tag": "85cb2801-42de-49e1-b975-d26594d01f2b"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:45:15.989858 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:45:15.996568 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9d0948f2-6a50-49ea-a4c5-46100657b5f8 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] 10.222.0.52 "GET /compute/v2.1/servers/ac91ce38-2d07-43e1-91c5-ebf68341e491" status: 200 len: 1475 microversion: 2.1 time: 0.210507 Oct 19 03:45:15.997162 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2953/5976] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:45:15 2022] GET /compute/v2.1/servers/ac91ce38-2d07-43e1-91c5-ebf68341e491 => generated 1475 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:45:16.002025 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-11436214-ef68-4aa3-a654-dfa87460cc48 req-01b11681-23b6-4f11-a2ec-996f10a648b6 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:45:16.003048 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-11436214-ef68-4aa3-a654-dfa87460cc48 req-01b11681-23b6-4f11-a2ec-996f10a648b6 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:45:16.003764 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-11436214-ef68-4aa3-a654-dfa87460cc48 req-01b11681-23b6-4f11-a2ec-996f10a648b6 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:45:16.023030 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-11436214-ef68-4aa3-a654-dfa87460cc48 req-01b11681-23b6-4f11-a2ec-996f10a648b6 service nova] Creating event network-vif-deleted:85cb2801-42de-49e1-b975-d26594d01f2b for instance ac91ce38-2d07-43e1-91c5-ebf68341e491 on n-h1-861333-8 Oct 19 03:45:16.030097 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-11436214-ef68-4aa3-a654-dfa87460cc48 req-01b11681-23b6-4f11-a2ec-996f10a648b6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046655 Oct 19 03:45:16.034504 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3024/5977] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:45:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:45:17.029565 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b97ed212-cd92-4761-9f9c-5fca3518369e tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:45:17.031116 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b97ed212-cd92-4761-9f9c-5fca3518369e tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] [instance: ac91ce38-2d07-43e1-91c5-ebf68341e491] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:45:17.039534 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b97ed212-cd92-4761-9f9c-5fca3518369e tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:45:17.040223 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b97ed212-cd92-4761-9f9c-5fca3518369e tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:45:17.041072 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b97ed212-cd92-4761-9f9c-5fca3518369e tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:45:17.042037 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b97ed212-cd92-4761-9f9c-5fca3518369e tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:45:17.042654 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b97ed212-cd92-4761-9f9c-5fca3518369e tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:45:17.043246 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b97ed212-cd92-4761-9f9c-5fca3518369e tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:45:17.082632 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b97ed212-cd92-4761-9f9c-5fca3518369e tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:45:17.083396 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b97ed212-cd92-4761-9f9c-5fca3518369e tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:45:17.084004 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b97ed212-cd92-4761-9f9c-5fca3518369e tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:45:17.084636 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-b97ed212-cd92-4761-9f9c-5fca3518369e tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lazy-loading 'fault' on Instance uuid ac91ce38-2d07-43e1-91c5-ebf68341e491 {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:45:17.234730 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b97ed212-cd92-4761-9f9c-5fca3518369e tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81e63d09bd94a9faf9530e911acf0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36c639ebfd347b28afeb5724b3e1d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:45:17.244907 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b97ed212-cd92-4761-9f9c-5fca3518369e tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] 10.222.0.52 "GET /compute/v2.1/servers/ac91ce38-2d07-43e1-91c5-ebf68341e491" status: 200 len: 1310 microversion: 2.1 time: 0.224210 Oct 19 03:45:17.245458 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2954/5978] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:45:17 2022] GET /compute/v2.1/servers/ac91ce38-2d07-43e1-91c5-ebf68341e491 => generated 1310 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:45:18.272344 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c6f2c899-110b-46af-a0ba-6e724c60c869 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:45:18.275078 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c6f2c899-110b-46af-a0ba-6e724c60c869 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] [instance: ac91ce38-2d07-43e1-91c5-ebf68341e491] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:45:18.292859 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c6f2c899-110b-46af-a0ba-6e724c60c869 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:45:18.293458 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c6f2c899-110b-46af-a0ba-6e724c60c869 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:45:18.293925 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c6f2c899-110b-46af-a0ba-6e724c60c869 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:45:18.294685 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c6f2c899-110b-46af-a0ba-6e724c60c869 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:45:18.295213 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c6f2c899-110b-46af-a0ba-6e724c60c869 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:45:18.295591 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c6f2c899-110b-46af-a0ba-6e724c60c869 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:45:18.351696 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-c6f2c899-110b-46af-a0ba-6e724c60c869 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] HTTP exception thrown: Instance ac91ce38-2d07-43e1-91c5-ebf68341e491 could not be found. Oct 19 03:45:18.353461 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c6f2c899-110b-46af-a0ba-6e724c60c869 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Request method failure captured: Oct 19 03:45:18.353461 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/ac91ce38-2d07-43e1-91c5-ebf68341e491 HTTP/1.1 Oct 19 03:45:18.353461 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:45:18.353461 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:45:18.353461 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:45:18.353461 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:45:18.353461 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:45:18.353461 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:45:18.353461 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:45:18.353461 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:45:18.353461 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT3KBZXq2ZE4g71PjzqWypPsYe_zEH9DB4sEzW9Qt3tDYva_1tL62jWCidHBRiHRaLmbUFdMQ9QHj3xYTzi0HL1_UOtcD1-rzYcZGhga7txHWku_O-v31H9V33sbpnInFhwTwFDSH75RvUJSGmGfTebtSlbvpE87yURICThZlKt76t2A Oct 19 03:45:18.353461 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:45:18.353461 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:45:18.353461 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:45:18.353461 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:45:18.353461 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:45:18.353461 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:45:18.353461 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: d36c639ebfd347b28afeb5724b3e1d67 Oct 19 03:45:18.353461 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ListServerFiltersTestJSON-567370122 Oct 19 03:45:18.353461 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:45:18.353461 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:45:18.353461 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d36c639ebfd347b28afeb5724b3e1d67"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d36c639ebfd347b28afeb5724b3e1d67"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d36c639ebfd347b28afeb5724b3e1d67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d36c639ebfd347b28afeb5724b3e1d67", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:45:18.353461 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ListServerFiltersTestJSON-567370122 Oct 19 03:45:18.353461 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: d36c639ebfd347b28afeb5724b3e1d67 Oct 19 03:45:18.353461 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-567370122 Oct 19 03:45:18.353461 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ListServerFiltersTestJSON-567370122-project Oct 19 03:45:18.353461 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:45:18.353461 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:45:18.353461 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: c81e63d09bd94a9faf9530e911acf0a3 Oct 19 03:45:18.353461 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ListServerFiltersTestJSON-567370122-project Oct 19 03:45:18.353461 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:45:18.353461 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance ac91ce38-2d07-43e1-91c5-ebf68341e491 could not be found. Oct 19 03:45:18.353461 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': 'ac91ce38-2d07-43e1-91c5-ebf68341e491'} Oct 19 03:45:18.353461 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:45:18.353461 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:45:18.353461 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:45:18.353461 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:45:18.353461 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:45:18.353461 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:45:18.353461 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:45:18.353461 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:45:18.353461 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:45:18.353461 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:45:18.353461 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac91ce38-2d07-43e1-91c5-ebf68341e491 could not be found. Oct 19 03:45:18.353461 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:45:18.353461 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:45:18.353461 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:45:18.353461 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:45:18.353461 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:45:18.353461 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:45:18.353461 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:45:18.353461 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:45:18.353461 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:45:18.353461 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:45:18.353461 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:45:18.353461 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:45:18.353461 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:45:18.353461 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:45:18.353461 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:45:18.353461 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:45:18.353461 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac91ce38-2d07-43e1-91c5-ebf68341e491 could not be found. Oct 19 03:45:18.353461 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:45:18.353461 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:45:18.353461 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:45:18.357801 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:45:18.357801 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:45:18.357801 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:45:18.357801 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:45:18.357801 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:45:18.357801 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac91ce38-2d07-43e1-91c5-ebf68341e491 could not be found. Oct 19 03:45:18.357801 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:45:18.357801 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c6f2c899-110b-46af-a0ba-6e724c60c869 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] Returning 404 to user: Instance ac91ce38-2d07-43e1-91c5-ebf68341e491 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:45:18.360484 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c6f2c899-110b-46af-a0ba-6e724c60c869 tempest-ListServerFiltersTestJSON-567370122 tempest-ListServerFiltersTestJSON-567370122-project] 10.222.0.52 "GET /compute/v2.1/servers/ac91ce38-2d07-43e1-91c5-ebf68341e491" status: 404 len: 111 microversion: 2.1 time: 0.087890 Oct 19 03:45:18.378589 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3025/5979] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:45:18 2022] GET /compute/v2.1/servers/ac91ce38-2d07-43e1-91c5-ebf68341e491 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:45:23.902323 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0f2679ee-7646-4389-a8e9-b34123fd73cc tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-1594338920", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "networks": "none"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:45:23.986918 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-0f2679ee-7646-4389-a8e9-b34123fd73cc tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Flavor limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:45:23.987580 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-0f2679ee-7646-4389-a8e9-b34123fd73cc tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Image limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:45:23.988141 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-0f2679ee-7646-4389-a8e9-b34123fd73cc tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Flavor pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:45:23.988646 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-0f2679ee-7646-4389-a8e9-b34123fd73cc tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Image pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:45:23.989129 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-0f2679ee-7646-4389-a8e9-b34123fd73cc tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:45:24.001010 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0f2679ee-7646-4389-a8e9-b34123fd73cc tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:45:24.001010 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0f2679ee-7646-4389-a8e9-b34123fd73cc tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:45:24.001010 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0f2679ee-7646-4389-a8e9-b34123fd73cc tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:45:24.001010 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0f2679ee-7646-4389-a8e9-b34123fd73cc tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:45:24.001527 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0f2679ee-7646-4389-a8e9-b34123fd73cc tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:45:24.002278 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0f2679ee-7646-4389-a8e9-b34123fd73cc tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:45:24.023213 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-0f2679ee-7646-4389-a8e9-b34123fd73cc tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Getting quotas for project 6bdb0e0207e84c42b6ce356431009f70. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:45:24.029344 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-0f2679ee-7646-4389-a8e9-b34123fd73cc tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Getting quotas for user 513576a6579d4b4bac9919190a9ca39f and project 6bdb0e0207e84c42b6ce356431009f70. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:45:24.045335 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0f2679ee-7646-4389-a8e9-b34123fd73cc tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Going to run 1 instances... {{(pid=121134) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:45:24.048673 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0f2679ee-7646-4389-a8e9-b34123fd73cc tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] [instance: 18f9dc3c-d566-4a07-b6fe-8ea31f4e00a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:45:24.164173 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0f2679ee-7646-4389-a8e9-b34123fd73cc tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.660069 Oct 19 03:45:24.166206 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2955/5980] 10.222.0.52 () {62 vars in 1188 bytes} [Wed Oct 19 03:45:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 662 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 19 03:45:24.178950 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7badf029-8718-455c-84b2-6557e886b4ca tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:45:24.180738 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7badf029-8718-455c-84b2-6557e886b4ca tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] [instance: 18f9dc3c-d566-4a07-b6fe-8ea31f4e00a7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:45:24.318714 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7badf029-8718-455c-84b2-6557e886b4ca tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513576a6579d4b4bac9919190a9ca39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdb0e0207e84c42b6ce356431009f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:45:24.333665 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7badf029-8718-455c-84b2-6557e886b4ca tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '513576a6579d4b4bac9919190a9ca39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdb0e0207e84c42b6ce356431009f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:45:24.349974 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7badf029-8718-455c-84b2-6557e886b4ca tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '513576a6579d4b4bac9919190a9ca39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdb0e0207e84c42b6ce356431009f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:45:24.349974 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7badf029-8718-455c-84b2-6557e886b4ca tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] 10.222.0.52 "GET /compute/v2.1/servers/18f9dc3c-d566-4a07-b6fe-8ea31f4e00a7" status: 200 len: 1281 microversion: 2.47 time: 0.165092 Oct 19 03:45:24.352351 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3026/5981] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:45:24 2022] GET /compute/v2.1/servers/18f9dc3c-d566-4a07-b6fe-8ea31f4e00a7 => generated 1281 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:45:25.370078 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-43094933-e093-4048-a47e-3730be1f73ea tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:45:25.373433 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-43094933-e093-4048-a47e-3730be1f73ea tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] [instance: 18f9dc3c-d566-4a07-b6fe-8ea31f4e00a7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:45:25.454767 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-43094933-e093-4048-a47e-3730be1f73ea tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513576a6579d4b4bac9919190a9ca39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdb0e0207e84c42b6ce356431009f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:45:25.462894 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-43094933-e093-4048-a47e-3730be1f73ea tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '513576a6579d4b4bac9919190a9ca39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdb0e0207e84c42b6ce356431009f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:45:25.464345 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-43094933-e093-4048-a47e-3730be1f73ea tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '513576a6579d4b4bac9919190a9ca39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdb0e0207e84c42b6ce356431009f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:45:25.465736 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-43094933-e093-4048-a47e-3730be1f73ea tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] 10.222.0.52 "GET /compute/v2.1/servers/18f9dc3c-d566-4a07-b6fe-8ea31f4e00a7" status: 200 len: 1281 microversion: 2.47 time: 0.103296 Oct 19 03:45:25.466304 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2956/5982] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:45:25 2022] GET /compute/v2.1/servers/18f9dc3c-d566-4a07-b6fe-8ea31f4e00a7 => generated 1281 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:45:26.493318 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-185b6edf-b802-4336-8d58-3f377f4361ea tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:45:26.493979 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-185b6edf-b802-4336-8d58-3f377f4361ea tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] [instance: 18f9dc3c-d566-4a07-b6fe-8ea31f4e00a7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:45:26.502356 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-185b6edf-b802-4336-8d58-3f377f4361ea tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:45:26.502706 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-185b6edf-b802-4336-8d58-3f377f4361ea tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:45:26.503248 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-185b6edf-b802-4336-8d58-3f377f4361ea tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:45:26.503962 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-185b6edf-b802-4336-8d58-3f377f4361ea tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:45:26.504425 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-185b6edf-b802-4336-8d58-3f377f4361ea tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:45:26.505056 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-185b6edf-b802-4336-8d58-3f377f4361ea tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:45:26.626342 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-185b6edf-b802-4336-8d58-3f377f4361ea tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513576a6579d4b4bac9919190a9ca39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdb0e0207e84c42b6ce356431009f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:45:26.638050 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-185b6edf-b802-4336-8d58-3f377f4361ea tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '513576a6579d4b4bac9919190a9ca39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdb0e0207e84c42b6ce356431009f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:45:26.641224 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-185b6edf-b802-4336-8d58-3f377f4361ea tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '513576a6579d4b4bac9919190a9ca39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdb0e0207e84c42b6ce356431009f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:45:26.642678 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-185b6edf-b802-4336-8d58-3f377f4361ea tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] 10.222.0.52 "GET /compute/v2.1/servers/18f9dc3c-d566-4a07-b6fe-8ea31f4e00a7" status: 200 len: 1277 microversion: 2.47 time: 0.153451 Oct 19 03:45:26.657776 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3027/5983] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:45:26 2022] GET /compute/v2.1/servers/18f9dc3c-d566-4a07-b6fe-8ea31f4e00a7 => generated 1277 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:45:27.669979 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-98d5c0aa-f6e5-4c0a-9f72-cfb808300e98 tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:45:27.674390 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-98d5c0aa-f6e5-4c0a-9f72-cfb808300e98 tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] [instance: 18f9dc3c-d566-4a07-b6fe-8ea31f4e00a7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:45:27.710335 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-98d5c0aa-f6e5-4c0a-9f72-cfb808300e98 tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:45:27.711479 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-98d5c0aa-f6e5-4c0a-9f72-cfb808300e98 tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:45:27.712149 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-98d5c0aa-f6e5-4c0a-9f72-cfb808300e98 tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:45:27.716567 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-98d5c0aa-f6e5-4c0a-9f72-cfb808300e98 tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:45:27.717295 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-98d5c0aa-f6e5-4c0a-9f72-cfb808300e98 tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:45:27.718642 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-98d5c0aa-f6e5-4c0a-9f72-cfb808300e98 tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:45:27.836891 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-98d5c0aa-f6e5-4c0a-9f72-cfb808300e98 tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513576a6579d4b4bac9919190a9ca39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdb0e0207e84c42b6ce356431009f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:45:27.850847 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-98d5c0aa-f6e5-4c0a-9f72-cfb808300e98 tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '513576a6579d4b4bac9919190a9ca39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdb0e0207e84c42b6ce356431009f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:45:27.852826 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-98d5c0aa-f6e5-4c0a-9f72-cfb808300e98 tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '513576a6579d4b4bac9919190a9ca39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdb0e0207e84c42b6ce356431009f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:45:27.854222 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-98d5c0aa-f6e5-4c0a-9f72-cfb808300e98 tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] 10.222.0.52 "GET /compute/v2.1/servers/18f9dc3c-d566-4a07-b6fe-8ea31f4e00a7" status: 200 len: 1341 microversion: 2.47 time: 0.188490 Oct 19 03:45:27.856345 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2957/5984] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:45:27 2022] GET /compute/v2.1/servers/18f9dc3c-d566-4a07-b6fe-8ea31f4e00a7 => generated 1341 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:45:28.887770 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-cbef8f4b-d073-4c05-80f0-7df0f8d25c43 tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:45:28.889092 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-cbef8f4b-d073-4c05-80f0-7df0f8d25c43 tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] [instance: 18f9dc3c-d566-4a07-b6fe-8ea31f4e00a7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:45:28.897013 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cbef8f4b-d073-4c05-80f0-7df0f8d25c43 tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:45:28.897817 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cbef8f4b-d073-4c05-80f0-7df0f8d25c43 tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:45:28.899143 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cbef8f4b-d073-4c05-80f0-7df0f8d25c43 tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:45:28.900130 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cbef8f4b-d073-4c05-80f0-7df0f8d25c43 tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:45:28.901620 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cbef8f4b-d073-4c05-80f0-7df0f8d25c43 tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:45:28.902244 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cbef8f4b-d073-4c05-80f0-7df0f8d25c43 tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:45:29.026073 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-cbef8f4b-d073-4c05-80f0-7df0f8d25c43 tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513576a6579d4b4bac9919190a9ca39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdb0e0207e84c42b6ce356431009f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:45:29.043363 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-cbef8f4b-d073-4c05-80f0-7df0f8d25c43 tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '513576a6579d4b4bac9919190a9ca39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdb0e0207e84c42b6ce356431009f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:45:29.046916 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-cbef8f4b-d073-4c05-80f0-7df0f8d25c43 tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '513576a6579d4b4bac9919190a9ca39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdb0e0207e84c42b6ce356431009f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:45:29.049548 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-cbef8f4b-d073-4c05-80f0-7df0f8d25c43 tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] 10.222.0.52 "GET /compute/v2.1/servers/18f9dc3c-d566-4a07-b6fe-8ea31f4e00a7" status: 200 len: 1339 microversion: 2.47 time: 0.165579 Oct 19 03:45:29.050907 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3028/5985] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:45:28 2022] GET /compute/v2.1/servers/18f9dc3c-d566-4a07-b6fe-8ea31f4e00a7 => generated 1339 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:45:30.088891 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8a984abf-9704-44f3-b303-c9bcae5afa2a tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:45:30.090029 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8a984abf-9704-44f3-b303-c9bcae5afa2a tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] [instance: 18f9dc3c-d566-4a07-b6fe-8ea31f4e00a7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:45:30.101831 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8a984abf-9704-44f3-b303-c9bcae5afa2a tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:45:30.102324 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8a984abf-9704-44f3-b303-c9bcae5afa2a tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:45:30.102755 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8a984abf-9704-44f3-b303-c9bcae5afa2a tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:45:30.104386 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8a984abf-9704-44f3-b303-c9bcae5afa2a tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:45:30.106675 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8a984abf-9704-44f3-b303-c9bcae5afa2a tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:45:30.107301 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8a984abf-9704-44f3-b303-c9bcae5afa2a tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:45:30.214284 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8a984abf-9704-44f3-b303-c9bcae5afa2a tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513576a6579d4b4bac9919190a9ca39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdb0e0207e84c42b6ce356431009f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:45:30.228734 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8a984abf-9704-44f3-b303-c9bcae5afa2a tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '513576a6579d4b4bac9919190a9ca39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdb0e0207e84c42b6ce356431009f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:45:30.230446 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8a984abf-9704-44f3-b303-c9bcae5afa2a tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '513576a6579d4b4bac9919190a9ca39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdb0e0207e84c42b6ce356431009f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:45:30.231935 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8a984abf-9704-44f3-b303-c9bcae5afa2a tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] 10.222.0.52 "GET /compute/v2.1/servers/18f9dc3c-d566-4a07-b6fe-8ea31f4e00a7" status: 200 len: 1339 microversion: 2.47 time: 0.156862 Oct 19 03:45:30.232978 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2958/5986] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:45:30 2022] GET /compute/v2.1/servers/18f9dc3c-d566-4a07-b6fe-8ea31f4e00a7 => generated 1339 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:45:31.259398 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9bcf32b2-e719-48c8-b14e-737a293b62cb tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:45:31.266564 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9bcf32b2-e719-48c8-b14e-737a293b62cb tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] [instance: 18f9dc3c-d566-4a07-b6fe-8ea31f4e00a7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:45:31.276446 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9bcf32b2-e719-48c8-b14e-737a293b62cb tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:45:31.278738 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9bcf32b2-e719-48c8-b14e-737a293b62cb tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:45:31.285499 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9bcf32b2-e719-48c8-b14e-737a293b62cb tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:45:31.289315 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9bcf32b2-e719-48c8-b14e-737a293b62cb tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:45:31.291502 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9bcf32b2-e719-48c8-b14e-737a293b62cb tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:45:31.292158 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9bcf32b2-e719-48c8-b14e-737a293b62cb tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:45:31.483644 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-9bcf32b2-e719-48c8-b14e-737a293b62cb tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513576a6579d4b4bac9919190a9ca39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdb0e0207e84c42b6ce356431009f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:45:31.496089 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-9bcf32b2-e719-48c8-b14e-737a293b62cb tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '513576a6579d4b4bac9919190a9ca39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdb0e0207e84c42b6ce356431009f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:45:31.501262 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-9bcf32b2-e719-48c8-b14e-737a293b62cb tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '513576a6579d4b4bac9919190a9ca39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdb0e0207e84c42b6ce356431009f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:45:31.517662 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9bcf32b2-e719-48c8-b14e-737a293b62cb tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] 10.222.0.52 "GET /compute/v2.1/servers/18f9dc3c-d566-4a07-b6fe-8ea31f4e00a7" status: 200 len: 1339 microversion: 2.47 time: 0.248900 Oct 19 03:45:31.517662 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3029/5987] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:45:31 2022] GET /compute/v2.1/servers/18f9dc3c-d566-4a07-b6fe-8ea31f4e00a7 => generated 1339 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:45:32.529742 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ede68f88-380d-4dc4-91b8-46ee628b7a89 tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:45:32.530958 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ede68f88-380d-4dc4-91b8-46ee628b7a89 tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] [instance: 18f9dc3c-d566-4a07-b6fe-8ea31f4e00a7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:45:32.543265 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ede68f88-380d-4dc4-91b8-46ee628b7a89 tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:45:32.545194 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ede68f88-380d-4dc4-91b8-46ee628b7a89 tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:45:32.549876 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ede68f88-380d-4dc4-91b8-46ee628b7a89 tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:45:32.550797 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ede68f88-380d-4dc4-91b8-46ee628b7a89 tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:45:32.551108 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ede68f88-380d-4dc4-91b8-46ee628b7a89 tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:45:32.551554 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ede68f88-380d-4dc4-91b8-46ee628b7a89 tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:45:32.623303 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ede68f88-380d-4dc4-91b8-46ee628b7a89 tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513576a6579d4b4bac9919190a9ca39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdb0e0207e84c42b6ce356431009f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:45:32.636163 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ede68f88-380d-4dc4-91b8-46ee628b7a89 tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '513576a6579d4b4bac9919190a9ca39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdb0e0207e84c42b6ce356431009f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:45:32.637867 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ede68f88-380d-4dc4-91b8-46ee628b7a89 tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '513576a6579d4b4bac9919190a9ca39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdb0e0207e84c42b6ce356431009f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:45:32.638842 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ede68f88-380d-4dc4-91b8-46ee628b7a89 tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] 10.222.0.52 "GET /compute/v2.1/servers/18f9dc3c-d566-4a07-b6fe-8ea31f4e00a7" status: 200 len: 1360 microversion: 2.47 time: 0.112943 Oct 19 03:45:32.653757 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2959/5988] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:45:32 2022] GET /compute/v2.1/servers/18f9dc3c-d566-4a07-b6fe-8ea31f4e00a7 => generated 1360 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:45:32.671407 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-223f48da-14de-468d-a897-ac89a49a5cf6 tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1194286693"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:45:32.685926 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-223f48da-14de-468d-a897-ac89a49a5cf6 tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] [instance: 18f9dc3c-d566-4a07-b6fe-8ea31f4e00a7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:45:32.693853 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-223f48da-14de-468d-a897-ac89a49a5cf6 tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:45:32.694859 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-223f48da-14de-468d-a897-ac89a49a5cf6 tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:45:32.695494 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-223f48da-14de-468d-a897-ac89a49a5cf6 tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:45:32.707627 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-223f48da-14de-468d-a897-ac89a49a5cf6 tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:45:32.713222 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-223f48da-14de-468d-a897-ac89a49a5cf6 tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:45:32.714070 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-223f48da-14de-468d-a897-ac89a49a5cf6 tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:45:33.364048 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-223f48da-14de-468d-a897-ac89a49a5cf6 tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] 10.222.0.52 "POST /compute/v2.1/servers/18f9dc3c-d566-4a07-b6fe-8ea31f4e00a7/action" status: 202 len: 52 microversion: 2.47 time: 0.693949 Oct 19 03:45:33.364048 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3030/5989] 10.222.0.52 () {62 vars in 1319 bytes} [Wed Oct 19 03:45:32 2022] POST /compute/v2.1/servers/18f9dc3c-d566-4a07-b6fe-8ea31f4e00a7/action => generated 52 bytes in 696 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Oct 19 03:45:33.378382 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-80a91df4-49b3-4668-8be0-c834f3dd37f8 tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:45:33.380129 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-80a91df4-49b3-4668-8be0-c834f3dd37f8 tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] [instance: 18f9dc3c-d566-4a07-b6fe-8ea31f4e00a7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:45:33.403522 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-80a91df4-49b3-4668-8be0-c834f3dd37f8 tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:45:33.405548 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-80a91df4-49b3-4668-8be0-c834f3dd37f8 tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:45:33.406206 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-80a91df4-49b3-4668-8be0-c834f3dd37f8 tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:45:33.407766 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-80a91df4-49b3-4668-8be0-c834f3dd37f8 tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:45:33.410915 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-80a91df4-49b3-4668-8be0-c834f3dd37f8 tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:45:33.415691 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-80a91df4-49b3-4668-8be0-c834f3dd37f8 tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:45:33.484321 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-80a91df4-49b3-4668-8be0-c834f3dd37f8 tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] [instance: 18f9dc3c-d566-4a07-b6fe-8ea31f4e00a7] Going to try to terminate instance {{(pid=121134) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:45:33.949047 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-80a91df4-49b3-4668-8be0-c834f3dd37f8 tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] 10.222.0.52 "DELETE /compute/v2.1/servers/18f9dc3c-d566-4a07-b6fe-8ea31f4e00a7" status: 204 len: 0 microversion: 2.47 time: 0.575947 Oct 19 03:45:33.949875 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2960/5990] 10.222.0.52 () {60 vars in 1280 bytes} [Wed Oct 19 03:45:33 2022] DELETE /compute/v2.1/servers/18f9dc3c-d566-4a07-b6fe-8ea31f4e00a7 => generated 0 bytes in 578 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 19 03:45:33.960794 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ab762bcc-b873-4242-a618-b032f0feb4d0 tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:45:33.961571 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ab762bcc-b873-4242-a618-b032f0feb4d0 tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] [instance: 18f9dc3c-d566-4a07-b6fe-8ea31f4e00a7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:45:33.976285 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ab762bcc-b873-4242-a618-b032f0feb4d0 tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:45:33.976797 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ab762bcc-b873-4242-a618-b032f0feb4d0 tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:45:33.978404 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ab762bcc-b873-4242-a618-b032f0feb4d0 tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:45:33.980303 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ab762bcc-b873-4242-a618-b032f0feb4d0 tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:45:33.980789 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ab762bcc-b873-4242-a618-b032f0feb4d0 tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:45:33.982653 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ab762bcc-b873-4242-a618-b032f0feb4d0 tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:45:34.119530 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ab762bcc-b873-4242-a618-b032f0feb4d0 tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513576a6579d4b4bac9919190a9ca39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdb0e0207e84c42b6ce356431009f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:45:34.130862 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ab762bcc-b873-4242-a618-b032f0feb4d0 tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '513576a6579d4b4bac9919190a9ca39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdb0e0207e84c42b6ce356431009f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:45:34.132369 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ab762bcc-b873-4242-a618-b032f0feb4d0 tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '513576a6579d4b4bac9919190a9ca39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdb0e0207e84c42b6ce356431009f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:45:34.134324 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ab762bcc-b873-4242-a618-b032f0feb4d0 tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] 10.222.0.52 "GET /compute/v2.1/servers/18f9dc3c-d566-4a07-b6fe-8ea31f4e00a7" status: 200 len: 1366 microversion: 2.47 time: 0.179519 Oct 19 03:45:34.135017 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3031/5991] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:45:33 2022] GET /compute/v2.1/servers/18f9dc3c-d566-4a07-b6fe-8ea31f4e00a7 => generated 1366 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:45:35.163906 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-17ee698a-4721-4a62-858c-cd124c188ef8 tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:45:35.163906 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-17ee698a-4721-4a62-858c-cd124c188ef8 tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] [instance: 18f9dc3c-d566-4a07-b6fe-8ea31f4e00a7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:45:35.196736 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:45:35.199159 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-17ee698a-4721-4a62-858c-cd124c188ef8 tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:45:35.199652 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-17ee698a-4721-4a62-858c-cd124c188ef8 tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:45:35.200099 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-17ee698a-4721-4a62-858c-cd124c188ef8 tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:45:35.200868 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-17ee698a-4721-4a62-858c-cd124c188ef8 tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:45:35.201250 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-17ee698a-4721-4a62-858c-cd124c188ef8 tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:45:35.202317 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-17ee698a-4721-4a62-858c-cd124c188ef8 tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:45:35.304808 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-17ee698a-4721-4a62-858c-cd124c188ef8 tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513576a6579d4b4bac9919190a9ca39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdb0e0207e84c42b6ce356431009f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:45:35.314657 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-17ee698a-4721-4a62-858c-cd124c188ef8 tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '513576a6579d4b4bac9919190a9ca39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdb0e0207e84c42b6ce356431009f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:45:35.316690 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-17ee698a-4721-4a62-858c-cd124c188ef8 tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '513576a6579d4b4bac9919190a9ca39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdb0e0207e84c42b6ce356431009f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:45:35.318358 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-17ee698a-4721-4a62-858c-cd124c188ef8 tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] 10.222.0.52 "GET /compute/v2.1/servers/18f9dc3c-d566-4a07-b6fe-8ea31f4e00a7" status: 200 len: 1366 microversion: 2.47 time: 0.159745 Oct 19 03:45:35.319537 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2961/5992] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:45:35 2022] GET /compute/v2.1/servers/18f9dc3c-d566-4a07-b6fe-8ea31f4e00a7 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:45:36.346694 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-912e00a0-0b59-4fc5-9b04-6c9ac821d04f tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:45:36.348288 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-912e00a0-0b59-4fc5-9b04-6c9ac821d04f tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] [instance: 18f9dc3c-d566-4a07-b6fe-8ea31f4e00a7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:45:36.352002 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:45:36.373960 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-912e00a0-0b59-4fc5-9b04-6c9ac821d04f tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:45:36.376075 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-912e00a0-0b59-4fc5-9b04-6c9ac821d04f tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:45:36.378414 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-912e00a0-0b59-4fc5-9b04-6c9ac821d04f tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:45:36.380249 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-912e00a0-0b59-4fc5-9b04-6c9ac821d04f tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:45:36.381919 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-912e00a0-0b59-4fc5-9b04-6c9ac821d04f tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:45:36.388430 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-912e00a0-0b59-4fc5-9b04-6c9ac821d04f tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:45:36.689248 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-912e00a0-0b59-4fc5-9b04-6c9ac821d04f tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513576a6579d4b4bac9919190a9ca39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdb0e0207e84c42b6ce356431009f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:45:36.703492 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-912e00a0-0b59-4fc5-9b04-6c9ac821d04f tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '513576a6579d4b4bac9919190a9ca39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdb0e0207e84c42b6ce356431009f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:45:36.705756 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-912e00a0-0b59-4fc5-9b04-6c9ac821d04f tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '513576a6579d4b4bac9919190a9ca39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdb0e0207e84c42b6ce356431009f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:45:36.707119 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-912e00a0-0b59-4fc5-9b04-6c9ac821d04f tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] 10.222.0.52 "GET /compute/v2.1/servers/18f9dc3c-d566-4a07-b6fe-8ea31f4e00a7" status: 200 len: 1366 microversion: 2.47 time: 0.365161 Oct 19 03:45:36.722458 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3032/5993] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:45:36 2022] GET /compute/v2.1/servers/18f9dc3c-d566-4a07-b6fe-8ea31f4e00a7 => generated 1366 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:45:37.739537 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e6dbd8f8-d52f-4c86-91cd-6e755e7d230b tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:45:37.739537 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e6dbd8f8-d52f-4c86-91cd-6e755e7d230b tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] [instance: 18f9dc3c-d566-4a07-b6fe-8ea31f4e00a7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:45:37.759303 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=8 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:45:37.768124 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e6dbd8f8-d52f-4c86-91cd-6e755e7d230b tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:45:37.768822 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e6dbd8f8-d52f-4c86-91cd-6e755e7d230b tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:45:37.774856 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e6dbd8f8-d52f-4c86-91cd-6e755e7d230b tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:45:37.774856 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e6dbd8f8-d52f-4c86-91cd-6e755e7d230b tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:45:37.777223 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e6dbd8f8-d52f-4c86-91cd-6e755e7d230b tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:45:37.777884 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e6dbd8f8-d52f-4c86-91cd-6e755e7d230b tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:45:37.994180 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e6dbd8f8-d52f-4c86-91cd-6e755e7d230b tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513576a6579d4b4bac9919190a9ca39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdb0e0207e84c42b6ce356431009f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:45:38.011363 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e6dbd8f8-d52f-4c86-91cd-6e755e7d230b tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '513576a6579d4b4bac9919190a9ca39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdb0e0207e84c42b6ce356431009f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:45:38.026214 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e6dbd8f8-d52f-4c86-91cd-6e755e7d230b tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '513576a6579d4b4bac9919190a9ca39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdb0e0207e84c42b6ce356431009f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:45:38.027865 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e6dbd8f8-d52f-4c86-91cd-6e755e7d230b tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] 10.222.0.52 "GET /compute/v2.1/servers/18f9dc3c-d566-4a07-b6fe-8ea31f4e00a7" status: 200 len: 1366 microversion: 2.47 time: 0.294171 Oct 19 03:45:38.028940 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2962/5994] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:45:37 2022] GET /compute/v2.1/servers/18f9dc3c-d566-4a07-b6fe-8ea31f4e00a7 => generated 1366 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:45:39.063965 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5db31f93-35ba-45c8-b159-1e5305a35c20 tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:45:39.064756 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-5db31f93-35ba-45c8-b159-1e5305a35c20 tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] [instance: 18f9dc3c-d566-4a07-b6fe-8ea31f4e00a7] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:45:39.067887 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:45:39.090314 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5db31f93-35ba-45c8-b159-1e5305a35c20 tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:45:39.091496 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5db31f93-35ba-45c8-b159-1e5305a35c20 tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:45:39.092416 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5db31f93-35ba-45c8-b159-1e5305a35c20 tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:45:39.093560 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5db31f93-35ba-45c8-b159-1e5305a35c20 tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:45:39.094267 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5db31f93-35ba-45c8-b159-1e5305a35c20 tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:45:39.095552 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5db31f93-35ba-45c8-b159-1e5305a35c20 tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:45:39.156277 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5db31f93-35ba-45c8-b159-1e5305a35c20 tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:45:39.157341 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5db31f93-35ba-45c8-b159-1e5305a35c20 tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:45:39.158190 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5db31f93-35ba-45c8-b159-1e5305a35c20 tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:45:39.159787 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-5db31f93-35ba-45c8-b159-1e5305a35c20 tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Lazy-loading 'fault' on Instance uuid 18f9dc3c-d566-4a07-b6fe-8ea31f4e00a7 {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:45:39.249109 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-5db31f93-35ba-45c8-b159-1e5305a35c20 tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513576a6579d4b4bac9919190a9ca39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdb0e0207e84c42b6ce356431009f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:45:39.281177 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-5db31f93-35ba-45c8-b159-1e5305a35c20 tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '513576a6579d4b4bac9919190a9ca39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdb0e0207e84c42b6ce356431009f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:45:39.289047 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-5db31f93-35ba-45c8-b159-1e5305a35c20 tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '513576a6579d4b4bac9919190a9ca39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdb0e0207e84c42b6ce356431009f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:45:39.291165 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5db31f93-35ba-45c8-b159-1e5305a35c20 tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] 10.222.0.52 "GET /compute/v2.1/servers/18f9dc3c-d566-4a07-b6fe-8ea31f4e00a7" status: 200 len: 1371 microversion: 2.47 time: 0.232482 Oct 19 03:45:39.311240 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3033/5995] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:45:39 2022] GET /compute/v2.1/servers/18f9dc3c-d566-4a07-b6fe-8ea31f4e00a7 => generated 1371 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:45:40.327076 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f653f93e-1ddb-489f-9d19-8f6d33011d59 tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:45:40.327703 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f653f93e-1ddb-489f-9d19-8f6d33011d59 tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] [instance: 18f9dc3c-d566-4a07-b6fe-8ea31f4e00a7] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:45:40.339996 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:45:40.350189 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f653f93e-1ddb-489f-9d19-8f6d33011d59 tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:45:40.350709 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f653f93e-1ddb-489f-9d19-8f6d33011d59 tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:45:40.352507 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f653f93e-1ddb-489f-9d19-8f6d33011d59 tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:45:40.353267 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f653f93e-1ddb-489f-9d19-8f6d33011d59 tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:45:40.353756 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f653f93e-1ddb-489f-9d19-8f6d33011d59 tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:45:40.354193 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f653f93e-1ddb-489f-9d19-8f6d33011d59 tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:45:40.408124 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-f653f93e-1ddb-489f-9d19-8f6d33011d59 tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] HTTP exception thrown: Instance 18f9dc3c-d566-4a07-b6fe-8ea31f4e00a7 could not be found. Oct 19 03:45:40.410499 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f653f93e-1ddb-489f-9d19-8f6d33011d59 tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Request method failure captured: Oct 19 03:45:40.410499 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/18f9dc3c-d566-4a07-b6fe-8ea31f4e00a7 HTTP/1.1 Oct 19 03:45:40.410499 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:45:40.410499 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:45:40.410499 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:45:40.410499 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:45:40.410499 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:45:40.410499 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:45:40.410499 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:45:40.410499 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:45:40.410499 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3LToaN8gG9A45FS4brPI7AfCRa3a4-jLJ1L7W4weWoi6sBsRSjdnNRSCUv8GveoLDxy56Koxg8iy0Nqmcs-ohYtTXhRaXJKk0tCu_PEHFP9UyFbeDsR9LYVtYjvjfXa1QX1LW8Hp5iUte6DuAmWbkXoNZjECaTd8GyY1mftXMVevwU Oct 19 03:45:40.410499 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:45:40.410499 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:45:40.410499 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:45:40.410499 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:45:40.410499 n-d-861333-8 devstack@n-api.service[121134]: X-Openstack-Nova-Api-Version: 2.47 Oct 19 03:45:40.410499 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:45:40.410499 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:45:40.410499 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 6bdb0e0207e84c42b6ce356431009f70 Oct 19 03:45:40.410499 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ServersAaction247Test-1011030382 Oct 19 03:45:40.410499 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:45:40.410499 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:45:40.410499 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6bdb0e0207e84c42b6ce356431009f70"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6bdb0e0207e84c42b6ce356431009f70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6bdb0e0207e84c42b6ce356431009f70"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6bdb0e0207e84c42b6ce356431009f70", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:45:40.410499 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ServersAaction247Test-1011030382 Oct 19 03:45:40.410499 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 6bdb0e0207e84c42b6ce356431009f70 Oct 19 03:45:40.410499 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ServersAaction247Test-1011030382 Oct 19 03:45:40.410499 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ServersAaction247Test-1011030382-project Oct 19 03:45:40.410499 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:45:40.410499 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:45:40.410499 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 513576a6579d4b4bac9919190a9ca39f Oct 19 03:45:40.410499 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ServersAaction247Test-1011030382-project Oct 19 03:45:40.410499 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:45:40.410499 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance 18f9dc3c-d566-4a07-b6fe-8ea31f4e00a7 could not be found. Oct 19 03:45:40.410499 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '18f9dc3c-d566-4a07-b6fe-8ea31f4e00a7'} Oct 19 03:45:40.410499 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:45:40.410499 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:45:40.410499 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:45:40.410499 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:45:40.410499 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:45:40.410499 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:45:40.410499 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:45:40.410499 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:45:40.410499 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:45:40.410499 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:45:40.410499 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18f9dc3c-d566-4a07-b6fe-8ea31f4e00a7 could not be found. Oct 19 03:45:40.410499 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:45:40.410499 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:45:40.410499 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:45:40.410499 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:45:40.410499 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:45:40.410499 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:45:40.410499 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:45:40.410499 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:45:40.410499 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:45:40.410499 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:45:40.410499 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:45:40.410499 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:45:40.410499 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:45:40.410499 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:45:40.410499 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:45:40.410499 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:45:40.410499 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18f9dc3c-d566-4a07-b6fe-8ea31f4e00a7 could not be found. Oct 19 03:45:40.410499 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:45:40.410499 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:45:40.416224 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:45:40.416224 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:45:40.416224 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:45:40.416224 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:45:40.416224 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:45:40.416224 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:45:40.416224 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18f9dc3c-d566-4a07-b6fe-8ea31f4e00a7 could not be found. Oct 19 03:45:40.416224 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:45:40.418300 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f653f93e-1ddb-489f-9d19-8f6d33011d59 tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] Returning 404 to user: Instance 18f9dc3c-d566-4a07-b6fe-8ea31f4e00a7 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:45:40.419490 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f653f93e-1ddb-489f-9d19-8f6d33011d59 tempest-ServersAaction247Test-1011030382 tempest-ServersAaction247Test-1011030382-project] 10.222.0.52 "GET /compute/v2.1/servers/18f9dc3c-d566-4a07-b6fe-8ea31f4e00a7" status: 404 len: 111 microversion: 2.47 time: 0.097200 Oct 19 03:45:40.421625 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2963/5996] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:45:40 2022] GET /compute/v2.1/servers/18f9dc3c-d566-4a07-b6fe-8ea31f4e00a7 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 19 03:45:44.391578 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-11355d97-7e79-4126-a152-9c5468c75ec7 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-1761963539", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "networks": "none"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:45:44.481935 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-11355d97-7e79-4126-a152-9c5468c75ec7 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Flavor limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:45:44.486035 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-11355d97-7e79-4126-a152-9c5468c75ec7 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Image limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:45:44.486745 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-11355d97-7e79-4126-a152-9c5468c75ec7 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Flavor pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:45:44.487180 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-11355d97-7e79-4126-a152-9c5468c75ec7 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Image pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:45:44.487609 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-11355d97-7e79-4126-a152-9c5468c75ec7 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:45:44.499748 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-11355d97-7e79-4126-a152-9c5468c75ec7 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:45:44.500170 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-11355d97-7e79-4126-a152-9c5468c75ec7 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:45:44.500635 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-11355d97-7e79-4126-a152-9c5468c75ec7 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:45:44.501425 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-11355d97-7e79-4126-a152-9c5468c75ec7 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:45:44.502454 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-11355d97-7e79-4126-a152-9c5468c75ec7 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:45:44.503059 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-11355d97-7e79-4126-a152-9c5468c75ec7 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:45:44.512304 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:45:44.525292 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-11355d97-7e79-4126-a152-9c5468c75ec7 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Getting quotas for project 04af56ffeb4c4c4c8672c66e2f6c9d46. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:45:44.531155 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-11355d97-7e79-4126-a152-9c5468c75ec7 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Getting quotas for user 07259157650043f09c677af878a52e69 and project 04af56ffeb4c4c4c8672c66e2f6c9d46. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:45:44.571169 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-11355d97-7e79-4126-a152-9c5468c75ec7 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Going to run 1 instances... {{(pid=121135) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:45:44.574369 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-11355d97-7e79-4126-a152-9c5468c75ec7 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] [instance: 1e03aef5-c628-4472-adc9-16ad1c768364] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121135) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:45:44.729222 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-11355d97-7e79-4126-a152-9c5468c75ec7 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.526618 Oct 19 03:45:44.730565 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3034/5997] 10.222.0.52 () {62 vars in 1188 bytes} [Wed Oct 19 03:45:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 529 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 19 03:45:44.759761 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6b297a57-3fb3-4ae6-b7fb-52eaccdf2011 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:45:44.761075 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6b297a57-3fb3-4ae6-b7fb-52eaccdf2011 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] [instance: 1e03aef5-c628-4472-adc9-16ad1c768364] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:45:44.956093 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-6b297a57-3fb3-4ae6-b7fb-52eaccdf2011 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07259157650043f09c677af878a52e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af56ffeb4c4c4c8672c66e2f6c9d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:45:44.975379 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-6b297a57-3fb3-4ae6-b7fb-52eaccdf2011 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07259157650043f09c677af878a52e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af56ffeb4c4c4c8672c66e2f6c9d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:45:44.981143 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-6b297a57-3fb3-4ae6-b7fb-52eaccdf2011 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07259157650043f09c677af878a52e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af56ffeb4c4c4c8672c66e2f6c9d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:45:44.984785 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6b297a57-3fb3-4ae6-b7fb-52eaccdf2011 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] 10.222.0.52 "GET /compute/v2.1/servers/1e03aef5-c628-4472-adc9-16ad1c768364" status: 200 len: 1278 microversion: 2.57 time: 0.239228 Oct 19 03:45:44.988002 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2964/5998] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:45:44 2022] GET /compute/v2.1/servers/1e03aef5-c628-4472-adc9-16ad1c768364 => generated 1278 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:45:46.020291 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-8c40924f-779f-45ff-93ec-76e479ab55e0 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:45:46.022514 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-8c40924f-779f-45ff-93ec-76e479ab55e0 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] [instance: 1e03aef5-c628-4472-adc9-16ad1c768364] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:45:46.226340 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-8c40924f-779f-45ff-93ec-76e479ab55e0 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07259157650043f09c677af878a52e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af56ffeb4c4c4c8672c66e2f6c9d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:45:46.249963 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-8c40924f-779f-45ff-93ec-76e479ab55e0 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07259157650043f09c677af878a52e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af56ffeb4c4c4c8672c66e2f6c9d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:45:46.252947 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-8c40924f-779f-45ff-93ec-76e479ab55e0 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07259157650043f09c677af878a52e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af56ffeb4c4c4c8672c66e2f6c9d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:45:46.257016 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-8c40924f-779f-45ff-93ec-76e479ab55e0 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] 10.222.0.52 "GET /compute/v2.1/servers/1e03aef5-c628-4472-adc9-16ad1c768364" status: 200 len: 1278 microversion: 2.57 time: 0.244180 Oct 19 03:45:46.257016 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3035/5999] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:45:46 2022] GET /compute/v2.1/servers/1e03aef5-c628-4472-adc9-16ad1c768364 => generated 1278 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:45:47.301688 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9c39c2a4-92ac-4761-b6ac-7f66d688c82b tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:45:47.302323 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9c39c2a4-92ac-4761-b6ac-7f66d688c82b tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] [instance: 1e03aef5-c628-4472-adc9-16ad1c768364] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:45:47.320442 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9c39c2a4-92ac-4761-b6ac-7f66d688c82b tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:45:47.335824 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9c39c2a4-92ac-4761-b6ac-7f66d688c82b tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:45:47.335824 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9c39c2a4-92ac-4761-b6ac-7f66d688c82b tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:45:47.335824 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9c39c2a4-92ac-4761-b6ac-7f66d688c82b tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:45:47.337281 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9c39c2a4-92ac-4761-b6ac-7f66d688c82b tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:45:47.337772 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9c39c2a4-92ac-4761-b6ac-7f66d688c82b tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:45:47.574278 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9c39c2a4-92ac-4761-b6ac-7f66d688c82b tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07259157650043f09c677af878a52e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af56ffeb4c4c4c8672c66e2f6c9d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:45:47.591734 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9c39c2a4-92ac-4761-b6ac-7f66d688c82b tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07259157650043f09c677af878a52e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af56ffeb4c4c4c8672c66e2f6c9d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:45:47.593193 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9c39c2a4-92ac-4761-b6ac-7f66d688c82b tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07259157650043f09c677af878a52e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af56ffeb4c4c4c8672c66e2f6c9d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:45:47.599745 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9c39c2a4-92ac-4761-b6ac-7f66d688c82b tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] 10.222.0.52 "GET /compute/v2.1/servers/1e03aef5-c628-4472-adc9-16ad1c768364" status: 200 len: 1274 microversion: 2.57 time: 0.299109 Oct 19 03:45:47.610125 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2965/6000] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:45:47 2022] GET /compute/v2.1/servers/1e03aef5-c628-4472-adc9-16ad1c768364 => generated 1274 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:45:48.622104 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b6f602c5-12e8-4bb9-9e0e-eccbd96736d9 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:45:48.623377 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b6f602c5-12e8-4bb9-9e0e-eccbd96736d9 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] [instance: 1e03aef5-c628-4472-adc9-16ad1c768364] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:45:48.645991 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b6f602c5-12e8-4bb9-9e0e-eccbd96736d9 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:45:48.647519 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b6f602c5-12e8-4bb9-9e0e-eccbd96736d9 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:45:48.669227 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b6f602c5-12e8-4bb9-9e0e-eccbd96736d9 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:45:48.670902 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b6f602c5-12e8-4bb9-9e0e-eccbd96736d9 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:45:48.672437 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b6f602c5-12e8-4bb9-9e0e-eccbd96736d9 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:45:48.673343 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b6f602c5-12e8-4bb9-9e0e-eccbd96736d9 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:45:49.296802 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b6f602c5-12e8-4bb9-9e0e-eccbd96736d9 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07259157650043f09c677af878a52e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af56ffeb4c4c4c8672c66e2f6c9d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:45:49.330085 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b6f602c5-12e8-4bb9-9e0e-eccbd96736d9 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07259157650043f09c677af878a52e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af56ffeb4c4c4c8672c66e2f6c9d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:45:49.331206 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b6f602c5-12e8-4bb9-9e0e-eccbd96736d9 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07259157650043f09c677af878a52e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af56ffeb4c4c4c8672c66e2f6c9d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:45:49.332417 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b6f602c5-12e8-4bb9-9e0e-eccbd96736d9 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] 10.222.0.52 "GET /compute/v2.1/servers/1e03aef5-c628-4472-adc9-16ad1c768364" status: 200 len: 1330 microversion: 2.57 time: 0.714372 Oct 19 03:45:49.332993 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3036/6001] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:45:48 2022] GET /compute/v2.1/servers/1e03aef5-c628-4472-adc9-16ad1c768364 => generated 1330 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:45:50.362109 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0c72675c-6714-4a8f-8307-7bca9991ee8b tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:45:50.363775 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0c72675c-6714-4a8f-8307-7bca9991ee8b tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] [instance: 1e03aef5-c628-4472-adc9-16ad1c768364] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:45:50.379900 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0c72675c-6714-4a8f-8307-7bca9991ee8b tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:45:50.380676 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0c72675c-6714-4a8f-8307-7bca9991ee8b tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:45:50.381447 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0c72675c-6714-4a8f-8307-7bca9991ee8b tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:45:50.382345 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0c72675c-6714-4a8f-8307-7bca9991ee8b tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:45:50.406813 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0c72675c-6714-4a8f-8307-7bca9991ee8b tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:45:50.407510 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0c72675c-6714-4a8f-8307-7bca9991ee8b tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:45:50.571420 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0c72675c-6714-4a8f-8307-7bca9991ee8b tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07259157650043f09c677af878a52e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af56ffeb4c4c4c8672c66e2f6c9d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:45:50.583390 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0c72675c-6714-4a8f-8307-7bca9991ee8b tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07259157650043f09c677af878a52e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af56ffeb4c4c4c8672c66e2f6c9d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:45:50.591321 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0c72675c-6714-4a8f-8307-7bca9991ee8b tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07259157650043f09c677af878a52e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af56ffeb4c4c4c8672c66e2f6c9d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:45:50.592885 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0c72675c-6714-4a8f-8307-7bca9991ee8b tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] 10.222.0.52 "GET /compute/v2.1/servers/1e03aef5-c628-4472-adc9-16ad1c768364" status: 200 len: 1336 microversion: 2.57 time: 0.234697 Oct 19 03:45:50.596539 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2966/6002] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:45:50 2022] GET /compute/v2.1/servers/1e03aef5-c628-4472-adc9-16ad1c768364 => generated 1336 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:45:51.630119 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4c72bbed-f468-4d65-ad8d-bca789dd73e0 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:45:51.631549 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4c72bbed-f468-4d65-ad8d-bca789dd73e0 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] [instance: 1e03aef5-c628-4472-adc9-16ad1c768364] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:45:51.639933 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4c72bbed-f468-4d65-ad8d-bca789dd73e0 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:45:51.640468 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4c72bbed-f468-4d65-ad8d-bca789dd73e0 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:45:51.641165 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4c72bbed-f468-4d65-ad8d-bca789dd73e0 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:45:51.642137 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4c72bbed-f468-4d65-ad8d-bca789dd73e0 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:45:51.642777 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4c72bbed-f468-4d65-ad8d-bca789dd73e0 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:45:51.643527 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4c72bbed-f468-4d65-ad8d-bca789dd73e0 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:45:51.815595 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4c72bbed-f468-4d65-ad8d-bca789dd73e0 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07259157650043f09c677af878a52e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af56ffeb4c4c4c8672c66e2f6c9d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:45:51.894589 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4c72bbed-f468-4d65-ad8d-bca789dd73e0 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07259157650043f09c677af878a52e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af56ffeb4c4c4c8672c66e2f6c9d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:45:51.903337 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4c72bbed-f468-4d65-ad8d-bca789dd73e0 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07259157650043f09c677af878a52e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af56ffeb4c4c4c8672c66e2f6c9d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:45:51.910995 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4c72bbed-f468-4d65-ad8d-bca789dd73e0 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] 10.222.0.52 "GET /compute/v2.1/servers/1e03aef5-c628-4472-adc9-16ad1c768364" status: 200 len: 1336 microversion: 2.57 time: 0.284711 Oct 19 03:45:51.912589 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3037/6003] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:45:51 2022] GET /compute/v2.1/servers/1e03aef5-c628-4472-adc9-16ad1c768364 => generated 1336 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:45:52.943461 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f9dd7738-aa97-4cb7-aea9-fdc2fd10700c tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:45:52.944781 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f9dd7738-aa97-4cb7-aea9-fdc2fd10700c tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] [instance: 1e03aef5-c628-4472-adc9-16ad1c768364] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:45:52.960503 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f9dd7738-aa97-4cb7-aea9-fdc2fd10700c tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:45:52.962925 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f9dd7738-aa97-4cb7-aea9-fdc2fd10700c tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:45:52.964264 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f9dd7738-aa97-4cb7-aea9-fdc2fd10700c tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:45:52.969783 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f9dd7738-aa97-4cb7-aea9-fdc2fd10700c tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:45:52.969783 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f9dd7738-aa97-4cb7-aea9-fdc2fd10700c tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:45:52.969783 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f9dd7738-aa97-4cb7-aea9-fdc2fd10700c tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:45:53.066033 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-f9dd7738-aa97-4cb7-aea9-fdc2fd10700c tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07259157650043f09c677af878a52e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af56ffeb4c4c4c8672c66e2f6c9d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:45:53.078670 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-f9dd7738-aa97-4cb7-aea9-fdc2fd10700c tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07259157650043f09c677af878a52e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af56ffeb4c4c4c8672c66e2f6c9d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:45:53.085660 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-f9dd7738-aa97-4cb7-aea9-fdc2fd10700c tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07259157650043f09c677af878a52e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af56ffeb4c4c4c8672c66e2f6c9d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:45:53.085660 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f9dd7738-aa97-4cb7-aea9-fdc2fd10700c tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] 10.222.0.52 "GET /compute/v2.1/servers/1e03aef5-c628-4472-adc9-16ad1c768364" status: 200 len: 1336 microversion: 2.57 time: 0.143051 Oct 19 03:45:53.085660 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2967/6004] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:45:52 2022] GET /compute/v2.1/servers/1e03aef5-c628-4472-adc9-16ad1c768364 => generated 1336 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:45:54.108031 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-96c8e634-16cc-4966-a31a-07707d7b6d0e tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:45:54.108947 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-96c8e634-16cc-4966-a31a-07707d7b6d0e tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] [instance: 1e03aef5-c628-4472-adc9-16ad1c768364] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:45:54.120832 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-96c8e634-16cc-4966-a31a-07707d7b6d0e tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:45:54.124001 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-96c8e634-16cc-4966-a31a-07707d7b6d0e tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:45:54.126145 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-96c8e634-16cc-4966-a31a-07707d7b6d0e tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:45:54.126145 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-96c8e634-16cc-4966-a31a-07707d7b6d0e tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:45:54.126145 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-96c8e634-16cc-4966-a31a-07707d7b6d0e tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:45:54.134108 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-96c8e634-16cc-4966-a31a-07707d7b6d0e tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:45:54.256452 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-96c8e634-16cc-4966-a31a-07707d7b6d0e tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07259157650043f09c677af878a52e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af56ffeb4c4c4c8672c66e2f6c9d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:45:54.266757 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-96c8e634-16cc-4966-a31a-07707d7b6d0e tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07259157650043f09c677af878a52e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af56ffeb4c4c4c8672c66e2f6c9d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:45:54.268230 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-96c8e634-16cc-4966-a31a-07707d7b6d0e tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07259157650043f09c677af878a52e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af56ffeb4c4c4c8672c66e2f6c9d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:45:54.274530 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-96c8e634-16cc-4966-a31a-07707d7b6d0e tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] 10.222.0.52 "GET /compute/v2.1/servers/1e03aef5-c628-4472-adc9-16ad1c768364" status: 200 len: 1357 microversion: 2.57 time: 0.171390 Oct 19 03:45:54.275128 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3038/6005] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:45:54 2022] GET /compute/v2.1/servers/1e03aef5-c628-4472-adc9-16ad1c768364 => generated 1357 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:45:54.409349 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a6e9d190-5722-4a5b-ad81-e85584274b83 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:45:54.412741 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a6e9d190-5722-4a5b-ad81-e85584274b83 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] [instance: 1e03aef5-c628-4472-adc9-16ad1c768364] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:45:54.440951 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a6e9d190-5722-4a5b-ad81-e85584274b83 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:45:54.441403 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a6e9d190-5722-4a5b-ad81-e85584274b83 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:45:54.463062 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a6e9d190-5722-4a5b-ad81-e85584274b83 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:45:54.471496 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a6e9d190-5722-4a5b-ad81-e85584274b83 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:45:54.472276 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a6e9d190-5722-4a5b-ad81-e85584274b83 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:45:54.473141 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a6e9d190-5722-4a5b-ad81-e85584274b83 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:45:54.487744 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:45:54.700050 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-a6e9d190-5722-4a5b-ad81-e85584274b83 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Flavor limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:45:54.700528 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-a6e9d190-5722-4a5b-ad81-e85584274b83 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Image limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:45:54.701022 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-a6e9d190-5722-4a5b-ad81-e85584274b83 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Flavor pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:45:54.706666 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-a6e9d190-5722-4a5b-ad81-e85584274b83 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Image pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:45:54.707352 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-a6e9d190-5722-4a5b-ad81-e85584274b83 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:45:54.974550 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:45:55.092721 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a6e9d190-5722-4a5b-ad81-e85584274b83 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] [instance: 1e03aef5-c628-4472-adc9-16ad1c768364] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:45:55.121506 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a6e9d190-5722-4a5b-ad81-e85584274b83 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:45:55.136266 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a6e9d190-5722-4a5b-ad81-e85584274b83 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:45:55.137104 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a6e9d190-5722-4a5b-ad81-e85584274b83 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:45:55.140831 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a6e9d190-5722-4a5b-ad81-e85584274b83 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:45:55.141876 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a6e9d190-5722-4a5b-ad81-e85584274b83 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:45:55.143812 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a6e9d190-5722-4a5b-ad81-e85584274b83 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:45:55.233080 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a6e9d190-5722-4a5b-ad81-e85584274b83 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] 10.222.0.52 "POST /compute/v2.1/servers/1e03aef5-c628-4472-adc9-16ad1c768364/action" status: 202 len: 1138 microversion: 2.57 time: 0.823900 Oct 19 03:45:55.233080 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2968/6006] 10.222.0.52 () {62 vars in 1320 bytes} [Wed Oct 19 03:45:54 2022] POST /compute/v2.1/servers/1e03aef5-c628-4472-adc9-16ad1c768364/action => generated 1138 bytes in 828 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 19 03:45:55.256278 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-01b010e2-1ac6-43da-9caf-38d63167bb70 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:45:55.257604 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-01b010e2-1ac6-43da-9caf-38d63167bb70 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] [instance: 1e03aef5-c628-4472-adc9-16ad1c768364] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:45:55.260943 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:45:55.275285 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-01b010e2-1ac6-43da-9caf-38d63167bb70 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:45:55.279395 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-01b010e2-1ac6-43da-9caf-38d63167bb70 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:45:55.283184 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-01b010e2-1ac6-43da-9caf-38d63167bb70 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:45:55.284432 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-01b010e2-1ac6-43da-9caf-38d63167bb70 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:45:55.285638 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-01b010e2-1ac6-43da-9caf-38d63167bb70 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:45:55.287832 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-01b010e2-1ac6-43da-9caf-38d63167bb70 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:45:55.459938 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-01b010e2-1ac6-43da-9caf-38d63167bb70 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07259157650043f09c677af878a52e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af56ffeb4c4c4c8672c66e2f6c9d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:45:55.477785 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-01b010e2-1ac6-43da-9caf-38d63167bb70 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07259157650043f09c677af878a52e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af56ffeb4c4c4c8672c66e2f6c9d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:45:55.480958 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-01b010e2-1ac6-43da-9caf-38d63167bb70 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07259157650043f09c677af878a52e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af56ffeb4c4c4c8672c66e2f6c9d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:45:55.488199 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-01b010e2-1ac6-43da-9caf-38d63167bb70 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] 10.222.0.52 "GET /compute/v2.1/servers/1e03aef5-c628-4472-adc9-16ad1c768364" status: 200 len: 1366 microversion: 2.57 time: 0.236440 Oct 19 03:45:55.505427 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3039/6007] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:45:55 2022] GET /compute/v2.1/servers/1e03aef5-c628-4472-adc9-16ad1c768364 => generated 1366 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:45:56.518297 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a131928e-0ea2-4f9f-8bf1-badc2847ffaa tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:45:56.518826 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a131928e-0ea2-4f9f-8bf1-badc2847ffaa tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] [instance: 1e03aef5-c628-4472-adc9-16ad1c768364] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:45:56.543789 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a131928e-0ea2-4f9f-8bf1-badc2847ffaa tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:45:56.552001 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a131928e-0ea2-4f9f-8bf1-badc2847ffaa tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:45:56.552587 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a131928e-0ea2-4f9f-8bf1-badc2847ffaa tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:45:56.554333 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a131928e-0ea2-4f9f-8bf1-badc2847ffaa tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:45:56.555353 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a131928e-0ea2-4f9f-8bf1-badc2847ffaa tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:45:56.556185 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a131928e-0ea2-4f9f-8bf1-badc2847ffaa tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:45:56.812149 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a131928e-0ea2-4f9f-8bf1-badc2847ffaa tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07259157650043f09c677af878a52e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af56ffeb4c4c4c8672c66e2f6c9d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:45:56.812149 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a131928e-0ea2-4f9f-8bf1-badc2847ffaa tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07259157650043f09c677af878a52e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af56ffeb4c4c4c8672c66e2f6c9d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:45:56.812149 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a131928e-0ea2-4f9f-8bf1-badc2847ffaa tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07259157650043f09c677af878a52e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af56ffeb4c4c4c8672c66e2f6c9d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:45:56.812149 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a131928e-0ea2-4f9f-8bf1-badc2847ffaa tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] 10.222.0.52 "GET /compute/v2.1/servers/1e03aef5-c628-4472-adc9-16ad1c768364" status: 200 len: 1366 microversion: 2.57 time: 0.228366 Oct 19 03:45:56.812149 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2969/6008] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:45:56 2022] GET /compute/v2.1/servers/1e03aef5-c628-4472-adc9-16ad1c768364 => generated 1366 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:45:57.839005 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4ff560af-389c-4e07-bd2c-74ad76780cba tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:45:57.839701 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4ff560af-389c-4e07-bd2c-74ad76780cba tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] [instance: 1e03aef5-c628-4472-adc9-16ad1c768364] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:45:57.855704 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=8 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:45:57.861759 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4ff560af-389c-4e07-bd2c-74ad76780cba tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:45:57.862267 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4ff560af-389c-4e07-bd2c-74ad76780cba tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:45:57.862715 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4ff560af-389c-4e07-bd2c-74ad76780cba tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:45:57.865842 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4ff560af-389c-4e07-bd2c-74ad76780cba tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:45:57.868110 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4ff560af-389c-4e07-bd2c-74ad76780cba tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:45:57.868607 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4ff560af-389c-4e07-bd2c-74ad76780cba tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:45:58.113751 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4ff560af-389c-4e07-bd2c-74ad76780cba tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07259157650043f09c677af878a52e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af56ffeb4c4c4c8672c66e2f6c9d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:45:58.124227 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4ff560af-389c-4e07-bd2c-74ad76780cba tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07259157650043f09c677af878a52e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af56ffeb4c4c4c8672c66e2f6c9d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:45:58.126082 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4ff560af-389c-4e07-bd2c-74ad76780cba tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07259157650043f09c677af878a52e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af56ffeb4c4c4c8672c66e2f6c9d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:45:58.127830 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4ff560af-389c-4e07-bd2c-74ad76780cba tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] 10.222.0.52 "GET /compute/v2.1/servers/1e03aef5-c628-4472-adc9-16ad1c768364" status: 200 len: 1366 microversion: 2.57 time: 0.293336 Oct 19 03:45:58.128946 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3040/6009] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:45:57 2022] GET /compute/v2.1/servers/1e03aef5-c628-4472-adc9-16ad1c768364 => generated 1366 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:45:59.168190 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4a2ec5dc-7f0d-430e-99f9-222ed58f2945 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:45:59.169587 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4a2ec5dc-7f0d-430e-99f9-222ed58f2945 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] [instance: 1e03aef5-c628-4472-adc9-16ad1c768364] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:45:59.203114 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4a2ec5dc-7f0d-430e-99f9-222ed58f2945 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:45:59.203628 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4a2ec5dc-7f0d-430e-99f9-222ed58f2945 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:45:59.204332 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4a2ec5dc-7f0d-430e-99f9-222ed58f2945 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:45:59.204797 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4a2ec5dc-7f0d-430e-99f9-222ed58f2945 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:45:59.205257 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4a2ec5dc-7f0d-430e-99f9-222ed58f2945 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:45:59.217572 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4a2ec5dc-7f0d-430e-99f9-222ed58f2945 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:45:59.769492 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-4a2ec5dc-7f0d-430e-99f9-222ed58f2945 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07259157650043f09c677af878a52e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af56ffeb4c4c4c8672c66e2f6c9d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:45:59.784040 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-4a2ec5dc-7f0d-430e-99f9-222ed58f2945 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07259157650043f09c677af878a52e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af56ffeb4c4c4c8672c66e2f6c9d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:45:59.789472 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-4a2ec5dc-7f0d-430e-99f9-222ed58f2945 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07259157650043f09c677af878a52e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af56ffeb4c4c4c8672c66e2f6c9d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:45:59.789472 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4a2ec5dc-7f0d-430e-99f9-222ed58f2945 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] 10.222.0.52 "GET /compute/v2.1/servers/1e03aef5-c628-4472-adc9-16ad1c768364" status: 200 len: 1366 microversion: 2.57 time: 0.624677 Oct 19 03:45:59.789752 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2970/6010] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:45:59 2022] GET /compute/v2.1/servers/1e03aef5-c628-4472-adc9-16ad1c768364 => generated 1366 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:46:00.816555 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9e5b9bca-9bc5-4768-88e9-0105cdf07936 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:46:00.817180 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9e5b9bca-9bc5-4768-88e9-0105cdf07936 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] [instance: 1e03aef5-c628-4472-adc9-16ad1c768364] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:46:00.831313 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9e5b9bca-9bc5-4768-88e9-0105cdf07936 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:46:00.836641 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9e5b9bca-9bc5-4768-88e9-0105cdf07936 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:46:00.836641 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9e5b9bca-9bc5-4768-88e9-0105cdf07936 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:46:00.836641 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9e5b9bca-9bc5-4768-88e9-0105cdf07936 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:46:00.836641 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9e5b9bca-9bc5-4768-88e9-0105cdf07936 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:46:00.836641 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9e5b9bca-9bc5-4768-88e9-0105cdf07936 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:46:00.936605 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-9e5b9bca-9bc5-4768-88e9-0105cdf07936 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07259157650043f09c677af878a52e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af56ffeb4c4c4c8672c66e2f6c9d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:46:00.947285 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-9e5b9bca-9bc5-4768-88e9-0105cdf07936 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07259157650043f09c677af878a52e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af56ffeb4c4c4c8672c66e2f6c9d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:46:00.949842 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-9e5b9bca-9bc5-4768-88e9-0105cdf07936 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07259157650043f09c677af878a52e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af56ffeb4c4c4c8672c66e2f6c9d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:46:00.952489 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9e5b9bca-9bc5-4768-88e9-0105cdf07936 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] 10.222.0.52 "GET /compute/v2.1/servers/1e03aef5-c628-4472-adc9-16ad1c768364" status: 200 len: 1366 microversion: 2.57 time: 0.140118 Oct 19 03:46:00.956828 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3041/6011] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:46:00 2022] GET /compute/v2.1/servers/1e03aef5-c628-4472-adc9-16ad1c768364 => generated 1366 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:46:01.985647 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6fd75f19-efca-48e1-9a34-29420876aa94 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:46:01.986891 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6fd75f19-efca-48e1-9a34-29420876aa94 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] [instance: 1e03aef5-c628-4472-adc9-16ad1c768364] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:46:02.000834 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6fd75f19-efca-48e1-9a34-29420876aa94 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:46:02.001388 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6fd75f19-efca-48e1-9a34-29420876aa94 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:46:02.002089 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6fd75f19-efca-48e1-9a34-29420876aa94 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:46:02.002869 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6fd75f19-efca-48e1-9a34-29420876aa94 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:46:02.003346 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6fd75f19-efca-48e1-9a34-29420876aa94 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:46:02.003778 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6fd75f19-efca-48e1-9a34-29420876aa94 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:46:02.122840 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-6fd75f19-efca-48e1-9a34-29420876aa94 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07259157650043f09c677af878a52e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af56ffeb4c4c4c8672c66e2f6c9d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:46:02.133901 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-6fd75f19-efca-48e1-9a34-29420876aa94 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07259157650043f09c677af878a52e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af56ffeb4c4c4c8672c66e2f6c9d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:46:02.139843 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-6fd75f19-efca-48e1-9a34-29420876aa94 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07259157650043f09c677af878a52e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af56ffeb4c4c4c8672c66e2f6c9d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:46:02.141063 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6fd75f19-efca-48e1-9a34-29420876aa94 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] 10.222.0.52 "GET /compute/v2.1/servers/1e03aef5-c628-4472-adc9-16ad1c768364" status: 200 len: 1366 microversion: 2.57 time: 0.160369 Oct 19 03:46:02.157006 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2971/6012] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:46:01 2022] GET /compute/v2.1/servers/1e03aef5-c628-4472-adc9-16ad1c768364 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:46:03.170846 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-94f806ef-97fc-4a7e-8231-cf8d1b634815 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:46:03.171611 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-94f806ef-97fc-4a7e-8231-cf8d1b634815 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] [instance: 1e03aef5-c628-4472-adc9-16ad1c768364] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:46:03.179863 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-94f806ef-97fc-4a7e-8231-cf8d1b634815 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:46:03.181027 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-94f806ef-97fc-4a7e-8231-cf8d1b634815 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:46:03.181723 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-94f806ef-97fc-4a7e-8231-cf8d1b634815 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:46:03.182864 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-94f806ef-97fc-4a7e-8231-cf8d1b634815 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:46:03.187048 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-94f806ef-97fc-4a7e-8231-cf8d1b634815 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:46:03.187048 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-94f806ef-97fc-4a7e-8231-cf8d1b634815 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:46:03.362229 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-94f806ef-97fc-4a7e-8231-cf8d1b634815 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07259157650043f09c677af878a52e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af56ffeb4c4c4c8672c66e2f6c9d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:46:03.397200 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-94f806ef-97fc-4a7e-8231-cf8d1b634815 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07259157650043f09c677af878a52e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af56ffeb4c4c4c8672c66e2f6c9d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:46:03.400930 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-94f806ef-97fc-4a7e-8231-cf8d1b634815 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07259157650043f09c677af878a52e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af56ffeb4c4c4c8672c66e2f6c9d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:46:03.408333 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-94f806ef-97fc-4a7e-8231-cf8d1b634815 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] 10.222.0.52 "GET /compute/v2.1/servers/1e03aef5-c628-4472-adc9-16ad1c768364" status: 200 len: 1366 microversion: 2.57 time: 0.242837 Oct 19 03:46:03.408948 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3042/6013] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:46:03 2022] GET /compute/v2.1/servers/1e03aef5-c628-4472-adc9-16ad1c768364 => generated 1366 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:46:04.448191 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b12ee745-6973-4eb9-ac14-e4438c6398e9 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:46:04.454609 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b12ee745-6973-4eb9-ac14-e4438c6398e9 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] [instance: 1e03aef5-c628-4472-adc9-16ad1c768364] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:46:04.458614 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b12ee745-6973-4eb9-ac14-e4438c6398e9 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:46:04.459157 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b12ee745-6973-4eb9-ac14-e4438c6398e9 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:46:04.459561 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b12ee745-6973-4eb9-ac14-e4438c6398e9 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:46:04.460276 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b12ee745-6973-4eb9-ac14-e4438c6398e9 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:46:04.460732 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b12ee745-6973-4eb9-ac14-e4438c6398e9 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:46:04.465319 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b12ee745-6973-4eb9-ac14-e4438c6398e9 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:46:04.765567 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b12ee745-6973-4eb9-ac14-e4438c6398e9 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07259157650043f09c677af878a52e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af56ffeb4c4c4c8672c66e2f6c9d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:46:04.784123 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b12ee745-6973-4eb9-ac14-e4438c6398e9 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07259157650043f09c677af878a52e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af56ffeb4c4c4c8672c66e2f6c9d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:46:04.787704 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b12ee745-6973-4eb9-ac14-e4438c6398e9 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07259157650043f09c677af878a52e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af56ffeb4c4c4c8672c66e2f6c9d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:46:04.790975 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b12ee745-6973-4eb9-ac14-e4438c6398e9 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] 10.222.0.52 "GET /compute/v2.1/servers/1e03aef5-c628-4472-adc9-16ad1c768364" status: 200 len: 1366 microversion: 2.57 time: 0.346296 Oct 19 03:46:04.792570 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2972/6014] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:46:04 2022] GET /compute/v2.1/servers/1e03aef5-c628-4472-adc9-16ad1c768364 => generated 1366 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:46:05.820900 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ccd3a06d-a51c-4c0b-8de5-a106be9f1f5f tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:46:05.826231 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ccd3a06d-a51c-4c0b-8de5-a106be9f1f5f tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] [instance: 1e03aef5-c628-4472-adc9-16ad1c768364] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:46:05.838085 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ccd3a06d-a51c-4c0b-8de5-a106be9f1f5f tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:46:05.838733 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ccd3a06d-a51c-4c0b-8de5-a106be9f1f5f tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:46:05.839286 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ccd3a06d-a51c-4c0b-8de5-a106be9f1f5f tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:46:05.840166 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ccd3a06d-a51c-4c0b-8de5-a106be9f1f5f tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:46:05.840763 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ccd3a06d-a51c-4c0b-8de5-a106be9f1f5f tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:46:05.841307 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ccd3a06d-a51c-4c0b-8de5-a106be9f1f5f tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:46:05.937205 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ccd3a06d-a51c-4c0b-8de5-a106be9f1f5f tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07259157650043f09c677af878a52e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af56ffeb4c4c4c8672c66e2f6c9d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:46:05.946387 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ccd3a06d-a51c-4c0b-8de5-a106be9f1f5f tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07259157650043f09c677af878a52e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af56ffeb4c4c4c8672c66e2f6c9d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:46:05.957712 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ccd3a06d-a51c-4c0b-8de5-a106be9f1f5f tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07259157650043f09c677af878a52e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af56ffeb4c4c4c8672c66e2f6c9d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:46:05.959182 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ccd3a06d-a51c-4c0b-8de5-a106be9f1f5f tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] 10.222.0.52 "GET /compute/v2.1/servers/1e03aef5-c628-4472-adc9-16ad1c768364" status: 200 len: 1366 microversion: 2.57 time: 0.145283 Oct 19 03:46:05.973545 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3043/6015] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:46:05 2022] GET /compute/v2.1/servers/1e03aef5-c628-4472-adc9-16ad1c768364 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:46:06.997609 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-620cb181-808b-4997-8fca-8da9eca30683 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:46:06.998935 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-620cb181-808b-4997-8fca-8da9eca30683 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] [instance: 1e03aef5-c628-4472-adc9-16ad1c768364] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:46:07.007240 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-620cb181-808b-4997-8fca-8da9eca30683 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:46:07.008496 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-620cb181-808b-4997-8fca-8da9eca30683 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:46:07.010685 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-620cb181-808b-4997-8fca-8da9eca30683 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:46:07.011734 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-620cb181-808b-4997-8fca-8da9eca30683 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:46:07.012488 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-620cb181-808b-4997-8fca-8da9eca30683 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:46:07.013712 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-620cb181-808b-4997-8fca-8da9eca30683 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:46:07.130239 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-620cb181-808b-4997-8fca-8da9eca30683 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07259157650043f09c677af878a52e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af56ffeb4c4c4c8672c66e2f6c9d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:46:07.142696 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-620cb181-808b-4997-8fca-8da9eca30683 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07259157650043f09c677af878a52e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af56ffeb4c4c4c8672c66e2f6c9d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:46:07.144286 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-620cb181-808b-4997-8fca-8da9eca30683 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07259157650043f09c677af878a52e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af56ffeb4c4c4c8672c66e2f6c9d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:46:07.145561 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-620cb181-808b-4997-8fca-8da9eca30683 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] 10.222.0.52 "GET /compute/v2.1/servers/1e03aef5-c628-4472-adc9-16ad1c768364" status: 200 len: 1366 microversion: 2.57 time: 0.160909 Oct 19 03:46:07.161289 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2973/6016] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:46:06 2022] GET /compute/v2.1/servers/1e03aef5-c628-4472-adc9-16ad1c768364 => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:46:08.174931 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a97dcc8c-6438-4d66-8f7c-0f7ca96d6c6a tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:46:08.191207 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a97dcc8c-6438-4d66-8f7c-0f7ca96d6c6a tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] [instance: 1e03aef5-c628-4472-adc9-16ad1c768364] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:46:08.191811 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a97dcc8c-6438-4d66-8f7c-0f7ca96d6c6a tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:46:08.192586 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a97dcc8c-6438-4d66-8f7c-0f7ca96d6c6a tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:46:08.193099 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a97dcc8c-6438-4d66-8f7c-0f7ca96d6c6a tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:46:08.193928 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a97dcc8c-6438-4d66-8f7c-0f7ca96d6c6a tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:46:08.194785 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a97dcc8c-6438-4d66-8f7c-0f7ca96d6c6a tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:46:08.196558 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a97dcc8c-6438-4d66-8f7c-0f7ca96d6c6a tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:46:08.283763 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a97dcc8c-6438-4d66-8f7c-0f7ca96d6c6a tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07259157650043f09c677af878a52e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af56ffeb4c4c4c8672c66e2f6c9d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:46:08.295979 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a97dcc8c-6438-4d66-8f7c-0f7ca96d6c6a tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07259157650043f09c677af878a52e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af56ffeb4c4c4c8672c66e2f6c9d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:46:08.298893 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a97dcc8c-6438-4d66-8f7c-0f7ca96d6c6a tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07259157650043f09c677af878a52e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af56ffeb4c4c4c8672c66e2f6c9d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:46:08.301948 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a97dcc8c-6438-4d66-8f7c-0f7ca96d6c6a tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] 10.222.0.52 "GET /compute/v2.1/servers/1e03aef5-c628-4472-adc9-16ad1c768364" status: 200 len: 1366 microversion: 2.57 time: 0.130589 Oct 19 03:46:08.303443 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3044/6017] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:46:08 2022] GET /compute/v2.1/servers/1e03aef5-c628-4472-adc9-16ad1c768364 => generated 1366 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:46:09.338163 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3e7876a1-980c-49e9-a73d-27ac4dc255cd tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:46:09.339355 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3e7876a1-980c-49e9-a73d-27ac4dc255cd tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] [instance: 1e03aef5-c628-4472-adc9-16ad1c768364] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:46:09.365861 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3e7876a1-980c-49e9-a73d-27ac4dc255cd tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:46:09.366636 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3e7876a1-980c-49e9-a73d-27ac4dc255cd tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:46:09.367251 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3e7876a1-980c-49e9-a73d-27ac4dc255cd tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:46:09.369049 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3e7876a1-980c-49e9-a73d-27ac4dc255cd tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:46:09.369401 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3e7876a1-980c-49e9-a73d-27ac4dc255cd tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:46:09.370389 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3e7876a1-980c-49e9-a73d-27ac4dc255cd tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:46:09.486510 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-3e7876a1-980c-49e9-a73d-27ac4dc255cd tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07259157650043f09c677af878a52e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af56ffeb4c4c4c8672c66e2f6c9d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:46:09.503529 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-3e7876a1-980c-49e9-a73d-27ac4dc255cd tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07259157650043f09c677af878a52e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af56ffeb4c4c4c8672c66e2f6c9d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:46:09.505011 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-3e7876a1-980c-49e9-a73d-27ac4dc255cd tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07259157650043f09c677af878a52e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af56ffeb4c4c4c8672c66e2f6c9d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:46:09.506538 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3e7876a1-980c-49e9-a73d-27ac4dc255cd tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] 10.222.0.52 "GET /compute/v2.1/servers/1e03aef5-c628-4472-adc9-16ad1c768364" status: 200 len: 1366 microversion: 2.57 time: 0.180233 Oct 19 03:46:09.507353 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2974/6018] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:46:09 2022] GET /compute/v2.1/servers/1e03aef5-c628-4472-adc9-16ad1c768364 => generated 1366 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:46:10.537341 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4239970c-21f1-4f8e-a97a-839c4f1d494b tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:46:10.538070 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4239970c-21f1-4f8e-a97a-839c4f1d494b tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] [instance: 1e03aef5-c628-4472-adc9-16ad1c768364] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:46:10.544389 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:46:10.561892 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4239970c-21f1-4f8e-a97a-839c4f1d494b tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:46:10.562747 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4239970c-21f1-4f8e-a97a-839c4f1d494b tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:46:10.563217 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4239970c-21f1-4f8e-a97a-839c4f1d494b tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:46:10.563978 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4239970c-21f1-4f8e-a97a-839c4f1d494b tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:46:10.564437 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4239970c-21f1-4f8e-a97a-839c4f1d494b tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:46:10.571384 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4239970c-21f1-4f8e-a97a-839c4f1d494b tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:46:10.709239 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4239970c-21f1-4f8e-a97a-839c4f1d494b tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07259157650043f09c677af878a52e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af56ffeb4c4c4c8672c66e2f6c9d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:46:10.724658 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4239970c-21f1-4f8e-a97a-839c4f1d494b tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07259157650043f09c677af878a52e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af56ffeb4c4c4c8672c66e2f6c9d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:46:10.726567 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4239970c-21f1-4f8e-a97a-839c4f1d494b tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07259157650043f09c677af878a52e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af56ffeb4c4c4c8672c66e2f6c9d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:46:10.728605 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4239970c-21f1-4f8e-a97a-839c4f1d494b tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] 10.222.0.52 "GET /compute/v2.1/servers/1e03aef5-c628-4472-adc9-16ad1c768364" status: 200 len: 1366 microversion: 2.57 time: 0.199696 Oct 19 03:46:10.730600 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3045/6019] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:46:10 2022] GET /compute/v2.1/servers/1e03aef5-c628-4472-adc9-16ad1c768364 => generated 1366 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:46:11.768194 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-89a98de9-2878-4ee0-bc1e-359c36c226a7 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:46:11.768838 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-89a98de9-2878-4ee0-bc1e-359c36c226a7 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] [instance: 1e03aef5-c628-4472-adc9-16ad1c768364] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:46:11.796075 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-89a98de9-2878-4ee0-bc1e-359c36c226a7 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:46:11.796586 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-89a98de9-2878-4ee0-bc1e-359c36c226a7 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:46:11.803054 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-89a98de9-2878-4ee0-bc1e-359c36c226a7 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:46:11.803054 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-89a98de9-2878-4ee0-bc1e-359c36c226a7 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:46:11.803054 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-89a98de9-2878-4ee0-bc1e-359c36c226a7 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:46:11.803054 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-89a98de9-2878-4ee0-bc1e-359c36c226a7 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:46:12.002757 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-89a98de9-2878-4ee0-bc1e-359c36c226a7 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07259157650043f09c677af878a52e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af56ffeb4c4c4c8672c66e2f6c9d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:46:12.012183 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-89a98de9-2878-4ee0-bc1e-359c36c226a7 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07259157650043f09c677af878a52e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af56ffeb4c4c4c8672c66e2f6c9d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:46:12.014578 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-89a98de9-2878-4ee0-bc1e-359c36c226a7 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07259157650043f09c677af878a52e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af56ffeb4c4c4c8672c66e2f6c9d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:46:12.016299 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-89a98de9-2878-4ee0-bc1e-359c36c226a7 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] 10.222.0.52 "GET /compute/v2.1/servers/1e03aef5-c628-4472-adc9-16ad1c768364" status: 200 len: 1366 microversion: 2.57 time: 0.257860 Oct 19 03:46:12.017362 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2975/6020] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:46:11 2022] GET /compute/v2.1/servers/1e03aef5-c628-4472-adc9-16ad1c768364 => generated 1366 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:46:13.042471 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-86a4a1c6-5e11-4f81-9c08-ffebecf2b84c tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:46:13.044212 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-86a4a1c6-5e11-4f81-9c08-ffebecf2b84c tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] [instance: 1e03aef5-c628-4472-adc9-16ad1c768364] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:46:13.053203 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-86a4a1c6-5e11-4f81-9c08-ffebecf2b84c tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:46:13.054003 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-86a4a1c6-5e11-4f81-9c08-ffebecf2b84c tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:46:13.054669 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-86a4a1c6-5e11-4f81-9c08-ffebecf2b84c tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:46:13.055571 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-86a4a1c6-5e11-4f81-9c08-ffebecf2b84c tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:46:13.056233 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-86a4a1c6-5e11-4f81-9c08-ffebecf2b84c tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:46:13.056898 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-86a4a1c6-5e11-4f81-9c08-ffebecf2b84c tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:46:13.143663 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-86a4a1c6-5e11-4f81-9c08-ffebecf2b84c tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07259157650043f09c677af878a52e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af56ffeb4c4c4c8672c66e2f6c9d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:46:13.153156 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-86a4a1c6-5e11-4f81-9c08-ffebecf2b84c tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07259157650043f09c677af878a52e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af56ffeb4c4c4c8672c66e2f6c9d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:46:13.154703 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-86a4a1c6-5e11-4f81-9c08-ffebecf2b84c tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07259157650043f09c677af878a52e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af56ffeb4c4c4c8672c66e2f6c9d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:46:13.155884 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-86a4a1c6-5e11-4f81-9c08-ffebecf2b84c tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] 10.222.0.52 "GET /compute/v2.1/servers/1e03aef5-c628-4472-adc9-16ad1c768364" status: 200 len: 1366 microversion: 2.57 time: 0.117563 Oct 19 03:46:13.156451 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3046/6021] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:46:13 2022] GET /compute/v2.1/servers/1e03aef5-c628-4472-adc9-16ad1c768364 => generated 1366 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:46:14.189264 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2e184a97-49d4-4ce4-ba8a-a83c6a84b53b tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:46:14.189828 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2e184a97-49d4-4ce4-ba8a-a83c6a84b53b tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] [instance: 1e03aef5-c628-4472-adc9-16ad1c768364] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:46:14.199132 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2e184a97-49d4-4ce4-ba8a-a83c6a84b53b tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:46:14.200457 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2e184a97-49d4-4ce4-ba8a-a83c6a84b53b tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:46:14.200775 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2e184a97-49d4-4ce4-ba8a-a83c6a84b53b tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:46:14.202053 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2e184a97-49d4-4ce4-ba8a-a83c6a84b53b tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:46:14.203462 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2e184a97-49d4-4ce4-ba8a-a83c6a84b53b tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:46:14.204505 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2e184a97-49d4-4ce4-ba8a-a83c6a84b53b tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:46:14.289050 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-2e184a97-49d4-4ce4-ba8a-a83c6a84b53b tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07259157650043f09c677af878a52e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af56ffeb4c4c4c8672c66e2f6c9d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:46:14.298781 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-2e184a97-49d4-4ce4-ba8a-a83c6a84b53b tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07259157650043f09c677af878a52e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af56ffeb4c4c4c8672c66e2f6c9d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:46:14.303407 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-2e184a97-49d4-4ce4-ba8a-a83c6a84b53b tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07259157650043f09c677af878a52e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af56ffeb4c4c4c8672c66e2f6c9d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:46:14.304622 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2e184a97-49d4-4ce4-ba8a-a83c6a84b53b tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] 10.222.0.52 "GET /compute/v2.1/servers/1e03aef5-c628-4472-adc9-16ad1c768364" status: 200 len: 1366 microversion: 2.57 time: 0.125633 Oct 19 03:46:14.308677 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2976/6022] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:46:14 2022] GET /compute/v2.1/servers/1e03aef5-c628-4472-adc9-16ad1c768364 => generated 1366 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:46:14.892278 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0a1fce23-50e1-4e5d-995a-6f51abdb1786 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:46:14.892874 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0a1fce23-50e1-4e5d-995a-6f51abdb1786 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] [instance: 77e68020-0c84-433d-8a03-c4319aeb99b6] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:46:14.901787 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0a1fce23-50e1-4e5d-995a-6f51abdb1786 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:46:14.906541 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0a1fce23-50e1-4e5d-995a-6f51abdb1786 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:46:14.907286 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0a1fce23-50e1-4e5d-995a-6f51abdb1786 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:46:14.908286 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0a1fce23-50e1-4e5d-995a-6f51abdb1786 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:46:14.911091 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0a1fce23-50e1-4e5d-995a-6f51abdb1786 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:46:14.912478 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0a1fce23-50e1-4e5d-995a-6f51abdb1786 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:46:15.049342 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-0a1fce23-50e1-4e5d-995a-6f51abdb1786 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Lazy-loading 'services' on Instance uuid 77e68020-0c84-433d-8a03-c4319aeb99b6 {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:46:15.335138 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9ab6c359-f95a-48cf-91bc-f26bf4d6c92a tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:46:15.335921 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9ab6c359-f95a-48cf-91bc-f26bf4d6c92a tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] [instance: 1e03aef5-c628-4472-adc9-16ad1c768364] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:46:15.343623 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9ab6c359-f95a-48cf-91bc-f26bf4d6c92a tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:46:15.344451 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9ab6c359-f95a-48cf-91bc-f26bf4d6c92a tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:46:15.344963 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9ab6c359-f95a-48cf-91bc-f26bf4d6c92a tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:46:15.345934 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9ab6c359-f95a-48cf-91bc-f26bf4d6c92a tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:46:15.346601 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9ab6c359-f95a-48cf-91bc-f26bf4d6c92a tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:46:15.347375 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9ab6c359-f95a-48cf-91bc-f26bf4d6c92a tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:46:15.356274 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0a1fce23-50e1-4e5d-995a-6f51abdb1786 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] 10.222.0.52 "DELETE /compute/v2.1/servers/77e68020-0c84-433d-8a03-c4319aeb99b6/os-volume_attachments/c5eb3e95-effc-4de9-b0b2-a6ab7228334f" status: 202 len: 0 microversion: 2.1 time: 0.467742 Oct 19 03:46:15.361441 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3047/6023] 10.222.0.52 () {58 vars in 1416 bytes} [Wed Oct 19 03:46:14 2022] DELETE /compute/v2.1/servers/77e68020-0c84-433d-8a03-c4319aeb99b6/os-volume_attachments/c5eb3e95-effc-4de9-b0b2-a6ab7228334f => generated 0 bytes in 474 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:46:15.473716 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9ab6c359-f95a-48cf-91bc-f26bf4d6c92a tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07259157650043f09c677af878a52e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af56ffeb4c4c4c8672c66e2f6c9d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:46:15.483155 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9ab6c359-f95a-48cf-91bc-f26bf4d6c92a tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07259157650043f09c677af878a52e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af56ffeb4c4c4c8672c66e2f6c9d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:46:15.484936 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9ab6c359-f95a-48cf-91bc-f26bf4d6c92a tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07259157650043f09c677af878a52e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af56ffeb4c4c4c8672c66e2f6c9d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:46:15.486611 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9ab6c359-f95a-48cf-91bc-f26bf4d6c92a tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] 10.222.0.52 "GET /compute/v2.1/servers/1e03aef5-c628-4472-adc9-16ad1c768364" status: 200 len: 1366 microversion: 2.57 time: 0.155401 Oct 19 03:46:15.510442 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2977/6024] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:46:15 2022] GET /compute/v2.1/servers/1e03aef5-c628-4472-adc9-16ad1c768364 => generated 1366 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:46:16.516785 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b6ba7401-606f-49a5-8a4f-02e6307c67c7 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:46:16.517631 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b6ba7401-606f-49a5-8a4f-02e6307c67c7 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] [instance: 1e03aef5-c628-4472-adc9-16ad1c768364] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:46:16.525710 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b6ba7401-606f-49a5-8a4f-02e6307c67c7 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:46:16.526211 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b6ba7401-606f-49a5-8a4f-02e6307c67c7 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:46:16.526695 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b6ba7401-606f-49a5-8a4f-02e6307c67c7 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:46:16.535666 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b6ba7401-606f-49a5-8a4f-02e6307c67c7 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:46:16.536324 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b6ba7401-606f-49a5-8a4f-02e6307c67c7 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:46:16.536793 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b6ba7401-606f-49a5-8a4f-02e6307c67c7 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:46:16.629092 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b6ba7401-606f-49a5-8a4f-02e6307c67c7 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07259157650043f09c677af878a52e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af56ffeb4c4c4c8672c66e2f6c9d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:46:16.641872 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b6ba7401-606f-49a5-8a4f-02e6307c67c7 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07259157650043f09c677af878a52e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af56ffeb4c4c4c8672c66e2f6c9d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:46:16.645770 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b6ba7401-606f-49a5-8a4f-02e6307c67c7 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07259157650043f09c677af878a52e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af56ffeb4c4c4c8672c66e2f6c9d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:46:16.647318 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b6ba7401-606f-49a5-8a4f-02e6307c67c7 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] 10.222.0.52 "GET /compute/v2.1/servers/1e03aef5-c628-4472-adc9-16ad1c768364" status: 200 len: 1366 microversion: 2.57 time: 0.135808 Oct 19 03:46:16.669117 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3048/6025] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:46:16 2022] GET /compute/v2.1/servers/1e03aef5-c628-4472-adc9-16ad1c768364 => generated 1366 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:46:17.694604 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2a9c1001-9a91-4222-8562-96e27f94d534 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:46:17.694604 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2a9c1001-9a91-4222-8562-96e27f94d534 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] [instance: 1e03aef5-c628-4472-adc9-16ad1c768364] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:46:17.711367 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=36 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:46:17.713283 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2a9c1001-9a91-4222-8562-96e27f94d534 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:46:17.713825 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2a9c1001-9a91-4222-8562-96e27f94d534 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:46:17.714276 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2a9c1001-9a91-4222-8562-96e27f94d534 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:46:17.715567 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2a9c1001-9a91-4222-8562-96e27f94d534 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:46:17.716036 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2a9c1001-9a91-4222-8562-96e27f94d534 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:46:17.716474 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2a9c1001-9a91-4222-8562-96e27f94d534 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:46:17.897409 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-2a9c1001-9a91-4222-8562-96e27f94d534 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07259157650043f09c677af878a52e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af56ffeb4c4c4c8672c66e2f6c9d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:46:17.910645 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-2a9c1001-9a91-4222-8562-96e27f94d534 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07259157650043f09c677af878a52e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af56ffeb4c4c4c8672c66e2f6c9d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:46:17.915049 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-2a9c1001-9a91-4222-8562-96e27f94d534 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07259157650043f09c677af878a52e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af56ffeb4c4c4c8672c66e2f6c9d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:46:17.926701 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2a9c1001-9a91-4222-8562-96e27f94d534 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] 10.222.0.52 "GET /compute/v2.1/servers/1e03aef5-c628-4472-adc9-16ad1c768364" status: 200 len: 1366 microversion: 2.57 time: 0.237538 Oct 19 03:46:17.942132 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2978/6026] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:46:17 2022] GET /compute/v2.1/servers/1e03aef5-c628-4472-adc9-16ad1c768364 => generated 1366 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:46:18.960425 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-89e36589-fd11-4a40-a61a-17e911cc56c9 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:46:18.963288 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-89e36589-fd11-4a40-a61a-17e911cc56c9 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] [instance: 1e03aef5-c628-4472-adc9-16ad1c768364] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:46:18.977697 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-89e36589-fd11-4a40-a61a-17e911cc56c9 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:46:18.979299 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-89e36589-fd11-4a40-a61a-17e911cc56c9 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:46:18.979299 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-89e36589-fd11-4a40-a61a-17e911cc56c9 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:46:18.979299 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-89e36589-fd11-4a40-a61a-17e911cc56c9 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:46:18.979710 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-89e36589-fd11-4a40-a61a-17e911cc56c9 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:46:18.980121 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-89e36589-fd11-4a40-a61a-17e911cc56c9 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:46:18.987775 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=83,nova_cell1:INSERT=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:46:19.136257 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-89e36589-fd11-4a40-a61a-17e911cc56c9 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07259157650043f09c677af878a52e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af56ffeb4c4c4c8672c66e2f6c9d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:46:19.145930 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-89e36589-fd11-4a40-a61a-17e911cc56c9 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07259157650043f09c677af878a52e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af56ffeb4c4c4c8672c66e2f6c9d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:46:19.147393 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-89e36589-fd11-4a40-a61a-17e911cc56c9 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07259157650043f09c677af878a52e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af56ffeb4c4c4c8672c66e2f6c9d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:46:19.148588 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-89e36589-fd11-4a40-a61a-17e911cc56c9 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] 10.222.0.52 "GET /compute/v2.1/servers/1e03aef5-c628-4472-adc9-16ad1c768364" status: 200 len: 1366 microversion: 2.57 time: 0.194129 Oct 19 03:46:19.149950 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3049/6027] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:46:18 2022] GET /compute/v2.1/servers/1e03aef5-c628-4472-adc9-16ad1c768364 => generated 1366 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:46:20.175828 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-87ed3ffa-21f7-4caa-ac0a-88841fd48e33 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:46:20.176560 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-87ed3ffa-21f7-4caa-ac0a-88841fd48e33 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] [instance: 1e03aef5-c628-4472-adc9-16ad1c768364] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:46:20.200791 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-87ed3ffa-21f7-4caa-ac0a-88841fd48e33 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:46:20.201590 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-87ed3ffa-21f7-4caa-ac0a-88841fd48e33 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:46:20.202345 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-87ed3ffa-21f7-4caa-ac0a-88841fd48e33 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:46:20.203230 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-87ed3ffa-21f7-4caa-ac0a-88841fd48e33 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:46:20.203806 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-87ed3ffa-21f7-4caa-ac0a-88841fd48e33 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:46:20.204390 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-87ed3ffa-21f7-4caa-ac0a-88841fd48e33 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:46:20.344986 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-87ed3ffa-21f7-4caa-ac0a-88841fd48e33 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07259157650043f09c677af878a52e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af56ffeb4c4c4c8672c66e2f6c9d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:46:20.370179 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-87ed3ffa-21f7-4caa-ac0a-88841fd48e33 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07259157650043f09c677af878a52e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af56ffeb4c4c4c8672c66e2f6c9d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:46:20.370179 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-87ed3ffa-21f7-4caa-ac0a-88841fd48e33 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07259157650043f09c677af878a52e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af56ffeb4c4c4c8672c66e2f6c9d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:46:20.370179 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-87ed3ffa-21f7-4caa-ac0a-88841fd48e33 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] 10.222.0.52 "GET /compute/v2.1/servers/1e03aef5-c628-4472-adc9-16ad1c768364" status: 200 len: 1366 microversion: 2.57 time: 0.196953 Oct 19 03:46:20.370179 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2979/6028] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:46:20 2022] GET /compute/v2.1/servers/1e03aef5-c628-4472-adc9-16ad1c768364 => generated 1366 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:46:21.411266 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3c42aae7-0e80-4ca7-a250-eecfda4edbf5 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:46:21.412467 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-3c42aae7-0e80-4ca7-a250-eecfda4edbf5 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] [instance: 1e03aef5-c628-4472-adc9-16ad1c768364] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:46:21.431162 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3c42aae7-0e80-4ca7-a250-eecfda4edbf5 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:46:21.432445 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3c42aae7-0e80-4ca7-a250-eecfda4edbf5 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:46:21.432882 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3c42aae7-0e80-4ca7-a250-eecfda4edbf5 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:46:21.433694 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3c42aae7-0e80-4ca7-a250-eecfda4edbf5 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:46:21.434339 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3c42aae7-0e80-4ca7-a250-eecfda4edbf5 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:46:21.444506 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3c42aae7-0e80-4ca7-a250-eecfda4edbf5 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:46:21.921757 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-3c42aae7-0e80-4ca7-a250-eecfda4edbf5 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07259157650043f09c677af878a52e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af56ffeb4c4c4c8672c66e2f6c9d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:46:21.921757 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-3c42aae7-0e80-4ca7-a250-eecfda4edbf5 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07259157650043f09c677af878a52e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af56ffeb4c4c4c8672c66e2f6c9d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:46:21.921757 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-3c42aae7-0e80-4ca7-a250-eecfda4edbf5 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07259157650043f09c677af878a52e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af56ffeb4c4c4c8672c66e2f6c9d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:46:21.921757 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-3c42aae7-0e80-4ca7-a250-eecfda4edbf5 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] 10.222.0.52 "GET /compute/v2.1/servers/1e03aef5-c628-4472-adc9-16ad1c768364" status: 200 len: 1366 microversion: 2.57 time: 0.205671 Oct 19 03:46:21.921757 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3050/6029] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:46:21 2022] GET /compute/v2.1/servers/1e03aef5-c628-4472-adc9-16ad1c768364 => generated 1366 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:46:22.366225 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a6bce129-6939-44a3-94c0-70f25be9809d tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:46:22.366781 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a6bce129-6939-44a3-94c0-70f25be9809d tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] [instance: 77e68020-0c84-433d-8a03-c4319aeb99b6] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:46:22.375365 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a6bce129-6939-44a3-94c0-70f25be9809d tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:46:22.375365 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a6bce129-6939-44a3-94c0-70f25be9809d tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:46:22.375604 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a6bce129-6939-44a3-94c0-70f25be9809d tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:46:22.376457 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a6bce129-6939-44a3-94c0-70f25be9809d tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:46:22.376906 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a6bce129-6939-44a3-94c0-70f25be9809d tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:46:22.377429 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a6bce129-6939-44a3-94c0-70f25be9809d tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:46:22.412347 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a6bce129-6939-44a3-94c0-70f25be9809d tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] [instance: 77e68020-0c84-433d-8a03-c4319aeb99b6] Going to try to terminate instance {{(pid=121134) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:46:22.637139 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-de8046a6-b56c-4440-8a3e-be956c9efbbc tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:46:22.643900 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-de8046a6-b56c-4440-8a3e-be956c9efbbc tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] [instance: 1e03aef5-c628-4472-adc9-16ad1c768364] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:46:22.646409 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-de8046a6-b56c-4440-8a3e-be956c9efbbc tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:46:22.646951 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-de8046a6-b56c-4440-8a3e-be956c9efbbc tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:46:22.647407 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-de8046a6-b56c-4440-8a3e-be956c9efbbc tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:46:22.648133 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-de8046a6-b56c-4440-8a3e-be956c9efbbc tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:46:22.651383 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-de8046a6-b56c-4440-8a3e-be956c9efbbc tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:46:22.656258 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-de8046a6-b56c-4440-8a3e-be956c9efbbc tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:46:22.752733 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-de8046a6-b56c-4440-8a3e-be956c9efbbc tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07259157650043f09c677af878a52e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af56ffeb4c4c4c8672c66e2f6c9d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:46:22.760960 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-de8046a6-b56c-4440-8a3e-be956c9efbbc tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07259157650043f09c677af878a52e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af56ffeb4c4c4c8672c66e2f6c9d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:46:22.765018 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a6bce129-6939-44a3-94c0-70f25be9809d tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] 10.222.0.52 "DELETE /compute/v2.1/servers/77e68020-0c84-433d-8a03-c4319aeb99b6" status: 204 len: 0 microversion: 2.1 time: 0.404977 Oct 19 03:46:22.765652 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2980/6030] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:46:22 2022] DELETE /compute/v2.1/servers/77e68020-0c84-433d-8a03-c4319aeb99b6 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:46:22.775617 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-de8046a6-b56c-4440-8a3e-be956c9efbbc tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07259157650043f09c677af878a52e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af56ffeb4c4c4c8672c66e2f6c9d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:46:22.777720 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-de8046a6-b56c-4440-8a3e-be956c9efbbc tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] 10.222.0.52 "GET /compute/v2.1/servers/1e03aef5-c628-4472-adc9-16ad1c768364" status: 200 len: 1384 microversion: 2.57 time: 0.144408 Oct 19 03:46:22.778850 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3051/6031] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:46:22 2022] GET /compute/v2.1/servers/1e03aef5-c628-4472-adc9-16ad1c768364 => generated 1384 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:46:22.783451 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-64a7b121-9cfc-4736-9d97-65f9ba98ad28 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:46:22.784167 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-64a7b121-9cfc-4736-9d97-65f9ba98ad28 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] [instance: 77e68020-0c84-433d-8a03-c4319aeb99b6] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:46:22.791132 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-64a7b121-9cfc-4736-9d97-65f9ba98ad28 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:46:22.791760 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-64a7b121-9cfc-4736-9d97-65f9ba98ad28 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:46:22.792210 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-64a7b121-9cfc-4736-9d97-65f9ba98ad28 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:46:22.793624 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-64a7b121-9cfc-4736-9d97-65f9ba98ad28 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:46:22.794606 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-64a7b121-9cfc-4736-9d97-65f9ba98ad28 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:46:22.795062 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-64a7b121-9cfc-4736-9d97-65f9ba98ad28 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:46:22.819683 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:46:23.008794 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-64a7b121-9cfc-4736-9d97-65f9ba98ad28 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eda27d8b6c47b3acd19492f6ecc462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd3b552d16542e888d8205cc983c1b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:46:23.018521 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-64a7b121-9cfc-4736-9d97-65f9ba98ad28 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] 10.222.0.52 "GET /compute/v2.1/servers/77e68020-0c84-433d-8a03-c4319aeb99b6" status: 200 len: 1470 microversion: 2.1 time: 0.246888 Oct 19 03:46:23.019135 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2981/6032] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:46:22 2022] GET /compute/v2.1/servers/77e68020-0c84-433d-8a03-c4319aeb99b6 => generated 1470 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:46:23.806492 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-644ac3d0-caa3-41b8-a9bf-5b8ba8166631 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:46:23.807102 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-644ac3d0-caa3-41b8-a9bf-5b8ba8166631 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] [instance: 1e03aef5-c628-4472-adc9-16ad1c768364] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:46:23.817647 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-644ac3d0-caa3-41b8-a9bf-5b8ba8166631 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:46:23.818148 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-644ac3d0-caa3-41b8-a9bf-5b8ba8166631 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:46:23.818588 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-644ac3d0-caa3-41b8-a9bf-5b8ba8166631 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:46:23.819427 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-644ac3d0-caa3-41b8-a9bf-5b8ba8166631 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:46:23.820841 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-644ac3d0-caa3-41b8-a9bf-5b8ba8166631 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:46:23.821674 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-644ac3d0-caa3-41b8-a9bf-5b8ba8166631 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:46:23.941026 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-644ac3d0-caa3-41b8-a9bf-5b8ba8166631 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07259157650043f09c677af878a52e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af56ffeb4c4c4c8672c66e2f6c9d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:46:23.950372 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-644ac3d0-caa3-41b8-a9bf-5b8ba8166631 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07259157650043f09c677af878a52e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af56ffeb4c4c4c8672c66e2f6c9d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:46:23.953646 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-644ac3d0-caa3-41b8-a9bf-5b8ba8166631 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07259157650043f09c677af878a52e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af56ffeb4c4c4c8672c66e2f6c9d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:46:23.953646 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-644ac3d0-caa3-41b8-a9bf-5b8ba8166631 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] 10.222.0.52 "GET /compute/v2.1/servers/1e03aef5-c628-4472-adc9-16ad1c768364" status: 200 len: 1372 microversion: 2.57 time: 0.152263 Oct 19 03:46:23.954308 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3052/6033] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:46:23 2022] GET /compute/v2.1/servers/1e03aef5-c628-4472-adc9-16ad1c768364 => generated 1372 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:46:24.042225 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-335f1e79-3032-45af-8665-1dbb384e6e4f tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:46:24.044539 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-335f1e79-3032-45af-8665-1dbb384e6e4f tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] [instance: 77e68020-0c84-433d-8a03-c4319aeb99b6] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:46:24.061598 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-335f1e79-3032-45af-8665-1dbb384e6e4f tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:46:24.071150 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-335f1e79-3032-45af-8665-1dbb384e6e4f tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:46:24.071670 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-335f1e79-3032-45af-8665-1dbb384e6e4f tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:46:24.072721 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-335f1e79-3032-45af-8665-1dbb384e6e4f tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:46:24.073634 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-335f1e79-3032-45af-8665-1dbb384e6e4f tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:46:24.075161 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-335f1e79-3032-45af-8665-1dbb384e6e4f tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:46:24.310218 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-335f1e79-3032-45af-8665-1dbb384e6e4f tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eda27d8b6c47b3acd19492f6ecc462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd3b552d16542e888d8205cc983c1b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:46:24.321358 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-335f1e79-3032-45af-8665-1dbb384e6e4f tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] 10.222.0.52 "GET /compute/v2.1/servers/77e68020-0c84-433d-8a03-c4319aeb99b6" status: 200 len: 1470 microversion: 2.1 time: 0.283161 Oct 19 03:46:24.328080 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2982/6034] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:46:24 2022] GET /compute/v2.1/servers/77e68020-0c84-433d-8a03-c4319aeb99b6 => generated 1470 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:46:24.986214 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-8f1d9343-5352-4b46-ac37-9bfb1256f3e7 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:46:24.992756 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-8f1d9343-5352-4b46-ac37-9bfb1256f3e7 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] [instance: 1e03aef5-c628-4472-adc9-16ad1c768364] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:46:24.995569 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8f1d9343-5352-4b46-ac37-9bfb1256f3e7 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:46:24.996885 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8f1d9343-5352-4b46-ac37-9bfb1256f3e7 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:46:24.997333 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8f1d9343-5352-4b46-ac37-9bfb1256f3e7 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:46:24.998059 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8f1d9343-5352-4b46-ac37-9bfb1256f3e7 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:46:24.998516 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8f1d9343-5352-4b46-ac37-9bfb1256f3e7 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:46:24.998943 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8f1d9343-5352-4b46-ac37-9bfb1256f3e7 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:46:25.103111 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-8f1d9343-5352-4b46-ac37-9bfb1256f3e7 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07259157650043f09c677af878a52e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af56ffeb4c4c4c8672c66e2f6c9d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:46:25.113725 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-8f1d9343-5352-4b46-ac37-9bfb1256f3e7 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07259157650043f09c677af878a52e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af56ffeb4c4c4c8672c66e2f6c9d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:46:25.116349 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-8f1d9343-5352-4b46-ac37-9bfb1256f3e7 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07259157650043f09c677af878a52e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af56ffeb4c4c4c8672c66e2f6c9d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:46:25.117390 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-8f1d9343-5352-4b46-ac37-9bfb1256f3e7 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] 10.222.0.52 "GET /compute/v2.1/servers/1e03aef5-c628-4472-adc9-16ad1c768364" status: 200 len: 1372 microversion: 2.57 time: 0.139049 Oct 19 03:46:25.118523 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3053/6035] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:46:24 2022] GET /compute/v2.1/servers/1e03aef5-c628-4472-adc9-16ad1c768364 => generated 1372 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:46:25.348892 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-364298b2-49fd-43f6-9f30-7e161b56c3a2 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:46:25.349689 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-364298b2-49fd-43f6-9f30-7e161b56c3a2 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] [instance: 77e68020-0c84-433d-8a03-c4319aeb99b6] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:46:25.357933 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-364298b2-49fd-43f6-9f30-7e161b56c3a2 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:46:25.358880 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-364298b2-49fd-43f6-9f30-7e161b56c3a2 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:46:25.359504 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-364298b2-49fd-43f6-9f30-7e161b56c3a2 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:46:25.360557 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-364298b2-49fd-43f6-9f30-7e161b56c3a2 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:46:25.361180 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-364298b2-49fd-43f6-9f30-7e161b56c3a2 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:46:25.364421 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-364298b2-49fd-43f6-9f30-7e161b56c3a2 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:46:25.386290 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-2cc3a997-5b36-4074-9234-a73462c9605b req-6fb146e7-4066-4a1d-8c94-04f0e478a7ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77e68020-0c84-433d-8a03-c4319aeb99b6", "name": "network-vif-deleted", "tag": "dbd9ba88-f51c-4822-b494-6ebfe2da0279"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:46:25.405711 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-2cc3a997-5b36-4074-9234-a73462c9605b req-6fb146e7-4066-4a1d-8c94-04f0e478a7ff service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:46:25.406517 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-2cc3a997-5b36-4074-9234-a73462c9605b req-6fb146e7-4066-4a1d-8c94-04f0e478a7ff service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:46:25.408229 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-2cc3a997-5b36-4074-9234-a73462c9605b req-6fb146e7-4066-4a1d-8c94-04f0e478a7ff service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:46:25.426375 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-2cc3a997-5b36-4074-9234-a73462c9605b req-6fb146e7-4066-4a1d-8c94-04f0e478a7ff service nova] Creating event network-vif-deleted:dbd9ba88-f51c-4822-b494-6ebfe2da0279 for instance 77e68020-0c84-433d-8a03-c4319aeb99b6 on n-h2-861333-8 Oct 19 03:46:25.431831 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-2cc3a997-5b36-4074-9234-a73462c9605b req-6fb146e7-4066-4a1d-8c94-04f0e478a7ff service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053123 Oct 19 03:46:25.432747 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3054/6036] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:46:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:46:25.472335 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-364298b2-49fd-43f6-9f30-7e161b56c3a2 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eda27d8b6c47b3acd19492f6ecc462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd3b552d16542e888d8205cc983c1b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:46:25.481259 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-364298b2-49fd-43f6-9f30-7e161b56c3a2 tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] 10.222.0.52 "GET /compute/v2.1/servers/77e68020-0c84-433d-8a03-c4319aeb99b6" status: 200 len: 1428 microversion: 2.1 time: 0.136886 Oct 19 03:46:25.481881 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2983/6037] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:46:25 2022] GET /compute/v2.1/servers/77e68020-0c84-433d-8a03-c4319aeb99b6 => generated 1428 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:46:26.148019 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f427e051-e3fa-40cb-83ca-e35fa162dcc8 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:46:26.148972 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f427e051-e3fa-40cb-83ca-e35fa162dcc8 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] [instance: 1e03aef5-c628-4472-adc9-16ad1c768364] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:46:26.155861 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f427e051-e3fa-40cb-83ca-e35fa162dcc8 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:46:26.156340 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f427e051-e3fa-40cb-83ca-e35fa162dcc8 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:46:26.156783 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f427e051-e3fa-40cb-83ca-e35fa162dcc8 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:46:26.157520 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f427e051-e3fa-40cb-83ca-e35fa162dcc8 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:46:26.158171 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f427e051-e3fa-40cb-83ca-e35fa162dcc8 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:46:26.158606 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f427e051-e3fa-40cb-83ca-e35fa162dcc8 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:46:26.232552 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f427e051-e3fa-40cb-83ca-e35fa162dcc8 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07259157650043f09c677af878a52e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af56ffeb4c4c4c8672c66e2f6c9d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:46:26.242250 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f427e051-e3fa-40cb-83ca-e35fa162dcc8 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07259157650043f09c677af878a52e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af56ffeb4c4c4c8672c66e2f6c9d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:46:26.243888 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f427e051-e3fa-40cb-83ca-e35fa162dcc8 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07259157650043f09c677af878a52e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af56ffeb4c4c4c8672c66e2f6c9d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:46:26.245086 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f427e051-e3fa-40cb-83ca-e35fa162dcc8 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] 10.222.0.52 "GET /compute/v2.1/servers/1e03aef5-c628-4472-adc9-16ad1c768364" status: 200 len: 1372 microversion: 2.57 time: 0.102382 Oct 19 03:46:26.264364 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3055/6038] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:46:26 2022] GET /compute/v2.1/servers/1e03aef5-c628-4472-adc9-16ad1c768364 => generated 1372 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:46:26.507057 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-04465167-f166-44b8-a63e-e94424de476b tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:46:26.510568 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-04465167-f166-44b8-a63e-e94424de476b tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] [instance: 77e68020-0c84-433d-8a03-c4319aeb99b6] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:46:26.520878 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-04465167-f166-44b8-a63e-e94424de476b tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:46:26.521842 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-04465167-f166-44b8-a63e-e94424de476b tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:46:26.522449 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-04465167-f166-44b8-a63e-e94424de476b tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:46:26.523373 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-04465167-f166-44b8-a63e-e94424de476b tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:46:26.524008 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-04465167-f166-44b8-a63e-e94424de476b tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:46:26.524608 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-04465167-f166-44b8-a63e-e94424de476b tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:46:26.542798 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-04465167-f166-44b8-a63e-e94424de476b tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] HTTP exception thrown: Instance 77e68020-0c84-433d-8a03-c4319aeb99b6 could not be found. Oct 19 03:46:26.545660 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-04465167-f166-44b8-a63e-e94424de476b tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Request method failure captured: Oct 19 03:46:26.545660 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/77e68020-0c84-433d-8a03-c4319aeb99b6 HTTP/1.1 Oct 19 03:46:26.545660 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:46:26.545660 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:46:26.545660 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:46:26.545660 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:46:26.545660 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:46:26.545660 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:46:26.545660 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:46:26.545660 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:46:26.545660 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3JyIOhMQpNXJ1H1q5QSziIlaSLO73rRXqrOY0c-Y_Ct_H83mTR6lAaKWhq51TH9nFh2QXW0orlR8JCafgomcWEznv2w1NSxHI8Xrld-M9xlISiGpfGqUjWxjcCmepsSSLkEZPJWE2tiIUEuHFyJYTq_gvsVV_voC7KqIa6TObAixR4 Oct 19 03:46:26.545660 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:46:26.545660 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:46:26.545660 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:46:26.545660 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:46:26.545660 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:46:26.545660 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:46:26.545660 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 8dd3b552d16542e888d8205cc983c1b1 Oct 19 03:46:26.545660 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-VolumesBackupsTest-1032415317 Oct 19 03:46:26.545660 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:46:26.545660 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:46:26.545660 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8dd3b552d16542e888d8205cc983c1b1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8dd3b552d16542e888d8205cc983c1b1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8dd3b552d16542e888d8205cc983c1b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8dd3b552d16542e888d8205cc983c1b1", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:46:26.545660 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-VolumesBackupsTest-1032415317 Oct 19 03:46:26.545660 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 8dd3b552d16542e888d8205cc983c1b1 Oct 19 03:46:26.545660 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-VolumesBackupsTest-1032415317 Oct 19 03:46:26.545660 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-VolumesBackupsTest-1032415317-project Oct 19 03:46:26.545660 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:46:26.545660 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:46:26.545660 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: d5eda27d8b6c47b3acd19492f6ecc462 Oct 19 03:46:26.545660 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-VolumesBackupsTest-1032415317-project Oct 19 03:46:26.545660 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:46:26.545660 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance 77e68020-0c84-433d-8a03-c4319aeb99b6 could not be found. Oct 19 03:46:26.545660 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '77e68020-0c84-433d-8a03-c4319aeb99b6'} Oct 19 03:46:26.545660 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:46:26.545660 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:46:26.545660 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:46:26.545660 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:46:26.545660 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:46:26.545660 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:46:26.545660 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:46:26.545660 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:46:26.545660 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:46:26.545660 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:46:26.545660 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77e68020-0c84-433d-8a03-c4319aeb99b6 could not be found. Oct 19 03:46:26.545660 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:46:26.545660 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:46:26.545660 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:46:26.545660 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:46:26.545660 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:46:26.545660 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:46:26.545660 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:46:26.545660 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:46:26.545660 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:46:26.545660 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:46:26.545660 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:46:26.545660 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:46:26.545660 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:46:26.545660 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:46:26.545660 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:46:26.545660 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:46:26.545660 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77e68020-0c84-433d-8a03-c4319aeb99b6 could not be found. Oct 19 03:46:26.545660 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:46:26.545660 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:46:26.545660 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:46:26.554457 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:46:26.554457 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:46:26.554457 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:46:26.554457 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:46:26.554457 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:46:26.554457 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77e68020-0c84-433d-8a03-c4319aeb99b6 could not be found. Oct 19 03:46:26.554457 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:46:26.554457 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-04465167-f166-44b8-a63e-e94424de476b tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] Returning 404 to user: Instance 77e68020-0c84-433d-8a03-c4319aeb99b6 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:46:26.554457 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-04465167-f166-44b8-a63e-e94424de476b tempest-VolumesBackupsTest-1032415317 tempest-VolumesBackupsTest-1032415317-project] 10.222.0.52 "GET /compute/v2.1/servers/77e68020-0c84-433d-8a03-c4319aeb99b6" status: 404 len: 111 microversion: 2.1 time: 0.045081 Oct 19 03:46:26.554457 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2984/6039] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:46:26 2022] GET /compute/v2.1/servers/77e68020-0c84-433d-8a03-c4319aeb99b6 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:46:27.273620 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6d541b1a-5c3c-4430-b454-5d4245557634 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:46:27.274392 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6d541b1a-5c3c-4430-b454-5d4245557634 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] [instance: 1e03aef5-c628-4472-adc9-16ad1c768364] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:46:27.293217 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6d541b1a-5c3c-4430-b454-5d4245557634 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:46:27.293615 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6d541b1a-5c3c-4430-b454-5d4245557634 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:46:27.294068 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6d541b1a-5c3c-4430-b454-5d4245557634 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:46:27.294793 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6d541b1a-5c3c-4430-b454-5d4245557634 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:46:27.295252 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6d541b1a-5c3c-4430-b454-5d4245557634 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:46:27.295688 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6d541b1a-5c3c-4430-b454-5d4245557634 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:46:27.458822 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-6d541b1a-5c3c-4430-b454-5d4245557634 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07259157650043f09c677af878a52e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af56ffeb4c4c4c8672c66e2f6c9d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:46:27.467717 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-6d541b1a-5c3c-4430-b454-5d4245557634 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07259157650043f09c677af878a52e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af56ffeb4c4c4c8672c66e2f6c9d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:46:27.470380 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-6d541b1a-5c3c-4430-b454-5d4245557634 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07259157650043f09c677af878a52e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af56ffeb4c4c4c8672c66e2f6c9d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:46:27.471628 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6d541b1a-5c3c-4430-b454-5d4245557634 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] 10.222.0.52 "GET /compute/v2.1/servers/1e03aef5-c628-4472-adc9-16ad1c768364" status: 200 len: 1357 microversion: 2.57 time: 0.203454 Oct 19 03:46:27.472258 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3056/6040] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:46:27 2022] GET /compute/v2.1/servers/1e03aef5-c628-4472-adc9-16ad1c768364 => generated 1357 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:46:27.506482 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4aee0630-6951-4e41-a001-acef3e06ba26 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:46:27.506988 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4aee0630-6951-4e41-a001-acef3e06ba26 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] [instance: 1e03aef5-c628-4472-adc9-16ad1c768364] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:46:27.514162 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4aee0630-6951-4e41-a001-acef3e06ba26 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:46:27.518631 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4aee0630-6951-4e41-a001-acef3e06ba26 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:46:27.518631 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4aee0630-6951-4e41-a001-acef3e06ba26 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:46:27.518631 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4aee0630-6951-4e41-a001-acef3e06ba26 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:46:27.518631 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4aee0630-6951-4e41-a001-acef3e06ba26 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:46:27.518631 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4aee0630-6951-4e41-a001-acef3e06ba26 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:46:27.549392 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4aee0630-6951-4e41-a001-acef3e06ba26 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] [instance: 1e03aef5-c628-4472-adc9-16ad1c768364] Going to try to terminate instance {{(pid=121134) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:46:28.059094 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4aee0630-6951-4e41-a001-acef3e06ba26 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1e03aef5-c628-4472-adc9-16ad1c768364" status: 204 len: 0 microversion: 2.57 time: 0.552902 Oct 19 03:46:28.059094 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2985/6041] 10.222.0.52 () {60 vars in 1280 bytes} [Wed Oct 19 03:46:27 2022] DELETE /compute/v2.1/servers/1e03aef5-c628-4472-adc9-16ad1c768364 => generated 0 bytes in 554 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 19 03:46:28.065350 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-337df57f-cc9c-45ff-88fa-eed169db6667 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:46:28.066327 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-337df57f-cc9c-45ff-88fa-eed169db6667 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] [instance: 1e03aef5-c628-4472-adc9-16ad1c768364] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:46:28.077832 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-337df57f-cc9c-45ff-88fa-eed169db6667 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:46:28.078633 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-337df57f-cc9c-45ff-88fa-eed169db6667 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:46:28.079262 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-337df57f-cc9c-45ff-88fa-eed169db6667 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:46:28.080158 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-337df57f-cc9c-45ff-88fa-eed169db6667 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:46:28.080788 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-337df57f-cc9c-45ff-88fa-eed169db6667 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:46:28.082121 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-337df57f-cc9c-45ff-88fa-eed169db6667 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:46:28.339412 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-337df57f-cc9c-45ff-88fa-eed169db6667 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07259157650043f09c677af878a52e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af56ffeb4c4c4c8672c66e2f6c9d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:46:28.350830 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-337df57f-cc9c-45ff-88fa-eed169db6667 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07259157650043f09c677af878a52e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af56ffeb4c4c4c8672c66e2f6c9d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:46:28.356634 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-337df57f-cc9c-45ff-88fa-eed169db6667 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07259157650043f09c677af878a52e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af56ffeb4c4c4c8672c66e2f6c9d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:46:28.360546 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-337df57f-cc9c-45ff-88fa-eed169db6667 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] 10.222.0.52 "GET /compute/v2.1/servers/1e03aef5-c628-4472-adc9-16ad1c768364" status: 200 len: 1363 microversion: 2.57 time: 0.297023 Oct 19 03:46:28.364567 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3057/6042] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:46:28 2022] GET /compute/v2.1/servers/1e03aef5-c628-4472-adc9-16ad1c768364 => generated 1363 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:46:29.389664 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-835f2750-4f97-4026-8db3-25c3f51331a2 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:46:29.390364 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-835f2750-4f97-4026-8db3-25c3f51331a2 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] [instance: 1e03aef5-c628-4472-adc9-16ad1c768364] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:46:29.401678 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-835f2750-4f97-4026-8db3-25c3f51331a2 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:46:29.406125 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-835f2750-4f97-4026-8db3-25c3f51331a2 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:46:29.406829 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-835f2750-4f97-4026-8db3-25c3f51331a2 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:46:29.408814 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-835f2750-4f97-4026-8db3-25c3f51331a2 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:46:29.409535 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-835f2750-4f97-4026-8db3-25c3f51331a2 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:46:29.409978 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-835f2750-4f97-4026-8db3-25c3f51331a2 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:46:29.573248 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-835f2750-4f97-4026-8db3-25c3f51331a2 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07259157650043f09c677af878a52e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af56ffeb4c4c4c8672c66e2f6c9d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:46:29.592406 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-835f2750-4f97-4026-8db3-25c3f51331a2 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07259157650043f09c677af878a52e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af56ffeb4c4c4c8672c66e2f6c9d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:46:29.594154 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-835f2750-4f97-4026-8db3-25c3f51331a2 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07259157650043f09c677af878a52e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af56ffeb4c4c4c8672c66e2f6c9d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:46:29.600022 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-835f2750-4f97-4026-8db3-25c3f51331a2 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] 10.222.0.52 "GET /compute/v2.1/servers/1e03aef5-c628-4472-adc9-16ad1c768364" status: 200 len: 1363 microversion: 2.57 time: 0.210656 Oct 19 03:46:29.600022 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2986/6043] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:46:29 2022] GET /compute/v2.1/servers/1e03aef5-c628-4472-adc9-16ad1c768364 => generated 1363 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:46:30.622745 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f708d55d-3bae-422a-9f48-1f24b1991d1b tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:46:30.624216 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f708d55d-3bae-422a-9f48-1f24b1991d1b tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] [instance: 1e03aef5-c628-4472-adc9-16ad1c768364] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:46:30.631983 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f708d55d-3bae-422a-9f48-1f24b1991d1b tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:46:30.633565 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f708d55d-3bae-422a-9f48-1f24b1991d1b tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:46:30.634398 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f708d55d-3bae-422a-9f48-1f24b1991d1b tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:46:30.635133 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f708d55d-3bae-422a-9f48-1f24b1991d1b tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:46:30.635656 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f708d55d-3bae-422a-9f48-1f24b1991d1b tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:46:30.636538 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f708d55d-3bae-422a-9f48-1f24b1991d1b tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:46:30.695375 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f708d55d-3bae-422a-9f48-1f24b1991d1b tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:46:30.696028 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f708d55d-3bae-422a-9f48-1f24b1991d1b tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:46:30.696603 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f708d55d-3bae-422a-9f48-1f24b1991d1b tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:46:30.697207 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-f708d55d-3bae-422a-9f48-1f24b1991d1b tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lazy-loading 'fault' on Instance uuid 1e03aef5-c628-4472-adc9-16ad1c768364 {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:46:30.770730 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f708d55d-3bae-422a-9f48-1f24b1991d1b tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07259157650043f09c677af878a52e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af56ffeb4c4c4c8672c66e2f6c9d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:46:30.780268 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f708d55d-3bae-422a-9f48-1f24b1991d1b tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07259157650043f09c677af878a52e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af56ffeb4c4c4c8672c66e2f6c9d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:46:30.782248 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f708d55d-3bae-422a-9f48-1f24b1991d1b tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07259157650043f09c677af878a52e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04af56ffeb4c4c4c8672c66e2f6c9d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:46:30.785011 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f708d55d-3bae-422a-9f48-1f24b1991d1b tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] 10.222.0.52 "GET /compute/v2.1/servers/1e03aef5-c628-4472-adc9-16ad1c768364" status: 200 len: 1368 microversion: 2.57 time: 0.165443 Oct 19 03:46:30.785895 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3058/6044] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:46:30 2022] GET /compute/v2.1/servers/1e03aef5-c628-4472-adc9-16ad1c768364 => generated 1368 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:46:31.817782 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f3c47648-eaae-4352-ad86-9dad3bb02e04 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:46:31.819042 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f3c47648-eaae-4352-ad86-9dad3bb02e04 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] [instance: 1e03aef5-c628-4472-adc9-16ad1c768364] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:46:31.827054 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f3c47648-eaae-4352-ad86-9dad3bb02e04 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:46:31.827753 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f3c47648-eaae-4352-ad86-9dad3bb02e04 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:46:31.828377 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f3c47648-eaae-4352-ad86-9dad3bb02e04 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:46:31.829274 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f3c47648-eaae-4352-ad86-9dad3bb02e04 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:46:31.829981 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f3c47648-eaae-4352-ad86-9dad3bb02e04 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:46:31.830423 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f3c47648-eaae-4352-ad86-9dad3bb02e04 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:46:31.865331 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-f3c47648-eaae-4352-ad86-9dad3bb02e04 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] HTTP exception thrown: Instance 1e03aef5-c628-4472-adc9-16ad1c768364 could not be found. Oct 19 03:46:31.873412 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f3c47648-eaae-4352-ad86-9dad3bb02e04 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Request method failure captured: Oct 19 03:46:31.873412 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/1e03aef5-c628-4472-adc9-16ad1c768364 HTTP/1.1 Oct 19 03:46:31.873412 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:46:31.873412 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:46:31.873412 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:46:31.873412 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:46:31.873412 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:46:31.873412 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:46:31.873412 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:46:31.873412 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:46:31.873412 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3LoCX7pJqLyoZ-AeezTkFrbLy-Bq1Ix-ffi8nkLDH_5kkcP8KQ7vM6cQaU58pa6Eb6AwniIbywOZspJLdIGEs2SVzK89kshidJca71g9USoWGVfgPuUnLd8DSjdD9BQB8MN6SGCYA0WgA55Zpo4GlgBPw8x2RaKQ-iA3HKA1lZ2MtM Oct 19 03:46:31.873412 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:46:31.873412 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:46:31.873412 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:46:31.873412 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:46:31.873412 n-d-861333-8 devstack@n-api.service[121134]: X-Openstack-Nova-Api-Version: 2.57 Oct 19 03:46:31.873412 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:46:31.873412 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:46:31.873412 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 04af56ffeb4c4c4c8672c66e2f6c9d46 Oct 19 03:46:31.873412 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ServerShowV257Test-2095675123 Oct 19 03:46:31.873412 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:46:31.873412 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:46:31.873412 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/04af56ffeb4c4c4c8672c66e2f6c9d46"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/04af56ffeb4c4c4c8672c66e2f6c9d46"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/04af56ffeb4c4c4c8672c66e2f6c9d46"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_04af56ffeb4c4c4c8672c66e2f6c9d46", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:46:31.873412 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ServerShowV257Test-2095675123 Oct 19 03:46:31.873412 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 04af56ffeb4c4c4c8672c66e2f6c9d46 Oct 19 03:46:31.873412 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ServerShowV257Test-2095675123 Oct 19 03:46:31.873412 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ServerShowV257Test-2095675123-project Oct 19 03:46:31.873412 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:46:31.873412 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:46:31.873412 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 07259157650043f09c677af878a52e69 Oct 19 03:46:31.873412 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ServerShowV257Test-2095675123-project Oct 19 03:46:31.873412 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:46:31.873412 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance 1e03aef5-c628-4472-adc9-16ad1c768364 could not be found. Oct 19 03:46:31.873412 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '1e03aef5-c628-4472-adc9-16ad1c768364'} Oct 19 03:46:31.873412 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:46:31.873412 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:46:31.873412 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:46:31.873412 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:46:31.873412 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:46:31.873412 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:46:31.873412 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:46:31.873412 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:46:31.873412 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:46:31.873412 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:46:31.873412 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e03aef5-c628-4472-adc9-16ad1c768364 could not be found. Oct 19 03:46:31.873412 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:46:31.873412 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:46:31.873412 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:46:31.873412 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:46:31.873412 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:46:31.873412 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:46:31.873412 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:46:31.873412 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:46:31.873412 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:46:31.873412 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:46:31.873412 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:46:31.873412 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:46:31.873412 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:46:31.873412 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:46:31.873412 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:46:31.873412 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:46:31.873412 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e03aef5-c628-4472-adc9-16ad1c768364 could not be found. Oct 19 03:46:31.873412 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:46:31.873412 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:46:31.873412 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:46:31.878641 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:46:31.878641 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:46:31.878641 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:46:31.878641 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:46:31.878641 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:46:31.878641 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e03aef5-c628-4472-adc9-16ad1c768364 could not be found. Oct 19 03:46:31.878641 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:46:31.878641 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f3c47648-eaae-4352-ad86-9dad3bb02e04 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] Returning 404 to user: Instance 1e03aef5-c628-4472-adc9-16ad1c768364 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:46:31.878641 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f3c47648-eaae-4352-ad86-9dad3bb02e04 tempest-ServerShowV257Test-2095675123 tempest-ServerShowV257Test-2095675123-project] 10.222.0.52 "GET /compute/v2.1/servers/1e03aef5-c628-4472-adc9-16ad1c768364" status: 404 len: 111 microversion: 2.57 time: 0.062090 Oct 19 03:46:31.879420 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2987/6045] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:46:31 2022] GET /compute/v2.1/servers/1e03aef5-c628-4472-adc9-16ad1c768364 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 19 03:46:43.474095 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=29 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:46:43.475847 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=57 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:46:43.639203 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9f5b6eb0-2bea-4985-8d76-092ee967d0ae tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Action: 'create', calling method: .version_select at 0x7fc130207af0>, body: {"keypair": {"name": "tempest-keypair-2055193955", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOaEHNgxBCnyGKYUBH5OLzf1sZ8R0ofuZRFbZFknSiOoFOR1VERXj21Bip6yIMQi5IYSgItsh6taVDrB0nElXVnkBoABCuLdwQH8cEZ8hi2lpcVWLi04GaibW00Y4dAwfg=="}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:46:43.656556 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-9f5b6eb0-2bea-4985-8d76-092ee967d0ae tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Getting quotas for project c2dfa644c780498a9d9ab24938903dd7. Resources: {'key_pairs'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:46:43.670216 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-9f5b6eb0-2bea-4985-8d76-092ee967d0ae tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Getting quotas for user 43f8869bb2c44a1f814d5da9e5d1a39d and project c2dfa644c780498a9d9ab24938903dd7. Resources: {'key_pairs'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:46:43.760031 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9f5b6eb0-2bea-4985-8d76-092ee967d0ae tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.302268 Oct 19 03:46:43.767016 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3059/6046] 10.222.0.52 () {62 vars in 1200 bytes} [Wed Oct 19 03:46:43 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 304 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 19 03:46:47.361645 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-dddf19b2-9992-4445-b7ad-c605680fdf5c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-807696299", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5a742c06-4978-4adc-92a1-26af959be6df"}], "security_groups": [{"name": "tempest-securitygroup--1486885474"}], "key_name": "tempest-keypair-2055193955", "user_data": "}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:46:47.376854 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:46:47.378170 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:46:47.591045 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-dddf19b2-9992-4445-b7ad-c605680fdf5c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] validate_networks() for [('5a742c06-4978-4adc-92a1-26af959be6df', None, None, None, None, None)] {{(pid=121134) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:46:48.789646 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-dddf19b2-9992-4445-b7ad-c605680fdf5c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Flavor limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:46:48.790409 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-dddf19b2-9992-4445-b7ad-c605680fdf5c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Image limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:46:48.790729 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-dddf19b2-9992-4445-b7ad-c605680fdf5c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Flavor pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:46:48.791910 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-dddf19b2-9992-4445-b7ad-c605680fdf5c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Image pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:46:48.792503 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-dddf19b2-9992-4445-b7ad-c605680fdf5c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:46:48.808340 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dddf19b2-9992-4445-b7ad-c605680fdf5c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:46:48.808845 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dddf19b2-9992-4445-b7ad-c605680fdf5c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:46:48.809694 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dddf19b2-9992-4445-b7ad-c605680fdf5c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:46:48.812010 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dddf19b2-9992-4445-b7ad-c605680fdf5c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:46:48.812701 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dddf19b2-9992-4445-b7ad-c605680fdf5c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:46:48.813390 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dddf19b2-9992-4445-b7ad-c605680fdf5c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:46:48.850685 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-dddf19b2-9992-4445-b7ad-c605680fdf5c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Getting quotas for project c2dfa644c780498a9d9ab24938903dd7. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:46:48.863582 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-dddf19b2-9992-4445-b7ad-c605680fdf5c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Getting quotas for user 43f8869bb2c44a1f814d5da9e5d1a39d and project c2dfa644c780498a9d9ab24938903dd7. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:46:48.894077 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-dddf19b2-9992-4445-b7ad-c605680fdf5c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Going to run 1 instances... {{(pid=121134) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:46:48.896932 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-dddf19b2-9992-4445-b7ad-c605680fdf5c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 89f2e52f-afcb-49bf-a39a-4b442a96eba8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:46:49.113461 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-dddf19b2-9992-4445-b7ad-c605680fdf5c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.758059 Oct 19 03:46:49.120529 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2988/6047] 10.222.0.52 () {62 vars in 1188 bytes} [Wed Oct 19 03:46:47 2022] POST /compute/v2.1/servers => generated 402 bytes in 1760 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 19 03:46:49.126145 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-da27b280-a159-441b-b1e5-ff08ef656fc4 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:46:49.129230 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-da27b280-a159-441b-b1e5-ff08ef656fc4 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 89f2e52f-afcb-49bf-a39a-4b442a96eba8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:46:49.226002 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-da27b280-a159-441b-b1e5-ff08ef656fc4 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:46:49.239039 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-da27b280-a159-441b-b1e5-ff08ef656fc4 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:46:49.245676 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-da27b280-a159-441b-b1e5-ff08ef656fc4 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:46:49.247224 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-da27b280-a159-441b-b1e5-ff08ef656fc4 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8" status: 200 len: 1281 microversion: 2.20 time: 0.125472 Oct 19 03:46:49.250434 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3060/6048] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:46:49 2022] GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8 => generated 1281 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:46:50.281901 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6642c5bf-f121-4977-bb97-879268bfb8d0 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:46:50.283432 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6642c5bf-f121-4977-bb97-879268bfb8d0 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 89f2e52f-afcb-49bf-a39a-4b442a96eba8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:46:50.694016 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-6642c5bf-f121-4977-bb97-879268bfb8d0 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:46:50.702766 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-6642c5bf-f121-4977-bb97-879268bfb8d0 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:46:50.707032 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-6642c5bf-f121-4977-bb97-879268bfb8d0 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:46:50.708366 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6642c5bf-f121-4977-bb97-879268bfb8d0 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8" status: 200 len: 1281 microversion: 2.20 time: 0.432647 Oct 19 03:46:50.708934 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2989/6049] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:46:50 2022] GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8 => generated 1281 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:46:51.739589 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-40ccb820-ae2b-4247-bb1c-42b230fcbfa9 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:46:51.740855 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-40ccb820-ae2b-4247-bb1c-42b230fcbfa9 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 89f2e52f-afcb-49bf-a39a-4b442a96eba8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:46:51.751098 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-40ccb820-ae2b-4247-bb1c-42b230fcbfa9 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:46:51.751098 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-40ccb820-ae2b-4247-bb1c-42b230fcbfa9 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:46:51.751098 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-40ccb820-ae2b-4247-bb1c-42b230fcbfa9 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:46:51.751682 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-40ccb820-ae2b-4247-bb1c-42b230fcbfa9 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:46:51.752471 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-40ccb820-ae2b-4247-bb1c-42b230fcbfa9 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:46:51.753176 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-40ccb820-ae2b-4247-bb1c-42b230fcbfa9 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:46:51.870127 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-40ccb820-ae2b-4247-bb1c-42b230fcbfa9 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:46:51.879866 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-40ccb820-ae2b-4247-bb1c-42b230fcbfa9 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:46:51.881342 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-40ccb820-ae2b-4247-bb1c-42b230fcbfa9 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:46:51.882526 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-40ccb820-ae2b-4247-bb1c-42b230fcbfa9 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8" status: 200 len: 1333 microversion: 2.20 time: 0.148135 Oct 19 03:46:51.883609 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3061/6050] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:46:51 2022] GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8 => generated 1333 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:46:52.931567 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ace4fdd4-98ee-4c98-8b4c-df11370c1f35 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:46:52.931567 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ace4fdd4-98ee-4c98-8b4c-df11370c1f35 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 89f2e52f-afcb-49bf-a39a-4b442a96eba8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:46:52.938723 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ace4fdd4-98ee-4c98-8b4c-df11370c1f35 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:46:52.944108 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ace4fdd4-98ee-4c98-8b4c-df11370c1f35 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:46:52.944108 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ace4fdd4-98ee-4c98-8b4c-df11370c1f35 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:46:52.946454 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ace4fdd4-98ee-4c98-8b4c-df11370c1f35 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:46:52.946956 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ace4fdd4-98ee-4c98-8b4c-df11370c1f35 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:46:52.949786 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ace4fdd4-98ee-4c98-8b4c-df11370c1f35 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:46:53.196373 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ace4fdd4-98ee-4c98-8b4c-df11370c1f35 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:46:53.208464 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ace4fdd4-98ee-4c98-8b4c-df11370c1f35 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:46:53.210021 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ace4fdd4-98ee-4c98-8b4c-df11370c1f35 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:46:53.212248 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ace4fdd4-98ee-4c98-8b4c-df11370c1f35 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8" status: 200 len: 1341 microversion: 2.20 time: 0.300011 Oct 19 03:46:53.219096 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2990/6051] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:46:52 2022] GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8 => generated 1341 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:46:54.254477 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-04582bf6-0f69-4441-af08-5eaf7acb7c70 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:46:54.255650 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-04582bf6-0f69-4441-af08-5eaf7acb7c70 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 89f2e52f-afcb-49bf-a39a-4b442a96eba8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:46:54.273062 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-04582bf6-0f69-4441-af08-5eaf7acb7c70 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:46:54.278999 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-04582bf6-0f69-4441-af08-5eaf7acb7c70 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:46:54.279488 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-04582bf6-0f69-4441-af08-5eaf7acb7c70 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:46:54.284222 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-04582bf6-0f69-4441-af08-5eaf7acb7c70 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:46:54.286023 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-04582bf6-0f69-4441-af08-5eaf7acb7c70 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:46:54.292157 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-04582bf6-0f69-4441-af08-5eaf7acb7c70 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:46:54.745510 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-04582bf6-0f69-4441-af08-5eaf7acb7c70 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:46:54.758666 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-04582bf6-0f69-4441-af08-5eaf7acb7c70 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:46:54.765784 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-04582bf6-0f69-4441-af08-5eaf7acb7c70 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:46:54.767055 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-04582bf6-0f69-4441-af08-5eaf7acb7c70 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8" status: 200 len: 1407 microversion: 2.20 time: 0.518103 Oct 19 03:46:54.771840 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3062/6052] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:46:54 2022] GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8 => generated 1407 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:46:55.796102 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2fb98588-10db-47f2-8d5c-92c71feb892f tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:46:55.797331 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2fb98588-10db-47f2-8d5c-92c71feb892f tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 89f2e52f-afcb-49bf-a39a-4b442a96eba8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:46:55.808285 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2fb98588-10db-47f2-8d5c-92c71feb892f tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:46:55.819117 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2fb98588-10db-47f2-8d5c-92c71feb892f tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:46:55.824273 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2fb98588-10db-47f2-8d5c-92c71feb892f tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:46:55.825253 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2fb98588-10db-47f2-8d5c-92c71feb892f tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:46:55.825760 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2fb98588-10db-47f2-8d5c-92c71feb892f tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:46:55.826200 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2fb98588-10db-47f2-8d5c-92c71feb892f tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:46:55.864913 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-50deae5e-3768-4cd0-b912-3294e215d703 req-28e50b27-794d-4746-b439-35ae0938e563 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89f2e52f-afcb-49bf-a39a-4b442a96eba8", "tag": "916e68b3-4b4b-48a3-9beb-6bf56116fff0"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:46:55.888405 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-50deae5e-3768-4cd0-b912-3294e215d703 req-28e50b27-794d-4746-b439-35ae0938e563 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:46:55.904179 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-50deae5e-3768-4cd0-b912-3294e215d703 req-28e50b27-794d-4746-b439-35ae0938e563 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:46:55.904179 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-50deae5e-3768-4cd0-b912-3294e215d703 req-28e50b27-794d-4746-b439-35ae0938e563 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:46:55.922005 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-50deae5e-3768-4cd0-b912-3294e215d703 req-28e50b27-794d-4746-b439-35ae0938e563 service nova] Creating event network-changed:916e68b3-4b4b-48a3-9beb-6bf56116fff0 for instance 89f2e52f-afcb-49bf-a39a-4b442a96eba8 on n-h2-861333-8 Oct 19 03:46:55.929028 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-50deae5e-3768-4cd0-b912-3294e215d703 req-28e50b27-794d-4746-b439-35ae0938e563 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076452 Oct 19 03:46:55.938775 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3063/6053] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:46:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:46:56.305421 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-2fb98588-10db-47f2-8d5c-92c71feb892f tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:46:56.329429 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-2fb98588-10db-47f2-8d5c-92c71feb892f tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:46:56.332369 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-2fb98588-10db-47f2-8d5c-92c71feb892f tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:46:56.333600 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2fb98588-10db-47f2-8d5c-92c71feb892f tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8" status: 200 len: 1407 microversion: 2.20 time: 0.541250 Oct 19 03:46:56.338138 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2991/6054] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:46:55 2022] GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8 => generated 1407 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:46:57.365994 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-fa8677c1-43c1-4c67-857d-406063227c93 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:46:57.367467 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-fa8677c1-43c1-4c67-857d-406063227c93 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 89f2e52f-afcb-49bf-a39a-4b442a96eba8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:46:57.379757 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fa8677c1-43c1-4c67-857d-406063227c93 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:46:57.380524 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fa8677c1-43c1-4c67-857d-406063227c93 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:46:57.381213 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fa8677c1-43c1-4c67-857d-406063227c93 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:46:57.383387 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fa8677c1-43c1-4c67-857d-406063227c93 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:46:57.385862 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fa8677c1-43c1-4c67-857d-406063227c93 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:46:57.386559 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fa8677c1-43c1-4c67-857d-406063227c93 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:46:57.615536 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-fa8677c1-43c1-4c67-857d-406063227c93 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:46:57.633171 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-fa8677c1-43c1-4c67-857d-406063227c93 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:46:57.639987 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-fa8677c1-43c1-4c67-857d-406063227c93 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:46:57.642642 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-fa8677c1-43c1-4c67-857d-406063227c93 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8" status: 200 len: 1407 microversion: 2.20 time: 0.282171 Oct 19 03:46:57.643731 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3064/6055] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:46:57 2022] GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8 => generated 1407 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:46:58.682740 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-46b2108b-ac7b-4ab4-bc18-7b4c2c089d43 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:46:58.682740 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-46b2108b-ac7b-4ab4-bc18-7b4c2c089d43 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 89f2e52f-afcb-49bf-a39a-4b442a96eba8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:46:58.689353 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-46b2108b-ac7b-4ab4-bc18-7b4c2c089d43 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:46:58.689941 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-46b2108b-ac7b-4ab4-bc18-7b4c2c089d43 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:46:58.690757 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-46b2108b-ac7b-4ab4-bc18-7b4c2c089d43 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:46:58.691546 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-46b2108b-ac7b-4ab4-bc18-7b4c2c089d43 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:46:58.692079 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-46b2108b-ac7b-4ab4-bc18-7b4c2c089d43 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:46:58.693312 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-46b2108b-ac7b-4ab4-bc18-7b4c2c089d43 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:46:58.823596 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:46:58.841671 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-46b2108b-ac7b-4ab4-bc18-7b4c2c089d43 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:46:58.854066 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-46b2108b-ac7b-4ab4-bc18-7b4c2c089d43 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:46:58.855475 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-46b2108b-ac7b-4ab4-bc18-7b4c2c089d43 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:46:58.856826 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-46b2108b-ac7b-4ab4-bc18-7b4c2c089d43 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8" status: 200 len: 1407 microversion: 2.20 time: 0.185429 Oct 19 03:46:58.857709 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2992/6056] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:46:58 2022] GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8 => generated 1407 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:46:59.887418 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-533df07f-aea5-49bd-8073-c31ce3f1a2c4 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:46:59.888100 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-533df07f-aea5-49bd-8073-c31ce3f1a2c4 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 89f2e52f-afcb-49bf-a39a-4b442a96eba8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:46:59.890768 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=6 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:46:59.899176 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-533df07f-aea5-49bd-8073-c31ce3f1a2c4 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:46:59.899176 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-533df07f-aea5-49bd-8073-c31ce3f1a2c4 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:46:59.899176 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-533df07f-aea5-49bd-8073-c31ce3f1a2c4 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:46:59.899176 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-533df07f-aea5-49bd-8073-c31ce3f1a2c4 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:46:59.899176 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-533df07f-aea5-49bd-8073-c31ce3f1a2c4 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:46:59.899176 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-533df07f-aea5-49bd-8073-c31ce3f1a2c4 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:47:00.040434 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-533df07f-aea5-49bd-8073-c31ce3f1a2c4 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:47:00.049917 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-533df07f-aea5-49bd-8073-c31ce3f1a2c4 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:47:00.051414 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-533df07f-aea5-49bd-8073-c31ce3f1a2c4 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:47:00.052538 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-533df07f-aea5-49bd-8073-c31ce3f1a2c4 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8" status: 200 len: 1407 microversion: 2.20 time: 0.169116 Oct 19 03:47:00.053109 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3065/6057] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:46:59 2022] GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8 => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:47:01.078952 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b928a5d5-9e08-4a5d-bb24-96795ba3c6f3 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:47:01.079574 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b928a5d5-9e08-4a5d-bb24-96795ba3c6f3 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 89f2e52f-afcb-49bf-a39a-4b442a96eba8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:47:01.082354 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=8 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:47:01.087427 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b928a5d5-9e08-4a5d-bb24-96795ba3c6f3 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:47:01.087978 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b928a5d5-9e08-4a5d-bb24-96795ba3c6f3 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:47:01.088466 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b928a5d5-9e08-4a5d-bb24-96795ba3c6f3 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:47:01.089183 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b928a5d5-9e08-4a5d-bb24-96795ba3c6f3 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:47:01.089964 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b928a5d5-9e08-4a5d-bb24-96795ba3c6f3 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:47:01.090237 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b928a5d5-9e08-4a5d-bb24-96795ba3c6f3 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:47:01.251459 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b928a5d5-9e08-4a5d-bb24-96795ba3c6f3 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:47:01.262421 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b928a5d5-9e08-4a5d-bb24-96795ba3c6f3 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:47:01.267912 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b928a5d5-9e08-4a5d-bb24-96795ba3c6f3 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:47:01.267912 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b928a5d5-9e08-4a5d-bb24-96795ba3c6f3 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8" status: 200 len: 1407 microversion: 2.20 time: 0.191236 Oct 19 03:47:01.267912 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2993/6058] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:47:01 2022] GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8 => generated 1407 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:47:02.292978 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1ef04b3c-9a30-40e6-bd87-6c94a4b79044 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:47:02.295306 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1ef04b3c-9a30-40e6-bd87-6c94a4b79044 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 89f2e52f-afcb-49bf-a39a-4b442a96eba8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:47:02.305487 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1ef04b3c-9a30-40e6-bd87-6c94a4b79044 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:47:02.313622 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1ef04b3c-9a30-40e6-bd87-6c94a4b79044 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:47:02.313622 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1ef04b3c-9a30-40e6-bd87-6c94a4b79044 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:47:02.313622 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1ef04b3c-9a30-40e6-bd87-6c94a4b79044 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:47:02.313622 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1ef04b3c-9a30-40e6-bd87-6c94a4b79044 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:47:02.313622 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1ef04b3c-9a30-40e6-bd87-6c94a4b79044 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:47:02.506320 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-1ef04b3c-9a30-40e6-bd87-6c94a4b79044 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:47:02.515179 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-1ef04b3c-9a30-40e6-bd87-6c94a4b79044 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:47:02.516646 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-1ef04b3c-9a30-40e6-bd87-6c94a4b79044 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:47:02.517800 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1ef04b3c-9a30-40e6-bd87-6c94a4b79044 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8" status: 200 len: 1407 microversion: 2.20 time: 0.229359 Oct 19 03:47:02.518392 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3066/6059] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:47:02 2022] GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8 => generated 1407 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:47:03.543503 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-61ad07ea-5a6c-4d28-91d9-83e30af05ed9 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:47:03.546631 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-61ad07ea-5a6c-4d28-91d9-83e30af05ed9 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 89f2e52f-afcb-49bf-a39a-4b442a96eba8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:47:03.552038 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-61ad07ea-5a6c-4d28-91d9-83e30af05ed9 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:47:03.552798 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-61ad07ea-5a6c-4d28-91d9-83e30af05ed9 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:47:03.553473 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-61ad07ea-5a6c-4d28-91d9-83e30af05ed9 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:47:03.554466 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-61ad07ea-5a6c-4d28-91d9-83e30af05ed9 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:47:03.562773 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-61ad07ea-5a6c-4d28-91d9-83e30af05ed9 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:47:03.563556 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-61ad07ea-5a6c-4d28-91d9-83e30af05ed9 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:47:03.740204 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-61ad07ea-5a6c-4d28-91d9-83e30af05ed9 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:47:03.755156 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-61ad07ea-5a6c-4d28-91d9-83e30af05ed9 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:47:03.755156 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-61ad07ea-5a6c-4d28-91d9-83e30af05ed9 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:47:03.755156 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-61ad07ea-5a6c-4d28-91d9-83e30af05ed9 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8" status: 200 len: 1407 microversion: 2.20 time: 0.214784 Oct 19 03:47:03.755156 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2994/6060] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:47:03 2022] GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8 => generated 1407 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:47:03.866137 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-18e020a0-64ac-4711-8fa9-bf8d1bea4e4b req-b9db6035-366e-4649-b5ea-78a0202560a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89f2e52f-afcb-49bf-a39a-4b442a96eba8", "name": "network-vif-plugged", "status": "completed", "tag": "916e68b3-4b4b-48a3-9beb-6bf56116fff0"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:47:03.896637 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-18e020a0-64ac-4711-8fa9-bf8d1bea4e4b req-b9db6035-366e-4649-b5ea-78a0202560a6 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:47:03.896637 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-18e020a0-64ac-4711-8fa9-bf8d1bea4e4b req-b9db6035-366e-4649-b5ea-78a0202560a6 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:47:03.896637 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-18e020a0-64ac-4711-8fa9-bf8d1bea4e4b req-b9db6035-366e-4649-b5ea-78a0202560a6 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:47:03.896637 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-18e020a0-64ac-4711-8fa9-bf8d1bea4e4b req-b9db6035-366e-4649-b5ea-78a0202560a6 service nova] Creating event network-vif-plugged:916e68b3-4b4b-48a3-9beb-6bf56116fff0 for instance 89f2e52f-afcb-49bf-a39a-4b442a96eba8 on n-h2-861333-8 Oct 19 03:47:03.902171 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-18e020a0-64ac-4711-8fa9-bf8d1bea4e4b req-b9db6035-366e-4649-b5ea-78a0202560a6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045020 Oct 19 03:47:03.903105 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3067/6061] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:47:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:47:04.781777 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-32f1a7a1-2009-4c98-bad6-721ba9bd5aca tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:47:04.783164 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-32f1a7a1-2009-4c98-bad6-721ba9bd5aca tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 89f2e52f-afcb-49bf-a39a-4b442a96eba8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:47:04.791873 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-32f1a7a1-2009-4c98-bad6-721ba9bd5aca tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:47:04.792437 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-32f1a7a1-2009-4c98-bad6-721ba9bd5aca tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:47:04.795516 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-32f1a7a1-2009-4c98-bad6-721ba9bd5aca tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:47:04.795516 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-32f1a7a1-2009-4c98-bad6-721ba9bd5aca tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:47:04.795516 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-32f1a7a1-2009-4c98-bad6-721ba9bd5aca tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:47:04.795516 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-32f1a7a1-2009-4c98-bad6-721ba9bd5aca tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:47:04.951952 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-32f1a7a1-2009-4c98-bad6-721ba9bd5aca tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:47:04.962113 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-32f1a7a1-2009-4c98-bad6-721ba9bd5aca tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:47:04.964751 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-32f1a7a1-2009-4c98-bad6-721ba9bd5aca tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:47:04.966103 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-32f1a7a1-2009-4c98-bad6-721ba9bd5aca tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8" status: 200 len: 1407 microversion: 2.20 time: 0.188359 Oct 19 03:47:04.977815 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2995/6062] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:47:04 2022] GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8 => generated 1407 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:47:05.993930 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-bb47e108-b587-4e16-8cda-a672513b72d2 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:47:05.994628 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-bb47e108-b587-4e16-8cda-a672513b72d2 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 89f2e52f-afcb-49bf-a39a-4b442a96eba8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:47:06.001298 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bb47e108-b587-4e16-8cda-a672513b72d2 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:47:06.004849 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bb47e108-b587-4e16-8cda-a672513b72d2 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:47:06.004849 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bb47e108-b587-4e16-8cda-a672513b72d2 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:47:06.004849 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bb47e108-b587-4e16-8cda-a672513b72d2 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:47:06.004849 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bb47e108-b587-4e16-8cda-a672513b72d2 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:47:06.004849 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bb47e108-b587-4e16-8cda-a672513b72d2 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:47:06.157602 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-bb47e108-b587-4e16-8cda-a672513b72d2 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:47:06.166777 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-bb47e108-b587-4e16-8cda-a672513b72d2 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:47:06.169439 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-bb47e108-b587-4e16-8cda-a672513b72d2 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:47:06.171312 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-bb47e108-b587-4e16-8cda-a672513b72d2 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8" status: 200 len: 1599 microversion: 2.20 time: 0.182921 Oct 19 03:47:06.189868 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3068/6063] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:47:05 2022] GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8 => generated 1599 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:47:06.201169 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-19cf28c1-cc99-40f0-ada0-4b28de8a866a tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:47:06.201956 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-19cf28c1-cc99-40f0-ada0-4b28de8a866a tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 89f2e52f-afcb-49bf-a39a-4b442a96eba8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:47:06.210408 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-19cf28c1-cc99-40f0-ada0-4b28de8a866a tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:47:06.210875 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-19cf28c1-cc99-40f0-ada0-4b28de8a866a tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:47:06.211404 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-19cf28c1-cc99-40f0-ada0-4b28de8a866a tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:47:06.218199 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-19cf28c1-cc99-40f0-ada0-4b28de8a866a tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:47:06.218744 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-19cf28c1-cc99-40f0-ada0-4b28de8a866a tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:47:06.219229 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-19cf28c1-cc99-40f0-ada0-4b28de8a866a tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:47:06.341072 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-19cf28c1-cc99-40f0-ada0-4b28de8a866a tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.143977 Oct 19 03:47:06.342026 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2996/6064] 10.222.0.52 () {60 vars in 1316 bytes} [Wed Oct 19 03:47:06 2022] GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8/os-interface => generated 285 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 03:47:07.632568 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-b872498c-1cd8-4a11-a8b8-6a1f9bb36da5 req-84fb8105-195d-4ac1-9f42-2e9a1d8bfeb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89f2e52f-afcb-49bf-a39a-4b442a96eba8", "tag": "916e68b3-4b4b-48a3-9beb-6bf56116fff0"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:47:07.651053 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-b872498c-1cd8-4a11-a8b8-6a1f9bb36da5 req-84fb8105-195d-4ac1-9f42-2e9a1d8bfeb8 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:47:07.652349 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-b872498c-1cd8-4a11-a8b8-6a1f9bb36da5 req-84fb8105-195d-4ac1-9f42-2e9a1d8bfeb8 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:47:07.652946 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-b872498c-1cd8-4a11-a8b8-6a1f9bb36da5 req-84fb8105-195d-4ac1-9f42-2e9a1d8bfeb8 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:47:07.683526 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-b872498c-1cd8-4a11-a8b8-6a1f9bb36da5 req-84fb8105-195d-4ac1-9f42-2e9a1d8bfeb8 service nova] Creating event network-changed:916e68b3-4b4b-48a3-9beb-6bf56116fff0 for instance 89f2e52f-afcb-49bf-a39a-4b442a96eba8 on n-h2-861333-8 Oct 19 03:47:07.688001 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-b872498c-1cd8-4a11-a8b8-6a1f9bb36da5 req-84fb8105-195d-4ac1-9f42-2e9a1d8bfeb8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059391 Oct 19 03:47:07.688774 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3069/6065] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:47:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:47:43.140603 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:47:43.141437 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=42 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:47:43.142407 n-d-861333-8 devstack@n-api.service[121134]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 03:47:43.142562 n-d-861333-8 devstack@n-api.service[121134]: Wed Oct 19 03:47:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8/ips (ip 10.222.0.52) !!! Oct 19 03:47:43.147044 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e20d3df5-344b-4009-9e68-8a32ad4bee30 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:47:43.147542 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e20d3df5-344b-4009-9e68-8a32ad4bee30 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 89f2e52f-afcb-49bf-a39a-4b442a96eba8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:47:43.154565 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e20d3df5-344b-4009-9e68-8a32ad4bee30 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:47:43.155054 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e20d3df5-344b-4009-9e68-8a32ad4bee30 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:47:43.155691 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e20d3df5-344b-4009-9e68-8a32ad4bee30 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:47:43.156593 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e20d3df5-344b-4009-9e68-8a32ad4bee30 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:47:43.157056 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e20d3df5-344b-4009-9e68-8a32ad4bee30 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:47:43.157536 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e20d3df5-344b-4009-9e68-8a32ad4bee30 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:47:43.186241 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e20d3df5-344b-4009-9e68-8a32ad4bee30 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8/ips" status: 200 len: 152 microversion: 2.20 time: 0.047676 Oct 19 03:47:43.186825 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2997/6066] 10.222.0.52 () {60 vars in 1289 bytes} [Wed Oct 19 03:47:43 2022] GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8/ips => generated 152 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 03:47:46.688701 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:47:46.688701 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=42 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:47:46.689800 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6c62a339-4153-4062-bc16-28984d92f215 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:47:46.690654 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6c62a339-4153-4062-bc16-28984d92f215 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 89f2e52f-afcb-49bf-a39a-4b442a96eba8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:47:46.697842 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6c62a339-4153-4062-bc16-28984d92f215 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:47:46.698335 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6c62a339-4153-4062-bc16-28984d92f215 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:47:46.698776 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6c62a339-4153-4062-bc16-28984d92f215 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:47:46.699505 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6c62a339-4153-4062-bc16-28984d92f215 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:47:46.699962 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6c62a339-4153-4062-bc16-28984d92f215 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:47:46.700393 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6c62a339-4153-4062-bc16-28984d92f215 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:47:46.724008 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-6c62a339-4153-4062-bc16-28984d92f215 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lazy-loading 'flavor' on Instance uuid 89f2e52f-afcb-49bf-a39a-4b442a96eba8 {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:47:47.643458 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6c62a339-4153-4062-bc16-28984d92f215 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "POST /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8/action" status: 202 len: 0 microversion: 2.20 time: 0.962260 Oct 19 03:47:47.644550 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3070/6067] 10.222.0.52 () {62 vars in 1319 bytes} [Wed Oct 19 03:47:46 2022] POST /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8/action => generated 0 bytes in 964 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:47:47.660626 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d9be2dbe-4314-442d-863b-2e399a72d673 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:47:47.661963 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d9be2dbe-4314-442d-863b-2e399a72d673 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 89f2e52f-afcb-49bf-a39a-4b442a96eba8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:47:47.676098 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d9be2dbe-4314-442d-863b-2e399a72d673 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:47:47.676797 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d9be2dbe-4314-442d-863b-2e399a72d673 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:47:47.677485 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d9be2dbe-4314-442d-863b-2e399a72d673 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:47:47.678577 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d9be2dbe-4314-442d-863b-2e399a72d673 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:47:47.679243 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d9be2dbe-4314-442d-863b-2e399a72d673 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:47:47.679678 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d9be2dbe-4314-442d-863b-2e399a72d673 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:47:47.967900 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d9be2dbe-4314-442d-863b-2e399a72d673 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:47:47.977538 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d9be2dbe-4314-442d-863b-2e399a72d673 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:47:47.980747 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d9be2dbe-4314-442d-863b-2e399a72d673 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:47:47.981848 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d9be2dbe-4314-442d-863b-2e399a72d673 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8" status: 200 len: 1724 microversion: 2.20 time: 0.332617 Oct 19 03:47:47.982657 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2998/6068] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:47:47 2022] GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8 => generated 1724 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:47:49.013053 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d9cb2403-9579-4df4-afd7-b73f070fe076 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:47:49.015940 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d9cb2403-9579-4df4-afd7-b73f070fe076 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 89f2e52f-afcb-49bf-a39a-4b442a96eba8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:47:49.028108 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d9cb2403-9579-4df4-afd7-b73f070fe076 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:47:49.028877 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d9cb2403-9579-4df4-afd7-b73f070fe076 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:47:49.029572 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d9cb2403-9579-4df4-afd7-b73f070fe076 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:47:49.030623 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d9cb2403-9579-4df4-afd7-b73f070fe076 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:47:49.031239 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d9cb2403-9579-4df4-afd7-b73f070fe076 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:47:49.032086 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d9cb2403-9579-4df4-afd7-b73f070fe076 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:47:49.196030 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d9cb2403-9579-4df4-afd7-b73f070fe076 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:47:49.206008 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d9cb2403-9579-4df4-afd7-b73f070fe076 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:47:49.207934 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d9cb2403-9579-4df4-afd7-b73f070fe076 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:47:49.209500 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d9cb2403-9579-4df4-afd7-b73f070fe076 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8" status: 200 len: 1724 microversion: 2.20 time: 0.204329 Oct 19 03:47:49.227590 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3071/6069] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:47:49 2022] GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8 => generated 1724 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:47:50.239445 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-bce1663d-93b5-412f-a7aa-75dc96dfc6c3 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:47:50.240723 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-bce1663d-93b5-412f-a7aa-75dc96dfc6c3 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 89f2e52f-afcb-49bf-a39a-4b442a96eba8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:47:50.253045 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bce1663d-93b5-412f-a7aa-75dc96dfc6c3 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:47:50.253848 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bce1663d-93b5-412f-a7aa-75dc96dfc6c3 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:47:50.254670 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bce1663d-93b5-412f-a7aa-75dc96dfc6c3 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:47:50.275115 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bce1663d-93b5-412f-a7aa-75dc96dfc6c3 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:47:50.276424 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bce1663d-93b5-412f-a7aa-75dc96dfc6c3 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:47:50.277100 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bce1663d-93b5-412f-a7aa-75dc96dfc6c3 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:47:50.466789 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-bce1663d-93b5-412f-a7aa-75dc96dfc6c3 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:47:50.510425 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-bce1663d-93b5-412f-a7aa-75dc96dfc6c3 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:47:50.510425 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-bce1663d-93b5-412f-a7aa-75dc96dfc6c3 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:47:50.510425 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-bce1663d-93b5-412f-a7aa-75dc96dfc6c3 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8" status: 200 len: 1724 microversion: 2.20 time: 0.246470 Oct 19 03:47:50.510425 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 2999/6070] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:47:50 2022] GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8 => generated 1724 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:47:51.520743 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9eab8485-eb98-4149-9bd1-171a1473084b tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:47:51.522905 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9eab8485-eb98-4149-9bd1-171a1473084b tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 89f2e52f-afcb-49bf-a39a-4b442a96eba8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:47:51.536658 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9eab8485-eb98-4149-9bd1-171a1473084b tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:47:51.540154 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9eab8485-eb98-4149-9bd1-171a1473084b tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:47:51.540847 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9eab8485-eb98-4149-9bd1-171a1473084b tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:47:51.541824 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9eab8485-eb98-4149-9bd1-171a1473084b tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:47:51.542460 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9eab8485-eb98-4149-9bd1-171a1473084b tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:47:51.548793 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9eab8485-eb98-4149-9bd1-171a1473084b tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:47:51.727520 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-9eab8485-eb98-4149-9bd1-171a1473084b tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:47:51.737159 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-9eab8485-eb98-4149-9bd1-171a1473084b tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:47:51.738676 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-9eab8485-eb98-4149-9bd1-171a1473084b tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:47:51.739996 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9eab8485-eb98-4149-9bd1-171a1473084b tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8" status: 200 len: 1724 microversion: 2.20 time: 0.223829 Oct 19 03:47:51.741079 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3072/6071] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:47:51 2022] GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8 => generated 1724 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:47:52.766092 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4a042b88-98d1-4950-bda3-8ad96b669c32 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:47:52.767644 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4a042b88-98d1-4950-bda3-8ad96b669c32 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 89f2e52f-afcb-49bf-a39a-4b442a96eba8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:47:52.773889 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4a042b88-98d1-4950-bda3-8ad96b669c32 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:47:52.774378 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4a042b88-98d1-4950-bda3-8ad96b669c32 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:47:52.774867 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4a042b88-98d1-4950-bda3-8ad96b669c32 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:47:52.775569 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4a042b88-98d1-4950-bda3-8ad96b669c32 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:47:52.776062 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4a042b88-98d1-4950-bda3-8ad96b669c32 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:47:52.776452 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4a042b88-98d1-4950-bda3-8ad96b669c32 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:47:52.921813 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-4a042b88-98d1-4950-bda3-8ad96b669c32 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:47:52.936076 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-4a042b88-98d1-4950-bda3-8ad96b669c32 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:47:52.937809 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-4a042b88-98d1-4950-bda3-8ad96b669c32 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:47:52.940732 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4a042b88-98d1-4950-bda3-8ad96b669c32 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8" status: 200 len: 1724 microversion: 2.20 time: 0.178498 Oct 19 03:47:52.941747 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3000/6072] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:47:52 2022] GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8 => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:47:53.969184 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-50ec90ec-13d2-46eb-8b66-42d1eb3c3de7 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:47:53.970444 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-50ec90ec-13d2-46eb-8b66-42d1eb3c3de7 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 89f2e52f-afcb-49bf-a39a-4b442a96eba8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:47:53.983330 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-50ec90ec-13d2-46eb-8b66-42d1eb3c3de7 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:47:53.984335 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-50ec90ec-13d2-46eb-8b66-42d1eb3c3de7 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:47:53.986189 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-50ec90ec-13d2-46eb-8b66-42d1eb3c3de7 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:47:53.988072 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-50ec90ec-13d2-46eb-8b66-42d1eb3c3de7 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:47:53.990897 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-50ec90ec-13d2-46eb-8b66-42d1eb3c3de7 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:47:53.991739 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-50ec90ec-13d2-46eb-8b66-42d1eb3c3de7 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:47:54.213628 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-50ec90ec-13d2-46eb-8b66-42d1eb3c3de7 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:47:54.222207 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-50ec90ec-13d2-46eb-8b66-42d1eb3c3de7 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:47:54.224663 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-50ec90ec-13d2-46eb-8b66-42d1eb3c3de7 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:47:54.226073 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-50ec90ec-13d2-46eb-8b66-42d1eb3c3de7 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8" status: 200 len: 1724 microversion: 2.20 time: 0.261170 Oct 19 03:47:54.227096 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3073/6073] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:47:53 2022] GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8 => generated 1724 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:47:55.263927 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2381201a-7c00-4123-a0eb-8a8425409183 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:47:55.264718 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2381201a-7c00-4123-a0eb-8a8425409183 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 89f2e52f-afcb-49bf-a39a-4b442a96eba8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:47:55.276332 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2381201a-7c00-4123-a0eb-8a8425409183 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:47:55.276838 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2381201a-7c00-4123-a0eb-8a8425409183 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:47:55.277518 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2381201a-7c00-4123-a0eb-8a8425409183 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:47:55.278418 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2381201a-7c00-4123-a0eb-8a8425409183 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:47:55.279116 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2381201a-7c00-4123-a0eb-8a8425409183 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:47:55.279562 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2381201a-7c00-4123-a0eb-8a8425409183 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:47:55.440994 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-2381201a-7c00-4123-a0eb-8a8425409183 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:47:55.450484 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-2381201a-7c00-4123-a0eb-8a8425409183 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:47:55.455153 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-2381201a-7c00-4123-a0eb-8a8425409183 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:47:55.455153 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2381201a-7c00-4123-a0eb-8a8425409183 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8" status: 200 len: 1724 microversion: 2.20 time: 0.200060 Oct 19 03:47:55.455153 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3001/6074] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:47:55 2022] GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8 => generated 1724 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:47:56.480375 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6fd7c163-02c8-4774-962f-90ccd94fafb2 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:47:56.481759 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6fd7c163-02c8-4774-962f-90ccd94fafb2 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 89f2e52f-afcb-49bf-a39a-4b442a96eba8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:47:56.489348 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6fd7c163-02c8-4774-962f-90ccd94fafb2 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:47:56.490666 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6fd7c163-02c8-4774-962f-90ccd94fafb2 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:47:56.491421 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6fd7c163-02c8-4774-962f-90ccd94fafb2 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:47:56.492746 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6fd7c163-02c8-4774-962f-90ccd94fafb2 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:47:56.493584 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6fd7c163-02c8-4774-962f-90ccd94fafb2 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:47:56.494770 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6fd7c163-02c8-4774-962f-90ccd94fafb2 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:47:56.655891 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-6fd7c163-02c8-4774-962f-90ccd94fafb2 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:47:56.667106 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-6fd7c163-02c8-4774-962f-90ccd94fafb2 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:47:56.673316 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-6fd7c163-02c8-4774-962f-90ccd94fafb2 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:47:56.673316 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6fd7c163-02c8-4774-962f-90ccd94fafb2 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8" status: 200 len: 1724 microversion: 2.20 time: 0.195655 Oct 19 03:47:56.673316 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3074/6075] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:47:56 2022] GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8 => generated 1724 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:47:57.697944 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-79247726-2f01-42f6-9bc9-7793ffc84300 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:47:57.703268 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-79247726-2f01-42f6-9bc9-7793ffc84300 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 89f2e52f-afcb-49bf-a39a-4b442a96eba8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:47:57.708478 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-79247726-2f01-42f6-9bc9-7793ffc84300 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:47:57.709494 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-79247726-2f01-42f6-9bc9-7793ffc84300 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:47:57.710146 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-79247726-2f01-42f6-9bc9-7793ffc84300 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:47:57.711268 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-79247726-2f01-42f6-9bc9-7793ffc84300 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:47:57.711898 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-79247726-2f01-42f6-9bc9-7793ffc84300 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:47:57.712498 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-79247726-2f01-42f6-9bc9-7793ffc84300 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:47:57.911734 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-79247726-2f01-42f6-9bc9-7793ffc84300 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:47:57.921643 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-79247726-2f01-42f6-9bc9-7793ffc84300 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:47:57.925509 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-79247726-2f01-42f6-9bc9-7793ffc84300 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:47:57.925509 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-79247726-2f01-42f6-9bc9-7793ffc84300 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8" status: 200 len: 1724 microversion: 2.20 time: 0.232393 Oct 19 03:47:57.935306 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3002/6076] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:47:57 2022] GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8 => generated 1724 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:47:58.953242 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-cf93e1af-115b-4982-b898-a0fdd5ad255a tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:47:58.954001 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-cf93e1af-115b-4982-b898-a0fdd5ad255a tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 89f2e52f-afcb-49bf-a39a-4b442a96eba8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:47:58.964759 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cf93e1af-115b-4982-b898-a0fdd5ad255a tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:47:58.965262 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cf93e1af-115b-4982-b898-a0fdd5ad255a tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:47:58.970007 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cf93e1af-115b-4982-b898-a0fdd5ad255a tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:47:58.970768 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cf93e1af-115b-4982-b898-a0fdd5ad255a tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:47:58.971264 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cf93e1af-115b-4982-b898-a0fdd5ad255a tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:47:58.971685 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cf93e1af-115b-4982-b898-a0fdd5ad255a tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:47:59.144747 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-cf93e1af-115b-4982-b898-a0fdd5ad255a tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:47:59.167513 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-cf93e1af-115b-4982-b898-a0fdd5ad255a tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:47:59.167513 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-cf93e1af-115b-4982-b898-a0fdd5ad255a tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:47:59.167513 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-cf93e1af-115b-4982-b898-a0fdd5ad255a tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8" status: 200 len: 1724 microversion: 2.20 time: 0.215713 Oct 19 03:47:59.180315 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3075/6077] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:47:58 2022] GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8 => generated 1724 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:48:00.209661 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9d516357-1a10-4545-8c30-66d060187911 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:48:00.210607 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9d516357-1a10-4545-8c30-66d060187911 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 89f2e52f-afcb-49bf-a39a-4b442a96eba8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:48:00.218364 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9d516357-1a10-4545-8c30-66d060187911 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:00.225087 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9d516357-1a10-4545-8c30-66d060187911 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:00.225087 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9d516357-1a10-4545-8c30-66d060187911 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:00.225087 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9d516357-1a10-4545-8c30-66d060187911 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:00.225087 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9d516357-1a10-4545-8c30-66d060187911 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:00.225087 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9d516357-1a10-4545-8c30-66d060187911 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:00.498314 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9d516357-1a10-4545-8c30-66d060187911 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:00.507532 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9d516357-1a10-4545-8c30-66d060187911 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:00.509603 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9d516357-1a10-4545-8c30-66d060187911 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:00.511059 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9d516357-1a10-4545-8c30-66d060187911 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8" status: 200 len: 1724 microversion: 2.20 time: 0.305597 Oct 19 03:48:00.512235 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3003/6078] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:48:00 2022] GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8 => generated 1724 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:48:01.536752 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-32659a48-5f54-4111-9d11-758fc1954a5a tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:48:01.537402 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-32659a48-5f54-4111-9d11-758fc1954a5a tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 89f2e52f-afcb-49bf-a39a-4b442a96eba8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:48:01.545922 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-32659a48-5f54-4111-9d11-758fc1954a5a tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:01.546422 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-32659a48-5f54-4111-9d11-758fc1954a5a tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:01.546868 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-32659a48-5f54-4111-9d11-758fc1954a5a tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:01.547206 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b8c52c47-c211-4bd8-9288-18d9de252600 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Action: 'create', calling method: .version_select at 0x7fc130de5af0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2014040594", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMiRAGvIN8atSqkkTsCD7QCcxAcyuDWmXTNszP+TZTs1RIPLpYKNWYS9kEZYUv76c6DpekTBKv5Fiq4Wh2sG/BVWbVLAuU/Lxgx1Y7C90p30BCcX9SzmUT1XgYD31E+Q3Q=="}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:48:01.547733 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-32659a48-5f54-4111-9d11-758fc1954a5a tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:01.548033 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-32659a48-5f54-4111-9d11-758fc1954a5a tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:01.548464 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-32659a48-5f54-4111-9d11-758fc1954a5a tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:01.565260 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-b8c52c47-c211-4bd8-9288-18d9de252600 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Getting quotas for project fe972f4874424bf89e9ed0bfcb69f050. Resources: {'key_pairs'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:48:01.571846 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-b8c52c47-c211-4bd8-9288-18d9de252600 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Getting quotas for user b63367855cc9468f8512a87e89b8606d and project fe972f4874424bf89e9ed0bfcb69f050. Resources: {'key_pairs'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:48:01.687011 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-32659a48-5f54-4111-9d11-758fc1954a5a tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:01.689572 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b8c52c47-c211-4bd8-9288-18d9de252600 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.351724 Oct 19 03:48:01.693763 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3076/6079] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Oct 19 03:48:01 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:48:01.696383 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-32659a48-5f54-4111-9d11-758fc1954a5a tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:01.698559 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-32659a48-5f54-4111-9d11-758fc1954a5a tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:01.699042 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-32659a48-5f54-4111-9d11-758fc1954a5a tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8" status: 200 len: 1724 microversion: 2.20 time: 0.166391 Oct 19 03:48:01.699793 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3004/6080] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:48:01 2022] GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:48:02.728211 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b5a2af5d-80a4-4502-94a7-9e103da9e7aa tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:48:02.729493 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b5a2af5d-80a4-4502-94a7-9e103da9e7aa tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 89f2e52f-afcb-49bf-a39a-4b442a96eba8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:48:02.736768 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b5a2af5d-80a4-4502-94a7-9e103da9e7aa tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:02.739859 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b5a2af5d-80a4-4502-94a7-9e103da9e7aa tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:02.739859 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b5a2af5d-80a4-4502-94a7-9e103da9e7aa tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:02.739859 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b5a2af5d-80a4-4502-94a7-9e103da9e7aa tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:02.739859 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b5a2af5d-80a4-4502-94a7-9e103da9e7aa tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:02.739859 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b5a2af5d-80a4-4502-94a7-9e103da9e7aa tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:03.016297 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b5a2af5d-80a4-4502-94a7-9e103da9e7aa tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:03.036238 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b5a2af5d-80a4-4502-94a7-9e103da9e7aa tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:03.037723 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b5a2af5d-80a4-4502-94a7-9e103da9e7aa tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:03.039020 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b5a2af5d-80a4-4502-94a7-9e103da9e7aa tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8" status: 200 len: 1724 microversion: 2.20 time: 0.316543 Oct 19 03:48:03.039930 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3077/6081] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:48:02 2022] GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8 => generated 1724 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:48:04.068962 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-07467cd6-cc0b-4819-a26e-c908e3a9f1c0 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:48:04.070145 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-07467cd6-cc0b-4819-a26e-c908e3a9f1c0 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 89f2e52f-afcb-49bf-a39a-4b442a96eba8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:48:04.078001 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-07467cd6-cc0b-4819-a26e-c908e3a9f1c0 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:04.078592 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-07467cd6-cc0b-4819-a26e-c908e3a9f1c0 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:04.079095 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-07467cd6-cc0b-4819-a26e-c908e3a9f1c0 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:04.086253 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-07467cd6-cc0b-4819-a26e-c908e3a9f1c0 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:04.086253 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-07467cd6-cc0b-4819-a26e-c908e3a9f1c0 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:04.086253 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-07467cd6-cc0b-4819-a26e-c908e3a9f1c0 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:04.281338 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-07467cd6-cc0b-4819-a26e-c908e3a9f1c0 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:04.285496 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-07467cd6-cc0b-4819-a26e-c908e3a9f1c0 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:04.287048 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-07467cd6-cc0b-4819-a26e-c908e3a9f1c0 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:04.288801 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-07467cd6-cc0b-4819-a26e-c908e3a9f1c0 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8" status: 200 len: 1745 microversion: 2.20 time: 0.223514 Oct 19 03:48:04.292009 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3005/6082] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:48:04 2022] GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8 => generated 1745 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:48:05.316527 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f91cded6-702a-45bd-83c4-3efb21f06418 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:48:05.317086 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f91cded6-702a-45bd-83c4-3efb21f06418 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 89f2e52f-afcb-49bf-a39a-4b442a96eba8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:48:05.324451 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f91cded6-702a-45bd-83c4-3efb21f06418 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:05.331190 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f91cded6-702a-45bd-83c4-3efb21f06418 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:05.331190 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f91cded6-702a-45bd-83c4-3efb21f06418 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:05.331190 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f91cded6-702a-45bd-83c4-3efb21f06418 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:05.331190 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f91cded6-702a-45bd-83c4-3efb21f06418 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:05.331190 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f91cded6-702a-45bd-83c4-3efb21f06418 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:05.520481 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f91cded6-702a-45bd-83c4-3efb21f06418 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:05.530853 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f91cded6-702a-45bd-83c4-3efb21f06418 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:05.532992 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f91cded6-702a-45bd-83c4-3efb21f06418 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:05.534236 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f91cded6-702a-45bd-83c4-3efb21f06418 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8" status: 200 len: 1745 microversion: 2.20 time: 0.222108 Oct 19 03:48:05.534809 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3078/6083] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:48:05 2022] GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8 => generated 1745 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:48:06.562543 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-81c9653b-c6aa-49aa-a6c6-b67d27919e22 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:48:06.563292 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-81c9653b-c6aa-49aa-a6c6-b67d27919e22 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 89f2e52f-afcb-49bf-a39a-4b442a96eba8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:48:06.575686 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-81c9653b-c6aa-49aa-a6c6-b67d27919e22 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:06.577644 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-81c9653b-c6aa-49aa-a6c6-b67d27919e22 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:06.579774 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-81c9653b-c6aa-49aa-a6c6-b67d27919e22 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:06.580682 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-81c9653b-c6aa-49aa-a6c6-b67d27919e22 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:06.581452 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-81c9653b-c6aa-49aa-a6c6-b67d27919e22 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:06.586280 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-81c9653b-c6aa-49aa-a6c6-b67d27919e22 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:06.912789 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-81c9653b-c6aa-49aa-a6c6-b67d27919e22 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:06.925951 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-81c9653b-c6aa-49aa-a6c6-b67d27919e22 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:06.925951 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-81c9653b-c6aa-49aa-a6c6-b67d27919e22 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:06.925951 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-81c9653b-c6aa-49aa-a6c6-b67d27919e22 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8" status: 200 len: 1740 microversion: 2.20 time: 0.367218 Oct 19 03:48:06.926846 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3006/6084] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:48:06 2022] GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8 => generated 1740 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:48:07.964955 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-59dfdb86-c8a7-4918-b105-41ea68e65221 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:48:07.965814 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-59dfdb86-c8a7-4918-b105-41ea68e65221 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 89f2e52f-afcb-49bf-a39a-4b442a96eba8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:48:07.986799 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-59dfdb86-c8a7-4918-b105-41ea68e65221 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:07.987320 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-59dfdb86-c8a7-4918-b105-41ea68e65221 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:07.987774 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-59dfdb86-c8a7-4918-b105-41ea68e65221 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:07.988681 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-59dfdb86-c8a7-4918-b105-41ea68e65221 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:07.991710 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-59dfdb86-c8a7-4918-b105-41ea68e65221 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:07.994233 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-59dfdb86-c8a7-4918-b105-41ea68e65221 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:08.243894 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-ea6ec9bd-d795-47c7-96aa-82675f1537c5 req-b59c0619-8cee-489f-ba74-c204ced3cf77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89f2e52f-afcb-49bf-a39a-4b442a96eba8", "name": "network-vif-plugged", "status": "completed", "tag": "916e68b3-4b4b-48a3-9beb-6bf56116fff0"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:48:08.273815 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-ea6ec9bd-d795-47c7-96aa-82675f1537c5 req-b59c0619-8cee-489f-ba74-c204ced3cf77 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:08.274633 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-ea6ec9bd-d795-47c7-96aa-82675f1537c5 req-b59c0619-8cee-489f-ba74-c204ced3cf77 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:08.275288 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-ea6ec9bd-d795-47c7-96aa-82675f1537c5 req-b59c0619-8cee-489f-ba74-c204ced3cf77 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:08.304839 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-59dfdb86-c8a7-4918-b105-41ea68e65221 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:08.314154 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-ea6ec9bd-d795-47c7-96aa-82675f1537c5 req-b59c0619-8cee-489f-ba74-c204ced3cf77 service nova] Creating event network-vif-plugged:916e68b3-4b4b-48a3-9beb-6bf56116fff0 for instance 89f2e52f-afcb-49bf-a39a-4b442a96eba8 on n-h2-861333-8 Oct 19 03:48:08.315731 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-59dfdb86-c8a7-4918-b105-41ea68e65221 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:08.317191 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-59dfdb86-c8a7-4918-b105-41ea68e65221 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:08.318462 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-59dfdb86-c8a7-4918-b105-41ea68e65221 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8" status: 200 len: 1740 microversion: 2.20 time: 0.359117 Oct 19 03:48:08.323775 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-ea6ec9bd-d795-47c7-96aa-82675f1537c5 req-b59c0619-8cee-489f-ba74-c204ced3cf77 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088440 Oct 19 03:48:08.325013 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3007/6085] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:48:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:48:08.327253 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3079/6086] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:48:07 2022] GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8 => generated 1740 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:48:08.478513 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-80c0428c-648c-4973-af11-b3bd1089c0b4 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-654438949", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:48:08.603831 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-80c0428c-648c-4973-af11-b3bd1089c0b4 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] validate_networks() for None {{(pid=121134) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:48:08.960846 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-80c0428c-648c-4973-af11-b3bd1089c0b4 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Flavor limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:48:08.961405 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-80c0428c-648c-4973-af11-b3bd1089c0b4 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Image limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:48:08.962020 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-80c0428c-648c-4973-af11-b3bd1089c0b4 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Flavor pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:48:08.964584 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-80c0428c-648c-4973-af11-b3bd1089c0b4 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Image pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:48:08.964584 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-80c0428c-648c-4973-af11-b3bd1089c0b4 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:48:08.980728 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-80c0428c-648c-4973-af11-b3bd1089c0b4 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:08.983322 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-80c0428c-648c-4973-af11-b3bd1089c0b4 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:08.983789 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-80c0428c-648c-4973-af11-b3bd1089c0b4 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:08.990199 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-80c0428c-648c-4973-af11-b3bd1089c0b4 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:08.990984 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-80c0428c-648c-4973-af11-b3bd1089c0b4 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:09.003211 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-80c0428c-648c-4973-af11-b3bd1089c0b4 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:09.036234 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-80c0428c-648c-4973-af11-b3bd1089c0b4 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Getting quotas for project 9a42569fa043433a9455e9a09941a109. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:48:09.053225 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-80c0428c-648c-4973-af11-b3bd1089c0b4 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Getting quotas for user 881e3245fa91439682dd7ffd31b3f5ce and project 9a42569fa043433a9455e9a09941a109. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:48:09.084220 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-80c0428c-648c-4973-af11-b3bd1089c0b4 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Going to run 1 instances... {{(pid=121134) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:48:09.090885 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-80c0428c-648c-4973-af11-b3bd1089c0b4 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] [instance: cdbd892a-6028-43ab-8957-c44fc7257d8a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:48:09.351578 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4e6be4b5-2dee-4c87-9b99-e68cdd18c465 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:48:09.352140 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4e6be4b5-2dee-4c87-9b99-e68cdd18c465 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 89f2e52f-afcb-49bf-a39a-4b442a96eba8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:48:09.368275 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4e6be4b5-2dee-4c87-9b99-e68cdd18c465 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:09.369417 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4e6be4b5-2dee-4c87-9b99-e68cdd18c465 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:09.369860 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4e6be4b5-2dee-4c87-9b99-e68cdd18c465 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:09.370588 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4e6be4b5-2dee-4c87-9b99-e68cdd18c465 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:09.371051 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4e6be4b5-2dee-4c87-9b99-e68cdd18c465 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:09.371485 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4e6be4b5-2dee-4c87-9b99-e68cdd18c465 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:09.493537 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-80c0428c-648c-4973-af11-b3bd1089c0b4 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.021521 Oct 19 03:48:09.506428 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3008/6087] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:48:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1036 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 03:48:09.517966 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4eb3c06f-43f0-4851-9fb5-c3c6615a7a7c tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:48:09.519515 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4eb3c06f-43f0-4851-9fb5-c3c6615a7a7c tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] [instance: cdbd892a-6028-43ab-8957-c44fc7257d8a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:48:09.657079 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-4eb3c06f-43f0-4851-9fb5-c3c6615a7a7c tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881e3245fa91439682dd7ffd31b3f5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a42569fa043433a9455e9a09941a109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:09.667145 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4eb3c06f-43f0-4851-9fb5-c3c6615a7a7c tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] 10.222.0.52 "GET /compute/v2.1/servers/cdbd892a-6028-43ab-8957-c44fc7257d8a" status: 200 len: 1214 microversion: 2.1 time: 0.158311 Oct 19 03:48:09.671997 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3009/6088] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:48:09 2022] GET /compute/v2.1/servers/cdbd892a-6028-43ab-8957-c44fc7257d8a => generated 1214 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:48:09.803050 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4e6be4b5-2dee-4c87-9b99-e68cdd18c465 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:09.820840 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4e6be4b5-2dee-4c87-9b99-e68cdd18c465 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:09.827970 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4e6be4b5-2dee-4c87-9b99-e68cdd18c465 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:09.832677 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4e6be4b5-2dee-4c87-9b99-e68cdd18c465 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8" status: 200 len: 1740 microversion: 2.20 time: 0.483714 Oct 19 03:48:09.843125 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3080/6089] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:48:09 2022] GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8 => generated 1740 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:48:10.701877 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4a4535bf-c9be-4587-801c-4b9bcedfce11 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:48:10.703630 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4a4535bf-c9be-4587-801c-4b9bcedfce11 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] [instance: cdbd892a-6028-43ab-8957-c44fc7257d8a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:48:10.876966 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-87258d9b-d6d5-4609-91ec-59f985065b44 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:48:10.878706 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-87258d9b-d6d5-4609-91ec-59f985065b44 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 89f2e52f-afcb-49bf-a39a-4b442a96eba8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:48:10.892391 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-87258d9b-d6d5-4609-91ec-59f985065b44 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:10.896100 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-87258d9b-d6d5-4609-91ec-59f985065b44 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:10.896808 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-87258d9b-d6d5-4609-91ec-59f985065b44 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:10.898741 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-87258d9b-d6d5-4609-91ec-59f985065b44 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:10.901790 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-87258d9b-d6d5-4609-91ec-59f985065b44 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:10.902525 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-87258d9b-d6d5-4609-91ec-59f985065b44 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:11.079620 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-4a4535bf-c9be-4587-801c-4b9bcedfce11 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881e3245fa91439682dd7ffd31b3f5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a42569fa043433a9455e9a09941a109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:11.095039 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4a4535bf-c9be-4587-801c-4b9bcedfce11 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] 10.222.0.52 "GET /compute/v2.1/servers/cdbd892a-6028-43ab-8957-c44fc7257d8a" status: 200 len: 1214 microversion: 2.1 time: 0.396337 Oct 19 03:48:11.096798 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3010/6090] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:48:10 2022] GET /compute/v2.1/servers/cdbd892a-6028-43ab-8957-c44fc7257d8a => generated 1214 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:48:11.581733 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=4 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:48:11.727549 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-87258d9b-d6d5-4609-91ec-59f985065b44 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:11.738986 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-87258d9b-d6d5-4609-91ec-59f985065b44 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:11.740832 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-87258d9b-d6d5-4609-91ec-59f985065b44 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:11.742933 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-87258d9b-d6d5-4609-91ec-59f985065b44 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8" status: 200 len: 1740 microversion: 2.20 time: 0.871699 Oct 19 03:48:11.744470 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3081/6091] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:48:10 2022] GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8 => generated 1740 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:48:12.118030 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-93541b9a-cd95-4e61-8f51-7ca6278f8212 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:48:12.119469 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-93541b9a-cd95-4e61-8f51-7ca6278f8212 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] [instance: cdbd892a-6028-43ab-8957-c44fc7257d8a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:48:12.145908 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-93541b9a-cd95-4e61-8f51-7ca6278f8212 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:12.152156 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-93541b9a-cd95-4e61-8f51-7ca6278f8212 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:12.152650 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-93541b9a-cd95-4e61-8f51-7ca6278f8212 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:12.159379 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-93541b9a-cd95-4e61-8f51-7ca6278f8212 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:12.163559 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-93541b9a-cd95-4e61-8f51-7ca6278f8212 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:12.165186 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-93541b9a-cd95-4e61-8f51-7ca6278f8212 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:12.431671 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-93541b9a-cd95-4e61-8f51-7ca6278f8212 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881e3245fa91439682dd7ffd31b3f5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a42569fa043433a9455e9a09941a109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:12.453348 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-93541b9a-cd95-4e61-8f51-7ca6278f8212 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] 10.222.0.52 "GET /compute/v2.1/servers/cdbd892a-6028-43ab-8957-c44fc7257d8a" status: 200 len: 1210 microversion: 2.1 time: 0.339998 Oct 19 03:48:12.462647 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3011/6092] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:48:12 2022] GET /compute/v2.1/servers/cdbd892a-6028-43ab-8957-c44fc7257d8a => generated 1210 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:48:12.773629 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9d2f64bb-074b-45b5-bceb-94f307e76681 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:48:12.774250 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9d2f64bb-074b-45b5-bceb-94f307e76681 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 89f2e52f-afcb-49bf-a39a-4b442a96eba8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:48:12.791175 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9d2f64bb-074b-45b5-bceb-94f307e76681 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:12.803219 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9d2f64bb-074b-45b5-bceb-94f307e76681 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:12.804024 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9d2f64bb-074b-45b5-bceb-94f307e76681 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:12.804950 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9d2f64bb-074b-45b5-bceb-94f307e76681 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:12.805607 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9d2f64bb-074b-45b5-bceb-94f307e76681 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:12.806348 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9d2f64bb-074b-45b5-bceb-94f307e76681 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:13.154352 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-9d2f64bb-074b-45b5-bceb-94f307e76681 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:13.178089 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-9d2f64bb-074b-45b5-bceb-94f307e76681 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:13.183611 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-9d2f64bb-074b-45b5-bceb-94f307e76681 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:13.187186 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9d2f64bb-074b-45b5-bceb-94f307e76681 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8" status: 200 len: 1740 microversion: 2.20 time: 0.419683 Oct 19 03:48:13.205530 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3082/6093] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:48:12 2022] GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8 => generated 1740 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:48:13.478259 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e368056e-8f0f-4d5c-bb3a-628713641e7f tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:48:13.479815 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e368056e-8f0f-4d5c-bb3a-628713641e7f tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] [instance: cdbd892a-6028-43ab-8957-c44fc7257d8a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:48:13.504665 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e368056e-8f0f-4d5c-bb3a-628713641e7f tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:13.504665 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e368056e-8f0f-4d5c-bb3a-628713641e7f tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:13.507747 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e368056e-8f0f-4d5c-bb3a-628713641e7f tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:13.510626 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e368056e-8f0f-4d5c-bb3a-628713641e7f tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:13.511238 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e368056e-8f0f-4d5c-bb3a-628713641e7f tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:13.511744 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e368056e-8f0f-4d5c-bb3a-628713641e7f tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:13.698039 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e368056e-8f0f-4d5c-bb3a-628713641e7f tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881e3245fa91439682dd7ffd31b3f5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a42569fa043433a9455e9a09941a109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:13.707133 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e368056e-8f0f-4d5c-bb3a-628713641e7f tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] 10.222.0.52 "GET /compute/v2.1/servers/cdbd892a-6028-43ab-8957-c44fc7257d8a" status: 200 len: 1284 microversion: 2.1 time: 0.232857 Oct 19 03:48:13.729462 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3012/6094] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:48:13 2022] GET /compute/v2.1/servers/cdbd892a-6028-43ab-8957-c44fc7257d8a => generated 1284 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:48:14.224632 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-da9c381d-2d21-4160-b12b-0cb1e46b48f9 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:48:14.225246 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-da9c381d-2d21-4160-b12b-0cb1e46b48f9 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 89f2e52f-afcb-49bf-a39a-4b442a96eba8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:48:14.255817 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-da9c381d-2d21-4160-b12b-0cb1e46b48f9 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:14.256396 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-da9c381d-2d21-4160-b12b-0cb1e46b48f9 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:14.259097 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-da9c381d-2d21-4160-b12b-0cb1e46b48f9 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:14.263018 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-da9c381d-2d21-4160-b12b-0cb1e46b48f9 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:14.263717 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-da9c381d-2d21-4160-b12b-0cb1e46b48f9 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:14.264608 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-da9c381d-2d21-4160-b12b-0cb1e46b48f9 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:14.619876 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-da9c381d-2d21-4160-b12b-0cb1e46b48f9 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:14.637110 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-da9c381d-2d21-4160-b12b-0cb1e46b48f9 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:14.638833 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-da9c381d-2d21-4160-b12b-0cb1e46b48f9 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:14.644331 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-da9c381d-2d21-4160-b12b-0cb1e46b48f9 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8" status: 200 len: 1740 microversion: 2.20 time: 0.421567 Oct 19 03:48:14.645700 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3083/6095] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:48:14 2022] GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8 => generated 1740 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:48:14.744623 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-171b8d92-b53e-48ba-a3b3-90a4f464ae11 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:48:14.744623 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-171b8d92-b53e-48ba-a3b3-90a4f464ae11 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] [instance: cdbd892a-6028-43ab-8957-c44fc7257d8a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:48:14.761745 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-171b8d92-b53e-48ba-a3b3-90a4f464ae11 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:14.762639 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-171b8d92-b53e-48ba-a3b3-90a4f464ae11 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:14.763377 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-171b8d92-b53e-48ba-a3b3-90a4f464ae11 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:14.764461 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-171b8d92-b53e-48ba-a3b3-90a4f464ae11 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:14.764994 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-171b8d92-b53e-48ba-a3b3-90a4f464ae11 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:14.765531 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-171b8d92-b53e-48ba-a3b3-90a4f464ae11 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:14.833756 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-171b8d92-b53e-48ba-a3b3-90a4f464ae11 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881e3245fa91439682dd7ffd31b3f5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a42569fa043433a9455e9a09941a109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:14.842567 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-171b8d92-b53e-48ba-a3b3-90a4f464ae11 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] 10.222.0.52 "GET /compute/v2.1/servers/cdbd892a-6028-43ab-8957-c44fc7257d8a" status: 200 len: 1272 microversion: 2.1 time: 0.109870 Oct 19 03:48:14.843757 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3013/6096] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:48:14 2022] GET /compute/v2.1/servers/cdbd892a-6028-43ab-8957-c44fc7257d8a => generated 1272 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:48:15.684306 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-494d1dcb-d56b-4718-b290-d0c28193adef tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:48:15.685697 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-494d1dcb-d56b-4718-b290-d0c28193adef tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 89f2e52f-afcb-49bf-a39a-4b442a96eba8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:48:15.702029 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-494d1dcb-d56b-4718-b290-d0c28193adef tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:15.704676 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-494d1dcb-d56b-4718-b290-d0c28193adef tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:15.705507 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-494d1dcb-d56b-4718-b290-d0c28193adef tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:15.708419 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-494d1dcb-d56b-4718-b290-d0c28193adef tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:15.715535 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-494d1dcb-d56b-4718-b290-d0c28193adef tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:15.721545 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-494d1dcb-d56b-4718-b290-d0c28193adef tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:15.870082 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-aa728210-6bc9-4136-b726-1f310de4db1d tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:48:15.870727 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-aa728210-6bc9-4136-b726-1f310de4db1d tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] [instance: cdbd892a-6028-43ab-8957-c44fc7257d8a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:48:15.880349 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-aa728210-6bc9-4136-b726-1f310de4db1d tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:15.880849 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-aa728210-6bc9-4136-b726-1f310de4db1d tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:15.887756 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-aa728210-6bc9-4136-b726-1f310de4db1d tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:15.888807 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-aa728210-6bc9-4136-b726-1f310de4db1d tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:15.891592 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-aa728210-6bc9-4136-b726-1f310de4db1d tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:15.892749 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-aa728210-6bc9-4136-b726-1f310de4db1d tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:15.956293 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-494d1dcb-d56b-4718-b290-d0c28193adef tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:15.968123 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-494d1dcb-d56b-4718-b290-d0c28193adef tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:15.970780 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-494d1dcb-d56b-4718-b290-d0c28193adef tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:15.972315 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-494d1dcb-d56b-4718-b290-d0c28193adef tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8" status: 200 len: 1740 microversion: 2.20 time: 0.293596 Oct 19 03:48:15.973250 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3084/6097] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:48:15 2022] GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8 => generated 1740 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:48:16.276301 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-aa728210-6bc9-4136-b726-1f310de4db1d tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881e3245fa91439682dd7ffd31b3f5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a42569fa043433a9455e9a09941a109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:16.293337 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-aa728210-6bc9-4136-b726-1f310de4db1d tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] 10.222.0.52 "GET /compute/v2.1/servers/cdbd892a-6028-43ab-8957-c44fc7257d8a" status: 200 len: 1314 microversion: 2.1 time: 0.423274 Oct 19 03:48:16.310953 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3014/6098] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:48:15 2022] GET /compute/v2.1/servers/cdbd892a-6028-43ab-8957-c44fc7257d8a => generated 1314 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:48:17.002636 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-77869612-ad75-43f9-94e9-cffd837a5cbd tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:48:17.004749 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-77869612-ad75-43f9-94e9-cffd837a5cbd tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 89f2e52f-afcb-49bf-a39a-4b442a96eba8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:48:17.014266 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:48:17.018709 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-77869612-ad75-43f9-94e9-cffd837a5cbd tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:17.022143 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-77869612-ad75-43f9-94e9-cffd837a5cbd tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:17.024257 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-77869612-ad75-43f9-94e9-cffd837a5cbd tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:17.025482 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-77869612-ad75-43f9-94e9-cffd837a5cbd tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:17.026216 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-77869612-ad75-43f9-94e9-cffd837a5cbd tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:17.028513 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-77869612-ad75-43f9-94e9-cffd837a5cbd tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:17.038570 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:48:17.319318 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f458f746-dcc7-4b24-ad82-bcc77e131cde tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:48:17.321723 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f458f746-dcc7-4b24-ad82-bcc77e131cde tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] [instance: cdbd892a-6028-43ab-8957-c44fc7257d8a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:48:17.339683 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f458f746-dcc7-4b24-ad82-bcc77e131cde tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:17.340507 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f458f746-dcc7-4b24-ad82-bcc77e131cde tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:17.341133 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f458f746-dcc7-4b24-ad82-bcc77e131cde tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:17.342098 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f458f746-dcc7-4b24-ad82-bcc77e131cde tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:17.342743 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f458f746-dcc7-4b24-ad82-bcc77e131cde tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:17.343359 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f458f746-dcc7-4b24-ad82-bcc77e131cde tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:17.379196 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-77869612-ad75-43f9-94e9-cffd837a5cbd tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:17.399608 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-77869612-ad75-43f9-94e9-cffd837a5cbd tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:17.404318 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-77869612-ad75-43f9-94e9-cffd837a5cbd tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:17.410427 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-77869612-ad75-43f9-94e9-cffd837a5cbd tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8" status: 200 len: 1740 microversion: 2.20 time: 0.413286 Oct 19 03:48:17.411653 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3085/6099] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:48:16 2022] GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8 => generated 1740 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:48:17.637610 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-f458f746-dcc7-4b24-ad82-bcc77e131cde tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881e3245fa91439682dd7ffd31b3f5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a42569fa043433a9455e9a09941a109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:17.649310 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f458f746-dcc7-4b24-ad82-bcc77e131cde tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] 10.222.0.52 "GET /compute/v2.1/servers/cdbd892a-6028-43ab-8957-c44fc7257d8a" status: 200 len: 1314 microversion: 2.1 time: 0.334450 Oct 19 03:48:17.659777 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3015/6100] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:48:17 2022] GET /compute/v2.1/servers/cdbd892a-6028-43ab-8957-c44fc7257d8a => generated 1314 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:48:18.034906 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e3a06da8-afbd-4b0d-bbb3-027928c0be18 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1241114956", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "networks": [{"uuid": "7fd99750-05f0-40e8-ba6c-0247c0e0a9eb"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2014040594", "security_groups": [{"name": "tempest-secgroup-smoke-1566360592"}]}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:48:18.194491 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.network.neutron [None req-e3a06da8-afbd-4b0d-bbb3-027928c0be18 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] validate_networks() for [('7fd99750-05f0-40e8-ba6c-0247c0e0a9eb', None, None, None, None, None)] {{(pid=121135) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:48:18.444385 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-73e5c989-0a27-4114-9567-8afe026c544a tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:48:18.445203 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-73e5c989-0a27-4114-9567-8afe026c544a tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 89f2e52f-afcb-49bf-a39a-4b442a96eba8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:48:18.450503 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=3 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:48:18.464982 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-73e5c989-0a27-4114-9567-8afe026c544a tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:18.466818 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-73e5c989-0a27-4114-9567-8afe026c544a tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:18.467795 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-73e5c989-0a27-4114-9567-8afe026c544a tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:18.470506 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-73e5c989-0a27-4114-9567-8afe026c544a tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:18.470972 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-73e5c989-0a27-4114-9567-8afe026c544a tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:18.471401 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-73e5c989-0a27-4114-9567-8afe026c544a tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:18.490895 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=93 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:48:18.828740 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-73e5c989-0a27-4114-9567-8afe026c544a tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:18.849856 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-73e5c989-0a27-4114-9567-8afe026c544a tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:18.858682 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-73e5c989-0a27-4114-9567-8afe026c544a tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:18.861315 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-73e5c989-0a27-4114-9567-8afe026c544a tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8" status: 200 len: 1740 microversion: 2.20 time: 0.419532 Oct 19 03:48:18.862555 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3016/6101] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:48:18 2022] GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8 => generated 1740 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:48:18.883210 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-3b06e1f1-88b1-4e15-acdc-c84a6f6becf8 req-ee744c62-80a1-4538-b506-85112a72d8ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdbd892a-6028-43ab-8957-c44fc7257d8a", "tag": "7d2e2968-81c2-44a5-9dfd-20e0cfa06679"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:48:18.909254 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-3b06e1f1-88b1-4e15-acdc-c84a6f6becf8 req-ee744c62-80a1-4538-b506-85112a72d8ff service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:18.910183 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-3b06e1f1-88b1-4e15-acdc-c84a6f6becf8 req-ee744c62-80a1-4538-b506-85112a72d8ff service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:18.914087 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-3b06e1f1-88b1-4e15-acdc-c84a6f6becf8 req-ee744c62-80a1-4538-b506-85112a72d8ff service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:18.941323 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-3b06e1f1-88b1-4e15-acdc-c84a6f6becf8 req-ee744c62-80a1-4538-b506-85112a72d8ff service nova] Creating event network-changed:7d2e2968-81c2-44a5-9dfd-20e0cfa06679 for instance cdbd892a-6028-43ab-8957-c44fc7257d8a on n-h1-861333-8 Oct 19 03:48:18.951798 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-3b06e1f1-88b1-4e15-acdc-c84a6f6becf8 req-ee744c62-80a1-4538-b506-85112a72d8ff service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087289 Oct 19 03:48:18.953759 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3017/6102] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:48:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:48:18.963739 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8be3b3d9-7b83-428a-8062-2a348d4bda5a tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:48:18.964455 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8be3b3d9-7b83-428a-8062-2a348d4bda5a tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] [instance: cdbd892a-6028-43ab-8957-c44fc7257d8a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:48:18.984301 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8be3b3d9-7b83-428a-8062-2a348d4bda5a tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:18.993219 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8be3b3d9-7b83-428a-8062-2a348d4bda5a tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:18.993773 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8be3b3d9-7b83-428a-8062-2a348d4bda5a tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:18.994535 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8be3b3d9-7b83-428a-8062-2a348d4bda5a tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:18.995206 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8be3b3d9-7b83-428a-8062-2a348d4bda5a tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:18.995813 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8be3b3d9-7b83-428a-8062-2a348d4bda5a tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:19.046590 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:48:19.358151 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8be3b3d9-7b83-428a-8062-2a348d4bda5a tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881e3245fa91439682dd7ffd31b3f5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a42569fa043433a9455e9a09941a109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:19.370204 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8be3b3d9-7b83-428a-8062-2a348d4bda5a tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] 10.222.0.52 "GET /compute/v2.1/servers/cdbd892a-6028-43ab-8957-c44fc7257d8a" status: 200 len: 1314 microversion: 2.1 time: 0.411950 Oct 19 03:48:19.374164 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3018/6103] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:48:18 2022] GET /compute/v2.1/servers/cdbd892a-6028-43ab-8957-c44fc7257d8a => generated 1314 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:48:19.505321 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-e3a06da8-afbd-4b0d-bbb3-027928c0be18 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Flavor limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:48:19.508883 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-e3a06da8-afbd-4b0d-bbb3-027928c0be18 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Image limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:48:19.508883 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-e3a06da8-afbd-4b0d-bbb3-027928c0be18 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Flavor pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:48:19.509470 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-e3a06da8-afbd-4b0d-bbb3-027928c0be18 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Image pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:48:19.511112 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-e3a06da8-afbd-4b0d-bbb3-027928c0be18 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:48:19.524952 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e3a06da8-afbd-4b0d-bbb3-027928c0be18 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:19.527677 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e3a06da8-afbd-4b0d-bbb3-027928c0be18 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:19.528591 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e3a06da8-afbd-4b0d-bbb3-027928c0be18 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:19.530123 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e3a06da8-afbd-4b0d-bbb3-027928c0be18 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:19.530885 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e3a06da8-afbd-4b0d-bbb3-027928c0be18 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:19.531567 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e3a06da8-afbd-4b0d-bbb3-027928c0be18 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:19.589280 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-e3a06da8-afbd-4b0d-bbb3-027928c0be18 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Getting quotas for project fe972f4874424bf89e9ed0bfcb69f050. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:48:19.597537 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-e3a06da8-afbd-4b0d-bbb3-027928c0be18 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Getting quotas for user b63367855cc9468f8512a87e89b8606d and project fe972f4874424bf89e9ed0bfcb69f050. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:48:19.623167 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e3a06da8-afbd-4b0d-bbb3-027928c0be18 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Going to run 1 instances... {{(pid=121135) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:48:19.623167 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e3a06da8-afbd-4b0d-bbb3-027928c0be18 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: d7223d39-2ef0-443b-989b-87c1fe11d2c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121135) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:48:19.809773 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e3a06da8-afbd-4b0d-bbb3-027928c0be18 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.779284 Oct 19 03:48:19.813300 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3086/6104] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:48:18 2022] POST /compute/v2.1/servers => generated 406 bytes in 1783 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 03:48:19.835731 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c3e577dd-643d-4955-a0fb-62d7b482bb3e tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:48:19.838710 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c3e577dd-643d-4955-a0fb-62d7b482bb3e tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: d7223d39-2ef0-443b-989b-87c1fe11d2c1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:48:19.905355 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5c100b9d-9cc6-4c2d-8683-a580ba6b977c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:48:19.923866 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-5c100b9d-9cc6-4c2d-8683-a580ba6b977c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 89f2e52f-afcb-49bf-a39a-4b442a96eba8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:48:20.003153 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5c100b9d-9cc6-4c2d-8683-a580ba6b977c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:20.003887 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5c100b9d-9cc6-4c2d-8683-a580ba6b977c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:20.004539 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5c100b9d-9cc6-4c2d-8683-a580ba6b977c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:20.005717 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5c100b9d-9cc6-4c2d-8683-a580ba6b977c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:20.006398 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5c100b9d-9cc6-4c2d-8683-a580ba6b977c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:20.007048 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5c100b9d-9cc6-4c2d-8683-a580ba6b977c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:20.057638 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c3e577dd-643d-4955-a0fb-62d7b482bb3e tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:20.075743 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c3e577dd-643d-4955-a0fb-62d7b482bb3e tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/d7223d39-2ef0-443b-989b-87c1fe11d2c1" status: 200 len: 1267 microversion: 2.1 time: 0.246679 Oct 19 03:48:20.077517 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3019/6105] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:48:19 2022] GET /compute/v2.1/servers/d7223d39-2ef0-443b-989b-87c1fe11d2c1 => generated 1267 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:48:20.405962 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b33e291a-273d-480b-b254-850e61ec4574 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:48:20.407096 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b33e291a-273d-480b-b254-850e61ec4574 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] [instance: cdbd892a-6028-43ab-8957-c44fc7257d8a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:48:20.448200 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b33e291a-273d-480b-b254-850e61ec4574 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:20.449497 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b33e291a-273d-480b-b254-850e61ec4574 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:20.452189 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-5c100b9d-9cc6-4c2d-8683-a580ba6b977c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:20.452650 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b33e291a-273d-480b-b254-850e61ec4574 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:20.454293 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b33e291a-273d-480b-b254-850e61ec4574 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:20.457963 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b33e291a-273d-480b-b254-850e61ec4574 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:20.460089 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b33e291a-273d-480b-b254-850e61ec4574 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:20.465264 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-5c100b9d-9cc6-4c2d-8683-a580ba6b977c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:20.469018 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-5c100b9d-9cc6-4c2d-8683-a580ba6b977c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:20.472013 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5c100b9d-9cc6-4c2d-8683-a580ba6b977c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8" status: 200 len: 1740 microversion: 2.20 time: 0.583279 Oct 19 03:48:20.474414 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3087/6106] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:48:19 2022] GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8 => generated 1740 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:48:21.123189 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9602b685-4859-45a1-871d-78697614edf9 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:48:21.124651 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9602b685-4859-45a1-871d-78697614edf9 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: d7223d39-2ef0-443b-989b-87c1fe11d2c1] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:48:21.280041 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-9602b685-4859-45a1-871d-78697614edf9 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:21.291608 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9602b685-4859-45a1-871d-78697614edf9 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/d7223d39-2ef0-443b-989b-87c1fe11d2c1" status: 200 len: 1267 microversion: 2.1 time: 0.172487 Oct 19 03:48:21.301403 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3088/6107] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:48:21 2022] GET /compute/v2.1/servers/d7223d39-2ef0-443b-989b-87c1fe11d2c1 => generated 1267 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:48:21.301631 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b33e291a-273d-480b-b254-850e61ec4574 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881e3245fa91439682dd7ffd31b3f5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a42569fa043433a9455e9a09941a109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:21.309513 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b33e291a-273d-480b-b254-850e61ec4574 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] 10.222.0.52 "GET /compute/v2.1/servers/cdbd892a-6028-43ab-8957-c44fc7257d8a" status: 200 len: 1314 microversion: 2.1 time: 0.912078 Oct 19 03:48:21.310663 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3020/6108] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:48:20 2022] GET /compute/v2.1/servers/cdbd892a-6028-43ab-8957-c44fc7257d8a => generated 1314 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:48:21.521335 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9566d228-b1d4-4e2f-9dd8-6e179cfb42b6 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:48:21.548401 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9566d228-b1d4-4e2f-9dd8-6e179cfb42b6 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 89f2e52f-afcb-49bf-a39a-4b442a96eba8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:48:21.548401 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9566d228-b1d4-4e2f-9dd8-6e179cfb42b6 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:21.548401 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9566d228-b1d4-4e2f-9dd8-6e179cfb42b6 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:21.548401 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9566d228-b1d4-4e2f-9dd8-6e179cfb42b6 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:21.548401 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9566d228-b1d4-4e2f-9dd8-6e179cfb42b6 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:21.548401 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9566d228-b1d4-4e2f-9dd8-6e179cfb42b6 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:21.548401 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9566d228-b1d4-4e2f-9dd8-6e179cfb42b6 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:21.866097 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-9566d228-b1d4-4e2f-9dd8-6e179cfb42b6 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:21.882960 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-9566d228-b1d4-4e2f-9dd8-6e179cfb42b6 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:21.884624 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-9566d228-b1d4-4e2f-9dd8-6e179cfb42b6 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:21.889150 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9566d228-b1d4-4e2f-9dd8-6e179cfb42b6 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8" status: 200 len: 1740 microversion: 2.20 time: 0.373523 Oct 19 03:48:21.889806 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3089/6109] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:48:21 2022] GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8 => generated 1740 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:48:22.314608 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d542f0fc-2122-4770-a9f6-ef2f96a43c17 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:48:22.315596 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d542f0fc-2122-4770-a9f6-ef2f96a43c17 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: d7223d39-2ef0-443b-989b-87c1fe11d2c1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:48:22.339164 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-531bc45c-5222-4f04-b18c-0829da51556c tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:48:22.340702 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-531bc45c-5222-4f04-b18c-0829da51556c tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] [instance: cdbd892a-6028-43ab-8957-c44fc7257d8a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:48:22.344613 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d542f0fc-2122-4770-a9f6-ef2f96a43c17 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:22.348146 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d542f0fc-2122-4770-a9f6-ef2f96a43c17 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:22.351420 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d542f0fc-2122-4770-a9f6-ef2f96a43c17 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:22.354970 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d542f0fc-2122-4770-a9f6-ef2f96a43c17 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:22.355669 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d542f0fc-2122-4770-a9f6-ef2f96a43c17 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:22.356966 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d542f0fc-2122-4770-a9f6-ef2f96a43c17 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:22.367714 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-531bc45c-5222-4f04-b18c-0829da51556c tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:22.368408 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-531bc45c-5222-4f04-b18c-0829da51556c tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:22.371986 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-531bc45c-5222-4f04-b18c-0829da51556c tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:22.377618 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-531bc45c-5222-4f04-b18c-0829da51556c tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:22.377618 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-531bc45c-5222-4f04-b18c-0829da51556c tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:22.382935 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-531bc45c-5222-4f04-b18c-0829da51556c tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:22.649057 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d542f0fc-2122-4770-a9f6-ef2f96a43c17 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:22.663577 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d542f0fc-2122-4770-a9f6-ef2f96a43c17 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/d7223d39-2ef0-443b-989b-87c1fe11d2c1" status: 200 len: 1271 microversion: 2.1 time: 0.352604 Oct 19 03:48:22.668512 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3021/6110] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:48:22 2022] GET /compute/v2.1/servers/d7223d39-2ef0-443b-989b-87c1fe11d2c1 => generated 1271 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:48:22.683864 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-531bc45c-5222-4f04-b18c-0829da51556c tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881e3245fa91439682dd7ffd31b3f5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a42569fa043433a9455e9a09941a109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:22.703088 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-531bc45c-5222-4f04-b18c-0829da51556c tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] 10.222.0.52 "GET /compute/v2.1/servers/cdbd892a-6028-43ab-8957-c44fc7257d8a" status: 200 len: 1314 microversion: 2.1 time: 0.370385 Oct 19 03:48:22.708284 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3090/6111] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:48:22 2022] GET /compute/v2.1/servers/cdbd892a-6028-43ab-8957-c44fc7257d8a => generated 1314 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:48:22.918601 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-01a02bc8-5058-4d3b-9d93-848e9d70bd23 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:48:22.920088 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-01a02bc8-5058-4d3b-9d93-848e9d70bd23 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 89f2e52f-afcb-49bf-a39a-4b442a96eba8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:48:22.936998 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-01a02bc8-5058-4d3b-9d93-848e9d70bd23 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:22.937707 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-01a02bc8-5058-4d3b-9d93-848e9d70bd23 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:22.938164 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-01a02bc8-5058-4d3b-9d93-848e9d70bd23 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:22.938975 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-01a02bc8-5058-4d3b-9d93-848e9d70bd23 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:22.939438 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-01a02bc8-5058-4d3b-9d93-848e9d70bd23 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:22.939931 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-01a02bc8-5058-4d3b-9d93-848e9d70bd23 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:23.286111 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-01a02bc8-5058-4d3b-9d93-848e9d70bd23 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:23.297890 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-01a02bc8-5058-4d3b-9d93-848e9d70bd23 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:23.299768 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-01a02bc8-5058-4d3b-9d93-848e9d70bd23 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:23.301167 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-01a02bc8-5058-4d3b-9d93-848e9d70bd23 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8" status: 200 len: 1740 microversion: 2.20 time: 0.388918 Oct 19 03:48:23.306641 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3022/6112] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:48:22 2022] GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8 => generated 1740 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:48:23.689530 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9a83ec89-b3fe-4f21-9e19-1a88764325f5 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:48:23.690161 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9a83ec89-b3fe-4f21-9e19-1a88764325f5 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: d7223d39-2ef0-443b-989b-87c1fe11d2c1] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:48:23.705702 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9a83ec89-b3fe-4f21-9e19-1a88764325f5 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:23.706508 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9a83ec89-b3fe-4f21-9e19-1a88764325f5 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:23.707134 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9a83ec89-b3fe-4f21-9e19-1a88764325f5 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:23.708153 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9a83ec89-b3fe-4f21-9e19-1a88764325f5 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:23.708791 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9a83ec89-b3fe-4f21-9e19-1a88764325f5 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:23.714065 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9a83ec89-b3fe-4f21-9e19-1a88764325f5 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:23.734449 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-647bb747-6737-4c59-8927-2919d730b1c1 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:48:23.735883 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-647bb747-6737-4c59-8927-2919d730b1c1 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] [instance: cdbd892a-6028-43ab-8957-c44fc7257d8a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:48:23.746180 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-647bb747-6737-4c59-8927-2919d730b1c1 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:23.772183 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-647bb747-6737-4c59-8927-2919d730b1c1 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:23.773539 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-647bb747-6737-4c59-8927-2919d730b1c1 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:23.778079 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-647bb747-6737-4c59-8927-2919d730b1c1 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:23.778691 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-647bb747-6737-4c59-8927-2919d730b1c1 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:23.779234 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-647bb747-6737-4c59-8927-2919d730b1c1 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:23.799726 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-9a83ec89-b3fe-4f21-9e19-1a88764325f5 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:23.810351 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9a83ec89-b3fe-4f21-9e19-1a88764325f5 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/d7223d39-2ef0-443b-989b-87c1fe11d2c1" status: 200 len: 1319 microversion: 2.1 time: 0.124654 Oct 19 03:48:23.811161 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3091/6113] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:48:23 2022] GET /compute/v2.1/servers/d7223d39-2ef0-443b-989b-87c1fe11d2c1 => generated 1319 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:48:23.990372 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-19ad59a5-68c7-470e-b3f6-6b46f0f0bedb req-e482a3cd-9300-44ae-b2a9-4b278bfd7ac7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdbd892a-6028-43ab-8957-c44fc7257d8a", "name": "network-vif-plugged", "status": "completed", "tag": "7d2e2968-81c2-44a5-9dfd-20e0cfa06679"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:48:24.013450 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-647bb747-6737-4c59-8927-2919d730b1c1 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881e3245fa91439682dd7ffd31b3f5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a42569fa043433a9455e9a09941a109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:24.021911 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-19ad59a5-68c7-470e-b3f6-6b46f0f0bedb req-e482a3cd-9300-44ae-b2a9-4b278bfd7ac7 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:24.022440 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-19ad59a5-68c7-470e-b3f6-6b46f0f0bedb req-e482a3cd-9300-44ae-b2a9-4b278bfd7ac7 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:24.028198 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-19ad59a5-68c7-470e-b3f6-6b46f0f0bedb req-e482a3cd-9300-44ae-b2a9-4b278bfd7ac7 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:24.029194 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-647bb747-6737-4c59-8927-2919d730b1c1 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] 10.222.0.52 "GET /compute/v2.1/servers/cdbd892a-6028-43ab-8957-c44fc7257d8a" status: 200 len: 1314 microversion: 2.1 time: 0.298607 Oct 19 03:48:24.031904 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3023/6114] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:48:23 2022] GET /compute/v2.1/servers/cdbd892a-6028-43ab-8957-c44fc7257d8a => generated 1314 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:48:24.047928 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-19ad59a5-68c7-470e-b3f6-6b46f0f0bedb req-e482a3cd-9300-44ae-b2a9-4b278bfd7ac7 service nova] Creating event network-vif-plugged:7d2e2968-81c2-44a5-9dfd-20e0cfa06679 for instance cdbd892a-6028-43ab-8957-c44fc7257d8a on n-h1-861333-8 Oct 19 03:48:24.054329 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-19ad59a5-68c7-470e-b3f6-6b46f0f0bedb req-e482a3cd-9300-44ae-b2a9-4b278bfd7ac7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067766 Oct 19 03:48:24.055775 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3092/6115] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:48:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:48:24.335139 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-217b14ae-6a7f-42d0-b104-62966cb5e8a9 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:48:24.335739 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-217b14ae-6a7f-42d0-b104-62966cb5e8a9 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 89f2e52f-afcb-49bf-a39a-4b442a96eba8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:48:24.349426 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-217b14ae-6a7f-42d0-b104-62966cb5e8a9 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:24.349915 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-217b14ae-6a7f-42d0-b104-62966cb5e8a9 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:24.350365 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-217b14ae-6a7f-42d0-b104-62966cb5e8a9 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:24.351183 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-217b14ae-6a7f-42d0-b104-62966cb5e8a9 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:24.360760 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-217b14ae-6a7f-42d0-b104-62966cb5e8a9 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:24.361297 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-217b14ae-6a7f-42d0-b104-62966cb5e8a9 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:24.779325 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-217b14ae-6a7f-42d0-b104-62966cb5e8a9 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:24.787779 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-217b14ae-6a7f-42d0-b104-62966cb5e8a9 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:24.798033 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-217b14ae-6a7f-42d0-b104-62966cb5e8a9 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:24.799310 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-217b14ae-6a7f-42d0-b104-62966cb5e8a9 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8" status: 200 len: 1740 microversion: 2.20 time: 0.469093 Oct 19 03:48:24.799916 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3024/6116] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:48:24 2022] GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8 => generated 1740 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:48:24.839353 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-434b9daa-717a-4401-9642-2c6d49bf7f6f tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:48:24.840083 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-434b9daa-717a-4401-9642-2c6d49bf7f6f tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: d7223d39-2ef0-443b-989b-87c1fe11d2c1] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:48:24.851940 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-434b9daa-717a-4401-9642-2c6d49bf7f6f tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:24.853272 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-434b9daa-717a-4401-9642-2c6d49bf7f6f tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:24.854827 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-434b9daa-717a-4401-9642-2c6d49bf7f6f tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:24.855889 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-434b9daa-717a-4401-9642-2c6d49bf7f6f tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:24.856608 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-434b9daa-717a-4401-9642-2c6d49bf7f6f tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:24.857534 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-434b9daa-717a-4401-9642-2c6d49bf7f6f tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:24.943045 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-434b9daa-717a-4401-9642-2c6d49bf7f6f tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:24.957048 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-434b9daa-717a-4401-9642-2c6d49bf7f6f tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/d7223d39-2ef0-443b-989b-87c1fe11d2c1" status: 200 len: 1325 microversion: 2.1 time: 0.125934 Oct 19 03:48:24.973923 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3093/6117] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:48:24 2022] GET /compute/v2.1/servers/d7223d39-2ef0-443b-989b-87c1fe11d2c1 => generated 1325 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:48:25.052098 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-15cb4596-cee7-47c8-9d2d-8564ed23a263 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:48:25.052732 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-15cb4596-cee7-47c8-9d2d-8564ed23a263 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] [instance: cdbd892a-6028-43ab-8957-c44fc7257d8a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:48:25.060200 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-15cb4596-cee7-47c8-9d2d-8564ed23a263 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:25.060707 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-15cb4596-cee7-47c8-9d2d-8564ed23a263 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:25.061157 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-15cb4596-cee7-47c8-9d2d-8564ed23a263 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:25.061903 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-15cb4596-cee7-47c8-9d2d-8564ed23a263 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:25.062629 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-15cb4596-cee7-47c8-9d2d-8564ed23a263 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:25.063296 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-15cb4596-cee7-47c8-9d2d-8564ed23a263 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:25.425729 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-15cb4596-cee7-47c8-9d2d-8564ed23a263 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881e3245fa91439682dd7ffd31b3f5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a42569fa043433a9455e9a09941a109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:25.447544 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-15cb4596-cee7-47c8-9d2d-8564ed23a263 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] 10.222.0.52 "GET /compute/v2.1/servers/cdbd892a-6028-43ab-8957-c44fc7257d8a" status: 200 len: 1314 microversion: 2.1 time: 0.397261 Oct 19 03:48:25.449028 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3025/6118] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:48:25 2022] GET /compute/v2.1/servers/cdbd892a-6028-43ab-8957-c44fc7257d8a => generated 1314 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:48:25.827167 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4f4b7605-6ef8-4d7f-bbc0-a4bd997605d3 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:48:25.828465 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4f4b7605-6ef8-4d7f-bbc0-a4bd997605d3 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 89f2e52f-afcb-49bf-a39a-4b442a96eba8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:48:25.850888 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4f4b7605-6ef8-4d7f-bbc0-a4bd997605d3 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:25.853165 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4f4b7605-6ef8-4d7f-bbc0-a4bd997605d3 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:25.853777 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4f4b7605-6ef8-4d7f-bbc0-a4bd997605d3 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:25.855094 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4f4b7605-6ef8-4d7f-bbc0-a4bd997605d3 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:25.855659 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4f4b7605-6ef8-4d7f-bbc0-a4bd997605d3 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:25.856189 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4f4b7605-6ef8-4d7f-bbc0-a4bd997605d3 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:25.981162 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-567e2a4f-a3ff-4fc6-a4d1-1f09a10ae8da tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:48:25.982986 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-567e2a4f-a3ff-4fc6-a4d1-1f09a10ae8da tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: d7223d39-2ef0-443b-989b-87c1fe11d2c1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:48:26.000030 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-567e2a4f-a3ff-4fc6-a4d1-1f09a10ae8da tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:26.010559 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-567e2a4f-a3ff-4fc6-a4d1-1f09a10ae8da tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:26.011368 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-567e2a4f-a3ff-4fc6-a4d1-1f09a10ae8da tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:26.012335 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-567e2a4f-a3ff-4fc6-a4d1-1f09a10ae8da tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:26.012988 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-567e2a4f-a3ff-4fc6-a4d1-1f09a10ae8da tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:26.014651 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-567e2a4f-a3ff-4fc6-a4d1-1f09a10ae8da tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:26.200832 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4f4b7605-6ef8-4d7f-bbc0-a4bd997605d3 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:26.212905 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4f4b7605-6ef8-4d7f-bbc0-a4bd997605d3 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:26.216932 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4f4b7605-6ef8-4d7f-bbc0-a4bd997605d3 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:26.220701 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4f4b7605-6ef8-4d7f-bbc0-a4bd997605d3 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8" status: 200 len: 1740 microversion: 2.20 time: 0.397545 Oct 19 03:48:26.223926 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3094/6119] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:48:25 2022] GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8 => generated 1740 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:48:26.333407 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-567e2a4f-a3ff-4fc6-a4d1-1f09a10ae8da tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:26.344515 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-567e2a4f-a3ff-4fc6-a4d1-1f09a10ae8da tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/d7223d39-2ef0-443b-989b-87c1fe11d2c1" status: 200 len: 1393 microversion: 2.1 time: 0.368306 Oct 19 03:48:26.345544 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3026/6120] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:48:25 2022] GET /compute/v2.1/servers/d7223d39-2ef0-443b-989b-87c1fe11d2c1 => generated 1393 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:48:26.529023 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6901e6cd-1e5f-40d1-a159-c64fc615af46 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:48:26.529023 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6901e6cd-1e5f-40d1-a159-c64fc615af46 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] [instance: cdbd892a-6028-43ab-8957-c44fc7257d8a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:48:26.529023 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6901e6cd-1e5f-40d1-a159-c64fc615af46 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:26.529023 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6901e6cd-1e5f-40d1-a159-c64fc615af46 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:26.529023 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6901e6cd-1e5f-40d1-a159-c64fc615af46 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:26.529023 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6901e6cd-1e5f-40d1-a159-c64fc615af46 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:26.529023 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6901e6cd-1e5f-40d1-a159-c64fc615af46 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:26.529023 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6901e6cd-1e5f-40d1-a159-c64fc615af46 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:26.727985 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-6901e6cd-1e5f-40d1-a159-c64fc615af46 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881e3245fa91439682dd7ffd31b3f5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a42569fa043433a9455e9a09941a109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:26.736036 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6901e6cd-1e5f-40d1-a159-c64fc615af46 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] 10.222.0.52 "GET /compute/v2.1/servers/cdbd892a-6028-43ab-8957-c44fc7257d8a" status: 200 len: 1464 microversion: 2.1 time: 0.259787 Oct 19 03:48:26.756107 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3095/6121] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:48:26 2022] GET /compute/v2.1/servers/cdbd892a-6028-43ab-8957-c44fc7257d8a => generated 1464 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:48:26.803470 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c3d7edf8-ea0e-40d7-853f-4bb80b70d992 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:48:26.803984 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c3d7edf8-ea0e-40d7-853f-4bb80b70d992 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] [instance: cdbd892a-6028-43ab-8957-c44fc7257d8a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:48:26.812240 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c3d7edf8-ea0e-40d7-853f-4bb80b70d992 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:26.812787 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c3d7edf8-ea0e-40d7-853f-4bb80b70d992 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:26.813285 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c3d7edf8-ea0e-40d7-853f-4bb80b70d992 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:26.814122 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c3d7edf8-ea0e-40d7-853f-4bb80b70d992 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:26.814586 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c3d7edf8-ea0e-40d7-853f-4bb80b70d992 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:26.815027 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c3d7edf8-ea0e-40d7-853f-4bb80b70d992 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:26.856019 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c3d7edf8-ea0e-40d7-853f-4bb80b70d992 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] [instance: cdbd892a-6028-43ab-8957-c44fc7257d8a] Going to try to terminate instance {{(pid=121134) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:48:27.252403 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-8a2e8c00-de1c-476b-b1d0-8f86adce1318 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:48:27.253925 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-8a2e8c00-de1c-476b-b1d0-8f86adce1318 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 89f2e52f-afcb-49bf-a39a-4b442a96eba8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:48:27.263767 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8a2e8c00-de1c-476b-b1d0-8f86adce1318 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:27.266644 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8a2e8c00-de1c-476b-b1d0-8f86adce1318 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:27.267344 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8a2e8c00-de1c-476b-b1d0-8f86adce1318 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:27.268105 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8a2e8c00-de1c-476b-b1d0-8f86adce1318 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:27.268575 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8a2e8c00-de1c-476b-b1d0-8f86adce1318 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:27.269016 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8a2e8c00-de1c-476b-b1d0-8f86adce1318 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:27.380205 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c3d7edf8-ea0e-40d7-853f-4bb80b70d992 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] 10.222.0.52 "DELETE /compute/v2.1/servers/cdbd892a-6028-43ab-8957-c44fc7257d8a" status: 204 len: 0 microversion: 2.1 time: 0.580222 Oct 19 03:48:27.382281 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3027/6122] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:48:26 2022] DELETE /compute/v2.1/servers/cdbd892a-6028-43ab-8957-c44fc7257d8a => generated 0 bytes in 583 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:48:27.390833 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c6e50890-623c-4aa7-996b-65a10392c17a tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:48:27.391854 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c6e50890-623c-4aa7-996b-65a10392c17a tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: d7223d39-2ef0-443b-989b-87c1fe11d2c1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:48:27.407120 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c6e50890-623c-4aa7-996b-65a10392c17a tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:27.407623 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c6e50890-623c-4aa7-996b-65a10392c17a tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:27.408058 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c6e50890-623c-4aa7-996b-65a10392c17a tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:27.408759 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c6e50890-623c-4aa7-996b-65a10392c17a tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:27.410890 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c6e50890-623c-4aa7-996b-65a10392c17a tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:27.411494 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c6e50890-623c-4aa7-996b-65a10392c17a tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:27.596049 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-8a2e8c00-de1c-476b-b1d0-8f86adce1318 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:27.625823 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-8a2e8c00-de1c-476b-b1d0-8f86adce1318 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:27.633000 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-8a2e8c00-de1c-476b-b1d0-8f86adce1318 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:27.635569 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-8a2e8c00-de1c-476b-b1d0-8f86adce1318 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8" status: 200 len: 1740 microversion: 2.20 time: 0.387520 Oct 19 03:48:27.642041 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3096/6123] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:48:27 2022] GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8 => generated 1740 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:48:27.650043 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f8509e41-003f-4b97-b6f5-1125cfd802d6 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:48:27.653646 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f8509e41-003f-4b97-b6f5-1125cfd802d6 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] [instance: cdbd892a-6028-43ab-8957-c44fc7257d8a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:48:27.664550 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f8509e41-003f-4b97-b6f5-1125cfd802d6 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:27.665755 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f8509e41-003f-4b97-b6f5-1125cfd802d6 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:27.666454 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f8509e41-003f-4b97-b6f5-1125cfd802d6 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:27.667956 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f8509e41-003f-4b97-b6f5-1125cfd802d6 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:27.669084 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f8509e41-003f-4b97-b6f5-1125cfd802d6 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:27.670481 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f8509e41-003f-4b97-b6f5-1125cfd802d6 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:27.929763 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c6e50890-623c-4aa7-996b-65a10392c17a tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:27.956812 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c6e50890-623c-4aa7-996b-65a10392c17a tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/d7223d39-2ef0-443b-989b-87c1fe11d2c1" status: 200 len: 1393 microversion: 2.1 time: 0.552170 Oct 19 03:48:27.956812 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3028/6124] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:48:27 2022] GET /compute/v2.1/servers/d7223d39-2ef0-443b-989b-87c1fe11d2c1 => generated 1393 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:48:27.965403 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-4e00d258-46ba-401e-93fd-96def8d71f55 req-efd707a0-5c42-4419-bb78-6fec11143ae8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7223d39-2ef0-443b-989b-87c1fe11d2c1", "tag": "f1a51aab-0c40-4b41-ae4e-760590333068"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:48:27.995742 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-4e00d258-46ba-401e-93fd-96def8d71f55 req-efd707a0-5c42-4419-bb78-6fec11143ae8 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:27.996298 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-4e00d258-46ba-401e-93fd-96def8d71f55 req-efd707a0-5c42-4419-bb78-6fec11143ae8 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:27.996640 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-4e00d258-46ba-401e-93fd-96def8d71f55 req-efd707a0-5c42-4419-bb78-6fec11143ae8 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:28.019492 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-4e00d258-46ba-401e-93fd-96def8d71f55 req-efd707a0-5c42-4419-bb78-6fec11143ae8 service nova] Creating event network-changed:f1a51aab-0c40-4b41-ae4e-760590333068 for instance d7223d39-2ef0-443b-989b-87c1fe11d2c1 on n-h2-861333-8 Oct 19 03:48:28.031033 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-4e00d258-46ba-401e-93fd-96def8d71f55 req-efd707a0-5c42-4419-bb78-6fec11143ae8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081746 Oct 19 03:48:28.035169 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3029/6125] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:48:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:48:28.133202 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f8509e41-003f-4b97-b6f5-1125cfd802d6 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881e3245fa91439682dd7ffd31b3f5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a42569fa043433a9455e9a09941a109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:28.145919 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f8509e41-003f-4b97-b6f5-1125cfd802d6 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] 10.222.0.52 "GET /compute/v2.1/servers/cdbd892a-6028-43ab-8957-c44fc7257d8a" status: 200 len: 1470 microversion: 2.1 time: 0.501737 Oct 19 03:48:28.146683 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3097/6126] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:48:27 2022] GET /compute/v2.1/servers/cdbd892a-6028-43ab-8957-c44fc7257d8a => generated 1470 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:48:28.670777 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3f80356f-d0bb-4a8e-8b63-a4e94306993c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:48:28.671479 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3f80356f-d0bb-4a8e-8b63-a4e94306993c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 89f2e52f-afcb-49bf-a39a-4b442a96eba8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:48:28.683226 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3f80356f-d0bb-4a8e-8b63-a4e94306993c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:28.689961 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3f80356f-d0bb-4a8e-8b63-a4e94306993c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:28.689961 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3f80356f-d0bb-4a8e-8b63-a4e94306993c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:28.689961 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3f80356f-d0bb-4a8e-8b63-a4e94306993c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:28.689961 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3f80356f-d0bb-4a8e-8b63-a4e94306993c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:28.689961 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3f80356f-d0bb-4a8e-8b63-a4e94306993c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:28.857494 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-3f80356f-d0bb-4a8e-8b63-a4e94306993c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:28.866423 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-3f80356f-d0bb-4a8e-8b63-a4e94306993c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:28.868479 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-3f80356f-d0bb-4a8e-8b63-a4e94306993c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:28.869714 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3f80356f-d0bb-4a8e-8b63-a4e94306993c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8" status: 200 len: 1740 microversion: 2.20 time: 0.203276 Oct 19 03:48:28.870282 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3030/6127] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:48:28 2022] GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8 => generated 1740 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:48:28.975342 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9b42606d-91b7-47ab-ad3d-ddacf0ba6ac0 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:48:28.975963 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9b42606d-91b7-47ab-ad3d-ddacf0ba6ac0 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: d7223d39-2ef0-443b-989b-87c1fe11d2c1] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:48:28.983097 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9b42606d-91b7-47ab-ad3d-ddacf0ba6ac0 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:28.983853 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9b42606d-91b7-47ab-ad3d-ddacf0ba6ac0 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:28.984299 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9b42606d-91b7-47ab-ad3d-ddacf0ba6ac0 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:28.984995 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9b42606d-91b7-47ab-ad3d-ddacf0ba6ac0 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:28.985474 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9b42606d-91b7-47ab-ad3d-ddacf0ba6ac0 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:28.985910 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9b42606d-91b7-47ab-ad3d-ddacf0ba6ac0 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:29.153131 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-9b42606d-91b7-47ab-ad3d-ddacf0ba6ac0 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:29.163249 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9b42606d-91b7-47ab-ad3d-ddacf0ba6ac0 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/d7223d39-2ef0-443b-989b-87c1fe11d2c1" status: 200 len: 1393 microversion: 2.1 time: 0.190959 Oct 19 03:48:29.164128 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3098/6128] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:48:28 2022] GET /compute/v2.1/servers/d7223d39-2ef0-443b-989b-87c1fe11d2c1 => generated 1393 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:48:29.171466 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-01e60903-b7fb-49f9-819d-bed6ee274cde tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:48:29.172335 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-01e60903-b7fb-49f9-819d-bed6ee274cde tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] [instance: cdbd892a-6028-43ab-8957-c44fc7257d8a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:48:29.181620 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-01e60903-b7fb-49f9-819d-bed6ee274cde tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:29.182770 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-01e60903-b7fb-49f9-819d-bed6ee274cde tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:29.183401 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-01e60903-b7fb-49f9-819d-bed6ee274cde tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:29.184629 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-01e60903-b7fb-49f9-819d-bed6ee274cde tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:29.185255 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-01e60903-b7fb-49f9-819d-bed6ee274cde tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:29.186016 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-01e60903-b7fb-49f9-819d-bed6ee274cde tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:29.378078 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-01e60903-b7fb-49f9-819d-bed6ee274cde tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881e3245fa91439682dd7ffd31b3f5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a42569fa043433a9455e9a09941a109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:29.390384 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-01e60903-b7fb-49f9-819d-bed6ee274cde tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] 10.222.0.52 "GET /compute/v2.1/servers/cdbd892a-6028-43ab-8957-c44fc7257d8a" status: 200 len: 1470 microversion: 2.1 time: 0.224798 Oct 19 03:48:29.394131 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3031/6129] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:48:29 2022] GET /compute/v2.1/servers/cdbd892a-6028-43ab-8957-c44fc7257d8a => generated 1470 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:48:29.801120 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-3f273953-8649-40f9-afc3-61a9e92a28ae req-1c58a466-8ffe-4851-a499-5b52e78b762f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdbd892a-6028-43ab-8957-c44fc7257d8a", "name": "network-vif-deleted", "tag": "7d2e2968-81c2-44a5-9dfd-20e0cfa06679"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:48:29.807859 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:48:29.814242 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-3f273953-8649-40f9-afc3-61a9e92a28ae req-1c58a466-8ffe-4851-a499-5b52e78b762f service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:29.814835 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-3f273953-8649-40f9-afc3-61a9e92a28ae req-1c58a466-8ffe-4851-a499-5b52e78b762f service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:29.815343 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-3f273953-8649-40f9-afc3-61a9e92a28ae req-1c58a466-8ffe-4851-a499-5b52e78b762f service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:29.835030 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-3f273953-8649-40f9-afc3-61a9e92a28ae req-1c58a466-8ffe-4851-a499-5b52e78b762f service nova] Creating event network-vif-deleted:7d2e2968-81c2-44a5-9dfd-20e0cfa06679 for instance cdbd892a-6028-43ab-8957-c44fc7257d8a on n-h1-861333-8 Oct 19 03:48:29.840387 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-3f273953-8649-40f9-afc3-61a9e92a28ae req-1c58a466-8ffe-4851-a499-5b52e78b762f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044770 Oct 19 03:48:29.842440 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3099/6130] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:48:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:48:29.896332 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-bfefeb7e-6c84-4a6d-be3a-089705b7fcd0 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:48:29.896935 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-bfefeb7e-6c84-4a6d-be3a-089705b7fcd0 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 89f2e52f-afcb-49bf-a39a-4b442a96eba8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:48:29.903404 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bfefeb7e-6c84-4a6d-be3a-089705b7fcd0 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:29.906908 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bfefeb7e-6c84-4a6d-be3a-089705b7fcd0 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:29.906908 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bfefeb7e-6c84-4a6d-be3a-089705b7fcd0 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:29.906908 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bfefeb7e-6c84-4a6d-be3a-089705b7fcd0 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:29.906908 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bfefeb7e-6c84-4a6d-be3a-089705b7fcd0 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:29.906908 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bfefeb7e-6c84-4a6d-be3a-089705b7fcd0 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:30.073598 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=12 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:48:30.143108 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-bfefeb7e-6c84-4a6d-be3a-089705b7fcd0 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:30.152722 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-bfefeb7e-6c84-4a6d-be3a-089705b7fcd0 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:30.154246 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-bfefeb7e-6c84-4a6d-be3a-089705b7fcd0 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:30.155468 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-bfefeb7e-6c84-4a6d-be3a-089705b7fcd0 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8" status: 200 len: 1740 microversion: 2.20 time: 0.263089 Oct 19 03:48:30.156075 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3032/6131] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:48:29 2022] GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8 => generated 1740 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:48:30.190473 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-93012dc7-e65c-4231-8a86-647d31f8a716 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:48:30.191294 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-93012dc7-e65c-4231-8a86-647d31f8a716 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: d7223d39-2ef0-443b-989b-87c1fe11d2c1] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:48:30.199110 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-93012dc7-e65c-4231-8a86-647d31f8a716 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:30.199613 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-93012dc7-e65c-4231-8a86-647d31f8a716 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:30.200058 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-93012dc7-e65c-4231-8a86-647d31f8a716 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:30.200747 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-93012dc7-e65c-4231-8a86-647d31f8a716 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:30.201273 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-93012dc7-e65c-4231-8a86-647d31f8a716 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:30.201739 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-93012dc7-e65c-4231-8a86-647d31f8a716 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:30.418631 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7097116b-8ddc-4a29-a36c-f70b5841f0b1 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:48:30.419247 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7097116b-8ddc-4a29-a36c-f70b5841f0b1 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] [instance: cdbd892a-6028-43ab-8957-c44fc7257d8a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:48:30.427200 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7097116b-8ddc-4a29-a36c-f70b5841f0b1 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:30.427781 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7097116b-8ddc-4a29-a36c-f70b5841f0b1 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:30.428234 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7097116b-8ddc-4a29-a36c-f70b5841f0b1 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:30.428935 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7097116b-8ddc-4a29-a36c-f70b5841f0b1 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:30.429930 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7097116b-8ddc-4a29-a36c-f70b5841f0b1 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:30.430373 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7097116b-8ddc-4a29-a36c-f70b5841f0b1 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:30.446319 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:48:30.463856 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7097116b-8ddc-4a29-a36c-f70b5841f0b1 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:30.464403 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7097116b-8ddc-4a29-a36c-f70b5841f0b1 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:30.464870 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7097116b-8ddc-4a29-a36c-f70b5841f0b1 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:30.465328 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-7097116b-8ddc-4a29-a36c-f70b5841f0b1 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Lazy-loading 'fault' on Instance uuid cdbd892a-6028-43ab-8957-c44fc7257d8a {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:48:30.546905 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-93012dc7-e65c-4231-8a86-647d31f8a716 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:30.558337 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-7097116b-8ddc-4a29-a36c-f70b5841f0b1 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881e3245fa91439682dd7ffd31b3f5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a42569fa043433a9455e9a09941a109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:30.559007 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-93012dc7-e65c-4231-8a86-647d31f8a716 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/d7223d39-2ef0-443b-989b-87c1fe11d2c1" status: 200 len: 1393 microversion: 2.1 time: 0.373305 Oct 19 03:48:30.560940 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3100/6132] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:48:30 2022] GET /compute/v2.1/servers/d7223d39-2ef0-443b-989b-87c1fe11d2c1 => generated 1393 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:48:30.569127 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7097116b-8ddc-4a29-a36c-f70b5841f0b1 tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] 10.222.0.52 "GET /compute/v2.1/servers/cdbd892a-6028-43ab-8957-c44fc7257d8a" status: 200 len: 1304 microversion: 2.1 time: 0.154273 Oct 19 03:48:30.569127 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3033/6133] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:48:30 2022] GET /compute/v2.1/servers/cdbd892a-6028-43ab-8957-c44fc7257d8a => generated 1304 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:48:31.181422 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b07d296e-dd07-46ca-a415-d9e66f10ae7e tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:48:31.181934 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b07d296e-dd07-46ca-a415-d9e66f10ae7e tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 89f2e52f-afcb-49bf-a39a-4b442a96eba8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:48:31.189137 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b07d296e-dd07-46ca-a415-d9e66f10ae7e tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:31.189635 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b07d296e-dd07-46ca-a415-d9e66f10ae7e tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:31.190076 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b07d296e-dd07-46ca-a415-d9e66f10ae7e tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:31.191345 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b07d296e-dd07-46ca-a415-d9e66f10ae7e tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:31.191958 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b07d296e-dd07-46ca-a415-d9e66f10ae7e tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:31.192240 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b07d296e-dd07-46ca-a415-d9e66f10ae7e tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:31.284747 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=8 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:48:31.333572 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b07d296e-dd07-46ca-a415-d9e66f10ae7e tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:31.342652 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b07d296e-dd07-46ca-a415-d9e66f10ae7e tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:31.344106 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b07d296e-dd07-46ca-a415-d9e66f10ae7e tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:31.345282 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b07d296e-dd07-46ca-a415-d9e66f10ae7e tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8" status: 200 len: 1722 microversion: 2.20 time: 0.168493 Oct 19 03:48:31.345889 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3101/6134] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:48:31 2022] GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:48:31.591880 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2777f8c8-ecd1-4763-a375-15ee6295914c tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:48:31.592434 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7840030b-39ba-4af5-9208-e0ccb0632acf tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:48:31.592716 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7840030b-39ba-4af5-9208-e0ccb0632acf tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: d7223d39-2ef0-443b-989b-87c1fe11d2c1] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:48:31.593484 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2777f8c8-ecd1-4763-a375-15ee6295914c tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] [instance: cdbd892a-6028-43ab-8957-c44fc7257d8a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:48:31.599155 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7840030b-39ba-4af5-9208-e0ccb0632acf tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:31.599664 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7840030b-39ba-4af5-9208-e0ccb0632acf tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:31.600113 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7840030b-39ba-4af5-9208-e0ccb0632acf tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:31.600826 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7840030b-39ba-4af5-9208-e0ccb0632acf tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:31.602192 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7840030b-39ba-4af5-9208-e0ccb0632acf tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:31.602634 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7840030b-39ba-4af5-9208-e0ccb0632acf tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:31.603008 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2777f8c8-ecd1-4763-a375-15ee6295914c tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:31.603758 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2777f8c8-ecd1-4763-a375-15ee6295914c tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:31.604464 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2777f8c8-ecd1-4763-a375-15ee6295914c tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:31.605440 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2777f8c8-ecd1-4763-a375-15ee6295914c tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:31.606134 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2777f8c8-ecd1-4763-a375-15ee6295914c tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:31.606810 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2777f8c8-ecd1-4763-a375-15ee6295914c tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:31.622683 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-2777f8c8-ecd1-4763-a375-15ee6295914c tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] HTTP exception thrown: Instance cdbd892a-6028-43ab-8957-c44fc7257d8a could not be found. Oct 19 03:48:31.627351 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2777f8c8-ecd1-4763-a375-15ee6295914c tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Request method failure captured: Oct 19 03:48:31.627351 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/cdbd892a-6028-43ab-8957-c44fc7257d8a HTTP/1.1 Oct 19 03:48:31.627351 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:48:31.627351 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:48:31.627351 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:48:31.627351 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:48:31.627351 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:48:31.627351 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:48:31.627351 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:48:31.627351 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:48:31.627351 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3N0GcIAHbPIlNoC0I-9feNy4-3HFiIsuZ7GwtBgnMXTea5ExCc40jW_OCEw4Q5PnmY0_DjFI57HRKZq0RPrijPH9zahculsc2r3K6tfBubAZyfcDmXgPigUKMv3bQk1ucAZpTTYAHjOkaHzEzsjs9jyOj_VUgQ9MTmBwcgDmJOIR0I Oct 19 03:48:31.627351 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:48:31.627351 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:48:31.627351 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:48:31.627351 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:48:31.627351 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:48:31.627351 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:48:31.627351 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 9a42569fa043433a9455e9a09941a109 Oct 19 03:48:31.627351 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-VolumesNegativeTest-1878567251 Oct 19 03:48:31.627351 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:48:31.627351 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:48:31.627351 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9a42569fa043433a9455e9a09941a109"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9a42569fa043433a9455e9a09941a109"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9a42569fa043433a9455e9a09941a109"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9a42569fa043433a9455e9a09941a109", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:48:31.627351 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-VolumesNegativeTest-1878567251 Oct 19 03:48:31.627351 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 9a42569fa043433a9455e9a09941a109 Oct 19 03:48:31.627351 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-VolumesNegativeTest-1878567251 Oct 19 03:48:31.627351 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-VolumesNegativeTest-1878567251-project Oct 19 03:48:31.627351 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:48:31.627351 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:48:31.627351 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 881e3245fa91439682dd7ffd31b3f5ce Oct 19 03:48:31.627351 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-VolumesNegativeTest-1878567251-project Oct 19 03:48:31.627351 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:48:31.627351 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance cdbd892a-6028-43ab-8957-c44fc7257d8a could not be found. Oct 19 03:48:31.627351 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': 'cdbd892a-6028-43ab-8957-c44fc7257d8a'} Oct 19 03:48:31.627351 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:48:31.627351 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:48:31.627351 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:48:31.627351 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:48:31.627351 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:48:31.627351 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:48:31.627351 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:48:31.627351 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:48:31.627351 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:48:31.627351 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:48:31.627351 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cdbd892a-6028-43ab-8957-c44fc7257d8a could not be found. Oct 19 03:48:31.627351 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:48:31.627351 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:48:31.627351 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:48:31.627351 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:48:31.627351 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:48:31.627351 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:48:31.627351 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:48:31.627351 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:48:31.627351 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:48:31.627351 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:48:31.627351 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:48:31.627351 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:48:31.627351 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:48:31.627351 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:48:31.627351 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:48:31.627351 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:48:31.627351 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cdbd892a-6028-43ab-8957-c44fc7257d8a could not be found. Oct 19 03:48:31.627351 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:48:31.627351 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:48:31.627351 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:48:31.640525 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:48:31.640525 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:48:31.640525 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:48:31.640525 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:48:31.640525 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:48:31.640525 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cdbd892a-6028-43ab-8957-c44fc7257d8a could not be found. Oct 19 03:48:31.640525 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:48:31.640525 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2777f8c8-ecd1-4763-a375-15ee6295914c tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] Returning 404 to user: Instance cdbd892a-6028-43ab-8957-c44fc7257d8a could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:48:31.640525 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2777f8c8-ecd1-4763-a375-15ee6295914c tempest-VolumesNegativeTest-1878567251 tempest-VolumesNegativeTest-1878567251-project] 10.222.0.52 "GET /compute/v2.1/servers/cdbd892a-6028-43ab-8957-c44fc7257d8a" status: 404 len: 111 microversion: 2.1 time: 0.038064 Oct 19 03:48:31.644639 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3034/6135] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:48:31 2022] GET /compute/v2.1/servers/cdbd892a-6028-43ab-8957-c44fc7257d8a => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:48:31.753217 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7840030b-39ba-4af5-9208-e0ccb0632acf tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:31.761204 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7840030b-39ba-4af5-9208-e0ccb0632acf tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/d7223d39-2ef0-443b-989b-87c1fe11d2c1" status: 200 len: 1393 microversion: 2.1 time: 0.172980 Oct 19 03:48:31.762871 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3102/6136] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:48:31 2022] GET /compute/v2.1/servers/d7223d39-2ef0-443b-989b-87c1fe11d2c1 => generated 1393 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:48:32.374148 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-31a5510b-4cdd-48fe-bf22-fe9402a7a310 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:48:32.374958 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-31a5510b-4cdd-48fe-bf22-fe9402a7a310 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 89f2e52f-afcb-49bf-a39a-4b442a96eba8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:48:32.382140 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-31a5510b-4cdd-48fe-bf22-fe9402a7a310 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:32.383532 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-31a5510b-4cdd-48fe-bf22-fe9402a7a310 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:32.384726 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-31a5510b-4cdd-48fe-bf22-fe9402a7a310 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:32.385953 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-31a5510b-4cdd-48fe-bf22-fe9402a7a310 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:32.386644 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-31a5510b-4cdd-48fe-bf22-fe9402a7a310 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:32.387306 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-31a5510b-4cdd-48fe-bf22-fe9402a7a310 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:32.559675 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-31a5510b-4cdd-48fe-bf22-fe9402a7a310 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:32.577751 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-31a5510b-4cdd-48fe-bf22-fe9402a7a310 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:32.579819 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-31a5510b-4cdd-48fe-bf22-fe9402a7a310 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:32.582435 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-31a5510b-4cdd-48fe-bf22-fe9402a7a310 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8" status: 200 len: 1722 microversion: 2.20 time: 0.212406 Oct 19 03:48:32.585203 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3035/6137] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:48:32 2022] GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8 => generated 1722 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:48:32.784633 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d2615a3c-f749-43e7-9bc7-1d63b481f533 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:48:32.786021 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d2615a3c-f749-43e7-9bc7-1d63b481f533 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: d7223d39-2ef0-443b-989b-87c1fe11d2c1] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:48:32.794881 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d2615a3c-f749-43e7-9bc7-1d63b481f533 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:32.795461 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d2615a3c-f749-43e7-9bc7-1d63b481f533 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:32.795978 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d2615a3c-f749-43e7-9bc7-1d63b481f533 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:32.796768 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d2615a3c-f749-43e7-9bc7-1d63b481f533 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:32.797323 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d2615a3c-f749-43e7-9bc7-1d63b481f533 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:32.797856 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d2615a3c-f749-43e7-9bc7-1d63b481f533 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:32.980586 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d2615a3c-f749-43e7-9bc7-1d63b481f533 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:32.998295 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d2615a3c-f749-43e7-9bc7-1d63b481f533 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/d7223d39-2ef0-443b-989b-87c1fe11d2c1" status: 200 len: 1393 microversion: 2.1 time: 0.209916 Oct 19 03:48:32.998295 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3103/6138] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:48:32 2022] GET /compute/v2.1/servers/d7223d39-2ef0-443b-989b-87c1fe11d2c1 => generated 1393 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:48:33.628000 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9abe4ca1-da1b-486b-a4a8-a4d119748e1c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:48:33.628000 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9abe4ca1-da1b-486b-a4a8-a4d119748e1c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 89f2e52f-afcb-49bf-a39a-4b442a96eba8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:48:33.638536 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9abe4ca1-da1b-486b-a4a8-a4d119748e1c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:33.639084 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9abe4ca1-da1b-486b-a4a8-a4d119748e1c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:33.639526 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9abe4ca1-da1b-486b-a4a8-a4d119748e1c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:33.640239 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9abe4ca1-da1b-486b-a4a8-a4d119748e1c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:33.640698 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9abe4ca1-da1b-486b-a4a8-a4d119748e1c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:33.641249 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9abe4ca1-da1b-486b-a4a8-a4d119748e1c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:33.793322 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9abe4ca1-da1b-486b-a4a8-a4d119748e1c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:33.801459 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9abe4ca1-da1b-486b-a4a8-a4d119748e1c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:33.802917 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9abe4ca1-da1b-486b-a4a8-a4d119748e1c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:33.804074 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9abe4ca1-da1b-486b-a4a8-a4d119748e1c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8" status: 200 len: 1725 microversion: 2.20 time: 0.193087 Oct 19 03:48:33.805293 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3036/6139] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:48:33 2022] GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8 => generated 1725 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:48:33.830077 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d266002c-96ff-4cbc-9f90-29d299132a14 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "851a808e-b646-4571-8afd-9deecf4beb93"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:48:33.832487 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d266002c-96ff-4cbc-9f90-29d299132a14 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 89f2e52f-afcb-49bf-a39a-4b442a96eba8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:48:33.839409 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d266002c-96ff-4cbc-9f90-29d299132a14 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:33.839901 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d266002c-96ff-4cbc-9f90-29d299132a14 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:33.840342 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d266002c-96ff-4cbc-9f90-29d299132a14 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:33.841039 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d266002c-96ff-4cbc-9f90-29d299132a14 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:33.841547 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d266002c-96ff-4cbc-9f90-29d299132a14 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:33.841983 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d266002c-96ff-4cbc-9f90-29d299132a14 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:33.919071 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=100 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:48:34.014617 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-331e84e6-fa31-4902-bc6f-d2cb31ef949f tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:48:34.015416 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-331e84e6-fa31-4902-bc6f-d2cb31ef949f tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: d7223d39-2ef0-443b-989b-87c1fe11d2c1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:48:34.021861 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-331e84e6-fa31-4902-bc6f-d2cb31ef949f tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:34.022360 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-331e84e6-fa31-4902-bc6f-d2cb31ef949f tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:34.022823 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-331e84e6-fa31-4902-bc6f-d2cb31ef949f tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:34.023686 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-331e84e6-fa31-4902-bc6f-d2cb31ef949f tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:34.024153 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-331e84e6-fa31-4902-bc6f-d2cb31ef949f tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:34.024591 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-331e84e6-fa31-4902-bc6f-d2cb31ef949f tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:34.218158 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-331e84e6-fa31-4902-bc6f-d2cb31ef949f tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:34.227174 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-331e84e6-fa31-4902-bc6f-d2cb31ef949f tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/d7223d39-2ef0-443b-989b-87c1fe11d2c1" status: 200 len: 1393 microversion: 2.1 time: 0.216115 Oct 19 03:48:34.227761 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3037/6140] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:48:34 2022] GET /compute/v2.1/servers/d7223d39-2ef0-443b-989b-87c1fe11d2c1 => generated 1393 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:48:34.232687 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-c1491311-40e7-43b3-995e-5fb5bd700f39 req-7b146241-ee8a-4811-8705-e788a556898c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7223d39-2ef0-443b-989b-87c1fe11d2c1", "name": "network-vif-plugged", "status": "completed", "tag": "f1a51aab-0c40-4b41-ae4e-760590333068"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:48:34.242899 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-c1491311-40e7-43b3-995e-5fb5bd700f39 req-7b146241-ee8a-4811-8705-e788a556898c service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:34.243521 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-c1491311-40e7-43b3-995e-5fb5bd700f39 req-7b146241-ee8a-4811-8705-e788a556898c service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:34.244033 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-c1491311-40e7-43b3-995e-5fb5bd700f39 req-7b146241-ee8a-4811-8705-e788a556898c service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:34.256952 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-c1491311-40e7-43b3-995e-5fb5bd700f39 req-7b146241-ee8a-4811-8705-e788a556898c service nova] Creating event network-vif-plugged:f1a51aab-0c40-4b41-ae4e-760590333068 for instance d7223d39-2ef0-443b-989b-87c1fe11d2c1 on n-h2-861333-8 Oct 19 03:48:34.261994 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-c1491311-40e7-43b3-995e-5fb5bd700f39 req-7b146241-ee8a-4811-8705-e788a556898c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032873 Oct 19 03:48:34.262586 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3038/6141] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:48:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:48:35.192632 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d266002c-96ff-4cbc-9f90-29d299132a14 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "POST /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.366573 Oct 19 03:48:35.193628 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3104/6142] 10.222.0.52 () {62 vars in 1364 bytes} [Wed Oct 19 03:48:33 2022] POST /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8/os-volume_attachments => generated 188 bytes in 1368 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 03:48:35.259498 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1f5558c1-a100-49c4-9068-49da1f4a67e2 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:48:35.260243 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1f5558c1-a100-49c4-9068-49da1f4a67e2 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: d7223d39-2ef0-443b-989b-87c1fe11d2c1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:48:35.275703 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1f5558c1-a100-49c4-9068-49da1f4a67e2 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:35.282699 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1f5558c1-a100-49c4-9068-49da1f4a67e2 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:35.283284 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1f5558c1-a100-49c4-9068-49da1f4a67e2 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:35.284044 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1f5558c1-a100-49c4-9068-49da1f4a67e2 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:35.284517 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1f5558c1-a100-49c4-9068-49da1f4a67e2 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:35.285259 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1f5558c1-a100-49c4-9068-49da1f4a67e2 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:35.350902 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-11b44546-afa0-4fe7-8b6b-ae510520c88d tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:48:35.352175 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-11b44546-afa0-4fe7-8b6b-ae510520c88d tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 89f2e52f-afcb-49bf-a39a-4b442a96eba8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:48:35.362365 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-11b44546-afa0-4fe7-8b6b-ae510520c88d tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:35.366859 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-11b44546-afa0-4fe7-8b6b-ae510520c88d tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:35.371324 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-11b44546-afa0-4fe7-8b6b-ae510520c88d tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:35.372197 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-11b44546-afa0-4fe7-8b6b-ae510520c88d tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:35.372676 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-11b44546-afa0-4fe7-8b6b-ae510520c88d tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:35.373446 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-11b44546-afa0-4fe7-8b6b-ae510520c88d tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:35.448850 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-11b44546-afa0-4fe7-8b6b-ae510520c88d tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 89f2e52f-afcb-49bf-a39a-4b442a96eba8] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121135) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 19 03:48:35.544568 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-1f5558c1-a100-49c4-9068-49da1f4a67e2 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:35.557036 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1f5558c1-a100-49c4-9068-49da1f4a67e2 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/d7223d39-2ef0-443b-989b-87c1fe11d2c1" status: 200 len: 1393 microversion: 2.1 time: 0.308323 Oct 19 03:48:35.557343 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3039/6143] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:48:35 2022] GET /compute/v2.1/servers/d7223d39-2ef0-443b-989b-87c1fe11d2c1 => generated 1393 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:48:35.859924 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-11b44546-afa0-4fe7-8b6b-ae510520c88d tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "POST /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8/action" status: 202 len: 0 microversion: 2.20 time: 0.513460 Oct 19 03:48:35.861035 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3105/6144] 10.222.0.52 () {62 vars in 1319 bytes} [Wed Oct 19 03:48:35 2022] POST /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8/action => generated 0 bytes in 515 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:48:35.870114 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-419cded1-8308-427d-9a0f-405dd7690b87 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:48:35.870730 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-419cded1-8308-427d-9a0f-405dd7690b87 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 89f2e52f-afcb-49bf-a39a-4b442a96eba8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:48:35.877147 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-419cded1-8308-427d-9a0f-405dd7690b87 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:35.877930 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-419cded1-8308-427d-9a0f-405dd7690b87 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:35.878362 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-419cded1-8308-427d-9a0f-405dd7690b87 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:35.880873 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-419cded1-8308-427d-9a0f-405dd7690b87 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:35.881333 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-419cded1-8308-427d-9a0f-405dd7690b87 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:35.885290 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-419cded1-8308-427d-9a0f-405dd7690b87 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:36.050292 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-419cded1-8308-427d-9a0f-405dd7690b87 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:36.060943 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-419cded1-8308-427d-9a0f-405dd7690b87 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:36.063860 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-419cded1-8308-427d-9a0f-405dd7690b87 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:36.065999 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-419cded1-8308-427d-9a0f-405dd7690b87 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8" status: 200 len: 1751 microversion: 2.20 time: 0.200463 Oct 19 03:48:36.067010 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3040/6145] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:48:35 2022] GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8 => generated 1751 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:48:36.278553 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-db6dde5b-69ca-4d88-b6b0-d613cd9027be req-a2c2b4a6-b8e6-4e9d-b9ef-df212c25b3ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89f2e52f-afcb-49bf-a39a-4b442a96eba8", "name": "network-vif-unplugged", "status": "completed", "tag": "916e68b3-4b4b-48a3-9beb-6bf56116fff0"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:48:36.299828 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-db6dde5b-69ca-4d88-b6b0-d613cd9027be req-a2c2b4a6-b8e6-4e9d-b9ef-df212c25b3ac service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:36.300002 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-db6dde5b-69ca-4d88-b6b0-d613cd9027be req-a2c2b4a6-b8e6-4e9d-b9ef-df212c25b3ac service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:36.300430 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-db6dde5b-69ca-4d88-b6b0-d613cd9027be req-a2c2b4a6-b8e6-4e9d-b9ef-df212c25b3ac service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:36.323219 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.compute.server_external_events [req-db6dde5b-69ca-4d88-b6b0-d613cd9027be req-a2c2b4a6-b8e6-4e9d-b9ef-df212c25b3ac service nova] Unable to find a host for instance 89f2e52f-afcb-49bf-a39a-4b442a96eba8. Dropping event network-vif-unplugged {{(pid=121135) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 19 03:48:36.324531 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-db6dde5b-69ca-4d88-b6b0-d613cd9027be req-a2c2b4a6-b8e6-4e9d-b9ef-df212c25b3ac service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.049863 Oct 19 03:48:36.334647 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3106/6146] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:48:36 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 52 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 19 03:48:36.594373 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6c089a7d-24c3-4e4f-a673-92ecb2711dc0 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:48:36.603971 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6c089a7d-24c3-4e4f-a673-92ecb2711dc0 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: d7223d39-2ef0-443b-989b-87c1fe11d2c1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:48:36.616620 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6c089a7d-24c3-4e4f-a673-92ecb2711dc0 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:36.619650 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6c089a7d-24c3-4e4f-a673-92ecb2711dc0 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:36.620284 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6c089a7d-24c3-4e4f-a673-92ecb2711dc0 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:36.620993 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6c089a7d-24c3-4e4f-a673-92ecb2711dc0 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:36.625339 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6c089a7d-24c3-4e4f-a673-92ecb2711dc0 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:36.626150 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6c089a7d-24c3-4e4f-a673-92ecb2711dc0 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:37.100892 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-305bacc5-59e0-41b8-b35c-75ac1db5d099 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:48:37.101918 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-305bacc5-59e0-41b8-b35c-75ac1db5d099 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 89f2e52f-afcb-49bf-a39a-4b442a96eba8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:48:37.112727 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-305bacc5-59e0-41b8-b35c-75ac1db5d099 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:37.112727 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-305bacc5-59e0-41b8-b35c-75ac1db5d099 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:37.112727 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-305bacc5-59e0-41b8-b35c-75ac1db5d099 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:37.112727 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-305bacc5-59e0-41b8-b35c-75ac1db5d099 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:37.112727 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-305bacc5-59e0-41b8-b35c-75ac1db5d099 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:37.113295 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-305bacc5-59e0-41b8-b35c-75ac1db5d099 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:37.267532 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-6c089a7d-24c3-4e4f-a673-92ecb2711dc0 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:37.276693 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6c089a7d-24c3-4e4f-a673-92ecb2711dc0 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/d7223d39-2ef0-443b-989b-87c1fe11d2c1" status: 200 len: 1566 microversion: 2.1 time: 0.700017 Oct 19 03:48:37.278249 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3041/6147] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:48:36 2022] GET /compute/v2.1/servers/d7223d39-2ef0-443b-989b-87c1fe11d2c1 => generated 1566 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:48:37.308350 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-fb1e8c03-f425-4d46-aa75-bdd9abdb727d tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:48:37.308350 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-fb1e8c03-f425-4d46-aa75-bdd9abdb727d tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: d7223d39-2ef0-443b-989b-87c1fe11d2c1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:48:37.315381 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fb1e8c03-f425-4d46-aa75-bdd9abdb727d tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:37.316041 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fb1e8c03-f425-4d46-aa75-bdd9abdb727d tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:37.316640 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fb1e8c03-f425-4d46-aa75-bdd9abdb727d tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:37.317612 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fb1e8c03-f425-4d46-aa75-bdd9abdb727d tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:37.318399 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fb1e8c03-f425-4d46-aa75-bdd9abdb727d tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:37.318839 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fb1e8c03-f425-4d46-aa75-bdd9abdb727d tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:37.322463 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-305bacc5-59e0-41b8-b35c-75ac1db5d099 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:37.333116 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-305bacc5-59e0-41b8-b35c-75ac1db5d099 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:37.334682 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-305bacc5-59e0-41b8-b35c-75ac1db5d099 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:37.336106 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-305bacc5-59e0-41b8-b35c-75ac1db5d099 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8" status: 200 len: 1751 microversion: 2.20 time: 0.239758 Oct 19 03:48:37.336670 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3107/6148] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:48:37 2022] GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8 => generated 1751 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:48:37.523916 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-fb1e8c03-f425-4d46-aa75-bdd9abdb727d tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:37.533262 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-fb1e8c03-f425-4d46-aa75-bdd9abdb727d tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/d7223d39-2ef0-443b-989b-87c1fe11d2c1" status: 200 len: 1566 microversion: 2.1 time: 0.234254 Oct 19 03:48:37.537446 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3042/6149] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:48:37 2022] GET /compute/v2.1/servers/d7223d39-2ef0-443b-989b-87c1fe11d2c1 => generated 1566 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:48:38.362344 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2eca02f2-8b5d-450a-87c6-2c3660cb9043 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:48:38.363019 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-2eca02f2-8b5d-450a-87c6-2c3660cb9043 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 89f2e52f-afcb-49bf-a39a-4b442a96eba8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:48:38.370247 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2eca02f2-8b5d-450a-87c6-2c3660cb9043 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:38.370752 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2eca02f2-8b5d-450a-87c6-2c3660cb9043 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:38.371196 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2eca02f2-8b5d-450a-87c6-2c3660cb9043 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:38.372143 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2eca02f2-8b5d-450a-87c6-2c3660cb9043 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:38.372610 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2eca02f2-8b5d-450a-87c6-2c3660cb9043 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:38.373037 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2eca02f2-8b5d-450a-87c6-2c3660cb9043 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:38.794824 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-2eca02f2-8b5d-450a-87c6-2c3660cb9043 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:38.805120 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-2eca02f2-8b5d-450a-87c6-2c3660cb9043 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:38.806626 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-2eca02f2-8b5d-450a-87c6-2c3660cb9043 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:38.807829 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2eca02f2-8b5d-450a-87c6-2c3660cb9043 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8" status: 200 len: 1751 microversion: 2.20 time: 0.449637 Oct 19 03:48:38.808396 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3108/6150] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:48:38 2022] GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8 => generated 1751 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:48:39.837489 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c26a474d-04cd-48bc-b933-7cacb33a4fc2 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:48:39.838173 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c26a474d-04cd-48bc-b933-7cacb33a4fc2 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 89f2e52f-afcb-49bf-a39a-4b442a96eba8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:48:39.848262 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c26a474d-04cd-48bc-b933-7cacb33a4fc2 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:39.851656 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c26a474d-04cd-48bc-b933-7cacb33a4fc2 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:39.852619 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c26a474d-04cd-48bc-b933-7cacb33a4fc2 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:39.857796 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c26a474d-04cd-48bc-b933-7cacb33a4fc2 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:39.857796 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c26a474d-04cd-48bc-b933-7cacb33a4fc2 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:39.857796 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c26a474d-04cd-48bc-b933-7cacb33a4fc2 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:40.255720 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c26a474d-04cd-48bc-b933-7cacb33a4fc2 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:40.265573 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c26a474d-04cd-48bc-b933-7cacb33a4fc2 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:40.267414 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c26a474d-04cd-48bc-b933-7cacb33a4fc2 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:40.268832 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c26a474d-04cd-48bc-b933-7cacb33a4fc2 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8" status: 200 len: 1753 microversion: 2.20 time: 0.435721 Oct 19 03:48:40.269995 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3043/6151] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:48:39 2022] GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8 => generated 1753 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:48:40.774842 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e18db36f-a163-4d15-a9eb-5675740c91a2 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:48:40.774842 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e18db36f-a163-4d15-a9eb-5675740c91a2 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: d7223d39-2ef0-443b-989b-87c1fe11d2c1] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:48:40.781879 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e18db36f-a163-4d15-a9eb-5675740c91a2 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:40.782516 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e18db36f-a163-4d15-a9eb-5675740c91a2 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:40.783389 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e18db36f-a163-4d15-a9eb-5675740c91a2 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:40.784467 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e18db36f-a163-4d15-a9eb-5675740c91a2 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:40.785069 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e18db36f-a163-4d15-a9eb-5675740c91a2 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:40.785723 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e18db36f-a163-4d15-a9eb-5675740c91a2 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:41.100325 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-e18db36f-a163-4d15-a9eb-5675740c91a2 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:41.109014 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e18db36f-a163-4d15-a9eb-5675740c91a2 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/d7223d39-2ef0-443b-989b-87c1fe11d2c1" status: 200 len: 1566 microversion: 2.1 time: 0.340980 Oct 19 03:48:41.129704 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3109/6152] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:48:40 2022] GET /compute/v2.1/servers/d7223d39-2ef0-443b-989b-87c1fe11d2c1 => generated 1566 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:48:41.219392 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-a5177558-3496-457c-82f5-ef7d4ab22bad req-059c7599-9c0c-4ff8-91f1-ff6448b09ecc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7223d39-2ef0-443b-989b-87c1fe11d2c1", "tag": "f1a51aab-0c40-4b41-ae4e-760590333068"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:48:41.234699 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-a5177558-3496-457c-82f5-ef7d4ab22bad req-059c7599-9c0c-4ff8-91f1-ff6448b09ecc service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:41.237055 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-a5177558-3496-457c-82f5-ef7d4ab22bad req-059c7599-9c0c-4ff8-91f1-ff6448b09ecc service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:41.239664 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-a5177558-3496-457c-82f5-ef7d4ab22bad req-059c7599-9c0c-4ff8-91f1-ff6448b09ecc service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:41.264558 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-a5177558-3496-457c-82f5-ef7d4ab22bad req-059c7599-9c0c-4ff8-91f1-ff6448b09ecc service nova] Creating event network-changed:f1a51aab-0c40-4b41-ae4e-760590333068 for instance d7223d39-2ef0-443b-989b-87c1fe11d2c1 on n-h2-861333-8 Oct 19 03:48:41.281168 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-a5177558-3496-457c-82f5-ef7d4ab22bad req-059c7599-9c0c-4ff8-91f1-ff6448b09ecc service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.506677 Oct 19 03:48:41.282401 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3044/6153] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:48:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:48:41.302174 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-90d752da-a5fd-4494-84d7-9b18d86dc11b tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:48:41.303753 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-90d752da-a5fd-4494-84d7-9b18d86dc11b tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 89f2e52f-afcb-49bf-a39a-4b442a96eba8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:48:41.311668 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-90d752da-a5fd-4494-84d7-9b18d86dc11b tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:41.312761 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-90d752da-a5fd-4494-84d7-9b18d86dc11b tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:41.313023 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-90d752da-a5fd-4494-84d7-9b18d86dc11b tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:41.313901 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-90d752da-a5fd-4494-84d7-9b18d86dc11b tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:41.314634 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-90d752da-a5fd-4494-84d7-9b18d86dc11b tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:41.315280 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-90d752da-a5fd-4494-84d7-9b18d86dc11b tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:41.700558 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-90d752da-a5fd-4494-84d7-9b18d86dc11b tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:41.715218 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-90d752da-a5fd-4494-84d7-9b18d86dc11b tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:41.721798 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-90d752da-a5fd-4494-84d7-9b18d86dc11b tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:41.721798 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-90d752da-a5fd-4494-84d7-9b18d86dc11b tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8" status: 200 len: 1753 microversion: 2.20 time: 0.422387 Oct 19 03:48:41.722891 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3110/6154] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:48:41 2022] GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8 => generated 1753 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:48:42.747201 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-357d6cde-5d10-4b68-abab-5aa607b7241f tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:48:42.747909 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-357d6cde-5d10-4b68-abab-5aa607b7241f tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 89f2e52f-afcb-49bf-a39a-4b442a96eba8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:48:42.755998 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-357d6cde-5d10-4b68-abab-5aa607b7241f tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:42.756633 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-357d6cde-5d10-4b68-abab-5aa607b7241f tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:42.757082 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-357d6cde-5d10-4b68-abab-5aa607b7241f tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:42.757852 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-357d6cde-5d10-4b68-abab-5aa607b7241f tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:42.758311 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-357d6cde-5d10-4b68-abab-5aa607b7241f tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:42.758742 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-357d6cde-5d10-4b68-abab-5aa607b7241f tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:42.996310 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-357d6cde-5d10-4b68-abab-5aa607b7241f tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:43.005989 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-357d6cde-5d10-4b68-abab-5aa607b7241f tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:43.007509 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-357d6cde-5d10-4b68-abab-5aa607b7241f tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:43.009403 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-357d6cde-5d10-4b68-abab-5aa607b7241f tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8" status: 200 len: 1753 microversion: 2.20 time: 0.268632 Oct 19 03:48:43.010153 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3045/6155] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:48:42 2022] GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8 => generated 1753 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:48:44.036045 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ec3b10ab-fb07-414c-acaf-29a6e2efecd3 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:48:44.036897 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ec3b10ab-fb07-414c-acaf-29a6e2efecd3 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 89f2e52f-afcb-49bf-a39a-4b442a96eba8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:48:44.044609 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ec3b10ab-fb07-414c-acaf-29a6e2efecd3 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:44.045107 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ec3b10ab-fb07-414c-acaf-29a6e2efecd3 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:44.045576 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ec3b10ab-fb07-414c-acaf-29a6e2efecd3 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:44.046359 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ec3b10ab-fb07-414c-acaf-29a6e2efecd3 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:44.046833 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ec3b10ab-fb07-414c-acaf-29a6e2efecd3 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:44.047260 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ec3b10ab-fb07-414c-acaf-29a6e2efecd3 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:44.186477 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ec3b10ab-fb07-414c-acaf-29a6e2efecd3 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:44.196652 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ec3b10ab-fb07-414c-acaf-29a6e2efecd3 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:44.198400 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ec3b10ab-fb07-414c-acaf-29a6e2efecd3 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:44.199723 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ec3b10ab-fb07-414c-acaf-29a6e2efecd3 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8" status: 200 len: 1753 microversion: 2.20 time: 0.167666 Oct 19 03:48:44.209510 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3111/6156] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:48:44 2022] GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8 => generated 1753 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:48:45.225488 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-33bd5408-5c6f-4e74-b549-cf35e3ca3d2b tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:48:45.226129 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-33bd5408-5c6f-4e74-b549-cf35e3ca3d2b tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 89f2e52f-afcb-49bf-a39a-4b442a96eba8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:48:45.233318 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-33bd5408-5c6f-4e74-b549-cf35e3ca3d2b tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:45.233842 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-33bd5408-5c6f-4e74-b549-cf35e3ca3d2b tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:45.234284 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-33bd5408-5c6f-4e74-b549-cf35e3ca3d2b tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:45.234996 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-33bd5408-5c6f-4e74-b549-cf35e3ca3d2b tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:45.235445 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-33bd5408-5c6f-4e74-b549-cf35e3ca3d2b tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:45.235882 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-33bd5408-5c6f-4e74-b549-cf35e3ca3d2b tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:45.393561 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-33bd5408-5c6f-4e74-b549-cf35e3ca3d2b tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:45.407813 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-33bd5408-5c6f-4e74-b549-cf35e3ca3d2b tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:45.407813 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-33bd5408-5c6f-4e74-b549-cf35e3ca3d2b tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:45.408619 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-33bd5408-5c6f-4e74-b549-cf35e3ca3d2b tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8" status: 200 len: 1753 microversion: 2.20 time: 0.186900 Oct 19 03:48:45.409164 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3046/6157] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:48:45 2022] GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8 => generated 1753 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:48:46.437771 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d2129d6e-2e61-4376-90ca-9d701f911b1c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:48:46.438563 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d2129d6e-2e61-4376-90ca-9d701f911b1c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 89f2e52f-afcb-49bf-a39a-4b442a96eba8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:48:46.447911 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d2129d6e-2e61-4376-90ca-9d701f911b1c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:46.448634 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d2129d6e-2e61-4376-90ca-9d701f911b1c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:46.449134 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d2129d6e-2e61-4376-90ca-9d701f911b1c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:46.449929 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d2129d6e-2e61-4376-90ca-9d701f911b1c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:46.450489 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d2129d6e-2e61-4376-90ca-9d701f911b1c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:46.450936 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d2129d6e-2e61-4376-90ca-9d701f911b1c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:46.621024 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d2129d6e-2e61-4376-90ca-9d701f911b1c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:46.630912 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d2129d6e-2e61-4376-90ca-9d701f911b1c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:46.632374 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d2129d6e-2e61-4376-90ca-9d701f911b1c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:46.633643 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d2129d6e-2e61-4376-90ca-9d701f911b1c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8" status: 200 len: 1753 microversion: 2.20 time: 0.204100 Oct 19 03:48:46.634223 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3112/6158] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:48:46 2022] GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8 => generated 1753 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:48:47.663903 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-48827871-74e4-4be7-bf3b-68f8b77ad1ad tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:48:47.664753 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-48827871-74e4-4be7-bf3b-68f8b77ad1ad tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 89f2e52f-afcb-49bf-a39a-4b442a96eba8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:48:47.672894 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-48827871-74e4-4be7-bf3b-68f8b77ad1ad tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:47.673552 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-48827871-74e4-4be7-bf3b-68f8b77ad1ad tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:47.674101 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-48827871-74e4-4be7-bf3b-68f8b77ad1ad tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:47.674917 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-48827871-74e4-4be7-bf3b-68f8b77ad1ad tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:47.675726 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-48827871-74e4-4be7-bf3b-68f8b77ad1ad tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:47.676304 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-48827871-74e4-4be7-bf3b-68f8b77ad1ad tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:47.851086 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-48827871-74e4-4be7-bf3b-68f8b77ad1ad tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:47.860905 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-48827871-74e4-4be7-bf3b-68f8b77ad1ad tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:47.862734 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-48827871-74e4-4be7-bf3b-68f8b77ad1ad tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:47.863963 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-48827871-74e4-4be7-bf3b-68f8b77ad1ad tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8" status: 200 len: 1809 microversion: 2.20 time: 0.204104 Oct 19 03:48:47.872593 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3047/6159] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:48:47 2022] GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8 => generated 1809 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:48:48.891700 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-707dd812-fefd-485f-a0ab-754ab4c2595c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:48:48.892326 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-707dd812-fefd-485f-a0ab-754ab4c2595c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 89f2e52f-afcb-49bf-a39a-4b442a96eba8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:48:48.895283 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:48:48.900961 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-707dd812-fefd-485f-a0ab-754ab4c2595c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:48.901509 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-707dd812-fefd-485f-a0ab-754ab4c2595c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:48.902128 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-707dd812-fefd-485f-a0ab-754ab4c2595c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:48.902854 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-707dd812-fefd-485f-a0ab-754ab4c2595c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:48.903321 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-707dd812-fefd-485f-a0ab-754ab4c2595c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:48.904843 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-707dd812-fefd-485f-a0ab-754ab4c2595c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:49.201732 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-bb8ddddb-b3db-486d-a318-d7ff038bf2b0 req-6d578a6b-2e10-49a7-b9fc-ccd3e378314f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89f2e52f-afcb-49bf-a39a-4b442a96eba8", "tag": "916e68b3-4b4b-48a3-9beb-6bf56116fff0"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:48:49.212610 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:48:49.219686 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-bb8ddddb-b3db-486d-a318-d7ff038bf2b0 req-6d578a6b-2e10-49a7-b9fc-ccd3e378314f service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:49.221065 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-bb8ddddb-b3db-486d-a318-d7ff038bf2b0 req-6d578a6b-2e10-49a7-b9fc-ccd3e378314f service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:49.221761 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-bb8ddddb-b3db-486d-a318-d7ff038bf2b0 req-6d578a6b-2e10-49a7-b9fc-ccd3e378314f service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:49.235240 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-bb8ddddb-b3db-486d-a318-d7ff038bf2b0 req-6d578a6b-2e10-49a7-b9fc-ccd3e378314f service nova] Creating event network-changed:916e68b3-4b4b-48a3-9beb-6bf56116fff0 for instance 89f2e52f-afcb-49bf-a39a-4b442a96eba8 on n-h1-861333-8 Oct 19 03:48:49.241300 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-bb8ddddb-b3db-486d-a318-d7ff038bf2b0 req-6d578a6b-2e10-49a7-b9fc-ccd3e378314f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043152 Oct 19 03:48:49.243031 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3048/6160] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:48:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:48:49.413790 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-707dd812-fefd-485f-a0ab-754ab4c2595c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:49.425322 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-707dd812-fefd-485f-a0ab-754ab4c2595c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:49.426838 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-707dd812-fefd-485f-a0ab-754ab4c2595c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:49.433735 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-707dd812-fefd-485f-a0ab-754ab4c2595c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8" status: 200 len: 1809 microversion: 2.20 time: 0.540405 Oct 19 03:48:49.433735 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3113/6161] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:48:48 2022] GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8 => generated 1809 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:48:50.460014 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-87f05afe-4c35-4de0-9c8e-8c26845eb45c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:48:50.462194 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-87f05afe-4c35-4de0-9c8e-8c26845eb45c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 89f2e52f-afcb-49bf-a39a-4b442a96eba8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:48:50.476229 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-87f05afe-4c35-4de0-9c8e-8c26845eb45c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:50.480716 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-87f05afe-4c35-4de0-9c8e-8c26845eb45c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:50.481702 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-87f05afe-4c35-4de0-9c8e-8c26845eb45c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:50.483568 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-87f05afe-4c35-4de0-9c8e-8c26845eb45c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:50.483988 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-87f05afe-4c35-4de0-9c8e-8c26845eb45c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:50.485356 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-87f05afe-4c35-4de0-9c8e-8c26845eb45c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:50.656214 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-87f05afe-4c35-4de0-9c8e-8c26845eb45c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:50.667231 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-87f05afe-4c35-4de0-9c8e-8c26845eb45c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:50.667231 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-87f05afe-4c35-4de0-9c8e-8c26845eb45c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:50.667871 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-87f05afe-4c35-4de0-9c8e-8c26845eb45c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8" status: 200 len: 1809 microversion: 2.20 time: 0.213662 Oct 19 03:48:50.681530 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3049/6162] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:48:50 2022] GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8 => generated 1809 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:48:51.696570 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c16b26b2-5d39-4c8d-8c82-816014e4d2ce tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:48:51.697537 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c16b26b2-5d39-4c8d-8c82-816014e4d2ce tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 89f2e52f-afcb-49bf-a39a-4b442a96eba8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:48:51.711331 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c16b26b2-5d39-4c8d-8c82-816014e4d2ce tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:51.711827 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c16b26b2-5d39-4c8d-8c82-816014e4d2ce tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:51.712268 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c16b26b2-5d39-4c8d-8c82-816014e4d2ce tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:51.712985 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c16b26b2-5d39-4c8d-8c82-816014e4d2ce tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:51.716656 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c16b26b2-5d39-4c8d-8c82-816014e4d2ce tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:51.717595 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c16b26b2-5d39-4c8d-8c82-816014e4d2ce tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:52.001023 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c16b26b2-5d39-4c8d-8c82-816014e4d2ce tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:52.011037 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c16b26b2-5d39-4c8d-8c82-816014e4d2ce tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:52.013015 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c16b26b2-5d39-4c8d-8c82-816014e4d2ce tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:52.014349 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c16b26b2-5d39-4c8d-8c82-816014e4d2ce tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8" status: 200 len: 1809 microversion: 2.20 time: 0.322406 Oct 19 03:48:52.015042 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3114/6163] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:48:51 2022] GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8 => generated 1809 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:48:53.040534 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-008ce042-cea9-45f4-8152-c71d9966ca29 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:48:53.041346 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-008ce042-cea9-45f4-8152-c71d9966ca29 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 89f2e52f-afcb-49bf-a39a-4b442a96eba8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:48:53.055377 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-008ce042-cea9-45f4-8152-c71d9966ca29 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:53.056004 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-008ce042-cea9-45f4-8152-c71d9966ca29 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:53.056546 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-008ce042-cea9-45f4-8152-c71d9966ca29 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:53.057348 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-008ce042-cea9-45f4-8152-c71d9966ca29 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:53.057924 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-008ce042-cea9-45f4-8152-c71d9966ca29 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:53.058447 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-008ce042-cea9-45f4-8152-c71d9966ca29 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:53.285768 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-008ce042-cea9-45f4-8152-c71d9966ca29 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:53.298204 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-008ce042-cea9-45f4-8152-c71d9966ca29 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:53.300683 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-008ce042-cea9-45f4-8152-c71d9966ca29 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:53.302237 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-008ce042-cea9-45f4-8152-c71d9966ca29 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8" status: 200 len: 1809 microversion: 2.20 time: 0.266058 Oct 19 03:48:53.316744 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3050/6164] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:48:53 2022] GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8 => generated 1809 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:48:54.332263 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-56da6722-c139-4b56-a5df-0d69412c59e4 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:48:54.338063 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-56da6722-c139-4b56-a5df-0d69412c59e4 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 89f2e52f-afcb-49bf-a39a-4b442a96eba8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:48:54.360264 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-56da6722-c139-4b56-a5df-0d69412c59e4 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:54.360986 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-56da6722-c139-4b56-a5df-0d69412c59e4 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:54.362659 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-56da6722-c139-4b56-a5df-0d69412c59e4 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:54.364358 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-56da6722-c139-4b56-a5df-0d69412c59e4 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:54.364822 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-56da6722-c139-4b56-a5df-0d69412c59e4 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:54.365254 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-56da6722-c139-4b56-a5df-0d69412c59e4 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:54.669013 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-56da6722-c139-4b56-a5df-0d69412c59e4 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:54.687077 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-56da6722-c139-4b56-a5df-0d69412c59e4 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:54.688993 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-56da6722-c139-4b56-a5df-0d69412c59e4 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:54.694009 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-56da6722-c139-4b56-a5df-0d69412c59e4 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8" status: 200 len: 1809 microversion: 2.20 time: 0.365637 Oct 19 03:48:54.722725 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3115/6165] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:48:54 2022] GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8 => generated 1809 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:48:55.727189 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5a90a51f-d943-415f-8f72-9baf3d302eca tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:48:55.728479 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5a90a51f-d943-415f-8f72-9baf3d302eca tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 89f2e52f-afcb-49bf-a39a-4b442a96eba8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:48:55.735995 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5a90a51f-d943-415f-8f72-9baf3d302eca tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:55.736841 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5a90a51f-d943-415f-8f72-9baf3d302eca tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:55.737302 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5a90a51f-d943-415f-8f72-9baf3d302eca tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:55.738228 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5a90a51f-d943-415f-8f72-9baf3d302eca tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:55.738683 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5a90a51f-d943-415f-8f72-9baf3d302eca tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:55.739265 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5a90a51f-d943-415f-8f72-9baf3d302eca tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:55.909727 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5a90a51f-d943-415f-8f72-9baf3d302eca tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:55.927838 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5a90a51f-d943-415f-8f72-9baf3d302eca tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:55.929638 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5a90a51f-d943-415f-8f72-9baf3d302eca tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:55.930869 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5a90a51f-d943-415f-8f72-9baf3d302eca tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8" status: 200 len: 1809 microversion: 2.20 time: 0.208189 Oct 19 03:48:55.931439 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3051/6166] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:48:55 2022] GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8 => generated 1809 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:48:56.957456 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-40ff5a7a-eb5c-4c61-864e-dbd8e202fc10 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:48:56.958322 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-40ff5a7a-eb5c-4c61-864e-dbd8e202fc10 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 89f2e52f-afcb-49bf-a39a-4b442a96eba8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:48:56.971163 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-40ff5a7a-eb5c-4c61-864e-dbd8e202fc10 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:56.972747 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-40ff5a7a-eb5c-4c61-864e-dbd8e202fc10 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:56.974936 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-40ff5a7a-eb5c-4c61-864e-dbd8e202fc10 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:56.975955 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-40ff5a7a-eb5c-4c61-864e-dbd8e202fc10 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:56.977913 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-40ff5a7a-eb5c-4c61-864e-dbd8e202fc10 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:56.978723 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-40ff5a7a-eb5c-4c61-864e-dbd8e202fc10 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:57.209687 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-40ff5a7a-eb5c-4c61-864e-dbd8e202fc10 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:57.221340 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-40ff5a7a-eb5c-4c61-864e-dbd8e202fc10 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:57.223108 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-40ff5a7a-eb5c-4c61-864e-dbd8e202fc10 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:57.224592 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-40ff5a7a-eb5c-4c61-864e-dbd8e202fc10 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8" status: 200 len: 1809 microversion: 2.20 time: 0.271642 Oct 19 03:48:57.225333 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3116/6167] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:48:56 2022] GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8 => generated 1809 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:48:58.255707 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8de2f986-f986-422a-be1b-1d49671fcbc8 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:48:58.256952 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8de2f986-f986-422a-be1b-1d49671fcbc8 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 89f2e52f-afcb-49bf-a39a-4b442a96eba8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:48:58.277421 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8de2f986-f986-422a-be1b-1d49671fcbc8 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:58.278210 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8de2f986-f986-422a-be1b-1d49671fcbc8 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:58.278819 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8de2f986-f986-422a-be1b-1d49671fcbc8 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:58.279768 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8de2f986-f986-422a-be1b-1d49671fcbc8 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:58.280620 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8de2f986-f986-422a-be1b-1d49671fcbc8 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:58.281204 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8de2f986-f986-422a-be1b-1d49671fcbc8 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:58.324888 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=100 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:48:58.544084 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8de2f986-f986-422a-be1b-1d49671fcbc8 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:58.560383 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8de2f986-f986-422a-be1b-1d49671fcbc8 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:58.562158 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8de2f986-f986-422a-be1b-1d49671fcbc8 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:58.563853 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8de2f986-f986-422a-be1b-1d49671fcbc8 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8" status: 200 len: 1809 microversion: 2.20 time: 0.315787 Oct 19 03:48:58.564510 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3052/6168] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:48:58 2022] GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8 => generated 1809 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:48:59.591466 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f75ea270-eaad-4e7e-babd-ece498e3e891 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:48:59.593147 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f75ea270-eaad-4e7e-babd-ece498e3e891 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 89f2e52f-afcb-49bf-a39a-4b442a96eba8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:48:59.600139 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f75ea270-eaad-4e7e-babd-ece498e3e891 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:59.600783 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f75ea270-eaad-4e7e-babd-ece498e3e891 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:59.601260 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f75ea270-eaad-4e7e-babd-ece498e3e891 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:59.602646 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f75ea270-eaad-4e7e-babd-ece498e3e891 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:48:59.603097 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f75ea270-eaad-4e7e-babd-ece498e3e891 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:48:59.603529 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f75ea270-eaad-4e7e-babd-ece498e3e891 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:48:59.753220 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f75ea270-eaad-4e7e-babd-ece498e3e891 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:59.763050 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f75ea270-eaad-4e7e-babd-ece498e3e891 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:59.764494 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f75ea270-eaad-4e7e-babd-ece498e3e891 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:48:59.765943 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f75ea270-eaad-4e7e-babd-ece498e3e891 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8" status: 200 len: 1809 microversion: 2.20 time: 0.179268 Oct 19 03:48:59.766690 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3117/6169] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:48:59 2022] GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8 => generated 1809 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:49:00.800315 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-85fa5590-0c04-429a-b1ee-77bbd9d5df07 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:49:00.801059 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-85fa5590-0c04-429a-b1ee-77bbd9d5df07 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 89f2e52f-afcb-49bf-a39a-4b442a96eba8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:49:00.810561 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-85fa5590-0c04-429a-b1ee-77bbd9d5df07 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:49:00.811260 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-85fa5590-0c04-429a-b1ee-77bbd9d5df07 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:49:00.811878 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-85fa5590-0c04-429a-b1ee-77bbd9d5df07 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:49:00.812812 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-85fa5590-0c04-429a-b1ee-77bbd9d5df07 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:49:00.813274 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-85fa5590-0c04-429a-b1ee-77bbd9d5df07 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:49:00.813735 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-85fa5590-0c04-429a-b1ee-77bbd9d5df07 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:49:00.976632 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-85fa5590-0c04-429a-b1ee-77bbd9d5df07 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:49:00.986878 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-85fa5590-0c04-429a-b1ee-77bbd9d5df07 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:49:00.988620 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-85fa5590-0c04-429a-b1ee-77bbd9d5df07 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:49:00.989900 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-85fa5590-0c04-429a-b1ee-77bbd9d5df07 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8" status: 200 len: 1809 microversion: 2.20 time: 0.193893 Oct 19 03:49:00.990636 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3053/6170] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:49:00 2022] GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8 => generated 1809 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:49:01.769615 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ae7e59bd-af4e-437a-8115-819f7fa4be7a tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:49:01.772044 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ae7e59bd-af4e-437a-8115-819f7fa4be7a tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: d7223d39-2ef0-443b-989b-87c1fe11d2c1] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:49:01.779805 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ae7e59bd-af4e-437a-8115-819f7fa4be7a tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:49:01.780535 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ae7e59bd-af4e-437a-8115-819f7fa4be7a tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:49:01.780749 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ae7e59bd-af4e-437a-8115-819f7fa4be7a tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:49:01.781476 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ae7e59bd-af4e-437a-8115-819f7fa4be7a tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:49:01.781939 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ae7e59bd-af4e-437a-8115-819f7fa4be7a tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:49:01.782372 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ae7e59bd-af4e-437a-8115-819f7fa4be7a tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:49:01.796281 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:49:01.839650 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ae7e59bd-af4e-437a-8115-819f7fa4be7a tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "POST /compute/v2.1/servers/d7223d39-2ef0-443b-989b-87c1fe11d2c1/action" status: 200 len: 24563 microversion: 2.1 time: 0.073740 Oct 19 03:49:01.840520 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3118/6171] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:49:01 2022] POST /compute/v2.1/servers/d7223d39-2ef0-443b-989b-87c1fe11d2c1/action => generated 24563 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 03:49:02.015627 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f84e91ce-e4be-4113-b88b-3a412f48d95b tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:49:02.016243 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f84e91ce-e4be-4113-b88b-3a412f48d95b tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 89f2e52f-afcb-49bf-a39a-4b442a96eba8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:49:02.023144 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f84e91ce-e4be-4113-b88b-3a412f48d95b tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:49:02.024303 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f84e91ce-e4be-4113-b88b-3a412f48d95b tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:49:02.024752 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f84e91ce-e4be-4113-b88b-3a412f48d95b tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:49:02.025482 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f84e91ce-e4be-4113-b88b-3a412f48d95b tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:49:02.025943 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f84e91ce-e4be-4113-b88b-3a412f48d95b tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:49:02.026376 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f84e91ce-e4be-4113-b88b-3a412f48d95b tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:49:02.159128 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-f84e91ce-e4be-4113-b88b-3a412f48d95b tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:49:02.168008 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-f84e91ce-e4be-4113-b88b-3a412f48d95b tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:49:02.169500 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-f84e91ce-e4be-4113-b88b-3a412f48d95b tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:49:02.170673 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f84e91ce-e4be-4113-b88b-3a412f48d95b tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8" status: 200 len: 1809 microversion: 2.20 time: 0.159124 Oct 19 03:49:02.171240 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3054/6172] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:49:02 2022] GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8 => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:49:03.297047 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b03a2758-7a54-4e33-83bf-dda315837d99 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:49:03.297047 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b03a2758-7a54-4e33-83bf-dda315837d99 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 89f2e52f-afcb-49bf-a39a-4b442a96eba8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:49:03.297047 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b03a2758-7a54-4e33-83bf-dda315837d99 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:49:03.297047 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b03a2758-7a54-4e33-83bf-dda315837d99 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:49:03.297047 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b03a2758-7a54-4e33-83bf-dda315837d99 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:49:03.297047 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b03a2758-7a54-4e33-83bf-dda315837d99 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:49:03.297047 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b03a2758-7a54-4e33-83bf-dda315837d99 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:49:03.297047 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b03a2758-7a54-4e33-83bf-dda315837d99 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:49:03.400705 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b03a2758-7a54-4e33-83bf-dda315837d99 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:49:03.409957 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b03a2758-7a54-4e33-83bf-dda315837d99 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:49:03.411485 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b03a2758-7a54-4e33-83bf-dda315837d99 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:49:03.412671 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b03a2758-7a54-4e33-83bf-dda315837d99 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8" status: 200 len: 1809 microversion: 2.20 time: 0.219134 Oct 19 03:49:03.413232 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3119/6173] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:49:03 2022] GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8 => generated 1809 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:49:04.438621 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3ab4f701-871c-4472-8f5f-980f96166b2a tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:49:04.439244 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3ab4f701-871c-4472-8f5f-980f96166b2a tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 89f2e52f-afcb-49bf-a39a-4b442a96eba8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:49:04.446806 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3ab4f701-871c-4472-8f5f-980f96166b2a tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:49:04.447342 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3ab4f701-871c-4472-8f5f-980f96166b2a tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:49:04.447745 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3ab4f701-871c-4472-8f5f-980f96166b2a tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:49:04.448440 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3ab4f701-871c-4472-8f5f-980f96166b2a tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:49:04.448895 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3ab4f701-871c-4472-8f5f-980f96166b2a tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:49:04.449328 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3ab4f701-871c-4472-8f5f-980f96166b2a tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:49:04.587490 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-3ab4f701-871c-4472-8f5f-980f96166b2a tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:49:04.596402 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-3ab4f701-871c-4472-8f5f-980f96166b2a tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:49:04.597906 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-3ab4f701-871c-4472-8f5f-980f96166b2a tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:49:04.599140 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3ab4f701-871c-4472-8f5f-980f96166b2a tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8" status: 200 len: 1809 microversion: 2.20 time: 0.164440 Oct 19 03:49:04.599928 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3055/6174] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:49:04 2022] GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8 => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:49:05.626303 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ebd1ad1c-84da-471a-8510-83e7bfe286d8 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:49:05.637525 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ebd1ad1c-84da-471a-8510-83e7bfe286d8 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 89f2e52f-afcb-49bf-a39a-4b442a96eba8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:49:05.637525 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ebd1ad1c-84da-471a-8510-83e7bfe286d8 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:49:05.637525 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ebd1ad1c-84da-471a-8510-83e7bfe286d8 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:49:05.637525 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ebd1ad1c-84da-471a-8510-83e7bfe286d8 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:49:05.637525 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ebd1ad1c-84da-471a-8510-83e7bfe286d8 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:49:05.638204 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ebd1ad1c-84da-471a-8510-83e7bfe286d8 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:49:05.638204 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ebd1ad1c-84da-471a-8510-83e7bfe286d8 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:49:05.791951 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ebd1ad1c-84da-471a-8510-83e7bfe286d8 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:49:05.801328 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ebd1ad1c-84da-471a-8510-83e7bfe286d8 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:49:05.803028 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ebd1ad1c-84da-471a-8510-83e7bfe286d8 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:49:05.804307 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ebd1ad1c-84da-471a-8510-83e7bfe286d8 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8" status: 200 len: 1809 microversion: 2.20 time: 0.181951 Oct 19 03:49:05.805668 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3120/6175] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:49:05 2022] GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8 => generated 1809 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:49:06.837017 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3d7e591f-0c54-4a96-b031-381b12550079 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:49:06.838806 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3d7e591f-0c54-4a96-b031-381b12550079 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 89f2e52f-afcb-49bf-a39a-4b442a96eba8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:49:06.846258 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3d7e591f-0c54-4a96-b031-381b12550079 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:49:06.846756 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3d7e591f-0c54-4a96-b031-381b12550079 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:49:06.847924 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3d7e591f-0c54-4a96-b031-381b12550079 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:49:06.848319 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3d7e591f-0c54-4a96-b031-381b12550079 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:49:06.848796 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3d7e591f-0c54-4a96-b031-381b12550079 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:49:06.849239 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3d7e591f-0c54-4a96-b031-381b12550079 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:49:07.008992 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-3d7e591f-0c54-4a96-b031-381b12550079 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:49:07.020106 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-3d7e591f-0c54-4a96-b031-381b12550079 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:49:07.020106 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-3d7e591f-0c54-4a96-b031-381b12550079 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:49:07.021323 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3d7e591f-0c54-4a96-b031-381b12550079 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8" status: 200 len: 1809 microversion: 2.20 time: 0.189124 Oct 19 03:49:07.021965 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3056/6176] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:49:06 2022] GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8 => generated 1809 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:49:08.051605 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-94c4012e-0bcc-4caa-a46c-e517069ffff9 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:49:08.052584 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-94c4012e-0bcc-4caa-a46c-e517069ffff9 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 89f2e52f-afcb-49bf-a39a-4b442a96eba8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:49:08.061247 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-94c4012e-0bcc-4caa-a46c-e517069ffff9 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:49:08.061777 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-94c4012e-0bcc-4caa-a46c-e517069ffff9 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:49:08.062224 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-94c4012e-0bcc-4caa-a46c-e517069ffff9 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:49:08.062934 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-94c4012e-0bcc-4caa-a46c-e517069ffff9 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:49:08.063395 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-94c4012e-0bcc-4caa-a46c-e517069ffff9 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:49:08.063834 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-94c4012e-0bcc-4caa-a46c-e517069ffff9 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:49:08.211046 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-94c4012e-0bcc-4caa-a46c-e517069ffff9 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:49:08.221506 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-94c4012e-0bcc-4caa-a46c-e517069ffff9 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:49:08.222987 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-94c4012e-0bcc-4caa-a46c-e517069ffff9 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:49:08.224222 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-94c4012e-0bcc-4caa-a46c-e517069ffff9 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8" status: 200 len: 1809 microversion: 2.20 time: 0.177933 Oct 19 03:49:08.225075 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3121/6177] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:49:08 2022] GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8 => generated 1809 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:49:09.251019 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ccdad8af-995e-4493-9cd0-c95021cfe389 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:49:09.251813 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ccdad8af-995e-4493-9cd0-c95021cfe389 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 89f2e52f-afcb-49bf-a39a-4b442a96eba8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:49:09.259048 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ccdad8af-995e-4493-9cd0-c95021cfe389 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:49:09.259610 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ccdad8af-995e-4493-9cd0-c95021cfe389 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:49:09.260141 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ccdad8af-995e-4493-9cd0-c95021cfe389 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:49:09.262065 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ccdad8af-995e-4493-9cd0-c95021cfe389 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:49:09.262531 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ccdad8af-995e-4493-9cd0-c95021cfe389 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:49:09.263153 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ccdad8af-995e-4493-9cd0-c95021cfe389 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:49:09.410502 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ccdad8af-995e-4493-9cd0-c95021cfe389 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:49:09.420772 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ccdad8af-995e-4493-9cd0-c95021cfe389 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:49:09.422309 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ccdad8af-995e-4493-9cd0-c95021cfe389 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:49:09.423547 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ccdad8af-995e-4493-9cd0-c95021cfe389 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8" status: 200 len: 1809 microversion: 2.20 time: 0.176726 Oct 19 03:49:09.424126 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3057/6178] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:49:09 2022] GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8 => generated 1809 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:49:10.453076 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-449b5613-49b5-440c-ade1-e125779bdde2 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:49:10.454300 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-449b5613-49b5-440c-ade1-e125779bdde2 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 89f2e52f-afcb-49bf-a39a-4b442a96eba8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:49:10.461322 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-449b5613-49b5-440c-ade1-e125779bdde2 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:49:10.461858 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-449b5613-49b5-440c-ade1-e125779bdde2 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:49:10.462307 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-449b5613-49b5-440c-ade1-e125779bdde2 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:49:10.463023 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-449b5613-49b5-440c-ade1-e125779bdde2 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:49:10.463500 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-449b5613-49b5-440c-ade1-e125779bdde2 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:49:10.464116 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-449b5613-49b5-440c-ade1-e125779bdde2 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:49:10.614020 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-449b5613-49b5-440c-ade1-e125779bdde2 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:49:10.623229 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-449b5613-49b5-440c-ade1-e125779bdde2 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:49:10.624720 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-449b5613-49b5-440c-ade1-e125779bdde2 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:49:10.625939 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-449b5613-49b5-440c-ade1-e125779bdde2 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8" status: 200 len: 1809 microversion: 2.20 time: 0.176884 Oct 19 03:49:10.626514 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3122/6179] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:49:10 2022] GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8 => generated 1809 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:49:11.654933 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3b64ec8a-6683-45f9-9e63-87635b9606db tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:49:11.657049 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3b64ec8a-6683-45f9-9e63-87635b9606db tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 89f2e52f-afcb-49bf-a39a-4b442a96eba8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:49:11.667127 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3b64ec8a-6683-45f9-9e63-87635b9606db tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:49:11.667687 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3b64ec8a-6683-45f9-9e63-87635b9606db tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:49:11.668198 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3b64ec8a-6683-45f9-9e63-87635b9606db tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:49:11.669465 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3b64ec8a-6683-45f9-9e63-87635b9606db tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:49:11.670289 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3b64ec8a-6683-45f9-9e63-87635b9606db tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:49:11.670946 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3b64ec8a-6683-45f9-9e63-87635b9606db tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:49:11.856636 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-3b64ec8a-6683-45f9-9e63-87635b9606db tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:49:11.868157 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-3b64ec8a-6683-45f9-9e63-87635b9606db tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:49:11.869720 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-3b64ec8a-6683-45f9-9e63-87635b9606db tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:49:11.871186 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3b64ec8a-6683-45f9-9e63-87635b9606db tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8" status: 200 len: 1809 microversion: 2.20 time: 0.222724 Oct 19 03:49:11.871860 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3058/6180] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:49:11 2022] GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8 => generated 1809 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:49:12.703179 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-09fb893f-0538-4aa7-9289-24fdd3c4dec8 tempest-TestNetworkAdvancedServerOps-173376372 tempest-TestNetworkAdvancedServerOps-173376372-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:49:12.703800 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-09fb893f-0538-4aa7-9289-24fdd3c4dec8 tempest-TestNetworkAdvancedServerOps-173376372 tempest-TestNetworkAdvancedServerOps-173376372-project-admin] [instance: d7223d39-2ef0-443b-989b-87c1fe11d2c1] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:49:12.710899 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-09fb893f-0538-4aa7-9289-24fdd3c4dec8 tempest-TestNetworkAdvancedServerOps-173376372 tempest-TestNetworkAdvancedServerOps-173376372-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:49:12.711914 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-09fb893f-0538-4aa7-9289-24fdd3c4dec8 tempest-TestNetworkAdvancedServerOps-173376372 tempest-TestNetworkAdvancedServerOps-173376372-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:49:12.712359 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-09fb893f-0538-4aa7-9289-24fdd3c4dec8 tempest-TestNetworkAdvancedServerOps-173376372 tempest-TestNetworkAdvancedServerOps-173376372-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:49:12.713063 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-09fb893f-0538-4aa7-9289-24fdd3c4dec8 tempest-TestNetworkAdvancedServerOps-173376372 tempest-TestNetworkAdvancedServerOps-173376372-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:49:12.713562 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-09fb893f-0538-4aa7-9289-24fdd3c4dec8 tempest-TestNetworkAdvancedServerOps-173376372 tempest-TestNetworkAdvancedServerOps-173376372-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:49:12.713996 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-09fb893f-0538-4aa7-9289-24fdd3c4dec8 tempest-TestNetworkAdvancedServerOps-173376372 tempest-TestNetworkAdvancedServerOps-173376372-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:49:12.900949 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-464a8235-71c1-4306-8012-2689d585798e tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:49:12.901636 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-464a8235-71c1-4306-8012-2689d585798e tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 89f2e52f-afcb-49bf-a39a-4b442a96eba8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:49:12.908827 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-464a8235-71c1-4306-8012-2689d585798e tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:49:12.909315 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-464a8235-71c1-4306-8012-2689d585798e tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:49:12.909779 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-464a8235-71c1-4306-8012-2689d585798e tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:49:12.910564 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-464a8235-71c1-4306-8012-2689d585798e tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:49:12.911043 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-464a8235-71c1-4306-8012-2689d585798e tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:49:12.911471 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-464a8235-71c1-4306-8012-2689d585798e tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:49:13.093261 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-09fb893f-0538-4aa7-9289-24fdd3c4dec8 tempest-TestNetworkAdvancedServerOps-173376372 tempest-TestNetworkAdvancedServerOps-173376372-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d7223d39-2ef0-443b-989b-87c1fe11d2c1" status: 200 len: 1835 microversion: 2.1 time: 0.393793 Oct 19 03:49:13.101000 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-464a8235-71c1-4306-8012-2689d585798e tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:49:13.109625 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3123/6181] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:49:12 2022] GET /compute/v2.1/servers/d7223d39-2ef0-443b-989b-87c1fe11d2c1 => generated 1835 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:49:13.113475 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-464a8235-71c1-4306-8012-2689d585798e tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:49:13.115417 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-464a8235-71c1-4306-8012-2689d585798e tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:49:13.116836 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-464a8235-71c1-4306-8012-2689d585798e tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8" status: 200 len: 1809 microversion: 2.20 time: 0.219926 Oct 19 03:49:13.117432 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3059/6182] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:49:12 2022] GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8 => generated 1809 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:49:13.127069 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-90cdae2f-3720-492a-b769-2e62f96508c6 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:49:13.127069 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-90cdae2f-3720-492a-b769-2e62f96508c6 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: d7223d39-2ef0-443b-989b-87c1fe11d2c1] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:49:13.132190 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-90cdae2f-3720-492a-b769-2e62f96508c6 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:49:13.132681 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-90cdae2f-3720-492a-b769-2e62f96508c6 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:49:13.133205 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-90cdae2f-3720-492a-b769-2e62f96508c6 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:49:13.134452 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-90cdae2f-3720-492a-b769-2e62f96508c6 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:49:13.135224 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-90cdae2f-3720-492a-b769-2e62f96508c6 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:49:13.135994 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-90cdae2f-3720-492a-b769-2e62f96508c6 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:49:13.288515 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-90cdae2f-3720-492a-b769-2e62f96508c6 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:49:13.297264 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-90cdae2f-3720-492a-b769-2e62f96508c6 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/d7223d39-2ef0-443b-989b-87c1fe11d2c1" status: 200 len: 1684 microversion: 2.1 time: 0.181080 Oct 19 03:49:13.297927 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3124/6183] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:49:13 2022] GET /compute/v2.1/servers/d7223d39-2ef0-443b-989b-87c1fe11d2c1 => generated 1684 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:49:13.405221 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b06ecdb1-67d2-4b92-b466-f20b0194187b tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:49:13.407409 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b06ecdb1-67d2-4b92-b466-f20b0194187b tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: d7223d39-2ef0-443b-989b-87c1fe11d2c1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:49:13.413649 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b06ecdb1-67d2-4b92-b466-f20b0194187b tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:49:13.414147 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b06ecdb1-67d2-4b92-b466-f20b0194187b tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:49:13.415179 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b06ecdb1-67d2-4b92-b466-f20b0194187b tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:49:13.415880 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b06ecdb1-67d2-4b92-b466-f20b0194187b tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:49:13.416340 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b06ecdb1-67d2-4b92-b466-f20b0194187b tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:49:13.416770 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b06ecdb1-67d2-4b92-b466-f20b0194187b tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:49:13.473686 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b06ecdb1-67d2-4b92-b466-f20b0194187b tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "POST /compute/v2.1/servers/d7223d39-2ef0-443b-989b-87c1fe11d2c1/action" status: 200 len: 32629 microversion: 2.1 time: 0.072054 Oct 19 03:49:13.474356 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3060/6184] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:49:13 2022] POST /compute/v2.1/servers/d7223d39-2ef0-443b-989b-87c1fe11d2c1/action => generated 32629 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 03:49:13.645159 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b86ce958-72a2-48ad-be4f-2d3c7ff048b4 tempest-TestNetworkAdvancedServerOps-173376372 tempest-TestNetworkAdvancedServerOps-173376372-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:49:13.645799 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b86ce958-72a2-48ad-be4f-2d3c7ff048b4 tempest-TestNetworkAdvancedServerOps-173376372 tempest-TestNetworkAdvancedServerOps-173376372-project-admin] [instance: d7223d39-2ef0-443b-989b-87c1fe11d2c1] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:49:13.653062 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b86ce958-72a2-48ad-be4f-2d3c7ff048b4 tempest-TestNetworkAdvancedServerOps-173376372 tempest-TestNetworkAdvancedServerOps-173376372-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:49:13.653660 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b86ce958-72a2-48ad-be4f-2d3c7ff048b4 tempest-TestNetworkAdvancedServerOps-173376372 tempest-TestNetworkAdvancedServerOps-173376372-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:49:13.654109 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b86ce958-72a2-48ad-be4f-2d3c7ff048b4 tempest-TestNetworkAdvancedServerOps-173376372 tempest-TestNetworkAdvancedServerOps-173376372-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:49:13.654817 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b86ce958-72a2-48ad-be4f-2d3c7ff048b4 tempest-TestNetworkAdvancedServerOps-173376372 tempest-TestNetworkAdvancedServerOps-173376372-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:49:13.655546 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b86ce958-72a2-48ad-be4f-2d3c7ff048b4 tempest-TestNetworkAdvancedServerOps-173376372 tempest-TestNetworkAdvancedServerOps-173376372-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:49:13.655981 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b86ce958-72a2-48ad-be4f-2d3c7ff048b4 tempest-TestNetworkAdvancedServerOps-173376372 tempest-TestNetworkAdvancedServerOps-173376372-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:49:13.696494 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b86ce958-72a2-48ad-be4f-2d3c7ff048b4 tempest-TestNetworkAdvancedServerOps-173376372 tempest-TestNetworkAdvancedServerOps-173376372-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'e8f6b9fbf33b4025aee81ddcaf3f2482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bc81d7207274a0c91b2a1d99f129170', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:49:13.697100 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b86ce958-72a2-48ad-be4f-2d3c7ff048b4 tempest-TestNetworkAdvancedServerOps-173376372 tempest-TestNetworkAdvancedServerOps-173376372-project-admin] [instance: d7223d39-2ef0-443b-989b-87c1fe11d2c1] flavor_id is None. Assuming migration. {{(pid=121135) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 19 03:49:13.697690 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b86ce958-72a2-48ad-be4f-2d3c7ff048b4 tempest-TestNetworkAdvancedServerOps-173376372 tempest-TestNetworkAdvancedServerOps-173376372-project-admin] [instance: d7223d39-2ef0-443b-989b-87c1fe11d2c1] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=121135) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 19 03:49:14.187986 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b86ce958-72a2-48ad-be4f-2d3c7ff048b4 tempest-TestNetworkAdvancedServerOps-173376372 tempest-TestNetworkAdvancedServerOps-173376372-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/d7223d39-2ef0-443b-989b-87c1fe11d2c1/action" status: 202 len: 0 microversion: 2.1 time: 0.545471 Oct 19 03:49:14.189762 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3125/6185] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:49:13 2022] POST /compute/v2.1/servers/d7223d39-2ef0-443b-989b-87c1fe11d2c1/action => generated 0 bytes in 550 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:49:14.204161 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-8544cf53-33c5-49a9-adb4-2bed8c1b04aa tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:49:14.205109 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-8544cf53-33c5-49a9-adb4-2bed8c1b04aa tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 89f2e52f-afcb-49bf-a39a-4b442a96eba8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:49:14.224034 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8544cf53-33c5-49a9-adb4-2bed8c1b04aa tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:49:14.226927 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8544cf53-33c5-49a9-adb4-2bed8c1b04aa tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:49:14.230381 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8544cf53-33c5-49a9-adb4-2bed8c1b04aa tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:49:14.231455 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8544cf53-33c5-49a9-adb4-2bed8c1b04aa tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:49:14.232125 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8544cf53-33c5-49a9-adb4-2bed8c1b04aa tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:49:14.232832 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8544cf53-33c5-49a9-adb4-2bed8c1b04aa tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:49:14.249491 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-e4335c23-70bb-4028-85e6-9147c6505e48 req-51901257-ddcb-4bcb-bbe0-d1a97bbe8bbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89f2e52f-afcb-49bf-a39a-4b442a96eba8", "name": "network-vif-plugged", "status": "completed", "tag": "916e68b3-4b4b-48a3-9beb-6bf56116fff0"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:49:14.268169 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-e4335c23-70bb-4028-85e6-9147c6505e48 req-51901257-ddcb-4bcb-bbe0-d1a97bbe8bbc service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:49:14.273193 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-e4335c23-70bb-4028-85e6-9147c6505e48 req-51901257-ddcb-4bcb-bbe0-d1a97bbe8bbc service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:49:14.273956 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-e4335c23-70bb-4028-85e6-9147c6505e48 req-51901257-ddcb-4bcb-bbe0-d1a97bbe8bbc service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:49:14.291994 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-e4335c23-70bb-4028-85e6-9147c6505e48 req-51901257-ddcb-4bcb-bbe0-d1a97bbe8bbc service nova] Creating event network-vif-plugged:916e68b3-4b4b-48a3-9beb-6bf56116fff0 for instance 89f2e52f-afcb-49bf-a39a-4b442a96eba8 on n-h1-861333-8 Oct 19 03:49:14.297269 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-e4335c23-70bb-4028-85e6-9147c6505e48 req-51901257-ddcb-4bcb-bbe0-d1a97bbe8bbc service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.224329 Oct 19 03:49:14.297961 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3061/6186] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:49:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:49:14.303155 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7c0f854f-bedc-4434-a127-c50a6fd37d72 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:49:14.304006 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7c0f854f-bedc-4434-a127-c50a6fd37d72 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: d7223d39-2ef0-443b-989b-87c1fe11d2c1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:49:14.311439 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7c0f854f-bedc-4434-a127-c50a6fd37d72 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:49:14.312172 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7c0f854f-bedc-4434-a127-c50a6fd37d72 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:49:14.312801 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7c0f854f-bedc-4434-a127-c50a6fd37d72 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:49:14.313734 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7c0f854f-bedc-4434-a127-c50a6fd37d72 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:49:14.314788 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7c0f854f-bedc-4434-a127-c50a6fd37d72 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:49:14.314788 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7c0f854f-bedc-4434-a127-c50a6fd37d72 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:49:14.477795 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-8544cf53-33c5-49a9-adb4-2bed8c1b04aa tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:49:14.493619 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-8544cf53-33c5-49a9-adb4-2bed8c1b04aa tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:49:14.499752 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-8544cf53-33c5-49a9-adb4-2bed8c1b04aa tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:49:14.501624 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-8544cf53-33c5-49a9-adb4-2bed8c1b04aa tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8" status: 200 len: 1809 microversion: 2.20 time: 0.310660 Oct 19 03:49:14.502454 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3126/6187] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:49:14 2022] GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8 => generated 1809 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:49:14.575145 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-7c0f854f-bedc-4434-a127-c50a6fd37d72 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:49:14.585180 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7c0f854f-bedc-4434-a127-c50a6fd37d72 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/d7223d39-2ef0-443b-989b-87c1fe11d2c1" status: 200 len: 1693 microversion: 2.1 time: 0.286004 Oct 19 03:49:14.586081 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3062/6188] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:49:14 2022] GET /compute/v2.1/servers/d7223d39-2ef0-443b-989b-87c1fe11d2c1 => generated 1693 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:49:15.529768 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-26bad78b-afd2-486b-a4c0-4a021a2ddf58 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:49:15.530326 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-26bad78b-afd2-486b-a4c0-4a021a2ddf58 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 89f2e52f-afcb-49bf-a39a-4b442a96eba8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:49:15.538000 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-26bad78b-afd2-486b-a4c0-4a021a2ddf58 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:49:15.540395 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-26bad78b-afd2-486b-a4c0-4a021a2ddf58 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:49:15.540395 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-26bad78b-afd2-486b-a4c0-4a021a2ddf58 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:49:15.540395 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-26bad78b-afd2-486b-a4c0-4a021a2ddf58 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:49:15.540395 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-26bad78b-afd2-486b-a4c0-4a021a2ddf58 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:49:15.540722 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-26bad78b-afd2-486b-a4c0-4a021a2ddf58 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:49:15.616286 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0183dbbf-3838-493a-8fed-ad75a54b3c56 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:49:15.618226 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0183dbbf-3838-493a-8fed-ad75a54b3c56 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: d7223d39-2ef0-443b-989b-87c1fe11d2c1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:49:15.628849 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0183dbbf-3838-493a-8fed-ad75a54b3c56 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:49:15.629386 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0183dbbf-3838-493a-8fed-ad75a54b3c56 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:49:15.630235 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0183dbbf-3838-493a-8fed-ad75a54b3c56 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:49:15.630847 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0183dbbf-3838-493a-8fed-ad75a54b3c56 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:49:15.634628 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0183dbbf-3838-493a-8fed-ad75a54b3c56 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:49:15.635266 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0183dbbf-3838-493a-8fed-ad75a54b3c56 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:49:15.711312 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-26bad78b-afd2-486b-a4c0-4a021a2ddf58 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:49:15.724630 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-26bad78b-afd2-486b-a4c0-4a021a2ddf58 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:49:15.726652 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-26bad78b-afd2-486b-a4c0-4a021a2ddf58 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:49:15.728256 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-26bad78b-afd2-486b-a4c0-4a021a2ddf58 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8" status: 200 len: 1809 microversion: 2.20 time: 0.202774 Oct 19 03:49:15.733517 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3127/6189] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:49:15 2022] GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8 => generated 1809 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:49:15.812825 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0183dbbf-3838-493a-8fed-ad75a54b3c56 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:49:15.823956 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0183dbbf-3838-493a-8fed-ad75a54b3c56 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/d7223d39-2ef0-443b-989b-87c1fe11d2c1" status: 200 len: 1693 microversion: 2.1 time: 0.211972 Oct 19 03:49:15.824436 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3063/6190] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:49:15 2022] GET /compute/v2.1/servers/d7223d39-2ef0-443b-989b-87c1fe11d2c1 => generated 1693 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:49:16.762648 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0daef4a7-5065-4bb6-aa05-87fe071bf865 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:49:16.763348 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0daef4a7-5065-4bb6-aa05-87fe071bf865 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 89f2e52f-afcb-49bf-a39a-4b442a96eba8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:49:16.771154 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0daef4a7-5065-4bb6-aa05-87fe071bf865 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:49:16.771822 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0daef4a7-5065-4bb6-aa05-87fe071bf865 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:49:16.772070 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0daef4a7-5065-4bb6-aa05-87fe071bf865 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:49:16.773049 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0daef4a7-5065-4bb6-aa05-87fe071bf865 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:49:16.773429 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0daef4a7-5065-4bb6-aa05-87fe071bf865 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:49:16.774089 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0daef4a7-5065-4bb6-aa05-87fe071bf865 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:49:16.850545 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-408d8ead-b228-4930-9869-add833fc620e tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:49:16.851173 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-408d8ead-b228-4930-9869-add833fc620e tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: d7223d39-2ef0-443b-989b-87c1fe11d2c1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:49:16.861580 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-408d8ead-b228-4930-9869-add833fc620e tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:49:16.861580 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-408d8ead-b228-4930-9869-add833fc620e tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:49:16.868944 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-408d8ead-b228-4930-9869-add833fc620e tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:49:16.870291 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-408d8ead-b228-4930-9869-add833fc620e tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:49:16.870986 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-408d8ead-b228-4930-9869-add833fc620e tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:49:16.871634 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-408d8ead-b228-4930-9869-add833fc620e tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:49:16.940351 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-0daef4a7-5065-4bb6-aa05-87fe071bf865 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:49:16.951250 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-0daef4a7-5065-4bb6-aa05-87fe071bf865 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:49:16.953160 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-0daef4a7-5065-4bb6-aa05-87fe071bf865 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:49:16.955334 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0daef4a7-5065-4bb6-aa05-87fe071bf865 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8" status: 200 len: 1809 microversion: 2.20 time: 0.196857 Oct 19 03:49:16.956922 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3128/6191] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:49:16 2022] GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8 => generated 1809 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:49:17.060952 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-408d8ead-b228-4930-9869-add833fc620e tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:49:17.070351 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-408d8ead-b228-4930-9869-add833fc620e tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/d7223d39-2ef0-443b-989b-87c1fe11d2c1" status: 200 len: 1693 microversion: 2.1 time: 0.226781 Oct 19 03:49:17.071381 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3064/6192] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:49:16 2022] GET /compute/v2.1/servers/d7223d39-2ef0-443b-989b-87c1fe11d2c1 => generated 1693 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:49:17.984654 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f51d8e38-a50d-4611-9e1e-1b93d4f5099d tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:49:17.985874 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f51d8e38-a50d-4611-9e1e-1b93d4f5099d tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 89f2e52f-afcb-49bf-a39a-4b442a96eba8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:49:17.993739 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f51d8e38-a50d-4611-9e1e-1b93d4f5099d tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:49:17.994212 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f51d8e38-a50d-4611-9e1e-1b93d4f5099d tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:49:17.994809 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f51d8e38-a50d-4611-9e1e-1b93d4f5099d tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:49:17.995685 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f51d8e38-a50d-4611-9e1e-1b93d4f5099d tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:49:17.996365 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f51d8e38-a50d-4611-9e1e-1b93d4f5099d tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:49:17.996788 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f51d8e38-a50d-4611-9e1e-1b93d4f5099d tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:49:18.095737 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9ed7b405-9c54-4dd9-90ea-db3184e82e9d tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:49:18.096652 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9ed7b405-9c54-4dd9-90ea-db3184e82e9d tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: d7223d39-2ef0-443b-989b-87c1fe11d2c1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:49:18.105965 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9ed7b405-9c54-4dd9-90ea-db3184e82e9d tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:49:18.106804 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9ed7b405-9c54-4dd9-90ea-db3184e82e9d tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:49:18.107360 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9ed7b405-9c54-4dd9-90ea-db3184e82e9d tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:49:18.108571 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9ed7b405-9c54-4dd9-90ea-db3184e82e9d tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:49:18.109867 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9ed7b405-9c54-4dd9-90ea-db3184e82e9d tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:49:18.123492 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9ed7b405-9c54-4dd9-90ea-db3184e82e9d tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:49:18.271673 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f51d8e38-a50d-4611-9e1e-1b93d4f5099d tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:49:18.299206 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f51d8e38-a50d-4611-9e1e-1b93d4f5099d tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:49:18.301214 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f51d8e38-a50d-4611-9e1e-1b93d4f5099d tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:49:18.308632 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f51d8e38-a50d-4611-9e1e-1b93d4f5099d tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8" status: 200 len: 1809 microversion: 2.20 time: 0.329048 Oct 19 03:49:18.309474 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3129/6193] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:49:17 2022] GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8 => generated 1809 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:49:18.404165 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9ed7b405-9c54-4dd9-90ea-db3184e82e9d tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:49:18.414601 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9ed7b405-9c54-4dd9-90ea-db3184e82e9d tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/d7223d39-2ef0-443b-989b-87c1fe11d2c1" status: 200 len: 1693 microversion: 2.1 time: 0.323396 Oct 19 03:49:18.416079 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3065/6194] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:49:18 2022] GET /compute/v2.1/servers/d7223d39-2ef0-443b-989b-87c1fe11d2c1 => generated 1693 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:49:19.339576 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-38c5f654-30e3-4665-8066-b0054db52861 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:49:19.340396 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-38c5f654-30e3-4665-8066-b0054db52861 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 89f2e52f-afcb-49bf-a39a-4b442a96eba8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:49:19.348887 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-38c5f654-30e3-4665-8066-b0054db52861 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:49:19.349404 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-38c5f654-30e3-4665-8066-b0054db52861 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:49:19.349851 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-38c5f654-30e3-4665-8066-b0054db52861 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:49:19.350618 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-38c5f654-30e3-4665-8066-b0054db52861 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:49:19.351075 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-38c5f654-30e3-4665-8066-b0054db52861 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:49:19.351507 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-38c5f654-30e3-4665-8066-b0054db52861 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:49:19.438130 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4a9baaaa-348a-4b2d-bf38-0eec6fc288ea tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:49:19.438863 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4a9baaaa-348a-4b2d-bf38-0eec6fc288ea tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: d7223d39-2ef0-443b-989b-87c1fe11d2c1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:49:19.447780 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4a9baaaa-348a-4b2d-bf38-0eec6fc288ea tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:49:19.449196 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4a9baaaa-348a-4b2d-bf38-0eec6fc288ea tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:49:19.449927 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4a9baaaa-348a-4b2d-bf38-0eec6fc288ea tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:49:19.450768 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4a9baaaa-348a-4b2d-bf38-0eec6fc288ea tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:49:19.451266 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4a9baaaa-348a-4b2d-bf38-0eec6fc288ea tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:49:19.451885 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4a9baaaa-348a-4b2d-bf38-0eec6fc288ea tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:49:19.502091 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-38c5f654-30e3-4665-8066-b0054db52861 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:49:19.512261 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-38c5f654-30e3-4665-8066-b0054db52861 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:49:19.513754 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-38c5f654-30e3-4665-8066-b0054db52861 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:49:19.514954 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-38c5f654-30e3-4665-8066-b0054db52861 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8" status: 200 len: 1796 microversion: 2.20 time: 0.180696 Oct 19 03:49:19.515513 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3130/6195] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:49:19 2022] GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8 => generated 1796 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:49:19.627495 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-4a9baaaa-348a-4b2d-bf38-0eec6fc288ea tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:49:19.636682 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4a9baaaa-348a-4b2d-bf38-0eec6fc288ea tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/d7223d39-2ef0-443b-989b-87c1fe11d2c1" status: 200 len: 1698 microversion: 2.1 time: 0.202885 Oct 19 03:49:19.637297 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3066/6196] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:49:19 2022] GET /compute/v2.1/servers/d7223d39-2ef0-443b-989b-87c1fe11d2c1 => generated 1698 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:49:20.660183 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-030600c1-3944-4a2c-98e0-2e81fc760b47 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:49:20.660789 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-030600c1-3944-4a2c-98e0-2e81fc760b47 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: d7223d39-2ef0-443b-989b-87c1fe11d2c1] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:49:20.667746 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-030600c1-3944-4a2c-98e0-2e81fc760b47 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:49:20.668228 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-030600c1-3944-4a2c-98e0-2e81fc760b47 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:49:20.668666 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-030600c1-3944-4a2c-98e0-2e81fc760b47 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:49:20.669512 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-030600c1-3944-4a2c-98e0-2e81fc760b47 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:49:20.669971 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-030600c1-3944-4a2c-98e0-2e81fc760b47 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:49:20.670425 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-030600c1-3944-4a2c-98e0-2e81fc760b47 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:49:20.832222 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-030600c1-3944-4a2c-98e0-2e81fc760b47 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:49:20.840369 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-030600c1-3944-4a2c-98e0-2e81fc760b47 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/d7223d39-2ef0-443b-989b-87c1fe11d2c1" status: 200 len: 1698 microversion: 2.1 time: 0.184143 Oct 19 03:49:20.841021 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3131/6197] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:49:20 2022] GET /compute/v2.1/servers/d7223d39-2ef0-443b-989b-87c1fe11d2c1 => generated 1698 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:49:21.864760 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8fef061d-2104-4df8-8f95-6d39c80c7d27 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:49:21.865808 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8fef061d-2104-4df8-8f95-6d39c80c7d27 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: d7223d39-2ef0-443b-989b-87c1fe11d2c1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:49:21.881816 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8fef061d-2104-4df8-8f95-6d39c80c7d27 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:49:21.882484 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8fef061d-2104-4df8-8f95-6d39c80c7d27 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:49:21.882924 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8fef061d-2104-4df8-8f95-6d39c80c7d27 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:49:21.883637 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8fef061d-2104-4df8-8f95-6d39c80c7d27 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:49:21.884094 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8fef061d-2104-4df8-8f95-6d39c80c7d27 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:49:21.884579 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8fef061d-2104-4df8-8f95-6d39c80c7d27 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:49:22.030538 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8fef061d-2104-4df8-8f95-6d39c80c7d27 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:49:22.040489 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8fef061d-2104-4df8-8f95-6d39c80c7d27 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/d7223d39-2ef0-443b-989b-87c1fe11d2c1" status: 200 len: 1698 microversion: 2.1 time: 0.180582 Oct 19 03:49:22.041100 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3067/6198] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:49:21 2022] GET /compute/v2.1/servers/d7223d39-2ef0-443b-989b-87c1fe11d2c1 => generated 1698 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:49:23.065973 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-268197be-9cf5-4418-9270-a549c3c6ef98 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:49:23.066535 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-268197be-9cf5-4418-9270-a549c3c6ef98 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: d7223d39-2ef0-443b-989b-87c1fe11d2c1] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:49:23.069627 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=40 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:49:23.076970 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-268197be-9cf5-4418-9270-a549c3c6ef98 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:49:23.077971 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-268197be-9cf5-4418-9270-a549c3c6ef98 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:49:23.078445 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-268197be-9cf5-4418-9270-a549c3c6ef98 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:49:23.082977 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-268197be-9cf5-4418-9270-a549c3c6ef98 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:49:23.082977 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-268197be-9cf5-4418-9270-a549c3c6ef98 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:49:23.082977 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-268197be-9cf5-4418-9270-a549c3c6ef98 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:49:23.240570 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-268197be-9cf5-4418-9270-a549c3c6ef98 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:49:23.249670 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-268197be-9cf5-4418-9270-a549c3c6ef98 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/d7223d39-2ef0-443b-989b-87c1fe11d2c1" status: 200 len: 1698 microversion: 2.1 time: 0.187569 Oct 19 03:49:23.265352 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3132/6199] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:49:23 2022] GET /compute/v2.1/servers/d7223d39-2ef0-443b-989b-87c1fe11d2c1 => generated 1698 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:49:24.273414 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-34ebb954-637e-4211-b45b-88e69d35c446 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:49:24.273976 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-34ebb954-637e-4211-b45b-88e69d35c446 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: d7223d39-2ef0-443b-989b-87c1fe11d2c1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:49:24.277930 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=40 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:49:24.282828 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-34ebb954-637e-4211-b45b-88e69d35c446 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:49:24.283314 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-34ebb954-637e-4211-b45b-88e69d35c446 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:49:24.283743 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-34ebb954-637e-4211-b45b-88e69d35c446 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:49:24.284435 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-34ebb954-637e-4211-b45b-88e69d35c446 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:49:24.284901 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-34ebb954-637e-4211-b45b-88e69d35c446 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:49:24.285317 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-34ebb954-637e-4211-b45b-88e69d35c446 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:49:24.431247 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-34ebb954-637e-4211-b45b-88e69d35c446 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:49:24.439318 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-34ebb954-637e-4211-b45b-88e69d35c446 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/d7223d39-2ef0-443b-989b-87c1fe11d2c1" status: 200 len: 1698 microversion: 2.1 time: 0.170126 Oct 19 03:49:24.439888 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3068/6200] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:49:24 2022] GET /compute/v2.1/servers/d7223d39-2ef0-443b-989b-87c1fe11d2c1 => generated 1698 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:49:25.463667 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-fafa9cb7-45a7-47e9-8b30-56b9959ad25a tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:49:25.464300 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-fafa9cb7-45a7-47e9-8b30-56b9959ad25a tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: d7223d39-2ef0-443b-989b-87c1fe11d2c1] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:49:25.471447 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fafa9cb7-45a7-47e9-8b30-56b9959ad25a tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:49:25.472326 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fafa9cb7-45a7-47e9-8b30-56b9959ad25a tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:49:25.472773 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fafa9cb7-45a7-47e9-8b30-56b9959ad25a tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:49:25.473543 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fafa9cb7-45a7-47e9-8b30-56b9959ad25a tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:49:25.473995 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fafa9cb7-45a7-47e9-8b30-56b9959ad25a tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:49:25.474423 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fafa9cb7-45a7-47e9-8b30-56b9959ad25a tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:49:25.610196 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-fafa9cb7-45a7-47e9-8b30-56b9959ad25a tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:49:25.612439 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:49:25.618905 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-fafa9cb7-45a7-47e9-8b30-56b9959ad25a tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/d7223d39-2ef0-443b-989b-87c1fe11d2c1" status: 200 len: 1698 microversion: 2.1 time: 0.159803 Oct 19 03:49:25.619550 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3133/6201] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:49:25 2022] GET /compute/v2.1/servers/d7223d39-2ef0-443b-989b-87c1fe11d2c1 => generated 1698 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:49:26.646521 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a9ce4912-8cbd-4bbc-a0f2-5d1642eff211 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:49:26.648365 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a9ce4912-8cbd-4bbc-a0f2-5d1642eff211 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: d7223d39-2ef0-443b-989b-87c1fe11d2c1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:49:26.662050 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a9ce4912-8cbd-4bbc-a0f2-5d1642eff211 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:49:26.663063 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a9ce4912-8cbd-4bbc-a0f2-5d1642eff211 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:49:26.663681 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a9ce4912-8cbd-4bbc-a0f2-5d1642eff211 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:49:26.664548 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a9ce4912-8cbd-4bbc-a0f2-5d1642eff211 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:49:26.665204 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a9ce4912-8cbd-4bbc-a0f2-5d1642eff211 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:49:26.666376 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a9ce4912-8cbd-4bbc-a0f2-5d1642eff211 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:49:26.819493 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a9ce4912-8cbd-4bbc-a0f2-5d1642eff211 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:49:26.827762 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a9ce4912-8cbd-4bbc-a0f2-5d1642eff211 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/d7223d39-2ef0-443b-989b-87c1fe11d2c1" status: 200 len: 1698 microversion: 2.1 time: 0.189533 Oct 19 03:49:26.839494 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3069/6202] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:49:26 2022] GET /compute/v2.1/servers/d7223d39-2ef0-443b-989b-87c1fe11d2c1 => generated 1698 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:49:27.854007 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2a1d595a-7028-4c1d-8e83-48c02f9b9919 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:49:27.855268 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-2a1d595a-7028-4c1d-8e83-48c02f9b9919 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: d7223d39-2ef0-443b-989b-87c1fe11d2c1] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:49:27.864481 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2a1d595a-7028-4c1d-8e83-48c02f9b9919 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:49:27.864979 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2a1d595a-7028-4c1d-8e83-48c02f9b9919 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:49:27.865490 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2a1d595a-7028-4c1d-8e83-48c02f9b9919 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:49:27.866207 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2a1d595a-7028-4c1d-8e83-48c02f9b9919 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:49:27.866670 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2a1d595a-7028-4c1d-8e83-48c02f9b9919 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:49:27.867106 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2a1d595a-7028-4c1d-8e83-48c02f9b9919 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:49:28.008595 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-2a1d595a-7028-4c1d-8e83-48c02f9b9919 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:49:28.020229 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2a1d595a-7028-4c1d-8e83-48c02f9b9919 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/d7223d39-2ef0-443b-989b-87c1fe11d2c1" status: 200 len: 1698 microversion: 2.1 time: 0.168671 Oct 19 03:49:28.020229 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3134/6203] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:49:27 2022] GET /compute/v2.1/servers/d7223d39-2ef0-443b-989b-87c1fe11d2c1 => generated 1698 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:49:29.046254 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b9bfc1f6-981e-4f33-9e06-80a6adb43aad tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:49:29.046882 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b9bfc1f6-981e-4f33-9e06-80a6adb43aad tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: d7223d39-2ef0-443b-989b-87c1fe11d2c1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:49:29.054225 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b9bfc1f6-981e-4f33-9e06-80a6adb43aad tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:49:29.054966 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b9bfc1f6-981e-4f33-9e06-80a6adb43aad tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:49:29.055410 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b9bfc1f6-981e-4f33-9e06-80a6adb43aad tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:49:29.056142 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b9bfc1f6-981e-4f33-9e06-80a6adb43aad tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:49:29.057223 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b9bfc1f6-981e-4f33-9e06-80a6adb43aad tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:49:29.057676 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b9bfc1f6-981e-4f33-9e06-80a6adb43aad tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:49:29.060396 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=100 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:49:29.213196 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b9bfc1f6-981e-4f33-9e06-80a6adb43aad tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:49:29.225333 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b9bfc1f6-981e-4f33-9e06-80a6adb43aad tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/d7223d39-2ef0-443b-989b-87c1fe11d2c1" status: 200 len: 1698 microversion: 2.1 time: 0.183016 Oct 19 03:49:29.226671 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3070/6204] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:49:29 2022] GET /compute/v2.1/servers/d7223d39-2ef0-443b-989b-87c1fe11d2c1 => generated 1698 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:49:30.251368 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1ea5d1fe-94ca-4e57-b549-c83fff52b7b4 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:49:30.258862 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1ea5d1fe-94ca-4e57-b549-c83fff52b7b4 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: d7223d39-2ef0-443b-989b-87c1fe11d2c1] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:49:30.259136 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1ea5d1fe-94ca-4e57-b549-c83fff52b7b4 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:49:30.260468 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1ea5d1fe-94ca-4e57-b549-c83fff52b7b4 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:49:30.260926 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1ea5d1fe-94ca-4e57-b549-c83fff52b7b4 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:49:30.261675 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1ea5d1fe-94ca-4e57-b549-c83fff52b7b4 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:49:30.262805 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1ea5d1fe-94ca-4e57-b549-c83fff52b7b4 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:49:30.263247 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1ea5d1fe-94ca-4e57-b549-c83fff52b7b4 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:49:30.435408 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-1ea5d1fe-94ca-4e57-b549-c83fff52b7b4 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:49:30.444837 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1ea5d1fe-94ca-4e57-b549-c83fff52b7b4 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/d7223d39-2ef0-443b-989b-87c1fe11d2c1" status: 200 len: 1698 microversion: 2.1 time: 0.197420 Oct 19 03:49:30.449105 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3135/6205] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:49:30 2022] GET /compute/v2.1/servers/d7223d39-2ef0-443b-989b-87c1fe11d2c1 => generated 1698 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:49:31.469784 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-cf2bff08-c427-47d6-b1db-11b4bb9e17b4 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:49:31.470436 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-cf2bff08-c427-47d6-b1db-11b4bb9e17b4 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: d7223d39-2ef0-443b-989b-87c1fe11d2c1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:49:31.477746 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cf2bff08-c427-47d6-b1db-11b4bb9e17b4 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:49:31.478351 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cf2bff08-c427-47d6-b1db-11b4bb9e17b4 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:49:31.479303 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cf2bff08-c427-47d6-b1db-11b4bb9e17b4 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:49:31.480023 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cf2bff08-c427-47d6-b1db-11b4bb9e17b4 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:49:31.480914 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cf2bff08-c427-47d6-b1db-11b4bb9e17b4 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:49:31.481482 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cf2bff08-c427-47d6-b1db-11b4bb9e17b4 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:49:31.620220 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-cf2bff08-c427-47d6-b1db-11b4bb9e17b4 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:49:31.628090 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-cf2bff08-c427-47d6-b1db-11b4bb9e17b4 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/d7223d39-2ef0-443b-989b-87c1fe11d2c1" status: 200 len: 1698 microversion: 2.1 time: 0.162361 Oct 19 03:49:31.628643 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3071/6206] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:49:31 2022] GET /compute/v2.1/servers/d7223d39-2ef0-443b-989b-87c1fe11d2c1 => generated 1698 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:49:32.764681 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-41010977-3b19-427c-8a69-b71716eda3cc tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:49:32.765237 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-41010977-3b19-427c-8a69-b71716eda3cc tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: d7223d39-2ef0-443b-989b-87c1fe11d2c1] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:49:32.774875 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-41010977-3b19-427c-8a69-b71716eda3cc tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:49:32.775900 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-41010977-3b19-427c-8a69-b71716eda3cc tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:49:32.776810 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-41010977-3b19-427c-8a69-b71716eda3cc tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:49:32.777842 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-41010977-3b19-427c-8a69-b71716eda3cc tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:49:32.778387 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-41010977-3b19-427c-8a69-b71716eda3cc tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:49:32.778906 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-41010977-3b19-427c-8a69-b71716eda3cc tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:49:32.942867 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-41010977-3b19-427c-8a69-b71716eda3cc tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:49:32.957257 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-41010977-3b19-427c-8a69-b71716eda3cc tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/d7223d39-2ef0-443b-989b-87c1fe11d2c1" status: 200 len: 1698 microversion: 2.1 time: 0.201490 Oct 19 03:49:32.958135 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3136/6207] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:49:32 2022] GET /compute/v2.1/servers/d7223d39-2ef0-443b-989b-87c1fe11d2c1 => generated 1698 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:49:33.983988 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-54944d74-9127-48c3-9c17-600bf80fd1d8 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:49:33.984678 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-54944d74-9127-48c3-9c17-600bf80fd1d8 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: d7223d39-2ef0-443b-989b-87c1fe11d2c1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:49:33.992601 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-54944d74-9127-48c3-9c17-600bf80fd1d8 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:49:33.993378 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-54944d74-9127-48c3-9c17-600bf80fd1d8 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:49:33.993819 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-54944d74-9127-48c3-9c17-600bf80fd1d8 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:49:33.995196 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-54944d74-9127-48c3-9c17-600bf80fd1d8 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:49:33.995655 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-54944d74-9127-48c3-9c17-600bf80fd1d8 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:49:33.996080 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-54944d74-9127-48c3-9c17-600bf80fd1d8 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:49:34.142660 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-54944d74-9127-48c3-9c17-600bf80fd1d8 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:49:34.151566 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-54944d74-9127-48c3-9c17-600bf80fd1d8 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/d7223d39-2ef0-443b-989b-87c1fe11d2c1" status: 200 len: 1698 microversion: 2.1 time: 0.171523 Oct 19 03:49:34.159682 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3072/6208] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:49:33 2022] GET /compute/v2.1/servers/d7223d39-2ef0-443b-989b-87c1fe11d2c1 => generated 1698 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:49:35.175375 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d5162a8c-12ef-49dd-b970-3c20af642efa tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:49:35.175983 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d5162a8c-12ef-49dd-b970-3c20af642efa tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: d7223d39-2ef0-443b-989b-87c1fe11d2c1] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:49:35.183644 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d5162a8c-12ef-49dd-b970-3c20af642efa tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:49:35.184129 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d5162a8c-12ef-49dd-b970-3c20af642efa tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:49:35.184880 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d5162a8c-12ef-49dd-b970-3c20af642efa tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:49:35.185658 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d5162a8c-12ef-49dd-b970-3c20af642efa tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:49:35.186113 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d5162a8c-12ef-49dd-b970-3c20af642efa tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:49:35.186536 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d5162a8c-12ef-49dd-b970-3c20af642efa tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:49:35.338439 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d5162a8c-12ef-49dd-b970-3c20af642efa tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:49:35.346704 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d5162a8c-12ef-49dd-b970-3c20af642efa tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/d7223d39-2ef0-443b-989b-87c1fe11d2c1" status: 200 len: 1698 microversion: 2.1 time: 0.175209 Oct 19 03:49:35.347300 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3137/6209] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:49:35 2022] GET /compute/v2.1/servers/d7223d39-2ef0-443b-989b-87c1fe11d2c1 => generated 1698 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:49:36.370954 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a3fe9026-39e4-4d26-aa15-b774bdcd0e35 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:49:36.371778 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a3fe9026-39e4-4d26-aa15-b774bdcd0e35 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: d7223d39-2ef0-443b-989b-87c1fe11d2c1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:49:36.378979 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a3fe9026-39e4-4d26-aa15-b774bdcd0e35 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:49:36.379485 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a3fe9026-39e4-4d26-aa15-b774bdcd0e35 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:49:36.379932 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a3fe9026-39e4-4d26-aa15-b774bdcd0e35 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:49:36.380898 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a3fe9026-39e4-4d26-aa15-b774bdcd0e35 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:49:36.381404 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a3fe9026-39e4-4d26-aa15-b774bdcd0e35 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:49:36.381845 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a3fe9026-39e4-4d26-aa15-b774bdcd0e35 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:49:36.570413 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a3fe9026-39e4-4d26-aa15-b774bdcd0e35 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:49:36.584793 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a3fe9026-39e4-4d26-aa15-b774bdcd0e35 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/d7223d39-2ef0-443b-989b-87c1fe11d2c1" status: 200 len: 1698 microversion: 2.1 time: 0.218371 Oct 19 03:49:36.603237 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3073/6210] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:49:36 2022] GET /compute/v2.1/servers/d7223d39-2ef0-443b-989b-87c1fe11d2c1 => generated 1698 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:49:37.616396 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0ebeecfe-6601-4a41-ac8e-124bf80d25f9 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:49:37.617102 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0ebeecfe-6601-4a41-ac8e-124bf80d25f9 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: d7223d39-2ef0-443b-989b-87c1fe11d2c1] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:49:37.624378 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0ebeecfe-6601-4a41-ac8e-124bf80d25f9 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:49:37.625000 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0ebeecfe-6601-4a41-ac8e-124bf80d25f9 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:49:37.625732 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0ebeecfe-6601-4a41-ac8e-124bf80d25f9 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:49:37.626773 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0ebeecfe-6601-4a41-ac8e-124bf80d25f9 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:49:37.627431 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0ebeecfe-6601-4a41-ac8e-124bf80d25f9 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:49:37.627920 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0ebeecfe-6601-4a41-ac8e-124bf80d25f9 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:49:37.804324 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-0ebeecfe-6601-4a41-ac8e-124bf80d25f9 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:49:37.811636 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-c979570f-701e-4e73-9148-c447ab5d6c7b req-3b2b9113-d4b2-4481-a71f-cda22402811f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7223d39-2ef0-443b-989b-87c1fe11d2c1", "name": "network-vif-unplugged", "status": "completed", "tag": "f1a51aab-0c40-4b41-ae4e-760590333068"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:49:37.818701 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0ebeecfe-6601-4a41-ac8e-124bf80d25f9 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/d7223d39-2ef0-443b-989b-87c1fe11d2c1" status: 200 len: 1697 microversion: 2.1 time: 0.206817 Oct 19 03:49:37.821221 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3138/6211] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:49:37 2022] GET /compute/v2.1/servers/d7223d39-2ef0-443b-989b-87c1fe11d2c1 => generated 1697 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:49:37.849479 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-c979570f-701e-4e73-9148-c447ab5d6c7b req-3b2b9113-d4b2-4481-a71f-cda22402811f service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:49:37.849479 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-c979570f-701e-4e73-9148-c447ab5d6c7b req-3b2b9113-d4b2-4481-a71f-cda22402811f service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:49:37.849479 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-c979570f-701e-4e73-9148-c447ab5d6c7b req-3b2b9113-d4b2-4481-a71f-cda22402811f service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:49:37.856912 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-c979570f-701e-4e73-9148-c447ab5d6c7b req-3b2b9113-d4b2-4481-a71f-cda22402811f service nova] Creating event network-vif-unplugged:f1a51aab-0c40-4b41-ae4e-760590333068 for instance d7223d39-2ef0-443b-989b-87c1fe11d2c1 on n-h1-861333-8 Oct 19 03:49:37.864072 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [req-c979570f-701e-4e73-9148-c447ab5d6c7b req-3b2b9113-d4b2-4481-a71f-cda22402811f service nova] Instance d7223d39-2ef0-443b-989b-87c1fe11d2c1 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-861333-8', 'n-h1-861333-8'} {{(pid=121134) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 03:49:37.876551 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-c979570f-701e-4e73-9148-c447ab5d6c7b req-3b2b9113-d4b2-4481-a71f-cda22402811f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.247902 Oct 19 03:49:37.877885 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3074/6212] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:49:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:49:38.849032 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-299e949d-258a-4311-9334-dfe03c679b95 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:49:38.850342 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-299e949d-258a-4311-9334-dfe03c679b95 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: d7223d39-2ef0-443b-989b-87c1fe11d2c1] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:49:38.858055 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-299e949d-258a-4311-9334-dfe03c679b95 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:49:38.858749 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-299e949d-258a-4311-9334-dfe03c679b95 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:49:38.860672 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-299e949d-258a-4311-9334-dfe03c679b95 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:49:38.860672 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-299e949d-258a-4311-9334-dfe03c679b95 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:49:38.860672 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-299e949d-258a-4311-9334-dfe03c679b95 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:49:38.862563 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-299e949d-258a-4311-9334-dfe03c679b95 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:49:39.015146 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-299e949d-258a-4311-9334-dfe03c679b95 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:49:39.023594 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-299e949d-258a-4311-9334-dfe03c679b95 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/d7223d39-2ef0-443b-989b-87c1fe11d2c1" status: 200 len: 1697 microversion: 2.1 time: 0.179131 Oct 19 03:49:39.024185 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3139/6213] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:49:38 2022] GET /compute/v2.1/servers/d7223d39-2ef0-443b-989b-87c1fe11d2c1 => generated 1697 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:49:39.899080 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-085942e2-2937-4a12-a75d-4b2cbd5d28e6 req-6f1f5954-2423-460c-8001-9b70304f0fe7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7223d39-2ef0-443b-989b-87c1fe11d2c1", "tag": "f1a51aab-0c40-4b41-ae4e-760590333068"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:49:39.910893 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-085942e2-2937-4a12-a75d-4b2cbd5d28e6 req-6f1f5954-2423-460c-8001-9b70304f0fe7 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:49:39.911372 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-085942e2-2937-4a12-a75d-4b2cbd5d28e6 req-6f1f5954-2423-460c-8001-9b70304f0fe7 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:49:39.911805 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-085942e2-2937-4a12-a75d-4b2cbd5d28e6 req-6f1f5954-2423-460c-8001-9b70304f0fe7 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:49:39.924921 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-085942e2-2937-4a12-a75d-4b2cbd5d28e6 req-6f1f5954-2423-460c-8001-9b70304f0fe7 service nova] Creating event network-changed:f1a51aab-0c40-4b41-ae4e-760590333068 for instance d7223d39-2ef0-443b-989b-87c1fe11d2c1 on n-h1-861333-8 Oct 19 03:49:39.931137 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [req-085942e2-2937-4a12-a75d-4b2cbd5d28e6 req-6f1f5954-2423-460c-8001-9b70304f0fe7 service nova] Instance d7223d39-2ef0-443b-989b-87c1fe11d2c1 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-861333-8', 'n-h1-861333-8'} {{(pid=121134) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 03:49:39.942861 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-085942e2-2937-4a12-a75d-4b2cbd5d28e6 req-6f1f5954-2423-460c-8001-9b70304f0fe7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048266 Oct 19 03:49:39.943479 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3075/6214] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:49:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:49:40.048609 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3833e7f4-29fa-4fcf-b7e3-d59e674af792 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:49:40.049996 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-3833e7f4-29fa-4fcf-b7e3-d59e674af792 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: d7223d39-2ef0-443b-989b-87c1fe11d2c1] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:49:40.058571 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3833e7f4-29fa-4fcf-b7e3-d59e674af792 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:49:40.059203 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3833e7f4-29fa-4fcf-b7e3-d59e674af792 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:49:40.059793 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3833e7f4-29fa-4fcf-b7e3-d59e674af792 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:49:40.060708 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3833e7f4-29fa-4fcf-b7e3-d59e674af792 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:49:40.061308 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3833e7f4-29fa-4fcf-b7e3-d59e674af792 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:49:40.061867 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3833e7f4-29fa-4fcf-b7e3-d59e674af792 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:49:40.271391 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-3833e7f4-29fa-4fcf-b7e3-d59e674af792 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:49:40.281984 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-3833e7f4-29fa-4fcf-b7e3-d59e674af792 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/d7223d39-2ef0-443b-989b-87c1fe11d2c1" status: 200 len: 1695 microversion: 2.1 time: 0.238179 Oct 19 03:49:40.282659 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3140/6215] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:49:40 2022] GET /compute/v2.1/servers/d7223d39-2ef0-443b-989b-87c1fe11d2c1 => generated 1695 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:49:41.313016 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ede49262-cd86-4cdf-b1c8-a9fefdabd04a tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:49:41.313656 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ede49262-cd86-4cdf-b1c8-a9fefdabd04a tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: d7223d39-2ef0-443b-989b-87c1fe11d2c1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:49:41.320060 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ede49262-cd86-4cdf-b1c8-a9fefdabd04a tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:49:41.320596 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ede49262-cd86-4cdf-b1c8-a9fefdabd04a tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:49:41.320993 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ede49262-cd86-4cdf-b1c8-a9fefdabd04a tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:49:41.324874 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ede49262-cd86-4cdf-b1c8-a9fefdabd04a tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:49:41.325417 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ede49262-cd86-4cdf-b1c8-a9fefdabd04a tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:49:41.325879 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ede49262-cd86-4cdf-b1c8-a9fefdabd04a tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:49:41.474675 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ede49262-cd86-4cdf-b1c8-a9fefdabd04a tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:49:41.482616 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ede49262-cd86-4cdf-b1c8-a9fefdabd04a tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/d7223d39-2ef0-443b-989b-87c1fe11d2c1" status: 200 len: 1695 microversion: 2.1 time: 0.174714 Oct 19 03:49:41.483277 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3076/6216] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:49:41 2022] GET /compute/v2.1/servers/d7223d39-2ef0-443b-989b-87c1fe11d2c1 => generated 1695 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:49:42.507417 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b2c86bf9-c64d-4a04-9d77-489b227b9a40 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:49:42.508038 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b2c86bf9-c64d-4a04-9d77-489b227b9a40 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: d7223d39-2ef0-443b-989b-87c1fe11d2c1] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:49:42.515584 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b2c86bf9-c64d-4a04-9d77-489b227b9a40 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:49:42.517619 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b2c86bf9-c64d-4a04-9d77-489b227b9a40 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:49:42.517619 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b2c86bf9-c64d-4a04-9d77-489b227b9a40 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:49:42.517619 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b2c86bf9-c64d-4a04-9d77-489b227b9a40 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:49:42.517921 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b2c86bf9-c64d-4a04-9d77-489b227b9a40 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:49:42.518187 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b2c86bf9-c64d-4a04-9d77-489b227b9a40 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:49:42.660543 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b2c86bf9-c64d-4a04-9d77-489b227b9a40 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:49:42.669627 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b2c86bf9-c64d-4a04-9d77-489b227b9a40 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/d7223d39-2ef0-443b-989b-87c1fe11d2c1" status: 200 len: 1695 microversion: 2.1 time: 0.166507 Oct 19 03:49:42.670190 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3141/6217] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:49:42 2022] GET /compute/v2.1/servers/d7223d39-2ef0-443b-989b-87c1fe11d2c1 => generated 1695 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:49:43.693454 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-191aca83-fce1-4480-8858-4d3fdccb18bb tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:49:43.694072 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-191aca83-fce1-4480-8858-4d3fdccb18bb tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: d7223d39-2ef0-443b-989b-87c1fe11d2c1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:49:43.701620 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-191aca83-fce1-4480-8858-4d3fdccb18bb tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:49:43.702118 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-191aca83-fce1-4480-8858-4d3fdccb18bb tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:49:43.702564 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-191aca83-fce1-4480-8858-4d3fdccb18bb tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:49:43.703271 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-191aca83-fce1-4480-8858-4d3fdccb18bb tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:49:43.703837 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-191aca83-fce1-4480-8858-4d3fdccb18bb tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:49:43.704161 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-191aca83-fce1-4480-8858-4d3fdccb18bb tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:49:43.852262 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-191aca83-fce1-4480-8858-4d3fdccb18bb tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:49:43.861902 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-191aca83-fce1-4480-8858-4d3fdccb18bb tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/d7223d39-2ef0-443b-989b-87c1fe11d2c1" status: 200 len: 1692 microversion: 2.1 time: 0.172281 Oct 19 03:49:43.862596 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3077/6218] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:49:43 2022] GET /compute/v2.1/servers/d7223d39-2ef0-443b-989b-87c1fe11d2c1 => generated 1692 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:49:43.887757 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-644af92d-ad20-4585-816c-6a16c92bac6c tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:49:43.888284 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-644af92d-ad20-4585-816c-6a16c92bac6c tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: d7223d39-2ef0-443b-989b-87c1fe11d2c1] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:49:43.895264 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-644af92d-ad20-4585-816c-6a16c92bac6c tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:49:43.895732 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-644af92d-ad20-4585-816c-6a16c92bac6c tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:49:43.896167 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-644af92d-ad20-4585-816c-6a16c92bac6c tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:49:43.896855 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-644af92d-ad20-4585-816c-6a16c92bac6c tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:49:43.897306 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-644af92d-ad20-4585-816c-6a16c92bac6c tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:49:43.897787 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-644af92d-ad20-4585-816c-6a16c92bac6c tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:49:44.091228 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-644af92d-ad20-4585-816c-6a16c92bac6c tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "POST /compute/v2.1/servers/d7223d39-2ef0-443b-989b-87c1fe11d2c1/action" status: 204 len: 0 microversion: 2.1 time: 0.207720 Oct 19 03:49:44.092493 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3142/6219] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:49:43 2022] POST /compute/v2.1/servers/d7223d39-2ef0-443b-989b-87c1fe11d2c1/action => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:49:44.112363 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0e74b03d-69f8-4ce5-9987-b1a042982a12 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:49:44.122495 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0e74b03d-69f8-4ce5-9987-b1a042982a12 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: d7223d39-2ef0-443b-989b-87c1fe11d2c1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:49:44.144991 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0e74b03d-69f8-4ce5-9987-b1a042982a12 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:49:44.145458 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0e74b03d-69f8-4ce5-9987-b1a042982a12 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:49:44.145994 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0e74b03d-69f8-4ce5-9987-b1a042982a12 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:49:44.146784 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0e74b03d-69f8-4ce5-9987-b1a042982a12 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:49:44.147498 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0e74b03d-69f8-4ce5-9987-b1a042982a12 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:49:44.147994 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0e74b03d-69f8-4ce5-9987-b1a042982a12 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:49:44.211505 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-43768dbc-ac91-443c-a7ea-eb7b59677313 req-656773b2-5380-4cc8-9a39-45eaba1b751a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7223d39-2ef0-443b-989b-87c1fe11d2c1", "name": "network-vif-plugged", "status": "completed", "tag": "f1a51aab-0c40-4b41-ae4e-760590333068"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:49:44.257767 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-43768dbc-ac91-443c-a7ea-eb7b59677313 req-656773b2-5380-4cc8-9a39-45eaba1b751a service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:49:44.258392 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-43768dbc-ac91-443c-a7ea-eb7b59677313 req-656773b2-5380-4cc8-9a39-45eaba1b751a service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:49:44.259076 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-43768dbc-ac91-443c-a7ea-eb7b59677313 req-656773b2-5380-4cc8-9a39-45eaba1b751a service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:49:44.274004 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-43768dbc-ac91-443c-a7ea-eb7b59677313 req-656773b2-5380-4cc8-9a39-45eaba1b751a service nova] Creating event network-vif-plugged:f1a51aab-0c40-4b41-ae4e-760590333068 for instance d7223d39-2ef0-443b-989b-87c1fe11d2c1 on n-h1-861333-8 Oct 19 03:49:44.280421 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [req-43768dbc-ac91-443c-a7ea-eb7b59677313 req-656773b2-5380-4cc8-9a39-45eaba1b751a service nova] Instance d7223d39-2ef0-443b-989b-87c1fe11d2c1 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-861333-8', 'n-h1-861333-8'} {{(pid=121135) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 03:49:44.294437 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-43768dbc-ac91-443c-a7ea-eb7b59677313 req-656773b2-5380-4cc8-9a39-45eaba1b751a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089911 Oct 19 03:49:44.297358 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3143/6220] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:49:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:49:44.396752 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0e74b03d-69f8-4ce5-9987-b1a042982a12 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:49:44.409873 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0e74b03d-69f8-4ce5-9987-b1a042982a12 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/d7223d39-2ef0-443b-989b-87c1fe11d2c1" status: 200 len: 1692 microversion: 2.1 time: 0.313071 Oct 19 03:49:44.410864 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3078/6221] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:49:44 2022] GET /compute/v2.1/servers/d7223d39-2ef0-443b-989b-87c1fe11d2c1 => generated 1692 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:49:45.437659 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b4610790-1be2-4905-93e8-eb600ef6f8b4 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:49:45.438393 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b4610790-1be2-4905-93e8-eb600ef6f8b4 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: d7223d39-2ef0-443b-989b-87c1fe11d2c1] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:49:45.446196 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b4610790-1be2-4905-93e8-eb600ef6f8b4 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:49:45.446696 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b4610790-1be2-4905-93e8-eb600ef6f8b4 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:49:45.447150 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b4610790-1be2-4905-93e8-eb600ef6f8b4 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:49:45.447895 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b4610790-1be2-4905-93e8-eb600ef6f8b4 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:49:45.448469 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b4610790-1be2-4905-93e8-eb600ef6f8b4 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:49:45.448917 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b4610790-1be2-4905-93e8-eb600ef6f8b4 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:49:45.605102 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b4610790-1be2-4905-93e8-eb600ef6f8b4 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:49:45.613770 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b4610790-1be2-4905-93e8-eb600ef6f8b4 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/d7223d39-2ef0-443b-989b-87c1fe11d2c1" status: 200 len: 1692 microversion: 2.1 time: 0.180422 Oct 19 03:49:45.614477 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3144/6222] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:49:45 2022] GET /compute/v2.1/servers/d7223d39-2ef0-443b-989b-87c1fe11d2c1 => generated 1692 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:49:46.640292 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7de086b9-1be5-47c2-bd0e-03ad563f9a8b tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:49:46.640917 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7de086b9-1be5-47c2-bd0e-03ad563f9a8b tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: d7223d39-2ef0-443b-989b-87c1fe11d2c1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:49:46.648270 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7de086b9-1be5-47c2-bd0e-03ad563f9a8b tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:49:46.648826 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7de086b9-1be5-47c2-bd0e-03ad563f9a8b tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:49:46.649270 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7de086b9-1be5-47c2-bd0e-03ad563f9a8b tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:49:46.650827 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7de086b9-1be5-47c2-bd0e-03ad563f9a8b tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:49:46.651304 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7de086b9-1be5-47c2-bd0e-03ad563f9a8b tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:49:46.651889 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7de086b9-1be5-47c2-bd0e-03ad563f9a8b tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:49:46.856909 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-7de086b9-1be5-47c2-bd0e-03ad563f9a8b tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:49:46.864667 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7de086b9-1be5-47c2-bd0e-03ad563f9a8b tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/d7223d39-2ef0-443b-989b-87c1fe11d2c1" status: 200 len: 1684 microversion: 2.1 time: 0.230384 Oct 19 03:49:46.865255 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3079/6223] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:49:46 2022] GET /compute/v2.1/servers/d7223d39-2ef0-443b-989b-87c1fe11d2c1 => generated 1684 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:50:19.101879 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f561bf6c-dbdc-4b07-9fd9-d5dd2802639a tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:50:19.104338 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f561bf6c-dbdc-4b07-9fd9-d5dd2802639a tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: d7223d39-2ef0-443b-989b-87c1fe11d2c1] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:50:19.106916 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=25 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:50:19.107675 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:50:19.113185 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f561bf6c-dbdc-4b07-9fd9-d5dd2802639a tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:50:19.113971 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f561bf6c-dbdc-4b07-9fd9-d5dd2802639a tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:50:19.115031 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f561bf6c-dbdc-4b07-9fd9-d5dd2802639a tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:50:19.115435 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f561bf6c-dbdc-4b07-9fd9-d5dd2802639a tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:50:19.115900 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f561bf6c-dbdc-4b07-9fd9-d5dd2802639a tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:50:19.116416 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f561bf6c-dbdc-4b07-9fd9-d5dd2802639a tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:50:19.186996 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f561bf6c-dbdc-4b07-9fd9-d5dd2802639a tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "POST /compute/v2.1/servers/d7223d39-2ef0-443b-989b-87c1fe11d2c1/action" status: 200 len: 24569 microversion: 2.1 time: 0.088928 Oct 19 03:50:19.187994 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3145/6224] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:50:19 2022] POST /compute/v2.1/servers/d7223d39-2ef0-443b-989b-87c1fe11d2c1/action => generated 24569 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 03:50:24.590750 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c27bd229-f141-473c-b593-2a5855eb0164 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:50:24.591285 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c27bd229-f141-473c-b593-2a5855eb0164 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 89f2e52f-afcb-49bf-a39a-4b442a96eba8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:50:24.595871 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=23 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:50:24.596712 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=55 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:50:24.601781 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c27bd229-f141-473c-b593-2a5855eb0164 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:50:24.604247 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c27bd229-f141-473c-b593-2a5855eb0164 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:50:24.604247 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c27bd229-f141-473c-b593-2a5855eb0164 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:50:24.604247 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c27bd229-f141-473c-b593-2a5855eb0164 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:50:24.604247 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c27bd229-f141-473c-b593-2a5855eb0164 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:50:24.604247 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c27bd229-f141-473c-b593-2a5855eb0164 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:50:24.645198 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c27bd229-f141-473c-b593-2a5855eb0164 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8/os-volume_attachments/851a808e-b646-4571-8afd-9deecf4beb93" status: 200 len: 194 microversion: 2.20 time: 0.058905 Oct 19 03:50:24.646218 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3080/6225] 10.222.0.52 () {60 vars in 1454 bytes} [Wed Oct 19 03:50:24 2022] GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8/os-volume_attachments/851a808e-b646-4571-8afd-9deecf4beb93 => generated 194 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 03:50:24.727144 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-524067e7-c1d4-4444-8642-c6225459d778 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:50:24.727736 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-524067e7-c1d4-4444-8642-c6225459d778 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 89f2e52f-afcb-49bf-a39a-4b442a96eba8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:50:24.735899 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-524067e7-c1d4-4444-8642-c6225459d778 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:50:24.736397 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-524067e7-c1d4-4444-8642-c6225459d778 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:50:24.736868 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-524067e7-c1d4-4444-8642-c6225459d778 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:50:24.737589 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-524067e7-c1d4-4444-8642-c6225459d778 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:50:24.738570 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-524067e7-c1d4-4444-8642-c6225459d778 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:50:24.739008 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-524067e7-c1d4-4444-8642-c6225459d778 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:50:24.823954 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-524067e7-c1d4-4444-8642-c6225459d778 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lazy-loading 'services' on Instance uuid 89f2e52f-afcb-49bf-a39a-4b442a96eba8 {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:50:25.084693 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-524067e7-c1d4-4444-8642-c6225459d778 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "DELETE /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8/os-volume_attachments/851a808e-b646-4571-8afd-9deecf4beb93" status: 202 len: 0 microversion: 2.20 time: 0.362170 Oct 19 03:50:25.085376 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3146/6226] 10.222.0.52 () {60 vars in 1457 bytes} [Wed Oct 19 03:50:24 2022] DELETE /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8/os-volume_attachments/851a808e-b646-4571-8afd-9deecf4beb93 => generated 0 bytes in 364 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:50:25.094406 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a1882e49-b652-4e7a-bab8-4b232d612de1 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:50:25.096857 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a1882e49-b652-4e7a-bab8-4b232d612de1 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 89f2e52f-afcb-49bf-a39a-4b442a96eba8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:50:25.104018 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a1882e49-b652-4e7a-bab8-4b232d612de1 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:50:25.104512 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a1882e49-b652-4e7a-bab8-4b232d612de1 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:50:25.104966 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a1882e49-b652-4e7a-bab8-4b232d612de1 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:50:25.105693 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a1882e49-b652-4e7a-bab8-4b232d612de1 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:50:25.106157 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a1882e49-b652-4e7a-bab8-4b232d612de1 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:50:25.106592 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a1882e49-b652-4e7a-bab8-4b232d612de1 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:50:25.137780 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a1882e49-b652-4e7a-bab8-4b232d612de1 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047584 Oct 19 03:50:25.138123 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3081/6227] 10.222.0.52 () {60 vars in 1343 bytes} [Wed Oct 19 03:50:25 2022] GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 03:50:26.152688 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3dd0a0be-ccf3-4e8b-960f-f204f8350994 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:50:26.157087 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-3dd0a0be-ccf3-4e8b-960f-f204f8350994 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 89f2e52f-afcb-49bf-a39a-4b442a96eba8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:50:26.164836 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3dd0a0be-ccf3-4e8b-960f-f204f8350994 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:50:26.165768 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3dd0a0be-ccf3-4e8b-960f-f204f8350994 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:50:26.166513 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3dd0a0be-ccf3-4e8b-960f-f204f8350994 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:50:26.167534 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3dd0a0be-ccf3-4e8b-960f-f204f8350994 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:50:26.168190 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3dd0a0be-ccf3-4e8b-960f-f204f8350994 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:50:26.168831 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3dd0a0be-ccf3-4e8b-960f-f204f8350994 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:50:26.216303 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-3dd0a0be-ccf3-4e8b-960f-f204f8350994 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.068578 Oct 19 03:50:26.217755 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3147/6228] 10.222.0.52 () {60 vars in 1343 bytes} [Wed Oct 19 03:50:26 2022] GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 03:50:27.229650 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2779d468-f2c7-431d-9a9a-adbb4c945b5a tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:50:27.231718 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2779d468-f2c7-431d-9a9a-adbb4c945b5a tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 89f2e52f-afcb-49bf-a39a-4b442a96eba8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:50:27.251294 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2779d468-f2c7-431d-9a9a-adbb4c945b5a tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:50:27.256159 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2779d468-f2c7-431d-9a9a-adbb4c945b5a tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:50:27.256159 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2779d468-f2c7-431d-9a9a-adbb4c945b5a tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:50:27.256159 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2779d468-f2c7-431d-9a9a-adbb4c945b5a tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:50:27.256159 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2779d468-f2c7-431d-9a9a-adbb4c945b5a tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:50:27.256159 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2779d468-f2c7-431d-9a9a-adbb4c945b5a tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:50:27.316864 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2779d468-f2c7-431d-9a9a-adbb4c945b5a tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.090676 Oct 19 03:50:27.317701 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3082/6229] 10.222.0.52 () {60 vars in 1343 bytes} [Wed Oct 19 03:50:27 2022] GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 03:50:28.334275 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-573f3d59-5be7-4b7d-8af2-3e1d9ac56fd1 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:50:28.337440 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-573f3d59-5be7-4b7d-8af2-3e1d9ac56fd1 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 89f2e52f-afcb-49bf-a39a-4b442a96eba8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:50:28.347366 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-573f3d59-5be7-4b7d-8af2-3e1d9ac56fd1 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:50:28.349437 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-573f3d59-5be7-4b7d-8af2-3e1d9ac56fd1 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:50:28.349663 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-573f3d59-5be7-4b7d-8af2-3e1d9ac56fd1 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:50:28.350585 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-573f3d59-5be7-4b7d-8af2-3e1d9ac56fd1 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:50:28.351074 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-573f3d59-5be7-4b7d-8af2-3e1d9ac56fd1 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:50:28.351514 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-573f3d59-5be7-4b7d-8af2-3e1d9ac56fd1 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:50:28.422177 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-573f3d59-5be7-4b7d-8af2-3e1d9ac56fd1 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.094830 Oct 19 03:50:28.423231 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3148/6230] 10.222.0.52 () {60 vars in 1343 bytes} [Wed Oct 19 03:50:28 2022] GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 03:50:29.436049 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-bc5f7046-91c7-4a70-beae-66208100426d tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:50:29.439848 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-bc5f7046-91c7-4a70-beae-66208100426d tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 89f2e52f-afcb-49bf-a39a-4b442a96eba8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:50:29.448880 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bc5f7046-91c7-4a70-beae-66208100426d tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:50:29.449696 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bc5f7046-91c7-4a70-beae-66208100426d tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:50:29.450489 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bc5f7046-91c7-4a70-beae-66208100426d tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:50:29.451415 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bc5f7046-91c7-4a70-beae-66208100426d tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:50:29.452084 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bc5f7046-91c7-4a70-beae-66208100426d tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:50:29.452851 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bc5f7046-91c7-4a70-beae-66208100426d tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:50:29.491070 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-bc5f7046-91c7-4a70-beae-66208100426d tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.059634 Oct 19 03:50:29.492028 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3083/6231] 10.222.0.52 () {60 vars in 1343 bytes} [Wed Oct 19 03:50:29 2022] GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 03:50:30.507065 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-bd26569d-60a0-4a48-86fd-a63684bb0bfa tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:50:30.509632 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-bd26569d-60a0-4a48-86fd-a63684bb0bfa tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 89f2e52f-afcb-49bf-a39a-4b442a96eba8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:50:30.516767 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bd26569d-60a0-4a48-86fd-a63684bb0bfa tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:50:30.517275 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bd26569d-60a0-4a48-86fd-a63684bb0bfa tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:50:30.517762 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bd26569d-60a0-4a48-86fd-a63684bb0bfa tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:50:30.518479 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bd26569d-60a0-4a48-86fd-a63684bb0bfa tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:50:30.518970 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bd26569d-60a0-4a48-86fd-a63684bb0bfa tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:50:30.519929 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bd26569d-60a0-4a48-86fd-a63684bb0bfa tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:50:30.559904 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-bd26569d-60a0-4a48-86fd-a63684bb0bfa tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.057565 Oct 19 03:50:30.565539 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3149/6232] 10.222.0.52 () {60 vars in 1343 bytes} [Wed Oct 19 03:50:30 2022] GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8/os-volume_attachments => generated 25 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:50:30.652441 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-93930f17-e709-4f00-a7d3-c5a72c709ffa tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:50:30.654200 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-93930f17-e709-4f00-a7d3-c5a72c709ffa tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 89f2e52f-afcb-49bf-a39a-4b442a96eba8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:50:30.662036 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-93930f17-e709-4f00-a7d3-c5a72c709ffa tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:50:30.662841 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-93930f17-e709-4f00-a7d3-c5a72c709ffa tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:50:30.663513 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-93930f17-e709-4f00-a7d3-c5a72c709ffa tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:50:30.664321 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-93930f17-e709-4f00-a7d3-c5a72c709ffa tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:50:30.664985 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-93930f17-e709-4f00-a7d3-c5a72c709ffa tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:50:30.665529 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-93930f17-e709-4f00-a7d3-c5a72c709ffa tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:50:30.693122 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-93930f17-e709-4f00-a7d3-c5a72c709ffa tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 89f2e52f-afcb-49bf-a39a-4b442a96eba8] Going to try to terminate instance {{(pid=121134) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:50:30.984776 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-93930f17-e709-4f00-a7d3-c5a72c709ffa tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "DELETE /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8" status: 204 len: 0 microversion: 2.20 time: 0.335175 Oct 19 03:50:30.986213 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3084/6233] 10.222.0.52 () {60 vars in 1280 bytes} [Wed Oct 19 03:50:30 2022] DELETE /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 19 03:50:30.994348 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-94e951e6-2156-41ee-93d2-bcdc79410361 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:50:30.994972 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-94e951e6-2156-41ee-93d2-bcdc79410361 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 89f2e52f-afcb-49bf-a39a-4b442a96eba8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:50:31.005919 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-94e951e6-2156-41ee-93d2-bcdc79410361 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:50:31.006829 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-94e951e6-2156-41ee-93d2-bcdc79410361 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:50:31.007336 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-94e951e6-2156-41ee-93d2-bcdc79410361 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:50:31.008477 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-94e951e6-2156-41ee-93d2-bcdc79410361 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:50:31.008937 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-94e951e6-2156-41ee-93d2-bcdc79410361 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:50:31.009389 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-94e951e6-2156-41ee-93d2-bcdc79410361 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:50:31.158778 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-94e951e6-2156-41ee-93d2-bcdc79410361 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:50:31.167209 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-94e951e6-2156-41ee-93d2-bcdc79410361 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:50:31.168761 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-94e951e6-2156-41ee-93d2-bcdc79410361 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:50:31.170143 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-94e951e6-2156-41ee-93d2-bcdc79410361 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8" status: 200 len: 1724 microversion: 2.20 time: 0.179849 Oct 19 03:50:31.170708 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3150/6234] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:50:30 2022] GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8 => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:50:32.197048 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-effdf924-217e-4080-91c5-09da3d95f2ed tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:50:32.197788 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-effdf924-217e-4080-91c5-09da3d95f2ed tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 89f2e52f-afcb-49bf-a39a-4b442a96eba8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:50:32.205342 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-effdf924-217e-4080-91c5-09da3d95f2ed tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:50:32.205896 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-effdf924-217e-4080-91c5-09da3d95f2ed tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:50:32.209733 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-effdf924-217e-4080-91c5-09da3d95f2ed tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:50:32.210825 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-effdf924-217e-4080-91c5-09da3d95f2ed tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:50:32.211310 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-effdf924-217e-4080-91c5-09da3d95f2ed tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:50:32.212024 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-effdf924-217e-4080-91c5-09da3d95f2ed tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:50:32.364963 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-effdf924-217e-4080-91c5-09da3d95f2ed tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:50:32.374895 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-effdf924-217e-4080-91c5-09da3d95f2ed tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:50:32.376627 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-effdf924-217e-4080-91c5-09da3d95f2ed tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:50:32.378019 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-effdf924-217e-4080-91c5-09da3d95f2ed tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8" status: 200 len: 1724 microversion: 2.20 time: 0.185500 Oct 19 03:50:32.396736 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3085/6235] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:50:32 2022] GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8 => generated 1724 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:50:33.405031 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f86ff927-e150-46cd-aa2a-fee344ac6f2e tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:50:33.405675 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f86ff927-e150-46cd-aa2a-fee344ac6f2e tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 89f2e52f-afcb-49bf-a39a-4b442a96eba8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:50:33.412786 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f86ff927-e150-46cd-aa2a-fee344ac6f2e tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:50:33.413618 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f86ff927-e150-46cd-aa2a-fee344ac6f2e tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:50:33.414379 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f86ff927-e150-46cd-aa2a-fee344ac6f2e tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:50:33.415554 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f86ff927-e150-46cd-aa2a-fee344ac6f2e tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:50:33.416252 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f86ff927-e150-46cd-aa2a-fee344ac6f2e tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:50:33.416758 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f86ff927-e150-46cd-aa2a-fee344ac6f2e tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:50:33.610498 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f86ff927-e150-46cd-aa2a-fee344ac6f2e tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:50:33.626316 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f86ff927-e150-46cd-aa2a-fee344ac6f2e tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:50:33.628045 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f86ff927-e150-46cd-aa2a-fee344ac6f2e tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:50:33.630065 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f86ff927-e150-46cd-aa2a-fee344ac6f2e tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8" status: 200 len: 1724 microversion: 2.20 time: 0.229861 Oct 19 03:50:33.640953 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3151/6236] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:50:33 2022] GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8 => generated 1724 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:50:34.403909 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-4fb95d0c-b96f-4e93-a4d0-15a60c7638e6 req-33e30315-4331-4e8f-882c-5c6ff5d33406 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89f2e52f-afcb-49bf-a39a-4b442a96eba8", "name": "network-vif-deleted", "tag": "916e68b3-4b4b-48a3-9beb-6bf56116fff0"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:50:34.420436 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-4fb95d0c-b96f-4e93-a4d0-15a60c7638e6 req-33e30315-4331-4e8f-882c-5c6ff5d33406 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:50:34.420943 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-4fb95d0c-b96f-4e93-a4d0-15a60c7638e6 req-33e30315-4331-4e8f-882c-5c6ff5d33406 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:50:34.421405 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-4fb95d0c-b96f-4e93-a4d0-15a60c7638e6 req-33e30315-4331-4e8f-882c-5c6ff5d33406 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:50:34.443353 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-4fb95d0c-b96f-4e93-a4d0-15a60c7638e6 req-33e30315-4331-4e8f-882c-5c6ff5d33406 service nova] Creating event network-vif-deleted:916e68b3-4b4b-48a3-9beb-6bf56116fff0 for instance 89f2e52f-afcb-49bf-a39a-4b442a96eba8 on n-h1-861333-8 Oct 19 03:50:34.451398 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-4fb95d0c-b96f-4e93-a4d0-15a60c7638e6 req-33e30315-4331-4e8f-882c-5c6ff5d33406 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077343 Oct 19 03:50:34.453315 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3086/6237] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:50:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:50:34.657016 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e65ecbaa-e350-4684-8a3a-dd1686b02040 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:50:34.657769 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e65ecbaa-e350-4684-8a3a-dd1686b02040 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 89f2e52f-afcb-49bf-a39a-4b442a96eba8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:50:34.674965 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e65ecbaa-e350-4684-8a3a-dd1686b02040 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:50:34.675638 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e65ecbaa-e350-4684-8a3a-dd1686b02040 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:50:34.676987 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e65ecbaa-e350-4684-8a3a-dd1686b02040 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:50:34.681002 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e65ecbaa-e350-4684-8a3a-dd1686b02040 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:50:34.682185 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e65ecbaa-e350-4684-8a3a-dd1686b02040 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:50:34.682879 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e65ecbaa-e350-4684-8a3a-dd1686b02040 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:50:34.769771 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-e65ecbaa-e350-4684-8a3a-dd1686b02040 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:50:34.783379 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-e65ecbaa-e350-4684-8a3a-dd1686b02040 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:50:34.789955 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-e65ecbaa-e350-4684-8a3a-dd1686b02040 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:50:34.791195 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e65ecbaa-e350-4684-8a3a-dd1686b02040 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8" status: 200 len: 1366 microversion: 2.20 time: 0.138316 Oct 19 03:50:34.791838 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3152/6238] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:50:34 2022] GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8 => generated 1366 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:50:35.818423 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4ae954f8-94d0-48d7-9991-09a81b70fc0f tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:50:35.819877 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4ae954f8-94d0-48d7-9991-09a81b70fc0f tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 89f2e52f-afcb-49bf-a39a-4b442a96eba8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:50:35.837222 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4ae954f8-94d0-48d7-9991-09a81b70fc0f tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:50:35.837840 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4ae954f8-94d0-48d7-9991-09a81b70fc0f tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:50:35.838398 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4ae954f8-94d0-48d7-9991-09a81b70fc0f tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:50:35.839172 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4ae954f8-94d0-48d7-9991-09a81b70fc0f tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:50:35.848177 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4ae954f8-94d0-48d7-9991-09a81b70fc0f tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:50:35.848980 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4ae954f8-94d0-48d7-9991-09a81b70fc0f tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:50:35.869360 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-4ae954f8-94d0-48d7-9991-09a81b70fc0f tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] HTTP exception thrown: Instance 89f2e52f-afcb-49bf-a39a-4b442a96eba8 could not be found. Oct 19 03:50:35.871443 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4ae954f8-94d0-48d7-9991-09a81b70fc0f tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Request method failure captured: Oct 19 03:50:35.871443 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8 HTTP/1.1 Oct 19 03:50:35.871443 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:50:35.871443 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:50:35.871443 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:50:35.871443 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:50:35.871443 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:50:35.871443 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:50:35.871443 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:50:35.871443 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:50:35.871443 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3Mj8Y9XZUqdAO7It2_JZfeGIxD8aLHMiOWUFfIXg2mA6_dl2bPpa0kOk0am9pPXP4oh6B6udK76F-90kFvdD17QuGVLTMnqVb2EpkTkWoVzrcHTsYKtJfL-nQKy4vPS1m2xj0L66liLV8wFyDhJKV4T3C-Uqz51OaZp5zeh1hnRxQY Oct 19 03:50:35.871443 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:50:35.871443 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:50:35.871443 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:50:35.871443 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:50:35.871443 n-d-861333-8 devstack@n-api.service[121134]: X-Openstack-Nova-Api-Version: 2.20 Oct 19 03:50:35.871443 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:50:35.871443 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:50:35.871443 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: c2dfa644c780498a9d9ab24938903dd7 Oct 19 03:50:35.871443 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1060931270 Oct 19 03:50:35.871443 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:50:35.871443 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:50:35.871443 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c2dfa644c780498a9d9ab24938903dd7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c2dfa644c780498a9d9ab24938903dd7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c2dfa644c780498a9d9ab24938903dd7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c2dfa644c780498a9d9ab24938903dd7", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:50:35.871443 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1060931270 Oct 19 03:50:35.871443 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: c2dfa644c780498a9d9ab24938903dd7 Oct 19 03:50:35.871443 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1060931270 Oct 19 03:50:35.871443 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-AttachVolumeShelveTestJSON-1060931270-project Oct 19 03:50:35.871443 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:50:35.871443 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:50:35.871443 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 43f8869bb2c44a1f814d5da9e5d1a39d Oct 19 03:50:35.871443 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1060931270-project Oct 19 03:50:35.871443 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:50:35.871443 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance 89f2e52f-afcb-49bf-a39a-4b442a96eba8 could not be found. Oct 19 03:50:35.871443 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '89f2e52f-afcb-49bf-a39a-4b442a96eba8'} Oct 19 03:50:35.871443 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:50:35.871443 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:50:35.871443 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:50:35.871443 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:50:35.871443 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:50:35.871443 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:50:35.871443 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:50:35.871443 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:50:35.871443 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:50:35.871443 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:50:35.871443 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89f2e52f-afcb-49bf-a39a-4b442a96eba8 could not be found. Oct 19 03:50:35.871443 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:50:35.871443 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:50:35.871443 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:50:35.871443 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:50:35.871443 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:50:35.871443 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:50:35.871443 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:50:35.871443 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:50:35.871443 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:50:35.871443 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:50:35.871443 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:50:35.871443 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:50:35.871443 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:50:35.871443 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:50:35.871443 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:50:35.871443 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:50:35.871443 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89f2e52f-afcb-49bf-a39a-4b442a96eba8 could not be found. Oct 19 03:50:35.871443 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:50:35.871443 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:50:35.879141 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:50:35.879141 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:50:35.879141 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:50:35.879141 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:50:35.879141 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:50:35.879141 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:50:35.879141 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89f2e52f-afcb-49bf-a39a-4b442a96eba8 could not be found. Oct 19 03:50:35.879141 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:50:35.879141 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4ae954f8-94d0-48d7-9991-09a81b70fc0f tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Returning 404 to user: Instance 89f2e52f-afcb-49bf-a39a-4b442a96eba8 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:50:35.879141 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4ae954f8-94d0-48d7-9991-09a81b70fc0f tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8" status: 404 len: 111 microversion: 2.20 time: 0.058664 Oct 19 03:50:35.879141 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3087/6239] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:50:35 2022] GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 19 03:50:35.885590 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0318cc3a-b87a-4597-ad1d-1d269605d80a tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '.version_select at 0x7fc130d0b4c0>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:50:35.891040 n-d-861333-8 devstack@n-api.service[121135]: ERROR oslo.messaging._drivers.impl_rabbit [None req-0318cc3a-b87a-4597-ad1d-1d269605d80a tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [466284c6-cbd7-4ef3-a024-7f40823a5c9c] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 19 03:50:36.898018 n-d-861333-8 devstack@n-api.service[121135]: INFO oslo.messaging._drivers.impl_rabbit [None req-0318cc3a-b87a-4597-ad1d-1d269605d80a tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [466284c6-cbd7-4ef3-a024-7f40823a5c9c] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 45112. Oct 19 03:50:37.001988 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0318cc3a-b87a-4597-ad1d-1d269605d80a tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2055193955" status: 204 len: 0 microversion: 2.20 time: 1.123612 Oct 19 03:50:37.004051 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3153/6240] 10.222.0.52 () {60 vars in 1262 bytes} [Wed Oct 19 03:50:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2055193955 => generated 0 bytes in 1126 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 19 03:50:37.926872 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-fdd4528b-8580-4021-8ea5-15ee1e63e04f tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Action: 'create', calling method: .version_select at 0x7fc131077790>, body: {"keypair": {"name": "tempest-keypair-1155833408", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBYm7Zm64Z+KvPJF/xB8vtv2NS3k0TTecgqT2U91I+qZFyrDHB3n6Ip5eY72Qop8g4M3V9sVXUe33FErujsygy6tkuFsieoFuG6RSCQtQ9p/Xx7LuTwHJCU9ZwBIi9sZ/g=="}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:50:37.945220 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-fdd4528b-8580-4021-8ea5-15ee1e63e04f tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Getting quotas for project c2dfa644c780498a9d9ab24938903dd7. Resources: {'key_pairs'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:50:37.951351 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-fdd4528b-8580-4021-8ea5-15ee1e63e04f tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Getting quotas for user 43f8869bb2c44a1f814d5da9e5d1a39d and project c2dfa644c780498a9d9ab24938903dd7. Resources: {'key_pairs'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:50:38.071196 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-fdd4528b-8580-4021-8ea5-15ee1e63e04f tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.148590 Oct 19 03:50:38.071815 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3088/6241] 10.222.0.52 () {62 vars in 1200 bytes} [Wed Oct 19 03:50:37 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 150 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 19 03:50:40.615035 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5e06858c-5010-4d46-bf08-01ea7a92cffe tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-421386967", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5a742c06-4978-4adc-92a1-26af959be6df"}], "security_groups": [{"name": "tempest-securitygroup--492290647"}], "key_name": "tempest-keypair-1155833408", "user_data": "}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:50:40.724966 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.network.neutron [None req-5e06858c-5010-4d46-bf08-01ea7a92cffe tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] validate_networks() for [('5a742c06-4978-4adc-92a1-26af959be6df', None, None, None, None, None)] {{(pid=121135) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:50:41.433460 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-5e06858c-5010-4d46-bf08-01ea7a92cffe tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Flavor limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:50:41.433862 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-5e06858c-5010-4d46-bf08-01ea7a92cffe tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Image limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:50:41.434347 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-5e06858c-5010-4d46-bf08-01ea7a92cffe tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Flavor pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:50:41.434862 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-5e06858c-5010-4d46-bf08-01ea7a92cffe tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Image pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:50:41.435320 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-5e06858c-5010-4d46-bf08-01ea7a92cffe tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:50:41.445680 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5e06858c-5010-4d46-bf08-01ea7a92cffe tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:50:41.446176 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5e06858c-5010-4d46-bf08-01ea7a92cffe tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:50:41.446621 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5e06858c-5010-4d46-bf08-01ea7a92cffe tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:50:41.447376 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5e06858c-5010-4d46-bf08-01ea7a92cffe tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:50:41.447843 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5e06858c-5010-4d46-bf08-01ea7a92cffe tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:50:41.448277 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5e06858c-5010-4d46-bf08-01ea7a92cffe tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:50:41.466582 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-5e06858c-5010-4d46-bf08-01ea7a92cffe tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Getting quotas for project c2dfa644c780498a9d9ab24938903dd7. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:50:41.472473 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-5e06858c-5010-4d46-bf08-01ea7a92cffe tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Getting quotas for user 43f8869bb2c44a1f814d5da9e5d1a39d and project c2dfa644c780498a9d9ab24938903dd7. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:50:41.486655 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-5e06858c-5010-4d46-bf08-01ea7a92cffe tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Going to run 1 instances... {{(pid=121135) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:50:41.489574 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-5e06858c-5010-4d46-bf08-01ea7a92cffe tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 1eeec04f-d94e-4625-ab65-6d227a640f2f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121135) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:50:41.617002 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5e06858c-5010-4d46-bf08-01ea7a92cffe tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.007348 Oct 19 03:50:41.617826 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3154/6242] 10.222.0.52 () {62 vars in 1188 bytes} [Wed Oct 19 03:50:40 2022] POST /compute/v2.1/servers => generated 401 bytes in 1009 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 19 03:50:41.629218 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1c6057c5-0533-47fd-95e8-52eab5a3431e tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:50:41.629872 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1c6057c5-0533-47fd-95e8-52eab5a3431e tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 1eeec04f-d94e-4625-ab65-6d227a640f2f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:50:41.700881 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-1c6057c5-0533-47fd-95e8-52eab5a3431e tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:50:41.716358 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-1c6057c5-0533-47fd-95e8-52eab5a3431e tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:50:41.717832 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-1c6057c5-0533-47fd-95e8-52eab5a3431e tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:50:41.718959 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1c6057c5-0533-47fd-95e8-52eab5a3431e tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f" status: 200 len: 1281 microversion: 2.20 time: 0.093884 Oct 19 03:50:41.719531 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3089/6243] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:50:41 2022] GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f => generated 1281 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:50:41.908142 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a880fc9b-288d-4d87-a4f4-d38fcb0b2ca3 tempest-TestNetworkAdvancedServerOps-173376372 tempest-TestNetworkAdvancedServerOps-173376372-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:50:41.908142 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a880fc9b-288d-4d87-a4f4-d38fcb0b2ca3 tempest-TestNetworkAdvancedServerOps-173376372 tempest-TestNetworkAdvancedServerOps-173376372-project-admin] [instance: d7223d39-2ef0-443b-989b-87c1fe11d2c1] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:50:41.914728 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a880fc9b-288d-4d87-a4f4-d38fcb0b2ca3 tempest-TestNetworkAdvancedServerOps-173376372 tempest-TestNetworkAdvancedServerOps-173376372-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:50:41.915860 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a880fc9b-288d-4d87-a4f4-d38fcb0b2ca3 tempest-TestNetworkAdvancedServerOps-173376372 tempest-TestNetworkAdvancedServerOps-173376372-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:50:41.916481 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a880fc9b-288d-4d87-a4f4-d38fcb0b2ca3 tempest-TestNetworkAdvancedServerOps-173376372 tempest-TestNetworkAdvancedServerOps-173376372-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:50:41.917544 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a880fc9b-288d-4d87-a4f4-d38fcb0b2ca3 tempest-TestNetworkAdvancedServerOps-173376372 tempest-TestNetworkAdvancedServerOps-173376372-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:50:41.918309 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a880fc9b-288d-4d87-a4f4-d38fcb0b2ca3 tempest-TestNetworkAdvancedServerOps-173376372 tempest-TestNetworkAdvancedServerOps-173376372-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:50:41.918926 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a880fc9b-288d-4d87-a4f4-d38fcb0b2ca3 tempest-TestNetworkAdvancedServerOps-173376372 tempest-TestNetworkAdvancedServerOps-173376372-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:50:42.090368 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a880fc9b-288d-4d87-a4f4-d38fcb0b2ca3 tempest-TestNetworkAdvancedServerOps-173376372 tempest-TestNetworkAdvancedServerOps-173376372-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d7223d39-2ef0-443b-989b-87c1fe11d2c1" status: 200 len: 1835 microversion: 2.1 time: 0.191751 Oct 19 03:50:42.091586 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3155/6244] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:50:41 2022] GET /compute/v2.1/servers/d7223d39-2ef0-443b-989b-87c1fe11d2c1 => generated 1835 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:50:42.745068 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8c70ba52-7d0f-497c-acba-280c7c870006 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:50:42.746343 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8c70ba52-7d0f-497c-acba-280c7c870006 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 1eeec04f-d94e-4625-ab65-6d227a640f2f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:50:42.773332 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8c70ba52-7d0f-497c-acba-280c7c870006 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:50:42.776440 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8c70ba52-7d0f-497c-acba-280c7c870006 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:50:42.776440 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8c70ba52-7d0f-497c-acba-280c7c870006 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:50:42.776440 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8c70ba52-7d0f-497c-acba-280c7c870006 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:50:42.776440 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8c70ba52-7d0f-497c-acba-280c7c870006 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:50:42.776440 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8c70ba52-7d0f-497c-acba-280c7c870006 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:50:42.847262 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8c70ba52-7d0f-497c-acba-280c7c870006 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:50:42.860821 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8c70ba52-7d0f-497c-acba-280c7c870006 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:50:42.865966 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8c70ba52-7d0f-497c-acba-280c7c870006 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:50:42.871456 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8c70ba52-7d0f-497c-acba-280c7c870006 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f" status: 200 len: 1285 microversion: 2.20 time: 0.126336 Oct 19 03:50:42.879063 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3090/6245] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:50:42 2022] GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f => generated 1285 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:50:43.581403 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-598c061b-61f8-4daf-abdd-a56030603f68 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:50:43.584144 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-598c061b-61f8-4daf-abdd-a56030603f68 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: d7223d39-2ef0-443b-989b-87c1fe11d2c1] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:50:43.587103 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-7f795dda-04f8-49a0-92af-e05a2ede93aa req-a596be8d-4ac0-407a-ba13-d48aea11378f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7223d39-2ef0-443b-989b-87c1fe11d2c1", "tag": "f1a51aab-0c40-4b41-ae4e-760590333068"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:50:43.598593 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-7f795dda-04f8-49a0-92af-e05a2ede93aa req-a596be8d-4ac0-407a-ba13-d48aea11378f service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:50:43.599318 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-598c061b-61f8-4daf-abdd-a56030603f68 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:50:43.599874 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-598c061b-61f8-4daf-abdd-a56030603f68 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:50:43.600342 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-598c061b-61f8-4daf-abdd-a56030603f68 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:50:43.600569 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-7f795dda-04f8-49a0-92af-e05a2ede93aa req-a596be8d-4ac0-407a-ba13-d48aea11378f service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:50:43.601206 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-7f795dda-04f8-49a0-92af-e05a2ede93aa req-a596be8d-4ac0-407a-ba13-d48aea11378f service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:50:43.601325 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-598c061b-61f8-4daf-abdd-a56030603f68 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:50:43.601817 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-598c061b-61f8-4daf-abdd-a56030603f68 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:50:43.602258 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-598c061b-61f8-4daf-abdd-a56030603f68 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:50:43.615057 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-7f795dda-04f8-49a0-92af-e05a2ede93aa req-a596be8d-4ac0-407a-ba13-d48aea11378f service nova] Creating event network-changed:f1a51aab-0c40-4b41-ae4e-760590333068 for instance d7223d39-2ef0-443b-989b-87c1fe11d2c1 on n-h1-861333-8 Oct 19 03:50:43.621243 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-7f795dda-04f8-49a0-92af-e05a2ede93aa req-a596be8d-4ac0-407a-ba13-d48aea11378f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038269 Oct 19 03:50:43.622240 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3091/6246] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:50:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:50:43.646691 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-598c061b-61f8-4daf-abdd-a56030603f68 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: d7223d39-2ef0-443b-989b-87c1fe11d2c1] Going to try to terminate instance {{(pid=121135) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:50:43.895734 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-73d48604-4d7d-4593-be74-b0cd2dbb9c8f tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:50:43.896441 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-73d48604-4d7d-4593-be74-b0cd2dbb9c8f tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 1eeec04f-d94e-4625-ab65-6d227a640f2f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:50:43.914149 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-73d48604-4d7d-4593-be74-b0cd2dbb9c8f tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:50:43.918307 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-73d48604-4d7d-4593-be74-b0cd2dbb9c8f tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:50:43.918307 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-73d48604-4d7d-4593-be74-b0cd2dbb9c8f tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:50:43.918307 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-73d48604-4d7d-4593-be74-b0cd2dbb9c8f tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:50:43.918307 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-73d48604-4d7d-4593-be74-b0cd2dbb9c8f tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:50:43.918307 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-73d48604-4d7d-4593-be74-b0cd2dbb9c8f tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:50:44.013777 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-598c061b-61f8-4daf-abdd-a56030603f68 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "DELETE /compute/v2.1/servers/d7223d39-2ef0-443b-989b-87c1fe11d2c1" status: 204 len: 0 microversion: 2.1 time: 0.436735 Oct 19 03:50:44.014950 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3156/6247] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:50:43 2022] DELETE /compute/v2.1/servers/d7223d39-2ef0-443b-989b-87c1fe11d2c1 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:50:44.024659 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-412d96b0-d83c-4f96-92ad-93d38900ac29 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:50:44.025758 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-412d96b0-d83c-4f96-92ad-93d38900ac29 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: d7223d39-2ef0-443b-989b-87c1fe11d2c1] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:50:44.041749 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-412d96b0-d83c-4f96-92ad-93d38900ac29 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:50:44.045097 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-412d96b0-d83c-4f96-92ad-93d38900ac29 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:50:44.045806 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-412d96b0-d83c-4f96-92ad-93d38900ac29 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:50:44.047839 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-412d96b0-d83c-4f96-92ad-93d38900ac29 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:50:44.049841 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-412d96b0-d83c-4f96-92ad-93d38900ac29 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:50:44.052607 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-412d96b0-d83c-4f96-92ad-93d38900ac29 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:50:44.054102 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-73d48604-4d7d-4593-be74-b0cd2dbb9c8f tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:50:44.076800 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-73d48604-4d7d-4593-be74-b0cd2dbb9c8f tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:50:44.080974 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-73d48604-4d7d-4593-be74-b0cd2dbb9c8f tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:50:44.083185 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-73d48604-4d7d-4593-be74-b0cd2dbb9c8f tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f" status: 200 len: 1333 microversion: 2.20 time: 0.192379 Oct 19 03:50:44.083933 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3092/6248] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:50:43 2022] GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f => generated 1333 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:50:44.326866 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-412d96b0-d83c-4f96-92ad-93d38900ac29 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:50:44.337290 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-412d96b0-d83c-4f96-92ad-93d38900ac29 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/d7223d39-2ef0-443b-989b-87c1fe11d2c1" status: 200 len: 1690 microversion: 2.1 time: 0.317956 Oct 19 03:50:44.350127 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3157/6249] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:50:44 2022] GET /compute/v2.1/servers/d7223d39-2ef0-443b-989b-87c1fe11d2c1 => generated 1690 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:50:45.109782 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-064c05e6-2257-4f23-a613-8d4fb315d5f6 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:50:45.111773 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-064c05e6-2257-4f23-a613-8d4fb315d5f6 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 1eeec04f-d94e-4625-ab65-6d227a640f2f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:50:45.126539 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-064c05e6-2257-4f23-a613-8d4fb315d5f6 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:50:45.126539 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-064c05e6-2257-4f23-a613-8d4fb315d5f6 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:50:45.126539 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-064c05e6-2257-4f23-a613-8d4fb315d5f6 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:50:45.126539 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-064c05e6-2257-4f23-a613-8d4fb315d5f6 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:50:45.126539 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-064c05e6-2257-4f23-a613-8d4fb315d5f6 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:50:45.126539 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-064c05e6-2257-4f23-a613-8d4fb315d5f6 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:50:45.375138 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a4311d11-36a4-458c-8976-069d200332f0 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:50:45.375834 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a4311d11-36a4-458c-8976-069d200332f0 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: d7223d39-2ef0-443b-989b-87c1fe11d2c1] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:50:45.388937 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a4311d11-36a4-458c-8976-069d200332f0 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:50:45.389677 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a4311d11-36a4-458c-8976-069d200332f0 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:50:45.390326 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a4311d11-36a4-458c-8976-069d200332f0 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:50:45.391232 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a4311d11-36a4-458c-8976-069d200332f0 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:50:45.396481 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a4311d11-36a4-458c-8976-069d200332f0 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:50:45.397185 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a4311d11-36a4-458c-8976-069d200332f0 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:50:45.402884 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-064c05e6-2257-4f23-a613-8d4fb315d5f6 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:50:45.417241 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-064c05e6-2257-4f23-a613-8d4fb315d5f6 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:50:45.422636 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-064c05e6-2257-4f23-a613-8d4fb315d5f6 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:50:45.432695 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-064c05e6-2257-4f23-a613-8d4fb315d5f6 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f" status: 200 len: 1406 microversion: 2.20 time: 0.326800 Oct 19 03:50:45.437486 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3093/6250] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:50:45 2022] GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f => generated 1406 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:50:45.847870 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a4311d11-36a4-458c-8976-069d200332f0 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:50:45.864737 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a4311d11-36a4-458c-8976-069d200332f0 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/d7223d39-2ef0-443b-989b-87c1fe11d2c1" status: 200 len: 1690 microversion: 2.1 time: 0.494385 Oct 19 03:50:45.866487 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3158/6251] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:50:45 2022] GET /compute/v2.1/servers/d7223d39-2ef0-443b-989b-87c1fe11d2c1 => generated 1690 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:50:46.468927 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-56d61747-ebce-4e1b-9950-eeec6242aac0 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:50:46.470623 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-56d61747-ebce-4e1b-9950-eeec6242aac0 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 1eeec04f-d94e-4625-ab65-6d227a640f2f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:50:46.480706 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-56d61747-ebce-4e1b-9950-eeec6242aac0 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:50:46.481557 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-56d61747-ebce-4e1b-9950-eeec6242aac0 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:50:46.483272 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-56d61747-ebce-4e1b-9950-eeec6242aac0 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:50:46.486280 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-56d61747-ebce-4e1b-9950-eeec6242aac0 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:50:46.487062 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-56d61747-ebce-4e1b-9950-eeec6242aac0 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:50:46.487602 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-56d61747-ebce-4e1b-9950-eeec6242aac0 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:50:46.685395 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-fd2d70e0-eaa0-428e-b288-31b6c8b0aa7f req-8d4067b2-d2f1-46aa-bfbb-0ca245a2efd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7223d39-2ef0-443b-989b-87c1fe11d2c1", "name": "network-vif-deleted", "tag": "f1a51aab-0c40-4b41-ae4e-760590333068"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:50:46.696470 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-fd2d70e0-eaa0-428e-b288-31b6c8b0aa7f req-8d4067b2-d2f1-46aa-bfbb-0ca245a2efd3 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:50:46.697191 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-fd2d70e0-eaa0-428e-b288-31b6c8b0aa7f req-8d4067b2-d2f1-46aa-bfbb-0ca245a2efd3 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:50:46.697920 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-fd2d70e0-eaa0-428e-b288-31b6c8b0aa7f req-8d4067b2-d2f1-46aa-bfbb-0ca245a2efd3 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:50:46.712581 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-fd2d70e0-eaa0-428e-b288-31b6c8b0aa7f req-8d4067b2-d2f1-46aa-bfbb-0ca245a2efd3 service nova] Creating event network-vif-deleted:f1a51aab-0c40-4b41-ae4e-760590333068 for instance d7223d39-2ef0-443b-989b-87c1fe11d2c1 on n-h1-861333-8 Oct 19 03:50:46.716645 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-fd2d70e0-eaa0-428e-b288-31b6c8b0aa7f req-8d4067b2-d2f1-46aa-bfbb-0ca245a2efd3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035085 Oct 19 03:50:46.717862 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3159/6252] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:50:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:50:46.814845 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-56d61747-ebce-4e1b-9950-eeec6242aac0 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:50:46.826820 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-56d61747-ebce-4e1b-9950-eeec6242aac0 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:50:46.828658 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-56d61747-ebce-4e1b-9950-eeec6242aac0 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:50:46.830931 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-56d61747-ebce-4e1b-9950-eeec6242aac0 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f" status: 200 len: 1406 microversion: 2.20 time: 0.369081 Oct 19 03:50:46.831504 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3094/6253] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:50:46 2022] GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f => generated 1406 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:50:46.869363 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-fe420554-af7d-40ae-92b7-a51468e7102d req-d66d5720-47c4-44f2-86ee-60aaaa80504e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1eeec04f-d94e-4625-ab65-6d227a640f2f", "tag": "9487bc37-2fe4-4fbc-914a-50a09e00b655"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:50:46.881789 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-fe420554-af7d-40ae-92b7-a51468e7102d req-d66d5720-47c4-44f2-86ee-60aaaa80504e service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:50:46.882735 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-fe420554-af7d-40ae-92b7-a51468e7102d req-d66d5720-47c4-44f2-86ee-60aaaa80504e service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:50:46.883398 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-fe420554-af7d-40ae-92b7-a51468e7102d req-d66d5720-47c4-44f2-86ee-60aaaa80504e service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:50:46.901679 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4e927d63-6316-44de-a265-6ac7c63048d7 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:50:46.902300 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4e927d63-6316-44de-a265-6ac7c63048d7 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: d7223d39-2ef0-443b-989b-87c1fe11d2c1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:50:46.917817 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4e927d63-6316-44de-a265-6ac7c63048d7 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:50:46.925566 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4e927d63-6316-44de-a265-6ac7c63048d7 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:50:46.934233 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-fe420554-af7d-40ae-92b7-a51468e7102d req-d66d5720-47c4-44f2-86ee-60aaaa80504e service nova] Creating event network-changed:9487bc37-2fe4-4fbc-914a-50a09e00b655 for instance 1eeec04f-d94e-4625-ab65-6d227a640f2f on n-h2-861333-8 Oct 19 03:50:46.934389 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4e927d63-6316-44de-a265-6ac7c63048d7 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:50:46.935024 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4e927d63-6316-44de-a265-6ac7c63048d7 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:50:46.935506 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4e927d63-6316-44de-a265-6ac7c63048d7 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:50:46.935940 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4e927d63-6316-44de-a265-6ac7c63048d7 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:50:46.957809 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-fe420554-af7d-40ae-92b7-a51468e7102d req-d66d5720-47c4-44f2-86ee-60aaaa80504e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093436 Oct 19 03:50:46.959064 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3160/6254] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:50:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:50:47.100884 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-4e927d63-6316-44de-a265-6ac7c63048d7 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:50:47.109400 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4e927d63-6316-44de-a265-6ac7c63048d7 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/d7223d39-2ef0-443b-989b-87c1fe11d2c1" status: 200 len: 1352 microversion: 2.1 time: 0.212836 Oct 19 03:50:47.110207 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3095/6255] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:50:46 2022] GET /compute/v2.1/servers/d7223d39-2ef0-443b-989b-87c1fe11d2c1 => generated 1352 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:50:47.858049 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4c3f5592-9bab-4aae-bbca-40905d0b5943 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:50:47.859529 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4c3f5592-9bab-4aae-bbca-40905d0b5943 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 1eeec04f-d94e-4625-ab65-6d227a640f2f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:50:47.869166 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4c3f5592-9bab-4aae-bbca-40905d0b5943 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:50:47.870021 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4c3f5592-9bab-4aae-bbca-40905d0b5943 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:50:47.870547 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4c3f5592-9bab-4aae-bbca-40905d0b5943 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:50:47.871485 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4c3f5592-9bab-4aae-bbca-40905d0b5943 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:50:47.872150 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4c3f5592-9bab-4aae-bbca-40905d0b5943 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:50:47.872777 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4c3f5592-9bab-4aae-bbca-40905d0b5943 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:50:48.028137 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4c3f5592-9bab-4aae-bbca-40905d0b5943 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:50:48.037268 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4c3f5592-9bab-4aae-bbca-40905d0b5943 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:50:48.039088 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4c3f5592-9bab-4aae-bbca-40905d0b5943 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:50:48.040359 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4c3f5592-9bab-4aae-bbca-40905d0b5943 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f" status: 200 len: 1406 microversion: 2.20 time: 0.186826 Oct 19 03:50:48.041054 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3161/6256] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:50:47 2022] GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f => generated 1406 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:50:48.132823 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-36857759-659b-4b21-b2be-68a3fd147b67 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:50:48.133620 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-36857759-659b-4b21-b2be-68a3fd147b67 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: d7223d39-2ef0-443b-989b-87c1fe11d2c1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:50:48.141087 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-36857759-659b-4b21-b2be-68a3fd147b67 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:50:48.141613 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-36857759-659b-4b21-b2be-68a3fd147b67 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:50:48.142064 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-36857759-659b-4b21-b2be-68a3fd147b67 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:50:48.142786 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-36857759-659b-4b21-b2be-68a3fd147b67 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:50:48.143242 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-36857759-659b-4b21-b2be-68a3fd147b67 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:50:48.143707 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-36857759-659b-4b21-b2be-68a3fd147b67 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:50:48.161457 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-36857759-659b-4b21-b2be-68a3fd147b67 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] HTTP exception thrown: Instance d7223d39-2ef0-443b-989b-87c1fe11d2c1 could not be found. Oct 19 03:50:48.163149 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-36857759-659b-4b21-b2be-68a3fd147b67 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Request method failure captured: Oct 19 03:50:48.163149 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/d7223d39-2ef0-443b-989b-87c1fe11d2c1 HTTP/1.1 Oct 19 03:50:48.163149 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:50:48.163149 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:50:48.163149 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:50:48.163149 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:50:48.163149 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:50:48.163149 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:50:48.163149 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:50:48.163149 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:50:48.163149 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3NwoLvkX1ASv7BWG8n03-wyV-PHrk4Zzw5wyutTUqINpvyr9PXOVTlUcdwMhf8Q5ZkPK7itp1Hf4ku46LTSLnpDmtKa_b_RS1LRUWqOcdFLvZqgZoywIxoBs14di1P9oAs26SP9if5E5-uZy9hDECUpYA7EORF5pEKdwwte-cPfVLw Oct 19 03:50:48.163149 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:50:48.163149 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:50:48.163149 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:50:48.163149 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:50:48.163149 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:50:48.163149 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:50:48.163149 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: fe972f4874424bf89e9ed0bfcb69f050 Oct 19 03:50:48.163149 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-374576753 Oct 19 03:50:48.163149 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:50:48.163149 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:50:48.163149 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/fe972f4874424bf89e9ed0bfcb69f050"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe972f4874424bf89e9ed0bfcb69f050"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe972f4874424bf89e9ed0bfcb69f050"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_fe972f4874424bf89e9ed0bfcb69f050", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:50:48.163149 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-TestNetworkAdvancedServerOps-374576753 Oct 19 03:50:48.163149 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: fe972f4874424bf89e9ed0bfcb69f050 Oct 19 03:50:48.163149 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-374576753 Oct 19 03:50:48.163149 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-TestNetworkAdvancedServerOps-374576753-project Oct 19 03:50:48.163149 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:50:48.163149 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:50:48.163149 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: b63367855cc9468f8512a87e89b8606d Oct 19 03:50:48.163149 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-TestNetworkAdvancedServerOps-374576753-project Oct 19 03:50:48.163149 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:50:48.163149 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance d7223d39-2ef0-443b-989b-87c1fe11d2c1 could not be found. Oct 19 03:50:48.163149 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': 'd7223d39-2ef0-443b-989b-87c1fe11d2c1'} Oct 19 03:50:48.163149 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:50:48.163149 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:50:48.163149 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:50:48.163149 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:50:48.163149 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:50:48.163149 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:50:48.163149 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:50:48.163149 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:50:48.163149 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:50:48.163149 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:50:48.163149 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7223d39-2ef0-443b-989b-87c1fe11d2c1 could not be found. Oct 19 03:50:48.163149 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:50:48.163149 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:50:48.163149 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:50:48.163149 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:50:48.163149 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:50:48.163149 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:50:48.163149 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:50:48.163149 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:50:48.163149 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:50:48.163149 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:50:48.163149 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:50:48.163149 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:50:48.163149 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:50:48.163149 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:50:48.163149 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:50:48.163149 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:50:48.163149 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7223d39-2ef0-443b-989b-87c1fe11d2c1 could not be found. Oct 19 03:50:48.163149 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:50:48.163149 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:50:48.167557 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:50:48.167557 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:50:48.167557 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:50:48.167557 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:50:48.167557 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:50:48.167557 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:50:48.167557 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7223d39-2ef0-443b-989b-87c1fe11d2c1 could not be found. Oct 19 03:50:48.167557 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:50:48.167557 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-36857759-659b-4b21-b2be-68a3fd147b67 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Returning 404 to user: Instance d7223d39-2ef0-443b-989b-87c1fe11d2c1 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:50:48.167557 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-36857759-659b-4b21-b2be-68a3fd147b67 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/d7223d39-2ef0-443b-989b-87c1fe11d2c1" status: 404 len: 111 microversion: 2.1 time: 0.036244 Oct 19 03:50:48.169851 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3096/6257] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:50:48 2022] GET /compute/v2.1/servers/d7223d39-2ef0-443b-989b-87c1fe11d2c1 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:50:49.067930 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a94e3e97-a912-4ffe-ba5e-37bb3826248a tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:50:49.069232 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a94e3e97-a912-4ffe-ba5e-37bb3826248a tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 1eeec04f-d94e-4625-ab65-6d227a640f2f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:50:49.086890 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a94e3e97-a912-4ffe-ba5e-37bb3826248a tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:50:49.086890 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a94e3e97-a912-4ffe-ba5e-37bb3826248a tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:50:49.086890 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a94e3e97-a912-4ffe-ba5e-37bb3826248a tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:50:49.086890 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a94e3e97-a912-4ffe-ba5e-37bb3826248a tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:50:49.086890 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a94e3e97-a912-4ffe-ba5e-37bb3826248a tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:50:49.086890 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a94e3e97-a912-4ffe-ba5e-37bb3826248a tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:50:49.104832 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:50:49.308139 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a94e3e97-a912-4ffe-ba5e-37bb3826248a tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:50:49.323218 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a94e3e97-a912-4ffe-ba5e-37bb3826248a tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:50:49.324867 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a94e3e97-a912-4ffe-ba5e-37bb3826248a tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:50:49.333329 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a94e3e97-a912-4ffe-ba5e-37bb3826248a tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f" status: 200 len: 1406 microversion: 2.20 time: 0.269903 Oct 19 03:50:49.334086 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3162/6258] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:50:49 2022] GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f => generated 1406 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:50:50.362108 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2d7965b4-51c1-4bb0-afec-753878868be3 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:50:50.376340 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2d7965b4-51c1-4bb0-afec-753878868be3 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 1eeec04f-d94e-4625-ab65-6d227a640f2f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:50:50.408915 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2d7965b4-51c1-4bb0-afec-753878868be3 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:50:50.409728 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2d7965b4-51c1-4bb0-afec-753878868be3 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:50:50.410319 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2d7965b4-51c1-4bb0-afec-753878868be3 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:50:50.411949 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2d7965b4-51c1-4bb0-afec-753878868be3 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:50:50.412642 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2d7965b4-51c1-4bb0-afec-753878868be3 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:50:50.413241 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2d7965b4-51c1-4bb0-afec-753878868be3 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:50:50.670075 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-2d7965b4-51c1-4bb0-afec-753878868be3 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:50:50.682471 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-2d7965b4-51c1-4bb0-afec-753878868be3 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:50:50.686318 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-2d7965b4-51c1-4bb0-afec-753878868be3 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:50:50.686318 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2d7965b4-51c1-4bb0-afec-753878868be3 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f" status: 200 len: 1406 microversion: 2.20 time: 0.327537 Oct 19 03:50:50.686318 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3097/6259] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:50:50 2022] GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f => generated 1406 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:50:51.713153 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-22f7d36d-c03c-4372-a77e-04c436236bcf tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:50:51.717087 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-22f7d36d-c03c-4372-a77e-04c436236bcf tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 1eeec04f-d94e-4625-ab65-6d227a640f2f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:50:51.720023 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:50:51.720707 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=6 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:50:51.721354 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=56,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:50:51.727407 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-22f7d36d-c03c-4372-a77e-04c436236bcf tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:50:51.727911 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-22f7d36d-c03c-4372-a77e-04c436236bcf tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:50:51.728353 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-22f7d36d-c03c-4372-a77e-04c436236bcf tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:50:51.729158 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-22f7d36d-c03c-4372-a77e-04c436236bcf tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:50:51.729647 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-22f7d36d-c03c-4372-a77e-04c436236bcf tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:50:51.730142 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-22f7d36d-c03c-4372-a77e-04c436236bcf tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:50:51.908586 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-22f7d36d-c03c-4372-a77e-04c436236bcf tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:50:51.917444 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-22f7d36d-c03c-4372-a77e-04c436236bcf tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:50:51.919113 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-22f7d36d-c03c-4372-a77e-04c436236bcf tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:50:51.923720 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-22f7d36d-c03c-4372-a77e-04c436236bcf tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f" status: 200 len: 1406 microversion: 2.20 time: 0.214954 Oct 19 03:50:51.924347 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3163/6260] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:50:51 2022] GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f => generated 1406 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:50:52.952482 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-47bd39c1-781e-4516-9c01-174e9ebdfc7f tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:50:52.953441 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-47bd39c1-781e-4516-9c01-174e9ebdfc7f tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 1eeec04f-d94e-4625-ab65-6d227a640f2f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:50:52.957323 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=6 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:50:52.973996 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-f28a2b61-ab22-4b72-abc9-c146db9e6d2f req-0bb998ef-6525-46d3-b12e-c62f9911dabc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1eeec04f-d94e-4625-ab65-6d227a640f2f", "name": "network-vif-plugged", "status": "completed", "tag": "9487bc37-2fe4-4fbc-914a-50a09e00b655"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:50:52.983321 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-47bd39c1-781e-4516-9c01-174e9ebdfc7f tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:50:52.983824 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-47bd39c1-781e-4516-9c01-174e9ebdfc7f tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:50:52.984259 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-47bd39c1-781e-4516-9c01-174e9ebdfc7f tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:50:52.984973 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-47bd39c1-781e-4516-9c01-174e9ebdfc7f tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:50:52.989503 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-47bd39c1-781e-4516-9c01-174e9ebdfc7f tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:50:52.990514 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-47bd39c1-781e-4516-9c01-174e9ebdfc7f tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:50:52.995922 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-f28a2b61-ab22-4b72-abc9-c146db9e6d2f req-0bb998ef-6525-46d3-b12e-c62f9911dabc service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:50:52.996747 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-f28a2b61-ab22-4b72-abc9-c146db9e6d2f req-0bb998ef-6525-46d3-b12e-c62f9911dabc service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:50:52.997194 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-f28a2b61-ab22-4b72-abc9-c146db9e6d2f req-0bb998ef-6525-46d3-b12e-c62f9911dabc service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:50:53.028409 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-f28a2b61-ab22-4b72-abc9-c146db9e6d2f req-0bb998ef-6525-46d3-b12e-c62f9911dabc service nova] Creating event network-vif-plugged:9487bc37-2fe4-4fbc-914a-50a09e00b655 for instance 1eeec04f-d94e-4625-ab65-6d227a640f2f on n-h2-861333-8 Oct 19 03:50:53.038771 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-f28a2b61-ab22-4b72-abc9-c146db9e6d2f req-0bb998ef-6525-46d3-b12e-c62f9911dabc service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071169 Oct 19 03:50:53.039381 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3164/6261] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:50:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:50:53.081116 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-227cc64c-c618-4832-9b73-5b7e98035908 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '.version_select at 0x7fc130d0b670>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:50:53.180745 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-227cc64c-c618-4832-9b73-5b7e98035908 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2014040594" status: 202 len: 0 microversion: 2.1 time: 0.103760 Oct 19 03:50:53.181646 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3165/6262] 10.222.0.52 () {58 vars in 1284 bytes} [Wed Oct 19 03:50:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2014040594 => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 19 03:50:53.229984 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6d766adf-1570-4c69-8baf-d0f98a047251 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Action: 'create', calling method: .version_select at 0x7fc134f19670>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-354532", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLAPs8ssJEB9xVJVbQerNLLqmJSx/9cOJomN1Op20e6J40HA/VjTaB90yKgQngllYnlGh4xspa1jCVZ9j48tYdsfRtVdxS3jSfGgomEW4PTeNEnABoRyVz8oxwc7/duLyw=="}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:50:53.255252 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-6d766adf-1570-4c69-8baf-d0f98a047251 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Getting quotas for project fe972f4874424bf89e9ed0bfcb69f050. Resources: {'key_pairs'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:50:53.264010 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-6d766adf-1570-4c69-8baf-d0f98a047251 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Getting quotas for user b63367855cc9468f8512a87e89b8606d and project fe972f4874424bf89e9ed0bfcb69f050. Resources: {'key_pairs'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:50:53.316693 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-47bd39c1-781e-4516-9c01-174e9ebdfc7f tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:50:53.329651 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-47bd39c1-781e-4516-9c01-174e9ebdfc7f tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:50:53.331376 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-47bd39c1-781e-4516-9c01-174e9ebdfc7f tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:50:53.333348 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-47bd39c1-781e-4516-9c01-174e9ebdfc7f tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f" status: 200 len: 1406 microversion: 2.20 time: 0.385667 Oct 19 03:50:53.334194 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3098/6263] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:50:52 2022] GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f => generated 1406 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:50:53.349946 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6d766adf-1570-4c69-8baf-d0f98a047251 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.124213 Oct 19 03:50:53.358784 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3166/6264] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Oct 19 03:50:53 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:50:54.369539 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1833e756-5e9e-43fe-9766-c74f07f861b8 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:50:54.372300 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1833e756-5e9e-43fe-9766-c74f07f861b8 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 1eeec04f-d94e-4625-ab65-6d227a640f2f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:50:54.408370 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1833e756-5e9e-43fe-9766-c74f07f861b8 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:50:54.409051 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1833e756-5e9e-43fe-9766-c74f07f861b8 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:50:54.413416 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1833e756-5e9e-43fe-9766-c74f07f861b8 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:50:54.413416 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1833e756-5e9e-43fe-9766-c74f07f861b8 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:50:54.413416 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1833e756-5e9e-43fe-9766-c74f07f861b8 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:50:54.413416 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1833e756-5e9e-43fe-9766-c74f07f861b8 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:50:54.437064 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:50:54.639933 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-1833e756-5e9e-43fe-9766-c74f07f861b8 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:50:54.648957 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-1833e756-5e9e-43fe-9766-c74f07f861b8 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:50:54.650801 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-1833e756-5e9e-43fe-9766-c74f07f861b8 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:50:54.652008 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1833e756-5e9e-43fe-9766-c74f07f861b8 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f" status: 200 len: 1406 microversion: 2.20 time: 0.292999 Oct 19 03:50:54.652666 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3099/6265] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:50:54 2022] GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f => generated 1406 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:50:55.678621 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e17c40ea-0f66-4da5-9ace-50555c743520 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:50:55.679431 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e17c40ea-0f66-4da5-9ace-50555c743520 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 1eeec04f-d94e-4625-ab65-6d227a640f2f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:50:55.686266 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e17c40ea-0f66-4da5-9ace-50555c743520 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:50:55.686764 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e17c40ea-0f66-4da5-9ace-50555c743520 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:50:55.687213 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e17c40ea-0f66-4da5-9ace-50555c743520 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:50:55.688090 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e17c40ea-0f66-4da5-9ace-50555c743520 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:50:55.688717 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e17c40ea-0f66-4da5-9ace-50555c743520 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:50:55.689154 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e17c40ea-0f66-4da5-9ace-50555c743520 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:50:55.860605 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-e17c40ea-0f66-4da5-9ace-50555c743520 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:50:55.870685 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-e17c40ea-0f66-4da5-9ace-50555c743520 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:50:55.871938 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-e17c40ea-0f66-4da5-9ace-50555c743520 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:50:55.873411 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e17c40ea-0f66-4da5-9ace-50555c743520 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f" status: 200 len: 1598 microversion: 2.20 time: 0.200128 Oct 19 03:50:55.887472 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3167/6266] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:50:55 2022] GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f => generated 1598 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:50:55.902251 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-fbb74cc7-fa23-446d-8c1c-f5321d6471e7 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:50:55.902815 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-fbb74cc7-fa23-446d-8c1c-f5321d6471e7 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 1eeec04f-d94e-4625-ab65-6d227a640f2f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:50:55.913784 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:50:55.919521 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fbb74cc7-fa23-446d-8c1c-f5321d6471e7 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:50:55.919974 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fbb74cc7-fa23-446d-8c1c-f5321d6471e7 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:50:55.920474 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fbb74cc7-fa23-446d-8c1c-f5321d6471e7 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:50:55.921182 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fbb74cc7-fa23-446d-8c1c-f5321d6471e7 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:50:55.921677 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fbb74cc7-fa23-446d-8c1c-f5321d6471e7 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:50:55.922115 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fbb74cc7-fa23-446d-8c1c-f5321d6471e7 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:50:56.004364 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-fbb74cc7-fa23-446d-8c1c-f5321d6471e7 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.106947 Oct 19 03:50:56.004971 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3100/6267] 10.222.0.52 () {60 vars in 1316 bytes} [Wed Oct 19 03:50:55 2022] GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f/os-interface => generated 285 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 03:50:57.403786 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-52ef594b-ebd5-4f73-894a-3c4437cb7617 req-36debcbc-030f-483a-aff6-fa460fd33ea5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1eeec04f-d94e-4625-ab65-6d227a640f2f", "tag": "9487bc37-2fe4-4fbc-914a-50a09e00b655"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:50:57.414933 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-52ef594b-ebd5-4f73-894a-3c4437cb7617 req-36debcbc-030f-483a-aff6-fa460fd33ea5 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:50:57.425294 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-52ef594b-ebd5-4f73-894a-3c4437cb7617 req-36debcbc-030f-483a-aff6-fa460fd33ea5 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:50:57.425294 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-52ef594b-ebd5-4f73-894a-3c4437cb7617 req-36debcbc-030f-483a-aff6-fa460fd33ea5 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:50:57.428748 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-52ef594b-ebd5-4f73-894a-3c4437cb7617 req-36debcbc-030f-483a-aff6-fa460fd33ea5 service nova] Creating event network-changed:9487bc37-2fe4-4fbc-914a-50a09e00b655 for instance 1eeec04f-d94e-4625-ab65-6d227a640f2f on n-h2-861333-8 Oct 19 03:50:57.434316 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-52ef594b-ebd5-4f73-894a-3c4437cb7617 req-36debcbc-030f-483a-aff6-fa460fd33ea5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034150 Oct 19 03:50:57.435387 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3168/6268] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:50:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:51:04.368619 n-d-861333-8 devstack@n-api.service[121134]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 03:51:04.369150 n-d-861333-8 devstack@n-api.service[121134]: Wed Oct 19 03:51:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.52) !!! Oct 19 03:51:04.374004 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b749b50f-8c30-4d69-92f1-5fdcf1a018b9 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-218393374", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "networks": [{"uuid": "b6e9184f-af47-405f-9130-68852997c82d"}], "key_name": "tempest-TestNetworkAdvancedServerOps-354532", "security_groups": [{"name": "tempest-secgroup-smoke-581837633"}]}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:51:04.563147 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-b749b50f-8c30-4d69-92f1-5fdcf1a018b9 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] validate_networks() for [('b6e9184f-af47-405f-9130-68852997c82d', None, None, None, None, None)] {{(pid=121134) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:51:05.053328 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-b749b50f-8c30-4d69-92f1-5fdcf1a018b9 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Flavor limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:51:05.054052 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-b749b50f-8c30-4d69-92f1-5fdcf1a018b9 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Image limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:51:05.054695 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-b749b50f-8c30-4d69-92f1-5fdcf1a018b9 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Flavor pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:51:05.055269 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-b749b50f-8c30-4d69-92f1-5fdcf1a018b9 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Image pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:51:05.056039 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-b749b50f-8c30-4d69-92f1-5fdcf1a018b9 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:51:05.073862 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b749b50f-8c30-4d69-92f1-5fdcf1a018b9 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:51:05.074727 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b749b50f-8c30-4d69-92f1-5fdcf1a018b9 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:51:05.075332 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b749b50f-8c30-4d69-92f1-5fdcf1a018b9 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:51:05.076243 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b749b50f-8c30-4d69-92f1-5fdcf1a018b9 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:51:05.076847 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b749b50f-8c30-4d69-92f1-5fdcf1a018b9 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:51:05.077757 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b749b50f-8c30-4d69-92f1-5fdcf1a018b9 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:51:05.102878 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-b749b50f-8c30-4d69-92f1-5fdcf1a018b9 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Getting quotas for project fe972f4874424bf89e9ed0bfcb69f050. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:51:05.109923 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-b749b50f-8c30-4d69-92f1-5fdcf1a018b9 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Getting quotas for user b63367855cc9468f8512a87e89b8606d and project fe972f4874424bf89e9ed0bfcb69f050. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:51:05.128256 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b749b50f-8c30-4d69-92f1-5fdcf1a018b9 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Going to run 1 instances... {{(pid=121134) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:51:05.131853 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b749b50f-8c30-4d69-92f1-5fdcf1a018b9 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: 2b57ed72-0e3a-43c8-b552-875524942849] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:51:05.278039 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b749b50f-8c30-4d69-92f1-5fdcf1a018b9 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.911212 Oct 19 03:51:05.280032 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3101/6269] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:51:04 2022] POST /compute/v2.1/servers => generated 405 bytes in 914 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 03:51:05.290490 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=4 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:51:05.296080 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-019e51b4-0378-431f-8ed6-20a9f663def3 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:51:05.296967 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-019e51b4-0378-431f-8ed6-20a9f663def3 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: 2b57ed72-0e3a-43c8-b552-875524942849] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:51:05.435386 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-019e51b4-0378-431f-8ed6-20a9f663def3 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:51:05.443483 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-019e51b4-0378-431f-8ed6-20a9f663def3 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849" status: 200 len: 1262 microversion: 2.1 time: 0.155154 Oct 19 03:51:05.444359 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3169/6270] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:51:05 2022] GET /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849 => generated 1262 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:51:06.473189 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2679548a-026b-4d4e-a51a-4372c051a349 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:51:06.474474 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2679548a-026b-4d4e-a51a-4372c051a349 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: 2b57ed72-0e3a-43c8-b552-875524942849] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:51:06.483543 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2679548a-026b-4d4e-a51a-4372c051a349 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:51:06.486263 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2679548a-026b-4d4e-a51a-4372c051a349 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:51:06.487879 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2679548a-026b-4d4e-a51a-4372c051a349 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:51:06.491265 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2679548a-026b-4d4e-a51a-4372c051a349 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:51:06.492004 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2679548a-026b-4d4e-a51a-4372c051a349 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:51:06.492689 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2679548a-026b-4d4e-a51a-4372c051a349 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:51:06.597834 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-2679548a-026b-4d4e-a51a-4372c051a349 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:51:06.605397 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2679548a-026b-4d4e-a51a-4372c051a349 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849" status: 200 len: 1266 microversion: 2.1 time: 0.137609 Oct 19 03:51:06.608339 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3102/6271] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:51:06 2022] GET /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849 => generated 1266 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:51:07.633959 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-23589837-24f8-4763-a006-64c83faec3be tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:51:07.635733 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-23589837-24f8-4763-a006-64c83faec3be tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: 2b57ed72-0e3a-43c8-b552-875524942849] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:51:07.645606 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=18 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:51:07.647707 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-23589837-24f8-4763-a006-64c83faec3be tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:51:07.648495 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-23589837-24f8-4763-a006-64c83faec3be tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:51:07.649022 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-23589837-24f8-4763-a006-64c83faec3be tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:51:07.649884 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-23589837-24f8-4763-a006-64c83faec3be tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:51:07.650432 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-23589837-24f8-4763-a006-64c83faec3be tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:51:07.650949 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-23589837-24f8-4763-a006-64c83faec3be tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:51:07.759905 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-23589837-24f8-4763-a006-64c83faec3be tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:51:07.768604 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-23589837-24f8-4763-a006-64c83faec3be tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849" status: 200 len: 1314 microversion: 2.1 time: 0.140195 Oct 19 03:51:07.769892 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3170/6272] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:51:07 2022] GET /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849 => generated 1314 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:51:08.802411 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5250a08e-a920-4795-8051-c12ad2c99dd3 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:51:08.803568 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5250a08e-a920-4795-8051-c12ad2c99dd3 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: 2b57ed72-0e3a-43c8-b552-875524942849] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:51:08.811550 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5250a08e-a920-4795-8051-c12ad2c99dd3 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:51:08.812417 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5250a08e-a920-4795-8051-c12ad2c99dd3 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:51:08.812929 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5250a08e-a920-4795-8051-c12ad2c99dd3 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:51:08.813752 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5250a08e-a920-4795-8051-c12ad2c99dd3 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:51:08.814408 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5250a08e-a920-4795-8051-c12ad2c99dd3 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:51:08.815064 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5250a08e-a920-4795-8051-c12ad2c99dd3 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:51:08.912814 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5250a08e-a920-4795-8051-c12ad2c99dd3 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:51:08.921083 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5250a08e-a920-4795-8051-c12ad2c99dd3 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849" status: 200 len: 1320 microversion: 2.1 time: 0.123105 Oct 19 03:51:08.922122 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3103/6273] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:51:08 2022] GET /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849 => generated 1320 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:51:09.947790 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7735b340-a1da-4060-ac0b-0c48da1ecace tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:51:09.949005 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7735b340-a1da-4060-ac0b-0c48da1ecace tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: 2b57ed72-0e3a-43c8-b552-875524942849] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:51:09.959487 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7735b340-a1da-4060-ac0b-0c48da1ecace tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:51:09.960223 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7735b340-a1da-4060-ac0b-0c48da1ecace tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:51:09.960971 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7735b340-a1da-4060-ac0b-0c48da1ecace tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:51:09.962510 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7735b340-a1da-4060-ac0b-0c48da1ecace tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:51:09.963387 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7735b340-a1da-4060-ac0b-0c48da1ecace tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:51:09.964067 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7735b340-a1da-4060-ac0b-0c48da1ecace tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:51:10.155287 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7735b340-a1da-4060-ac0b-0c48da1ecace tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:51:10.164616 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7735b340-a1da-4060-ac0b-0c48da1ecace tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849" status: 200 len: 1387 microversion: 2.1 time: 0.222340 Oct 19 03:51:10.165999 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3171/6274] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:51:09 2022] GET /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849 => generated 1387 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:51:10.346774 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-c95e42e9-c806-47fa-b36a-eb2086ae3dae req-25f51bf0-ff43-4df3-9551-5b60fda61135 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b57ed72-0e3a-43c8-b552-875524942849", "tag": "b71571a2-9eae-43a2-9932-7383aafff2d1"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:51:10.377584 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-c95e42e9-c806-47fa-b36a-eb2086ae3dae req-25f51bf0-ff43-4df3-9551-5b60fda61135 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:51:10.378067 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-c95e42e9-c806-47fa-b36a-eb2086ae3dae req-25f51bf0-ff43-4df3-9551-5b60fda61135 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:51:10.379205 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-c95e42e9-c806-47fa-b36a-eb2086ae3dae req-25f51bf0-ff43-4df3-9551-5b60fda61135 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:51:10.409493 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-c95e42e9-c806-47fa-b36a-eb2086ae3dae req-25f51bf0-ff43-4df3-9551-5b60fda61135 service nova] Creating event network-changed:b71571a2-9eae-43a2-9932-7383aafff2d1 for instance 2b57ed72-0e3a-43c8-b552-875524942849 on n-h1-861333-8 Oct 19 03:51:10.414694 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-c95e42e9-c806-47fa-b36a-eb2086ae3dae req-25f51bf0-ff43-4df3-9551-5b60fda61135 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071576 Oct 19 03:51:10.419524 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3104/6275] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:51:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:51:11.196392 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1e550663-1a55-43a0-98ce-d5462bb2dc92 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:51:11.197615 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1e550663-1a55-43a0-98ce-d5462bb2dc92 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: 2b57ed72-0e3a-43c8-b552-875524942849] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:51:11.208405 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1e550663-1a55-43a0-98ce-d5462bb2dc92 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:51:11.209173 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1e550663-1a55-43a0-98ce-d5462bb2dc92 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:51:11.209659 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1e550663-1a55-43a0-98ce-d5462bb2dc92 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:51:11.210763 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1e550663-1a55-43a0-98ce-d5462bb2dc92 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:51:11.211639 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1e550663-1a55-43a0-98ce-d5462bb2dc92 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:51:11.212269 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1e550663-1a55-43a0-98ce-d5462bb2dc92 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:51:11.375473 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-1e550663-1a55-43a0-98ce-d5462bb2dc92 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:51:11.393703 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1e550663-1a55-43a0-98ce-d5462bb2dc92 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849" status: 200 len: 1387 microversion: 2.1 time: 0.201090 Oct 19 03:51:11.401873 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3172/6276] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:51:11 2022] GET /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849 => generated 1387 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:51:12.423526 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-531415d4-0d12-4f3f-8d51-79c072335e55 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:51:12.424238 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-531415d4-0d12-4f3f-8d51-79c072335e55 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: 2b57ed72-0e3a-43c8-b552-875524942849] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:51:12.431660 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-531415d4-0d12-4f3f-8d51-79c072335e55 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:51:12.432150 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-531415d4-0d12-4f3f-8d51-79c072335e55 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:51:12.432590 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-531415d4-0d12-4f3f-8d51-79c072335e55 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:51:12.433291 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-531415d4-0d12-4f3f-8d51-79c072335e55 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:51:12.433774 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-531415d4-0d12-4f3f-8d51-79c072335e55 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:51:12.434211 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-531415d4-0d12-4f3f-8d51-79c072335e55 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:51:12.587809 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-531415d4-0d12-4f3f-8d51-79c072335e55 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:51:12.598404 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-531415d4-0d12-4f3f-8d51-79c072335e55 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849" status: 200 len: 1387 microversion: 2.1 time: 0.179838 Oct 19 03:51:12.599005 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3105/6277] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:51:12 2022] GET /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849 => generated 1387 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:51:13.622384 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7235772f-c09e-4d82-a69a-3d0512483ccf tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:51:13.623114 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7235772f-c09e-4d82-a69a-3d0512483ccf tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: 2b57ed72-0e3a-43c8-b552-875524942849] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:51:13.630828 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7235772f-c09e-4d82-a69a-3d0512483ccf tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:51:13.631583 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7235772f-c09e-4d82-a69a-3d0512483ccf tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:51:13.632033 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7235772f-c09e-4d82-a69a-3d0512483ccf tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:51:13.632757 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7235772f-c09e-4d82-a69a-3d0512483ccf tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:51:13.633221 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7235772f-c09e-4d82-a69a-3d0512483ccf tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:51:13.633682 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7235772f-c09e-4d82-a69a-3d0512483ccf tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:51:13.777480 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7235772f-c09e-4d82-a69a-3d0512483ccf tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:51:13.787666 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7235772f-c09e-4d82-a69a-3d0512483ccf tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849" status: 200 len: 1387 microversion: 2.1 time: 0.169093 Oct 19 03:51:13.788517 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3173/6278] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:51:13 2022] GET /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849 => generated 1387 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:51:14.812028 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-52f01c16-e068-4980-b93f-ef3f5667e602 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:51:14.812653 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-52f01c16-e068-4980-b93f-ef3f5667e602 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: 2b57ed72-0e3a-43c8-b552-875524942849] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:51:14.823112 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-52f01c16-e068-4980-b93f-ef3f5667e602 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:51:14.823614 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-52f01c16-e068-4980-b93f-ef3f5667e602 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:51:14.824060 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-52f01c16-e068-4980-b93f-ef3f5667e602 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:51:14.824787 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-52f01c16-e068-4980-b93f-ef3f5667e602 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:51:14.825235 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-52f01c16-e068-4980-b93f-ef3f5667e602 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:51:14.825696 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-52f01c16-e068-4980-b93f-ef3f5667e602 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:51:15.005592 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-52f01c16-e068-4980-b93f-ef3f5667e602 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:51:15.014349 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-52f01c16-e068-4980-b93f-ef3f5667e602 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849" status: 200 len: 1387 microversion: 2.1 time: 0.206563 Oct 19 03:51:15.015112 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3106/6279] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:51:14 2022] GET /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849 => generated 1387 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:51:16.038894 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9fc9b03f-7aed-4c09-b137-bcbc2de27e3d tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:51:16.039621 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9fc9b03f-7aed-4c09-b137-bcbc2de27e3d tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: 2b57ed72-0e3a-43c8-b552-875524942849] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:51:16.048232 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9fc9b03f-7aed-4c09-b137-bcbc2de27e3d tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:51:16.048996 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9fc9b03f-7aed-4c09-b137-bcbc2de27e3d tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:51:16.050118 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9fc9b03f-7aed-4c09-b137-bcbc2de27e3d tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:51:16.050907 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9fc9b03f-7aed-4c09-b137-bcbc2de27e3d tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:51:16.051378 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9fc9b03f-7aed-4c09-b137-bcbc2de27e3d tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:51:16.052140 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9fc9b03f-7aed-4c09-b137-bcbc2de27e3d tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:51:16.226711 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-9fc9b03f-7aed-4c09-b137-bcbc2de27e3d tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:51:16.235966 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9fc9b03f-7aed-4c09-b137-bcbc2de27e3d tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849" status: 200 len: 1387 microversion: 2.1 time: 0.201606 Oct 19 03:51:16.237203 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3174/6280] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:51:16 2022] GET /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849 => generated 1387 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:51:17.262423 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ce734457-4602-4306-822d-7cb512a651b9 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:51:17.264526 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ce734457-4602-4306-822d-7cb512a651b9 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: 2b57ed72-0e3a-43c8-b552-875524942849] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:51:17.271229 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:51:17.272346 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=6 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:51:17.275351 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ce734457-4602-4306-822d-7cb512a651b9 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:51:17.276147 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ce734457-4602-4306-822d-7cb512a651b9 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:51:17.276822 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ce734457-4602-4306-822d-7cb512a651b9 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:51:17.277763 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ce734457-4602-4306-822d-7cb512a651b9 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:51:17.278408 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ce734457-4602-4306-822d-7cb512a651b9 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:51:17.287173 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ce734457-4602-4306-822d-7cb512a651b9 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:51:17.444034 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ce734457-4602-4306-822d-7cb512a651b9 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:51:17.463541 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ce734457-4602-4306-822d-7cb512a651b9 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849" status: 200 len: 1387 microversion: 2.1 time: 0.205526 Oct 19 03:51:17.482380 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3107/6281] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:51:17 2022] GET /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849 => generated 1387 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:51:18.488428 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7481e346-516d-4aa4-aefe-5b6c9231ff44 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:51:18.489311 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7481e346-516d-4aa4-aefe-5b6c9231ff44 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: 2b57ed72-0e3a-43c8-b552-875524942849] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:51:18.498065 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:51:18.499274 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7481e346-516d-4aa4-aefe-5b6c9231ff44 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:51:18.500290 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7481e346-516d-4aa4-aefe-5b6c9231ff44 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:51:18.500897 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7481e346-516d-4aa4-aefe-5b6c9231ff44 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:51:18.501997 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7481e346-516d-4aa4-aefe-5b6c9231ff44 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:51:18.502605 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7481e346-516d-4aa4-aefe-5b6c9231ff44 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:51:18.503483 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7481e346-516d-4aa4-aefe-5b6c9231ff44 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:51:18.671161 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7481e346-516d-4aa4-aefe-5b6c9231ff44 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:51:18.680552 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7481e346-516d-4aa4-aefe-5b6c9231ff44 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849" status: 200 len: 1387 microversion: 2.1 time: 0.196442 Oct 19 03:51:18.694050 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3175/6282] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:51:18 2022] GET /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849 => generated 1387 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:51:18.717691 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-bf1d8dbb-6c01-4d55-983d-6d7208dd8a7f req-aa5211b0-a729-42c4-91b5-7cb80d46eb84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b57ed72-0e3a-43c8-b552-875524942849", "name": "network-vif-plugged", "status": "completed", "tag": "b71571a2-9eae-43a2-9932-7383aafff2d1"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:51:18.743590 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-bf1d8dbb-6c01-4d55-983d-6d7208dd8a7f req-aa5211b0-a729-42c4-91b5-7cb80d46eb84 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:51:18.744083 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-bf1d8dbb-6c01-4d55-983d-6d7208dd8a7f req-aa5211b0-a729-42c4-91b5-7cb80d46eb84 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:51:18.744526 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-bf1d8dbb-6c01-4d55-983d-6d7208dd8a7f req-aa5211b0-a729-42c4-91b5-7cb80d46eb84 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:51:18.757587 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-bf1d8dbb-6c01-4d55-983d-6d7208dd8a7f req-aa5211b0-a729-42c4-91b5-7cb80d46eb84 service nova] Creating event network-vif-plugged:b71571a2-9eae-43a2-9932-7383aafff2d1 for instance 2b57ed72-0e3a-43c8-b552-875524942849 on n-h1-861333-8 Oct 19 03:51:18.763488 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-bf1d8dbb-6c01-4d55-983d-6d7208dd8a7f req-aa5211b0-a729-42c4-91b5-7cb80d46eb84 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050326 Oct 19 03:51:18.764423 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3108/6283] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:51:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:51:19.706175 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-44f8be32-6064-4966-8717-8d7c9fe2be7c tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:51:19.708044 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-44f8be32-6064-4966-8717-8d7c9fe2be7c tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: 2b57ed72-0e3a-43c8-b552-875524942849] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:51:19.718516 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-44f8be32-6064-4966-8717-8d7c9fe2be7c tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:51:19.719388 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-44f8be32-6064-4966-8717-8d7c9fe2be7c tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:51:19.720157 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-44f8be32-6064-4966-8717-8d7c9fe2be7c tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:51:19.721079 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-44f8be32-6064-4966-8717-8d7c9fe2be7c tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:51:19.721887 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-44f8be32-6064-4966-8717-8d7c9fe2be7c tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:51:19.723097 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-44f8be32-6064-4966-8717-8d7c9fe2be7c tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:51:19.883245 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-44f8be32-6064-4966-8717-8d7c9fe2be7c tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:51:19.892381 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-44f8be32-6064-4966-8717-8d7c9fe2be7c tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849" status: 200 len: 1387 microversion: 2.1 time: 0.190552 Oct 19 03:51:19.905676 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3176/6284] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:51:19 2022] GET /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849 => generated 1387 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:51:20.918566 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-60d7cd1d-ea98-4dd0-9868-539c35a6d55e tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:51:20.920095 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-60d7cd1d-ea98-4dd0-9868-539c35a6d55e tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: 2b57ed72-0e3a-43c8-b552-875524942849] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:51:20.927976 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-60d7cd1d-ea98-4dd0-9868-539c35a6d55e tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:51:20.928795 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-60d7cd1d-ea98-4dd0-9868-539c35a6d55e tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:51:20.929436 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-60d7cd1d-ea98-4dd0-9868-539c35a6d55e tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:51:20.930569 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-60d7cd1d-ea98-4dd0-9868-539c35a6d55e tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:51:20.931209 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-60d7cd1d-ea98-4dd0-9868-539c35a6d55e tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:51:20.931635 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-60d7cd1d-ea98-4dd0-9868-539c35a6d55e tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:51:21.093726 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-60d7cd1d-ea98-4dd0-9868-539c35a6d55e tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:51:21.102168 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-60d7cd1d-ea98-4dd0-9868-539c35a6d55e tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849" status: 200 len: 1560 microversion: 2.1 time: 0.188842 Oct 19 03:51:21.103997 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3109/6285] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:51:20 2022] GET /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849 => generated 1560 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:51:21.131483 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0d1f4c7f-c9f5-48ef-b8e4-2b3ff2b669e9 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:51:21.132755 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0d1f4c7f-c9f5-48ef-b8e4-2b3ff2b669e9 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: 2b57ed72-0e3a-43c8-b552-875524942849] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:51:21.140700 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0d1f4c7f-c9f5-48ef-b8e4-2b3ff2b669e9 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:51:21.141495 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0d1f4c7f-c9f5-48ef-b8e4-2b3ff2b669e9 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:51:21.142173 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0d1f4c7f-c9f5-48ef-b8e4-2b3ff2b669e9 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:51:21.143097 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0d1f4c7f-c9f5-48ef-b8e4-2b3ff2b669e9 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:51:21.143761 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0d1f4c7f-c9f5-48ef-b8e4-2b3ff2b669e9 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:51:21.144431 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0d1f4c7f-c9f5-48ef-b8e4-2b3ff2b669e9 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:51:21.313229 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-0d1f4c7f-c9f5-48ef-b8e4-2b3ff2b669e9 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:51:21.322715 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0d1f4c7f-c9f5-48ef-b8e4-2b3ff2b669e9 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849" status: 200 len: 1560 microversion: 2.1 time: 0.195133 Oct 19 03:51:21.334079 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3177/6286] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:51:21 2022] GET /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849 => generated 1560 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:51:23.466261 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-89bc7a1b-5983-4158-ad9e-6205194ccf9c tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:51:23.466882 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-89bc7a1b-5983-4158-ad9e-6205194ccf9c tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: 2b57ed72-0e3a-43c8-b552-875524942849] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:51:23.474221 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-1ab2c071-19d0-40d1-ab94-ace0341389c7 req-368e038b-75c5-4f28-b89a-971b320c5daf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b57ed72-0e3a-43c8-b552-875524942849", "tag": "b71571a2-9eae-43a2-9932-7383aafff2d1"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:51:23.475338 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-89bc7a1b-5983-4158-ad9e-6205194ccf9c tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:51:23.475838 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-89bc7a1b-5983-4158-ad9e-6205194ccf9c tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:51:23.476282 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-89bc7a1b-5983-4158-ad9e-6205194ccf9c tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:51:23.476991 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-89bc7a1b-5983-4158-ad9e-6205194ccf9c tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:51:23.477484 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-89bc7a1b-5983-4158-ad9e-6205194ccf9c tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:51:23.482725 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-89bc7a1b-5983-4158-ad9e-6205194ccf9c tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:51:23.486463 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-1ab2c071-19d0-40d1-ab94-ace0341389c7 req-368e038b-75c5-4f28-b89a-971b320c5daf service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:51:23.486960 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-1ab2c071-19d0-40d1-ab94-ace0341389c7 req-368e038b-75c5-4f28-b89a-971b320c5daf service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:51:23.487400 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-1ab2c071-19d0-40d1-ab94-ace0341389c7 req-368e038b-75c5-4f28-b89a-971b320c5daf service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:51:23.501402 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-1ab2c071-19d0-40d1-ab94-ace0341389c7 req-368e038b-75c5-4f28-b89a-971b320c5daf service nova] Creating event network-changed:b71571a2-9eae-43a2-9932-7383aafff2d1 for instance 2b57ed72-0e3a-43c8-b552-875524942849 on n-h1-861333-8 Oct 19 03:51:23.508292 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-1ab2c071-19d0-40d1-ab94-ace0341389c7 req-368e038b-75c5-4f28-b89a-971b320c5daf service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039240 Oct 19 03:51:23.513575 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3178/6287] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:51:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:51:23.666857 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-89bc7a1b-5983-4158-ad9e-6205194ccf9c tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:51:23.676093 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-89bc7a1b-5983-4158-ad9e-6205194ccf9c tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849" status: 200 len: 1560 microversion: 2.1 time: 0.213774 Oct 19 03:51:23.676813 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3110/6288] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:51:23 2022] GET /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849 => generated 1560 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:51:33.471348 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-bd41799f-cfde-49ba-acac-175d397920d6 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:51:33.471862 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-bd41799f-cfde-49ba-acac-175d397920d6 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 1eeec04f-d94e-4625-ab65-6d227a640f2f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:51:33.474452 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=44,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:51:33.479387 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bd41799f-cfde-49ba-acac-175d397920d6 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:51:33.479883 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bd41799f-cfde-49ba-acac-175d397920d6 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:51:33.480330 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bd41799f-cfde-49ba-acac-175d397920d6 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:51:33.481024 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bd41799f-cfde-49ba-acac-175d397920d6 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:51:33.481510 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bd41799f-cfde-49ba-acac-175d397920d6 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:51:33.481939 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bd41799f-cfde-49ba-acac-175d397920d6 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:51:33.506608 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-bd41799f-cfde-49ba-acac-175d397920d6 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f/ips" status: 200 len: 152 microversion: 2.20 time: 0.040883 Oct 19 03:51:33.507206 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3179/6289] 10.222.0.52 () {60 vars in 1289 bytes} [Wed Oct 19 03:51:33 2022] GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f/ips => generated 152 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 03:51:36.685973 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-019c27f6-7c96-455b-b058-0c35b1f78ba5 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:51:36.686876 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-019c27f6-7c96-455b-b058-0c35b1f78ba5 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 1eeec04f-d94e-4625-ab65-6d227a640f2f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:51:36.691340 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:51:36.692319 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=54 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:51:36.698830 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-019c27f6-7c96-455b-b058-0c35b1f78ba5 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:51:36.699570 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-019c27f6-7c96-455b-b058-0c35b1f78ba5 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:51:36.700197 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-019c27f6-7c96-455b-b058-0c35b1f78ba5 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:51:36.701219 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-019c27f6-7c96-455b-b058-0c35b1f78ba5 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:51:36.701989 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-019c27f6-7c96-455b-b058-0c35b1f78ba5 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:51:36.703272 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-019c27f6-7c96-455b-b058-0c35b1f78ba5 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:51:36.738813 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-019c27f6-7c96-455b-b058-0c35b1f78ba5 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lazy-loading 'flavor' on Instance uuid 1eeec04f-d94e-4625-ab65-6d227a640f2f {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:51:37.254898 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-019c27f6-7c96-455b-b058-0c35b1f78ba5 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "POST /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f/action" status: 202 len: 0 microversion: 2.20 time: 0.573851 Oct 19 03:51:37.255524 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3111/6290] 10.222.0.52 () {62 vars in 1319 bytes} [Wed Oct 19 03:51:36 2022] POST /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f/action => generated 0 bytes in 575 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:51:37.264629 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4897ec8d-76b7-404e-962c-ef021304f880 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:51:37.265429 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4897ec8d-76b7-404e-962c-ef021304f880 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 1eeec04f-d94e-4625-ab65-6d227a640f2f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:51:37.273493 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4897ec8d-76b7-404e-962c-ef021304f880 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:51:37.273988 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4897ec8d-76b7-404e-962c-ef021304f880 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:51:37.274482 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4897ec8d-76b7-404e-962c-ef021304f880 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:51:37.275220 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4897ec8d-76b7-404e-962c-ef021304f880 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:51:37.275670 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4897ec8d-76b7-404e-962c-ef021304f880 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:51:37.276095 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4897ec8d-76b7-404e-962c-ef021304f880 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:51:37.434299 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4897ec8d-76b7-404e-962c-ef021304f880 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:51:37.443946 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4897ec8d-76b7-404e-962c-ef021304f880 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:51:37.449104 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4897ec8d-76b7-404e-962c-ef021304f880 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:51:37.449104 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4897ec8d-76b7-404e-962c-ef021304f880 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f" status: 200 len: 1723 microversion: 2.20 time: 0.186623 Oct 19 03:51:37.449104 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3180/6291] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:51:37 2022] GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f => generated 1723 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:51:38.475275 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5c9df051-08e7-4a74-9054-426c40b8761e tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:51:38.476565 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5c9df051-08e7-4a74-9054-426c40b8761e tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 1eeec04f-d94e-4625-ab65-6d227a640f2f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:51:38.483158 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5c9df051-08e7-4a74-9054-426c40b8761e tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:51:38.483652 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5c9df051-08e7-4a74-9054-426c40b8761e tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:51:38.484097 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5c9df051-08e7-4a74-9054-426c40b8761e tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:51:38.484794 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5c9df051-08e7-4a74-9054-426c40b8761e tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:51:38.485437 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5c9df051-08e7-4a74-9054-426c40b8761e tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:51:38.485889 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5c9df051-08e7-4a74-9054-426c40b8761e tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:51:38.627852 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5c9df051-08e7-4a74-9054-426c40b8761e tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:51:38.637736 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5c9df051-08e7-4a74-9054-426c40b8761e tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:51:38.639610 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5c9df051-08e7-4a74-9054-426c40b8761e tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:51:38.641916 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5c9df051-08e7-4a74-9054-426c40b8761e tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f" status: 200 len: 1723 microversion: 2.20 time: 0.172968 Oct 19 03:51:38.648365 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3112/6292] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:51:38 2022] GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:51:39.668757 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5f9d2530-a79d-414b-9980-079e0274d61c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:51:39.671480 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-5f9d2530-a79d-414b-9980-079e0274d61c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 1eeec04f-d94e-4625-ab65-6d227a640f2f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:51:39.681973 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5f9d2530-a79d-414b-9980-079e0274d61c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:51:39.682631 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5f9d2530-a79d-414b-9980-079e0274d61c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:51:39.683288 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5f9d2530-a79d-414b-9980-079e0274d61c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:51:39.684204 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5f9d2530-a79d-414b-9980-079e0274d61c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:51:39.684884 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5f9d2530-a79d-414b-9980-079e0274d61c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:51:39.686184 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5f9d2530-a79d-414b-9980-079e0274d61c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:51:39.692037 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=61 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:51:39.945273 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-5f9d2530-a79d-414b-9980-079e0274d61c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:51:39.955400 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-5f9d2530-a79d-414b-9980-079e0274d61c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:51:39.969725 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-5f9d2530-a79d-414b-9980-079e0274d61c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:51:39.971949 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5f9d2530-a79d-414b-9980-079e0274d61c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f" status: 200 len: 1723 microversion: 2.20 time: 0.307261 Oct 19 03:51:39.973612 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3181/6293] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:51:39 2022] GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f => generated 1723 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:51:41.000624 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9acd196d-2c4c-4425-ba81-ec3a6084ef1f tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:51:41.001246 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9acd196d-2c4c-4425-ba81-ec3a6084ef1f tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 1eeec04f-d94e-4625-ab65-6d227a640f2f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:51:41.007802 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9acd196d-2c4c-4425-ba81-ec3a6084ef1f tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:51:41.008497 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9acd196d-2c4c-4425-ba81-ec3a6084ef1f tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:51:41.008939 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9acd196d-2c4c-4425-ba81-ec3a6084ef1f tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:51:41.009666 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9acd196d-2c4c-4425-ba81-ec3a6084ef1f tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:51:41.010114 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9acd196d-2c4c-4425-ba81-ec3a6084ef1f tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:51:41.010709 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9acd196d-2c4c-4425-ba81-ec3a6084ef1f tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:51:41.157780 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9acd196d-2c4c-4425-ba81-ec3a6084ef1f tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:51:41.169104 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9acd196d-2c4c-4425-ba81-ec3a6084ef1f tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:51:41.170743 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9acd196d-2c4c-4425-ba81-ec3a6084ef1f tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:51:41.173705 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9acd196d-2c4c-4425-ba81-ec3a6084ef1f tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f" status: 200 len: 1723 microversion: 2.20 time: 0.175261 Oct 19 03:51:41.173705 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3113/6294] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:51:40 2022] GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:51:42.199187 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-49a0fda7-3eb5-4609-b626-e677a72e786c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:51:42.200472 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-49a0fda7-3eb5-4609-b626-e677a72e786c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 1eeec04f-d94e-4625-ab65-6d227a640f2f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:51:42.208429 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-49a0fda7-3eb5-4609-b626-e677a72e786c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:51:42.208902 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-49a0fda7-3eb5-4609-b626-e677a72e786c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:51:42.209619 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-49a0fda7-3eb5-4609-b626-e677a72e786c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:51:42.210471 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-49a0fda7-3eb5-4609-b626-e677a72e786c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:51:42.210948 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-49a0fda7-3eb5-4609-b626-e677a72e786c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:51:42.211602 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-49a0fda7-3eb5-4609-b626-e677a72e786c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:51:42.589812 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-49a0fda7-3eb5-4609-b626-e677a72e786c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:51:42.600834 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-49a0fda7-3eb5-4609-b626-e677a72e786c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:51:42.602714 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-49a0fda7-3eb5-4609-b626-e677a72e786c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:51:42.603985 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-49a0fda7-3eb5-4609-b626-e677a72e786c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f" status: 200 len: 1723 microversion: 2.20 time: 0.408722 Oct 19 03:51:42.604750 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3182/6295] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:51:42 2022] GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f => generated 1723 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:51:43.632652 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-96d80e10-34a6-4a47-92bb-f23bbf6a966f tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:51:43.633359 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-96d80e10-34a6-4a47-92bb-f23bbf6a966f tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 1eeec04f-d94e-4625-ab65-6d227a640f2f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:51:43.641587 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-96d80e10-34a6-4a47-92bb-f23bbf6a966f tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:51:43.642696 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-96d80e10-34a6-4a47-92bb-f23bbf6a966f tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:51:43.643386 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-96d80e10-34a6-4a47-92bb-f23bbf6a966f tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:51:43.644412 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-96d80e10-34a6-4a47-92bb-f23bbf6a966f tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:51:43.645070 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-96d80e10-34a6-4a47-92bb-f23bbf6a966f tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:51:43.645526 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-96d80e10-34a6-4a47-92bb-f23bbf6a966f tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:51:43.783609 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-96d80e10-34a6-4a47-92bb-f23bbf6a966f tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:51:43.793457 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-96d80e10-34a6-4a47-92bb-f23bbf6a966f tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:51:43.796287 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-96d80e10-34a6-4a47-92bb-f23bbf6a966f tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:51:43.796287 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-96d80e10-34a6-4a47-92bb-f23bbf6a966f tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f" status: 200 len: 1723 microversion: 2.20 time: 0.168802 Oct 19 03:51:43.797219 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3114/6296] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:51:43 2022] GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:51:44.833182 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-72f66300-90cc-4f6f-8b91-b089d7a3986d tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:51:44.833828 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-72f66300-90cc-4f6f-8b91-b089d7a3986d tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 1eeec04f-d94e-4625-ab65-6d227a640f2f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:51:44.841943 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-72f66300-90cc-4f6f-8b91-b089d7a3986d tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:51:44.842473 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-72f66300-90cc-4f6f-8b91-b089d7a3986d tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:51:44.843360 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-72f66300-90cc-4f6f-8b91-b089d7a3986d tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:51:44.844454 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-72f66300-90cc-4f6f-8b91-b089d7a3986d tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:51:44.845086 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-72f66300-90cc-4f6f-8b91-b089d7a3986d tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:51:44.845540 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-72f66300-90cc-4f6f-8b91-b089d7a3986d tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:51:45.013295 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-72f66300-90cc-4f6f-8b91-b089d7a3986d tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:51:45.022136 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-72f66300-90cc-4f6f-8b91-b089d7a3986d tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:51:45.028827 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-72f66300-90cc-4f6f-8b91-b089d7a3986d tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:51:45.028827 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-72f66300-90cc-4f6f-8b91-b089d7a3986d tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f" status: 200 len: 1723 microversion: 2.20 time: 0.202750 Oct 19 03:51:45.028827 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3183/6297] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:51:44 2022] GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f => generated 1723 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:51:46.051277 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0c4fad21-0df4-4853-b4bd-6da2a6fc979e tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:51:46.052705 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0c4fad21-0df4-4853-b4bd-6da2a6fc979e tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 1eeec04f-d94e-4625-ab65-6d227a640f2f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:51:46.060756 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0c4fad21-0df4-4853-b4bd-6da2a6fc979e tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:51:46.061573 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0c4fad21-0df4-4853-b4bd-6da2a6fc979e tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:51:46.062091 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0c4fad21-0df4-4853-b4bd-6da2a6fc979e tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:51:46.063598 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0c4fad21-0df4-4853-b4bd-6da2a6fc979e tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:51:46.064135 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0c4fad21-0df4-4853-b4bd-6da2a6fc979e tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:51:46.064648 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0c4fad21-0df4-4853-b4bd-6da2a6fc979e tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:51:46.217615 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0c4fad21-0df4-4853-b4bd-6da2a6fc979e tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:51:46.229229 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0c4fad21-0df4-4853-b4bd-6da2a6fc979e tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:51:46.231133 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0c4fad21-0df4-4853-b4bd-6da2a6fc979e tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:51:46.232543 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0c4fad21-0df4-4853-b4bd-6da2a6fc979e tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f" status: 200 len: 1723 microversion: 2.20 time: 0.186595 Oct 19 03:51:46.233328 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3115/6298] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:51:46 2022] GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f => generated 1723 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:51:47.264367 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5e7890f5-55d4-4283-aa20-93ff93ed54cb tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:51:47.265696 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-5e7890f5-55d4-4283-aa20-93ff93ed54cb tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 1eeec04f-d94e-4625-ab65-6d227a640f2f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:51:47.281490 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5e7890f5-55d4-4283-aa20-93ff93ed54cb tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:51:47.285843 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5e7890f5-55d4-4283-aa20-93ff93ed54cb tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:51:47.285843 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5e7890f5-55d4-4283-aa20-93ff93ed54cb tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:51:47.285843 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5e7890f5-55d4-4283-aa20-93ff93ed54cb tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:51:47.285843 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5e7890f5-55d4-4283-aa20-93ff93ed54cb tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:51:47.285843 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5e7890f5-55d4-4283-aa20-93ff93ed54cb tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:51:47.458039 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-5e7890f5-55d4-4283-aa20-93ff93ed54cb tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:51:47.468387 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-5e7890f5-55d4-4283-aa20-93ff93ed54cb tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:51:47.471932 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-5e7890f5-55d4-4283-aa20-93ff93ed54cb tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:51:47.471932 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5e7890f5-55d4-4283-aa20-93ff93ed54cb tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f" status: 200 len: 1723 microversion: 2.20 time: 0.213925 Oct 19 03:51:47.472493 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3184/6299] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:51:47 2022] GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f => generated 1723 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:51:48.500084 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1a929f63-77c7-4267-a445-e6c3edc01816 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:51:48.501211 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1a929f63-77c7-4267-a445-e6c3edc01816 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 1eeec04f-d94e-4625-ab65-6d227a640f2f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:51:48.512459 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1a929f63-77c7-4267-a445-e6c3edc01816 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:51:48.512459 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1a929f63-77c7-4267-a445-e6c3edc01816 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:51:48.512459 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1a929f63-77c7-4267-a445-e6c3edc01816 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:51:48.513794 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1a929f63-77c7-4267-a445-e6c3edc01816 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:51:48.514475 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1a929f63-77c7-4267-a445-e6c3edc01816 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:51:48.515056 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1a929f63-77c7-4267-a445-e6c3edc01816 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:51:49.025833 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-1a929f63-77c7-4267-a445-e6c3edc01816 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:51:49.034592 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-1a929f63-77c7-4267-a445-e6c3edc01816 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:51:49.036707 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-1a929f63-77c7-4267-a445-e6c3edc01816 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:51:49.040193 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1a929f63-77c7-4267-a445-e6c3edc01816 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f" status: 200 len: 1723 microversion: 2.20 time: 0.546594 Oct 19 03:51:49.040793 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3116/6300] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:51:48 2022] GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f => generated 1723 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:51:50.066445 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-76f55e75-4478-4e4a-82cf-d21c339a8d1f tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:51:50.067176 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-76f55e75-4478-4e4a-82cf-d21c339a8d1f tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 1eeec04f-d94e-4625-ab65-6d227a640f2f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:51:50.075263 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-76f55e75-4478-4e4a-82cf-d21c339a8d1f tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:51:50.075973 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-76f55e75-4478-4e4a-82cf-d21c339a8d1f tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:51:50.076418 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-76f55e75-4478-4e4a-82cf-d21c339a8d1f tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:51:50.077344 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-76f55e75-4478-4e4a-82cf-d21c339a8d1f tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:51:50.077984 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-76f55e75-4478-4e4a-82cf-d21c339a8d1f tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:51:50.078423 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-76f55e75-4478-4e4a-82cf-d21c339a8d1f tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:51:50.219190 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-76f55e75-4478-4e4a-82cf-d21c339a8d1f tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:51:50.231334 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-76f55e75-4478-4e4a-82cf-d21c339a8d1f tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:51:50.233281 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-76f55e75-4478-4e4a-82cf-d21c339a8d1f tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:51:50.234661 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-76f55e75-4478-4e4a-82cf-d21c339a8d1f tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f" status: 200 len: 1723 microversion: 2.20 time: 0.172446 Oct 19 03:51:50.235350 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3185/6301] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:51:50 2022] GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:51:51.260840 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5f1c16a1-0394-4cce-9f01-787a5bdc1694 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:51:51.261915 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5f1c16a1-0394-4cce-9f01-787a5bdc1694 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 1eeec04f-d94e-4625-ab65-6d227a640f2f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:51:51.271321 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5f1c16a1-0394-4cce-9f01-787a5bdc1694 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:51:51.271816 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5f1c16a1-0394-4cce-9f01-787a5bdc1694 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:51:51.272254 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5f1c16a1-0394-4cce-9f01-787a5bdc1694 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:51:51.272978 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5f1c16a1-0394-4cce-9f01-787a5bdc1694 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:51:51.273624 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5f1c16a1-0394-4cce-9f01-787a5bdc1694 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:51:51.274053 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5f1c16a1-0394-4cce-9f01-787a5bdc1694 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:51:51.422396 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5f1c16a1-0394-4cce-9f01-787a5bdc1694 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:51:51.432840 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5f1c16a1-0394-4cce-9f01-787a5bdc1694 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:51:51.434299 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5f1c16a1-0394-4cce-9f01-787a5bdc1694 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:51:51.435452 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5f1c16a1-0394-4cce-9f01-787a5bdc1694 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f" status: 200 len: 1723 microversion: 2.20 time: 0.178498 Oct 19 03:51:51.436411 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3117/6302] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:51:51 2022] GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:51:51.800632 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3cdd1b09-47e2-4877-b507-b3d12adbbe1a tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Action: 'create', calling method: .version_select at 0x7fc1350c7550>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-93452807", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM6sVj1jrFoPuQwAqh2WgsUcSxOD7HdJ7ilXxtj7pJaJDfG+gjQhDYhkxpvAzw5HJj0i2b56kx5AcoL+Pi5JoQkXVhnZB1pujuGxUtC8UADN8uZqYJeVBbkcW98eegF/7g=="}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:51:51.816094 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-3cdd1b09-47e2-4877-b507-b3d12adbbe1a tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Getting quotas for project 6f4f31b5836f40e580c28153626ec6ce. Resources: {'key_pairs'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:51:51.822982 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-3cdd1b09-47e2-4877-b507-b3d12adbbe1a tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Getting quotas for user 8d8ec7142c79407b81108e90ce3657d5 and project 6f4f31b5836f40e580c28153626ec6ce. Resources: {'key_pairs'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:51:51.996783 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-3cdd1b09-47e2-4877-b507-b3d12adbbe1a tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.383460 Oct 19 03:51:51.997319 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3186/6303] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Oct 19 03:51:51 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:51:52.463724 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5adf6f63-03d6-4380-9d9c-052620feee17 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:51:52.464339 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5adf6f63-03d6-4380-9d9c-052620feee17 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 1eeec04f-d94e-4625-ab65-6d227a640f2f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:51:52.471261 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5adf6f63-03d6-4380-9d9c-052620feee17 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:51:52.471748 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5adf6f63-03d6-4380-9d9c-052620feee17 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:51:52.478933 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5adf6f63-03d6-4380-9d9c-052620feee17 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:51:52.478933 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5adf6f63-03d6-4380-9d9c-052620feee17 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:51:52.478933 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5adf6f63-03d6-4380-9d9c-052620feee17 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:51:52.478933 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5adf6f63-03d6-4380-9d9c-052620feee17 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:51:52.612480 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5adf6f63-03d6-4380-9d9c-052620feee17 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:51:52.622620 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5adf6f63-03d6-4380-9d9c-052620feee17 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:51:52.624623 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5adf6f63-03d6-4380-9d9c-052620feee17 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:51:52.629504 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5adf6f63-03d6-4380-9d9c-052620feee17 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f" status: 200 len: 1723 microversion: 2.20 time: 0.166260 Oct 19 03:51:52.629504 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3118/6304] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:51:52 2022] GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:51:53.653554 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-bbb65211-d32d-436d-b576-5c8d24ce4d7d tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:51:53.654298 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-bbb65211-d32d-436d-b576-5c8d24ce4d7d tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 1eeec04f-d94e-4625-ab65-6d227a640f2f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:51:53.660364 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bbb65211-d32d-436d-b576-5c8d24ce4d7d tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:51:53.660861 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bbb65211-d32d-436d-b576-5c8d24ce4d7d tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:51:53.661307 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bbb65211-d32d-436d-b576-5c8d24ce4d7d tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:51:53.662037 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bbb65211-d32d-436d-b576-5c8d24ce4d7d tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:51:53.662495 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bbb65211-d32d-436d-b576-5c8d24ce4d7d tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:51:53.662930 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bbb65211-d32d-436d-b576-5c8d24ce4d7d tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:51:53.807450 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-bbb65211-d32d-436d-b576-5c8d24ce4d7d tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:51:53.815567 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-bbb65211-d32d-436d-b576-5c8d24ce4d7d tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:51:53.817558 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-bbb65211-d32d-436d-b576-5c8d24ce4d7d tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:51:53.818727 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-bbb65211-d32d-436d-b576-5c8d24ce4d7d tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f" status: 200 len: 1744 microversion: 2.20 time: 0.170057 Oct 19 03:51:53.819297 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3187/6305] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:51:53 2022] GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f => generated 1744 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:51:54.844862 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c8821556-10ee-4d1a-a401-d673ec371655 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:51:54.845529 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c8821556-10ee-4d1a-a401-d673ec371655 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 1eeec04f-d94e-4625-ab65-6d227a640f2f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:51:54.853227 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c8821556-10ee-4d1a-a401-d673ec371655 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:51:54.853748 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c8821556-10ee-4d1a-a401-d673ec371655 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:51:54.854190 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c8821556-10ee-4d1a-a401-d673ec371655 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:51:54.855024 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c8821556-10ee-4d1a-a401-d673ec371655 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:51:54.855487 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c8821556-10ee-4d1a-a401-d673ec371655 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:51:54.855923 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c8821556-10ee-4d1a-a401-d673ec371655 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:51:55.033681 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c8821556-10ee-4d1a-a401-d673ec371655 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:51:55.044347 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c8821556-10ee-4d1a-a401-d673ec371655 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:51:55.045819 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c8821556-10ee-4d1a-a401-d673ec371655 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:51:55.048922 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c8821556-10ee-4d1a-a401-d673ec371655 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f" status: 200 len: 1739 microversion: 2.20 time: 0.208301 Oct 19 03:51:55.055433 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3119/6306] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:51:54 2022] GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f => generated 1739 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:51:56.079757 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b9ee3265-b26d-4b11-a612-babbe500d04d tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:51:56.080291 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b9ee3265-b26d-4b11-a612-babbe500d04d tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 1eeec04f-d94e-4625-ab65-6d227a640f2f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:51:56.087922 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b9ee3265-b26d-4b11-a612-babbe500d04d tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:51:56.089504 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b9ee3265-b26d-4b11-a612-babbe500d04d tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:51:56.090007 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b9ee3265-b26d-4b11-a612-babbe500d04d tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:51:56.090763 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b9ee3265-b26d-4b11-a612-babbe500d04d tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:51:56.091410 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b9ee3265-b26d-4b11-a612-babbe500d04d tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:51:56.092026 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b9ee3265-b26d-4b11-a612-babbe500d04d tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:51:56.299659 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b9ee3265-b26d-4b11-a612-babbe500d04d tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:51:56.310090 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b9ee3265-b26d-4b11-a612-babbe500d04d tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:51:56.330727 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b9ee3265-b26d-4b11-a612-babbe500d04d tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:51:56.333092 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b9ee3265-b26d-4b11-a612-babbe500d04d tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f" status: 200 len: 1739 microversion: 2.20 time: 0.256550 Oct 19 03:51:56.338214 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3188/6307] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:51:56 2022] GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f => generated 1739 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:51:57.232685 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-75945aab-addd-4fed-8a2d-e5f91b0591b5 req-ea58fbc3-c430-4a71-9156-0ec98caeae81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1eeec04f-d94e-4625-ab65-6d227a640f2f", "name": "network-vif-plugged", "status": "completed", "tag": "9487bc37-2fe4-4fbc-914a-50a09e00b655"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:51:57.258678 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-75945aab-addd-4fed-8a2d-e5f91b0591b5 req-ea58fbc3-c430-4a71-9156-0ec98caeae81 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:51:57.262168 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-75945aab-addd-4fed-8a2d-e5f91b0591b5 req-ea58fbc3-c430-4a71-9156-0ec98caeae81 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:51:57.263001 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-75945aab-addd-4fed-8a2d-e5f91b0591b5 req-ea58fbc3-c430-4a71-9156-0ec98caeae81 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:51:57.296674 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-75945aab-addd-4fed-8a2d-e5f91b0591b5 req-ea58fbc3-c430-4a71-9156-0ec98caeae81 service nova] Creating event network-vif-plugged:9487bc37-2fe4-4fbc-914a-50a09e00b655 for instance 1eeec04f-d94e-4625-ab65-6d227a640f2f on n-h2-861333-8 Oct 19 03:51:57.308382 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-75945aab-addd-4fed-8a2d-e5f91b0591b5 req-ea58fbc3-c430-4a71-9156-0ec98caeae81 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079632 Oct 19 03:51:57.309000 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3120/6308] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:51:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:51:57.361731 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3f1e70a8-3bac-47a1-9d3a-055ef3cee418 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:51:57.362257 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-3f1e70a8-3bac-47a1-9d3a-055ef3cee418 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 1eeec04f-d94e-4625-ab65-6d227a640f2f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:51:57.375785 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3f1e70a8-3bac-47a1-9d3a-055ef3cee418 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:51:57.379874 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3f1e70a8-3bac-47a1-9d3a-055ef3cee418 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:51:57.379874 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3f1e70a8-3bac-47a1-9d3a-055ef3cee418 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:51:57.380540 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3f1e70a8-3bac-47a1-9d3a-055ef3cee418 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:51:57.381016 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3f1e70a8-3bac-47a1-9d3a-055ef3cee418 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:51:57.382375 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3f1e70a8-3bac-47a1-9d3a-055ef3cee418 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:51:57.674142 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-3f1e70a8-3bac-47a1-9d3a-055ef3cee418 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:51:57.683816 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-3f1e70a8-3bac-47a1-9d3a-055ef3cee418 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:51:57.685403 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-3f1e70a8-3bac-47a1-9d3a-055ef3cee418 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:51:57.686598 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-3f1e70a8-3bac-47a1-9d3a-055ef3cee418 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f" status: 200 len: 1739 microversion: 2.20 time: 0.329296 Oct 19 03:51:57.689727 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3189/6309] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:51:57 2022] GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f => generated 1739 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:51:58.724301 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b5533284-7c4d-4f87-a346-8ea763c56e9e tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:51:58.725733 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b5533284-7c4d-4f87-a346-8ea763c56e9e tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 1eeec04f-d94e-4625-ab65-6d227a640f2f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:51:58.735036 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b5533284-7c4d-4f87-a346-8ea763c56e9e tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:51:58.735830 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b5533284-7c4d-4f87-a346-8ea763c56e9e tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:51:58.736581 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b5533284-7c4d-4f87-a346-8ea763c56e9e tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:51:58.737950 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b5533284-7c4d-4f87-a346-8ea763c56e9e tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:51:58.738802 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b5533284-7c4d-4f87-a346-8ea763c56e9e tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:51:58.739431 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b5533284-7c4d-4f87-a346-8ea763c56e9e tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:51:59.011413 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9a423c88-0b01-48be-a1d1-b9bd1126de6a tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:51:59.014775 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9a423c88-0b01-48be-a1d1-b9bd1126de6a tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: 2b57ed72-0e3a-43c8-b552-875524942849] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:51:59.025579 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9a423c88-0b01-48be-a1d1-b9bd1126de6a tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:51:59.026352 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9a423c88-0b01-48be-a1d1-b9bd1126de6a tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:51:59.026994 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9a423c88-0b01-48be-a1d1-b9bd1126de6a tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:51:59.027901 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9a423c88-0b01-48be-a1d1-b9bd1126de6a tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:51:59.028534 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9a423c88-0b01-48be-a1d1-b9bd1126de6a tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:51:59.029138 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9a423c88-0b01-48be-a1d1-b9bd1126de6a tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:51:59.089056 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b5533284-7c4d-4f87-a346-8ea763c56e9e tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:51:59.116869 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b5533284-7c4d-4f87-a346-8ea763c56e9e tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:51:59.118973 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b5533284-7c4d-4f87-a346-8ea763c56e9e tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:51:59.120195 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b5533284-7c4d-4f87-a346-8ea763c56e9e tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f" status: 200 len: 1739 microversion: 2.20 time: 0.411177 Oct 19 03:51:59.133776 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9a423c88-0b01-48be-a1d1-b9bd1126de6a tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "POST /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849/action" status: 200 len: 24564 microversion: 2.1 time: 0.126114 Oct 19 03:51:59.144774 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3190/6310] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:51:59 2022] POST /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849/action => generated 24564 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 03:51:59.150143 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3121/6311] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:51:58 2022] GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f => generated 1739 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:52:00.148965 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1c7f5729-89f1-46f9-8ddc-10f67d3975c1 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:52:00.150383 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1c7f5729-89f1-46f9-8ddc-10f67d3975c1 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 1eeec04f-d94e-4625-ab65-6d227a640f2f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:52:00.159265 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1c7f5729-89f1-46f9-8ddc-10f67d3975c1 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:00.160012 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1c7f5729-89f1-46f9-8ddc-10f67d3975c1 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:00.161180 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1c7f5729-89f1-46f9-8ddc-10f67d3975c1 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:00.162274 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1c7f5729-89f1-46f9-8ddc-10f67d3975c1 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:00.162899 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1c7f5729-89f1-46f9-8ddc-10f67d3975c1 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:00.163494 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1c7f5729-89f1-46f9-8ddc-10f67d3975c1 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:00.500474 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-1c7f5729-89f1-46f9-8ddc-10f67d3975c1 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:00.511175 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-1c7f5729-89f1-46f9-8ddc-10f67d3975c1 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:00.513209 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-1c7f5729-89f1-46f9-8ddc-10f67d3975c1 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:00.514538 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1c7f5729-89f1-46f9-8ddc-10f67d3975c1 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f" status: 200 len: 1739 microversion: 2.20 time: 0.372164 Oct 19 03:52:00.525514 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3191/6312] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:52:00 2022] GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f => generated 1739 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:52:01.544871 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1cfc00b0-9c2d-4b74-a374-f1907ca02ac7 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:52:01.546285 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1cfc00b0-9c2d-4b74-a374-f1907ca02ac7 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 1eeec04f-d94e-4625-ab65-6d227a640f2f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:52:01.556943 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1cfc00b0-9c2d-4b74-a374-f1907ca02ac7 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:01.557791 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1cfc00b0-9c2d-4b74-a374-f1907ca02ac7 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:01.558604 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1cfc00b0-9c2d-4b74-a374-f1907ca02ac7 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:01.566544 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1cfc00b0-9c2d-4b74-a374-f1907ca02ac7 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:01.569839 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1cfc00b0-9c2d-4b74-a374-f1907ca02ac7 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:01.570521 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1cfc00b0-9c2d-4b74-a374-f1907ca02ac7 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:01.795899 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-1cfc00b0-9c2d-4b74-a374-f1907ca02ac7 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:01.809214 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-1cfc00b0-9c2d-4b74-a374-f1907ca02ac7 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:01.810783 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-1cfc00b0-9c2d-4b74-a374-f1907ca02ac7 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:01.812178 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1cfc00b0-9c2d-4b74-a374-f1907ca02ac7 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f" status: 200 len: 1739 microversion: 2.20 time: 0.271766 Oct 19 03:52:01.812938 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3122/6313] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:52:01 2022] GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f => generated 1739 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:52:02.448557 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-518f5c5c-750e-4da7-b67c-58c1e57aa514 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-1659476090-access_point-1530827824", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "networks": [{"uuid": "81d2c7e4-9674-45ac-858a-53d65002f794"}], "key_name": "tempest-TestSecurityGroupsBasicOps-93452807", "security_groups": [{"name": "tempest-secgroup_access--1887388595"}, {"name": "tempest-secgroup_general--1782770951"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:52:02.466448 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=4 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:52:02.656018 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.network.neutron [None req-518f5c5c-750e-4da7-b67c-58c1e57aa514 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] validate_networks() for [('81d2c7e4-9674-45ac-858a-53d65002f794', None, None, None, None, None)] {{(pid=121135) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:52:02.850091 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8297cc42-0f9a-4e57-adf8-6a8b85698f43 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:52:02.850711 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8297cc42-0f9a-4e57-adf8-6a8b85698f43 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 1eeec04f-d94e-4625-ab65-6d227a640f2f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:52:02.865731 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8297cc42-0f9a-4e57-adf8-6a8b85698f43 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:02.866571 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8297cc42-0f9a-4e57-adf8-6a8b85698f43 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:02.871187 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8297cc42-0f9a-4e57-adf8-6a8b85698f43 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:02.871187 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8297cc42-0f9a-4e57-adf8-6a8b85698f43 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:02.871187 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8297cc42-0f9a-4e57-adf8-6a8b85698f43 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:02.871187 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8297cc42-0f9a-4e57-adf8-6a8b85698f43 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:03.256620 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8297cc42-0f9a-4e57-adf8-6a8b85698f43 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:03.268572 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8297cc42-0f9a-4e57-adf8-6a8b85698f43 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:03.271927 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8297cc42-0f9a-4e57-adf8-6a8b85698f43 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:03.286148 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8297cc42-0f9a-4e57-adf8-6a8b85698f43 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f" status: 200 len: 1739 microversion: 2.20 time: 0.436630 Oct 19 03:52:03.286148 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3123/6314] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:52:02 2022] GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f => generated 1739 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:52:03.466371 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-518f5c5c-750e-4da7-b67c-58c1e57aa514 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Flavor limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:52:03.466889 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-518f5c5c-750e-4da7-b67c-58c1e57aa514 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Image limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:52:03.467252 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-518f5c5c-750e-4da7-b67c-58c1e57aa514 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Flavor pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:52:03.467659 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-518f5c5c-750e-4da7-b67c-58c1e57aa514 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Image pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:52:03.468816 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-518f5c5c-750e-4da7-b67c-58c1e57aa514 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:52:03.479896 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-518f5c5c-750e-4da7-b67c-58c1e57aa514 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:03.480635 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-518f5c5c-750e-4da7-b67c-58c1e57aa514 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:03.481553 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-518f5c5c-750e-4da7-b67c-58c1e57aa514 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:03.482283 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-518f5c5c-750e-4da7-b67c-58c1e57aa514 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:03.482732 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-518f5c5c-750e-4da7-b67c-58c1e57aa514 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:03.483748 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-518f5c5c-750e-4da7-b67c-58c1e57aa514 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:03.513810 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-518f5c5c-750e-4da7-b67c-58c1e57aa514 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Getting quotas for project 6f4f31b5836f40e580c28153626ec6ce. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:52:03.521296 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-518f5c5c-750e-4da7-b67c-58c1e57aa514 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Getting quotas for user 8d8ec7142c79407b81108e90ce3657d5 and project 6f4f31b5836f40e580c28153626ec6ce. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:52:03.538986 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-518f5c5c-750e-4da7-b67c-58c1e57aa514 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Going to run 1 instances... {{(pid=121135) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:52:03.541299 n-d-861333-8 devstack@n-api.service[121135]: WARNING nova.utils [None req-518f5c5c-750e-4da7-b67c-58c1e57aa514 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-1659476090-access_point-1530827824 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-1659476090-ac Oct 19 03:52:03.542555 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-518f5c5c-750e-4da7-b67c-58c1e57aa514 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] [instance: 8346e5ae-6c1f-4ab8-9ebf-0bb59c802a8b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121135) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:52:03.722421 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-518f5c5c-750e-4da7-b67c-58c1e57aa514 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 458 microversion: 2.1 time: 1.279879 Oct 19 03:52:03.723750 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3192/6315] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:52:02 2022] POST /compute/v2.1/servers => generated 458 bytes in 1282 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 03:52:03.734554 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3014624c-f395-4c86-83ad-735e3ead8f4c tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:52:03.735299 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3014624c-f395-4c86-83ad-735e3ead8f4c tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] [instance: 8346e5ae-6c1f-4ab8-9ebf-0bb59c802a8b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:52:03.802520 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-3014624c-f395-4c86-83ad-735e3ead8f4c tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d8ec7142c79407b81108e90ce3657d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f4f31b5836f40e580c28153626ec6ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:03.817709 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3014624c-f395-4c86-83ad-735e3ead8f4c tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] 10.222.0.52 "GET /compute/v2.1/servers/8346e5ae-6c1f-4ab8-9ebf-0bb59c802a8b" status: 200 len: 1293 microversion: 2.1 time: 0.086227 Oct 19 03:52:03.832201 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3124/6316] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:52:03 2022] GET /compute/v2.1/servers/8346e5ae-6c1f-4ab8-9ebf-0bb59c802a8b => generated 1293 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:52:04.304343 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-09debb70-ddd9-4b77-a3a2-90be8d490b92 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:52:04.305014 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-09debb70-ddd9-4b77-a3a2-90be8d490b92 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 1eeec04f-d94e-4625-ab65-6d227a640f2f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:52:04.334443 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-09debb70-ddd9-4b77-a3a2-90be8d490b92 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:04.346407 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-09debb70-ddd9-4b77-a3a2-90be8d490b92 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:04.348737 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-09debb70-ddd9-4b77-a3a2-90be8d490b92 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:04.352238 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-09debb70-ddd9-4b77-a3a2-90be8d490b92 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:04.352735 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-09debb70-ddd9-4b77-a3a2-90be8d490b92 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:04.353185 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-09debb70-ddd9-4b77-a3a2-90be8d490b92 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:04.581249 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-09debb70-ddd9-4b77-a3a2-90be8d490b92 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:04.593918 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-09debb70-ddd9-4b77-a3a2-90be8d490b92 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:04.596141 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-09debb70-ddd9-4b77-a3a2-90be8d490b92 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:04.597414 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-09debb70-ddd9-4b77-a3a2-90be8d490b92 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f" status: 200 len: 1739 microversion: 2.20 time: 0.297662 Oct 19 03:52:04.598011 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3193/6317] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:52:04 2022] GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f => generated 1739 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:52:04.846948 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a83b2367-cbb2-4372-b8b4-e068a5a6128a tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:52:04.847775 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a83b2367-cbb2-4372-b8b4-e068a5a6128a tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] [instance: 8346e5ae-6c1f-4ab8-9ebf-0bb59c802a8b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:52:04.909053 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a83b2367-cbb2-4372-b8b4-e068a5a6128a tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d8ec7142c79407b81108e90ce3657d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f4f31b5836f40e580c28153626ec6ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:04.916705 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a83b2367-cbb2-4372-b8b4-e068a5a6128a tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] 10.222.0.52 "GET /compute/v2.1/servers/8346e5ae-6c1f-4ab8-9ebf-0bb59c802a8b" status: 200 len: 1293 microversion: 2.1 time: 0.074321 Oct 19 03:52:04.917276 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3125/6318] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:52:04 2022] GET /compute/v2.1/servers/8346e5ae-6c1f-4ab8-9ebf-0bb59c802a8b => generated 1293 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:52:05.628686 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-77da9350-471f-49c6-9044-935c4f9e1927 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:52:05.629336 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-77da9350-471f-49c6-9044-935c4f9e1927 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 1eeec04f-d94e-4625-ab65-6d227a640f2f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:52:05.637345 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-77da9350-471f-49c6-9044-935c4f9e1927 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:05.641187 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-77da9350-471f-49c6-9044-935c4f9e1927 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:05.641187 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-77da9350-471f-49c6-9044-935c4f9e1927 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:05.641187 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-77da9350-471f-49c6-9044-935c4f9e1927 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:05.641187 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-77da9350-471f-49c6-9044-935c4f9e1927 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:05.641187 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-77da9350-471f-49c6-9044-935c4f9e1927 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:05.828485 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-77da9350-471f-49c6-9044-935c4f9e1927 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:05.842402 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-77da9350-471f-49c6-9044-935c4f9e1927 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:05.846379 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-77da9350-471f-49c6-9044-935c4f9e1927 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:05.849882 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-77da9350-471f-49c6-9044-935c4f9e1927 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f" status: 200 len: 1739 microversion: 2.20 time: 0.224195 Oct 19 03:52:05.851377 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3194/6319] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:52:05 2022] GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f => generated 1739 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:52:05.940248 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-63ef1690-7529-41b1-b733-8ffb2f036b76 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:52:05.940870 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-63ef1690-7529-41b1-b733-8ffb2f036b76 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] [instance: 8346e5ae-6c1f-4ab8-9ebf-0bb59c802a8b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:52:05.951860 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-63ef1690-7529-41b1-b733-8ffb2f036b76 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:05.952364 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-63ef1690-7529-41b1-b733-8ffb2f036b76 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:05.952815 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-63ef1690-7529-41b1-b733-8ffb2f036b76 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:05.953560 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-63ef1690-7529-41b1-b733-8ffb2f036b76 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:05.954208 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-63ef1690-7529-41b1-b733-8ffb2f036b76 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:05.954642 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-63ef1690-7529-41b1-b733-8ffb2f036b76 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:06.036692 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-63ef1690-7529-41b1-b733-8ffb2f036b76 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d8ec7142c79407b81108e90ce3657d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f4f31b5836f40e580c28153626ec6ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:06.045005 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-63ef1690-7529-41b1-b733-8ffb2f036b76 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] 10.222.0.52 "GET /compute/v2.1/servers/8346e5ae-6c1f-4ab8-9ebf-0bb59c802a8b" status: 200 len: 1345 microversion: 2.1 time: 0.108701 Oct 19 03:52:06.062141 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3126/6320] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:52:05 2022] GET /compute/v2.1/servers/8346e5ae-6c1f-4ab8-9ebf-0bb59c802a8b => generated 1345 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:52:06.876514 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5bb33d14-2c14-49a3-9303-14ed601f5aa9 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:52:06.877941 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-5bb33d14-2c14-49a3-9303-14ed601f5aa9 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 1eeec04f-d94e-4625-ab65-6d227a640f2f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:52:06.890345 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5bb33d14-2c14-49a3-9303-14ed601f5aa9 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:06.894088 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5bb33d14-2c14-49a3-9303-14ed601f5aa9 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:06.894860 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5bb33d14-2c14-49a3-9303-14ed601f5aa9 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:06.898240 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5bb33d14-2c14-49a3-9303-14ed601f5aa9 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:06.898973 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5bb33d14-2c14-49a3-9303-14ed601f5aa9 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:06.901505 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5bb33d14-2c14-49a3-9303-14ed601f5aa9 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:07.073113 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-51bc6167-b71a-4d39-bb38-3bd933a2c207 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:52:07.073772 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-51bc6167-b71a-4d39-bb38-3bd933a2c207 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] [instance: 8346e5ae-6c1f-4ab8-9ebf-0bb59c802a8b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:52:07.086860 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=37 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:52:07.090871 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-51bc6167-b71a-4d39-bb38-3bd933a2c207 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:07.091643 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-51bc6167-b71a-4d39-bb38-3bd933a2c207 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:07.092403 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-51bc6167-b71a-4d39-bb38-3bd933a2c207 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:07.093435 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-51bc6167-b71a-4d39-bb38-3bd933a2c207 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:07.094117 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-51bc6167-b71a-4d39-bb38-3bd933a2c207 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:07.094549 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-51bc6167-b71a-4d39-bb38-3bd933a2c207 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:07.103676 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:52:07.225124 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-5bb33d14-2c14-49a3-9303-14ed601f5aa9 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:07.228431 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-51bc6167-b71a-4d39-bb38-3bd933a2c207 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d8ec7142c79407b81108e90ce3657d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f4f31b5836f40e580c28153626ec6ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:07.244156 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-5bb33d14-2c14-49a3-9303-14ed601f5aa9 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:07.246169 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-5bb33d14-2c14-49a3-9303-14ed601f5aa9 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:07.249320 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-51bc6167-b71a-4d39-bb38-3bd933a2c207 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] 10.222.0.52 "GET /compute/v2.1/servers/8346e5ae-6c1f-4ab8-9ebf-0bb59c802a8b" status: 200 len: 1363 microversion: 2.1 time: 0.179414 Oct 19 03:52:07.249320 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3127/6321] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:52:07 2022] GET /compute/v2.1/servers/8346e5ae-6c1f-4ab8-9ebf-0bb59c802a8b => generated 1363 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:52:07.252770 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5bb33d14-2c14-49a3-9303-14ed601f5aa9 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f" status: 200 len: 1739 microversion: 2.20 time: 0.379602 Oct 19 03:52:07.273767 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3195/6322] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:52:06 2022] GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f => generated 1739 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:52:08.274079 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-fe6ae660-f00a-4f08-8417-faa5c650f4cf tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:52:08.276561 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-fe6ae660-f00a-4f08-8417-faa5c650f4cf tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] [instance: 8346e5ae-6c1f-4ab8-9ebf-0bb59c802a8b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:52:08.281703 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-75d7fa3e-5809-4c9b-91a6-5de6180c5746 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:52:08.282408 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-75d7fa3e-5809-4c9b-91a6-5de6180c5746 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 1eeec04f-d94e-4625-ab65-6d227a640f2f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:52:08.283915 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fe6ae660-f00a-4f08-8417-faa5c650f4cf tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:08.284416 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fe6ae660-f00a-4f08-8417-faa5c650f4cf tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:08.285543 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fe6ae660-f00a-4f08-8417-faa5c650f4cf tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:08.286771 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fe6ae660-f00a-4f08-8417-faa5c650f4cf tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:08.287241 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fe6ae660-f00a-4f08-8417-faa5c650f4cf tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:08.287675 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fe6ae660-f00a-4f08-8417-faa5c650f4cf tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:08.288028 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=4 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:52:08.291674 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-75d7fa3e-5809-4c9b-91a6-5de6180c5746 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:08.292389 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-75d7fa3e-5809-4c9b-91a6-5de6180c5746 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:08.292900 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-75d7fa3e-5809-4c9b-91a6-5de6180c5746 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:08.293692 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-75d7fa3e-5809-4c9b-91a6-5de6180c5746 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:08.294182 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-75d7fa3e-5809-4c9b-91a6-5de6180c5746 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:08.295069 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-75d7fa3e-5809-4c9b-91a6-5de6180c5746 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:08.537279 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-fe6ae660-f00a-4f08-8417-faa5c650f4cf tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d8ec7142c79407b81108e90ce3657d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f4f31b5836f40e580c28153626ec6ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:08.539132 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-fe6ae660-f00a-4f08-8417-faa5c650f4cf tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] 10.222.0.52 "GET /compute/v2.1/servers/8346e5ae-6c1f-4ab8-9ebf-0bb59c802a8b" status: 200 len: 1471 microversion: 2.1 time: 0.269376 Oct 19 03:52:08.539720 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3128/6323] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:52:08 2022] GET /compute/v2.1/servers/8346e5ae-6c1f-4ab8-9ebf-0bb59c802a8b => generated 1471 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:52:08.549685 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-75d7fa3e-5809-4c9b-91a6-5de6180c5746 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:08.565951 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-75d7fa3e-5809-4c9b-91a6-5de6180c5746 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:08.565951 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-75d7fa3e-5809-4c9b-91a6-5de6180c5746 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:08.566576 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-75d7fa3e-5809-4c9b-91a6-5de6180c5746 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f" status: 200 len: 1739 microversion: 2.20 time: 0.289080 Oct 19 03:52:08.567898 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3196/6324] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:52:08 2022] GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f => generated 1739 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:52:09.508339 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-d89c6e82-020c-43da-abfe-8060fd5f0398 req-71ff04c6-4595-4c52-842a-cb7491ab9f66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8346e5ae-6c1f-4ab8-9ebf-0bb59c802a8b", "tag": "bdecb113-13e4-4aae-a58a-012ce7f0cf31"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:52:09.520626 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-d89c6e82-020c-43da-abfe-8060fd5f0398 req-71ff04c6-4595-4c52-842a-cb7491ab9f66 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:09.521127 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-d89c6e82-020c-43da-abfe-8060fd5f0398 req-71ff04c6-4595-4c52-842a-cb7491ab9f66 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:09.521678 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-d89c6e82-020c-43da-abfe-8060fd5f0398 req-71ff04c6-4595-4c52-842a-cb7491ab9f66 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:09.533871 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-d89c6e82-020c-43da-abfe-8060fd5f0398 req-71ff04c6-4595-4c52-842a-cb7491ab9f66 service nova] Creating event network-changed:bdecb113-13e4-4aae-a58a-012ce7f0cf31 for instance 8346e5ae-6c1f-4ab8-9ebf-0bb59c802a8b on n-h2-861333-8 Oct 19 03:52:09.539300 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-d89c6e82-020c-43da-abfe-8060fd5f0398 req-71ff04c6-4595-4c52-842a-cb7491ab9f66 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036062 Oct 19 03:52:09.540224 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3129/6325] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:52:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:52:09.565462 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2aa1b21f-d33c-4569-9fd2-b87b82de1a29 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:52:09.570862 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-2aa1b21f-d33c-4569-9fd2-b87b82de1a29 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] [instance: 8346e5ae-6c1f-4ab8-9ebf-0bb59c802a8b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:52:09.581906 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2aa1b21f-d33c-4569-9fd2-b87b82de1a29 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:09.583044 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2aa1b21f-d33c-4569-9fd2-b87b82de1a29 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:09.583492 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2aa1b21f-d33c-4569-9fd2-b87b82de1a29 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:09.584294 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2aa1b21f-d33c-4569-9fd2-b87b82de1a29 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:09.584845 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2aa1b21f-d33c-4569-9fd2-b87b82de1a29 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:09.585934 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2aa1b21f-d33c-4569-9fd2-b87b82de1a29 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:09.596204 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4e16ff33-e21e-49e3-b90b-a328f4dd9de8 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:52:09.596976 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4e16ff33-e21e-49e3-b90b-a328f4dd9de8 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 1eeec04f-d94e-4625-ab65-6d227a640f2f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:52:09.605568 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4e16ff33-e21e-49e3-b90b-a328f4dd9de8 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:09.606059 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4e16ff33-e21e-49e3-b90b-a328f4dd9de8 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:09.606513 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4e16ff33-e21e-49e3-b90b-a328f4dd9de8 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:09.607232 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4e16ff33-e21e-49e3-b90b-a328f4dd9de8 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:09.607699 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4e16ff33-e21e-49e3-b90b-a328f4dd9de8 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:09.608132 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4e16ff33-e21e-49e3-b90b-a328f4dd9de8 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:09.966347 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-4e16ff33-e21e-49e3-b90b-a328f4dd9de8 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:09.975037 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-2aa1b21f-d33c-4569-9fd2-b87b82de1a29 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d8ec7142c79407b81108e90ce3657d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f4f31b5836f40e580c28153626ec6ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:09.977339 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=88 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:52:09.979433 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-4e16ff33-e21e-49e3-b90b-a328f4dd9de8 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:09.980890 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-4e16ff33-e21e-49e3-b90b-a328f4dd9de8 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:09.984588 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2aa1b21f-d33c-4569-9fd2-b87b82de1a29 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] 10.222.0.52 "GET /compute/v2.1/servers/8346e5ae-6c1f-4ab8-9ebf-0bb59c802a8b" status: 200 len: 1471 microversion: 2.1 time: 0.424345 Oct 19 03:52:09.997394 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4e16ff33-e21e-49e3-b90b-a328f4dd9de8 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f" status: 200 len: 1739 microversion: 2.20 time: 0.390895 Oct 19 03:52:09.997394 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3130/6326] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:52:09 2022] GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f => generated 1739 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:52:10.004161 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3197/6327] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:52:09 2022] GET /compute/v2.1/servers/8346e5ae-6c1f-4ab8-9ebf-0bb59c802a8b => generated 1471 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:52:11.009395 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-78489f4f-5644-4c3e-a0cc-72097ed3b217 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:52:11.010093 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-78489f4f-5644-4c3e-a0cc-72097ed3b217 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] [instance: 8346e5ae-6c1f-4ab8-9ebf-0bb59c802a8b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:52:11.013848 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1d71f16d-1926-45e2-8a21-8f3245cca8bf tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:52:11.013848 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1d71f16d-1926-45e2-8a21-8f3245cca8bf tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 1eeec04f-d94e-4625-ab65-6d227a640f2f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:52:11.018448 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-78489f4f-5644-4c3e-a0cc-72097ed3b217 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:11.019500 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-78489f4f-5644-4c3e-a0cc-72097ed3b217 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:11.020765 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-78489f4f-5644-4c3e-a0cc-72097ed3b217 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:11.021735 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-78489f4f-5644-4c3e-a0cc-72097ed3b217 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:11.022357 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-78489f4f-5644-4c3e-a0cc-72097ed3b217 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:11.022480 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1d71f16d-1926-45e2-8a21-8f3245cca8bf tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:11.022968 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1d71f16d-1926-45e2-8a21-8f3245cca8bf tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:11.023086 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-78489f4f-5644-4c3e-a0cc-72097ed3b217 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:11.023486 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1d71f16d-1926-45e2-8a21-8f3245cca8bf tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:11.024428 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1d71f16d-1926-45e2-8a21-8f3245cca8bf tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:11.024955 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1d71f16d-1926-45e2-8a21-8f3245cca8bf tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:11.025486 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1d71f16d-1926-45e2-8a21-8f3245cca8bf tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:11.227108 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-1d71f16d-1926-45e2-8a21-8f3245cca8bf tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:11.235916 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-1d71f16d-1926-45e2-8a21-8f3245cca8bf tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:11.237399 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-1d71f16d-1926-45e2-8a21-8f3245cca8bf tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:11.238578 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1d71f16d-1926-45e2-8a21-8f3245cca8bf tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f" status: 200 len: 1721 microversion: 2.20 time: 0.230633 Oct 19 03:52:11.239387 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3198/6328] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:52:11 2022] GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f => generated 1721 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:52:11.246007 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-78489f4f-5644-4c3e-a0cc-72097ed3b217 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d8ec7142c79407b81108e90ce3657d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f4f31b5836f40e580c28153626ec6ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:11.254574 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-78489f4f-5644-4c3e-a0cc-72097ed3b217 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] 10.222.0.52 "GET /compute/v2.1/servers/8346e5ae-6c1f-4ab8-9ebf-0bb59c802a8b" status: 200 len: 1471 microversion: 2.1 time: 0.249973 Oct 19 03:52:11.255424 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3131/6329] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:52:11 2022] GET /compute/v2.1/servers/8346e5ae-6c1f-4ab8-9ebf-0bb59c802a8b => generated 1471 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:52:12.281807 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0a6d9ce0-3985-4c1c-a295-3574f60dd5f4 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:52:12.282349 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6fdfa765-019a-4a1f-821b-a0dcc3aa8b6c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:52:12.282738 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0a6d9ce0-3985-4c1c-a295-3574f60dd5f4 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] [instance: 8346e5ae-6c1f-4ab8-9ebf-0bb59c802a8b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:52:12.282833 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6fdfa765-019a-4a1f-821b-a0dcc3aa8b6c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 1eeec04f-d94e-4625-ab65-6d227a640f2f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:52:12.290526 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0a6d9ce0-3985-4c1c-a295-3574f60dd5f4 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:12.290919 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6fdfa765-019a-4a1f-821b-a0dcc3aa8b6c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:12.291164 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0a6d9ce0-3985-4c1c-a295-3574f60dd5f4 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:12.291611 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0a6d9ce0-3985-4c1c-a295-3574f60dd5f4 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:12.291980 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6fdfa765-019a-4a1f-821b-a0dcc3aa8b6c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:12.292516 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6fdfa765-019a-4a1f-821b-a0dcc3aa8b6c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:12.292787 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0a6d9ce0-3985-4c1c-a295-3574f60dd5f4 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:12.293263 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0a6d9ce0-3985-4c1c-a295-3574f60dd5f4 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:12.293577 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6fdfa765-019a-4a1f-821b-a0dcc3aa8b6c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:12.293737 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0a6d9ce0-3985-4c1c-a295-3574f60dd5f4 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:12.294097 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6fdfa765-019a-4a1f-821b-a0dcc3aa8b6c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:12.294529 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6fdfa765-019a-4a1f-821b-a0dcc3aa8b6c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:12.518772 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-6fdfa765-019a-4a1f-821b-a0dcc3aa8b6c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:12.523407 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0a6d9ce0-3985-4c1c-a295-3574f60dd5f4 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d8ec7142c79407b81108e90ce3657d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f4f31b5836f40e580c28153626ec6ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:12.528587 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-6fdfa765-019a-4a1f-821b-a0dcc3aa8b6c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:12.530091 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-6fdfa765-019a-4a1f-821b-a0dcc3aa8b6c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:12.531366 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6fdfa765-019a-4a1f-821b-a0dcc3aa8b6c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f" status: 200 len: 1721 microversion: 2.20 time: 0.255128 Oct 19 03:52:12.531910 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0a6d9ce0-3985-4c1c-a295-3574f60dd5f4 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] 10.222.0.52 "GET /compute/v2.1/servers/8346e5ae-6c1f-4ab8-9ebf-0bb59c802a8b" status: 200 len: 1471 microversion: 2.1 time: 0.254204 Oct 19 03:52:12.532049 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3199/6330] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:52:12 2022] GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f => generated 1721 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:52:12.533069 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3132/6331] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:52:12 2022] GET /compute/v2.1/servers/8346e5ae-6c1f-4ab8-9ebf-0bb59c802a8b => generated 1471 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:52:13.167386 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-74656d53-5e97-4692-b990-c4364a381540 req-fd01ea20-b2bb-49da-b84a-7ca1f8202463 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1eeec04f-d94e-4625-ab65-6d227a640f2f", "name": "network-vif-unplugged", "status": "completed", "tag": "9487bc37-2fe4-4fbc-914a-50a09e00b655"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:52:13.178911 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-74656d53-5e97-4692-b990-c4364a381540 req-fd01ea20-b2bb-49da-b84a-7ca1f8202463 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:13.179393 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-74656d53-5e97-4692-b990-c4364a381540 req-fd01ea20-b2bb-49da-b84a-7ca1f8202463 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:13.179822 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-74656d53-5e97-4692-b990-c4364a381540 req-fd01ea20-b2bb-49da-b84a-7ca1f8202463 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:13.195507 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-74656d53-5e97-4692-b990-c4364a381540 req-fd01ea20-b2bb-49da-b84a-7ca1f8202463 service nova] Creating event network-vif-unplugged:9487bc37-2fe4-4fbc-914a-50a09e00b655 for instance 1eeec04f-d94e-4625-ab65-6d227a640f2f on n-h2-861333-8 Oct 19 03:52:13.200568 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-74656d53-5e97-4692-b990-c4364a381540 req-fd01ea20-b2bb-49da-b84a-7ca1f8202463 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037258 Oct 19 03:52:13.201412 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3200/6332] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:52:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:52:13.559287 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8d4d0f00-210a-4b41-b454-dd3e1ddcbaea tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:52:13.559914 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8d4d0f00-210a-4b41-b454-dd3e1ddcbaea tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 1eeec04f-d94e-4625-ab65-6d227a640f2f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:52:13.565520 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4176b713-bc7a-484e-9abd-5e234ba0483a tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:52:13.566234 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4176b713-bc7a-484e-9abd-5e234ba0483a tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] [instance: 8346e5ae-6c1f-4ab8-9ebf-0bb59c802a8b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:52:13.569019 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:52:13.569880 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=6 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:52:13.579021 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8d4d0f00-210a-4b41-b454-dd3e1ddcbaea tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:13.580048 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8d4d0f00-210a-4b41-b454-dd3e1ddcbaea tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:13.580048 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8d4d0f00-210a-4b41-b454-dd3e1ddcbaea tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:13.580643 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8d4d0f00-210a-4b41-b454-dd3e1ddcbaea tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:13.581089 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8d4d0f00-210a-4b41-b454-dd3e1ddcbaea tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:13.581541 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8d4d0f00-210a-4b41-b454-dd3e1ddcbaea tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:13.585272 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4176b713-bc7a-484e-9abd-5e234ba0483a tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:13.585814 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4176b713-bc7a-484e-9abd-5e234ba0483a tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:13.586256 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4176b713-bc7a-484e-9abd-5e234ba0483a tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:13.587046 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4176b713-bc7a-484e-9abd-5e234ba0483a tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:13.587505 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4176b713-bc7a-484e-9abd-5e234ba0483a tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:13.587929 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4176b713-bc7a-484e-9abd-5e234ba0483a tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:13.820517 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8d4d0f00-210a-4b41-b454-dd3e1ddcbaea tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:13.825126 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4176b713-bc7a-484e-9abd-5e234ba0483a tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d8ec7142c79407b81108e90ce3657d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f4f31b5836f40e580c28153626ec6ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:13.830605 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8d4d0f00-210a-4b41-b454-dd3e1ddcbaea tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:13.832038 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8d4d0f00-210a-4b41-b454-dd3e1ddcbaea tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:13.833950 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4176b713-bc7a-484e-9abd-5e234ba0483a tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] 10.222.0.52 "GET /compute/v2.1/servers/8346e5ae-6c1f-4ab8-9ebf-0bb59c802a8b" status: 200 len: 1471 microversion: 2.1 time: 0.280836 Oct 19 03:52:13.834092 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8d4d0f00-210a-4b41-b454-dd3e1ddcbaea tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f" status: 200 len: 1721 microversion: 2.20 time: 0.278988 Oct 19 03:52:13.841772 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3201/6333] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:52:13 2022] GET /compute/v2.1/servers/8346e5ae-6c1f-4ab8-9ebf-0bb59c802a8b => generated 1471 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:52:13.842237 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3133/6334] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:52:13 2022] GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f => generated 1721 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:52:14.858262 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-786d5e89-8a62-4795-9c72-af6158c6bc99 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:52:14.859115 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2d4aaa11-997a-49a4-996c-0dcb75c7a448 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:52:14.859706 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-786d5e89-8a62-4795-9c72-af6158c6bc99 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] [instance: 8346e5ae-6c1f-4ab8-9ebf-0bb59c802a8b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:52:14.859826 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2d4aaa11-997a-49a4-996c-0dcb75c7a448 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 1eeec04f-d94e-4625-ab65-6d227a640f2f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:52:14.866976 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2d4aaa11-997a-49a4-996c-0dcb75c7a448 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:14.867428 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2d4aaa11-997a-49a4-996c-0dcb75c7a448 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:14.867877 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2d4aaa11-997a-49a4-996c-0dcb75c7a448 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:14.868587 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2d4aaa11-997a-49a4-996c-0dcb75c7a448 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:14.869052 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2d4aaa11-997a-49a4-996c-0dcb75c7a448 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:14.869515 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2d4aaa11-997a-49a4-996c-0dcb75c7a448 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:14.871540 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-786d5e89-8a62-4795-9c72-af6158c6bc99 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:14.872363 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-786d5e89-8a62-4795-9c72-af6158c6bc99 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:14.872464 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-786d5e89-8a62-4795-9c72-af6158c6bc99 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:14.873163 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-786d5e89-8a62-4795-9c72-af6158c6bc99 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:14.879827 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-786d5e89-8a62-4795-9c72-af6158c6bc99 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:14.880315 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-786d5e89-8a62-4795-9c72-af6158c6bc99 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:14.914078 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=4 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:52:15.394508 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-2d4aaa11-997a-49a4-996c-0dcb75c7a448 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:15.408299 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-2d4aaa11-997a-49a4-996c-0dcb75c7a448 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:15.410084 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-2d4aaa11-997a-49a4-996c-0dcb75c7a448 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:15.419281 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2d4aaa11-997a-49a4-996c-0dcb75c7a448 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f" status: 200 len: 1664 microversion: 2.20 time: 0.557102 Oct 19 03:52:15.419281 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3134/6335] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:52:14 2022] GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f => generated 1664 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:52:15.420679 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-0a7890da-1f76-4692-b2bf-3cd67cbb7828 req-d5b99177-778e-43e8-90f0-a574d6536910 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8346e5ae-6c1f-4ab8-9ebf-0bb59c802a8b", "name": "network-vif-plugged", "status": "completed", "tag": "bdecb113-13e4-4aae-a58a-012ce7f0cf31"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:52:15.430908 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-0a7890da-1f76-4692-b2bf-3cd67cbb7828 req-d5b99177-778e-43e8-90f0-a574d6536910 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:15.431383 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-0a7890da-1f76-4692-b2bf-3cd67cbb7828 req-d5b99177-778e-43e8-90f0-a574d6536910 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:15.431862 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-0a7890da-1f76-4692-b2bf-3cd67cbb7828 req-d5b99177-778e-43e8-90f0-a574d6536910 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:15.443650 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-0a7890da-1f76-4692-b2bf-3cd67cbb7828 req-d5b99177-778e-43e8-90f0-a574d6536910 service nova] Creating event network-vif-plugged:bdecb113-13e4-4aae-a58a-012ce7f0cf31 for instance 8346e5ae-6c1f-4ab8-9ebf-0bb59c802a8b on n-h2-861333-8 Oct 19 03:52:15.449164 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-0a7890da-1f76-4692-b2bf-3cd67cbb7828 req-d5b99177-778e-43e8-90f0-a574d6536910 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032872 Oct 19 03:52:15.450207 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3135/6336] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:52:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:52:15.455989 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f667d766-eaa2-4ae7-9432-6475e096e42a tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fcf3f0a2-e64e-4734-bad5-49a0ec865a68"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:52:15.458829 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f667d766-eaa2-4ae7-9432-6475e096e42a tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 1eeec04f-d94e-4625-ab65-6d227a640f2f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:52:15.465312 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f667d766-eaa2-4ae7-9432-6475e096e42a tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:15.465823 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f667d766-eaa2-4ae7-9432-6475e096e42a tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:15.466268 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f667d766-eaa2-4ae7-9432-6475e096e42a tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:15.467983 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f667d766-eaa2-4ae7-9432-6475e096e42a tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:15.468818 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f667d766-eaa2-4ae7-9432-6475e096e42a tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:15.469477 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f667d766-eaa2-4ae7-9432-6475e096e42a tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:15.472135 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-786d5e89-8a62-4795-9c72-af6158c6bc99 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d8ec7142c79407b81108e90ce3657d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f4f31b5836f40e580c28153626ec6ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:15.481527 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-786d5e89-8a62-4795-9c72-af6158c6bc99 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] 10.222.0.52 "GET /compute/v2.1/servers/8346e5ae-6c1f-4ab8-9ebf-0bb59c802a8b" status: 200 len: 1471 microversion: 2.1 time: 0.627799 Oct 19 03:52:15.482292 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3202/6337] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:52:14 2022] GET /compute/v2.1/servers/8346e5ae-6c1f-4ab8-9ebf-0bb59c802a8b => generated 1471 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:52:16.383953 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f667d766-eaa2-4ae7-9432-6475e096e42a tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "POST /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.932265 Oct 19 03:52:16.387166 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3136/6338] 10.222.0.52 () {62 vars in 1364 bytes} [Wed Oct 19 03:52:15 2022] POST /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f/os-volume_attachments => generated 188 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 03:52:16.509514 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d53fa0b5-d49f-43d0-9144-00dd49adc740 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:52:16.509514 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d53fa0b5-d49f-43d0-9144-00dd49adc740 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] [instance: 8346e5ae-6c1f-4ab8-9ebf-0bb59c802a8b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:52:16.512854 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d53fa0b5-d49f-43d0-9144-00dd49adc740 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:16.513353 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d53fa0b5-d49f-43d0-9144-00dd49adc740 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:16.513835 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d53fa0b5-d49f-43d0-9144-00dd49adc740 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:16.514545 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d53fa0b5-d49f-43d0-9144-00dd49adc740 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:16.515000 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d53fa0b5-d49f-43d0-9144-00dd49adc740 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:16.515428 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d53fa0b5-d49f-43d0-9144-00dd49adc740 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:16.516717 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-cba99f1a-a581-4e51-910c-894b1b0ae170 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:52:16.517225 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-cba99f1a-a581-4e51-910c-894b1b0ae170 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 1eeec04f-d94e-4625-ab65-6d227a640f2f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:52:16.523499 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cba99f1a-a581-4e51-910c-894b1b0ae170 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:16.523999 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cba99f1a-a581-4e51-910c-894b1b0ae170 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:16.524444 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cba99f1a-a581-4e51-910c-894b1b0ae170 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:16.525153 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cba99f1a-a581-4e51-910c-894b1b0ae170 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:16.525657 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cba99f1a-a581-4e51-910c-894b1b0ae170 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:16.526106 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cba99f1a-a581-4e51-910c-894b1b0ae170 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:16.679045 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d53fa0b5-d49f-43d0-9144-00dd49adc740 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d8ec7142c79407b81108e90ce3657d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f4f31b5836f40e580c28153626ec6ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:16.682615 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d53fa0b5-d49f-43d0-9144-00dd49adc740 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] 10.222.0.52 "GET /compute/v2.1/servers/8346e5ae-6c1f-4ab8-9ebf-0bb59c802a8b" status: 200 len: 1471 microversion: 2.1 time: 0.182504 Oct 19 03:52:16.683193 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3203/6339] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:52:16 2022] GET /compute/v2.1/servers/8346e5ae-6c1f-4ab8-9ebf-0bb59c802a8b => generated 1471 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:52:17.127984 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-cba99f1a-a581-4e51-910c-894b1b0ae170 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f/os-volume_attachments/fcf3f0a2-e64e-4734-bad5-49a0ec865a68" status: 202 len: 0 microversion: 2.20 time: 0.615323 Oct 19 03:52:17.128800 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3137/6340] 10.222.0.52 () {60 vars in 1457 bytes} [Wed Oct 19 03:52:16 2022] DELETE /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f/os-volume_attachments/fcf3f0a2-e64e-4734-bad5-49a0ec865a68 => generated 0 bytes in 617 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 19 03:52:17.194014 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b9afded9-a274-4c9d-8af7-93778f3b81ec tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:52:17.194519 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b9afded9-a274-4c9d-8af7-93778f3b81ec tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 1eeec04f-d94e-4625-ab65-6d227a640f2f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:52:17.200836 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b9afded9-a274-4c9d-8af7-93778f3b81ec tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:17.201328 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b9afded9-a274-4c9d-8af7-93778f3b81ec tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:17.201801 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b9afded9-a274-4c9d-8af7-93778f3b81ec tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:17.202491 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b9afded9-a274-4c9d-8af7-93778f3b81ec tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:17.202940 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b9afded9-a274-4c9d-8af7-93778f3b81ec tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:17.203364 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b9afded9-a274-4c9d-8af7-93778f3b81ec tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:17.248216 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b9afded9-a274-4c9d-8af7-93778f3b81ec tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 1eeec04f-d94e-4625-ab65-6d227a640f2f] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121135) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 19 03:52:17.485080 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b9afded9-a274-4c9d-8af7-93778f3b81ec tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "POST /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f/action" status: 202 len: 0 microversion: 2.20 time: 0.295157 Oct 19 03:52:17.485670 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3204/6341] 10.222.0.52 () {62 vars in 1319 bytes} [Wed Oct 19 03:52:17 2022] POST /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f/action => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:52:17.494140 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-cee7b8f2-75fb-4f0b-9820-c0b904622ceb tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:52:17.494795 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-cee7b8f2-75fb-4f0b-9820-c0b904622ceb tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 1eeec04f-d94e-4625-ab65-6d227a640f2f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:52:17.504386 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cee7b8f2-75fb-4f0b-9820-c0b904622ceb tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:17.504888 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cee7b8f2-75fb-4f0b-9820-c0b904622ceb tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:17.505404 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cee7b8f2-75fb-4f0b-9820-c0b904622ceb tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:17.506120 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cee7b8f2-75fb-4f0b-9820-c0b904622ceb tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:17.506582 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cee7b8f2-75fb-4f0b-9820-c0b904622ceb tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:17.507052 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cee7b8f2-75fb-4f0b-9820-c0b904622ceb tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:17.643488 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-cee7b8f2-75fb-4f0b-9820-c0b904622ceb tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:17.654321 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-cee7b8f2-75fb-4f0b-9820-c0b904622ceb tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:17.656104 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-cee7b8f2-75fb-4f0b-9820-c0b904622ceb tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:17.657890 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-cee7b8f2-75fb-4f0b-9820-c0b904622ceb tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f" status: 200 len: 1672 microversion: 2.20 time: 0.167656 Oct 19 03:52:17.660006 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3138/6342] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:52:17 2022] GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f => generated 1672 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:52:17.710042 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-8288a871-e25d-4ae6-883c-79dccde03775 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:52:17.710753 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-8288a871-e25d-4ae6-883c-79dccde03775 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] [instance: 8346e5ae-6c1f-4ab8-9ebf-0bb59c802a8b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:52:17.716966 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8288a871-e25d-4ae6-883c-79dccde03775 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:17.717586 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8288a871-e25d-4ae6-883c-79dccde03775 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:17.718105 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8288a871-e25d-4ae6-883c-79dccde03775 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:17.718888 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8288a871-e25d-4ae6-883c-79dccde03775 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:17.719490 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8288a871-e25d-4ae6-883c-79dccde03775 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:17.720039 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8288a871-e25d-4ae6-883c-79dccde03775 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:17.922507 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-8288a871-e25d-4ae6-883c-79dccde03775 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d8ec7142c79407b81108e90ce3657d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f4f31b5836f40e580c28153626ec6ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:17.922507 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-8288a871-e25d-4ae6-883c-79dccde03775 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] 10.222.0.52 "GET /compute/v2.1/servers/8346e5ae-6c1f-4ab8-9ebf-0bb59c802a8b" status: 200 len: 1644 microversion: 2.1 time: 0.185073 Oct 19 03:52:17.922507 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3205/6343] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:52:17 2022] GET /compute/v2.1/servers/8346e5ae-6c1f-4ab8-9ebf-0bb59c802a8b => generated 1644 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:52:17.937135 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e5fcc657-91b7-4ee6-a1f2-e475ba8836ad tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:52:17.937731 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e5fcc657-91b7-4ee6-a1f2-e475ba8836ad tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] [instance: 8346e5ae-6c1f-4ab8-9ebf-0bb59c802a8b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:52:17.945255 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e5fcc657-91b7-4ee6-a1f2-e475ba8836ad tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:17.953120 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e5fcc657-91b7-4ee6-a1f2-e475ba8836ad tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:17.953120 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e5fcc657-91b7-4ee6-a1f2-e475ba8836ad tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:17.953120 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e5fcc657-91b7-4ee6-a1f2-e475ba8836ad tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:17.953120 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e5fcc657-91b7-4ee6-a1f2-e475ba8836ad tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:17.953120 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e5fcc657-91b7-4ee6-a1f2-e475ba8836ad tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:18.093623 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e5fcc657-91b7-4ee6-a1f2-e475ba8836ad tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d8ec7142c79407b81108e90ce3657d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f4f31b5836f40e580c28153626ec6ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:18.097284 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=5,nova_cell1:UPDATE=8 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:52:18.101936 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e5fcc657-91b7-4ee6-a1f2-e475ba8836ad tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] 10.222.0.52 "GET /compute/v2.1/servers/8346e5ae-6c1f-4ab8-9ebf-0bb59c802a8b" status: 200 len: 1644 microversion: 2.1 time: 0.168734 Oct 19 03:52:18.102646 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3139/6344] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:52:17 2022] GET /compute/v2.1/servers/8346e5ae-6c1f-4ab8-9ebf-0bb59c802a8b => generated 1644 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:52:18.124409 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4231cc1d-7a65-4f1f-9a53-a12b0139acc8 tempest-TestSecurityGroupsBasicOps-709888478 tempest-TestSecurityGroupsBasicOps-709888478-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:52:18.125034 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4231cc1d-7a65-4f1f-9a53-a12b0139acc8 tempest-TestSecurityGroupsBasicOps-709888478 tempest-TestSecurityGroupsBasicOps-709888478-project-admin] [instance: 8346e5ae-6c1f-4ab8-9ebf-0bb59c802a8b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:52:18.131606 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4231cc1d-7a65-4f1f-9a53-a12b0139acc8 tempest-TestSecurityGroupsBasicOps-709888478 tempest-TestSecurityGroupsBasicOps-709888478-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:18.132130 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4231cc1d-7a65-4f1f-9a53-a12b0139acc8 tempest-TestSecurityGroupsBasicOps-709888478 tempest-TestSecurityGroupsBasicOps-709888478-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:18.132578 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4231cc1d-7a65-4f1f-9a53-a12b0139acc8 tempest-TestSecurityGroupsBasicOps-709888478 tempest-TestSecurityGroupsBasicOps-709888478-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:18.133275 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4231cc1d-7a65-4f1f-9a53-a12b0139acc8 tempest-TestSecurityGroupsBasicOps-709888478 tempest-TestSecurityGroupsBasicOps-709888478-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:18.133765 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4231cc1d-7a65-4f1f-9a53-a12b0139acc8 tempest-TestSecurityGroupsBasicOps-709888478 tempest-TestSecurityGroupsBasicOps-709888478-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:18.134197 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4231cc1d-7a65-4f1f-9a53-a12b0139acc8 tempest-TestSecurityGroupsBasicOps-709888478 tempest-TestSecurityGroupsBasicOps-709888478-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:18.467925 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4231cc1d-7a65-4f1f-9a53-a12b0139acc8 tempest-TestSecurityGroupsBasicOps-709888478 tempest-TestSecurityGroupsBasicOps-709888478-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/8346e5ae-6c1f-4ab8-9ebf-0bb59c802a8b" status: 200 len: 1795 microversion: 2.1 time: 0.347214 Oct 19 03:52:18.468730 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3206/6345] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:52:18 2022] GET /compute/v2.1/servers/8346e5ae-6c1f-4ab8-9ebf-0bb59c802a8b => generated 1795 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:52:18.687208 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0fbd4fca-613c-4765-aac0-ba5aa79857d7 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:52:18.687825 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0fbd4fca-613c-4765-aac0-ba5aa79857d7 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 1eeec04f-d94e-4625-ab65-6d227a640f2f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:52:18.694645 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0fbd4fca-613c-4765-aac0-ba5aa79857d7 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:18.695364 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0fbd4fca-613c-4765-aac0-ba5aa79857d7 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:18.696074 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0fbd4fca-613c-4765-aac0-ba5aa79857d7 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:18.696858 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0fbd4fca-613c-4765-aac0-ba5aa79857d7 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:18.697321 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0fbd4fca-613c-4765-aac0-ba5aa79857d7 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:18.697796 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0fbd4fca-613c-4765-aac0-ba5aa79857d7 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:18.848551 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0fbd4fca-613c-4765-aac0-ba5aa79857d7 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:18.855568 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0fbd4fca-613c-4765-aac0-ba5aa79857d7 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:18.857198 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0fbd4fca-613c-4765-aac0-ba5aa79857d7 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:18.858824 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0fbd4fca-613c-4765-aac0-ba5aa79857d7 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f" status: 200 len: 1672 microversion: 2.20 time: 0.177557 Oct 19 03:52:18.859429 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3140/6346] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:52:18 2022] GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f => generated 1672 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:52:19.885699 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a95a15ab-6166-4d84-a048-737a0daab1be tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:52:19.886537 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a95a15ab-6166-4d84-a048-737a0daab1be tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 1eeec04f-d94e-4625-ab65-6d227a640f2f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:52:19.893547 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a95a15ab-6166-4d84-a048-737a0daab1be tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:19.897257 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a95a15ab-6166-4d84-a048-737a0daab1be tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:19.897257 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a95a15ab-6166-4d84-a048-737a0daab1be tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:19.897257 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a95a15ab-6166-4d84-a048-737a0daab1be tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:19.897257 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a95a15ab-6166-4d84-a048-737a0daab1be tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:19.897257 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a95a15ab-6166-4d84-a048-737a0daab1be tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:20.064664 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a95a15ab-6166-4d84-a048-737a0daab1be tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:20.076270 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a95a15ab-6166-4d84-a048-737a0daab1be tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:20.077761 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a95a15ab-6166-4d84-a048-737a0daab1be tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:20.078956 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a95a15ab-6166-4d84-a048-737a0daab1be tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f" status: 200 len: 1730 microversion: 2.20 time: 0.197258 Oct 19 03:52:20.079566 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3207/6347] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:52:19 2022] GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f => generated 1730 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:52:20.994576 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-bda1eb8b-4369-495e-8ce2-f1027794c44c req-ba8fdfaf-88e3-4249-b362-1c90f3246015 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8346e5ae-6c1f-4ab8-9ebf-0bb59c802a8b", "tag": "bdecb113-13e4-4aae-a58a-012ce7f0cf31"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:52:21.005566 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-bda1eb8b-4369-495e-8ce2-f1027794c44c req-ba8fdfaf-88e3-4249-b362-1c90f3246015 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:21.006334 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-bda1eb8b-4369-495e-8ce2-f1027794c44c req-ba8fdfaf-88e3-4249-b362-1c90f3246015 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:21.007202 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-bda1eb8b-4369-495e-8ce2-f1027794c44c req-ba8fdfaf-88e3-4249-b362-1c90f3246015 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:21.028866 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-bda1eb8b-4369-495e-8ce2-f1027794c44c req-ba8fdfaf-88e3-4249-b362-1c90f3246015 service nova] Creating event network-changed:bdecb113-13e4-4aae-a58a-012ce7f0cf31 for instance 8346e5ae-6c1f-4ab8-9ebf-0bb59c802a8b on n-h2-861333-8 Oct 19 03:52:21.034976 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-bda1eb8b-4369-495e-8ce2-f1027794c44c req-ba8fdfaf-88e3-4249-b362-1c90f3246015 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046242 Oct 19 03:52:21.036162 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3141/6348] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:52:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:52:21.107202 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-790dbe82-7c2e-44e4-9b3f-af16e0e495b9 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:52:21.107830 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-790dbe82-7c2e-44e4-9b3f-af16e0e495b9 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 1eeec04f-d94e-4625-ab65-6d227a640f2f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:52:21.117189 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-790dbe82-7c2e-44e4-9b3f-af16e0e495b9 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:21.117649 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-790dbe82-7c2e-44e4-9b3f-af16e0e495b9 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:21.118100 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-790dbe82-7c2e-44e4-9b3f-af16e0e495b9 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:21.127740 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-790dbe82-7c2e-44e4-9b3f-af16e0e495b9 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:21.128612 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-790dbe82-7c2e-44e4-9b3f-af16e0e495b9 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:21.129806 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-790dbe82-7c2e-44e4-9b3f-af16e0e495b9 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:21.563876 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-790dbe82-7c2e-44e4-9b3f-af16e0e495b9 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:21.582399 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-790dbe82-7c2e-44e4-9b3f-af16e0e495b9 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:21.586188 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-790dbe82-7c2e-44e4-9b3f-af16e0e495b9 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:21.589328 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-790dbe82-7c2e-44e4-9b3f-af16e0e495b9 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f" status: 200 len: 1730 microversion: 2.20 time: 0.485327 Oct 19 03:52:21.601517 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3208/6349] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:52:21 2022] GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f => generated 1730 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:52:22.620703 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-fac73a67-6999-4af0-a9e1-0c7af1bbe487 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:52:22.623571 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-fac73a67-6999-4af0-a9e1-0c7af1bbe487 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 1eeec04f-d94e-4625-ab65-6d227a640f2f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:52:22.628509 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fac73a67-6999-4af0-a9e1-0c7af1bbe487 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:22.629061 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fac73a67-6999-4af0-a9e1-0c7af1bbe487 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:22.629498 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fac73a67-6999-4af0-a9e1-0c7af1bbe487 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:22.630208 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fac73a67-6999-4af0-a9e1-0c7af1bbe487 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:22.630666 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fac73a67-6999-4af0-a9e1-0c7af1bbe487 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:22.631097 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fac73a67-6999-4af0-a9e1-0c7af1bbe487 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:22.770974 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-fac73a67-6999-4af0-a9e1-0c7af1bbe487 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:22.780571 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-fac73a67-6999-4af0-a9e1-0c7af1bbe487 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:22.782304 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-fac73a67-6999-4af0-a9e1-0c7af1bbe487 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:22.783507 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-fac73a67-6999-4af0-a9e1-0c7af1bbe487 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f" status: 200 len: 1730 microversion: 2.20 time: 0.167406 Oct 19 03:52:22.784080 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3142/6350] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:52:22 2022] GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:52:23.067397 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-b0bbbe40-7cf9-4f85-af2b-42b721dc2e25 req-60ca93ed-b4a3-494f-8009-8a28d18cb96e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1eeec04f-d94e-4625-ab65-6d227a640f2f", "tag": "9487bc37-2fe4-4fbc-914a-50a09e00b655"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:52:23.078038 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-b0bbbe40-7cf9-4f85-af2b-42b721dc2e25 req-60ca93ed-b4a3-494f-8009-8a28d18cb96e service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:23.078507 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-b0bbbe40-7cf9-4f85-af2b-42b721dc2e25 req-60ca93ed-b4a3-494f-8009-8a28d18cb96e service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:23.078949 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-b0bbbe40-7cf9-4f85-af2b-42b721dc2e25 req-60ca93ed-b4a3-494f-8009-8a28d18cb96e service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:23.090886 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-b0bbbe40-7cf9-4f85-af2b-42b721dc2e25 req-60ca93ed-b4a3-494f-8009-8a28d18cb96e service nova] Creating event network-changed:9487bc37-2fe4-4fbc-914a-50a09e00b655 for instance 1eeec04f-d94e-4625-ab65-6d227a640f2f on n-h1-861333-8 Oct 19 03:52:23.097783 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-b0bbbe40-7cf9-4f85-af2b-42b721dc2e25 req-60ca93ed-b4a3-494f-8009-8a28d18cb96e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034428 Oct 19 03:52:23.108369 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3209/6351] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:52:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:52:23.809262 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8511e8f8-ee4e-4786-88b7-2c5b2cbbdd63 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:52:23.810011 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8511e8f8-ee4e-4786-88b7-2c5b2cbbdd63 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 1eeec04f-d94e-4625-ab65-6d227a640f2f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:52:23.817906 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8511e8f8-ee4e-4786-88b7-2c5b2cbbdd63 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:23.818499 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8511e8f8-ee4e-4786-88b7-2c5b2cbbdd63 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:23.819049 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8511e8f8-ee4e-4786-88b7-2c5b2cbbdd63 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:23.819765 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8511e8f8-ee4e-4786-88b7-2c5b2cbbdd63 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:23.820224 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8511e8f8-ee4e-4786-88b7-2c5b2cbbdd63 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:23.820652 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8511e8f8-ee4e-4786-88b7-2c5b2cbbdd63 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:23.965456 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8511e8f8-ee4e-4786-88b7-2c5b2cbbdd63 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:23.976573 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8511e8f8-ee4e-4786-88b7-2c5b2cbbdd63 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:23.978212 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8511e8f8-ee4e-4786-88b7-2c5b2cbbdd63 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:23.979545 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8511e8f8-ee4e-4786-88b7-2c5b2cbbdd63 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f" status: 200 len: 1730 microversion: 2.20 time: 0.174214 Oct 19 03:52:23.980314 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3143/6352] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:52:23 2022] GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f => generated 1730 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:52:25.008349 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c87846ff-e2f9-4aac-905d-384243bea3f1 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:52:25.009157 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c87846ff-e2f9-4aac-905d-384243bea3f1 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 1eeec04f-d94e-4625-ab65-6d227a640f2f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:52:25.021842 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c87846ff-e2f9-4aac-905d-384243bea3f1 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:25.022956 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c87846ff-e2f9-4aac-905d-384243bea3f1 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:25.023646 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c87846ff-e2f9-4aac-905d-384243bea3f1 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:25.024396 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c87846ff-e2f9-4aac-905d-384243bea3f1 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:25.025047 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c87846ff-e2f9-4aac-905d-384243bea3f1 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:25.025511 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c87846ff-e2f9-4aac-905d-384243bea3f1 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:25.231575 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c87846ff-e2f9-4aac-905d-384243bea3f1 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:25.241323 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c87846ff-e2f9-4aac-905d-384243bea3f1 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:25.242868 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c87846ff-e2f9-4aac-905d-384243bea3f1 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:25.244111 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c87846ff-e2f9-4aac-905d-384243bea3f1 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f" status: 200 len: 1730 microversion: 2.20 time: 0.241463 Oct 19 03:52:25.244723 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3210/6353] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:52:25 2022] GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f => generated 1730 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:52:26.274946 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e4bbe445-d5fd-46f3-b64c-e07037cacb8b tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:52:26.277173 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e4bbe445-d5fd-46f3-b64c-e07037cacb8b tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 1eeec04f-d94e-4625-ab65-6d227a640f2f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:52:26.313159 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e4bbe445-d5fd-46f3-b64c-e07037cacb8b tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:26.315138 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e4bbe445-d5fd-46f3-b64c-e07037cacb8b tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:26.315911 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e4bbe445-d5fd-46f3-b64c-e07037cacb8b tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:26.317082 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e4bbe445-d5fd-46f3-b64c-e07037cacb8b tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:26.318875 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e4bbe445-d5fd-46f3-b64c-e07037cacb8b tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:26.319568 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e4bbe445-d5fd-46f3-b64c-e07037cacb8b tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:26.571353 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e4bbe445-d5fd-46f3-b64c-e07037cacb8b tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:26.581317 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e4bbe445-d5fd-46f3-b64c-e07037cacb8b tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:26.586774 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e4bbe445-d5fd-46f3-b64c-e07037cacb8b tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:26.588048 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e4bbe445-d5fd-46f3-b64c-e07037cacb8b tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f" status: 200 len: 1730 microversion: 2.20 time: 0.318196 Oct 19 03:52:26.588819 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3144/6354] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:52:26 2022] GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f => generated 1730 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:52:27.622226 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-38161938-3abb-4fe5-a65c-c5aa078c3cd1 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:52:27.627627 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-38161938-3abb-4fe5-a65c-c5aa078c3cd1 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 1eeec04f-d94e-4625-ab65-6d227a640f2f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:52:27.635547 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-38161938-3abb-4fe5-a65c-c5aa078c3cd1 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:27.636048 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-38161938-3abb-4fe5-a65c-c5aa078c3cd1 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:27.636494 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-38161938-3abb-4fe5-a65c-c5aa078c3cd1 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:27.637217 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-38161938-3abb-4fe5-a65c-c5aa078c3cd1 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:27.637967 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-38161938-3abb-4fe5-a65c-c5aa078c3cd1 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:27.638398 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-38161938-3abb-4fe5-a65c-c5aa078c3cd1 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:27.790067 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-38161938-3abb-4fe5-a65c-c5aa078c3cd1 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:27.800387 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-38161938-3abb-4fe5-a65c-c5aa078c3cd1 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:27.803058 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-38161938-3abb-4fe5-a65c-c5aa078c3cd1 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:27.804517 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-38161938-3abb-4fe5-a65c-c5aa078c3cd1 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f" status: 200 len: 1730 microversion: 2.20 time: 0.189115 Oct 19 03:52:27.805872 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3211/6355] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:52:27 2022] GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f => generated 1730 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:52:28.832184 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f679344a-0932-43c3-b3d3-0e3937b76396 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:52:28.832943 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f679344a-0932-43c3-b3d3-0e3937b76396 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 1eeec04f-d94e-4625-ab65-6d227a640f2f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:52:28.841057 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f679344a-0932-43c3-b3d3-0e3937b76396 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:28.842224 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f679344a-0932-43c3-b3d3-0e3937b76396 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:28.842692 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f679344a-0932-43c3-b3d3-0e3937b76396 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:28.843875 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f679344a-0932-43c3-b3d3-0e3937b76396 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:28.846294 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f679344a-0932-43c3-b3d3-0e3937b76396 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:28.846811 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f679344a-0932-43c3-b3d3-0e3937b76396 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:28.998315 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-f679344a-0932-43c3-b3d3-0e3937b76396 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:29.006892 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-f679344a-0932-43c3-b3d3-0e3937b76396 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:29.008437 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-f679344a-0932-43c3-b3d3-0e3937b76396 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:29.009662 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f679344a-0932-43c3-b3d3-0e3937b76396 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f" status: 200 len: 1730 microversion: 2.20 time: 0.181764 Oct 19 03:52:29.010231 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3145/6356] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:52:28 2022] GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f => generated 1730 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:52:30.037587 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6553db17-4405-4c5f-8a3f-9ff4020fe11d tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:52:30.039166 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6553db17-4405-4c5f-8a3f-9ff4020fe11d tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 1eeec04f-d94e-4625-ab65-6d227a640f2f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:52:30.047474 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6553db17-4405-4c5f-8a3f-9ff4020fe11d tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:30.047726 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6553db17-4405-4c5f-8a3f-9ff4020fe11d tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:30.048301 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6553db17-4405-4c5f-8a3f-9ff4020fe11d tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:30.049239 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6553db17-4405-4c5f-8a3f-9ff4020fe11d tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:30.049785 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6553db17-4405-4c5f-8a3f-9ff4020fe11d tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:30.050274 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6553db17-4405-4c5f-8a3f-9ff4020fe11d tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:30.191681 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-6553db17-4405-4c5f-8a3f-9ff4020fe11d tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:30.200053 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-6553db17-4405-4c5f-8a3f-9ff4020fe11d tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:30.213573 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-6553db17-4405-4c5f-8a3f-9ff4020fe11d tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:30.213573 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6553db17-4405-4c5f-8a3f-9ff4020fe11d tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f" status: 200 len: 1730 microversion: 2.20 time: 0.170309 Oct 19 03:52:30.213573 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3212/6357] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:52:30 2022] GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f => generated 1730 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:52:31.230779 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7906364b-1a1e-4e94-bb7d-46d43a2e9489 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:52:31.231404 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7906364b-1a1e-4e94-bb7d-46d43a2e9489 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 1eeec04f-d94e-4625-ab65-6d227a640f2f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:52:31.239581 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7906364b-1a1e-4e94-bb7d-46d43a2e9489 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:31.240090 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7906364b-1a1e-4e94-bb7d-46d43a2e9489 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:31.240587 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7906364b-1a1e-4e94-bb7d-46d43a2e9489 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:31.241439 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7906364b-1a1e-4e94-bb7d-46d43a2e9489 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:31.241995 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7906364b-1a1e-4e94-bb7d-46d43a2e9489 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:31.242552 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7906364b-1a1e-4e94-bb7d-46d43a2e9489 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:31.390210 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-7906364b-1a1e-4e94-bb7d-46d43a2e9489 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:31.410506 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-7906364b-1a1e-4e94-bb7d-46d43a2e9489 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:31.412077 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-7906364b-1a1e-4e94-bb7d-46d43a2e9489 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:31.413588 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7906364b-1a1e-4e94-bb7d-46d43a2e9489 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f" status: 200 len: 1730 microversion: 2.20 time: 0.186827 Oct 19 03:52:31.416664 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3146/6358] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:52:31 2022] GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f => generated 1730 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:52:32.440358 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9565ec24-cd40-4b9c-8508-e73cdf581028 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:52:32.441085 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9565ec24-cd40-4b9c-8508-e73cdf581028 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 1eeec04f-d94e-4625-ab65-6d227a640f2f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:52:32.454657 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9565ec24-cd40-4b9c-8508-e73cdf581028 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:32.455167 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9565ec24-cd40-4b9c-8508-e73cdf581028 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:32.455620 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9565ec24-cd40-4b9c-8508-e73cdf581028 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:32.456350 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9565ec24-cd40-4b9c-8508-e73cdf581028 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:32.456813 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9565ec24-cd40-4b9c-8508-e73cdf581028 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:32.457812 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9565ec24-cd40-4b9c-8508-e73cdf581028 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:32.594185 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-9565ec24-cd40-4b9c-8508-e73cdf581028 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:32.602469 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-9565ec24-cd40-4b9c-8508-e73cdf581028 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:32.603941 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-9565ec24-cd40-4b9c-8508-e73cdf581028 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:32.605122 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9565ec24-cd40-4b9c-8508-e73cdf581028 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f" status: 200 len: 1730 microversion: 2.20 time: 0.168969 Oct 19 03:52:32.605720 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3213/6359] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:52:32 2022] GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:52:33.631110 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-30c09c30-1689-46bb-8ccb-74fb78010a8e tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:52:33.631734 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-30c09c30-1689-46bb-8ccb-74fb78010a8e tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 1eeec04f-d94e-4625-ab65-6d227a640f2f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:52:33.639071 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-30c09c30-1689-46bb-8ccb-74fb78010a8e tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:33.639647 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-30c09c30-1689-46bb-8ccb-74fb78010a8e tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:33.640270 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-30c09c30-1689-46bb-8ccb-74fb78010a8e tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:33.641160 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-30c09c30-1689-46bb-8ccb-74fb78010a8e tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:33.641642 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-30c09c30-1689-46bb-8ccb-74fb78010a8e tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:33.642076 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-30c09c30-1689-46bb-8ccb-74fb78010a8e tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:33.788466 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-30c09c30-1689-46bb-8ccb-74fb78010a8e tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:33.797636 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-30c09c30-1689-46bb-8ccb-74fb78010a8e tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:33.799313 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-30c09c30-1689-46bb-8ccb-74fb78010a8e tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:33.800660 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-30c09c30-1689-46bb-8ccb-74fb78010a8e tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f" status: 200 len: 1730 microversion: 2.20 time: 0.173659 Oct 19 03:52:33.814464 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3147/6360] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:52:33 2022] GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f => generated 1730 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:52:34.826768 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4c2b1354-2294-4a2e-963e-54e1aa185345 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:52:34.827394 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4c2b1354-2294-4a2e-963e-54e1aa185345 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 1eeec04f-d94e-4625-ab65-6d227a640f2f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:52:34.834276 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4c2b1354-2294-4a2e-963e-54e1aa185345 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:34.834769 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4c2b1354-2294-4a2e-963e-54e1aa185345 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:34.835212 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4c2b1354-2294-4a2e-963e-54e1aa185345 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:34.836063 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4c2b1354-2294-4a2e-963e-54e1aa185345 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:34.836365 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4c2b1354-2294-4a2e-963e-54e1aa185345 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:34.836795 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4c2b1354-2294-4a2e-963e-54e1aa185345 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:34.971953 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4c2b1354-2294-4a2e-963e-54e1aa185345 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:34.974858 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:52:34.981401 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4c2b1354-2294-4a2e-963e-54e1aa185345 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:34.982844 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4c2b1354-2294-4a2e-963e-54e1aa185345 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:34.984067 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4c2b1354-2294-4a2e-963e-54e1aa185345 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f" status: 200 len: 1730 microversion: 2.20 time: 0.161285 Oct 19 03:52:34.984632 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3214/6361] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:52:34 2022] GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:52:36.011062 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-756d6bc9-9bd5-4a11-b99c-c1d42943caad tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:52:36.011706 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-756d6bc9-9bd5-4a11-b99c-c1d42943caad tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 1eeec04f-d94e-4625-ab65-6d227a640f2f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:52:36.018887 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-756d6bc9-9bd5-4a11-b99c-c1d42943caad tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:36.019379 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-756d6bc9-9bd5-4a11-b99c-c1d42943caad tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:36.019826 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-756d6bc9-9bd5-4a11-b99c-c1d42943caad tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:36.020528 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-756d6bc9-9bd5-4a11-b99c-c1d42943caad tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:36.020993 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-756d6bc9-9bd5-4a11-b99c-c1d42943caad tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:36.021447 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-756d6bc9-9bd5-4a11-b99c-c1d42943caad tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:36.174333 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-756d6bc9-9bd5-4a11-b99c-c1d42943caad tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:36.183365 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-756d6bc9-9bd5-4a11-b99c-c1d42943caad tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:36.184834 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-756d6bc9-9bd5-4a11-b99c-c1d42943caad tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:36.186048 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-756d6bc9-9bd5-4a11-b99c-c1d42943caad tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f" status: 200 len: 1730 microversion: 2.20 time: 0.179167 Oct 19 03:52:36.186619 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3148/6362] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:52:36 2022] GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f => generated 1730 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:52:37.217672 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6de30339-e363-48d2-8979-9eaac18a4253 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:52:37.218288 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6de30339-e363-48d2-8979-9eaac18a4253 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 1eeec04f-d94e-4625-ab65-6d227a640f2f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:52:37.225563 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6de30339-e363-48d2-8979-9eaac18a4253 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:37.246724 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6de30339-e363-48d2-8979-9eaac18a4253 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:37.246724 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6de30339-e363-48d2-8979-9eaac18a4253 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:37.246724 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6de30339-e363-48d2-8979-9eaac18a4253 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:37.246724 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6de30339-e363-48d2-8979-9eaac18a4253 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:37.246724 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6de30339-e363-48d2-8979-9eaac18a4253 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:37.386513 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-6de30339-e363-48d2-8979-9eaac18a4253 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:37.396252 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-6de30339-e363-48d2-8979-9eaac18a4253 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:37.398018 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-6de30339-e363-48d2-8979-9eaac18a4253 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:37.403554 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6de30339-e363-48d2-8979-9eaac18a4253 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f" status: 200 len: 1730 microversion: 2.20 time: 0.185700 Oct 19 03:52:37.403554 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3215/6363] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:52:37 2022] GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f => generated 1730 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:52:38.271390 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b335e215-d819-4598-bf1e-fff4e06fa646 tempest-TestNetworkAdvancedServerOps-173376372 tempest-TestNetworkAdvancedServerOps-173376372-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:52:38.272015 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b335e215-d819-4598-bf1e-fff4e06fa646 tempest-TestNetworkAdvancedServerOps-173376372 tempest-TestNetworkAdvancedServerOps-173376372-project-admin] [instance: 2b57ed72-0e3a-43c8-b552-875524942849] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:52:38.275434 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=44 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:52:38.278974 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b335e215-d819-4598-bf1e-fff4e06fa646 tempest-TestNetworkAdvancedServerOps-173376372 tempest-TestNetworkAdvancedServerOps-173376372-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:38.279478 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b335e215-d819-4598-bf1e-fff4e06fa646 tempest-TestNetworkAdvancedServerOps-173376372 tempest-TestNetworkAdvancedServerOps-173376372-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:38.279899 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b335e215-d819-4598-bf1e-fff4e06fa646 tempest-TestNetworkAdvancedServerOps-173376372 tempest-TestNetworkAdvancedServerOps-173376372-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:38.280851 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b335e215-d819-4598-bf1e-fff4e06fa646 tempest-TestNetworkAdvancedServerOps-173376372 tempest-TestNetworkAdvancedServerOps-173376372-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:38.281550 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b335e215-d819-4598-bf1e-fff4e06fa646 tempest-TestNetworkAdvancedServerOps-173376372 tempest-TestNetworkAdvancedServerOps-173376372-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:38.282150 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b335e215-d819-4598-bf1e-fff4e06fa646 tempest-TestNetworkAdvancedServerOps-173376372 tempest-TestNetworkAdvancedServerOps-173376372-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:38.424679 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3bc34ab4-8a6d-4205-941c-d96e2c156310 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:52:38.425348 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-3bc34ab4-8a6d-4205-941c-d96e2c156310 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 1eeec04f-d94e-4625-ab65-6d227a640f2f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:52:38.433676 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3bc34ab4-8a6d-4205-941c-d96e2c156310 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:38.434170 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3bc34ab4-8a6d-4205-941c-d96e2c156310 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:38.434827 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3bc34ab4-8a6d-4205-941c-d96e2c156310 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:38.435797 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3bc34ab4-8a6d-4205-941c-d96e2c156310 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:38.436564 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3bc34ab4-8a6d-4205-941c-d96e2c156310 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:38.436996 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3bc34ab4-8a6d-4205-941c-d96e2c156310 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:38.476174 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b335e215-d819-4598-bf1e-fff4e06fa646 tempest-TestNetworkAdvancedServerOps-173376372 tempest-TestNetworkAdvancedServerOps-173376372-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849" status: 200 len: 1829 microversion: 2.1 time: 0.209279 Oct 19 03:52:38.476965 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3149/6364] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:52:38 2022] GET /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849 => generated 1829 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:52:38.498625 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4930eed2-1b3c-4f76-953a-c4d1ba19aadf tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:52:38.499240 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4930eed2-1b3c-4f76-953a-c4d1ba19aadf tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: 2b57ed72-0e3a-43c8-b552-875524942849] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:52:38.505270 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4930eed2-1b3c-4f76-953a-c4d1ba19aadf tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:38.505826 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4930eed2-1b3c-4f76-953a-c4d1ba19aadf tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:38.506268 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4930eed2-1b3c-4f76-953a-c4d1ba19aadf tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:38.506968 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4930eed2-1b3c-4f76-953a-c4d1ba19aadf tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:38.507487 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4930eed2-1b3c-4f76-953a-c4d1ba19aadf tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:38.508132 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4930eed2-1b3c-4f76-953a-c4d1ba19aadf tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:39.121384 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-3bc34ab4-8a6d-4205-941c-d96e2c156310 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:39.131438 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-3bc34ab4-8a6d-4205-941c-d96e2c156310 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:39.133100 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-3bc34ab4-8a6d-4205-941c-d96e2c156310 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:39.135048 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-3bc34ab4-8a6d-4205-941c-d96e2c156310 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f" status: 200 len: 1730 microversion: 2.20 time: 0.714409 Oct 19 03:52:39.136281 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3216/6365] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:52:38 2022] GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f => generated 1730 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:52:39.180844 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-4930eed2-1b3c-4f76-953a-c4d1ba19aadf tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:39.189440 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4930eed2-1b3c-4f76-953a-c4d1ba19aadf tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849" status: 200 len: 1678 microversion: 2.1 time: 0.694548 Oct 19 03:52:39.203164 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3150/6366] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:52:38 2022] GET /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849 => generated 1678 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:52:39.308762 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-191a677d-60e8-43ac-b1a0-2b339b921907 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:52:39.311246 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-191a677d-60e8-43ac-b1a0-2b339b921907 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: 2b57ed72-0e3a-43c8-b552-875524942849] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:52:39.318618 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-191a677d-60e8-43ac-b1a0-2b339b921907 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:39.319065 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-191a677d-60e8-43ac-b1a0-2b339b921907 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:39.319780 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-191a677d-60e8-43ac-b1a0-2b339b921907 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:39.320505 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-191a677d-60e8-43ac-b1a0-2b339b921907 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:39.320967 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-191a677d-60e8-43ac-b1a0-2b339b921907 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:39.321436 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-191a677d-60e8-43ac-b1a0-2b339b921907 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:39.405874 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-191a677d-60e8-43ac-b1a0-2b339b921907 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "POST /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849/action" status: 200 len: 32637 microversion: 2.1 time: 0.100778 Oct 19 03:52:39.408591 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3217/6367] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:52:39 2022] POST /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849/action => generated 32637 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 03:52:39.551882 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-54a5bc9d-a163-4653-997f-85522ef85a8d tempest-TestNetworkAdvancedServerOps-173376372 tempest-TestNetworkAdvancedServerOps-173376372-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:52:39.553201 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-54a5bc9d-a163-4653-997f-85522ef85a8d tempest-TestNetworkAdvancedServerOps-173376372 tempest-TestNetworkAdvancedServerOps-173376372-project-admin] [instance: 2b57ed72-0e3a-43c8-b552-875524942849] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:52:39.561169 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-54a5bc9d-a163-4653-997f-85522ef85a8d tempest-TestNetworkAdvancedServerOps-173376372 tempest-TestNetworkAdvancedServerOps-173376372-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:39.563013 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-54a5bc9d-a163-4653-997f-85522ef85a8d tempest-TestNetworkAdvancedServerOps-173376372 tempest-TestNetworkAdvancedServerOps-173376372-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:39.563671 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-54a5bc9d-a163-4653-997f-85522ef85a8d tempest-TestNetworkAdvancedServerOps-173376372 tempest-TestNetworkAdvancedServerOps-173376372-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:39.565778 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-54a5bc9d-a163-4653-997f-85522ef85a8d tempest-TestNetworkAdvancedServerOps-173376372 tempest-TestNetworkAdvancedServerOps-173376372-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:39.566447 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-54a5bc9d-a163-4653-997f-85522ef85a8d tempest-TestNetworkAdvancedServerOps-173376372 tempest-TestNetworkAdvancedServerOps-173376372-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:39.567620 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-54a5bc9d-a163-4653-997f-85522ef85a8d tempest-TestNetworkAdvancedServerOps-173376372 tempest-TestNetworkAdvancedServerOps-173376372-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:39.720151 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-54a5bc9d-a163-4653-997f-85522ef85a8d tempest-TestNetworkAdvancedServerOps-173376372 tempest-TestNetworkAdvancedServerOps-173376372-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'e8f6b9fbf33b4025aee81ddcaf3f2482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bc81d7207274a0c91b2a1d99f129170', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:39.720763 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-54a5bc9d-a163-4653-997f-85522ef85a8d tempest-TestNetworkAdvancedServerOps-173376372 tempest-TestNetworkAdvancedServerOps-173376372-project-admin] [instance: 2b57ed72-0e3a-43c8-b552-875524942849] flavor_id is None. Assuming migration. {{(pid=121134) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 19 03:52:39.721205 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-54a5bc9d-a163-4653-997f-85522ef85a8d tempest-TestNetworkAdvancedServerOps-173376372 tempest-TestNetworkAdvancedServerOps-173376372-project-admin] [instance: 2b57ed72-0e3a-43c8-b552-875524942849] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=121134) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 19 03:52:40.100141 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-54a5bc9d-a163-4653-997f-85522ef85a8d tempest-TestNetworkAdvancedServerOps-173376372 tempest-TestNetworkAdvancedServerOps-173376372-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849/action" status: 202 len: 0 microversion: 2.1 time: 0.551833 Oct 19 03:52:40.101106 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3151/6368] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:52:39 2022] POST /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849/action => generated 0 bytes in 554 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:52:40.110542 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c9412870-45dd-4a51-b3ea-c80c080f642e tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:52:40.111373 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c9412870-45dd-4a51-b3ea-c80c080f642e tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: 2b57ed72-0e3a-43c8-b552-875524942849] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:52:40.116102 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:52:40.120545 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c9412870-45dd-4a51-b3ea-c80c080f642e tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:40.121273 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c9412870-45dd-4a51-b3ea-c80c080f642e tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:40.121932 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c9412870-45dd-4a51-b3ea-c80c080f642e tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:40.128461 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c9412870-45dd-4a51-b3ea-c80c080f642e tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:40.128461 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c9412870-45dd-4a51-b3ea-c80c080f642e tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:40.128461 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c9412870-45dd-4a51-b3ea-c80c080f642e tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:40.162130 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9b4cfd46-761f-424d-98b5-a0bbcec34cfc tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:52:40.162743 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9b4cfd46-761f-424d-98b5-a0bbcec34cfc tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 1eeec04f-d94e-4625-ab65-6d227a640f2f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:52:40.169187 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9b4cfd46-761f-424d-98b5-a0bbcec34cfc tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:40.170072 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9b4cfd46-761f-424d-98b5-a0bbcec34cfc tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:40.170691 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9b4cfd46-761f-424d-98b5-a0bbcec34cfc tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:40.171857 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9b4cfd46-761f-424d-98b5-a0bbcec34cfc tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:40.172568 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9b4cfd46-761f-424d-98b5-a0bbcec34cfc tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:40.173156 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9b4cfd46-761f-424d-98b5-a0bbcec34cfc tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:40.395289 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c9412870-45dd-4a51-b3ea-c80c080f642e tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:40.405472 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c9412870-45dd-4a51-b3ea-c80c080f642e tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849" status: 200 len: 1687 microversion: 2.1 time: 0.299984 Oct 19 03:52:40.425937 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3218/6369] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:52:40 2022] GET /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849 => generated 1687 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:52:40.454234 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9b4cfd46-761f-424d-98b5-a0bbcec34cfc tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:40.463874 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9b4cfd46-761f-424d-98b5-a0bbcec34cfc tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:40.465630 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9b4cfd46-761f-424d-98b5-a0bbcec34cfc tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:40.467009 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9b4cfd46-761f-424d-98b5-a0bbcec34cfc tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f" status: 200 len: 1730 microversion: 2.20 time: 0.309780 Oct 19 03:52:40.468077 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3152/6370] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:52:40 2022] GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f => generated 1730 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:52:40.852832 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-24929954-ca98-4ea5-ac69-1e029bd1e58b req-bbe8f949-dcad-44ff-8b23-014b1d548952 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1eeec04f-d94e-4625-ab65-6d227a640f2f", "name": "network-vif-plugged", "status": "completed", "tag": "9487bc37-2fe4-4fbc-914a-50a09e00b655"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:52:40.864326 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-24929954-ca98-4ea5-ac69-1e029bd1e58b req-bbe8f949-dcad-44ff-8b23-014b1d548952 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:40.864821 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-24929954-ca98-4ea5-ac69-1e029bd1e58b req-bbe8f949-dcad-44ff-8b23-014b1d548952 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:40.865252 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-24929954-ca98-4ea5-ac69-1e029bd1e58b req-bbe8f949-dcad-44ff-8b23-014b1d548952 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:40.880999 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-24929954-ca98-4ea5-ac69-1e029bd1e58b req-bbe8f949-dcad-44ff-8b23-014b1d548952 service nova] Creating event network-vif-plugged:9487bc37-2fe4-4fbc-914a-50a09e00b655 for instance 1eeec04f-d94e-4625-ab65-6d227a640f2f on n-h1-861333-8 Oct 19 03:52:40.884200 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-24929954-ca98-4ea5-ac69-1e029bd1e58b req-bbe8f949-dcad-44ff-8b23-014b1d548952 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035183 Oct 19 03:52:40.885002 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3219/6371] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:52:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:52:41.442857 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8c9d709c-9052-43b1-8614-84b4d5942424 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:52:41.444278 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8c9d709c-9052-43b1-8614-84b4d5942424 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: 2b57ed72-0e3a-43c8-b552-875524942849] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:52:41.453727 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8c9d709c-9052-43b1-8614-84b4d5942424 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:41.454757 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8c9d709c-9052-43b1-8614-84b4d5942424 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:41.455862 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8c9d709c-9052-43b1-8614-84b4d5942424 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:41.456755 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8c9d709c-9052-43b1-8614-84b4d5942424 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:41.458994 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8c9d709c-9052-43b1-8614-84b4d5942424 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:41.458994 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8c9d709c-9052-43b1-8614-84b4d5942424 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:41.497002 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e7a33fa0-40d0-4520-9fd8-7713570460a6 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:52:41.497838 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e7a33fa0-40d0-4520-9fd8-7713570460a6 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 1eeec04f-d94e-4625-ab65-6d227a640f2f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:52:41.512464 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e7a33fa0-40d0-4520-9fd8-7713570460a6 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:41.516020 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e7a33fa0-40d0-4520-9fd8-7713570460a6 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:41.519067 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e7a33fa0-40d0-4520-9fd8-7713570460a6 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:41.520038 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e7a33fa0-40d0-4520-9fd8-7713570460a6 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:41.520513 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e7a33fa0-40d0-4520-9fd8-7713570460a6 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:41.520981 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e7a33fa0-40d0-4520-9fd8-7713570460a6 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:41.769175 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8c9d709c-9052-43b1-8614-84b4d5942424 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:41.796170 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8c9d709c-9052-43b1-8614-84b4d5942424 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849" status: 200 len: 1687 microversion: 2.1 time: 0.363844 Oct 19 03:52:41.803401 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-e7a33fa0-40d0-4520-9fd8-7713570460a6 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:41.811715 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3153/6372] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:52:41 2022] GET /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849 => generated 1687 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:52:41.812998 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-e7a33fa0-40d0-4520-9fd8-7713570460a6 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:41.814729 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-e7a33fa0-40d0-4520-9fd8-7713570460a6 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:41.816207 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e7a33fa0-40d0-4520-9fd8-7713570460a6 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f" status: 200 len: 1730 microversion: 2.20 time: 0.325041 Oct 19 03:52:41.816826 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3220/6373] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:52:41 2022] GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f => generated 1730 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:52:42.822369 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6a2929a1-9535-4959-842e-bf0fc4061586 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:52:42.823600 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6a2929a1-9535-4959-842e-bf0fc4061586 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: 2b57ed72-0e3a-43c8-b552-875524942849] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:52:42.830949 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6a2929a1-9535-4959-842e-bf0fc4061586 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:42.831767 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6a2929a1-9535-4959-842e-bf0fc4061586 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:42.832726 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6a2929a1-9535-4959-842e-bf0fc4061586 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:42.833663 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6a2929a1-9535-4959-842e-bf0fc4061586 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:42.834266 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6a2929a1-9535-4959-842e-bf0fc4061586 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:42.834693 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6a2929a1-9535-4959-842e-bf0fc4061586 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:42.849501 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1f71f503-d761-47c4-88c2-e2b2a8187f09 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:52:42.850320 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1f71f503-d761-47c4-88c2-e2b2a8187f09 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 1eeec04f-d94e-4625-ab65-6d227a640f2f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:52:42.857340 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1f71f503-d761-47c4-88c2-e2b2a8187f09 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:42.858415 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1f71f503-d761-47c4-88c2-e2b2a8187f09 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:42.859668 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1f71f503-d761-47c4-88c2-e2b2a8187f09 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:42.860597 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1f71f503-d761-47c4-88c2-e2b2a8187f09 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:42.861068 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1f71f503-d761-47c4-88c2-e2b2a8187f09 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:42.861538 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1f71f503-d761-47c4-88c2-e2b2a8187f09 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:43.080883 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-6a2929a1-9535-4959-842e-bf0fc4061586 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:43.089802 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6a2929a1-9535-4959-842e-bf0fc4061586 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849" status: 200 len: 1687 microversion: 2.1 time: 0.271208 Oct 19 03:52:43.090389 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3154/6374] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:52:42 2022] GET /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849 => generated 1687 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:52:43.097823 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-1f71f503-d761-47c4-88c2-e2b2a8187f09 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:43.106996 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-1f71f503-d761-47c4-88c2-e2b2a8187f09 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:43.108441 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-1f71f503-d761-47c4-88c2-e2b2a8187f09 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:43.110243 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1f71f503-d761-47c4-88c2-e2b2a8187f09 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f" status: 200 len: 1730 microversion: 2.20 time: 0.265750 Oct 19 03:52:43.111185 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3221/6375] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:52:42 2022] GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f => generated 1730 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:52:44.117649 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8cec69fc-a1b9-4fa6-bf73-4de78e420226 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:52:44.118371 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8cec69fc-a1b9-4fa6-bf73-4de78e420226 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: 2b57ed72-0e3a-43c8-b552-875524942849] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:52:44.124635 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8cec69fc-a1b9-4fa6-bf73-4de78e420226 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:44.125325 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8cec69fc-a1b9-4fa6-bf73-4de78e420226 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:44.125805 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8cec69fc-a1b9-4fa6-bf73-4de78e420226 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:44.126519 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8cec69fc-a1b9-4fa6-bf73-4de78e420226 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:44.127010 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8cec69fc-a1b9-4fa6-bf73-4de78e420226 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:44.127444 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8cec69fc-a1b9-4fa6-bf73-4de78e420226 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:44.141062 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f71f714b-6e7b-49c1-87cd-d10788d7c8b1 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:52:44.143227 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f71f714b-6e7b-49c1-87cd-d10788d7c8b1 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 1eeec04f-d94e-4625-ab65-6d227a640f2f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:52:44.150639 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:52:44.157562 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f71f714b-6e7b-49c1-87cd-d10788d7c8b1 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:44.159256 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f71f714b-6e7b-49c1-87cd-d10788d7c8b1 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:44.162059 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f71f714b-6e7b-49c1-87cd-d10788d7c8b1 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:44.162059 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f71f714b-6e7b-49c1-87cd-d10788d7c8b1 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:44.162059 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f71f714b-6e7b-49c1-87cd-d10788d7c8b1 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:44.162588 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f71f714b-6e7b-49c1-87cd-d10788d7c8b1 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:44.355860 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8cec69fc-a1b9-4fa6-bf73-4de78e420226 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:44.378711 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8cec69fc-a1b9-4fa6-bf73-4de78e420226 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849" status: 200 len: 1692 microversion: 2.1 time: 0.265857 Oct 19 03:52:44.381312 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3155/6376] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:52:44 2022] GET /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849 => generated 1692 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:52:44.408899 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f71f714b-6e7b-49c1-87cd-d10788d7c8b1 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:44.419240 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f71f714b-6e7b-49c1-87cd-d10788d7c8b1 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:44.421418 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f71f714b-6e7b-49c1-87cd-d10788d7c8b1 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:44.422846 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f71f714b-6e7b-49c1-87cd-d10788d7c8b1 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f" status: 200 len: 1730 microversion: 2.20 time: 0.290513 Oct 19 03:52:44.423425 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3222/6377] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:52:44 2022] GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f => generated 1730 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:52:45.408325 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9262fb79-b5f3-467a-b2a6-c67b0d1f1882 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:52:45.413473 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9262fb79-b5f3-467a-b2a6-c67b0d1f1882 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: 2b57ed72-0e3a-43c8-b552-875524942849] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:52:45.413473 n-d-861333-8 devstack@n-api.service[121134]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 03:52:45.413473 n-d-861333-8 devstack@n-api.service[121134]: Wed Oct 19 03:52:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849 (ip 10.222.0.52) !!! Oct 19 03:52:45.425915 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9262fb79-b5f3-467a-b2a6-c67b0d1f1882 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:45.426404 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9262fb79-b5f3-467a-b2a6-c67b0d1f1882 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:45.426843 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9262fb79-b5f3-467a-b2a6-c67b0d1f1882 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:45.427548 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9262fb79-b5f3-467a-b2a6-c67b0d1f1882 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:45.427999 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9262fb79-b5f3-467a-b2a6-c67b0d1f1882 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:45.428426 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9262fb79-b5f3-467a-b2a6-c67b0d1f1882 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:45.450149 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-85f4871a-1639-4329-b055-d296bc823fab tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:52:45.451066 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-85f4871a-1639-4329-b055-d296bc823fab tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 1eeec04f-d94e-4625-ab65-6d227a640f2f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:52:45.458767 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-85f4871a-1639-4329-b055-d296bc823fab tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:45.459261 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-85f4871a-1639-4329-b055-d296bc823fab tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:45.459702 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-85f4871a-1639-4329-b055-d296bc823fab tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:45.460409 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-85f4871a-1639-4329-b055-d296bc823fab tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:45.460867 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-85f4871a-1639-4329-b055-d296bc823fab tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:45.461300 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-85f4871a-1639-4329-b055-d296bc823fab tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:45.679925 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9262fb79-b5f3-467a-b2a6-c67b0d1f1882 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:45.689201 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9262fb79-b5f3-467a-b2a6-c67b0d1f1882 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849" status: 200 len: 1692 microversion: 2.1 time: 0.284792 Oct 19 03:52:45.689864 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3156/6378] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:52:45 2022] GET /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849 => generated 1692 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:52:45.696866 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-85f4871a-1639-4329-b055-d296bc823fab tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:45.706835 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-85f4871a-1639-4329-b055-d296bc823fab tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:45.708849 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-85f4871a-1639-4329-b055-d296bc823fab tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:45.714239 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-85f4871a-1639-4329-b055-d296bc823fab tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f" status: 200 len: 1717 microversion: 2.20 time: 0.268634 Oct 19 03:52:45.714936 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3223/6379] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:52:45 2022] GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f => generated 1717 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:52:46.717842 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6d04865f-9b71-4952-8eea-37a383c6c8c9 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:52:46.719072 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6d04865f-9b71-4952-8eea-37a383c6c8c9 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: 2b57ed72-0e3a-43c8-b552-875524942849] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:52:46.726605 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6d04865f-9b71-4952-8eea-37a383c6c8c9 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:46.727391 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6d04865f-9b71-4952-8eea-37a383c6c8c9 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:46.728070 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6d04865f-9b71-4952-8eea-37a383c6c8c9 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:46.729019 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6d04865f-9b71-4952-8eea-37a383c6c8c9 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:46.729721 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6d04865f-9b71-4952-8eea-37a383c6c8c9 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:46.730385 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6d04865f-9b71-4952-8eea-37a383c6c8c9 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:46.911119 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-6d04865f-9b71-4952-8eea-37a383c6c8c9 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:46.920846 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6d04865f-9b71-4952-8eea-37a383c6c8c9 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849" status: 200 len: 1692 microversion: 2.1 time: 0.211660 Oct 19 03:52:46.921477 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3157/6380] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:52:46 2022] GET /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849 => generated 1692 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:52:47.947243 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-48583d4d-afb5-4c2c-a8e5-a30e9e0a1895 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:52:47.949005 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-48583d4d-afb5-4c2c-a8e5-a30e9e0a1895 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: 2b57ed72-0e3a-43c8-b552-875524942849] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:52:47.957847 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-48583d4d-afb5-4c2c-a8e5-a30e9e0a1895 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:47.961072 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-48583d4d-afb5-4c2c-a8e5-a30e9e0a1895 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:47.961561 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-48583d4d-afb5-4c2c-a8e5-a30e9e0a1895 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:47.962497 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-48583d4d-afb5-4c2c-a8e5-a30e9e0a1895 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:47.963113 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-48583d4d-afb5-4c2c-a8e5-a30e9e0a1895 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:47.963704 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-48583d4d-afb5-4c2c-a8e5-a30e9e0a1895 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:48.456946 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-48583d4d-afb5-4c2c-a8e5-a30e9e0a1895 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:48.465557 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-48583d4d-afb5-4c2c-a8e5-a30e9e0a1895 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849" status: 200 len: 1692 microversion: 2.1 time: 0.525326 Oct 19 03:52:48.466662 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3224/6381] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:52:47 2022] GET /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849 => generated 1692 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:52:49.385615 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4b006f11-a0c5-45ae-a900-2166859d12d2 tempest-TestAggregatesBasicOps-17243852 tempest-TestAggregatesBasicOps-17243852-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-1524696654", "availability_zone": "foo_zone"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:52:49.389764 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.aggregate [None req-4b006f11-a0c5-45ae-a900-2166859d12d2 tempest-TestAggregatesBasicOps-17243852 tempest-TestAggregatesBasicOps-17243852-project-admin] Generated uuid c6cefd63-c329-4fcf-95cd-700efe2c98df for aggregate {{(pid=121134) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 19 03:52:49.471376 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4b006f11-a0c5-45ae-a900-2166859d12d2 tempest-TestAggregatesBasicOps-17243852 tempest-TestAggregatesBasicOps-17243852-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 200 len: 209 microversion: 2.1 time: 0.146279 Oct 19 03:52:49.472172 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3158/6382] 10.222.0.52 () {60 vars in 1164 bytes} [Wed Oct 19 03:52:49 2022] POST /compute/v2.1/os-aggregates => generated 209 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:52:49.483825 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-45dbb4e1-cac0-457a-9bb6-9ed27123cf07 tempest-TestAggregatesBasicOps-17243852 tempest-TestAggregatesBasicOps-17243852-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:52:49.490462 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9e27ed6f-a8c8-40a6-849e-a67eab9e0d06 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:52:49.491106 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9e27ed6f-a8c8-40a6-849e-a67eab9e0d06 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: 2b57ed72-0e3a-43c8-b552-875524942849] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:52:49.498134 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9e27ed6f-a8c8-40a6-849e-a67eab9e0d06 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:49.498637 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9e27ed6f-a8c8-40a6-849e-a67eab9e0d06 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:49.499088 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9e27ed6f-a8c8-40a6-849e-a67eab9e0d06 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:49.499795 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9e27ed6f-a8c8-40a6-849e-a67eab9e0d06 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:49.500257 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9e27ed6f-a8c8-40a6-849e-a67eab9e0d06 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:49.500693 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9e27ed6f-a8c8-40a6-849e-a67eab9e0d06 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:49.590833 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-45dbb4e1-cac0-457a-9bb6-9ed27123cf07 tempest-TestAggregatesBasicOps-17243852 tempest-TestAggregatesBasicOps-17243852-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 319 microversion: 2.1 time: 0.110843 Oct 19 03:52:49.591748 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3225/6383] 10.222.0.52 () {60 vars in 1194 bytes} [Wed Oct 19 03:52:49 2022] POST /compute/v2.1/os-aggregates/19/action => generated 319 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:52:49.603086 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-8769047b-dda5-4967-a74f-e01733acb587 tempest-TestAggregatesBasicOps-17243852 tempest-TestAggregatesBasicOps-17243852-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:52:49.607424 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8769047b-dda5-4967-a74f-e01733acb587 tempest-TestAggregatesBasicOps-17243852 tempest-TestAggregatesBasicOps-17243852-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:49.607930 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8769047b-dda5-4967-a74f-e01733acb587 tempest-TestAggregatesBasicOps-17243852 tempest-TestAggregatesBasicOps-17243852-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:49.608381 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8769047b-dda5-4967-a74f-e01733acb587 tempest-TestAggregatesBasicOps-17243852 tempest-TestAggregatesBasicOps-17243852-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:49.609128 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8769047b-dda5-4967-a74f-e01733acb587 tempest-TestAggregatesBasicOps-17243852 tempest-TestAggregatesBasicOps-17243852-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:49.609626 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8769047b-dda5-4967-a74f-e01733acb587 tempest-TestAggregatesBasicOps-17243852 tempest-TestAggregatesBasicOps-17243852-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:49.610062 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8769047b-dda5-4967-a74f-e01733acb587 tempest-TestAggregatesBasicOps-17243852 tempest-TestAggregatesBasicOps-17243852-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:49.636091 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-8769047b-dda5-4967-a74f-e01733acb587 tempest-TestAggregatesBasicOps-17243852 tempest-TestAggregatesBasicOps-17243852-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.036640 Oct 19 03:52:49.636719 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3226/6384] 10.222.0.52 () {58 vars in 1176 bytes} [Wed Oct 19 03:52:49 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:52:49.648903 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0cd86a17-7299-49b9-beb9-1bff05103b46 tempest-TestAggregatesBasicOps-17243852 tempest-TestAggregatesBasicOps-17243852-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:52:49.656358 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0cd86a17-7299-49b9-beb9-1bff05103b46 tempest-TestAggregatesBasicOps-17243852 tempest-TestAggregatesBasicOps-17243852-project-admin] 10.222.0.52 "GET /compute/v2.1/os-aggregates" status: 200 len: 298 microversion: 2.1 time: 0.011562 Oct 19 03:52:49.656999 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3227/6385] 10.222.0.52 () {58 vars in 1143 bytes} [Wed Oct 19 03:52:49 2022] GET /compute/v2.1/os-aggregates => generated 298 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:52:49.673602 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0ae22549-3641-4915-a7d0-2fb65f36624d tempest-TestAggregatesBasicOps-17243852 tempest-TestAggregatesBasicOps-17243852-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-861333-8"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:52:49.684388 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0ae22549-3641-4915-a7d0-2fb65f36624d tempest-TestAggregatesBasicOps-17243852 tempest-TestAggregatesBasicOps-17243852-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:49.684883 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0ae22549-3641-4915-a7d0-2fb65f36624d tempest-TestAggregatesBasicOps-17243852 tempest-TestAggregatesBasicOps-17243852-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:49.685328 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0ae22549-3641-4915-a7d0-2fb65f36624d tempest-TestAggregatesBasicOps-17243852 tempest-TestAggregatesBasicOps-17243852-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:49.707927 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9e27ed6f-a8c8-40a6-849e-a67eab9e0d06 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:49.715752 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9e27ed6f-a8c8-40a6-849e-a67eab9e0d06 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849" status: 200 len: 1692 microversion: 2.1 time: 0.229733 Oct 19 03:52:49.716324 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3159/6386] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:52:49 2022] GET /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849 => generated 1692 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:52:49.924501 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0ae22549-3641-4915-a7d0-2fb65f36624d tempest-TestAggregatesBasicOps-17243852 tempest-TestAggregatesBasicOps-17243852-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 310 microversion: 2.1 time: 0.254662 Oct 19 03:52:49.925169 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3228/6387] 10.222.0.52 () {60 vars in 1194 bytes} [Wed Oct 19 03:52:49 2022] POST /compute/v2.1/os-aggregates/19/action => generated 310 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:52:49.936559 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0fd8610a-c7a3-488d-88b6-94ccb003a93f tempest-TestAggregatesBasicOps-17243852 tempest-TestAggregatesBasicOps-17243852-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:52:49.945346 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0fd8610a-c7a3-488d-88b6-94ccb003a93f tempest-TestAggregatesBasicOps-17243852 tempest-TestAggregatesBasicOps-17243852-project-admin] 10.222.0.52 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 310 microversion: 2.1 time: 0.012419 Oct 19 03:52:49.945948 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3160/6388] 10.222.0.52 () {58 vars in 1152 bytes} [Wed Oct 19 03:52:49 2022] GET /compute/v2.1/os-aggregates/19 => generated 310 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:52:49.958309 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c9c034c2-ec94-463c-bc20-ca8e6b5a6f7f tempest-TestAggregatesBasicOps-17243852 tempest-TestAggregatesBasicOps-17243852-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-12198170", "availability_zone": "foo_zone"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:52:50.068226 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c9c034c2-ec94-463c-bc20-ca8e6b5a6f7f tempest-TestAggregatesBasicOps-17243852 tempest-TestAggregatesBasicOps-17243852-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 340 microversion: 2.1 time: 0.114308 Oct 19 03:52:50.075373 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3229/6389] 10.222.0.52 () {60 vars in 1173 bytes} [Wed Oct 19 03:52:49 2022] PUT /compute/v2.1/os-aggregates/19 => generated 340 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:52:50.080480 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1b1df323-9248-4627-8f66-50ced7593617 tempest-TestAggregatesBasicOps-17243852 tempest-TestAggregatesBasicOps-17243852-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:52:50.161259 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1b1df323-9248-4627-8f66-50ced7593617 tempest-TestAggregatesBasicOps-17243852 tempest-TestAggregatesBasicOps-17243852-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 354 microversion: 2.1 time: 0.084533 Oct 19 03:52:50.161830 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3161/6390] 10.222.0.52 () {60 vars in 1194 bytes} [Wed Oct 19 03:52:50 2022] POST /compute/v2.1/os-aggregates/19/action => generated 354 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:52:50.173009 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d4412cdd-48b6-4d47-a042-3d42c6bfab6f tempest-TestAggregatesBasicOps-17243852 tempest-TestAggregatesBasicOps-17243852-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:52:50.182452 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d4412cdd-48b6-4d47-a042-3d42c6bfab6f tempest-TestAggregatesBasicOps-17243852 tempest-TestAggregatesBasicOps-17243852-project-admin] 10.222.0.52 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 354 microversion: 2.1 time: 0.013173 Oct 19 03:52:50.183019 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3230/6391] 10.222.0.52 () {58 vars in 1152 bytes} [Wed Oct 19 03:52:50 2022] GET /compute/v2.1/os-aggregates/19 => generated 354 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:52:50.195268 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ce6cc2c8-bff3-4fc1-9f3e-1c735f4a1b55 tempest-TestAggregatesBasicOps-17243852 tempest-TestAggregatesBasicOps-17243852-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-861333-8"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:52:50.206631 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ce6cc2c8-bff3-4fc1-9f3e-1c735f4a1b55 tempest-TestAggregatesBasicOps-17243852 tempest-TestAggregatesBasicOps-17243852-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:50.207134 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ce6cc2c8-bff3-4fc1-9f3e-1c735f4a1b55 tempest-TestAggregatesBasicOps-17243852 tempest-TestAggregatesBasicOps-17243852-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:50.207597 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ce6cc2c8-bff3-4fc1-9f3e-1c735f4a1b55 tempest-TestAggregatesBasicOps-17243852 tempest-TestAggregatesBasicOps-17243852-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:50.458496 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ce6cc2c8-bff3-4fc1-9f3e-1c735f4a1b55 tempest-TestAggregatesBasicOps-17243852 tempest-TestAggregatesBasicOps-17243852-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 339 microversion: 2.1 time: 0.267631 Oct 19 03:52:50.459197 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3162/6392] 10.222.0.52 () {60 vars in 1194 bytes} [Wed Oct 19 03:52:50 2022] POST /compute/v2.1/os-aggregates/19/action => generated 339 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:52:50.470523 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-fe6090ae-a50e-4530-8502-83a303888b31 tempest-TestAggregatesBasicOps-17243852 tempest-TestAggregatesBasicOps-17243852-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:52:50.560933 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-fe6090ae-a50e-4530-8502-83a303888b31 tempest-TestAggregatesBasicOps-17243852 tempest-TestAggregatesBasicOps-17243852-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.094035 Oct 19 03:52:50.567189 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3231/6393] 10.222.0.52 () {58 vars in 1155 bytes} [Wed Oct 19 03:52:50 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 19 03:52:50.740089 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d1ecfcfb-d1ab-41e8-a2b5-23a431ecf8d5 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:52:50.740725 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d1ecfcfb-d1ab-41e8-a2b5-23a431ecf8d5 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: 2b57ed72-0e3a-43c8-b552-875524942849] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:52:50.747684 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d1ecfcfb-d1ab-41e8-a2b5-23a431ecf8d5 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:50.748188 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d1ecfcfb-d1ab-41e8-a2b5-23a431ecf8d5 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:50.748638 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d1ecfcfb-d1ab-41e8-a2b5-23a431ecf8d5 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:50.749721 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d1ecfcfb-d1ab-41e8-a2b5-23a431ecf8d5 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:50.750191 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d1ecfcfb-d1ab-41e8-a2b5-23a431ecf8d5 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:50.750774 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d1ecfcfb-d1ab-41e8-a2b5-23a431ecf8d5 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:50.915994 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d1ecfcfb-d1ab-41e8-a2b5-23a431ecf8d5 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:50.924350 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d1ecfcfb-d1ab-41e8-a2b5-23a431ecf8d5 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849" status: 200 len: 1692 microversion: 2.1 time: 0.188333 Oct 19 03:52:50.925556 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3163/6394] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:52:50 2022] GET /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849 => generated 1692 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:52:51.963820 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6b3a6fb2-905c-4da3-871f-b28e1f445454 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:52:51.963820 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6b3a6fb2-905c-4da3-871f-b28e1f445454 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: 2b57ed72-0e3a-43c8-b552-875524942849] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:52:52.007584 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6b3a6fb2-905c-4da3-871f-b28e1f445454 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:52.008717 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6b3a6fb2-905c-4da3-871f-b28e1f445454 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:52.009283 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6b3a6fb2-905c-4da3-871f-b28e1f445454 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:52.010587 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6b3a6fb2-905c-4da3-871f-b28e1f445454 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:52.011356 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6b3a6fb2-905c-4da3-871f-b28e1f445454 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:52.015167 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6b3a6fb2-905c-4da3-871f-b28e1f445454 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:52.180270 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-6b3a6fb2-905c-4da3-871f-b28e1f445454 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:52.191299 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6b3a6fb2-905c-4da3-871f-b28e1f445454 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849" status: 200 len: 1692 microversion: 2.1 time: 0.244694 Oct 19 03:52:52.193731 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3232/6395] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:52:51 2022] GET /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849 => generated 1692 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:52:53.217503 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5ab2c24a-acc2-43f8-b61c-7e080ca157c8 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:52:53.218417 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5ab2c24a-acc2-43f8-b61c-7e080ca157c8 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: 2b57ed72-0e3a-43c8-b552-875524942849] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:52:53.226597 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5ab2c24a-acc2-43f8-b61c-7e080ca157c8 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:53.227106 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5ab2c24a-acc2-43f8-b61c-7e080ca157c8 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:53.227557 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5ab2c24a-acc2-43f8-b61c-7e080ca157c8 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:53.228336 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5ab2c24a-acc2-43f8-b61c-7e080ca157c8 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:53.228800 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5ab2c24a-acc2-43f8-b61c-7e080ca157c8 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:53.229236 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5ab2c24a-acc2-43f8-b61c-7e080ca157c8 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:53.496716 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5ab2c24a-acc2-43f8-b61c-7e080ca157c8 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:53.508712 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5ab2c24a-acc2-43f8-b61c-7e080ca157c8 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849" status: 200 len: 1692 microversion: 2.1 time: 0.295189 Oct 19 03:52:53.512814 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3164/6396] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:52:53 2022] GET /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849 => generated 1692 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:52:54.537717 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5dbfbf76-93fd-4ba5-95ad-faf0f5512311 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:52:54.539034 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-5dbfbf76-93fd-4ba5-95ad-faf0f5512311 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: 2b57ed72-0e3a-43c8-b552-875524942849] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:52:54.549541 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5dbfbf76-93fd-4ba5-95ad-faf0f5512311 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:54.550352 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5dbfbf76-93fd-4ba5-95ad-faf0f5512311 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:54.551676 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5dbfbf76-93fd-4ba5-95ad-faf0f5512311 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:54.552558 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5dbfbf76-93fd-4ba5-95ad-faf0f5512311 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:54.553174 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5dbfbf76-93fd-4ba5-95ad-faf0f5512311 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:54.553983 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5dbfbf76-93fd-4ba5-95ad-faf0f5512311 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:54.725931 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-5dbfbf76-93fd-4ba5-95ad-faf0f5512311 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:54.738030 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5dbfbf76-93fd-4ba5-95ad-faf0f5512311 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849" status: 200 len: 1692 microversion: 2.1 time: 0.204562 Oct 19 03:52:54.738030 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3233/6397] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:52:54 2022] GET /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849 => generated 1692 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:52:55.758445 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7d72b5df-d32f-4a4e-9e76-df9afc62e9c4 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:52:55.759659 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7d72b5df-d32f-4a4e-9e76-df9afc62e9c4 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: 2b57ed72-0e3a-43c8-b552-875524942849] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:52:55.766296 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7d72b5df-d32f-4a4e-9e76-df9afc62e9c4 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:55.766789 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7d72b5df-d32f-4a4e-9e76-df9afc62e9c4 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:55.767233 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7d72b5df-d32f-4a4e-9e76-df9afc62e9c4 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:55.767939 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7d72b5df-d32f-4a4e-9e76-df9afc62e9c4 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:55.768402 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7d72b5df-d32f-4a4e-9e76-df9afc62e9c4 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:55.768833 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7d72b5df-d32f-4a4e-9e76-df9afc62e9c4 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:55.952715 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-7d72b5df-d32f-4a4e-9e76-df9afc62e9c4 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:55.960486 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7d72b5df-d32f-4a4e-9e76-df9afc62e9c4 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849" status: 200 len: 1692 microversion: 2.1 time: 0.206508 Oct 19 03:52:55.961069 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3165/6398] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:52:55 2022] GET /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849 => generated 1692 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:52:56.986096 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a1089c52-3350-48fe-8462-a3812fde7801 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:52:56.986778 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a1089c52-3350-48fe-8462-a3812fde7801 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: 2b57ed72-0e3a-43c8-b552-875524942849] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:52:56.995986 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a1089c52-3350-48fe-8462-a3812fde7801 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:56.996677 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a1089c52-3350-48fe-8462-a3812fde7801 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:56.997123 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a1089c52-3350-48fe-8462-a3812fde7801 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:56.997865 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a1089c52-3350-48fe-8462-a3812fde7801 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:56.998325 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a1089c52-3350-48fe-8462-a3812fde7801 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:56.998757 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a1089c52-3350-48fe-8462-a3812fde7801 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:57.232833 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a1089c52-3350-48fe-8462-a3812fde7801 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:57.246826 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a1089c52-3350-48fe-8462-a3812fde7801 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849" status: 200 len: 1692 microversion: 2.1 time: 0.264550 Oct 19 03:52:57.252314 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3234/6399] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:52:56 2022] GET /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849 => generated 1692 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:52:58.276078 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3b5c77f7-bd03-4270-a4f0-c0a0ee641c49 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:52:58.276911 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3b5c77f7-bd03-4270-a4f0-c0a0ee641c49 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: 2b57ed72-0e3a-43c8-b552-875524942849] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:52:58.284322 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3b5c77f7-bd03-4270-a4f0-c0a0ee641c49 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:58.284859 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3b5c77f7-bd03-4270-a4f0-c0a0ee641c49 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:58.285307 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3b5c77f7-bd03-4270-a4f0-c0a0ee641c49 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:58.286051 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3b5c77f7-bd03-4270-a4f0-c0a0ee641c49 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:58.286515 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3b5c77f7-bd03-4270-a4f0-c0a0ee641c49 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:58.286970 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3b5c77f7-bd03-4270-a4f0-c0a0ee641c49 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:58.497201 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-3b5c77f7-bd03-4270-a4f0-c0a0ee641c49 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:58.506879 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3b5c77f7-bd03-4270-a4f0-c0a0ee641c49 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849" status: 200 len: 1692 microversion: 2.1 time: 0.234695 Oct 19 03:52:58.525299 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3166/6400] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:52:58 2022] GET /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849 => generated 1692 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:52:59.532000 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1ea5fa38-52b1-4be2-86ae-e59dd6eee33e tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:52:59.532919 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1ea5fa38-52b1-4be2-86ae-e59dd6eee33e tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: 2b57ed72-0e3a-43c8-b552-875524942849] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:52:59.540988 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1ea5fa38-52b1-4be2-86ae-e59dd6eee33e tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:59.541550 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1ea5fa38-52b1-4be2-86ae-e59dd6eee33e tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:59.544170 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1ea5fa38-52b1-4be2-86ae-e59dd6eee33e tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:59.544170 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1ea5fa38-52b1-4be2-86ae-e59dd6eee33e tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:52:59.544170 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1ea5fa38-52b1-4be2-86ae-e59dd6eee33e tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:52:59.544170 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1ea5fa38-52b1-4be2-86ae-e59dd6eee33e tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:52:59.616807 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:52:59.686610 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-1ea5fa38-52b1-4be2-86ae-e59dd6eee33e tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:52:59.695060 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1ea5fa38-52b1-4be2-86ae-e59dd6eee33e tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849" status: 200 len: 1692 microversion: 2.1 time: 0.167062 Oct 19 03:52:59.695623 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3235/6401] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:52:59 2022] GET /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849 => generated 1692 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:53:00.721120 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7332d33e-2188-4ec3-851c-1cdb38ca08b9 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:53:00.723678 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7332d33e-2188-4ec3-851c-1cdb38ca08b9 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: 2b57ed72-0e3a-43c8-b552-875524942849] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:53:00.731563 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7332d33e-2188-4ec3-851c-1cdb38ca08b9 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:00.732098 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7332d33e-2188-4ec3-851c-1cdb38ca08b9 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:00.732694 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7332d33e-2188-4ec3-851c-1cdb38ca08b9 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:00.733440 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7332d33e-2188-4ec3-851c-1cdb38ca08b9 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:00.734082 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7332d33e-2188-4ec3-851c-1cdb38ca08b9 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:00.734520 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7332d33e-2188-4ec3-851c-1cdb38ca08b9 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:00.912279 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-7332d33e-2188-4ec3-851c-1cdb38ca08b9 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:53:00.920595 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7332d33e-2188-4ec3-851c-1cdb38ca08b9 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849" status: 200 len: 1692 microversion: 2.1 time: 0.204971 Oct 19 03:53:00.921565 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3167/6402] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:53:00 2022] GET /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849 => generated 1692 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:53:02.207733 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-e92e35b1-6c64-4f1d-bedf-4128489bed02 req-8a035fa2-bb15-46bf-8a24-0627e17127b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b57ed72-0e3a-43c8-b552-875524942849", "name": "network-vif-unplugged", "status": "completed", "tag": "b71571a2-9eae-43a2-9932-7383aafff2d1"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:53:02.210185 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-14fee284-9af9-4126-9d45-4c204ebf96b7 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:53:02.211375 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-14fee284-9af9-4126-9d45-4c204ebf96b7 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: 2b57ed72-0e3a-43c8-b552-875524942849] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:53:02.218926 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-14fee284-9af9-4126-9d45-4c204ebf96b7 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:02.219579 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-14fee284-9af9-4126-9d45-4c204ebf96b7 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:02.220273 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-14fee284-9af9-4126-9d45-4c204ebf96b7 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:02.220998 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-14fee284-9af9-4126-9d45-4c204ebf96b7 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:02.221475 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-14fee284-9af9-4126-9d45-4c204ebf96b7 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:02.221903 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-14fee284-9af9-4126-9d45-4c204ebf96b7 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:02.225570 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-e92e35b1-6c64-4f1d-bedf-4128489bed02 req-8a035fa2-bb15-46bf-8a24-0627e17127b1 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:02.225570 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-e92e35b1-6c64-4f1d-bedf-4128489bed02 req-8a035fa2-bb15-46bf-8a24-0627e17127b1 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:02.225796 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-e92e35b1-6c64-4f1d-bedf-4128489bed02 req-8a035fa2-bb15-46bf-8a24-0627e17127b1 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:02.244216 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-e92e35b1-6c64-4f1d-bedf-4128489bed02 req-8a035fa2-bb15-46bf-8a24-0627e17127b1 service nova] Creating event network-vif-unplugged:b71571a2-9eae-43a2-9932-7383aafff2d1 for instance 2b57ed72-0e3a-43c8-b552-875524942849 on n-h2-861333-8 Oct 19 03:53:02.279500 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [req-e92e35b1-6c64-4f1d-bedf-4128489bed02 req-8a035fa2-bb15-46bf-8a24-0627e17127b1 service nova] Instance 2b57ed72-0e3a-43c8-b552-875524942849 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-861333-8', 'n-h1-861333-8'} {{(pid=121134) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 03:53:02.300523 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-e92e35b1-6c64-4f1d-bedf-4128489bed02 req-8a035fa2-bb15-46bf-8a24-0627e17127b1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.096004 Oct 19 03:53:02.317292 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3168/6403] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:53:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:53:02.537762 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-14fee284-9af9-4126-9d45-4c204ebf96b7 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:53:02.556841 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-14fee284-9af9-4126-9d45-4c204ebf96b7 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849" status: 200 len: 1691 microversion: 2.1 time: 0.614728 Oct 19 03:53:02.561985 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3236/6404] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:53:01 2022] GET /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849 => generated 1691 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:53:03.585779 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c1cc1631-e5fa-4e19-8d5d-39b8ca22f48f tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:53:03.586491 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c1cc1631-e5fa-4e19-8d5d-39b8ca22f48f tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: 2b57ed72-0e3a-43c8-b552-875524942849] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:53:03.601170 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c1cc1631-e5fa-4e19-8d5d-39b8ca22f48f tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:03.605810 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c1cc1631-e5fa-4e19-8d5d-39b8ca22f48f tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:03.605810 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c1cc1631-e5fa-4e19-8d5d-39b8ca22f48f tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:03.605810 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c1cc1631-e5fa-4e19-8d5d-39b8ca22f48f tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:03.605810 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c1cc1631-e5fa-4e19-8d5d-39b8ca22f48f tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:03.605810 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c1cc1631-e5fa-4e19-8d5d-39b8ca22f48f tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:03.914364 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c1cc1631-e5fa-4e19-8d5d-39b8ca22f48f tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:53:03.923655 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c1cc1631-e5fa-4e19-8d5d-39b8ca22f48f tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849" status: 200 len: 1691 microversion: 2.1 time: 0.343069 Oct 19 03:53:03.927528 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3169/6405] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:53:03 2022] GET /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849 => generated 1691 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:53:04.319435 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-57f8bf00-56f0-45f2-b56c-f5efb599f94b req-c2413579-7f0b-491d-a7a8-3a03e6c311ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b57ed72-0e3a-43c8-b552-875524942849", "tag": "b71571a2-9eae-43a2-9932-7383aafff2d1"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:53:04.361735 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-57f8bf00-56f0-45f2-b56c-f5efb599f94b req-c2413579-7f0b-491d-a7a8-3a03e6c311ca service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:04.362248 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-57f8bf00-56f0-45f2-b56c-f5efb599f94b req-c2413579-7f0b-491d-a7a8-3a03e6c311ca service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:04.362685 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-57f8bf00-56f0-45f2-b56c-f5efb599f94b req-c2413579-7f0b-491d-a7a8-3a03e6c311ca service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:04.389135 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-57f8bf00-56f0-45f2-b56c-f5efb599f94b req-c2413579-7f0b-491d-a7a8-3a03e6c311ca service nova] Creating event network-changed:b71571a2-9eae-43a2-9932-7383aafff2d1 for instance 2b57ed72-0e3a-43c8-b552-875524942849 on n-h2-861333-8 Oct 19 03:53:04.396036 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [req-57f8bf00-56f0-45f2-b56c-f5efb599f94b req-c2413579-7f0b-491d-a7a8-3a03e6c311ca service nova] Instance 2b57ed72-0e3a-43c8-b552-875524942849 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-861333-8', 'n-h1-861333-8'} {{(pid=121135) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 03:53:04.409754 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-57f8bf00-56f0-45f2-b56c-f5efb599f94b req-c2413579-7f0b-491d-a7a8-3a03e6c311ca service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095596 Oct 19 03:53:04.410117 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3237/6406] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:53:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:53:04.949559 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-86e48204-325b-45a8-afcf-97cbf2580ed6 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:53:04.950832 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-86e48204-325b-45a8-afcf-97cbf2580ed6 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: 2b57ed72-0e3a-43c8-b552-875524942849] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:53:04.965161 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-86e48204-325b-45a8-afcf-97cbf2580ed6 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:04.965722 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-86e48204-325b-45a8-afcf-97cbf2580ed6 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:04.966457 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-86e48204-325b-45a8-afcf-97cbf2580ed6 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:04.971522 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-86e48204-325b-45a8-afcf-97cbf2580ed6 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:04.971522 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-86e48204-325b-45a8-afcf-97cbf2580ed6 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:04.971522 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-86e48204-325b-45a8-afcf-97cbf2580ed6 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:05.119535 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-86e48204-325b-45a8-afcf-97cbf2580ed6 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:53:05.135490 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-86e48204-325b-45a8-afcf-97cbf2580ed6 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849" status: 200 len: 1689 microversion: 2.1 time: 0.190237 Oct 19 03:53:05.146587 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3170/6407] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:53:04 2022] GET /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849 => generated 1689 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:53:06.161959 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2310e1ee-f06c-498a-a9f2-2ad3d7e0c070 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:53:06.162941 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-2310e1ee-f06c-498a-a9f2-2ad3d7e0c070 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: 2b57ed72-0e3a-43c8-b552-875524942849] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:53:06.184581 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2310e1ee-f06c-498a-a9f2-2ad3d7e0c070 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:06.186058 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2310e1ee-f06c-498a-a9f2-2ad3d7e0c070 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:06.186726 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2310e1ee-f06c-498a-a9f2-2ad3d7e0c070 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:06.187978 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2310e1ee-f06c-498a-a9f2-2ad3d7e0c070 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:06.188658 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2310e1ee-f06c-498a-a9f2-2ad3d7e0c070 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:06.190508 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2310e1ee-f06c-498a-a9f2-2ad3d7e0c070 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:06.555329 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-2310e1ee-f06c-498a-a9f2-2ad3d7e0c070 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:53:06.558649 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=100 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:53:06.567768 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2310e1ee-f06c-498a-a9f2-2ad3d7e0c070 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849" status: 200 len: 1689 microversion: 2.1 time: 0.410908 Oct 19 03:53:06.568376 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3238/6408] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:53:06 2022] GET /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849 => generated 1689 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:53:06.591707 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2e910bb1-8fe9-405c-b478-dddab938809d tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-1744816373", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "networks": [{"uuid": "fa8a096c-2333-4ffd-b910-55738ff162e7"}], "key_name": "tempest-TestSecurityGroupsBasicOps-93452807", "security_groups": []}, "os:scheduler_hints": {"different_host": ["8346e5ae-6c1f-4ab8-9ebf-0bb59c802a8b"]}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:53:06.663606 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-2e910bb1-8fe9-405c-b478-dddab938809d tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] validate_networks() for [('fa8a096c-2333-4ffd-b910-55738ff162e7', None, None, None, None, None)] {{(pid=121134) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:53:07.150014 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-2e910bb1-8fe9-405c-b478-dddab938809d tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Flavor limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:53:07.150450 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-2e910bb1-8fe9-405c-b478-dddab938809d tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Image limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:53:07.150929 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-2e910bb1-8fe9-405c-b478-dddab938809d tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Flavor pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:53:07.151346 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-2e910bb1-8fe9-405c-b478-dddab938809d tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Image pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:53:07.151771 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-2e910bb1-8fe9-405c-b478-dddab938809d tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:53:07.161541 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2e910bb1-8fe9-405c-b478-dddab938809d tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:07.162035 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2e910bb1-8fe9-405c-b478-dddab938809d tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:07.162478 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2e910bb1-8fe9-405c-b478-dddab938809d tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:07.163216 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2e910bb1-8fe9-405c-b478-dddab938809d tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:07.163679 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2e910bb1-8fe9-405c-b478-dddab938809d tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:07.164111 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2e910bb1-8fe9-405c-b478-dddab938809d tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:07.181743 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-2e910bb1-8fe9-405c-b478-dddab938809d tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Getting quotas for project 6f4f31b5836f40e580c28153626ec6ce. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:53:07.187320 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-2e910bb1-8fe9-405c-b478-dddab938809d tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Getting quotas for user 8d8ec7142c79407b81108e90ce3657d5 and project 6f4f31b5836f40e580c28153626ec6ce. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:53:07.201055 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2e910bb1-8fe9-405c-b478-dddab938809d tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Going to run 1 instances... {{(pid=121134) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:53:07.203487 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2e910bb1-8fe9-405c-b478-dddab938809d tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] [instance: 8b8ec387-c84b-4c5b-8d3b-d2e31fb3fa26] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:53:07.350401 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2e910bb1-8fe9-405c-b478-dddab938809d tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 0.762391 Oct 19 03:53:07.351071 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3171/6409] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:53:06 2022] POST /compute/v2.1/servers => generated 361 bytes in 764 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 03:53:07.363757 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0fcfc43c-80d9-42d5-abbd-0edba9bc650d tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:53:07.364977 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0fcfc43c-80d9-42d5-abbd-0edba9bc650d tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] [instance: 8b8ec387-c84b-4c5b-8d3b-d2e31fb3fa26] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:53:07.452824 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-0fcfc43c-80d9-42d5-abbd-0edba9bc650d tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d8ec7142c79407b81108e90ce3657d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f4f31b5836f40e580c28153626ec6ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:53:07.461101 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0fcfc43c-80d9-42d5-abbd-0edba9bc650d tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] 10.222.0.52 "GET /compute/v2.1/servers/8b8ec387-c84b-4c5b-8d3b-d2e31fb3fa26" status: 200 len: 1240 microversion: 2.1 time: 0.102668 Oct 19 03:53:07.462217 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3239/6410] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:53:07 2022] GET /compute/v2.1/servers/8b8ec387-c84b-4c5b-8d3b-d2e31fb3fa26 => generated 1240 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:53:07.593619 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3a73d3af-b24c-45f8-92d6-13fac372a3b5 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:53:07.595151 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3a73d3af-b24c-45f8-92d6-13fac372a3b5 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: 2b57ed72-0e3a-43c8-b552-875524942849] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:53:07.604777 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3a73d3af-b24c-45f8-92d6-13fac372a3b5 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:07.611095 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3a73d3af-b24c-45f8-92d6-13fac372a3b5 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:07.612142 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3a73d3af-b24c-45f8-92d6-13fac372a3b5 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:07.614438 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3a73d3af-b24c-45f8-92d6-13fac372a3b5 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:07.615154 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3a73d3af-b24c-45f8-92d6-13fac372a3b5 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:07.616279 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3a73d3af-b24c-45f8-92d6-13fac372a3b5 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:07.786227 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-3a73d3af-b24c-45f8-92d6-13fac372a3b5 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:53:07.795690 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3a73d3af-b24c-45f8-92d6-13fac372a3b5 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849" status: 200 len: 1686 microversion: 2.1 time: 0.206935 Oct 19 03:53:07.796608 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3172/6411] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:53:07 2022] GET /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849 => generated 1686 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:53:07.821408 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c9f33187-f574-488a-97b0-9738f7c3df84 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:53:07.822047 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c9f33187-f574-488a-97b0-9738f7c3df84 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: 2b57ed72-0e3a-43c8-b552-875524942849] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:53:07.829130 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c9f33187-f574-488a-97b0-9738f7c3df84 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:07.829994 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c9f33187-f574-488a-97b0-9738f7c3df84 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:07.830648 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c9f33187-f574-488a-97b0-9738f7c3df84 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:07.831651 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c9f33187-f574-488a-97b0-9738f7c3df84 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:07.832320 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c9f33187-f574-488a-97b0-9738f7c3df84 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:07.832967 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c9f33187-f574-488a-97b0-9738f7c3df84 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:07.897296 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5fe82958-f2ab-463e-98ee-75eda48a8e7d tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-1505782545", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "networks": [{"uuid": "a6f3e683-38a9-490b-ad07-79c3dcd2fd9a"}]}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:53:07.957950 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.network.neutron [None req-5fe82958-f2ab-463e-98ee-75eda48a8e7d tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] validate_networks() for [('a6f3e683-38a9-490b-ad07-79c3dcd2fd9a', None, None, None, None, None)] {{(pid=121135) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:53:08.180634 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c9f33187-f574-488a-97b0-9738f7c3df84 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "POST /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849/action" status: 202 len: 0 microversion: 2.1 time: 0.363742 Oct 19 03:53:08.181661 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3173/6412] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:53:07 2022] POST /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849/action => generated 0 bytes in 366 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 19 03:53:08.201572 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1ca645a5-0a6f-4089-a688-774f93fb8b14 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:53:08.202646 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1ca645a5-0a6f-4089-a688-774f93fb8b14 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: 2b57ed72-0e3a-43c8-b552-875524942849] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:53:08.212356 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1ca645a5-0a6f-4089-a688-774f93fb8b14 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:08.212356 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1ca645a5-0a6f-4089-a688-774f93fb8b14 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:08.212356 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1ca645a5-0a6f-4089-a688-774f93fb8b14 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:08.212356 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1ca645a5-0a6f-4089-a688-774f93fb8b14 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:08.212821 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1ca645a5-0a6f-4089-a688-774f93fb8b14 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:08.213006 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1ca645a5-0a6f-4089-a688-774f93fb8b14 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:08.904467 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-5fe82958-f2ab-463e-98ee-75eda48a8e7d tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Flavor limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:53:08.904965 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-5fe82958-f2ab-463e-98ee-75eda48a8e7d tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Image limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:53:08.906219 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-5fe82958-f2ab-463e-98ee-75eda48a8e7d tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Flavor pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:53:08.906647 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-5fe82958-f2ab-463e-98ee-75eda48a8e7d tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Image pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:53:08.907070 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-5fe82958-f2ab-463e-98ee-75eda48a8e7d tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:53:08.917977 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5fe82958-f2ab-463e-98ee-75eda48a8e7d tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:08.918995 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5fe82958-f2ab-463e-98ee-75eda48a8e7d tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:08.919503 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5fe82958-f2ab-463e-98ee-75eda48a8e7d tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:08.920489 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5fe82958-f2ab-463e-98ee-75eda48a8e7d tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:08.921134 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5fe82958-f2ab-463e-98ee-75eda48a8e7d tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:08.921916 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5fe82958-f2ab-463e-98ee-75eda48a8e7d tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:08.935458 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-1ca645a5-0a6f-4089-a688-774f93fb8b14 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:53:08.945269 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-5fe82958-f2ab-463e-98ee-75eda48a8e7d tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Getting quotas for project 54ea53cc200c4428afb03a512f41bee4. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:53:08.946411 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:53:08.952441 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-5fe82958-f2ab-463e-98ee-75eda48a8e7d tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Getting quotas for user 518702207efb468a9dea88ad8ce1d557 and project 54ea53cc200c4428afb03a512f41bee4. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:53:08.959493 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1ca645a5-0a6f-4089-a688-774f93fb8b14 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849" status: 200 len: 1685 microversion: 2.1 time: 0.773087 Oct 19 03:53:08.964892 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3174/6413] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:53:08 2022] GET /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849 => generated 1685 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:53:08.976594 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-eff99f2f-4dd3-4d0b-a406-cbf9e5771737 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:53:08.980946 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-5fe82958-f2ab-463e-98ee-75eda48a8e7d tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Going to run 1 instances... {{(pid=121135) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:53:08.981081 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-eff99f2f-4dd3-4d0b-a406-cbf9e5771737 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] [instance: 8b8ec387-c84b-4c5b-8d3b-d2e31fb3fa26] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:53:08.983900 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-5fe82958-f2ab-463e-98ee-75eda48a8e7d tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] [instance: 70a4ad35-460a-46e6-8819-f73fb43cecaf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121135) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:53:08.989147 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:53:08.991348 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eff99f2f-4dd3-4d0b-a406-cbf9e5771737 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:08.992100 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eff99f2f-4dd3-4d0b-a406-cbf9e5771737 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:08.992785 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eff99f2f-4dd3-4d0b-a406-cbf9e5771737 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:08.993990 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eff99f2f-4dd3-4d0b-a406-cbf9e5771737 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:08.994670 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eff99f2f-4dd3-4d0b-a406-cbf9e5771737 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:08.995321 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eff99f2f-4dd3-4d0b-a406-cbf9e5771737 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:09.093510 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-eff99f2f-4dd3-4d0b-a406-cbf9e5771737 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d8ec7142c79407b81108e90ce3657d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f4f31b5836f40e580c28153626ec6ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:53:09.114844 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-eff99f2f-4dd3-4d0b-a406-cbf9e5771737 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] 10.222.0.52 "GET /compute/v2.1/servers/8b8ec387-c84b-4c5b-8d3b-d2e31fb3fa26" status: 200 len: 1292 microversion: 2.1 time: 0.148705 Oct 19 03:53:09.116131 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3175/6414] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:53:08 2022] GET /compute/v2.1/servers/8b8ec387-c84b-4c5b-8d3b-d2e31fb3fa26 => generated 1292 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:53:09.155817 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5fe82958-f2ab-463e-98ee-75eda48a8e7d tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.412112 Oct 19 03:53:09.156407 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3240/6415] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:53:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1414 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 19 03:53:09.189041 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b358769f-d328-45b1-9837-28d82ebb2583 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:53:09.189041 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b358769f-d328-45b1-9837-28d82ebb2583 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] [instance: 70a4ad35-460a-46e6-8819-f73fb43cecaf] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:53:09.266815 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b358769f-d328-45b1-9837-28d82ebb2583 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518702207efb468a9dea88ad8ce1d557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ea53cc200c4428afb03a512f41bee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:53:09.275226 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b358769f-d328-45b1-9837-28d82ebb2583 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] 10.222.0.52 "GET /compute/v2.1/servers/70a4ad35-460a-46e6-8819-f73fb43cecaf" status: 200 len: 1215 microversion: 2.1 time: 0.111249 Oct 19 03:53:09.276522 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3176/6416] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:53:09 2022] GET /compute/v2.1/servers/70a4ad35-460a-46e6-8819-f73fb43cecaf => generated 1215 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:53:09.561966 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-d6163356-0f77-4ad0-b4ad-cea1b9923f82 req-ee309070-bd9f-460f-94d9-8f2911b39dbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b57ed72-0e3a-43c8-b552-875524942849", "name": "network-vif-plugged", "status": "completed", "tag": "b71571a2-9eae-43a2-9932-7383aafff2d1"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:53:09.573765 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-d6163356-0f77-4ad0-b4ad-cea1b9923f82 req-ee309070-bd9f-460f-94d9-8f2911b39dbb service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:09.574260 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-d6163356-0f77-4ad0-b4ad-cea1b9923f82 req-ee309070-bd9f-460f-94d9-8f2911b39dbb service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:09.574705 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-d6163356-0f77-4ad0-b4ad-cea1b9923f82 req-ee309070-bd9f-460f-94d9-8f2911b39dbb service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:09.587306 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-d6163356-0f77-4ad0-b4ad-cea1b9923f82 req-ee309070-bd9f-460f-94d9-8f2911b39dbb service nova] Creating event network-vif-plugged:b71571a2-9eae-43a2-9932-7383aafff2d1 for instance 2b57ed72-0e3a-43c8-b552-875524942849 on n-h2-861333-8 Oct 19 03:53:09.608461 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [req-d6163356-0f77-4ad0-b4ad-cea1b9923f82 req-ee309070-bd9f-460f-94d9-8f2911b39dbb service nova] Instance 2b57ed72-0e3a-43c8-b552-875524942849 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-861333-8', 'n-h1-861333-8'} {{(pid=121135) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 03:53:09.622212 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-d6163356-0f77-4ad0-b4ad-cea1b9923f82 req-ee309070-bd9f-460f-94d9-8f2911b39dbb service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064911 Oct 19 03:53:09.623365 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3241/6417] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:53:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:53:09.989334 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6e9ab5af-9bd7-48a6-b432-459792adc2b6 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:53:09.993154 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6e9ab5af-9bd7-48a6-b432-459792adc2b6 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: 2b57ed72-0e3a-43c8-b552-875524942849] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:53:10.009209 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6e9ab5af-9bd7-48a6-b432-459792adc2b6 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:10.010697 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6e9ab5af-9bd7-48a6-b432-459792adc2b6 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:10.011381 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6e9ab5af-9bd7-48a6-b432-459792adc2b6 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:10.012170 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6e9ab5af-9bd7-48a6-b432-459792adc2b6 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:10.012666 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6e9ab5af-9bd7-48a6-b432-459792adc2b6 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:10.013105 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6e9ab5af-9bd7-48a6-b432-459792adc2b6 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:10.142568 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d9e94723-88d3-4fdd-82ba-9e6d68020820 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:53:10.149785 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d9e94723-88d3-4fdd-82ba-9e6d68020820 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] [instance: 8b8ec387-c84b-4c5b-8d3b-d2e31fb3fa26] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:53:10.149967 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d9e94723-88d3-4fdd-82ba-9e6d68020820 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:10.150675 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d9e94723-88d3-4fdd-82ba-9e6d68020820 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:10.151415 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d9e94723-88d3-4fdd-82ba-9e6d68020820 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:10.153581 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d9e94723-88d3-4fdd-82ba-9e6d68020820 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:10.154211 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d9e94723-88d3-4fdd-82ba-9e6d68020820 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:10.155173 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d9e94723-88d3-4fdd-82ba-9e6d68020820 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:10.190527 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-6e9ab5af-9bd7-48a6-b432-459792adc2b6 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:53:10.208550 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6e9ab5af-9bd7-48a6-b432-459792adc2b6 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849" status: 200 len: 1685 microversion: 2.1 time: 0.224131 Oct 19 03:53:10.209146 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3177/6418] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:53:09 2022] GET /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849 => generated 1685 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:53:10.226423 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d9e94723-88d3-4fdd-82ba-9e6d68020820 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d8ec7142c79407b81108e90ce3657d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f4f31b5836f40e580c28153626ec6ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:53:10.237659 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d9e94723-88d3-4fdd-82ba-9e6d68020820 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] 10.222.0.52 "GET /compute/v2.1/servers/8b8ec387-c84b-4c5b-8d3b-d2e31fb3fa26" status: 200 len: 1298 microversion: 2.1 time: 0.100251 Oct 19 03:53:10.238844 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3242/6419] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:53:10 2022] GET /compute/v2.1/servers/8b8ec387-c84b-4c5b-8d3b-d2e31fb3fa26 => generated 1298 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:53:10.303248 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1fcddfdd-0396-464d-ae7d-4b0e260b8384 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:53:10.303881 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1fcddfdd-0396-464d-ae7d-4b0e260b8384 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] [instance: 70a4ad35-460a-46e6-8819-f73fb43cecaf] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:53:10.410047 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-1fcddfdd-0396-464d-ae7d-4b0e260b8384 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518702207efb468a9dea88ad8ce1d557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ea53cc200c4428afb03a512f41bee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:53:10.411990 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1fcddfdd-0396-464d-ae7d-4b0e260b8384 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] 10.222.0.52 "GET /compute/v2.1/servers/70a4ad35-460a-46e6-8819-f73fb43cecaf" status: 200 len: 1215 microversion: 2.1 time: 0.117128 Oct 19 03:53:10.412598 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3178/6420] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:53:10 2022] GET /compute/v2.1/servers/70a4ad35-460a-46e6-8819-f73fb43cecaf => generated 1215 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:53:11.232945 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a421c435-754d-41ab-9608-743b0210efc8 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:53:11.233603 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a421c435-754d-41ab-9608-743b0210efc8 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: 2b57ed72-0e3a-43c8-b552-875524942849] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:53:11.239488 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=5,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:53:11.244681 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a421c435-754d-41ab-9608-743b0210efc8 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:11.245799 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a421c435-754d-41ab-9608-743b0210efc8 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:11.246561 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a421c435-754d-41ab-9608-743b0210efc8 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:11.247734 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a421c435-754d-41ab-9608-743b0210efc8 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:11.248382 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a421c435-754d-41ab-9608-743b0210efc8 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:11.250230 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a421c435-754d-41ab-9608-743b0210efc8 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:11.264535 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-906a99e4-429d-44d6-9030-4edd116b25d9 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:53:11.265797 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-906a99e4-429d-44d6-9030-4edd116b25d9 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] [instance: 8b8ec387-c84b-4c5b-8d3b-d2e31fb3fa26] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:53:11.282894 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-906a99e4-429d-44d6-9030-4edd116b25d9 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:11.283826 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-906a99e4-429d-44d6-9030-4edd116b25d9 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:11.291418 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-906a99e4-429d-44d6-9030-4edd116b25d9 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:11.291418 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-906a99e4-429d-44d6-9030-4edd116b25d9 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:11.291418 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-906a99e4-429d-44d6-9030-4edd116b25d9 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:11.291418 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-906a99e4-429d-44d6-9030-4edd116b25d9 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:11.433000 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-906a99e4-429d-44d6-9030-4edd116b25d9 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d8ec7142c79407b81108e90ce3657d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f4f31b5836f40e580c28153626ec6ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:53:11.445895 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-906a99e4-429d-44d6-9030-4edd116b25d9 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] 10.222.0.52 "GET /compute/v2.1/servers/8b8ec387-c84b-4c5b-8d3b-d2e31fb3fa26" status: 200 len: 1298 microversion: 2.1 time: 0.186078 Oct 19 03:53:11.447883 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3179/6421] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:53:11 2022] GET /compute/v2.1/servers/8b8ec387-c84b-4c5b-8d3b-d2e31fb3fa26 => generated 1298 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:53:11.465822 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ea3d4e77-612f-47d1-955e-9bef23b98d52 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:53:11.468232 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ea3d4e77-612f-47d1-955e-9bef23b98d52 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] [instance: 70a4ad35-460a-46e6-8819-f73fb43cecaf] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:53:11.478298 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ea3d4e77-612f-47d1-955e-9bef23b98d52 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:11.479609 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ea3d4e77-612f-47d1-955e-9bef23b98d52 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:11.480206 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ea3d4e77-612f-47d1-955e-9bef23b98d52 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:11.480546 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a421c435-754d-41ab-9608-743b0210efc8 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:53:11.482182 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ea3d4e77-612f-47d1-955e-9bef23b98d52 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:11.482905 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ea3d4e77-612f-47d1-955e-9bef23b98d52 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:11.483729 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ea3d4e77-612f-47d1-955e-9bef23b98d52 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:11.494297 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a421c435-754d-41ab-9608-743b0210efc8 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849" status: 200 len: 1685 microversion: 2.1 time: 0.265925 Oct 19 03:53:11.494885 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3243/6422] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:53:11 2022] GET /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849 => generated 1685 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:53:11.555542 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ea3d4e77-612f-47d1-955e-9bef23b98d52 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518702207efb468a9dea88ad8ce1d557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ea53cc200c4428afb03a512f41bee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:53:11.564347 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ea3d4e77-612f-47d1-955e-9bef23b98d52 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] 10.222.0.52 "GET /compute/v2.1/servers/70a4ad35-460a-46e6-8819-f73fb43cecaf" status: 200 len: 1211 microversion: 2.1 time: 0.113031 Oct 19 03:53:11.565789 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3180/6423] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:53:11 2022] GET /compute/v2.1/servers/70a4ad35-460a-46e6-8819-f73fb43cecaf => generated 1211 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:53:11.651238 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-6b769b53-3d84-4fb7-a2aa-1e3fb88dcc50 req-dd628aee-7761-4064-ae7b-b9ffd43a7d3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b8ec387-c84b-4c5b-8d3b-d2e31fb3fa26", "tag": "8eb38ab3-bc83-4809-946d-37639141c03b"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:53:11.662407 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-6b769b53-3d84-4fb7-a2aa-1e3fb88dcc50 req-dd628aee-7761-4064-ae7b-b9ffd43a7d3b service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:11.662898 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-6b769b53-3d84-4fb7-a2aa-1e3fb88dcc50 req-dd628aee-7761-4064-ae7b-b9ffd43a7d3b service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:11.663329 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-6b769b53-3d84-4fb7-a2aa-1e3fb88dcc50 req-dd628aee-7761-4064-ae7b-b9ffd43a7d3b service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:11.674808 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-6b769b53-3d84-4fb7-a2aa-1e3fb88dcc50 req-dd628aee-7761-4064-ae7b-b9ffd43a7d3b service nova] Creating event network-changed:8eb38ab3-bc83-4809-946d-37639141c03b for instance 8b8ec387-c84b-4c5b-8d3b-d2e31fb3fa26 on n-h1-861333-8 Oct 19 03:53:11.680431 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-6b769b53-3d84-4fb7-a2aa-1e3fb88dcc50 req-dd628aee-7761-4064-ae7b-b9ffd43a7d3b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033614 Oct 19 03:53:11.683656 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3244/6424] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:53:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:53:12.469320 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-20afb199-bc16-4d8e-9051-24dfd75d3425 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:53:12.470050 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-20afb199-bc16-4d8e-9051-24dfd75d3425 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] [instance: 8b8ec387-c84b-4c5b-8d3b-d2e31fb3fa26] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:53:12.479682 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-20afb199-bc16-4d8e-9051-24dfd75d3425 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:12.480180 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-20afb199-bc16-4d8e-9051-24dfd75d3425 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:12.480636 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-20afb199-bc16-4d8e-9051-24dfd75d3425 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:12.481391 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-20afb199-bc16-4d8e-9051-24dfd75d3425 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:12.481874 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-20afb199-bc16-4d8e-9051-24dfd75d3425 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:12.482292 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-20afb199-bc16-4d8e-9051-24dfd75d3425 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:12.524631 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e2cc715f-c18c-404c-aace-a79a4089ae83 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:53:12.526027 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e2cc715f-c18c-404c-aace-a79a4089ae83 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: 2b57ed72-0e3a-43c8-b552-875524942849] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:53:12.534198 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e2cc715f-c18c-404c-aace-a79a4089ae83 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:12.534936 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e2cc715f-c18c-404c-aace-a79a4089ae83 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:12.535945 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e2cc715f-c18c-404c-aace-a79a4089ae83 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:12.536969 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e2cc715f-c18c-404c-aace-a79a4089ae83 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:12.537529 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e2cc715f-c18c-404c-aace-a79a4089ae83 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:12.538209 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e2cc715f-c18c-404c-aace-a79a4089ae83 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:12.586111 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-20afb199-bc16-4d8e-9051-24dfd75d3425 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d8ec7142c79407b81108e90ce3657d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f4f31b5836f40e580c28153626ec6ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:53:12.594091 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-20afb199-bc16-4d8e-9051-24dfd75d3425 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] 10.222.0.52 "GET /compute/v2.1/servers/8b8ec387-c84b-4c5b-8d3b-d2e31fb3fa26" status: 200 len: 1298 microversion: 2.1 time: 0.128504 Oct 19 03:53:12.601527 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3181/6425] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:53:12 2022] GET /compute/v2.1/servers/8b8ec387-c84b-4c5b-8d3b-d2e31fb3fa26 => generated 1298 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:53:12.601527 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a657405e-b961-4feb-a467-d43a479afac8 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:53:12.601527 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a657405e-b961-4feb-a467-d43a479afac8 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] [instance: 70a4ad35-460a-46e6-8819-f73fb43cecaf] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:53:12.605804 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a657405e-b961-4feb-a467-d43a479afac8 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:12.606306 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a657405e-b961-4feb-a467-d43a479afac8 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:12.606756 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a657405e-b961-4feb-a467-d43a479afac8 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:12.607626 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a657405e-b961-4feb-a467-d43a479afac8 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:12.608270 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a657405e-b961-4feb-a467-d43a479afac8 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:12.608709 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a657405e-b961-4feb-a467-d43a479afac8 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:12.687702 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a657405e-b961-4feb-a467-d43a479afac8 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518702207efb468a9dea88ad8ce1d557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ea53cc200c4428afb03a512f41bee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:53:12.695983 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a657405e-b961-4feb-a467-d43a479afac8 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] 10.222.0.52 "GET /compute/v2.1/servers/70a4ad35-460a-46e6-8819-f73fb43cecaf" status: 200 len: 1267 microversion: 2.1 time: 0.100301 Oct 19 03:53:12.709423 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3182/6426] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:53:12 2022] GET /compute/v2.1/servers/70a4ad35-460a-46e6-8819-f73fb43cecaf => generated 1267 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:53:12.719281 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-e2cc715f-c18c-404c-aace-a79a4089ae83 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:53:12.728383 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e2cc715f-c18c-404c-aace-a79a4089ae83 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849" status: 200 len: 1685 microversion: 2.1 time: 0.207911 Oct 19 03:53:12.729123 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3245/6427] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:53:12 2022] GET /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849 => generated 1685 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:53:13.617927 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-25de49e6-fef0-4b9f-a355-f6e3c1c05e68 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:53:13.618400 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-25de49e6-fef0-4b9f-a355-f6e3c1c05e68 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] [instance: 8b8ec387-c84b-4c5b-8d3b-d2e31fb3fa26] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:53:13.625520 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-25de49e6-fef0-4b9f-a355-f6e3c1c05e68 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:13.626369 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-25de49e6-fef0-4b9f-a355-f6e3c1c05e68 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:13.626539 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-25de49e6-fef0-4b9f-a355-f6e3c1c05e68 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:13.627150 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-25de49e6-fef0-4b9f-a355-f6e3c1c05e68 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:13.627609 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-25de49e6-fef0-4b9f-a355-f6e3c1c05e68 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:13.628038 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-25de49e6-fef0-4b9f-a355-f6e3c1c05e68 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:13.720500 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5f44ccc1-9be0-4387-90b2-0ad085a07214 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:53:13.721132 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-5f44ccc1-9be0-4387-90b2-0ad085a07214 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] [instance: 70a4ad35-460a-46e6-8819-f73fb43cecaf] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:53:13.732748 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5f44ccc1-9be0-4387-90b2-0ad085a07214 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:13.733259 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5f44ccc1-9be0-4387-90b2-0ad085a07214 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:13.733730 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5f44ccc1-9be0-4387-90b2-0ad085a07214 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:13.734480 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5f44ccc1-9be0-4387-90b2-0ad085a07214 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:13.734997 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5f44ccc1-9be0-4387-90b2-0ad085a07214 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:13.735436 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5f44ccc1-9be0-4387-90b2-0ad085a07214 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:13.753908 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-25de49e6-fef0-4b9f-a355-f6e3c1c05e68 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d8ec7142c79407b81108e90ce3657d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f4f31b5836f40e580c28153626ec6ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:53:13.762773 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-25de49e6-fef0-4b9f-a355-f6e3c1c05e68 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] 10.222.0.52 "GET /compute/v2.1/servers/8b8ec387-c84b-4c5b-8d3b-d2e31fb3fa26" status: 200 len: 1298 microversion: 2.1 time: 0.148984 Oct 19 03:53:13.777780 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3183/6428] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:53:13 2022] GET /compute/v2.1/servers/8b8ec387-c84b-4c5b-8d3b-d2e31fb3fa26 => generated 1298 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:53:13.782789 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-70dc83ea-6da1-4c2f-8851-cb0043b35fbd tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:53:13.783343 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-70dc83ea-6da1-4c2f-8851-cb0043b35fbd tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: 2b57ed72-0e3a-43c8-b552-875524942849] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:53:13.791655 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-70dc83ea-6da1-4c2f-8851-cb0043b35fbd tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:13.792371 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-70dc83ea-6da1-4c2f-8851-cb0043b35fbd tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:13.792817 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-70dc83ea-6da1-4c2f-8851-cb0043b35fbd tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:13.793560 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-70dc83ea-6da1-4c2f-8851-cb0043b35fbd tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:13.794017 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-70dc83ea-6da1-4c2f-8851-cb0043b35fbd tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:13.794446 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-70dc83ea-6da1-4c2f-8851-cb0043b35fbd tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:13.958774 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-5f44ccc1-9be0-4387-90b2-0ad085a07214 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518702207efb468a9dea88ad8ce1d557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ea53cc200c4428afb03a512f41bee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:53:13.966689 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5f44ccc1-9be0-4387-90b2-0ad085a07214 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] 10.222.0.52 "GET /compute/v2.1/servers/70a4ad35-460a-46e6-8819-f73fb43cecaf" status: 200 len: 1315 microversion: 2.1 time: 0.250229 Oct 19 03:53:13.967290 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3246/6429] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:53:13 2022] GET /compute/v2.1/servers/70a4ad35-460a-46e6-8819-f73fb43cecaf => generated 1315 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:53:14.020266 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-70dc83ea-6da1-4c2f-8851-cb0043b35fbd tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:53:14.028083 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-70dc83ea-6da1-4c2f-8851-cb0043b35fbd tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849" status: 200 len: 1685 microversion: 2.1 time: 0.249122 Oct 19 03:53:14.028757 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3184/6430] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:53:13 2022] GET /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849 => generated 1685 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:53:14.772089 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-72ac2768-8771-41f9-bf63-fda6f1a4795e req-3eb81ca4-8dec-437c-960b-c1e155015598 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70a4ad35-460a-46e6-8819-f73fb43cecaf", "tag": "9c018691-b8d6-4230-874b-28c5f931ce00"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:53:14.783594 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-72ac2768-8771-41f9-bf63-fda6f1a4795e req-3eb81ca4-8dec-437c-960b-c1e155015598 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:14.784361 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-72ac2768-8771-41f9-bf63-fda6f1a4795e req-3eb81ca4-8dec-437c-960b-c1e155015598 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:14.786603 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-72ac2768-8771-41f9-bf63-fda6f1a4795e req-3eb81ca4-8dec-437c-960b-c1e155015598 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:14.792334 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-89043046-b7f6-4a90-831e-ba08d21e502c tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:53:14.793030 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-89043046-b7f6-4a90-831e-ba08d21e502c tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] [instance: 8b8ec387-c84b-4c5b-8d3b-d2e31fb3fa26] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:53:14.801710 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-89043046-b7f6-4a90-831e-ba08d21e502c tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:14.802406 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-89043046-b7f6-4a90-831e-ba08d21e502c tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:14.802830 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-89043046-b7f6-4a90-831e-ba08d21e502c tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:14.803713 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-89043046-b7f6-4a90-831e-ba08d21e502c tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:14.804164 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-89043046-b7f6-4a90-831e-ba08d21e502c tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:14.804588 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-89043046-b7f6-4a90-831e-ba08d21e502c tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:14.805340 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-72ac2768-8771-41f9-bf63-fda6f1a4795e req-3eb81ca4-8dec-437c-960b-c1e155015598 service nova] Creating event network-changed:9c018691-b8d6-4230-874b-28c5f931ce00 for instance 70a4ad35-460a-46e6-8819-f73fb43cecaf on n-h2-861333-8 Oct 19 03:53:14.810680 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-72ac2768-8771-41f9-bf63-fda6f1a4795e req-3eb81ca4-8dec-437c-960b-c1e155015598 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042244 Oct 19 03:53:14.814786 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3247/6431] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:53:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:53:14.926670 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-89043046-b7f6-4a90-831e-ba08d21e502c tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d8ec7142c79407b81108e90ce3657d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f4f31b5836f40e580c28153626ec6ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:53:14.936778 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-89043046-b7f6-4a90-831e-ba08d21e502c tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] 10.222.0.52 "GET /compute/v2.1/servers/8b8ec387-c84b-4c5b-8d3b-d2e31fb3fa26" status: 200 len: 1298 microversion: 2.1 time: 0.148357 Oct 19 03:53:14.937974 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3185/6432] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:53:14 2022] GET /compute/v2.1/servers/8b8ec387-c84b-4c5b-8d3b-d2e31fb3fa26 => generated 1298 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:53:14.991847 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2a3ace9f-6b12-4114-a6f5-8fc13082bfe5 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:53:14.992563 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-2a3ace9f-6b12-4114-a6f5-8fc13082bfe5 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] [instance: 70a4ad35-460a-46e6-8819-f73fb43cecaf] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:53:14.998822 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2a3ace9f-6b12-4114-a6f5-8fc13082bfe5 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:14.999311 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2a3ace9f-6b12-4114-a6f5-8fc13082bfe5 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:14.999909 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2a3ace9f-6b12-4114-a6f5-8fc13082bfe5 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:15.000617 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2a3ace9f-6b12-4114-a6f5-8fc13082bfe5 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:15.001075 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2a3ace9f-6b12-4114-a6f5-8fc13082bfe5 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:15.001540 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2a3ace9f-6b12-4114-a6f5-8fc13082bfe5 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:15.052979 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3573e59a-7428-4b46-9a6d-6f0c1f47db44 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:53:15.053905 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3573e59a-7428-4b46-9a6d-6f0c1f47db44 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: 2b57ed72-0e3a-43c8-b552-875524942849] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:53:15.060339 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3573e59a-7428-4b46-9a6d-6f0c1f47db44 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:15.060959 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3573e59a-7428-4b46-9a6d-6f0c1f47db44 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:15.061515 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3573e59a-7428-4b46-9a6d-6f0c1f47db44 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:15.062333 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3573e59a-7428-4b46-9a6d-6f0c1f47db44 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:15.062901 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3573e59a-7428-4b46-9a6d-6f0c1f47db44 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:15.063416 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3573e59a-7428-4b46-9a6d-6f0c1f47db44 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:15.309653 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-2a3ace9f-6b12-4114-a6f5-8fc13082bfe5 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518702207efb468a9dea88ad8ce1d557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ea53cc200c4428afb03a512f41bee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:53:15.319731 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2a3ace9f-6b12-4114-a6f5-8fc13082bfe5 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] 10.222.0.52 "GET /compute/v2.1/servers/70a4ad35-460a-46e6-8819-f73fb43cecaf" status: 200 len: 1315 microversion: 2.1 time: 0.332311 Oct 19 03:53:15.320329 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3248/6433] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:53:14 2022] GET /compute/v2.1/servers/70a4ad35-460a-46e6-8819-f73fb43cecaf => generated 1315 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:53:15.325290 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-6cd17061-0fd7-46e3-b163-b0188534f7bf req-43c4338b-96a5-491e-b6cc-e9d6ede29567 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b57ed72-0e3a-43c8-b552-875524942849", "name": "network-vif-unplugged", "status": "completed", "tag": "b71571a2-9eae-43a2-9932-7383aafff2d1"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:53:15.329335 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-3573e59a-7428-4b46-9a6d-6f0c1f47db44 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:53:15.340288 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-6cd17061-0fd7-46e3-b163-b0188534f7bf req-43c4338b-96a5-491e-b6cc-e9d6ede29567 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:15.341922 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-6cd17061-0fd7-46e3-b163-b0188534f7bf req-43c4338b-96a5-491e-b6cc-e9d6ede29567 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:15.342559 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-6cd17061-0fd7-46e3-b163-b0188534f7bf req-43c4338b-96a5-491e-b6cc-e9d6ede29567 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:15.342711 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3573e59a-7428-4b46-9a6d-6f0c1f47db44 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849" status: 200 len: 1685 microversion: 2.1 time: 0.295348 Oct 19 03:53:15.346881 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3186/6434] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:53:15 2022] GET /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849 => generated 1685 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:53:15.384439 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-6cd17061-0fd7-46e3-b163-b0188534f7bf req-43c4338b-96a5-491e-b6cc-e9d6ede29567 service nova] Creating event network-vif-unplugged:b71571a2-9eae-43a2-9932-7383aafff2d1 for instance 2b57ed72-0e3a-43c8-b552-875524942849 on n-h1-861333-8 Oct 19 03:53:15.395321 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [req-6cd17061-0fd7-46e3-b163-b0188534f7bf req-43c4338b-96a5-491e-b6cc-e9d6ede29567 service nova] Instance 2b57ed72-0e3a-43c8-b552-875524942849 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-861333-8', 'n-h1-861333-8'} {{(pid=121135) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 03:53:15.407880 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-6cd17061-0fd7-46e3-b163-b0188534f7bf req-43c4338b-96a5-491e-b6cc-e9d6ede29567 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.086008 Oct 19 03:53:15.408740 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3249/6435] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:53:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:53:15.959969 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d93f1707-5e96-4ebb-a568-374ebdf1d540 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:53:15.960552 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d93f1707-5e96-4ebb-a568-374ebdf1d540 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] [instance: 8b8ec387-c84b-4c5b-8d3b-d2e31fb3fa26] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:53:15.967063 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d93f1707-5e96-4ebb-a568-374ebdf1d540 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:15.967558 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d93f1707-5e96-4ebb-a568-374ebdf1d540 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:15.968219 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d93f1707-5e96-4ebb-a568-374ebdf1d540 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:15.968940 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d93f1707-5e96-4ebb-a568-374ebdf1d540 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:15.969424 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d93f1707-5e96-4ebb-a568-374ebdf1d540 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:15.969873 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d93f1707-5e96-4ebb-a568-374ebdf1d540 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:16.056756 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d93f1707-5e96-4ebb-a568-374ebdf1d540 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d8ec7142c79407b81108e90ce3657d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f4f31b5836f40e580c28153626ec6ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:53:16.068306 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d93f1707-5e96-4ebb-a568-374ebdf1d540 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] 10.222.0.52 "GET /compute/v2.1/servers/8b8ec387-c84b-4c5b-8d3b-d2e31fb3fa26" status: 200 len: 1298 microversion: 2.1 time: 0.108745 Oct 19 03:53:16.068306 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3187/6436] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:53:15 2022] GET /compute/v2.1/servers/8b8ec387-c84b-4c5b-8d3b-d2e31fb3fa26 => generated 1298 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:53:16.344625 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b0fc9cb7-1236-4251-b6a7-8fcc8870da0f tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:53:16.345495 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b0fc9cb7-1236-4251-b6a7-8fcc8870da0f tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] [instance: 70a4ad35-460a-46e6-8819-f73fb43cecaf] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:53:16.352242 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b0fc9cb7-1236-4251-b6a7-8fcc8870da0f tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:16.352729 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b0fc9cb7-1236-4251-b6a7-8fcc8870da0f tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:16.353171 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b0fc9cb7-1236-4251-b6a7-8fcc8870da0f tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:16.353893 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b0fc9cb7-1236-4251-b6a7-8fcc8870da0f tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:16.354351 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b0fc9cb7-1236-4251-b6a7-8fcc8870da0f tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:16.354780 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b0fc9cb7-1236-4251-b6a7-8fcc8870da0f tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:16.369337 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6445ce89-6fa5-4f7c-bfc4-bf9a3a73549a tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:53:16.370165 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6445ce89-6fa5-4f7c-bfc4-bf9a3a73549a tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: 2b57ed72-0e3a-43c8-b552-875524942849] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:53:16.376267 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6445ce89-6fa5-4f7c-bfc4-bf9a3a73549a tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:16.376753 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6445ce89-6fa5-4f7c-bfc4-bf9a3a73549a tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:16.377197 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6445ce89-6fa5-4f7c-bfc4-bf9a3a73549a tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:16.377929 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6445ce89-6fa5-4f7c-bfc4-bf9a3a73549a tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:16.378388 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6445ce89-6fa5-4f7c-bfc4-bf9a3a73549a tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:16.378825 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6445ce89-6fa5-4f7c-bfc4-bf9a3a73549a tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:16.550074 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b0fc9cb7-1236-4251-b6a7-8fcc8870da0f tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518702207efb468a9dea88ad8ce1d557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ea53cc200c4428afb03a512f41bee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:53:16.558102 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b0fc9cb7-1236-4251-b6a7-8fcc8870da0f tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] 10.222.0.52 "GET /compute/v2.1/servers/70a4ad35-460a-46e6-8819-f73fb43cecaf" status: 200 len: 1315 microversion: 2.1 time: 0.218563 Oct 19 03:53:16.558710 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3250/6437] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:53:16 2022] GET /compute/v2.1/servers/70a4ad35-460a-46e6-8819-f73fb43cecaf => generated 1315 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:53:16.562457 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-6445ce89-6fa5-4f7c-bfc4-bf9a3a73549a tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:53:16.570322 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6445ce89-6fa5-4f7c-bfc4-bf9a3a73549a tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849" status: 200 len: 1685 microversion: 2.1 time: 0.205497 Oct 19 03:53:16.570896 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3188/6438] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:53:16 2022] GET /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849 => generated 1685 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:53:17.088972 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b81063b7-da32-4772-bd32-e6bb203e047d tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:53:17.089613 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b81063b7-da32-4772-bd32-e6bb203e047d tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] [instance: 8b8ec387-c84b-4c5b-8d3b-d2e31fb3fa26] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:53:17.095930 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b81063b7-da32-4772-bd32-e6bb203e047d tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:17.096425 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b81063b7-da32-4772-bd32-e6bb203e047d tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:17.096877 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b81063b7-da32-4772-bd32-e6bb203e047d tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:17.097689 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b81063b7-da32-4772-bd32-e6bb203e047d tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:17.098155 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b81063b7-da32-4772-bd32-e6bb203e047d tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:17.098583 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b81063b7-da32-4772-bd32-e6bb203e047d tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:17.181265 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b81063b7-da32-4772-bd32-e6bb203e047d tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d8ec7142c79407b81108e90ce3657d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f4f31b5836f40e580c28153626ec6ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:53:17.189222 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b81063b7-da32-4772-bd32-e6bb203e047d tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] 10.222.0.52 "GET /compute/v2.1/servers/8b8ec387-c84b-4c5b-8d3b-d2e31fb3fa26" status: 200 len: 1298 microversion: 2.1 time: 0.104200 Oct 19 03:53:17.189835 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3251/6439] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:53:17 2022] GET /compute/v2.1/servers/8b8ec387-c84b-4c5b-8d3b-d2e31fb3fa26 => generated 1298 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:53:17.443290 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-59ac45c8-8b6d-4642-930e-1a9f4e8a5375 req-98460f0e-109e-40c0-80fa-cbebbc00d001 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b57ed72-0e3a-43c8-b552-875524942849", "tag": "b71571a2-9eae-43a2-9932-7383aafff2d1"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:53:17.449273 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:53:17.454605 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-59ac45c8-8b6d-4642-930e-1a9f4e8a5375 req-98460f0e-109e-40c0-80fa-cbebbc00d001 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:17.455082 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-59ac45c8-8b6d-4642-930e-1a9f4e8a5375 req-98460f0e-109e-40c0-80fa-cbebbc00d001 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:17.455516 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-59ac45c8-8b6d-4642-930e-1a9f4e8a5375 req-98460f0e-109e-40c0-80fa-cbebbc00d001 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:17.468165 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-59ac45c8-8b6d-4642-930e-1a9f4e8a5375 req-98460f0e-109e-40c0-80fa-cbebbc00d001 service nova] Creating event network-changed:b71571a2-9eae-43a2-9932-7383aafff2d1 for instance 2b57ed72-0e3a-43c8-b552-875524942849 on n-h1-861333-8 Oct 19 03:53:17.474333 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [req-59ac45c8-8b6d-4642-930e-1a9f4e8a5375 req-98460f0e-109e-40c0-80fa-cbebbc00d001 service nova] Instance 2b57ed72-0e3a-43c8-b552-875524942849 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-861333-8', 'n-h1-861333-8'} {{(pid=121134) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 03:53:17.484972 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-59ac45c8-8b6d-4642-930e-1a9f4e8a5375 req-98460f0e-109e-40c0-80fa-cbebbc00d001 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045368 Oct 19 03:53:17.485621 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3189/6440] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:53:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:53:17.581290 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2851f600-8c65-44fd-b0de-578e95bb1b1e tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:53:17.582049 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-2851f600-8c65-44fd-b0de-578e95bb1b1e tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] [instance: 70a4ad35-460a-46e6-8819-f73fb43cecaf] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:53:17.589466 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2851f600-8c65-44fd-b0de-578e95bb1b1e tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:17.589966 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2851f600-8c65-44fd-b0de-578e95bb1b1e tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:17.590414 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2851f600-8c65-44fd-b0de-578e95bb1b1e tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:17.591125 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2851f600-8c65-44fd-b0de-578e95bb1b1e tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:17.591585 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2851f600-8c65-44fd-b0de-578e95bb1b1e tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:17.592018 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2851f600-8c65-44fd-b0de-578e95bb1b1e tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:17.594542 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ac4cdcd6-f2e9-4ea1-ac7c-e6a4916ad22b tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:53:17.595368 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ac4cdcd6-f2e9-4ea1-ac7c-e6a4916ad22b tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: 2b57ed72-0e3a-43c8-b552-875524942849] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:53:17.602008 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ac4cdcd6-f2e9-4ea1-ac7c-e6a4916ad22b tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:17.602499 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ac4cdcd6-f2e9-4ea1-ac7c-e6a4916ad22b tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:17.602941 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ac4cdcd6-f2e9-4ea1-ac7c-e6a4916ad22b tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:17.603628 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ac4cdcd6-f2e9-4ea1-ac7c-e6a4916ad22b tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:17.604078 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ac4cdcd6-f2e9-4ea1-ac7c-e6a4916ad22b tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:17.604503 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ac4cdcd6-f2e9-4ea1-ac7c-e6a4916ad22b tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:17.861685 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-2851f600-8c65-44fd-b0de-578e95bb1b1e tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518702207efb468a9dea88ad8ce1d557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ea53cc200c4428afb03a512f41bee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:53:17.869611 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2851f600-8c65-44fd-b0de-578e95bb1b1e tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] 10.222.0.52 "GET /compute/v2.1/servers/70a4ad35-460a-46e6-8819-f73fb43cecaf" status: 200 len: 1315 microversion: 2.1 time: 0.292070 Oct 19 03:53:17.870200 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3252/6441] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:53:17 2022] GET /compute/v2.1/servers/70a4ad35-460a-46e6-8819-f73fb43cecaf => generated 1315 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:53:17.905155 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ac4cdcd6-f2e9-4ea1-ac7c-e6a4916ad22b tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:53:17.914045 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ac4cdcd6-f2e9-4ea1-ac7c-e6a4916ad22b tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849" status: 200 len: 1685 microversion: 2.1 time: 0.324047 Oct 19 03:53:17.914681 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3190/6442] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:53:17 2022] GET /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849 => generated 1685 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:53:18.212041 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f42836c6-9a67-4be5-bac4-9361cf162764 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:53:18.212663 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f42836c6-9a67-4be5-bac4-9361cf162764 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] [instance: 8b8ec387-c84b-4c5b-8d3b-d2e31fb3fa26] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:53:18.218746 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f42836c6-9a67-4be5-bac4-9361cf162764 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:18.219223 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f42836c6-9a67-4be5-bac4-9361cf162764 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:18.219659 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f42836c6-9a67-4be5-bac4-9361cf162764 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:18.220349 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f42836c6-9a67-4be5-bac4-9361cf162764 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:18.220809 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f42836c6-9a67-4be5-bac4-9361cf162764 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:18.221236 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f42836c6-9a67-4be5-bac4-9361cf162764 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:18.302216 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f42836c6-9a67-4be5-bac4-9361cf162764 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d8ec7142c79407b81108e90ce3657d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f4f31b5836f40e580c28153626ec6ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:53:18.309991 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f42836c6-9a67-4be5-bac4-9361cf162764 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] 10.222.0.52 "GET /compute/v2.1/servers/8b8ec387-c84b-4c5b-8d3b-d2e31fb3fa26" status: 200 len: 1298 microversion: 2.1 time: 0.101864 Oct 19 03:53:18.310567 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3253/6443] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:53:18 2022] GET /compute/v2.1/servers/8b8ec387-c84b-4c5b-8d3b-d2e31fb3fa26 => generated 1298 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:53:18.893593 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a79f7196-ba58-4bc7-bf86-17b1d0e85fba tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:53:18.894326 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a79f7196-ba58-4bc7-bf86-17b1d0e85fba tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] [instance: 70a4ad35-460a-46e6-8819-f73fb43cecaf] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:53:18.903504 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a79f7196-ba58-4bc7-bf86-17b1d0e85fba tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:18.903988 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a79f7196-ba58-4bc7-bf86-17b1d0e85fba tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:18.904426 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a79f7196-ba58-4bc7-bf86-17b1d0e85fba tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:18.905142 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a79f7196-ba58-4bc7-bf86-17b1d0e85fba tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:18.905616 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a79f7196-ba58-4bc7-bf86-17b1d0e85fba tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:18.906022 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a79f7196-ba58-4bc7-bf86-17b1d0e85fba tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:18.940039 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d79de17f-a8eb-4314-bf7e-584090813aa8 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:53:18.940836 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d79de17f-a8eb-4314-bf7e-584090813aa8 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: 2b57ed72-0e3a-43c8-b552-875524942849] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:53:18.944205 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:53:18.949363 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d79de17f-a8eb-4314-bf7e-584090813aa8 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:18.950027 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d79de17f-a8eb-4314-bf7e-584090813aa8 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:18.950584 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d79de17f-a8eb-4314-bf7e-584090813aa8 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:18.951443 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d79de17f-a8eb-4314-bf7e-584090813aa8 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:18.952000 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d79de17f-a8eb-4314-bf7e-584090813aa8 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:18.952618 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d79de17f-a8eb-4314-bf7e-584090813aa8 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:18.969448 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=8 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:53:19.097553 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a79f7196-ba58-4bc7-bf86-17b1d0e85fba tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518702207efb468a9dea88ad8ce1d557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ea53cc200c4428afb03a512f41bee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:53:19.106008 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a79f7196-ba58-4bc7-bf86-17b1d0e85fba tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] 10.222.0.52 "GET /compute/v2.1/servers/70a4ad35-460a-46e6-8819-f73fb43cecaf" status: 200 len: 1315 microversion: 2.1 time: 0.216532 Oct 19 03:53:19.106600 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3191/6444] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:53:18 2022] GET /compute/v2.1/servers/70a4ad35-460a-46e6-8819-f73fb43cecaf => generated 1315 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:53:19.111420 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-45514172-84bb-4994-b2d5-353abb460f3f req-60ac02f3-2c85-476c-a32b-e58048e5a442 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b8ec387-c84b-4c5b-8d3b-d2e31fb3fa26", "name": "network-vif-plugged", "status": "completed", "tag": "8eb38ab3-bc83-4809-946d-37639141c03b"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:53:19.120929 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-45514172-84bb-4994-b2d5-353abb460f3f req-60ac02f3-2c85-476c-a32b-e58048e5a442 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:19.121588 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-45514172-84bb-4994-b2d5-353abb460f3f req-60ac02f3-2c85-476c-a32b-e58048e5a442 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:19.122187 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-45514172-84bb-4994-b2d5-353abb460f3f req-60ac02f3-2c85-476c-a32b-e58048e5a442 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:19.134140 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-45514172-84bb-4994-b2d5-353abb460f3f req-60ac02f3-2c85-476c-a32b-e58048e5a442 service nova] Creating event network-vif-plugged:8eb38ab3-bc83-4809-946d-37639141c03b for instance 8b8ec387-c84b-4c5b-8d3b-d2e31fb3fa26 on n-h1-861333-8 Oct 19 03:53:19.138988 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d79de17f-a8eb-4314-bf7e-584090813aa8 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:53:19.139148 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-45514172-84bb-4994-b2d5-353abb460f3f req-60ac02f3-2c85-476c-a32b-e58048e5a442 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031238 Oct 19 03:53:19.140016 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3192/6445] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:53:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:53:19.148875 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d79de17f-a8eb-4314-bf7e-584090813aa8 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849" status: 200 len: 1685 microversion: 2.1 time: 0.213362 Oct 19 03:53:19.149471 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3254/6446] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:53:18 2022] GET /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849 => generated 1685 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:53:19.334395 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d1126064-41b4-4f82-91ff-4be626e9ddc6 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:53:19.335020 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d1126064-41b4-4f82-91ff-4be626e9ddc6 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] [instance: 8b8ec387-c84b-4c5b-8d3b-d2e31fb3fa26] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:53:19.343193 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d1126064-41b4-4f82-91ff-4be626e9ddc6 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:19.343686 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d1126064-41b4-4f82-91ff-4be626e9ddc6 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:19.344206 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d1126064-41b4-4f82-91ff-4be626e9ddc6 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:19.344829 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d1126064-41b4-4f82-91ff-4be626e9ddc6 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:19.345301 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d1126064-41b4-4f82-91ff-4be626e9ddc6 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:19.345747 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d1126064-41b4-4f82-91ff-4be626e9ddc6 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:19.438911 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d1126064-41b4-4f82-91ff-4be626e9ddc6 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d8ec7142c79407b81108e90ce3657d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f4f31b5836f40e580c28153626ec6ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:53:19.447629 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d1126064-41b4-4f82-91ff-4be626e9ddc6 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] 10.222.0.52 "GET /compute/v2.1/servers/8b8ec387-c84b-4c5b-8d3b-d2e31fb3fa26" status: 200 len: 1298 microversion: 2.1 time: 0.118213 Oct 19 03:53:19.448223 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3193/6447] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:53:19 2022] GET /compute/v2.1/servers/8b8ec387-c84b-4c5b-8d3b-d2e31fb3fa26 => generated 1298 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:53:20.128448 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f9a5e1ff-edfb-4057-9cb2-0949e560d62d tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:53:20.129664 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f9a5e1ff-edfb-4057-9cb2-0949e560d62d tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] [instance: 70a4ad35-460a-46e6-8819-f73fb43cecaf] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:53:20.136633 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f9a5e1ff-edfb-4057-9cb2-0949e560d62d tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:20.137125 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f9a5e1ff-edfb-4057-9cb2-0949e560d62d tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:20.137599 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f9a5e1ff-edfb-4057-9cb2-0949e560d62d tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:20.138304 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f9a5e1ff-edfb-4057-9cb2-0949e560d62d tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:20.138758 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f9a5e1ff-edfb-4057-9cb2-0949e560d62d tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:20.139188 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f9a5e1ff-edfb-4057-9cb2-0949e560d62d tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:20.172065 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f3b8d5d5-037e-487d-a74f-a8080fef51ed tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:53:20.172812 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f3b8d5d5-037e-487d-a74f-a8080fef51ed tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: 2b57ed72-0e3a-43c8-b552-875524942849] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:53:20.181057 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f3b8d5d5-037e-487d-a74f-a8080fef51ed tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:20.181588 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f3b8d5d5-037e-487d-a74f-a8080fef51ed tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:20.182040 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f3b8d5d5-037e-487d-a74f-a8080fef51ed tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:20.182749 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f3b8d5d5-037e-487d-a74f-a8080fef51ed tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:20.183214 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f3b8d5d5-037e-487d-a74f-a8080fef51ed tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:20.183651 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f3b8d5d5-037e-487d-a74f-a8080fef51ed tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:20.199186 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=100 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:53:20.322691 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f9a5e1ff-edfb-4057-9cb2-0949e560d62d tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518702207efb468a9dea88ad8ce1d557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ea53cc200c4428afb03a512f41bee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:53:20.330528 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f9a5e1ff-edfb-4057-9cb2-0949e560d62d tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] 10.222.0.52 "GET /compute/v2.1/servers/70a4ad35-460a-46e6-8819-f73fb43cecaf" status: 200 len: 1315 microversion: 2.1 time: 0.206119 Oct 19 03:53:20.331103 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3255/6448] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:53:20 2022] GET /compute/v2.1/servers/70a4ad35-460a-46e6-8819-f73fb43cecaf => generated 1315 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:53:20.353741 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-f3b8d5d5-037e-487d-a74f-a8080fef51ed tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:53:20.361430 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f3b8d5d5-037e-487d-a74f-a8080fef51ed tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849" status: 200 len: 1685 microversion: 2.1 time: 0.193164 Oct 19 03:53:20.362070 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3194/6449] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:53:20 2022] GET /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849 => generated 1685 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:53:20.471780 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-72234309-395d-41d5-bfe1-10f4a7a86c90 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:53:20.472395 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-72234309-395d-41d5-bfe1-10f4a7a86c90 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] [instance: 8b8ec387-c84b-4c5b-8d3b-d2e31fb3fa26] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:53:20.478461 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-72234309-395d-41d5-bfe1-10f4a7a86c90 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:20.479000 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-72234309-395d-41d5-bfe1-10f4a7a86c90 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:20.479428 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-72234309-395d-41d5-bfe1-10f4a7a86c90 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:20.480142 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-72234309-395d-41d5-bfe1-10f4a7a86c90 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:20.480595 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-72234309-395d-41d5-bfe1-10f4a7a86c90 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:20.481014 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-72234309-395d-41d5-bfe1-10f4a7a86c90 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:20.567314 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-72234309-395d-41d5-bfe1-10f4a7a86c90 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d8ec7142c79407b81108e90ce3657d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f4f31b5836f40e580c28153626ec6ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:53:20.578790 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-72234309-395d-41d5-bfe1-10f4a7a86c90 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] 10.222.0.52 "GET /compute/v2.1/servers/8b8ec387-c84b-4c5b-8d3b-d2e31fb3fa26" status: 200 len: 1298 microversion: 2.1 time: 0.110803 Oct 19 03:53:20.579783 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3256/6450] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:53:20 2022] GET /compute/v2.1/servers/8b8ec387-c84b-4c5b-8d3b-d2e31fb3fa26 => generated 1298 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:53:21.353298 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-bfa05173-6f34-41ba-a839-807a0f4025b8 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:53:21.353958 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-bfa05173-6f34-41ba-a839-807a0f4025b8 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] [instance: 70a4ad35-460a-46e6-8819-f73fb43cecaf] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:53:21.355884 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=10 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:53:21.361623 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bfa05173-6f34-41ba-a839-807a0f4025b8 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:21.362121 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bfa05173-6f34-41ba-a839-807a0f4025b8 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:21.362568 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bfa05173-6f34-41ba-a839-807a0f4025b8 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:21.363319 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bfa05173-6f34-41ba-a839-807a0f4025b8 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:21.363782 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bfa05173-6f34-41ba-a839-807a0f4025b8 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:21.364218 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bfa05173-6f34-41ba-a839-807a0f4025b8 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:21.385307 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d453a864-4026-461e-9770-01fdfbba0a5f tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:53:21.386066 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d453a864-4026-461e-9770-01fdfbba0a5f tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: 2b57ed72-0e3a-43c8-b552-875524942849] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:53:21.394092 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d453a864-4026-461e-9770-01fdfbba0a5f tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:21.400257 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d453a864-4026-461e-9770-01fdfbba0a5f tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:21.400257 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d453a864-4026-461e-9770-01fdfbba0a5f tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:21.400257 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d453a864-4026-461e-9770-01fdfbba0a5f tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:21.400257 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d453a864-4026-461e-9770-01fdfbba0a5f tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:21.400257 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d453a864-4026-461e-9770-01fdfbba0a5f tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:21.576910 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-bfa05173-6f34-41ba-a839-807a0f4025b8 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518702207efb468a9dea88ad8ce1d557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ea53cc200c4428afb03a512f41bee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:53:21.583748 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d453a864-4026-461e-9770-01fdfbba0a5f tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:53:21.586205 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-bfa05173-6f34-41ba-a839-807a0f4025b8 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] 10.222.0.52 "GET /compute/v2.1/servers/70a4ad35-460a-46e6-8819-f73fb43cecaf" status: 200 len: 1315 microversion: 2.1 time: 0.236764 Oct 19 03:53:21.586856 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3195/6451] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:53:21 2022] GET /compute/v2.1/servers/70a4ad35-460a-46e6-8819-f73fb43cecaf => generated 1315 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:53:21.591730 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-a1404af8-65e8-4c12-8527-4f71aa69069c req-d3d69a47-2808-43b2-92ab-ac69d7dbb9ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70a4ad35-460a-46e6-8819-f73fb43cecaf", "name": "network-vif-plugged", "status": "completed", "tag": "9c018691-b8d6-4230-874b-28c5f931ce00"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:53:21.593235 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d453a864-4026-461e-9770-01fdfbba0a5f tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849" status: 200 len: 1678 microversion: 2.1 time: 0.211805 Oct 19 03:53:21.595312 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3257/6452] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:53:21 2022] GET /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849 => generated 1678 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:53:21.602204 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-a1404af8-65e8-4c12-8527-4f71aa69069c req-d3d69a47-2808-43b2-92ab-ac69d7dbb9ff service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:21.602700 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-a1404af8-65e8-4c12-8527-4f71aa69069c req-d3d69a47-2808-43b2-92ab-ac69d7dbb9ff service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:21.603137 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-a1404af8-65e8-4c12-8527-4f71aa69069c req-d3d69a47-2808-43b2-92ab-ac69d7dbb9ff service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:21.615700 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-a1404af8-65e8-4c12-8527-4f71aa69069c req-d3d69a47-2808-43b2-92ab-ac69d7dbb9ff service nova] Creating event network-vif-plugged:9c018691-b8d6-4230-874b-28c5f931ce00 for instance 70a4ad35-460a-46e6-8819-f73fb43cecaf on n-h2-861333-8 Oct 19 03:53:21.618228 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a598e702-727a-4740-b332-f4bb1253621f tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:53:21.619390 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a598e702-727a-4740-b332-f4bb1253621f tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] [instance: 8b8ec387-c84b-4c5b-8d3b-d2e31fb3fa26] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:53:21.620866 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-a1404af8-65e8-4c12-8527-4f71aa69069c req-d3d69a47-2808-43b2-92ab-ac69d7dbb9ff service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032715 Oct 19 03:53:21.621493 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3196/6453] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:53:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:53:21.629879 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a598e702-727a-4740-b332-f4bb1253621f tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:21.629879 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a598e702-727a-4740-b332-f4bb1253621f tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:21.629879 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a598e702-727a-4740-b332-f4bb1253621f tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:21.630705 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a598e702-727a-4740-b332-f4bb1253621f tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:21.631227 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a598e702-727a-4740-b332-f4bb1253621f tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:21.631727 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a598e702-727a-4740-b332-f4bb1253621f tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:21.772280 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a598e702-727a-4740-b332-f4bb1253621f tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d8ec7142c79407b81108e90ce3657d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f4f31b5836f40e580c28153626ec6ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:53:21.781093 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a598e702-727a-4740-b332-f4bb1253621f tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] 10.222.0.52 "GET /compute/v2.1/servers/8b8ec387-c84b-4c5b-8d3b-d2e31fb3fa26" status: 200 len: 1471 microversion: 2.1 time: 0.182224 Oct 19 03:53:21.781821 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3258/6454] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:53:21 2022] GET /compute/v2.1/servers/8b8ec387-c84b-4c5b-8d3b-d2e31fb3fa26 => generated 1471 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:53:21.805177 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f377cd51-3626-4f8e-996c-43c0bc0510e5 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:53:21.806278 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f377cd51-3626-4f8e-996c-43c0bc0510e5 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] [instance: 8b8ec387-c84b-4c5b-8d3b-d2e31fb3fa26] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:53:21.813433 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f377cd51-3626-4f8e-996c-43c0bc0510e5 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:21.814121 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f377cd51-3626-4f8e-996c-43c0bc0510e5 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:21.814667 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f377cd51-3626-4f8e-996c-43c0bc0510e5 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:21.815473 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f377cd51-3626-4f8e-996c-43c0bc0510e5 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:21.816087 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f377cd51-3626-4f8e-996c-43c0bc0510e5 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:21.817252 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f377cd51-3626-4f8e-996c-43c0bc0510e5 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:21.902877 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-f377cd51-3626-4f8e-996c-43c0bc0510e5 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d8ec7142c79407b81108e90ce3657d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f4f31b5836f40e580c28153626ec6ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:53:21.910689 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f377cd51-3626-4f8e-996c-43c0bc0510e5 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] 10.222.0.52 "GET /compute/v2.1/servers/8b8ec387-c84b-4c5b-8d3b-d2e31fb3fa26" status: 200 len: 1471 microversion: 2.1 time: 0.110428 Oct 19 03:53:21.911882 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3197/6455] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:53:21 2022] GET /compute/v2.1/servers/8b8ec387-c84b-4c5b-8d3b-d2e31fb3fa26 => generated 1471 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:53:21.933142 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-25c481e6-6173-4a61-812d-c968df656880 tempest-TestSecurityGroupsBasicOps-709888478 tempest-TestSecurityGroupsBasicOps-709888478-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:53:21.933801 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-25c481e6-6173-4a61-812d-c968df656880 tempest-TestSecurityGroupsBasicOps-709888478 tempest-TestSecurityGroupsBasicOps-709888478-project-admin] [instance: 8b8ec387-c84b-4c5b-8d3b-d2e31fb3fa26] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:53:21.939726 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-25c481e6-6173-4a61-812d-c968df656880 tempest-TestSecurityGroupsBasicOps-709888478 tempest-TestSecurityGroupsBasicOps-709888478-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:21.940219 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-25c481e6-6173-4a61-812d-c968df656880 tempest-TestSecurityGroupsBasicOps-709888478 tempest-TestSecurityGroupsBasicOps-709888478-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:21.940664 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-25c481e6-6173-4a61-812d-c968df656880 tempest-TestSecurityGroupsBasicOps-709888478 tempest-TestSecurityGroupsBasicOps-709888478-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:21.943605 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-25c481e6-6173-4a61-812d-c968df656880 tempest-TestSecurityGroupsBasicOps-709888478 tempest-TestSecurityGroupsBasicOps-709888478-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:21.943605 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-25c481e6-6173-4a61-812d-c968df656880 tempest-TestSecurityGroupsBasicOps-709888478 tempest-TestSecurityGroupsBasicOps-709888478-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:21.943605 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-25c481e6-6173-4a61-812d-c968df656880 tempest-TestSecurityGroupsBasicOps-709888478 tempest-TestSecurityGroupsBasicOps-709888478-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:21.945474 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=100 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:53:22.022699 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-25c481e6-6173-4a61-812d-c968df656880 tempest-TestSecurityGroupsBasicOps-709888478 tempest-TestSecurityGroupsBasicOps-709888478-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/8b8ec387-c84b-4c5b-8d3b-d2e31fb3fa26" status: 200 len: 1622 microversion: 2.1 time: 0.093319 Oct 19 03:53:22.023282 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3259/6456] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:53:21 2022] GET /compute/v2.1/servers/8b8ec387-c84b-4c5b-8d3b-d2e31fb3fa26 => generated 1622 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:53:22.044163 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4c0a6cdd-fe9b-456e-a58e-200f43ea4079 tempest-TestSecurityGroupsBasicOps-709888478 tempest-TestSecurityGroupsBasicOps-709888478-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:53:22.044775 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4c0a6cdd-fe9b-456e-a58e-200f43ea4079 tempest-TestSecurityGroupsBasicOps-709888478 tempest-TestSecurityGroupsBasicOps-709888478-project-admin] [instance: 8346e5ae-6c1f-4ab8-9ebf-0bb59c802a8b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:53:22.051174 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4c0a6cdd-fe9b-456e-a58e-200f43ea4079 tempest-TestSecurityGroupsBasicOps-709888478 tempest-TestSecurityGroupsBasicOps-709888478-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:22.051663 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4c0a6cdd-fe9b-456e-a58e-200f43ea4079 tempest-TestSecurityGroupsBasicOps-709888478 tempest-TestSecurityGroupsBasicOps-709888478-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:22.052105 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4c0a6cdd-fe9b-456e-a58e-200f43ea4079 tempest-TestSecurityGroupsBasicOps-709888478 tempest-TestSecurityGroupsBasicOps-709888478-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:22.052826 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4c0a6cdd-fe9b-456e-a58e-200f43ea4079 tempest-TestSecurityGroupsBasicOps-709888478 tempest-TestSecurityGroupsBasicOps-709888478-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:22.053282 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4c0a6cdd-fe9b-456e-a58e-200f43ea4079 tempest-TestSecurityGroupsBasicOps-709888478 tempest-TestSecurityGroupsBasicOps-709888478-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:22.053738 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4c0a6cdd-fe9b-456e-a58e-200f43ea4079 tempest-TestSecurityGroupsBasicOps-709888478 tempest-TestSecurityGroupsBasicOps-709888478-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:22.192093 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4c0a6cdd-fe9b-456e-a58e-200f43ea4079 tempest-TestSecurityGroupsBasicOps-709888478 tempest-TestSecurityGroupsBasicOps-709888478-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/8346e5ae-6c1f-4ab8-9ebf-0bb59c802a8b" status: 200 len: 1914 microversion: 2.1 time: 0.151501 Oct 19 03:53:22.192682 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3198/6457] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:53:22 2022] GET /compute/v2.1/servers/8346e5ae-6c1f-4ab8-9ebf-0bb59c802a8b => generated 1914 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:53:22.256894 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3e45f1ac-8d97-4f80-ae4d-1297623d4eac tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:53:22.257434 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-3e45f1ac-8d97-4f80-ae4d-1297623d4eac tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] [instance: 8b8ec387-c84b-4c5b-8d3b-d2e31fb3fa26] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:53:22.263478 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3e45f1ac-8d97-4f80-ae4d-1297623d4eac tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:22.263956 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3e45f1ac-8d97-4f80-ae4d-1297623d4eac tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:22.264659 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3e45f1ac-8d97-4f80-ae4d-1297623d4eac tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:22.265384 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3e45f1ac-8d97-4f80-ae4d-1297623d4eac tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:22.265847 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3e45f1ac-8d97-4f80-ae4d-1297623d4eac tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:22.266280 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3e45f1ac-8d97-4f80-ae4d-1297623d4eac tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:22.291885 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-3e45f1ac-8d97-4f80-ae4d-1297623d4eac tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] [instance: 8b8ec387-c84b-4c5b-8d3b-d2e31fb3fa26] Going to try to terminate instance {{(pid=121135) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:53:22.561710 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-3e45f1ac-8d97-4f80-ae4d-1297623d4eac tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] 10.222.0.52 "DELETE /compute/v2.1/servers/8b8ec387-c84b-4c5b-8d3b-d2e31fb3fa26" status: 204 len: 0 microversion: 2.1 time: 0.308380 Oct 19 03:53:22.562434 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3260/6458] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:53:22 2022] DELETE /compute/v2.1/servers/8b8ec387-c84b-4c5b-8d3b-d2e31fb3fa26 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:53:22.570986 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-10efcf68-8fb3-4b9a-ba2e-bb995091b227 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:53:22.572216 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-10efcf68-8fb3-4b9a-ba2e-bb995091b227 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] [instance: 8b8ec387-c84b-4c5b-8d3b-d2e31fb3fa26] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:53:22.579248 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-10efcf68-8fb3-4b9a-ba2e-bb995091b227 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:22.579740 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-10efcf68-8fb3-4b9a-ba2e-bb995091b227 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:22.580187 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-10efcf68-8fb3-4b9a-ba2e-bb995091b227 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:22.580885 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-10efcf68-8fb3-4b9a-ba2e-bb995091b227 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:22.581385 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-10efcf68-8fb3-4b9a-ba2e-bb995091b227 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:22.582412 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-10efcf68-8fb3-4b9a-ba2e-bb995091b227 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:22.610144 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-22820d87-6a55-4af6-a323-a6d7e0031e86 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:53:22.611009 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-22820d87-6a55-4af6-a323-a6d7e0031e86 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] [instance: 70a4ad35-460a-46e6-8819-f73fb43cecaf] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:53:22.617048 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-22820d87-6a55-4af6-a323-a6d7e0031e86 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:22.617586 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-22820d87-6a55-4af6-a323-a6d7e0031e86 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:22.618039 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-22820d87-6a55-4af6-a323-a6d7e0031e86 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:22.618765 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-22820d87-6a55-4af6-a323-a6d7e0031e86 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:22.619215 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-22820d87-6a55-4af6-a323-a6d7e0031e86 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:22.619649 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-22820d87-6a55-4af6-a323-a6d7e0031e86 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:22.677213 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-10efcf68-8fb3-4b9a-ba2e-bb995091b227 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d8ec7142c79407b81108e90ce3657d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f4f31b5836f40e580c28153626ec6ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:53:22.685326 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-10efcf68-8fb3-4b9a-ba2e-bb995091b227 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] 10.222.0.52 "GET /compute/v2.1/servers/8b8ec387-c84b-4c5b-8d3b-d2e31fb3fa26" status: 200 len: 1477 microversion: 2.1 time: 0.118152 Oct 19 03:53:22.685998 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3199/6459] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:53:22 2022] GET /compute/v2.1/servers/8b8ec387-c84b-4c5b-8d3b-d2e31fb3fa26 => generated 1477 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:53:22.767875 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-22820d87-6a55-4af6-a323-a6d7e0031e86 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518702207efb468a9dea88ad8ce1d557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ea53cc200c4428afb03a512f41bee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:53:22.776257 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-22820d87-6a55-4af6-a323-a6d7e0031e86 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] 10.222.0.52 "GET /compute/v2.1/servers/70a4ad35-460a-46e6-8819-f73fb43cecaf" status: 200 len: 1315 microversion: 2.1 time: 0.170500 Oct 19 03:53:22.776836 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3261/6460] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:53:22 2022] GET /compute/v2.1/servers/70a4ad35-460a-46e6-8819-f73fb43cecaf => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:53:23.636128 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-1d101016-b9cb-4619-b1a3-5517ddef36d9 req-1fbf71f7-de53-4a1c-9edd-234debff6f19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b57ed72-0e3a-43c8-b552-875524942849", "name": "network-vif-plugged", "status": "completed", "tag": "b71571a2-9eae-43a2-9932-7383aafff2d1"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:53:23.646530 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-1d101016-b9cb-4619-b1a3-5517ddef36d9 req-1fbf71f7-de53-4a1c-9edd-234debff6f19 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:23.647041 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-1d101016-b9cb-4619-b1a3-5517ddef36d9 req-1fbf71f7-de53-4a1c-9edd-234debff6f19 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:23.647469 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-1d101016-b9cb-4619-b1a3-5517ddef36d9 req-1fbf71f7-de53-4a1c-9edd-234debff6f19 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:23.658090 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-1d101016-b9cb-4619-b1a3-5517ddef36d9 req-1fbf71f7-de53-4a1c-9edd-234debff6f19 service nova] Creating event network-vif-plugged:b71571a2-9eae-43a2-9932-7383aafff2d1 for instance 2b57ed72-0e3a-43c8-b552-875524942849 on n-h1-861333-8 Oct 19 03:53:23.663385 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-1d101016-b9cb-4619-b1a3-5517ddef36d9 req-1fbf71f7-de53-4a1c-9edd-234debff6f19 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030890 Oct 19 03:53:23.670551 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3200/6461] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:53:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:53:23.708740 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-39023120-d1a2-41a1-8bdc-fa6dc90b107e tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:53:23.709386 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-39023120-d1a2-41a1-8bdc-fa6dc90b107e tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] [instance: 8b8ec387-c84b-4c5b-8d3b-d2e31fb3fa26] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:53:23.716571 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-39023120-d1a2-41a1-8bdc-fa6dc90b107e tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:23.717064 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-39023120-d1a2-41a1-8bdc-fa6dc90b107e tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:23.717533 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-39023120-d1a2-41a1-8bdc-fa6dc90b107e tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:23.718242 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-39023120-d1a2-41a1-8bdc-fa6dc90b107e tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:23.718693 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-39023120-d1a2-41a1-8bdc-fa6dc90b107e tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:23.719121 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-39023120-d1a2-41a1-8bdc-fa6dc90b107e tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:23.801564 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e27b7a5a-08fe-4898-83bd-0a0a49c3fcad tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:53:23.802268 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e27b7a5a-08fe-4898-83bd-0a0a49c3fcad tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] [instance: 70a4ad35-460a-46e6-8819-f73fb43cecaf] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:53:23.807896 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-39023120-d1a2-41a1-8bdc-fa6dc90b107e tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d8ec7142c79407b81108e90ce3657d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f4f31b5836f40e580c28153626ec6ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:53:23.808628 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e27b7a5a-08fe-4898-83bd-0a0a49c3fcad tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:23.809128 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e27b7a5a-08fe-4898-83bd-0a0a49c3fcad tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:23.809599 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e27b7a5a-08fe-4898-83bd-0a0a49c3fcad tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:23.810308 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e27b7a5a-08fe-4898-83bd-0a0a49c3fcad tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:23.810772 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e27b7a5a-08fe-4898-83bd-0a0a49c3fcad tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:23.811200 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e27b7a5a-08fe-4898-83bd-0a0a49c3fcad tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:23.816322 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-39023120-d1a2-41a1-8bdc-fa6dc90b107e tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] 10.222.0.52 "GET /compute/v2.1/servers/8b8ec387-c84b-4c5b-8d3b-d2e31fb3fa26" status: 200 len: 1477 microversion: 2.1 time: 0.111706 Oct 19 03:53:23.816985 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3262/6462] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:53:23 2022] GET /compute/v2.1/servers/8b8ec387-c84b-4c5b-8d3b-d2e31fb3fa26 => generated 1477 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:53:23.940330 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e27b7a5a-08fe-4898-83bd-0a0a49c3fcad tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518702207efb468a9dea88ad8ce1d557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ea53cc200c4428afb03a512f41bee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:53:23.948007 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e27b7a5a-08fe-4898-83bd-0a0a49c3fcad tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] 10.222.0.52 "GET /compute/v2.1/servers/70a4ad35-460a-46e6-8819-f73fb43cecaf" status: 200 len: 1503 microversion: 2.1 time: 0.151471 Oct 19 03:53:23.948581 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3201/6463] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:53:23 2022] GET /compute/v2.1/servers/70a4ad35-460a-46e6-8819-f73fb43cecaf => generated 1503 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:53:23.970406 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-29f3f17a-3843-472d-af75-f348856976d1 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:53:23.971032 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-29f3f17a-3843-472d-af75-f348856976d1 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] [instance: 70a4ad35-460a-46e6-8819-f73fb43cecaf] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:53:23.978644 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-29f3f17a-3843-472d-af75-f348856976d1 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:23.979143 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-29f3f17a-3843-472d-af75-f348856976d1 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:23.979591 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-29f3f17a-3843-472d-af75-f348856976d1 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:23.980300 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-29f3f17a-3843-472d-af75-f348856976d1 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:23.980765 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-29f3f17a-3843-472d-af75-f348856976d1 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:23.981199 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-29f3f17a-3843-472d-af75-f348856976d1 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:24.111413 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-29f3f17a-3843-472d-af75-f348856976d1 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518702207efb468a9dea88ad8ce1d557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ea53cc200c4428afb03a512f41bee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:53:24.119085 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-29f3f17a-3843-472d-af75-f348856976d1 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] 10.222.0.52 "GET /compute/v2.1/servers/70a4ad35-460a-46e6-8819-f73fb43cecaf" status: 200 len: 1503 microversion: 2.1 time: 0.152585 Oct 19 03:53:24.119659 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3263/6464] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:53:23 2022] GET /compute/v2.1/servers/70a4ad35-460a-46e6-8819-f73fb43cecaf => generated 1503 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:53:24.142090 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8ac470fc-3efd-48dd-9c30-8cdd794be0a4 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:53:24.142627 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8ac470fc-3efd-48dd-9c30-8cdd794be0a4 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] [instance: 70a4ad35-460a-46e6-8819-f73fb43cecaf] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:53:24.149093 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8ac470fc-3efd-48dd-9c30-8cdd794be0a4 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:24.149616 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8ac470fc-3efd-48dd-9c30-8cdd794be0a4 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:24.150060 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8ac470fc-3efd-48dd-9c30-8cdd794be0a4 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:24.150753 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8ac470fc-3efd-48dd-9c30-8cdd794be0a4 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:24.151211 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8ac470fc-3efd-48dd-9c30-8cdd794be0a4 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:24.151642 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8ac470fc-3efd-48dd-9c30-8cdd794be0a4 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:24.174764 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-8ac470fc-3efd-48dd-9c30-8cdd794be0a4 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lazy-loading 'flavor' on Instance uuid 70a4ad35-460a-46e6-8819-f73fb43cecaf {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:53:24.442885 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8ac470fc-3efd-48dd-9c30-8cdd794be0a4 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] 10.222.0.52 "POST /compute/v2.1/servers/70a4ad35-460a-46e6-8819-f73fb43cecaf/action" status: 202 len: 0 microversion: 2.1 time: 0.304850 Oct 19 03:53:24.443938 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3202/6465] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:53:24 2022] POST /compute/v2.1/servers/70a4ad35-460a-46e6-8819-f73fb43cecaf/action => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:53:24.452117 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1b9d8ceb-8c09-4319-9f31-cca59d516723 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:53:24.452732 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1b9d8ceb-8c09-4319-9f31-cca59d516723 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] [instance: 70a4ad35-460a-46e6-8819-f73fb43cecaf] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:53:24.459877 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1b9d8ceb-8c09-4319-9f31-cca59d516723 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:24.460474 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1b9d8ceb-8c09-4319-9f31-cca59d516723 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:24.460986 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1b9d8ceb-8c09-4319-9f31-cca59d516723 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:24.461790 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1b9d8ceb-8c09-4319-9f31-cca59d516723 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:24.462319 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1b9d8ceb-8c09-4319-9f31-cca59d516723 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:24.462856 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1b9d8ceb-8c09-4319-9f31-cca59d516723 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:24.593914 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-1b9d8ceb-8c09-4319-9f31-cca59d516723 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518702207efb468a9dea88ad8ce1d557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ea53cc200c4428afb03a512f41bee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:53:24.601905 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1b9d8ceb-8c09-4319-9f31-cca59d516723 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] 10.222.0.52 "GET /compute/v2.1/servers/70a4ad35-460a-46e6-8819-f73fb43cecaf" status: 200 len: 1511 microversion: 2.1 time: 0.153919 Oct 19 03:53:24.602501 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3264/6466] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:53:24 2022] GET /compute/v2.1/servers/70a4ad35-460a-46e6-8819-f73fb43cecaf => generated 1511 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:53:24.699274 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-d228f312-5897-4bfc-bff8-0160d0a064c9 req-679ff0b7-f4e9-464b-8eaa-d1f65a9759e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b8ec387-c84b-4c5b-8d3b-d2e31fb3fa26", "name": "network-vif-deleted", "tag": "8eb38ab3-bc83-4809-946d-37639141c03b"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:53:24.711194 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-d228f312-5897-4bfc-bff8-0160d0a064c9 req-679ff0b7-f4e9-464b-8eaa-d1f65a9759e0 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:24.711682 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-d228f312-5897-4bfc-bff8-0160d0a064c9 req-679ff0b7-f4e9-464b-8eaa-d1f65a9759e0 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:24.712122 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-d228f312-5897-4bfc-bff8-0160d0a064c9 req-679ff0b7-f4e9-464b-8eaa-d1f65a9759e0 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:24.725984 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-d228f312-5897-4bfc-bff8-0160d0a064c9 req-679ff0b7-f4e9-464b-8eaa-d1f65a9759e0 service nova] Creating event network-vif-deleted:8eb38ab3-bc83-4809-946d-37639141c03b for instance 8b8ec387-c84b-4c5b-8d3b-d2e31fb3fa26 on n-h1-861333-8 Oct 19 03:53:24.733106 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-d228f312-5897-4bfc-bff8-0160d0a064c9 req-679ff0b7-f4e9-464b-8eaa-d1f65a9759e0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038683 Oct 19 03:53:24.733828 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3203/6467] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:53:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:53:24.839213 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d31feb52-015f-4c8c-9d2d-656ffa3a73d6 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:53:24.839838 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d31feb52-015f-4c8c-9d2d-656ffa3a73d6 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] [instance: 8b8ec387-c84b-4c5b-8d3b-d2e31fb3fa26] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:53:24.849156 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d31feb52-015f-4c8c-9d2d-656ffa3a73d6 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:24.849692 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d31feb52-015f-4c8c-9d2d-656ffa3a73d6 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:24.850140 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d31feb52-015f-4c8c-9d2d-656ffa3a73d6 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:24.850862 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d31feb52-015f-4c8c-9d2d-656ffa3a73d6 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:24.851326 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d31feb52-015f-4c8c-9d2d-656ffa3a73d6 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:24.856095 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d31feb52-015f-4c8c-9d2d-656ffa3a73d6 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:24.917210 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d31feb52-015f-4c8c-9d2d-656ffa3a73d6 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d8ec7142c79407b81108e90ce3657d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f4f31b5836f40e580c28153626ec6ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:53:24.925115 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d31feb52-015f-4c8c-9d2d-656ffa3a73d6 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] 10.222.0.52 "GET /compute/v2.1/servers/8b8ec387-c84b-4c5b-8d3b-d2e31fb3fa26" status: 200 len: 1325 microversion: 2.1 time: 0.089753 Oct 19 03:53:24.926218 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3265/6468] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:53:24 2022] GET /compute/v2.1/servers/8b8ec387-c84b-4c5b-8d3b-d2e31fb3fa26 => generated 1325 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:53:25.625670 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ca7be92a-6683-4266-80ef-5a341b4cabc1 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:53:25.626418 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ca7be92a-6683-4266-80ef-5a341b4cabc1 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] [instance: 70a4ad35-460a-46e6-8819-f73fb43cecaf] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:53:25.632669 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ca7be92a-6683-4266-80ef-5a341b4cabc1 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:25.634383 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ca7be92a-6683-4266-80ef-5a341b4cabc1 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:25.634383 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ca7be92a-6683-4266-80ef-5a341b4cabc1 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:25.634383 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ca7be92a-6683-4266-80ef-5a341b4cabc1 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:25.634822 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ca7be92a-6683-4266-80ef-5a341b4cabc1 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:25.635257 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ca7be92a-6683-4266-80ef-5a341b4cabc1 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:25.776915 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ca7be92a-6683-4266-80ef-5a341b4cabc1 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518702207efb468a9dea88ad8ce1d557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ea53cc200c4428afb03a512f41bee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:53:25.786085 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ca7be92a-6683-4266-80ef-5a341b4cabc1 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] 10.222.0.52 "GET /compute/v2.1/servers/70a4ad35-460a-46e6-8819-f73fb43cecaf" status: 200 len: 1494 microversion: 2.1 time: 0.164101 Oct 19 03:53:25.786669 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3204/6469] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:53:25 2022] GET /compute/v2.1/servers/70a4ad35-460a-46e6-8819-f73fb43cecaf => generated 1494 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:53:25.808921 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-49ba7748-4c79-4f94-98ca-b348442c1777 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:53:25.809519 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-49ba7748-4c79-4f94-98ca-b348442c1777 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] [instance: 70a4ad35-460a-46e6-8819-f73fb43cecaf] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:53:25.815560 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-49ba7748-4c79-4f94-98ca-b348442c1777 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:25.816040 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-49ba7748-4c79-4f94-98ca-b348442c1777 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:25.816994 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-49ba7748-4c79-4f94-98ca-b348442c1777 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:25.817715 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-49ba7748-4c79-4f94-98ca-b348442c1777 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:25.818237 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-49ba7748-4c79-4f94-98ca-b348442c1777 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:25.818662 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-49ba7748-4c79-4f94-98ca-b348442c1777 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:25.948726 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-bd8e83aa-58b2-4853-afb1-6ada9cebf2e0 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:53:25.949336 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-bd8e83aa-58b2-4853-afb1-6ada9cebf2e0 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] [instance: 8b8ec387-c84b-4c5b-8d3b-d2e31fb3fa26] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:53:25.955473 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bd8e83aa-58b2-4853-afb1-6ada9cebf2e0 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:25.955977 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bd8e83aa-58b2-4853-afb1-6ada9cebf2e0 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:25.956413 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bd8e83aa-58b2-4853-afb1-6ada9cebf2e0 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:25.957675 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bd8e83aa-58b2-4853-afb1-6ada9cebf2e0 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:25.958133 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bd8e83aa-58b2-4853-afb1-6ada9cebf2e0 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:25.958556 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bd8e83aa-58b2-4853-afb1-6ada9cebf2e0 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:25.975096 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-bd8e83aa-58b2-4853-afb1-6ada9cebf2e0 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] HTTP exception thrown: Instance 8b8ec387-c84b-4c5b-8d3b-d2e31fb3fa26 could not be found. Oct 19 03:53:25.976821 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-bd8e83aa-58b2-4853-afb1-6ada9cebf2e0 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Request method failure captured: Oct 19 03:53:25.976821 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/8b8ec387-c84b-4c5b-8d3b-d2e31fb3fa26 HTTP/1.1 Oct 19 03:53:25.976821 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:53:25.976821 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:53:25.976821 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:53:25.976821 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:53:25.976821 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:53:25.976821 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:53:25.976821 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:53:25.976821 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:53:25.976821 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3RWwIx8SDdQdPERf4HTt_1GdIK8bPBKaXQb5e8PjM54MG4wLQnBeZL9E8w2iSF_IUdVweAi2CNvPy9JlvpD_viQ2Yf1Em4lFBWIciGIa8ABbe0wDDx0ZkpG_cxVuLaEG0eZEhP-u6I1ejtjBRAV2x3twh5Z8hWtZGP9JAleFx02_3s Oct 19 03:53:25.976821 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:53:25.976821 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:53:25.976821 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:53:25.976821 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:53:25.976821 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:53:25.976821 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:53:25.976821 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 6f4f31b5836f40e580c28153626ec6ce Oct 19 03:53:25.976821 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1659476090 Oct 19 03:53:25.976821 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:53:25.976821 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:53:25.976821 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6f4f31b5836f40e580c28153626ec6ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6f4f31b5836f40e580c28153626ec6ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6f4f31b5836f40e580c28153626ec6ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6f4f31b5836f40e580c28153626ec6ce", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:53:25.976821 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1659476090 Oct 19 03:53:25.976821 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 6f4f31b5836f40e580c28153626ec6ce Oct 19 03:53:25.976821 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1659476090 Oct 19 03:53:25.976821 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-TestSecurityGroupsBasicOps-1659476090-project Oct 19 03:53:25.976821 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:53:25.976821 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:53:25.976821 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 8d8ec7142c79407b81108e90ce3657d5 Oct 19 03:53:25.976821 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1659476090-project Oct 19 03:53:25.976821 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:53:25.976821 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance 8b8ec387-c84b-4c5b-8d3b-d2e31fb3fa26 could not be found. Oct 19 03:53:25.976821 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '8b8ec387-c84b-4c5b-8d3b-d2e31fb3fa26'} Oct 19 03:53:25.976821 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:53:25.976821 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:53:25.976821 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:53:25.976821 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:53:25.976821 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:53:25.976821 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:53:25.976821 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:53:25.976821 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:53:25.976821 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:53:25.976821 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:53:25.976821 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b8ec387-c84b-4c5b-8d3b-d2e31fb3fa26 could not be found. Oct 19 03:53:25.976821 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:53:25.976821 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:53:25.976821 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:53:25.976821 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:53:25.976821 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:53:25.976821 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:53:25.976821 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:53:25.976821 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:53:25.976821 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:53:25.976821 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:53:25.976821 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:53:25.976821 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:53:25.976821 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:53:25.976821 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:53:25.976821 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:53:25.976821 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:53:25.976821 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b8ec387-c84b-4c5b-8d3b-d2e31fb3fa26 could not be found. Oct 19 03:53:25.976821 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:53:25.976821 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:53:25.981548 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:53:25.981548 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:53:25.981548 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:53:25.981548 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:53:25.981548 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:53:25.981548 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:53:25.981548 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b8ec387-c84b-4c5b-8d3b-d2e31fb3fa26 could not be found. Oct 19 03:53:25.981548 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:53:25.981548 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-bd8e83aa-58b2-4853-afb1-6ada9cebf2e0 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Returning 404 to user: Instance 8b8ec387-c84b-4c5b-8d3b-d2e31fb3fa26 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:53:25.981548 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-bd8e83aa-58b2-4853-afb1-6ada9cebf2e0 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] 10.222.0.52 "GET /compute/v2.1/servers/8b8ec387-c84b-4c5b-8d3b-d2e31fb3fa26" status: 404 len: 111 microversion: 2.1 time: 0.033653 Oct 19 03:53:25.981548 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3205/6470] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:53:25 2022] GET /compute/v2.1/servers/8b8ec387-c84b-4c5b-8d3b-d2e31fb3fa26 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 03:53:26.036205 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-49ba7748-4c79-4f94-98ca-b348442c1777 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] 10.222.0.52 "POST /compute/v2.1/servers/70a4ad35-460a-46e6-8819-f73fb43cecaf/action" status: 202 len: 0 microversion: 2.1 time: 0.231163 Oct 19 03:53:26.036934 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3266/6471] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:53:25 2022] POST /compute/v2.1/servers/70a4ad35-460a-46e6-8819-f73fb43cecaf/action => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:53:26.045950 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ff69e448-ec71-4442-8a7b-d391d1c3ba6b tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:53:26.046667 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ff69e448-ec71-4442-8a7b-d391d1c3ba6b tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] [instance: 70a4ad35-460a-46e6-8819-f73fb43cecaf] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:53:26.054690 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ff69e448-ec71-4442-8a7b-d391d1c3ba6b tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:26.055536 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ff69e448-ec71-4442-8a7b-d391d1c3ba6b tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:26.056081 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ff69e448-ec71-4442-8a7b-d391d1c3ba6b tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:26.056975 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ff69e448-ec71-4442-8a7b-d391d1c3ba6b tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:26.057673 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ff69e448-ec71-4442-8a7b-d391d1c3ba6b tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:26.059444 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ff69e448-ec71-4442-8a7b-d391d1c3ba6b tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:26.409146 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ff69e448-ec71-4442-8a7b-d391d1c3ba6b tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518702207efb468a9dea88ad8ce1d557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ea53cc200c4428afb03a512f41bee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:53:26.417048 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ff69e448-ec71-4442-8a7b-d391d1c3ba6b tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] 10.222.0.52 "GET /compute/v2.1/servers/70a4ad35-460a-46e6-8819-f73fb43cecaf" status: 200 len: 1500 microversion: 2.1 time: 0.375961 Oct 19 03:53:26.417659 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3206/6472] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:53:26 2022] GET /compute/v2.1/servers/70a4ad35-460a-46e6-8819-f73fb43cecaf => generated 1500 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:53:27.440662 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f054fbe5-047f-4041-9a2b-ce188f880ce8 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:53:27.441919 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f054fbe5-047f-4041-9a2b-ce188f880ce8 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] [instance: 70a4ad35-460a-46e6-8819-f73fb43cecaf] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:53:27.448970 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f054fbe5-047f-4041-9a2b-ce188f880ce8 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:27.449497 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f054fbe5-047f-4041-9a2b-ce188f880ce8 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:27.449946 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f054fbe5-047f-4041-9a2b-ce188f880ce8 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:27.450679 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f054fbe5-047f-4041-9a2b-ce188f880ce8 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:27.451143 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f054fbe5-047f-4041-9a2b-ce188f880ce8 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:27.451575 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f054fbe5-047f-4041-9a2b-ce188f880ce8 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:27.663332 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f054fbe5-047f-4041-9a2b-ce188f880ce8 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518702207efb468a9dea88ad8ce1d557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ea53cc200c4428afb03a512f41bee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:53:27.671163 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f054fbe5-047f-4041-9a2b-ce188f880ce8 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] 10.222.0.52 "GET /compute/v2.1/servers/70a4ad35-460a-46e6-8819-f73fb43cecaf" status: 200 len: 1500 microversion: 2.1 time: 0.234792 Oct 19 03:53:27.671739 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3267/6473] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:53:27 2022] GET /compute/v2.1/servers/70a4ad35-460a-46e6-8819-f73fb43cecaf => generated 1500 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:53:28.695018 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1cb76fce-7de0-4181-be08-d50cca55bf58 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:53:28.695911 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1cb76fce-7de0-4181-be08-d50cca55bf58 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] [instance: 70a4ad35-460a-46e6-8819-f73fb43cecaf] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:53:28.704399 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1cb76fce-7de0-4181-be08-d50cca55bf58 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:28.704982 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1cb76fce-7de0-4181-be08-d50cca55bf58 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:28.712316 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1cb76fce-7de0-4181-be08-d50cca55bf58 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:28.712316 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1cb76fce-7de0-4181-be08-d50cca55bf58 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:28.712316 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1cb76fce-7de0-4181-be08-d50cca55bf58 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:28.712316 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1cb76fce-7de0-4181-be08-d50cca55bf58 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:28.864911 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-1cb76fce-7de0-4181-be08-d50cca55bf58 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518702207efb468a9dea88ad8ce1d557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ea53cc200c4428afb03a512f41bee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:53:28.874123 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1cb76fce-7de0-4181-be08-d50cca55bf58 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] 10.222.0.52 "GET /compute/v2.1/servers/70a4ad35-460a-46e6-8819-f73fb43cecaf" status: 200 len: 1503 microversion: 2.1 time: 0.183473 Oct 19 03:53:28.875441 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3207/6474] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:53:28 2022] GET /compute/v2.1/servers/70a4ad35-460a-46e6-8819-f73fb43cecaf => generated 1503 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:53:28.898028 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-556dcdcd-9797-47ed-880e-d6ed1a426dd0 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:53:28.898559 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-556dcdcd-9797-47ed-880e-d6ed1a426dd0 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] [instance: 70a4ad35-460a-46e6-8819-f73fb43cecaf] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:53:28.907060 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-556dcdcd-9797-47ed-880e-d6ed1a426dd0 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:28.908733 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-556dcdcd-9797-47ed-880e-d6ed1a426dd0 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:28.910073 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-556dcdcd-9797-47ed-880e-d6ed1a426dd0 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:28.910877 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-556dcdcd-9797-47ed-880e-d6ed1a426dd0 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:28.911453 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-556dcdcd-9797-47ed-880e-d6ed1a426dd0 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:28.912066 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-556dcdcd-9797-47ed-880e-d6ed1a426dd0 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:28.935981 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-556dcdcd-9797-47ed-880e-d6ed1a426dd0 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lazy-loading 'flavor' on Instance uuid 70a4ad35-460a-46e6-8819-f73fb43cecaf {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:53:29.289346 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-556dcdcd-9797-47ed-880e-d6ed1a426dd0 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] 10.222.0.52 "POST /compute/v2.1/servers/70a4ad35-460a-46e6-8819-f73fb43cecaf/action" status: 202 len: 0 microversion: 2.1 time: 0.395160 Oct 19 03:53:29.290581 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3268/6475] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:53:28 2022] POST /compute/v2.1/servers/70a4ad35-460a-46e6-8819-f73fb43cecaf/action => generated 0 bytes in 397 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:53:29.298737 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5f0d178f-3ad1-4b5c-86e0-453925ebb60e tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:53:29.299621 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5f0d178f-3ad1-4b5c-86e0-453925ebb60e tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] [instance: 70a4ad35-460a-46e6-8819-f73fb43cecaf] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:53:29.306885 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5f0d178f-3ad1-4b5c-86e0-453925ebb60e tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:29.307392 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5f0d178f-3ad1-4b5c-86e0-453925ebb60e tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:29.308024 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5f0d178f-3ad1-4b5c-86e0-453925ebb60e tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:29.309028 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5f0d178f-3ad1-4b5c-86e0-453925ebb60e tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:29.309528 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5f0d178f-3ad1-4b5c-86e0-453925ebb60e tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:29.310000 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5f0d178f-3ad1-4b5c-86e0-453925ebb60e tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:29.453670 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5f0d178f-3ad1-4b5c-86e0-453925ebb60e tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518702207efb468a9dea88ad8ce1d557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ea53cc200c4428afb03a512f41bee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:53:29.462652 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5f0d178f-3ad1-4b5c-86e0-453925ebb60e tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] 10.222.0.52 "GET /compute/v2.1/servers/70a4ad35-460a-46e6-8819-f73fb43cecaf" status: 200 len: 1511 microversion: 2.1 time: 0.168165 Oct 19 03:53:29.464199 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3208/6476] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:53:29 2022] GET /compute/v2.1/servers/70a4ad35-460a-46e6-8819-f73fb43cecaf => generated 1511 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:53:30.489584 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4f713ebb-aef0-4387-93de-84fbd222998a tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:53:30.490295 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4f713ebb-aef0-4387-93de-84fbd222998a tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] [instance: 70a4ad35-460a-46e6-8819-f73fb43cecaf] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:53:30.496502 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4f713ebb-aef0-4387-93de-84fbd222998a tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:30.496960 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4f713ebb-aef0-4387-93de-84fbd222998a tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:30.497628 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4f713ebb-aef0-4387-93de-84fbd222998a tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:30.501983 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4f713ebb-aef0-4387-93de-84fbd222998a tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:30.501983 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4f713ebb-aef0-4387-93de-84fbd222998a tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:30.501983 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4f713ebb-aef0-4387-93de-84fbd222998a tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:30.707829 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4f713ebb-aef0-4387-93de-84fbd222998a tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518702207efb468a9dea88ad8ce1d557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ea53cc200c4428afb03a512f41bee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:53:30.718510 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4f713ebb-aef0-4387-93de-84fbd222998a tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] 10.222.0.52 "GET /compute/v2.1/servers/70a4ad35-460a-46e6-8819-f73fb43cecaf" status: 200 len: 1494 microversion: 2.1 time: 0.234017 Oct 19 03:53:30.719842 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3269/6477] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:53:30 2022] GET /compute/v2.1/servers/70a4ad35-460a-46e6-8819-f73fb43cecaf => generated 1494 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:53:30.742128 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-40d69cbc-7f17-4052-a697-97bd2c648dfb tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:53:30.743321 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-40d69cbc-7f17-4052-a697-97bd2c648dfb tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] [instance: 70a4ad35-460a-46e6-8819-f73fb43cecaf] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:53:30.751481 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-40d69cbc-7f17-4052-a697-97bd2c648dfb tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:30.756217 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-40d69cbc-7f17-4052-a697-97bd2c648dfb tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:30.756217 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-40d69cbc-7f17-4052-a697-97bd2c648dfb tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:30.756217 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-40d69cbc-7f17-4052-a697-97bd2c648dfb tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:30.756217 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-40d69cbc-7f17-4052-a697-97bd2c648dfb tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:30.756217 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-40d69cbc-7f17-4052-a697-97bd2c648dfb tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:31.012438 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-40d69cbc-7f17-4052-a697-97bd2c648dfb tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] 10.222.0.52 "POST /compute/v2.1/servers/70a4ad35-460a-46e6-8819-f73fb43cecaf/action" status: 202 len: 0 microversion: 2.1 time: 0.274411 Oct 19 03:53:31.016660 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3209/6478] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:53:30 2022] POST /compute/v2.1/servers/70a4ad35-460a-46e6-8819-f73fb43cecaf/action => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:53:31.022301 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f867a93b-3854-4066-86da-769c682f2688 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:53:31.022923 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f867a93b-3854-4066-86da-769c682f2688 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] [instance: 70a4ad35-460a-46e6-8819-f73fb43cecaf] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:53:31.029121 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f867a93b-3854-4066-86da-769c682f2688 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:31.029654 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f867a93b-3854-4066-86da-769c682f2688 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:31.030124 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f867a93b-3854-4066-86da-769c682f2688 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:31.031028 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f867a93b-3854-4066-86da-769c682f2688 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:31.031683 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f867a93b-3854-4066-86da-769c682f2688 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:31.032075 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f867a93b-3854-4066-86da-769c682f2688 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:31.176999 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f867a93b-3854-4066-86da-769c682f2688 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518702207efb468a9dea88ad8ce1d557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ea53cc200c4428afb03a512f41bee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:53:31.185846 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f867a93b-3854-4066-86da-769c682f2688 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] 10.222.0.52 "GET /compute/v2.1/servers/70a4ad35-460a-46e6-8819-f73fb43cecaf" status: 200 len: 1500 microversion: 2.1 time: 0.167737 Oct 19 03:53:31.186859 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3270/6479] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:53:31 2022] GET /compute/v2.1/servers/70a4ad35-460a-46e6-8819-f73fb43cecaf => generated 1500 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:53:31.572255 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-eb11e0c8-df42-4651-be17-8cfc7e9f9d0a tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:53:31.573045 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-eb11e0c8-df42-4651-be17-8cfc7e9f9d0a tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] [instance: 8346e5ae-6c1f-4ab8-9ebf-0bb59c802a8b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:53:31.573359 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-cc6f87bd-d51b-4b84-a810-fcb4b85347ff req-7506385f-cbd8-4037-92c8-6edeaae0a863 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8346e5ae-6c1f-4ab8-9ebf-0bb59c802a8b", "tag": "bdecb113-13e4-4aae-a58a-012ce7f0cf31"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:53:31.580028 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eb11e0c8-df42-4651-be17-8cfc7e9f9d0a tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:31.580789 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eb11e0c8-df42-4651-be17-8cfc7e9f9d0a tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:31.581465 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eb11e0c8-df42-4651-be17-8cfc7e9f9d0a tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:31.582952 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eb11e0c8-df42-4651-be17-8cfc7e9f9d0a tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:31.583610 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eb11e0c8-df42-4651-be17-8cfc7e9f9d0a tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:31.584240 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eb11e0c8-df42-4651-be17-8cfc7e9f9d0a tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:31.585163 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-cc6f87bd-d51b-4b84-a810-fcb4b85347ff req-7506385f-cbd8-4037-92c8-6edeaae0a863 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:31.585698 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-cc6f87bd-d51b-4b84-a810-fcb4b85347ff req-7506385f-cbd8-4037-92c8-6edeaae0a863 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:31.586139 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-cc6f87bd-d51b-4b84-a810-fcb4b85347ff req-7506385f-cbd8-4037-92c8-6edeaae0a863 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:31.600965 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-cc6f87bd-d51b-4b84-a810-fcb4b85347ff req-7506385f-cbd8-4037-92c8-6edeaae0a863 service nova] Creating event network-changed:bdecb113-13e4-4aae-a58a-012ce7f0cf31 for instance 8346e5ae-6c1f-4ab8-9ebf-0bb59c802a8b on n-h2-861333-8 Oct 19 03:53:31.606892 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-cc6f87bd-d51b-4b84-a810-fcb4b85347ff req-7506385f-cbd8-4037-92c8-6edeaae0a863 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037005 Oct 19 03:53:31.607711 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3271/6480] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:53:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:53:31.657609 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-eb11e0c8-df42-4651-be17-8cfc7e9f9d0a tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] [instance: 8346e5ae-6c1f-4ab8-9ebf-0bb59c802a8b] Going to try to terminate instance {{(pid=121134) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:53:31.657609 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:53:31.928389 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-eb11e0c8-df42-4651-be17-8cfc7e9f9d0a tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] 10.222.0.52 "DELETE /compute/v2.1/servers/8346e5ae-6c1f-4ab8-9ebf-0bb59c802a8b" status: 204 len: 0 microversion: 2.1 time: 0.357872 Oct 19 03:53:31.933661 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3210/6481] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:53:31 2022] DELETE /compute/v2.1/servers/8346e5ae-6c1f-4ab8-9ebf-0bb59c802a8b => generated 0 bytes in 363 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:53:31.940187 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-33aee3cd-b8c3-416b-9dce-f99dd6e150ce tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:53:31.940936 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-33aee3cd-b8c3-416b-9dce-f99dd6e150ce tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] [instance: 8346e5ae-6c1f-4ab8-9ebf-0bb59c802a8b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:53:31.948590 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-33aee3cd-b8c3-416b-9dce-f99dd6e150ce tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:31.949103 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-33aee3cd-b8c3-416b-9dce-f99dd6e150ce tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:31.949763 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-33aee3cd-b8c3-416b-9dce-f99dd6e150ce tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:31.950644 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-33aee3cd-b8c3-416b-9dce-f99dd6e150ce tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:31.955646 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-33aee3cd-b8c3-416b-9dce-f99dd6e150ce tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:31.955646 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-33aee3cd-b8c3-416b-9dce-f99dd6e150ce tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:31.955646 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:53:32.173882 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-33aee3cd-b8c3-416b-9dce-f99dd6e150ce tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d8ec7142c79407b81108e90ce3657d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f4f31b5836f40e580c28153626ec6ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:53:32.183142 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-33aee3cd-b8c3-416b-9dce-f99dd6e150ce tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] 10.222.0.52 "GET /compute/v2.1/servers/8346e5ae-6c1f-4ab8-9ebf-0bb59c802a8b" status: 200 len: 1769 microversion: 2.1 time: 0.247468 Oct 19 03:53:32.183747 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3272/6482] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:53:31 2022] GET /compute/v2.1/servers/8346e5ae-6c1f-4ab8-9ebf-0bb59c802a8b => generated 1769 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:53:32.210903 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-20ccb95b-59fd-480c-84df-456e7b31d927 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:53:32.211609 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-20ccb95b-59fd-480c-84df-456e7b31d927 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] [instance: 70a4ad35-460a-46e6-8819-f73fb43cecaf] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:53:32.217732 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-20ccb95b-59fd-480c-84df-456e7b31d927 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:32.218214 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-20ccb95b-59fd-480c-84df-456e7b31d927 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:32.218651 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-20ccb95b-59fd-480c-84df-456e7b31d927 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:32.219376 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-20ccb95b-59fd-480c-84df-456e7b31d927 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:32.221100 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-20ccb95b-59fd-480c-84df-456e7b31d927 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:32.221596 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-20ccb95b-59fd-480c-84df-456e7b31d927 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:32.367684 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-20ccb95b-59fd-480c-84df-456e7b31d927 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518702207efb468a9dea88ad8ce1d557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ea53cc200c4428afb03a512f41bee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:53:32.375458 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-20ccb95b-59fd-480c-84df-456e7b31d927 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] 10.222.0.52 "GET /compute/v2.1/servers/70a4ad35-460a-46e6-8819-f73fb43cecaf" status: 200 len: 1500 microversion: 2.1 time: 0.169183 Oct 19 03:53:32.376024 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3211/6483] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:53:32 2022] GET /compute/v2.1/servers/70a4ad35-460a-46e6-8819-f73fb43cecaf => generated 1500 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:53:33.207926 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-bd46b032-985d-4b91-88f9-d9f1a0887082 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:53:33.208547 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-bd46b032-985d-4b91-88f9-d9f1a0887082 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] [instance: 8346e5ae-6c1f-4ab8-9ebf-0bb59c802a8b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:53:33.215636 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bd46b032-985d-4b91-88f9-d9f1a0887082 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:33.216334 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bd46b032-985d-4b91-88f9-d9f1a0887082 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:33.216790 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bd46b032-985d-4b91-88f9-d9f1a0887082 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:33.217529 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bd46b032-985d-4b91-88f9-d9f1a0887082 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:33.217995 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bd46b032-985d-4b91-88f9-d9f1a0887082 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:33.218433 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bd46b032-985d-4b91-88f9-d9f1a0887082 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:33.400065 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7096e836-5881-4250-814a-96902f3ad96b tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:53:33.401979 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7096e836-5881-4250-814a-96902f3ad96b tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] [instance: 70a4ad35-460a-46e6-8819-f73fb43cecaf] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:53:33.409089 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7096e836-5881-4250-814a-96902f3ad96b tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:33.409654 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7096e836-5881-4250-814a-96902f3ad96b tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:33.410134 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7096e836-5881-4250-814a-96902f3ad96b tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:33.410847 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7096e836-5881-4250-814a-96902f3ad96b tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:33.411311 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7096e836-5881-4250-814a-96902f3ad96b tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:33.411745 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7096e836-5881-4250-814a-96902f3ad96b tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:33.604720 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-bd46b032-985d-4b91-88f9-d9f1a0887082 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d8ec7142c79407b81108e90ce3657d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f4f31b5836f40e580c28153626ec6ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:53:33.612728 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-bd46b032-985d-4b91-88f9-d9f1a0887082 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] 10.222.0.52 "GET /compute/v2.1/servers/8346e5ae-6c1f-4ab8-9ebf-0bb59c802a8b" status: 200 len: 1769 microversion: 2.1 time: 0.409226 Oct 19 03:53:33.613573 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3273/6484] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:53:33 2022] GET /compute/v2.1/servers/8346e5ae-6c1f-4ab8-9ebf-0bb59c802a8b => generated 1769 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:53:33.769391 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-7096e836-5881-4250-814a-96902f3ad96b tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518702207efb468a9dea88ad8ce1d557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ea53cc200c4428afb03a512f41bee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:53:33.777503 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7096e836-5881-4250-814a-96902f3ad96b tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] 10.222.0.52 "GET /compute/v2.1/servers/70a4ad35-460a-46e6-8819-f73fb43cecaf" status: 200 len: 1500 microversion: 2.1 time: 0.381733 Oct 19 03:53:33.778139 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3212/6485] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:53:33 2022] GET /compute/v2.1/servers/70a4ad35-460a-46e6-8819-f73fb43cecaf => generated 1500 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:53:34.189016 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-11612aa3-603f-4f80-a365-8fc2f23f9482 req-2d29d73c-f591-453b-b000-182e09475f2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8346e5ae-6c1f-4ab8-9ebf-0bb59c802a8b", "name": "network-vif-deleted", "tag": "bdecb113-13e4-4aae-a58a-012ce7f0cf31"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:53:34.198677 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-11612aa3-603f-4f80-a365-8fc2f23f9482 req-2d29d73c-f591-453b-b000-182e09475f2d service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:34.200133 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-11612aa3-603f-4f80-a365-8fc2f23f9482 req-2d29d73c-f591-453b-b000-182e09475f2d service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:34.200133 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-11612aa3-603f-4f80-a365-8fc2f23f9482 req-2d29d73c-f591-453b-b000-182e09475f2d service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:34.210493 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-11612aa3-603f-4f80-a365-8fc2f23f9482 req-2d29d73c-f591-453b-b000-182e09475f2d service nova] Creating event network-vif-deleted:bdecb113-13e4-4aae-a58a-012ce7f0cf31 for instance 8346e5ae-6c1f-4ab8-9ebf-0bb59c802a8b on n-h2-861333-8 Oct 19 03:53:34.215844 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-11612aa3-603f-4f80-a365-8fc2f23f9482 req-2d29d73c-f591-453b-b000-182e09475f2d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030801 Oct 19 03:53:34.216463 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3274/6486] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:53:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:53:34.636150 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d9ded4f9-2482-40aa-b5b4-ce63d4c057fa tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:53:34.636758 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d9ded4f9-2482-40aa-b5b4-ce63d4c057fa tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] [instance: 8346e5ae-6c1f-4ab8-9ebf-0bb59c802a8b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:53:34.643856 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d9ded4f9-2482-40aa-b5b4-ce63d4c057fa tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:34.644853 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d9ded4f9-2482-40aa-b5b4-ce63d4c057fa tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:34.645305 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d9ded4f9-2482-40aa-b5b4-ce63d4c057fa tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:34.646017 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d9ded4f9-2482-40aa-b5b4-ce63d4c057fa tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:34.646465 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d9ded4f9-2482-40aa-b5b4-ce63d4c057fa tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:34.646905 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d9ded4f9-2482-40aa-b5b4-ce63d4c057fa tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:34.678575 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d9ded4f9-2482-40aa-b5b4-ce63d4c057fa tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:34.679064 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d9ded4f9-2482-40aa-b5b4-ce63d4c057fa tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:34.679500 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d9ded4f9-2482-40aa-b5b4-ce63d4c057fa tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:34.679945 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-d9ded4f9-2482-40aa-b5b4-ce63d4c057fa tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lazy-loading 'fault' on Instance uuid 8346e5ae-6c1f-4ab8-9ebf-0bb59c802a8b {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:53:34.726649 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d9ded4f9-2482-40aa-b5b4-ce63d4c057fa tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d8ec7142c79407b81108e90ce3657d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f4f31b5836f40e580c28153626ec6ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:53:34.734788 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d9ded4f9-2482-40aa-b5b4-ce63d4c057fa tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] 10.222.0.52 "GET /compute/v2.1/servers/8346e5ae-6c1f-4ab8-9ebf-0bb59c802a8b" status: 200 len: 1383 microversion: 2.1 time: 0.102557 Oct 19 03:53:34.735373 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3213/6487] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:53:34 2022] GET /compute/v2.1/servers/8346e5ae-6c1f-4ab8-9ebf-0bb59c802a8b => generated 1383 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:53:34.801423 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ffafa423-2222-44e1-b1af-fb3b6dfd7742 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:53:34.802136 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ffafa423-2222-44e1-b1af-fb3b6dfd7742 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] [instance: 70a4ad35-460a-46e6-8819-f73fb43cecaf] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:53:34.808335 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ffafa423-2222-44e1-b1af-fb3b6dfd7742 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:34.808819 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ffafa423-2222-44e1-b1af-fb3b6dfd7742 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:34.809258 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ffafa423-2222-44e1-b1af-fb3b6dfd7742 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:34.809971 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ffafa423-2222-44e1-b1af-fb3b6dfd7742 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:34.810586 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ffafa423-2222-44e1-b1af-fb3b6dfd7742 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:34.811108 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ffafa423-2222-44e1-b1af-fb3b6dfd7742 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:34.942373 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ffafa423-2222-44e1-b1af-fb3b6dfd7742 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518702207efb468a9dea88ad8ce1d557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ea53cc200c4428afb03a512f41bee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:53:34.948940 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ffafa423-2222-44e1-b1af-fb3b6dfd7742 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] 10.222.0.52 "GET /compute/v2.1/servers/70a4ad35-460a-46e6-8819-f73fb43cecaf" status: 200 len: 1503 microversion: 2.1 time: 0.151955 Oct 19 03:53:34.960189 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3275/6488] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:53:34 2022] GET /compute/v2.1/servers/70a4ad35-460a-46e6-8819-f73fb43cecaf => generated 1503 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:53:34.971451 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-edc25e7a-8d67-4a19-a209-80c1374f686a tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:53:34.971953 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-edc25e7a-8d67-4a19-a209-80c1374f686a tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] [instance: 70a4ad35-460a-46e6-8819-f73fb43cecaf] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:53:34.978069 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-edc25e7a-8d67-4a19-a209-80c1374f686a tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:34.978552 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-edc25e7a-8d67-4a19-a209-80c1374f686a tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:34.978993 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-edc25e7a-8d67-4a19-a209-80c1374f686a tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:34.979682 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-edc25e7a-8d67-4a19-a209-80c1374f686a tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:34.980134 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-edc25e7a-8d67-4a19-a209-80c1374f686a tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:34.980754 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-edc25e7a-8d67-4a19-a209-80c1374f686a tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:35.005432 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-edc25e7a-8d67-4a19-a209-80c1374f686a tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] [instance: 70a4ad35-460a-46e6-8819-f73fb43cecaf] Going to try to terminate instance {{(pid=121134) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:53:35.261102 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-edc25e7a-8d67-4a19-a209-80c1374f686a tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] 10.222.0.52 "DELETE /compute/v2.1/servers/70a4ad35-460a-46e6-8819-f73fb43cecaf" status: 204 len: 0 microversion: 2.1 time: 0.293134 Oct 19 03:53:35.261657 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3214/6489] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:53:34 2022] DELETE /compute/v2.1/servers/70a4ad35-460a-46e6-8819-f73fb43cecaf => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 19 03:53:35.270435 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-60c5eca5-bee3-448e-a071-9dc6b0a7e8ce tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:53:35.271057 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-60c5eca5-bee3-448e-a071-9dc6b0a7e8ce tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] [instance: 70a4ad35-460a-46e6-8819-f73fb43cecaf] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:53:35.278046 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-60c5eca5-bee3-448e-a071-9dc6b0a7e8ce tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:35.278521 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-60c5eca5-bee3-448e-a071-9dc6b0a7e8ce tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:35.278966 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-60c5eca5-bee3-448e-a071-9dc6b0a7e8ce tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:35.279664 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-60c5eca5-bee3-448e-a071-9dc6b0a7e8ce tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:35.280123 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-60c5eca5-bee3-448e-a071-9dc6b0a7e8ce tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:35.280555 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-60c5eca5-bee3-448e-a071-9dc6b0a7e8ce tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:35.414512 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-60c5eca5-bee3-448e-a071-9dc6b0a7e8ce tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518702207efb468a9dea88ad8ce1d557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ea53cc200c4428afb03a512f41bee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:53:35.422476 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-60c5eca5-bee3-448e-a071-9dc6b0a7e8ce tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] 10.222.0.52 "GET /compute/v2.1/servers/70a4ad35-460a-46e6-8819-f73fb43cecaf" status: 200 len: 1509 microversion: 2.1 time: 0.156284 Oct 19 03:53:35.423041 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3276/6490] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:53:35 2022] GET /compute/v2.1/servers/70a4ad35-460a-46e6-8819-f73fb43cecaf => generated 1509 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:53:35.758805 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9b95ff18-0372-4831-9ae9-2e2b66890feb tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:53:35.759512 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9b95ff18-0372-4831-9ae9-2e2b66890feb tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] [instance: 8346e5ae-6c1f-4ab8-9ebf-0bb59c802a8b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:53:35.766937 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9b95ff18-0372-4831-9ae9-2e2b66890feb tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:35.767417 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9b95ff18-0372-4831-9ae9-2e2b66890feb tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:35.767859 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9b95ff18-0372-4831-9ae9-2e2b66890feb tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:35.768565 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9b95ff18-0372-4831-9ae9-2e2b66890feb tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:35.769021 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9b95ff18-0372-4831-9ae9-2e2b66890feb tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:35.769476 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9b95ff18-0372-4831-9ae9-2e2b66890feb tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:35.783102 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-9b95ff18-0372-4831-9ae9-2e2b66890feb tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] HTTP exception thrown: Instance 8346e5ae-6c1f-4ab8-9ebf-0bb59c802a8b could not be found. Oct 19 03:53:35.784732 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9b95ff18-0372-4831-9ae9-2e2b66890feb tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Request method failure captured: Oct 19 03:53:35.784732 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/8346e5ae-6c1f-4ab8-9ebf-0bb59c802a8b HTTP/1.1 Oct 19 03:53:35.784732 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:53:35.784732 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:53:35.784732 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:53:35.784732 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:53:35.784732 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:53:35.784732 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:53:35.784732 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:53:35.784732 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:53:35.784732 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3RWwIx8SDdQdPERf4HTt_1GdIK8bPBKaXQb5e8PjM54MG4wLQnBeZL9E8w2iSF_IUdVweAi2CNvPy9JlvpD_viQ2Yf1Em4lFBWIciGIa8ABbe0wDDx0ZkpG_cxVuLaEG0eZEhP-u6I1ejtjBRAV2x3twh5Z8hWtZGP9JAleFx02_3s Oct 19 03:53:35.784732 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:53:35.784732 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:53:35.784732 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:53:35.784732 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:53:35.784732 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:53:35.784732 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:53:35.784732 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 6f4f31b5836f40e580c28153626ec6ce Oct 19 03:53:35.784732 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1659476090 Oct 19 03:53:35.784732 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:53:35.784732 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:53:35.784732 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6f4f31b5836f40e580c28153626ec6ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6f4f31b5836f40e580c28153626ec6ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6f4f31b5836f40e580c28153626ec6ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6f4f31b5836f40e580c28153626ec6ce", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:53:35.784732 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1659476090 Oct 19 03:53:35.784732 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 6f4f31b5836f40e580c28153626ec6ce Oct 19 03:53:35.784732 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1659476090 Oct 19 03:53:35.784732 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-TestSecurityGroupsBasicOps-1659476090-project Oct 19 03:53:35.784732 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:53:35.784732 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:53:35.784732 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 8d8ec7142c79407b81108e90ce3657d5 Oct 19 03:53:35.784732 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1659476090-project Oct 19 03:53:35.784732 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:53:35.784732 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance 8346e5ae-6c1f-4ab8-9ebf-0bb59c802a8b could not be found. Oct 19 03:53:35.784732 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '8346e5ae-6c1f-4ab8-9ebf-0bb59c802a8b'} Oct 19 03:53:35.784732 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:53:35.784732 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:53:35.784732 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:53:35.784732 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:53:35.784732 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:53:35.784732 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:53:35.784732 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:53:35.784732 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:53:35.784732 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:53:35.784732 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:53:35.784732 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8346e5ae-6c1f-4ab8-9ebf-0bb59c802a8b could not be found. Oct 19 03:53:35.784732 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:53:35.784732 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:53:35.784732 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:53:35.784732 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:53:35.784732 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:53:35.784732 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:53:35.784732 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:53:35.784732 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:53:35.784732 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:53:35.784732 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:53:35.784732 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:53:35.784732 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:53:35.784732 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:53:35.784732 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:53:35.784732 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:53:35.784732 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:53:35.784732 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8346e5ae-6c1f-4ab8-9ebf-0bb59c802a8b could not be found. Oct 19 03:53:35.784732 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:53:35.784732 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:53:35.789956 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:53:35.789956 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:53:35.789956 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:53:35.789956 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:53:35.789956 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:53:35.789956 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:53:35.789956 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8346e5ae-6c1f-4ab8-9ebf-0bb59c802a8b could not be found. Oct 19 03:53:35.789956 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:53:35.789956 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9b95ff18-0372-4831-9ae9-2e2b66890feb tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Returning 404 to user: Instance 8346e5ae-6c1f-4ab8-9ebf-0bb59c802a8b could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:53:35.789956 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9b95ff18-0372-4831-9ae9-2e2b66890feb tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] 10.222.0.52 "GET /compute/v2.1/servers/8346e5ae-6c1f-4ab8-9ebf-0bb59c802a8b" status: 404 len: 111 microversion: 2.1 time: 0.032140 Oct 19 03:53:35.789956 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3215/6491] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:53:35 2022] GET /compute/v2.1/servers/8346e5ae-6c1f-4ab8-9ebf-0bb59c802a8b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:53:36.446678 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ce57a503-2cb6-4940-bf40-d12f4454f064 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:53:36.447302 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ce57a503-2cb6-4940-bf40-d12f4454f064 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] [instance: 70a4ad35-460a-46e6-8819-f73fb43cecaf] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:53:36.454116 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ce57a503-2cb6-4940-bf40-d12f4454f064 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:36.454607 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ce57a503-2cb6-4940-bf40-d12f4454f064 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:36.455049 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ce57a503-2cb6-4940-bf40-d12f4454f064 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:36.455752 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ce57a503-2cb6-4940-bf40-d12f4454f064 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:36.456215 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ce57a503-2cb6-4940-bf40-d12f4454f064 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:36.456647 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ce57a503-2cb6-4940-bf40-d12f4454f064 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:36.587008 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ce57a503-2cb6-4940-bf40-d12f4454f064 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518702207efb468a9dea88ad8ce1d557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ea53cc200c4428afb03a512f41bee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:53:36.595138 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ce57a503-2cb6-4940-bf40-d12f4454f064 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] 10.222.0.52 "GET /compute/v2.1/servers/70a4ad35-460a-46e6-8819-f73fb43cecaf" status: 200 len: 1509 microversion: 2.1 time: 0.152274 Oct 19 03:53:36.595728 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3277/6492] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:53:36 2022] GET /compute/v2.1/servers/70a4ad35-460a-46e6-8819-f73fb43cecaf => generated 1509 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:53:37.621203 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6549f63c-71b5-4dc9-9f21-aefcf98f756e tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:53:37.623728 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6549f63c-71b5-4dc9-9f21-aefcf98f756e tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] [instance: 70a4ad35-460a-46e6-8819-f73fb43cecaf] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:53:37.648840 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:53:37.655773 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6549f63c-71b5-4dc9-9f21-aefcf98f756e tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:37.659664 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6549f63c-71b5-4dc9-9f21-aefcf98f756e tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:37.662490 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6549f63c-71b5-4dc9-9f21-aefcf98f756e tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:37.662921 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6549f63c-71b5-4dc9-9f21-aefcf98f756e tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:37.663727 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6549f63c-71b5-4dc9-9f21-aefcf98f756e tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:37.664350 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6549f63c-71b5-4dc9-9f21-aefcf98f756e tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:37.931392 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-e4ed369f-4a89-4c85-97c5-423ed9825a58 req-fa7bfe5b-8457-4b72-a707-8ec090175711 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70a4ad35-460a-46e6-8819-f73fb43cecaf", "name": "network-vif-deleted", "tag": "9c018691-b8d6-4230-874b-28c5f931ce00"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:53:37.935005 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-6549f63c-71b5-4dc9-9f21-aefcf98f756e tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518702207efb468a9dea88ad8ce1d557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ea53cc200c4428afb03a512f41bee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:53:37.951255 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6549f63c-71b5-4dc9-9f21-aefcf98f756e tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] 10.222.0.52 "GET /compute/v2.1/servers/70a4ad35-460a-46e6-8819-f73fb43cecaf" status: 200 len: 1509 microversion: 2.1 time: 0.334406 Oct 19 03:53:37.960997 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3216/6493] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:53:37 2022] GET /compute/v2.1/servers/70a4ad35-460a-46e6-8819-f73fb43cecaf => generated 1509 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:53:37.962608 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-e4ed369f-4a89-4c85-97c5-423ed9825a58 req-fa7bfe5b-8457-4b72-a707-8ec090175711 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:37.963322 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-e4ed369f-4a89-4c85-97c5-423ed9825a58 req-fa7bfe5b-8457-4b72-a707-8ec090175711 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:37.963771 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-e4ed369f-4a89-4c85-97c5-423ed9825a58 req-fa7bfe5b-8457-4b72-a707-8ec090175711 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:37.982072 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-e4ed369f-4a89-4c85-97c5-423ed9825a58 req-fa7bfe5b-8457-4b72-a707-8ec090175711 service nova] Creating event network-vif-deleted:9c018691-b8d6-4230-874b-28c5f931ce00 for instance 70a4ad35-460a-46e6-8819-f73fb43cecaf on n-h2-861333-8 Oct 19 03:53:37.988684 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-e4ed369f-4a89-4c85-97c5-423ed9825a58 req-fa7bfe5b-8457-4b72-a707-8ec090175711 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074214 Oct 19 03:53:37.993452 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3278/6494] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:53:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:53:38.996210 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-50403c1c-7beb-47cc-82d0-93fd00189c27 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:53:38.996210 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-50403c1c-7beb-47cc-82d0-93fd00189c27 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] [instance: 70a4ad35-460a-46e6-8819-f73fb43cecaf] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:53:38.996210 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-50403c1c-7beb-47cc-82d0-93fd00189c27 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:39.002449 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-50403c1c-7beb-47cc-82d0-93fd00189c27 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:39.003188 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-50403c1c-7beb-47cc-82d0-93fd00189c27 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:39.006289 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-50403c1c-7beb-47cc-82d0-93fd00189c27 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:39.008264 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-50403c1c-7beb-47cc-82d0-93fd00189c27 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:39.009403 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-50403c1c-7beb-47cc-82d0-93fd00189c27 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:39.059703 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-50403c1c-7beb-47cc-82d0-93fd00189c27 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:39.060198 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-50403c1c-7beb-47cc-82d0-93fd00189c27 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:39.060740 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-50403c1c-7beb-47cc-82d0-93fd00189c27 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:39.061301 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-50403c1c-7beb-47cc-82d0-93fd00189c27 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lazy-loading 'fault' on Instance uuid 70a4ad35-460a-46e6-8819-f73fb43cecaf {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:53:39.119575 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-50403c1c-7beb-47cc-82d0-93fd00189c27 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518702207efb468a9dea88ad8ce1d557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ea53cc200c4428afb03a512f41bee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:53:39.128146 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-50403c1c-7beb-47cc-82d0-93fd00189c27 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] 10.222.0.52 "GET /compute/v2.1/servers/70a4ad35-460a-46e6-8819-f73fb43cecaf" status: 200 len: 1305 microversion: 2.1 time: 0.148008 Oct 19 03:53:39.128758 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3217/6495] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:53:38 2022] GET /compute/v2.1/servers/70a4ad35-460a-46e6-8819-f73fb43cecaf => generated 1305 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:53:39.678748 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d7375df0-1233-4b91-ba4e-3cd4519a3bf8 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] Calling method '.version_select at 0x7fc1300473a0>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:53:39.788268 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d7375df0-1233-4b91-ba4e-3cd4519a3bf8 tempest-TestSecurityGroupsBasicOps-1659476090 tempest-TestSecurityGroupsBasicOps-1659476090-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-93452807" status: 202 len: 0 microversion: 2.1 time: 0.115275 Oct 19 03:53:39.788868 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3279/6496] 10.222.0.52 () {58 vars in 1272 bytes} [Wed Oct 19 03:53:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-93452807 => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 19 03:53:40.152726 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-748c0898-57a1-44ce-b0a7-6b46d9bd8bb9 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:53:40.153349 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-748c0898-57a1-44ce-b0a7-6b46d9bd8bb9 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] [instance: 70a4ad35-460a-46e6-8819-f73fb43cecaf] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:53:40.160849 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-748c0898-57a1-44ce-b0a7-6b46d9bd8bb9 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:40.161344 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-748c0898-57a1-44ce-b0a7-6b46d9bd8bb9 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:40.161810 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-748c0898-57a1-44ce-b0a7-6b46d9bd8bb9 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:40.162514 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-748c0898-57a1-44ce-b0a7-6b46d9bd8bb9 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:40.162971 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-748c0898-57a1-44ce-b0a7-6b46d9bd8bb9 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:40.163401 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-748c0898-57a1-44ce-b0a7-6b46d9bd8bb9 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:40.177655 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-748c0898-57a1-44ce-b0a7-6b46d9bd8bb9 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] HTTP exception thrown: Instance 70a4ad35-460a-46e6-8819-f73fb43cecaf could not be found. Oct 19 03:53:40.179228 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-748c0898-57a1-44ce-b0a7-6b46d9bd8bb9 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Request method failure captured: Oct 19 03:53:40.179228 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/70a4ad35-460a-46e6-8819-f73fb43cecaf HTTP/1.1 Oct 19 03:53:40.179228 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:53:40.179228 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:53:40.179228 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:53:40.179228 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:53:40.179228 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:53:40.179228 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:53:40.179228 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:53:40.179228 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:53:40.179228 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3SgzbidUPTcb_LE2TD88aMjB9gSjw0tYK2Q0yJm8JP55J-YgAGURRqx3-rEoih5EMowboBOpKDUHkLdRRn_8dt8kdsbsj3DsYrcNQJaJLy7_PSA_UsmyNeoFzFakPHFqw5F_GhL_NOb8KmC7-55W6Fh4IZiwrH9eTYRJT9xNeOMDuc Oct 19 03:53:40.179228 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:53:40.179228 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:53:40.179228 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:53:40.179228 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:53:40.179228 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:53:40.179228 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:53:40.179228 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 54ea53cc200c4428afb03a512f41bee4 Oct 19 03:53:40.179228 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-TestServerAdvancedOps-468220783 Oct 19 03:53:40.179228 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:53:40.179228 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:53:40.179228 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/54ea53cc200c4428afb03a512f41bee4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/54ea53cc200c4428afb03a512f41bee4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/54ea53cc200c4428afb03a512f41bee4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_54ea53cc200c4428afb03a512f41bee4", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:53:40.179228 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-TestServerAdvancedOps-468220783 Oct 19 03:53:40.179228 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 54ea53cc200c4428afb03a512f41bee4 Oct 19 03:53:40.179228 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-TestServerAdvancedOps-468220783 Oct 19 03:53:40.179228 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-TestServerAdvancedOps-468220783-project Oct 19 03:53:40.179228 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:53:40.179228 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:53:40.179228 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 518702207efb468a9dea88ad8ce1d557 Oct 19 03:53:40.179228 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-TestServerAdvancedOps-468220783-project Oct 19 03:53:40.179228 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:53:40.179228 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance 70a4ad35-460a-46e6-8819-f73fb43cecaf could not be found. Oct 19 03:53:40.179228 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '70a4ad35-460a-46e6-8819-f73fb43cecaf'} Oct 19 03:53:40.179228 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:53:40.179228 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:53:40.179228 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:53:40.179228 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:53:40.179228 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:53:40.179228 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:53:40.179228 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:53:40.179228 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:53:40.179228 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:53:40.179228 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:53:40.179228 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70a4ad35-460a-46e6-8819-f73fb43cecaf could not be found. Oct 19 03:53:40.179228 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:53:40.179228 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:53:40.179228 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:53:40.179228 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:53:40.179228 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:53:40.179228 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:53:40.179228 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:53:40.179228 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:53:40.179228 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:53:40.179228 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:53:40.179228 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:53:40.179228 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:53:40.179228 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:53:40.179228 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:53:40.179228 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:53:40.179228 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:53:40.179228 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70a4ad35-460a-46e6-8819-f73fb43cecaf could not be found. Oct 19 03:53:40.179228 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:53:40.179228 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:53:40.179228 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:53:40.183661 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:53:40.183661 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:53:40.183661 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:53:40.183661 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:53:40.183661 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:53:40.183661 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70a4ad35-460a-46e6-8819-f73fb43cecaf could not be found. Oct 19 03:53:40.183661 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:53:40.183661 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-748c0898-57a1-44ce-b0a7-6b46d9bd8bb9 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] Returning 404 to user: Instance 70a4ad35-460a-46e6-8819-f73fb43cecaf could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:53:40.183661 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-748c0898-57a1-44ce-b0a7-6b46d9bd8bb9 tempest-TestServerAdvancedOps-468220783 tempest-TestServerAdvancedOps-468220783-project] 10.222.0.52 "GET /compute/v2.1/servers/70a4ad35-460a-46e6-8819-f73fb43cecaf" status: 404 len: 111 microversion: 2.1 time: 0.032750 Oct 19 03:53:40.183661 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3218/6497] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:53:40 2022] GET /compute/v2.1/servers/70a4ad35-460a-46e6-8819-f73fb43cecaf => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:53:50.848241 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=33 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:53:50.850490 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:53:50.856140 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-8ee100c5-7f6b-455c-985d-959a43b615a9 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:53:50.859215 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-8ee100c5-7f6b-455c-985d-959a43b615a9 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 1eeec04f-d94e-4625-ab65-6d227a640f2f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:53:50.867084 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8ee100c5-7f6b-455c-985d-959a43b615a9 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:50.867689 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8ee100c5-7f6b-455c-985d-959a43b615a9 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:50.868513 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8ee100c5-7f6b-455c-985d-959a43b615a9 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:50.869250 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8ee100c5-7f6b-455c-985d-959a43b615a9 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:50.872115 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8ee100c5-7f6b-455c-985d-959a43b615a9 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:50.872904 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8ee100c5-7f6b-455c-985d-959a43b615a9 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:50.946797 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-8ee100c5-7f6b-455c-985d-959a43b615a9 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.101099 Oct 19 03:53:50.951632 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3280/6498] 10.222.0.52 () {60 vars in 1343 bytes} [Wed Oct 19 03:53:50 2022] GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f/os-volume_attachments => generated 25 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:53:51.089561 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4b8fc341-af6c-46e8-b13d-745340521188 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:53:51.090190 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4b8fc341-af6c-46e8-b13d-745340521188 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 1eeec04f-d94e-4625-ab65-6d227a640f2f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:53:51.105227 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=7 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:53:51.106717 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:53:51.109629 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4b8fc341-af6c-46e8-b13d-745340521188 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:51.114667 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4b8fc341-af6c-46e8-b13d-745340521188 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:51.114667 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4b8fc341-af6c-46e8-b13d-745340521188 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:51.118040 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4b8fc341-af6c-46e8-b13d-745340521188 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:51.120139 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4b8fc341-af6c-46e8-b13d-745340521188 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:51.120837 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4b8fc341-af6c-46e8-b13d-745340521188 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:51.197175 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4b8fc341-af6c-46e8-b13d-745340521188 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 1eeec04f-d94e-4625-ab65-6d227a640f2f] Going to try to terminate instance {{(pid=121134) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:53:51.651055 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4b8fc341-af6c-46e8-b13d-745340521188 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f" status: 204 len: 0 microversion: 2.20 time: 0.565420 Oct 19 03:53:51.652594 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3219/6499] 10.222.0.52 () {60 vars in 1280 bytes} [Wed Oct 19 03:53:51 2022] DELETE /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f => generated 0 bytes in 568 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 19 03:53:51.668584 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e8eb7757-e606-4359-9404-96ca5e69e5b1 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:53:51.669221 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e8eb7757-e606-4359-9404-96ca5e69e5b1 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 1eeec04f-d94e-4625-ab65-6d227a640f2f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:53:51.679256 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e8eb7757-e606-4359-9404-96ca5e69e5b1 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:51.683368 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e8eb7757-e606-4359-9404-96ca5e69e5b1 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:51.684375 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e8eb7757-e606-4359-9404-96ca5e69e5b1 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:51.685299 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e8eb7757-e606-4359-9404-96ca5e69e5b1 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:51.686009 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e8eb7757-e606-4359-9404-96ca5e69e5b1 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:51.692434 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e8eb7757-e606-4359-9404-96ca5e69e5b1 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:51.860503 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-e8eb7757-e606-4359-9404-96ca5e69e5b1 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:53:51.879629 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-e8eb7757-e606-4359-9404-96ca5e69e5b1 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:53:51.883501 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-e8eb7757-e606-4359-9404-96ca5e69e5b1 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:53:51.891275 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e8eb7757-e606-4359-9404-96ca5e69e5b1 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f" status: 200 len: 1723 microversion: 2.20 time: 0.233636 Oct 19 03:53:51.891985 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3281/6500] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:53:51 2022] GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f => generated 1723 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:53:52.920770 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e5a6e6f1-5783-4483-950a-95cb9c5192c4 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:53:52.921544 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e5a6e6f1-5783-4483-950a-95cb9c5192c4 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 1eeec04f-d94e-4625-ab65-6d227a640f2f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:53:52.937264 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e5a6e6f1-5783-4483-950a-95cb9c5192c4 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:52.937882 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e5a6e6f1-5783-4483-950a-95cb9c5192c4 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:52.939091 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e5a6e6f1-5783-4483-950a-95cb9c5192c4 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:52.940806 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e5a6e6f1-5783-4483-950a-95cb9c5192c4 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:52.942185 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e5a6e6f1-5783-4483-950a-95cb9c5192c4 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:52.942874 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e5a6e6f1-5783-4483-950a-95cb9c5192c4 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:53.203927 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e5a6e6f1-5783-4483-950a-95cb9c5192c4 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:53:53.213267 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e5a6e6f1-5783-4483-950a-95cb9c5192c4 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:53:53.215336 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e5a6e6f1-5783-4483-950a-95cb9c5192c4 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:53:53.220231 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e5a6e6f1-5783-4483-950a-95cb9c5192c4 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f" status: 200 len: 1723 microversion: 2.20 time: 0.304569 Oct 19 03:53:53.221258 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3220/6501] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:53:52 2022] GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f => generated 1723 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:53:54.251173 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-39d097f9-28e6-44ff-8efa-8454ff674190 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:53:54.252391 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-39d097f9-28e6-44ff-8efa-8454ff674190 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 1eeec04f-d94e-4625-ab65-6d227a640f2f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:53:54.260876 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-39d097f9-28e6-44ff-8efa-8454ff674190 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:54.261415 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-39d097f9-28e6-44ff-8efa-8454ff674190 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:54.261946 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-39d097f9-28e6-44ff-8efa-8454ff674190 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:54.262650 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-39d097f9-28e6-44ff-8efa-8454ff674190 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:54.263272 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-39d097f9-28e6-44ff-8efa-8454ff674190 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:54.263705 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-39d097f9-28e6-44ff-8efa-8454ff674190 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:54.648874 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-39d097f9-28e6-44ff-8efa-8454ff674190 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:53:54.668366 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-39d097f9-28e6-44ff-8efa-8454ff674190 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:53:54.690733 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-39d097f9-28e6-44ff-8efa-8454ff674190 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:53:54.694245 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-39d097f9-28e6-44ff-8efa-8454ff674190 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f" status: 200 len: 1723 microversion: 2.20 time: 0.447150 Oct 19 03:53:54.705011 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3282/6502] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:53:54 2022] GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f => generated 1723 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:53:55.509208 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-0b530344-6168-4ddd-8463-42c27cb110a0 req-4325897a-19c6-4f73-bf44-5943a8375a15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1eeec04f-d94e-4625-ab65-6d227a640f2f", "name": "network-vif-deleted", "tag": "9487bc37-2fe4-4fbc-914a-50a09e00b655"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:53:55.543328 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-0b530344-6168-4ddd-8463-42c27cb110a0 req-4325897a-19c6-4f73-bf44-5943a8375a15 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:55.544084 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-0b530344-6168-4ddd-8463-42c27cb110a0 req-4325897a-19c6-4f73-bf44-5943a8375a15 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:55.544682 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-0b530344-6168-4ddd-8463-42c27cb110a0 req-4325897a-19c6-4f73-bf44-5943a8375a15 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:55.593648 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-0b530344-6168-4ddd-8463-42c27cb110a0 req-4325897a-19c6-4f73-bf44-5943a8375a15 service nova] Creating event network-vif-deleted:9487bc37-2fe4-4fbc-914a-50a09e00b655 for instance 1eeec04f-d94e-4625-ab65-6d227a640f2f on n-h1-861333-8 Oct 19 03:53:55.601963 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-0b530344-6168-4ddd-8463-42c27cb110a0 req-4325897a-19c6-4f73-bf44-5943a8375a15 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096368 Oct 19 03:53:55.603122 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3221/6503] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:53:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:53:55.724062 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9c372509-a706-49c6-9b4b-85370936fea1 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:53:55.724867 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9c372509-a706-49c6-9b4b-85370936fea1 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 1eeec04f-d94e-4625-ab65-6d227a640f2f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:53:55.757695 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9c372509-a706-49c6-9b4b-85370936fea1 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:55.758532 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9c372509-a706-49c6-9b4b-85370936fea1 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:55.761827 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9c372509-a706-49c6-9b4b-85370936fea1 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:55.762531 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9c372509-a706-49c6-9b4b-85370936fea1 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:55.765707 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9c372509-a706-49c6-9b4b-85370936fea1 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:55.766277 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9c372509-a706-49c6-9b4b-85370936fea1 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:55.951676 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-9c372509-a706-49c6-9b4b-85370936fea1 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:53:55.966821 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-9c372509-a706-49c6-9b4b-85370936fea1 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:53:55.979358 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-9c372509-a706-49c6-9b4b-85370936fea1 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:53:55.980732 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9c372509-a706-49c6-9b4b-85370936fea1 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f" status: 200 len: 1366 microversion: 2.20 time: 0.261233 Oct 19 03:53:55.981480 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3283/6504] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:53:55 2022] GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f => generated 1366 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 03:53:57.011947 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-461e769b-2790-4be6-81d6-a13c065d8730 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:53:57.013736 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-461e769b-2790-4be6-81d6-a13c065d8730 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 1eeec04f-d94e-4625-ab65-6d227a640f2f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:53:57.028831 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-461e769b-2790-4be6-81d6-a13c065d8730 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:57.029647 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-461e769b-2790-4be6-81d6-a13c065d8730 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:57.030377 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-461e769b-2790-4be6-81d6-a13c065d8730 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:57.031295 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-461e769b-2790-4be6-81d6-a13c065d8730 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:57.031998 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-461e769b-2790-4be6-81d6-a13c065d8730 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:57.032608 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-461e769b-2790-4be6-81d6-a13c065d8730 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:57.084025 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-461e769b-2790-4be6-81d6-a13c065d8730 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:57.085088 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-461e769b-2790-4be6-81d6-a13c065d8730 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:57.085763 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-461e769b-2790-4be6-81d6-a13c065d8730 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:57.086442 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-461e769b-2790-4be6-81d6-a13c065d8730 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lazy-loading 'fault' on Instance uuid 1eeec04f-d94e-4625-ab65-6d227a640f2f {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:53:57.145007 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-461e769b-2790-4be6-81d6-a13c065d8730 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:53:57.161199 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-461e769b-2790-4be6-81d6-a13c065d8730 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:53:57.162869 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-461e769b-2790-4be6-81d6-a13c065d8730 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43f8869bb2c44a1f814d5da9e5d1a39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dfa644c780498a9d9ab24938903dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:53:57.164298 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-461e769b-2790-4be6-81d6-a13c065d8730 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f" status: 200 len: 1371 microversion: 2.20 time: 0.157509 Oct 19 03:53:57.165504 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3222/6505] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:53:57 2022] GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f => generated 1371 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 03:53:57.877494 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-863a11f7-bf3b-43e4-b61d-a27db0d9049e tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:53:57.879995 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-863a11f7-bf3b-43e4-b61d-a27db0d9049e tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: 2b57ed72-0e3a-43c8-b552-875524942849] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:53:57.891959 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-863a11f7-bf3b-43e4-b61d-a27db0d9049e tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:57.893459 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-863a11f7-bf3b-43e4-b61d-a27db0d9049e tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:57.898223 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-863a11f7-bf3b-43e4-b61d-a27db0d9049e tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:57.899610 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-863a11f7-bf3b-43e4-b61d-a27db0d9049e tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:57.900284 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-863a11f7-bf3b-43e4-b61d-a27db0d9049e tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:57.902964 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-863a11f7-bf3b-43e4-b61d-a27db0d9049e tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:57.997137 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-863a11f7-bf3b-43e4-b61d-a27db0d9049e tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "POST /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849/action" status: 200 len: 62911 microversion: 2.1 time: 0.124277 Oct 19 03:53:57.997921 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3284/6506] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:53:57 2022] POST /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849/action => generated 62911 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 03:53:58.192229 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0b9d319d-eb1d-4428-a5f0-e05479255861 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:53:58.192836 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0b9d319d-eb1d-4428-a5f0-e05479255861 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 1eeec04f-d94e-4625-ab65-6d227a640f2f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:53:58.199479 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0b9d319d-eb1d-4428-a5f0-e05479255861 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:58.199964 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0b9d319d-eb1d-4428-a5f0-e05479255861 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:58.200588 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0b9d319d-eb1d-4428-a5f0-e05479255861 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:58.201306 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0b9d319d-eb1d-4428-a5f0-e05479255861 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:53:58.201842 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0b9d319d-eb1d-4428-a5f0-e05479255861 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:53:58.202263 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0b9d319d-eb1d-4428-a5f0-e05479255861 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:53:58.216638 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-0b9d319d-eb1d-4428-a5f0-e05479255861 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] HTTP exception thrown: Instance 1eeec04f-d94e-4625-ab65-6d227a640f2f could not be found. Oct 19 03:53:58.218613 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0b9d319d-eb1d-4428-a5f0-e05479255861 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Request method failure captured: Oct 19 03:53:58.218613 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f HTTP/1.1 Oct 19 03:53:58.218613 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:53:58.218613 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:53:58.218613 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:53:58.218613 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:53:58.218613 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:53:58.218613 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:53:58.218613 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:53:58.218613 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:53:58.218613 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3Mj8Y9XZUqdAO7It2_JZfeGIxD8aLHMiOWUFfIXg2mA6_dl2bPpa0kOk0am9pPXP4oh6B6udK76F-90kFvdD17QuGVLTMnqVb2EpkTkWoVzrcHTsYKtJfL-nQKy4vPS1m2xj0L66liLV8wFyDhJKV4T3C-Uqz51OaZp5zeh1hnRxQY Oct 19 03:53:58.218613 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:53:58.218613 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:53:58.218613 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:53:58.218613 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:53:58.218613 n-d-861333-8 devstack@n-api.service[121134]: X-Openstack-Nova-Api-Version: 2.20 Oct 19 03:53:58.218613 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:53:58.218613 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:53:58.218613 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: c2dfa644c780498a9d9ab24938903dd7 Oct 19 03:53:58.218613 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1060931270 Oct 19 03:53:58.218613 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:53:58.218613 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:53:58.218613 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c2dfa644c780498a9d9ab24938903dd7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c2dfa644c780498a9d9ab24938903dd7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c2dfa644c780498a9d9ab24938903dd7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c2dfa644c780498a9d9ab24938903dd7", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:53:58.218613 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1060931270 Oct 19 03:53:58.218613 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: c2dfa644c780498a9d9ab24938903dd7 Oct 19 03:53:58.218613 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1060931270 Oct 19 03:53:58.218613 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-AttachVolumeShelveTestJSON-1060931270-project Oct 19 03:53:58.218613 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:53:58.218613 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:53:58.218613 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 43f8869bb2c44a1f814d5da9e5d1a39d Oct 19 03:53:58.218613 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1060931270-project Oct 19 03:53:58.218613 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:53:58.218613 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance 1eeec04f-d94e-4625-ab65-6d227a640f2f could not be found. Oct 19 03:53:58.218613 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '1eeec04f-d94e-4625-ab65-6d227a640f2f'} Oct 19 03:53:58.218613 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:53:58.218613 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:53:58.218613 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:53:58.218613 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:53:58.218613 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:53:58.218613 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:53:58.218613 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:53:58.218613 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:53:58.218613 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:53:58.218613 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:53:58.218613 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1eeec04f-d94e-4625-ab65-6d227a640f2f could not be found. Oct 19 03:53:58.218613 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:53:58.218613 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:53:58.218613 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:53:58.218613 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:53:58.218613 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:53:58.218613 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:53:58.218613 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:53:58.218613 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:53:58.218613 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:53:58.218613 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:53:58.218613 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:53:58.218613 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:53:58.218613 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:53:58.218613 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:53:58.218613 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:53:58.218613 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:53:58.218613 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1eeec04f-d94e-4625-ab65-6d227a640f2f could not be found. Oct 19 03:53:58.218613 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:53:58.218613 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:53:58.222752 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:53:58.222752 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:53:58.222752 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:53:58.222752 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:53:58.222752 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:53:58.222752 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:53:58.222752 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1eeec04f-d94e-4625-ab65-6d227a640f2f could not be found. Oct 19 03:53:58.222752 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:53:58.224621 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0b9d319d-eb1d-4428-a5f0-e05479255861 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Returning 404 to user: Instance 1eeec04f-d94e-4625-ab65-6d227a640f2f could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:53:58.225439 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0b9d319d-eb1d-4428-a5f0-e05479255861 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f" status: 404 len: 111 microversion: 2.20 time: 0.037652 Oct 19 03:53:58.226006 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3223/6507] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:53:58 2022] GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 19 03:53:58.240503 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ba373534-377b-42f2-a4fb-346dcd8b9631 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '.version_select at 0x7fc13008f5e0>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:53:58.377953 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ba373534-377b-42f2-a4fb-346dcd8b9631 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1155833408" status: 204 len: 0 microversion: 2.20 time: 0.143770 Oct 19 03:53:58.377953 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3285/6508] 10.222.0.52 () {60 vars in 1262 bytes} [Wed Oct 19 03:53:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1155833408 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 19 03:54:01.840977 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5dab2d73-d5e0-40c9-8e88-13f78400d2ab tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:54:01.847830 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5dab2d73-d5e0-40c9-8e88-13f78400d2ab tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:01.848619 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5dab2d73-d5e0-40c9-8e88-13f78400d2ab tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:01.849269 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5dab2d73-d5e0-40c9-8e88-13f78400d2ab tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:01.850274 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5dab2d73-d5e0-40c9-8e88-13f78400d2ab tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:01.850935 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5dab2d73-d5e0-40c9-8e88-13f78400d2ab tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:01.851587 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5dab2d73-d5e0-40c9-8e88-13f78400d2ab tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:01.893519 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5dab2d73-d5e0-40c9-8e88-13f78400d2ab tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] 10.222.0.52 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.213269 Oct 19 03:54:01.894386 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3224/6509] 10.222.0.52 () {58 vars in 1185 bytes} [Wed Oct 19 03:54:01 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:54:02.021148 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-45adf5cd-0493-4d9e-aa10-9a3cdca8b302 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-559870472", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "availability_zone": "nova:n-h2-861333-8", "networks": [{"uuid": "0d16df5b-ad46-4b24-a231-4399fdb879ac"}]}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:54:02.095964 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.network.neutron [None req-45adf5cd-0493-4d9e-aa10-9a3cdca8b302 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] validate_networks() for [('0d16df5b-ad46-4b24-a231-4399fdb879ac', None, None, None, None, None)] {{(pid=121135) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:54:02.835682 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-45adf5cd-0493-4d9e-aa10-9a3cdca8b302 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Flavor limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:54:02.836885 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-45adf5cd-0493-4d9e-aa10-9a3cdca8b302 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Image limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:54:02.839306 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-45adf5cd-0493-4d9e-aa10-9a3cdca8b302 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Flavor pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:54:02.839753 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-45adf5cd-0493-4d9e-aa10-9a3cdca8b302 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Image pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:54:02.840676 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-45adf5cd-0493-4d9e-aa10-9a3cdca8b302 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:54:02.856622 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-45adf5cd-0493-4d9e-aa10-9a3cdca8b302 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:02.857436 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-45adf5cd-0493-4d9e-aa10-9a3cdca8b302 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:02.858351 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-45adf5cd-0493-4d9e-aa10-9a3cdca8b302 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:02.859562 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-45adf5cd-0493-4d9e-aa10-9a3cdca8b302 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:02.867789 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-45adf5cd-0493-4d9e-aa10-9a3cdca8b302 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:02.867789 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-45adf5cd-0493-4d9e-aa10-9a3cdca8b302 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:02.885759 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-45adf5cd-0493-4d9e-aa10-9a3cdca8b302 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Getting quotas for project 7f4b24b82352419b9bd2a6cb8e92c7e5. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:54:02.892390 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-45adf5cd-0493-4d9e-aa10-9a3cdca8b302 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Getting quotas for user 6e26061ac02e43d3a6908e385976332e and project 7f4b24b82352419b9bd2a6cb8e92c7e5. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:54:02.909332 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-45adf5cd-0493-4d9e-aa10-9a3cdca8b302 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Going to run 1 instances... {{(pid=121135) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:54:02.911950 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-45adf5cd-0493-4d9e-aa10-9a3cdca8b302 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] [instance: 2ba616b3-3dae-4176-a55c-39a41bee6cc1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121135) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:54:03.067794 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-45adf5cd-0493-4d9e-aa10-9a3cdca8b302 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.052006 Oct 19 03:54:03.072083 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3286/6510] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:54:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1053 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 03:54:03.080068 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6e5a05b7-bf61-4ad6-a5e5-238704ec8a98 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:54:03.080718 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6e5a05b7-bf61-4ad6-a5e5-238704ec8a98 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] [instance: 2ba616b3-3dae-4176-a55c-39a41bee6cc1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:54:03.164551 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6e5a05b7-bf61-4ad6-a5e5-238704ec8a98 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/2ba616b3-3dae-4176-a55c-39a41bee6cc1" status: 200 len: 1328 microversion: 2.1 time: 0.088503 Oct 19 03:54:03.169813 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3225/6511] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:54:03 2022] GET /compute/v2.1/servers/2ba616b3-3dae-4176-a55c-39a41bee6cc1 => generated 1328 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:54:03.757905 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4c570eb5-413c-46aa-8cec-687d4edcab1c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:54:03.758708 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4c570eb5-413c-46aa-8cec-687d4edcab1c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 1eeec04f-d94e-4625-ab65-6d227a640f2f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:54:03.793735 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4c570eb5-413c-46aa-8cec-687d4edcab1c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:03.800046 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4c570eb5-413c-46aa-8cec-687d4edcab1c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:03.800788 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4c570eb5-413c-46aa-8cec-687d4edcab1c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:03.802002 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4c570eb5-413c-46aa-8cec-687d4edcab1c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:03.802224 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4c570eb5-413c-46aa-8cec-687d4edcab1c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:03.802748 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4c570eb5-413c-46aa-8cec-687d4edcab1c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:03.826376 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-4c570eb5-413c-46aa-8cec-687d4edcab1c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] HTTP exception thrown: Instance 1eeec04f-d94e-4625-ab65-6d227a640f2f could not be found. Oct 19 03:54:03.828765 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4c570eb5-413c-46aa-8cec-687d4edcab1c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Request method failure captured: Oct 19 03:54:03.828765 n-d-861333-8 devstack@n-api.service[121135]: request: DELETE /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f HTTP/1.1 Oct 19 03:54:03.828765 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:54:03.828765 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:54:03.828765 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:54:03.828765 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:54:03.828765 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:54:03.828765 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:54:03.828765 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:54:03.828765 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:54:03.828765 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT3Mj8Y9XZUqdAO7It2_JZfeGIxD8aLHMiOWUFfIXg2mA6_dl2bPpa0kOk0am9pPXP4oh6B6udK76F-90kFvdD17QuGVLTMnqVb2EpkTkWoVzrcHTsYKtJfL-nQKy4vPS1m2xj0L66liLV8wFyDhJKV4T3C-Uqz51OaZp5zeh1hnRxQY Oct 19 03:54:03.828765 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:54:03.828765 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:54:03.828765 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:54:03.828765 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:54:03.828765 n-d-861333-8 devstack@n-api.service[121135]: X-Openstack-Nova-Api-Version: 2.20 Oct 19 03:54:03.828765 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:54:03.828765 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:54:03.828765 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: c2dfa644c780498a9d9ab24938903dd7 Oct 19 03:54:03.828765 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1060931270 Oct 19 03:54:03.828765 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:54:03.828765 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:54:03.828765 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c2dfa644c780498a9d9ab24938903dd7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c2dfa644c780498a9d9ab24938903dd7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c2dfa644c780498a9d9ab24938903dd7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c2dfa644c780498a9d9ab24938903dd7", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:54:03.828765 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1060931270 Oct 19 03:54:03.828765 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: c2dfa644c780498a9d9ab24938903dd7 Oct 19 03:54:03.828765 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1060931270 Oct 19 03:54:03.828765 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-AttachVolumeShelveTestJSON-1060931270-project Oct 19 03:54:03.828765 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:54:03.828765 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:54:03.828765 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 43f8869bb2c44a1f814d5da9e5d1a39d Oct 19 03:54:03.828765 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1060931270-project Oct 19 03:54:03.828765 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:54:03.828765 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance 1eeec04f-d94e-4625-ab65-6d227a640f2f could not be found. Oct 19 03:54:03.828765 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '1eeec04f-d94e-4625-ab65-6d227a640f2f'} Oct 19 03:54:03.828765 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:54:03.828765 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:54:03.828765 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:54:03.828765 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:54:03.828765 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:54:03.828765 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:54:03.828765 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:54:03.828765 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:54:03.828765 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:54:03.828765 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:54:03.828765 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1eeec04f-d94e-4625-ab65-6d227a640f2f could not be found. Oct 19 03:54:03.828765 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:54:03.828765 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:54:03.828765 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:54:03.828765 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:54:03.828765 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:54:03.828765 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:54:03.828765 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:54:03.828765 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:54:03.828765 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:54:03.828765 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:54:03.828765 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 03:54:03.828765 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 03:54:03.828765 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 03:54:03.828765 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 03:54:03.828765 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:54:03.828765 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:54:03.828765 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:54:03.828765 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:54:03.833116 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1eeec04f-d94e-4625-ab65-6d227a640f2f could not be found. Oct 19 03:54:03.833116 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:54:03.833116 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:54:03.833116 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:54:03.833116 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:54:03.833116 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:54:03.833116 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:54:03.833116 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:54:03.833116 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:54:03.833116 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1eeec04f-d94e-4625-ab65-6d227a640f2f could not be found. Oct 19 03:54:03.833116 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:54:03.833116 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4c570eb5-413c-46aa-8cec-687d4edcab1c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Returning 404 to user: Instance 1eeec04f-d94e-4625-ab65-6d227a640f2f could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:54:03.833116 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4c570eb5-413c-46aa-8cec-687d4edcab1c tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f" status: 404 len: 111 microversion: 2.20 time: 0.076482 Oct 19 03:54:03.833116 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3287/6512] 10.222.0.52 () {60 vars in 1280 bytes} [Wed Oct 19 03:54:03 2022] DELETE /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 19 03:54:03.840140 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-51ea1b2c-3d0b-4936-9ce2-e696c8e724a6 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:54:03.840759 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-51ea1b2c-3d0b-4936-9ce2-e696c8e724a6 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 1eeec04f-d94e-4625-ab65-6d227a640f2f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:54:03.848892 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-51ea1b2c-3d0b-4936-9ce2-e696c8e724a6 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:03.849467 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-51ea1b2c-3d0b-4936-9ce2-e696c8e724a6 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:03.849941 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-51ea1b2c-3d0b-4936-9ce2-e696c8e724a6 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:03.850657 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-51ea1b2c-3d0b-4936-9ce2-e696c8e724a6 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:03.851118 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-51ea1b2c-3d0b-4936-9ce2-e696c8e724a6 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:03.851552 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-51ea1b2c-3d0b-4936-9ce2-e696c8e724a6 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:03.866888 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-51ea1b2c-3d0b-4936-9ce2-e696c8e724a6 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] HTTP exception thrown: Instance 1eeec04f-d94e-4625-ab65-6d227a640f2f could not be found. Oct 19 03:54:03.868531 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-51ea1b2c-3d0b-4936-9ce2-e696c8e724a6 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Request method failure captured: Oct 19 03:54:03.868531 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f HTTP/1.1 Oct 19 03:54:03.868531 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:54:03.868531 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:54:03.868531 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:54:03.868531 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:54:03.868531 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:54:03.868531 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:54:03.868531 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:54:03.868531 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:54:03.868531 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3Mj8Y9XZUqdAO7It2_JZfeGIxD8aLHMiOWUFfIXg2mA6_dl2bPpa0kOk0am9pPXP4oh6B6udK76F-90kFvdD17QuGVLTMnqVb2EpkTkWoVzrcHTsYKtJfL-nQKy4vPS1m2xj0L66liLV8wFyDhJKV4T3C-Uqz51OaZp5zeh1hnRxQY Oct 19 03:54:03.868531 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:54:03.868531 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:54:03.868531 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:54:03.868531 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:54:03.868531 n-d-861333-8 devstack@n-api.service[121134]: X-Openstack-Nova-Api-Version: 2.20 Oct 19 03:54:03.868531 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:54:03.868531 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:54:03.868531 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: c2dfa644c780498a9d9ab24938903dd7 Oct 19 03:54:03.868531 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1060931270 Oct 19 03:54:03.868531 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:54:03.868531 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:54:03.868531 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c2dfa644c780498a9d9ab24938903dd7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c2dfa644c780498a9d9ab24938903dd7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c2dfa644c780498a9d9ab24938903dd7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c2dfa644c780498a9d9ab24938903dd7", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:54:03.868531 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1060931270 Oct 19 03:54:03.868531 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: c2dfa644c780498a9d9ab24938903dd7 Oct 19 03:54:03.868531 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1060931270 Oct 19 03:54:03.868531 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-AttachVolumeShelveTestJSON-1060931270-project Oct 19 03:54:03.868531 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:54:03.868531 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:54:03.868531 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 43f8869bb2c44a1f814d5da9e5d1a39d Oct 19 03:54:03.868531 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1060931270-project Oct 19 03:54:03.868531 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:54:03.868531 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance 1eeec04f-d94e-4625-ab65-6d227a640f2f could not be found. Oct 19 03:54:03.868531 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '1eeec04f-d94e-4625-ab65-6d227a640f2f'} Oct 19 03:54:03.868531 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:54:03.868531 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:54:03.868531 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:54:03.868531 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:54:03.868531 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:54:03.868531 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:54:03.868531 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:54:03.868531 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:54:03.868531 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:54:03.868531 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:54:03.868531 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1eeec04f-d94e-4625-ab65-6d227a640f2f could not be found. Oct 19 03:54:03.868531 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:54:03.868531 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:54:03.868531 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:54:03.868531 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:54:03.868531 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:54:03.868531 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:54:03.868531 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:54:03.868531 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:54:03.868531 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:54:03.868531 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:54:03.868531 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:54:03.868531 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:54:03.868531 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:54:03.868531 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:54:03.868531 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:54:03.868531 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:54:03.868531 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1eeec04f-d94e-4625-ab65-6d227a640f2f could not be found. Oct 19 03:54:03.868531 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:54:03.868531 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:54:03.874165 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:54:03.874165 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:54:03.874165 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:54:03.874165 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:54:03.874165 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:54:03.874165 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:54:03.874165 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1eeec04f-d94e-4625-ab65-6d227a640f2f could not be found. Oct 19 03:54:03.874165 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:54:03.874165 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-51ea1b2c-3d0b-4936-9ce2-e696c8e724a6 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Returning 404 to user: Instance 1eeec04f-d94e-4625-ab65-6d227a640f2f could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:54:03.874165 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-51ea1b2c-3d0b-4936-9ce2-e696c8e724a6 tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f" status: 404 len: 111 microversion: 2.20 time: 0.034017 Oct 19 03:54:03.874165 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3226/6513] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:54:03 2022] GET /compute/v2.1/servers/1eeec04f-d94e-4625-ab65-6d227a640f2f => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 19 03:54:04.190699 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-83e85eb0-5303-47e5-868b-ce96a2f123e3 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:54:04.191837 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-83e85eb0-5303-47e5-868b-ce96a2f123e3 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] [instance: 2ba616b3-3dae-4176-a55c-39a41bee6cc1] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:54:04.279562 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-83e85eb0-5303-47e5-868b-ce96a2f123e3 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/2ba616b3-3dae-4176-a55c-39a41bee6cc1" status: 200 len: 1328 microversion: 2.1 time: 0.092416 Oct 19 03:54:04.280679 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3288/6514] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:54:04 2022] GET /compute/v2.1/servers/2ba616b3-3dae-4176-a55c-39a41bee6cc1 => generated 1328 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:54:05.302486 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-55e7dcf9-95db-4ac1-983c-b46b78811322 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:54:05.303296 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-55e7dcf9-95db-4ac1-983c-b46b78811322 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] [instance: 2ba616b3-3dae-4176-a55c-39a41bee6cc1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:54:05.315352 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-55e7dcf9-95db-4ac1-983c-b46b78811322 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:05.318028 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-55e7dcf9-95db-4ac1-983c-b46b78811322 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:05.318500 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-55e7dcf9-95db-4ac1-983c-b46b78811322 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:05.319231 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-55e7dcf9-95db-4ac1-983c-b46b78811322 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:05.319689 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-55e7dcf9-95db-4ac1-983c-b46b78811322 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:05.320479 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-55e7dcf9-95db-4ac1-983c-b46b78811322 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:05.504270 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-55e7dcf9-95db-4ac1-983c-b46b78811322 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/2ba616b3-3dae-4176-a55c-39a41bee6cc1" status: 200 len: 1337 microversion: 2.1 time: 0.184553 Oct 19 03:54:05.506951 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3227/6515] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:54:05 2022] GET /compute/v2.1/servers/2ba616b3-3dae-4176-a55c-39a41bee6cc1 => generated 1337 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:54:06.529495 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-69e98a8b-8da1-4b8f-9cb0-c37d15944046 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:54:06.530989 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-69e98a8b-8da1-4b8f-9cb0-c37d15944046 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] [instance: 2ba616b3-3dae-4176-a55c-39a41bee6cc1] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:54:06.540526 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-69e98a8b-8da1-4b8f-9cb0-c37d15944046 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:06.540846 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-69e98a8b-8da1-4b8f-9cb0-c37d15944046 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:06.541789 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-69e98a8b-8da1-4b8f-9cb0-c37d15944046 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:06.542694 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-69e98a8b-8da1-4b8f-9cb0-c37d15944046 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:06.543325 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-69e98a8b-8da1-4b8f-9cb0-c37d15944046 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:06.543930 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-69e98a8b-8da1-4b8f-9cb0-c37d15944046 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:07.131010 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-69e98a8b-8da1-4b8f-9cb0-c37d15944046 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/2ba616b3-3dae-4176-a55c-39a41bee6cc1" status: 200 len: 1415 microversion: 2.1 time: 0.605106 Oct 19 03:54:07.132176 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3289/6516] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:54:06 2022] GET /compute/v2.1/servers/2ba616b3-3dae-4176-a55c-39a41bee6cc1 => generated 1415 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:54:08.158716 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-396f3cfc-4798-4948-90e6-c115cac6289e tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:54:08.160335 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-396f3cfc-4798-4948-90e6-c115cac6289e tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] [instance: 2ba616b3-3dae-4176-a55c-39a41bee6cc1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:54:08.166499 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-396f3cfc-4798-4948-90e6-c115cac6289e tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:08.167227 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-396f3cfc-4798-4948-90e6-c115cac6289e tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:08.167847 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-396f3cfc-4798-4948-90e6-c115cac6289e tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:08.168909 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-396f3cfc-4798-4948-90e6-c115cac6289e tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:08.169567 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-396f3cfc-4798-4948-90e6-c115cac6289e tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:08.170162 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-396f3cfc-4798-4948-90e6-c115cac6289e tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:08.472512 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-396f3cfc-4798-4948-90e6-c115cac6289e tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/2ba616b3-3dae-4176-a55c-39a41bee6cc1" status: 200 len: 1463 microversion: 2.1 time: 0.316462 Oct 19 03:54:08.474959 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3228/6517] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:54:08 2022] GET /compute/v2.1/servers/2ba616b3-3dae-4176-a55c-39a41bee6cc1 => generated 1463 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:54:08.866513 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-bf95ace2-7192-4876-ba77-be743795d73d tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:54:08.867733 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-bf95ace2-7192-4876-ba77-be743795d73d tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 89f2e52f-afcb-49bf-a39a-4b442a96eba8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:54:08.889503 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bf95ace2-7192-4876-ba77-be743795d73d tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:08.890268 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bf95ace2-7192-4876-ba77-be743795d73d tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:08.896384 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bf95ace2-7192-4876-ba77-be743795d73d tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:08.896384 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bf95ace2-7192-4876-ba77-be743795d73d tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:08.896384 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bf95ace2-7192-4876-ba77-be743795d73d tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:08.896384 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bf95ace2-7192-4876-ba77-be743795d73d tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:08.931407 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-bf95ace2-7192-4876-ba77-be743795d73d tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] HTTP exception thrown: Instance 89f2e52f-afcb-49bf-a39a-4b442a96eba8 could not be found. Oct 19 03:54:08.935438 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-bf95ace2-7192-4876-ba77-be743795d73d tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Request method failure captured: Oct 19 03:54:08.935438 n-d-861333-8 devstack@n-api.service[121135]: request: DELETE /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8 HTTP/1.1 Oct 19 03:54:08.935438 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:54:08.935438 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:54:08.935438 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:54:08.935438 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:54:08.935438 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:54:08.935438 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:54:08.935438 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:54:08.935438 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:54:08.935438 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT3Mj8Y9XZUqdAO7It2_JZfeGIxD8aLHMiOWUFfIXg2mA6_dl2bPpa0kOk0am9pPXP4oh6B6udK76F-90kFvdD17QuGVLTMnqVb2EpkTkWoVzrcHTsYKtJfL-nQKy4vPS1m2xj0L66liLV8wFyDhJKV4T3C-Uqz51OaZp5zeh1hnRxQY Oct 19 03:54:08.935438 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:54:08.935438 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:54:08.935438 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:54:08.935438 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:54:08.935438 n-d-861333-8 devstack@n-api.service[121135]: X-Openstack-Nova-Api-Version: 2.20 Oct 19 03:54:08.935438 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:54:08.935438 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:54:08.935438 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: c2dfa644c780498a9d9ab24938903dd7 Oct 19 03:54:08.935438 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1060931270 Oct 19 03:54:08.935438 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:54:08.935438 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:54:08.935438 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c2dfa644c780498a9d9ab24938903dd7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c2dfa644c780498a9d9ab24938903dd7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c2dfa644c780498a9d9ab24938903dd7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c2dfa644c780498a9d9ab24938903dd7", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:54:08.935438 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1060931270 Oct 19 03:54:08.935438 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: c2dfa644c780498a9d9ab24938903dd7 Oct 19 03:54:08.935438 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1060931270 Oct 19 03:54:08.935438 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-AttachVolumeShelveTestJSON-1060931270-project Oct 19 03:54:08.935438 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:54:08.935438 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:54:08.935438 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 43f8869bb2c44a1f814d5da9e5d1a39d Oct 19 03:54:08.935438 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1060931270-project Oct 19 03:54:08.935438 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:54:08.935438 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance 89f2e52f-afcb-49bf-a39a-4b442a96eba8 could not be found. Oct 19 03:54:08.935438 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '89f2e52f-afcb-49bf-a39a-4b442a96eba8'} Oct 19 03:54:08.935438 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:54:08.935438 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:54:08.935438 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:54:08.935438 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:54:08.935438 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:54:08.935438 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:54:08.935438 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:54:08.935438 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:54:08.935438 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:54:08.935438 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:54:08.935438 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89f2e52f-afcb-49bf-a39a-4b442a96eba8 could not be found. Oct 19 03:54:08.935438 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:54:08.935438 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:54:08.935438 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:54:08.935438 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:54:08.935438 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:54:08.935438 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:54:08.935438 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:54:08.935438 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:54:08.935438 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:54:08.935438 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:54:08.935438 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 03:54:08.935438 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 03:54:08.935438 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 03:54:08.935438 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 03:54:08.935438 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:54:08.935438 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:54:08.935438 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:54:08.935438 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:54:08.942478 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89f2e52f-afcb-49bf-a39a-4b442a96eba8 could not be found. Oct 19 03:54:08.942478 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:54:08.942478 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:54:08.942478 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:54:08.942478 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:54:08.942478 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:54:08.942478 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:54:08.942478 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:54:08.942478 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:54:08.942478 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89f2e52f-afcb-49bf-a39a-4b442a96eba8 could not be found. Oct 19 03:54:08.942478 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:54:08.942478 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-bf95ace2-7192-4876-ba77-be743795d73d tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Returning 404 to user: Instance 89f2e52f-afcb-49bf-a39a-4b442a96eba8 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:54:08.942478 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-bf95ace2-7192-4876-ba77-be743795d73d tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "DELETE /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8" status: 404 len: 111 microversion: 2.20 time: 0.075557 Oct 19 03:54:08.942478 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3290/6518] 10.222.0.52 () {60 vars in 1280 bytes} [Wed Oct 19 03:54:08 2022] DELETE /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 19 03:54:08.946966 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-59f77235-0230-4026-a9d5-297b88331b4d tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:54:08.947900 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-59f77235-0230-4026-a9d5-297b88331b4d tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] [instance: 89f2e52f-afcb-49bf-a39a-4b442a96eba8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:54:08.963184 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-59f77235-0230-4026-a9d5-297b88331b4d tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:08.967132 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-59f77235-0230-4026-a9d5-297b88331b4d tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:08.967719 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-59f77235-0230-4026-a9d5-297b88331b4d tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:08.968706 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-59f77235-0230-4026-a9d5-297b88331b4d tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:08.969281 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-59f77235-0230-4026-a9d5-297b88331b4d tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:08.970087 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-59f77235-0230-4026-a9d5-297b88331b4d tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:08.997975 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-59f77235-0230-4026-a9d5-297b88331b4d tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] HTTP exception thrown: Instance 89f2e52f-afcb-49bf-a39a-4b442a96eba8 could not be found. Oct 19 03:54:09.000661 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-59f77235-0230-4026-a9d5-297b88331b4d tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Request method failure captured: Oct 19 03:54:09.000661 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8 HTTP/1.1 Oct 19 03:54:09.000661 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:54:09.000661 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:54:09.000661 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:54:09.000661 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:54:09.000661 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:54:09.000661 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:54:09.000661 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:54:09.000661 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:54:09.000661 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3Mj8Y9XZUqdAO7It2_JZfeGIxD8aLHMiOWUFfIXg2mA6_dl2bPpa0kOk0am9pPXP4oh6B6udK76F-90kFvdD17QuGVLTMnqVb2EpkTkWoVzrcHTsYKtJfL-nQKy4vPS1m2xj0L66liLV8wFyDhJKV4T3C-Uqz51OaZp5zeh1hnRxQY Oct 19 03:54:09.000661 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:54:09.000661 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:54:09.000661 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:54:09.000661 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:54:09.000661 n-d-861333-8 devstack@n-api.service[121134]: X-Openstack-Nova-Api-Version: 2.20 Oct 19 03:54:09.000661 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:54:09.000661 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:54:09.000661 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: c2dfa644c780498a9d9ab24938903dd7 Oct 19 03:54:09.000661 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1060931270 Oct 19 03:54:09.000661 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:54:09.000661 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:54:09.000661 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c2dfa644c780498a9d9ab24938903dd7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c2dfa644c780498a9d9ab24938903dd7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c2dfa644c780498a9d9ab24938903dd7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c2dfa644c780498a9d9ab24938903dd7", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:54:09.000661 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1060931270 Oct 19 03:54:09.000661 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: c2dfa644c780498a9d9ab24938903dd7 Oct 19 03:54:09.000661 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1060931270 Oct 19 03:54:09.000661 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-AttachVolumeShelveTestJSON-1060931270-project Oct 19 03:54:09.000661 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:54:09.000661 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:54:09.000661 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 43f8869bb2c44a1f814d5da9e5d1a39d Oct 19 03:54:09.000661 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1060931270-project Oct 19 03:54:09.000661 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:54:09.000661 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance 89f2e52f-afcb-49bf-a39a-4b442a96eba8 could not be found. Oct 19 03:54:09.000661 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '89f2e52f-afcb-49bf-a39a-4b442a96eba8'} Oct 19 03:54:09.000661 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:54:09.000661 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:54:09.000661 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:54:09.000661 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:54:09.000661 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:54:09.000661 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:54:09.000661 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:54:09.000661 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:54:09.000661 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:54:09.000661 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:54:09.000661 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89f2e52f-afcb-49bf-a39a-4b442a96eba8 could not be found. Oct 19 03:54:09.000661 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:54:09.000661 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:54:09.000661 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:54:09.000661 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:54:09.000661 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:54:09.000661 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:54:09.000661 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:54:09.000661 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:54:09.000661 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:54:09.000661 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:54:09.000661 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:54:09.000661 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:54:09.000661 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:54:09.000661 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:54:09.000661 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:54:09.000661 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:54:09.000661 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89f2e52f-afcb-49bf-a39a-4b442a96eba8 could not be found. Oct 19 03:54:09.000661 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:54:09.000661 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:54:09.006184 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:54:09.006184 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:54:09.006184 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:54:09.006184 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:54:09.006184 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:54:09.006184 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:54:09.006184 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89f2e52f-afcb-49bf-a39a-4b442a96eba8 could not be found. Oct 19 03:54:09.006184 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:54:09.009961 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-59f77235-0230-4026-a9d5-297b88331b4d tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] Returning 404 to user: Instance 89f2e52f-afcb-49bf-a39a-4b442a96eba8 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:54:09.011107 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-59f77235-0230-4026-a9d5-297b88331b4d tempest-AttachVolumeShelveTestJSON-1060931270 tempest-AttachVolumeShelveTestJSON-1060931270-project] 10.222.0.52 "GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8" status: 404 len: 111 microversion: 2.20 time: 0.069116 Oct 19 03:54:09.012216 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3229/6519] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 19 03:54:08 2022] GET /compute/v2.1/servers/89f2e52f-afcb-49bf-a39a-4b442a96eba8 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 19 03:54:09.499907 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-fa7370ff-d4f4-4c07-87eb-f075c705c014 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:54:09.500527 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-fa7370ff-d4f4-4c07-87eb-f075c705c014 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] [instance: 2ba616b3-3dae-4176-a55c-39a41bee6cc1] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:54:09.536908 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fa7370ff-d4f4-4c07-87eb-f075c705c014 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:09.540158 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fa7370ff-d4f4-4c07-87eb-f075c705c014 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:09.540981 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fa7370ff-d4f4-4c07-87eb-f075c705c014 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:09.543470 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fa7370ff-d4f4-4c07-87eb-f075c705c014 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:09.544116 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fa7370ff-d4f4-4c07-87eb-f075c705c014 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:09.545474 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fa7370ff-d4f4-4c07-87eb-f075c705c014 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:09.764319 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-80262652-94fc-48ec-ba37-062e3090dc63 req-84717ca4-518e-4bed-8fe3-632a7dcc01c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ba616b3-3dae-4176-a55c-39a41bee6cc1", "tag": "76b22975-752c-4984-96e7-d796879b2179"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:54:09.778831 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-80262652-94fc-48ec-ba37-062e3090dc63 req-84717ca4-518e-4bed-8fe3-632a7dcc01c3 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:09.781524 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-80262652-94fc-48ec-ba37-062e3090dc63 req-84717ca4-518e-4bed-8fe3-632a7dcc01c3 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:09.781524 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-80262652-94fc-48ec-ba37-062e3090dc63 req-84717ca4-518e-4bed-8fe3-632a7dcc01c3 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:09.796221 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-80262652-94fc-48ec-ba37-062e3090dc63 req-84717ca4-518e-4bed-8fe3-632a7dcc01c3 service nova] Creating event network-changed:76b22975-752c-4984-96e7-d796879b2179 for instance 2ba616b3-3dae-4176-a55c-39a41bee6cc1 on n-h2-861333-8 Oct 19 03:54:09.803888 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-80262652-94fc-48ec-ba37-062e3090dc63 req-84717ca4-518e-4bed-8fe3-632a7dcc01c3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.290965 Oct 19 03:54:09.805119 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3230/6520] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:54:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:54:10.155969 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-fa7370ff-d4f4-4c07-87eb-f075c705c014 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/2ba616b3-3dae-4176-a55c-39a41bee6cc1" status: 200 len: 1463 microversion: 2.1 time: 0.659617 Oct 19 03:54:10.157165 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3291/6521] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:54:09 2022] GET /compute/v2.1/servers/2ba616b3-3dae-4176-a55c-39a41bee6cc1 => generated 1463 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:54:11.185178 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c39fec1b-35ea-40c5-b101-10351cadbcea tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:54:11.185178 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c39fec1b-35ea-40c5-b101-10351cadbcea tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] [instance: 2ba616b3-3dae-4176-a55c-39a41bee6cc1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:54:11.197728 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c39fec1b-35ea-40c5-b101-10351cadbcea tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:11.198236 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c39fec1b-35ea-40c5-b101-10351cadbcea tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:11.198669 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c39fec1b-35ea-40c5-b101-10351cadbcea tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:11.203550 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c39fec1b-35ea-40c5-b101-10351cadbcea tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:11.204095 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c39fec1b-35ea-40c5-b101-10351cadbcea tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:11.204550 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c39fec1b-35ea-40c5-b101-10351cadbcea tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:11.463182 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c39fec1b-35ea-40c5-b101-10351cadbcea tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/2ba616b3-3dae-4176-a55c-39a41bee6cc1" status: 200 len: 1463 microversion: 2.1 time: 0.285403 Oct 19 03:54:11.477299 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3231/6522] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:54:11 2022] GET /compute/v2.1/servers/2ba616b3-3dae-4176-a55c-39a41bee6cc1 => generated 1463 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:54:12.488814 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e431f46c-60e4-4f6a-83fc-43886fb71873 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:54:12.489467 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e431f46c-60e4-4f6a-83fc-43886fb71873 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] [instance: 2ba616b3-3dae-4176-a55c-39a41bee6cc1] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:54:12.499895 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e431f46c-60e4-4f6a-83fc-43886fb71873 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:12.500402 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e431f46c-60e4-4f6a-83fc-43886fb71873 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:12.501630 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e431f46c-60e4-4f6a-83fc-43886fb71873 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:12.502938 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e431f46c-60e4-4f6a-83fc-43886fb71873 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:12.504269 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e431f46c-60e4-4f6a-83fc-43886fb71873 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:12.504869 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e431f46c-60e4-4f6a-83fc-43886fb71873 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:12.847513 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e431f46c-60e4-4f6a-83fc-43886fb71873 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/2ba616b3-3dae-4176-a55c-39a41bee6cc1" status: 200 len: 1463 microversion: 2.1 time: 0.363298 Oct 19 03:54:12.853919 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3292/6523] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:54:12 2022] GET /compute/v2.1/servers/2ba616b3-3dae-4176-a55c-39a41bee6cc1 => generated 1463 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:54:13.871474 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5b2bd5df-c31e-47fa-98f8-ce9ae488dee9 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:54:13.872624 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5b2bd5df-c31e-47fa-98f8-ce9ae488dee9 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] [instance: 2ba616b3-3dae-4176-a55c-39a41bee6cc1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:54:13.879653 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:54:13.881755 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:54:13.888786 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5b2bd5df-c31e-47fa-98f8-ce9ae488dee9 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:13.888786 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5b2bd5df-c31e-47fa-98f8-ce9ae488dee9 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:13.888786 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5b2bd5df-c31e-47fa-98f8-ce9ae488dee9 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:13.888786 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5b2bd5df-c31e-47fa-98f8-ce9ae488dee9 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:13.888786 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5b2bd5df-c31e-47fa-98f8-ce9ae488dee9 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:13.888786 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5b2bd5df-c31e-47fa-98f8-ce9ae488dee9 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:14.125566 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5b2bd5df-c31e-47fa-98f8-ce9ae488dee9 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/2ba616b3-3dae-4176-a55c-39a41bee6cc1" status: 200 len: 1463 microversion: 2.1 time: 0.257643 Oct 19 03:54:14.126953 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3232/6524] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:54:13 2022] GET /compute/v2.1/servers/2ba616b3-3dae-4176-a55c-39a41bee6cc1 => generated 1463 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:54:14.246938 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:54:14.272558 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=8 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:54:14.733112 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-735d0f14-ca04-4955-ac2f-e0353366b4b0 tempest-TestNetworkAdvancedServerOps-173376372 tempest-TestNetworkAdvancedServerOps-173376372-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:54:14.734325 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-735d0f14-ca04-4955-ac2f-e0353366b4b0 tempest-TestNetworkAdvancedServerOps-173376372 tempest-TestNetworkAdvancedServerOps-173376372-project-admin] [instance: 2b57ed72-0e3a-43c8-b552-875524942849] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:54:14.758531 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-735d0f14-ca04-4955-ac2f-e0353366b4b0 tempest-TestNetworkAdvancedServerOps-173376372 tempest-TestNetworkAdvancedServerOps-173376372-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:14.761330 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-735d0f14-ca04-4955-ac2f-e0353366b4b0 tempest-TestNetworkAdvancedServerOps-173376372 tempest-TestNetworkAdvancedServerOps-173376372-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:14.764053 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-735d0f14-ca04-4955-ac2f-e0353366b4b0 tempest-TestNetworkAdvancedServerOps-173376372 tempest-TestNetworkAdvancedServerOps-173376372-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:14.768139 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-735d0f14-ca04-4955-ac2f-e0353366b4b0 tempest-TestNetworkAdvancedServerOps-173376372 tempest-TestNetworkAdvancedServerOps-173376372-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:14.776205 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-735d0f14-ca04-4955-ac2f-e0353366b4b0 tempest-TestNetworkAdvancedServerOps-173376372 tempest-TestNetworkAdvancedServerOps-173376372-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:14.777453 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-735d0f14-ca04-4955-ac2f-e0353366b4b0 tempest-TestNetworkAdvancedServerOps-173376372 tempest-TestNetworkAdvancedServerOps-173376372-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:15.080661 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-735d0f14-ca04-4955-ac2f-e0353366b4b0 tempest-TestNetworkAdvancedServerOps-173376372 tempest-TestNetworkAdvancedServerOps-173376372-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849" status: 200 len: 1829 microversion: 2.1 time: 0.844892 Oct 19 03:54:15.083496 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3293/6525] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:54:14 2022] GET /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849 => generated 1829 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:54:15.151642 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-815abff2-1621-4e32-b00c-aa3ccd34afc8 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:54:15.153056 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-815abff2-1621-4e32-b00c-aa3ccd34afc8 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] [instance: 2ba616b3-3dae-4176-a55c-39a41bee6cc1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:54:15.161246 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-815abff2-1621-4e32-b00c-aa3ccd34afc8 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:15.162060 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-815abff2-1621-4e32-b00c-aa3ccd34afc8 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:15.162686 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-815abff2-1621-4e32-b00c-aa3ccd34afc8 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:15.163789 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-815abff2-1621-4e32-b00c-aa3ccd34afc8 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:15.164451 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-815abff2-1621-4e32-b00c-aa3ccd34afc8 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:15.165529 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-815abff2-1621-4e32-b00c-aa3ccd34afc8 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:15.573658 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-815abff2-1621-4e32-b00c-aa3ccd34afc8 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/2ba616b3-3dae-4176-a55c-39a41bee6cc1" status: 200 len: 1463 microversion: 2.1 time: 0.427116 Oct 19 03:54:15.576838 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3233/6526] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:54:15 2022] GET /compute/v2.1/servers/2ba616b3-3dae-4176-a55c-39a41bee6cc1 => generated 1463 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:54:16.604142 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-db42e3e9-7ad9-4270-aa1e-75d557af6e8a tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:54:16.605509 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-db42e3e9-7ad9-4270-aa1e-75d557af6e8a tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] [instance: 2ba616b3-3dae-4176-a55c-39a41bee6cc1] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:54:16.625711 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-db42e3e9-7ad9-4270-aa1e-75d557af6e8a tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:16.627049 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-db42e3e9-7ad9-4270-aa1e-75d557af6e8a tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:16.631728 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-db42e3e9-7ad9-4270-aa1e-75d557af6e8a tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:16.632873 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-db42e3e9-7ad9-4270-aa1e-75d557af6e8a tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:16.641055 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-db42e3e9-7ad9-4270-aa1e-75d557af6e8a tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:16.643023 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-db42e3e9-7ad9-4270-aa1e-75d557af6e8a tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:16.755598 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5d194c82-03b0-4bdb-a43b-debc085a005e tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:54:16.756083 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5d194c82-03b0-4bdb-a43b-debc085a005e tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: 2b57ed72-0e3a-43c8-b552-875524942849] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:54:16.767422 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5d194c82-03b0-4bdb-a43b-debc085a005e tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:16.774818 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5d194c82-03b0-4bdb-a43b-debc085a005e tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:16.775376 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5d194c82-03b0-4bdb-a43b-debc085a005e tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:16.776144 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5d194c82-03b0-4bdb-a43b-debc085a005e tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:16.776614 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5d194c82-03b0-4bdb-a43b-debc085a005e tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:16.777221 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5d194c82-03b0-4bdb-a43b-debc085a005e tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:16.836923 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5d194c82-03b0-4bdb-a43b-debc085a005e tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: 2b57ed72-0e3a-43c8-b552-875524942849] Going to try to terminate instance {{(pid=121134) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:54:16.930792 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-db42e3e9-7ad9-4270-aa1e-75d557af6e8a tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/2ba616b3-3dae-4176-a55c-39a41bee6cc1" status: 200 len: 1463 microversion: 2.1 time: 0.332372 Oct 19 03:54:16.933734 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3294/6527] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:54:16 2022] GET /compute/v2.1/servers/2ba616b3-3dae-4176-a55c-39a41bee6cc1 => generated 1463 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:54:16.949318 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-ca9d46f6-cc71-4d0d-bf8f-b67f37595c71 req-f7bf6ee8-2735-46f3-8f68-7b2c830ba5cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b57ed72-0e3a-43c8-b552-875524942849", "tag": "b71571a2-9eae-43a2-9932-7383aafff2d1"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:54:16.968024 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-ca9d46f6-cc71-4d0d-bf8f-b67f37595c71 req-f7bf6ee8-2735-46f3-8f68-7b2c830ba5cd service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:16.971166 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-ca9d46f6-cc71-4d0d-bf8f-b67f37595c71 req-f7bf6ee8-2735-46f3-8f68-7b2c830ba5cd service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:16.971838 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-ca9d46f6-cc71-4d0d-bf8f-b67f37595c71 req-f7bf6ee8-2735-46f3-8f68-7b2c830ba5cd service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:16.993603 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-ca9d46f6-cc71-4d0d-bf8f-b67f37595c71 req-f7bf6ee8-2735-46f3-8f68-7b2c830ba5cd service nova] Creating event network-changed:b71571a2-9eae-43a2-9932-7383aafff2d1 for instance 2b57ed72-0e3a-43c8-b552-875524942849 on n-h1-861333-8 Oct 19 03:54:17.011664 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-ca9d46f6-cc71-4d0d-bf8f-b67f37595c71 req-f7bf6ee8-2735-46f3-8f68-7b2c830ba5cd service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076617 Oct 19 03:54:17.012521 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3295/6528] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:54:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:54:17.294219 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5d194c82-03b0-4bdb-a43b-debc085a005e tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "DELETE /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849" status: 204 len: 0 microversion: 2.1 time: 0.543070 Oct 19 03:54:17.295752 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3234/6529] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:54:16 2022] DELETE /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:54:17.305954 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-09455d43-81af-462f-95b2-7f9123833b19 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:54:17.307997 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-09455d43-81af-462f-95b2-7f9123833b19 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: 2b57ed72-0e3a-43c8-b552-875524942849] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:54:17.323999 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-09455d43-81af-462f-95b2-7f9123833b19 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:17.330589 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-09455d43-81af-462f-95b2-7f9123833b19 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:17.331753 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-09455d43-81af-462f-95b2-7f9123833b19 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:17.333305 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-09455d43-81af-462f-95b2-7f9123833b19 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:17.334044 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-09455d43-81af-462f-95b2-7f9123833b19 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:17.335335 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-09455d43-81af-462f-95b2-7f9123833b19 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:17.463214 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-d87cdae8-aec6-482d-a537-7f3e67fa6903 req-63ea1a0e-9d03-46a1-bfa3-cd0571b6fe3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ba616b3-3dae-4176-a55c-39a41bee6cc1", "name": "network-vif-plugged", "status": "completed", "tag": "76b22975-752c-4984-96e7-d796879b2179"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:54:17.489714 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-d87cdae8-aec6-482d-a537-7f3e67fa6903 req-63ea1a0e-9d03-46a1-bfa3-cd0571b6fe3e service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:17.497760 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-d87cdae8-aec6-482d-a537-7f3e67fa6903 req-63ea1a0e-9d03-46a1-bfa3-cd0571b6fe3e service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:17.499321 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-d87cdae8-aec6-482d-a537-7f3e67fa6903 req-63ea1a0e-9d03-46a1-bfa3-cd0571b6fe3e service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:17.555519 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-d87cdae8-aec6-482d-a537-7f3e67fa6903 req-63ea1a0e-9d03-46a1-bfa3-cd0571b6fe3e service nova] Creating event network-vif-plugged:76b22975-752c-4984-96e7-d796879b2179 for instance 2ba616b3-3dae-4176-a55c-39a41bee6cc1 on n-h2-861333-8 Oct 19 03:54:17.573700 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-d87cdae8-aec6-482d-a537-7f3e67fa6903 req-63ea1a0e-9d03-46a1-bfa3-cd0571b6fe3e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.557452 Oct 19 03:54:17.575999 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3296/6530] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:54:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:54:17.600976 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-09455d43-81af-462f-95b2-7f9123833b19 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:54:17.624349 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-09455d43-81af-462f-95b2-7f9123833b19 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849" status: 200 len: 1684 microversion: 2.1 time: 0.323656 Oct 19 03:54:17.624872 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3235/6531] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:54:17 2022] GET /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849 => generated 1684 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:54:17.966643 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e09f9bb9-fcaf-4d93-80de-c56d444b4574 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:54:17.968808 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e09f9bb9-fcaf-4d93-80de-c56d444b4574 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] [instance: 2ba616b3-3dae-4176-a55c-39a41bee6cc1] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:54:17.984062 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e09f9bb9-fcaf-4d93-80de-c56d444b4574 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:17.986376 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e09f9bb9-fcaf-4d93-80de-c56d444b4574 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:17.987402 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e09f9bb9-fcaf-4d93-80de-c56d444b4574 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:17.991149 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e09f9bb9-fcaf-4d93-80de-c56d444b4574 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:17.991896 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e09f9bb9-fcaf-4d93-80de-c56d444b4574 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:17.995477 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e09f9bb9-fcaf-4d93-80de-c56d444b4574 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:18.241803 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e09f9bb9-fcaf-4d93-80de-c56d444b4574 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/2ba616b3-3dae-4176-a55c-39a41bee6cc1" status: 200 len: 1463 microversion: 2.1 time: 0.287674 Oct 19 03:54:18.242395 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3297/6532] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:54:17 2022] GET /compute/v2.1/servers/2ba616b3-3dae-4176-a55c-39a41bee6cc1 => generated 1463 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:54:18.655311 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-fd49dd80-6e5d-4b5e-b4c2-c8212ef322d6 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:54:18.656598 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-fd49dd80-6e5d-4b5e-b4c2-c8212ef322d6 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: 2b57ed72-0e3a-43c8-b552-875524942849] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:54:18.670900 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fd49dd80-6e5d-4b5e-b4c2-c8212ef322d6 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:18.676547 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fd49dd80-6e5d-4b5e-b4c2-c8212ef322d6 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:18.677286 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fd49dd80-6e5d-4b5e-b4c2-c8212ef322d6 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:18.682472 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fd49dd80-6e5d-4b5e-b4c2-c8212ef322d6 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:18.682472 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fd49dd80-6e5d-4b5e-b4c2-c8212ef322d6 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:18.691932 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fd49dd80-6e5d-4b5e-b4c2-c8212ef322d6 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:19.216472 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-fd49dd80-6e5d-4b5e-b4c2-c8212ef322d6 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:54:19.221263 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:54:19.225977 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-fd49dd80-6e5d-4b5e-b4c2-c8212ef322d6 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849" status: 200 len: 1684 microversion: 2.1 time: 0.575021 Oct 19 03:54:19.237908 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3236/6533] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:54:18 2022] GET /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849 => generated 1684 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:54:19.268905 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-bb3cba6d-debd-46d6-a425-1de866f4e799 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:54:19.270935 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-bb3cba6d-debd-46d6-a425-1de866f4e799 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] [instance: 2ba616b3-3dae-4176-a55c-39a41bee6cc1] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:54:19.286833 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bb3cba6d-debd-46d6-a425-1de866f4e799 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:19.287777 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bb3cba6d-debd-46d6-a425-1de866f4e799 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:19.288429 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bb3cba6d-debd-46d6-a425-1de866f4e799 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:19.289353 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bb3cba6d-debd-46d6-a425-1de866f4e799 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:19.290162 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bb3cba6d-debd-46d6-a425-1de866f4e799 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:19.290955 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bb3cba6d-debd-46d6-a425-1de866f4e799 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:19.687054 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-bb3cba6d-debd-46d6-a425-1de866f4e799 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/2ba616b3-3dae-4176-a55c-39a41bee6cc1" status: 200 len: 1648 microversion: 2.1 time: 0.422551 Oct 19 03:54:19.693001 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3298/6534] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:54:19 2022] GET /compute/v2.1/servers/2ba616b3-3dae-4176-a55c-39a41bee6cc1 => generated 1648 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:54:19.720180 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-fd14c8fa-650d-4606-8f9a-1a141fa26dda tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:54:19.720799 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-fd14c8fa-650d-4606-8f9a-1a141fa26dda tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] [instance: 2ba616b3-3dae-4176-a55c-39a41bee6cc1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:54:19.733313 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fd14c8fa-650d-4606-8f9a-1a141fa26dda tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:19.734122 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fd14c8fa-650d-4606-8f9a-1a141fa26dda tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:19.734565 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fd14c8fa-650d-4606-8f9a-1a141fa26dda tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:19.735270 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fd14c8fa-650d-4606-8f9a-1a141fa26dda tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:19.745437 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fd14c8fa-650d-4606-8f9a-1a141fa26dda tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:19.745817 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fd14c8fa-650d-4606-8f9a-1a141fa26dda tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:20.091497 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-fd14c8fa-650d-4606-8f9a-1a141fa26dda tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/2ba616b3-3dae-4176-a55c-39a41bee6cc1" status: 200 len: 1648 microversion: 2.1 time: 0.374802 Oct 19 03:54:20.092118 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3237/6535] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:54:19 2022] GET /compute/v2.1/servers/2ba616b3-3dae-4176-a55c-39a41bee6cc1 => generated 1648 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:54:20.121062 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2398fb55-99af-4e03-ad38-e58da293ddcf tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:54:20.122155 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-2398fb55-99af-4e03-ad38-e58da293ddcf tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] [instance: 2ba616b3-3dae-4176-a55c-39a41bee6cc1] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:54:20.129852 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2398fb55-99af-4e03-ad38-e58da293ddcf tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:20.130538 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2398fb55-99af-4e03-ad38-e58da293ddcf tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:20.131191 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2398fb55-99af-4e03-ad38-e58da293ddcf tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:20.132059 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2398fb55-99af-4e03-ad38-e58da293ddcf tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:20.132665 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2398fb55-99af-4e03-ad38-e58da293ddcf tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:20.133296 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2398fb55-99af-4e03-ad38-e58da293ddcf tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:20.251748 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-57a900aa-1bc1-45f8-87f3-73f8aac22e63 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:54:20.252372 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-57a900aa-1bc1-45f8-87f3-73f8aac22e63 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: 2b57ed72-0e3a-43c8-b552-875524942849] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:54:20.260031 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-57a900aa-1bc1-45f8-87f3-73f8aac22e63 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:20.260524 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-57a900aa-1bc1-45f8-87f3-73f8aac22e63 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:20.260961 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-57a900aa-1bc1-45f8-87f3-73f8aac22e63 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:20.264429 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-57a900aa-1bc1-45f8-87f3-73f8aac22e63 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:20.265045 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-57a900aa-1bc1-45f8-87f3-73f8aac22e63 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:20.265775 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-57a900aa-1bc1-45f8-87f3-73f8aac22e63 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:20.872734 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-57a900aa-1bc1-45f8-87f3-73f8aac22e63 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:54:20.886134 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-57a900aa-1bc1-45f8-87f3-73f8aac22e63 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849" status: 200 len: 1499 microversion: 2.1 time: 0.638443 Oct 19 03:54:20.890450 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3238/6536] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:54:20 2022] GET /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849 => generated 1499 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:54:20.895845 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-f033ada6-f6ef-4fad-8892-0f37be4dc3d0 req-ea293644-c8f8-41c9-9f62-082fd4044fe9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b57ed72-0e3a-43c8-b552-875524942849", "name": "network-vif-deleted", "tag": "b71571a2-9eae-43a2-9932-7383aafff2d1"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:54:20.926524 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-f033ada6-f6ef-4fad-8892-0f37be4dc3d0 req-ea293644-c8f8-41c9-9f62-082fd4044fe9 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:20.927479 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-f033ada6-f6ef-4fad-8892-0f37be4dc3d0 req-ea293644-c8f8-41c9-9f62-082fd4044fe9 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:20.927923 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-f033ada6-f6ef-4fad-8892-0f37be4dc3d0 req-ea293644-c8f8-41c9-9f62-082fd4044fe9 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:20.952684 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-f033ada6-f6ef-4fad-8892-0f37be4dc3d0 req-ea293644-c8f8-41c9-9f62-082fd4044fe9 service nova] Creating event network-vif-deleted:b71571a2-9eae-43a2-9932-7383aafff2d1 for instance 2b57ed72-0e3a-43c8-b552-875524942849 on n-h1-861333-8 Oct 19 03:54:20.959492 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-f033ada6-f6ef-4fad-8892-0f37be4dc3d0 req-ea293644-c8f8-41c9-9f62-082fd4044fe9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067332 Oct 19 03:54:20.964260 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3239/6537] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:54:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:54:20.993756 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=85 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:54:20.999942 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2398fb55-99af-4e03-ad38-e58da293ddcf tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/2ba616b3-3dae-4176-a55c-39a41bee6cc1" status: 200 len: 1648 microversion: 2.1 time: 0.889903 Oct 19 03:54:21.000531 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3299/6538] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:54:20 2022] GET /compute/v2.1/servers/2ba616b3-3dae-4176-a55c-39a41bee6cc1 => generated 1648 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:54:21.170919 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-86343191-8b05-41ae-8de6-39f07a2f2d82 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1618665019", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "availability_zone": "nova:n-h1-861333-8", "networks": [{"uuid": "0d16df5b-ad46-4b24-a231-4399fdb879ac"}]}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:54:21.208587 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:54:21.271917 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-86343191-8b05-41ae-8de6-39f07a2f2d82 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] validate_networks() for [('0d16df5b-ad46-4b24-a231-4399fdb879ac', None, None, None, None, None)] {{(pid=121134) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:54:21.746532 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-86343191-8b05-41ae-8de6-39f07a2f2d82 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Flavor limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:54:21.746962 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-86343191-8b05-41ae-8de6-39f07a2f2d82 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Image limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:54:21.747594 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-86343191-8b05-41ae-8de6-39f07a2f2d82 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Flavor pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:54:21.747880 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-86343191-8b05-41ae-8de6-39f07a2f2d82 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Image pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:54:21.748293 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-86343191-8b05-41ae-8de6-39f07a2f2d82 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:54:21.758510 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-86343191-8b05-41ae-8de6-39f07a2f2d82 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:21.759009 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-86343191-8b05-41ae-8de6-39f07a2f2d82 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:21.759541 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-86343191-8b05-41ae-8de6-39f07a2f2d82 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:21.760554 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-86343191-8b05-41ae-8de6-39f07a2f2d82 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:21.761017 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-86343191-8b05-41ae-8de6-39f07a2f2d82 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:21.761483 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-86343191-8b05-41ae-8de6-39f07a2f2d82 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:21.783224 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-86343191-8b05-41ae-8de6-39f07a2f2d82 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Getting quotas for project 7f4b24b82352419b9bd2a6cb8e92c7e5. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:54:21.788693 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-86343191-8b05-41ae-8de6-39f07a2f2d82 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Getting quotas for user 6e26061ac02e43d3a6908e385976332e and project 7f4b24b82352419b9bd2a6cb8e92c7e5. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:54:21.803764 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-86343191-8b05-41ae-8de6-39f07a2f2d82 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Going to run 1 instances... {{(pid=121134) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:54:21.806165 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-86343191-8b05-41ae-8de6-39f07a2f2d82 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] [instance: 177dd040-34ce-414c-b186-aa1d48d708b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:54:21.916467 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-da125d5e-d396-48b1-93ab-448c3e035c4e tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:54:21.917197 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-da125d5e-d396-48b1-93ab-448c3e035c4e tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: 2b57ed72-0e3a-43c8-b552-875524942849] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:54:21.924737 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-da125d5e-d396-48b1-93ab-448c3e035c4e tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:21.925780 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-da125d5e-d396-48b1-93ab-448c3e035c4e tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:21.926226 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-da125d5e-d396-48b1-93ab-448c3e035c4e tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:21.926927 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-da125d5e-d396-48b1-93ab-448c3e035c4e tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:21.927386 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-da125d5e-d396-48b1-93ab-448c3e035c4e tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:21.927816 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-da125d5e-d396-48b1-93ab-448c3e035c4e tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:21.966854 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-da125d5e-d396-48b1-93ab-448c3e035c4e tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:21.967931 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-da125d5e-d396-48b1-93ab-448c3e035c4e tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:21.968585 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-da125d5e-d396-48b1-93ab-448c3e035c4e tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:21.969206 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-da125d5e-d396-48b1-93ab-448c3e035c4e tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lazy-loading 'fault' on Instance uuid 2b57ed72-0e3a-43c8-b552-875524942849 {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:54:21.984929 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-86343191-8b05-41ae-8de6-39f07a2f2d82 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.827652 Oct 19 03:54:22.009451 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3240/6539] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:54:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 853 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 03:54:22.014383 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e53bb173-e709-4041-bd4d-0414e098d6ab tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:54:22.020980 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e53bb173-e709-4041-bd4d-0414e098d6ab tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] [instance: 177dd040-34ce-414c-b186-aa1d48d708b4] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:54:22.025132 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-da125d5e-d396-48b1-93ab-448c3e035c4e tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:54:22.037697 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-da125d5e-d396-48b1-93ab-448c3e035c4e tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849" status: 200 len: 1352 microversion: 2.1 time: 0.125262 Oct 19 03:54:22.049656 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3300/6540] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:54:21 2022] GET /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849 => generated 1352 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:54:22.129798 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e53bb173-e709-4041-bd4d-0414e098d6ab tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/177dd040-34ce-414c-b186-aa1d48d708b4" status: 200 len: 1329 microversion: 2.1 time: 0.119059 Oct 19 03:54:22.130538 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3241/6541] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:54:22 2022] GET /compute/v2.1/servers/177dd040-34ce-414c-b186-aa1d48d708b4 => generated 1329 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:54:23.064133 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2ab6061e-fca8-409c-849d-f4fea6958119 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:54:23.065394 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-2ab6061e-fca8-409c-849d-f4fea6958119 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: 2b57ed72-0e3a-43c8-b552-875524942849] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:54:23.073032 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2ab6061e-fca8-409c-849d-f4fea6958119 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:23.073798 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2ab6061e-fca8-409c-849d-f4fea6958119 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:23.074401 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2ab6061e-fca8-409c-849d-f4fea6958119 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:23.075290 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2ab6061e-fca8-409c-849d-f4fea6958119 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:23.075790 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2ab6061e-fca8-409c-849d-f4fea6958119 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:23.076438 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2ab6061e-fca8-409c-849d-f4fea6958119 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:23.092175 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-2ab6061e-fca8-409c-849d-f4fea6958119 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] HTTP exception thrown: Instance 2b57ed72-0e3a-43c8-b552-875524942849 could not be found. Oct 19 03:54:23.094241 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2ab6061e-fca8-409c-849d-f4fea6958119 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Request method failure captured: Oct 19 03:54:23.094241 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849 HTTP/1.1 Oct 19 03:54:23.094241 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:54:23.094241 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:54:23.094241 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:54:23.094241 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:54:23.094241 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:54:23.094241 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:54:23.094241 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:54:23.094241 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:54:23.094241 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT3NwoLvkX1ASv7BWG8n03-wyV-PHrk4Zzw5wyutTUqINpvyr9PXOVTlUcdwMhf8Q5ZkPK7itp1Hf4ku46LTSLnpDmtKa_b_RS1LRUWqOcdFLvZqgZoywIxoBs14di1P9oAs26SP9if5E5-uZy9hDECUpYA7EORF5pEKdwwte-cPfVLw Oct 19 03:54:23.094241 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:54:23.094241 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:54:23.094241 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:54:23.094241 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:54:23.094241 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:54:23.094241 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:54:23.094241 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: fe972f4874424bf89e9ed0bfcb69f050 Oct 19 03:54:23.094241 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-374576753 Oct 19 03:54:23.094241 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:54:23.094241 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:54:23.094241 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/fe972f4874424bf89e9ed0bfcb69f050"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe972f4874424bf89e9ed0bfcb69f050"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe972f4874424bf89e9ed0bfcb69f050"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_fe972f4874424bf89e9ed0bfcb69f050", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:54:23.094241 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-TestNetworkAdvancedServerOps-374576753 Oct 19 03:54:23.094241 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: fe972f4874424bf89e9ed0bfcb69f050 Oct 19 03:54:23.094241 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-374576753 Oct 19 03:54:23.094241 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-TestNetworkAdvancedServerOps-374576753-project Oct 19 03:54:23.094241 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:54:23.094241 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:54:23.094241 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: b63367855cc9468f8512a87e89b8606d Oct 19 03:54:23.094241 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-TestNetworkAdvancedServerOps-374576753-project Oct 19 03:54:23.094241 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:54:23.094241 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance 2b57ed72-0e3a-43c8-b552-875524942849 could not be found. Oct 19 03:54:23.094241 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '2b57ed72-0e3a-43c8-b552-875524942849'} Oct 19 03:54:23.094241 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:54:23.094241 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:54:23.094241 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:54:23.094241 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:54:23.094241 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:54:23.094241 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:54:23.094241 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:54:23.094241 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:54:23.094241 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:54:23.094241 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:54:23.094241 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b57ed72-0e3a-43c8-b552-875524942849 could not be found. Oct 19 03:54:23.094241 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:54:23.094241 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:54:23.094241 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:54:23.094241 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:54:23.094241 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:54:23.094241 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:54:23.094241 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:54:23.094241 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:54:23.094241 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:54:23.094241 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:54:23.094241 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:54:23.094241 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:54:23.094241 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:54:23.094241 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:54:23.094241 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:54:23.094241 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:54:23.094241 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b57ed72-0e3a-43c8-b552-875524942849 could not be found. Oct 19 03:54:23.094241 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:54:23.094241 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:54:23.099994 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:54:23.099994 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:54:23.099994 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:54:23.099994 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:54:23.099994 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:54:23.099994 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:54:23.099994 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b57ed72-0e3a-43c8-b552-875524942849 could not be found. Oct 19 03:54:23.099994 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:54:23.101194 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2ab6061e-fca8-409c-849d-f4fea6958119 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Returning 404 to user: Instance 2b57ed72-0e3a-43c8-b552-875524942849 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:54:23.102488 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2ab6061e-fca8-409c-849d-f4fea6958119 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849" status: 404 len: 111 microversion: 2.1 time: 0.042244 Oct 19 03:54:23.106898 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3301/6542] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:54:23 2022] GET /compute/v2.1/servers/2b57ed72-0e3a-43c8-b552-875524942849 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:54:23.153559 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b65db4ce-0ebc-4417-81f5-f10ca43cb17a tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:54:23.154189 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b65db4ce-0ebc-4417-81f5-f10ca43cb17a tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] [instance: 177dd040-34ce-414c-b186-aa1d48d708b4] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:54:23.177891 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b65db4ce-0ebc-4417-81f5-f10ca43cb17a tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:23.178397 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b65db4ce-0ebc-4417-81f5-f10ca43cb17a tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:23.178838 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b65db4ce-0ebc-4417-81f5-f10ca43cb17a tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:23.181811 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b65db4ce-0ebc-4417-81f5-f10ca43cb17a tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:23.182309 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b65db4ce-0ebc-4417-81f5-f10ca43cb17a tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:23.182743 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b65db4ce-0ebc-4417-81f5-f10ca43cb17a tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:23.321187 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b65db4ce-0ebc-4417-81f5-f10ca43cb17a tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/177dd040-34ce-414c-b186-aa1d48d708b4" status: 200 len: 1346 microversion: 2.1 time: 0.167077 Oct 19 03:54:23.321187 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3242/6543] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:54:23 2022] GET /compute/v2.1/servers/177dd040-34ce-414c-b186-aa1d48d708b4 => generated 1346 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:54:24.343220 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-23514b5c-8bdb-4849-92f2-46f616961da4 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:54:24.348218 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-23514b5c-8bdb-4849-92f2-46f616961da4 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] [instance: 177dd040-34ce-414c-b186-aa1d48d708b4] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:54:24.348218 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=63,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:54:24.354540 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-23514b5c-8bdb-4849-92f2-46f616961da4 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:24.355047 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-23514b5c-8bdb-4849-92f2-46f616961da4 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:24.355811 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-23514b5c-8bdb-4849-92f2-46f616961da4 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:24.356771 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-23514b5c-8bdb-4849-92f2-46f616961da4 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:24.357234 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-23514b5c-8bdb-4849-92f2-46f616961da4 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:24.357949 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-23514b5c-8bdb-4849-92f2-46f616961da4 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:24.489096 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-23514b5c-8bdb-4849-92f2-46f616961da4 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/177dd040-34ce-414c-b186-aa1d48d708b4" status: 200 len: 1416 microversion: 2.1 time: 0.150834 Oct 19 03:54:24.489730 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3302/6544] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:54:24 2022] GET /compute/v2.1/servers/177dd040-34ce-414c-b186-aa1d48d708b4 => generated 1416 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:54:25.511952 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-eeeadcb1-b72b-4ce3-94bd-e75bbbcf8212 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:54:25.512767 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-eeeadcb1-b72b-4ce3-94bd-e75bbbcf8212 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] [instance: 177dd040-34ce-414c-b186-aa1d48d708b4] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:54:25.525408 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eeeadcb1-b72b-4ce3-94bd-e75bbbcf8212 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:25.528664 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eeeadcb1-b72b-4ce3-94bd-e75bbbcf8212 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:25.529317 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eeeadcb1-b72b-4ce3-94bd-e75bbbcf8212 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:25.532631 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eeeadcb1-b72b-4ce3-94bd-e75bbbcf8212 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:25.533330 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eeeadcb1-b72b-4ce3-94bd-e75bbbcf8212 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:25.534497 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eeeadcb1-b72b-4ce3-94bd-e75bbbcf8212 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:25.850436 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-eeeadcb1-b72b-4ce3-94bd-e75bbbcf8212 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/177dd040-34ce-414c-b186-aa1d48d708b4" status: 200 len: 1422 microversion: 2.1 time: 0.339118 Oct 19 03:54:25.855134 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3243/6545] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:54:25 2022] GET /compute/v2.1/servers/177dd040-34ce-414c-b186-aa1d48d708b4 => generated 1422 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:54:26.880673 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6a2c25ac-2624-4404-8377-bc99a6fef4b3 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:54:26.882958 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6a2c25ac-2624-4404-8377-bc99a6fef4b3 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] [instance: 177dd040-34ce-414c-b186-aa1d48d708b4] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:54:26.905227 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6a2c25ac-2624-4404-8377-bc99a6fef4b3 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:26.905938 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6a2c25ac-2624-4404-8377-bc99a6fef4b3 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:26.907757 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6a2c25ac-2624-4404-8377-bc99a6fef4b3 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:26.907757 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6a2c25ac-2624-4404-8377-bc99a6fef4b3 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:26.910800 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6a2c25ac-2624-4404-8377-bc99a6fef4b3 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:26.911411 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6a2c25ac-2624-4404-8377-bc99a6fef4b3 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:27.212383 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6a2c25ac-2624-4404-8377-bc99a6fef4b3 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/177dd040-34ce-414c-b186-aa1d48d708b4" status: 200 len: 1464 microversion: 2.1 time: 0.331992 Oct 19 03:54:27.214321 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3303/6546] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:54:26 2022] GET /compute/v2.1/servers/177dd040-34ce-414c-b186-aa1d48d708b4 => generated 1464 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:54:28.242645 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7d368601-ffaa-4e15-aa12-50ebd471ce87 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:54:28.244083 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7d368601-ffaa-4e15-aa12-50ebd471ce87 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] [instance: 177dd040-34ce-414c-b186-aa1d48d708b4] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:54:28.263106 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7d368601-ffaa-4e15-aa12-50ebd471ce87 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:28.263872 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7d368601-ffaa-4e15-aa12-50ebd471ce87 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:28.266630 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7d368601-ffaa-4e15-aa12-50ebd471ce87 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:28.270835 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7d368601-ffaa-4e15-aa12-50ebd471ce87 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:28.271995 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7d368601-ffaa-4e15-aa12-50ebd471ce87 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:28.273794 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7d368601-ffaa-4e15-aa12-50ebd471ce87 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:28.948093 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7d368601-ffaa-4e15-aa12-50ebd471ce87 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/177dd040-34ce-414c-b186-aa1d48d708b4" status: 200 len: 1464 microversion: 2.1 time: 0.711657 Oct 19 03:54:28.949039 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3244/6547] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:54:28 2022] GET /compute/v2.1/servers/177dd040-34ce-414c-b186-aa1d48d708b4 => generated 1464 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:54:29.269680 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-e39ff499-03ef-494f-ad51-8c8174d3e34a req-05a1418a-7558-4ddb-bdbf-802aa4da8407 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "177dd040-34ce-414c-b186-aa1d48d708b4", "tag": "5b455615-8f5f-4d01-8e87-4af8150a5d15"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:54:29.285674 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-e39ff499-03ef-494f-ad51-8c8174d3e34a req-05a1418a-7558-4ddb-bdbf-802aa4da8407 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:29.286561 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-e39ff499-03ef-494f-ad51-8c8174d3e34a req-05a1418a-7558-4ddb-bdbf-802aa4da8407 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:29.287205 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-e39ff499-03ef-494f-ad51-8c8174d3e34a req-05a1418a-7558-4ddb-bdbf-802aa4da8407 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:29.304254 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-e39ff499-03ef-494f-ad51-8c8174d3e34a req-05a1418a-7558-4ddb-bdbf-802aa4da8407 service nova] Creating event network-changed:5b455615-8f5f-4d01-8e87-4af8150a5d15 for instance 177dd040-34ce-414c-b186-aa1d48d708b4 on n-h1-861333-8 Oct 19 03:54:29.311253 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-e39ff499-03ef-494f-ad51-8c8174d3e34a req-05a1418a-7558-4ddb-bdbf-802aa4da8407 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046352 Oct 19 03:54:29.312077 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3304/6548] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:54:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:54:29.898244 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d56b263c-f23c-47ea-b4fb-feb8daeb42f1 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Action: 'create', calling method: .version_select at 0x7fc1351119d0>, body: {"keypair": {"name": "tempest-keypair-1081585132", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE+WlOX7svVg5YKskcEvCmvxVSboHGo+lB4MF1mM9xcHVYcEomZD3YujpW+5twH9vDdI+C4q+V3bSwzXvWfoWIhK0wqLMXN8czNHTwCO0IXxpnzSttxVjtRQy3p4gWquwA=="}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:54:29.948567 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-d56b263c-f23c-47ea-b4fb-feb8daeb42f1 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Getting quotas for project ea131e741ef34573aa73360c5010221a. Resources: {'key_pairs'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:54:29.963620 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-d56b263c-f23c-47ea-b4fb-feb8daeb42f1 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Getting quotas for user 14706e15b5d7487a9b1d1a6332f93f7c and project ea131e741ef34573aa73360c5010221a. Resources: {'key_pairs'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:54:29.976503 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-86147e2f-0826-4d81-9ba6-25a9a0e396cb tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:54:29.977299 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-86147e2f-0826-4d81-9ba6-25a9a0e396cb tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] [instance: 177dd040-34ce-414c-b186-aa1d48d708b4] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:54:29.991149 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-86147e2f-0826-4d81-9ba6-25a9a0e396cb tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:29.993504 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-86147e2f-0826-4d81-9ba6-25a9a0e396cb tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:29.997464 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-86147e2f-0826-4d81-9ba6-25a9a0e396cb tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:29.998810 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-86147e2f-0826-4d81-9ba6-25a9a0e396cb tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:29.999506 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-86147e2f-0826-4d81-9ba6-25a9a0e396cb tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:29.999994 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-86147e2f-0826-4d81-9ba6-25a9a0e396cb tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:30.099073 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d56b263c-f23c-47ea-b4fb-feb8daeb42f1 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.467104 Oct 19 03:54:30.099755 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3245/6549] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Oct 19 03:54:29 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:54:30.359674 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-86147e2f-0826-4d81-9ba6-25a9a0e396cb tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/177dd040-34ce-414c-b186-aa1d48d708b4" status: 200 len: 1464 microversion: 2.1 time: 0.388208 Oct 19 03:54:30.364287 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3305/6550] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:54:29 2022] GET /compute/v2.1/servers/177dd040-34ce-414c-b186-aa1d48d708b4 => generated 1464 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:54:30.683660 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7f8ae351-eb85-4d4d-9ea7-515a41904371 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '.version_select at 0x7fc130c1f1f0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:54:30.811781 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7f8ae351-eb85-4d4d-9ea7-515a41904371 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-354532" status: 202 len: 0 microversion: 2.1 time: 0.136722 Oct 19 03:54:30.812869 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3246/6551] 10.222.0.52 () {58 vars in 1272 bytes} [Wed Oct 19 03:54:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-354532 => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:54:30.855970 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c4c5349a-4ee8-48a9-8355-2bbc71f5ed16 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Action: 'create', calling method: .version_select at 0x7fc1301720d0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1035296342", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBZSlFuN7sjGPFdvvPuTOOMD15EBOO+NnjIxOH4bc5Icy4e42rfndsBa3EMLgZvTGyuZjqLQr0I2kFEVrb5AxsJ7f3dHvsWxIjmepQ4MVR8MoI1wXirmtjtDTFJ3lZTlmw=="}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:54:30.874561 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-c4c5349a-4ee8-48a9-8355-2bbc71f5ed16 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Getting quotas for project fe972f4874424bf89e9ed0bfcb69f050. Resources: {'key_pairs'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:54:30.882394 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-c4c5349a-4ee8-48a9-8355-2bbc71f5ed16 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Getting quotas for user b63367855cc9468f8512a87e89b8606d and project fe972f4874424bf89e9ed0bfcb69f050. Resources: {'key_pairs'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:54:30.960880 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c4c5349a-4ee8-48a9-8355-2bbc71f5ed16 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.109108 Oct 19 03:54:30.967777 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3306/6552] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Oct 19 03:54:30 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:54:31.382780 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-cde7cdcc-615d-411b-97b2-0569a92e7c5a tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:54:31.384589 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-cde7cdcc-615d-411b-97b2-0569a92e7c5a tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] [instance: 177dd040-34ce-414c-b186-aa1d48d708b4] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:54:31.411305 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cde7cdcc-615d-411b-97b2-0569a92e7c5a tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:31.412468 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cde7cdcc-615d-411b-97b2-0569a92e7c5a tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:31.413666 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cde7cdcc-615d-411b-97b2-0569a92e7c5a tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:31.415509 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cde7cdcc-615d-411b-97b2-0569a92e7c5a tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:31.416685 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cde7cdcc-615d-411b-97b2-0569a92e7c5a tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:31.418189 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cde7cdcc-615d-411b-97b2-0569a92e7c5a tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:31.614750 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-cde7cdcc-615d-411b-97b2-0569a92e7c5a tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/177dd040-34ce-414c-b186-aa1d48d708b4" status: 200 len: 1464 microversion: 2.1 time: 0.231395 Oct 19 03:54:31.614750 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3247/6553] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:54:31 2022] GET /compute/v2.1/servers/177dd040-34ce-414c-b186-aa1d48d708b4 => generated 1464 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:54:32.638616 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3cefeb3d-ae5b-4b30-8da1-8b4706c5ce38 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:54:32.639842 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-3cefeb3d-ae5b-4b30-8da1-8b4706c5ce38 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] [instance: 177dd040-34ce-414c-b186-aa1d48d708b4] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:54:32.653255 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3cefeb3d-ae5b-4b30-8da1-8b4706c5ce38 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:32.654037 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3cefeb3d-ae5b-4b30-8da1-8b4706c5ce38 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:32.654644 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3cefeb3d-ae5b-4b30-8da1-8b4706c5ce38 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:32.656064 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3cefeb3d-ae5b-4b30-8da1-8b4706c5ce38 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:32.656693 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3cefeb3d-ae5b-4b30-8da1-8b4706c5ce38 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:32.657658 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3cefeb3d-ae5b-4b30-8da1-8b4706c5ce38 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:32.841852 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-3cefeb3d-ae5b-4b30-8da1-8b4706c5ce38 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/177dd040-34ce-414c-b186-aa1d48d708b4" status: 200 len: 1464 microversion: 2.1 time: 0.205712 Oct 19 03:54:32.841852 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3307/6554] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:54:32 2022] GET /compute/v2.1/servers/177dd040-34ce-414c-b186-aa1d48d708b4 => generated 1464 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:54:33.380378 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7690a27b-2f99-417d-8221-67779f148ba7 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-342520840", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "41fa7d07-f5eb-4de7-9c08-67821611f5f1"}], "security_groups": [{"name": "tempest-securitygroup--1653412909"}], "key_name": "tempest-keypair-1081585132", "user_data": "}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:54:33.397933 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:54:33.556411 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-7690a27b-2f99-417d-8221-67779f148ba7 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] validate_networks() for [('41fa7d07-f5eb-4de7-9c08-67821611f5f1', None, None, None, None, None)] {{(pid=121134) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:54:33.866239 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-65081074-371f-470e-b160-acaafc457b82 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:54:33.866860 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-65081074-371f-470e-b160-acaafc457b82 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] [instance: 177dd040-34ce-414c-b186-aa1d48d708b4] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:54:33.874369 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-65081074-371f-470e-b160-acaafc457b82 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:33.876938 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-65081074-371f-470e-b160-acaafc457b82 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:33.876938 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-65081074-371f-470e-b160-acaafc457b82 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:33.876938 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-65081074-371f-470e-b160-acaafc457b82 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:33.876938 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-65081074-371f-470e-b160-acaafc457b82 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:33.876938 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-65081074-371f-470e-b160-acaafc457b82 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:34.168863 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-7690a27b-2f99-417d-8221-67779f148ba7 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Flavor limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:54:34.169283 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-7690a27b-2f99-417d-8221-67779f148ba7 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Image limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:54:34.170876 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-7690a27b-2f99-417d-8221-67779f148ba7 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Flavor pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:54:34.173765 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-7690a27b-2f99-417d-8221-67779f148ba7 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Image pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:54:34.174373 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-7690a27b-2f99-417d-8221-67779f148ba7 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:54:34.181693 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-65081074-371f-470e-b160-acaafc457b82 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/177dd040-34ce-414c-b186-aa1d48d708b4" status: 200 len: 1464 microversion: 2.1 time: 0.319046 Oct 19 03:54:34.182301 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3308/6555] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:54:33 2022] GET /compute/v2.1/servers/177dd040-34ce-414c-b186-aa1d48d708b4 => generated 1464 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:54:34.190498 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7690a27b-2f99-417d-8221-67779f148ba7 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:34.191524 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7690a27b-2f99-417d-8221-67779f148ba7 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:34.191974 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7690a27b-2f99-417d-8221-67779f148ba7 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:34.192719 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7690a27b-2f99-417d-8221-67779f148ba7 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:34.193183 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7690a27b-2f99-417d-8221-67779f148ba7 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:34.193653 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7690a27b-2f99-417d-8221-67779f148ba7 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:34.218059 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-7690a27b-2f99-417d-8221-67779f148ba7 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Getting quotas for project ea131e741ef34573aa73360c5010221a. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:54:34.224611 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-7690a27b-2f99-417d-8221-67779f148ba7 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Getting quotas for user 14706e15b5d7487a9b1d1a6332f93f7c and project ea131e741ef34573aa73360c5010221a. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:54:34.240395 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7690a27b-2f99-417d-8221-67779f148ba7 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Going to run 1 instances... {{(pid=121134) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:54:34.242764 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7690a27b-2f99-417d-8221-67779f148ba7 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: 5f833ef3-e5bd-4953-a3ca-5cddddb2641f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:54:34.381915 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7690a27b-2f99-417d-8221-67779f148ba7 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.005714 Oct 19 03:54:34.383265 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3248/6556] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:54:33 2022] POST /compute/v2.1/servers => generated 402 bytes in 1008 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 03:54:34.397665 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-672a30fd-af23-433e-94bf-2c289cdca921 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:54:34.403158 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-672a30fd-af23-433e-94bf-2c289cdca921 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: 5f833ef3-e5bd-4953-a3ca-5cddddb2641f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:54:34.478651 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-672a30fd-af23-433e-94bf-2c289cdca921 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14706e15b5d7487a9b1d1a6332f93f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea131e741ef34573aa73360c5010221a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:54:34.488697 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-672a30fd-af23-433e-94bf-2c289cdca921 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "GET /compute/v2.1/servers/5f833ef3-e5bd-4953-a3ca-5cddddb2641f" status: 200 len: 1241 microversion: 2.1 time: 0.096678 Oct 19 03:54:34.490036 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3309/6557] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:54:34 2022] GET /compute/v2.1/servers/5f833ef3-e5bd-4953-a3ca-5cddddb2641f => generated 1241 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:54:35.205634 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-bc4ccf61-b0c0-4b03-aefd-967ce1cbc428 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:54:35.212511 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-bc4ccf61-b0c0-4b03-aefd-967ce1cbc428 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] [instance: 177dd040-34ce-414c-b186-aa1d48d708b4] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:54:35.214874 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bc4ccf61-b0c0-4b03-aefd-967ce1cbc428 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:35.215373 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bc4ccf61-b0c0-4b03-aefd-967ce1cbc428 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:35.216522 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bc4ccf61-b0c0-4b03-aefd-967ce1cbc428 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:35.217245 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bc4ccf61-b0c0-4b03-aefd-967ce1cbc428 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:35.218192 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bc4ccf61-b0c0-4b03-aefd-967ce1cbc428 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:35.218900 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bc4ccf61-b0c0-4b03-aefd-967ce1cbc428 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:35.383348 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-bc4ccf61-b0c0-4b03-aefd-967ce1cbc428 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/177dd040-34ce-414c-b186-aa1d48d708b4" status: 200 len: 1464 microversion: 2.1 time: 0.181418 Oct 19 03:54:35.397896 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3249/6558] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:54:35 2022] GET /compute/v2.1/servers/177dd040-34ce-414c-b186-aa1d48d708b4 => generated 1464 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:54:35.513400 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c8836aba-f62f-499a-8ad1-a7cc62fdf758 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:54:35.514369 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c8836aba-f62f-499a-8ad1-a7cc62fdf758 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: 5f833ef3-e5bd-4953-a3ca-5cddddb2641f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:54:35.583293 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c8836aba-f62f-499a-8ad1-a7cc62fdf758 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14706e15b5d7487a9b1d1a6332f93f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea131e741ef34573aa73360c5010221a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:54:35.590541 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c8836aba-f62f-499a-8ad1-a7cc62fdf758 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "GET /compute/v2.1/servers/5f833ef3-e5bd-4953-a3ca-5cddddb2641f" status: 200 len: 1241 microversion: 2.1 time: 0.081075 Oct 19 03:54:35.591125 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3310/6559] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:54:35 2022] GET /compute/v2.1/servers/5f833ef3-e5bd-4953-a3ca-5cddddb2641f => generated 1241 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:54:36.412447 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-994d876e-987b-461f-8231-1d76d17d8452 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:54:36.414654 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-994d876e-987b-461f-8231-1d76d17d8452 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] [instance: 177dd040-34ce-414c-b186-aa1d48d708b4] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:54:36.422816 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-994d876e-987b-461f-8231-1d76d17d8452 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:36.423316 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-994d876e-987b-461f-8231-1d76d17d8452 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:36.424245 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-994d876e-987b-461f-8231-1d76d17d8452 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:36.425402 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-994d876e-987b-461f-8231-1d76d17d8452 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:36.425987 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-994d876e-987b-461f-8231-1d76d17d8452 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:36.426853 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-994d876e-987b-461f-8231-1d76d17d8452 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:36.580721 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-994d876e-987b-461f-8231-1d76d17d8452 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/177dd040-34ce-414c-b186-aa1d48d708b4" status: 200 len: 1464 microversion: 2.1 time: 0.172381 Oct 19 03:54:36.581864 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3250/6560] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:54:36 2022] GET /compute/v2.1/servers/177dd040-34ce-414c-b186-aa1d48d708b4 => generated 1464 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:54:36.619086 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1148ba54-1cbe-431d-a6a3-5d6b45418044 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:54:36.619714 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1148ba54-1cbe-431d-a6a3-5d6b45418044 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: 5f833ef3-e5bd-4953-a3ca-5cddddb2641f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:54:36.626960 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1148ba54-1cbe-431d-a6a3-5d6b45418044 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:36.627453 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1148ba54-1cbe-431d-a6a3-5d6b45418044 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:36.628750 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1148ba54-1cbe-431d-a6a3-5d6b45418044 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:36.629489 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1148ba54-1cbe-431d-a6a3-5d6b45418044 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:36.629946 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1148ba54-1cbe-431d-a6a3-5d6b45418044 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:36.633056 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1148ba54-1cbe-431d-a6a3-5d6b45418044 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:36.697177 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-1148ba54-1cbe-431d-a6a3-5d6b45418044 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14706e15b5d7487a9b1d1a6332f93f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea131e741ef34573aa73360c5010221a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:54:36.707996 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1148ba54-1cbe-431d-a6a3-5d6b45418044 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "GET /compute/v2.1/servers/5f833ef3-e5bd-4953-a3ca-5cddddb2641f" status: 200 len: 1237 microversion: 2.1 time: 0.096151 Oct 19 03:54:36.708869 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3311/6561] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:54:36 2022] GET /compute/v2.1/servers/5f833ef3-e5bd-4953-a3ca-5cddddb2641f => generated 1237 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:54:37.457157 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-55362ccc-74f9-4d04-9f96-4ee0e06a6d5c req-d150bd1b-214f-4c9a-97ba-9cf2714ee5df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "177dd040-34ce-414c-b186-aa1d48d708b4", "name": "network-vif-plugged", "status": "completed", "tag": "5b455615-8f5f-4d01-8e87-4af8150a5d15"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:54:37.481523 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-55362ccc-74f9-4d04-9f96-4ee0e06a6d5c req-d150bd1b-214f-4c9a-97ba-9cf2714ee5df service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:37.481523 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-55362ccc-74f9-4d04-9f96-4ee0e06a6d5c req-d150bd1b-214f-4c9a-97ba-9cf2714ee5df service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:37.481523 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-55362ccc-74f9-4d04-9f96-4ee0e06a6d5c req-d150bd1b-214f-4c9a-97ba-9cf2714ee5df service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:37.507631 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-55362ccc-74f9-4d04-9f96-4ee0e06a6d5c req-d150bd1b-214f-4c9a-97ba-9cf2714ee5df service nova] Creating event network-vif-plugged:5b455615-8f5f-4d01-8e87-4af8150a5d15 for instance 177dd040-34ce-414c-b186-aa1d48d708b4 on n-h1-861333-8 Oct 19 03:54:37.515648 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-55362ccc-74f9-4d04-9f96-4ee0e06a6d5c req-d150bd1b-214f-4c9a-97ba-9cf2714ee5df service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062958 Oct 19 03:54:37.520495 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3251/6562] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:54:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:54:37.604092 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-de6dee14-4f34-4b96-8e82-698307af94b7 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:54:37.604720 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-de6dee14-4f34-4b96-8e82-698307af94b7 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] [instance: 177dd040-34ce-414c-b186-aa1d48d708b4] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:54:37.616386 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-de6dee14-4f34-4b96-8e82-698307af94b7 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:37.616894 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-de6dee14-4f34-4b96-8e82-698307af94b7 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:37.618258 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-de6dee14-4f34-4b96-8e82-698307af94b7 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:37.621448 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-de6dee14-4f34-4b96-8e82-698307af94b7 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:37.623419 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-de6dee14-4f34-4b96-8e82-698307af94b7 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:37.624735 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-de6dee14-4f34-4b96-8e82-698307af94b7 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:37.740765 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-cf5c3f03-ac40-4ee0-9329-19a9ad0bf0f3 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:54:37.741492 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-cf5c3f03-ac40-4ee0-9329-19a9ad0bf0f3 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: 5f833ef3-e5bd-4953-a3ca-5cddddb2641f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:54:37.752249 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cf5c3f03-ac40-4ee0-9329-19a9ad0bf0f3 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:37.752894 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cf5c3f03-ac40-4ee0-9329-19a9ad0bf0f3 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:37.754194 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cf5c3f03-ac40-4ee0-9329-19a9ad0bf0f3 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:37.755751 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cf5c3f03-ac40-4ee0-9329-19a9ad0bf0f3 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:37.756826 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cf5c3f03-ac40-4ee0-9329-19a9ad0bf0f3 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:37.757698 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cf5c3f03-ac40-4ee0-9329-19a9ad0bf0f3 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:37.910525 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-cf5c3f03-ac40-4ee0-9329-19a9ad0bf0f3 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14706e15b5d7487a9b1d1a6332f93f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea131e741ef34573aa73360c5010221a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:54:37.924353 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-cf5c3f03-ac40-4ee0-9329-19a9ad0bf0f3 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "GET /compute/v2.1/servers/5f833ef3-e5bd-4953-a3ca-5cddddb2641f" status: 200 len: 1311 microversion: 2.1 time: 0.189294 Oct 19 03:54:37.926680 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3252/6563] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:54:37 2022] GET /compute/v2.1/servers/5f833ef3-e5bd-4953-a3ca-5cddddb2641f => generated 1311 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:54:37.971059 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-de6dee14-4f34-4b96-8e82-698307af94b7 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/177dd040-34ce-414c-b186-aa1d48d708b4" status: 200 len: 1464 microversion: 2.1 time: 0.370698 Oct 19 03:54:37.973987 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3312/6564] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:54:37 2022] GET /compute/v2.1/servers/177dd040-34ce-414c-b186-aa1d48d708b4 => generated 1464 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:54:38.950270 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5fe52b5b-d98d-4228-a433-756760677c16 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:54:38.951103 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5fe52b5b-d98d-4228-a433-756760677c16 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: 5f833ef3-e5bd-4953-a3ca-5cddddb2641f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:54:38.961357 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5fe52b5b-d98d-4228-a433-756760677c16 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:38.962716 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5fe52b5b-d98d-4228-a433-756760677c16 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:38.963315 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5fe52b5b-d98d-4228-a433-756760677c16 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:38.964485 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5fe52b5b-d98d-4228-a433-756760677c16 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:38.965055 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5fe52b5b-d98d-4228-a433-756760677c16 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:38.965632 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5fe52b5b-d98d-4228-a433-756760677c16 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:38.996865 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-624eccbb-b89f-4f12-9773-20ee1731537d tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:54:38.998466 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-624eccbb-b89f-4f12-9773-20ee1731537d tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] [instance: 177dd040-34ce-414c-b186-aa1d48d708b4] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:54:39.009454 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-624eccbb-b89f-4f12-9773-20ee1731537d tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:39.015475 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-624eccbb-b89f-4f12-9773-20ee1731537d tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:39.016315 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-624eccbb-b89f-4f12-9773-20ee1731537d tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:39.017513 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-624eccbb-b89f-4f12-9773-20ee1731537d tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:39.018254 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-624eccbb-b89f-4f12-9773-20ee1731537d tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:39.019458 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-624eccbb-b89f-4f12-9773-20ee1731537d tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:39.217792 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5fe52b5b-d98d-4228-a433-756760677c16 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14706e15b5d7487a9b1d1a6332f93f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea131e741ef34573aa73360c5010221a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:54:39.227498 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5fe52b5b-d98d-4228-a433-756760677c16 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "GET /compute/v2.1/servers/5f833ef3-e5bd-4953-a3ca-5cddddb2641f" status: 200 len: 1367 microversion: 2.1 time: 0.281408 Oct 19 03:54:39.228101 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3253/6565] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:54:38 2022] GET /compute/v2.1/servers/5f833ef3-e5bd-4953-a3ca-5cddddb2641f => generated 1367 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:54:39.245530 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-624eccbb-b89f-4f12-9773-20ee1731537d tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/177dd040-34ce-414c-b186-aa1d48d708b4" status: 200 len: 1464 microversion: 2.1 time: 0.236234 Oct 19 03:54:39.245530 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3313/6566] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:54:38 2022] GET /compute/v2.1/servers/177dd040-34ce-414c-b186-aa1d48d708b4 => generated 1464 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:54:40.265958 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-886b5ba3-15e2-4a5a-83ed-aaf79f59d5f1 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:54:40.266815 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ac634cc2-14b3-47e2-9330-9aefc29d63d3 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:54:40.267526 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ac634cc2-14b3-47e2-9330-9aefc29d63d3 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] [instance: 177dd040-34ce-414c-b186-aa1d48d708b4] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:54:40.268769 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-886b5ba3-15e2-4a5a-83ed-aaf79f59d5f1 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: 5f833ef3-e5bd-4953-a3ca-5cddddb2641f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:54:40.289300 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ac634cc2-14b3-47e2-9330-9aefc29d63d3 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:40.289830 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ac634cc2-14b3-47e2-9330-9aefc29d63d3 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:40.290269 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ac634cc2-14b3-47e2-9330-9aefc29d63d3 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:40.290993 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ac634cc2-14b3-47e2-9330-9aefc29d63d3 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:40.291434 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ac634cc2-14b3-47e2-9330-9aefc29d63d3 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:40.292063 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ac634cc2-14b3-47e2-9330-9aefc29d63d3 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:40.299498 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-886b5ba3-15e2-4a5a-83ed-aaf79f59d5f1 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:40.303534 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-886b5ba3-15e2-4a5a-83ed-aaf79f59d5f1 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:40.303534 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-886b5ba3-15e2-4a5a-83ed-aaf79f59d5f1 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:40.304062 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-886b5ba3-15e2-4a5a-83ed-aaf79f59d5f1 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:40.304677 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-886b5ba3-15e2-4a5a-83ed-aaf79f59d5f1 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:40.307732 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-886b5ba3-15e2-4a5a-83ed-aaf79f59d5f1 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:41.149444 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ac634cc2-14b3-47e2-9330-9aefc29d63d3 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/177dd040-34ce-414c-b186-aa1d48d708b4" status: 200 len: 1649 microversion: 2.1 time: 0.893574 Oct 19 03:54:41.151140 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3254/6567] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:54:40 2022] GET /compute/v2.1/servers/177dd040-34ce-414c-b186-aa1d48d708b4 => generated 1649 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:54:41.180623 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-886b5ba3-15e2-4a5a-83ed-aaf79f59d5f1 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14706e15b5d7487a9b1d1a6332f93f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea131e741ef34573aa73360c5010221a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:54:41.184344 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2ea34682-f301-43c1-ae41-2ed30f4efcdf tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:54:41.185397 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2ea34682-f301-43c1-ae41-2ed30f4efcdf tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] [instance: 177dd040-34ce-414c-b186-aa1d48d708b4] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:54:41.202870 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-886b5ba3-15e2-4a5a-83ed-aaf79f59d5f1 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "GET /compute/v2.1/servers/5f833ef3-e5bd-4953-a3ca-5cddddb2641f" status: 200 len: 1367 microversion: 2.1 time: 0.948458 Oct 19 03:54:41.203900 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2ea34682-f301-43c1-ae41-2ed30f4efcdf tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:41.204435 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2ea34682-f301-43c1-ae41-2ed30f4efcdf tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:41.204884 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2ea34682-f301-43c1-ae41-2ed30f4efcdf tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:41.205996 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2ea34682-f301-43c1-ae41-2ed30f4efcdf tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:41.206503 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2ea34682-f301-43c1-ae41-2ed30f4efcdf tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:41.207159 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2ea34682-f301-43c1-ae41-2ed30f4efcdf tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:41.207289 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3314/6568] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:54:40 2022] GET /compute/v2.1/servers/5f833ef3-e5bd-4953-a3ca-5cddddb2641f => generated 1367 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:54:41.754009 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2ea34682-f301-43c1-ae41-2ed30f4efcdf tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/177dd040-34ce-414c-b186-aa1d48d708b4" status: 200 len: 1649 microversion: 2.1 time: 0.580831 Oct 19 03:54:41.754693 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3255/6569] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:54:41 2022] GET /compute/v2.1/servers/177dd040-34ce-414c-b186-aa1d48d708b4 => generated 1649 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:54:41.778156 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-dc15a8e7-3866-482e-8273-c15811239f88 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:54:41.778156 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-dc15a8e7-3866-482e-8273-c15811239f88 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] [instance: 177dd040-34ce-414c-b186-aa1d48d708b4] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:54:41.784885 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dc15a8e7-3866-482e-8273-c15811239f88 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:41.785392 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dc15a8e7-3866-482e-8273-c15811239f88 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:41.785869 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dc15a8e7-3866-482e-8273-c15811239f88 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:41.786575 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dc15a8e7-3866-482e-8273-c15811239f88 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:41.787018 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dc15a8e7-3866-482e-8273-c15811239f88 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:41.787444 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dc15a8e7-3866-482e-8273-c15811239f88 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:42.236975 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e94aac42-b09c-441f-aa1c-73cb2843a86b tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:54:42.238771 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e94aac42-b09c-441f-aa1c-73cb2843a86b tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: 5f833ef3-e5bd-4953-a3ca-5cddddb2641f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:54:42.251941 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-dc15a8e7-3866-482e-8273-c15811239f88 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/177dd040-34ce-414c-b186-aa1d48d708b4" status: 200 len: 1649 microversion: 2.1 time: 0.475396 Oct 19 03:54:42.254597 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3315/6570] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:54:41 2022] GET /compute/v2.1/servers/177dd040-34ce-414c-b186-aa1d48d708b4 => generated 1649 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:54:42.263781 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e94aac42-b09c-441f-aa1c-73cb2843a86b tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:42.264501 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e94aac42-b09c-441f-aa1c-73cb2843a86b tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:42.265107 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e94aac42-b09c-441f-aa1c-73cb2843a86b tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:42.266012 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e94aac42-b09c-441f-aa1c-73cb2843a86b tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:42.273793 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e94aac42-b09c-441f-aa1c-73cb2843a86b tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:42.276037 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e94aac42-b09c-441f-aa1c-73cb2843a86b tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:42.276912 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-cf20bee8-7d28-4cb3-82df-c05071840eb5 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:54:42.278325 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-cf20bee8-7d28-4cb3-82df-c05071840eb5 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] [instance: 177dd040-34ce-414c-b186-aa1d48d708b4] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:54:42.293957 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cf20bee8-7d28-4cb3-82df-c05071840eb5 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:42.294733 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cf20bee8-7d28-4cb3-82df-c05071840eb5 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:42.295537 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cf20bee8-7d28-4cb3-82df-c05071840eb5 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:42.296539 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cf20bee8-7d28-4cb3-82df-c05071840eb5 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:42.297251 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cf20bee8-7d28-4cb3-82df-c05071840eb5 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:42.298209 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cf20bee8-7d28-4cb3-82df-c05071840eb5 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:42.348093 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-cf20bee8-7d28-4cb3-82df-c05071840eb5 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] [instance: 177dd040-34ce-414c-b186-aa1d48d708b4] Going to try to terminate instance {{(pid=121135) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:54:42.717535 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-cf20bee8-7d28-4cb3-82df-c05071840eb5 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] 10.222.0.52 "DELETE /compute/v2.1/servers/177dd040-34ce-414c-b186-aa1d48d708b4" status: 204 len: 0 microversion: 2.1 time: 0.446513 Oct 19 03:54:42.719181 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3316/6571] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:54:42 2022] DELETE /compute/v2.1/servers/177dd040-34ce-414c-b186-aa1d48d708b4 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:54:42.732174 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-955912cc-dd94-41d0-bf24-2dd1c1127d2b tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:54:42.736019 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-955912cc-dd94-41d0-bf24-2dd1c1127d2b tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] [instance: 177dd040-34ce-414c-b186-aa1d48d708b4] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:54:42.746852 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-955912cc-dd94-41d0-bf24-2dd1c1127d2b tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:42.747697 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-955912cc-dd94-41d0-bf24-2dd1c1127d2b tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:42.749205 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-955912cc-dd94-41d0-bf24-2dd1c1127d2b tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:42.750739 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-955912cc-dd94-41d0-bf24-2dd1c1127d2b tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:42.752039 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-955912cc-dd94-41d0-bf24-2dd1c1127d2b tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:42.753522 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-955912cc-dd94-41d0-bf24-2dd1c1127d2b tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:42.772600 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e94aac42-b09c-441f-aa1c-73cb2843a86b tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14706e15b5d7487a9b1d1a6332f93f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea131e741ef34573aa73360c5010221a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:54:42.793505 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e94aac42-b09c-441f-aa1c-73cb2843a86b tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "GET /compute/v2.1/servers/5f833ef3-e5bd-4953-a3ca-5cddddb2641f" status: 200 len: 1367 microversion: 2.1 time: 0.562635 Oct 19 03:54:42.795366 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3256/6572] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:54:42 2022] GET /compute/v2.1/servers/5f833ef3-e5bd-4953-a3ca-5cddddb2641f => generated 1367 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:54:43.095611 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-61ddbf33-3090-455c-8a6e-4150197566ac req-b700d2b6-8d6d-4dce-9561-da4a5e741960 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f833ef3-e5bd-4953-a3ca-5cddddb2641f", "tag": "01954836-0ba9-45ed-ac4d-bd11f0421890"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:54:43.109886 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-61ddbf33-3090-455c-8a6e-4150197566ac req-b700d2b6-8d6d-4dce-9561-da4a5e741960 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:43.111130 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-61ddbf33-3090-455c-8a6e-4150197566ac req-b700d2b6-8d6d-4dce-9561-da4a5e741960 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:43.111756 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-61ddbf33-3090-455c-8a6e-4150197566ac req-b700d2b6-8d6d-4dce-9561-da4a5e741960 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:43.125651 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-61ddbf33-3090-455c-8a6e-4150197566ac req-b700d2b6-8d6d-4dce-9561-da4a5e741960 service nova] Creating event network-changed:01954836-0ba9-45ed-ac4d-bd11f0421890 for instance 5f833ef3-e5bd-4953-a3ca-5cddddb2641f on n-h2-861333-8 Oct 19 03:54:43.131603 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-61ddbf33-3090-455c-8a6e-4150197566ac req-b700d2b6-8d6d-4dce-9561-da4a5e741960 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039518 Oct 19 03:54:43.133072 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3257/6573] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:54:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:54:43.174297 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-955912cc-dd94-41d0-bf24-2dd1c1127d2b tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/177dd040-34ce-414c-b186-aa1d48d708b4" status: 200 len: 1655 microversion: 2.1 time: 0.449323 Oct 19 03:54:43.176168 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3317/6574] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:54:42 2022] GET /compute/v2.1/servers/177dd040-34ce-414c-b186-aa1d48d708b4 => generated 1655 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:54:43.830521 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1ce35a74-d32f-42c1-bd31-b0489ad2dfff tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:54:43.831990 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1ce35a74-d32f-42c1-bd31-b0489ad2dfff tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: 5f833ef3-e5bd-4953-a3ca-5cddddb2641f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:54:43.847964 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1ce35a74-d32f-42c1-bd31-b0489ad2dfff tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:43.848980 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1ce35a74-d32f-42c1-bd31-b0489ad2dfff tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:43.849963 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1ce35a74-d32f-42c1-bd31-b0489ad2dfff tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:43.850930 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1ce35a74-d32f-42c1-bd31-b0489ad2dfff tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:43.851620 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1ce35a74-d32f-42c1-bd31-b0489ad2dfff tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:43.852328 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1ce35a74-d32f-42c1-bd31-b0489ad2dfff tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:44.199348 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-26c517de-12a2-460a-8702-02c2cd3818db tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:54:44.214934 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-26c517de-12a2-460a-8702-02c2cd3818db tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] [instance: 177dd040-34ce-414c-b186-aa1d48d708b4] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:54:44.215524 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:54:44.215653 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-26c517de-12a2-460a-8702-02c2cd3818db tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:44.215653 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-26c517de-12a2-460a-8702-02c2cd3818db tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:44.215653 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-26c517de-12a2-460a-8702-02c2cd3818db tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:44.215653 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-26c517de-12a2-460a-8702-02c2cd3818db tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:44.215653 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-26c517de-12a2-460a-8702-02c2cd3818db tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:44.215653 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-26c517de-12a2-460a-8702-02c2cd3818db tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:44.221275 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-1ce35a74-d32f-42c1-bd31-b0489ad2dfff tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14706e15b5d7487a9b1d1a6332f93f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea131e741ef34573aa73360c5010221a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:54:44.231787 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1ce35a74-d32f-42c1-bd31-b0489ad2dfff tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "GET /compute/v2.1/servers/5f833ef3-e5bd-4953-a3ca-5cddddb2641f" status: 200 len: 1367 microversion: 2.1 time: 0.409565 Oct 19 03:54:44.232650 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3258/6575] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:54:43 2022] GET /compute/v2.1/servers/5f833ef3-e5bd-4953-a3ca-5cddddb2641f => generated 1367 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:54:44.472937 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:54:44.482627 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-26c517de-12a2-460a-8702-02c2cd3818db tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/177dd040-34ce-414c-b186-aa1d48d708b4" status: 200 len: 1655 microversion: 2.1 time: 0.287402 Oct 19 03:54:44.483920 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3318/6576] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:54:44 2022] GET /compute/v2.1/servers/177dd040-34ce-414c-b186-aa1d48d708b4 => generated 1655 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:54:45.258445 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d4366b84-fc5d-445a-b995-cf42a21662b7 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:54:45.259230 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d4366b84-fc5d-445a-b995-cf42a21662b7 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: 5f833ef3-e5bd-4953-a3ca-5cddddb2641f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:54:45.261463 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=18 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:54:45.268957 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d4366b84-fc5d-445a-b995-cf42a21662b7 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:45.269790 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d4366b84-fc5d-445a-b995-cf42a21662b7 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:45.270461 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d4366b84-fc5d-445a-b995-cf42a21662b7 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:45.271758 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d4366b84-fc5d-445a-b995-cf42a21662b7 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:45.272449 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d4366b84-fc5d-445a-b995-cf42a21662b7 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:45.273061 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d4366b84-fc5d-445a-b995-cf42a21662b7 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:45.508808 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-991dcb1d-e191-4322-a88d-9afc3c5e81bf tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:54:45.508808 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-991dcb1d-e191-4322-a88d-9afc3c5e81bf tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] [instance: 177dd040-34ce-414c-b186-aa1d48d708b4] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:54:45.518399 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-991dcb1d-e191-4322-a88d-9afc3c5e81bf tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:45.518941 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-991dcb1d-e191-4322-a88d-9afc3c5e81bf tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:45.519385 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-991dcb1d-e191-4322-a88d-9afc3c5e81bf tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:45.520354 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-991dcb1d-e191-4322-a88d-9afc3c5e81bf tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:45.520823 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-991dcb1d-e191-4322-a88d-9afc3c5e81bf tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:45.521256 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-991dcb1d-e191-4322-a88d-9afc3c5e81bf tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:45.587330 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=8 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:54:45.637993 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d4366b84-fc5d-445a-b995-cf42a21662b7 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14706e15b5d7487a9b1d1a6332f93f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea131e741ef34573aa73360c5010221a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:54:45.644700 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=100 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:54:45.652063 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d4366b84-fc5d-445a-b995-cf42a21662b7 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "GET /compute/v2.1/servers/5f833ef3-e5bd-4953-a3ca-5cddddb2641f" status: 200 len: 1367 microversion: 2.1 time: 0.398970 Oct 19 03:54:45.658572 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3259/6577] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:54:45 2022] GET /compute/v2.1/servers/5f833ef3-e5bd-4953-a3ca-5cddddb2641f => generated 1367 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:54:45.681056 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-991dcb1d-e191-4322-a88d-9afc3c5e81bf tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/177dd040-34ce-414c-b186-aa1d48d708b4" status: 200 len: 1613 microversion: 2.1 time: 0.178984 Oct 19 03:54:45.696228 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3319/6578] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:54:45 2022] GET /compute/v2.1/servers/177dd040-34ce-414c-b186-aa1d48d708b4 => generated 1613 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:54:45.697170 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-7c68f0d8-3587-4e62-92c3-a55c94c0b888 req-407cd4b0-373d-4521-8309-d207a8788473 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "177dd040-34ce-414c-b186-aa1d48d708b4", "name": "network-vif-deleted", "tag": "5b455615-8f5f-4d01-8e87-4af8150a5d15"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:54:45.712344 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-7c68f0d8-3587-4e62-92c3-a55c94c0b888 req-407cd4b0-373d-4521-8309-d207a8788473 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:45.712911 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-7c68f0d8-3587-4e62-92c3-a55c94c0b888 req-407cd4b0-373d-4521-8309-d207a8788473 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:45.713441 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-7c68f0d8-3587-4e62-92c3-a55c94c0b888 req-407cd4b0-373d-4521-8309-d207a8788473 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:45.733504 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-7c68f0d8-3587-4e62-92c3-a55c94c0b888 req-407cd4b0-373d-4521-8309-d207a8788473 service nova] Creating event network-vif-deleted:5b455615-8f5f-4d01-8e87-4af8150a5d15 for instance 177dd040-34ce-414c-b186-aa1d48d708b4 on n-h1-861333-8 Oct 19 03:54:45.743011 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-7c68f0d8-3587-4e62-92c3-a55c94c0b888 req-407cd4b0-373d-4521-8309-d207a8788473 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060075 Oct 19 03:54:45.743643 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3260/6579] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:54:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:54:46.100479 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b1656572-7f36-42e8-b177-6a507ab61845 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1842140931", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "networks": [{"uuid": "8d5f85d1-7510-455d-89cc-d1c62442a88d"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1035296342", "security_groups": [{"name": "tempest-secgroup-smoke-416943114"}]}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:54:46.220798 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.network.neutron [None req-b1656572-7f36-42e8-b177-6a507ab61845 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] validate_networks() for [('8d5f85d1-7510-455d-89cc-d1c62442a88d', None, None, None, None, None)] {{(pid=121135) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:54:46.632881 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-b1656572-7f36-42e8-b177-6a507ab61845 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Flavor limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:54:46.633653 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-b1656572-7f36-42e8-b177-6a507ab61845 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Image limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:54:46.633939 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-b1656572-7f36-42e8-b177-6a507ab61845 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Flavor pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:54:46.634425 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-b1656572-7f36-42e8-b177-6a507ab61845 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Image pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:54:46.634920 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-b1656572-7f36-42e8-b177-6a507ab61845 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:54:46.645834 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b1656572-7f36-42e8-b177-6a507ab61845 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:46.658620 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b1656572-7f36-42e8-b177-6a507ab61845 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:46.658620 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b1656572-7f36-42e8-b177-6a507ab61845 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:46.658620 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b1656572-7f36-42e8-b177-6a507ab61845 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:46.658620 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b1656572-7f36-42e8-b177-6a507ab61845 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:46.658620 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b1656572-7f36-42e8-b177-6a507ab61845 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:46.666269 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-b1656572-7f36-42e8-b177-6a507ab61845 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Getting quotas for project fe972f4874424bf89e9ed0bfcb69f050. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:54:46.672012 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-b1656572-7f36-42e8-b177-6a507ab61845 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Getting quotas for user b63367855cc9468f8512a87e89b8606d and project fe972f4874424bf89e9ed0bfcb69f050. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:54:46.679407 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8a302c6e-0058-4043-a80e-7b13b7de3c69 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:54:46.680110 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8a302c6e-0058-4043-a80e-7b13b7de3c69 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: 5f833ef3-e5bd-4953-a3ca-5cddddb2641f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:54:46.686523 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8a302c6e-0058-4043-a80e-7b13b7de3c69 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:46.688970 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8a302c6e-0058-4043-a80e-7b13b7de3c69 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:46.688970 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8a302c6e-0058-4043-a80e-7b13b7de3c69 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:46.688970 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8a302c6e-0058-4043-a80e-7b13b7de3c69 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:46.689236 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b1656572-7f36-42e8-b177-6a507ab61845 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Going to run 1 instances... {{(pid=121135) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:54:46.689324 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8a302c6e-0058-4043-a80e-7b13b7de3c69 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:46.689324 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8a302c6e-0058-4043-a80e-7b13b7de3c69 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:46.691790 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b1656572-7f36-42e8-b177-6a507ab61845 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: f1ef8fca-83d2-4b91-ae54-3fe226f7a19f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121135) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:54:46.833128 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8a302c6e-0058-4043-a80e-7b13b7de3c69 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14706e15b5d7487a9b1d1a6332f93f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea131e741ef34573aa73360c5010221a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:54:46.841618 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8a302c6e-0058-4043-a80e-7b13b7de3c69 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "GET /compute/v2.1/servers/5f833ef3-e5bd-4953-a3ca-5cddddb2641f" status: 200 len: 1367 microversion: 2.1 time: 0.169364 Oct 19 03:54:46.842330 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3261/6580] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:54:46 2022] GET /compute/v2.1/servers/5f833ef3-e5bd-4953-a3ca-5cddddb2641f => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:54:46.847432 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e20a391e-8847-4831-9e15-fb2a8d924c17 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:54:46.848490 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e20a391e-8847-4831-9e15-fb2a8d924c17 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] [instance: 177dd040-34ce-414c-b186-aa1d48d708b4] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:54:46.856023 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e20a391e-8847-4831-9e15-fb2a8d924c17 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:46.866819 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e20a391e-8847-4831-9e15-fb2a8d924c17 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:46.866819 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e20a391e-8847-4831-9e15-fb2a8d924c17 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:46.866819 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e20a391e-8847-4831-9e15-fb2a8d924c17 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:46.866819 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e20a391e-8847-4831-9e15-fb2a8d924c17 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:46.866819 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e20a391e-8847-4831-9e15-fb2a8d924c17 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:46.902060 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b1656572-7f36-42e8-b177-6a507ab61845 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.805936 Oct 19 03:54:46.908379 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3320/6581] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:54:46 2022] POST /compute/v2.1/servers => generated 405 bytes in 807 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 03:54:46.911866 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e20a391e-8847-4831-9e15-fb2a8d924c17 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:46.912837 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e20a391e-8847-4831-9e15-fb2a8d924c17 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:46.913663 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e20a391e-8847-4831-9e15-fb2a8d924c17 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:46.914536 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-e20a391e-8847-4831-9e15-fb2a8d924c17 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lazy-loading 'fault' on Instance uuid 177dd040-34ce-414c-b186-aa1d48d708b4 {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:54:46.915079 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1c45736a-2630-4738-a45c-589381d1144e tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:54:46.915885 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1c45736a-2630-4738-a45c-589381d1144e tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: f1ef8fca-83d2-4b91-ae54-3fe226f7a19f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:54:46.987082 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e20a391e-8847-4831-9e15-fb2a8d924c17 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/177dd040-34ce-414c-b186-aa1d48d708b4" status: 200 len: 1454 microversion: 2.1 time: 0.143519 Oct 19 03:54:46.990439 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3262/6582] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:54:46 2022] GET /compute/v2.1/servers/177dd040-34ce-414c-b186-aa1d48d708b4 => generated 1454 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:54:47.024738 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-1c45736a-2630-4738-a45c-589381d1144e tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:54:47.024738 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1c45736a-2630-4738-a45c-589381d1144e tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/f1ef8fca-83d2-4b91-ae54-3fe226f7a19f" status: 200 len: 1267 microversion: 2.1 time: 0.112854 Oct 19 03:54:47.024738 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3321/6583] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:54:46 2022] GET /compute/v2.1/servers/f1ef8fca-83d2-4b91-ae54-3fe226f7a19f => generated 1267 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:54:47.866630 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a134879f-fdde-4337-b7bd-7cc500dcddc4 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:54:47.867358 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a134879f-fdde-4337-b7bd-7cc500dcddc4 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: 5f833ef3-e5bd-4953-a3ca-5cddddb2641f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:54:47.874838 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a134879f-fdde-4337-b7bd-7cc500dcddc4 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:47.875342 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a134879f-fdde-4337-b7bd-7cc500dcddc4 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:47.875791 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a134879f-fdde-4337-b7bd-7cc500dcddc4 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:47.876696 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a134879f-fdde-4337-b7bd-7cc500dcddc4 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:47.877152 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a134879f-fdde-4337-b7bd-7cc500dcddc4 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:47.877613 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a134879f-fdde-4337-b7bd-7cc500dcddc4 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:48.013274 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-86151d3e-4ee9-4011-8f24-dca03413b993 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:54:48.015298 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-86151d3e-4ee9-4011-8f24-dca03413b993 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] [instance: 177dd040-34ce-414c-b186-aa1d48d708b4] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:54:48.025274 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-86151d3e-4ee9-4011-8f24-dca03413b993 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:48.026122 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-86151d3e-4ee9-4011-8f24-dca03413b993 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:48.026785 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-86151d3e-4ee9-4011-8f24-dca03413b993 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:48.027694 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-86151d3e-4ee9-4011-8f24-dca03413b993 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:48.028304 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-86151d3e-4ee9-4011-8f24-dca03413b993 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:48.029179 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-86151d3e-4ee9-4011-8f24-dca03413b993 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:48.035994 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a134879f-fdde-4337-b7bd-7cc500dcddc4 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14706e15b5d7487a9b1d1a6332f93f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea131e741ef34573aa73360c5010221a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:54:48.047944 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a134879f-fdde-4337-b7bd-7cc500dcddc4 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "GET /compute/v2.1/servers/5f833ef3-e5bd-4953-a3ca-5cddddb2641f" status: 200 len: 1367 microversion: 2.1 time: 0.183073 Oct 19 03:54:48.047944 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3263/6584] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:54:47 2022] GET /compute/v2.1/servers/5f833ef3-e5bd-4953-a3ca-5cddddb2641f => generated 1367 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:54:48.052076 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-86617940-2b7b-4db7-aff2-35209fbf636c tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:54:48.052887 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-86617940-2b7b-4db7-aff2-35209fbf636c tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: f1ef8fca-83d2-4b91-ae54-3fe226f7a19f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:54:48.053627 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-86151d3e-4ee9-4011-8f24-dca03413b993 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] HTTP exception thrown: Instance 177dd040-34ce-414c-b186-aa1d48d708b4 could not be found. Oct 19 03:54:48.057266 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-86151d3e-4ee9-4011-8f24-dca03413b993 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Request method failure captured: Oct 19 03:54:48.057266 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/177dd040-34ce-414c-b186-aa1d48d708b4 HTTP/1.1 Oct 19 03:54:48.057266 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:54:48.057266 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:54:48.057266 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:54:48.057266 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:54:48.057266 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:54:48.057266 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:54:48.057266 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:54:48.057266 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:54:48.057266 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT3TZ3dFNRkfmhCp2LS7v8RC46zPobGtefWa33nFkKX0DsRcGyfIYPqPIfc_XMPWMvcgSgrSKmEfWYIghaQn-k1v_WQPmTXK2GUOoyupFRLqlSynq1y9Op00NtlBZAZuE93DWty1kOQoYI_bbBONuaAn8MbXoZ9mLkCDA-nVtrGhu_Gg Oct 19 03:54:48.057266 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:54:48.057266 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:54:48.057266 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:54:48.057266 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:54:48.057266 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:54:48.057266 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:54:48.057266 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 7f4b24b82352419b9bd2a6cb8e92c7e5 Oct 19 03:54:48.057266 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-TestServerMultinode-205098138 Oct 19 03:54:48.057266 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member,admin Oct 19 03:54:48.057266 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member,admin Oct 19 03:54:48.057266 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7f4b24b82352419b9bd2a6cb8e92c7e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7f4b24b82352419b9bd2a6cb8e92c7e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7f4b24b82352419b9bd2a6cb8e92c7e5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7f4b24b82352419b9bd2a6cb8e92c7e5", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:54:48.057266 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-TestServerMultinode-205098138 Oct 19 03:54:48.057266 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 7f4b24b82352419b9bd2a6cb8e92c7e5 Oct 19 03:54:48.057266 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-TestServerMultinode-205098138 Oct 19 03:54:48.057266 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-TestServerMultinode-205098138-project-admin Oct 19 03:54:48.057266 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:54:48.057266 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:54:48.057266 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 6e26061ac02e43d3a6908e385976332e Oct 19 03:54:48.057266 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-TestServerMultinode-205098138-project-admin Oct 19 03:54:48.057266 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:54:48.057266 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance 177dd040-34ce-414c-b186-aa1d48d708b4 could not be found. Oct 19 03:54:48.057266 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '177dd040-34ce-414c-b186-aa1d48d708b4'} Oct 19 03:54:48.057266 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:54:48.057266 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:54:48.057266 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:54:48.057266 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:54:48.057266 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:54:48.057266 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:54:48.057266 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:54:48.057266 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:54:48.057266 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:54:48.057266 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:54:48.057266 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 177dd040-34ce-414c-b186-aa1d48d708b4 could not be found. Oct 19 03:54:48.057266 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:54:48.057266 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:54:48.057266 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:54:48.057266 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:54:48.057266 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:54:48.057266 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:54:48.057266 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:54:48.057266 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:54:48.057266 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:54:48.057266 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:54:48.057266 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:54:48.057266 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:54:48.057266 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:54:48.057266 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:54:48.057266 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:54:48.057266 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:54:48.057266 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 177dd040-34ce-414c-b186-aa1d48d708b4 could not be found. Oct 19 03:54:48.057266 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:54:48.057266 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:54:48.057266 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:54:48.062846 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:54:48.062846 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:54:48.062846 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:54:48.062846 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:54:48.062846 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:54:48.062846 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 177dd040-34ce-414c-b186-aa1d48d708b4 could not be found. Oct 19 03:54:48.062846 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:54:48.063433 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-86617940-2b7b-4db7-aff2-35209fbf636c tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:48.063433 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-86617940-2b7b-4db7-aff2-35209fbf636c tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:48.063433 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-86617940-2b7b-4db7-aff2-35209fbf636c tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:48.063433 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-86617940-2b7b-4db7-aff2-35209fbf636c tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:48.063433 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-86617940-2b7b-4db7-aff2-35209fbf636c tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:48.063433 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-86617940-2b7b-4db7-aff2-35209fbf636c tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:48.068764 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-86151d3e-4ee9-4011-8f24-dca03413b993 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Returning 404 to user: Instance 177dd040-34ce-414c-b186-aa1d48d708b4 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:54:48.070016 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-86151d3e-4ee9-4011-8f24-dca03413b993 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/177dd040-34ce-414c-b186-aa1d48d708b4" status: 404 len: 111 microversion: 2.1 time: 0.061771 Oct 19 03:54:48.071155 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3322/6585] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:54:48 2022] GET /compute/v2.1/servers/177dd040-34ce-414c-b186-aa1d48d708b4 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:54:48.080965 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b5b0ce6f-d828-4f45-9e1f-20b9f2812788 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:54:48.081632 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b5b0ce6f-d828-4f45-9e1f-20b9f2812788 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] [instance: 2ba616b3-3dae-4176-a55c-39a41bee6cc1] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:54:48.090301 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b5b0ce6f-d828-4f45-9e1f-20b9f2812788 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:48.093665 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b5b0ce6f-d828-4f45-9e1f-20b9f2812788 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:48.093665 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b5b0ce6f-d828-4f45-9e1f-20b9f2812788 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:48.093665 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b5b0ce6f-d828-4f45-9e1f-20b9f2812788 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:48.093665 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b5b0ce6f-d828-4f45-9e1f-20b9f2812788 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:48.093665 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b5b0ce6f-d828-4f45-9e1f-20b9f2812788 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:48.123388 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b5b0ce6f-d828-4f45-9e1f-20b9f2812788 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] [instance: 2ba616b3-3dae-4176-a55c-39a41bee6cc1] Going to try to terminate instance {{(pid=121135) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:54:48.132118 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-86617940-2b7b-4db7-aff2-35209fbf636c tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:54:48.140918 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-86617940-2b7b-4db7-aff2-35209fbf636c tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/f1ef8fca-83d2-4b91-ae54-3fe226f7a19f" status: 200 len: 1271 microversion: 2.1 time: 0.093724 Oct 19 03:54:48.142179 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3264/6586] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:54:48 2022] GET /compute/v2.1/servers/f1ef8fca-83d2-4b91-ae54-3fe226f7a19f => generated 1271 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:54:48.679183 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b5b0ce6f-d828-4f45-9e1f-20b9f2812788 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] 10.222.0.52 "DELETE /compute/v2.1/servers/2ba616b3-3dae-4176-a55c-39a41bee6cc1" status: 204 len: 0 microversion: 2.1 time: 0.603011 Oct 19 03:54:48.680098 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3323/6587] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:54:48 2022] DELETE /compute/v2.1/servers/2ba616b3-3dae-4176-a55c-39a41bee6cc1 => generated 0 bytes in 605 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:54:48.688321 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0d3ee230-bf67-487d-a183-c8a751b5d634 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:54:48.688957 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0d3ee230-bf67-487d-a183-c8a751b5d634 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] [instance: 2ba616b3-3dae-4176-a55c-39a41bee6cc1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:54:48.704584 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0d3ee230-bf67-487d-a183-c8a751b5d634 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:48.711001 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0d3ee230-bf67-487d-a183-c8a751b5d634 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:48.711001 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0d3ee230-bf67-487d-a183-c8a751b5d634 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:48.711001 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0d3ee230-bf67-487d-a183-c8a751b5d634 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:48.711001 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0d3ee230-bf67-487d-a183-c8a751b5d634 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:48.711001 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0d3ee230-bf67-487d-a183-c8a751b5d634 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:48.899301 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0d3ee230-bf67-487d-a183-c8a751b5d634 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/2ba616b3-3dae-4176-a55c-39a41bee6cc1" status: 200 len: 1654 microversion: 2.1 time: 0.214650 Oct 19 03:54:48.900522 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3265/6588] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:54:48 2022] GET /compute/v2.1/servers/2ba616b3-3dae-4176-a55c-39a41bee6cc1 => generated 1654 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:54:49.073161 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-41c50891-5ab3-4769-ad74-02fd446940ec tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:54:49.074131 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-41c50891-5ab3-4769-ad74-02fd446940ec tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: 5f833ef3-e5bd-4953-a3ca-5cddddb2641f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:54:49.085319 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-41c50891-5ab3-4769-ad74-02fd446940ec tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:49.085868 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-41c50891-5ab3-4769-ad74-02fd446940ec tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:49.086311 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-41c50891-5ab3-4769-ad74-02fd446940ec tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:49.087054 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-41c50891-5ab3-4769-ad74-02fd446940ec tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:49.087515 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-41c50891-5ab3-4769-ad74-02fd446940ec tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:49.087940 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-41c50891-5ab3-4769-ad74-02fd446940ec tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:49.167623 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-73d7b98a-b2fb-40db-9715-77198308e7c3 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:54:49.169093 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-73d7b98a-b2fb-40db-9715-77198308e7c3 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: f1ef8fca-83d2-4b91-ae54-3fe226f7a19f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:54:49.171008 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:DELETE=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:54:49.176894 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-73d7b98a-b2fb-40db-9715-77198308e7c3 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:49.177466 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-73d7b98a-b2fb-40db-9715-77198308e7c3 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:49.177854 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-73d7b98a-b2fb-40db-9715-77198308e7c3 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:49.178778 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-73d7b98a-b2fb-40db-9715-77198308e7c3 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:49.179357 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-73d7b98a-b2fb-40db-9715-77198308e7c3 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:49.180060 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-73d7b98a-b2fb-40db-9715-77198308e7c3 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:49.267239 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-73d7b98a-b2fb-40db-9715-77198308e7c3 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:54:49.276150 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-73d7b98a-b2fb-40db-9715-77198308e7c3 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/f1ef8fca-83d2-4b91-ae54-3fe226f7a19f" status: 200 len: 1319 microversion: 2.1 time: 0.112655 Oct 19 03:54:49.276883 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3266/6589] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:54:49 2022] GET /compute/v2.1/servers/f1ef8fca-83d2-4b91-ae54-3fe226f7a19f => generated 1319 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:54:49.286655 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-41c50891-5ab3-4769-ad74-02fd446940ec tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14706e15b5d7487a9b1d1a6332f93f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea131e741ef34573aa73360c5010221a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:54:49.295328 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-41c50891-5ab3-4769-ad74-02fd446940ec tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "GET /compute/v2.1/servers/5f833ef3-e5bd-4953-a3ca-5cddddb2641f" status: 200 len: 1367 microversion: 2.1 time: 0.227231 Oct 19 03:54:49.295928 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3324/6590] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:54:49 2022] GET /compute/v2.1/servers/5f833ef3-e5bd-4953-a3ca-5cddddb2641f => generated 1367 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:54:49.923605 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a8479626-6dcb-42ed-82c4-e693e0b82c9f tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:54:49.925492 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a8479626-6dcb-42ed-82c4-e693e0b82c9f tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] [instance: 2ba616b3-3dae-4176-a55c-39a41bee6cc1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:54:49.934514 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a8479626-6dcb-42ed-82c4-e693e0b82c9f tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:49.935006 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a8479626-6dcb-42ed-82c4-e693e0b82c9f tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:49.935902 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a8479626-6dcb-42ed-82c4-e693e0b82c9f tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:49.936143 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a8479626-6dcb-42ed-82c4-e693e0b82c9f tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:49.936597 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a8479626-6dcb-42ed-82c4-e693e0b82c9f tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:49.937229 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a8479626-6dcb-42ed-82c4-e693e0b82c9f tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:50.153868 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a8479626-6dcb-42ed-82c4-e693e0b82c9f tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/2ba616b3-3dae-4176-a55c-39a41bee6cc1" status: 200 len: 1654 microversion: 2.1 time: 0.234302 Oct 19 03:54:50.155125 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3267/6591] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:54:49 2022] GET /compute/v2.1/servers/2ba616b3-3dae-4176-a55c-39a41bee6cc1 => generated 1654 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:54:50.302028 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-8f6bd447-367f-41bb-9981-e01f3c9a6856 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:54:50.309663 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-8f6bd447-367f-41bb-9981-e01f3c9a6856 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: f1ef8fca-83d2-4b91-ae54-3fe226f7a19f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:54:50.315165 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-1124149c-74d9-4f48-bf23-619468686753 req-8c945f7a-959d-450a-9ed0-87059b5d641c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f833ef3-e5bd-4953-a3ca-5cddddb2641f", "name": "network-vif-plugged", "status": "completed", "tag": "01954836-0ba9-45ed-ac4d-bd11f0421890"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:54:50.315762 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8f6bd447-367f-41bb-9981-e01f3c9a6856 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:50.316402 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8f6bd447-367f-41bb-9981-e01f3c9a6856 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:50.316988 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8f6bd447-367f-41bb-9981-e01f3c9a6856 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:50.317745 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8f6bd447-367f-41bb-9981-e01f3c9a6856 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:50.319907 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8f6bd447-367f-41bb-9981-e01f3c9a6856 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:50.320898 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8f6bd447-367f-41bb-9981-e01f3c9a6856 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:50.332739 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-1124149c-74d9-4f48-bf23-619468686753 req-8c945f7a-959d-450a-9ed0-87059b5d641c service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:50.336185 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-1124149c-74d9-4f48-bf23-619468686753 req-8c945f7a-959d-450a-9ed0-87059b5d641c service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:50.336799 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-1124149c-74d9-4f48-bf23-619468686753 req-8c945f7a-959d-450a-9ed0-87059b5d641c service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:50.354862 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-1124149c-74d9-4f48-bf23-619468686753 req-8c945f7a-959d-450a-9ed0-87059b5d641c service nova] Creating event network-vif-plugged:01954836-0ba9-45ed-ac4d-bd11f0421890 for instance 5f833ef3-e5bd-4953-a3ca-5cddddb2641f on n-h2-861333-8 Oct 19 03:54:50.361703 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-1124149c-74d9-4f48-bf23-619468686753 req-8c945f7a-959d-450a-9ed0-87059b5d641c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052078 Oct 19 03:54:50.366607 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3268/6592] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:54:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:54:50.372282 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-90ff5200-ce3c-4a8a-ba5c-adb17a37be0a tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:54:50.373850 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-90ff5200-ce3c-4a8a-ba5c-adb17a37be0a tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: 5f833ef3-e5bd-4953-a3ca-5cddddb2641f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:54:50.409140 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-90ff5200-ce3c-4a8a-ba5c-adb17a37be0a tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:50.413554 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-90ff5200-ce3c-4a8a-ba5c-adb17a37be0a tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:50.418637 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-90ff5200-ce3c-4a8a-ba5c-adb17a37be0a tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:50.418637 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-90ff5200-ce3c-4a8a-ba5c-adb17a37be0a tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:50.418637 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-90ff5200-ce3c-4a8a-ba5c-adb17a37be0a tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:50.418637 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-90ff5200-ce3c-4a8a-ba5c-adb17a37be0a tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:50.454487 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-8f6bd447-367f-41bb-9981-e01f3c9a6856 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:54:50.473148 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-8f6bd447-367f-41bb-9981-e01f3c9a6856 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/f1ef8fca-83d2-4b91-ae54-3fe226f7a19f" status: 200 len: 1325 microversion: 2.1 time: 0.174654 Oct 19 03:54:50.475028 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3325/6593] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:54:50 2022] GET /compute/v2.1/servers/f1ef8fca-83d2-4b91-ae54-3fe226f7a19f => generated 1325 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:54:51.130150 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-90ff5200-ce3c-4a8a-ba5c-adb17a37be0a tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14706e15b5d7487a9b1d1a6332f93f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea131e741ef34573aa73360c5010221a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:54:51.138566 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-90ff5200-ce3c-4a8a-ba5c-adb17a37be0a tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "GET /compute/v2.1/servers/5f833ef3-e5bd-4953-a3ca-5cddddb2641f" status: 200 len: 1367 microversion: 2.1 time: 0.770317 Oct 19 03:54:51.150330 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3269/6594] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:54:50 2022] GET /compute/v2.1/servers/5f833ef3-e5bd-4953-a3ca-5cddddb2641f => generated 1367 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:54:51.193845 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f703b2f7-8c3e-4979-84c0-7b55bff2377d tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:54:51.198229 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f703b2f7-8c3e-4979-84c0-7b55bff2377d tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] [instance: 2ba616b3-3dae-4176-a55c-39a41bee6cc1] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:54:51.201831 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f703b2f7-8c3e-4979-84c0-7b55bff2377d tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:51.202413 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f703b2f7-8c3e-4979-84c0-7b55bff2377d tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:51.203074 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f703b2f7-8c3e-4979-84c0-7b55bff2377d tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:51.203850 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f703b2f7-8c3e-4979-84c0-7b55bff2377d tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:51.204511 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f703b2f7-8c3e-4979-84c0-7b55bff2377d tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:51.205018 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f703b2f7-8c3e-4979-84c0-7b55bff2377d tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:51.420641 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f703b2f7-8c3e-4979-84c0-7b55bff2377d tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/2ba616b3-3dae-4176-a55c-39a41bee6cc1" status: 200 len: 1654 microversion: 2.1 time: 0.233492 Oct 19 03:54:51.421513 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3326/6595] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:54:51 2022] GET /compute/v2.1/servers/2ba616b3-3dae-4176-a55c-39a41bee6cc1 => generated 1654 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:54:51.498434 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ed881aa4-c027-44b5-af38-ce38b3dd6ac4 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:54:51.499055 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ed881aa4-c027-44b5-af38-ce38b3dd6ac4 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: f1ef8fca-83d2-4b91-ae54-3fe226f7a19f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:54:51.510558 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ed881aa4-c027-44b5-af38-ce38b3dd6ac4 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:51.511290 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ed881aa4-c027-44b5-af38-ce38b3dd6ac4 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:51.511734 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ed881aa4-c027-44b5-af38-ce38b3dd6ac4 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:51.512452 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ed881aa4-c027-44b5-af38-ce38b3dd6ac4 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:51.512913 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ed881aa4-c027-44b5-af38-ce38b3dd6ac4 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:51.513339 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ed881aa4-c027-44b5-af38-ce38b3dd6ac4 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:51.537458 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-9ead8334-ae82-4f9f-91b0-4ab7bbbd2d14 req-e8a53a3e-0813-4673-a1dc-4737d24d1be6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ba616b3-3dae-4176-a55c-39a41bee6cc1", "name": "network-vif-deleted", "tag": "76b22975-752c-4984-96e7-d796879b2179"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:54:51.554340 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-9ead8334-ae82-4f9f-91b0-4ab7bbbd2d14 req-e8a53a3e-0813-4673-a1dc-4737d24d1be6 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:51.554819 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-9ead8334-ae82-4f9f-91b0-4ab7bbbd2d14 req-e8a53a3e-0813-4673-a1dc-4737d24d1be6 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:51.555248 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-9ead8334-ae82-4f9f-91b0-4ab7bbbd2d14 req-e8a53a3e-0813-4673-a1dc-4737d24d1be6 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:51.567501 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-9ead8334-ae82-4f9f-91b0-4ab7bbbd2d14 req-e8a53a3e-0813-4673-a1dc-4737d24d1be6 service nova] Creating event network-vif-deleted:76b22975-752c-4984-96e7-d796879b2179 for instance 2ba616b3-3dae-4176-a55c-39a41bee6cc1 on n-h2-861333-8 Oct 19 03:54:51.575227 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-9ead8334-ae82-4f9f-91b0-4ab7bbbd2d14 req-e8a53a3e-0813-4673-a1dc-4737d24d1be6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042082 Oct 19 03:54:51.576147 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3327/6596] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:54:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:54:51.700976 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ed881aa4-c027-44b5-af38-ce38b3dd6ac4 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:54:51.709118 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ed881aa4-c027-44b5-af38-ce38b3dd6ac4 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/f1ef8fca-83d2-4b91-ae54-3fe226f7a19f" status: 200 len: 1392 microversion: 2.1 time: 0.214948 Oct 19 03:54:51.713419 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3270/6597] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:54:51 2022] GET /compute/v2.1/servers/f1ef8fca-83d2-4b91-ae54-3fe226f7a19f => generated 1392 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:54:52.165153 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-64912be6-2f0a-4402-96fe-cb95b20686bb tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:54:52.165930 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-64912be6-2f0a-4402-96fe-cb95b20686bb tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: 5f833ef3-e5bd-4953-a3ca-5cddddb2641f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:54:52.173139 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-64912be6-2f0a-4402-96fe-cb95b20686bb tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:52.174336 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-64912be6-2f0a-4402-96fe-cb95b20686bb tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:52.175471 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-64912be6-2f0a-4402-96fe-cb95b20686bb tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:52.176368 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-64912be6-2f0a-4402-96fe-cb95b20686bb tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:52.176924 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-64912be6-2f0a-4402-96fe-cb95b20686bb tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:52.177363 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-64912be6-2f0a-4402-96fe-cb95b20686bb tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:52.434748 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-64912be6-2f0a-4402-96fe-cb95b20686bb tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14706e15b5d7487a9b1d1a6332f93f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea131e741ef34573aa73360c5010221a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:54:52.444569 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-220751b8-674b-4b3b-85f1-82f8c75479c2 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:54:52.445857 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-220751b8-674b-4b3b-85f1-82f8c75479c2 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] [instance: 2ba616b3-3dae-4176-a55c-39a41bee6cc1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:54:52.446924 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-64912be6-2f0a-4402-96fe-cb95b20686bb tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "GET /compute/v2.1/servers/5f833ef3-e5bd-4953-a3ca-5cddddb2641f" status: 200 len: 1367 microversion: 2.1 time: 0.288326 Oct 19 03:54:52.457425 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3328/6598] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:54:52 2022] GET /compute/v2.1/servers/5f833ef3-e5bd-4953-a3ca-5cddddb2641f => generated 1367 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:54:52.470872 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-220751b8-674b-4b3b-85f1-82f8c75479c2 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:52.471369 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-220751b8-674b-4b3b-85f1-82f8c75479c2 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:52.472378 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-220751b8-674b-4b3b-85f1-82f8c75479c2 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:52.473301 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-220751b8-674b-4b3b-85f1-82f8c75479c2 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:52.477670 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-220751b8-674b-4b3b-85f1-82f8c75479c2 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:52.477670 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-220751b8-674b-4b3b-85f1-82f8c75479c2 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:52.514530 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-220751b8-674b-4b3b-85f1-82f8c75479c2 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:52.514989 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-220751b8-674b-4b3b-85f1-82f8c75479c2 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:52.515423 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-220751b8-674b-4b3b-85f1-82f8c75479c2 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:52.516049 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-220751b8-674b-4b3b-85f1-82f8c75479c2 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lazy-loading 'fault' on Instance uuid 2ba616b3-3dae-4176-a55c-39a41bee6cc1 {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:54:52.577645 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-220751b8-674b-4b3b-85f1-82f8c75479c2 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/2ba616b3-3dae-4176-a55c-39a41bee6cc1" status: 200 len: 1453 microversion: 2.1 time: 0.136948 Oct 19 03:54:52.578224 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3271/6599] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:54:52 2022] GET /compute/v2.1/servers/2ba616b3-3dae-4176-a55c-39a41bee6cc1 => generated 1453 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:54:52.732271 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-524ee52a-1ee9-4270-9cd0-c613e1134e06 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:54:52.732911 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-524ee52a-1ee9-4270-9cd0-c613e1134e06 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: f1ef8fca-83d2-4b91-ae54-3fe226f7a19f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:54:52.739580 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-524ee52a-1ee9-4270-9cd0-c613e1134e06 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:52.740347 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-524ee52a-1ee9-4270-9cd0-c613e1134e06 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:52.740988 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-524ee52a-1ee9-4270-9cd0-c613e1134e06 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:52.741729 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-524ee52a-1ee9-4270-9cd0-c613e1134e06 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:52.742190 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-524ee52a-1ee9-4270-9cd0-c613e1134e06 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:52.742804 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-524ee52a-1ee9-4270-9cd0-c613e1134e06 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:52.913623 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-524ee52a-1ee9-4270-9cd0-c613e1134e06 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:54:52.925478 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-524ee52a-1ee9-4270-9cd0-c613e1134e06 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/f1ef8fca-83d2-4b91-ae54-3fe226f7a19f" status: 200 len: 1392 microversion: 2.1 time: 0.196425 Oct 19 03:54:52.926585 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3329/6600] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:54:52 2022] GET /compute/v2.1/servers/f1ef8fca-83d2-4b91-ae54-3fe226f7a19f => generated 1392 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:54:53.472437 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e0b3bfe6-2fdf-47d8-8d6c-33301c174c7b tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:54:53.472959 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e0b3bfe6-2fdf-47d8-8d6c-33301c174c7b tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: 5f833ef3-e5bd-4953-a3ca-5cddddb2641f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:54:53.480225 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e0b3bfe6-2fdf-47d8-8d6c-33301c174c7b tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:53.480712 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e0b3bfe6-2fdf-47d8-8d6c-33301c174c7b tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:53.481154 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e0b3bfe6-2fdf-47d8-8d6c-33301c174c7b tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:53.481882 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e0b3bfe6-2fdf-47d8-8d6c-33301c174c7b tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:53.482342 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e0b3bfe6-2fdf-47d8-8d6c-33301c174c7b tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:53.482773 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e0b3bfe6-2fdf-47d8-8d6c-33301c174c7b tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:53.602199 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-53af2628-2410-4dcf-8707-c1b7bf091345 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:54:53.603099 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-53af2628-2410-4dcf-8707-c1b7bf091345 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] [instance: 2ba616b3-3dae-4176-a55c-39a41bee6cc1] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:54:53.606291 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:54:53.611246 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-53af2628-2410-4dcf-8707-c1b7bf091345 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:53.611967 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-53af2628-2410-4dcf-8707-c1b7bf091345 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:53.612419 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-53af2628-2410-4dcf-8707-c1b7bf091345 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:53.613270 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-53af2628-2410-4dcf-8707-c1b7bf091345 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:53.613922 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-53af2628-2410-4dcf-8707-c1b7bf091345 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:53.614527 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-53af2628-2410-4dcf-8707-c1b7bf091345 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:53.620592 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e0b3bfe6-2fdf-47d8-8d6c-33301c174c7b tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14706e15b5d7487a9b1d1a6332f93f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea131e741ef34573aa73360c5010221a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:54:53.629293 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-53af2628-2410-4dcf-8707-c1b7bf091345 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] HTTP exception thrown: Instance 2ba616b3-3dae-4176-a55c-39a41bee6cc1 could not be found. Oct 19 03:54:53.630377 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e0b3bfe6-2fdf-47d8-8d6c-33301c174c7b tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "GET /compute/v2.1/servers/5f833ef3-e5bd-4953-a3ca-5cddddb2641f" status: 200 len: 1558 microversion: 2.1 time: 0.162604 Oct 19 03:54:53.630966 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3272/6601] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:54:53 2022] GET /compute/v2.1/servers/5f833ef3-e5bd-4953-a3ca-5cddddb2641f => generated 1558 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:54:53.631107 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-53af2628-2410-4dcf-8707-c1b7bf091345 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Request method failure captured: Oct 19 03:54:53.631107 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/2ba616b3-3dae-4176-a55c-39a41bee6cc1 HTTP/1.1 Oct 19 03:54:53.631107 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:54:53.631107 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:54:53.631107 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:54:53.631107 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:54:53.631107 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:54:53.631107 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:54:53.631107 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:54:53.631107 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:54:53.631107 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT3TZ3dFNRkfmhCp2LS7v8RC46zPobGtefWa33nFkKX0DsRcGyfIYPqPIfc_XMPWMvcgSgrSKmEfWYIghaQn-k1v_WQPmTXK2GUOoyupFRLqlSynq1y9Op00NtlBZAZuE93DWty1kOQoYI_bbBONuaAn8MbXoZ9mLkCDA-nVtrGhu_Gg Oct 19 03:54:53.631107 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:54:53.631107 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:54:53.631107 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:54:53.631107 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:54:53.631107 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:54:53.631107 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:54:53.631107 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 7f4b24b82352419b9bd2a6cb8e92c7e5 Oct 19 03:54:53.631107 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-TestServerMultinode-205098138 Oct 19 03:54:53.631107 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member,admin Oct 19 03:54:53.631107 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member,admin Oct 19 03:54:53.631107 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7f4b24b82352419b9bd2a6cb8e92c7e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7f4b24b82352419b9bd2a6cb8e92c7e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7f4b24b82352419b9bd2a6cb8e92c7e5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7f4b24b82352419b9bd2a6cb8e92c7e5", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:54:53.631107 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-TestServerMultinode-205098138 Oct 19 03:54:53.631107 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 7f4b24b82352419b9bd2a6cb8e92c7e5 Oct 19 03:54:53.631107 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-TestServerMultinode-205098138 Oct 19 03:54:53.631107 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-TestServerMultinode-205098138-project-admin Oct 19 03:54:53.631107 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:54:53.631107 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:54:53.631107 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 6e26061ac02e43d3a6908e385976332e Oct 19 03:54:53.631107 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-TestServerMultinode-205098138-project-admin Oct 19 03:54:53.631107 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:54:53.631107 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance 2ba616b3-3dae-4176-a55c-39a41bee6cc1 could not be found. Oct 19 03:54:53.631107 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '2ba616b3-3dae-4176-a55c-39a41bee6cc1'} Oct 19 03:54:53.631107 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:54:53.631107 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:54:53.631107 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:54:53.631107 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:54:53.631107 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:54:53.631107 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:54:53.631107 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:54:53.631107 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:54:53.631107 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:54:53.631107 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:54:53.631107 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ba616b3-3dae-4176-a55c-39a41bee6cc1 could not be found. Oct 19 03:54:53.631107 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:54:53.631107 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:54:53.631107 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:54:53.631107 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:54:53.631107 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:54:53.631107 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:54:53.631107 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:54:53.631107 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:54:53.631107 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:54:53.631107 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:54:53.631107 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:54:53.631107 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:54:53.631107 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:54:53.631107 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:54:53.631107 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:54:53.631107 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:54:53.631107 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ba616b3-3dae-4176-a55c-39a41bee6cc1 could not be found. Oct 19 03:54:53.631107 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:54:53.631107 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:54:53.631107 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:54:53.635915 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:54:53.635915 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:54:53.635915 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:54:53.635915 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:54:53.635915 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:54:53.635915 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ba616b3-3dae-4176-a55c-39a41bee6cc1 could not be found. Oct 19 03:54:53.635915 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:54:53.635915 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-53af2628-2410-4dcf-8707-c1b7bf091345 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] Returning 404 to user: Instance 2ba616b3-3dae-4176-a55c-39a41bee6cc1 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:54:53.635915 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-53af2628-2410-4dcf-8707-c1b7bf091345 tempest-TestServerMultinode-205098138 tempest-TestServerMultinode-205098138-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/2ba616b3-3dae-4176-a55c-39a41bee6cc1" status: 404 len: 111 microversion: 2.1 time: 0.034432 Oct 19 03:54:53.635915 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3330/6602] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:54:53 2022] GET /compute/v2.1/servers/2ba616b3-3dae-4176-a55c-39a41bee6cc1 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 03:54:53.650347 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-d91c4f83-9e50-495f-bf8b-79b4fb1faab9 req-288a7caf-b1da-43ac-b08f-00642277bf45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1ef8fca-83d2-4b91-ae54-3fe226f7a19f", "tag": "98a83fc3-ced4-46bb-9e55-385a65332e54"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:54:53.654789 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-d91c4f83-9e50-495f-bf8b-79b4fb1faab9 req-288a7caf-b1da-43ac-b08f-00642277bf45 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:53.655061 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0df2b82a-9777-4478-8fd9-49412fe8de8a tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:54:53.655280 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-d91c4f83-9e50-495f-bf8b-79b4fb1faab9 req-288a7caf-b1da-43ac-b08f-00642277bf45 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:53.655724 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-d91c4f83-9e50-495f-bf8b-79b4fb1faab9 req-288a7caf-b1da-43ac-b08f-00642277bf45 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:53.655960 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0df2b82a-9777-4478-8fd9-49412fe8de8a tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: 5f833ef3-e5bd-4953-a3ca-5cddddb2641f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:54:53.663169 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0df2b82a-9777-4478-8fd9-49412fe8de8a tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:53.664000 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0df2b82a-9777-4478-8fd9-49412fe8de8a tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:53.664543 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0df2b82a-9777-4478-8fd9-49412fe8de8a tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:53.665872 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0df2b82a-9777-4478-8fd9-49412fe8de8a tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:53.666428 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0df2b82a-9777-4478-8fd9-49412fe8de8a tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:53.667094 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0df2b82a-9777-4478-8fd9-49412fe8de8a tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:53.671095 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-d91c4f83-9e50-495f-bf8b-79b4fb1faab9 req-288a7caf-b1da-43ac-b08f-00642277bf45 service nova] Creating event network-changed:98a83fc3-ced4-46bb-9e55-385a65332e54 for instance f1ef8fca-83d2-4b91-ae54-3fe226f7a19f on n-h1-861333-8 Oct 19 03:54:53.676235 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-d91c4f83-9e50-495f-bf8b-79b4fb1faab9 req-288a7caf-b1da-43ac-b08f-00642277bf45 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038610 Oct 19 03:54:53.677208 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3331/6603] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:54:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:54:53.791058 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0df2b82a-9777-4478-8fd9-49412fe8de8a tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "GET /compute/v2.1/servers/5f833ef3-e5bd-4953-a3ca-5cddddb2641f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.140360 Oct 19 03:54:53.801203 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3273/6604] 10.222.0.52 () {58 vars in 1275 bytes} [Wed Oct 19 03:54:53 2022] GET /compute/v2.1/servers/5f833ef3-e5bd-4953-a3ca-5cddddb2641f/os-interface => generated 285 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:54:53.949127 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a9000506-0724-46b8-8387-36dff1df2221 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:54:53.949862 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a9000506-0724-46b8-8387-36dff1df2221 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: f1ef8fca-83d2-4b91-ae54-3fe226f7a19f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:54:53.961407 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a9000506-0724-46b8-8387-36dff1df2221 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:53.961581 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a9000506-0724-46b8-8387-36dff1df2221 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:53.964916 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a9000506-0724-46b8-8387-36dff1df2221 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:53.965688 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a9000506-0724-46b8-8387-36dff1df2221 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:53.966164 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a9000506-0724-46b8-8387-36dff1df2221 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:53.966587 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a9000506-0724-46b8-8387-36dff1df2221 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:54.231884 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a9000506-0724-46b8-8387-36dff1df2221 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:54:54.240564 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a9000506-0724-46b8-8387-36dff1df2221 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/f1ef8fca-83d2-4b91-ae54-3fe226f7a19f" status: 200 len: 1392 microversion: 2.1 time: 0.295933 Oct 19 03:54:54.254282 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3332/6605] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:54:53 2022] GET /compute/v2.1/servers/f1ef8fca-83d2-4b91-ae54-3fe226f7a19f => generated 1392 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:54:55.103803 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-b64b322d-0625-4f8d-bc88-5eb340c2989c req-f6803c78-41f5-43c6-b20c-637aa60662db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f833ef3-e5bd-4953-a3ca-5cddddb2641f", "tag": "01954836-0ba9-45ed-ac4d-bd11f0421890"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:54:55.115709 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-b64b322d-0625-4f8d-bc88-5eb340c2989c req-f6803c78-41f5-43c6-b20c-637aa60662db service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:55.116418 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-b64b322d-0625-4f8d-bc88-5eb340c2989c req-f6803c78-41f5-43c6-b20c-637aa60662db service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:55.117032 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-b64b322d-0625-4f8d-bc88-5eb340c2989c req-f6803c78-41f5-43c6-b20c-637aa60662db service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:55.129635 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-b64b322d-0625-4f8d-bc88-5eb340c2989c req-f6803c78-41f5-43c6-b20c-637aa60662db service nova] Creating event network-changed:01954836-0ba9-45ed-ac4d-bd11f0421890 for instance 5f833ef3-e5bd-4953-a3ca-5cddddb2641f on n-h2-861333-8 Oct 19 03:54:55.135301 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-b64b322d-0625-4f8d-bc88-5eb340c2989c req-f6803c78-41f5-43c6-b20c-637aa60662db service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.175501 Oct 19 03:54:55.136435 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3274/6606] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:54:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:54:55.265910 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-095f7c1e-8020-4107-b19b-da3f1b5e56b1 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:54:55.267802 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-095f7c1e-8020-4107-b19b-da3f1b5e56b1 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: f1ef8fca-83d2-4b91-ae54-3fe226f7a19f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:54:55.278591 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-095f7c1e-8020-4107-b19b-da3f1b5e56b1 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:55.279420 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-095f7c1e-8020-4107-b19b-da3f1b5e56b1 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:55.280090 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-095f7c1e-8020-4107-b19b-da3f1b5e56b1 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:55.281026 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-095f7c1e-8020-4107-b19b-da3f1b5e56b1 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:55.281708 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-095f7c1e-8020-4107-b19b-da3f1b5e56b1 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:55.282736 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-095f7c1e-8020-4107-b19b-da3f1b5e56b1 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:56.062379 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-095f7c1e-8020-4107-b19b-da3f1b5e56b1 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:54:56.070984 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-095f7c1e-8020-4107-b19b-da3f1b5e56b1 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/f1ef8fca-83d2-4b91-ae54-3fe226f7a19f" status: 200 len: 1392 microversion: 2.1 time: 0.810520 Oct 19 03:54:56.085779 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3333/6607] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:54:55 2022] GET /compute/v2.1/servers/f1ef8fca-83d2-4b91-ae54-3fe226f7a19f => generated 1392 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:54:57.098239 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-30b23070-9310-4fbc-a213-21af94fdc411 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:54:57.099077 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-30b23070-9310-4fbc-a213-21af94fdc411 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: f1ef8fca-83d2-4b91-ae54-3fe226f7a19f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:54:57.111083 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-30b23070-9310-4fbc-a213-21af94fdc411 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:57.112568 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-30b23070-9310-4fbc-a213-21af94fdc411 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:57.114377 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-30b23070-9310-4fbc-a213-21af94fdc411 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:57.116484 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-30b23070-9310-4fbc-a213-21af94fdc411 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:57.117178 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-30b23070-9310-4fbc-a213-21af94fdc411 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:57.117870 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-30b23070-9310-4fbc-a213-21af94fdc411 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:57.276725 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-30b23070-9310-4fbc-a213-21af94fdc411 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:54:57.286177 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-30b23070-9310-4fbc-a213-21af94fdc411 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/f1ef8fca-83d2-4b91-ae54-3fe226f7a19f" status: 200 len: 1392 microversion: 2.1 time: 0.193982 Oct 19 03:54:57.287049 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3275/6608] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:54:57 2022] GET /compute/v2.1/servers/f1ef8fca-83d2-4b91-ae54-3fe226f7a19f => generated 1392 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:54:58.310523 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b8c78df3-ce46-4de9-b436-3adfecfba365 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:54:58.311884 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b8c78df3-ce46-4de9-b436-3adfecfba365 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: f1ef8fca-83d2-4b91-ae54-3fe226f7a19f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:54:58.315019 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:54:58.315791 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=8 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:54:58.320865 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b8c78df3-ce46-4de9-b436-3adfecfba365 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:58.325329 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b8c78df3-ce46-4de9-b436-3adfecfba365 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:58.325329 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b8c78df3-ce46-4de9-b436-3adfecfba365 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:58.325329 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b8c78df3-ce46-4de9-b436-3adfecfba365 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:58.325329 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b8c78df3-ce46-4de9-b436-3adfecfba365 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:58.325329 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b8c78df3-ce46-4de9-b436-3adfecfba365 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:58.531847 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b8c78df3-ce46-4de9-b436-3adfecfba365 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:54:58.540555 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b8c78df3-ce46-4de9-b436-3adfecfba365 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/f1ef8fca-83d2-4b91-ae54-3fe226f7a19f" status: 200 len: 1392 microversion: 2.1 time: 0.233893 Oct 19 03:54:58.541139 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3334/6609] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:54:58 2022] GET /compute/v2.1/servers/f1ef8fca-83d2-4b91-ae54-3fe226f7a19f => generated 1392 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:54:59.564961 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c1cdc864-5ea0-48c3-a973-4a8d2228e6e0 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:54:59.567459 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c1cdc864-5ea0-48c3-a973-4a8d2228e6e0 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: f1ef8fca-83d2-4b91-ae54-3fe226f7a19f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:54:59.587226 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-4d18ced4-089e-4c58-a6ad-f7346897a217 req-b6d0d9d6-4fc3-4c6e-9b65-f95d3718755b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1ef8fca-83d2-4b91-ae54-3fe226f7a19f", "name": "network-vif-plugged", "status": "completed", "tag": "98a83fc3-ced4-46bb-9e55-385a65332e54"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:54:59.600142 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c1cdc864-5ea0-48c3-a973-4a8d2228e6e0 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:59.600650 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c1cdc864-5ea0-48c3-a973-4a8d2228e6e0 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:59.601099 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c1cdc864-5ea0-48c3-a973-4a8d2228e6e0 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:59.608952 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-4d18ced4-089e-4c58-a6ad-f7346897a217 req-b6d0d9d6-4fc3-4c6e-9b65-f95d3718755b service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:59.609476 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-4d18ced4-089e-4c58-a6ad-f7346897a217 req-b6d0d9d6-4fc3-4c6e-9b65-f95d3718755b service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:59.609913 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-4d18ced4-089e-4c58-a6ad-f7346897a217 req-b6d0d9d6-4fc3-4c6e-9b65-f95d3718755b service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:59.612042 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c1cdc864-5ea0-48c3-a973-4a8d2228e6e0 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:54:59.613290 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c1cdc864-5ea0-48c3-a973-4a8d2228e6e0 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:54:59.614154 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c1cdc864-5ea0-48c3-a973-4a8d2228e6e0 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:54:59.636817 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-4d18ced4-089e-4c58-a6ad-f7346897a217 req-b6d0d9d6-4fc3-4c6e-9b65-f95d3718755b service nova] Creating event network-vif-plugged:98a83fc3-ced4-46bb-9e55-385a65332e54 for instance f1ef8fca-83d2-4b91-ae54-3fe226f7a19f on n-h1-861333-8 Oct 19 03:54:59.642813 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-4d18ced4-089e-4c58-a6ad-f7346897a217 req-b6d0d9d6-4fc3-4c6e-9b65-f95d3718755b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062775 Oct 19 03:54:59.644400 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3335/6610] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:54:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:54:59.940632 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c1cdc864-5ea0-48c3-a973-4a8d2228e6e0 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:54:59.948527 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c1cdc864-5ea0-48c3-a973-4a8d2228e6e0 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/f1ef8fca-83d2-4b91-ae54-3fe226f7a19f" status: 200 len: 1392 microversion: 2.1 time: 0.388103 Oct 19 03:54:59.949190 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3276/6611] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:54:59 2022] GET /compute/v2.1/servers/f1ef8fca-83d2-4b91-ae54-3fe226f7a19f => generated 1392 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:55:00.974484 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-480a81fe-5d79-45b7-98e4-07171b99cb8f tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:55:00.975354 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-480a81fe-5d79-45b7-98e4-07171b99cb8f tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: f1ef8fca-83d2-4b91-ae54-3fe226f7a19f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:55:00.984289 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-480a81fe-5d79-45b7-98e4-07171b99cb8f tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:55:00.985098 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-480a81fe-5d79-45b7-98e4-07171b99cb8f tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:55:00.985872 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-480a81fe-5d79-45b7-98e4-07171b99cb8f tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:55:00.986593 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-480a81fe-5d79-45b7-98e4-07171b99cb8f tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:55:00.987589 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-480a81fe-5d79-45b7-98e4-07171b99cb8f tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:55:00.988213 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-480a81fe-5d79-45b7-98e4-07171b99cb8f tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:55:01.297924 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-480a81fe-5d79-45b7-98e4-07171b99cb8f tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:55:01.311113 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-480a81fe-5d79-45b7-98e4-07171b99cb8f tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/f1ef8fca-83d2-4b91-ae54-3fe226f7a19f" status: 200 len: 1392 microversion: 2.1 time: 0.340383 Oct 19 03:55:01.315221 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3336/6612] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:55:00 2022] GET /compute/v2.1/servers/f1ef8fca-83d2-4b91-ae54-3fe226f7a19f => generated 1392 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:55:02.339643 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6dddfc8f-3559-4311-9699-db0ce2fbc527 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:55:02.340269 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6dddfc8f-3559-4311-9699-db0ce2fbc527 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: f1ef8fca-83d2-4b91-ae54-3fe226f7a19f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:55:02.347344 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6dddfc8f-3559-4311-9699-db0ce2fbc527 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:55:02.347834 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6dddfc8f-3559-4311-9699-db0ce2fbc527 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:55:02.348281 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6dddfc8f-3559-4311-9699-db0ce2fbc527 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:55:02.348979 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6dddfc8f-3559-4311-9699-db0ce2fbc527 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:55:02.349465 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6dddfc8f-3559-4311-9699-db0ce2fbc527 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:55:02.349904 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6dddfc8f-3559-4311-9699-db0ce2fbc527 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:55:02.824981 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-6dddfc8f-3559-4311-9699-db0ce2fbc527 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:55:02.836361 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6dddfc8f-3559-4311-9699-db0ce2fbc527 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/f1ef8fca-83d2-4b91-ae54-3fe226f7a19f" status: 200 len: 1564 microversion: 2.1 time: 0.500736 Oct 19 03:55:02.836945 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3277/6613] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:55:02 2022] GET /compute/v2.1/servers/f1ef8fca-83d2-4b91-ae54-3fe226f7a19f => generated 1564 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:55:02.863951 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6f59e731-4a43-40f0-8d27-7a64292c8609 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:55:02.864588 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6f59e731-4a43-40f0-8d27-7a64292c8609 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: f1ef8fca-83d2-4b91-ae54-3fe226f7a19f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:55:02.872948 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6f59e731-4a43-40f0-8d27-7a64292c8609 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:55:02.874271 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6f59e731-4a43-40f0-8d27-7a64292c8609 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:55:02.874726 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6f59e731-4a43-40f0-8d27-7a64292c8609 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:55:02.875942 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6f59e731-4a43-40f0-8d27-7a64292c8609 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:55:02.876215 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6f59e731-4a43-40f0-8d27-7a64292c8609 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:55:02.876814 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6f59e731-4a43-40f0-8d27-7a64292c8609 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:55:03.035257 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-6f59e731-4a43-40f0-8d27-7a64292c8609 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:55:03.054168 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6f59e731-4a43-40f0-8d27-7a64292c8609 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/f1ef8fca-83d2-4b91-ae54-3fe226f7a19f" status: 200 len: 1564 microversion: 2.1 time: 0.197854 Oct 19 03:55:03.070580 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3337/6614] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:55:02 2022] GET /compute/v2.1/servers/f1ef8fca-83d2-4b91-ae54-3fe226f7a19f => generated 1564 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:55:05.370345 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9672cfeb-b486-41ca-ab8e-679adeb046b2 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:55:05.371069 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9672cfeb-b486-41ca-ab8e-679adeb046b2 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: f1ef8fca-83d2-4b91-ae54-3fe226f7a19f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:55:05.387053 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-4b771edc-504e-49ab-ad40-66f34a9d0670 req-2e205c3f-4f72-42d2-a5ed-90aad8a19e96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1ef8fca-83d2-4b91-ae54-3fe226f7a19f", "tag": "98a83fc3-ced4-46bb-9e55-385a65332e54"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:55:05.387581 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9672cfeb-b486-41ca-ab8e-679adeb046b2 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:55:05.388313 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9672cfeb-b486-41ca-ab8e-679adeb046b2 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:55:05.390277 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9672cfeb-b486-41ca-ab8e-679adeb046b2 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:55:05.393170 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9672cfeb-b486-41ca-ab8e-679adeb046b2 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:55:05.394860 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9672cfeb-b486-41ca-ab8e-679adeb046b2 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:55:05.395896 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9672cfeb-b486-41ca-ab8e-679adeb046b2 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:55:05.404558 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=100 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:55:05.412738 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-4b771edc-504e-49ab-ad40-66f34a9d0670 req-2e205c3f-4f72-42d2-a5ed-90aad8a19e96 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:55:05.412738 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-4b771edc-504e-49ab-ad40-66f34a9d0670 req-2e205c3f-4f72-42d2-a5ed-90aad8a19e96 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:55:05.412738 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-4b771edc-504e-49ab-ad40-66f34a9d0670 req-2e205c3f-4f72-42d2-a5ed-90aad8a19e96 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:55:05.437046 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-4b771edc-504e-49ab-ad40-66f34a9d0670 req-2e205c3f-4f72-42d2-a5ed-90aad8a19e96 service nova] Creating event network-changed:98a83fc3-ced4-46bb-9e55-385a65332e54 for instance f1ef8fca-83d2-4b91-ae54-3fe226f7a19f on n-h1-861333-8 Oct 19 03:55:05.445223 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-4b771edc-504e-49ab-ad40-66f34a9d0670 req-2e205c3f-4f72-42d2-a5ed-90aad8a19e96 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061408 Oct 19 03:55:05.446552 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3338/6615] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:55:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:55:05.648425 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9672cfeb-b486-41ca-ab8e-679adeb046b2 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:55:05.667511 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9672cfeb-b486-41ca-ab8e-679adeb046b2 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/f1ef8fca-83d2-4b91-ae54-3fe226f7a19f" status: 200 len: 1564 microversion: 2.1 time: 0.300884 Oct 19 03:55:05.668436 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3278/6616] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:55:05 2022] GET /compute/v2.1/servers/f1ef8fca-83d2-4b91-ae54-3fe226f7a19f => generated 1564 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:55:32.044213 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=17 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:55:32.045036 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:55:32.049111 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-38f27326-f2a1-4c06-97a9-98336a0ee475 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:55:32.049715 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-38f27326-f2a1-4c06-97a9-98336a0ee475 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: 5f833ef3-e5bd-4953-a3ca-5cddddb2641f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:55:32.056252 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-38f27326-f2a1-4c06-97a9-98336a0ee475 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:55:32.056737 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-38f27326-f2a1-4c06-97a9-98336a0ee475 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:55:32.057171 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-38f27326-f2a1-4c06-97a9-98336a0ee475 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:55:32.057879 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-38f27326-f2a1-4c06-97a9-98336a0ee475 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:55:32.058334 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-38f27326-f2a1-4c06-97a9-98336a0ee475 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:55:32.058754 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-38f27326-f2a1-4c06-97a9-98336a0ee475 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:55:32.081663 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-38f27326-f2a1-4c06-97a9-98336a0ee475 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "GET /compute/v2.1/servers/5f833ef3-e5bd-4953-a3ca-5cddddb2641f/ips" status: 200 len: 150 microversion: 2.1 time: 0.039419 Oct 19 03:55:32.082279 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3339/6617] 10.222.0.52 () {58 vars in 1248 bytes} [Wed Oct 19 03:55:32 2022] GET /compute/v2.1/servers/5f833ef3-e5bd-4953-a3ca-5cddddb2641f/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:55:34.928156 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-06473e46-12a2-4df4-939a-597b10e290b3 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d6c0a330-4bb6-48cf-92d2-d74238c3cd54"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:55:34.930599 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-06473e46-12a2-4df4-939a-597b10e290b3 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: 5f833ef3-e5bd-4953-a3ca-5cddddb2641f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:55:34.932974 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=27 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:55:34.937994 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-06473e46-12a2-4df4-939a-597b10e290b3 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:55:34.942925 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-06473e46-12a2-4df4-939a-597b10e290b3 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:55:34.942925 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-06473e46-12a2-4df4-939a-597b10e290b3 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:55:34.942925 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-06473e46-12a2-4df4-939a-597b10e290b3 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:55:34.942925 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-06473e46-12a2-4df4-939a-597b10e290b3 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:55:34.942925 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-06473e46-12a2-4df4-939a-597b10e290b3 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:55:35.783557 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-06473e46-12a2-4df4-939a-597b10e290b3 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "POST /compute/v2.1/servers/5f833ef3-e5bd-4953-a3ca-5cddddb2641f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.859929 Oct 19 03:55:35.784129 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3279/6618] 10.222.0.52 () {60 vars in 1323 bytes} [Wed Oct 19 03:55:34 2022] POST /compute/v2.1/servers/5f833ef3-e5bd-4953-a3ca-5cddddb2641f/os-volume_attachments => generated 194 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:55:37.020799 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-596f68ca-fb3a-43fb-9314-5dfdbf085f18 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:55:37.023591 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-596f68ca-fb3a-43fb-9314-5dfdbf085f18 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: f1ef8fca-83d2-4b91-ae54-3fe226f7a19f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:55:37.031456 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-596f68ca-fb3a-43fb-9314-5dfdbf085f18 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:55:37.032184 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-596f68ca-fb3a-43fb-9314-5dfdbf085f18 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:55:37.032730 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-596f68ca-fb3a-43fb-9314-5dfdbf085f18 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:55:37.033574 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-596f68ca-fb3a-43fb-9314-5dfdbf085f18 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:55:37.034176 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-596f68ca-fb3a-43fb-9314-5dfdbf085f18 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:55:37.034732 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-596f68ca-fb3a-43fb-9314-5dfdbf085f18 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:55:37.103871 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-596f68ca-fb3a-43fb-9314-5dfdbf085f18 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "POST /compute/v2.1/servers/f1ef8fca-83d2-4b91-ae54-3fe226f7a19f/action" status: 200 len: 24572 microversion: 2.1 time: 0.088407 Oct 19 03:55:37.105208 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3340/6619] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:55:37 2022] POST /compute/v2.1/servers/f1ef8fca-83d2-4b91-ae54-3fe226f7a19f/action => generated 24572 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 03:55:47.599897 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:55:47.600875 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=15,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:55:47.604868 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-90fe605c-48bd-4128-8a0e-97107da7d3e9 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Action: 'create', calling method: .version_select at 0x7fc12b936550>, body: {"keypair": {"name": "tempest-keypair-1550976726", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJI8XdjvXFwgbqYcd4UwoS8/nWMjmIOtSgI4OLIKn2ZZ5ABNyberEudYr03fTojIzk9ucgWXEIa4U1DG2n75aYTIF8gt9gifh/XnWg6ARs61cBuZjABTn4QRAOc4X0qFhg=="}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:55:47.621993 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-90fe605c-48bd-4128-8a0e-97107da7d3e9 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Getting quotas for project ea131e741ef34573aa73360c5010221a. Resources: {'key_pairs'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:55:47.627536 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-90fe605c-48bd-4128-8a0e-97107da7d3e9 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Getting quotas for user 14706e15b5d7487a9b1d1a6332f93f7c and project ea131e741ef34573aa73360c5010221a. Resources: {'key_pairs'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:55:47.720935 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-90fe605c-48bd-4128-8a0e-97107da7d3e9 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.123467 Oct 19 03:55:47.728218 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3280/6620] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Oct 19 03:55:47 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:55:50.292106 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5b35eb83-489a-4aa6-985e-49af0748713a tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1612058449", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "41fa7d07-f5eb-4de7-9c08-67821611f5f1"}], "security_groups": [{"name": "tempest-securitygroup--286544707"}], "key_name": "tempest-keypair-1550976726", "user_data": "}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:55:50.302026 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=4 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:55:50.408204 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.network.neutron [None req-5b35eb83-489a-4aa6-985e-49af0748713a tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] validate_networks() for [('41fa7d07-f5eb-4de7-9c08-67821611f5f1', None, None, None, None, None)] {{(pid=121135) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:55:50.791510 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-5b35eb83-489a-4aa6-985e-49af0748713a tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Flavor limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:55:50.792069 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-5b35eb83-489a-4aa6-985e-49af0748713a tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Image limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:55:50.792626 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-5b35eb83-489a-4aa6-985e-49af0748713a tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Flavor pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:55:50.793117 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-5b35eb83-489a-4aa6-985e-49af0748713a tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Image pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:55:50.793667 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-5b35eb83-489a-4aa6-985e-49af0748713a tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:55:50.803247 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5b35eb83-489a-4aa6-985e-49af0748713a tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:55:50.803738 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5b35eb83-489a-4aa6-985e-49af0748713a tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:55:50.804180 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5b35eb83-489a-4aa6-985e-49af0748713a tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:55:50.804912 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5b35eb83-489a-4aa6-985e-49af0748713a tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:55:50.805389 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5b35eb83-489a-4aa6-985e-49af0748713a tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:55:50.805822 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5b35eb83-489a-4aa6-985e-49af0748713a tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:55:50.822592 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-5b35eb83-489a-4aa6-985e-49af0748713a tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Getting quotas for project ea131e741ef34573aa73360c5010221a. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:55:50.828115 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-5b35eb83-489a-4aa6-985e-49af0748713a tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Getting quotas for user 14706e15b5d7487a9b1d1a6332f93f7c and project ea131e741ef34573aa73360c5010221a. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:55:50.841213 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-5b35eb83-489a-4aa6-985e-49af0748713a tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Going to run 1 instances... {{(pid=121135) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:55:50.843626 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-5b35eb83-489a-4aa6-985e-49af0748713a tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: ac1213da-e573-4522-a8cd-685e598892f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121135) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:55:50.944208 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5b35eb83-489a-4aa6-985e-49af0748713a tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.657089 Oct 19 03:55:50.945170 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3341/6621] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:55:50 2022] POST /compute/v2.1/servers => generated 401 bytes in 659 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 03:55:50.957909 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-923a8270-ea79-470f-aea5-f6aa1490f700 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:55:50.958679 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-923a8270-ea79-470f-aea5-f6aa1490f700 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: ac1213da-e573-4522-a8cd-685e598892f3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:55:51.024390 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-923a8270-ea79-470f-aea5-f6aa1490f700 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14706e15b5d7487a9b1d1a6332f93f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea131e741ef34573aa73360c5010221a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:55:51.032063 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-923a8270-ea79-470f-aea5-f6aa1490f700 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "GET /compute/v2.1/servers/ac1213da-e573-4522-a8cd-685e598892f3" status: 200 len: 1242 microversion: 2.1 time: 0.079881 Oct 19 03:55:51.032767 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3281/6622] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:55:50 2022] GET /compute/v2.1/servers/ac1213da-e573-4522-a8cd-685e598892f3 => generated 1242 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:55:52.056897 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-40c3d539-a5a8-488e-9ee8-5dc6b2363838 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:55:52.057554 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-40c3d539-a5a8-488e-9ee8-5dc6b2363838 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: ac1213da-e573-4522-a8cd-685e598892f3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:55:52.064546 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-40c3d539-a5a8-488e-9ee8-5dc6b2363838 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:55:52.065038 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-40c3d539-a5a8-488e-9ee8-5dc6b2363838 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:55:52.065506 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-40c3d539-a5a8-488e-9ee8-5dc6b2363838 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:55:52.066201 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-40c3d539-a5a8-488e-9ee8-5dc6b2363838 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:55:52.066693 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-40c3d539-a5a8-488e-9ee8-5dc6b2363838 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:55:52.067124 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-40c3d539-a5a8-488e-9ee8-5dc6b2363838 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:55:52.145188 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-40c3d539-a5a8-488e-9ee8-5dc6b2363838 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14706e15b5d7487a9b1d1a6332f93f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea131e741ef34573aa73360c5010221a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:55:52.153072 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-40c3d539-a5a8-488e-9ee8-5dc6b2363838 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "GET /compute/v2.1/servers/ac1213da-e573-4522-a8cd-685e598892f3" status: 200 len: 1246 microversion: 2.1 time: 0.101113 Oct 19 03:55:52.153909 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3342/6623] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:55:52 2022] GET /compute/v2.1/servers/ac1213da-e573-4522-a8cd-685e598892f3 => generated 1246 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:55:53.176386 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0b9bca64-1fdc-447c-9fdb-5e9362a55da4 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:55:53.177007 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0b9bca64-1fdc-447c-9fdb-5e9362a55da4 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: ac1213da-e573-4522-a8cd-685e598892f3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:55:53.184879 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0b9bca64-1fdc-447c-9fdb-5e9362a55da4 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:55:53.185381 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0b9bca64-1fdc-447c-9fdb-5e9362a55da4 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:55:53.185828 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0b9bca64-1fdc-447c-9fdb-5e9362a55da4 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:55:53.186516 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0b9bca64-1fdc-447c-9fdb-5e9362a55da4 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:55:53.186971 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0b9bca64-1fdc-447c-9fdb-5e9362a55da4 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:55:53.187401 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0b9bca64-1fdc-447c-9fdb-5e9362a55da4 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:55:53.305573 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0b9bca64-1fdc-447c-9fdb-5e9362a55da4 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14706e15b5d7487a9b1d1a6332f93f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea131e741ef34573aa73360c5010221a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:55:53.315161 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0b9bca64-1fdc-447c-9fdb-5e9362a55da4 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "GET /compute/v2.1/servers/ac1213da-e573-4522-a8cd-685e598892f3" status: 200 len: 1302 microversion: 2.1 time: 0.142836 Oct 19 03:55:53.333117 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3282/6624] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:55:53 2022] GET /compute/v2.1/servers/ac1213da-e573-4522-a8cd-685e598892f3 => generated 1302 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:55:54.340314 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-38a23100-3c0c-4d46-8562-62ad9504d97d tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:55:54.340882 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-38a23100-3c0c-4d46-8562-62ad9504d97d tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: ac1213da-e573-4522-a8cd-685e598892f3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:55:54.355089 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-38a23100-3c0c-4d46-8562-62ad9504d97d tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:55:54.355591 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-38a23100-3c0c-4d46-8562-62ad9504d97d tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:55:54.356039 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-38a23100-3c0c-4d46-8562-62ad9504d97d tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:55:54.356751 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-38a23100-3c0c-4d46-8562-62ad9504d97d tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:55:54.357210 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-38a23100-3c0c-4d46-8562-62ad9504d97d tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:55:54.357668 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-38a23100-3c0c-4d46-8562-62ad9504d97d tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:55:54.629727 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-38a23100-3c0c-4d46-8562-62ad9504d97d tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14706e15b5d7487a9b1d1a6332f93f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea131e741ef34573aa73360c5010221a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:55:54.637815 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-38a23100-3c0c-4d46-8562-62ad9504d97d tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "GET /compute/v2.1/servers/ac1213da-e573-4522-a8cd-685e598892f3" status: 200 len: 1367 microversion: 2.1 time: 0.301437 Oct 19 03:55:54.653389 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3343/6625] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:55:54 2022] GET /compute/v2.1/servers/ac1213da-e573-4522-a8cd-685e598892f3 => generated 1367 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:55:55.229248 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-d8d4b12b-c87d-47b4-bc6b-fb8511869536 req-70f9db9b-aebe-461e-8cd0-5ca5c201c9f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac1213da-e573-4522-a8cd-685e598892f3", "tag": "e039f998-073a-4974-a2eb-9d3fae5bf2d4"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:55:55.240340 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-d8d4b12b-c87d-47b4-bc6b-fb8511869536 req-70f9db9b-aebe-461e-8cd0-5ca5c201c9f8 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:55:55.240966 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-d8d4b12b-c87d-47b4-bc6b-fb8511869536 req-70f9db9b-aebe-461e-8cd0-5ca5c201c9f8 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:55:55.241519 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-d8d4b12b-c87d-47b4-bc6b-fb8511869536 req-70f9db9b-aebe-461e-8cd0-5ca5c201c9f8 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:55:55.252762 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-d8d4b12b-c87d-47b4-bc6b-fb8511869536 req-70f9db9b-aebe-461e-8cd0-5ca5c201c9f8 service nova] Creating event network-changed:e039f998-073a-4974-a2eb-9d3fae5bf2d4 for instance ac1213da-e573-4522-a8cd-685e598892f3 on n-h2-861333-8 Oct 19 03:55:55.258679 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-d8d4b12b-c87d-47b4-bc6b-fb8511869536 req-70f9db9b-aebe-461e-8cd0-5ca5c201c9f8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037008 Oct 19 03:55:55.259385 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3283/6626] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:55:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:55:55.661688 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-883b78a9-f206-49af-b3c7-962bcbb5cbfc tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:55:55.663128 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-883b78a9-f206-49af-b3c7-962bcbb5cbfc tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: ac1213da-e573-4522-a8cd-685e598892f3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:55:55.670425 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-883b78a9-f206-49af-b3c7-962bcbb5cbfc tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:55:55.670997 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-883b78a9-f206-49af-b3c7-962bcbb5cbfc tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:55:55.671628 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-883b78a9-f206-49af-b3c7-962bcbb5cbfc tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:55:55.672551 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-883b78a9-f206-49af-b3c7-962bcbb5cbfc tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:55:55.673173 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-883b78a9-f206-49af-b3c7-962bcbb5cbfc tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:55:55.673795 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-883b78a9-f206-49af-b3c7-962bcbb5cbfc tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:55:55.882344 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-883b78a9-f206-49af-b3c7-962bcbb5cbfc tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14706e15b5d7487a9b1d1a6332f93f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea131e741ef34573aa73360c5010221a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:55:55.891101 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-883b78a9-f206-49af-b3c7-962bcbb5cbfc tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "GET /compute/v2.1/servers/ac1213da-e573-4522-a8cd-685e598892f3" status: 200 len: 1367 microversion: 2.1 time: 0.233394 Oct 19 03:55:55.891701 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3344/6627] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:55:55 2022] GET /compute/v2.1/servers/ac1213da-e573-4522-a8cd-685e598892f3 => generated 1367 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:55:56.915315 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-390f11c0-eca5-4aaa-95e1-39285cb38a1b tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:55:56.916024 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-390f11c0-eca5-4aaa-95e1-39285cb38a1b tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: ac1213da-e573-4522-a8cd-685e598892f3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:55:56.923306 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-390f11c0-eca5-4aaa-95e1-39285cb38a1b tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:55:56.924776 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-390f11c0-eca5-4aaa-95e1-39285cb38a1b tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:55:56.925207 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-390f11c0-eca5-4aaa-95e1-39285cb38a1b tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:55:56.926684 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-390f11c0-eca5-4aaa-95e1-39285cb38a1b tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:55:56.927157 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-390f11c0-eca5-4aaa-95e1-39285cb38a1b tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:55:56.927698 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-390f11c0-eca5-4aaa-95e1-39285cb38a1b tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:55:57.057068 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-390f11c0-eca5-4aaa-95e1-39285cb38a1b tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14706e15b5d7487a9b1d1a6332f93f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea131e741ef34573aa73360c5010221a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:55:57.064783 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-390f11c0-eca5-4aaa-95e1-39285cb38a1b tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "GET /compute/v2.1/servers/ac1213da-e573-4522-a8cd-685e598892f3" status: 200 len: 1367 microversion: 2.1 time: 0.154049 Oct 19 03:55:57.065416 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3284/6628] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:55:56 2022] GET /compute/v2.1/servers/ac1213da-e573-4522-a8cd-685e598892f3 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:55:58.092678 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7fa77961-d688-455f-b377-6a5a1ae91955 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:55:58.093107 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7fa77961-d688-455f-b377-6a5a1ae91955 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: ac1213da-e573-4522-a8cd-685e598892f3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:55:58.100988 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7fa77961-d688-455f-b377-6a5a1ae91955 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:55:58.101526 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7fa77961-d688-455f-b377-6a5a1ae91955 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:55:58.101980 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7fa77961-d688-455f-b377-6a5a1ae91955 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:55:58.102690 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7fa77961-d688-455f-b377-6a5a1ae91955 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:55:58.103159 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7fa77961-d688-455f-b377-6a5a1ae91955 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:55:58.103588 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7fa77961-d688-455f-b377-6a5a1ae91955 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:55:58.241090 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7fa77961-d688-455f-b377-6a5a1ae91955 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14706e15b5d7487a9b1d1a6332f93f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea131e741ef34573aa73360c5010221a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:55:58.248920 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7fa77961-d688-455f-b377-6a5a1ae91955 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "GET /compute/v2.1/servers/ac1213da-e573-4522-a8cd-685e598892f3" status: 200 len: 1367 microversion: 2.1 time: 0.160455 Oct 19 03:55:58.249591 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3345/6629] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:55:58 2022] GET /compute/v2.1/servers/ac1213da-e573-4522-a8cd-685e598892f3 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:55:59.272302 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c2f49d47-848f-4cbd-ae26-8337d1f7afc5 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:55:59.272920 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c2f49d47-848f-4cbd-ae26-8337d1f7afc5 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: ac1213da-e573-4522-a8cd-685e598892f3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:55:59.280521 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c2f49d47-848f-4cbd-ae26-8337d1f7afc5 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:55:59.285711 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c2f49d47-848f-4cbd-ae26-8337d1f7afc5 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:55:59.285711 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c2f49d47-848f-4cbd-ae26-8337d1f7afc5 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:55:59.285711 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c2f49d47-848f-4cbd-ae26-8337d1f7afc5 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:55:59.285711 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c2f49d47-848f-4cbd-ae26-8337d1f7afc5 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:55:59.285711 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c2f49d47-848f-4cbd-ae26-8337d1f7afc5 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:55:59.416698 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c2f49d47-848f-4cbd-ae26-8337d1f7afc5 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14706e15b5d7487a9b1d1a6332f93f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea131e741ef34573aa73360c5010221a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:55:59.422554 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c2f49d47-848f-4cbd-ae26-8337d1f7afc5 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "GET /compute/v2.1/servers/ac1213da-e573-4522-a8cd-685e598892f3" status: 200 len: 1367 microversion: 2.1 time: 0.154522 Oct 19 03:55:59.423132 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3285/6630] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:55:59 2022] GET /compute/v2.1/servers/ac1213da-e573-4522-a8cd-685e598892f3 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:56:00.445679 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-50c15d84-c1be-4db1-b108-619c9aab67d5 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:56:00.446708 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-50c15d84-c1be-4db1-b108-619c9aab67d5 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: ac1213da-e573-4522-a8cd-685e598892f3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:56:00.455315 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-50c15d84-c1be-4db1-b108-619c9aab67d5 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:00.455916 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-50c15d84-c1be-4db1-b108-619c9aab67d5 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:00.456551 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-50c15d84-c1be-4db1-b108-619c9aab67d5 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:00.457938 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-50c15d84-c1be-4db1-b108-619c9aab67d5 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:00.458401 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-50c15d84-c1be-4db1-b108-619c9aab67d5 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:00.458839 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-50c15d84-c1be-4db1-b108-619c9aab67d5 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:00.599412 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-50c15d84-c1be-4db1-b108-619c9aab67d5 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14706e15b5d7487a9b1d1a6332f93f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea131e741ef34573aa73360c5010221a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:56:00.607623 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-50c15d84-c1be-4db1-b108-619c9aab67d5 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "GET /compute/v2.1/servers/ac1213da-e573-4522-a8cd-685e598892f3" status: 200 len: 1367 microversion: 2.1 time: 0.166555 Oct 19 03:56:00.608490 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3346/6631] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:56:00 2022] GET /compute/v2.1/servers/ac1213da-e573-4522-a8cd-685e598892f3 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:56:00.679272 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-b9fa1c9a-e60a-4628-b059-10738809462d req-88790f72-1ec4-49fe-b125-66420f216bb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac1213da-e573-4522-a8cd-685e598892f3", "name": "network-vif-plugged", "status": "completed", "tag": "e039f998-073a-4974-a2eb-9d3fae5bf2d4"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:56:00.689481 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-b9fa1c9a-e60a-4628-b059-10738809462d req-88790f72-1ec4-49fe-b125-66420f216bb2 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:00.689960 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-b9fa1c9a-e60a-4628-b059-10738809462d req-88790f72-1ec4-49fe-b125-66420f216bb2 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:00.692169 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-b9fa1c9a-e60a-4628-b059-10738809462d req-88790f72-1ec4-49fe-b125-66420f216bb2 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:00.701842 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-b9fa1c9a-e60a-4628-b059-10738809462d req-88790f72-1ec4-49fe-b125-66420f216bb2 service nova] Creating event network-vif-plugged:e039f998-073a-4974-a2eb-9d3fae5bf2d4 for instance ac1213da-e573-4522-a8cd-685e598892f3 on n-h2-861333-8 Oct 19 03:56:00.706840 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-b9fa1c9a-e60a-4628-b059-10738809462d req-88790f72-1ec4-49fe-b125-66420f216bb2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031998 Oct 19 03:56:00.707415 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3286/6632] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:56:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:56:01.633902 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e002c0a2-3b8e-4212-bcec-85905f4b2312 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:56:01.635127 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e002c0a2-3b8e-4212-bcec-85905f4b2312 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: ac1213da-e573-4522-a8cd-685e598892f3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:56:01.637721 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:56:01.638551 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=6 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:56:01.645256 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e002c0a2-3b8e-4212-bcec-85905f4b2312 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:01.645899 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e002c0a2-3b8e-4212-bcec-85905f4b2312 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:01.646237 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e002c0a2-3b8e-4212-bcec-85905f4b2312 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:01.646956 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e002c0a2-3b8e-4212-bcec-85905f4b2312 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:01.647417 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e002c0a2-3b8e-4212-bcec-85905f4b2312 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:01.647848 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e002c0a2-3b8e-4212-bcec-85905f4b2312 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:01.784830 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-e002c0a2-3b8e-4212-bcec-85905f4b2312 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14706e15b5d7487a9b1d1a6332f93f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea131e741ef34573aa73360c5010221a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:56:01.792834 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e002c0a2-3b8e-4212-bcec-85905f4b2312 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "GET /compute/v2.1/servers/ac1213da-e573-4522-a8cd-685e598892f3" status: 200 len: 1367 microversion: 2.1 time: 0.163931 Oct 19 03:56:01.793470 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3347/6633] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:56:01 2022] GET /compute/v2.1/servers/ac1213da-e573-4522-a8cd-685e598892f3 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:56:02.812832 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=6 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:56:02.817884 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-49f35235-8f82-462b-86f3-de6bef51bd55 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:56:02.818586 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-49f35235-8f82-462b-86f3-de6bef51bd55 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: ac1213da-e573-4522-a8cd-685e598892f3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:56:02.824989 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-49f35235-8f82-462b-86f3-de6bef51bd55 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:02.825506 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-49f35235-8f82-462b-86f3-de6bef51bd55 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:02.825995 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-49f35235-8f82-462b-86f3-de6bef51bd55 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:02.826687 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-49f35235-8f82-462b-86f3-de6bef51bd55 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:02.827139 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-49f35235-8f82-462b-86f3-de6bef51bd55 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:02.827854 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-49f35235-8f82-462b-86f3-de6bef51bd55 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:02.957600 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-49f35235-8f82-462b-86f3-de6bef51bd55 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14706e15b5d7487a9b1d1a6332f93f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea131e741ef34573aa73360c5010221a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:56:02.965482 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-49f35235-8f82-462b-86f3-de6bef51bd55 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "GET /compute/v2.1/servers/ac1213da-e573-4522-a8cd-685e598892f3" status: 200 len: 1558 microversion: 2.1 time: 0.153515 Oct 19 03:56:02.966086 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3287/6634] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:56:02 2022] GET /compute/v2.1/servers/ac1213da-e573-4522-a8cd-685e598892f3 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:56:02.988421 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b5d6fd1a-b02a-4855-83df-4534fdbb5c2d tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:56:02.988952 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b5d6fd1a-b02a-4855-83df-4534fdbb5c2d tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: ac1213da-e573-4522-a8cd-685e598892f3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:56:02.996440 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b5d6fd1a-b02a-4855-83df-4534fdbb5c2d tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:02.997003 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b5d6fd1a-b02a-4855-83df-4534fdbb5c2d tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:02.997541 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b5d6fd1a-b02a-4855-83df-4534fdbb5c2d tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:02.998302 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b5d6fd1a-b02a-4855-83df-4534fdbb5c2d tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:02.998755 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b5d6fd1a-b02a-4855-83df-4534fdbb5c2d tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:02.999178 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b5d6fd1a-b02a-4855-83df-4534fdbb5c2d tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:03.079452 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b5d6fd1a-b02a-4855-83df-4534fdbb5c2d tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "GET /compute/v2.1/servers/ac1213da-e573-4522-a8cd-685e598892f3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095093 Oct 19 03:56:03.080064 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3348/6635] 10.222.0.52 () {58 vars in 1275 bytes} [Wed Oct 19 03:56:02 2022] GET /compute/v2.1/servers/ac1213da-e573-4522-a8cd-685e598892f3/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:56:04.079251 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-d46af48b-52c1-4022-be72-a98063c7a219 req-7441ec59-46ba-4bd2-82f3-b98eacee66f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac1213da-e573-4522-a8cd-685e598892f3", "tag": "e039f998-073a-4974-a2eb-9d3fae5bf2d4"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:56:04.089558 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-d46af48b-52c1-4022-be72-a98063c7a219 req-7441ec59-46ba-4bd2-82f3-b98eacee66f7 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:04.090048 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-d46af48b-52c1-4022-be72-a98063c7a219 req-7441ec59-46ba-4bd2-82f3-b98eacee66f7 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:04.090485 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-d46af48b-52c1-4022-be72-a98063c7a219 req-7441ec59-46ba-4bd2-82f3-b98eacee66f7 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:04.101828 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-d46af48b-52c1-4022-be72-a98063c7a219 req-7441ec59-46ba-4bd2-82f3-b98eacee66f7 service nova] Creating event network-changed:e039f998-073a-4974-a2eb-9d3fae5bf2d4 for instance ac1213da-e573-4522-a8cd-685e598892f3 on n-h2-861333-8 Oct 19 03:56:04.107057 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-d46af48b-52c1-4022-be72-a98063c7a219 req-7441ec59-46ba-4bd2-82f3-b98eacee66f7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031469 Oct 19 03:56:04.109743 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3288/6636] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:56:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:56:07.583471 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5f7e3bd8-42a5-4abb-8dbb-bcae222e0773 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:56:07.584222 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-5f7e3bd8-42a5-4abb-8dbb-bcae222e0773 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: f1ef8fca-83d2-4b91-ae54-3fe226f7a19f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:56:07.590327 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5f7e3bd8-42a5-4abb-8dbb-bcae222e0773 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:07.590820 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5f7e3bd8-42a5-4abb-8dbb-bcae222e0773 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:07.591262 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5f7e3bd8-42a5-4abb-8dbb-bcae222e0773 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:07.591949 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5f7e3bd8-42a5-4abb-8dbb-bcae222e0773 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:07.592406 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5f7e3bd8-42a5-4abb-8dbb-bcae222e0773 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:07.592831 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5f7e3bd8-42a5-4abb-8dbb-bcae222e0773 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:07.727226 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-5f7e3bd8-42a5-4abb-8dbb-bcae222e0773 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:56:07.735021 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5f7e3bd8-42a5-4abb-8dbb-bcae222e0773 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/f1ef8fca-83d2-4b91-ae54-3fe226f7a19f" status: 200 len: 1682 microversion: 2.1 time: 0.156845 Oct 19 03:56:07.735589 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3349/6637] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:56:07 2022] GET /compute/v2.1/servers/f1ef8fca-83d2-4b91-ae54-3fe226f7a19f => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:56:07.842954 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-62386b07-216c-456c-a11b-49882eac44de tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:56:07.845226 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-62386b07-216c-456c-a11b-49882eac44de tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: f1ef8fca-83d2-4b91-ae54-3fe226f7a19f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:56:07.852320 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-62386b07-216c-456c-a11b-49882eac44de tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:07.852814 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-62386b07-216c-456c-a11b-49882eac44de tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:07.853259 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-62386b07-216c-456c-a11b-49882eac44de tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:07.853994 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-62386b07-216c-456c-a11b-49882eac44de tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:07.854453 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-62386b07-216c-456c-a11b-49882eac44de tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:07.854915 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-62386b07-216c-456c-a11b-49882eac44de tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:07.923346 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-62386b07-216c-456c-a11b-49882eac44de tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "POST /compute/v2.1/servers/f1ef8fca-83d2-4b91-ae54-3fe226f7a19f/action" status: 200 len: 32647 microversion: 2.1 time: 0.085889 Oct 19 03:56:07.930811 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3289/6638] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:56:07 2022] POST /compute/v2.1/servers/f1ef8fca-83d2-4b91-ae54-3fe226f7a19f/action => generated 32647 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 03:56:08.137541 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-495332f8-0c82-42b2-801c-9b7d77657852 tempest-TestNetworkAdvancedServerOps-173376372 tempest-TestNetworkAdvancedServerOps-173376372-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:56:08.138084 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-495332f8-0c82-42b2-801c-9b7d77657852 tempest-TestNetworkAdvancedServerOps-173376372 tempest-TestNetworkAdvancedServerOps-173376372-project-admin] [instance: f1ef8fca-83d2-4b91-ae54-3fe226f7a19f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:56:08.144990 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-495332f8-0c82-42b2-801c-9b7d77657852 tempest-TestNetworkAdvancedServerOps-173376372 tempest-TestNetworkAdvancedServerOps-173376372-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:08.145683 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-495332f8-0c82-42b2-801c-9b7d77657852 tempest-TestNetworkAdvancedServerOps-173376372 tempest-TestNetworkAdvancedServerOps-173376372-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:08.146136 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-495332f8-0c82-42b2-801c-9b7d77657852 tempest-TestNetworkAdvancedServerOps-173376372 tempest-TestNetworkAdvancedServerOps-173376372-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:08.146837 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-495332f8-0c82-42b2-801c-9b7d77657852 tempest-TestNetworkAdvancedServerOps-173376372 tempest-TestNetworkAdvancedServerOps-173376372-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:08.147300 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-495332f8-0c82-42b2-801c-9b7d77657852 tempest-TestNetworkAdvancedServerOps-173376372 tempest-TestNetworkAdvancedServerOps-173376372-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:08.147735 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-495332f8-0c82-42b2-801c-9b7d77657852 tempest-TestNetworkAdvancedServerOps-173376372 tempest-TestNetworkAdvancedServerOps-173376372-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:08.276236 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-495332f8-0c82-42b2-801c-9b7d77657852 tempest-TestNetworkAdvancedServerOps-173376372 tempest-TestNetworkAdvancedServerOps-173376372-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/f1ef8fca-83d2-4b91-ae54-3fe226f7a19f" status: 200 len: 1833 microversion: 2.1 time: 0.142500 Oct 19 03:56:08.276955 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3350/6639] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:56:08 2022] GET /compute/v2.1/servers/f1ef8fca-83d2-4b91-ae54-3fe226f7a19f => generated 1833 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:56:08.315007 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ba1882df-054e-4d4b-9a86-b582245d6360 tempest-TestNetworkAdvancedServerOps-173376372 tempest-TestNetworkAdvancedServerOps-173376372-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:56:08.318165 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ba1882df-054e-4d4b-9a86-b582245d6360 tempest-TestNetworkAdvancedServerOps-173376372 tempest-TestNetworkAdvancedServerOps-173376372-project-admin] [instance: f1ef8fca-83d2-4b91-ae54-3fe226f7a19f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:56:08.325517 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ba1882df-054e-4d4b-9a86-b582245d6360 tempest-TestNetworkAdvancedServerOps-173376372 tempest-TestNetworkAdvancedServerOps-173376372-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:08.326011 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ba1882df-054e-4d4b-9a86-b582245d6360 tempest-TestNetworkAdvancedServerOps-173376372 tempest-TestNetworkAdvancedServerOps-173376372-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:08.326559 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ba1882df-054e-4d4b-9a86-b582245d6360 tempest-TestNetworkAdvancedServerOps-173376372 tempest-TestNetworkAdvancedServerOps-173376372-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:08.327267 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ba1882df-054e-4d4b-9a86-b582245d6360 tempest-TestNetworkAdvancedServerOps-173376372 tempest-TestNetworkAdvancedServerOps-173376372-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:08.327786 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ba1882df-054e-4d4b-9a86-b582245d6360 tempest-TestNetworkAdvancedServerOps-173376372 tempest-TestNetworkAdvancedServerOps-173376372-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:08.328136 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ba1882df-054e-4d4b-9a86-b582245d6360 tempest-TestNetworkAdvancedServerOps-173376372 tempest-TestNetworkAdvancedServerOps-173376372-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:08.356195 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-ba1882df-054e-4d4b-9a86-b582245d6360 tempest-TestNetworkAdvancedServerOps-173376372 tempest-TestNetworkAdvancedServerOps-173376372-project-admin] Lazy-loading 'flavor' on Instance uuid f1ef8fca-83d2-4b91-ae54-3fe226f7a19f {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:56:08.369023 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ba1882df-054e-4d4b-9a86-b582245d6360 tempest-TestNetworkAdvancedServerOps-173376372 tempest-TestNetworkAdvancedServerOps-173376372-project-admin] [instance: f1ef8fca-83d2-4b91-ae54-3fe226f7a19f] Going to try to live migrate instance to another host {{(pid=121134) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 19 03:56:11.112149 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ba1882df-054e-4d4b-9a86-b582245d6360 tempest-TestNetworkAdvancedServerOps-173376372 tempest-TestNetworkAdvancedServerOps-173376372-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/f1ef8fca-83d2-4b91-ae54-3fe226f7a19f/action" status: 202 len: 0 microversion: 2.1 time: 2.801273 Oct 19 03:56:11.117682 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3290/6640] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:56:08 2022] POST /compute/v2.1/servers/f1ef8fca-83d2-4b91-ae54-3fe226f7a19f/action => generated 0 bytes in 2808 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 19 03:56:11.122678 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-08949905-51b0-47f2-80ac-0e32cc6f2dd8 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:56:11.123453 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-08949905-51b0-47f2-80ac-0e32cc6f2dd8 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: f1ef8fca-83d2-4b91-ae54-3fe226f7a19f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:56:11.131327 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-08949905-51b0-47f2-80ac-0e32cc6f2dd8 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:11.131845 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-08949905-51b0-47f2-80ac-0e32cc6f2dd8 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:11.132314 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-08949905-51b0-47f2-80ac-0e32cc6f2dd8 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:11.133015 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-08949905-51b0-47f2-80ac-0e32cc6f2dd8 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:11.133531 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-08949905-51b0-47f2-80ac-0e32cc6f2dd8 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:11.133962 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-08949905-51b0-47f2-80ac-0e32cc6f2dd8 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:11.284241 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-08949905-51b0-47f2-80ac-0e32cc6f2dd8 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:56:11.295847 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-08949905-51b0-47f2-80ac-0e32cc6f2dd8 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/f1ef8fca-83d2-4b91-ae54-3fe226f7a19f" status: 200 len: 1692 microversion: 2.1 time: 0.177251 Oct 19 03:56:11.296989 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3351/6641] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:56:11 2022] GET /compute/v2.1/servers/f1ef8fca-83d2-4b91-ae54-3fe226f7a19f => generated 1692 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:56:12.320810 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f6573a9c-33b7-4908-a5ec-ebae8f119565 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:56:12.321579 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f6573a9c-33b7-4908-a5ec-ebae8f119565 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: f1ef8fca-83d2-4b91-ae54-3fe226f7a19f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:56:12.330496 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f6573a9c-33b7-4908-a5ec-ebae8f119565 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:12.331026 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f6573a9c-33b7-4908-a5ec-ebae8f119565 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:12.331471 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f6573a9c-33b7-4908-a5ec-ebae8f119565 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:12.332773 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f6573a9c-33b7-4908-a5ec-ebae8f119565 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:12.333230 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f6573a9c-33b7-4908-a5ec-ebae8f119565 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:12.334650 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f6573a9c-33b7-4908-a5ec-ebae8f119565 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:12.549534 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-f6573a9c-33b7-4908-a5ec-ebae8f119565 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:56:12.557875 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f6573a9c-33b7-4908-a5ec-ebae8f119565 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/f1ef8fca-83d2-4b91-ae54-3fe226f7a19f" status: 200 len: 1692 microversion: 2.1 time: 0.241561 Oct 19 03:56:12.558688 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3291/6642] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:56:12 2022] GET /compute/v2.1/servers/f1ef8fca-83d2-4b91-ae54-3fe226f7a19f => generated 1692 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:56:12.603243 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-32397333-27c5-42f0-a44f-b1a3c3b50631 req-9c09598c-4ac5-42d9-9d50-bf3976ef9ae6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1ef8fca-83d2-4b91-ae54-3fe226f7a19f", "name": "network-vif-unplugged", "status": "completed", "tag": "98a83fc3-ced4-46bb-9e55-385a65332e54"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:56:12.614721 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-32397333-27c5-42f0-a44f-b1a3c3b50631 req-9c09598c-4ac5-42d9-9d50-bf3976ef9ae6 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:12.615207 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-32397333-27c5-42f0-a44f-b1a3c3b50631 req-9c09598c-4ac5-42d9-9d50-bf3976ef9ae6 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:12.615643 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-32397333-27c5-42f0-a44f-b1a3c3b50631 req-9c09598c-4ac5-42d9-9d50-bf3976ef9ae6 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:12.626779 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-32397333-27c5-42f0-a44f-b1a3c3b50631 req-9c09598c-4ac5-42d9-9d50-bf3976ef9ae6 service nova] Creating event network-vif-unplugged:98a83fc3-ced4-46bb-9e55-385a65332e54 for instance f1ef8fca-83d2-4b91-ae54-3fe226f7a19f on n-h1-861333-8 Oct 19 03:56:12.631850 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-32397333-27c5-42f0-a44f-b1a3c3b50631 req-9c09598c-4ac5-42d9-9d50-bf3976ef9ae6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032520 Oct 19 03:56:12.632458 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3352/6643] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:56:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:56:13.583692 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a1d0cb4d-9f75-45a3-a42c-f71f0a90a572 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:56:13.584392 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a1d0cb4d-9f75-45a3-a42c-f71f0a90a572 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: f1ef8fca-83d2-4b91-ae54-3fe226f7a19f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:56:13.591363 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a1d0cb4d-9f75-45a3-a42c-f71f0a90a572 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:13.591854 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a1d0cb4d-9f75-45a3-a42c-f71f0a90a572 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:13.592300 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a1d0cb4d-9f75-45a3-a42c-f71f0a90a572 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:13.593007 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a1d0cb4d-9f75-45a3-a42c-f71f0a90a572 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:13.593495 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a1d0cb4d-9f75-45a3-a42c-f71f0a90a572 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:13.593929 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a1d0cb4d-9f75-45a3-a42c-f71f0a90a572 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:13.726590 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a1d0cb4d-9f75-45a3-a42c-f71f0a90a572 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:56:13.735163 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a1d0cb4d-9f75-45a3-a42c-f71f0a90a572 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/f1ef8fca-83d2-4b91-ae54-3fe226f7a19f" status: 200 len: 1692 microversion: 2.1 time: 0.155468 Oct 19 03:56:13.735831 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3292/6644] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:56:13 2022] GET /compute/v2.1/servers/f1ef8fca-83d2-4b91-ae54-3fe226f7a19f => generated 1692 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:56:14.648671 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-b20d26c3-f684-46bd-b8e5-9110e623bf99 req-a7feabba-f282-4b02-a8b1-13044f816784 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1ef8fca-83d2-4b91-ae54-3fe226f7a19f", "tag": "98a83fc3-ced4-46bb-9e55-385a65332e54"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:56:14.658714 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-b20d26c3-f684-46bd-b8e5-9110e623bf99 req-a7feabba-f282-4b02-a8b1-13044f816784 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:14.659488 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-b20d26c3-f684-46bd-b8e5-9110e623bf99 req-a7feabba-f282-4b02-a8b1-13044f816784 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:14.660056 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-b20d26c3-f684-46bd-b8e5-9110e623bf99 req-a7feabba-f282-4b02-a8b1-13044f816784 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:14.671179 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-b20d26c3-f684-46bd-b8e5-9110e623bf99 req-a7feabba-f282-4b02-a8b1-13044f816784 service nova] Creating event network-changed:98a83fc3-ced4-46bb-9e55-385a65332e54 for instance f1ef8fca-83d2-4b91-ae54-3fe226f7a19f on n-h1-861333-8 Oct 19 03:56:14.676028 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-b20d26c3-f684-46bd-b8e5-9110e623bf99 req-a7feabba-f282-4b02-a8b1-13044f816784 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033257 Oct 19 03:56:14.676779 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3353/6645] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:56:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:56:14.759860 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b632eab2-6875-4ecd-b339-c9ad0ec78d58 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:56:14.760482 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b632eab2-6875-4ecd-b339-c9ad0ec78d58 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: f1ef8fca-83d2-4b91-ae54-3fe226f7a19f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:56:14.767714 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b632eab2-6875-4ecd-b339-c9ad0ec78d58 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:14.770923 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b632eab2-6875-4ecd-b339-c9ad0ec78d58 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:14.770923 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b632eab2-6875-4ecd-b339-c9ad0ec78d58 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:14.770923 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b632eab2-6875-4ecd-b339-c9ad0ec78d58 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:14.770923 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b632eab2-6875-4ecd-b339-c9ad0ec78d58 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:14.771309 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b632eab2-6875-4ecd-b339-c9ad0ec78d58 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:15.012171 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b632eab2-6875-4ecd-b339-c9ad0ec78d58 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:56:15.021055 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b632eab2-6875-4ecd-b339-c9ad0ec78d58 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/f1ef8fca-83d2-4b91-ae54-3fe226f7a19f" status: 200 len: 1692 microversion: 2.1 time: 0.265113 Oct 19 03:56:15.037670 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3293/6646] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:56:14 2022] GET /compute/v2.1/servers/f1ef8fca-83d2-4b91-ae54-3fe226f7a19f => generated 1692 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:56:16.048666 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-51a8e8bd-f3e3-4584-af67-ee172b317387 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:56:16.049552 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-51a8e8bd-f3e3-4584-af67-ee172b317387 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: f1ef8fca-83d2-4b91-ae54-3fe226f7a19f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:56:16.056374 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-51a8e8bd-f3e3-4584-af67-ee172b317387 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:16.056854 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-51a8e8bd-f3e3-4584-af67-ee172b317387 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:16.057324 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-51a8e8bd-f3e3-4584-af67-ee172b317387 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:16.058334 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-51a8e8bd-f3e3-4584-af67-ee172b317387 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:16.058961 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-51a8e8bd-f3e3-4584-af67-ee172b317387 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:16.059393 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-51a8e8bd-f3e3-4584-af67-ee172b317387 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:16.203637 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-51a8e8bd-f3e3-4584-af67-ee172b317387 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:56:16.212327 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-51a8e8bd-f3e3-4584-af67-ee172b317387 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/f1ef8fca-83d2-4b91-ae54-3fe226f7a19f" status: 200 len: 1692 microversion: 2.1 time: 0.169026 Oct 19 03:56:16.212909 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3354/6647] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:56:16 2022] GET /compute/v2.1/servers/f1ef8fca-83d2-4b91-ae54-3fe226f7a19f => generated 1692 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:56:17.235618 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-234e3383-22ca-4cc8-af2a-8cc70138d1ab tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:56:17.236239 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-234e3383-22ca-4cc8-af2a-8cc70138d1ab tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: f1ef8fca-83d2-4b91-ae54-3fe226f7a19f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:56:17.243190 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-234e3383-22ca-4cc8-af2a-8cc70138d1ab tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:17.243673 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-234e3383-22ca-4cc8-af2a-8cc70138d1ab tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:17.244115 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-234e3383-22ca-4cc8-af2a-8cc70138d1ab tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:17.244805 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-234e3383-22ca-4cc8-af2a-8cc70138d1ab tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:17.245263 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-234e3383-22ca-4cc8-af2a-8cc70138d1ab tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:17.245718 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-234e3383-22ca-4cc8-af2a-8cc70138d1ab tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:17.385361 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-234e3383-22ca-4cc8-af2a-8cc70138d1ab tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:56:17.394487 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-234e3383-22ca-4cc8-af2a-8cc70138d1ab tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/f1ef8fca-83d2-4b91-ae54-3fe226f7a19f" status: 200 len: 1692 microversion: 2.1 time: 0.162783 Oct 19 03:56:17.396162 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3294/6648] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:56:17 2022] GET /compute/v2.1/servers/f1ef8fca-83d2-4b91-ae54-3fe226f7a19f => generated 1692 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:56:18.419018 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-643a916e-329b-45b9-87c9-1bb4ebe8537c tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:56:18.419637 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-643a916e-329b-45b9-87c9-1bb4ebe8537c tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: f1ef8fca-83d2-4b91-ae54-3fe226f7a19f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:56:18.426785 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-643a916e-329b-45b9-87c9-1bb4ebe8537c tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:18.427284 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-643a916e-329b-45b9-87c9-1bb4ebe8537c tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:18.427726 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-643a916e-329b-45b9-87c9-1bb4ebe8537c tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:18.428429 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-643a916e-329b-45b9-87c9-1bb4ebe8537c tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:18.429467 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-643a916e-329b-45b9-87c9-1bb4ebe8537c tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:18.430108 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-643a916e-329b-45b9-87c9-1bb4ebe8537c tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:18.563730 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-643a916e-329b-45b9-87c9-1bb4ebe8537c tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:56:18.572452 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-643a916e-329b-45b9-87c9-1bb4ebe8537c tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/f1ef8fca-83d2-4b91-ae54-3fe226f7a19f" status: 200 len: 1692 microversion: 2.1 time: 0.157358 Oct 19 03:56:18.573174 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3355/6649] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:56:18 2022] GET /compute/v2.1/servers/f1ef8fca-83d2-4b91-ae54-3fe226f7a19f => generated 1692 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:56:19.595817 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-330ecac1-1b4f-4f26-aa23-d8a59163e435 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:56:19.598927 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-330ecac1-1b4f-4f26-aa23-d8a59163e435 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: f1ef8fca-83d2-4b91-ae54-3fe226f7a19f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:56:19.600072 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:56:19.604934 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-330ecac1-1b4f-4f26-aa23-d8a59163e435 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:19.605506 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-330ecac1-1b4f-4f26-aa23-d8a59163e435 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:19.606560 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-330ecac1-1b4f-4f26-aa23-d8a59163e435 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:19.607288 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-330ecac1-1b4f-4f26-aa23-d8a59163e435 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:19.607752 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-330ecac1-1b4f-4f26-aa23-d8a59163e435 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:19.608186 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-330ecac1-1b4f-4f26-aa23-d8a59163e435 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:19.801795 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-330ecac1-1b4f-4f26-aa23-d8a59163e435 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:56:19.809730 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-330ecac1-1b4f-4f26-aa23-d8a59163e435 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/f1ef8fca-83d2-4b91-ae54-3fe226f7a19f" status: 200 len: 1692 microversion: 2.1 time: 0.217742 Oct 19 03:56:19.810782 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3295/6650] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:56:19 2022] GET /compute/v2.1/servers/f1ef8fca-83d2-4b91-ae54-3fe226f7a19f => generated 1692 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:56:20.837455 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f6466dbd-84c1-4faa-8c02-5c3709782e20 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:56:20.838415 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f6466dbd-84c1-4faa-8c02-5c3709782e20 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: f1ef8fca-83d2-4b91-ae54-3fe226f7a19f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:56:20.841299 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:56:20.846213 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f6466dbd-84c1-4faa-8c02-5c3709782e20 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:20.846769 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f6466dbd-84c1-4faa-8c02-5c3709782e20 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:20.847273 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f6466dbd-84c1-4faa-8c02-5c3709782e20 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:20.848519 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f6466dbd-84c1-4faa-8c02-5c3709782e20 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:20.849265 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f6466dbd-84c1-4faa-8c02-5c3709782e20 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:20.849724 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f6466dbd-84c1-4faa-8c02-5c3709782e20 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:20.854974 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=85 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:56:20.987419 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f6466dbd-84c1-4faa-8c02-5c3709782e20 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:56:20.996218 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f6466dbd-84c1-4faa-8c02-5c3709782e20 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/f1ef8fca-83d2-4b91-ae54-3fe226f7a19f" status: 200 len: 1682 microversion: 2.1 time: 0.162616 Oct 19 03:56:20.997194 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3356/6651] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:56:20 2022] GET /compute/v2.1/servers/f1ef8fca-83d2-4b91-ae54-3fe226f7a19f => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:56:21.019455 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f8841844-2974-4fca-8a5c-a13a98a658a8 tempest-TestNetworkAdvancedServerOps-173376372 tempest-TestNetworkAdvancedServerOps-173376372-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:56:21.020095 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f8841844-2974-4fca-8a5c-a13a98a658a8 tempest-TestNetworkAdvancedServerOps-173376372 tempest-TestNetworkAdvancedServerOps-173376372-project-admin] [instance: f1ef8fca-83d2-4b91-ae54-3fe226f7a19f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:56:21.027811 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f8841844-2974-4fca-8a5c-a13a98a658a8 tempest-TestNetworkAdvancedServerOps-173376372 tempest-TestNetworkAdvancedServerOps-173376372-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:21.032626 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f8841844-2974-4fca-8a5c-a13a98a658a8 tempest-TestNetworkAdvancedServerOps-173376372 tempest-TestNetworkAdvancedServerOps-173376372-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:21.032626 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f8841844-2974-4fca-8a5c-a13a98a658a8 tempest-TestNetworkAdvancedServerOps-173376372 tempest-TestNetworkAdvancedServerOps-173376372-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:21.032626 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f8841844-2974-4fca-8a5c-a13a98a658a8 tempest-TestNetworkAdvancedServerOps-173376372 tempest-TestNetworkAdvancedServerOps-173376372-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:21.032626 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f8841844-2974-4fca-8a5c-a13a98a658a8 tempest-TestNetworkAdvancedServerOps-173376372 tempest-TestNetworkAdvancedServerOps-173376372-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:21.032626 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f8841844-2974-4fca-8a5c-a13a98a658a8 tempest-TestNetworkAdvancedServerOps-173376372 tempest-TestNetworkAdvancedServerOps-173376372-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:21.033105 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:56:21.164398 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f8841844-2974-4fca-8a5c-a13a98a658a8 tempest-TestNetworkAdvancedServerOps-173376372 tempest-TestNetworkAdvancedServerOps-173376372-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/f1ef8fca-83d2-4b91-ae54-3fe226f7a19f" status: 200 len: 1833 microversion: 2.1 time: 0.148793 Oct 19 03:56:21.165028 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3296/6652] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:56:21 2022] GET /compute/v2.1/servers/f1ef8fca-83d2-4b91-ae54-3fe226f7a19f => generated 1833 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:56:21.189028 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-50be0e28-8000-4b78-a60e-9b47319babef tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:56:21.189769 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-50be0e28-8000-4b78-a60e-9b47319babef tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: f1ef8fca-83d2-4b91-ae54-3fe226f7a19f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:56:21.196770 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-50be0e28-8000-4b78-a60e-9b47319babef tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:21.204816 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-50be0e28-8000-4b78-a60e-9b47319babef tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:21.204816 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-50be0e28-8000-4b78-a60e-9b47319babef tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:21.204816 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-50be0e28-8000-4b78-a60e-9b47319babef tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:21.204816 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-50be0e28-8000-4b78-a60e-9b47319babef tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:21.204816 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-50be0e28-8000-4b78-a60e-9b47319babef tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:21.340699 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-50be0e28-8000-4b78-a60e-9b47319babef tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:56:21.348512 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-50be0e28-8000-4b78-a60e-9b47319babef tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/f1ef8fca-83d2-4b91-ae54-3fe226f7a19f" status: 200 len: 1682 microversion: 2.1 time: 0.163749 Oct 19 03:56:21.349160 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3357/6653] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:56:21 2022] GET /compute/v2.1/servers/f1ef8fca-83d2-4b91-ae54-3fe226f7a19f => generated 1682 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:56:21.464883 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b618379a-4048-47fe-ad14-3440eae71ab1 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:56:21.467347 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b618379a-4048-47fe-ad14-3440eae71ab1 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: f1ef8fca-83d2-4b91-ae54-3fe226f7a19f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:56:21.474372 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b618379a-4048-47fe-ad14-3440eae71ab1 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:21.474869 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b618379a-4048-47fe-ad14-3440eae71ab1 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:21.475315 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b618379a-4048-47fe-ad14-3440eae71ab1 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:21.476022 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b618379a-4048-47fe-ad14-3440eae71ab1 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:21.476488 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b618379a-4048-47fe-ad14-3440eae71ab1 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:21.476926 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b618379a-4048-47fe-ad14-3440eae71ab1 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:21.653988 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b618379a-4048-47fe-ad14-3440eae71ab1 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "POST /compute/v2.1/servers/f1ef8fca-83d2-4b91-ae54-3fe226f7a19f/action" status: 200 len: 38629 microversion: 2.1 time: 0.078843 Oct 19 03:56:21.653988 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3297/6654] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:56:21 2022] POST /compute/v2.1/servers/f1ef8fca-83d2-4b91-ae54-3fe226f7a19f/action => generated 38629 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 03:56:22.951934 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-bdd745cc-a3e0-4fee-8f14-d899ebfa5ec6 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:56:22.952456 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-bdd745cc-a3e0-4fee-8f14-d899ebfa5ec6 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: f1ef8fca-83d2-4b91-ae54-3fe226f7a19f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:56:22.955075 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-0afb9b37-ad7d-4393-ad8a-59c0075337e8 req-61deb8b8-3f9c-44a0-8a53-9699adb6a878 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1ef8fca-83d2-4b91-ae54-3fe226f7a19f", "tag": "98a83fc3-ced4-46bb-9e55-385a65332e54"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:56:22.960257 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bdd745cc-a3e0-4fee-8f14-d899ebfa5ec6 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:22.960760 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bdd745cc-a3e0-4fee-8f14-d899ebfa5ec6 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:22.961204 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bdd745cc-a3e0-4fee-8f14-d899ebfa5ec6 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:22.961935 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bdd745cc-a3e0-4fee-8f14-d899ebfa5ec6 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:22.962397 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bdd745cc-a3e0-4fee-8f14-d899ebfa5ec6 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:22.963044 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bdd745cc-a3e0-4fee-8f14-d899ebfa5ec6 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:22.967495 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-0afb9b37-ad7d-4393-ad8a-59c0075337e8 req-61deb8b8-3f9c-44a0-8a53-9699adb6a878 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:22.968260 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-0afb9b37-ad7d-4393-ad8a-59c0075337e8 req-61deb8b8-3f9c-44a0-8a53-9699adb6a878 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:22.968943 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-0afb9b37-ad7d-4393-ad8a-59c0075337e8 req-61deb8b8-3f9c-44a0-8a53-9699adb6a878 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:22.980720 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-0afb9b37-ad7d-4393-ad8a-59c0075337e8 req-61deb8b8-3f9c-44a0-8a53-9699adb6a878 service nova] Creating event network-changed:98a83fc3-ced4-46bb-9e55-385a65332e54 for instance f1ef8fca-83d2-4b91-ae54-3fe226f7a19f on n-h2-861333-8 Oct 19 03:56:22.985799 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-0afb9b37-ad7d-4393-ad8a-59c0075337e8 req-61deb8b8-3f9c-44a0-8a53-9699adb6a878 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034934 Oct 19 03:56:22.986772 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3298/6655] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:56:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:56:22.993381 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-bdd745cc-a3e0-4fee-8f14-d899ebfa5ec6 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: f1ef8fca-83d2-4b91-ae54-3fe226f7a19f] Going to try to terminate instance {{(pid=121135) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:56:23.279457 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-bdd745cc-a3e0-4fee-8f14-d899ebfa5ec6 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "DELETE /compute/v2.1/servers/f1ef8fca-83d2-4b91-ae54-3fe226f7a19f" status: 204 len: 0 microversion: 2.1 time: 0.331173 Oct 19 03:56:23.280362 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3358/6656] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:56:22 2022] DELETE /compute/v2.1/servers/f1ef8fca-83d2-4b91-ae54-3fe226f7a19f => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:56:23.290585 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d85300f2-1521-4bba-b355-7e20e482e96d tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:56:23.291604 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d85300f2-1521-4bba-b355-7e20e482e96d tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: f1ef8fca-83d2-4b91-ae54-3fe226f7a19f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:56:23.300783 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d85300f2-1521-4bba-b355-7e20e482e96d tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:23.301889 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d85300f2-1521-4bba-b355-7e20e482e96d tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:23.302931 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d85300f2-1521-4bba-b355-7e20e482e96d tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:23.303662 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d85300f2-1521-4bba-b355-7e20e482e96d tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:23.304122 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d85300f2-1521-4bba-b355-7e20e482e96d tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:23.304870 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d85300f2-1521-4bba-b355-7e20e482e96d tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:23.452724 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d85300f2-1521-4bba-b355-7e20e482e96d tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:56:23.462844 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d85300f2-1521-4bba-b355-7e20e482e96d tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/f1ef8fca-83d2-4b91-ae54-3fe226f7a19f" status: 200 len: 1688 microversion: 2.1 time: 0.177917 Oct 19 03:56:23.463846 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3299/6657] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:56:23 2022] GET /compute/v2.1/servers/f1ef8fca-83d2-4b91-ae54-3fe226f7a19f => generated 1688 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:56:24.489810 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1c59337b-7684-4604-a3be-67a17b5b4040 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:56:24.490518 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1c59337b-7684-4604-a3be-67a17b5b4040 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: f1ef8fca-83d2-4b91-ae54-3fe226f7a19f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:56:24.497653 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1c59337b-7684-4604-a3be-67a17b5b4040 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:24.498109 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1c59337b-7684-4604-a3be-67a17b5b4040 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:24.498571 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1c59337b-7684-4604-a3be-67a17b5b4040 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:24.499286 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1c59337b-7684-4604-a3be-67a17b5b4040 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:24.499745 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1c59337b-7684-4604-a3be-67a17b5b4040 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:24.500177 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1c59337b-7684-4604-a3be-67a17b5b4040 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:24.568948 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-1c59337b-7684-4604-a3be-67a17b5b4040 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:56:24.577520 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1c59337b-7684-4604-a3be-67a17b5b4040 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/f1ef8fca-83d2-4b91-ae54-3fe226f7a19f" status: 200 len: 1503 microversion: 2.1 time: 0.091936 Oct 19 03:56:24.578142 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3359/6658] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:56:24 2022] GET /compute/v2.1/servers/f1ef8fca-83d2-4b91-ae54-3fe226f7a19f => generated 1503 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:56:25.001627 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-c70e47d7-2643-4556-aef7-bda7ec40122b req-b070e47c-6b85-4c50-9d08-11816729a1c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1ef8fca-83d2-4b91-ae54-3fe226f7a19f", "name": "network-vif-deleted", "tag": "98a83fc3-ced4-46bb-9e55-385a65332e54"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:56:25.012006 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-c70e47d7-2643-4556-aef7-bda7ec40122b req-b070e47c-6b85-4c50-9d08-11816729a1c0 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:25.012482 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-c70e47d7-2643-4556-aef7-bda7ec40122b req-b070e47c-6b85-4c50-9d08-11816729a1c0 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:25.012912 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-c70e47d7-2643-4556-aef7-bda7ec40122b req-b070e47c-6b85-4c50-9d08-11816729a1c0 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:25.025731 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-c70e47d7-2643-4556-aef7-bda7ec40122b req-b070e47c-6b85-4c50-9d08-11816729a1c0 service nova] Creating event network-vif-deleted:98a83fc3-ced4-46bb-9e55-385a65332e54 for instance f1ef8fca-83d2-4b91-ae54-3fe226f7a19f on n-h2-861333-8 Oct 19 03:56:25.031171 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-c70e47d7-2643-4556-aef7-bda7ec40122b req-b070e47c-6b85-4c50-9d08-11816729a1c0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033169 Oct 19 03:56:25.031783 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3300/6659] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:56:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:56:25.601308 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c3b2ac51-940c-4e86-9cb2-b6788cd86df5 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:56:25.601894 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c3b2ac51-940c-4e86-9cb2-b6788cd86df5 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: f1ef8fca-83d2-4b91-ae54-3fe226f7a19f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:56:25.609067 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c3b2ac51-940c-4e86-9cb2-b6788cd86df5 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:25.611331 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c3b2ac51-940c-4e86-9cb2-b6788cd86df5 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:25.620492 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c3b2ac51-940c-4e86-9cb2-b6788cd86df5 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:25.620492 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c3b2ac51-940c-4e86-9cb2-b6788cd86df5 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:25.620492 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c3b2ac51-940c-4e86-9cb2-b6788cd86df5 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:25.620492 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c3b2ac51-940c-4e86-9cb2-b6788cd86df5 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:25.627309 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-c3b2ac51-940c-4e86-9cb2-b6788cd86df5 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] HTTP exception thrown: Instance f1ef8fca-83d2-4b91-ae54-3fe226f7a19f could not be found. Oct 19 03:56:25.628988 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c3b2ac51-940c-4e86-9cb2-b6788cd86df5 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Request method failure captured: Oct 19 03:56:25.628988 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/f1ef8fca-83d2-4b91-ae54-3fe226f7a19f HTTP/1.1 Oct 19 03:56:25.628988 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:56:25.628988 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:56:25.628988 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:56:25.628988 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 03:56:25.628988 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:56:25.628988 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:56:25.628988 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:56:25.628988 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:56:25.628988 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT3NwoLvkX1ASv7BWG8n03-wyV-PHrk4Zzw5wyutTUqINpvyr9PXOVTlUcdwMhf8Q5ZkPK7itp1Hf4ku46LTSLnpDmtKa_b_RS1LRUWqOcdFLvZqgZoywIxoBs14di1P9oAs26SP9if5E5-uZy9hDECUpYA7EORF5pEKdwwte-cPfVLw Oct 19 03:56:25.628988 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:56:25.628988 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:56:25.628988 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:56:25.628988 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:56:25.628988 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:56:25.628988 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:56:25.628988 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: fe972f4874424bf89e9ed0bfcb69f050 Oct 19 03:56:25.628988 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-374576753 Oct 19 03:56:25.628988 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:56:25.628988 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:56:25.628988 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/fe972f4874424bf89e9ed0bfcb69f050"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe972f4874424bf89e9ed0bfcb69f050"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe972f4874424bf89e9ed0bfcb69f050"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_fe972f4874424bf89e9ed0bfcb69f050", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:56:25.628988 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-TestNetworkAdvancedServerOps-374576753 Oct 19 03:56:25.628988 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: fe972f4874424bf89e9ed0bfcb69f050 Oct 19 03:56:25.628988 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-374576753 Oct 19 03:56:25.628988 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-TestNetworkAdvancedServerOps-374576753-project Oct 19 03:56:25.628988 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:56:25.628988 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:56:25.628988 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: b63367855cc9468f8512a87e89b8606d Oct 19 03:56:25.628988 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-TestNetworkAdvancedServerOps-374576753-project Oct 19 03:56:25.628988 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:56:25.628988 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance f1ef8fca-83d2-4b91-ae54-3fe226f7a19f could not be found. Oct 19 03:56:25.628988 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': 'f1ef8fca-83d2-4b91-ae54-3fe226f7a19f'} Oct 19 03:56:25.628988 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:56:25.628988 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:56:25.628988 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:56:25.628988 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:56:25.628988 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:56:25.628988 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:56:25.628988 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:56:25.628988 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:56:25.628988 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:56:25.628988 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:56:25.628988 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1ef8fca-83d2-4b91-ae54-3fe226f7a19f could not be found. Oct 19 03:56:25.628988 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:56:25.628988 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:56:25.628988 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:56:25.628988 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:56:25.628988 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:56:25.628988 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:56:25.628988 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:56:25.628988 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:56:25.628988 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:56:25.628988 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:56:25.628988 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:56:25.628988 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:56:25.628988 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:56:25.628988 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:56:25.628988 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:56:25.628988 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:56:25.628988 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1ef8fca-83d2-4b91-ae54-3fe226f7a19f could not be found. Oct 19 03:56:25.628988 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:56:25.628988 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:56:25.634175 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:56:25.634175 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:56:25.634175 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:56:25.634175 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:56:25.634175 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:56:25.634175 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:56:25.634175 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1ef8fca-83d2-4b91-ae54-3fe226f7a19f could not be found. Oct 19 03:56:25.634175 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:56:25.634175 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c3b2ac51-940c-4e86-9cb2-b6788cd86df5 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Returning 404 to user: Instance f1ef8fca-83d2-4b91-ae54-3fe226f7a19f could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:56:25.634175 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c3b2ac51-940c-4e86-9cb2-b6788cd86df5 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/f1ef8fca-83d2-4b91-ae54-3fe226f7a19f" status: 404 len: 111 microversion: 2.1 time: 0.034103 Oct 19 03:56:25.634175 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3360/6660] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:56:25 2022] GET /compute/v2.1/servers/f1ef8fca-83d2-4b91-ae54-3fe226f7a19f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:56:29.740477 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-cde552e0-c734-4732-a4e3-ce37c3659954 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '.version_select at 0x7fc12b93c700>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:56:29.839558 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-cde552e0-c734-4732-a4e3-ce37c3659954 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1035296342" status: 202 len: 0 microversion: 2.1 time: 0.104036 Oct 19 03:56:29.840078 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3301/6661] 10.222.0.52 () {58 vars in 1284 bytes} [Wed Oct 19 03:56:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1035296342 => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:56:29.871992 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-69090f8a-bfe5-4f7e-bf97-30ff72aed9f3 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Action: 'create', calling method: .version_select at 0x7fc12bfa5dc0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-50981351", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOyIn2shSho2ZHeq+Lv6QskmkOa3ERuXZzcseWx+trvLvMfuKvd8k3lAEeD2NB6Bm+mtFag+lrb1C/uqsfV4FtESq8F7JAMc1A4P1PcY3X3bUiiseO5Gp/0zqAjXs+YxSw=="}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:56:29.888683 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-69090f8a-bfe5-4f7e-bf97-30ff72aed9f3 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Getting quotas for project fe972f4874424bf89e9ed0bfcb69f050. Resources: {'key_pairs'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:56:29.894058 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-69090f8a-bfe5-4f7e-bf97-30ff72aed9f3 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Getting quotas for user b63367855cc9468f8512a87e89b8606d and project fe972f4874424bf89e9ed0bfcb69f050. Resources: {'key_pairs'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:56:29.986662 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-69090f8a-bfe5-4f7e-bf97-30ff72aed9f3 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.118563 Oct 19 03:56:29.987267 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3361/6662] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Oct 19 03:56:29 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:56:39.200668 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=19 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:56:39.205084 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0b7196ed-26a5-454d-aec9-5c6dec226528 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-189480472", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "networks": [{"uuid": "0f9f0710-6362-480f-bd8e-8a18417bef3f"}], "key_name": "tempest-TestNetworkAdvancedServerOps-50981351", "security_groups": [{"name": "tempest-secgroup-smoke-1602342230"}]}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:56:39.333740 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-0b7196ed-26a5-454d-aec9-5c6dec226528 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] validate_networks() for [('0f9f0710-6362-480f-bd8e-8a18417bef3f', None, None, None, None, None)] {{(pid=121134) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:56:39.884432 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-0b7196ed-26a5-454d-aec9-5c6dec226528 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Flavor limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:56:39.884432 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-0b7196ed-26a5-454d-aec9-5c6dec226528 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Image limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:56:39.884432 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-0b7196ed-26a5-454d-aec9-5c6dec226528 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Flavor pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:56:39.884432 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-0b7196ed-26a5-454d-aec9-5c6dec226528 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Image pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:56:39.884432 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-0b7196ed-26a5-454d-aec9-5c6dec226528 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:56:39.896975 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0b7196ed-26a5-454d-aec9-5c6dec226528 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:39.897860 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0b7196ed-26a5-454d-aec9-5c6dec226528 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:39.898206 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0b7196ed-26a5-454d-aec9-5c6dec226528 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:39.899114 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0b7196ed-26a5-454d-aec9-5c6dec226528 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:39.899582 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0b7196ed-26a5-454d-aec9-5c6dec226528 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:39.900214 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0b7196ed-26a5-454d-aec9-5c6dec226528 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:39.951867 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-0b7196ed-26a5-454d-aec9-5c6dec226528 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Getting quotas for project fe972f4874424bf89e9ed0bfcb69f050. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:56:39.959002 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-0b7196ed-26a5-454d-aec9-5c6dec226528 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Getting quotas for user b63367855cc9468f8512a87e89b8606d and project fe972f4874424bf89e9ed0bfcb69f050. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:56:39.976877 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0b7196ed-26a5-454d-aec9-5c6dec226528 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Going to run 1 instances... {{(pid=121134) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:56:39.979780 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0b7196ed-26a5-454d-aec9-5c6dec226528 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: 6de16745-5838-4ba1-b987-1e1e4084dd7f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:56:40.153900 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0b7196ed-26a5-454d-aec9-5c6dec226528 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.954992 Oct 19 03:56:40.161566 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3302/6663] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:56:39 2022] POST /compute/v2.1/servers => generated 406 bytes in 957 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 03:56:40.167063 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e8ffc9ff-f4e6-4f0f-899e-45e8d5995058 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:56:40.168366 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e8ffc9ff-f4e6-4f0f-899e-45e8d5995058 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: 6de16745-5838-4ba1-b987-1e1e4084dd7f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:56:40.185986 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:56:40.187196 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=4 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:56:40.187834 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:56:40.235298 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4d061fc9-eea6-4555-aa10-a9ccdd634536 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:56:40.236662 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4d061fc9-eea6-4555-aa10-a9ccdd634536 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: ac1213da-e573-4522-a8cd-685e598892f3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:56:40.250414 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4d061fc9-eea6-4555-aa10-a9ccdd634536 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:40.251332 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4d061fc9-eea6-4555-aa10-a9ccdd634536 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:40.252607 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4d061fc9-eea6-4555-aa10-a9ccdd634536 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:40.253695 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4d061fc9-eea6-4555-aa10-a9ccdd634536 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:40.254588 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4d061fc9-eea6-4555-aa10-a9ccdd634536 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:40.255396 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4d061fc9-eea6-4555-aa10-a9ccdd634536 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:40.280816 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-e8ffc9ff-f4e6-4f0f-899e-45e8d5995058 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:56:40.297099 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e8ffc9ff-f4e6-4f0f-899e-45e8d5995058 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/6de16745-5838-4ba1-b987-1e1e4084dd7f" status: 200 len: 1264 microversion: 2.1 time: 0.133814 Oct 19 03:56:40.298202 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3362/6664] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:56:40 2022] GET /compute/v2.1/servers/6de16745-5838-4ba1-b987-1e1e4084dd7f => generated 1264 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:56:40.313226 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4d061fc9-eea6-4555-aa10-a9ccdd634536 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "GET /compute/v2.1/servers/ac1213da-e573-4522-a8cd-685e598892f3/ips" status: 200 len: 150 microversion: 2.1 time: 0.083511 Oct 19 03:56:40.323932 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3303/6665] 10.222.0.52 () {58 vars in 1248 bytes} [Wed Oct 19 03:56:40 2022] GET /compute/v2.1/servers/ac1213da-e573-4522-a8cd-685e598892f3/ips => generated 150 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:56:40.333720 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-17c86515-11f0-420a-8ce8-4375a8f764e9 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d6c0a330-4bb6-48cf-92d2-d74238c3cd54"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:56:40.349965 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-17c86515-11f0-420a-8ce8-4375a8f764e9 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: ac1213da-e573-4522-a8cd-685e598892f3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:56:40.358353 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-17c86515-11f0-420a-8ce8-4375a8f764e9 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:40.360508 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-17c86515-11f0-420a-8ce8-4375a8f764e9 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:40.361096 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-17c86515-11f0-420a-8ce8-4375a8f764e9 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:40.362019 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-17c86515-11f0-420a-8ce8-4375a8f764e9 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:40.362667 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-17c86515-11f0-420a-8ce8-4375a8f764e9 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:40.363294 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-17c86515-11f0-420a-8ce8-4375a8f764e9 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:40.474268 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-17c86515-11f0-420a-8ce8-4375a8f764e9 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] HTTP exception thrown: Invalid volume: volume d6c0a330-4bb6-48cf-92d2-d74238c3cd54 is already attached to instances: 5f833ef3-e5bd-4953-a3ca-5cddddb2641f Oct 19 03:56:40.476315 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-17c86515-11f0-420a-8ce8-4375a8f764e9 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Request method failure captured: Oct 19 03:56:40.476315 n-d-861333-8 devstack@n-api.service[121135]: request: POST /compute/v2.1/servers/ac1213da-e573-4522-a8cd-685e598892f3/os-volume_attachments HTTP/1.1 Oct 19 03:56:40.476315 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 03:56:40.476315 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 03:56:40.476315 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 03:56:40.476315 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 74 Oct 19 03:56:40.476315 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 03:56:40.476315 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 03:56:40.476315 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 03:56:40.476315 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 03:56:40.476315 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT3T1Tg0DFz0guFQMDM9yU7WN_RUGuMbf_rWbbF4rS1oDiWv6x0dTsqBA7TFunkbzAHPQAqy9kZJmC_H2-rpZa4Diw9UEoM4xkjg4JciNrIIW263ufBC_07F6Mlg4-xs8Q2J9bkOD2CDMpGZHCZ5KbDaJBjuAHOQ_5qLd75r8z_OFtFo Oct 19 03:56:40.476315 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 03:56:40.476315 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 03:56:40.476315 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 03:56:40.476315 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 03:56:40.476315 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 03:56:40.476315 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 03:56:40.476315 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: ea131e741ef34573aa73360c5010221a Oct 19 03:56:40.476315 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-AttachVolumeNegativeTest-892544868 Oct 19 03:56:40.476315 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 03:56:40.476315 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 03:56:40.476315 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ea131e741ef34573aa73360c5010221a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ea131e741ef34573aa73360c5010221a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ea131e741ef34573aa73360c5010221a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ea131e741ef34573aa73360c5010221a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:56:40.476315 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-AttachVolumeNegativeTest-892544868 Oct 19 03:56:40.476315 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: ea131e741ef34573aa73360c5010221a Oct 19 03:56:40.476315 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-892544868 Oct 19 03:56:40.476315 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-AttachVolumeNegativeTest-892544868-project Oct 19 03:56:40.476315 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 03:56:40.476315 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 03:56:40.476315 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 14706e15b5d7487a9b1d1a6332f93f7c Oct 19 03:56:40.476315 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-AttachVolumeNegativeTest-892544868-project Oct 19 03:56:40.476315 n-d-861333-8 devstack@n-api.service[121135]: Oct 19 03:56:40.476315 n-d-861333-8 devstack@n-api.service[121135]: {"volumeAttachment": {"volumeId": "d6c0a330-4bb6-48cf-92d2-d74238c3cd54"}} Oct 19 03:56:40.476315 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 03:56:40.476315 n-d-861333-8 devstack@n-api.service[121135]: exception: Invalid volume: volume d6c0a330-4bb6-48cf-92d2-d74238c3cd54 is already attached to instances: 5f833ef3-e5bd-4953-a3ca-5cddddb2641f Oct 19 03:56:40.476315 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'server_id': 'ac1213da-e573-4522-a8cd-685e598892f3', 'body': {'volumeAttachment': {'volumeId': 'd6c0a330-4bb6-48cf-92d2-d74238c3cd54'}}} Oct 19 03:56:40.476315 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:56:40.476315 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:56:40.476315 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 19 03:56:40.476315 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 19 03:56:40.476315 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 19 03:56:40.476315 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 19 03:56:40.476315 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 19 03:56:40.476315 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 19 03:56:40.476315 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 19 03:56:40.476315 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 19 03:56:40.476315 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 19 03:56:40.476315 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 19 03:56:40.476315 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume d6c0a330-4bb6-48cf-92d2-d74238c3cd54 is already attached to instances: 5f833ef3-e5bd-4953-a3ca-5cddddb2641f Oct 19 03:56:40.476315 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:56:40.476315 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:56:40.476315 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:56:40.476315 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:56:40.476315 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:56:40.476315 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:56:40.476315 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:56:40.476315 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:56:40.476315 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:56:40.476315 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:56:40.476315 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:56:40.476315 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:56:40.476315 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:56:40.476315 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:56:40.481126 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:56:40.481126 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:56:40.481126 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 19 03:56:40.481126 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 19 03:56:40.481126 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume d6c0a330-4bb6-48cf-92d2-d74238c3cd54 is already attached to instances: 5f833ef3-e5bd-4953-a3ca-5cddddb2641f Oct 19 03:56:40.481126 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:56:40.481126 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:56:40.481126 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:56:40.481126 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:56:40.481126 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:56:40.481126 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:56:40.481126 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:56:40.481126 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:56:40.481126 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume d6c0a330-4bb6-48cf-92d2-d74238c3cd54 is already attached to instances: 5f833ef3-e5bd-4953-a3ca-5cddddb2641f Oct 19 03:56:40.481126 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 03:56:40.485079 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-17c86515-11f0-420a-8ce8-4375a8f764e9 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Returning 400 to user: Invalid volume: volume d6c0a330-4bb6-48cf-92d2-d74238c3cd54 is already attached to instances: 5f833ef3-e5bd-4953-a3ca-5cddddb2641f {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:56:40.485079 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-17c86515-11f0-420a-8ce8-4375a8f764e9 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "POST /compute/v2.1/servers/ac1213da-e573-4522-a8cd-685e598892f3/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.161706 Oct 19 03:56:40.485079 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3363/6666] 10.222.0.52 () {60 vars in 1323 bytes} [Wed Oct 19 03:56:40 2022] POST /compute/v2.1/servers/ac1213da-e573-4522-a8cd-685e598892f3/os-volume_attachments => generated 174 bytes in 163 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 03:56:40.495189 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b76d8fc9-2d81-4d68-8c2f-a48cc7b756de tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:56:40.495713 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b76d8fc9-2d81-4d68-8c2f-a48cc7b756de tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: ac1213da-e573-4522-a8cd-685e598892f3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:56:40.506764 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b76d8fc9-2d81-4d68-8c2f-a48cc7b756de tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:40.507350 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b76d8fc9-2d81-4d68-8c2f-a48cc7b756de tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:40.507807 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b76d8fc9-2d81-4d68-8c2f-a48cc7b756de tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:40.508592 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b76d8fc9-2d81-4d68-8c2f-a48cc7b756de tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:40.509665 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b76d8fc9-2d81-4d68-8c2f-a48cc7b756de tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:40.510109 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b76d8fc9-2d81-4d68-8c2f-a48cc7b756de tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:40.801608 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b76d8fc9-2d81-4d68-8c2f-a48cc7b756de tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: ac1213da-e573-4522-a8cd-685e598892f3] Going to try to terminate instance {{(pid=121134) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:56:41.227943 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b76d8fc9-2d81-4d68-8c2f-a48cc7b756de tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ac1213da-e573-4522-a8cd-685e598892f3" status: 204 len: 0 microversion: 2.1 time: 0.737527 Oct 19 03:56:41.228829 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3304/6667] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:56:40 2022] DELETE /compute/v2.1/servers/ac1213da-e573-4522-a8cd-685e598892f3 => generated 0 bytes in 739 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:56:41.236773 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-95333789-9338-4f77-adea-61422c69a76f tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:56:41.237429 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-95333789-9338-4f77-adea-61422c69a76f tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: ac1213da-e573-4522-a8cd-685e598892f3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:56:41.246284 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-95333789-9338-4f77-adea-61422c69a76f tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:41.246774 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-95333789-9338-4f77-adea-61422c69a76f tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:41.247209 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-95333789-9338-4f77-adea-61422c69a76f tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:41.247939 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-95333789-9338-4f77-adea-61422c69a76f tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:41.248491 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-95333789-9338-4f77-adea-61422c69a76f tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:41.248925 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-95333789-9338-4f77-adea-61422c69a76f tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:41.322169 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-828c8fb2-3f26-4891-b47f-0e7cadd0087d tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:56:41.323513 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-828c8fb2-3f26-4891-b47f-0e7cadd0087d tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: 6de16745-5838-4ba1-b987-1e1e4084dd7f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:56:41.401480 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-828c8fb2-3f26-4891-b47f-0e7cadd0087d tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:56:41.412651 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-828c8fb2-3f26-4891-b47f-0e7cadd0087d tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/6de16745-5838-4ba1-b987-1e1e4084dd7f" status: 200 len: 1264 microversion: 2.1 time: 0.094749 Oct 19 03:56:41.426217 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3305/6668] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:56:41 2022] GET /compute/v2.1/servers/6de16745-5838-4ba1-b987-1e1e4084dd7f => generated 1264 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:56:41.431728 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-95333789-9338-4f77-adea-61422c69a76f tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14706e15b5d7487a9b1d1a6332f93f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea131e741ef34573aa73360c5010221a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:56:41.440487 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-95333789-9338-4f77-adea-61422c69a76f tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "GET /compute/v2.1/servers/ac1213da-e573-4522-a8cd-685e598892f3" status: 200 len: 1682 microversion: 2.1 time: 0.207460 Oct 19 03:56:41.441077 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3364/6669] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:56:41 2022] GET /compute/v2.1/servers/ac1213da-e573-4522-a8cd-685e598892f3 => generated 1682 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:56:42.436843 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-fb603e3b-bbb5-493c-80ef-4813ee8b9858 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:56:42.437747 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-fb603e3b-bbb5-493c-80ef-4813ee8b9858 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: 6de16745-5838-4ba1-b987-1e1e4084dd7f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:56:42.445604 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fb603e3b-bbb5-493c-80ef-4813ee8b9858 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:42.446133 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fb603e3b-bbb5-493c-80ef-4813ee8b9858 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:42.446811 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fb603e3b-bbb5-493c-80ef-4813ee8b9858 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:42.447828 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fb603e3b-bbb5-493c-80ef-4813ee8b9858 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:42.448687 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fb603e3b-bbb5-493c-80ef-4813ee8b9858 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:42.449329 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fb603e3b-bbb5-493c-80ef-4813ee8b9858 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:42.472099 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e462d1f8-a79d-4f7c-a6c3-133e541fde08 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:56:42.473340 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e462d1f8-a79d-4f7c-a6c3-133e541fde08 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: ac1213da-e573-4522-a8cd-685e598892f3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:56:42.481974 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e462d1f8-a79d-4f7c-a6c3-133e541fde08 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:42.482544 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e462d1f8-a79d-4f7c-a6c3-133e541fde08 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:42.483001 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e462d1f8-a79d-4f7c-a6c3-133e541fde08 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:42.490295 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e462d1f8-a79d-4f7c-a6c3-133e541fde08 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:42.490858 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e462d1f8-a79d-4f7c-a6c3-133e541fde08 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:42.491384 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e462d1f8-a79d-4f7c-a6c3-133e541fde08 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:42.531308 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-fb603e3b-bbb5-493c-80ef-4813ee8b9858 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:56:42.544102 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-fb603e3b-bbb5-493c-80ef-4813ee8b9858 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/6de16745-5838-4ba1-b987-1e1e4084dd7f" status: 200 len: 1316 microversion: 2.1 time: 0.111332 Oct 19 03:56:42.553911 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3306/6670] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:56:42 2022] GET /compute/v2.1/servers/6de16745-5838-4ba1-b987-1e1e4084dd7f => generated 1316 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:56:42.676927 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-e462d1f8-a79d-4f7c-a6c3-133e541fde08 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14706e15b5d7487a9b1d1a6332f93f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea131e741ef34573aa73360c5010221a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:56:42.686648 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e462d1f8-a79d-4f7c-a6c3-133e541fde08 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "GET /compute/v2.1/servers/ac1213da-e573-4522-a8cd-685e598892f3" status: 200 len: 1682 microversion: 2.1 time: 0.220679 Oct 19 03:56:42.697930 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3365/6671] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:56:42 2022] GET /compute/v2.1/servers/ac1213da-e573-4522-a8cd-685e598892f3 => generated 1682 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:56:43.581141 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c4e71e1d-74a2-4bc6-bed4-de1e9dd0e084 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:56:43.582845 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c4e71e1d-74a2-4bc6-bed4-de1e9dd0e084 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: 6de16745-5838-4ba1-b987-1e1e4084dd7f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:56:43.605456 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c4e71e1d-74a2-4bc6-bed4-de1e9dd0e084 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:43.605456 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c4e71e1d-74a2-4bc6-bed4-de1e9dd0e084 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:43.605456 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c4e71e1d-74a2-4bc6-bed4-de1e9dd0e084 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:43.605456 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c4e71e1d-74a2-4bc6-bed4-de1e9dd0e084 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:43.605456 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c4e71e1d-74a2-4bc6-bed4-de1e9dd0e084 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:43.605456 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c4e71e1d-74a2-4bc6-bed4-de1e9dd0e084 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:43.711576 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ef9a8199-432b-43ff-b417-8c7ce43c276b tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:56:43.715982 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ef9a8199-432b-43ff-b417-8c7ce43c276b tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: ac1213da-e573-4522-a8cd-685e598892f3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:56:43.720359 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ef9a8199-432b-43ff-b417-8c7ce43c276b tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:43.721098 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ef9a8199-432b-43ff-b417-8c7ce43c276b tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:43.721752 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ef9a8199-432b-43ff-b417-8c7ce43c276b tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:43.723166 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ef9a8199-432b-43ff-b417-8c7ce43c276b tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:43.723819 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ef9a8199-432b-43ff-b417-8c7ce43c276b tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:43.724410 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ef9a8199-432b-43ff-b417-8c7ce43c276b tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:44.074192 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c4e71e1d-74a2-4bc6-bed4-de1e9dd0e084 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:56:44.083623 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c4e71e1d-74a2-4bc6-bed4-de1e9dd0e084 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/6de16745-5838-4ba1-b987-1e1e4084dd7f" status: 200 len: 1322 microversion: 2.1 time: 0.509200 Oct 19 03:56:44.084206 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3307/6672] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:56:43 2022] GET /compute/v2.1/servers/6de16745-5838-4ba1-b987-1e1e4084dd7f => generated 1322 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:56:44.297675 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ef9a8199-432b-43ff-b417-8c7ce43c276b tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14706e15b5d7487a9b1d1a6332f93f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea131e741ef34573aa73360c5010221a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:56:44.306513 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ef9a8199-432b-43ff-b417-8c7ce43c276b tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "GET /compute/v2.1/servers/ac1213da-e573-4522-a8cd-685e598892f3" status: 200 len: 1682 microversion: 2.1 time: 0.599199 Oct 19 03:56:44.307111 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3366/6673] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:56:43 2022] GET /compute/v2.1/servers/ac1213da-e573-4522-a8cd-685e598892f3 => generated 1682 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:56:45.119053 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-06b0e6c9-df89-4af5-8b3d-4790dec626fd req-3a9ae93f-2540-4b90-806c-1735e6ba3a9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac1213da-e573-4522-a8cd-685e598892f3", "name": "network-vif-deleted", "tag": "e039f998-073a-4974-a2eb-9d3fae5bf2d4"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:56:45.123669 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-cf922273-36b9-47e2-86e0-59691294e75c tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:56:45.125813 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-cf922273-36b9-47e2-86e0-59691294e75c tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: 6de16745-5838-4ba1-b987-1e1e4084dd7f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:56:45.136517 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cf922273-36b9-47e2-86e0-59691294e75c tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:45.137476 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cf922273-36b9-47e2-86e0-59691294e75c tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:45.138501 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cf922273-36b9-47e2-86e0-59691294e75c tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:45.139588 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cf922273-36b9-47e2-86e0-59691294e75c tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:45.139731 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-06b0e6c9-df89-4af5-8b3d-4790dec626fd req-3a9ae93f-2540-4b90-806c-1735e6ba3a9f service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:45.140081 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-06b0e6c9-df89-4af5-8b3d-4790dec626fd req-3a9ae93f-2540-4b90-806c-1735e6ba3a9f service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:45.140562 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-06b0e6c9-df89-4af5-8b3d-4790dec626fd req-3a9ae93f-2540-4b90-806c-1735e6ba3a9f service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:45.141986 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cf922273-36b9-47e2-86e0-59691294e75c tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:45.142797 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cf922273-36b9-47e2-86e0-59691294e75c tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:45.155794 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-06b0e6c9-df89-4af5-8b3d-4790dec626fd req-3a9ae93f-2540-4b90-806c-1735e6ba3a9f service nova] Creating event network-vif-deleted:e039f998-073a-4974-a2eb-9d3fae5bf2d4 for instance ac1213da-e573-4522-a8cd-685e598892f3 on n-h2-861333-8 Oct 19 03:56:45.162443 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-06b0e6c9-df89-4af5-8b3d-4790dec626fd req-3a9ae93f-2540-4b90-806c-1735e6ba3a9f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057529 Oct 19 03:56:45.167116 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3367/6674] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:56:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:56:45.338560 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9dc84e71-69e1-40b4-8f77-4b076c90286f tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:56:45.339739 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9dc84e71-69e1-40b4-8f77-4b076c90286f tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: ac1213da-e573-4522-a8cd-685e598892f3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:56:45.353058 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9dc84e71-69e1-40b4-8f77-4b076c90286f tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:45.355083 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9dc84e71-69e1-40b4-8f77-4b076c90286f tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:45.358135 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9dc84e71-69e1-40b4-8f77-4b076c90286f tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:45.395676 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9dc84e71-69e1-40b4-8f77-4b076c90286f tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:45.396585 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9dc84e71-69e1-40b4-8f77-4b076c90286f tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.040s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:45.397236 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9dc84e71-69e1-40b4-8f77-4b076c90286f tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:45.398777 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-cf922273-36b9-47e2-86e0-59691294e75c tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:56:45.410997 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-cf922273-36b9-47e2-86e0-59691294e75c tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/6de16745-5838-4ba1-b987-1e1e4084dd7f" status: 200 len: 1390 microversion: 2.1 time: 0.303774 Oct 19 03:56:45.419712 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3308/6675] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:56:45 2022] GET /compute/v2.1/servers/6de16745-5838-4ba1-b987-1e1e4084dd7f => generated 1390 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:56:45.491435 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-9dc84e71-69e1-40b4-8f77-4b076c90286f tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14706e15b5d7487a9b1d1a6332f93f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea131e741ef34573aa73360c5010221a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:56:45.501053 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9dc84e71-69e1-40b4-8f77-4b076c90286f tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "GET /compute/v2.1/servers/ac1213da-e573-4522-a8cd-685e598892f3" status: 200 len: 1327 microversion: 2.1 time: 0.171872 Oct 19 03:56:45.517208 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3368/6676] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:56:45 2022] GET /compute/v2.1/servers/ac1213da-e573-4522-a8cd-685e598892f3 => generated 1327 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:56:46.445691 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f09571a5-dc08-4539-a15f-779984394417 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:56:46.446332 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f09571a5-dc08-4539-a15f-779984394417 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: 6de16745-5838-4ba1-b987-1e1e4084dd7f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:56:46.458748 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f09571a5-dc08-4539-a15f-779984394417 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:46.461108 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f09571a5-dc08-4539-a15f-779984394417 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:46.461797 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f09571a5-dc08-4539-a15f-779984394417 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:46.462752 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f09571a5-dc08-4539-a15f-779984394417 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:46.463388 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f09571a5-dc08-4539-a15f-779984394417 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:46.464269 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f09571a5-dc08-4539-a15f-779984394417 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:46.525245 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9a939d79-fc77-4b67-9d68-b6aa19ff743f tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:56:46.526705 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9a939d79-fc77-4b67-9d68-b6aa19ff743f tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: ac1213da-e573-4522-a8cd-685e598892f3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:56:46.542058 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9a939d79-fc77-4b67-9d68-b6aa19ff743f tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:46.544446 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9a939d79-fc77-4b67-9d68-b6aa19ff743f tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:46.546063 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9a939d79-fc77-4b67-9d68-b6aa19ff743f tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:46.548214 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9a939d79-fc77-4b67-9d68-b6aa19ff743f tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:46.550460 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9a939d79-fc77-4b67-9d68-b6aa19ff743f tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:46.551790 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9a939d79-fc77-4b67-9d68-b6aa19ff743f tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:46.602064 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9a939d79-fc77-4b67-9d68-b6aa19ff743f tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:46.602917 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9a939d79-fc77-4b67-9d68-b6aa19ff743f tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:46.603595 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9a939d79-fc77-4b67-9d68-b6aa19ff743f tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:46.604381 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-9a939d79-fc77-4b67-9d68-b6aa19ff743f tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lazy-loading 'fault' on Instance uuid ac1213da-e573-4522-a8cd-685e598892f3 {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:56:46.674377 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-9a939d79-fc77-4b67-9d68-b6aa19ff743f tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14706e15b5d7487a9b1d1a6332f93f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea131e741ef34573aa73360c5010221a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:56:46.686480 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9a939d79-fc77-4b67-9d68-b6aa19ff743f tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "GET /compute/v2.1/servers/ac1213da-e573-4522-a8cd-685e598892f3" status: 200 len: 1332 microversion: 2.1 time: 0.165260 Oct 19 03:56:46.696808 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3369/6677] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:56:46 2022] GET /compute/v2.1/servers/ac1213da-e573-4522-a8cd-685e598892f3 => generated 1332 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:56:46.714356 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-f09571a5-dc08-4539-a15f-779984394417 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:56:46.723872 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f09571a5-dc08-4539-a15f-779984394417 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/6de16745-5838-4ba1-b987-1e1e4084dd7f" status: 200 len: 1390 microversion: 2.1 time: 0.283116 Oct 19 03:56:46.724533 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3309/6678] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:56:46 2022] GET /compute/v2.1/servers/6de16745-5838-4ba1-b987-1e1e4084dd7f => generated 1390 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:56:47.182292 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-43ac875b-8fdb-498f-99ad-9c937b3eb43d req-83c10927-a407-4524-a23c-2545b1c408b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6de16745-5838-4ba1-b987-1e1e4084dd7f", "tag": "11ca3831-bfbb-4328-9073-14dcd2216de2"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:56:47.192567 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-43ac875b-8fdb-498f-99ad-9c937b3eb43d req-83c10927-a407-4524-a23c-2545b1c408b7 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:47.193141 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-43ac875b-8fdb-498f-99ad-9c937b3eb43d req-83c10927-a407-4524-a23c-2545b1c408b7 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:47.193680 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-43ac875b-8fdb-498f-99ad-9c937b3eb43d req-83c10927-a407-4524-a23c-2545b1c408b7 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:47.204962 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-43ac875b-8fdb-498f-99ad-9c937b3eb43d req-83c10927-a407-4524-a23c-2545b1c408b7 service nova] Creating event network-changed:11ca3831-bfbb-4328-9073-14dcd2216de2 for instance 6de16745-5838-4ba1-b987-1e1e4084dd7f on n-h1-861333-8 Oct 19 03:56:47.209899 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-43ac875b-8fdb-498f-99ad-9c937b3eb43d req-83c10927-a407-4524-a23c-2545b1c408b7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031273 Oct 19 03:56:47.210492 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3370/6679] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:56:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:56:47.712160 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2adc79fb-63d9-4ff7-b7b2-ae2db8c55ab6 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:56:47.712787 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2adc79fb-63d9-4ff7-b7b2-ae2db8c55ab6 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: ac1213da-e573-4522-a8cd-685e598892f3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:56:47.719654 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2adc79fb-63d9-4ff7-b7b2-ae2db8c55ab6 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:47.720151 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2adc79fb-63d9-4ff7-b7b2-ae2db8c55ab6 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:47.720594 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2adc79fb-63d9-4ff7-b7b2-ae2db8c55ab6 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:47.721299 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2adc79fb-63d9-4ff7-b7b2-ae2db8c55ab6 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:47.721789 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2adc79fb-63d9-4ff7-b7b2-ae2db8c55ab6 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:47.722229 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2adc79fb-63d9-4ff7-b7b2-ae2db8c55ab6 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:47.739205 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-2adc79fb-63d9-4ff7-b7b2-ae2db8c55ab6 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] HTTP exception thrown: Instance ac1213da-e573-4522-a8cd-685e598892f3 could not be found. Oct 19 03:56:47.740914 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2adc79fb-63d9-4ff7-b7b2-ae2db8c55ab6 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Request method failure captured: Oct 19 03:56:47.740914 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/ac1213da-e573-4522-a8cd-685e598892f3 HTTP/1.1 Oct 19 03:56:47.740914 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:56:47.740914 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:56:47.740914 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:56:47.740914 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:56:47.740914 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:56:47.740914 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:56:47.740914 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:56:47.740914 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:56:47.740914 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3T1Tg0DFz0guFQMDM9yU7WN_RUGuMbf_rWbbF4rS1oDiWv6x0dTsqBA7TFunkbzAHPQAqy9kZJmC_H2-rpZa4Diw9UEoM4xkjg4JciNrIIW263ufBC_07F6Mlg4-xs8Q2J9bkOD2CDMpGZHCZ5KbDaJBjuAHOQ_5qLd75r8z_OFtFo Oct 19 03:56:47.740914 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:56:47.740914 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:56:47.740914 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:56:47.740914 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:56:47.740914 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:56:47.740914 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:56:47.740914 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: ea131e741ef34573aa73360c5010221a Oct 19 03:56:47.740914 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-AttachVolumeNegativeTest-892544868 Oct 19 03:56:47.740914 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:56:47.740914 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:56:47.740914 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ea131e741ef34573aa73360c5010221a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ea131e741ef34573aa73360c5010221a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ea131e741ef34573aa73360c5010221a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ea131e741ef34573aa73360c5010221a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:56:47.740914 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-AttachVolumeNegativeTest-892544868 Oct 19 03:56:47.740914 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: ea131e741ef34573aa73360c5010221a Oct 19 03:56:47.740914 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-892544868 Oct 19 03:56:47.740914 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-AttachVolumeNegativeTest-892544868-project Oct 19 03:56:47.740914 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:56:47.740914 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:56:47.740914 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 14706e15b5d7487a9b1d1a6332f93f7c Oct 19 03:56:47.740914 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-AttachVolumeNegativeTest-892544868-project Oct 19 03:56:47.740914 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:56:47.740914 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance ac1213da-e573-4522-a8cd-685e598892f3 could not be found. Oct 19 03:56:47.740914 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': 'ac1213da-e573-4522-a8cd-685e598892f3'} Oct 19 03:56:47.740914 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:56:47.740914 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:56:47.740914 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:56:47.740914 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:56:47.740914 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:56:47.740914 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:56:47.740914 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:56:47.740914 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:56:47.740914 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:56:47.740914 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:56:47.740914 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac1213da-e573-4522-a8cd-685e598892f3 could not be found. Oct 19 03:56:47.740914 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:56:47.740914 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:56:47.740914 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:56:47.740914 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:56:47.740914 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:56:47.740914 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:56:47.740914 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:56:47.740914 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:56:47.740914 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:56:47.740914 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:56:47.740914 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:56:47.740914 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:56:47.740914 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:56:47.740914 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:56:47.740914 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:56:47.740914 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:56:47.740914 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac1213da-e573-4522-a8cd-685e598892f3 could not be found. Oct 19 03:56:47.740914 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:56:47.740914 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:56:47.740914 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:56:47.745229 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:56:47.745229 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:56:47.745229 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:56:47.745229 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:56:47.745229 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:56:47.745229 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac1213da-e573-4522-a8cd-685e598892f3 could not be found. Oct 19 03:56:47.745229 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:56:47.745229 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2adc79fb-63d9-4ff7-b7b2-ae2db8c55ab6 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Returning 404 to user: Instance ac1213da-e573-4522-a8cd-685e598892f3 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:56:47.745229 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2adc79fb-63d9-4ff7-b7b2-ae2db8c55ab6 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "GET /compute/v2.1/servers/ac1213da-e573-4522-a8cd-685e598892f3" status: 404 len: 111 microversion: 2.1 time: 0.034232 Oct 19 03:56:47.745229 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3310/6680] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:56:47 2022] GET /compute/v2.1/servers/ac1213da-e573-4522-a8cd-685e598892f3 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:56:47.750823 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-540cf9ae-03f4-4796-bedc-846f51d8eb94 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Calling method '.version_select at 0x7fc13024e5e0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:56:47.752051 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d347056a-64cf-4966-9474-9d7bf894b88b tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:56:47.752899 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d347056a-64cf-4966-9474-9d7bf894b88b tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: 6de16745-5838-4ba1-b987-1e1e4084dd7f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:56:47.760826 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d347056a-64cf-4966-9474-9d7bf894b88b tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:47.761483 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d347056a-64cf-4966-9474-9d7bf894b88b tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:47.762020 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d347056a-64cf-4966-9474-9d7bf894b88b tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:47.762818 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d347056a-64cf-4966-9474-9d7bf894b88b tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:47.763777 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d347056a-64cf-4966-9474-9d7bf894b88b tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:47.764122 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d347056a-64cf-4966-9474-9d7bf894b88b tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:47.829546 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-540cf9ae-03f4-4796-bedc-846f51d8eb94 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1550976726" status: 202 len: 0 microversion: 2.1 time: 0.082133 Oct 19 03:56:47.830260 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3311/6681] 10.222.0.52 () {58 vars in 1221 bytes} [Wed Oct 19 03:56:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1550976726 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:56:47.955666 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d347056a-64cf-4966-9474-9d7bf894b88b tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:56:47.964210 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d347056a-64cf-4966-9474-9d7bf894b88b tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/6de16745-5838-4ba1-b987-1e1e4084dd7f" status: 200 len: 1390 microversion: 2.1 time: 0.216270 Oct 19 03:56:47.964892 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3371/6682] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:56:47 2022] GET /compute/v2.1/servers/6de16745-5838-4ba1-b987-1e1e4084dd7f => generated 1390 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:56:48.714197 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c24e7404-7909-4768-ac92-4415c303bab7 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:56:48.714761 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c24e7404-7909-4768-ac92-4415c303bab7 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: 5f833ef3-e5bd-4953-a3ca-5cddddb2641f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:56:48.723201 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c24e7404-7909-4768-ac92-4415c303bab7 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:48.723703 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c24e7404-7909-4768-ac92-4415c303bab7 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:48.724149 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c24e7404-7909-4768-ac92-4415c303bab7 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:48.724858 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c24e7404-7909-4768-ac92-4415c303bab7 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:48.725355 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c24e7404-7909-4768-ac92-4415c303bab7 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:48.725797 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c24e7404-7909-4768-ac92-4415c303bab7 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:48.806867 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-c24e7404-7909-4768-ac92-4415c303bab7 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lazy-loading 'services' on Instance uuid 5f833ef3-e5bd-4953-a3ca-5cddddb2641f {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:56:48.988016 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9098948c-82a6-430e-a1b3-4b78fc804fcf tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:56:48.988746 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9098948c-82a6-430e-a1b3-4b78fc804fcf tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: 6de16745-5838-4ba1-b987-1e1e4084dd7f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:56:48.995997 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9098948c-82a6-430e-a1b3-4b78fc804fcf tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:48.996563 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9098948c-82a6-430e-a1b3-4b78fc804fcf tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:48.997069 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9098948c-82a6-430e-a1b3-4b78fc804fcf tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:48.997879 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9098948c-82a6-430e-a1b3-4b78fc804fcf tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:48.998400 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9098948c-82a6-430e-a1b3-4b78fc804fcf tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:48.998890 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9098948c-82a6-430e-a1b3-4b78fc804fcf tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:49.007170 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c24e7404-7909-4768-ac92-4415c303bab7 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "DELETE /compute/v2.1/servers/5f833ef3-e5bd-4953-a3ca-5cddddb2641f/os-volume_attachments/d6c0a330-4bb6-48cf-92d2-d74238c3cd54" status: 202 len: 0 microversion: 2.1 time: 0.296868 Oct 19 03:56:49.007773 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3312/6683] 10.222.0.52 () {58 vars in 1416 bytes} [Wed Oct 19 03:56:48 2022] DELETE /compute/v2.1/servers/5f833ef3-e5bd-4953-a3ca-5cddddb2641f/os-volume_attachments/d6c0a330-4bb6-48cf-92d2-d74238c3cd54 => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:56:49.017974 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ab9055ad-9c8b-4d98-8268-fd8f42ad34f1 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:56:49.021424 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ab9055ad-9c8b-4d98-8268-fd8f42ad34f1 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: 5f833ef3-e5bd-4953-a3ca-5cddddb2641f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:56:49.027721 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ab9055ad-9c8b-4d98-8268-fd8f42ad34f1 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:49.028999 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ab9055ad-9c8b-4d98-8268-fd8f42ad34f1 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:49.029660 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ab9055ad-9c8b-4d98-8268-fd8f42ad34f1 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:49.030551 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ab9055ad-9c8b-4d98-8268-fd8f42ad34f1 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:49.031005 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ab9055ad-9c8b-4d98-8268-fd8f42ad34f1 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:49.031433 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ab9055ad-9c8b-4d98-8268-fd8f42ad34f1 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:49.062264 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ab9055ad-9c8b-4d98-8268-fd8f42ad34f1 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "GET /compute/v2.1/servers/5f833ef3-e5bd-4953-a3ca-5cddddb2641f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049814 Oct 19 03:56:49.063500 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3313/6684] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Oct 19 03:56:49 2022] GET /compute/v2.1/servers/5f833ef3-e5bd-4953-a3ca-5cddddb2641f/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:56:49.147056 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-9098948c-82a6-430e-a1b3-4b78fc804fcf tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:56:49.155395 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9098948c-82a6-430e-a1b3-4b78fc804fcf tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/6de16745-5838-4ba1-b987-1e1e4084dd7f" status: 200 len: 1390 microversion: 2.1 time: 0.171539 Oct 19 03:56:49.156830 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3372/6685] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:56:48 2022] GET /compute/v2.1/servers/6de16745-5838-4ba1-b987-1e1e4084dd7f => generated 1390 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:56:50.077026 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3e14e309-1580-43f2-9d72-a99f82a8c508 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:56:50.079611 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3e14e309-1580-43f2-9d72-a99f82a8c508 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: 5f833ef3-e5bd-4953-a3ca-5cddddb2641f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:56:50.083133 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:56:50.088229 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3e14e309-1580-43f2-9d72-a99f82a8c508 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:50.088713 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3e14e309-1580-43f2-9d72-a99f82a8c508 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:50.089158 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3e14e309-1580-43f2-9d72-a99f82a8c508 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:50.089906 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3e14e309-1580-43f2-9d72-a99f82a8c508 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:50.090354 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3e14e309-1580-43f2-9d72-a99f82a8c508 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:50.090878 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3e14e309-1580-43f2-9d72-a99f82a8c508 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:50.123722 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3e14e309-1580-43f2-9d72-a99f82a8c508 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "GET /compute/v2.1/servers/5f833ef3-e5bd-4953-a3ca-5cddddb2641f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051712 Oct 19 03:56:50.128587 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3314/6686] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Oct 19 03:56:50 2022] GET /compute/v2.1/servers/5f833ef3-e5bd-4953-a3ca-5cddddb2641f/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:56:50.179517 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1989dae8-8ebe-4fe1-8635-66b278c64a0b tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:56:50.180156 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1989dae8-8ebe-4fe1-8635-66b278c64a0b tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: 6de16745-5838-4ba1-b987-1e1e4084dd7f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:56:50.187305 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1989dae8-8ebe-4fe1-8635-66b278c64a0b tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:50.187795 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1989dae8-8ebe-4fe1-8635-66b278c64a0b tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:50.188237 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1989dae8-8ebe-4fe1-8635-66b278c64a0b tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:50.188934 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1989dae8-8ebe-4fe1-8635-66b278c64a0b tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:50.189409 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1989dae8-8ebe-4fe1-8635-66b278c64a0b tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:50.189845 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1989dae8-8ebe-4fe1-8635-66b278c64a0b tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:50.292364 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:56:50.324018 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-1989dae8-8ebe-4fe1-8635-66b278c64a0b tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:56:50.331687 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1989dae8-8ebe-4fe1-8635-66b278c64a0b tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/6de16745-5838-4ba1-b987-1e1e4084dd7f" status: 200 len: 1390 microversion: 2.1 time: 0.156731 Oct 19 03:56:50.332345 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3373/6687] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:56:50 2022] GET /compute/v2.1/servers/6de16745-5838-4ba1-b987-1e1e4084dd7f => generated 1390 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:56:51.136590 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d255ba88-05cb-4a0f-9c5b-5328da6e450e tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:56:51.138776 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d255ba88-05cb-4a0f-9c5b-5328da6e450e tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: 5f833ef3-e5bd-4953-a3ca-5cddddb2641f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:56:51.141824 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=62,nova_api:DELETE=2,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:56:51.147070 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d255ba88-05cb-4a0f-9c5b-5328da6e450e tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:51.147556 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d255ba88-05cb-4a0f-9c5b-5328da6e450e tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:51.147998 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d255ba88-05cb-4a0f-9c5b-5328da6e450e tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:51.148695 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d255ba88-05cb-4a0f-9c5b-5328da6e450e tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:51.149148 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d255ba88-05cb-4a0f-9c5b-5328da6e450e tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:51.149612 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d255ba88-05cb-4a0f-9c5b-5328da6e450e tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:51.182017 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d255ba88-05cb-4a0f-9c5b-5328da6e450e tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "GET /compute/v2.1/servers/5f833ef3-e5bd-4953-a3ca-5cddddb2641f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049480 Oct 19 03:56:51.182860 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3315/6688] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Oct 19 03:56:51 2022] GET /compute/v2.1/servers/5f833ef3-e5bd-4953-a3ca-5cddddb2641f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:56:51.355823 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-8ff38e1e-2bd4-4894-bc70-23d2b93c2220 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:56:51.356453 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-8ff38e1e-2bd4-4894-bc70-23d2b93c2220 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: 6de16745-5838-4ba1-b987-1e1e4084dd7f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:56:51.364027 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8ff38e1e-2bd4-4894-bc70-23d2b93c2220 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:51.364536 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8ff38e1e-2bd4-4894-bc70-23d2b93c2220 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:51.364989 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8ff38e1e-2bd4-4894-bc70-23d2b93c2220 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:51.365775 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8ff38e1e-2bd4-4894-bc70-23d2b93c2220 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:51.366246 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8ff38e1e-2bd4-4894-bc70-23d2b93c2220 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:51.366685 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8ff38e1e-2bd4-4894-bc70-23d2b93c2220 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:51.511282 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-8ff38e1e-2bd4-4894-bc70-23d2b93c2220 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:56:51.520328 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-8ff38e1e-2bd4-4894-bc70-23d2b93c2220 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/6de16745-5838-4ba1-b987-1e1e4084dd7f" status: 200 len: 1390 microversion: 2.1 time: 0.167777 Oct 19 03:56:51.521054 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3374/6689] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:56:51 2022] GET /compute/v2.1/servers/6de16745-5838-4ba1-b987-1e1e4084dd7f => generated 1390 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:56:51.597340 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5589cdae-62c8-4291-a7ae-8f8b5e7c24d6 tempest-TestVolumeBackupRestore-1994640921 tempest-TestVolumeBackupRestore-1994640921-project] Action: 'create', calling method: .version_select at 0x7fc12bed9310>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-1287828978", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH309EkFKjCJVNL2CGZr3Tb/tLczi/1+yl6AhgWBJLO4/pvZuF9z8dxspCDBuXK5uQf55IBvysAg+AsLLPwR2c99LmM2IzCGWTj5UiNf1trTdVi6LhMF2QhMYj3gO13GmQ=="}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:56:51.602803 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=8 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:56:51.614214 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-5589cdae-62c8-4291-a7ae-8f8b5e7c24d6 tempest-TestVolumeBackupRestore-1994640921 tempest-TestVolumeBackupRestore-1994640921-project] Getting quotas for project 02cfb344e9844795871b84beb245b688. Resources: {'key_pairs'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:56:51.619288 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-5589cdae-62c8-4291-a7ae-8f8b5e7c24d6 tempest-TestVolumeBackupRestore-1994640921 tempest-TestVolumeBackupRestore-1994640921-project] Getting quotas for user aa037965b2fa47d4ac0bf21aeacc9de5 and project 02cfb344e9844795871b84beb245b688. Resources: {'key_pairs'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:56:51.724290 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5589cdae-62c8-4291-a7ae-8f8b5e7c24d6 tempest-TestVolumeBackupRestore-1994640921 tempest-TestVolumeBackupRestore-1994640921-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.130650 Oct 19 03:56:51.724938 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3316/6690] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Oct 19 03:56:51 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:56:52.155156 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-8de1919b-7594-4f27-a358-fc2d1c138425 req-d39f4d88-ce2b-434e-8bfc-c4c60dc4fbb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6de16745-5838-4ba1-b987-1e1e4084dd7f", "name": "network-vif-plugged", "status": "completed", "tag": "11ca3831-bfbb-4328-9073-14dcd2216de2"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:56:52.164740 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-8de1919b-7594-4f27-a358-fc2d1c138425 req-d39f4d88-ce2b-434e-8bfc-c4c60dc4fbb4 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:52.165223 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-8de1919b-7594-4f27-a358-fc2d1c138425 req-d39f4d88-ce2b-434e-8bfc-c4c60dc4fbb4 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:52.165699 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-8de1919b-7594-4f27-a358-fc2d1c138425 req-d39f4d88-ce2b-434e-8bfc-c4c60dc4fbb4 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:52.177177 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-8de1919b-7594-4f27-a358-fc2d1c138425 req-d39f4d88-ce2b-434e-8bfc-c4c60dc4fbb4 service nova] Creating event network-vif-plugged:11ca3831-bfbb-4328-9073-14dcd2216de2 for instance 6de16745-5838-4ba1-b987-1e1e4084dd7f on n-h1-861333-8 Oct 19 03:56:52.182453 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-8de1919b-7594-4f27-a358-fc2d1c138425 req-d39f4d88-ce2b-434e-8bfc-c4c60dc4fbb4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031072 Oct 19 03:56:52.183296 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3375/6691] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:56:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:56:52.195750 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-95e0fdb1-ad32-4201-89ad-e01f4453c7d1 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:56:52.198142 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-95e0fdb1-ad32-4201-89ad-e01f4453c7d1 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: 5f833ef3-e5bd-4953-a3ca-5cddddb2641f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:56:52.206695 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-95e0fdb1-ad32-4201-89ad-e01f4453c7d1 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:52.207943 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-95e0fdb1-ad32-4201-89ad-e01f4453c7d1 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:52.208390 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-95e0fdb1-ad32-4201-89ad-e01f4453c7d1 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:52.209313 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-95e0fdb1-ad32-4201-89ad-e01f4453c7d1 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:52.209987 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-95e0fdb1-ad32-4201-89ad-e01f4453c7d1 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:52.210423 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-95e0fdb1-ad32-4201-89ad-e01f4453c7d1 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:52.273194 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-95e0fdb1-ad32-4201-89ad-e01f4453c7d1 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "GET /compute/v2.1/servers/5f833ef3-e5bd-4953-a3ca-5cddddb2641f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078757 Oct 19 03:56:52.273194 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3317/6692] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Oct 19 03:56:52 2022] GET /compute/v2.1/servers/5f833ef3-e5bd-4953-a3ca-5cddddb2641f/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:56:52.545567 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c0ae49d6-9490-49db-a60f-c40b04f54c0c tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:56:52.546818 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c0ae49d6-9490-49db-a60f-c40b04f54c0c tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: 6de16745-5838-4ba1-b987-1e1e4084dd7f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:56:52.553486 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c0ae49d6-9490-49db-a60f-c40b04f54c0c tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:52.554346 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c0ae49d6-9490-49db-a60f-c40b04f54c0c tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:52.554891 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c0ae49d6-9490-49db-a60f-c40b04f54c0c tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:52.555686 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c0ae49d6-9490-49db-a60f-c40b04f54c0c tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:52.556257 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c0ae49d6-9490-49db-a60f-c40b04f54c0c tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:52.556793 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c0ae49d6-9490-49db-a60f-c40b04f54c0c tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:52.735931 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c0ae49d6-9490-49db-a60f-c40b04f54c0c tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:56:52.744481 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c0ae49d6-9490-49db-a60f-c40b04f54c0c tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/6de16745-5838-4ba1-b987-1e1e4084dd7f" status: 200 len: 1390 microversion: 2.1 time: 0.204595 Oct 19 03:56:52.745078 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3376/6693] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:56:52 2022] GET /compute/v2.1/servers/6de16745-5838-4ba1-b987-1e1e4084dd7f => generated 1390 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:56:53.283613 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0031faee-97c8-414a-9779-9f2a270ad721 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:56:53.286087 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0031faee-97c8-414a-9779-9f2a270ad721 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: 5f833ef3-e5bd-4953-a3ca-5cddddb2641f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:56:53.292959 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0031faee-97c8-414a-9779-9f2a270ad721 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:53.293482 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0031faee-97c8-414a-9779-9f2a270ad721 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:53.293926 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0031faee-97c8-414a-9779-9f2a270ad721 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:53.294622 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0031faee-97c8-414a-9779-9f2a270ad721 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:53.295136 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0031faee-97c8-414a-9779-9f2a270ad721 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:53.295510 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0031faee-97c8-414a-9779-9f2a270ad721 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:53.327915 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0031faee-97c8-414a-9779-9f2a270ad721 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "GET /compute/v2.1/servers/5f833ef3-e5bd-4953-a3ca-5cddddb2641f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048343 Oct 19 03:56:53.328779 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3318/6694] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Oct 19 03:56:53 2022] GET /compute/v2.1/servers/5f833ef3-e5bd-4953-a3ca-5cddddb2641f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:56:53.768094 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f3df6c6d-b186-40ec-b4f7-ab1d90df2b4d tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:56:53.768641 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f3df6c6d-b186-40ec-b4f7-ab1d90df2b4d tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: 6de16745-5838-4ba1-b987-1e1e4084dd7f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:56:53.775750 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f3df6c6d-b186-40ec-b4f7-ab1d90df2b4d tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:53.776996 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f3df6c6d-b186-40ec-b4f7-ab1d90df2b4d tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:53.776996 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f3df6c6d-b186-40ec-b4f7-ab1d90df2b4d tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:53.777346 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f3df6c6d-b186-40ec-b4f7-ab1d90df2b4d tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:53.777816 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f3df6c6d-b186-40ec-b4f7-ab1d90df2b4d tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:53.778238 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f3df6c6d-b186-40ec-b4f7-ab1d90df2b4d tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:53.942708 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f3df6c6d-b186-40ec-b4f7-ab1d90df2b4d tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:56:53.950798 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f3df6c6d-b186-40ec-b4f7-ab1d90df2b4d tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/6de16745-5838-4ba1-b987-1e1e4084dd7f" status: 200 len: 1390 microversion: 2.1 time: 0.186628 Oct 19 03:56:53.954634 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3377/6695] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:56:53 2022] GET /compute/v2.1/servers/6de16745-5838-4ba1-b987-1e1e4084dd7f => generated 1390 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:56:54.340311 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3f7374ba-56c1-4f1b-8876-71298fa991c0 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:56:54.342423 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3f7374ba-56c1-4f1b-8876-71298fa991c0 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: 5f833ef3-e5bd-4953-a3ca-5cddddb2641f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:56:54.350170 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3f7374ba-56c1-4f1b-8876-71298fa991c0 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:54.350668 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3f7374ba-56c1-4f1b-8876-71298fa991c0 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:54.351121 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3f7374ba-56c1-4f1b-8876-71298fa991c0 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:54.351823 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3f7374ba-56c1-4f1b-8876-71298fa991c0 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:54.352283 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3f7374ba-56c1-4f1b-8876-71298fa991c0 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:54.352716 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3f7374ba-56c1-4f1b-8876-71298fa991c0 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:54.354542 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c9618131-48c5-4724-b08b-59a9e1f86ffc tempest-TestVolumeBackupRestore-1994640921 tempest-TestVolumeBackupRestore-1994640921-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-1899322790", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "0fa05750-4a4d-4a37-95ed-c1cf117f6ca7", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-1287828978", "security_groups": [{"name": "tempest-secgroup-smoke-209149988"}], "networks": [{"uuid": "74aa1e7c-61b3-41a7-9a41-a093ccf4025b"}]}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:56:54.388080 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3f7374ba-56c1-4f1b-8876-71298fa991c0 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "GET /compute/v2.1/servers/5f833ef3-e5bd-4953-a3ca-5cddddb2641f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051682 Oct 19 03:56:54.393621 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3319/6696] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Oct 19 03:56:54 2022] GET /compute/v2.1/servers/5f833ef3-e5bd-4953-a3ca-5cddddb2641f/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:56:54.976827 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7e32aa56-4025-41a1-b991-a605330fb21f tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:56:54.977344 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7e32aa56-4025-41a1-b991-a605330fb21f tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: 6de16745-5838-4ba1-b987-1e1e4084dd7f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:56:54.983377 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7e32aa56-4025-41a1-b991-a605330fb21f tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:54.983871 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7e32aa56-4025-41a1-b991-a605330fb21f tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:54.984317 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7e32aa56-4025-41a1-b991-a605330fb21f tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:54.985016 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7e32aa56-4025-41a1-b991-a605330fb21f tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:54.985504 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7e32aa56-4025-41a1-b991-a605330fb21f tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:54.985943 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7e32aa56-4025-41a1-b991-a605330fb21f tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:55.121953 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-7e32aa56-4025-41a1-b991-a605330fb21f tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:56:55.125406 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:56:55.129966 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7e32aa56-4025-41a1-b991-a605330fb21f tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/6de16745-5838-4ba1-b987-1e1e4084dd7f" status: 200 len: 1563 microversion: 2.1 time: 0.157803 Oct 19 03:56:55.130535 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3320/6697] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:56:54 2022] GET /compute/v2.1/servers/6de16745-5838-4ba1-b987-1e1e4084dd7f => generated 1563 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:56:55.152280 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-fc652b30-e59a-4aa1-9333-56a49c24c7eb tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:56:55.152878 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-fc652b30-e59a-4aa1-9333-56a49c24c7eb tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: 6de16745-5838-4ba1-b987-1e1e4084dd7f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:56:55.158973 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fc652b30-e59a-4aa1-9333-56a49c24c7eb tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:55.159486 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fc652b30-e59a-4aa1-9333-56a49c24c7eb tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:55.159918 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fc652b30-e59a-4aa1-9333-56a49c24c7eb tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:55.161127 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fc652b30-e59a-4aa1-9333-56a49c24c7eb tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:55.161685 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fc652b30-e59a-4aa1-9333-56a49c24c7eb tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:55.162109 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fc652b30-e59a-4aa1-9333-56a49c24c7eb tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:55.292236 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-fc652b30-e59a-4aa1-9333-56a49c24c7eb tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:56:55.299859 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-fc652b30-e59a-4aa1-9333-56a49c24c7eb tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/6de16745-5838-4ba1-b987-1e1e4084dd7f" status: 200 len: 1563 microversion: 2.1 time: 0.151140 Oct 19 03:56:55.300429 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3321/6698] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:56:55 2022] GET /compute/v2.1/servers/6de16745-5838-4ba1-b987-1e1e4084dd7f => generated 1563 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:56:55.401877 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-73fce0aa-662a-4dc0-8b2b-417b5a94ce15 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:56:55.404196 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-73fce0aa-662a-4dc0-8b2b-417b5a94ce15 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: 5f833ef3-e5bd-4953-a3ca-5cddddb2641f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:56:55.411820 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-73fce0aa-662a-4dc0-8b2b-417b5a94ce15 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:55.412302 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-73fce0aa-662a-4dc0-8b2b-417b5a94ce15 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:55.412755 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-73fce0aa-662a-4dc0-8b2b-417b5a94ce15 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:55.413472 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-73fce0aa-662a-4dc0-8b2b-417b5a94ce15 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:55.413928 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-73fce0aa-662a-4dc0-8b2b-417b5a94ce15 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:55.414360 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-73fce0aa-662a-4dc0-8b2b-417b5a94ce15 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:55.442861 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-73fce0aa-662a-4dc0-8b2b-417b5a94ce15 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "GET /compute/v2.1/servers/5f833ef3-e5bd-4953-a3ca-5cddddb2641f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045445 Oct 19 03:56:55.443415 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3322/6699] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Oct 19 03:56:55 2022] GET /compute/v2.1/servers/5f833ef3-e5bd-4953-a3ca-5cddddb2641f/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 19 03:56:55.509110 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ec3e053f-7046-449b-abea-adb6014ed0ab tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:56:55.510051 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ec3e053f-7046-449b-abea-adb6014ed0ab tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: 5f833ef3-e5bd-4953-a3ca-5cddddb2641f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:56:55.515633 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ec3e053f-7046-449b-abea-adb6014ed0ab tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:55.516122 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ec3e053f-7046-449b-abea-adb6014ed0ab tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:55.516564 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ec3e053f-7046-449b-abea-adb6014ed0ab tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:55.517266 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ec3e053f-7046-449b-abea-adb6014ed0ab tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:55.517813 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ec3e053f-7046-449b-abea-adb6014ed0ab tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:55.518246 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ec3e053f-7046-449b-abea-adb6014ed0ab tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:55.546979 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ec3e053f-7046-449b-abea-adb6014ed0ab tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: 5f833ef3-e5bd-4953-a3ca-5cddddb2641f] Going to try to terminate instance {{(pid=121134) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:56:55.819523 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ec3e053f-7046-449b-abea-adb6014ed0ab tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "DELETE /compute/v2.1/servers/5f833ef3-e5bd-4953-a3ca-5cddddb2641f" status: 204 len: 0 microversion: 2.1 time: 0.314153 Oct 19 03:56:55.820119 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3323/6700] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:56:55 2022] DELETE /compute/v2.1/servers/5f833ef3-e5bd-4953-a3ca-5cddddb2641f => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:56:55.828486 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a4d45d3e-7b83-4597-a365-7256951f2548 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:56:55.829198 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a4d45d3e-7b83-4597-a365-7256951f2548 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: 5f833ef3-e5bd-4953-a3ca-5cddddb2641f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:56:55.835762 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a4d45d3e-7b83-4597-a365-7256951f2548 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:55.839013 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a4d45d3e-7b83-4597-a365-7256951f2548 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:55.839013 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a4d45d3e-7b83-4597-a365-7256951f2548 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:55.839013 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a4d45d3e-7b83-4597-a365-7256951f2548 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:55.839013 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a4d45d3e-7b83-4597-a365-7256951f2548 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:55.839013 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a4d45d3e-7b83-4597-a365-7256951f2548 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:56.410535 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a4d45d3e-7b83-4597-a365-7256951f2548 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14706e15b5d7487a9b1d1a6332f93f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea131e741ef34573aa73360c5010221a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:56:56.418788 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a4d45d3e-7b83-4597-a365-7256951f2548 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "GET /compute/v2.1/servers/5f833ef3-e5bd-4953-a3ca-5cddddb2641f" status: 200 len: 1682 microversion: 2.1 time: 0.594254 Oct 19 03:56:56.423196 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3324/6701] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:56:55 2022] GET /compute/v2.1/servers/5f833ef3-e5bd-4953-a3ca-5cddddb2641f => generated 1682 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:56:57.447157 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-140248c2-6c75-4718-b764-5c852295e528 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:56:57.447912 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-140248c2-6c75-4718-b764-5c852295e528 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: 5f833ef3-e5bd-4953-a3ca-5cddddb2641f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:56:57.455503 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-140248c2-6c75-4718-b764-5c852295e528 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:57.456263 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-140248c2-6c75-4718-b764-5c852295e528 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:57.456951 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-140248c2-6c75-4718-b764-5c852295e528 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:57.458754 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-140248c2-6c75-4718-b764-5c852295e528 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:57.459231 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-140248c2-6c75-4718-b764-5c852295e528 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:57.459785 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-140248c2-6c75-4718-b764-5c852295e528 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:57.620671 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-140248c2-6c75-4718-b764-5c852295e528 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14706e15b5d7487a9b1d1a6332f93f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea131e741ef34573aa73360c5010221a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:56:57.628486 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-140248c2-6c75-4718-b764-5c852295e528 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "GET /compute/v2.1/servers/5f833ef3-e5bd-4953-a3ca-5cddddb2641f" status: 200 len: 1682 microversion: 2.1 time: 0.187150 Oct 19 03:56:57.629070 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3325/6702] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:56:57 2022] GET /compute/v2.1/servers/5f833ef3-e5bd-4953-a3ca-5cddddb2641f => generated 1682 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:56:57.699800 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-15aded6a-1ce8-4b89-afea-bc5aacf570a1 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:56:57.701250 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-15aded6a-1ce8-4b89-afea-bc5aacf570a1 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: 6de16745-5838-4ba1-b987-1e1e4084dd7f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:56:57.708234 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-15aded6a-1ce8-4b89-afea-bc5aacf570a1 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:57.708818 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-15aded6a-1ce8-4b89-afea-bc5aacf570a1 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:57.713484 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-15aded6a-1ce8-4b89-afea-bc5aacf570a1 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:57.713484 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-15aded6a-1ce8-4b89-afea-bc5aacf570a1 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:57.713484 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-15aded6a-1ce8-4b89-afea-bc5aacf570a1 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:57.713484 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-15aded6a-1ce8-4b89-afea-bc5aacf570a1 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:57.948634 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-15aded6a-1ce8-4b89-afea-bc5aacf570a1 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:56:57.956797 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-15aded6a-1ce8-4b89-afea-bc5aacf570a1 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/6de16745-5838-4ba1-b987-1e1e4084dd7f" status: 200 len: 1563 microversion: 2.1 time: 0.261194 Oct 19 03:56:57.969399 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3326/6703] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:56:57 2022] GET /compute/v2.1/servers/6de16745-5838-4ba1-b987-1e1e4084dd7f => generated 1563 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:56:57.969399 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-71a50636-e74e-4ba9-9aaa-7c5e805b9e7b req-eb0530b2-8441-48de-9ce2-13676a38c69d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6de16745-5838-4ba1-b987-1e1e4084dd7f", "tag": "11ca3831-bfbb-4328-9073-14dcd2216de2"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:56:57.972498 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-71a50636-e74e-4ba9-9aaa-7c5e805b9e7b req-eb0530b2-8441-48de-9ce2-13676a38c69d service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:57.973892 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-71a50636-e74e-4ba9-9aaa-7c5e805b9e7b req-eb0530b2-8441-48de-9ce2-13676a38c69d service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:57.974491 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-71a50636-e74e-4ba9-9aaa-7c5e805b9e7b req-eb0530b2-8441-48de-9ce2-13676a38c69d service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:57.991829 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-71a50636-e74e-4ba9-9aaa-7c5e805b9e7b req-eb0530b2-8441-48de-9ce2-13676a38c69d service nova] Creating event network-changed:11ca3831-bfbb-4328-9073-14dcd2216de2 for instance 6de16745-5838-4ba1-b987-1e1e4084dd7f on n-h1-861333-8 Oct 19 03:56:57.996878 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-71a50636-e74e-4ba9-9aaa-7c5e805b9e7b req-eb0530b2-8441-48de-9ce2-13676a38c69d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037213 Oct 19 03:56:57.997515 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3327/6704] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:56:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:56:58.654627 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8bb73dca-ef24-43e6-88b9-8ea31aade674 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:56:58.655337 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8bb73dca-ef24-43e6-88b9-8ea31aade674 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: 5f833ef3-e5bd-4953-a3ca-5cddddb2641f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:56:58.661936 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8bb73dca-ef24-43e6-88b9-8ea31aade674 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:58.662427 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8bb73dca-ef24-43e6-88b9-8ea31aade674 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:58.662869 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8bb73dca-ef24-43e6-88b9-8ea31aade674 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:58.663567 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8bb73dca-ef24-43e6-88b9-8ea31aade674 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:58.664197 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8bb73dca-ef24-43e6-88b9-8ea31aade674 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:58.664625 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8bb73dca-ef24-43e6-88b9-8ea31aade674 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:58.778373 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8bb73dca-ef24-43e6-88b9-8ea31aade674 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14706e15b5d7487a9b1d1a6332f93f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea131e741ef34573aa73360c5010221a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:56:58.786793 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8bb73dca-ef24-43e6-88b9-8ea31aade674 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "GET /compute/v2.1/servers/5f833ef3-e5bd-4953-a3ca-5cddddb2641f" status: 200 len: 1614 microversion: 2.1 time: 0.137194 Oct 19 03:56:58.787406 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3328/6705] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:56:58 2022] GET /compute/v2.1/servers/5f833ef3-e5bd-4953-a3ca-5cddddb2641f => generated 1614 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:56:59.811285 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-df07ee21-5072-4f07-9142-3b71a54dad29 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:56:59.811921 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-df07ee21-5072-4f07-9142-3b71a54dad29 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: 5f833ef3-e5bd-4953-a3ca-5cddddb2641f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:56:59.819189 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-df07ee21-5072-4f07-9142-3b71a54dad29 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:59.819707 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-df07ee21-5072-4f07-9142-3b71a54dad29 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:59.820140 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-df07ee21-5072-4f07-9142-3b71a54dad29 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:59.820834 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-df07ee21-5072-4f07-9142-3b71a54dad29 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:59.821284 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-df07ee21-5072-4f07-9142-3b71a54dad29 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:59.821730 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-df07ee21-5072-4f07-9142-3b71a54dad29 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:59.854011 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-df07ee21-5072-4f07-9142-3b71a54dad29 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:56:59.854504 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-df07ee21-5072-4f07-9142-3b71a54dad29 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:56:59.854974 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-df07ee21-5072-4f07-9142-3b71a54dad29 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:56:59.855425 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-df07ee21-5072-4f07-9142-3b71a54dad29 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lazy-loading 'fault' on Instance uuid 5f833ef3-e5bd-4953-a3ca-5cddddb2641f {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:56:59.902640 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-df07ee21-5072-4f07-9142-3b71a54dad29 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14706e15b5d7487a9b1d1a6332f93f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea131e741ef34573aa73360c5010221a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:56:59.911151 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-df07ee21-5072-4f07-9142-3b71a54dad29 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "GET /compute/v2.1/servers/5f833ef3-e5bd-4953-a3ca-5cddddb2641f" status: 200 len: 1331 microversion: 2.1 time: 0.103807 Oct 19 03:56:59.911735 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3329/6706] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:56:59 2022] GET /compute/v2.1/servers/5f833ef3-e5bd-4953-a3ca-5cddddb2641f => generated 1331 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:57:00.015628 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-f939eb90-9d56-49bb-bd31-c19e77cadbe3 req-9a55c08e-ff8d-4e28-8233-9dcb31182225 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f833ef3-e5bd-4953-a3ca-5cddddb2641f", "name": "network-vif-deleted", "tag": "01954836-0ba9-45ed-ac4d-bd11f0421890"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:57:00.025803 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-f939eb90-9d56-49bb-bd31-c19e77cadbe3 req-9a55c08e-ff8d-4e28-8233-9dcb31182225 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:57:00.026506 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-f939eb90-9d56-49bb-bd31-c19e77cadbe3 req-9a55c08e-ff8d-4e28-8233-9dcb31182225 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:57:00.026955 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-f939eb90-9d56-49bb-bd31-c19e77cadbe3 req-9a55c08e-ff8d-4e28-8233-9dcb31182225 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:57:00.038507 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-f939eb90-9d56-49bb-bd31-c19e77cadbe3 req-9a55c08e-ff8d-4e28-8233-9dcb31182225 service nova] Creating event network-vif-deleted:01954836-0ba9-45ed-ac4d-bd11f0421890 for instance 5f833ef3-e5bd-4953-a3ca-5cddddb2641f on n-h2-861333-8 Oct 19 03:57:00.043266 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-f939eb90-9d56-49bb-bd31-c19e77cadbe3 req-9a55c08e-ff8d-4e28-8233-9dcb31182225 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031789 Oct 19 03:57:00.043869 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3330/6707] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:57:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:57:00.936683 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7b14cbb1-f7a2-436f-8f1c-dc6d0203e063 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:57:00.937420 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7b14cbb1-f7a2-436f-8f1c-dc6d0203e063 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: 5f833ef3-e5bd-4953-a3ca-5cddddb2641f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:57:00.944377 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7b14cbb1-f7a2-436f-8f1c-dc6d0203e063 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:57:00.944868 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7b14cbb1-f7a2-436f-8f1c-dc6d0203e063 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:57:00.945310 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7b14cbb1-f7a2-436f-8f1c-dc6d0203e063 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:57:00.946029 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7b14cbb1-f7a2-436f-8f1c-dc6d0203e063 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:57:00.946486 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7b14cbb1-f7a2-436f-8f1c-dc6d0203e063 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:57:00.946916 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7b14cbb1-f7a2-436f-8f1c-dc6d0203e063 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:57:00.959952 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-7b14cbb1-f7a2-436f-8f1c-dc6d0203e063 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] HTTP exception thrown: Instance 5f833ef3-e5bd-4953-a3ca-5cddddb2641f could not be found. Oct 19 03:57:00.961592 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7b14cbb1-f7a2-436f-8f1c-dc6d0203e063 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Request method failure captured: Oct 19 03:57:00.961592 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/5f833ef3-e5bd-4953-a3ca-5cddddb2641f HTTP/1.1 Oct 19 03:57:00.961592 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:57:00.961592 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:57:00.961592 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:57:00.961592 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:57:00.961592 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:57:00.961592 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:57:00.961592 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:57:00.961592 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:57:00.961592 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3T1Tg0DFz0guFQMDM9yU7WN_RUGuMbf_rWbbF4rS1oDiWv6x0dTsqBA7TFunkbzAHPQAqy9kZJmC_H2-rpZa4Diw9UEoM4xkjg4JciNrIIW263ufBC_07F6Mlg4-xs8Q2J9bkOD2CDMpGZHCZ5KbDaJBjuAHOQ_5qLd75r8z_OFtFo Oct 19 03:57:00.961592 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:57:00.961592 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:57:00.961592 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:57:00.961592 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:57:00.961592 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:57:00.961592 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:57:00.961592 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: ea131e741ef34573aa73360c5010221a Oct 19 03:57:00.961592 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-AttachVolumeNegativeTest-892544868 Oct 19 03:57:00.961592 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:57:00.961592 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:57:00.961592 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ea131e741ef34573aa73360c5010221a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ea131e741ef34573aa73360c5010221a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ea131e741ef34573aa73360c5010221a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ea131e741ef34573aa73360c5010221a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:57:00.961592 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-AttachVolumeNegativeTest-892544868 Oct 19 03:57:00.961592 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: ea131e741ef34573aa73360c5010221a Oct 19 03:57:00.961592 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-892544868 Oct 19 03:57:00.961592 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-AttachVolumeNegativeTest-892544868-project Oct 19 03:57:00.961592 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:57:00.961592 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:57:00.961592 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 14706e15b5d7487a9b1d1a6332f93f7c Oct 19 03:57:00.961592 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-AttachVolumeNegativeTest-892544868-project Oct 19 03:57:00.961592 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:57:00.961592 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance 5f833ef3-e5bd-4953-a3ca-5cddddb2641f could not be found. Oct 19 03:57:00.961592 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '5f833ef3-e5bd-4953-a3ca-5cddddb2641f'} Oct 19 03:57:00.961592 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:57:00.961592 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:57:00.961592 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:57:00.961592 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:57:00.961592 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:57:00.961592 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:57:00.961592 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:57:00.961592 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:57:00.961592 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:57:00.961592 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:57:00.961592 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f833ef3-e5bd-4953-a3ca-5cddddb2641f could not be found. Oct 19 03:57:00.961592 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:57:00.961592 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:57:00.961592 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:57:00.961592 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:57:00.961592 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:57:00.961592 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:57:00.961592 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:57:00.961592 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:57:00.961592 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:57:00.961592 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:57:00.961592 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:57:00.961592 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:57:00.961592 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:57:00.961592 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:57:00.961592 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:57:00.961592 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:57:00.961592 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f833ef3-e5bd-4953-a3ca-5cddddb2641f could not be found. Oct 19 03:57:00.961592 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:57:00.961592 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:57:00.961592 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:57:00.966058 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:57:00.966058 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:57:00.966058 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:57:00.966058 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:57:00.966058 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:57:00.966058 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f833ef3-e5bd-4953-a3ca-5cddddb2641f could not be found. Oct 19 03:57:00.966058 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:57:00.966058 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7b14cbb1-f7a2-436f-8f1c-dc6d0203e063 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Returning 404 to user: Instance 5f833ef3-e5bd-4953-a3ca-5cddddb2641f could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:57:00.966058 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7b14cbb1-f7a2-436f-8f1c-dc6d0203e063 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "GET /compute/v2.1/servers/5f833ef3-e5bd-4953-a3ca-5cddddb2641f" status: 404 len: 111 microversion: 2.1 time: 0.031477 Oct 19 03:57:00.966058 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3331/6708] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:57:00 2022] GET /compute/v2.1/servers/5f833ef3-e5bd-4953-a3ca-5cddddb2641f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 03:57:00.971187 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2906a235-94d1-45dd-906c-ddce83f932e3 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Calling method '.version_select at 0x7fc130b69280>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:57:01.092162 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2906a235-94d1-45dd-906c-ddce83f932e3 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1081585132" status: 202 len: 0 microversion: 2.1 time: 0.124317 Oct 19 03:57:01.092763 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3332/6709] 10.222.0.52 () {58 vars in 1221 bytes} [Wed Oct 19 03:57:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1081585132 => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 19 03:57:02.165623 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f17b9316-a8c8-40c6-af66-279c03469482 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Action: 'create', calling method: .version_select at 0x7fc12be58670>, body: {"keypair": {"name": "tempest-keypair-129440190", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCV0pcMVMU2/2HxMaj2olcPbRRIv4VQtyNGo+IENdc+BcEZkRHNMnC4+nRte31F8FCqdN1keMZTKmVxeLfkxibsxOjIcAOi1zDj62Fj3BSPIfVS9DYcutLd58o/iN2bTnQ=="}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:57:02.170997 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=4 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:57:02.184592 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-f17b9316-a8c8-40c6-af66-279c03469482 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Getting quotas for project ea131e741ef34573aa73360c5010221a. Resources: {'key_pairs'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:57:02.199423 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-f17b9316-a8c8-40c6-af66-279c03469482 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Getting quotas for user 14706e15b5d7487a9b1d1a6332f93f7c and project ea131e741ef34573aa73360c5010221a. Resources: {'key_pairs'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:57:02.277976 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f17b9316-a8c8-40c6-af66-279c03469482 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.116229 Oct 19 03:57:02.278586 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3333/6710] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Oct 19 03:57:02 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:57:03.947272 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=80 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:57:04.376605 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=38 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:57:04.398379 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-56d5a04d-807d-4511-a5b9-1e59232c9dd7 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-162463246", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "41fa7d07-f5eb-4de7-9c08-67821611f5f1"}], "security_groups": [{"name": "tempest-securitygroup--1544948881"}], "key_name": "tempest-keypair-129440190", "user_data": "}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:57:04.500700 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-56d5a04d-807d-4511-a5b9-1e59232c9dd7 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] validate_networks() for [('41fa7d07-f5eb-4de7-9c08-67821611f5f1', None, None, None, None, None)] {{(pid=121134) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:57:04.883670 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-56d5a04d-807d-4511-a5b9-1e59232c9dd7 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Flavor limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:57:04.884123 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-56d5a04d-807d-4511-a5b9-1e59232c9dd7 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Image limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:57:04.884619 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-56d5a04d-807d-4511-a5b9-1e59232c9dd7 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Flavor pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:57:04.885026 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-56d5a04d-807d-4511-a5b9-1e59232c9dd7 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Image pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:57:04.885482 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-56d5a04d-807d-4511-a5b9-1e59232c9dd7 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:57:04.895433 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-56d5a04d-807d-4511-a5b9-1e59232c9dd7 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:57:04.895688 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-56d5a04d-807d-4511-a5b9-1e59232c9dd7 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:57:04.896133 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-56d5a04d-807d-4511-a5b9-1e59232c9dd7 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:57:04.896844 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-56d5a04d-807d-4511-a5b9-1e59232c9dd7 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:57:04.897293 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-56d5a04d-807d-4511-a5b9-1e59232c9dd7 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:57:04.897743 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-56d5a04d-807d-4511-a5b9-1e59232c9dd7 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:57:04.913855 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-56d5a04d-807d-4511-a5b9-1e59232c9dd7 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Getting quotas for project ea131e741ef34573aa73360c5010221a. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:57:04.919040 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-56d5a04d-807d-4511-a5b9-1e59232c9dd7 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Getting quotas for user 14706e15b5d7487a9b1d1a6332f93f7c and project ea131e741ef34573aa73360c5010221a. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:57:04.931216 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-56d5a04d-807d-4511-a5b9-1e59232c9dd7 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Going to run 1 instances... {{(pid=121134) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:57:04.933473 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-56d5a04d-807d-4511-a5b9-1e59232c9dd7 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: ebb09805-86db-46ee-a803-5e9afcc94d1d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:57:05.052184 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-56d5a04d-807d-4511-a5b9-1e59232c9dd7 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.659097 Oct 19 03:57:05.052968 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3334/6711] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:57:04 2022] POST /compute/v2.1/servers => generated 402 bytes in 660 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 19 03:57:05.063972 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ddc67ac8-70e0-413c-9735-78af21be7964 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:57:05.064593 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ddc67ac8-70e0-413c-9735-78af21be7964 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: ebb09805-86db-46ee-a803-5e9afcc94d1d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:57:05.120146 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ddc67ac8-70e0-413c-9735-78af21be7964 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14706e15b5d7487a9b1d1a6332f93f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea131e741ef34573aa73360c5010221a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:57:05.127203 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ddc67ac8-70e0-413c-9735-78af21be7964 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "GET /compute/v2.1/servers/ebb09805-86db-46ee-a803-5e9afcc94d1d" status: 200 len: 1240 microversion: 2.1 time: 0.066982 Oct 19 03:57:05.128011 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3335/6712] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:57:05 2022] GET /compute/v2.1/servers/ebb09805-86db-46ee-a803-5e9afcc94d1d => generated 1240 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:57:06.151030 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8f09f779-c8ba-4f02-b9ce-9e2887b4d648 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:57:06.151681 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8f09f779-c8ba-4f02-b9ce-9e2887b4d648 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: ebb09805-86db-46ee-a803-5e9afcc94d1d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:57:06.158628 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8f09f779-c8ba-4f02-b9ce-9e2887b4d648 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:57:06.159115 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8f09f779-c8ba-4f02-b9ce-9e2887b4d648 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:57:06.159608 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8f09f779-c8ba-4f02-b9ce-9e2887b4d648 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:57:06.160306 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8f09f779-c8ba-4f02-b9ce-9e2887b4d648 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:57:06.160836 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8f09f779-c8ba-4f02-b9ce-9e2887b4d648 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:57:06.161294 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8f09f779-c8ba-4f02-b9ce-9e2887b4d648 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:57:06.224467 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8f09f779-c8ba-4f02-b9ce-9e2887b4d648 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14706e15b5d7487a9b1d1a6332f93f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea131e741ef34573aa73360c5010221a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:57:06.232345 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8f09f779-c8ba-4f02-b9ce-9e2887b4d648 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "GET /compute/v2.1/servers/ebb09805-86db-46ee-a803-5e9afcc94d1d" status: 200 len: 1236 microversion: 2.1 time: 0.085309 Oct 19 03:57:06.232918 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3336/6713] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:57:06 2022] GET /compute/v2.1/servers/ebb09805-86db-46ee-a803-5e9afcc94d1d => generated 1236 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:57:07.256306 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-62db6657-fc9e-46f1-b851-2df6ad095796 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:57:07.256981 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-62db6657-fc9e-46f1-b851-2df6ad095796 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: ebb09805-86db-46ee-a803-5e9afcc94d1d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:57:07.263701 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-62db6657-fc9e-46f1-b851-2df6ad095796 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:57:07.264192 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-62db6657-fc9e-46f1-b851-2df6ad095796 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:57:07.264636 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-62db6657-fc9e-46f1-b851-2df6ad095796 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:57:07.265412 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-62db6657-fc9e-46f1-b851-2df6ad095796 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:57:07.266054 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-62db6657-fc9e-46f1-b851-2df6ad095796 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:57:07.266522 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-62db6657-fc9e-46f1-b851-2df6ad095796 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:57:07.338433 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-62db6657-fc9e-46f1-b851-2df6ad095796 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14706e15b5d7487a9b1d1a6332f93f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea131e741ef34573aa73360c5010221a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:57:07.347125 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-62db6657-fc9e-46f1-b851-2df6ad095796 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "GET /compute/v2.1/servers/ebb09805-86db-46ee-a803-5e9afcc94d1d" status: 200 len: 1310 microversion: 2.1 time: 0.094875 Oct 19 03:57:07.347703 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3337/6714] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:57:07 2022] GET /compute/v2.1/servers/ebb09805-86db-46ee-a803-5e9afcc94d1d => generated 1310 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:57:08.371480 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-999f3590-f43d-4d66-a455-64e4c5bf2996 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:57:08.372118 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-999f3590-f43d-4d66-a455-64e4c5bf2996 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: ebb09805-86db-46ee-a803-5e9afcc94d1d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:57:08.378734 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-999f3590-f43d-4d66-a455-64e4c5bf2996 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:57:08.379240 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-999f3590-f43d-4d66-a455-64e4c5bf2996 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:57:08.379669 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-999f3590-f43d-4d66-a455-64e4c5bf2996 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:57:08.380948 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-999f3590-f43d-4d66-a455-64e4c5bf2996 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:57:08.381437 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-999f3590-f43d-4d66-a455-64e4c5bf2996 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:57:08.381871 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-999f3590-f43d-4d66-a455-64e4c5bf2996 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:57:08.610081 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-999f3590-f43d-4d66-a455-64e4c5bf2996 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14706e15b5d7487a9b1d1a6332f93f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea131e741ef34573aa73360c5010221a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:57:08.618414 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-999f3590-f43d-4d66-a455-64e4c5bf2996 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "GET /compute/v2.1/servers/ebb09805-86db-46ee-a803-5e9afcc94d1d" status: 200 len: 1366 microversion: 2.1 time: 0.250922 Oct 19 03:57:08.618992 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3338/6715] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:57:08 2022] GET /compute/v2.1/servers/ebb09805-86db-46ee-a803-5e9afcc94d1d => generated 1366 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:57:08.869898 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-2c239fce-fe92-487d-ab2a-58ed44266730 req-36a6430c-375e-4263-b6b7-c6debb4fec3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebb09805-86db-46ee-a803-5e9afcc94d1d", "tag": "7967e6b8-99f3-4e56-9a4a-c99ceb8ad9e0"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:57:08.879639 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-2c239fce-fe92-487d-ab2a-58ed44266730 req-36a6430c-375e-4263-b6b7-c6debb4fec3b service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:57:08.880126 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-2c239fce-fe92-487d-ab2a-58ed44266730 req-36a6430c-375e-4263-b6b7-c6debb4fec3b service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:57:08.880567 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-2c239fce-fe92-487d-ab2a-58ed44266730 req-36a6430c-375e-4263-b6b7-c6debb4fec3b service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:57:08.891734 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-2c239fce-fe92-487d-ab2a-58ed44266730 req-36a6430c-375e-4263-b6b7-c6debb4fec3b service nova] Creating event network-changed:7967e6b8-99f3-4e56-9a4a-c99ceb8ad9e0 for instance ebb09805-86db-46ee-a803-5e9afcc94d1d on n-h2-861333-8 Oct 19 03:57:08.897574 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-2c239fce-fe92-487d-ab2a-58ed44266730 req-36a6430c-375e-4263-b6b7-c6debb4fec3b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031305 Oct 19 03:57:08.898769 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3339/6716] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:57:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:57:09.642848 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4d585144-bcd5-4a48-bd10-1991adfd3106 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:57:09.643601 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4d585144-bcd5-4a48-bd10-1991adfd3106 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: ebb09805-86db-46ee-a803-5e9afcc94d1d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:57:09.650131 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4d585144-bcd5-4a48-bd10-1991adfd3106 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:57:09.650625 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4d585144-bcd5-4a48-bd10-1991adfd3106 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:57:09.651193 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4d585144-bcd5-4a48-bd10-1991adfd3106 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:57:09.651814 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4d585144-bcd5-4a48-bd10-1991adfd3106 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:57:09.652276 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4d585144-bcd5-4a48-bd10-1991adfd3106 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:57:09.652716 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4d585144-bcd5-4a48-bd10-1991adfd3106 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:57:09.781733 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-4d585144-bcd5-4a48-bd10-1991adfd3106 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14706e15b5d7487a9b1d1a6332f93f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea131e741ef34573aa73360c5010221a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:57:09.789619 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4d585144-bcd5-4a48-bd10-1991adfd3106 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "GET /compute/v2.1/servers/ebb09805-86db-46ee-a803-5e9afcc94d1d" status: 200 len: 1366 microversion: 2.1 time: 0.152038 Oct 19 03:57:09.790206 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3340/6717] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:57:09 2022] GET /compute/v2.1/servers/ebb09805-86db-46ee-a803-5e9afcc94d1d => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:57:10.812205 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2fe74f2e-5dd9-43b0-be22-283d774cb43c tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:57:10.813614 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2fe74f2e-5dd9-43b0-be22-283d774cb43c tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: ebb09805-86db-46ee-a803-5e9afcc94d1d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:57:10.817973 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=5,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:57:10.821609 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2fe74f2e-5dd9-43b0-be22-283d774cb43c tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:57:10.822099 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2fe74f2e-5dd9-43b0-be22-283d774cb43c tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:57:10.822535 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2fe74f2e-5dd9-43b0-be22-283d774cb43c tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:57:10.823237 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2fe74f2e-5dd9-43b0-be22-283d774cb43c tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:57:10.823687 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2fe74f2e-5dd9-43b0-be22-283d774cb43c tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:57:10.824113 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2fe74f2e-5dd9-43b0-be22-283d774cb43c tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:57:10.963789 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-2fe74f2e-5dd9-43b0-be22-283d774cb43c tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14706e15b5d7487a9b1d1a6332f93f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea131e741ef34573aa73360c5010221a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:57:10.967399 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:57:10.972370 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2fe74f2e-5dd9-43b0-be22-283d774cb43c tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "GET /compute/v2.1/servers/ebb09805-86db-46ee-a803-5e9afcc94d1d" status: 200 len: 1366 microversion: 2.1 time: 0.164013 Oct 19 03:57:10.972962 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3341/6718] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:57:10 2022] GET /compute/v2.1/servers/ebb09805-86db-46ee-a803-5e9afcc94d1d => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:57:11.996546 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-851df0dd-a723-4cee-9a13-433932f47784 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:57:11.997191 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-851df0dd-a723-4cee-9a13-433932f47784 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: ebb09805-86db-46ee-a803-5e9afcc94d1d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:57:12.005869 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-851df0dd-a723-4cee-9a13-433932f47784 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:57:12.006382 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-851df0dd-a723-4cee-9a13-433932f47784 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:57:12.006825 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-851df0dd-a723-4cee-9a13-433932f47784 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:57:12.007521 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-851df0dd-a723-4cee-9a13-433932f47784 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:57:12.007987 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-851df0dd-a723-4cee-9a13-433932f47784 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:57:12.008417 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-851df0dd-a723-4cee-9a13-433932f47784 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:57:12.136361 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-851df0dd-a723-4cee-9a13-433932f47784 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14706e15b5d7487a9b1d1a6332f93f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea131e741ef34573aa73360c5010221a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:57:12.144145 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-851df0dd-a723-4cee-9a13-433932f47784 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "GET /compute/v2.1/servers/ebb09805-86db-46ee-a803-5e9afcc94d1d" status: 200 len: 1366 microversion: 2.1 time: 0.151487 Oct 19 03:57:12.144879 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3342/6719] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:57:11 2022] GET /compute/v2.1/servers/ebb09805-86db-46ee-a803-5e9afcc94d1d => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:57:12.955827 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-ed8620f2-47bb-4960-ba19-59908084c4af req-8b9cb3ca-2e7c-4a8c-a4cf-6112a81cbaa1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebb09805-86db-46ee-a803-5e9afcc94d1d", "name": "network-vif-plugged", "status": "completed", "tag": "7967e6b8-99f3-4e56-9a4a-c99ceb8ad9e0"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:57:12.965799 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-ed8620f2-47bb-4960-ba19-59908084c4af req-8b9cb3ca-2e7c-4a8c-a4cf-6112a81cbaa1 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:57:12.966271 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-ed8620f2-47bb-4960-ba19-59908084c4af req-8b9cb3ca-2e7c-4a8c-a4cf-6112a81cbaa1 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:57:12.966709 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-ed8620f2-47bb-4960-ba19-59908084c4af req-8b9cb3ca-2e7c-4a8c-a4cf-6112a81cbaa1 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:57:12.977565 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-ed8620f2-47bb-4960-ba19-59908084c4af req-8b9cb3ca-2e7c-4a8c-a4cf-6112a81cbaa1 service nova] Creating event network-vif-plugged:7967e6b8-99f3-4e56-9a4a-c99ceb8ad9e0 for instance ebb09805-86db-46ee-a803-5e9afcc94d1d on n-h2-861333-8 Oct 19 03:57:12.982434 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-ed8620f2-47bb-4960-ba19-59908084c4af req-8b9cb3ca-2e7c-4a8c-a4cf-6112a81cbaa1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030263 Oct 19 03:57:12.983013 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3343/6720] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:57:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:57:13.169591 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0a5bc241-c5bd-4b5a-9eb7-d1ba46a8c0bd tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:57:13.170326 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0a5bc241-c5bd-4b5a-9eb7-d1ba46a8c0bd tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: ebb09805-86db-46ee-a803-5e9afcc94d1d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:57:13.176527 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0a5bc241-c5bd-4b5a-9eb7-d1ba46a8c0bd tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:57:13.177007 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0a5bc241-c5bd-4b5a-9eb7-d1ba46a8c0bd tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:57:13.177484 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0a5bc241-c5bd-4b5a-9eb7-d1ba46a8c0bd tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:57:13.178170 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0a5bc241-c5bd-4b5a-9eb7-d1ba46a8c0bd tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:57:13.178663 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0a5bc241-c5bd-4b5a-9eb7-d1ba46a8c0bd tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:57:13.179090 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0a5bc241-c5bd-4b5a-9eb7-d1ba46a8c0bd tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:57:13.312522 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0a5bc241-c5bd-4b5a-9eb7-d1ba46a8c0bd tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14706e15b5d7487a9b1d1a6332f93f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea131e741ef34573aa73360c5010221a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:57:13.320759 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0a5bc241-c5bd-4b5a-9eb7-d1ba46a8c0bd tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "GET /compute/v2.1/servers/ebb09805-86db-46ee-a803-5e9afcc94d1d" status: 200 len: 1366 microversion: 2.1 time: 0.156423 Oct 19 03:57:13.321326 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3344/6721] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:57:13 2022] GET /compute/v2.1/servers/ebb09805-86db-46ee-a803-5e9afcc94d1d => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:57:14.344092 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-859599ab-ca16-4f0a-a3d3-f78174f14d8a tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:57:14.344783 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-859599ab-ca16-4f0a-a3d3-f78174f14d8a tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: ebb09805-86db-46ee-a803-5e9afcc94d1d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:57:14.352774 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-859599ab-ca16-4f0a-a3d3-f78174f14d8a tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:57:14.353267 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-859599ab-ca16-4f0a-a3d3-f78174f14d8a tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:57:14.354280 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-859599ab-ca16-4f0a-a3d3-f78174f14d8a tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:57:14.354978 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-859599ab-ca16-4f0a-a3d3-f78174f14d8a tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:57:14.355430 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-859599ab-ca16-4f0a-a3d3-f78174f14d8a tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:57:14.355858 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-859599ab-ca16-4f0a-a3d3-f78174f14d8a tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:57:14.487738 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-859599ab-ca16-4f0a-a3d3-f78174f14d8a tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14706e15b5d7487a9b1d1a6332f93f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea131e741ef34573aa73360c5010221a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:57:14.495656 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-859599ab-ca16-4f0a-a3d3-f78174f14d8a tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "GET /compute/v2.1/servers/ebb09805-86db-46ee-a803-5e9afcc94d1d" status: 200 len: 1366 microversion: 2.1 time: 0.155471 Oct 19 03:57:14.496246 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3345/6722] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:57:14 2022] GET /compute/v2.1/servers/ebb09805-86db-46ee-a803-5e9afcc94d1d => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:57:15.519399 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-49c8a022-dc6c-4683-ac40-cd6fb91b05f2 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:57:15.520349 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-49c8a022-dc6c-4683-ac40-cd6fb91b05f2 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: ebb09805-86db-46ee-a803-5e9afcc94d1d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:57:15.522878 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:57:15.523581 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=12 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:57:15.529182 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-49c8a022-dc6c-4683-ac40-cd6fb91b05f2 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:57:15.529709 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-49c8a022-dc6c-4683-ac40-cd6fb91b05f2 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:57:15.530157 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-49c8a022-dc6c-4683-ac40-cd6fb91b05f2 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:57:15.530857 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-49c8a022-dc6c-4683-ac40-cd6fb91b05f2 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:57:15.531320 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-49c8a022-dc6c-4683-ac40-cd6fb91b05f2 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:57:15.531755 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-49c8a022-dc6c-4683-ac40-cd6fb91b05f2 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:57:15.664819 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-49c8a022-dc6c-4683-ac40-cd6fb91b05f2 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14706e15b5d7487a9b1d1a6332f93f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea131e741ef34573aa73360c5010221a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:57:15.672693 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-49c8a022-dc6c-4683-ac40-cd6fb91b05f2 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "GET /compute/v2.1/servers/ebb09805-86db-46ee-a803-5e9afcc94d1d" status: 200 len: 1556 microversion: 2.1 time: 0.157292 Oct 19 03:57:15.675590 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3346/6723] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:57:15 2022] GET /compute/v2.1/servers/ebb09805-86db-46ee-a803-5e9afcc94d1d => generated 1556 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:57:15.695295 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7c3c11d3-d7af-4240-9119-20f270c39fea tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:57:15.695794 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7c3c11d3-d7af-4240-9119-20f270c39fea tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: ebb09805-86db-46ee-a803-5e9afcc94d1d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:57:15.701516 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7c3c11d3-d7af-4240-9119-20f270c39fea tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:57:15.706052 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7c3c11d3-d7af-4240-9119-20f270c39fea tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:57:15.706052 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7c3c11d3-d7af-4240-9119-20f270c39fea tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:57:15.706052 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7c3c11d3-d7af-4240-9119-20f270c39fea tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:57:15.706052 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7c3c11d3-d7af-4240-9119-20f270c39fea tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:57:15.706052 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7c3c11d3-d7af-4240-9119-20f270c39fea tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:57:15.780583 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7c3c11d3-d7af-4240-9119-20f270c39fea tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "GET /compute/v2.1/servers/ebb09805-86db-46ee-a803-5e9afcc94d1d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089249 Oct 19 03:57:15.781184 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3347/6724] 10.222.0.52 () {58 vars in 1275 bytes} [Wed Oct 19 03:57:15 2022] GET /compute/v2.1/servers/ebb09805-86db-46ee-a803-5e9afcc94d1d/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:57:16.801432 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-f9a1bf0f-11a6-4342-9252-786d76b197a1 req-3884d62a-b473-4008-a385-b68a61532161 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebb09805-86db-46ee-a803-5e9afcc94d1d", "tag": "7967e6b8-99f3-4e56-9a4a-c99ceb8ad9e0"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:57:16.811312 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-f9a1bf0f-11a6-4342-9252-786d76b197a1 req-3884d62a-b473-4008-a385-b68a61532161 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:57:16.811795 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-f9a1bf0f-11a6-4342-9252-786d76b197a1 req-3884d62a-b473-4008-a385-b68a61532161 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:57:16.812233 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-f9a1bf0f-11a6-4342-9252-786d76b197a1 req-3884d62a-b473-4008-a385-b68a61532161 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:57:16.823362 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-f9a1bf0f-11a6-4342-9252-786d76b197a1 req-3884d62a-b473-4008-a385-b68a61532161 service nova] Creating event network-changed:7967e6b8-99f3-4e56-9a4a-c99ceb8ad9e0 for instance ebb09805-86db-46ee-a803-5e9afcc94d1d on n-h2-861333-8 Oct 19 03:57:16.828351 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-f9a1bf0f-11a6-4342-9252-786d76b197a1 req-3884d62a-b473-4008-a385-b68a61532161 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031484 Oct 19 03:57:16.829176 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3348/6725] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:57:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:57:31.269294 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=15 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:57:31.270251 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=32 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:57:31.275293 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3c9b37d9-4ebc-4c7a-af8c-7a4276d93486 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:57:31.277506 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3c9b37d9-4ebc-4c7a-af8c-7a4276d93486 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: 6de16745-5838-4ba1-b987-1e1e4084dd7f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:57:31.283555 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3c9b37d9-4ebc-4c7a-af8c-7a4276d93486 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:57:31.285537 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3c9b37d9-4ebc-4c7a-af8c-7a4276d93486 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:57:31.285537 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3c9b37d9-4ebc-4c7a-af8c-7a4276d93486 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:57:31.285537 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3c9b37d9-4ebc-4c7a-af8c-7a4276d93486 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:57:31.285828 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3c9b37d9-4ebc-4c7a-af8c-7a4276d93486 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:57:31.286062 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3c9b37d9-4ebc-4c7a-af8c-7a4276d93486 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:57:31.359376 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3c9b37d9-4ebc-4c7a-af8c-7a4276d93486 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "POST /compute/v2.1/servers/6de16745-5838-4ba1-b987-1e1e4084dd7f/action" status: 200 len: 24565 microversion: 2.1 time: 0.092056 Oct 19 03:57:31.360056 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3349/6726] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:57:31 2022] POST /compute/v2.1/servers/6de16745-5838-4ba1-b987-1e1e4084dd7f/action => generated 24565 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 03:57:52.976039 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f1fe9476-aa80-4438-a1ff-0391d1c67db2 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:57:52.976756 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f1fe9476-aa80-4438-a1ff-0391d1c67db2 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: ebb09805-86db-46ee-a803-5e9afcc94d1d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:57:52.980051 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:57:52.986001 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f1fe9476-aa80-4438-a1ff-0391d1c67db2 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:57:52.996652 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f1fe9476-aa80-4438-a1ff-0391d1c67db2 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:57:52.996652 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f1fe9476-aa80-4438-a1ff-0391d1c67db2 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:57:52.996652 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f1fe9476-aa80-4438-a1ff-0391d1c67db2 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:57:52.996652 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f1fe9476-aa80-4438-a1ff-0391d1c67db2 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:57:52.996652 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f1fe9476-aa80-4438-a1ff-0391d1c67db2 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:57:53.012121 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f1fe9476-aa80-4438-a1ff-0391d1c67db2 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "GET /compute/v2.1/servers/ebb09805-86db-46ee-a803-5e9afcc94d1d/ips" status: 200 len: 149 microversion: 2.1 time: 0.040582 Oct 19 03:57:53.012705 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3350/6727] 10.222.0.52 () {58 vars in 1248 bytes} [Wed Oct 19 03:57:52 2022] GET /compute/v2.1/servers/ebb09805-86db-46ee-a803-5e9afcc94d1d/ips => generated 149 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:57:54.772852 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7477a632-8d44-41f5-b6aa-effc3b18afe4 tempest-TestVolumeBackupRestore-1994640921 tempest-TestVolumeBackupRestore-1994640921-project] Calling method '.version_select at 0x7fc1300273a0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:57:54.857138 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7477a632-8d44-41f5-b6aa-effc3b18afe4 tempest-TestVolumeBackupRestore-1994640921 tempest-TestVolumeBackupRestore-1994640921-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1287828978" status: 202 len: 0 microversion: 2.1 time: 0.088774 Oct 19 03:57:54.857771 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3351/6728] 10.222.0.52 () {58 vars in 1269 bytes} [Wed Oct 19 03:57:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1287828978 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 19 03:57:55.688554 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3cc41a8c-b558-4421-be9f-9a6a2e764222 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6a18d545-1073-45af-9232-ab9bb155495b"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:57:55.691045 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3cc41a8c-b558-4421-be9f-9a6a2e764222 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: ebb09805-86db-46ee-a803-5e9afcc94d1d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:57:55.698031 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3cc41a8c-b558-4421-be9f-9a6a2e764222 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:57:55.698533 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3cc41a8c-b558-4421-be9f-9a6a2e764222 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:57:55.698983 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3cc41a8c-b558-4421-be9f-9a6a2e764222 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:57:55.699809 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3cc41a8c-b558-4421-be9f-9a6a2e764222 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:57:55.700293 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3cc41a8c-b558-4421-be9f-9a6a2e764222 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:57:55.700735 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3cc41a8c-b558-4421-be9f-9a6a2e764222 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:57:56.727041 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3cc41a8c-b558-4421-be9f-9a6a2e764222 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "POST /compute/v2.1/servers/ebb09805-86db-46ee-a803-5e9afcc94d1d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.040979 Oct 19 03:57:56.727041 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3352/6729] 10.222.0.52 () {60 vars in 1323 bytes} [Wed Oct 19 03:57:55 2022] POST /compute/v2.1/servers/ebb09805-86db-46ee-a803-5e9afcc94d1d/os-volume_attachments => generated 194 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:58:01.971509 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-bac52ad1-cd13-4886-9510-8f800993d78a tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:58:01.979762 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-bac52ad1-cd13-4886-9510-8f800993d78a tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: 6de16745-5838-4ba1-b987-1e1e4084dd7f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:58:01.987041 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bac52ad1-cd13-4886-9510-8f800993d78a tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:01.987554 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bac52ad1-cd13-4886-9510-8f800993d78a tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:01.988009 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bac52ad1-cd13-4886-9510-8f800993d78a tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:01.991720 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bac52ad1-cd13-4886-9510-8f800993d78a tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:01.992221 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bac52ad1-cd13-4886-9510-8f800993d78a tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:01.994229 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bac52ad1-cd13-4886-9510-8f800993d78a tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:02.120512 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-bac52ad1-cd13-4886-9510-8f800993d78a tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Flavor limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:58:02.121261 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-bac52ad1-cd13-4886-9510-8f800993d78a tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Image limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:58:02.122058 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-bac52ad1-cd13-4886-9510-8f800993d78a tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Flavor pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:58:02.122676 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-bac52ad1-cd13-4886-9510-8f800993d78a tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Image pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:58:02.123674 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-bac52ad1-cd13-4886-9510-8f800993d78a tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:58:02.379742 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-bac52ad1-cd13-4886-9510-8f800993d78a tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: 6de16745-5838-4ba1-b987-1e1e4084dd7f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:58:02.387722 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bac52ad1-cd13-4886-9510-8f800993d78a tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:02.388471 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bac52ad1-cd13-4886-9510-8f800993d78a tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:02.389089 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bac52ad1-cd13-4886-9510-8f800993d78a tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:02.390025 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bac52ad1-cd13-4886-9510-8f800993d78a tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:02.390651 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bac52ad1-cd13-4886-9510-8f800993d78a tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:02.393667 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bac52ad1-cd13-4886-9510-8f800993d78a tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:02.425532 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-bac52ad1-cd13-4886-9510-8f800993d78a tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "POST /compute/v2.1/servers/6de16745-5838-4ba1-b987-1e1e4084dd7f/action" status: 202 len: 1137 microversion: 2.1 time: 0.621513 Oct 19 03:58:02.430375 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3353/6730] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:58:01 2022] POST /compute/v2.1/servers/6de16745-5838-4ba1-b987-1e1e4084dd7f/action => generated 1137 bytes in 627 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 19 03:58:02.447633 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-57fecc55-b288-442e-bdde-a771000bfcd3 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:58:02.447917 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-57fecc55-b288-442e-bdde-a771000bfcd3 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: 6de16745-5838-4ba1-b987-1e1e4084dd7f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:58:02.454428 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-57fecc55-b288-442e-bdde-a771000bfcd3 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:02.455051 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-57fecc55-b288-442e-bdde-a771000bfcd3 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:02.455577 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-57fecc55-b288-442e-bdde-a771000bfcd3 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:02.456287 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-57fecc55-b288-442e-bdde-a771000bfcd3 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:02.456747 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-57fecc55-b288-442e-bdde-a771000bfcd3 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:02.457212 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-57fecc55-b288-442e-bdde-a771000bfcd3 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:02.732368 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-57fecc55-b288-442e-bdde-a771000bfcd3 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:58:02.740292 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-57fecc55-b288-442e-bdde-a771000bfcd3 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/6de16745-5838-4ba1-b987-1e1e4084dd7f" status: 200 len: 1690 microversion: 2.1 time: 0.297462 Oct 19 03:58:02.740917 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3354/6731] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:58:02 2022] GET /compute/v2.1/servers/6de16745-5838-4ba1-b987-1e1e4084dd7f => generated 1690 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:58:03.765319 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9b0ead73-11e3-4dbf-a964-9e38ff5e21e7 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:58:03.766720 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9b0ead73-11e3-4dbf-a964-9e38ff5e21e7 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: 6de16745-5838-4ba1-b987-1e1e4084dd7f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:58:03.778329 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9b0ead73-11e3-4dbf-a964-9e38ff5e21e7 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:03.778711 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9b0ead73-11e3-4dbf-a964-9e38ff5e21e7 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:03.779161 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9b0ead73-11e3-4dbf-a964-9e38ff5e21e7 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:03.779932 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9b0ead73-11e3-4dbf-a964-9e38ff5e21e7 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:03.780587 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9b0ead73-11e3-4dbf-a964-9e38ff5e21e7 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:03.781042 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9b0ead73-11e3-4dbf-a964-9e38ff5e21e7 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:04.059927 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9b0ead73-11e3-4dbf-a964-9e38ff5e21e7 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:58:04.067910 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9b0ead73-11e3-4dbf-a964-9e38ff5e21e7 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/6de16745-5838-4ba1-b987-1e1e4084dd7f" status: 200 len: 1690 microversion: 2.1 time: 0.306733 Oct 19 03:58:04.068756 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3355/6732] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:58:03 2022] GET /compute/v2.1/servers/6de16745-5838-4ba1-b987-1e1e4084dd7f => generated 1690 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:58:05.092677 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8733084f-80ab-4e68-b493-4b86ef8abdac tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:58:05.094136 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8733084f-80ab-4e68-b493-4b86ef8abdac tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: 6de16745-5838-4ba1-b987-1e1e4084dd7f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:58:05.104430 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8733084f-80ab-4e68-b493-4b86ef8abdac tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:05.104936 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8733084f-80ab-4e68-b493-4b86ef8abdac tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:05.105412 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8733084f-80ab-4e68-b493-4b86ef8abdac tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:05.106138 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8733084f-80ab-4e68-b493-4b86ef8abdac tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:05.106603 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8733084f-80ab-4e68-b493-4b86ef8abdac tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:05.107149 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8733084f-80ab-4e68-b493-4b86ef8abdac tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:05.331338 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8733084f-80ab-4e68-b493-4b86ef8abdac tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:58:05.342098 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8733084f-80ab-4e68-b493-4b86ef8abdac tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/6de16745-5838-4ba1-b987-1e1e4084dd7f" status: 200 len: 1690 microversion: 2.1 time: 0.253264 Oct 19 03:58:05.358163 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3356/6733] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:58:05 2022] GET /compute/v2.1/servers/6de16745-5838-4ba1-b987-1e1e4084dd7f => generated 1690 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:58:06.365760 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-46c32403-6e5e-4e04-af4c-fa8391b672be tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:58:06.366565 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-46c32403-6e5e-4e04-af4c-fa8391b672be tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: 6de16745-5838-4ba1-b987-1e1e4084dd7f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:58:06.374171 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-46c32403-6e5e-4e04-af4c-fa8391b672be tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:06.374747 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-46c32403-6e5e-4e04-af4c-fa8391b672be tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:06.375314 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-46c32403-6e5e-4e04-af4c-fa8391b672be tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:06.376230 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-46c32403-6e5e-4e04-af4c-fa8391b672be tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:06.376695 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-46c32403-6e5e-4e04-af4c-fa8391b672be tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:06.377128 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-46c32403-6e5e-4e04-af4c-fa8391b672be tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:06.606729 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-46c32403-6e5e-4e04-af4c-fa8391b672be tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:58:06.616035 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-46c32403-6e5e-4e04-af4c-fa8391b672be tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/6de16745-5838-4ba1-b987-1e1e4084dd7f" status: 200 len: 1690 microversion: 2.1 time: 0.254667 Oct 19 03:58:06.617272 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3357/6734] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:58:06 2022] GET /compute/v2.1/servers/6de16745-5838-4ba1-b987-1e1e4084dd7f => generated 1690 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:58:07.640344 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2b4e379a-c099-4db4-8e3d-a12244e1ccdb tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:58:07.641022 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2b4e379a-c099-4db4-8e3d-a12244e1ccdb tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: 6de16745-5838-4ba1-b987-1e1e4084dd7f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:58:07.653137 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2b4e379a-c099-4db4-8e3d-a12244e1ccdb tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:07.653914 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2b4e379a-c099-4db4-8e3d-a12244e1ccdb tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:07.654282 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2b4e379a-c099-4db4-8e3d-a12244e1ccdb tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:07.655028 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2b4e379a-c099-4db4-8e3d-a12244e1ccdb tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:07.655949 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2b4e379a-c099-4db4-8e3d-a12244e1ccdb tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:07.657981 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2b4e379a-c099-4db4-8e3d-a12244e1ccdb tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:07.820525 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-2b4e379a-c099-4db4-8e3d-a12244e1ccdb tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:58:07.830200 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2b4e379a-c099-4db4-8e3d-a12244e1ccdb tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/6de16745-5838-4ba1-b987-1e1e4084dd7f" status: 200 len: 1690 microversion: 2.1 time: 0.193788 Oct 19 03:58:07.831299 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3358/6735] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:58:07 2022] GET /compute/v2.1/servers/6de16745-5838-4ba1-b987-1e1e4084dd7f => generated 1690 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:58:08.722627 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e88acfb7-f6a3-445e-8334-51a7b2d3c6bf tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6a18d545-1073-45af-9232-ab9bb155495b"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:58:08.725073 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e88acfb7-f6a3-445e-8334-51a7b2d3c6bf tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: ebb09805-86db-46ee-a803-5e9afcc94d1d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:58:08.731968 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e88acfb7-f6a3-445e-8334-51a7b2d3c6bf tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:08.732458 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e88acfb7-f6a3-445e-8334-51a7b2d3c6bf tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:08.732902 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e88acfb7-f6a3-445e-8334-51a7b2d3c6bf tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:08.733627 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e88acfb7-f6a3-445e-8334-51a7b2d3c6bf tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:08.734088 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e88acfb7-f6a3-445e-8334-51a7b2d3c6bf tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:08.734521 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e88acfb7-f6a3-445e-8334-51a7b2d3c6bf tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:08.814109 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-e88acfb7-f6a3-445e-8334-51a7b2d3c6bf tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] HTTP exception thrown: Invalid volume: volume 6a18d545-1073-45af-9232-ab9bb155495b is already attached to instances: ebb09805-86db-46ee-a803-5e9afcc94d1d Oct 19 03:58:08.815865 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e88acfb7-f6a3-445e-8334-51a7b2d3c6bf tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Request method failure captured: Oct 19 03:58:08.815865 n-d-861333-8 devstack@n-api.service[121134]: request: POST /compute/v2.1/servers/ebb09805-86db-46ee-a803-5e9afcc94d1d/os-volume_attachments HTTP/1.1 Oct 19 03:58:08.815865 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:58:08.815865 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:58:08.815865 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:58:08.815865 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 74 Oct 19 03:58:08.815865 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:58:08.815865 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:58:08.815865 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:58:08.815865 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:58:08.815865 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3T1Tg0DFz0guFQMDM9yU7WN_RUGuMbf_rWbbF4rS1oDiWv6x0dTsqBA7TFunkbzAHPQAqy9kZJmC_H2-rpZa4Diw9UEoM4xkjg4JciNrIIW263ufBC_07F6Mlg4-xs8Q2J9bkOD2CDMpGZHCZ5KbDaJBjuAHOQ_5qLd75r8z_OFtFo Oct 19 03:58:08.815865 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:58:08.815865 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:58:08.815865 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:58:08.815865 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:58:08.815865 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:58:08.815865 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:58:08.815865 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: ea131e741ef34573aa73360c5010221a Oct 19 03:58:08.815865 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-AttachVolumeNegativeTest-892544868 Oct 19 03:58:08.815865 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:58:08.815865 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:58:08.815865 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ea131e741ef34573aa73360c5010221a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ea131e741ef34573aa73360c5010221a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ea131e741ef34573aa73360c5010221a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ea131e741ef34573aa73360c5010221a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:58:08.815865 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-AttachVolumeNegativeTest-892544868 Oct 19 03:58:08.815865 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: ea131e741ef34573aa73360c5010221a Oct 19 03:58:08.815865 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-892544868 Oct 19 03:58:08.815865 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-AttachVolumeNegativeTest-892544868-project Oct 19 03:58:08.815865 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:58:08.815865 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:58:08.815865 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 14706e15b5d7487a9b1d1a6332f93f7c Oct 19 03:58:08.815865 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-AttachVolumeNegativeTest-892544868-project Oct 19 03:58:08.815865 n-d-861333-8 devstack@n-api.service[121134]: Oct 19 03:58:08.815865 n-d-861333-8 devstack@n-api.service[121134]: {"volumeAttachment": {"volumeId": "6a18d545-1073-45af-9232-ab9bb155495b"}} Oct 19 03:58:08.815865 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:58:08.815865 n-d-861333-8 devstack@n-api.service[121134]: exception: Invalid volume: volume 6a18d545-1073-45af-9232-ab9bb155495b is already attached to instances: ebb09805-86db-46ee-a803-5e9afcc94d1d Oct 19 03:58:08.815865 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'server_id': 'ebb09805-86db-46ee-a803-5e9afcc94d1d', 'body': {'volumeAttachment': {'volumeId': '6a18d545-1073-45af-9232-ab9bb155495b'}}} Oct 19 03:58:08.815865 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:58:08.815865 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:58:08.815865 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 19 03:58:08.815865 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 19 03:58:08.815865 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 19 03:58:08.815865 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 19 03:58:08.815865 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 19 03:58:08.815865 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 19 03:58:08.815865 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 19 03:58:08.815865 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 19 03:58:08.815865 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 19 03:58:08.815865 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 19 03:58:08.815865 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 6a18d545-1073-45af-9232-ab9bb155495b is already attached to instances: ebb09805-86db-46ee-a803-5e9afcc94d1d Oct 19 03:58:08.815865 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:58:08.815865 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:58:08.815865 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:58:08.815865 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:58:08.815865 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:58:08.815865 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:58:08.815865 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:58:08.815865 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:58:08.815865 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:58:08.815865 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:58:08.815865 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:58:08.815865 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:58:08.815865 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:58:08.815865 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:58:08.820625 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 03:58:08.820625 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 03:58:08.820625 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 19 03:58:08.820625 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 19 03:58:08.820625 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 6a18d545-1073-45af-9232-ab9bb155495b is already attached to instances: ebb09805-86db-46ee-a803-5e9afcc94d1d Oct 19 03:58:08.820625 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:58:08.820625 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:58:08.820625 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:58:08.820625 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:58:08.820625 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:58:08.820625 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:58:08.820625 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:58:08.820625 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:58:08.820625 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 6a18d545-1073-45af-9232-ab9bb155495b is already attached to instances: ebb09805-86db-46ee-a803-5e9afcc94d1d Oct 19 03:58:08.820625 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:58:08.820625 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e88acfb7-f6a3-445e-8334-51a7b2d3c6bf tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Returning 400 to user: Invalid volume: volume 6a18d545-1073-45af-9232-ab9bb155495b is already attached to instances: ebb09805-86db-46ee-a803-5e9afcc94d1d {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:58:08.820625 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e88acfb7-f6a3-445e-8334-51a7b2d3c6bf tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "POST /compute/v2.1/servers/ebb09805-86db-46ee-a803-5e9afcc94d1d/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.098735 Oct 19 03:58:08.820625 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3359/6736] 10.222.0.52 () {60 vars in 1323 bytes} [Wed Oct 19 03:58:08 2022] POST /compute/v2.1/servers/ebb09805-86db-46ee-a803-5e9afcc94d1d/os-volume_attachments => generated 174 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 19 03:58:08.855327 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f3c0fcab-9404-48e6-af63-09c97a9c1085 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:58:08.858735 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f3c0fcab-9404-48e6-af63-09c97a9c1085 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: 6de16745-5838-4ba1-b987-1e1e4084dd7f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:58:08.864156 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f3c0fcab-9404-48e6-af63-09c97a9c1085 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:08.864289 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f3c0fcab-9404-48e6-af63-09c97a9c1085 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:08.864796 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f3c0fcab-9404-48e6-af63-09c97a9c1085 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:08.865734 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f3c0fcab-9404-48e6-af63-09c97a9c1085 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:08.877410 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f3c0fcab-9404-48e6-af63-09c97a9c1085 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:08.877410 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f3c0fcab-9404-48e6-af63-09c97a9c1085 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:09.004574 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-f3c0fcab-9404-48e6-af63-09c97a9c1085 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:58:09.013108 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f3c0fcab-9404-48e6-af63-09c97a9c1085 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/6de16745-5838-4ba1-b987-1e1e4084dd7f" status: 200 len: 1690 microversion: 2.1 time: 0.162894 Oct 19 03:58:09.013721 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3360/6737] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:58:08 2022] GET /compute/v2.1/servers/6de16745-5838-4ba1-b987-1e1e4084dd7f => generated 1690 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:58:09.018328 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f9720cd8-ca53-4cbd-aeba-3bff6a443784 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:58:09.018870 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f9720cd8-ca53-4cbd-aeba-3bff6a443784 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: ebb09805-86db-46ee-a803-5e9afcc94d1d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:58:09.025789 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f9720cd8-ca53-4cbd-aeba-3bff6a443784 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:09.026321 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f9720cd8-ca53-4cbd-aeba-3bff6a443784 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:09.026771 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f9720cd8-ca53-4cbd-aeba-3bff6a443784 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:09.027504 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f9720cd8-ca53-4cbd-aeba-3bff6a443784 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:09.028019 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f9720cd8-ca53-4cbd-aeba-3bff6a443784 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:09.028462 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f9720cd8-ca53-4cbd-aeba-3bff6a443784 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:09.109999 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-f9720cd8-ca53-4cbd-aeba-3bff6a443784 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lazy-loading 'services' on Instance uuid ebb09805-86db-46ee-a803-5e9afcc94d1d {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:58:09.377718 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f9720cd8-ca53-4cbd-aeba-3bff6a443784 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ebb09805-86db-46ee-a803-5e9afcc94d1d/os-volume_attachments/6a18d545-1073-45af-9232-ab9bb155495b" status: 202 len: 0 microversion: 2.1 time: 0.362511 Oct 19 03:58:09.378325 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3361/6738] 10.222.0.52 () {58 vars in 1416 bytes} [Wed Oct 19 03:58:09 2022] DELETE /compute/v2.1/servers/ebb09805-86db-46ee-a803-5e9afcc94d1d/os-volume_attachments/6a18d545-1073-45af-9232-ab9bb155495b => generated 0 bytes in 364 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:58:09.387465 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0d276bb2-01d2-426d-bce4-c7b42ee0903c tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:58:09.389892 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0d276bb2-01d2-426d-bce4-c7b42ee0903c tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: ebb09805-86db-46ee-a803-5e9afcc94d1d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:58:09.396911 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0d276bb2-01d2-426d-bce4-c7b42ee0903c tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:09.397436 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0d276bb2-01d2-426d-bce4-c7b42ee0903c tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:09.397889 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0d276bb2-01d2-426d-bce4-c7b42ee0903c tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:09.398602 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0d276bb2-01d2-426d-bce4-c7b42ee0903c tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:09.399070 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0d276bb2-01d2-426d-bce4-c7b42ee0903c tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:09.399499 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0d276bb2-01d2-426d-bce4-c7b42ee0903c tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:09.429557 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0d276bb2-01d2-426d-bce4-c7b42ee0903c tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "GET /compute/v2.1/servers/ebb09805-86db-46ee-a803-5e9afcc94d1d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046431 Oct 19 03:58:09.430123 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3362/6739] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Oct 19 03:58:09 2022] GET /compute/v2.1/servers/ebb09805-86db-46ee-a803-5e9afcc94d1d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:58:10.036159 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3f8f32f0-f768-4bbc-985b-13ce740f1528 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:58:10.043093 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3f8f32f0-f768-4bbc-985b-13ce740f1528 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: 6de16745-5838-4ba1-b987-1e1e4084dd7f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:58:10.043676 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3f8f32f0-f768-4bbc-985b-13ce740f1528 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:10.044174 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3f8f32f0-f768-4bbc-985b-13ce740f1528 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:10.044623 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3f8f32f0-f768-4bbc-985b-13ce740f1528 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:10.045330 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3f8f32f0-f768-4bbc-985b-13ce740f1528 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:10.045820 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3f8f32f0-f768-4bbc-985b-13ce740f1528 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:10.046264 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3f8f32f0-f768-4bbc-985b-13ce740f1528 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:10.050489 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:58:10.202529 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-3f8f32f0-f768-4bbc-985b-13ce740f1528 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:58:10.212914 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3f8f32f0-f768-4bbc-985b-13ce740f1528 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/6de16745-5838-4ba1-b987-1e1e4084dd7f" status: 200 len: 1690 microversion: 2.1 time: 0.180238 Oct 19 03:58:10.213904 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3363/6740] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:58:10 2022] GET /compute/v2.1/servers/6de16745-5838-4ba1-b987-1e1e4084dd7f => generated 1690 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:58:10.443750 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-022827ba-4d98-421b-b4e9-8a5695beb466 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:58:10.446912 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-022827ba-4d98-421b-b4e9-8a5695beb466 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: ebb09805-86db-46ee-a803-5e9afcc94d1d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:58:10.454559 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-022827ba-4d98-421b-b4e9-8a5695beb466 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:10.455116 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-022827ba-4d98-421b-b4e9-8a5695beb466 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:10.455642 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-022827ba-4d98-421b-b4e9-8a5695beb466 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:10.456436 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-022827ba-4d98-421b-b4e9-8a5695beb466 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:10.456948 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-022827ba-4d98-421b-b4e9-8a5695beb466 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:10.457588 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-022827ba-4d98-421b-b4e9-8a5695beb466 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:10.491629 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-022827ba-4d98-421b-b4e9-8a5695beb466 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "GET /compute/v2.1/servers/ebb09805-86db-46ee-a803-5e9afcc94d1d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052686 Oct 19 03:58:10.492475 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3364/6741] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Oct 19 03:58:10 2022] GET /compute/v2.1/servers/ebb09805-86db-46ee-a803-5e9afcc94d1d/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:58:11.236635 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7ca49abc-7419-480e-b86e-7603dca469da tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:58:11.237323 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7ca49abc-7419-480e-b86e-7603dca469da tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: 6de16745-5838-4ba1-b987-1e1e4084dd7f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:58:11.244785 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7ca49abc-7419-480e-b86e-7603dca469da tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:11.245298 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7ca49abc-7419-480e-b86e-7603dca469da tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:11.245779 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7ca49abc-7419-480e-b86e-7603dca469da tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:11.246674 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7ca49abc-7419-480e-b86e-7603dca469da tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:11.247141 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7ca49abc-7419-480e-b86e-7603dca469da tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:11.247579 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7ca49abc-7419-480e-b86e-7603dca469da tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:11.395709 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-7ca49abc-7419-480e-b86e-7603dca469da tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:58:11.406343 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7ca49abc-7419-480e-b86e-7603dca469da tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/6de16745-5838-4ba1-b987-1e1e4084dd7f" status: 200 len: 1690 microversion: 2.1 time: 0.173677 Oct 19 03:58:11.413957 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3365/6742] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:58:11 2022] GET /compute/v2.1/servers/6de16745-5838-4ba1-b987-1e1e4084dd7f => generated 1690 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:58:11.506508 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-22aa0a1f-af35-4fe7-8740-83c136f0fcaf tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:58:11.508829 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-22aa0a1f-af35-4fe7-8740-83c136f0fcaf tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: ebb09805-86db-46ee-a803-5e9afcc94d1d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:58:11.516510 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-22aa0a1f-af35-4fe7-8740-83c136f0fcaf tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:11.517336 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-22aa0a1f-af35-4fe7-8740-83c136f0fcaf tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:11.518014 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-22aa0a1f-af35-4fe7-8740-83c136f0fcaf tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:11.518932 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-22aa0a1f-af35-4fe7-8740-83c136f0fcaf tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:11.519600 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-22aa0a1f-af35-4fe7-8740-83c136f0fcaf tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:11.520241 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-22aa0a1f-af35-4fe7-8740-83c136f0fcaf tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:11.554485 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-22aa0a1f-af35-4fe7-8740-83c136f0fcaf tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "GET /compute/v2.1/servers/ebb09805-86db-46ee-a803-5e9afcc94d1d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053825 Oct 19 03:58:11.555727 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3366/6743] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Oct 19 03:58:11 2022] GET /compute/v2.1/servers/ebb09805-86db-46ee-a803-5e9afcc94d1d/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:58:12.430628 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e60f77c5-13ea-4284-b3c8-288a04f92acd tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:58:12.432546 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e60f77c5-13ea-4284-b3c8-288a04f92acd tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: 6de16745-5838-4ba1-b987-1e1e4084dd7f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:58:12.440326 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e60f77c5-13ea-4284-b3c8-288a04f92acd tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:12.441282 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e60f77c5-13ea-4284-b3c8-288a04f92acd tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:12.441814 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e60f77c5-13ea-4284-b3c8-288a04f92acd tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:12.442820 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e60f77c5-13ea-4284-b3c8-288a04f92acd tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:12.443558 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e60f77c5-13ea-4284-b3c8-288a04f92acd tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:12.444230 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e60f77c5-13ea-4284-b3c8-288a04f92acd tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:12.620005 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e60f77c5-13ea-4284-b3c8-288a04f92acd tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:58:12.628914 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e60f77c5-13ea-4284-b3c8-288a04f92acd tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/6de16745-5838-4ba1-b987-1e1e4084dd7f" status: 200 len: 1690 microversion: 2.1 time: 0.202358 Oct 19 03:58:12.641798 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3367/6744] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:58:12 2022] GET /compute/v2.1/servers/6de16745-5838-4ba1-b987-1e1e4084dd7f => generated 1690 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:58:12.651267 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c60c54cc-6cc2-4886-8a2a-41a8cca75e32 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:58:12.653668 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c60c54cc-6cc2-4886-8a2a-41a8cca75e32 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: ebb09805-86db-46ee-a803-5e9afcc94d1d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:58:12.659787 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c60c54cc-6cc2-4886-8a2a-41a8cca75e32 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:12.660501 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c60c54cc-6cc2-4886-8a2a-41a8cca75e32 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:12.660953 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c60c54cc-6cc2-4886-8a2a-41a8cca75e32 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:12.661694 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c60c54cc-6cc2-4886-8a2a-41a8cca75e32 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:12.662528 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c60c54cc-6cc2-4886-8a2a-41a8cca75e32 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:12.662972 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c60c54cc-6cc2-4886-8a2a-41a8cca75e32 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:12.695822 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c60c54cc-6cc2-4886-8a2a-41a8cca75e32 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "GET /compute/v2.1/servers/ebb09805-86db-46ee-a803-5e9afcc94d1d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052636 Oct 19 03:58:12.701586 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3368/6745] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Oct 19 03:58:12 2022] GET /compute/v2.1/servers/ebb09805-86db-46ee-a803-5e9afcc94d1d/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:58:13.659729 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-adbbe3dc-d973-488f-b4b2-4846f2c44d6b tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:58:13.661243 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-adbbe3dc-d973-488f-b4b2-4846f2c44d6b tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: 6de16745-5838-4ba1-b987-1e1e4084dd7f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:58:13.669212 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-adbbe3dc-d973-488f-b4b2-4846f2c44d6b tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:13.670132 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-adbbe3dc-d973-488f-b4b2-4846f2c44d6b tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:13.670902 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-adbbe3dc-d973-488f-b4b2-4846f2c44d6b tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:13.671781 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-adbbe3dc-d973-488f-b4b2-4846f2c44d6b tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:13.672395 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-adbbe3dc-d973-488f-b4b2-4846f2c44d6b tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:13.672984 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-adbbe3dc-d973-488f-b4b2-4846f2c44d6b tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:13.817267 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-adbbe3dc-d973-488f-b4b2-4846f2c44d6b tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:58:13.828369 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-adbbe3dc-d973-488f-b4b2-4846f2c44d6b tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/6de16745-5838-4ba1-b987-1e1e4084dd7f" status: 200 len: 1690 microversion: 2.1 time: 0.174413 Oct 19 03:58:13.829208 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3369/6746] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:58:13 2022] GET /compute/v2.1/servers/6de16745-5838-4ba1-b987-1e1e4084dd7f => generated 1690 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:58:13.844987 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a4faddaf-ebc6-442e-a3c2-5d4ed6cc2261 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:58:13.846145 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a4faddaf-ebc6-442e-a3c2-5d4ed6cc2261 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: ebb09805-86db-46ee-a803-5e9afcc94d1d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:58:13.852437 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a4faddaf-ebc6-442e-a3c2-5d4ed6cc2261 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:13.853136 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a4faddaf-ebc6-442e-a3c2-5d4ed6cc2261 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:13.853657 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a4faddaf-ebc6-442e-a3c2-5d4ed6cc2261 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:13.854375 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a4faddaf-ebc6-442e-a3c2-5d4ed6cc2261 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:13.854834 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a4faddaf-ebc6-442e-a3c2-5d4ed6cc2261 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:13.855262 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a4faddaf-ebc6-442e-a3c2-5d4ed6cc2261 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:13.890737 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a4faddaf-ebc6-442e-a3c2-5d4ed6cc2261 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "GET /compute/v2.1/servers/ebb09805-86db-46ee-a803-5e9afcc94d1d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051336 Oct 19 03:58:13.891323 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3370/6747] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Oct 19 03:58:13 2022] GET /compute/v2.1/servers/ebb09805-86db-46ee-a803-5e9afcc94d1d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:58:14.852805 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ec02270b-dd1f-49f0-9880-9ffb68c6a670 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:58:14.854063 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ec02270b-dd1f-49f0-9880-9ffb68c6a670 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: 6de16745-5838-4ba1-b987-1e1e4084dd7f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:58:14.862525 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ec02270b-dd1f-49f0-9880-9ffb68c6a670 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:14.862992 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ec02270b-dd1f-49f0-9880-9ffb68c6a670 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:14.863443 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ec02270b-dd1f-49f0-9880-9ffb68c6a670 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:14.864148 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ec02270b-dd1f-49f0-9880-9ffb68c6a670 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:14.864611 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ec02270b-dd1f-49f0-9880-9ffb68c6a670 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:14.870512 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ec02270b-dd1f-49f0-9880-9ffb68c6a670 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:15.148750 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ec02270b-dd1f-49f0-9880-9ffb68c6a670 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:58:15.158200 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ec02270b-dd1f-49f0-9880-9ffb68c6a670 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/6de16745-5838-4ba1-b987-1e1e4084dd7f" status: 200 len: 1708 microversion: 2.1 time: 0.308997 Oct 19 03:58:15.159277 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3371/6748] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:58:14 2022] GET /compute/v2.1/servers/6de16745-5838-4ba1-b987-1e1e4084dd7f => generated 1708 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:58:15.165804 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-af9c072e-a69e-4a70-aa04-a05029f050e0 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:58:15.168712 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-af9c072e-a69e-4a70-aa04-a05029f050e0 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: ebb09805-86db-46ee-a803-5e9afcc94d1d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:58:15.177587 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-af9c072e-a69e-4a70-aa04-a05029f050e0 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:15.178324 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-af9c072e-a69e-4a70-aa04-a05029f050e0 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:15.178929 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-af9c072e-a69e-4a70-aa04-a05029f050e0 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:15.180046 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-af9c072e-a69e-4a70-aa04-a05029f050e0 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:15.180710 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-af9c072e-a69e-4a70-aa04-a05029f050e0 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:15.182363 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-af9c072e-a69e-4a70-aa04-a05029f050e0 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:15.216613 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-af9c072e-a69e-4a70-aa04-a05029f050e0 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "GET /compute/v2.1/servers/ebb09805-86db-46ee-a803-5e9afcc94d1d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055962 Oct 19 03:58:15.217194 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3372/6749] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Oct 19 03:58:15 2022] GET /compute/v2.1/servers/ebb09805-86db-46ee-a803-5e9afcc94d1d/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 03:58:15.292803 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4281e6ca-9a21-4264-b701-5645278f433b tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:58:15.293309 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4281e6ca-9a21-4264-b701-5645278f433b tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: ebb09805-86db-46ee-a803-5e9afcc94d1d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:58:15.299329 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4281e6ca-9a21-4264-b701-5645278f433b tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:15.300072 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4281e6ca-9a21-4264-b701-5645278f433b tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:15.300518 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4281e6ca-9a21-4264-b701-5645278f433b tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:15.301444 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4281e6ca-9a21-4264-b701-5645278f433b tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:15.301908 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4281e6ca-9a21-4264-b701-5645278f433b tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:15.302343 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4281e6ca-9a21-4264-b701-5645278f433b tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:15.328328 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4281e6ca-9a21-4264-b701-5645278f433b tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: ebb09805-86db-46ee-a803-5e9afcc94d1d] Going to try to terminate instance {{(pid=121134) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:58:15.661751 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4281e6ca-9a21-4264-b701-5645278f433b tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ebb09805-86db-46ee-a803-5e9afcc94d1d" status: 204 len: 0 microversion: 2.1 time: 0.373866 Oct 19 03:58:15.666683 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3373/6750] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:58:15 2022] DELETE /compute/v2.1/servers/ebb09805-86db-46ee-a803-5e9afcc94d1d => generated 0 bytes in 376 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 19 03:58:15.674180 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5a22b08e-e172-43da-a195-11097375de4e tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:58:15.674985 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5a22b08e-e172-43da-a195-11097375de4e tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: ebb09805-86db-46ee-a803-5e9afcc94d1d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:58:15.683382 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5a22b08e-e172-43da-a195-11097375de4e tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:15.684129 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5a22b08e-e172-43da-a195-11097375de4e tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:15.684829 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5a22b08e-e172-43da-a195-11097375de4e tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:15.685812 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5a22b08e-e172-43da-a195-11097375de4e tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:15.686495 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5a22b08e-e172-43da-a195-11097375de4e tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:15.687129 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5a22b08e-e172-43da-a195-11097375de4e tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:15.873353 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5a22b08e-e172-43da-a195-11097375de4e tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14706e15b5d7487a9b1d1a6332f93f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea131e741ef34573aa73360c5010221a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:58:15.894587 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5a22b08e-e172-43da-a195-11097375de4e tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "GET /compute/v2.1/servers/ebb09805-86db-46ee-a803-5e9afcc94d1d" status: 200 len: 1680 microversion: 2.1 time: 0.225870 Oct 19 03:58:15.898365 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3374/6751] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:58:15 2022] GET /compute/v2.1/servers/ebb09805-86db-46ee-a803-5e9afcc94d1d => generated 1680 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:58:16.188443 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8f69d1d8-4b0f-42b2-a36d-3826959cff29 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:58:16.193578 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8f69d1d8-4b0f-42b2-a36d-3826959cff29 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: 6de16745-5838-4ba1-b987-1e1e4084dd7f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:58:16.196489 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8f69d1d8-4b0f-42b2-a36d-3826959cff29 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:16.197258 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8f69d1d8-4b0f-42b2-a36d-3826959cff29 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:16.198372 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8f69d1d8-4b0f-42b2-a36d-3826959cff29 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:16.199291 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8f69d1d8-4b0f-42b2-a36d-3826959cff29 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:16.199886 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8f69d1d8-4b0f-42b2-a36d-3826959cff29 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:16.200497 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8f69d1d8-4b0f-42b2-a36d-3826959cff29 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:16.388579 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8f69d1d8-4b0f-42b2-a36d-3826959cff29 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:58:16.397623 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8f69d1d8-4b0f-42b2-a36d-3826959cff29 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/6de16745-5838-4ba1-b987-1e1e4084dd7f" status: 200 len: 1696 microversion: 2.1 time: 0.213510 Oct 19 03:58:16.398216 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3375/6752] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:58:16 2022] GET /compute/v2.1/servers/6de16745-5838-4ba1-b987-1e1e4084dd7f => generated 1696 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:58:16.922002 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-fbad4ce3-775e-4227-a0aa-103b9e59fcb6 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:58:16.926672 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-fbad4ce3-775e-4227-a0aa-103b9e59fcb6 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: ebb09805-86db-46ee-a803-5e9afcc94d1d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:58:16.931101 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fbad4ce3-775e-4227-a0aa-103b9e59fcb6 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:16.932455 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fbad4ce3-775e-4227-a0aa-103b9e59fcb6 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:16.932969 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fbad4ce3-775e-4227-a0aa-103b9e59fcb6 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:16.934150 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fbad4ce3-775e-4227-a0aa-103b9e59fcb6 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:16.934828 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fbad4ce3-775e-4227-a0aa-103b9e59fcb6 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:16.935719 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fbad4ce3-775e-4227-a0aa-103b9e59fcb6 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:17.086664 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-fbad4ce3-775e-4227-a0aa-103b9e59fcb6 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14706e15b5d7487a9b1d1a6332f93f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea131e741ef34573aa73360c5010221a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:58:17.095555 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-fbad4ce3-775e-4227-a0aa-103b9e59fcb6 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "GET /compute/v2.1/servers/ebb09805-86db-46ee-a803-5e9afcc94d1d" status: 200 len: 1680 microversion: 2.1 time: 0.177468 Oct 19 03:58:17.096164 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3376/6753] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:58:16 2022] GET /compute/v2.1/servers/ebb09805-86db-46ee-a803-5e9afcc94d1d => generated 1680 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:58:17.427343 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8c3a4a5a-d81a-4771-a083-99a2e996bb6a tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:58:17.428085 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8c3a4a5a-d81a-4771-a083-99a2e996bb6a tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: 6de16745-5838-4ba1-b987-1e1e4084dd7f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:58:17.434182 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8c3a4a5a-d81a-4771-a083-99a2e996bb6a tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:17.434669 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8c3a4a5a-d81a-4771-a083-99a2e996bb6a tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:17.435105 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8c3a4a5a-d81a-4771-a083-99a2e996bb6a tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:17.435800 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8c3a4a5a-d81a-4771-a083-99a2e996bb6a tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:17.436509 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8c3a4a5a-d81a-4771-a083-99a2e996bb6a tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:17.436675 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8c3a4a5a-d81a-4771-a083-99a2e996bb6a tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:18.096744 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8c3a4a5a-d81a-4771-a083-99a2e996bb6a tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:58:18.106592 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8c3a4a5a-d81a-4771-a083-99a2e996bb6a tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/6de16745-5838-4ba1-b987-1e1e4084dd7f" status: 200 len: 1696 microversion: 2.1 time: 0.683082 Oct 19 03:58:18.107718 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3377/6754] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:58:17 2022] GET /compute/v2.1/servers/6de16745-5838-4ba1-b987-1e1e4084dd7f => generated 1696 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:58:18.125573 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d793d2c5-c6cc-4756-b6a3-38b1593e1a75 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:58:18.126681 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d793d2c5-c6cc-4756-b6a3-38b1593e1a75 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: ebb09805-86db-46ee-a803-5e9afcc94d1d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:58:18.133044 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d793d2c5-c6cc-4756-b6a3-38b1593e1a75 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:18.133592 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d793d2c5-c6cc-4756-b6a3-38b1593e1a75 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:18.134255 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d793d2c5-c6cc-4756-b6a3-38b1593e1a75 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:18.134994 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d793d2c5-c6cc-4756-b6a3-38b1593e1a75 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:18.135614 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d793d2c5-c6cc-4756-b6a3-38b1593e1a75 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:18.136047 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d793d2c5-c6cc-4756-b6a3-38b1593e1a75 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:18.140444 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:58:18.401006 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d793d2c5-c6cc-4756-b6a3-38b1593e1a75 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14706e15b5d7487a9b1d1a6332f93f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea131e741ef34573aa73360c5010221a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:58:18.414914 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d793d2c5-c6cc-4756-b6a3-38b1593e1a75 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "GET /compute/v2.1/servers/ebb09805-86db-46ee-a803-5e9afcc94d1d" status: 200 len: 1680 microversion: 2.1 time: 0.299132 Oct 19 03:58:18.421937 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3378/6755] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:58:18 2022] GET /compute/v2.1/servers/ebb09805-86db-46ee-a803-5e9afcc94d1d => generated 1680 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:58:18.711481 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-ae103210-5d1e-43ee-8342-65fd3f3127af req-7af800c7-825e-4d19-a2ab-f644191aa277 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6de16745-5838-4ba1-b987-1e1e4084dd7f", "name": "network-vif-unplugged", "status": "completed", "tag": "11ca3831-bfbb-4328-9073-14dcd2216de2"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:58:18.722439 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-ae103210-5d1e-43ee-8342-65fd3f3127af req-7af800c7-825e-4d19-a2ab-f644191aa277 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:18.723208 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-ae103210-5d1e-43ee-8342-65fd3f3127af req-7af800c7-825e-4d19-a2ab-f644191aa277 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:18.723808 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-ae103210-5d1e-43ee-8342-65fd3f3127af req-7af800c7-825e-4d19-a2ab-f644191aa277 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:18.737641 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-ae103210-5d1e-43ee-8342-65fd3f3127af req-7af800c7-825e-4d19-a2ab-f644191aa277 service nova] Creating event network-vif-unplugged:11ca3831-bfbb-4328-9073-14dcd2216de2 for instance 6de16745-5838-4ba1-b987-1e1e4084dd7f on n-h1-861333-8 Oct 19 03:58:18.751633 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-ae103210-5d1e-43ee-8342-65fd3f3127af req-7af800c7-825e-4d19-a2ab-f644191aa277 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041895 Oct 19 03:58:18.752655 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3379/6756] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:58:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:58:19.018450 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-15257845-1b0e-4fe0-8830-d306280fa418 req-f336be4a-bdde-4d2c-83e4-a0427e31c3da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebb09805-86db-46ee-a803-5e9afcc94d1d", "name": "network-vif-deleted", "tag": "7967e6b8-99f3-4e56-9a4a-c99ceb8ad9e0"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:58:19.029187 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-15257845-1b0e-4fe0-8830-d306280fa418 req-f336be4a-bdde-4d2c-83e4-a0427e31c3da service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:19.029766 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-15257845-1b0e-4fe0-8830-d306280fa418 req-f336be4a-bdde-4d2c-83e4-a0427e31c3da service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:19.030207 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-15257845-1b0e-4fe0-8830-d306280fa418 req-f336be4a-bdde-4d2c-83e4-a0427e31c3da service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:19.042180 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-15257845-1b0e-4fe0-8830-d306280fa418 req-f336be4a-bdde-4d2c-83e4-a0427e31c3da service nova] Creating event network-vif-deleted:7967e6b8-99f3-4e56-9a4a-c99ceb8ad9e0 for instance ebb09805-86db-46ee-a803-5e9afcc94d1d on n-h2-861333-8 Oct 19 03:58:19.050957 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-15257845-1b0e-4fe0-8830-d306280fa418 req-f336be4a-bdde-4d2c-83e4-a0427e31c3da service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039426 Oct 19 03:58:19.052470 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3380/6757] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:58:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:58:19.134203 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b3bddab2-0b7a-4f71-b432-de037fda617a tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:58:19.136654 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b3bddab2-0b7a-4f71-b432-de037fda617a tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: 6de16745-5838-4ba1-b987-1e1e4084dd7f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:58:19.145132 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b3bddab2-0b7a-4f71-b432-de037fda617a tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:19.149087 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b3bddab2-0b7a-4f71-b432-de037fda617a tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:19.149087 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b3bddab2-0b7a-4f71-b432-de037fda617a tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:19.149087 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b3bddab2-0b7a-4f71-b432-de037fda617a tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:19.149087 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b3bddab2-0b7a-4f71-b432-de037fda617a tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:19.149087 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b3bddab2-0b7a-4f71-b432-de037fda617a tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:19.445714 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b3bddab2-0b7a-4f71-b432-de037fda617a tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:58:19.455053 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b3bddab2-0b7a-4f71-b432-de037fda617a tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/6de16745-5838-4ba1-b987-1e1e4084dd7f" status: 200 len: 1696 microversion: 2.1 time: 0.326864 Oct 19 03:58:19.470286 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3381/6758] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:58:19 2022] GET /compute/v2.1/servers/6de16745-5838-4ba1-b987-1e1e4084dd7f => generated 1696 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:58:19.478504 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-be23ca9d-0a81-4ba3-adff-ee618c7aee66 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:58:19.479377 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-be23ca9d-0a81-4ba3-adff-ee618c7aee66 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: ebb09805-86db-46ee-a803-5e9afcc94d1d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:58:19.486119 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-be23ca9d-0a81-4ba3-adff-ee618c7aee66 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:19.488877 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-be23ca9d-0a81-4ba3-adff-ee618c7aee66 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:19.488877 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-be23ca9d-0a81-4ba3-adff-ee618c7aee66 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:19.488877 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-be23ca9d-0a81-4ba3-adff-ee618c7aee66 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:19.488877 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-be23ca9d-0a81-4ba3-adff-ee618c7aee66 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:19.489268 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-be23ca9d-0a81-4ba3-adff-ee618c7aee66 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:19.530540 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-be23ca9d-0a81-4ba3-adff-ee618c7aee66 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:19.531435 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-be23ca9d-0a81-4ba3-adff-ee618c7aee66 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:19.532117 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-be23ca9d-0a81-4ba3-adff-ee618c7aee66 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:19.532986 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-be23ca9d-0a81-4ba3-adff-ee618c7aee66 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lazy-loading 'fault' on Instance uuid ebb09805-86db-46ee-a803-5e9afcc94d1d {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:58:19.665323 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-be23ca9d-0a81-4ba3-adff-ee618c7aee66 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14706e15b5d7487a9b1d1a6332f93f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea131e741ef34573aa73360c5010221a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:58:19.674247 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-be23ca9d-0a81-4ba3-adff-ee618c7aee66 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "GET /compute/v2.1/servers/ebb09805-86db-46ee-a803-5e9afcc94d1d" status: 200 len: 1330 microversion: 2.1 time: 0.202514 Oct 19 03:58:19.678252 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3382/6759] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:58:19 2022] GET /compute/v2.1/servers/ebb09805-86db-46ee-a803-5e9afcc94d1d => generated 1330 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:58:20.482217 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-72eec55f-1916-493d-bff8-66ecc813f1ea tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:58:20.483173 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-72eec55f-1916-493d-bff8-66ecc813f1ea tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: 6de16745-5838-4ba1-b987-1e1e4084dd7f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:58:20.503226 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-72eec55f-1916-493d-bff8-66ecc813f1ea tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:20.504035 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-72eec55f-1916-493d-bff8-66ecc813f1ea tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:20.504752 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-72eec55f-1916-493d-bff8-66ecc813f1ea tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:20.506191 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-72eec55f-1916-493d-bff8-66ecc813f1ea tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:20.509110 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-72eec55f-1916-493d-bff8-66ecc813f1ea tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:20.509704 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-72eec55f-1916-493d-bff8-66ecc813f1ea tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:20.685090 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-72eec55f-1916-493d-bff8-66ecc813f1ea tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:58:20.692824 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-72eec55f-1916-493d-bff8-66ecc813f1ea tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/6de16745-5838-4ba1-b987-1e1e4084dd7f" status: 200 len: 1681 microversion: 2.1 time: 0.215444 Oct 19 03:58:20.695172 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3383/6760] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:58:20 2022] GET /compute/v2.1/servers/6de16745-5838-4ba1-b987-1e1e4084dd7f => generated 1681 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:58:20.711679 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-934eeb7a-881a-4ca4-aa2b-5e40ff6097be tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:58:20.711825 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-934eeb7a-881a-4ca4-aa2b-5e40ff6097be tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: ebb09805-86db-46ee-a803-5e9afcc94d1d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:58:20.719573 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-934eeb7a-881a-4ca4-aa2b-5e40ff6097be tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:20.720080 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-934eeb7a-881a-4ca4-aa2b-5e40ff6097be tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:20.720532 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-934eeb7a-881a-4ca4-aa2b-5e40ff6097be tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:20.721245 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-934eeb7a-881a-4ca4-aa2b-5e40ff6097be tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:20.721739 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-934eeb7a-881a-4ca4-aa2b-5e40ff6097be tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:20.722394 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-934eeb7a-881a-4ca4-aa2b-5e40ff6097be tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:20.740616 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-934eeb7a-881a-4ca4-aa2b-5e40ff6097be tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] HTTP exception thrown: Instance ebb09805-86db-46ee-a803-5e9afcc94d1d could not be found. Oct 19 03:58:20.746917 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-934eeb7a-881a-4ca4-aa2b-5e40ff6097be tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Request method failure captured: Oct 19 03:58:20.746917 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/ebb09805-86db-46ee-a803-5e9afcc94d1d HTTP/1.1 Oct 19 03:58:20.746917 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:58:20.746917 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:58:20.746917 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:58:20.746917 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:58:20.746917 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:58:20.746917 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:58:20.746917 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:58:20.746917 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:58:20.746917 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3T1Tg0DFz0guFQMDM9yU7WN_RUGuMbf_rWbbF4rS1oDiWv6x0dTsqBA7TFunkbzAHPQAqy9kZJmC_H2-rpZa4Diw9UEoM4xkjg4JciNrIIW263ufBC_07F6Mlg4-xs8Q2J9bkOD2CDMpGZHCZ5KbDaJBjuAHOQ_5qLd75r8z_OFtFo Oct 19 03:58:20.746917 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:58:20.746917 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:58:20.746917 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:58:20.746917 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:58:20.746917 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:58:20.746917 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:58:20.746917 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: ea131e741ef34573aa73360c5010221a Oct 19 03:58:20.746917 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-AttachVolumeNegativeTest-892544868 Oct 19 03:58:20.746917 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:58:20.746917 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:58:20.746917 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ea131e741ef34573aa73360c5010221a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ea131e741ef34573aa73360c5010221a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ea131e741ef34573aa73360c5010221a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ea131e741ef34573aa73360c5010221a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:58:20.746917 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-AttachVolumeNegativeTest-892544868 Oct 19 03:58:20.746917 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: ea131e741ef34573aa73360c5010221a Oct 19 03:58:20.746917 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-892544868 Oct 19 03:58:20.746917 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-AttachVolumeNegativeTest-892544868-project Oct 19 03:58:20.746917 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:58:20.746917 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:58:20.746917 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 14706e15b5d7487a9b1d1a6332f93f7c Oct 19 03:58:20.746917 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-AttachVolumeNegativeTest-892544868-project Oct 19 03:58:20.746917 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:58:20.746917 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance ebb09805-86db-46ee-a803-5e9afcc94d1d could not be found. Oct 19 03:58:20.746917 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': 'ebb09805-86db-46ee-a803-5e9afcc94d1d'} Oct 19 03:58:20.746917 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:58:20.746917 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:58:20.746917 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:58:20.746917 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:58:20.746917 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:58:20.746917 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:58:20.746917 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:58:20.746917 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:58:20.746917 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:58:20.746917 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:58:20.746917 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ebb09805-86db-46ee-a803-5e9afcc94d1d could not be found. Oct 19 03:58:20.746917 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:58:20.746917 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:58:20.746917 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:58:20.746917 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:58:20.746917 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:58:20.746917 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:58:20.746917 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:58:20.746917 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:58:20.746917 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:58:20.746917 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:58:20.746917 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:58:20.746917 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:58:20.746917 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:58:20.746917 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:58:20.746917 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:58:20.746917 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:58:20.746917 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ebb09805-86db-46ee-a803-5e9afcc94d1d could not be found. Oct 19 03:58:20.746917 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:58:20.746917 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:58:20.746917 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:58:20.751910 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:58:20.751910 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:58:20.751910 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:58:20.751910 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:58:20.751910 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:58:20.751910 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ebb09805-86db-46ee-a803-5e9afcc94d1d could not be found. Oct 19 03:58:20.751910 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:58:20.751910 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-934eeb7a-881a-4ca4-aa2b-5e40ff6097be tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Returning 404 to user: Instance ebb09805-86db-46ee-a803-5e9afcc94d1d could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:58:20.751910 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-934eeb7a-881a-4ca4-aa2b-5e40ff6097be tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "GET /compute/v2.1/servers/ebb09805-86db-46ee-a803-5e9afcc94d1d" status: 404 len: 111 microversion: 2.1 time: 0.044177 Oct 19 03:58:20.751910 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3384/6761] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:58:20 2022] GET /compute/v2.1/servers/ebb09805-86db-46ee-a803-5e9afcc94d1d => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:58:20.758202 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0fd887d7-841a-42a4-838a-14dd67165f54 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Calling method '.version_select at 0x7fc13516aa60>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:58:20.848903 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0fd887d7-841a-42a4-838a-14dd67165f54 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-129440190" status: 202 len: 0 microversion: 2.1 time: 0.094545 Oct 19 03:58:20.850094 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3385/6762] 10.222.0.52 () {58 vars in 1218 bytes} [Wed Oct 19 03:58:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-129440190 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 19 03:58:22.108077 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-349394cb-01f8-4a32-a2cc-80c11388b929 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Action: 'create', calling method: .version_select at 0x7fc13024f0d0>, body: {"keypair": {"name": "tempest-keypair-1186584213", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM7HEP/bq9ftPRAhLHAtGwHcK5nIlHcS1jvlWFo5ELxsnJo5IzrGpcGTkJN0UO3kncNIj1KPgHn3W3j+6xuaQG8f1KV2atYvZMnKpzkttVAIT8rG/32YkNfM6T71ySE5HA=="}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:58:22.131449 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-349394cb-01f8-4a32-a2cc-80c11388b929 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Getting quotas for project ea131e741ef34573aa73360c5010221a. Resources: {'key_pairs'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:58:22.138791 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-349394cb-01f8-4a32-a2cc-80c11388b929 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Getting quotas for user 14706e15b5d7487a9b1d1a6332f93f7c and project ea131e741ef34573aa73360c5010221a. Resources: {'key_pairs'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:58:22.160153 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:58:22.229004 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-349394cb-01f8-4a32-a2cc-80c11388b929 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.126610 Oct 19 03:58:22.234537 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3386/6763] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Oct 19 03:58:22 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:58:22.993234 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-3c77c3d5-0eea-4969-b92e-1ebc1389ccc7 req-d288d58c-804d-497c-b526-a4e8f83da944 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6de16745-5838-4ba1-b987-1e1e4084dd7f", "name": "network-vif-plugged", "status": "completed", "tag": "11ca3831-bfbb-4328-9073-14dcd2216de2"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:58:23.025324 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-3c77c3d5-0eea-4969-b92e-1ebc1389ccc7 req-d288d58c-804d-497c-b526-a4e8f83da944 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:23.030887 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-3c77c3d5-0eea-4969-b92e-1ebc1389ccc7 req-d288d58c-804d-497c-b526-a4e8f83da944 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:23.030887 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-3c77c3d5-0eea-4969-b92e-1ebc1389ccc7 req-d288d58c-804d-497c-b526-a4e8f83da944 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:23.045240 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-3c77c3d5-0eea-4969-b92e-1ebc1389ccc7 req-d288d58c-804d-497c-b526-a4e8f83da944 service nova] Creating event network-vif-plugged:11ca3831-bfbb-4328-9073-14dcd2216de2 for instance 6de16745-5838-4ba1-b987-1e1e4084dd7f on n-h1-861333-8 Oct 19 03:58:23.054004 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-3c77c3d5-0eea-4969-b92e-1ebc1389ccc7 req-d288d58c-804d-497c-b526-a4e8f83da944 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067905 Oct 19 03:58:23.055016 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3387/6764] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:58:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:58:25.549835 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9546e65a-fd45-4dba-8686-e3358f4f8cab tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1908225184", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "41fa7d07-f5eb-4de7-9c08-67821611f5f1"}], "security_groups": [{"name": "tempest-securitygroup--301189737"}], "key_name": "tempest-keypair-1186584213", "user_data": "}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:58:25.679686 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-9546e65a-fd45-4dba-8686-e3358f4f8cab tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] validate_networks() for [('41fa7d07-f5eb-4de7-9c08-67821611f5f1', None, None, None, None, None)] {{(pid=121134) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:58:26.200758 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-9546e65a-fd45-4dba-8686-e3358f4f8cab tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Flavor limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:58:26.201223 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-9546e65a-fd45-4dba-8686-e3358f4f8cab tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Image limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:58:26.201731 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-9546e65a-fd45-4dba-8686-e3358f4f8cab tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Flavor pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:58:26.202179 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-9546e65a-fd45-4dba-8686-e3358f4f8cab tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Image pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:58:26.202726 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-9546e65a-fd45-4dba-8686-e3358f4f8cab tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:58:26.212791 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9546e65a-fd45-4dba-8686-e3358f4f8cab tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:26.215106 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9546e65a-fd45-4dba-8686-e3358f4f8cab tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:26.215106 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9546e65a-fd45-4dba-8686-e3358f4f8cab tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:26.215106 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9546e65a-fd45-4dba-8686-e3358f4f8cab tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:26.215420 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9546e65a-fd45-4dba-8686-e3358f4f8cab tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:26.215679 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9546e65a-fd45-4dba-8686-e3358f4f8cab tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:26.234291 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-9546e65a-fd45-4dba-8686-e3358f4f8cab tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Getting quotas for project ea131e741ef34573aa73360c5010221a. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:58:26.240292 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-9546e65a-fd45-4dba-8686-e3358f4f8cab tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Getting quotas for user 14706e15b5d7487a9b1d1a6332f93f7c and project ea131e741ef34573aa73360c5010221a. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:58:26.254747 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9546e65a-fd45-4dba-8686-e3358f4f8cab tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Going to run 1 instances... {{(pid=121134) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:58:26.257490 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9546e65a-fd45-4dba-8686-e3358f4f8cab tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: 908ca82f-86ba-40c5-95b8-ee0f51588c9b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:58:26.421055 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9546e65a-fd45-4dba-8686-e3358f4f8cab tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.877982 Oct 19 03:58:26.427852 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3388/6765] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:58:25 2022] POST /compute/v2.1/servers => generated 401 bytes in 886 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 03:58:26.433594 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7fff39a2-394b-43d8-aa37-00b38d7267ef tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:58:26.434240 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7fff39a2-394b-43d8-aa37-00b38d7267ef tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: 908ca82f-86ba-40c5-95b8-ee0f51588c9b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:58:26.505285 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-7fff39a2-394b-43d8-aa37-00b38d7267ef tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14706e15b5d7487a9b1d1a6332f93f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea131e741ef34573aa73360c5010221a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:58:26.513385 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7fff39a2-394b-43d8-aa37-00b38d7267ef tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "GET /compute/v2.1/servers/908ca82f-86ba-40c5-95b8-ee0f51588c9b" status: 200 len: 1242 microversion: 2.1 time: 0.084136 Oct 19 03:58:26.514614 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3389/6766] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:58:26 2022] GET /compute/v2.1/servers/908ca82f-86ba-40c5-95b8-ee0f51588c9b => generated 1242 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:58:27.540722 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-09b2fd1c-8ba9-4635-94b3-ca9fb270def9 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:58:27.543964 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-09b2fd1c-8ba9-4635-94b3-ca9fb270def9 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: 908ca82f-86ba-40c5-95b8-ee0f51588c9b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:58:27.555241 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-09b2fd1c-8ba9-4635-94b3-ca9fb270def9 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:27.558055 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-09b2fd1c-8ba9-4635-94b3-ca9fb270def9 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:27.558055 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-09b2fd1c-8ba9-4635-94b3-ca9fb270def9 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:27.558055 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-09b2fd1c-8ba9-4635-94b3-ca9fb270def9 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:27.563213 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-09b2fd1c-8ba9-4635-94b3-ca9fb270def9 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:27.563905 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-09b2fd1c-8ba9-4635-94b3-ca9fb270def9 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:27.639923 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-09b2fd1c-8ba9-4635-94b3-ca9fb270def9 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14706e15b5d7487a9b1d1a6332f93f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea131e741ef34573aa73360c5010221a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:58:27.652280 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-09b2fd1c-8ba9-4635-94b3-ca9fb270def9 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "GET /compute/v2.1/servers/908ca82f-86ba-40c5-95b8-ee0f51588c9b" status: 200 len: 1246 microversion: 2.1 time: 0.119209 Oct 19 03:58:27.654122 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3390/6767] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:58:27 2022] GET /compute/v2.1/servers/908ca82f-86ba-40c5-95b8-ee0f51588c9b => generated 1246 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:58:27.935160 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c3a90eb1-b55a-484b-b8e6-ce592f08b479 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-571026358", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "e9a507f9-fe94-42e8-81e6-e0c611d4e7c9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d55e7db4-c570-4a69-afcb-0fab975a7a7e"}]}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:58:28.003411 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-c3a90eb1-b55a-484b-b8e6-ce592f08b479 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] validate_networks() for [('d55e7db4-c570-4a69-afcb-0fab975a7a7e', None, None, None, None, None)] {{(pid=121134) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:58:28.444105 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-c3a90eb1-b55a-484b-b8e6-ce592f08b479 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Flavor limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:58:28.444637 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-c3a90eb1-b55a-484b-b8e6-ce592f08b479 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Image limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:58:28.445117 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-c3a90eb1-b55a-484b-b8e6-ce592f08b479 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Flavor pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:58:28.445576 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-c3a90eb1-b55a-484b-b8e6-ce592f08b479 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Image pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:58:28.446177 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-c3a90eb1-b55a-484b-b8e6-ce592f08b479 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:58:28.455209 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c3a90eb1-b55a-484b-b8e6-ce592f08b479 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:28.455752 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c3a90eb1-b55a-484b-b8e6-ce592f08b479 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:28.456222 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c3a90eb1-b55a-484b-b8e6-ce592f08b479 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:28.456954 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c3a90eb1-b55a-484b-b8e6-ce592f08b479 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:28.457435 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c3a90eb1-b55a-484b-b8e6-ce592f08b479 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:28.457874 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c3a90eb1-b55a-484b-b8e6-ce592f08b479 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:28.475431 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-c3a90eb1-b55a-484b-b8e6-ce592f08b479 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Getting quotas for project beff434485604f85985617071a93727c. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:58:28.481295 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-c3a90eb1-b55a-484b-b8e6-ce592f08b479 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Getting quotas for user 4d30aa868d79473f9534bd79816c07e3 and project beff434485604f85985617071a93727c. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:58:28.556533 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c3a90eb1-b55a-484b-b8e6-ce592f08b479 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Going to run 1 instances... {{(pid=121134) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:58:28.558678 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c3a90eb1-b55a-484b-b8e6-ce592f08b479 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 9fd381f9-3dd9-482d-b255-3a3f64528c6c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e9a507f9-fe94-42e8-81e6-e0c611d4e7c9',volume_size=None,volume_type=None)] {{(pid=121134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:58:28.962493 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c3a90eb1-b55a-484b-b8e6-ce592f08b479 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.031736 Oct 19 03:58:28.963429 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3391/6768] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:58:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1034 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 19 03:58:28.968683 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-81db8f06-7030-4eaa-abf2-b42cb5b31ae5 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:58:28.969615 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-81db8f06-7030-4eaa-abf2-b42cb5b31ae5 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: 908ca82f-86ba-40c5-95b8-ee0f51588c9b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:58:28.987134 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-81db8f06-7030-4eaa-abf2-b42cb5b31ae5 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:28.990919 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-81db8f06-7030-4eaa-abf2-b42cb5b31ae5 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:28.990919 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-81db8f06-7030-4eaa-abf2-b42cb5b31ae5 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:28.990919 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-81db8f06-7030-4eaa-abf2-b42cb5b31ae5 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:28.990919 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-81db8f06-7030-4eaa-abf2-b42cb5b31ae5 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:28.990919 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-81db8f06-7030-4eaa-abf2-b42cb5b31ae5 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:29.080668 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-81db8f06-7030-4eaa-abf2-b42cb5b31ae5 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14706e15b5d7487a9b1d1a6332f93f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea131e741ef34573aa73360c5010221a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:58:29.100117 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-81db8f06-7030-4eaa-abf2-b42cb5b31ae5 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "GET /compute/v2.1/servers/908ca82f-86ba-40c5-95b8-ee0f51588c9b" status: 200 len: 1312 microversion: 2.1 time: 0.133362 Oct 19 03:58:29.100117 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3392/6769] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:58:28 2022] GET /compute/v2.1/servers/908ca82f-86ba-40c5-95b8-ee0f51588c9b => generated 1312 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:58:29.103324 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1fcb97e5-99a9-446a-9ed1-0dd400674f47 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:58:29.103900 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1fcb97e5-99a9-446a-9ed1-0dd400674f47 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 9fd381f9-3dd9-482d-b255-3a3f64528c6c] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:58:29.159942 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-1fcb97e5-99a9-446a-9ed1-0dd400674f47 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:58:29.167292 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1fcb97e5-99a9-446a-9ed1-0dd400674f47 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/9fd381f9-3dd9-482d-b255-3a3f64528c6c" status: 200 len: 1056 microversion: 2.1 time: 0.067592 Oct 19 03:58:29.167899 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3393/6770] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:58:29 2022] GET /compute/v2.1/servers/9fd381f9-3dd9-482d-b255-3a3f64528c6c => generated 1056 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:58:30.121395 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ee50ba91-e228-41a1-b5cc-4ee9e8895ef8 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:58:30.122028 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ee50ba91-e228-41a1-b5cc-4ee9e8895ef8 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: 908ca82f-86ba-40c5-95b8-ee0f51588c9b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:58:30.130091 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ee50ba91-e228-41a1-b5cc-4ee9e8895ef8 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:30.130592 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ee50ba91-e228-41a1-b5cc-4ee9e8895ef8 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:30.131038 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ee50ba91-e228-41a1-b5cc-4ee9e8895ef8 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:30.131754 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ee50ba91-e228-41a1-b5cc-4ee9e8895ef8 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:30.132216 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ee50ba91-e228-41a1-b5cc-4ee9e8895ef8 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:30.132838 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ee50ba91-e228-41a1-b5cc-4ee9e8895ef8 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:30.260885 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ee50ba91-e228-41a1-b5cc-4ee9e8895ef8 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14706e15b5d7487a9b1d1a6332f93f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea131e741ef34573aa73360c5010221a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:58:30.270183 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ee50ba91-e228-41a1-b5cc-4ee9e8895ef8 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "GET /compute/v2.1/servers/908ca82f-86ba-40c5-95b8-ee0f51588c9b" status: 200 len: 1367 microversion: 2.1 time: 0.152786 Oct 19 03:58:30.281580 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3394/6771] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:58:30 2022] GET /compute/v2.1/servers/908ca82f-86ba-40c5-95b8-ee0f51588c9b => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:58:30.281580 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-cc93c6ba-ba11-4c2d-99ef-1c8993568964 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:58:30.281580 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-cc93c6ba-ba11-4c2d-99ef-1c8993568964 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 9fd381f9-3dd9-482d-b255-3a3f64528c6c] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:58:30.286807 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cc93c6ba-ba11-4c2d-99ef-1c8993568964 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:30.290562 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cc93c6ba-ba11-4c2d-99ef-1c8993568964 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:30.290562 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cc93c6ba-ba11-4c2d-99ef-1c8993568964 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:30.290562 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cc93c6ba-ba11-4c2d-99ef-1c8993568964 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:30.290562 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cc93c6ba-ba11-4c2d-99ef-1c8993568964 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:30.290562 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cc93c6ba-ba11-4c2d-99ef-1c8993568964 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:30.383932 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-cc93c6ba-ba11-4c2d-99ef-1c8993568964 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:58:30.397675 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-cc93c6ba-ba11-4c2d-99ef-1c8993568964 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/9fd381f9-3dd9-482d-b255-3a3f64528c6c" status: 200 len: 1106 microversion: 2.1 time: 0.125395 Oct 19 03:58:30.398541 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3395/6772] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:58:30 2022] GET /compute/v2.1/servers/9fd381f9-3dd9-482d-b255-3a3f64528c6c => generated 1106 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:58:30.680152 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-32d62b42-5a72-4327-b960-7afef0872d5b req-dd7c323e-3217-489c-9a0e-16b9ac9eefe2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "908ca82f-86ba-40c5-95b8-ee0f51588c9b", "tag": "f8bac4df-22bc-4f9f-80d5-5a0ac74800e4"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:58:30.692020 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-32d62b42-5a72-4327-b960-7afef0872d5b req-dd7c323e-3217-489c-9a0e-16b9ac9eefe2 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:30.692504 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-32d62b42-5a72-4327-b960-7afef0872d5b req-dd7c323e-3217-489c-9a0e-16b9ac9eefe2 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:30.693106 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-32d62b42-5a72-4327-b960-7afef0872d5b req-dd7c323e-3217-489c-9a0e-16b9ac9eefe2 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:30.705100 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-32d62b42-5a72-4327-b960-7afef0872d5b req-dd7c323e-3217-489c-9a0e-16b9ac9eefe2 service nova] Creating event network-changed:f8bac4df-22bc-4f9f-80d5-5a0ac74800e4 for instance 908ca82f-86ba-40c5-95b8-ee0f51588c9b on n-h2-861333-8 Oct 19 03:58:30.710067 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-32d62b42-5a72-4327-b960-7afef0872d5b req-dd7c323e-3217-489c-9a0e-16b9ac9eefe2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034108 Oct 19 03:58:30.710677 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3396/6773] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:58:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:58:31.298837 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-54357f90-a410-4d29-bebd-f68050af9449 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:58:31.299548 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-54357f90-a410-4d29-bebd-f68050af9449 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: 908ca82f-86ba-40c5-95b8-ee0f51588c9b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:58:31.306758 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-54357f90-a410-4d29-bebd-f68050af9449 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:31.310625 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-54357f90-a410-4d29-bebd-f68050af9449 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:31.310625 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-54357f90-a410-4d29-bebd-f68050af9449 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:31.310625 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-54357f90-a410-4d29-bebd-f68050af9449 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:31.310625 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-54357f90-a410-4d29-bebd-f68050af9449 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:31.310625 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-54357f90-a410-4d29-bebd-f68050af9449 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:31.523679 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-54357f90-a410-4d29-bebd-f68050af9449 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14706e15b5d7487a9b1d1a6332f93f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea131e741ef34573aa73360c5010221a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:58:31.532216 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-54357f90-a410-4d29-bebd-f68050af9449 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "GET /compute/v2.1/servers/908ca82f-86ba-40c5-95b8-ee0f51588c9b" status: 200 len: 1367 microversion: 2.1 time: 0.237492 Oct 19 03:58:31.532983 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3397/6774] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:58:31 2022] GET /compute/v2.1/servers/908ca82f-86ba-40c5-95b8-ee0f51588c9b => generated 1367 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:58:31.537832 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-69ef6735-5031-4067-8ecf-d6a0b0d0d6fa tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:58:31.538444 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-69ef6735-5031-4067-8ecf-d6a0b0d0d6fa tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 9fd381f9-3dd9-482d-b255-3a3f64528c6c] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:58:31.544549 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-69ef6735-5031-4067-8ecf-d6a0b0d0d6fa tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:31.545616 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-69ef6735-5031-4067-8ecf-d6a0b0d0d6fa tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:31.545616 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-69ef6735-5031-4067-8ecf-d6a0b0d0d6fa tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:31.546357 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-69ef6735-5031-4067-8ecf-d6a0b0d0d6fa tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:31.546814 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-69ef6735-5031-4067-8ecf-d6a0b0d0d6fa tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:31.547240 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-69ef6735-5031-4067-8ecf-d6a0b0d0d6fa tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:31.632841 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-69ef6735-5031-4067-8ecf-d6a0b0d0d6fa tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:58:31.641225 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-69ef6735-5031-4067-8ecf-d6a0b0d0d6fa tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/9fd381f9-3dd9-482d-b255-3a3f64528c6c" status: 200 len: 1162 microversion: 2.1 time: 0.106809 Oct 19 03:58:31.641837 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3398/6775] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:58:31 2022] GET /compute/v2.1/servers/9fd381f9-3dd9-482d-b255-3a3f64528c6c => generated 1162 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:58:32.556383 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-53a8b26d-6fca-4406-992c-a8b4ec806291 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:58:32.558328 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-53a8b26d-6fca-4406-992c-a8b4ec806291 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: 908ca82f-86ba-40c5-95b8-ee0f51588c9b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:58:32.566252 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-53a8b26d-6fca-4406-992c-a8b4ec806291 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:32.567026 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-53a8b26d-6fca-4406-992c-a8b4ec806291 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:32.567629 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-53a8b26d-6fca-4406-992c-a8b4ec806291 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:32.569170 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-53a8b26d-6fca-4406-992c-a8b4ec806291 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:32.569170 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-53a8b26d-6fca-4406-992c-a8b4ec806291 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:32.569904 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-53a8b26d-6fca-4406-992c-a8b4ec806291 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:32.839263 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-53a8b26d-6fca-4406-992c-a8b4ec806291 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14706e15b5d7487a9b1d1a6332f93f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea131e741ef34573aa73360c5010221a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:58:32.851595 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-53a8b26d-6fca-4406-992c-a8b4ec806291 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "GET /compute/v2.1/servers/908ca82f-86ba-40c5-95b8-ee0f51588c9b" status: 200 len: 1367 microversion: 2.1 time: 0.299219 Oct 19 03:58:32.853208 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3399/6776] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:58:32 2022] GET /compute/v2.1/servers/908ca82f-86ba-40c5-95b8-ee0f51588c9b => generated 1367 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:58:32.859282 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-49631f04-cdb6-4f67-8486-64a914ac5388 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:58:32.860189 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-49631f04-cdb6-4f67-8486-64a914ac5388 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 9fd381f9-3dd9-482d-b255-3a3f64528c6c] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:58:32.866923 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-49631f04-cdb6-4f67-8486-64a914ac5388 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:32.867729 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-49631f04-cdb6-4f67-8486-64a914ac5388 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:32.868440 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-49631f04-cdb6-4f67-8486-64a914ac5388 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:32.869453 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-49631f04-cdb6-4f67-8486-64a914ac5388 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:32.870704 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-49631f04-cdb6-4f67-8486-64a914ac5388 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:32.871228 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-49631f04-cdb6-4f67-8486-64a914ac5388 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:33.058917 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-49631f04-cdb6-4f67-8486-64a914ac5388 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:58:33.066778 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-49631f04-cdb6-4f67-8486-64a914ac5388 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/9fd381f9-3dd9-482d-b255-3a3f64528c6c" status: 200 len: 1214 microversion: 2.1 time: 0.212294 Oct 19 03:58:33.067397 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3400/6777] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:58:32 2022] GET /compute/v2.1/servers/9fd381f9-3dd9-482d-b255-3a3f64528c6c => generated 1214 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:58:33.503646 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-a76215c1-5517-42bb-8aa2-c861882d96f3 req-4df1ca25-f8ab-4ed7-8566-cc4e84eb017c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fd381f9-3dd9-482d-b255-3a3f64528c6c", "tag": "b38a0157-84e0-495c-9846-0650d8236f42"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:58:33.514352 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-a76215c1-5517-42bb-8aa2-c861882d96f3 req-4df1ca25-f8ab-4ed7-8566-cc4e84eb017c service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:33.515042 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-a76215c1-5517-42bb-8aa2-c861882d96f3 req-4df1ca25-f8ab-4ed7-8566-cc4e84eb017c service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:33.515576 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-a76215c1-5517-42bb-8aa2-c861882d96f3 req-4df1ca25-f8ab-4ed7-8566-cc4e84eb017c service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:33.528150 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-a76215c1-5517-42bb-8aa2-c861882d96f3 req-4df1ca25-f8ab-4ed7-8566-cc4e84eb017c service nova] Creating event network-changed:b38a0157-84e0-495c-9846-0650d8236f42 for instance 9fd381f9-3dd9-482d-b255-3a3f64528c6c on n-h1-861333-8 Oct 19 03:58:33.533195 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-a76215c1-5517-42bb-8aa2-c861882d96f3 req-4df1ca25-f8ab-4ed7-8566-cc4e84eb017c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035447 Oct 19 03:58:33.534010 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3401/6778] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:58:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:58:33.877539 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-56c59a33-55a3-45d4-a864-92eede171111 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:58:33.878251 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-56c59a33-55a3-45d4-a864-92eede171111 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: 908ca82f-86ba-40c5-95b8-ee0f51588c9b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:58:33.884462 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-56c59a33-55a3-45d4-a864-92eede171111 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:33.884949 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-56c59a33-55a3-45d4-a864-92eede171111 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:33.885917 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-56c59a33-55a3-45d4-a864-92eede171111 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:33.886610 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-56c59a33-55a3-45d4-a864-92eede171111 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:33.887066 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-56c59a33-55a3-45d4-a864-92eede171111 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:33.887494 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-56c59a33-55a3-45d4-a864-92eede171111 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:34.103657 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-56c59a33-55a3-45d4-a864-92eede171111 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14706e15b5d7487a9b1d1a6332f93f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea131e741ef34573aa73360c5010221a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:58:34.112380 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-56c59a33-55a3-45d4-a864-92eede171111 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "GET /compute/v2.1/servers/908ca82f-86ba-40c5-95b8-ee0f51588c9b" status: 200 len: 1367 microversion: 2.1 time: 0.239797 Oct 19 03:58:34.113255 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3402/6779] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:58:33 2022] GET /compute/v2.1/servers/908ca82f-86ba-40c5-95b8-ee0f51588c9b => generated 1367 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:58:34.129403 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-29a3aa83-6235-4d37-b42c-8d9311b7ae2a tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:58:34.130156 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-29a3aa83-6235-4d37-b42c-8d9311b7ae2a tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 9fd381f9-3dd9-482d-b255-3a3f64528c6c] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:58:34.137297 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-29a3aa83-6235-4d37-b42c-8d9311b7ae2a tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:34.137946 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-29a3aa83-6235-4d37-b42c-8d9311b7ae2a tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:34.138474 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-29a3aa83-6235-4d37-b42c-8d9311b7ae2a tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:34.139297 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-29a3aa83-6235-4d37-b42c-8d9311b7ae2a tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:34.139833 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-29a3aa83-6235-4d37-b42c-8d9311b7ae2a tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:34.140339 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-29a3aa83-6235-4d37-b42c-8d9311b7ae2a tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:34.686052 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-29a3aa83-6235-4d37-b42c-8d9311b7ae2a tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:58:34.690173 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=100 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:58:34.695235 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-29a3aa83-6235-4d37-b42c-8d9311b7ae2a tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/9fd381f9-3dd9-482d-b255-3a3f64528c6c" status: 200 len: 1214 microversion: 2.1 time: 0.570228 Oct 19 03:58:34.695943 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3403/6780] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:58:34 2022] GET /compute/v2.1/servers/9fd381f9-3dd9-482d-b255-3a3f64528c6c => generated 1214 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:58:35.136114 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-caec9265-2224-4ccd-93a0-eb5cc3414b2d tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:58:35.136915 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-caec9265-2224-4ccd-93a0-eb5cc3414b2d tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: 908ca82f-86ba-40c5-95b8-ee0f51588c9b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:58:35.144082 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-caec9265-2224-4ccd-93a0-eb5cc3414b2d tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:35.144669 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-caec9265-2224-4ccd-93a0-eb5cc3414b2d tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:35.145187 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-caec9265-2224-4ccd-93a0-eb5cc3414b2d tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:35.146377 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-caec9265-2224-4ccd-93a0-eb5cc3414b2d tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:35.146900 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-caec9265-2224-4ccd-93a0-eb5cc3414b2d tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:35.147340 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-caec9265-2224-4ccd-93a0-eb5cc3414b2d tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:35.283506 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-caec9265-2224-4ccd-93a0-eb5cc3414b2d tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14706e15b5d7487a9b1d1a6332f93f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea131e741ef34573aa73360c5010221a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:58:35.292948 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-caec9265-2224-4ccd-93a0-eb5cc3414b2d tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "GET /compute/v2.1/servers/908ca82f-86ba-40c5-95b8-ee0f51588c9b" status: 200 len: 1367 microversion: 2.1 time: 0.161851 Oct 19 03:58:35.294043 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3404/6781] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:58:35 2022] GET /compute/v2.1/servers/908ca82f-86ba-40c5-95b8-ee0f51588c9b => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:58:35.718690 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4ad2c963-89af-4604-b0b2-78a21a1ac575 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:58:35.719404 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4ad2c963-89af-4604-b0b2-78a21a1ac575 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 9fd381f9-3dd9-482d-b255-3a3f64528c6c] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:58:35.725798 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4ad2c963-89af-4604-b0b2-78a21a1ac575 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:35.726377 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4ad2c963-89af-4604-b0b2-78a21a1ac575 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:35.726878 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4ad2c963-89af-4604-b0b2-78a21a1ac575 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:35.727651 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4ad2c963-89af-4604-b0b2-78a21a1ac575 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:35.728171 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4ad2c963-89af-4604-b0b2-78a21a1ac575 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:35.728671 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4ad2c963-89af-4604-b0b2-78a21a1ac575 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:35.864750 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-4ad2c963-89af-4604-b0b2-78a21a1ac575 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:58:35.873943 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4ad2c963-89af-4604-b0b2-78a21a1ac575 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/9fd381f9-3dd9-482d-b255-3a3f64528c6c" status: 200 len: 1214 microversion: 2.1 time: 0.159350 Oct 19 03:58:35.874581 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3405/6782] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:58:35 2022] GET /compute/v2.1/servers/9fd381f9-3dd9-482d-b255-3a3f64528c6c => generated 1214 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:58:36.316603 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-78f4970b-0a48-423d-9e96-53063be9e458 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:58:36.317250 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-78f4970b-0a48-423d-9e96-53063be9e458 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: 908ca82f-86ba-40c5-95b8-ee0f51588c9b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:58:36.324026 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-78f4970b-0a48-423d-9e96-53063be9e458 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:36.324515 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-78f4970b-0a48-423d-9e96-53063be9e458 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:36.324953 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-78f4970b-0a48-423d-9e96-53063be9e458 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:36.325885 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-78f4970b-0a48-423d-9e96-53063be9e458 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:36.326496 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-78f4970b-0a48-423d-9e96-53063be9e458 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:36.327046 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-78f4970b-0a48-423d-9e96-53063be9e458 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:36.456401 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-78f4970b-0a48-423d-9e96-53063be9e458 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14706e15b5d7487a9b1d1a6332f93f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea131e741ef34573aa73360c5010221a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:58:36.464943 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-78f4970b-0a48-423d-9e96-53063be9e458 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "GET /compute/v2.1/servers/908ca82f-86ba-40c5-95b8-ee0f51588c9b" status: 200 len: 1367 microversion: 2.1 time: 0.152607 Oct 19 03:58:36.465543 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3406/6783] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:58:36 2022] GET /compute/v2.1/servers/908ca82f-86ba-40c5-95b8-ee0f51588c9b => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:58:36.897886 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f67ab5e1-de03-4843-aa71-f32fe5ef3eae tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:58:36.900462 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f67ab5e1-de03-4843-aa71-f32fe5ef3eae tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 9fd381f9-3dd9-482d-b255-3a3f64528c6c] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:58:36.905389 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f67ab5e1-de03-4843-aa71-f32fe5ef3eae tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:36.905898 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f67ab5e1-de03-4843-aa71-f32fe5ef3eae tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:36.906405 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f67ab5e1-de03-4843-aa71-f32fe5ef3eae tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:36.907251 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f67ab5e1-de03-4843-aa71-f32fe5ef3eae tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:36.907713 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f67ab5e1-de03-4843-aa71-f32fe5ef3eae tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:36.908149 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f67ab5e1-de03-4843-aa71-f32fe5ef3eae tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:37.042863 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-f67ab5e1-de03-4843-aa71-f32fe5ef3eae tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:58:37.050811 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f67ab5e1-de03-4843-aa71-f32fe5ef3eae tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/9fd381f9-3dd9-482d-b255-3a3f64528c6c" status: 200 len: 1214 microversion: 2.1 time: 0.157226 Oct 19 03:58:37.051389 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3407/6784] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:58:36 2022] GET /compute/v2.1/servers/9fd381f9-3dd9-482d-b255-3a3f64528c6c => generated 1214 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:58:37.401197 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-2312ff46-432e-4893-8703-06ba2a754509 req-5bd20d25-ffc7-4048-887e-5b5237660dc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "908ca82f-86ba-40c5-95b8-ee0f51588c9b", "name": "network-vif-plugged", "status": "completed", "tag": "f8bac4df-22bc-4f9f-80d5-5a0ac74800e4"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:58:37.411569 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-2312ff46-432e-4893-8703-06ba2a754509 req-5bd20d25-ffc7-4048-887e-5b5237660dc9 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:37.412212 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-2312ff46-432e-4893-8703-06ba2a754509 req-5bd20d25-ffc7-4048-887e-5b5237660dc9 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:37.412652 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-2312ff46-432e-4893-8703-06ba2a754509 req-5bd20d25-ffc7-4048-887e-5b5237660dc9 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:37.423829 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-2312ff46-432e-4893-8703-06ba2a754509 req-5bd20d25-ffc7-4048-887e-5b5237660dc9 service nova] Creating event network-vif-plugged:f8bac4df-22bc-4f9f-80d5-5a0ac74800e4 for instance 908ca82f-86ba-40c5-95b8-ee0f51588c9b on n-h2-861333-8 Oct 19 03:58:37.429228 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-2312ff46-432e-4893-8703-06ba2a754509 req-5bd20d25-ffc7-4048-887e-5b5237660dc9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033038 Oct 19 03:58:37.430930 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3408/6785] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:58:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:58:37.489537 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-fdd2ca52-7a82-4c41-bf47-500a3bf1e2ba tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:58:37.490385 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-fdd2ca52-7a82-4c41-bf47-500a3bf1e2ba tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: 908ca82f-86ba-40c5-95b8-ee0f51588c9b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:58:37.500205 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fdd2ca52-7a82-4c41-bf47-500a3bf1e2ba tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:37.500818 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fdd2ca52-7a82-4c41-bf47-500a3bf1e2ba tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:37.501327 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fdd2ca52-7a82-4c41-bf47-500a3bf1e2ba tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:37.502165 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fdd2ca52-7a82-4c41-bf47-500a3bf1e2ba tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:37.502712 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fdd2ca52-7a82-4c41-bf47-500a3bf1e2ba tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:37.503223 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fdd2ca52-7a82-4c41-bf47-500a3bf1e2ba tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:37.688539 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-fdd2ca52-7a82-4c41-bf47-500a3bf1e2ba tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14706e15b5d7487a9b1d1a6332f93f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea131e741ef34573aa73360c5010221a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:58:37.696287 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-fdd2ca52-7a82-4c41-bf47-500a3bf1e2ba tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "GET /compute/v2.1/servers/908ca82f-86ba-40c5-95b8-ee0f51588c9b" status: 200 len: 1367 microversion: 2.1 time: 0.211856 Oct 19 03:58:37.697106 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3409/6786] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:58:37 2022] GET /compute/v2.1/servers/908ca82f-86ba-40c5-95b8-ee0f51588c9b => generated 1367 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:58:38.073940 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-75930b49-4867-42a6-bab0-01ee6066337e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:58:38.074569 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-75930b49-4867-42a6-bab0-01ee6066337e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 9fd381f9-3dd9-482d-b255-3a3f64528c6c] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:58:38.080578 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-75930b49-4867-42a6-bab0-01ee6066337e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:38.081070 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-75930b49-4867-42a6-bab0-01ee6066337e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:38.081561 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-75930b49-4867-42a6-bab0-01ee6066337e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:38.082261 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-75930b49-4867-42a6-bab0-01ee6066337e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:38.082724 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-75930b49-4867-42a6-bab0-01ee6066337e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:38.083158 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-75930b49-4867-42a6-bab0-01ee6066337e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:38.209418 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-75930b49-4867-42a6-bab0-01ee6066337e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:58:38.218006 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-75930b49-4867-42a6-bab0-01ee6066337e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/9fd381f9-3dd9-482d-b255-3a3f64528c6c" status: 200 len: 1202 microversion: 2.1 time: 0.148221 Oct 19 03:58:38.218592 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3410/6787] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:58:38 2022] GET /compute/v2.1/servers/9fd381f9-3dd9-482d-b255-3a3f64528c6c => generated 1202 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:58:38.719383 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ab1361ef-43db-4488-a0f9-50dd1aeeb444 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:58:38.720066 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ab1361ef-43db-4488-a0f9-50dd1aeeb444 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: 908ca82f-86ba-40c5-95b8-ee0f51588c9b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:58:38.722483 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=4 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:58:38.727326 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ab1361ef-43db-4488-a0f9-50dd1aeeb444 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:38.727819 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ab1361ef-43db-4488-a0f9-50dd1aeeb444 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:38.728260 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ab1361ef-43db-4488-a0f9-50dd1aeeb444 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:38.728968 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ab1361ef-43db-4488-a0f9-50dd1aeeb444 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:38.729460 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ab1361ef-43db-4488-a0f9-50dd1aeeb444 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:38.729895 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ab1361ef-43db-4488-a0f9-50dd1aeeb444 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:38.866067 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ab1361ef-43db-4488-a0f9-50dd1aeeb444 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14706e15b5d7487a9b1d1a6332f93f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea131e741ef34573aa73360c5010221a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:58:38.874519 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ab1361ef-43db-4488-a0f9-50dd1aeeb444 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "GET /compute/v2.1/servers/908ca82f-86ba-40c5-95b8-ee0f51588c9b" status: 200 len: 1367 microversion: 2.1 time: 0.159091 Oct 19 03:58:38.875289 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3411/6788] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:58:38 2022] GET /compute/v2.1/servers/908ca82f-86ba-40c5-95b8-ee0f51588c9b => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:58:39.242100 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e0d02078-dbae-4165-8014-b6f8cd021c7c tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:58:39.242718 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e0d02078-dbae-4165-8014-b6f8cd021c7c tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 9fd381f9-3dd9-482d-b255-3a3f64528c6c] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:58:39.245704 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=20 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:58:39.250529 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e0d02078-dbae-4165-8014-b6f8cd021c7c tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:39.251017 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e0d02078-dbae-4165-8014-b6f8cd021c7c tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:39.251457 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e0d02078-dbae-4165-8014-b6f8cd021c7c tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:39.252146 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e0d02078-dbae-4165-8014-b6f8cd021c7c tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:39.252599 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e0d02078-dbae-4165-8014-b6f8cd021c7c tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:39.253024 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e0d02078-dbae-4165-8014-b6f8cd021c7c tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:39.380176 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e0d02078-dbae-4165-8014-b6f8cd021c7c tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:58:39.388016 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e0d02078-dbae-4165-8014-b6f8cd021c7c tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/9fd381f9-3dd9-482d-b255-3a3f64528c6c" status: 200 len: 1202 microversion: 2.1 time: 0.149799 Oct 19 03:58:39.388795 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3412/6789] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:58:39 2022] GET /compute/v2.1/servers/9fd381f9-3dd9-482d-b255-3a3f64528c6c => generated 1202 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:58:39.897607 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-eaa46cfb-f75d-4bf2-b6c2-d91e6e8da303 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:58:39.898222 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-eaa46cfb-f75d-4bf2-b6c2-d91e6e8da303 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: 908ca82f-86ba-40c5-95b8-ee0f51588c9b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:58:39.905342 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eaa46cfb-f75d-4bf2-b6c2-d91e6e8da303 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:39.905871 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eaa46cfb-f75d-4bf2-b6c2-d91e6e8da303 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:39.906317 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eaa46cfb-f75d-4bf2-b6c2-d91e6e8da303 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:39.907018 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eaa46cfb-f75d-4bf2-b6c2-d91e6e8da303 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:39.907475 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eaa46cfb-f75d-4bf2-b6c2-d91e6e8da303 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:39.907908 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eaa46cfb-f75d-4bf2-b6c2-d91e6e8da303 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:40.035239 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-eaa46cfb-f75d-4bf2-b6c2-d91e6e8da303 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14706e15b5d7487a9b1d1a6332f93f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea131e741ef34573aa73360c5010221a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:58:40.043404 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-eaa46cfb-f75d-4bf2-b6c2-d91e6e8da303 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "GET /compute/v2.1/servers/908ca82f-86ba-40c5-95b8-ee0f51588c9b" status: 200 len: 1557 microversion: 2.1 time: 0.149939 Oct 19 03:58:40.043984 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3413/6790] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:58:39 2022] GET /compute/v2.1/servers/908ca82f-86ba-40c5-95b8-ee0f51588c9b => generated 1557 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:58:40.065299 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3a63a683-c456-420e-aeb3-40995f367471 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:58:40.065889 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3a63a683-c456-420e-aeb3-40995f367471 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: 908ca82f-86ba-40c5-95b8-ee0f51588c9b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:58:40.071720 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3a63a683-c456-420e-aeb3-40995f367471 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:40.076781 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3a63a683-c456-420e-aeb3-40995f367471 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:40.076781 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3a63a683-c456-420e-aeb3-40995f367471 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:40.076781 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3a63a683-c456-420e-aeb3-40995f367471 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:40.076781 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3a63a683-c456-420e-aeb3-40995f367471 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:40.076781 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3a63a683-c456-420e-aeb3-40995f367471 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:40.155568 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3a63a683-c456-420e-aeb3-40995f367471 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "GET /compute/v2.1/servers/908ca82f-86ba-40c5-95b8-ee0f51588c9b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093884 Oct 19 03:58:40.156192 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3414/6791] 10.222.0.52 () {58 vars in 1275 bytes} [Wed Oct 19 03:58:40 2022] GET /compute/v2.1/servers/908ca82f-86ba-40c5-95b8-ee0f51588c9b/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:58:40.412136 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-abe9290e-aba2-4c03-afaa-8aa1d32080f4 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:58:40.412762 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-abe9290e-aba2-4c03-afaa-8aa1d32080f4 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 9fd381f9-3dd9-482d-b255-3a3f64528c6c] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:58:40.418792 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-abe9290e-aba2-4c03-afaa-8aa1d32080f4 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:40.419286 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-abe9290e-aba2-4c03-afaa-8aa1d32080f4 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:40.419726 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-abe9290e-aba2-4c03-afaa-8aa1d32080f4 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:40.420429 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-abe9290e-aba2-4c03-afaa-8aa1d32080f4 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:40.421107 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-abe9290e-aba2-4c03-afaa-8aa1d32080f4 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:40.421307 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-abe9290e-aba2-4c03-afaa-8aa1d32080f4 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:40.657768 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-abe9290e-aba2-4c03-afaa-8aa1d32080f4 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:58:40.665754 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-abe9290e-aba2-4c03-afaa-8aa1d32080f4 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/9fd381f9-3dd9-482d-b255-3a3f64528c6c" status: 200 len: 1202 microversion: 2.1 time: 0.258078 Oct 19 03:58:40.669540 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3415/6792] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:58:40 2022] GET /compute/v2.1/servers/9fd381f9-3dd9-482d-b255-3a3f64528c6c => generated 1202 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:58:41.240528 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-6e642396-0a1d-47df-9dd0-2a49ece3fd5d req-b8c6a0f0-2668-4b8e-a63a-1f36b812d1c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "908ca82f-86ba-40c5-95b8-ee0f51588c9b", "tag": "f8bac4df-22bc-4f9f-80d5-5a0ac74800e4"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:58:41.250461 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-6e642396-0a1d-47df-9dd0-2a49ece3fd5d req-b8c6a0f0-2668-4b8e-a63a-1f36b812d1c6 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:41.251025 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-6e642396-0a1d-47df-9dd0-2a49ece3fd5d req-b8c6a0f0-2668-4b8e-a63a-1f36b812d1c6 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:41.251532 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-6e642396-0a1d-47df-9dd0-2a49ece3fd5d req-b8c6a0f0-2668-4b8e-a63a-1f36b812d1c6 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:41.263223 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-6e642396-0a1d-47df-9dd0-2a49ece3fd5d req-b8c6a0f0-2668-4b8e-a63a-1f36b812d1c6 service nova] Creating event network-changed:f8bac4df-22bc-4f9f-80d5-5a0ac74800e4 for instance 908ca82f-86ba-40c5-95b8-ee0f51588c9b on n-h2-861333-8 Oct 19 03:58:41.268261 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-6e642396-0a1d-47df-9dd0-2a49ece3fd5d req-b8c6a0f0-2668-4b8e-a63a-1f36b812d1c6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031450 Oct 19 03:58:41.268815 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3416/6793] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:58:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:58:41.691121 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-72c20d27-fa30-46ee-9c6a-daa754e564e5 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:58:41.692003 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-72c20d27-fa30-46ee-9c6a-daa754e564e5 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 9fd381f9-3dd9-482d-b255-3a3f64528c6c] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:58:41.699069 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-72c20d27-fa30-46ee-9c6a-daa754e564e5 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:41.699648 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-72c20d27-fa30-46ee-9c6a-daa754e564e5 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:41.700095 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-72c20d27-fa30-46ee-9c6a-daa754e564e5 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:41.700831 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-72c20d27-fa30-46ee-9c6a-daa754e564e5 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:41.701324 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-72c20d27-fa30-46ee-9c6a-daa754e564e5 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:41.701795 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-72c20d27-fa30-46ee-9c6a-daa754e564e5 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:41.877658 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-72c20d27-fa30-46ee-9c6a-daa754e564e5 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:58:41.886485 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-72c20d27-fa30-46ee-9c6a-daa754e564e5 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/9fd381f9-3dd9-482d-b255-3a3f64528c6c" status: 200 len: 1202 microversion: 2.1 time: 0.200918 Oct 19 03:58:41.887068 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3417/6794] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:58:41 2022] GET /compute/v2.1/servers/9fd381f9-3dd9-482d-b255-3a3f64528c6c => generated 1202 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:58:42.910743 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a85071df-46b3-49be-9ed2-20aeea164b35 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:58:42.911404 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a85071df-46b3-49be-9ed2-20aeea164b35 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 9fd381f9-3dd9-482d-b255-3a3f64528c6c] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:58:42.918365 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a85071df-46b3-49be-9ed2-20aeea164b35 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:42.918874 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a85071df-46b3-49be-9ed2-20aeea164b35 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:42.922271 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a85071df-46b3-49be-9ed2-20aeea164b35 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:42.922271 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a85071df-46b3-49be-9ed2-20aeea164b35 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:42.922271 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a85071df-46b3-49be-9ed2-20aeea164b35 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:42.922271 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a85071df-46b3-49be-9ed2-20aeea164b35 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:43.056488 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a85071df-46b3-49be-9ed2-20aeea164b35 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:58:43.064142 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a85071df-46b3-49be-9ed2-20aeea164b35 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/9fd381f9-3dd9-482d-b255-3a3f64528c6c" status: 200 len: 1202 microversion: 2.1 time: 0.158000 Oct 19 03:58:43.064744 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3418/6795] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:58:42 2022] GET /compute/v2.1/servers/9fd381f9-3dd9-482d-b255-3a3f64528c6c => generated 1202 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:58:44.087657 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2b23374e-c38b-4493-a8a5-9ce9e68ed4d6 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:58:44.088859 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2b23374e-c38b-4493-a8a5-9ce9e68ed4d6 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 9fd381f9-3dd9-482d-b255-3a3f64528c6c] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:58:44.092935 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:58:44.096313 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2b23374e-c38b-4493-a8a5-9ce9e68ed4d6 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:44.096801 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2b23374e-c38b-4493-a8a5-9ce9e68ed4d6 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:44.097241 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2b23374e-c38b-4493-a8a5-9ce9e68ed4d6 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:44.097960 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2b23374e-c38b-4493-a8a5-9ce9e68ed4d6 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:44.098416 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2b23374e-c38b-4493-a8a5-9ce9e68ed4d6 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:44.098842 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2b23374e-c38b-4493-a8a5-9ce9e68ed4d6 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:44.228332 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-2b23374e-c38b-4493-a8a5-9ce9e68ed4d6 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:58:44.236655 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2b23374e-c38b-4493-a8a5-9ce9e68ed4d6 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/9fd381f9-3dd9-482d-b255-3a3f64528c6c" status: 200 len: 1202 microversion: 2.1 time: 0.152911 Oct 19 03:58:44.237262 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3419/6796] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:58:44 2022] GET /compute/v2.1/servers/9fd381f9-3dd9-482d-b255-3a3f64528c6c => generated 1202 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:58:45.259221 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a1d3e47d-5a8e-4318-83e7-bab3f96a1c4a tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:58:45.259875 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a1d3e47d-5a8e-4318-83e7-bab3f96a1c4a tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 9fd381f9-3dd9-482d-b255-3a3f64528c6c] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:58:45.266602 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a1d3e47d-5a8e-4318-83e7-bab3f96a1c4a tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:45.267086 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a1d3e47d-5a8e-4318-83e7-bab3f96a1c4a tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:45.267557 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a1d3e47d-5a8e-4318-83e7-bab3f96a1c4a tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:45.268245 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a1d3e47d-5a8e-4318-83e7-bab3f96a1c4a tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:45.268696 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a1d3e47d-5a8e-4318-83e7-bab3f96a1c4a tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:45.269123 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a1d3e47d-5a8e-4318-83e7-bab3f96a1c4a tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:45.399069 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a1d3e47d-5a8e-4318-83e7-bab3f96a1c4a tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:58:45.407319 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a1d3e47d-5a8e-4318-83e7-bab3f96a1c4a tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/9fd381f9-3dd9-482d-b255-3a3f64528c6c" status: 200 len: 1202 microversion: 2.1 time: 0.152078 Oct 19 03:58:45.407893 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3420/6797] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:58:45 2022] GET /compute/v2.1/servers/9fd381f9-3dd9-482d-b255-3a3f64528c6c => generated 1202 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:58:46.430787 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7845b589-17eb-4aa9-9bef-369d2c6f2792 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:58:46.431473 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7845b589-17eb-4aa9-9bef-369d2c6f2792 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 9fd381f9-3dd9-482d-b255-3a3f64528c6c] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:58:46.439002 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7845b589-17eb-4aa9-9bef-369d2c6f2792 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:46.439576 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7845b589-17eb-4aa9-9bef-369d2c6f2792 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:46.439939 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7845b589-17eb-4aa9-9bef-369d2c6f2792 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:46.440655 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7845b589-17eb-4aa9-9bef-369d2c6f2792 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:46.441120 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7845b589-17eb-4aa9-9bef-369d2c6f2792 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:46.441621 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7845b589-17eb-4aa9-9bef-369d2c6f2792 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:46.645235 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-7845b589-17eb-4aa9-9bef-369d2c6f2792 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:58:46.653286 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7845b589-17eb-4aa9-9bef-369d2c6f2792 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/9fd381f9-3dd9-482d-b255-3a3f64528c6c" status: 200 len: 1202 microversion: 2.1 time: 0.226568 Oct 19 03:58:46.653892 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3421/6798] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:58:46 2022] GET /compute/v2.1/servers/9fd381f9-3dd9-482d-b255-3a3f64528c6c => generated 1202 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:58:47.677099 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6dcd7ae7-4f9a-4208-8191-2708ffdb752a tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:58:47.677768 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6dcd7ae7-4f9a-4208-8191-2708ffdb752a tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 9fd381f9-3dd9-482d-b255-3a3f64528c6c] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:58:47.684596 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6dcd7ae7-4f9a-4208-8191-2708ffdb752a tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:47.685086 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6dcd7ae7-4f9a-4208-8191-2708ffdb752a tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:47.685568 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6dcd7ae7-4f9a-4208-8191-2708ffdb752a tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:47.686290 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6dcd7ae7-4f9a-4208-8191-2708ffdb752a tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:47.686754 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6dcd7ae7-4f9a-4208-8191-2708ffdb752a tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:47.687188 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6dcd7ae7-4f9a-4208-8191-2708ffdb752a tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:47.691095 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=100 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:58:47.815606 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-6dcd7ae7-4f9a-4208-8191-2708ffdb752a tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:58:47.823258 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6dcd7ae7-4f9a-4208-8191-2708ffdb752a tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/9fd381f9-3dd9-482d-b255-3a3f64528c6c" status: 200 len: 1202 microversion: 2.1 time: 0.150082 Oct 19 03:58:47.823840 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3422/6799] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:58:47 2022] GET /compute/v2.1/servers/9fd381f9-3dd9-482d-b255-3a3f64528c6c => generated 1202 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:58:48.845771 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a3619fa5-c662-40ef-afdb-c0f2a0e89ddc tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:58:48.846402 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a3619fa5-c662-40ef-afdb-c0f2a0e89ddc tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 9fd381f9-3dd9-482d-b255-3a3f64528c6c] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:58:48.853242 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a3619fa5-c662-40ef-afdb-c0f2a0e89ddc tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:48.854678 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a3619fa5-c662-40ef-afdb-c0f2a0e89ddc tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:48.855135 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a3619fa5-c662-40ef-afdb-c0f2a0e89ddc tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:48.856368 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a3619fa5-c662-40ef-afdb-c0f2a0e89ddc tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:48.856837 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a3619fa5-c662-40ef-afdb-c0f2a0e89ddc tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:48.857296 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a3619fa5-c662-40ef-afdb-c0f2a0e89ddc tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:48.987602 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a3619fa5-c662-40ef-afdb-c0f2a0e89ddc tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:58:48.995641 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a3619fa5-c662-40ef-afdb-c0f2a0e89ddc tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/9fd381f9-3dd9-482d-b255-3a3f64528c6c" status: 200 len: 1202 microversion: 2.1 time: 0.153796 Oct 19 03:58:48.996253 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3423/6800] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:58:48 2022] GET /compute/v2.1/servers/9fd381f9-3dd9-482d-b255-3a3f64528c6c => generated 1202 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:58:49.001622 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-128a4f95-932c-44be-b871-334399c445e1 req-f9343112-21e8-43f1-820e-2e1afabe354a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fd381f9-3dd9-482d-b255-3a3f64528c6c", "name": "network-vif-plugged", "status": "completed", "tag": "b38a0157-84e0-495c-9846-0650d8236f42"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:58:49.010580 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-128a4f95-932c-44be-b871-334399c445e1 req-f9343112-21e8-43f1-820e-2e1afabe354a service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:49.011061 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-128a4f95-932c-44be-b871-334399c445e1 req-f9343112-21e8-43f1-820e-2e1afabe354a service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:49.011490 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-128a4f95-932c-44be-b871-334399c445e1 req-f9343112-21e8-43f1-820e-2e1afabe354a service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:49.022643 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-128a4f95-932c-44be-b871-334399c445e1 req-f9343112-21e8-43f1-820e-2e1afabe354a service nova] Creating event network-vif-plugged:b38a0157-84e0-495c-9846-0650d8236f42 for instance 9fd381f9-3dd9-482d-b255-3a3f64528c6c on n-h1-861333-8 Oct 19 03:58:49.027687 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-128a4f95-932c-44be-b871-334399c445e1 req-f9343112-21e8-43f1-820e-2e1afabe354a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030123 Oct 19 03:58:49.028277 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3424/6801] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:58:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:58:50.019663 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3a84e6e9-b452-4e50-b5f3-5aa969c8cb44 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:58:50.020498 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3a84e6e9-b452-4e50-b5f3-5aa969c8cb44 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 9fd381f9-3dd9-482d-b255-3a3f64528c6c] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:58:50.028458 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3a84e6e9-b452-4e50-b5f3-5aa969c8cb44 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:50.028950 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3a84e6e9-b452-4e50-b5f3-5aa969c8cb44 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:50.029414 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3a84e6e9-b452-4e50-b5f3-5aa969c8cb44 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:50.030117 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3a84e6e9-b452-4e50-b5f3-5aa969c8cb44 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:50.030582 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3a84e6e9-b452-4e50-b5f3-5aa969c8cb44 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:50.031014 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3a84e6e9-b452-4e50-b5f3-5aa969c8cb44 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:50.161533 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-3a84e6e9-b452-4e50-b5f3-5aa969c8cb44 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:58:50.169966 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3a84e6e9-b452-4e50-b5f3-5aa969c8cb44 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/9fd381f9-3dd9-482d-b255-3a3f64528c6c" status: 200 len: 1202 microversion: 2.1 time: 0.154513 Oct 19 03:58:50.170537 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3425/6802] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:58:50 2022] GET /compute/v2.1/servers/9fd381f9-3dd9-482d-b255-3a3f64528c6c => generated 1202 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:58:51.192742 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7531a387-c3a7-435c-8c11-0e4d0a4a5d9c tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:58:51.193425 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7531a387-c3a7-435c-8c11-0e4d0a4a5d9c tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 9fd381f9-3dd9-482d-b255-3a3f64528c6c] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:58:51.200307 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7531a387-c3a7-435c-8c11-0e4d0a4a5d9c tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:51.200800 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7531a387-c3a7-435c-8c11-0e4d0a4a5d9c tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:51.201244 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7531a387-c3a7-435c-8c11-0e4d0a4a5d9c tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:51.201972 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7531a387-c3a7-435c-8c11-0e4d0a4a5d9c tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:51.202433 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7531a387-c3a7-435c-8c11-0e4d0a4a5d9c tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:51.202868 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7531a387-c3a7-435c-8c11-0e4d0a4a5d9c tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:51.330674 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-7531a387-c3a7-435c-8c11-0e4d0a4a5d9c tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:58:51.338543 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7531a387-c3a7-435c-8c11-0e4d0a4a5d9c tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/9fd381f9-3dd9-482d-b255-3a3f64528c6c" status: 200 len: 1389 microversion: 2.1 time: 0.149679 Oct 19 03:58:51.339129 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3426/6803] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:58:51 2022] GET /compute/v2.1/servers/9fd381f9-3dd9-482d-b255-3a3f64528c6c => generated 1389 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:58:51.362094 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-412354c2-9010-4353-bb26-70f2c0065cdc tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:58:51.362714 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-412354c2-9010-4353-bb26-70f2c0065cdc tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 9fd381f9-3dd9-482d-b255-3a3f64528c6c] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:58:51.368598 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-412354c2-9010-4353-bb26-70f2c0065cdc tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:51.369089 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-412354c2-9010-4353-bb26-70f2c0065cdc tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:51.369562 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-412354c2-9010-4353-bb26-70f2c0065cdc tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:51.370260 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-412354c2-9010-4353-bb26-70f2c0065cdc tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:51.370718 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-412354c2-9010-4353-bb26-70f2c0065cdc tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:51.371147 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-412354c2-9010-4353-bb26-70f2c0065cdc tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:51.501168 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-412354c2-9010-4353-bb26-70f2c0065cdc tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:58:51.508865 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-412354c2-9010-4353-bb26-70f2c0065cdc tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/9fd381f9-3dd9-482d-b255-3a3f64528c6c" status: 200 len: 1389 microversion: 2.1 time: 0.150502 Oct 19 03:58:51.509467 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3427/6804] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:58:51 2022] GET /compute/v2.1/servers/9fd381f9-3dd9-482d-b255-3a3f64528c6c => generated 1389 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:58:51.530843 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f080d1e8-de4a-4d6b-b597-b583e5cf18de tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:58:51.531565 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f080d1e8-de4a-4d6b-b597-b583e5cf18de tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 9fd381f9-3dd9-482d-b255-3a3f64528c6c] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:58:51.537523 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f080d1e8-de4a-4d6b-b597-b583e5cf18de tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:51.538011 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f080d1e8-de4a-4d6b-b597-b583e5cf18de tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:51.538456 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f080d1e8-de4a-4d6b-b597-b583e5cf18de tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:51.539153 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f080d1e8-de4a-4d6b-b597-b583e5cf18de tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:51.539610 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f080d1e8-de4a-4d6b-b597-b583e5cf18de tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:51.540041 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f080d1e8-de4a-4d6b-b597-b583e5cf18de tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:51.664860 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-f080d1e8-de4a-4d6b-b597-b583e5cf18de tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:58:51.673435 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f080d1e8-de4a-4d6b-b597-b583e5cf18de tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/9fd381f9-3dd9-482d-b255-3a3f64528c6c" status: 200 len: 1389 microversion: 2.1 time: 0.146724 Oct 19 03:58:51.674023 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3428/6805] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:58:51 2022] GET /compute/v2.1/servers/9fd381f9-3dd9-482d-b255-3a3f64528c6c => generated 1389 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:58:51.694629 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ca0036b7-ecee-4484-8ccb-b536be08b44b tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:58:51.695131 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ca0036b7-ecee-4484-8ccb-b536be08b44b tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 9fd381f9-3dd9-482d-b255-3a3f64528c6c] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:58:51.701030 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ca0036b7-ecee-4484-8ccb-b536be08b44b tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:51.701554 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ca0036b7-ecee-4484-8ccb-b536be08b44b tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:51.702002 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ca0036b7-ecee-4484-8ccb-b536be08b44b tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:51.702695 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ca0036b7-ecee-4484-8ccb-b536be08b44b tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:51.703157 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ca0036b7-ecee-4484-8ccb-b536be08b44b tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:51.703592 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ca0036b7-ecee-4484-8ccb-b536be08b44b tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:51.727739 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ca0036b7-ecee-4484-8ccb-b536be08b44b tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 9fd381f9-3dd9-482d-b255-3a3f64528c6c] Going to try to terminate instance {{(pid=121134) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:58:52.013316 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ca0036b7-ecee-4484-8ccb-b536be08b44b tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "DELETE /compute/v2.1/servers/9fd381f9-3dd9-482d-b255-3a3f64528c6c" status: 204 len: 0 microversion: 2.1 time: 0.321781 Oct 19 03:58:52.013879 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3429/6806] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:58:51 2022] DELETE /compute/v2.1/servers/9fd381f9-3dd9-482d-b255-3a3f64528c6c => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 19 03:58:52.022687 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8210e4d4-226c-458a-8628-6a5254830eee tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:58:52.025836 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8210e4d4-226c-458a-8628-6a5254830eee tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 9fd381f9-3dd9-482d-b255-3a3f64528c6c] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:58:52.030218 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8210e4d4-226c-458a-8628-6a5254830eee tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:52.030756 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8210e4d4-226c-458a-8628-6a5254830eee tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:52.031199 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8210e4d4-226c-458a-8628-6a5254830eee tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:52.031894 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8210e4d4-226c-458a-8628-6a5254830eee tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:52.032364 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8210e4d4-226c-458a-8628-6a5254830eee tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:52.032801 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8210e4d4-226c-458a-8628-6a5254830eee tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:52.163039 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8210e4d4-226c-458a-8628-6a5254830eee tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:58:52.170763 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8210e4d4-226c-458a-8628-6a5254830eee tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/9fd381f9-3dd9-482d-b255-3a3f64528c6c" status: 200 len: 1395 microversion: 2.1 time: 0.152521 Oct 19 03:58:52.171362 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3430/6807] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:58:52 2022] GET /compute/v2.1/servers/9fd381f9-3dd9-482d-b255-3a3f64528c6c => generated 1395 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:58:53.194118 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-88ff9bee-dfdd-4711-b3a4-fffe1372790a tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:58:53.194749 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-88ff9bee-dfdd-4711-b3a4-fffe1372790a tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 9fd381f9-3dd9-482d-b255-3a3f64528c6c] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:58:53.201795 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-88ff9bee-dfdd-4711-b3a4-fffe1372790a tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:53.202289 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-88ff9bee-dfdd-4711-b3a4-fffe1372790a tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:53.202735 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-88ff9bee-dfdd-4711-b3a4-fffe1372790a tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:53.203438 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-88ff9bee-dfdd-4711-b3a4-fffe1372790a tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:53.203932 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-88ff9bee-dfdd-4711-b3a4-fffe1372790a tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:53.204365 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-88ff9bee-dfdd-4711-b3a4-fffe1372790a tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:53.333961 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-88ff9bee-dfdd-4711-b3a4-fffe1372790a tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:58:53.342731 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-88ff9bee-dfdd-4711-b3a4-fffe1372790a tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/9fd381f9-3dd9-482d-b255-3a3f64528c6c" status: 200 len: 1395 microversion: 2.1 time: 0.152469 Oct 19 03:58:53.343312 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3431/6808] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:58:53 2022] GET /compute/v2.1/servers/9fd381f9-3dd9-482d-b255-3a3f64528c6c => generated 1395 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:58:54.326400 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-bb4b5ee4-f765-4811-9030-ef5e86a467a8 req-198d3f78-ac3b-4bb6-9b66-f65b8444bbe4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fd381f9-3dd9-482d-b255-3a3f64528c6c", "name": "network-vif-deleted", "tag": "b38a0157-84e0-495c-9846-0650d8236f42"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:58:54.337336 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-bb4b5ee4-f765-4811-9030-ef5e86a467a8 req-198d3f78-ac3b-4bb6-9b66-f65b8444bbe4 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:54.337876 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-bb4b5ee4-f765-4811-9030-ef5e86a467a8 req-198d3f78-ac3b-4bb6-9b66-f65b8444bbe4 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:54.338306 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-bb4b5ee4-f765-4811-9030-ef5e86a467a8 req-198d3f78-ac3b-4bb6-9b66-f65b8444bbe4 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:54.351138 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-bb4b5ee4-f765-4811-9030-ef5e86a467a8 req-198d3f78-ac3b-4bb6-9b66-f65b8444bbe4 service nova] Creating event network-vif-deleted:b38a0157-84e0-495c-9846-0650d8236f42 for instance 9fd381f9-3dd9-482d-b255-3a3f64528c6c on n-h1-861333-8 Oct 19 03:58:54.356890 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-bb4b5ee4-f765-4811-9030-ef5e86a467a8 req-198d3f78-ac3b-4bb6-9b66-f65b8444bbe4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034202 Oct 19 03:58:54.357796 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3432/6809] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:58:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:58:54.365805 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-609dd53d-71ba-4a0a-b260-c868ac70b320 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:58:54.366523 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-609dd53d-71ba-4a0a-b260-c868ac70b320 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 9fd381f9-3dd9-482d-b255-3a3f64528c6c] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:58:54.373615 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-609dd53d-71ba-4a0a-b260-c868ac70b320 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:54.374143 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-609dd53d-71ba-4a0a-b260-c868ac70b320 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:54.374601 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-609dd53d-71ba-4a0a-b260-c868ac70b320 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:54.375339 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-609dd53d-71ba-4a0a-b260-c868ac70b320 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:54.375811 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-609dd53d-71ba-4a0a-b260-c868ac70b320 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:54.376244 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-609dd53d-71ba-4a0a-b260-c868ac70b320 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:54.452459 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-609dd53d-71ba-4a0a-b260-c868ac70b320 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:58:54.466860 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-609dd53d-71ba-4a0a-b260-c868ac70b320 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/9fd381f9-3dd9-482d-b255-3a3f64528c6c" status: 200 len: 1353 microversion: 2.1 time: 0.102888 Oct 19 03:58:54.466860 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3433/6810] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:58:54 2022] GET /compute/v2.1/servers/9fd381f9-3dd9-482d-b255-3a3f64528c6c => generated 1353 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:58:55.487979 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-dab6ffff-5651-4e86-980f-8fdf1832df58 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:58:55.488617 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-dab6ffff-5651-4e86-980f-8fdf1832df58 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 9fd381f9-3dd9-482d-b255-3a3f64528c6c] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:58:55.495504 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dab6ffff-5651-4e86-980f-8fdf1832df58 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:55.495993 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dab6ffff-5651-4e86-980f-8fdf1832df58 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:55.496434 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dab6ffff-5651-4e86-980f-8fdf1832df58 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:55.497133 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dab6ffff-5651-4e86-980f-8fdf1832df58 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:55.497617 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dab6ffff-5651-4e86-980f-8fdf1832df58 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:55.498049 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dab6ffff-5651-4e86-980f-8fdf1832df58 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:55.560418 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-dab6ffff-5651-4e86-980f-8fdf1832df58 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:58:55.568543 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-dab6ffff-5651-4e86-980f-8fdf1832df58 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/9fd381f9-3dd9-482d-b255-3a3f64528c6c" status: 200 len: 1187 microversion: 2.1 time: 0.084522 Oct 19 03:58:55.569184 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3434/6811] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:58:55 2022] GET /compute/v2.1/servers/9fd381f9-3dd9-482d-b255-3a3f64528c6c => generated 1187 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:58:56.592991 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a426f357-9d44-4ca0-a916-3674170e823d tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:58:56.593692 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a426f357-9d44-4ca0-a916-3674170e823d tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 9fd381f9-3dd9-482d-b255-3a3f64528c6c] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:58:56.601170 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a426f357-9d44-4ca0-a916-3674170e823d tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:56.601707 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a426f357-9d44-4ca0-a916-3674170e823d tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:56.602156 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a426f357-9d44-4ca0-a916-3674170e823d tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:56.602867 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a426f357-9d44-4ca0-a916-3674170e823d tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:56.603350 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a426f357-9d44-4ca0-a916-3674170e823d tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:56.603770 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a426f357-9d44-4ca0-a916-3674170e823d tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:56.669161 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a426f357-9d44-4ca0-a916-3674170e823d tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:58:56.677530 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a426f357-9d44-4ca0-a916-3674170e823d tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/9fd381f9-3dd9-482d-b255-3a3f64528c6c" status: 200 len: 1187 microversion: 2.1 time: 0.089236 Oct 19 03:58:56.678118 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3435/6812] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:58:56 2022] GET /compute/v2.1/servers/9fd381f9-3dd9-482d-b255-3a3f64528c6c => generated 1187 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:58:56.960234 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1343d768-e344-43cc-aa7c-ce820ee78df2 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:58:56.962605 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1343d768-e344-43cc-aa7c-ce820ee78df2 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: 6de16745-5838-4ba1-b987-1e1e4084dd7f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:58:56.969181 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1343d768-e344-43cc-aa7c-ce820ee78df2 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:56.969771 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1343d768-e344-43cc-aa7c-ce820ee78df2 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:56.970222 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1343d768-e344-43cc-aa7c-ce820ee78df2 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:56.970957 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1343d768-e344-43cc-aa7c-ce820ee78df2 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:56.971419 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1343d768-e344-43cc-aa7c-ce820ee78df2 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:56.971851 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1343d768-e344-43cc-aa7c-ce820ee78df2 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:57.048772 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1343d768-e344-43cc-aa7c-ce820ee78df2 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "POST /compute/v2.1/servers/6de16745-5838-4ba1-b987-1e1e4084dd7f/action" status: 200 len: 24549 microversion: 2.1 time: 0.092248 Oct 19 03:58:57.049813 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3436/6813] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 03:58:56 2022] POST /compute/v2.1/servers/6de16745-5838-4ba1-b987-1e1e4084dd7f/action => generated 24549 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 03:58:57.701483 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-18b47e2b-ac22-4bbd-a603-ec9a3335b067 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:58:57.702183 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-18b47e2b-ac22-4bbd-a603-ec9a3335b067 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 9fd381f9-3dd9-482d-b255-3a3f64528c6c] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:58:57.710182 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-18b47e2b-ac22-4bbd-a603-ec9a3335b067 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:57.710660 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-18b47e2b-ac22-4bbd-a603-ec9a3335b067 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:57.711100 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-18b47e2b-ac22-4bbd-a603-ec9a3335b067 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:57.711808 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-18b47e2b-ac22-4bbd-a603-ec9a3335b067 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:57.712262 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-18b47e2b-ac22-4bbd-a603-ec9a3335b067 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:57.712690 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-18b47e2b-ac22-4bbd-a603-ec9a3335b067 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:57.780873 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-18b47e2b-ac22-4bbd-a603-ec9a3335b067 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:58:57.789497 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-18b47e2b-ac22-4bbd-a603-ec9a3335b067 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/9fd381f9-3dd9-482d-b255-3a3f64528c6c" status: 200 len: 1187 microversion: 2.1 time: 0.092941 Oct 19 03:58:57.790067 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3437/6814] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:58:57 2022] GET /compute/v2.1/servers/9fd381f9-3dd9-482d-b255-3a3f64528c6c => generated 1187 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:58:58.813992 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b678eccf-cc35-4ee5-ba62-73b786c83f63 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:58:58.814616 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b678eccf-cc35-4ee5-ba62-73b786c83f63 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 9fd381f9-3dd9-482d-b255-3a3f64528c6c] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:58:58.821333 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b678eccf-cc35-4ee5-ba62-73b786c83f63 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:58.824015 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b678eccf-cc35-4ee5-ba62-73b786c83f63 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:58.824015 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b678eccf-cc35-4ee5-ba62-73b786c83f63 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:58.824015 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b678eccf-cc35-4ee5-ba62-73b786c83f63 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:58.824015 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b678eccf-cc35-4ee5-ba62-73b786c83f63 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:58.824015 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b678eccf-cc35-4ee5-ba62-73b786c83f63 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:58.857141 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b678eccf-cc35-4ee5-ba62-73b786c83f63 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:58.857667 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b678eccf-cc35-4ee5-ba62-73b786c83f63 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:58.858136 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b678eccf-cc35-4ee5-ba62-73b786c83f63 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:58.858575 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-b678eccf-cc35-4ee5-ba62-73b786c83f63 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lazy-loading 'fault' on Instance uuid 9fd381f9-3dd9-482d-b255-3a3f64528c6c {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:58:58.861440 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:58:58.899604 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b678eccf-cc35-4ee5-ba62-73b786c83f63 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:58:58.907856 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b678eccf-cc35-4ee5-ba62-73b786c83f63 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/9fd381f9-3dd9-482d-b255-3a3f64528c6c" status: 200 len: 1192 microversion: 2.1 time: 0.097901 Oct 19 03:58:58.908424 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3438/6815] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:58:58 2022] GET /compute/v2.1/servers/9fd381f9-3dd9-482d-b255-3a3f64528c6c => generated 1192 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:58:59.935429 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-908f3234-1ed0-4cd8-93b2-06db55fd66e7 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:58:59.936093 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-908f3234-1ed0-4cd8-93b2-06db55fd66e7 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 9fd381f9-3dd9-482d-b255-3a3f64528c6c] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:58:59.943337 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-908f3234-1ed0-4cd8-93b2-06db55fd66e7 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:59.943829 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-908f3234-1ed0-4cd8-93b2-06db55fd66e7 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:59.944303 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-908f3234-1ed0-4cd8-93b2-06db55fd66e7 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:59.945006 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-908f3234-1ed0-4cd8-93b2-06db55fd66e7 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:58:59.945509 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-908f3234-1ed0-4cd8-93b2-06db55fd66e7 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:58:59.945945 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-908f3234-1ed0-4cd8-93b2-06db55fd66e7 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:58:59.959783 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-908f3234-1ed0-4cd8-93b2-06db55fd66e7 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] HTTP exception thrown: Instance 9fd381f9-3dd9-482d-b255-3a3f64528c6c could not be found. Oct 19 03:58:59.961487 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-908f3234-1ed0-4cd8-93b2-06db55fd66e7 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Request method failure captured: Oct 19 03:58:59.961487 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/9fd381f9-3dd9-482d-b255-3a3f64528c6c HTTP/1.1 Oct 19 03:58:59.961487 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:58:59.961487 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:58:59.961487 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:58:59.961487 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:58:59.961487 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:58:59.961487 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:58:59.961487 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:58:59.961487 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:58:59.961487 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3XYw5PeFcmVZaG2CxoqLxKroO9lkG-Hw7MzEkzHPy2_aqlf3HPBMKgLOXoQ-WbgkZbvZB1PbShR7FiiZmGSIVTCeQrWw3ytKpP-AuucJQP3lFFYEs8HquAFih6wwJOh2-3eNgmaxbIZUVh9y_A1g_wYecm08YmNoRnAnQnVYIDNRwE Oct 19 03:58:59.961487 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:58:59.961487 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:58:59.961487 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:58:59.961487 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:58:59.961487 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:58:59.961487 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:58:59.961487 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: beff434485604f85985617071a93727c Oct 19 03:58:59.961487 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-TestVolumeBootPattern-954873624 Oct 19 03:58:59.961487 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:58:59.961487 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:58:59.961487 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/beff434485604f85985617071a93727c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/beff434485604f85985617071a93727c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/beff434485604f85985617071a93727c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_beff434485604f85985617071a93727c", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:58:59.961487 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-TestVolumeBootPattern-954873624 Oct 19 03:58:59.961487 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: beff434485604f85985617071a93727c Oct 19 03:58:59.961487 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-TestVolumeBootPattern-954873624 Oct 19 03:58:59.961487 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-TestVolumeBootPattern-954873624-project Oct 19 03:58:59.961487 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:58:59.961487 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:58:59.961487 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 4d30aa868d79473f9534bd79816c07e3 Oct 19 03:58:59.961487 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-TestVolumeBootPattern-954873624-project Oct 19 03:58:59.961487 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:58:59.961487 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance 9fd381f9-3dd9-482d-b255-3a3f64528c6c could not be found. Oct 19 03:58:59.961487 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '9fd381f9-3dd9-482d-b255-3a3f64528c6c'} Oct 19 03:58:59.961487 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:58:59.961487 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:58:59.961487 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:58:59.961487 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:58:59.961487 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:58:59.961487 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:58:59.961487 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:58:59.961487 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:58:59.961487 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:58:59.961487 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:58:59.961487 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fd381f9-3dd9-482d-b255-3a3f64528c6c could not be found. Oct 19 03:58:59.961487 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:58:59.961487 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:58:59.961487 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:58:59.961487 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:58:59.961487 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:58:59.961487 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:58:59.961487 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:58:59.961487 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:58:59.961487 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:58:59.961487 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:58:59.961487 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:58:59.961487 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:58:59.961487 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:58:59.961487 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:58:59.961487 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:58:59.961487 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:58:59.961487 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fd381f9-3dd9-482d-b255-3a3f64528c6c could not be found. Oct 19 03:58:59.961487 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:58:59.961487 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:58:59.961487 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:58:59.967132 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:58:59.967132 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:58:59.967132 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:58:59.967132 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:58:59.967132 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:58:59.967132 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fd381f9-3dd9-482d-b255-3a3f64528c6c could not be found. Oct 19 03:58:59.967132 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:58:59.967132 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-908f3234-1ed0-4cd8-93b2-06db55fd66e7 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Returning 404 to user: Instance 9fd381f9-3dd9-482d-b255-3a3f64528c6c could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:58:59.967132 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-908f3234-1ed0-4cd8-93b2-06db55fd66e7 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/9fd381f9-3dd9-482d-b255-3a3f64528c6c" status: 404 len: 111 microversion: 2.1 time: 0.031847 Oct 19 03:58:59.967132 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3439/6816] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:58:59 2022] GET /compute/v2.1/servers/9fd381f9-3dd9-482d-b255-3a3f64528c6c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 03:59:06.801093 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3741565d-4547-4d18-9255-60944ac1ec5e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-47715816", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "67b2db84-60a1-48e9-82a4-4bc6fec4bf48", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d55e7db4-c570-4a69-afcb-0fab975a7a7e"}]}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:59:06.863568 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-3741565d-4547-4d18-9255-60944ac1ec5e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] validate_networks() for [('d55e7db4-c570-4a69-afcb-0fab975a7a7e', None, None, None, None, None)] {{(pid=121134) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 03:59:07.536300 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-3741565d-4547-4d18-9255-60944ac1ec5e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Flavor limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 03:59:07.536744 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-3741565d-4547-4d18-9255-60944ac1ec5e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Image limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 03:59:07.537229 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-3741565d-4547-4d18-9255-60944ac1ec5e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Flavor pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 03:59:07.537681 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-3741565d-4547-4d18-9255-60944ac1ec5e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Image pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 03:59:07.538108 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-3741565d-4547-4d18-9255-60944ac1ec5e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 03:59:07.551353 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3741565d-4547-4d18-9255-60944ac1ec5e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:07.551353 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3741565d-4547-4d18-9255-60944ac1ec5e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:07.551353 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3741565d-4547-4d18-9255-60944ac1ec5e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:07.551353 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3741565d-4547-4d18-9255-60944ac1ec5e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:07.551353 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3741565d-4547-4d18-9255-60944ac1ec5e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:07.551353 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3741565d-4547-4d18-9255-60944ac1ec5e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:07.566803 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-3741565d-4547-4d18-9255-60944ac1ec5e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Getting quotas for project beff434485604f85985617071a93727c. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 03:59:07.572178 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-3741565d-4547-4d18-9255-60944ac1ec5e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Getting quotas for user 4d30aa868d79473f9534bd79816c07e3 and project beff434485604f85985617071a93727c. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 03:59:07.631845 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3741565d-4547-4d18-9255-60944ac1ec5e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Going to run 1 instances... {{(pid=121134) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 03:59:07.633889 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3741565d-4547-4d18-9255-60944ac1ec5e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 2e716aa7-08cb-4992-b853-b1d6a6e28d81] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='67b2db84-60a1-48e9-82a4-4bc6fec4bf48',volume_size=None,volume_type=None)] {{(pid=121134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 03:59:07.982121 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3741565d-4547-4d18-9255-60944ac1ec5e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.185223 Oct 19 03:59:07.982932 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3440/6817] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:59:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1187 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 19 03:59:07.993864 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c5db7530-53da-46bf-8d80-7bf1b21ff29e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:59:07.994493 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c5db7530-53da-46bf-8d80-7bf1b21ff29e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 2e716aa7-08cb-4992-b853-b1d6a6e28d81] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:59:08.048852 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c5db7530-53da-46bf-8d80-7bf1b21ff29e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:59:08.055758 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c5db7530-53da-46bf-8d80-7bf1b21ff29e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/2e716aa7-08cb-4992-b853-b1d6a6e28d81" status: 200 len: 1055 microversion: 2.1 time: 0.065710 Oct 19 03:59:08.056325 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3441/6818] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:59:07 2022] GET /compute/v2.1/servers/2e716aa7-08cb-4992-b853-b1d6a6e28d81 => generated 1055 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:59:09.079916 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5f124617-d825-4105-b790-1956720a4e73 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:59:09.080572 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5f124617-d825-4105-b790-1956720a4e73 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 2e716aa7-08cb-4992-b853-b1d6a6e28d81] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:59:09.087421 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5f124617-d825-4105-b790-1956720a4e73 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:09.087932 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5f124617-d825-4105-b790-1956720a4e73 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:09.088371 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5f124617-d825-4105-b790-1956720a4e73 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:09.089076 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5f124617-d825-4105-b790-1956720a4e73 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:09.089577 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5f124617-d825-4105-b790-1956720a4e73 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:09.090018 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5f124617-d825-4105-b790-1956720a4e73 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:09.157884 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5f124617-d825-4105-b790-1956720a4e73 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:59:09.165618 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5f124617-d825-4105-b790-1956720a4e73 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/2e716aa7-08cb-4992-b853-b1d6a6e28d81" status: 200 len: 1105 microversion: 2.1 time: 0.090320 Oct 19 03:59:09.166199 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3442/6819] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:59:09 2022] GET /compute/v2.1/servers/2e716aa7-08cb-4992-b853-b1d6a6e28d81 => generated 1105 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:59:10.188493 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-193afa7c-4f9c-4302-b0b1-b2627bc454d1 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:59:10.190211 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-193afa7c-4f9c-4302-b0b1-b2627bc454d1 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 2e716aa7-08cb-4992-b853-b1d6a6e28d81] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:59:10.197937 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-193afa7c-4f9c-4302-b0b1-b2627bc454d1 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:10.198585 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-193afa7c-4f9c-4302-b0b1-b2627bc454d1 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:10.199033 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-193afa7c-4f9c-4302-b0b1-b2627bc454d1 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:10.200035 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-193afa7c-4f9c-4302-b0b1-b2627bc454d1 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:10.200502 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-193afa7c-4f9c-4302-b0b1-b2627bc454d1 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:10.200934 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-193afa7c-4f9c-4302-b0b1-b2627bc454d1 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:10.269352 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-193afa7c-4f9c-4302-b0b1-b2627bc454d1 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:59:10.278287 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-193afa7c-4f9c-4302-b0b1-b2627bc454d1 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/2e716aa7-08cb-4992-b853-b1d6a6e28d81" status: 200 len: 1161 microversion: 2.1 time: 0.093943 Oct 19 03:59:10.281679 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3443/6820] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:59:10 2022] GET /compute/v2.1/servers/2e716aa7-08cb-4992-b853-b1d6a6e28d81 => generated 1161 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:59:11.308354 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-901d5ffb-3366-4187-a3aa-2beb2638aa1f tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:59:11.310425 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-901d5ffb-3366-4187-a3aa-2beb2638aa1f tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 2e716aa7-08cb-4992-b853-b1d6a6e28d81] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:59:11.324730 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-901d5ffb-3366-4187-a3aa-2beb2638aa1f tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:11.325521 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-901d5ffb-3366-4187-a3aa-2beb2638aa1f tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:11.326915 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-901d5ffb-3366-4187-a3aa-2beb2638aa1f tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:11.327845 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-901d5ffb-3366-4187-a3aa-2beb2638aa1f tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:11.328466 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-901d5ffb-3366-4187-a3aa-2beb2638aa1f tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:11.329060 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-901d5ffb-3366-4187-a3aa-2beb2638aa1f tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:11.536043 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-901d5ffb-3366-4187-a3aa-2beb2638aa1f tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:59:11.546206 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-901d5ffb-3366-4187-a3aa-2beb2638aa1f tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/2e716aa7-08cb-4992-b853-b1d6a6e28d81" status: 200 len: 1213 microversion: 2.1 time: 0.245801 Oct 19 03:59:11.556745 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3444/6821] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:59:11 2022] GET /compute/v2.1/servers/2e716aa7-08cb-4992-b853-b1d6a6e28d81 => generated 1213 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:59:12.115405 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-ce82a284-1665-4d48-8e85-3812686dc614 req-2b1db017-ffc5-4908-8b00-66151bcc02dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e716aa7-08cb-4992-b853-b1d6a6e28d81", "tag": "f03f946f-d164-426a-bea8-df675173e06d"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:59:12.125988 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-ce82a284-1665-4d48-8e85-3812686dc614 req-2b1db017-ffc5-4908-8b00-66151bcc02dd service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:12.126592 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-ce82a284-1665-4d48-8e85-3812686dc614 req-2b1db017-ffc5-4908-8b00-66151bcc02dd service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:12.127135 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-ce82a284-1665-4d48-8e85-3812686dc614 req-2b1db017-ffc5-4908-8b00-66151bcc02dd service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:12.138310 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-ce82a284-1665-4d48-8e85-3812686dc614 req-2b1db017-ffc5-4908-8b00-66151bcc02dd service nova] Creating event network-changed:f03f946f-d164-426a-bea8-df675173e06d for instance 2e716aa7-08cb-4992-b853-b1d6a6e28d81 on n-h2-861333-8 Oct 19 03:59:12.143478 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-ce82a284-1665-4d48-8e85-3812686dc614 req-2b1db017-ffc5-4908-8b00-66151bcc02dd service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.190951 Oct 19 03:59:12.144260 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3445/6822] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:59:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:59:12.571695 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-07a416ca-2027-4259-8c1e-ab801badfb20 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:59:12.572511 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-07a416ca-2027-4259-8c1e-ab801badfb20 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 2e716aa7-08cb-4992-b853-b1d6a6e28d81] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:59:12.580748 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-07a416ca-2027-4259-8c1e-ab801badfb20 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:12.581563 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-07a416ca-2027-4259-8c1e-ab801badfb20 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:12.582190 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-07a416ca-2027-4259-8c1e-ab801badfb20 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:12.583271 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-07a416ca-2027-4259-8c1e-ab801badfb20 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:12.583898 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-07a416ca-2027-4259-8c1e-ab801badfb20 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:12.584600 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-07a416ca-2027-4259-8c1e-ab801badfb20 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:12.815157 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-07a416ca-2027-4259-8c1e-ab801badfb20 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:59:12.823368 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-07a416ca-2027-4259-8c1e-ab801badfb20 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/2e716aa7-08cb-4992-b853-b1d6a6e28d81" status: 200 len: 1213 microversion: 2.1 time: 0.257097 Oct 19 03:59:12.823957 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3446/6823] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:59:12 2022] GET /compute/v2.1/servers/2e716aa7-08cb-4992-b853-b1d6a6e28d81 => generated 1213 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:59:13.847388 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-04de61a4-9b89-4591-b10e-fcc5cbe87158 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:59:13.848010 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-04de61a4-9b89-4591-b10e-fcc5cbe87158 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 2e716aa7-08cb-4992-b853-b1d6a6e28d81] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:59:13.854844 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-04de61a4-9b89-4591-b10e-fcc5cbe87158 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:13.855337 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-04de61a4-9b89-4591-b10e-fcc5cbe87158 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:13.855782 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-04de61a4-9b89-4591-b10e-fcc5cbe87158 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:13.856486 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-04de61a4-9b89-4591-b10e-fcc5cbe87158 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:13.857016 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-04de61a4-9b89-4591-b10e-fcc5cbe87158 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:13.858050 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-04de61a4-9b89-4591-b10e-fcc5cbe87158 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:13.986618 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-04de61a4-9b89-4591-b10e-fcc5cbe87158 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:59:13.994732 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-04de61a4-9b89-4591-b10e-fcc5cbe87158 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/2e716aa7-08cb-4992-b853-b1d6a6e28d81" status: 200 len: 1213 microversion: 2.1 time: 0.151387 Oct 19 03:59:13.995312 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3447/6824] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:59:13 2022] GET /compute/v2.1/servers/2e716aa7-08cb-4992-b853-b1d6a6e28d81 => generated 1213 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:59:15.017307 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0059e2e7-ea32-4b11-9435-3d184a48e5a1 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:59:15.018130 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0059e2e7-ea32-4b11-9435-3d184a48e5a1 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 2e716aa7-08cb-4992-b853-b1d6a6e28d81] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:59:15.021056 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:59:15.026238 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0059e2e7-ea32-4b11-9435-3d184a48e5a1 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:15.026737 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0059e2e7-ea32-4b11-9435-3d184a48e5a1 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:15.027185 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0059e2e7-ea32-4b11-9435-3d184a48e5a1 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:15.028020 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0059e2e7-ea32-4b11-9435-3d184a48e5a1 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:15.028496 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0059e2e7-ea32-4b11-9435-3d184a48e5a1 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:15.028933 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0059e2e7-ea32-4b11-9435-3d184a48e5a1 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:15.165030 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0059e2e7-ea32-4b11-9435-3d184a48e5a1 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:59:15.170156 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0059e2e7-ea32-4b11-9435-3d184a48e5a1 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/2e716aa7-08cb-4992-b853-b1d6a6e28d81" status: 200 len: 1213 microversion: 2.1 time: 0.156274 Oct 19 03:59:15.170717 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3448/6825] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:59:15 2022] GET /compute/v2.1/servers/2e716aa7-08cb-4992-b853-b1d6a6e28d81 => generated 1213 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:59:16.192729 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-988d943f-ae21-4f04-b314-f4a6ce0e1b97 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:59:16.193390 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-988d943f-ae21-4f04-b314-f4a6ce0e1b97 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 2e716aa7-08cb-4992-b853-b1d6a6e28d81] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:59:16.200308 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-988d943f-ae21-4f04-b314-f4a6ce0e1b97 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:16.200796 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-988d943f-ae21-4f04-b314-f4a6ce0e1b97 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:16.201901 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-988d943f-ae21-4f04-b314-f4a6ce0e1b97 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:16.202600 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-988d943f-ae21-4f04-b314-f4a6ce0e1b97 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:16.203059 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-988d943f-ae21-4f04-b314-f4a6ce0e1b97 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:16.203491 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-988d943f-ae21-4f04-b314-f4a6ce0e1b97 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:16.335905 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-988d943f-ae21-4f04-b314-f4a6ce0e1b97 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:59:16.343802 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-988d943f-ae21-4f04-b314-f4a6ce0e1b97 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/2e716aa7-08cb-4992-b853-b1d6a6e28d81" status: 200 len: 1201 microversion: 2.1 time: 0.154958 Oct 19 03:59:16.344376 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3449/6826] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:59:16 2022] GET /compute/v2.1/servers/2e716aa7-08cb-4992-b853-b1d6a6e28d81 => generated 1201 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:59:17.225996 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-62612739-d839-4dc2-8764-9d0832e74991 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:59:17.226747 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-62612739-d839-4dc2-8764-9d0832e74991 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: 908ca82f-86ba-40c5-95b8-ee0f51588c9b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:59:17.233308 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-62612739-d839-4dc2-8764-9d0832e74991 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:17.233820 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-62612739-d839-4dc2-8764-9d0832e74991 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:17.234260 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-62612739-d839-4dc2-8764-9d0832e74991 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:17.234951 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-62612739-d839-4dc2-8764-9d0832e74991 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:17.235402 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-62612739-d839-4dc2-8764-9d0832e74991 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:17.235830 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-62612739-d839-4dc2-8764-9d0832e74991 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:17.260618 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-62612739-d839-4dc2-8764-9d0832e74991 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "GET /compute/v2.1/servers/908ca82f-86ba-40c5-95b8-ee0f51588c9b/ips" status: 200 len: 150 microversion: 2.1 time: 0.038570 Oct 19 03:59:17.261187 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3450/6827] 10.222.0.52 () {58 vars in 1248 bytes} [Wed Oct 19 03:59:17 2022] GET /compute/v2.1/servers/908ca82f-86ba-40c5-95b8-ee0f51588c9b/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:59:17.366653 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3ee55411-17d2-43b5-b5f5-1eeec54cf83b tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:59:17.367432 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3ee55411-17d2-43b5-b5f5-1eeec54cf83b tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 2e716aa7-08cb-4992-b853-b1d6a6e28d81] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:59:17.373642 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3ee55411-17d2-43b5-b5f5-1eeec54cf83b tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:17.374141 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3ee55411-17d2-43b5-b5f5-1eeec54cf83b tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:17.374589 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3ee55411-17d2-43b5-b5f5-1eeec54cf83b tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:17.375298 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3ee55411-17d2-43b5-b5f5-1eeec54cf83b tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:17.375755 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3ee55411-17d2-43b5-b5f5-1eeec54cf83b tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:17.376222 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3ee55411-17d2-43b5-b5f5-1eeec54cf83b tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:17.504314 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-3ee55411-17d2-43b5-b5f5-1eeec54cf83b tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:59:17.512147 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3ee55411-17d2-43b5-b5f5-1eeec54cf83b tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/2e716aa7-08cb-4992-b853-b1d6a6e28d81" status: 200 len: 1201 microversion: 2.1 time: 0.149331 Oct 19 03:59:17.512723 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3451/6828] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:59:17 2022] GET /compute/v2.1/servers/2e716aa7-08cb-4992-b853-b1d6a6e28d81 => generated 1201 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:59:18.536406 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-027bcc0d-a243-48af-b38b-06b38200e0fd tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:59:18.537073 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-027bcc0d-a243-48af-b38b-06b38200e0fd tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 2e716aa7-08cb-4992-b853-b1d6a6e28d81] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:59:18.538909 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:59:18.539757 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=8 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:59:18.546078 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-027bcc0d-a243-48af-b38b-06b38200e0fd tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:18.547134 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-027bcc0d-a243-48af-b38b-06b38200e0fd tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:18.547134 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-027bcc0d-a243-48af-b38b-06b38200e0fd tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:18.547740 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-027bcc0d-a243-48af-b38b-06b38200e0fd tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:18.548190 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-027bcc0d-a243-48af-b38b-06b38200e0fd tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:18.548620 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-027bcc0d-a243-48af-b38b-06b38200e0fd tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:18.684556 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-027bcc0d-a243-48af-b38b-06b38200e0fd tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:59:18.692759 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-027bcc0d-a243-48af-b38b-06b38200e0fd tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/2e716aa7-08cb-4992-b853-b1d6a6e28d81" status: 200 len: 1201 microversion: 2.1 time: 0.160546 Oct 19 03:59:18.693349 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3452/6829] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:59:18 2022] GET /compute/v2.1/servers/2e716aa7-08cb-4992-b853-b1d6a6e28d81 => generated 1201 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:59:19.715672 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-566eb5fb-e669-41d2-ac62-02139e085ae6 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:59:19.716291 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-566eb5fb-e669-41d2-ac62-02139e085ae6 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 2e716aa7-08cb-4992-b853-b1d6a6e28d81] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:59:19.723259 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-566eb5fb-e669-41d2-ac62-02139e085ae6 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:19.723735 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-566eb5fb-e669-41d2-ac62-02139e085ae6 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:19.724177 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-566eb5fb-e669-41d2-ac62-02139e085ae6 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:19.724872 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-566eb5fb-e669-41d2-ac62-02139e085ae6 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:19.725332 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-566eb5fb-e669-41d2-ac62-02139e085ae6 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:19.725789 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-566eb5fb-e669-41d2-ac62-02139e085ae6 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:19.852506 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-566eb5fb-e669-41d2-ac62-02139e085ae6 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:59:19.860745 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-566eb5fb-e669-41d2-ac62-02139e085ae6 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/2e716aa7-08cb-4992-b853-b1d6a6e28d81" status: 200 len: 1201 microversion: 2.1 time: 0.148999 Oct 19 03:59:19.861346 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3453/6830] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:59:19 2022] GET /compute/v2.1/servers/2e716aa7-08cb-4992-b853-b1d6a6e28d81 => generated 1201 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:59:19.932070 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b00ce30e-432b-42fd-990a-46a6492daca5 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f8d7fa13-da9c-4b41-917f-5f6c97f88e34"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:59:19.934592 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b00ce30e-432b-42fd-990a-46a6492daca5 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: 908ca82f-86ba-40c5-95b8-ee0f51588c9b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:59:19.940611 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b00ce30e-432b-42fd-990a-46a6492daca5 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:19.941108 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b00ce30e-432b-42fd-990a-46a6492daca5 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:19.941605 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b00ce30e-432b-42fd-990a-46a6492daca5 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:19.942301 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b00ce30e-432b-42fd-990a-46a6492daca5 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:19.942760 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b00ce30e-432b-42fd-990a-46a6492daca5 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:19.943190 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b00ce30e-432b-42fd-990a-46a6492daca5 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:20.622231 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b00ce30e-432b-42fd-990a-46a6492daca5 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "POST /compute/v2.1/servers/908ca82f-86ba-40c5-95b8-ee0f51588c9b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.693937 Oct 19 03:59:20.623335 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3454/6831] 10.222.0.52 () {60 vars in 1323 bytes} [Wed Oct 19 03:59:19 2022] POST /compute/v2.1/servers/908ca82f-86ba-40c5-95b8-ee0f51588c9b/os-volume_attachments => generated 194 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:59:20.885169 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-85bf19af-5a29-403d-a2f0-49265b93f4d3 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:59:20.885918 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-85bf19af-5a29-403d-a2f0-49265b93f4d3 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 2e716aa7-08cb-4992-b853-b1d6a6e28d81] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:59:20.893032 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-85bf19af-5a29-403d-a2f0-49265b93f4d3 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:20.893574 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-85bf19af-5a29-403d-a2f0-49265b93f4d3 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:20.894012 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-85bf19af-5a29-403d-a2f0-49265b93f4d3 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:20.894881 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-85bf19af-5a29-403d-a2f0-49265b93f4d3 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:20.895360 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-85bf19af-5a29-403d-a2f0-49265b93f4d3 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:20.896668 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-85bf19af-5a29-403d-a2f0-49265b93f4d3 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:21.029865 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-85bf19af-5a29-403d-a2f0-49265b93f4d3 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:59:21.037765 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-85bf19af-5a29-403d-a2f0-49265b93f4d3 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/2e716aa7-08cb-4992-b853-b1d6a6e28d81" status: 200 len: 1201 microversion: 2.1 time: 0.157744 Oct 19 03:59:21.038444 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3455/6832] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:59:20 2022] GET /compute/v2.1/servers/2e716aa7-08cb-4992-b853-b1d6a6e28d81 => generated 1201 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:59:22.061325 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4e41ed1a-ba50-48bd-ae96-432a895e2d66 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:59:22.061965 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4e41ed1a-ba50-48bd-ae96-432a895e2d66 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 2e716aa7-08cb-4992-b853-b1d6a6e28d81] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:59:22.068866 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4e41ed1a-ba50-48bd-ae96-432a895e2d66 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:22.069362 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4e41ed1a-ba50-48bd-ae96-432a895e2d66 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:22.069833 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4e41ed1a-ba50-48bd-ae96-432a895e2d66 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:22.070679 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4e41ed1a-ba50-48bd-ae96-432a895e2d66 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:22.071147 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4e41ed1a-ba50-48bd-ae96-432a895e2d66 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:22.071582 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4e41ed1a-ba50-48bd-ae96-432a895e2d66 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:22.209287 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-4e41ed1a-ba50-48bd-ae96-432a895e2d66 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:59:22.218098 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4e41ed1a-ba50-48bd-ae96-432a895e2d66 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/2e716aa7-08cb-4992-b853-b1d6a6e28d81" status: 200 len: 1201 microversion: 2.1 time: 0.160921 Oct 19 03:59:22.218706 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3456/6833] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:59:22 2022] GET /compute/v2.1/servers/2e716aa7-08cb-4992-b853-b1d6a6e28d81 => generated 1201 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:59:23.240762 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9e1eacce-2691-4998-b25c-7e67ac697ce3 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:59:23.241506 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9e1eacce-2691-4998-b25c-7e67ac697ce3 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 2e716aa7-08cb-4992-b853-b1d6a6e28d81] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:59:23.249030 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9e1eacce-2691-4998-b25c-7e67ac697ce3 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:23.249504 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9e1eacce-2691-4998-b25c-7e67ac697ce3 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:23.249951 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9e1eacce-2691-4998-b25c-7e67ac697ce3 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:23.250651 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9e1eacce-2691-4998-b25c-7e67ac697ce3 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:23.251108 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9e1eacce-2691-4998-b25c-7e67ac697ce3 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:23.251540 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9e1eacce-2691-4998-b25c-7e67ac697ce3 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:23.255734 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:59:23.382886 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9e1eacce-2691-4998-b25c-7e67ac697ce3 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:59:23.391478 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9e1eacce-2691-4998-b25c-7e67ac697ce3 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/2e716aa7-08cb-4992-b853-b1d6a6e28d81" status: 200 len: 1201 microversion: 2.1 time: 0.154669 Oct 19 03:59:23.392069 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3457/6834] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:59:23 2022] GET /compute/v2.1/servers/2e716aa7-08cb-4992-b853-b1d6a6e28d81 => generated 1201 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:59:24.414097 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c4f591db-b0d5-467f-8c17-65aa2afe65e1 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:59:24.414702 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c4f591db-b0d5-467f-8c17-65aa2afe65e1 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 2e716aa7-08cb-4992-b853-b1d6a6e28d81] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:59:24.421620 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c4f591db-b0d5-467f-8c17-65aa2afe65e1 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:24.422110 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c4f591db-b0d5-467f-8c17-65aa2afe65e1 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:24.422558 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c4f591db-b0d5-467f-8c17-65aa2afe65e1 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:24.423245 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c4f591db-b0d5-467f-8c17-65aa2afe65e1 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:24.423704 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c4f591db-b0d5-467f-8c17-65aa2afe65e1 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:24.424135 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c4f591db-b0d5-467f-8c17-65aa2afe65e1 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:24.557027 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c4f591db-b0d5-467f-8c17-65aa2afe65e1 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:59:24.565574 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c4f591db-b0d5-467f-8c17-65aa2afe65e1 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/2e716aa7-08cb-4992-b853-b1d6a6e28d81" status: 200 len: 1201 microversion: 2.1 time: 0.155340 Oct 19 03:59:24.566193 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3458/6835] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:59:24 2022] GET /compute/v2.1/servers/2e716aa7-08cb-4992-b853-b1d6a6e28d81 => generated 1201 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:59:25.588591 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a6762a09-b908-47e1-a485-2a76032a1545 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:59:25.589208 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a6762a09-b908-47e1-a485-2a76032a1545 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 2e716aa7-08cb-4992-b853-b1d6a6e28d81] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:59:25.596714 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a6762a09-b908-47e1-a485-2a76032a1545 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:25.597203 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a6762a09-b908-47e1-a485-2a76032a1545 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:25.597683 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a6762a09-b908-47e1-a485-2a76032a1545 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:25.599278 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a6762a09-b908-47e1-a485-2a76032a1545 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:25.599790 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a6762a09-b908-47e1-a485-2a76032a1545 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:25.600282 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a6762a09-b908-47e1-a485-2a76032a1545 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:25.735372 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a6762a09-b908-47e1-a485-2a76032a1545 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:59:25.743187 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a6762a09-b908-47e1-a485-2a76032a1545 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/2e716aa7-08cb-4992-b853-b1d6a6e28d81" status: 200 len: 1201 microversion: 2.1 time: 0.158524 Oct 19 03:59:25.743773 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3459/6836] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:59:25 2022] GET /compute/v2.1/servers/2e716aa7-08cb-4992-b853-b1d6a6e28d81 => generated 1201 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:59:26.767170 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-769b7ef2-41fd-45a8-9b1d-e8ba740c962e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:59:26.767832 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-769b7ef2-41fd-45a8-9b1d-e8ba740c962e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 2e716aa7-08cb-4992-b853-b1d6a6e28d81] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:59:26.774953 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-769b7ef2-41fd-45a8-9b1d-e8ba740c962e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:26.775445 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-769b7ef2-41fd-45a8-9b1d-e8ba740c962e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:26.775889 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-769b7ef2-41fd-45a8-9b1d-e8ba740c962e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:26.776593 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-769b7ef2-41fd-45a8-9b1d-e8ba740c962e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:26.777039 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-769b7ef2-41fd-45a8-9b1d-e8ba740c962e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:26.777501 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-769b7ef2-41fd-45a8-9b1d-e8ba740c962e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:26.906546 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-769b7ef2-41fd-45a8-9b1d-e8ba740c962e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:59:26.914295 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-769b7ef2-41fd-45a8-9b1d-e8ba740c962e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/2e716aa7-08cb-4992-b853-b1d6a6e28d81" status: 200 len: 1201 microversion: 2.1 time: 0.151645 Oct 19 03:59:26.914874 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3460/6837] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:59:26 2022] GET /compute/v2.1/servers/2e716aa7-08cb-4992-b853-b1d6a6e28d81 => generated 1201 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:59:27.696416 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-b624246a-974d-4855-ad38-e5e836c269bb req-1ad0616c-9cf7-42dc-adf1-79998a0a4163 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e716aa7-08cb-4992-b853-b1d6a6e28d81", "name": "network-vif-plugged", "status": "completed", "tag": "f03f946f-d164-426a-bea8-df675173e06d"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:59:27.706438 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-b624246a-974d-4855-ad38-e5e836c269bb req-1ad0616c-9cf7-42dc-adf1-79998a0a4163 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:27.706918 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-b624246a-974d-4855-ad38-e5e836c269bb req-1ad0616c-9cf7-42dc-adf1-79998a0a4163 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:27.707352 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-b624246a-974d-4855-ad38-e5e836c269bb req-1ad0616c-9cf7-42dc-adf1-79998a0a4163 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:27.718627 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-b624246a-974d-4855-ad38-e5e836c269bb req-1ad0616c-9cf7-42dc-adf1-79998a0a4163 service nova] Creating event network-vif-plugged:f03f946f-d164-426a-bea8-df675173e06d for instance 2e716aa7-08cb-4992-b853-b1d6a6e28d81 on n-h2-861333-8 Oct 19 03:59:27.723345 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-b624246a-974d-4855-ad38-e5e836c269bb req-1ad0616c-9cf7-42dc-adf1-79998a0a4163 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092529 Oct 19 03:59:27.723918 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3461/6838] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:59:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:59:27.938910 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-86d11590-095c-4f3f-a453-4d1019c97b8d tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:59:27.939611 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-86d11590-095c-4f3f-a453-4d1019c97b8d tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 2e716aa7-08cb-4992-b853-b1d6a6e28d81] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:59:27.945777 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-86d11590-095c-4f3f-a453-4d1019c97b8d tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:27.946258 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-86d11590-095c-4f3f-a453-4d1019c97b8d tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:27.946704 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-86d11590-095c-4f3f-a453-4d1019c97b8d tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:27.947396 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-86d11590-095c-4f3f-a453-4d1019c97b8d tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:27.947847 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-86d11590-095c-4f3f-a453-4d1019c97b8d tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:27.948274 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-86d11590-095c-4f3f-a453-4d1019c97b8d tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:28.078350 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-86d11590-095c-4f3f-a453-4d1019c97b8d tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:59:28.086671 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-86d11590-095c-4f3f-a453-4d1019c97b8d tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/2e716aa7-08cb-4992-b853-b1d6a6e28d81" status: 200 len: 1201 microversion: 2.1 time: 0.152708 Oct 19 03:59:28.087098 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3462/6839] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:59:27 2022] GET /compute/v2.1/servers/2e716aa7-08cb-4992-b853-b1d6a6e28d81 => generated 1201 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:59:29.111093 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-066ffd86-f697-48c8-8716-b16b3ca56595 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:59:29.111763 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-066ffd86-f697-48c8-8716-b16b3ca56595 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 2e716aa7-08cb-4992-b853-b1d6a6e28d81] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:59:29.118830 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-066ffd86-f697-48c8-8716-b16b3ca56595 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:29.119331 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-066ffd86-f697-48c8-8716-b16b3ca56595 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:29.119776 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-066ffd86-f697-48c8-8716-b16b3ca56595 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:29.120485 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-066ffd86-f697-48c8-8716-b16b3ca56595 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:29.120948 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-066ffd86-f697-48c8-8716-b16b3ca56595 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:29.121416 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-066ffd86-f697-48c8-8716-b16b3ca56595 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:29.257343 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-066ffd86-f697-48c8-8716-b16b3ca56595 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:59:29.265811 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-066ffd86-f697-48c8-8716-b16b3ca56595 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/2e716aa7-08cb-4992-b853-b1d6a6e28d81" status: 200 len: 1201 microversion: 2.1 time: 0.159166 Oct 19 03:59:29.266442 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3463/6840] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:59:29 2022] GET /compute/v2.1/servers/2e716aa7-08cb-4992-b853-b1d6a6e28d81 => generated 1201 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:59:30.289660 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c8eb8255-1b13-4568-86a5-f64f91c6565a tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:59:30.290254 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c8eb8255-1b13-4568-86a5-f64f91c6565a tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 2e716aa7-08cb-4992-b853-b1d6a6e28d81] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:59:30.297814 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c8eb8255-1b13-4568-86a5-f64f91c6565a tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:30.298336 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c8eb8255-1b13-4568-86a5-f64f91c6565a tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:30.298782 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c8eb8255-1b13-4568-86a5-f64f91c6565a tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:30.299681 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c8eb8255-1b13-4568-86a5-f64f91c6565a tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:30.300154 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c8eb8255-1b13-4568-86a5-f64f91c6565a tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:30.300585 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c8eb8255-1b13-4568-86a5-f64f91c6565a tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:30.428883 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c8eb8255-1b13-4568-86a5-f64f91c6565a tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:59:30.436698 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c8eb8255-1b13-4568-86a5-f64f91c6565a tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/2e716aa7-08cb-4992-b853-b1d6a6e28d81" status: 200 len: 1388 microversion: 2.1 time: 0.150954 Oct 19 03:59:30.437270 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3464/6841] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:59:30 2022] GET /compute/v2.1/servers/2e716aa7-08cb-4992-b853-b1d6a6e28d81 => generated 1388 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:59:30.458646 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4199e16a-a769-454c-98fb-87e26cd55478 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:59:30.462294 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4199e16a-a769-454c-98fb-87e26cd55478 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 2e716aa7-08cb-4992-b853-b1d6a6e28d81] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:59:30.464883 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4199e16a-a769-454c-98fb-87e26cd55478 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:30.465385 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4199e16a-a769-454c-98fb-87e26cd55478 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:30.465831 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4199e16a-a769-454c-98fb-87e26cd55478 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:30.466518 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4199e16a-a769-454c-98fb-87e26cd55478 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:30.467003 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4199e16a-a769-454c-98fb-87e26cd55478 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:30.467430 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4199e16a-a769-454c-98fb-87e26cd55478 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:30.602003 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-4199e16a-a769-454c-98fb-87e26cd55478 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:59:30.610694 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4199e16a-a769-454c-98fb-87e26cd55478 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/2e716aa7-08cb-4992-b853-b1d6a6e28d81" status: 200 len: 1388 microversion: 2.1 time: 0.155526 Oct 19 03:59:30.611274 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3465/6842] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:59:30 2022] GET /compute/v2.1/servers/2e716aa7-08cb-4992-b853-b1d6a6e28d81 => generated 1388 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:59:30.631763 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1aac873a-d5d5-4fde-9a46-9c7620928ecc tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:59:30.632378 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1aac873a-d5d5-4fde-9a46-9c7620928ecc tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 2e716aa7-08cb-4992-b853-b1d6a6e28d81] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:59:30.638127 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1aac873a-d5d5-4fde-9a46-9c7620928ecc tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:30.638613 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1aac873a-d5d5-4fde-9a46-9c7620928ecc tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:30.639058 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1aac873a-d5d5-4fde-9a46-9c7620928ecc tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:30.640250 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1aac873a-d5d5-4fde-9a46-9c7620928ecc tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:30.640708 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1aac873a-d5d5-4fde-9a46-9c7620928ecc tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:30.641140 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1aac873a-d5d5-4fde-9a46-9c7620928ecc tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:30.770339 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-1aac873a-d5d5-4fde-9a46-9c7620928ecc tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:59:30.778446 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1aac873a-d5d5-4fde-9a46-9c7620928ecc tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/2e716aa7-08cb-4992-b853-b1d6a6e28d81" status: 200 len: 1388 microversion: 2.1 time: 0.150205 Oct 19 03:59:30.779033 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3466/6843] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:59:30 2022] GET /compute/v2.1/servers/2e716aa7-08cb-4992-b853-b1d6a6e28d81 => generated 1388 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:59:30.802131 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3632b793-8163-4200-8338-870d61f1fbe2 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:59:30.802686 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3632b793-8163-4200-8338-870d61f1fbe2 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 2e716aa7-08cb-4992-b853-b1d6a6e28d81] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:59:30.808935 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3632b793-8163-4200-8338-870d61f1fbe2 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:30.809764 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3632b793-8163-4200-8338-870d61f1fbe2 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:30.810284 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3632b793-8163-4200-8338-870d61f1fbe2 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:30.811030 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3632b793-8163-4200-8338-870d61f1fbe2 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:30.811555 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3632b793-8163-4200-8338-870d61f1fbe2 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:30.811995 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3632b793-8163-4200-8338-870d61f1fbe2 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:30.836521 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3632b793-8163-4200-8338-870d61f1fbe2 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 2e716aa7-08cb-4992-b853-b1d6a6e28d81] Going to try to terminate instance {{(pid=121134) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:59:31.072592 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3632b793-8163-4200-8338-870d61f1fbe2 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "DELETE /compute/v2.1/servers/2e716aa7-08cb-4992-b853-b1d6a6e28d81" status: 204 len: 0 microversion: 2.1 time: 0.275491 Oct 19 03:59:31.073198 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3467/6844] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:59:30 2022] DELETE /compute/v2.1/servers/2e716aa7-08cb-4992-b853-b1d6a6e28d81 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 19 03:59:31.082145 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-29b97ec2-ae4f-4066-957d-d36d77346a69 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:59:31.082841 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-29b97ec2-ae4f-4066-957d-d36d77346a69 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 2e716aa7-08cb-4992-b853-b1d6a6e28d81] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:59:31.089539 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-29b97ec2-ae4f-4066-957d-d36d77346a69 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:31.090023 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-29b97ec2-ae4f-4066-957d-d36d77346a69 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:31.090463 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-29b97ec2-ae4f-4066-957d-d36d77346a69 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:31.091153 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-29b97ec2-ae4f-4066-957d-d36d77346a69 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:31.091607 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-29b97ec2-ae4f-4066-957d-d36d77346a69 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:31.092042 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-29b97ec2-ae4f-4066-957d-d36d77346a69 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:31.134166 n-d-861333-8 devstack@n-api.service[121135]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 03:59:31.134765 n-d-861333-8 devstack@n-api.service[121135]: Wed Oct 19 03:59:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.52) !!! Oct 19 03:59:31.137784 n-d-861333-8 devstack@n-api.service[121135]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 03:59:31.137913 n-d-861333-8 devstack@n-api.service[121135]: Wed Oct 19 03:59:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.52) !!! Oct 19 03:59:31.220869 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-29b97ec2-ae4f-4066-957d-d36d77346a69 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:59:31.228987 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-29b97ec2-ae4f-4066-957d-d36d77346a69 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/2e716aa7-08cb-4992-b853-b1d6a6e28d81" status: 200 len: 1394 microversion: 2.1 time: 0.151482 Oct 19 03:59:31.229592 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3468/6845] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:59:31 2022] GET /compute/v2.1/servers/2e716aa7-08cb-4992-b853-b1d6a6e28d81 => generated 1394 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:59:32.252177 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-151f6b37-a911-4252-b2c1-395544c1d925 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:59:32.252843 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-151f6b37-a911-4252-b2c1-395544c1d925 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 2e716aa7-08cb-4992-b853-b1d6a6e28d81] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:59:32.259806 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-151f6b37-a911-4252-b2c1-395544c1d925 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:32.260297 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-151f6b37-a911-4252-b2c1-395544c1d925 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:32.260749 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-151f6b37-a911-4252-b2c1-395544c1d925 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:32.261474 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-151f6b37-a911-4252-b2c1-395544c1d925 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:32.261937 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-151f6b37-a911-4252-b2c1-395544c1d925 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:32.262373 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-151f6b37-a911-4252-b2c1-395544c1d925 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:32.395390 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-151f6b37-a911-4252-b2c1-395544c1d925 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:59:32.403596 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-151f6b37-a911-4252-b2c1-395544c1d925 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/2e716aa7-08cb-4992-b853-b1d6a6e28d81" status: 200 len: 1394 microversion: 2.1 time: 0.155413 Oct 19 03:59:32.404369 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3469/6846] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:59:32 2022] GET /compute/v2.1/servers/2e716aa7-08cb-4992-b853-b1d6a6e28d81 => generated 1394 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:59:32.563370 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9f441597-e204-43f0-be29-df297e377870 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:59:32.563881 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9f441597-e204-43f0-be29-df297e377870 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: 908ca82f-86ba-40c5-95b8-ee0f51588c9b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:59:32.570056 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9f441597-e204-43f0-be29-df297e377870 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:32.570553 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9f441597-e204-43f0-be29-df297e377870 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:32.571003 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9f441597-e204-43f0-be29-df297e377870 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:32.571705 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9f441597-e204-43f0-be29-df297e377870 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:32.572167 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9f441597-e204-43f0-be29-df297e377870 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:32.572661 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9f441597-e204-43f0-be29-df297e377870 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:32.654825 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-9f441597-e204-43f0-be29-df297e377870 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lazy-loading 'services' on Instance uuid 908ca82f-86ba-40c5-95b8-ee0f51588c9b {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:59:32.850607 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9f441597-e204-43f0-be29-df297e377870 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "DELETE /compute/v2.1/servers/908ca82f-86ba-40c5-95b8-ee0f51588c9b/os-volume_attachments/f8d7fa13-da9c-4b41-917f-5f6c97f88e34" status: 202 len: 0 microversion: 2.1 time: 0.291531 Oct 19 03:59:32.851220 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3470/6847] 10.222.0.52 () {58 vars in 1416 bytes} [Wed Oct 19 03:59:32 2022] DELETE /compute/v2.1/servers/908ca82f-86ba-40c5-95b8-ee0f51588c9b/os-volume_attachments/f8d7fa13-da9c-4b41-917f-5f6c97f88e34 => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 19 03:59:32.860244 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3aecbb9f-84c6-4745-81ea-47f31b8202ec tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:59:32.863196 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3aecbb9f-84c6-4745-81ea-47f31b8202ec tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: 908ca82f-86ba-40c5-95b8-ee0f51588c9b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:59:32.869627 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3aecbb9f-84c6-4745-81ea-47f31b8202ec tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:32.870129 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3aecbb9f-84c6-4745-81ea-47f31b8202ec tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:32.870575 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3aecbb9f-84c6-4745-81ea-47f31b8202ec tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:32.871305 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3aecbb9f-84c6-4745-81ea-47f31b8202ec tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:32.871777 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3aecbb9f-84c6-4745-81ea-47f31b8202ec tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:32.872206 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3aecbb9f-84c6-4745-81ea-47f31b8202ec tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:32.903855 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3aecbb9f-84c6-4745-81ea-47f31b8202ec tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "GET /compute/v2.1/servers/908ca82f-86ba-40c5-95b8-ee0f51588c9b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048116 Oct 19 03:59:32.904423 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3471/6848] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Oct 19 03:59:32 2022] GET /compute/v2.1/servers/908ca82f-86ba-40c5-95b8-ee0f51588c9b/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:59:33.428993 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5074d48a-0741-4fe4-9da9-d044c90cc8dc tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:59:33.429712 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5074d48a-0741-4fe4-9da9-d044c90cc8dc tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 2e716aa7-08cb-4992-b853-b1d6a6e28d81] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:59:33.442556 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5074d48a-0741-4fe4-9da9-d044c90cc8dc tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:33.443080 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5074d48a-0741-4fe4-9da9-d044c90cc8dc tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:33.443523 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5074d48a-0741-4fe4-9da9-d044c90cc8dc tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:33.444249 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5074d48a-0741-4fe4-9da9-d044c90cc8dc tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:33.444705 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5074d48a-0741-4fe4-9da9-d044c90cc8dc tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:33.445132 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5074d48a-0741-4fe4-9da9-d044c90cc8dc tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:33.457454 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:59:33.531685 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5074d48a-0741-4fe4-9da9-d044c90cc8dc tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:59:33.540598 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5074d48a-0741-4fe4-9da9-d044c90cc8dc tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/2e716aa7-08cb-4992-b853-b1d6a6e28d81" status: 200 len: 1352 microversion: 2.1 time: 0.116850 Oct 19 03:59:33.553394 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3472/6849] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:59:33 2022] GET /compute/v2.1/servers/2e716aa7-08cb-4992-b853-b1d6a6e28d81 => generated 1352 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:59:33.553394 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-dba1fbb9-ea36-4371-8a88-0c4490e22541 req-c95407cb-c8e8-4c87-ae8d-3bf1dd105f7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e716aa7-08cb-4992-b853-b1d6a6e28d81", "name": "network-vif-deleted", "tag": "f03f946f-d164-426a-bea8-df675173e06d"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:59:33.561842 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-dba1fbb9-ea36-4371-8a88-0c4490e22541 req-c95407cb-c8e8-4c87-ae8d-3bf1dd105f7d service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:33.561842 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-dba1fbb9-ea36-4371-8a88-0c4490e22541 req-c95407cb-c8e8-4c87-ae8d-3bf1dd105f7d service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:33.561842 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-dba1fbb9-ea36-4371-8a88-0c4490e22541 req-c95407cb-c8e8-4c87-ae8d-3bf1dd105f7d service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:33.578330 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-dba1fbb9-ea36-4371-8a88-0c4490e22541 req-c95407cb-c8e8-4c87-ae8d-3bf1dd105f7d service nova] Creating event network-vif-deleted:f03f946f-d164-426a-bea8-df675173e06d for instance 2e716aa7-08cb-4992-b853-b1d6a6e28d81 on n-h2-861333-8 Oct 19 03:59:33.582327 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-dba1fbb9-ea36-4371-8a88-0c4490e22541 req-c95407cb-c8e8-4c87-ae8d-3bf1dd105f7d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039542 Oct 19 03:59:33.583259 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3473/6850] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:59:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:59:33.917083 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8700e762-e369-48bd-ae50-3c7774fb2ea2 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:59:33.919412 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8700e762-e369-48bd-ae50-3c7774fb2ea2 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: 908ca82f-86ba-40c5-95b8-ee0f51588c9b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:59:33.926276 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8700e762-e369-48bd-ae50-3c7774fb2ea2 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:33.926774 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8700e762-e369-48bd-ae50-3c7774fb2ea2 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:33.927222 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8700e762-e369-48bd-ae50-3c7774fb2ea2 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:33.927928 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8700e762-e369-48bd-ae50-3c7774fb2ea2 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:33.928390 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8700e762-e369-48bd-ae50-3c7774fb2ea2 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:33.928825 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8700e762-e369-48bd-ae50-3c7774fb2ea2 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:33.959229 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8700e762-e369-48bd-ae50-3c7774fb2ea2 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "GET /compute/v2.1/servers/908ca82f-86ba-40c5-95b8-ee0f51588c9b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046716 Oct 19 03:59:33.959802 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3474/6851] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Oct 19 03:59:33 2022] GET /compute/v2.1/servers/908ca82f-86ba-40c5-95b8-ee0f51588c9b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:59:34.569845 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b9c413f4-48ff-4344-8f2a-79b955a0ad83 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:59:34.570469 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b9c413f4-48ff-4344-8f2a-79b955a0ad83 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 2e716aa7-08cb-4992-b853-b1d6a6e28d81] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:59:34.577425 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b9c413f4-48ff-4344-8f2a-79b955a0ad83 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:34.577919 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b9c413f4-48ff-4344-8f2a-79b955a0ad83 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:34.578368 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b9c413f4-48ff-4344-8f2a-79b955a0ad83 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:34.579071 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b9c413f4-48ff-4344-8f2a-79b955a0ad83 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:34.579528 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b9c413f4-48ff-4344-8f2a-79b955a0ad83 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:34.579957 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b9c413f4-48ff-4344-8f2a-79b955a0ad83 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:34.642517 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b9c413f4-48ff-4344-8f2a-79b955a0ad83 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:59:34.650863 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b9c413f4-48ff-4344-8f2a-79b955a0ad83 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/2e716aa7-08cb-4992-b853-b1d6a6e28d81" status: 200 len: 1186 microversion: 2.1 time: 0.085167 Oct 19 03:59:34.651519 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3475/6852] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:59:34 2022] GET /compute/v2.1/servers/2e716aa7-08cb-4992-b853-b1d6a6e28d81 => generated 1186 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:59:34.972322 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-cf1df4ec-0675-4d9e-8205-8f06a03be377 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:59:34.986578 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-cf1df4ec-0675-4d9e-8205-8f06a03be377 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: 908ca82f-86ba-40c5-95b8-ee0f51588c9b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:59:34.986578 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cf1df4ec-0675-4d9e-8205-8f06a03be377 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:34.986578 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cf1df4ec-0675-4d9e-8205-8f06a03be377 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:34.986578 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cf1df4ec-0675-4d9e-8205-8f06a03be377 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:34.986578 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cf1df4ec-0675-4d9e-8205-8f06a03be377 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:34.986578 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cf1df4ec-0675-4d9e-8205-8f06a03be377 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:34.986578 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cf1df4ec-0675-4d9e-8205-8f06a03be377 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:35.012392 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-cf1df4ec-0675-4d9e-8205-8f06a03be377 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "GET /compute/v2.1/servers/908ca82f-86ba-40c5-95b8-ee0f51588c9b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044509 Oct 19 03:59:35.012982 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3476/6853] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Oct 19 03:59:34 2022] GET /compute/v2.1/servers/908ca82f-86ba-40c5-95b8-ee0f51588c9b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:59:35.675468 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ff6076c6-e98f-4f42-a58c-448f9f14015d tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:59:35.676228 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ff6076c6-e98f-4f42-a58c-448f9f14015d tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 2e716aa7-08cb-4992-b853-b1d6a6e28d81] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:59:35.683280 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ff6076c6-e98f-4f42-a58c-448f9f14015d tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:35.683771 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ff6076c6-e98f-4f42-a58c-448f9f14015d tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:35.684224 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ff6076c6-e98f-4f42-a58c-448f9f14015d tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:35.684923 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ff6076c6-e98f-4f42-a58c-448f9f14015d tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:35.685397 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ff6076c6-e98f-4f42-a58c-448f9f14015d tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:35.685836 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ff6076c6-e98f-4f42-a58c-448f9f14015d tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:35.748510 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ff6076c6-e98f-4f42-a58c-448f9f14015d tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:59:35.757524 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ff6076c6-e98f-4f42-a58c-448f9f14015d tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/2e716aa7-08cb-4992-b853-b1d6a6e28d81" status: 200 len: 1186 microversion: 2.1 time: 0.085965 Oct 19 03:59:35.758452 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3477/6854] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:59:35 2022] GET /compute/v2.1/servers/2e716aa7-08cb-4992-b853-b1d6a6e28d81 => generated 1186 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:59:36.024672 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5962a1a6-47a4-4b81-ae7f-39378be28ec2 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:59:36.027175 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5962a1a6-47a4-4b81-ae7f-39378be28ec2 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: 908ca82f-86ba-40c5-95b8-ee0f51588c9b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:59:36.033531 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5962a1a6-47a4-4b81-ae7f-39378be28ec2 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:36.034039 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5962a1a6-47a4-4b81-ae7f-39378be28ec2 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:36.034480 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5962a1a6-47a4-4b81-ae7f-39378be28ec2 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:36.035198 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5962a1a6-47a4-4b81-ae7f-39378be28ec2 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:36.035662 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5962a1a6-47a4-4b81-ae7f-39378be28ec2 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:36.036100 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5962a1a6-47a4-4b81-ae7f-39378be28ec2 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:36.068053 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5962a1a6-47a4-4b81-ae7f-39378be28ec2 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "GET /compute/v2.1/servers/908ca82f-86ba-40c5-95b8-ee0f51588c9b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047659 Oct 19 03:59:36.068630 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3478/6855] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Oct 19 03:59:36 2022] GET /compute/v2.1/servers/908ca82f-86ba-40c5-95b8-ee0f51588c9b/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 03:59:36.678074 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8ce06af3-6aba-45b5-8303-c57ff59f9e3f tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:59:36.678691 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8ce06af3-6aba-45b5-8303-c57ff59f9e3f tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: 6de16745-5838-4ba1-b987-1e1e4084dd7f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:59:36.685577 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8ce06af3-6aba-45b5-8303-c57ff59f9e3f tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:36.686076 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8ce06af3-6aba-45b5-8303-c57ff59f9e3f tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:36.686560 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8ce06af3-6aba-45b5-8303-c57ff59f9e3f tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:36.687330 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8ce06af3-6aba-45b5-8303-c57ff59f9e3f tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:36.687799 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8ce06af3-6aba-45b5-8303-c57ff59f9e3f tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:36.688235 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8ce06af3-6aba-45b5-8303-c57ff59f9e3f tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:36.717038 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8ce06af3-6aba-45b5-8303-c57ff59f9e3f tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: 6de16745-5838-4ba1-b987-1e1e4084dd7f] Going to try to terminate instance {{(pid=121134) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:59:37.034239 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8ce06af3-6aba-45b5-8303-c57ff59f9e3f tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "DELETE /compute/v2.1/servers/6de16745-5838-4ba1-b987-1e1e4084dd7f" status: 204 len: 0 microversion: 2.1 time: 0.359071 Oct 19 03:59:37.038270 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3479/6856] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:59:36 2022] DELETE /compute/v2.1/servers/6de16745-5838-4ba1-b987-1e1e4084dd7f => generated 0 bytes in 362 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 03:59:37.045245 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-ce424211-f4c3-4184-81d3-69c66207acf4 req-4b286c50-b324-42a9-917f-009aef844212 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6de16745-5838-4ba1-b987-1e1e4084dd7f", "tag": "11ca3831-bfbb-4328-9073-14dcd2216de2"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:59:37.055080 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-ce424211-f4c3-4184-81d3-69c66207acf4 req-4b286c50-b324-42a9-917f-009aef844212 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:37.055582 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-ce424211-f4c3-4184-81d3-69c66207acf4 req-4b286c50-b324-42a9-917f-009aef844212 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:37.056014 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-ce424211-f4c3-4184-81d3-69c66207acf4 req-4b286c50-b324-42a9-917f-009aef844212 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:37.068417 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-ce424211-f4c3-4184-81d3-69c66207acf4 req-4b286c50-b324-42a9-917f-009aef844212 service nova] Creating event network-changed:11ca3831-bfbb-4328-9073-14dcd2216de2 for instance 6de16745-5838-4ba1-b987-1e1e4084dd7f on n-h1-861333-8 Oct 19 03:59:37.077768 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-ce424211-f4c3-4184-81d3-69c66207acf4 req-4b286c50-b324-42a9-917f-009aef844212 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036477 Oct 19 03:59:37.077768 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3480/6857] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:59:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:59:37.082754 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3dfeb1f3-6d45-4b6c-a8fb-ed367b8dc194 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:59:37.083867 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3dfeb1f3-6d45-4b6c-a8fb-ed367b8dc194 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 2e716aa7-08cb-4992-b853-b1d6a6e28d81] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:59:37.090377 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3dfeb1f3-6d45-4b6c-a8fb-ed367b8dc194 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:37.090871 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3dfeb1f3-6d45-4b6c-a8fb-ed367b8dc194 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:37.091313 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3dfeb1f3-6d45-4b6c-a8fb-ed367b8dc194 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:37.092020 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3dfeb1f3-6d45-4b6c-a8fb-ed367b8dc194 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:37.092480 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3dfeb1f3-6d45-4b6c-a8fb-ed367b8dc194 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:37.092953 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3dfeb1f3-6d45-4b6c-a8fb-ed367b8dc194 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:37.158505 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-3dfeb1f3-6d45-4b6c-a8fb-ed367b8dc194 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:59:37.167006 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3dfeb1f3-6d45-4b6c-a8fb-ed367b8dc194 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/2e716aa7-08cb-4992-b853-b1d6a6e28d81" status: 200 len: 1186 microversion: 2.1 time: 0.089933 Oct 19 03:59:37.171331 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3481/6858] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:59:37 2022] GET /compute/v2.1/servers/2e716aa7-08cb-4992-b853-b1d6a6e28d81 => generated 1186 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:59:37.172337 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8d64b9e8-223a-4df7-958b-cb1f27327b32 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:59:37.173207 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8d64b9e8-223a-4df7-958b-cb1f27327b32 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: 6de16745-5838-4ba1-b987-1e1e4084dd7f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:59:37.179417 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8d64b9e8-223a-4df7-958b-cb1f27327b32 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:37.179922 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8d64b9e8-223a-4df7-958b-cb1f27327b32 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:37.180366 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8d64b9e8-223a-4df7-958b-cb1f27327b32 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:37.181073 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8d64b9e8-223a-4df7-958b-cb1f27327b32 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:37.181576 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8d64b9e8-223a-4df7-958b-cb1f27327b32 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:37.182023 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8d64b9e8-223a-4df7-958b-cb1f27327b32 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:37.325016 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8d64b9e8-223a-4df7-958b-cb1f27327b32 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:59:37.334413 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8d64b9e8-223a-4df7-958b-cb1f27327b32 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/6de16745-5838-4ba1-b987-1e1e4084dd7f" status: 200 len: 1687 microversion: 2.1 time: 0.165780 Oct 19 03:59:37.338124 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3482/6859] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:59:37 2022] GET /compute/v2.1/servers/6de16745-5838-4ba1-b987-1e1e4084dd7f => generated 1687 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:59:37.340451 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2ca599d8-d451-4e10-af8c-1a2925c1578b tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:59:37.342911 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2ca599d8-d451-4e10-af8c-1a2925c1578b tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: 908ca82f-86ba-40c5-95b8-ee0f51588c9b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:59:37.356549 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2ca599d8-d451-4e10-af8c-1a2925c1578b tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:37.357226 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2ca599d8-d451-4e10-af8c-1a2925c1578b tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:37.357938 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2ca599d8-d451-4e10-af8c-1a2925c1578b tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:37.359119 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2ca599d8-d451-4e10-af8c-1a2925c1578b tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:37.359688 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2ca599d8-d451-4e10-af8c-1a2925c1578b tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:37.360282 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2ca599d8-d451-4e10-af8c-1a2925c1578b tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:37.393815 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2ca599d8-d451-4e10-af8c-1a2925c1578b tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "GET /compute/v2.1/servers/908ca82f-86ba-40c5-95b8-ee0f51588c9b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057504 Oct 19 03:59:37.394777 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3483/6860] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Oct 19 03:59:37 2022] GET /compute/v2.1/servers/908ca82f-86ba-40c5-95b8-ee0f51588c9b/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:59:38.190841 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-393364d2-5b56-467e-a8c2-9874921b4507 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:59:38.191483 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-393364d2-5b56-467e-a8c2-9874921b4507 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 2e716aa7-08cb-4992-b853-b1d6a6e28d81] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:59:38.198413 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-393364d2-5b56-467e-a8c2-9874921b4507 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:38.198912 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-393364d2-5b56-467e-a8c2-9874921b4507 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:38.199364 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-393364d2-5b56-467e-a8c2-9874921b4507 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:38.200074 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-393364d2-5b56-467e-a8c2-9874921b4507 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:38.200543 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-393364d2-5b56-467e-a8c2-9874921b4507 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:38.200981 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-393364d2-5b56-467e-a8c2-9874921b4507 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:38.264292 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-393364d2-5b56-467e-a8c2-9874921b4507 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:59:38.273555 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-393364d2-5b56-467e-a8c2-9874921b4507 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/2e716aa7-08cb-4992-b853-b1d6a6e28d81" status: 200 len: 1186 microversion: 2.1 time: 0.086588 Oct 19 03:59:38.274166 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3484/6861] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:59:38 2022] GET /compute/v2.1/servers/2e716aa7-08cb-4992-b853-b1d6a6e28d81 => generated 1186 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:59:38.360403 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e294c757-33e1-4edf-9695-9b9b64a4c0c9 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:59:38.360403 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e294c757-33e1-4edf-9695-9b9b64a4c0c9 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: 6de16745-5838-4ba1-b987-1e1e4084dd7f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:59:38.366853 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e294c757-33e1-4edf-9695-9b9b64a4c0c9 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:38.367430 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e294c757-33e1-4edf-9695-9b9b64a4c0c9 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:38.367950 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e294c757-33e1-4edf-9695-9b9b64a4c0c9 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:38.368755 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e294c757-33e1-4edf-9695-9b9b64a4c0c9 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:38.369296 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e294c757-33e1-4edf-9695-9b9b64a4c0c9 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:38.369862 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e294c757-33e1-4edf-9695-9b9b64a4c0c9 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:38.921225 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e294c757-33e1-4edf-9695-9b9b64a4c0c9 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:59:38.938138 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e294c757-33e1-4edf-9695-9b9b64a4c0c9 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/6de16745-5838-4ba1-b987-1e1e4084dd7f" status: 200 len: 1687 microversion: 2.1 time: 0.581134 Oct 19 03:59:38.955179 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3485/6862] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:59:38 2022] GET /compute/v2.1/servers/6de16745-5838-4ba1-b987-1e1e4084dd7f => generated 1687 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:59:38.963656 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-449da25a-09f3-4d18-9515-232bedae3d33 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:59:38.966629 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-449da25a-09f3-4d18-9515-232bedae3d33 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: 908ca82f-86ba-40c5-95b8-ee0f51588c9b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:59:38.975081 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-449da25a-09f3-4d18-9515-232bedae3d33 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:38.976353 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-449da25a-09f3-4d18-9515-232bedae3d33 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:38.977051 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-449da25a-09f3-4d18-9515-232bedae3d33 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:38.978041 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-449da25a-09f3-4d18-9515-232bedae3d33 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:38.978821 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-449da25a-09f3-4d18-9515-232bedae3d33 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:38.979314 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-449da25a-09f3-4d18-9515-232bedae3d33 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:39.017809 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-449da25a-09f3-4d18-9515-232bedae3d33 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "GET /compute/v2.1/servers/908ca82f-86ba-40c5-95b8-ee0f51588c9b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.061054 Oct 19 03:59:39.018391 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3486/6863] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Oct 19 03:59:38 2022] GET /compute/v2.1/servers/908ca82f-86ba-40c5-95b8-ee0f51588c9b/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 03:59:39.087165 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-68d5d009-6c93-4951-8708-45c147b9c7a5 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:59:39.087950 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-68d5d009-6c93-4951-8708-45c147b9c7a5 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: 908ca82f-86ba-40c5-95b8-ee0f51588c9b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:59:39.094782 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-68d5d009-6c93-4951-8708-45c147b9c7a5 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:39.095274 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-68d5d009-6c93-4951-8708-45c147b9c7a5 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:39.095712 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-68d5d009-6c93-4951-8708-45c147b9c7a5 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:39.096521 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-68d5d009-6c93-4951-8708-45c147b9c7a5 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:39.097009 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-68d5d009-6c93-4951-8708-45c147b9c7a5 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:39.097462 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-68d5d009-6c93-4951-8708-45c147b9c7a5 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:39.131052 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-68d5d009-6c93-4951-8708-45c147b9c7a5 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: 908ca82f-86ba-40c5-95b8-ee0f51588c9b] Going to try to terminate instance {{(pid=121134) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 03:59:39.175542 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:59:39.486810 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-68d5d009-6c93-4951-8708-45c147b9c7a5 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "DELETE /compute/v2.1/servers/908ca82f-86ba-40c5-95b8-ee0f51588c9b" status: 204 len: 0 microversion: 2.1 time: 0.403214 Oct 19 03:59:39.487447 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3487/6864] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:59:39 2022] DELETE /compute/v2.1/servers/908ca82f-86ba-40c5-95b8-ee0f51588c9b => generated 0 bytes in 405 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 19 03:59:39.497468 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4ab31b7f-e0aa-4c86-b7aa-52fd42d1c01d tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:59:39.498428 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4ab31b7f-e0aa-4c86-b7aa-52fd42d1c01d tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 2e716aa7-08cb-4992-b853-b1d6a6e28d81] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:59:39.504686 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4ab31b7f-e0aa-4c86-b7aa-52fd42d1c01d tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:39.505178 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4ab31b7f-e0aa-4c86-b7aa-52fd42d1c01d tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:39.505662 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4ab31b7f-e0aa-4c86-b7aa-52fd42d1c01d tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:39.506367 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4ab31b7f-e0aa-4c86-b7aa-52fd42d1c01d tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:39.506829 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4ab31b7f-e0aa-4c86-b7aa-52fd42d1c01d tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:39.507260 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4ab31b7f-e0aa-4c86-b7aa-52fd42d1c01d tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:39.576503 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-4ab31b7f-e0aa-4c86-b7aa-52fd42d1c01d tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:59:39.585579 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4ab31b7f-e0aa-4c86-b7aa-52fd42d1c01d tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/2e716aa7-08cb-4992-b853-b1d6a6e28d81" status: 200 len: 1186 microversion: 2.1 time: 0.096944 Oct 19 03:59:39.588569 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3488/6865] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:59:39 2022] GET /compute/v2.1/servers/2e716aa7-08cb-4992-b853-b1d6a6e28d81 => generated 1186 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:59:39.596588 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-177437f2-2e20-492d-bfd2-96f4c022369b req-2cfcc3c7-d4a2-4369-8ab0-e85112971785 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6de16745-5838-4ba1-b987-1e1e4084dd7f", "name": "network-vif-deleted", "tag": "11ca3831-bfbb-4328-9073-14dcd2216de2"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:59:39.602541 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 03:59:39.607993 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-177437f2-2e20-492d-bfd2-96f4c022369b req-2cfcc3c7-d4a2-4369-8ab0-e85112971785 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:39.618535 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-177437f2-2e20-492d-bfd2-96f4c022369b req-2cfcc3c7-d4a2-4369-8ab0-e85112971785 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:39.618535 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-177437f2-2e20-492d-bfd2-96f4c022369b req-2cfcc3c7-d4a2-4369-8ab0-e85112971785 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:39.621532 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-177437f2-2e20-492d-bfd2-96f4c022369b req-2cfcc3c7-d4a2-4369-8ab0-e85112971785 service nova] Creating event network-vif-deleted:11ca3831-bfbb-4328-9073-14dcd2216de2 for instance 6de16745-5838-4ba1-b987-1e1e4084dd7f on n-h1-861333-8 Oct 19 03:59:39.626695 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-177437f2-2e20-492d-bfd2-96f4c022369b req-2cfcc3c7-d4a2-4369-8ab0-e85112971785 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039227 Oct 19 03:59:39.627295 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3489/6866] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:59:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:59:39.634742 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6115e042-e12f-43bf-b4d6-d67b671e8b3c tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:59:39.635445 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6115e042-e12f-43bf-b4d6-d67b671e8b3c tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: 908ca82f-86ba-40c5-95b8-ee0f51588c9b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:59:39.642906 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6115e042-e12f-43bf-b4d6-d67b671e8b3c tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:39.643402 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6115e042-e12f-43bf-b4d6-d67b671e8b3c tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:39.643845 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6115e042-e12f-43bf-b4d6-d67b671e8b3c tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:39.644576 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6115e042-e12f-43bf-b4d6-d67b671e8b3c tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:39.645069 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6115e042-e12f-43bf-b4d6-d67b671e8b3c tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:39.645692 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6115e042-e12f-43bf-b4d6-d67b671e8b3c tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:39.788011 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-6115e042-e12f-43bf-b4d6-d67b671e8b3c tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14706e15b5d7487a9b1d1a6332f93f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea131e741ef34573aa73360c5010221a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:59:39.797078 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6115e042-e12f-43bf-b4d6-d67b671e8b3c tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "GET /compute/v2.1/servers/908ca82f-86ba-40c5-95b8-ee0f51588c9b" status: 200 len: 1682 microversion: 2.1 time: 0.166094 Oct 19 03:59:39.797987 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3490/6867] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:59:39 2022] GET /compute/v2.1/servers/908ca82f-86ba-40c5-95b8-ee0f51588c9b => generated 1682 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:59:39.969261 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-552b39ce-a890-4e20-98b9-530967128a15 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:59:39.969988 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-552b39ce-a890-4e20-98b9-530967128a15 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: 6de16745-5838-4ba1-b987-1e1e4084dd7f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:59:39.976525 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-552b39ce-a890-4e20-98b9-530967128a15 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:39.977029 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-552b39ce-a890-4e20-98b9-530967128a15 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:39.980857 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-552b39ce-a890-4e20-98b9-530967128a15 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:39.980857 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-552b39ce-a890-4e20-98b9-530967128a15 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:39.980857 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-552b39ce-a890-4e20-98b9-530967128a15 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:39.980857 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-552b39ce-a890-4e20-98b9-530967128a15 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:40.014031 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-552b39ce-a890-4e20-98b9-530967128a15 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:40.015044 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-552b39ce-a890-4e20-98b9-530967128a15 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:40.015495 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-552b39ce-a890-4e20-98b9-530967128a15 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:40.015960 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-552b39ce-a890-4e20-98b9-530967128a15 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lazy-loading 'fault' on Instance uuid 6de16745-5838-4ba1-b987-1e1e4084dd7f {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:59:40.057544 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-552b39ce-a890-4e20-98b9-530967128a15 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63367855cc9468f8512a87e89b8606d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe972f4874424bf89e9ed0bfcb69f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:59:40.066148 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-552b39ce-a890-4e20-98b9-530967128a15 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/6de16745-5838-4ba1-b987-1e1e4084dd7f" status: 200 len: 1354 microversion: 2.1 time: 0.101927 Oct 19 03:59:40.066813 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3491/6868] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:59:39 2022] GET /compute/v2.1/servers/6de16745-5838-4ba1-b987-1e1e4084dd7f => generated 1354 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:59:40.610521 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b6da340f-6e67-49aa-be4c-6230cd15f22d tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:59:40.611167 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b6da340f-6e67-49aa-be4c-6230cd15f22d tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 2e716aa7-08cb-4992-b853-b1d6a6e28d81] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:59:40.618533 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b6da340f-6e67-49aa-be4c-6230cd15f22d tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:40.619035 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b6da340f-6e67-49aa-be4c-6230cd15f22d tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:40.619530 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b6da340f-6e67-49aa-be4c-6230cd15f22d tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:40.620220 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b6da340f-6e67-49aa-be4c-6230cd15f22d tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:40.620726 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b6da340f-6e67-49aa-be4c-6230cd15f22d tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:40.621116 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b6da340f-6e67-49aa-be4c-6230cd15f22d tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:40.688569 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b6da340f-6e67-49aa-be4c-6230cd15f22d tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:59:40.696768 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b6da340f-6e67-49aa-be4c-6230cd15f22d tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/2e716aa7-08cb-4992-b853-b1d6a6e28d81" status: 200 len: 1186 microversion: 2.1 time: 0.090741 Oct 19 03:59:40.697741 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3492/6869] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:59:40 2022] GET /compute/v2.1/servers/2e716aa7-08cb-4992-b853-b1d6a6e28d81 => generated 1186 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:59:40.820671 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-991c530b-3001-4199-a8ae-bf41ff16bf53 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:59:40.821205 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-991c530b-3001-4199-a8ae-bf41ff16bf53 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: 908ca82f-86ba-40c5-95b8-ee0f51588c9b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:59:40.827854 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-991c530b-3001-4199-a8ae-bf41ff16bf53 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:40.828745 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-991c530b-3001-4199-a8ae-bf41ff16bf53 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:40.829562 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-991c530b-3001-4199-a8ae-bf41ff16bf53 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:40.830452 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-991c530b-3001-4199-a8ae-bf41ff16bf53 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:40.830922 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-991c530b-3001-4199-a8ae-bf41ff16bf53 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:40.831362 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-991c530b-3001-4199-a8ae-bf41ff16bf53 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:40.962702 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-991c530b-3001-4199-a8ae-bf41ff16bf53 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14706e15b5d7487a9b1d1a6332f93f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea131e741ef34573aa73360c5010221a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:59:40.971410 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-991c530b-3001-4199-a8ae-bf41ff16bf53 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "GET /compute/v2.1/servers/908ca82f-86ba-40c5-95b8-ee0f51588c9b" status: 200 len: 1682 microversion: 2.1 time: 0.154786 Oct 19 03:59:40.972030 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3493/6870] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:59:40 2022] GET /compute/v2.1/servers/908ca82f-86ba-40c5-95b8-ee0f51588c9b => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:59:41.090041 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-cd61a041-61ef-45e8-b334-79860d33bd95 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:59:41.090574 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-cd61a041-61ef-45e8-b334-79860d33bd95 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] [instance: 6de16745-5838-4ba1-b987-1e1e4084dd7f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:59:41.097164 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cd61a041-61ef-45e8-b334-79860d33bd95 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:41.097692 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cd61a041-61ef-45e8-b334-79860d33bd95 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:41.098130 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cd61a041-61ef-45e8-b334-79860d33bd95 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:41.098836 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cd61a041-61ef-45e8-b334-79860d33bd95 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:41.099280 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cd61a041-61ef-45e8-b334-79860d33bd95 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:41.099708 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cd61a041-61ef-45e8-b334-79860d33bd95 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:41.113816 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-cd61a041-61ef-45e8-b334-79860d33bd95 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] HTTP exception thrown: Instance 6de16745-5838-4ba1-b987-1e1e4084dd7f could not be found. Oct 19 03:59:41.115396 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-cd61a041-61ef-45e8-b334-79860d33bd95 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Request method failure captured: Oct 19 03:59:41.115396 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/6de16745-5838-4ba1-b987-1e1e4084dd7f HTTP/1.1 Oct 19 03:59:41.115396 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:59:41.115396 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:59:41.115396 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:59:41.115396 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:59:41.115396 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:59:41.115396 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:59:41.115396 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:59:41.115396 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:59:41.115396 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3NwoLvkX1ASv7BWG8n03-wyV-PHrk4Zzw5wyutTUqINpvyr9PXOVTlUcdwMhf8Q5ZkPK7itp1Hf4ku46LTSLnpDmtKa_b_RS1LRUWqOcdFLvZqgZoywIxoBs14di1P9oAs26SP9if5E5-uZy9hDECUpYA7EORF5pEKdwwte-cPfVLw Oct 19 03:59:41.115396 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:59:41.115396 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:59:41.115396 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:59:41.115396 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:59:41.115396 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:59:41.115396 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:59:41.115396 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: fe972f4874424bf89e9ed0bfcb69f050 Oct 19 03:59:41.115396 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-374576753 Oct 19 03:59:41.115396 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:59:41.115396 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:59:41.115396 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/fe972f4874424bf89e9ed0bfcb69f050"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe972f4874424bf89e9ed0bfcb69f050"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe972f4874424bf89e9ed0bfcb69f050"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_fe972f4874424bf89e9ed0bfcb69f050", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:59:41.115396 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-TestNetworkAdvancedServerOps-374576753 Oct 19 03:59:41.115396 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: fe972f4874424bf89e9ed0bfcb69f050 Oct 19 03:59:41.115396 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-374576753 Oct 19 03:59:41.115396 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-TestNetworkAdvancedServerOps-374576753-project Oct 19 03:59:41.115396 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:59:41.115396 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:59:41.115396 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: b63367855cc9468f8512a87e89b8606d Oct 19 03:59:41.115396 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-TestNetworkAdvancedServerOps-374576753-project Oct 19 03:59:41.115396 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:59:41.115396 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance 6de16745-5838-4ba1-b987-1e1e4084dd7f could not be found. Oct 19 03:59:41.115396 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '6de16745-5838-4ba1-b987-1e1e4084dd7f'} Oct 19 03:59:41.115396 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:59:41.115396 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:59:41.115396 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:59:41.115396 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:59:41.115396 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:59:41.115396 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:59:41.115396 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:59:41.115396 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:59:41.115396 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:59:41.115396 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:59:41.115396 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6de16745-5838-4ba1-b987-1e1e4084dd7f could not be found. Oct 19 03:59:41.115396 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:59:41.115396 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:59:41.115396 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:59:41.115396 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:59:41.115396 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:59:41.115396 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:59:41.115396 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:59:41.115396 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:59:41.115396 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:59:41.115396 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:59:41.115396 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:59:41.115396 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:59:41.115396 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:59:41.115396 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:59:41.115396 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:59:41.115396 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:59:41.115396 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6de16745-5838-4ba1-b987-1e1e4084dd7f could not be found. Oct 19 03:59:41.115396 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:59:41.115396 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:59:41.119833 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:59:41.119833 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:59:41.119833 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:59:41.119833 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:59:41.119833 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:59:41.119833 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:59:41.119833 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6de16745-5838-4ba1-b987-1e1e4084dd7f could not be found. Oct 19 03:59:41.119833 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:59:41.119833 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-cd61a041-61ef-45e8-b334-79860d33bd95 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Returning 404 to user: Instance 6de16745-5838-4ba1-b987-1e1e4084dd7f could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:59:41.119833 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-cd61a041-61ef-45e8-b334-79860d33bd95 tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "GET /compute/v2.1/servers/6de16745-5838-4ba1-b987-1e1e4084dd7f" status: 404 len: 111 microversion: 2.1 time: 0.030929 Oct 19 03:59:41.119833 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3494/6871] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:59:41 2022] GET /compute/v2.1/servers/6de16745-5838-4ba1-b987-1e1e4084dd7f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 03:59:41.720943 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a92bced8-18ba-4608-bf8a-a36528b61abd tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:59:41.724623 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a92bced8-18ba-4608-bf8a-a36528b61abd tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 2e716aa7-08cb-4992-b853-b1d6a6e28d81] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:59:41.733295 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a92bced8-18ba-4608-bf8a-a36528b61abd tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:41.735631 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a92bced8-18ba-4608-bf8a-a36528b61abd tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:41.738049 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a92bced8-18ba-4608-bf8a-a36528b61abd tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:41.739082 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a92bced8-18ba-4608-bf8a-a36528b61abd tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:41.739541 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a92bced8-18ba-4608-bf8a-a36528b61abd tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:41.739977 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a92bced8-18ba-4608-bf8a-a36528b61abd tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:41.816141 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a92bced8-18ba-4608-bf8a-a36528b61abd tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:59:41.824977 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a92bced8-18ba-4608-bf8a-a36528b61abd tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/2e716aa7-08cb-4992-b853-b1d6a6e28d81" status: 200 len: 1186 microversion: 2.1 time: 0.109224 Oct 19 03:59:41.838613 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3495/6872] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:59:41 2022] GET /compute/v2.1/servers/2e716aa7-08cb-4992-b853-b1d6a6e28d81 => generated 1186 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:59:41.996272 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-22c6ef13-4a15-443a-999f-4b74554f3373 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:59:41.997048 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-22c6ef13-4a15-443a-999f-4b74554f3373 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: 908ca82f-86ba-40c5-95b8-ee0f51588c9b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:59:42.004181 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-22c6ef13-4a15-443a-999f-4b74554f3373 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:42.004802 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-22c6ef13-4a15-443a-999f-4b74554f3373 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:42.005353 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-22c6ef13-4a15-443a-999f-4b74554f3373 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:42.006185 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-22c6ef13-4a15-443a-999f-4b74554f3373 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:42.006776 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-22c6ef13-4a15-443a-999f-4b74554f3373 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:42.007430 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-22c6ef13-4a15-443a-999f-4b74554f3373 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:42.111856 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-22c6ef13-4a15-443a-999f-4b74554f3373 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14706e15b5d7487a9b1d1a6332f93f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea131e741ef34573aa73360c5010221a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:59:42.120835 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-22c6ef13-4a15-443a-999f-4b74554f3373 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "GET /compute/v2.1/servers/908ca82f-86ba-40c5-95b8-ee0f51588c9b" status: 200 len: 1615 microversion: 2.1 time: 0.128342 Oct 19 03:59:42.122263 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3496/6873] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:59:41 2022] GET /compute/v2.1/servers/908ca82f-86ba-40c5-95b8-ee0f51588c9b => generated 1615 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:59:42.230295 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-eb18ead2-9b7a-48cc-9491-f819db774ad1 req-82a056a9-78fb-4ab7-af6f-9715af5f23e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "908ca82f-86ba-40c5-95b8-ee0f51588c9b", "name": "network-vif-deleted", "tag": "f8bac4df-22bc-4f9f-80d5-5a0ac74800e4"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 03:59:42.247893 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-eb18ead2-9b7a-48cc-9491-f819db774ad1 req-82a056a9-78fb-4ab7-af6f-9715af5f23e3 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:42.248580 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-eb18ead2-9b7a-48cc-9491-f819db774ad1 req-82a056a9-78fb-4ab7-af6f-9715af5f23e3 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:42.249691 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-eb18ead2-9b7a-48cc-9491-f819db774ad1 req-82a056a9-78fb-4ab7-af6f-9715af5f23e3 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:42.279550 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-eb18ead2-9b7a-48cc-9491-f819db774ad1 req-82a056a9-78fb-4ab7-af6f-9715af5f23e3 service nova] Creating event network-vif-deleted:f8bac4df-22bc-4f9f-80d5-5a0ac74800e4 for instance 908ca82f-86ba-40c5-95b8-ee0f51588c9b on n-h2-861333-8 Oct 19 03:59:42.296584 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-eb18ead2-9b7a-48cc-9491-f819db774ad1 req-82a056a9-78fb-4ab7-af6f-9715af5f23e3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069247 Oct 19 03:59:42.297940 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3497/6874] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 03:59:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 03:59:42.853083 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3091329d-a0fc-49cd-9e3c-84e0dceef716 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:59:42.853843 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3091329d-a0fc-49cd-9e3c-84e0dceef716 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 2e716aa7-08cb-4992-b853-b1d6a6e28d81] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:59:42.870440 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3091329d-a0fc-49cd-9e3c-84e0dceef716 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:42.872884 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3091329d-a0fc-49cd-9e3c-84e0dceef716 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:42.878068 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3091329d-a0fc-49cd-9e3c-84e0dceef716 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:42.879062 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3091329d-a0fc-49cd-9e3c-84e0dceef716 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:42.879719 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3091329d-a0fc-49cd-9e3c-84e0dceef716 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:42.882071 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3091329d-a0fc-49cd-9e3c-84e0dceef716 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:42.948113 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3091329d-a0fc-49cd-9e3c-84e0dceef716 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:42.948669 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3091329d-a0fc-49cd-9e3c-84e0dceef716 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:42.949128 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3091329d-a0fc-49cd-9e3c-84e0dceef716 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:42.950011 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-3091329d-a0fc-49cd-9e3c-84e0dceef716 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lazy-loading 'fault' on Instance uuid 2e716aa7-08cb-4992-b853-b1d6a6e28d81 {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:59:43.024718 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-3091329d-a0fc-49cd-9e3c-84e0dceef716 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:59:43.038787 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3091329d-a0fc-49cd-9e3c-84e0dceef716 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/2e716aa7-08cb-4992-b853-b1d6a6e28d81" status: 200 len: 1145 microversion: 2.1 time: 0.189411 Oct 19 03:59:43.038787 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3498/6875] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:59:42 2022] GET /compute/v2.1/servers/2e716aa7-08cb-4992-b853-b1d6a6e28d81 => generated 1145 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 03:59:43.148456 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2a98d1e5-20c7-4784-9b8b-3304d0bc4d06 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:59:43.149160 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2a98d1e5-20c7-4784-9b8b-3304d0bc4d06 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: 908ca82f-86ba-40c5-95b8-ee0f51588c9b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:59:43.162592 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2a98d1e5-20c7-4784-9b8b-3304d0bc4d06 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:43.163104 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2a98d1e5-20c7-4784-9b8b-3304d0bc4d06 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:43.163557 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2a98d1e5-20c7-4784-9b8b-3304d0bc4d06 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:43.173850 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2a98d1e5-20c7-4784-9b8b-3304d0bc4d06 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:43.174368 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2a98d1e5-20c7-4784-9b8b-3304d0bc4d06 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:43.176955 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2a98d1e5-20c7-4784-9b8b-3304d0bc4d06 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:43.227124 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2a98d1e5-20c7-4784-9b8b-3304d0bc4d06 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:43.227879 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2a98d1e5-20c7-4784-9b8b-3304d0bc4d06 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:43.229443 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2a98d1e5-20c7-4784-9b8b-3304d0bc4d06 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:43.230115 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-2a98d1e5-20c7-4784-9b8b-3304d0bc4d06 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lazy-loading 'fault' on Instance uuid 908ca82f-86ba-40c5-95b8-ee0f51588c9b {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 03:59:43.304645 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-2a98d1e5-20c7-4784-9b8b-3304d0bc4d06 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14706e15b5d7487a9b1d1a6332f93f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea131e741ef34573aa73360c5010221a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 03:59:43.313504 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2a98d1e5-20c7-4784-9b8b-3304d0bc4d06 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "GET /compute/v2.1/servers/908ca82f-86ba-40c5-95b8-ee0f51588c9b" status: 200 len: 1332 microversion: 2.1 time: 0.171366 Oct 19 03:59:43.315372 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3499/6876] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:59:43 2022] GET /compute/v2.1/servers/908ca82f-86ba-40c5-95b8-ee0f51588c9b => generated 1332 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 03:59:44.062904 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1170b2f1-21ed-4e09-a316-4016f3a45bd5 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:59:44.063536 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1170b2f1-21ed-4e09-a316-4016f3a45bd5 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 2e716aa7-08cb-4992-b853-b1d6a6e28d81] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:59:44.071475 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1170b2f1-21ed-4e09-a316-4016f3a45bd5 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:44.071977 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1170b2f1-21ed-4e09-a316-4016f3a45bd5 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:44.072425 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1170b2f1-21ed-4e09-a316-4016f3a45bd5 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:44.073283 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1170b2f1-21ed-4e09-a316-4016f3a45bd5 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:44.073842 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1170b2f1-21ed-4e09-a316-4016f3a45bd5 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:44.074566 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1170b2f1-21ed-4e09-a316-4016f3a45bd5 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:44.089407 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-1170b2f1-21ed-4e09-a316-4016f3a45bd5 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] HTTP exception thrown: Instance 2e716aa7-08cb-4992-b853-b1d6a6e28d81 could not be found. Oct 19 03:59:44.091135 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1170b2f1-21ed-4e09-a316-4016f3a45bd5 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Request method failure captured: Oct 19 03:59:44.091135 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/2e716aa7-08cb-4992-b853-b1d6a6e28d81 HTTP/1.1 Oct 19 03:59:44.091135 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:59:44.091135 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:59:44.091135 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:59:44.091135 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:59:44.091135 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:59:44.091135 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:59:44.091135 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:59:44.091135 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:59:44.091135 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3XYw5PeFcmVZaG2CxoqLxKroO9lkG-Hw7MzEkzHPy2_aqlf3HPBMKgLOXoQ-WbgkZbvZB1PbShR7FiiZmGSIVTCeQrWw3ytKpP-AuucJQP3lFFYEs8HquAFih6wwJOh2-3eNgmaxbIZUVh9y_A1g_wYecm08YmNoRnAnQnVYIDNRwE Oct 19 03:59:44.091135 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:59:44.091135 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:59:44.091135 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:59:44.091135 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:59:44.091135 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:59:44.091135 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:59:44.091135 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: beff434485604f85985617071a93727c Oct 19 03:59:44.091135 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-TestVolumeBootPattern-954873624 Oct 19 03:59:44.091135 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:59:44.091135 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:59:44.091135 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/beff434485604f85985617071a93727c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/beff434485604f85985617071a93727c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/beff434485604f85985617071a93727c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_beff434485604f85985617071a93727c", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:59:44.091135 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-TestVolumeBootPattern-954873624 Oct 19 03:59:44.091135 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: beff434485604f85985617071a93727c Oct 19 03:59:44.091135 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-TestVolumeBootPattern-954873624 Oct 19 03:59:44.091135 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-TestVolumeBootPattern-954873624-project Oct 19 03:59:44.091135 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:59:44.091135 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:59:44.091135 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 4d30aa868d79473f9534bd79816c07e3 Oct 19 03:59:44.091135 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-TestVolumeBootPattern-954873624-project Oct 19 03:59:44.091135 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:59:44.091135 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance 2e716aa7-08cb-4992-b853-b1d6a6e28d81 could not be found. Oct 19 03:59:44.091135 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '2e716aa7-08cb-4992-b853-b1d6a6e28d81'} Oct 19 03:59:44.091135 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:59:44.091135 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:59:44.091135 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:59:44.091135 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:59:44.091135 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:59:44.091135 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:59:44.091135 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:59:44.091135 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:59:44.091135 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:59:44.091135 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:59:44.091135 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e716aa7-08cb-4992-b853-b1d6a6e28d81 could not be found. Oct 19 03:59:44.091135 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:59:44.091135 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:59:44.091135 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:59:44.091135 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:59:44.091135 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:59:44.091135 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:59:44.091135 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:59:44.091135 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:59:44.091135 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:59:44.091135 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:59:44.091135 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:59:44.091135 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:59:44.091135 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:59:44.091135 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:59:44.091135 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:59:44.091135 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:59:44.091135 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e716aa7-08cb-4992-b853-b1d6a6e28d81 could not be found. Oct 19 03:59:44.091135 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:59:44.091135 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:59:44.091135 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:59:44.096040 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:59:44.096040 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:59:44.096040 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:59:44.096040 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:59:44.096040 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:59:44.096040 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e716aa7-08cb-4992-b853-b1d6a6e28d81 could not be found. Oct 19 03:59:44.096040 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:59:44.096040 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1170b2f1-21ed-4e09-a316-4016f3a45bd5 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Returning 404 to user: Instance 2e716aa7-08cb-4992-b853-b1d6a6e28d81 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:59:44.096040 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1170b2f1-21ed-4e09-a316-4016f3a45bd5 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/2e716aa7-08cb-4992-b853-b1d6a6e28d81" status: 404 len: 111 microversion: 2.1 time: 0.034281 Oct 19 03:59:44.096040 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3500/6877] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:59:44 2022] GET /compute/v2.1/servers/2e716aa7-08cb-4992-b853-b1d6a6e28d81 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 03:59:44.339574 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9c81d0a8-9cd1-4dae-8123-2b4a7681b58a tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:59:44.340856 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9c81d0a8-9cd1-4dae-8123-2b4a7681b58a tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: 908ca82f-86ba-40c5-95b8-ee0f51588c9b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:59:44.354137 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9c81d0a8-9cd1-4dae-8123-2b4a7681b58a tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:44.354137 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9c81d0a8-9cd1-4dae-8123-2b4a7681b58a tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:44.354137 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9c81d0a8-9cd1-4dae-8123-2b4a7681b58a tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:44.354137 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9c81d0a8-9cd1-4dae-8123-2b4a7681b58a tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:44.354137 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9c81d0a8-9cd1-4dae-8123-2b4a7681b58a tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:44.354137 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9c81d0a8-9cd1-4dae-8123-2b4a7681b58a tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:44.370948 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-9c81d0a8-9cd1-4dae-8123-2b4a7681b58a tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] HTTP exception thrown: Instance 908ca82f-86ba-40c5-95b8-ee0f51588c9b could not be found. Oct 19 03:59:44.372795 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9c81d0a8-9cd1-4dae-8123-2b4a7681b58a tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Request method failure captured: Oct 19 03:59:44.372795 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/908ca82f-86ba-40c5-95b8-ee0f51588c9b HTTP/1.1 Oct 19 03:59:44.372795 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:59:44.372795 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:59:44.372795 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:59:44.372795 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:59:44.372795 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:59:44.372795 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:59:44.372795 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:59:44.372795 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:59:44.372795 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3T1Tg0DFz0guFQMDM9yU7WN_RUGuMbf_rWbbF4rS1oDiWv6x0dTsqBA7TFunkbzAHPQAqy9kZJmC_H2-rpZa4Diw9UEoM4xkjg4JciNrIIW263ufBC_07F6Mlg4-xs8Q2J9bkOD2CDMpGZHCZ5KbDaJBjuAHOQ_5qLd75r8z_OFtFo Oct 19 03:59:44.372795 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:59:44.372795 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:59:44.372795 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:59:44.372795 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:59:44.372795 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:59:44.372795 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:59:44.372795 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: ea131e741ef34573aa73360c5010221a Oct 19 03:59:44.372795 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-AttachVolumeNegativeTest-892544868 Oct 19 03:59:44.372795 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:59:44.372795 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:59:44.372795 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ea131e741ef34573aa73360c5010221a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ea131e741ef34573aa73360c5010221a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ea131e741ef34573aa73360c5010221a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ea131e741ef34573aa73360c5010221a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:59:44.372795 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-AttachVolumeNegativeTest-892544868 Oct 19 03:59:44.372795 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: ea131e741ef34573aa73360c5010221a Oct 19 03:59:44.372795 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-892544868 Oct 19 03:59:44.372795 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-AttachVolumeNegativeTest-892544868-project Oct 19 03:59:44.372795 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:59:44.372795 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:59:44.372795 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 14706e15b5d7487a9b1d1a6332f93f7c Oct 19 03:59:44.372795 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-AttachVolumeNegativeTest-892544868-project Oct 19 03:59:44.372795 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:59:44.372795 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance 908ca82f-86ba-40c5-95b8-ee0f51588c9b could not be found. Oct 19 03:59:44.372795 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '908ca82f-86ba-40c5-95b8-ee0f51588c9b'} Oct 19 03:59:44.372795 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:59:44.372795 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:59:44.372795 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:59:44.372795 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:59:44.372795 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:59:44.372795 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:59:44.372795 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:59:44.372795 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:59:44.372795 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:59:44.372795 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:59:44.372795 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 908ca82f-86ba-40c5-95b8-ee0f51588c9b could not be found. Oct 19 03:59:44.372795 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:59:44.372795 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:59:44.372795 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:59:44.372795 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:59:44.372795 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:59:44.372795 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:59:44.372795 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:59:44.372795 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:59:44.372795 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:59:44.372795 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:59:44.372795 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:59:44.372795 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:59:44.372795 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:59:44.372795 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:59:44.372795 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:59:44.372795 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:59:44.372795 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 908ca82f-86ba-40c5-95b8-ee0f51588c9b could not be found. Oct 19 03:59:44.372795 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:59:44.372795 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:59:44.372795 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:59:44.379262 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:59:44.379262 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:59:44.379262 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:59:44.379262 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:59:44.379262 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:59:44.379262 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 908ca82f-86ba-40c5-95b8-ee0f51588c9b could not be found. Oct 19 03:59:44.379262 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:59:44.379262 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9c81d0a8-9cd1-4dae-8123-2b4a7681b58a tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Returning 404 to user: Instance 908ca82f-86ba-40c5-95b8-ee0f51588c9b could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:59:44.379262 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9c81d0a8-9cd1-4dae-8123-2b4a7681b58a tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "GET /compute/v2.1/servers/908ca82f-86ba-40c5-95b8-ee0f51588c9b" status: 404 len: 111 microversion: 2.1 time: 0.040470 Oct 19 03:59:44.379262 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3501/6878] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:59:44 2022] GET /compute/v2.1/servers/908ca82f-86ba-40c5-95b8-ee0f51588c9b => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:59:44.388773 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4ef0250c-3293-4c91-9d4d-e8fb7a6174d3 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Calling method '.version_select at 0x7fc135137820>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:59:44.493541 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4ef0250c-3293-4c91-9d4d-e8fb7a6174d3 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1186584213" status: 202 len: 0 microversion: 2.1 time: 0.113525 Oct 19 03:59:44.497651 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3502/6879] 10.222.0.52 () {58 vars in 1221 bytes} [Wed Oct 19 03:59:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1186584213 => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:59:45.805131 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-eef2c3fc-94a7-4f8c-aee9-a2f4b45bb2dc tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] Calling method '.version_select at 0x7fc130503310>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:59:45.904911 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-eef2c3fc-94a7-4f8c-aee9-a2f4b45bb2dc tempest-TestNetworkAdvancedServerOps-374576753 tempest-TestNetworkAdvancedServerOps-374576753-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-50981351" status: 202 len: 0 microversion: 2.1 time: 0.103595 Oct 19 03:59:45.905542 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3503/6880] 10.222.0.52 () {58 vars in 1278 bytes} [Wed Oct 19 03:59:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-50981351 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 03:59:49.251643 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7215ec28-585b-456b-b635-81cca6681184 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:59:49.251643 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7215ec28-585b-456b-b635-81cca6681184 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: 908ca82f-86ba-40c5-95b8-ee0f51588c9b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:59:49.256438 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7215ec28-585b-456b-b635-81cca6681184 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:49.257066 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7215ec28-585b-456b-b635-81cca6681184 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:49.257727 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7215ec28-585b-456b-b635-81cca6681184 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:49.258702 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7215ec28-585b-456b-b635-81cca6681184 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:49.259135 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7215ec28-585b-456b-b635-81cca6681184 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:49.259918 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7215ec28-585b-456b-b635-81cca6681184 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:49.275170 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-7215ec28-585b-456b-b635-81cca6681184 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] HTTP exception thrown: Instance 908ca82f-86ba-40c5-95b8-ee0f51588c9b could not be found. Oct 19 03:59:49.276923 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7215ec28-585b-456b-b635-81cca6681184 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Request method failure captured: Oct 19 03:59:49.276923 n-d-861333-8 devstack@n-api.service[121134]: request: DELETE /compute/v2.1/servers/908ca82f-86ba-40c5-95b8-ee0f51588c9b HTTP/1.1 Oct 19 03:59:49.276923 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:59:49.276923 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:59:49.276923 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:59:49.276923 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:59:49.276923 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:59:49.276923 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:59:49.276923 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:59:49.276923 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:59:49.276923 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3T1Tg0DFz0guFQMDM9yU7WN_RUGuMbf_rWbbF4rS1oDiWv6x0dTsqBA7TFunkbzAHPQAqy9kZJmC_H2-rpZa4Diw9UEoM4xkjg4JciNrIIW263ufBC_07F6Mlg4-xs8Q2J9bkOD2CDMpGZHCZ5KbDaJBjuAHOQ_5qLd75r8z_OFtFo Oct 19 03:59:49.276923 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:59:49.276923 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:59:49.276923 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:59:49.276923 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:59:49.276923 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:59:49.276923 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:59:49.276923 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: ea131e741ef34573aa73360c5010221a Oct 19 03:59:49.276923 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-AttachVolumeNegativeTest-892544868 Oct 19 03:59:49.276923 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:59:49.276923 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:59:49.276923 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ea131e741ef34573aa73360c5010221a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ea131e741ef34573aa73360c5010221a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ea131e741ef34573aa73360c5010221a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ea131e741ef34573aa73360c5010221a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:59:49.276923 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-AttachVolumeNegativeTest-892544868 Oct 19 03:59:49.276923 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: ea131e741ef34573aa73360c5010221a Oct 19 03:59:49.276923 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-892544868 Oct 19 03:59:49.276923 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-AttachVolumeNegativeTest-892544868-project Oct 19 03:59:49.276923 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:59:49.276923 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:59:49.276923 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 14706e15b5d7487a9b1d1a6332f93f7c Oct 19 03:59:49.276923 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-AttachVolumeNegativeTest-892544868-project Oct 19 03:59:49.276923 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:59:49.276923 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance 908ca82f-86ba-40c5-95b8-ee0f51588c9b could not be found. Oct 19 03:59:49.276923 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '908ca82f-86ba-40c5-95b8-ee0f51588c9b'} Oct 19 03:59:49.276923 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:59:49.276923 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:59:49.276923 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:59:49.276923 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:59:49.276923 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:59:49.276923 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:59:49.276923 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:59:49.276923 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:59:49.276923 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:59:49.276923 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:59:49.276923 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 908ca82f-86ba-40c5-95b8-ee0f51588c9b could not be found. Oct 19 03:59:49.276923 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:59:49.276923 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:59:49.276923 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:59:49.276923 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:59:49.276923 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:59:49.276923 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:59:49.276923 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:59:49.276923 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:59:49.276923 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:59:49.276923 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:59:49.276923 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 03:59:49.276923 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 03:59:49.276923 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 03:59:49.276923 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 03:59:49.276923 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:59:49.276923 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:59:49.276923 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:59:49.276923 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:59:49.285439 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 908ca82f-86ba-40c5-95b8-ee0f51588c9b could not be found. Oct 19 03:59:49.285439 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:59:49.285439 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:59:49.285439 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:59:49.285439 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:59:49.285439 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:59:49.285439 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:59:49.285439 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:59:49.285439 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:59:49.285439 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 908ca82f-86ba-40c5-95b8-ee0f51588c9b could not be found. Oct 19 03:59:49.285439 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:59:49.285439 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7215ec28-585b-456b-b635-81cca6681184 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Returning 404 to user: Instance 908ca82f-86ba-40c5-95b8-ee0f51588c9b could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:59:49.285439 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7215ec28-585b-456b-b635-81cca6681184 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "DELETE /compute/v2.1/servers/908ca82f-86ba-40c5-95b8-ee0f51588c9b" status: 404 len: 111 microversion: 2.1 time: 0.040117 Oct 19 03:59:49.285439 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3504/6881] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:59:49 2022] DELETE /compute/v2.1/servers/908ca82f-86ba-40c5-95b8-ee0f51588c9b => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 03:59:49.293034 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ef2b4dfa-49bb-4534-9ee6-c34b1e74f169 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:59:49.294050 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ef2b4dfa-49bb-4534-9ee6-c34b1e74f169 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: 908ca82f-86ba-40c5-95b8-ee0f51588c9b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:59:49.301425 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ef2b4dfa-49bb-4534-9ee6-c34b1e74f169 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:49.302122 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ef2b4dfa-49bb-4534-9ee6-c34b1e74f169 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:49.302762 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ef2b4dfa-49bb-4534-9ee6-c34b1e74f169 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:49.303496 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ef2b4dfa-49bb-4534-9ee6-c34b1e74f169 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:49.303946 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ef2b4dfa-49bb-4534-9ee6-c34b1e74f169 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:49.304563 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ef2b4dfa-49bb-4534-9ee6-c34b1e74f169 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:49.319483 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-ef2b4dfa-49bb-4534-9ee6-c34b1e74f169 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] HTTP exception thrown: Instance 908ca82f-86ba-40c5-95b8-ee0f51588c9b could not be found. Oct 19 03:59:49.321105 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ef2b4dfa-49bb-4534-9ee6-c34b1e74f169 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Request method failure captured: Oct 19 03:59:49.321105 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/908ca82f-86ba-40c5-95b8-ee0f51588c9b HTTP/1.1 Oct 19 03:59:49.321105 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:59:49.321105 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:59:49.321105 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:59:49.321105 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:59:49.321105 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:59:49.321105 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:59:49.321105 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:59:49.321105 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:59:49.321105 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3T1Tg0DFz0guFQMDM9yU7WN_RUGuMbf_rWbbF4rS1oDiWv6x0dTsqBA7TFunkbzAHPQAqy9kZJmC_H2-rpZa4Diw9UEoM4xkjg4JciNrIIW263ufBC_07F6Mlg4-xs8Q2J9bkOD2CDMpGZHCZ5KbDaJBjuAHOQ_5qLd75r8z_OFtFo Oct 19 03:59:49.321105 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:59:49.321105 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:59:49.321105 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:59:49.321105 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:59:49.321105 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:59:49.321105 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:59:49.321105 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: ea131e741ef34573aa73360c5010221a Oct 19 03:59:49.321105 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-AttachVolumeNegativeTest-892544868 Oct 19 03:59:49.321105 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:59:49.321105 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:59:49.321105 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ea131e741ef34573aa73360c5010221a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ea131e741ef34573aa73360c5010221a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ea131e741ef34573aa73360c5010221a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ea131e741ef34573aa73360c5010221a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:59:49.321105 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-AttachVolumeNegativeTest-892544868 Oct 19 03:59:49.321105 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: ea131e741ef34573aa73360c5010221a Oct 19 03:59:49.321105 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-892544868 Oct 19 03:59:49.321105 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-AttachVolumeNegativeTest-892544868-project Oct 19 03:59:49.321105 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:59:49.321105 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:59:49.321105 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 14706e15b5d7487a9b1d1a6332f93f7c Oct 19 03:59:49.321105 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-AttachVolumeNegativeTest-892544868-project Oct 19 03:59:49.321105 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:59:49.321105 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance 908ca82f-86ba-40c5-95b8-ee0f51588c9b could not be found. Oct 19 03:59:49.321105 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '908ca82f-86ba-40c5-95b8-ee0f51588c9b'} Oct 19 03:59:49.321105 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:59:49.321105 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:59:49.321105 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:59:49.321105 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:59:49.321105 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:59:49.321105 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:59:49.321105 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:59:49.321105 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:59:49.321105 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:59:49.321105 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:59:49.321105 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 908ca82f-86ba-40c5-95b8-ee0f51588c9b could not be found. Oct 19 03:59:49.321105 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:59:49.321105 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:59:49.321105 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:59:49.321105 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:59:49.321105 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:59:49.321105 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:59:49.321105 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:59:49.321105 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:59:49.321105 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:59:49.321105 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:59:49.321105 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:59:49.321105 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:59:49.321105 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:59:49.321105 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:59:49.321105 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:59:49.321105 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:59:49.321105 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 908ca82f-86ba-40c5-95b8-ee0f51588c9b could not be found. Oct 19 03:59:49.321105 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:59:49.321105 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:59:49.321105 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:59:49.325600 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:59:49.325600 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:59:49.325600 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:59:49.325600 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:59:49.325600 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:59:49.325600 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 908ca82f-86ba-40c5-95b8-ee0f51588c9b could not be found. Oct 19 03:59:49.325600 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:59:49.325600 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ef2b4dfa-49bb-4534-9ee6-c34b1e74f169 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Returning 404 to user: Instance 908ca82f-86ba-40c5-95b8-ee0f51588c9b could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:59:49.325600 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ef2b4dfa-49bb-4534-9ee6-c34b1e74f169 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "GET /compute/v2.1/servers/908ca82f-86ba-40c5-95b8-ee0f51588c9b" status: 404 len: 111 microversion: 2.1 time: 0.034160 Oct 19 03:59:49.325600 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3505/6882] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:59:49 2022] GET /compute/v2.1/servers/908ca82f-86ba-40c5-95b8-ee0f51588c9b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 03:59:53.907016 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ab31cf6d-8274-446c-ae99-6079bf9ee96a tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:59:53.909785 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ab31cf6d-8274-446c-ae99-6079bf9ee96a tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: ebb09805-86db-46ee-a803-5e9afcc94d1d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:59:53.924297 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ab31cf6d-8274-446c-ae99-6079bf9ee96a tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:53.924297 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ab31cf6d-8274-446c-ae99-6079bf9ee96a tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:53.924297 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ab31cf6d-8274-446c-ae99-6079bf9ee96a tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:53.924297 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ab31cf6d-8274-446c-ae99-6079bf9ee96a tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:53.924297 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ab31cf6d-8274-446c-ae99-6079bf9ee96a tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:53.924835 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ab31cf6d-8274-446c-ae99-6079bf9ee96a tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:53.943347 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-ab31cf6d-8274-446c-ae99-6079bf9ee96a tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] HTTP exception thrown: Instance ebb09805-86db-46ee-a803-5e9afcc94d1d could not be found. Oct 19 03:59:53.948123 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ab31cf6d-8274-446c-ae99-6079bf9ee96a tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Request method failure captured: Oct 19 03:59:53.948123 n-d-861333-8 devstack@n-api.service[121134]: request: DELETE /compute/v2.1/servers/ebb09805-86db-46ee-a803-5e9afcc94d1d HTTP/1.1 Oct 19 03:59:53.948123 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:59:53.948123 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:59:53.948123 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:59:53.948123 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:59:53.948123 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:59:53.948123 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:59:53.948123 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:59:53.948123 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:59:53.948123 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3T1Tg0DFz0guFQMDM9yU7WN_RUGuMbf_rWbbF4rS1oDiWv6x0dTsqBA7TFunkbzAHPQAqy9kZJmC_H2-rpZa4Diw9UEoM4xkjg4JciNrIIW263ufBC_07F6Mlg4-xs8Q2J9bkOD2CDMpGZHCZ5KbDaJBjuAHOQ_5qLd75r8z_OFtFo Oct 19 03:59:53.948123 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:59:53.948123 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:59:53.948123 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:59:53.948123 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:59:53.948123 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:59:53.948123 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:59:53.948123 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: ea131e741ef34573aa73360c5010221a Oct 19 03:59:53.948123 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-AttachVolumeNegativeTest-892544868 Oct 19 03:59:53.948123 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:59:53.948123 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:59:53.948123 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ea131e741ef34573aa73360c5010221a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ea131e741ef34573aa73360c5010221a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ea131e741ef34573aa73360c5010221a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ea131e741ef34573aa73360c5010221a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:59:53.948123 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-AttachVolumeNegativeTest-892544868 Oct 19 03:59:53.948123 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: ea131e741ef34573aa73360c5010221a Oct 19 03:59:53.948123 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-892544868 Oct 19 03:59:53.948123 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-AttachVolumeNegativeTest-892544868-project Oct 19 03:59:53.948123 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:59:53.948123 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:59:53.948123 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 14706e15b5d7487a9b1d1a6332f93f7c Oct 19 03:59:53.948123 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-AttachVolumeNegativeTest-892544868-project Oct 19 03:59:53.948123 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:59:53.948123 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance ebb09805-86db-46ee-a803-5e9afcc94d1d could not be found. Oct 19 03:59:53.948123 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': 'ebb09805-86db-46ee-a803-5e9afcc94d1d'} Oct 19 03:59:53.948123 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:59:53.948123 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:59:53.948123 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:59:53.948123 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:59:53.948123 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:59:53.948123 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:59:53.948123 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:59:53.948123 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:59:53.948123 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:59:53.948123 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:59:53.948123 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ebb09805-86db-46ee-a803-5e9afcc94d1d could not be found. Oct 19 03:59:53.948123 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:59:53.948123 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:59:53.948123 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:59:53.948123 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:59:53.948123 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:59:53.948123 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:59:53.948123 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:59:53.948123 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:59:53.948123 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:59:53.948123 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:59:53.948123 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 03:59:53.948123 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 03:59:53.948123 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 03:59:53.948123 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 03:59:53.948123 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:59:53.948123 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:59:53.948123 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:59:53.948123 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:59:53.952518 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ebb09805-86db-46ee-a803-5e9afcc94d1d could not be found. Oct 19 03:59:53.952518 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:59:53.952518 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:59:53.952518 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:59:53.952518 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:59:53.952518 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:59:53.952518 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:59:53.952518 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:59:53.952518 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:59:53.952518 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ebb09805-86db-46ee-a803-5e9afcc94d1d could not be found. Oct 19 03:59:53.952518 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:59:53.952518 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ab31cf6d-8274-446c-ae99-6079bf9ee96a tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Returning 404 to user: Instance ebb09805-86db-46ee-a803-5e9afcc94d1d could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:59:53.952518 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ab31cf6d-8274-446c-ae99-6079bf9ee96a tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ebb09805-86db-46ee-a803-5e9afcc94d1d" status: 404 len: 111 microversion: 2.1 time: 0.045217 Oct 19 03:59:53.954359 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3506/6883] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:59:53 2022] DELETE /compute/v2.1/servers/ebb09805-86db-46ee-a803-5e9afcc94d1d => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:59:53.964130 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6c6ea82d-f0b3-424b-968a-f3a251cab439 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:59:53.965338 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6c6ea82d-f0b3-424b-968a-f3a251cab439 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: ebb09805-86db-46ee-a803-5e9afcc94d1d] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:59:53.973473 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6c6ea82d-f0b3-424b-968a-f3a251cab439 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:53.978239 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6c6ea82d-f0b3-424b-968a-f3a251cab439 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:53.978239 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6c6ea82d-f0b3-424b-968a-f3a251cab439 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:53.978239 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6c6ea82d-f0b3-424b-968a-f3a251cab439 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:53.978239 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6c6ea82d-f0b3-424b-968a-f3a251cab439 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:53.978239 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6c6ea82d-f0b3-424b-968a-f3a251cab439 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:53.993630 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-6c6ea82d-f0b3-424b-968a-f3a251cab439 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] HTTP exception thrown: Instance ebb09805-86db-46ee-a803-5e9afcc94d1d could not be found. Oct 19 03:59:53.996430 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6c6ea82d-f0b3-424b-968a-f3a251cab439 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Request method failure captured: Oct 19 03:59:53.996430 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/ebb09805-86db-46ee-a803-5e9afcc94d1d HTTP/1.1 Oct 19 03:59:53.996430 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:59:53.996430 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:59:53.996430 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:59:53.996430 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:59:53.996430 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:59:53.996430 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:59:53.996430 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:59:53.996430 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:59:53.996430 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3T1Tg0DFz0guFQMDM9yU7WN_RUGuMbf_rWbbF4rS1oDiWv6x0dTsqBA7TFunkbzAHPQAqy9kZJmC_H2-rpZa4Diw9UEoM4xkjg4JciNrIIW263ufBC_07F6Mlg4-xs8Q2J9bkOD2CDMpGZHCZ5KbDaJBjuAHOQ_5qLd75r8z_OFtFo Oct 19 03:59:53.996430 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:59:53.996430 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:59:53.996430 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:59:53.996430 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:59:53.996430 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:59:53.996430 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:59:53.996430 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: ea131e741ef34573aa73360c5010221a Oct 19 03:59:53.996430 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-AttachVolumeNegativeTest-892544868 Oct 19 03:59:53.996430 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:59:53.996430 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:59:53.996430 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ea131e741ef34573aa73360c5010221a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ea131e741ef34573aa73360c5010221a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ea131e741ef34573aa73360c5010221a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ea131e741ef34573aa73360c5010221a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:59:53.996430 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-AttachVolumeNegativeTest-892544868 Oct 19 03:59:53.996430 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: ea131e741ef34573aa73360c5010221a Oct 19 03:59:53.996430 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-892544868 Oct 19 03:59:53.996430 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-AttachVolumeNegativeTest-892544868-project Oct 19 03:59:53.996430 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:59:53.996430 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:59:53.996430 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 14706e15b5d7487a9b1d1a6332f93f7c Oct 19 03:59:53.996430 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-AttachVolumeNegativeTest-892544868-project Oct 19 03:59:53.996430 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:59:53.996430 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance ebb09805-86db-46ee-a803-5e9afcc94d1d could not be found. Oct 19 03:59:53.996430 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': 'ebb09805-86db-46ee-a803-5e9afcc94d1d'} Oct 19 03:59:53.996430 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:59:53.996430 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:59:53.996430 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:59:53.996430 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:59:53.996430 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:59:53.996430 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:59:53.996430 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:59:53.996430 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:59:53.996430 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:59:53.996430 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:59:53.996430 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ebb09805-86db-46ee-a803-5e9afcc94d1d could not be found. Oct 19 03:59:53.996430 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:59:53.996430 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:59:53.996430 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:59:53.996430 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:59:53.996430 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:59:53.996430 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:59:53.996430 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:59:53.996430 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:59:53.996430 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:59:53.996430 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:59:53.996430 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:59:53.996430 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:59:53.996430 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:59:53.996430 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:59:53.996430 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:59:53.996430 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:59:53.996430 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ebb09805-86db-46ee-a803-5e9afcc94d1d could not be found. Oct 19 03:59:53.996430 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:59:53.996430 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:59:53.996430 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:59:54.002023 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:59:54.002023 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:59:54.002023 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:59:54.002023 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:59:54.002023 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:59:54.002023 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ebb09805-86db-46ee-a803-5e9afcc94d1d could not be found. Oct 19 03:59:54.002023 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:59:54.003126 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6c6ea82d-f0b3-424b-968a-f3a251cab439 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Returning 404 to user: Instance ebb09805-86db-46ee-a803-5e9afcc94d1d could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:59:54.003769 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6c6ea82d-f0b3-424b-968a-f3a251cab439 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "GET /compute/v2.1/servers/ebb09805-86db-46ee-a803-5e9afcc94d1d" status: 404 len: 111 microversion: 2.1 time: 0.044455 Oct 19 03:59:54.007381 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3507/6884] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:59:53 2022] GET /compute/v2.1/servers/ebb09805-86db-46ee-a803-5e9afcc94d1d => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:59:54.015692 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2622d1ff-268e-421b-8368-c3d9d7729d19 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:59:54.016194 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2622d1ff-268e-421b-8368-c3d9d7729d19 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: ac1213da-e573-4522-a8cd-685e598892f3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:59:54.038945 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2622d1ff-268e-421b-8368-c3d9d7729d19 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:54.042850 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2622d1ff-268e-421b-8368-c3d9d7729d19 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:54.046181 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2622d1ff-268e-421b-8368-c3d9d7729d19 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:54.049822 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2622d1ff-268e-421b-8368-c3d9d7729d19 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:54.051106 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2622d1ff-268e-421b-8368-c3d9d7729d19 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:54.051751 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2622d1ff-268e-421b-8368-c3d9d7729d19 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:54.067959 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-2622d1ff-268e-421b-8368-c3d9d7729d19 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] HTTP exception thrown: Instance ac1213da-e573-4522-a8cd-685e598892f3 could not be found. Oct 19 03:59:54.069478 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2622d1ff-268e-421b-8368-c3d9d7729d19 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Request method failure captured: Oct 19 03:59:54.069478 n-d-861333-8 devstack@n-api.service[121134]: request: DELETE /compute/v2.1/servers/ac1213da-e573-4522-a8cd-685e598892f3 HTTP/1.1 Oct 19 03:59:54.069478 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:59:54.069478 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:59:54.069478 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:59:54.069478 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:59:54.069478 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:59:54.069478 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:59:54.069478 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:59:54.069478 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:59:54.069478 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3T1Tg0DFz0guFQMDM9yU7WN_RUGuMbf_rWbbF4rS1oDiWv6x0dTsqBA7TFunkbzAHPQAqy9kZJmC_H2-rpZa4Diw9UEoM4xkjg4JciNrIIW263ufBC_07F6Mlg4-xs8Q2J9bkOD2CDMpGZHCZ5KbDaJBjuAHOQ_5qLd75r8z_OFtFo Oct 19 03:59:54.069478 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:59:54.069478 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:59:54.069478 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:59:54.069478 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:59:54.069478 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:59:54.069478 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:59:54.069478 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: ea131e741ef34573aa73360c5010221a Oct 19 03:59:54.069478 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-AttachVolumeNegativeTest-892544868 Oct 19 03:59:54.069478 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:59:54.069478 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:59:54.069478 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ea131e741ef34573aa73360c5010221a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ea131e741ef34573aa73360c5010221a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ea131e741ef34573aa73360c5010221a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ea131e741ef34573aa73360c5010221a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:59:54.069478 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-AttachVolumeNegativeTest-892544868 Oct 19 03:59:54.069478 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: ea131e741ef34573aa73360c5010221a Oct 19 03:59:54.069478 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-892544868 Oct 19 03:59:54.069478 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-AttachVolumeNegativeTest-892544868-project Oct 19 03:59:54.069478 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:59:54.069478 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:59:54.069478 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 14706e15b5d7487a9b1d1a6332f93f7c Oct 19 03:59:54.069478 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-AttachVolumeNegativeTest-892544868-project Oct 19 03:59:54.069478 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:59:54.069478 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance ac1213da-e573-4522-a8cd-685e598892f3 could not be found. Oct 19 03:59:54.069478 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': 'ac1213da-e573-4522-a8cd-685e598892f3'} Oct 19 03:59:54.069478 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:59:54.069478 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:59:54.069478 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:59:54.069478 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:59:54.069478 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:59:54.069478 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:59:54.069478 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:59:54.069478 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:59:54.069478 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:59:54.069478 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:59:54.069478 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac1213da-e573-4522-a8cd-685e598892f3 could not be found. Oct 19 03:59:54.069478 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:59:54.069478 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:59:54.069478 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:59:54.069478 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:59:54.069478 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:59:54.069478 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:59:54.069478 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:59:54.069478 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:59:54.069478 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:59:54.069478 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:59:54.069478 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 03:59:54.069478 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 03:59:54.069478 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 03:59:54.069478 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 03:59:54.069478 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:59:54.069478 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:59:54.069478 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:59:54.069478 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:59:54.077125 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac1213da-e573-4522-a8cd-685e598892f3 could not be found. Oct 19 03:59:54.077125 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:59:54.077125 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:59:54.077125 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:59:54.077125 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:59:54.077125 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:59:54.077125 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:59:54.077125 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:59:54.077125 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:59:54.077125 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac1213da-e573-4522-a8cd-685e598892f3 could not be found. Oct 19 03:59:54.077125 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:59:54.077125 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2622d1ff-268e-421b-8368-c3d9d7729d19 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Returning 404 to user: Instance ac1213da-e573-4522-a8cd-685e598892f3 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:59:54.077125 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2622d1ff-268e-421b-8368-c3d9d7729d19 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ac1213da-e573-4522-a8cd-685e598892f3" status: 404 len: 111 microversion: 2.1 time: 0.059408 Oct 19 03:59:54.077125 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3508/6885] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:59:54 2022] DELETE /compute/v2.1/servers/ac1213da-e573-4522-a8cd-685e598892f3 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:59:54.090546 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-192d15dd-20e2-4acd-a7e6-f2e23836698a tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:59:54.091143 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-192d15dd-20e2-4acd-a7e6-f2e23836698a tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: ac1213da-e573-4522-a8cd-685e598892f3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:59:54.102409 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-192d15dd-20e2-4acd-a7e6-f2e23836698a tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:54.102409 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-192d15dd-20e2-4acd-a7e6-f2e23836698a tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:54.102409 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-192d15dd-20e2-4acd-a7e6-f2e23836698a tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:54.102409 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-192d15dd-20e2-4acd-a7e6-f2e23836698a tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:54.102901 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-192d15dd-20e2-4acd-a7e6-f2e23836698a tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:54.103106 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-192d15dd-20e2-4acd-a7e6-f2e23836698a tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:54.122375 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-192d15dd-20e2-4acd-a7e6-f2e23836698a tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] HTTP exception thrown: Instance ac1213da-e573-4522-a8cd-685e598892f3 could not be found. Oct 19 03:59:54.124521 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-192d15dd-20e2-4acd-a7e6-f2e23836698a tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Request method failure captured: Oct 19 03:59:54.124521 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/ac1213da-e573-4522-a8cd-685e598892f3 HTTP/1.1 Oct 19 03:59:54.124521 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:59:54.124521 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:59:54.124521 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:59:54.124521 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:59:54.124521 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:59:54.124521 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:59:54.124521 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:59:54.124521 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:59:54.124521 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3T1Tg0DFz0guFQMDM9yU7WN_RUGuMbf_rWbbF4rS1oDiWv6x0dTsqBA7TFunkbzAHPQAqy9kZJmC_H2-rpZa4Diw9UEoM4xkjg4JciNrIIW263ufBC_07F6Mlg4-xs8Q2J9bkOD2CDMpGZHCZ5KbDaJBjuAHOQ_5qLd75r8z_OFtFo Oct 19 03:59:54.124521 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:59:54.124521 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:59:54.124521 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:59:54.124521 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:59:54.124521 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:59:54.124521 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:59:54.124521 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: ea131e741ef34573aa73360c5010221a Oct 19 03:59:54.124521 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-AttachVolumeNegativeTest-892544868 Oct 19 03:59:54.124521 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:59:54.124521 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:59:54.124521 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ea131e741ef34573aa73360c5010221a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ea131e741ef34573aa73360c5010221a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ea131e741ef34573aa73360c5010221a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ea131e741ef34573aa73360c5010221a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:59:54.124521 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-AttachVolumeNegativeTest-892544868 Oct 19 03:59:54.124521 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: ea131e741ef34573aa73360c5010221a Oct 19 03:59:54.124521 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-892544868 Oct 19 03:59:54.124521 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-AttachVolumeNegativeTest-892544868-project Oct 19 03:59:54.124521 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:59:54.124521 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:59:54.124521 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 14706e15b5d7487a9b1d1a6332f93f7c Oct 19 03:59:54.124521 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-AttachVolumeNegativeTest-892544868-project Oct 19 03:59:54.124521 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:59:54.124521 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance ac1213da-e573-4522-a8cd-685e598892f3 could not be found. Oct 19 03:59:54.124521 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': 'ac1213da-e573-4522-a8cd-685e598892f3'} Oct 19 03:59:54.124521 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:59:54.124521 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:59:54.124521 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:59:54.124521 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:59:54.124521 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:59:54.124521 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:59:54.124521 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:59:54.124521 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:59:54.124521 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:59:54.124521 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:59:54.124521 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac1213da-e573-4522-a8cd-685e598892f3 could not be found. Oct 19 03:59:54.124521 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:59:54.124521 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:59:54.124521 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:59:54.124521 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:59:54.124521 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:59:54.124521 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:59:54.124521 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:59:54.124521 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:59:54.124521 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:59:54.124521 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:59:54.124521 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:59:54.124521 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:59:54.124521 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:59:54.124521 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:59:54.124521 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:59:54.124521 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:59:54.124521 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac1213da-e573-4522-a8cd-685e598892f3 could not be found. Oct 19 03:59:54.124521 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:59:54.124521 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:59:54.124521 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:59:54.130255 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:59:54.130255 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:59:54.130255 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:59:54.130255 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:59:54.130255 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:59:54.130255 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac1213da-e573-4522-a8cd-685e598892f3 could not be found. Oct 19 03:59:54.130255 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:59:54.130255 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-192d15dd-20e2-4acd-a7e6-f2e23836698a tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Returning 404 to user: Instance ac1213da-e573-4522-a8cd-685e598892f3 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:59:54.130255 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-192d15dd-20e2-4acd-a7e6-f2e23836698a tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "GET /compute/v2.1/servers/ac1213da-e573-4522-a8cd-685e598892f3" status: 404 len: 111 microversion: 2.1 time: 0.039481 Oct 19 03:59:54.130255 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3509/6886] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:59:54 2022] GET /compute/v2.1/servers/ac1213da-e573-4522-a8cd-685e598892f3 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 03:59:58.775478 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7fe97538-701d-4457-96c2-b2266d074b2d tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:59:58.776222 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7fe97538-701d-4457-96c2-b2266d074b2d tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: 5f833ef3-e5bd-4953-a3ca-5cddddb2641f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:59:58.784284 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7fe97538-701d-4457-96c2-b2266d074b2d tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:58.785109 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7fe97538-701d-4457-96c2-b2266d074b2d tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:58.785847 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7fe97538-701d-4457-96c2-b2266d074b2d tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:58.786718 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7fe97538-701d-4457-96c2-b2266d074b2d tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:58.787410 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7fe97538-701d-4457-96c2-b2266d074b2d tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:58.788376 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7fe97538-701d-4457-96c2-b2266d074b2d tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:58.804842 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-7fe97538-701d-4457-96c2-b2266d074b2d tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] HTTP exception thrown: Instance 5f833ef3-e5bd-4953-a3ca-5cddddb2641f could not be found. Oct 19 03:59:58.806897 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7fe97538-701d-4457-96c2-b2266d074b2d tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Request method failure captured: Oct 19 03:59:58.806897 n-d-861333-8 devstack@n-api.service[121134]: request: DELETE /compute/v2.1/servers/5f833ef3-e5bd-4953-a3ca-5cddddb2641f HTTP/1.1 Oct 19 03:59:58.806897 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:59:58.806897 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:59:58.806897 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:59:58.806897 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:59:58.806897 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:59:58.806897 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:59:58.806897 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:59:58.806897 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:59:58.806897 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3T1Tg0DFz0guFQMDM9yU7WN_RUGuMbf_rWbbF4rS1oDiWv6x0dTsqBA7TFunkbzAHPQAqy9kZJmC_H2-rpZa4Diw9UEoM4xkjg4JciNrIIW263ufBC_07F6Mlg4-xs8Q2J9bkOD2CDMpGZHCZ5KbDaJBjuAHOQ_5qLd75r8z_OFtFo Oct 19 03:59:58.806897 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:59:58.806897 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:59:58.806897 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:59:58.806897 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:59:58.806897 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:59:58.806897 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:59:58.806897 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: ea131e741ef34573aa73360c5010221a Oct 19 03:59:58.806897 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-AttachVolumeNegativeTest-892544868 Oct 19 03:59:58.806897 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:59:58.806897 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:59:58.806897 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ea131e741ef34573aa73360c5010221a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ea131e741ef34573aa73360c5010221a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ea131e741ef34573aa73360c5010221a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ea131e741ef34573aa73360c5010221a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:59:58.806897 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-AttachVolumeNegativeTest-892544868 Oct 19 03:59:58.806897 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: ea131e741ef34573aa73360c5010221a Oct 19 03:59:58.806897 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-892544868 Oct 19 03:59:58.806897 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-AttachVolumeNegativeTest-892544868-project Oct 19 03:59:58.806897 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:59:58.806897 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:59:58.806897 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 14706e15b5d7487a9b1d1a6332f93f7c Oct 19 03:59:58.806897 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-AttachVolumeNegativeTest-892544868-project Oct 19 03:59:58.806897 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:59:58.806897 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance 5f833ef3-e5bd-4953-a3ca-5cddddb2641f could not be found. Oct 19 03:59:58.806897 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '5f833ef3-e5bd-4953-a3ca-5cddddb2641f'} Oct 19 03:59:58.806897 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:59:58.806897 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:59:58.806897 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:59:58.806897 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:59:58.806897 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:59:58.806897 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:59:58.806897 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:59:58.806897 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:59:58.806897 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:59:58.806897 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:59:58.806897 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f833ef3-e5bd-4953-a3ca-5cddddb2641f could not be found. Oct 19 03:59:58.806897 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:59:58.806897 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:59:58.806897 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:59:58.806897 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:59:58.806897 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:59:58.806897 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:59:58.806897 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:59:58.806897 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:59:58.806897 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:59:58.806897 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:59:58.806897 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 03:59:58.806897 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 03:59:58.806897 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 03:59:58.806897 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 03:59:58.806897 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:59:58.806897 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:59:58.806897 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:59:58.806897 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:59:58.811703 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f833ef3-e5bd-4953-a3ca-5cddddb2641f could not be found. Oct 19 03:59:58.811703 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:59:58.811703 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:59:58.811703 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:59:58.811703 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:59:58.811703 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:59:58.811703 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:59:58.811703 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:59:58.811703 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:59:58.811703 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f833ef3-e5bd-4953-a3ca-5cddddb2641f could not be found. Oct 19 03:59:58.811703 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:59:58.814354 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7fe97538-701d-4457-96c2-b2266d074b2d tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Returning 404 to user: Instance 5f833ef3-e5bd-4953-a3ca-5cddddb2641f could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:59:58.815623 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7fe97538-701d-4457-96c2-b2266d074b2d tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "DELETE /compute/v2.1/servers/5f833ef3-e5bd-4953-a3ca-5cddddb2641f" status: 404 len: 111 microversion: 2.1 time: 0.044276 Oct 19 03:59:58.816911 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3510/6887] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 03:59:58 2022] DELETE /compute/v2.1/servers/5f833ef3-e5bd-4953-a3ca-5cddddb2641f => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 03:59:58.828499 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8cdf9058-d7c3-4766-8eb0-e5e04ef57035 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 03:59:58.829707 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8cdf9058-d7c3-4766-8eb0-e5e04ef57035 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] [instance: 5f833ef3-e5bd-4953-a3ca-5cddddb2641f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 03:59:58.837067 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8cdf9058-d7c3-4766-8eb0-e5e04ef57035 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:58.838709 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8cdf9058-d7c3-4766-8eb0-e5e04ef57035 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:58.839555 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8cdf9058-d7c3-4766-8eb0-e5e04ef57035 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:58.840517 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8cdf9058-d7c3-4766-8eb0-e5e04ef57035 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 03:59:58.841176 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8cdf9058-d7c3-4766-8eb0-e5e04ef57035 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 03:59:58.841862 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8cdf9058-d7c3-4766-8eb0-e5e04ef57035 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 03:59:58.858038 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-8cdf9058-d7c3-4766-8eb0-e5e04ef57035 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] HTTP exception thrown: Instance 5f833ef3-e5bd-4953-a3ca-5cddddb2641f could not be found. Oct 19 03:59:58.861484 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8cdf9058-d7c3-4766-8eb0-e5e04ef57035 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Request method failure captured: Oct 19 03:59:58.861484 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/5f833ef3-e5bd-4953-a3ca-5cddddb2641f HTTP/1.1 Oct 19 03:59:58.861484 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 03:59:58.861484 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 03:59:58.861484 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 03:59:58.861484 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 03:59:58.861484 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 03:59:58.861484 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 03:59:58.861484 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 03:59:58.861484 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 03:59:58.861484 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3T1Tg0DFz0guFQMDM9yU7WN_RUGuMbf_rWbbF4rS1oDiWv6x0dTsqBA7TFunkbzAHPQAqy9kZJmC_H2-rpZa4Diw9UEoM4xkjg4JciNrIIW263ufBC_07F6Mlg4-xs8Q2J9bkOD2CDMpGZHCZ5KbDaJBjuAHOQ_5qLd75r8z_OFtFo Oct 19 03:59:58.861484 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 03:59:58.861484 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 03:59:58.861484 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 03:59:58.861484 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 03:59:58.861484 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 03:59:58.861484 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 03:59:58.861484 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: ea131e741ef34573aa73360c5010221a Oct 19 03:59:58.861484 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-AttachVolumeNegativeTest-892544868 Oct 19 03:59:58.861484 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 03:59:58.861484 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 03:59:58.861484 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ea131e741ef34573aa73360c5010221a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ea131e741ef34573aa73360c5010221a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ea131e741ef34573aa73360c5010221a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ea131e741ef34573aa73360c5010221a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 03:59:58.861484 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-AttachVolumeNegativeTest-892544868 Oct 19 03:59:58.861484 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: ea131e741ef34573aa73360c5010221a Oct 19 03:59:58.861484 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-892544868 Oct 19 03:59:58.861484 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-AttachVolumeNegativeTest-892544868-project Oct 19 03:59:58.861484 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 03:59:58.861484 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 03:59:58.861484 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 14706e15b5d7487a9b1d1a6332f93f7c Oct 19 03:59:58.861484 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-AttachVolumeNegativeTest-892544868-project Oct 19 03:59:58.861484 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 03:59:58.861484 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance 5f833ef3-e5bd-4953-a3ca-5cddddb2641f could not be found. Oct 19 03:59:58.861484 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '5f833ef3-e5bd-4953-a3ca-5cddddb2641f'} Oct 19 03:59:58.861484 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 03:59:58.861484 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:59:58.861484 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 03:59:58.861484 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 03:59:58.861484 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 03:59:58.861484 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 03:59:58.861484 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 03:59:58.861484 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 03:59:58.861484 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 03:59:58.861484 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 03:59:58.861484 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f833ef3-e5bd-4953-a3ca-5cddddb2641f could not be found. Oct 19 03:59:58.861484 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:59:58.861484 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:59:58.861484 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:59:58.861484 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:59:58.861484 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:59:58.861484 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:59:58.861484 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 03:59:58.861484 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 03:59:58.861484 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 03:59:58.861484 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 03:59:58.861484 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 03:59:58.861484 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 03:59:58.861484 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 03:59:58.861484 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 03:59:58.861484 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 03:59:58.861484 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 03:59:58.861484 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f833ef3-e5bd-4953-a3ca-5cddddb2641f could not be found. Oct 19 03:59:58.861484 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:59:58.861484 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 03:59:58.861484 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:59:58.866941 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 03:59:58.866941 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 03:59:58.866941 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 03:59:58.866941 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 03:59:58.866941 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 03:59:58.866941 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f833ef3-e5bd-4953-a3ca-5cddddb2641f could not be found. Oct 19 03:59:58.866941 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 03:59:58.869809 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8cdf9058-d7c3-4766-8eb0-e5e04ef57035 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] Returning 404 to user: Instance 5f833ef3-e5bd-4953-a3ca-5cddddb2641f could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 03:59:58.870897 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8cdf9058-d7c3-4766-8eb0-e5e04ef57035 tempest-AttachVolumeNegativeTest-892544868 tempest-AttachVolumeNegativeTest-892544868-project] 10.222.0.52 "GET /compute/v2.1/servers/5f833ef3-e5bd-4953-a3ca-5cddddb2641f" status: 404 len: 111 microversion: 2.1 time: 0.049826 Oct 19 03:59:58.871943 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3511/6888] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 03:59:58 2022] GET /compute/v2.1/servers/5f833ef3-e5bd-4953-a3ca-5cddddb2641f => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 04:00:05.105081 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-342ad41b-c836-4ec8-9808-43da7edc7a4c tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Action: 'create', calling method: .version_select at 0x7fc130054e50>, body: {"keypair": {"name": "tempest-TestServerBasicOps-49554266", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBxT3QdPUIXzfVB7HMhoU0rRzwwGHta38qZtZ7j1W1ldS45yFAwsRaiLIxuY1dUVpONg1a8zlGjlfl/Qh67Qg7FcwBCB8BZY47UjTohKoESLH56fYzqSd+EohcSvdpPEvA=="}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:00:05.128324 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-342ad41b-c836-4ec8-9808-43da7edc7a4c tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Getting quotas for project f809c5b4d0b9405caaa93697baeea39b. Resources: {'key_pairs'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 04:00:05.135744 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-342ad41b-c836-4ec8-9808-43da7edc7a4c tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Getting quotas for user bb05a7575aa041cd9d38cfaba331446f and project f809c5b4d0b9405caaa93697baeea39b. Resources: {'key_pairs'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 04:00:05.249610 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-342ad41b-c836-4ec8-9808-43da7edc7a4c tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 395 microversion: 2.1 time: 0.464769 Oct 19 04:00:05.251363 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3512/6889] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Oct 19 04:00:04 2022] POST /compute/v2.1/os-keypairs => generated 395 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 04:00:08.776555 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-66f076dd-04b3-46ca-8e88-03702b963e97 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-1199194980", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-49554266", "security_groups": [{"name": "tempest-secgroup-smoke-1745555873"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "24b65194-06bd-42e3-8b2a-ec941cd4c262"}]}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:00:08.848017 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=90,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:00:08.904475 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-66f076dd-04b3-46ca-8e88-03702b963e97 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] validate_networks() for [('24b65194-06bd-42e3-8b2a-ec941cd4c262', None, None, None, None, None)] {{(pid=121134) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 04:00:09.414528 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-66f076dd-04b3-46ca-8e88-03702b963e97 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Getting quotas for project f809c5b4d0b9405caaa93697baeea39b. Resources: dict_keys(['metadata_items']) {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 04:00:09.420115 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-66f076dd-04b3-46ca-8e88-03702b963e97 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Getting quotas for user bb05a7575aa041cd9d38cfaba331446f and project f809c5b4d0b9405caaa93697baeea39b. Resources: dict_keys(['metadata_items']) {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 04:00:09.434004 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-66f076dd-04b3-46ca-8e88-03702b963e97 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Flavor limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 04:00:09.434728 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-66f076dd-04b3-46ca-8e88-03702b963e97 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Image limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 04:00:09.435923 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-66f076dd-04b3-46ca-8e88-03702b963e97 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Flavor pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 04:00:09.436347 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-66f076dd-04b3-46ca-8e88-03702b963e97 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Image pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 04:00:09.436759 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-66f076dd-04b3-46ca-8e88-03702b963e97 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 04:00:09.448124 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-66f076dd-04b3-46ca-8e88-03702b963e97 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:00:09.449104 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-66f076dd-04b3-46ca-8e88-03702b963e97 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:00:09.452354 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-66f076dd-04b3-46ca-8e88-03702b963e97 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:00:09.454470 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-66f076dd-04b3-46ca-8e88-03702b963e97 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:00:09.455119 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-66f076dd-04b3-46ca-8e88-03702b963e97 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:00:09.456036 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-66f076dd-04b3-46ca-8e88-03702b963e97 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:00:09.474507 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-66f076dd-04b3-46ca-8e88-03702b963e97 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Getting quotas for project f809c5b4d0b9405caaa93697baeea39b. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 04:00:09.482891 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-66f076dd-04b3-46ca-8e88-03702b963e97 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Getting quotas for user bb05a7575aa041cd9d38cfaba331446f and project f809c5b4d0b9405caaa93697baeea39b. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 04:00:09.501266 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-66f076dd-04b3-46ca-8e88-03702b963e97 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Going to run 1 instances... {{(pid=121134) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 04:00:09.501266 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-66f076dd-04b3-46ca-8e88-03702b963e97 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] [instance: 6a87c0fe-b69c-4db5-800f-eb79c28fc4bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 04:00:09.651881 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-66f076dd-04b3-46ca-8e88-03702b963e97 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.875157 Oct 19 04:00:09.653203 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3513/6890] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 04:00:08 2022] POST /compute/v2.1/servers => generated 406 bytes in 882 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 19 04:00:09.670371 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c4127d83-9152-4525-84f3-2156c13eda60 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:00:09.671607 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c4127d83-9152-4525-84f3-2156c13eda60 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] [instance: 6a87c0fe-b69c-4db5-800f-eb79c28fc4bf] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:00:09.772503 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c4127d83-9152-4525-84f3-2156c13eda60 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb05a7575aa041cd9d38cfaba331446f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f809c5b4d0b9405caaa93697baeea39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:00:09.783806 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c4127d83-9152-4525-84f3-2156c13eda60 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] 10.222.0.52 "GET /compute/v2.1/servers/6a87c0fe-b69c-4db5-800f-eb79c28fc4bf" status: 200 len: 1301 microversion: 2.1 time: 0.122328 Oct 19 04:00:09.784534 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3514/6891] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:00:09 2022] GET /compute/v2.1/servers/6a87c0fe-b69c-4db5-800f-eb79c28fc4bf => generated 1301 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:00:10.807488 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e6a48427-102b-4da9-a8fd-eb060914799e tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:00:10.808169 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e6a48427-102b-4da9-a8fd-eb060914799e tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] [instance: 6a87c0fe-b69c-4db5-800f-eb79c28fc4bf] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:00:10.811463 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=2,nova_api:INSERT=4 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:00:10.956601 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e6a48427-102b-4da9-a8fd-eb060914799e tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb05a7575aa041cd9d38cfaba331446f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f809c5b4d0b9405caaa93697baeea39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:00:10.967514 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e6a48427-102b-4da9-a8fd-eb060914799e tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] 10.222.0.52 "GET /compute/v2.1/servers/6a87c0fe-b69c-4db5-800f-eb79c28fc4bf" status: 200 len: 1301 microversion: 2.1 time: 0.164119 Oct 19 04:00:10.970224 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3515/6892] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:00:10 2022] GET /compute/v2.1/servers/6a87c0fe-b69c-4db5-800f-eb79c28fc4bf => generated 1301 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:00:11.993483 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5242d5e0-b858-44b2-a6e5-cde8519bb7cc tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:00:11.998364 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5242d5e0-b858-44b2-a6e5-cde8519bb7cc tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] [instance: 6a87c0fe-b69c-4db5-800f-eb79c28fc4bf] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:00:12.007861 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5242d5e0-b858-44b2-a6e5-cde8519bb7cc tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:00:12.009044 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5242d5e0-b858-44b2-a6e5-cde8519bb7cc tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:00:12.009763 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5242d5e0-b858-44b2-a6e5-cde8519bb7cc tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:00:12.010764 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5242d5e0-b858-44b2-a6e5-cde8519bb7cc tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:00:12.011510 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5242d5e0-b858-44b2-a6e5-cde8519bb7cc tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:00:12.012192 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5242d5e0-b858-44b2-a6e5-cde8519bb7cc tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:00:12.102215 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5242d5e0-b858-44b2-a6e5-cde8519bb7cc tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb05a7575aa041cd9d38cfaba331446f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f809c5b4d0b9405caaa93697baeea39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:00:12.113333 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5242d5e0-b858-44b2-a6e5-cde8519bb7cc tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] 10.222.0.52 "GET /compute/v2.1/servers/6a87c0fe-b69c-4db5-800f-eb79c28fc4bf" status: 200 len: 1353 microversion: 2.1 time: 0.125210 Oct 19 04:00:12.115216 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3516/6893] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:00:11 2022] GET /compute/v2.1/servers/6a87c0fe-b69c-4db5-800f-eb79c28fc4bf => generated 1353 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:00:13.137446 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-23e2470e-ab41-4932-96c1-401a34753177 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:00:13.138767 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-23e2470e-ab41-4932-96c1-401a34753177 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] [instance: 6a87c0fe-b69c-4db5-800f-eb79c28fc4bf] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:00:13.145942 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-23e2470e-ab41-4932-96c1-401a34753177 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:00:13.146556 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-23e2470e-ab41-4932-96c1-401a34753177 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:00:13.153349 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-23e2470e-ab41-4932-96c1-401a34753177 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:00:13.153349 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-23e2470e-ab41-4932-96c1-401a34753177 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:00:13.153349 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-23e2470e-ab41-4932-96c1-401a34753177 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:00:13.153349 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-23e2470e-ab41-4932-96c1-401a34753177 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:00:13.248199 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-23e2470e-ab41-4932-96c1-401a34753177 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb05a7575aa041cd9d38cfaba331446f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f809c5b4d0b9405caaa93697baeea39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:00:13.256545 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-23e2470e-ab41-4932-96c1-401a34753177 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] 10.222.0.52 "GET /compute/v2.1/servers/6a87c0fe-b69c-4db5-800f-eb79c28fc4bf" status: 200 len: 1359 microversion: 2.1 time: 0.122925 Oct 19 04:00:13.257156 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3517/6894] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:00:13 2022] GET /compute/v2.1/servers/6a87c0fe-b69c-4db5-800f-eb79c28fc4bf => generated 1359 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:00:14.280170 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-012bea45-d3a2-4e88-9feb-26cedff0478e tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:00:14.280905 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-012bea45-d3a2-4e88-9feb-26cedff0478e tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] [instance: 6a87c0fe-b69c-4db5-800f-eb79c28fc4bf] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:00:14.287923 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-012bea45-d3a2-4e88-9feb-26cedff0478e tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:00:14.288601 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-012bea45-d3a2-4e88-9feb-26cedff0478e tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:00:14.288937 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-012bea45-d3a2-4e88-9feb-26cedff0478e tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:00:14.289765 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-012bea45-d3a2-4e88-9feb-26cedff0478e tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:00:14.290138 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-012bea45-d3a2-4e88-9feb-26cedff0478e tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:00:14.290558 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-012bea45-d3a2-4e88-9feb-26cedff0478e tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:00:14.530212 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-012bea45-d3a2-4e88-9feb-26cedff0478e tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb05a7575aa041cd9d38cfaba331446f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f809c5b4d0b9405caaa93697baeea39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:00:14.538923 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-012bea45-d3a2-4e88-9feb-26cedff0478e tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] 10.222.0.52 "GET /compute/v2.1/servers/6a87c0fe-b69c-4db5-800f-eb79c28fc4bf" status: 200 len: 1427 microversion: 2.1 time: 0.262238 Oct 19 04:00:14.539545 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3518/6895] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:00:14 2022] GET /compute/v2.1/servers/6a87c0fe-b69c-4db5-800f-eb79c28fc4bf => generated 1427 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:00:14.887478 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-38c6c372-4b21-4dca-bb3d-9adb2ea66959 req-60fd45b3-1af9-41e5-a2d8-d29bd9906c53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a87c0fe-b69c-4db5-800f-eb79c28fc4bf", "tag": "4ff175da-6016-4896-a556-83f7df41d005"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:00:14.903902 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-38c6c372-4b21-4dca-bb3d-9adb2ea66959 req-60fd45b3-1af9-41e5-a2d8-d29bd9906c53 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:00:14.905285 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-38c6c372-4b21-4dca-bb3d-9adb2ea66959 req-60fd45b3-1af9-41e5-a2d8-d29bd9906c53 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:00:14.906007 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-38c6c372-4b21-4dca-bb3d-9adb2ea66959 req-60fd45b3-1af9-41e5-a2d8-d29bd9906c53 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:00:14.918934 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-38c6c372-4b21-4dca-bb3d-9adb2ea66959 req-60fd45b3-1af9-41e5-a2d8-d29bd9906c53 service nova] Creating event network-changed:4ff175da-6016-4896-a556-83f7df41d005 for instance 6a87c0fe-b69c-4db5-800f-eb79c28fc4bf on n-h2-861333-8 Oct 19 04:00:14.924044 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-38c6c372-4b21-4dca-bb3d-9adb2ea66959 req-60fd45b3-1af9-41e5-a2d8-d29bd9906c53 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040660 Oct 19 04:00:14.925033 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3519/6896] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:00:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 04:00:15.566109 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-669b6ea9-4dd1-4b72-85da-3c7bc16e7bea tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:00:15.566803 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-669b6ea9-4dd1-4b72-85da-3c7bc16e7bea tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] [instance: 6a87c0fe-b69c-4db5-800f-eb79c28fc4bf] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:00:15.573349 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-669b6ea9-4dd1-4b72-85da-3c7bc16e7bea tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:00:15.573898 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-669b6ea9-4dd1-4b72-85da-3c7bc16e7bea tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:00:15.574341 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-669b6ea9-4dd1-4b72-85da-3c7bc16e7bea tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:00:15.575052 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-669b6ea9-4dd1-4b72-85da-3c7bc16e7bea tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:00:15.575519 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-669b6ea9-4dd1-4b72-85da-3c7bc16e7bea tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:00:15.576615 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-669b6ea9-4dd1-4b72-85da-3c7bc16e7bea tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:00:15.757160 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-669b6ea9-4dd1-4b72-85da-3c7bc16e7bea tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb05a7575aa041cd9d38cfaba331446f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f809c5b4d0b9405caaa93697baeea39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:00:15.765068 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-669b6ea9-4dd1-4b72-85da-3c7bc16e7bea tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] 10.222.0.52 "GET /compute/v2.1/servers/6a87c0fe-b69c-4db5-800f-eb79c28fc4bf" status: 200 len: 1427 microversion: 2.1 time: 0.204904 Oct 19 04:00:15.765673 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3520/6897] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:00:15 2022] GET /compute/v2.1/servers/6a87c0fe-b69c-4db5-800f-eb79c28fc4bf => generated 1427 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:00:16.789730 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-09b89ee1-3603-4598-b3a4-65d9be671d8b tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:00:16.790585 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-09b89ee1-3603-4598-b3a4-65d9be671d8b tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] [instance: 6a87c0fe-b69c-4db5-800f-eb79c28fc4bf] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:00:16.796635 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-09b89ee1-3603-4598-b3a4-65d9be671d8b tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:00:16.797135 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-09b89ee1-3603-4598-b3a4-65d9be671d8b tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:00:16.797619 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-09b89ee1-3603-4598-b3a4-65d9be671d8b tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:00:16.798335 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-09b89ee1-3603-4598-b3a4-65d9be671d8b tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:00:16.798799 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-09b89ee1-3603-4598-b3a4-65d9be671d8b tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:00:16.799235 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-09b89ee1-3603-4598-b3a4-65d9be671d8b tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:00:16.937840 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-09b89ee1-3603-4598-b3a4-65d9be671d8b tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb05a7575aa041cd9d38cfaba331446f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f809c5b4d0b9405caaa93697baeea39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:00:16.953324 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-09b89ee1-3603-4598-b3a4-65d9be671d8b tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] 10.222.0.52 "GET /compute/v2.1/servers/6a87c0fe-b69c-4db5-800f-eb79c28fc4bf" status: 200 len: 1427 microversion: 2.1 time: 0.165506 Oct 19 04:00:16.953324 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3521/6898] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:00:16 2022] GET /compute/v2.1/servers/6a87c0fe-b69c-4db5-800f-eb79c28fc4bf => generated 1427 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:00:17.974711 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-754fb7ad-f675-4894-9afd-16486a1c635e tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:00:17.975441 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-754fb7ad-f675-4894-9afd-16486a1c635e tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] [instance: 6a87c0fe-b69c-4db5-800f-eb79c28fc4bf] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:00:17.984164 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-754fb7ad-f675-4894-9afd-16486a1c635e tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:00:17.984676 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-754fb7ad-f675-4894-9afd-16486a1c635e tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:00:17.986598 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-754fb7ad-f675-4894-9afd-16486a1c635e tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:00:17.988488 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-754fb7ad-f675-4894-9afd-16486a1c635e tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:00:17.988979 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-754fb7ad-f675-4894-9afd-16486a1c635e tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:00:17.990061 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-754fb7ad-f675-4894-9afd-16486a1c635e tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:00:18.157674 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-754fb7ad-f675-4894-9afd-16486a1c635e tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb05a7575aa041cd9d38cfaba331446f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f809c5b4d0b9405caaa93697baeea39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:00:18.165805 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-754fb7ad-f675-4894-9afd-16486a1c635e tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] 10.222.0.52 "GET /compute/v2.1/servers/6a87c0fe-b69c-4db5-800f-eb79c28fc4bf" status: 200 len: 1427 microversion: 2.1 time: 0.195199 Oct 19 04:00:18.166285 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3522/6899] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:00:17 2022] GET /compute/v2.1/servers/6a87c0fe-b69c-4db5-800f-eb79c28fc4bf => generated 1427 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:00:19.188556 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e1b0765f-31c6-489b-ad7e-e959069b7c73 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:00:19.189167 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e1b0765f-31c6-489b-ad7e-e959069b7c73 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] [instance: 6a87c0fe-b69c-4db5-800f-eb79c28fc4bf] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:00:19.196210 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e1b0765f-31c6-489b-ad7e-e959069b7c73 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:00:19.196721 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e1b0765f-31c6-489b-ad7e-e959069b7c73 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:00:19.197150 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e1b0765f-31c6-489b-ad7e-e959069b7c73 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:00:19.198363 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e1b0765f-31c6-489b-ad7e-e959069b7c73 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:00:19.198832 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e1b0765f-31c6-489b-ad7e-e959069b7c73 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:00:19.199313 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e1b0765f-31c6-489b-ad7e-e959069b7c73 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:00:19.347243 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e1b0765f-31c6-489b-ad7e-e959069b7c73 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb05a7575aa041cd9d38cfaba331446f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f809c5b4d0b9405caaa93697baeea39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:00:19.355477 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e1b0765f-31c6-489b-ad7e-e959069b7c73 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] 10.222.0.52 "GET /compute/v2.1/servers/6a87c0fe-b69c-4db5-800f-eb79c28fc4bf" status: 200 len: 1427 microversion: 2.1 time: 0.171473 Oct 19 04:00:19.356067 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3523/6900] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:00:19 2022] GET /compute/v2.1/servers/6a87c0fe-b69c-4db5-800f-eb79c28fc4bf => generated 1427 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:00:20.380419 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-14298c09-6e53-40b9-9f39-ceb1b566342a tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:00:20.381110 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-14298c09-6e53-40b9-9f39-ceb1b566342a tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] [instance: 6a87c0fe-b69c-4db5-800f-eb79c28fc4bf] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:00:20.387166 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:00:20.390505 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-14298c09-6e53-40b9-9f39-ceb1b566342a tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:00:20.391005 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-14298c09-6e53-40b9-9f39-ceb1b566342a tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:00:20.391454 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-14298c09-6e53-40b9-9f39-ceb1b566342a tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:00:20.392175 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-14298c09-6e53-40b9-9f39-ceb1b566342a tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:00:20.392644 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-14298c09-6e53-40b9-9f39-ceb1b566342a tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:00:20.393082 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-14298c09-6e53-40b9-9f39-ceb1b566342a tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:00:20.547108 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-14298c09-6e53-40b9-9f39-ceb1b566342a tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb05a7575aa041cd9d38cfaba331446f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f809c5b4d0b9405caaa93697baeea39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:00:20.554724 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-14298c09-6e53-40b9-9f39-ceb1b566342a tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] 10.222.0.52 "GET /compute/v2.1/servers/6a87c0fe-b69c-4db5-800f-eb79c28fc4bf" status: 200 len: 1427 microversion: 2.1 time: 0.178303 Oct 19 04:00:20.555298 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3524/6901] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:00:20 2022] GET /compute/v2.1/servers/6a87c0fe-b69c-4db5-800f-eb79c28fc4bf => generated 1427 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:00:21.578278 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-28c481b0-2f62-4c16-ada2-415b10b33675 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:00:21.578808 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-28c481b0-2f62-4c16-ada2-415b10b33675 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] [instance: 6a87c0fe-b69c-4db5-800f-eb79c28fc4bf] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:00:21.580640 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=18 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:00:21.589979 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-28c481b0-2f62-4c16-ada2-415b10b33675 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:00:21.589979 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-28c481b0-2f62-4c16-ada2-415b10b33675 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:00:21.589979 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-28c481b0-2f62-4c16-ada2-415b10b33675 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:00:21.589979 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-28c481b0-2f62-4c16-ada2-415b10b33675 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:00:21.590374 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-28c481b0-2f62-4c16-ada2-415b10b33675 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:00:21.590549 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-28c481b0-2f62-4c16-ada2-415b10b33675 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:00:21.735528 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-28c481b0-2f62-4c16-ada2-415b10b33675 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb05a7575aa041cd9d38cfaba331446f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f809c5b4d0b9405caaa93697baeea39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:00:21.744116 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-28c481b0-2f62-4c16-ada2-415b10b33675 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] 10.222.0.52 "GET /compute/v2.1/servers/6a87c0fe-b69c-4db5-800f-eb79c28fc4bf" status: 200 len: 1427 microversion: 2.1 time: 0.170233 Oct 19 04:00:21.745196 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3525/6902] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:00:21 2022] GET /compute/v2.1/servers/6a87c0fe-b69c-4db5-800f-eb79c28fc4bf => generated 1427 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:00:21.827378 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6b86a940-6e66-42e8-889f-25a12a777ac8 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1819198987", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "5aad938a-42db-449b-b49e-cac2104d9fdc", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "d55e7db4-c570-4a69-afcb-0fab975a7a7e"}]}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:00:21.923481 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-6b86a940-6e66-42e8-889f-25a12a777ac8 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] validate_networks() for [('d55e7db4-c570-4a69-afcb-0fab975a7a7e', None, None, None, None, None)] {{(pid=121134) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 04:00:22.310869 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-6b86a940-6e66-42e8-889f-25a12a777ac8 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Flavor limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 04:00:22.311379 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-6b86a940-6e66-42e8-889f-25a12a777ac8 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Image limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 04:00:22.311978 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-6b86a940-6e66-42e8-889f-25a12a777ac8 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Flavor pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 04:00:22.312463 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-6b86a940-6e66-42e8-889f-25a12a777ac8 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Image pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 04:00:22.313025 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-6b86a940-6e66-42e8-889f-25a12a777ac8 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 04:00:22.322557 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6b86a940-6e66-42e8-889f-25a12a777ac8 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:00:22.323150 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6b86a940-6e66-42e8-889f-25a12a777ac8 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:00:22.323596 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6b86a940-6e66-42e8-889f-25a12a777ac8 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:00:22.324365 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6b86a940-6e66-42e8-889f-25a12a777ac8 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:00:22.324816 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6b86a940-6e66-42e8-889f-25a12a777ac8 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:00:22.325251 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6b86a940-6e66-42e8-889f-25a12a777ac8 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:00:22.343595 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-6b86a940-6e66-42e8-889f-25a12a777ac8 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Getting quotas for project beff434485604f85985617071a93727c. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 04:00:22.349388 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-6b86a940-6e66-42e8-889f-25a12a777ac8 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Getting quotas for user 4d30aa868d79473f9534bd79816c07e3 and project beff434485604f85985617071a93727c. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 04:00:22.363103 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6b86a940-6e66-42e8-889f-25a12a777ac8 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Going to run 1 instances... {{(pid=121134) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 04:00:22.365184 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6b86a940-6e66-42e8-889f-25a12a777ac8 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 66a7e71a-ccc8-4b35-ba82-8adc1d0972d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='5aad938a-42db-449b-b49e-cac2104d9fdc',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 04:00:22.520341 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6b86a940-6e66-42e8-889f-25a12a777ac8 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.696970 Oct 19 04:00:22.521141 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3526/6903] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 04:00:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 698 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 04:00:22.527246 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-ccf10e0e-a1f5-486f-9841-09ddc82327fc req-fb40c3c4-d36d-4979-a91c-6354646012cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a87c0fe-b69c-4db5-800f-eb79c28fc4bf", "name": "network-vif-plugged", "status": "completed", "tag": "4ff175da-6016-4896-a556-83f7df41d005"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:00:22.537909 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-ccf10e0e-a1f5-486f-9841-09ddc82327fc req-fb40c3c4-d36d-4979-a91c-6354646012cc service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:00:22.538233 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-ccf10e0e-a1f5-486f-9841-09ddc82327fc req-fb40c3c4-d36d-4979-a91c-6354646012cc service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:00:22.538671 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-ccf10e0e-a1f5-486f-9841-09ddc82327fc req-fb40c3c4-d36d-4979-a91c-6354646012cc service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:00:22.550202 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-ccf10e0e-a1f5-486f-9841-09ddc82327fc req-fb40c3c4-d36d-4979-a91c-6354646012cc service nova] Creating event network-vif-plugged:4ff175da-6016-4896-a556-83f7df41d005 for instance 6a87c0fe-b69c-4db5-800f-eb79c28fc4bf on n-h2-861333-8 Oct 19 04:00:22.555367 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-ccf10e0e-a1f5-486f-9841-09ddc82327fc req-fb40c3c4-d36d-4979-a91c-6354646012cc service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032115 Oct 19 04:00:22.556037 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3527/6904] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:00:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:00:22.561534 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-61f36393-3c0c-4004-9eb1-ab75fdb16478 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:00:22.562392 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-61f36393-3c0c-4004-9eb1-ab75fdb16478 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 66a7e71a-ccc8-4b35-ba82-8adc1d0972d1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:00:22.634928 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-61f36393-3c0c-4004-9eb1-ab75fdb16478 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:00:22.644555 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-61f36393-3c0c-4004-9eb1-ab75fdb16478 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/66a7e71a-ccc8-4b35-ba82-8adc1d0972d1" status: 200 len: 1057 microversion: 2.1 time: 0.087213 Oct 19 04:00:22.645149 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3528/6905] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:00:22 2022] GET /compute/v2.1/servers/66a7e71a-ccc8-4b35-ba82-8adc1d0972d1 => generated 1057 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:00:22.768676 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-97e256f6-2774-441e-85ee-5d0140858b5e tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:00:22.769344 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-97e256f6-2774-441e-85ee-5d0140858b5e tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] [instance: 6a87c0fe-b69c-4db5-800f-eb79c28fc4bf] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:00:22.776422 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-97e256f6-2774-441e-85ee-5d0140858b5e tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:00:22.776910 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-97e256f6-2774-441e-85ee-5d0140858b5e tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:00:22.777350 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-97e256f6-2774-441e-85ee-5d0140858b5e tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:00:22.778143 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-97e256f6-2774-441e-85ee-5d0140858b5e tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:00:22.778597 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-97e256f6-2774-441e-85ee-5d0140858b5e tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:00:22.779065 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-97e256f6-2774-441e-85ee-5d0140858b5e tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:00:22.917628 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-97e256f6-2774-441e-85ee-5d0140858b5e tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb05a7575aa041cd9d38cfaba331446f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f809c5b4d0b9405caaa93697baeea39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:00:22.925621 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-97e256f6-2774-441e-85ee-5d0140858b5e tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] 10.222.0.52 "GET /compute/v2.1/servers/6a87c0fe-b69c-4db5-800f-eb79c28fc4bf" status: 200 len: 1427 microversion: 2.1 time: 0.160620 Oct 19 04:00:22.930131 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3529/6906] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:00:22 2022] GET /compute/v2.1/servers/6a87c0fe-b69c-4db5-800f-eb79c28fc4bf => generated 1427 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:00:23.667539 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ecb281a2-7f93-4a28-8d75-151c955f6c8d tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:00:23.668223 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ecb281a2-7f93-4a28-8d75-151c955f6c8d tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 66a7e71a-ccc8-4b35-ba82-8adc1d0972d1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:00:23.675083 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ecb281a2-7f93-4a28-8d75-151c955f6c8d tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:00:23.675574 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ecb281a2-7f93-4a28-8d75-151c955f6c8d tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:00:23.676024 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ecb281a2-7f93-4a28-8d75-151c955f6c8d tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:00:23.676722 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ecb281a2-7f93-4a28-8d75-151c955f6c8d tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:00:23.677186 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ecb281a2-7f93-4a28-8d75-151c955f6c8d tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:00:23.677652 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ecb281a2-7f93-4a28-8d75-151c955f6c8d tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:00:23.755000 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ecb281a2-7f93-4a28-8d75-151c955f6c8d tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:00:23.764759 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ecb281a2-7f93-4a28-8d75-151c955f6c8d tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/66a7e71a-ccc8-4b35-ba82-8adc1d0972d1" status: 200 len: 1061 microversion: 2.1 time: 0.100998 Oct 19 04:00:23.776934 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3530/6907] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:00:23 2022] GET /compute/v2.1/servers/66a7e71a-ccc8-4b35-ba82-8adc1d0972d1 => generated 1061 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:00:23.951775 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-bbdbd2e9-2184-4fa6-8533-6ba59ec24bc5 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:00:23.952500 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-bbdbd2e9-2184-4fa6-8533-6ba59ec24bc5 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] [instance: 6a87c0fe-b69c-4db5-800f-eb79c28fc4bf] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:00:23.959015 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bbdbd2e9-2184-4fa6-8533-6ba59ec24bc5 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:00:23.961565 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bbdbd2e9-2184-4fa6-8533-6ba59ec24bc5 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:00:23.961565 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bbdbd2e9-2184-4fa6-8533-6ba59ec24bc5 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:00:23.961565 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bbdbd2e9-2184-4fa6-8533-6ba59ec24bc5 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:00:23.961565 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bbdbd2e9-2184-4fa6-8533-6ba59ec24bc5 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:00:23.961565 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bbdbd2e9-2184-4fa6-8533-6ba59ec24bc5 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:00:24.110858 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-bbdbd2e9-2184-4fa6-8533-6ba59ec24bc5 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb05a7575aa041cd9d38cfaba331446f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f809c5b4d0b9405caaa93697baeea39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:00:24.118812 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-bbdbd2e9-2184-4fa6-8533-6ba59ec24bc5 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] 10.222.0.52 "GET /compute/v2.1/servers/6a87c0fe-b69c-4db5-800f-eb79c28fc4bf" status: 200 len: 1427 microversion: 2.1 time: 0.171071 Oct 19 04:00:24.119387 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3531/6908] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:00:23 2022] GET /compute/v2.1/servers/6a87c0fe-b69c-4db5-800f-eb79c28fc4bf => generated 1427 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:00:24.787270 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b95acc4a-7468-45ff-87cd-c64cf4927a1d tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:00:24.787930 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b95acc4a-7468-45ff-87cd-c64cf4927a1d tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 66a7e71a-ccc8-4b35-ba82-8adc1d0972d1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:00:24.794784 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b95acc4a-7468-45ff-87cd-c64cf4927a1d tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:00:24.795336 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b95acc4a-7468-45ff-87cd-c64cf4927a1d tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:00:24.795776 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b95acc4a-7468-45ff-87cd-c64cf4927a1d tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:00:24.796462 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b95acc4a-7468-45ff-87cd-c64cf4927a1d tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:00:24.797150 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b95acc4a-7468-45ff-87cd-c64cf4927a1d tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:00:24.797327 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b95acc4a-7468-45ff-87cd-c64cf4927a1d tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:00:24.873175 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b95acc4a-7468-45ff-87cd-c64cf4927a1d tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:00:24.884398 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b95acc4a-7468-45ff-87cd-c64cf4927a1d tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/66a7e71a-ccc8-4b35-ba82-8adc1d0972d1" status: 200 len: 1109 microversion: 2.1 time: 0.101057 Oct 19 04:00:24.885003 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3532/6909] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:00:24 2022] GET /compute/v2.1/servers/66a7e71a-ccc8-4b35-ba82-8adc1d0972d1 => generated 1109 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:00:25.143156 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-77dc20dc-4733-4073-9547-c2464ce37f60 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:00:25.143783 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-77dc20dc-4733-4073-9547-c2464ce37f60 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] [instance: 6a87c0fe-b69c-4db5-800f-eb79c28fc4bf] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:00:25.150647 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-77dc20dc-4733-4073-9547-c2464ce37f60 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:00:25.151150 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-77dc20dc-4733-4073-9547-c2464ce37f60 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:00:25.151598 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-77dc20dc-4733-4073-9547-c2464ce37f60 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:00:25.152317 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-77dc20dc-4733-4073-9547-c2464ce37f60 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:00:25.152781 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-77dc20dc-4733-4073-9547-c2464ce37f60 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:00:25.153438 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-77dc20dc-4733-4073-9547-c2464ce37f60 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:00:25.308098 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-77dc20dc-4733-4073-9547-c2464ce37f60 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb05a7575aa041cd9d38cfaba331446f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f809c5b4d0b9405caaa93697baeea39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:00:25.319218 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-77dc20dc-4733-4073-9547-c2464ce37f60 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] 10.222.0.52 "GET /compute/v2.1/servers/6a87c0fe-b69c-4db5-800f-eb79c28fc4bf" status: 200 len: 1608 microversion: 2.1 time: 0.180448 Oct 19 04:00:25.320469 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3533/6910] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:00:25 2022] GET /compute/v2.1/servers/6a87c0fe-b69c-4db5-800f-eb79c28fc4bf => generated 1608 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:00:25.343156 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-fe6015e0-43b0-461e-bb66-05c7e5af9953 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:00:25.343781 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-fe6015e0-43b0-461e-bb66-05c7e5af9953 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] [instance: 6a87c0fe-b69c-4db5-800f-eb79c28fc4bf] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:00:25.350036 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fe6015e0-43b0-461e-bb66-05c7e5af9953 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:00:25.350530 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fe6015e0-43b0-461e-bb66-05c7e5af9953 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:00:25.350969 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fe6015e0-43b0-461e-bb66-05c7e5af9953 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:00:25.351671 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fe6015e0-43b0-461e-bb66-05c7e5af9953 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:00:25.352130 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fe6015e0-43b0-461e-bb66-05c7e5af9953 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:00:25.352575 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fe6015e0-43b0-461e-bb66-05c7e5af9953 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:00:25.516400 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-fe6015e0-43b0-461e-bb66-05c7e5af9953 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb05a7575aa041cd9d38cfaba331446f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f809c5b4d0b9405caaa93697baeea39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:00:25.526120 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-fe6015e0-43b0-461e-bb66-05c7e5af9953 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] 10.222.0.52 "GET /compute/v2.1/servers/6a87c0fe-b69c-4db5-800f-eb79c28fc4bf" status: 200 len: 1608 microversion: 2.1 time: 0.186950 Oct 19 04:00:25.527674 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3534/6911] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:00:25 2022] GET /compute/v2.1/servers/6a87c0fe-b69c-4db5-800f-eb79c28fc4bf => generated 1608 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:00:25.558546 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-97becdf8-7a48-477b-82fb-f951d189164e tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:00:25.559491 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-97becdf8-7a48-477b-82fb-f951d189164e tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] [instance: 6a87c0fe-b69c-4db5-800f-eb79c28fc4bf] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:00:25.566300 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-97becdf8-7a48-477b-82fb-f951d189164e tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:00:25.570525 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-97becdf8-7a48-477b-82fb-f951d189164e tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:00:25.570525 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-97becdf8-7a48-477b-82fb-f951d189164e tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:00:25.570525 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-97becdf8-7a48-477b-82fb-f951d189164e tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:00:25.570525 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-97becdf8-7a48-477b-82fb-f951d189164e tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:00:25.570525 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-97becdf8-7a48-477b-82fb-f951d189164e tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:00:25.573218 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=100 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:00:25.710741 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-97becdf8-7a48-477b-82fb-f951d189164e tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb05a7575aa041cd9d38cfaba331446f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f809c5b4d0b9405caaa93697baeea39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:00:25.721501 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-97becdf8-7a48-477b-82fb-f951d189164e tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] 10.222.0.52 "GET /compute/v2.1/servers/6a87c0fe-b69c-4db5-800f-eb79c28fc4bf" status: 200 len: 1608 microversion: 2.1 time: 0.167680 Oct 19 04:00:25.722193 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3535/6912] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:00:25 2022] GET /compute/v2.1/servers/6a87c0fe-b69c-4db5-800f-eb79c28fc4bf => generated 1608 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:00:25.908647 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8cd1cc4f-1ed8-4f85-85b5-a0d2d42fa4c0 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:00:25.909914 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8cd1cc4f-1ed8-4f85-85b5-a0d2d42fa4c0 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 66a7e71a-ccc8-4b35-ba82-8adc1d0972d1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:00:25.924132 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8cd1cc4f-1ed8-4f85-85b5-a0d2d42fa4c0 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:00:25.924645 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8cd1cc4f-1ed8-4f85-85b5-a0d2d42fa4c0 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:00:25.925097 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8cd1cc4f-1ed8-4f85-85b5-a0d2d42fa4c0 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:00:25.925851 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8cd1cc4f-1ed8-4f85-85b5-a0d2d42fa4c0 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:00:25.929889 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8cd1cc4f-1ed8-4f85-85b5-a0d2d42fa4c0 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:00:25.929889 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8cd1cc4f-1ed8-4f85-85b5-a0d2d42fa4c0 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:00:26.022616 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8cd1cc4f-1ed8-4f85-85b5-a0d2d42fa4c0 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:00:26.032448 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8cd1cc4f-1ed8-4f85-85b5-a0d2d42fa4c0 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/66a7e71a-ccc8-4b35-ba82-8adc1d0972d1" status: 200 len: 1127 microversion: 2.1 time: 0.127599 Oct 19 04:00:26.033029 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3536/6913] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:00:25 2022] GET /compute/v2.1/servers/66a7e71a-ccc8-4b35-ba82-8adc1d0972d1 => generated 1127 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:00:27.059911 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9beac4b4-25b4-4e5a-a3d3-82e428affb29 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:00:27.061728 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9beac4b4-25b4-4e5a-a3d3-82e428affb29 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 66a7e71a-ccc8-4b35-ba82-8adc1d0972d1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:00:27.069752 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9beac4b4-25b4-4e5a-a3d3-82e428affb29 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:00:27.070543 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9beac4b4-25b4-4e5a-a3d3-82e428affb29 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:00:27.071166 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9beac4b4-25b4-4e5a-a3d3-82e428affb29 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:00:27.072119 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9beac4b4-25b4-4e5a-a3d3-82e428affb29 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:00:27.072778 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9beac4b4-25b4-4e5a-a3d3-82e428affb29 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:00:27.073644 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9beac4b4-25b4-4e5a-a3d3-82e428affb29 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:00:27.345186 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9beac4b4-25b4-4e5a-a3d3-82e428affb29 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:00:27.358464 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9beac4b4-25b4-4e5a-a3d3-82e428affb29 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/66a7e71a-ccc8-4b35-ba82-8adc1d0972d1" status: 200 len: 1169 microversion: 2.1 time: 0.306004 Oct 19 04:00:27.361204 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3537/6914] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:00:27 2022] GET /compute/v2.1/servers/66a7e71a-ccc8-4b35-ba82-8adc1d0972d1 => generated 1169 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:00:27.572952 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-2fc422c9-1f63-4b72-97e7-9e929057217f req-dfc3f652-ebf1-4b2f-85b3-b7fe1b581896 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66a7e71a-ccc8-4b35-ba82-8adc1d0972d1", "tag": "1ad8e64b-3a95-4651-839a-6cb61bb9fb68"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:00:27.589143 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-2fc422c9-1f63-4b72-97e7-9e929057217f req-dfc3f652-ebf1-4b2f-85b3-b7fe1b581896 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:00:27.592430 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-2fc422c9-1f63-4b72-97e7-9e929057217f req-dfc3f652-ebf1-4b2f-85b3-b7fe1b581896 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:00:27.593202 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-2fc422c9-1f63-4b72-97e7-9e929057217f req-dfc3f652-ebf1-4b2f-85b3-b7fe1b581896 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:00:27.614398 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-2fc422c9-1f63-4b72-97e7-9e929057217f req-dfc3f652-ebf1-4b2f-85b3-b7fe1b581896 service nova] Creating event network-changed:1ad8e64b-3a95-4651-839a-6cb61bb9fb68 for instance 66a7e71a-ccc8-4b35-ba82-8adc1d0972d1 on n-h1-861333-8 Oct 19 04:00:27.623011 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-2fc422c9-1f63-4b72-97e7-9e929057217f req-dfc3f652-ebf1-4b2f-85b3-b7fe1b581896 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.257577 Oct 19 04:00:27.623632 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3538/6915] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:00:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:00:28.385767 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c8bfa693-6d6d-4d2d-97e4-a13a514b43dc tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:00:28.387200 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c8bfa693-6d6d-4d2d-97e4-a13a514b43dc tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 66a7e71a-ccc8-4b35-ba82-8adc1d0972d1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:00:28.397950 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c8bfa693-6d6d-4d2d-97e4-a13a514b43dc tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:00:28.398820 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c8bfa693-6d6d-4d2d-97e4-a13a514b43dc tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:00:28.399524 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c8bfa693-6d6d-4d2d-97e4-a13a514b43dc tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:00:28.400475 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c8bfa693-6d6d-4d2d-97e4-a13a514b43dc tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:00:28.401440 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c8bfa693-6d6d-4d2d-97e4-a13a514b43dc tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:00:28.402098 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c8bfa693-6d6d-4d2d-97e4-a13a514b43dc tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:00:29.101868 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c8bfa693-6d6d-4d2d-97e4-a13a514b43dc tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:00:29.110739 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c8bfa693-6d6d-4d2d-97e4-a13a514b43dc tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/66a7e71a-ccc8-4b35-ba82-8adc1d0972d1" status: 200 len: 1169 microversion: 2.1 time: 0.730287 Oct 19 04:00:29.127421 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3539/6916] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:00:28 2022] GET /compute/v2.1/servers/66a7e71a-ccc8-4b35-ba82-8adc1d0972d1 => generated 1169 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:00:29.134521 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-8f41fe10-fc7e-4f56-b662-bec432fe7784 req-c77f6f8a-d5fb-4fb8-9aa7-7d063cb39b22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a87c0fe-b69c-4db5-800f-eb79c28fc4bf", "tag": "4ff175da-6016-4896-a556-83f7df41d005"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:00:29.150821 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-8f41fe10-fc7e-4f56-b662-bec432fe7784 req-c77f6f8a-d5fb-4fb8-9aa7-7d063cb39b22 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:00:29.156108 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-8f41fe10-fc7e-4f56-b662-bec432fe7784 req-c77f6f8a-d5fb-4fb8-9aa7-7d063cb39b22 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:00:29.157143 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-8f41fe10-fc7e-4f56-b662-bec432fe7784 req-c77f6f8a-d5fb-4fb8-9aa7-7d063cb39b22 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:00:29.182269 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-8f41fe10-fc7e-4f56-b662-bec432fe7784 req-c77f6f8a-d5fb-4fb8-9aa7-7d063cb39b22 service nova] Creating event network-changed:4ff175da-6016-4896-a556-83f7df41d005 for instance 6a87c0fe-b69c-4db5-800f-eb79c28fc4bf on n-h2-861333-8 Oct 19 04:00:29.188520 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-8f41fe10-fc7e-4f56-b662-bec432fe7784 req-c77f6f8a-d5fb-4fb8-9aa7-7d063cb39b22 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059614 Oct 19 04:00:29.189504 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3540/6917] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:00:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:00:30.135282 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0fb3936e-43ba-4e03-bca4-299b5ecbc0b8 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:00:30.135996 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0fb3936e-43ba-4e03-bca4-299b5ecbc0b8 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 66a7e71a-ccc8-4b35-ba82-8adc1d0972d1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:00:30.143010 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0fb3936e-43ba-4e03-bca4-299b5ecbc0b8 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:00:30.143530 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0fb3936e-43ba-4e03-bca4-299b5ecbc0b8 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:00:30.144070 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0fb3936e-43ba-4e03-bca4-299b5ecbc0b8 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:00:30.144809 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0fb3936e-43ba-4e03-bca4-299b5ecbc0b8 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:00:30.145428 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0fb3936e-43ba-4e03-bca4-299b5ecbc0b8 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:00:30.145866 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0fb3936e-43ba-4e03-bca4-299b5ecbc0b8 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:00:30.298449 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0fb3936e-43ba-4e03-bca4-299b5ecbc0b8 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:00:30.310117 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0fb3936e-43ba-4e03-bca4-299b5ecbc0b8 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/66a7e71a-ccc8-4b35-ba82-8adc1d0972d1" status: 200 len: 1169 microversion: 2.1 time: 0.179971 Oct 19 04:00:30.310511 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3541/6918] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:00:30 2022] GET /compute/v2.1/servers/66a7e71a-ccc8-4b35-ba82-8adc1d0972d1 => generated 1169 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:00:31.335960 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8bfb3a45-4839-444d-9420-da6dffdd3219 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:00:31.336798 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8bfb3a45-4839-444d-9420-da6dffdd3219 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 66a7e71a-ccc8-4b35-ba82-8adc1d0972d1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:00:31.343876 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8bfb3a45-4839-444d-9420-da6dffdd3219 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:00:31.344507 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8bfb3a45-4839-444d-9420-da6dffdd3219 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:00:31.345218 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8bfb3a45-4839-444d-9420-da6dffdd3219 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:00:31.346005 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8bfb3a45-4839-444d-9420-da6dffdd3219 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:00:31.346531 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8bfb3a45-4839-444d-9420-da6dffdd3219 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:00:31.347000 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8bfb3a45-4839-444d-9420-da6dffdd3219 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:00:31.495450 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8bfb3a45-4839-444d-9420-da6dffdd3219 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:00:31.504374 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8bfb3a45-4839-444d-9420-da6dffdd3219 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/66a7e71a-ccc8-4b35-ba82-8adc1d0972d1" status: 200 len: 1169 microversion: 2.1 time: 0.173285 Oct 19 04:00:31.504974 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3542/6919] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:00:31 2022] GET /compute/v2.1/servers/66a7e71a-ccc8-4b35-ba82-8adc1d0972d1 => generated 1169 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:00:32.527339 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3db6f43b-51ef-43c7-ad4b-72b449326050 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:00:32.527996 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3db6f43b-51ef-43c7-ad4b-72b449326050 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 66a7e71a-ccc8-4b35-ba82-8adc1d0972d1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:00:32.530366 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:00:32.537064 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3db6f43b-51ef-43c7-ad4b-72b449326050 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:00:32.537825 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3db6f43b-51ef-43c7-ad4b-72b449326050 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:00:32.538386 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3db6f43b-51ef-43c7-ad4b-72b449326050 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:00:32.539359 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3db6f43b-51ef-43c7-ad4b-72b449326050 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:00:32.539977 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3db6f43b-51ef-43c7-ad4b-72b449326050 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:00:32.540577 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3db6f43b-51ef-43c7-ad4b-72b449326050 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:00:32.641753 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=8 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:00:32.689033 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-3db6f43b-51ef-43c7-ad4b-72b449326050 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:00:32.698415 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3db6f43b-51ef-43c7-ad4b-72b449326050 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/66a7e71a-ccc8-4b35-ba82-8adc1d0972d1" status: 200 len: 1169 microversion: 2.1 time: 0.174525 Oct 19 04:00:32.699099 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3543/6920] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:00:32 2022] GET /compute/v2.1/servers/66a7e71a-ccc8-4b35-ba82-8adc1d0972d1 => generated 1169 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:00:33.726095 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7222e2d8-6468-45c5-8011-29533d5694af tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:00:33.726845 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7222e2d8-6468-45c5-8011-29533d5694af tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 66a7e71a-ccc8-4b35-ba82-8adc1d0972d1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:00:33.734704 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7222e2d8-6468-45c5-8011-29533d5694af tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:00:33.735202 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7222e2d8-6468-45c5-8011-29533d5694af tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:00:33.736370 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7222e2d8-6468-45c5-8011-29533d5694af tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:00:33.736486 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7222e2d8-6468-45c5-8011-29533d5694af tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:00:33.736957 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7222e2d8-6468-45c5-8011-29533d5694af tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:00:33.737412 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7222e2d8-6468-45c5-8011-29533d5694af tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:00:33.889532 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-7222e2d8-6468-45c5-8011-29533d5694af tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:00:33.898850 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7222e2d8-6468-45c5-8011-29533d5694af tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/66a7e71a-ccc8-4b35-ba82-8adc1d0972d1" status: 200 len: 1169 microversion: 2.1 time: 0.178110 Oct 19 04:00:33.899497 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3544/6921] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:00:33 2022] GET /compute/v2.1/servers/66a7e71a-ccc8-4b35-ba82-8adc1d0972d1 => generated 1169 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:00:34.922355 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7e44fdb0-cd3d-46df-855f-6f53f4dbdd89 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:00:34.923040 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7e44fdb0-cd3d-46df-855f-6f53f4dbdd89 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 66a7e71a-ccc8-4b35-ba82-8adc1d0972d1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:00:34.930148 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7e44fdb0-cd3d-46df-855f-6f53f4dbdd89 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:00:34.930639 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7e44fdb0-cd3d-46df-855f-6f53f4dbdd89 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:00:34.931077 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7e44fdb0-cd3d-46df-855f-6f53f4dbdd89 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:00:34.931780 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7e44fdb0-cd3d-46df-855f-6f53f4dbdd89 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:00:34.932249 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7e44fdb0-cd3d-46df-855f-6f53f4dbdd89 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:00:34.932780 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7e44fdb0-cd3d-46df-855f-6f53f4dbdd89 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:00:35.091676 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-7e44fdb0-cd3d-46df-855f-6f53f4dbdd89 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:00:35.100708 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7e44fdb0-cd3d-46df-855f-6f53f4dbdd89 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/66a7e71a-ccc8-4b35-ba82-8adc1d0972d1" status: 200 len: 1169 microversion: 2.1 time: 0.182300 Oct 19 04:00:35.101287 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3545/6922] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:00:34 2022] GET /compute/v2.1/servers/66a7e71a-ccc8-4b35-ba82-8adc1d0972d1 => generated 1169 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:00:36.125548 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-97d508b3-3765-46e4-82d5-10a44387aa87 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:00:36.126312 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-97d508b3-3765-46e4-82d5-10a44387aa87 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 66a7e71a-ccc8-4b35-ba82-8adc1d0972d1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:00:36.133047 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-97d508b3-3765-46e4-82d5-10a44387aa87 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:00:36.133563 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-97d508b3-3765-46e4-82d5-10a44387aa87 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:00:36.134012 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-97d508b3-3765-46e4-82d5-10a44387aa87 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:00:36.134700 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-97d508b3-3765-46e4-82d5-10a44387aa87 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:00:36.135286 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-97d508b3-3765-46e4-82d5-10a44387aa87 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:00:36.135715 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-97d508b3-3765-46e4-82d5-10a44387aa87 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:00:36.273817 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-97d508b3-3765-46e4-82d5-10a44387aa87 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:00:36.281985 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-97d508b3-3765-46e4-82d5-10a44387aa87 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/66a7e71a-ccc8-4b35-ba82-8adc1d0972d1" status: 200 len: 1169 microversion: 2.1 time: 0.160550 Oct 19 04:00:36.282571 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3546/6923] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:00:36 2022] GET /compute/v2.1/servers/66a7e71a-ccc8-4b35-ba82-8adc1d0972d1 => generated 1169 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:00:37.312365 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b8bb0eac-d7f8-42fe-8f86-6624ced8aa43 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:00:37.313128 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b8bb0eac-d7f8-42fe-8f86-6624ced8aa43 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 66a7e71a-ccc8-4b35-ba82-8adc1d0972d1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:00:37.320635 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b8bb0eac-d7f8-42fe-8f86-6624ced8aa43 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:00:37.321129 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b8bb0eac-d7f8-42fe-8f86-6624ced8aa43 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:00:37.321898 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b8bb0eac-d7f8-42fe-8f86-6624ced8aa43 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:00:37.322617 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b8bb0eac-d7f8-42fe-8f86-6624ced8aa43 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:00:37.323080 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b8bb0eac-d7f8-42fe-8f86-6624ced8aa43 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:00:37.323515 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b8bb0eac-d7f8-42fe-8f86-6624ced8aa43 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:00:37.468929 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b8bb0eac-d7f8-42fe-8f86-6624ced8aa43 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:00:37.477056 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b8bb0eac-d7f8-42fe-8f86-6624ced8aa43 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/66a7e71a-ccc8-4b35-ba82-8adc1d0972d1" status: 200 len: 1169 microversion: 2.1 time: 0.172062 Oct 19 04:00:37.477687 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3547/6924] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:00:37 2022] GET /compute/v2.1/servers/66a7e71a-ccc8-4b35-ba82-8adc1d0972d1 => generated 1169 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:00:38.499840 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ce260f60-926a-4ca5-b349-abae4f31bdfa tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:00:38.500418 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ce260f60-926a-4ca5-b349-abae4f31bdfa tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 66a7e71a-ccc8-4b35-ba82-8adc1d0972d1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:00:38.509215 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ce260f60-926a-4ca5-b349-abae4f31bdfa tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:00:38.509215 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ce260f60-926a-4ca5-b349-abae4f31bdfa tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:00:38.509215 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ce260f60-926a-4ca5-b349-abae4f31bdfa tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:00:38.509215 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ce260f60-926a-4ca5-b349-abae4f31bdfa tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:00:38.509215 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ce260f60-926a-4ca5-b349-abae4f31bdfa tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:00:38.509762 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ce260f60-926a-4ca5-b349-abae4f31bdfa tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:00:38.656462 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ce260f60-926a-4ca5-b349-abae4f31bdfa tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:00:38.665109 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ce260f60-926a-4ca5-b349-abae4f31bdfa tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/66a7e71a-ccc8-4b35-ba82-8adc1d0972d1" status: 200 len: 1169 microversion: 2.1 time: 0.169292 Oct 19 04:00:38.671132 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3548/6925] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:00:38 2022] GET /compute/v2.1/servers/66a7e71a-ccc8-4b35-ba82-8adc1d0972d1 => generated 1169 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:00:39.690623 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-63f0724e-2f51-4fa4-9dc0-111c0c568a41 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:00:39.691761 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-63f0724e-2f51-4fa4-9dc0-111c0c568a41 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 66a7e71a-ccc8-4b35-ba82-8adc1d0972d1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:00:39.703103 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-63f0724e-2f51-4fa4-9dc0-111c0c568a41 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:00:39.704095 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-63f0724e-2f51-4fa4-9dc0-111c0c568a41 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:00:39.704095 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-63f0724e-2f51-4fa4-9dc0-111c0c568a41 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:00:39.704745 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-63f0724e-2f51-4fa4-9dc0-111c0c568a41 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:00:39.705200 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-63f0724e-2f51-4fa4-9dc0-111c0c568a41 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:00:39.705732 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-63f0724e-2f51-4fa4-9dc0-111c0c568a41 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:00:39.850441 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-63f0724e-2f51-4fa4-9dc0-111c0c568a41 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:00:39.858680 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-63f0724e-2f51-4fa4-9dc0-111c0c568a41 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/66a7e71a-ccc8-4b35-ba82-8adc1d0972d1" status: 200 len: 1169 microversion: 2.1 time: 0.172286 Oct 19 04:00:39.862669 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3549/6926] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:00:39 2022] GET /compute/v2.1/servers/66a7e71a-ccc8-4b35-ba82-8adc1d0972d1 => generated 1169 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:00:40.881947 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e223faa0-2c8e-4f4c-a933-b2f8212a8774 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:00:40.882803 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e223faa0-2c8e-4f4c-a933-b2f8212a8774 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 66a7e71a-ccc8-4b35-ba82-8adc1d0972d1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:00:40.890353 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e223faa0-2c8e-4f4c-a933-b2f8212a8774 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:00:40.891254 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e223faa0-2c8e-4f4c-a933-b2f8212a8774 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:00:40.894441 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e223faa0-2c8e-4f4c-a933-b2f8212a8774 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:00:40.896041 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e223faa0-2c8e-4f4c-a933-b2f8212a8774 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:00:40.896041 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e223faa0-2c8e-4f4c-a933-b2f8212a8774 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:00:40.896426 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e223faa0-2c8e-4f4c-a933-b2f8212a8774 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:00:41.040913 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e223faa0-2c8e-4f4c-a933-b2f8212a8774 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:00:41.049728 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e223faa0-2c8e-4f4c-a933-b2f8212a8774 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/66a7e71a-ccc8-4b35-ba82-8adc1d0972d1" status: 200 len: 1169 microversion: 2.1 time: 0.171798 Oct 19 04:00:41.050312 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3550/6927] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:00:40 2022] GET /compute/v2.1/servers/66a7e71a-ccc8-4b35-ba82-8adc1d0972d1 => generated 1169 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:00:41.284036 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ab527736-94dd-4fe8-a1df-4bac3d717b05 tempest-PortsAdminExtendedAttrsTestJSON-1894876349 tempest-PortsAdminExtendedAttrsTestJSON-1894876349-project-admin] Calling method '.version_select at 0x7fc12bf7f5e0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:00:41.286134 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ab527736-94dd-4fe8-a1df-4bac3d717b05 tempest-PortsAdminExtendedAttrsTestJSON-1894876349 tempest-PortsAdminExtendedAttrsTestJSON-1894876349-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:00:41.286700 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ab527736-94dd-4fe8-a1df-4bac3d717b05 tempest-PortsAdminExtendedAttrsTestJSON-1894876349 tempest-PortsAdminExtendedAttrsTestJSON-1894876349-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:00:41.287173 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ab527736-94dd-4fe8-a1df-4bac3d717b05 tempest-PortsAdminExtendedAttrsTestJSON-1894876349 tempest-PortsAdminExtendedAttrsTestJSON-1894876349-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:00:41.303767 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ab527736-94dd-4fe8-a1df-4bac3d717b05 tempest-PortsAdminExtendedAttrsTestJSON-1894876349 tempest-PortsAdminExtendedAttrsTestJSON-1894876349-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:00:41.304264 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ab527736-94dd-4fe8-a1df-4bac3d717b05 tempest-PortsAdminExtendedAttrsTestJSON-1894876349 tempest-PortsAdminExtendedAttrsTestJSON-1894876349-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:00:41.304709 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ab527736-94dd-4fe8-a1df-4bac3d717b05 tempest-PortsAdminExtendedAttrsTestJSON-1894876349 tempest-PortsAdminExtendedAttrsTestJSON-1894876349-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:00:41.314730 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ab527736-94dd-4fe8-a1df-4bac3d717b05 tempest-PortsAdminExtendedAttrsTestJSON-1894876349 tempest-PortsAdminExtendedAttrsTestJSON-1894876349-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:00:41.315213 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ab527736-94dd-4fe8-a1df-4bac3d717b05 tempest-PortsAdminExtendedAttrsTestJSON-1894876349 tempest-PortsAdminExtendedAttrsTestJSON-1894876349-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:00:41.315658 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ab527736-94dd-4fe8-a1df-4bac3d717b05 tempest-PortsAdminExtendedAttrsTestJSON-1894876349 tempest-PortsAdminExtendedAttrsTestJSON-1894876349-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:00:41.322600 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ab527736-94dd-4fe8-a1df-4bac3d717b05 tempest-PortsAdminExtendedAttrsTestJSON-1894876349 tempest-PortsAdminExtendedAttrsTestJSON-1894876349-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.164266 Oct 19 04:00:41.323175 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3551/6928] 10.222.0.52 () {58 vars in 1146 bytes} [Wed Oct 19 04:00:41 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 04:00:42.072946 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7765c074-f5c5-466e-bce5-370f388ea50f tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:00:42.073850 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7765c074-f5c5-466e-bce5-370f388ea50f tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 66a7e71a-ccc8-4b35-ba82-8adc1d0972d1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:00:42.076733 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:00:42.081691 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7765c074-f5c5-466e-bce5-370f388ea50f tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:00:42.082165 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7765c074-f5c5-466e-bce5-370f388ea50f tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:00:42.082605 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7765c074-f5c5-466e-bce5-370f388ea50f tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:00:42.083299 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7765c074-f5c5-466e-bce5-370f388ea50f tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:00:42.083757 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7765c074-f5c5-466e-bce5-370f388ea50f tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:00:42.084180 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7765c074-f5c5-466e-bce5-370f388ea50f tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:00:42.232983 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-7765c074-f5c5-466e-bce5-370f388ea50f tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:00:42.258358 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7765c074-f5c5-466e-bce5-370f388ea50f tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/66a7e71a-ccc8-4b35-ba82-8adc1d0972d1" status: 200 len: 1169 microversion: 2.1 time: 0.176882 Oct 19 04:00:42.258358 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3552/6929] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:00:42 2022] GET /compute/v2.1/servers/66a7e71a-ccc8-4b35-ba82-8adc1d0972d1 => generated 1169 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:00:43.274998 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-61b2dffc-db2c-4e50-a472-d6ac8a7a2f22 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:00:43.275726 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-61b2dffc-db2c-4e50-a472-d6ac8a7a2f22 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 66a7e71a-ccc8-4b35-ba82-8adc1d0972d1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:00:43.283740 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-61b2dffc-db2c-4e50-a472-d6ac8a7a2f22 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:00:43.284223 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-61b2dffc-db2c-4e50-a472-d6ac8a7a2f22 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:00:43.284658 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-61b2dffc-db2c-4e50-a472-d6ac8a7a2f22 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:00:43.285353 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-61b2dffc-db2c-4e50-a472-d6ac8a7a2f22 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:00:43.285858 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-61b2dffc-db2c-4e50-a472-d6ac8a7a2f22 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:00:43.286330 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-61b2dffc-db2c-4e50-a472-d6ac8a7a2f22 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:00:43.290748 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=100 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:00:43.431361 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-61b2dffc-db2c-4e50-a472-d6ac8a7a2f22 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:00:43.439738 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-61b2dffc-db2c-4e50-a472-d6ac8a7a2f22 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/66a7e71a-ccc8-4b35-ba82-8adc1d0972d1" status: 200 len: 1169 microversion: 2.1 time: 0.172339 Oct 19 04:00:43.440372 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3553/6930] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:00:43 2022] GET /compute/v2.1/servers/66a7e71a-ccc8-4b35-ba82-8adc1d0972d1 => generated 1169 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:00:44.464817 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d3d4d9b3-5821-4835-898c-bc002b2aa183 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:00:44.469219 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d3d4d9b3-5821-4835-898c-bc002b2aa183 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 66a7e71a-ccc8-4b35-ba82-8adc1d0972d1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:00:44.474065 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d3d4d9b3-5821-4835-898c-bc002b2aa183 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:00:44.474568 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d3d4d9b3-5821-4835-898c-bc002b2aa183 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:00:44.475169 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d3d4d9b3-5821-4835-898c-bc002b2aa183 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:00:44.475893 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d3d4d9b3-5821-4835-898c-bc002b2aa183 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:00:44.476365 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d3d4d9b3-5821-4835-898c-bc002b2aa183 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:00:44.476804 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d3d4d9b3-5821-4835-898c-bc002b2aa183 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:00:44.618251 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d3d4d9b3-5821-4835-898c-bc002b2aa183 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:00:44.626142 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d3d4d9b3-5821-4835-898c-bc002b2aa183 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/66a7e71a-ccc8-4b35-ba82-8adc1d0972d1" status: 200 len: 1169 microversion: 2.1 time: 0.165504 Oct 19 04:00:44.626714 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3554/6931] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:00:44 2022] GET /compute/v2.1/servers/66a7e71a-ccc8-4b35-ba82-8adc1d0972d1 => generated 1169 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:00:45.655168 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-20ce66d6-061d-446c-9d00-27501ea8a5a4 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:00:45.655959 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-20ce66d6-061d-446c-9d00-27501ea8a5a4 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 66a7e71a-ccc8-4b35-ba82-8adc1d0972d1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:00:45.664124 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-20ce66d6-061d-446c-9d00-27501ea8a5a4 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:00:45.665107 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-20ce66d6-061d-446c-9d00-27501ea8a5a4 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:00:45.666077 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-20ce66d6-061d-446c-9d00-27501ea8a5a4 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:00:45.666543 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-20ce66d6-061d-446c-9d00-27501ea8a5a4 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:00:45.667027 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-20ce66d6-061d-446c-9d00-27501ea8a5a4 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:00:45.667781 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-20ce66d6-061d-446c-9d00-27501ea8a5a4 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:00:45.909021 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-20ce66d6-061d-446c-9d00-27501ea8a5a4 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:00:45.916884 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-20ce66d6-061d-446c-9d00-27501ea8a5a4 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/66a7e71a-ccc8-4b35-ba82-8adc1d0972d1" status: 200 len: 1169 microversion: 2.1 time: 0.270925 Oct 19 04:00:45.919415 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3555/6932] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:00:45 2022] GET /compute/v2.1/servers/66a7e71a-ccc8-4b35-ba82-8adc1d0972d1 => generated 1169 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:00:46.942429 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b180da60-4255-4346-8cfb-107e4a6077c9 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:00:46.943031 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b180da60-4255-4346-8cfb-107e4a6077c9 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 66a7e71a-ccc8-4b35-ba82-8adc1d0972d1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:00:46.950253 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b180da60-4255-4346-8cfb-107e4a6077c9 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:00:46.950801 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b180da60-4255-4346-8cfb-107e4a6077c9 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:00:46.951301 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b180da60-4255-4346-8cfb-107e4a6077c9 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:00:46.952014 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b180da60-4255-4346-8cfb-107e4a6077c9 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:00:46.952476 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b180da60-4255-4346-8cfb-107e4a6077c9 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:00:46.952904 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b180da60-4255-4346-8cfb-107e4a6077c9 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:00:47.088100 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b180da60-4255-4346-8cfb-107e4a6077c9 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:00:47.096978 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b180da60-4255-4346-8cfb-107e4a6077c9 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/66a7e71a-ccc8-4b35-ba82-8adc1d0972d1" status: 200 len: 1169 microversion: 2.1 time: 0.157718 Oct 19 04:00:47.096978 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3556/6933] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:00:46 2022] GET /compute/v2.1/servers/66a7e71a-ccc8-4b35-ba82-8adc1d0972d1 => generated 1169 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:00:48.121677 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-879b5e23-61c1-4076-82a6-9a29ac52b23f tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:00:48.122782 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-879b5e23-61c1-4076-82a6-9a29ac52b23f tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 66a7e71a-ccc8-4b35-ba82-8adc1d0972d1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:00:48.129589 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-879b5e23-61c1-4076-82a6-9a29ac52b23f tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:00:48.130167 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-879b5e23-61c1-4076-82a6-9a29ac52b23f tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:00:48.130833 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-879b5e23-61c1-4076-82a6-9a29ac52b23f tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:00:48.131754 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-879b5e23-61c1-4076-82a6-9a29ac52b23f tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:00:48.132444 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-879b5e23-61c1-4076-82a6-9a29ac52b23f tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:00:48.133401 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-879b5e23-61c1-4076-82a6-9a29ac52b23f tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:00:48.266826 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-879b5e23-61c1-4076-82a6-9a29ac52b23f tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:00:48.275124 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-879b5e23-61c1-4076-82a6-9a29ac52b23f tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/66a7e71a-ccc8-4b35-ba82-8adc1d0972d1" status: 200 len: 1169 microversion: 2.1 time: 0.158338 Oct 19 04:00:48.275968 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3557/6934] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:00:48 2022] GET /compute/v2.1/servers/66a7e71a-ccc8-4b35-ba82-8adc1d0972d1 => generated 1169 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:00:49.298982 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5932c2e8-f3c2-41e9-bc40-83cd824bc794 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:00:49.299721 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5932c2e8-f3c2-41e9-bc40-83cd824bc794 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 66a7e71a-ccc8-4b35-ba82-8adc1d0972d1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:00:49.307255 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5932c2e8-f3c2-41e9-bc40-83cd824bc794 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:00:49.312446 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5932c2e8-f3c2-41e9-bc40-83cd824bc794 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:00:49.312446 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5932c2e8-f3c2-41e9-bc40-83cd824bc794 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:00:49.312446 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5932c2e8-f3c2-41e9-bc40-83cd824bc794 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:00:49.312446 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5932c2e8-f3c2-41e9-bc40-83cd824bc794 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:00:49.312446 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5932c2e8-f3c2-41e9-bc40-83cd824bc794 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:00:49.451266 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5932c2e8-f3c2-41e9-bc40-83cd824bc794 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:00:49.459683 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5932c2e8-f3c2-41e9-bc40-83cd824bc794 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/66a7e71a-ccc8-4b35-ba82-8adc1d0972d1" status: 200 len: 1169 microversion: 2.1 time: 0.164922 Oct 19 04:00:49.460508 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3558/6935] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:00:49 2022] GET /compute/v2.1/servers/66a7e71a-ccc8-4b35-ba82-8adc1d0972d1 => generated 1169 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:00:50.482718 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5bd9a21c-3305-43ec-9254-4632cf673c6c tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:00:50.483364 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5bd9a21c-3305-43ec-9254-4632cf673c6c tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 66a7e71a-ccc8-4b35-ba82-8adc1d0972d1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:00:50.490296 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5bd9a21c-3305-43ec-9254-4632cf673c6c tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:00:50.490789 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5bd9a21c-3305-43ec-9254-4632cf673c6c tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:00:50.491238 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5bd9a21c-3305-43ec-9254-4632cf673c6c tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:00:50.491960 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5bd9a21c-3305-43ec-9254-4632cf673c6c tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:00:50.492400 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5bd9a21c-3305-43ec-9254-4632cf673c6c tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:00:50.492841 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5bd9a21c-3305-43ec-9254-4632cf673c6c tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:00:50.673616 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5bd9a21c-3305-43ec-9254-4632cf673c6c tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:00:50.683714 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5bd9a21c-3305-43ec-9254-4632cf673c6c tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/66a7e71a-ccc8-4b35-ba82-8adc1d0972d1" status: 200 len: 1169 microversion: 2.1 time: 0.204781 Oct 19 04:00:50.684622 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3559/6936] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:00:50 2022] GET /compute/v2.1/servers/66a7e71a-ccc8-4b35-ba82-8adc1d0972d1 => generated 1169 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:00:51.707142 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e30e3b5e-3cb9-4d82-90b6-f0c9304f2246 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:00:51.707756 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e30e3b5e-3cb9-4d82-90b6-f0c9304f2246 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 66a7e71a-ccc8-4b35-ba82-8adc1d0972d1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:00:51.714681 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e30e3b5e-3cb9-4d82-90b6-f0c9304f2246 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:00:51.715167 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e30e3b5e-3cb9-4d82-90b6-f0c9304f2246 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:00:51.715604 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e30e3b5e-3cb9-4d82-90b6-f0c9304f2246 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:00:51.716294 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e30e3b5e-3cb9-4d82-90b6-f0c9304f2246 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:00:51.716744 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e30e3b5e-3cb9-4d82-90b6-f0c9304f2246 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:00:51.717167 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e30e3b5e-3cb9-4d82-90b6-f0c9304f2246 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:00:51.858860 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e30e3b5e-3cb9-4d82-90b6-f0c9304f2246 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:00:51.870711 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e30e3b5e-3cb9-4d82-90b6-f0c9304f2246 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/66a7e71a-ccc8-4b35-ba82-8adc1d0972d1" status: 200 len: 1169 microversion: 2.1 time: 0.167023 Oct 19 04:00:51.871578 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3560/6937] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:00:51 2022] GET /compute/v2.1/servers/66a7e71a-ccc8-4b35-ba82-8adc1d0972d1 => generated 1169 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:00:52.894540 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-dfbaba3f-225c-4e32-b2ed-77e594b32294 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:00:52.895204 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-dfbaba3f-225c-4e32-b2ed-77e594b32294 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 66a7e71a-ccc8-4b35-ba82-8adc1d0972d1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:00:52.902273 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dfbaba3f-225c-4e32-b2ed-77e594b32294 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:00:52.902767 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dfbaba3f-225c-4e32-b2ed-77e594b32294 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:00:52.903212 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dfbaba3f-225c-4e32-b2ed-77e594b32294 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:00:52.903914 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dfbaba3f-225c-4e32-b2ed-77e594b32294 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:00:52.904376 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dfbaba3f-225c-4e32-b2ed-77e594b32294 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:00:52.904805 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dfbaba3f-225c-4e32-b2ed-77e594b32294 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:00:53.036915 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-dfbaba3f-225c-4e32-b2ed-77e594b32294 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:00:53.044750 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-dfbaba3f-225c-4e32-b2ed-77e594b32294 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/66a7e71a-ccc8-4b35-ba82-8adc1d0972d1" status: 200 len: 1169 microversion: 2.1 time: 0.154225 Oct 19 04:00:53.048852 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3561/6938] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:00:52 2022] GET /compute/v2.1/servers/66a7e71a-ccc8-4b35-ba82-8adc1d0972d1 => generated 1169 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:00:54.067959 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-243c4b0e-3570-43fe-bed0-3b2829fbb707 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:00:54.068685 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-243c4b0e-3570-43fe-bed0-3b2829fbb707 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 66a7e71a-ccc8-4b35-ba82-8adc1d0972d1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:00:54.075994 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-243c4b0e-3570-43fe-bed0-3b2829fbb707 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:00:54.076564 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-243c4b0e-3570-43fe-bed0-3b2829fbb707 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:00:54.077077 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-243c4b0e-3570-43fe-bed0-3b2829fbb707 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:00:54.077948 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-243c4b0e-3570-43fe-bed0-3b2829fbb707 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:00:54.078487 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-243c4b0e-3570-43fe-bed0-3b2829fbb707 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:00:54.078982 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-243c4b0e-3570-43fe-bed0-3b2829fbb707 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:00:54.224426 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-243c4b0e-3570-43fe-bed0-3b2829fbb707 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:00:54.233280 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-243c4b0e-3570-43fe-bed0-3b2829fbb707 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/66a7e71a-ccc8-4b35-ba82-8adc1d0972d1" status: 200 len: 1169 microversion: 2.1 time: 0.169827 Oct 19 04:00:54.234049 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3562/6939] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:00:54 2022] GET /compute/v2.1/servers/66a7e71a-ccc8-4b35-ba82-8adc1d0972d1 => generated 1169 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:00:55.256798 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-830636cb-c9a2-4ce2-8dcb-ce78b5995205 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:00:55.258929 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-830636cb-c9a2-4ce2-8dcb-ce78b5995205 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 66a7e71a-ccc8-4b35-ba82-8adc1d0972d1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:00:55.264399 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-830636cb-c9a2-4ce2-8dcb-ce78b5995205 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:00:55.264887 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-830636cb-c9a2-4ce2-8dcb-ce78b5995205 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:00:55.265334 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-830636cb-c9a2-4ce2-8dcb-ce78b5995205 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:00:55.266108 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-830636cb-c9a2-4ce2-8dcb-ce78b5995205 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:00:55.266564 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-830636cb-c9a2-4ce2-8dcb-ce78b5995205 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:00:55.267025 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-830636cb-c9a2-4ce2-8dcb-ce78b5995205 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:00:55.413525 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-830636cb-c9a2-4ce2-8dcb-ce78b5995205 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:00:55.421402 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-830636cb-c9a2-4ce2-8dcb-ce78b5995205 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/66a7e71a-ccc8-4b35-ba82-8adc1d0972d1" status: 200 len: 1169 microversion: 2.1 time: 0.168561 Oct 19 04:00:55.421990 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3563/6940] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:00:55 2022] GET /compute/v2.1/servers/66a7e71a-ccc8-4b35-ba82-8adc1d0972d1 => generated 1169 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:00:56.444860 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6380ebc9-a9e7-436f-8724-7376c1020352 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:00:56.445557 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6380ebc9-a9e7-436f-8724-7376c1020352 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 66a7e71a-ccc8-4b35-ba82-8adc1d0972d1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:00:56.452376 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6380ebc9-a9e7-436f-8724-7376c1020352 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:00:56.452933 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6380ebc9-a9e7-436f-8724-7376c1020352 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:00:56.453404 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6380ebc9-a9e7-436f-8724-7376c1020352 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:00:56.454287 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6380ebc9-a9e7-436f-8724-7376c1020352 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:00:56.454752 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6380ebc9-a9e7-436f-8724-7376c1020352 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:00:56.455195 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6380ebc9-a9e7-436f-8724-7376c1020352 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:00:56.591402 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-6380ebc9-a9e7-436f-8724-7376c1020352 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:00:56.599517 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6380ebc9-a9e7-436f-8724-7376c1020352 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/66a7e71a-ccc8-4b35-ba82-8adc1d0972d1" status: 200 len: 1169 microversion: 2.1 time: 0.158683 Oct 19 04:00:56.600103 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3564/6941] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:00:56 2022] GET /compute/v2.1/servers/66a7e71a-ccc8-4b35-ba82-8adc1d0972d1 => generated 1169 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:00:57.636687 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-92809968-5837-4604-ba05-ea0343d0bc21 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:00:57.636687 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-92809968-5837-4604-ba05-ea0343d0bc21 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 66a7e71a-ccc8-4b35-ba82-8adc1d0972d1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:00:57.636687 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-92809968-5837-4604-ba05-ea0343d0bc21 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:00:57.636687 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-92809968-5837-4604-ba05-ea0343d0bc21 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:00:57.641562 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-92809968-5837-4604-ba05-ea0343d0bc21 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:00:57.641562 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-92809968-5837-4604-ba05-ea0343d0bc21 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:00:57.641562 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-92809968-5837-4604-ba05-ea0343d0bc21 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:00:57.641562 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-92809968-5837-4604-ba05-ea0343d0bc21 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:00:57.783863 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-92809968-5837-4604-ba05-ea0343d0bc21 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:00:57.793837 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-92809968-5837-4604-ba05-ea0343d0bc21 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/66a7e71a-ccc8-4b35-ba82-8adc1d0972d1" status: 200 len: 1169 microversion: 2.1 time: 0.174825 Oct 19 04:00:57.794577 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3565/6942] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:00:57 2022] GET /compute/v2.1/servers/66a7e71a-ccc8-4b35-ba82-8adc1d0972d1 => generated 1169 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:00:58.817570 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-503913b8-cd78-4212-82c1-f89d7128f2b8 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:00:58.818248 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-503913b8-cd78-4212-82c1-f89d7128f2b8 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 66a7e71a-ccc8-4b35-ba82-8adc1d0972d1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:00:58.824831 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-503913b8-cd78-4212-82c1-f89d7128f2b8 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:00:58.825324 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-503913b8-cd78-4212-82c1-f89d7128f2b8 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:00:58.825876 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-503913b8-cd78-4212-82c1-f89d7128f2b8 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:00:58.826577 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-503913b8-cd78-4212-82c1-f89d7128f2b8 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:00:58.827218 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-503913b8-cd78-4212-82c1-f89d7128f2b8 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:00:58.827655 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-503913b8-cd78-4212-82c1-f89d7128f2b8 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:00:58.963701 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-503913b8-cd78-4212-82c1-f89d7128f2b8 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:00:58.973834 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-503913b8-cd78-4212-82c1-f89d7128f2b8 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/66a7e71a-ccc8-4b35-ba82-8adc1d0972d1" status: 200 len: 1215 microversion: 2.1 time: 0.160428 Oct 19 04:00:58.989719 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3566/6943] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:00:58 2022] GET /compute/v2.1/servers/66a7e71a-ccc8-4b35-ba82-8adc1d0972d1 => generated 1215 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:00:59.997710 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0cf17e28-6676-4fdb-aa22-a27fafd2ad73 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:00:59.998397 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0cf17e28-6676-4fdb-aa22-a27fafd2ad73 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 66a7e71a-ccc8-4b35-ba82-8adc1d0972d1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:01:00.005042 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0cf17e28-6676-4fdb-aa22-a27fafd2ad73 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:01:00.005658 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0cf17e28-6676-4fdb-aa22-a27fafd2ad73 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:01:00.011894 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0cf17e28-6676-4fdb-aa22-a27fafd2ad73 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:01:00.011894 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0cf17e28-6676-4fdb-aa22-a27fafd2ad73 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:01:00.011894 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0cf17e28-6676-4fdb-aa22-a27fafd2ad73 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:01:00.011894 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0cf17e28-6676-4fdb-aa22-a27fafd2ad73 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:01:00.144645 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0cf17e28-6676-4fdb-aa22-a27fafd2ad73 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:01:00.152859 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0cf17e28-6676-4fdb-aa22-a27fafd2ad73 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/66a7e71a-ccc8-4b35-ba82-8adc1d0972d1" status: 200 len: 1203 microversion: 2.1 time: 0.159184 Oct 19 04:01:00.153650 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3567/6944] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:00:59 2022] GET /compute/v2.1/servers/66a7e71a-ccc8-4b35-ba82-8adc1d0972d1 => generated 1203 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:01:01.178830 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-84ac025c-e4de-45bc-9db4-47687882742a tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:01:01.179550 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-84ac025c-e4de-45bc-9db4-47687882742a tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 66a7e71a-ccc8-4b35-ba82-8adc1d0972d1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:01:01.194751 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-84ac025c-e4de-45bc-9db4-47687882742a tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:01:01.195266 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-84ac025c-e4de-45bc-9db4-47687882742a tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:01:01.195719 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-84ac025c-e4de-45bc-9db4-47687882742a tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:01:01.196451 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-84ac025c-e4de-45bc-9db4-47687882742a tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:01:01.196928 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-84ac025c-e4de-45bc-9db4-47687882742a tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:01:01.197353 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-84ac025c-e4de-45bc-9db4-47687882742a tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:01:01.343229 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-84ac025c-e4de-45bc-9db4-47687882742a tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:01:01.355138 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-84ac025c-e4de-45bc-9db4-47687882742a tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/66a7e71a-ccc8-4b35-ba82-8adc1d0972d1" status: 200 len: 1203 microversion: 2.1 time: 0.181946 Oct 19 04:01:01.355739 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3568/6945] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:01:01 2022] GET /compute/v2.1/servers/66a7e71a-ccc8-4b35-ba82-8adc1d0972d1 => generated 1203 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:01:02.378949 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-38e3d52c-34f3-4087-93f5-036e17771dd0 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:01:02.379589 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-38e3d52c-34f3-4087-93f5-036e17771dd0 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 66a7e71a-ccc8-4b35-ba82-8adc1d0972d1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:01:02.386900 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-38e3d52c-34f3-4087-93f5-036e17771dd0 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:01:02.387408 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-38e3d52c-34f3-4087-93f5-036e17771dd0 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:01:02.387853 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-38e3d52c-34f3-4087-93f5-036e17771dd0 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:01:02.388568 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-38e3d52c-34f3-4087-93f5-036e17771dd0 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:01:02.389032 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-38e3d52c-34f3-4087-93f5-036e17771dd0 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:01:02.389502 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-38e3d52c-34f3-4087-93f5-036e17771dd0 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:01:02.929226 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-38e3d52c-34f3-4087-93f5-036e17771dd0 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:01:02.932787 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=100 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:01:02.937569 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-38e3d52c-34f3-4087-93f5-036e17771dd0 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/66a7e71a-ccc8-4b35-ba82-8adc1d0972d1" status: 200 len: 1203 microversion: 2.1 time: 0.563058 Oct 19 04:01:02.938150 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3569/6946] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:01:02 2022] GET /compute/v2.1/servers/66a7e71a-ccc8-4b35-ba82-8adc1d0972d1 => generated 1203 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:01:03.961256 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-31c4d940-54c1-4cb7-9a9c-5b2661d4afb4 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:01:03.962021 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-31c4d940-54c1-4cb7-9a9c-5b2661d4afb4 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 66a7e71a-ccc8-4b35-ba82-8adc1d0972d1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:01:03.971558 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-31c4d940-54c1-4cb7-9a9c-5b2661d4afb4 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:01:03.972056 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-31c4d940-54c1-4cb7-9a9c-5b2661d4afb4 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:01:03.972502 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-31c4d940-54c1-4cb7-9a9c-5b2661d4afb4 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:01:03.973216 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-31c4d940-54c1-4cb7-9a9c-5b2661d4afb4 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:01:03.977875 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-31c4d940-54c1-4cb7-9a9c-5b2661d4afb4 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:01:03.978472 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-31c4d940-54c1-4cb7-9a9c-5b2661d4afb4 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:01:04.209618 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-31c4d940-54c1-4cb7-9a9c-5b2661d4afb4 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:01:04.217772 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-31c4d940-54c1-4cb7-9a9c-5b2661d4afb4 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/66a7e71a-ccc8-4b35-ba82-8adc1d0972d1" status: 200 len: 1203 microversion: 2.1 time: 0.261346 Oct 19 04:01:04.218617 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3570/6947] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:01:03 2022] GET /compute/v2.1/servers/66a7e71a-ccc8-4b35-ba82-8adc1d0972d1 => generated 1203 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:01:05.241435 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-cec422e8-f30c-4111-a552-6bba4fb289be tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:01:05.242195 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-cec422e8-f30c-4111-a552-6bba4fb289be tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 66a7e71a-ccc8-4b35-ba82-8adc1d0972d1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:01:05.248986 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cec422e8-f30c-4111-a552-6bba4fb289be tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:01:05.249576 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cec422e8-f30c-4111-a552-6bba4fb289be tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:01:05.250333 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cec422e8-f30c-4111-a552-6bba4fb289be tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:01:05.251386 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cec422e8-f30c-4111-a552-6bba4fb289be tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:01:05.252507 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cec422e8-f30c-4111-a552-6bba4fb289be tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:01:05.252940 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cec422e8-f30c-4111-a552-6bba4fb289be tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:01:05.497335 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-cec422e8-f30c-4111-a552-6bba4fb289be tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:01:05.505312 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-cec422e8-f30c-4111-a552-6bba4fb289be tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/66a7e71a-ccc8-4b35-ba82-8adc1d0972d1" status: 200 len: 1203 microversion: 2.1 time: 0.268210 Oct 19 04:01:05.506117 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3571/6948] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:01:05 2022] GET /compute/v2.1/servers/66a7e71a-ccc8-4b35-ba82-8adc1d0972d1 => generated 1203 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:01:05.515316 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-95c48bda-92a7-4487-bdd3-a555e66d507a tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:01:05.515809 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-95c48bda-92a7-4487-bdd3-a555e66d507a tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] [instance: 6a87c0fe-b69c-4db5-800f-eb79c28fc4bf] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:01:05.522732 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-95c48bda-92a7-4487-bdd3-a555e66d507a tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:01:05.523217 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-95c48bda-92a7-4487-bdd3-a555e66d507a tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:01:05.523654 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-95c48bda-92a7-4487-bdd3-a555e66d507a tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:01:05.524343 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-95c48bda-92a7-4487-bdd3-a555e66d507a tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:01:05.524797 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-95c48bda-92a7-4487-bdd3-a555e66d507a tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:01:05.525225 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-95c48bda-92a7-4487-bdd3-a555e66d507a tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:01:05.557214 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-95c48bda-92a7-4487-bdd3-a555e66d507a tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] 10.222.0.52 "GET /compute/v2.1/servers/6a87c0fe-b69c-4db5-800f-eb79c28fc4bf/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.050244 Oct 19 04:01:05.561533 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3572/6949] 10.222.0.52 () {58 vars in 1293 bytes} [Wed Oct 19 04:01:05 2022] GET /compute/v2.1/servers/6a87c0fe-b69c-4db5-800f-eb79c28fc4bf/os-server-password => generated 116 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:01:06.528578 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-93af5448-9ab8-4655-a541-1f6c6c3d856e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:01:06.529264 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-93af5448-9ab8-4655-a541-1f6c6c3d856e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 66a7e71a-ccc8-4b35-ba82-8adc1d0972d1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:01:06.536099 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-93af5448-9ab8-4655-a541-1f6c6c3d856e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:01:06.536586 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-93af5448-9ab8-4655-a541-1f6c6c3d856e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:01:06.537227 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-93af5448-9ab8-4655-a541-1f6c6c3d856e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:01:06.538179 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-93af5448-9ab8-4655-a541-1f6c6c3d856e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:01:06.538647 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-93af5448-9ab8-4655-a541-1f6c6c3d856e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:01:06.539082 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-93af5448-9ab8-4655-a541-1f6c6c3d856e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:01:06.690340 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-93af5448-9ab8-4655-a541-1f6c6c3d856e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:01:06.698624 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-93af5448-9ab8-4655-a541-1f6c6c3d856e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/66a7e71a-ccc8-4b35-ba82-8adc1d0972d1" status: 200 len: 1203 microversion: 2.1 time: 0.174041 Oct 19 04:01:06.699214 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3573/6950] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:01:06 2022] GET /compute/v2.1/servers/66a7e71a-ccc8-4b35-ba82-8adc1d0972d1 => generated 1203 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:01:07.722727 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-70bf5302-0a0e-4620-a009-96df78157c9f tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:01:07.724126 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-70bf5302-0a0e-4620-a009-96df78157c9f tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 66a7e71a-ccc8-4b35-ba82-8adc1d0972d1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:01:07.731816 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-70bf5302-0a0e-4620-a009-96df78157c9f tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:01:07.732649 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-70bf5302-0a0e-4620-a009-96df78157c9f tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:01:07.733350 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-70bf5302-0a0e-4620-a009-96df78157c9f tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:01:07.734482 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-70bf5302-0a0e-4620-a009-96df78157c9f tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:01:07.735201 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-70bf5302-0a0e-4620-a009-96df78157c9f tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:01:07.736392 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-70bf5302-0a0e-4620-a009-96df78157c9f tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:01:07.900638 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-70bf5302-0a0e-4620-a009-96df78157c9f tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:01:07.911751 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-70bf5302-0a0e-4620-a009-96df78157c9f tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/66a7e71a-ccc8-4b35-ba82-8adc1d0972d1" status: 200 len: 1203 microversion: 2.1 time: 0.193239 Oct 19 04:01:07.912288 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3574/6951] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:01:07 2022] GET /compute/v2.1/servers/66a7e71a-ccc8-4b35-ba82-8adc1d0972d1 => generated 1203 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:01:08.937905 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9ebe8521-a2ec-46b8-8089-ba9c83c6bbe3 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:01:08.937905 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9ebe8521-a2ec-46b8-8089-ba9c83c6bbe3 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 66a7e71a-ccc8-4b35-ba82-8adc1d0972d1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:01:08.943238 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9ebe8521-a2ec-46b8-8089-ba9c83c6bbe3 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:01:08.943734 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9ebe8521-a2ec-46b8-8089-ba9c83c6bbe3 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:01:08.944176 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9ebe8521-a2ec-46b8-8089-ba9c83c6bbe3 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:01:08.944884 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9ebe8521-a2ec-46b8-8089-ba9c83c6bbe3 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:01:08.945503 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9ebe8521-a2ec-46b8-8089-ba9c83c6bbe3 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:01:08.945849 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9ebe8521-a2ec-46b8-8089-ba9c83c6bbe3 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:01:09.217099 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9ebe8521-a2ec-46b8-8089-ba9c83c6bbe3 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:01:09.225495 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9ebe8521-a2ec-46b8-8089-ba9c83c6bbe3 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/66a7e71a-ccc8-4b35-ba82-8adc1d0972d1" status: 200 len: 1203 microversion: 2.1 time: 0.293857 Oct 19 04:01:09.226021 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3575/6952] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:01:08 2022] GET /compute/v2.1/servers/66a7e71a-ccc8-4b35-ba82-8adc1d0972d1 => generated 1203 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:01:09.643210 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-9143e7c7-cc64-434b-b1cc-895daf4b2391 req-dcf94fc9-a106-4ffa-9bdc-1b35c8f627ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66a7e71a-ccc8-4b35-ba82-8adc1d0972d1", "name": "network-vif-plugged", "status": "completed", "tag": "1ad8e64b-3a95-4651-839a-6cb61bb9fb68"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:01:09.655590 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-9143e7c7-cc64-434b-b1cc-895daf4b2391 req-dcf94fc9-a106-4ffa-9bdc-1b35c8f627ae service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:01:09.656304 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-9143e7c7-cc64-434b-b1cc-895daf4b2391 req-dcf94fc9-a106-4ffa-9bdc-1b35c8f627ae service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:01:09.657158 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-9143e7c7-cc64-434b-b1cc-895daf4b2391 req-dcf94fc9-a106-4ffa-9bdc-1b35c8f627ae service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:01:09.671422 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-9143e7c7-cc64-434b-b1cc-895daf4b2391 req-dcf94fc9-a106-4ffa-9bdc-1b35c8f627ae service nova] Creating event network-vif-plugged:1ad8e64b-3a95-4651-839a-6cb61bb9fb68 for instance 66a7e71a-ccc8-4b35-ba82-8adc1d0972d1 on n-h1-861333-8 Oct 19 04:01:09.678129 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-9143e7c7-cc64-434b-b1cc-895daf4b2391 req-dcf94fc9-a106-4ffa-9bdc-1b35c8f627ae service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045783 Oct 19 04:01:09.678891 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3576/6953] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:01:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:01:10.251234 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-49264f4e-6acd-4e71-80e8-46c36c4fdc3a tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:01:10.252559 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-49264f4e-6acd-4e71-80e8-46c36c4fdc3a tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 66a7e71a-ccc8-4b35-ba82-8adc1d0972d1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:01:10.259467 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-49264f4e-6acd-4e71-80e8-46c36c4fdc3a tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:01:10.259967 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-49264f4e-6acd-4e71-80e8-46c36c4fdc3a tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:01:10.260411 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-49264f4e-6acd-4e71-80e8-46c36c4fdc3a tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:01:10.261125 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-49264f4e-6acd-4e71-80e8-46c36c4fdc3a tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:01:10.261618 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-49264f4e-6acd-4e71-80e8-46c36c4fdc3a tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:01:10.262058 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-49264f4e-6acd-4e71-80e8-46c36c4fdc3a tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:01:10.411294 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-49264f4e-6acd-4e71-80e8-46c36c4fdc3a tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:01:10.418319 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-49264f4e-6acd-4e71-80e8-46c36c4fdc3a tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/66a7e71a-ccc8-4b35-ba82-8adc1d0972d1" status: 200 len: 1203 microversion: 2.1 time: 0.172459 Oct 19 04:01:10.418886 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3577/6954] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:01:10 2022] GET /compute/v2.1/servers/66a7e71a-ccc8-4b35-ba82-8adc1d0972d1 => generated 1203 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:01:11.140552 n-d-861333-8 devstack@n-api.service[121135]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 04:01:11.141141 n-d-861333-8 devstack@n-api.service[121135]: Wed Oct 19 04:01:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.52) !!! Oct 19 04:01:11.440936 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-469d8a8b-52c8-4353-90d1-ae88a0bbd29f tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:01:11.441588 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-469d8a8b-52c8-4353-90d1-ae88a0bbd29f tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 66a7e71a-ccc8-4b35-ba82-8adc1d0972d1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:01:11.449138 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-469d8a8b-52c8-4353-90d1-ae88a0bbd29f tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:01:11.449660 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-469d8a8b-52c8-4353-90d1-ae88a0bbd29f tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:01:11.450293 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-469d8a8b-52c8-4353-90d1-ae88a0bbd29f tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:01:11.451247 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-469d8a8b-52c8-4353-90d1-ae88a0bbd29f tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:01:11.451709 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-469d8a8b-52c8-4353-90d1-ae88a0bbd29f tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:01:11.452142 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-469d8a8b-52c8-4353-90d1-ae88a0bbd29f tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:01:11.601210 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-469d8a8b-52c8-4353-90d1-ae88a0bbd29f tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:01:11.615977 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-469d8a8b-52c8-4353-90d1-ae88a0bbd29f tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/66a7e71a-ccc8-4b35-ba82-8adc1d0972d1" status: 200 len: 1391 microversion: 2.1 time: 0.179420 Oct 19 04:01:11.617285 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3578/6955] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:01:11 2022] GET /compute/v2.1/servers/66a7e71a-ccc8-4b35-ba82-8adc1d0972d1 => generated 1391 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:01:11.645440 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0081e2b9-6249-41b7-a72c-4c2e16f31fde tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:01:11.648173 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0081e2b9-6249-41b7-a72c-4c2e16f31fde tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 66a7e71a-ccc8-4b35-ba82-8adc1d0972d1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:01:11.660392 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0081e2b9-6249-41b7-a72c-4c2e16f31fde tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:01:11.661034 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0081e2b9-6249-41b7-a72c-4c2e16f31fde tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:01:11.661708 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0081e2b9-6249-41b7-a72c-4c2e16f31fde tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:01:11.667211 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0081e2b9-6249-41b7-a72c-4c2e16f31fde tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:01:11.667211 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0081e2b9-6249-41b7-a72c-4c2e16f31fde tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:01:11.667211 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0081e2b9-6249-41b7-a72c-4c2e16f31fde tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:01:11.836999 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0081e2b9-6249-41b7-a72c-4c2e16f31fde tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:01:11.845525 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0081e2b9-6249-41b7-a72c-4c2e16f31fde tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/66a7e71a-ccc8-4b35-ba82-8adc1d0972d1" status: 200 len: 1391 microversion: 2.1 time: 0.204930 Oct 19 04:01:11.846112 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3579/6956] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:01:11 2022] GET /compute/v2.1/servers/66a7e71a-ccc8-4b35-ba82-8adc1d0972d1 => generated 1391 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:01:11.867581 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9014d93a-90ca-414a-8756-c23280934fd2 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:01:11.868311 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9014d93a-90ca-414a-8756-c23280934fd2 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 66a7e71a-ccc8-4b35-ba82-8adc1d0972d1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:01:11.875018 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9014d93a-90ca-414a-8756-c23280934fd2 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:01:11.875801 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9014d93a-90ca-414a-8756-c23280934fd2 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:01:11.876256 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9014d93a-90ca-414a-8756-c23280934fd2 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:01:11.877563 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9014d93a-90ca-414a-8756-c23280934fd2 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:01:11.878030 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9014d93a-90ca-414a-8756-c23280934fd2 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:01:11.878470 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9014d93a-90ca-414a-8756-c23280934fd2 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:01:12.027861 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9014d93a-90ca-414a-8756-c23280934fd2 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:01:12.035729 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9014d93a-90ca-414a-8756-c23280934fd2 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/66a7e71a-ccc8-4b35-ba82-8adc1d0972d1" status: 200 len: 1391 microversion: 2.1 time: 0.172212 Oct 19 04:01:12.036308 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3580/6957] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:01:11 2022] GET /compute/v2.1/servers/66a7e71a-ccc8-4b35-ba82-8adc1d0972d1 => generated 1391 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:01:12.116318 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-26a55ce9-bcf6-4586-a7c5-5e402b90dde5 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:01:12.121401 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-26a55ce9-bcf6-4586-a7c5-5e402b90dde5 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 66a7e71a-ccc8-4b35-ba82-8adc1d0972d1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:01:12.123574 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-26a55ce9-bcf6-4586-a7c5-5e402b90dde5 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:01:12.124074 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-26a55ce9-bcf6-4586-a7c5-5e402b90dde5 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:01:12.124520 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-26a55ce9-bcf6-4586-a7c5-5e402b90dde5 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:01:12.125235 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-26a55ce9-bcf6-4586-a7c5-5e402b90dde5 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:01:12.125728 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-26a55ce9-bcf6-4586-a7c5-5e402b90dde5 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:01:12.126167 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-26a55ce9-bcf6-4586-a7c5-5e402b90dde5 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:01:12.156189 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-26a55ce9-bcf6-4586-a7c5-5e402b90dde5 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 66a7e71a-ccc8-4b35-ba82-8adc1d0972d1] Going to try to terminate instance {{(pid=121134) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 04:01:12.462187 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-26a55ce9-bcf6-4586-a7c5-5e402b90dde5 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "DELETE /compute/v2.1/servers/66a7e71a-ccc8-4b35-ba82-8adc1d0972d1" status: 204 len: 0 microversion: 2.1 time: 0.349522 Oct 19 04:01:12.462954 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3581/6958] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 04:01:12 2022] DELETE /compute/v2.1/servers/66a7e71a-ccc8-4b35-ba82-8adc1d0972d1 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 19 04:01:12.471587 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-671cfcde-5774-4fd7-bfa7-b9d67ce8bbe0 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:01:12.472380 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-671cfcde-5774-4fd7-bfa7-b9d67ce8bbe0 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 66a7e71a-ccc8-4b35-ba82-8adc1d0972d1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:01:12.478643 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-671cfcde-5774-4fd7-bfa7-b9d67ce8bbe0 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:01:12.479235 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-671cfcde-5774-4fd7-bfa7-b9d67ce8bbe0 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:01:12.479755 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-671cfcde-5774-4fd7-bfa7-b9d67ce8bbe0 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:01:12.480469 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-671cfcde-5774-4fd7-bfa7-b9d67ce8bbe0 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:01:12.480935 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-671cfcde-5774-4fd7-bfa7-b9d67ce8bbe0 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:01:12.481406 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-671cfcde-5774-4fd7-bfa7-b9d67ce8bbe0 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:01:12.618929 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-671cfcde-5774-4fd7-bfa7-b9d67ce8bbe0 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:01:12.627341 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-671cfcde-5774-4fd7-bfa7-b9d67ce8bbe0 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/66a7e71a-ccc8-4b35-ba82-8adc1d0972d1" status: 200 len: 1397 microversion: 2.1 time: 0.159944 Oct 19 04:01:12.628010 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3582/6959] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:01:12 2022] GET /compute/v2.1/servers/66a7e71a-ccc8-4b35-ba82-8adc1d0972d1 => generated 1397 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:01:13.650631 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5a031653-12b1-40c9-9a05-191d537014f5 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:01:13.651337 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5a031653-12b1-40c9-9a05-191d537014f5 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 66a7e71a-ccc8-4b35-ba82-8adc1d0972d1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:01:13.654619 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:01:13.660089 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5a031653-12b1-40c9-9a05-191d537014f5 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:01:13.660596 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5a031653-12b1-40c9-9a05-191d537014f5 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:01:13.661059 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5a031653-12b1-40c9-9a05-191d537014f5 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:01:13.661873 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5a031653-12b1-40c9-9a05-191d537014f5 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:01:13.662397 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5a031653-12b1-40c9-9a05-191d537014f5 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:01:13.662935 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5a031653-12b1-40c9-9a05-191d537014f5 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:01:13.794522 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5a031653-12b1-40c9-9a05-191d537014f5 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:01:13.803007 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5a031653-12b1-40c9-9a05-191d537014f5 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/66a7e71a-ccc8-4b35-ba82-8adc1d0972d1" status: 200 len: 1397 microversion: 2.1 time: 0.156557 Oct 19 04:01:13.803588 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3583/6960] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:01:13 2022] GET /compute/v2.1/servers/66a7e71a-ccc8-4b35-ba82-8adc1d0972d1 => generated 1397 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:01:14.825841 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ed39a7cb-53c3-4a1c-ae46-d9e1b120e0b8 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:01:14.826607 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ed39a7cb-53c3-4a1c-ae46-d9e1b120e0b8 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 66a7e71a-ccc8-4b35-ba82-8adc1d0972d1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:01:14.834967 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ed39a7cb-53c3-4a1c-ae46-d9e1b120e0b8 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:01:14.835653 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ed39a7cb-53c3-4a1c-ae46-d9e1b120e0b8 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:01:14.836387 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ed39a7cb-53c3-4a1c-ae46-d9e1b120e0b8 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:01:14.837288 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ed39a7cb-53c3-4a1c-ae46-d9e1b120e0b8 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:01:14.838480 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ed39a7cb-53c3-4a1c-ae46-d9e1b120e0b8 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:01:14.838924 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ed39a7cb-53c3-4a1c-ae46-d9e1b120e0b8 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:01:14.923978 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ed39a7cb-53c3-4a1c-ae46-d9e1b120e0b8 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:01:14.932142 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ed39a7cb-53c3-4a1c-ae46-d9e1b120e0b8 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/66a7e71a-ccc8-4b35-ba82-8adc1d0972d1" status: 200 len: 1355 microversion: 2.1 time: 0.110071 Oct 19 04:01:14.932738 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3584/6961] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:01:14 2022] GET /compute/v2.1/servers/66a7e71a-ccc8-4b35-ba82-8adc1d0972d1 => generated 1355 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:01:14.945591 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-82372248-beb3-4939-8f7d-ade6031f1243 req-31fb108d-e139-46a1-9d02-c5afa213008a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66a7e71a-ccc8-4b35-ba82-8adc1d0972d1", "name": "network-vif-deleted", "tag": "1ad8e64b-3a95-4651-839a-6cb61bb9fb68"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:01:14.949449 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-82372248-beb3-4939-8f7d-ade6031f1243 req-31fb108d-e139-46a1-9d02-c5afa213008a service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:01:14.950010 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-82372248-beb3-4939-8f7d-ade6031f1243 req-31fb108d-e139-46a1-9d02-c5afa213008a service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:01:14.950448 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-82372248-beb3-4939-8f7d-ade6031f1243 req-31fb108d-e139-46a1-9d02-c5afa213008a service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:01:14.963063 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-82372248-beb3-4939-8f7d-ade6031f1243 req-31fb108d-e139-46a1-9d02-c5afa213008a service nova] Creating event network-vif-deleted:1ad8e64b-3a95-4651-839a-6cb61bb9fb68 for instance 66a7e71a-ccc8-4b35-ba82-8adc1d0972d1 on n-h1-861333-8 Oct 19 04:01:14.968288 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-82372248-beb3-4939-8f7d-ade6031f1243 req-31fb108d-e139-46a1-9d02-c5afa213008a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033535 Oct 19 04:01:14.968907 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3585/6962] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:01:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:01:15.958306 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f9d19216-5b40-4392-8b8c-44a034f441fb tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:01:15.959097 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f9d19216-5b40-4392-8b8c-44a034f441fb tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 66a7e71a-ccc8-4b35-ba82-8adc1d0972d1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:01:15.965332 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f9d19216-5b40-4392-8b8c-44a034f441fb tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:01:15.965859 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f9d19216-5b40-4392-8b8c-44a034f441fb tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:01:15.966301 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f9d19216-5b40-4392-8b8c-44a034f441fb tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:01:15.967399 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f9d19216-5b40-4392-8b8c-44a034f441fb tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:01:15.967870 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f9d19216-5b40-4392-8b8c-44a034f441fb tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:01:15.968318 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f9d19216-5b40-4392-8b8c-44a034f441fb tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:01:15.990968 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:01:16.035833 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-f9d19216-5b40-4392-8b8c-44a034f441fb tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:01:16.044182 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f9d19216-5b40-4392-8b8c-44a034f441fb tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/66a7e71a-ccc8-4b35-ba82-8adc1d0972d1" status: 200 len: 1188 microversion: 2.1 time: 0.091445 Oct 19 04:01:16.044775 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3586/6963] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:01:15 2022] GET /compute/v2.1/servers/66a7e71a-ccc8-4b35-ba82-8adc1d0972d1 => generated 1188 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:01:17.069315 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-191b5964-19d6-4046-8380-5b430c35b739 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:01:17.070770 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-191b5964-19d6-4046-8380-5b430c35b739 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 66a7e71a-ccc8-4b35-ba82-8adc1d0972d1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:01:17.078279 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-191b5964-19d6-4046-8380-5b430c35b739 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:01:17.078934 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-191b5964-19d6-4046-8380-5b430c35b739 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:01:17.080110 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-191b5964-19d6-4046-8380-5b430c35b739 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:01:17.081077 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-191b5964-19d6-4046-8380-5b430c35b739 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:01:17.081768 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-191b5964-19d6-4046-8380-5b430c35b739 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:01:17.082241 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-191b5964-19d6-4046-8380-5b430c35b739 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:01:17.159150 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-191b5964-19d6-4046-8380-5b430c35b739 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:01:17.168183 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-191b5964-19d6-4046-8380-5b430c35b739 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/66a7e71a-ccc8-4b35-ba82-8adc1d0972d1" status: 200 len: 1188 microversion: 2.1 time: 0.103503 Oct 19 04:01:17.168970 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3587/6964] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:01:17 2022] GET /compute/v2.1/servers/66a7e71a-ccc8-4b35-ba82-8adc1d0972d1 => generated 1188 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:01:18.191548 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-62660f15-0caa-49d4-ae4d-6c5d73301ef7 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:01:18.192884 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-62660f15-0caa-49d4-ae4d-6c5d73301ef7 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 66a7e71a-ccc8-4b35-ba82-8adc1d0972d1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:01:18.199926 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-62660f15-0caa-49d4-ae4d-6c5d73301ef7 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:01:18.200424 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-62660f15-0caa-49d4-ae4d-6c5d73301ef7 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:01:18.200860 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-62660f15-0caa-49d4-ae4d-6c5d73301ef7 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:01:18.201787 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-62660f15-0caa-49d4-ae4d-6c5d73301ef7 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:01:18.203202 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-62660f15-0caa-49d4-ae4d-6c5d73301ef7 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:01:18.203637 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-62660f15-0caa-49d4-ae4d-6c5d73301ef7 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:01:18.280444 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-62660f15-0caa-49d4-ae4d-6c5d73301ef7 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:01:18.288704 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-62660f15-0caa-49d4-ae4d-6c5d73301ef7 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/66a7e71a-ccc8-4b35-ba82-8adc1d0972d1" status: 200 len: 1188 microversion: 2.1 time: 0.101517 Oct 19 04:01:18.290011 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3588/6965] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:01:18 2022] GET /compute/v2.1/servers/66a7e71a-ccc8-4b35-ba82-8adc1d0972d1 => generated 1188 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:01:19.312115 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e2a16a64-8eb3-4c46-8261-58919dd1e132 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:01:19.312751 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e2a16a64-8eb3-4c46-8261-58919dd1e132 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 66a7e71a-ccc8-4b35-ba82-8adc1d0972d1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:01:19.319812 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e2a16a64-8eb3-4c46-8261-58919dd1e132 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:01:19.322547 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e2a16a64-8eb3-4c46-8261-58919dd1e132 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:01:19.322547 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e2a16a64-8eb3-4c46-8261-58919dd1e132 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:01:19.322547 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e2a16a64-8eb3-4c46-8261-58919dd1e132 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:01:19.323303 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e2a16a64-8eb3-4c46-8261-58919dd1e132 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:01:19.323303 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e2a16a64-8eb3-4c46-8261-58919dd1e132 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:01:19.388831 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e2a16a64-8eb3-4c46-8261-58919dd1e132 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:01:19.397907 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e2a16a64-8eb3-4c46-8261-58919dd1e132 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/66a7e71a-ccc8-4b35-ba82-8adc1d0972d1" status: 200 len: 1188 microversion: 2.1 time: 0.089239 Oct 19 04:01:19.398502 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3589/6966] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:01:19 2022] GET /compute/v2.1/servers/66a7e71a-ccc8-4b35-ba82-8adc1d0972d1 => generated 1188 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:01:20.421948 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6f65f93f-6b23-4f8e-925c-d434380b76b7 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:01:20.422699 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6f65f93f-6b23-4f8e-925c-d434380b76b7 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 66a7e71a-ccc8-4b35-ba82-8adc1d0972d1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:01:20.430401 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6f65f93f-6b23-4f8e-925c-d434380b76b7 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:01:20.430898 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6f65f93f-6b23-4f8e-925c-d434380b76b7 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:01:20.431412 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6f65f93f-6b23-4f8e-925c-d434380b76b7 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:01:20.432339 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6f65f93f-6b23-4f8e-925c-d434380b76b7 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:01:20.432802 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6f65f93f-6b23-4f8e-925c-d434380b76b7 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:01:20.433259 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6f65f93f-6b23-4f8e-925c-d434380b76b7 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:01:20.473744 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6f65f93f-6b23-4f8e-925c-d434380b76b7 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:01:20.474237 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6f65f93f-6b23-4f8e-925c-d434380b76b7 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:01:20.474677 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6f65f93f-6b23-4f8e-925c-d434380b76b7 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:01:20.475130 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-6f65f93f-6b23-4f8e-925c-d434380b76b7 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lazy-loading 'fault' on Instance uuid 66a7e71a-ccc8-4b35-ba82-8adc1d0972d1 {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 04:01:20.518397 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-6f65f93f-6b23-4f8e-925c-d434380b76b7 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:01:20.526806 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6f65f93f-6b23-4f8e-925c-d434380b76b7 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/66a7e71a-ccc8-4b35-ba82-8adc1d0972d1" status: 200 len: 1147 microversion: 2.1 time: 0.109239 Oct 19 04:01:20.527387 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3590/6967] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:01:20 2022] GET /compute/v2.1/servers/66a7e71a-ccc8-4b35-ba82-8adc1d0972d1 => generated 1147 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:01:21.553911 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1996840d-7825-4ec6-9cf7-a99e43740701 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:01:21.557471 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1996840d-7825-4ec6-9cf7-a99e43740701 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 66a7e71a-ccc8-4b35-ba82-8adc1d0972d1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:01:21.562159 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1996840d-7825-4ec6-9cf7-a99e43740701 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:01:21.562663 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1996840d-7825-4ec6-9cf7-a99e43740701 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:01:21.563108 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1996840d-7825-4ec6-9cf7-a99e43740701 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:01:21.564395 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1996840d-7825-4ec6-9cf7-a99e43740701 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:01:21.564857 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1996840d-7825-4ec6-9cf7-a99e43740701 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:01:21.565329 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1996840d-7825-4ec6-9cf7-a99e43740701 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:01:21.581259 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-1996840d-7825-4ec6-9cf7-a99e43740701 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] HTTP exception thrown: Instance 66a7e71a-ccc8-4b35-ba82-8adc1d0972d1 could not be found. Oct 19 04:01:21.582995 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1996840d-7825-4ec6-9cf7-a99e43740701 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Request method failure captured: Oct 19 04:01:21.582995 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/66a7e71a-ccc8-4b35-ba82-8adc1d0972d1 HTTP/1.1 Oct 19 04:01:21.582995 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 04:01:21.582995 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 04:01:21.582995 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 04:01:21.582995 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 04:01:21.582995 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 04:01:21.582995 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 04:01:21.582995 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 04:01:21.582995 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 04:01:21.582995 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3XYw5PeFcmVZaG2CxoqLxKroO9lkG-Hw7MzEkzHPy2_aqlf3HPBMKgLOXoQ-WbgkZbvZB1PbShR7FiiZmGSIVTCeQrWw3ytKpP-AuucJQP3lFFYEs8HquAFih6wwJOh2-3eNgmaxbIZUVh9y_A1g_wYecm08YmNoRnAnQnVYIDNRwE Oct 19 04:01:21.582995 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 04:01:21.582995 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 04:01:21.582995 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 04:01:21.582995 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 04:01:21.582995 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 04:01:21.582995 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 04:01:21.582995 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: beff434485604f85985617071a93727c Oct 19 04:01:21.582995 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-TestVolumeBootPattern-954873624 Oct 19 04:01:21.582995 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 04:01:21.582995 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 04:01:21.582995 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/beff434485604f85985617071a93727c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/beff434485604f85985617071a93727c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/beff434485604f85985617071a93727c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_beff434485604f85985617071a93727c", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 04:01:21.582995 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-TestVolumeBootPattern-954873624 Oct 19 04:01:21.582995 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: beff434485604f85985617071a93727c Oct 19 04:01:21.582995 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-TestVolumeBootPattern-954873624 Oct 19 04:01:21.582995 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-TestVolumeBootPattern-954873624-project Oct 19 04:01:21.582995 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 04:01:21.582995 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 04:01:21.582995 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 4d30aa868d79473f9534bd79816c07e3 Oct 19 04:01:21.582995 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-TestVolumeBootPattern-954873624-project Oct 19 04:01:21.582995 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 04:01:21.582995 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance 66a7e71a-ccc8-4b35-ba82-8adc1d0972d1 could not be found. Oct 19 04:01:21.582995 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '66a7e71a-ccc8-4b35-ba82-8adc1d0972d1'} Oct 19 04:01:21.582995 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 04:01:21.582995 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:01:21.582995 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 04:01:21.582995 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 04:01:21.582995 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 04:01:21.582995 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 04:01:21.582995 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 04:01:21.582995 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 04:01:21.582995 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 04:01:21.582995 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 04:01:21.582995 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66a7e71a-ccc8-4b35-ba82-8adc1d0972d1 could not be found. Oct 19 04:01:21.582995 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:01:21.582995 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:01:21.582995 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:01:21.582995 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:01:21.582995 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:01:21.582995 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:01:21.582995 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 04:01:21.582995 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 04:01:21.582995 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 04:01:21.582995 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 04:01:21.582995 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 04:01:21.582995 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 04:01:21.582995 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 04:01:21.582995 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 04:01:21.582995 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 04:01:21.582995 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 04:01:21.582995 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66a7e71a-ccc8-4b35-ba82-8adc1d0972d1 could not be found. Oct 19 04:01:21.582995 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:01:21.582995 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:01:21.582995 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:01:21.594449 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:01:21.594449 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:01:21.594449 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:01:21.594449 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 04:01:21.594449 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 04:01:21.594449 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66a7e71a-ccc8-4b35-ba82-8adc1d0972d1 could not be found. Oct 19 04:01:21.594449 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:01:21.594449 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1996840d-7825-4ec6-9cf7-a99e43740701 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Returning 404 to user: Instance 66a7e71a-ccc8-4b35-ba82-8adc1d0972d1 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 04:01:21.594449 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1996840d-7825-4ec6-9cf7-a99e43740701 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/66a7e71a-ccc8-4b35-ba82-8adc1d0972d1" status: 404 len: 111 microversion: 2.1 time: 0.034916 Oct 19 04:01:21.594449 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3591/6968] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:01:21 2022] GET /compute/v2.1/servers/66a7e71a-ccc8-4b35-ba82-8adc1d0972d1 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 04:01:22.691511 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-20043ef3-248d-4fd3-acab-7bb83e453e20 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:01:22.691511 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-20043ef3-248d-4fd3-acab-7bb83e453e20 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 66a7e71a-ccc8-4b35-ba82-8adc1d0972d1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:01:22.697675 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-20043ef3-248d-4fd3-acab-7bb83e453e20 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:01:22.698207 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-20043ef3-248d-4fd3-acab-7bb83e453e20 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:01:22.698652 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-20043ef3-248d-4fd3-acab-7bb83e453e20 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:01:22.699356 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-20043ef3-248d-4fd3-acab-7bb83e453e20 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:01:22.699820 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-20043ef3-248d-4fd3-acab-7bb83e453e20 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:01:22.700251 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-20043ef3-248d-4fd3-acab-7bb83e453e20 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:01:22.714443 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-20043ef3-248d-4fd3-acab-7bb83e453e20 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] HTTP exception thrown: Instance 66a7e71a-ccc8-4b35-ba82-8adc1d0972d1 could not be found. Oct 19 04:01:22.716051 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-20043ef3-248d-4fd3-acab-7bb83e453e20 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Request method failure captured: Oct 19 04:01:22.716051 n-d-861333-8 devstack@n-api.service[121134]: request: DELETE /compute/v2.1/servers/66a7e71a-ccc8-4b35-ba82-8adc1d0972d1 HTTP/1.1 Oct 19 04:01:22.716051 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 04:01:22.716051 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 04:01:22.716051 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 04:01:22.716051 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 04:01:22.716051 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 04:01:22.716051 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 04:01:22.716051 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 04:01:22.716051 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 04:01:22.716051 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3XYw5PeFcmVZaG2CxoqLxKroO9lkG-Hw7MzEkzHPy2_aqlf3HPBMKgLOXoQ-WbgkZbvZB1PbShR7FiiZmGSIVTCeQrWw3ytKpP-AuucJQP3lFFYEs8HquAFih6wwJOh2-3eNgmaxbIZUVh9y_A1g_wYecm08YmNoRnAnQnVYIDNRwE Oct 19 04:01:22.716051 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 04:01:22.716051 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 04:01:22.716051 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 04:01:22.716051 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 04:01:22.716051 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 04:01:22.716051 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 04:01:22.716051 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: beff434485604f85985617071a93727c Oct 19 04:01:22.716051 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-TestVolumeBootPattern-954873624 Oct 19 04:01:22.716051 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 04:01:22.716051 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 04:01:22.716051 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/beff434485604f85985617071a93727c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/beff434485604f85985617071a93727c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/beff434485604f85985617071a93727c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_beff434485604f85985617071a93727c", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 04:01:22.716051 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-TestVolumeBootPattern-954873624 Oct 19 04:01:22.716051 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: beff434485604f85985617071a93727c Oct 19 04:01:22.716051 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-TestVolumeBootPattern-954873624 Oct 19 04:01:22.716051 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-TestVolumeBootPattern-954873624-project Oct 19 04:01:22.716051 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 04:01:22.716051 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 04:01:22.716051 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 4d30aa868d79473f9534bd79816c07e3 Oct 19 04:01:22.716051 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-TestVolumeBootPattern-954873624-project Oct 19 04:01:22.716051 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 04:01:22.716051 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance 66a7e71a-ccc8-4b35-ba82-8adc1d0972d1 could not be found. Oct 19 04:01:22.716051 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '66a7e71a-ccc8-4b35-ba82-8adc1d0972d1'} Oct 19 04:01:22.716051 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 04:01:22.716051 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:01:22.716051 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 04:01:22.716051 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 04:01:22.716051 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 04:01:22.716051 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 04:01:22.716051 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 04:01:22.716051 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 04:01:22.716051 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 04:01:22.716051 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 04:01:22.716051 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66a7e71a-ccc8-4b35-ba82-8adc1d0972d1 could not be found. Oct 19 04:01:22.716051 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:01:22.716051 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:01:22.716051 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:01:22.716051 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:01:22.716051 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:01:22.716051 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:01:22.716051 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 04:01:22.716051 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 04:01:22.716051 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 04:01:22.716051 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 04:01:22.716051 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 04:01:22.716051 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 04:01:22.716051 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 04:01:22.716051 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 04:01:22.716051 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 04:01:22.716051 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 04:01:22.716051 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 04:01:22.716051 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 04:01:22.721314 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66a7e71a-ccc8-4b35-ba82-8adc1d0972d1 could not be found. Oct 19 04:01:22.721314 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:01:22.721314 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:01:22.721314 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:01:22.721314 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:01:22.721314 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:01:22.721314 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:01:22.721314 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 04:01:22.721314 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 04:01:22.721314 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66a7e71a-ccc8-4b35-ba82-8adc1d0972d1 could not be found. Oct 19 04:01:22.721314 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:01:22.721314 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-20043ef3-248d-4fd3-acab-7bb83e453e20 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Returning 404 to user: Instance 66a7e71a-ccc8-4b35-ba82-8adc1d0972d1 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 04:01:22.721314 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-20043ef3-248d-4fd3-acab-7bb83e453e20 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "DELETE /compute/v2.1/servers/66a7e71a-ccc8-4b35-ba82-8adc1d0972d1" status: 404 len: 111 microversion: 2.1 time: 0.033673 Oct 19 04:01:22.721314 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3592/6969] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 04:01:22 2022] DELETE /compute/v2.1/servers/66a7e71a-ccc8-4b35-ba82-8adc1d0972d1 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 04:01:22.726232 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-cb17031f-6cd6-4458-89eb-6bee4d897be4 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:01:22.726852 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-cb17031f-6cd6-4458-89eb-6bee4d897be4 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 66a7e71a-ccc8-4b35-ba82-8adc1d0972d1] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:01:22.732794 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cb17031f-6cd6-4458-89eb-6bee4d897be4 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:01:22.733289 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cb17031f-6cd6-4458-89eb-6bee4d897be4 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:01:22.733765 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cb17031f-6cd6-4458-89eb-6bee4d897be4 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:01:22.734547 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cb17031f-6cd6-4458-89eb-6bee4d897be4 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:01:22.735010 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cb17031f-6cd6-4458-89eb-6bee4d897be4 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:01:22.735937 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cb17031f-6cd6-4458-89eb-6bee4d897be4 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:01:22.749567 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-cb17031f-6cd6-4458-89eb-6bee4d897be4 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] HTTP exception thrown: Instance 66a7e71a-ccc8-4b35-ba82-8adc1d0972d1 could not be found. Oct 19 04:01:22.751678 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-cb17031f-6cd6-4458-89eb-6bee4d897be4 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Request method failure captured: Oct 19 04:01:22.751678 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/66a7e71a-ccc8-4b35-ba82-8adc1d0972d1 HTTP/1.1 Oct 19 04:01:22.751678 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 04:01:22.751678 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 04:01:22.751678 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 04:01:22.751678 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 04:01:22.751678 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 04:01:22.751678 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 04:01:22.751678 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 04:01:22.751678 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 04:01:22.751678 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3XYw5PeFcmVZaG2CxoqLxKroO9lkG-Hw7MzEkzHPy2_aqlf3HPBMKgLOXoQ-WbgkZbvZB1PbShR7FiiZmGSIVTCeQrWw3ytKpP-AuucJQP3lFFYEs8HquAFih6wwJOh2-3eNgmaxbIZUVh9y_A1g_wYecm08YmNoRnAnQnVYIDNRwE Oct 19 04:01:22.751678 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 04:01:22.751678 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 04:01:22.751678 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 04:01:22.751678 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 04:01:22.751678 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 04:01:22.751678 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 04:01:22.751678 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: beff434485604f85985617071a93727c Oct 19 04:01:22.751678 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-TestVolumeBootPattern-954873624 Oct 19 04:01:22.751678 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 04:01:22.751678 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 04:01:22.751678 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/beff434485604f85985617071a93727c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/beff434485604f85985617071a93727c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/beff434485604f85985617071a93727c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_beff434485604f85985617071a93727c", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 04:01:22.751678 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-TestVolumeBootPattern-954873624 Oct 19 04:01:22.751678 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: beff434485604f85985617071a93727c Oct 19 04:01:22.751678 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-TestVolumeBootPattern-954873624 Oct 19 04:01:22.751678 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-TestVolumeBootPattern-954873624-project Oct 19 04:01:22.751678 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 04:01:22.751678 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 04:01:22.751678 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 4d30aa868d79473f9534bd79816c07e3 Oct 19 04:01:22.751678 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-TestVolumeBootPattern-954873624-project Oct 19 04:01:22.751678 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 04:01:22.751678 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance 66a7e71a-ccc8-4b35-ba82-8adc1d0972d1 could not be found. Oct 19 04:01:22.751678 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '66a7e71a-ccc8-4b35-ba82-8adc1d0972d1'} Oct 19 04:01:22.751678 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 04:01:22.751678 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:01:22.751678 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 04:01:22.751678 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 04:01:22.751678 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 04:01:22.751678 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 04:01:22.751678 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 04:01:22.751678 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 04:01:22.751678 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 04:01:22.751678 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 04:01:22.751678 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66a7e71a-ccc8-4b35-ba82-8adc1d0972d1 could not be found. Oct 19 04:01:22.751678 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:01:22.751678 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:01:22.751678 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:01:22.751678 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:01:22.751678 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:01:22.751678 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:01:22.751678 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 04:01:22.751678 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 04:01:22.751678 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 04:01:22.751678 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 04:01:22.751678 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 04:01:22.751678 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 04:01:22.751678 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 04:01:22.751678 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 04:01:22.751678 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 04:01:22.751678 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 04:01:22.751678 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66a7e71a-ccc8-4b35-ba82-8adc1d0972d1 could not be found. Oct 19 04:01:22.751678 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:01:22.751678 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:01:22.751678 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:01:22.756590 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:01:22.756590 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:01:22.756590 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:01:22.756590 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 04:01:22.756590 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 04:01:22.756590 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66a7e71a-ccc8-4b35-ba82-8adc1d0972d1 could not be found. Oct 19 04:01:22.756590 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:01:22.756590 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-cb17031f-6cd6-4458-89eb-6bee4d897be4 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Returning 404 to user: Instance 66a7e71a-ccc8-4b35-ba82-8adc1d0972d1 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 04:01:22.756590 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-cb17031f-6cd6-4458-89eb-6bee4d897be4 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/66a7e71a-ccc8-4b35-ba82-8adc1d0972d1" status: 404 len: 111 microversion: 2.1 time: 0.030577 Oct 19 04:01:22.756590 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3593/6970] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:01:22 2022] GET /compute/v2.1/servers/66a7e71a-ccc8-4b35-ba82-8adc1d0972d1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 04:01:50.656278 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d0aa176f-e1e0-4aea-b721-01258029baf1 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1093800796", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "2e03fc75-a1fa-46d3-87c8-7743ceec22f5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "d55e7db4-c570-4a69-afcb-0fab975a7a7e"}]}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:01:50.681430 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=23 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:01:50.682599 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=34 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:01:50.742979 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-d0aa176f-e1e0-4aea-b721-01258029baf1 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] validate_networks() for [('d55e7db4-c570-4a69-afcb-0fab975a7a7e', None, None, None, None, None)] {{(pid=121134) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 04:01:51.493033 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-d0aa176f-e1e0-4aea-b721-01258029baf1 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Flavor limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 04:01:51.493729 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-d0aa176f-e1e0-4aea-b721-01258029baf1 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Image limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 04:01:51.494508 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-d0aa176f-e1e0-4aea-b721-01258029baf1 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Flavor pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 04:01:51.495017 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-d0aa176f-e1e0-4aea-b721-01258029baf1 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Image pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 04:01:51.495606 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-d0aa176f-e1e0-4aea-b721-01258029baf1 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 04:01:51.509264 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d0aa176f-e1e0-4aea-b721-01258029baf1 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:01:51.516063 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d0aa176f-e1e0-4aea-b721-01258029baf1 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:01:51.516063 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d0aa176f-e1e0-4aea-b721-01258029baf1 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:01:51.516063 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d0aa176f-e1e0-4aea-b721-01258029baf1 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:01:51.516063 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d0aa176f-e1e0-4aea-b721-01258029baf1 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:01:51.516063 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d0aa176f-e1e0-4aea-b721-01258029baf1 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:01:51.535681 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-d0aa176f-e1e0-4aea-b721-01258029baf1 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Getting quotas for project beff434485604f85985617071a93727c. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 04:01:51.541889 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-d0aa176f-e1e0-4aea-b721-01258029baf1 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Getting quotas for user 4d30aa868d79473f9534bd79816c07e3 and project beff434485604f85985617071a93727c. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 04:01:51.614330 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d0aa176f-e1e0-4aea-b721-01258029baf1 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Going to run 1 instances... {{(pid=121134) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 04:01:51.619373 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d0aa176f-e1e0-4aea-b721-01258029baf1 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 5262740d-a79b-413a-990b-bb4842fd8d58] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2e03fc75-a1fa-46d3-87c8-7743ceec22f5',volume_size=None,volume_type=None)] {{(pid=121134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 04:01:52.142440 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d0aa176f-e1e0-4aea-b721-01258029baf1 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.491152 Oct 19 04:01:52.150719 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3594/6971] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 04:01:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1500 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 19 04:01:52.155847 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-fc6f6971-de90-491e-b2c7-94c55b2270c5 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:01:52.156795 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-fc6f6971-de90-491e-b2c7-94c55b2270c5 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 5262740d-a79b-413a-990b-bb4842fd8d58] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:01:52.231761 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-fc6f6971-de90-491e-b2c7-94c55b2270c5 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:01:52.241310 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-fc6f6971-de90-491e-b2c7-94c55b2270c5 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/5262740d-a79b-413a-990b-bb4842fd8d58" status: 200 len: 1071 microversion: 2.1 time: 0.088768 Oct 19 04:01:52.241937 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3595/6972] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:01:52 2022] GET /compute/v2.1/servers/5262740d-a79b-413a-990b-bb4842fd8d58 => generated 1071 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:01:53.266653 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-03d9a74c-933c-47ba-ba63-74a1fabfd9c2 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:01:53.271956 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-03d9a74c-933c-47ba-ba63-74a1fabfd9c2 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 5262740d-a79b-413a-990b-bb4842fd8d58] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:01:53.279345 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-03d9a74c-933c-47ba-ba63-74a1fabfd9c2 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:01:53.279844 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-03d9a74c-933c-47ba-ba63-74a1fabfd9c2 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:01:53.280282 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-03d9a74c-933c-47ba-ba63-74a1fabfd9c2 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:01:53.280998 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-03d9a74c-933c-47ba-ba63-74a1fabfd9c2 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:01:53.281484 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-03d9a74c-933c-47ba-ba63-74a1fabfd9c2 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:01:53.282648 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-03d9a74c-933c-47ba-ba63-74a1fabfd9c2 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:01:53.546767 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-03d9a74c-933c-47ba-ba63-74a1fabfd9c2 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:01:53.556179 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-03d9a74c-933c-47ba-ba63-74a1fabfd9c2 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/5262740d-a79b-413a-990b-bb4842fd8d58" status: 200 len: 1121 microversion: 2.1 time: 0.295572 Oct 19 04:01:53.560575 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3596/6973] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:01:53 2022] GET /compute/v2.1/servers/5262740d-a79b-413a-990b-bb4842fd8d58 => generated 1121 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:01:54.580745 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1d741f9d-29cf-4415-bc03-7d87359f1421 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:01:54.581487 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1d741f9d-29cf-4415-bc03-7d87359f1421 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 5262740d-a79b-413a-990b-bb4842fd8d58] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:01:54.588339 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1d741f9d-29cf-4415-bc03-7d87359f1421 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:01:54.588832 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1d741f9d-29cf-4415-bc03-7d87359f1421 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:01:54.589271 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1d741f9d-29cf-4415-bc03-7d87359f1421 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:01:54.590600 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1d741f9d-29cf-4415-bc03-7d87359f1421 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:01:54.591089 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1d741f9d-29cf-4415-bc03-7d87359f1421 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:01:54.591524 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1d741f9d-29cf-4415-bc03-7d87359f1421 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:01:54.667649 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-1d741f9d-29cf-4415-bc03-7d87359f1421 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:01:54.677159 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1d741f9d-29cf-4415-bc03-7d87359f1421 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/5262740d-a79b-413a-990b-bb4842fd8d58" status: 200 len: 1177 microversion: 2.1 time: 0.100265 Oct 19 04:01:54.678061 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3597/6974] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:01:54 2022] GET /compute/v2.1/servers/5262740d-a79b-413a-990b-bb4842fd8d58 => generated 1177 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:01:55.714035 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a923ec68-6ecf-46fa-b3d1-93f29608941b tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:01:55.714703 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a923ec68-6ecf-46fa-b3d1-93f29608941b tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 5262740d-a79b-413a-990b-bb4842fd8d58] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:01:55.722866 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a923ec68-6ecf-46fa-b3d1-93f29608941b tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:01:55.725286 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a923ec68-6ecf-46fa-b3d1-93f29608941b tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:01:55.725286 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a923ec68-6ecf-46fa-b3d1-93f29608941b tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:01:55.725286 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a923ec68-6ecf-46fa-b3d1-93f29608941b tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:01:55.725286 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a923ec68-6ecf-46fa-b3d1-93f29608941b tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:01:55.735843 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a923ec68-6ecf-46fa-b3d1-93f29608941b tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:01:55.933644 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a923ec68-6ecf-46fa-b3d1-93f29608941b tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:01:55.944903 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a923ec68-6ecf-46fa-b3d1-93f29608941b tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/5262740d-a79b-413a-990b-bb4842fd8d58" status: 200 len: 1229 microversion: 2.1 time: 0.238433 Oct 19 04:01:55.959935 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3598/6975] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:01:55 2022] GET /compute/v2.1/servers/5262740d-a79b-413a-990b-bb4842fd8d58 => generated 1229 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:01:56.969713 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4a9f935e-d0ed-4788-a108-71d5b853b8af tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:01:56.971011 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4a9f935e-d0ed-4788-a108-71d5b853b8af tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 5262740d-a79b-413a-990b-bb4842fd8d58] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:01:56.978571 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4a9f935e-d0ed-4788-a108-71d5b853b8af tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:01:56.979358 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4a9f935e-d0ed-4788-a108-71d5b853b8af tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:01:56.979992 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4a9f935e-d0ed-4788-a108-71d5b853b8af tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:01:56.980880 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4a9f935e-d0ed-4788-a108-71d5b853b8af tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:01:56.981540 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4a9f935e-d0ed-4788-a108-71d5b853b8af tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:01:56.982146 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4a9f935e-d0ed-4788-a108-71d5b853b8af tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:01:57.208205 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-4a9f935e-d0ed-4788-a108-71d5b853b8af tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:01:57.216616 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4a9f935e-d0ed-4788-a108-71d5b853b8af tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/5262740d-a79b-413a-990b-bb4842fd8d58" status: 200 len: 1229 microversion: 2.1 time: 0.250732 Oct 19 04:01:57.217212 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3599/6976] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:01:56 2022] GET /compute/v2.1/servers/5262740d-a79b-413a-990b-bb4842fd8d58 => generated 1229 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:01:57.455083 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-be286c1b-c89b-4904-8e2b-7a6334eeea6e req-93ec3b53-fc12-4a0b-9c1e-988be063463f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5262740d-a79b-413a-990b-bb4842fd8d58", "tag": "0f92420a-3a0b-40ef-a003-55776635b70d"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:01:57.465265 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-be286c1b-c89b-4904-8e2b-7a6334eeea6e req-93ec3b53-fc12-4a0b-9c1e-988be063463f service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:01:57.466069 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-be286c1b-c89b-4904-8e2b-7a6334eeea6e req-93ec3b53-fc12-4a0b-9c1e-988be063463f service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:01:57.466771 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-be286c1b-c89b-4904-8e2b-7a6334eeea6e req-93ec3b53-fc12-4a0b-9c1e-988be063463f service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:01:57.487968 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-be286c1b-c89b-4904-8e2b-7a6334eeea6e req-93ec3b53-fc12-4a0b-9c1e-988be063463f service nova] Creating event network-changed:0f92420a-3a0b-40ef-a003-55776635b70d for instance 5262740d-a79b-413a-990b-bb4842fd8d58 on n-h1-861333-8 Oct 19 04:01:57.499398 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-be286c1b-c89b-4904-8e2b-7a6334eeea6e req-93ec3b53-fc12-4a0b-9c1e-988be063463f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048008 Oct 19 04:01:57.501261 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3600/6977] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:01:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 04:01:58.243332 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9b3d7b84-a280-44cf-b2a3-7e75c90dd57e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:01:58.244815 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9b3d7b84-a280-44cf-b2a3-7e75c90dd57e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 5262740d-a79b-413a-990b-bb4842fd8d58] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:01:58.253742 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9b3d7b84-a280-44cf-b2a3-7e75c90dd57e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:01:58.256679 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9b3d7b84-a280-44cf-b2a3-7e75c90dd57e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:01:58.256679 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9b3d7b84-a280-44cf-b2a3-7e75c90dd57e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:01:58.256679 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9b3d7b84-a280-44cf-b2a3-7e75c90dd57e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:01:58.256679 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9b3d7b84-a280-44cf-b2a3-7e75c90dd57e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:01:58.256679 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9b3d7b84-a280-44cf-b2a3-7e75c90dd57e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:01:58.494912 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9b3d7b84-a280-44cf-b2a3-7e75c90dd57e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:01:58.508563 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9b3d7b84-a280-44cf-b2a3-7e75c90dd57e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/5262740d-a79b-413a-990b-bb4842fd8d58" status: 200 len: 1229 microversion: 2.1 time: 0.271652 Oct 19 04:01:58.510294 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3601/6978] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:01:58 2022] GET /compute/v2.1/servers/5262740d-a79b-413a-990b-bb4842fd8d58 => generated 1229 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:01:59.533411 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5a1d5e2c-4d8a-4a73-858c-40b6946e30cc tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:01:59.534733 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5a1d5e2c-4d8a-4a73-858c-40b6946e30cc tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 5262740d-a79b-413a-990b-bb4842fd8d58] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:01:59.541740 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5a1d5e2c-4d8a-4a73-858c-40b6946e30cc tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:01:59.542232 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5a1d5e2c-4d8a-4a73-858c-40b6946e30cc tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:01:59.542695 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5a1d5e2c-4d8a-4a73-858c-40b6946e30cc tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:01:59.543517 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5a1d5e2c-4d8a-4a73-858c-40b6946e30cc tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:01:59.544268 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5a1d5e2c-4d8a-4a73-858c-40b6946e30cc tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:01:59.544876 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5a1d5e2c-4d8a-4a73-858c-40b6946e30cc tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:01:59.705201 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5a1d5e2c-4d8a-4a73-858c-40b6946e30cc tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:01:59.713852 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5a1d5e2c-4d8a-4a73-858c-40b6946e30cc tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/5262740d-a79b-413a-990b-bb4842fd8d58" status: 200 len: 1229 microversion: 2.1 time: 0.184473 Oct 19 04:01:59.714688 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3602/6979] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:01:59 2022] GET /compute/v2.1/servers/5262740d-a79b-413a-990b-bb4842fd8d58 => generated 1229 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:02:00.744046 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-cec5b8fc-9ab6-4ee1-90f5-ef451c3c809b tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:02:00.744978 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-cec5b8fc-9ab6-4ee1-90f5-ef451c3c809b tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 5262740d-a79b-413a-990b-bb4842fd8d58] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:02:00.752440 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cec5b8fc-9ab6-4ee1-90f5-ef451c3c809b tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:02:00.753015 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cec5b8fc-9ab6-4ee1-90f5-ef451c3c809b tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:02:00.756887 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cec5b8fc-9ab6-4ee1-90f5-ef451c3c809b tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:02:00.756887 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cec5b8fc-9ab6-4ee1-90f5-ef451c3c809b tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:02:00.756887 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cec5b8fc-9ab6-4ee1-90f5-ef451c3c809b tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:02:00.756887 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cec5b8fc-9ab6-4ee1-90f5-ef451c3c809b tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:02:00.896153 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-cec5b8fc-9ab6-4ee1-90f5-ef451c3c809b tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:02:00.904672 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-cec5b8fc-9ab6-4ee1-90f5-ef451c3c809b tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/5262740d-a79b-413a-990b-bb4842fd8d58" status: 200 len: 1229 microversion: 2.1 time: 0.166459 Oct 19 04:02:00.907002 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3603/6980] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:02:00 2022] GET /compute/v2.1/servers/5262740d-a79b-413a-990b-bb4842fd8d58 => generated 1229 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:02:01.928893 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-fe47ddae-dc6c-4324-a103-e7bbd546507f tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:02:01.929595 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-fe47ddae-dc6c-4324-a103-e7bbd546507f tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 5262740d-a79b-413a-990b-bb4842fd8d58] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:02:01.931490 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:02:01.938115 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fe47ddae-dc6c-4324-a103-e7bbd546507f tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:02:01.938605 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fe47ddae-dc6c-4324-a103-e7bbd546507f tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:02:01.939047 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fe47ddae-dc6c-4324-a103-e7bbd546507f tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:02:01.939739 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fe47ddae-dc6c-4324-a103-e7bbd546507f tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:02:01.940196 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fe47ddae-dc6c-4324-a103-e7bbd546507f tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:02:01.940626 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fe47ddae-dc6c-4324-a103-e7bbd546507f tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:02:02.169026 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-fe47ddae-dc6c-4324-a103-e7bbd546507f tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:02:02.178525 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-fe47ddae-dc6c-4324-a103-e7bbd546507f tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/5262740d-a79b-413a-990b-bb4842fd8d58" status: 200 len: 1217 microversion: 2.1 time: 0.253427 Oct 19 04:02:02.184373 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3604/6981] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:02:01 2022] GET /compute/v2.1/servers/5262740d-a79b-413a-990b-bb4842fd8d58 => generated 1217 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:02:03.204550 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-611bbefe-2092-48fb-b305-8007c6c5f9f0 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:02:03.205301 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-611bbefe-2092-48fb-b305-8007c6c5f9f0 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 5262740d-a79b-413a-990b-bb4842fd8d58] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:02:03.207383 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=8 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:02:03.213899 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-611bbefe-2092-48fb-b305-8007c6c5f9f0 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:02:03.214873 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-611bbefe-2092-48fb-b305-8007c6c5f9f0 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:02:03.215601 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-611bbefe-2092-48fb-b305-8007c6c5f9f0 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:02:03.216644 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-611bbefe-2092-48fb-b305-8007c6c5f9f0 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:02:03.217325 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-611bbefe-2092-48fb-b305-8007c6c5f9f0 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:02:03.218158 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-611bbefe-2092-48fb-b305-8007c6c5f9f0 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:02:03.406851 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-611bbefe-2092-48fb-b305-8007c6c5f9f0 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:02:03.415145 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-611bbefe-2092-48fb-b305-8007c6c5f9f0 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/5262740d-a79b-413a-990b-bb4842fd8d58" status: 200 len: 1217 microversion: 2.1 time: 0.216293 Oct 19 04:02:03.429503 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3605/6982] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:02:03 2022] GET /compute/v2.1/servers/5262740d-a79b-413a-990b-bb4842fd8d58 => generated 1217 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:02:04.442455 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-fd12c1cc-a2e7-4dc0-8bdc-09777adf02f9 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:02:04.443315 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-fd12c1cc-a2e7-4dc0-8bdc-09777adf02f9 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 5262740d-a79b-413a-990b-bb4842fd8d58] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:02:04.450563 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fd12c1cc-a2e7-4dc0-8bdc-09777adf02f9 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:02:04.451057 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fd12c1cc-a2e7-4dc0-8bdc-09777adf02f9 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:02:04.451488 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fd12c1cc-a2e7-4dc0-8bdc-09777adf02f9 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:02:04.452203 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fd12c1cc-a2e7-4dc0-8bdc-09777adf02f9 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:02:04.452663 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fd12c1cc-a2e7-4dc0-8bdc-09777adf02f9 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:02:04.453682 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fd12c1cc-a2e7-4dc0-8bdc-09777adf02f9 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:02:04.607941 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-fd12c1cc-a2e7-4dc0-8bdc-09777adf02f9 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:02:04.616512 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-fd12c1cc-a2e7-4dc0-8bdc-09777adf02f9 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/5262740d-a79b-413a-990b-bb4842fd8d58" status: 200 len: 1217 microversion: 2.1 time: 0.179665 Oct 19 04:02:04.617260 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3606/6983] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:02:04 2022] GET /compute/v2.1/servers/5262740d-a79b-413a-990b-bb4842fd8d58 => generated 1217 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:02:05.642694 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b4f85640-d871-44e8-a943-553fdc949f9b tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:02:05.643383 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b4f85640-d871-44e8-a943-553fdc949f9b tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 5262740d-a79b-413a-990b-bb4842fd8d58] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:02:05.650233 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b4f85640-d871-44e8-a943-553fdc949f9b tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:02:05.650722 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b4f85640-d871-44e8-a943-553fdc949f9b tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:02:05.651271 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b4f85640-d871-44e8-a943-553fdc949f9b tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:02:05.652682 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b4f85640-d871-44e8-a943-553fdc949f9b tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:02:05.653426 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b4f85640-d871-44e8-a943-553fdc949f9b tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:02:05.656960 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b4f85640-d871-44e8-a943-553fdc949f9b tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:02:05.887180 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b4f85640-d871-44e8-a943-553fdc949f9b tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:02:05.898177 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b4f85640-d871-44e8-a943-553fdc949f9b tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/5262740d-a79b-413a-990b-bb4842fd8d58" status: 200 len: 1217 microversion: 2.1 time: 0.261292 Oct 19 04:02:05.898806 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3607/6984] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:02:05 2022] GET /compute/v2.1/servers/5262740d-a79b-413a-990b-bb4842fd8d58 => generated 1217 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:02:06.924784 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8f246553-8098-4d27-a981-b8312b633fe5 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:02:06.926113 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8f246553-8098-4d27-a981-b8312b633fe5 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 5262740d-a79b-413a-990b-bb4842fd8d58] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:02:06.933060 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8f246553-8098-4d27-a981-b8312b633fe5 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:02:06.933826 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8f246553-8098-4d27-a981-b8312b633fe5 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:02:06.934330 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8f246553-8098-4d27-a981-b8312b633fe5 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:02:06.935085 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8f246553-8098-4d27-a981-b8312b633fe5 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:02:06.935546 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8f246553-8098-4d27-a981-b8312b633fe5 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:02:06.936040 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8f246553-8098-4d27-a981-b8312b633fe5 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:02:07.243315 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8f246553-8098-4d27-a981-b8312b633fe5 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:02:07.254612 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8f246553-8098-4d27-a981-b8312b633fe5 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/5262740d-a79b-413a-990b-bb4842fd8d58" status: 200 len: 1217 microversion: 2.1 time: 0.334261 Oct 19 04:02:07.255506 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3608/6985] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:02:06 2022] GET /compute/v2.1/servers/5262740d-a79b-413a-990b-bb4842fd8d58 => generated 1217 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:02:08.277635 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0250b9a3-f4e7-4d1e-abfe-d108e410d07d tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:02:08.278371 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0250b9a3-f4e7-4d1e-abfe-d108e410d07d tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 5262740d-a79b-413a-990b-bb4842fd8d58] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:02:08.285572 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0250b9a3-f4e7-4d1e-abfe-d108e410d07d tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:02:08.286064 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0250b9a3-f4e7-4d1e-abfe-d108e410d07d tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:02:08.286508 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0250b9a3-f4e7-4d1e-abfe-d108e410d07d tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:02:08.287211 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0250b9a3-f4e7-4d1e-abfe-d108e410d07d tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:02:08.287662 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0250b9a3-f4e7-4d1e-abfe-d108e410d07d tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:02:08.288088 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0250b9a3-f4e7-4d1e-abfe-d108e410d07d tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:02:08.467419 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0250b9a3-f4e7-4d1e-abfe-d108e410d07d tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:02:08.476253 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0250b9a3-f4e7-4d1e-abfe-d108e410d07d tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/5262740d-a79b-413a-990b-bb4842fd8d58" status: 200 len: 1217 microversion: 2.1 time: 0.202631 Oct 19 04:02:08.476957 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3609/6986] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:02:08 2022] GET /compute/v2.1/servers/5262740d-a79b-413a-990b-bb4842fd8d58 => generated 1217 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:02:09.499523 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-11d5b769-9ff7-4b7f-a040-de7960bb24c1 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:02:09.500749 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-11d5b769-9ff7-4b7f-a040-de7960bb24c1 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 5262740d-a79b-413a-990b-bb4842fd8d58] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:02:09.510203 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-11d5b769-9ff7-4b7f-a040-de7960bb24c1 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:02:09.511290 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-11d5b769-9ff7-4b7f-a040-de7960bb24c1 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:02:09.512523 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-11d5b769-9ff7-4b7f-a040-de7960bb24c1 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:02:09.513525 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-11d5b769-9ff7-4b7f-a040-de7960bb24c1 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:02:09.514383 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-11d5b769-9ff7-4b7f-a040-de7960bb24c1 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:02:09.515016 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-11d5b769-9ff7-4b7f-a040-de7960bb24c1 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:02:09.832425 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-11d5b769-9ff7-4b7f-a040-de7960bb24c1 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:02:09.841084 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-11d5b769-9ff7-4b7f-a040-de7960bb24c1 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/5262740d-a79b-413a-990b-bb4842fd8d58" status: 200 len: 1217 microversion: 2.1 time: 0.345387 Oct 19 04:02:09.855617 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3610/6987] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:02:09 2022] GET /compute/v2.1/servers/5262740d-a79b-413a-990b-bb4842fd8d58 => generated 1217 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:02:10.871917 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-26e9f499-b3d4-4861-a8c5-c9fd326dacc1 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:02:10.881758 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-26e9f499-b3d4-4861-a8c5-c9fd326dacc1 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 5262740d-a79b-413a-990b-bb4842fd8d58] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:02:10.892898 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-26e9f499-b3d4-4861-a8c5-c9fd326dacc1 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:02:10.895465 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-26e9f499-b3d4-4861-a8c5-c9fd326dacc1 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:02:10.895754 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-26e9f499-b3d4-4861-a8c5-c9fd326dacc1 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:02:10.896489 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-26e9f499-b3d4-4861-a8c5-c9fd326dacc1 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:02:10.896955 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-26e9f499-b3d4-4861-a8c5-c9fd326dacc1 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:02:10.897414 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-26e9f499-b3d4-4861-a8c5-c9fd326dacc1 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:02:11.112159 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-26e9f499-b3d4-4861-a8c5-c9fd326dacc1 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:02:11.127483 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-26e9f499-b3d4-4861-a8c5-c9fd326dacc1 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/5262740d-a79b-413a-990b-bb4842fd8d58" status: 200 len: 1217 microversion: 2.1 time: 0.263769 Oct 19 04:02:11.128463 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3611/6988] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:02:10 2022] GET /compute/v2.1/servers/5262740d-a79b-413a-990b-bb4842fd8d58 => generated 1217 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:02:12.131381 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-6580ca8d-8088-43bd-ad2c-8c7b591918e8 req-46a575dd-ec49-4eed-bbae-edaec54176ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5262740d-a79b-413a-990b-bb4842fd8d58", "name": "network-vif-plugged", "status": "completed", "tag": "0f92420a-3a0b-40ef-a003-55776635b70d"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:02:12.150073 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-6580ca8d-8088-43bd-ad2c-8c7b591918e8 req-46a575dd-ec49-4eed-bbae-edaec54176ff service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:02:12.150753 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-6580ca8d-8088-43bd-ad2c-8c7b591918e8 req-46a575dd-ec49-4eed-bbae-edaec54176ff service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:02:12.151491 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-6580ca8d-8088-43bd-ad2c-8c7b591918e8 req-46a575dd-ec49-4eed-bbae-edaec54176ff service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:02:12.163943 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-6580ca8d-8088-43bd-ad2c-8c7b591918e8 req-46a575dd-ec49-4eed-bbae-edaec54176ff service nova] Creating event network-vif-plugged:0f92420a-3a0b-40ef-a003-55776635b70d for instance 5262740d-a79b-413a-990b-bb4842fd8d58 on n-h1-861333-8 Oct 19 04:02:12.170057 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-6580ca8d-8088-43bd-ad2c-8c7b591918e8 req-46a575dd-ec49-4eed-bbae-edaec54176ff service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043220 Oct 19 04:02:12.171151 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3612/6989] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:02:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 04:02:12.177189 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4c323b89-e1b4-4ad7-835d-bd870f0221df tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:02:12.178160 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4c323b89-e1b4-4ad7-835d-bd870f0221df tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 5262740d-a79b-413a-990b-bb4842fd8d58] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:02:12.190640 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4c323b89-e1b4-4ad7-835d-bd870f0221df tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:02:12.191159 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4c323b89-e1b4-4ad7-835d-bd870f0221df tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:02:12.191610 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4c323b89-e1b4-4ad7-835d-bd870f0221df tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:02:12.192335 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4c323b89-e1b4-4ad7-835d-bd870f0221df tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:02:12.192983 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4c323b89-e1b4-4ad7-835d-bd870f0221df tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:02:12.193448 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4c323b89-e1b4-4ad7-835d-bd870f0221df tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:02:12.213182 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=100 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:02:12.380193 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-4c323b89-e1b4-4ad7-835d-bd870f0221df tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:02:12.388867 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4c323b89-e1b4-4ad7-835d-bd870f0221df tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/5262740d-a79b-413a-990b-bb4842fd8d58" status: 200 len: 1217 microversion: 2.1 time: 0.215771 Oct 19 04:02:12.389720 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3613/6990] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:02:12 2022] GET /compute/v2.1/servers/5262740d-a79b-413a-990b-bb4842fd8d58 => generated 1217 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:02:13.416416 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-21b1fcf5-14c4-48a5-83e0-a375f63f4c57 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:02:13.417107 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-21b1fcf5-14c4-48a5-83e0-a375f63f4c57 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 5262740d-a79b-413a-990b-bb4842fd8d58] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:02:13.424418 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-21b1fcf5-14c4-48a5-83e0-a375f63f4c57 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:02:13.425098 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-21b1fcf5-14c4-48a5-83e0-a375f63f4c57 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:02:13.425781 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-21b1fcf5-14c4-48a5-83e0-a375f63f4c57 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:02:13.426480 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-21b1fcf5-14c4-48a5-83e0-a375f63f4c57 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:02:13.426941 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-21b1fcf5-14c4-48a5-83e0-a375f63f4c57 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:02:13.427369 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-21b1fcf5-14c4-48a5-83e0-a375f63f4c57 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:02:13.680838 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-21b1fcf5-14c4-48a5-83e0-a375f63f4c57 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:02:13.690254 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-21b1fcf5-14c4-48a5-83e0-a375f63f4c57 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/5262740d-a79b-413a-990b-bb4842fd8d58" status: 200 len: 1217 microversion: 2.1 time: 0.277931 Oct 19 04:02:13.706677 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3614/6991] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:02:13 2022] GET /compute/v2.1/servers/5262740d-a79b-413a-990b-bb4842fd8d58 => generated 1217 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:02:14.713517 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2e0093e7-2a1a-4408-a21b-b0c1c95e8b50 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:02:14.714896 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2e0093e7-2a1a-4408-a21b-b0c1c95e8b50 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 5262740d-a79b-413a-990b-bb4842fd8d58] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:02:14.723023 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2e0093e7-2a1a-4408-a21b-b0c1c95e8b50 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:02:14.723806 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2e0093e7-2a1a-4408-a21b-b0c1c95e8b50 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:02:14.724256 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2e0093e7-2a1a-4408-a21b-b0c1c95e8b50 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:02:14.725177 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2e0093e7-2a1a-4408-a21b-b0c1c95e8b50 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:02:14.725699 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2e0093e7-2a1a-4408-a21b-b0c1c95e8b50 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:02:14.726123 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2e0093e7-2a1a-4408-a21b-b0c1c95e8b50 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:02:15.224117 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-2e0093e7-2a1a-4408-a21b-b0c1c95e8b50 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:02:15.233097 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2e0093e7-2a1a-4408-a21b-b0c1c95e8b50 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/5262740d-a79b-413a-990b-bb4842fd8d58" status: 200 len: 1405 microversion: 2.1 time: 0.523455 Oct 19 04:02:15.234600 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3615/6992] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:02:14 2022] GET /compute/v2.1/servers/5262740d-a79b-413a-990b-bb4842fd8d58 => generated 1405 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:02:15.257214 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-79f1e271-7f00-4f6a-b5b7-6e4d36c407c0 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:02:15.257862 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-79f1e271-7f00-4f6a-b5b7-6e4d36c407c0 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 5262740d-a79b-413a-990b-bb4842fd8d58] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:02:15.264578 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-79f1e271-7f00-4f6a-b5b7-6e4d36c407c0 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:02:15.265210 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-79f1e271-7f00-4f6a-b5b7-6e4d36c407c0 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:02:15.265679 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-79f1e271-7f00-4f6a-b5b7-6e4d36c407c0 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:02:15.266389 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-79f1e271-7f00-4f6a-b5b7-6e4d36c407c0 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:02:15.267131 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-79f1e271-7f00-4f6a-b5b7-6e4d36c407c0 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:02:15.267564 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-79f1e271-7f00-4f6a-b5b7-6e4d36c407c0 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:02:15.425596 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-79f1e271-7f00-4f6a-b5b7-6e4d36c407c0 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:02:15.433950 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-79f1e271-7f00-4f6a-b5b7-6e4d36c407c0 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/5262740d-a79b-413a-990b-bb4842fd8d58" status: 200 len: 1405 microversion: 2.1 time: 0.180506 Oct 19 04:02:15.434653 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3616/6993] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:02:15 2022] GET /compute/v2.1/servers/5262740d-a79b-413a-990b-bb4842fd8d58 => generated 1405 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:02:15.457045 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-554f7a9a-895c-4fbc-9791-93029771f869 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-108536739"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:02:15.459466 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-554f7a9a-895c-4fbc-9791-93029771f869 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 5262740d-a79b-413a-990b-bb4842fd8d58] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:02:15.465651 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-554f7a9a-895c-4fbc-9791-93029771f869 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:02:15.466149 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-554f7a9a-895c-4fbc-9791-93029771f869 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:02:15.466597 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-554f7a9a-895c-4fbc-9791-93029771f869 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:02:15.467294 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-554f7a9a-895c-4fbc-9791-93029771f869 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:02:15.467754 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-554f7a9a-895c-4fbc-9791-93029771f869 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:02:15.468828 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-554f7a9a-895c-4fbc-9791-93029771f869 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:02:15.571293 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.compute.api [None req-554f7a9a-895c-4fbc-9791-93029771f869 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 5262740d-a79b-413a-990b-bb4842fd8d58] Attempting to quiesce instance before volume snapshot. Oct 19 04:02:15.635170 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.compute.api [None req-554f7a9a-895c-4fbc-9791-93029771f869 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 5262740d-a79b-413a-990b-bb4842fd8d58] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Oct 19 04:02:15.873222 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-554f7a9a-895c-4fbc-9791-93029771f869 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 5262740d-a79b-413a-990b-bb4842fd8d58] Creating snapshot from volume 2e03fc75-a1fa-46d3-87c8-7743ceec22f5. {{(pid=121134) snapshot_instance /opt/stack/nova/nova/compute/api.py:3509}} Oct 19 04:02:17.779246 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-554f7a9a-895c-4fbc-9791-93029771f869 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "POST /compute/v2.1/servers/5262740d-a79b-413a-990b-bb4842fd8d58/action" status: 202 len: 0 microversion: 2.1 time: 2.326396 Oct 19 04:02:17.781061 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3617/6994] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 04:02:15 2022] POST /compute/v2.1/servers/5262740d-a79b-413a-990b-bb4842fd8d58/action => generated 0 bytes in 2329 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Oct 19 04:02:18.984862 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-07bbdd53-903f-409b-8583-e7b9d3b31496 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-2928638", "imageRef": "68d63def-a947-47f6-b7b1-95029f27adca", "flavorRef": "452", "networks": [{"uuid": "d55e7db4-c570-4a69-afcb-0fab975a7a7e"}]}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:02:19.054083 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-07bbdd53-903f-409b-8583-e7b9d3b31496 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] validate_networks() for [('d55e7db4-c570-4a69-afcb-0fab975a7a7e', None, None, None, None, None)] {{(pid=121134) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 04:02:19.707611 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-07bbdd53-903f-409b-8583-e7b9d3b31496 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Flavor limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 04:02:19.708181 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-07bbdd53-903f-409b-8583-e7b9d3b31496 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Image limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 04:02:19.709646 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-07bbdd53-903f-409b-8583-e7b9d3b31496 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Flavor pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 04:02:19.710111 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-07bbdd53-903f-409b-8583-e7b9d3b31496 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Image pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 04:02:19.710564 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-07bbdd53-903f-409b-8583-e7b9d3b31496 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 04:02:19.721887 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-07bbdd53-903f-409b-8583-e7b9d3b31496 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:02:19.721887 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-07bbdd53-903f-409b-8583-e7b9d3b31496 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:02:19.722281 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-07bbdd53-903f-409b-8583-e7b9d3b31496 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:02:19.723036 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-07bbdd53-903f-409b-8583-e7b9d3b31496 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:02:19.723837 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-07bbdd53-903f-409b-8583-e7b9d3b31496 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:02:19.724952 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-07bbdd53-903f-409b-8583-e7b9d3b31496 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:02:19.743081 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-07bbdd53-903f-409b-8583-e7b9d3b31496 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Getting quotas for project beff434485604f85985617071a93727c. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 04:02:19.748409 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-07bbdd53-903f-409b-8583-e7b9d3b31496 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Getting quotas for user 4d30aa868d79473f9534bd79816c07e3 and project beff434485604f85985617071a93727c. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 04:02:19.763964 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-07bbdd53-903f-409b-8583-e7b9d3b31496 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Going to run 1 instances... {{(pid=121134) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 04:02:19.765797 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-07bbdd53-903f-409b-8583-e7b9d3b31496 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: f0484f54-9a04-4d53-a922-8aea4041bb75] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='25adf18b-6ecd-40ae-a7ed-0aa9c9143ea4',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=121134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 04:02:19.909342 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-07bbdd53-903f-409b-8583-e7b9d3b31496 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.929694 Oct 19 04:02:19.910400 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3618/6995] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 04:02:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 932 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 04:02:19.922034 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5486dd3f-51fe-4e10-b582-f4445ca237ca tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:02:19.922669 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5486dd3f-51fe-4e10-b582-f4445ca237ca tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: f0484f54-9a04-4d53-a922-8aea4041bb75] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:02:19.985243 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5486dd3f-51fe-4e10-b582-f4445ca237ca tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:02:19.994047 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5486dd3f-51fe-4e10-b582-f4445ca237ca tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75" status: 200 len: 1227 microversion: 2.1 time: 0.076259 Oct 19 04:02:20.007215 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3619/6996] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:02:19 2022] GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75 => generated 1227 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:02:21.018637 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-be14f0b8-7ccf-454a-9608-01423ead4fab tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:02:21.019345 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-be14f0b8-7ccf-454a-9608-01423ead4fab tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: f0484f54-9a04-4d53-a922-8aea4041bb75] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:02:21.023096 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=6 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:02:21.030944 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-be14f0b8-7ccf-454a-9608-01423ead4fab tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:02:21.031381 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-be14f0b8-7ccf-454a-9608-01423ead4fab tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:02:21.031847 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-be14f0b8-7ccf-454a-9608-01423ead4fab tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:02:21.032644 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-be14f0b8-7ccf-454a-9608-01423ead4fab tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:02:21.033134 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-be14f0b8-7ccf-454a-9608-01423ead4fab tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:02:21.033616 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-be14f0b8-7ccf-454a-9608-01423ead4fab tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:02:21.158787 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-be14f0b8-7ccf-454a-9608-01423ead4fab tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:02:21.166658 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-be14f0b8-7ccf-454a-9608-01423ead4fab tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75" status: 200 len: 1231 microversion: 2.1 time: 0.152025 Oct 19 04:02:21.167354 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3620/6997] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:02:21 2022] GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75 => generated 1231 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:02:22.195317 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e13157c6-253f-475f-8070-25f59c976542 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:02:22.196010 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e13157c6-253f-475f-8070-25f59c976542 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: f0484f54-9a04-4d53-a922-8aea4041bb75] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:02:22.205998 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e13157c6-253f-475f-8070-25f59c976542 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:02:22.206790 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e13157c6-253f-475f-8070-25f59c976542 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:02:22.207409 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e13157c6-253f-475f-8070-25f59c976542 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:02:22.209596 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e13157c6-253f-475f-8070-25f59c976542 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:02:22.209859 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e13157c6-253f-475f-8070-25f59c976542 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:02:22.210475 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e13157c6-253f-475f-8070-25f59c976542 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:02:22.315723 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e13157c6-253f-475f-8070-25f59c976542 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:02:22.332254 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e13157c6-253f-475f-8070-25f59c976542 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75" status: 200 len: 1287 microversion: 2.1 time: 0.144867 Oct 19 04:02:22.349819 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3621/6998] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:02:22 2022] GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75 => generated 1287 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:02:23.363815 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-da9fc81c-ea0f-4611-a855-1612f8911e10 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:02:23.366286 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-da9fc81c-ea0f-4611-a855-1612f8911e10 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: f0484f54-9a04-4d53-a922-8aea4041bb75] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:02:23.376166 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-da9fc81c-ea0f-4611-a855-1612f8911e10 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:02:23.378143 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-da9fc81c-ea0f-4611-a855-1612f8911e10 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:02:23.378702 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-da9fc81c-ea0f-4611-a855-1612f8911e10 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:02:23.386765 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-da9fc81c-ea0f-4611-a855-1612f8911e10 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:02:23.386765 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-da9fc81c-ea0f-4611-a855-1612f8911e10 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:02:23.386765 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-da9fc81c-ea0f-4611-a855-1612f8911e10 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:02:23.788195 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-da9fc81c-ea0f-4611-a855-1612f8911e10 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:02:23.793282 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-da9fc81c-ea0f-4611-a855-1612f8911e10 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75" status: 200 len: 1339 microversion: 2.1 time: 0.437087 Oct 19 04:02:23.793972 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3622/6999] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:02:23 2022] GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75 => generated 1339 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:02:24.389631 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-1abe2901-ffb1-432f-b5c1-1b4ac27cf461 req-f024b8c5-910a-42db-b1fa-6b7a4d2db67e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0484f54-9a04-4d53-a922-8aea4041bb75", "tag": "84bf5e46-8aa1-4094-9a68-4dc8b4aaefe9"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:02:24.423780 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-1abe2901-ffb1-432f-b5c1-1b4ac27cf461 req-f024b8c5-910a-42db-b1fa-6b7a4d2db67e service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:02:24.426336 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-1abe2901-ffb1-432f-b5c1-1b4ac27cf461 req-f024b8c5-910a-42db-b1fa-6b7a4d2db67e service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:02:24.427504 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-1abe2901-ffb1-432f-b5c1-1b4ac27cf461 req-f024b8c5-910a-42db-b1fa-6b7a4d2db67e service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:02:24.456532 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-1abe2901-ffb1-432f-b5c1-1b4ac27cf461 req-f024b8c5-910a-42db-b1fa-6b7a4d2db67e service nova] Creating event network-changed:84bf5e46-8aa1-4094-9a68-4dc8b4aaefe9 for instance f0484f54-9a04-4d53-a922-8aea4041bb75 on n-h2-861333-8 Oct 19 04:02:24.465956 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-1abe2901-ffb1-432f-b5c1-1b4ac27cf461 req-f024b8c5-910a-42db-b1fa-6b7a4d2db67e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078748 Oct 19 04:02:24.469162 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3623/7000] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:02:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 04:02:24.818406 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ddaab47d-5b6a-4534-8909-f33cad270ac9 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:02:24.819135 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ddaab47d-5b6a-4534-8909-f33cad270ac9 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: f0484f54-9a04-4d53-a922-8aea4041bb75] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:02:24.832426 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ddaab47d-5b6a-4534-8909-f33cad270ac9 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:02:24.832977 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ddaab47d-5b6a-4534-8909-f33cad270ac9 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:02:24.833562 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ddaab47d-5b6a-4534-8909-f33cad270ac9 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:02:24.834627 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ddaab47d-5b6a-4534-8909-f33cad270ac9 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:02:24.835271 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ddaab47d-5b6a-4534-8909-f33cad270ac9 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:02:24.836198 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ddaab47d-5b6a-4534-8909-f33cad270ac9 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:02:25.170827 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ddaab47d-5b6a-4534-8909-f33cad270ac9 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:02:25.188433 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ddaab47d-5b6a-4534-8909-f33cad270ac9 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75" status: 200 len: 1339 microversion: 2.1 time: 0.366701 Oct 19 04:02:25.188433 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3624/7001] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:02:24 2022] GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75 => generated 1339 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:02:26.216683 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-37a23990-f0e8-47be-b532-605fdc2c8a62 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:02:26.216683 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-37a23990-f0e8-47be-b532-605fdc2c8a62 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: f0484f54-9a04-4d53-a922-8aea4041bb75] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:02:26.225096 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-37a23990-f0e8-47be-b532-605fdc2c8a62 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:02:26.225727 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-37a23990-f0e8-47be-b532-605fdc2c8a62 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:02:26.226130 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-37a23990-f0e8-47be-b532-605fdc2c8a62 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:02:26.226908 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-37a23990-f0e8-47be-b532-605fdc2c8a62 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:02:26.227385 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-37a23990-f0e8-47be-b532-605fdc2c8a62 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:02:26.227867 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-37a23990-f0e8-47be-b532-605fdc2c8a62 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:02:26.456545 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-37a23990-f0e8-47be-b532-605fdc2c8a62 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:02:26.469216 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-37a23990-f0e8-47be-b532-605fdc2c8a62 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75" status: 200 len: 1339 microversion: 2.1 time: 0.266359 Oct 19 04:02:26.470170 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3625/7002] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:02:26 2022] GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75 => generated 1339 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:02:27.493779 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-bec76808-ac81-4c8b-9ac9-121893006682 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:02:27.494570 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-bec76808-ac81-4c8b-9ac9-121893006682 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: f0484f54-9a04-4d53-a922-8aea4041bb75] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:02:27.502355 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bec76808-ac81-4c8b-9ac9-121893006682 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:02:27.502909 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bec76808-ac81-4c8b-9ac9-121893006682 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:02:27.503587 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bec76808-ac81-4c8b-9ac9-121893006682 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:02:27.504424 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bec76808-ac81-4c8b-9ac9-121893006682 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:02:27.505068 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bec76808-ac81-4c8b-9ac9-121893006682 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:02:27.505743 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bec76808-ac81-4c8b-9ac9-121893006682 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:02:27.677825 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-bec76808-ac81-4c8b-9ac9-121893006682 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:02:27.689592 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-bec76808-ac81-4c8b-9ac9-121893006682 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75" status: 200 len: 1339 microversion: 2.1 time: 0.198979 Oct 19 04:02:27.693878 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3626/7003] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:02:27 2022] GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75 => generated 1339 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:02:28.727577 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-cc48ac63-3822-4578-a4fa-fb147664f845 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:02:28.728259 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-cc48ac63-3822-4578-a4fa-fb147664f845 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: f0484f54-9a04-4d53-a922-8aea4041bb75] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:02:28.736433 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cc48ac63-3822-4578-a4fa-fb147664f845 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:02:28.737253 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cc48ac63-3822-4578-a4fa-fb147664f845 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:02:28.738017 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cc48ac63-3822-4578-a4fa-fb147664f845 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:02:28.739134 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cc48ac63-3822-4578-a4fa-fb147664f845 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:02:28.739834 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cc48ac63-3822-4578-a4fa-fb147664f845 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:02:28.740605 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cc48ac63-3822-4578-a4fa-fb147664f845 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:02:28.903820 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-cc48ac63-3822-4578-a4fa-fb147664f845 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:02:28.915679 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-cc48ac63-3822-4578-a4fa-fb147664f845 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75" status: 200 len: 1339 microversion: 2.1 time: 0.191850 Oct 19 04:02:28.930634 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3627/7004] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:02:28 2022] GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75 => generated 1339 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:02:29.943992 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8b1f5417-0c00-43ac-9746-87c4f5cb6366 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:02:29.945609 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8b1f5417-0c00-43ac-9746-87c4f5cb6366 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: f0484f54-9a04-4d53-a922-8aea4041bb75] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:02:29.947837 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:02:29.955484 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8b1f5417-0c00-43ac-9746-87c4f5cb6366 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:02:29.956277 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8b1f5417-0c00-43ac-9746-87c4f5cb6366 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:02:29.956936 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8b1f5417-0c00-43ac-9746-87c4f5cb6366 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:02:29.957895 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8b1f5417-0c00-43ac-9746-87c4f5cb6366 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:02:29.958688 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8b1f5417-0c00-43ac-9746-87c4f5cb6366 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:02:29.959310 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8b1f5417-0c00-43ac-9746-87c4f5cb6366 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:02:29.994105 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=8 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:02:30.117046 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8b1f5417-0c00-43ac-9746-87c4f5cb6366 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:02:30.125929 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8b1f5417-0c00-43ac-9746-87c4f5cb6366 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75" status: 200 len: 1339 microversion: 2.1 time: 0.186638 Oct 19 04:02:30.126602 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3628/7005] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:02:29 2022] GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75 => generated 1339 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:02:31.150823 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-24c98174-b7db-4aad-8b49-7a05c4e75521 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:02:31.151550 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-24c98174-b7db-4aad-8b49-7a05c4e75521 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: f0484f54-9a04-4d53-a922-8aea4041bb75] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:02:31.158381 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-24c98174-b7db-4aad-8b49-7a05c4e75521 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:02:31.160321 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-24c98174-b7db-4aad-8b49-7a05c4e75521 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:02:31.160321 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-24c98174-b7db-4aad-8b49-7a05c4e75521 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:02:31.160321 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-24c98174-b7db-4aad-8b49-7a05c4e75521 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:02:31.160639 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-24c98174-b7db-4aad-8b49-7a05c4e75521 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:02:31.160888 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-24c98174-b7db-4aad-8b49-7a05c4e75521 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:02:31.315482 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-24c98174-b7db-4aad-8b49-7a05c4e75521 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:02:31.344788 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-24c98174-b7db-4aad-8b49-7a05c4e75521 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75" status: 200 len: 1339 microversion: 2.1 time: 0.177934 Oct 19 04:02:31.344788 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3629/7006] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:02:31 2022] GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75 => generated 1339 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:02:32.350124 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2e4fd438-457e-454b-b8b8-e874b15e6dc3 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:02:32.365906 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2e4fd438-457e-454b-b8b8-e874b15e6dc3 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: f0484f54-9a04-4d53-a922-8aea4041bb75] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:02:32.365906 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2e4fd438-457e-454b-b8b8-e874b15e6dc3 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:02:32.365906 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2e4fd438-457e-454b-b8b8-e874b15e6dc3 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:02:32.365906 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2e4fd438-457e-454b-b8b8-e874b15e6dc3 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:02:32.365906 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2e4fd438-457e-454b-b8b8-e874b15e6dc3 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:02:32.365906 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2e4fd438-457e-454b-b8b8-e874b15e6dc3 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:02:32.365906 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2e4fd438-457e-454b-b8b8-e874b15e6dc3 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:02:32.382296 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:02:32.532264 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-2e4fd438-457e-454b-b8b8-e874b15e6dc3 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:02:32.549288 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2e4fd438-457e-454b-b8b8-e874b15e6dc3 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75" status: 200 len: 1339 microversion: 2.1 time: 0.204899 Oct 19 04:02:32.551277 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3630/7007] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:02:32 2022] GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75 => generated 1339 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:02:33.584749 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-587792d7-a5de-4389-959b-f9526e5567ca tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:02:33.585481 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-587792d7-a5de-4389-959b-f9526e5567ca tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: f0484f54-9a04-4d53-a922-8aea4041bb75] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:02:33.593660 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-587792d7-a5de-4389-959b-f9526e5567ca tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:02:33.594583 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-587792d7-a5de-4389-959b-f9526e5567ca tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:02:33.595287 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-587792d7-a5de-4389-959b-f9526e5567ca tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:02:33.596344 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-587792d7-a5de-4389-959b-f9526e5567ca tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:02:33.597014 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-587792d7-a5de-4389-959b-f9526e5567ca tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:02:33.597684 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-587792d7-a5de-4389-959b-f9526e5567ca tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:02:33.786850 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-587792d7-a5de-4389-959b-f9526e5567ca tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:02:33.796563 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-587792d7-a5de-4389-959b-f9526e5567ca tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75" status: 200 len: 1339 microversion: 2.1 time: 0.214983 Oct 19 04:02:33.802626 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3631/7008] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:02:33 2022] GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75 => generated 1339 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:02:34.830913 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0fc87670-3a69-4c29-a5f8-14bd059fbbba tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:02:34.832944 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0fc87670-3a69-4c29-a5f8-14bd059fbbba tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: f0484f54-9a04-4d53-a922-8aea4041bb75] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:02:34.840681 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0fc87670-3a69-4c29-a5f8-14bd059fbbba tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:02:34.841517 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0fc87670-3a69-4c29-a5f8-14bd059fbbba tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:02:34.844920 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0fc87670-3a69-4c29-a5f8-14bd059fbbba tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:02:34.844920 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0fc87670-3a69-4c29-a5f8-14bd059fbbba tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:02:34.844920 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0fc87670-3a69-4c29-a5f8-14bd059fbbba tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:02:34.844920 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0fc87670-3a69-4c29-a5f8-14bd059fbbba tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:02:35.020827 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0fc87670-3a69-4c29-a5f8-14bd059fbbba tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:02:35.029121 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0fc87670-3a69-4c29-a5f8-14bd059fbbba tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75" status: 200 len: 1339 microversion: 2.1 time: 0.203580 Oct 19 04:02:35.029743 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3632/7009] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:02:34 2022] GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75 => generated 1339 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:02:36.057634 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ab489dec-ba06-4302-be50-02f438cd6501 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:02:36.058434 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ab489dec-ba06-4302-be50-02f438cd6501 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: f0484f54-9a04-4d53-a922-8aea4041bb75] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:02:36.065478 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ab489dec-ba06-4302-be50-02f438cd6501 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:02:36.065969 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ab489dec-ba06-4302-be50-02f438cd6501 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:02:36.066470 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ab489dec-ba06-4302-be50-02f438cd6501 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:02:36.067279 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ab489dec-ba06-4302-be50-02f438cd6501 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:02:36.068139 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ab489dec-ba06-4302-be50-02f438cd6501 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:02:36.069020 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ab489dec-ba06-4302-be50-02f438cd6501 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:02:36.336890 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ab489dec-ba06-4302-be50-02f438cd6501 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:02:36.344599 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ab489dec-ba06-4302-be50-02f438cd6501 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75" status: 200 len: 1339 microversion: 2.1 time: 0.291095 Oct 19 04:02:36.345192 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3633/7010] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:02:36 2022] GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75 => generated 1339 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:02:37.370735 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1ab560ca-5a57-4680-b4a0-7b07087891c9 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:02:37.371592 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1ab560ca-5a57-4680-b4a0-7b07087891c9 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: f0484f54-9a04-4d53-a922-8aea4041bb75] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:02:37.380154 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1ab560ca-5a57-4680-b4a0-7b07087891c9 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:02:37.386506 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1ab560ca-5a57-4680-b4a0-7b07087891c9 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:02:37.386506 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1ab560ca-5a57-4680-b4a0-7b07087891c9 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:02:37.386506 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1ab560ca-5a57-4680-b4a0-7b07087891c9 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:02:37.386506 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1ab560ca-5a57-4680-b4a0-7b07087891c9 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:02:37.386506 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1ab560ca-5a57-4680-b4a0-7b07087891c9 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:02:37.814138 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-1ab560ca-5a57-4680-b4a0-7b07087891c9 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:02:37.822310 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1ab560ca-5a57-4680-b4a0-7b07087891c9 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75" status: 200 len: 1339 microversion: 2.1 time: 0.455480 Oct 19 04:02:37.822904 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3634/7011] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:02:37 2022] GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75 => generated 1339 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:02:38.845876 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9c2ef15d-26b8-4320-9027-d6e9ca3c3380 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:02:38.846509 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9c2ef15d-26b8-4320-9027-d6e9ca3c3380 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: f0484f54-9a04-4d53-a922-8aea4041bb75] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:02:38.853621 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9c2ef15d-26b8-4320-9027-d6e9ca3c3380 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:02:38.854125 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9c2ef15d-26b8-4320-9027-d6e9ca3c3380 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:02:38.854577 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9c2ef15d-26b8-4320-9027-d6e9ca3c3380 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:02:38.855296 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9c2ef15d-26b8-4320-9027-d6e9ca3c3380 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:02:38.856805 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9c2ef15d-26b8-4320-9027-d6e9ca3c3380 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:02:38.856805 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9c2ef15d-26b8-4320-9027-d6e9ca3c3380 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:02:39.042522 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9c2ef15d-26b8-4320-9027-d6e9ca3c3380 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:02:39.058154 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9c2ef15d-26b8-4320-9027-d6e9ca3c3380 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75" status: 200 len: 1339 microversion: 2.1 time: 0.216529 Oct 19 04:02:39.058761 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3635/7012] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:02:38 2022] GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75 => generated 1339 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:02:40.084987 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-bc321f57-307f-48d7-b498-e2ac9e3306f6 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:02:40.087051 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-bc321f57-307f-48d7-b498-e2ac9e3306f6 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: f0484f54-9a04-4d53-a922-8aea4041bb75] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:02:40.095656 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bc321f57-307f-48d7-b498-e2ac9e3306f6 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:02:40.096289 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bc321f57-307f-48d7-b498-e2ac9e3306f6 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:02:40.097241 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bc321f57-307f-48d7-b498-e2ac9e3306f6 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:02:40.098162 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bc321f57-307f-48d7-b498-e2ac9e3306f6 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:02:40.098802 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bc321f57-307f-48d7-b498-e2ac9e3306f6 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:02:40.099684 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bc321f57-307f-48d7-b498-e2ac9e3306f6 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:02:40.254341 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-bc321f57-307f-48d7-b498-e2ac9e3306f6 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:02:40.262365 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-bc321f57-307f-48d7-b498-e2ac9e3306f6 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75" status: 200 len: 1339 microversion: 2.1 time: 0.182287 Oct 19 04:02:40.262960 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3636/7013] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:02:40 2022] GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75 => generated 1339 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:02:41.286117 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-27168dfb-125f-45a0-a2ad-06e56d814b81 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:02:41.286873 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-27168dfb-125f-45a0-a2ad-06e56d814b81 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: f0484f54-9a04-4d53-a922-8aea4041bb75] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:02:41.294092 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-27168dfb-125f-45a0-a2ad-06e56d814b81 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:02:41.294595 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-27168dfb-125f-45a0-a2ad-06e56d814b81 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:02:41.296432 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-27168dfb-125f-45a0-a2ad-06e56d814b81 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:02:41.296432 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-27168dfb-125f-45a0-a2ad-06e56d814b81 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:02:41.296432 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-27168dfb-125f-45a0-a2ad-06e56d814b81 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:02:41.296847 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-27168dfb-125f-45a0-a2ad-06e56d814b81 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:02:41.446688 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-27168dfb-125f-45a0-a2ad-06e56d814b81 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:02:41.458166 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-27168dfb-125f-45a0-a2ad-06e56d814b81 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75" status: 200 len: 1339 microversion: 2.1 time: 0.176051 Oct 19 04:02:41.469946 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3637/7014] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:02:41 2022] GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75 => generated 1339 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:02:42.483811 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-92d87a27-7c30-4616-ae09-7128a3fb170c tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:02:42.484565 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-92d87a27-7c30-4616-ae09-7128a3fb170c tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: f0484f54-9a04-4d53-a922-8aea4041bb75] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:02:42.491724 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-92d87a27-7c30-4616-ae09-7128a3fb170c tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:02:42.492461 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-92d87a27-7c30-4616-ae09-7128a3fb170c tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:02:42.493136 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-92d87a27-7c30-4616-ae09-7128a3fb170c tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:02:42.493896 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-92d87a27-7c30-4616-ae09-7128a3fb170c tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:02:42.494372 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-92d87a27-7c30-4616-ae09-7128a3fb170c tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:02:42.494820 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-92d87a27-7c30-4616-ae09-7128a3fb170c tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:02:42.731825 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-92d87a27-7c30-4616-ae09-7128a3fb170c tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:02:42.740892 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-92d87a27-7c30-4616-ae09-7128a3fb170c tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75" status: 200 len: 1339 microversion: 2.1 time: 0.261474 Oct 19 04:02:42.741693 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3638/7015] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:02:42 2022] GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75 => generated 1339 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:02:43.763969 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e49a1ee2-5fa3-4718-b6d9-e0ab0008b76e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:02:43.765971 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e49a1ee2-5fa3-4718-b6d9-e0ab0008b76e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: f0484f54-9a04-4d53-a922-8aea4041bb75] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:02:43.783036 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e49a1ee2-5fa3-4718-b6d9-e0ab0008b76e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:02:43.783720 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e49a1ee2-5fa3-4718-b6d9-e0ab0008b76e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:02:43.784451 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e49a1ee2-5fa3-4718-b6d9-e0ab0008b76e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:02:43.785406 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e49a1ee2-5fa3-4718-b6d9-e0ab0008b76e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:02:43.785941 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e49a1ee2-5fa3-4718-b6d9-e0ab0008b76e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:02:43.786388 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e49a1ee2-5fa3-4718-b6d9-e0ab0008b76e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:02:44.021003 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e49a1ee2-5fa3-4718-b6d9-e0ab0008b76e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:02:44.033711 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e49a1ee2-5fa3-4718-b6d9-e0ab0008b76e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75" status: 200 len: 1339 microversion: 2.1 time: 0.273632 Oct 19 04:02:44.049741 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3639/7016] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:02:43 2022] GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75 => generated 1339 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:02:45.056300 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8839daa2-b64c-41b8-a070-8591445feba6 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:02:45.057007 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8839daa2-b64c-41b8-a070-8591445feba6 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: f0484f54-9a04-4d53-a922-8aea4041bb75] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:02:45.068391 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8839daa2-b64c-41b8-a070-8591445feba6 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:02:45.068941 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8839daa2-b64c-41b8-a070-8591445feba6 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:02:45.069463 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8839daa2-b64c-41b8-a070-8591445feba6 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:02:45.070292 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8839daa2-b64c-41b8-a070-8591445feba6 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:02:45.070946 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8839daa2-b64c-41b8-a070-8591445feba6 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:02:45.071551 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8839daa2-b64c-41b8-a070-8591445feba6 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:02:45.226270 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8839daa2-b64c-41b8-a070-8591445feba6 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:02:45.235043 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8839daa2-b64c-41b8-a070-8591445feba6 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75" status: 200 len: 1339 microversion: 2.1 time: 0.182647 Oct 19 04:02:45.235813 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3640/7017] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:02:45 2022] GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75 => generated 1339 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:02:46.259819 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7ec3ab41-5b5f-4aec-ac2c-d333d00d2405 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:02:46.260502 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7ec3ab41-5b5f-4aec-ac2c-d333d00d2405 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: f0484f54-9a04-4d53-a922-8aea4041bb75] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:02:46.267434 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7ec3ab41-5b5f-4aec-ac2c-d333d00d2405 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:02:46.267941 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7ec3ab41-5b5f-4aec-ac2c-d333d00d2405 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:02:46.268402 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7ec3ab41-5b5f-4aec-ac2c-d333d00d2405 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:02:46.269114 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7ec3ab41-5b5f-4aec-ac2c-d333d00d2405 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:02:46.269622 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7ec3ab41-5b5f-4aec-ac2c-d333d00d2405 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:02:46.270068 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7ec3ab41-5b5f-4aec-ac2c-d333d00d2405 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:02:46.429770 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-7ec3ab41-5b5f-4aec-ac2c-d333d00d2405 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:02:46.438837 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7ec3ab41-5b5f-4aec-ac2c-d333d00d2405 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75" status: 200 len: 1339 microversion: 2.1 time: 0.182967 Oct 19 04:02:46.439520 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3641/7018] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:02:46 2022] GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75 => generated 1339 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:02:47.466132 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a9c959c9-cf2c-471b-96a0-77e11440c7ea tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:02:47.467149 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a9c959c9-cf2c-471b-96a0-77e11440c7ea tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: f0484f54-9a04-4d53-a922-8aea4041bb75] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:02:47.476591 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a9c959c9-cf2c-471b-96a0-77e11440c7ea tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:02:47.477937 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a9c959c9-cf2c-471b-96a0-77e11440c7ea tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:02:47.479738 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a9c959c9-cf2c-471b-96a0-77e11440c7ea tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:02:47.479974 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a9c959c9-cf2c-471b-96a0-77e11440c7ea tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:02:47.480517 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a9c959c9-cf2c-471b-96a0-77e11440c7ea tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:02:47.480968 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a9c959c9-cf2c-471b-96a0-77e11440c7ea tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:02:47.636952 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a9c959c9-cf2c-471b-96a0-77e11440c7ea tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:02:47.649525 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a9c959c9-cf2c-471b-96a0-77e11440c7ea tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75" status: 200 len: 1339 microversion: 2.1 time: 0.186841 Oct 19 04:02:47.649525 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3642/7019] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:02:47 2022] GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75 => generated 1339 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:02:48.673801 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-58b7689e-840c-42ac-9971-11fcc00a32e4 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:02:48.675546 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-58b7689e-840c-42ac-9971-11fcc00a32e4 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: f0484f54-9a04-4d53-a922-8aea4041bb75] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:02:48.684722 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-58b7689e-840c-42ac-9971-11fcc00a32e4 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:02:48.685336 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-58b7689e-840c-42ac-9971-11fcc00a32e4 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:02:48.686654 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-58b7689e-840c-42ac-9971-11fcc00a32e4 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:02:48.687874 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-58b7689e-840c-42ac-9971-11fcc00a32e4 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:02:48.688438 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-58b7689e-840c-42ac-9971-11fcc00a32e4 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:02:48.688896 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-58b7689e-840c-42ac-9971-11fcc00a32e4 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:02:48.834343 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-58b7689e-840c-42ac-9971-11fcc00a32e4 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:02:48.843055 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-58b7689e-840c-42ac-9971-11fcc00a32e4 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75" status: 200 len: 1339 microversion: 2.1 time: 0.174505 Oct 19 04:02:48.843636 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3643/7020] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:02:48 2022] GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75 => generated 1339 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:02:49.866636 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-fcbac6e3-630c-4615-a885-c7468ca21157 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:02:49.867414 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-fcbac6e3-630c-4615-a885-c7468ca21157 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: f0484f54-9a04-4d53-a922-8aea4041bb75] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:02:49.875909 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fcbac6e3-630c-4615-a885-c7468ca21157 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:02:49.876418 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fcbac6e3-630c-4615-a885-c7468ca21157 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:02:49.876878 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fcbac6e3-630c-4615-a885-c7468ca21157 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:02:49.877658 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fcbac6e3-630c-4615-a885-c7468ca21157 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:02:49.878337 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fcbac6e3-630c-4615-a885-c7468ca21157 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:02:49.878789 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fcbac6e3-630c-4615-a885-c7468ca21157 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:02:50.080682 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-fcbac6e3-630c-4615-a885-c7468ca21157 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:02:50.089383 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-fcbac6e3-630c-4615-a885-c7468ca21157 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75" status: 200 len: 1339 microversion: 2.1 time: 0.226927 Oct 19 04:02:50.090001 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3644/7021] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:02:49 2022] GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75 => generated 1339 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:02:51.112853 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-070be066-f461-4ff8-8362-34646288ad97 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:02:51.113799 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-070be066-f461-4ff8-8362-34646288ad97 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: f0484f54-9a04-4d53-a922-8aea4041bb75] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:02:51.118400 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=50 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:02:51.124478 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-070be066-f461-4ff8-8362-34646288ad97 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:02:51.125250 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-070be066-f461-4ff8-8362-34646288ad97 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:02:51.126658 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-070be066-f461-4ff8-8362-34646288ad97 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:02:51.126995 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-070be066-f461-4ff8-8362-34646288ad97 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:02:51.127570 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-070be066-f461-4ff8-8362-34646288ad97 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:02:51.128064 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-070be066-f461-4ff8-8362-34646288ad97 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:02:51.147780 n-d-861333-8 devstack@n-api.service[121135]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 04:02:51.150091 n-d-861333-8 devstack@n-api.service[121135]: Wed Oct 19 04:02:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.52) !!! Oct 19 04:02:51.152187 n-d-861333-8 devstack@n-api.service[121135]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 04:02:51.152319 n-d-861333-8 devstack@n-api.service[121135]: Wed Oct 19 04:02:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.52) !!! Oct 19 04:02:51.410025 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-070be066-f461-4ff8-8362-34646288ad97 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:02:51.428298 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-070be066-f461-4ff8-8362-34646288ad97 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75" status: 200 len: 1339 microversion: 2.1 time: 0.319279 Oct 19 04:02:51.429134 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3645/7022] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:02:51 2022] GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75 => generated 1339 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:02:52.453230 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1bf19381-b497-4a7c-b0d1-972f6c12eefc tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:02:52.454072 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1bf19381-b497-4a7c-b0d1-972f6c12eefc tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: f0484f54-9a04-4d53-a922-8aea4041bb75] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:02:52.461041 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1bf19381-b497-4a7c-b0d1-972f6c12eefc tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:02:52.461612 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1bf19381-b497-4a7c-b0d1-972f6c12eefc tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:02:52.462066 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1bf19381-b497-4a7c-b0d1-972f6c12eefc tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:02:52.462788 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1bf19381-b497-4a7c-b0d1-972f6c12eefc tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:02:52.463503 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1bf19381-b497-4a7c-b0d1-972f6c12eefc tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:02:52.464170 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1bf19381-b497-4a7c-b0d1-972f6c12eefc tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:02:52.625002 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-1bf19381-b497-4a7c-b0d1-972f6c12eefc tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:02:52.633714 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1bf19381-b497-4a7c-b0d1-972f6c12eefc tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75" status: 200 len: 1339 microversion: 2.1 time: 0.185104 Oct 19 04:02:52.634347 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3646/7023] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:02:52 2022] GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75 => generated 1339 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:02:53.659302 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8024fdaf-43c7-4feb-8efc-ecd7ba18f319 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:02:53.672404 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8024fdaf-43c7-4feb-8efc-ecd7ba18f319 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: f0484f54-9a04-4d53-a922-8aea4041bb75] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:02:53.672404 n-d-861333-8 devstack@n-api.service[121134]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 04:02:53.672404 n-d-861333-8 devstack@n-api.service[121134]: Wed Oct 19 04:02:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75 (ip 10.222.0.52) !!! Oct 19 04:02:53.684340 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8024fdaf-43c7-4feb-8efc-ecd7ba18f319 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:02:53.685074 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8024fdaf-43c7-4feb-8efc-ecd7ba18f319 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:02:53.688273 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8024fdaf-43c7-4feb-8efc-ecd7ba18f319 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:02:53.690417 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8024fdaf-43c7-4feb-8efc-ecd7ba18f319 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:02:53.691365 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8024fdaf-43c7-4feb-8efc-ecd7ba18f319 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:02:53.692144 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8024fdaf-43c7-4feb-8efc-ecd7ba18f319 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:02:53.700909 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=100 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:02:53.870802 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8024fdaf-43c7-4feb-8efc-ecd7ba18f319 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:02:53.881726 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8024fdaf-43c7-4feb-8efc-ecd7ba18f319 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75" status: 200 len: 1339 microversion: 2.1 time: 0.227325 Oct 19 04:02:53.886485 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3647/7024] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:02:53 2022] GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75 => generated 1339 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:02:54.907250 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-02e8a250-13f0-4eba-9277-6dc38aa06556 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:02:54.907886 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-02e8a250-13f0-4eba-9277-6dc38aa06556 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: f0484f54-9a04-4d53-a922-8aea4041bb75] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:02:54.915917 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-02e8a250-13f0-4eba-9277-6dc38aa06556 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:02:54.919763 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-02e8a250-13f0-4eba-9277-6dc38aa06556 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:02:54.919763 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-02e8a250-13f0-4eba-9277-6dc38aa06556 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:02:54.919763 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-02e8a250-13f0-4eba-9277-6dc38aa06556 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:02:54.919763 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-02e8a250-13f0-4eba-9277-6dc38aa06556 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:02:54.919763 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-02e8a250-13f0-4eba-9277-6dc38aa06556 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:02:55.240689 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-02e8a250-13f0-4eba-9277-6dc38aa06556 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:02:55.249963 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-02e8a250-13f0-4eba-9277-6dc38aa06556 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75" status: 200 len: 1339 microversion: 2.1 time: 0.348505 Oct 19 04:02:55.250589 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3648/7025] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:02:54 2022] GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75 => generated 1339 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:02:56.273359 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-cf77f165-05f7-469a-8a8e-1934d249dc4c tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:02:56.274064 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-cf77f165-05f7-469a-8a8e-1934d249dc4c tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: f0484f54-9a04-4d53-a922-8aea4041bb75] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:02:56.280827 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cf77f165-05f7-469a-8a8e-1934d249dc4c tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:02:56.281298 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cf77f165-05f7-469a-8a8e-1934d249dc4c tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:02:56.281787 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cf77f165-05f7-469a-8a8e-1934d249dc4c tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:02:56.282509 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cf77f165-05f7-469a-8a8e-1934d249dc4c tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:02:56.282982 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cf77f165-05f7-469a-8a8e-1934d249dc4c tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:02:56.283430 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cf77f165-05f7-469a-8a8e-1934d249dc4c tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:02:56.449450 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-cf77f165-05f7-469a-8a8e-1934d249dc4c tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:02:56.449450 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-cf77f165-05f7-469a-8a8e-1934d249dc4c tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75" status: 200 len: 1339 microversion: 2.1 time: 0.177647 Oct 19 04:02:56.459263 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3649/7026] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:02:56 2022] GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75 => generated 1339 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:02:57.474942 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a56ca217-4a5e-4421-aeaf-28faeaac26a5 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:02:57.475564 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a56ca217-4a5e-4421-aeaf-28faeaac26a5 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: f0484f54-9a04-4d53-a922-8aea4041bb75] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:02:57.483329 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a56ca217-4a5e-4421-aeaf-28faeaac26a5 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:02:57.484049 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a56ca217-4a5e-4421-aeaf-28faeaac26a5 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:02:57.484515 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a56ca217-4a5e-4421-aeaf-28faeaac26a5 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:02:57.485241 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a56ca217-4a5e-4421-aeaf-28faeaac26a5 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:02:57.485828 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a56ca217-4a5e-4421-aeaf-28faeaac26a5 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:02:57.486282 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a56ca217-4a5e-4421-aeaf-28faeaac26a5 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:02:57.640342 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a56ca217-4a5e-4421-aeaf-28faeaac26a5 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:02:57.651826 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a56ca217-4a5e-4421-aeaf-28faeaac26a5 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75" status: 200 len: 1339 microversion: 2.1 time: 0.180094 Oct 19 04:02:57.661805 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3650/7027] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:02:57 2022] GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75 => generated 1339 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:02:58.674891 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0563c4dc-47a9-4409-9d18-8768b470d5e9 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:02:58.675734 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0563c4dc-47a9-4409-9d18-8768b470d5e9 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: f0484f54-9a04-4d53-a922-8aea4041bb75] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:02:58.682840 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0563c4dc-47a9-4409-9d18-8768b470d5e9 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:02:58.683351 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0563c4dc-47a9-4409-9d18-8768b470d5e9 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:02:58.683822 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0563c4dc-47a9-4409-9d18-8768b470d5e9 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:02:58.684575 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0563c4dc-47a9-4409-9d18-8768b470d5e9 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:02:58.685053 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0563c4dc-47a9-4409-9d18-8768b470d5e9 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:02:58.685532 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0563c4dc-47a9-4409-9d18-8768b470d5e9 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:02:58.827101 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0563c4dc-47a9-4409-9d18-8768b470d5e9 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:02:58.836736 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0563c4dc-47a9-4409-9d18-8768b470d5e9 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75" status: 200 len: 1339 microversion: 2.1 time: 0.165828 Oct 19 04:02:58.837863 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3651/7028] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:02:58 2022] GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75 => generated 1339 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:02:59.861310 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e9cd9c53-bf73-4a63-922d-b47900b2389d tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:02:59.861966 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e9cd9c53-bf73-4a63-922d-b47900b2389d tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: f0484f54-9a04-4d53-a922-8aea4041bb75] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:02:59.871152 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e9cd9c53-bf73-4a63-922d-b47900b2389d tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:02:59.871955 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e9cd9c53-bf73-4a63-922d-b47900b2389d tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:02:59.872684 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e9cd9c53-bf73-4a63-922d-b47900b2389d tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:02:59.873688 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e9cd9c53-bf73-4a63-922d-b47900b2389d tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:02:59.874360 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e9cd9c53-bf73-4a63-922d-b47900b2389d tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:02:59.875001 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e9cd9c53-bf73-4a63-922d-b47900b2389d tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:03:00.054987 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e9cd9c53-bf73-4a63-922d-b47900b2389d tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:03:00.063548 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e9cd9c53-bf73-4a63-922d-b47900b2389d tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75" status: 200 len: 1339 microversion: 2.1 time: 0.206747 Oct 19 04:03:00.064153 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3652/7029] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:02:59 2022] GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75 => generated 1339 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:03:01.088158 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8e1207d5-2c63-4825-b3dc-78b6618a9f4f tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:03:01.089029 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8e1207d5-2c63-4825-b3dc-78b6618a9f4f tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: f0484f54-9a04-4d53-a922-8aea4041bb75] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:03:01.099738 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8e1207d5-2c63-4825-b3dc-78b6618a9f4f tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:03:01.102506 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8e1207d5-2c63-4825-b3dc-78b6618a9f4f tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:03:01.102506 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8e1207d5-2c63-4825-b3dc-78b6618a9f4f tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:03:01.102506 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8e1207d5-2c63-4825-b3dc-78b6618a9f4f tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:03:01.102506 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8e1207d5-2c63-4825-b3dc-78b6618a9f4f tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:03:01.102506 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8e1207d5-2c63-4825-b3dc-78b6618a9f4f tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:03:01.298817 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8e1207d5-2c63-4825-b3dc-78b6618a9f4f tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:03:01.307826 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8e1207d5-2c63-4825-b3dc-78b6618a9f4f tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75" status: 200 len: 1339 microversion: 2.1 time: 0.224707 Oct 19 04:03:01.308563 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3653/7030] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:03:01 2022] GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75 => generated 1339 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:03:02.332761 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5d07a7d7-c0f0-40a3-8a95-9fb0bf3dac6a tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:03:02.334184 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5d07a7d7-c0f0-40a3-8a95-9fb0bf3dac6a tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: f0484f54-9a04-4d53-a922-8aea4041bb75] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:03:02.341754 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5d07a7d7-c0f0-40a3-8a95-9fb0bf3dac6a tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:03:02.343726 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5d07a7d7-c0f0-40a3-8a95-9fb0bf3dac6a tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:03:02.343726 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5d07a7d7-c0f0-40a3-8a95-9fb0bf3dac6a tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:03:02.344567 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5d07a7d7-c0f0-40a3-8a95-9fb0bf3dac6a tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:03:02.345156 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5d07a7d7-c0f0-40a3-8a95-9fb0bf3dac6a tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:03:02.345714 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5d07a7d7-c0f0-40a3-8a95-9fb0bf3dac6a tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:03:02.562189 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5d07a7d7-c0f0-40a3-8a95-9fb0bf3dac6a tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:03:02.579957 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5d07a7d7-c0f0-40a3-8a95-9fb0bf3dac6a tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75" status: 200 len: 1339 microversion: 2.1 time: 0.242189 Oct 19 04:03:02.579957 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3654/7031] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:03:02 2022] GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75 => generated 1339 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:03:03.595032 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7ce80434-3fbc-494a-840d-eb35f22f656b tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:03:03.600200 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7ce80434-3fbc-494a-840d-eb35f22f656b tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: f0484f54-9a04-4d53-a922-8aea4041bb75] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:03:03.607771 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7ce80434-3fbc-494a-840d-eb35f22f656b tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:03:03.608734 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7ce80434-3fbc-494a-840d-eb35f22f656b tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:03:03.609291 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7ce80434-3fbc-494a-840d-eb35f22f656b tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:03:03.610151 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7ce80434-3fbc-494a-840d-eb35f22f656b tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:03:03.610744 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7ce80434-3fbc-494a-840d-eb35f22f656b tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:03:03.611295 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7ce80434-3fbc-494a-840d-eb35f22f656b tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:03:03.766482 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-7ce80434-3fbc-494a-840d-eb35f22f656b tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:03:03.775263 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7ce80434-3fbc-494a-840d-eb35f22f656b tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75" status: 200 len: 1339 microversion: 2.1 time: 0.184344 Oct 19 04:03:03.775920 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3655/7032] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:03:03 2022] GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75 => generated 1339 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:03:04.800802 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-fc2aef76-9f85-44ac-a403-189f11c07432 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:03:04.801557 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-fc2aef76-9f85-44ac-a403-189f11c07432 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: f0484f54-9a04-4d53-a922-8aea4041bb75] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:03:04.808916 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fc2aef76-9f85-44ac-a403-189f11c07432 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:03:04.809459 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fc2aef76-9f85-44ac-a403-189f11c07432 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:03:04.809925 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fc2aef76-9f85-44ac-a403-189f11c07432 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:03:04.810773 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fc2aef76-9f85-44ac-a403-189f11c07432 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:03:04.811479 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fc2aef76-9f85-44ac-a403-189f11c07432 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:03:04.811935 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fc2aef76-9f85-44ac-a403-189f11c07432 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:03:04.958429 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-fc2aef76-9f85-44ac-a403-189f11c07432 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:03:04.967615 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-fc2aef76-9f85-44ac-a403-189f11c07432 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75" status: 200 len: 1339 microversion: 2.1 time: 0.170238 Oct 19 04:03:04.968214 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3656/7033] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:03:04 2022] GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75 => generated 1339 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:03:05.991803 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5948c3ce-cc9f-4cac-8199-ec0c2a95d5fd tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:03:05.993730 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5948c3ce-cc9f-4cac-8199-ec0c2a95d5fd tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: f0484f54-9a04-4d53-a922-8aea4041bb75] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:03:06.003147 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5948c3ce-cc9f-4cac-8199-ec0c2a95d5fd tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:03:06.003907 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5948c3ce-cc9f-4cac-8199-ec0c2a95d5fd tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:03:06.004544 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5948c3ce-cc9f-4cac-8199-ec0c2a95d5fd tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:03:06.005485 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5948c3ce-cc9f-4cac-8199-ec0c2a95d5fd tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:03:06.006137 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5948c3ce-cc9f-4cac-8199-ec0c2a95d5fd tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:03:06.006763 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5948c3ce-cc9f-4cac-8199-ec0c2a95d5fd tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:03:06.171276 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5948c3ce-cc9f-4cac-8199-ec0c2a95d5fd tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:03:06.192324 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5948c3ce-cc9f-4cac-8199-ec0c2a95d5fd tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75" status: 200 len: 1339 microversion: 2.1 time: 0.204759 Oct 19 04:03:06.193567 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3657/7034] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:03:05 2022] GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75 => generated 1339 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:03:07.219966 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-34b80eff-1bcd-44a4-8907-76c87e8d75c6 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:03:07.221540 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-34b80eff-1bcd-44a4-8907-76c87e8d75c6 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: f0484f54-9a04-4d53-a922-8aea4041bb75] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:03:07.236774 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-34b80eff-1bcd-44a4-8907-76c87e8d75c6 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:03:07.237393 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-34b80eff-1bcd-44a4-8907-76c87e8d75c6 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:03:07.238101 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-34b80eff-1bcd-44a4-8907-76c87e8d75c6 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:03:07.240515 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-34b80eff-1bcd-44a4-8907-76c87e8d75c6 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:03:07.241484 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-34b80eff-1bcd-44a4-8907-76c87e8d75c6 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:03:07.242003 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-34b80eff-1bcd-44a4-8907-76c87e8d75c6 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:03:07.458315 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-34b80eff-1bcd-44a4-8907-76c87e8d75c6 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:03:07.468277 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-34b80eff-1bcd-44a4-8907-76c87e8d75c6 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75" status: 200 len: 1339 microversion: 2.1 time: 0.254948 Oct 19 04:03:07.469836 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3658/7035] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:03:07 2022] GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75 => generated 1339 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:03:08.497989 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4ab723fd-bd8b-4981-958b-5cb2b0757226 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:03:08.498684 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4ab723fd-bd8b-4981-958b-5cb2b0757226 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: f0484f54-9a04-4d53-a922-8aea4041bb75] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:03:08.506174 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4ab723fd-bd8b-4981-958b-5cb2b0757226 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:03:08.506792 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4ab723fd-bd8b-4981-958b-5cb2b0757226 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:03:08.507339 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4ab723fd-bd8b-4981-958b-5cb2b0757226 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:03:08.508156 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4ab723fd-bd8b-4981-958b-5cb2b0757226 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:03:08.508709 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4ab723fd-bd8b-4981-958b-5cb2b0757226 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:03:08.509603 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4ab723fd-bd8b-4981-958b-5cb2b0757226 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:03:08.719174 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-4ab723fd-bd8b-4981-958b-5cb2b0757226 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:03:08.734725 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4ab723fd-bd8b-4981-958b-5cb2b0757226 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75" status: 200 len: 1339 microversion: 2.1 time: 0.240512 Oct 19 04:03:08.737456 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3659/7036] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:03:08 2022] GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75 => generated 1339 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:03:09.761250 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e4d7c8de-c4e8-4363-b541-4e50ef45398e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:03:09.761908 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e4d7c8de-c4e8-4363-b541-4e50ef45398e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: f0484f54-9a04-4d53-a922-8aea4041bb75] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:03:09.771153 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e4d7c8de-c4e8-4363-b541-4e50ef45398e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:03:09.771664 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e4d7c8de-c4e8-4363-b541-4e50ef45398e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:03:09.772125 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e4d7c8de-c4e8-4363-b541-4e50ef45398e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:03:09.776165 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e4d7c8de-c4e8-4363-b541-4e50ef45398e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:03:09.776796 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e4d7c8de-c4e8-4363-b541-4e50ef45398e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:03:09.777473 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e4d7c8de-c4e8-4363-b541-4e50ef45398e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:03:10.026138 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e4d7c8de-c4e8-4363-b541-4e50ef45398e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:03:10.034453 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e4d7c8de-c4e8-4363-b541-4e50ef45398e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75" status: 200 len: 1385 microversion: 2.1 time: 0.277633 Oct 19 04:03:10.035040 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3660/7037] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:03:09 2022] GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75 => generated 1385 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:03:11.058410 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ac0e53c1-a0d2-4ff8-8520-0b920877f7de tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:03:11.061749 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ac0e53c1-a0d2-4ff8-8520-0b920877f7de tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: f0484f54-9a04-4d53-a922-8aea4041bb75] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:03:11.068811 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ac0e53c1-a0d2-4ff8-8520-0b920877f7de tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:03:11.069684 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ac0e53c1-a0d2-4ff8-8520-0b920877f7de tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:03:11.070321 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ac0e53c1-a0d2-4ff8-8520-0b920877f7de tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:03:11.071908 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ac0e53c1-a0d2-4ff8-8520-0b920877f7de tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:03:11.072746 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ac0e53c1-a0d2-4ff8-8520-0b920877f7de tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:03:11.073131 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ac0e53c1-a0d2-4ff8-8520-0b920877f7de tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:03:11.251400 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ac0e53c1-a0d2-4ff8-8520-0b920877f7de tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:03:11.260773 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ac0e53c1-a0d2-4ff8-8520-0b920877f7de tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75" status: 200 len: 1373 microversion: 2.1 time: 0.206174 Oct 19 04:03:11.261952 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3661/7038] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:03:11 2022] GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75 => generated 1373 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:03:12.292014 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b1120200-1a18-4f29-92da-85cfc3b0d594 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:03:12.292983 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b1120200-1a18-4f29-92da-85cfc3b0d594 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: f0484f54-9a04-4d53-a922-8aea4041bb75] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:03:12.301206 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b1120200-1a18-4f29-92da-85cfc3b0d594 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:03:12.302716 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b1120200-1a18-4f29-92da-85cfc3b0d594 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:03:12.303276 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b1120200-1a18-4f29-92da-85cfc3b0d594 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:03:12.304200 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b1120200-1a18-4f29-92da-85cfc3b0d594 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:03:12.304778 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b1120200-1a18-4f29-92da-85cfc3b0d594 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:03:12.305338 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b1120200-1a18-4f29-92da-85cfc3b0d594 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:03:12.476741 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b1120200-1a18-4f29-92da-85cfc3b0d594 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:03:12.491200 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b1120200-1a18-4f29-92da-85cfc3b0d594 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75" status: 200 len: 1373 microversion: 2.1 time: 0.204186 Oct 19 04:03:12.491988 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3662/7039] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:03:12 2022] GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75 => generated 1373 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:03:13.513978 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-09d03184-1945-4ce4-9508-462b7e5a0dae tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:03:13.514640 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-09d03184-1945-4ce4-9508-462b7e5a0dae tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: f0484f54-9a04-4d53-a922-8aea4041bb75] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:03:13.521926 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-09d03184-1945-4ce4-9508-462b7e5a0dae tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:03:13.523708 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-09d03184-1945-4ce4-9508-462b7e5a0dae tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:03:13.523708 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-09d03184-1945-4ce4-9508-462b7e5a0dae tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:03:13.523948 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-09d03184-1945-4ce4-9508-462b7e5a0dae tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:03:13.524390 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-09d03184-1945-4ce4-9508-462b7e5a0dae tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:03:13.525034 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-09d03184-1945-4ce4-9508-462b7e5a0dae tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:03:13.678057 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-09d03184-1945-4ce4-9508-462b7e5a0dae tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:03:13.680918 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=100 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:03:13.687810 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-09d03184-1945-4ce4-9508-462b7e5a0dae tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75" status: 200 len: 1373 microversion: 2.1 time: 0.177712 Oct 19 04:03:13.688405 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3663/7040] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:03:13 2022] GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75 => generated 1373 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:03:14.714925 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-89b568b7-87ae-41bd-adb3-947bcc2b5139 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:03:14.715690 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-89b568b7-87ae-41bd-adb3-947bcc2b5139 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: f0484f54-9a04-4d53-a922-8aea4041bb75] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:03:14.723560 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-89b568b7-87ae-41bd-adb3-947bcc2b5139 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:03:14.724113 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-89b568b7-87ae-41bd-adb3-947bcc2b5139 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:03:14.724563 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-89b568b7-87ae-41bd-adb3-947bcc2b5139 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:03:14.725277 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-89b568b7-87ae-41bd-adb3-947bcc2b5139 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:03:14.725907 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-89b568b7-87ae-41bd-adb3-947bcc2b5139 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:03:14.726559 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-89b568b7-87ae-41bd-adb3-947bcc2b5139 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:03:14.867968 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-89b568b7-87ae-41bd-adb3-947bcc2b5139 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:03:14.877235 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-89b568b7-87ae-41bd-adb3-947bcc2b5139 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75" status: 200 len: 1373 microversion: 2.1 time: 0.167827 Oct 19 04:03:14.877856 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3664/7041] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:03:14 2022] GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75 => generated 1373 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:03:15.902540 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b502f0f3-2fca-47d1-bb26-463b156183e5 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:03:15.904766 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b502f0f3-2fca-47d1-bb26-463b156183e5 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: f0484f54-9a04-4d53-a922-8aea4041bb75] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:03:15.912899 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b502f0f3-2fca-47d1-bb26-463b156183e5 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:03:15.913864 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b502f0f3-2fca-47d1-bb26-463b156183e5 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:03:15.914437 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b502f0f3-2fca-47d1-bb26-463b156183e5 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:03:15.915527 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b502f0f3-2fca-47d1-bb26-463b156183e5 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:03:15.916231 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b502f0f3-2fca-47d1-bb26-463b156183e5 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:03:15.916876 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b502f0f3-2fca-47d1-bb26-463b156183e5 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:03:16.431991 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b502f0f3-2fca-47d1-bb26-463b156183e5 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:03:16.441694 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b502f0f3-2fca-47d1-bb26-463b156183e5 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75" status: 200 len: 1373 microversion: 2.1 time: 0.545050 Oct 19 04:03:16.442366 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3665/7042] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:03:15 2022] GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75 => generated 1373 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:03:17.465998 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ccda800d-e68b-457a-8b83-9dd553cda664 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:03:17.466724 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ccda800d-e68b-457a-8b83-9dd553cda664 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: f0484f54-9a04-4d53-a922-8aea4041bb75] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:03:17.476817 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ccda800d-e68b-457a-8b83-9dd553cda664 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:03:17.476817 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ccda800d-e68b-457a-8b83-9dd553cda664 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:03:17.476817 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ccda800d-e68b-457a-8b83-9dd553cda664 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:03:17.477679 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ccda800d-e68b-457a-8b83-9dd553cda664 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:03:17.478319 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ccda800d-e68b-457a-8b83-9dd553cda664 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:03:17.478919 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ccda800d-e68b-457a-8b83-9dd553cda664 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:03:17.698518 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ccda800d-e68b-457a-8b83-9dd553cda664 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:03:17.704033 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ccda800d-e68b-457a-8b83-9dd553cda664 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75" status: 200 len: 1373 microversion: 2.1 time: 0.240320 Oct 19 04:03:17.704638 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3666/7043] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:03:17 2022] GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75 => generated 1373 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:03:18.726257 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4d7e3028-80f1-44b3-a85e-afdc0d8c4f4a tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:03:18.727114 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4d7e3028-80f1-44b3-a85e-afdc0d8c4f4a tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: f0484f54-9a04-4d53-a922-8aea4041bb75] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:03:18.734882 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4d7e3028-80f1-44b3-a85e-afdc0d8c4f4a tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:03:18.735396 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4d7e3028-80f1-44b3-a85e-afdc0d8c4f4a tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:03:18.735867 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4d7e3028-80f1-44b3-a85e-afdc0d8c4f4a tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:03:18.736599 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4d7e3028-80f1-44b3-a85e-afdc0d8c4f4a tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:03:18.737076 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4d7e3028-80f1-44b3-a85e-afdc0d8c4f4a tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:03:18.737552 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4d7e3028-80f1-44b3-a85e-afdc0d8c4f4a tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:03:18.934339 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-4d7e3028-80f1-44b3-a85e-afdc0d8c4f4a tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:03:18.946108 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4d7e3028-80f1-44b3-a85e-afdc0d8c4f4a tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75" status: 200 len: 1373 microversion: 2.1 time: 0.223850 Oct 19 04:03:18.946801 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3667/7044] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:03:18 2022] GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75 => generated 1373 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:03:19.970695 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5369c7b2-719c-413f-b9b6-c470dc4e3761 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:03:19.971340 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5369c7b2-719c-413f-b9b6-c470dc4e3761 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: f0484f54-9a04-4d53-a922-8aea4041bb75] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:03:19.978998 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5369c7b2-719c-413f-b9b6-c470dc4e3761 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:03:19.979517 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5369c7b2-719c-413f-b9b6-c470dc4e3761 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:03:19.979984 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5369c7b2-719c-413f-b9b6-c470dc4e3761 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:03:19.980723 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5369c7b2-719c-413f-b9b6-c470dc4e3761 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:03:19.981202 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5369c7b2-719c-413f-b9b6-c470dc4e3761 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:03:19.982235 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5369c7b2-719c-413f-b9b6-c470dc4e3761 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:03:20.137559 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5369c7b2-719c-413f-b9b6-c470dc4e3761 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:03:20.146228 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5369c7b2-719c-413f-b9b6-c470dc4e3761 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75" status: 200 len: 1373 microversion: 2.1 time: 0.179792 Oct 19 04:03:20.146809 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3668/7045] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:03:19 2022] GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75 => generated 1373 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:03:20.700298 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-b0111f6b-91a2-4d31-9251-12d647e26e10 req-e56566cb-dbb9-4ea4-9fb3-39dff4153c17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0484f54-9a04-4d53-a922-8aea4041bb75", "name": "network-vif-plugged", "status": "completed", "tag": "84bf5e46-8aa1-4094-9a68-4dc8b4aaefe9"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:03:20.710309 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-b0111f6b-91a2-4d31-9251-12d647e26e10 req-e56566cb-dbb9-4ea4-9fb3-39dff4153c17 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:03:20.718806 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-b0111f6b-91a2-4d31-9251-12d647e26e10 req-e56566cb-dbb9-4ea4-9fb3-39dff4153c17 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:03:20.718806 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-b0111f6b-91a2-4d31-9251-12d647e26e10 req-e56566cb-dbb9-4ea4-9fb3-39dff4153c17 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:03:20.722152 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-b0111f6b-91a2-4d31-9251-12d647e26e10 req-e56566cb-dbb9-4ea4-9fb3-39dff4153c17 service nova] Creating event network-vif-plugged:84bf5e46-8aa1-4094-9a68-4dc8b4aaefe9 for instance f0484f54-9a04-4d53-a922-8aea4041bb75 on n-h2-861333-8 Oct 19 04:03:20.727190 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-b0111f6b-91a2-4d31-9251-12d647e26e10 req-e56566cb-dbb9-4ea4-9fb3-39dff4153c17 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030594 Oct 19 04:03:20.727805 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3669/7046] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:03:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 04:03:21.173138 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3936bda0-487d-4bed-8e66-d83d6ee4f7eb tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:03:21.173983 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3936bda0-487d-4bed-8e66-d83d6ee4f7eb tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: f0484f54-9a04-4d53-a922-8aea4041bb75] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:03:21.188778 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3936bda0-487d-4bed-8e66-d83d6ee4f7eb tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:03:21.188778 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3936bda0-487d-4bed-8e66-d83d6ee4f7eb tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:03:21.188778 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3936bda0-487d-4bed-8e66-d83d6ee4f7eb tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:03:21.188778 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3936bda0-487d-4bed-8e66-d83d6ee4f7eb tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:03:21.188778 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3936bda0-487d-4bed-8e66-d83d6ee4f7eb tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:03:21.188778 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3936bda0-487d-4bed-8e66-d83d6ee4f7eb tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:03:21.334460 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-3936bda0-487d-4bed-8e66-d83d6ee4f7eb tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:03:21.342710 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3936bda0-487d-4bed-8e66-d83d6ee4f7eb tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75" status: 200 len: 1373 microversion: 2.1 time: 0.175949 Oct 19 04:03:21.343434 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3670/7047] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:03:21 2022] GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75 => generated 1373 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:03:22.366809 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-74229b32-ab69-43db-a7eb-50a13ab75100 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:03:22.367482 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-74229b32-ab69-43db-a7eb-50a13ab75100 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: f0484f54-9a04-4d53-a922-8aea4041bb75] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:03:22.370327 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=52 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:03:22.379544 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-74229b32-ab69-43db-a7eb-50a13ab75100 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:03:22.385296 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-74229b32-ab69-43db-a7eb-50a13ab75100 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:03:22.385296 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-74229b32-ab69-43db-a7eb-50a13ab75100 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:03:22.385296 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-74229b32-ab69-43db-a7eb-50a13ab75100 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:03:22.385296 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-74229b32-ab69-43db-a7eb-50a13ab75100 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:03:22.385296 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-74229b32-ab69-43db-a7eb-50a13ab75100 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:03:22.522964 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-74229b32-ab69-43db-a7eb-50a13ab75100 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:03:22.531950 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-74229b32-ab69-43db-a7eb-50a13ab75100 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75" status: 200 len: 1560 microversion: 2.1 time: 0.169191 Oct 19 04:03:22.532527 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3671/7048] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:03:22 2022] GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75 => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:03:22.554762 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6a851d69-7db3-4be4-9023-e61bff9eed50 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:03:22.555413 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6a851d69-7db3-4be4-9023-e61bff9eed50 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: f0484f54-9a04-4d53-a922-8aea4041bb75] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:03:22.561247 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6a851d69-7db3-4be4-9023-e61bff9eed50 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:03:22.563546 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6a851d69-7db3-4be4-9023-e61bff9eed50 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:03:22.563546 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6a851d69-7db3-4be4-9023-e61bff9eed50 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:03:22.563546 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6a851d69-7db3-4be4-9023-e61bff9eed50 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:03:22.563546 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6a851d69-7db3-4be4-9023-e61bff9eed50 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:03:22.564279 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6a851d69-7db3-4be4-9023-e61bff9eed50 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:03:22.699083 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-6a851d69-7db3-4be4-9023-e61bff9eed50 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:03:22.707570 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6a851d69-7db3-4be4-9023-e61bff9eed50 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75" status: 200 len: 1560 microversion: 2.1 time: 0.156800 Oct 19 04:03:22.712485 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3672/7049] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:03:22 2022] GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:03:22.789878 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6aa53759-1fa7-4394-b0b0-9693e83328e3 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:03:22.790400 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6aa53759-1fa7-4394-b0b0-9693e83328e3 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: f0484f54-9a04-4d53-a922-8aea4041bb75] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:03:22.798556 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6aa53759-1fa7-4394-b0b0-9693e83328e3 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:03:22.799399 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6aa53759-1fa7-4394-b0b0-9693e83328e3 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:03:22.800176 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6aa53759-1fa7-4394-b0b0-9693e83328e3 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:03:22.801440 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6aa53759-1fa7-4394-b0b0-9693e83328e3 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:03:22.802245 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6aa53759-1fa7-4394-b0b0-9693e83328e3 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:03:22.802998 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6aa53759-1fa7-4394-b0b0-9693e83328e3 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:03:22.831964 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6aa53759-1fa7-4394-b0b0-9693e83328e3 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: f0484f54-9a04-4d53-a922-8aea4041bb75] Going to try to terminate instance {{(pid=121134) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 04:03:23.121392 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6aa53759-1fa7-4394-b0b0-9693e83328e3 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "DELETE /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75" status: 204 len: 0 microversion: 2.1 time: 0.334992 Oct 19 04:03:23.122002 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3673/7050] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 04:03:22 2022] DELETE /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 19 04:03:23.132869 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8c76d5d6-7946-48c0-8f63-5161257c9d7b tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:03:23.133629 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8c76d5d6-7946-48c0-8f63-5161257c9d7b tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: f0484f54-9a04-4d53-a922-8aea4041bb75] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:03:23.140366 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8c76d5d6-7946-48c0-8f63-5161257c9d7b tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:03:23.140912 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8c76d5d6-7946-48c0-8f63-5161257c9d7b tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:03:23.141400 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8c76d5d6-7946-48c0-8f63-5161257c9d7b tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:03:23.142257 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8c76d5d6-7946-48c0-8f63-5161257c9d7b tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:03:23.142734 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8c76d5d6-7946-48c0-8f63-5161257c9d7b tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:03:23.143185 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8c76d5d6-7946-48c0-8f63-5161257c9d7b tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:03:23.286642 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8c76d5d6-7946-48c0-8f63-5161257c9d7b tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:03:23.295183 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8c76d5d6-7946-48c0-8f63-5161257c9d7b tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75" status: 200 len: 1566 microversion: 2.1 time: 0.167204 Oct 19 04:03:23.295777 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3674/7051] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:03:23 2022] GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75 => generated 1566 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:03:24.501339 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f97a3f86-65b8-4fae-a078-8d128bebb217 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:03:24.502011 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f97a3f86-65b8-4fae-a078-8d128bebb217 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: f0484f54-9a04-4d53-a922-8aea4041bb75] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:03:24.508400 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f97a3f86-65b8-4fae-a078-8d128bebb217 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:03:24.509060 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f97a3f86-65b8-4fae-a078-8d128bebb217 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:03:24.509546 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f97a3f86-65b8-4fae-a078-8d128bebb217 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:03:24.515760 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f97a3f86-65b8-4fae-a078-8d128bebb217 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:03:24.515760 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f97a3f86-65b8-4fae-a078-8d128bebb217 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:03:24.515760 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f97a3f86-65b8-4fae-a078-8d128bebb217 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:03:24.651098 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-f97a3f86-65b8-4fae-a078-8d128bebb217 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:03:24.660599 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f97a3f86-65b8-4fae-a078-8d128bebb217 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75" status: 200 len: 1566 microversion: 2.1 time: 0.345430 Oct 19 04:03:24.661714 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3675/7052] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:03:24 2022] GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75 => generated 1566 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:03:25.407630 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-bbddda7f-31dc-47e0-90cb-0707bc670b0e req-402e3f6c-a876-4d47-b8c0-f62b4017df85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0484f54-9a04-4d53-a922-8aea4041bb75", "name": "network-vif-deleted", "tag": "84bf5e46-8aa1-4094-9a68-4dc8b4aaefe9"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:03:25.426005 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-bbddda7f-31dc-47e0-90cb-0707bc670b0e req-402e3f6c-a876-4d47-b8c0-f62b4017df85 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:03:25.426005 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-bbddda7f-31dc-47e0-90cb-0707bc670b0e req-402e3f6c-a876-4d47-b8c0-f62b4017df85 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:03:25.426005 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-bbddda7f-31dc-47e0-90cb-0707bc670b0e req-402e3f6c-a876-4d47-b8c0-f62b4017df85 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:03:25.435307 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-bbddda7f-31dc-47e0-90cb-0707bc670b0e req-402e3f6c-a876-4d47-b8c0-f62b4017df85 service nova] Creating event network-vif-deleted:84bf5e46-8aa1-4094-9a68-4dc8b4aaefe9 for instance f0484f54-9a04-4d53-a922-8aea4041bb75 on n-h2-861333-8 Oct 19 04:03:25.442662 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-bbddda7f-31dc-47e0-90cb-0707bc670b0e req-402e3f6c-a876-4d47-b8c0-f62b4017df85 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044455 Oct 19 04:03:25.443287 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3676/7053] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:03:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:03:25.685417 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b4b853f0-6537-45a6-b820-6d84f7f1ba17 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:03:25.686210 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b4b853f0-6537-45a6-b820-6d84f7f1ba17 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: f0484f54-9a04-4d53-a922-8aea4041bb75] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:03:25.693334 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b4b853f0-6537-45a6-b820-6d84f7f1ba17 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:03:25.696984 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b4b853f0-6537-45a6-b820-6d84f7f1ba17 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:03:25.696984 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b4b853f0-6537-45a6-b820-6d84f7f1ba17 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:03:25.696984 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b4b853f0-6537-45a6-b820-6d84f7f1ba17 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:03:25.696984 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b4b853f0-6537-45a6-b820-6d84f7f1ba17 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:03:25.696984 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b4b853f0-6537-45a6-b820-6d84f7f1ba17 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:03:25.766324 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b4b853f0-6537-45a6-b820-6d84f7f1ba17 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:03:25.772390 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b4b853f0-6537-45a6-b820-6d84f7f1ba17 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75" status: 200 len: 1358 microversion: 2.1 time: 0.091911 Oct 19 04:03:25.772960 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3677/7054] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:03:25 2022] GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75 => generated 1358 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:03:26.795811 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f38a8427-37f4-43f8-a4a6-3a4688557e69 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:03:26.796541 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f38a8427-37f4-43f8-a4a6-3a4688557e69 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: f0484f54-9a04-4d53-a922-8aea4041bb75] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:03:26.803728 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f38a8427-37f4-43f8-a4a6-3a4688557e69 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:03:26.804238 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f38a8427-37f4-43f8-a4a6-3a4688557e69 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:03:26.804696 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f38a8427-37f4-43f8-a4a6-3a4688557e69 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:03:26.805442 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f38a8427-37f4-43f8-a4a6-3a4688557e69 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:03:26.805917 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f38a8427-37f4-43f8-a4a6-3a4688557e69 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:03:26.806415 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f38a8427-37f4-43f8-a4a6-3a4688557e69 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:03:26.874102 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-f38a8427-37f4-43f8-a4a6-3a4688557e69 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:03:26.882585 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f38a8427-37f4-43f8-a4a6-3a4688557e69 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75" status: 200 len: 1358 microversion: 2.1 time: 0.090609 Oct 19 04:03:26.883164 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3678/7055] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:03:26 2022] GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75 => generated 1358 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:03:27.906910 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-14cf6d76-d265-449a-80ba-9c44477cc355 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:03:27.907656 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-14cf6d76-d265-449a-80ba-9c44477cc355 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: f0484f54-9a04-4d53-a922-8aea4041bb75] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:03:27.914643 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-14cf6d76-d265-449a-80ba-9c44477cc355 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:03:27.915160 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-14cf6d76-d265-449a-80ba-9c44477cc355 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:03:27.915618 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-14cf6d76-d265-449a-80ba-9c44477cc355 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:03:27.916364 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-14cf6d76-d265-449a-80ba-9c44477cc355 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:03:27.916819 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-14cf6d76-d265-449a-80ba-9c44477cc355 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:03:27.917338 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-14cf6d76-d265-449a-80ba-9c44477cc355 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:03:27.984271 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-14cf6d76-d265-449a-80ba-9c44477cc355 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:03:27.992728 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-14cf6d76-d265-449a-80ba-9c44477cc355 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75" status: 200 len: 1358 microversion: 2.1 time: 0.090056 Oct 19 04:03:27.993461 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3679/7056] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:03:27 2022] GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75 => generated 1358 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:03:29.016392 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-20f49775-d4db-43f7-b0ab-e4cf5db88dee tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:03:29.017120 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-20f49775-d4db-43f7-b0ab-e4cf5db88dee tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: f0484f54-9a04-4d53-a922-8aea4041bb75] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:03:29.024839 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-20f49775-d4db-43f7-b0ab-e4cf5db88dee tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:03:29.025353 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-20f49775-d4db-43f7-b0ab-e4cf5db88dee tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:03:29.025837 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-20f49775-d4db-43f7-b0ab-e4cf5db88dee tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:03:29.026575 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-20f49775-d4db-43f7-b0ab-e4cf5db88dee tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:03:29.027047 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-20f49775-d4db-43f7-b0ab-e4cf5db88dee tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:03:29.027494 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-20f49775-d4db-43f7-b0ab-e4cf5db88dee tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:03:29.030465 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:03:29.104855 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-20f49775-d4db-43f7-b0ab-e4cf5db88dee tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:03:29.113875 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-20f49775-d4db-43f7-b0ab-e4cf5db88dee tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75" status: 200 len: 1358 microversion: 2.1 time: 0.102044 Oct 19 04:03:29.114466 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3680/7057] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:03:29 2022] GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75 => generated 1358 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:03:30.139352 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4b50e97a-46d2-4c51-ade6-b60fb2542b76 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:03:30.139995 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4b50e97a-46d2-4c51-ade6-b60fb2542b76 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: f0484f54-9a04-4d53-a922-8aea4041bb75] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:03:30.148615 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4b50e97a-46d2-4c51-ade6-b60fb2542b76 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:03:30.149603 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4b50e97a-46d2-4c51-ade6-b60fb2542b76 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:03:30.154540 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4b50e97a-46d2-4c51-ade6-b60fb2542b76 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:03:30.154540 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4b50e97a-46d2-4c51-ade6-b60fb2542b76 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:03:30.154540 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4b50e97a-46d2-4c51-ade6-b60fb2542b76 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:03:30.154540 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4b50e97a-46d2-4c51-ade6-b60fb2542b76 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:03:30.236812 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-4b50e97a-46d2-4c51-ade6-b60fb2542b76 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:03:30.244972 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4b50e97a-46d2-4c51-ade6-b60fb2542b76 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75" status: 200 len: 1358 microversion: 2.1 time: 0.110703 Oct 19 04:03:30.245734 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3681/7058] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:03:30 2022] GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75 => generated 1358 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:03:31.269135 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5838062e-b3da-4931-a740-4ba525002649 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:03:31.269877 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5838062e-b3da-4931-a740-4ba525002649 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: f0484f54-9a04-4d53-a922-8aea4041bb75] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:03:31.284277 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5838062e-b3da-4931-a740-4ba525002649 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:03:31.284797 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5838062e-b3da-4931-a740-4ba525002649 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:03:31.286182 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5838062e-b3da-4931-a740-4ba525002649 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:03:31.286182 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5838062e-b3da-4931-a740-4ba525002649 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:03:31.292730 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5838062e-b3da-4931-a740-4ba525002649 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:03:31.293224 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5838062e-b3da-4931-a740-4ba525002649 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:03:31.342921 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5838062e-b3da-4931-a740-4ba525002649 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:03:31.343816 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5838062e-b3da-4931-a740-4ba525002649 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:03:31.344533 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5838062e-b3da-4931-a740-4ba525002649 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:03:31.345240 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-5838062e-b3da-4931-a740-4ba525002649 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lazy-loading 'fault' on Instance uuid f0484f54-9a04-4d53-a922-8aea4041bb75 {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 04:03:31.413845 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5838062e-b3da-4931-a740-4ba525002649 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:03:31.419498 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5838062e-b3da-4931-a740-4ba525002649 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75" status: 200 len: 1363 microversion: 2.1 time: 0.154489 Oct 19 04:03:31.420306 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3682/7059] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:03:31 2022] GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:03:32.445042 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-fe0a7f37-2d10-463c-b176-47194bee10d2 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:03:32.446757 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-fe0a7f37-2d10-463c-b176-47194bee10d2 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: f0484f54-9a04-4d53-a922-8aea4041bb75] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:03:32.456250 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fe0a7f37-2d10-463c-b176-47194bee10d2 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:03:32.457675 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fe0a7f37-2d10-463c-b176-47194bee10d2 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:03:32.457675 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fe0a7f37-2d10-463c-b176-47194bee10d2 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:03:32.458017 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fe0a7f37-2d10-463c-b176-47194bee10d2 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:03:32.458457 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fe0a7f37-2d10-463c-b176-47194bee10d2 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:03:32.458934 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fe0a7f37-2d10-463c-b176-47194bee10d2 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:03:32.475063 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-fe0a7f37-2d10-463c-b176-47194bee10d2 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] HTTP exception thrown: Instance f0484f54-9a04-4d53-a922-8aea4041bb75 could not be found. Oct 19 04:03:32.476764 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-fe0a7f37-2d10-463c-b176-47194bee10d2 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Request method failure captured: Oct 19 04:03:32.476764 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75 HTTP/1.1 Oct 19 04:03:32.476764 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 04:03:32.476764 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 04:03:32.476764 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 04:03:32.476764 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 04:03:32.476764 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 04:03:32.476764 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 04:03:32.476764 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 04:03:32.476764 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 04:03:32.476764 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3XYw5PeFcmVZaG2CxoqLxKroO9lkG-Hw7MzEkzHPy2_aqlf3HPBMKgLOXoQ-WbgkZbvZB1PbShR7FiiZmGSIVTCeQrWw3ytKpP-AuucJQP3lFFYEs8HquAFih6wwJOh2-3eNgmaxbIZUVh9y_A1g_wYecm08YmNoRnAnQnVYIDNRwE Oct 19 04:03:32.476764 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 04:03:32.476764 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 04:03:32.476764 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 04:03:32.476764 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 04:03:32.476764 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 04:03:32.476764 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 04:03:32.476764 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: beff434485604f85985617071a93727c Oct 19 04:03:32.476764 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-TestVolumeBootPattern-954873624 Oct 19 04:03:32.476764 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 04:03:32.476764 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 04:03:32.476764 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/beff434485604f85985617071a93727c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/beff434485604f85985617071a93727c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/beff434485604f85985617071a93727c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_beff434485604f85985617071a93727c", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 04:03:32.476764 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-TestVolumeBootPattern-954873624 Oct 19 04:03:32.476764 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: beff434485604f85985617071a93727c Oct 19 04:03:32.476764 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-TestVolumeBootPattern-954873624 Oct 19 04:03:32.476764 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-TestVolumeBootPattern-954873624-project Oct 19 04:03:32.476764 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 04:03:32.476764 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 04:03:32.476764 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 4d30aa868d79473f9534bd79816c07e3 Oct 19 04:03:32.476764 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-TestVolumeBootPattern-954873624-project Oct 19 04:03:32.476764 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 04:03:32.476764 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance f0484f54-9a04-4d53-a922-8aea4041bb75 could not be found. Oct 19 04:03:32.476764 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': 'f0484f54-9a04-4d53-a922-8aea4041bb75'} Oct 19 04:03:32.476764 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 04:03:32.476764 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:03:32.476764 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 04:03:32.476764 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 04:03:32.476764 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 04:03:32.476764 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 04:03:32.476764 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 04:03:32.476764 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 04:03:32.476764 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 04:03:32.476764 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 04:03:32.476764 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0484f54-9a04-4d53-a922-8aea4041bb75 could not be found. Oct 19 04:03:32.476764 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:03:32.476764 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:03:32.476764 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:03:32.476764 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:03:32.476764 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:03:32.476764 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:03:32.476764 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 04:03:32.476764 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 04:03:32.476764 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 04:03:32.476764 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 04:03:32.476764 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 04:03:32.476764 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 04:03:32.476764 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 04:03:32.476764 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 04:03:32.476764 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 04:03:32.476764 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 04:03:32.476764 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0484f54-9a04-4d53-a922-8aea4041bb75 could not be found. Oct 19 04:03:32.476764 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:03:32.476764 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:03:32.476764 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:03:32.482809 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:03:32.482809 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:03:32.482809 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:03:32.482809 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 04:03:32.482809 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 04:03:32.482809 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0484f54-9a04-4d53-a922-8aea4041bb75 could not be found. Oct 19 04:03:32.482809 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:03:32.482809 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-fe0a7f37-2d10-463c-b176-47194bee10d2 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Returning 404 to user: Instance f0484f54-9a04-4d53-a922-8aea4041bb75 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 04:03:32.482809 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-fe0a7f37-2d10-463c-b176-47194bee10d2 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75" status: 404 len: 111 microversion: 2.1 time: 0.038002 Oct 19 04:03:32.484922 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3683/7060] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:03:32 2022] GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 04:03:35.804061 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-677ab4e2-e99a-4a3e-90ad-05c9f0387cc4 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:03:35.804666 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-677ab4e2-e99a-4a3e-90ad-05c9f0387cc4 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 5262740d-a79b-413a-990b-bb4842fd8d58] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:03:35.812211 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-677ab4e2-e99a-4a3e-90ad-05c9f0387cc4 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:03:35.812713 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-677ab4e2-e99a-4a3e-90ad-05c9f0387cc4 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:03:35.813172 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-677ab4e2-e99a-4a3e-90ad-05c9f0387cc4 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:03:35.813917 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-677ab4e2-e99a-4a3e-90ad-05c9f0387cc4 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:03:35.814391 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-677ab4e2-e99a-4a3e-90ad-05c9f0387cc4 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:03:35.814843 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-677ab4e2-e99a-4a3e-90ad-05c9f0387cc4 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:03:35.839704 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-677ab4e2-e99a-4a3e-90ad-05c9f0387cc4 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 5262740d-a79b-413a-990b-bb4842fd8d58] Going to try to terminate instance {{(pid=121134) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 04:03:36.060374 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-677ab4e2-e99a-4a3e-90ad-05c9f0387cc4 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "DELETE /compute/v2.1/servers/5262740d-a79b-413a-990b-bb4842fd8d58" status: 204 len: 0 microversion: 2.1 time: 0.259908 Oct 19 04:03:36.061105 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3684/7061] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 04:03:35 2022] DELETE /compute/v2.1/servers/5262740d-a79b-413a-990b-bb4842fd8d58 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 19 04:03:36.070818 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9b2340eb-5ce1-4013-b4b7-e0ff3acf7e3f tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:03:36.071921 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9b2340eb-5ce1-4013-b4b7-e0ff3acf7e3f tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 5262740d-a79b-413a-990b-bb4842fd8d58] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:03:36.078608 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9b2340eb-5ce1-4013-b4b7-e0ff3acf7e3f tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:03:36.079121 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9b2340eb-5ce1-4013-b4b7-e0ff3acf7e3f tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:03:36.079580 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9b2340eb-5ce1-4013-b4b7-e0ff3acf7e3f tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:03:36.080377 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9b2340eb-5ce1-4013-b4b7-e0ff3acf7e3f tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:03:36.081056 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9b2340eb-5ce1-4013-b4b7-e0ff3acf7e3f tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:03:36.081550 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9b2340eb-5ce1-4013-b4b7-e0ff3acf7e3f tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:03:36.224537 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9b2340eb-5ce1-4013-b4b7-e0ff3acf7e3f tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:03:36.234080 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9b2340eb-5ce1-4013-b4b7-e0ff3acf7e3f tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/5262740d-a79b-413a-990b-bb4842fd8d58" status: 200 len: 1411 microversion: 2.1 time: 0.168407 Oct 19 04:03:36.237211 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3685/7062] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:03:36 2022] GET /compute/v2.1/servers/5262740d-a79b-413a-990b-bb4842fd8d58 => generated 1411 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:03:37.258998 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d163892d-7ec0-411c-957e-3556372696ef tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:03:37.259630 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d163892d-7ec0-411c-957e-3556372696ef tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 5262740d-a79b-413a-990b-bb4842fd8d58] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:03:37.267133 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d163892d-7ec0-411c-957e-3556372696ef tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:03:37.268001 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d163892d-7ec0-411c-957e-3556372696ef tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:03:37.268466 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d163892d-7ec0-411c-957e-3556372696ef tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:03:37.269195 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d163892d-7ec0-411c-957e-3556372696ef tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:03:37.269701 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d163892d-7ec0-411c-957e-3556372696ef tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:03:37.270151 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d163892d-7ec0-411c-957e-3556372696ef tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:03:37.502446 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d163892d-7ec0-411c-957e-3556372696ef tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:03:37.511041 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d163892d-7ec0-411c-957e-3556372696ef tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/5262740d-a79b-413a-990b-bb4842fd8d58" status: 200 len: 1411 microversion: 2.1 time: 0.256126 Oct 19 04:03:37.511754 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3686/7063] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:03:37 2022] GET /compute/v2.1/servers/5262740d-a79b-413a-990b-bb4842fd8d58 => generated 1411 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:03:38.537685 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-74d6e5d3-31d7-46b4-a362-5fc2c23151d4 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:03:38.542787 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-74d6e5d3-31d7-46b4-a362-5fc2c23151d4 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 5262740d-a79b-413a-990b-bb4842fd8d58] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:03:38.565326 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-74d6e5d3-31d7-46b4-a362-5fc2c23151d4 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:03:38.569432 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-74d6e5d3-31d7-46b4-a362-5fc2c23151d4 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:03:38.571606 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-74d6e5d3-31d7-46b4-a362-5fc2c23151d4 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:03:38.581336 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-74d6e5d3-31d7-46b4-a362-5fc2c23151d4 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:03:38.584586 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-74d6e5d3-31d7-46b4-a362-5fc2c23151d4 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:03:38.585563 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-74d6e5d3-31d7-46b4-a362-5fc2c23151d4 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:03:38.705467 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-74d6e5d3-31d7-46b4-a362-5fc2c23151d4 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:03:38.714008 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-74d6e5d3-31d7-46b4-a362-5fc2c23151d4 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/5262740d-a79b-413a-990b-bb4842fd8d58" status: 200 len: 1369 microversion: 2.1 time: 0.182174 Oct 19 04:03:38.714598 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3687/7064] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:03:38 2022] GET /compute/v2.1/servers/5262740d-a79b-413a-990b-bb4842fd8d58 => generated 1369 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:03:38.729557 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-6c83ce90-0b3d-4e26-857e-d8c73a797793 req-9b477eff-fc7a-43b0-8f4c-2619116604bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5262740d-a79b-413a-990b-bb4842fd8d58", "name": "network-vif-deleted", "tag": "0f92420a-3a0b-40ef-a003-55776635b70d"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:03:38.734709 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-6c83ce90-0b3d-4e26-857e-d8c73a797793 req-9b477eff-fc7a-43b0-8f4c-2619116604bd service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:03:38.735230 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-6c83ce90-0b3d-4e26-857e-d8c73a797793 req-9b477eff-fc7a-43b0-8f4c-2619116604bd service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:03:38.735673 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-6c83ce90-0b3d-4e26-857e-d8c73a797793 req-9b477eff-fc7a-43b0-8f4c-2619116604bd service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:03:38.752758 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-6c83ce90-0b3d-4e26-857e-d8c73a797793 req-9b477eff-fc7a-43b0-8f4c-2619116604bd service nova] Creating event network-vif-deleted:0f92420a-3a0b-40ef-a003-55776635b70d for instance 5262740d-a79b-413a-990b-bb4842fd8d58 on n-h1-861333-8 Oct 19 04:03:38.758984 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-6c83ce90-0b3d-4e26-857e-d8c73a797793 req-9b477eff-fc7a-43b0-8f4c-2619116604bd service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038245 Oct 19 04:03:38.759594 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3688/7065] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:03:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:03:39.745569 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-55a25f2e-565d-47f9-a901-b5a8c16e121c tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:03:39.747310 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-55a25f2e-565d-47f9-a901-b5a8c16e121c tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 5262740d-a79b-413a-990b-bb4842fd8d58] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:03:39.759033 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-55a25f2e-565d-47f9-a901-b5a8c16e121c tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:03:39.759888 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-55a25f2e-565d-47f9-a901-b5a8c16e121c tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:03:39.760499 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-55a25f2e-565d-47f9-a901-b5a8c16e121c tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:03:39.761857 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-55a25f2e-565d-47f9-a901-b5a8c16e121c tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:03:39.770083 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-55a25f2e-565d-47f9-a901-b5a8c16e121c tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:03:39.770736 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-55a25f2e-565d-47f9-a901-b5a8c16e121c tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:03:39.848309 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-55a25f2e-565d-47f9-a901-b5a8c16e121c tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:03:39.857391 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-55a25f2e-565d-47f9-a901-b5a8c16e121c tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/5262740d-a79b-413a-990b-bb4842fd8d58" status: 200 len: 1202 microversion: 2.1 time: 0.119506 Oct 19 04:03:39.859044 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3689/7066] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:03:39 2022] GET /compute/v2.1/servers/5262740d-a79b-413a-990b-bb4842fd8d58 => generated 1202 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:03:40.880427 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4167bd51-3586-4233-92cd-6d344c43be34 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:03:40.881070 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4167bd51-3586-4233-92cd-6d344c43be34 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 5262740d-a79b-413a-990b-bb4842fd8d58] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:03:40.888054 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4167bd51-3586-4233-92cd-6d344c43be34 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:03:40.888566 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4167bd51-3586-4233-92cd-6d344c43be34 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:03:40.889272 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4167bd51-3586-4233-92cd-6d344c43be34 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:03:40.890043 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4167bd51-3586-4233-92cd-6d344c43be34 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:03:40.890525 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4167bd51-3586-4233-92cd-6d344c43be34 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:03:40.890972 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4167bd51-3586-4233-92cd-6d344c43be34 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:03:40.954298 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-4167bd51-3586-4233-92cd-6d344c43be34 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:03:40.967178 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4167bd51-3586-4233-92cd-6d344c43be34 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/5262740d-a79b-413a-990b-bb4842fd8d58" status: 200 len: 1202 microversion: 2.1 time: 0.086690 Oct 19 04:03:40.967178 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3690/7067] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:03:40 2022] GET /compute/v2.1/servers/5262740d-a79b-413a-990b-bb4842fd8d58 => generated 1202 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:03:41.985634 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-49350328-c04c-49cd-872f-6818a30fa409 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:03:41.986379 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-49350328-c04c-49cd-872f-6818a30fa409 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 5262740d-a79b-413a-990b-bb4842fd8d58] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:03:41.994077 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-49350328-c04c-49cd-872f-6818a30fa409 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:03:41.998850 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-49350328-c04c-49cd-872f-6818a30fa409 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:03:41.998850 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-49350328-c04c-49cd-872f-6818a30fa409 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:03:41.998850 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-49350328-c04c-49cd-872f-6818a30fa409 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:03:41.998850 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-49350328-c04c-49cd-872f-6818a30fa409 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:03:41.998850 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-49350328-c04c-49cd-872f-6818a30fa409 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:03:42.063884 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-49350328-c04c-49cd-872f-6818a30fa409 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:03:42.075726 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-49350328-c04c-49cd-872f-6818a30fa409 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/5262740d-a79b-413a-990b-bb4842fd8d58" status: 200 len: 1202 microversion: 2.1 time: 0.093165 Oct 19 04:03:42.076666 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3691/7068] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:03:41 2022] GET /compute/v2.1/servers/5262740d-a79b-413a-990b-bb4842fd8d58 => generated 1202 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:03:43.099741 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9fefbf31-4d71-4c8b-a629-476869cd64cd tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:03:43.100400 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9fefbf31-4d71-4c8b-a629-476869cd64cd tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 5262740d-a79b-413a-990b-bb4842fd8d58] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:03:43.107318 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9fefbf31-4d71-4c8b-a629-476869cd64cd tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:03:43.107817 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9fefbf31-4d71-4c8b-a629-476869cd64cd tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:03:43.108269 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9fefbf31-4d71-4c8b-a629-476869cd64cd tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:03:43.108982 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9fefbf31-4d71-4c8b-a629-476869cd64cd tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:03:43.109481 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9fefbf31-4d71-4c8b-a629-476869cd64cd tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:03:43.109926 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9fefbf31-4d71-4c8b-a629-476869cd64cd tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:03:43.191590 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9fefbf31-4d71-4c8b-a629-476869cd64cd tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:03:43.200768 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9fefbf31-4d71-4c8b-a629-476869cd64cd tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/5262740d-a79b-413a-990b-bb4842fd8d58" status: 200 len: 1202 microversion: 2.1 time: 0.105306 Oct 19 04:03:43.201388 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3692/7069] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:03:43 2022] GET /compute/v2.1/servers/5262740d-a79b-413a-990b-bb4842fd8d58 => generated 1202 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:03:44.224606 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7a0eaa79-6a29-40f5-ab3f-ff9eb67a67f6 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:03:44.225424 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7a0eaa79-6a29-40f5-ab3f-ff9eb67a67f6 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 5262740d-a79b-413a-990b-bb4842fd8d58] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:03:44.233290 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7a0eaa79-6a29-40f5-ab3f-ff9eb67a67f6 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:03:44.233830 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7a0eaa79-6a29-40f5-ab3f-ff9eb67a67f6 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:03:44.234287 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7a0eaa79-6a29-40f5-ab3f-ff9eb67a67f6 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:03:44.235053 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7a0eaa79-6a29-40f5-ab3f-ff9eb67a67f6 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:03:44.235562 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7a0eaa79-6a29-40f5-ab3f-ff9eb67a67f6 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:03:44.236016 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7a0eaa79-6a29-40f5-ab3f-ff9eb67a67f6 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:03:44.272056 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7a0eaa79-6a29-40f5-ab3f-ff9eb67a67f6 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:03:44.272947 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7a0eaa79-6a29-40f5-ab3f-ff9eb67a67f6 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:03:44.273361 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7a0eaa79-6a29-40f5-ab3f-ff9eb67a67f6 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:03:44.273741 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-7a0eaa79-6a29-40f5-ab3f-ff9eb67a67f6 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lazy-loading 'fault' on Instance uuid 5262740d-a79b-413a-990b-bb4842fd8d58 {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 04:03:44.319839 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-7a0eaa79-6a29-40f5-ab3f-ff9eb67a67f6 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:03:44.327316 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7a0eaa79-6a29-40f5-ab3f-ff9eb67a67f6 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/5262740d-a79b-413a-990b-bb4842fd8d58" status: 200 len: 1161 microversion: 2.1 time: 0.107039 Oct 19 04:03:44.327966 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3693/7070] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:03:44 2022] GET /compute/v2.1/servers/5262740d-a79b-413a-990b-bb4842fd8d58 => generated 1161 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:03:45.353037 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-56ac7bd7-ebdc-4685-b881-a02f39973dc7 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:03:45.353842 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-56ac7bd7-ebdc-4685-b881-a02f39973dc7 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 5262740d-a79b-413a-990b-bb4842fd8d58] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:03:45.362012 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-56ac7bd7-ebdc-4685-b881-a02f39973dc7 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:03:45.362586 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-56ac7bd7-ebdc-4685-b881-a02f39973dc7 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:03:45.362979 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-56ac7bd7-ebdc-4685-b881-a02f39973dc7 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:03:45.365475 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-56ac7bd7-ebdc-4685-b881-a02f39973dc7 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:03:45.365475 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-56ac7bd7-ebdc-4685-b881-a02f39973dc7 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:03:45.365475 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-56ac7bd7-ebdc-4685-b881-a02f39973dc7 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:03:45.380819 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-56ac7bd7-ebdc-4685-b881-a02f39973dc7 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] HTTP exception thrown: Instance 5262740d-a79b-413a-990b-bb4842fd8d58 could not be found. Oct 19 04:03:45.382579 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-56ac7bd7-ebdc-4685-b881-a02f39973dc7 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Request method failure captured: Oct 19 04:03:45.382579 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/5262740d-a79b-413a-990b-bb4842fd8d58 HTTP/1.1 Oct 19 04:03:45.382579 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 04:03:45.382579 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 04:03:45.382579 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 04:03:45.382579 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 04:03:45.382579 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 04:03:45.382579 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 04:03:45.382579 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 04:03:45.382579 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 04:03:45.382579 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3XYw5PeFcmVZaG2CxoqLxKroO9lkG-Hw7MzEkzHPy2_aqlf3HPBMKgLOXoQ-WbgkZbvZB1PbShR7FiiZmGSIVTCeQrWw3ytKpP-AuucJQP3lFFYEs8HquAFih6wwJOh2-3eNgmaxbIZUVh9y_A1g_wYecm08YmNoRnAnQnVYIDNRwE Oct 19 04:03:45.382579 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 04:03:45.382579 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 04:03:45.382579 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 04:03:45.382579 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 04:03:45.382579 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 04:03:45.382579 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 04:03:45.382579 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: beff434485604f85985617071a93727c Oct 19 04:03:45.382579 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-TestVolumeBootPattern-954873624 Oct 19 04:03:45.382579 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 04:03:45.382579 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 04:03:45.382579 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/beff434485604f85985617071a93727c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/beff434485604f85985617071a93727c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/beff434485604f85985617071a93727c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_beff434485604f85985617071a93727c", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 04:03:45.382579 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-TestVolumeBootPattern-954873624 Oct 19 04:03:45.382579 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: beff434485604f85985617071a93727c Oct 19 04:03:45.382579 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-TestVolumeBootPattern-954873624 Oct 19 04:03:45.382579 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-TestVolumeBootPattern-954873624-project Oct 19 04:03:45.382579 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 04:03:45.382579 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 04:03:45.382579 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 4d30aa868d79473f9534bd79816c07e3 Oct 19 04:03:45.382579 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-TestVolumeBootPattern-954873624-project Oct 19 04:03:45.382579 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 04:03:45.382579 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance 5262740d-a79b-413a-990b-bb4842fd8d58 could not be found. Oct 19 04:03:45.382579 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '5262740d-a79b-413a-990b-bb4842fd8d58'} Oct 19 04:03:45.382579 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 04:03:45.382579 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:03:45.382579 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 04:03:45.382579 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 04:03:45.382579 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 04:03:45.382579 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 04:03:45.382579 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 04:03:45.382579 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 04:03:45.382579 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 04:03:45.382579 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 04:03:45.382579 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5262740d-a79b-413a-990b-bb4842fd8d58 could not be found. Oct 19 04:03:45.382579 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:03:45.382579 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:03:45.382579 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:03:45.382579 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:03:45.382579 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:03:45.382579 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:03:45.382579 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 04:03:45.382579 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 04:03:45.382579 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 04:03:45.382579 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 04:03:45.382579 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 04:03:45.382579 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 04:03:45.382579 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 04:03:45.382579 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 04:03:45.382579 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 04:03:45.382579 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 04:03:45.382579 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5262740d-a79b-413a-990b-bb4842fd8d58 could not be found. Oct 19 04:03:45.382579 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:03:45.382579 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:03:45.382579 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:03:45.388149 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:03:45.388149 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:03:45.388149 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:03:45.388149 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 04:03:45.388149 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 04:03:45.388149 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5262740d-a79b-413a-990b-bb4842fd8d58 could not be found. Oct 19 04:03:45.388149 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:03:45.388149 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-56ac7bd7-ebdc-4685-b881-a02f39973dc7 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Returning 404 to user: Instance 5262740d-a79b-413a-990b-bb4842fd8d58 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 04:03:45.389778 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-56ac7bd7-ebdc-4685-b881-a02f39973dc7 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/5262740d-a79b-413a-990b-bb4842fd8d58" status: 404 len: 111 microversion: 2.1 time: 0.036859 Oct 19 04:03:45.390433 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3694/7071] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:03:45 2022] GET /compute/v2.1/servers/5262740d-a79b-413a-990b-bb4842fd8d58 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 04:03:46.487464 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-54e0f205-e29c-4928-9ffb-1f539fc54f6c tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:03:46.488061 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-54e0f205-e29c-4928-9ffb-1f539fc54f6c tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: f0484f54-9a04-4d53-a922-8aea4041bb75] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:03:46.495053 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-54e0f205-e29c-4928-9ffb-1f539fc54f6c tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:03:46.495502 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-54e0f205-e29c-4928-9ffb-1f539fc54f6c tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:03:46.495965 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-54e0f205-e29c-4928-9ffb-1f539fc54f6c tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:03:46.496681 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-54e0f205-e29c-4928-9ffb-1f539fc54f6c tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:03:46.497756 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-54e0f205-e29c-4928-9ffb-1f539fc54f6c tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:03:46.498211 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-54e0f205-e29c-4928-9ffb-1f539fc54f6c tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:03:46.515720 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-54e0f205-e29c-4928-9ffb-1f539fc54f6c tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] HTTP exception thrown: Instance f0484f54-9a04-4d53-a922-8aea4041bb75 could not be found. Oct 19 04:03:46.517310 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-54e0f205-e29c-4928-9ffb-1f539fc54f6c tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Request method failure captured: Oct 19 04:03:46.517310 n-d-861333-8 devstack@n-api.service[121134]: request: DELETE /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75 HTTP/1.1 Oct 19 04:03:46.517310 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 04:03:46.517310 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 04:03:46.517310 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 04:03:46.517310 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 04:03:46.517310 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 04:03:46.517310 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 04:03:46.517310 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 04:03:46.517310 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 04:03:46.517310 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3XYw5PeFcmVZaG2CxoqLxKroO9lkG-Hw7MzEkzHPy2_aqlf3HPBMKgLOXoQ-WbgkZbvZB1PbShR7FiiZmGSIVTCeQrWw3ytKpP-AuucJQP3lFFYEs8HquAFih6wwJOh2-3eNgmaxbIZUVh9y_A1g_wYecm08YmNoRnAnQnVYIDNRwE Oct 19 04:03:46.517310 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 04:03:46.517310 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 04:03:46.517310 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 04:03:46.517310 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 04:03:46.517310 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 04:03:46.517310 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 04:03:46.517310 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: beff434485604f85985617071a93727c Oct 19 04:03:46.517310 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-TestVolumeBootPattern-954873624 Oct 19 04:03:46.517310 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 04:03:46.517310 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 04:03:46.517310 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/beff434485604f85985617071a93727c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/beff434485604f85985617071a93727c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/beff434485604f85985617071a93727c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_beff434485604f85985617071a93727c", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 04:03:46.517310 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-TestVolumeBootPattern-954873624 Oct 19 04:03:46.517310 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: beff434485604f85985617071a93727c Oct 19 04:03:46.517310 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-TestVolumeBootPattern-954873624 Oct 19 04:03:46.517310 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-TestVolumeBootPattern-954873624-project Oct 19 04:03:46.517310 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 04:03:46.517310 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 04:03:46.517310 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 4d30aa868d79473f9534bd79816c07e3 Oct 19 04:03:46.517310 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-TestVolumeBootPattern-954873624-project Oct 19 04:03:46.517310 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 04:03:46.517310 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance f0484f54-9a04-4d53-a922-8aea4041bb75 could not be found. Oct 19 04:03:46.517310 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': 'f0484f54-9a04-4d53-a922-8aea4041bb75'} Oct 19 04:03:46.517310 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 04:03:46.517310 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:03:46.517310 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 04:03:46.517310 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 04:03:46.517310 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 04:03:46.517310 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 04:03:46.517310 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 04:03:46.517310 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 04:03:46.517310 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 04:03:46.517310 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 04:03:46.517310 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0484f54-9a04-4d53-a922-8aea4041bb75 could not be found. Oct 19 04:03:46.517310 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:03:46.517310 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:03:46.517310 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:03:46.517310 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:03:46.517310 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:03:46.517310 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:03:46.517310 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 04:03:46.517310 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 04:03:46.517310 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 04:03:46.517310 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 04:03:46.517310 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 04:03:46.517310 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 04:03:46.517310 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 04:03:46.517310 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 04:03:46.517310 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 04:03:46.517310 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 04:03:46.517310 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 04:03:46.517310 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 04:03:46.523635 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0484f54-9a04-4d53-a922-8aea4041bb75 could not be found. Oct 19 04:03:46.523635 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:03:46.523635 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:03:46.523635 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:03:46.523635 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:03:46.523635 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:03:46.523635 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:03:46.523635 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 04:03:46.523635 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 04:03:46.523635 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0484f54-9a04-4d53-a922-8aea4041bb75 could not be found. Oct 19 04:03:46.523635 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:03:46.523635 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-54e0f205-e29c-4928-9ffb-1f539fc54f6c tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Returning 404 to user: Instance f0484f54-9a04-4d53-a922-8aea4041bb75 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 04:03:46.523635 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-54e0f205-e29c-4928-9ffb-1f539fc54f6c tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "DELETE /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75" status: 404 len: 111 microversion: 2.1 time: 0.037391 Oct 19 04:03:46.525683 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3695/7072] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 04:03:46 2022] DELETE /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 04:03:46.535362 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-78097173-2624-4c80-be48-a0dce7cf9bf1 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:03:46.536116 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-78097173-2624-4c80-be48-a0dce7cf9bf1 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: f0484f54-9a04-4d53-a922-8aea4041bb75] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:03:46.543788 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-78097173-2624-4c80-be48-a0dce7cf9bf1 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:03:46.544376 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-78097173-2624-4c80-be48-a0dce7cf9bf1 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:03:46.544839 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-78097173-2624-4c80-be48-a0dce7cf9bf1 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:03:46.545723 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-78097173-2624-4c80-be48-a0dce7cf9bf1 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:03:46.546203 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-78097173-2624-4c80-be48-a0dce7cf9bf1 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:03:46.546659 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-78097173-2624-4c80-be48-a0dce7cf9bf1 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:03:46.562086 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-78097173-2624-4c80-be48-a0dce7cf9bf1 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] HTTP exception thrown: Instance f0484f54-9a04-4d53-a922-8aea4041bb75 could not be found. Oct 19 04:03:46.563652 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-78097173-2624-4c80-be48-a0dce7cf9bf1 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Request method failure captured: Oct 19 04:03:46.563652 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75 HTTP/1.1 Oct 19 04:03:46.563652 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 04:03:46.563652 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 04:03:46.563652 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 04:03:46.563652 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 04:03:46.563652 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 04:03:46.563652 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 04:03:46.563652 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 04:03:46.563652 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 04:03:46.563652 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3XYw5PeFcmVZaG2CxoqLxKroO9lkG-Hw7MzEkzHPy2_aqlf3HPBMKgLOXoQ-WbgkZbvZB1PbShR7FiiZmGSIVTCeQrWw3ytKpP-AuucJQP3lFFYEs8HquAFih6wwJOh2-3eNgmaxbIZUVh9y_A1g_wYecm08YmNoRnAnQnVYIDNRwE Oct 19 04:03:46.563652 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 04:03:46.563652 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 04:03:46.563652 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 04:03:46.563652 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 04:03:46.563652 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 04:03:46.563652 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 04:03:46.563652 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: beff434485604f85985617071a93727c Oct 19 04:03:46.563652 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-TestVolumeBootPattern-954873624 Oct 19 04:03:46.563652 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 04:03:46.563652 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 04:03:46.563652 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/beff434485604f85985617071a93727c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/beff434485604f85985617071a93727c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/beff434485604f85985617071a93727c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_beff434485604f85985617071a93727c", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 04:03:46.563652 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-TestVolumeBootPattern-954873624 Oct 19 04:03:46.563652 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: beff434485604f85985617071a93727c Oct 19 04:03:46.563652 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-TestVolumeBootPattern-954873624 Oct 19 04:03:46.563652 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-TestVolumeBootPattern-954873624-project Oct 19 04:03:46.563652 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 04:03:46.563652 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 04:03:46.563652 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 4d30aa868d79473f9534bd79816c07e3 Oct 19 04:03:46.563652 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-TestVolumeBootPattern-954873624-project Oct 19 04:03:46.563652 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 04:03:46.563652 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance f0484f54-9a04-4d53-a922-8aea4041bb75 could not be found. Oct 19 04:03:46.563652 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': 'f0484f54-9a04-4d53-a922-8aea4041bb75'} Oct 19 04:03:46.563652 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 04:03:46.563652 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:03:46.563652 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 04:03:46.563652 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 04:03:46.563652 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 04:03:46.563652 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 04:03:46.563652 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 04:03:46.563652 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 04:03:46.563652 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 04:03:46.563652 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 04:03:46.563652 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0484f54-9a04-4d53-a922-8aea4041bb75 could not be found. Oct 19 04:03:46.563652 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:03:46.563652 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:03:46.563652 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:03:46.563652 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:03:46.563652 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:03:46.563652 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:03:46.563652 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 04:03:46.563652 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 04:03:46.563652 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 04:03:46.563652 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 04:03:46.563652 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 04:03:46.563652 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 04:03:46.563652 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 04:03:46.563652 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 04:03:46.563652 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 04:03:46.563652 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 04:03:46.563652 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0484f54-9a04-4d53-a922-8aea4041bb75 could not be found. Oct 19 04:03:46.563652 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:03:46.563652 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:03:46.563652 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:03:46.568763 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:03:46.568763 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:03:46.568763 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:03:46.568763 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 04:03:46.568763 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 04:03:46.568763 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0484f54-9a04-4d53-a922-8aea4041bb75 could not be found. Oct 19 04:03:46.568763 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:03:46.568763 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-78097173-2624-4c80-be48-a0dce7cf9bf1 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Returning 404 to user: Instance f0484f54-9a04-4d53-a922-8aea4041bb75 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 04:03:46.568763 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-78097173-2624-4c80-be48-a0dce7cf9bf1 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75" status: 404 len: 111 microversion: 2.1 time: 0.033927 Oct 19 04:03:46.568763 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3696/7073] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:03:46 2022] GET /compute/v2.1/servers/f0484f54-9a04-4d53-a922-8aea4041bb75 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 04:03:47.530478 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9b01f2c3-cf09-4a12-9a6b-16dbbec2af07 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:03:47.530478 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9b01f2c3-cf09-4a12-9a6b-16dbbec2af07 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 5262740d-a79b-413a-990b-bb4842fd8d58] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:03:47.536819 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9b01f2c3-cf09-4a12-9a6b-16dbbec2af07 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:03:47.537336 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9b01f2c3-cf09-4a12-9a6b-16dbbec2af07 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:03:47.537825 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9b01f2c3-cf09-4a12-9a6b-16dbbec2af07 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:03:47.538544 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9b01f2c3-cf09-4a12-9a6b-16dbbec2af07 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:03:47.539019 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9b01f2c3-cf09-4a12-9a6b-16dbbec2af07 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:03:47.539470 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9b01f2c3-cf09-4a12-9a6b-16dbbec2af07 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:03:47.553884 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-9b01f2c3-cf09-4a12-9a6b-16dbbec2af07 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] HTTP exception thrown: Instance 5262740d-a79b-413a-990b-bb4842fd8d58 could not be found. Oct 19 04:03:47.555452 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9b01f2c3-cf09-4a12-9a6b-16dbbec2af07 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Request method failure captured: Oct 19 04:03:47.555452 n-d-861333-8 devstack@n-api.service[121134]: request: DELETE /compute/v2.1/servers/5262740d-a79b-413a-990b-bb4842fd8d58 HTTP/1.1 Oct 19 04:03:47.555452 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 04:03:47.555452 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 04:03:47.555452 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 04:03:47.555452 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 04:03:47.555452 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 04:03:47.555452 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 04:03:47.555452 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 04:03:47.555452 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 04:03:47.555452 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3XYw5PeFcmVZaG2CxoqLxKroO9lkG-Hw7MzEkzHPy2_aqlf3HPBMKgLOXoQ-WbgkZbvZB1PbShR7FiiZmGSIVTCeQrWw3ytKpP-AuucJQP3lFFYEs8HquAFih6wwJOh2-3eNgmaxbIZUVh9y_A1g_wYecm08YmNoRnAnQnVYIDNRwE Oct 19 04:03:47.555452 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 04:03:47.555452 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 04:03:47.555452 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 04:03:47.555452 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 04:03:47.555452 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 04:03:47.555452 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 04:03:47.555452 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: beff434485604f85985617071a93727c Oct 19 04:03:47.555452 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-TestVolumeBootPattern-954873624 Oct 19 04:03:47.555452 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 04:03:47.555452 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 04:03:47.555452 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/beff434485604f85985617071a93727c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/beff434485604f85985617071a93727c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/beff434485604f85985617071a93727c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_beff434485604f85985617071a93727c", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 04:03:47.555452 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-TestVolumeBootPattern-954873624 Oct 19 04:03:47.555452 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: beff434485604f85985617071a93727c Oct 19 04:03:47.555452 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-TestVolumeBootPattern-954873624 Oct 19 04:03:47.555452 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-TestVolumeBootPattern-954873624-project Oct 19 04:03:47.555452 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 04:03:47.555452 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 04:03:47.555452 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 4d30aa868d79473f9534bd79816c07e3 Oct 19 04:03:47.555452 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-TestVolumeBootPattern-954873624-project Oct 19 04:03:47.555452 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 04:03:47.555452 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance 5262740d-a79b-413a-990b-bb4842fd8d58 could not be found. Oct 19 04:03:47.555452 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '5262740d-a79b-413a-990b-bb4842fd8d58'} Oct 19 04:03:47.555452 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 04:03:47.555452 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:03:47.555452 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 04:03:47.555452 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 04:03:47.555452 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 04:03:47.555452 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 04:03:47.555452 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 04:03:47.555452 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 04:03:47.555452 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 04:03:47.555452 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 04:03:47.555452 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5262740d-a79b-413a-990b-bb4842fd8d58 could not be found. Oct 19 04:03:47.555452 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:03:47.555452 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:03:47.555452 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:03:47.555452 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:03:47.555452 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:03:47.555452 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:03:47.555452 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 04:03:47.555452 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 04:03:47.555452 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 04:03:47.555452 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 04:03:47.555452 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 04:03:47.555452 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 04:03:47.555452 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 04:03:47.555452 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 04:03:47.555452 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 04:03:47.555452 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 04:03:47.555452 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 04:03:47.555452 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 04:03:47.564772 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5262740d-a79b-413a-990b-bb4842fd8d58 could not be found. Oct 19 04:03:47.564772 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:03:47.564772 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:03:47.564772 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:03:47.564772 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:03:47.564772 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:03:47.564772 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:03:47.564772 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 04:03:47.564772 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 04:03:47.564772 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5262740d-a79b-413a-990b-bb4842fd8d58 could not be found. Oct 19 04:03:47.564772 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:03:47.564772 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9b01f2c3-cf09-4a12-9a6b-16dbbec2af07 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Returning 404 to user: Instance 5262740d-a79b-413a-990b-bb4842fd8d58 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 04:03:47.564772 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9b01f2c3-cf09-4a12-9a6b-16dbbec2af07 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "DELETE /compute/v2.1/servers/5262740d-a79b-413a-990b-bb4842fd8d58" status: 404 len: 111 microversion: 2.1 time: 0.033415 Oct 19 04:03:47.564772 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3697/7074] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 04:03:47 2022] DELETE /compute/v2.1/servers/5262740d-a79b-413a-990b-bb4842fd8d58 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 04:03:47.567359 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e7dd6813-e895-4aa8-9675-87345e43f800 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:03:47.567989 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e7dd6813-e895-4aa8-9675-87345e43f800 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 5262740d-a79b-413a-990b-bb4842fd8d58] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:03:47.573995 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e7dd6813-e895-4aa8-9675-87345e43f800 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:03:47.574507 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e7dd6813-e895-4aa8-9675-87345e43f800 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:03:47.574965 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e7dd6813-e895-4aa8-9675-87345e43f800 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:03:47.575737 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e7dd6813-e895-4aa8-9675-87345e43f800 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:03:47.576210 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e7dd6813-e895-4aa8-9675-87345e43f800 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:03:47.576660 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e7dd6813-e895-4aa8-9675-87345e43f800 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:03:47.590824 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-e7dd6813-e895-4aa8-9675-87345e43f800 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] HTTP exception thrown: Instance 5262740d-a79b-413a-990b-bb4842fd8d58 could not be found. Oct 19 04:03:47.592384 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e7dd6813-e895-4aa8-9675-87345e43f800 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Request method failure captured: Oct 19 04:03:47.592384 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/5262740d-a79b-413a-990b-bb4842fd8d58 HTTP/1.1 Oct 19 04:03:47.592384 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 04:03:47.592384 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 04:03:47.592384 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 04:03:47.592384 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 04:03:47.592384 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 04:03:47.592384 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 04:03:47.592384 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 04:03:47.592384 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 04:03:47.592384 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3XYw5PeFcmVZaG2CxoqLxKroO9lkG-Hw7MzEkzHPy2_aqlf3HPBMKgLOXoQ-WbgkZbvZB1PbShR7FiiZmGSIVTCeQrWw3ytKpP-AuucJQP3lFFYEs8HquAFih6wwJOh2-3eNgmaxbIZUVh9y_A1g_wYecm08YmNoRnAnQnVYIDNRwE Oct 19 04:03:47.592384 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 04:03:47.592384 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 04:03:47.592384 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 04:03:47.592384 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 04:03:47.592384 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 04:03:47.592384 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 04:03:47.592384 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: beff434485604f85985617071a93727c Oct 19 04:03:47.592384 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-TestVolumeBootPattern-954873624 Oct 19 04:03:47.592384 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 04:03:47.592384 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 04:03:47.592384 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/beff434485604f85985617071a93727c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/beff434485604f85985617071a93727c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/beff434485604f85985617071a93727c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_beff434485604f85985617071a93727c", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 04:03:47.592384 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-TestVolumeBootPattern-954873624 Oct 19 04:03:47.592384 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: beff434485604f85985617071a93727c Oct 19 04:03:47.592384 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-TestVolumeBootPattern-954873624 Oct 19 04:03:47.592384 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-TestVolumeBootPattern-954873624-project Oct 19 04:03:47.592384 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 04:03:47.592384 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 04:03:47.592384 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 4d30aa868d79473f9534bd79816c07e3 Oct 19 04:03:47.592384 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-TestVolumeBootPattern-954873624-project Oct 19 04:03:47.592384 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 04:03:47.592384 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance 5262740d-a79b-413a-990b-bb4842fd8d58 could not be found. Oct 19 04:03:47.592384 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '5262740d-a79b-413a-990b-bb4842fd8d58'} Oct 19 04:03:47.592384 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 04:03:47.592384 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:03:47.592384 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 04:03:47.592384 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 04:03:47.592384 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 04:03:47.592384 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 04:03:47.592384 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 04:03:47.592384 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 04:03:47.592384 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 04:03:47.592384 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 04:03:47.592384 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5262740d-a79b-413a-990b-bb4842fd8d58 could not be found. Oct 19 04:03:47.592384 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:03:47.592384 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:03:47.592384 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:03:47.592384 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:03:47.592384 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:03:47.592384 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:03:47.592384 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 04:03:47.592384 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 04:03:47.592384 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 04:03:47.592384 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 04:03:47.592384 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 04:03:47.592384 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 04:03:47.592384 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 04:03:47.592384 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 04:03:47.592384 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 04:03:47.592384 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 04:03:47.592384 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5262740d-a79b-413a-990b-bb4842fd8d58 could not be found. Oct 19 04:03:47.592384 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:03:47.592384 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:03:47.592384 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:03:47.598802 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:03:47.598802 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:03:47.598802 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:03:47.598802 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 04:03:47.598802 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 04:03:47.598802 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5262740d-a79b-413a-990b-bb4842fd8d58 could not be found. Oct 19 04:03:47.598802 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:03:47.598802 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e7dd6813-e895-4aa8-9675-87345e43f800 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Returning 404 to user: Instance 5262740d-a79b-413a-990b-bb4842fd8d58 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 04:03:47.598802 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e7dd6813-e895-4aa8-9675-87345e43f800 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/5262740d-a79b-413a-990b-bb4842fd8d58" status: 404 len: 111 microversion: 2.1 time: 0.030717 Oct 19 04:03:47.598802 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3698/7075] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:03:47 2022] GET /compute/v2.1/servers/5262740d-a79b-413a-990b-bb4842fd8d58 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 04:03:47.680271 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1c39fed9-e44a-4c43-88c1-02806e325fad tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Action: 'create', calling method: .version_select at 0x7fc12be9ef70>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-374641124", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHTtL+leuarbs6IP85bkirjgBcjwFOZco80TXbXF4Lhd6U0FZmmbV3Fks1oyDk546Cd4pAhl/dXn7topfURA0VcYYsJXneyGQizRaDuUJYE8tC0heWIm2A8WINx5zab5jA=="}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:03:47.702894 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-1c39fed9-e44a-4c43-88c1-02806e325fad tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Getting quotas for project beff434485604f85985617071a93727c. Resources: {'key_pairs'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 04:03:47.705875 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-1c39fed9-e44a-4c43-88c1-02806e325fad tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Getting quotas for user 4d30aa868d79473f9534bd79816c07e3 and project beff434485604f85985617071a93727c. Resources: {'key_pairs'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 04:03:47.845356 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1c39fed9-e44a-4c43-88c1-02806e325fad tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.169135 Oct 19 04:03:47.850815 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3699/7076] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Oct 19 04:03:47 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 04:04:02.978915 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:04:02.979718 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=4 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:04:02.980369 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:04:03.103454 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d958cb54-0c92-4898-bbdb-315becd815e2 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-619856209", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "networks": [{"uuid": "a5a32eb2-9eb1-4198-a1f2-ebbca231d256"}]}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:04:03.171202 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-d958cb54-0c92-4898-bbdb-315becd815e2 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] validate_networks() for [('a5a32eb2-9eb1-4198-a1f2-ebbca231d256', None, None, None, None, None)] {{(pid=121134) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 04:04:03.637384 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-d958cb54-0c92-4898-bbdb-315becd815e2 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Flavor limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 04:04:03.637860 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-d958cb54-0c92-4898-bbdb-315becd815e2 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Image limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 04:04:03.638350 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-d958cb54-0c92-4898-bbdb-315becd815e2 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Flavor pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 04:04:03.638773 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-d958cb54-0c92-4898-bbdb-315becd815e2 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Image pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 04:04:03.639202 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-d958cb54-0c92-4898-bbdb-315becd815e2 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 04:04:03.649641 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d958cb54-0c92-4898-bbdb-315becd815e2 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:04:03.650150 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d958cb54-0c92-4898-bbdb-315becd815e2 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:04:03.650602 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d958cb54-0c92-4898-bbdb-315becd815e2 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:04:03.651492 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d958cb54-0c92-4898-bbdb-315becd815e2 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:04:03.651941 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d958cb54-0c92-4898-bbdb-315becd815e2 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:04:03.652388 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d958cb54-0c92-4898-bbdb-315becd815e2 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:04:03.671489 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-d958cb54-0c92-4898-bbdb-315becd815e2 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Getting quotas for project 9d317bf5395045ecb56b14347b23c41f. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 04:04:03.677965 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-d958cb54-0c92-4898-bbdb-315becd815e2 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Getting quotas for user 634a3ba007d64fb287ac4b712db9990d and project 9d317bf5395045ecb56b14347b23c41f. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 04:04:03.692798 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d958cb54-0c92-4898-bbdb-315becd815e2 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Going to run 1 instances... {{(pid=121134) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 04:04:03.695250 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d958cb54-0c92-4898-bbdb-315becd815e2 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] [instance: 92032bf2-1aa5-4dc4-8d73-2c2524eb6bae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 04:04:03.820529 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d958cb54-0c92-4898-bbdb-315becd815e2 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.843490 Oct 19 04:04:03.821357 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3700/7077] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 04:04:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 845 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 19 04:04:03.837195 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-fb6736f7-745f-4d96-8d66-a732201b950f tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:04:03.838132 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-fb6736f7-745f-4d96-8d66-a732201b950f tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] [instance: 92032bf2-1aa5-4dc4-8d73-2c2524eb6bae] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:04:03.892517 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-fb6736f7-745f-4d96-8d66-a732201b950f tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634a3ba007d64fb287ac4b712db9990d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d317bf5395045ecb56b14347b23c41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:04:03.900405 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-fb6736f7-745f-4d96-8d66-a732201b950f tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] 10.222.0.52 "GET /compute/v2.1/servers/92032bf2-1aa5-4dc4-8d73-2c2524eb6bae" status: 200 len: 1213 microversion: 2.1 time: 0.068132 Oct 19 04:04:03.901298 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3701/7078] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:04:03 2022] GET /compute/v2.1/servers/92032bf2-1aa5-4dc4-8d73-2c2524eb6bae => generated 1213 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:04:04.923731 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-70b98236-1907-46ff-afa2-773897eba6e6 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:04:04.924371 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-70b98236-1907-46ff-afa2-773897eba6e6 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] [instance: 92032bf2-1aa5-4dc4-8d73-2c2524eb6bae] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:04:04.931409 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-70b98236-1907-46ff-afa2-773897eba6e6 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:04:04.931919 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-70b98236-1907-46ff-afa2-773897eba6e6 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:04:04.932414 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-70b98236-1907-46ff-afa2-773897eba6e6 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:04:04.933167 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-70b98236-1907-46ff-afa2-773897eba6e6 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:04:04.933671 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-70b98236-1907-46ff-afa2-773897eba6e6 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:04:04.934124 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-70b98236-1907-46ff-afa2-773897eba6e6 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:04:05.001637 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-70b98236-1907-46ff-afa2-773897eba6e6 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634a3ba007d64fb287ac4b712db9990d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d317bf5395045ecb56b14347b23c41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:04:05.009807 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-70b98236-1907-46ff-afa2-773897eba6e6 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] 10.222.0.52 "GET /compute/v2.1/servers/92032bf2-1aa5-4dc4-8d73-2c2524eb6bae" status: 200 len: 1217 microversion: 2.1 time: 0.090540 Oct 19 04:04:05.025314 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3702/7079] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:04:04 2022] GET /compute/v2.1/servers/92032bf2-1aa5-4dc4-8d73-2c2524eb6bae => generated 1217 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:04:06.032242 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d3068589-ad08-4cef-ad58-6c08e4824f27 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:04:06.032867 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d3068589-ad08-4cef-ad58-6c08e4824f27 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] [instance: 92032bf2-1aa5-4dc4-8d73-2c2524eb6bae] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:04:06.040233 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d3068589-ad08-4cef-ad58-6c08e4824f27 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:04:06.040880 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d3068589-ad08-4cef-ad58-6c08e4824f27 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:04:06.041527 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d3068589-ad08-4cef-ad58-6c08e4824f27 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:04:06.042392 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d3068589-ad08-4cef-ad58-6c08e4824f27 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:04:06.042978 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d3068589-ad08-4cef-ad58-6c08e4824f27 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:04:06.043530 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d3068589-ad08-4cef-ad58-6c08e4824f27 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:04:06.114435 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d3068589-ad08-4cef-ad58-6c08e4824f27 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634a3ba007d64fb287ac4b712db9990d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d317bf5395045ecb56b14347b23c41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:04:06.124813 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d3068589-ad08-4cef-ad58-6c08e4824f27 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] 10.222.0.52 "GET /compute/v2.1/servers/92032bf2-1aa5-4dc4-8d73-2c2524eb6bae" status: 200 len: 1273 microversion: 2.1 time: 0.096456 Oct 19 04:04:06.125419 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3703/7080] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:04:06 2022] GET /compute/v2.1/servers/92032bf2-1aa5-4dc4-8d73-2c2524eb6bae => generated 1273 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:04:07.149331 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ad1b6462-3c9f-4df0-84b9-a590fc13d6b5 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:04:07.150135 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ad1b6462-3c9f-4df0-84b9-a590fc13d6b5 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] [instance: 92032bf2-1aa5-4dc4-8d73-2c2524eb6bae] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:04:07.156727 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ad1b6462-3c9f-4df0-84b9-a590fc13d6b5 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:04:07.157230 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ad1b6462-3c9f-4df0-84b9-a590fc13d6b5 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:04:07.157708 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ad1b6462-3c9f-4df0-84b9-a590fc13d6b5 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:04:07.158919 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ad1b6462-3c9f-4df0-84b9-a590fc13d6b5 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:04:07.159398 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ad1b6462-3c9f-4df0-84b9-a590fc13d6b5 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:04:07.159883 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ad1b6462-3c9f-4df0-84b9-a590fc13d6b5 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:04:07.296017 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ad1b6462-3c9f-4df0-84b9-a590fc13d6b5 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634a3ba007d64fb287ac4b712db9990d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d317bf5395045ecb56b14347b23c41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:04:07.304345 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ad1b6462-3c9f-4df0-84b9-a590fc13d6b5 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] 10.222.0.52 "GET /compute/v2.1/servers/92032bf2-1aa5-4dc4-8d73-2c2524eb6bae" status: 200 len: 1313 microversion: 2.1 time: 0.159292 Oct 19 04:04:07.312061 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3704/7081] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:04:07 2022] GET /compute/v2.1/servers/92032bf2-1aa5-4dc4-8d73-2c2524eb6bae => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:04:07.891232 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-bf74b036-35e6-4891-bfe6-a2b96c4025c4 req-219640db-ff41-492e-b0d8-7c47f6c40eaf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92032bf2-1aa5-4dc4-8d73-2c2524eb6bae", "tag": "df043783-47f3-4cc9-937f-9136f2a0cb3d"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:04:07.901902 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-bf74b036-35e6-4891-bfe6-a2b96c4025c4 req-219640db-ff41-492e-b0d8-7c47f6c40eaf service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:04:07.902407 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-bf74b036-35e6-4891-bfe6-a2b96c4025c4 req-219640db-ff41-492e-b0d8-7c47f6c40eaf service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:04:07.902915 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-bf74b036-35e6-4891-bfe6-a2b96c4025c4 req-219640db-ff41-492e-b0d8-7c47f6c40eaf service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:04:07.918648 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-bf74b036-35e6-4891-bfe6-a2b96c4025c4 req-219640db-ff41-492e-b0d8-7c47f6c40eaf service nova] Creating event network-changed:df043783-47f3-4cc9-937f-9136f2a0cb3d for instance 92032bf2-1aa5-4dc4-8d73-2c2524eb6bae on n-h1-861333-8 Oct 19 04:04:07.924027 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-bf74b036-35e6-4891-bfe6-a2b96c4025c4 req-219640db-ff41-492e-b0d8-7c47f6c40eaf service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036419 Oct 19 04:04:07.930917 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3705/7082] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:04:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 04:04:08.330733 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-88b2a0be-06fa-422a-88a3-2d3fbe5525ef tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:04:08.331458 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-88b2a0be-06fa-422a-88a3-2d3fbe5525ef tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] [instance: 92032bf2-1aa5-4dc4-8d73-2c2524eb6bae] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:04:08.338449 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-88b2a0be-06fa-422a-88a3-2d3fbe5525ef tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:04:08.339040 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-88b2a0be-06fa-422a-88a3-2d3fbe5525ef tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:04:08.339496 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-88b2a0be-06fa-422a-88a3-2d3fbe5525ef tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:04:08.340213 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-88b2a0be-06fa-422a-88a3-2d3fbe5525ef tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:04:08.340687 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-88b2a0be-06fa-422a-88a3-2d3fbe5525ef tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:04:08.341161 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-88b2a0be-06fa-422a-88a3-2d3fbe5525ef tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:04:08.479677 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-88b2a0be-06fa-422a-88a3-2d3fbe5525ef tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634a3ba007d64fb287ac4b712db9990d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d317bf5395045ecb56b14347b23c41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:04:08.488315 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-88b2a0be-06fa-422a-88a3-2d3fbe5525ef tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] 10.222.0.52 "GET /compute/v2.1/servers/92032bf2-1aa5-4dc4-8d73-2c2524eb6bae" status: 200 len: 1313 microversion: 2.1 time: 0.163665 Oct 19 04:04:08.488923 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3706/7083] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:04:08 2022] GET /compute/v2.1/servers/92032bf2-1aa5-4dc4-8d73-2c2524eb6bae => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:04:09.511800 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b6953c97-624e-4a33-b368-6394f06966f6 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:04:09.512414 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b6953c97-624e-4a33-b368-6394f06966f6 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] [instance: 92032bf2-1aa5-4dc4-8d73-2c2524eb6bae] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:04:09.519237 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b6953c97-624e-4a33-b368-6394f06966f6 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:04:09.520339 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b6953c97-624e-4a33-b368-6394f06966f6 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:04:09.520822 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b6953c97-624e-4a33-b368-6394f06966f6 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:04:09.521586 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b6953c97-624e-4a33-b368-6394f06966f6 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:04:09.522064 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b6953c97-624e-4a33-b368-6394f06966f6 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:04:09.522513 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b6953c97-624e-4a33-b368-6394f06966f6 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:04:09.652155 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b6953c97-624e-4a33-b368-6394f06966f6 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634a3ba007d64fb287ac4b712db9990d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d317bf5395045ecb56b14347b23c41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:04:09.660061 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b6953c97-624e-4a33-b368-6394f06966f6 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] 10.222.0.52 "GET /compute/v2.1/servers/92032bf2-1aa5-4dc4-8d73-2c2524eb6bae" status: 200 len: 1313 microversion: 2.1 time: 0.152257 Oct 19 04:04:09.660636 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3707/7084] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:04:09 2022] GET /compute/v2.1/servers/92032bf2-1aa5-4dc4-8d73-2c2524eb6bae => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:04:10.683015 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-19d52cd4-2368-44ef-ac30-248515a89f34 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:04:10.683650 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-19d52cd4-2368-44ef-ac30-248515a89f34 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] [instance: 92032bf2-1aa5-4dc4-8d73-2c2524eb6bae] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:04:10.690739 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-19d52cd4-2368-44ef-ac30-248515a89f34 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:04:10.691252 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-19d52cd4-2368-44ef-ac30-248515a89f34 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:04:10.691720 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-19d52cd4-2368-44ef-ac30-248515a89f34 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:04:10.692443 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-19d52cd4-2368-44ef-ac30-248515a89f34 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:04:10.692924 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-19d52cd4-2368-44ef-ac30-248515a89f34 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:04:10.693387 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-19d52cd4-2368-44ef-ac30-248515a89f34 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:04:10.836180 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-19d52cd4-2368-44ef-ac30-248515a89f34 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634a3ba007d64fb287ac4b712db9990d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d317bf5395045ecb56b14347b23c41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:04:10.845186 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-19d52cd4-2368-44ef-ac30-248515a89f34 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] 10.222.0.52 "GET /compute/v2.1/servers/92032bf2-1aa5-4dc4-8d73-2c2524eb6bae" status: 200 len: 1313 microversion: 2.1 time: 0.166015 Oct 19 04:04:10.845856 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3708/7085] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:04:10 2022] GET /compute/v2.1/servers/92032bf2-1aa5-4dc4-8d73-2c2524eb6bae => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:04:11.868449 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9eadd331-95e8-49c3-99f0-110fefa7f513 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:04:11.869076 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9eadd331-95e8-49c3-99f0-110fefa7f513 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] [instance: 92032bf2-1aa5-4dc4-8d73-2c2524eb6bae] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:04:11.876548 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9eadd331-95e8-49c3-99f0-110fefa7f513 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:04:11.877068 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9eadd331-95e8-49c3-99f0-110fefa7f513 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:04:11.877562 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9eadd331-95e8-49c3-99f0-110fefa7f513 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:04:11.878299 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9eadd331-95e8-49c3-99f0-110fefa7f513 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:04:11.879273 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9eadd331-95e8-49c3-99f0-110fefa7f513 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:04:11.880438 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9eadd331-95e8-49c3-99f0-110fefa7f513 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:04:12.022137 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9eadd331-95e8-49c3-99f0-110fefa7f513 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634a3ba007d64fb287ac4b712db9990d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d317bf5395045ecb56b14347b23c41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:04:12.030246 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9eadd331-95e8-49c3-99f0-110fefa7f513 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] 10.222.0.52 "GET /compute/v2.1/servers/92032bf2-1aa5-4dc4-8d73-2c2524eb6bae" status: 200 len: 1313 microversion: 2.1 time: 0.165859 Oct 19 04:04:12.030832 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3709/7086] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:04:11 2022] GET /compute/v2.1/servers/92032bf2-1aa5-4dc4-8d73-2c2524eb6bae => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:04:13.054202 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ee7ab53c-381e-4786-970c-7fedc25ca97d tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:04:13.054813 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ee7ab53c-381e-4786-970c-7fedc25ca97d tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] [instance: 92032bf2-1aa5-4dc4-8d73-2c2524eb6bae] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:04:13.061678 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ee7ab53c-381e-4786-970c-7fedc25ca97d tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:04:13.062187 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ee7ab53c-381e-4786-970c-7fedc25ca97d tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:04:13.062644 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ee7ab53c-381e-4786-970c-7fedc25ca97d tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:04:13.063359 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ee7ab53c-381e-4786-970c-7fedc25ca97d tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:04:13.063841 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ee7ab53c-381e-4786-970c-7fedc25ca97d tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:04:13.064294 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ee7ab53c-381e-4786-970c-7fedc25ca97d tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:04:13.194898 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ee7ab53c-381e-4786-970c-7fedc25ca97d tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634a3ba007d64fb287ac4b712db9990d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d317bf5395045ecb56b14347b23c41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:04:13.203138 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ee7ab53c-381e-4786-970c-7fedc25ca97d tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] 10.222.0.52 "GET /compute/v2.1/servers/92032bf2-1aa5-4dc4-8d73-2c2524eb6bae" status: 200 len: 1313 microversion: 2.1 time: 0.153438 Oct 19 04:04:13.203726 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3710/7087] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:04:13 2022] GET /compute/v2.1/servers/92032bf2-1aa5-4dc4-8d73-2c2524eb6bae => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:04:13.373686 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-975547db-793f-4e46-8710-c971df202cbd tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1485852738", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-374641124", "security_groups": [{"name": "tempest-secgroup-smoke-777567092"}], "block_device_mapping_v2": [{"uuid": "806b3a42-ea4f-499f-9161-9b935b2baf57", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d55e7db4-c570-4a69-afcb-0fab975a7a7e"}]}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:04:13.499472 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-975547db-793f-4e46-8710-c971df202cbd tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] validate_networks() for [('d55e7db4-c570-4a69-afcb-0fab975a7a7e', None, None, None, None, None)] {{(pid=121134) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 04:04:13.662419 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:04:13.897126 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=8 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:04:14.146162 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-975547db-793f-4e46-8710-c971df202cbd tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Flavor limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 04:04:14.146683 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-975547db-793f-4e46-8710-c971df202cbd tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Image limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 04:04:14.147295 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-975547db-793f-4e46-8710-c971df202cbd tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Flavor pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 04:04:14.147742 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-975547db-793f-4e46-8710-c971df202cbd tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Image pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 04:04:14.148539 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-975547db-793f-4e46-8710-c971df202cbd tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 04:04:14.157596 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-975547db-793f-4e46-8710-c971df202cbd tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:04:14.158179 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-975547db-793f-4e46-8710-c971df202cbd tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:04:14.159022 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-975547db-793f-4e46-8710-c971df202cbd tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:04:14.159528 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-975547db-793f-4e46-8710-c971df202cbd tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:04:14.160095 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-975547db-793f-4e46-8710-c971df202cbd tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:04:14.160619 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-975547db-793f-4e46-8710-c971df202cbd tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:04:14.178077 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-975547db-793f-4e46-8710-c971df202cbd tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Getting quotas for project beff434485604f85985617071a93727c. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 04:04:14.183647 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-975547db-793f-4e46-8710-c971df202cbd tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Getting quotas for user 4d30aa868d79473f9534bd79816c07e3 and project beff434485604f85985617071a93727c. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 04:04:14.242197 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-975547db-793f-4e46-8710-c971df202cbd tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Going to run 1 instances... {{(pid=121134) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 04:04:14.244444 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-975547db-793f-4e46-8710-c971df202cbd tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='806b3a42-ea4f-499f-9161-9b935b2baf57',volume_size=None,volume_type=None)] {{(pid=121134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 04:04:14.627068 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-975547db-793f-4e46-8710-c971df202cbd tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.257218 Oct 19 04:04:14.627734 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3711/7088] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 04:04:13 2022] POST /compute/v2.1/servers => generated 405 bytes in 1259 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 19 04:04:14.632318 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e7b16c50-5566-4082-8afd-490a20018216 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:04:14.633116 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e7b16c50-5566-4082-8afd-490a20018216 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] [instance: 92032bf2-1aa5-4dc4-8d73-2c2524eb6bae] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:04:14.639264 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e7b16c50-5566-4082-8afd-490a20018216 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:04:14.639792 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e7b16c50-5566-4082-8afd-490a20018216 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:04:14.640244 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e7b16c50-5566-4082-8afd-490a20018216 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:04:14.640973 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e7b16c50-5566-4082-8afd-490a20018216 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:04:14.641448 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e7b16c50-5566-4082-8afd-490a20018216 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:04:14.642649 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e7b16c50-5566-4082-8afd-490a20018216 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:04:14.776097 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e7b16c50-5566-4082-8afd-490a20018216 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634a3ba007d64fb287ac4b712db9990d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d317bf5395045ecb56b14347b23c41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:04:14.784734 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e7b16c50-5566-4082-8afd-490a20018216 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] 10.222.0.52 "GET /compute/v2.1/servers/92032bf2-1aa5-4dc4-8d73-2c2524eb6bae" status: 200 len: 1313 microversion: 2.1 time: 0.155703 Oct 19 04:04:14.788182 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3712/7089] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:04:14 2022] GET /compute/v2.1/servers/92032bf2-1aa5-4dc4-8d73-2c2524eb6bae => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:04:14.797399 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-c21a490e-1817-4fc1-8328-0e3c18e73fe9 req-d23c017e-d747-4089-8a2d-b91703045202 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92032bf2-1aa5-4dc4-8d73-2c2524eb6bae", "name": "network-vif-plugged", "status": "completed", "tag": "df043783-47f3-4cc9-937f-9136f2a0cb3d"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:04:14.808138 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-c21a490e-1817-4fc1-8328-0e3c18e73fe9 req-d23c017e-d747-4089-8a2d-b91703045202 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:04:14.808700 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-c21a490e-1817-4fc1-8328-0e3c18e73fe9 req-d23c017e-d747-4089-8a2d-b91703045202 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:04:14.809167 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-c21a490e-1817-4fc1-8328-0e3c18e73fe9 req-d23c017e-d747-4089-8a2d-b91703045202 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:04:14.821700 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-c21a490e-1817-4fc1-8328-0e3c18e73fe9 req-d23c017e-d747-4089-8a2d-b91703045202 service nova] Creating event network-vif-plugged:df043783-47f3-4cc9-937f-9136f2a0cb3d for instance 92032bf2-1aa5-4dc4-8d73-2c2524eb6bae on n-h1-861333-8 Oct 19 04:04:14.826705 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-c21a490e-1817-4fc1-8328-0e3c18e73fe9 req-d23c017e-d747-4089-8a2d-b91703045202 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033535 Oct 19 04:04:14.827304 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3713/7090] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:04:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:04:14.832297 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b869bff2-a5ee-4426-9817-a524541309e2 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:04:14.833205 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b869bff2-a5ee-4426-9817-a524541309e2 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:04:14.889192 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b869bff2-a5ee-4426-9817-a524541309e2 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:04:14.896360 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b869bff2-a5ee-4426-9817-a524541309e2 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56" status: 200 len: 1094 microversion: 2.1 time: 0.067918 Oct 19 04:04:14.896941 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3714/7091] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:04:14 2022] GET /compute/v2.1/servers/9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56 => generated 1094 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:04:15.811363 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6592b66b-1a69-4122-8e14-9b5df338941a tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:04:15.811976 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6592b66b-1a69-4122-8e14-9b5df338941a tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] [instance: 92032bf2-1aa5-4dc4-8d73-2c2524eb6bae] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:04:15.819686 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6592b66b-1a69-4122-8e14-9b5df338941a tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:04:15.820194 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6592b66b-1a69-4122-8e14-9b5df338941a tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:04:15.820653 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6592b66b-1a69-4122-8e14-9b5df338941a tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:04:15.821394 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6592b66b-1a69-4122-8e14-9b5df338941a tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:04:15.821878 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6592b66b-1a69-4122-8e14-9b5df338941a tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:04:15.822326 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6592b66b-1a69-4122-8e14-9b5df338941a tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:04:15.958424 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-6592b66b-1a69-4122-8e14-9b5df338941a tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634a3ba007d64fb287ac4b712db9990d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d317bf5395045ecb56b14347b23c41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:04:15.966311 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6592b66b-1a69-4122-8e14-9b5df338941a tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] 10.222.0.52 "GET /compute/v2.1/servers/92032bf2-1aa5-4dc4-8d73-2c2524eb6bae" status: 200 len: 1313 microversion: 2.1 time: 0.158918 Oct 19 04:04:15.966885 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3715/7092] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:04:15 2022] GET /compute/v2.1/servers/92032bf2-1aa5-4dc4-8d73-2c2524eb6bae => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:04:15.971311 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-152852a0-e132-4633-b304-088f575ef870 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:04:15.971934 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-152852a0-e132-4633-b304-088f575ef870 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:04:15.978465 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-152852a0-e132-4633-b304-088f575ef870 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:04:15.978973 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-152852a0-e132-4633-b304-088f575ef870 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:04:15.979453 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-152852a0-e132-4633-b304-088f575ef870 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:04:15.982766 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-152852a0-e132-4633-b304-088f575ef870 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:04:15.982766 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-152852a0-e132-4633-b304-088f575ef870 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:04:15.982766 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-152852a0-e132-4633-b304-088f575ef870 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:04:16.044569 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-152852a0-e132-4633-b304-088f575ef870 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:04:16.053904 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-152852a0-e132-4633-b304-088f575ef870 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56" status: 200 len: 1136 microversion: 2.1 time: 0.085960 Oct 19 04:04:16.054504 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3716/7093] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:04:15 2022] GET /compute/v2.1/servers/9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56 => generated 1136 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:04:16.990600 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c80fd3f2-f257-448a-a3d2-94421ca0e4f8 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:04:16.991810 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c80fd3f2-f257-448a-a3d2-94421ca0e4f8 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] [instance: 92032bf2-1aa5-4dc4-8d73-2c2524eb6bae] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:04:16.999226 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c80fd3f2-f257-448a-a3d2-94421ca0e4f8 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:04:16.999732 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c80fd3f2-f257-448a-a3d2-94421ca0e4f8 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:04:17.000311 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c80fd3f2-f257-448a-a3d2-94421ca0e4f8 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:04:17.001039 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c80fd3f2-f257-448a-a3d2-94421ca0e4f8 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:04:17.001538 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c80fd3f2-f257-448a-a3d2-94421ca0e4f8 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:04:17.001989 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c80fd3f2-f257-448a-a3d2-94421ca0e4f8 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:04:17.212822 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c80fd3f2-f257-448a-a3d2-94421ca0e4f8 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634a3ba007d64fb287ac4b712db9990d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d317bf5395045ecb56b14347b23c41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:04:17.220936 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c80fd3f2-f257-448a-a3d2-94421ca0e4f8 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] 10.222.0.52 "GET /compute/v2.1/servers/92032bf2-1aa5-4dc4-8d73-2c2524eb6bae" status: 200 len: 1496 microversion: 2.1 time: 0.234791 Oct 19 04:04:17.235180 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3717/7094] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:04:16 2022] GET /compute/v2.1/servers/92032bf2-1aa5-4dc4-8d73-2c2524eb6bae => generated 1496 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:04:17.235180 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c5a7c3dc-57c9-4abb-b5b1-baf356093be8 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:04:17.235180 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c5a7c3dc-57c9-4abb-b5b1-baf356093be8 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:04:17.235180 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c5a7c3dc-57c9-4abb-b5b1-baf356093be8 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:04:17.235591 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c5a7c3dc-57c9-4abb-b5b1-baf356093be8 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:04:17.236084 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c5a7c3dc-57c9-4abb-b5b1-baf356093be8 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:04:17.241248 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c5a7c3dc-57c9-4abb-b5b1-baf356093be8 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:04:17.241248 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c5a7c3dc-57c9-4abb-b5b1-baf356093be8 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:04:17.241248 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c5a7c3dc-57c9-4abb-b5b1-baf356093be8 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:04:17.329225 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c5a7c3dc-57c9-4abb-b5b1-baf356093be8 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:04:17.338285 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c5a7c3dc-57c9-4abb-b5b1-baf356093be8 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56" status: 200 len: 1210 microversion: 2.1 time: 0.115442 Oct 19 04:04:17.339398 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3718/7095] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:04:17 2022] GET /compute/v2.1/servers/9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56 => generated 1210 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:04:18.361847 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-730b3052-260b-4f7a-aa23-ebdda70f56ca tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:04:18.362693 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-730b3052-260b-4f7a-aa23-ebdda70f56ca tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:04:18.371733 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-730b3052-260b-4f7a-aa23-ebdda70f56ca tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:04:18.372339 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-730b3052-260b-4f7a-aa23-ebdda70f56ca tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:04:18.373238 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-730b3052-260b-4f7a-aa23-ebdda70f56ca tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:04:18.375052 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-730b3052-260b-4f7a-aa23-ebdda70f56ca tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:04:18.375697 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-730b3052-260b-4f7a-aa23-ebdda70f56ca tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:04:18.376412 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-730b3052-260b-4f7a-aa23-ebdda70f56ca tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:04:18.604907 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-730b3052-260b-4f7a-aa23-ebdda70f56ca tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:04:18.614986 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-730b3052-260b-4f7a-aa23-ebdda70f56ca tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56" status: 200 len: 1277 microversion: 2.1 time: 0.257417 Oct 19 04:04:18.616145 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3719/7096] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:04:18 2022] GET /compute/v2.1/servers/9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56 => generated 1277 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:04:18.975317 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-740bfacb-8262-41dd-bfa5-97e8dc59ab2b req-a3cac6f7-9c14-4115-9166-32ae9f86fc4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56", "tag": "9ed3b59c-9a02-414c-8eef-84c24b8c531d"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:04:18.986166 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-740bfacb-8262-41dd-bfa5-97e8dc59ab2b req-a3cac6f7-9c14-4115-9166-32ae9f86fc4e service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:04:18.986577 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-740bfacb-8262-41dd-bfa5-97e8dc59ab2b req-a3cac6f7-9c14-4115-9166-32ae9f86fc4e service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:04:18.987015 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-740bfacb-8262-41dd-bfa5-97e8dc59ab2b req-a3cac6f7-9c14-4115-9166-32ae9f86fc4e service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:04:19.001778 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-740bfacb-8262-41dd-bfa5-97e8dc59ab2b req-a3cac6f7-9c14-4115-9166-32ae9f86fc4e service nova] Creating event network-changed:9ed3b59c-9a02-414c-8eef-84c24b8c531d for instance 9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56 on n-h2-861333-8 Oct 19 04:04:19.007557 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-740bfacb-8262-41dd-bfa5-97e8dc59ab2b req-a3cac6f7-9c14-4115-9166-32ae9f86fc4e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110866 Oct 19 04:04:19.008172 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3720/7097] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:04:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 04:04:19.640157 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a4363224-6c62-4595-9a2b-7c41569d558e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:04:19.640954 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a4363224-6c62-4595-9a2b-7c41569d558e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:04:19.650046 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a4363224-6c62-4595-9a2b-7c41569d558e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:04:19.650564 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a4363224-6c62-4595-9a2b-7c41569d558e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:04:19.651030 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a4363224-6c62-4595-9a2b-7c41569d558e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:04:19.651816 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a4363224-6c62-4595-9a2b-7c41569d558e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:04:19.652280 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a4363224-6c62-4595-9a2b-7c41569d558e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:04:19.653236 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a4363224-6c62-4595-9a2b-7c41569d558e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:04:19.862440 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a4363224-6c62-4595-9a2b-7c41569d558e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:04:19.867052 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=100 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:04:19.872067 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a4363224-6c62-4595-9a2b-7c41569d558e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56" status: 200 len: 1277 microversion: 2.1 time: 0.236447 Oct 19 04:04:19.872865 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3721/7098] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:04:19 2022] GET /compute/v2.1/servers/9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56 => generated 1277 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:04:20.895237 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e5ad2ab7-d835-4bc7-a96c-9725644f7903 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:04:20.897256 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e5ad2ab7-d835-4bc7-a96c-9725644f7903 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:04:20.905645 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e5ad2ab7-d835-4bc7-a96c-9725644f7903 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:04:20.906420 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e5ad2ab7-d835-4bc7-a96c-9725644f7903 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:04:20.907115 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e5ad2ab7-d835-4bc7-a96c-9725644f7903 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:04:20.907850 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e5ad2ab7-d835-4bc7-a96c-9725644f7903 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:04:20.908378 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e5ad2ab7-d835-4bc7-a96c-9725644f7903 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:04:20.908826 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e5ad2ab7-d835-4bc7-a96c-9725644f7903 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:04:21.052916 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e5ad2ab7-d835-4bc7-a96c-9725644f7903 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:04:21.061513 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e5ad2ab7-d835-4bc7-a96c-9725644f7903 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56" status: 200 len: 1277 microversion: 2.1 time: 0.170071 Oct 19 04:04:21.062108 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3722/7099] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:04:20 2022] GET /compute/v2.1/servers/9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56 => generated 1277 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:04:21.785343 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ead652f5-50da-4d59-be77-0e9ef35a96c6 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:04:21.785897 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ead652f5-50da-4d59-be77-0e9ef35a96c6 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] [instance: 92032bf2-1aa5-4dc4-8d73-2c2524eb6bae] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:04:21.791949 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ead652f5-50da-4d59-be77-0e9ef35a96c6 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:04:21.792450 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ead652f5-50da-4d59-be77-0e9ef35a96c6 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:04:21.792900 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ead652f5-50da-4d59-be77-0e9ef35a96c6 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:04:21.793629 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ead652f5-50da-4d59-be77-0e9ef35a96c6 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:04:21.794129 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ead652f5-50da-4d59-be77-0e9ef35a96c6 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:04:21.794569 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ead652f5-50da-4d59-be77-0e9ef35a96c6 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:04:21.818757 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ead652f5-50da-4d59-be77-0e9ef35a96c6 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] [instance: 92032bf2-1aa5-4dc4-8d73-2c2524eb6bae] Going to try to terminate instance {{(pid=121134) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 04:04:22.076082 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ead652f5-50da-4d59-be77-0e9ef35a96c6 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] 10.222.0.52 "DELETE /compute/v2.1/servers/92032bf2-1aa5-4dc4-8d73-2c2524eb6bae" status: 204 len: 0 microversion: 2.1 time: 0.295200 Oct 19 04:04:22.076736 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3723/7100] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 04:04:21 2022] DELETE /compute/v2.1/servers/92032bf2-1aa5-4dc4-8d73-2c2524eb6bae => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 19 04:04:22.085789 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0ab20b34-59ad-40b4-a23c-c1b3229cbf2d tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:04:22.086513 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0ab20b34-59ad-40b4-a23c-c1b3229cbf2d tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] [instance: 92032bf2-1aa5-4dc4-8d73-2c2524eb6bae] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:04:22.092636 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0ab20b34-59ad-40b4-a23c-c1b3229cbf2d tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:04:22.093155 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0ab20b34-59ad-40b4-a23c-c1b3229cbf2d tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:04:22.093639 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0ab20b34-59ad-40b4-a23c-c1b3229cbf2d tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:04:22.094354 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0ab20b34-59ad-40b4-a23c-c1b3229cbf2d tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:04:22.094826 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0ab20b34-59ad-40b4-a23c-c1b3229cbf2d tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:04:22.095272 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0ab20b34-59ad-40b4-a23c-c1b3229cbf2d tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:04:22.233918 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0ab20b34-59ad-40b4-a23c-c1b3229cbf2d tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634a3ba007d64fb287ac4b712db9990d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d317bf5395045ecb56b14347b23c41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:04:22.242423 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0ab20b34-59ad-40b4-a23c-c1b3229cbf2d tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] 10.222.0.52 "GET /compute/v2.1/servers/92032bf2-1aa5-4dc4-8d73-2c2524eb6bae" status: 200 len: 1502 microversion: 2.1 time: 0.161074 Oct 19 04:04:22.254167 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3724/7101] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:04:22 2022] GET /compute/v2.1/servers/92032bf2-1aa5-4dc4-8d73-2c2524eb6bae => generated 1502 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:04:22.254167 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-707e6965-4bdd-403b-b8a1-e02ded7361c3 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:04:22.254167 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-707e6965-4bdd-403b-b8a1-e02ded7361c3 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:04:22.254592 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-707e6965-4bdd-403b-b8a1-e02ded7361c3 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:04:22.255261 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-707e6965-4bdd-403b-b8a1-e02ded7361c3 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:04:22.255724 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-707e6965-4bdd-403b-b8a1-e02ded7361c3 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:04:22.256441 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-707e6965-4bdd-403b-b8a1-e02ded7361c3 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:04:22.256964 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-707e6965-4bdd-403b-b8a1-e02ded7361c3 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:04:22.257361 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-707e6965-4bdd-403b-b8a1-e02ded7361c3 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:04:22.389008 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-707e6965-4bdd-403b-b8a1-e02ded7361c3 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:04:22.397565 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-707e6965-4bdd-403b-b8a1-e02ded7361c3 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56" status: 200 len: 1277 microversion: 2.1 time: 0.153436 Oct 19 04:04:22.398171 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3725/7102] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:04:22 2022] GET /compute/v2.1/servers/9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56 => generated 1277 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:04:23.267822 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-559813e3-a7e4-4b62-aeba-2e3106b70c60 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:04:23.268478 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-559813e3-a7e4-4b62-aeba-2e3106b70c60 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] [instance: 92032bf2-1aa5-4dc4-8d73-2c2524eb6bae] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:04:23.275796 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-559813e3-a7e4-4b62-aeba-2e3106b70c60 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:04:23.276302 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-559813e3-a7e4-4b62-aeba-2e3106b70c60 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:04:23.276761 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-559813e3-a7e4-4b62-aeba-2e3106b70c60 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:04:23.277510 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-559813e3-a7e4-4b62-aeba-2e3106b70c60 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:04:23.277987 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-559813e3-a7e4-4b62-aeba-2e3106b70c60 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:04:23.278433 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-559813e3-a7e4-4b62-aeba-2e3106b70c60 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:04:23.411264 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-559813e3-a7e4-4b62-aeba-2e3106b70c60 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634a3ba007d64fb287ac4b712db9990d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d317bf5395045ecb56b14347b23c41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:04:23.419380 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-559813e3-a7e4-4b62-aeba-2e3106b70c60 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] 10.222.0.52 "GET /compute/v2.1/servers/92032bf2-1aa5-4dc4-8d73-2c2524eb6bae" status: 200 len: 1502 microversion: 2.1 time: 0.155567 Oct 19 04:04:23.419943 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3726/7103] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:04:23 2022] GET /compute/v2.1/servers/92032bf2-1aa5-4dc4-8d73-2c2524eb6bae => generated 1502 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:04:23.424284 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-203d14d6-31cf-42cc-90b7-50a592dfd1bc tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:04:23.424897 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-203d14d6-31cf-42cc-90b7-50a592dfd1bc tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:04:23.431022 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-203d14d6-31cf-42cc-90b7-50a592dfd1bc tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:04:23.431517 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-203d14d6-31cf-42cc-90b7-50a592dfd1bc tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:04:23.431963 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-203d14d6-31cf-42cc-90b7-50a592dfd1bc tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:04:23.432657 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-203d14d6-31cf-42cc-90b7-50a592dfd1bc tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:04:23.433122 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-203d14d6-31cf-42cc-90b7-50a592dfd1bc tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:04:23.433588 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-203d14d6-31cf-42cc-90b7-50a592dfd1bc tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:04:23.559808 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-203d14d6-31cf-42cc-90b7-50a592dfd1bc tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:04:23.568159 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-203d14d6-31cf-42cc-90b7-50a592dfd1bc tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56" status: 200 len: 1265 microversion: 2.1 time: 0.147264 Oct 19 04:04:23.568759 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3727/7104] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:04:23 2022] GET /compute/v2.1/servers/9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56 => generated 1265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:04:24.363244 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-32f6a988-2468-495c-beb5-2b05dd399e45 req-958ef089-6749-46d9-86ac-832014d804fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92032bf2-1aa5-4dc4-8d73-2c2524eb6bae", "name": "network-vif-deleted", "tag": "df043783-47f3-4cc9-937f-9136f2a0cb3d"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:04:24.368619 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:04:24.376346 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-32f6a988-2468-495c-beb5-2b05dd399e45 req-958ef089-6749-46d9-86ac-832014d804fb service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:04:24.376843 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-32f6a988-2468-495c-beb5-2b05dd399e45 req-958ef089-6749-46d9-86ac-832014d804fb service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:04:24.381214 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-32f6a988-2468-495c-beb5-2b05dd399e45 req-958ef089-6749-46d9-86ac-832014d804fb service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:04:24.393171 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-32f6a988-2468-495c-beb5-2b05dd399e45 req-958ef089-6749-46d9-86ac-832014d804fb service nova] Creating event network-vif-deleted:df043783-47f3-4cc9-937f-9136f2a0cb3d for instance 92032bf2-1aa5-4dc4-8d73-2c2524eb6bae on n-h1-861333-8 Oct 19 04:04:24.400295 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-32f6a988-2468-495c-beb5-2b05dd399e45 req-958ef089-6749-46d9-86ac-832014d804fb service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040912 Oct 19 04:04:24.400914 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3728/7105] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:04:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:04:24.444218 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0c2513a6-6968-4ed1-87c2-39311c4c3ebe tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:04:24.445005 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0c2513a6-6968-4ed1-87c2-39311c4c3ebe tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] [instance: 92032bf2-1aa5-4dc4-8d73-2c2524eb6bae] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:04:24.449506 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:04:24.453725 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0c2513a6-6968-4ed1-87c2-39311c4c3ebe tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:04:24.454236 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0c2513a6-6968-4ed1-87c2-39311c4c3ebe tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:04:24.454687 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0c2513a6-6968-4ed1-87c2-39311c4c3ebe tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:04:24.455404 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0c2513a6-6968-4ed1-87c2-39311c4c3ebe tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:04:24.455867 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0c2513a6-6968-4ed1-87c2-39311c4c3ebe tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:04:24.456306 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0c2513a6-6968-4ed1-87c2-39311c4c3ebe tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:04:24.518537 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0c2513a6-6968-4ed1-87c2-39311c4c3ebe tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634a3ba007d64fb287ac4b712db9990d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d317bf5395045ecb56b14347b23c41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:04:24.528053 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0c2513a6-6968-4ed1-87c2-39311c4c3ebe tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] 10.222.0.52 "GET /compute/v2.1/servers/92032bf2-1aa5-4dc4-8d73-2c2524eb6bae" status: 200 len: 1460 microversion: 2.1 time: 0.088795 Oct 19 04:04:24.528631 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3729/7106] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:04:24 2022] GET /compute/v2.1/servers/92032bf2-1aa5-4dc4-8d73-2c2524eb6bae => generated 1460 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:04:24.591460 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9a91a9df-f5a8-4fbe-8fc0-1dd7a6a37c4b tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:04:24.592134 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9a91a9df-f5a8-4fbe-8fc0-1dd7a6a37c4b tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:04:24.598937 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9a91a9df-f5a8-4fbe-8fc0-1dd7a6a37c4b tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:04:24.599447 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9a91a9df-f5a8-4fbe-8fc0-1dd7a6a37c4b tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:04:24.599948 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9a91a9df-f5a8-4fbe-8fc0-1dd7a6a37c4b tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:04:24.600820 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9a91a9df-f5a8-4fbe-8fc0-1dd7a6a37c4b tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:04:24.601724 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9a91a9df-f5a8-4fbe-8fc0-1dd7a6a37c4b tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:04:24.602607 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9a91a9df-f5a8-4fbe-8fc0-1dd7a6a37c4b tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:04:24.740813 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9a91a9df-f5a8-4fbe-8fc0-1dd7a6a37c4b tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:04:24.748747 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9a91a9df-f5a8-4fbe-8fc0-1dd7a6a37c4b tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56" status: 200 len: 1265 microversion: 2.1 time: 0.161171 Oct 19 04:04:24.749317 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3730/7107] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:04:24 2022] GET /compute/v2.1/servers/9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:04:25.551305 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-03037946-928e-4a4e-8a84-5289a503c843 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:04:25.551942 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-03037946-928e-4a4e-8a84-5289a503c843 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] [instance: 92032bf2-1aa5-4dc4-8d73-2c2524eb6bae] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:04:25.553866 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=8 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:04:25.559654 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-03037946-928e-4a4e-8a84-5289a503c843 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:04:25.560164 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-03037946-928e-4a4e-8a84-5289a503c843 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:04:25.560622 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-03037946-928e-4a4e-8a84-5289a503c843 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:04:25.561417 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-03037946-928e-4a4e-8a84-5289a503c843 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:04:25.561898 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-03037946-928e-4a4e-8a84-5289a503c843 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:04:25.562349 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-03037946-928e-4a4e-8a84-5289a503c843 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:04:25.575967 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-03037946-928e-4a4e-8a84-5289a503c843 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] HTTP exception thrown: Instance 92032bf2-1aa5-4dc4-8d73-2c2524eb6bae could not be found. Oct 19 04:04:25.577666 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-03037946-928e-4a4e-8a84-5289a503c843 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Request method failure captured: Oct 19 04:04:25.577666 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/92032bf2-1aa5-4dc4-8d73-2c2524eb6bae HTTP/1.1 Oct 19 04:04:25.577666 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 04:04:25.577666 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 04:04:25.577666 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 04:04:25.577666 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 04:04:25.577666 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 04:04:25.577666 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 04:04:25.577666 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 04:04:25.577666 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 04:04:25.577666 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3cwZ-gTo61Ofsg1LX2XCB4kvDxqkbxUHgqrCMmyIeL2r7PjJtgTLbi34cDqEYfextriJjaD2X-6XIqTCVQ-Wxflg5gkRcTQfDvnEYzt1dlCF5v4NkavJyOeRj-Po9fietfrixLIOxeM8c_R1GCair29eyPH5uo9U_O8iAmlN9hlhgc Oct 19 04:04:25.577666 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 04:04:25.577666 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 04:04:25.577666 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 04:04:25.577666 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 04:04:25.577666 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 04:04:25.577666 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 04:04:25.577666 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 9d317bf5395045ecb56b14347b23c41f Oct 19 04:04:25.577666 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-VolumesActionsTest-1980160199 Oct 19 04:04:25.577666 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 04:04:25.577666 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 04:04:25.577666 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9d317bf5395045ecb56b14347b23c41f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9d317bf5395045ecb56b14347b23c41f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9d317bf5395045ecb56b14347b23c41f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9d317bf5395045ecb56b14347b23c41f", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 04:04:25.577666 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-VolumesActionsTest-1980160199 Oct 19 04:04:25.577666 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 9d317bf5395045ecb56b14347b23c41f Oct 19 04:04:25.577666 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-VolumesActionsTest-1980160199 Oct 19 04:04:25.577666 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-VolumesActionsTest-1980160199-project Oct 19 04:04:25.577666 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 04:04:25.577666 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 04:04:25.577666 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 634a3ba007d64fb287ac4b712db9990d Oct 19 04:04:25.577666 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-VolumesActionsTest-1980160199-project Oct 19 04:04:25.577666 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 04:04:25.577666 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance 92032bf2-1aa5-4dc4-8d73-2c2524eb6bae could not be found. Oct 19 04:04:25.577666 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '92032bf2-1aa5-4dc4-8d73-2c2524eb6bae'} Oct 19 04:04:25.577666 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 04:04:25.577666 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:04:25.577666 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 04:04:25.577666 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 04:04:25.577666 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 04:04:25.577666 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 04:04:25.577666 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 04:04:25.577666 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 04:04:25.577666 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 04:04:25.577666 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 04:04:25.577666 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92032bf2-1aa5-4dc4-8d73-2c2524eb6bae could not be found. Oct 19 04:04:25.577666 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:04:25.577666 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:04:25.577666 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:04:25.577666 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:04:25.577666 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:04:25.577666 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:04:25.577666 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 04:04:25.577666 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 04:04:25.577666 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 04:04:25.577666 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 04:04:25.577666 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 04:04:25.577666 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 04:04:25.577666 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 04:04:25.577666 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 04:04:25.577666 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 04:04:25.577666 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 04:04:25.577666 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92032bf2-1aa5-4dc4-8d73-2c2524eb6bae could not be found. Oct 19 04:04:25.577666 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:04:25.577666 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:04:25.577666 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:04:25.582612 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:04:25.582612 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:04:25.582612 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:04:25.582612 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 04:04:25.582612 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 04:04:25.582612 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92032bf2-1aa5-4dc4-8d73-2c2524eb6bae could not be found. Oct 19 04:04:25.582612 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:04:25.582612 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-03037946-928e-4a4e-8a84-5289a503c843 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] Returning 404 to user: Instance 92032bf2-1aa5-4dc4-8d73-2c2524eb6bae could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 04:04:25.582612 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-03037946-928e-4a4e-8a84-5289a503c843 tempest-VolumesActionsTest-1980160199 tempest-VolumesActionsTest-1980160199-project] 10.222.0.52 "GET /compute/v2.1/servers/92032bf2-1aa5-4dc4-8d73-2c2524eb6bae" status: 404 len: 111 microversion: 2.1 time: 0.031836 Oct 19 04:04:25.582612 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3731/7108] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:04:25 2022] GET /compute/v2.1/servers/92032bf2-1aa5-4dc4-8d73-2c2524eb6bae => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 04:04:25.772987 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b57ea1fe-ee6f-41cb-9191-a11af6855de3 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:04:25.774303 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b57ea1fe-ee6f-41cb-9191-a11af6855de3 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:04:25.780682 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b57ea1fe-ee6f-41cb-9191-a11af6855de3 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:04:25.781237 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b57ea1fe-ee6f-41cb-9191-a11af6855de3 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:04:25.781732 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b57ea1fe-ee6f-41cb-9191-a11af6855de3 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:04:25.782455 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b57ea1fe-ee6f-41cb-9191-a11af6855de3 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:04:25.782928 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b57ea1fe-ee6f-41cb-9191-a11af6855de3 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:04:25.783375 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b57ea1fe-ee6f-41cb-9191-a11af6855de3 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:04:25.914661 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b57ea1fe-ee6f-41cb-9191-a11af6855de3 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:04:25.922686 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b57ea1fe-ee6f-41cb-9191-a11af6855de3 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56" status: 200 len: 1265 microversion: 2.1 time: 0.154531 Oct 19 04:04:25.923261 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3732/7109] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:04:25 2022] GET /compute/v2.1/servers/9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:04:26.945299 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d3826d2e-fa17-455f-a558-14ef98432349 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:04:26.945979 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d3826d2e-fa17-455f-a558-14ef98432349 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:04:26.952964 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d3826d2e-fa17-455f-a558-14ef98432349 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:04:26.953507 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d3826d2e-fa17-455f-a558-14ef98432349 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:04:26.959070 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d3826d2e-fa17-455f-a558-14ef98432349 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:04:26.959070 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d3826d2e-fa17-455f-a558-14ef98432349 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:04:26.959070 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d3826d2e-fa17-455f-a558-14ef98432349 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:04:26.959070 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d3826d2e-fa17-455f-a558-14ef98432349 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:04:27.098712 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d3826d2e-fa17-455f-a558-14ef98432349 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:04:27.107023 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d3826d2e-fa17-455f-a558-14ef98432349 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56" status: 200 len: 1265 microversion: 2.1 time: 0.165653 Oct 19 04:04:27.107878 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3733/7110] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:04:26 2022] GET /compute/v2.1/servers/9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:04:28.131834 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4e67b942-1f0e-4acd-8eb1-257f777e6eb3 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:04:28.132502 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4e67b942-1f0e-4acd-8eb1-257f777e6eb3 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:04:28.139400 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4e67b942-1f0e-4acd-8eb1-257f777e6eb3 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:04:28.139902 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4e67b942-1f0e-4acd-8eb1-257f777e6eb3 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:04:28.140387 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4e67b942-1f0e-4acd-8eb1-257f777e6eb3 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:04:28.141095 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4e67b942-1f0e-4acd-8eb1-257f777e6eb3 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:04:28.141598 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4e67b942-1f0e-4acd-8eb1-257f777e6eb3 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:04:28.142041 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4e67b942-1f0e-4acd-8eb1-257f777e6eb3 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:04:28.273563 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-4e67b942-1f0e-4acd-8eb1-257f777e6eb3 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:04:28.281322 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4e67b942-1f0e-4acd-8eb1-257f777e6eb3 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56" status: 200 len: 1265 microversion: 2.1 time: 0.153369 Oct 19 04:04:28.281920 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3734/7111] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:04:28 2022] GET /compute/v2.1/servers/9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:04:29.304453 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-508b3228-eb94-4d92-9350-4cb5e9327989 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:04:29.305075 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-508b3228-eb94-4d92-9350-4cb5e9327989 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:04:29.312286 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-508b3228-eb94-4d92-9350-4cb5e9327989 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:04:29.312800 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-508b3228-eb94-4d92-9350-4cb5e9327989 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:04:29.313268 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-508b3228-eb94-4d92-9350-4cb5e9327989 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:04:29.314007 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-508b3228-eb94-4d92-9350-4cb5e9327989 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:04:29.314473 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-508b3228-eb94-4d92-9350-4cb5e9327989 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:04:29.314912 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-508b3228-eb94-4d92-9350-4cb5e9327989 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:04:29.451214 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-508b3228-eb94-4d92-9350-4cb5e9327989 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:04:29.459807 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-508b3228-eb94-4d92-9350-4cb5e9327989 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56" status: 200 len: 1265 microversion: 2.1 time: 0.159525 Oct 19 04:04:29.460391 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3735/7112] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:04:29 2022] GET /compute/v2.1/servers/9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:04:30.483823 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-55b89bf3-f882-4d69-a3e5-a1f28269b158 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:04:30.484517 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-55b89bf3-f882-4d69-a3e5-a1f28269b158 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:04:30.492114 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-55b89bf3-f882-4d69-a3e5-a1f28269b158 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:04:30.492936 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-55b89bf3-f882-4d69-a3e5-a1f28269b158 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:04:30.493417 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-55b89bf3-f882-4d69-a3e5-a1f28269b158 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:04:30.494128 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-55b89bf3-f882-4d69-a3e5-a1f28269b158 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:04:30.494713 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-55b89bf3-f882-4d69-a3e5-a1f28269b158 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:04:30.495166 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-55b89bf3-f882-4d69-a3e5-a1f28269b158 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:04:30.639837 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-55b89bf3-f882-4d69-a3e5-a1f28269b158 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:04:30.648084 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-55b89bf3-f882-4d69-a3e5-a1f28269b158 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56" status: 200 len: 1265 microversion: 2.1 time: 0.168212 Oct 19 04:04:30.648922 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3736/7113] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:04:30 2022] GET /compute/v2.1/servers/9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:04:31.158163 n-d-861333-8 devstack@n-api.service[121135]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 04:04:31.158657 n-d-861333-8 devstack@n-api.service[121135]: Wed Oct 19 04:04:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.52) !!! Oct 19 04:04:31.671717 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d46c1f95-801f-4574-8f4f-b817ef049195 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:04:31.672354 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d46c1f95-801f-4574-8f4f-b817ef049195 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:04:31.680176 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d46c1f95-801f-4574-8f4f-b817ef049195 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:04:31.680679 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d46c1f95-801f-4574-8f4f-b817ef049195 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:04:31.681138 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d46c1f95-801f-4574-8f4f-b817ef049195 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:04:31.681891 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d46c1f95-801f-4574-8f4f-b817ef049195 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:04:31.682395 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d46c1f95-801f-4574-8f4f-b817ef049195 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:04:31.682848 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d46c1f95-801f-4574-8f4f-b817ef049195 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:04:31.819482 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d46c1f95-801f-4574-8f4f-b817ef049195 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:04:31.827476 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d46c1f95-801f-4574-8f4f-b817ef049195 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56" status: 200 len: 1265 microversion: 2.1 time: 0.159615 Oct 19 04:04:31.828257 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3737/7114] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:04:31 2022] GET /compute/v2.1/servers/9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:04:32.849650 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-022ef2b2-91c7-4d84-956e-9d68132151e9 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:04:32.850434 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-022ef2b2-91c7-4d84-956e-9d68132151e9 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:04:32.857412 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-022ef2b2-91c7-4d84-956e-9d68132151e9 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:04:32.858197 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-022ef2b2-91c7-4d84-956e-9d68132151e9 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:04:32.858402 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-022ef2b2-91c7-4d84-956e-9d68132151e9 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:04:32.859099 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-022ef2b2-91c7-4d84-956e-9d68132151e9 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:04:32.859564 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-022ef2b2-91c7-4d84-956e-9d68132151e9 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:04:32.860000 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-022ef2b2-91c7-4d84-956e-9d68132151e9 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:04:32.864152 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:04:33.020298 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-022ef2b2-91c7-4d84-956e-9d68132151e9 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:04:33.029152 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-022ef2b2-91c7-4d84-956e-9d68132151e9 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56" status: 200 len: 1265 microversion: 2.1 time: 0.183573 Oct 19 04:04:33.029887 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3738/7115] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:04:32 2022] GET /compute/v2.1/servers/9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56 => generated 1265 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:04:33.098413 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-c10b345c-31e5-49b9-bde2-3d920cc6921e req-6b0e3052-ed14-4f66-a075-d61d04cbefca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56", "name": "network-vif-plugged", "status": "completed", "tag": "9ed3b59c-9a02-414c-8eef-84c24b8c531d"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:04:33.108094 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-c10b345c-31e5-49b9-bde2-3d920cc6921e req-6b0e3052-ed14-4f66-a075-d61d04cbefca service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:04:33.108595 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-c10b345c-31e5-49b9-bde2-3d920cc6921e req-6b0e3052-ed14-4f66-a075-d61d04cbefca service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:04:33.109050 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-c10b345c-31e5-49b9-bde2-3d920cc6921e req-6b0e3052-ed14-4f66-a075-d61d04cbefca service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:04:33.120529 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-c10b345c-31e5-49b9-bde2-3d920cc6921e req-6b0e3052-ed14-4f66-a075-d61d04cbefca service nova] Creating event network-vif-plugged:9ed3b59c-9a02-414c-8eef-84c24b8c531d for instance 9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56 on n-h2-861333-8 Oct 19 04:04:33.125454 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-c10b345c-31e5-49b9-bde2-3d920cc6921e req-6b0e3052-ed14-4f66-a075-d61d04cbefca service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094416 Oct 19 04:04:33.126332 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3739/7116] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:04:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:04:34.052676 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a48e32c4-93fe-4dde-9301-5516dfb4120e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:04:34.053432 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a48e32c4-93fe-4dde-9301-5516dfb4120e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:04:34.060897 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a48e32c4-93fe-4dde-9301-5516dfb4120e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:04:34.061431 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a48e32c4-93fe-4dde-9301-5516dfb4120e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:04:34.061903 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a48e32c4-93fe-4dde-9301-5516dfb4120e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:04:34.062617 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a48e32c4-93fe-4dde-9301-5516dfb4120e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:04:34.063094 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a48e32c4-93fe-4dde-9301-5516dfb4120e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:04:34.063541 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a48e32c4-93fe-4dde-9301-5516dfb4120e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:04:34.197689 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a48e32c4-93fe-4dde-9301-5516dfb4120e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:04:34.205519 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a48e32c4-93fe-4dde-9301-5516dfb4120e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56" status: 200 len: 1265 microversion: 2.1 time: 0.157677 Oct 19 04:04:34.206654 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3740/7117] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:04:34 2022] GET /compute/v2.1/servers/9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:04:35.228921 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0ce3a6a4-3395-470c-99f9-f22aa205eff0 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:04:35.229601 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0ce3a6a4-3395-470c-99f9-f22aa205eff0 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:04:35.236677 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0ce3a6a4-3395-470c-99f9-f22aa205eff0 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:04:35.237187 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0ce3a6a4-3395-470c-99f9-f22aa205eff0 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:04:35.237770 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0ce3a6a4-3395-470c-99f9-f22aa205eff0 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:04:35.238495 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0ce3a6a4-3395-470c-99f9-f22aa205eff0 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:04:35.238997 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0ce3a6a4-3395-470c-99f9-f22aa205eff0 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:04:35.239457 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0ce3a6a4-3395-470c-99f9-f22aa205eff0 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:04:35.372415 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0ce3a6a4-3395-470c-99f9-f22aa205eff0 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:04:35.380698 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0ce3a6a4-3395-470c-99f9-f22aa205eff0 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56" status: 200 len: 1452 microversion: 2.1 time: 0.155652 Oct 19 04:04:35.381281 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3741/7118] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:04:35 2022] GET /compute/v2.1/servers/9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56 => generated 1452 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:04:35.404152 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-69a408c6-22a4-4605-9212-313f85902255 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:04:35.404913 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-69a408c6-22a4-4605-9212-313f85902255 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:04:35.411554 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-69a408c6-22a4-4605-9212-313f85902255 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:04:35.412062 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-69a408c6-22a4-4605-9212-313f85902255 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:04:35.412516 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-69a408c6-22a4-4605-9212-313f85902255 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:04:35.413230 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-69a408c6-22a4-4605-9212-313f85902255 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:04:35.413737 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-69a408c6-22a4-4605-9212-313f85902255 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:04:35.414185 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-69a408c6-22a4-4605-9212-313f85902255 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:04:35.548674 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-69a408c6-22a4-4605-9212-313f85902255 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:04:35.557471 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-69a408c6-22a4-4605-9212-313f85902255 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56" status: 200 len: 1452 microversion: 2.1 time: 0.157048 Oct 19 04:04:35.558076 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3742/7119] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:04:35 2022] GET /compute/v2.1/servers/9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56 => generated 1452 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:04:37.917024 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-97dfe1c6-535f-4eae-8100-466368c26af7 req-df7c65db-b6e1-4a15-a081-5f20a7c861c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56", "tag": "9ed3b59c-9a02-414c-8eef-84c24b8c531d"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:04:37.931410 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-97dfe1c6-535f-4eae-8100-466368c26af7 req-df7c65db-b6e1-4a15-a081-5f20a7c861c0 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:04:37.932244 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-97dfe1c6-535f-4eae-8100-466368c26af7 req-df7c65db-b6e1-4a15-a081-5f20a7c861c0 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:04:37.932774 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-97dfe1c6-535f-4eae-8100-466368c26af7 req-df7c65db-b6e1-4a15-a081-5f20a7c861c0 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:04:37.945982 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-97dfe1c6-535f-4eae-8100-466368c26af7 req-df7c65db-b6e1-4a15-a081-5f20a7c861c0 service nova] Creating event network-changed:9ed3b59c-9a02-414c-8eef-84c24b8c531d for instance 9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56 on n-h2-861333-8 Oct 19 04:04:37.951450 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-97dfe1c6-535f-4eae-8100-466368c26af7 req-df7c65db-b6e1-4a15-a081-5f20a7c861c0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039360 Oct 19 04:04:37.952657 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3743/7120] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:04:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 04:05:09.287250 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=28 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:05:09.287745 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=26 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:05:09.461775 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-63855f95-aa35-4224-9ecd-2f4cb09700fd tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:05:09.463121 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-63855f95-aa35-4224-9ecd-2f4cb09700fd tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] [instance: 6a87c0fe-b69c-4db5-800f-eb79c28fc4bf] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:05:09.469687 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-63855f95-aa35-4224-9ecd-2f4cb09700fd tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:05:09.470341 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-63855f95-aa35-4224-9ecd-2f4cb09700fd tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:05:09.470801 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-63855f95-aa35-4224-9ecd-2f4cb09700fd tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:05:09.471514 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-63855f95-aa35-4224-9ecd-2f4cb09700fd tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:05:09.471984 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-63855f95-aa35-4224-9ecd-2f4cb09700fd tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:05:09.472427 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-63855f95-aa35-4224-9ecd-2f4cb09700fd tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:05:09.501311 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-63855f95-aa35-4224-9ecd-2f4cb09700fd tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] [instance: 6a87c0fe-b69c-4db5-800f-eb79c28fc4bf] Going to try to terminate instance {{(pid=121134) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 04:05:09.782856 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-63855f95-aa35-4224-9ecd-2f4cb09700fd tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] 10.222.0.52 "DELETE /compute/v2.1/servers/6a87c0fe-b69c-4db5-800f-eb79c28fc4bf" status: 204 len: 0 microversion: 2.1 time: 0.501925 Oct 19 04:05:09.783528 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3744/7121] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 04:05:09 2022] DELETE /compute/v2.1/servers/6a87c0fe-b69c-4db5-800f-eb79c28fc4bf => generated 0 bytes in 504 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 19 04:05:09.792715 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a5e7a57b-e0bb-4ba9-85fc-f64524eda1a4 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:05:09.793472 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a5e7a57b-e0bb-4ba9-85fc-f64524eda1a4 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] [instance: 6a87c0fe-b69c-4db5-800f-eb79c28fc4bf] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:05:09.799514 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a5e7a57b-e0bb-4ba9-85fc-f64524eda1a4 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:05:09.800013 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a5e7a57b-e0bb-4ba9-85fc-f64524eda1a4 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:05:09.800472 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a5e7a57b-e0bb-4ba9-85fc-f64524eda1a4 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:05:09.801176 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a5e7a57b-e0bb-4ba9-85fc-f64524eda1a4 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:05:09.801683 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a5e7a57b-e0bb-4ba9-85fc-f64524eda1a4 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:05:09.802126 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a5e7a57b-e0bb-4ba9-85fc-f64524eda1a4 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:05:09.939529 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a5e7a57b-e0bb-4ba9-85fc-f64524eda1a4 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb05a7575aa041cd9d38cfaba331446f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f809c5b4d0b9405caaa93697baeea39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:05:09.947986 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a5e7a57b-e0bb-4ba9-85fc-f64524eda1a4 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] 10.222.0.52 "GET /compute/v2.1/servers/6a87c0fe-b69c-4db5-800f-eb79c28fc4bf" status: 200 len: 1733 microversion: 2.1 time: 0.159894 Oct 19 04:05:09.948571 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3745/7122] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:05:09 2022] GET /compute/v2.1/servers/6a87c0fe-b69c-4db5-800f-eb79c28fc4bf => generated 1733 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:05:10.972417 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-58ce907c-5471-4c06-8c47-49c126d85765 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:05:10.973278 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-58ce907c-5471-4c06-8c47-49c126d85765 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] [instance: 6a87c0fe-b69c-4db5-800f-eb79c28fc4bf] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:05:10.981048 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-58ce907c-5471-4c06-8c47-49c126d85765 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:05:10.981659 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-58ce907c-5471-4c06-8c47-49c126d85765 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:05:10.982222 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-58ce907c-5471-4c06-8c47-49c126d85765 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:05:10.983050 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-58ce907c-5471-4c06-8c47-49c126d85765 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:05:10.983634 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-58ce907c-5471-4c06-8c47-49c126d85765 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:05:10.984185 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-58ce907c-5471-4c06-8c47-49c126d85765 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:05:11.141698 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-58ce907c-5471-4c06-8c47-49c126d85765 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb05a7575aa041cd9d38cfaba331446f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f809c5b4d0b9405caaa93697baeea39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:05:11.152546 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-58ce907c-5471-4c06-8c47-49c126d85765 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] 10.222.0.52 "GET /compute/v2.1/servers/6a87c0fe-b69c-4db5-800f-eb79c28fc4bf" status: 200 len: 1733 microversion: 2.1 time: 0.184188 Oct 19 04:05:11.163227 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3746/7123] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:05:10 2022] GET /compute/v2.1/servers/6a87c0fe-b69c-4db5-800f-eb79c28fc4bf => generated 1733 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:05:12.176587 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-123edbbf-57da-4ae8-8c39-b8a0c2053dec tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:05:12.177058 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-123edbbf-57da-4ae8-8c39-b8a0c2053dec tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] [instance: 6a87c0fe-b69c-4db5-800f-eb79c28fc4bf] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:05:12.184463 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-123edbbf-57da-4ae8-8c39-b8a0c2053dec tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:05:12.185167 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-123edbbf-57da-4ae8-8c39-b8a0c2053dec tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:05:12.185718 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-123edbbf-57da-4ae8-8c39-b8a0c2053dec tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:05:12.186440 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-123edbbf-57da-4ae8-8c39-b8a0c2053dec tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:05:12.186915 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-123edbbf-57da-4ae8-8c39-b8a0c2053dec tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:05:12.187360 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-123edbbf-57da-4ae8-8c39-b8a0c2053dec tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:05:12.258489 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-123edbbf-57da-4ae8-8c39-b8a0c2053dec tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb05a7575aa041cd9d38cfaba331446f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f809c5b4d0b9405caaa93697baeea39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:05:12.267587 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-123edbbf-57da-4ae8-8c39-b8a0c2053dec tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] 10.222.0.52 "GET /compute/v2.1/servers/6a87c0fe-b69c-4db5-800f-eb79c28fc4bf" status: 200 len: 1665 microversion: 2.1 time: 0.095429 Oct 19 04:05:12.268477 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3747/7124] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:05:12 2022] GET /compute/v2.1/servers/6a87c0fe-b69c-4db5-800f-eb79c28fc4bf => generated 1665 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:05:12.381560 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-bfc8ab99-3c3b-4dba-9e0c-0d562d88dee0 req-a43bf985-ac20-4181-b942-7ad823d1e9da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a87c0fe-b69c-4db5-800f-eb79c28fc4bf", "name": "network-vif-deleted", "tag": "4ff175da-6016-4896-a556-83f7df41d005"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:05:12.393868 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-bfc8ab99-3c3b-4dba-9e0c-0d562d88dee0 req-a43bf985-ac20-4181-b942-7ad823d1e9da service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:05:12.394371 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-bfc8ab99-3c3b-4dba-9e0c-0d562d88dee0 req-a43bf985-ac20-4181-b942-7ad823d1e9da service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:05:12.394823 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-bfc8ab99-3c3b-4dba-9e0c-0d562d88dee0 req-a43bf985-ac20-4181-b942-7ad823d1e9da service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:05:12.411625 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-bfc8ab99-3c3b-4dba-9e0c-0d562d88dee0 req-a43bf985-ac20-4181-b942-7ad823d1e9da service nova] Creating event network-vif-deleted:4ff175da-6016-4896-a556-83f7df41d005 for instance 6a87c0fe-b69c-4db5-800f-eb79c28fc4bf on n-h2-861333-8 Oct 19 04:05:12.417033 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-bfc8ab99-3c3b-4dba-9e0c-0d562d88dee0 req-a43bf985-ac20-4181-b942-7ad823d1e9da service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039256 Oct 19 04:05:12.418032 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3748/7125] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:05:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:05:13.293666 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9129499d-e545-4ab8-8450-254771b83a1c tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:05:13.294701 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9129499d-e545-4ab8-8450-254771b83a1c tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] [instance: 6a87c0fe-b69c-4db5-800f-eb79c28fc4bf] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:05:13.301619 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9129499d-e545-4ab8-8450-254771b83a1c tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:05:13.302386 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9129499d-e545-4ab8-8450-254771b83a1c tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:05:13.302910 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9129499d-e545-4ab8-8450-254771b83a1c tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:05:13.304074 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9129499d-e545-4ab8-8450-254771b83a1c tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:05:13.305104 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9129499d-e545-4ab8-8450-254771b83a1c tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:05:13.306395 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9129499d-e545-4ab8-8450-254771b83a1c tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:05:13.343028 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9129499d-e545-4ab8-8450-254771b83a1c tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:05:13.343533 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9129499d-e545-4ab8-8450-254771b83a1c tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:05:13.343985 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9129499d-e545-4ab8-8450-254771b83a1c tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:05:13.344447 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-9129499d-e545-4ab8-8450-254771b83a1c tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Lazy-loading 'fault' on Instance uuid 6a87c0fe-b69c-4db5-800f-eb79c28fc4bf {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 04:05:13.413914 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9129499d-e545-4ab8-8450-254771b83a1c tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb05a7575aa041cd9d38cfaba331446f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f809c5b4d0b9405caaa93697baeea39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:05:13.423767 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9129499d-e545-4ab8-8450-254771b83a1c tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] 10.222.0.52 "GET /compute/v2.1/servers/6a87c0fe-b69c-4db5-800f-eb79c28fc4bf" status: 200 len: 1387 microversion: 2.1 time: 0.135442 Oct 19 04:05:13.424974 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3749/7126] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:05:13 2022] GET /compute/v2.1/servers/6a87c0fe-b69c-4db5-800f-eb79c28fc4bf => generated 1387 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:05:14.450047 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-846230cf-bf7e-436b-9bc5-03259a9b803c tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:05:14.450690 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-846230cf-bf7e-436b-9bc5-03259a9b803c tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] [instance: 6a87c0fe-b69c-4db5-800f-eb79c28fc4bf] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:05:14.457682 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-846230cf-bf7e-436b-9bc5-03259a9b803c tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:05:14.458395 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-846230cf-bf7e-436b-9bc5-03259a9b803c tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:05:14.458856 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-846230cf-bf7e-436b-9bc5-03259a9b803c tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:05:14.459572 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-846230cf-bf7e-436b-9bc5-03259a9b803c tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:05:14.460043 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-846230cf-bf7e-436b-9bc5-03259a9b803c tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:05:14.460518 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-846230cf-bf7e-436b-9bc5-03259a9b803c tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:05:14.475447 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-846230cf-bf7e-436b-9bc5-03259a9b803c tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] HTTP exception thrown: Instance 6a87c0fe-b69c-4db5-800f-eb79c28fc4bf could not be found. Oct 19 04:05:14.477113 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-846230cf-bf7e-436b-9bc5-03259a9b803c tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Request method failure captured: Oct 19 04:05:14.477113 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/6a87c0fe-b69c-4db5-800f-eb79c28fc4bf HTTP/1.1 Oct 19 04:05:14.477113 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 04:05:14.477113 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 04:05:14.477113 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 04:05:14.477113 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 04:05:14.477113 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 04:05:14.477113 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 04:05:14.477113 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 04:05:14.477113 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 04:05:14.477113 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3Y8YXz23R1ze46_u164wmtyBQehmBqxXwt7pFeQTDYFWwGAc3V_AaWQfXGmXEDO4CuC0eiVAOn37IokCLI89ypWogN-qLe2SRvPeMXWPkk6R-C6v2hLNXYbyqYpKoq4D4BBQ_jIxSnN-Y8J-IT-IlpIvQpwdnrcLZBUlQ5t-puBMLY Oct 19 04:05:14.477113 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 04:05:14.477113 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 04:05:14.477113 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 04:05:14.477113 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 04:05:14.477113 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 04:05:14.477113 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 04:05:14.477113 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: f809c5b4d0b9405caaa93697baeea39b Oct 19 04:05:14.477113 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-TestServerBasicOps-353264134 Oct 19 04:05:14.477113 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 04:05:14.477113 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 04:05:14.477113 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f809c5b4d0b9405caaa93697baeea39b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f809c5b4d0b9405caaa93697baeea39b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f809c5b4d0b9405caaa93697baeea39b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f809c5b4d0b9405caaa93697baeea39b", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 04:05:14.477113 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-TestServerBasicOps-353264134 Oct 19 04:05:14.477113 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: f809c5b4d0b9405caaa93697baeea39b Oct 19 04:05:14.477113 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-TestServerBasicOps-353264134 Oct 19 04:05:14.477113 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-TestServerBasicOps-353264134-project Oct 19 04:05:14.477113 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 04:05:14.477113 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 04:05:14.477113 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: bb05a7575aa041cd9d38cfaba331446f Oct 19 04:05:14.477113 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-TestServerBasicOps-353264134-project Oct 19 04:05:14.477113 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 04:05:14.477113 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance 6a87c0fe-b69c-4db5-800f-eb79c28fc4bf could not be found. Oct 19 04:05:14.477113 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '6a87c0fe-b69c-4db5-800f-eb79c28fc4bf'} Oct 19 04:05:14.477113 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 04:05:14.477113 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:05:14.477113 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 04:05:14.477113 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 04:05:14.477113 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 04:05:14.477113 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 04:05:14.477113 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 04:05:14.477113 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 04:05:14.477113 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 04:05:14.477113 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 04:05:14.477113 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a87c0fe-b69c-4db5-800f-eb79c28fc4bf could not be found. Oct 19 04:05:14.477113 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:05:14.477113 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:05:14.477113 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:05:14.477113 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:05:14.477113 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:05:14.477113 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:05:14.477113 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 04:05:14.477113 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 04:05:14.477113 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 04:05:14.477113 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 04:05:14.477113 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 04:05:14.477113 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 04:05:14.477113 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 04:05:14.477113 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 04:05:14.477113 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 04:05:14.477113 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 04:05:14.477113 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a87c0fe-b69c-4db5-800f-eb79c28fc4bf could not be found. Oct 19 04:05:14.477113 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:05:14.477113 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:05:14.477113 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:05:14.481428 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:05:14.481428 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:05:14.481428 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:05:14.481428 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 04:05:14.481428 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 04:05:14.481428 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a87c0fe-b69c-4db5-800f-eb79c28fc4bf could not be found. Oct 19 04:05:14.481428 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:05:14.481428 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-846230cf-bf7e-436b-9bc5-03259a9b803c tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Returning 404 to user: Instance 6a87c0fe-b69c-4db5-800f-eb79c28fc4bf could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 04:05:14.481428 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-846230cf-bf7e-436b-9bc5-03259a9b803c tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] 10.222.0.52 "GET /compute/v2.1/servers/6a87c0fe-b69c-4db5-800f-eb79c28fc4bf" status: 404 len: 111 microversion: 2.1 time: 0.033267 Oct 19 04:05:14.481428 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3750/7127] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:05:14 2022] GET /compute/v2.1/servers/6a87c0fe-b69c-4db5-800f-eb79c28fc4bf => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 04:05:15.085801 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-dbf121d9-0469-4d13-b200-94f453d43fd9 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:05:15.086323 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-dbf121d9-0469-4d13-b200-94f453d43fd9 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] [instance: 6a87c0fe-b69c-4db5-800f-eb79c28fc4bf] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:05:15.092840 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dbf121d9-0469-4d13-b200-94f453d43fd9 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:05:15.093343 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dbf121d9-0469-4d13-b200-94f453d43fd9 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:05:15.093830 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dbf121d9-0469-4d13-b200-94f453d43fd9 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:05:15.094543 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dbf121d9-0469-4d13-b200-94f453d43fd9 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:05:15.095017 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dbf121d9-0469-4d13-b200-94f453d43fd9 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:05:15.095473 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dbf121d9-0469-4d13-b200-94f453d43fd9 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:05:15.112286 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-dbf121d9-0469-4d13-b200-94f453d43fd9 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] HTTP exception thrown: Instance 6a87c0fe-b69c-4db5-800f-eb79c28fc4bf could not be found. Oct 19 04:05:15.113869 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-dbf121d9-0469-4d13-b200-94f453d43fd9 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Request method failure captured: Oct 19 04:05:15.113869 n-d-861333-8 devstack@n-api.service[121134]: request: DELETE /compute/v2.1/servers/6a87c0fe-b69c-4db5-800f-eb79c28fc4bf HTTP/1.1 Oct 19 04:05:15.113869 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 04:05:15.113869 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 04:05:15.113869 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 04:05:15.113869 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 04:05:15.113869 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 04:05:15.113869 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 04:05:15.113869 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 04:05:15.113869 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 04:05:15.113869 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3Y8YXz23R1ze46_u164wmtyBQehmBqxXwt7pFeQTDYFWwGAc3V_AaWQfXGmXEDO4CuC0eiVAOn37IokCLI89ypWogN-qLe2SRvPeMXWPkk6R-C6v2hLNXYbyqYpKoq4D4BBQ_jIxSnN-Y8J-IT-IlpIvQpwdnrcLZBUlQ5t-puBMLY Oct 19 04:05:15.113869 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 04:05:15.113869 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 04:05:15.113869 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 04:05:15.113869 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 04:05:15.113869 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 04:05:15.113869 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 04:05:15.113869 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: f809c5b4d0b9405caaa93697baeea39b Oct 19 04:05:15.113869 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-TestServerBasicOps-353264134 Oct 19 04:05:15.113869 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 04:05:15.113869 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 04:05:15.113869 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f809c5b4d0b9405caaa93697baeea39b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f809c5b4d0b9405caaa93697baeea39b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f809c5b4d0b9405caaa93697baeea39b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f809c5b4d0b9405caaa93697baeea39b", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 04:05:15.113869 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-TestServerBasicOps-353264134 Oct 19 04:05:15.113869 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: f809c5b4d0b9405caaa93697baeea39b Oct 19 04:05:15.113869 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-TestServerBasicOps-353264134 Oct 19 04:05:15.113869 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-TestServerBasicOps-353264134-project Oct 19 04:05:15.113869 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 04:05:15.113869 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 04:05:15.113869 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: bb05a7575aa041cd9d38cfaba331446f Oct 19 04:05:15.113869 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-TestServerBasicOps-353264134-project Oct 19 04:05:15.113869 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 04:05:15.113869 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance 6a87c0fe-b69c-4db5-800f-eb79c28fc4bf could not be found. Oct 19 04:05:15.113869 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '6a87c0fe-b69c-4db5-800f-eb79c28fc4bf'} Oct 19 04:05:15.113869 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 04:05:15.113869 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:05:15.113869 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 04:05:15.113869 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 04:05:15.113869 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 04:05:15.113869 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 04:05:15.113869 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 04:05:15.113869 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 04:05:15.113869 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 04:05:15.113869 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 04:05:15.113869 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a87c0fe-b69c-4db5-800f-eb79c28fc4bf could not be found. Oct 19 04:05:15.113869 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:05:15.113869 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:05:15.113869 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:05:15.113869 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:05:15.113869 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:05:15.113869 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:05:15.113869 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 04:05:15.113869 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 04:05:15.113869 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 04:05:15.113869 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 04:05:15.113869 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 04:05:15.113869 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 04:05:15.113869 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 04:05:15.113869 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 04:05:15.113869 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 04:05:15.113869 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 04:05:15.113869 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 04:05:15.113869 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 04:05:15.117477 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a87c0fe-b69c-4db5-800f-eb79c28fc4bf could not be found. Oct 19 04:05:15.117477 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:05:15.117477 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:05:15.117477 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:05:15.117477 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:05:15.117477 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:05:15.117477 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:05:15.117477 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 04:05:15.117477 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 04:05:15.117477 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a87c0fe-b69c-4db5-800f-eb79c28fc4bf could not be found. Oct 19 04:05:15.117477 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:05:15.117477 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-dbf121d9-0469-4d13-b200-94f453d43fd9 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Returning 404 to user: Instance 6a87c0fe-b69c-4db5-800f-eb79c28fc4bf could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 04:05:15.117477 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-dbf121d9-0469-4d13-b200-94f453d43fd9 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] 10.222.0.52 "DELETE /compute/v2.1/servers/6a87c0fe-b69c-4db5-800f-eb79c28fc4bf" status: 404 len: 111 microversion: 2.1 time: 0.033378 Oct 19 04:05:15.117477 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3751/7128] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 04:05:15 2022] DELETE /compute/v2.1/servers/6a87c0fe-b69c-4db5-800f-eb79c28fc4bf => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 04:05:15.123489 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b7515a46-04db-46fd-8318-c9d7c288b95a tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:05:15.124120 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b7515a46-04db-46fd-8318-c9d7c288b95a tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] [instance: 6a87c0fe-b69c-4db5-800f-eb79c28fc4bf] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:05:15.129908 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b7515a46-04db-46fd-8318-c9d7c288b95a tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:05:15.130382 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b7515a46-04db-46fd-8318-c9d7c288b95a tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:05:15.130840 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b7515a46-04db-46fd-8318-c9d7c288b95a tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:05:15.131540 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b7515a46-04db-46fd-8318-c9d7c288b95a tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:05:15.132015 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b7515a46-04db-46fd-8318-c9d7c288b95a tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:05:15.132463 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b7515a46-04db-46fd-8318-c9d7c288b95a tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:05:15.146161 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-b7515a46-04db-46fd-8318-c9d7c288b95a tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] HTTP exception thrown: Instance 6a87c0fe-b69c-4db5-800f-eb79c28fc4bf could not be found. Oct 19 04:05:15.147667 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b7515a46-04db-46fd-8318-c9d7c288b95a tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Request method failure captured: Oct 19 04:05:15.147667 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/6a87c0fe-b69c-4db5-800f-eb79c28fc4bf HTTP/1.1 Oct 19 04:05:15.147667 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 04:05:15.147667 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 04:05:15.147667 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 04:05:15.147667 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 04:05:15.147667 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 04:05:15.147667 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 04:05:15.147667 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 04:05:15.147667 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 04:05:15.147667 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3Y8YXz23R1ze46_u164wmtyBQehmBqxXwt7pFeQTDYFWwGAc3V_AaWQfXGmXEDO4CuC0eiVAOn37IokCLI89ypWogN-qLe2SRvPeMXWPkk6R-C6v2hLNXYbyqYpKoq4D4BBQ_jIxSnN-Y8J-IT-IlpIvQpwdnrcLZBUlQ5t-puBMLY Oct 19 04:05:15.147667 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 04:05:15.147667 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 04:05:15.147667 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 04:05:15.147667 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 04:05:15.147667 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 04:05:15.147667 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 04:05:15.147667 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: f809c5b4d0b9405caaa93697baeea39b Oct 19 04:05:15.147667 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-TestServerBasicOps-353264134 Oct 19 04:05:15.147667 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 04:05:15.147667 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 04:05:15.147667 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f809c5b4d0b9405caaa93697baeea39b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f809c5b4d0b9405caaa93697baeea39b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f809c5b4d0b9405caaa93697baeea39b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f809c5b4d0b9405caaa93697baeea39b", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 04:05:15.147667 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-TestServerBasicOps-353264134 Oct 19 04:05:15.147667 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: f809c5b4d0b9405caaa93697baeea39b Oct 19 04:05:15.147667 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-TestServerBasicOps-353264134 Oct 19 04:05:15.147667 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-TestServerBasicOps-353264134-project Oct 19 04:05:15.147667 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 04:05:15.147667 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 04:05:15.147667 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: bb05a7575aa041cd9d38cfaba331446f Oct 19 04:05:15.147667 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-TestServerBasicOps-353264134-project Oct 19 04:05:15.147667 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 04:05:15.147667 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance 6a87c0fe-b69c-4db5-800f-eb79c28fc4bf could not be found. Oct 19 04:05:15.147667 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '6a87c0fe-b69c-4db5-800f-eb79c28fc4bf'} Oct 19 04:05:15.147667 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 04:05:15.147667 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:05:15.147667 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 04:05:15.147667 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 04:05:15.147667 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 04:05:15.147667 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 04:05:15.147667 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 04:05:15.147667 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 04:05:15.147667 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 04:05:15.147667 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 04:05:15.147667 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a87c0fe-b69c-4db5-800f-eb79c28fc4bf could not be found. Oct 19 04:05:15.147667 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:05:15.147667 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:05:15.147667 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:05:15.147667 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:05:15.147667 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:05:15.147667 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:05:15.147667 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 04:05:15.147667 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 04:05:15.147667 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 04:05:15.147667 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 04:05:15.147667 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 04:05:15.147667 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 04:05:15.147667 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 04:05:15.147667 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 04:05:15.147667 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 04:05:15.147667 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 04:05:15.147667 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a87c0fe-b69c-4db5-800f-eb79c28fc4bf could not be found. Oct 19 04:05:15.147667 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:05:15.147667 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:05:15.147667 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:05:15.152474 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:05:15.152474 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:05:15.152474 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:05:15.152474 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 04:05:15.152474 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 04:05:15.152474 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a87c0fe-b69c-4db5-800f-eb79c28fc4bf could not be found. Oct 19 04:05:15.152474 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:05:15.152474 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b7515a46-04db-46fd-8318-c9d7c288b95a tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Returning 404 to user: Instance 6a87c0fe-b69c-4db5-800f-eb79c28fc4bf could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 04:05:15.152474 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b7515a46-04db-46fd-8318-c9d7c288b95a tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] 10.222.0.52 "GET /compute/v2.1/servers/6a87c0fe-b69c-4db5-800f-eb79c28fc4bf" status: 404 len: 111 microversion: 2.1 time: 0.029324 Oct 19 04:05:15.152474 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3752/7129] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:05:15 2022] GET /compute/v2.1/servers/6a87c0fe-b69c-4db5-800f-eb79c28fc4bf => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 04:05:15.411724 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e4f7cb8e-f699-4e35-8170-0e9746769d83 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] Calling method '.version_select at 0x7fc12beb94c0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:05:15.505120 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e4f7cb8e-f699-4e35-8170-0e9746769d83 tempest-TestServerBasicOps-353264134 tempest-TestServerBasicOps-353264134-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-49554266" status: 202 len: 0 microversion: 2.1 time: 0.097214 Oct 19 04:05:15.505743 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3753/7130] 10.222.0.52 () {58 vars in 1248 bytes} [Wed Oct 19 04:05:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-49554266 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 19 04:06:11.165904 n-d-861333-8 devstack@n-api.service[121135]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 04:06:11.168786 n-d-861333-8 devstack@n-api.service[121135]: Wed Oct 19 04:06:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.52) !!! Oct 19 04:06:11.168786 n-d-861333-8 devstack@n-api.service[121135]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 04:06:11.168786 n-d-861333-8 devstack@n-api.service[121135]: Wed Oct 19 04:06:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.52) !!! Oct 19 04:07:06.037573 n-d-861333-8 devstack@n-api.service[121134]: ERROR oslo.messaging._drivers.impl_rabbit [-] [96947759-862b-4b0f-b2e1-828b2ec3f179] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 19 04:07:06.038295 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:07:06.039036 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:07:06.039887 n-d-861333-8 devstack@n-api.service[121134]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 04:07:06.040092 n-d-861333-8 devstack@n-api.service[121134]: Wed Oct 19 04:07:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56 (ip 10.222.0.52) !!! Oct 19 04:07:06.050138 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6b781df5-f9d4-41fb-a04d-7148ec4e43e3 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:07:06.050138 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6b781df5-f9d4-41fb-a04d-7148ec4e43e3 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:07:06.055396 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6b781df5-f9d4-41fb-a04d-7148ec4e43e3 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:07:06.055995 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6b781df5-f9d4-41fb-a04d-7148ec4e43e3 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:07:06.056467 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6b781df5-f9d4-41fb-a04d-7148ec4e43e3 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:07:06.057207 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6b781df5-f9d4-41fb-a04d-7148ec4e43e3 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:07:06.057711 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6b781df5-f9d4-41fb-a04d-7148ec4e43e3 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:07:06.058231 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6b781df5-f9d4-41fb-a04d-7148ec4e43e3 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:07:06.086888 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6b781df5-f9d4-41fb-a04d-7148ec4e43e3 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56] Going to try to terminate instance {{(pid=121134) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 04:07:06.474140 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6b781df5-f9d4-41fb-a04d-7148ec4e43e3 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "DELETE /compute/v2.1/servers/9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56" status: 204 len: 0 microversion: 2.1 time: 0.438737 Oct 19 04:07:06.474838 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3754/7131] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 04:07:06 2022] DELETE /compute/v2.1/servers/9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 04:07:06.483264 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4e6e1937-6eac-4da8-9e74-c438b2a7353e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:07:06.486886 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4e6e1937-6eac-4da8-9e74-c438b2a7353e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:07:06.490919 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4e6e1937-6eac-4da8-9e74-c438b2a7353e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:07:06.491419 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4e6e1937-6eac-4da8-9e74-c438b2a7353e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:07:06.491875 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4e6e1937-6eac-4da8-9e74-c438b2a7353e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:07:06.492592 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4e6e1937-6eac-4da8-9e74-c438b2a7353e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:07:06.493067 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4e6e1937-6eac-4da8-9e74-c438b2a7353e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:07:06.493538 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4e6e1937-6eac-4da8-9e74-c438b2a7353e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:07:06.648401 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-4e6e1937-6eac-4da8-9e74-c438b2a7353e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:07:06.656649 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4e6e1937-6eac-4da8-9e74-c438b2a7353e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56" status: 200 len: 1577 microversion: 2.1 time: 0.177399 Oct 19 04:07:06.657760 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3755/7132] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:07:06 2022] GET /compute/v2.1/servers/9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56 => generated 1577 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:07:07.682168 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1b606e3f-4d27-4294-a90f-523ab3bf86ac tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:07:07.682830 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1b606e3f-4d27-4294-a90f-523ab3bf86ac tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:07:07.694975 n-d-861333-8 devstack@n-api.service[121134]: INFO oslo.messaging._drivers.impl_rabbit [-] [96947759-862b-4b0f-b2e1-828b2ec3f179] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 56594. Oct 19 04:07:07.699537 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1b606e3f-4d27-4294-a90f-523ab3bf86ac tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:07:07.700046 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1b606e3f-4d27-4294-a90f-523ab3bf86ac tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:07:07.700506 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1b606e3f-4d27-4294-a90f-523ab3bf86ac tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:07:07.701258 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1b606e3f-4d27-4294-a90f-523ab3bf86ac tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:07:07.701764 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1b606e3f-4d27-4294-a90f-523ab3bf86ac tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:07:07.702296 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1b606e3f-4d27-4294-a90f-523ab3bf86ac tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:07:07.833226 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-1b606e3f-4d27-4294-a90f-523ab3bf86ac tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:07:07.841002 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1b606e3f-4d27-4294-a90f-523ab3bf86ac tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56" status: 200 len: 1577 microversion: 2.1 time: 0.163492 Oct 19 04:07:07.841604 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3756/7133] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:07:07 2022] GET /compute/v2.1/servers/9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56 => generated 1577 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:07:08.866631 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c6df9081-70a8-4837-a7ab-55397c470d75 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:07:08.867391 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c6df9081-70a8-4837-a7ab-55397c470d75 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:07:08.874163 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c6df9081-70a8-4837-a7ab-55397c470d75 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:07:08.875247 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c6df9081-70a8-4837-a7ab-55397c470d75 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:07:08.876311 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c6df9081-70a8-4837-a7ab-55397c470d75 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:07:08.877043 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c6df9081-70a8-4837-a7ab-55397c470d75 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:07:08.877552 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c6df9081-70a8-4837-a7ab-55397c470d75 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:07:08.878002 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c6df9081-70a8-4837-a7ab-55397c470d75 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:07:09.416540 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c6df9081-70a8-4837-a7ab-55397c470d75 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:07:09.430207 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c6df9081-70a8-4837-a7ab-55397c470d75 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56" status: 200 len: 1577 microversion: 2.1 time: 0.568022 Oct 19 04:07:09.431129 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3757/7134] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:07:08 2022] GET /compute/v2.1/servers/9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56 => generated 1577 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:07:09.668418 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-61ae4c86-3318-4614-b3c1-98acc6b9a8fe req-47c2a67f-bcb8-4f15-a342-4919216dd020 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56", "name": "network-vif-deleted", "tag": "9ed3b59c-9a02-414c-8eef-84c24b8c531d"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:07:09.681006 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-61ae4c86-3318-4614-b3c1-98acc6b9a8fe req-47c2a67f-bcb8-4f15-a342-4919216dd020 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:07:09.681591 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-61ae4c86-3318-4614-b3c1-98acc6b9a8fe req-47c2a67f-bcb8-4f15-a342-4919216dd020 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:07:09.682245 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-61ae4c86-3318-4614-b3c1-98acc6b9a8fe req-47c2a67f-bcb8-4f15-a342-4919216dd020 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:07:09.694510 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-61ae4c86-3318-4614-b3c1-98acc6b9a8fe req-47c2a67f-bcb8-4f15-a342-4919216dd020 service nova] Creating event network-vif-deleted:9ed3b59c-9a02-414c-8eef-84c24b8c531d for instance 9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56 on n-h2-861333-8 Oct 19 04:07:09.700480 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-61ae4c86-3318-4614-b3c1-98acc6b9a8fe req-47c2a67f-bcb8-4f15-a342-4919216dd020 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035908 Oct 19 04:07:09.701759 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3758/7135] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:07:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 04:07:10.456558 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-512eb517-d23d-41c0-9fbd-cdbdf81d55ba tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:07:10.458169 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-512eb517-d23d-41c0-9fbd-cdbdf81d55ba tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:07:10.471125 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-512eb517-d23d-41c0-9fbd-cdbdf81d55ba tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:07:10.472276 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-512eb517-d23d-41c0-9fbd-cdbdf81d55ba tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:07:10.472831 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-512eb517-d23d-41c0-9fbd-cdbdf81d55ba tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:07:10.473682 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-512eb517-d23d-41c0-9fbd-cdbdf81d55ba tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:07:10.474232 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-512eb517-d23d-41c0-9fbd-cdbdf81d55ba tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:07:10.474752 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-512eb517-d23d-41c0-9fbd-cdbdf81d55ba tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:07:10.565660 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-512eb517-d23d-41c0-9fbd-cdbdf81d55ba tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:07:10.575298 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-512eb517-d23d-41c0-9fbd-cdbdf81d55ba tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56" status: 200 len: 1225 microversion: 2.1 time: 0.124085 Oct 19 04:07:10.577294 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3759/7136] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:07:10 2022] GET /compute/v2.1/servers/9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56 => generated 1225 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:07:11.601098 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0eec34e2-cff1-4c49-8115-e7a724814a49 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:07:11.602610 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0eec34e2-cff1-4c49-8115-e7a724814a49 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:07:11.610979 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0eec34e2-cff1-4c49-8115-e7a724814a49 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:07:11.611800 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0eec34e2-cff1-4c49-8115-e7a724814a49 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:07:11.612652 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0eec34e2-cff1-4c49-8115-e7a724814a49 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:07:11.613704 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0eec34e2-cff1-4c49-8115-e7a724814a49 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:07:11.614398 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0eec34e2-cff1-4c49-8115-e7a724814a49 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:07:11.615073 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0eec34e2-cff1-4c49-8115-e7a724814a49 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:07:11.684487 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0eec34e2-cff1-4c49-8115-e7a724814a49 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:07:11.703264 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0eec34e2-cff1-4c49-8115-e7a724814a49 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56" status: 200 len: 1225 microversion: 2.1 time: 0.106095 Oct 19 04:07:11.705676 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3760/7137] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:07:11 2022] GET /compute/v2.1/servers/9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56 => generated 1225 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:07:12.734386 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8d88f293-ed21-4a1c-a259-1db0da6c5efc tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:07:12.736823 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8d88f293-ed21-4a1c-a259-1db0da6c5efc tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:07:12.747905 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8d88f293-ed21-4a1c-a259-1db0da6c5efc tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:07:12.751220 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8d88f293-ed21-4a1c-a259-1db0da6c5efc tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:07:12.751799 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8d88f293-ed21-4a1c-a259-1db0da6c5efc tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:07:12.752624 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8d88f293-ed21-4a1c-a259-1db0da6c5efc tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:07:12.753183 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8d88f293-ed21-4a1c-a259-1db0da6c5efc tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:07:12.753735 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8d88f293-ed21-4a1c-a259-1db0da6c5efc tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:07:12.827058 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8d88f293-ed21-4a1c-a259-1db0da6c5efc tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:07:12.835047 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8d88f293-ed21-4a1c-a259-1db0da6c5efc tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56" status: 200 len: 1225 microversion: 2.1 time: 0.104475 Oct 19 04:07:12.835625 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3761/7138] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:07:12 2022] GET /compute/v2.1/servers/9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56 => generated 1225 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:07:13.859232 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8aa4f3b7-1c39-47fe-8282-106f824ee463 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:07:13.864791 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8aa4f3b7-1c39-47fe-8282-106f824ee463 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:07:13.868754 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8aa4f3b7-1c39-47fe-8282-106f824ee463 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:07:13.869347 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8aa4f3b7-1c39-47fe-8282-106f824ee463 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:07:13.869894 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8aa4f3b7-1c39-47fe-8282-106f824ee463 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:07:13.870684 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8aa4f3b7-1c39-47fe-8282-106f824ee463 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:07:13.871227 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8aa4f3b7-1c39-47fe-8282-106f824ee463 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:07:13.871745 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8aa4f3b7-1c39-47fe-8282-106f824ee463 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:07:13.940396 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8aa4f3b7-1c39-47fe-8282-106f824ee463 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:07:13.948349 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8aa4f3b7-1c39-47fe-8282-106f824ee463 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56" status: 200 len: 1225 microversion: 2.1 time: 0.093721 Oct 19 04:07:13.948912 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3762/7139] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:07:13 2022] GET /compute/v2.1/servers/9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56 => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:07:14.972002 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-43da1bc9-a65b-46f9-ba9a-709592ecd746 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:07:14.972702 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-43da1bc9-a65b-46f9-ba9a-709592ecd746 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:07:14.979698 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-43da1bc9-a65b-46f9-ba9a-709592ecd746 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:07:14.980199 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-43da1bc9-a65b-46f9-ba9a-709592ecd746 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:07:14.980648 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-43da1bc9-a65b-46f9-ba9a-709592ecd746 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:07:14.981356 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-43da1bc9-a65b-46f9-ba9a-709592ecd746 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:07:14.981845 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-43da1bc9-a65b-46f9-ba9a-709592ecd746 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:07:14.982283 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-43da1bc9-a65b-46f9-ba9a-709592ecd746 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:07:15.014526 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-43da1bc9-a65b-46f9-ba9a-709592ecd746 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:07:15.015204 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-43da1bc9-a65b-46f9-ba9a-709592ecd746 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:07:15.015831 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-43da1bc9-a65b-46f9-ba9a-709592ecd746 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:07:15.016306 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-43da1bc9-a65b-46f9-ba9a-709592ecd746 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lazy-loading 'fault' on Instance uuid 9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56 {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 04:07:15.058566 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-43da1bc9-a65b-46f9-ba9a-709592ecd746 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:07:15.066574 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-43da1bc9-a65b-46f9-ba9a-709592ecd746 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56" status: 200 len: 1230 microversion: 2.1 time: 0.098939 Oct 19 04:07:15.067143 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3763/7140] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:07:14 2022] GET /compute/v2.1/servers/9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56 => generated 1230 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:07:16.097216 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-169d4c4f-b9e3-469a-b14a-5c0863588049 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:07:16.097876 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-169d4c4f-b9e3-469a-b14a-5c0863588049 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:07:16.105053 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-169d4c4f-b9e3-469a-b14a-5c0863588049 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:07:16.105604 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-169d4c4f-b9e3-469a-b14a-5c0863588049 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:07:16.106068 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-169d4c4f-b9e3-469a-b14a-5c0863588049 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:07:16.106776 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-169d4c4f-b9e3-469a-b14a-5c0863588049 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:07:16.107253 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-169d4c4f-b9e3-469a-b14a-5c0863588049 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:07:16.107702 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-169d4c4f-b9e3-469a-b14a-5c0863588049 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:07:16.121166 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-169d4c4f-b9e3-469a-b14a-5c0863588049 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] HTTP exception thrown: Instance 9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56 could not be found. Oct 19 04:07:16.122842 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-169d4c4f-b9e3-469a-b14a-5c0863588049 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Request method failure captured: Oct 19 04:07:16.122842 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56 HTTP/1.1 Oct 19 04:07:16.122842 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 04:07:16.122842 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 04:07:16.122842 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 04:07:16.122842 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 04:07:16.122842 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 04:07:16.122842 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 04:07:16.122842 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 04:07:16.122842 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 04:07:16.122842 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3XYw5PeFcmVZaG2CxoqLxKroO9lkG-Hw7MzEkzHPy2_aqlf3HPBMKgLOXoQ-WbgkZbvZB1PbShR7FiiZmGSIVTCeQrWw3ytKpP-AuucJQP3lFFYEs8HquAFih6wwJOh2-3eNgmaxbIZUVh9y_A1g_wYecm08YmNoRnAnQnVYIDNRwE Oct 19 04:07:16.122842 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 04:07:16.122842 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 04:07:16.122842 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 04:07:16.122842 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 04:07:16.122842 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 04:07:16.122842 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 04:07:16.122842 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: beff434485604f85985617071a93727c Oct 19 04:07:16.122842 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-TestVolumeBootPattern-954873624 Oct 19 04:07:16.122842 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 04:07:16.122842 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 04:07:16.122842 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/beff434485604f85985617071a93727c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/beff434485604f85985617071a93727c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/beff434485604f85985617071a93727c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_beff434485604f85985617071a93727c", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 04:07:16.122842 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-TestVolumeBootPattern-954873624 Oct 19 04:07:16.122842 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: beff434485604f85985617071a93727c Oct 19 04:07:16.122842 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-TestVolumeBootPattern-954873624 Oct 19 04:07:16.122842 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-TestVolumeBootPattern-954873624-project Oct 19 04:07:16.122842 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 04:07:16.122842 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 04:07:16.122842 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 4d30aa868d79473f9534bd79816c07e3 Oct 19 04:07:16.122842 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-TestVolumeBootPattern-954873624-project Oct 19 04:07:16.122842 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 04:07:16.122842 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance 9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56 could not be found. Oct 19 04:07:16.122842 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56'} Oct 19 04:07:16.122842 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 04:07:16.122842 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:07:16.122842 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 04:07:16.122842 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 04:07:16.122842 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 04:07:16.122842 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 04:07:16.122842 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 04:07:16.122842 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 04:07:16.122842 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 04:07:16.122842 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 04:07:16.122842 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56 could not be found. Oct 19 04:07:16.122842 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:07:16.122842 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:07:16.122842 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:07:16.122842 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:07:16.122842 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:07:16.122842 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:07:16.122842 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 04:07:16.122842 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 04:07:16.122842 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 04:07:16.122842 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 04:07:16.122842 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 04:07:16.122842 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 04:07:16.122842 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 04:07:16.122842 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 04:07:16.122842 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 04:07:16.122842 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 04:07:16.122842 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56 could not be found. Oct 19 04:07:16.122842 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:07:16.122842 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:07:16.122842 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:07:16.132269 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:07:16.132269 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:07:16.132269 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:07:16.132269 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 04:07:16.132269 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 04:07:16.132269 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56 could not be found. Oct 19 04:07:16.132269 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:07:16.132269 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-169d4c4f-b9e3-469a-b14a-5c0863588049 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Returning 404 to user: Instance 9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 04:07:16.132269 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-169d4c4f-b9e3-469a-b14a-5c0863588049 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56" status: 404 len: 111 microversion: 2.1 time: 0.032146 Oct 19 04:07:16.132269 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3764/7141] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:07:16 2022] GET /compute/v2.1/servers/9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 04:07:16.228131 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-79b23bc9-3f44-45df-ab35-003cdd989b2e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-446668039", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-374641124", "security_groups": [{"name": "tempest-secgroup-smoke-777567092"}], "block_device_mapping_v2": [{"uuid": "806b3a42-ea4f-499f-9161-9b935b2baf57", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d55e7db4-c570-4a69-afcb-0fab975a7a7e"}]}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:07:16.347350 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-79b23bc9-3f44-45df-ab35-003cdd989b2e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] validate_networks() for [('d55e7db4-c570-4a69-afcb-0fab975a7a7e', None, None, None, None, None)] {{(pid=121134) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 04:07:16.733527 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-79b23bc9-3f44-45df-ab35-003cdd989b2e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Flavor limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 04:07:16.733972 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-79b23bc9-3f44-45df-ab35-003cdd989b2e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Image limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 04:07:16.734483 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-79b23bc9-3f44-45df-ab35-003cdd989b2e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Flavor pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 04:07:16.735484 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-79b23bc9-3f44-45df-ab35-003cdd989b2e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Image pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 04:07:16.735976 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-79b23bc9-3f44-45df-ab35-003cdd989b2e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 04:07:16.745049 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-79b23bc9-3f44-45df-ab35-003cdd989b2e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:07:16.745596 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-79b23bc9-3f44-45df-ab35-003cdd989b2e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:07:16.746128 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-79b23bc9-3f44-45df-ab35-003cdd989b2e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:07:16.746867 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-79b23bc9-3f44-45df-ab35-003cdd989b2e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:07:16.747335 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-79b23bc9-3f44-45df-ab35-003cdd989b2e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:07:16.747774 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-79b23bc9-3f44-45df-ab35-003cdd989b2e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:07:16.764355 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-79b23bc9-3f44-45df-ab35-003cdd989b2e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Getting quotas for project beff434485604f85985617071a93727c. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 04:07:16.770087 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-79b23bc9-3f44-45df-ab35-003cdd989b2e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Getting quotas for user 4d30aa868d79473f9534bd79816c07e3 and project beff434485604f85985617071a93727c. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 04:07:16.830525 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-79b23bc9-3f44-45df-ab35-003cdd989b2e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Going to run 1 instances... {{(pid=121134) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 04:07:16.832693 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-79b23bc9-3f44-45df-ab35-003cdd989b2e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 1f95df19-4270-423d-8738-a749b9981006] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='806b3a42-ea4f-499f-9161-9b935b2baf57',volume_size=None,volume_type=None)] {{(pid=121134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 04:07:17.252886 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-79b23bc9-3f44-45df-ab35-003cdd989b2e tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.028898 Oct 19 04:07:17.253900 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3765/7142] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 04:07:16 2022] POST /compute/v2.1/servers => generated 405 bytes in 1031 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 04:07:17.265304 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b6fd17d0-df35-4fe9-81d7-58d8c5f22cb1 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:07:17.266816 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b6fd17d0-df35-4fe9-81d7-58d8c5f22cb1 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 1f95df19-4270-423d-8738-a749b9981006] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:07:17.339172 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b6fd17d0-df35-4fe9-81d7-58d8c5f22cb1 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:07:17.347371 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b6fd17d0-df35-4fe9-81d7-58d8c5f22cb1 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/1f95df19-4270-423d-8738-a749b9981006" status: 200 len: 1093 microversion: 2.1 time: 0.086183 Oct 19 04:07:17.348161 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3766/7143] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:07:17 2022] GET /compute/v2.1/servers/1f95df19-4270-423d-8738-a749b9981006 => generated 1093 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:07:18.384635 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-55e67914-3add-4eed-9a55-411db31d0302 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:07:18.385297 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-55e67914-3add-4eed-9a55-411db31d0302 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 1f95df19-4270-423d-8738-a749b9981006] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:07:18.395927 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-55e67914-3add-4eed-9a55-411db31d0302 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:07:18.396478 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-55e67914-3add-4eed-9a55-411db31d0302 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:07:18.396932 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-55e67914-3add-4eed-9a55-411db31d0302 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:07:18.397680 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-55e67914-3add-4eed-9a55-411db31d0302 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:07:18.398151 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-55e67914-3add-4eed-9a55-411db31d0302 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:07:18.398883 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-55e67914-3add-4eed-9a55-411db31d0302 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:07:18.466849 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-55e67914-3add-4eed-9a55-411db31d0302 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:07:18.475390 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-55e67914-3add-4eed-9a55-411db31d0302 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/1f95df19-4270-423d-8738-a749b9981006" status: 200 len: 1143 microversion: 2.1 time: 0.094647 Oct 19 04:07:18.475956 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3767/7144] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:07:18 2022] GET /compute/v2.1/servers/1f95df19-4270-423d-8738-a749b9981006 => generated 1143 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:07:19.499209 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6325c879-e3ea-4947-a717-56e6a0ebe638 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:07:19.499778 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6325c879-e3ea-4947-a717-56e6a0ebe638 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 1f95df19-4270-423d-8738-a749b9981006] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:07:19.507135 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6325c879-e3ea-4947-a717-56e6a0ebe638 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:07:19.507644 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6325c879-e3ea-4947-a717-56e6a0ebe638 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:07:19.508278 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6325c879-e3ea-4947-a717-56e6a0ebe638 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:07:19.509004 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6325c879-e3ea-4947-a717-56e6a0ebe638 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:07:19.509543 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6325c879-e3ea-4947-a717-56e6a0ebe638 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:07:19.509998 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6325c879-e3ea-4947-a717-56e6a0ebe638 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:07:19.588932 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-6325c879-e3ea-4947-a717-56e6a0ebe638 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:07:19.599674 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6325c879-e3ea-4947-a717-56e6a0ebe638 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/1f95df19-4270-423d-8738-a749b9981006" status: 200 len: 1199 microversion: 2.1 time: 0.103854 Oct 19 04:07:19.600343 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3768/7145] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:07:19 2022] GET /compute/v2.1/servers/1f95df19-4270-423d-8738-a749b9981006 => generated 1199 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:07:20.623479 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-58c61a6b-3426-40f4-af3f-6e92d3c267c8 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:07:20.624234 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-58c61a6b-3426-40f4-af3f-6e92d3c267c8 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 1f95df19-4270-423d-8738-a749b9981006] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:07:20.632052 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-58c61a6b-3426-40f4-af3f-6e92d3c267c8 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:07:20.632776 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-58c61a6b-3426-40f4-af3f-6e92d3c267c8 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:07:20.633489 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-58c61a6b-3426-40f4-af3f-6e92d3c267c8 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:07:20.634428 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-58c61a6b-3426-40f4-af3f-6e92d3c267c8 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:07:20.635066 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-58c61a6b-3426-40f4-af3f-6e92d3c267c8 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:07:20.635665 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-58c61a6b-3426-40f4-af3f-6e92d3c267c8 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:07:20.841624 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-58c61a6b-3426-40f4-af3f-6e92d3c267c8 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:07:20.850535 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-58c61a6b-3426-40f4-af3f-6e92d3c267c8 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/1f95df19-4270-423d-8738-a749b9981006" status: 200 len: 1276 microversion: 2.1 time: 0.231147 Oct 19 04:07:20.860954 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3769/7146] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:07:20 2022] GET /compute/v2.1/servers/1f95df19-4270-423d-8738-a749b9981006 => generated 1276 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:07:21.278873 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-a640028f-1345-462b-b07c-e40ed1eba04c req-0d7804b8-af26-4d02-bc8b-1ab9fe64a3df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f95df19-4270-423d-8738-a749b9981006", "tag": "0b09badc-c0d4-4e27-bbc7-3b0304eadc2c"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:07:21.291937 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-a640028f-1345-462b-b07c-e40ed1eba04c req-0d7804b8-af26-4d02-bc8b-1ab9fe64a3df service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:07:21.292590 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-a640028f-1345-462b-b07c-e40ed1eba04c req-0d7804b8-af26-4d02-bc8b-1ab9fe64a3df service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:07:21.293197 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-a640028f-1345-462b-b07c-e40ed1eba04c req-0d7804b8-af26-4d02-bc8b-1ab9fe64a3df service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:07:21.305970 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-a640028f-1345-462b-b07c-e40ed1eba04c req-0d7804b8-af26-4d02-bc8b-1ab9fe64a3df service nova] Creating event network-changed:0b09badc-c0d4-4e27-bbc7-3b0304eadc2c for instance 1f95df19-4270-423d-8738-a749b9981006 on n-h2-861333-8 Oct 19 04:07:21.311343 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-a640028f-1345-462b-b07c-e40ed1eba04c req-0d7804b8-af26-4d02-bc8b-1ab9fe64a3df service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045595 Oct 19 04:07:21.312181 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3770/7147] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:07:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 04:07:21.877770 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-33f07b68-fc60-46da-b646-194c90b97411 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:07:21.879186 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-33f07b68-fc60-46da-b646-194c90b97411 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 1f95df19-4270-423d-8738-a749b9981006] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:07:21.886505 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-33f07b68-fc60-46da-b646-194c90b97411 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:07:21.887267 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-33f07b68-fc60-46da-b646-194c90b97411 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:07:21.887918 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-33f07b68-fc60-46da-b646-194c90b97411 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:07:21.888812 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-33f07b68-fc60-46da-b646-194c90b97411 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:07:21.889540 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-33f07b68-fc60-46da-b646-194c90b97411 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:07:21.890185 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-33f07b68-fc60-46da-b646-194c90b97411 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:07:22.111752 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-33f07b68-fc60-46da-b646-194c90b97411 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:07:22.120335 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-33f07b68-fc60-46da-b646-194c90b97411 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/1f95df19-4270-423d-8738-a749b9981006" status: 200 len: 1276 microversion: 2.1 time: 0.246765 Oct 19 04:07:22.121666 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3771/7148] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:07:21 2022] GET /compute/v2.1/servers/1f95df19-4270-423d-8738-a749b9981006 => generated 1276 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:07:23.143556 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-58031b7e-cb46-4270-8655-d41075ecc8c6 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:07:23.144500 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-58031b7e-cb46-4270-8655-d41075ecc8c6 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 1f95df19-4270-423d-8738-a749b9981006] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:07:23.152136 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-58031b7e-cb46-4270-8655-d41075ecc8c6 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:07:23.152650 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-58031b7e-cb46-4270-8655-d41075ecc8c6 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:07:23.153348 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-58031b7e-cb46-4270-8655-d41075ecc8c6 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:07:23.154103 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-58031b7e-cb46-4270-8655-d41075ecc8c6 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:07:23.154580 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-58031b7e-cb46-4270-8655-d41075ecc8c6 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:07:23.155031 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-58031b7e-cb46-4270-8655-d41075ecc8c6 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:07:23.160655 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:07:23.295500 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-58031b7e-cb46-4270-8655-d41075ecc8c6 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:07:23.303694 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-58031b7e-cb46-4270-8655-d41075ecc8c6 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/1f95df19-4270-423d-8738-a749b9981006" status: 200 len: 1276 microversion: 2.1 time: 0.164027 Oct 19 04:07:23.311238 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3772/7149] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:07:23 2022] GET /compute/v2.1/servers/1f95df19-4270-423d-8738-a749b9981006 => generated 1276 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:07:24.327107 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a35d589e-782d-4e97-aded-009bce145572 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:07:24.327860 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a35d589e-782d-4e97-aded-009bce145572 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 1f95df19-4270-423d-8738-a749b9981006] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:07:24.335637 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a35d589e-782d-4e97-aded-009bce145572 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:07:24.336141 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a35d589e-782d-4e97-aded-009bce145572 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:07:24.336592 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a35d589e-782d-4e97-aded-009bce145572 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:07:24.337338 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a35d589e-782d-4e97-aded-009bce145572 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:07:24.337865 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a35d589e-782d-4e97-aded-009bce145572 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:07:24.338308 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a35d589e-782d-4e97-aded-009bce145572 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:07:24.482302 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a35d589e-782d-4e97-aded-009bce145572 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:07:24.490783 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a35d589e-782d-4e97-aded-009bce145572 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/1f95df19-4270-423d-8738-a749b9981006" status: 200 len: 1276 microversion: 2.1 time: 0.167679 Oct 19 04:07:24.491409 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3773/7150] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:07:24 2022] GET /compute/v2.1/servers/1f95df19-4270-423d-8738-a749b9981006 => generated 1276 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:07:25.513702 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a0e4cc54-5223-4b18-91fc-6ec88967aca3 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:07:25.514359 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a0e4cc54-5223-4b18-91fc-6ec88967aca3 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 1f95df19-4270-423d-8738-a749b9981006] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:07:25.521638 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a0e4cc54-5223-4b18-91fc-6ec88967aca3 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:07:25.522150 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a0e4cc54-5223-4b18-91fc-6ec88967aca3 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:07:25.522612 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a0e4cc54-5223-4b18-91fc-6ec88967aca3 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:07:25.523332 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a0e4cc54-5223-4b18-91fc-6ec88967aca3 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:07:25.524089 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a0e4cc54-5223-4b18-91fc-6ec88967aca3 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:07:25.524563 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a0e4cc54-5223-4b18-91fc-6ec88967aca3 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:07:25.659926 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a0e4cc54-5223-4b18-91fc-6ec88967aca3 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:07:25.667977 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a0e4cc54-5223-4b18-91fc-6ec88967aca3 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/1f95df19-4270-423d-8738-a749b9981006" status: 200 len: 1264 microversion: 2.1 time: 0.158204 Oct 19 04:07:25.668640 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3774/7151] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:07:25 2022] GET /compute/v2.1/servers/1f95df19-4270-423d-8738-a749b9981006 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:07:26.691519 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-916c2eda-7845-4b43-8e43-81d78e7e16ea tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:07:26.692158 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-916c2eda-7845-4b43-8e43-81d78e7e16ea tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 1f95df19-4270-423d-8738-a749b9981006] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:07:26.699222 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-916c2eda-7845-4b43-8e43-81d78e7e16ea tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:07:26.699734 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-916c2eda-7845-4b43-8e43-81d78e7e16ea tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:07:26.700188 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-916c2eda-7845-4b43-8e43-81d78e7e16ea tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:07:26.700894 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-916c2eda-7845-4b43-8e43-81d78e7e16ea tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:07:26.701364 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-916c2eda-7845-4b43-8e43-81d78e7e16ea tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:07:26.701832 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-916c2eda-7845-4b43-8e43-81d78e7e16ea tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:07:26.755714 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:07:26.843413 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-916c2eda-7845-4b43-8e43-81d78e7e16ea tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:07:26.851283 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-916c2eda-7845-4b43-8e43-81d78e7e16ea tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/1f95df19-4270-423d-8738-a749b9981006" status: 200 len: 1264 microversion: 2.1 time: 0.164274 Oct 19 04:07:26.851863 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3775/7152] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:07:26 2022] GET /compute/v2.1/servers/1f95df19-4270-423d-8738-a749b9981006 => generated 1264 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:07:27.874823 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a7dc42ef-f4c3-45d1-a484-f9ba3e74cd24 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:07:27.875485 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a7dc42ef-f4c3-45d1-a484-f9ba3e74cd24 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 1f95df19-4270-423d-8738-a749b9981006] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:07:27.877356 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=8 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:07:27.883102 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a7dc42ef-f4c3-45d1-a484-f9ba3e74cd24 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:07:27.883613 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a7dc42ef-f4c3-45d1-a484-f9ba3e74cd24 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:07:27.884075 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a7dc42ef-f4c3-45d1-a484-f9ba3e74cd24 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:07:27.884794 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a7dc42ef-f4c3-45d1-a484-f9ba3e74cd24 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:07:27.885272 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a7dc42ef-f4c3-45d1-a484-f9ba3e74cd24 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:07:27.885748 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a7dc42ef-f4c3-45d1-a484-f9ba3e74cd24 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:07:28.020845 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a7dc42ef-f4c3-45d1-a484-f9ba3e74cd24 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:07:28.029206 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a7dc42ef-f4c3-45d1-a484-f9ba3e74cd24 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/1f95df19-4270-423d-8738-a749b9981006" status: 200 len: 1264 microversion: 2.1 time: 0.158277 Oct 19 04:07:28.030036 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3776/7153] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:07:27 2022] GET /compute/v2.1/servers/1f95df19-4270-423d-8738-a749b9981006 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:07:29.051966 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9c91ced6-831f-497e-80e1-5eb61426d539 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:07:29.052589 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9c91ced6-831f-497e-80e1-5eb61426d539 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 1f95df19-4270-423d-8738-a749b9981006] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:07:29.059644 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9c91ced6-831f-497e-80e1-5eb61426d539 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:07:29.060147 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9c91ced6-831f-497e-80e1-5eb61426d539 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:07:29.060601 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9c91ced6-831f-497e-80e1-5eb61426d539 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:07:29.061357 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9c91ced6-831f-497e-80e1-5eb61426d539 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:07:29.061853 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9c91ced6-831f-497e-80e1-5eb61426d539 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:07:29.062298 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9c91ced6-831f-497e-80e1-5eb61426d539 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:07:29.195478 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9c91ced6-831f-497e-80e1-5eb61426d539 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:07:29.203984 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9c91ced6-831f-497e-80e1-5eb61426d539 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/1f95df19-4270-423d-8738-a749b9981006" status: 200 len: 1264 microversion: 2.1 time: 0.155885 Oct 19 04:07:29.204571 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3777/7154] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:07:29 2022] GET /compute/v2.1/servers/1f95df19-4270-423d-8738-a749b9981006 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:07:30.226621 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9eb7fb14-76b5-4ea7-8764-6f0e7b317adb tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:07:30.227263 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9eb7fb14-76b5-4ea7-8764-6f0e7b317adb tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 1f95df19-4270-423d-8738-a749b9981006] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:07:30.234835 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9eb7fb14-76b5-4ea7-8764-6f0e7b317adb tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:07:30.235336 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9eb7fb14-76b5-4ea7-8764-6f0e7b317adb tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:07:30.235783 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9eb7fb14-76b5-4ea7-8764-6f0e7b317adb tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:07:30.236482 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9eb7fb14-76b5-4ea7-8764-6f0e7b317adb tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:07:30.236947 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9eb7fb14-76b5-4ea7-8764-6f0e7b317adb tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:07:30.237406 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9eb7fb14-76b5-4ea7-8764-6f0e7b317adb tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:07:30.374015 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9eb7fb14-76b5-4ea7-8764-6f0e7b317adb tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:07:30.382466 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9eb7fb14-76b5-4ea7-8764-6f0e7b317adb tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/1f95df19-4270-423d-8738-a749b9981006" status: 200 len: 1264 microversion: 2.1 time: 0.159749 Oct 19 04:07:30.383042 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3778/7155] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:07:30 2022] GET /compute/v2.1/servers/1f95df19-4270-423d-8738-a749b9981006 => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:07:31.406340 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-73856da7-d65d-45a6-86f2-de4395bbcf79 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:07:31.406993 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-73856da7-d65d-45a6-86f2-de4395bbcf79 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 1f95df19-4270-423d-8738-a749b9981006] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:07:31.414398 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-73856da7-d65d-45a6-86f2-de4395bbcf79 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:07:31.415169 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-73856da7-d65d-45a6-86f2-de4395bbcf79 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:07:31.415689 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-73856da7-d65d-45a6-86f2-de4395bbcf79 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:07:31.416461 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-73856da7-d65d-45a6-86f2-de4395bbcf79 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:07:31.416942 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-73856da7-d65d-45a6-86f2-de4395bbcf79 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:07:31.417413 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-73856da7-d65d-45a6-86f2-de4395bbcf79 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:07:31.552876 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-73856da7-d65d-45a6-86f2-de4395bbcf79 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:07:31.560915 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-73856da7-d65d-45a6-86f2-de4395bbcf79 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/1f95df19-4270-423d-8738-a749b9981006" status: 200 len: 1264 microversion: 2.1 time: 0.159198 Oct 19 04:07:31.561639 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3779/7156] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:07:31 2022] GET /compute/v2.1/servers/1f95df19-4270-423d-8738-a749b9981006 => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:07:32.583804 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9ce0c323-09c0-4438-9745-6eff49745749 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:07:32.584462 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9ce0c323-09c0-4438-9745-6eff49745749 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 1f95df19-4270-423d-8738-a749b9981006] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:07:32.591501 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9ce0c323-09c0-4438-9745-6eff49745749 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:07:32.592009 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9ce0c323-09c0-4438-9745-6eff49745749 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:07:32.592464 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9ce0c323-09c0-4438-9745-6eff49745749 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:07:32.593179 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9ce0c323-09c0-4438-9745-6eff49745749 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:07:32.593682 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9ce0c323-09c0-4438-9745-6eff49745749 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:07:32.594131 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9ce0c323-09c0-4438-9745-6eff49745749 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:07:32.735375 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9ce0c323-09c0-4438-9745-6eff49745749 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:07:32.743161 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9ce0c323-09c0-4438-9745-6eff49745749 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/1f95df19-4270-423d-8738-a749b9981006" status: 200 len: 1264 microversion: 2.1 time: 0.163259 Oct 19 04:07:32.743739 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3780/7157] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:07:32 2022] GET /compute/v2.1/servers/1f95df19-4270-423d-8738-a749b9981006 => generated 1264 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:07:33.766943 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4e0a8f54-b5f2-4fef-b068-71d501fcdfe9 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:07:33.768953 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4e0a8f54-b5f2-4fef-b068-71d501fcdfe9 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 1f95df19-4270-423d-8738-a749b9981006] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:07:33.776826 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4e0a8f54-b5f2-4fef-b068-71d501fcdfe9 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:07:33.777553 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4e0a8f54-b5f2-4fef-b068-71d501fcdfe9 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:07:33.778017 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4e0a8f54-b5f2-4fef-b068-71d501fcdfe9 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:07:33.778749 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4e0a8f54-b5f2-4fef-b068-71d501fcdfe9 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:07:33.779229 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4e0a8f54-b5f2-4fef-b068-71d501fcdfe9 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:07:33.779682 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4e0a8f54-b5f2-4fef-b068-71d501fcdfe9 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:07:33.916255 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-4e0a8f54-b5f2-4fef-b068-71d501fcdfe9 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:07:33.924693 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4e0a8f54-b5f2-4fef-b068-71d501fcdfe9 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/1f95df19-4270-423d-8738-a749b9981006" status: 200 len: 1264 microversion: 2.1 time: 0.161678 Oct 19 04:07:33.925277 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3781/7158] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:07:33 2022] GET /compute/v2.1/servers/1f95df19-4270-423d-8738-a749b9981006 => generated 1264 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:07:34.949199 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a361cd8a-e4d1-41eb-98e5-b49257462a19 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:07:34.949878 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a361cd8a-e4d1-41eb-98e5-b49257462a19 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 1f95df19-4270-423d-8738-a749b9981006] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:07:34.956873 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a361cd8a-e4d1-41eb-98e5-b49257462a19 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:07:34.957398 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a361cd8a-e4d1-41eb-98e5-b49257462a19 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:07:34.957886 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a361cd8a-e4d1-41eb-98e5-b49257462a19 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:07:34.958605 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a361cd8a-e4d1-41eb-98e5-b49257462a19 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:07:34.959084 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a361cd8a-e4d1-41eb-98e5-b49257462a19 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:07:34.959536 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a361cd8a-e4d1-41eb-98e5-b49257462a19 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:07:35.094350 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a361cd8a-e4d1-41eb-98e5-b49257462a19 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:07:35.102332 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a361cd8a-e4d1-41eb-98e5-b49257462a19 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/1f95df19-4270-423d-8738-a749b9981006" status: 200 len: 1264 microversion: 2.1 time: 0.157176 Oct 19 04:07:35.103008 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3782/7159] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:07:34 2022] GET /compute/v2.1/servers/1f95df19-4270-423d-8738-a749b9981006 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:07:35.801279 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-c77d16e8-0710-4571-b655-5898845b6f98 req-59929921-d6e7-4c21-a126-fc594edcef6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f95df19-4270-423d-8738-a749b9981006", "name": "network-vif-plugged", "status": "completed", "tag": "0b09badc-c0d4-4e27-bbc7-3b0304eadc2c"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:07:35.811558 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-c77d16e8-0710-4571-b655-5898845b6f98 req-59929921-d6e7-4c21-a126-fc594edcef6c service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:07:35.812713 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-c77d16e8-0710-4571-b655-5898845b6f98 req-59929921-d6e7-4c21-a126-fc594edcef6c service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:07:35.813198 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-c77d16e8-0710-4571-b655-5898845b6f98 req-59929921-d6e7-4c21-a126-fc594edcef6c service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:07:35.824248 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-c77d16e8-0710-4571-b655-5898845b6f98 req-59929921-d6e7-4c21-a126-fc594edcef6c service nova] Creating event network-vif-plugged:0b09badc-c0d4-4e27-bbc7-3b0304eadc2c for instance 1f95df19-4270-423d-8738-a749b9981006 on n-h2-861333-8 Oct 19 04:07:35.829921 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-c77d16e8-0710-4571-b655-5898845b6f98 req-59929921-d6e7-4c21-a126-fc594edcef6c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033148 Oct 19 04:07:35.830524 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3783/7160] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:07:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 04:07:36.126632 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-265cce5b-98e6-4c01-a409-518ac91b388a tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:07:36.127349 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-265cce5b-98e6-4c01-a409-518ac91b388a tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 1f95df19-4270-423d-8738-a749b9981006] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:07:36.133675 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-265cce5b-98e6-4c01-a409-518ac91b388a tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:07:36.134183 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-265cce5b-98e6-4c01-a409-518ac91b388a tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:07:36.134636 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-265cce5b-98e6-4c01-a409-518ac91b388a tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:07:36.135346 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-265cce5b-98e6-4c01-a409-518ac91b388a tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:07:36.135815 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-265cce5b-98e6-4c01-a409-518ac91b388a tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:07:36.136260 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-265cce5b-98e6-4c01-a409-518ac91b388a tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:07:36.268715 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-265cce5b-98e6-4c01-a409-518ac91b388a tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:07:36.277068 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-265cce5b-98e6-4c01-a409-518ac91b388a tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/1f95df19-4270-423d-8738-a749b9981006" status: 200 len: 1264 microversion: 2.1 time: 0.155560 Oct 19 04:07:36.277686 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3784/7161] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:07:36 2022] GET /compute/v2.1/servers/1f95df19-4270-423d-8738-a749b9981006 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:07:37.303434 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5397385a-ea67-4d9d-a176-95dbbc5e084c tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:07:37.303434 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5397385a-ea67-4d9d-a176-95dbbc5e084c tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 1f95df19-4270-423d-8738-a749b9981006] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:07:37.308765 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5397385a-ea67-4d9d-a176-95dbbc5e084c tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:07:37.309284 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5397385a-ea67-4d9d-a176-95dbbc5e084c tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:07:37.309744 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5397385a-ea67-4d9d-a176-95dbbc5e084c tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:07:37.310459 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5397385a-ea67-4d9d-a176-95dbbc5e084c tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:07:37.310952 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5397385a-ea67-4d9d-a176-95dbbc5e084c tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:07:37.311378 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5397385a-ea67-4d9d-a176-95dbbc5e084c tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:07:37.473751 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5397385a-ea67-4d9d-a176-95dbbc5e084c tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:07:37.482014 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5397385a-ea67-4d9d-a176-95dbbc5e084c tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/1f95df19-4270-423d-8738-a749b9981006" status: 200 len: 1264 microversion: 2.1 time: 0.185629 Oct 19 04:07:37.482823 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3785/7162] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:07:37 2022] GET /compute/v2.1/servers/1f95df19-4270-423d-8738-a749b9981006 => generated 1264 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:07:38.504810 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-65776039-fdf5-4ac8-9710-8b3e2a1439f0 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:07:38.505475 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-65776039-fdf5-4ac8-9710-8b3e2a1439f0 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 1f95df19-4270-423d-8738-a749b9981006] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:07:38.508168 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:07:38.517722 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-65776039-fdf5-4ac8-9710-8b3e2a1439f0 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:07:38.518934 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-65776039-fdf5-4ac8-9710-8b3e2a1439f0 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:07:38.519515 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-65776039-fdf5-4ac8-9710-8b3e2a1439f0 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:07:38.520238 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-65776039-fdf5-4ac8-9710-8b3e2a1439f0 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:07:38.521001 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-65776039-fdf5-4ac8-9710-8b3e2a1439f0 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:07:38.534270 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-65776039-fdf5-4ac8-9710-8b3e2a1439f0 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:07:38.659384 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-65776039-fdf5-4ac8-9710-8b3e2a1439f0 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:07:38.669803 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-65776039-fdf5-4ac8-9710-8b3e2a1439f0 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/1f95df19-4270-423d-8738-a749b9981006" status: 200 len: 1452 microversion: 2.1 time: 0.168337 Oct 19 04:07:38.670825 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3786/7163] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:07:38 2022] GET /compute/v2.1/servers/1f95df19-4270-423d-8738-a749b9981006 => generated 1452 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:07:38.696119 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-21c24d7e-a407-42d9-926c-2eefb05c1e9f tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:07:38.696747 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-21c24d7e-a407-42d9-926c-2eefb05c1e9f tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 1f95df19-4270-423d-8738-a749b9981006] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:07:38.703276 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-21c24d7e-a407-42d9-926c-2eefb05c1e9f tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:07:38.703778 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-21c24d7e-a407-42d9-926c-2eefb05c1e9f tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:07:38.704233 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-21c24d7e-a407-42d9-926c-2eefb05c1e9f tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:07:38.704947 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-21c24d7e-a407-42d9-926c-2eefb05c1e9f tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:07:38.705438 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-21c24d7e-a407-42d9-926c-2eefb05c1e9f tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:07:38.705885 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-21c24d7e-a407-42d9-926c-2eefb05c1e9f tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:07:38.847937 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-21c24d7e-a407-42d9-926c-2eefb05c1e9f tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:07:38.857380 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-21c24d7e-a407-42d9-926c-2eefb05c1e9f tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/1f95df19-4270-423d-8738-a749b9981006" status: 200 len: 1452 microversion: 2.1 time: 0.165803 Oct 19 04:07:38.857985 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3787/7164] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:07:38 2022] GET /compute/v2.1/servers/1f95df19-4270-423d-8738-a749b9981006 => generated 1452 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:07:41.243722 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-2daa8448-078a-4dd0-963b-d3a4371fbd42 req-6157f58c-f7f8-476e-af9f-ca1ca6b99a81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f95df19-4270-423d-8738-a749b9981006", "tag": "0b09badc-c0d4-4e27-bbc7-3b0304eadc2c"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:07:41.256056 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-2daa8448-078a-4dd0-963b-d3a4371fbd42 req-6157f58c-f7f8-476e-af9f-ca1ca6b99a81 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:07:41.257013 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-2daa8448-078a-4dd0-963b-d3a4371fbd42 req-6157f58c-f7f8-476e-af9f-ca1ca6b99a81 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:07:41.257660 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-2daa8448-078a-4dd0-963b-d3a4371fbd42 req-6157f58c-f7f8-476e-af9f-ca1ca6b99a81 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:07:41.270570 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-2daa8448-078a-4dd0-963b-d3a4371fbd42 req-6157f58c-f7f8-476e-af9f-ca1ca6b99a81 service nova] Creating event network-changed:0b09badc-c0d4-4e27-bbc7-3b0304eadc2c for instance 1f95df19-4270-423d-8738-a749b9981006 on n-h2-861333-8 Oct 19 04:07:41.276410 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-2daa8448-078a-4dd0-963b-d3a4371fbd42 req-6157f58c-f7f8-476e-af9f-ca1ca6b99a81 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036780 Oct 19 04:07:41.277097 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3788/7165] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:07:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 04:07:51.171512 n-d-861333-8 devstack@n-api.service[121135]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 04:07:51.172118 n-d-861333-8 devstack@n-api.service[121135]: Wed Oct 19 04:07:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.52) !!! Oct 19 04:09:31.180604 n-d-861333-8 devstack@n-api.service[121135]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 04:09:31.184338 n-d-861333-8 devstack@n-api.service[121135]: Wed Oct 19 04:09:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.52) !!! Oct 19 04:09:31.184338 n-d-861333-8 devstack@n-api.service[121135]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 04:09:31.184338 n-d-861333-8 devstack@n-api.service[121135]: Wed Oct 19 04:09:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.52) !!! Oct 19 04:09:57.679142 n-d-861333-8 devstack@n-api.service[121134]: ERROR oslo.messaging._drivers.impl_rabbit [-] [96947759-862b-4b0f-b2e1-828b2ec3f179] AMQP server on 10.222.0.52:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 19 04:09:57.679974 n-d-861333-8 devstack@n-api.service[121134]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1a02a1d9-5473-4a0a-ab8b-e198030a9897] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 19 04:09:57.680643 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=5 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:09:57.681407 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=92 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:09:57.682269 n-d-861333-8 devstack@n-api.service[121134]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 04:09:57.682408 n-d-861333-8 devstack@n-api.service[121134]: Wed Oct 19 04:09:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.52) !!! Oct 19 04:09:57.684094 n-d-861333-8 devstack@n-api.service[121134]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 19 04:09:57.684209 n-d-861333-8 devstack@n-api.service[121134]: Wed Oct 19 04:09:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.52) !!! Oct 19 04:09:57.690384 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f9654b2c-c51f-4958-ae0f-b961e09a2620 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1417220169", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "networks": [{"uuid": "ca4a59fa-4760-42f1-971a-79bf6f1d166b"}]}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:09:57.909486 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-f9654b2c-c51f-4958-ae0f-b961e09a2620 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] validate_networks() for [('ca4a59fa-4760-42f1-971a-79bf6f1d166b', None, None, None, None, None)] {{(pid=121134) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 04:09:58.318380 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-f9654b2c-c51f-4958-ae0f-b961e09a2620 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Flavor limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 04:09:58.319021 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-f9654b2c-c51f-4958-ae0f-b961e09a2620 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Image limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 04:09:58.319552 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-f9654b2c-c51f-4958-ae0f-b961e09a2620 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Flavor pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 04:09:58.319984 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-f9654b2c-c51f-4958-ae0f-b961e09a2620 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Image pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 04:09:58.320415 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-f9654b2c-c51f-4958-ae0f-b961e09a2620 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 04:09:58.329782 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f9654b2c-c51f-4958-ae0f-b961e09a2620 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:09:58.330288 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f9654b2c-c51f-4958-ae0f-b961e09a2620 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:09:58.330754 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f9654b2c-c51f-4958-ae0f-b961e09a2620 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:09:58.331815 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f9654b2c-c51f-4958-ae0f-b961e09a2620 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:09:58.332288 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f9654b2c-c51f-4958-ae0f-b961e09a2620 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:09:58.332741 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f9654b2c-c51f-4958-ae0f-b961e09a2620 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:09:58.349737 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-f9654b2c-c51f-4958-ae0f-b961e09a2620 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Getting quotas for project ae028dcf0d5949488105d6b9aa6b523d. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 04:09:58.355320 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-f9654b2c-c51f-4958-ae0f-b961e09a2620 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Getting quotas for user 7b1064b12837487488ed599b4656bcf7 and project ae028dcf0d5949488105d6b9aa6b523d. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 04:09:58.368238 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f9654b2c-c51f-4958-ae0f-b961e09a2620 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Going to run 1 instances... {{(pid=121134) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 04:09:58.370719 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f9654b2c-c51f-4958-ae0f-b961e09a2620 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] [instance: ee1ebc87-7d6d-47d9-bb84-87ab619cdda2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 04:09:58.479490 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f9654b2c-c51f-4958-ae0f-b961e09a2620 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.803217 Oct 19 04:09:58.480164 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3789/7166] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 04:09:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 805 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 19 04:09:58.492730 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f87dc257-fa17-4a4f-82e7-5f05cb154a53 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:09:58.493570 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f87dc257-fa17-4a4f-82e7-5f05cb154a53 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] [instance: ee1ebc87-7d6d-47d9-bb84-87ab619cdda2] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:09:58.565424 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-f87dc257-fa17-4a4f-82e7-5f05cb154a53 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1064b12837487488ed599b4656bcf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae028dcf0d5949488105d6b9aa6b523d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:09:58.573876 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f87dc257-fa17-4a4f-82e7-5f05cb154a53 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] 10.222.0.52 "GET /compute/v2.1/servers/ee1ebc87-7d6d-47d9-bb84-87ab619cdda2" status: 200 len: 1219 microversion: 2.1 time: 0.084424 Oct 19 04:09:58.578206 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3790/7167] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:09:58 2022] GET /compute/v2.1/servers/ee1ebc87-7d6d-47d9-bb84-87ab619cdda2 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:09:59.598312 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2ba488e6-af50-4340-9249-28e5bf77c504 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:09:59.598946 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2ba488e6-af50-4340-9249-28e5bf77c504 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] [instance: ee1ebc87-7d6d-47d9-bb84-87ab619cdda2] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:09:59.611465 n-d-861333-8 devstack@n-api.service[121134]: INFO oslo.messaging._drivers.impl_rabbit [-] [1a02a1d9-5473-4a0a-ab8b-e198030a9897] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 58976. Oct 19 04:09:59.618545 n-d-861333-8 devstack@n-api.service[121134]: INFO oslo.messaging._drivers.impl_rabbit [-] [96947759-862b-4b0f-b2e1-828b2ec3f179] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 58974. Oct 19 04:09:59.623102 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2ba488e6-af50-4340-9249-28e5bf77c504 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:09:59.623614 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2ba488e6-af50-4340-9249-28e5bf77c504 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:09:59.624073 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2ba488e6-af50-4340-9249-28e5bf77c504 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:09:59.624839 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2ba488e6-af50-4340-9249-28e5bf77c504 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:09:59.625316 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2ba488e6-af50-4340-9249-28e5bf77c504 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:09:59.625813 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2ba488e6-af50-4340-9249-28e5bf77c504 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:09:59.692510 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-2ba488e6-af50-4340-9249-28e5bf77c504 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1064b12837487488ed599b4656bcf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae028dcf0d5949488105d6b9aa6b523d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:09:59.701051 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2ba488e6-af50-4340-9249-28e5bf77c504 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] 10.222.0.52 "GET /compute/v2.1/servers/ee1ebc87-7d6d-47d9-bb84-87ab619cdda2" status: 200 len: 1223 microversion: 2.1 time: 0.107345 Oct 19 04:09:59.701752 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3791/7168] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:09:59 2022] GET /compute/v2.1/servers/ee1ebc87-7d6d-47d9-bb84-87ab619cdda2 => generated 1223 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:10:00.725607 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-51c59763-afd6-4e48-839f-58a2ea89ca34 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:10:00.726930 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-51c59763-afd6-4e48-839f-58a2ea89ca34 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] [instance: ee1ebc87-7d6d-47d9-bb84-87ab619cdda2] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:10:00.734248 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-51c59763-afd6-4e48-839f-58a2ea89ca34 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:10:00.734755 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-51c59763-afd6-4e48-839f-58a2ea89ca34 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:10:00.735250 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-51c59763-afd6-4e48-839f-58a2ea89ca34 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:10:00.735975 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-51c59763-afd6-4e48-839f-58a2ea89ca34 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:10:00.736455 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-51c59763-afd6-4e48-839f-58a2ea89ca34 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:10:00.736900 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-51c59763-afd6-4e48-839f-58a2ea89ca34 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:10:00.805473 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-51c59763-afd6-4e48-839f-58a2ea89ca34 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1064b12837487488ed599b4656bcf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae028dcf0d5949488105d6b9aa6b523d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:10:00.814985 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-51c59763-afd6-4e48-839f-58a2ea89ca34 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] 10.222.0.52 "GET /compute/v2.1/servers/ee1ebc87-7d6d-47d9-bb84-87ab619cdda2" status: 200 len: 1279 microversion: 2.1 time: 0.094042 Oct 19 04:10:00.819354 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3792/7169] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:10:00 2022] GET /compute/v2.1/servers/ee1ebc87-7d6d-47d9-bb84-87ab619cdda2 => generated 1279 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:10:01.839888 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-cb4572c2-a249-410e-b630-73f315acc91d tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:10:01.840539 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-cb4572c2-a249-410e-b630-73f315acc91d tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] [instance: ee1ebc87-7d6d-47d9-bb84-87ab619cdda2] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:10:01.847413 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cb4572c2-a249-410e-b630-73f315acc91d tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:10:01.848413 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cb4572c2-a249-410e-b630-73f315acc91d tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:10:01.848413 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cb4572c2-a249-410e-b630-73f315acc91d tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:10:01.851056 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cb4572c2-a249-410e-b630-73f315acc91d tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:10:01.851056 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cb4572c2-a249-410e-b630-73f315acc91d tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:10:01.851056 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cb4572c2-a249-410e-b630-73f315acc91d tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:10:01.997899 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-cb4572c2-a249-410e-b630-73f315acc91d tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1064b12837487488ed599b4656bcf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae028dcf0d5949488105d6b9aa6b523d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:10:02.007089 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-cb4572c2-a249-410e-b630-73f315acc91d tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] 10.222.0.52 "GET /compute/v2.1/servers/ee1ebc87-7d6d-47d9-bb84-87ab619cdda2" status: 200 len: 1319 microversion: 2.1 time: 0.171069 Oct 19 04:10:02.007681 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3793/7170] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:10:01 2022] GET /compute/v2.1/servers/ee1ebc87-7d6d-47d9-bb84-87ab619cdda2 => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:10:02.633130 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-fcb2ad54-f075-4827-bdcf-3325373c128c req-8112ed41-f785-4e3d-93fe-856351e2137d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee1ebc87-7d6d-47d9-bb84-87ab619cdda2", "tag": "a4262ed5-a521-4c09-9f87-01a6acf52b58"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:10:02.645098 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-fcb2ad54-f075-4827-bdcf-3325373c128c req-8112ed41-f785-4e3d-93fe-856351e2137d service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:10:02.645659 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-fcb2ad54-f075-4827-bdcf-3325373c128c req-8112ed41-f785-4e3d-93fe-856351e2137d service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:10:02.646114 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-fcb2ad54-f075-4827-bdcf-3325373c128c req-8112ed41-f785-4e3d-93fe-856351e2137d service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:10:02.657270 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-fcb2ad54-f075-4827-bdcf-3325373c128c req-8112ed41-f785-4e3d-93fe-856351e2137d service nova] Creating event network-changed:a4262ed5-a521-4c09-9f87-01a6acf52b58 for instance ee1ebc87-7d6d-47d9-bb84-87ab619cdda2 on n-h1-861333-8 Oct 19 04:10:02.664613 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-fcb2ad54-f075-4827-bdcf-3325373c128c req-8112ed41-f785-4e3d-93fe-856351e2137d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113307 Oct 19 04:10:02.665740 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3794/7171] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:10:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 04:10:03.035239 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b6b45564-6d1a-4786-9222-7ffddfc3d8ae tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:10:03.035991 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b6b45564-6d1a-4786-9222-7ffddfc3d8ae tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] [instance: ee1ebc87-7d6d-47d9-bb84-87ab619cdda2] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:10:03.042273 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b6b45564-6d1a-4786-9222-7ffddfc3d8ae tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:10:03.042773 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b6b45564-6d1a-4786-9222-7ffddfc3d8ae tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:10:03.043228 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b6b45564-6d1a-4786-9222-7ffddfc3d8ae tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:10:03.043935 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b6b45564-6d1a-4786-9222-7ffddfc3d8ae tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:10:03.044400 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b6b45564-6d1a-4786-9222-7ffddfc3d8ae tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:10:03.044843 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b6b45564-6d1a-4786-9222-7ffddfc3d8ae tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:10:03.187354 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b6b45564-6d1a-4786-9222-7ffddfc3d8ae tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1064b12837487488ed599b4656bcf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae028dcf0d5949488105d6b9aa6b523d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:10:03.197022 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b6b45564-6d1a-4786-9222-7ffddfc3d8ae tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] 10.222.0.52 "GET /compute/v2.1/servers/ee1ebc87-7d6d-47d9-bb84-87ab619cdda2" status: 200 len: 1319 microversion: 2.1 time: 0.167251 Oct 19 04:10:03.197627 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3795/7172] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:10:03 2022] GET /compute/v2.1/servers/ee1ebc87-7d6d-47d9-bb84-87ab619cdda2 => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:10:04.221689 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-98a13e89-cdc1-4da1-9e15-9e8127c90c08 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:10:04.222329 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-98a13e89-cdc1-4da1-9e15-9e8127c90c08 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] [instance: ee1ebc87-7d6d-47d9-bb84-87ab619cdda2] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:10:04.230334 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-98a13e89-cdc1-4da1-9e15-9e8127c90c08 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:10:04.230848 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-98a13e89-cdc1-4da1-9e15-9e8127c90c08 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:10:04.231443 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-98a13e89-cdc1-4da1-9e15-9e8127c90c08 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:10:04.232159 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-98a13e89-cdc1-4da1-9e15-9e8127c90c08 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:10:04.232641 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-98a13e89-cdc1-4da1-9e15-9e8127c90c08 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:10:04.233088 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-98a13e89-cdc1-4da1-9e15-9e8127c90c08 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:10:04.379516 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-98a13e89-cdc1-4da1-9e15-9e8127c90c08 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1064b12837487488ed599b4656bcf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae028dcf0d5949488105d6b9aa6b523d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:10:04.388870 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-98a13e89-cdc1-4da1-9e15-9e8127c90c08 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] 10.222.0.52 "GET /compute/v2.1/servers/ee1ebc87-7d6d-47d9-bb84-87ab619cdda2" status: 200 len: 1319 microversion: 2.1 time: 0.171085 Oct 19 04:10:04.389503 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3796/7173] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:10:04 2022] GET /compute/v2.1/servers/ee1ebc87-7d6d-47d9-bb84-87ab619cdda2 => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:10:05.412779 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2a1abd40-bf21-4b89-9174-49c5d6dc162a tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:10:05.413432 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2a1abd40-bf21-4b89-9174-49c5d6dc162a tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] [instance: ee1ebc87-7d6d-47d9-bb84-87ab619cdda2] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:10:05.421813 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2a1abd40-bf21-4b89-9174-49c5d6dc162a tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:10:05.422327 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2a1abd40-bf21-4b89-9174-49c5d6dc162a tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:10:05.422782 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2a1abd40-bf21-4b89-9174-49c5d6dc162a tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:10:05.423505 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2a1abd40-bf21-4b89-9174-49c5d6dc162a tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:10:05.423977 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2a1abd40-bf21-4b89-9174-49c5d6dc162a tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:10:05.424504 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2a1abd40-bf21-4b89-9174-49c5d6dc162a tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:10:05.569721 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-2a1abd40-bf21-4b89-9174-49c5d6dc162a tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1064b12837487488ed599b4656bcf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae028dcf0d5949488105d6b9aa6b523d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:10:05.579212 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2a1abd40-bf21-4b89-9174-49c5d6dc162a tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] 10.222.0.52 "GET /compute/v2.1/servers/ee1ebc87-7d6d-47d9-bb84-87ab619cdda2" status: 200 len: 1319 microversion: 2.1 time: 0.170197 Oct 19 04:10:05.579809 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3797/7174] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:10:05 2022] GET /compute/v2.1/servers/ee1ebc87-7d6d-47d9-bb84-87ab619cdda2 => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:10:06.603256 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c798b783-1a10-4307-aead-394718bcebf6 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:10:06.603997 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c798b783-1a10-4307-aead-394718bcebf6 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] [instance: ee1ebc87-7d6d-47d9-bb84-87ab619cdda2] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:10:06.610891 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c798b783-1a10-4307-aead-394718bcebf6 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:10:06.611393 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c798b783-1a10-4307-aead-394718bcebf6 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:10:06.611856 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c798b783-1a10-4307-aead-394718bcebf6 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:10:06.612556 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c798b783-1a10-4307-aead-394718bcebf6 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:10:06.613040 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c798b783-1a10-4307-aead-394718bcebf6 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:10:06.613509 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c798b783-1a10-4307-aead-394718bcebf6 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:10:06.755796 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c798b783-1a10-4307-aead-394718bcebf6 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1064b12837487488ed599b4656bcf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae028dcf0d5949488105d6b9aa6b523d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:10:06.765091 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c798b783-1a10-4307-aead-394718bcebf6 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] 10.222.0.52 "GET /compute/v2.1/servers/ee1ebc87-7d6d-47d9-bb84-87ab619cdda2" status: 200 len: 1319 microversion: 2.1 time: 0.165715 Oct 19 04:10:06.765713 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3798/7175] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:10:06 2022] GET /compute/v2.1/servers/ee1ebc87-7d6d-47d9-bb84-87ab619cdda2 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:10:07.787316 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-61ca9520-ee94-47f6-8817-d4e1e21ed38c tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:10:07.787991 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-61ca9520-ee94-47f6-8817-d4e1e21ed38c tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] [instance: ee1ebc87-7d6d-47d9-bb84-87ab619cdda2] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:10:07.795534 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-61ca9520-ee94-47f6-8817-d4e1e21ed38c tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:10:07.796038 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-61ca9520-ee94-47f6-8817-d4e1e21ed38c tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:10:07.796496 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-61ca9520-ee94-47f6-8817-d4e1e21ed38c tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:10:07.797213 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-61ca9520-ee94-47f6-8817-d4e1e21ed38c tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:10:07.797718 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-61ca9520-ee94-47f6-8817-d4e1e21ed38c tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:10:07.798168 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-61ca9520-ee94-47f6-8817-d4e1e21ed38c tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:10:07.948231 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-61ca9520-ee94-47f6-8817-d4e1e21ed38c tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1064b12837487488ed599b4656bcf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae028dcf0d5949488105d6b9aa6b523d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:10:07.955994 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-61ca9520-ee94-47f6-8817-d4e1e21ed38c tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] 10.222.0.52 "GET /compute/v2.1/servers/ee1ebc87-7d6d-47d9-bb84-87ab619cdda2" status: 200 len: 1319 microversion: 2.1 time: 0.172493 Oct 19 04:10:07.956747 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3799/7176] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:10:07 2022] GET /compute/v2.1/servers/ee1ebc87-7d6d-47d9-bb84-87ab619cdda2 => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:10:08.982238 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-12bc80d9-77dc-49aa-b952-2a4293849199 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:10:08.982946 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-12bc80d9-77dc-49aa-b952-2a4293849199 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] [instance: ee1ebc87-7d6d-47d9-bb84-87ab619cdda2] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:10:08.984867 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:10:08.985634 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=8 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:10:08.993705 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-12bc80d9-77dc-49aa-b952-2a4293849199 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:10:08.994215 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-12bc80d9-77dc-49aa-b952-2a4293849199 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:10:08.994773 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-12bc80d9-77dc-49aa-b952-2a4293849199 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:10:08.998025 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-12bc80d9-77dc-49aa-b952-2a4293849199 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:10:08.998025 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-12bc80d9-77dc-49aa-b952-2a4293849199 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:10:08.998025 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-12bc80d9-77dc-49aa-b952-2a4293849199 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:10:09.137689 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-12bc80d9-77dc-49aa-b952-2a4293849199 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1064b12837487488ed599b4656bcf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae028dcf0d5949488105d6b9aa6b523d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:10:09.148144 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-12bc80d9-77dc-49aa-b952-2a4293849199 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] 10.222.0.52 "GET /compute/v2.1/servers/ee1ebc87-7d6d-47d9-bb84-87ab619cdda2" status: 200 len: 1319 microversion: 2.1 time: 0.169828 Oct 19 04:10:09.149024 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3800/7177] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:10:08 2022] GET /compute/v2.1/servers/ee1ebc87-7d6d-47d9-bb84-87ab619cdda2 => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:10:10.195568 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-d8cd2c50-3274-4aff-86c6-03b901e6d88b req-03a542cd-a03d-42ba-963b-1d39f4b27e5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee1ebc87-7d6d-47d9-bb84-87ab619cdda2", "name": "network-vif-plugged", "status": "completed", "tag": "a4262ed5-a521-4c09-9f87-01a6acf52b58"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:10:10.205771 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-d8cd2c50-3274-4aff-86c6-03b901e6d88b req-03a542cd-a03d-42ba-963b-1d39f4b27e5a service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:10:10.206273 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-d8cd2c50-3274-4aff-86c6-03b901e6d88b req-03a542cd-a03d-42ba-963b-1d39f4b27e5a service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:10:10.206741 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-d8cd2c50-3274-4aff-86c6-03b901e6d88b req-03a542cd-a03d-42ba-963b-1d39f4b27e5a service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:10:10.217732 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-d8cd2c50-3274-4aff-86c6-03b901e6d88b req-03a542cd-a03d-42ba-963b-1d39f4b27e5a service nova] Creating event network-vif-plugged:a4262ed5-a521-4c09-9f87-01a6acf52b58 for instance ee1ebc87-7d6d-47d9-bb84-87ab619cdda2 on n-h1-861333-8 Oct 19 04:10:10.222809 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-d8cd2c50-3274-4aff-86c6-03b901e6d88b req-03a542cd-a03d-42ba-963b-1d39f4b27e5a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106679 Oct 19 04:10:10.223588 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3801/7178] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:10:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 04:10:10.228390 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-da5dfb30-dd2f-432d-8c6f-02d3c55916a6 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:10:10.229161 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-da5dfb30-dd2f-432d-8c6f-02d3c55916a6 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] [instance: ee1ebc87-7d6d-47d9-bb84-87ab619cdda2] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:10:10.235866 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-da5dfb30-dd2f-432d-8c6f-02d3c55916a6 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:10:10.236378 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-da5dfb30-dd2f-432d-8c6f-02d3c55916a6 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:10:10.236881 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-da5dfb30-dd2f-432d-8c6f-02d3c55916a6 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:10:10.242962 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-da5dfb30-dd2f-432d-8c6f-02d3c55916a6 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:10:10.243788 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-da5dfb30-dd2f-432d-8c6f-02d3c55916a6 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:10:10.244751 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-da5dfb30-dd2f-432d-8c6f-02d3c55916a6 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:10:10.402371 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-da5dfb30-dd2f-432d-8c6f-02d3c55916a6 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1064b12837487488ed599b4656bcf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae028dcf0d5949488105d6b9aa6b523d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:10:10.410596 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-da5dfb30-dd2f-432d-8c6f-02d3c55916a6 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] 10.222.0.52 "GET /compute/v2.1/servers/ee1ebc87-7d6d-47d9-bb84-87ab619cdda2" status: 200 len: 1319 microversion: 2.1 time: 0.186000 Oct 19 04:10:10.411195 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3802/7179] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:10:10 2022] GET /compute/v2.1/servers/ee1ebc87-7d6d-47d9-bb84-87ab619cdda2 => generated 1319 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:10:11.435371 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-eca49cd2-b701-4ec0-bed1-818b1552c5b1 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:10:11.436673 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-eca49cd2-b701-4ec0-bed1-818b1552c5b1 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] [instance: ee1ebc87-7d6d-47d9-bb84-87ab619cdda2] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:10:11.443597 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eca49cd2-b701-4ec0-bed1-818b1552c5b1 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:10:11.444102 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eca49cd2-b701-4ec0-bed1-818b1552c5b1 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:10:11.444561 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eca49cd2-b701-4ec0-bed1-818b1552c5b1 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:10:11.445321 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eca49cd2-b701-4ec0-bed1-818b1552c5b1 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:10:11.445816 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eca49cd2-b701-4ec0-bed1-818b1552c5b1 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:10:11.446262 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eca49cd2-b701-4ec0-bed1-818b1552c5b1 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:10:11.586055 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-eca49cd2-b701-4ec0-bed1-818b1552c5b1 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1064b12837487488ed599b4656bcf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae028dcf0d5949488105d6b9aa6b523d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:10:11.596308 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-eca49cd2-b701-4ec0-bed1-818b1552c5b1 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] 10.222.0.52 "GET /compute/v2.1/servers/ee1ebc87-7d6d-47d9-bb84-87ab619cdda2" status: 200 len: 1319 microversion: 2.1 time: 0.165042 Oct 19 04:10:11.596895 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3803/7180] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:10:11 2022] GET /compute/v2.1/servers/ee1ebc87-7d6d-47d9-bb84-87ab619cdda2 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:10:12.622554 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8f922700-a557-4170-8ebc-5aab6cc65cb7 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:10:12.623214 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8f922700-a557-4170-8ebc-5aab6cc65cb7 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] [instance: ee1ebc87-7d6d-47d9-bb84-87ab619cdda2] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:10:12.630349 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8f922700-a557-4170-8ebc-5aab6cc65cb7 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:10:12.643433 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8f922700-a557-4170-8ebc-5aab6cc65cb7 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:10:12.643433 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8f922700-a557-4170-8ebc-5aab6cc65cb7 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:10:12.643433 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8f922700-a557-4170-8ebc-5aab6cc65cb7 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:10:12.643433 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8f922700-a557-4170-8ebc-5aab6cc65cb7 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:10:12.643433 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8f922700-a557-4170-8ebc-5aab6cc65cb7 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:10:12.763924 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8f922700-a557-4170-8ebc-5aab6cc65cb7 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1064b12837487488ed599b4656bcf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae028dcf0d5949488105d6b9aa6b523d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:10:12.771802 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8f922700-a557-4170-8ebc-5aab6cc65cb7 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] 10.222.0.52 "GET /compute/v2.1/servers/ee1ebc87-7d6d-47d9-bb84-87ab619cdda2" status: 200 len: 1507 microversion: 2.1 time: 0.153544 Oct 19 04:10:12.772407 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3804/7181] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:10:12 2022] GET /compute/v2.1/servers/ee1ebc87-7d6d-47d9-bb84-87ab619cdda2 => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:10:23.101535 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-37904ed3-26e2-42ba-ab59-38a3324e4648 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1359731964", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-374641124", "security_groups": [{"name": "tempest-secgroup-smoke-777567092"}], "block_device_mapping_v2": [{"uuid": "337090af-8ab9-426d-8f6c-e6fbe59d346b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d55e7db4-c570-4a69-afcb-0fab975a7a7e"}]}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:10:23.115129 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:10:23.115804 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=78 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:10:23.383092 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-37904ed3-26e2-42ba-ab59-38a3324e4648 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] validate_networks() for [('d55e7db4-c570-4a69-afcb-0fab975a7a7e', None, None, None, None, None)] {{(pid=121134) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 04:10:23.776479 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-37904ed3-26e2-42ba-ab59-38a3324e4648 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Flavor limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 04:10:23.776921 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-37904ed3-26e2-42ba-ab59-38a3324e4648 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Image limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 04:10:23.777439 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-37904ed3-26e2-42ba-ab59-38a3324e4648 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Flavor pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 04:10:23.777871 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-37904ed3-26e2-42ba-ab59-38a3324e4648 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Image pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 04:10:23.778302 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-37904ed3-26e2-42ba-ab59-38a3324e4648 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 04:10:23.787953 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-37904ed3-26e2-42ba-ab59-38a3324e4648 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:10:23.788842 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-37904ed3-26e2-42ba-ab59-38a3324e4648 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:10:23.788971 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-37904ed3-26e2-42ba-ab59-38a3324e4648 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:10:23.789677 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-37904ed3-26e2-42ba-ab59-38a3324e4648 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:10:23.790173 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-37904ed3-26e2-42ba-ab59-38a3324e4648 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:10:23.790604 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-37904ed3-26e2-42ba-ab59-38a3324e4648 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:10:23.808738 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-37904ed3-26e2-42ba-ab59-38a3324e4648 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Getting quotas for project beff434485604f85985617071a93727c. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 04:10:23.814353 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-37904ed3-26e2-42ba-ab59-38a3324e4648 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Getting quotas for user 4d30aa868d79473f9534bd79816c07e3 and project beff434485604f85985617071a93727c. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 04:10:23.876550 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-37904ed3-26e2-42ba-ab59-38a3324e4648 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Going to run 1 instances... {{(pid=121134) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 04:10:23.878881 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-37904ed3-26e2-42ba-ab59-38a3324e4648 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 165ab672-2a25-4e32-ab1d-80b2b5133696] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='337090af-8ab9-426d-8f6c-e6fbe59d346b',volume_size=None,volume_type=None)] {{(pid=121134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 04:10:25.025328 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-37904ed3-26e2-42ba-ab59-38a3324e4648 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.927628 Oct 19 04:10:25.032808 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3805/7182] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 04:10:23 2022] POST /compute/v2.1/servers => generated 405 bytes in 1936 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 19 04:10:25.037702 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0882371b-db60-404c-a589-40fb6e989543 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:10:25.038340 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0882371b-db60-404c-a589-40fb6e989543 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 165ab672-2a25-4e32-ab1d-80b2b5133696] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:10:25.099002 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0882371b-db60-404c-a589-40fb6e989543 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:10:25.106817 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0882371b-db60-404c-a589-40fb6e989543 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/165ab672-2a25-4e32-ab1d-80b2b5133696" status: 200 len: 1094 microversion: 2.1 time: 0.072757 Oct 19 04:10:25.109121 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3806/7183] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:10:25 2022] GET /compute/v2.1/servers/165ab672-2a25-4e32-ab1d-80b2b5133696 => generated 1094 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:10:26.129409 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-51bf8c7d-89ce-4c41-9da8-ef42db586ccc tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:10:26.130142 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-51bf8c7d-89ce-4c41-9da8-ef42db586ccc tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 165ab672-2a25-4e32-ab1d-80b2b5133696] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:10:26.138497 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-51bf8c7d-89ce-4c41-9da8-ef42db586ccc tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:10:26.139038 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-51bf8c7d-89ce-4c41-9da8-ef42db586ccc tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:10:26.139497 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-51bf8c7d-89ce-4c41-9da8-ef42db586ccc tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:10:26.140345 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-51bf8c7d-89ce-4c41-9da8-ef42db586ccc tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:10:26.140817 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-51bf8c7d-89ce-4c41-9da8-ef42db586ccc tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:10:26.141260 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-51bf8c7d-89ce-4c41-9da8-ef42db586ccc tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:10:26.226750 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-51bf8c7d-89ce-4c41-9da8-ef42db586ccc tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:10:26.226750 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-51bf8c7d-89ce-4c41-9da8-ef42db586ccc tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/165ab672-2a25-4e32-ab1d-80b2b5133696" status: 200 len: 1144 microversion: 2.1 time: 0.101425 Oct 19 04:10:26.230803 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3807/7184] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:10:26 2022] GET /compute/v2.1/servers/165ab672-2a25-4e32-ab1d-80b2b5133696 => generated 1144 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:10:27.250982 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b7bdfa68-829f-4f88-a6e2-c7c60b713fa4 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:10:27.252030 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b7bdfa68-829f-4f88-a6e2-c7c60b713fa4 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 165ab672-2a25-4e32-ab1d-80b2b5133696] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:10:27.261019 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b7bdfa68-829f-4f88-a6e2-c7c60b713fa4 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:10:27.261648 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b7bdfa68-829f-4f88-a6e2-c7c60b713fa4 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:10:27.262349 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b7bdfa68-829f-4f88-a6e2-c7c60b713fa4 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:10:27.263321 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b7bdfa68-829f-4f88-a6e2-c7c60b713fa4 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:10:27.263876 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b7bdfa68-829f-4f88-a6e2-c7c60b713fa4 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:10:27.264399 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b7bdfa68-829f-4f88-a6e2-c7c60b713fa4 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:10:27.340993 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b7bdfa68-829f-4f88-a6e2-c7c60b713fa4 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:10:27.350010 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b7bdfa68-829f-4f88-a6e2-c7c60b713fa4 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/165ab672-2a25-4e32-ab1d-80b2b5133696" status: 200 len: 1192 microversion: 2.1 time: 0.102489 Oct 19 04:10:27.350745 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3808/7185] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:10:27 2022] GET /compute/v2.1/servers/165ab672-2a25-4e32-ab1d-80b2b5133696 => generated 1192 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:10:28.375303 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1fab3c96-3d5e-4b10-9bb6-3d997c15cb36 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:10:28.375937 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1fab3c96-3d5e-4b10-9bb6-3d997c15cb36 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 165ab672-2a25-4e32-ab1d-80b2b5133696] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:10:28.389519 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1fab3c96-3d5e-4b10-9bb6-3d997c15cb36 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:10:28.390043 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1fab3c96-3d5e-4b10-9bb6-3d997c15cb36 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:10:28.390504 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1fab3c96-3d5e-4b10-9bb6-3d997c15cb36 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:10:28.391235 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1fab3c96-3d5e-4b10-9bb6-3d997c15cb36 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:10:28.391771 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1fab3c96-3d5e-4b10-9bb6-3d997c15cb36 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:10:28.392221 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1fab3c96-3d5e-4b10-9bb6-3d997c15cb36 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:10:28.569268 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-1fab3c96-3d5e-4b10-9bb6-3d997c15cb36 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:10:28.575727 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1fab3c96-3d5e-4b10-9bb6-3d997c15cb36 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/165ab672-2a25-4e32-ab1d-80b2b5133696" status: 200 len: 1277 microversion: 2.1 time: 0.204447 Oct 19 04:10:28.585073 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3809/7186] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:10:28 2022] GET /compute/v2.1/servers/165ab672-2a25-4e32-ab1d-80b2b5133696 => generated 1277 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:10:29.600213 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4865c802-d76d-44ad-a983-66b3742f6c79 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:10:29.601638 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4865c802-d76d-44ad-a983-66b3742f6c79 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 165ab672-2a25-4e32-ab1d-80b2b5133696] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:10:29.610560 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4865c802-d76d-44ad-a983-66b3742f6c79 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:10:29.611078 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4865c802-d76d-44ad-a983-66b3742f6c79 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:10:29.613393 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4865c802-d76d-44ad-a983-66b3742f6c79 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:10:29.613393 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4865c802-d76d-44ad-a983-66b3742f6c79 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:10:29.613393 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4865c802-d76d-44ad-a983-66b3742f6c79 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:10:29.613393 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4865c802-d76d-44ad-a983-66b3742f6c79 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:10:29.784739 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-4865c802-d76d-44ad-a983-66b3742f6c79 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:10:29.794368 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4865c802-d76d-44ad-a983-66b3742f6c79 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/165ab672-2a25-4e32-ab1d-80b2b5133696" status: 200 len: 1277 microversion: 2.1 time: 0.198375 Oct 19 04:10:29.806300 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3810/7187] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:10:29 2022] GET /compute/v2.1/servers/165ab672-2a25-4e32-ab1d-80b2b5133696 => generated 1277 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:10:29.942089 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-e0160945-0517-467a-84ae-1e76bbe314fc req-8d466267-a5e0-4ba2-90d0-63380a97686e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "165ab672-2a25-4e32-ab1d-80b2b5133696", "tag": "ed2cd9c7-b37a-4843-af41-06582eee726a"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:10:29.952138 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-e0160945-0517-467a-84ae-1e76bbe314fc req-8d466267-a5e0-4ba2-90d0-63380a97686e service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:10:29.952892 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-e0160945-0517-467a-84ae-1e76bbe314fc req-8d466267-a5e0-4ba2-90d0-63380a97686e service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:10:29.953713 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-e0160945-0517-467a-84ae-1e76bbe314fc req-8d466267-a5e0-4ba2-90d0-63380a97686e service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:10:29.968315 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-e0160945-0517-467a-84ae-1e76bbe314fc req-8d466267-a5e0-4ba2-90d0-63380a97686e service nova] Creating event network-changed:ed2cd9c7-b37a-4843-af41-06582eee726a for instance 165ab672-2a25-4e32-ab1d-80b2b5133696 on n-h2-861333-8 Oct 19 04:10:29.974099 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-e0160945-0517-467a-84ae-1e76bbe314fc req-8d466267-a5e0-4ba2-90d0-63380a97686e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099012 Oct 19 04:10:29.975016 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3811/7188] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:10:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 04:10:30.819381 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1302172c-88a5-4c42-a7bb-c2a300718db5 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:10:30.820297 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1302172c-88a5-4c42-a7bb-c2a300718db5 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 165ab672-2a25-4e32-ab1d-80b2b5133696] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:10:30.827425 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1302172c-88a5-4c42-a7bb-c2a300718db5 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:10:30.830043 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1302172c-88a5-4c42-a7bb-c2a300718db5 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:10:30.830043 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1302172c-88a5-4c42-a7bb-c2a300718db5 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:10:30.830043 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1302172c-88a5-4c42-a7bb-c2a300718db5 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:10:30.830043 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1302172c-88a5-4c42-a7bb-c2a300718db5 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:10:30.830579 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1302172c-88a5-4c42-a7bb-c2a300718db5 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:10:31.048446 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-1302172c-88a5-4c42-a7bb-c2a300718db5 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:10:31.057696 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1302172c-88a5-4c42-a7bb-c2a300718db5 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/165ab672-2a25-4e32-ab1d-80b2b5133696" status: 200 len: 1277 microversion: 2.1 time: 0.243383 Oct 19 04:10:31.058694 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3812/7189] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:10:30 2022] GET /compute/v2.1/servers/165ab672-2a25-4e32-ab1d-80b2b5133696 => generated 1277 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:10:32.081747 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c40b39a1-d110-4c78-9be7-db87e0de67e3 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:10:32.082412 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c40b39a1-d110-4c78-9be7-db87e0de67e3 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 165ab672-2a25-4e32-ab1d-80b2b5133696] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:10:32.090212 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c40b39a1-d110-4c78-9be7-db87e0de67e3 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:10:32.090710 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c40b39a1-d110-4c78-9be7-db87e0de67e3 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:10:32.091278 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c40b39a1-d110-4c78-9be7-db87e0de67e3 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:10:32.091995 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c40b39a1-d110-4c78-9be7-db87e0de67e3 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:10:32.092469 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c40b39a1-d110-4c78-9be7-db87e0de67e3 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:10:32.092976 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c40b39a1-d110-4c78-9be7-db87e0de67e3 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:10:32.237802 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c40b39a1-d110-4c78-9be7-db87e0de67e3 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:10:32.246605 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c40b39a1-d110-4c78-9be7-db87e0de67e3 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/165ab672-2a25-4e32-ab1d-80b2b5133696" status: 200 len: 1277 microversion: 2.1 time: 0.169202 Oct 19 04:10:32.247197 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3813/7190] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:10:32 2022] GET /compute/v2.1/servers/165ab672-2a25-4e32-ab1d-80b2b5133696 => generated 1277 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:10:33.269921 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-03ec99bc-3823-482f-8c0a-b40bbd479af1 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:10:33.270564 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-03ec99bc-3823-482f-8c0a-b40bbd479af1 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 165ab672-2a25-4e32-ab1d-80b2b5133696] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:10:33.278174 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-03ec99bc-3823-482f-8c0a-b40bbd479af1 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:10:33.278682 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-03ec99bc-3823-482f-8c0a-b40bbd479af1 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:10:33.279138 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-03ec99bc-3823-482f-8c0a-b40bbd479af1 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:10:33.279842 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-03ec99bc-3823-482f-8c0a-b40bbd479af1 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:10:33.280308 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-03ec99bc-3823-482f-8c0a-b40bbd479af1 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:10:33.280754 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-03ec99bc-3823-482f-8c0a-b40bbd479af1 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:10:33.423364 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-03ec99bc-3823-482f-8c0a-b40bbd479af1 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:10:33.431171 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-03ec99bc-3823-482f-8c0a-b40bbd479af1 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/165ab672-2a25-4e32-ab1d-80b2b5133696" status: 200 len: 1277 microversion: 2.1 time: 0.165270 Oct 19 04:10:33.431822 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3814/7191] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:10:33 2022] GET /compute/v2.1/servers/165ab672-2a25-4e32-ab1d-80b2b5133696 => generated 1277 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:10:34.455499 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ecc197f8-dba1-464c-9e51-5bfa62c49bc1 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:10:34.456210 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ecc197f8-dba1-464c-9e51-5bfa62c49bc1 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 165ab672-2a25-4e32-ab1d-80b2b5133696] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:10:34.458369 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:10:34.464259 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ecc197f8-dba1-464c-9e51-5bfa62c49bc1 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:10:34.465454 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ecc197f8-dba1-464c-9e51-5bfa62c49bc1 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:10:34.465913 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ecc197f8-dba1-464c-9e51-5bfa62c49bc1 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:10:34.466622 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ecc197f8-dba1-464c-9e51-5bfa62c49bc1 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:10:34.467086 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ecc197f8-dba1-464c-9e51-5bfa62c49bc1 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:10:34.467534 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ecc197f8-dba1-464c-9e51-5bfa62c49bc1 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:10:34.605674 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ecc197f8-dba1-464c-9e51-5bfa62c49bc1 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:10:34.613416 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ecc197f8-dba1-464c-9e51-5bfa62c49bc1 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/165ab672-2a25-4e32-ab1d-80b2b5133696" status: 200 len: 1265 microversion: 2.1 time: 0.162083 Oct 19 04:10:34.613999 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3815/7192] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:10:34 2022] GET /compute/v2.1/servers/165ab672-2a25-4e32-ab1d-80b2b5133696 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:10:35.636111 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e7046bfb-d311-46e1-91f3-ce0ae1def8d6 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:10:35.636732 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e7046bfb-d311-46e1-91f3-ce0ae1def8d6 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 165ab672-2a25-4e32-ab1d-80b2b5133696] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:10:35.638781 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=8 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:10:35.644694 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e7046bfb-d311-46e1-91f3-ce0ae1def8d6 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:10:35.645208 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e7046bfb-d311-46e1-91f3-ce0ae1def8d6 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:10:35.645691 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e7046bfb-d311-46e1-91f3-ce0ae1def8d6 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:10:35.647454 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e7046bfb-d311-46e1-91f3-ce0ae1def8d6 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:10:35.647454 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e7046bfb-d311-46e1-91f3-ce0ae1def8d6 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:10:35.647454 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e7046bfb-d311-46e1-91f3-ce0ae1def8d6 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:10:35.785618 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e7046bfb-d311-46e1-91f3-ce0ae1def8d6 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:10:35.793899 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e7046bfb-d311-46e1-91f3-ce0ae1def8d6 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/165ab672-2a25-4e32-ab1d-80b2b5133696" status: 200 len: 1265 microversion: 2.1 time: 0.161078 Oct 19 04:10:35.794488 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3816/7193] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:10:35 2022] GET /compute/v2.1/servers/165ab672-2a25-4e32-ab1d-80b2b5133696 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:10:36.815977 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-304fca96-5f8d-4cbc-8c38-81dcef0f763c tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:10:36.816612 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-304fca96-5f8d-4cbc-8c38-81dcef0f763c tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 165ab672-2a25-4e32-ab1d-80b2b5133696] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:10:36.823581 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-304fca96-5f8d-4cbc-8c38-81dcef0f763c tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:10:36.828584 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-304fca96-5f8d-4cbc-8c38-81dcef0f763c tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:10:36.828584 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-304fca96-5f8d-4cbc-8c38-81dcef0f763c tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:10:36.828584 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-304fca96-5f8d-4cbc-8c38-81dcef0f763c tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:10:36.828584 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-304fca96-5f8d-4cbc-8c38-81dcef0f763c tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:10:36.828584 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-304fca96-5f8d-4cbc-8c38-81dcef0f763c tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:10:36.964480 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-304fca96-5f8d-4cbc-8c38-81dcef0f763c tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:10:36.972494 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-304fca96-5f8d-4cbc-8c38-81dcef0f763c tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/165ab672-2a25-4e32-ab1d-80b2b5133696" status: 200 len: 1265 microversion: 2.1 time: 0.160383 Oct 19 04:10:36.973286 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3817/7194] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:10:36 2022] GET /compute/v2.1/servers/165ab672-2a25-4e32-ab1d-80b2b5133696 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:10:37.995617 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-547278b7-c6cd-4274-a4c7-912bdf0326f7 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:10:37.996287 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-547278b7-c6cd-4274-a4c7-912bdf0326f7 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 165ab672-2a25-4e32-ab1d-80b2b5133696] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:10:38.003387 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-547278b7-c6cd-4274-a4c7-912bdf0326f7 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:10:38.003888 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-547278b7-c6cd-4274-a4c7-912bdf0326f7 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:10:38.004343 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-547278b7-c6cd-4274-a4c7-912bdf0326f7 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:10:38.005060 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-547278b7-c6cd-4274-a4c7-912bdf0326f7 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:10:38.005560 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-547278b7-c6cd-4274-a4c7-912bdf0326f7 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:10:38.006010 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-547278b7-c6cd-4274-a4c7-912bdf0326f7 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:10:38.139461 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-547278b7-c6cd-4274-a4c7-912bdf0326f7 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:10:38.147196 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-547278b7-c6cd-4274-a4c7-912bdf0326f7 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/165ab672-2a25-4e32-ab1d-80b2b5133696" status: 200 len: 1265 microversion: 2.1 time: 0.155612 Oct 19 04:10:38.147837 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3818/7195] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:10:37 2022] GET /compute/v2.1/servers/165ab672-2a25-4e32-ab1d-80b2b5133696 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:10:39.170915 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4c00bfdb-767e-41c5-834f-506f088a2a2b tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:10:39.171586 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4c00bfdb-767e-41c5-834f-506f088a2a2b tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 165ab672-2a25-4e32-ab1d-80b2b5133696] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:10:39.178581 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4c00bfdb-767e-41c5-834f-506f088a2a2b tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:10:39.179085 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4c00bfdb-767e-41c5-834f-506f088a2a2b tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:10:39.179548 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4c00bfdb-767e-41c5-834f-506f088a2a2b tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:10:39.180263 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4c00bfdb-767e-41c5-834f-506f088a2a2b tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:10:39.180734 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4c00bfdb-767e-41c5-834f-506f088a2a2b tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:10:39.181184 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4c00bfdb-767e-41c5-834f-506f088a2a2b tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:10:39.319545 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-4c00bfdb-767e-41c5-834f-506f088a2a2b tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:10:39.328044 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4c00bfdb-767e-41c5-834f-506f088a2a2b tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/165ab672-2a25-4e32-ab1d-80b2b5133696" status: 200 len: 1265 microversion: 2.1 time: 0.161125 Oct 19 04:10:39.328639 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3819/7196] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:10:39 2022] GET /compute/v2.1/servers/165ab672-2a25-4e32-ab1d-80b2b5133696 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:10:40.016315 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f4a3862d-b9eb-4c71-a994-2040bc9851e1 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "32d8d598-9a76-4ece-80c1-b870845a7eb7", "device": "/dev/sdb"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:10:40.018696 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f4a3862d-b9eb-4c71-a994-2040bc9851e1 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] [instance: ee1ebc87-7d6d-47d9-bb84-87ab619cdda2] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:10:40.024904 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f4a3862d-b9eb-4c71-a994-2040bc9851e1 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:10:40.025430 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f4a3862d-b9eb-4c71-a994-2040bc9851e1 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:10:40.025884 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f4a3862d-b9eb-4c71-a994-2040bc9851e1 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:10:40.026586 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f4a3862d-b9eb-4c71-a994-2040bc9851e1 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:10:40.027067 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f4a3862d-b9eb-4c71-a994-2040bc9851e1 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:10:40.027487 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f4a3862d-b9eb-4c71-a994-2040bc9851e1 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:10:40.929221 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f4a3862d-b9eb-4c71-a994-2040bc9851e1 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] 10.222.0.52 "POST /compute/v2.1/servers/ee1ebc87-7d6d-47d9-bb84-87ab619cdda2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.916766 Oct 19 04:10:40.931077 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3820/7197] 10.222.0.52 () {60 vars in 1323 bytes} [Wed Oct 19 04:10:40 2022] POST /compute/v2.1/servers/ee1ebc87-7d6d-47d9-bb84-87ab619cdda2/os-volume_attachments => generated 194 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 04:10:40.937697 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a3ab1be8-9021-47d2-a21b-661a278b6ab9 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:10:40.939288 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a3ab1be8-9021-47d2-a21b-661a278b6ab9 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 165ab672-2a25-4e32-ab1d-80b2b5133696] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:10:40.945070 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a3ab1be8-9021-47d2-a21b-661a278b6ab9 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:10:40.945672 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a3ab1be8-9021-47d2-a21b-661a278b6ab9 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:10:40.946089 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a3ab1be8-9021-47d2-a21b-661a278b6ab9 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:10:40.946812 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a3ab1be8-9021-47d2-a21b-661a278b6ab9 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:10:40.947295 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a3ab1be8-9021-47d2-a21b-661a278b6ab9 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:10:40.947744 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a3ab1be8-9021-47d2-a21b-661a278b6ab9 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:10:41.088578 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a3ab1be8-9021-47d2-a21b-661a278b6ab9 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:10:41.096472 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a3ab1be8-9021-47d2-a21b-661a278b6ab9 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/165ab672-2a25-4e32-ab1d-80b2b5133696" status: 200 len: 1265 microversion: 2.1 time: 0.164160 Oct 19 04:10:41.097058 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3821/7198] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:10:40 2022] GET /compute/v2.1/servers/165ab672-2a25-4e32-ab1d-80b2b5133696 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:10:42.120932 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f7fe44f5-318c-4747-8e23-d2e81bd6f1bd tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:10:42.121603 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f7fe44f5-318c-4747-8e23-d2e81bd6f1bd tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 165ab672-2a25-4e32-ab1d-80b2b5133696] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:10:42.128723 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f7fe44f5-318c-4747-8e23-d2e81bd6f1bd tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:10:42.129225 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f7fe44f5-318c-4747-8e23-d2e81bd6f1bd tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:10:42.143361 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f7fe44f5-318c-4747-8e23-d2e81bd6f1bd tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:10:42.143361 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f7fe44f5-318c-4747-8e23-d2e81bd6f1bd tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:10:42.143361 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f7fe44f5-318c-4747-8e23-d2e81bd6f1bd tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:10:42.143361 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f7fe44f5-318c-4747-8e23-d2e81bd6f1bd tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:10:42.152066 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:10:42.269771 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-f7fe44f5-318c-4747-8e23-d2e81bd6f1bd tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:10:42.279085 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f7fe44f5-318c-4747-8e23-d2e81bd6f1bd tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/165ab672-2a25-4e32-ab1d-80b2b5133696" status: 200 len: 1265 microversion: 2.1 time: 0.163167 Oct 19 04:10:42.279672 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3822/7199] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:10:42 2022] GET /compute/v2.1/servers/165ab672-2a25-4e32-ab1d-80b2b5133696 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:10:42.702799 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-b7675a05-ee4b-43fd-8475-48ccead3cad2 req-eb58012a-ff64-4253-8653-87da6103674c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "165ab672-2a25-4e32-ab1d-80b2b5133696", "name": "network-vif-plugged", "status": "completed", "tag": "ed2cd9c7-b37a-4843-af41-06582eee726a"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:10:42.712564 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-b7675a05-ee4b-43fd-8475-48ccead3cad2 req-eb58012a-ff64-4253-8653-87da6103674c service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:10:42.713068 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-b7675a05-ee4b-43fd-8475-48ccead3cad2 req-eb58012a-ff64-4253-8653-87da6103674c service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:10:42.713674 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-b7675a05-ee4b-43fd-8475-48ccead3cad2 req-eb58012a-ff64-4253-8653-87da6103674c service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:10:42.726743 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-b7675a05-ee4b-43fd-8475-48ccead3cad2 req-eb58012a-ff64-4253-8653-87da6103674c service nova] Creating event network-vif-plugged:ed2cd9c7-b37a-4843-af41-06582eee726a for instance 165ab672-2a25-4e32-ab1d-80b2b5133696 on n-h2-861333-8 Oct 19 04:10:42.731760 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-b7675a05-ee4b-43fd-8475-48ccead3cad2 req-eb58012a-ff64-4253-8653-87da6103674c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034034 Oct 19 04:10:42.732370 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3823/7200] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:10:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 04:10:43.303756 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1bbf0bc6-a225-4e3e-88ff-4886a8de391f tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:10:43.304513 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1bbf0bc6-a225-4e3e-88ff-4886a8de391f tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 165ab672-2a25-4e32-ab1d-80b2b5133696] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:10:43.310918 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1bbf0bc6-a225-4e3e-88ff-4886a8de391f tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:10:43.311515 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1bbf0bc6-a225-4e3e-88ff-4886a8de391f tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:10:43.311981 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1bbf0bc6-a225-4e3e-88ff-4886a8de391f tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:10:43.312704 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1bbf0bc6-a225-4e3e-88ff-4886a8de391f tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:10:43.313182 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1bbf0bc6-a225-4e3e-88ff-4886a8de391f tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:10:43.313673 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1bbf0bc6-a225-4e3e-88ff-4886a8de391f tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:10:43.453304 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-1bbf0bc6-a225-4e3e-88ff-4886a8de391f tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:10:43.461484 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1bbf0bc6-a225-4e3e-88ff-4886a8de391f tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/165ab672-2a25-4e32-ab1d-80b2b5133696" status: 200 len: 1265 microversion: 2.1 time: 0.162821 Oct 19 04:10:43.462020 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3824/7201] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:10:43 2022] GET /compute/v2.1/servers/165ab672-2a25-4e32-ab1d-80b2b5133696 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:10:44.485261 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-cdcc305e-ac19-4f35-ae85-3cd05b9cfdc5 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:10:44.486016 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-cdcc305e-ac19-4f35-ae85-3cd05b9cfdc5 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 165ab672-2a25-4e32-ab1d-80b2b5133696] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:10:44.492735 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cdcc305e-ac19-4f35-ae85-3cd05b9cfdc5 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:10:44.493240 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cdcc305e-ac19-4f35-ae85-3cd05b9cfdc5 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:10:44.493738 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cdcc305e-ac19-4f35-ae85-3cd05b9cfdc5 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:10:44.494451 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cdcc305e-ac19-4f35-ae85-3cd05b9cfdc5 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:10:44.494928 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cdcc305e-ac19-4f35-ae85-3cd05b9cfdc5 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:10:44.495374 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cdcc305e-ac19-4f35-ae85-3cd05b9cfdc5 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:10:44.629678 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-cdcc305e-ac19-4f35-ae85-3cd05b9cfdc5 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:10:44.638261 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-cdcc305e-ac19-4f35-ae85-3cd05b9cfdc5 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/165ab672-2a25-4e32-ab1d-80b2b5133696" status: 200 len: 1453 microversion: 2.1 time: 0.157076 Oct 19 04:10:44.639075 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3825/7202] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:10:44 2022] GET /compute/v2.1/servers/165ab672-2a25-4e32-ab1d-80b2b5133696 => generated 1453 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:10:44.661697 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9b2d81df-d068-47ff-b539-3542ec681209 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:10:44.662331 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9b2d81df-d068-47ff-b539-3542ec681209 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 165ab672-2a25-4e32-ab1d-80b2b5133696] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:10:44.668440 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9b2d81df-d068-47ff-b539-3542ec681209 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:10:44.671227 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9b2d81df-d068-47ff-b539-3542ec681209 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:10:44.671227 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9b2d81df-d068-47ff-b539-3542ec681209 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:10:44.671227 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9b2d81df-d068-47ff-b539-3542ec681209 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:10:44.671227 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9b2d81df-d068-47ff-b539-3542ec681209 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:10:44.671227 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9b2d81df-d068-47ff-b539-3542ec681209 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:10:44.812434 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9b2d81df-d068-47ff-b539-3542ec681209 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:10:44.820331 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9b2d81df-d068-47ff-b539-3542ec681209 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/165ab672-2a25-4e32-ab1d-80b2b5133696" status: 200 len: 1453 microversion: 2.1 time: 0.162538 Oct 19 04:10:44.820911 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3826/7203] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:10:44 2022] GET /compute/v2.1/servers/165ab672-2a25-4e32-ab1d-80b2b5133696 => generated 1453 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:10:46.920251 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-8c1bed9c-7388-4f66-ac03-2df838395063 req-3e569bdc-d15f-4494-b1a0-195c05678458 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "165ab672-2a25-4e32-ab1d-80b2b5133696", "tag": "ed2cd9c7-b37a-4843-af41-06582eee726a"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:10:46.930542 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-8c1bed9c-7388-4f66-ac03-2df838395063 req-3e569bdc-d15f-4494-b1a0-195c05678458 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:10:46.931036 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-8c1bed9c-7388-4f66-ac03-2df838395063 req-3e569bdc-d15f-4494-b1a0-195c05678458 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:10:46.931575 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-8c1bed9c-7388-4f66-ac03-2df838395063 req-3e569bdc-d15f-4494-b1a0-195c05678458 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:10:46.945070 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-8c1bed9c-7388-4f66-ac03-2df838395063 req-3e569bdc-d15f-4494-b1a0-195c05678458 service nova] Creating event network-changed:ed2cd9c7-b37a-4843-af41-06582eee726a for instance 165ab672-2a25-4e32-ab1d-80b2b5133696 on n-h2-861333-8 Oct 19 04:10:46.950673 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-8c1bed9c-7388-4f66-ac03-2df838395063 req-3e569bdc-d15f-4494-b1a0-195c05678458 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034672 Oct 19 04:10:46.951360 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3827/7204] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:10:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 04:11:08.698732 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:11:08.699521 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=24 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:11:08.704274 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2c2c8fbd-97fe-41c8-a779-fe303558f662 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:11:08.704885 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2c2c8fbd-97fe-41c8-a779-fe303558f662 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] [instance: ee1ebc87-7d6d-47d9-bb84-87ab619cdda2] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:11:08.710888 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2c2c8fbd-97fe-41c8-a779-fe303558f662 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:11:08.711884 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2c2c8fbd-97fe-41c8-a779-fe303558f662 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:11:08.711884 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2c2c8fbd-97fe-41c8-a779-fe303558f662 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:11:08.712519 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2c2c8fbd-97fe-41c8-a779-fe303558f662 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:11:08.712988 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2c2c8fbd-97fe-41c8-a779-fe303558f662 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:11:08.713464 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2c2c8fbd-97fe-41c8-a779-fe303558f662 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:11:08.799720 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-2c2c8fbd-97fe-41c8-a779-fe303558f662 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lazy-loading 'services' on Instance uuid ee1ebc87-7d6d-47d9-bb84-87ab619cdda2 {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 04:11:08.962961 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2c2c8fbd-97fe-41c8-a779-fe303558f662 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ee1ebc87-7d6d-47d9-bb84-87ab619cdda2/os-volume_attachments/32d8d598-9a76-4ece-80c1-b870845a7eb7" status: 202 len: 0 microversion: 2.1 time: 0.266154 Oct 19 04:11:08.963590 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3828/7205] 10.222.0.52 () {58 vars in 1416 bytes} [Wed Oct 19 04:11:08 2022] DELETE /compute/v2.1/servers/ee1ebc87-7d6d-47d9-bb84-87ab619cdda2/os-volume_attachments/32d8d598-9a76-4ece-80c1-b870845a7eb7 => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 19 04:11:11.180987 n-d-861333-8 devstack@n-api.service[121135]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 04:11:11.181566 n-d-861333-8 devstack@n-api.service[121135]: Wed Oct 19 04:11:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.52) !!! Oct 19 04:11:14.340905 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-40e39dee-30c8-4b31-a5c9-78d8735f7823 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:11:14.351458 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-40e39dee-30c8-4b31-a5c9-78d8735f7823 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] [instance: ee1ebc87-7d6d-47d9-bb84-87ab619cdda2] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:11:14.351458 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-40e39dee-30c8-4b31-a5c9-78d8735f7823 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:11:14.351458 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-40e39dee-30c8-4b31-a5c9-78d8735f7823 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:11:14.351458 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-40e39dee-30c8-4b31-a5c9-78d8735f7823 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:11:14.351458 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-40e39dee-30c8-4b31-a5c9-78d8735f7823 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:11:14.351458 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-40e39dee-30c8-4b31-a5c9-78d8735f7823 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:11:14.351458 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-40e39dee-30c8-4b31-a5c9-78d8735f7823 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:11:14.378946 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-40e39dee-30c8-4b31-a5c9-78d8735f7823 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] [instance: ee1ebc87-7d6d-47d9-bb84-87ab619cdda2] Going to try to terminate instance {{(pid=121134) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 04:11:14.610262 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-40e39dee-30c8-4b31-a5c9-78d8735f7823 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ee1ebc87-7d6d-47d9-bb84-87ab619cdda2" status: 204 len: 0 microversion: 2.1 time: 0.274368 Oct 19 04:11:14.610973 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3829/7206] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 04:11:14 2022] DELETE /compute/v2.1/servers/ee1ebc87-7d6d-47d9-bb84-87ab619cdda2 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 19 04:11:14.619407 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-cacc554e-ac0a-4169-8806-986b74ced1d7 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:11:14.620122 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-cacc554e-ac0a-4169-8806-986b74ced1d7 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] [instance: ee1ebc87-7d6d-47d9-bb84-87ab619cdda2] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:11:14.626032 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cacc554e-ac0a-4169-8806-986b74ced1d7 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:11:14.627022 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cacc554e-ac0a-4169-8806-986b74ced1d7 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:11:14.627480 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cacc554e-ac0a-4169-8806-986b74ced1d7 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:11:14.628214 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cacc554e-ac0a-4169-8806-986b74ced1d7 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:11:14.628682 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cacc554e-ac0a-4169-8806-986b74ced1d7 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:11:14.629122 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cacc554e-ac0a-4169-8806-986b74ced1d7 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:11:14.761675 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-cacc554e-ac0a-4169-8806-986b74ced1d7 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1064b12837487488ed599b4656bcf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae028dcf0d5949488105d6b9aa6b523d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:11:14.769434 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-cacc554e-ac0a-4169-8806-986b74ced1d7 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] 10.222.0.52 "GET /compute/v2.1/servers/ee1ebc87-7d6d-47d9-bb84-87ab619cdda2" status: 200 len: 1513 microversion: 2.1 time: 0.153976 Oct 19 04:11:14.770016 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3830/7207] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:11:14 2022] GET /compute/v2.1/servers/ee1ebc87-7d6d-47d9-bb84-87ab619cdda2 => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:11:15.792179 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c298cf9e-146b-4fd5-aa23-b010e59c9ff5 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:11:15.792819 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c298cf9e-146b-4fd5-aa23-b010e59c9ff5 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] [instance: ee1ebc87-7d6d-47d9-bb84-87ab619cdda2] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:11:15.799645 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c298cf9e-146b-4fd5-aa23-b010e59c9ff5 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:11:15.800155 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c298cf9e-146b-4fd5-aa23-b010e59c9ff5 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:11:15.800616 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c298cf9e-146b-4fd5-aa23-b010e59c9ff5 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:11:15.801329 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c298cf9e-146b-4fd5-aa23-b010e59c9ff5 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:11:15.801850 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c298cf9e-146b-4fd5-aa23-b010e59c9ff5 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:11:15.802298 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c298cf9e-146b-4fd5-aa23-b010e59c9ff5 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:11:15.937024 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c298cf9e-146b-4fd5-aa23-b010e59c9ff5 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1064b12837487488ed599b4656bcf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae028dcf0d5949488105d6b9aa6b523d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:11:15.945723 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c298cf9e-146b-4fd5-aa23-b010e59c9ff5 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] 10.222.0.52 "GET /compute/v2.1/servers/ee1ebc87-7d6d-47d9-bb84-87ab619cdda2" status: 200 len: 1513 microversion: 2.1 time: 0.157347 Oct 19 04:11:15.946340 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3831/7208] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:11:15 2022] GET /compute/v2.1/servers/ee1ebc87-7d6d-47d9-bb84-87ab619cdda2 => generated 1513 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:11:16.970550 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ddb14d39-b767-4765-bd81-06271291d6db tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:11:16.971220 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ddb14d39-b767-4765-bd81-06271291d6db tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] [instance: ee1ebc87-7d6d-47d9-bb84-87ab619cdda2] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:11:16.980198 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ddb14d39-b767-4765-bd81-06271291d6db tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:11:16.980725 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ddb14d39-b767-4765-bd81-06271291d6db tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:11:16.981176 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ddb14d39-b767-4765-bd81-06271291d6db tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:11:16.981964 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ddb14d39-b767-4765-bd81-06271291d6db tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:11:16.982429 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ddb14d39-b767-4765-bd81-06271291d6db tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:11:16.982872 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ddb14d39-b767-4765-bd81-06271291d6db tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:11:17.047942 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ddb14d39-b767-4765-bd81-06271291d6db tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1064b12837487488ed599b4656bcf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae028dcf0d5949488105d6b9aa6b523d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:11:17.057743 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ddb14d39-b767-4765-bd81-06271291d6db tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] 10.222.0.52 "GET /compute/v2.1/servers/ee1ebc87-7d6d-47d9-bb84-87ab619cdda2" status: 200 len: 1471 microversion: 2.1 time: 0.091560 Oct 19 04:11:17.058327 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3832/7209] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:11:16 2022] GET /compute/v2.1/servers/ee1ebc87-7d6d-47d9-bb84-87ab619cdda2 => generated 1471 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:11:17.112514 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-70c4baea-b0c3-4c8a-87ec-fce041ef475b req-f747b977-a37c-4bb7-bfcb-d4347b603323 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee1ebc87-7d6d-47d9-bb84-87ab619cdda2", "name": "network-vif-deleted", "tag": "a4262ed5-a521-4c09-9f87-01a6acf52b58"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:11:17.122281 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-70c4baea-b0c3-4c8a-87ec-fce041ef475b req-f747b977-a37c-4bb7-bfcb-d4347b603323 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:11:17.122776 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-70c4baea-b0c3-4c8a-87ec-fce041ef475b req-f747b977-a37c-4bb7-bfcb-d4347b603323 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:11:17.123222 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-70c4baea-b0c3-4c8a-87ec-fce041ef475b req-f747b977-a37c-4bb7-bfcb-d4347b603323 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:11:17.134358 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-70c4baea-b0c3-4c8a-87ec-fce041ef475b req-f747b977-a37c-4bb7-bfcb-d4347b603323 service nova] Creating event network-vif-deleted:a4262ed5-a521-4c09-9f87-01a6acf52b58 for instance ee1ebc87-7d6d-47d9-bb84-87ab619cdda2 on n-h1-861333-8 Oct 19 04:11:17.139241 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-70c4baea-b0c3-4c8a-87ec-fce041ef475b req-f747b977-a37c-4bb7-bfcb-d4347b603323 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079679 Oct 19 04:11:17.139859 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3833/7210] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:11:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:11:18.081527 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ec25f8b7-0d75-4c4a-96ec-a2121a4dd1ae tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:11:18.082247 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ec25f8b7-0d75-4c4a-96ec-a2121a4dd1ae tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] [instance: ee1ebc87-7d6d-47d9-bb84-87ab619cdda2] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:11:18.088514 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ec25f8b7-0d75-4c4a-96ec-a2121a4dd1ae tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:11:18.089015 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ec25f8b7-0d75-4c4a-96ec-a2121a4dd1ae tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:11:18.089506 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ec25f8b7-0d75-4c4a-96ec-a2121a4dd1ae tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:11:18.090212 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ec25f8b7-0d75-4c4a-96ec-a2121a4dd1ae tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:11:18.090681 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ec25f8b7-0d75-4c4a-96ec-a2121a4dd1ae tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:11:18.091125 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ec25f8b7-0d75-4c4a-96ec-a2121a4dd1ae tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:11:18.107407 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-ec25f8b7-0d75-4c4a-96ec-a2121a4dd1ae tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] HTTP exception thrown: Instance ee1ebc87-7d6d-47d9-bb84-87ab619cdda2 could not be found. Oct 19 04:11:18.109027 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ec25f8b7-0d75-4c4a-96ec-a2121a4dd1ae tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Request method failure captured: Oct 19 04:11:18.109027 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/ee1ebc87-7d6d-47d9-bb84-87ab619cdda2 HTTP/1.1 Oct 19 04:11:18.109027 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 04:11:18.109027 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 04:11:18.109027 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 04:11:18.109027 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 04:11:18.109027 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 04:11:18.109027 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 04:11:18.109027 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 04:11:18.109027 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 04:11:18.109027 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3g9_CTeYWnvYc_mOaxoj2hg_5LZyv-HHPtYHAoaw4AKHYxO8IrPYKkT2EADUoGMeJFVI8CCdcTLKuNxkCWks2U8cKscFkZSQsjbNZ1ciBHDfMWUou2lGbalkppSfR5_niLFFYC52TUFUeap7OKRKmr6nbYMBpuG7n2_p2q74WIT2i4 Oct 19 04:11:18.109027 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 04:11:18.109027 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 04:11:18.109027 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 04:11:18.109027 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 04:11:18.109027 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 04:11:18.109027 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 04:11:18.109027 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: ae028dcf0d5949488105d6b9aa6b523d Oct 19 04:11:18.109027 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1536955095 Oct 19 04:11:18.109027 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 04:11:18.109027 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 04:11:18.109027 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ae028dcf0d5949488105d6b9aa6b523d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ae028dcf0d5949488105d6b9aa6b523d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ae028dcf0d5949488105d6b9aa6b523d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ae028dcf0d5949488105d6b9aa6b523d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 04:11:18.109027 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-VolumesSnapshotTestJSON-1536955095 Oct 19 04:11:18.109027 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: ae028dcf0d5949488105d6b9aa6b523d Oct 19 04:11:18.109027 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1536955095 Oct 19 04:11:18.109027 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-VolumesSnapshotTestJSON-1536955095-project Oct 19 04:11:18.109027 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 04:11:18.109027 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 04:11:18.109027 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 7b1064b12837487488ed599b4656bcf7 Oct 19 04:11:18.109027 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-VolumesSnapshotTestJSON-1536955095-project Oct 19 04:11:18.109027 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 04:11:18.109027 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance ee1ebc87-7d6d-47d9-bb84-87ab619cdda2 could not be found. Oct 19 04:11:18.109027 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': 'ee1ebc87-7d6d-47d9-bb84-87ab619cdda2'} Oct 19 04:11:18.109027 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 04:11:18.109027 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:11:18.109027 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 04:11:18.109027 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 04:11:18.109027 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 04:11:18.109027 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 04:11:18.109027 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 04:11:18.109027 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 04:11:18.109027 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 04:11:18.109027 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 04:11:18.109027 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee1ebc87-7d6d-47d9-bb84-87ab619cdda2 could not be found. Oct 19 04:11:18.109027 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:11:18.109027 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:11:18.109027 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:11:18.109027 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:11:18.109027 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:11:18.109027 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:11:18.109027 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 04:11:18.109027 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 04:11:18.109027 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 04:11:18.109027 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 04:11:18.109027 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 04:11:18.109027 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 04:11:18.109027 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 04:11:18.109027 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 04:11:18.109027 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 04:11:18.109027 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 04:11:18.109027 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee1ebc87-7d6d-47d9-bb84-87ab619cdda2 could not be found. Oct 19 04:11:18.109027 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:11:18.109027 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:11:18.109027 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:11:18.113498 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:11:18.113498 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:11:18.113498 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:11:18.113498 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 04:11:18.113498 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 04:11:18.113498 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee1ebc87-7d6d-47d9-bb84-87ab619cdda2 could not be found. Oct 19 04:11:18.113498 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:11:18.113498 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ec25f8b7-0d75-4c4a-96ec-a2121a4dd1ae tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Returning 404 to user: Instance ee1ebc87-7d6d-47d9-bb84-87ab619cdda2 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 04:11:18.113498 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ec25f8b7-0d75-4c4a-96ec-a2121a4dd1ae tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] 10.222.0.52 "GET /compute/v2.1/servers/ee1ebc87-7d6d-47d9-bb84-87ab619cdda2" status: 404 len: 111 microversion: 2.1 time: 0.034117 Oct 19 04:11:18.113498 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3834/7211] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:11:18 2022] GET /compute/v2.1/servers/ee1ebc87-7d6d-47d9-bb84-87ab619cdda2 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 04:11:25.632652 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-94826e07-d761-4215-99f5-5abff379c762 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-986095910", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "networks": [{"uuid": "ca4a59fa-4760-42f1-971a-79bf6f1d166b"}]}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:11:25.687359 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-94826e07-d761-4215-99f5-5abff379c762 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] validate_networks() for [('ca4a59fa-4760-42f1-971a-79bf6f1d166b', None, None, None, None, None)] {{(pid=121134) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 04:11:26.420758 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-94826e07-d761-4215-99f5-5abff379c762 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Flavor limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 04:11:26.421211 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-94826e07-d761-4215-99f5-5abff379c762 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Image limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 04:11:26.421740 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-94826e07-d761-4215-99f5-5abff379c762 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Flavor pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 04:11:26.422201 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-94826e07-d761-4215-99f5-5abff379c762 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Image pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 04:11:26.422659 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-94826e07-d761-4215-99f5-5abff379c762 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 04:11:26.432426 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-94826e07-d761-4215-99f5-5abff379c762 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:11:26.432931 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-94826e07-d761-4215-99f5-5abff379c762 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:11:26.433404 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-94826e07-d761-4215-99f5-5abff379c762 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:11:26.434258 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-94826e07-d761-4215-99f5-5abff379c762 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:11:26.434723 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-94826e07-d761-4215-99f5-5abff379c762 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:11:26.435164 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-94826e07-d761-4215-99f5-5abff379c762 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:11:26.452379 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-94826e07-d761-4215-99f5-5abff379c762 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Getting quotas for project ae028dcf0d5949488105d6b9aa6b523d. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 04:11:26.460259 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-94826e07-d761-4215-99f5-5abff379c762 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Getting quotas for user 7b1064b12837487488ed599b4656bcf7 and project ae028dcf0d5949488105d6b9aa6b523d. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 04:11:26.473214 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-94826e07-d761-4215-99f5-5abff379c762 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Going to run 1 instances... {{(pid=121134) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 04:11:26.475544 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-94826e07-d761-4215-99f5-5abff379c762 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] [instance: 1e5cbe50-c34c-4540-beea-6b4850178fd8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 04:11:26.566143 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-94826e07-d761-4215-99f5-5abff379c762 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.937357 Oct 19 04:11:26.566983 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3835/7212] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 04:11:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 939 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 19 04:11:26.577619 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8ed78f8a-f819-429c-902b-850c5910a872 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:11:26.578310 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8ed78f8a-f819-429c-902b-850c5910a872 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] [instance: 1e5cbe50-c34c-4540-beea-6b4850178fd8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:11:26.632516 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8ed78f8a-f819-429c-902b-850c5910a872 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1064b12837487488ed599b4656bcf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae028dcf0d5949488105d6b9aa6b523d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:11:26.640336 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8ed78f8a-f819-429c-902b-850c5910a872 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] 10.222.0.52 "GET /compute/v2.1/servers/1e5cbe50-c34c-4540-beea-6b4850178fd8" status: 200 len: 1218 microversion: 2.1 time: 0.066342 Oct 19 04:11:26.640931 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3836/7213] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:11:26 2022] GET /compute/v2.1/servers/1e5cbe50-c34c-4540-beea-6b4850178fd8 => generated 1218 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:11:27.664359 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-321064a3-5560-4569-99b5-9b7941e9d4c1 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:11:27.665039 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-321064a3-5560-4569-99b5-9b7941e9d4c1 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] [instance: 1e5cbe50-c34c-4540-beea-6b4850178fd8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:11:27.672411 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-321064a3-5560-4569-99b5-9b7941e9d4c1 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:11:27.673079 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-321064a3-5560-4569-99b5-9b7941e9d4c1 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:11:27.673534 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-321064a3-5560-4569-99b5-9b7941e9d4c1 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:11:27.674284 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-321064a3-5560-4569-99b5-9b7941e9d4c1 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:11:27.674992 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-321064a3-5560-4569-99b5-9b7941e9d4c1 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:11:27.675434 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-321064a3-5560-4569-99b5-9b7941e9d4c1 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:11:27.741532 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-321064a3-5560-4569-99b5-9b7941e9d4c1 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1064b12837487488ed599b4656bcf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae028dcf0d5949488105d6b9aa6b523d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:11:27.749314 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-321064a3-5560-4569-99b5-9b7941e9d4c1 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] 10.222.0.52 "GET /compute/v2.1/servers/1e5cbe50-c34c-4540-beea-6b4850178fd8" status: 200 len: 1222 microversion: 2.1 time: 0.088859 Oct 19 04:11:27.749969 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3837/7214] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:11:27 2022] GET /compute/v2.1/servers/1e5cbe50-c34c-4540-beea-6b4850178fd8 => generated 1222 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:11:28.772261 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-eafae598-89ac-4e36-8a3a-5b1a077cfbfb tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:11:28.772956 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-eafae598-89ac-4e36-8a3a-5b1a077cfbfb tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] [instance: 1e5cbe50-c34c-4540-beea-6b4850178fd8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:11:28.780043 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eafae598-89ac-4e36-8a3a-5b1a077cfbfb tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:11:28.781772 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eafae598-89ac-4e36-8a3a-5b1a077cfbfb tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:11:28.782253 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eafae598-89ac-4e36-8a3a-5b1a077cfbfb tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:11:28.783494 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eafae598-89ac-4e36-8a3a-5b1a077cfbfb tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:11:28.783976 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eafae598-89ac-4e36-8a3a-5b1a077cfbfb tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:11:28.784447 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eafae598-89ac-4e36-8a3a-5b1a077cfbfb tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:11:28.847973 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-eafae598-89ac-4e36-8a3a-5b1a077cfbfb tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1064b12837487488ed599b4656bcf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae028dcf0d5949488105d6b9aa6b523d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:11:28.855914 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-eafae598-89ac-4e36-8a3a-5b1a077cfbfb tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] 10.222.0.52 "GET /compute/v2.1/servers/1e5cbe50-c34c-4540-beea-6b4850178fd8" status: 200 len: 1276 microversion: 2.1 time: 0.087677 Oct 19 04:11:28.856686 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3838/7215] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:11:28 2022] GET /compute/v2.1/servers/1e5cbe50-c34c-4540-beea-6b4850178fd8 => generated 1276 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:11:29.879044 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-85fb5f04-fbc9-4768-b6b8-1c80dc98eeaa tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:11:29.879705 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-85fb5f04-fbc9-4768-b6b8-1c80dc98eeaa tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] [instance: 1e5cbe50-c34c-4540-beea-6b4850178fd8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:11:29.886408 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-85fb5f04-fbc9-4768-b6b8-1c80dc98eeaa tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:11:29.886928 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-85fb5f04-fbc9-4768-b6b8-1c80dc98eeaa tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:11:29.887392 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-85fb5f04-fbc9-4768-b6b8-1c80dc98eeaa tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:11:29.888116 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-85fb5f04-fbc9-4768-b6b8-1c80dc98eeaa tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:11:29.888586 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-85fb5f04-fbc9-4768-b6b8-1c80dc98eeaa tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:11:29.889029 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-85fb5f04-fbc9-4768-b6b8-1c80dc98eeaa tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:11:30.021131 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-85fb5f04-fbc9-4768-b6b8-1c80dc98eeaa tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1064b12837487488ed599b4656bcf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae028dcf0d5949488105d6b9aa6b523d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:11:30.029196 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-85fb5f04-fbc9-4768-b6b8-1c80dc98eeaa tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] 10.222.0.52 "GET /compute/v2.1/servers/1e5cbe50-c34c-4540-beea-6b4850178fd8" status: 200 len: 1318 microversion: 2.1 time: 0.154124 Oct 19 04:11:30.029811 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3839/7216] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:11:29 2022] GET /compute/v2.1/servers/1e5cbe50-c34c-4540-beea-6b4850178fd8 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:11:30.141426 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-2e7dfbb3-b93c-43aa-81a6-feb33b87aca9 req-9ccdd99a-63ea-41d0-9522-0e0c0c60d5e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e5cbe50-c34c-4540-beea-6b4850178fd8", "tag": "025e1417-8c51-4f86-8379-0f81b8774d1d"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:11:30.152065 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-2e7dfbb3-b93c-43aa-81a6-feb33b87aca9 req-9ccdd99a-63ea-41d0-9522-0e0c0c60d5e2 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:11:30.152567 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-2e7dfbb3-b93c-43aa-81a6-feb33b87aca9 req-9ccdd99a-63ea-41d0-9522-0e0c0c60d5e2 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:11:30.153019 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-2e7dfbb3-b93c-43aa-81a6-feb33b87aca9 req-9ccdd99a-63ea-41d0-9522-0e0c0c60d5e2 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:11:30.164484 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-2e7dfbb3-b93c-43aa-81a6-feb33b87aca9 req-9ccdd99a-63ea-41d0-9522-0e0c0c60d5e2 service nova] Creating event network-changed:025e1417-8c51-4f86-8379-0f81b8774d1d for instance 1e5cbe50-c34c-4540-beea-6b4850178fd8 on n-h1-861333-8 Oct 19 04:11:30.169471 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-2e7dfbb3-b93c-43aa-81a6-feb33b87aca9 req-9ccdd99a-63ea-41d0-9522-0e0c0c60d5e2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031785 Oct 19 04:11:30.170237 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3840/7217] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:11:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 04:11:31.054131 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ffc534ad-f4c6-49e0-b478-6cbd908d41de tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:11:31.054846 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ffc534ad-f4c6-49e0-b478-6cbd908d41de tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] [instance: 1e5cbe50-c34c-4540-beea-6b4850178fd8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:11:31.061218 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ffc534ad-f4c6-49e0-b478-6cbd908d41de tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:11:31.061744 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ffc534ad-f4c6-49e0-b478-6cbd908d41de tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:11:31.062227 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ffc534ad-f4c6-49e0-b478-6cbd908d41de tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:11:31.062961 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ffc534ad-f4c6-49e0-b478-6cbd908d41de tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:11:31.063434 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ffc534ad-f4c6-49e0-b478-6cbd908d41de tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:11:31.063877 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ffc534ad-f4c6-49e0-b478-6cbd908d41de tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:11:31.199684 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ffc534ad-f4c6-49e0-b478-6cbd908d41de tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1064b12837487488ed599b4656bcf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae028dcf0d5949488105d6b9aa6b523d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:11:31.208458 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ffc534ad-f4c6-49e0-b478-6cbd908d41de tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] 10.222.0.52 "GET /compute/v2.1/servers/1e5cbe50-c34c-4540-beea-6b4850178fd8" status: 200 len: 1318 microversion: 2.1 time: 0.160014 Oct 19 04:11:31.209051 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3841/7218] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:11:31 2022] GET /compute/v2.1/servers/1e5cbe50-c34c-4540-beea-6b4850178fd8 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:11:32.231613 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d1429cc4-799e-43be-9da3-d6585c01ded9 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:11:32.232282 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d1429cc4-799e-43be-9da3-d6585c01ded9 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] [instance: 1e5cbe50-c34c-4540-beea-6b4850178fd8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:11:32.239763 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d1429cc4-799e-43be-9da3-d6585c01ded9 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:11:32.240263 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d1429cc4-799e-43be-9da3-d6585c01ded9 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:11:32.240714 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d1429cc4-799e-43be-9da3-d6585c01ded9 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:11:32.241442 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d1429cc4-799e-43be-9da3-d6585c01ded9 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:11:32.241914 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d1429cc4-799e-43be-9da3-d6585c01ded9 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:11:32.242356 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d1429cc4-799e-43be-9da3-d6585c01ded9 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:11:32.372885 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d1429cc4-799e-43be-9da3-d6585c01ded9 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1064b12837487488ed599b4656bcf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae028dcf0d5949488105d6b9aa6b523d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:11:32.380577 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d1429cc4-799e-43be-9da3-d6585c01ded9 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] 10.222.0.52 "GET /compute/v2.1/servers/1e5cbe50-c34c-4540-beea-6b4850178fd8" status: 200 len: 1318 microversion: 2.1 time: 0.152892 Oct 19 04:11:32.381154 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3842/7219] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:11:32 2022] GET /compute/v2.1/servers/1e5cbe50-c34c-4540-beea-6b4850178fd8 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:11:33.402857 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d3fa5832-42b0-432f-87db-e158b4ef84e6 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:11:33.403494 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d3fa5832-42b0-432f-87db-e158b4ef84e6 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] [instance: 1e5cbe50-c34c-4540-beea-6b4850178fd8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:11:33.410414 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d3fa5832-42b0-432f-87db-e158b4ef84e6 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:11:33.410919 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d3fa5832-42b0-432f-87db-e158b4ef84e6 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:11:33.411379 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d3fa5832-42b0-432f-87db-e158b4ef84e6 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:11:33.412087 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d3fa5832-42b0-432f-87db-e158b4ef84e6 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:11:33.412560 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d3fa5832-42b0-432f-87db-e158b4ef84e6 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:11:33.413007 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d3fa5832-42b0-432f-87db-e158b4ef84e6 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:11:33.796371 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d3fa5832-42b0-432f-87db-e158b4ef84e6 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1064b12837487488ed599b4656bcf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae028dcf0d5949488105d6b9aa6b523d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:11:33.804873 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d3fa5832-42b0-432f-87db-e158b4ef84e6 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] 10.222.0.52 "GET /compute/v2.1/servers/1e5cbe50-c34c-4540-beea-6b4850178fd8" status: 200 len: 1318 microversion: 2.1 time: 0.405872 Oct 19 04:11:33.805476 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3843/7220] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:11:33 2022] GET /compute/v2.1/servers/1e5cbe50-c34c-4540-beea-6b4850178fd8 => generated 1318 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:11:34.827638 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1bcc53cc-8871-451a-8d4e-38e031b9bd53 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:11:34.828313 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1bcc53cc-8871-451a-8d4e-38e031b9bd53 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] [instance: 1e5cbe50-c34c-4540-beea-6b4850178fd8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:11:34.836710 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1bcc53cc-8871-451a-8d4e-38e031b9bd53 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:11:34.837210 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1bcc53cc-8871-451a-8d4e-38e031b9bd53 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:11:34.837688 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1bcc53cc-8871-451a-8d4e-38e031b9bd53 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:11:34.838398 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1bcc53cc-8871-451a-8d4e-38e031b9bd53 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:11:34.838862 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1bcc53cc-8871-451a-8d4e-38e031b9bd53 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:11:34.839673 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1bcc53cc-8871-451a-8d4e-38e031b9bd53 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:11:34.974794 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-1bcc53cc-8871-451a-8d4e-38e031b9bd53 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1064b12837487488ed599b4656bcf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae028dcf0d5949488105d6b9aa6b523d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:11:34.982597 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1bcc53cc-8871-451a-8d4e-38e031b9bd53 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] 10.222.0.52 "GET /compute/v2.1/servers/1e5cbe50-c34c-4540-beea-6b4850178fd8" status: 200 len: 1318 microversion: 2.1 time: 0.158916 Oct 19 04:11:34.983172 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3844/7221] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:11:34 2022] GET /compute/v2.1/servers/1e5cbe50-c34c-4540-beea-6b4850178fd8 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:11:36.005570 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9400d437-9e76-48bf-aaa5-c22127521c37 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:11:36.006212 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9400d437-9e76-48bf-aaa5-c22127521c37 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] [instance: 1e5cbe50-c34c-4540-beea-6b4850178fd8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:11:36.013182 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9400d437-9e76-48bf-aaa5-c22127521c37 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:11:36.013733 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9400d437-9e76-48bf-aaa5-c22127521c37 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:11:36.014198 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9400d437-9e76-48bf-aaa5-c22127521c37 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:11:36.014915 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9400d437-9e76-48bf-aaa5-c22127521c37 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:11:36.015392 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9400d437-9e76-48bf-aaa5-c22127521c37 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:11:36.015843 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9400d437-9e76-48bf-aaa5-c22127521c37 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:11:36.144482 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9400d437-9e76-48bf-aaa5-c22127521c37 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1064b12837487488ed599b4656bcf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae028dcf0d5949488105d6b9aa6b523d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:11:36.148688 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:11:36.153276 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9400d437-9e76-48bf-aaa5-c22127521c37 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] 10.222.0.52 "GET /compute/v2.1/servers/1e5cbe50-c34c-4540-beea-6b4850178fd8" status: 200 len: 1318 microversion: 2.1 time: 0.151750 Oct 19 04:11:36.157393 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3845/7222] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:11:36 2022] GET /compute/v2.1/servers/1e5cbe50-c34c-4540-beea-6b4850178fd8 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:11:36.472798 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:11:36.528731 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-0afd00b4-9e35-4f44-87cd-8146d44f2620 req-ed58024a-61c7-4f79-b41e-254edffe37a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e5cbe50-c34c-4540-beea-6b4850178fd8", "name": "network-vif-plugged", "status": "completed", "tag": "025e1417-8c51-4f86-8379-0f81b8774d1d"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:11:36.542106 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-0afd00b4-9e35-4f44-87cd-8146d44f2620 req-ed58024a-61c7-4f79-b41e-254edffe37a2 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:11:36.542616 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-0afd00b4-9e35-4f44-87cd-8146d44f2620 req-ed58024a-61c7-4f79-b41e-254edffe37a2 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:11:36.543074 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-0afd00b4-9e35-4f44-87cd-8146d44f2620 req-ed58024a-61c7-4f79-b41e-254edffe37a2 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:11:36.554850 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-0afd00b4-9e35-4f44-87cd-8146d44f2620 req-ed58024a-61c7-4f79-b41e-254edffe37a2 service nova] Creating event network-vif-plugged:025e1417-8c51-4f86-8379-0f81b8774d1d for instance 1e5cbe50-c34c-4540-beea-6b4850178fd8 on n-h1-861333-8 Oct 19 04:11:36.560727 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-0afd00b4-9e35-4f44-87cd-8146d44f2620 req-ed58024a-61c7-4f79-b41e-254edffe37a2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092273 Oct 19 04:11:36.561318 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3846/7223] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:11:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 04:11:37.176885 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0311ffe3-063a-43e6-bf61-694bea9e2203 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:11:37.177756 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0311ffe3-063a-43e6-bf61-694bea9e2203 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] [instance: 1e5cbe50-c34c-4540-beea-6b4850178fd8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:11:37.180469 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=8 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:11:37.187189 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0311ffe3-063a-43e6-bf61-694bea9e2203 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:11:37.187696 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0311ffe3-063a-43e6-bf61-694bea9e2203 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:11:37.188157 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0311ffe3-063a-43e6-bf61-694bea9e2203 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:11:37.188912 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0311ffe3-063a-43e6-bf61-694bea9e2203 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:11:37.189491 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0311ffe3-063a-43e6-bf61-694bea9e2203 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:11:37.189948 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0311ffe3-063a-43e6-bf61-694bea9e2203 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:11:37.322774 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0311ffe3-063a-43e6-bf61-694bea9e2203 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1064b12837487488ed599b4656bcf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae028dcf0d5949488105d6b9aa6b523d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:11:37.331258 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0311ffe3-063a-43e6-bf61-694bea9e2203 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] 10.222.0.52 "GET /compute/v2.1/servers/1e5cbe50-c34c-4540-beea-6b4850178fd8" status: 200 len: 1318 microversion: 2.1 time: 0.158784 Oct 19 04:11:37.331830 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3847/7224] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:11:37 2022] GET /compute/v2.1/servers/1e5cbe50-c34c-4540-beea-6b4850178fd8 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:11:38.354736 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2e9c4472-3664-4a20-a803-e7ed47481780 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:11:38.355371 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2e9c4472-3664-4a20-a803-e7ed47481780 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] [instance: 1e5cbe50-c34c-4540-beea-6b4850178fd8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:11:38.363426 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2e9c4472-3664-4a20-a803-e7ed47481780 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:11:38.363915 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2e9c4472-3664-4a20-a803-e7ed47481780 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:11:38.364370 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2e9c4472-3664-4a20-a803-e7ed47481780 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:11:38.365083 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2e9c4472-3664-4a20-a803-e7ed47481780 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:11:38.365591 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2e9c4472-3664-4a20-a803-e7ed47481780 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:11:38.366036 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2e9c4472-3664-4a20-a803-e7ed47481780 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:11:38.494144 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-2e9c4472-3664-4a20-a803-e7ed47481780 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1064b12837487488ed599b4656bcf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae028dcf0d5949488105d6b9aa6b523d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:11:38.501968 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2e9c4472-3664-4a20-a803-e7ed47481780 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] 10.222.0.52 "GET /compute/v2.1/servers/1e5cbe50-c34c-4540-beea-6b4850178fd8" status: 200 len: 1507 microversion: 2.1 time: 0.151267 Oct 19 04:11:38.502537 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3848/7225] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:11:38 2022] GET /compute/v2.1/servers/1e5cbe50-c34c-4540-beea-6b4850178fd8 => generated 1507 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:11:38.524036 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-62f4e956-8781-484d-b2d9-93830ba2c805 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "905eed79-7da1-43af-85ee-e34dc524b1be", "device": "/dev/sdb"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:11:38.526430 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-62f4e956-8781-484d-b2d9-93830ba2c805 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] [instance: 1e5cbe50-c34c-4540-beea-6b4850178fd8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:11:38.532803 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-62f4e956-8781-484d-b2d9-93830ba2c805 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:11:38.533300 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-62f4e956-8781-484d-b2d9-93830ba2c805 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:11:38.533780 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-62f4e956-8781-484d-b2d9-93830ba2c805 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:11:38.534483 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-62f4e956-8781-484d-b2d9-93830ba2c805 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:11:38.534952 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-62f4e956-8781-484d-b2d9-93830ba2c805 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:11:38.535396 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-62f4e956-8781-484d-b2d9-93830ba2c805 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:11:39.184977 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-62f4e956-8781-484d-b2d9-93830ba2c805 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] 10.222.0.52 "POST /compute/v2.1/servers/1e5cbe50-c34c-4540-beea-6b4850178fd8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.664778 Oct 19 04:11:39.185651 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3849/7226] 10.222.0.52 () {60 vars in 1323 bytes} [Wed Oct 19 04:11:38 2022] POST /compute/v2.1/servers/1e5cbe50-c34c-4540-beea-6b4850178fd8/os-volume_attachments => generated 194 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 04:11:54.270488 n-d-861333-8 devstack@n-api.service[121135]: DEBUG neutronclient.v2_0.client [None req-c9618131-48c5-4724-b08b-59a9e1f86ffc tempest-TestVolumeBackupRestore-1994640921 tempest-TestVolumeBackupRestore-1994640921-project] Error message: {"error": {"code": 401, "title": "Unauthorized", "message": "The request you have made requires authentication."}} {{(pid=121135) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 19 04:11:54.271302 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c9618131-48c5-4724-b08b-59a9e1f86ffc tempest-TestVolumeBackupRestore-1994640921 tempest-TestVolumeBackupRestore-1994640921-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 500 len: 0 microversion: 2.1 time: 899.920893 Oct 19 04:11:54.330847 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack [None req-c9618131-48c5-4724-b08b-59a9e1f86ffc tempest-TestVolumeBackupRestore-1994640921 tempest-TestVolumeBackupRestore-1994640921-project] Caught error: Not authorized.: nova.exception.Unauthorized: Not authorized. Oct 19 04:11:54.330847 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack Traceback (most recent call last): Oct 19 04:11:54.330847 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Oct 19 04:11:54.330847 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack return self.find_resource_by_id(resource, name_or_id, Oct 19 04:11:54.330847 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 04:11:54.330847 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Oct 19 04:11:54.330847 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Oct 19 04:11:54.330847 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack raise exceptions.NotFound(message=not_found_message) Oct 19 04:11:54.330847 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'tempest-secgroup-smoke-209149988' Oct 19 04:11:54.330847 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack Oct 19 04:11:54.330847 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack During handling of the above exception, another exception occurred: Oct 19 04:11:54.330847 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack Oct 19 04:11:54.330847 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack Traceback (most recent call last): Oct 19 04:11:54.330847 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 04:11:54.330847 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Oct 19 04:11:54.330847 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 19 04:11:54.330847 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack exception_handler_v20(status_code, error_body) Oct 19 04:11:54.330847 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 19 04:11:54.330847 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack raise client_exc(message=error_message, Oct 19 04:11:54.330847 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack neutronclient.common.exceptions.Unauthorized: 401-{'error': {'code': 401, 'title': 'Unauthorized', 'message': 'The request you have made requires authentication.'}} Oct 19 04:11:54.330847 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack Neutron server returns request_ids: ['req-0dd0bbfa-c64f-44dc-86ed-903e49668553'] Oct 19 04:11:54.330847 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack Oct 19 04:11:54.330847 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack During handling of the above exception, another exception occurred: Oct 19 04:11:54.330847 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack Oct 19 04:11:54.330847 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack Traceback (most recent call last): Oct 19 04:11:54.330847 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/__init__.py", line 95, in __call__ Oct 19 04:11:54.330847 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack return req.get_response(self.application) Oct 19 04:11:54.330847 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1313, in send Oct 19 04:11:54.330847 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack status, headers, app_iter = self.call_application( Oct 19 04:11:54.330847 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1278, in call_application Oct 19 04:11:54.330847 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack app_iter = application(self.environ, start_response) Oct 19 04:11:54.330847 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 129, in __call__ Oct 19 04:11:54.330847 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack resp = self.call_func(req, *args, **kw) Oct 19 04:11:54.330847 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 193, in call_func Oct 19 04:11:54.330847 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack return self.func(req, *args, **kwargs) Oct 19 04:11:54.330847 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/requestlog.py", line 104, in __call__ Oct 19 04:11:54.330847 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack self._log_req(req, res, start) Oct 19 04:11:54.330847 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 04:11:54.330847 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack self.force_reraise() Oct 19 04:11:54.330847 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 04:11:54.330847 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack raise self.value Oct 19 04:11:54.330847 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/requestlog.py", line 99, in __call__ Oct 19 04:11:54.330847 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack res = req.get_response(self.application) Oct 19 04:11:54.330847 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1313, in send Oct 19 04:11:54.330847 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack status, headers, app_iter = self.call_application( Oct 19 04:11:54.330847 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1278, in call_application Oct 19 04:11:54.330847 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack app_iter = application(self.environ, start_response) Oct 19 04:11:54.330847 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 143, in __call__ Oct 19 04:11:54.330847 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack return resp(environ, start_response) Oct 19 04:11:54.330847 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 129, in __call__ Oct 19 04:11:54.330847 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack resp = self.call_func(req, *args, **kw) Oct 19 04:11:54.330847 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 193, in call_func Oct 19 04:11:54.330847 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack return self.func(req, *args, **kwargs) Oct 19 04:11:54.330847 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/osprofiler/web.py", line 111, in __call__ Oct 19 04:11:54.330847 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack return request.get_response(self.application) Oct 19 04:11:54.330847 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1313, in send Oct 19 04:11:54.330847 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack status, headers, app_iter = self.call_application( Oct 19 04:11:54.330847 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1278, in call_application Oct 19 04:11:54.335191 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack app_iter = application(self.environ, start_response) Oct 19 04:11:54.335191 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 129, in __call__ Oct 19 04:11:54.335191 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack resp = self.call_func(req, *args, **kw) Oct 19 04:11:54.335191 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 193, in call_func Oct 19 04:11:54.335191 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack return self.func(req, *args, **kwargs) Oct 19 04:11:54.335191 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py", line 341, in __call__ Oct 19 04:11:54.335191 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack response = req.get_response(self._app) Oct 19 04:11:54.335191 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1313, in send Oct 19 04:11:54.335191 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack status, headers, app_iter = self.call_application( Oct 19 04:11:54.335191 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1278, in call_application Oct 19 04:11:54.335191 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack app_iter = application(self.environ, start_response) Oct 19 04:11:54.335191 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 143, in __call__ Oct 19 04:11:54.335191 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack return resp(environ, start_response) Oct 19 04:11:54.335191 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 143, in __call__ Oct 19 04:11:54.335191 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack return resp(environ, start_response) Oct 19 04:11:54.335191 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/routes/middleware.py", line 153, in __call__ Oct 19 04:11:54.335191 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack response = self.app(environ, start_response) Oct 19 04:11:54.335191 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 143, in __call__ Oct 19 04:11:54.335191 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack return resp(environ, start_response) Oct 19 04:11:54.335191 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 129, in __call__ Oct 19 04:11:54.335191 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack resp = self.call_func(req, *args, **kw) Oct 19 04:11:54.335191 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 193, in call_func Oct 19 04:11:54.335191 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack return self.func(req, *args, **kwargs) Oct 19 04:11:54.335191 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 486, in __call__ Oct 19 04:11:54.335191 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack return self._process_stack(request, action, action_args, Oct 19 04:11:54.335191 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:11:54.335191 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack action_result = self.dispatch(meth, request, action_args) Oct 19 04:11:54.335191 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 04:11:54.335191 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack return method(req=request, **action_args) Oct 19 04:11:54.335191 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 04:11:54.335191 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack return f(*args, **kwargs) Oct 19 04:11:54.335191 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 04:11:54.335191 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack return func(*args, **kwargs) Oct 19 04:11:54.335191 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 04:11:54.335191 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack return func(*args, **kwargs) Oct 19 04:11:54.335191 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 04:11:54.335191 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack return func(*args, **kwargs) Oct 19 04:11:54.335191 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack [Previous line repeated 10 more times] Oct 19 04:11:54.335191 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 19 04:11:54.335191 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack instances, resv_id = self.compute_api.create( Oct 19 04:11:54.335191 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 19 04:11:54.335191 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack return self._create_instance( Oct 19 04:11:54.335191 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 19 04:11:54.335191 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack ) = self._validate_and_build_base_options( Oct 19 04:11:54.335191 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Oct 19 04:11:54.335191 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack security_groups = self._check_requested_secgroups( Oct 19 04:11:54.335191 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Oct 19 04:11:54.335191 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack secgroup_uuid = security_group_api.validate_name(context, secgroup) Oct 19 04:11:54.335191 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Oct 19 04:11:54.335191 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack return neutronv20.find_resourceid_by_name_or_id( Oct 19 04:11:54.335191 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Oct 19 04:11:54.335191 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack return find_resource_by_name_or_id(client, resource, name_or_id, Oct 19 04:11:54.335191 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Oct 19 04:11:54.335191 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack return client.find_resource(resource, name_or_id, project_id, Oct 19 04:11:54.335191 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 04:11:54.335191 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Oct 19 04:11:54.335191 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Oct 19 04:11:54.335191 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack return self._find_resource_by_name( Oct 19 04:11:54.339295 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 04:11:54.339295 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Oct 19 04:11:54.339295 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 457, in _find_resource_by_name Oct 19 04:11:54.339295 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack data = obj_lister(**params) Oct 19 04:11:54.339295 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 04:11:54.339295 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Oct 19 04:11:54.339295 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1063, in list_security_groups Oct 19 04:11:54.339295 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack return self.list('security_groups', self.security_groups_path, Oct 19 04:11:54.339295 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 04:11:54.339295 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Oct 19 04:11:54.339295 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 372, in list Oct 19 04:11:54.339295 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack for r in self._pagination(collection, path, **params): Oct 19 04:11:54.339295 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 387, in _pagination Oct 19 04:11:54.339295 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack res = self.get(path, params=params) Oct 19 04:11:54.339295 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 04:11:54.339295 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Oct 19 04:11:54.339295 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 19 04:11:54.339295 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack return self.retry_request("GET", action, body=body, Oct 19 04:11:54.339295 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 04:11:54.339295 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Oct 19 04:11:54.339295 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 19 04:11:54.339295 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack return self.do_request(method, action, body=body, Oct 19 04:11:54.339295 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 04:11:54.339295 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Oct 19 04:11:54.339295 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 19 04:11:54.339295 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack self._handle_fault_response(status_code, replybody, resp) Oct 19 04:11:54.339295 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 204, in wrapper Oct 19 04:11:54.339295 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack raise exception.Unauthorized() Oct 19 04:11:54.339295 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack nova.exception.Unauthorized: Not authorized. Oct 19 04:11:54.339295 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack Oct 19 04:11:54.339295 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack [None req-c9618131-48c5-4724-b08b-59a9e1f86ffc tempest-TestVolumeBackupRestore-1994640921 tempest-TestVolumeBackupRestore-1994640921-project] http://10.222.0.52/compute/v2.1/servers returned with HTTP 401 Oct 19 04:11:54.339295 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c9618131-48c5-4724-b08b-59a9e1f86ffc tempest-TestVolumeBackupRestore-1994640921 tempest-TestVolumeBackupRestore-1994640921-project] Returning 401 to user: This server could not verify that you are authorized to access the document you requested. Either you supplied the wrong credentials (e.g., bad password), or your browser does not understand how to supply the credentials required. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 04:11:54.339295 n-d-861333-8 devstack@n-api.service[121135]: Wed Oct 19 04:11:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.52) !!! Oct 19 04:11:54.339295 n-d-861333-8 devstack@n-api.service[121135]: Wed Oct 19 04:11:54 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during POST /compute/v2.1/servers (10.222.0.52) Oct 19 04:11:54.339295 n-d-861333-8 devstack@n-api.service[121135]: CRITICAL nova [None req-c9618131-48c5-4724-b08b-59a9e1f86ffc tempest-TestVolumeBackupRestore-1994640921 tempest-TestVolumeBackupRestore-1994640921-project] Unhandled error: OSError: write error Oct 19 04:11:54.339295 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova OSError: write error Oct 19 04:11:54.339295 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova Oct 19 04:11:54.339295 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3378/7227] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 03:56:54 2022] POST /compute/v2.1/servers => generated 0 bytes in 899985 msecs (HTTP/1.1 401) 9 headers in 0 bytes (1 switches on core 0) Oct 19 04:12:02.258008 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:12:02.258759 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:12:02.263158 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b00205d5-9f13-4aa9-b76a-335c7b883e48 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:12:02.263765 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b00205d5-9f13-4aa9-b76a-335c7b883e48 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] [instance: 1e5cbe50-c34c-4540-beea-6b4850178fd8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:12:02.269890 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b00205d5-9f13-4aa9-b76a-335c7b883e48 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:12:02.270397 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b00205d5-9f13-4aa9-b76a-335c7b883e48 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:12:02.270855 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b00205d5-9f13-4aa9-b76a-335c7b883e48 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:12:02.271569 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b00205d5-9f13-4aa9-b76a-335c7b883e48 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:12:02.272051 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b00205d5-9f13-4aa9-b76a-335c7b883e48 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:12:02.272544 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b00205d5-9f13-4aa9-b76a-335c7b883e48 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:12:02.352846 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-b00205d5-9f13-4aa9-b76a-335c7b883e48 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lazy-loading 'services' on Instance uuid 1e5cbe50-c34c-4540-beea-6b4850178fd8 {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 04:12:02.528247 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b00205d5-9f13-4aa9-b76a-335c7b883e48 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1e5cbe50-c34c-4540-beea-6b4850178fd8/os-volume_attachments/905eed79-7da1-43af-85ee-e34dc524b1be" status: 202 len: 0 microversion: 2.1 time: 0.272082 Oct 19 04:12:02.528818 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3850/7228] 10.222.0.52 () {58 vars in 1416 bytes} [Wed Oct 19 04:12:02 2022] DELETE /compute/v2.1/servers/1e5cbe50-c34c-4540-beea-6b4850178fd8/os-volume_attachments/905eed79-7da1-43af-85ee-e34dc524b1be => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 04:12:07.888928 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ad8e6929-0497-4e25-b51c-c94fba925dbd tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:12:07.889506 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ad8e6929-0497-4e25-b51c-c94fba925dbd tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] [instance: 1e5cbe50-c34c-4540-beea-6b4850178fd8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:12:07.895936 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ad8e6929-0497-4e25-b51c-c94fba925dbd tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:12:07.896428 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ad8e6929-0497-4e25-b51c-c94fba925dbd tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:12:07.896876 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ad8e6929-0497-4e25-b51c-c94fba925dbd tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:12:07.897601 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ad8e6929-0497-4e25-b51c-c94fba925dbd tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:12:07.898316 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ad8e6929-0497-4e25-b51c-c94fba925dbd tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:12:07.898748 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ad8e6929-0497-4e25-b51c-c94fba925dbd tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:12:07.926796 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ad8e6929-0497-4e25-b51c-c94fba925dbd tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] [instance: 1e5cbe50-c34c-4540-beea-6b4850178fd8] Going to try to terminate instance {{(pid=121135) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 04:12:08.237339 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ad8e6929-0497-4e25-b51c-c94fba925dbd tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1e5cbe50-c34c-4540-beea-6b4850178fd8" status: 204 len: 0 microversion: 2.1 time: 0.353791 Oct 19 04:12:08.237966 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3379/7229] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 04:12:07 2022] DELETE /compute/v2.1/servers/1e5cbe50-c34c-4540-beea-6b4850178fd8 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 04:12:08.249782 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0edea177-8b7e-4a65-808d-104f4841313f tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:12:08.251102 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0edea177-8b7e-4a65-808d-104f4841313f tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] [instance: 1e5cbe50-c34c-4540-beea-6b4850178fd8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:12:08.256926 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0edea177-8b7e-4a65-808d-104f4841313f tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:12:08.257464 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0edea177-8b7e-4a65-808d-104f4841313f tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:12:08.257960 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0edea177-8b7e-4a65-808d-104f4841313f tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:12:08.258670 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0edea177-8b7e-4a65-808d-104f4841313f tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:12:08.259143 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0edea177-8b7e-4a65-808d-104f4841313f tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:12:08.259588 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0edea177-8b7e-4a65-808d-104f4841313f tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:12:08.389435 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0edea177-8b7e-4a65-808d-104f4841313f tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1064b12837487488ed599b4656bcf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae028dcf0d5949488105d6b9aa6b523d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:12:08.397526 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0edea177-8b7e-4a65-808d-104f4841313f tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] 10.222.0.52 "GET /compute/v2.1/servers/1e5cbe50-c34c-4540-beea-6b4850178fd8" status: 200 len: 1513 microversion: 2.1 time: 0.153494 Oct 19 04:12:08.398362 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3851/7230] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:12:08 2022] GET /compute/v2.1/servers/1e5cbe50-c34c-4540-beea-6b4850178fd8 => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:12:09.422800 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b604f449-1573-4237-bf3b-71e1b4db9fb9 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:12:09.423516 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b604f449-1573-4237-bf3b-71e1b4db9fb9 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] [instance: 1e5cbe50-c34c-4540-beea-6b4850178fd8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:12:09.430146 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b604f449-1573-4237-bf3b-71e1b4db9fb9 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:12:09.430635 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b604f449-1573-4237-bf3b-71e1b4db9fb9 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:12:09.431077 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b604f449-1573-4237-bf3b-71e1b4db9fb9 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:12:09.431770 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b604f449-1573-4237-bf3b-71e1b4db9fb9 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:12:09.432228 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b604f449-1573-4237-bf3b-71e1b4db9fb9 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:12:09.432671 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b604f449-1573-4237-bf3b-71e1b4db9fb9 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:12:09.564029 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b604f449-1573-4237-bf3b-71e1b4db9fb9 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1064b12837487488ed599b4656bcf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae028dcf0d5949488105d6b9aa6b523d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:12:09.572428 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b604f449-1573-4237-bf3b-71e1b4db9fb9 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] 10.222.0.52 "GET /compute/v2.1/servers/1e5cbe50-c34c-4540-beea-6b4850178fd8" status: 200 len: 1513 microversion: 2.1 time: 0.154098 Oct 19 04:12:09.573104 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3380/7231] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:12:09 2022] GET /compute/v2.1/servers/1e5cbe50-c34c-4540-beea-6b4850178fd8 => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:12:10.598107 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2fb63329-84f8-4cf6-9f54-74a27736ad59 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:12:10.599434 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2fb63329-84f8-4cf6-9f54-74a27736ad59 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] [instance: 1e5cbe50-c34c-4540-beea-6b4850178fd8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:12:10.607247 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2fb63329-84f8-4cf6-9f54-74a27736ad59 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:12:10.607826 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2fb63329-84f8-4cf6-9f54-74a27736ad59 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:12:10.608362 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2fb63329-84f8-4cf6-9f54-74a27736ad59 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:12:10.609162 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2fb63329-84f8-4cf6-9f54-74a27736ad59 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:12:10.609691 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2fb63329-84f8-4cf6-9f54-74a27736ad59 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:12:10.610216 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2fb63329-84f8-4cf6-9f54-74a27736ad59 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:12:10.661762 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-8ec881bc-6120-416e-a17f-f7b8af0b92ef req-7e95e883-717a-45bc-8a81-cb58d382b6d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e5cbe50-c34c-4540-beea-6b4850178fd8", "name": "network-vif-deleted", "tag": "025e1417-8c51-4f86-8379-0f81b8774d1d"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:12:10.672677 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-8ec881bc-6120-416e-a17f-f7b8af0b92ef req-7e95e883-717a-45bc-8a81-cb58d382b6d8 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:12:10.676197 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-8ec881bc-6120-416e-a17f-f7b8af0b92ef req-7e95e883-717a-45bc-8a81-cb58d382b6d8 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:12:10.676197 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-8ec881bc-6120-416e-a17f-f7b8af0b92ef req-7e95e883-717a-45bc-8a81-cb58d382b6d8 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:12:10.685946 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-2fb63329-84f8-4cf6-9f54-74a27736ad59 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1064b12837487488ed599b4656bcf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae028dcf0d5949488105d6b9aa6b523d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:12:10.686117 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-8ec881bc-6120-416e-a17f-f7b8af0b92ef req-7e95e883-717a-45bc-8a81-cb58d382b6d8 service nova] Creating event network-vif-deleted:025e1417-8c51-4f86-8379-0f81b8774d1d for instance 1e5cbe50-c34c-4540-beea-6b4850178fd8 on n-h1-861333-8 Oct 19 04:12:10.691106 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-8ec881bc-6120-416e-a17f-f7b8af0b92ef req-7e95e883-717a-45bc-8a81-cb58d382b6d8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033023 Oct 19 04:12:10.691741 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3381/7232] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:12:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 04:12:10.695070 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2fb63329-84f8-4cf6-9f54-74a27736ad59 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] 10.222.0.52 "GET /compute/v2.1/servers/1e5cbe50-c34c-4540-beea-6b4850178fd8" status: 200 len: 1471 microversion: 2.1 time: 0.102712 Oct 19 04:12:10.695690 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3852/7233] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:12:10 2022] GET /compute/v2.1/servers/1e5cbe50-c34c-4540-beea-6b4850178fd8 => generated 1471 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:12:11.725887 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c81995e8-aa10-4a94-a78a-24b54c15073a tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:12:11.726541 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c81995e8-aa10-4a94-a78a-24b54c15073a tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] [instance: 1e5cbe50-c34c-4540-beea-6b4850178fd8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:12:11.733497 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c81995e8-aa10-4a94-a78a-24b54c15073a tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:12:11.733986 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c81995e8-aa10-4a94-a78a-24b54c15073a tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:12:11.734429 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c81995e8-aa10-4a94-a78a-24b54c15073a tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:12:11.735121 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c81995e8-aa10-4a94-a78a-24b54c15073a tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:12:11.735576 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c81995e8-aa10-4a94-a78a-24b54c15073a tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:12:11.736001 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c81995e8-aa10-4a94-a78a-24b54c15073a tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:12:11.769816 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c81995e8-aa10-4a94-a78a-24b54c15073a tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:12:11.770323 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c81995e8-aa10-4a94-a78a-24b54c15073a tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:12:11.770909 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c81995e8-aa10-4a94-a78a-24b54c15073a tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:12:11.771360 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-c81995e8-aa10-4a94-a78a-24b54c15073a tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lazy-loading 'fault' on Instance uuid 1e5cbe50-c34c-4540-beea-6b4850178fd8 {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 04:12:11.814966 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c81995e8-aa10-4a94-a78a-24b54c15073a tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1064b12837487488ed599b4656bcf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae028dcf0d5949488105d6b9aa6b523d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:12:11.823521 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c81995e8-aa10-4a94-a78a-24b54c15073a tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] 10.222.0.52 "GET /compute/v2.1/servers/1e5cbe50-c34c-4540-beea-6b4850178fd8" status: 200 len: 1308 microversion: 2.1 time: 0.103113 Oct 19 04:12:11.824097 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3382/7234] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:12:11 2022] GET /compute/v2.1/servers/1e5cbe50-c34c-4540-beea-6b4850178fd8 => generated 1308 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:12:12.846591 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-14b04c01-3b4a-484f-9f14-a37ea9a02a77 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:12:12.847251 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-14b04c01-3b4a-484f-9f14-a37ea9a02a77 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] [instance: 1e5cbe50-c34c-4540-beea-6b4850178fd8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:12:12.854917 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-14b04c01-3b4a-484f-9f14-a37ea9a02a77 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:12:12.855413 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-14b04c01-3b4a-484f-9f14-a37ea9a02a77 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:12:12.855865 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-14b04c01-3b4a-484f-9f14-a37ea9a02a77 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:12:12.856577 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-14b04c01-3b4a-484f-9f14-a37ea9a02a77 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:12:12.857098 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-14b04c01-3b4a-484f-9f14-a37ea9a02a77 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:12:12.857621 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-14b04c01-3b4a-484f-9f14-a37ea9a02a77 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:12:12.871804 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-14b04c01-3b4a-484f-9f14-a37ea9a02a77 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] HTTP exception thrown: Instance 1e5cbe50-c34c-4540-beea-6b4850178fd8 could not be found. Oct 19 04:12:12.873498 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-14b04c01-3b4a-484f-9f14-a37ea9a02a77 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Request method failure captured: Oct 19 04:12:12.873498 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/1e5cbe50-c34c-4540-beea-6b4850178fd8 HTTP/1.1 Oct 19 04:12:12.873498 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 04:12:12.873498 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 04:12:12.873498 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 04:12:12.873498 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 04:12:12.873498 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 04:12:12.873498 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 04:12:12.873498 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 04:12:12.873498 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 04:12:12.873498 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3g9_CTeYWnvYc_mOaxoj2hg_5LZyv-HHPtYHAoaw4AKHYxO8IrPYKkT2EADUoGMeJFVI8CCdcTLKuNxkCWks2U8cKscFkZSQsjbNZ1ciBHDfMWUou2lGbalkppSfR5_niLFFYC52TUFUeap7OKRKmr6nbYMBpuG7n2_p2q74WIT2i4 Oct 19 04:12:12.873498 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 04:12:12.873498 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 04:12:12.873498 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 04:12:12.873498 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 04:12:12.873498 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 04:12:12.873498 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 04:12:12.873498 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: ae028dcf0d5949488105d6b9aa6b523d Oct 19 04:12:12.873498 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1536955095 Oct 19 04:12:12.873498 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 04:12:12.873498 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 04:12:12.873498 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ae028dcf0d5949488105d6b9aa6b523d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ae028dcf0d5949488105d6b9aa6b523d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ae028dcf0d5949488105d6b9aa6b523d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ae028dcf0d5949488105d6b9aa6b523d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 04:12:12.873498 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-VolumesSnapshotTestJSON-1536955095 Oct 19 04:12:12.873498 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: ae028dcf0d5949488105d6b9aa6b523d Oct 19 04:12:12.873498 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1536955095 Oct 19 04:12:12.873498 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-VolumesSnapshotTestJSON-1536955095-project Oct 19 04:12:12.873498 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 04:12:12.873498 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 04:12:12.873498 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 7b1064b12837487488ed599b4656bcf7 Oct 19 04:12:12.873498 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-VolumesSnapshotTestJSON-1536955095-project Oct 19 04:12:12.873498 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 04:12:12.873498 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance 1e5cbe50-c34c-4540-beea-6b4850178fd8 could not be found. Oct 19 04:12:12.873498 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '1e5cbe50-c34c-4540-beea-6b4850178fd8'} Oct 19 04:12:12.873498 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 04:12:12.873498 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:12:12.873498 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 04:12:12.873498 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 04:12:12.873498 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 04:12:12.873498 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 04:12:12.873498 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 04:12:12.873498 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 04:12:12.873498 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 04:12:12.873498 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 04:12:12.873498 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e5cbe50-c34c-4540-beea-6b4850178fd8 could not be found. Oct 19 04:12:12.873498 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:12:12.873498 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:12:12.873498 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:12:12.873498 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:12:12.873498 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:12:12.873498 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:12:12.873498 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 04:12:12.873498 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 04:12:12.873498 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 04:12:12.873498 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 04:12:12.873498 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 04:12:12.873498 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 04:12:12.873498 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 04:12:12.873498 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 04:12:12.873498 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 04:12:12.873498 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 04:12:12.873498 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e5cbe50-c34c-4540-beea-6b4850178fd8 could not be found. Oct 19 04:12:12.873498 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:12:12.873498 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:12:12.873498 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:12:12.878109 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:12:12.878109 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:12:12.878109 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:12:12.878109 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 04:12:12.878109 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 04:12:12.878109 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e5cbe50-c34c-4540-beea-6b4850178fd8 could not be found. Oct 19 04:12:12.878109 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:12:12.878109 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-14b04c01-3b4a-484f-9f14-a37ea9a02a77 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] Returning 404 to user: Instance 1e5cbe50-c34c-4540-beea-6b4850178fd8 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 04:12:12.878109 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-14b04c01-3b4a-484f-9f14-a37ea9a02a77 tempest-VolumesSnapshotTestJSON-1536955095 tempest-VolumesSnapshotTestJSON-1536955095-project] 10.222.0.52 "GET /compute/v2.1/servers/1e5cbe50-c34c-4540-beea-6b4850178fd8" status: 404 len: 111 microversion: 2.1 time: 0.032336 Oct 19 04:12:12.878109 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3853/7235] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:12:12 2022] GET /compute/v2.1/servers/1e5cbe50-c34c-4540-beea-6b4850178fd8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 04:12:50.072310 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2e0d715b-593c-4a5b-8c64-8a694ef4f296 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:12:50.080841 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-2e0d715b-593c-4a5b-8c64-8a694ef4f296 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 165ab672-2a25-4e32-ab1d-80b2b5133696] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:12:50.080984 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-dbb9c5dd-935b-473b-bd31-9f72d91ded8a req-b3658104-5d4c-4e5b-bb85-371810627580 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "165ab672-2a25-4e32-ab1d-80b2b5133696", "tag": "ed2cd9c7-b37a-4843-af41-06582eee726a"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:12:50.081454 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:12:50.081454 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:12:50.086007 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=8 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:12:50.086976 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:12:50.089285 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-dbb9c5dd-935b-473b-bd31-9f72d91ded8a req-b3658104-5d4c-4e5b-bb85-371810627580 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:12:50.089913 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-dbb9c5dd-935b-473b-bd31-9f72d91ded8a req-b3658104-5d4c-4e5b-bb85-371810627580 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:12:50.090446 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-dbb9c5dd-935b-473b-bd31-9f72d91ded8a req-b3658104-5d4c-4e5b-bb85-371810627580 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:12:50.093022 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2e0d715b-593c-4a5b-8c64-8a694ef4f296 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:12:50.093569 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2e0d715b-593c-4a5b-8c64-8a694ef4f296 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:12:50.094020 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2e0d715b-593c-4a5b-8c64-8a694ef4f296 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:12:50.094791 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2e0d715b-593c-4a5b-8c64-8a694ef4f296 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:12:50.095201 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2e0d715b-593c-4a5b-8c64-8a694ef4f296 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:12:50.095636 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2e0d715b-593c-4a5b-8c64-8a694ef4f296 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:12:50.103237 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-dbb9c5dd-935b-473b-bd31-9f72d91ded8a req-b3658104-5d4c-4e5b-bb85-371810627580 service nova] Creating event network-changed:ed2cd9c7-b37a-4843-af41-06582eee726a for instance 165ab672-2a25-4e32-ab1d-80b2b5133696 on n-h2-861333-8 Oct 19 04:12:50.109469 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-dbb9c5dd-935b-473b-bd31-9f72d91ded8a req-b3658104-5d4c-4e5b-bb85-371810627580 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038634 Oct 19 04:12:50.110971 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3854/7236] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:12:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 04:12:50.137784 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-2e0d715b-593c-4a5b-8c64-8a694ef4f296 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 165ab672-2a25-4e32-ab1d-80b2b5133696] Going to try to terminate instance {{(pid=121135) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 04:12:50.406035 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2e0d715b-593c-4a5b-8c64-8a694ef4f296 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "DELETE /compute/v2.1/servers/165ab672-2a25-4e32-ab1d-80b2b5133696" status: 204 len: 0 microversion: 2.1 time: 0.336854 Oct 19 04:12:50.407438 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3383/7237] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 04:12:50 2022] DELETE /compute/v2.1/servers/165ab672-2a25-4e32-ab1d-80b2b5133696 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 04:12:50.417399 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-678a0345-1c68-48d0-86c9-7c3c07771fdd tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:12:50.424162 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-678a0345-1c68-48d0-86c9-7c3c07771fdd tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 165ab672-2a25-4e32-ab1d-80b2b5133696] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:12:50.431565 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-678a0345-1c68-48d0-86c9-7c3c07771fdd tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:12:50.432458 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-678a0345-1c68-48d0-86c9-7c3c07771fdd tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:12:50.433188 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-678a0345-1c68-48d0-86c9-7c3c07771fdd tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:12:50.434270 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-678a0345-1c68-48d0-86c9-7c3c07771fdd tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:12:50.434981 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-678a0345-1c68-48d0-86c9-7c3c07771fdd tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:12:50.435656 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-678a0345-1c68-48d0-86c9-7c3c07771fdd tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:12:50.582929 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-678a0345-1c68-48d0-86c9-7c3c07771fdd tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:12:50.592595 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-678a0345-1c68-48d0-86c9-7c3c07771fdd tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/165ab672-2a25-4e32-ab1d-80b2b5133696" status: 200 len: 1578 microversion: 2.1 time: 0.180536 Oct 19 04:12:50.593904 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3855/7238] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:12:50 2022] GET /compute/v2.1/servers/165ab672-2a25-4e32-ab1d-80b2b5133696 => generated 1578 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:12:51.618555 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-cce22553-a828-4213-ad18-319d8c80dfa2 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:12:51.619796 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-cce22553-a828-4213-ad18-319d8c80dfa2 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 165ab672-2a25-4e32-ab1d-80b2b5133696] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:12:51.623769 n-d-861333-8 devstack@n-api.service[121135]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 04:12:51.623919 n-d-861333-8 devstack@n-api.service[121135]: Wed Oct 19 04:12:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/165ab672-2a25-4e32-ab1d-80b2b5133696 (ip 10.222.0.52) !!! Oct 19 04:12:51.632234 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cce22553-a828-4213-ad18-319d8c80dfa2 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:12:51.633071 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cce22553-a828-4213-ad18-319d8c80dfa2 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:12:51.633630 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cce22553-a828-4213-ad18-319d8c80dfa2 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:12:51.634346 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cce22553-a828-4213-ad18-319d8c80dfa2 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:12:51.634810 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cce22553-a828-4213-ad18-319d8c80dfa2 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:12:51.635243 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cce22553-a828-4213-ad18-319d8c80dfa2 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:12:51.863947 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-cce22553-a828-4213-ad18-319d8c80dfa2 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:12:51.876963 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-cce22553-a828-4213-ad18-319d8c80dfa2 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/165ab672-2a25-4e32-ab1d-80b2b5133696" status: 200 len: 1578 microversion: 2.1 time: 0.262876 Oct 19 04:12:51.892999 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3384/7239] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:12:51 2022] GET /compute/v2.1/servers/165ab672-2a25-4e32-ab1d-80b2b5133696 => generated 1578 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:12:52.757132 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-9e490670-e60a-4821-95ad-0bb93e0185b7 req-fbd6bbae-9d51-414e-b317-fbdf21441c62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "165ab672-2a25-4e32-ab1d-80b2b5133696", "name": "network-vif-deleted", "tag": "ed2cd9c7-b37a-4843-af41-06582eee726a"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:12:52.775635 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-9e490670-e60a-4821-95ad-0bb93e0185b7 req-fbd6bbae-9d51-414e-b317-fbdf21441c62 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:12:52.776054 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-9e490670-e60a-4821-95ad-0bb93e0185b7 req-fbd6bbae-9d51-414e-b317-fbdf21441c62 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:12:52.776507 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-9e490670-e60a-4821-95ad-0bb93e0185b7 req-fbd6bbae-9d51-414e-b317-fbdf21441c62 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:12:52.790505 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-9e490670-e60a-4821-95ad-0bb93e0185b7 req-fbd6bbae-9d51-414e-b317-fbdf21441c62 service nova] Creating event network-vif-deleted:ed2cd9c7-b37a-4843-af41-06582eee726a for instance 165ab672-2a25-4e32-ab1d-80b2b5133696 on n-h2-861333-8 Oct 19 04:12:52.796882 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-9e490670-e60a-4821-95ad-0bb93e0185b7 req-fbd6bbae-9d51-414e-b317-fbdf21441c62 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043493 Oct 19 04:12:52.797527 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3856/7240] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:12:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:12:52.900953 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-19993309-cf5c-4bb2-9323-8292f0ae6d15 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:12:52.901832 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-19993309-cf5c-4bb2-9323-8292f0ae6d15 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 165ab672-2a25-4e32-ab1d-80b2b5133696] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:12:52.909203 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-19993309-cf5c-4bb2-9323-8292f0ae6d15 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:12:52.909728 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-19993309-cf5c-4bb2-9323-8292f0ae6d15 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:12:52.910172 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-19993309-cf5c-4bb2-9323-8292f0ae6d15 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:12:52.910866 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-19993309-cf5c-4bb2-9323-8292f0ae6d15 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:12:52.911322 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-19993309-cf5c-4bb2-9323-8292f0ae6d15 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:12:52.911749 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-19993309-cf5c-4bb2-9323-8292f0ae6d15 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:12:52.979371 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-19993309-cf5c-4bb2-9323-8292f0ae6d15 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:12:52.988435 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-19993309-cf5c-4bb2-9323-8292f0ae6d15 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/165ab672-2a25-4e32-ab1d-80b2b5133696" status: 200 len: 1225 microversion: 2.1 time: 0.091584 Oct 19 04:12:52.989020 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3385/7241] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:12:52 2022] GET /compute/v2.1/servers/165ab672-2a25-4e32-ab1d-80b2b5133696 => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:12:54.013232 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-633d569c-3fe1-45b2-9987-dcb6d9b14d12 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:12:54.014092 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-633d569c-3fe1-45b2-9987-dcb6d9b14d12 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 165ab672-2a25-4e32-ab1d-80b2b5133696] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:12:54.024318 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-633d569c-3fe1-45b2-9987-dcb6d9b14d12 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:12:54.024824 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-633d569c-3fe1-45b2-9987-dcb6d9b14d12 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:12:54.025271 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-633d569c-3fe1-45b2-9987-dcb6d9b14d12 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:12:54.026208 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-633d569c-3fe1-45b2-9987-dcb6d9b14d12 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:12:54.026827 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-633d569c-3fe1-45b2-9987-dcb6d9b14d12 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:12:54.027421 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-633d569c-3fe1-45b2-9987-dcb6d9b14d12 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:12:54.108161 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-633d569c-3fe1-45b2-9987-dcb6d9b14d12 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:12:54.116700 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-633d569c-3fe1-45b2-9987-dcb6d9b14d12 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/165ab672-2a25-4e32-ab1d-80b2b5133696" status: 200 len: 1225 microversion: 2.1 time: 0.108910 Oct 19 04:12:54.118945 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3857/7242] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:12:54 2022] GET /compute/v2.1/servers/165ab672-2a25-4e32-ab1d-80b2b5133696 => generated 1225 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:12:55.140401 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-81b5f23c-2a2f-43b7-ae8d-afedd42b8744 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:12:55.141134 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-81b5f23c-2a2f-43b7-ae8d-afedd42b8744 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 165ab672-2a25-4e32-ab1d-80b2b5133696] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:12:55.148230 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-81b5f23c-2a2f-43b7-ae8d-afedd42b8744 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:12:55.148725 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-81b5f23c-2a2f-43b7-ae8d-afedd42b8744 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:12:55.149166 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-81b5f23c-2a2f-43b7-ae8d-afedd42b8744 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:12:55.149893 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-81b5f23c-2a2f-43b7-ae8d-afedd42b8744 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:12:55.150352 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-81b5f23c-2a2f-43b7-ae8d-afedd42b8744 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:12:55.150787 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-81b5f23c-2a2f-43b7-ae8d-afedd42b8744 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:12:55.218880 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-81b5f23c-2a2f-43b7-ae8d-afedd42b8744 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:12:55.227156 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-81b5f23c-2a2f-43b7-ae8d-afedd42b8744 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/165ab672-2a25-4e32-ab1d-80b2b5133696" status: 200 len: 1225 microversion: 2.1 time: 0.090729 Oct 19 04:12:55.227739 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3386/7243] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:12:55 2022] GET /compute/v2.1/servers/165ab672-2a25-4e32-ab1d-80b2b5133696 => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:12:56.254608 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e5c47621-1900-44a1-b9a7-a9b39e48a570 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:12:56.255249 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e5c47621-1900-44a1-b9a7-a9b39e48a570 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 165ab672-2a25-4e32-ab1d-80b2b5133696] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:12:56.267666 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e5c47621-1900-44a1-b9a7-a9b39e48a570 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:12:56.268227 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e5c47621-1900-44a1-b9a7-a9b39e48a570 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:12:56.268683 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e5c47621-1900-44a1-b9a7-a9b39e48a570 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:12:56.269513 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e5c47621-1900-44a1-b9a7-a9b39e48a570 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:12:56.269991 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e5c47621-1900-44a1-b9a7-a9b39e48a570 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:12:56.270442 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e5c47621-1900-44a1-b9a7-a9b39e48a570 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:12:56.337393 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e5c47621-1900-44a1-b9a7-a9b39e48a570 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:12:56.346930 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e5c47621-1900-44a1-b9a7-a9b39e48a570 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/165ab672-2a25-4e32-ab1d-80b2b5133696" status: 200 len: 1225 microversion: 2.1 time: 0.096255 Oct 19 04:12:56.347515 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3858/7244] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:12:56 2022] GET /compute/v2.1/servers/165ab672-2a25-4e32-ab1d-80b2b5133696 => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:12:57.371125 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-999880a4-2083-47f7-8577-55f754b79589 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:12:57.371694 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-999880a4-2083-47f7-8577-55f754b79589 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 165ab672-2a25-4e32-ab1d-80b2b5133696] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:12:57.378370 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-999880a4-2083-47f7-8577-55f754b79589 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:12:57.378814 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-999880a4-2083-47f7-8577-55f754b79589 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:12:57.379263 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-999880a4-2083-47f7-8577-55f754b79589 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:12:57.379968 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-999880a4-2083-47f7-8577-55f754b79589 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:12:57.380429 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-999880a4-2083-47f7-8577-55f754b79589 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:12:57.380857 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-999880a4-2083-47f7-8577-55f754b79589 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:12:57.413667 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-999880a4-2083-47f7-8577-55f754b79589 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:12:57.414171 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-999880a4-2083-47f7-8577-55f754b79589 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:12:57.414606 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-999880a4-2083-47f7-8577-55f754b79589 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:12:57.415060 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-999880a4-2083-47f7-8577-55f754b79589 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lazy-loading 'fault' on Instance uuid 165ab672-2a25-4e32-ab1d-80b2b5133696 {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 04:12:57.465710 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-999880a4-2083-47f7-8577-55f754b79589 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:12:57.474683 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-999880a4-2083-47f7-8577-55f754b79589 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/165ab672-2a25-4e32-ab1d-80b2b5133696" status: 200 len: 1230 microversion: 2.1 time: 0.107518 Oct 19 04:12:57.476307 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3387/7245] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:12:57 2022] GET /compute/v2.1/servers/165ab672-2a25-4e32-ab1d-80b2b5133696 => generated 1230 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:12:58.500428 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6347f538-441f-4d30-a85b-685c83632280 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:12:58.501116 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6347f538-441f-4d30-a85b-685c83632280 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 165ab672-2a25-4e32-ab1d-80b2b5133696] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:12:58.508046 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6347f538-441f-4d30-a85b-685c83632280 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:12:58.508550 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6347f538-441f-4d30-a85b-685c83632280 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:12:58.509140 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6347f538-441f-4d30-a85b-685c83632280 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:12:58.509886 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6347f538-441f-4d30-a85b-685c83632280 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:12:58.510353 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6347f538-441f-4d30-a85b-685c83632280 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:12:58.510802 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6347f538-441f-4d30-a85b-685c83632280 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:12:58.524784 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-6347f538-441f-4d30-a85b-685c83632280 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] HTTP exception thrown: Instance 165ab672-2a25-4e32-ab1d-80b2b5133696 could not be found. Oct 19 04:12:58.526475 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6347f538-441f-4d30-a85b-685c83632280 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Request method failure captured: Oct 19 04:12:58.526475 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/165ab672-2a25-4e32-ab1d-80b2b5133696 HTTP/1.1 Oct 19 04:12:58.526475 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 04:12:58.526475 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 04:12:58.526475 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 04:12:58.526475 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 04:12:58.526475 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 04:12:58.526475 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 04:12:58.526475 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 04:12:58.526475 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 04:12:58.526475 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3XYw5PeFcmVZaG2CxoqLxKroO9lkG-Hw7MzEkzHPy2_aqlf3HPBMKgLOXoQ-WbgkZbvZB1PbShR7FiiZmGSIVTCeQrWw3ytKpP-AuucJQP3lFFYEs8HquAFih6wwJOh2-3eNgmaxbIZUVh9y_A1g_wYecm08YmNoRnAnQnVYIDNRwE Oct 19 04:12:58.526475 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 04:12:58.526475 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 04:12:58.526475 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 04:12:58.526475 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 04:12:58.526475 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 04:12:58.526475 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 04:12:58.526475 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: beff434485604f85985617071a93727c Oct 19 04:12:58.526475 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-TestVolumeBootPattern-954873624 Oct 19 04:12:58.526475 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 04:12:58.526475 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 04:12:58.526475 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/beff434485604f85985617071a93727c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/beff434485604f85985617071a93727c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/beff434485604f85985617071a93727c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_beff434485604f85985617071a93727c", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 04:12:58.526475 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-TestVolumeBootPattern-954873624 Oct 19 04:12:58.526475 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: beff434485604f85985617071a93727c Oct 19 04:12:58.526475 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-TestVolumeBootPattern-954873624 Oct 19 04:12:58.526475 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-TestVolumeBootPattern-954873624-project Oct 19 04:12:58.526475 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 04:12:58.526475 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 04:12:58.526475 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 4d30aa868d79473f9534bd79816c07e3 Oct 19 04:12:58.526475 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-TestVolumeBootPattern-954873624-project Oct 19 04:12:58.526475 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 04:12:58.526475 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance 165ab672-2a25-4e32-ab1d-80b2b5133696 could not be found. Oct 19 04:12:58.526475 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '165ab672-2a25-4e32-ab1d-80b2b5133696'} Oct 19 04:12:58.526475 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 04:12:58.526475 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:12:58.526475 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 04:12:58.526475 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 04:12:58.526475 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 04:12:58.526475 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 04:12:58.526475 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 04:12:58.526475 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 04:12:58.526475 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 04:12:58.526475 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 04:12:58.526475 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 165ab672-2a25-4e32-ab1d-80b2b5133696 could not be found. Oct 19 04:12:58.526475 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:12:58.526475 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:12:58.526475 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:12:58.526475 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:12:58.526475 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:12:58.526475 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:12:58.526475 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 04:12:58.526475 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 04:12:58.526475 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 04:12:58.526475 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 04:12:58.526475 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 04:12:58.526475 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 04:12:58.526475 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 04:12:58.526475 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 04:12:58.526475 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 04:12:58.526475 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 04:12:58.526475 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 165ab672-2a25-4e32-ab1d-80b2b5133696 could not be found. Oct 19 04:12:58.526475 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:12:58.526475 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:12:58.526475 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:12:58.530991 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:12:58.530991 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:12:58.530991 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:12:58.530991 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 04:12:58.530991 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 04:12:58.530991 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 165ab672-2a25-4e32-ab1d-80b2b5133696 could not be found. Oct 19 04:12:58.530991 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:12:58.530991 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6347f538-441f-4d30-a85b-685c83632280 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Returning 404 to user: Instance 165ab672-2a25-4e32-ab1d-80b2b5133696 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 04:12:58.530991 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6347f538-441f-4d30-a85b-685c83632280 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/165ab672-2a25-4e32-ab1d-80b2b5133696" status: 404 len: 111 microversion: 2.1 time: 0.032126 Oct 19 04:12:58.530991 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3859/7246] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:12:58 2022] GET /compute/v2.1/servers/165ab672-2a25-4e32-ab1d-80b2b5133696 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 04:13:05.093221 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-929d5f51-c51f-4c67-a38e-b77273b4d41c tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:13:05.093738 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-929d5f51-c51f-4c67-a38e-b77273b4d41c tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 1f95df19-4270-423d-8738-a749b9981006] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:13:05.095574 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-46291504-acec-4f89-a574-bdc12d105b1a req-bb76b9af-8f95-439a-a248-edca0f0f5aef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f95df19-4270-423d-8738-a749b9981006", "tag": "0b09badc-c0d4-4e27-bbc7-3b0304eadc2c"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:13:05.102338 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-929d5f51-c51f-4c67-a38e-b77273b4d41c tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:13:05.102877 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-929d5f51-c51f-4c67-a38e-b77273b4d41c tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:13:05.103281 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-929d5f51-c51f-4c67-a38e-b77273b4d41c tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:13:05.103992 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-929d5f51-c51f-4c67-a38e-b77273b4d41c tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:13:05.104456 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-929d5f51-c51f-4c67-a38e-b77273b4d41c tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:13:05.110249 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-46291504-acec-4f89-a574-bdc12d105b1a req-bb76b9af-8f95-439a-a248-edca0f0f5aef service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:13:05.110754 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-46291504-acec-4f89-a574-bdc12d105b1a req-bb76b9af-8f95-439a-a248-edca0f0f5aef service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:13:05.111205 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-46291504-acec-4f89-a574-bdc12d105b1a req-bb76b9af-8f95-439a-a248-edca0f0f5aef service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:13:05.111480 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-929d5f51-c51f-4c67-a38e-b77273b4d41c tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:13:05.123218 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-46291504-acec-4f89-a574-bdc12d105b1a req-bb76b9af-8f95-439a-a248-edca0f0f5aef service nova] Creating event network-changed:0b09badc-c0d4-4e27-bbc7-3b0304eadc2c for instance 1f95df19-4270-423d-8738-a749b9981006 on n-h2-861333-8 Oct 19 04:13:05.128424 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-46291504-acec-4f89-a574-bdc12d105b1a req-bb76b9af-8f95-439a-a248-edca0f0f5aef service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036614 Oct 19 04:13:05.132173 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3860/7247] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:13:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:13:05.152890 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-929d5f51-c51f-4c67-a38e-b77273b4d41c tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 1f95df19-4270-423d-8738-a749b9981006] Going to try to terminate instance {{(pid=121135) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 04:13:05.483205 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-929d5f51-c51f-4c67-a38e-b77273b4d41c tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1f95df19-4270-423d-8738-a749b9981006" status: 204 len: 0 microversion: 2.1 time: 0.394420 Oct 19 04:13:05.484397 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3388/7248] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 04:13:05 2022] DELETE /compute/v2.1/servers/1f95df19-4270-423d-8738-a749b9981006 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 04:13:05.493308 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-fb4a54b2-42da-405a-aa14-c9cee86544d2 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:13:05.494413 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-fb4a54b2-42da-405a-aa14-c9cee86544d2 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 1f95df19-4270-423d-8738-a749b9981006] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:13:05.501009 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fb4a54b2-42da-405a-aa14-c9cee86544d2 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:13:05.501664 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fb4a54b2-42da-405a-aa14-c9cee86544d2 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:13:05.502216 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fb4a54b2-42da-405a-aa14-c9cee86544d2 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:13:05.503017 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fb4a54b2-42da-405a-aa14-c9cee86544d2 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:13:05.503565 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fb4a54b2-42da-405a-aa14-c9cee86544d2 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:13:05.504086 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fb4a54b2-42da-405a-aa14-c9cee86544d2 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:13:05.720816 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-fb4a54b2-42da-405a-aa14-c9cee86544d2 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:13:05.731785 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-fb4a54b2-42da-405a-aa14-c9cee86544d2 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/1f95df19-4270-423d-8738-a749b9981006" status: 200 len: 1576 microversion: 2.1 time: 0.242627 Oct 19 04:13:05.733152 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3861/7249] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:13:05 2022] GET /compute/v2.1/servers/1f95df19-4270-423d-8738-a749b9981006 => generated 1576 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:13:06.611122 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-7e7c89e5-6eec-40a5-9eb9-c637b6bef040 req-7620f66c-2642-4e6f-ba3f-d78537ce8a80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f95df19-4270-423d-8738-a749b9981006", "name": "network-vif-deleted", "tag": "0b09badc-c0d4-4e27-bbc7-3b0304eadc2c"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:13:06.622028 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-7e7c89e5-6eec-40a5-9eb9-c637b6bef040 req-7620f66c-2642-4e6f-ba3f-d78537ce8a80 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:13:06.622519 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-7e7c89e5-6eec-40a5-9eb9-c637b6bef040 req-7620f66c-2642-4e6f-ba3f-d78537ce8a80 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:13:06.622961 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-7e7c89e5-6eec-40a5-9eb9-c637b6bef040 req-7620f66c-2642-4e6f-ba3f-d78537ce8a80 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:13:06.633252 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-7e7c89e5-6eec-40a5-9eb9-c637b6bef040 req-7620f66c-2642-4e6f-ba3f-d78537ce8a80 service nova] Creating event network-vif-deleted:0b09badc-c0d4-4e27-bbc7-3b0304eadc2c for instance 1f95df19-4270-423d-8738-a749b9981006 on n-h2-861333-8 Oct 19 04:13:06.639015 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-7e7c89e5-6eec-40a5-9eb9-c637b6bef040 req-7620f66c-2642-4e6f-ba3f-d78537ce8a80 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031872 Oct 19 04:13:06.639987 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3389/7250] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:13:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:13:06.757422 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6dafd2de-f311-4ac8-b7eb-8bda06782029 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:13:06.758095 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6dafd2de-f311-4ac8-b7eb-8bda06782029 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 1f95df19-4270-423d-8738-a749b9981006] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:13:06.764869 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6dafd2de-f311-4ac8-b7eb-8bda06782029 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:13:06.765399 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6dafd2de-f311-4ac8-b7eb-8bda06782029 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:13:06.765875 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6dafd2de-f311-4ac8-b7eb-8bda06782029 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:13:06.766591 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6dafd2de-f311-4ac8-b7eb-8bda06782029 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:13:06.767067 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6dafd2de-f311-4ac8-b7eb-8bda06782029 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:13:06.767517 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6dafd2de-f311-4ac8-b7eb-8bda06782029 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:13:06.830905 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-6dafd2de-f311-4ac8-b7eb-8bda06782029 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:13:06.838906 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6dafd2de-f311-4ac8-b7eb-8bda06782029 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/1f95df19-4270-423d-8738-a749b9981006" status: 200 len: 1224 microversion: 2.1 time: 0.085413 Oct 19 04:13:06.839978 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3862/7251] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:13:06 2022] GET /compute/v2.1/servers/1f95df19-4270-423d-8738-a749b9981006 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:13:07.863049 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-715b0f73-665a-4610-84b4-237b54ebffc1 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:13:07.863766 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-715b0f73-665a-4610-84b4-237b54ebffc1 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 1f95df19-4270-423d-8738-a749b9981006] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:13:07.871874 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-715b0f73-665a-4610-84b4-237b54ebffc1 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:13:07.872937 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-715b0f73-665a-4610-84b4-237b54ebffc1 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:13:07.873600 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-715b0f73-665a-4610-84b4-237b54ebffc1 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:13:07.874491 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-715b0f73-665a-4610-84b4-237b54ebffc1 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:13:07.875108 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-715b0f73-665a-4610-84b4-237b54ebffc1 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:13:07.875696 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-715b0f73-665a-4610-84b4-237b54ebffc1 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:13:07.942798 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-715b0f73-665a-4610-84b4-237b54ebffc1 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:13:07.953048 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-715b0f73-665a-4610-84b4-237b54ebffc1 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/1f95df19-4270-423d-8738-a749b9981006" status: 200 len: 1224 microversion: 2.1 time: 0.094079 Oct 19 04:13:07.953855 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3390/7252] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:13:07 2022] GET /compute/v2.1/servers/1f95df19-4270-423d-8738-a749b9981006 => generated 1224 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:13:08.977041 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e7cb8130-a2d0-4edf-b1fa-34da32e7e2e4 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:13:08.977824 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e7cb8130-a2d0-4edf-b1fa-34da32e7e2e4 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 1f95df19-4270-423d-8738-a749b9981006] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:13:08.985011 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e7cb8130-a2d0-4edf-b1fa-34da32e7e2e4 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:13:08.985650 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e7cb8130-a2d0-4edf-b1fa-34da32e7e2e4 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:13:08.986181 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e7cb8130-a2d0-4edf-b1fa-34da32e7e2e4 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:13:08.986970 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e7cb8130-a2d0-4edf-b1fa-34da32e7e2e4 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:13:08.987525 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e7cb8130-a2d0-4edf-b1fa-34da32e7e2e4 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:13:08.988040 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e7cb8130-a2d0-4edf-b1fa-34da32e7e2e4 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:13:09.054630 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e7cb8130-a2d0-4edf-b1fa-34da32e7e2e4 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:13:09.063389 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e7cb8130-a2d0-4edf-b1fa-34da32e7e2e4 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/1f95df19-4270-423d-8738-a749b9981006" status: 200 len: 1224 microversion: 2.1 time: 0.090378 Oct 19 04:13:09.063973 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3863/7253] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:13:08 2022] GET /compute/v2.1/servers/1f95df19-4270-423d-8738-a749b9981006 => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:13:10.087087 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d3c223d4-aa25-4119-b552-fe8a470c2f9f tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:13:10.087700 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d3c223d4-aa25-4119-b552-fe8a470c2f9f tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 1f95df19-4270-423d-8738-a749b9981006] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:13:10.095214 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d3c223d4-aa25-4119-b552-fe8a470c2f9f tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:13:10.095742 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d3c223d4-aa25-4119-b552-fe8a470c2f9f tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:13:10.096181 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d3c223d4-aa25-4119-b552-fe8a470c2f9f tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:13:10.096888 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d3c223d4-aa25-4119-b552-fe8a470c2f9f tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:13:10.097344 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d3c223d4-aa25-4119-b552-fe8a470c2f9f tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:13:10.097790 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d3c223d4-aa25-4119-b552-fe8a470c2f9f tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:13:10.163347 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d3c223d4-aa25-4119-b552-fe8a470c2f9f tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:13:10.171897 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d3c223d4-aa25-4119-b552-fe8a470c2f9f tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/1f95df19-4270-423d-8738-a749b9981006" status: 200 len: 1224 microversion: 2.1 time: 0.088701 Oct 19 04:13:10.172469 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3391/7254] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:13:10 2022] GET /compute/v2.1/servers/1f95df19-4270-423d-8738-a749b9981006 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:13:11.196757 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-62c3c5ac-eb5c-474a-8832-faee4e848bd4 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:13:11.197632 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-62c3c5ac-eb5c-474a-8832-faee4e848bd4 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 1f95df19-4270-423d-8738-a749b9981006] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:13:11.207998 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-62c3c5ac-eb5c-474a-8832-faee4e848bd4 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:13:11.208507 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-62c3c5ac-eb5c-474a-8832-faee4e848bd4 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:13:11.208975 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-62c3c5ac-eb5c-474a-8832-faee4e848bd4 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:13:11.209938 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-62c3c5ac-eb5c-474a-8832-faee4e848bd4 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:13:11.211012 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-62c3c5ac-eb5c-474a-8832-faee4e848bd4 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:13:11.211676 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-62c3c5ac-eb5c-474a-8832-faee4e848bd4 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:13:11.244989 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-62c3c5ac-eb5c-474a-8832-faee4e848bd4 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:13:11.246146 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-62c3c5ac-eb5c-474a-8832-faee4e848bd4 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:13:11.246978 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-62c3c5ac-eb5c-474a-8832-faee4e848bd4 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:13:11.247450 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-62c3c5ac-eb5c-474a-8832-faee4e848bd4 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lazy-loading 'fault' on Instance uuid 1f95df19-4270-423d-8738-a749b9981006 {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 04:13:11.295849 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-62c3c5ac-eb5c-474a-8832-faee4e848bd4 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30aa868d79473f9534bd79816c07e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beff434485604f85985617071a93727c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:13:11.305405 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-62c3c5ac-eb5c-474a-8832-faee4e848bd4 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/1f95df19-4270-423d-8738-a749b9981006" status: 200 len: 1229 microversion: 2.1 time: 0.114242 Oct 19 04:13:11.306787 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3864/7255] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:13:11 2022] GET /compute/v2.1/servers/1f95df19-4270-423d-8738-a749b9981006 => generated 1229 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:13:12.330202 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-38df5af8-6eb6-4212-8e7b-cc02b8a26064 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:13:12.330854 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-38df5af8-6eb6-4212-8e7b-cc02b8a26064 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 1f95df19-4270-423d-8738-a749b9981006] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:13:12.337917 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-38df5af8-6eb6-4212-8e7b-cc02b8a26064 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:13:12.338409 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-38df5af8-6eb6-4212-8e7b-cc02b8a26064 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:13:12.338852 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-38df5af8-6eb6-4212-8e7b-cc02b8a26064 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:13:12.340093 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-38df5af8-6eb6-4212-8e7b-cc02b8a26064 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:13:12.340553 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-38df5af8-6eb6-4212-8e7b-cc02b8a26064 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:13:12.340981 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-38df5af8-6eb6-4212-8e7b-cc02b8a26064 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:13:12.354238 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-38df5af8-6eb6-4212-8e7b-cc02b8a26064 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] HTTP exception thrown: Instance 1f95df19-4270-423d-8738-a749b9981006 could not be found. Oct 19 04:13:12.356534 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-38df5af8-6eb6-4212-8e7b-cc02b8a26064 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Request method failure captured: Oct 19 04:13:12.356534 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/1f95df19-4270-423d-8738-a749b9981006 HTTP/1.1 Oct 19 04:13:12.356534 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 04:13:12.356534 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 04:13:12.356534 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 04:13:12.356534 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 04:13:12.356534 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 04:13:12.356534 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 04:13:12.356534 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 04:13:12.356534 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 04:13:12.356534 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT3XYw5PeFcmVZaG2CxoqLxKroO9lkG-Hw7MzEkzHPy2_aqlf3HPBMKgLOXoQ-WbgkZbvZB1PbShR7FiiZmGSIVTCeQrWw3ytKpP-AuucJQP3lFFYEs8HquAFih6wwJOh2-3eNgmaxbIZUVh9y_A1g_wYecm08YmNoRnAnQnVYIDNRwE Oct 19 04:13:12.356534 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 04:13:12.356534 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 04:13:12.356534 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 04:13:12.356534 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 04:13:12.356534 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 04:13:12.356534 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 04:13:12.356534 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: beff434485604f85985617071a93727c Oct 19 04:13:12.356534 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-TestVolumeBootPattern-954873624 Oct 19 04:13:12.356534 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 04:13:12.356534 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 04:13:12.356534 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/beff434485604f85985617071a93727c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/beff434485604f85985617071a93727c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/beff434485604f85985617071a93727c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_beff434485604f85985617071a93727c", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 04:13:12.356534 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-TestVolumeBootPattern-954873624 Oct 19 04:13:12.356534 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: beff434485604f85985617071a93727c Oct 19 04:13:12.356534 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-TestVolumeBootPattern-954873624 Oct 19 04:13:12.356534 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-TestVolumeBootPattern-954873624-project Oct 19 04:13:12.356534 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 04:13:12.356534 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 04:13:12.356534 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 4d30aa868d79473f9534bd79816c07e3 Oct 19 04:13:12.356534 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-TestVolumeBootPattern-954873624-project Oct 19 04:13:12.356534 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 04:13:12.356534 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance 1f95df19-4270-423d-8738-a749b9981006 could not be found. Oct 19 04:13:12.356534 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '1f95df19-4270-423d-8738-a749b9981006'} Oct 19 04:13:12.356534 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 04:13:12.356534 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:13:12.356534 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 04:13:12.356534 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 04:13:12.356534 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 04:13:12.356534 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 04:13:12.356534 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 04:13:12.356534 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 04:13:12.356534 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 04:13:12.356534 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 04:13:12.356534 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f95df19-4270-423d-8738-a749b9981006 could not be found. Oct 19 04:13:12.356534 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:13:12.356534 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:13:12.356534 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:13:12.356534 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:13:12.356534 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:13:12.356534 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:13:12.356534 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 04:13:12.356534 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 04:13:12.356534 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 04:13:12.356534 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 04:13:12.356534 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 04:13:12.356534 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 04:13:12.356534 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 04:13:12.356534 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 04:13:12.356534 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 04:13:12.356534 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 04:13:12.356534 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f95df19-4270-423d-8738-a749b9981006 could not be found. Oct 19 04:13:12.356534 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:13:12.356534 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:13:12.356534 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:13:12.360765 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:13:12.360765 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:13:12.360765 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:13:12.360765 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 04:13:12.360765 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 04:13:12.360765 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f95df19-4270-423d-8738-a749b9981006 could not be found. Oct 19 04:13:12.360765 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:13:12.360765 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-38df5af8-6eb6-4212-8e7b-cc02b8a26064 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Returning 404 to user: Instance 1f95df19-4270-423d-8738-a749b9981006 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 04:13:12.360765 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-38df5af8-6eb6-4212-8e7b-cc02b8a26064 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/1f95df19-4270-423d-8738-a749b9981006" status: 404 len: 111 microversion: 2.1 time: 0.031774 Oct 19 04:13:12.360765 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3392/7256] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:13:12 2022] GET /compute/v2.1/servers/1f95df19-4270-423d-8738-a749b9981006 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 04:13:12.859072 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-eee12128-159d-4d82-8268-b101977fb777 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:13:12.860203 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-eee12128-159d-4d82-8268-b101977fb777 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:13:12.867500 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eee12128-159d-4d82-8268-b101977fb777 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:13:12.868018 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eee12128-159d-4d82-8268-b101977fb777 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:13:12.868490 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eee12128-159d-4d82-8268-b101977fb777 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:13:12.869230 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eee12128-159d-4d82-8268-b101977fb777 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:13:12.869752 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eee12128-159d-4d82-8268-b101977fb777 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:13:12.870205 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eee12128-159d-4d82-8268-b101977fb777 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:13:12.885687 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-eee12128-159d-4d82-8268-b101977fb777 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] HTTP exception thrown: Instance 9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56 could not be found. Oct 19 04:13:12.887837 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-eee12128-159d-4d82-8268-b101977fb777 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Request method failure captured: Oct 19 04:13:12.887837 n-d-861333-8 devstack@n-api.service[121134]: request: DELETE /compute/v2.1/servers/9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56 HTTP/1.1 Oct 19 04:13:12.887837 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 04:13:12.887837 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 04:13:12.887837 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 04:13:12.887837 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 04:13:12.887837 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 04:13:12.887837 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 04:13:12.887837 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 04:13:12.887837 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 04:13:12.887837 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3XYw5PeFcmVZaG2CxoqLxKroO9lkG-Hw7MzEkzHPy2_aqlf3HPBMKgLOXoQ-WbgkZbvZB1PbShR7FiiZmGSIVTCeQrWw3ytKpP-AuucJQP3lFFYEs8HquAFih6wwJOh2-3eNgmaxbIZUVh9y_A1g_wYecm08YmNoRnAnQnVYIDNRwE Oct 19 04:13:12.887837 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 04:13:12.887837 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 04:13:12.887837 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 04:13:12.887837 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 04:13:12.887837 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 04:13:12.887837 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 04:13:12.887837 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: beff434485604f85985617071a93727c Oct 19 04:13:12.887837 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-TestVolumeBootPattern-954873624 Oct 19 04:13:12.887837 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 04:13:12.887837 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 04:13:12.887837 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/beff434485604f85985617071a93727c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/beff434485604f85985617071a93727c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/beff434485604f85985617071a93727c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_beff434485604f85985617071a93727c", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 04:13:12.887837 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-TestVolumeBootPattern-954873624 Oct 19 04:13:12.887837 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: beff434485604f85985617071a93727c Oct 19 04:13:12.887837 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-TestVolumeBootPattern-954873624 Oct 19 04:13:12.887837 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-TestVolumeBootPattern-954873624-project Oct 19 04:13:12.887837 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 04:13:12.887837 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 04:13:12.887837 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 4d30aa868d79473f9534bd79816c07e3 Oct 19 04:13:12.887837 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-TestVolumeBootPattern-954873624-project Oct 19 04:13:12.887837 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 04:13:12.887837 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance 9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56 could not be found. Oct 19 04:13:12.887837 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56'} Oct 19 04:13:12.887837 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 04:13:12.887837 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:13:12.887837 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 04:13:12.887837 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 04:13:12.887837 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 04:13:12.887837 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 04:13:12.887837 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 04:13:12.887837 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 04:13:12.887837 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 04:13:12.887837 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 04:13:12.887837 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56 could not be found. Oct 19 04:13:12.887837 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:13:12.887837 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:13:12.887837 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:13:12.887837 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:13:12.887837 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:13:12.887837 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:13:12.887837 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 04:13:12.887837 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 04:13:12.887837 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 04:13:12.887837 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 04:13:12.887837 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 04:13:12.887837 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 04:13:12.887837 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 04:13:12.887837 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 04:13:12.887837 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 04:13:12.887837 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 04:13:12.887837 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 04:13:12.887837 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 04:13:12.891346 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56 could not be found. Oct 19 04:13:12.891346 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:13:12.891346 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:13:12.891346 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:13:12.891346 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:13:12.891346 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:13:12.891346 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:13:12.891346 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 04:13:12.891346 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 04:13:12.891346 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56 could not be found. Oct 19 04:13:12.891346 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:13:12.891346 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-eee12128-159d-4d82-8268-b101977fb777 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Returning 404 to user: Instance 9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 04:13:12.891346 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-eee12128-159d-4d82-8268-b101977fb777 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "DELETE /compute/v2.1/servers/9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56" status: 404 len: 111 microversion: 2.1 time: 0.034412 Oct 19 04:13:12.893197 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3865/7257] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 04:13:12 2022] DELETE /compute/v2.1/servers/9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 04:13:12.898892 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f8565115-028d-4b30-91b6-577181e89218 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:13:12.899837 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f8565115-028d-4b30-91b6-577181e89218 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [instance: 9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:13:12.906105 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f8565115-028d-4b30-91b6-577181e89218 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:13:12.906592 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f8565115-028d-4b30-91b6-577181e89218 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:13:12.907029 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f8565115-028d-4b30-91b6-577181e89218 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:13:12.907758 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f8565115-028d-4b30-91b6-577181e89218 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:13:12.908373 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f8565115-028d-4b30-91b6-577181e89218 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:13:12.909094 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f8565115-028d-4b30-91b6-577181e89218 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:13:12.922488 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-f8565115-028d-4b30-91b6-577181e89218 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] HTTP exception thrown: Instance 9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56 could not be found. Oct 19 04:13:12.924011 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f8565115-028d-4b30-91b6-577181e89218 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Request method failure captured: Oct 19 04:13:12.924011 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56 HTTP/1.1 Oct 19 04:13:12.924011 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 04:13:12.924011 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 04:13:12.924011 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 04:13:12.924011 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 04:13:12.924011 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 04:13:12.924011 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 04:13:12.924011 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 04:13:12.924011 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 04:13:12.924011 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT3XYw5PeFcmVZaG2CxoqLxKroO9lkG-Hw7MzEkzHPy2_aqlf3HPBMKgLOXoQ-WbgkZbvZB1PbShR7FiiZmGSIVTCeQrWw3ytKpP-AuucJQP3lFFYEs8HquAFih6wwJOh2-3eNgmaxbIZUVh9y_A1g_wYecm08YmNoRnAnQnVYIDNRwE Oct 19 04:13:12.924011 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 04:13:12.924011 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 04:13:12.924011 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 04:13:12.924011 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 04:13:12.924011 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 04:13:12.924011 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 04:13:12.924011 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: beff434485604f85985617071a93727c Oct 19 04:13:12.924011 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-TestVolumeBootPattern-954873624 Oct 19 04:13:12.924011 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 04:13:12.924011 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 04:13:12.924011 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/beff434485604f85985617071a93727c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/beff434485604f85985617071a93727c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/beff434485604f85985617071a93727c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_beff434485604f85985617071a93727c", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 04:13:12.924011 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-TestVolumeBootPattern-954873624 Oct 19 04:13:12.924011 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: beff434485604f85985617071a93727c Oct 19 04:13:12.924011 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-TestVolumeBootPattern-954873624 Oct 19 04:13:12.924011 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-TestVolumeBootPattern-954873624-project Oct 19 04:13:12.924011 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 04:13:12.924011 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 04:13:12.924011 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 4d30aa868d79473f9534bd79816c07e3 Oct 19 04:13:12.924011 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-TestVolumeBootPattern-954873624-project Oct 19 04:13:12.924011 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 04:13:12.924011 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance 9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56 could not be found. Oct 19 04:13:12.924011 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56'} Oct 19 04:13:12.924011 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 04:13:12.924011 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:13:12.924011 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 04:13:12.924011 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 04:13:12.924011 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 04:13:12.924011 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 04:13:12.924011 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 04:13:12.924011 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 04:13:12.924011 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 04:13:12.924011 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 04:13:12.924011 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56 could not be found. Oct 19 04:13:12.924011 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:13:12.924011 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:13:12.924011 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:13:12.924011 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:13:12.924011 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:13:12.924011 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:13:12.924011 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 04:13:12.924011 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 04:13:12.924011 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 04:13:12.924011 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 04:13:12.924011 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 04:13:12.924011 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 04:13:12.924011 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 04:13:12.924011 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 04:13:12.924011 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 04:13:12.924011 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 04:13:12.924011 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56 could not be found. Oct 19 04:13:12.924011 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:13:12.924011 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:13:12.924011 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:13:12.928286 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:13:12.928286 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:13:12.928286 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:13:12.928286 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 04:13:12.928286 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 04:13:12.928286 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56 could not be found. Oct 19 04:13:12.928286 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:13:12.928286 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f8565115-028d-4b30-91b6-577181e89218 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Returning 404 to user: Instance 9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 04:13:12.928286 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f8565115-028d-4b30-91b6-577181e89218 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "GET /compute/v2.1/servers/9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56" status: 404 len: 111 microversion: 2.1 time: 0.030989 Oct 19 04:13:12.928286 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3393/7258] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:13:12 2022] GET /compute/v2.1/servers/9ed4ff8d-3039-4d2c-8f6c-90e75ad02f56 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 04:13:16.543942 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2ae24927-11f6-4a9d-811f-1416d2194032 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] Calling method '.version_select at 0x7fc12b8f2dc0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:13:16.549006 n-d-861333-8 devstack@n-api.service[121134]: ERROR oslo.messaging._drivers.impl_rabbit [None req-2ae24927-11f6-4a9d-811f-1416d2194032 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [19b0d749-bd61-471f-8efc-e4b656063a84] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 19 04:13:17.558925 n-d-861333-8 devstack@n-api.service[121134]: INFO oslo.messaging._drivers.impl_rabbit [None req-2ae24927-11f6-4a9d-811f-1416d2194032 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] [19b0d749-bd61-471f-8efc-e4b656063a84] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 59988. Oct 19 04:13:17.642892 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2ae24927-11f6-4a9d-811f-1416d2194032 tempest-TestVolumeBootPattern-954873624 tempest-TestVolumeBootPattern-954873624-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-374641124" status: 202 len: 0 microversion: 2.1 time: 1.102880 Oct 19 04:13:17.643639 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3866/7259] 10.222.0.52 () {58 vars in 1260 bytes} [Wed Oct 19 04:13:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-374641124 => generated 0 bytes in 1104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 04:13:37.811129 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:13:37.811956 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:13:37.949006 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f4344ef3-e72c-4d2f-bec0-adee9e9e898a tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1750588375", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:13:38.003333 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.network.neutron [None req-f4344ef3-e72c-4d2f-bec0-adee9e9e898a tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] validate_networks() for None {{(pid=121135) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 04:13:38.279600 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-f4344ef3-e72c-4d2f-bec0-adee9e9e898a tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Flavor limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 04:13:38.280060 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-f4344ef3-e72c-4d2f-bec0-adee9e9e898a tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Image limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 04:13:38.280541 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-f4344ef3-e72c-4d2f-bec0-adee9e9e898a tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Flavor pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 04:13:38.280959 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-f4344ef3-e72c-4d2f-bec0-adee9e9e898a tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Image pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 04:13:38.281397 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-f4344ef3-e72c-4d2f-bec0-adee9e9e898a tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 04:13:38.293107 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f4344ef3-e72c-4d2f-bec0-adee9e9e898a tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:13:38.293627 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f4344ef3-e72c-4d2f-bec0-adee9e9e898a tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:13:38.294070 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f4344ef3-e72c-4d2f-bec0-adee9e9e898a tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:13:38.294803 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f4344ef3-e72c-4d2f-bec0-adee9e9e898a tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:13:38.295263 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f4344ef3-e72c-4d2f-bec0-adee9e9e898a tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:13:38.295697 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f4344ef3-e72c-4d2f-bec0-adee9e9e898a tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:13:38.315111 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-f4344ef3-e72c-4d2f-bec0-adee9e9e898a tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Getting quotas for project e72f06852d78468494ad79f82e55b374. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 04:13:38.320427 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-f4344ef3-e72c-4d2f-bec0-adee9e9e898a tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Getting quotas for user 88bb9eff08de46259eb19a5c87b12017 and project e72f06852d78468494ad79f82e55b374. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 04:13:38.333447 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f4344ef3-e72c-4d2f-bec0-adee9e9e898a tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Going to run 1 instances... {{(pid=121135) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 04:13:38.335772 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f4344ef3-e72c-4d2f-bec0-adee9e9e898a tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] [instance: bbecd10c-7823-4ede-b418-c3b2a3c4de36] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121135) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 04:13:38.454700 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f4344ef3-e72c-4d2f-bec0-adee9e9e898a tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.650112 Oct 19 04:13:38.455369 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3394/7260] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 04:13:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 651 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 04:13:38.465381 n-d-861333-8 devstack@n-api.service[121134]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Oct 19 04:13:38.467425 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=54 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:13:38.468307 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=29,nova_api:DELETE=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:13:38.472659 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-cfe78cc2-2300-4ce9-b92f-44dff82b5d79 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:13:38.473295 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-cfe78cc2-2300-4ce9-b92f-44dff82b5d79 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] [instance: bbecd10c-7823-4ede-b418-c3b2a3c4de36] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:13:38.528568 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-cfe78cc2-2300-4ce9-b92f-44dff82b5d79 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb9eff08de46259eb19a5c87b12017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72f06852d78468494ad79f82e55b374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:13:38.539151 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-cfe78cc2-2300-4ce9-b92f-44dff82b5d79 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] 10.222.0.52 "GET /compute/v2.1/servers/bbecd10c-7823-4ede-b418-c3b2a3c4de36" status: 200 len: 1222 microversion: 2.1 time: 0.075063 Oct 19 04:13:38.539804 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3867/7261] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:13:38 2022] GET /compute/v2.1/servers/bbecd10c-7823-4ede-b418-c3b2a3c4de36 => generated 1222 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:13:39.563387 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c74c6c6c-b1d9-4d99-b311-68fc6afc92b5 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:13:39.563933 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c74c6c6c-b1d9-4d99-b311-68fc6afc92b5 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] [instance: bbecd10c-7823-4ede-b418-c3b2a3c4de36] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:13:39.570060 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c74c6c6c-b1d9-4d99-b311-68fc6afc92b5 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:13:39.570554 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c74c6c6c-b1d9-4d99-b311-68fc6afc92b5 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:13:39.570999 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c74c6c6c-b1d9-4d99-b311-68fc6afc92b5 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:13:39.571696 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c74c6c6c-b1d9-4d99-b311-68fc6afc92b5 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:13:39.572160 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c74c6c6c-b1d9-4d99-b311-68fc6afc92b5 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:13:39.572595 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c74c6c6c-b1d9-4d99-b311-68fc6afc92b5 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:13:39.633973 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c74c6c6c-b1d9-4d99-b311-68fc6afc92b5 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb9eff08de46259eb19a5c87b12017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72f06852d78468494ad79f82e55b374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:13:39.642425 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c74c6c6c-b1d9-4d99-b311-68fc6afc92b5 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] 10.222.0.52 "GET /compute/v2.1/servers/bbecd10c-7823-4ede-b418-c3b2a3c4de36" status: 200 len: 1226 microversion: 2.1 time: 0.083979 Oct 19 04:13:39.643202 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3395/7262] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:13:39 2022] GET /compute/v2.1/servers/bbecd10c-7823-4ede-b418-c3b2a3c4de36 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:13:40.668048 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-98b6cbee-7133-42d8-bb90-20a2da2c6f58 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:13:40.668679 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-98b6cbee-7133-42d8-bb90-20a2da2c6f58 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] [instance: bbecd10c-7823-4ede-b418-c3b2a3c4de36] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:13:40.675424 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-98b6cbee-7133-42d8-bb90-20a2da2c6f58 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:13:40.677955 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-98b6cbee-7133-42d8-bb90-20a2da2c6f58 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:13:40.677955 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-98b6cbee-7133-42d8-bb90-20a2da2c6f58 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:13:40.677955 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-98b6cbee-7133-42d8-bb90-20a2da2c6f58 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:13:40.677955 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-98b6cbee-7133-42d8-bb90-20a2da2c6f58 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:13:40.678429 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-98b6cbee-7133-42d8-bb90-20a2da2c6f58 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:13:40.744115 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-98b6cbee-7133-42d8-bb90-20a2da2c6f58 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb9eff08de46259eb19a5c87b12017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72f06852d78468494ad79f82e55b374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:13:40.751930 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-98b6cbee-7133-42d8-bb90-20a2da2c6f58 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] 10.222.0.52 "GET /compute/v2.1/servers/bbecd10c-7823-4ede-b418-c3b2a3c4de36" status: 200 len: 1274 microversion: 2.1 time: 0.088846 Oct 19 04:13:40.752496 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3868/7263] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:13:40 2022] GET /compute/v2.1/servers/bbecd10c-7823-4ede-b418-c3b2a3c4de36 => generated 1274 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:13:41.774923 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-46fe8d4e-7712-46a4-9f5b-d242afe1c2d7 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:13:41.775552 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-46fe8d4e-7712-46a4-9f5b-d242afe1c2d7 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] [instance: bbecd10c-7823-4ede-b418-c3b2a3c4de36] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:13:41.782587 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-46fe8d4e-7712-46a4-9f5b-d242afe1c2d7 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:13:41.783084 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-46fe8d4e-7712-46a4-9f5b-d242afe1c2d7 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:13:41.783531 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-46fe8d4e-7712-46a4-9f5b-d242afe1c2d7 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:13:41.784240 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-46fe8d4e-7712-46a4-9f5b-d242afe1c2d7 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:13:41.784700 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-46fe8d4e-7712-46a4-9f5b-d242afe1c2d7 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:13:41.785130 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-46fe8d4e-7712-46a4-9f5b-d242afe1c2d7 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:13:41.977049 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-46fe8d4e-7712-46a4-9f5b-d242afe1c2d7 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb9eff08de46259eb19a5c87b12017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72f06852d78468494ad79f82e55b374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:13:41.986429 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-46fe8d4e-7712-46a4-9f5b-d242afe1c2d7 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] 10.222.0.52 "GET /compute/v2.1/servers/bbecd10c-7823-4ede-b418-c3b2a3c4de36" status: 200 len: 1322 microversion: 2.1 time: 0.215616 Oct 19 04:13:41.990672 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3396/7264] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:13:41 2022] GET /compute/v2.1/servers/bbecd10c-7823-4ede-b418-c3b2a3c4de36 => generated 1322 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:13:42.778774 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-d75280ea-a48f-4830-ad59-61ac07e3ed54 req-83c37666-202a-482f-b1d6-d08d1dc2b4b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbecd10c-7823-4ede-b418-c3b2a3c4de36", "tag": "7d3e4367-1b34-4834-9723-32a878c14e08"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:13:42.789673 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-d75280ea-a48f-4830-ad59-61ac07e3ed54 req-83c37666-202a-482f-b1d6-d08d1dc2b4b5 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:13:42.790289 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-d75280ea-a48f-4830-ad59-61ac07e3ed54 req-83c37666-202a-482f-b1d6-d08d1dc2b4b5 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:13:42.790812 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-d75280ea-a48f-4830-ad59-61ac07e3ed54 req-83c37666-202a-482f-b1d6-d08d1dc2b4b5 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:13:42.801958 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-d75280ea-a48f-4830-ad59-61ac07e3ed54 req-83c37666-202a-482f-b1d6-d08d1dc2b4b5 service nova] Creating event network-changed:7d3e4367-1b34-4834-9723-32a878c14e08 for instance bbecd10c-7823-4ede-b418-c3b2a3c4de36 on n-h2-861333-8 Oct 19 04:13:42.807020 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-d75280ea-a48f-4830-ad59-61ac07e3ed54 req-83c37666-202a-482f-b1d6-d08d1dc2b4b5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032737 Oct 19 04:13:42.808117 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3869/7265] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:13:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:13:43.010171 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-acb687cb-958c-4788-b35e-8f057f37d8bf tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:13:43.011442 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-acb687cb-958c-4788-b35e-8f057f37d8bf tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] [instance: bbecd10c-7823-4ede-b418-c3b2a3c4de36] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:13:43.018332 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-acb687cb-958c-4788-b35e-8f057f37d8bf tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:13:43.018817 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-acb687cb-958c-4788-b35e-8f057f37d8bf tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:13:43.019255 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-acb687cb-958c-4788-b35e-8f057f37d8bf tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:13:43.019956 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-acb687cb-958c-4788-b35e-8f057f37d8bf tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:13:43.020412 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-acb687cb-958c-4788-b35e-8f057f37d8bf tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:13:43.020844 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-acb687cb-958c-4788-b35e-8f057f37d8bf tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:13:43.240631 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-acb687cb-958c-4788-b35e-8f057f37d8bf tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb9eff08de46259eb19a5c87b12017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72f06852d78468494ad79f82e55b374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:13:43.249633 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-acb687cb-958c-4788-b35e-8f057f37d8bf tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] 10.222.0.52 "GET /compute/v2.1/servers/bbecd10c-7823-4ede-b418-c3b2a3c4de36" status: 200 len: 1322 microversion: 2.1 time: 0.243238 Oct 19 04:13:43.250223 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3397/7266] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:13:43 2022] GET /compute/v2.1/servers/bbecd10c-7823-4ede-b418-c3b2a3c4de36 => generated 1322 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:13:44.273557 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ba6b2dc4-da0d-40f3-8a3b-a3536fa7016f tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:13:44.274196 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ba6b2dc4-da0d-40f3-8a3b-a3536fa7016f tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] [instance: bbecd10c-7823-4ede-b418-c3b2a3c4de36] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:13:44.281027 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ba6b2dc4-da0d-40f3-8a3b-a3536fa7016f tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:13:44.281578 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ba6b2dc4-da0d-40f3-8a3b-a3536fa7016f tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:13:44.282039 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ba6b2dc4-da0d-40f3-8a3b-a3536fa7016f tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:13:44.282746 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ba6b2dc4-da0d-40f3-8a3b-a3536fa7016f tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:13:44.283222 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ba6b2dc4-da0d-40f3-8a3b-a3536fa7016f tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:13:44.283724 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ba6b2dc4-da0d-40f3-8a3b-a3536fa7016f tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:13:44.418396 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ba6b2dc4-da0d-40f3-8a3b-a3536fa7016f tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb9eff08de46259eb19a5c87b12017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72f06852d78468494ad79f82e55b374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:13:44.426307 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ba6b2dc4-da0d-40f3-8a3b-a3536fa7016f tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] 10.222.0.52 "GET /compute/v2.1/servers/bbecd10c-7823-4ede-b418-c3b2a3c4de36" status: 200 len: 1322 microversion: 2.1 time: 0.158194 Oct 19 04:13:44.427005 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3870/7267] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:13:44 2022] GET /compute/v2.1/servers/bbecd10c-7823-4ede-b418-c3b2a3c4de36 => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:13:45.450056 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-654fa981-e4ae-4e4f-82df-22fa0e1378b6 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:13:45.450668 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-654fa981-e4ae-4e4f-82df-22fa0e1378b6 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] [instance: bbecd10c-7823-4ede-b418-c3b2a3c4de36] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:13:45.457395 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-654fa981-e4ae-4e4f-82df-22fa0e1378b6 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:13:45.457871 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-654fa981-e4ae-4e4f-82df-22fa0e1378b6 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:13:45.458302 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-654fa981-e4ae-4e4f-82df-22fa0e1378b6 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:13:45.459096 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-654fa981-e4ae-4e4f-82df-22fa0e1378b6 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:13:45.459552 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-654fa981-e4ae-4e4f-82df-22fa0e1378b6 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:13:45.459978 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-654fa981-e4ae-4e4f-82df-22fa0e1378b6 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:13:45.587819 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-654fa981-e4ae-4e4f-82df-22fa0e1378b6 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb9eff08de46259eb19a5c87b12017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72f06852d78468494ad79f82e55b374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:13:45.596397 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-654fa981-e4ae-4e4f-82df-22fa0e1378b6 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] 10.222.0.52 "GET /compute/v2.1/servers/bbecd10c-7823-4ede-b418-c3b2a3c4de36" status: 200 len: 1322 microversion: 2.1 time: 0.150613 Oct 19 04:13:45.596992 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3398/7268] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:13:45 2022] GET /compute/v2.1/servers/bbecd10c-7823-4ede-b418-c3b2a3c4de36 => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:13:46.620224 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9b70a927-0720-49bb-bc15-8801a731ae86 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:13:46.620224 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9b70a927-0720-49bb-bc15-8801a731ae86 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] [instance: bbecd10c-7823-4ede-b418-c3b2a3c4de36] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:13:46.626895 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9b70a927-0720-49bb-bc15-8801a731ae86 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:13:46.627405 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9b70a927-0720-49bb-bc15-8801a731ae86 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:13:46.627869 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9b70a927-0720-49bb-bc15-8801a731ae86 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:13:46.628620 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9b70a927-0720-49bb-bc15-8801a731ae86 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:13:46.629145 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9b70a927-0720-49bb-bc15-8801a731ae86 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:13:46.629628 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9b70a927-0720-49bb-bc15-8801a731ae86 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:13:46.762828 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9b70a927-0720-49bb-bc15-8801a731ae86 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb9eff08de46259eb19a5c87b12017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72f06852d78468494ad79f82e55b374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:13:46.770659 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9b70a927-0720-49bb-bc15-8801a731ae86 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] 10.222.0.52 "GET /compute/v2.1/servers/bbecd10c-7823-4ede-b418-c3b2a3c4de36" status: 200 len: 1322 microversion: 2.1 time: 0.155595 Oct 19 04:13:46.771256 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3871/7269] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:13:46 2022] GET /compute/v2.1/servers/bbecd10c-7823-4ede-b418-c3b2a3c4de36 => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:13:47.759408 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-72dbbf81-855a-45fd-8b65-35317bba6f9d req-c21098f9-4e5a-4adb-96dc-cc15b1e25d39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbecd10c-7823-4ede-b418-c3b2a3c4de36", "name": "network-vif-plugged", "status": "completed", "tag": "7d3e4367-1b34-4834-9723-32a878c14e08"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:13:47.770339 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-72dbbf81-855a-45fd-8b65-35317bba6f9d req-c21098f9-4e5a-4adb-96dc-cc15b1e25d39 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:13:47.770821 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-72dbbf81-855a-45fd-8b65-35317bba6f9d req-c21098f9-4e5a-4adb-96dc-cc15b1e25d39 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:13:47.771408 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-72dbbf81-855a-45fd-8b65-35317bba6f9d req-c21098f9-4e5a-4adb-96dc-cc15b1e25d39 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:13:47.782902 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-72dbbf81-855a-45fd-8b65-35317bba6f9d req-c21098f9-4e5a-4adb-96dc-cc15b1e25d39 service nova] Creating event network-vif-plugged:7d3e4367-1b34-4834-9723-32a878c14e08 for instance bbecd10c-7823-4ede-b418-c3b2a3c4de36 on n-h2-861333-8 Oct 19 04:13:47.787820 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-72dbbf81-855a-45fd-8b65-35317bba6f9d req-c21098f9-4e5a-4adb-96dc-cc15b1e25d39 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032185 Oct 19 04:13:47.788408 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3399/7270] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:13:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:13:47.794161 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9d5a1e98-1e13-4112-abb3-367473bc6e14 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:13:47.798421 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9d5a1e98-1e13-4112-abb3-367473bc6e14 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] [instance: bbecd10c-7823-4ede-b418-c3b2a3c4de36] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:13:47.801299 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9d5a1e98-1e13-4112-abb3-367473bc6e14 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:13:47.801948 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9d5a1e98-1e13-4112-abb3-367473bc6e14 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:13:47.802409 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9d5a1e98-1e13-4112-abb3-367473bc6e14 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:13:47.803196 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9d5a1e98-1e13-4112-abb3-367473bc6e14 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:13:47.803710 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9d5a1e98-1e13-4112-abb3-367473bc6e14 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:13:47.804163 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9d5a1e98-1e13-4112-abb3-367473bc6e14 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:13:47.992969 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9d5a1e98-1e13-4112-abb3-367473bc6e14 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb9eff08de46259eb19a5c87b12017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72f06852d78468494ad79f82e55b374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:13:48.000802 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9d5a1e98-1e13-4112-abb3-367473bc6e14 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] 10.222.0.52 "GET /compute/v2.1/servers/bbecd10c-7823-4ede-b418-c3b2a3c4de36" status: 200 len: 1322 microversion: 2.1 time: 0.210524 Oct 19 04:13:48.001417 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3872/7271] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:13:47 2022] GET /compute/v2.1/servers/bbecd10c-7823-4ede-b418-c3b2a3c4de36 => generated 1322 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:13:49.021478 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:13:49.022209 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=6 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:13:49.027850 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1771a43b-554c-4333-b558-1c2b5390665b tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:13:49.028560 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1771a43b-554c-4333-b558-1c2b5390665b tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] [instance: bbecd10c-7823-4ede-b418-c3b2a3c4de36] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:13:49.034646 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1771a43b-554c-4333-b558-1c2b5390665b tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:13:49.035134 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1771a43b-554c-4333-b558-1c2b5390665b tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:13:49.035580 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1771a43b-554c-4333-b558-1c2b5390665b tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:13:49.036274 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1771a43b-554c-4333-b558-1c2b5390665b tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:13:49.036732 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1771a43b-554c-4333-b558-1c2b5390665b tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:13:49.037163 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1771a43b-554c-4333-b558-1c2b5390665b tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:13:49.172299 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-1771a43b-554c-4333-b558-1c2b5390665b tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb9eff08de46259eb19a5c87b12017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72f06852d78468494ad79f82e55b374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:13:49.180077 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1771a43b-554c-4333-b558-1c2b5390665b tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] 10.222.0.52 "GET /compute/v2.1/servers/bbecd10c-7823-4ede-b418-c3b2a3c4de36" status: 200 len: 1322 microversion: 2.1 time: 0.159721 Oct 19 04:13:49.180652 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3400/7272] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:13:49 2022] GET /compute/v2.1/servers/bbecd10c-7823-4ede-b418-c3b2a3c4de36 => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:13:50.202954 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-40c7df18-6f5d-45b1-81e2-f0f5f376a2bd tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:13:50.203614 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-40c7df18-6f5d-45b1-81e2-f0f5f376a2bd tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] [instance: bbecd10c-7823-4ede-b418-c3b2a3c4de36] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:13:50.205755 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:13:50.211393 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-40c7df18-6f5d-45b1-81e2-f0f5f376a2bd tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:13:50.211903 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-40c7df18-6f5d-45b1-81e2-f0f5f376a2bd tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:13:50.212367 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-40c7df18-6f5d-45b1-81e2-f0f5f376a2bd tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:13:50.213081 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-40c7df18-6f5d-45b1-81e2-f0f5f376a2bd tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:13:50.213595 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-40c7df18-6f5d-45b1-81e2-f0f5f376a2bd tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:13:50.214044 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-40c7df18-6f5d-45b1-81e2-f0f5f376a2bd tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:13:50.342719 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-40c7df18-6f5d-45b1-81e2-f0f5f376a2bd tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb9eff08de46259eb19a5c87b12017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72f06852d78468494ad79f82e55b374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:13:50.350732 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-40c7df18-6f5d-45b1-81e2-f0f5f376a2bd tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] 10.222.0.52 "GET /compute/v2.1/servers/bbecd10c-7823-4ede-b418-c3b2a3c4de36" status: 200 len: 1471 microversion: 2.1 time: 0.151716 Oct 19 04:13:50.351314 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3873/7273] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:13:50 2022] GET /compute/v2.1/servers/bbecd10c-7823-4ede-b418-c3b2a3c4de36 => generated 1471 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:13:50.423687 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f1e61e6a-7f32-42e5-b569-39866a430a22 tempest-ServersAdminNegativeTestJSON-823470194 tempest-ServersAdminNegativeTestJSON-823470194-project-admin] Calling method '.version_select at 0x7fc12b8c7ca0>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:13:50.487752 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f1e61e6a-7f32-42e5-b569-39866a430a22 tempest-ServersAdminNegativeTestJSON-823470194 tempest-ServersAdminNegativeTestJSON-823470194-project-admin] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/1d7856af4bef4f4ba1de5dcde7d8d3fd" status: 200 len: 371 microversion: 2.1 time: 0.115494 Oct 19 04:13:50.488323 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3401/7274] 10.222.0.52 () {58 vars in 1242 bytes} [Wed Oct 19 04:13:50 2022] GET /compute/v2.1/os-quota-sets/1d7856af4bef4f4ba1de5dcde7d8d3fd => generated 371 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:13:50.500120 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-51893ae4-cd73-445f-97cf-c5aa31c0664a tempest-ServersAdminNegativeTestJSON-823470194 tempest-ServersAdminNegativeTestJSON-823470194-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1927861640", "id": 1599469444, "os-flavor-access:is_public": "True"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:13:50.601031 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-51893ae4-cd73-445f-97cf-c5aa31c0664a tempest-ServersAdminNegativeTestJSON-823470194 tempest-ServersAdminNegativeTestJSON-823470194-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.104555 Oct 19 04:13:50.601646 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3874/7275] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 04:13:50 2022] POST /compute/v2.1/flavors => generated 438 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:13:50.614617 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e3bdc22d-e2cd-4fe4-873b-55192c91c738 tempest-ServersAdminNegativeTestJSON-823470194 tempest-ServersAdminNegativeTestJSON-823470194-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1599469444"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:13:50.616982 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e3bdc22d-e2cd-4fe4-873b-55192c91c738 tempest-ServersAdminNegativeTestJSON-823470194 tempest-ServersAdminNegativeTestJSON-823470194-project-admin] [instance: bbecd10c-7823-4ede-b418-c3b2a3c4de36] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:13:50.622914 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e3bdc22d-e2cd-4fe4-873b-55192c91c738 tempest-ServersAdminNegativeTestJSON-823470194 tempest-ServersAdminNegativeTestJSON-823470194-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:13:50.626182 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e3bdc22d-e2cd-4fe4-873b-55192c91c738 tempest-ServersAdminNegativeTestJSON-823470194 tempest-ServersAdminNegativeTestJSON-823470194-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:13:50.626182 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e3bdc22d-e2cd-4fe4-873b-55192c91c738 tempest-ServersAdminNegativeTestJSON-823470194 tempest-ServersAdminNegativeTestJSON-823470194-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:13:50.626182 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e3bdc22d-e2cd-4fe4-873b-55192c91c738 tempest-ServersAdminNegativeTestJSON-823470194 tempest-ServersAdminNegativeTestJSON-823470194-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:13:50.626182 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e3bdc22d-e2cd-4fe4-873b-55192c91c738 tempest-ServersAdminNegativeTestJSON-823470194 tempest-ServersAdminNegativeTestJSON-823470194-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:13:50.626182 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e3bdc22d-e2cd-4fe4-873b-55192c91c738 tempest-ServersAdminNegativeTestJSON-823470194 tempest-ServersAdminNegativeTestJSON-823470194-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:13:50.830978 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-e3bdc22d-e2cd-4fe4-873b-55192c91c738 tempest-ServersAdminNegativeTestJSON-823470194 tempest-ServersAdminNegativeTestJSON-823470194-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'e7e434795a3643f3ad175774e60f2aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7856af4bef4f4ba1de5dcde7d8d3fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:13:50.837232 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e3bdc22d-e2cd-4fe4-873b-55192c91c738 tempest-ServersAdminNegativeTestJSON-823470194 tempest-ServersAdminNegativeTestJSON-823470194-project-admin] [instance: bbecd10c-7823-4ede-b418-c3b2a3c4de36] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1927861640 {{(pid=121135) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 19 04:13:50.844511 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e3bdc22d-e2cd-4fe4-873b-55192c91c738 tempest-ServersAdminNegativeTestJSON-823470194 tempest-ServersAdminNegativeTestJSON-823470194-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:13:50.844996 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e3bdc22d-e2cd-4fe4-873b-55192c91c738 tempest-ServersAdminNegativeTestJSON-823470194 tempest-ServersAdminNegativeTestJSON-823470194-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:13:50.845468 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e3bdc22d-e2cd-4fe4-873b-55192c91c738 tempest-ServersAdminNegativeTestJSON-823470194 tempest-ServersAdminNegativeTestJSON-823470194-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:13:50.846196 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e3bdc22d-e2cd-4fe4-873b-55192c91c738 tempest-ServersAdminNegativeTestJSON-823470194 tempest-ServersAdminNegativeTestJSON-823470194-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:13:50.846656 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e3bdc22d-e2cd-4fe4-873b-55192c91c738 tempest-ServersAdminNegativeTestJSON-823470194 tempest-ServersAdminNegativeTestJSON-823470194-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:13:50.847086 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e3bdc22d-e2cd-4fe4-873b-55192c91c738 tempest-ServersAdminNegativeTestJSON-823470194 tempest-ServersAdminNegativeTestJSON-823470194-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:13:50.867039 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-e3bdc22d-e2cd-4fe4-873b-55192c91c738 tempest-ServersAdminNegativeTestJSON-823470194 tempest-ServersAdminNegativeTestJSON-823470194-project-admin] Getting quotas for project e72f06852d78468494ad79f82e55b374. Resources: {'cores', 'ram'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 04:13:50.872039 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-e3bdc22d-e2cd-4fe4-873b-55192c91c738 tempest-ServersAdminNegativeTestJSON-823470194 tempest-ServersAdminNegativeTestJSON-823470194-project-admin] Getting quotas for user 88bb9eff08de46259eb19a5c87b12017 and project e72f06852d78468494ad79f82e55b374. Resources: {'cores', 'ram'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 04:13:50.883909 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.compute.api [None req-e3bdc22d-e2cd-4fe4-873b-55192c91c738 tempest-ServersAdminNegativeTestJSON-823470194 tempest-ServersAdminNegativeTestJSON-823470194-project-admin] ram quota exceeded for 1d7856af4bef4f4ba1de5dcde7d8d3fd, tried to resize instance. Oct 19 04:13:50.884455 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-e3bdc22d-e2cd-4fe4-873b-55192c91c738 tempest-ServersAdminNegativeTestJSON-823470194 tempest-ServersAdminNegativeTestJSON-823470194-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 19 04:13:50.887012 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e3bdc22d-e2cd-4fe4-873b-55192c91c738 tempest-ServersAdminNegativeTestJSON-823470194 tempest-ServersAdminNegativeTestJSON-823470194-project-admin] Request method failure captured: Oct 19 04:13:50.887012 n-d-861333-8 devstack@n-api.service[121135]: request: POST /compute/v2.1/servers/bbecd10c-7823-4ede-b418-c3b2a3c4de36/action HTTP/1.1 Oct 19 04:13:50.887012 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 04:13:50.887012 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 04:13:50.887012 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 04:13:50.887012 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 39 Oct 19 04:13:50.887012 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 04:13:50.887012 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 04:13:50.887012 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 04:13:50.887012 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 04:13:50.887012 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT3lxS9V1ujCnVvHiT-h5y8ko4jas_BmILzql089_6Y-p9rKbcQsYUiRL_yzFdtlPV6rsMw8T585-ju2UY6rbFAhJe1slR58Smpz_AMKb7YDQ2WcEgdkrWKI23X6wIpDMIsCcMcGd6Kh9gEuRMj3fSS2UR0vg-BMpfVPDI--JlBx4JLQ Oct 19 04:13:50.887012 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 04:13:50.887012 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 04:13:50.887012 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 04:13:50.887012 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 04:13:50.887012 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 04:13:50.887012 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 04:13:50.887012 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 1d7856af4bef4f4ba1de5dcde7d8d3fd Oct 19 04:13:50.887012 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-823470194 Oct 19 04:13:50.887012 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member,admin Oct 19 04:13:50.887012 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member,admin Oct 19 04:13:50.887012 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1d7856af4bef4f4ba1de5dcde7d8d3fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1d7856af4bef4f4ba1de5dcde7d8d3fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1d7856af4bef4f4ba1de5dcde7d8d3fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1d7856af4bef4f4ba1de5dcde7d8d3fd", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 04:13:50.887012 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ServersAdminNegativeTestJSON-823470194 Oct 19 04:13:50.887012 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 1d7856af4bef4f4ba1de5dcde7d8d3fd Oct 19 04:13:50.887012 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-823470194 Oct 19 04:13:50.887012 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ServersAdminNegativeTestJSON-823470194-project-admin Oct 19 04:13:50.887012 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 04:13:50.887012 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 04:13:50.887012 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: e7e434795a3643f3ad175774e60f2aa0 Oct 19 04:13:50.887012 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ServersAdminNegativeTestJSON-823470194-project-admin Oct 19 04:13:50.887012 n-d-861333-8 devstack@n-api.service[121135]: Oct 19 04:13:50.887012 n-d-861333-8 devstack@n-api.service[121135]: {"resize": {"flavorRef": "1599469444"}} Oct 19 04:13:50.887012 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 04:13:50.887012 n-d-861333-8 devstack@n-api.service[121135]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 19 04:13:50.887012 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': 'bbecd10c-7823-4ede-b418-c3b2a3c4de36', 'body': {'resize': {'flavorRef': '1599469444'}}} Oct 19 04:13:50.887012 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 04:13:50.887012 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:13:50.887012 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Oct 19 04:13:50.887012 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 19 04:13:50.887012 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 04:13:50.887012 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 04:13:50.887012 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 19 04:13:50.887012 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc Oct 19 04:13:50.887012 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 19 04:13:50.887012 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 19 04:13:50.887012 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 04:13:50.887012 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 04:13:50.887012 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 19 04:13:50.887012 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 19 04:13:50.887012 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 19 04:13:50.887012 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 19 04:13:50.887012 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 19 04:13:50.887012 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 19 04:13:50.887012 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 19 04:13:50.887012 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:13:50.887012 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:13:50.887012 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:13:50.887012 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:13:50.887012 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 19 04:13:50.887012 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 19 04:13:50.887012 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 19 04:13:50.887012 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 19 04:13:50.887012 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 19 04:13:50.891231 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 19 04:13:50.891231 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 19 04:13:50.891231 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 19 04:13:50.891231 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 19 04:13:50.891231 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 19 04:13:50.891231 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 19 04:13:50.891231 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 19 04:13:50.891231 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 19 04:13:50.891231 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 19 04:13:50.891231 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Oct 19 04:13:50.891231 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 19 04:13:50.891231 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Oct 19 04:13:50.891231 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 19 04:13:50.891231 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 19 04:13:50.891231 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:13:50.891231 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:13:50.891231 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:13:50.891231 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:13:50.891231 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:13:50.891231 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:13:50.891231 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 04:13:50.891231 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 04:13:50.891231 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 04:13:50.891231 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 04:13:50.891231 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 04:13:50.891231 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 04:13:50.891231 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 19 04:13:50.891231 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 19 04:13:50.891231 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 19 04:13:50.891231 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 19 04:13:50.891231 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 19 04:13:50.891231 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:13:50.891231 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:13:50.891231 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:13:50.891231 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:13:50.891231 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:13:50.891231 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:13:50.891231 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 04:13:50.891231 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 04:13:50.891231 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 19 04:13:50.891231 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:13:50.891231 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e3bdc22d-e2cd-4fe4-873b-55192c91c738 tempest-ServersAdminNegativeTestJSON-823470194 tempest-ServersAdminNegativeTestJSON-823470194-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 04:13:50.891231 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e3bdc22d-e2cd-4fe4-873b-55192c91c738 tempest-ServersAdminNegativeTestJSON-823470194 tempest-ServersAdminNegativeTestJSON-823470194-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/bbecd10c-7823-4ede-b418-c3b2a3c4de36/action" status: 403 len: 118 microversion: 2.1 time: 0.277647 Oct 19 04:13:50.891231 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3402/7276] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 04:13:50 2022] POST /compute/v2.1/servers/bbecd10c-7823-4ede-b418-c3b2a3c4de36/action => generated 118 bytes in 279 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 19 04:13:50.897428 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4f2d3e88-f5df-47ef-9967-2ac1bee28617 tempest-ServersAdminNegativeTestJSON-823470194 tempest-ServersAdminNegativeTestJSON-823470194-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:13:50.955025 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4f2d3e88-f5df-47ef-9967-2ac1bee28617 tempest-ServersAdminNegativeTestJSON-823470194 tempest-ServersAdminNegativeTestJSON-823470194-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/1599469444" status: 202 len: 0 microversion: 2.1 time: 0.061074 Oct 19 04:13:50.955726 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3875/7277] 10.222.0.52 () {58 vars in 1161 bytes} [Wed Oct 19 04:13:50 2022] DELETE /compute/v2.1/flavors/1599469444 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 04:13:50.963407 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7d81c0b5-07ff-4405-b2f9-f04db1e9dfe1 tempest-ServersAdminNegativeTestJSON-823470194 tempest-ServersAdminNegativeTestJSON-823470194-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:13:50.984208 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7d81c0b5-07ff-4405-b2f9-f04db1e9dfe1 tempest-ServersAdminNegativeTestJSON-823470194 tempest-ServersAdminNegativeTestJSON-823470194-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024404 Oct 19 04:13:50.984761 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3403/7278] 10.222.0.52 () {58 vars in 1146 bytes} [Wed Oct 19 04:13:50 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:13:51.005232 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e2b0059d-80b6-44bc-ba73-66ce5d8b2331 tempest-ServersAdminNegativeTestJSON-823470194 tempest-ServersAdminNegativeTestJSON-823470194-project-admin] Calling method '.version_select at 0x7fc1280773a0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:13:51.078517 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e2b0059d-80b6-44bc-ba73-66ce5d8b2331 tempest-ServersAdminNegativeTestJSON-823470194 tempest-ServersAdminNegativeTestJSON-823470194-project-admin] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/1d7856af4bef4f4ba1de5dcde7d8d3fd" status: 200 len: 371 microversion: 2.1 time: 0.076895 Oct 19 04:13:51.079132 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3876/7279] 10.222.0.52 () {58 vars in 1242 bytes} [Wed Oct 19 04:13:51 2022] GET /compute/v2.1/os-quota-sets/1d7856af4bef4f4ba1de5dcde7d8d3fd => generated 371 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 04:13:51.091146 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-225cc3b8-58c5-4a9c-9007-708a5095f291 tempest-ServersAdminNegativeTestJSON-823470194 tempest-ServersAdminNegativeTestJSON-823470194-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-669247794", "id": 2000130406, "os-flavor-access:is_public": "True"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:13:51.165432 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-225cc3b8-58c5-4a9c-9007-708a5095f291 tempest-ServersAdminNegativeTestJSON-823470194 tempest-ServersAdminNegativeTestJSON-823470194-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.078169 Oct 19 04:13:51.166028 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3404/7280] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 04:13:51 2022] POST /compute/v2.1/flavors => generated 436 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:13:51.178032 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e147dd40-734f-4222-bd00-4910fa4fec69 tempest-ServersAdminNegativeTestJSON-823470194 tempest-ServersAdminNegativeTestJSON-823470194-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "2000130406"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:13:51.180387 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e147dd40-734f-4222-bd00-4910fa4fec69 tempest-ServersAdminNegativeTestJSON-823470194 tempest-ServersAdminNegativeTestJSON-823470194-project-admin] [instance: bbecd10c-7823-4ede-b418-c3b2a3c4de36] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:13:51.187080 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e147dd40-734f-4222-bd00-4910fa4fec69 tempest-ServersAdminNegativeTestJSON-823470194 tempest-ServersAdminNegativeTestJSON-823470194-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:13:51.187583 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e147dd40-734f-4222-bd00-4910fa4fec69 tempest-ServersAdminNegativeTestJSON-823470194 tempest-ServersAdminNegativeTestJSON-823470194-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:13:51.188045 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e147dd40-734f-4222-bd00-4910fa4fec69 tempest-ServersAdminNegativeTestJSON-823470194 tempest-ServersAdminNegativeTestJSON-823470194-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:13:51.188761 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e147dd40-734f-4222-bd00-4910fa4fec69 tempest-ServersAdminNegativeTestJSON-823470194 tempest-ServersAdminNegativeTestJSON-823470194-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:13:51.189239 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e147dd40-734f-4222-bd00-4910fa4fec69 tempest-ServersAdminNegativeTestJSON-823470194 tempest-ServersAdminNegativeTestJSON-823470194-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:13:51.189716 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e147dd40-734f-4222-bd00-4910fa4fec69 tempest-ServersAdminNegativeTestJSON-823470194 tempest-ServersAdminNegativeTestJSON-823470194-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:13:51.274883 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e147dd40-734f-4222-bd00-4910fa4fec69 tempest-ServersAdminNegativeTestJSON-823470194 tempest-ServersAdminNegativeTestJSON-823470194-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'e7e434795a3643f3ad175774e60f2aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7856af4bef4f4ba1de5dcde7d8d3fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:13:51.280845 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e147dd40-734f-4222-bd00-4910fa4fec69 tempest-ServersAdminNegativeTestJSON-823470194 tempest-ServersAdminNegativeTestJSON-823470194-project-admin] [instance: bbecd10c-7823-4ede-b418-c3b2a3c4de36] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-669247794 {{(pid=121134) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 19 04:13:51.287438 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e147dd40-734f-4222-bd00-4910fa4fec69 tempest-ServersAdminNegativeTestJSON-823470194 tempest-ServersAdminNegativeTestJSON-823470194-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:13:51.287936 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e147dd40-734f-4222-bd00-4910fa4fec69 tempest-ServersAdminNegativeTestJSON-823470194 tempest-ServersAdminNegativeTestJSON-823470194-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:13:51.288389 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e147dd40-734f-4222-bd00-4910fa4fec69 tempest-ServersAdminNegativeTestJSON-823470194 tempest-ServersAdminNegativeTestJSON-823470194-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:13:51.289135 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e147dd40-734f-4222-bd00-4910fa4fec69 tempest-ServersAdminNegativeTestJSON-823470194 tempest-ServersAdminNegativeTestJSON-823470194-project-admin] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:13:51.289708 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e147dd40-734f-4222-bd00-4910fa4fec69 tempest-ServersAdminNegativeTestJSON-823470194 tempest-ServersAdminNegativeTestJSON-823470194-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:13:51.290154 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e147dd40-734f-4222-bd00-4910fa4fec69 tempest-ServersAdminNegativeTestJSON-823470194 tempest-ServersAdminNegativeTestJSON-823470194-project-admin] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:13:51.314817 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-e147dd40-734f-4222-bd00-4910fa4fec69 tempest-ServersAdminNegativeTestJSON-823470194 tempest-ServersAdminNegativeTestJSON-823470194-project-admin] Getting quotas for project e72f06852d78468494ad79f82e55b374. Resources: {'cores', 'ram'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 04:13:51.319871 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-e147dd40-734f-4222-bd00-4910fa4fec69 tempest-ServersAdminNegativeTestJSON-823470194 tempest-ServersAdminNegativeTestJSON-823470194-project-admin] Getting quotas for user 88bb9eff08de46259eb19a5c87b12017 and project e72f06852d78468494ad79f82e55b374. Resources: {'cores', 'ram'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 04:13:51.334699 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.compute.api [None req-e147dd40-734f-4222-bd00-4910fa4fec69 tempest-ServersAdminNegativeTestJSON-823470194 tempest-ServersAdminNegativeTestJSON-823470194-project-admin] cores quota exceeded for 1d7856af4bef4f4ba1de5dcde7d8d3fd, tried to resize instance. Oct 19 04:13:51.335334 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-e147dd40-734f-4222-bd00-4910fa4fec69 tempest-ServersAdminNegativeTestJSON-823470194 tempest-ServersAdminNegativeTestJSON-823470194-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 19 04:13:51.337434 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e147dd40-734f-4222-bd00-4910fa4fec69 tempest-ServersAdminNegativeTestJSON-823470194 tempest-ServersAdminNegativeTestJSON-823470194-project-admin] Request method failure captured: Oct 19 04:13:51.337434 n-d-861333-8 devstack@n-api.service[121134]: request: POST /compute/v2.1/servers/bbecd10c-7823-4ede-b418-c3b2a3c4de36/action HTTP/1.1 Oct 19 04:13:51.337434 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 04:13:51.337434 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 04:13:51.337434 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 04:13:51.337434 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 39 Oct 19 04:13:51.337434 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 04:13:51.337434 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 04:13:51.337434 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 04:13:51.337434 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 04:13:51.337434 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3lxS9V1ujCnVvHiT-h5y8ko4jas_BmILzql089_6Y-p9rKbcQsYUiRL_yzFdtlPV6rsMw8T585-ju2UY6rbFAhJe1slR58Smpz_AMKb7YDQ2WcEgdkrWKI23X6wIpDMIsCcMcGd6Kh9gEuRMj3fSS2UR0vg-BMpfVPDI--JlBx4JLQ Oct 19 04:13:51.337434 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 04:13:51.337434 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 04:13:51.337434 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 04:13:51.337434 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 04:13:51.337434 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 04:13:51.337434 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 04:13:51.337434 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 1d7856af4bef4f4ba1de5dcde7d8d3fd Oct 19 04:13:51.337434 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-823470194 Oct 19 04:13:51.337434 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member,admin Oct 19 04:13:51.337434 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member,admin Oct 19 04:13:51.337434 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1d7856af4bef4f4ba1de5dcde7d8d3fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1d7856af4bef4f4ba1de5dcde7d8d3fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1d7856af4bef4f4ba1de5dcde7d8d3fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1d7856af4bef4f4ba1de5dcde7d8d3fd", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 04:13:51.337434 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ServersAdminNegativeTestJSON-823470194 Oct 19 04:13:51.337434 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 1d7856af4bef4f4ba1de5dcde7d8d3fd Oct 19 04:13:51.337434 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-823470194 Oct 19 04:13:51.337434 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ServersAdminNegativeTestJSON-823470194-project-admin Oct 19 04:13:51.337434 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 04:13:51.337434 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 04:13:51.337434 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: e7e434795a3643f3ad175774e60f2aa0 Oct 19 04:13:51.337434 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ServersAdminNegativeTestJSON-823470194-project-admin Oct 19 04:13:51.337434 n-d-861333-8 devstack@n-api.service[121134]: Oct 19 04:13:51.337434 n-d-861333-8 devstack@n-api.service[121134]: {"resize": {"flavorRef": "2000130406"}} Oct 19 04:13:51.337434 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 04:13:51.337434 n-d-861333-8 devstack@n-api.service[121134]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 19 04:13:51.337434 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': 'bbecd10c-7823-4ede-b418-c3b2a3c4de36', 'body': {'resize': {'flavorRef': '2000130406'}}} Oct 19 04:13:51.337434 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 04:13:51.337434 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:13:51.337434 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Oct 19 04:13:51.337434 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 19 04:13:51.337434 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 04:13:51.337434 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 04:13:51.337434 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 19 04:13:51.337434 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc Oct 19 04:13:51.337434 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 19 04:13:51.337434 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 19 04:13:51.337434 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 04:13:51.337434 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 04:13:51.337434 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 19 04:13:51.337434 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 19 04:13:51.337434 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 19 04:13:51.337434 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 19 04:13:51.337434 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 19 04:13:51.337434 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 19 04:13:51.337434 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 19 04:13:51.337434 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:13:51.337434 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:13:51.337434 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:13:51.337434 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:13:51.337434 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 19 04:13:51.337434 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 19 04:13:51.337434 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 19 04:13:51.337434 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 19 04:13:51.337434 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 19 04:13:51.341830 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 19 04:13:51.341830 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 19 04:13:51.341830 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 19 04:13:51.341830 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 19 04:13:51.341830 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 19 04:13:51.341830 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 19 04:13:51.341830 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 19 04:13:51.341830 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 19 04:13:51.341830 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 19 04:13:51.341830 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Oct 19 04:13:51.341830 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 19 04:13:51.341830 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Oct 19 04:13:51.341830 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 19 04:13:51.341830 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 19 04:13:51.341830 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:13:51.341830 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:13:51.341830 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:13:51.341830 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:13:51.341830 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:13:51.341830 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:13:51.341830 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 04:13:51.341830 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 04:13:51.341830 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 04:13:51.341830 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 04:13:51.341830 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 04:13:51.341830 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 04:13:51.341830 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 19 04:13:51.341830 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 19 04:13:51.341830 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 19 04:13:51.341830 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 19 04:13:51.341830 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 19 04:13:51.341830 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:13:51.341830 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:13:51.341830 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:13:51.341830 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:13:51.341830 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:13:51.341830 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:13:51.341830 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 04:13:51.341830 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 04:13:51.341830 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 19 04:13:51.341830 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:13:51.341830 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e147dd40-734f-4222-bd00-4910fa4fec69 tempest-ServersAdminNegativeTestJSON-823470194 tempest-ServersAdminNegativeTestJSON-823470194-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 04:13:51.341830 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e147dd40-734f-4222-bd00-4910fa4fec69 tempest-ServersAdminNegativeTestJSON-823470194 tempest-ServersAdminNegativeTestJSON-823470194-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/bbecd10c-7823-4ede-b418-c3b2a3c4de36/action" status: 403 len: 113 microversion: 2.1 time: 0.164768 Oct 19 04:13:51.341830 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3877/7281] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 04:13:51 2022] POST /compute/v2.1/servers/bbecd10c-7823-4ede-b418-c3b2a3c4de36/action => generated 113 bytes in 166 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 19 04:13:51.347535 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-bd3158f1-d3e8-483b-be86-4e8c0046350b tempest-ServersAdminNegativeTestJSON-823470194 tempest-ServersAdminNegativeTestJSON-823470194-project-admin] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:13:51.418302 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-bd3158f1-d3e8-483b-be86-4e8c0046350b tempest-ServersAdminNegativeTestJSON-823470194 tempest-ServersAdminNegativeTestJSON-823470194-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/2000130406" status: 202 len: 0 microversion: 2.1 time: 0.074291 Oct 19 04:13:51.418829 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3405/7282] 10.222.0.52 () {58 vars in 1161 bytes} [Wed Oct 19 04:13:51 2022] DELETE /compute/v2.1/flavors/2000130406 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 04:13:51.432006 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4db70258-391b-45de-b4f0-e4957e739caa tempest-ServersAdminNegativeTestJSON-823470194 tempest-ServersAdminNegativeTestJSON-823470194-project-admin] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:13:51.455789 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4db70258-391b-45de-b4f0-e4957e739caa tempest-ServersAdminNegativeTestJSON-823470194 tempest-ServersAdminNegativeTestJSON-823470194-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.027473 Oct 19 04:13:51.456353 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3878/7283] 10.222.0.52 () {58 vars in 1146 bytes} [Wed Oct 19 04:13:51 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:13:51.476777 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-99df0401-03a1-46a6-b6d7-a285d4aa8e18 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:13:51.477282 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-99df0401-03a1-46a6-b6d7-a285d4aa8e18 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] [instance: bbecd10c-7823-4ede-b418-c3b2a3c4de36] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:13:51.484340 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-99df0401-03a1-46a6-b6d7-a285d4aa8e18 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:13:51.493204 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-99df0401-03a1-46a6-b6d7-a285d4aa8e18 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:13:51.493204 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-99df0401-03a1-46a6-b6d7-a285d4aa8e18 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:13:51.493204 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-99df0401-03a1-46a6-b6d7-a285d4aa8e18 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:13:51.493204 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-99df0401-03a1-46a6-b6d7-a285d4aa8e18 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:13:51.493204 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-99df0401-03a1-46a6-b6d7-a285d4aa8e18 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:13:51.511422 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-99df0401-03a1-46a6-b6d7-a285d4aa8e18 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] [instance: bbecd10c-7823-4ede-b418-c3b2a3c4de36] Going to try to terminate instance {{(pid=121135) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 04:13:51.817846 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-99df0401-03a1-46a6-b6d7-a285d4aa8e18 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] 10.222.0.52 "DELETE /compute/v2.1/servers/bbecd10c-7823-4ede-b418-c3b2a3c4de36" status: 204 len: 0 microversion: 2.1 time: 0.344622 Oct 19 04:13:51.818453 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3406/7284] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 04:13:51 2022] DELETE /compute/v2.1/servers/bbecd10c-7823-4ede-b418-c3b2a3c4de36 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 04:13:51.827315 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f0660434-4a69-476a-9143-a4ea307964a8 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:13:51.827948 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f0660434-4a69-476a-9143-a4ea307964a8 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] [instance: bbecd10c-7823-4ede-b418-c3b2a3c4de36] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:13:51.834120 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f0660434-4a69-476a-9143-a4ea307964a8 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:13:51.834626 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f0660434-4a69-476a-9143-a4ea307964a8 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:13:51.835088 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f0660434-4a69-476a-9143-a4ea307964a8 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:13:51.835805 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f0660434-4a69-476a-9143-a4ea307964a8 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:13:51.836282 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f0660434-4a69-476a-9143-a4ea307964a8 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:13:51.836730 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f0660434-4a69-476a-9143-a4ea307964a8 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:13:51.969176 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-f0660434-4a69-476a-9143-a4ea307964a8 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb9eff08de46259eb19a5c87b12017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72f06852d78468494ad79f82e55b374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:13:51.977202 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f0660434-4a69-476a-9143-a4ea307964a8 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] 10.222.0.52 "GET /compute/v2.1/servers/bbecd10c-7823-4ede-b418-c3b2a3c4de36" status: 200 len: 1477 microversion: 2.1 time: 0.154459 Oct 19 04:13:51.977811 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3879/7285] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:13:51 2022] GET /compute/v2.1/servers/bbecd10c-7823-4ede-b418-c3b2a3c4de36 => generated 1477 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:13:53.000716 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e0275b2c-5398-45b0-91ee-452354111e35 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:13:53.001450 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e0275b2c-5398-45b0-91ee-452354111e35 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] [instance: bbecd10c-7823-4ede-b418-c3b2a3c4de36] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:13:53.008258 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e0275b2c-5398-45b0-91ee-452354111e35 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:13:53.008747 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e0275b2c-5398-45b0-91ee-452354111e35 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:13:53.009191 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e0275b2c-5398-45b0-91ee-452354111e35 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:13:53.009905 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e0275b2c-5398-45b0-91ee-452354111e35 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:13:53.010884 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e0275b2c-5398-45b0-91ee-452354111e35 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:13:53.011314 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e0275b2c-5398-45b0-91ee-452354111e35 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:13:53.140899 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-e0275b2c-5398-45b0-91ee-452354111e35 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb9eff08de46259eb19a5c87b12017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72f06852d78468494ad79f82e55b374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:13:53.148926 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e0275b2c-5398-45b0-91ee-452354111e35 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] 10.222.0.52 "GET /compute/v2.1/servers/bbecd10c-7823-4ede-b418-c3b2a3c4de36" status: 200 len: 1477 microversion: 2.1 time: 0.152458 Oct 19 04:13:53.149523 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3407/7286] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:13:52 2022] GET /compute/v2.1/servers/bbecd10c-7823-4ede-b418-c3b2a3c4de36 => generated 1477 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:13:53.770684 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-4111809d-08ee-4695-aace-0afbd47a4874 req-2e0a0867-721d-45d9-8244-7e2f9080ca72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbecd10c-7823-4ede-b418-c3b2a3c4de36", "name": "network-vif-deleted", "tag": "7d3e4367-1b34-4834-9723-32a878c14e08"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:13:53.782829 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-4111809d-08ee-4695-aace-0afbd47a4874 req-2e0a0867-721d-45d9-8244-7e2f9080ca72 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:13:53.783341 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-4111809d-08ee-4695-aace-0afbd47a4874 req-2e0a0867-721d-45d9-8244-7e2f9080ca72 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:13:53.783795 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-4111809d-08ee-4695-aace-0afbd47a4874 req-2e0a0867-721d-45d9-8244-7e2f9080ca72 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:13:53.796645 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-4111809d-08ee-4695-aace-0afbd47a4874 req-2e0a0867-721d-45d9-8244-7e2f9080ca72 service nova] Creating event network-vif-deleted:7d3e4367-1b34-4834-9723-32a878c14e08 for instance bbecd10c-7823-4ede-b418-c3b2a3c4de36 on n-h2-861333-8 Oct 19 04:13:53.802344 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-4111809d-08ee-4695-aace-0afbd47a4874 req-2e0a0867-721d-45d9-8244-7e2f9080ca72 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035310 Oct 19 04:13:53.803287 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3880/7287] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:13:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:13:54.172779 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d8562aa1-11b5-4be6-939f-35395bcc8738 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:13:54.173592 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d8562aa1-11b5-4be6-939f-35395bcc8738 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] [instance: bbecd10c-7823-4ede-b418-c3b2a3c4de36] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:13:54.180536 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d8562aa1-11b5-4be6-939f-35395bcc8738 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:13:54.181117 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d8562aa1-11b5-4be6-939f-35395bcc8738 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:13:54.181596 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d8562aa1-11b5-4be6-939f-35395bcc8738 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:13:54.182297 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d8562aa1-11b5-4be6-939f-35395bcc8738 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:13:54.182801 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d8562aa1-11b5-4be6-939f-35395bcc8738 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:13:54.183262 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d8562aa1-11b5-4be6-939f-35395bcc8738 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:13:54.219768 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d8562aa1-11b5-4be6-939f-35395bcc8738 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:13:54.220266 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d8562aa1-11b5-4be6-939f-35395bcc8738 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:13:54.220709 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d8562aa1-11b5-4be6-939f-35395bcc8738 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:13:54.221159 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-d8562aa1-11b5-4be6-939f-35395bcc8738 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Lazy-loading 'fault' on Instance uuid bbecd10c-7823-4ede-b418-c3b2a3c4de36 {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 04:13:54.262348 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d8562aa1-11b5-4be6-939f-35395bcc8738 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb9eff08de46259eb19a5c87b12017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72f06852d78468494ad79f82e55b374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:13:54.270320 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d8562aa1-11b5-4be6-939f-35395bcc8738 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] 10.222.0.52 "GET /compute/v2.1/servers/bbecd10c-7823-4ede-b418-c3b2a3c4de36" status: 200 len: 1312 microversion: 2.1 time: 0.101563 Oct 19 04:13:54.270886 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3408/7288] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:13:54 2022] GET /compute/v2.1/servers/bbecd10c-7823-4ede-b418-c3b2a3c4de36 => generated 1312 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:13:55.295860 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a805ed37-0b23-4dc8-a690-5177006af712 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:13:55.296584 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a805ed37-0b23-4dc8-a690-5177006af712 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] [instance: bbecd10c-7823-4ede-b418-c3b2a3c4de36] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:13:55.302856 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a805ed37-0b23-4dc8-a690-5177006af712 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:13:55.303362 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a805ed37-0b23-4dc8-a690-5177006af712 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:13:55.303822 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a805ed37-0b23-4dc8-a690-5177006af712 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:13:55.304529 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a805ed37-0b23-4dc8-a690-5177006af712 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:13:55.305009 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a805ed37-0b23-4dc8-a690-5177006af712 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:13:55.305480 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a805ed37-0b23-4dc8-a690-5177006af712 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:13:55.318556 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-a805ed37-0b23-4dc8-a690-5177006af712 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] HTTP exception thrown: Instance bbecd10c-7823-4ede-b418-c3b2a3c4de36 could not be found. Oct 19 04:13:55.320164 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a805ed37-0b23-4dc8-a690-5177006af712 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Request method failure captured: Oct 19 04:13:55.320164 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/bbecd10c-7823-4ede-b418-c3b2a3c4de36 HTTP/1.1 Oct 19 04:13:55.320164 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 04:13:55.320164 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 04:13:55.320164 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 04:13:55.320164 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 04:13:55.320164 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 04:13:55.320164 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 04:13:55.320164 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 04:13:55.320164 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 04:13:55.320164 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3lwx0EiIhvnc0VldGdrGAyJy83E_WHZN_luOupYmCCJaAdjv93BTKew_uCXMcgpKeh5T8xDkr1zUay5fxBXCergX9s8e-fuft-WfkPE41UwZgtR8UBi7aEwtlKbWDTvsJZV0dRid0Vs5hleEXPrjj4KMY2UZVY-2EN2zK8HsYtc4QQ Oct 19 04:13:55.320164 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 04:13:55.320164 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 04:13:55.320164 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 04:13:55.320164 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 04:13:55.320164 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 04:13:55.320164 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 04:13:55.320164 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: e72f06852d78468494ad79f82e55b374 Oct 19 04:13:55.320164 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1940717642 Oct 19 04:13:55.320164 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 04:13:55.320164 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 04:13:55.320164 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e72f06852d78468494ad79f82e55b374"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e72f06852d78468494ad79f82e55b374"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e72f06852d78468494ad79f82e55b374"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e72f06852d78468494ad79f82e55b374", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 04:13:55.320164 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1940717642 Oct 19 04:13:55.320164 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: e72f06852d78468494ad79f82e55b374 Oct 19 04:13:55.320164 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1940717642 Oct 19 04:13:55.320164 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ServersAdminNegativeTestJSON-1940717642-project Oct 19 04:13:55.320164 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 04:13:55.320164 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 04:13:55.320164 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 88bb9eff08de46259eb19a5c87b12017 Oct 19 04:13:55.320164 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1940717642-project Oct 19 04:13:55.320164 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 04:13:55.320164 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance bbecd10c-7823-4ede-b418-c3b2a3c4de36 could not be found. Oct 19 04:13:55.320164 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': 'bbecd10c-7823-4ede-b418-c3b2a3c4de36'} Oct 19 04:13:55.320164 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 04:13:55.320164 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:13:55.320164 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 04:13:55.320164 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 04:13:55.320164 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 04:13:55.320164 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 04:13:55.320164 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 04:13:55.320164 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 04:13:55.320164 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 04:13:55.320164 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 04:13:55.320164 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbecd10c-7823-4ede-b418-c3b2a3c4de36 could not be found. Oct 19 04:13:55.320164 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:13:55.320164 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:13:55.320164 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:13:55.320164 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:13:55.320164 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:13:55.320164 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:13:55.320164 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 04:13:55.320164 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 04:13:55.320164 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 04:13:55.320164 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 04:13:55.320164 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 04:13:55.320164 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 04:13:55.320164 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 04:13:55.320164 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 04:13:55.320164 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 04:13:55.320164 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 04:13:55.320164 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbecd10c-7823-4ede-b418-c3b2a3c4de36 could not be found. Oct 19 04:13:55.320164 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:13:55.320164 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:13:55.325432 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:13:55.325432 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:13:55.325432 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:13:55.325432 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:13:55.325432 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 04:13:55.325432 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 04:13:55.325432 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbecd10c-7823-4ede-b418-c3b2a3c4de36 could not be found. Oct 19 04:13:55.325432 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:13:55.325432 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a805ed37-0b23-4dc8-a690-5177006af712 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] Returning 404 to user: Instance bbecd10c-7823-4ede-b418-c3b2a3c4de36 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 04:13:55.325432 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a805ed37-0b23-4dc8-a690-5177006af712 tempest-ServersAdminNegativeTestJSON-1940717642 tempest-ServersAdminNegativeTestJSON-1940717642-project] 10.222.0.52 "GET /compute/v2.1/servers/bbecd10c-7823-4ede-b418-c3b2a3c4de36" status: 404 len: 111 microversion: 2.1 time: 0.031163 Oct 19 04:13:55.325432 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3881/7289] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:13:55 2022] GET /compute/v2.1/servers/bbecd10c-7823-4ede-b418-c3b2a3c4de36 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 04:14:03.487802 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:14:03.488595 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=3 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:14:03.602358 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e8086591-d771-4b99-8494-5aff382dcd00 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1646677349", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "networks": [{"uuid": "f57e3afe-a0e4-4cb6-86d6-a1ab7d75b090"}]}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:14:03.658230 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.network.neutron [None req-e8086591-d771-4b99-8494-5aff382dcd00 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] validate_networks() for [('f57e3afe-a0e4-4cb6-86d6-a1ab7d75b090', None, None, None, None, None)] {{(pid=121135) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 04:14:04.040763 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-e8086591-d771-4b99-8494-5aff382dcd00 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Flavor limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 04:14:04.041006 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-e8086591-d771-4b99-8494-5aff382dcd00 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Image limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 04:14:04.042251 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-e8086591-d771-4b99-8494-5aff382dcd00 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Flavor pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 04:14:04.042621 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-e8086591-d771-4b99-8494-5aff382dcd00 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Image pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 04:14:04.043109 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-e8086591-d771-4b99-8494-5aff382dcd00 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 04:14:04.052393 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e8086591-d771-4b99-8494-5aff382dcd00 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:14:04.052897 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e8086591-d771-4b99-8494-5aff382dcd00 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:14:04.053345 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e8086591-d771-4b99-8494-5aff382dcd00 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:14:04.054099 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e8086591-d771-4b99-8494-5aff382dcd00 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:14:04.054558 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e8086591-d771-4b99-8494-5aff382dcd00 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:14:04.054989 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e8086591-d771-4b99-8494-5aff382dcd00 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:14:04.072027 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-e8086591-d771-4b99-8494-5aff382dcd00 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Getting quotas for project 2a0dbee232ca4952ac57fa31d9061431. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 04:14:04.077352 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-e8086591-d771-4b99-8494-5aff382dcd00 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Getting quotas for user f625ca3815214fc182b2a72b596de4a8 and project 2a0dbee232ca4952ac57fa31d9061431. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 04:14:04.090219 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e8086591-d771-4b99-8494-5aff382dcd00 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Going to run 1 instances... {{(pid=121135) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 04:14:04.092468 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e8086591-d771-4b99-8494-5aff382dcd00 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] [instance: 874a96e0-c65a-474d-9f55-93206bd93c46] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121135) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 04:14:04.197850 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e8086591-d771-4b99-8494-5aff382dcd00 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.714695 Oct 19 04:14:04.199386 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3409/7290] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 04:14:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 717 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 04:14:04.211910 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1ddc0e93-8613-424a-bc5e-4a3df155ac35 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:14:04.212548 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1ddc0e93-8613-424a-bc5e-4a3df155ac35 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] [instance: 874a96e0-c65a-474d-9f55-93206bd93c46] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:14:04.215395 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:14:04.216116 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=3 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:14:04.281017 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-1ddc0e93-8613-424a-bc5e-4a3df155ac35 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f625ca3815214fc182b2a72b596de4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0dbee232ca4952ac57fa31d9061431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:14:04.292496 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1ddc0e93-8613-424a-bc5e-4a3df155ac35 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] 10.222.0.52 "GET /compute/v2.1/servers/874a96e0-c65a-474d-9f55-93206bd93c46" status: 200 len: 1215 microversion: 2.1 time: 0.081584 Oct 19 04:14:04.292496 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3882/7291] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:14:04 2022] GET /compute/v2.1/servers/874a96e0-c65a-474d-9f55-93206bd93c46 => generated 1215 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:14:05.313488 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-24df8822-239c-4193-b59e-5e814ec24805 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:14:05.314940 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-24df8822-239c-4193-b59e-5e814ec24805 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] [instance: 874a96e0-c65a-474d-9f55-93206bd93c46] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:14:05.321961 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-24df8822-239c-4193-b59e-5e814ec24805 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:14:05.322512 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-24df8822-239c-4193-b59e-5e814ec24805 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:14:05.322958 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-24df8822-239c-4193-b59e-5e814ec24805 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:14:05.323660 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-24df8822-239c-4193-b59e-5e814ec24805 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:14:05.324216 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-24df8822-239c-4193-b59e-5e814ec24805 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:14:05.324656 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-24df8822-239c-4193-b59e-5e814ec24805 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:14:05.390041 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-24df8822-239c-4193-b59e-5e814ec24805 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f625ca3815214fc182b2a72b596de4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0dbee232ca4952ac57fa31d9061431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:14:05.404046 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-24df8822-239c-4193-b59e-5e814ec24805 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] 10.222.0.52 "GET /compute/v2.1/servers/874a96e0-c65a-474d-9f55-93206bd93c46" status: 200 len: 1219 microversion: 2.1 time: 0.095562 Oct 19 04:14:05.404640 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3410/7292] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:14:05 2022] GET /compute/v2.1/servers/874a96e0-c65a-474d-9f55-93206bd93c46 => generated 1219 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:14:06.426993 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e5634ea8-880f-4ba7-a06d-0628015a0fe3 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:14:06.428313 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e5634ea8-880f-4ba7-a06d-0628015a0fe3 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] [instance: 874a96e0-c65a-474d-9f55-93206bd93c46] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:14:06.433425 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=55 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:14:06.439785 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e5634ea8-880f-4ba7-a06d-0628015a0fe3 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:14:06.440547 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e5634ea8-880f-4ba7-a06d-0628015a0fe3 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:14:06.441257 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e5634ea8-880f-4ba7-a06d-0628015a0fe3 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:14:06.442143 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e5634ea8-880f-4ba7-a06d-0628015a0fe3 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:14:06.442845 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e5634ea8-880f-4ba7-a06d-0628015a0fe3 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:14:06.443582 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e5634ea8-880f-4ba7-a06d-0628015a0fe3 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:14:06.529725 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e5634ea8-880f-4ba7-a06d-0628015a0fe3 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f625ca3815214fc182b2a72b596de4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0dbee232ca4952ac57fa31d9061431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:14:06.539771 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e5634ea8-880f-4ba7-a06d-0628015a0fe3 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] 10.222.0.52 "GET /compute/v2.1/servers/874a96e0-c65a-474d-9f55-93206bd93c46" status: 200 len: 1275 microversion: 2.1 time: 0.116757 Oct 19 04:14:06.540381 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3883/7293] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:14:06 2022] GET /compute/v2.1/servers/874a96e0-c65a-474d-9f55-93206bd93c46 => generated 1275 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:14:07.564138 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-acfadc23-e015-473b-bbec-f5dd71216ab8 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:14:07.564754 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-acfadc23-e015-473b-bbec-f5dd71216ab8 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] [instance: 874a96e0-c65a-474d-9f55-93206bd93c46] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:14:07.571703 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-acfadc23-e015-473b-bbec-f5dd71216ab8 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:14:07.572225 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-acfadc23-e015-473b-bbec-f5dd71216ab8 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:14:07.572665 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-acfadc23-e015-473b-bbec-f5dd71216ab8 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:14:07.573360 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-acfadc23-e015-473b-bbec-f5dd71216ab8 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:14:07.573838 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-acfadc23-e015-473b-bbec-f5dd71216ab8 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:14:07.579885 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-acfadc23-e015-473b-bbec-f5dd71216ab8 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:14:07.784705 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-acfadc23-e015-473b-bbec-f5dd71216ab8 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f625ca3815214fc182b2a72b596de4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0dbee232ca4952ac57fa31d9061431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:14:07.793017 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-acfadc23-e015-473b-bbec-f5dd71216ab8 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] 10.222.0.52 "GET /compute/v2.1/servers/874a96e0-c65a-474d-9f55-93206bd93c46" status: 200 len: 1315 microversion: 2.1 time: 0.232845 Oct 19 04:14:07.793633 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3411/7294] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:14:07 2022] GET /compute/v2.1/servers/874a96e0-c65a-474d-9f55-93206bd93c46 => generated 1315 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:14:08.428468 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-34b03148-d0db-4906-b6dd-39d31ea12ed4 req-47f56846-ae72-4c22-ab4d-4069173a3a6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "874a96e0-c65a-474d-9f55-93206bd93c46", "tag": "1b118950-f663-499b-b9ff-6ae3ed0086b9"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:14:08.439660 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-34b03148-d0db-4906-b6dd-39d31ea12ed4 req-47f56846-ae72-4c22-ab4d-4069173a3a6b service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:14:08.440156 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-34b03148-d0db-4906-b6dd-39d31ea12ed4 req-47f56846-ae72-4c22-ab4d-4069173a3a6b service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:14:08.440603 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-34b03148-d0db-4906-b6dd-39d31ea12ed4 req-47f56846-ae72-4c22-ab4d-4069173a3a6b service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:14:08.452454 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-34b03148-d0db-4906-b6dd-39d31ea12ed4 req-47f56846-ae72-4c22-ab4d-4069173a3a6b service nova] Creating event network-changed:1b118950-f663-499b-b9ff-6ae3ed0086b9 for instance 874a96e0-c65a-474d-9f55-93206bd93c46 on n-h2-861333-8 Oct 19 04:14:08.457445 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-34b03148-d0db-4906-b6dd-39d31ea12ed4 req-47f56846-ae72-4c22-ab4d-4069173a3a6b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032753 Oct 19 04:14:08.458047 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3884/7295] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:14:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:14:08.816202 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-53243d8d-8283-4345-bfb5-5e7986b3108a tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:14:08.816804 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-53243d8d-8283-4345-bfb5-5e7986b3108a tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] [instance: 874a96e0-c65a-474d-9f55-93206bd93c46] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:14:08.819510 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=7,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:14:08.824627 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-53243d8d-8283-4345-bfb5-5e7986b3108a tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:14:08.825116 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-53243d8d-8283-4345-bfb5-5e7986b3108a tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:14:08.825585 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-53243d8d-8283-4345-bfb5-5e7986b3108a tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:14:08.826276 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-53243d8d-8283-4345-bfb5-5e7986b3108a tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:14:08.826729 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-53243d8d-8283-4345-bfb5-5e7986b3108a tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:14:08.827154 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-53243d8d-8283-4345-bfb5-5e7986b3108a tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:14:08.831125 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:14:09.059049 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-53243d8d-8283-4345-bfb5-5e7986b3108a tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f625ca3815214fc182b2a72b596de4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0dbee232ca4952ac57fa31d9061431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:14:09.066692 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-53243d8d-8283-4345-bfb5-5e7986b3108a tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] 10.222.0.52 "GET /compute/v2.1/servers/874a96e0-c65a-474d-9f55-93206bd93c46" status: 200 len: 1315 microversion: 2.1 time: 0.254400 Oct 19 04:14:09.067482 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3412/7296] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:14:08 2022] GET /compute/v2.1/servers/874a96e0-c65a-474d-9f55-93206bd93c46 => generated 1315 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:14:10.091303 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-52000046-8a0c-4be8-a9f5-38fa57396f84 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:14:10.092031 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-52000046-8a0c-4be8-a9f5-38fa57396f84 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] [instance: 874a96e0-c65a-474d-9f55-93206bd93c46] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:14:10.098326 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-52000046-8a0c-4be8-a9f5-38fa57396f84 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:14:10.098832 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-52000046-8a0c-4be8-a9f5-38fa57396f84 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:14:10.099293 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-52000046-8a0c-4be8-a9f5-38fa57396f84 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:14:10.100009 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-52000046-8a0c-4be8-a9f5-38fa57396f84 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:14:10.100491 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-52000046-8a0c-4be8-a9f5-38fa57396f84 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:14:10.100942 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-52000046-8a0c-4be8-a9f5-38fa57396f84 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:14:10.228558 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-52000046-8a0c-4be8-a9f5-38fa57396f84 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f625ca3815214fc182b2a72b596de4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0dbee232ca4952ac57fa31d9061431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:14:10.237250 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-52000046-8a0c-4be8-a9f5-38fa57396f84 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] 10.222.0.52 "GET /compute/v2.1/servers/874a96e0-c65a-474d-9f55-93206bd93c46" status: 200 len: 1315 microversion: 2.1 time: 0.151216 Oct 19 04:14:10.237867 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3885/7297] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:14:10 2022] GET /compute/v2.1/servers/874a96e0-c65a-474d-9f55-93206bd93c46 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:14:11.260050 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-aac4886c-380b-48dd-abc7-1eb66cc041cd tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:14:11.260665 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-aac4886c-380b-48dd-abc7-1eb66cc041cd tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] [instance: 874a96e0-c65a-474d-9f55-93206bd93c46] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:14:11.268099 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aac4886c-380b-48dd-abc7-1eb66cc041cd tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:14:11.268588 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aac4886c-380b-48dd-abc7-1eb66cc041cd tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:14:11.269032 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aac4886c-380b-48dd-abc7-1eb66cc041cd tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:14:11.269750 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aac4886c-380b-48dd-abc7-1eb66cc041cd tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:14:11.270209 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aac4886c-380b-48dd-abc7-1eb66cc041cd tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:14:11.270644 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aac4886c-380b-48dd-abc7-1eb66cc041cd tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:14:11.404530 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-aac4886c-380b-48dd-abc7-1eb66cc041cd tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f625ca3815214fc182b2a72b596de4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0dbee232ca4952ac57fa31d9061431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:14:11.412444 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-aac4886c-380b-48dd-abc7-1eb66cc041cd tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] 10.222.0.52 "GET /compute/v2.1/servers/874a96e0-c65a-474d-9f55-93206bd93c46" status: 200 len: 1315 microversion: 2.1 time: 0.156281 Oct 19 04:14:11.413018 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3413/7298] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:14:11 2022] GET /compute/v2.1/servers/874a96e0-c65a-474d-9f55-93206bd93c46 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:14:12.435630 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-77f4062a-5399-45f0-a2b1-978dda26bde8 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:14:12.436269 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-77f4062a-5399-45f0-a2b1-978dda26bde8 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] [instance: 874a96e0-c65a-474d-9f55-93206bd93c46] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:14:12.439114 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=1,nova_api:DELETE=3 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:14:12.443888 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-77f4062a-5399-45f0-a2b1-978dda26bde8 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:14:12.444389 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-77f4062a-5399-45f0-a2b1-978dda26bde8 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:14:12.444845 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-77f4062a-5399-45f0-a2b1-978dda26bde8 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:14:12.445596 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-77f4062a-5399-45f0-a2b1-978dda26bde8 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:14:12.446070 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-77f4062a-5399-45f0-a2b1-978dda26bde8 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:14:12.446518 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-77f4062a-5399-45f0-a2b1-978dda26bde8 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:14:12.580374 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-77f4062a-5399-45f0-a2b1-978dda26bde8 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f625ca3815214fc182b2a72b596de4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0dbee232ca4952ac57fa31d9061431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:14:12.588559 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-77f4062a-5399-45f0-a2b1-978dda26bde8 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] 10.222.0.52 "GET /compute/v2.1/servers/874a96e0-c65a-474d-9f55-93206bd93c46" status: 200 len: 1315 microversion: 2.1 time: 0.156888 Oct 19 04:14:12.589106 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3886/7299] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:14:12 2022] GET /compute/v2.1/servers/874a96e0-c65a-474d-9f55-93206bd93c46 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:14:13.612085 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-378914bd-b076-41da-a972-8b8c03144d2c tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:14:13.612785 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-378914bd-b076-41da-a972-8b8c03144d2c tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] [instance: 874a96e0-c65a-474d-9f55-93206bd93c46] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:14:13.619719 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-378914bd-b076-41da-a972-8b8c03144d2c tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:14:13.620212 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-378914bd-b076-41da-a972-8b8c03144d2c tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:14:13.621150 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-378914bd-b076-41da-a972-8b8c03144d2c tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:14:13.621872 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-378914bd-b076-41da-a972-8b8c03144d2c tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:14:13.622338 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-378914bd-b076-41da-a972-8b8c03144d2c tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:14:13.622772 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-378914bd-b076-41da-a972-8b8c03144d2c tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:14:13.755852 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-378914bd-b076-41da-a972-8b8c03144d2c tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f625ca3815214fc182b2a72b596de4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0dbee232ca4952ac57fa31d9061431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:14:13.764572 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-378914bd-b076-41da-a972-8b8c03144d2c tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] 10.222.0.52 "GET /compute/v2.1/servers/874a96e0-c65a-474d-9f55-93206bd93c46" status: 200 len: 1315 microversion: 2.1 time: 0.156350 Oct 19 04:14:13.765153 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3414/7300] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:14:13 2022] GET /compute/v2.1/servers/874a96e0-c65a-474d-9f55-93206bd93c46 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:14:13.852242 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-c9718a29-30d3-437c-bb31-acd34fef53a1 req-2b4392cd-5e01-4804-9392-a39d9023f70d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "874a96e0-c65a-474d-9f55-93206bd93c46", "name": "network-vif-plugged", "status": "completed", "tag": "1b118950-f663-499b-b9ff-6ae3ed0086b9"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:14:13.863530 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-c9718a29-30d3-437c-bb31-acd34fef53a1 req-2b4392cd-5e01-4804-9392-a39d9023f70d service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:14:13.864032 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-c9718a29-30d3-437c-bb31-acd34fef53a1 req-2b4392cd-5e01-4804-9392-a39d9023f70d service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:14:13.864483 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-c9718a29-30d3-437c-bb31-acd34fef53a1 req-2b4392cd-5e01-4804-9392-a39d9023f70d service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:14:13.876011 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-c9718a29-30d3-437c-bb31-acd34fef53a1 req-2b4392cd-5e01-4804-9392-a39d9023f70d service nova] Creating event network-vif-plugged:1b118950-f663-499b-b9ff-6ae3ed0086b9 for instance 874a96e0-c65a-474d-9f55-93206bd93c46 on n-h2-861333-8 Oct 19 04:14:13.881016 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-c9718a29-30d3-437c-bb31-acd34fef53a1 req-2b4392cd-5e01-4804-9392-a39d9023f70d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032571 Oct 19 04:14:13.881642 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3887/7301] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:14:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:14:14.787543 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-794fc1bb-1188-4270-9b14-982c22144238 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:14:14.788165 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-794fc1bb-1188-4270-9b14-982c22144238 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] [instance: 874a96e0-c65a-474d-9f55-93206bd93c46] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:14:14.790046 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:14:14.790720 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=6 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:14:14.796730 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-794fc1bb-1188-4270-9b14-982c22144238 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:14:14.796956 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-794fc1bb-1188-4270-9b14-982c22144238 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:14:14.798194 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-794fc1bb-1188-4270-9b14-982c22144238 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:14:14.798194 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-794fc1bb-1188-4270-9b14-982c22144238 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:14:14.798590 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-794fc1bb-1188-4270-9b14-982c22144238 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:14:14.799070 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-794fc1bb-1188-4270-9b14-982c22144238 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:14:14.934017 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-794fc1bb-1188-4270-9b14-982c22144238 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f625ca3815214fc182b2a72b596de4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0dbee232ca4952ac57fa31d9061431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:14:14.941804 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-794fc1bb-1188-4270-9b14-982c22144238 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] 10.222.0.52 "GET /compute/v2.1/servers/874a96e0-c65a-474d-9f55-93206bd93c46" status: 200 len: 1315 microversion: 2.1 time: 0.158102 Oct 19 04:14:14.942400 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3415/7302] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:14:14 2022] GET /compute/v2.1/servers/874a96e0-c65a-474d-9f55-93206bd93c46 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:14:15.961424 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:14:15.966978 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-97630085-9d5d-4c85-aa15-85dbfbc8361b tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:14:15.967733 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-97630085-9d5d-4c85-aa15-85dbfbc8361b tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] [instance: 874a96e0-c65a-474d-9f55-93206bd93c46] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:14:15.973862 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-97630085-9d5d-4c85-aa15-85dbfbc8361b tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:14:15.974370 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-97630085-9d5d-4c85-aa15-85dbfbc8361b tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:14:15.974839 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-97630085-9d5d-4c85-aa15-85dbfbc8361b tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:14:15.975556 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-97630085-9d5d-4c85-aa15-85dbfbc8361b tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:14:15.976060 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-97630085-9d5d-4c85-aa15-85dbfbc8361b tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:14:15.976507 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-97630085-9d5d-4c85-aa15-85dbfbc8361b tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:14:16.110740 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-97630085-9d5d-4c85-aa15-85dbfbc8361b tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f625ca3815214fc182b2a72b596de4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0dbee232ca4952ac57fa31d9061431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:14:16.118753 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-97630085-9d5d-4c85-aa15-85dbfbc8361b tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] 10.222.0.52 "GET /compute/v2.1/servers/874a96e0-c65a-474d-9f55-93206bd93c46" status: 200 len: 1502 microversion: 2.1 time: 0.158345 Oct 19 04:14:16.119579 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3888/7303] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:14:15 2022] GET /compute/v2.1/servers/874a96e0-c65a-474d-9f55-93206bd93c46 => generated 1502 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:14:16.142861 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-59cde959-7544-4e36-ac02-482911851f43 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:14:16.145227 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-59cde959-7544-4e36-ac02-482911851f43 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] [instance: 874a96e0-c65a-474d-9f55-93206bd93c46] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:14:16.153050 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-59cde959-7544-4e36-ac02-482911851f43 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:14:16.153601 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-59cde959-7544-4e36-ac02-482911851f43 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:14:16.154046 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-59cde959-7544-4e36-ac02-482911851f43 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:14:16.154740 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-59cde959-7544-4e36-ac02-482911851f43 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:14:16.155199 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-59cde959-7544-4e36-ac02-482911851f43 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:14:16.155631 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-59cde959-7544-4e36-ac02-482911851f43 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:14:16.183324 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-59cde959-7544-4e36-ac02-482911851f43 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'f625ca3815214fc182b2a72b596de4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0dbee232ca4952ac57fa31d9061431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:14:16.188805 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-59cde959-7544-4e36-ac02-482911851f43 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] [instance: 874a96e0-c65a-474d-9f55-93206bd93c46] Old instance type m1.heat2, new instance type m1.heat {{(pid=121135) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 19 04:14:16.195205 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-59cde959-7544-4e36-ac02-482911851f43 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Flavor limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 04:14:16.195635 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-59cde959-7544-4e36-ac02-482911851f43 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Image limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 04:14:16.196117 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-59cde959-7544-4e36-ac02-482911851f43 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Flavor pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 04:14:16.196534 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-59cde959-7544-4e36-ac02-482911851f43 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Image pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 04:14:16.196952 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-59cde959-7544-4e36-ac02-482911851f43 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 04:14:16.392303 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-59cde959-7544-4e36-ac02-482911851f43 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] 10.222.0.52 "POST /compute/v2.1/servers/874a96e0-c65a-474d-9f55-93206bd93c46/action" status: 202 len: 0 microversion: 2.1 time: 0.253310 Oct 19 04:14:16.401432 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-25d0256e-72aa-494b-a30f-dc33dcbfce09 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:14:16.402063 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-25d0256e-72aa-494b-a30f-dc33dcbfce09 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] [instance: 874a96e0-c65a-474d-9f55-93206bd93c46] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:14:16.404902 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3416/7304] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 04:14:16 2022] POST /compute/v2.1/servers/874a96e0-c65a-474d-9f55-93206bd93c46/action => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 04:14:16.408471 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-25d0256e-72aa-494b-a30f-dc33dcbfce09 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:14:16.409136 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-25d0256e-72aa-494b-a30f-dc33dcbfce09 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:14:16.409626 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-25d0256e-72aa-494b-a30f-dc33dcbfce09 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:14:16.410464 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-25d0256e-72aa-494b-a30f-dc33dcbfce09 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:14:16.410971 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-25d0256e-72aa-494b-a30f-dc33dcbfce09 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:14:16.411431 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-25d0256e-72aa-494b-a30f-dc33dcbfce09 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:14:16.546504 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-25d0256e-72aa-494b-a30f-dc33dcbfce09 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f625ca3815214fc182b2a72b596de4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0dbee232ca4952ac57fa31d9061431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:14:16.554326 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-25d0256e-72aa-494b-a30f-dc33dcbfce09 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] 10.222.0.52 "GET /compute/v2.1/servers/874a96e0-c65a-474d-9f55-93206bd93c46" status: 200 len: 1511 microversion: 2.1 time: 0.157045 Oct 19 04:14:16.554908 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3889/7305] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:14:16 2022] GET /compute/v2.1/servers/874a96e0-c65a-474d-9f55-93206bd93c46 => generated 1511 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:14:17.579067 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-04fe06f8-fbc2-46cc-9f32-85d000d921b6 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:14:17.579683 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-04fe06f8-fbc2-46cc-9f32-85d000d921b6 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] [instance: 874a96e0-c65a-474d-9f55-93206bd93c46] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:14:17.586573 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-04fe06f8-fbc2-46cc-9f32-85d000d921b6 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:14:17.587055 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-04fe06f8-fbc2-46cc-9f32-85d000d921b6 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:14:17.587488 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-04fe06f8-fbc2-46cc-9f32-85d000d921b6 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:14:17.588170 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-04fe06f8-fbc2-46cc-9f32-85d000d921b6 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:14:17.588626 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-04fe06f8-fbc2-46cc-9f32-85d000d921b6 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:14:17.589048 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-04fe06f8-fbc2-46cc-9f32-85d000d921b6 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:14:17.733288 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-04fe06f8-fbc2-46cc-9f32-85d000d921b6 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f625ca3815214fc182b2a72b596de4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0dbee232ca4952ac57fa31d9061431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:14:17.742160 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-04fe06f8-fbc2-46cc-9f32-85d000d921b6 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] 10.222.0.52 "GET /compute/v2.1/servers/874a96e0-c65a-474d-9f55-93206bd93c46" status: 200 len: 1511 microversion: 2.1 time: 0.168529 Oct 19 04:14:17.742926 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3417/7306] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:14:17 2022] GET /compute/v2.1/servers/874a96e0-c65a-474d-9f55-93206bd93c46 => generated 1511 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:14:18.766528 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-73e40353-500e-4efd-8212-2a16870f4bcb tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:14:18.767195 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-73e40353-500e-4efd-8212-2a16870f4bcb tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] [instance: 874a96e0-c65a-474d-9f55-93206bd93c46] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:14:18.774298 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-73e40353-500e-4efd-8212-2a16870f4bcb tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:14:18.774806 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-73e40353-500e-4efd-8212-2a16870f4bcb tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:14:18.775262 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-73e40353-500e-4efd-8212-2a16870f4bcb tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:14:18.775980 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-73e40353-500e-4efd-8212-2a16870f4bcb tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:14:18.776500 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-73e40353-500e-4efd-8212-2a16870f4bcb tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:14:18.776946 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-73e40353-500e-4efd-8212-2a16870f4bcb tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:14:18.979022 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-73e40353-500e-4efd-8212-2a16870f4bcb tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f625ca3815214fc182b2a72b596de4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0dbee232ca4952ac57fa31d9061431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:14:18.986894 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-73e40353-500e-4efd-8212-2a16870f4bcb tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] 10.222.0.52 "GET /compute/v2.1/servers/874a96e0-c65a-474d-9f55-93206bd93c46" status: 200 len: 1511 microversion: 2.1 time: 0.224344 Oct 19 04:14:18.987487 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3890/7307] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:14:18 2022] GET /compute/v2.1/servers/874a96e0-c65a-474d-9f55-93206bd93c46 => generated 1511 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:14:20.010306 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a185f8af-b02e-4de6-8d0d-8b8c0ec01eae tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:14:20.011505 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a185f8af-b02e-4de6-8d0d-8b8c0ec01eae tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] [instance: 874a96e0-c65a-474d-9f55-93206bd93c46] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:14:20.018310 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a185f8af-b02e-4de6-8d0d-8b8c0ec01eae tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:14:20.018797 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a185f8af-b02e-4de6-8d0d-8b8c0ec01eae tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:14:20.019237 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a185f8af-b02e-4de6-8d0d-8b8c0ec01eae tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:14:20.019927 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a185f8af-b02e-4de6-8d0d-8b8c0ec01eae tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:14:20.020381 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a185f8af-b02e-4de6-8d0d-8b8c0ec01eae tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:14:20.020804 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a185f8af-b02e-4de6-8d0d-8b8c0ec01eae tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:14:20.150562 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a185f8af-b02e-4de6-8d0d-8b8c0ec01eae tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f625ca3815214fc182b2a72b596de4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0dbee232ca4952ac57fa31d9061431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:14:20.158922 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a185f8af-b02e-4de6-8d0d-8b8c0ec01eae tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] 10.222.0.52 "GET /compute/v2.1/servers/874a96e0-c65a-474d-9f55-93206bd93c46" status: 200 len: 1516 microversion: 2.1 time: 0.152506 Oct 19 04:14:20.159503 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3418/7308] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:14:20 2022] GET /compute/v2.1/servers/874a96e0-c65a-474d-9f55-93206bd93c46 => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:14:21.182091 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ec97aae7-97a8-4dc2-8b06-976be50545ee tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:14:21.182823 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ec97aae7-97a8-4dc2-8b06-976be50545ee tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] [instance: 874a96e0-c65a-474d-9f55-93206bd93c46] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:14:21.191610 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ec97aae7-97a8-4dc2-8b06-976be50545ee tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:14:21.192114 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ec97aae7-97a8-4dc2-8b06-976be50545ee tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:14:21.192568 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ec97aae7-97a8-4dc2-8b06-976be50545ee tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:14:21.193275 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ec97aae7-97a8-4dc2-8b06-976be50545ee tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:14:21.193784 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ec97aae7-97a8-4dc2-8b06-976be50545ee tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:14:21.194227 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ec97aae7-97a8-4dc2-8b06-976be50545ee tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:14:21.327731 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ec97aae7-97a8-4dc2-8b06-976be50545ee tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f625ca3815214fc182b2a72b596de4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0dbee232ca4952ac57fa31d9061431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:14:21.335376 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ec97aae7-97a8-4dc2-8b06-976be50545ee tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] 10.222.0.52 "GET /compute/v2.1/servers/874a96e0-c65a-474d-9f55-93206bd93c46" status: 200 len: 1516 microversion: 2.1 time: 0.157204 Oct 19 04:14:21.335945 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3891/7309] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:14:21 2022] GET /compute/v2.1/servers/874a96e0-c65a-474d-9f55-93206bd93c46 => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:14:22.359306 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-df91f9c4-3ad7-410a-b08e-8534c4184b5f tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:14:22.359830 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-df91f9c4-3ad7-410a-b08e-8534c4184b5f tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] [instance: 874a96e0-c65a-474d-9f55-93206bd93c46] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:14:22.366624 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-df91f9c4-3ad7-410a-b08e-8534c4184b5f tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:14:22.367106 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-df91f9c4-3ad7-410a-b08e-8534c4184b5f tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:14:22.367543 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-df91f9c4-3ad7-410a-b08e-8534c4184b5f tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:14:22.368222 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-df91f9c4-3ad7-410a-b08e-8534c4184b5f tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:14:22.368673 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-df91f9c4-3ad7-410a-b08e-8534c4184b5f tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:14:22.369092 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-df91f9c4-3ad7-410a-b08e-8534c4184b5f tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:14:22.497805 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-df91f9c4-3ad7-410a-b08e-8534c4184b5f tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f625ca3815214fc182b2a72b596de4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0dbee232ca4952ac57fa31d9061431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:14:22.505393 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-df91f9c4-3ad7-410a-b08e-8534c4184b5f tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] 10.222.0.52 "GET /compute/v2.1/servers/874a96e0-c65a-474d-9f55-93206bd93c46" status: 200 len: 1516 microversion: 2.1 time: 0.150093 Oct 19 04:14:22.505975 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3419/7310] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:14:22 2022] GET /compute/v2.1/servers/874a96e0-c65a-474d-9f55-93206bd93c46 => generated 1516 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:14:23.528448 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f9483e23-8259-4c0e-a02d-08f416232e6a tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:14:23.529111 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f9483e23-8259-4c0e-a02d-08f416232e6a tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] [instance: 874a96e0-c65a-474d-9f55-93206bd93c46] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:14:23.535975 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f9483e23-8259-4c0e-a02d-08f416232e6a tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:14:23.536471 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f9483e23-8259-4c0e-a02d-08f416232e6a tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:14:23.536923 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f9483e23-8259-4c0e-a02d-08f416232e6a tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:14:23.537675 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f9483e23-8259-4c0e-a02d-08f416232e6a tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:14:23.538130 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f9483e23-8259-4c0e-a02d-08f416232e6a tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:14:23.538571 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f9483e23-8259-4c0e-a02d-08f416232e6a tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:14:23.670311 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-f9483e23-8259-4c0e-a02d-08f416232e6a tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f625ca3815214fc182b2a72b596de4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0dbee232ca4952ac57fa31d9061431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:14:23.678028 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f9483e23-8259-4c0e-a02d-08f416232e6a tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] 10.222.0.52 "GET /compute/v2.1/servers/874a96e0-c65a-474d-9f55-93206bd93c46" status: 200 len: 1516 microversion: 2.1 time: 0.153582 Oct 19 04:14:23.678649 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3892/7311] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:14:23 2022] GET /compute/v2.1/servers/874a96e0-c65a-474d-9f55-93206bd93c46 => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:14:24.702198 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-cb8b9e13-eca3-47f9-8936-8172b72e9f35 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:14:24.702850 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-cb8b9e13-eca3-47f9-8936-8172b72e9f35 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] [instance: 874a96e0-c65a-474d-9f55-93206bd93c46] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:14:24.709660 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cb8b9e13-eca3-47f9-8936-8172b72e9f35 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:14:24.710151 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cb8b9e13-eca3-47f9-8936-8172b72e9f35 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:14:24.710592 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cb8b9e13-eca3-47f9-8936-8172b72e9f35 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:14:24.711282 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cb8b9e13-eca3-47f9-8936-8172b72e9f35 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:14:24.711733 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cb8b9e13-eca3-47f9-8936-8172b72e9f35 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:14:24.712161 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cb8b9e13-eca3-47f9-8936-8172b72e9f35 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:14:24.847002 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-cb8b9e13-eca3-47f9-8936-8172b72e9f35 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f625ca3815214fc182b2a72b596de4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0dbee232ca4952ac57fa31d9061431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:14:24.854745 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-cb8b9e13-eca3-47f9-8936-8172b72e9f35 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] 10.222.0.52 "GET /compute/v2.1/servers/874a96e0-c65a-474d-9f55-93206bd93c46" status: 200 len: 1516 microversion: 2.1 time: 0.157010 Oct 19 04:14:24.855328 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3420/7312] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:14:24 2022] GET /compute/v2.1/servers/874a96e0-c65a-474d-9f55-93206bd93c46 => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:14:25.878433 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2f138632-6ad7-4f6a-b0a0-696ff4439420 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:14:25.879069 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2f138632-6ad7-4f6a-b0a0-696ff4439420 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] [instance: 874a96e0-c65a-474d-9f55-93206bd93c46] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:14:25.886450 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2f138632-6ad7-4f6a-b0a0-696ff4439420 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:14:25.886956 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2f138632-6ad7-4f6a-b0a0-696ff4439420 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:14:25.887413 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2f138632-6ad7-4f6a-b0a0-696ff4439420 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:14:25.888127 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2f138632-6ad7-4f6a-b0a0-696ff4439420 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:14:25.888597 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2f138632-6ad7-4f6a-b0a0-696ff4439420 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:14:25.889042 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2f138632-6ad7-4f6a-b0a0-696ff4439420 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:14:26.017268 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-2f138632-6ad7-4f6a-b0a0-696ff4439420 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f625ca3815214fc182b2a72b596de4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0dbee232ca4952ac57fa31d9061431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:14:26.025351 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2f138632-6ad7-4f6a-b0a0-696ff4439420 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] 10.222.0.52 "GET /compute/v2.1/servers/874a96e0-c65a-474d-9f55-93206bd93c46" status: 200 len: 1516 microversion: 2.1 time: 0.150970 Oct 19 04:14:26.025957 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3893/7313] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:14:25 2022] GET /compute/v2.1/servers/874a96e0-c65a-474d-9f55-93206bd93c46 => generated 1516 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:14:27.048793 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f40d13c0-ef9c-4cf0-9400-b6e3dd1b845d tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:14:27.049428 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f40d13c0-ef9c-4cf0-9400-b6e3dd1b845d tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] [instance: 874a96e0-c65a-474d-9f55-93206bd93c46] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:14:27.056243 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f40d13c0-ef9c-4cf0-9400-b6e3dd1b845d tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:14:27.056724 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f40d13c0-ef9c-4cf0-9400-b6e3dd1b845d tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:14:27.057159 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f40d13c0-ef9c-4cf0-9400-b6e3dd1b845d tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:14:27.057865 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f40d13c0-ef9c-4cf0-9400-b6e3dd1b845d tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:14:27.058315 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f40d13c0-ef9c-4cf0-9400-b6e3dd1b845d tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:14:27.058738 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f40d13c0-ef9c-4cf0-9400-b6e3dd1b845d tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:14:27.190318 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f40d13c0-ef9c-4cf0-9400-b6e3dd1b845d tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f625ca3815214fc182b2a72b596de4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0dbee232ca4952ac57fa31d9061431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:14:27.198487 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f40d13c0-ef9c-4cf0-9400-b6e3dd1b845d tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] 10.222.0.52 "GET /compute/v2.1/servers/874a96e0-c65a-474d-9f55-93206bd93c46" status: 200 len: 1516 microversion: 2.1 time: 0.153115 Oct 19 04:14:27.199075 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3421/7314] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:14:27 2022] GET /compute/v2.1/servers/874a96e0-c65a-474d-9f55-93206bd93c46 => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:14:28.225142 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8f9e1e85-8d1c-45d1-b7ff-70eb0805e9ef tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:14:28.225811 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8f9e1e85-8d1c-45d1-b7ff-70eb0805e9ef tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] [instance: 874a96e0-c65a-474d-9f55-93206bd93c46] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:14:28.233326 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8f9e1e85-8d1c-45d1-b7ff-70eb0805e9ef tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:14:28.233849 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8f9e1e85-8d1c-45d1-b7ff-70eb0805e9ef tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:14:28.234298 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8f9e1e85-8d1c-45d1-b7ff-70eb0805e9ef tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:14:28.235092 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8f9e1e85-8d1c-45d1-b7ff-70eb0805e9ef tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:14:28.235559 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8f9e1e85-8d1c-45d1-b7ff-70eb0805e9ef tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:14:28.236000 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8f9e1e85-8d1c-45d1-b7ff-70eb0805e9ef tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:14:28.367892 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8f9e1e85-8d1c-45d1-b7ff-70eb0805e9ef tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f625ca3815214fc182b2a72b596de4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0dbee232ca4952ac57fa31d9061431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:14:28.376265 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8f9e1e85-8d1c-45d1-b7ff-70eb0805e9ef tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] 10.222.0.52 "GET /compute/v2.1/servers/874a96e0-c65a-474d-9f55-93206bd93c46" status: 200 len: 1516 microversion: 2.1 time: 0.155118 Oct 19 04:14:28.376845 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3894/7315] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:14:28 2022] GET /compute/v2.1/servers/874a96e0-c65a-474d-9f55-93206bd93c46 => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:14:29.399625 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c2aa6f23-3582-41f3-82af-1d5e6e50ab09 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:14:29.400239 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c2aa6f23-3582-41f3-82af-1d5e6e50ab09 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] [instance: 874a96e0-c65a-474d-9f55-93206bd93c46] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:14:29.407480 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c2aa6f23-3582-41f3-82af-1d5e6e50ab09 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:14:29.407979 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c2aa6f23-3582-41f3-82af-1d5e6e50ab09 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:14:29.408425 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c2aa6f23-3582-41f3-82af-1d5e6e50ab09 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:14:29.409127 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c2aa6f23-3582-41f3-82af-1d5e6e50ab09 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:14:29.409625 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c2aa6f23-3582-41f3-82af-1d5e6e50ab09 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:14:29.410051 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c2aa6f23-3582-41f3-82af-1d5e6e50ab09 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:14:29.540888 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c2aa6f23-3582-41f3-82af-1d5e6e50ab09 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f625ca3815214fc182b2a72b596de4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0dbee232ca4952ac57fa31d9061431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:14:29.548614 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c2aa6f23-3582-41f3-82af-1d5e6e50ab09 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] 10.222.0.52 "GET /compute/v2.1/servers/874a96e0-c65a-474d-9f55-93206bd93c46" status: 200 len: 1516 microversion: 2.1 time: 0.153335 Oct 19 04:14:29.549196 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3422/7316] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:14:29 2022] GET /compute/v2.1/servers/874a96e0-c65a-474d-9f55-93206bd93c46 => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:14:30.572200 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-09984db5-40ba-4720-b2fa-4e8cbb8053d7 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:14:30.573386 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-09984db5-40ba-4720-b2fa-4e8cbb8053d7 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] [instance: 874a96e0-c65a-474d-9f55-93206bd93c46] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:14:30.579372 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-09984db5-40ba-4720-b2fa-4e8cbb8053d7 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:14:30.579884 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-09984db5-40ba-4720-b2fa-4e8cbb8053d7 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:14:30.580343 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-09984db5-40ba-4720-b2fa-4e8cbb8053d7 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:14:30.581056 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-09984db5-40ba-4720-b2fa-4e8cbb8053d7 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:14:30.581573 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-09984db5-40ba-4720-b2fa-4e8cbb8053d7 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:14:30.582026 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-09984db5-40ba-4720-b2fa-4e8cbb8053d7 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:14:30.715590 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-09984db5-40ba-4720-b2fa-4e8cbb8053d7 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f625ca3815214fc182b2a72b596de4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0dbee232ca4952ac57fa31d9061431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:14:30.723472 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-09984db5-40ba-4720-b2fa-4e8cbb8053d7 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] 10.222.0.52 "GET /compute/v2.1/servers/874a96e0-c65a-474d-9f55-93206bd93c46" status: 200 len: 1516 microversion: 2.1 time: 0.155509 Oct 19 04:14:30.724104 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3895/7317] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:14:30 2022] GET /compute/v2.1/servers/874a96e0-c65a-474d-9f55-93206bd93c46 => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:14:31.746814 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7005e773-849b-46f3-bf2a-ee4d7c0c4788 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:14:31.747434 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7005e773-849b-46f3-bf2a-ee4d7c0c4788 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] [instance: 874a96e0-c65a-474d-9f55-93206bd93c46] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:14:31.754784 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7005e773-849b-46f3-bf2a-ee4d7c0c4788 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:14:31.755273 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7005e773-849b-46f3-bf2a-ee4d7c0c4788 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:14:31.755711 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7005e773-849b-46f3-bf2a-ee4d7c0c4788 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:14:31.756399 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7005e773-849b-46f3-bf2a-ee4d7c0c4788 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:14:31.756855 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7005e773-849b-46f3-bf2a-ee4d7c0c4788 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:14:31.757285 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7005e773-849b-46f3-bf2a-ee4d7c0c4788 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:14:31.885539 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7005e773-849b-46f3-bf2a-ee4d7c0c4788 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f625ca3815214fc182b2a72b596de4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0dbee232ca4952ac57fa31d9061431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:14:31.893248 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7005e773-849b-46f3-bf2a-ee4d7c0c4788 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] 10.222.0.52 "GET /compute/v2.1/servers/874a96e0-c65a-474d-9f55-93206bd93c46" status: 200 len: 1516 microversion: 2.1 time: 0.150882 Oct 19 04:14:31.893849 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3423/7318] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:14:31 2022] GET /compute/v2.1/servers/874a96e0-c65a-474d-9f55-93206bd93c46 => generated 1516 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:14:32.916159 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3f8e0237-54b8-46de-b48d-1957bd782031 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:14:32.916785 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3f8e0237-54b8-46de-b48d-1957bd782031 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] [instance: 874a96e0-c65a-474d-9f55-93206bd93c46] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:14:32.923698 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3f8e0237-54b8-46de-b48d-1957bd782031 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:14:32.924193 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3f8e0237-54b8-46de-b48d-1957bd782031 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:14:32.924648 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3f8e0237-54b8-46de-b48d-1957bd782031 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:14:32.925346 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3f8e0237-54b8-46de-b48d-1957bd782031 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:14:32.925833 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3f8e0237-54b8-46de-b48d-1957bd782031 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:14:32.926278 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3f8e0237-54b8-46de-b48d-1957bd782031 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:14:33.057943 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-3f8e0237-54b8-46de-b48d-1957bd782031 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f625ca3815214fc182b2a72b596de4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0dbee232ca4952ac57fa31d9061431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:14:33.065839 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3f8e0237-54b8-46de-b48d-1957bd782031 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] 10.222.0.52 "GET /compute/v2.1/servers/874a96e0-c65a-474d-9f55-93206bd93c46" status: 200 len: 1516 microversion: 2.1 time: 0.153657 Oct 19 04:14:33.066428 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3896/7319] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:14:32 2022] GET /compute/v2.1/servers/874a96e0-c65a-474d-9f55-93206bd93c46 => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:14:34.089972 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-09345af4-24e7-4341-90cb-94d77f4f8ff0 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:14:34.090590 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-09345af4-24e7-4341-90cb-94d77f4f8ff0 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] [instance: 874a96e0-c65a-474d-9f55-93206bd93c46] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:14:34.097551 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-09345af4-24e7-4341-90cb-94d77f4f8ff0 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:14:34.098052 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-09345af4-24e7-4341-90cb-94d77f4f8ff0 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:14:34.098502 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-09345af4-24e7-4341-90cb-94d77f4f8ff0 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:14:34.099204 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-09345af4-24e7-4341-90cb-94d77f4f8ff0 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:14:34.099693 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-09345af4-24e7-4341-90cb-94d77f4f8ff0 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:14:34.100154 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-09345af4-24e7-4341-90cb-94d77f4f8ff0 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:14:34.227751 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-09345af4-24e7-4341-90cb-94d77f4f8ff0 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f625ca3815214fc182b2a72b596de4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0dbee232ca4952ac57fa31d9061431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:14:34.235836 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-09345af4-24e7-4341-90cb-94d77f4f8ff0 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] 10.222.0.52 "GET /compute/v2.1/servers/874a96e0-c65a-474d-9f55-93206bd93c46" status: 200 len: 1516 microversion: 2.1 time: 0.149934 Oct 19 04:14:34.236424 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3424/7320] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:14:34 2022] GET /compute/v2.1/servers/874a96e0-c65a-474d-9f55-93206bd93c46 => generated 1516 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:14:35.259387 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-dff09f0c-0e22-4028-a57e-4ce22609cd49 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:14:35.260016 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-dff09f0c-0e22-4028-a57e-4ce22609cd49 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] [instance: 874a96e0-c65a-474d-9f55-93206bd93c46] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:14:35.266905 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dff09f0c-0e22-4028-a57e-4ce22609cd49 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:14:35.267400 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dff09f0c-0e22-4028-a57e-4ce22609cd49 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:14:35.267854 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dff09f0c-0e22-4028-a57e-4ce22609cd49 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:14:35.268553 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dff09f0c-0e22-4028-a57e-4ce22609cd49 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:14:35.269017 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dff09f0c-0e22-4028-a57e-4ce22609cd49 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:14:35.269489 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dff09f0c-0e22-4028-a57e-4ce22609cd49 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:14:35.402175 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-dff09f0c-0e22-4028-a57e-4ce22609cd49 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f625ca3815214fc182b2a72b596de4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0dbee232ca4952ac57fa31d9061431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:14:35.409987 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-dff09f0c-0e22-4028-a57e-4ce22609cd49 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] 10.222.0.52 "GET /compute/v2.1/servers/874a96e0-c65a-474d-9f55-93206bd93c46" status: 200 len: 1516 microversion: 2.1 time: 0.154548 Oct 19 04:14:35.410562 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3897/7321] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:14:35 2022] GET /compute/v2.1/servers/874a96e0-c65a-474d-9f55-93206bd93c46 => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:14:36.434192 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5e0ef957-1bf8-48f8-b97b-1cfa24b7dcd8 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:14:36.434866 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-5e0ef957-1bf8-48f8-b97b-1cfa24b7dcd8 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] [instance: 874a96e0-c65a-474d-9f55-93206bd93c46] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:14:36.441846 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5e0ef957-1bf8-48f8-b97b-1cfa24b7dcd8 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:14:36.443343 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5e0ef957-1bf8-48f8-b97b-1cfa24b7dcd8 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:14:36.443343 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5e0ef957-1bf8-48f8-b97b-1cfa24b7dcd8 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:14:36.443545 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5e0ef957-1bf8-48f8-b97b-1cfa24b7dcd8 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:14:36.443885 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5e0ef957-1bf8-48f8-b97b-1cfa24b7dcd8 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:14:36.444307 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5e0ef957-1bf8-48f8-b97b-1cfa24b7dcd8 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:14:36.572816 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-5e0ef957-1bf8-48f8-b97b-1cfa24b7dcd8 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f625ca3815214fc182b2a72b596de4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0dbee232ca4952ac57fa31d9061431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:14:36.580601 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5e0ef957-1bf8-48f8-b97b-1cfa24b7dcd8 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] 10.222.0.52 "GET /compute/v2.1/servers/874a96e0-c65a-474d-9f55-93206bd93c46" status: 200 len: 1516 microversion: 2.1 time: 0.151028 Oct 19 04:14:36.581171 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3425/7322] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:14:36 2022] GET /compute/v2.1/servers/874a96e0-c65a-474d-9f55-93206bd93c46 => generated 1516 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:14:37.602711 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ea707496-832a-4d9c-9707-348a7c28b7ee tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:14:37.603378 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ea707496-832a-4d9c-9707-348a7c28b7ee tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] [instance: 874a96e0-c65a-474d-9f55-93206bd93c46] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:14:37.610969 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ea707496-832a-4d9c-9707-348a7c28b7ee tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:14:37.611489 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ea707496-832a-4d9c-9707-348a7c28b7ee tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:14:37.611936 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ea707496-832a-4d9c-9707-348a7c28b7ee tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:14:37.612653 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ea707496-832a-4d9c-9707-348a7c28b7ee tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:14:37.613132 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ea707496-832a-4d9c-9707-348a7c28b7ee tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:14:37.613617 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ea707496-832a-4d9c-9707-348a7c28b7ee tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:14:37.745433 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ea707496-832a-4d9c-9707-348a7c28b7ee tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f625ca3815214fc182b2a72b596de4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0dbee232ca4952ac57fa31d9061431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:14:37.753084 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ea707496-832a-4d9c-9707-348a7c28b7ee tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] 10.222.0.52 "GET /compute/v2.1/servers/874a96e0-c65a-474d-9f55-93206bd93c46" status: 200 len: 1516 microversion: 2.1 time: 0.154348 Oct 19 04:14:37.753688 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3898/7323] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:14:37 2022] GET /compute/v2.1/servers/874a96e0-c65a-474d-9f55-93206bd93c46 => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:14:38.776595 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-106cd879-8595-48e7-bebf-340f74089e16 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:14:38.777202 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-106cd879-8595-48e7-bebf-340f74089e16 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] [instance: 874a96e0-c65a-474d-9f55-93206bd93c46] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:14:38.784277 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-106cd879-8595-48e7-bebf-340f74089e16 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:14:38.784767 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-106cd879-8595-48e7-bebf-340f74089e16 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:14:38.785219 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-106cd879-8595-48e7-bebf-340f74089e16 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:14:38.785945 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-106cd879-8595-48e7-bebf-340f74089e16 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:14:38.786405 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-106cd879-8595-48e7-bebf-340f74089e16 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:14:38.786836 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-106cd879-8595-48e7-bebf-340f74089e16 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:14:38.917307 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-106cd879-8595-48e7-bebf-340f74089e16 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f625ca3815214fc182b2a72b596de4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0dbee232ca4952ac57fa31d9061431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:14:38.925005 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-106cd879-8595-48e7-bebf-340f74089e16 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] 10.222.0.52 "GET /compute/v2.1/servers/874a96e0-c65a-474d-9f55-93206bd93c46" status: 200 len: 1516 microversion: 2.1 time: 0.152584 Oct 19 04:14:38.925606 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3426/7324] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:14:38 2022] GET /compute/v2.1/servers/874a96e0-c65a-474d-9f55-93206bd93c46 => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:14:39.948730 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8f9d4db0-55a3-49d8-a75f-829541d22f00 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:14:39.949361 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8f9d4db0-55a3-49d8-a75f-829541d22f00 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] [instance: 874a96e0-c65a-474d-9f55-93206bd93c46] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:14:39.956332 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8f9d4db0-55a3-49d8-a75f-829541d22f00 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:14:39.956838 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8f9d4db0-55a3-49d8-a75f-829541d22f00 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:14:39.957295 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8f9d4db0-55a3-49d8-a75f-829541d22f00 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:14:39.958033 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8f9d4db0-55a3-49d8-a75f-829541d22f00 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:14:39.958508 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8f9d4db0-55a3-49d8-a75f-829541d22f00 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:14:39.958953 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8f9d4db0-55a3-49d8-a75f-829541d22f00 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:14:39.961525 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=89 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:14:40.087749 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8f9d4db0-55a3-49d8-a75f-829541d22f00 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f625ca3815214fc182b2a72b596de4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0dbee232ca4952ac57fa31d9061431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:14:40.095495 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8f9d4db0-55a3-49d8-a75f-829541d22f00 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] 10.222.0.52 "GET /compute/v2.1/servers/874a96e0-c65a-474d-9f55-93206bd93c46" status: 200 len: 1516 microversion: 2.1 time: 0.151287 Oct 19 04:14:40.096076 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3899/7325] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:14:39 2022] GET /compute/v2.1/servers/874a96e0-c65a-474d-9f55-93206bd93c46 => generated 1516 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:14:41.119110 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5618b014-e890-41d1-9c86-6fe8ef480635 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:14:41.119761 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-5618b014-e890-41d1-9c86-6fe8ef480635 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] [instance: 874a96e0-c65a-474d-9f55-93206bd93c46] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:14:41.122137 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=34 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:14:41.126874 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5618b014-e890-41d1-9c86-6fe8ef480635 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:14:41.130667 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5618b014-e890-41d1-9c86-6fe8ef480635 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:14:41.130667 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5618b014-e890-41d1-9c86-6fe8ef480635 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:14:41.130667 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5618b014-e890-41d1-9c86-6fe8ef480635 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:14:41.130667 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5618b014-e890-41d1-9c86-6fe8ef480635 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:14:41.130667 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5618b014-e890-41d1-9c86-6fe8ef480635 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:14:41.133258 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:14:41.266820 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-5618b014-e890-41d1-9c86-6fe8ef480635 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f625ca3815214fc182b2a72b596de4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0dbee232ca4952ac57fa31d9061431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:14:41.276217 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5618b014-e890-41d1-9c86-6fe8ef480635 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] 10.222.0.52 "GET /compute/v2.1/servers/874a96e0-c65a-474d-9f55-93206bd93c46" status: 200 len: 1516 microversion: 2.1 time: 0.159739 Oct 19 04:14:41.276217 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3427/7326] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:14:41 2022] GET /compute/v2.1/servers/874a96e0-c65a-474d-9f55-93206bd93c46 => generated 1516 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:14:42.298896 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-faccb8c1-7591-4022-afe9-1ee5a2db1a35 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:14:42.299456 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-faccb8c1-7591-4022-afe9-1ee5a2db1a35 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] [instance: 874a96e0-c65a-474d-9f55-93206bd93c46] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:14:42.306342 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-faccb8c1-7591-4022-afe9-1ee5a2db1a35 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:14:42.307108 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-faccb8c1-7591-4022-afe9-1ee5a2db1a35 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:14:42.307572 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-faccb8c1-7591-4022-afe9-1ee5a2db1a35 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:14:42.308316 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-faccb8c1-7591-4022-afe9-1ee5a2db1a35 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:14:42.308796 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-faccb8c1-7591-4022-afe9-1ee5a2db1a35 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:14:42.309245 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-faccb8c1-7591-4022-afe9-1ee5a2db1a35 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:14:42.439211 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-faccb8c1-7591-4022-afe9-1ee5a2db1a35 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f625ca3815214fc182b2a72b596de4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0dbee232ca4952ac57fa31d9061431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:14:42.446985 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-faccb8c1-7591-4022-afe9-1ee5a2db1a35 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] 10.222.0.52 "GET /compute/v2.1/servers/874a96e0-c65a-474d-9f55-93206bd93c46" status: 200 len: 1516 microversion: 2.1 time: 0.152310 Oct 19 04:14:42.448070 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3900/7327] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:14:42 2022] GET /compute/v2.1/servers/874a96e0-c65a-474d-9f55-93206bd93c46 => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:14:43.471074 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d3ef8b0e-f339-44bc-9b11-ea8e3d97147e tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:14:43.471696 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d3ef8b0e-f339-44bc-9b11-ea8e3d97147e tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] [instance: 874a96e0-c65a-474d-9f55-93206bd93c46] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:14:43.479188 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d3ef8b0e-f339-44bc-9b11-ea8e3d97147e tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:14:43.479680 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d3ef8b0e-f339-44bc-9b11-ea8e3d97147e tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:14:43.480119 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d3ef8b0e-f339-44bc-9b11-ea8e3d97147e tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:14:43.480820 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d3ef8b0e-f339-44bc-9b11-ea8e3d97147e tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:14:43.481279 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d3ef8b0e-f339-44bc-9b11-ea8e3d97147e tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:14:43.481810 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d3ef8b0e-f339-44bc-9b11-ea8e3d97147e tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:14:43.616343 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d3ef8b0e-f339-44bc-9b11-ea8e3d97147e tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f625ca3815214fc182b2a72b596de4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0dbee232ca4952ac57fa31d9061431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:14:43.624935 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d3ef8b0e-f339-44bc-9b11-ea8e3d97147e tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] 10.222.0.52 "GET /compute/v2.1/servers/874a96e0-c65a-474d-9f55-93206bd93c46" status: 200 len: 1516 microversion: 2.1 time: 0.157720 Oct 19 04:14:43.625558 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3428/7328] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:14:43 2022] GET /compute/v2.1/servers/874a96e0-c65a-474d-9f55-93206bd93c46 => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:14:44.648612 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e9ad0770-4179-4753-8371-24085d74cf39 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:14:44.649295 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e9ad0770-4179-4753-8371-24085d74cf39 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] [instance: 874a96e0-c65a-474d-9f55-93206bd93c46] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:14:44.652656 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=30 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:14:44.657451 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e9ad0770-4179-4753-8371-24085d74cf39 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:14:44.657963 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e9ad0770-4179-4753-8371-24085d74cf39 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:14:44.658432 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e9ad0770-4179-4753-8371-24085d74cf39 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:14:44.659148 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e9ad0770-4179-4753-8371-24085d74cf39 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:14:44.659630 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e9ad0770-4179-4753-8371-24085d74cf39 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:14:44.660078 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e9ad0770-4179-4753-8371-24085d74cf39 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:14:44.792098 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e9ad0770-4179-4753-8371-24085d74cf39 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f625ca3815214fc182b2a72b596de4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0dbee232ca4952ac57fa31d9061431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:14:44.800165 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e9ad0770-4179-4753-8371-24085d74cf39 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] 10.222.0.52 "GET /compute/v2.1/servers/874a96e0-c65a-474d-9f55-93206bd93c46" status: 200 len: 1516 microversion: 2.1 time: 0.155772 Oct 19 04:14:44.800782 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3901/7329] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:14:44 2022] GET /compute/v2.1/servers/874a96e0-c65a-474d-9f55-93206bd93c46 => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:14:45.822969 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a2890281-e3da-4e1c-a459-9bbd93046d94 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:14:45.823580 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a2890281-e3da-4e1c-a459-9bbd93046d94 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] [instance: 874a96e0-c65a-474d-9f55-93206bd93c46] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:14:45.830514 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a2890281-e3da-4e1c-a459-9bbd93046d94 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:14:45.840263 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a2890281-e3da-4e1c-a459-9bbd93046d94 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:14:45.840263 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a2890281-e3da-4e1c-a459-9bbd93046d94 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:14:45.840263 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a2890281-e3da-4e1c-a459-9bbd93046d94 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:14:45.840263 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a2890281-e3da-4e1c-a459-9bbd93046d94 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:14:45.840263 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a2890281-e3da-4e1c-a459-9bbd93046d94 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:14:45.961115 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a2890281-e3da-4e1c-a459-9bbd93046d94 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f625ca3815214fc182b2a72b596de4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0dbee232ca4952ac57fa31d9061431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:14:45.969318 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a2890281-e3da-4e1c-a459-9bbd93046d94 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] 10.222.0.52 "GET /compute/v2.1/servers/874a96e0-c65a-474d-9f55-93206bd93c46" status: 200 len: 1516 microversion: 2.1 time: 0.150269 Oct 19 04:14:45.969928 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3429/7330] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:14:45 2022] GET /compute/v2.1/servers/874a96e0-c65a-474d-9f55-93206bd93c46 => generated 1516 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:14:46.993786 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e581ce93-315c-4aba-88fc-dcdc4b5f67c6 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:14:46.995053 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e581ce93-315c-4aba-88fc-dcdc4b5f67c6 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] [instance: 874a96e0-c65a-474d-9f55-93206bd93c46] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:14:47.001932 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e581ce93-315c-4aba-88fc-dcdc4b5f67c6 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:14:47.002439 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e581ce93-315c-4aba-88fc-dcdc4b5f67c6 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:14:47.002906 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e581ce93-315c-4aba-88fc-dcdc4b5f67c6 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:14:47.003616 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e581ce93-315c-4aba-88fc-dcdc4b5f67c6 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:14:47.004095 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e581ce93-315c-4aba-88fc-dcdc4b5f67c6 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:14:47.004540 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e581ce93-315c-4aba-88fc-dcdc4b5f67c6 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:14:47.135957 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e581ce93-315c-4aba-88fc-dcdc4b5f67c6 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f625ca3815214fc182b2a72b596de4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0dbee232ca4952ac57fa31d9061431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:14:47.143884 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e581ce93-315c-4aba-88fc-dcdc4b5f67c6 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] 10.222.0.52 "GET /compute/v2.1/servers/874a96e0-c65a-474d-9f55-93206bd93c46" status: 200 len: 1516 microversion: 2.1 time: 0.154040 Oct 19 04:14:47.144584 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3902/7331] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:14:46 2022] GET /compute/v2.1/servers/874a96e0-c65a-474d-9f55-93206bd93c46 => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:14:47.661552 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-06993e43-c678-4541-a708-716ce276fb67 req-44cfe6d9-1e8b-4f5c-b055-664797771c0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "874a96e0-c65a-474d-9f55-93206bd93c46", "name": "network-vif-unplugged", "status": "completed", "tag": "1b118950-f663-499b-b9ff-6ae3ed0086b9"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:14:47.671809 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-06993e43-c678-4541-a708-716ce276fb67 req-44cfe6d9-1e8b-4f5c-b055-664797771c0c service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:14:47.673639 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-06993e43-c678-4541-a708-716ce276fb67 req-44cfe6d9-1e8b-4f5c-b055-664797771c0c service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:14:47.673639 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-06993e43-c678-4541-a708-716ce276fb67 req-44cfe6d9-1e8b-4f5c-b055-664797771c0c service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:14:47.686130 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-06993e43-c678-4541-a708-716ce276fb67 req-44cfe6d9-1e8b-4f5c-b055-664797771c0c service nova] Creating event network-vif-unplugged:1b118950-f663-499b-b9ff-6ae3ed0086b9 for instance 874a96e0-c65a-474d-9f55-93206bd93c46 on n-h1-861333-8 Oct 19 04:14:47.691774 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [req-06993e43-c678-4541-a708-716ce276fb67 req-44cfe6d9-1e8b-4f5c-b055-664797771c0c service nova] Instance 874a96e0-c65a-474d-9f55-93206bd93c46 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-861333-8', 'n-h1-861333-8'} {{(pid=121135) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 04:14:47.703124 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-06993e43-c678-4541-a708-716ce276fb67 req-44cfe6d9-1e8b-4f5c-b055-664797771c0c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045268 Oct 19 04:14:47.703726 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3430/7332] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:14:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:14:48.166842 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-65c34333-01be-4f1b-964d-11f8e1e346cf tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:14:48.167481 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-65c34333-01be-4f1b-964d-11f8e1e346cf tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] [instance: 874a96e0-c65a-474d-9f55-93206bd93c46] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:14:48.174312 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-65c34333-01be-4f1b-964d-11f8e1e346cf tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:14:48.174821 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-65c34333-01be-4f1b-964d-11f8e1e346cf tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:14:48.175284 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-65c34333-01be-4f1b-964d-11f8e1e346cf tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:14:48.176006 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-65c34333-01be-4f1b-964d-11f8e1e346cf tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:14:48.176483 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-65c34333-01be-4f1b-964d-11f8e1e346cf tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:14:48.176931 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-65c34333-01be-4f1b-964d-11f8e1e346cf tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:14:48.316258 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-65c34333-01be-4f1b-964d-11f8e1e346cf tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f625ca3815214fc182b2a72b596de4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0dbee232ca4952ac57fa31d9061431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:14:48.324579 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-65c34333-01be-4f1b-964d-11f8e1e346cf tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] 10.222.0.52 "GET /compute/v2.1/servers/874a96e0-c65a-474d-9f55-93206bd93c46" status: 200 len: 1515 microversion: 2.1 time: 0.161739 Oct 19 04:14:48.331429 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3903/7333] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:14:48 2022] GET /compute/v2.1/servers/874a96e0-c65a-474d-9f55-93206bd93c46 => generated 1515 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:14:49.352092 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-24fb80c3-798d-4e42-b7b7-8ba10652614a tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:14:49.352792 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-24fb80c3-798d-4e42-b7b7-8ba10652614a tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] [instance: 874a96e0-c65a-474d-9f55-93206bd93c46] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:14:49.359039 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-24fb80c3-798d-4e42-b7b7-8ba10652614a tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:14:49.359524 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-24fb80c3-798d-4e42-b7b7-8ba10652614a tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:14:49.359959 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-24fb80c3-798d-4e42-b7b7-8ba10652614a tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:14:49.360644 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-24fb80c3-798d-4e42-b7b7-8ba10652614a tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:14:49.361094 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-24fb80c3-798d-4e42-b7b7-8ba10652614a tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:14:49.361553 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-24fb80c3-798d-4e42-b7b7-8ba10652614a tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:14:49.490109 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-24fb80c3-798d-4e42-b7b7-8ba10652614a tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f625ca3815214fc182b2a72b596de4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0dbee232ca4952ac57fa31d9061431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:14:49.498390 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-24fb80c3-798d-4e42-b7b7-8ba10652614a tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] 10.222.0.52 "GET /compute/v2.1/servers/874a96e0-c65a-474d-9f55-93206bd93c46" status: 200 len: 1513 microversion: 2.1 time: 0.151449 Oct 19 04:14:49.498967 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3431/7334] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:14:49 2022] GET /compute/v2.1/servers/874a96e0-c65a-474d-9f55-93206bd93c46 => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:14:49.718413 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-01c0069b-be81-4d7a-8e51-545da7336228 req-383316e7-4cfb-4e3d-abdb-0a3aa04c67c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "874a96e0-c65a-474d-9f55-93206bd93c46", "tag": "1b118950-f663-499b-b9ff-6ae3ed0086b9"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:14:49.728567 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-01c0069b-be81-4d7a-8e51-545da7336228 req-383316e7-4cfb-4e3d-abdb-0a3aa04c67c4 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:14:49.729062 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-01c0069b-be81-4d7a-8e51-545da7336228 req-383316e7-4cfb-4e3d-abdb-0a3aa04c67c4 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:14:49.729560 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-01c0069b-be81-4d7a-8e51-545da7336228 req-383316e7-4cfb-4e3d-abdb-0a3aa04c67c4 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:14:49.740927 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-01c0069b-be81-4d7a-8e51-545da7336228 req-383316e7-4cfb-4e3d-abdb-0a3aa04c67c4 service nova] Creating event network-changed:1b118950-f663-499b-b9ff-6ae3ed0086b9 for instance 874a96e0-c65a-474d-9f55-93206bd93c46 on n-h1-861333-8 Oct 19 04:14:49.746789 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [req-01c0069b-be81-4d7a-8e51-545da7336228 req-383316e7-4cfb-4e3d-abdb-0a3aa04c67c4 service nova] Instance 874a96e0-c65a-474d-9f55-93206bd93c46 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-861333-8', 'n-h1-861333-8'} {{(pid=121134) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 04:14:49.758248 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-01c0069b-be81-4d7a-8e51-545da7336228 req-383316e7-4cfb-4e3d-abdb-0a3aa04c67c4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043620 Oct 19 04:14:49.758841 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3904/7335] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:14:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:14:50.522215 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-82d15df0-6e42-402e-a37a-47ad26246b7f tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:14:50.523001 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-82d15df0-6e42-402e-a37a-47ad26246b7f tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] [instance: 874a96e0-c65a-474d-9f55-93206bd93c46] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:14:50.530384 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-82d15df0-6e42-402e-a37a-47ad26246b7f tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:14:50.530865 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-82d15df0-6e42-402e-a37a-47ad26246b7f tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:14:50.531329 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-82d15df0-6e42-402e-a37a-47ad26246b7f tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:14:50.532016 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-82d15df0-6e42-402e-a37a-47ad26246b7f tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:14:50.532471 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-82d15df0-6e42-402e-a37a-47ad26246b7f tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:14:50.532889 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-82d15df0-6e42-402e-a37a-47ad26246b7f tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:14:50.662786 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-82d15df0-6e42-402e-a37a-47ad26246b7f tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f625ca3815214fc182b2a72b596de4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0dbee232ca4952ac57fa31d9061431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:14:50.670583 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-82d15df0-6e42-402e-a37a-47ad26246b7f tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] 10.222.0.52 "GET /compute/v2.1/servers/874a96e0-c65a-474d-9f55-93206bd93c46" status: 200 len: 1513 microversion: 2.1 time: 0.152205 Oct 19 04:14:50.671159 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3432/7336] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:14:50 2022] GET /compute/v2.1/servers/874a96e0-c65a-474d-9f55-93206bd93c46 => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:14:51.695764 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-558b638c-102b-4e8d-a9cc-492cdc0f966d tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:14:51.696484 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-558b638c-102b-4e8d-a9cc-492cdc0f966d tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] [instance: 874a96e0-c65a-474d-9f55-93206bd93c46] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:14:51.702739 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-558b638c-102b-4e8d-a9cc-492cdc0f966d tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:14:51.703240 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-558b638c-102b-4e8d-a9cc-492cdc0f966d tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:14:51.703691 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-558b638c-102b-4e8d-a9cc-492cdc0f966d tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:14:51.704431 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-558b638c-102b-4e8d-a9cc-492cdc0f966d tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:14:51.704902 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-558b638c-102b-4e8d-a9cc-492cdc0f966d tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:14:51.705389 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-558b638c-102b-4e8d-a9cc-492cdc0f966d tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:14:51.842762 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-558b638c-102b-4e8d-a9cc-492cdc0f966d tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f625ca3815214fc182b2a72b596de4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0dbee232ca4952ac57fa31d9061431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:14:51.850786 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-558b638c-102b-4e8d-a9cc-492cdc0f966d tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] 10.222.0.52 "GET /compute/v2.1/servers/874a96e0-c65a-474d-9f55-93206bd93c46" status: 200 len: 1513 microversion: 2.1 time: 0.160304 Oct 19 04:14:51.851603 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3905/7337] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:14:51 2022] GET /compute/v2.1/servers/874a96e0-c65a-474d-9f55-93206bd93c46 => generated 1513 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:14:52.874768 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-74c20269-aabb-4b24-8847-dfd5ea300e75 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:14:52.875393 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-74c20269-aabb-4b24-8847-dfd5ea300e75 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] [instance: 874a96e0-c65a-474d-9f55-93206bd93c46] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:14:52.882275 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-74c20269-aabb-4b24-8847-dfd5ea300e75 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:14:52.882768 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-74c20269-aabb-4b24-8847-dfd5ea300e75 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:14:52.883214 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-74c20269-aabb-4b24-8847-dfd5ea300e75 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:14:52.883910 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-74c20269-aabb-4b24-8847-dfd5ea300e75 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:14:52.884370 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-74c20269-aabb-4b24-8847-dfd5ea300e75 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:14:52.884802 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-74c20269-aabb-4b24-8847-dfd5ea300e75 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:14:53.283627 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-74c20269-aabb-4b24-8847-dfd5ea300e75 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f625ca3815214fc182b2a72b596de4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0dbee232ca4952ac57fa31d9061431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:14:53.292159 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-74c20269-aabb-4b24-8847-dfd5ea300e75 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] 10.222.0.52 "GET /compute/v2.1/servers/874a96e0-c65a-474d-9f55-93206bd93c46" status: 200 len: 1510 microversion: 2.1 time: 0.421216 Oct 19 04:14:53.292811 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3433/7338] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:14:52 2022] GET /compute/v2.1/servers/874a96e0-c65a-474d-9f55-93206bd93c46 => generated 1510 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:14:53.314661 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-631eb264-0e5d-43fa-b1a0-f9d3d745e034 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:14:53.315267 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-631eb264-0e5d-43fa-b1a0-f9d3d745e034 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] [instance: 874a96e0-c65a-474d-9f55-93206bd93c46] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:14:53.322446 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-631eb264-0e5d-43fa-b1a0-f9d3d745e034 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:14:53.323024 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-631eb264-0e5d-43fa-b1a0-f9d3d745e034 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:14:53.323552 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-631eb264-0e5d-43fa-b1a0-f9d3d745e034 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:14:53.324338 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-631eb264-0e5d-43fa-b1a0-f9d3d745e034 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:14:53.324876 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-631eb264-0e5d-43fa-b1a0-f9d3d745e034 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:14:53.325328 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-631eb264-0e5d-43fa-b1a0-f9d3d745e034 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:14:53.352218 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-631eb264-0e5d-43fa-b1a0-f9d3d745e034 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] [instance: 874a96e0-c65a-474d-9f55-93206bd93c46] Going to try to terminate instance {{(pid=121134) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 04:14:53.478009 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.compute.api [None req-631eb264-0e5d-43fa-b1a0-f9d3d745e034 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] [instance: 874a96e0-c65a-474d-9f55-93206bd93c46] Found an unconfirmed migration during delete, id: 16, status: finished Oct 19 04:14:55.358217 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-04ce6ca0-21ff-48ce-8f71-4bdabb4df68d req-b03f2404-eb46-43df-a88d-8518fbdc5def service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "874a96e0-c65a-474d-9f55-93206bd93c46", "name": "network-vif-plugged", "status": "completed", "tag": "1b118950-f663-499b-b9ff-6ae3ed0086b9"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:14:55.368480 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-04ce6ca0-21ff-48ce-8f71-4bdabb4df68d req-b03f2404-eb46-43df-a88d-8518fbdc5def service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:14:55.368990 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-04ce6ca0-21ff-48ce-8f71-4bdabb4df68d req-b03f2404-eb46-43df-a88d-8518fbdc5def service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:14:55.369451 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-04ce6ca0-21ff-48ce-8f71-4bdabb4df68d req-b03f2404-eb46-43df-a88d-8518fbdc5def service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:14:55.380229 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-04ce6ca0-21ff-48ce-8f71-4bdabb4df68d req-b03f2404-eb46-43df-a88d-8518fbdc5def service nova] Creating event network-vif-plugged:1b118950-f663-499b-b9ff-6ae3ed0086b9 for instance 874a96e0-c65a-474d-9f55-93206bd93c46 on n-h1-861333-8 Oct 19 04:14:55.385777 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-04ce6ca0-21ff-48ce-8f71-4bdabb4df68d req-b03f2404-eb46-43df-a88d-8518fbdc5def service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031247 Oct 19 04:14:55.386356 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3434/7339] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:14:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 04:14:55.804951 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-631eb264-0e5d-43fa-b1a0-f9d3d745e034 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] 10.222.0.52 "DELETE /compute/v2.1/servers/874a96e0-c65a-474d-9f55-93206bd93c46" status: 204 len: 0 microversion: 2.1 time: 2.493971 Oct 19 04:14:55.805600 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3906/7340] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 04:14:53 2022] DELETE /compute/v2.1/servers/874a96e0-c65a-474d-9f55-93206bd93c46 => generated 0 bytes in 2496 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 04:14:55.815965 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a2dc5f42-5cdf-4f6b-b6a2-0f8ab334f7f2 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:14:55.816678 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a2dc5f42-5cdf-4f6b-b6a2-0f8ab334f7f2 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] [instance: 874a96e0-c65a-474d-9f55-93206bd93c46] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:14:55.823800 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a2dc5f42-5cdf-4f6b-b6a2-0f8ab334f7f2 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:14:55.824658 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a2dc5f42-5cdf-4f6b-b6a2-0f8ab334f7f2 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:14:55.824780 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a2dc5f42-5cdf-4f6b-b6a2-0f8ab334f7f2 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:14:55.825517 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a2dc5f42-5cdf-4f6b-b6a2-0f8ab334f7f2 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:14:55.825980 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a2dc5f42-5cdf-4f6b-b6a2-0f8ab334f7f2 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:14:55.826414 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a2dc5f42-5cdf-4f6b-b6a2-0f8ab334f7f2 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:14:55.956703 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a2dc5f42-5cdf-4f6b-b6a2-0f8ab334f7f2 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f625ca3815214fc182b2a72b596de4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0dbee232ca4952ac57fa31d9061431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:14:55.964504 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a2dc5f42-5cdf-4f6b-b6a2-0f8ab334f7f2 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] 10.222.0.52 "GET /compute/v2.1/servers/874a96e0-c65a-474d-9f55-93206bd93c46" status: 200 len: 1502 microversion: 2.1 time: 0.153133 Oct 19 04:14:55.965070 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3435/7341] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:14:55 2022] GET /compute/v2.1/servers/874a96e0-c65a-474d-9f55-93206bd93c46 => generated 1502 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:14:56.988745 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-30f7275f-a27e-44f7-8ff6-890cceb3da57 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:14:56.989492 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-30f7275f-a27e-44f7-8ff6-890cceb3da57 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] [instance: 874a96e0-c65a-474d-9f55-93206bd93c46] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:14:56.997543 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-30f7275f-a27e-44f7-8ff6-890cceb3da57 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:14:56.998048 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-30f7275f-a27e-44f7-8ff6-890cceb3da57 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:14:56.998506 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-30f7275f-a27e-44f7-8ff6-890cceb3da57 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:14:56.999217 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-30f7275f-a27e-44f7-8ff6-890cceb3da57 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:14:56.999688 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-30f7275f-a27e-44f7-8ff6-890cceb3da57 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:14:57.000131 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-30f7275f-a27e-44f7-8ff6-890cceb3da57 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:14:57.131566 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-30f7275f-a27e-44f7-8ff6-890cceb3da57 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f625ca3815214fc182b2a72b596de4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0dbee232ca4952ac57fa31d9061431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:14:57.139952 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-30f7275f-a27e-44f7-8ff6-890cceb3da57 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] 10.222.0.52 "GET /compute/v2.1/servers/874a96e0-c65a-474d-9f55-93206bd93c46" status: 200 len: 1502 microversion: 2.1 time: 0.155547 Oct 19 04:14:57.140532 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3907/7342] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:14:56 2022] GET /compute/v2.1/servers/874a96e0-c65a-474d-9f55-93206bd93c46 => generated 1502 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:14:58.140901 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-34534a28-ecc3-4b62-afdc-18948daa51e2 req-1f8e41b9-57a3-4bb0-b2cd-f9f629bbb472 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "874a96e0-c65a-474d-9f55-93206bd93c46", "name": "network-vif-deleted", "tag": "1b118950-f663-499b-b9ff-6ae3ed0086b9"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:14:58.152297 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-34534a28-ecc3-4b62-afdc-18948daa51e2 req-1f8e41b9-57a3-4bb0-b2cd-f9f629bbb472 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:14:58.152785 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-34534a28-ecc3-4b62-afdc-18948daa51e2 req-1f8e41b9-57a3-4bb0-b2cd-f9f629bbb472 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:14:58.153223 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-34534a28-ecc3-4b62-afdc-18948daa51e2 req-1f8e41b9-57a3-4bb0-b2cd-f9f629bbb472 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:14:58.163049 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4b603d25-c4f5-4060-bbce-806ca95b910b tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:14:58.163680 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4b603d25-c4f5-4060-bbce-806ca95b910b tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] [instance: 874a96e0-c65a-474d-9f55-93206bd93c46] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:14:58.164331 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-34534a28-ecc3-4b62-afdc-18948daa51e2 req-1f8e41b9-57a3-4bb0-b2cd-f9f629bbb472 service nova] Creating event network-vif-deleted:1b118950-f663-499b-b9ff-6ae3ed0086b9 for instance 874a96e0-c65a-474d-9f55-93206bd93c46 on n-h1-861333-8 Oct 19 04:14:58.169672 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-34534a28-ecc3-4b62-afdc-18948daa51e2 req-1f8e41b9-57a3-4bb0-b2cd-f9f629bbb472 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032896 Oct 19 04:14:58.170288 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3436/7343] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:14:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:14:58.170957 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4b603d25-c4f5-4060-bbce-806ca95b910b tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:14:58.171465 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4b603d25-c4f5-4060-bbce-806ca95b910b tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:14:58.172178 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4b603d25-c4f5-4060-bbce-806ca95b910b tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:14:58.172828 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4b603d25-c4f5-4060-bbce-806ca95b910b tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:14:58.173312 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4b603d25-c4f5-4060-bbce-806ca95b910b tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:14:58.173877 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4b603d25-c4f5-4060-bbce-806ca95b910b tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:14:58.238485 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-4b603d25-c4f5-4060-bbce-806ca95b910b tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f625ca3815214fc182b2a72b596de4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0dbee232ca4952ac57fa31d9061431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:14:58.246414 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4b603d25-c4f5-4060-bbce-806ca95b910b tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] 10.222.0.52 "GET /compute/v2.1/servers/874a96e0-c65a-474d-9f55-93206bd93c46" status: 200 len: 1460 microversion: 2.1 time: 0.087311 Oct 19 04:14:58.246993 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3908/7344] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:14:58 2022] GET /compute/v2.1/servers/874a96e0-c65a-474d-9f55-93206bd93c46 => generated 1460 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:14:59.271413 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1a112dbd-f16c-49f1-9dd8-4d3ce5adc8ff tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:14:59.272111 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1a112dbd-f16c-49f1-9dd8-4d3ce5adc8ff tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] [instance: 874a96e0-c65a-474d-9f55-93206bd93c46] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:14:59.281417 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1a112dbd-f16c-49f1-9dd8-4d3ce5adc8ff tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:14:59.281919 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1a112dbd-f16c-49f1-9dd8-4d3ce5adc8ff tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:14:59.282369 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1a112dbd-f16c-49f1-9dd8-4d3ce5adc8ff tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:14:59.283073 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1a112dbd-f16c-49f1-9dd8-4d3ce5adc8ff tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:14:59.283537 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1a112dbd-f16c-49f1-9dd8-4d3ce5adc8ff tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:14:59.283973 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1a112dbd-f16c-49f1-9dd8-4d3ce5adc8ff tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:14:59.297779 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-1a112dbd-f16c-49f1-9dd8-4d3ce5adc8ff tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] HTTP exception thrown: Instance 874a96e0-c65a-474d-9f55-93206bd93c46 could not be found. Oct 19 04:14:59.299402 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1a112dbd-f16c-49f1-9dd8-4d3ce5adc8ff tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Request method failure captured: Oct 19 04:14:59.299402 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/874a96e0-c65a-474d-9f55-93206bd93c46 HTTP/1.1 Oct 19 04:14:59.299402 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 04:14:59.299402 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 04:14:59.299402 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 04:14:59.299402 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 04:14:59.299402 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 04:14:59.299402 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 04:14:59.299402 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 04:14:59.299402 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 04:14:59.299402 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT3mLxfOqVOLVykhJKMeqHaTHg8DFa5Ia3hyS3fEEzEBm0UVQj4JRx_Yk-qKLX85Jss-XUqpV-k68ktueHSj75VMTvz4AgTV3vQedtgJPAvZJ6vKP0Qq9rlcB-x7Vtj9rr4k7_TFbIwUFwWYXdyrDsWtnhkcqdSOenUux9Wn8tzZnvMY Oct 19 04:14:59.299402 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 04:14:59.299402 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 04:14:59.299402 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 04:14:59.299402 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 04:14:59.299402 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 04:14:59.299402 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 04:14:59.299402 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 2a0dbee232ca4952ac57fa31d9061431 Oct 19 04:14:59.299402 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-DeleteServersTestJSON-127086146 Oct 19 04:14:59.299402 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 04:14:59.299402 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 04:14:59.299402 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2a0dbee232ca4952ac57fa31d9061431"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2a0dbee232ca4952ac57fa31d9061431"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2a0dbee232ca4952ac57fa31d9061431"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2a0dbee232ca4952ac57fa31d9061431", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 04:14:59.299402 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-DeleteServersTestJSON-127086146 Oct 19 04:14:59.299402 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 2a0dbee232ca4952ac57fa31d9061431 Oct 19 04:14:59.299402 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-DeleteServersTestJSON-127086146 Oct 19 04:14:59.299402 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-DeleteServersTestJSON-127086146-project Oct 19 04:14:59.299402 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 04:14:59.299402 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 04:14:59.299402 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: f625ca3815214fc182b2a72b596de4a8 Oct 19 04:14:59.299402 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-DeleteServersTestJSON-127086146-project Oct 19 04:14:59.299402 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 04:14:59.299402 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance 874a96e0-c65a-474d-9f55-93206bd93c46 could not be found. Oct 19 04:14:59.299402 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '874a96e0-c65a-474d-9f55-93206bd93c46'} Oct 19 04:14:59.299402 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 04:14:59.299402 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:14:59.299402 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 04:14:59.299402 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 04:14:59.299402 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 04:14:59.299402 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 04:14:59.299402 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 04:14:59.299402 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 04:14:59.299402 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 04:14:59.299402 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 04:14:59.299402 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 874a96e0-c65a-474d-9f55-93206bd93c46 could not be found. Oct 19 04:14:59.299402 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:14:59.299402 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:14:59.299402 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:14:59.299402 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:14:59.299402 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:14:59.299402 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:14:59.299402 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 04:14:59.299402 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 04:14:59.299402 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 04:14:59.299402 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 04:14:59.299402 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 04:14:59.299402 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 04:14:59.299402 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 04:14:59.299402 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 04:14:59.299402 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 04:14:59.299402 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 04:14:59.299402 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 874a96e0-c65a-474d-9f55-93206bd93c46 could not be found. Oct 19 04:14:59.299402 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:14:59.299402 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:14:59.299402 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:14:59.304145 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:14:59.304145 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:14:59.304145 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:14:59.304145 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 04:14:59.304145 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 04:14:59.304145 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 874a96e0-c65a-474d-9f55-93206bd93c46 could not be found. Oct 19 04:14:59.304145 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:14:59.304145 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1a112dbd-f16c-49f1-9dd8-4d3ce5adc8ff tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Returning 404 to user: Instance 874a96e0-c65a-474d-9f55-93206bd93c46 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 04:14:59.304145 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1a112dbd-f16c-49f1-9dd8-4d3ce5adc8ff tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] 10.222.0.52 "GET /compute/v2.1/servers/874a96e0-c65a-474d-9f55-93206bd93c46" status: 404 len: 111 microversion: 2.1 time: 0.034545 Oct 19 04:14:59.304145 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3437/7345] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:14:59 2022] GET /compute/v2.1/servers/874a96e0-c65a-474d-9f55-93206bd93c46 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 04:14:59.317694 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d3ad73a0-adb3-4f35-abbc-e83f48348ea0 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:14:59.318232 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d3ad73a0-adb3-4f35-abbc-e83f48348ea0 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] [instance: 874a96e0-c65a-474d-9f55-93206bd93c46] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:14:59.325084 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d3ad73a0-adb3-4f35-abbc-e83f48348ea0 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:14:59.325830 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d3ad73a0-adb3-4f35-abbc-e83f48348ea0 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:14:59.326297 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d3ad73a0-adb3-4f35-abbc-e83f48348ea0 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:14:59.327027 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d3ad73a0-adb3-4f35-abbc-e83f48348ea0 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:14:59.327505 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d3ad73a0-adb3-4f35-abbc-e83f48348ea0 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:14:59.327958 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d3ad73a0-adb3-4f35-abbc-e83f48348ea0 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:14:59.342030 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-d3ad73a0-adb3-4f35-abbc-e83f48348ea0 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] HTTP exception thrown: Instance 874a96e0-c65a-474d-9f55-93206bd93c46 could not be found. Oct 19 04:14:59.344763 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d3ad73a0-adb3-4f35-abbc-e83f48348ea0 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Request method failure captured: Oct 19 04:14:59.344763 n-d-861333-8 devstack@n-api.service[121134]: request: DELETE /compute/v2.1/servers/874a96e0-c65a-474d-9f55-93206bd93c46 HTTP/1.1 Oct 19 04:14:59.344763 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 04:14:59.344763 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 04:14:59.344763 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 04:14:59.344763 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 04:14:59.344763 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 04:14:59.344763 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 04:14:59.344763 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 04:14:59.344763 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 04:14:59.344763 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3mLxfOqVOLVykhJKMeqHaTHg8DFa5Ia3hyS3fEEzEBm0UVQj4JRx_Yk-qKLX85Jss-XUqpV-k68ktueHSj75VMTvz4AgTV3vQedtgJPAvZJ6vKP0Qq9rlcB-x7Vtj9rr4k7_TFbIwUFwWYXdyrDsWtnhkcqdSOenUux9Wn8tzZnvMY Oct 19 04:14:59.344763 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 04:14:59.344763 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 04:14:59.344763 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 04:14:59.344763 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 04:14:59.344763 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 04:14:59.344763 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 04:14:59.344763 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 2a0dbee232ca4952ac57fa31d9061431 Oct 19 04:14:59.344763 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-DeleteServersTestJSON-127086146 Oct 19 04:14:59.344763 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 04:14:59.344763 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 04:14:59.344763 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2a0dbee232ca4952ac57fa31d9061431"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2a0dbee232ca4952ac57fa31d9061431"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2a0dbee232ca4952ac57fa31d9061431"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2a0dbee232ca4952ac57fa31d9061431", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 04:14:59.344763 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-DeleteServersTestJSON-127086146 Oct 19 04:14:59.344763 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 2a0dbee232ca4952ac57fa31d9061431 Oct 19 04:14:59.344763 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-DeleteServersTestJSON-127086146 Oct 19 04:14:59.344763 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-DeleteServersTestJSON-127086146-project Oct 19 04:14:59.344763 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 04:14:59.344763 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 04:14:59.344763 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: f625ca3815214fc182b2a72b596de4a8 Oct 19 04:14:59.344763 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-DeleteServersTestJSON-127086146-project Oct 19 04:14:59.344763 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 04:14:59.344763 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance 874a96e0-c65a-474d-9f55-93206bd93c46 could not be found. Oct 19 04:14:59.344763 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '874a96e0-c65a-474d-9f55-93206bd93c46'} Oct 19 04:14:59.344763 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 04:14:59.344763 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:14:59.344763 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 04:14:59.344763 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 04:14:59.344763 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 04:14:59.344763 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 04:14:59.344763 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 04:14:59.344763 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 04:14:59.344763 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 04:14:59.344763 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 04:14:59.344763 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 874a96e0-c65a-474d-9f55-93206bd93c46 could not be found. Oct 19 04:14:59.344763 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:14:59.344763 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:14:59.344763 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:14:59.344763 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:14:59.344763 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:14:59.344763 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:14:59.344763 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 04:14:59.344763 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 04:14:59.344763 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 04:14:59.344763 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 04:14:59.344763 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 04:14:59.344763 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 04:14:59.344763 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 04:14:59.344763 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 04:14:59.344763 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 04:14:59.344763 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 04:14:59.344763 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 04:14:59.344763 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 04:14:59.349300 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 874a96e0-c65a-474d-9f55-93206bd93c46 could not be found. Oct 19 04:14:59.349300 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:14:59.349300 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:14:59.349300 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:14:59.349300 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:14:59.349300 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:14:59.349300 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:14:59.349300 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 04:14:59.349300 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 04:14:59.349300 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 874a96e0-c65a-474d-9f55-93206bd93c46 could not be found. Oct 19 04:14:59.349300 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:14:59.349300 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d3ad73a0-adb3-4f35-abbc-e83f48348ea0 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Returning 404 to user: Instance 874a96e0-c65a-474d-9f55-93206bd93c46 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 04:14:59.349300 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d3ad73a0-adb3-4f35-abbc-e83f48348ea0 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] 10.222.0.52 "DELETE /compute/v2.1/servers/874a96e0-c65a-474d-9f55-93206bd93c46" status: 404 len: 111 microversion: 2.1 time: 0.031552 Oct 19 04:14:59.349300 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3909/7346] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 04:14:59 2022] DELETE /compute/v2.1/servers/874a96e0-c65a-474d-9f55-93206bd93c46 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 04:14:59.354277 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f9f64927-72fd-482c-8c7b-e9a0561d88f9 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:14:59.354899 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f9f64927-72fd-482c-8c7b-e9a0561d88f9 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] [instance: 874a96e0-c65a-474d-9f55-93206bd93c46] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:14:59.360967 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f9f64927-72fd-482c-8c7b-e9a0561d88f9 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:14:59.361505 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f9f64927-72fd-482c-8c7b-e9a0561d88f9 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:14:59.361953 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f9f64927-72fd-482c-8c7b-e9a0561d88f9 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:14:59.362656 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f9f64927-72fd-482c-8c7b-e9a0561d88f9 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:14:59.363114 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f9f64927-72fd-482c-8c7b-e9a0561d88f9 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:14:59.363548 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f9f64927-72fd-482c-8c7b-e9a0561d88f9 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:14:59.376767 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-f9f64927-72fd-482c-8c7b-e9a0561d88f9 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] HTTP exception thrown: Instance 874a96e0-c65a-474d-9f55-93206bd93c46 could not be found. Oct 19 04:14:59.378318 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f9f64927-72fd-482c-8c7b-e9a0561d88f9 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Request method failure captured: Oct 19 04:14:59.378318 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/874a96e0-c65a-474d-9f55-93206bd93c46 HTTP/1.1 Oct 19 04:14:59.378318 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 04:14:59.378318 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 04:14:59.378318 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 04:14:59.378318 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 04:14:59.378318 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 04:14:59.378318 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 04:14:59.378318 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 04:14:59.378318 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 04:14:59.378318 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT3mLxfOqVOLVykhJKMeqHaTHg8DFa5Ia3hyS3fEEzEBm0UVQj4JRx_Yk-qKLX85Jss-XUqpV-k68ktueHSj75VMTvz4AgTV3vQedtgJPAvZJ6vKP0Qq9rlcB-x7Vtj9rr4k7_TFbIwUFwWYXdyrDsWtnhkcqdSOenUux9Wn8tzZnvMY Oct 19 04:14:59.378318 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 04:14:59.378318 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 04:14:59.378318 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 04:14:59.378318 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 04:14:59.378318 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 04:14:59.378318 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 04:14:59.378318 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 2a0dbee232ca4952ac57fa31d9061431 Oct 19 04:14:59.378318 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-DeleteServersTestJSON-127086146 Oct 19 04:14:59.378318 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 04:14:59.378318 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 04:14:59.378318 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2a0dbee232ca4952ac57fa31d9061431"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2a0dbee232ca4952ac57fa31d9061431"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2a0dbee232ca4952ac57fa31d9061431"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2a0dbee232ca4952ac57fa31d9061431", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 04:14:59.378318 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-DeleteServersTestJSON-127086146 Oct 19 04:14:59.378318 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 2a0dbee232ca4952ac57fa31d9061431 Oct 19 04:14:59.378318 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-DeleteServersTestJSON-127086146 Oct 19 04:14:59.378318 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-DeleteServersTestJSON-127086146-project Oct 19 04:14:59.378318 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 04:14:59.378318 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 04:14:59.378318 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: f625ca3815214fc182b2a72b596de4a8 Oct 19 04:14:59.378318 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-DeleteServersTestJSON-127086146-project Oct 19 04:14:59.378318 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 04:14:59.378318 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance 874a96e0-c65a-474d-9f55-93206bd93c46 could not be found. Oct 19 04:14:59.378318 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '874a96e0-c65a-474d-9f55-93206bd93c46'} Oct 19 04:14:59.378318 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 04:14:59.378318 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:14:59.378318 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 04:14:59.378318 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 04:14:59.378318 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 04:14:59.378318 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 04:14:59.378318 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 04:14:59.378318 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 04:14:59.378318 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 04:14:59.378318 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 04:14:59.378318 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 874a96e0-c65a-474d-9f55-93206bd93c46 could not be found. Oct 19 04:14:59.378318 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:14:59.378318 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:14:59.378318 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:14:59.378318 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:14:59.378318 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:14:59.378318 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:14:59.378318 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 04:14:59.378318 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 04:14:59.378318 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 04:14:59.378318 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 04:14:59.378318 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 04:14:59.378318 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 04:14:59.378318 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 04:14:59.378318 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 04:14:59.378318 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 04:14:59.378318 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 04:14:59.378318 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 874a96e0-c65a-474d-9f55-93206bd93c46 could not be found. Oct 19 04:14:59.378318 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:14:59.378318 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:14:59.378318 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:14:59.382923 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:14:59.382923 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:14:59.382923 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:14:59.382923 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 04:14:59.382923 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 04:14:59.382923 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 874a96e0-c65a-474d-9f55-93206bd93c46 could not be found. Oct 19 04:14:59.382923 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:14:59.382923 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f9f64927-72fd-482c-8c7b-e9a0561d88f9 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] Returning 404 to user: Instance 874a96e0-c65a-474d-9f55-93206bd93c46 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 04:14:59.382923 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f9f64927-72fd-482c-8c7b-e9a0561d88f9 tempest-DeleteServersTestJSON-127086146 tempest-DeleteServersTestJSON-127086146-project] 10.222.0.52 "GET /compute/v2.1/servers/874a96e0-c65a-474d-9f55-93206bd93c46" status: 404 len: 111 microversion: 2.1 time: 0.029968 Oct 19 04:14:59.382923 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3438/7347] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:14:59 2022] GET /compute/v2.1/servers/874a96e0-c65a-474d-9f55-93206bd93c46 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 04:15:09.954601 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:15:09.955368 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:15:10.066579 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8a206f3b-2890-49f1-84be-57302afada85 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-606826147", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "networks": [{"uuid": "66f8546e-01aa-48f1-a45c-74eed59f9d28"}]}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:15:10.126530 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-8a206f3b-2890-49f1-84be-57302afada85 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] validate_networks() for [('66f8546e-01aa-48f1-a45c-74eed59f9d28', None, None, None, None, None)] {{(pid=121134) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 04:15:10.504994 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-8a206f3b-2890-49f1-84be-57302afada85 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Flavor limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 04:15:10.505471 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-8a206f3b-2890-49f1-84be-57302afada85 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Image limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 04:15:10.506004 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-8a206f3b-2890-49f1-84be-57302afada85 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Flavor pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 04:15:10.506438 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-8a206f3b-2890-49f1-84be-57302afada85 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Image pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 04:15:10.506875 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-8a206f3b-2890-49f1-84be-57302afada85 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 04:15:10.516142 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8a206f3b-2890-49f1-84be-57302afada85 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:15:10.516647 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8a206f3b-2890-49f1-84be-57302afada85 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:15:10.517139 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8a206f3b-2890-49f1-84be-57302afada85 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:15:10.517931 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8a206f3b-2890-49f1-84be-57302afada85 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:15:10.518413 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8a206f3b-2890-49f1-84be-57302afada85 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:15:10.518862 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8a206f3b-2890-49f1-84be-57302afada85 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:15:10.538952 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-8a206f3b-2890-49f1-84be-57302afada85 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Getting quotas for project c167e643b30048719ceec299de90e284. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 04:15:10.546200 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-8a206f3b-2890-49f1-84be-57302afada85 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Getting quotas for user fa1f7e244b0d4799b3b3b557e78e2bc7 and project c167e643b30048719ceec299de90e284. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 04:15:10.561689 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8a206f3b-2890-49f1-84be-57302afada85 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Going to run 1 instances... {{(pid=121134) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 04:15:10.564352 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8a206f3b-2890-49f1-84be-57302afada85 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 5f487de7-7234-4320-8c36-49c8d9f311cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 04:15:10.667168 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8a206f3b-2890-49f1-84be-57302afada85 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.717269 Oct 19 04:15:10.668122 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3910/7348] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 04:15:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 719 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 04:15:10.679205 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-33adfa80-f95a-4a70-9810-fac38ff41adf tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:15:10.679913 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-33adfa80-f95a-4a70-9810-fac38ff41adf tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 5f487de7-7234-4320-8c36-49c8d9f311cd] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:15:10.683530 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=23 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:15:10.684391 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=53 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:15:10.754957 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-33adfa80-f95a-4a70-9810-fac38ff41adf tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f7e244b0d4799b3b3b557e78e2bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167e643b30048719ceec299de90e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:15:10.763703 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-33adfa80-f95a-4a70-9810-fac38ff41adf tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd" status: 200 len: 1217 microversion: 2.1 time: 0.088362 Oct 19 04:15:10.764289 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3439/7349] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:15:10 2022] GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd => generated 1217 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:15:11.791441 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-bb8e8bdd-57ea-4fdb-a49d-5d689461fb18 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:15:11.792673 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-bb8e8bdd-57ea-4fdb-a49d-5d689461fb18 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 5f487de7-7234-4320-8c36-49c8d9f311cd] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:15:11.801664 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bb8e8bdd-57ea-4fdb-a49d-5d689461fb18 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:15:11.802172 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bb8e8bdd-57ea-4fdb-a49d-5d689461fb18 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:15:11.802830 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bb8e8bdd-57ea-4fdb-a49d-5d689461fb18 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:15:11.803560 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bb8e8bdd-57ea-4fdb-a49d-5d689461fb18 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:15:11.804034 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bb8e8bdd-57ea-4fdb-a49d-5d689461fb18 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:15:11.804484 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bb8e8bdd-57ea-4fdb-a49d-5d689461fb18 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:15:11.876183 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-bb8e8bdd-57ea-4fdb-a49d-5d689461fb18 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f7e244b0d4799b3b3b557e78e2bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167e643b30048719ceec299de90e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:15:11.884679 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-bb8e8bdd-57ea-4fdb-a49d-5d689461fb18 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd" status: 200 len: 1221 microversion: 2.1 time: 0.097377 Oct 19 04:15:11.885883 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3911/7350] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:15:11 2022] GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd => generated 1221 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:15:12.912668 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-84e09430-e4a0-4e48-85d4-dfe0b4216de1 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:15:12.913924 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-84e09430-e4a0-4e48-85d4-dfe0b4216de1 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 5f487de7-7234-4320-8c36-49c8d9f311cd] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:15:12.922927 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-84e09430-e4a0-4e48-85d4-dfe0b4216de1 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:15:12.923736 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-84e09430-e4a0-4e48-85d4-dfe0b4216de1 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:15:12.924262 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-84e09430-e4a0-4e48-85d4-dfe0b4216de1 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:15:12.925059 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-84e09430-e4a0-4e48-85d4-dfe0b4216de1 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:15:12.925619 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-84e09430-e4a0-4e48-85d4-dfe0b4216de1 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:15:12.926128 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-84e09430-e4a0-4e48-85d4-dfe0b4216de1 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:15:12.992435 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-84e09430-e4a0-4e48-85d4-dfe0b4216de1 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f7e244b0d4799b3b3b557e78e2bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167e643b30048719ceec299de90e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:15:13.003416 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-84e09430-e4a0-4e48-85d4-dfe0b4216de1 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd" status: 200 len: 1269 microversion: 2.1 time: 0.098490 Oct 19 04:15:13.005841 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3440/7351] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:15:12 2022] GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd => generated 1269 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:15:14.026992 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b711c4aa-8747-44ce-8bc0-49fc8d2d4931 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:15:14.027643 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b711c4aa-8747-44ce-8bc0-49fc8d2d4931 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 5f487de7-7234-4320-8c36-49c8d9f311cd] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:15:14.034471 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b711c4aa-8747-44ce-8bc0-49fc8d2d4931 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:15:14.034984 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b711c4aa-8747-44ce-8bc0-49fc8d2d4931 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:15:14.035440 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b711c4aa-8747-44ce-8bc0-49fc8d2d4931 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:15:14.036160 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b711c4aa-8747-44ce-8bc0-49fc8d2d4931 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:15:14.036665 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b711c4aa-8747-44ce-8bc0-49fc8d2d4931 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:15:14.037117 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b711c4aa-8747-44ce-8bc0-49fc8d2d4931 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:15:14.324715 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b711c4aa-8747-44ce-8bc0-49fc8d2d4931 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f7e244b0d4799b3b3b557e78e2bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167e643b30048719ceec299de90e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:15:14.332648 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b711c4aa-8747-44ce-8bc0-49fc8d2d4931 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd" status: 200 len: 1317 microversion: 2.1 time: 0.309887 Oct 19 04:15:14.333236 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3912/7352] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:15:14 2022] GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd => generated 1317 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:15:14.828543 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-aac4de4f-1f9a-411c-b054-9cb646e25b2e req-d35ee0b7-9f84-4850-8a69-536a84db5f73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f487de7-7234-4320-8c36-49c8d9f311cd", "tag": "bdf639e9-ec77-4393-a451-af96f9aa4bbc"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:15:14.839631 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-aac4de4f-1f9a-411c-b054-9cb646e25b2e req-d35ee0b7-9f84-4850-8a69-536a84db5f73 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:15:14.840119 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-aac4de4f-1f9a-411c-b054-9cb646e25b2e req-d35ee0b7-9f84-4850-8a69-536a84db5f73 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:15:14.840558 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-aac4de4f-1f9a-411c-b054-9cb646e25b2e req-d35ee0b7-9f84-4850-8a69-536a84db5f73 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:15:14.851701 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-aac4de4f-1f9a-411c-b054-9cb646e25b2e req-d35ee0b7-9f84-4850-8a69-536a84db5f73 service nova] Creating event network-changed:bdf639e9-ec77-4393-a451-af96f9aa4bbc for instance 5f487de7-7234-4320-8c36-49c8d9f311cd on n-h2-861333-8 Oct 19 04:15:14.857698 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-aac4de4f-1f9a-411c-b054-9cb646e25b2e req-d35ee0b7-9f84-4850-8a69-536a84db5f73 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032877 Oct 19 04:15:14.858374 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3441/7353] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:15:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:15:15.357043 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b5de8928-307f-4f3e-8426-153288f9073d tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:15:15.357707 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b5de8928-307f-4f3e-8426-153288f9073d tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 5f487de7-7234-4320-8c36-49c8d9f311cd] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:15:15.364516 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b5de8928-307f-4f3e-8426-153288f9073d tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:15:15.365023 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b5de8928-307f-4f3e-8426-153288f9073d tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:15:15.365520 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b5de8928-307f-4f3e-8426-153288f9073d tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:15:15.373028 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b5de8928-307f-4f3e-8426-153288f9073d tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:15:15.373028 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b5de8928-307f-4f3e-8426-153288f9073d tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:15:15.373028 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b5de8928-307f-4f3e-8426-153288f9073d tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:15:15.595237 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b5de8928-307f-4f3e-8426-153288f9073d tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f7e244b0d4799b3b3b557e78e2bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167e643b30048719ceec299de90e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:15:15.602954 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b5de8928-307f-4f3e-8426-153288f9073d tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd" status: 200 len: 1317 microversion: 2.1 time: 0.250543 Oct 19 04:15:15.608202 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3913/7354] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:15:15 2022] GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd => generated 1317 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:15:16.626933 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5958f654-3dca-47b1-9576-82d9fcce865d tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:15:16.627827 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-5958f654-3dca-47b1-9576-82d9fcce865d tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 5f487de7-7234-4320-8c36-49c8d9f311cd] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:15:16.636167 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5958f654-3dca-47b1-9576-82d9fcce865d tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:15:16.636724 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5958f654-3dca-47b1-9576-82d9fcce865d tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:15:16.637167 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5958f654-3dca-47b1-9576-82d9fcce865d tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:15:16.637907 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5958f654-3dca-47b1-9576-82d9fcce865d tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:15:16.638369 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5958f654-3dca-47b1-9576-82d9fcce865d tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:15:16.638802 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5958f654-3dca-47b1-9576-82d9fcce865d tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:15:16.768108 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-5958f654-3dca-47b1-9576-82d9fcce865d tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f7e244b0d4799b3b3b557e78e2bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167e643b30048719ceec299de90e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:15:16.776619 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5958f654-3dca-47b1-9576-82d9fcce865d tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd" status: 200 len: 1317 microversion: 2.1 time: 0.153960 Oct 19 04:15:16.777183 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3442/7355] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:15:16 2022] GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:15:17.800270 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-554b17b5-ec61-4317-af62-865cb6b21596 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:15:17.800913 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-554b17b5-ec61-4317-af62-865cb6b21596 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 5f487de7-7234-4320-8c36-49c8d9f311cd] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:15:17.807897 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-554b17b5-ec61-4317-af62-865cb6b21596 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:15:17.808401 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-554b17b5-ec61-4317-af62-865cb6b21596 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:15:17.808858 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-554b17b5-ec61-4317-af62-865cb6b21596 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:15:17.809610 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-554b17b5-ec61-4317-af62-865cb6b21596 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:15:17.810085 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-554b17b5-ec61-4317-af62-865cb6b21596 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:15:17.810532 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-554b17b5-ec61-4317-af62-865cb6b21596 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:15:17.936263 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-554b17b5-ec61-4317-af62-865cb6b21596 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f7e244b0d4799b3b3b557e78e2bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167e643b30048719ceec299de90e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:15:17.944002 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-554b17b5-ec61-4317-af62-865cb6b21596 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd" status: 200 len: 1317 microversion: 2.1 time: 0.147779 Oct 19 04:15:17.944581 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3914/7356] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:15:17 2022] GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd => generated 1317 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:15:18.967277 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2bd0ea00-cebc-4d22-8b30-3f14fea9fffc tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:15:18.967894 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-2bd0ea00-cebc-4d22-8b30-3f14fea9fffc tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 5f487de7-7234-4320-8c36-49c8d9f311cd] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:15:18.974709 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2bd0ea00-cebc-4d22-8b30-3f14fea9fffc tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:15:18.975189 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2bd0ea00-cebc-4d22-8b30-3f14fea9fffc tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:15:18.975625 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2bd0ea00-cebc-4d22-8b30-3f14fea9fffc tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:15:18.976318 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2bd0ea00-cebc-4d22-8b30-3f14fea9fffc tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:15:18.976767 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2bd0ea00-cebc-4d22-8b30-3f14fea9fffc tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:15:18.977189 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2bd0ea00-cebc-4d22-8b30-3f14fea9fffc tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:15:19.110747 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-2bd0ea00-cebc-4d22-8b30-3f14fea9fffc tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f7e244b0d4799b3b3b557e78e2bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167e643b30048719ceec299de90e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:15:19.118519 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2bd0ea00-cebc-4d22-8b30-3f14fea9fffc tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd" status: 200 len: 1317 microversion: 2.1 time: 0.155128 Oct 19 04:15:19.119131 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3443/7357] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:15:18 2022] GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:15:20.141079 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1eb6d071-c889-429c-9912-7b5702dccb35 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:15:20.141745 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1eb6d071-c889-429c-9912-7b5702dccb35 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 5f487de7-7234-4320-8c36-49c8d9f311cd] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:15:20.149695 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1eb6d071-c889-429c-9912-7b5702dccb35 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:15:20.150196 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1eb6d071-c889-429c-9912-7b5702dccb35 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:15:20.150685 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1eb6d071-c889-429c-9912-7b5702dccb35 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:15:20.151396 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1eb6d071-c889-429c-9912-7b5702dccb35 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:15:20.151862 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1eb6d071-c889-429c-9912-7b5702dccb35 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:15:20.152300 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1eb6d071-c889-429c-9912-7b5702dccb35 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:15:20.286779 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-1eb6d071-c889-429c-9912-7b5702dccb35 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f7e244b0d4799b3b3b557e78e2bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167e643b30048719ceec299de90e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:15:20.295376 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1eb6d071-c889-429c-9912-7b5702dccb35 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd" status: 200 len: 1317 microversion: 2.1 time: 0.158227 Oct 19 04:15:20.295956 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3915/7358] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:15:20 2022] GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:15:21.319711 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-71f13cba-ee27-4754-9238-f1700275286f tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:15:21.320330 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-71f13cba-ee27-4754-9238-f1700275286f tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 5f487de7-7234-4320-8c36-49c8d9f311cd] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:15:21.323718 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:15:21.330104 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-71f13cba-ee27-4754-9238-f1700275286f tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:15:21.330104 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-71f13cba-ee27-4754-9238-f1700275286f tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:15:21.330104 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-71f13cba-ee27-4754-9238-f1700275286f tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:15:21.330104 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-71f13cba-ee27-4754-9238-f1700275286f tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:15:21.330525 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-71f13cba-ee27-4754-9238-f1700275286f tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:15:21.330952 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-71f13cba-ee27-4754-9238-f1700275286f tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:15:21.468544 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-71f13cba-ee27-4754-9238-f1700275286f tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f7e244b0d4799b3b3b557e78e2bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167e643b30048719ceec299de90e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:15:21.476244 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-71f13cba-ee27-4754-9238-f1700275286f tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd" status: 200 len: 1317 microversion: 2.1 time: 0.160442 Oct 19 04:15:21.476818 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3444/7359] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:15:21 2022] GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:15:22.194479 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-bf5ac67f-58b7-4e59-9415-7382d67bf2e1 req-6fd978a6-baa0-4222-9b95-06bdda3459bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f487de7-7234-4320-8c36-49c8d9f311cd", "name": "network-vif-plugged", "status": "completed", "tag": "bdf639e9-ec77-4393-a451-af96f9aa4bbc"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:15:22.200155 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:15:22.200887 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=6 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:15:22.207074 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-bf5ac67f-58b7-4e59-9415-7382d67bf2e1 req-6fd978a6-baa0-4222-9b95-06bdda3459bd service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:15:22.207611 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-bf5ac67f-58b7-4e59-9415-7382d67bf2e1 req-6fd978a6-baa0-4222-9b95-06bdda3459bd service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:15:22.210777 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-bf5ac67f-58b7-4e59-9415-7382d67bf2e1 req-6fd978a6-baa0-4222-9b95-06bdda3459bd service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:15:22.219436 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-bf5ac67f-58b7-4e59-9415-7382d67bf2e1 req-6fd978a6-baa0-4222-9b95-06bdda3459bd service nova] Creating event network-vif-plugged:bdf639e9-ec77-4393-a451-af96f9aa4bbc for instance 5f487de7-7234-4320-8c36-49c8d9f311cd on n-h2-861333-8 Oct 19 04:15:22.224693 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-bf5ac67f-58b7-4e59-9415-7382d67bf2e1 req-6fd978a6-baa0-4222-9b95-06bdda3459bd service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034045 Oct 19 04:15:22.225330 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3916/7360] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:15:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:15:22.499239 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-265e3462-5479-4f86-9227-5c159221a65e tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:15:22.499865 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-265e3462-5479-4f86-9227-5c159221a65e tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 5f487de7-7234-4320-8c36-49c8d9f311cd] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:15:22.506932 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-265e3462-5479-4f86-9227-5c159221a65e tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:15:22.507369 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-265e3462-5479-4f86-9227-5c159221a65e tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:15:22.507819 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-265e3462-5479-4f86-9227-5c159221a65e tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:15:22.508525 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-265e3462-5479-4f86-9227-5c159221a65e tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:15:22.508987 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-265e3462-5479-4f86-9227-5c159221a65e tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:15:22.509454 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-265e3462-5479-4f86-9227-5c159221a65e tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:15:22.636877 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-265e3462-5479-4f86-9227-5c159221a65e tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f7e244b0d4799b3b3b557e78e2bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167e643b30048719ceec299de90e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:15:22.644754 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-265e3462-5479-4f86-9227-5c159221a65e tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd" status: 200 len: 1317 microversion: 2.1 time: 0.149414 Oct 19 04:15:22.645334 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3445/7361] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:15:22 2022] GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:15:23.670158 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-34c0be4f-5e78-4d83-9b48-e64090375890 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:15:23.670882 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-34c0be4f-5e78-4d83-9b48-e64090375890 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 5f487de7-7234-4320-8c36-49c8d9f311cd] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:15:23.678329 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-34c0be4f-5e78-4d83-9b48-e64090375890 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:15:23.678829 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-34c0be4f-5e78-4d83-9b48-e64090375890 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:15:23.679285 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-34c0be4f-5e78-4d83-9b48-e64090375890 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:15:23.679995 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-34c0be4f-5e78-4d83-9b48-e64090375890 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:15:23.680467 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-34c0be4f-5e78-4d83-9b48-e64090375890 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:15:23.680917 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-34c0be4f-5e78-4d83-9b48-e64090375890 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:15:23.868327 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-34c0be4f-5e78-4d83-9b48-e64090375890 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f7e244b0d4799b3b3b557e78e2bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167e643b30048719ceec299de90e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:15:23.876161 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-34c0be4f-5e78-4d83-9b48-e64090375890 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd" status: 200 len: 1317 microversion: 2.1 time: 0.210995 Oct 19 04:15:23.876737 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3917/7362] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:15:23 2022] GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd => generated 1317 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:15:24.899109 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1b6804c2-d1dc-47c2-bd36-a0a359fcc20d tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:15:24.899745 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1b6804c2-d1dc-47c2-bd36-a0a359fcc20d tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 5f487de7-7234-4320-8c36-49c8d9f311cd] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:15:24.907198 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1b6804c2-d1dc-47c2-bd36-a0a359fcc20d tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:15:24.907694 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1b6804c2-d1dc-47c2-bd36-a0a359fcc20d tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:15:24.908136 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1b6804c2-d1dc-47c2-bd36-a0a359fcc20d tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:15:24.908834 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1b6804c2-d1dc-47c2-bd36-a0a359fcc20d tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:15:24.909298 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1b6804c2-d1dc-47c2-bd36-a0a359fcc20d tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:15:24.909759 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1b6804c2-d1dc-47c2-bd36-a0a359fcc20d tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:15:25.039144 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-1b6804c2-d1dc-47c2-bd36-a0a359fcc20d tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f7e244b0d4799b3b3b557e78e2bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167e643b30048719ceec299de90e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:15:25.047473 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1b6804c2-d1dc-47c2-bd36-a0a359fcc20d tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd" status: 200 len: 1507 microversion: 2.1 time: 0.152667 Oct 19 04:15:25.048084 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3446/7363] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:15:24 2022] GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:15:25.069739 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-be496af3-9791-4766-b183-dc6dd2f2878e tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:15:25.070379 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-be496af3-9791-4766-b183-dc6dd2f2878e tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 5f487de7-7234-4320-8c36-49c8d9f311cd] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:15:25.077838 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-be496af3-9791-4766-b183-dc6dd2f2878e tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:15:25.078342 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-be496af3-9791-4766-b183-dc6dd2f2878e tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:15:25.078805 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-be496af3-9791-4766-b183-dc6dd2f2878e tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:15:25.079518 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-be496af3-9791-4766-b183-dc6dd2f2878e tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:15:25.079993 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-be496af3-9791-4766-b183-dc6dd2f2878e tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:15:25.080447 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-be496af3-9791-4766-b183-dc6dd2f2878e tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:15:25.211430 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-be496af3-9791-4766-b183-dc6dd2f2878e tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f7e244b0d4799b3b3b557e78e2bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167e643b30048719ceec299de90e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:15:25.219915 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-be496af3-9791-4766-b183-dc6dd2f2878e tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd" status: 200 len: 1507 microversion: 2.1 time: 0.154105 Oct 19 04:15:25.220498 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3918/7364] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:15:25 2022] GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:15:25.241478 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7a72980a-7560-4dd3-a555-bbad1c7eedc3 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:15:25.243876 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7a72980a-7560-4dd3-a555-bbad1c7eedc3 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 5f487de7-7234-4320-8c36-49c8d9f311cd] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:15:25.249820 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7a72980a-7560-4dd3-a555-bbad1c7eedc3 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:15:25.250316 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7a72980a-7560-4dd3-a555-bbad1c7eedc3 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:15:25.250766 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7a72980a-7560-4dd3-a555-bbad1c7eedc3 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:15:25.251466 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7a72980a-7560-4dd3-a555-bbad1c7eedc3 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:15:25.251926 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7a72980a-7560-4dd3-a555-bbad1c7eedc3 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:15:25.252363 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7a72980a-7560-4dd3-a555-bbad1c7eedc3 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:15:25.368242 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7a72980a-7560-4dd3-a555-bbad1c7eedc3 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "PUT /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd" status: 200 len: 1079 microversion: 2.1 time: 0.130596 Oct 19 04:15:25.368918 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3447/7365] 10.222.0.52 () {60 vars in 1256 bytes} [Wed Oct 19 04:15:25 2022] PUT /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd => generated 1079 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:15:25.387956 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d116fe49-e826-4632-890d-7682f9bbba0c tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:15:25.388587 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d116fe49-e826-4632-890d-7682f9bbba0c tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 5f487de7-7234-4320-8c36-49c8d9f311cd] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:15:25.394768 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d116fe49-e826-4632-890d-7682f9bbba0c tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:15:25.395267 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d116fe49-e826-4632-890d-7682f9bbba0c tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:15:25.395718 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d116fe49-e826-4632-890d-7682f9bbba0c tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:15:25.396515 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d116fe49-e826-4632-890d-7682f9bbba0c tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:15:25.396982 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d116fe49-e826-4632-890d-7682f9bbba0c tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:15:25.397719 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d116fe49-e826-4632-890d-7682f9bbba0c tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:15:25.526317 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d116fe49-e826-4632-890d-7682f9bbba0c tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f7e244b0d4799b3b3b557e78e2bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167e643b30048719ceec299de90e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:15:25.534013 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d116fe49-e826-4632-890d-7682f9bbba0c tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd" status: 200 len: 1505 microversion: 2.1 time: 0.150461 Oct 19 04:15:25.534597 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3919/7366] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:15:25 2022] GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd => generated 1505 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:15:25.555623 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4794c99c-7484-4fef-b799-22a74ab03e00 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:15:25.556251 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4794c99c-7484-4fef-b799-22a74ab03e00 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 5f487de7-7234-4320-8c36-49c8d9f311cd] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:15:25.562912 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4794c99c-7484-4fef-b799-22a74ab03e00 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:15:25.563406 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4794c99c-7484-4fef-b799-22a74ab03e00 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:15:25.563855 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4794c99c-7484-4fef-b799-22a74ab03e00 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:15:25.564551 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4794c99c-7484-4fef-b799-22a74ab03e00 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:15:25.565053 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4794c99c-7484-4fef-b799-22a74ab03e00 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:15:25.565569 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4794c99c-7484-4fef-b799-22a74ab03e00 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:15:25.699688 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4794c99c-7484-4fef-b799-22a74ab03e00 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f7e244b0d4799b3b3b557e78e2bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167e643b30048719ceec299de90e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:15:25.707338 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4794c99c-7484-4fef-b799-22a74ab03e00 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd" status: 200 len: 1505 microversion: 2.1 time: 0.155688 Oct 19 04:15:25.707907 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3448/7367] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:15:25 2022] GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd => generated 1505 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:15:25.729189 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ea7762f6-bc6b-42a5-9e8f-812ec73f76be tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:15:25.731543 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ea7762f6-bc6b-42a5-9e8f-812ec73f76be tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 5f487de7-7234-4320-8c36-49c8d9f311cd] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:15:25.737481 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ea7762f6-bc6b-42a5-9e8f-812ec73f76be tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:15:25.737983 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ea7762f6-bc6b-42a5-9e8f-812ec73f76be tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:15:25.738433 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ea7762f6-bc6b-42a5-9e8f-812ec73f76be tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:15:25.739136 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ea7762f6-bc6b-42a5-9e8f-812ec73f76be tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:15:25.739635 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ea7762f6-bc6b-42a5-9e8f-812ec73f76be tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:15:25.740080 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ea7762f6-bc6b-42a5-9e8f-812ec73f76be tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:15:25.771409 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ea7762f6-bc6b-42a5-9e8f-812ec73f76be tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'fa1f7e244b0d4799b3b3b557e78e2bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167e643b30048719ceec299de90e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:15:25.778318 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ea7762f6-bc6b-42a5-9e8f-812ec73f76be tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 5f487de7-7234-4320-8c36-49c8d9f311cd] Old instance type m1.heat2, new instance type m1.heat {{(pid=121134) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 19 04:15:25.785351 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-ea7762f6-bc6b-42a5-9e8f-812ec73f76be tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Flavor limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 04:15:25.785819 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-ea7762f6-bc6b-42a5-9e8f-812ec73f76be tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Image limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 04:15:25.786378 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-ea7762f6-bc6b-42a5-9e8f-812ec73f76be tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Flavor pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 04:15:25.786809 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-ea7762f6-bc6b-42a5-9e8f-812ec73f76be tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Image pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 04:15:25.787271 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-ea7762f6-bc6b-42a5-9e8f-812ec73f76be tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 04:15:25.934094 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ea7762f6-bc6b-42a5-9e8f-812ec73f76be tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "POST /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd/action" status: 202 len: 0 microversion: 2.1 time: 0.208995 Oct 19 04:15:25.934710 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3920/7368] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 04:15:25 2022] POST /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd/action => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 04:15:25.947866 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-56939cf1-8151-427d-a7ac-11c7cf0a1314 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:15:25.948600 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-56939cf1-8151-427d-a7ac-11c7cf0a1314 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 5f487de7-7234-4320-8c36-49c8d9f311cd] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:15:25.960452 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-56939cf1-8151-427d-a7ac-11c7cf0a1314 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:15:25.961323 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-56939cf1-8151-427d-a7ac-11c7cf0a1314 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:15:25.962160 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-56939cf1-8151-427d-a7ac-11c7cf0a1314 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:15:25.963481 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-56939cf1-8151-427d-a7ac-11c7cf0a1314 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:15:25.964146 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-56939cf1-8151-427d-a7ac-11c7cf0a1314 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:15:25.964629 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-56939cf1-8151-427d-a7ac-11c7cf0a1314 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:15:26.105096 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-56939cf1-8151-427d-a7ac-11c7cf0a1314 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f7e244b0d4799b3b3b557e78e2bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167e643b30048719ceec299de90e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:15:26.113490 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-56939cf1-8151-427d-a7ac-11c7cf0a1314 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd" status: 200 len: 1516 microversion: 2.1 time: 0.173849 Oct 19 04:15:26.114374 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3449/7369] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:15:25 2022] GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd => generated 1516 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:15:27.137187 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d59de45c-34bf-4862-bbd5-16aee0170a34 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:15:27.137854 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d59de45c-34bf-4862-bbd5-16aee0170a34 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 5f487de7-7234-4320-8c36-49c8d9f311cd] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:15:27.145729 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d59de45c-34bf-4862-bbd5-16aee0170a34 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:15:27.146232 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d59de45c-34bf-4862-bbd5-16aee0170a34 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:15:27.146685 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d59de45c-34bf-4862-bbd5-16aee0170a34 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:15:27.147653 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d59de45c-34bf-4862-bbd5-16aee0170a34 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:15:27.150677 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d59de45c-34bf-4862-bbd5-16aee0170a34 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:15:27.150677 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d59de45c-34bf-4862-bbd5-16aee0170a34 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:15:27.282065 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d59de45c-34bf-4862-bbd5-16aee0170a34 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f7e244b0d4799b3b3b557e78e2bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167e643b30048719ceec299de90e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:15:27.290079 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d59de45c-34bf-4862-bbd5-16aee0170a34 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd" status: 200 len: 1516 microversion: 2.1 time: 0.156991 Oct 19 04:15:27.293214 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3921/7370] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:15:27 2022] GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd => generated 1516 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:15:28.314004 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7626afe8-03e3-4ee8-964d-f36f06c0d8af tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:15:28.314746 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7626afe8-03e3-4ee8-964d-f36f06c0d8af tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 5f487de7-7234-4320-8c36-49c8d9f311cd] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:15:28.321981 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7626afe8-03e3-4ee8-964d-f36f06c0d8af tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:15:28.322540 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7626afe8-03e3-4ee8-964d-f36f06c0d8af tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:15:28.322990 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7626afe8-03e3-4ee8-964d-f36f06c0d8af tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:15:28.323700 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7626afe8-03e3-4ee8-964d-f36f06c0d8af tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:15:28.324165 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7626afe8-03e3-4ee8-964d-f36f06c0d8af tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:15:28.324602 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7626afe8-03e3-4ee8-964d-f36f06c0d8af tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:15:28.538927 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7626afe8-03e3-4ee8-964d-f36f06c0d8af tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f7e244b0d4799b3b3b557e78e2bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167e643b30048719ceec299de90e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:15:28.547329 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7626afe8-03e3-4ee8-964d-f36f06c0d8af tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd" status: 200 len: 1516 microversion: 2.1 time: 0.237272 Oct 19 04:15:28.547924 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3450/7371] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:15:28 2022] GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd => generated 1516 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:15:29.570632 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-39f84a42-2db4-4c1a-9ec2-3a9201ab7251 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:15:29.571246 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-39f84a42-2db4-4c1a-9ec2-3a9201ab7251 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 5f487de7-7234-4320-8c36-49c8d9f311cd] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:15:29.578914 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-39f84a42-2db4-4c1a-9ec2-3a9201ab7251 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:15:29.582326 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-39f84a42-2db4-4c1a-9ec2-3a9201ab7251 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:15:29.582326 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-39f84a42-2db4-4c1a-9ec2-3a9201ab7251 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:15:29.582326 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-39f84a42-2db4-4c1a-9ec2-3a9201ab7251 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:15:29.582326 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-39f84a42-2db4-4c1a-9ec2-3a9201ab7251 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:15:29.582326 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-39f84a42-2db4-4c1a-9ec2-3a9201ab7251 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:15:29.716285 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-39f84a42-2db4-4c1a-9ec2-3a9201ab7251 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f7e244b0d4799b3b3b557e78e2bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167e643b30048719ceec299de90e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:15:29.724111 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-39f84a42-2db4-4c1a-9ec2-3a9201ab7251 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd" status: 200 len: 1521 microversion: 2.1 time: 0.157614 Oct 19 04:15:29.724689 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3922/7372] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:15:29 2022] GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:15:30.748844 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b034e22b-20e3-4188-b58d-fa633c2a2a00 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:15:30.749514 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b034e22b-20e3-4188-b58d-fa633c2a2a00 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 5f487de7-7234-4320-8c36-49c8d9f311cd] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:15:30.756155 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b034e22b-20e3-4188-b58d-fa633c2a2a00 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:15:30.756647 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b034e22b-20e3-4188-b58d-fa633c2a2a00 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:15:30.757218 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b034e22b-20e3-4188-b58d-fa633c2a2a00 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:15:30.758292 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b034e22b-20e3-4188-b58d-fa633c2a2a00 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:15:30.758759 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b034e22b-20e3-4188-b58d-fa633c2a2a00 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:15:30.759192 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b034e22b-20e3-4188-b58d-fa633c2a2a00 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:15:30.888219 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b034e22b-20e3-4188-b58d-fa633c2a2a00 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f7e244b0d4799b3b3b557e78e2bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167e643b30048719ceec299de90e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:15:30.896085 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b034e22b-20e3-4188-b58d-fa633c2a2a00 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd" status: 200 len: 1521 microversion: 2.1 time: 0.151327 Oct 19 04:15:30.896651 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3451/7373] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:15:30 2022] GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:15:31.919641 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d50b4416-2568-49d4-a1bb-e4e329bc5134 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:15:31.920288 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d50b4416-2568-49d4-a1bb-e4e329bc5134 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 5f487de7-7234-4320-8c36-49c8d9f311cd] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:15:31.927445 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d50b4416-2568-49d4-a1bb-e4e329bc5134 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:15:31.927948 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d50b4416-2568-49d4-a1bb-e4e329bc5134 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:15:31.928396 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d50b4416-2568-49d4-a1bb-e4e329bc5134 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:15:31.929103 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d50b4416-2568-49d4-a1bb-e4e329bc5134 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:15:31.929688 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d50b4416-2568-49d4-a1bb-e4e329bc5134 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:15:31.930130 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d50b4416-2568-49d4-a1bb-e4e329bc5134 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:15:32.062728 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d50b4416-2568-49d4-a1bb-e4e329bc5134 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f7e244b0d4799b3b3b557e78e2bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167e643b30048719ceec299de90e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:15:32.070635 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d50b4416-2568-49d4-a1bb-e4e329bc5134 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd" status: 200 len: 1521 microversion: 2.1 time: 0.154955 Oct 19 04:15:32.071253 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3923/7374] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:15:31 2022] GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:15:33.094604 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a9c63d83-cf80-462d-8aa1-993bc519d50d tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:15:33.095152 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a9c63d83-cf80-462d-8aa1-993bc519d50d tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 5f487de7-7234-4320-8c36-49c8d9f311cd] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:15:33.102156 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a9c63d83-cf80-462d-8aa1-993bc519d50d tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:15:33.102648 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a9c63d83-cf80-462d-8aa1-993bc519d50d tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:15:33.103741 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a9c63d83-cf80-462d-8aa1-993bc519d50d tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:15:33.104453 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a9c63d83-cf80-462d-8aa1-993bc519d50d tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:15:33.104913 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a9c63d83-cf80-462d-8aa1-993bc519d50d tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:15:33.105349 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a9c63d83-cf80-462d-8aa1-993bc519d50d tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:15:33.231696 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a9c63d83-cf80-462d-8aa1-993bc519d50d tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f7e244b0d4799b3b3b557e78e2bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167e643b30048719ceec299de90e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:15:33.239363 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a9c63d83-cf80-462d-8aa1-993bc519d50d tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd" status: 200 len: 1521 microversion: 2.1 time: 0.148786 Oct 19 04:15:33.239933 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3452/7375] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:15:33 2022] GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:15:34.262540 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7cd3c550-0f34-420a-9217-9bf3bf7c07e3 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:15:34.263181 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7cd3c550-0f34-420a-9217-9bf3bf7c07e3 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 5f487de7-7234-4320-8c36-49c8d9f311cd] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:15:34.270306 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7cd3c550-0f34-420a-9217-9bf3bf7c07e3 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:15:34.270801 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7cd3c550-0f34-420a-9217-9bf3bf7c07e3 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:15:34.271251 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7cd3c550-0f34-420a-9217-9bf3bf7c07e3 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:15:34.271951 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7cd3c550-0f34-420a-9217-9bf3bf7c07e3 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:15:34.272671 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7cd3c550-0f34-420a-9217-9bf3bf7c07e3 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:15:34.273110 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7cd3c550-0f34-420a-9217-9bf3bf7c07e3 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:15:34.402150 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-7cd3c550-0f34-420a-9217-9bf3bf7c07e3 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f7e244b0d4799b3b3b557e78e2bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167e643b30048719ceec299de90e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:15:34.409999 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7cd3c550-0f34-420a-9217-9bf3bf7c07e3 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd" status: 200 len: 1521 microversion: 2.1 time: 0.151414 Oct 19 04:15:34.410578 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3924/7376] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:15:34 2022] GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:15:35.433994 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-76ce134f-b5ab-42fa-a144-b4f581c0a17f tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:15:35.434614 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-76ce134f-b5ab-42fa-a144-b4f581c0a17f tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 5f487de7-7234-4320-8c36-49c8d9f311cd] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:15:35.441482 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-76ce134f-b5ab-42fa-a144-b4f581c0a17f tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:15:35.441967 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-76ce134f-b5ab-42fa-a144-b4f581c0a17f tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:15:35.442403 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-76ce134f-b5ab-42fa-a144-b4f581c0a17f tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:15:35.443092 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-76ce134f-b5ab-42fa-a144-b4f581c0a17f tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:15:35.443543 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-76ce134f-b5ab-42fa-a144-b4f581c0a17f tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:15:35.443967 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-76ce134f-b5ab-42fa-a144-b4f581c0a17f tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:15:35.579595 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-76ce134f-b5ab-42fa-a144-b4f581c0a17f tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f7e244b0d4799b3b3b557e78e2bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167e643b30048719ceec299de90e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:15:35.587470 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-76ce134f-b5ab-42fa-a144-b4f581c0a17f tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd" status: 200 len: 1521 microversion: 2.1 time: 0.157883 Oct 19 04:15:35.588041 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3453/7377] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:15:35 2022] GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:15:36.609638 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e9dbcf0c-dd6e-47a8-828d-306c47c6a2c7 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:15:36.610264 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e9dbcf0c-dd6e-47a8-828d-306c47c6a2c7 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 5f487de7-7234-4320-8c36-49c8d9f311cd] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:15:36.617153 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e9dbcf0c-dd6e-47a8-828d-306c47c6a2c7 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:15:36.617681 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e9dbcf0c-dd6e-47a8-828d-306c47c6a2c7 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:15:36.618134 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e9dbcf0c-dd6e-47a8-828d-306c47c6a2c7 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:15:36.618832 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e9dbcf0c-dd6e-47a8-828d-306c47c6a2c7 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:15:36.619297 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e9dbcf0c-dd6e-47a8-828d-306c47c6a2c7 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:15:36.619738 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e9dbcf0c-dd6e-47a8-828d-306c47c6a2c7 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:15:36.751475 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e9dbcf0c-dd6e-47a8-828d-306c47c6a2c7 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f7e244b0d4799b3b3b557e78e2bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167e643b30048719ceec299de90e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:15:36.759817 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e9dbcf0c-dd6e-47a8-828d-306c47c6a2c7 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd" status: 200 len: 1521 microversion: 2.1 time: 0.153458 Oct 19 04:15:36.760386 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3925/7378] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:15:36 2022] GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:15:37.784228 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-12c921b3-34fc-4221-8ca4-1cbb89de03c2 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:15:37.784858 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-12c921b3-34fc-4221-8ca4-1cbb89de03c2 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 5f487de7-7234-4320-8c36-49c8d9f311cd] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:15:37.792942 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-12c921b3-34fc-4221-8ca4-1cbb89de03c2 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:15:37.792942 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-12c921b3-34fc-4221-8ca4-1cbb89de03c2 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:15:37.793451 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-12c921b3-34fc-4221-8ca4-1cbb89de03c2 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:15:37.794145 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-12c921b3-34fc-4221-8ca4-1cbb89de03c2 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:15:37.794603 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-12c921b3-34fc-4221-8ca4-1cbb89de03c2 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:15:37.795027 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-12c921b3-34fc-4221-8ca4-1cbb89de03c2 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:15:37.929829 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-12c921b3-34fc-4221-8ca4-1cbb89de03c2 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f7e244b0d4799b3b3b557e78e2bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167e643b30048719ceec299de90e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:15:37.937881 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-12c921b3-34fc-4221-8ca4-1cbb89de03c2 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd" status: 200 len: 1521 microversion: 2.1 time: 0.157668 Oct 19 04:15:37.938524 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3454/7379] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:15:37 2022] GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:15:38.961103 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-685e3592-00ea-4581-acbb-195008fa9790 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:15:38.961766 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-685e3592-00ea-4581-acbb-195008fa9790 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 5f487de7-7234-4320-8c36-49c8d9f311cd] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:15:38.969048 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-685e3592-00ea-4581-acbb-195008fa9790 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:15:38.969583 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-685e3592-00ea-4581-acbb-195008fa9790 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:15:38.970032 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-685e3592-00ea-4581-acbb-195008fa9790 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:15:38.970726 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-685e3592-00ea-4581-acbb-195008fa9790 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:15:38.971187 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-685e3592-00ea-4581-acbb-195008fa9790 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:15:38.971622 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-685e3592-00ea-4581-acbb-195008fa9790 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:15:38.991403 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:15:39.099292 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-685e3592-00ea-4581-acbb-195008fa9790 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f7e244b0d4799b3b3b557e78e2bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167e643b30048719ceec299de90e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:15:39.107399 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-685e3592-00ea-4581-acbb-195008fa9790 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd" status: 200 len: 1521 microversion: 2.1 time: 0.150138 Oct 19 04:15:39.107975 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3926/7380] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:15:38 2022] GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:15:40.130875 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9ee43aed-efcb-4e1d-9828-cc1edff85d95 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:15:40.131527 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9ee43aed-efcb-4e1d-9828-cc1edff85d95 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 5f487de7-7234-4320-8c36-49c8d9f311cd] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:15:40.138162 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9ee43aed-efcb-4e1d-9828-cc1edff85d95 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:15:40.138654 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9ee43aed-efcb-4e1d-9828-cc1edff85d95 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:15:40.139092 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9ee43aed-efcb-4e1d-9828-cc1edff85d95 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:15:40.139786 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9ee43aed-efcb-4e1d-9828-cc1edff85d95 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:15:40.140249 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9ee43aed-efcb-4e1d-9828-cc1edff85d95 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:15:40.140679 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9ee43aed-efcb-4e1d-9828-cc1edff85d95 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:15:40.266721 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-9ee43aed-efcb-4e1d-9828-cc1edff85d95 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f7e244b0d4799b3b3b557e78e2bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167e643b30048719ceec299de90e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:15:40.274800 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9ee43aed-efcb-4e1d-9828-cc1edff85d95 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd" status: 200 len: 1521 microversion: 2.1 time: 0.147821 Oct 19 04:15:40.275369 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3455/7381] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:15:40 2022] GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:15:41.297222 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5643bbf4-19bc-4315-952d-1fffa5650d5e tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:15:41.297878 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5643bbf4-19bc-4315-952d-1fffa5650d5e tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 5f487de7-7234-4320-8c36-49c8d9f311cd] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:15:41.300576 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:15:41.305302 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5643bbf4-19bc-4315-952d-1fffa5650d5e tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:15:41.306336 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5643bbf4-19bc-4315-952d-1fffa5650d5e tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:15:41.306787 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5643bbf4-19bc-4315-952d-1fffa5650d5e tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:15:41.307486 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5643bbf4-19bc-4315-952d-1fffa5650d5e tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:15:41.307978 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5643bbf4-19bc-4315-952d-1fffa5650d5e tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:15:41.308418 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5643bbf4-19bc-4315-952d-1fffa5650d5e tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:15:41.442013 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5643bbf4-19bc-4315-952d-1fffa5650d5e tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f7e244b0d4799b3b3b557e78e2bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167e643b30048719ceec299de90e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:15:41.450283 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5643bbf4-19bc-4315-952d-1fffa5650d5e tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd" status: 200 len: 1521 microversion: 2.1 time: 0.156981 Oct 19 04:15:41.450848 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3927/7382] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:15:41 2022] GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:15:42.473119 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-99c55daf-eac8-4f0d-bdb6-e14f1fd5f4ed tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:15:42.473769 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-99c55daf-eac8-4f0d-bdb6-e14f1fd5f4ed tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 5f487de7-7234-4320-8c36-49c8d9f311cd] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:15:42.481049 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-99c55daf-eac8-4f0d-bdb6-e14f1fd5f4ed tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:15:42.481577 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-99c55daf-eac8-4f0d-bdb6-e14f1fd5f4ed tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:15:42.482024 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-99c55daf-eac8-4f0d-bdb6-e14f1fd5f4ed tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:15:42.482717 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-99c55daf-eac8-4f0d-bdb6-e14f1fd5f4ed tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:15:42.483172 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-99c55daf-eac8-4f0d-bdb6-e14f1fd5f4ed tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:15:42.483598 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-99c55daf-eac8-4f0d-bdb6-e14f1fd5f4ed tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:15:42.501845 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:15:42.612231 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-99c55daf-eac8-4f0d-bdb6-e14f1fd5f4ed tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f7e244b0d4799b3b3b557e78e2bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167e643b30048719ceec299de90e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:15:42.620439 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-99c55daf-eac8-4f0d-bdb6-e14f1fd5f4ed tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd" status: 200 len: 1521 microversion: 2.1 time: 0.151307 Oct 19 04:15:42.621003 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3456/7383] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:15:42 2022] GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:15:43.643059 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-11bc6c4f-6d64-4d75-9edd-d09bc1ce0cde tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:15:43.643724 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-11bc6c4f-6d64-4d75-9edd-d09bc1ce0cde tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 5f487de7-7234-4320-8c36-49c8d9f311cd] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:15:43.651221 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-11bc6c4f-6d64-4d75-9edd-d09bc1ce0cde tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:15:43.651699 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-11bc6c4f-6d64-4d75-9edd-d09bc1ce0cde tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:15:43.652200 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-11bc6c4f-6d64-4d75-9edd-d09bc1ce0cde tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:15:43.652920 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-11bc6c4f-6d64-4d75-9edd-d09bc1ce0cde tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:15:43.653420 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-11bc6c4f-6d64-4d75-9edd-d09bc1ce0cde tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:15:43.656923 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-11bc6c4f-6d64-4d75-9edd-d09bc1ce0cde tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:15:43.785880 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-11bc6c4f-6d64-4d75-9edd-d09bc1ce0cde tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f7e244b0d4799b3b3b557e78e2bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167e643b30048719ceec299de90e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:15:43.793588 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-11bc6c4f-6d64-4d75-9edd-d09bc1ce0cde tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd" status: 200 len: 1521 microversion: 2.1 time: 0.154487 Oct 19 04:15:43.794155 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3928/7384] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:15:43 2022] GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:15:44.817029 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1d173b48-6b9d-4fff-af87-2017a33a863a tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:15:44.817677 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1d173b48-6b9d-4fff-af87-2017a33a863a tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 5f487de7-7234-4320-8c36-49c8d9f311cd] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:15:44.820641 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=39 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:15:44.825994 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1d173b48-6b9d-4fff-af87-2017a33a863a tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:15:44.827541 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1d173b48-6b9d-4fff-af87-2017a33a863a tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:15:44.827986 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1d173b48-6b9d-4fff-af87-2017a33a863a tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:15:44.828717 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1d173b48-6b9d-4fff-af87-2017a33a863a tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:15:44.829178 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1d173b48-6b9d-4fff-af87-2017a33a863a tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:15:44.829638 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1d173b48-6b9d-4fff-af87-2017a33a863a tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:15:44.958326 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-1d173b48-6b9d-4fff-af87-2017a33a863a tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f7e244b0d4799b3b3b557e78e2bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167e643b30048719ceec299de90e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:15:44.966635 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1d173b48-6b9d-4fff-af87-2017a33a863a tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd" status: 200 len: 1521 microversion: 2.1 time: 0.153807 Oct 19 04:15:44.967212 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3457/7385] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:15:44 2022] GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:15:45.990424 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-071e0d25-08fb-435c-9daa-da1ac0799d04 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:15:45.991064 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-071e0d25-08fb-435c-9daa-da1ac0799d04 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 5f487de7-7234-4320-8c36-49c8d9f311cd] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:15:45.998100 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-071e0d25-08fb-435c-9daa-da1ac0799d04 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:15:45.998606 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-071e0d25-08fb-435c-9daa-da1ac0799d04 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:15:45.999064 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-071e0d25-08fb-435c-9daa-da1ac0799d04 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:15:45.999775 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-071e0d25-08fb-435c-9daa-da1ac0799d04 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:15:46.000250 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-071e0d25-08fb-435c-9daa-da1ac0799d04 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:15:46.000697 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-071e0d25-08fb-435c-9daa-da1ac0799d04 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:15:46.131103 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-071e0d25-08fb-435c-9daa-da1ac0799d04 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f7e244b0d4799b3b3b557e78e2bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167e643b30048719ceec299de90e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:15:46.139370 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-071e0d25-08fb-435c-9daa-da1ac0799d04 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd" status: 200 len: 1521 microversion: 2.1 time: 0.152967 Oct 19 04:15:46.139944 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3929/7386] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:15:45 2022] GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:15:47.163331 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-bce29250-7e82-4c71-b5c3-e048ec8a47d4 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:15:47.163958 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-bce29250-7e82-4c71-b5c3-e048ec8a47d4 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 5f487de7-7234-4320-8c36-49c8d9f311cd] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:15:47.171380 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bce29250-7e82-4c71-b5c3-e048ec8a47d4 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:15:47.171908 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bce29250-7e82-4c71-b5c3-e048ec8a47d4 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:15:47.172356 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bce29250-7e82-4c71-b5c3-e048ec8a47d4 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:15:47.173058 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bce29250-7e82-4c71-b5c3-e048ec8a47d4 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:15:47.173563 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bce29250-7e82-4c71-b5c3-e048ec8a47d4 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:15:47.174006 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bce29250-7e82-4c71-b5c3-e048ec8a47d4 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:15:47.301772 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-bce29250-7e82-4c71-b5c3-e048ec8a47d4 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f7e244b0d4799b3b3b557e78e2bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167e643b30048719ceec299de90e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:15:47.309534 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-bce29250-7e82-4c71-b5c3-e048ec8a47d4 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd" status: 200 len: 1521 microversion: 2.1 time: 0.150247 Oct 19 04:15:47.310108 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3458/7387] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:15:47 2022] GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:15:48.331672 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5225be6b-4eff-4e68-ae46-eab8739a1e7f tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:15:48.332237 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5225be6b-4eff-4e68-ae46-eab8739a1e7f tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 5f487de7-7234-4320-8c36-49c8d9f311cd] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:15:48.339096 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5225be6b-4eff-4e68-ae46-eab8739a1e7f tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:15:48.339591 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5225be6b-4eff-4e68-ae46-eab8739a1e7f tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:15:48.340046 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5225be6b-4eff-4e68-ae46-eab8739a1e7f tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:15:48.340739 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5225be6b-4eff-4e68-ae46-eab8739a1e7f tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:15:48.341204 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5225be6b-4eff-4e68-ae46-eab8739a1e7f tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:15:48.341677 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5225be6b-4eff-4e68-ae46-eab8739a1e7f tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:15:48.468578 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5225be6b-4eff-4e68-ae46-eab8739a1e7f tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f7e244b0d4799b3b3b557e78e2bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167e643b30048719ceec299de90e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:15:48.476520 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5225be6b-4eff-4e68-ae46-eab8739a1e7f tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd" status: 200 len: 1521 microversion: 2.1 time: 0.148780 Oct 19 04:15:48.477824 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3930/7388] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:15:48 2022] GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:15:49.500079 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6ed43e0d-19f5-4c44-b39f-a13b530cf858 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:15:49.500778 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6ed43e0d-19f5-4c44-b39f-a13b530cf858 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 5f487de7-7234-4320-8c36-49c8d9f311cd] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:15:49.508325 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6ed43e0d-19f5-4c44-b39f-a13b530cf858 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:15:49.509481 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6ed43e0d-19f5-4c44-b39f-a13b530cf858 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:15:49.509933 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6ed43e0d-19f5-4c44-b39f-a13b530cf858 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:15:49.510639 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6ed43e0d-19f5-4c44-b39f-a13b530cf858 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:15:49.511104 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6ed43e0d-19f5-4c44-b39f-a13b530cf858 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:15:49.511541 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6ed43e0d-19f5-4c44-b39f-a13b530cf858 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:15:49.645644 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-6ed43e0d-19f5-4c44-b39f-a13b530cf858 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f7e244b0d4799b3b3b557e78e2bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167e643b30048719ceec299de90e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:15:49.653999 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6ed43e0d-19f5-4c44-b39f-a13b530cf858 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd" status: 200 len: 1521 microversion: 2.1 time: 0.157825 Oct 19 04:15:49.654578 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3459/7389] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:15:49 2022] GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:15:50.677198 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-37b4be67-5cf6-4e34-a99a-0ab813d5ea9c tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:15:50.677856 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-37b4be67-5cf6-4e34-a99a-0ab813d5ea9c tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 5f487de7-7234-4320-8c36-49c8d9f311cd] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:15:50.684934 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-37b4be67-5cf6-4e34-a99a-0ab813d5ea9c tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:15:50.685463 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-37b4be67-5cf6-4e34-a99a-0ab813d5ea9c tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:15:50.685917 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-37b4be67-5cf6-4e34-a99a-0ab813d5ea9c tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:15:50.686621 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-37b4be67-5cf6-4e34-a99a-0ab813d5ea9c tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:15:50.687239 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-37b4be67-5cf6-4e34-a99a-0ab813d5ea9c tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:15:50.687684 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-37b4be67-5cf6-4e34-a99a-0ab813d5ea9c tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:15:50.818278 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-37b4be67-5cf6-4e34-a99a-0ab813d5ea9c tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f7e244b0d4799b3b3b557e78e2bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167e643b30048719ceec299de90e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:15:50.826542 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-37b4be67-5cf6-4e34-a99a-0ab813d5ea9c tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd" status: 200 len: 1521 microversion: 2.1 time: 0.153377 Oct 19 04:15:50.827142 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3931/7390] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:15:50 2022] GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:15:51.850639 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-090ca521-dc89-4e2e-9dda-038af2a5f1ed tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:15:51.851259 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-090ca521-dc89-4e2e-9dda-038af2a5f1ed tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 5f487de7-7234-4320-8c36-49c8d9f311cd] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:15:51.858856 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-090ca521-dc89-4e2e-9dda-038af2a5f1ed tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:15:51.859346 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-090ca521-dc89-4e2e-9dda-038af2a5f1ed tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:15:51.859803 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-090ca521-dc89-4e2e-9dda-038af2a5f1ed tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:15:51.860499 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-090ca521-dc89-4e2e-9dda-038af2a5f1ed tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:15:51.860959 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-090ca521-dc89-4e2e-9dda-038af2a5f1ed tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:15:51.861421 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-090ca521-dc89-4e2e-9dda-038af2a5f1ed tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:15:51.992139 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-090ca521-dc89-4e2e-9dda-038af2a5f1ed tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f7e244b0d4799b3b3b557e78e2bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167e643b30048719ceec299de90e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:15:52.000048 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-090ca521-dc89-4e2e-9dda-038af2a5f1ed tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd" status: 200 len: 1521 microversion: 2.1 time: 0.153330 Oct 19 04:15:52.003933 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3460/7391] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:15:51 2022] GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:15:53.023149 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-217f577c-1640-42ef-ace5-1e51cc2661f6 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:15:53.023803 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-217f577c-1640-42ef-ace5-1e51cc2661f6 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 5f487de7-7234-4320-8c36-49c8d9f311cd] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:15:53.030565 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-217f577c-1640-42ef-ace5-1e51cc2661f6 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:15:53.031059 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-217f577c-1640-42ef-ace5-1e51cc2661f6 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:15:53.031508 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-217f577c-1640-42ef-ace5-1e51cc2661f6 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:15:53.032202 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-217f577c-1640-42ef-ace5-1e51cc2661f6 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:15:53.032665 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-217f577c-1640-42ef-ace5-1e51cc2661f6 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:15:53.033102 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-217f577c-1640-42ef-ace5-1e51cc2661f6 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:15:53.159162 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-217f577c-1640-42ef-ace5-1e51cc2661f6 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f7e244b0d4799b3b3b557e78e2bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167e643b30048719ceec299de90e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:15:53.167350 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-217f577c-1640-42ef-ace5-1e51cc2661f6 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd" status: 200 len: 1521 microversion: 2.1 time: 0.148446 Oct 19 04:15:53.167919 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3932/7392] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:15:53 2022] GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:15:54.190879 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4eec796e-cd19-4c16-ac16-88cc8b20c505 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:15:54.191502 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4eec796e-cd19-4c16-ac16-88cc8b20c505 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 5f487de7-7234-4320-8c36-49c8d9f311cd] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:15:54.200018 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4eec796e-cd19-4c16-ac16-88cc8b20c505 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:15:54.200507 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4eec796e-cd19-4c16-ac16-88cc8b20c505 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:15:54.200948 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4eec796e-cd19-4c16-ac16-88cc8b20c505 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:15:54.201675 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4eec796e-cd19-4c16-ac16-88cc8b20c505 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:15:54.202132 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4eec796e-cd19-4c16-ac16-88cc8b20c505 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:15:54.202561 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4eec796e-cd19-4c16-ac16-88cc8b20c505 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:15:54.332577 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4eec796e-cd19-4c16-ac16-88cc8b20c505 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f7e244b0d4799b3b3b557e78e2bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167e643b30048719ceec299de90e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:15:54.340389 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4eec796e-cd19-4c16-ac16-88cc8b20c505 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd" status: 200 len: 1521 microversion: 2.1 time: 0.153393 Oct 19 04:15:54.340983 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3461/7393] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:15:54 2022] GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:15:55.364033 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9bbb631b-03bb-41c4-bf84-6ef9e739ba70 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:15:55.364702 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9bbb631b-03bb-41c4-bf84-6ef9e739ba70 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 5f487de7-7234-4320-8c36-49c8d9f311cd] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:15:55.372216 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9bbb631b-03bb-41c4-bf84-6ef9e739ba70 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:15:55.372726 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9bbb631b-03bb-41c4-bf84-6ef9e739ba70 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:15:55.373185 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9bbb631b-03bb-41c4-bf84-6ef9e739ba70 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:15:55.373931 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9bbb631b-03bb-41c4-bf84-6ef9e739ba70 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:15:55.374409 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9bbb631b-03bb-41c4-bf84-6ef9e739ba70 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:15:55.374861 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9bbb631b-03bb-41c4-bf84-6ef9e739ba70 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:15:55.505221 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9bbb631b-03bb-41c4-bf84-6ef9e739ba70 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f7e244b0d4799b3b3b557e78e2bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167e643b30048719ceec299de90e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:15:55.513012 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9bbb631b-03bb-41c4-bf84-6ef9e739ba70 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd" status: 200 len: 1521 microversion: 2.1 time: 0.152932 Oct 19 04:15:55.513623 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3933/7394] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:15:55 2022] GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:15:56.536324 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-cc8906ee-f688-4c0b-8cb8-91b68caa9618 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:15:56.536947 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-cc8906ee-f688-4c0b-8cb8-91b68caa9618 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 5f487de7-7234-4320-8c36-49c8d9f311cd] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:15:56.543885 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cc8906ee-f688-4c0b-8cb8-91b68caa9618 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:15:56.544383 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cc8906ee-f688-4c0b-8cb8-91b68caa9618 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:15:56.544829 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cc8906ee-f688-4c0b-8cb8-91b68caa9618 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:15:56.545572 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cc8906ee-f688-4c0b-8cb8-91b68caa9618 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:15:56.546034 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cc8906ee-f688-4c0b-8cb8-91b68caa9618 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:15:56.546467 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cc8906ee-f688-4c0b-8cb8-91b68caa9618 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:15:56.675535 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-cc8906ee-f688-4c0b-8cb8-91b68caa9618 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f7e244b0d4799b3b3b557e78e2bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167e643b30048719ceec299de90e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:15:56.683988 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-cc8906ee-f688-4c0b-8cb8-91b68caa9618 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd" status: 200 len: 1521 microversion: 2.1 time: 0.151592 Oct 19 04:15:56.684566 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3462/7395] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:15:56 2022] GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:15:57.707358 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-cd42fba7-90a9-42dc-950f-dc441f525139 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:15:57.707991 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-cd42fba7-90a9-42dc-950f-dc441f525139 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 5f487de7-7234-4320-8c36-49c8d9f311cd] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:15:57.716375 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cd42fba7-90a9-42dc-950f-dc441f525139 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:15:57.716881 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cd42fba7-90a9-42dc-950f-dc441f525139 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:15:57.717333 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cd42fba7-90a9-42dc-950f-dc441f525139 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:15:57.718319 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cd42fba7-90a9-42dc-950f-dc441f525139 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:15:57.718796 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cd42fba7-90a9-42dc-950f-dc441f525139 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:15:57.719248 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cd42fba7-90a9-42dc-950f-dc441f525139 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:15:57.850499 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-cd42fba7-90a9-42dc-950f-dc441f525139 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f7e244b0d4799b3b3b557e78e2bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167e643b30048719ceec299de90e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:15:57.858882 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-cd42fba7-90a9-42dc-950f-dc441f525139 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd" status: 200 len: 1521 microversion: 2.1 time: 0.155578 Oct 19 04:15:57.859454 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3934/7396] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:15:57 2022] GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:15:58.882085 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-623c93a4-f2c9-4046-9dc5-55a74e5d368e tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:15:58.882707 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-623c93a4-f2c9-4046-9dc5-55a74e5d368e tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 5f487de7-7234-4320-8c36-49c8d9f311cd] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:15:58.889658 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-623c93a4-f2c9-4046-9dc5-55a74e5d368e tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:15:58.890151 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-623c93a4-f2c9-4046-9dc5-55a74e5d368e tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:15:58.890595 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-623c93a4-f2c9-4046-9dc5-55a74e5d368e tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:15:58.891292 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-623c93a4-f2c9-4046-9dc5-55a74e5d368e tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:15:58.891749 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-623c93a4-f2c9-4046-9dc5-55a74e5d368e tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:15:58.892181 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-623c93a4-f2c9-4046-9dc5-55a74e5d368e tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:15:59.020267 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-623c93a4-f2c9-4046-9dc5-55a74e5d368e tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f7e244b0d4799b3b3b557e78e2bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167e643b30048719ceec299de90e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:15:59.028426 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-623c93a4-f2c9-4046-9dc5-55a74e5d368e tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd" status: 200 len: 1521 microversion: 2.1 time: 0.150234 Oct 19 04:15:59.029007 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3463/7397] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:15:58 2022] GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:16:00.052154 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b6622a27-67c9-4f2e-a96b-1cfbf75dbfec tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:16:00.052714 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b6622a27-67c9-4f2e-a96b-1cfbf75dbfec tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 5f487de7-7234-4320-8c36-49c8d9f311cd] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:16:00.059520 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b6622a27-67c9-4f2e-a96b-1cfbf75dbfec tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:00.060037 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b6622a27-67c9-4f2e-a96b-1cfbf75dbfec tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:00.060666 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b6622a27-67c9-4f2e-a96b-1cfbf75dbfec tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:00.061447 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b6622a27-67c9-4f2e-a96b-1cfbf75dbfec tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:00.061956 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b6622a27-67c9-4f2e-a96b-1cfbf75dbfec tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:00.062411 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b6622a27-67c9-4f2e-a96b-1cfbf75dbfec tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:00.203301 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b6622a27-67c9-4f2e-a96b-1cfbf75dbfec tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f7e244b0d4799b3b3b557e78e2bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167e643b30048719ceec299de90e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:16:00.211021 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b6622a27-67c9-4f2e-a96b-1cfbf75dbfec tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd" status: 200 len: 1521 microversion: 2.1 time: 0.163238 Oct 19 04:16:00.211593 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3935/7398] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:16:00 2022] GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:16:01.234990 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b34c3349-06bf-4c94-9ed7-e78ddd787c91 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:16:01.235812 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b34c3349-06bf-4c94-9ed7-e78ddd787c91 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 5f487de7-7234-4320-8c36-49c8d9f311cd] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:16:01.242550 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b34c3349-06bf-4c94-9ed7-e78ddd787c91 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:01.243045 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b34c3349-06bf-4c94-9ed7-e78ddd787c91 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:01.243493 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b34c3349-06bf-4c94-9ed7-e78ddd787c91 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:01.244799 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b34c3349-06bf-4c94-9ed7-e78ddd787c91 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:01.245266 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b34c3349-06bf-4c94-9ed7-e78ddd787c91 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:01.245730 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b34c3349-06bf-4c94-9ed7-e78ddd787c91 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:01.377921 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b34c3349-06bf-4c94-9ed7-e78ddd787c91 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f7e244b0d4799b3b3b557e78e2bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167e643b30048719ceec299de90e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:16:01.385861 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b34c3349-06bf-4c94-9ed7-e78ddd787c91 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd" status: 200 len: 1521 microversion: 2.1 time: 0.154803 Oct 19 04:16:01.388596 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3464/7399] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:16:01 2022] GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:16:01.990243 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-e322e95b-40f7-473b-bc60-b8a9be3616c0 req-80232a74-8cb2-42c6-84ad-09dd6400fb03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f487de7-7234-4320-8c36-49c8d9f311cd", "name": "network-vif-unplugged", "status": "completed", "tag": "bdf639e9-ec77-4393-a451-af96f9aa4bbc"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:16:02.001117 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-e322e95b-40f7-473b-bc60-b8a9be3616c0 req-80232a74-8cb2-42c6-84ad-09dd6400fb03 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:02.001692 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-e322e95b-40f7-473b-bc60-b8a9be3616c0 req-80232a74-8cb2-42c6-84ad-09dd6400fb03 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:02.002150 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-e322e95b-40f7-473b-bc60-b8a9be3616c0 req-80232a74-8cb2-42c6-84ad-09dd6400fb03 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:02.014251 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-e322e95b-40f7-473b-bc60-b8a9be3616c0 req-80232a74-8cb2-42c6-84ad-09dd6400fb03 service nova] Creating event network-vif-unplugged:bdf639e9-ec77-4393-a451-af96f9aa4bbc for instance 5f487de7-7234-4320-8c36-49c8d9f311cd on n-h1-861333-8 Oct 19 04:16:02.019569 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [req-e322e95b-40f7-473b-bc60-b8a9be3616c0 req-80232a74-8cb2-42c6-84ad-09dd6400fb03 service nova] Instance 5f487de7-7234-4320-8c36-49c8d9f311cd is migrating within the same cell, copying events to all relevant hosts: {'n-h2-861333-8', 'n-h1-861333-8'} {{(pid=121134) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 04:16:02.030943 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-e322e95b-40f7-473b-bc60-b8a9be3616c0 req-80232a74-8cb2-42c6-84ad-09dd6400fb03 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044473 Oct 19 04:16:02.031607 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3936/7400] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:16:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 04:16:02.409221 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6b0cc29f-373a-4952-8daa-05d3871dd9c8 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:16:02.410130 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6b0cc29f-373a-4952-8daa-05d3871dd9c8 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 5f487de7-7234-4320-8c36-49c8d9f311cd] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:16:02.418958 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6b0cc29f-373a-4952-8daa-05d3871dd9c8 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:02.419444 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6b0cc29f-373a-4952-8daa-05d3871dd9c8 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:02.420034 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6b0cc29f-373a-4952-8daa-05d3871dd9c8 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:02.420772 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6b0cc29f-373a-4952-8daa-05d3871dd9c8 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:02.421178 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6b0cc29f-373a-4952-8daa-05d3871dd9c8 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:02.421646 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6b0cc29f-373a-4952-8daa-05d3871dd9c8 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:02.895747 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-6b0cc29f-373a-4952-8daa-05d3871dd9c8 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f7e244b0d4799b3b3b557e78e2bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167e643b30048719ceec299de90e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:16:02.904707 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6b0cc29f-373a-4952-8daa-05d3871dd9c8 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd" status: 200 len: 1520 microversion: 2.1 time: 0.499640 Oct 19 04:16:02.905299 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3465/7401] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:16:02 2022] GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd => generated 1520 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:16:03.930271 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3d04906a-21b8-4aa0-a39c-b19f1002832c tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:16:03.930993 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3d04906a-21b8-4aa0-a39c-b19f1002832c tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 5f487de7-7234-4320-8c36-49c8d9f311cd] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:16:03.938251 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3d04906a-21b8-4aa0-a39c-b19f1002832c tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:03.938773 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3d04906a-21b8-4aa0-a39c-b19f1002832c tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:03.939239 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3d04906a-21b8-4aa0-a39c-b19f1002832c tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:03.940085 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3d04906a-21b8-4aa0-a39c-b19f1002832c tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:03.940620 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3d04906a-21b8-4aa0-a39c-b19f1002832c tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:03.941071 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3d04906a-21b8-4aa0-a39c-b19f1002832c tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:04.045884 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-066289a5-14ff-4b4e-bbcb-ffa5a8b5b8ee req-cd73b6a3-eb10-40ae-8026-3ea2e96e4d15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f487de7-7234-4320-8c36-49c8d9f311cd", "tag": "bdf639e9-ec77-4393-a451-af96f9aa4bbc"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:16:04.056456 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-066289a5-14ff-4b4e-bbcb-ffa5a8b5b8ee req-cd73b6a3-eb10-40ae-8026-3ea2e96e4d15 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:04.057600 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-066289a5-14ff-4b4e-bbcb-ffa5a8b5b8ee req-cd73b6a3-eb10-40ae-8026-3ea2e96e4d15 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:04.058065 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-066289a5-14ff-4b4e-bbcb-ffa5a8b5b8ee req-cd73b6a3-eb10-40ae-8026-3ea2e96e4d15 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:04.069601 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-066289a5-14ff-4b4e-bbcb-ffa5a8b5b8ee req-cd73b6a3-eb10-40ae-8026-3ea2e96e4d15 service nova] Creating event network-changed:bdf639e9-ec77-4393-a451-af96f9aa4bbc for instance 5f487de7-7234-4320-8c36-49c8d9f311cd on n-h1-861333-8 Oct 19 04:16:04.072058 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-3d04906a-21b8-4aa0-a39c-b19f1002832c tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f7e244b0d4799b3b3b557e78e2bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167e643b30048719ceec299de90e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:16:04.074964 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [req-066289a5-14ff-4b4e-bbcb-ffa5a8b5b8ee req-cd73b6a3-eb10-40ae-8026-3ea2e96e4d15 service nova] Instance 5f487de7-7234-4320-8c36-49c8d9f311cd is migrating within the same cell, copying events to all relevant hosts: {'n-h2-861333-8', 'n-h1-861333-8'} {{(pid=121135) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 04:16:04.080897 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3d04906a-21b8-4aa0-a39c-b19f1002832c tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd" status: 200 len: 1518 microversion: 2.1 time: 0.155982 Oct 19 04:16:04.091651 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3937/7402] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:16:03 2022] GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd => generated 1518 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:16:04.092813 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-066289a5-14ff-4b4e-bbcb-ffa5a8b5b8ee req-cd73b6a3-eb10-40ae-8026-3ea2e96e4d15 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044219 Oct 19 04:16:04.092813 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3466/7403] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:16:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 04:16:05.103794 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9328c9bb-97a2-44cb-b1c0-94164c82fa73 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:16:05.104433 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9328c9bb-97a2-44cb-b1c0-94164c82fa73 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 5f487de7-7234-4320-8c36-49c8d9f311cd] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:16:05.111277 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9328c9bb-97a2-44cb-b1c0-94164c82fa73 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:05.111783 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9328c9bb-97a2-44cb-b1c0-94164c82fa73 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:05.112245 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9328c9bb-97a2-44cb-b1c0-94164c82fa73 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:05.112970 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9328c9bb-97a2-44cb-b1c0-94164c82fa73 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:05.113487 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9328c9bb-97a2-44cb-b1c0-94164c82fa73 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:05.113946 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9328c9bb-97a2-44cb-b1c0-94164c82fa73 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:05.249696 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9328c9bb-97a2-44cb-b1c0-94164c82fa73 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f7e244b0d4799b3b3b557e78e2bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167e643b30048719ceec299de90e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:16:05.257528 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9328c9bb-97a2-44cb-b1c0-94164c82fa73 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd" status: 200 len: 1518 microversion: 2.1 time: 0.157715 Oct 19 04:16:05.258124 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3938/7404] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:16:05 2022] GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd => generated 1518 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:16:06.283247 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9f588388-b2e4-4dfa-9685-252498108d03 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:16:06.283982 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9f588388-b2e4-4dfa-9685-252498108d03 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 5f487de7-7234-4320-8c36-49c8d9f311cd] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:16:06.290326 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9f588388-b2e4-4dfa-9685-252498108d03 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:06.290818 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9f588388-b2e4-4dfa-9685-252498108d03 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:06.291895 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9f588388-b2e4-4dfa-9685-252498108d03 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:06.292642 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9f588388-b2e4-4dfa-9685-252498108d03 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:06.293102 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9f588388-b2e4-4dfa-9685-252498108d03 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:06.293574 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9f588388-b2e4-4dfa-9685-252498108d03 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:06.442288 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-9f588388-b2e4-4dfa-9685-252498108d03 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f7e244b0d4799b3b3b557e78e2bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167e643b30048719ceec299de90e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:16:06.450636 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9f588388-b2e4-4dfa-9685-252498108d03 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd" status: 200 len: 1518 microversion: 2.1 time: 0.172506 Oct 19 04:16:06.451232 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3467/7405] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:16:06 2022] GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd => generated 1518 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:16:07.473986 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-74c88c68-637f-42be-ad7a-be186dd2fb5c tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:16:07.474617 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-74c88c68-637f-42be-ad7a-be186dd2fb5c tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 5f487de7-7234-4320-8c36-49c8d9f311cd] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:16:07.481504 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-74c88c68-637f-42be-ad7a-be186dd2fb5c tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:07.482008 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-74c88c68-637f-42be-ad7a-be186dd2fb5c tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:07.482462 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-74c88c68-637f-42be-ad7a-be186dd2fb5c tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:07.483165 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-74c88c68-637f-42be-ad7a-be186dd2fb5c tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:07.483639 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-74c88c68-637f-42be-ad7a-be186dd2fb5c tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:07.484083 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-74c88c68-637f-42be-ad7a-be186dd2fb5c tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:07.611517 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-74c88c68-637f-42be-ad7a-be186dd2fb5c tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f7e244b0d4799b3b3b557e78e2bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167e643b30048719ceec299de90e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:16:07.619832 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-74c88c68-637f-42be-ad7a-be186dd2fb5c tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd" status: 200 len: 1515 microversion: 2.1 time: 0.149252 Oct 19 04:16:07.620439 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3939/7406] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:16:07 2022] GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd => generated 1515 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:16:07.660277 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-8b6304bf-97da-4217-96bb-0c1990ea6736 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:16:07.660814 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-8b6304bf-97da-4217-96bb-0c1990ea6736 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 5f487de7-7234-4320-8c36-49c8d9f311cd] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:16:07.667746 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8b6304bf-97da-4217-96bb-0c1990ea6736 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:07.670147 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8b6304bf-97da-4217-96bb-0c1990ea6736 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:07.670147 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8b6304bf-97da-4217-96bb-0c1990ea6736 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:07.670147 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8b6304bf-97da-4217-96bb-0c1990ea6736 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:07.670147 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8b6304bf-97da-4217-96bb-0c1990ea6736 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:07.670653 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8b6304bf-97da-4217-96bb-0c1990ea6736 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:07.826067 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-8b6304bf-97da-4217-96bb-0c1990ea6736 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "POST /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd/action" status: 204 len: 0 microversion: 2.1 time: 0.169420 Oct 19 04:16:07.826720 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3468/7407] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 04:16:07 2022] POST /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd/action => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 04:16:07.834918 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d92b0e4e-5748-4610-807a-bea39194789a tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:16:07.836153 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d92b0e4e-5748-4610-807a-bea39194789a tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 5f487de7-7234-4320-8c36-49c8d9f311cd] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:16:07.841791 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d92b0e4e-5748-4610-807a-bea39194789a tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:07.842310 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d92b0e4e-5748-4610-807a-bea39194789a tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:07.843115 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d92b0e4e-5748-4610-807a-bea39194789a tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:07.843453 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d92b0e4e-5748-4610-807a-bea39194789a tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:07.843918 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d92b0e4e-5748-4610-807a-bea39194789a tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:07.844428 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d92b0e4e-5748-4610-807a-bea39194789a tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:07.982971 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d92b0e4e-5748-4610-807a-bea39194789a tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f7e244b0d4799b3b3b557e78e2bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167e643b30048719ceec299de90e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:16:07.991102 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d92b0e4e-5748-4610-807a-bea39194789a tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd" status: 200 len: 1515 microversion: 2.1 time: 0.160159 Oct 19 04:16:07.991895 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3940/7408] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:16:07 2022] GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:16:09.017051 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2870af61-816b-4d3b-8823-4bcb1dee11c6 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:16:09.017792 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-2870af61-816b-4d3b-8823-4bcb1dee11c6 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 5f487de7-7234-4320-8c36-49c8d9f311cd] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:16:09.024744 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2870af61-816b-4d3b-8823-4bcb1dee11c6 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:09.025248 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2870af61-816b-4d3b-8823-4bcb1dee11c6 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:09.025726 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2870af61-816b-4d3b-8823-4bcb1dee11c6 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:09.026432 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2870af61-816b-4d3b-8823-4bcb1dee11c6 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:09.026898 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2870af61-816b-4d3b-8823-4bcb1dee11c6 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:09.027334 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2870af61-816b-4d3b-8823-4bcb1dee11c6 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:09.162600 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-2870af61-816b-4d3b-8823-4bcb1dee11c6 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f7e244b0d4799b3b3b557e78e2bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167e643b30048719ceec299de90e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:16:09.170333 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2870af61-816b-4d3b-8823-4bcb1dee11c6 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd" status: 200 len: 1515 microversion: 2.1 time: 0.158687 Oct 19 04:16:09.170916 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3469/7409] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:16:09 2022] GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:16:09.983842 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-ded05bcd-6257-4993-8f75-187bb6249f02 req-1ca9b0e6-8b6b-4e8b-be0b-397156107ec1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f487de7-7234-4320-8c36-49c8d9f311cd", "name": "network-vif-plugged", "status": "completed", "tag": "bdf639e9-ec77-4393-a451-af96f9aa4bbc"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:16:09.994232 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-ded05bcd-6257-4993-8f75-187bb6249f02 req-1ca9b0e6-8b6b-4e8b-be0b-397156107ec1 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:09.994731 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-ded05bcd-6257-4993-8f75-187bb6249f02 req-1ca9b0e6-8b6b-4e8b-be0b-397156107ec1 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:09.995186 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-ded05bcd-6257-4993-8f75-187bb6249f02 req-1ca9b0e6-8b6b-4e8b-be0b-397156107ec1 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:09.999021 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=85 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:16:10.006513 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-ded05bcd-6257-4993-8f75-187bb6249f02 req-1ca9b0e6-8b6b-4e8b-be0b-397156107ec1 service nova] Creating event network-vif-plugged:bdf639e9-ec77-4393-a451-af96f9aa4bbc for instance 5f487de7-7234-4320-8c36-49c8d9f311cd on n-h1-861333-8 Oct 19 04:16:10.011605 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-ded05bcd-6257-4993-8f75-187bb6249f02 req-1ca9b0e6-8b6b-4e8b-be0b-397156107ec1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031583 Oct 19 04:16:10.012237 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3941/7410] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:16:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:16:10.193970 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f2d0a3a5-d0f0-4c56-9f16-fdd1cf322397 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:16:10.194605 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f2d0a3a5-d0f0-4c56-9f16-fdd1cf322397 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 5f487de7-7234-4320-8c36-49c8d9f311cd] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:16:10.202124 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f2d0a3a5-d0f0-4c56-9f16-fdd1cf322397 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:10.202567 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f2d0a3a5-d0f0-4c56-9f16-fdd1cf322397 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:10.203016 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f2d0a3a5-d0f0-4c56-9f16-fdd1cf322397 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:10.203720 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f2d0a3a5-d0f0-4c56-9f16-fdd1cf322397 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:10.204182 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f2d0a3a5-d0f0-4c56-9f16-fdd1cf322397 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:10.204618 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f2d0a3a5-d0f0-4c56-9f16-fdd1cf322397 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:10.332346 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f2d0a3a5-d0f0-4c56-9f16-fdd1cf322397 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f7e244b0d4799b3b3b557e78e2bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167e643b30048719ceec299de90e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:16:10.340767 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f2d0a3a5-d0f0-4c56-9f16-fdd1cf322397 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd" status: 200 len: 1507 microversion: 2.1 time: 0.150764 Oct 19 04:16:10.341345 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3470/7411] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:16:10 2022] GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd => generated 1507 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:16:10.364133 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8df05b2d-3f06-4a17-83fb-704dbd8d4d05 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:16:10.364851 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8df05b2d-3f06-4a17-83fb-704dbd8d4d05 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 5f487de7-7234-4320-8c36-49c8d9f311cd] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:16:10.371717 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8df05b2d-3f06-4a17-83fb-704dbd8d4d05 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:10.372208 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8df05b2d-3f06-4a17-83fb-704dbd8d4d05 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:10.372656 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8df05b2d-3f06-4a17-83fb-704dbd8d4d05 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:10.373355 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8df05b2d-3f06-4a17-83fb-704dbd8d4d05 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:10.373839 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8df05b2d-3f06-4a17-83fb-704dbd8d4d05 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:10.374277 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8df05b2d-3f06-4a17-83fb-704dbd8d4d05 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:10.503416 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8df05b2d-3f06-4a17-83fb-704dbd8d4d05 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f7e244b0d4799b3b3b557e78e2bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167e643b30048719ceec299de90e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:16:10.511067 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8df05b2d-3f06-4a17-83fb-704dbd8d4d05 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd" status: 200 len: 1507 microversion: 2.1 time: 0.151512 Oct 19 04:16:10.511633 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3942/7412] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:16:10 2022] GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd => generated 1507 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:16:10.536665 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-246fe896-3f5b-4eae-a284-c7278b96c8c7 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Action: 'create', calling method: .version_select at 0x7fc12b79dd30>, body: {"keypair": {"name": "tempest-keypair-531873683", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKjLM+9pmPz4ZHgtlOH7rfzA+yJTM3ioBdYGBArdnlejIejEZHyHtfrIBUbJWaunDEackOWImEF7pXz3GG7t1QfAvY+FQETNhSUN2DDcsxDx/HCym9HvhCv6wR0agSVt2g=="}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:16:10.552525 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-246fe896-3f5b-4eae-a284-c7278b96c8c7 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Getting quotas for project c167e643b30048719ceec299de90e284. Resources: {'key_pairs'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 04:16:10.557629 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-246fe896-3f5b-4eae-a284-c7278b96c8c7 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Getting quotas for user fa1f7e244b0d4799b3b3b557e78e2bc7 and project c167e643b30048719ceec299de90e284. Resources: {'key_pairs'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 04:16:10.570491 n-d-861333-8 devstack@n-api.service[121135]: ERROR oslo.messaging._drivers.impl_rabbit [None req-246fe896-3f5b-4eae-a284-c7278b96c8c7 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [466284c6-cbd7-4ef3-a024-7f40823a5c9c] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 19 04:16:11.578658 n-d-861333-8 devstack@n-api.service[121135]: INFO oslo.messaging._drivers.impl_rabbit [None req-246fe896-3f5b-4eae-a284-c7278b96c8c7 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [466284c6-cbd7-4ef3-a024-7f40823a5c9c] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 60654. Oct 19 04:16:11.685676 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-246fe896-3f5b-4eae-a284-c7278b96c8c7 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.152761 Oct 19 04:16:11.686285 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3471/7413] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Oct 19 04:16:10 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:16:13.797016 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-25f1bb2d-8842-4fbe-bbca-657e255561d5 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:16:13.797695 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-25f1bb2d-8842-4fbe-bbca-657e255561d5 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 5f487de7-7234-4320-8c36-49c8d9f311cd] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:16:13.800534 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=32 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:16:13.805396 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-25f1bb2d-8842-4fbe-bbca-657e255561d5 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:13.805911 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-25f1bb2d-8842-4fbe-bbca-657e255561d5 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:13.806365 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-25f1bb2d-8842-4fbe-bbca-657e255561d5 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:13.807073 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-25f1bb2d-8842-4fbe-bbca-657e255561d5 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:13.807567 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-25f1bb2d-8842-4fbe-bbca-657e255561d5 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:13.808601 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-25f1bb2d-8842-4fbe-bbca-657e255561d5 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:13.939727 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-25f1bb2d-8842-4fbe-bbca-657e255561d5 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f7e244b0d4799b3b3b557e78e2bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167e643b30048719ceec299de90e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:16:13.947592 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-25f1bb2d-8842-4fbe-bbca-657e255561d5 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd" status: 200 len: 1507 microversion: 2.1 time: 0.154992 Oct 19 04:16:13.948168 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3943/7414] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:16:13 2022] GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd => generated 1507 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:16:13.972083 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-292ad7e9-fb8c-48d8-97ed-9c7565f63d31 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:16:13.972611 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-292ad7e9-fb8c-48d8-97ed-9c7565f63d31 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 5f487de7-7234-4320-8c36-49c8d9f311cd] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:16:13.978799 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-292ad7e9-fb8c-48d8-97ed-9c7565f63d31 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:13.979290 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-292ad7e9-fb8c-48d8-97ed-9c7565f63d31 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:13.980229 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-292ad7e9-fb8c-48d8-97ed-9c7565f63d31 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:13.980936 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-292ad7e9-fb8c-48d8-97ed-9c7565f63d31 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:13.981423 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-292ad7e9-fb8c-48d8-97ed-9c7565f63d31 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:13.981858 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-292ad7e9-fb8c-48d8-97ed-9c7565f63d31 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:13.985898 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:16:14.006450 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-292ad7e9-fb8c-48d8-97ed-9c7565f63d31 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 5f487de7-7234-4320-8c36-49c8d9f311cd] Going to try to terminate instance {{(pid=121135) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 04:16:14.278224 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-292ad7e9-fb8c-48d8-97ed-9c7565f63d31 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "DELETE /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd" status: 204 len: 0 microversion: 2.1 time: 0.311994 Oct 19 04:16:14.278834 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3472/7415] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 04:16:13 2022] DELETE /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 04:16:14.337813 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-10939573-a792-4575-8dee-09364dd641e9 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1442232428", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "networks": [{"uuid": "66f8546e-01aa-48f1-a45c-74eed59f9d28"}]}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:16:14.392177 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-10939573-a792-4575-8dee-09364dd641e9 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] validate_networks() for [('66f8546e-01aa-48f1-a45c-74eed59f9d28', None, None, None, None, None)] {{(pid=121134) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 04:16:14.758139 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-10939573-a792-4575-8dee-09364dd641e9 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Flavor limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 04:16:14.758583 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-10939573-a792-4575-8dee-09364dd641e9 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Image limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 04:16:14.759077 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-10939573-a792-4575-8dee-09364dd641e9 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Flavor pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 04:16:14.759508 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-10939573-a792-4575-8dee-09364dd641e9 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Image pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 04:16:14.759937 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-10939573-a792-4575-8dee-09364dd641e9 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 04:16:14.768925 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-10939573-a792-4575-8dee-09364dd641e9 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:14.769455 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-10939573-a792-4575-8dee-09364dd641e9 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:14.769910 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-10939573-a792-4575-8dee-09364dd641e9 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:14.770659 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-10939573-a792-4575-8dee-09364dd641e9 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:14.771141 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-10939573-a792-4575-8dee-09364dd641e9 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:14.771586 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-10939573-a792-4575-8dee-09364dd641e9 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:14.788560 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-10939573-a792-4575-8dee-09364dd641e9 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Getting quotas for project c167e643b30048719ceec299de90e284. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 04:16:14.794592 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-10939573-a792-4575-8dee-09364dd641e9 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Getting quotas for user fa1f7e244b0d4799b3b3b557e78e2bc7 and project c167e643b30048719ceec299de90e284. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 04:16:14.809133 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-10939573-a792-4575-8dee-09364dd641e9 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Going to run 1 instances... {{(pid=121134) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 04:16:14.811938 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-10939573-a792-4575-8dee-09364dd641e9 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 1f9c4e23-8c35-4085-a8b2-d9a497239f72] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 04:16:14.918772 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-10939573-a792-4575-8dee-09364dd641e9 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.584851 Oct 19 04:16:14.919461 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3944/7416] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 04:16:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 586 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 04:16:14.931287 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a404fc6e-1a02-4197-84cf-9cdfad84c914 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:16:14.932003 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a404fc6e-1a02-4197-84cf-9cdfad84c914 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 1f9c4e23-8c35-4085-a8b2-d9a497239f72] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:16:14.934462 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:16:14.993200 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a404fc6e-1a02-4197-84cf-9cdfad84c914 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f7e244b0d4799b3b3b557e78e2bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167e643b30048719ceec299de90e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:16:15.001088 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a404fc6e-1a02-4197-84cf-9cdfad84c914 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "GET /compute/v2.1/servers/1f9c4e23-8c35-4085-a8b2-d9a497239f72" status: 200 len: 1218 microversion: 2.1 time: 0.074076 Oct 19 04:16:15.001710 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3473/7417] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:16:14 2022] GET /compute/v2.1/servers/1f9c4e23-8c35-4085-a8b2-d9a497239f72 => generated 1218 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:16:16.025693 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7d5d805e-e53c-4f55-b266-b9dad174b3bf tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:16:16.026343 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7d5d805e-e53c-4f55-b266-b9dad174b3bf tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 1f9c4e23-8c35-4085-a8b2-d9a497239f72] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:16:16.034677 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7d5d805e-e53c-4f55-b266-b9dad174b3bf tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:16.035197 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7d5d805e-e53c-4f55-b266-b9dad174b3bf tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:16.035668 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7d5d805e-e53c-4f55-b266-b9dad174b3bf tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:16.036608 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7d5d805e-e53c-4f55-b266-b9dad174b3bf tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:16.037086 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7d5d805e-e53c-4f55-b266-b9dad174b3bf tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:16.037577 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7d5d805e-e53c-4f55-b266-b9dad174b3bf tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:16.105334 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-7d5d805e-e53c-4f55-b266-b9dad174b3bf tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f7e244b0d4799b3b3b557e78e2bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167e643b30048719ceec299de90e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:16:16.114697 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7d5d805e-e53c-4f55-b266-b9dad174b3bf tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "GET /compute/v2.1/servers/1f9c4e23-8c35-4085-a8b2-d9a497239f72" status: 200 len: 1222 microversion: 2.1 time: 0.094523 Oct 19 04:16:16.115306 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3945/7418] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:16:16 2022] GET /compute/v2.1/servers/1f9c4e23-8c35-4085-a8b2-d9a497239f72 => generated 1222 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:16:16.445169 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-bb2d74e1-f367-45e9-841b-c05b0b3ecbbd req-99a8b17f-2db9-40b6-811d-8759af620899 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f487de7-7234-4320-8c36-49c8d9f311cd", "name": "network-vif-deleted", "tag": "bdf639e9-ec77-4393-a451-af96f9aa4bbc"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:16:16.457099 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-bb2d74e1-f367-45e9-841b-c05b0b3ecbbd req-99a8b17f-2db9-40b6-811d-8759af620899 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:16.457702 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-bb2d74e1-f367-45e9-841b-c05b0b3ecbbd req-99a8b17f-2db9-40b6-811d-8759af620899 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:16.458145 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-bb2d74e1-f367-45e9-841b-c05b0b3ecbbd req-99a8b17f-2db9-40b6-811d-8759af620899 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:16.471099 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-bb2d74e1-f367-45e9-841b-c05b0b3ecbbd req-99a8b17f-2db9-40b6-811d-8759af620899 service nova] Creating event network-vif-deleted:bdf639e9-ec77-4393-a451-af96f9aa4bbc for instance 5f487de7-7234-4320-8c36-49c8d9f311cd on n-h1-861333-8 Oct 19 04:16:16.475965 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-bb2d74e1-f367-45e9-841b-c05b0b3ecbbd req-99a8b17f-2db9-40b6-811d-8759af620899 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037027 Oct 19 04:16:16.476876 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3474/7419] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:16:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:16:17.138361 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a506132a-8025-4885-ba92-6774dfc95f4d tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:16:17.138927 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a506132a-8025-4885-ba92-6774dfc95f4d tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 1f9c4e23-8c35-4085-a8b2-d9a497239f72] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:16:17.145975 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a506132a-8025-4885-ba92-6774dfc95f4d tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:17.146470 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a506132a-8025-4885-ba92-6774dfc95f4d tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:17.147375 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a506132a-8025-4885-ba92-6774dfc95f4d tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:17.148277 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a506132a-8025-4885-ba92-6774dfc95f4d tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:17.148938 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a506132a-8025-4885-ba92-6774dfc95f4d tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:17.149568 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a506132a-8025-4885-ba92-6774dfc95f4d tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:17.223399 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a506132a-8025-4885-ba92-6774dfc95f4d tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f7e244b0d4799b3b3b557e78e2bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167e643b30048719ceec299de90e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:16:17.231147 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a506132a-8025-4885-ba92-6774dfc95f4d tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "GET /compute/v2.1/servers/1f9c4e23-8c35-4085-a8b2-d9a497239f72" status: 200 len: 1288 microversion: 2.1 time: 0.097683 Oct 19 04:16:17.231723 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3946/7420] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:16:17 2022] GET /compute/v2.1/servers/1f9c4e23-8c35-4085-a8b2-d9a497239f72 => generated 1288 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:16:18.254993 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f298dce6-458b-4c6e-917f-0e521a315150 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:16:18.255700 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f298dce6-458b-4c6e-917f-0e521a315150 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 1f9c4e23-8c35-4085-a8b2-d9a497239f72] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:16:18.263382 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f298dce6-458b-4c6e-917f-0e521a315150 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:18.263876 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f298dce6-458b-4c6e-917f-0e521a315150 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:18.264321 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f298dce6-458b-4c6e-917f-0e521a315150 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:18.265025 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f298dce6-458b-4c6e-917f-0e521a315150 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:18.265513 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f298dce6-458b-4c6e-917f-0e521a315150 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:18.265947 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f298dce6-458b-4c6e-917f-0e521a315150 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:18.495677 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f298dce6-458b-4c6e-917f-0e521a315150 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f7e244b0d4799b3b3b557e78e2bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167e643b30048719ceec299de90e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:16:18.503672 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f298dce6-458b-4c6e-917f-0e521a315150 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "GET /compute/v2.1/servers/1f9c4e23-8c35-4085-a8b2-d9a497239f72" status: 200 len: 1318 microversion: 2.1 time: 0.253210 Oct 19 04:16:18.504360 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3475/7421] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:16:18 2022] GET /compute/v2.1/servers/1f9c4e23-8c35-4085-a8b2-d9a497239f72 => generated 1318 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:16:18.802335 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-5405a6db-fd65-4f38-be47-542932402f1d req-d2237a00-a567-4c98-9cf7-36ea286a3651 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f9c4e23-8c35-4085-a8b2-d9a497239f72", "tag": "9fc439bb-f5c0-49b8-91ad-767eebb33ae0"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:16:18.812248 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-5405a6db-fd65-4f38-be47-542932402f1d req-d2237a00-a567-4c98-9cf7-36ea286a3651 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:18.812772 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-5405a6db-fd65-4f38-be47-542932402f1d req-d2237a00-a567-4c98-9cf7-36ea286a3651 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:18.813226 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-5405a6db-fd65-4f38-be47-542932402f1d req-d2237a00-a567-4c98-9cf7-36ea286a3651 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:18.824784 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-5405a6db-fd65-4f38-be47-542932402f1d req-d2237a00-a567-4c98-9cf7-36ea286a3651 service nova] Creating event network-changed:9fc439bb-f5c0-49b8-91ad-767eebb33ae0 for instance 1f9c4e23-8c35-4085-a8b2-d9a497239f72 on n-h2-861333-8 Oct 19 04:16:18.829722 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-5405a6db-fd65-4f38-be47-542932402f1d req-d2237a00-a567-4c98-9cf7-36ea286a3651 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087762 Oct 19 04:16:18.830316 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3947/7422] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:16:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:16:19.528036 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4ff27ccb-4530-48dd-80e7-8ae2645d10a5 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:16:19.528655 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4ff27ccb-4530-48dd-80e7-8ae2645d10a5 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 1f9c4e23-8c35-4085-a8b2-d9a497239f72] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:16:19.535501 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4ff27ccb-4530-48dd-80e7-8ae2645d10a5 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:19.535988 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4ff27ccb-4530-48dd-80e7-8ae2645d10a5 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:19.536428 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4ff27ccb-4530-48dd-80e7-8ae2645d10a5 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:19.537123 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4ff27ccb-4530-48dd-80e7-8ae2645d10a5 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:19.537621 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4ff27ccb-4530-48dd-80e7-8ae2645d10a5 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:19.538055 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4ff27ccb-4530-48dd-80e7-8ae2645d10a5 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:19.666526 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4ff27ccb-4530-48dd-80e7-8ae2645d10a5 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f7e244b0d4799b3b3b557e78e2bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167e643b30048719ceec299de90e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:16:19.677069 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4ff27ccb-4530-48dd-80e7-8ae2645d10a5 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "GET /compute/v2.1/servers/1f9c4e23-8c35-4085-a8b2-d9a497239f72" status: 200 len: 1318 microversion: 2.1 time: 0.153423 Oct 19 04:16:19.677680 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3476/7423] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:16:19 2022] GET /compute/v2.1/servers/1f9c4e23-8c35-4085-a8b2-d9a497239f72 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:16:20.702086 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3f485622-8bfa-437a-ba62-6aef71477cdd tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:16:20.702891 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3f485622-8bfa-437a-ba62-6aef71477cdd tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 1f9c4e23-8c35-4085-a8b2-d9a497239f72] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:16:20.709095 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3f485622-8bfa-437a-ba62-6aef71477cdd tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:20.709640 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3f485622-8bfa-437a-ba62-6aef71477cdd tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:20.710099 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3f485622-8bfa-437a-ba62-6aef71477cdd tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:20.710816 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3f485622-8bfa-437a-ba62-6aef71477cdd tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:20.711288 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3f485622-8bfa-437a-ba62-6aef71477cdd tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:20.711739 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3f485622-8bfa-437a-ba62-6aef71477cdd tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:20.853126 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-3f485622-8bfa-437a-ba62-6aef71477cdd tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f7e244b0d4799b3b3b557e78e2bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167e643b30048719ceec299de90e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:16:20.861016 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3f485622-8bfa-437a-ba62-6aef71477cdd tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "GET /compute/v2.1/servers/1f9c4e23-8c35-4085-a8b2-d9a497239f72" status: 200 len: 1318 microversion: 2.1 time: 0.164836 Oct 19 04:16:20.861648 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3948/7424] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:16:20 2022] GET /compute/v2.1/servers/1f9c4e23-8c35-4085-a8b2-d9a497239f72 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:16:21.884100 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1af4d0d1-f2e1-4be7-8bda-afece5a278df tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:16:21.885083 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1af4d0d1-f2e1-4be7-8bda-afece5a278df tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 1f9c4e23-8c35-4085-a8b2-d9a497239f72] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:16:21.893584 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1af4d0d1-f2e1-4be7-8bda-afece5a278df tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:21.894083 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1af4d0d1-f2e1-4be7-8bda-afece5a278df tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:21.894533 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1af4d0d1-f2e1-4be7-8bda-afece5a278df tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:21.895238 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1af4d0d1-f2e1-4be7-8bda-afece5a278df tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:21.895703 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1af4d0d1-f2e1-4be7-8bda-afece5a278df tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:21.896140 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1af4d0d1-f2e1-4be7-8bda-afece5a278df tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:22.092302 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-1af4d0d1-f2e1-4be7-8bda-afece5a278df tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f7e244b0d4799b3b3b557e78e2bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167e643b30048719ceec299de90e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:16:22.092302 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1af4d0d1-f2e1-4be7-8bda-afece5a278df tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "GET /compute/v2.1/servers/1f9c4e23-8c35-4085-a8b2-d9a497239f72" status: 200 len: 1318 microversion: 2.1 time: 0.160797 Oct 19 04:16:22.092302 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3477/7425] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:16:21 2022] GET /compute/v2.1/servers/1f9c4e23-8c35-4085-a8b2-d9a497239f72 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:16:23.064297 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-fe52b275-0446-48bd-a394-bd1aea84ad45 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:16:23.064877 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-fe52b275-0446-48bd-a394-bd1aea84ad45 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 1f9c4e23-8c35-4085-a8b2-d9a497239f72] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:16:23.071847 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fe52b275-0446-48bd-a394-bd1aea84ad45 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:23.072357 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fe52b275-0446-48bd-a394-bd1aea84ad45 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:23.072822 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fe52b275-0446-48bd-a394-bd1aea84ad45 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:23.074058 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fe52b275-0446-48bd-a394-bd1aea84ad45 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:23.074533 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fe52b275-0446-48bd-a394-bd1aea84ad45 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:23.074985 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fe52b275-0446-48bd-a394-bd1aea84ad45 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:23.204916 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-fe52b275-0446-48bd-a394-bd1aea84ad45 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f7e244b0d4799b3b3b557e78e2bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167e643b30048719ceec299de90e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:16:23.212695 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-fe52b275-0446-48bd-a394-bd1aea84ad45 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "GET /compute/v2.1/servers/1f9c4e23-8c35-4085-a8b2-d9a497239f72" status: 200 len: 1318 microversion: 2.1 time: 0.152462 Oct 19 04:16:23.213271 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3949/7426] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:16:23 2022] GET /compute/v2.1/servers/1f9c4e23-8c35-4085-a8b2-d9a497239f72 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:16:24.235940 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1095b722-a97a-43e8-a009-c37a88b5ed2e tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:16:24.236558 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1095b722-a97a-43e8-a009-c37a88b5ed2e tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 1f9c4e23-8c35-4085-a8b2-d9a497239f72] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:16:24.243374 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1095b722-a97a-43e8-a009-c37a88b5ed2e tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:24.243864 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1095b722-a97a-43e8-a009-c37a88b5ed2e tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:24.244307 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1095b722-a97a-43e8-a009-c37a88b5ed2e tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:24.245005 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1095b722-a97a-43e8-a009-c37a88b5ed2e tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:24.245490 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1095b722-a97a-43e8-a009-c37a88b5ed2e tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:24.245927 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1095b722-a97a-43e8-a009-c37a88b5ed2e tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:24.378318 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-1095b722-a97a-43e8-a009-c37a88b5ed2e tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f7e244b0d4799b3b3b557e78e2bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167e643b30048719ceec299de90e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:16:24.386628 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1095b722-a97a-43e8-a009-c37a88b5ed2e tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "GET /compute/v2.1/servers/1f9c4e23-8c35-4085-a8b2-d9a497239f72" status: 200 len: 1318 microversion: 2.1 time: 0.154573 Oct 19 04:16:24.387508 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3478/7427] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:16:24 2022] GET /compute/v2.1/servers/1f9c4e23-8c35-4085-a8b2-d9a497239f72 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:16:24.507730 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-3565aabc-da0f-4ddf-9400-fc85a4e12a9d req-cef89a73-90a6-4275-a69e-9d12a8e87535 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f9c4e23-8c35-4085-a8b2-d9a497239f72", "name": "network-vif-plugged", "status": "completed", "tag": "9fc439bb-f5c0-49b8-91ad-767eebb33ae0"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:16:24.519345 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-3565aabc-da0f-4ddf-9400-fc85a4e12a9d req-cef89a73-90a6-4275-a69e-9d12a8e87535 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:24.519847 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-3565aabc-da0f-4ddf-9400-fc85a4e12a9d req-cef89a73-90a6-4275-a69e-9d12a8e87535 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:24.520392 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-3565aabc-da0f-4ddf-9400-fc85a4e12a9d req-cef89a73-90a6-4275-a69e-9d12a8e87535 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:24.532386 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-3565aabc-da0f-4ddf-9400-fc85a4e12a9d req-cef89a73-90a6-4275-a69e-9d12a8e87535 service nova] Creating event network-vif-plugged:9fc439bb-f5c0-49b8-91ad-767eebb33ae0 for instance 1f9c4e23-8c35-4085-a8b2-d9a497239f72 on n-h2-861333-8 Oct 19 04:16:24.537645 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-3565aabc-da0f-4ddf-9400-fc85a4e12a9d req-cef89a73-90a6-4275-a69e-9d12a8e87535 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033731 Oct 19 04:16:24.538223 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3950/7428] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:16:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:16:25.410127 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-35a61ccd-8594-4b6a-9bfa-e1eea8d7cb55 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:16:25.410782 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-35a61ccd-8594-4b6a-9bfa-e1eea8d7cb55 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 1f9c4e23-8c35-4085-a8b2-d9a497239f72] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:16:25.412728 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=6 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:16:25.419019 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-35a61ccd-8594-4b6a-9bfa-e1eea8d7cb55 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:25.419511 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-35a61ccd-8594-4b6a-9bfa-e1eea8d7cb55 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:25.419957 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-35a61ccd-8594-4b6a-9bfa-e1eea8d7cb55 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:25.420654 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-35a61ccd-8594-4b6a-9bfa-e1eea8d7cb55 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:25.421116 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-35a61ccd-8594-4b6a-9bfa-e1eea8d7cb55 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:25.421584 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-35a61ccd-8594-4b6a-9bfa-e1eea8d7cb55 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:25.548107 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-35a61ccd-8594-4b6a-9bfa-e1eea8d7cb55 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f7e244b0d4799b3b3b557e78e2bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167e643b30048719ceec299de90e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:16:25.555794 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-35a61ccd-8594-4b6a-9bfa-e1eea8d7cb55 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "GET /compute/v2.1/servers/1f9c4e23-8c35-4085-a8b2-d9a497239f72" status: 200 len: 1318 microversion: 2.1 time: 0.149635 Oct 19 04:16:25.556371 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3479/7429] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:16:25 2022] GET /compute/v2.1/servers/1f9c4e23-8c35-4085-a8b2-d9a497239f72 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:16:26.579038 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-fae729f0-dc18-4d7f-9ded-490daa769e92 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:16:26.579764 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-fae729f0-dc18-4d7f-9ded-490daa769e92 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 1f9c4e23-8c35-4085-a8b2-d9a497239f72] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:16:26.581779 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:16:26.582471 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=6 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:16:26.588319 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fae729f0-dc18-4d7f-9ded-490daa769e92 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:26.588860 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fae729f0-dc18-4d7f-9ded-490daa769e92 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:26.589338 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fae729f0-dc18-4d7f-9ded-490daa769e92 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:26.592591 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fae729f0-dc18-4d7f-9ded-490daa769e92 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:26.592591 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fae729f0-dc18-4d7f-9ded-490daa769e92 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:26.592591 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fae729f0-dc18-4d7f-9ded-490daa769e92 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:26.723296 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-fae729f0-dc18-4d7f-9ded-490daa769e92 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f7e244b0d4799b3b3b557e78e2bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167e643b30048719ceec299de90e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:16:26.731618 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-fae729f0-dc18-4d7f-9ded-490daa769e92 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "GET /compute/v2.1/servers/1f9c4e23-8c35-4085-a8b2-d9a497239f72" status: 200 len: 1508 microversion: 2.1 time: 0.156869 Oct 19 04:16:26.732199 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3951/7430] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:16:26 2022] GET /compute/v2.1/servers/1f9c4e23-8c35-4085-a8b2-d9a497239f72 => generated 1508 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:16:26.754465 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e2a33141-e0bc-485e-9d57-04ea43113fbd tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:16:26.755084 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e2a33141-e0bc-485e-9d57-04ea43113fbd tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 1f9c4e23-8c35-4085-a8b2-d9a497239f72] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:16:26.761824 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e2a33141-e0bc-485e-9d57-04ea43113fbd tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:26.762311 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e2a33141-e0bc-485e-9d57-04ea43113fbd tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:26.762779 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e2a33141-e0bc-485e-9d57-04ea43113fbd tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:26.763476 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e2a33141-e0bc-485e-9d57-04ea43113fbd tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:26.763933 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e2a33141-e0bc-485e-9d57-04ea43113fbd tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:26.764361 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e2a33141-e0bc-485e-9d57-04ea43113fbd tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:26.889243 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-e2a33141-e0bc-485e-9d57-04ea43113fbd tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f7e244b0d4799b3b3b557e78e2bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167e643b30048719ceec299de90e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:16:26.897324 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e2a33141-e0bc-485e-9d57-04ea43113fbd tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "GET /compute/v2.1/servers/1f9c4e23-8c35-4085-a8b2-d9a497239f72" status: 200 len: 1508 microversion: 2.1 time: 0.146413 Oct 19 04:16:26.897922 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3480/7431] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:16:26 2022] GET /compute/v2.1/servers/1f9c4e23-8c35-4085-a8b2-d9a497239f72 => generated 1508 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:16:26.920289 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-13351998-8dea-4038-9d65-c479ad64fc11 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:16:26.922555 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-13351998-8dea-4038-9d65-c479ad64fc11 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 1f9c4e23-8c35-4085-a8b2-d9a497239f72] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:16:26.928684 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-13351998-8dea-4038-9d65-c479ad64fc11 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:26.929137 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-13351998-8dea-4038-9d65-c479ad64fc11 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:26.929619 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-13351998-8dea-4038-9d65-c479ad64fc11 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:26.930315 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-13351998-8dea-4038-9d65-c479ad64fc11 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:26.930807 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-13351998-8dea-4038-9d65-c479ad64fc11 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:26.931244 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-13351998-8dea-4038-9d65-c479ad64fc11 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:26.958391 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-13351998-8dea-4038-9d65-c479ad64fc11 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'fa1f7e244b0d4799b3b3b557e78e2bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167e643b30048719ceec299de90e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:16:26.964413 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-13351998-8dea-4038-9d65-c479ad64fc11 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 1f9c4e23-8c35-4085-a8b2-d9a497239f72] Old instance type m1.heat2, new instance type m1.heat {{(pid=121134) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 19 04:16:26.971090 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-13351998-8dea-4038-9d65-c479ad64fc11 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Flavor limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 04:16:26.971536 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-13351998-8dea-4038-9d65-c479ad64fc11 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Image limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 04:16:26.972027 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-13351998-8dea-4038-9d65-c479ad64fc11 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Flavor pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 04:16:26.972489 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-13351998-8dea-4038-9d65-c479ad64fc11 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Image pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 04:16:26.972894 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-13351998-8dea-4038-9d65-c479ad64fc11 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 04:16:27.150173 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-13351998-8dea-4038-9d65-c479ad64fc11 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "POST /compute/v2.1/servers/1f9c4e23-8c35-4085-a8b2-d9a497239f72/action" status: 202 len: 0 microversion: 2.1 time: 0.234329 Oct 19 04:16:27.150964 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3952/7432] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 04:16:26 2022] POST /compute/v2.1/servers/1f9c4e23-8c35-4085-a8b2-d9a497239f72/action => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 19 04:16:27.161017 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0aee77d2-3483-474c-b4ad-870e9c454d72 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:16:27.161700 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0aee77d2-3483-474c-b4ad-870e9c454d72 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 1f9c4e23-8c35-4085-a8b2-d9a497239f72] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:16:27.169058 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0aee77d2-3483-474c-b4ad-870e9c454d72 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:27.169602 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0aee77d2-3483-474c-b4ad-870e9c454d72 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:27.170052 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0aee77d2-3483-474c-b4ad-870e9c454d72 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:27.170760 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0aee77d2-3483-474c-b4ad-870e9c454d72 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:27.171231 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0aee77d2-3483-474c-b4ad-870e9c454d72 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:27.171666 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0aee77d2-3483-474c-b4ad-870e9c454d72 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:27.317393 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-0aee77d2-3483-474c-b4ad-870e9c454d72 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f7e244b0d4799b3b3b557e78e2bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167e643b30048719ceec299de90e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:16:27.325948 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0aee77d2-3483-474c-b4ad-870e9c454d72 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "GET /compute/v2.1/servers/1f9c4e23-8c35-4085-a8b2-d9a497239f72" status: 200 len: 1515 microversion: 2.1 time: 0.169718 Oct 19 04:16:27.326530 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3481/7433] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:16:27 2022] GET /compute/v2.1/servers/1f9c4e23-8c35-4085-a8b2-d9a497239f72 => generated 1515 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:16:28.350539 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b2768d4f-3600-49e1-8a89-f19f736d1dc5 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:16:28.351168 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b2768d4f-3600-49e1-8a89-f19f736d1dc5 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 1f9c4e23-8c35-4085-a8b2-d9a497239f72] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:16:28.361265 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b2768d4f-3600-49e1-8a89-f19f736d1dc5 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:28.361800 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b2768d4f-3600-49e1-8a89-f19f736d1dc5 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:28.362254 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b2768d4f-3600-49e1-8a89-f19f736d1dc5 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:28.362960 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b2768d4f-3600-49e1-8a89-f19f736d1dc5 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:28.363428 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b2768d4f-3600-49e1-8a89-f19f736d1dc5 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:28.363876 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b2768d4f-3600-49e1-8a89-f19f736d1dc5 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:28.497480 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b2768d4f-3600-49e1-8a89-f19f736d1dc5 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f7e244b0d4799b3b3b557e78e2bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167e643b30048719ceec299de90e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:16:28.505172 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b2768d4f-3600-49e1-8a89-f19f736d1dc5 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "GET /compute/v2.1/servers/1f9c4e23-8c35-4085-a8b2-d9a497239f72" status: 200 len: 1515 microversion: 2.1 time: 0.159513 Oct 19 04:16:28.505780 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3953/7434] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:16:28 2022] GET /compute/v2.1/servers/1f9c4e23-8c35-4085-a8b2-d9a497239f72 => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:16:29.528747 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b6e016a1-172f-4c1b-9838-c84974ba22f8 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:16:29.529359 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b6e016a1-172f-4c1b-9838-c84974ba22f8 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 1f9c4e23-8c35-4085-a8b2-d9a497239f72] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:16:29.536224 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b6e016a1-172f-4c1b-9838-c84974ba22f8 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:29.536728 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b6e016a1-172f-4c1b-9838-c84974ba22f8 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:29.537182 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b6e016a1-172f-4c1b-9838-c84974ba22f8 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:29.537932 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b6e016a1-172f-4c1b-9838-c84974ba22f8 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:29.538397 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b6e016a1-172f-4c1b-9838-c84974ba22f8 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:29.538836 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b6e016a1-172f-4c1b-9838-c84974ba22f8 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:29.889696 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b6e016a1-172f-4c1b-9838-c84974ba22f8 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f7e244b0d4799b3b3b557e78e2bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167e643b30048719ceec299de90e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:16:29.897790 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b6e016a1-172f-4c1b-9838-c84974ba22f8 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "GET /compute/v2.1/servers/1f9c4e23-8c35-4085-a8b2-d9a497239f72" status: 200 len: 1515 microversion: 2.1 time: 0.373203 Oct 19 04:16:29.904240 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3482/7435] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:16:29 2022] GET /compute/v2.1/servers/1f9c4e23-8c35-4085-a8b2-d9a497239f72 => generated 1515 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:16:30.922033 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-bb91f67b-6984-427f-aa18-0d8d69e1c0a2 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:16:30.922692 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-bb91f67b-6984-427f-aa18-0d8d69e1c0a2 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 1f9c4e23-8c35-4085-a8b2-d9a497239f72] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:16:30.928929 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bb91f67b-6984-427f-aa18-0d8d69e1c0a2 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:30.929456 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bb91f67b-6984-427f-aa18-0d8d69e1c0a2 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:30.929910 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bb91f67b-6984-427f-aa18-0d8d69e1c0a2 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:30.930942 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bb91f67b-6984-427f-aa18-0d8d69e1c0a2 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:30.931411 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bb91f67b-6984-427f-aa18-0d8d69e1c0a2 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:30.931852 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bb91f67b-6984-427f-aa18-0d8d69e1c0a2 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:31.059521 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-bb91f67b-6984-427f-aa18-0d8d69e1c0a2 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f7e244b0d4799b3b3b557e78e2bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167e643b30048719ceec299de90e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:16:31.067167 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-bb91f67b-6984-427f-aa18-0d8d69e1c0a2 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "GET /compute/v2.1/servers/1f9c4e23-8c35-4085-a8b2-d9a497239f72" status: 200 len: 1520 microversion: 2.1 time: 0.149481 Oct 19 04:16:31.067735 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3954/7436] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:16:30 2022] GET /compute/v2.1/servers/1f9c4e23-8c35-4085-a8b2-d9a497239f72 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:16:32.090919 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9dfed529-6d63-4fbb-9c9a-07892169409f tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:16:32.091543 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9dfed529-6d63-4fbb-9c9a-07892169409f tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 1f9c4e23-8c35-4085-a8b2-d9a497239f72] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:16:32.098531 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9dfed529-6d63-4fbb-9c9a-07892169409f tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:32.099087 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9dfed529-6d63-4fbb-9c9a-07892169409f tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:32.099457 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9dfed529-6d63-4fbb-9c9a-07892169409f tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:32.100154 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9dfed529-6d63-4fbb-9c9a-07892169409f tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:32.100613 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9dfed529-6d63-4fbb-9c9a-07892169409f tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:32.101044 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9dfed529-6d63-4fbb-9c9a-07892169409f tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:32.234687 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-9dfed529-6d63-4fbb-9c9a-07892169409f tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f7e244b0d4799b3b3b557e78e2bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167e643b30048719ceec299de90e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:16:32.242536 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9dfed529-6d63-4fbb-9c9a-07892169409f tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "GET /compute/v2.1/servers/1f9c4e23-8c35-4085-a8b2-d9a497239f72" status: 200 len: 1520 microversion: 2.1 time: 0.156275 Oct 19 04:16:32.243129 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3483/7437] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:16:32 2022] GET /compute/v2.1/servers/1f9c4e23-8c35-4085-a8b2-d9a497239f72 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:16:33.266250 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-44d8679c-e9d2-4fe7-99d9-bc038432a1a9 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:16:33.266884 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-44d8679c-e9d2-4fe7-99d9-bc038432a1a9 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 1f9c4e23-8c35-4085-a8b2-d9a497239f72] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:16:33.274161 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-44d8679c-e9d2-4fe7-99d9-bc038432a1a9 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:33.274665 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-44d8679c-e9d2-4fe7-99d9-bc038432a1a9 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:33.275125 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-44d8679c-e9d2-4fe7-99d9-bc038432a1a9 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:33.275841 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-44d8679c-e9d2-4fe7-99d9-bc038432a1a9 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:33.276954 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-44d8679c-e9d2-4fe7-99d9-bc038432a1a9 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:33.277435 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-44d8679c-e9d2-4fe7-99d9-bc038432a1a9 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:33.404374 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-44d8679c-e9d2-4fe7-99d9-bc038432a1a9 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f7e244b0d4799b3b3b557e78e2bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167e643b30048719ceec299de90e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:16:33.412140 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-44d8679c-e9d2-4fe7-99d9-bc038432a1a9 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "GET /compute/v2.1/servers/1f9c4e23-8c35-4085-a8b2-d9a497239f72" status: 200 len: 1520 microversion: 2.1 time: 0.149858 Oct 19 04:16:33.412722 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3955/7438] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:16:33 2022] GET /compute/v2.1/servers/1f9c4e23-8c35-4085-a8b2-d9a497239f72 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:16:34.435060 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b3460a98-50fa-4b70-917b-83c4327b5123 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:16:34.435692 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b3460a98-50fa-4b70-917b-83c4327b5123 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 1f9c4e23-8c35-4085-a8b2-d9a497239f72] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:16:34.442604 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b3460a98-50fa-4b70-917b-83c4327b5123 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:34.443105 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b3460a98-50fa-4b70-917b-83c4327b5123 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:34.443552 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b3460a98-50fa-4b70-917b-83c4327b5123 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:34.444253 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b3460a98-50fa-4b70-917b-83c4327b5123 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:34.444715 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b3460a98-50fa-4b70-917b-83c4327b5123 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:34.445152 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b3460a98-50fa-4b70-917b-83c4327b5123 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:34.574781 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b3460a98-50fa-4b70-917b-83c4327b5123 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f7e244b0d4799b3b3b557e78e2bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167e643b30048719ceec299de90e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:16:34.582593 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b3460a98-50fa-4b70-917b-83c4327b5123 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "GET /compute/v2.1/servers/1f9c4e23-8c35-4085-a8b2-d9a497239f72" status: 200 len: 1520 microversion: 2.1 time: 0.151472 Oct 19 04:16:34.583182 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3484/7439] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:16:34 2022] GET /compute/v2.1/servers/1f9c4e23-8c35-4085-a8b2-d9a497239f72 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:16:35.606198 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1253e622-4fad-4bae-b80d-fdce05934129 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:16:35.606830 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1253e622-4fad-4bae-b80d-fdce05934129 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 1f9c4e23-8c35-4085-a8b2-d9a497239f72] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:16:35.614050 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1253e622-4fad-4bae-b80d-fdce05934129 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:35.614585 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1253e622-4fad-4bae-b80d-fdce05934129 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:35.615047 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1253e622-4fad-4bae-b80d-fdce05934129 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:35.615796 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1253e622-4fad-4bae-b80d-fdce05934129 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:35.616300 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1253e622-4fad-4bae-b80d-fdce05934129 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:35.616747 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1253e622-4fad-4bae-b80d-fdce05934129 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:35.745237 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-1253e622-4fad-4bae-b80d-fdce05934129 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f7e244b0d4799b3b3b557e78e2bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167e643b30048719ceec299de90e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:16:35.756954 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1253e622-4fad-4bae-b80d-fdce05934129 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "GET /compute/v2.1/servers/1f9c4e23-8c35-4085-a8b2-d9a497239f72" status: 200 len: 1520 microversion: 2.1 time: 0.154712 Oct 19 04:16:35.757683 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3956/7440] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:16:35 2022] GET /compute/v2.1/servers/1f9c4e23-8c35-4085-a8b2-d9a497239f72 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:16:36.781714 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-14e336e3-24b8-48d4-b7f5-ee990348f18d tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:16:36.782369 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-14e336e3-24b8-48d4-b7f5-ee990348f18d tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 1f9c4e23-8c35-4085-a8b2-d9a497239f72] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:16:36.789399 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-14e336e3-24b8-48d4-b7f5-ee990348f18d tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:36.789892 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-14e336e3-24b8-48d4-b7f5-ee990348f18d tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:36.790339 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-14e336e3-24b8-48d4-b7f5-ee990348f18d tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:36.791043 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-14e336e3-24b8-48d4-b7f5-ee990348f18d tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:36.791506 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-14e336e3-24b8-48d4-b7f5-ee990348f18d tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:36.791949 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-14e336e3-24b8-48d4-b7f5-ee990348f18d tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:36.923551 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-14e336e3-24b8-48d4-b7f5-ee990348f18d tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f7e244b0d4799b3b3b557e78e2bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167e643b30048719ceec299de90e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:16:36.931331 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-14e336e3-24b8-48d4-b7f5-ee990348f18d tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "GET /compute/v2.1/servers/1f9c4e23-8c35-4085-a8b2-d9a497239f72" status: 200 len: 1520 microversion: 2.1 time: 0.154099 Oct 19 04:16:36.931907 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3485/7441] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:16:36 2022] GET /compute/v2.1/servers/1f9c4e23-8c35-4085-a8b2-d9a497239f72 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:16:37.954868 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-10fa7fa2-19df-4783-9695-37803b23a2f0 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:16:37.955506 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-10fa7fa2-19df-4783-9695-37803b23a2f0 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 1f9c4e23-8c35-4085-a8b2-d9a497239f72] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:16:37.962570 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-10fa7fa2-19df-4783-9695-37803b23a2f0 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:37.963076 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-10fa7fa2-19df-4783-9695-37803b23a2f0 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:37.963536 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-10fa7fa2-19df-4783-9695-37803b23a2f0 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:37.964252 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-10fa7fa2-19df-4783-9695-37803b23a2f0 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:37.964730 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-10fa7fa2-19df-4783-9695-37803b23a2f0 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:37.965177 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-10fa7fa2-19df-4783-9695-37803b23a2f0 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:38.094194 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-10fa7fa2-19df-4783-9695-37803b23a2f0 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f7e244b0d4799b3b3b557e78e2bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167e643b30048719ceec299de90e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:16:38.101967 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-10fa7fa2-19df-4783-9695-37803b23a2f0 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "GET /compute/v2.1/servers/1f9c4e23-8c35-4085-a8b2-d9a497239f72" status: 200 len: 1520 microversion: 2.1 time: 0.151054 Oct 19 04:16:38.102541 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3957/7442] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:16:37 2022] GET /compute/v2.1/servers/1f9c4e23-8c35-4085-a8b2-d9a497239f72 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:16:39.125939 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7edf425e-e94b-42a1-96b5-c04dbc21d857 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:16:39.126587 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7edf425e-e94b-42a1-96b5-c04dbc21d857 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 1f9c4e23-8c35-4085-a8b2-d9a497239f72] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:16:39.133242 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7edf425e-e94b-42a1-96b5-c04dbc21d857 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:39.133772 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7edf425e-e94b-42a1-96b5-c04dbc21d857 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:39.134216 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7edf425e-e94b-42a1-96b5-c04dbc21d857 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:39.134917 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7edf425e-e94b-42a1-96b5-c04dbc21d857 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:39.135381 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7edf425e-e94b-42a1-96b5-c04dbc21d857 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:39.135816 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7edf425e-e94b-42a1-96b5-c04dbc21d857 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:39.265054 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7edf425e-e94b-42a1-96b5-c04dbc21d857 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f7e244b0d4799b3b3b557e78e2bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167e643b30048719ceec299de90e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:16:39.273225 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7edf425e-e94b-42a1-96b5-c04dbc21d857 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "GET /compute/v2.1/servers/1f9c4e23-8c35-4085-a8b2-d9a497239f72" status: 200 len: 1520 microversion: 2.1 time: 0.151205 Oct 19 04:16:39.274749 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3486/7443] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:16:39 2022] GET /compute/v2.1/servers/1f9c4e23-8c35-4085-a8b2-d9a497239f72 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:16:40.296139 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7bd1230e-6fd6-42c2-8630-b69bdd976d8a tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:16:40.296771 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7bd1230e-6fd6-42c2-8630-b69bdd976d8a tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 1f9c4e23-8c35-4085-a8b2-d9a497239f72] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:16:40.303588 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7bd1230e-6fd6-42c2-8630-b69bdd976d8a tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:40.304093 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7bd1230e-6fd6-42c2-8630-b69bdd976d8a tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:40.304554 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7bd1230e-6fd6-42c2-8630-b69bdd976d8a tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:40.305257 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7bd1230e-6fd6-42c2-8630-b69bdd976d8a tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:40.305757 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7bd1230e-6fd6-42c2-8630-b69bdd976d8a tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:40.306204 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7bd1230e-6fd6-42c2-8630-b69bdd976d8a tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:40.438668 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-7bd1230e-6fd6-42c2-8630-b69bdd976d8a tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f7e244b0d4799b3b3b557e78e2bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167e643b30048719ceec299de90e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:16:40.440873 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:16:40.447027 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7bd1230e-6fd6-42c2-8630-b69bdd976d8a tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "GET /compute/v2.1/servers/1f9c4e23-8c35-4085-a8b2-d9a497239f72" status: 200 len: 1520 microversion: 2.1 time: 0.154894 Oct 19 04:16:40.451833 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3958/7444] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:16:40 2022] GET /compute/v2.1/servers/1f9c4e23-8c35-4085-a8b2-d9a497239f72 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:16:41.472868 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-77d95f25-c047-4420-87be-714bb3d3670d tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:16:41.473483 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-77d95f25-c047-4420-87be-714bb3d3670d tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 1f9c4e23-8c35-4085-a8b2-d9a497239f72] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:16:41.480339 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-77d95f25-c047-4420-87be-714bb3d3670d tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:41.480826 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-77d95f25-c047-4420-87be-714bb3d3670d tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:41.481269 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-77d95f25-c047-4420-87be-714bb3d3670d tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:41.481990 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-77d95f25-c047-4420-87be-714bb3d3670d tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:41.482452 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-77d95f25-c047-4420-87be-714bb3d3670d tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:41.482881 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-77d95f25-c047-4420-87be-714bb3d3670d tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:41.612973 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-77d95f25-c047-4420-87be-714bb3d3670d tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f7e244b0d4799b3b3b557e78e2bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167e643b30048719ceec299de90e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:16:41.620686 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-77d95f25-c047-4420-87be-714bb3d3670d tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "GET /compute/v2.1/servers/1f9c4e23-8c35-4085-a8b2-d9a497239f72" status: 200 len: 1520 microversion: 2.1 time: 0.151833 Oct 19 04:16:41.621253 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3487/7445] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:16:41 2022] GET /compute/v2.1/servers/1f9c4e23-8c35-4085-a8b2-d9a497239f72 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:16:42.644180 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-30acfa7f-fcaf-4d66-a904-ec58a4f0705b tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:16:42.649847 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-30acfa7f-fcaf-4d66-a904-ec58a4f0705b tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 1f9c4e23-8c35-4085-a8b2-d9a497239f72] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:16:42.653227 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-30acfa7f-fcaf-4d66-a904-ec58a4f0705b tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:42.653774 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-30acfa7f-fcaf-4d66-a904-ec58a4f0705b tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:42.654237 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-30acfa7f-fcaf-4d66-a904-ec58a4f0705b tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:42.654966 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-30acfa7f-fcaf-4d66-a904-ec58a4f0705b tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:42.655422 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-30acfa7f-fcaf-4d66-a904-ec58a4f0705b tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:42.655868 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-30acfa7f-fcaf-4d66-a904-ec58a4f0705b tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:42.791405 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-30acfa7f-fcaf-4d66-a904-ec58a4f0705b tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f7e244b0d4799b3b3b557e78e2bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167e643b30048719ceec299de90e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:16:42.799775 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-30acfa7f-fcaf-4d66-a904-ec58a4f0705b tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "GET /compute/v2.1/servers/1f9c4e23-8c35-4085-a8b2-d9a497239f72" status: 200 len: 1520 microversion: 2.1 time: 0.159574 Oct 19 04:16:42.800373 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3959/7446] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:16:42 2022] GET /compute/v2.1/servers/1f9c4e23-8c35-4085-a8b2-d9a497239f72 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:16:43.823507 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-504f897d-1e49-44cb-9211-d6f2d4e29d9b tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:16:43.824131 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-504f897d-1e49-44cb-9211-d6f2d4e29d9b tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 1f9c4e23-8c35-4085-a8b2-d9a497239f72] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:16:43.830954 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-504f897d-1e49-44cb-9211-d6f2d4e29d9b tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:43.831442 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-504f897d-1e49-44cb-9211-d6f2d4e29d9b tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:43.831897 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-504f897d-1e49-44cb-9211-d6f2d4e29d9b tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:43.832593 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-504f897d-1e49-44cb-9211-d6f2d4e29d9b tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:43.833053 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-504f897d-1e49-44cb-9211-d6f2d4e29d9b tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:43.833519 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-504f897d-1e49-44cb-9211-d6f2d4e29d9b tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:43.960880 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-504f897d-1e49-44cb-9211-d6f2d4e29d9b tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f7e244b0d4799b3b3b557e78e2bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167e643b30048719ceec299de90e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:16:43.963124 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:16:43.969176 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-504f897d-1e49-44cb-9211-d6f2d4e29d9b tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "GET /compute/v2.1/servers/1f9c4e23-8c35-4085-a8b2-d9a497239f72" status: 200 len: 1520 microversion: 2.1 time: 0.149570 Oct 19 04:16:43.969775 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3488/7447] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:16:43 2022] GET /compute/v2.1/servers/1f9c4e23-8c35-4085-a8b2-d9a497239f72 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:16:44.992639 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-292967bd-ef5c-4093-973d-329af1f56da5 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:16:44.993298 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-292967bd-ef5c-4093-973d-329af1f56da5 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 1f9c4e23-8c35-4085-a8b2-d9a497239f72] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:16:44.996510 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:16:45.001252 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-292967bd-ef5c-4093-973d-329af1f56da5 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:45.001819 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-292967bd-ef5c-4093-973d-329af1f56da5 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:45.002288 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-292967bd-ef5c-4093-973d-329af1f56da5 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:45.002998 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-292967bd-ef5c-4093-973d-329af1f56da5 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:45.003468 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-292967bd-ef5c-4093-973d-329af1f56da5 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:45.003916 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-292967bd-ef5c-4093-973d-329af1f56da5 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:45.135478 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-292967bd-ef5c-4093-973d-329af1f56da5 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f7e244b0d4799b3b3b557e78e2bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167e643b30048719ceec299de90e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:16:45.143871 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-292967bd-ef5c-4093-973d-329af1f56da5 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "GET /compute/v2.1/servers/1f9c4e23-8c35-4085-a8b2-d9a497239f72" status: 200 len: 1520 microversion: 2.1 time: 0.155242 Oct 19 04:16:45.144443 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3960/7448] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:16:44 2022] GET /compute/v2.1/servers/1f9c4e23-8c35-4085-a8b2-d9a497239f72 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:16:46.167440 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ebc016f7-2e47-4bc7-a5af-4b515b111ccb tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:16:46.168068 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ebc016f7-2e47-4bc7-a5af-4b515b111ccb tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 1f9c4e23-8c35-4085-a8b2-d9a497239f72] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:16:46.175341 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ebc016f7-2e47-4bc7-a5af-4b515b111ccb tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:46.175835 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ebc016f7-2e47-4bc7-a5af-4b515b111ccb tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:46.176284 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ebc016f7-2e47-4bc7-a5af-4b515b111ccb tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:46.176988 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ebc016f7-2e47-4bc7-a5af-4b515b111ccb tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:46.177554 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ebc016f7-2e47-4bc7-a5af-4b515b111ccb tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:46.183680 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ebc016f7-2e47-4bc7-a5af-4b515b111ccb tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:46.310977 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ebc016f7-2e47-4bc7-a5af-4b515b111ccb tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f7e244b0d4799b3b3b557e78e2bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167e643b30048719ceec299de90e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:16:46.319036 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ebc016f7-2e47-4bc7-a5af-4b515b111ccb tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "GET /compute/v2.1/servers/1f9c4e23-8c35-4085-a8b2-d9a497239f72" status: 200 len: 1520 microversion: 2.1 time: 0.155860 Oct 19 04:16:46.319646 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3489/7449] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:16:46 2022] GET /compute/v2.1/servers/1f9c4e23-8c35-4085-a8b2-d9a497239f72 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:16:47.341967 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ea96ab4c-377e-4561-bb50-dddc1f90c32e tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:16:47.342609 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ea96ab4c-377e-4561-bb50-dddc1f90c32e tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 1f9c4e23-8c35-4085-a8b2-d9a497239f72] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:16:47.349511 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ea96ab4c-377e-4561-bb50-dddc1f90c32e tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:47.350024 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ea96ab4c-377e-4561-bb50-dddc1f90c32e tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:47.350486 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ea96ab4c-377e-4561-bb50-dddc1f90c32e tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:47.351199 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ea96ab4c-377e-4561-bb50-dddc1f90c32e tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:47.351993 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ea96ab4c-377e-4561-bb50-dddc1f90c32e tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:47.352450 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ea96ab4c-377e-4561-bb50-dddc1f90c32e tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:47.480881 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ea96ab4c-377e-4561-bb50-dddc1f90c32e tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f7e244b0d4799b3b3b557e78e2bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167e643b30048719ceec299de90e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:16:47.488678 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ea96ab4c-377e-4561-bb50-dddc1f90c32e tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "GET /compute/v2.1/servers/1f9c4e23-8c35-4085-a8b2-d9a497239f72" status: 200 len: 1520 microversion: 2.1 time: 0.150681 Oct 19 04:16:47.489258 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3961/7450] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:16:47 2022] GET /compute/v2.1/servers/1f9c4e23-8c35-4085-a8b2-d9a497239f72 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:16:48.514092 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4ff0e629-a469-4426-8bdf-4daf80e1aefd tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:16:48.514721 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4ff0e629-a469-4426-8bdf-4daf80e1aefd tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 1f9c4e23-8c35-4085-a8b2-d9a497239f72] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:16:48.517655 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=36 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:16:48.522592 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4ff0e629-a469-4426-8bdf-4daf80e1aefd tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:48.523088 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4ff0e629-a469-4426-8bdf-4daf80e1aefd tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:48.523535 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4ff0e629-a469-4426-8bdf-4daf80e1aefd tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:48.524240 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4ff0e629-a469-4426-8bdf-4daf80e1aefd tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:48.524701 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4ff0e629-a469-4426-8bdf-4daf80e1aefd tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:48.525137 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4ff0e629-a469-4426-8bdf-4daf80e1aefd tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:48.657241 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4ff0e629-a469-4426-8bdf-4daf80e1aefd tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f7e244b0d4799b3b3b557e78e2bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167e643b30048719ceec299de90e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:16:48.665083 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4ff0e629-a469-4426-8bdf-4daf80e1aefd tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "GET /compute/v2.1/servers/1f9c4e23-8c35-4085-a8b2-d9a497239f72" status: 200 len: 1520 microversion: 2.1 time: 0.155467 Oct 19 04:16:48.665680 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3490/7451] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:16:48 2022] GET /compute/v2.1/servers/1f9c4e23-8c35-4085-a8b2-d9a497239f72 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:16:49.687088 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0c3d7b92-5b35-4172-a209-55205136812b tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:16:49.687727 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0c3d7b92-5b35-4172-a209-55205136812b tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 1f9c4e23-8c35-4085-a8b2-d9a497239f72] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:16:49.694815 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0c3d7b92-5b35-4172-a209-55205136812b tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:49.695314 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0c3d7b92-5b35-4172-a209-55205136812b tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:49.695770 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0c3d7b92-5b35-4172-a209-55205136812b tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:49.696474 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0c3d7b92-5b35-4172-a209-55205136812b tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:49.696946 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0c3d7b92-5b35-4172-a209-55205136812b tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:49.697407 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0c3d7b92-5b35-4172-a209-55205136812b tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:49.826391 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0c3d7b92-5b35-4172-a209-55205136812b tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f7e244b0d4799b3b3b557e78e2bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167e643b30048719ceec299de90e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:16:49.834121 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0c3d7b92-5b35-4172-a209-55205136812b tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "GET /compute/v2.1/servers/1f9c4e23-8c35-4085-a8b2-d9a497239f72" status: 200 len: 1520 microversion: 2.1 time: 0.150948 Oct 19 04:16:49.834691 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3962/7452] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:16:49 2022] GET /compute/v2.1/servers/1f9c4e23-8c35-4085-a8b2-d9a497239f72 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:16:50.858311 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-259ba248-0a3d-4c17-a69c-544450a44c4a tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:16:50.858939 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-259ba248-0a3d-4c17-a69c-544450a44c4a tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 1f9c4e23-8c35-4085-a8b2-d9a497239f72] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:16:50.865783 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-259ba248-0a3d-4c17-a69c-544450a44c4a tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:50.866282 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-259ba248-0a3d-4c17-a69c-544450a44c4a tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:50.866734 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-259ba248-0a3d-4c17-a69c-544450a44c4a tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:50.867436 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-259ba248-0a3d-4c17-a69c-544450a44c4a tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:50.867905 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-259ba248-0a3d-4c17-a69c-544450a44c4a tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:50.868340 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-259ba248-0a3d-4c17-a69c-544450a44c4a tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:51.000881 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-259ba248-0a3d-4c17-a69c-544450a44c4a tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f7e244b0d4799b3b3b557e78e2bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167e643b30048719ceec299de90e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:16:51.008916 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-259ba248-0a3d-4c17-a69c-544450a44c4a tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "GET /compute/v2.1/servers/1f9c4e23-8c35-4085-a8b2-d9a497239f72" status: 200 len: 1520 microversion: 2.1 time: 0.155181 Oct 19 04:16:51.009527 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3491/7453] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:16:50 2022] GET /compute/v2.1/servers/1f9c4e23-8c35-4085-a8b2-d9a497239f72 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:16:52.032162 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8ccc70b4-9bcb-4842-a02c-234af117392c tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:16:52.032791 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8ccc70b4-9bcb-4842-a02c-234af117392c tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 1f9c4e23-8c35-4085-a8b2-d9a497239f72] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:16:52.039684 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8ccc70b4-9bcb-4842-a02c-234af117392c tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:52.040184 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8ccc70b4-9bcb-4842-a02c-234af117392c tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:52.040633 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8ccc70b4-9bcb-4842-a02c-234af117392c tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:52.041332 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8ccc70b4-9bcb-4842-a02c-234af117392c tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:52.041822 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8ccc70b4-9bcb-4842-a02c-234af117392c tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:52.042259 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8ccc70b4-9bcb-4842-a02c-234af117392c tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:52.173242 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8ccc70b4-9bcb-4842-a02c-234af117392c tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f7e244b0d4799b3b3b557e78e2bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167e643b30048719ceec299de90e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:16:52.180945 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8ccc70b4-9bcb-4842-a02c-234af117392c tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "GET /compute/v2.1/servers/1f9c4e23-8c35-4085-a8b2-d9a497239f72" status: 200 len: 1520 microversion: 2.1 time: 0.152772 Oct 19 04:16:52.181533 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3963/7454] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:16:52 2022] GET /compute/v2.1/servers/1f9c4e23-8c35-4085-a8b2-d9a497239f72 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:16:53.204341 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-04473037-466e-4939-b87f-5af2d2857b49 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:16:53.204958 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-04473037-466e-4939-b87f-5af2d2857b49 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 1f9c4e23-8c35-4085-a8b2-d9a497239f72] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:16:53.211896 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-04473037-466e-4939-b87f-5af2d2857b49 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:53.212383 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-04473037-466e-4939-b87f-5af2d2857b49 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:53.212823 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-04473037-466e-4939-b87f-5af2d2857b49 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:53.213541 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-04473037-466e-4939-b87f-5af2d2857b49 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:53.213999 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-04473037-466e-4939-b87f-5af2d2857b49 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:53.214424 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-04473037-466e-4939-b87f-5af2d2857b49 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:53.341063 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-04473037-466e-4939-b87f-5af2d2857b49 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f7e244b0d4799b3b3b557e78e2bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167e643b30048719ceec299de90e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:16:53.348745 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-04473037-466e-4939-b87f-5af2d2857b49 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "GET /compute/v2.1/servers/1f9c4e23-8c35-4085-a8b2-d9a497239f72" status: 200 len: 1520 microversion: 2.1 time: 0.148351 Oct 19 04:16:53.349314 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3492/7455] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:16:53 2022] GET /compute/v2.1/servers/1f9c4e23-8c35-4085-a8b2-d9a497239f72 => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:16:54.374163 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1a15423d-8742-4e69-ad68-775acadc535b tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:16:54.374730 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1a15423d-8742-4e69-ad68-775acadc535b tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 1f9c4e23-8c35-4085-a8b2-d9a497239f72] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:16:54.381736 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1a15423d-8742-4e69-ad68-775acadc535b tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:54.382244 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1a15423d-8742-4e69-ad68-775acadc535b tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:54.382703 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1a15423d-8742-4e69-ad68-775acadc535b tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:54.383419 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1a15423d-8742-4e69-ad68-775acadc535b tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:54.383893 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1a15423d-8742-4e69-ad68-775acadc535b tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:54.384345 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1a15423d-8742-4e69-ad68-775acadc535b tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:54.515960 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-1a15423d-8742-4e69-ad68-775acadc535b tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f7e244b0d4799b3b3b557e78e2bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167e643b30048719ceec299de90e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:16:54.524092 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1a15423d-8742-4e69-ad68-775acadc535b tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "GET /compute/v2.1/servers/1f9c4e23-8c35-4085-a8b2-d9a497239f72" status: 200 len: 1520 microversion: 2.1 time: 0.154759 Oct 19 04:16:54.524683 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3964/7456] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:16:54 2022] GET /compute/v2.1/servers/1f9c4e23-8c35-4085-a8b2-d9a497239f72 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:16:55.547102 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7ae6747e-2947-4ed5-92bd-9fd30f5b95d2 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:16:55.547725 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7ae6747e-2947-4ed5-92bd-9fd30f5b95d2 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 1f9c4e23-8c35-4085-a8b2-d9a497239f72] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:16:55.554601 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7ae6747e-2947-4ed5-92bd-9fd30f5b95d2 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:55.555093 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7ae6747e-2947-4ed5-92bd-9fd30f5b95d2 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:55.555539 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7ae6747e-2947-4ed5-92bd-9fd30f5b95d2 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:55.556240 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7ae6747e-2947-4ed5-92bd-9fd30f5b95d2 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:55.556696 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7ae6747e-2947-4ed5-92bd-9fd30f5b95d2 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:55.557131 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7ae6747e-2947-4ed5-92bd-9fd30f5b95d2 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:55.739238 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7ae6747e-2947-4ed5-92bd-9fd30f5b95d2 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f7e244b0d4799b3b3b557e78e2bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167e643b30048719ceec299de90e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:16:55.747729 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7ae6747e-2947-4ed5-92bd-9fd30f5b95d2 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "GET /compute/v2.1/servers/1f9c4e23-8c35-4085-a8b2-d9a497239f72" status: 200 len: 1520 microversion: 2.1 time: 0.204578 Oct 19 04:16:55.748296 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3493/7457] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:16:55 2022] GET /compute/v2.1/servers/1f9c4e23-8c35-4085-a8b2-d9a497239f72 => generated 1520 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:16:56.770861 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-07e72cea-5715-4f9b-87ec-7fa49c06618f tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:16:56.771497 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-07e72cea-5715-4f9b-87ec-7fa49c06618f tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 1f9c4e23-8c35-4085-a8b2-d9a497239f72] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:16:56.779341 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-07e72cea-5715-4f9b-87ec-7fa49c06618f tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:56.779847 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-07e72cea-5715-4f9b-87ec-7fa49c06618f tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:56.780304 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-07e72cea-5715-4f9b-87ec-7fa49c06618f tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:56.781017 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-07e72cea-5715-4f9b-87ec-7fa49c06618f tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:56.781538 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-07e72cea-5715-4f9b-87ec-7fa49c06618f tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:56.781992 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-07e72cea-5715-4f9b-87ec-7fa49c06618f tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:56.915287 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-07e72cea-5715-4f9b-87ec-7fa49c06618f tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f7e244b0d4799b3b3b557e78e2bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167e643b30048719ceec299de90e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:16:56.923096 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-07e72cea-5715-4f9b-87ec-7fa49c06618f tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "GET /compute/v2.1/servers/1f9c4e23-8c35-4085-a8b2-d9a497239f72" status: 200 len: 1520 microversion: 2.1 time: 0.156194 Oct 19 04:16:56.923695 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3965/7458] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:16:56 2022] GET /compute/v2.1/servers/1f9c4e23-8c35-4085-a8b2-d9a497239f72 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:16:57.946224 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7f762f59-9608-40ee-9124-38d1fe2d8462 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:16:57.946980 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7f762f59-9608-40ee-9124-38d1fe2d8462 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 1f9c4e23-8c35-4085-a8b2-d9a497239f72] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:16:57.954511 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7f762f59-9608-40ee-9124-38d1fe2d8462 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:57.955017 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7f762f59-9608-40ee-9124-38d1fe2d8462 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:57.955470 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7f762f59-9608-40ee-9124-38d1fe2d8462 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:57.956182 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7f762f59-9608-40ee-9124-38d1fe2d8462 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:57.956648 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7f762f59-9608-40ee-9124-38d1fe2d8462 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:57.957086 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7f762f59-9608-40ee-9124-38d1fe2d8462 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:58.090910 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7f762f59-9608-40ee-9124-38d1fe2d8462 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f7e244b0d4799b3b3b557e78e2bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167e643b30048719ceec299de90e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:16:58.098932 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7f762f59-9608-40ee-9124-38d1fe2d8462 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "GET /compute/v2.1/servers/1f9c4e23-8c35-4085-a8b2-d9a497239f72" status: 200 len: 1519 microversion: 2.1 time: 0.156641 Oct 19 04:16:58.099519 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3494/7459] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:16:57 2022] GET /compute/v2.1/servers/1f9c4e23-8c35-4085-a8b2-d9a497239f72 => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:16:58.379506 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-17c239e3-6b08-4176-885d-0968c132a30b req-68900968-c35a-42e5-9972-36eec84dbfd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f9c4e23-8c35-4085-a8b2-d9a497239f72", "name": "network-vif-unplugged", "status": "completed", "tag": "9fc439bb-f5c0-49b8-91ad-767eebb33ae0"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:16:58.389097 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-17c239e3-6b08-4176-885d-0968c132a30b req-68900968-c35a-42e5-9972-36eec84dbfd7 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:58.389568 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-17c239e3-6b08-4176-885d-0968c132a30b req-68900968-c35a-42e5-9972-36eec84dbfd7 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:58.390026 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-17c239e3-6b08-4176-885d-0968c132a30b req-68900968-c35a-42e5-9972-36eec84dbfd7 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:58.402908 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-17c239e3-6b08-4176-885d-0968c132a30b req-68900968-c35a-42e5-9972-36eec84dbfd7 service nova] Creating event network-vif-unplugged:9fc439bb-f5c0-49b8-91ad-767eebb33ae0 for instance 1f9c4e23-8c35-4085-a8b2-d9a497239f72 on n-h1-861333-8 Oct 19 04:16:58.408431 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [req-17c239e3-6b08-4176-885d-0968c132a30b req-68900968-c35a-42e5-9972-36eec84dbfd7 service nova] Instance 1f9c4e23-8c35-4085-a8b2-d9a497239f72 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-861333-8', 'n-h1-861333-8'} {{(pid=121134) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 04:16:58.420019 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-17c239e3-6b08-4176-885d-0968c132a30b req-68900968-c35a-42e5-9972-36eec84dbfd7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.097565 Oct 19 04:16:58.420875 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3966/7460] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:16:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:16:59.122729 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ca5e46be-ea96-4f92-b3b9-df9640a4a417 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:16:59.123353 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ca5e46be-ea96-4f92-b3b9-df9640a4a417 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 1f9c4e23-8c35-4085-a8b2-d9a497239f72] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:16:59.130130 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ca5e46be-ea96-4f92-b3b9-df9640a4a417 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:59.130619 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ca5e46be-ea96-4f92-b3b9-df9640a4a417 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:59.131062 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ca5e46be-ea96-4f92-b3b9-df9640a4a417 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:59.131755 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ca5e46be-ea96-4f92-b3b9-df9640a4a417 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:16:59.132209 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ca5e46be-ea96-4f92-b3b9-df9640a4a417 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:16:59.132638 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ca5e46be-ea96-4f92-b3b9-df9640a4a417 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:16:59.267608 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ca5e46be-ea96-4f92-b3b9-df9640a4a417 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f7e244b0d4799b3b3b557e78e2bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167e643b30048719ceec299de90e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:16:59.275656 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ca5e46be-ea96-4f92-b3b9-df9640a4a417 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "GET /compute/v2.1/servers/1f9c4e23-8c35-4085-a8b2-d9a497239f72" status: 200 len: 1519 microversion: 2.1 time: 0.157361 Oct 19 04:16:59.276234 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3495/7461] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:16:59 2022] GET /compute/v2.1/servers/1f9c4e23-8c35-4085-a8b2-d9a497239f72 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:17:00.301824 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1c08eeb0-04c2-4740-a678-8e06a3c7bc40 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:17:00.302586 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1c08eeb0-04c2-4740-a678-8e06a3c7bc40 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 1f9c4e23-8c35-4085-a8b2-d9a497239f72] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:17:00.309694 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1c08eeb0-04c2-4740-a678-8e06a3c7bc40 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:17:00.310197 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1c08eeb0-04c2-4740-a678-8e06a3c7bc40 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:17:00.310656 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1c08eeb0-04c2-4740-a678-8e06a3c7bc40 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:17:00.311367 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1c08eeb0-04c2-4740-a678-8e06a3c7bc40 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:17:00.311875 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1c08eeb0-04c2-4740-a678-8e06a3c7bc40 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:17:00.312350 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1c08eeb0-04c2-4740-a678-8e06a3c7bc40 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:17:00.443291 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-1c08eeb0-04c2-4740-a678-8e06a3c7bc40 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f7e244b0d4799b3b3b557e78e2bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167e643b30048719ceec299de90e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:17:00.444942 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-b528740c-998d-4913-996e-586b887875f4 req-4af625f8-1afa-4a03-a60f-88d35740b422 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f9c4e23-8c35-4085-a8b2-d9a497239f72", "tag": "9fc439bb-f5c0-49b8-91ad-767eebb33ae0"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:17:00.451426 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1c08eeb0-04c2-4740-a678-8e06a3c7bc40 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "GET /compute/v2.1/servers/1f9c4e23-8c35-4085-a8b2-d9a497239f72" status: 200 len: 1517 microversion: 2.1 time: 0.155526 Oct 19 04:17:00.457535 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-b528740c-998d-4913-996e-586b887875f4 req-4af625f8-1afa-4a03-a60f-88d35740b422 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:17:00.457535 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-b528740c-998d-4913-996e-586b887875f4 req-4af625f8-1afa-4a03-a60f-88d35740b422 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:17:00.457535 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-b528740c-998d-4913-996e-586b887875f4 req-4af625f8-1afa-4a03-a60f-88d35740b422 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:17:00.457798 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3967/7462] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:17:00 2022] GET /compute/v2.1/servers/1f9c4e23-8c35-4085-a8b2-d9a497239f72 => generated 1517 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:17:00.468002 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-b528740c-998d-4913-996e-586b887875f4 req-4af625f8-1afa-4a03-a60f-88d35740b422 service nova] Creating event network-changed:9fc439bb-f5c0-49b8-91ad-767eebb33ae0 for instance 1f9c4e23-8c35-4085-a8b2-d9a497239f72 on n-h1-861333-8 Oct 19 04:17:00.473619 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [req-b528740c-998d-4913-996e-586b887875f4 req-4af625f8-1afa-4a03-a60f-88d35740b422 service nova] Instance 1f9c4e23-8c35-4085-a8b2-d9a497239f72 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-861333-8', 'n-h1-861333-8'} {{(pid=121135) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 04:17:00.484928 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-b528740c-998d-4913-996e-586b887875f4 req-4af625f8-1afa-4a03-a60f-88d35740b422 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043649 Oct 19 04:17:00.485553 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3496/7463] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:17:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 04:17:01.476025 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e7065376-ff67-4fa4-99f2-814677a53021 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:17:01.476595 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e7065376-ff67-4fa4-99f2-814677a53021 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 1f9c4e23-8c35-4085-a8b2-d9a497239f72] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:17:01.483651 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e7065376-ff67-4fa4-99f2-814677a53021 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:17:01.484153 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e7065376-ff67-4fa4-99f2-814677a53021 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:17:01.484610 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e7065376-ff67-4fa4-99f2-814677a53021 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:17:01.485317 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e7065376-ff67-4fa4-99f2-814677a53021 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:17:01.485817 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e7065376-ff67-4fa4-99f2-814677a53021 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:17:01.486289 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e7065376-ff67-4fa4-99f2-814677a53021 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:17:01.685595 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e7065376-ff67-4fa4-99f2-814677a53021 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f7e244b0d4799b3b3b557e78e2bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167e643b30048719ceec299de90e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:17:01.685595 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e7065376-ff67-4fa4-99f2-814677a53021 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "GET /compute/v2.1/servers/1f9c4e23-8c35-4085-a8b2-d9a497239f72" status: 200 len: 1517 microversion: 2.1 time: 0.161214 Oct 19 04:17:01.685595 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3968/7464] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:17:01 2022] GET /compute/v2.1/servers/1f9c4e23-8c35-4085-a8b2-d9a497239f72 => generated 1517 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:17:02.664983 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-418f4f15-7fb1-416a-86e9-0411d7410802 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:17:02.665720 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-418f4f15-7fb1-416a-86e9-0411d7410802 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 1f9c4e23-8c35-4085-a8b2-d9a497239f72] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:17:02.671969 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-418f4f15-7fb1-416a-86e9-0411d7410802 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:17:02.672462 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-418f4f15-7fb1-416a-86e9-0411d7410802 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:17:02.672903 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-418f4f15-7fb1-416a-86e9-0411d7410802 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:17:02.673649 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-418f4f15-7fb1-416a-86e9-0411d7410802 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:17:02.674097 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-418f4f15-7fb1-416a-86e9-0411d7410802 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:17:02.674526 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-418f4f15-7fb1-416a-86e9-0411d7410802 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:17:02.815516 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-418f4f15-7fb1-416a-86e9-0411d7410802 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f7e244b0d4799b3b3b557e78e2bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167e643b30048719ceec299de90e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:17:02.823469 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-418f4f15-7fb1-416a-86e9-0411d7410802 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "GET /compute/v2.1/servers/1f9c4e23-8c35-4085-a8b2-d9a497239f72" status: 200 len: 1517 microversion: 2.1 time: 0.163931 Oct 19 04:17:02.824676 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3497/7465] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:17:02 2022] GET /compute/v2.1/servers/1f9c4e23-8c35-4085-a8b2-d9a497239f72 => generated 1517 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:17:03.847081 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4d894982-1ed4-4e5f-8b06-36032554fda2 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:17:03.847718 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4d894982-1ed4-4e5f-8b06-36032554fda2 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 1f9c4e23-8c35-4085-a8b2-d9a497239f72] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:17:03.854699 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4d894982-1ed4-4e5f-8b06-36032554fda2 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:17:03.855842 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4d894982-1ed4-4e5f-8b06-36032554fda2 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:17:03.856302 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4d894982-1ed4-4e5f-8b06-36032554fda2 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:17:03.857013 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4d894982-1ed4-4e5f-8b06-36032554fda2 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:17:03.857520 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4d894982-1ed4-4e5f-8b06-36032554fda2 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:17:03.857966 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4d894982-1ed4-4e5f-8b06-36032554fda2 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:17:03.990130 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-4d894982-1ed4-4e5f-8b06-36032554fda2 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f7e244b0d4799b3b3b557e78e2bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167e643b30048719ceec299de90e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:17:03.998149 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4d894982-1ed4-4e5f-8b06-36032554fda2 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "GET /compute/v2.1/servers/1f9c4e23-8c35-4085-a8b2-d9a497239f72" status: 200 len: 1514 microversion: 2.1 time: 0.155017 Oct 19 04:17:03.998735 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3969/7466] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:17:03 2022] GET /compute/v2.1/servers/1f9c4e23-8c35-4085-a8b2-d9a497239f72 => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:17:04.020687 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-93e47385-3e07-4ec3-ae19-dd5fc4d938e3 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:17:04.021231 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-93e47385-3e07-4ec3-ae19-dd5fc4d938e3 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 1f9c4e23-8c35-4085-a8b2-d9a497239f72] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:17:04.029683 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-93e47385-3e07-4ec3-ae19-dd5fc4d938e3 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:17:04.030224 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-93e47385-3e07-4ec3-ae19-dd5fc4d938e3 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:17:04.030685 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-93e47385-3e07-4ec3-ae19-dd5fc4d938e3 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:17:04.031411 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-93e47385-3e07-4ec3-ae19-dd5fc4d938e3 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:17:04.031881 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-93e47385-3e07-4ec3-ae19-dd5fc4d938e3 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:17:04.032354 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-93e47385-3e07-4ec3-ae19-dd5fc4d938e3 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:17:04.194815 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-93e47385-3e07-4ec3-ae19-dd5fc4d938e3 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "POST /compute/v2.1/servers/1f9c4e23-8c35-4085-a8b2-d9a497239f72/action" status: 204 len: 0 microversion: 2.1 time: 0.177765 Oct 19 04:17:04.195715 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3498/7467] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 04:17:04 2022] POST /compute/v2.1/servers/1f9c4e23-8c35-4085-a8b2-d9a497239f72/action => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 04:17:04.204589 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f2d5ccc2-d604-46be-bbb9-2dabf5ea900c tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:17:04.205222 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f2d5ccc2-d604-46be-bbb9-2dabf5ea900c tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 1f9c4e23-8c35-4085-a8b2-d9a497239f72] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:17:04.211205 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f2d5ccc2-d604-46be-bbb9-2dabf5ea900c tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:17:04.211703 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f2d5ccc2-d604-46be-bbb9-2dabf5ea900c tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:17:04.212254 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f2d5ccc2-d604-46be-bbb9-2dabf5ea900c tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:17:04.212842 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f2d5ccc2-d604-46be-bbb9-2dabf5ea900c tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:17:04.213327 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f2d5ccc2-d604-46be-bbb9-2dabf5ea900c tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:17:04.213781 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f2d5ccc2-d604-46be-bbb9-2dabf5ea900c tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:17:04.349293 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-f2d5ccc2-d604-46be-bbb9-2dabf5ea900c tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f7e244b0d4799b3b3b557e78e2bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167e643b30048719ceec299de90e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:17:04.357252 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f2d5ccc2-d604-46be-bbb9-2dabf5ea900c tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "GET /compute/v2.1/servers/1f9c4e23-8c35-4085-a8b2-d9a497239f72" status: 200 len: 1514 microversion: 2.1 time: 0.156579 Oct 19 04:17:04.357805 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3970/7468] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:17:04 2022] GET /compute/v2.1/servers/1f9c4e23-8c35-4085-a8b2-d9a497239f72 => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:17:05.387286 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ba873b8a-3189-44c8-9c2c-6ce6f4a47e47 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:17:05.388643 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ba873b8a-3189-44c8-9c2c-6ce6f4a47e47 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 1f9c4e23-8c35-4085-a8b2-d9a497239f72] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:17:05.394895 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ba873b8a-3189-44c8-9c2c-6ce6f4a47e47 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:17:05.395481 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ba873b8a-3189-44c8-9c2c-6ce6f4a47e47 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:17:05.395925 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ba873b8a-3189-44c8-9c2c-6ce6f4a47e47 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:17:05.396625 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ba873b8a-3189-44c8-9c2c-6ce6f4a47e47 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:17:05.397331 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ba873b8a-3189-44c8-9c2c-6ce6f4a47e47 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:17:05.397786 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ba873b8a-3189-44c8-9c2c-6ce6f4a47e47 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:17:05.535372 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ba873b8a-3189-44c8-9c2c-6ce6f4a47e47 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f7e244b0d4799b3b3b557e78e2bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167e643b30048719ceec299de90e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:17:05.543268 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ba873b8a-3189-44c8-9c2c-6ce6f4a47e47 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "GET /compute/v2.1/servers/1f9c4e23-8c35-4085-a8b2-d9a497239f72" status: 200 len: 1514 microversion: 2.1 time: 0.161082 Oct 19 04:17:05.543846 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3499/7469] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:17:05 2022] GET /compute/v2.1/servers/1f9c4e23-8c35-4085-a8b2-d9a497239f72 => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:17:06.453948 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-ebb42f76-a054-46ae-95b8-bda00204a84b req-bceac2f0-ebc6-4e72-9d72-fb861f98e30d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f9c4e23-8c35-4085-a8b2-d9a497239f72", "name": "network-vif-plugged", "status": "completed", "tag": "9fc439bb-f5c0-49b8-91ad-767eebb33ae0"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:17:06.463651 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-ebb42f76-a054-46ae-95b8-bda00204a84b req-bceac2f0-ebc6-4e72-9d72-fb861f98e30d service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:17:06.464149 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-ebb42f76-a054-46ae-95b8-bda00204a84b req-bceac2f0-ebc6-4e72-9d72-fb861f98e30d service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:17:06.464605 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-ebb42f76-a054-46ae-95b8-bda00204a84b req-bceac2f0-ebc6-4e72-9d72-fb861f98e30d service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:17:06.477483 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-ebb42f76-a054-46ae-95b8-bda00204a84b req-bceac2f0-ebc6-4e72-9d72-fb861f98e30d service nova] Creating event network-vif-plugged:9fc439bb-f5c0-49b8-91ad-767eebb33ae0 for instance 1f9c4e23-8c35-4085-a8b2-d9a497239f72 on n-h1-861333-8 Oct 19 04:17:06.483716 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-ebb42f76-a054-46ae-95b8-bda00204a84b req-bceac2f0-ebc6-4e72-9d72-fb861f98e30d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120321 Oct 19 04:17:06.484764 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3971/7470] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:17:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 04:17:06.566361 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-574880fd-5e22-4235-beca-dcc10391fe48 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:17:06.566982 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-574880fd-5e22-4235-beca-dcc10391fe48 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 1f9c4e23-8c35-4085-a8b2-d9a497239f72] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:17:06.573954 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-574880fd-5e22-4235-beca-dcc10391fe48 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:17:06.574444 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-574880fd-5e22-4235-beca-dcc10391fe48 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:17:06.574888 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-574880fd-5e22-4235-beca-dcc10391fe48 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:17:06.575682 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-574880fd-5e22-4235-beca-dcc10391fe48 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:17:06.576187 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-574880fd-5e22-4235-beca-dcc10391fe48 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:17:06.576621 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-574880fd-5e22-4235-beca-dcc10391fe48 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:17:06.707704 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-574880fd-5e22-4235-beca-dcc10391fe48 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f7e244b0d4799b3b3b557e78e2bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167e643b30048719ceec299de90e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:17:06.715979 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-574880fd-5e22-4235-beca-dcc10391fe48 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "GET /compute/v2.1/servers/1f9c4e23-8c35-4085-a8b2-d9a497239f72" status: 200 len: 1506 microversion: 2.1 time: 0.153565 Oct 19 04:17:06.716586 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3500/7471] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:17:06 2022] GET /compute/v2.1/servers/1f9c4e23-8c35-4085-a8b2-d9a497239f72 => generated 1506 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:17:06.739074 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-02576a03-daaa-40a5-9003-f0f9a41c595d tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:17:06.739804 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-02576a03-daaa-40a5-9003-f0f9a41c595d tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 1f9c4e23-8c35-4085-a8b2-d9a497239f72] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:17:06.746569 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-02576a03-daaa-40a5-9003-f0f9a41c595d tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:17:06.747077 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-02576a03-daaa-40a5-9003-f0f9a41c595d tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:17:06.747537 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-02576a03-daaa-40a5-9003-f0f9a41c595d tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:17:06.748254 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-02576a03-daaa-40a5-9003-f0f9a41c595d tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:17:06.748725 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-02576a03-daaa-40a5-9003-f0f9a41c595d tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:17:06.749172 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-02576a03-daaa-40a5-9003-f0f9a41c595d tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:17:06.875775 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-02576a03-daaa-40a5-9003-f0f9a41c595d tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f7e244b0d4799b3b3b557e78e2bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167e643b30048719ceec299de90e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:17:06.883614 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-02576a03-daaa-40a5-9003-f0f9a41c595d tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "GET /compute/v2.1/servers/1f9c4e23-8c35-4085-a8b2-d9a497239f72" status: 200 len: 1506 microversion: 2.1 time: 0.148774 Oct 19 04:17:06.884196 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3972/7472] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:17:06 2022] GET /compute/v2.1/servers/1f9c4e23-8c35-4085-a8b2-d9a497239f72 => generated 1506 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:17:06.906873 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6cd5d966-3c0f-4a63-84f3-4beb301cb700 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:17:06.907526 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6cd5d966-3c0f-4a63-84f3-4beb301cb700 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 1f9c4e23-8c35-4085-a8b2-d9a497239f72] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:17:06.913502 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6cd5d966-3c0f-4a63-84f3-4beb301cb700 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:17:06.914001 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6cd5d966-3c0f-4a63-84f3-4beb301cb700 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:17:06.914442 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6cd5d966-3c0f-4a63-84f3-4beb301cb700 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:17:06.915141 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6cd5d966-3c0f-4a63-84f3-4beb301cb700 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:17:06.915597 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6cd5d966-3c0f-4a63-84f3-4beb301cb700 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:17:06.916032 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6cd5d966-3c0f-4a63-84f3-4beb301cb700 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:17:07.046209 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-6cd5d966-3c0f-4a63-84f3-4beb301cb700 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f7e244b0d4799b3b3b557e78e2bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167e643b30048719ceec299de90e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:17:07.053920 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6cd5d966-3c0f-4a63-84f3-4beb301cb700 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "GET /compute/v2.1/servers/1f9c4e23-8c35-4085-a8b2-d9a497239f72" status: 200 len: 1506 microversion: 2.1 time: 0.151019 Oct 19 04:17:07.054494 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3501/7473] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:17:06 2022] GET /compute/v2.1/servers/1f9c4e23-8c35-4085-a8b2-d9a497239f72 => generated 1506 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:17:07.076270 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e02e66b9-2bcf-457e-91fa-5f27683887f3 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:17:07.076784 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e02e66b9-2bcf-457e-91fa-5f27683887f3 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 1f9c4e23-8c35-4085-a8b2-d9a497239f72] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:17:07.082786 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e02e66b9-2bcf-457e-91fa-5f27683887f3 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:17:07.083283 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e02e66b9-2bcf-457e-91fa-5f27683887f3 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:17:07.083733 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e02e66b9-2bcf-457e-91fa-5f27683887f3 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:17:07.084440 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e02e66b9-2bcf-457e-91fa-5f27683887f3 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:17:07.084903 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e02e66b9-2bcf-457e-91fa-5f27683887f3 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:17:07.085342 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e02e66b9-2bcf-457e-91fa-5f27683887f3 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:17:07.112341 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e02e66b9-2bcf-457e-91fa-5f27683887f3 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 1f9c4e23-8c35-4085-a8b2-d9a497239f72] Going to try to terminate instance {{(pid=121134) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 04:17:07.333206 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e02e66b9-2bcf-457e-91fa-5f27683887f3 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1f9c4e23-8c35-4085-a8b2-d9a497239f72" status: 204 len: 0 microversion: 2.1 time: 0.260500 Oct 19 04:17:07.333783 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3973/7474] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 04:17:07 2022] DELETE /compute/v2.1/servers/1f9c4e23-8c35-4085-a8b2-d9a497239f72 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 04:17:07.351167 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d1e0495c-3e21-4305-ab14-42e973933dc8 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:17:07.351674 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d1e0495c-3e21-4305-ab14-42e973933dc8 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 1f9c4e23-8c35-4085-a8b2-d9a497239f72] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:17:07.358350 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d1e0495c-3e21-4305-ab14-42e973933dc8 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:17:07.358860 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d1e0495c-3e21-4305-ab14-42e973933dc8 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:17:07.359297 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d1e0495c-3e21-4305-ab14-42e973933dc8 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:17:07.359986 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d1e0495c-3e21-4305-ab14-42e973933dc8 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:17:07.360441 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d1e0495c-3e21-4305-ab14-42e973933dc8 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:17:07.360868 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d1e0495c-3e21-4305-ab14-42e973933dc8 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:17:07.385696 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d1e0495c-3e21-4305-ab14-42e973933dc8 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 1f9c4e23-8c35-4085-a8b2-d9a497239f72] Going to try to terminate instance {{(pid=121135) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 04:17:07.430470 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.compute.api [None req-d1e0495c-3e21-4305-ab14-42e973933dc8 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 1f9c4e23-8c35-4085-a8b2-d9a497239f72] Instance is already in deleting state, ignoring this request Oct 19 04:17:07.431298 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d1e0495c-3e21-4305-ab14-42e973933dc8 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1f9c4e23-8c35-4085-a8b2-d9a497239f72" status: 204 len: 0 microversion: 2.1 time: 0.084089 Oct 19 04:17:07.431853 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3502/7475] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 04:17:07 2022] DELETE /compute/v2.1/servers/1f9c4e23-8c35-4085-a8b2-d9a497239f72 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 04:17:07.440545 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-bf017053-9b79-4a9f-998d-34221d328ad1 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:17:07.441279 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-bf017053-9b79-4a9f-998d-34221d328ad1 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 1f9c4e23-8c35-4085-a8b2-d9a497239f72] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:17:07.448007 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bf017053-9b79-4a9f-998d-34221d328ad1 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:17:07.448500 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bf017053-9b79-4a9f-998d-34221d328ad1 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:17:07.448949 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bf017053-9b79-4a9f-998d-34221d328ad1 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:17:07.449664 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bf017053-9b79-4a9f-998d-34221d328ad1 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:17:07.450131 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bf017053-9b79-4a9f-998d-34221d328ad1 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:17:07.450569 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bf017053-9b79-4a9f-998d-34221d328ad1 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:17:07.579336 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-bf017053-9b79-4a9f-998d-34221d328ad1 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f7e244b0d4799b3b3b557e78e2bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167e643b30048719ceec299de90e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:17:07.581750 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:17:07.593299 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-bf017053-9b79-4a9f-998d-34221d328ad1 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "GET /compute/v2.1/servers/1f9c4e23-8c35-4085-a8b2-d9a497239f72" status: 200 len: 1512 microversion: 2.1 time: 0.151646 Oct 19 04:17:07.593299 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3974/7476] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:17:07 2022] GET /compute/v2.1/servers/1f9c4e23-8c35-4085-a8b2-d9a497239f72 => generated 1512 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:17:08.610939 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-196a1f50-e603-4f11-a507-20d3b961e2d0 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:17:08.611570 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-196a1f50-e603-4f11-a507-20d3b961e2d0 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 1f9c4e23-8c35-4085-a8b2-d9a497239f72] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:17:08.618484 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-196a1f50-e603-4f11-a507-20d3b961e2d0 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:17:08.618980 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-196a1f50-e603-4f11-a507-20d3b961e2d0 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:17:08.619428 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-196a1f50-e603-4f11-a507-20d3b961e2d0 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:17:08.620189 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-196a1f50-e603-4f11-a507-20d3b961e2d0 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:17:08.620594 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-196a1f50-e603-4f11-a507-20d3b961e2d0 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:17:08.621031 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-196a1f50-e603-4f11-a507-20d3b961e2d0 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:17:08.625193 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:17:08.754631 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-196a1f50-e603-4f11-a507-20d3b961e2d0 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f7e244b0d4799b3b3b557e78e2bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167e643b30048719ceec299de90e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:17:08.763048 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-196a1f50-e603-4f11-a507-20d3b961e2d0 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "GET /compute/v2.1/servers/1f9c4e23-8c35-4085-a8b2-d9a497239f72" status: 200 len: 1512 microversion: 2.1 time: 0.156037 Oct 19 04:17:08.763627 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3503/7477] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:17:08 2022] GET /compute/v2.1/servers/1f9c4e23-8c35-4085-a8b2-d9a497239f72 => generated 1512 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:17:09.495171 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-82d44660-75e4-4658-ad32-7a9123795cff req-a778f4fd-02c0-4c6a-9fc8-894070048214 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f9c4e23-8c35-4085-a8b2-d9a497239f72", "name": "network-vif-deleted", "tag": "9fc439bb-f5c0-49b8-91ad-767eebb33ae0"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:17:09.508733 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-82d44660-75e4-4658-ad32-7a9123795cff req-a778f4fd-02c0-4c6a-9fc8-894070048214 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:17:09.509246 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-82d44660-75e4-4658-ad32-7a9123795cff req-a778f4fd-02c0-4c6a-9fc8-894070048214 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:17:09.509744 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-82d44660-75e4-4658-ad32-7a9123795cff req-a778f4fd-02c0-4c6a-9fc8-894070048214 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:17:09.522340 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-82d44660-75e4-4658-ad32-7a9123795cff req-a778f4fd-02c0-4c6a-9fc8-894070048214 service nova] Creating event network-vif-deleted:9fc439bb-f5c0-49b8-91ad-767eebb33ae0 for instance 1f9c4e23-8c35-4085-a8b2-d9a497239f72 on n-h1-861333-8 Oct 19 04:17:09.528272 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-82d44660-75e4-4658-ad32-7a9123795cff req-a778f4fd-02c0-4c6a-9fc8-894070048214 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037433 Oct 19 04:17:09.529226 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3975/7478] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:17:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:17:09.787354 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-bb5d261d-a051-4791-b1a8-a9e425b10d4b tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:17:09.787973 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-bb5d261d-a051-4791-b1a8-a9e425b10d4b tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 1f9c4e23-8c35-4085-a8b2-d9a497239f72] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:17:09.795182 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bb5d261d-a051-4791-b1a8-a9e425b10d4b tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:17:09.795680 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bb5d261d-a051-4791-b1a8-a9e425b10d4b tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:17:09.796131 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bb5d261d-a051-4791-b1a8-a9e425b10d4b tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:17:09.796834 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bb5d261d-a051-4791-b1a8-a9e425b10d4b tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:17:09.797299 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bb5d261d-a051-4791-b1a8-a9e425b10d4b tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:17:09.797758 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bb5d261d-a051-4791-b1a8-a9e425b10d4b tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:17:09.828400 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bb5d261d-a051-4791-b1a8-a9e425b10d4b tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:17:09.828884 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bb5d261d-a051-4791-b1a8-a9e425b10d4b tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:17:09.829325 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bb5d261d-a051-4791-b1a8-a9e425b10d4b tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:17:09.829798 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-bb5d261d-a051-4791-b1a8-a9e425b10d4b tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lazy-loading 'fault' on Instance uuid 1f9c4e23-8c35-4085-a8b2-d9a497239f72 {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 04:17:09.873799 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-bb5d261d-a051-4791-b1a8-a9e425b10d4b tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f7e244b0d4799b3b3b557e78e2bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167e643b30048719ceec299de90e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:17:09.881497 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-bb5d261d-a051-4791-b1a8-a9e425b10d4b tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "GET /compute/v2.1/servers/1f9c4e23-8c35-4085-a8b2-d9a497239f72" status: 200 len: 1306 microversion: 2.1 time: 0.098353 Oct 19 04:17:09.882077 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3504/7479] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:17:09 2022] GET /compute/v2.1/servers/1f9c4e23-8c35-4085-a8b2-d9a497239f72 => generated 1306 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:17:10.905639 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-263c0fed-e8a5-49bf-b672-e19cf7b30bf0 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:17:10.906528 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-263c0fed-e8a5-49bf-b672-e19cf7b30bf0 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 1f9c4e23-8c35-4085-a8b2-d9a497239f72] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:17:10.914190 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-263c0fed-e8a5-49bf-b672-e19cf7b30bf0 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:17:10.914697 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-263c0fed-e8a5-49bf-b672-e19cf7b30bf0 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:17:10.915159 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-263c0fed-e8a5-49bf-b672-e19cf7b30bf0 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:17:10.915882 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-263c0fed-e8a5-49bf-b672-e19cf7b30bf0 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:17:10.916383 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-263c0fed-e8a5-49bf-b672-e19cf7b30bf0 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:17:10.916833 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-263c0fed-e8a5-49bf-b672-e19cf7b30bf0 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:17:10.931051 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-263c0fed-e8a5-49bf-b672-e19cf7b30bf0 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] HTTP exception thrown: Instance 1f9c4e23-8c35-4085-a8b2-d9a497239f72 could not be found. Oct 19 04:17:10.932711 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-263c0fed-e8a5-49bf-b672-e19cf7b30bf0 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Request method failure captured: Oct 19 04:17:10.932711 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/1f9c4e23-8c35-4085-a8b2-d9a497239f72 HTTP/1.1 Oct 19 04:17:10.932711 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 04:17:10.932711 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 04:17:10.932711 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 04:17:10.932711 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 04:17:10.932711 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 04:17:10.932711 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 04:17:10.932711 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 04:17:10.932711 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 04:17:10.932711 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3nNqxFihmM71Okg_zgx7IZkv133E5HxZHrkglZJUeLWaj6Y0Ij19tyNzRqMhV6FQjyJU07MkAaEY9HUL5fYsNGdD0b9JSMX3nGVRa-OZYLVuhs8w6xtmRyI4VztJZvebtpDe9lHeOslohO8AD1HNT8c2fnjsB3bAC_7MBptPYQGqJI Oct 19 04:17:10.932711 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 04:17:10.932711 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 04:17:10.932711 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 04:17:10.932711 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 04:17:10.932711 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 04:17:10.932711 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 04:17:10.932711 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: c167e643b30048719ceec299de90e284 Oct 19 04:17:10.932711 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ServerDiskConfigTestJSON-775461312 Oct 19 04:17:10.932711 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 04:17:10.932711 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 04:17:10.932711 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c167e643b30048719ceec299de90e284"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c167e643b30048719ceec299de90e284"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c167e643b30048719ceec299de90e284"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c167e643b30048719ceec299de90e284", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 04:17:10.932711 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ServerDiskConfigTestJSON-775461312 Oct 19 04:17:10.932711 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: c167e643b30048719ceec299de90e284 Oct 19 04:17:10.932711 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-775461312 Oct 19 04:17:10.932711 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ServerDiskConfigTestJSON-775461312-project Oct 19 04:17:10.932711 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 04:17:10.932711 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 04:17:10.932711 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: fa1f7e244b0d4799b3b3b557e78e2bc7 Oct 19 04:17:10.932711 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ServerDiskConfigTestJSON-775461312-project Oct 19 04:17:10.932711 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 04:17:10.932711 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance 1f9c4e23-8c35-4085-a8b2-d9a497239f72 could not be found. Oct 19 04:17:10.932711 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '1f9c4e23-8c35-4085-a8b2-d9a497239f72'} Oct 19 04:17:10.932711 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 04:17:10.932711 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:17:10.932711 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 04:17:10.932711 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 04:17:10.932711 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 04:17:10.932711 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 04:17:10.932711 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 04:17:10.932711 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 04:17:10.932711 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 04:17:10.932711 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 04:17:10.932711 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f9c4e23-8c35-4085-a8b2-d9a497239f72 could not be found. Oct 19 04:17:10.932711 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:17:10.932711 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:17:10.932711 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:17:10.932711 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:17:10.932711 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:17:10.932711 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:17:10.932711 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 04:17:10.932711 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 04:17:10.932711 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 04:17:10.932711 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 04:17:10.932711 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 04:17:10.932711 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 04:17:10.932711 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 04:17:10.932711 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 04:17:10.932711 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 04:17:10.932711 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 04:17:10.932711 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f9c4e23-8c35-4085-a8b2-d9a497239f72 could not be found. Oct 19 04:17:10.932711 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:17:10.932711 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:17:10.932711 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:17:10.938247 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:17:10.938247 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:17:10.938247 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:17:10.938247 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 04:17:10.938247 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 04:17:10.938247 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f9c4e23-8c35-4085-a8b2-d9a497239f72 could not be found. Oct 19 04:17:10.938247 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:17:10.938247 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-263c0fed-e8a5-49bf-b672-e19cf7b30bf0 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Returning 404 to user: Instance 1f9c4e23-8c35-4085-a8b2-d9a497239f72 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 04:17:10.938247 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-263c0fed-e8a5-49bf-b672-e19cf7b30bf0 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "GET /compute/v2.1/servers/1f9c4e23-8c35-4085-a8b2-d9a497239f72" status: 404 len: 111 microversion: 2.1 time: 0.033926 Oct 19 04:17:10.938247 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3976/7480] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:17:10 2022] GET /compute/v2.1/servers/1f9c4e23-8c35-4085-a8b2-d9a497239f72 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 04:17:10.944346 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9fe46852-8c67-49a1-a88f-1b312c5b8c84 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '.version_select at 0x7fc12bfa5700>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:17:11.054841 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9fe46852-8c67-49a1-a88f-1b312c5b8c84 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-531873683" status: 202 len: 0 microversion: 2.1 time: 0.114226 Oct 19 04:17:11.055344 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3505/7481] 10.222.0.52 () {58 vars in 1218 bytes} [Wed Oct 19 04:17:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-531873683 => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 04:17:11.812135 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-182b2d48-5fe0-401a-850d-a424ef42ea32 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:17:11.812659 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-182b2d48-5fe0-401a-850d-a424ef42ea32 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 5f487de7-7234-4320-8c36-49c8d9f311cd] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:17:11.819418 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-182b2d48-5fe0-401a-850d-a424ef42ea32 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:17:11.819927 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-182b2d48-5fe0-401a-850d-a424ef42ea32 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:17:11.820390 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-182b2d48-5fe0-401a-850d-a424ef42ea32 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:17:11.821121 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-182b2d48-5fe0-401a-850d-a424ef42ea32 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:17:11.821604 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-182b2d48-5fe0-401a-850d-a424ef42ea32 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:17:11.822051 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-182b2d48-5fe0-401a-850d-a424ef42ea32 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:17:11.836554 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-182b2d48-5fe0-401a-850d-a424ef42ea32 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] HTTP exception thrown: Instance 5f487de7-7234-4320-8c36-49c8d9f311cd could not be found. Oct 19 04:17:11.838176 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-182b2d48-5fe0-401a-850d-a424ef42ea32 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Request method failure captured: Oct 19 04:17:11.838176 n-d-861333-8 devstack@n-api.service[121134]: request: DELETE /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd HTTP/1.1 Oct 19 04:17:11.838176 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 04:17:11.838176 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 04:17:11.838176 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 04:17:11.838176 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 04:17:11.838176 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 04:17:11.838176 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 04:17:11.838176 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 04:17:11.838176 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 04:17:11.838176 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3nNqxFihmM71Okg_zgx7IZkv133E5HxZHrkglZJUeLWaj6Y0Ij19tyNzRqMhV6FQjyJU07MkAaEY9HUL5fYsNGdD0b9JSMX3nGVRa-OZYLVuhs8w6xtmRyI4VztJZvebtpDe9lHeOslohO8AD1HNT8c2fnjsB3bAC_7MBptPYQGqJI Oct 19 04:17:11.838176 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 04:17:11.838176 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 04:17:11.838176 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 04:17:11.838176 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 04:17:11.838176 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 04:17:11.838176 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 04:17:11.838176 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: c167e643b30048719ceec299de90e284 Oct 19 04:17:11.838176 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ServerDiskConfigTestJSON-775461312 Oct 19 04:17:11.838176 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 04:17:11.838176 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 04:17:11.838176 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c167e643b30048719ceec299de90e284"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c167e643b30048719ceec299de90e284"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c167e643b30048719ceec299de90e284"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c167e643b30048719ceec299de90e284", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 04:17:11.838176 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ServerDiskConfigTestJSON-775461312 Oct 19 04:17:11.838176 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: c167e643b30048719ceec299de90e284 Oct 19 04:17:11.838176 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-775461312 Oct 19 04:17:11.838176 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ServerDiskConfigTestJSON-775461312-project Oct 19 04:17:11.838176 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 04:17:11.838176 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 04:17:11.838176 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: fa1f7e244b0d4799b3b3b557e78e2bc7 Oct 19 04:17:11.838176 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ServerDiskConfigTestJSON-775461312-project Oct 19 04:17:11.838176 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 04:17:11.838176 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance 5f487de7-7234-4320-8c36-49c8d9f311cd could not be found. Oct 19 04:17:11.838176 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '5f487de7-7234-4320-8c36-49c8d9f311cd'} Oct 19 04:17:11.838176 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 04:17:11.838176 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:17:11.838176 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 04:17:11.838176 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 04:17:11.838176 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 04:17:11.838176 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 04:17:11.838176 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 04:17:11.838176 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 04:17:11.838176 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 04:17:11.838176 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 04:17:11.838176 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f487de7-7234-4320-8c36-49c8d9f311cd could not be found. Oct 19 04:17:11.838176 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:17:11.838176 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:17:11.838176 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:17:11.838176 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:17:11.838176 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:17:11.838176 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:17:11.838176 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 04:17:11.838176 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 04:17:11.838176 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 04:17:11.838176 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 04:17:11.838176 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 04:17:11.838176 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 04:17:11.838176 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 04:17:11.838176 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 04:17:11.838176 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 04:17:11.838176 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 04:17:11.838176 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 04:17:11.838176 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 04:17:11.842689 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f487de7-7234-4320-8c36-49c8d9f311cd could not be found. Oct 19 04:17:11.842689 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:17:11.842689 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:17:11.842689 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:17:11.842689 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:17:11.842689 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:17:11.842689 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:17:11.842689 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 04:17:11.842689 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 04:17:11.842689 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f487de7-7234-4320-8c36-49c8d9f311cd could not be found. Oct 19 04:17:11.842689 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:17:11.842689 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-182b2d48-5fe0-401a-850d-a424ef42ea32 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Returning 404 to user: Instance 5f487de7-7234-4320-8c36-49c8d9f311cd could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 04:17:11.842689 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-182b2d48-5fe0-401a-850d-a424ef42ea32 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "DELETE /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd" status: 404 len: 111 microversion: 2.1 time: 0.031927 Oct 19 04:17:11.842689 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3977/7482] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 04:17:11 2022] DELETE /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 04:17:11.848189 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-962ff600-5f74-459b-9d40-9299b8d77b34 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:17:11.848815 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-962ff600-5f74-459b-9d40-9299b8d77b34 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] [instance: 5f487de7-7234-4320-8c36-49c8d9f311cd] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:17:11.855565 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-962ff600-5f74-459b-9d40-9299b8d77b34 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:17:11.856059 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-962ff600-5f74-459b-9d40-9299b8d77b34 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:17:11.856508 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-962ff600-5f74-459b-9d40-9299b8d77b34 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:17:11.857224 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-962ff600-5f74-459b-9d40-9299b8d77b34 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:17:11.857695 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-962ff600-5f74-459b-9d40-9299b8d77b34 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:17:11.858129 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-962ff600-5f74-459b-9d40-9299b8d77b34 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:17:11.871947 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-962ff600-5f74-459b-9d40-9299b8d77b34 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] HTTP exception thrown: Instance 5f487de7-7234-4320-8c36-49c8d9f311cd could not be found. Oct 19 04:17:11.873651 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-962ff600-5f74-459b-9d40-9299b8d77b34 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Request method failure captured: Oct 19 04:17:11.873651 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd HTTP/1.1 Oct 19 04:17:11.873651 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 04:17:11.873651 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 04:17:11.873651 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 04:17:11.873651 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 04:17:11.873651 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 04:17:11.873651 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 04:17:11.873651 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 04:17:11.873651 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 04:17:11.873651 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT3nNqxFihmM71Okg_zgx7IZkv133E5HxZHrkglZJUeLWaj6Y0Ij19tyNzRqMhV6FQjyJU07MkAaEY9HUL5fYsNGdD0b9JSMX3nGVRa-OZYLVuhs8w6xtmRyI4VztJZvebtpDe9lHeOslohO8AD1HNT8c2fnjsB3bAC_7MBptPYQGqJI Oct 19 04:17:11.873651 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 04:17:11.873651 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 04:17:11.873651 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 04:17:11.873651 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 04:17:11.873651 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 04:17:11.873651 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 04:17:11.873651 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: c167e643b30048719ceec299de90e284 Oct 19 04:17:11.873651 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ServerDiskConfigTestJSON-775461312 Oct 19 04:17:11.873651 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 04:17:11.873651 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 04:17:11.873651 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c167e643b30048719ceec299de90e284"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c167e643b30048719ceec299de90e284"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c167e643b30048719ceec299de90e284"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c167e643b30048719ceec299de90e284", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 04:17:11.873651 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ServerDiskConfigTestJSON-775461312 Oct 19 04:17:11.873651 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: c167e643b30048719ceec299de90e284 Oct 19 04:17:11.873651 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-775461312 Oct 19 04:17:11.873651 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ServerDiskConfigTestJSON-775461312-project Oct 19 04:17:11.873651 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 04:17:11.873651 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 04:17:11.873651 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: fa1f7e244b0d4799b3b3b557e78e2bc7 Oct 19 04:17:11.873651 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ServerDiskConfigTestJSON-775461312-project Oct 19 04:17:11.873651 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 04:17:11.873651 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance 5f487de7-7234-4320-8c36-49c8d9f311cd could not be found. Oct 19 04:17:11.873651 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '5f487de7-7234-4320-8c36-49c8d9f311cd'} Oct 19 04:17:11.873651 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 04:17:11.873651 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:17:11.873651 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 04:17:11.873651 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 04:17:11.873651 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 04:17:11.873651 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 04:17:11.873651 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 04:17:11.873651 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 04:17:11.873651 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 04:17:11.873651 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 04:17:11.873651 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f487de7-7234-4320-8c36-49c8d9f311cd could not be found. Oct 19 04:17:11.873651 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:17:11.873651 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:17:11.873651 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:17:11.873651 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:17:11.873651 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:17:11.873651 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:17:11.873651 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 04:17:11.873651 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 04:17:11.873651 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 04:17:11.873651 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 04:17:11.873651 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 04:17:11.873651 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 04:17:11.873651 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 04:17:11.873651 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 04:17:11.873651 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 04:17:11.873651 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 04:17:11.873651 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f487de7-7234-4320-8c36-49c8d9f311cd could not be found. Oct 19 04:17:11.873651 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:17:11.873651 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:17:11.873651 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:17:11.878151 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:17:11.878151 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:17:11.878151 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:17:11.878151 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 04:17:11.878151 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 04:17:11.878151 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f487de7-7234-4320-8c36-49c8d9f311cd could not be found. Oct 19 04:17:11.878151 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:17:11.878151 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-962ff600-5f74-459b-9d40-9299b8d77b34 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] Returning 404 to user: Instance 5f487de7-7234-4320-8c36-49c8d9f311cd could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 04:17:11.878151 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-962ff600-5f74-459b-9d40-9299b8d77b34 tempest-ServerDiskConfigTestJSON-775461312 tempest-ServerDiskConfigTestJSON-775461312-project] 10.222.0.52 "GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd" status: 404 len: 111 microversion: 2.1 time: 0.030749 Oct 19 04:17:11.878151 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3506/7483] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:17:11 2022] GET /compute/v2.1/servers/5f487de7-7234-4320-8c36-49c8d9f311cd => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 04:17:22.732186 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:17:22.733330 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=7 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:17:22.848960 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6334bc65-adf0-466a-a234-c90054767026 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Action: 'create', calling method: .version_select at 0x7fc128077430>, body: {"keypair": {"name": "tempest-keypair-2091471087", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMM1zD6dd5VQR8VFsSW7nodzmaNrjZ02rL4QdHYVE8D2nD4UN8rUh/gJVBz/J1SRMmFGRvqbMk2n5+6OWQPvZUYcSo4niC1BV14qJhxaZ9QMtb4vFf4VcaDBSq9d8mqiow=="}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:17:22.865131 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-6334bc65-adf0-466a-a234-c90054767026 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Getting quotas for project 25caabf71e854e4ba4ee627309de481d. Resources: {'key_pairs'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 04:17:22.871905 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-6334bc65-adf0-466a-a234-c90054767026 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Getting quotas for user 31018706f7fd45988df04518eee6c044 and project 25caabf71e854e4ba4ee627309de481d. Resources: {'key_pairs'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 04:17:22.934729 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6334bc65-adf0-466a-a234-c90054767026 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.208963 Oct 19 04:17:22.935355 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3978/7484] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Oct 19 04:17:22 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 04:17:25.134943 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b949e664-2761-4b68-b677-f8ef6dade4a4 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2083504580", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "79af36cf-1d2d-4d42-bb0b-1923e8e4f461"}], "security_groups": [{"name": "tempest-securitygroup--1442934117"}], "key_name": "tempest-keypair-2091471087", "user_data": "}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:17:25.144618 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=36,nova_api:DELETE=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:17:25.145272 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=14 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:17:25.246248 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.network.neutron [None req-b949e664-2761-4b68-b677-f8ef6dade4a4 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] validate_networks() for [('79af36cf-1d2d-4d42-bb0b-1923e8e4f461', None, None, None, None, None)] {{(pid=121135) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 04:17:25.652898 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-b949e664-2761-4b68-b677-f8ef6dade4a4 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Flavor limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 04:17:25.653332 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-b949e664-2761-4b68-b677-f8ef6dade4a4 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Image limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 04:17:25.653844 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-b949e664-2761-4b68-b677-f8ef6dade4a4 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Flavor pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 04:17:25.654268 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-b949e664-2761-4b68-b677-f8ef6dade4a4 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Image pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 04:17:25.654693 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-b949e664-2761-4b68-b677-f8ef6dade4a4 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 04:17:25.664414 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b949e664-2761-4b68-b677-f8ef6dade4a4 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:17:25.664915 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b949e664-2761-4b68-b677-f8ef6dade4a4 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:17:25.665390 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b949e664-2761-4b68-b677-f8ef6dade4a4 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:17:25.666269 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b949e664-2761-4b68-b677-f8ef6dade4a4 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:17:25.666749 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b949e664-2761-4b68-b677-f8ef6dade4a4 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:17:25.667742 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b949e664-2761-4b68-b677-f8ef6dade4a4 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:17:25.685602 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-b949e664-2761-4b68-b677-f8ef6dade4a4 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Getting quotas for project 25caabf71e854e4ba4ee627309de481d. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 04:17:25.691493 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-b949e664-2761-4b68-b677-f8ef6dade4a4 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Getting quotas for user 31018706f7fd45988df04518eee6c044 and project 25caabf71e854e4ba4ee627309de481d. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 04:17:25.705722 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b949e664-2761-4b68-b677-f8ef6dade4a4 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Going to run 1 instances... {{(pid=121135) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 04:17:25.708150 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b949e664-2761-4b68-b677-f8ef6dade4a4 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0532d211-0e06-47ae-8441-32d2a7b3cdd8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121135) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 04:17:25.845195 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b949e664-2761-4b68-b677-f8ef6dade4a4 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.714576 Oct 19 04:17:25.846073 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3507/7485] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 04:17:25 2022] POST /compute/v2.1/servers => generated 409 bytes in 716 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 04:17:25.858922 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-329edb6d-6052-4066-ac45-867a5f14631b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:17:25.858922 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-329edb6d-6052-4066-ac45-867a5f14631b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0532d211-0e06-47ae-8441-32d2a7b3cdd8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:17:25.929916 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-329edb6d-6052-4066-ac45-867a5f14631b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:17:25.942342 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-329edb6d-6052-4066-ac45-867a5f14631b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0532d211-0e06-47ae-8441-32d2a7b3cdd8" status: 200 len: 1239 microversion: 2.1 time: 0.084882 Oct 19 04:17:25.942342 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3979/7486] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:17:25 2022] GET /compute/v2.1/servers/0532d211-0e06-47ae-8441-32d2a7b3cdd8 => generated 1239 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:17:26.963155 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-07767dc7-b532-4240-a38e-2d3261777f38 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:17:26.963784 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-07767dc7-b532-4240-a38e-2d3261777f38 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0532d211-0e06-47ae-8441-32d2a7b3cdd8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:17:26.973737 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-07767dc7-b532-4240-a38e-2d3261777f38 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:17:26.974236 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-07767dc7-b532-4240-a38e-2d3261777f38 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:17:26.974690 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-07767dc7-b532-4240-a38e-2d3261777f38 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:17:26.975407 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-07767dc7-b532-4240-a38e-2d3261777f38 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:17:26.975870 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-07767dc7-b532-4240-a38e-2d3261777f38 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:17:26.976315 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-07767dc7-b532-4240-a38e-2d3261777f38 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:17:27.041236 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-07767dc7-b532-4240-a38e-2d3261777f38 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:17:27.048997 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-07767dc7-b532-4240-a38e-2d3261777f38 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0532d211-0e06-47ae-8441-32d2a7b3cdd8" status: 200 len: 1243 microversion: 2.1 time: 0.090794 Oct 19 04:17:27.049623 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3508/7487] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:17:26 2022] GET /compute/v2.1/servers/0532d211-0e06-47ae-8441-32d2a7b3cdd8 => generated 1243 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:17:28.073078 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3774f12a-3ef9-457e-ba21-67567ea87fca tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:17:28.073977 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3774f12a-3ef9-457e-ba21-67567ea87fca tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0532d211-0e06-47ae-8441-32d2a7b3cdd8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:17:28.082602 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3774f12a-3ef9-457e-ba21-67567ea87fca tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:17:28.083145 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3774f12a-3ef9-457e-ba21-67567ea87fca tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:17:28.083609 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3774f12a-3ef9-457e-ba21-67567ea87fca tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:17:28.084438 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3774f12a-3ef9-457e-ba21-67567ea87fca tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:17:28.084935 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3774f12a-3ef9-457e-ba21-67567ea87fca tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:17:28.085404 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3774f12a-3ef9-457e-ba21-67567ea87fca tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:17:28.169151 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-3774f12a-3ef9-457e-ba21-67567ea87fca tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:17:28.177260 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3774f12a-3ef9-457e-ba21-67567ea87fca tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0532d211-0e06-47ae-8441-32d2a7b3cdd8" status: 200 len: 1299 microversion: 2.1 time: 0.108879 Oct 19 04:17:28.177880 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3980/7488] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:17:28 2022] GET /compute/v2.1/servers/0532d211-0e06-47ae-8441-32d2a7b3cdd8 => generated 1299 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:17:29.200398 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-fb052553-9b49-4e65-9b3e-c65ffe9ebffd tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:17:29.201767 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-fb052553-9b49-4e65-9b3e-c65ffe9ebffd tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0532d211-0e06-47ae-8441-32d2a7b3cdd8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:17:29.208826 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fb052553-9b49-4e65-9b3e-c65ffe9ebffd tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:17:29.209339 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fb052553-9b49-4e65-9b3e-c65ffe9ebffd tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:17:29.209809 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fb052553-9b49-4e65-9b3e-c65ffe9ebffd tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:17:29.217454 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fb052553-9b49-4e65-9b3e-c65ffe9ebffd tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:17:29.217454 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fb052553-9b49-4e65-9b3e-c65ffe9ebffd tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:17:29.217454 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fb052553-9b49-4e65-9b3e-c65ffe9ebffd tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:17:29.762515 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-fb052553-9b49-4e65-9b3e-c65ffe9ebffd tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:17:29.770659 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-fb052553-9b49-4e65-9b3e-c65ffe9ebffd tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0532d211-0e06-47ae-8441-32d2a7b3cdd8" status: 200 len: 1365 microversion: 2.1 time: 0.574223 Oct 19 04:17:29.772098 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3509/7489] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:17:29 2022] GET /compute/v2.1/servers/0532d211-0e06-47ae-8441-32d2a7b3cdd8 => generated 1365 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:17:30.247963 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-6ce74546-9d98-47fb-a4e1-56aaa26c5c72 req-abe48900-fea8-4d2d-ae98-cc1a95d742ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0532d211-0e06-47ae-8441-32d2a7b3cdd8", "tag": "a440f107-442f-40fa-b252-0e80e2ceb567"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:17:30.258251 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-6ce74546-9d98-47fb-a4e1-56aaa26c5c72 req-abe48900-fea8-4d2d-ae98-cc1a95d742ae service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:17:30.258805 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-6ce74546-9d98-47fb-a4e1-56aaa26c5c72 req-abe48900-fea8-4d2d-ae98-cc1a95d742ae service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:17:30.259254 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-6ce74546-9d98-47fb-a4e1-56aaa26c5c72 req-abe48900-fea8-4d2d-ae98-cc1a95d742ae service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:17:30.270462 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-6ce74546-9d98-47fb-a4e1-56aaa26c5c72 req-abe48900-fea8-4d2d-ae98-cc1a95d742ae service nova] Creating event network-changed:a440f107-442f-40fa-b252-0e80e2ceb567 for instance 0532d211-0e06-47ae-8441-32d2a7b3cdd8 on n-h2-861333-8 Oct 19 04:17:30.275732 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-6ce74546-9d98-47fb-a4e1-56aaa26c5c72 req-abe48900-fea8-4d2d-ae98-cc1a95d742ae service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032507 Oct 19 04:17:30.276514 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3981/7490] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:17:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 04:17:30.800933 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a2ae4ce4-812a-4807-88ab-33c529dfc946 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:17:30.800933 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a2ae4ce4-812a-4807-88ab-33c529dfc946 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0532d211-0e06-47ae-8441-32d2a7b3cdd8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:17:30.804211 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a2ae4ce4-812a-4807-88ab-33c529dfc946 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:17:30.804734 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a2ae4ce4-812a-4807-88ab-33c529dfc946 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:17:30.805200 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a2ae4ce4-812a-4807-88ab-33c529dfc946 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:17:30.805923 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a2ae4ce4-812a-4807-88ab-33c529dfc946 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:17:30.806400 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a2ae4ce4-812a-4807-88ab-33c529dfc946 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:17:30.806835 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a2ae4ce4-812a-4807-88ab-33c529dfc946 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:17:31.017404 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a2ae4ce4-812a-4807-88ab-33c529dfc946 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:17:31.025408 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a2ae4ce4-812a-4807-88ab-33c529dfc946 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0532d211-0e06-47ae-8441-32d2a7b3cdd8" status: 200 len: 1365 microversion: 2.1 time: 0.233191 Oct 19 04:17:31.025975 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3510/7491] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:17:30 2022] GET /compute/v2.1/servers/0532d211-0e06-47ae-8441-32d2a7b3cdd8 => generated 1365 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:17:32.049774 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9fbc7749-fac4-4aa8-b1c3-2e32cfead90e tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:17:32.050586 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9fbc7749-fac4-4aa8-b1c3-2e32cfead90e tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0532d211-0e06-47ae-8441-32d2a7b3cdd8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:17:32.056955 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9fbc7749-fac4-4aa8-b1c3-2e32cfead90e tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:17:32.057502 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9fbc7749-fac4-4aa8-b1c3-2e32cfead90e tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:17:32.057966 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9fbc7749-fac4-4aa8-b1c3-2e32cfead90e tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:17:32.058676 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9fbc7749-fac4-4aa8-b1c3-2e32cfead90e tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:17:32.059152 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9fbc7749-fac4-4aa8-b1c3-2e32cfead90e tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:17:32.059603 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9fbc7749-fac4-4aa8-b1c3-2e32cfead90e tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:17:32.193592 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9fbc7749-fac4-4aa8-b1c3-2e32cfead90e tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:17:32.201589 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9fbc7749-fac4-4aa8-b1c3-2e32cfead90e tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0532d211-0e06-47ae-8441-32d2a7b3cdd8" status: 200 len: 1365 microversion: 2.1 time: 0.157140 Oct 19 04:17:32.202185 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3982/7492] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:17:32 2022] GET /compute/v2.1/servers/0532d211-0e06-47ae-8441-32d2a7b3cdd8 => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:17:33.225095 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d3a00fa0-ccad-4aac-b10f-1fa89edafe21 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:17:33.225748 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d3a00fa0-ccad-4aac-b10f-1fa89edafe21 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0532d211-0e06-47ae-8441-32d2a7b3cdd8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:17:33.233175 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d3a00fa0-ccad-4aac-b10f-1fa89edafe21 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:17:33.233711 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d3a00fa0-ccad-4aac-b10f-1fa89edafe21 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:17:33.234177 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d3a00fa0-ccad-4aac-b10f-1fa89edafe21 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:17:33.234891 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d3a00fa0-ccad-4aac-b10f-1fa89edafe21 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:17:33.235351 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d3a00fa0-ccad-4aac-b10f-1fa89edafe21 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:17:33.235783 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d3a00fa0-ccad-4aac-b10f-1fa89edafe21 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:17:33.363103 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d3a00fa0-ccad-4aac-b10f-1fa89edafe21 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:17:33.370788 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d3a00fa0-ccad-4aac-b10f-1fa89edafe21 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0532d211-0e06-47ae-8441-32d2a7b3cdd8" status: 200 len: 1365 microversion: 2.1 time: 0.149617 Oct 19 04:17:33.371361 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3511/7493] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:17:33 2022] GET /compute/v2.1/servers/0532d211-0e06-47ae-8441-32d2a7b3cdd8 => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:17:34.394249 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-32c6c1c9-25b4-4f7c-bacc-b22388e3ba9d tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:17:34.394955 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-32c6c1c9-25b4-4f7c-bacc-b22388e3ba9d tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0532d211-0e06-47ae-8441-32d2a7b3cdd8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:17:34.402515 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-32c6c1c9-25b4-4f7c-bacc-b22388e3ba9d tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:17:34.403030 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-32c6c1c9-25b4-4f7c-bacc-b22388e3ba9d tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:17:34.404010 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-32c6c1c9-25b4-4f7c-bacc-b22388e3ba9d tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:17:34.404734 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-32c6c1c9-25b4-4f7c-bacc-b22388e3ba9d tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:17:34.405211 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-32c6c1c9-25b4-4f7c-bacc-b22388e3ba9d tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:17:34.405696 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-32c6c1c9-25b4-4f7c-bacc-b22388e3ba9d tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:17:34.537173 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-32c6c1c9-25b4-4f7c-bacc-b22388e3ba9d tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:17:34.545613 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-32c6c1c9-25b4-4f7c-bacc-b22388e3ba9d tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0532d211-0e06-47ae-8441-32d2a7b3cdd8" status: 200 len: 1365 microversion: 2.1 time: 0.155408 Oct 19 04:17:34.546199 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3983/7494] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:17:34 2022] GET /compute/v2.1/servers/0532d211-0e06-47ae-8441-32d2a7b3cdd8 => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:17:35.568186 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5ccf0199-04dd-48c8-8afb-75acb83b2a62 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:17:35.568738 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-5ccf0199-04dd-48c8-8afb-75acb83b2a62 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0532d211-0e06-47ae-8441-32d2a7b3cdd8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:17:35.576167 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5ccf0199-04dd-48c8-8afb-75acb83b2a62 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:17:35.576657 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5ccf0199-04dd-48c8-8afb-75acb83b2a62 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:17:35.577104 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5ccf0199-04dd-48c8-8afb-75acb83b2a62 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:17:35.577832 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5ccf0199-04dd-48c8-8afb-75acb83b2a62 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:17:35.578294 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5ccf0199-04dd-48c8-8afb-75acb83b2a62 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:17:35.578727 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5ccf0199-04dd-48c8-8afb-75acb83b2a62 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:17:35.674597 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:17:35.698449 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=6 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:17:35.707765 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-5ccf0199-04dd-48c8-8afb-75acb83b2a62 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:17:35.716600 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5ccf0199-04dd-48c8-8afb-75acb83b2a62 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0532d211-0e06-47ae-8441-32d2a7b3cdd8" status: 200 len: 1365 microversion: 2.1 time: 0.151805 Oct 19 04:17:35.717188 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3512/7495] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:17:35 2022] GET /compute/v2.1/servers/0532d211-0e06-47ae-8441-32d2a7b3cdd8 => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:17:36.739975 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5ce28c09-7600-4024-8968-5c679e867c7b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:17:36.740630 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5ce28c09-7600-4024-8968-5c679e867c7b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0532d211-0e06-47ae-8441-32d2a7b3cdd8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:17:36.744088 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=6 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:17:36.746420 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-7bf1e696-6321-4fba-8430-1952d802d113 req-a1b96c2b-4330-48e8-a91d-67a207f9c4a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0532d211-0e06-47ae-8441-32d2a7b3cdd8", "name": "network-vif-plugged", "status": "completed", "tag": "a440f107-442f-40fa-b252-0e80e2ceb567"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:17:36.752561 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5ce28c09-7600-4024-8968-5c679e867c7b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:17:36.757618 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5ce28c09-7600-4024-8968-5c679e867c7b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:17:36.757618 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5ce28c09-7600-4024-8968-5c679e867c7b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:17:36.757618 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5ce28c09-7600-4024-8968-5c679e867c7b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:17:36.757618 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5ce28c09-7600-4024-8968-5c679e867c7b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:17:36.757618 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5ce28c09-7600-4024-8968-5c679e867c7b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:17:36.758033 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-7bf1e696-6321-4fba-8430-1952d802d113 req-a1b96c2b-4330-48e8-a91d-67a207f9c4a7 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:17:36.758033 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-7bf1e696-6321-4fba-8430-1952d802d113 req-a1b96c2b-4330-48e8-a91d-67a207f9c4a7 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:17:36.758033 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-7bf1e696-6321-4fba-8430-1952d802d113 req-a1b96c2b-4330-48e8-a91d-67a207f9c4a7 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:17:36.768417 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-7bf1e696-6321-4fba-8430-1952d802d113 req-a1b96c2b-4330-48e8-a91d-67a207f9c4a7 service nova] Creating event network-vif-plugged:a440f107-442f-40fa-b252-0e80e2ceb567 for instance 0532d211-0e06-47ae-8441-32d2a7b3cdd8 on n-h2-861333-8 Oct 19 04:17:36.773757 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-7bf1e696-6321-4fba-8430-1952d802d113 req-a1b96c2b-4330-48e8-a91d-67a207f9c4a7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033416 Oct 19 04:17:36.774560 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3513/7496] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:17:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:17:36.938849 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5ce28c09-7600-4024-8968-5c679e867c7b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:17:36.947921 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5ce28c09-7600-4024-8968-5c679e867c7b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0532d211-0e06-47ae-8441-32d2a7b3cdd8" status: 200 len: 1365 microversion: 2.1 time: 0.210681 Oct 19 04:17:36.948518 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3984/7497] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:17:36 2022] GET /compute/v2.1/servers/0532d211-0e06-47ae-8441-32d2a7b3cdd8 => generated 1365 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:17:37.976204 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d75d66b9-c957-4ddd-b240-5e39b4e7c0b9 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:17:37.976923 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d75d66b9-c957-4ddd-b240-5e39b4e7c0b9 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0532d211-0e06-47ae-8441-32d2a7b3cdd8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:17:37.983207 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d75d66b9-c957-4ddd-b240-5e39b4e7c0b9 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:17:37.983700 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d75d66b9-c957-4ddd-b240-5e39b4e7c0b9 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:17:37.984198 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d75d66b9-c957-4ddd-b240-5e39b4e7c0b9 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:17:37.984884 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d75d66b9-c957-4ddd-b240-5e39b4e7c0b9 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:17:37.985349 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d75d66b9-c957-4ddd-b240-5e39b4e7c0b9 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:17:37.985807 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d75d66b9-c957-4ddd-b240-5e39b4e7c0b9 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:17:38.121380 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d75d66b9-c957-4ddd-b240-5e39b4e7c0b9 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:17:38.129896 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d75d66b9-c957-4ddd-b240-5e39b4e7c0b9 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0532d211-0e06-47ae-8441-32d2a7b3cdd8" status: 200 len: 1365 microversion: 2.1 time: 0.158638 Oct 19 04:17:38.130423 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3514/7498] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:17:37 2022] GET /compute/v2.1/servers/0532d211-0e06-47ae-8441-32d2a7b3cdd8 => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:17:39.153676 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-72ca1898-2329-4b1f-92df-981310e43448 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:17:39.154338 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-72ca1898-2329-4b1f-92df-981310e43448 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0532d211-0e06-47ae-8441-32d2a7b3cdd8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:17:39.161235 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-72ca1898-2329-4b1f-92df-981310e43448 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:17:39.161776 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-72ca1898-2329-4b1f-92df-981310e43448 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:17:39.162236 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-72ca1898-2329-4b1f-92df-981310e43448 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:17:39.162950 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-72ca1898-2329-4b1f-92df-981310e43448 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:17:39.163421 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-72ca1898-2329-4b1f-92df-981310e43448 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:17:39.163866 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-72ca1898-2329-4b1f-92df-981310e43448 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:17:39.290912 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-72ca1898-2329-4b1f-92df-981310e43448 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:17:39.299148 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-72ca1898-2329-4b1f-92df-981310e43448 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0532d211-0e06-47ae-8441-32d2a7b3cdd8" status: 200 len: 1552 microversion: 2.1 time: 0.149503 Oct 19 04:17:39.299730 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3985/7499] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:17:39 2022] GET /compute/v2.1/servers/0532d211-0e06-47ae-8441-32d2a7b3cdd8 => generated 1552 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:17:39.322016 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2469d4d5-7675-44e4-a195-977e659f44ce tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:17:39.322524 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-2469d4d5-7675-44e4-a195-977e659f44ce tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0532d211-0e06-47ae-8441-32d2a7b3cdd8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:17:39.329031 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2469d4d5-7675-44e4-a195-977e659f44ce tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:17:39.329562 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2469d4d5-7675-44e4-a195-977e659f44ce tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:17:39.330006 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2469d4d5-7675-44e4-a195-977e659f44ce tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:17:39.330707 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2469d4d5-7675-44e4-a195-977e659f44ce tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:17:39.331171 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2469d4d5-7675-44e4-a195-977e659f44ce tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:17:39.331600 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2469d4d5-7675-44e4-a195-977e659f44ce tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:17:39.408920 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2469d4d5-7675-44e4-a195-977e659f44ce tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0532d211-0e06-47ae-8441-32d2a7b3cdd8/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090892 Oct 19 04:17:39.409554 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3515/7500] 10.222.0.52 () {58 vars in 1275 bytes} [Wed Oct 19 04:17:39 2022] GET /compute/v2.1/servers/0532d211-0e06-47ae-8441-32d2a7b3cdd8/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:17:40.372342 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-6d16f696-64da-4751-8c2b-16aa773d7c1a req-d5ce6a8d-0a24-4cd2-875c-f65621089390 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0532d211-0e06-47ae-8441-32d2a7b3cdd8", "tag": "a440f107-442f-40fa-b252-0e80e2ceb567"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:17:40.383370 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-6d16f696-64da-4751-8c2b-16aa773d7c1a req-d5ce6a8d-0a24-4cd2-875c-f65621089390 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:17:40.383803 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-6d16f696-64da-4751-8c2b-16aa773d7c1a req-d5ce6a8d-0a24-4cd2-875c-f65621089390 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:17:40.384846 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-6d16f696-64da-4751-8c2b-16aa773d7c1a req-d5ce6a8d-0a24-4cd2-875c-f65621089390 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:17:40.397988 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-6d16f696-64da-4751-8c2b-16aa773d7c1a req-d5ce6a8d-0a24-4cd2-875c-f65621089390 service nova] Creating event network-changed:a440f107-442f-40fa-b252-0e80e2ceb567 for instance 0532d211-0e06-47ae-8441-32d2a7b3cdd8 on n-h2-861333-8 Oct 19 04:17:40.403349 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-6d16f696-64da-4751-8c2b-16aa773d7c1a req-d5ce6a8d-0a24-4cd2-875c-f65621089390 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034678 Oct 19 04:17:40.404200 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3986/7501] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:17:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:18:16.290836 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:18:16.291529 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=44 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:18:16.296154 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4509c304-dcfd-4a88-a9d7-d3df93439900 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:18:16.296846 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4509c304-dcfd-4a88-a9d7-d3df93439900 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0532d211-0e06-47ae-8441-32d2a7b3cdd8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:18:16.303166 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4509c304-dcfd-4a88-a9d7-d3df93439900 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:18:16.303658 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4509c304-dcfd-4a88-a9d7-d3df93439900 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:18:16.304101 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4509c304-dcfd-4a88-a9d7-d3df93439900 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:18:16.304801 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4509c304-dcfd-4a88-a9d7-d3df93439900 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:18:16.305261 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4509c304-dcfd-4a88-a9d7-d3df93439900 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:18:16.306695 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4509c304-dcfd-4a88-a9d7-d3df93439900 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:18:16.436489 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4509c304-dcfd-4a88-a9d7-d3df93439900 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:18:16.444936 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4509c304-dcfd-4a88-a9d7-d3df93439900 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0532d211-0e06-47ae-8441-32d2a7b3cdd8" status: 200 len: 1671 microversion: 2.1 time: 0.156417 Oct 19 04:18:16.445545 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3516/7502] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:18:16 2022] GET /compute/v2.1/servers/0532d211-0e06-47ae-8441-32d2a7b3cdd8 => generated 1671 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:18:16.468336 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-609bda4e-9a46-4058-9e63-004a93e0deb8 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:18:16.469205 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-609bda4e-9a46-4058-9e63-004a93e0deb8 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0532d211-0e06-47ae-8441-32d2a7b3cdd8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:18:16.471605 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:18:16.472352 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=34 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:18:16.477416 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-609bda4e-9a46-4058-9e63-004a93e0deb8 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:18:16.477928 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-609bda4e-9a46-4058-9e63-004a93e0deb8 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:18:16.478413 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-609bda4e-9a46-4058-9e63-004a93e0deb8 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:18:16.479134 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-609bda4e-9a46-4058-9e63-004a93e0deb8 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:18:16.479603 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-609bda4e-9a46-4058-9e63-004a93e0deb8 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:18:16.480050 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-609bda4e-9a46-4058-9e63-004a93e0deb8 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:18:16.612175 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-609bda4e-9a46-4058-9e63-004a93e0deb8 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:18:16.619923 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-609bda4e-9a46-4058-9e63-004a93e0deb8 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0532d211-0e06-47ae-8441-32d2a7b3cdd8" status: 200 len: 1671 microversion: 2.1 time: 0.155997 Oct 19 04:18:16.620497 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3987/7503] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:18:16 2022] GET /compute/v2.1/servers/0532d211-0e06-47ae-8441-32d2a7b3cdd8 => generated 1671 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:18:16.642725 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d5540f1f-4e23-4645-9903-26d36e321bca tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:18:16.643371 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d5540f1f-4e23-4645-9903-26d36e321bca tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0532d211-0e06-47ae-8441-32d2a7b3cdd8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:18:16.649595 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d5540f1f-4e23-4645-9903-26d36e321bca tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:18:16.650089 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d5540f1f-4e23-4645-9903-26d36e321bca tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:18:16.650559 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d5540f1f-4e23-4645-9903-26d36e321bca tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:18:16.651256 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d5540f1f-4e23-4645-9903-26d36e321bca tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:18:16.651717 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d5540f1f-4e23-4645-9903-26d36e321bca tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:18:16.652152 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d5540f1f-4e23-4645-9903-26d36e321bca tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:18:16.777630 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d5540f1f-4e23-4645-9903-26d36e321bca tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:18:16.785807 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d5540f1f-4e23-4645-9903-26d36e321bca tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0532d211-0e06-47ae-8441-32d2a7b3cdd8" status: 200 len: 1671 microversion: 2.1 time: 0.146973 Oct 19 04:18:16.786577 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3517/7504] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:18:16 2022] GET /compute/v2.1/servers/0532d211-0e06-47ae-8441-32d2a7b3cdd8 => generated 1671 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:18:16.808483 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-524d6828-f085-4fce-86a5-6ab78b2bf159 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:18:16.810851 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-524d6828-f085-4fce-86a5-6ab78b2bf159 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0532d211-0e06-47ae-8441-32d2a7b3cdd8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:18:16.817511 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-524d6828-f085-4fce-86a5-6ab78b2bf159 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:18:16.817962 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-524d6828-f085-4fce-86a5-6ab78b2bf159 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:18:16.818423 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-524d6828-f085-4fce-86a5-6ab78b2bf159 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:18:16.819132 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-524d6828-f085-4fce-86a5-6ab78b2bf159 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:18:16.819605 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-524d6828-f085-4fce-86a5-6ab78b2bf159 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:18:16.820050 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-524d6828-f085-4fce-86a5-6ab78b2bf159 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:18:16.847272 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-524d6828-f085-4fce-86a5-6ab78b2bf159 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:18:16.852581 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-524d6828-f085-4fce-86a5-6ab78b2bf159 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0532d211-0e06-47ae-8441-32d2a7b3cdd8] Old instance type m1.heat2, new instance type m1.heat {{(pid=121134) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 19 04:18:16.859980 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-524d6828-f085-4fce-86a5-6ab78b2bf159 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Flavor limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 04:18:16.860427 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-524d6828-f085-4fce-86a5-6ab78b2bf159 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Image limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 04:18:16.860930 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-524d6828-f085-4fce-86a5-6ab78b2bf159 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Flavor pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 04:18:16.861363 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-524d6828-f085-4fce-86a5-6ab78b2bf159 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Image pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 04:18:16.861819 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-524d6828-f085-4fce-86a5-6ab78b2bf159 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 04:18:17.078274 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-524d6828-f085-4fce-86a5-6ab78b2bf159 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "POST /compute/v2.1/servers/0532d211-0e06-47ae-8441-32d2a7b3cdd8/action" status: 202 len: 0 microversion: 2.1 time: 0.273712 Oct 19 04:18:17.079547 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3988/7505] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 04:18:16 2022] POST /compute/v2.1/servers/0532d211-0e06-47ae-8441-32d2a7b3cdd8/action => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 04:18:17.088822 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9c075723-47b9-4ba1-a2ee-079064aaac3c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:18:17.089605 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9c075723-47b9-4ba1-a2ee-079064aaac3c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0532d211-0e06-47ae-8441-32d2a7b3cdd8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:18:17.097081 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9c075723-47b9-4ba1-a2ee-079064aaac3c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:18:17.097866 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9c075723-47b9-4ba1-a2ee-079064aaac3c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:18:17.104088 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9c075723-47b9-4ba1-a2ee-079064aaac3c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:18:17.104088 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9c075723-47b9-4ba1-a2ee-079064aaac3c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:18:17.104088 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9c075723-47b9-4ba1-a2ee-079064aaac3c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:18:17.104088 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9c075723-47b9-4ba1-a2ee-079064aaac3c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:18:17.267116 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-9c075723-47b9-4ba1-a2ee-079064aaac3c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:18:17.276061 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9c075723-47b9-4ba1-a2ee-079064aaac3c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0532d211-0e06-47ae-8441-32d2a7b3cdd8" status: 200 len: 1680 microversion: 2.1 time: 0.192428 Oct 19 04:18:17.277001 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3518/7506] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:18:17 2022] GET /compute/v2.1/servers/0532d211-0e06-47ae-8441-32d2a7b3cdd8 => generated 1680 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:18:18.302094 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7fb82114-b4cb-4ffb-86b4-97a8175d63fc tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:18:18.302647 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7fb82114-b4cb-4ffb-86b4-97a8175d63fc tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0532d211-0e06-47ae-8441-32d2a7b3cdd8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:18:18.308773 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7fb82114-b4cb-4ffb-86b4-97a8175d63fc tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:18:18.309276 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7fb82114-b4cb-4ffb-86b4-97a8175d63fc tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:18:18.309771 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7fb82114-b4cb-4ffb-86b4-97a8175d63fc tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:18:18.310481 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7fb82114-b4cb-4ffb-86b4-97a8175d63fc tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:18:18.310957 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7fb82114-b4cb-4ffb-86b4-97a8175d63fc tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:18:18.311398 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7fb82114-b4cb-4ffb-86b4-97a8175d63fc tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:18:18.445195 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-7fb82114-b4cb-4ffb-86b4-97a8175d63fc tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:18:18.453215 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7fb82114-b4cb-4ffb-86b4-97a8175d63fc tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0532d211-0e06-47ae-8441-32d2a7b3cdd8" status: 200 len: 1680 microversion: 2.1 time: 0.156952 Oct 19 04:18:18.453825 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3989/7507] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:18:18 2022] GET /compute/v2.1/servers/0532d211-0e06-47ae-8441-32d2a7b3cdd8 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:18:19.477279 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-33a57d75-51fa-4aff-ac57-3c774eff8833 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:18:19.478054 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-33a57d75-51fa-4aff-ac57-3c774eff8833 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0532d211-0e06-47ae-8441-32d2a7b3cdd8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:18:19.486964 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-33a57d75-51fa-4aff-ac57-3c774eff8833 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:18:19.487470 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-33a57d75-51fa-4aff-ac57-3c774eff8833 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:18:19.487917 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-33a57d75-51fa-4aff-ac57-3c774eff8833 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:18:19.488632 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-33a57d75-51fa-4aff-ac57-3c774eff8833 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:18:19.489098 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-33a57d75-51fa-4aff-ac57-3c774eff8833 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:18:19.489588 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-33a57d75-51fa-4aff-ac57-3c774eff8833 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:18:19.695114 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-33a57d75-51fa-4aff-ac57-3c774eff8833 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:18:19.703039 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-33a57d75-51fa-4aff-ac57-3c774eff8833 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0532d211-0e06-47ae-8441-32d2a7b3cdd8" status: 200 len: 1680 microversion: 2.1 time: 0.229728 Oct 19 04:18:19.703853 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3519/7508] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:18:19 2022] GET /compute/v2.1/servers/0532d211-0e06-47ae-8441-32d2a7b3cdd8 => generated 1680 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:18:20.726474 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ecaf243d-4aec-4871-afb1-432b00572e53 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:18:20.727134 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ecaf243d-4aec-4871-afb1-432b00572e53 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0532d211-0e06-47ae-8441-32d2a7b3cdd8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:18:20.733995 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ecaf243d-4aec-4871-afb1-432b00572e53 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:18:20.736361 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ecaf243d-4aec-4871-afb1-432b00572e53 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:18:20.736361 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ecaf243d-4aec-4871-afb1-432b00572e53 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:18:20.736361 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ecaf243d-4aec-4871-afb1-432b00572e53 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:18:20.736361 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ecaf243d-4aec-4871-afb1-432b00572e53 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:18:20.736754 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ecaf243d-4aec-4871-afb1-432b00572e53 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:18:20.864507 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ecaf243d-4aec-4871-afb1-432b00572e53 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:18:20.872304 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ecaf243d-4aec-4871-afb1-432b00572e53 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0532d211-0e06-47ae-8441-32d2a7b3cdd8" status: 200 len: 1685 microversion: 2.1 time: 0.149802 Oct 19 04:18:20.872883 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3990/7509] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:18:20 2022] GET /compute/v2.1/servers/0532d211-0e06-47ae-8441-32d2a7b3cdd8 => generated 1685 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:18:21.896848 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ed7c8632-e748-4854-b21a-91ea85ced43c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:18:21.897504 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ed7c8632-e748-4854-b21a-91ea85ced43c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0532d211-0e06-47ae-8441-32d2a7b3cdd8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:18:21.904364 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ed7c8632-e748-4854-b21a-91ea85ced43c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:18:21.904857 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ed7c8632-e748-4854-b21a-91ea85ced43c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:18:21.905305 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ed7c8632-e748-4854-b21a-91ea85ced43c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:18:21.906666 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ed7c8632-e748-4854-b21a-91ea85ced43c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:18:21.907130 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ed7c8632-e748-4854-b21a-91ea85ced43c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:18:21.907562 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ed7c8632-e748-4854-b21a-91ea85ced43c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:18:22.040132 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ed7c8632-e748-4854-b21a-91ea85ced43c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:18:22.048447 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ed7c8632-e748-4854-b21a-91ea85ced43c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0532d211-0e06-47ae-8441-32d2a7b3cdd8" status: 200 len: 1685 microversion: 2.1 time: 0.155753 Oct 19 04:18:22.049023 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3520/7510] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:18:21 2022] GET /compute/v2.1/servers/0532d211-0e06-47ae-8441-32d2a7b3cdd8 => generated 1685 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:18:23.072049 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6cd630b7-d89e-4dad-b6cd-a63bdfffb91a tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:18:23.072680 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6cd630b7-d89e-4dad-b6cd-a63bdfffb91a tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0532d211-0e06-47ae-8441-32d2a7b3cdd8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:18:23.079511 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6cd630b7-d89e-4dad-b6cd-a63bdfffb91a tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:18:23.080011 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6cd630b7-d89e-4dad-b6cd-a63bdfffb91a tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:18:23.080466 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6cd630b7-d89e-4dad-b6cd-a63bdfffb91a tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:18:23.081170 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6cd630b7-d89e-4dad-b6cd-a63bdfffb91a tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:18:23.081668 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6cd630b7-d89e-4dad-b6cd-a63bdfffb91a tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:18:23.082113 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6cd630b7-d89e-4dad-b6cd-a63bdfffb91a tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:18:23.207527 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-6cd630b7-d89e-4dad-b6cd-a63bdfffb91a tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:18:23.215371 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6cd630b7-d89e-4dad-b6cd-a63bdfffb91a tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0532d211-0e06-47ae-8441-32d2a7b3cdd8" status: 200 len: 1685 microversion: 2.1 time: 0.147197 Oct 19 04:18:23.215931 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3991/7511] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:18:23 2022] GET /compute/v2.1/servers/0532d211-0e06-47ae-8441-32d2a7b3cdd8 => generated 1685 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:18:24.239124 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4db01431-2898-48a2-9191-bf207cfeefb6 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:18:24.239748 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4db01431-2898-48a2-9191-bf207cfeefb6 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0532d211-0e06-47ae-8441-32d2a7b3cdd8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:18:24.246535 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4db01431-2898-48a2-9191-bf207cfeefb6 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:18:24.247023 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4db01431-2898-48a2-9191-bf207cfeefb6 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:18:24.247465 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4db01431-2898-48a2-9191-bf207cfeefb6 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:18:24.248156 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4db01431-2898-48a2-9191-bf207cfeefb6 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:18:24.248610 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4db01431-2898-48a2-9191-bf207cfeefb6 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:18:24.249072 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4db01431-2898-48a2-9191-bf207cfeefb6 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:18:24.706423 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4db01431-2898-48a2-9191-bf207cfeefb6 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:18:24.714287 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4db01431-2898-48a2-9191-bf207cfeefb6 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0532d211-0e06-47ae-8441-32d2a7b3cdd8" status: 200 len: 1685 microversion: 2.1 time: 0.479141 Oct 19 04:18:24.714872 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3521/7512] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:18:24 2022] GET /compute/v2.1/servers/0532d211-0e06-47ae-8441-32d2a7b3cdd8 => generated 1685 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:18:25.738315 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-09791896-81b9-48aa-a39a-d5b90b6b41c1 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:18:25.738986 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-09791896-81b9-48aa-a39a-d5b90b6b41c1 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0532d211-0e06-47ae-8441-32d2a7b3cdd8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:18:25.745864 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-09791896-81b9-48aa-a39a-d5b90b6b41c1 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:18:25.746372 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-09791896-81b9-48aa-a39a-d5b90b6b41c1 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:18:25.746834 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-09791896-81b9-48aa-a39a-d5b90b6b41c1 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:18:25.747546 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-09791896-81b9-48aa-a39a-d5b90b6b41c1 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:18:25.748023 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-09791896-81b9-48aa-a39a-d5b90b6b41c1 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:18:25.748476 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-09791896-81b9-48aa-a39a-d5b90b6b41c1 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:18:25.876801 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-09791896-81b9-48aa-a39a-d5b90b6b41c1 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:18:25.884990 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-09791896-81b9-48aa-a39a-d5b90b6b41c1 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0532d211-0e06-47ae-8441-32d2a7b3cdd8" status: 200 len: 1685 microversion: 2.1 time: 0.150578 Oct 19 04:18:25.885599 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3992/7513] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:18:25 2022] GET /compute/v2.1/servers/0532d211-0e06-47ae-8441-32d2a7b3cdd8 => generated 1685 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:18:26.908714 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-bc1ffe0d-87e9-4c27-bf35-d294952a8183 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:18:26.909339 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-bc1ffe0d-87e9-4c27-bf35-d294952a8183 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0532d211-0e06-47ae-8441-32d2a7b3cdd8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:18:26.916289 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bc1ffe0d-87e9-4c27-bf35-d294952a8183 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:18:26.916785 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bc1ffe0d-87e9-4c27-bf35-d294952a8183 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:18:26.917238 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bc1ffe0d-87e9-4c27-bf35-d294952a8183 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:18:26.917974 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bc1ffe0d-87e9-4c27-bf35-d294952a8183 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:18:26.918440 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bc1ffe0d-87e9-4c27-bf35-d294952a8183 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:18:26.918877 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bc1ffe0d-87e9-4c27-bf35-d294952a8183 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:18:27.053069 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-bc1ffe0d-87e9-4c27-bf35-d294952a8183 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:18:27.060816 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-bc1ffe0d-87e9-4c27-bf35-d294952a8183 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0532d211-0e06-47ae-8441-32d2a7b3cdd8" status: 200 len: 1685 microversion: 2.1 time: 0.156147 Oct 19 04:18:27.063799 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3522/7514] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:18:26 2022] GET /compute/v2.1/servers/0532d211-0e06-47ae-8441-32d2a7b3cdd8 => generated 1685 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:18:28.084317 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3aa07b77-5772-48c7-b44e-079b1bc4eee4 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:18:28.085384 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3aa07b77-5772-48c7-b44e-079b1bc4eee4 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0532d211-0e06-47ae-8441-32d2a7b3cdd8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:18:28.093579 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3aa07b77-5772-48c7-b44e-079b1bc4eee4 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:18:28.094095 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3aa07b77-5772-48c7-b44e-079b1bc4eee4 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:18:28.094602 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3aa07b77-5772-48c7-b44e-079b1bc4eee4 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:18:28.095329 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3aa07b77-5772-48c7-b44e-079b1bc4eee4 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:18:28.095809 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3aa07b77-5772-48c7-b44e-079b1bc4eee4 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:18:28.096265 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3aa07b77-5772-48c7-b44e-079b1bc4eee4 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:18:28.238219 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-3aa07b77-5772-48c7-b44e-079b1bc4eee4 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:18:28.246860 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3aa07b77-5772-48c7-b44e-079b1bc4eee4 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0532d211-0e06-47ae-8441-32d2a7b3cdd8" status: 200 len: 1685 microversion: 2.1 time: 0.166392 Oct 19 04:18:28.247471 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3993/7515] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:18:28 2022] GET /compute/v2.1/servers/0532d211-0e06-47ae-8441-32d2a7b3cdd8 => generated 1685 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:18:29.273215 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d4b18e22-7e82-41d3-812e-6d233bd7537e tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:18:29.273883 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d4b18e22-7e82-41d3-812e-6d233bd7537e tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0532d211-0e06-47ae-8441-32d2a7b3cdd8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:18:29.281263 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d4b18e22-7e82-41d3-812e-6d233bd7537e tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:18:29.281777 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d4b18e22-7e82-41d3-812e-6d233bd7537e tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:18:29.282220 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d4b18e22-7e82-41d3-812e-6d233bd7537e tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:18:29.282912 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d4b18e22-7e82-41d3-812e-6d233bd7537e tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:18:29.283366 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d4b18e22-7e82-41d3-812e-6d233bd7537e tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:18:29.283792 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d4b18e22-7e82-41d3-812e-6d233bd7537e tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:18:29.414422 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d4b18e22-7e82-41d3-812e-6d233bd7537e tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:18:29.422310 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d4b18e22-7e82-41d3-812e-6d233bd7537e tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0532d211-0e06-47ae-8441-32d2a7b3cdd8" status: 200 len: 1685 microversion: 2.1 time: 0.153286 Oct 19 04:18:29.422881 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3523/7516] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:18:29 2022] GET /compute/v2.1/servers/0532d211-0e06-47ae-8441-32d2a7b3cdd8 => generated 1685 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:18:30.446513 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-946ddf75-6624-4dea-8f0d-afda94b2bd52 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:18:30.447152 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-946ddf75-6624-4dea-8f0d-afda94b2bd52 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0532d211-0e06-47ae-8441-32d2a7b3cdd8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:18:30.453592 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-946ddf75-6624-4dea-8f0d-afda94b2bd52 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:18:30.454097 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-946ddf75-6624-4dea-8f0d-afda94b2bd52 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:18:30.454556 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-946ddf75-6624-4dea-8f0d-afda94b2bd52 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:18:30.455316 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-946ddf75-6624-4dea-8f0d-afda94b2bd52 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:18:30.455835 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-946ddf75-6624-4dea-8f0d-afda94b2bd52 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:18:30.456276 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-946ddf75-6624-4dea-8f0d-afda94b2bd52 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:18:30.592316 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-946ddf75-6624-4dea-8f0d-afda94b2bd52 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:18:30.600528 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-946ddf75-6624-4dea-8f0d-afda94b2bd52 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0532d211-0e06-47ae-8441-32d2a7b3cdd8" status: 200 len: 1685 microversion: 2.1 time: 0.158134 Oct 19 04:18:30.601101 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3994/7517] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:18:30 2022] GET /compute/v2.1/servers/0532d211-0e06-47ae-8441-32d2a7b3cdd8 => generated 1685 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:18:31.624774 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a5f38a25-1729-4f41-84b3-25d1dab016ec tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:18:31.625438 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a5f38a25-1729-4f41-84b3-25d1dab016ec tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0532d211-0e06-47ae-8441-32d2a7b3cdd8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:18:31.632246 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a5f38a25-1729-4f41-84b3-25d1dab016ec tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:18:31.632738 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a5f38a25-1729-4f41-84b3-25d1dab016ec tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:18:31.633175 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a5f38a25-1729-4f41-84b3-25d1dab016ec tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:18:31.633888 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a5f38a25-1729-4f41-84b3-25d1dab016ec tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:18:31.634345 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a5f38a25-1729-4f41-84b3-25d1dab016ec tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:18:31.634770 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a5f38a25-1729-4f41-84b3-25d1dab016ec tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:18:31.760976 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a5f38a25-1729-4f41-84b3-25d1dab016ec tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:18:31.768770 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a5f38a25-1729-4f41-84b3-25d1dab016ec tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0532d211-0e06-47ae-8441-32d2a7b3cdd8" status: 200 len: 1685 microversion: 2.1 time: 0.148484 Oct 19 04:18:31.769346 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3524/7518] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:18:31 2022] GET /compute/v2.1/servers/0532d211-0e06-47ae-8441-32d2a7b3cdd8 => generated 1685 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:18:32.792267 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-602a10e6-2b2b-4741-954e-63ec85491027 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:18:32.792889 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-602a10e6-2b2b-4741-954e-63ec85491027 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0532d211-0e06-47ae-8441-32d2a7b3cdd8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:18:32.799676 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-602a10e6-2b2b-4741-954e-63ec85491027 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:18:32.800168 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-602a10e6-2b2b-4741-954e-63ec85491027 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:18:32.800615 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-602a10e6-2b2b-4741-954e-63ec85491027 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:18:32.801314 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-602a10e6-2b2b-4741-954e-63ec85491027 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:18:32.801802 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-602a10e6-2b2b-4741-954e-63ec85491027 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:18:32.802241 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-602a10e6-2b2b-4741-954e-63ec85491027 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:18:32.932530 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-602a10e6-2b2b-4741-954e-63ec85491027 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:18:32.941424 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-602a10e6-2b2b-4741-954e-63ec85491027 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0532d211-0e06-47ae-8441-32d2a7b3cdd8" status: 200 len: 1685 microversion: 2.1 time: 0.152961 Oct 19 04:18:32.942035 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3995/7519] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:18:32 2022] GET /compute/v2.1/servers/0532d211-0e06-47ae-8441-32d2a7b3cdd8 => generated 1685 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:18:33.965498 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0cc3fd72-6e62-474d-8b6f-4674d805c62f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:18:33.966122 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0cc3fd72-6e62-474d-8b6f-4674d805c62f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0532d211-0e06-47ae-8441-32d2a7b3cdd8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:18:33.974965 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0cc3fd72-6e62-474d-8b6f-4674d805c62f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:18:33.975577 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0cc3fd72-6e62-474d-8b6f-4674d805c62f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:18:33.976023 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0cc3fd72-6e62-474d-8b6f-4674d805c62f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:18:33.976725 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0cc3fd72-6e62-474d-8b6f-4674d805c62f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:18:33.977186 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0cc3fd72-6e62-474d-8b6f-4674d805c62f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:18:33.977674 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0cc3fd72-6e62-474d-8b6f-4674d805c62f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:18:34.116948 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-0cc3fd72-6e62-474d-8b6f-4674d805c62f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:18:34.125281 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0cc3fd72-6e62-474d-8b6f-4674d805c62f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0532d211-0e06-47ae-8441-32d2a7b3cdd8" status: 200 len: 1685 microversion: 2.1 time: 0.163793 Oct 19 04:18:34.125893 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3525/7520] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:18:33 2022] GET /compute/v2.1/servers/0532d211-0e06-47ae-8441-32d2a7b3cdd8 => generated 1685 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:18:35.148862 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e408e62c-e0db-4ed6-8a13-437fc3e58b22 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:18:35.149525 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e408e62c-e0db-4ed6-8a13-437fc3e58b22 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0532d211-0e06-47ae-8441-32d2a7b3cdd8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:18:35.157059 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e408e62c-e0db-4ed6-8a13-437fc3e58b22 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:18:35.157607 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e408e62c-e0db-4ed6-8a13-437fc3e58b22 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:18:35.158069 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e408e62c-e0db-4ed6-8a13-437fc3e58b22 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:18:35.158798 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e408e62c-e0db-4ed6-8a13-437fc3e58b22 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:18:35.159274 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e408e62c-e0db-4ed6-8a13-437fc3e58b22 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:18:35.159729 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e408e62c-e0db-4ed6-8a13-437fc3e58b22 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:18:35.288702 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e408e62c-e0db-4ed6-8a13-437fc3e58b22 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:18:35.296471 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e408e62c-e0db-4ed6-8a13-437fc3e58b22 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0532d211-0e06-47ae-8441-32d2a7b3cdd8" status: 200 len: 1685 microversion: 2.1 time: 0.151775 Oct 19 04:18:35.297055 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3996/7521] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:18:35 2022] GET /compute/v2.1/servers/0532d211-0e06-47ae-8441-32d2a7b3cdd8 => generated 1685 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:18:36.319534 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-78f48fec-73c4-46c1-8dcf-1241e6475969 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:18:36.320283 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-78f48fec-73c4-46c1-8dcf-1241e6475969 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0532d211-0e06-47ae-8441-32d2a7b3cdd8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:18:36.327300 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-78f48fec-73c4-46c1-8dcf-1241e6475969 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:18:36.327784 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-78f48fec-73c4-46c1-8dcf-1241e6475969 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:18:36.328223 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-78f48fec-73c4-46c1-8dcf-1241e6475969 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:18:36.328965 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-78f48fec-73c4-46c1-8dcf-1241e6475969 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:18:36.329445 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-78f48fec-73c4-46c1-8dcf-1241e6475969 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:18:36.329872 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-78f48fec-73c4-46c1-8dcf-1241e6475969 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:18:36.462606 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-78f48fec-73c4-46c1-8dcf-1241e6475969 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:18:36.470891 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-78f48fec-73c4-46c1-8dcf-1241e6475969 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0532d211-0e06-47ae-8441-32d2a7b3cdd8" status: 200 len: 1685 microversion: 2.1 time: 0.155319 Oct 19 04:18:36.471513 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3526/7522] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:18:36 2022] GET /compute/v2.1/servers/0532d211-0e06-47ae-8441-32d2a7b3cdd8 => generated 1685 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:18:37.495140 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-14ea5f28-f928-4da0-b46e-6467036ee62d tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:18:37.495772 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-14ea5f28-f928-4da0-b46e-6467036ee62d tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0532d211-0e06-47ae-8441-32d2a7b3cdd8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:18:37.503529 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-14ea5f28-f928-4da0-b46e-6467036ee62d tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:18:37.504038 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-14ea5f28-f928-4da0-b46e-6467036ee62d tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:18:37.504499 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-14ea5f28-f928-4da0-b46e-6467036ee62d tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:18:37.505211 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-14ea5f28-f928-4da0-b46e-6467036ee62d tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:18:37.505723 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-14ea5f28-f928-4da0-b46e-6467036ee62d tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:18:37.506301 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-14ea5f28-f928-4da0-b46e-6467036ee62d tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:18:37.641299 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-14ea5f28-f928-4da0-b46e-6467036ee62d tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:18:37.649429 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-14ea5f28-f928-4da0-b46e-6467036ee62d tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0532d211-0e06-47ae-8441-32d2a7b3cdd8" status: 200 len: 1684 microversion: 2.1 time: 0.158352 Oct 19 04:18:37.650007 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3997/7523] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:18:37 2022] GET /compute/v2.1/servers/0532d211-0e06-47ae-8441-32d2a7b3cdd8 => generated 1684 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:18:38.090579 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-e25ecb5f-44aa-4359-bc2b-7296d9867f1d req-092cfd9d-2141-4274-86db-96efcb7286ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0532d211-0e06-47ae-8441-32d2a7b3cdd8", "name": "network-vif-unplugged", "status": "completed", "tag": "a440f107-442f-40fa-b252-0e80e2ceb567"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:18:38.102835 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-e25ecb5f-44aa-4359-bc2b-7296d9867f1d req-092cfd9d-2141-4274-86db-96efcb7286ff service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:18:38.102835 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-e25ecb5f-44aa-4359-bc2b-7296d9867f1d req-092cfd9d-2141-4274-86db-96efcb7286ff service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:18:38.103335 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-e25ecb5f-44aa-4359-bc2b-7296d9867f1d req-092cfd9d-2141-4274-86db-96efcb7286ff service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:18:38.115749 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-e25ecb5f-44aa-4359-bc2b-7296d9867f1d req-092cfd9d-2141-4274-86db-96efcb7286ff service nova] Creating event network-vif-unplugged:a440f107-442f-40fa-b252-0e80e2ceb567 for instance 0532d211-0e06-47ae-8441-32d2a7b3cdd8 on n-h1-861333-8 Oct 19 04:18:38.121056 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [req-e25ecb5f-44aa-4359-bc2b-7296d9867f1d req-092cfd9d-2141-4274-86db-96efcb7286ff service nova] Instance 0532d211-0e06-47ae-8441-32d2a7b3cdd8 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-861333-8', 'n-h1-861333-8'} {{(pid=121135) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 04:18:38.132090 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-e25ecb5f-44aa-4359-bc2b-7296d9867f1d req-092cfd9d-2141-4274-86db-96efcb7286ff service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045424 Oct 19 04:18:38.132688 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3527/7524] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:18:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:18:38.674346 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b9e9c4c7-6534-4e37-b27a-af2fc94df618 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:18:38.675010 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b9e9c4c7-6534-4e37-b27a-af2fc94df618 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0532d211-0e06-47ae-8441-32d2a7b3cdd8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:18:38.682026 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b9e9c4c7-6534-4e37-b27a-af2fc94df618 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:18:38.682555 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b9e9c4c7-6534-4e37-b27a-af2fc94df618 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:18:38.683048 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b9e9c4c7-6534-4e37-b27a-af2fc94df618 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:18:38.683766 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b9e9c4c7-6534-4e37-b27a-af2fc94df618 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:18:38.684244 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b9e9c4c7-6534-4e37-b27a-af2fc94df618 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:18:38.684695 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b9e9c4c7-6534-4e37-b27a-af2fc94df618 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:18:38.819071 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b9e9c4c7-6534-4e37-b27a-af2fc94df618 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:18:38.827051 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b9e9c4c7-6534-4e37-b27a-af2fc94df618 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0532d211-0e06-47ae-8441-32d2a7b3cdd8" status: 200 len: 1684 microversion: 2.1 time: 0.156810 Oct 19 04:18:38.828253 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3998/7525] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:18:38 2022] GET /compute/v2.1/servers/0532d211-0e06-47ae-8441-32d2a7b3cdd8 => generated 1684 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:18:39.852195 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-50a3baf7-e356-4d2a-ac17-8b958a5c7dab tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:18:39.852909 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-50a3baf7-e356-4d2a-ac17-8b958a5c7dab tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0532d211-0e06-47ae-8441-32d2a7b3cdd8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:18:39.859673 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-50a3baf7-e356-4d2a-ac17-8b958a5c7dab tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:18:39.860165 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-50a3baf7-e356-4d2a-ac17-8b958a5c7dab tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:18:39.860612 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-50a3baf7-e356-4d2a-ac17-8b958a5c7dab tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:18:39.861316 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-50a3baf7-e356-4d2a-ac17-8b958a5c7dab tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:18:39.861802 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-50a3baf7-e356-4d2a-ac17-8b958a5c7dab tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:18:39.862246 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-50a3baf7-e356-4d2a-ac17-8b958a5c7dab tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:18:39.993845 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-50a3baf7-e356-4d2a-ac17-8b958a5c7dab tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:18:40.002215 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-50a3baf7-e356-4d2a-ac17-8b958a5c7dab tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0532d211-0e06-47ae-8441-32d2a7b3cdd8" status: 200 len: 1682 microversion: 2.1 time: 0.155212 Oct 19 04:18:40.002782 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3528/7526] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:18:39 2022] GET /compute/v2.1/servers/0532d211-0e06-47ae-8441-32d2a7b3cdd8 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:18:40.146649 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-d5dba1cb-599d-4e45-ba01-c5f373b09cd1 req-1d082319-17ac-4f91-a9c0-c782049914dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0532d211-0e06-47ae-8441-32d2a7b3cdd8", "tag": "a440f107-442f-40fa-b252-0e80e2ceb567"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:18:40.157208 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-d5dba1cb-599d-4e45-ba01-c5f373b09cd1 req-1d082319-17ac-4f91-a9c0-c782049914dd service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:18:40.157802 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-d5dba1cb-599d-4e45-ba01-c5f373b09cd1 req-1d082319-17ac-4f91-a9c0-c782049914dd service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:18:40.158256 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-d5dba1cb-599d-4e45-ba01-c5f373b09cd1 req-1d082319-17ac-4f91-a9c0-c782049914dd service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:18:40.169891 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-d5dba1cb-599d-4e45-ba01-c5f373b09cd1 req-1d082319-17ac-4f91-a9c0-c782049914dd service nova] Creating event network-changed:a440f107-442f-40fa-b252-0e80e2ceb567 for instance 0532d211-0e06-47ae-8441-32d2a7b3cdd8 on n-h1-861333-8 Oct 19 04:18:40.175847 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [req-d5dba1cb-599d-4e45-ba01-c5f373b09cd1 req-1d082319-17ac-4f91-a9c0-c782049914dd service nova] Instance 0532d211-0e06-47ae-8441-32d2a7b3cdd8 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-861333-8', 'n-h1-861333-8'} {{(pid=121134) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 04:18:40.186577 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-d5dba1cb-599d-4e45-ba01-c5f373b09cd1 req-1d082319-17ac-4f91-a9c0-c782049914dd service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043957 Oct 19 04:18:40.187164 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 3999/7527] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:18:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:18:41.026071 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-616cf23a-bf92-431b-9cde-77b476cb9bd8 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:18:41.026595 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-616cf23a-bf92-431b-9cde-77b476cb9bd8 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0532d211-0e06-47ae-8441-32d2a7b3cdd8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:18:41.033336 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-616cf23a-bf92-431b-9cde-77b476cb9bd8 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:18:41.033861 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-616cf23a-bf92-431b-9cde-77b476cb9bd8 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:18:41.034302 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-616cf23a-bf92-431b-9cde-77b476cb9bd8 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:18:41.035001 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-616cf23a-bf92-431b-9cde-77b476cb9bd8 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:18:41.035464 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-616cf23a-bf92-431b-9cde-77b476cb9bd8 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:18:41.036159 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-616cf23a-bf92-431b-9cde-77b476cb9bd8 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:18:41.164834 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-616cf23a-bf92-431b-9cde-77b476cb9bd8 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:18:41.172568 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-616cf23a-bf92-431b-9cde-77b476cb9bd8 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0532d211-0e06-47ae-8441-32d2a7b3cdd8" status: 200 len: 1682 microversion: 2.1 time: 0.150491 Oct 19 04:18:41.173145 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3529/7528] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:18:41 2022] GET /compute/v2.1/servers/0532d211-0e06-47ae-8441-32d2a7b3cdd8 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:18:42.198226 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8c626a38-a83d-4f8b-b580-a1b8a989c0f1 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:18:42.198953 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8c626a38-a83d-4f8b-b580-a1b8a989c0f1 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0532d211-0e06-47ae-8441-32d2a7b3cdd8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:18:42.206162 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8c626a38-a83d-4f8b-b580-a1b8a989c0f1 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:18:42.206670 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8c626a38-a83d-4f8b-b580-a1b8a989c0f1 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:18:42.207132 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8c626a38-a83d-4f8b-b580-a1b8a989c0f1 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:18:42.207852 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8c626a38-a83d-4f8b-b580-a1b8a989c0f1 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:18:42.208510 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8c626a38-a83d-4f8b-b580-a1b8a989c0f1 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:18:42.208964 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8c626a38-a83d-4f8b-b580-a1b8a989c0f1 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:18:42.341846 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8c626a38-a83d-4f8b-b580-a1b8a989c0f1 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:18:42.350579 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8c626a38-a83d-4f8b-b580-a1b8a989c0f1 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0532d211-0e06-47ae-8441-32d2a7b3cdd8" status: 200 len: 1682 microversion: 2.1 time: 0.158097 Oct 19 04:18:42.351166 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4000/7529] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:18:42 2022] GET /compute/v2.1/servers/0532d211-0e06-47ae-8441-32d2a7b3cdd8 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:18:43.374243 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b53827a1-594d-4778-a9a2-760494526ed4 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:18:43.374859 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b53827a1-594d-4778-a9a2-760494526ed4 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0532d211-0e06-47ae-8441-32d2a7b3cdd8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:18:43.381666 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b53827a1-594d-4778-a9a2-760494526ed4 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:18:43.382155 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b53827a1-594d-4778-a9a2-760494526ed4 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:18:43.382595 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b53827a1-594d-4778-a9a2-760494526ed4 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:18:43.383284 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b53827a1-594d-4778-a9a2-760494526ed4 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:18:43.383743 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b53827a1-594d-4778-a9a2-760494526ed4 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:18:43.384202 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b53827a1-594d-4778-a9a2-760494526ed4 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:18:43.517828 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b53827a1-594d-4778-a9a2-760494526ed4 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:18:43.525830 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b53827a1-594d-4778-a9a2-760494526ed4 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0532d211-0e06-47ae-8441-32d2a7b3cdd8" status: 200 len: 1679 microversion: 2.1 time: 0.155462 Oct 19 04:18:43.526407 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3530/7530] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:18:43 2022] GET /compute/v2.1/servers/0532d211-0e06-47ae-8441-32d2a7b3cdd8 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:18:43.548747 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b5194ae8-0091-4270-95b6-fac122678ea7 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:18:43.549465 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b5194ae8-0091-4270-95b6-fac122678ea7 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0532d211-0e06-47ae-8441-32d2a7b3cdd8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:18:43.556314 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b5194ae8-0091-4270-95b6-fac122678ea7 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:18:43.556816 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b5194ae8-0091-4270-95b6-fac122678ea7 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:18:43.557273 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b5194ae8-0091-4270-95b6-fac122678ea7 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:18:43.558008 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b5194ae8-0091-4270-95b6-fac122678ea7 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:18:43.558482 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b5194ae8-0091-4270-95b6-fac122678ea7 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:18:43.558926 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b5194ae8-0091-4270-95b6-fac122678ea7 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:18:43.601306 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:18:43.724643 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b5194ae8-0091-4270-95b6-fac122678ea7 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "POST /compute/v2.1/servers/0532d211-0e06-47ae-8441-32d2a7b3cdd8/action" status: 204 len: 0 microversion: 2.1 time: 0.179688 Oct 19 04:18:43.725298 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4001/7531] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 04:18:43 2022] POST /compute/v2.1/servers/0532d211-0e06-47ae-8441-32d2a7b3cdd8/action => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 04:18:43.734080 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3fd43b29-d847-4a7c-97f3-fa75b911a95f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:18:43.734726 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-3fd43b29-d847-4a7c-97f3-fa75b911a95f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0532d211-0e06-47ae-8441-32d2a7b3cdd8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:18:43.740927 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3fd43b29-d847-4a7c-97f3-fa75b911a95f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:18:43.741470 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3fd43b29-d847-4a7c-97f3-fa75b911a95f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:18:43.741911 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3fd43b29-d847-4a7c-97f3-fa75b911a95f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:18:43.742612 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3fd43b29-d847-4a7c-97f3-fa75b911a95f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:18:43.743063 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3fd43b29-d847-4a7c-97f3-fa75b911a95f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:18:43.743489 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3fd43b29-d847-4a7c-97f3-fa75b911a95f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:18:43.924441 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-3fd43b29-d847-4a7c-97f3-fa75b911a95f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:18:43.932284 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-3fd43b29-d847-4a7c-97f3-fa75b911a95f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0532d211-0e06-47ae-8441-32d2a7b3cdd8" status: 200 len: 1679 microversion: 2.1 time: 0.202549 Oct 19 04:18:43.932866 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3531/7532] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:18:43 2022] GET /compute/v2.1/servers/0532d211-0e06-47ae-8441-32d2a7b3cdd8 => generated 1679 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:18:44.847422 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-26e85c17-b16c-423d-9258-d88186cf259a req-1dcb21b5-d4fc-47b1-9751-e02f13af17aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0532d211-0e06-47ae-8441-32d2a7b3cdd8", "name": "network-vif-plugged", "status": "completed", "tag": "a440f107-442f-40fa-b252-0e80e2ceb567"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:18:44.858665 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-26e85c17-b16c-423d-9258-d88186cf259a req-1dcb21b5-d4fc-47b1-9751-e02f13af17aa service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:18:44.859164 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-26e85c17-b16c-423d-9258-d88186cf259a req-1dcb21b5-d4fc-47b1-9751-e02f13af17aa service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:18:44.863101 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-26e85c17-b16c-423d-9258-d88186cf259a req-1dcb21b5-d4fc-47b1-9751-e02f13af17aa service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:18:44.871453 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-26e85c17-b16c-423d-9258-d88186cf259a req-1dcb21b5-d4fc-47b1-9751-e02f13af17aa service nova] Creating event network-vif-plugged:a440f107-442f-40fa-b252-0e80e2ceb567 for instance 0532d211-0e06-47ae-8441-32d2a7b3cdd8 on n-h1-861333-8 Oct 19 04:18:44.878259 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [req-26e85c17-b16c-423d-9258-d88186cf259a req-1dcb21b5-d4fc-47b1-9751-e02f13af17aa service nova] Instance 0532d211-0e06-47ae-8441-32d2a7b3cdd8 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-861333-8', 'n-h1-861333-8'} {{(pid=121134) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 04:18:44.891924 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-26e85c17-b16c-423d-9258-d88186cf259a req-1dcb21b5-d4fc-47b1-9751-e02f13af17aa service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047414 Oct 19 04:18:44.892535 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4002/7533] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:18:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 04:18:44.956222 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-053e14e1-396e-4246-a671-1dac6f0a345e tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:18:44.956849 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-053e14e1-396e-4246-a671-1dac6f0a345e tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0532d211-0e06-47ae-8441-32d2a7b3cdd8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:18:44.963797 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-053e14e1-396e-4246-a671-1dac6f0a345e tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:18:44.964293 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-053e14e1-396e-4246-a671-1dac6f0a345e tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:18:44.965317 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-053e14e1-396e-4246-a671-1dac6f0a345e tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:18:44.966058 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-053e14e1-396e-4246-a671-1dac6f0a345e tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:18:44.966526 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-053e14e1-396e-4246-a671-1dac6f0a345e tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:18:44.966961 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-053e14e1-396e-4246-a671-1dac6f0a345e tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:18:45.100086 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-053e14e1-396e-4246-a671-1dac6f0a345e tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:18:45.103708 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=100 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:18:45.108326 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-053e14e1-396e-4246-a671-1dac6f0a345e tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0532d211-0e06-47ae-8441-32d2a7b3cdd8" status: 200 len: 1679 microversion: 2.1 time: 0.156790 Oct 19 04:18:45.108906 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3532/7534] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:18:44 2022] GET /compute/v2.1/servers/0532d211-0e06-47ae-8441-32d2a7b3cdd8 => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:18:46.132723 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5bf4ff44-26fc-4883-8149-971318667363 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:18:46.133484 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5bf4ff44-26fc-4883-8149-971318667363 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0532d211-0e06-47ae-8441-32d2a7b3cdd8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:18:46.140666 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5bf4ff44-26fc-4883-8149-971318667363 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:18:46.141832 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5bf4ff44-26fc-4883-8149-971318667363 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:18:46.142302 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5bf4ff44-26fc-4883-8149-971318667363 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:18:46.143033 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5bf4ff44-26fc-4883-8149-971318667363 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:18:46.143507 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5bf4ff44-26fc-4883-8149-971318667363 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:18:46.143954 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5bf4ff44-26fc-4883-8149-971318667363 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:18:46.281279 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5bf4ff44-26fc-4883-8149-971318667363 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:18:46.289148 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5bf4ff44-26fc-4883-8149-971318667363 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0532d211-0e06-47ae-8441-32d2a7b3cdd8" status: 200 len: 1671 microversion: 2.1 time: 0.160881 Oct 19 04:18:46.289753 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4003/7535] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:18:46 2022] GET /compute/v2.1/servers/0532d211-0e06-47ae-8441-32d2a7b3cdd8 => generated 1671 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:18:46.312102 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-805885dc-8b64-4068-aae4-393c0ed85593 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:18:46.313417 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-805885dc-8b64-4068-aae4-393c0ed85593 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0532d211-0e06-47ae-8441-32d2a7b3cdd8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:18:46.320741 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-805885dc-8b64-4068-aae4-393c0ed85593 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:18:46.321234 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-805885dc-8b64-4068-aae4-393c0ed85593 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:18:46.321719 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-805885dc-8b64-4068-aae4-393c0ed85593 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:18:46.322414 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-805885dc-8b64-4068-aae4-393c0ed85593 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:18:46.322878 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-805885dc-8b64-4068-aae4-393c0ed85593 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:18:46.323315 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-805885dc-8b64-4068-aae4-393c0ed85593 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:18:46.454282 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-805885dc-8b64-4068-aae4-393c0ed85593 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:18:46.462107 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-805885dc-8b64-4068-aae4-393c0ed85593 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0532d211-0e06-47ae-8441-32d2a7b3cdd8" status: 200 len: 1671 microversion: 2.1 time: 0.154025 Oct 19 04:18:46.462684 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3533/7536] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:18:46 2022] GET /compute/v2.1/servers/0532d211-0e06-47ae-8441-32d2a7b3cdd8 => generated 1671 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:18:46.484164 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e94cc5a0-f9f3-4265-bdda-8e32b4b700fe tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:18:46.485346 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e94cc5a0-f9f3-4265-bdda-8e32b4b700fe tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0532d211-0e06-47ae-8441-32d2a7b3cdd8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:18:46.491660 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e94cc5a0-f9f3-4265-bdda-8e32b4b700fe tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:18:46.492147 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e94cc5a0-f9f3-4265-bdda-8e32b4b700fe tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:18:46.492593 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e94cc5a0-f9f3-4265-bdda-8e32b4b700fe tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:18:46.493289 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e94cc5a0-f9f3-4265-bdda-8e32b4b700fe tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:18:46.493779 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e94cc5a0-f9f3-4265-bdda-8e32b4b700fe tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:18:46.494225 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e94cc5a0-f9f3-4265-bdda-8e32b4b700fe tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:18:46.626050 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e94cc5a0-f9f3-4265-bdda-8e32b4b700fe tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:18:46.634001 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e94cc5a0-f9f3-4265-bdda-8e32b4b700fe tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0532d211-0e06-47ae-8441-32d2a7b3cdd8" status: 200 len: 1671 microversion: 2.1 time: 0.153835 Oct 19 04:18:46.634612 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4004/7537] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:18:46 2022] GET /compute/v2.1/servers/0532d211-0e06-47ae-8441-32d2a7b3cdd8 => generated 1671 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:18:46.656377 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1fdfcb29-d0ac-47fd-a682-4bbcfb5a868e tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:18:46.656881 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1fdfcb29-d0ac-47fd-a682-4bbcfb5a868e tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0532d211-0e06-47ae-8441-32d2a7b3cdd8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:18:46.658739 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=37 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:18:46.663397 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1fdfcb29-d0ac-47fd-a682-4bbcfb5a868e tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:18:46.663879 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1fdfcb29-d0ac-47fd-a682-4bbcfb5a868e tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:18:46.664315 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1fdfcb29-d0ac-47fd-a682-4bbcfb5a868e tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:18:46.665006 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1fdfcb29-d0ac-47fd-a682-4bbcfb5a868e tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:18:46.665490 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1fdfcb29-d0ac-47fd-a682-4bbcfb5a868e tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:18:46.665918 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1fdfcb29-d0ac-47fd-a682-4bbcfb5a868e tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:18:46.692149 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1fdfcb29-d0ac-47fd-a682-4bbcfb5a868e tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0532d211-0e06-47ae-8441-32d2a7b3cdd8] Going to try to terminate instance {{(pid=121135) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 04:18:46.975628 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1fdfcb29-d0ac-47fd-a682-4bbcfb5a868e tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "DELETE /compute/v2.1/servers/0532d211-0e06-47ae-8441-32d2a7b3cdd8" status: 204 len: 0 microversion: 2.1 time: 0.322801 Oct 19 04:18:46.976237 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3534/7538] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 04:18:46 2022] DELETE /compute/v2.1/servers/0532d211-0e06-47ae-8441-32d2a7b3cdd8 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 04:18:46.985362 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d73801b3-a569-4edc-be02-db6700ca697f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:18:46.985999 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d73801b3-a569-4edc-be02-db6700ca697f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0532d211-0e06-47ae-8441-32d2a7b3cdd8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:18:46.987962 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=41 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:18:46.992703 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d73801b3-a569-4edc-be02-db6700ca697f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:18:46.993213 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d73801b3-a569-4edc-be02-db6700ca697f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:18:46.993699 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d73801b3-a569-4edc-be02-db6700ca697f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:18:46.994413 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d73801b3-a569-4edc-be02-db6700ca697f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:18:46.994890 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d73801b3-a569-4edc-be02-db6700ca697f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:18:46.995337 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d73801b3-a569-4edc-be02-db6700ca697f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:18:47.124554 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d73801b3-a569-4edc-be02-db6700ca697f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:18:47.132463 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d73801b3-a569-4edc-be02-db6700ca697f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0532d211-0e06-47ae-8441-32d2a7b3cdd8" status: 200 len: 1677 microversion: 2.1 time: 0.151648 Oct 19 04:18:47.133054 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4005/7539] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:18:46 2022] GET /compute/v2.1/servers/0532d211-0e06-47ae-8441-32d2a7b3cdd8 => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:18:48.157341 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-70f05aba-fa6d-41ca-bf99-7bad4eb77d1a tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:18:48.157984 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-70f05aba-fa6d-41ca-bf99-7bad4eb77d1a tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0532d211-0e06-47ae-8441-32d2a7b3cdd8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:18:48.164883 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-70f05aba-fa6d-41ca-bf99-7bad4eb77d1a tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:18:48.165389 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-70f05aba-fa6d-41ca-bf99-7bad4eb77d1a tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:18:48.165841 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-70f05aba-fa6d-41ca-bf99-7bad4eb77d1a tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:18:48.166535 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-70f05aba-fa6d-41ca-bf99-7bad4eb77d1a tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:18:48.166995 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-70f05aba-fa6d-41ca-bf99-7bad4eb77d1a tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:18:48.167423 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-70f05aba-fa6d-41ca-bf99-7bad4eb77d1a tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:18:48.299587 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-70f05aba-fa6d-41ca-bf99-7bad4eb77d1a tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:18:48.307359 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-70f05aba-fa6d-41ca-bf99-7bad4eb77d1a tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0532d211-0e06-47ae-8441-32d2a7b3cdd8" status: 200 len: 1677 microversion: 2.1 time: 0.154918 Oct 19 04:18:48.307937 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3535/7540] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:18:48 2022] GET /compute/v2.1/servers/0532d211-0e06-47ae-8441-32d2a7b3cdd8 => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:18:49.330965 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d53a7e63-48b2-4c2e-9603-c44df42d698f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:18:49.331600 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d53a7e63-48b2-4c2e-9603-c44df42d698f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0532d211-0e06-47ae-8441-32d2a7b3cdd8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:18:49.340706 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d53a7e63-48b2-4c2e-9603-c44df42d698f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:18:49.341657 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d53a7e63-48b2-4c2e-9603-c44df42d698f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:18:49.342177 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d53a7e63-48b2-4c2e-9603-c44df42d698f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:18:49.343162 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d53a7e63-48b2-4c2e-9603-c44df42d698f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:18:49.344402 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d53a7e63-48b2-4c2e-9603-c44df42d698f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:18:49.345067 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d53a7e63-48b2-4c2e-9603-c44df42d698f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:18:49.432024 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d53a7e63-48b2-4c2e-9603-c44df42d698f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:18:49.440016 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d53a7e63-48b2-4c2e-9603-c44df42d698f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0532d211-0e06-47ae-8441-32d2a7b3cdd8" status: 200 len: 1609 microversion: 2.1 time: 0.112966 Oct 19 04:18:49.441157 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4006/7541] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:18:49 2022] GET /compute/v2.1/servers/0532d211-0e06-47ae-8441-32d2a7b3cdd8 => generated 1609 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:18:49.466315 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-f0dc340f-2462-40a1-bafa-145bf189ae6a req-d0b2fa66-a71e-4ff9-bf2f-36b5c67494fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0532d211-0e06-47ae-8441-32d2a7b3cdd8", "name": "network-vif-deleted", "tag": "a440f107-442f-40fa-b252-0e80e2ceb567"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:18:49.477203 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-f0dc340f-2462-40a1-bafa-145bf189ae6a req-d0b2fa66-a71e-4ff9-bf2f-36b5c67494fd service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:18:49.477732 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-f0dc340f-2462-40a1-bafa-145bf189ae6a req-d0b2fa66-a71e-4ff9-bf2f-36b5c67494fd service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:18:49.478173 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-f0dc340f-2462-40a1-bafa-145bf189ae6a req-d0b2fa66-a71e-4ff9-bf2f-36b5c67494fd service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:18:49.489077 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-f0dc340f-2462-40a1-bafa-145bf189ae6a req-d0b2fa66-a71e-4ff9-bf2f-36b5c67494fd service nova] Creating event network-vif-deleted:a440f107-442f-40fa-b252-0e80e2ceb567 for instance 0532d211-0e06-47ae-8441-32d2a7b3cdd8 on n-h1-861333-8 Oct 19 04:18:49.494288 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-f0dc340f-2462-40a1-bafa-145bf189ae6a req-d0b2fa66-a71e-4ff9-bf2f-36b5c67494fd service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031745 Oct 19 04:18:49.494897 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3536/7542] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:18:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:18:50.464498 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e3565c06-3970-414d-b1e9-636fed176ea6 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:18:50.465138 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e3565c06-3970-414d-b1e9-636fed176ea6 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0532d211-0e06-47ae-8441-32d2a7b3cdd8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:18:50.472754 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e3565c06-3970-414d-b1e9-636fed176ea6 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:18:50.473259 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e3565c06-3970-414d-b1e9-636fed176ea6 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:18:50.473792 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e3565c06-3970-414d-b1e9-636fed176ea6 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:18:50.474518 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e3565c06-3970-414d-b1e9-636fed176ea6 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:18:50.474996 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e3565c06-3970-414d-b1e9-636fed176ea6 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:18:50.475444 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e3565c06-3970-414d-b1e9-636fed176ea6 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:18:50.489583 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-e3565c06-3970-414d-b1e9-636fed176ea6 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] HTTP exception thrown: Instance 0532d211-0e06-47ae-8441-32d2a7b3cdd8 could not be found. Oct 19 04:18:50.494190 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e3565c06-3970-414d-b1e9-636fed176ea6 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Request method failure captured: Oct 19 04:18:50.494190 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/0532d211-0e06-47ae-8441-32d2a7b3cdd8 HTTP/1.1 Oct 19 04:18:50.494190 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 04:18:50.494190 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 04:18:50.494190 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 04:18:50.494190 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 04:18:50.494190 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 04:18:50.494190 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 04:18:50.494190 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 04:18:50.494190 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 04:18:50.494190 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3pS2Cwyyy-dNSAxlLXDbJv718ZCSFb4tsqqjaELCUFVV4hTcgxmjEt9HPf0r6Tip4zea9RCTtHQ0ac2yM_L9WSLCmGFBJhcH41unZ6WfnrAV6EUJNxXeMSOhFFhVbKjU1BMM3_NjFd9xRkGRzGdSLz8_YHyiY2hvcg5UcnlLBsNaKo Oct 19 04:18:50.494190 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 04:18:50.494190 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 04:18:50.494190 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 04:18:50.494190 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 04:18:50.494190 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 04:18:50.494190 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 04:18:50.494190 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 25caabf71e854e4ba4ee627309de481d Oct 19 04:18:50.494190 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ServerActionsTestJSON-130142772 Oct 19 04:18:50.494190 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 04:18:50.494190 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 04:18:50.494190 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/25caabf71e854e4ba4ee627309de481d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/25caabf71e854e4ba4ee627309de481d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/25caabf71e854e4ba4ee627309de481d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_25caabf71e854e4ba4ee627309de481d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 04:18:50.494190 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ServerActionsTestJSON-130142772 Oct 19 04:18:50.494190 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 25caabf71e854e4ba4ee627309de481d Oct 19 04:18:50.494190 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ServerActionsTestJSON-130142772 Oct 19 04:18:50.494190 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ServerActionsTestJSON-130142772-project Oct 19 04:18:50.494190 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 04:18:50.494190 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 04:18:50.494190 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 31018706f7fd45988df04518eee6c044 Oct 19 04:18:50.494190 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ServerActionsTestJSON-130142772-project Oct 19 04:18:50.494190 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 04:18:50.494190 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance 0532d211-0e06-47ae-8441-32d2a7b3cdd8 could not be found. Oct 19 04:18:50.494190 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '0532d211-0e06-47ae-8441-32d2a7b3cdd8'} Oct 19 04:18:50.494190 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 04:18:50.494190 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:18:50.494190 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 04:18:50.494190 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 04:18:50.494190 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 04:18:50.494190 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 04:18:50.494190 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 04:18:50.494190 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 04:18:50.494190 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 04:18:50.494190 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 04:18:50.494190 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0532d211-0e06-47ae-8441-32d2a7b3cdd8 could not be found. Oct 19 04:18:50.494190 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:18:50.494190 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:18:50.494190 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:18:50.494190 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:18:50.494190 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:18:50.494190 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:18:50.494190 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 04:18:50.494190 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 04:18:50.494190 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 04:18:50.494190 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 04:18:50.494190 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 04:18:50.494190 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 04:18:50.494190 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 04:18:50.494190 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 04:18:50.494190 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 04:18:50.494190 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 04:18:50.494190 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0532d211-0e06-47ae-8441-32d2a7b3cdd8 could not be found. Oct 19 04:18:50.494190 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:18:50.494190 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:18:50.494190 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:18:50.498875 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:18:50.498875 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:18:50.498875 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:18:50.498875 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 04:18:50.498875 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 04:18:50.498875 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0532d211-0e06-47ae-8441-32d2a7b3cdd8 could not be found. Oct 19 04:18:50.498875 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:18:50.498875 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e3565c06-3970-414d-b1e9-636fed176ea6 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Returning 404 to user: Instance 0532d211-0e06-47ae-8441-32d2a7b3cdd8 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 04:18:50.498875 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e3565c06-3970-414d-b1e9-636fed176ea6 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0532d211-0e06-47ae-8441-32d2a7b3cdd8" status: 404 len: 111 microversion: 2.1 time: 0.033602 Oct 19 04:18:50.498875 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4007/7543] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:18:50 2022] GET /compute/v2.1/servers/0532d211-0e06-47ae-8441-32d2a7b3cdd8 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 04:18:50.511030 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ae562a8b-46b0-4857-89db-ac549ff5b6a7 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:18:50.516756 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ae562a8b-46b0-4857-89db-ac549ff5b6a7 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0532d211-0e06-47ae-8441-32d2a7b3cdd8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:18:50.519622 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ae562a8b-46b0-4857-89db-ac549ff5b6a7 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:18:50.520127 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ae562a8b-46b0-4857-89db-ac549ff5b6a7 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:18:50.520582 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ae562a8b-46b0-4857-89db-ac549ff5b6a7 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:18:50.521643 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ae562a8b-46b0-4857-89db-ac549ff5b6a7 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:18:50.522112 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ae562a8b-46b0-4857-89db-ac549ff5b6a7 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:18:50.522546 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ae562a8b-46b0-4857-89db-ac549ff5b6a7 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:18:50.537276 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-ae562a8b-46b0-4857-89db-ac549ff5b6a7 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] HTTP exception thrown: Instance 0532d211-0e06-47ae-8441-32d2a7b3cdd8 could not be found. Oct 19 04:18:50.539217 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ae562a8b-46b0-4857-89db-ac549ff5b6a7 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Request method failure captured: Oct 19 04:18:50.539217 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/0532d211-0e06-47ae-8441-32d2a7b3cdd8 HTTP/1.1 Oct 19 04:18:50.539217 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 04:18:50.539217 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 04:18:50.539217 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 04:18:50.539217 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 04:18:50.539217 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 04:18:50.539217 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 04:18:50.539217 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 04:18:50.539217 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 04:18:50.539217 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT3pS2Cwyyy-dNSAxlLXDbJv718ZCSFb4tsqqjaELCUFVV4hTcgxmjEt9HPf0r6Tip4zea9RCTtHQ0ac2yM_L9WSLCmGFBJhcH41unZ6WfnrAV6EUJNxXeMSOhFFhVbKjU1BMM3_NjFd9xRkGRzGdSLz8_YHyiY2hvcg5UcnlLBsNaKo Oct 19 04:18:50.539217 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 04:18:50.539217 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 04:18:50.539217 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 04:18:50.539217 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 04:18:50.539217 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 04:18:50.539217 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 04:18:50.539217 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 25caabf71e854e4ba4ee627309de481d Oct 19 04:18:50.539217 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ServerActionsTestJSON-130142772 Oct 19 04:18:50.539217 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 04:18:50.539217 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 04:18:50.539217 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/25caabf71e854e4ba4ee627309de481d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/25caabf71e854e4ba4ee627309de481d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/25caabf71e854e4ba4ee627309de481d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_25caabf71e854e4ba4ee627309de481d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 04:18:50.539217 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ServerActionsTestJSON-130142772 Oct 19 04:18:50.539217 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 25caabf71e854e4ba4ee627309de481d Oct 19 04:18:50.539217 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ServerActionsTestJSON-130142772 Oct 19 04:18:50.539217 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ServerActionsTestJSON-130142772-project Oct 19 04:18:50.539217 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 04:18:50.539217 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 04:18:50.539217 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 31018706f7fd45988df04518eee6c044 Oct 19 04:18:50.539217 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ServerActionsTestJSON-130142772-project Oct 19 04:18:50.539217 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 04:18:50.539217 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance 0532d211-0e06-47ae-8441-32d2a7b3cdd8 could not be found. Oct 19 04:18:50.539217 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '0532d211-0e06-47ae-8441-32d2a7b3cdd8'} Oct 19 04:18:50.539217 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 04:18:50.539217 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:18:50.539217 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 04:18:50.539217 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 04:18:50.539217 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 04:18:50.539217 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 04:18:50.539217 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 04:18:50.539217 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 04:18:50.539217 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 04:18:50.539217 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 04:18:50.539217 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0532d211-0e06-47ae-8441-32d2a7b3cdd8 could not be found. Oct 19 04:18:50.539217 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:18:50.539217 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:18:50.539217 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:18:50.539217 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:18:50.539217 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:18:50.539217 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:18:50.539217 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 04:18:50.539217 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 04:18:50.539217 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 04:18:50.539217 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 04:18:50.539217 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 04:18:50.539217 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 04:18:50.539217 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 04:18:50.539217 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 04:18:50.539217 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 04:18:50.539217 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 04:18:50.539217 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0532d211-0e06-47ae-8441-32d2a7b3cdd8 could not be found. Oct 19 04:18:50.539217 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:18:50.539217 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:18:50.539217 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:18:50.551264 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:18:50.551264 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:18:50.551264 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:18:50.551264 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 04:18:50.551264 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 04:18:50.551264 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0532d211-0e06-47ae-8441-32d2a7b3cdd8 could not be found. Oct 19 04:18:50.551264 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:18:50.551264 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ae562a8b-46b0-4857-89db-ac549ff5b6a7 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Returning 404 to user: Instance 0532d211-0e06-47ae-8441-32d2a7b3cdd8 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 04:18:50.551264 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ae562a8b-46b0-4857-89db-ac549ff5b6a7 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0532d211-0e06-47ae-8441-32d2a7b3cdd8" status: 404 len: 111 microversion: 2.1 time: 0.033997 Oct 19 04:18:50.551264 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3537/7544] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:18:50 2022] GET /compute/v2.1/servers/0532d211-0e06-47ae-8441-32d2a7b3cdd8 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 04:18:50.590990 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-477cb95e-55e6-4f87-82ac-cc73e327100f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1457677163", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "networks": [{"uuid": "79af36cf-1d2d-4d42-bb0b-1923e8e4f461"}], "security_groups": [{"name": "tempest-securitygroup--1442934117"}], "key_name": "tempest-keypair-2091471087", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:18:50.695022 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-477cb95e-55e6-4f87-82ac-cc73e327100f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] validate_networks() for [('79af36cf-1d2d-4d42-bb0b-1923e8e4f461', None, None, None, None, None)] {{(pid=121134) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 04:18:51.153718 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-477cb95e-55e6-4f87-82ac-cc73e327100f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Flavor limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 04:18:51.154167 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-477cb95e-55e6-4f87-82ac-cc73e327100f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Image limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 04:18:51.154667 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-477cb95e-55e6-4f87-82ac-cc73e327100f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Flavor pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 04:18:51.155099 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-477cb95e-55e6-4f87-82ac-cc73e327100f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Image pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 04:18:51.155537 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-477cb95e-55e6-4f87-82ac-cc73e327100f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 04:18:51.164628 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-477cb95e-55e6-4f87-82ac-cc73e327100f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:18:51.165136 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-477cb95e-55e6-4f87-82ac-cc73e327100f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:18:51.165625 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-477cb95e-55e6-4f87-82ac-cc73e327100f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:18:51.166374 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-477cb95e-55e6-4f87-82ac-cc73e327100f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:18:51.166854 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-477cb95e-55e6-4f87-82ac-cc73e327100f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:18:51.167304 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-477cb95e-55e6-4f87-82ac-cc73e327100f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:18:51.184339 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-477cb95e-55e6-4f87-82ac-cc73e327100f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Getting quotas for project 25caabf71e854e4ba4ee627309de481d. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 04:18:51.190671 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-477cb95e-55e6-4f87-82ac-cc73e327100f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Getting quotas for user 31018706f7fd45988df04518eee6c044 and project 25caabf71e854e4ba4ee627309de481d. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 04:18:51.207071 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-477cb95e-55e6-4f87-82ac-cc73e327100f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Going to run 1 instances... {{(pid=121134) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 04:18:51.209419 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-477cb95e-55e6-4f87-82ac-cc73e327100f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 21f02256-ec3e-445b-a842-96dae939c926] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 04:18:51.331196 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-477cb95e-55e6-4f87-82ac-cc73e327100f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.744061 Oct 19 04:18:51.331897 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4008/7545] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 04:18:50 2022] POST /compute/v2.1/servers => generated 406 bytes in 745 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 04:18:51.344036 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c0427277-f046-4cab-8324-44ed37d68ed9 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:18:51.344668 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c0427277-f046-4cab-8324-44ed37d68ed9 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 21f02256-ec3e-445b-a842-96dae939c926] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:18:51.400354 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c0427277-f046-4cab-8324-44ed37d68ed9 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:18:51.408093 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c0427277-f046-4cab-8324-44ed37d68ed9 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/21f02256-ec3e-445b-a842-96dae939c926" status: 200 len: 1239 microversion: 2.1 time: 0.068452 Oct 19 04:18:51.408678 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3538/7546] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:18:51 2022] GET /compute/v2.1/servers/21f02256-ec3e-445b-a842-96dae939c926 => generated 1239 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:18:52.433067 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3354c5f5-eb0d-4fb2-869a-a5c55130e468 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:18:52.433675 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3354c5f5-eb0d-4fb2-869a-a5c55130e468 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 21f02256-ec3e-445b-a842-96dae939c926] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:18:52.440982 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3354c5f5-eb0d-4fb2-869a-a5c55130e468 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:18:52.441585 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3354c5f5-eb0d-4fb2-869a-a5c55130e468 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:18:52.442045 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3354c5f5-eb0d-4fb2-869a-a5c55130e468 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:18:52.442801 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3354c5f5-eb0d-4fb2-869a-a5c55130e468 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:18:52.443278 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3354c5f5-eb0d-4fb2-869a-a5c55130e468 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:18:52.443724 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3354c5f5-eb0d-4fb2-869a-a5c55130e468 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:18:52.508446 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-3354c5f5-eb0d-4fb2-869a-a5c55130e468 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:18:52.516872 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3354c5f5-eb0d-4fb2-869a-a5c55130e468 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/21f02256-ec3e-445b-a842-96dae939c926" status: 200 len: 1243 microversion: 2.1 time: 0.088753 Oct 19 04:18:52.517468 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4009/7547] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:18:52 2022] GET /compute/v2.1/servers/21f02256-ec3e-445b-a842-96dae939c926 => generated 1243 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:18:53.541277 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6d9e6da2-330a-4f61-a924-58982946c1fa tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:18:53.542343 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6d9e6da2-330a-4f61-a924-58982946c1fa tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 21f02256-ec3e-445b-a842-96dae939c926] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:18:53.550193 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6d9e6da2-330a-4f61-a924-58982946c1fa tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:18:53.550766 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6d9e6da2-330a-4f61-a924-58982946c1fa tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:18:53.551296 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6d9e6da2-330a-4f61-a924-58982946c1fa tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:18:53.552194 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6d9e6da2-330a-4f61-a924-58982946c1fa tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:18:53.552702 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6d9e6da2-330a-4f61-a924-58982946c1fa tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:18:53.553145 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6d9e6da2-330a-4f61-a924-58982946c1fa tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:18:53.654658 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-6d9e6da2-330a-4f61-a924-58982946c1fa tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:18:53.662516 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6d9e6da2-330a-4f61-a924-58982946c1fa tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/21f02256-ec3e-445b-a842-96dae939c926" status: 200 len: 1299 microversion: 2.1 time: 0.125215 Oct 19 04:18:53.663265 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3539/7548] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:18:53 2022] GET /compute/v2.1/servers/21f02256-ec3e-445b-a842-96dae939c926 => generated 1299 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:18:54.686437 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2f85ea79-8c7c-4132-8ab4-da2669c8d2e2 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:18:54.687278 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2f85ea79-8c7c-4132-8ab4-da2669c8d2e2 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 21f02256-ec3e-445b-a842-96dae939c926] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:18:54.694236 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2f85ea79-8c7c-4132-8ab4-da2669c8d2e2 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:18:54.694670 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2f85ea79-8c7c-4132-8ab4-da2669c8d2e2 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:18:54.695161 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2f85ea79-8c7c-4132-8ab4-da2669c8d2e2 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:18:54.696116 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2f85ea79-8c7c-4132-8ab4-da2669c8d2e2 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:18:54.696599 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2f85ea79-8c7c-4132-8ab4-da2669c8d2e2 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:18:54.697044 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2f85ea79-8c7c-4132-8ab4-da2669c8d2e2 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:18:54.912155 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-2f85ea79-8c7c-4132-8ab4-da2669c8d2e2 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:18:54.920056 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2f85ea79-8c7c-4132-8ab4-da2669c8d2e2 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/21f02256-ec3e-445b-a842-96dae939c926" status: 200 len: 1365 microversion: 2.1 time: 0.237634 Oct 19 04:18:54.920632 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4010/7549] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:18:54 2022] GET /compute/v2.1/servers/21f02256-ec3e-445b-a842-96dae939c926 => generated 1365 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:18:55.174825 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-a8e95117-104e-427d-9fab-964794b2cb75 req-d91bd3a2-0fe8-44a1-8120-4095d99272df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21f02256-ec3e-445b-a842-96dae939c926", "tag": "591ce84f-65d8-47ff-98a3-64cbb72d7441"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:18:55.185840 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-a8e95117-104e-427d-9fab-964794b2cb75 req-d91bd3a2-0fe8-44a1-8120-4095d99272df service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:18:55.186398 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-a8e95117-104e-427d-9fab-964794b2cb75 req-d91bd3a2-0fe8-44a1-8120-4095d99272df service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:18:55.186909 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-a8e95117-104e-427d-9fab-964794b2cb75 req-d91bd3a2-0fe8-44a1-8120-4095d99272df service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:18:55.198648 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-a8e95117-104e-427d-9fab-964794b2cb75 req-d91bd3a2-0fe8-44a1-8120-4095d99272df service nova] Creating event network-changed:591ce84f-65d8-47ff-98a3-64cbb72d7441 for instance 21f02256-ec3e-445b-a842-96dae939c926 on n-h2-861333-8 Oct 19 04:18:55.204113 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-a8e95117-104e-427d-9fab-964794b2cb75 req-d91bd3a2-0fe8-44a1-8120-4095d99272df service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033348 Oct 19 04:18:55.204811 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3540/7550] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:18:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:18:55.946462 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4c0a234f-8e9b-4f7b-b258-0f00dc55399c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:18:55.947165 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4c0a234f-8e9b-4f7b-b258-0f00dc55399c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 21f02256-ec3e-445b-a842-96dae939c926] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:18:55.955109 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4c0a234f-8e9b-4f7b-b258-0f00dc55399c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:18:55.955635 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4c0a234f-8e9b-4f7b-b258-0f00dc55399c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:18:55.956186 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4c0a234f-8e9b-4f7b-b258-0f00dc55399c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:18:55.956903 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4c0a234f-8e9b-4f7b-b258-0f00dc55399c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:18:55.957483 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4c0a234f-8e9b-4f7b-b258-0f00dc55399c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:18:55.957994 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4c0a234f-8e9b-4f7b-b258-0f00dc55399c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:18:56.095668 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-4c0a234f-8e9b-4f7b-b258-0f00dc55399c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:18:56.103454 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4c0a234f-8e9b-4f7b-b258-0f00dc55399c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/21f02256-ec3e-445b-a842-96dae939c926" status: 200 len: 1365 microversion: 2.1 time: 0.163044 Oct 19 04:18:56.104025 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4011/7551] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:18:55 2022] GET /compute/v2.1/servers/21f02256-ec3e-445b-a842-96dae939c926 => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:18:57.128433 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e89f7fc1-0bcb-4c71-be4c-d9e2ac2d32c5 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:18:57.129204 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e89f7fc1-0bcb-4c71-be4c-d9e2ac2d32c5 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 21f02256-ec3e-445b-a842-96dae939c926] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:18:57.135436 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e89f7fc1-0bcb-4c71-be4c-d9e2ac2d32c5 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:18:57.135933 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e89f7fc1-0bcb-4c71-be4c-d9e2ac2d32c5 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:18:57.136391 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e89f7fc1-0bcb-4c71-be4c-d9e2ac2d32c5 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:18:57.137091 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e89f7fc1-0bcb-4c71-be4c-d9e2ac2d32c5 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:18:57.137605 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e89f7fc1-0bcb-4c71-be4c-d9e2ac2d32c5 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:18:57.138044 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e89f7fc1-0bcb-4c71-be4c-d9e2ac2d32c5 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:18:57.266177 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-e89f7fc1-0bcb-4c71-be4c-d9e2ac2d32c5 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:18:57.274165 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e89f7fc1-0bcb-4c71-be4c-d9e2ac2d32c5 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/21f02256-ec3e-445b-a842-96dae939c926" status: 200 len: 1365 microversion: 2.1 time: 0.150943 Oct 19 04:18:57.274748 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3541/7552] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:18:57 2022] GET /compute/v2.1/servers/21f02256-ec3e-445b-a842-96dae939c926 => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:18:58.298027 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-34f0cda0-2dee-41ef-b4a8-b03bab9cc200 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:18:58.298655 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-34f0cda0-2dee-41ef-b4a8-b03bab9cc200 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 21f02256-ec3e-445b-a842-96dae939c926] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:18:58.305556 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-34f0cda0-2dee-41ef-b4a8-b03bab9cc200 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:18:58.306080 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-34f0cda0-2dee-41ef-b4a8-b03bab9cc200 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:18:58.306528 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-34f0cda0-2dee-41ef-b4a8-b03bab9cc200 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:18:58.307228 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-34f0cda0-2dee-41ef-b4a8-b03bab9cc200 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:18:58.307696 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-34f0cda0-2dee-41ef-b4a8-b03bab9cc200 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:18:58.308137 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-34f0cda0-2dee-41ef-b4a8-b03bab9cc200 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:18:58.439766 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-34f0cda0-2dee-41ef-b4a8-b03bab9cc200 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:18:58.447569 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-34f0cda0-2dee-41ef-b4a8-b03bab9cc200 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/21f02256-ec3e-445b-a842-96dae939c926" status: 200 len: 1365 microversion: 2.1 time: 0.154160 Oct 19 04:18:58.451572 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4012/7553] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:18:58 2022] GET /compute/v2.1/servers/21f02256-ec3e-445b-a842-96dae939c926 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:18:59.471201 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0600cfa6-cf6f-44de-b812-7b4e670560a9 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:18:59.471823 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0600cfa6-cf6f-44de-b812-7b4e670560a9 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 21f02256-ec3e-445b-a842-96dae939c926] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:18:59.478674 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0600cfa6-cf6f-44de-b812-7b4e670560a9 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:18:59.479168 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0600cfa6-cf6f-44de-b812-7b4e670560a9 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:18:59.479659 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0600cfa6-cf6f-44de-b812-7b4e670560a9 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:18:59.480371 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0600cfa6-cf6f-44de-b812-7b4e670560a9 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:18:59.480838 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0600cfa6-cf6f-44de-b812-7b4e670560a9 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:18:59.481271 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0600cfa6-cf6f-44de-b812-7b4e670560a9 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:18:59.616859 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-0600cfa6-cf6f-44de-b812-7b4e670560a9 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:18:59.624939 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0600cfa6-cf6f-44de-b812-7b4e670560a9 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/21f02256-ec3e-445b-a842-96dae939c926" status: 200 len: 1365 microversion: 2.1 time: 0.157696 Oct 19 04:18:59.626350 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3542/7554] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:18:59 2022] GET /compute/v2.1/servers/21f02256-ec3e-445b-a842-96dae939c926 => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:19:00.648636 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f38ae9db-04b0-48b8-af57-da3f19eaff8e tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:19:00.649272 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f38ae9db-04b0-48b8-af57-da3f19eaff8e tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 21f02256-ec3e-445b-a842-96dae939c926] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:19:00.655641 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f38ae9db-04b0-48b8-af57-da3f19eaff8e tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:19:00.656156 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f38ae9db-04b0-48b8-af57-da3f19eaff8e tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:19:00.656617 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f38ae9db-04b0-48b8-af57-da3f19eaff8e tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:19:00.657337 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f38ae9db-04b0-48b8-af57-da3f19eaff8e tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:19:00.657842 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f38ae9db-04b0-48b8-af57-da3f19eaff8e tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:19:00.658288 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f38ae9db-04b0-48b8-af57-da3f19eaff8e tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:19:00.787989 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-f38ae9db-04b0-48b8-af57-da3f19eaff8e tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:19:00.795750 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f38ae9db-04b0-48b8-af57-da3f19eaff8e tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/21f02256-ec3e-445b-a842-96dae939c926" status: 200 len: 1365 microversion: 2.1 time: 0.151582 Oct 19 04:19:00.796840 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4013/7555] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:19:00 2022] GET /compute/v2.1/servers/21f02256-ec3e-445b-a842-96dae939c926 => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:19:01.157311 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-c051439b-b1e5-4263-a39c-20f51036f3ac req-6f059dc9-b513-47c2-9413-c7e0fd180278 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21f02256-ec3e-445b-a842-96dae939c926", "name": "network-vif-plugged", "status": "completed", "tag": "591ce84f-65d8-47ff-98a3-64cbb72d7441"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:19:01.167621 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-c051439b-b1e5-4263-a39c-20f51036f3ac req-6f059dc9-b513-47c2-9413-c7e0fd180278 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:19:01.168130 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-c051439b-b1e5-4263-a39c-20f51036f3ac req-6f059dc9-b513-47c2-9413-c7e0fd180278 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:19:01.168799 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-c051439b-b1e5-4263-a39c-20f51036f3ac req-6f059dc9-b513-47c2-9413-c7e0fd180278 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:19:01.183136 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-c051439b-b1e5-4263-a39c-20f51036f3ac req-6f059dc9-b513-47c2-9413-c7e0fd180278 service nova] Creating event network-vif-plugged:591ce84f-65d8-47ff-98a3-64cbb72d7441 for instance 21f02256-ec3e-445b-a842-96dae939c926 on n-h2-861333-8 Oct 19 04:19:01.188169 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-c051439b-b1e5-4263-a39c-20f51036f3ac req-6f059dc9-b513-47c2-9413-c7e0fd180278 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035235 Oct 19 04:19:01.188770 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3543/7556] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:19:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:19:01.820833 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-76016449-0290-4c69-8360-d75fe9355360 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:19:01.821464 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-76016449-0290-4c69-8360-d75fe9355360 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 21f02256-ec3e-445b-a842-96dae939c926] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:19:01.823273 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:19:01.823958 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=6 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:19:01.830182 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-76016449-0290-4c69-8360-d75fe9355360 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:19:01.836473 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-76016449-0290-4c69-8360-d75fe9355360 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:19:01.836473 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-76016449-0290-4c69-8360-d75fe9355360 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:19:01.836473 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-76016449-0290-4c69-8360-d75fe9355360 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:19:01.836473 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-76016449-0290-4c69-8360-d75fe9355360 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:19:01.836473 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-76016449-0290-4c69-8360-d75fe9355360 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:19:01.963173 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-76016449-0290-4c69-8360-d75fe9355360 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:19:01.970990 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-76016449-0290-4c69-8360-d75fe9355360 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/21f02256-ec3e-445b-a842-96dae939c926" status: 200 len: 1365 microversion: 2.1 time: 0.154116 Oct 19 04:19:01.971575 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4014/7557] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:19:01 2022] GET /compute/v2.1/servers/21f02256-ec3e-445b-a842-96dae939c926 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:19:02.990609 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:19:02.995607 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6ecb5180-c72a-4317-9f18-03830c16bc8b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:19:02.996285 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6ecb5180-c72a-4317-9f18-03830c16bc8b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 21f02256-ec3e-445b-a842-96dae939c926] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:19:03.002991 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6ecb5180-c72a-4317-9f18-03830c16bc8b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:19:03.003475 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6ecb5180-c72a-4317-9f18-03830c16bc8b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:19:03.003912 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6ecb5180-c72a-4317-9f18-03830c16bc8b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:19:03.004604 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6ecb5180-c72a-4317-9f18-03830c16bc8b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:19:03.005059 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6ecb5180-c72a-4317-9f18-03830c16bc8b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:19:03.005510 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6ecb5180-c72a-4317-9f18-03830c16bc8b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:19:03.132802 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-6ecb5180-c72a-4317-9f18-03830c16bc8b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:19:03.140574 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6ecb5180-c72a-4317-9f18-03830c16bc8b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/21f02256-ec3e-445b-a842-96dae939c926" status: 200 len: 1551 microversion: 2.1 time: 0.150905 Oct 19 04:19:03.141149 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3544/7558] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:19:02 2022] GET /compute/v2.1/servers/21f02256-ec3e-445b-a842-96dae939c926 => generated 1551 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:19:03.163490 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-578a4dee-3bdd-48cc-bf48-43aede76362c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:19:03.163995 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-578a4dee-3bdd-48cc-bf48-43aede76362c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 21f02256-ec3e-445b-a842-96dae939c926] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:19:03.170883 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-578a4dee-3bdd-48cc-bf48-43aede76362c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:19:03.171832 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-578a4dee-3bdd-48cc-bf48-43aede76362c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:19:03.172293 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-578a4dee-3bdd-48cc-bf48-43aede76362c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:19:03.172998 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-578a4dee-3bdd-48cc-bf48-43aede76362c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:19:03.173543 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-578a4dee-3bdd-48cc-bf48-43aede76362c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:19:03.173989 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-578a4dee-3bdd-48cc-bf48-43aede76362c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:19:03.253803 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-578a4dee-3bdd-48cc-bf48-43aede76362c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/21f02256-ec3e-445b-a842-96dae939c926/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094182 Oct 19 04:19:03.254411 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4015/7559] 10.222.0.52 () {58 vars in 1275 bytes} [Wed Oct 19 04:19:03 2022] GET /compute/v2.1/servers/21f02256-ec3e-445b-a842-96dae939c926/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:19:04.594883 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-adde44d1-9a38-4b69-a308-630cfa389744 req-44fd9f19-d14c-4114-8096-0dbc92cabfea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21f02256-ec3e-445b-a842-96dae939c926", "tag": "591ce84f-65d8-47ff-98a3-64cbb72d7441"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:19:04.605783 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-adde44d1-9a38-4b69-a308-630cfa389744 req-44fd9f19-d14c-4114-8096-0dbc92cabfea service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:19:04.606354 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-adde44d1-9a38-4b69-a308-630cfa389744 req-44fd9f19-d14c-4114-8096-0dbc92cabfea service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:19:04.606888 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-adde44d1-9a38-4b69-a308-630cfa389744 req-44fd9f19-d14c-4114-8096-0dbc92cabfea service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:19:04.618064 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-adde44d1-9a38-4b69-a308-630cfa389744 req-44fd9f19-d14c-4114-8096-0dbc92cabfea service nova] Creating event network-changed:591ce84f-65d8-47ff-98a3-64cbb72d7441 for instance 21f02256-ec3e-445b-a842-96dae939c926 on n-h2-861333-8 Oct 19 04:19:04.623097 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-adde44d1-9a38-4b69-a308-630cfa389744 req-44fd9f19-d14c-4114-8096-0dbc92cabfea service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032484 Oct 19 04:19:04.623792 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3545/7560] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:19:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:19:39.775682 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:19:39.776471 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=73,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:19:39.780458 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2560ab1b-ec2d-41ba-bf95-9ea84b80cdc9 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:19:39.786350 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2560ab1b-ec2d-41ba-bf95-9ea84b80cdc9 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:19:39.788434 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2560ab1b-ec2d-41ba-bf95-9ea84b80cdc9 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:19:39.788434 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2560ab1b-ec2d-41ba-bf95-9ea84b80cdc9 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:19:39.810067 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2560ab1b-ec2d-41ba-bf95-9ea84b80cdc9 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 21f02256-ec3e-445b-a842-96dae939c926] Going to try to stop instance {{(pid=121134) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 19 04:19:39.994314 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2560ab1b-ec2d-41ba-bf95-9ea84b80cdc9 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "POST /compute/v2.1/servers/21f02256-ec3e-445b-a842-96dae939c926/action" status: 202 len: 0 microversion: 2.1 time: 0.220941 Oct 19 04:19:39.994943 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4016/7561] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 04:19:39 2022] POST /compute/v2.1/servers/21f02256-ec3e-445b-a842-96dae939c926/action => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 04:19:40.002483 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:19:40.003295 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:19:40.007597 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ad2fa0ff-bdf5-433f-bf19-bdb37c4fa473 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:19:40.008563 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ad2fa0ff-bdf5-433f-bf19-bdb37c4fa473 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 21f02256-ec3e-445b-a842-96dae939c926] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:19:40.014451 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ad2fa0ff-bdf5-433f-bf19-bdb37c4fa473 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:19:40.014946 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ad2fa0ff-bdf5-433f-bf19-bdb37c4fa473 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:19:40.015397 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ad2fa0ff-bdf5-433f-bf19-bdb37c4fa473 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:19:40.016103 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ad2fa0ff-bdf5-433f-bf19-bdb37c4fa473 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:19:40.016566 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ad2fa0ff-bdf5-433f-bf19-bdb37c4fa473 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:19:40.017004 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ad2fa0ff-bdf5-433f-bf19-bdb37c4fa473 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:19:40.147422 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ad2fa0ff-bdf5-433f-bf19-bdb37c4fa473 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:19:40.155214 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ad2fa0ff-bdf5-433f-bf19-bdb37c4fa473 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/21f02256-ec3e-445b-a842-96dae939c926" status: 200 len: 1680 microversion: 2.1 time: 0.155839 Oct 19 04:19:40.155791 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3546/7562] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:19:39 2022] GET /compute/v2.1/servers/21f02256-ec3e-445b-a842-96dae939c926 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:19:41.181028 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-dc608b1e-b963-4ea6-b5ab-7076a8e12ad5 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:19:41.181798 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-dc608b1e-b963-4ea6-b5ab-7076a8e12ad5 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 21f02256-ec3e-445b-a842-96dae939c926] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:19:41.188436 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dc608b1e-b963-4ea6-b5ab-7076a8e12ad5 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:19:41.188941 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dc608b1e-b963-4ea6-b5ab-7076a8e12ad5 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:19:41.189423 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dc608b1e-b963-4ea6-b5ab-7076a8e12ad5 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:19:41.190754 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dc608b1e-b963-4ea6-b5ab-7076a8e12ad5 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:19:41.191227 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dc608b1e-b963-4ea6-b5ab-7076a8e12ad5 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:19:41.191674 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dc608b1e-b963-4ea6-b5ab-7076a8e12ad5 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:19:41.320049 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-dc608b1e-b963-4ea6-b5ab-7076a8e12ad5 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:19:41.327921 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-dc608b1e-b963-4ea6-b5ab-7076a8e12ad5 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/21f02256-ec3e-445b-a842-96dae939c926" status: 200 len: 1680 microversion: 2.1 time: 0.152065 Oct 19 04:19:41.328508 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4017/7563] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:19:41 2022] GET /compute/v2.1/servers/21f02256-ec3e-445b-a842-96dae939c926 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:19:42.352041 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-830fd87d-fc14-4f6b-b2dd-fc4327ccc856 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:19:42.352671 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-830fd87d-fc14-4f6b-b2dd-fc4327ccc856 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 21f02256-ec3e-445b-a842-96dae939c926] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:19:42.360664 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-830fd87d-fc14-4f6b-b2dd-fc4327ccc856 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:19:42.361157 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-830fd87d-fc14-4f6b-b2dd-fc4327ccc856 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:19:42.361643 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-830fd87d-fc14-4f6b-b2dd-fc4327ccc856 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:19:42.362343 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-830fd87d-fc14-4f6b-b2dd-fc4327ccc856 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:19:42.362806 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-830fd87d-fc14-4f6b-b2dd-fc4327ccc856 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:19:42.363293 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-830fd87d-fc14-4f6b-b2dd-fc4327ccc856 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:19:42.497560 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-830fd87d-fc14-4f6b-b2dd-fc4327ccc856 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:19:42.505810 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-830fd87d-fc14-4f6b-b2dd-fc4327ccc856 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/21f02256-ec3e-445b-a842-96dae939c926" status: 200 len: 1680 microversion: 2.1 time: 0.158018 Oct 19 04:19:42.506379 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3547/7564] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:19:42 2022] GET /compute/v2.1/servers/21f02256-ec3e-445b-a842-96dae939c926 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:19:43.529878 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-acae0a3c-34da-4a4a-b518-61199d0e3024 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:19:43.530520 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-acae0a3c-34da-4a4a-b518-61199d0e3024 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 21f02256-ec3e-445b-a842-96dae939c926] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:19:43.537977 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-acae0a3c-34da-4a4a-b518-61199d0e3024 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:19:43.538481 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-acae0a3c-34da-4a4a-b518-61199d0e3024 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:19:43.538937 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-acae0a3c-34da-4a4a-b518-61199d0e3024 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:19:43.539647 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-acae0a3c-34da-4a4a-b518-61199d0e3024 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:19:43.540118 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-acae0a3c-34da-4a4a-b518-61199d0e3024 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:19:43.540572 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-acae0a3c-34da-4a4a-b518-61199d0e3024 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:19:43.666279 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-acae0a3c-34da-4a4a-b518-61199d0e3024 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:19:43.674191 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-acae0a3c-34da-4a4a-b518-61199d0e3024 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/21f02256-ec3e-445b-a842-96dae939c926" status: 200 len: 1680 microversion: 2.1 time: 0.148232 Oct 19 04:19:43.674769 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4018/7565] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:19:43 2022] GET /compute/v2.1/servers/21f02256-ec3e-445b-a842-96dae939c926 => generated 1680 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:19:44.697575 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-74be89ad-4721-4244-9a75-e466da42379c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:19:44.698195 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-74be89ad-4721-4244-9a75-e466da42379c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 21f02256-ec3e-445b-a842-96dae939c926] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:19:44.704951 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-74be89ad-4721-4244-9a75-e466da42379c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:19:44.705470 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-74be89ad-4721-4244-9a75-e466da42379c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:19:44.705913 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-74be89ad-4721-4244-9a75-e466da42379c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:19:44.706599 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-74be89ad-4721-4244-9a75-e466da42379c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:19:44.707053 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-74be89ad-4721-4244-9a75-e466da42379c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:19:44.707508 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-74be89ad-4721-4244-9a75-e466da42379c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:19:44.841209 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-74be89ad-4721-4244-9a75-e466da42379c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:19:44.849710 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-74be89ad-4721-4244-9a75-e466da42379c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/21f02256-ec3e-445b-a842-96dae939c926" status: 200 len: 1680 microversion: 2.1 time: 0.156109 Oct 19 04:19:44.850287 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3548/7566] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:19:44 2022] GET /compute/v2.1/servers/21f02256-ec3e-445b-a842-96dae939c926 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:19:45.873890 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c5b255c6-8ea5-488b-92c8-3abf5a2b611b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:19:45.874514 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c5b255c6-8ea5-488b-92c8-3abf5a2b611b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 21f02256-ec3e-445b-a842-96dae939c926] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:19:45.881508 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c5b255c6-8ea5-488b-92c8-3abf5a2b611b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:19:45.882005 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c5b255c6-8ea5-488b-92c8-3abf5a2b611b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:19:45.882459 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c5b255c6-8ea5-488b-92c8-3abf5a2b611b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:19:45.883162 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c5b255c6-8ea5-488b-92c8-3abf5a2b611b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:19:45.883628 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c5b255c6-8ea5-488b-92c8-3abf5a2b611b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:19:45.884069 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c5b255c6-8ea5-488b-92c8-3abf5a2b611b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:19:46.013873 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c5b255c6-8ea5-488b-92c8-3abf5a2b611b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:19:46.022479 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c5b255c6-8ea5-488b-92c8-3abf5a2b611b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/21f02256-ec3e-445b-a842-96dae939c926" status: 200 len: 1680 microversion: 2.1 time: 0.152489 Oct 19 04:19:46.023060 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4019/7567] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:19:45 2022] GET /compute/v2.1/servers/21f02256-ec3e-445b-a842-96dae939c926 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:19:47.044904 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f5749e55-9491-4661-898a-a741753068d6 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:19:47.045552 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f5749e55-9491-4661-898a-a741753068d6 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 21f02256-ec3e-445b-a842-96dae939c926] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:19:47.053043 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f5749e55-9491-4661-898a-a741753068d6 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:19:47.053584 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f5749e55-9491-4661-898a-a741753068d6 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:19:47.054035 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f5749e55-9491-4661-898a-a741753068d6 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:19:47.054741 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f5749e55-9491-4661-898a-a741753068d6 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:19:47.055204 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f5749e55-9491-4661-898a-a741753068d6 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:19:47.055640 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f5749e55-9491-4661-898a-a741753068d6 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:19:47.182136 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f5749e55-9491-4661-898a-a741753068d6 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:19:47.189942 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f5749e55-9491-4661-898a-a741753068d6 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/21f02256-ec3e-445b-a842-96dae939c926" status: 200 len: 1680 microversion: 2.1 time: 0.148948 Oct 19 04:19:47.190520 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3549/7568] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:19:47 2022] GET /compute/v2.1/servers/21f02256-ec3e-445b-a842-96dae939c926 => generated 1680 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:19:48.213263 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7f22f41f-c0cf-4a40-a800-84636dd62c65 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:19:48.213936 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7f22f41f-c0cf-4a40-a800-84636dd62c65 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 21f02256-ec3e-445b-a842-96dae939c926] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:19:48.221227 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7f22f41f-c0cf-4a40-a800-84636dd62c65 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:19:48.221768 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7f22f41f-c0cf-4a40-a800-84636dd62c65 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:19:48.222228 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7f22f41f-c0cf-4a40-a800-84636dd62c65 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:19:48.222938 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7f22f41f-c0cf-4a40-a800-84636dd62c65 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:19:48.223414 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7f22f41f-c0cf-4a40-a800-84636dd62c65 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:19:48.223864 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7f22f41f-c0cf-4a40-a800-84636dd62c65 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:19:48.354308 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-7f22f41f-c0cf-4a40-a800-84636dd62c65 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:19:48.362620 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7f22f41f-c0cf-4a40-a800-84636dd62c65 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/21f02256-ec3e-445b-a842-96dae939c926" status: 200 len: 1680 microversion: 2.1 time: 0.153241 Oct 19 04:19:48.363201 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4020/7569] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:19:48 2022] GET /compute/v2.1/servers/21f02256-ec3e-445b-a842-96dae939c926 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:19:49.386288 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6795819b-6a9d-4e04-a82a-b6fc101d921f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:19:49.386946 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6795819b-6a9d-4e04-a82a-b6fc101d921f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 21f02256-ec3e-445b-a842-96dae939c926] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:19:49.393905 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6795819b-6a9d-4e04-a82a-b6fc101d921f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:19:49.400076 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6795819b-6a9d-4e04-a82a-b6fc101d921f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:19:49.400076 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6795819b-6a9d-4e04-a82a-b6fc101d921f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:19:49.400076 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6795819b-6a9d-4e04-a82a-b6fc101d921f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:19:49.400076 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6795819b-6a9d-4e04-a82a-b6fc101d921f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:19:49.400076 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6795819b-6a9d-4e04-a82a-b6fc101d921f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:19:49.528448 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-6795819b-6a9d-4e04-a82a-b6fc101d921f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:19:49.536245 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6795819b-6a9d-4e04-a82a-b6fc101d921f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/21f02256-ec3e-445b-a842-96dae939c926" status: 200 len: 1680 microversion: 2.1 time: 0.154014 Oct 19 04:19:49.536843 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3550/7570] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:19:49 2022] GET /compute/v2.1/servers/21f02256-ec3e-445b-a842-96dae939c926 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:19:50.560092 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f5fdc5da-f464-48d3-aa78-7b065e831981 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:19:50.560723 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f5fdc5da-f464-48d3-aa78-7b065e831981 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 21f02256-ec3e-445b-a842-96dae939c926] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:19:50.568764 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f5fdc5da-f464-48d3-aa78-7b065e831981 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:19:50.569278 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f5fdc5da-f464-48d3-aa78-7b065e831981 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:19:50.569803 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f5fdc5da-f464-48d3-aa78-7b065e831981 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:19:50.570534 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f5fdc5da-f464-48d3-aa78-7b065e831981 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:19:50.571012 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f5fdc5da-f464-48d3-aa78-7b065e831981 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:19:50.571465 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f5fdc5da-f464-48d3-aa78-7b065e831981 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:19:50.706221 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-f5fdc5da-f464-48d3-aa78-7b065e831981 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:19:50.714044 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f5fdc5da-f464-48d3-aa78-7b065e831981 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/21f02256-ec3e-445b-a842-96dae939c926" status: 200 len: 1657 microversion: 2.1 time: 0.157856 Oct 19 04:19:50.714631 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4021/7571] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:19:50 2022] GET /compute/v2.1/servers/21f02256-ec3e-445b-a842-96dae939c926 => generated 1657 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:19:50.737256 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2787ca59-3451-46aa-a46b-8d13c01b1148 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:19:50.739665 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-2787ca59-3451-46aa-a46b-8d13c01b1148 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 21f02256-ec3e-445b-a842-96dae939c926] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:19:50.746588 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2787ca59-3451-46aa-a46b-8d13c01b1148 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:19:50.747078 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2787ca59-3451-46aa-a46b-8d13c01b1148 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:19:50.747514 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2787ca59-3451-46aa-a46b-8d13c01b1148 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:19:50.748239 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2787ca59-3451-46aa-a46b-8d13c01b1148 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:19:50.748690 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2787ca59-3451-46aa-a46b-8d13c01b1148 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:19:50.749120 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2787ca59-3451-46aa-a46b-8d13c01b1148 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:19:50.779861 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-2787ca59-3451-46aa-a46b-8d13c01b1148 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:19:50.785308 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-2787ca59-3451-46aa-a46b-8d13c01b1148 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 21f02256-ec3e-445b-a842-96dae939c926] Old instance type m1.heat2, new instance type m1.heat {{(pid=121135) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 19 04:19:50.791742 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-2787ca59-3451-46aa-a46b-8d13c01b1148 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Flavor limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 04:19:50.792165 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-2787ca59-3451-46aa-a46b-8d13c01b1148 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Image limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 04:19:50.792637 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-2787ca59-3451-46aa-a46b-8d13c01b1148 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Flavor pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 04:19:50.793050 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-2787ca59-3451-46aa-a46b-8d13c01b1148 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Image pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 04:19:50.793494 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-2787ca59-3451-46aa-a46b-8d13c01b1148 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 04:19:50.962110 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2787ca59-3451-46aa-a46b-8d13c01b1148 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "POST /compute/v2.1/servers/21f02256-ec3e-445b-a842-96dae939c926/action" status: 202 len: 0 microversion: 2.1 time: 0.228748 Oct 19 04:19:50.962739 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3551/7572] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 04:19:50 2022] POST /compute/v2.1/servers/21f02256-ec3e-445b-a842-96dae939c926/action => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 04:19:50.970969 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4c59973f-574a-4e7f-8032-80c7ba3d8b41 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:19:50.971885 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4c59973f-574a-4e7f-8032-80c7ba3d8b41 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 21f02256-ec3e-445b-a842-96dae939c926] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:19:50.978837 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4c59973f-574a-4e7f-8032-80c7ba3d8b41 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:19:50.978837 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4c59973f-574a-4e7f-8032-80c7ba3d8b41 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:19:50.979199 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4c59973f-574a-4e7f-8032-80c7ba3d8b41 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:19:50.979913 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4c59973f-574a-4e7f-8032-80c7ba3d8b41 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:19:50.980381 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4c59973f-574a-4e7f-8032-80c7ba3d8b41 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:19:50.980823 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4c59973f-574a-4e7f-8032-80c7ba3d8b41 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:19:51.113285 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-4c59973f-574a-4e7f-8032-80c7ba3d8b41 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:19:51.121042 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4c59973f-574a-4e7f-8032-80c7ba3d8b41 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/21f02256-ec3e-445b-a842-96dae939c926" status: 200 len: 1680 microversion: 2.1 time: 0.154068 Oct 19 04:19:51.127908 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4022/7573] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:19:50 2022] GET /compute/v2.1/servers/21f02256-ec3e-445b-a842-96dae939c926 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:19:52.144870 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-bf151229-4c5b-4016-8166-4a73236ca1ae tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:19:52.145529 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-bf151229-4c5b-4016-8166-4a73236ca1ae tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 21f02256-ec3e-445b-a842-96dae939c926] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:19:52.161035 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bf151229-4c5b-4016-8166-4a73236ca1ae tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:19:52.161035 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bf151229-4c5b-4016-8166-4a73236ca1ae tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:19:52.161035 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bf151229-4c5b-4016-8166-4a73236ca1ae tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:19:52.161035 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bf151229-4c5b-4016-8166-4a73236ca1ae tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:19:52.161035 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bf151229-4c5b-4016-8166-4a73236ca1ae tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:19:52.161035 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bf151229-4c5b-4016-8166-4a73236ca1ae tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:19:52.287449 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-bf151229-4c5b-4016-8166-4a73236ca1ae tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:19:52.295366 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-bf151229-4c5b-4016-8166-4a73236ca1ae tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/21f02256-ec3e-445b-a842-96dae939c926" status: 200 len: 1680 microversion: 2.1 time: 0.155117 Oct 19 04:19:52.295946 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3552/7574] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:19:52 2022] GET /compute/v2.1/servers/21f02256-ec3e-445b-a842-96dae939c926 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:19:53.317768 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d0a131b9-9a36-4b3b-bd0e-c0497f525a68 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:19:53.318322 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d0a131b9-9a36-4b3b-bd0e-c0497f525a68 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 21f02256-ec3e-445b-a842-96dae939c926] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:19:53.325165 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d0a131b9-9a36-4b3b-bd0e-c0497f525a68 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:19:53.325703 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d0a131b9-9a36-4b3b-bd0e-c0497f525a68 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:19:53.326167 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d0a131b9-9a36-4b3b-bd0e-c0497f525a68 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:19:53.326868 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d0a131b9-9a36-4b3b-bd0e-c0497f525a68 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:19:53.327342 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d0a131b9-9a36-4b3b-bd0e-c0497f525a68 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:19:53.327789 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d0a131b9-9a36-4b3b-bd0e-c0497f525a68 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:19:53.491143 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d0a131b9-9a36-4b3b-bd0e-c0497f525a68 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:19:53.498923 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d0a131b9-9a36-4b3b-bd0e-c0497f525a68 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/21f02256-ec3e-445b-a842-96dae939c926" status: 200 len: 1680 microversion: 2.1 time: 0.185172 Oct 19 04:19:53.499511 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4023/7575] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:19:53 2022] GET /compute/v2.1/servers/21f02256-ec3e-445b-a842-96dae939c926 => generated 1680 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:19:54.522891 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-05e2d203-6c9f-4c45-8ef4-aaf8ec65996f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:19:54.523487 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-05e2d203-6c9f-4c45-8ef4-aaf8ec65996f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 21f02256-ec3e-445b-a842-96dae939c926] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:19:54.530371 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-05e2d203-6c9f-4c45-8ef4-aaf8ec65996f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:19:54.530869 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-05e2d203-6c9f-4c45-8ef4-aaf8ec65996f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:19:54.531320 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-05e2d203-6c9f-4c45-8ef4-aaf8ec65996f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:19:54.532026 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-05e2d203-6c9f-4c45-8ef4-aaf8ec65996f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:19:54.532491 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-05e2d203-6c9f-4c45-8ef4-aaf8ec65996f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:19:54.532925 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-05e2d203-6c9f-4c45-8ef4-aaf8ec65996f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:19:54.666085 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-05e2d203-6c9f-4c45-8ef4-aaf8ec65996f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:19:54.673883 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-05e2d203-6c9f-4c45-8ef4-aaf8ec65996f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/21f02256-ec3e-445b-a842-96dae939c926" status: 200 len: 1685 microversion: 2.1 time: 0.155235 Oct 19 04:19:54.674466 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3553/7576] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:19:54 2022] GET /compute/v2.1/servers/21f02256-ec3e-445b-a842-96dae939c926 => generated 1685 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:19:55.698000 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c36f2b6a-a79e-4282-8ead-109fbbd10434 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:19:55.698632 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c36f2b6a-a79e-4282-8ead-109fbbd10434 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 21f02256-ec3e-445b-a842-96dae939c926] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:19:55.705619 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c36f2b6a-a79e-4282-8ead-109fbbd10434 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:19:55.706126 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c36f2b6a-a79e-4282-8ead-109fbbd10434 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:19:55.706582 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c36f2b6a-a79e-4282-8ead-109fbbd10434 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:19:55.707296 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c36f2b6a-a79e-4282-8ead-109fbbd10434 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:19:55.707774 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c36f2b6a-a79e-4282-8ead-109fbbd10434 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:19:55.708218 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c36f2b6a-a79e-4282-8ead-109fbbd10434 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:19:55.841871 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c36f2b6a-a79e-4282-8ead-109fbbd10434 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:19:55.852958 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c36f2b6a-a79e-4282-8ead-109fbbd10434 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/21f02256-ec3e-445b-a842-96dae939c926" status: 200 len: 1685 microversion: 2.1 time: 0.156918 Oct 19 04:19:55.852958 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4024/7577] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:19:55 2022] GET /compute/v2.1/servers/21f02256-ec3e-445b-a842-96dae939c926 => generated 1685 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:19:56.877920 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-da403e3f-0333-404f-8fc4-2bce6faf514a tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:19:56.879545 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-da403e3f-0333-404f-8fc4-2bce6faf514a tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 21f02256-ec3e-445b-a842-96dae939c926] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:19:56.885407 n-d-861333-8 devstack@n-api.service[121135]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 04:19:56.885569 n-d-861333-8 devstack@n-api.service[121135]: Wed Oct 19 04:19:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/21f02256-ec3e-445b-a842-96dae939c926 (ip 10.222.0.52) !!! Oct 19 04:19:56.888237 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-da403e3f-0333-404f-8fc4-2bce6faf514a tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:19:56.888739 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-da403e3f-0333-404f-8fc4-2bce6faf514a tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:19:56.889209 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-da403e3f-0333-404f-8fc4-2bce6faf514a tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:19:56.889941 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-da403e3f-0333-404f-8fc4-2bce6faf514a tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:19:56.890412 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-da403e3f-0333-404f-8fc4-2bce6faf514a tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:19:56.890866 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-da403e3f-0333-404f-8fc4-2bce6faf514a tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:19:57.034158 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-da403e3f-0333-404f-8fc4-2bce6faf514a tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:19:57.042448 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-da403e3f-0333-404f-8fc4-2bce6faf514a tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/21f02256-ec3e-445b-a842-96dae939c926" status: 200 len: 1684 microversion: 2.1 time: 0.168334 Oct 19 04:19:57.043057 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3554/7578] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:19:56 2022] GET /compute/v2.1/servers/21f02256-ec3e-445b-a842-96dae939c926 => generated 1684 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:19:57.481947 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-3ca9a459-34c6-4ecc-9623-dd1805cccffd req-51b1441a-88ab-442d-b38c-dec1691af02f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21f02256-ec3e-445b-a842-96dae939c926", "name": "network-vif-unplugged", "status": "completed", "tag": "591ce84f-65d8-47ff-98a3-64cbb72d7441"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:19:57.493001 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-3ca9a459-34c6-4ecc-9623-dd1805cccffd req-51b1441a-88ab-442d-b38c-dec1691af02f service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:19:57.493539 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-3ca9a459-34c6-4ecc-9623-dd1805cccffd req-51b1441a-88ab-442d-b38c-dec1691af02f service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:19:57.493993 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-3ca9a459-34c6-4ecc-9623-dd1805cccffd req-51b1441a-88ab-442d-b38c-dec1691af02f service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:19:57.506048 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-3ca9a459-34c6-4ecc-9623-dd1805cccffd req-51b1441a-88ab-442d-b38c-dec1691af02f service nova] Creating event network-vif-unplugged:591ce84f-65d8-47ff-98a3-64cbb72d7441 for instance 21f02256-ec3e-445b-a842-96dae939c926 on n-h1-861333-8 Oct 19 04:19:57.511300 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [req-3ca9a459-34c6-4ecc-9623-dd1805cccffd req-51b1441a-88ab-442d-b38c-dec1691af02f service nova] Instance 21f02256-ec3e-445b-a842-96dae939c926 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-861333-8', 'n-h1-861333-8'} {{(pid=121134) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 04:19:57.522475 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-3ca9a459-34c6-4ecc-9623-dd1805cccffd req-51b1441a-88ab-442d-b38c-dec1691af02f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044281 Oct 19 04:19:57.523679 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4025/7579] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:19:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:19:58.066515 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-99715d48-bcf0-4a60-a3b3-b80431fbe96c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:19:58.067168 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-99715d48-bcf0-4a60-a3b3-b80431fbe96c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 21f02256-ec3e-445b-a842-96dae939c926] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:19:58.074606 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-99715d48-bcf0-4a60-a3b3-b80431fbe96c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:19:58.075110 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-99715d48-bcf0-4a60-a3b3-b80431fbe96c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:19:58.075558 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-99715d48-bcf0-4a60-a3b3-b80431fbe96c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:19:58.076269 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-99715d48-bcf0-4a60-a3b3-b80431fbe96c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:19:58.076733 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-99715d48-bcf0-4a60-a3b3-b80431fbe96c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:19:58.077165 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-99715d48-bcf0-4a60-a3b3-b80431fbe96c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:19:58.219072 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-99715d48-bcf0-4a60-a3b3-b80431fbe96c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:19:58.227198 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-99715d48-bcf0-4a60-a3b3-b80431fbe96c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/21f02256-ec3e-445b-a842-96dae939c926" status: 200 len: 1684 microversion: 2.1 time: 0.165269 Oct 19 04:19:58.229411 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3555/7580] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:19:58 2022] GET /compute/v2.1/servers/21f02256-ec3e-445b-a842-96dae939c926 => generated 1684 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:19:59.251959 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4f1dec47-c96f-41f9-af38-fade01df7fd7 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:19:59.252713 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4f1dec47-c96f-41f9-af38-fade01df7fd7 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 21f02256-ec3e-445b-a842-96dae939c926] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:19:59.258940 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4f1dec47-c96f-41f9-af38-fade01df7fd7 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:19:59.259443 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4f1dec47-c96f-41f9-af38-fade01df7fd7 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:19:59.259905 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4f1dec47-c96f-41f9-af38-fade01df7fd7 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:19:59.260616 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4f1dec47-c96f-41f9-af38-fade01df7fd7 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:19:59.261103 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4f1dec47-c96f-41f9-af38-fade01df7fd7 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:19:59.261664 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4f1dec47-c96f-41f9-af38-fade01df7fd7 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:19:59.394781 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-4f1dec47-c96f-41f9-af38-fade01df7fd7 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:19:59.403059 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4f1dec47-c96f-41f9-af38-fade01df7fd7 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/21f02256-ec3e-445b-a842-96dae939c926" status: 200 len: 1682 microversion: 2.1 time: 0.156233 Oct 19 04:19:59.403653 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4026/7581] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:19:59 2022] GET /compute/v2.1/servers/21f02256-ec3e-445b-a842-96dae939c926 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:19:59.537471 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-6c64b057-180a-4963-863d-8d5d7ae45c64 req-5c9749c9-6145-4ca4-b48a-03381b89fe53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21f02256-ec3e-445b-a842-96dae939c926", "tag": "591ce84f-65d8-47ff-98a3-64cbb72d7441"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:19:59.547213 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-6c64b057-180a-4963-863d-8d5d7ae45c64 req-5c9749c9-6145-4ca4-b48a-03381b89fe53 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:19:59.547698 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-6c64b057-180a-4963-863d-8d5d7ae45c64 req-5c9749c9-6145-4ca4-b48a-03381b89fe53 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:19:59.548130 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-6c64b057-180a-4963-863d-8d5d7ae45c64 req-5c9749c9-6145-4ca4-b48a-03381b89fe53 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:19:59.559614 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-6c64b057-180a-4963-863d-8d5d7ae45c64 req-5c9749c9-6145-4ca4-b48a-03381b89fe53 service nova] Creating event network-changed:591ce84f-65d8-47ff-98a3-64cbb72d7441 for instance 21f02256-ec3e-445b-a842-96dae939c926 on n-h1-861333-8 Oct 19 04:19:59.564813 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [req-6c64b057-180a-4963-863d-8d5d7ae45c64 req-5c9749c9-6145-4ca4-b48a-03381b89fe53 service nova] Instance 21f02256-ec3e-445b-a842-96dae939c926 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-861333-8', 'n-h1-861333-8'} {{(pid=121135) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 04:19:59.576016 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-6c64b057-180a-4963-863d-8d5d7ae45c64 req-5c9749c9-6145-4ca4-b48a-03381b89fe53 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042496 Oct 19 04:19:59.576574 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3556/7582] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:19:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:20:00.429655 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-456fa085-bb9d-4c83-814a-295bbb286067 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:20:00.430283 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-456fa085-bb9d-4c83-814a-295bbb286067 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 21f02256-ec3e-445b-a842-96dae939c926] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:20:00.436260 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-456fa085-bb9d-4c83-814a-295bbb286067 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:20:00.436757 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-456fa085-bb9d-4c83-814a-295bbb286067 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:20:00.437209 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-456fa085-bb9d-4c83-814a-295bbb286067 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:20:00.437936 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-456fa085-bb9d-4c83-814a-295bbb286067 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:20:00.438402 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-456fa085-bb9d-4c83-814a-295bbb286067 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:20:00.438841 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-456fa085-bb9d-4c83-814a-295bbb286067 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:20:00.573613 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-456fa085-bb9d-4c83-814a-295bbb286067 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:20:00.576832 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-456fa085-bb9d-4c83-814a-295bbb286067 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/21f02256-ec3e-445b-a842-96dae939c926" status: 200 len: 1682 microversion: 2.1 time: 0.152590 Oct 19 04:20:00.577436 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4027/7583] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:20:00 2022] GET /compute/v2.1/servers/21f02256-ec3e-445b-a842-96dae939c926 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:20:01.602301 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-112ee4b4-b175-481a-997a-e5f4655c8ee1 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:20:01.603239 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-112ee4b4-b175-481a-997a-e5f4655c8ee1 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 21f02256-ec3e-445b-a842-96dae939c926] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:20:01.609443 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-112ee4b4-b175-481a-997a-e5f4655c8ee1 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:20:01.609942 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-112ee4b4-b175-481a-997a-e5f4655c8ee1 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:20:01.610392 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-112ee4b4-b175-481a-997a-e5f4655c8ee1 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:20:01.611092 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-112ee4b4-b175-481a-997a-e5f4655c8ee1 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:20:01.611557 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-112ee4b4-b175-481a-997a-e5f4655c8ee1 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:20:01.611994 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-112ee4b4-b175-481a-997a-e5f4655c8ee1 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:20:01.749997 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-112ee4b4-b175-481a-997a-e5f4655c8ee1 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:20:01.758225 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-112ee4b4-b175-481a-997a-e5f4655c8ee1 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/21f02256-ec3e-445b-a842-96dae939c926" status: 200 len: 1678 microversion: 2.1 time: 0.161272 Oct 19 04:20:01.758806 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3557/7584] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:20:01 2022] GET /compute/v2.1/servers/21f02256-ec3e-445b-a842-96dae939c926 => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:20:01.781227 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5cb5f6d7-0ba1-48be-b981-8cb527418b2a tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:20:01.781813 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5cb5f6d7-0ba1-48be-b981-8cb527418b2a tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 21f02256-ec3e-445b-a842-96dae939c926] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:20:01.789677 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5cb5f6d7-0ba1-48be-b981-8cb527418b2a tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:20:01.790414 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5cb5f6d7-0ba1-48be-b981-8cb527418b2a tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:20:01.790911 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5cb5f6d7-0ba1-48be-b981-8cb527418b2a tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:20:01.791646 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5cb5f6d7-0ba1-48be-b981-8cb527418b2a tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:20:01.792124 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5cb5f6d7-0ba1-48be-b981-8cb527418b2a tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:20:01.792574 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5cb5f6d7-0ba1-48be-b981-8cb527418b2a tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:20:02.026547 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5cb5f6d7-0ba1-48be-b981-8cb527418b2a tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "POST /compute/v2.1/servers/21f02256-ec3e-445b-a842-96dae939c926/action" status: 204 len: 0 microversion: 2.1 time: 0.249042 Oct 19 04:20:02.027195 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4028/7585] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 04:20:01 2022] POST /compute/v2.1/servers/21f02256-ec3e-445b-a842-96dae939c926/action => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 04:20:02.035881 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-49239d97-9975-49fe-91a2-2d57378d01f1 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:20:02.036542 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-49239d97-9975-49fe-91a2-2d57378d01f1 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 21f02256-ec3e-445b-a842-96dae939c926] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:20:02.042780 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-49239d97-9975-49fe-91a2-2d57378d01f1 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:20:02.043284 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-49239d97-9975-49fe-91a2-2d57378d01f1 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:20:02.043743 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-49239d97-9975-49fe-91a2-2d57378d01f1 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:20:02.044467 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-49239d97-9975-49fe-91a2-2d57378d01f1 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:20:02.044936 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-49239d97-9975-49fe-91a2-2d57378d01f1 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:20:02.045393 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-49239d97-9975-49fe-91a2-2d57378d01f1 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:20:02.176017 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-49239d97-9975-49fe-91a2-2d57378d01f1 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:20:02.183815 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-49239d97-9975-49fe-91a2-2d57378d01f1 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/21f02256-ec3e-445b-a842-96dae939c926" status: 200 len: 1678 microversion: 2.1 time: 0.152370 Oct 19 04:20:02.184397 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3558/7586] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:20:02 2022] GET /compute/v2.1/servers/21f02256-ec3e-445b-a842-96dae939c926 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:20:03.207269 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-09a4d488-7076-4e32-8d24-2f6ca1f598a8 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:20:03.207996 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-09a4d488-7076-4e32-8d24-2f6ca1f598a8 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 21f02256-ec3e-445b-a842-96dae939c926] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:20:03.215056 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-09a4d488-7076-4e32-8d24-2f6ca1f598a8 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:20:03.215595 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-09a4d488-7076-4e32-8d24-2f6ca1f598a8 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:20:03.216098 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-09a4d488-7076-4e32-8d24-2f6ca1f598a8 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:20:03.217099 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-09a4d488-7076-4e32-8d24-2f6ca1f598a8 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:20:03.217611 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-09a4d488-7076-4e32-8d24-2f6ca1f598a8 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:20:03.218064 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-09a4d488-7076-4e32-8d24-2f6ca1f598a8 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:20:03.356671 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-09a4d488-7076-4e32-8d24-2f6ca1f598a8 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:20:03.365453 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-09a4d488-7076-4e32-8d24-2f6ca1f598a8 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/21f02256-ec3e-445b-a842-96dae939c926" status: 200 len: 1678 microversion: 2.1 time: 0.162483 Oct 19 04:20:03.366050 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4029/7587] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:20:03 2022] GET /compute/v2.1/servers/21f02256-ec3e-445b-a842-96dae939c926 => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:20:04.389059 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-05d308b7-503e-4282-a46b-240d33d3214c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:20:04.389698 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-05d308b7-503e-4282-a46b-240d33d3214c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 21f02256-ec3e-445b-a842-96dae939c926] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:20:04.396812 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-05d308b7-503e-4282-a46b-240d33d3214c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:20:04.397301 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-05d308b7-503e-4282-a46b-240d33d3214c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:20:04.397767 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-05d308b7-503e-4282-a46b-240d33d3214c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:20:04.398882 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-05d308b7-503e-4282-a46b-240d33d3214c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:20:04.398882 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-05d308b7-503e-4282-a46b-240d33d3214c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:20:04.399319 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-05d308b7-503e-4282-a46b-240d33d3214c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:20:04.529664 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-05d308b7-503e-4282-a46b-240d33d3214c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:20:04.537355 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-05d308b7-503e-4282-a46b-240d33d3214c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/21f02256-ec3e-445b-a842-96dae939c926" status: 200 len: 1657 microversion: 2.1 time: 0.152239 Oct 19 04:20:04.538008 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3559/7588] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:20:04 2022] GET /compute/v2.1/servers/21f02256-ec3e-445b-a842-96dae939c926 => generated 1657 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:20:04.561305 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-675863fa-d727-4f4f-aee4-f1dbf963ddaa tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:20:04.561960 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-675863fa-d727-4f4f-aee4-f1dbf963ddaa tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 21f02256-ec3e-445b-a842-96dae939c926] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:20:04.568749 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-675863fa-d727-4f4f-aee4-f1dbf963ddaa tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:20:04.569251 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-675863fa-d727-4f4f-aee4-f1dbf963ddaa tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:20:04.570014 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-675863fa-d727-4f4f-aee4-f1dbf963ddaa tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:20:04.570727 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-675863fa-d727-4f4f-aee4-f1dbf963ddaa tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:20:04.571200 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-675863fa-d727-4f4f-aee4-f1dbf963ddaa tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:20:04.571647 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-675863fa-d727-4f4f-aee4-f1dbf963ddaa tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:20:04.697880 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-675863fa-d727-4f4f-aee4-f1dbf963ddaa tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:20:04.700192 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:20:04.706430 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-675863fa-d727-4f4f-aee4-f1dbf963ddaa tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/21f02256-ec3e-445b-a842-96dae939c926" status: 200 len: 1657 microversion: 2.1 time: 0.149888 Oct 19 04:20:04.707014 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4030/7589] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:20:04 2022] GET /compute/v2.1/servers/21f02256-ec3e-445b-a842-96dae939c926 => generated 1657 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:20:04.729163 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-aeb0dec3-8f8a-4f64-83b9-7093bdd9edca tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:20:04.735168 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aeb0dec3-8f8a-4f64-83b9-7093bdd9edca tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:20:04.735659 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aeb0dec3-8f8a-4f64-83b9-7093bdd9edca tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:20:04.736097 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aeb0dec3-8f8a-4f64-83b9-7093bdd9edca tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:20:04.758155 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-aeb0dec3-8f8a-4f64-83b9-7093bdd9edca tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 21f02256-ec3e-445b-a842-96dae939c926] Going to try to start instance {{(pid=121135) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 19 04:20:04.781472 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:20:04.998966 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-aeb0dec3-8f8a-4f64-83b9-7093bdd9edca tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "POST /compute/v2.1/servers/21f02256-ec3e-445b-a842-96dae939c926/action" status: 202 len: 0 microversion: 2.1 time: 0.273643 Oct 19 04:20:04.999634 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3560/7590] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 04:20:04 2022] POST /compute/v2.1/servers/21f02256-ec3e-445b-a842-96dae939c926/action => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 04:20:05.010882 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f253542d-b7eb-434f-afd3-286ce2f63e12 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:20:05.010882 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f253542d-b7eb-434f-afd3-286ce2f63e12 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 21f02256-ec3e-445b-a842-96dae939c926] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:20:05.016767 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f253542d-b7eb-434f-afd3-286ce2f63e12 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:20:05.017283 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f253542d-b7eb-434f-afd3-286ce2f63e12 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:20:05.017823 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f253542d-b7eb-434f-afd3-286ce2f63e12 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:20:05.018558 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f253542d-b7eb-434f-afd3-286ce2f63e12 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:20:05.019038 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f253542d-b7eb-434f-afd3-286ce2f63e12 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:20:05.019487 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f253542d-b7eb-434f-afd3-286ce2f63e12 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:20:05.154580 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-f253542d-b7eb-434f-afd3-286ce2f63e12 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:20:05.163617 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f253542d-b7eb-434f-afd3-286ce2f63e12 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/21f02256-ec3e-445b-a842-96dae939c926" status: 200 len: 1666 microversion: 2.1 time: 0.158349 Oct 19 04:20:05.164310 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4031/7591] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:20:05 2022] GET /compute/v2.1/servers/21f02256-ec3e-445b-a842-96dae939c926 => generated 1666 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:20:05.239516 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-aaf8e9d3-cd18-4122-bce3-f0e27e619b90 req-4bd0093e-7304-4ec4-812c-844135d9161a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21f02256-ec3e-445b-a842-96dae939c926", "name": "network-vif-plugged", "status": "completed", "tag": "591ce84f-65d8-47ff-98a3-64cbb72d7441"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:20:05.250459 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-aaf8e9d3-cd18-4122-bce3-f0e27e619b90 req-4bd0093e-7304-4ec4-812c-844135d9161a service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:20:05.250956 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-aaf8e9d3-cd18-4122-bce3-f0e27e619b90 req-4bd0093e-7304-4ec4-812c-844135d9161a service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:20:05.251426 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-aaf8e9d3-cd18-4122-bce3-f0e27e619b90 req-4bd0093e-7304-4ec4-812c-844135d9161a service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:20:05.263289 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-aaf8e9d3-cd18-4122-bce3-f0e27e619b90 req-4bd0093e-7304-4ec4-812c-844135d9161a service nova] Creating event network-vif-plugged:591ce84f-65d8-47ff-98a3-64cbb72d7441 for instance 21f02256-ec3e-445b-a842-96dae939c926 on n-h1-861333-8 Oct 19 04:20:05.268200 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-aaf8e9d3-cd18-4122-bce3-f0e27e619b90 req-4bd0093e-7304-4ec4-812c-844135d9161a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034364 Oct 19 04:20:05.269306 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3561/7592] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:20:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:20:06.187710 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-16b90f00-2057-4967-96bf-3390bbe0f472 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:20:06.188399 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-16b90f00-2057-4967-96bf-3390bbe0f472 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 21f02256-ec3e-445b-a842-96dae939c926] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:20:06.196386 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-16b90f00-2057-4967-96bf-3390bbe0f472 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:20:06.196907 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-16b90f00-2057-4967-96bf-3390bbe0f472 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:20:06.197392 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-16b90f00-2057-4967-96bf-3390bbe0f472 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:20:06.198521 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-16b90f00-2057-4967-96bf-3390bbe0f472 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:20:06.199004 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-16b90f00-2057-4967-96bf-3390bbe0f472 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:20:06.199579 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-16b90f00-2057-4967-96bf-3390bbe0f472 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:20:06.338061 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-16b90f00-2057-4967-96bf-3390bbe0f472 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:20:06.347978 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-16b90f00-2057-4967-96bf-3390bbe0f472 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/21f02256-ec3e-445b-a842-96dae939c926" status: 200 len: 1666 microversion: 2.1 time: 0.164565 Oct 19 04:20:06.349065 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4032/7593] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:20:06 2022] GET /compute/v2.1/servers/21f02256-ec3e-445b-a842-96dae939c926 => generated 1666 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:20:07.373929 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-dd33d032-0d5c-42c8-8aad-d613c319b0ac tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:20:07.374641 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-dd33d032-0d5c-42c8-8aad-d613c319b0ac tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 21f02256-ec3e-445b-a842-96dae939c926] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:20:07.381625 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dd33d032-0d5c-42c8-8aad-d613c319b0ac tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:20:07.382125 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dd33d032-0d5c-42c8-8aad-d613c319b0ac tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:20:07.382570 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dd33d032-0d5c-42c8-8aad-d613c319b0ac tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:20:07.383270 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dd33d032-0d5c-42c8-8aad-d613c319b0ac tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:20:07.383735 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dd33d032-0d5c-42c8-8aad-d613c319b0ac tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:20:07.384177 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dd33d032-0d5c-42c8-8aad-d613c319b0ac tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:20:07.513127 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-dd33d032-0d5c-42c8-8aad-d613c319b0ac tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:20:07.521152 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-dd33d032-0d5c-42c8-8aad-d613c319b0ac tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/21f02256-ec3e-445b-a842-96dae939c926" status: 200 len: 1670 microversion: 2.1 time: 0.152172 Oct 19 04:20:07.521752 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3562/7594] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:20:07 2022] GET /compute/v2.1/servers/21f02256-ec3e-445b-a842-96dae939c926 => generated 1670 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:20:07.543290 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-88fd6968-276f-427d-88c8-a4617f3570b7 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:20:07.543828 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-88fd6968-276f-427d-88c8-a4617f3570b7 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 21f02256-ec3e-445b-a842-96dae939c926] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:20:07.551027 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-88fd6968-276f-427d-88c8-a4617f3570b7 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:20:07.551522 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-88fd6968-276f-427d-88c8-a4617f3570b7 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:20:07.551974 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-88fd6968-276f-427d-88c8-a4617f3570b7 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:20:07.552672 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-88fd6968-276f-427d-88c8-a4617f3570b7 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:20:07.553135 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-88fd6968-276f-427d-88c8-a4617f3570b7 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:20:07.553603 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-88fd6968-276f-427d-88c8-a4617f3570b7 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:20:07.578653 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-88fd6968-276f-427d-88c8-a4617f3570b7 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 21f02256-ec3e-445b-a842-96dae939c926] Going to try to terminate instance {{(pid=121134) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 04:20:07.802173 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-88fd6968-276f-427d-88c8-a4617f3570b7 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "DELETE /compute/v2.1/servers/21f02256-ec3e-445b-a842-96dae939c926" status: 204 len: 0 microversion: 2.1 time: 0.262359 Oct 19 04:20:07.802771 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4033/7595] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 04:20:07 2022] DELETE /compute/v2.1/servers/21f02256-ec3e-445b-a842-96dae939c926 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 04:20:07.811016 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d9b9c2b1-f2d3-4632-b359-4f922c8a65a1 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:20:07.811649 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d9b9c2b1-f2d3-4632-b359-4f922c8a65a1 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 21f02256-ec3e-445b-a842-96dae939c926] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:20:07.817711 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d9b9c2b1-f2d3-4632-b359-4f922c8a65a1 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:20:07.818205 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d9b9c2b1-f2d3-4632-b359-4f922c8a65a1 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:20:07.818654 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d9b9c2b1-f2d3-4632-b359-4f922c8a65a1 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:20:07.819353 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d9b9c2b1-f2d3-4632-b359-4f922c8a65a1 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:20:07.819817 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d9b9c2b1-f2d3-4632-b359-4f922c8a65a1 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:20:07.820252 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d9b9c2b1-f2d3-4632-b359-4f922c8a65a1 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:20:07.955091 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d9b9c2b1-f2d3-4632-b359-4f922c8a65a1 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:20:07.962970 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d9b9c2b1-f2d3-4632-b359-4f922c8a65a1 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/21f02256-ec3e-445b-a842-96dae939c926" status: 200 len: 1676 microversion: 2.1 time: 0.155863 Oct 19 04:20:07.963551 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3563/7596] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:20:07 2022] GET /compute/v2.1/servers/21f02256-ec3e-445b-a842-96dae939c926 => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:20:08.987690 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-589db170-0149-4933-a961-f9d09c94bb3b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:20:08.988412 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-589db170-0149-4933-a961-f9d09c94bb3b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 21f02256-ec3e-445b-a842-96dae939c926] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:20:08.995190 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-589db170-0149-4933-a961-f9d09c94bb3b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:20:08.995695 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-589db170-0149-4933-a961-f9d09c94bb3b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:20:08.996155 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-589db170-0149-4933-a961-f9d09c94bb3b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:20:08.996864 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-589db170-0149-4933-a961-f9d09c94bb3b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:20:08.997344 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-589db170-0149-4933-a961-f9d09c94bb3b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:20:08.997812 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-589db170-0149-4933-a961-f9d09c94bb3b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:20:09.127407 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-589db170-0149-4933-a961-f9d09c94bb3b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:20:09.135127 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-589db170-0149-4933-a961-f9d09c94bb3b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/21f02256-ec3e-445b-a842-96dae939c926" status: 200 len: 1676 microversion: 2.1 time: 0.151762 Oct 19 04:20:09.135714 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4034/7597] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:20:08 2022] GET /compute/v2.1/servers/21f02256-ec3e-445b-a842-96dae939c926 => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:20:10.160241 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f37cc51b-37a5-4b6f-b514-b0e27a949fd0 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:20:10.160898 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f37cc51b-37a5-4b6f-b514-b0e27a949fd0 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 21f02256-ec3e-445b-a842-96dae939c926] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:20:10.168056 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f37cc51b-37a5-4b6f-b514-b0e27a949fd0 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:20:10.168622 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f37cc51b-37a5-4b6f-b514-b0e27a949fd0 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:20:10.169310 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f37cc51b-37a5-4b6f-b514-b0e27a949fd0 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:20:10.170314 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f37cc51b-37a5-4b6f-b514-b0e27a949fd0 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:20:10.170928 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f37cc51b-37a5-4b6f-b514-b0e27a949fd0 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:20:10.171429 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f37cc51b-37a5-4b6f-b514-b0e27a949fd0 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:20:10.237971 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f37cc51b-37a5-4b6f-b514-b0e27a949fd0 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:20:10.246460 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f37cc51b-37a5-4b6f-b514-b0e27a949fd0 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/21f02256-ec3e-445b-a842-96dae939c926" status: 200 len: 1608 microversion: 2.1 time: 0.090726 Oct 19 04:20:10.247073 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3564/7598] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:20:10 2022] GET /compute/v2.1/servers/21f02256-ec3e-445b-a842-96dae939c926 => generated 1608 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:20:10.303605 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-2708e1e7-c5fc-49f7-8e1c-c2fbebef97f2 req-8d4475bf-a438-48f3-bcf2-c2ba52350a60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21f02256-ec3e-445b-a842-96dae939c926", "name": "network-vif-deleted", "tag": "591ce84f-65d8-47ff-98a3-64cbb72d7441"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:20:10.310603 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:20:10.314797 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-2708e1e7-c5fc-49f7-8e1c-c2fbebef97f2 req-8d4475bf-a438-48f3-bcf2-c2ba52350a60 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:20:10.315348 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-2708e1e7-c5fc-49f7-8e1c-c2fbebef97f2 req-8d4475bf-a438-48f3-bcf2-c2ba52350a60 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:20:10.315800 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-2708e1e7-c5fc-49f7-8e1c-c2fbebef97f2 req-8d4475bf-a438-48f3-bcf2-c2ba52350a60 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:20:10.326993 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-2708e1e7-c5fc-49f7-8e1c-c2fbebef97f2 req-8d4475bf-a438-48f3-bcf2-c2ba52350a60 service nova] Creating event network-vif-deleted:591ce84f-65d8-47ff-98a3-64cbb72d7441 for instance 21f02256-ec3e-445b-a842-96dae939c926 on n-h1-861333-8 Oct 19 04:20:10.332550 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-2708e1e7-c5fc-49f7-8e1c-c2fbebef97f2 req-8d4475bf-a438-48f3-bcf2-c2ba52350a60 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033361 Oct 19 04:20:10.338400 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4035/7599] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:20:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:20:11.269642 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f1dbc63d-513f-4409-80ab-f73b407e6ca4 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:20:11.270322 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f1dbc63d-513f-4409-80ab-f73b407e6ca4 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 21f02256-ec3e-445b-a842-96dae939c926] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:20:11.277392 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f1dbc63d-513f-4409-80ab-f73b407e6ca4 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:20:11.277894 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f1dbc63d-513f-4409-80ab-f73b407e6ca4 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:20:11.278339 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f1dbc63d-513f-4409-80ab-f73b407e6ca4 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:20:11.279037 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f1dbc63d-513f-4409-80ab-f73b407e6ca4 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:20:11.279496 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f1dbc63d-513f-4409-80ab-f73b407e6ca4 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:20:11.279929 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f1dbc63d-513f-4409-80ab-f73b407e6ca4 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:20:11.293402 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-f1dbc63d-513f-4409-80ab-f73b407e6ca4 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] HTTP exception thrown: Instance 21f02256-ec3e-445b-a842-96dae939c926 could not be found. Oct 19 04:20:11.295108 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f1dbc63d-513f-4409-80ab-f73b407e6ca4 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Request method failure captured: Oct 19 04:20:11.295108 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/21f02256-ec3e-445b-a842-96dae939c926 HTTP/1.1 Oct 19 04:20:11.295108 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 04:20:11.295108 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 04:20:11.295108 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 04:20:11.295108 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 04:20:11.295108 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 04:20:11.295108 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 04:20:11.295108 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 04:20:11.295108 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 04:20:11.295108 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT3pS2Cwyyy-dNSAxlLXDbJv718ZCSFb4tsqqjaELCUFVV4hTcgxmjEt9HPf0r6Tip4zea9RCTtHQ0ac2yM_L9WSLCmGFBJhcH41unZ6WfnrAV6EUJNxXeMSOhFFhVbKjU1BMM3_NjFd9xRkGRzGdSLz8_YHyiY2hvcg5UcnlLBsNaKo Oct 19 04:20:11.295108 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 04:20:11.295108 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 04:20:11.295108 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 04:20:11.295108 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 04:20:11.295108 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 04:20:11.295108 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 04:20:11.295108 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 25caabf71e854e4ba4ee627309de481d Oct 19 04:20:11.295108 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ServerActionsTestJSON-130142772 Oct 19 04:20:11.295108 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 04:20:11.295108 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 04:20:11.295108 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/25caabf71e854e4ba4ee627309de481d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/25caabf71e854e4ba4ee627309de481d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/25caabf71e854e4ba4ee627309de481d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_25caabf71e854e4ba4ee627309de481d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 04:20:11.295108 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ServerActionsTestJSON-130142772 Oct 19 04:20:11.295108 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 25caabf71e854e4ba4ee627309de481d Oct 19 04:20:11.295108 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ServerActionsTestJSON-130142772 Oct 19 04:20:11.295108 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ServerActionsTestJSON-130142772-project Oct 19 04:20:11.295108 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 04:20:11.295108 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 04:20:11.295108 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 31018706f7fd45988df04518eee6c044 Oct 19 04:20:11.295108 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ServerActionsTestJSON-130142772-project Oct 19 04:20:11.295108 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 04:20:11.295108 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance 21f02256-ec3e-445b-a842-96dae939c926 could not be found. Oct 19 04:20:11.295108 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '21f02256-ec3e-445b-a842-96dae939c926'} Oct 19 04:20:11.295108 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 04:20:11.295108 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:20:11.295108 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 04:20:11.295108 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 04:20:11.295108 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 04:20:11.295108 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 04:20:11.295108 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 04:20:11.295108 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 04:20:11.295108 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 04:20:11.295108 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 04:20:11.295108 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21f02256-ec3e-445b-a842-96dae939c926 could not be found. Oct 19 04:20:11.295108 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:20:11.295108 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:20:11.295108 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:20:11.295108 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:20:11.295108 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:20:11.295108 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:20:11.295108 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 04:20:11.295108 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 04:20:11.295108 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 04:20:11.295108 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 04:20:11.295108 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 04:20:11.295108 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 04:20:11.295108 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 04:20:11.295108 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 04:20:11.295108 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 04:20:11.295108 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 04:20:11.295108 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21f02256-ec3e-445b-a842-96dae939c926 could not be found. Oct 19 04:20:11.295108 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:20:11.295108 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:20:11.295108 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:20:11.300567 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:20:11.300567 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:20:11.300567 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:20:11.300567 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 04:20:11.300567 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 04:20:11.300567 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21f02256-ec3e-445b-a842-96dae939c926 could not be found. Oct 19 04:20:11.300567 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:20:11.300567 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f1dbc63d-513f-4409-80ab-f73b407e6ca4 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Returning 404 to user: Instance 21f02256-ec3e-445b-a842-96dae939c926 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 04:20:11.300567 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f1dbc63d-513f-4409-80ab-f73b407e6ca4 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/21f02256-ec3e-445b-a842-96dae939c926" status: 404 len: 111 microversion: 2.1 time: 0.030820 Oct 19 04:20:11.300567 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3565/7600] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:20:11 2022] GET /compute/v2.1/servers/21f02256-ec3e-445b-a842-96dae939c926 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 04:20:11.313178 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e8ef0923-8fc6-402c-a5ee-3fe32e70d02b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:20:11.314648 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e8ef0923-8fc6-402c-a5ee-3fe32e70d02b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 21f02256-ec3e-445b-a842-96dae939c926] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:20:11.323331 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e8ef0923-8fc6-402c-a5ee-3fe32e70d02b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:20:11.323850 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e8ef0923-8fc6-402c-a5ee-3fe32e70d02b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:20:11.324313 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e8ef0923-8fc6-402c-a5ee-3fe32e70d02b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:20:11.325050 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e8ef0923-8fc6-402c-a5ee-3fe32e70d02b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:20:11.325562 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e8ef0923-8fc6-402c-a5ee-3fe32e70d02b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:20:11.326072 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e8ef0923-8fc6-402c-a5ee-3fe32e70d02b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:20:11.349270 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-e8ef0923-8fc6-402c-a5ee-3fe32e70d02b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] HTTP exception thrown: Instance 21f02256-ec3e-445b-a842-96dae939c926 could not be found. Oct 19 04:20:11.349270 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e8ef0923-8fc6-402c-a5ee-3fe32e70d02b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Request method failure captured: Oct 19 04:20:11.349270 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/21f02256-ec3e-445b-a842-96dae939c926 HTTP/1.1 Oct 19 04:20:11.349270 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 04:20:11.349270 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 04:20:11.349270 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 04:20:11.349270 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 04:20:11.349270 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 04:20:11.349270 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 04:20:11.349270 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 04:20:11.349270 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 04:20:11.349270 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3pS2Cwyyy-dNSAxlLXDbJv718ZCSFb4tsqqjaELCUFVV4hTcgxmjEt9HPf0r6Tip4zea9RCTtHQ0ac2yM_L9WSLCmGFBJhcH41unZ6WfnrAV6EUJNxXeMSOhFFhVbKjU1BMM3_NjFd9xRkGRzGdSLz8_YHyiY2hvcg5UcnlLBsNaKo Oct 19 04:20:11.349270 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 04:20:11.349270 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 04:20:11.349270 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 04:20:11.349270 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 04:20:11.349270 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 04:20:11.349270 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 04:20:11.349270 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 25caabf71e854e4ba4ee627309de481d Oct 19 04:20:11.349270 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ServerActionsTestJSON-130142772 Oct 19 04:20:11.349270 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 04:20:11.349270 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 04:20:11.349270 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/25caabf71e854e4ba4ee627309de481d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/25caabf71e854e4ba4ee627309de481d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/25caabf71e854e4ba4ee627309de481d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_25caabf71e854e4ba4ee627309de481d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 04:20:11.349270 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ServerActionsTestJSON-130142772 Oct 19 04:20:11.349270 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 25caabf71e854e4ba4ee627309de481d Oct 19 04:20:11.349270 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ServerActionsTestJSON-130142772 Oct 19 04:20:11.349270 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ServerActionsTestJSON-130142772-project Oct 19 04:20:11.349270 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 04:20:11.349270 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 04:20:11.349270 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 31018706f7fd45988df04518eee6c044 Oct 19 04:20:11.349270 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ServerActionsTestJSON-130142772-project Oct 19 04:20:11.349270 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 04:20:11.349270 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance 21f02256-ec3e-445b-a842-96dae939c926 could not be found. Oct 19 04:20:11.349270 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '21f02256-ec3e-445b-a842-96dae939c926'} Oct 19 04:20:11.349270 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 04:20:11.349270 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:20:11.349270 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 04:20:11.349270 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 04:20:11.349270 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 04:20:11.349270 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 04:20:11.349270 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 04:20:11.349270 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 04:20:11.349270 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 04:20:11.349270 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 04:20:11.349270 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21f02256-ec3e-445b-a842-96dae939c926 could not be found. Oct 19 04:20:11.349270 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:20:11.349270 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:20:11.349270 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:20:11.349270 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:20:11.349270 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:20:11.349270 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:20:11.349270 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 04:20:11.349270 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 04:20:11.349270 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 04:20:11.349270 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 04:20:11.349270 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 04:20:11.349270 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 04:20:11.349270 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 04:20:11.349270 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 04:20:11.349270 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 04:20:11.349270 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 04:20:11.353979 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21f02256-ec3e-445b-a842-96dae939c926 could not be found. Oct 19 04:20:11.353979 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:20:11.353979 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:20:11.353979 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:20:11.353979 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:20:11.353979 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:20:11.353979 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:20:11.353979 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 04:20:11.353979 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 04:20:11.353979 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21f02256-ec3e-445b-a842-96dae939c926 could not be found. Oct 19 04:20:11.353979 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:20:11.354758 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e8ef0923-8fc6-402c-a5ee-3fe32e70d02b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Returning 404 to user: Instance 21f02256-ec3e-445b-a842-96dae939c926 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 04:20:11.355241 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e8ef0923-8fc6-402c-a5ee-3fe32e70d02b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/21f02256-ec3e-445b-a842-96dae939c926" status: 404 len: 111 microversion: 2.1 time: 0.046497 Oct 19 04:20:11.356075 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4036/7601] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:20:11 2022] GET /compute/v2.1/servers/21f02256-ec3e-445b-a842-96dae939c926 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 04:20:11.418372 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a5b21adb-27a7-46c5-a415-09945939c0c1 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-642364470", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "networks": [{"uuid": "79af36cf-1d2d-4d42-bb0b-1923e8e4f461"}], "security_groups": [{"name": "tempest-securitygroup--1442934117"}], "key_name": "tempest-keypair-2091471087", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:20:11.528635 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.network.neutron [None req-a5b21adb-27a7-46c5-a415-09945939c0c1 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] validate_networks() for [('79af36cf-1d2d-4d42-bb0b-1923e8e4f461', None, None, None, None, None)] {{(pid=121135) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 04:20:11.947760 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-a5b21adb-27a7-46c5-a415-09945939c0c1 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Flavor limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 04:20:11.948188 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-a5b21adb-27a7-46c5-a415-09945939c0c1 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Image limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 04:20:11.948972 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-a5b21adb-27a7-46c5-a415-09945939c0c1 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Flavor pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 04:20:11.949410 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-a5b21adb-27a7-46c5-a415-09945939c0c1 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Image pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 04:20:11.949832 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-a5b21adb-27a7-46c5-a415-09945939c0c1 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 04:20:11.961009 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a5b21adb-27a7-46c5-a415-09945939c0c1 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:20:11.961530 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a5b21adb-27a7-46c5-a415-09945939c0c1 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:20:11.961971 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a5b21adb-27a7-46c5-a415-09945939c0c1 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:20:11.962707 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a5b21adb-27a7-46c5-a415-09945939c0c1 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:20:11.963173 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a5b21adb-27a7-46c5-a415-09945939c0c1 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:20:11.963606 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a5b21adb-27a7-46c5-a415-09945939c0c1 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:20:11.983164 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-a5b21adb-27a7-46c5-a415-09945939c0c1 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Getting quotas for project 25caabf71e854e4ba4ee627309de481d. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 04:20:11.988881 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-a5b21adb-27a7-46c5-a415-09945939c0c1 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Getting quotas for user 31018706f7fd45988df04518eee6c044 and project 25caabf71e854e4ba4ee627309de481d. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 04:20:12.002224 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a5b21adb-27a7-46c5-a415-09945939c0c1 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Going to run 1 instances... {{(pid=121135) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 04:20:12.004615 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a5b21adb-27a7-46c5-a415-09945939c0c1 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: c321af99-3be9-4477-bd64-099009c0c0e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121135) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 04:20:12.130775 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a5b21adb-27a7-46c5-a415-09945939c0c1 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.716449 Oct 19 04:20:12.131429 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3566/7602] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 04:20:11 2022] POST /compute/v2.1/servers => generated 406 bytes in 718 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 04:20:12.143528 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7795542c-1ed4-43ac-81c2-46b0b580f8d4 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:20:12.144201 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7795542c-1ed4-43ac-81c2-46b0b580f8d4 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: c321af99-3be9-4477-bd64-099009c0c0e3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:20:12.200315 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-7795542c-1ed4-43ac-81c2-46b0b580f8d4 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:20:12.207949 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7795542c-1ed4-43ac-81c2-46b0b580f8d4 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/c321af99-3be9-4477-bd64-099009c0c0e3" status: 200 len: 1238 microversion: 2.1 time: 0.068967 Oct 19 04:20:12.208630 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4037/7603] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:20:12 2022] GET /compute/v2.1/servers/c321af99-3be9-4477-bd64-099009c0c0e3 => generated 1238 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:20:13.231460 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6f3a0ba9-df2a-409a-bdf5-8de988b24d82 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:20:13.232115 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6f3a0ba9-df2a-409a-bdf5-8de988b24d82 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: c321af99-3be9-4477-bd64-099009c0c0e3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:20:13.234153 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:20:13.240385 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6f3a0ba9-df2a-409a-bdf5-8de988b24d82 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:20:13.240884 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6f3a0ba9-df2a-409a-bdf5-8de988b24d82 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:20:13.241338 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6f3a0ba9-df2a-409a-bdf5-8de988b24d82 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:20:13.242068 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6f3a0ba9-df2a-409a-bdf5-8de988b24d82 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:20:13.242536 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6f3a0ba9-df2a-409a-bdf5-8de988b24d82 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:20:13.242981 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6f3a0ba9-df2a-409a-bdf5-8de988b24d82 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:20:13.303853 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-6f3a0ba9-df2a-409a-bdf5-8de988b24d82 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:20:13.312321 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6f3a0ba9-df2a-409a-bdf5-8de988b24d82 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/c321af99-3be9-4477-bd64-099009c0c0e3" status: 200 len: 1242 microversion: 2.1 time: 0.085726 Oct 19 04:20:13.318545 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3567/7604] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:20:13 2022] GET /compute/v2.1/servers/c321af99-3be9-4477-bd64-099009c0c0e3 => generated 1242 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:20:14.336174 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a9790f55-3f27-4c9c-b5b4-2feafa38131e tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:20:14.336807 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a9790f55-3f27-4c9c-b5b4-2feafa38131e tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: c321af99-3be9-4477-bd64-099009c0c0e3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:20:14.344100 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a9790f55-3f27-4c9c-b5b4-2feafa38131e tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:20:14.344902 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a9790f55-3f27-4c9c-b5b4-2feafa38131e tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:20:14.345578 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a9790f55-3f27-4c9c-b5b4-2feafa38131e tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:20:14.346312 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a9790f55-3f27-4c9c-b5b4-2feafa38131e tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:20:14.346784 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a9790f55-3f27-4c9c-b5b4-2feafa38131e tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:20:14.347446 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a9790f55-3f27-4c9c-b5b4-2feafa38131e tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:20:14.414923 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a9790f55-3f27-4c9c-b5b4-2feafa38131e tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:20:14.423161 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a9790f55-3f27-4c9c-b5b4-2feafa38131e tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/c321af99-3be9-4477-bd64-099009c0c0e3" status: 200 len: 1298 microversion: 2.1 time: 0.090822 Oct 19 04:20:14.433616 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4038/7605] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:20:14 2022] GET /compute/v2.1/servers/c321af99-3be9-4477-bd64-099009c0c0e3 => generated 1298 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:20:15.448653 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-58990025-db8c-4c9e-8cd0-0017363ba706 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:20:15.449269 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-58990025-db8c-4c9e-8cd0-0017363ba706 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: c321af99-3be9-4477-bd64-099009c0c0e3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:20:15.456176 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-58990025-db8c-4c9e-8cd0-0017363ba706 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:20:15.457281 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-58990025-db8c-4c9e-8cd0-0017363ba706 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:20:15.457799 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-58990025-db8c-4c9e-8cd0-0017363ba706 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:20:15.458683 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-58990025-db8c-4c9e-8cd0-0017363ba706 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:20:15.459154 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-58990025-db8c-4c9e-8cd0-0017363ba706 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:20:15.459587 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-58990025-db8c-4c9e-8cd0-0017363ba706 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:20:15.952740 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-58990025-db8c-4c9e-8cd0-0017363ba706 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:20:15.960591 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-58990025-db8c-4c9e-8cd0-0017363ba706 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/c321af99-3be9-4477-bd64-099009c0c0e3" status: 200 len: 1364 microversion: 2.1 time: 0.516514 Oct 19 04:20:15.961167 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3568/7606] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:20:15 2022] GET /compute/v2.1/servers/c321af99-3be9-4477-bd64-099009c0c0e3 => generated 1364 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:20:16.426112 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-dae96751-a846-487c-90b5-c0b395281895 req-c9822e54-ccfa-4c71-9e4d-d75b91e94ff7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c321af99-3be9-4477-bd64-099009c0c0e3", "tag": "084c11a4-8e4e-465e-a0a2-a59a2d078de4"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:20:16.436348 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-dae96751-a846-487c-90b5-c0b395281895 req-c9822e54-ccfa-4c71-9e4d-d75b91e94ff7 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:20:16.436839 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-dae96751-a846-487c-90b5-c0b395281895 req-c9822e54-ccfa-4c71-9e4d-d75b91e94ff7 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:20:16.437293 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-dae96751-a846-487c-90b5-c0b395281895 req-c9822e54-ccfa-4c71-9e4d-d75b91e94ff7 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:20:16.448556 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-dae96751-a846-487c-90b5-c0b395281895 req-c9822e54-ccfa-4c71-9e4d-d75b91e94ff7 service nova] Creating event network-changed:084c11a4-8e4e-465e-a0a2-a59a2d078de4 for instance c321af99-3be9-4477-bd64-099009c0c0e3 on n-h2-861333-8 Oct 19 04:20:16.453357 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-dae96751-a846-487c-90b5-c0b395281895 req-c9822e54-ccfa-4c71-9e4d-d75b91e94ff7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030993 Oct 19 04:20:16.454171 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4039/7607] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:20:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 04:20:16.985238 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0ebcd5bc-11a0-44b5-8e7b-f1e907b2e2e0 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:20:16.987640 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0ebcd5bc-11a0-44b5-8e7b-f1e907b2e2e0 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: c321af99-3be9-4477-bd64-099009c0c0e3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:20:16.994660 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0ebcd5bc-11a0-44b5-8e7b-f1e907b2e2e0 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:20:16.995156 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0ebcd5bc-11a0-44b5-8e7b-f1e907b2e2e0 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:20:16.995604 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0ebcd5bc-11a0-44b5-8e7b-f1e907b2e2e0 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:20:16.996314 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0ebcd5bc-11a0-44b5-8e7b-f1e907b2e2e0 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:20:16.996782 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0ebcd5bc-11a0-44b5-8e7b-f1e907b2e2e0 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:20:16.997219 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0ebcd5bc-11a0-44b5-8e7b-f1e907b2e2e0 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:20:17.204808 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-0ebcd5bc-11a0-44b5-8e7b-f1e907b2e2e0 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:20:17.212842 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0ebcd5bc-11a0-44b5-8e7b-f1e907b2e2e0 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/c321af99-3be9-4477-bd64-099009c0c0e3" status: 200 len: 1364 microversion: 2.1 time: 0.231548 Oct 19 04:20:17.213454 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3569/7608] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:20:16 2022] GET /compute/v2.1/servers/c321af99-3be9-4477-bd64-099009c0c0e3 => generated 1364 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:20:18.237341 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c11c8433-e9d4-4a22-a05e-c5817fdfd1f4 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:20:18.238092 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c11c8433-e9d4-4a22-a05e-c5817fdfd1f4 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: c321af99-3be9-4477-bd64-099009c0c0e3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:20:18.244328 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c11c8433-e9d4-4a22-a05e-c5817fdfd1f4 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:20:18.244836 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c11c8433-e9d4-4a22-a05e-c5817fdfd1f4 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:20:18.245299 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c11c8433-e9d4-4a22-a05e-c5817fdfd1f4 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:20:18.246045 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c11c8433-e9d4-4a22-a05e-c5817fdfd1f4 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:20:18.246525 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c11c8433-e9d4-4a22-a05e-c5817fdfd1f4 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:20:18.246974 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c11c8433-e9d4-4a22-a05e-c5817fdfd1f4 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:20:18.375957 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c11c8433-e9d4-4a22-a05e-c5817fdfd1f4 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:20:18.384133 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c11c8433-e9d4-4a22-a05e-c5817fdfd1f4 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/c321af99-3be9-4477-bd64-099009c0c0e3" status: 200 len: 1364 microversion: 2.1 time: 0.151964 Oct 19 04:20:18.384704 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4040/7609] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:20:18 2022] GET /compute/v2.1/servers/c321af99-3be9-4477-bd64-099009c0c0e3 => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:20:19.408308 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-be484f31-27ce-47d6-a859-e65879982518 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:20:19.408948 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-be484f31-27ce-47d6-a859-e65879982518 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: c321af99-3be9-4477-bd64-099009c0c0e3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:20:19.417066 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-be484f31-27ce-47d6-a859-e65879982518 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:20:19.419788 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-be484f31-27ce-47d6-a859-e65879982518 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:20:19.419788 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-be484f31-27ce-47d6-a859-e65879982518 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:20:19.419788 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-be484f31-27ce-47d6-a859-e65879982518 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:20:19.419788 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-be484f31-27ce-47d6-a859-e65879982518 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:20:19.419788 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-be484f31-27ce-47d6-a859-e65879982518 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:20:19.561515 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-be484f31-27ce-47d6-a859-e65879982518 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:20:19.569502 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-be484f31-27ce-47d6-a859-e65879982518 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/c321af99-3be9-4477-bd64-099009c0c0e3" status: 200 len: 1364 microversion: 2.1 time: 0.165265 Oct 19 04:20:19.570097 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3570/7610] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:20:19 2022] GET /compute/v2.1/servers/c321af99-3be9-4477-bd64-099009c0c0e3 => generated 1364 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:20:20.594059 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-29df8582-9635-4afc-843a-202dbace4ba1 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:20:20.594698 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-29df8582-9635-4afc-843a-202dbace4ba1 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: c321af99-3be9-4477-bd64-099009c0c0e3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:20:20.602124 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-29df8582-9635-4afc-843a-202dbace4ba1 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:20:20.606591 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-29df8582-9635-4afc-843a-202dbace4ba1 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:20:20.606591 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-29df8582-9635-4afc-843a-202dbace4ba1 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:20:20.606591 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-29df8582-9635-4afc-843a-202dbace4ba1 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:20:20.606591 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-29df8582-9635-4afc-843a-202dbace4ba1 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:20:20.606591 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-29df8582-9635-4afc-843a-202dbace4ba1 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:20:20.742522 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-29df8582-9635-4afc-843a-202dbace4ba1 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:20:20.750342 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-29df8582-9635-4afc-843a-202dbace4ba1 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/c321af99-3be9-4477-bd64-099009c0c0e3" status: 200 len: 1364 microversion: 2.1 time: 0.160317 Oct 19 04:20:20.753563 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4041/7611] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:20:20 2022] GET /compute/v2.1/servers/c321af99-3be9-4477-bd64-099009c0c0e3 => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:20:21.589089 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-8c09746d-7f72-4c67-b2e9-d4e6d9724335 req-107eaed0-72fe-41d7-8edf-4621e950dcbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c321af99-3be9-4477-bd64-099009c0c0e3", "name": "network-vif-plugged", "status": "completed", "tag": "084c11a4-8e4e-465e-a0a2-a59a2d078de4"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:20:21.599510 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-8c09746d-7f72-4c67-b2e9-d4e6d9724335 req-107eaed0-72fe-41d7-8edf-4621e950dcbf service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:20:21.599997 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-8c09746d-7f72-4c67-b2e9-d4e6d9724335 req-107eaed0-72fe-41d7-8edf-4621e950dcbf service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:20:21.600443 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-8c09746d-7f72-4c67-b2e9-d4e6d9724335 req-107eaed0-72fe-41d7-8edf-4621e950dcbf service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:20:21.611274 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-8c09746d-7f72-4c67-b2e9-d4e6d9724335 req-107eaed0-72fe-41d7-8edf-4621e950dcbf service nova] Creating event network-vif-plugged:084c11a4-8e4e-465e-a0a2-a59a2d078de4 for instance c321af99-3be9-4477-bd64-099009c0c0e3 on n-h2-861333-8 Oct 19 04:20:21.616795 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-8c09746d-7f72-4c67-b2e9-d4e6d9724335 req-107eaed0-72fe-41d7-8edf-4621e950dcbf service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031586 Oct 19 04:20:21.617411 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3571/7612] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:20:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:20:21.773923 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-dbdeec71-3819-4b6b-a972-39b72e9dcad6 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:20:21.774566 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-dbdeec71-3819-4b6b-a972-39b72e9dcad6 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: c321af99-3be9-4477-bd64-099009c0c0e3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:20:21.781720 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dbdeec71-3819-4b6b-a972-39b72e9dcad6 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:20:21.782231 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dbdeec71-3819-4b6b-a972-39b72e9dcad6 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:20:21.782689 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dbdeec71-3819-4b6b-a972-39b72e9dcad6 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:20:21.783437 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dbdeec71-3819-4b6b-a972-39b72e9dcad6 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:20:21.783906 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dbdeec71-3819-4b6b-a972-39b72e9dcad6 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:20:21.784388 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dbdeec71-3819-4b6b-a972-39b72e9dcad6 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:20:21.916709 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-dbdeec71-3819-4b6b-a972-39b72e9dcad6 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:20:21.925553 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-dbdeec71-3819-4b6b-a972-39b72e9dcad6 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/c321af99-3be9-4477-bd64-099009c0c0e3" status: 200 len: 1364 microversion: 2.1 time: 0.155246 Oct 19 04:20:21.926141 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4042/7613] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:20:21 2022] GET /compute/v2.1/servers/c321af99-3be9-4477-bd64-099009c0c0e3 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:20:22.946472 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:20:22.947389 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=6 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:20:22.952262 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-248bae0b-2f33-4c20-9c5c-5e88ac978f28 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:20:22.952973 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-248bae0b-2f33-4c20-9c5c-5e88ac978f28 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: c321af99-3be9-4477-bd64-099009c0c0e3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:20:22.959102 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-248bae0b-2f33-4c20-9c5c-5e88ac978f28 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:20:22.959590 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-248bae0b-2f33-4c20-9c5c-5e88ac978f28 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:20:22.960037 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-248bae0b-2f33-4c20-9c5c-5e88ac978f28 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:20:22.960727 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-248bae0b-2f33-4c20-9c5c-5e88ac978f28 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:20:22.961186 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-248bae0b-2f33-4c20-9c5c-5e88ac978f28 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:20:22.962947 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-248bae0b-2f33-4c20-9c5c-5e88ac978f28 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:20:23.096410 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-248bae0b-2f33-4c20-9c5c-5e88ac978f28 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:20:23.104988 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-248bae0b-2f33-4c20-9c5c-5e88ac978f28 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/c321af99-3be9-4477-bd64-099009c0c0e3" status: 200 len: 1364 microversion: 2.1 time: 0.159498 Oct 19 04:20:23.110555 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3572/7614] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:20:22 2022] GET /compute/v2.1/servers/c321af99-3be9-4477-bd64-099009c0c0e3 => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:20:24.129461 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-262a854a-8032-4115-8dde-140e008619ec tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:20:24.130082 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-262a854a-8032-4115-8dde-140e008619ec tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: c321af99-3be9-4477-bd64-099009c0c0e3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:20:24.132227 n-d-861333-8 devstack@n-api.service[121134]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 04:20:24.132379 n-d-861333-8 devstack@n-api.service[121134]: Wed Oct 19 04:20:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c321af99-3be9-4477-bd64-099009c0c0e3 (ip 10.222.0.52) !!! Oct 19 04:20:24.133784 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:20:24.140811 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-262a854a-8032-4115-8dde-140e008619ec tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:20:24.141317 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-262a854a-8032-4115-8dde-140e008619ec tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:20:24.141801 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-262a854a-8032-4115-8dde-140e008619ec tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:20:24.142520 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-262a854a-8032-4115-8dde-140e008619ec tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:20:24.142995 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-262a854a-8032-4115-8dde-140e008619ec tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:20:24.143449 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-262a854a-8032-4115-8dde-140e008619ec tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:20:24.320041 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-262a854a-8032-4115-8dde-140e008619ec tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:20:24.327686 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-262a854a-8032-4115-8dde-140e008619ec tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/c321af99-3be9-4477-bd64-099009c0c0e3" status: 200 len: 1550 microversion: 2.1 time: 0.203191 Oct 19 04:20:24.328258 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4043/7615] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:20:24 2022] GET /compute/v2.1/servers/c321af99-3be9-4477-bd64-099009c0c0e3 => generated 1550 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:20:24.350521 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-253f9c9c-99d7-4964-8794-037a704aa362 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:20:24.351001 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-253f9c9c-99d7-4964-8794-037a704aa362 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: c321af99-3be9-4477-bd64-099009c0c0e3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:20:24.357742 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-253f9c9c-99d7-4964-8794-037a704aa362 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:20:24.358223 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-253f9c9c-99d7-4964-8794-037a704aa362 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:20:24.358657 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-253f9c9c-99d7-4964-8794-037a704aa362 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:20:24.359343 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-253f9c9c-99d7-4964-8794-037a704aa362 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:20:24.359797 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-253f9c9c-99d7-4964-8794-037a704aa362 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:20:24.360222 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-253f9c9c-99d7-4964-8794-037a704aa362 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:20:24.440763 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-253f9c9c-99d7-4964-8794-037a704aa362 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/c321af99-3be9-4477-bd64-099009c0c0e3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094551 Oct 19 04:20:24.441385 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3573/7616] 10.222.0.52 () {58 vars in 1275 bytes} [Wed Oct 19 04:20:24 2022] GET /compute/v2.1/servers/c321af99-3be9-4477-bd64-099009c0c0e3/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:20:25.442290 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-62a2df45-49ea-443f-bc8c-67019d7e515d req-666147ff-e62d-47db-a936-1d355e6f6cbc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c321af99-3be9-4477-bd64-099009c0c0e3", "tag": "084c11a4-8e4e-465e-a0a2-a59a2d078de4"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:20:25.452349 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-62a2df45-49ea-443f-bc8c-67019d7e515d req-666147ff-e62d-47db-a936-1d355e6f6cbc service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:20:25.452843 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-62a2df45-49ea-443f-bc8c-67019d7e515d req-666147ff-e62d-47db-a936-1d355e6f6cbc service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:20:25.453283 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-62a2df45-49ea-443f-bc8c-67019d7e515d req-666147ff-e62d-47db-a936-1d355e6f6cbc service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:20:25.467008 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-62a2df45-49ea-443f-bc8c-67019d7e515d req-666147ff-e62d-47db-a936-1d355e6f6cbc service nova] Creating event network-changed:084c11a4-8e4e-465e-a0a2-a59a2d078de4 for instance c321af99-3be9-4477-bd64-099009c0c0e3 on n-h2-861333-8 Oct 19 04:20:25.472168 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-62a2df45-49ea-443f-bc8c-67019d7e515d req-666147ff-e62d-47db-a936-1d355e6f6cbc service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034070 Oct 19 04:20:25.472850 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4044/7617] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:20:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:20:58.574059 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=13 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:20:58.574746 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=61,nova_cell1:INSERT=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:20:58.578960 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5013b586-964c-49d5-9ac3-4b835bab43a3 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:20:58.581258 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-5013b586-964c-49d5-9ac3-4b835bab43a3 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: c321af99-3be9-4477-bd64-099009c0c0e3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:20:58.587144 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5013b586-964c-49d5-9ac3-4b835bab43a3 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:20:58.591005 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5013b586-964c-49d5-9ac3-4b835bab43a3 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:20:58.591005 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5013b586-964c-49d5-9ac3-4b835bab43a3 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:20:58.591005 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5013b586-964c-49d5-9ac3-4b835bab43a3 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:20:58.591005 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5013b586-964c-49d5-9ac3-4b835bab43a3 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:20:58.591005 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5013b586-964c-49d5-9ac3-4b835bab43a3 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:20:58.619039 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-5013b586-964c-49d5-9ac3-4b835bab43a3 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:20:58.624490 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-5013b586-964c-49d5-9ac3-4b835bab43a3 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: c321af99-3be9-4477-bd64-099009c0c0e3] Old instance type m1.heat2, new instance type m1.heat {{(pid=121135) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 19 04:20:58.631417 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-5013b586-964c-49d5-9ac3-4b835bab43a3 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Flavor limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 04:20:58.631850 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-5013b586-964c-49d5-9ac3-4b835bab43a3 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Image limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 04:20:58.632333 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-5013b586-964c-49d5-9ac3-4b835bab43a3 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Flavor pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 04:20:58.632785 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-5013b586-964c-49d5-9ac3-4b835bab43a3 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Image pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 04:20:58.633215 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-5013b586-964c-49d5-9ac3-4b835bab43a3 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 04:20:58.790087 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5013b586-964c-49d5-9ac3-4b835bab43a3 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "POST /compute/v2.1/servers/c321af99-3be9-4477-bd64-099009c0c0e3/action" status: 202 len: 0 microversion: 2.1 time: 0.218033 Oct 19 04:20:58.790713 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3574/7618] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 04:20:58 2022] POST /compute/v2.1/servers/c321af99-3be9-4477-bd64-099009c0c0e3/action => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 04:20:58.798318 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=21 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:20:58.799155 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:20:58.804043 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1ac3175d-5b9e-45ae-85ff-b6a2f20dc0fd tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:20:58.804421 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1ac3175d-5b9e-45ae-85ff-b6a2f20dc0fd tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: c321af99-3be9-4477-bd64-099009c0c0e3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:20:58.810668 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1ac3175d-5b9e-45ae-85ff-b6a2f20dc0fd tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:20:58.811285 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1ac3175d-5b9e-45ae-85ff-b6a2f20dc0fd tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:20:58.811735 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1ac3175d-5b9e-45ae-85ff-b6a2f20dc0fd tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:20:58.812452 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1ac3175d-5b9e-45ae-85ff-b6a2f20dc0fd tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:20:58.812923 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1ac3175d-5b9e-45ae-85ff-b6a2f20dc0fd tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:20:58.813393 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1ac3175d-5b9e-45ae-85ff-b6a2f20dc0fd tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:20:58.949663 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-1ac3175d-5b9e-45ae-85ff-b6a2f20dc0fd tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:20:58.958714 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1ac3175d-5b9e-45ae-85ff-b6a2f20dc0fd tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/c321af99-3be9-4477-bd64-099009c0c0e3" status: 200 len: 1678 microversion: 2.1 time: 0.162657 Oct 19 04:20:58.959301 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4045/7619] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:20:58 2022] GET /compute/v2.1/servers/c321af99-3be9-4477-bd64-099009c0c0e3 => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:20:59.983782 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c921e2e6-e88e-4b3a-a104-ba04ed3b2b21 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:20:59.984552 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c921e2e6-e88e-4b3a-a104-ba04ed3b2b21 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: c321af99-3be9-4477-bd64-099009c0c0e3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:20:59.992177 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c921e2e6-e88e-4b3a-a104-ba04ed3b2b21 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:20:59.992753 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c921e2e6-e88e-4b3a-a104-ba04ed3b2b21 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:20:59.993214 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c921e2e6-e88e-4b3a-a104-ba04ed3b2b21 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:20:59.993963 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c921e2e6-e88e-4b3a-a104-ba04ed3b2b21 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:20:59.994425 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c921e2e6-e88e-4b3a-a104-ba04ed3b2b21 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:20:59.994862 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c921e2e6-e88e-4b3a-a104-ba04ed3b2b21 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:21:00.132630 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c921e2e6-e88e-4b3a-a104-ba04ed3b2b21 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:21:00.139161 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c921e2e6-e88e-4b3a-a104-ba04ed3b2b21 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/c321af99-3be9-4477-bd64-099009c0c0e3" status: 200 len: 1678 microversion: 2.1 time: 0.160488 Oct 19 04:21:00.139737 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3575/7620] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:20:59 2022] GET /compute/v2.1/servers/c321af99-3be9-4477-bd64-099009c0c0e3 => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:21:01.165545 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7520107f-07c2-459a-8bea-2fc6bb8a8ece tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:21:01.166488 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7520107f-07c2-459a-8bea-2fc6bb8a8ece tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: c321af99-3be9-4477-bd64-099009c0c0e3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:21:01.174276 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7520107f-07c2-459a-8bea-2fc6bb8a8ece tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:21:01.175391 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7520107f-07c2-459a-8bea-2fc6bb8a8ece tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:21:01.175923 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7520107f-07c2-459a-8bea-2fc6bb8a8ece tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:21:01.176872 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7520107f-07c2-459a-8bea-2fc6bb8a8ece tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:21:01.177588 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7520107f-07c2-459a-8bea-2fc6bb8a8ece tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:21:01.178203 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7520107f-07c2-459a-8bea-2fc6bb8a8ece tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:21:01.393055 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-7520107f-07c2-459a-8bea-2fc6bb8a8ece tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:21:01.401353 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7520107f-07c2-459a-8bea-2fc6bb8a8ece tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/c321af99-3be9-4477-bd64-099009c0c0e3" status: 200 len: 1678 microversion: 2.1 time: 0.240413 Oct 19 04:21:01.401968 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4046/7621] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:21:01 2022] GET /compute/v2.1/servers/c321af99-3be9-4477-bd64-099009c0c0e3 => generated 1678 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:21:02.424086 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a96ba1b6-78ca-42fc-b53c-8d3f98fd6b31 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:21:02.424706 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a96ba1b6-78ca-42fc-b53c-8d3f98fd6b31 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: c321af99-3be9-4477-bd64-099009c0c0e3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:21:02.432000 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a96ba1b6-78ca-42fc-b53c-8d3f98fd6b31 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:21:02.432484 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a96ba1b6-78ca-42fc-b53c-8d3f98fd6b31 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:21:02.432923 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a96ba1b6-78ca-42fc-b53c-8d3f98fd6b31 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:21:02.433638 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a96ba1b6-78ca-42fc-b53c-8d3f98fd6b31 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:21:02.434091 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a96ba1b6-78ca-42fc-b53c-8d3f98fd6b31 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:21:02.434515 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a96ba1b6-78ca-42fc-b53c-8d3f98fd6b31 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:21:02.565725 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a96ba1b6-78ca-42fc-b53c-8d3f98fd6b31 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:21:02.573958 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a96ba1b6-78ca-42fc-b53c-8d3f98fd6b31 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/c321af99-3be9-4477-bd64-099009c0c0e3" status: 200 len: 1683 microversion: 2.1 time: 0.153762 Oct 19 04:21:02.574523 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3576/7622] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:21:02 2022] GET /compute/v2.1/servers/c321af99-3be9-4477-bd64-099009c0c0e3 => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:21:03.597102 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-fbd102f8-7855-4607-baf8-72c8340ecdb8 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:21:03.597759 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-fbd102f8-7855-4607-baf8-72c8340ecdb8 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: c321af99-3be9-4477-bd64-099009c0c0e3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:21:03.604854 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fbd102f8-7855-4607-baf8-72c8340ecdb8 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:21:03.605361 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fbd102f8-7855-4607-baf8-72c8340ecdb8 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:21:03.605963 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fbd102f8-7855-4607-baf8-72c8340ecdb8 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:21:03.606684 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fbd102f8-7855-4607-baf8-72c8340ecdb8 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:21:03.607163 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fbd102f8-7855-4607-baf8-72c8340ecdb8 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:21:03.607608 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fbd102f8-7855-4607-baf8-72c8340ecdb8 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:21:03.735337 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-fbd102f8-7855-4607-baf8-72c8340ecdb8 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:21:03.743386 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-fbd102f8-7855-4607-baf8-72c8340ecdb8 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/c321af99-3be9-4477-bd64-099009c0c0e3" status: 200 len: 1683 microversion: 2.1 time: 0.150151 Oct 19 04:21:03.743970 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4047/7623] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:21:03 2022] GET /compute/v2.1/servers/c321af99-3be9-4477-bd64-099009c0c0e3 => generated 1683 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:21:04.767231 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-bcea332d-a3cd-4da6-bd73-92e8e856de2b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:21:04.767859 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-bcea332d-a3cd-4da6-bd73-92e8e856de2b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: c321af99-3be9-4477-bd64-099009c0c0e3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:21:04.775494 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bcea332d-a3cd-4da6-bd73-92e8e856de2b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:21:04.775990 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bcea332d-a3cd-4da6-bd73-92e8e856de2b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:21:04.776444 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bcea332d-a3cd-4da6-bd73-92e8e856de2b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:21:04.777147 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bcea332d-a3cd-4da6-bd73-92e8e856de2b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:21:04.777643 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bcea332d-a3cd-4da6-bd73-92e8e856de2b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:21:04.778082 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bcea332d-a3cd-4da6-bd73-92e8e856de2b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:21:04.911819 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-bcea332d-a3cd-4da6-bd73-92e8e856de2b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:21:04.919599 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-bcea332d-a3cd-4da6-bd73-92e8e856de2b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/c321af99-3be9-4477-bd64-099009c0c0e3" status: 200 len: 1683 microversion: 2.1 time: 0.156364 Oct 19 04:21:04.920396 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3577/7624] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:21:04 2022] GET /compute/v2.1/servers/c321af99-3be9-4477-bd64-099009c0c0e3 => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:21:05.942910 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e85ad2fd-0a96-43f1-830c-f99432a90090 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:21:05.943547 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e85ad2fd-0a96-43f1-830c-f99432a90090 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: c321af99-3be9-4477-bd64-099009c0c0e3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:21:05.950454 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e85ad2fd-0a96-43f1-830c-f99432a90090 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:21:05.950964 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e85ad2fd-0a96-43f1-830c-f99432a90090 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:21:05.951424 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e85ad2fd-0a96-43f1-830c-f99432a90090 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:21:05.952139 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e85ad2fd-0a96-43f1-830c-f99432a90090 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:21:05.952614 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e85ad2fd-0a96-43f1-830c-f99432a90090 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:21:05.953061 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e85ad2fd-0a96-43f1-830c-f99432a90090 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:21:06.090537 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e85ad2fd-0a96-43f1-830c-f99432a90090 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:21:06.091323 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e85ad2fd-0a96-43f1-830c-f99432a90090 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/c321af99-3be9-4477-bd64-099009c0c0e3" status: 200 len: 1683 microversion: 2.1 time: 0.152315 Oct 19 04:21:06.091910 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4048/7625] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:21:05 2022] GET /compute/v2.1/servers/c321af99-3be9-4477-bd64-099009c0c0e3 => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:21:07.115607 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a75552f7-c2e0-446f-ba17-dd49af604acc tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:21:07.116233 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a75552f7-c2e0-446f-ba17-dd49af604acc tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: c321af99-3be9-4477-bd64-099009c0c0e3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:21:07.123087 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a75552f7-c2e0-446f-ba17-dd49af604acc tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:21:07.123533 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a75552f7-c2e0-446f-ba17-dd49af604acc tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:21:07.123974 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a75552f7-c2e0-446f-ba17-dd49af604acc tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:21:07.124663 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a75552f7-c2e0-446f-ba17-dd49af604acc tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:21:07.125117 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a75552f7-c2e0-446f-ba17-dd49af604acc tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:21:07.125578 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a75552f7-c2e0-446f-ba17-dd49af604acc tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:21:07.258000 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a75552f7-c2e0-446f-ba17-dd49af604acc tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:21:07.265934 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a75552f7-c2e0-446f-ba17-dd49af604acc tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/c321af99-3be9-4477-bd64-099009c0c0e3" status: 200 len: 1683 microversion: 2.1 time: 0.154873 Oct 19 04:21:07.266511 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3578/7626] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:21:07 2022] GET /compute/v2.1/servers/c321af99-3be9-4477-bd64-099009c0c0e3 => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:21:08.288894 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-228b4648-26ab-4096-9074-ec2cf054eba6 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:21:08.289558 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-228b4648-26ab-4096-9074-ec2cf054eba6 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: c321af99-3be9-4477-bd64-099009c0c0e3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:21:08.296434 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-228b4648-26ab-4096-9074-ec2cf054eba6 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:21:08.296943 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-228b4648-26ab-4096-9074-ec2cf054eba6 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:21:08.297429 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-228b4648-26ab-4096-9074-ec2cf054eba6 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:21:08.298149 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-228b4648-26ab-4096-9074-ec2cf054eba6 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:21:08.298627 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-228b4648-26ab-4096-9074-ec2cf054eba6 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:21:08.299077 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-228b4648-26ab-4096-9074-ec2cf054eba6 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:21:08.431920 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-228b4648-26ab-4096-9074-ec2cf054eba6 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:21:08.439701 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-228b4648-26ab-4096-9074-ec2cf054eba6 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/c321af99-3be9-4477-bd64-099009c0c0e3" status: 200 len: 1683 microversion: 2.1 time: 0.154729 Oct 19 04:21:08.440280 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4049/7627] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:21:08 2022] GET /compute/v2.1/servers/c321af99-3be9-4477-bd64-099009c0c0e3 => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:21:09.463834 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-cd23992f-b1af-4dab-badd-ad69fee2d29b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:21:09.464460 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-cd23992f-b1af-4dab-badd-ad69fee2d29b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: c321af99-3be9-4477-bd64-099009c0c0e3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:21:09.471142 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cd23992f-b1af-4dab-badd-ad69fee2d29b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:21:09.471640 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cd23992f-b1af-4dab-badd-ad69fee2d29b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:21:09.472650 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cd23992f-b1af-4dab-badd-ad69fee2d29b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:21:09.473354 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cd23992f-b1af-4dab-badd-ad69fee2d29b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:21:09.473841 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cd23992f-b1af-4dab-badd-ad69fee2d29b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:21:09.474305 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cd23992f-b1af-4dab-badd-ad69fee2d29b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:21:09.604808 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-cd23992f-b1af-4dab-badd-ad69fee2d29b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:21:09.613080 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-cd23992f-b1af-4dab-badd-ad69fee2d29b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/c321af99-3be9-4477-bd64-099009c0c0e3" status: 200 len: 1683 microversion: 2.1 time: 0.153424 Oct 19 04:21:09.613704 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3579/7628] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:21:09 2022] GET /compute/v2.1/servers/c321af99-3be9-4477-bd64-099009c0c0e3 => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:21:10.637833 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5bb30128-4ad3-444f-be7c-2fd405b0f975 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:21:10.638497 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5bb30128-4ad3-444f-be7c-2fd405b0f975 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: c321af99-3be9-4477-bd64-099009c0c0e3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:21:10.646229 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5bb30128-4ad3-444f-be7c-2fd405b0f975 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:21:10.646719 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5bb30128-4ad3-444f-be7c-2fd405b0f975 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:21:10.647177 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5bb30128-4ad3-444f-be7c-2fd405b0f975 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:21:10.647880 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5bb30128-4ad3-444f-be7c-2fd405b0f975 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:21:10.648351 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5bb30128-4ad3-444f-be7c-2fd405b0f975 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:21:10.648797 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5bb30128-4ad3-444f-be7c-2fd405b0f975 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:21:10.782309 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5bb30128-4ad3-444f-be7c-2fd405b0f975 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:21:10.790947 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5bb30128-4ad3-444f-be7c-2fd405b0f975 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/c321af99-3be9-4477-bd64-099009c0c0e3" status: 200 len: 1683 microversion: 2.1 time: 0.157029 Oct 19 04:21:10.791535 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4050/7629] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:21:10 2022] GET /compute/v2.1/servers/c321af99-3be9-4477-bd64-099009c0c0e3 => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:21:11.814226 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-cd2e6fd9-5a3d-439c-b1d8-3ee7cde6d814 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:21:11.814848 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-cd2e6fd9-5a3d-439c-b1d8-3ee7cde6d814 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: c321af99-3be9-4477-bd64-099009c0c0e3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:21:11.821747 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cd2e6fd9-5a3d-439c-b1d8-3ee7cde6d814 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:21:11.822254 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cd2e6fd9-5a3d-439c-b1d8-3ee7cde6d814 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:21:11.822672 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cd2e6fd9-5a3d-439c-b1d8-3ee7cde6d814 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:21:11.823359 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cd2e6fd9-5a3d-439c-b1d8-3ee7cde6d814 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:21:11.823813 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cd2e6fd9-5a3d-439c-b1d8-3ee7cde6d814 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:21:11.824240 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cd2e6fd9-5a3d-439c-b1d8-3ee7cde6d814 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:21:11.956693 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-cd2e6fd9-5a3d-439c-b1d8-3ee7cde6d814 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:21:11.965262 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-cd2e6fd9-5a3d-439c-b1d8-3ee7cde6d814 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/c321af99-3be9-4477-bd64-099009c0c0e3" status: 200 len: 1683 microversion: 2.1 time: 0.154840 Oct 19 04:21:11.968886 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3580/7630] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:21:11 2022] GET /compute/v2.1/servers/c321af99-3be9-4477-bd64-099009c0c0e3 => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:21:12.989520 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ae87f90a-d31d-492c-960a-85d33f346cb2 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:21:12.990155 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ae87f90a-d31d-492c-960a-85d33f346cb2 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: c321af99-3be9-4477-bd64-099009c0c0e3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:21:12.997087 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ae87f90a-d31d-492c-960a-85d33f346cb2 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:21:12.997627 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ae87f90a-d31d-492c-960a-85d33f346cb2 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:21:12.998085 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ae87f90a-d31d-492c-960a-85d33f346cb2 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:21:12.998795 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ae87f90a-d31d-492c-960a-85d33f346cb2 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:21:12.999272 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ae87f90a-d31d-492c-960a-85d33f346cb2 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:21:12.999719 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ae87f90a-d31d-492c-960a-85d33f346cb2 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:21:13.128181 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ae87f90a-d31d-492c-960a-85d33f346cb2 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:21:13.136470 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ae87f90a-d31d-492c-960a-85d33f346cb2 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/c321af99-3be9-4477-bd64-099009c0c0e3" status: 200 len: 1683 microversion: 2.1 time: 0.151373 Oct 19 04:21:13.137091 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4051/7631] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:21:12 2022] GET /compute/v2.1/servers/c321af99-3be9-4477-bd64-099009c0c0e3 => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:21:14.160544 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-64ded335-62d7-43ae-9f01-c56268e1ce74 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:21:14.161185 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-64ded335-62d7-43ae-9f01-c56268e1ce74 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: c321af99-3be9-4477-bd64-099009c0c0e3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:21:14.167999 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-64ded335-62d7-43ae-9f01-c56268e1ce74 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:21:14.168497 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-64ded335-62d7-43ae-9f01-c56268e1ce74 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:21:14.168946 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-64ded335-62d7-43ae-9f01-c56268e1ce74 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:21:14.169750 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-64ded335-62d7-43ae-9f01-c56268e1ce74 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:21:14.170218 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-64ded335-62d7-43ae-9f01-c56268e1ce74 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:21:14.170660 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-64ded335-62d7-43ae-9f01-c56268e1ce74 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:21:14.305138 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-64ded335-62d7-43ae-9f01-c56268e1ce74 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:21:14.313256 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-64ded335-62d7-43ae-9f01-c56268e1ce74 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/c321af99-3be9-4477-bd64-099009c0c0e3" status: 200 len: 1682 microversion: 2.1 time: 0.157175 Oct 19 04:21:14.313875 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3581/7632] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:21:14 2022] GET /compute/v2.1/servers/c321af99-3be9-4477-bd64-099009c0c0e3 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:21:14.630315 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-41c933ca-affd-4b66-941d-151ce49a0559 req-03e80890-8e98-4c96-ae68-96b7534e881a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c321af99-3be9-4477-bd64-099009c0c0e3", "name": "network-vif-unplugged", "status": "completed", "tag": "084c11a4-8e4e-465e-a0a2-a59a2d078de4"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:21:14.640580 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-41c933ca-affd-4b66-941d-151ce49a0559 req-03e80890-8e98-4c96-ae68-96b7534e881a service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:21:14.641071 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-41c933ca-affd-4b66-941d-151ce49a0559 req-03e80890-8e98-4c96-ae68-96b7534e881a service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:21:14.641556 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-41c933ca-affd-4b66-941d-151ce49a0559 req-03e80890-8e98-4c96-ae68-96b7534e881a service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:21:14.653803 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-41c933ca-affd-4b66-941d-151ce49a0559 req-03e80890-8e98-4c96-ae68-96b7534e881a service nova] Creating event network-vif-unplugged:084c11a4-8e4e-465e-a0a2-a59a2d078de4 for instance c321af99-3be9-4477-bd64-099009c0c0e3 on n-h1-861333-8 Oct 19 04:21:14.659153 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [req-41c933ca-affd-4b66-941d-151ce49a0559 req-03e80890-8e98-4c96-ae68-96b7534e881a service nova] Instance c321af99-3be9-4477-bd64-099009c0c0e3 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-861333-8', 'n-h1-861333-8'} {{(pid=121134) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 04:21:14.671504 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-41c933ca-affd-4b66-941d-151ce49a0559 req-03e80890-8e98-4c96-ae68-96b7534e881a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045058 Oct 19 04:21:14.672123 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4052/7633] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:21:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:21:15.337015 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-661b2c5d-9173-40a8-91a8-0eafd22dd491 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:21:15.337760 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-661b2c5d-9173-40a8-91a8-0eafd22dd491 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: c321af99-3be9-4477-bd64-099009c0c0e3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:21:15.344349 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-661b2c5d-9173-40a8-91a8-0eafd22dd491 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:21:15.345473 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-661b2c5d-9173-40a8-91a8-0eafd22dd491 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:21:15.345922 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-661b2c5d-9173-40a8-91a8-0eafd22dd491 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:21:15.346622 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-661b2c5d-9173-40a8-91a8-0eafd22dd491 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:21:15.347076 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-661b2c5d-9173-40a8-91a8-0eafd22dd491 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:21:15.347532 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-661b2c5d-9173-40a8-91a8-0eafd22dd491 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:21:15.485911 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-661b2c5d-9173-40a8-91a8-0eafd22dd491 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:21:15.494835 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-661b2c5d-9173-40a8-91a8-0eafd22dd491 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/c321af99-3be9-4477-bd64-099009c0c0e3" status: 200 len: 1682 microversion: 2.1 time: 0.161664 Oct 19 04:21:15.495430 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3582/7634] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:21:15 2022] GET /compute/v2.1/servers/c321af99-3be9-4477-bd64-099009c0c0e3 => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:21:16.520329 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-19e994c1-4a03-43f8-8efd-ba408ef8f887 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:21:16.521277 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-19e994c1-4a03-43f8-8efd-ba408ef8f887 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: c321af99-3be9-4477-bd64-099009c0c0e3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:21:16.527616 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-19e994c1-4a03-43f8-8efd-ba408ef8f887 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:21:16.528253 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-19e994c1-4a03-43f8-8efd-ba408ef8f887 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:21:16.528715 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-19e994c1-4a03-43f8-8efd-ba408ef8f887 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:21:16.529454 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-19e994c1-4a03-43f8-8efd-ba408ef8f887 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:21:16.529934 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-19e994c1-4a03-43f8-8efd-ba408ef8f887 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:21:16.530386 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-19e994c1-4a03-43f8-8efd-ba408ef8f887 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:21:16.657767 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-19e994c1-4a03-43f8-8efd-ba408ef8f887 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:21:16.665571 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-19e994c1-4a03-43f8-8efd-ba408ef8f887 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/c321af99-3be9-4477-bd64-099009c0c0e3" status: 200 len: 1680 microversion: 2.1 time: 0.151067 Oct 19 04:21:16.666155 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4053/7635] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:21:16 2022] GET /compute/v2.1/servers/c321af99-3be9-4477-bd64-099009c0c0e3 => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:21:16.686233 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-1da9a4ff-cecc-4b7a-a2f5-6d5ced209b49 req-9b9fa0fd-c4d5-411f-b966-8e22d26a57d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c321af99-3be9-4477-bd64-099009c0c0e3", "tag": "084c11a4-8e4e-465e-a0a2-a59a2d078de4"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:21:16.697052 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-1da9a4ff-cecc-4b7a-a2f5-6d5ced209b49 req-9b9fa0fd-c4d5-411f-b966-8e22d26a57d2 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:21:16.697650 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-1da9a4ff-cecc-4b7a-a2f5-6d5ced209b49 req-9b9fa0fd-c4d5-411f-b966-8e22d26a57d2 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:21:16.698087 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-1da9a4ff-cecc-4b7a-a2f5-6d5ced209b49 req-9b9fa0fd-c4d5-411f-b966-8e22d26a57d2 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:21:16.712541 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-1da9a4ff-cecc-4b7a-a2f5-6d5ced209b49 req-9b9fa0fd-c4d5-411f-b966-8e22d26a57d2 service nova] Creating event network-changed:084c11a4-8e4e-465e-a0a2-a59a2d078de4 for instance c321af99-3be9-4477-bd64-099009c0c0e3 on n-h1-861333-8 Oct 19 04:21:16.717837 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [req-1da9a4ff-cecc-4b7a-a2f5-6d5ced209b49 req-9b9fa0fd-c4d5-411f-b966-8e22d26a57d2 service nova] Instance c321af99-3be9-4477-bd64-099009c0c0e3 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-861333-8', 'n-h1-861333-8'} {{(pid=121135) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 04:21:16.728572 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-1da9a4ff-cecc-4b7a-a2f5-6d5ced209b49 req-9b9fa0fd-c4d5-411f-b966-8e22d26a57d2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046111 Oct 19 04:21:16.729189 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3583/7636] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:21:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 04:21:17.689348 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-359b18c2-ccc7-4bc4-a3ef-5794b23523e4 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:21:17.690037 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-359b18c2-ccc7-4bc4-a3ef-5794b23523e4 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: c321af99-3be9-4477-bd64-099009c0c0e3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:21:17.696929 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-359b18c2-ccc7-4bc4-a3ef-5794b23523e4 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:21:17.697461 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-359b18c2-ccc7-4bc4-a3ef-5794b23523e4 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:21:17.697925 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-359b18c2-ccc7-4bc4-a3ef-5794b23523e4 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:21:17.698638 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-359b18c2-ccc7-4bc4-a3ef-5794b23523e4 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:21:17.699140 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-359b18c2-ccc7-4bc4-a3ef-5794b23523e4 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:21:17.699585 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-359b18c2-ccc7-4bc4-a3ef-5794b23523e4 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:21:17.834112 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-359b18c2-ccc7-4bc4-a3ef-5794b23523e4 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:21:17.841920 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-359b18c2-ccc7-4bc4-a3ef-5794b23523e4 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/c321af99-3be9-4477-bd64-099009c0c0e3" status: 200 len: 1680 microversion: 2.1 time: 0.156574 Oct 19 04:21:17.842499 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4054/7637] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:21:17 2022] GET /compute/v2.1/servers/c321af99-3be9-4477-bd64-099009c0c0e3 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:21:18.867295 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-74f00ff7-63d2-46fe-a626-2e21b4ff0dd6 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:21:18.868006 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-74f00ff7-63d2-46fe-a626-2e21b4ff0dd6 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: c321af99-3be9-4477-bd64-099009c0c0e3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:21:18.874226 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-74f00ff7-63d2-46fe-a626-2e21b4ff0dd6 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:21:18.874714 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-74f00ff7-63d2-46fe-a626-2e21b4ff0dd6 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:21:18.875176 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-74f00ff7-63d2-46fe-a626-2e21b4ff0dd6 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:21:18.875876 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-74f00ff7-63d2-46fe-a626-2e21b4ff0dd6 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:21:18.876332 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-74f00ff7-63d2-46fe-a626-2e21b4ff0dd6 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:21:18.876765 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-74f00ff7-63d2-46fe-a626-2e21b4ff0dd6 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:21:19.014253 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-74f00ff7-63d2-46fe-a626-2e21b4ff0dd6 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:21:19.022305 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-74f00ff7-63d2-46fe-a626-2e21b4ff0dd6 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/c321af99-3be9-4477-bd64-099009c0c0e3" status: 200 len: 1680 microversion: 2.1 time: 0.160781 Oct 19 04:21:19.022902 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3584/7638] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:21:18 2022] GET /compute/v2.1/servers/c321af99-3be9-4477-bd64-099009c0c0e3 => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:21:20.046956 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b5492ba3-30f5-42c7-9b6f-8d7eb9643ac4 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:21:20.047588 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b5492ba3-30f5-42c7-9b6f-8d7eb9643ac4 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: c321af99-3be9-4477-bd64-099009c0c0e3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:21:20.054988 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b5492ba3-30f5-42c7-9b6f-8d7eb9643ac4 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:21:20.055495 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b5492ba3-30f5-42c7-9b6f-8d7eb9643ac4 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:21:20.055949 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b5492ba3-30f5-42c7-9b6f-8d7eb9643ac4 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:21:20.056668 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b5492ba3-30f5-42c7-9b6f-8d7eb9643ac4 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:21:20.057143 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b5492ba3-30f5-42c7-9b6f-8d7eb9643ac4 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:21:20.057684 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b5492ba3-30f5-42c7-9b6f-8d7eb9643ac4 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:21:20.185094 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b5492ba3-30f5-42c7-9b6f-8d7eb9643ac4 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:21:20.192918 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b5492ba3-30f5-42c7-9b6f-8d7eb9643ac4 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/c321af99-3be9-4477-bd64-099009c0c0e3" status: 200 len: 1677 microversion: 2.1 time: 0.150059 Oct 19 04:21:20.193516 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4055/7639] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:21:20 2022] GET /compute/v2.1/servers/c321af99-3be9-4477-bd64-099009c0c0e3 => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:21:20.215434 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-cbc1a516-8683-4189-a7df-978721720482 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:21:20.215980 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-cbc1a516-8683-4189-a7df-978721720482 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: c321af99-3be9-4477-bd64-099009c0c0e3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:21:20.223493 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cbc1a516-8683-4189-a7df-978721720482 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:21:20.223984 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cbc1a516-8683-4189-a7df-978721720482 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:21:20.224430 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cbc1a516-8683-4189-a7df-978721720482 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:21:20.225130 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cbc1a516-8683-4189-a7df-978721720482 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:21:20.225635 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cbc1a516-8683-4189-a7df-978721720482 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:21:20.226102 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cbc1a516-8683-4189-a7df-978721720482 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:21:20.264158 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cbc1a516-8683-4189-a7df-978721720482 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:21:20.264597 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cbc1a516-8683-4189-a7df-978721720482 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:21:20.265042 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cbc1a516-8683-4189-a7df-978721720482 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:21:20.265820 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cbc1a516-8683-4189-a7df-978721720482 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:21:20.266285 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cbc1a516-8683-4189-a7df-978721720482 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:21:20.266723 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cbc1a516-8683-4189-a7df-978721720482 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:21:20.287445 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-cbc1a516-8683-4189-a7df-978721720482 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Getting quotas for project 25caabf71e854e4ba4ee627309de481d. Resources: {'cores', 'ram'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 04:21:20.292543 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-cbc1a516-8683-4189-a7df-978721720482 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Getting quotas for user 31018706f7fd45988df04518eee6c044 and project 25caabf71e854e4ba4ee627309de481d. Resources: {'cores', 'ram'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 04:21:20.652450 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-cbc1a516-8683-4189-a7df-978721720482 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "POST /compute/v2.1/servers/c321af99-3be9-4477-bd64-099009c0c0e3/action" status: 202 len: 0 microversion: 2.1 time: 0.440602 Oct 19 04:21:20.653132 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3585/7640] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 04:21:20 2022] POST /compute/v2.1/servers/c321af99-3be9-4477-bd64-099009c0c0e3/action => generated 0 bytes in 442 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 04:21:20.667150 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8d976d66-f0d0-4fb9-85cf-2718073decad tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:21:20.667823 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8d976d66-f0d0-4fb9-85cf-2718073decad tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: c321af99-3be9-4477-bd64-099009c0c0e3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:21:20.674136 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8d976d66-f0d0-4fb9-85cf-2718073decad tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:21:20.674649 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8d976d66-f0d0-4fb9-85cf-2718073decad tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:21:20.675161 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8d976d66-f0d0-4fb9-85cf-2718073decad tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:21:20.675878 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8d976d66-f0d0-4fb9-85cf-2718073decad tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:21:20.676353 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8d976d66-f0d0-4fb9-85cf-2718073decad tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:21:20.676809 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8d976d66-f0d0-4fb9-85cf-2718073decad tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:21:20.814268 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8d976d66-f0d0-4fb9-85cf-2718073decad tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:21:20.823272 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8d976d66-f0d0-4fb9-85cf-2718073decad tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/c321af99-3be9-4477-bd64-099009c0c0e3" status: 200 len: 1676 microversion: 2.1 time: 0.165866 Oct 19 04:21:20.823880 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4056/7641] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:21:20 2022] GET /compute/v2.1/servers/c321af99-3be9-4477-bd64-099009c0c0e3 => generated 1676 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:21:21.588409 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-a68dd8ba-37ff-4b0a-b551-52ee5c9bc635 req-5d6b1cc7-dff8-4998-ac48-3233538d46e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c321af99-3be9-4477-bd64-099009c0c0e3", "name": "network-vif-plugged", "status": "completed", "tag": "084c11a4-8e4e-465e-a0a2-a59a2d078de4"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:21:21.601629 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-a68dd8ba-37ff-4b0a-b551-52ee5c9bc635 req-5d6b1cc7-dff8-4998-ac48-3233538d46e1 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:21:21.602110 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-a68dd8ba-37ff-4b0a-b551-52ee5c9bc635 req-5d6b1cc7-dff8-4998-ac48-3233538d46e1 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:21:21.602551 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-a68dd8ba-37ff-4b0a-b551-52ee5c9bc635 req-5d6b1cc7-dff8-4998-ac48-3233538d46e1 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:21:21.614454 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-a68dd8ba-37ff-4b0a-b551-52ee5c9bc635 req-5d6b1cc7-dff8-4998-ac48-3233538d46e1 service nova] Creating event network-vif-plugged:084c11a4-8e4e-465e-a0a2-a59a2d078de4 for instance c321af99-3be9-4477-bd64-099009c0c0e3 on n-h1-861333-8 Oct 19 04:21:21.617039 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:21:21.620514 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [req-a68dd8ba-37ff-4b0a-b551-52ee5c9bc635 req-5d6b1cc7-dff8-4998-ac48-3233538d46e1 service nova] Instance c321af99-3be9-4477-bd64-099009c0c0e3 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-861333-8', 'n-h1-861333-8'} {{(pid=121135) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 04:21:21.631378 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-a68dd8ba-37ff-4b0a-b551-52ee5c9bc635 req-5d6b1cc7-dff8-4998-ac48-3233538d46e1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047172 Oct 19 04:21:21.631993 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3586/7642] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:21:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:21:21.847441 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b8722fc2-e2c0-474b-8e4a-4650637979e2 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:21:21.848665 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b8722fc2-e2c0-474b-8e4a-4650637979e2 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: c321af99-3be9-4477-bd64-099009c0c0e3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:21:21.855717 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b8722fc2-e2c0-474b-8e4a-4650637979e2 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:21:21.856225 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b8722fc2-e2c0-474b-8e4a-4650637979e2 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:21:21.856685 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b8722fc2-e2c0-474b-8e4a-4650637979e2 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:21:21.857433 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b8722fc2-e2c0-474b-8e4a-4650637979e2 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:21:21.857907 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b8722fc2-e2c0-474b-8e4a-4650637979e2 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:21:21.858352 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b8722fc2-e2c0-474b-8e4a-4650637979e2 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:21:21.995165 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b8722fc2-e2c0-474b-8e4a-4650637979e2 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:21:22.003224 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b8722fc2-e2c0-474b-8e4a-4650637979e2 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/c321af99-3be9-4477-bd64-099009c0c0e3" status: 200 len: 1676 microversion: 2.1 time: 0.159752 Oct 19 04:21:22.003814 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4057/7643] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:21:21 2022] GET /compute/v2.1/servers/c321af99-3be9-4477-bd64-099009c0c0e3 => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:21:23.028259 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ff4946f0-4a8a-4704-abb7-64bdb78db94b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:21:23.028959 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ff4946f0-4a8a-4704-abb7-64bdb78db94b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: c321af99-3be9-4477-bd64-099009c0c0e3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:21:23.035424 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ff4946f0-4a8a-4704-abb7-64bdb78db94b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:21:23.036429 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ff4946f0-4a8a-4704-abb7-64bdb78db94b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:21:23.036864 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ff4946f0-4a8a-4704-abb7-64bdb78db94b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:21:23.037615 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ff4946f0-4a8a-4704-abb7-64bdb78db94b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:21:23.038072 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ff4946f0-4a8a-4704-abb7-64bdb78db94b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:21:23.038502 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ff4946f0-4a8a-4704-abb7-64bdb78db94b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:21:23.172297 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ff4946f0-4a8a-4704-abb7-64bdb78db94b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:21:23.180727 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ff4946f0-4a8a-4704-abb7-64bdb78db94b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/c321af99-3be9-4477-bd64-099009c0c0e3" status: 200 len: 1676 microversion: 2.1 time: 0.157912 Oct 19 04:21:23.181304 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3587/7644] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:21:23 2022] GET /compute/v2.1/servers/c321af99-3be9-4477-bd64-099009c0c0e3 => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:21:24.203953 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-15200912-21f8-483e-8fc8-550fb4e4ce07 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:21:24.205207 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-15200912-21f8-483e-8fc8-550fb4e4ce07 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: c321af99-3be9-4477-bd64-099009c0c0e3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:21:24.212030 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-15200912-21f8-483e-8fc8-550fb4e4ce07 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:21:24.216812 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-15200912-21f8-483e-8fc8-550fb4e4ce07 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:21:24.216812 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-15200912-21f8-483e-8fc8-550fb4e4ce07 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:21:24.216812 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-15200912-21f8-483e-8fc8-550fb4e4ce07 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:21:24.216812 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-15200912-21f8-483e-8fc8-550fb4e4ce07 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:21:24.216812 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-15200912-21f8-483e-8fc8-550fb4e4ce07 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:21:24.350159 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-15200912-21f8-483e-8fc8-550fb4e4ce07 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:21:24.357901 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-15200912-21f8-483e-8fc8-550fb4e4ce07 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/c321af99-3be9-4477-bd64-099009c0c0e3" status: 200 len: 1676 microversion: 2.1 time: 0.157898 Oct 19 04:21:24.358478 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4058/7645] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:21:24 2022] GET /compute/v2.1/servers/c321af99-3be9-4477-bd64-099009c0c0e3 => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:21:25.382268 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b1c303e6-e56c-477a-b578-8a9eb549f653 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:21:25.382894 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b1c303e6-e56c-477a-b578-8a9eb549f653 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: c321af99-3be9-4477-bd64-099009c0c0e3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:21:25.390298 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b1c303e6-e56c-477a-b578-8a9eb549f653 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:21:25.390799 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b1c303e6-e56c-477a-b578-8a9eb549f653 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:21:25.391250 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b1c303e6-e56c-477a-b578-8a9eb549f653 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:21:25.391962 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b1c303e6-e56c-477a-b578-8a9eb549f653 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:21:25.392423 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b1c303e6-e56c-477a-b578-8a9eb549f653 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:21:25.392853 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b1c303e6-e56c-477a-b578-8a9eb549f653 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:21:25.511303 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-eb7433a3-5d47-456f-86e8-6a87eaede61f req-e34f4463-bb2e-4125-a031-34f03e75a6d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c321af99-3be9-4477-bd64-099009c0c0e3", "name": "network-vif-unplugged", "status": "completed", "tag": "084c11a4-8e4e-465e-a0a2-a59a2d078de4"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:21:25.522237 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-eb7433a3-5d47-456f-86e8-6a87eaede61f req-e34f4463-bb2e-4125-a031-34f03e75a6d8 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:21:25.522740 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-eb7433a3-5d47-456f-86e8-6a87eaede61f req-e34f4463-bb2e-4125-a031-34f03e75a6d8 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:21:25.523195 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-eb7433a3-5d47-456f-86e8-6a87eaede61f req-e34f4463-bb2e-4125-a031-34f03e75a6d8 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:21:25.536910 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-eb7433a3-5d47-456f-86e8-6a87eaede61f req-e34f4463-bb2e-4125-a031-34f03e75a6d8 service nova] Creating event network-vif-unplugged:084c11a4-8e4e-465e-a0a2-a59a2d078de4 for instance c321af99-3be9-4477-bd64-099009c0c0e3 on n-h2-861333-8 Oct 19 04:21:25.542994 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [req-eb7433a3-5d47-456f-86e8-6a87eaede61f req-e34f4463-bb2e-4125-a031-34f03e75a6d8 service nova] Instance c321af99-3be9-4477-bd64-099009c0c0e3 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-861333-8', 'n-h1-861333-8'} {{(pid=121134) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 04:21:25.554629 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-eb7433a3-5d47-456f-86e8-6a87eaede61f req-e34f4463-bb2e-4125-a031-34f03e75a6d8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.103131 Oct 19 04:21:25.555250 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4059/7646] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:21:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 04:21:25.665472 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b1c303e6-e56c-477a-b578-8a9eb549f653 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:21:25.673472 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b1c303e6-e56c-477a-b578-8a9eb549f653 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/c321af99-3be9-4477-bd64-099009c0c0e3" status: 200 len: 1676 microversion: 2.1 time: 0.295650 Oct 19 04:21:25.674419 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3588/7647] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:21:25 2022] GET /compute/v2.1/servers/c321af99-3be9-4477-bd64-099009c0c0e3 => generated 1676 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:21:26.698537 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a61d7bf1-56c2-4470-b953-491ccfd3c909 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:21:26.699248 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a61d7bf1-56c2-4470-b953-491ccfd3c909 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: c321af99-3be9-4477-bd64-099009c0c0e3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:21:26.706568 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a61d7bf1-56c2-4470-b953-491ccfd3c909 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:21:26.707066 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a61d7bf1-56c2-4470-b953-491ccfd3c909 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:21:26.708006 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a61d7bf1-56c2-4470-b953-491ccfd3c909 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:21:26.708705 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a61d7bf1-56c2-4470-b953-491ccfd3c909 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:21:26.709170 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a61d7bf1-56c2-4470-b953-491ccfd3c909 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:21:26.709639 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a61d7bf1-56c2-4470-b953-491ccfd3c909 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:21:26.840023 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a61d7bf1-56c2-4470-b953-491ccfd3c909 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:21:26.848254 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a61d7bf1-56c2-4470-b953-491ccfd3c909 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/c321af99-3be9-4477-bd64-099009c0c0e3" status: 200 len: 1676 microversion: 2.1 time: 0.153963 Oct 19 04:21:26.848830 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4060/7648] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:21:26 2022] GET /compute/v2.1/servers/c321af99-3be9-4477-bd64-099009c0c0e3 => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:21:27.588401 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-de261ad7-a254-4ece-838a-a3713e6aa166 req-af5119b4-ec08-4572-b234-b892d6075135 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c321af99-3be9-4477-bd64-099009c0c0e3", "tag": "084c11a4-8e4e-465e-a0a2-a59a2d078de4"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:21:27.599069 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-de261ad7-a254-4ece-838a-a3713e6aa166 req-af5119b4-ec08-4572-b234-b892d6075135 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:21:27.599552 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-de261ad7-a254-4ece-838a-a3713e6aa166 req-af5119b4-ec08-4572-b234-b892d6075135 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:21:27.600016 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-de261ad7-a254-4ece-838a-a3713e6aa166 req-af5119b4-ec08-4572-b234-b892d6075135 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:21:27.611369 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-de261ad7-a254-4ece-838a-a3713e6aa166 req-af5119b4-ec08-4572-b234-b892d6075135 service nova] Creating event network-changed:084c11a4-8e4e-465e-a0a2-a59a2d078de4 for instance c321af99-3be9-4477-bd64-099009c0c0e3 on n-h2-861333-8 Oct 19 04:21:27.617268 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [req-de261ad7-a254-4ece-838a-a3713e6aa166 req-af5119b4-ec08-4572-b234-b892d6075135 service nova] Instance c321af99-3be9-4477-bd64-099009c0c0e3 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-861333-8', 'n-h1-861333-8'} {{(pid=121135) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 04:21:27.627893 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-de261ad7-a254-4ece-838a-a3713e6aa166 req-af5119b4-ec08-4572-b234-b892d6075135 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043265 Oct 19 04:21:27.628647 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3589/7649] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:21:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:21:27.871293 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d6b0edaf-f391-48ea-8bfb-5e34fc74f45b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:21:27.872084 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d6b0edaf-f391-48ea-8bfb-5e34fc74f45b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: c321af99-3be9-4477-bd64-099009c0c0e3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:21:27.879133 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d6b0edaf-f391-48ea-8bfb-5e34fc74f45b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:21:27.879646 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d6b0edaf-f391-48ea-8bfb-5e34fc74f45b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:21:27.880109 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d6b0edaf-f391-48ea-8bfb-5e34fc74f45b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:21:27.880829 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d6b0edaf-f391-48ea-8bfb-5e34fc74f45b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:21:27.881307 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d6b0edaf-f391-48ea-8bfb-5e34fc74f45b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:21:27.881785 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d6b0edaf-f391-48ea-8bfb-5e34fc74f45b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:21:28.121804 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d6b0edaf-f391-48ea-8bfb-5e34fc74f45b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:21:28.121804 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d6b0edaf-f391-48ea-8bfb-5e34fc74f45b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/c321af99-3be9-4477-bd64-099009c0c0e3" status: 200 len: 1676 microversion: 2.1 time: 0.248474 Oct 19 04:21:28.121804 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4061/7650] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:21:27 2022] GET /compute/v2.1/servers/c321af99-3be9-4477-bd64-099009c0c0e3 => generated 1676 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:21:29.140406 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4116f28b-8575-471c-b4c4-5dcdf6ed2ec5 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:21:29.141113 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4116f28b-8575-471c-b4c4-5dcdf6ed2ec5 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: c321af99-3be9-4477-bd64-099009c0c0e3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:21:29.143099 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:21:29.148924 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4116f28b-8575-471c-b4c4-5dcdf6ed2ec5 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:21:29.150974 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4116f28b-8575-471c-b4c4-5dcdf6ed2ec5 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:21:29.150974 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4116f28b-8575-471c-b4c4-5dcdf6ed2ec5 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:21:29.150974 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4116f28b-8575-471c-b4c4-5dcdf6ed2ec5 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:21:29.151335 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4116f28b-8575-471c-b4c4-5dcdf6ed2ec5 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:21:29.151478 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4116f28b-8575-471c-b4c4-5dcdf6ed2ec5 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:21:29.282863 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4116f28b-8575-471c-b4c4-5dcdf6ed2ec5 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:21:29.290647 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4116f28b-8575-471c-b4c4-5dcdf6ed2ec5 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/c321af99-3be9-4477-bd64-099009c0c0e3" status: 200 len: 1669 microversion: 2.1 time: 0.155371 Oct 19 04:21:29.291243 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3590/7651] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:21:29 2022] GET /compute/v2.1/servers/c321af99-3be9-4477-bd64-099009c0c0e3 => generated 1669 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:21:29.312747 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6279fb29-c63d-4b38-b2cc-62f0aa21492d tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:21:29.313392 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6279fb29-c63d-4b38-b2cc-62f0aa21492d tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: c321af99-3be9-4477-bd64-099009c0c0e3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:21:29.316276 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=35 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:21:29.321512 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6279fb29-c63d-4b38-b2cc-62f0aa21492d tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:21:29.322031 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6279fb29-c63d-4b38-b2cc-62f0aa21492d tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:21:29.322482 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6279fb29-c63d-4b38-b2cc-62f0aa21492d tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:21:29.323181 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6279fb29-c63d-4b38-b2cc-62f0aa21492d tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:21:29.323673 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6279fb29-c63d-4b38-b2cc-62f0aa21492d tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:21:29.324113 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6279fb29-c63d-4b38-b2cc-62f0aa21492d tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:21:29.328007 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=100 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:21:29.453975 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-6279fb29-c63d-4b38-b2cc-62f0aa21492d tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:21:29.461846 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6279fb29-c63d-4b38-b2cc-62f0aa21492d tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/c321af99-3be9-4477-bd64-099009c0c0e3" status: 200 len: 1669 microversion: 2.1 time: 0.152975 Oct 19 04:21:29.462435 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4062/7652] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:21:29 2022] GET /compute/v2.1/servers/c321af99-3be9-4477-bd64-099009c0c0e3 => generated 1669 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:21:29.484430 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1b89ca29-82d8-46c2-bcd1-2c51ef91b671 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:21:29.485046 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1b89ca29-82d8-46c2-bcd1-2c51ef91b671 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: c321af99-3be9-4477-bd64-099009c0c0e3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:21:29.491794 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1b89ca29-82d8-46c2-bcd1-2c51ef91b671 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:21:29.492274 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1b89ca29-82d8-46c2-bcd1-2c51ef91b671 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:21:29.492711 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1b89ca29-82d8-46c2-bcd1-2c51ef91b671 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:21:29.493420 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1b89ca29-82d8-46c2-bcd1-2c51ef91b671 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:21:29.493949 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1b89ca29-82d8-46c2-bcd1-2c51ef91b671 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:21:29.494380 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1b89ca29-82d8-46c2-bcd1-2c51ef91b671 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:21:29.626827 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-1b89ca29-82d8-46c2-bcd1-2c51ef91b671 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:21:29.635321 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1b89ca29-82d8-46c2-bcd1-2c51ef91b671 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/c321af99-3be9-4477-bd64-099009c0c0e3" status: 200 len: 1669 microversion: 2.1 time: 0.154896 Oct 19 04:21:29.635896 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3591/7653] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:21:29 2022] GET /compute/v2.1/servers/c321af99-3be9-4477-bd64-099009c0c0e3 => generated 1669 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:21:29.662123 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5f074ba0-22c3-42e1-8ab5-ad814b09f91d tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:21:29.662123 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5f074ba0-22c3-42e1-8ab5-ad814b09f91d tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: c321af99-3be9-4477-bd64-099009c0c0e3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:21:29.664963 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5f074ba0-22c3-42e1-8ab5-ad814b09f91d tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:21:29.665511 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5f074ba0-22c3-42e1-8ab5-ad814b09f91d tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:21:29.665972 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5f074ba0-22c3-42e1-8ab5-ad814b09f91d tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:21:29.666686 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5f074ba0-22c3-42e1-8ab5-ad814b09f91d tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:21:29.667162 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5f074ba0-22c3-42e1-8ab5-ad814b09f91d tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:21:29.667722 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5f074ba0-22c3-42e1-8ab5-ad814b09f91d tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:21:29.693550 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5f074ba0-22c3-42e1-8ab5-ad814b09f91d tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: c321af99-3be9-4477-bd64-099009c0c0e3] Going to try to terminate instance {{(pid=121134) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 04:21:29.959486 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5f074ba0-22c3-42e1-8ab5-ad814b09f91d tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "DELETE /compute/v2.1/servers/c321af99-3be9-4477-bd64-099009c0c0e3" status: 204 len: 0 microversion: 2.1 time: 0.304866 Oct 19 04:21:29.960018 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4063/7654] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 04:21:29 2022] DELETE /compute/v2.1/servers/c321af99-3be9-4477-bd64-099009c0c0e3 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 04:21:29.968502 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9bbfc4e7-5aa0-4d41-aeeb-4a96ca122949 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:21:29.969130 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9bbfc4e7-5aa0-4d41-aeeb-4a96ca122949 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: c321af99-3be9-4477-bd64-099009c0c0e3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:21:29.975852 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9bbfc4e7-5aa0-4d41-aeeb-4a96ca122949 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:21:29.976347 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9bbfc4e7-5aa0-4d41-aeeb-4a96ca122949 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:21:29.976796 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9bbfc4e7-5aa0-4d41-aeeb-4a96ca122949 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:21:29.977567 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9bbfc4e7-5aa0-4d41-aeeb-4a96ca122949 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:21:29.978032 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9bbfc4e7-5aa0-4d41-aeeb-4a96ca122949 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:21:29.978473 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9bbfc4e7-5aa0-4d41-aeeb-4a96ca122949 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:21:30.111576 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-9bbfc4e7-5aa0-4d41-aeeb-4a96ca122949 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:21:30.119357 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9bbfc4e7-5aa0-4d41-aeeb-4a96ca122949 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/c321af99-3be9-4477-bd64-099009c0c0e3" status: 200 len: 1675 microversion: 2.1 time: 0.154779 Oct 19 04:21:30.119933 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3592/7655] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:21:29 2022] GET /compute/v2.1/servers/c321af99-3be9-4477-bd64-099009c0c0e3 => generated 1675 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:21:31.143562 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e2ad4e51-96dc-4314-b232-b0ff7acfe1a5 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:21:31.144221 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e2ad4e51-96dc-4314-b232-b0ff7acfe1a5 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: c321af99-3be9-4477-bd64-099009c0c0e3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:21:31.151567 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e2ad4e51-96dc-4314-b232-b0ff7acfe1a5 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:21:31.152185 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e2ad4e51-96dc-4314-b232-b0ff7acfe1a5 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:21:31.152676 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e2ad4e51-96dc-4314-b232-b0ff7acfe1a5 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:21:31.153410 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e2ad4e51-96dc-4314-b232-b0ff7acfe1a5 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:21:31.153892 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e2ad4e51-96dc-4314-b232-b0ff7acfe1a5 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:21:31.154345 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e2ad4e51-96dc-4314-b232-b0ff7acfe1a5 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:21:31.303998 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e2ad4e51-96dc-4314-b232-b0ff7acfe1a5 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:21:31.312198 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e2ad4e51-96dc-4314-b232-b0ff7acfe1a5 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/c321af99-3be9-4477-bd64-099009c0c0e3" status: 200 len: 1675 microversion: 2.1 time: 0.173151 Oct 19 04:21:31.312789 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4064/7656] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:21:31 2022] GET /compute/v2.1/servers/c321af99-3be9-4477-bd64-099009c0c0e3 => generated 1675 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:21:32.253024 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-1b6162e7-09cd-40cf-8000-d28ef563108e req-eb5fda41-d224-4b48-8a59-97069f7c9e8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c321af99-3be9-4477-bd64-099009c0c0e3", "name": "network-vif-deleted", "tag": "084c11a4-8e4e-465e-a0a2-a59a2d078de4"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:21:32.259875 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=3 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:21:32.265597 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-1b6162e7-09cd-40cf-8000-d28ef563108e req-eb5fda41-d224-4b48-8a59-97069f7c9e8d service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:21:32.268789 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-1b6162e7-09cd-40cf-8000-d28ef563108e req-eb5fda41-d224-4b48-8a59-97069f7c9e8d service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:21:32.268789 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-1b6162e7-09cd-40cf-8000-d28ef563108e req-eb5fda41-d224-4b48-8a59-97069f7c9e8d service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:21:32.279401 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-1b6162e7-09cd-40cf-8000-d28ef563108e req-eb5fda41-d224-4b48-8a59-97069f7c9e8d service nova] Creating event network-vif-deleted:084c11a4-8e4e-465e-a0a2-a59a2d078de4 for instance c321af99-3be9-4477-bd64-099009c0c0e3 on n-h2-861333-8 Oct 19 04:21:32.284317 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-1b6162e7-09cd-40cf-8000-d28ef563108e req-eb5fda41-d224-4b48-8a59-97069f7c9e8d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035073 Oct 19 04:21:32.284990 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3593/7657] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:21:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:21:32.336363 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-93e69be3-f022-4e98-8323-31d01ea1bd3b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:21:32.336995 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-93e69be3-f022-4e98-8323-31d01ea1bd3b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: c321af99-3be9-4477-bd64-099009c0c0e3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:21:32.343926 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-93e69be3-f022-4e98-8323-31d01ea1bd3b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:21:32.344428 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-93e69be3-f022-4e98-8323-31d01ea1bd3b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:21:32.345152 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-93e69be3-f022-4e98-8323-31d01ea1bd3b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:21:32.345885 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-93e69be3-f022-4e98-8323-31d01ea1bd3b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:21:32.346360 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-93e69be3-f022-4e98-8323-31d01ea1bd3b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:21:32.348258 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-93e69be3-f022-4e98-8323-31d01ea1bd3b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:21:32.417145 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-93e69be3-f022-4e98-8323-31d01ea1bd3b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:21:32.426649 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-93e69be3-f022-4e98-8323-31d01ea1bd3b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/c321af99-3be9-4477-bd64-099009c0c0e3" status: 200 len: 1607 microversion: 2.1 time: 0.093787 Oct 19 04:21:32.426649 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4065/7658] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:21:32 2022] GET /compute/v2.1/servers/c321af99-3be9-4477-bd64-099009c0c0e3 => generated 1607 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:21:33.451837 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-15366c28-fab9-4793-b2f2-b0f9cd00032a tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:21:33.452551 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-15366c28-fab9-4793-b2f2-b0f9cd00032a tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: c321af99-3be9-4477-bd64-099009c0c0e3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:21:33.459762 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-15366c28-fab9-4793-b2f2-b0f9cd00032a tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:21:33.460252 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-15366c28-fab9-4793-b2f2-b0f9cd00032a tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:21:33.460700 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-15366c28-fab9-4793-b2f2-b0f9cd00032a tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:21:33.462206 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-15366c28-fab9-4793-b2f2-b0f9cd00032a tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:21:33.462206 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-15366c28-fab9-4793-b2f2-b0f9cd00032a tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:21:33.462387 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-15366c28-fab9-4793-b2f2-b0f9cd00032a tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:21:33.476245 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-15366c28-fab9-4793-b2f2-b0f9cd00032a tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] HTTP exception thrown: Instance c321af99-3be9-4477-bd64-099009c0c0e3 could not be found. Oct 19 04:21:33.477901 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-15366c28-fab9-4793-b2f2-b0f9cd00032a tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Request method failure captured: Oct 19 04:21:33.477901 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/c321af99-3be9-4477-bd64-099009c0c0e3 HTTP/1.1 Oct 19 04:21:33.477901 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 04:21:33.477901 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 04:21:33.477901 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 04:21:33.477901 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 04:21:33.477901 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 04:21:33.477901 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 04:21:33.477901 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 04:21:33.477901 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 04:21:33.477901 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT3pS2Cwyyy-dNSAxlLXDbJv718ZCSFb4tsqqjaELCUFVV4hTcgxmjEt9HPf0r6Tip4zea9RCTtHQ0ac2yM_L9WSLCmGFBJhcH41unZ6WfnrAV6EUJNxXeMSOhFFhVbKjU1BMM3_NjFd9xRkGRzGdSLz8_YHyiY2hvcg5UcnlLBsNaKo Oct 19 04:21:33.477901 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 04:21:33.477901 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 04:21:33.477901 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 04:21:33.477901 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 04:21:33.477901 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 04:21:33.477901 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 04:21:33.477901 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 25caabf71e854e4ba4ee627309de481d Oct 19 04:21:33.477901 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ServerActionsTestJSON-130142772 Oct 19 04:21:33.477901 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 04:21:33.477901 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 04:21:33.477901 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/25caabf71e854e4ba4ee627309de481d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/25caabf71e854e4ba4ee627309de481d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/25caabf71e854e4ba4ee627309de481d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_25caabf71e854e4ba4ee627309de481d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 04:21:33.477901 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ServerActionsTestJSON-130142772 Oct 19 04:21:33.477901 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 25caabf71e854e4ba4ee627309de481d Oct 19 04:21:33.477901 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ServerActionsTestJSON-130142772 Oct 19 04:21:33.477901 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ServerActionsTestJSON-130142772-project Oct 19 04:21:33.477901 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 04:21:33.477901 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 04:21:33.477901 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 31018706f7fd45988df04518eee6c044 Oct 19 04:21:33.477901 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ServerActionsTestJSON-130142772-project Oct 19 04:21:33.477901 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 04:21:33.477901 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance c321af99-3be9-4477-bd64-099009c0c0e3 could not be found. Oct 19 04:21:33.477901 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': 'c321af99-3be9-4477-bd64-099009c0c0e3'} Oct 19 04:21:33.477901 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 04:21:33.477901 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:21:33.477901 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 04:21:33.477901 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 04:21:33.477901 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 04:21:33.477901 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 04:21:33.477901 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 04:21:33.477901 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 04:21:33.477901 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 04:21:33.477901 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 04:21:33.477901 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c321af99-3be9-4477-bd64-099009c0c0e3 could not be found. Oct 19 04:21:33.477901 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:21:33.477901 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:21:33.477901 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:21:33.477901 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:21:33.477901 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:21:33.477901 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:21:33.477901 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 04:21:33.477901 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 04:21:33.477901 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 04:21:33.477901 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 04:21:33.477901 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 04:21:33.477901 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 04:21:33.477901 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 04:21:33.477901 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 04:21:33.477901 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 04:21:33.477901 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 04:21:33.477901 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c321af99-3be9-4477-bd64-099009c0c0e3 could not be found. Oct 19 04:21:33.477901 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:21:33.477901 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:21:33.477901 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:21:33.486213 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:21:33.486213 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:21:33.486213 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:21:33.486213 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 04:21:33.486213 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 04:21:33.486213 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c321af99-3be9-4477-bd64-099009c0c0e3 could not be found. Oct 19 04:21:33.486213 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:21:33.486213 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-15366c28-fab9-4793-b2f2-b0f9cd00032a tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Returning 404 to user: Instance c321af99-3be9-4477-bd64-099009c0c0e3 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 04:21:33.486213 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-15366c28-fab9-4793-b2f2-b0f9cd00032a tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/c321af99-3be9-4477-bd64-099009c0c0e3" status: 404 len: 111 microversion: 2.1 time: 0.032738 Oct 19 04:21:33.486213 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3594/7659] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:21:33 2022] GET /compute/v2.1/servers/c321af99-3be9-4477-bd64-099009c0c0e3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 04:21:33.498367 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a6e2df07-69f6-447b-8aa7-214362c76805 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:21:33.499006 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a6e2df07-69f6-447b-8aa7-214362c76805 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: c321af99-3be9-4477-bd64-099009c0c0e3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:21:33.506480 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a6e2df07-69f6-447b-8aa7-214362c76805 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:21:33.506990 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a6e2df07-69f6-447b-8aa7-214362c76805 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:21:33.507519 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a6e2df07-69f6-447b-8aa7-214362c76805 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:21:33.508232 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a6e2df07-69f6-447b-8aa7-214362c76805 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:21:33.508709 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a6e2df07-69f6-447b-8aa7-214362c76805 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:21:33.509275 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a6e2df07-69f6-447b-8aa7-214362c76805 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:21:33.523637 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-a6e2df07-69f6-447b-8aa7-214362c76805 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] HTTP exception thrown: Instance c321af99-3be9-4477-bd64-099009c0c0e3 could not be found. Oct 19 04:21:33.526226 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a6e2df07-69f6-447b-8aa7-214362c76805 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Request method failure captured: Oct 19 04:21:33.526226 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/c321af99-3be9-4477-bd64-099009c0c0e3 HTTP/1.1 Oct 19 04:21:33.526226 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 04:21:33.526226 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 04:21:33.526226 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 04:21:33.526226 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 04:21:33.526226 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 04:21:33.526226 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 04:21:33.526226 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 04:21:33.526226 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 04:21:33.526226 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3pS2Cwyyy-dNSAxlLXDbJv718ZCSFb4tsqqjaELCUFVV4hTcgxmjEt9HPf0r6Tip4zea9RCTtHQ0ac2yM_L9WSLCmGFBJhcH41unZ6WfnrAV6EUJNxXeMSOhFFhVbKjU1BMM3_NjFd9xRkGRzGdSLz8_YHyiY2hvcg5UcnlLBsNaKo Oct 19 04:21:33.526226 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 04:21:33.526226 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 04:21:33.526226 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 04:21:33.526226 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 04:21:33.526226 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 04:21:33.526226 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 04:21:33.526226 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 25caabf71e854e4ba4ee627309de481d Oct 19 04:21:33.526226 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ServerActionsTestJSON-130142772 Oct 19 04:21:33.526226 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 04:21:33.526226 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 04:21:33.526226 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/25caabf71e854e4ba4ee627309de481d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/25caabf71e854e4ba4ee627309de481d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/25caabf71e854e4ba4ee627309de481d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_25caabf71e854e4ba4ee627309de481d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 04:21:33.526226 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ServerActionsTestJSON-130142772 Oct 19 04:21:33.526226 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 25caabf71e854e4ba4ee627309de481d Oct 19 04:21:33.526226 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ServerActionsTestJSON-130142772 Oct 19 04:21:33.526226 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ServerActionsTestJSON-130142772-project Oct 19 04:21:33.526226 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 04:21:33.526226 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 04:21:33.526226 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 31018706f7fd45988df04518eee6c044 Oct 19 04:21:33.526226 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ServerActionsTestJSON-130142772-project Oct 19 04:21:33.526226 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 04:21:33.526226 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance c321af99-3be9-4477-bd64-099009c0c0e3 could not be found. Oct 19 04:21:33.526226 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': 'c321af99-3be9-4477-bd64-099009c0c0e3'} Oct 19 04:21:33.526226 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 04:21:33.526226 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:21:33.526226 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 04:21:33.526226 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 04:21:33.526226 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 04:21:33.526226 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 04:21:33.526226 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 04:21:33.526226 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 04:21:33.526226 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 04:21:33.526226 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 04:21:33.526226 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c321af99-3be9-4477-bd64-099009c0c0e3 could not be found. Oct 19 04:21:33.526226 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:21:33.526226 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:21:33.526226 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:21:33.526226 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:21:33.526226 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:21:33.526226 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:21:33.526226 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 04:21:33.526226 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 04:21:33.526226 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 04:21:33.526226 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 04:21:33.526226 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 04:21:33.526226 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 04:21:33.526226 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 04:21:33.526226 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 04:21:33.526226 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 04:21:33.526226 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 04:21:33.526226 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c321af99-3be9-4477-bd64-099009c0c0e3 could not be found. Oct 19 04:21:33.526226 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:21:33.526226 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:21:33.526226 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:21:33.530933 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:21:33.530933 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:21:33.530933 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:21:33.530933 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 04:21:33.530933 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 04:21:33.530933 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c321af99-3be9-4477-bd64-099009c0c0e3 could not be found. Oct 19 04:21:33.530933 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:21:33.530933 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a6e2df07-69f6-447b-8aa7-214362c76805 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Returning 404 to user: Instance c321af99-3be9-4477-bd64-099009c0c0e3 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 04:21:33.530933 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a6e2df07-69f6-447b-8aa7-214362c76805 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/c321af99-3be9-4477-bd64-099009c0c0e3" status: 404 len: 111 microversion: 2.1 time: 0.033683 Oct 19 04:21:33.530933 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4066/7660] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:21:33 2022] GET /compute/v2.1/servers/c321af99-3be9-4477-bd64-099009c0c0e3 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 04:21:33.574975 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-86d70a99-19ac-4a90-8d6e-7c9ffd079cd9 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1480742086", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "networks": [{"uuid": "79af36cf-1d2d-4d42-bb0b-1923e8e4f461"}], "security_groups": [{"name": "tempest-securitygroup--1442934117"}], "key_name": "tempest-keypair-2091471087", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:21:33.682078 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.network.neutron [None req-86d70a99-19ac-4a90-8d6e-7c9ffd079cd9 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] validate_networks() for [('79af36cf-1d2d-4d42-bb0b-1923e8e4f461', None, None, None, None, None)] {{(pid=121135) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 04:21:34.046391 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-86d70a99-19ac-4a90-8d6e-7c9ffd079cd9 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Flavor limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 04:21:34.046829 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-86d70a99-19ac-4a90-8d6e-7c9ffd079cd9 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Image limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 04:21:34.047315 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-86d70a99-19ac-4a90-8d6e-7c9ffd079cd9 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Flavor pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 04:21:34.047736 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-86d70a99-19ac-4a90-8d6e-7c9ffd079cd9 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Image pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 04:21:34.048218 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-86d70a99-19ac-4a90-8d6e-7c9ffd079cd9 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 04:21:34.057760 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-86d70a99-19ac-4a90-8d6e-7c9ffd079cd9 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:21:34.058251 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-86d70a99-19ac-4a90-8d6e-7c9ffd079cd9 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:21:34.058698 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-86d70a99-19ac-4a90-8d6e-7c9ffd079cd9 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:21:34.059442 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-86d70a99-19ac-4a90-8d6e-7c9ffd079cd9 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:21:34.059909 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-86d70a99-19ac-4a90-8d6e-7c9ffd079cd9 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:21:34.060345 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-86d70a99-19ac-4a90-8d6e-7c9ffd079cd9 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:21:34.077686 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-86d70a99-19ac-4a90-8d6e-7c9ffd079cd9 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Getting quotas for project 25caabf71e854e4ba4ee627309de481d. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 04:21:34.082936 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-86d70a99-19ac-4a90-8d6e-7c9ffd079cd9 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Getting quotas for user 31018706f7fd45988df04518eee6c044 and project 25caabf71e854e4ba4ee627309de481d. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 04:21:34.095220 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-86d70a99-19ac-4a90-8d6e-7c9ffd079cd9 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Going to run 1 instances... {{(pid=121135) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 04:21:34.097546 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-86d70a99-19ac-4a90-8d6e-7c9ffd079cd9 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0970a787-dfdd-444a-a0e4-c11aaf9adaf0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121135) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 04:21:34.220328 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-86d70a99-19ac-4a90-8d6e-7c9ffd079cd9 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.649143 Oct 19 04:21:34.220886 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3595/7661] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 04:21:33 2022] POST /compute/v2.1/servers => generated 406 bytes in 650 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 04:21:34.232781 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b5c0638a-0856-4944-888c-0603637cb535 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:21:34.233547 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b5c0638a-0856-4944-888c-0603637cb535 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0970a787-dfdd-444a-a0e4-c11aaf9adaf0] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:21:34.290044 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b5c0638a-0856-4944-888c-0603637cb535 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:21:34.296825 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b5c0638a-0856-4944-888c-0603637cb535 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0" status: 200 len: 1239 microversion: 2.1 time: 0.067970 Oct 19 04:21:34.309391 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4067/7662] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:21:34 2022] GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0 => generated 1239 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:21:35.323057 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1b44bad5-7205-4c24-ba1f-70c5203df225 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:21:35.323678 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1b44bad5-7205-4c24-ba1f-70c5203df225 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0970a787-dfdd-444a-a0e4-c11aaf9adaf0] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:21:35.330611 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1b44bad5-7205-4c24-ba1f-70c5203df225 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:21:35.331045 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1b44bad5-7205-4c24-ba1f-70c5203df225 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:21:35.331491 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1b44bad5-7205-4c24-ba1f-70c5203df225 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:21:35.332818 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1b44bad5-7205-4c24-ba1f-70c5203df225 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:21:35.333277 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1b44bad5-7205-4c24-ba1f-70c5203df225 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:21:35.333741 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1b44bad5-7205-4c24-ba1f-70c5203df225 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:21:35.401511 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-1b44bad5-7205-4c24-ba1f-70c5203df225 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:21:35.409466 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1b44bad5-7205-4c24-ba1f-70c5203df225 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0" status: 200 len: 1243 microversion: 2.1 time: 0.091166 Oct 19 04:21:35.413084 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3596/7663] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:21:35 2022] GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0 => generated 1243 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:21:36.432310 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-52b093ae-08ff-43a1-9af2-d8e097453a0d tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:21:36.433124 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-52b093ae-08ff-43a1-9af2-d8e097453a0d tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0970a787-dfdd-444a-a0e4-c11aaf9adaf0] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:21:36.441122 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-52b093ae-08ff-43a1-9af2-d8e097453a0d tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:21:36.441752 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-52b093ae-08ff-43a1-9af2-d8e097453a0d tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:21:36.442265 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-52b093ae-08ff-43a1-9af2-d8e097453a0d tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:21:36.443239 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-52b093ae-08ff-43a1-9af2-d8e097453a0d tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:21:36.443946 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-52b093ae-08ff-43a1-9af2-d8e097453a0d tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:21:36.444576 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-52b093ae-08ff-43a1-9af2-d8e097453a0d tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:21:36.842962 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-52b093ae-08ff-43a1-9af2-d8e097453a0d tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:21:36.850902 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-52b093ae-08ff-43a1-9af2-d8e097453a0d tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0" status: 200 len: 1309 microversion: 2.1 time: 0.422598 Oct 19 04:21:36.851481 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4068/7664] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:21:36 2022] GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0 => generated 1309 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:21:37.880580 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-116ef885-ec01-4341-8bf8-6c12ad495cc3 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:21:37.881211 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-116ef885-ec01-4341-8bf8-6c12ad495cc3 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0970a787-dfdd-444a-a0e4-c11aaf9adaf0] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:21:37.888814 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-116ef885-ec01-4341-8bf8-6c12ad495cc3 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:21:37.889314 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-116ef885-ec01-4341-8bf8-6c12ad495cc3 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:21:37.889790 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-116ef885-ec01-4341-8bf8-6c12ad495cc3 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:21:37.890495 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-116ef885-ec01-4341-8bf8-6c12ad495cc3 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:21:37.890957 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-116ef885-ec01-4341-8bf8-6c12ad495cc3 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:21:37.891396 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-116ef885-ec01-4341-8bf8-6c12ad495cc3 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:21:38.133739 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-116ef885-ec01-4341-8bf8-6c12ad495cc3 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:21:38.141735 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-116ef885-ec01-4341-8bf8-6c12ad495cc3 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0" status: 200 len: 1365 microversion: 2.1 time: 0.265082 Oct 19 04:21:38.142431 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3597/7665] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:21:37 2022] GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0 => generated 1365 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:21:38.343933 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-000a2d59-b1ea-4533-b13b-dd3dc2a625a6 req-3fd62914-e537-490b-b999-029ccdb12ff6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0970a787-dfdd-444a-a0e4-c11aaf9adaf0", "tag": "0e97e794-6f03-4a7d-b17c-da810d04a800"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:21:38.361142 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-000a2d59-b1ea-4533-b13b-dd3dc2a625a6 req-3fd62914-e537-490b-b999-029ccdb12ff6 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:21:38.361774 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-000a2d59-b1ea-4533-b13b-dd3dc2a625a6 req-3fd62914-e537-490b-b999-029ccdb12ff6 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:21:38.362201 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-000a2d59-b1ea-4533-b13b-dd3dc2a625a6 req-3fd62914-e537-490b-b999-029ccdb12ff6 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:21:38.374059 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-000a2d59-b1ea-4533-b13b-dd3dc2a625a6 req-3fd62914-e537-490b-b999-029ccdb12ff6 service nova] Creating event network-changed:0e97e794-6f03-4a7d-b17c-da810d04a800 for instance 0970a787-dfdd-444a-a0e4-c11aaf9adaf0 on n-h2-861333-8 Oct 19 04:21:38.379423 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-000a2d59-b1ea-4533-b13b-dd3dc2a625a6 req-3fd62914-e537-490b-b999-029ccdb12ff6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038661 Oct 19 04:21:38.380017 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4069/7666] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:21:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:21:39.166222 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a3f04f63-e25e-4000-ac7b-b1dbf868c18c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:21:39.166853 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a3f04f63-e25e-4000-ac7b-b1dbf868c18c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0970a787-dfdd-444a-a0e4-c11aaf9adaf0] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:21:39.173437 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a3f04f63-e25e-4000-ac7b-b1dbf868c18c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:21:39.173932 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a3f04f63-e25e-4000-ac7b-b1dbf868c18c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:21:39.174384 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a3f04f63-e25e-4000-ac7b-b1dbf868c18c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:21:39.175081 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a3f04f63-e25e-4000-ac7b-b1dbf868c18c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:21:39.175545 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a3f04f63-e25e-4000-ac7b-b1dbf868c18c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:21:39.175976 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a3f04f63-e25e-4000-ac7b-b1dbf868c18c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:21:39.311113 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a3f04f63-e25e-4000-ac7b-b1dbf868c18c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:21:39.318882 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a3f04f63-e25e-4000-ac7b-b1dbf868c18c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0" status: 200 len: 1365 microversion: 2.1 time: 0.156634 Oct 19 04:21:39.319457 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3598/7667] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:21:39 2022] GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0 => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:21:40.343343 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-82e13a5e-23e4-4644-98ed-4846b39651e8 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:21:40.344092 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-82e13a5e-23e4-4644-98ed-4846b39651e8 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0970a787-dfdd-444a-a0e4-c11aaf9adaf0] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:21:40.350842 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-82e13a5e-23e4-4644-98ed-4846b39651e8 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:21:40.351348 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-82e13a5e-23e4-4644-98ed-4846b39651e8 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:21:40.351821 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-82e13a5e-23e4-4644-98ed-4846b39651e8 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:21:40.352530 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-82e13a5e-23e4-4644-98ed-4846b39651e8 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:21:40.353005 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-82e13a5e-23e4-4644-98ed-4846b39651e8 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:21:40.353485 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-82e13a5e-23e4-4644-98ed-4846b39651e8 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:21:40.499193 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-82e13a5e-23e4-4644-98ed-4846b39651e8 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:21:40.507199 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-82e13a5e-23e4-4644-98ed-4846b39651e8 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0" status: 200 len: 1365 microversion: 2.1 time: 0.169129 Oct 19 04:21:40.507787 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4070/7668] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:21:40 2022] GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0 => generated 1365 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:21:41.530915 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-563756d7-8689-438e-9f76-deb1af3c56c6 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:21:41.531535 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-563756d7-8689-438e-9f76-deb1af3c56c6 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0970a787-dfdd-444a-a0e4-c11aaf9adaf0] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:21:41.538489 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-563756d7-8689-438e-9f76-deb1af3c56c6 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:21:41.538981 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-563756d7-8689-438e-9f76-deb1af3c56c6 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:21:41.539427 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-563756d7-8689-438e-9f76-deb1af3c56c6 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:21:41.540126 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-563756d7-8689-438e-9f76-deb1af3c56c6 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:21:41.540582 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-563756d7-8689-438e-9f76-deb1af3c56c6 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:21:41.541018 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-563756d7-8689-438e-9f76-deb1af3c56c6 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:21:41.669353 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-563756d7-8689-438e-9f76-deb1af3c56c6 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:21:41.677648 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-563756d7-8689-438e-9f76-deb1af3c56c6 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0" status: 200 len: 1365 microversion: 2.1 time: 0.150591 Oct 19 04:21:41.678222 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3599/7669] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:21:41 2022] GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0 => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:21:42.701530 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c23da37e-b6f9-46b1-ab99-82f8bfe233e6 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:21:42.702163 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c23da37e-b6f9-46b1-ab99-82f8bfe233e6 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0970a787-dfdd-444a-a0e4-c11aaf9adaf0] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:21:42.709767 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c23da37e-b6f9-46b1-ab99-82f8bfe233e6 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:21:42.710267 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c23da37e-b6f9-46b1-ab99-82f8bfe233e6 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:21:42.710721 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c23da37e-b6f9-46b1-ab99-82f8bfe233e6 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:21:42.711426 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c23da37e-b6f9-46b1-ab99-82f8bfe233e6 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:21:42.711895 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c23da37e-b6f9-46b1-ab99-82f8bfe233e6 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:21:42.712339 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c23da37e-b6f9-46b1-ab99-82f8bfe233e6 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:21:42.844582 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c23da37e-b6f9-46b1-ab99-82f8bfe233e6 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:21:42.852310 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c23da37e-b6f9-46b1-ab99-82f8bfe233e6 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0" status: 200 len: 1365 microversion: 2.1 time: 0.154687 Oct 19 04:21:42.852899 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4071/7670] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:21:42 2022] GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0 => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:21:43.875993 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f35e9fae-dda8-4e87-bd79-3cc2370a2af8 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:21:43.876632 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f35e9fae-dda8-4e87-bd79-3cc2370a2af8 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0970a787-dfdd-444a-a0e4-c11aaf9adaf0] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:21:43.883359 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f35e9fae-dda8-4e87-bd79-3cc2370a2af8 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:21:43.883857 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f35e9fae-dda8-4e87-bd79-3cc2370a2af8 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:21:43.884355 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f35e9fae-dda8-4e87-bd79-3cc2370a2af8 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:21:43.885142 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f35e9fae-dda8-4e87-bd79-3cc2370a2af8 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:21:43.885626 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f35e9fae-dda8-4e87-bd79-3cc2370a2af8 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:21:43.886060 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f35e9fae-dda8-4e87-bd79-3cc2370a2af8 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:21:43.983531 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-2e0d0173-4d88-40ca-b4eb-13483342f7a5 req-7ee6b343-bbe0-4368-8c22-9a7815f03812 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0970a787-dfdd-444a-a0e4-c11aaf9adaf0", "name": "network-vif-plugged", "status": "completed", "tag": "0e97e794-6f03-4a7d-b17c-da810d04a800"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:21:43.994271 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-2e0d0173-4d88-40ca-b4eb-13483342f7a5 req-7ee6b343-bbe0-4368-8c22-9a7815f03812 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:21:43.994778 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-2e0d0173-4d88-40ca-b4eb-13483342f7a5 req-7ee6b343-bbe0-4368-8c22-9a7815f03812 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:21:43.995234 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-2e0d0173-4d88-40ca-b4eb-13483342f7a5 req-7ee6b343-bbe0-4368-8c22-9a7815f03812 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:21:44.006946 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-2e0d0173-4d88-40ca-b4eb-13483342f7a5 req-7ee6b343-bbe0-4368-8c22-9a7815f03812 service nova] Creating event network-vif-plugged:0e97e794-6f03-4a7d-b17c-da810d04a800 for instance 0970a787-dfdd-444a-a0e4-c11aaf9adaf0 on n-h2-861333-8 Oct 19 04:21:44.011819 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-2e0d0173-4d88-40ca-b4eb-13483342f7a5 req-7ee6b343-bbe0-4368-8c22-9a7815f03812 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032069 Oct 19 04:21:44.012420 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4072/7671] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:21:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 04:21:44.020037 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f35e9fae-dda8-4e87-bd79-3cc2370a2af8 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:21:44.028792 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f35e9fae-dda8-4e87-bd79-3cc2370a2af8 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0" status: 200 len: 1365 microversion: 2.1 time: 0.156709 Oct 19 04:21:44.029413 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3600/7672] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:21:43 2022] GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0 => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:21:45.049397 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:21:45.055122 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e09ce614-cb15-431f-a318-26a625ca6327 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:21:45.055877 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e09ce614-cb15-431f-a318-26a625ca6327 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0970a787-dfdd-444a-a0e4-c11aaf9adaf0] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:21:45.062070 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e09ce614-cb15-431f-a318-26a625ca6327 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:21:45.062577 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e09ce614-cb15-431f-a318-26a625ca6327 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:21:45.063036 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e09ce614-cb15-431f-a318-26a625ca6327 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:21:45.063748 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e09ce614-cb15-431f-a318-26a625ca6327 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:21:45.064224 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e09ce614-cb15-431f-a318-26a625ca6327 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:21:45.064674 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e09ce614-cb15-431f-a318-26a625ca6327 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:21:45.198124 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e09ce614-cb15-431f-a318-26a625ca6327 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:21:45.205915 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e09ce614-cb15-431f-a318-26a625ca6327 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0" status: 200 len: 1365 microversion: 2.1 time: 0.157513 Oct 19 04:21:45.206538 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4073/7673] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:21:45 2022] GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0 => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:21:46.229359 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4677739c-509f-45a6-b08a-3222d0f314a5 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:21:46.230003 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4677739c-509f-45a6-b08a-3222d0f314a5 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0970a787-dfdd-444a-a0e4-c11aaf9adaf0] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:21:46.231991 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:21:46.232664 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=6 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:21:46.238361 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4677739c-509f-45a6-b08a-3222d0f314a5 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:21:46.238852 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4677739c-509f-45a6-b08a-3222d0f314a5 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:21:46.239299 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4677739c-509f-45a6-b08a-3222d0f314a5 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:21:46.239995 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4677739c-509f-45a6-b08a-3222d0f314a5 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:21:46.240454 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4677739c-509f-45a6-b08a-3222d0f314a5 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:21:46.240884 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4677739c-509f-45a6-b08a-3222d0f314a5 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:21:46.375312 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4677739c-509f-45a6-b08a-3222d0f314a5 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:21:46.380372 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4677739c-509f-45a6-b08a-3222d0f314a5 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0" status: 200 len: 1552 microversion: 2.1 time: 0.154965 Oct 19 04:21:46.380961 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3601/7674] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:21:46 2022] GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0 => generated 1552 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:21:46.404325 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-cd393b92-f403-4ded-853f-9d8a5229fb56 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:21:46.404850 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-cd393b92-f403-4ded-853f-9d8a5229fb56 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0970a787-dfdd-444a-a0e4-c11aaf9adaf0] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:21:46.411639 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cd393b92-f403-4ded-853f-9d8a5229fb56 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:21:46.412410 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cd393b92-f403-4ded-853f-9d8a5229fb56 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:21:46.412874 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cd393b92-f403-4ded-853f-9d8a5229fb56 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:21:46.413625 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cd393b92-f403-4ded-853f-9d8a5229fb56 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:21:46.414106 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cd393b92-f403-4ded-853f-9d8a5229fb56 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:21:46.414555 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cd393b92-f403-4ded-853f-9d8a5229fb56 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:21:46.495662 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-cd393b92-f403-4ded-853f-9d8a5229fb56 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095375 Oct 19 04:21:46.496278 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4074/7675] 10.222.0.52 () {58 vars in 1275 bytes} [Wed Oct 19 04:21:46 2022] GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:21:47.500703 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-f2237c00-525c-417e-b18f-f709d86420be req-84fc7685-43a9-484c-ba87-73ab1633c513 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0970a787-dfdd-444a-a0e4-c11aaf9adaf0", "tag": "0e97e794-6f03-4a7d-b17c-da810d04a800"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:21:47.511506 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-f2237c00-525c-417e-b18f-f709d86420be req-84fc7685-43a9-484c-ba87-73ab1633c513 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:21:47.511997 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-f2237c00-525c-417e-b18f-f709d86420be req-84fc7685-43a9-484c-ba87-73ab1633c513 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:21:47.512443 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-f2237c00-525c-417e-b18f-f709d86420be req-84fc7685-43a9-484c-ba87-73ab1633c513 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:21:47.524847 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-f2237c00-525c-417e-b18f-f709d86420be req-84fc7685-43a9-484c-ba87-73ab1633c513 service nova] Creating event network-changed:0e97e794-6f03-4a7d-b17c-da810d04a800 for instance 0970a787-dfdd-444a-a0e4-c11aaf9adaf0 on n-h2-861333-8 Oct 19 04:21:47.529964 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-f2237c00-525c-417e-b18f-f709d86420be req-84fc7685-43a9-484c-ba87-73ab1633c513 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032989 Oct 19 04:21:47.530572 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3602/7676] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:21:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 04:22:23.547762 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:22:23.548635 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:22:23.549591 n-d-861333-8 devstack@n-api.service[121134]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 04:22:23.549737 n-d-861333-8 devstack@n-api.service[121134]: Wed Oct 19 04:22:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0 (ip 10.222.0.52) !!! Oct 19 04:22:23.554096 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4e82f8aa-1bcf-4b44-9324-68e4621cb7a6 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:22:23.555412 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4e82f8aa-1bcf-4b44-9324-68e4621cb7a6 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0970a787-dfdd-444a-a0e4-c11aaf9adaf0] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:22:23.561706 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4e82f8aa-1bcf-4b44-9324-68e4621cb7a6 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:22:23.562254 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4e82f8aa-1bcf-4b44-9324-68e4621cb7a6 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:22:23.562703 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4e82f8aa-1bcf-4b44-9324-68e4621cb7a6 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:22:23.563404 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4e82f8aa-1bcf-4b44-9324-68e4621cb7a6 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:22:23.563870 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4e82f8aa-1bcf-4b44-9324-68e4621cb7a6 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:22:23.564312 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4e82f8aa-1bcf-4b44-9324-68e4621cb7a6 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:22:23.699050 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-4e82f8aa-1bcf-4b44-9324-68e4621cb7a6 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:22:23.706813 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4e82f8aa-1bcf-4b44-9324-68e4621cb7a6 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0" status: 200 len: 1671 microversion: 2.1 time: 0.161098 Oct 19 04:22:23.707393 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4075/7677] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:22:23 2022] GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0 => generated 1671 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:22:23.727908 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:22:23.728651 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=78 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:22:23.732957 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0e846d81-5f9e-4971-9fc5-10c208f270ff tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "765eff58-0a92-4104-bde1-db2f08693efc"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:22:23.735458 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0e846d81-5f9e-4971-9fc5-10c208f270ff tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0970a787-dfdd-444a-a0e4-c11aaf9adaf0] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:22:23.741654 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0e846d81-5f9e-4971-9fc5-10c208f270ff tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:22:23.742145 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0e846d81-5f9e-4971-9fc5-10c208f270ff tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:22:23.742588 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0e846d81-5f9e-4971-9fc5-10c208f270ff tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:22:23.743282 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0e846d81-5f9e-4971-9fc5-10c208f270ff tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:22:23.743745 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0e846d81-5f9e-4971-9fc5-10c208f270ff tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:22:23.744178 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0e846d81-5f9e-4971-9fc5-10c208f270ff tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:22:24.478514 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0e846d81-5f9e-4971-9fc5-10c208f270ff tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "POST /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.752585 Oct 19 04:22:24.479325 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3603/7678] 10.222.0.52 () {60 vars in 1323 bytes} [Wed Oct 19 04:22:23 2022] POST /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0/os-volume_attachments => generated 194 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:22:36.241354 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4c7db17e-de5f-4ad5-8be9-6b13dae37375 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:22:36.243696 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4c7db17e-de5f-4ad5-8be9-6b13dae37375 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0970a787-dfdd-444a-a0e4-c11aaf9adaf0] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:22:36.245726 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:22:36.246410 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=6 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:22:36.251144 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4c7db17e-de5f-4ad5-8be9-6b13dae37375 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:22:36.251652 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4c7db17e-de5f-4ad5-8be9-6b13dae37375 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:22:36.255182 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4c7db17e-de5f-4ad5-8be9-6b13dae37375 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:22:36.255182 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4c7db17e-de5f-4ad5-8be9-6b13dae37375 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:22:36.255182 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4c7db17e-de5f-4ad5-8be9-6b13dae37375 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:22:36.255182 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4c7db17e-de5f-4ad5-8be9-6b13dae37375 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:22:36.282707 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-4c7db17e-de5f-4ad5-8be9-6b13dae37375 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:22:36.288152 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4c7db17e-de5f-4ad5-8be9-6b13dae37375 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0970a787-dfdd-444a-a0e4-c11aaf9adaf0] Old instance type m1.heat2, new instance type m1.heat {{(pid=121134) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 19 04:22:36.295822 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-4c7db17e-de5f-4ad5-8be9-6b13dae37375 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Flavor limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 04:22:36.296269 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-4c7db17e-de5f-4ad5-8be9-6b13dae37375 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Image limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 04:22:36.296765 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-4c7db17e-de5f-4ad5-8be9-6b13dae37375 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Flavor pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 04:22:36.297194 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-4c7db17e-de5f-4ad5-8be9-6b13dae37375 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Image pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 04:22:36.297657 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-4c7db17e-de5f-4ad5-8be9-6b13dae37375 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 04:22:36.521167 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4c7db17e-de5f-4ad5-8be9-6b13dae37375 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "POST /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0/action" status: 202 len: 0 microversion: 2.1 time: 0.283962 Oct 19 04:22:36.522449 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4076/7679] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 04:22:36 2022] POST /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0/action => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 04:22:36.529083 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:22:36.530286 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:22:36.534415 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-153a2f0b-14ca-46b2-8968-3ed687153a1f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:22:36.535206 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-153a2f0b-14ca-46b2-8968-3ed687153a1f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0970a787-dfdd-444a-a0e4-c11aaf9adaf0] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:22:36.541439 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-153a2f0b-14ca-46b2-8968-3ed687153a1f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:22:36.542109 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-153a2f0b-14ca-46b2-8968-3ed687153a1f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:22:36.542423 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-153a2f0b-14ca-46b2-8968-3ed687153a1f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:22:36.543148 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-153a2f0b-14ca-46b2-8968-3ed687153a1f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:22:36.543605 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-153a2f0b-14ca-46b2-8968-3ed687153a1f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:22:36.544053 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-153a2f0b-14ca-46b2-8968-3ed687153a1f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:22:36.677910 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-153a2f0b-14ca-46b2-8968-3ed687153a1f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:22:36.687460 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-153a2f0b-14ca-46b2-8968-3ed687153a1f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0" status: 200 len: 1726 microversion: 2.1 time: 0.160253 Oct 19 04:22:36.688143 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3604/7680] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:22:36 2022] GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0 => generated 1726 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:22:37.713301 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2cf15b18-4537-4756-8c91-4cbc5dd8155f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:22:37.713963 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2cf15b18-4537-4756-8c91-4cbc5dd8155f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0970a787-dfdd-444a-a0e4-c11aaf9adaf0] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:22:37.721435 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2cf15b18-4537-4756-8c91-4cbc5dd8155f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:22:37.721951 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2cf15b18-4537-4756-8c91-4cbc5dd8155f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:22:37.722472 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2cf15b18-4537-4756-8c91-4cbc5dd8155f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:22:37.723210 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2cf15b18-4537-4756-8c91-4cbc5dd8155f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:22:37.723688 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2cf15b18-4537-4756-8c91-4cbc5dd8155f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:22:37.724134 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2cf15b18-4537-4756-8c91-4cbc5dd8155f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:22:37.855318 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-2cf15b18-4537-4756-8c91-4cbc5dd8155f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:22:37.863833 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2cf15b18-4537-4756-8c91-4cbc5dd8155f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0" status: 200 len: 1726 microversion: 2.1 time: 0.156193 Oct 19 04:22:37.864421 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4077/7681] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:22:37 2022] GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0 => generated 1726 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:22:38.887974 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4e281417-8db6-4155-a12f-1ae306100777 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:22:38.888724 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4e281417-8db6-4155-a12f-1ae306100777 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0970a787-dfdd-444a-a0e4-c11aaf9adaf0] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:22:38.896628 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4e281417-8db6-4155-a12f-1ae306100777 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:22:38.897125 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4e281417-8db6-4155-a12f-1ae306100777 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:22:38.897604 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4e281417-8db6-4155-a12f-1ae306100777 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:22:38.898312 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4e281417-8db6-4155-a12f-1ae306100777 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:22:38.898901 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4e281417-8db6-4155-a12f-1ae306100777 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:22:38.899988 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4e281417-8db6-4155-a12f-1ae306100777 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:22:39.094331 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4e281417-8db6-4155-a12f-1ae306100777 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:22:39.102635 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4e281417-8db6-4155-a12f-1ae306100777 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0" status: 200 len: 1726 microversion: 2.1 time: 0.219167 Oct 19 04:22:39.103223 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3605/7682] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:22:38 2022] GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0 => generated 1726 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:22:40.127244 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-fb6ae314-ec97-4ecf-8792-47e6d654d168 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:22:40.127904 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-fb6ae314-ec97-4ecf-8792-47e6d654d168 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0970a787-dfdd-444a-a0e4-c11aaf9adaf0] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:22:40.135190 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fb6ae314-ec97-4ecf-8792-47e6d654d168 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:22:40.135692 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fb6ae314-ec97-4ecf-8792-47e6d654d168 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:22:40.136147 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fb6ae314-ec97-4ecf-8792-47e6d654d168 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:22:40.136851 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fb6ae314-ec97-4ecf-8792-47e6d654d168 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:22:40.137321 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fb6ae314-ec97-4ecf-8792-47e6d654d168 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:22:40.137788 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fb6ae314-ec97-4ecf-8792-47e6d654d168 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:22:40.275653 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-fb6ae314-ec97-4ecf-8792-47e6d654d168 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:22:40.284696 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-fb6ae314-ec97-4ecf-8792-47e6d654d168 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0" status: 200 len: 1731 microversion: 2.1 time: 0.161760 Oct 19 04:22:40.285272 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4078/7683] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:22:40 2022] GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0 => generated 1731 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:22:41.309315 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0093161c-fb02-4383-8e8e-d87f86a44c94 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:22:41.309940 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0093161c-fb02-4383-8e8e-d87f86a44c94 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0970a787-dfdd-444a-a0e4-c11aaf9adaf0] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:22:41.316759 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0093161c-fb02-4383-8e8e-d87f86a44c94 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:22:41.317251 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0093161c-fb02-4383-8e8e-d87f86a44c94 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:22:41.317727 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0093161c-fb02-4383-8e8e-d87f86a44c94 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:22:41.318424 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0093161c-fb02-4383-8e8e-d87f86a44c94 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:22:41.318904 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0093161c-fb02-4383-8e8e-d87f86a44c94 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:22:41.319321 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0093161c-fb02-4383-8e8e-d87f86a44c94 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:22:41.448598 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-0093161c-fb02-4383-8e8e-d87f86a44c94 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:22:41.456917 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0093161c-fb02-4383-8e8e-d87f86a44c94 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0" status: 200 len: 1731 microversion: 2.1 time: 0.151657 Oct 19 04:22:41.457504 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3606/7684] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:22:41 2022] GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0 => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:22:42.480296 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-13f5ca95-3aa7-492b-a24e-e0fcf11d2909 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:22:42.480930 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-13f5ca95-3aa7-492b-a24e-e0fcf11d2909 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0970a787-dfdd-444a-a0e4-c11aaf9adaf0] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:22:42.487762 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-13f5ca95-3aa7-492b-a24e-e0fcf11d2909 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:22:42.491207 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-13f5ca95-3aa7-492b-a24e-e0fcf11d2909 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:22:42.491207 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-13f5ca95-3aa7-492b-a24e-e0fcf11d2909 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:22:42.491207 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-13f5ca95-3aa7-492b-a24e-e0fcf11d2909 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:22:42.491207 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-13f5ca95-3aa7-492b-a24e-e0fcf11d2909 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:22:42.491207 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-13f5ca95-3aa7-492b-a24e-e0fcf11d2909 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:22:42.956432 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-13f5ca95-3aa7-492b-a24e-e0fcf11d2909 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:22:42.965295 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-13f5ca95-3aa7-492b-a24e-e0fcf11d2909 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0" status: 200 len: 1731 microversion: 2.1 time: 0.489521 Oct 19 04:22:42.965903 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4079/7685] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:22:42 2022] GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0 => generated 1731 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:22:43.989624 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0515c0a5-8bd1-4d4c-9475-562785ee8885 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:22:43.990252 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0515c0a5-8bd1-4d4c-9475-562785ee8885 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0970a787-dfdd-444a-a0e4-c11aaf9adaf0] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:22:43.997719 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0515c0a5-8bd1-4d4c-9475-562785ee8885 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:22:43.998219 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0515c0a5-8bd1-4d4c-9475-562785ee8885 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:22:43.998665 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0515c0a5-8bd1-4d4c-9475-562785ee8885 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:22:43.999368 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0515c0a5-8bd1-4d4c-9475-562785ee8885 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:22:43.999830 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0515c0a5-8bd1-4d4c-9475-562785ee8885 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:22:44.000314 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0515c0a5-8bd1-4d4c-9475-562785ee8885 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:22:44.127937 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-0515c0a5-8bd1-4d4c-9475-562785ee8885 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:22:44.136296 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0515c0a5-8bd1-4d4c-9475-562785ee8885 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0" status: 200 len: 1731 microversion: 2.1 time: 0.150991 Oct 19 04:22:44.136873 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3607/7686] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:22:43 2022] GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0 => generated 1731 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:22:45.159891 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-fa917230-5b22-44cb-929f-4c4e859ce9d2 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:22:45.160513 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-fa917230-5b22-44cb-929f-4c4e859ce9d2 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0970a787-dfdd-444a-a0e4-c11aaf9adaf0] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:22:45.167943 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fa917230-5b22-44cb-929f-4c4e859ce9d2 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:22:45.168435 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fa917230-5b22-44cb-929f-4c4e859ce9d2 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:22:45.168884 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fa917230-5b22-44cb-929f-4c4e859ce9d2 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:22:45.169608 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fa917230-5b22-44cb-929f-4c4e859ce9d2 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:22:45.170073 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fa917230-5b22-44cb-929f-4c4e859ce9d2 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:22:45.170511 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fa917230-5b22-44cb-929f-4c4e859ce9d2 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:22:45.303807 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-fa917230-5b22-44cb-929f-4c4e859ce9d2 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:22:45.312071 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-fa917230-5b22-44cb-929f-4c4e859ce9d2 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0" status: 200 len: 1731 microversion: 2.1 time: 0.156038 Oct 19 04:22:45.312649 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4080/7687] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:22:45 2022] GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:22:46.337005 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b00e52ae-81ba-4155-b8b6-72149e2fdecc tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:22:46.337651 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b00e52ae-81ba-4155-b8b6-72149e2fdecc tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0970a787-dfdd-444a-a0e4-c11aaf9adaf0] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:22:46.344459 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b00e52ae-81ba-4155-b8b6-72149e2fdecc tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:22:46.344950 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b00e52ae-81ba-4155-b8b6-72149e2fdecc tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:22:46.345415 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b00e52ae-81ba-4155-b8b6-72149e2fdecc tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:22:46.346112 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b00e52ae-81ba-4155-b8b6-72149e2fdecc tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:22:46.346571 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b00e52ae-81ba-4155-b8b6-72149e2fdecc tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:22:46.347002 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b00e52ae-81ba-4155-b8b6-72149e2fdecc tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:22:46.480065 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b00e52ae-81ba-4155-b8b6-72149e2fdecc tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:22:46.488703 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b00e52ae-81ba-4155-b8b6-72149e2fdecc tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0" status: 200 len: 1731 microversion: 2.1 time: 0.155608 Oct 19 04:22:46.489277 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3608/7688] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:22:46 2022] GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:22:47.512546 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-356cfe1f-7630-4f23-8fd9-340ff25ff5ab tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:22:47.513174 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-356cfe1f-7630-4f23-8fd9-340ff25ff5ab tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0970a787-dfdd-444a-a0e4-c11aaf9adaf0] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:22:47.520324 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-356cfe1f-7630-4f23-8fd9-340ff25ff5ab tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:22:47.520834 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-356cfe1f-7630-4f23-8fd9-340ff25ff5ab tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:22:47.521292 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-356cfe1f-7630-4f23-8fd9-340ff25ff5ab tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:22:47.522284 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-356cfe1f-7630-4f23-8fd9-340ff25ff5ab tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:22:47.522756 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-356cfe1f-7630-4f23-8fd9-340ff25ff5ab tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:22:47.523198 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-356cfe1f-7630-4f23-8fd9-340ff25ff5ab tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:22:47.652667 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-356cfe1f-7630-4f23-8fd9-340ff25ff5ab tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:22:47.661103 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-356cfe1f-7630-4f23-8fd9-340ff25ff5ab tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0" status: 200 len: 1731 microversion: 2.1 time: 0.152973 Oct 19 04:22:47.661722 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4081/7689] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:22:47 2022] GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0 => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:22:48.687093 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-129b1639-7f7b-4379-9041-24461704c6bd tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:22:48.687721 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-129b1639-7f7b-4379-9041-24461704c6bd tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0970a787-dfdd-444a-a0e4-c11aaf9adaf0] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:22:48.694772 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-129b1639-7f7b-4379-9041-24461704c6bd tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:22:48.695264 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-129b1639-7f7b-4379-9041-24461704c6bd tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:22:48.695768 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-129b1639-7f7b-4379-9041-24461704c6bd tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:22:48.697100 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-129b1639-7f7b-4379-9041-24461704c6bd tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:22:48.697592 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-129b1639-7f7b-4379-9041-24461704c6bd tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:22:48.698036 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-129b1639-7f7b-4379-9041-24461704c6bd tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:22:48.830308 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-129b1639-7f7b-4379-9041-24461704c6bd tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:22:48.838895 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-129b1639-7f7b-4379-9041-24461704c6bd tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0" status: 200 len: 1731 microversion: 2.1 time: 0.156197 Oct 19 04:22:48.839463 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3609/7690] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:22:48 2022] GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0 => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:22:49.861465 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-36ac0e3c-c5f4-48b4-81f1-6da63aa8d225 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:22:49.862100 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-36ac0e3c-c5f4-48b4-81f1-6da63aa8d225 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0970a787-dfdd-444a-a0e4-c11aaf9adaf0] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:22:49.869446 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-36ac0e3c-c5f4-48b4-81f1-6da63aa8d225 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:22:49.869948 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-36ac0e3c-c5f4-48b4-81f1-6da63aa8d225 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:22:49.870397 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-36ac0e3c-c5f4-48b4-81f1-6da63aa8d225 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:22:49.871096 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-36ac0e3c-c5f4-48b4-81f1-6da63aa8d225 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:22:49.871563 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-36ac0e3c-c5f4-48b4-81f1-6da63aa8d225 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:22:49.872004 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-36ac0e3c-c5f4-48b4-81f1-6da63aa8d225 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:22:49.999245 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-36ac0e3c-c5f4-48b4-81f1-6da63aa8d225 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:22:50.007607 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-36ac0e3c-c5f4-48b4-81f1-6da63aa8d225 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0" status: 200 len: 1731 microversion: 2.1 time: 0.150106 Oct 19 04:22:50.008192 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4082/7691] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:22:49 2022] GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0 => generated 1731 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:22:51.031331 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0402d764-03de-438a-935e-ec7ee0e71300 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:22:51.031959 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0402d764-03de-438a-935e-ec7ee0e71300 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0970a787-dfdd-444a-a0e4-c11aaf9adaf0] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:22:51.038963 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0402d764-03de-438a-935e-ec7ee0e71300 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:22:51.039460 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0402d764-03de-438a-935e-ec7ee0e71300 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:22:51.039913 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0402d764-03de-438a-935e-ec7ee0e71300 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:22:51.040618 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0402d764-03de-438a-935e-ec7ee0e71300 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:22:51.041085 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0402d764-03de-438a-935e-ec7ee0e71300 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:22:51.041559 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0402d764-03de-438a-935e-ec7ee0e71300 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:22:51.173964 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-0402d764-03de-438a-935e-ec7ee0e71300 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:22:51.182766 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0402d764-03de-438a-935e-ec7ee0e71300 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0" status: 200 len: 1731 microversion: 2.1 time: 0.155449 Oct 19 04:22:51.183358 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3610/7692] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:22:51 2022] GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:22:52.206828 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-135e2c57-d635-41a5-945b-ad5f56b6af21 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:22:52.207454 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-135e2c57-d635-41a5-945b-ad5f56b6af21 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0970a787-dfdd-444a-a0e4-c11aaf9adaf0] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:22:52.214957 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-135e2c57-d635-41a5-945b-ad5f56b6af21 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:22:52.215453 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-135e2c57-d635-41a5-945b-ad5f56b6af21 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:22:52.215901 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-135e2c57-d635-41a5-945b-ad5f56b6af21 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:22:52.216601 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-135e2c57-d635-41a5-945b-ad5f56b6af21 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:22:52.217065 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-135e2c57-d635-41a5-945b-ad5f56b6af21 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:22:52.217677 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-135e2c57-d635-41a5-945b-ad5f56b6af21 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:22:52.344596 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-135e2c57-d635-41a5-945b-ad5f56b6af21 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:22:52.352876 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-135e2c57-d635-41a5-945b-ad5f56b6af21 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0" status: 200 len: 1731 microversion: 2.1 time: 0.149951 Oct 19 04:22:52.353469 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4083/7693] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:22:52 2022] GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0 => generated 1731 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:22:53.376050 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ee558adc-95b3-4dd2-84f1-20b8b15a41ad tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:22:53.376675 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ee558adc-95b3-4dd2-84f1-20b8b15a41ad tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0970a787-dfdd-444a-a0e4-c11aaf9adaf0] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:22:53.383696 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ee558adc-95b3-4dd2-84f1-20b8b15a41ad tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:22:53.384220 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ee558adc-95b3-4dd2-84f1-20b8b15a41ad tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:22:53.384662 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ee558adc-95b3-4dd2-84f1-20b8b15a41ad tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:22:53.385358 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ee558adc-95b3-4dd2-84f1-20b8b15a41ad tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:22:53.385842 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ee558adc-95b3-4dd2-84f1-20b8b15a41ad tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:22:53.386268 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ee558adc-95b3-4dd2-84f1-20b8b15a41ad tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:22:53.519049 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ee558adc-95b3-4dd2-84f1-20b8b15a41ad tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:22:53.528282 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ee558adc-95b3-4dd2-84f1-20b8b15a41ad tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0" status: 200 len: 1731 microversion: 2.1 time: 0.156178 Oct 19 04:22:53.528867 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3611/7694] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:22:53 2022] GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:22:54.551984 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d72e25b2-dc1c-4cf6-970a-ef8fdc7e78c4 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:22:54.552582 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d72e25b2-dc1c-4cf6-970a-ef8fdc7e78c4 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0970a787-dfdd-444a-a0e4-c11aaf9adaf0] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:22:54.560204 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d72e25b2-dc1c-4cf6-970a-ef8fdc7e78c4 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:22:54.560710 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d72e25b2-dc1c-4cf6-970a-ef8fdc7e78c4 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:22:54.561171 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d72e25b2-dc1c-4cf6-970a-ef8fdc7e78c4 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:22:54.561919 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d72e25b2-dc1c-4cf6-970a-ef8fdc7e78c4 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:22:54.562398 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d72e25b2-dc1c-4cf6-970a-ef8fdc7e78c4 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:22:54.562851 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d72e25b2-dc1c-4cf6-970a-ef8fdc7e78c4 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:22:54.704361 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d72e25b2-dc1c-4cf6-970a-ef8fdc7e78c4 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:22:54.719164 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d72e25b2-dc1c-4cf6-970a-ef8fdc7e78c4 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0" status: 200 len: 1731 microversion: 2.1 time: 0.170662 Oct 19 04:22:54.720077 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4084/7695] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:22:54 2022] GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0 => generated 1731 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:22:55.797544 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-77d63447-0e57-4ebb-bf92-6e37f331d771 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:22:55.798176 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-77d63447-0e57-4ebb-bf92-6e37f331d771 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0970a787-dfdd-444a-a0e4-c11aaf9adaf0] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:22:55.806280 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-77d63447-0e57-4ebb-bf92-6e37f331d771 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:22:55.806780 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-77d63447-0e57-4ebb-bf92-6e37f331d771 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:22:55.807228 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-77d63447-0e57-4ebb-bf92-6e37f331d771 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:22:55.807933 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-77d63447-0e57-4ebb-bf92-6e37f331d771 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:22:55.808436 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-77d63447-0e57-4ebb-bf92-6e37f331d771 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:22:55.808872 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-77d63447-0e57-4ebb-bf92-6e37f331d771 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:22:55.939895 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-77d63447-0e57-4ebb-bf92-6e37f331d771 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:22:55.948990 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-77d63447-0e57-4ebb-bf92-6e37f331d771 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0" status: 200 len: 1731 microversion: 2.1 time: 0.155356 Oct 19 04:22:55.949595 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3612/7696] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:22:55 2022] GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:22:56.972528 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-057a96fa-165b-4061-a582-d6c1bf2110f5 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:22:56.973194 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-057a96fa-165b-4061-a582-d6c1bf2110f5 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0970a787-dfdd-444a-a0e4-c11aaf9adaf0] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:22:56.980109 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-057a96fa-165b-4061-a582-d6c1bf2110f5 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:22:56.980611 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-057a96fa-165b-4061-a582-d6c1bf2110f5 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:22:56.981066 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-057a96fa-165b-4061-a582-d6c1bf2110f5 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:22:56.981798 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-057a96fa-165b-4061-a582-d6c1bf2110f5 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:22:56.982267 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-057a96fa-165b-4061-a582-d6c1bf2110f5 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:22:56.982711 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-057a96fa-165b-4061-a582-d6c1bf2110f5 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:22:57.119580 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-057a96fa-165b-4061-a582-d6c1bf2110f5 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:22:57.127793 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-057a96fa-165b-4061-a582-d6c1bf2110f5 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0" status: 200 len: 1731 microversion: 2.1 time: 0.159259 Oct 19 04:22:57.128388 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4085/7697] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:22:56 2022] GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0 => generated 1731 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:22:58.153003 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-63b4e2a5-6eab-456a-b5d0-e0c76067d7d4 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:22:58.153658 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-63b4e2a5-6eab-456a-b5d0-e0c76067d7d4 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0970a787-dfdd-444a-a0e4-c11aaf9adaf0] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:22:58.161828 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-63b4e2a5-6eab-456a-b5d0-e0c76067d7d4 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:22:58.162490 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-63b4e2a5-6eab-456a-b5d0-e0c76067d7d4 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:22:58.162948 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-63b4e2a5-6eab-456a-b5d0-e0c76067d7d4 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:22:58.164052 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-63b4e2a5-6eab-456a-b5d0-e0c76067d7d4 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:22:58.164524 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-63b4e2a5-6eab-456a-b5d0-e0c76067d7d4 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:22:58.164996 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-63b4e2a5-6eab-456a-b5d0-e0c76067d7d4 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:22:58.301633 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-63b4e2a5-6eab-456a-b5d0-e0c76067d7d4 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:22:58.310166 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-63b4e2a5-6eab-456a-b5d0-e0c76067d7d4 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0" status: 200 len: 1731 microversion: 2.1 time: 0.161814 Oct 19 04:22:58.310752 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3613/7698] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:22:58 2022] GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0 => generated 1731 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:22:59.335587 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-adb84ecb-192a-4d15-bb13-97d7f90e7dee tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:22:59.336220 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-adb84ecb-192a-4d15-bb13-97d7f90e7dee tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0970a787-dfdd-444a-a0e4-c11aaf9adaf0] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:22:59.343370 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-adb84ecb-192a-4d15-bb13-97d7f90e7dee tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:22:59.343883 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-adb84ecb-192a-4d15-bb13-97d7f90e7dee tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:22:59.344479 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-adb84ecb-192a-4d15-bb13-97d7f90e7dee tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:22:59.345205 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-adb84ecb-192a-4d15-bb13-97d7f90e7dee tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:22:59.345712 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-adb84ecb-192a-4d15-bb13-97d7f90e7dee tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:22:59.346186 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-adb84ecb-192a-4d15-bb13-97d7f90e7dee tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:22:59.483847 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-adb84ecb-192a-4d15-bb13-97d7f90e7dee tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:22:59.492361 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-adb84ecb-192a-4d15-bb13-97d7f90e7dee tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0" status: 200 len: 1731 microversion: 2.1 time: 0.161069 Oct 19 04:22:59.493686 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4086/7699] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:22:59 2022] GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0 => generated 1731 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:23:00.276789 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-a7ec9a91-cdf4-48ab-9a5a-558372262edb req-db5d44ee-d8e9-4799-b168-0babdbdebcb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0970a787-dfdd-444a-a0e4-c11aaf9adaf0", "name": "network-vif-unplugged", "status": "completed", "tag": "0e97e794-6f03-4a7d-b17c-da810d04a800"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:23:00.287322 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-a7ec9a91-cdf4-48ab-9a5a-558372262edb req-db5d44ee-d8e9-4799-b168-0babdbdebcb4 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:00.287828 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-a7ec9a91-cdf4-48ab-9a5a-558372262edb req-db5d44ee-d8e9-4799-b168-0babdbdebcb4 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:00.288260 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-a7ec9a91-cdf4-48ab-9a5a-558372262edb req-db5d44ee-d8e9-4799-b168-0babdbdebcb4 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:00.300694 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-a7ec9a91-cdf4-48ab-9a5a-558372262edb req-db5d44ee-d8e9-4799-b168-0babdbdebcb4 service nova] Creating event network-vif-unplugged:0e97e794-6f03-4a7d-b17c-da810d04a800 for instance 0970a787-dfdd-444a-a0e4-c11aaf9adaf0 on n-h1-861333-8 Oct 19 04:23:00.306156 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [req-a7ec9a91-cdf4-48ab-9a5a-558372262edb req-db5d44ee-d8e9-4799-b168-0babdbdebcb4 service nova] Instance 0970a787-dfdd-444a-a0e4-c11aaf9adaf0 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-861333-8', 'n-h1-861333-8'} {{(pid=121135) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 04:23:00.317502 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-a7ec9a91-cdf4-48ab-9a5a-558372262edb req-db5d44ee-d8e9-4799-b168-0babdbdebcb4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.101431 Oct 19 04:23:00.318123 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3614/7700] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:23:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:23:00.517722 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-aa7a0947-05be-4362-b6b9-9aac594dd08b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:23:00.518602 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-aa7a0947-05be-4362-b6b9-9aac594dd08b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0970a787-dfdd-444a-a0e4-c11aaf9adaf0] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:23:00.525434 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-aa7a0947-05be-4362-b6b9-9aac594dd08b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:00.525949 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-aa7a0947-05be-4362-b6b9-9aac594dd08b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:00.526410 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-aa7a0947-05be-4362-b6b9-9aac594dd08b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:00.527130 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-aa7a0947-05be-4362-b6b9-9aac594dd08b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:00.527611 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-aa7a0947-05be-4362-b6b9-9aac594dd08b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:00.528063 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-aa7a0947-05be-4362-b6b9-9aac594dd08b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:00.660821 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-aa7a0947-05be-4362-b6b9-9aac594dd08b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:23:00.669554 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-aa7a0947-05be-4362-b6b9-9aac594dd08b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0" status: 200 len: 1730 microversion: 2.1 time: 0.156087 Oct 19 04:23:00.670362 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4087/7701] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:23:00 2022] GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0 => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:23:01.698676 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-dcf87fe6-0cdb-4887-a845-b0058efa5c48 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:23:01.699391 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-dcf87fe6-0cdb-4887-a845-b0058efa5c48 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0970a787-dfdd-444a-a0e4-c11aaf9adaf0] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:23:01.705795 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dcf87fe6-0cdb-4887-a845-b0058efa5c48 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:01.706291 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dcf87fe6-0cdb-4887-a845-b0058efa5c48 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:01.706738 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dcf87fe6-0cdb-4887-a845-b0058efa5c48 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:01.707440 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dcf87fe6-0cdb-4887-a845-b0058efa5c48 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:01.707904 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dcf87fe6-0cdb-4887-a845-b0058efa5c48 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:01.708341 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dcf87fe6-0cdb-4887-a845-b0058efa5c48 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:01.845020 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-dcf87fe6-0cdb-4887-a845-b0058efa5c48 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:23:01.853712 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-dcf87fe6-0cdb-4887-a845-b0058efa5c48 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0" status: 200 len: 1728 microversion: 2.1 time: 0.160268 Oct 19 04:23:01.854298 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3615/7702] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:23:01 2022] GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0 => generated 1728 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:23:02.346453 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-0c70aa83-1c66-4b72-a3bf-4c11fec6d312 req-7c2b2e98-9a66-4b6d-9a84-4813ef2b4229 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0970a787-dfdd-444a-a0e4-c11aaf9adaf0", "tag": "0e97e794-6f03-4a7d-b17c-da810d04a800"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:23:02.356295 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-0c70aa83-1c66-4b72-a3bf-4c11fec6d312 req-7c2b2e98-9a66-4b6d-9a84-4813ef2b4229 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:02.356796 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-0c70aa83-1c66-4b72-a3bf-4c11fec6d312 req-7c2b2e98-9a66-4b6d-9a84-4813ef2b4229 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:02.357248 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-0c70aa83-1c66-4b72-a3bf-4c11fec6d312 req-7c2b2e98-9a66-4b6d-9a84-4813ef2b4229 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:02.370110 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-0c70aa83-1c66-4b72-a3bf-4c11fec6d312 req-7c2b2e98-9a66-4b6d-9a84-4813ef2b4229 service nova] Creating event network-changed:0e97e794-6f03-4a7d-b17c-da810d04a800 for instance 0970a787-dfdd-444a-a0e4-c11aaf9adaf0 on n-h1-861333-8 Oct 19 04:23:02.375670 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [req-0c70aa83-1c66-4b72-a3bf-4c11fec6d312 req-7c2b2e98-9a66-4b6d-9a84-4813ef2b4229 service nova] Instance 0970a787-dfdd-444a-a0e4-c11aaf9adaf0 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-861333-8', 'n-h1-861333-8'} {{(pid=121134) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 04:23:02.391452 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-0c70aa83-1c66-4b72-a3bf-4c11fec6d312 req-7c2b2e98-9a66-4b6d-9a84-4813ef2b4229 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049961 Oct 19 04:23:02.392218 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4088/7703] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:23:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:23:02.878580 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6b3c9ee4-02d5-43f5-b366-f130b83904b1 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:23:02.885652 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6b3c9ee4-02d5-43f5-b366-f130b83904b1 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0970a787-dfdd-444a-a0e4-c11aaf9adaf0] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:23:02.888441 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6b3c9ee4-02d5-43f5-b366-f130b83904b1 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:02.889850 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6b3c9ee4-02d5-43f5-b366-f130b83904b1 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:02.890556 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6b3c9ee4-02d5-43f5-b366-f130b83904b1 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:02.891643 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6b3c9ee4-02d5-43f5-b366-f130b83904b1 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:02.892324 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6b3c9ee4-02d5-43f5-b366-f130b83904b1 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:02.892972 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6b3c9ee4-02d5-43f5-b366-f130b83904b1 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:03.042133 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-6b3c9ee4-02d5-43f5-b366-f130b83904b1 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:23:03.051229 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6b3c9ee4-02d5-43f5-b366-f130b83904b1 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0" status: 200 len: 1728 microversion: 2.1 time: 0.176846 Oct 19 04:23:03.051834 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3616/7704] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:23:02 2022] GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0 => generated 1728 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:23:04.076464 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-55b9691e-8b31-4a4e-a804-755420e680d6 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:23:04.077185 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-55b9691e-8b31-4a4e-a804-755420e680d6 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0970a787-dfdd-444a-a0e4-c11aaf9adaf0] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:23:04.083433 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-55b9691e-8b31-4a4e-a804-755420e680d6 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:04.083936 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-55b9691e-8b31-4a4e-a804-755420e680d6 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:04.084400 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-55b9691e-8b31-4a4e-a804-755420e680d6 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:04.085111 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-55b9691e-8b31-4a4e-a804-755420e680d6 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:04.085614 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-55b9691e-8b31-4a4e-a804-755420e680d6 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:04.086062 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-55b9691e-8b31-4a4e-a804-755420e680d6 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:04.220862 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-55b9691e-8b31-4a4e-a804-755420e680d6 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:23:04.229825 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-55b9691e-8b31-4a4e-a804-755420e680d6 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0" status: 200 len: 1728 microversion: 2.1 time: 0.158727 Oct 19 04:23:04.230399 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4089/7705] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:23:04 2022] GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0 => generated 1728 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:23:05.253654 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-bccd5e91-e5a7-4595-98f5-c8322c96b4f7 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:23:05.254286 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-bccd5e91-e5a7-4595-98f5-c8322c96b4f7 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0970a787-dfdd-444a-a0e4-c11aaf9adaf0] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:23:05.261941 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bccd5e91-e5a7-4595-98f5-c8322c96b4f7 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:05.262528 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bccd5e91-e5a7-4595-98f5-c8322c96b4f7 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:05.263057 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bccd5e91-e5a7-4595-98f5-c8322c96b4f7 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:05.263826 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bccd5e91-e5a7-4595-98f5-c8322c96b4f7 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:05.264356 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bccd5e91-e5a7-4595-98f5-c8322c96b4f7 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:05.264856 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bccd5e91-e5a7-4595-98f5-c8322c96b4f7 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:05.401161 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-bccd5e91-e5a7-4595-98f5-c8322c96b4f7 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:23:05.409598 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-bccd5e91-e5a7-4595-98f5-c8322c96b4f7 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0" status: 200 len: 1728 microversion: 2.1 time: 0.159841 Oct 19 04:23:05.410199 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3617/7706] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:23:05 2022] GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0 => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:23:06.432201 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4ebaa4f9-2cbd-4edf-9c69-0cb96ffd7b3f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:23:06.432840 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4ebaa4f9-2cbd-4edf-9c69-0cb96ffd7b3f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0970a787-dfdd-444a-a0e4-c11aaf9adaf0] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:23:06.435705 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=33 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:23:06.440481 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4ebaa4f9-2cbd-4edf-9c69-0cb96ffd7b3f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:06.440994 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4ebaa4f9-2cbd-4edf-9c69-0cb96ffd7b3f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:06.441488 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4ebaa4f9-2cbd-4edf-9c69-0cb96ffd7b3f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:06.442211 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4ebaa4f9-2cbd-4edf-9c69-0cb96ffd7b3f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:06.442736 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4ebaa4f9-2cbd-4edf-9c69-0cb96ffd7b3f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:06.443137 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4ebaa4f9-2cbd-4edf-9c69-0cb96ffd7b3f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:06.447740 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:23:06.577926 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-4ebaa4f9-2cbd-4edf-9c69-0cb96ffd7b3f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:23:06.586288 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4ebaa4f9-2cbd-4edf-9c69-0cb96ffd7b3f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0" status: 200 len: 1728 microversion: 2.1 time: 0.158000 Oct 19 04:23:06.587540 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4090/7707] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:23:06 2022] GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0 => generated 1728 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:23:07.610306 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b2d4ab08-b7ae-44cb-9a02-1d025a3a2b89 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:23:07.610955 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b2d4ab08-b7ae-44cb-9a02-1d025a3a2b89 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0970a787-dfdd-444a-a0e4-c11aaf9adaf0] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:23:07.613759 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=29 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:23:07.618949 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b2d4ab08-b7ae-44cb-9a02-1d025a3a2b89 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:07.619440 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b2d4ab08-b7ae-44cb-9a02-1d025a3a2b89 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:07.619886 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b2d4ab08-b7ae-44cb-9a02-1d025a3a2b89 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:07.620582 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b2d4ab08-b7ae-44cb-9a02-1d025a3a2b89 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:07.621040 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b2d4ab08-b7ae-44cb-9a02-1d025a3a2b89 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:07.621510 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b2d4ab08-b7ae-44cb-9a02-1d025a3a2b89 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:07.750175 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b2d4ab08-b7ae-44cb-9a02-1d025a3a2b89 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:23:07.758346 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b2d4ab08-b7ae-44cb-9a02-1d025a3a2b89 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0" status: 200 len: 1728 microversion: 2.1 time: 0.151998 Oct 19 04:23:07.759538 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3618/7708] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:23:07 2022] GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0 => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:23:08.782005 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-fc366917-27a5-4bbd-a2fb-3faf5e2859c2 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:23:08.782635 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-fc366917-27a5-4bbd-a2fb-3faf5e2859c2 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0970a787-dfdd-444a-a0e4-c11aaf9adaf0] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:23:08.790684 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fc366917-27a5-4bbd-a2fb-3faf5e2859c2 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:08.791178 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fc366917-27a5-4bbd-a2fb-3faf5e2859c2 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:08.791623 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fc366917-27a5-4bbd-a2fb-3faf5e2859c2 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:08.792323 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fc366917-27a5-4bbd-a2fb-3faf5e2859c2 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:08.792787 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fc366917-27a5-4bbd-a2fb-3faf5e2859c2 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:08.793231 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fc366917-27a5-4bbd-a2fb-3faf5e2859c2 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:08.920598 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-fc366917-27a5-4bbd-a2fb-3faf5e2859c2 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:23:08.929030 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-fc366917-27a5-4bbd-a2fb-3faf5e2859c2 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0" status: 200 len: 1728 microversion: 2.1 time: 0.151062 Oct 19 04:23:08.929647 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4091/7709] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:23:08 2022] GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0 => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:23:09.953732 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3240dc64-136d-4ce0-bab7-280477c1c469 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:23:09.954356 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-3240dc64-136d-4ce0-bab7-280477c1c469 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0970a787-dfdd-444a-a0e4-c11aaf9adaf0] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:23:09.961347 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3240dc64-136d-4ce0-bab7-280477c1c469 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:09.961874 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3240dc64-136d-4ce0-bab7-280477c1c469 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:09.962318 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3240dc64-136d-4ce0-bab7-280477c1c469 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:09.963013 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3240dc64-136d-4ce0-bab7-280477c1c469 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:09.963472 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3240dc64-136d-4ce0-bab7-280477c1c469 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:09.963900 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3240dc64-136d-4ce0-bab7-280477c1c469 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:09.966475 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=89 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:23:10.096546 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-3240dc64-136d-4ce0-bab7-280477c1c469 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:23:10.104890 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-3240dc64-136d-4ce0-bab7-280477c1c469 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0" status: 200 len: 1728 microversion: 2.1 time: 0.155505 Oct 19 04:23:10.105492 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3619/7710] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:23:09 2022] GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0 => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:23:11.128194 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-cce5f52f-b66c-48ee-9702-bab06e8e0f1d tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:23:11.128747 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-cce5f52f-b66c-48ee-9702-bab06e8e0f1d tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0970a787-dfdd-444a-a0e4-c11aaf9adaf0] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:23:11.135906 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cce5f52f-b66c-48ee-9702-bab06e8e0f1d tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:11.136414 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cce5f52f-b66c-48ee-9702-bab06e8e0f1d tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:11.136871 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cce5f52f-b66c-48ee-9702-bab06e8e0f1d tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:11.137612 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cce5f52f-b66c-48ee-9702-bab06e8e0f1d tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:11.138127 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cce5f52f-b66c-48ee-9702-bab06e8e0f1d tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:11.138576 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cce5f52f-b66c-48ee-9702-bab06e8e0f1d tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:11.275962 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-cce5f52f-b66c-48ee-9702-bab06e8e0f1d tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:23:11.284359 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-cce5f52f-b66c-48ee-9702-bab06e8e0f1d tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0" status: 200 len: 1728 microversion: 2.1 time: 0.160194 Oct 19 04:23:11.284953 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4092/7711] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:23:11 2022] GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0 => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:23:12.308350 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f6d45d20-3eac-45f3-afbb-49097aa2a03d tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:23:12.308972 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f6d45d20-3eac-45f3-afbb-49097aa2a03d tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0970a787-dfdd-444a-a0e4-c11aaf9adaf0] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:23:12.316045 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f6d45d20-3eac-45f3-afbb-49097aa2a03d tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:12.316515 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f6d45d20-3eac-45f3-afbb-49097aa2a03d tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:12.316956 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f6d45d20-3eac-45f3-afbb-49097aa2a03d tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:12.317676 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f6d45d20-3eac-45f3-afbb-49097aa2a03d tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:12.318132 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f6d45d20-3eac-45f3-afbb-49097aa2a03d tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:12.318556 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f6d45d20-3eac-45f3-afbb-49097aa2a03d tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:12.451507 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f6d45d20-3eac-45f3-afbb-49097aa2a03d tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:23:12.459692 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f6d45d20-3eac-45f3-afbb-49097aa2a03d tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0" status: 200 len: 1728 microversion: 2.1 time: 0.155885 Oct 19 04:23:12.463153 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3620/7712] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:23:12 2022] GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0 => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:23:13.485214 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7adcc246-0ccc-4eec-ae5b-c05c7479e114 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:23:13.485877 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7adcc246-0ccc-4eec-ae5b-c05c7479e114 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0970a787-dfdd-444a-a0e4-c11aaf9adaf0] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:23:13.492700 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7adcc246-0ccc-4eec-ae5b-c05c7479e114 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:13.493790 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7adcc246-0ccc-4eec-ae5b-c05c7479e114 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:13.494246 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7adcc246-0ccc-4eec-ae5b-c05c7479e114 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:13.494953 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7adcc246-0ccc-4eec-ae5b-c05c7479e114 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:13.495416 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7adcc246-0ccc-4eec-ae5b-c05c7479e114 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:13.495855 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7adcc246-0ccc-4eec-ae5b-c05c7479e114 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:13.624353 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-7adcc246-0ccc-4eec-ae5b-c05c7479e114 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:23:13.632571 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7adcc246-0ccc-4eec-ae5b-c05c7479e114 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0" status: 200 len: 1728 microversion: 2.1 time: 0.151613 Oct 19 04:23:13.633145 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4093/7713] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:23:13 2022] GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0 => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:23:14.656893 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-88217984-b73d-445d-a354-4c185ef06aea tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:23:14.657465 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-88217984-b73d-445d-a354-4c185ef06aea tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0970a787-dfdd-444a-a0e4-c11aaf9adaf0] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:23:14.664391 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-88217984-b73d-445d-a354-4c185ef06aea tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:14.664887 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-88217984-b73d-445d-a354-4c185ef06aea tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:14.665869 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-88217984-b73d-445d-a354-4c185ef06aea tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:14.666574 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-88217984-b73d-445d-a354-4c185ef06aea tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:14.667038 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-88217984-b73d-445d-a354-4c185ef06aea tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:14.667475 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-88217984-b73d-445d-a354-4c185ef06aea tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:14.799494 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-88217984-b73d-445d-a354-4c185ef06aea tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:23:14.808474 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-88217984-b73d-445d-a354-4c185ef06aea tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0" status: 200 len: 1728 microversion: 2.1 time: 0.155584 Oct 19 04:23:14.809055 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3621/7714] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:23:14 2022] GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0 => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:23:15.831716 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-68101ebc-fb9c-406c-9c75-6770661518cb tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:23:15.832373 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-68101ebc-fb9c-406c-9c75-6770661518cb tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0970a787-dfdd-444a-a0e4-c11aaf9adaf0] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:23:15.839141 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-68101ebc-fb9c-406c-9c75-6770661518cb tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:15.839640 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-68101ebc-fb9c-406c-9c75-6770661518cb tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:15.840092 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-68101ebc-fb9c-406c-9c75-6770661518cb tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:15.840804 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-68101ebc-fb9c-406c-9c75-6770661518cb tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:15.841272 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-68101ebc-fb9c-406c-9c75-6770661518cb tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:15.841737 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-68101ebc-fb9c-406c-9c75-6770661518cb tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:15.971677 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-68101ebc-fb9c-406c-9c75-6770661518cb tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:23:15.980515 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-68101ebc-fb9c-406c-9c75-6770661518cb tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0" status: 200 len: 1725 microversion: 2.1 time: 0.152737 Oct 19 04:23:15.981272 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4094/7715] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:23:15 2022] GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:23:16.003420 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3a647f9c-b7bc-4ad1-921f-74eab598c35c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:23:16.003968 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-3a647f9c-b7bc-4ad1-921f-74eab598c35c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0970a787-dfdd-444a-a0e4-c11aaf9adaf0] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:23:16.011073 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3a647f9c-b7bc-4ad1-921f-74eab598c35c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:16.011642 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3a647f9c-b7bc-4ad1-921f-74eab598c35c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:16.012093 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3a647f9c-b7bc-4ad1-921f-74eab598c35c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:16.012799 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3a647f9c-b7bc-4ad1-921f-74eab598c35c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:16.013258 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3a647f9c-b7bc-4ad1-921f-74eab598c35c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:16.013716 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3a647f9c-b7bc-4ad1-921f-74eab598c35c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:16.051483 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3a647f9c-b7bc-4ad1-921f-74eab598c35c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:16.051978 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3a647f9c-b7bc-4ad1-921f-74eab598c35c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:16.052446 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3a647f9c-b7bc-4ad1-921f-74eab598c35c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:16.053165 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3a647f9c-b7bc-4ad1-921f-74eab598c35c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:16.053661 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3a647f9c-b7bc-4ad1-921f-74eab598c35c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:16.054099 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3a647f9c-b7bc-4ad1-921f-74eab598c35c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:16.075061 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-3a647f9c-b7bc-4ad1-921f-74eab598c35c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Getting quotas for project 25caabf71e854e4ba4ee627309de481d. Resources: {'cores', 'ram'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 04:23:16.080187 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-3a647f9c-b7bc-4ad1-921f-74eab598c35c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Getting quotas for user 31018706f7fd45988df04518eee6c044 and project 25caabf71e854e4ba4ee627309de481d. Resources: {'cores', 'ram'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 04:23:16.448811 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-3a647f9c-b7bc-4ad1-921f-74eab598c35c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "POST /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0/action" status: 202 len: 0 microversion: 2.1 time: 0.449058 Oct 19 04:23:16.449649 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3622/7716] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 04:23:15 2022] POST /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0/action => generated 0 bytes in 451 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 04:23:16.457789 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2490a6c9-0c53-4c2e-82b8-a12077dcc551 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:23:16.458438 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2490a6c9-0c53-4c2e-82b8-a12077dcc551 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0970a787-dfdd-444a-a0e4-c11aaf9adaf0] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:23:16.465207 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2490a6c9-0c53-4c2e-82b8-a12077dcc551 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:16.465745 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2490a6c9-0c53-4c2e-82b8-a12077dcc551 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:16.466207 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2490a6c9-0c53-4c2e-82b8-a12077dcc551 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:16.466929 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2490a6c9-0c53-4c2e-82b8-a12077dcc551 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:16.467405 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2490a6c9-0c53-4c2e-82b8-a12077dcc551 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:16.467869 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2490a6c9-0c53-4c2e-82b8-a12077dcc551 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:16.602085 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-2490a6c9-0c53-4c2e-82b8-a12077dcc551 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:23:16.611157 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2490a6c9-0c53-4c2e-82b8-a12077dcc551 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0" status: 200 len: 1724 microversion: 2.1 time: 0.157209 Oct 19 04:23:16.611752 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4095/7717] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:23:16 2022] GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:23:17.635831 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-07f0844e-15b0-42de-a284-315e4dcad812 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:23:17.636545 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-07f0844e-15b0-42de-a284-315e4dcad812 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0970a787-dfdd-444a-a0e4-c11aaf9adaf0] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:23:17.642764 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-07f0844e-15b0-42de-a284-315e4dcad812 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:17.643253 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-07f0844e-15b0-42de-a284-315e4dcad812 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:17.643699 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-07f0844e-15b0-42de-a284-315e4dcad812 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:17.644389 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-07f0844e-15b0-42de-a284-315e4dcad812 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:17.644844 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-07f0844e-15b0-42de-a284-315e4dcad812 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:17.645306 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-07f0844e-15b0-42de-a284-315e4dcad812 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:17.778290 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-07f0844e-15b0-42de-a284-315e4dcad812 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:23:17.786622 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-07f0844e-15b0-42de-a284-315e4dcad812 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0" status: 200 len: 1724 microversion: 2.1 time: 0.155935 Oct 19 04:23:17.787203 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3623/7718] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:23:17 2022] GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:23:18.104629 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-accb73cc-575d-4605-b962-5f7e69b3378d req-85857c3a-8fbd-4a53-a46d-b6df6472f60b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0970a787-dfdd-444a-a0e4-c11aaf9adaf0", "name": "network-vif-plugged", "status": "completed", "tag": "0e97e794-6f03-4a7d-b17c-da810d04a800"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:23:18.114521 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-accb73cc-575d-4605-b962-5f7e69b3378d req-85857c3a-8fbd-4a53-a46d-b6df6472f60b service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:18.115012 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-accb73cc-575d-4605-b962-5f7e69b3378d req-85857c3a-8fbd-4a53-a46d-b6df6472f60b service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:18.115455 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-accb73cc-575d-4605-b962-5f7e69b3378d req-85857c3a-8fbd-4a53-a46d-b6df6472f60b service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:18.127340 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-accb73cc-575d-4605-b962-5f7e69b3378d req-85857c3a-8fbd-4a53-a46d-b6df6472f60b service nova] Creating event network-vif-plugged:0e97e794-6f03-4a7d-b17c-da810d04a800 for instance 0970a787-dfdd-444a-a0e4-c11aaf9adaf0 on n-h1-861333-8 Oct 19 04:23:18.132791 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [req-accb73cc-575d-4605-b962-5f7e69b3378d req-85857c3a-8fbd-4a53-a46d-b6df6472f60b service nova] Instance 0970a787-dfdd-444a-a0e4-c11aaf9adaf0 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-861333-8', 'n-h1-861333-8'} {{(pid=121134) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 04:23:18.143524 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-accb73cc-575d-4605-b962-5f7e69b3378d req-85857c3a-8fbd-4a53-a46d-b6df6472f60b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096833 Oct 19 04:23:18.148055 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4096/7719] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:23:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:23:18.811489 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0da32380-0a79-46d1-9d43-d458e961ad95 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:23:18.812104 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0da32380-0a79-46d1-9d43-d458e961ad95 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0970a787-dfdd-444a-a0e4-c11aaf9adaf0] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:23:18.815037 n-d-861333-8 devstack@n-api.service[121135]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 04:23:18.815175 n-d-861333-8 devstack@n-api.service[121135]: Wed Oct 19 04:23:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0 (ip 10.222.0.52) !!! Oct 19 04:23:18.824737 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0da32380-0a79-46d1-9d43-d458e961ad95 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:18.825240 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0da32380-0a79-46d1-9d43-d458e961ad95 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:18.825723 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0da32380-0a79-46d1-9d43-d458e961ad95 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:18.826438 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0da32380-0a79-46d1-9d43-d458e961ad95 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:18.826901 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0da32380-0a79-46d1-9d43-d458e961ad95 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:18.827362 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0da32380-0a79-46d1-9d43-d458e961ad95 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:18.958059 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-0da32380-0a79-46d1-9d43-d458e961ad95 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:23:18.966449 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0da32380-0a79-46d1-9d43-d458e961ad95 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0" status: 200 len: 1724 microversion: 2.1 time: 0.158920 Oct 19 04:23:18.967053 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3624/7720] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:23:18 2022] GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:23:19.991473 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-cd928fa3-bf0e-4804-a05e-e1c87c9f26ca tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:23:19.992187 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-cd928fa3-bf0e-4804-a05e-e1c87c9f26ca tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0970a787-dfdd-444a-a0e4-c11aaf9adaf0] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:23:19.998506 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cd928fa3-bf0e-4804-a05e-e1c87c9f26ca tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:19.999003 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cd928fa3-bf0e-4804-a05e-e1c87c9f26ca tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:19.999454 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cd928fa3-bf0e-4804-a05e-e1c87c9f26ca tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:20.000173 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cd928fa3-bf0e-4804-a05e-e1c87c9f26ca tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:20.000620 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cd928fa3-bf0e-4804-a05e-e1c87c9f26ca tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:20.001055 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cd928fa3-bf0e-4804-a05e-e1c87c9f26ca tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:20.140693 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-cd928fa3-bf0e-4804-a05e-e1c87c9f26ca tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:23:20.150279 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-cd928fa3-bf0e-4804-a05e-e1c87c9f26ca tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0" status: 200 len: 1724 microversion: 2.1 time: 0.163370 Oct 19 04:23:20.150887 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4097/7721] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:23:19 2022] GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:23:21.174182 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d38f2861-5bd8-4bda-85f8-0a2fa0dd6c82 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:23:21.174805 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d38f2861-5bd8-4bda-85f8-0a2fa0dd6c82 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0970a787-dfdd-444a-a0e4-c11aaf9adaf0] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:23:21.181678 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d38f2861-5bd8-4bda-85f8-0a2fa0dd6c82 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:21.184754 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d38f2861-5bd8-4bda-85f8-0a2fa0dd6c82 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:21.184754 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d38f2861-5bd8-4bda-85f8-0a2fa0dd6c82 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:21.184754 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d38f2861-5bd8-4bda-85f8-0a2fa0dd6c82 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:21.184754 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d38f2861-5bd8-4bda-85f8-0a2fa0dd6c82 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:21.184754 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d38f2861-5bd8-4bda-85f8-0a2fa0dd6c82 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:21.314910 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d38f2861-5bd8-4bda-85f8-0a2fa0dd6c82 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:23:21.324392 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d38f2861-5bd8-4bda-85f8-0a2fa0dd6c82 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0" status: 200 len: 1724 microversion: 2.1 time: 0.153543 Oct 19 04:23:21.332993 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3625/7722] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:23:21 2022] GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:23:22.346493 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7f414f9b-caad-4825-bf53-ef8f05ffd0ac tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:23:22.347123 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7f414f9b-caad-4825-bf53-ef8f05ffd0ac tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0970a787-dfdd-444a-a0e4-c11aaf9adaf0] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:23:22.355407 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7f414f9b-caad-4825-bf53-ef8f05ffd0ac tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:22.355908 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7f414f9b-caad-4825-bf53-ef8f05ffd0ac tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:22.356433 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7f414f9b-caad-4825-bf53-ef8f05ffd0ac tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:22.357128 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7f414f9b-caad-4825-bf53-ef8f05ffd0ac tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:22.357619 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7f414f9b-caad-4825-bf53-ef8f05ffd0ac tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:22.358058 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7f414f9b-caad-4825-bf53-ef8f05ffd0ac tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:22.542005 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-7f414f9b-caad-4825-bf53-ef8f05ffd0ac tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:23:22.550520 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7f414f9b-caad-4825-bf53-ef8f05ffd0ac tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0" status: 200 len: 1724 microversion: 2.1 time: 0.207986 Oct 19 04:23:22.551136 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4098/7723] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:23:22 2022] GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0 => generated 1724 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:23:22.860802 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-7ac8e92e-c0fd-4b75-8891-e3f5c3e3cdcf req-26a8ba25-55a8-40e1-a1c0-c54fdb41511d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0970a787-dfdd-444a-a0e4-c11aaf9adaf0", "name": "network-vif-unplugged", "status": "completed", "tag": "0e97e794-6f03-4a7d-b17c-da810d04a800"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:23:22.871186 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-7ac8e92e-c0fd-4b75-8891-e3f5c3e3cdcf req-26a8ba25-55a8-40e1-a1c0-c54fdb41511d service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:22.871667 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-7ac8e92e-c0fd-4b75-8891-e3f5c3e3cdcf req-26a8ba25-55a8-40e1-a1c0-c54fdb41511d service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:22.872121 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-7ac8e92e-c0fd-4b75-8891-e3f5c3e3cdcf req-26a8ba25-55a8-40e1-a1c0-c54fdb41511d service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:22.883756 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-7ac8e92e-c0fd-4b75-8891-e3f5c3e3cdcf req-26a8ba25-55a8-40e1-a1c0-c54fdb41511d service nova] Creating event network-vif-unplugged:0e97e794-6f03-4a7d-b17c-da810d04a800 for instance 0970a787-dfdd-444a-a0e4-c11aaf9adaf0 on n-h2-861333-8 Oct 19 04:23:22.889530 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [req-7ac8e92e-c0fd-4b75-8891-e3f5c3e3cdcf req-26a8ba25-55a8-40e1-a1c0-c54fdb41511d service nova] Instance 0970a787-dfdd-444a-a0e4-c11aaf9adaf0 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-861333-8', 'n-h1-861333-8'} {{(pid=121135) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 04:23:22.901395 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-7ac8e92e-c0fd-4b75-8891-e3f5c3e3cdcf req-26a8ba25-55a8-40e1-a1c0-c54fdb41511d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043836 Oct 19 04:23:22.905456 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3626/7724] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:23:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:23:23.574370 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-254faec6-5a32-47e7-ab1a-f14169306b1a tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:23:23.575009 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-254faec6-5a32-47e7-ab1a-f14169306b1a tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0970a787-dfdd-444a-a0e4-c11aaf9adaf0] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:23:23.582216 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-254faec6-5a32-47e7-ab1a-f14169306b1a tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:23.582755 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-254faec6-5a32-47e7-ab1a-f14169306b1a tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:23.583245 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-254faec6-5a32-47e7-ab1a-f14169306b1a tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:23.583970 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-254faec6-5a32-47e7-ab1a-f14169306b1a tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:23.584446 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-254faec6-5a32-47e7-ab1a-f14169306b1a tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:23.584896 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-254faec6-5a32-47e7-ab1a-f14169306b1a tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:23.801583 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-254faec6-5a32-47e7-ab1a-f14169306b1a tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:23:23.809926 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-254faec6-5a32-47e7-ab1a-f14169306b1a tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0" status: 200 len: 1724 microversion: 2.1 time: 0.239590 Oct 19 04:23:23.810632 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4099/7725] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:23:23 2022] GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0 => generated 1724 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:23:24.835604 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c54a4616-5aeb-4dcc-9225-a5bd49cd1318 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:23:24.836305 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c54a4616-5aeb-4dcc-9225-a5bd49cd1318 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0970a787-dfdd-444a-a0e4-c11aaf9adaf0] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:23:24.843019 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c54a4616-5aeb-4dcc-9225-a5bd49cd1318 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:24.843506 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c54a4616-5aeb-4dcc-9225-a5bd49cd1318 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:24.843950 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c54a4616-5aeb-4dcc-9225-a5bd49cd1318 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:24.844643 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c54a4616-5aeb-4dcc-9225-a5bd49cd1318 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:24.845094 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c54a4616-5aeb-4dcc-9225-a5bd49cd1318 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:24.845709 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c54a4616-5aeb-4dcc-9225-a5bd49cd1318 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:24.925334 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-3ea8380f-388d-4605-bcec-49d95cc18e5a req-8043bc95-309b-473c-b08f-7216a3cb59e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0970a787-dfdd-444a-a0e4-c11aaf9adaf0", "tag": "0e97e794-6f03-4a7d-b17c-da810d04a800"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:23:24.936872 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-3ea8380f-388d-4605-bcec-49d95cc18e5a req-8043bc95-309b-473c-b08f-7216a3cb59e3 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:24.938042 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-3ea8380f-388d-4605-bcec-49d95cc18e5a req-8043bc95-309b-473c-b08f-7216a3cb59e3 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:24.938581 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-3ea8380f-388d-4605-bcec-49d95cc18e5a req-8043bc95-309b-473c-b08f-7216a3cb59e3 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:24.950956 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-3ea8380f-388d-4605-bcec-49d95cc18e5a req-8043bc95-309b-473c-b08f-7216a3cb59e3 service nova] Creating event network-changed:0e97e794-6f03-4a7d-b17c-da810d04a800 for instance 0970a787-dfdd-444a-a0e4-c11aaf9adaf0 on n-h2-861333-8 Oct 19 04:23:24.956682 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [req-3ea8380f-388d-4605-bcec-49d95cc18e5a req-8043bc95-309b-473c-b08f-7216a3cb59e3 service nova] Instance 0970a787-dfdd-444a-a0e4-c11aaf9adaf0 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-861333-8', 'n-h1-861333-8'} {{(pid=121134) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 04:23:24.969461 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-3ea8380f-388d-4605-bcec-49d95cc18e5a req-8043bc95-309b-473c-b08f-7216a3cb59e3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047667 Oct 19 04:23:24.970584 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4100/7726] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:23:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:23:24.994193 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c54a4616-5aeb-4dcc-9225-a5bd49cd1318 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:23:25.003052 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c54a4616-5aeb-4dcc-9225-a5bd49cd1318 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0" status: 200 len: 1724 microversion: 2.1 time: 0.172750 Oct 19 04:23:25.017869 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3627/7727] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:23:24 2022] GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0 => generated 1724 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:23:26.028026 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-79c44c29-bb40-4821-8b8d-f9c62921421a tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:23:26.028745 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-79c44c29-bb40-4821-8b8d-f9c62921421a tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0970a787-dfdd-444a-a0e4-c11aaf9adaf0] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:23:26.035179 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-79c44c29-bb40-4821-8b8d-f9c62921421a tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:26.036291 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-79c44c29-bb40-4821-8b8d-f9c62921421a tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:26.036291 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-79c44c29-bb40-4821-8b8d-f9c62921421a tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:26.036872 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-79c44c29-bb40-4821-8b8d-f9c62921421a tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:26.037342 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-79c44c29-bb40-4821-8b8d-f9c62921421a tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:26.037839 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-79c44c29-bb40-4821-8b8d-f9c62921421a tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:26.172928 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-79c44c29-bb40-4821-8b8d-f9c62921421a tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:23:26.181454 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-79c44c29-bb40-4821-8b8d-f9c62921421a tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0" status: 200 len: 1724 microversion: 2.1 time: 0.158837 Oct 19 04:23:26.182042 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4101/7728] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:23:26 2022] GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:23:27.205534 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-491aea58-5d18-4ab8-9fac-865c3edb3130 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:23:27.206258 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-491aea58-5d18-4ab8-9fac-865c3edb3130 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0970a787-dfdd-444a-a0e4-c11aaf9adaf0] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:23:27.209136 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=3 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:23:27.214814 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-491aea58-5d18-4ab8-9fac-865c3edb3130 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:27.215410 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-491aea58-5d18-4ab8-9fac-865c3edb3130 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:27.215850 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-491aea58-5d18-4ab8-9fac-865c3edb3130 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:27.216581 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-491aea58-5d18-4ab8-9fac-865c3edb3130 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:27.217031 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-491aea58-5d18-4ab8-9fac-865c3edb3130 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:27.217481 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-491aea58-5d18-4ab8-9fac-865c3edb3130 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:27.351210 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-491aea58-5d18-4ab8-9fac-865c3edb3130 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:23:27.359880 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-491aea58-5d18-4ab8-9fac-865c3edb3130 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0" status: 200 len: 1724 microversion: 2.1 time: 0.158308 Oct 19 04:23:27.360550 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3628/7729] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:23:27 2022] GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:23:28.383545 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8eff089d-0c90-409e-b447-369c670a995d tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:23:28.384250 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8eff089d-0c90-409e-b447-369c670a995d tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0970a787-dfdd-444a-a0e4-c11aaf9adaf0] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:23:28.392184 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8eff089d-0c90-409e-b447-369c670a995d tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:28.393129 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8eff089d-0c90-409e-b447-369c670a995d tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:28.393614 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8eff089d-0c90-409e-b447-369c670a995d tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:28.394546 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8eff089d-0c90-409e-b447-369c670a995d tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:28.395020 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8eff089d-0c90-409e-b447-369c670a995d tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:28.395461 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8eff089d-0c90-409e-b447-369c670a995d tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:28.529984 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8eff089d-0c90-409e-b447-369c670a995d tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:23:28.538549 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8eff089d-0c90-409e-b447-369c670a995d tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0" status: 200 len: 1724 microversion: 2.1 time: 0.158874 Oct 19 04:23:28.539143 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4102/7730] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:23:28 2022] GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:23:29.563046 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7cf026a1-0679-49b4-9960-9eb011074e5c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:23:29.563707 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7cf026a1-0679-49b4-9960-9eb011074e5c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0970a787-dfdd-444a-a0e4-c11aaf9adaf0] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:23:29.570587 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7cf026a1-0679-49b4-9960-9eb011074e5c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:29.571086 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7cf026a1-0679-49b4-9960-9eb011074e5c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:29.571536 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7cf026a1-0679-49b4-9960-9eb011074e5c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:29.572243 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7cf026a1-0679-49b4-9960-9eb011074e5c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:29.572704 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7cf026a1-0679-49b4-9960-9eb011074e5c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:29.573142 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7cf026a1-0679-49b4-9960-9eb011074e5c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:29.705670 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7cf026a1-0679-49b4-9960-9eb011074e5c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:23:29.714181 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7cf026a1-0679-49b4-9960-9eb011074e5c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0" status: 200 len: 1724 microversion: 2.1 time: 0.155171 Oct 19 04:23:29.714773 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3629/7731] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:23:29 2022] GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:23:30.738593 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e6ecb60e-3e40-418e-9c36-4b7e3188e99e tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:23:30.739229 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e6ecb60e-3e40-418e-9c36-4b7e3188e99e tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0970a787-dfdd-444a-a0e4-c11aaf9adaf0] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:23:30.745898 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e6ecb60e-3e40-418e-9c36-4b7e3188e99e tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:30.746403 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e6ecb60e-3e40-418e-9c36-4b7e3188e99e tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:30.746861 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e6ecb60e-3e40-418e-9c36-4b7e3188e99e tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:30.747665 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e6ecb60e-3e40-418e-9c36-4b7e3188e99e tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:30.748081 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e6ecb60e-3e40-418e-9c36-4b7e3188e99e tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:30.748601 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e6ecb60e-3e40-418e-9c36-4b7e3188e99e tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:30.879358 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e6ecb60e-3e40-418e-9c36-4b7e3188e99e tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:23:30.888315 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e6ecb60e-3e40-418e-9c36-4b7e3188e99e tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0" status: 200 len: 1724 microversion: 2.1 time: 0.153995 Oct 19 04:23:30.888904 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4103/7732] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:23:30 2022] GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:23:31.911849 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-11fe04b8-dd9d-4b9d-b6da-15a7f7823d24 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:23:31.912457 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-11fe04b8-dd9d-4b9d-b6da-15a7f7823d24 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0970a787-dfdd-444a-a0e4-c11aaf9adaf0] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:23:31.919968 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-11fe04b8-dd9d-4b9d-b6da-15a7f7823d24 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:31.920460 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-11fe04b8-dd9d-4b9d-b6da-15a7f7823d24 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:31.920907 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-11fe04b8-dd9d-4b9d-b6da-15a7f7823d24 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:31.921632 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-11fe04b8-dd9d-4b9d-b6da-15a7f7823d24 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:31.922104 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-11fe04b8-dd9d-4b9d-b6da-15a7f7823d24 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:31.922538 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-11fe04b8-dd9d-4b9d-b6da-15a7f7823d24 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:32.052111 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-11fe04b8-dd9d-4b9d-b6da-15a7f7823d24 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:23:32.060976 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-11fe04b8-dd9d-4b9d-b6da-15a7f7823d24 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0" status: 200 len: 1724 microversion: 2.1 time: 0.153059 Oct 19 04:23:32.061577 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3630/7733] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:23:31 2022] GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:23:33.084208 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-254abb95-0a3b-4a8d-9e86-86a9d7146b7f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:23:33.084834 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-254abb95-0a3b-4a8d-9e86-86a9d7146b7f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0970a787-dfdd-444a-a0e4-c11aaf9adaf0] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:23:33.091872 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-254abb95-0a3b-4a8d-9e86-86a9d7146b7f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:33.098277 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-254abb95-0a3b-4a8d-9e86-86a9d7146b7f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:33.098277 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-254abb95-0a3b-4a8d-9e86-86a9d7146b7f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:33.098277 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-254abb95-0a3b-4a8d-9e86-86a9d7146b7f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:33.098277 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-254abb95-0a3b-4a8d-9e86-86a9d7146b7f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:33.098277 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-254abb95-0a3b-4a8d-9e86-86a9d7146b7f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:33.226969 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-254abb95-0a3b-4a8d-9e86-86a9d7146b7f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:23:33.235205 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-254abb95-0a3b-4a8d-9e86-86a9d7146b7f tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0" status: 200 len: 1724 microversion: 2.1 time: 0.155028 Oct 19 04:23:33.235777 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4104/7734] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:23:33 2022] GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:23:34.258946 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-aa60ce11-5888-4ceb-a84b-a5d314cea089 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:23:34.259578 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-aa60ce11-5888-4ceb-a84b-a5d314cea089 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0970a787-dfdd-444a-a0e4-c11aaf9adaf0] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:23:34.267047 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aa60ce11-5888-4ceb-a84b-a5d314cea089 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:34.267541 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aa60ce11-5888-4ceb-a84b-a5d314cea089 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:34.267984 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aa60ce11-5888-4ceb-a84b-a5d314cea089 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:34.268688 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aa60ce11-5888-4ceb-a84b-a5d314cea089 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:34.269149 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aa60ce11-5888-4ceb-a84b-a5d314cea089 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:34.269615 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aa60ce11-5888-4ceb-a84b-a5d314cea089 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:34.397524 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-aa60ce11-5888-4ceb-a84b-a5d314cea089 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:23:34.406669 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-aa60ce11-5888-4ceb-a84b-a5d314cea089 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0" status: 200 len: 1724 microversion: 2.1 time: 0.151654 Oct 19 04:23:34.407251 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3631/7735] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:23:34 2022] GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:23:35.429692 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d6fb0ef2-20cd-4217-967e-a34633c7180e tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:23:35.430322 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d6fb0ef2-20cd-4217-967e-a34633c7180e tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0970a787-dfdd-444a-a0e4-c11aaf9adaf0] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:23:35.439608 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d6fb0ef2-20cd-4217-967e-a34633c7180e tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:35.440197 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d6fb0ef2-20cd-4217-967e-a34633c7180e tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:35.440654 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d6fb0ef2-20cd-4217-967e-a34633c7180e tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:35.441388 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d6fb0ef2-20cd-4217-967e-a34633c7180e tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:35.441851 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d6fb0ef2-20cd-4217-967e-a34633c7180e tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:35.442297 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d6fb0ef2-20cd-4217-967e-a34633c7180e tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:35.575019 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d6fb0ef2-20cd-4217-967e-a34633c7180e tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:23:35.583207 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d6fb0ef2-20cd-4217-967e-a34633c7180e tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0" status: 200 len: 1724 microversion: 2.1 time: 0.157453 Oct 19 04:23:35.583783 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4105/7736] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:23:35 2022] GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:23:36.606556 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5f7f24e3-f1d6-4bdd-9706-a7536822a83c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:23:36.608298 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-5f7f24e3-f1d6-4bdd-9706-a7536822a83c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0970a787-dfdd-444a-a0e4-c11aaf9adaf0] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:23:36.617189 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5f7f24e3-f1d6-4bdd-9706-a7536822a83c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:36.617883 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5f7f24e3-f1d6-4bdd-9706-a7536822a83c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:36.618333 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5f7f24e3-f1d6-4bdd-9706-a7536822a83c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:36.619043 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5f7f24e3-f1d6-4bdd-9706-a7536822a83c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:36.619508 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5f7f24e3-f1d6-4bdd-9706-a7536822a83c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:36.619949 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5f7f24e3-f1d6-4bdd-9706-a7536822a83c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:36.757363 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-5f7f24e3-f1d6-4bdd-9706-a7536822a83c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:23:36.765884 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5f7f24e3-f1d6-4bdd-9706-a7536822a83c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0" status: 200 len: 1724 microversion: 2.1 time: 0.163690 Oct 19 04:23:36.766491 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3632/7737] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:23:36 2022] GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:23:37.790045 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-73de8ab4-b385-4b85-82df-34903cbcfe8a tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:23:37.790671 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-73de8ab4-b385-4b85-82df-34903cbcfe8a tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0970a787-dfdd-444a-a0e4-c11aaf9adaf0] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:23:37.794204 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=32 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:23:37.798999 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-73de8ab4-b385-4b85-82df-34903cbcfe8a tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:37.801904 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-73de8ab4-b385-4b85-82df-34903cbcfe8a tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:37.801904 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-73de8ab4-b385-4b85-82df-34903cbcfe8a tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:37.801904 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-73de8ab4-b385-4b85-82df-34903cbcfe8a tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:37.801904 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-73de8ab4-b385-4b85-82df-34903cbcfe8a tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:37.801904 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-73de8ab4-b385-4b85-82df-34903cbcfe8a tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:37.932304 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-73de8ab4-b385-4b85-82df-34903cbcfe8a tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:23:37.941204 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-73de8ab4-b385-4b85-82df-34903cbcfe8a tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0" status: 200 len: 1717 microversion: 2.1 time: 0.155014 Oct 19 04:23:37.941837 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4106/7738] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:23:37 2022] GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0 => generated 1717 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:23:37.963698 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-65b77d60-750a-4e95-a818-f2c8f5b07a3d tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:23:37.964326 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-65b77d60-750a-4e95-a818-f2c8f5b07a3d tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0970a787-dfdd-444a-a0e4-c11aaf9adaf0] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:23:37.967094 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:23:37.971773 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-65b77d60-750a-4e95-a818-f2c8f5b07a3d tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:37.972258 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-65b77d60-750a-4e95-a818-f2c8f5b07a3d tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:37.972696 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-65b77d60-750a-4e95-a818-f2c8f5b07a3d tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:37.973401 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-65b77d60-750a-4e95-a818-f2c8f5b07a3d tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:37.973862 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-65b77d60-750a-4e95-a818-f2c8f5b07a3d tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:37.974286 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-65b77d60-750a-4e95-a818-f2c8f5b07a3d tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:37.976848 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:23:38.110924 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-65b77d60-750a-4e95-a818-f2c8f5b07a3d tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:23:38.119767 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-65b77d60-750a-4e95-a818-f2c8f5b07a3d tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0" status: 200 len: 1717 microversion: 2.1 time: 0.159927 Oct 19 04:23:38.120951 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3633/7739] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:23:37 2022] GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0 => generated 1717 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:23:38.143135 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2e14891d-ee4d-42c6-a819-1a18b50f16f5 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:23:38.143829 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2e14891d-ee4d-42c6-a819-1a18b50f16f5 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0970a787-dfdd-444a-a0e4-c11aaf9adaf0] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:23:38.150131 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2e14891d-ee4d-42c6-a819-1a18b50f16f5 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:38.150638 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2e14891d-ee4d-42c6-a819-1a18b50f16f5 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:38.151095 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2e14891d-ee4d-42c6-a819-1a18b50f16f5 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:38.152403 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2e14891d-ee4d-42c6-a819-1a18b50f16f5 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:38.152877 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2e14891d-ee4d-42c6-a819-1a18b50f16f5 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:38.153326 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2e14891d-ee4d-42c6-a819-1a18b50f16f5 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:38.168053 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=100 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:23:38.282880 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-2e14891d-ee4d-42c6-a819-1a18b50f16f5 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:23:38.291126 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2e14891d-ee4d-42c6-a819-1a18b50f16f5 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0" status: 200 len: 1717 microversion: 2.1 time: 0.151902 Oct 19 04:23:38.291700 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4107/7740] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:23:38 2022] GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0 => generated 1717 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:23:38.316175 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c9d70981-332e-41c4-983a-c75a97b5063d tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:23:38.316785 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c9d70981-332e-41c4-983a-c75a97b5063d tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0970a787-dfdd-444a-a0e4-c11aaf9adaf0] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:23:38.323003 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c9d70981-332e-41c4-983a-c75a97b5063d tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:38.324124 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c9d70981-332e-41c4-983a-c75a97b5063d tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:38.324569 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c9d70981-332e-41c4-983a-c75a97b5063d tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:38.325269 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c9d70981-332e-41c4-983a-c75a97b5063d tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:38.325781 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c9d70981-332e-41c4-983a-c75a97b5063d tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:38.326219 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c9d70981-332e-41c4-983a-c75a97b5063d tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:38.351254 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c9d70981-332e-41c4-983a-c75a97b5063d tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0970a787-dfdd-444a-a0e4-c11aaf9adaf0] Going to try to terminate instance {{(pid=121135) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 04:23:38.374595 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-79d90bb7-6522-4a15-beda-2e924bba94c8 req-9339169b-0179-4bf9-afe4-772a19c02b49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0970a787-dfdd-444a-a0e4-c11aaf9adaf0", "name": "network-vif-plugged", "status": "completed", "tag": "0e97e794-6f03-4a7d-b17c-da810d04a800"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:23:38.384550 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-79d90bb7-6522-4a15-beda-2e924bba94c8 req-9339169b-0179-4bf9-afe4-772a19c02b49 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:38.385229 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-79d90bb7-6522-4a15-beda-2e924bba94c8 req-9339169b-0179-4bf9-afe4-772a19c02b49 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:38.386250 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-79d90bb7-6522-4a15-beda-2e924bba94c8 req-9339169b-0179-4bf9-afe4-772a19c02b49 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:38.398862 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-79d90bb7-6522-4a15-beda-2e924bba94c8 req-9339169b-0179-4bf9-afe4-772a19c02b49 service nova] Creating event network-vif-plugged:0e97e794-6f03-4a7d-b17c-da810d04a800 for instance 0970a787-dfdd-444a-a0e4-c11aaf9adaf0 on n-h2-861333-8 Oct 19 04:23:38.404750 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-79d90bb7-6522-4a15-beda-2e924bba94c8 req-9339169b-0179-4bf9-afe4-772a19c02b49 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034543 Oct 19 04:23:38.406013 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4108/7741] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:23:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 04:23:38.687373 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c9d70981-332e-41c4-983a-c75a97b5063d tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "DELETE /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0" status: 204 len: 0 microversion: 2.1 time: 0.375232 Oct 19 04:23:38.687991 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3634/7742] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 04:23:38 2022] DELETE /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 04:23:38.696846 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-79b0e6eb-f75b-4639-a57b-d90e72e6b253 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:23:38.697595 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-79b0e6eb-f75b-4639-a57b-d90e72e6b253 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0970a787-dfdd-444a-a0e4-c11aaf9adaf0] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:23:38.704052 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-79b0e6eb-f75b-4639-a57b-d90e72e6b253 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:38.704550 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-79b0e6eb-f75b-4639-a57b-d90e72e6b253 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:38.704998 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-79b0e6eb-f75b-4639-a57b-d90e72e6b253 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:38.705736 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-79b0e6eb-f75b-4639-a57b-d90e72e6b253 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:38.706215 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-79b0e6eb-f75b-4639-a57b-d90e72e6b253 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:38.706650 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-79b0e6eb-f75b-4639-a57b-d90e72e6b253 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:38.840846 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-79b0e6eb-f75b-4639-a57b-d90e72e6b253 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:23:38.849355 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-79b0e6eb-f75b-4639-a57b-d90e72e6b253 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0" status: 200 len: 1723 microversion: 2.1 time: 0.156742 Oct 19 04:23:38.849971 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4109/7743] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:23:38 2022] GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:23:39.874305 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-28704c83-9e64-4a71-9a37-f83b9a63593c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:23:39.875022 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-28704c83-9e64-4a71-9a37-f83b9a63593c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0970a787-dfdd-444a-a0e4-c11aaf9adaf0] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:23:39.881690 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-28704c83-9e64-4a71-9a37-f83b9a63593c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:39.882188 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-28704c83-9e64-4a71-9a37-f83b9a63593c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:39.882634 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-28704c83-9e64-4a71-9a37-f83b9a63593c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:39.883330 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-28704c83-9e64-4a71-9a37-f83b9a63593c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:39.883796 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-28704c83-9e64-4a71-9a37-f83b9a63593c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:39.884227 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-28704c83-9e64-4a71-9a37-f83b9a63593c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:40.018322 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-28704c83-9e64-4a71-9a37-f83b9a63593c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:23:40.027211 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-28704c83-9e64-4a71-9a37-f83b9a63593c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0" status: 200 len: 1723 microversion: 2.1 time: 0.157674 Oct 19 04:23:40.028285 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3635/7744] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:23:39 2022] GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:23:41.050747 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0d9e3934-3c1b-4019-bcbb-f381919fa1d0 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:23:41.051420 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0d9e3934-3c1b-4019-bcbb-f381919fa1d0 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0970a787-dfdd-444a-a0e4-c11aaf9adaf0] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:23:41.059099 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0d9e3934-3c1b-4019-bcbb-f381919fa1d0 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:41.059616 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0d9e3934-3c1b-4019-bcbb-f381919fa1d0 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:41.060077 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0d9e3934-3c1b-4019-bcbb-f381919fa1d0 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:41.060809 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0d9e3934-3c1b-4019-bcbb-f381919fa1d0 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:41.061285 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0d9e3934-3c1b-4019-bcbb-f381919fa1d0 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:41.061765 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0d9e3934-3c1b-4019-bcbb-f381919fa1d0 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:41.324378 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0d9e3934-3c1b-4019-bcbb-f381919fa1d0 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:23:41.339859 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0d9e3934-3c1b-4019-bcbb-f381919fa1d0 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0" status: 200 len: 1723 microversion: 2.1 time: 0.292064 Oct 19 04:23:41.340848 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4110/7745] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:23:41 2022] GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0 => generated 1723 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:23:41.819547 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-436d866b-f096-4d56-b8f2-fe3af381ddaa req-a9e1af01-c6bd-4f95-8a2b-799d4320fa51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0970a787-dfdd-444a-a0e4-c11aaf9adaf0", "name": "network-vif-deleted", "tag": "0e97e794-6f03-4a7d-b17c-da810d04a800"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:23:41.835399 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-436d866b-f096-4d56-b8f2-fe3af381ddaa req-a9e1af01-c6bd-4f95-8a2b-799d4320fa51 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:41.835399 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-436d866b-f096-4d56-b8f2-fe3af381ddaa req-a9e1af01-c6bd-4f95-8a2b-799d4320fa51 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:41.835399 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-436d866b-f096-4d56-b8f2-fe3af381ddaa req-a9e1af01-c6bd-4f95-8a2b-799d4320fa51 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:41.843073 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-436d866b-f096-4d56-b8f2-fe3af381ddaa req-a9e1af01-c6bd-4f95-8a2b-799d4320fa51 service nova] Creating event network-vif-deleted:0e97e794-6f03-4a7d-b17c-da810d04a800 for instance 0970a787-dfdd-444a-a0e4-c11aaf9adaf0 on n-h2-861333-8 Oct 19 04:23:41.848258 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-436d866b-f096-4d56-b8f2-fe3af381ddaa req-a9e1af01-c6bd-4f95-8a2b-799d4320fa51 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032428 Oct 19 04:23:41.848848 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3636/7746] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:23:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:23:42.372358 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7dd9e6d4-19d5-44d9-aa2f-7e45d319f9a5 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:23:42.373782 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7dd9e6d4-19d5-44d9-aa2f-7e45d319f9a5 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0970a787-dfdd-444a-a0e4-c11aaf9adaf0] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:23:42.380781 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7dd9e6d4-19d5-44d9-aa2f-7e45d319f9a5 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:42.381399 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7dd9e6d4-19d5-44d9-aa2f-7e45d319f9a5 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:42.381946 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7dd9e6d4-19d5-44d9-aa2f-7e45d319f9a5 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:42.382671 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7dd9e6d4-19d5-44d9-aa2f-7e45d319f9a5 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:42.383150 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7dd9e6d4-19d5-44d9-aa2f-7e45d319f9a5 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:42.383601 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7dd9e6d4-19d5-44d9-aa2f-7e45d319f9a5 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:42.454771 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-7dd9e6d4-19d5-44d9-aa2f-7e45d319f9a5 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:23:42.464209 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7dd9e6d4-19d5-44d9-aa2f-7e45d319f9a5 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0" status: 200 len: 1370 microversion: 2.1 time: 0.095512 Oct 19 04:23:42.468464 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4111/7747] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:23:42 2022] GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0 => generated 1370 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:23:43.491877 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-03e42827-fe62-4128-beb4-aa58ebdfb23c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:23:43.492602 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-03e42827-fe62-4128-beb4-aa58ebdfb23c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0970a787-dfdd-444a-a0e4-c11aaf9adaf0] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:23:43.498947 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-03e42827-fe62-4128-beb4-aa58ebdfb23c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:43.506629 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-03e42827-fe62-4128-beb4-aa58ebdfb23c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:43.506629 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-03e42827-fe62-4128-beb4-aa58ebdfb23c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:43.506629 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-03e42827-fe62-4128-beb4-aa58ebdfb23c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:43.506629 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-03e42827-fe62-4128-beb4-aa58ebdfb23c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:43.506629 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-03e42827-fe62-4128-beb4-aa58ebdfb23c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:43.577944 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-03e42827-fe62-4128-beb4-aa58ebdfb23c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:23:43.586645 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-03e42827-fe62-4128-beb4-aa58ebdfb23c tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0" status: 200 len: 1370 microversion: 2.1 time: 0.099965 Oct 19 04:23:43.587233 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3637/7748] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:23:43 2022] GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0 => generated 1370 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:23:44.610627 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d00e3a54-d2a4-4af3-baa1-c0db957a1b18 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:23:44.611298 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d00e3a54-d2a4-4af3-baa1-c0db957a1b18 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0970a787-dfdd-444a-a0e4-c11aaf9adaf0] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:23:44.618915 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d00e3a54-d2a4-4af3-baa1-c0db957a1b18 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:44.619418 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d00e3a54-d2a4-4af3-baa1-c0db957a1b18 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:44.620421 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d00e3a54-d2a4-4af3-baa1-c0db957a1b18 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:44.621145 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d00e3a54-d2a4-4af3-baa1-c0db957a1b18 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:44.621638 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d00e3a54-d2a4-4af3-baa1-c0db957a1b18 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:44.622078 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d00e3a54-d2a4-4af3-baa1-c0db957a1b18 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:44.689649 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d00e3a54-d2a4-4af3-baa1-c0db957a1b18 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:23:44.698719 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d00e3a54-d2a4-4af3-baa1-c0db957a1b18 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0" status: 200 len: 1370 microversion: 2.1 time: 0.091481 Oct 19 04:23:44.699307 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4112/7749] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:23:44 2022] GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0 => generated 1370 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:23:45.722341 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c65a883a-5ac0-412f-aff7-3303ca5bdd18 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:23:45.723001 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c65a883a-5ac0-412f-aff7-3303ca5bdd18 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0970a787-dfdd-444a-a0e4-c11aaf9adaf0] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:23:45.730041 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c65a883a-5ac0-412f-aff7-3303ca5bdd18 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:45.730544 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c65a883a-5ac0-412f-aff7-3303ca5bdd18 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:45.730994 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c65a883a-5ac0-412f-aff7-3303ca5bdd18 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:45.731699 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c65a883a-5ac0-412f-aff7-3303ca5bdd18 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:45.732165 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c65a883a-5ac0-412f-aff7-3303ca5bdd18 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:45.732603 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c65a883a-5ac0-412f-aff7-3303ca5bdd18 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:45.794586 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c65a883a-5ac0-412f-aff7-3303ca5bdd18 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31018706f7fd45988df04518eee6c044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25caabf71e854e4ba4ee627309de481d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:23:45.802936 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c65a883a-5ac0-412f-aff7-3303ca5bdd18 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0" status: 200 len: 1370 microversion: 2.1 time: 0.084626 Oct 19 04:23:45.803514 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3638/7750] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:23:45 2022] GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0 => generated 1370 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:23:46.825458 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a421691e-0025-43c7-8699-2492fed1956b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:23:46.826103 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a421691e-0025-43c7-8699-2492fed1956b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0970a787-dfdd-444a-a0e4-c11aaf9adaf0] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:23:46.833215 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a421691e-0025-43c7-8699-2492fed1956b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:46.833757 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a421691e-0025-43c7-8699-2492fed1956b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:46.834221 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a421691e-0025-43c7-8699-2492fed1956b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:46.834949 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a421691e-0025-43c7-8699-2492fed1956b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:46.835430 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a421691e-0025-43c7-8699-2492fed1956b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:46.835880 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a421691e-0025-43c7-8699-2492fed1956b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:46.852496 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-a421691e-0025-43c7-8699-2492fed1956b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] HTTP exception thrown: Instance 0970a787-dfdd-444a-a0e4-c11aaf9adaf0 could not be found. Oct 19 04:23:46.854205 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a421691e-0025-43c7-8699-2492fed1956b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Request method failure captured: Oct 19 04:23:46.854205 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0 HTTP/1.1 Oct 19 04:23:46.854205 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 04:23:46.854205 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 04:23:46.854205 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 04:23:46.854205 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 04:23:46.854205 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 04:23:46.854205 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 04:23:46.854205 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 04:23:46.854205 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 04:23:46.854205 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3pS2Cwyyy-dNSAxlLXDbJv718ZCSFb4tsqqjaELCUFVV4hTcgxmjEt9HPf0r6Tip4zea9RCTtHQ0ac2yM_L9WSLCmGFBJhcH41unZ6WfnrAV6EUJNxXeMSOhFFhVbKjU1BMM3_NjFd9xRkGRzGdSLz8_YHyiY2hvcg5UcnlLBsNaKo Oct 19 04:23:46.854205 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 04:23:46.854205 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 04:23:46.854205 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 04:23:46.854205 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 04:23:46.854205 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 04:23:46.854205 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 04:23:46.854205 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 25caabf71e854e4ba4ee627309de481d Oct 19 04:23:46.854205 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ServerActionsTestJSON-130142772 Oct 19 04:23:46.854205 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 04:23:46.854205 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 04:23:46.854205 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/25caabf71e854e4ba4ee627309de481d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/25caabf71e854e4ba4ee627309de481d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/25caabf71e854e4ba4ee627309de481d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_25caabf71e854e4ba4ee627309de481d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 04:23:46.854205 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ServerActionsTestJSON-130142772 Oct 19 04:23:46.854205 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 25caabf71e854e4ba4ee627309de481d Oct 19 04:23:46.854205 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ServerActionsTestJSON-130142772 Oct 19 04:23:46.854205 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ServerActionsTestJSON-130142772-project Oct 19 04:23:46.854205 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 04:23:46.854205 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 04:23:46.854205 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 31018706f7fd45988df04518eee6c044 Oct 19 04:23:46.854205 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ServerActionsTestJSON-130142772-project Oct 19 04:23:46.854205 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 04:23:46.854205 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance 0970a787-dfdd-444a-a0e4-c11aaf9adaf0 could not be found. Oct 19 04:23:46.854205 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '0970a787-dfdd-444a-a0e4-c11aaf9adaf0'} Oct 19 04:23:46.854205 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 04:23:46.854205 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:23:46.854205 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 04:23:46.854205 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 04:23:46.854205 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 04:23:46.854205 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 04:23:46.854205 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 04:23:46.854205 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 04:23:46.854205 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 04:23:46.854205 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 04:23:46.854205 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0970a787-dfdd-444a-a0e4-c11aaf9adaf0 could not be found. Oct 19 04:23:46.854205 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:23:46.854205 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:23:46.854205 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:23:46.854205 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:23:46.854205 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:23:46.854205 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:23:46.854205 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 04:23:46.854205 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 04:23:46.854205 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 04:23:46.854205 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 04:23:46.854205 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 04:23:46.854205 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 04:23:46.854205 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 04:23:46.854205 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 04:23:46.854205 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 04:23:46.854205 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 04:23:46.854205 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0970a787-dfdd-444a-a0e4-c11aaf9adaf0 could not be found. Oct 19 04:23:46.854205 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:23:46.854205 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:23:46.854205 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:23:46.860116 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:23:46.860116 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:23:46.860116 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:23:46.860116 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 04:23:46.860116 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 04:23:46.860116 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0970a787-dfdd-444a-a0e4-c11aaf9adaf0 could not be found. Oct 19 04:23:46.860116 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:23:46.860116 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a421691e-0025-43c7-8699-2492fed1956b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Returning 404 to user: Instance 0970a787-dfdd-444a-a0e4-c11aaf9adaf0 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 04:23:46.860116 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a421691e-0025-43c7-8699-2492fed1956b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0" status: 404 len: 111 microversion: 2.1 time: 0.034904 Oct 19 04:23:46.860116 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4113/7751] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:23:46 2022] GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 04:23:46.919979 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-feb7a498-7ddd-4cf9-a162-ef160bfb2613 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:23:46.921139 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-feb7a498-7ddd-4cf9-a162-ef160bfb2613 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0970a787-dfdd-444a-a0e4-c11aaf9adaf0] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:23:46.928033 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-feb7a498-7ddd-4cf9-a162-ef160bfb2613 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:46.928523 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-feb7a498-7ddd-4cf9-a162-ef160bfb2613 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:46.928968 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-feb7a498-7ddd-4cf9-a162-ef160bfb2613 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:46.929693 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-feb7a498-7ddd-4cf9-a162-ef160bfb2613 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:46.930152 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-feb7a498-7ddd-4cf9-a162-ef160bfb2613 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:46.930584 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-feb7a498-7ddd-4cf9-a162-ef160bfb2613 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:46.943459 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-feb7a498-7ddd-4cf9-a162-ef160bfb2613 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] HTTP exception thrown: Instance 0970a787-dfdd-444a-a0e4-c11aaf9adaf0 could not be found. Oct 19 04:23:46.946062 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-feb7a498-7ddd-4cf9-a162-ef160bfb2613 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Request method failure captured: Oct 19 04:23:46.946062 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0/os-volume_attachments HTTP/1.1 Oct 19 04:23:46.946062 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 04:23:46.946062 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 04:23:46.946062 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 04:23:46.946062 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 04:23:46.946062 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 04:23:46.946062 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 04:23:46.946062 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 04:23:46.946062 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 04:23:46.946062 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT3pS2Cwyyy-dNSAxlLXDbJv718ZCSFb4tsqqjaELCUFVV4hTcgxmjEt9HPf0r6Tip4zea9RCTtHQ0ac2yM_L9WSLCmGFBJhcH41unZ6WfnrAV6EUJNxXeMSOhFFhVbKjU1BMM3_NjFd9xRkGRzGdSLz8_YHyiY2hvcg5UcnlLBsNaKo Oct 19 04:23:46.946062 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 04:23:46.946062 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 04:23:46.946062 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 04:23:46.946062 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 04:23:46.946062 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 04:23:46.946062 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 04:23:46.946062 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 25caabf71e854e4ba4ee627309de481d Oct 19 04:23:46.946062 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ServerActionsTestJSON-130142772 Oct 19 04:23:46.946062 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 04:23:46.946062 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 04:23:46.946062 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/25caabf71e854e4ba4ee627309de481d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/25caabf71e854e4ba4ee627309de481d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/25caabf71e854e4ba4ee627309de481d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_25caabf71e854e4ba4ee627309de481d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 04:23:46.946062 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ServerActionsTestJSON-130142772 Oct 19 04:23:46.946062 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 25caabf71e854e4ba4ee627309de481d Oct 19 04:23:46.946062 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ServerActionsTestJSON-130142772 Oct 19 04:23:46.946062 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ServerActionsTestJSON-130142772-project Oct 19 04:23:46.946062 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 04:23:46.946062 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 04:23:46.946062 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 31018706f7fd45988df04518eee6c044 Oct 19 04:23:46.946062 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ServerActionsTestJSON-130142772-project Oct 19 04:23:46.946062 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 04:23:46.946062 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance 0970a787-dfdd-444a-a0e4-c11aaf9adaf0 could not be found. Oct 19 04:23:46.946062 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'server_id': '0970a787-dfdd-444a-a0e4-c11aaf9adaf0'} Oct 19 04:23:46.946062 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 04:23:46.946062 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:23:46.946062 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 04:23:46.946062 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 04:23:46.946062 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 04:23:46.946062 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 04:23:46.946062 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 04:23:46.946062 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 04:23:46.946062 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 04:23:46.946062 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 04:23:46.946062 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0970a787-dfdd-444a-a0e4-c11aaf9adaf0 could not be found. Oct 19 04:23:46.946062 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:23:46.946062 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:23:46.946062 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:23:46.946062 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:23:46.946062 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:23:46.946062 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:23:46.946062 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 04:23:46.946062 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 04:23:46.946062 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 04:23:46.946062 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 04:23:46.946062 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 19 04:23:46.946062 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 04:23:46.946062 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 19 04:23:46.946062 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 04:23:46.946062 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 19 04:23:46.946062 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 19 04:23:46.946062 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 04:23:46.946062 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 04:23:46.950235 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0970a787-dfdd-444a-a0e4-c11aaf9adaf0 could not be found. Oct 19 04:23:46.950235 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:23:46.950235 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:23:46.950235 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:23:46.950235 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:23:46.950235 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:23:46.950235 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:23:46.950235 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 04:23:46.950235 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 04:23:46.950235 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0970a787-dfdd-444a-a0e4-c11aaf9adaf0 could not be found. Oct 19 04:23:46.950235 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:23:46.950235 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-feb7a498-7ddd-4cf9-a162-ef160bfb2613 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Returning 404 to user: Instance 0970a787-dfdd-444a-a0e4-c11aaf9adaf0 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 04:23:46.950235 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-feb7a498-7ddd-4cf9-a162-ef160bfb2613 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.032350 Oct 19 04:23:46.950235 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3639/7752] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Oct 19 04:23:46 2022] GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0/os-volume_attachments => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 04:23:50.406046 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0d25fef9-5f57-4d26-868d-8c6d4968957e tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:23:50.406574 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0d25fef9-5f57-4d26-868d-8c6d4968957e tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0970a787-dfdd-444a-a0e4-c11aaf9adaf0] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:23:50.413634 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0d25fef9-5f57-4d26-868d-8c6d4968957e tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:50.414141 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0d25fef9-5f57-4d26-868d-8c6d4968957e tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:50.414602 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0d25fef9-5f57-4d26-868d-8c6d4968957e tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:50.415315 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0d25fef9-5f57-4d26-868d-8c6d4968957e tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:50.415788 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0d25fef9-5f57-4d26-868d-8c6d4968957e tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:50.416284 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0d25fef9-5f57-4d26-868d-8c6d4968957e tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:50.429943 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-0d25fef9-5f57-4d26-868d-8c6d4968957e tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] HTTP exception thrown: Instance 0970a787-dfdd-444a-a0e4-c11aaf9adaf0 could not be found. Oct 19 04:23:50.431510 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0d25fef9-5f57-4d26-868d-8c6d4968957e tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Request method failure captured: Oct 19 04:23:50.431510 n-d-861333-8 devstack@n-api.service[121134]: request: DELETE /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0 HTTP/1.1 Oct 19 04:23:50.431510 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 04:23:50.431510 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 04:23:50.431510 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 04:23:50.431510 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 04:23:50.431510 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 04:23:50.431510 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 04:23:50.431510 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 04:23:50.431510 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 04:23:50.431510 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3pS2Cwyyy-dNSAxlLXDbJv718ZCSFb4tsqqjaELCUFVV4hTcgxmjEt9HPf0r6Tip4zea9RCTtHQ0ac2yM_L9WSLCmGFBJhcH41unZ6WfnrAV6EUJNxXeMSOhFFhVbKjU1BMM3_NjFd9xRkGRzGdSLz8_YHyiY2hvcg5UcnlLBsNaKo Oct 19 04:23:50.431510 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 04:23:50.431510 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 04:23:50.431510 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 04:23:50.431510 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 04:23:50.431510 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 04:23:50.431510 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 04:23:50.431510 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 25caabf71e854e4ba4ee627309de481d Oct 19 04:23:50.431510 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ServerActionsTestJSON-130142772 Oct 19 04:23:50.431510 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 04:23:50.431510 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 04:23:50.431510 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/25caabf71e854e4ba4ee627309de481d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/25caabf71e854e4ba4ee627309de481d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/25caabf71e854e4ba4ee627309de481d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_25caabf71e854e4ba4ee627309de481d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 04:23:50.431510 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ServerActionsTestJSON-130142772 Oct 19 04:23:50.431510 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 25caabf71e854e4ba4ee627309de481d Oct 19 04:23:50.431510 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ServerActionsTestJSON-130142772 Oct 19 04:23:50.431510 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ServerActionsTestJSON-130142772-project Oct 19 04:23:50.431510 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 04:23:50.431510 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 04:23:50.431510 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 31018706f7fd45988df04518eee6c044 Oct 19 04:23:50.431510 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ServerActionsTestJSON-130142772-project Oct 19 04:23:50.431510 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 04:23:50.431510 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance 0970a787-dfdd-444a-a0e4-c11aaf9adaf0 could not be found. Oct 19 04:23:50.431510 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '0970a787-dfdd-444a-a0e4-c11aaf9adaf0'} Oct 19 04:23:50.431510 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 04:23:50.431510 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:23:50.431510 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 04:23:50.431510 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 04:23:50.431510 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 04:23:50.431510 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 04:23:50.431510 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 04:23:50.431510 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 04:23:50.431510 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 04:23:50.431510 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 04:23:50.431510 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0970a787-dfdd-444a-a0e4-c11aaf9adaf0 could not be found. Oct 19 04:23:50.431510 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:23:50.431510 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:23:50.431510 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:23:50.431510 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:23:50.431510 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:23:50.431510 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:23:50.431510 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 04:23:50.431510 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 04:23:50.431510 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 04:23:50.431510 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 04:23:50.431510 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 04:23:50.431510 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 04:23:50.431510 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 04:23:50.431510 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 04:23:50.431510 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 04:23:50.431510 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 04:23:50.431510 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 04:23:50.431510 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 04:23:50.435362 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0970a787-dfdd-444a-a0e4-c11aaf9adaf0 could not be found. Oct 19 04:23:50.435362 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:23:50.435362 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:23:50.435362 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:23:50.435362 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:23:50.435362 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:23:50.435362 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:23:50.435362 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 04:23:50.435362 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 04:23:50.435362 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0970a787-dfdd-444a-a0e4-c11aaf9adaf0 could not be found. Oct 19 04:23:50.435362 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:23:50.435362 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0d25fef9-5f57-4d26-868d-8c6d4968957e tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Returning 404 to user: Instance 0970a787-dfdd-444a-a0e4-c11aaf9adaf0 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 04:23:50.435362 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0d25fef9-5f57-4d26-868d-8c6d4968957e tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "DELETE /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0" status: 404 len: 111 microversion: 2.1 time: 0.031636 Oct 19 04:23:50.435362 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4114/7753] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 04:23:50 2022] DELETE /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 04:23:50.441853 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-553a484b-d9e9-467d-9385-65288ac274e9 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:23:50.442487 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-553a484b-d9e9-467d-9385-65288ac274e9 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0970a787-dfdd-444a-a0e4-c11aaf9adaf0] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:23:50.450135 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-553a484b-d9e9-467d-9385-65288ac274e9 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:50.450573 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-553a484b-d9e9-467d-9385-65288ac274e9 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:50.451022 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-553a484b-d9e9-467d-9385-65288ac274e9 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:50.451728 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-553a484b-d9e9-467d-9385-65288ac274e9 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:50.452191 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-553a484b-d9e9-467d-9385-65288ac274e9 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:50.452629 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-553a484b-d9e9-467d-9385-65288ac274e9 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:50.466929 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-553a484b-d9e9-467d-9385-65288ac274e9 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] HTTP exception thrown: Instance 0970a787-dfdd-444a-a0e4-c11aaf9adaf0 could not be found. Oct 19 04:23:50.468441 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-553a484b-d9e9-467d-9385-65288ac274e9 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Request method failure captured: Oct 19 04:23:50.468441 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0 HTTP/1.1 Oct 19 04:23:50.468441 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 04:23:50.468441 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 04:23:50.468441 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 04:23:50.468441 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 04:23:50.468441 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 04:23:50.468441 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 04:23:50.468441 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 04:23:50.468441 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 04:23:50.468441 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT3pS2Cwyyy-dNSAxlLXDbJv718ZCSFb4tsqqjaELCUFVV4hTcgxmjEt9HPf0r6Tip4zea9RCTtHQ0ac2yM_L9WSLCmGFBJhcH41unZ6WfnrAV6EUJNxXeMSOhFFhVbKjU1BMM3_NjFd9xRkGRzGdSLz8_YHyiY2hvcg5UcnlLBsNaKo Oct 19 04:23:50.468441 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 04:23:50.468441 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 04:23:50.468441 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 04:23:50.468441 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 04:23:50.468441 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 04:23:50.468441 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 04:23:50.468441 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 25caabf71e854e4ba4ee627309de481d Oct 19 04:23:50.468441 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ServerActionsTestJSON-130142772 Oct 19 04:23:50.468441 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 04:23:50.468441 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 04:23:50.468441 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/25caabf71e854e4ba4ee627309de481d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/25caabf71e854e4ba4ee627309de481d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/25caabf71e854e4ba4ee627309de481d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_25caabf71e854e4ba4ee627309de481d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 04:23:50.468441 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ServerActionsTestJSON-130142772 Oct 19 04:23:50.468441 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 25caabf71e854e4ba4ee627309de481d Oct 19 04:23:50.468441 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ServerActionsTestJSON-130142772 Oct 19 04:23:50.468441 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ServerActionsTestJSON-130142772-project Oct 19 04:23:50.468441 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 04:23:50.468441 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 04:23:50.468441 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 31018706f7fd45988df04518eee6c044 Oct 19 04:23:50.468441 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ServerActionsTestJSON-130142772-project Oct 19 04:23:50.468441 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 04:23:50.468441 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance 0970a787-dfdd-444a-a0e4-c11aaf9adaf0 could not be found. Oct 19 04:23:50.468441 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '0970a787-dfdd-444a-a0e4-c11aaf9adaf0'} Oct 19 04:23:50.468441 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 04:23:50.468441 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:23:50.468441 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 04:23:50.468441 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 04:23:50.468441 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 04:23:50.468441 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 04:23:50.468441 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 04:23:50.468441 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 04:23:50.468441 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 04:23:50.468441 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 04:23:50.468441 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0970a787-dfdd-444a-a0e4-c11aaf9adaf0 could not be found. Oct 19 04:23:50.468441 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:23:50.468441 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:23:50.468441 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:23:50.468441 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:23:50.468441 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:23:50.468441 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:23:50.468441 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 04:23:50.468441 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 04:23:50.468441 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 04:23:50.468441 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 04:23:50.468441 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 04:23:50.468441 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 04:23:50.468441 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 04:23:50.468441 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 04:23:50.468441 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 04:23:50.468441 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 04:23:50.468441 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0970a787-dfdd-444a-a0e4-c11aaf9adaf0 could not be found. Oct 19 04:23:50.468441 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:23:50.468441 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:23:50.468441 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:23:50.478611 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:23:50.478611 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:23:50.478611 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:23:50.478611 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 04:23:50.478611 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 04:23:50.478611 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0970a787-dfdd-444a-a0e4-c11aaf9adaf0 could not be found. Oct 19 04:23:50.478611 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:23:50.478611 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-553a484b-d9e9-467d-9385-65288ac274e9 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Returning 404 to user: Instance 0970a787-dfdd-444a-a0e4-c11aaf9adaf0 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 04:23:50.478611 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-553a484b-d9e9-467d-9385-65288ac274e9 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0" status: 404 len: 111 microversion: 2.1 time: 0.031943 Oct 19 04:23:50.478611 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3640/7754] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:23:50 2022] GET /compute/v2.1/servers/0970a787-dfdd-444a-a0e4-c11aaf9adaf0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 04:23:50.481621 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b24270f4-1f4a-4570-8f53-b37bcdf01a96 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:23:50.482139 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b24270f4-1f4a-4570-8f53-b37bcdf01a96 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: c321af99-3be9-4477-bd64-099009c0c0e3] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:23:50.488194 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b24270f4-1f4a-4570-8f53-b37bcdf01a96 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:50.488766 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b24270f4-1f4a-4570-8f53-b37bcdf01a96 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:50.489160 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b24270f4-1f4a-4570-8f53-b37bcdf01a96 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:50.489915 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b24270f4-1f4a-4570-8f53-b37bcdf01a96 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:50.490388 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b24270f4-1f4a-4570-8f53-b37bcdf01a96 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:50.490834 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b24270f4-1f4a-4570-8f53-b37bcdf01a96 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:50.504638 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-b24270f4-1f4a-4570-8f53-b37bcdf01a96 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] HTTP exception thrown: Instance c321af99-3be9-4477-bd64-099009c0c0e3 could not be found. Oct 19 04:23:50.506255 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b24270f4-1f4a-4570-8f53-b37bcdf01a96 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Request method failure captured: Oct 19 04:23:50.506255 n-d-861333-8 devstack@n-api.service[121134]: request: DELETE /compute/v2.1/servers/c321af99-3be9-4477-bd64-099009c0c0e3 HTTP/1.1 Oct 19 04:23:50.506255 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 04:23:50.506255 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 04:23:50.506255 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 04:23:50.506255 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 04:23:50.506255 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 04:23:50.506255 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 04:23:50.506255 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 04:23:50.506255 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 04:23:50.506255 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3pS2Cwyyy-dNSAxlLXDbJv718ZCSFb4tsqqjaELCUFVV4hTcgxmjEt9HPf0r6Tip4zea9RCTtHQ0ac2yM_L9WSLCmGFBJhcH41unZ6WfnrAV6EUJNxXeMSOhFFhVbKjU1BMM3_NjFd9xRkGRzGdSLz8_YHyiY2hvcg5UcnlLBsNaKo Oct 19 04:23:50.506255 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 04:23:50.506255 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 04:23:50.506255 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 04:23:50.506255 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 04:23:50.506255 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 04:23:50.506255 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 04:23:50.506255 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 25caabf71e854e4ba4ee627309de481d Oct 19 04:23:50.506255 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ServerActionsTestJSON-130142772 Oct 19 04:23:50.506255 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 04:23:50.506255 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 04:23:50.506255 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/25caabf71e854e4ba4ee627309de481d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/25caabf71e854e4ba4ee627309de481d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/25caabf71e854e4ba4ee627309de481d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_25caabf71e854e4ba4ee627309de481d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 04:23:50.506255 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ServerActionsTestJSON-130142772 Oct 19 04:23:50.506255 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 25caabf71e854e4ba4ee627309de481d Oct 19 04:23:50.506255 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ServerActionsTestJSON-130142772 Oct 19 04:23:50.506255 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ServerActionsTestJSON-130142772-project Oct 19 04:23:50.506255 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 04:23:50.506255 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 04:23:50.506255 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 31018706f7fd45988df04518eee6c044 Oct 19 04:23:50.506255 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ServerActionsTestJSON-130142772-project Oct 19 04:23:50.506255 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 04:23:50.506255 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance c321af99-3be9-4477-bd64-099009c0c0e3 could not be found. Oct 19 04:23:50.506255 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': 'c321af99-3be9-4477-bd64-099009c0c0e3'} Oct 19 04:23:50.506255 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 04:23:50.506255 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:23:50.506255 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 04:23:50.506255 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 04:23:50.506255 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 04:23:50.506255 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 04:23:50.506255 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 04:23:50.506255 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 04:23:50.506255 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 04:23:50.506255 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 04:23:50.506255 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c321af99-3be9-4477-bd64-099009c0c0e3 could not be found. Oct 19 04:23:50.506255 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:23:50.506255 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:23:50.506255 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:23:50.506255 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:23:50.506255 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:23:50.506255 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:23:50.506255 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 04:23:50.506255 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 04:23:50.506255 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 04:23:50.506255 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 04:23:50.506255 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 04:23:50.506255 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 04:23:50.506255 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 04:23:50.506255 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 04:23:50.506255 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 04:23:50.506255 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 04:23:50.506255 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 04:23:50.506255 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 04:23:50.512061 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c321af99-3be9-4477-bd64-099009c0c0e3 could not be found. Oct 19 04:23:50.512061 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:23:50.512061 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:23:50.512061 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:23:50.512061 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:23:50.512061 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:23:50.512061 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:23:50.512061 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 04:23:50.512061 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 04:23:50.512061 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c321af99-3be9-4477-bd64-099009c0c0e3 could not be found. Oct 19 04:23:50.512061 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:23:50.512061 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b24270f4-1f4a-4570-8f53-b37bcdf01a96 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Returning 404 to user: Instance c321af99-3be9-4477-bd64-099009c0c0e3 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 04:23:50.512061 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b24270f4-1f4a-4570-8f53-b37bcdf01a96 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "DELETE /compute/v2.1/servers/c321af99-3be9-4477-bd64-099009c0c0e3" status: 404 len: 111 microversion: 2.1 time: 0.029943 Oct 19 04:23:50.512061 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4115/7755] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 04:23:50 2022] DELETE /compute/v2.1/servers/c321af99-3be9-4477-bd64-099009c0c0e3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 04:23:50.517803 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ea78c89a-1d8f-45f4-9929-785a64131fa7 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:23:50.518432 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ea78c89a-1d8f-45f4-9929-785a64131fa7 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: c321af99-3be9-4477-bd64-099009c0c0e3] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:23:50.524790 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ea78c89a-1d8f-45f4-9929-785a64131fa7 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:50.525533 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ea78c89a-1d8f-45f4-9929-785a64131fa7 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:50.526033 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ea78c89a-1d8f-45f4-9929-785a64131fa7 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:50.527266 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ea78c89a-1d8f-45f4-9929-785a64131fa7 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:50.527730 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ea78c89a-1d8f-45f4-9929-785a64131fa7 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:50.528165 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ea78c89a-1d8f-45f4-9929-785a64131fa7 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:50.541852 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-ea78c89a-1d8f-45f4-9929-785a64131fa7 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] HTTP exception thrown: Instance c321af99-3be9-4477-bd64-099009c0c0e3 could not be found. Oct 19 04:23:50.543387 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ea78c89a-1d8f-45f4-9929-785a64131fa7 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Request method failure captured: Oct 19 04:23:50.543387 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/c321af99-3be9-4477-bd64-099009c0c0e3 HTTP/1.1 Oct 19 04:23:50.543387 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 04:23:50.543387 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 04:23:50.543387 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 04:23:50.543387 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 04:23:50.543387 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 04:23:50.543387 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 04:23:50.543387 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 04:23:50.543387 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 04:23:50.543387 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT3pS2Cwyyy-dNSAxlLXDbJv718ZCSFb4tsqqjaELCUFVV4hTcgxmjEt9HPf0r6Tip4zea9RCTtHQ0ac2yM_L9WSLCmGFBJhcH41unZ6WfnrAV6EUJNxXeMSOhFFhVbKjU1BMM3_NjFd9xRkGRzGdSLz8_YHyiY2hvcg5UcnlLBsNaKo Oct 19 04:23:50.543387 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 04:23:50.543387 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 04:23:50.543387 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 04:23:50.543387 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 04:23:50.543387 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 04:23:50.543387 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 04:23:50.543387 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 25caabf71e854e4ba4ee627309de481d Oct 19 04:23:50.543387 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ServerActionsTestJSON-130142772 Oct 19 04:23:50.543387 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 04:23:50.543387 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 04:23:50.543387 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/25caabf71e854e4ba4ee627309de481d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/25caabf71e854e4ba4ee627309de481d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/25caabf71e854e4ba4ee627309de481d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_25caabf71e854e4ba4ee627309de481d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 04:23:50.543387 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ServerActionsTestJSON-130142772 Oct 19 04:23:50.543387 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 25caabf71e854e4ba4ee627309de481d Oct 19 04:23:50.543387 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ServerActionsTestJSON-130142772 Oct 19 04:23:50.543387 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ServerActionsTestJSON-130142772-project Oct 19 04:23:50.543387 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 04:23:50.543387 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 04:23:50.543387 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 31018706f7fd45988df04518eee6c044 Oct 19 04:23:50.543387 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ServerActionsTestJSON-130142772-project Oct 19 04:23:50.543387 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 04:23:50.543387 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance c321af99-3be9-4477-bd64-099009c0c0e3 could not be found. Oct 19 04:23:50.543387 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': 'c321af99-3be9-4477-bd64-099009c0c0e3'} Oct 19 04:23:50.543387 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 04:23:50.543387 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:23:50.543387 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 04:23:50.543387 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 04:23:50.543387 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 04:23:50.543387 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 04:23:50.543387 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 04:23:50.543387 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 04:23:50.543387 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 04:23:50.543387 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 04:23:50.543387 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c321af99-3be9-4477-bd64-099009c0c0e3 could not be found. Oct 19 04:23:50.543387 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:23:50.543387 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:23:50.543387 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:23:50.543387 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:23:50.543387 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:23:50.543387 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:23:50.543387 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 04:23:50.543387 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 04:23:50.543387 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 04:23:50.543387 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 04:23:50.543387 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 04:23:50.543387 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 04:23:50.543387 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 04:23:50.543387 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 04:23:50.543387 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 04:23:50.543387 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 04:23:50.543387 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c321af99-3be9-4477-bd64-099009c0c0e3 could not be found. Oct 19 04:23:50.543387 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:23:50.543387 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:23:50.543387 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:23:50.547819 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:23:50.547819 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:23:50.547819 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:23:50.547819 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 04:23:50.547819 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 04:23:50.547819 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c321af99-3be9-4477-bd64-099009c0c0e3 could not be found. Oct 19 04:23:50.547819 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:23:50.547819 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ea78c89a-1d8f-45f4-9929-785a64131fa7 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Returning 404 to user: Instance c321af99-3be9-4477-bd64-099009c0c0e3 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 04:23:50.547819 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ea78c89a-1d8f-45f4-9929-785a64131fa7 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/c321af99-3be9-4477-bd64-099009c0c0e3" status: 404 len: 111 microversion: 2.1 time: 0.031043 Oct 19 04:23:50.547819 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3641/7756] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:23:50 2022] GET /compute/v2.1/servers/c321af99-3be9-4477-bd64-099009c0c0e3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 04:23:50.553664 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7af85d8d-3ab9-4374-afa5-90cd0986003d tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:23:50.554184 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7af85d8d-3ab9-4374-afa5-90cd0986003d tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 21f02256-ec3e-445b-a842-96dae939c926] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:23:50.560692 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7af85d8d-3ab9-4374-afa5-90cd0986003d tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:50.561191 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7af85d8d-3ab9-4374-afa5-90cd0986003d tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:50.561668 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7af85d8d-3ab9-4374-afa5-90cd0986003d tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:50.562379 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7af85d8d-3ab9-4374-afa5-90cd0986003d tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:50.562846 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7af85d8d-3ab9-4374-afa5-90cd0986003d tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:50.563289 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7af85d8d-3ab9-4374-afa5-90cd0986003d tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:50.577721 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-7af85d8d-3ab9-4374-afa5-90cd0986003d tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] HTTP exception thrown: Instance 21f02256-ec3e-445b-a842-96dae939c926 could not be found. Oct 19 04:23:50.579282 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7af85d8d-3ab9-4374-afa5-90cd0986003d tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Request method failure captured: Oct 19 04:23:50.579282 n-d-861333-8 devstack@n-api.service[121134]: request: DELETE /compute/v2.1/servers/21f02256-ec3e-445b-a842-96dae939c926 HTTP/1.1 Oct 19 04:23:50.579282 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 04:23:50.579282 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 04:23:50.579282 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 04:23:50.579282 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 04:23:50.579282 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 04:23:50.579282 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 04:23:50.579282 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 04:23:50.579282 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 04:23:50.579282 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3pS2Cwyyy-dNSAxlLXDbJv718ZCSFb4tsqqjaELCUFVV4hTcgxmjEt9HPf0r6Tip4zea9RCTtHQ0ac2yM_L9WSLCmGFBJhcH41unZ6WfnrAV6EUJNxXeMSOhFFhVbKjU1BMM3_NjFd9xRkGRzGdSLz8_YHyiY2hvcg5UcnlLBsNaKo Oct 19 04:23:50.579282 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 04:23:50.579282 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 04:23:50.579282 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 04:23:50.579282 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 04:23:50.579282 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 04:23:50.579282 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 04:23:50.579282 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 25caabf71e854e4ba4ee627309de481d Oct 19 04:23:50.579282 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ServerActionsTestJSON-130142772 Oct 19 04:23:50.579282 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 04:23:50.579282 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 04:23:50.579282 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/25caabf71e854e4ba4ee627309de481d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/25caabf71e854e4ba4ee627309de481d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/25caabf71e854e4ba4ee627309de481d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_25caabf71e854e4ba4ee627309de481d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 04:23:50.579282 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ServerActionsTestJSON-130142772 Oct 19 04:23:50.579282 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 25caabf71e854e4ba4ee627309de481d Oct 19 04:23:50.579282 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ServerActionsTestJSON-130142772 Oct 19 04:23:50.579282 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ServerActionsTestJSON-130142772-project Oct 19 04:23:50.579282 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 04:23:50.579282 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 04:23:50.579282 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 31018706f7fd45988df04518eee6c044 Oct 19 04:23:50.579282 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ServerActionsTestJSON-130142772-project Oct 19 04:23:50.579282 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 04:23:50.579282 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance 21f02256-ec3e-445b-a842-96dae939c926 could not be found. Oct 19 04:23:50.579282 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '21f02256-ec3e-445b-a842-96dae939c926'} Oct 19 04:23:50.579282 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 04:23:50.579282 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:23:50.579282 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 04:23:50.579282 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 04:23:50.579282 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 04:23:50.579282 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 04:23:50.579282 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 04:23:50.579282 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 04:23:50.579282 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 04:23:50.579282 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 04:23:50.579282 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21f02256-ec3e-445b-a842-96dae939c926 could not be found. Oct 19 04:23:50.579282 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:23:50.579282 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:23:50.579282 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:23:50.579282 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:23:50.579282 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:23:50.579282 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:23:50.579282 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 04:23:50.579282 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 04:23:50.579282 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 04:23:50.579282 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 04:23:50.579282 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 04:23:50.579282 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 04:23:50.579282 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 04:23:50.579282 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 04:23:50.579282 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 04:23:50.579282 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 04:23:50.579282 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 04:23:50.579282 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 04:23:50.583389 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21f02256-ec3e-445b-a842-96dae939c926 could not be found. Oct 19 04:23:50.583389 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:23:50.583389 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:23:50.583389 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:23:50.583389 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:23:50.583389 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:23:50.583389 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:23:50.583389 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 04:23:50.583389 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 04:23:50.583389 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21f02256-ec3e-445b-a842-96dae939c926 could not be found. Oct 19 04:23:50.583389 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:23:50.583389 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7af85d8d-3ab9-4374-afa5-90cd0986003d tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Returning 404 to user: Instance 21f02256-ec3e-445b-a842-96dae939c926 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 04:23:50.583389 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7af85d8d-3ab9-4374-afa5-90cd0986003d tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "DELETE /compute/v2.1/servers/21f02256-ec3e-445b-a842-96dae939c926" status: 404 len: 111 microversion: 2.1 time: 0.031060 Oct 19 04:23:50.583389 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4116/7757] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 04:23:50 2022] DELETE /compute/v2.1/servers/21f02256-ec3e-445b-a842-96dae939c926 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 04:23:50.589749 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-eb1ecf47-1dce-46c7-a8e3-bb0147e732ac tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:23:50.590370 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-eb1ecf47-1dce-46c7-a8e3-bb0147e732ac tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 21f02256-ec3e-445b-a842-96dae939c926] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:23:50.596370 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-eb1ecf47-1dce-46c7-a8e3-bb0147e732ac tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:50.596862 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-eb1ecf47-1dce-46c7-a8e3-bb0147e732ac tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:50.603177 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-eb1ecf47-1dce-46c7-a8e3-bb0147e732ac tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:50.603904 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-eb1ecf47-1dce-46c7-a8e3-bb0147e732ac tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:50.604941 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-eb1ecf47-1dce-46c7-a8e3-bb0147e732ac tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:50.605396 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-eb1ecf47-1dce-46c7-a8e3-bb0147e732ac tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:50.620018 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-eb1ecf47-1dce-46c7-a8e3-bb0147e732ac tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] HTTP exception thrown: Instance 21f02256-ec3e-445b-a842-96dae939c926 could not be found. Oct 19 04:23:50.621584 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-eb1ecf47-1dce-46c7-a8e3-bb0147e732ac tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Request method failure captured: Oct 19 04:23:50.621584 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/21f02256-ec3e-445b-a842-96dae939c926 HTTP/1.1 Oct 19 04:23:50.621584 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 04:23:50.621584 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 04:23:50.621584 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 04:23:50.621584 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 04:23:50.621584 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 04:23:50.621584 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 04:23:50.621584 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 04:23:50.621584 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 04:23:50.621584 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT3pS2Cwyyy-dNSAxlLXDbJv718ZCSFb4tsqqjaELCUFVV4hTcgxmjEt9HPf0r6Tip4zea9RCTtHQ0ac2yM_L9WSLCmGFBJhcH41unZ6WfnrAV6EUJNxXeMSOhFFhVbKjU1BMM3_NjFd9xRkGRzGdSLz8_YHyiY2hvcg5UcnlLBsNaKo Oct 19 04:23:50.621584 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 04:23:50.621584 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 04:23:50.621584 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 04:23:50.621584 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 04:23:50.621584 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 04:23:50.621584 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 04:23:50.621584 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 25caabf71e854e4ba4ee627309de481d Oct 19 04:23:50.621584 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ServerActionsTestJSON-130142772 Oct 19 04:23:50.621584 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 04:23:50.621584 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 04:23:50.621584 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/25caabf71e854e4ba4ee627309de481d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/25caabf71e854e4ba4ee627309de481d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/25caabf71e854e4ba4ee627309de481d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_25caabf71e854e4ba4ee627309de481d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 04:23:50.621584 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ServerActionsTestJSON-130142772 Oct 19 04:23:50.621584 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 25caabf71e854e4ba4ee627309de481d Oct 19 04:23:50.621584 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ServerActionsTestJSON-130142772 Oct 19 04:23:50.621584 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ServerActionsTestJSON-130142772-project Oct 19 04:23:50.621584 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 04:23:50.621584 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 04:23:50.621584 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 31018706f7fd45988df04518eee6c044 Oct 19 04:23:50.621584 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ServerActionsTestJSON-130142772-project Oct 19 04:23:50.621584 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 04:23:50.621584 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance 21f02256-ec3e-445b-a842-96dae939c926 could not be found. Oct 19 04:23:50.621584 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '21f02256-ec3e-445b-a842-96dae939c926'} Oct 19 04:23:50.621584 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 04:23:50.621584 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:23:50.621584 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 04:23:50.621584 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 04:23:50.621584 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 04:23:50.621584 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 04:23:50.621584 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 04:23:50.621584 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 04:23:50.621584 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 04:23:50.621584 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 04:23:50.621584 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21f02256-ec3e-445b-a842-96dae939c926 could not be found. Oct 19 04:23:50.621584 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:23:50.621584 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:23:50.621584 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:23:50.621584 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:23:50.621584 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:23:50.621584 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:23:50.621584 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 04:23:50.621584 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 04:23:50.621584 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 04:23:50.621584 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 04:23:50.621584 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 04:23:50.621584 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 04:23:50.621584 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 04:23:50.621584 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 04:23:50.621584 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 04:23:50.621584 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 04:23:50.621584 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21f02256-ec3e-445b-a842-96dae939c926 could not be found. Oct 19 04:23:50.621584 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:23:50.621584 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:23:50.621584 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:23:50.625611 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:23:50.625611 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:23:50.625611 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:23:50.625611 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 04:23:50.625611 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 04:23:50.625611 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21f02256-ec3e-445b-a842-96dae939c926 could not be found. Oct 19 04:23:50.625611 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:23:50.625611 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-eb1ecf47-1dce-46c7-a8e3-bb0147e732ac tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Returning 404 to user: Instance 21f02256-ec3e-445b-a842-96dae939c926 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 04:23:50.625611 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-eb1ecf47-1dce-46c7-a8e3-bb0147e732ac tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/21f02256-ec3e-445b-a842-96dae939c926" status: 404 len: 111 microversion: 2.1 time: 0.037676 Oct 19 04:23:50.625611 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3642/7758] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:23:50 2022] GET /compute/v2.1/servers/21f02256-ec3e-445b-a842-96dae939c926 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 04:23:50.631961 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9a60b123-b82b-4299-974d-a2565ad08806 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:23:50.632475 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9a60b123-b82b-4299-974d-a2565ad08806 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0532d211-0e06-47ae-8441-32d2a7b3cdd8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:23:50.638471 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9a60b123-b82b-4299-974d-a2565ad08806 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:50.638978 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9a60b123-b82b-4299-974d-a2565ad08806 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:50.639411 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9a60b123-b82b-4299-974d-a2565ad08806 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:50.640112 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9a60b123-b82b-4299-974d-a2565ad08806 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:50.640573 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9a60b123-b82b-4299-974d-a2565ad08806 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:50.641019 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9a60b123-b82b-4299-974d-a2565ad08806 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:50.655613 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-9a60b123-b82b-4299-974d-a2565ad08806 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] HTTP exception thrown: Instance 0532d211-0e06-47ae-8441-32d2a7b3cdd8 could not be found. Oct 19 04:23:50.657209 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9a60b123-b82b-4299-974d-a2565ad08806 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Request method failure captured: Oct 19 04:23:50.657209 n-d-861333-8 devstack@n-api.service[121134]: request: DELETE /compute/v2.1/servers/0532d211-0e06-47ae-8441-32d2a7b3cdd8 HTTP/1.1 Oct 19 04:23:50.657209 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 04:23:50.657209 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 04:23:50.657209 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 04:23:50.657209 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 04:23:50.657209 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 04:23:50.657209 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 04:23:50.657209 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 04:23:50.657209 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 04:23:50.657209 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3pS2Cwyyy-dNSAxlLXDbJv718ZCSFb4tsqqjaELCUFVV4hTcgxmjEt9HPf0r6Tip4zea9RCTtHQ0ac2yM_L9WSLCmGFBJhcH41unZ6WfnrAV6EUJNxXeMSOhFFhVbKjU1BMM3_NjFd9xRkGRzGdSLz8_YHyiY2hvcg5UcnlLBsNaKo Oct 19 04:23:50.657209 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 04:23:50.657209 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 04:23:50.657209 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 04:23:50.657209 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 04:23:50.657209 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 04:23:50.657209 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 04:23:50.657209 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 25caabf71e854e4ba4ee627309de481d Oct 19 04:23:50.657209 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ServerActionsTestJSON-130142772 Oct 19 04:23:50.657209 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 04:23:50.657209 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 04:23:50.657209 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/25caabf71e854e4ba4ee627309de481d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/25caabf71e854e4ba4ee627309de481d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/25caabf71e854e4ba4ee627309de481d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_25caabf71e854e4ba4ee627309de481d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 04:23:50.657209 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ServerActionsTestJSON-130142772 Oct 19 04:23:50.657209 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 25caabf71e854e4ba4ee627309de481d Oct 19 04:23:50.657209 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ServerActionsTestJSON-130142772 Oct 19 04:23:50.657209 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ServerActionsTestJSON-130142772-project Oct 19 04:23:50.657209 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 04:23:50.657209 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 04:23:50.657209 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 31018706f7fd45988df04518eee6c044 Oct 19 04:23:50.657209 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ServerActionsTestJSON-130142772-project Oct 19 04:23:50.657209 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 04:23:50.657209 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance 0532d211-0e06-47ae-8441-32d2a7b3cdd8 could not be found. Oct 19 04:23:50.657209 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '0532d211-0e06-47ae-8441-32d2a7b3cdd8'} Oct 19 04:23:50.657209 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 04:23:50.657209 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:23:50.657209 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 04:23:50.657209 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 04:23:50.657209 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 04:23:50.657209 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 04:23:50.657209 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 04:23:50.657209 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 04:23:50.657209 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 04:23:50.657209 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 04:23:50.657209 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0532d211-0e06-47ae-8441-32d2a7b3cdd8 could not be found. Oct 19 04:23:50.657209 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:23:50.657209 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:23:50.657209 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:23:50.657209 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:23:50.657209 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:23:50.657209 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:23:50.657209 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 04:23:50.657209 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 04:23:50.657209 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 04:23:50.657209 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 04:23:50.657209 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 04:23:50.657209 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 04:23:50.657209 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 04:23:50.657209 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 04:23:50.657209 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 04:23:50.657209 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 04:23:50.657209 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 04:23:50.657209 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 04:23:50.661588 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0532d211-0e06-47ae-8441-32d2a7b3cdd8 could not be found. Oct 19 04:23:50.661588 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:23:50.661588 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:23:50.661588 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:23:50.661588 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:23:50.661588 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:23:50.661588 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:23:50.661588 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 04:23:50.661588 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 04:23:50.661588 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0532d211-0e06-47ae-8441-32d2a7b3cdd8 could not be found. Oct 19 04:23:50.661588 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:23:50.661588 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9a60b123-b82b-4299-974d-a2565ad08806 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Returning 404 to user: Instance 0532d211-0e06-47ae-8441-32d2a7b3cdd8 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 04:23:50.661588 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9a60b123-b82b-4299-974d-a2565ad08806 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "DELETE /compute/v2.1/servers/0532d211-0e06-47ae-8441-32d2a7b3cdd8" status: 404 len: 111 microversion: 2.1 time: 0.030680 Oct 19 04:23:50.661588 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4117/7759] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 04:23:50 2022] DELETE /compute/v2.1/servers/0532d211-0e06-47ae-8441-32d2a7b3cdd8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 04:23:50.668796 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-97c06671-bf5a-4f42-9a19-51da962f4b2b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:23:50.671704 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-97c06671-bf5a-4f42-9a19-51da962f4b2b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [instance: 0532d211-0e06-47ae-8441-32d2a7b3cdd8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:23:50.675885 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-97c06671-bf5a-4f42-9a19-51da962f4b2b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:50.676381 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-97c06671-bf5a-4f42-9a19-51da962f4b2b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:50.676825 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-97c06671-bf5a-4f42-9a19-51da962f4b2b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:50.677636 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-97c06671-bf5a-4f42-9a19-51da962f4b2b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:23:50.678090 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-97c06671-bf5a-4f42-9a19-51da962f4b2b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:23:50.678517 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-97c06671-bf5a-4f42-9a19-51da962f4b2b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:23:50.692947 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-97c06671-bf5a-4f42-9a19-51da962f4b2b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] HTTP exception thrown: Instance 0532d211-0e06-47ae-8441-32d2a7b3cdd8 could not be found. Oct 19 04:23:50.694644 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-97c06671-bf5a-4f42-9a19-51da962f4b2b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Request method failure captured: Oct 19 04:23:50.694644 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/0532d211-0e06-47ae-8441-32d2a7b3cdd8 HTTP/1.1 Oct 19 04:23:50.694644 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 04:23:50.694644 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 04:23:50.694644 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 04:23:50.694644 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 04:23:50.694644 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 04:23:50.694644 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 04:23:50.694644 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 04:23:50.694644 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 04:23:50.694644 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT3pS2Cwyyy-dNSAxlLXDbJv718ZCSFb4tsqqjaELCUFVV4hTcgxmjEt9HPf0r6Tip4zea9RCTtHQ0ac2yM_L9WSLCmGFBJhcH41unZ6WfnrAV6EUJNxXeMSOhFFhVbKjU1BMM3_NjFd9xRkGRzGdSLz8_YHyiY2hvcg5UcnlLBsNaKo Oct 19 04:23:50.694644 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 04:23:50.694644 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 04:23:50.694644 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 04:23:50.694644 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 04:23:50.694644 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 04:23:50.694644 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 04:23:50.694644 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 25caabf71e854e4ba4ee627309de481d Oct 19 04:23:50.694644 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ServerActionsTestJSON-130142772 Oct 19 04:23:50.694644 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 04:23:50.694644 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 04:23:50.694644 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/25caabf71e854e4ba4ee627309de481d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/25caabf71e854e4ba4ee627309de481d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/25caabf71e854e4ba4ee627309de481d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_25caabf71e854e4ba4ee627309de481d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 04:23:50.694644 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ServerActionsTestJSON-130142772 Oct 19 04:23:50.694644 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 25caabf71e854e4ba4ee627309de481d Oct 19 04:23:50.694644 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ServerActionsTestJSON-130142772 Oct 19 04:23:50.694644 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ServerActionsTestJSON-130142772-project Oct 19 04:23:50.694644 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 04:23:50.694644 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 04:23:50.694644 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 31018706f7fd45988df04518eee6c044 Oct 19 04:23:50.694644 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ServerActionsTestJSON-130142772-project Oct 19 04:23:50.694644 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 04:23:50.694644 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance 0532d211-0e06-47ae-8441-32d2a7b3cdd8 could not be found. Oct 19 04:23:50.694644 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '0532d211-0e06-47ae-8441-32d2a7b3cdd8'} Oct 19 04:23:50.694644 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 04:23:50.694644 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:23:50.694644 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 04:23:50.694644 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 04:23:50.694644 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 04:23:50.694644 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 04:23:50.694644 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 04:23:50.694644 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 04:23:50.694644 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 04:23:50.694644 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 04:23:50.694644 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0532d211-0e06-47ae-8441-32d2a7b3cdd8 could not be found. Oct 19 04:23:50.694644 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:23:50.694644 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:23:50.694644 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:23:50.694644 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:23:50.694644 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:23:50.694644 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:23:50.694644 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 04:23:50.694644 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 04:23:50.694644 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 04:23:50.694644 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 04:23:50.694644 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 04:23:50.694644 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 04:23:50.694644 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 04:23:50.694644 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 04:23:50.694644 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 04:23:50.694644 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 04:23:50.694644 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0532d211-0e06-47ae-8441-32d2a7b3cdd8 could not be found. Oct 19 04:23:50.694644 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:23:50.694644 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:23:50.694644 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:23:50.702267 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:23:50.702267 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:23:50.702267 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:23:50.702267 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 04:23:50.702267 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 04:23:50.702267 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0532d211-0e06-47ae-8441-32d2a7b3cdd8 could not be found. Oct 19 04:23:50.702267 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:23:50.702267 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-97c06671-bf5a-4f42-9a19-51da962f4b2b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Returning 404 to user: Instance 0532d211-0e06-47ae-8441-32d2a7b3cdd8 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 04:23:50.702267 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-97c06671-bf5a-4f42-9a19-51da962f4b2b tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "GET /compute/v2.1/servers/0532d211-0e06-47ae-8441-32d2a7b3cdd8" status: 404 len: 111 microversion: 2.1 time: 0.032244 Oct 19 04:23:50.702267 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3643/7760] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:23:50 2022] GET /compute/v2.1/servers/0532d211-0e06-47ae-8441-32d2a7b3cdd8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 04:23:50.704953 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-296f080e-a149-409a-b881-09c77c0d7601 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] Calling method '.version_select at 0x7fc12bfe28b0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:23:50.709388 n-d-861333-8 devstack@n-api.service[121134]: ERROR oslo.messaging._drivers.impl_rabbit [None req-296f080e-a149-409a-b881-09c77c0d7601 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [19b0d749-bd61-471f-8efc-e4b656063a84] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 19 04:23:51.717617 n-d-861333-8 devstack@n-api.service[121134]: INFO oslo.messaging._drivers.impl_rabbit [None req-296f080e-a149-409a-b881-09c77c0d7601 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] [19b0d749-bd61-471f-8efc-e4b656063a84] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 33576. Oct 19 04:23:51.782802 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-296f080e-a149-409a-b881-09c77c0d7601 tempest-ServerActionsTestJSON-130142772 tempest-ServerActionsTestJSON-130142772-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2091471087" status: 202 len: 0 microversion: 2.1 time: 1.081648 Oct 19 04:23:51.783415 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4118/7761] 10.222.0.52 () {58 vars in 1221 bytes} [Wed Oct 19 04:23:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2091471087 => generated 0 bytes in 1083 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 04:24:03.396352 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:24:03.396956 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:24:03.534118 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-bfda9093-2946-4e9c-a026-111899b724d0 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1238753178", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "networks": [{"uuid": "2c9b9af8-1e27-4fc1-b4b0-1b1c6b64032f"}]}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:24:03.593459 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.network.neutron [None req-bfda9093-2946-4e9c-a026-111899b724d0 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] validate_networks() for [('2c9b9af8-1e27-4fc1-b4b0-1b1c6b64032f', None, None, None, None, None)] {{(pid=121135) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 04:24:03.968255 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-bfda9093-2946-4e9c-a026-111899b724d0 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Flavor limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 04:24:03.968689 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-bfda9093-2946-4e9c-a026-111899b724d0 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Image limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 04:24:03.969176 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-bfda9093-2946-4e9c-a026-111899b724d0 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Flavor pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 04:24:03.969651 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-bfda9093-2946-4e9c-a026-111899b724d0 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Image pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 04:24:03.970081 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-bfda9093-2946-4e9c-a026-111899b724d0 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 04:24:03.979246 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bfda9093-2946-4e9c-a026-111899b724d0 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:24:03.979799 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bfda9093-2946-4e9c-a026-111899b724d0 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:24:03.980255 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bfda9093-2946-4e9c-a026-111899b724d0 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:24:03.981133 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bfda9093-2946-4e9c-a026-111899b724d0 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:24:03.981636 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bfda9093-2946-4e9c-a026-111899b724d0 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:24:03.982105 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bfda9093-2946-4e9c-a026-111899b724d0 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:24:04.000130 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-bfda9093-2946-4e9c-a026-111899b724d0 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Getting quotas for project 3084e66b15b645e683a12ce6b94e6106. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 04:24:04.005620 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-bfda9093-2946-4e9c-a026-111899b724d0 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Getting quotas for user bc05ba037afe4b1e99d9da5b2bdb01b7 and project 3084e66b15b645e683a12ce6b94e6106. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 04:24:04.019614 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-bfda9093-2946-4e9c-a026-111899b724d0 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Going to run 1 instances... {{(pid=121135) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 04:24:04.021972 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-bfda9093-2946-4e9c-a026-111899b724d0 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] [instance: 15c4de5f-2c34-4ed4-ab34-733ef307c3c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121135) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 04:24:04.151731 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-bfda9093-2946-4e9c-a026-111899b724d0 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.760828 Oct 19 04:24:04.152298 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3644/7762] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 04:24:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 763 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 04:24:04.163425 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-498d92ef-b657-4398-ae27-de58c8acf3a1 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:24:04.164068 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-498d92ef-b657-4398-ae27-de58c8acf3a1 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] [instance: 15c4de5f-2c34-4ed4-ab34-733ef307c3c6] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:24:04.167223 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=39 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:24:04.177459 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=26,nova_api:DELETE=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:24:04.234937 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-498d92ef-b657-4398-ae27-de58c8acf3a1 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc05ba037afe4b1e99d9da5b2bdb01b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3084e66b15b645e683a12ce6b94e6106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:24:04.244227 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-498d92ef-b657-4398-ae27-de58c8acf3a1 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] 10.222.0.52 "GET /compute/v2.1/servers/15c4de5f-2c34-4ed4-ab34-733ef307c3c6" status: 200 len: 1217 microversion: 2.1 time: 0.084620 Oct 19 04:24:04.245893 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4119/7763] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:24:04 2022] GET /compute/v2.1/servers/15c4de5f-2c34-4ed4-ab34-733ef307c3c6 => generated 1217 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:24:05.268956 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-eaca1c46-e3e6-4237-958b-4c421959c0a9 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:24:05.269685 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-eaca1c46-e3e6-4237-958b-4c421959c0a9 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] [instance: 15c4de5f-2c34-4ed4-ab34-733ef307c3c6] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:24:05.288190 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-eaca1c46-e3e6-4237-958b-4c421959c0a9 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:24:05.288696 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-eaca1c46-e3e6-4237-958b-4c421959c0a9 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:24:05.289506 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-eaca1c46-e3e6-4237-958b-4c421959c0a9 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:24:05.290899 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-eaca1c46-e3e6-4237-958b-4c421959c0a9 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:24:05.291372 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-eaca1c46-e3e6-4237-958b-4c421959c0a9 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:24:05.291846 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-eaca1c46-e3e6-4237-958b-4c421959c0a9 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:24:05.356783 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-eaca1c46-e3e6-4237-958b-4c421959c0a9 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc05ba037afe4b1e99d9da5b2bdb01b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3084e66b15b645e683a12ce6b94e6106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:24:05.364764 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-eaca1c46-e3e6-4237-958b-4c421959c0a9 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] 10.222.0.52 "GET /compute/v2.1/servers/15c4de5f-2c34-4ed4-ab34-733ef307c3c6" status: 200 len: 1221 microversion: 2.1 time: 0.100661 Oct 19 04:24:05.365738 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3645/7764] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:24:05 2022] GET /compute/v2.1/servers/15c4de5f-2c34-4ed4-ab34-733ef307c3c6 => generated 1221 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:24:06.389280 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d427409f-0ee9-4ca6-bcc5-ab425e21ba7b tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:24:06.390121 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d427409f-0ee9-4ca6-bcc5-ab425e21ba7b tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] [instance: 15c4de5f-2c34-4ed4-ab34-733ef307c3c6] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:24:06.399365 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d427409f-0ee9-4ca6-bcc5-ab425e21ba7b tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:24:06.399937 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d427409f-0ee9-4ca6-bcc5-ab425e21ba7b tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:24:06.400481 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d427409f-0ee9-4ca6-bcc5-ab425e21ba7b tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:24:06.401967 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d427409f-0ee9-4ca6-bcc5-ab425e21ba7b tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:24:06.402676 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d427409f-0ee9-4ca6-bcc5-ab425e21ba7b tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:24:06.403318 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d427409f-0ee9-4ca6-bcc5-ab425e21ba7b tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:24:06.489343 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d427409f-0ee9-4ca6-bcc5-ab425e21ba7b tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc05ba037afe4b1e99d9da5b2bdb01b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3084e66b15b645e683a12ce6b94e6106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:24:06.493024 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d427409f-0ee9-4ca6-bcc5-ab425e21ba7b tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] 10.222.0.52 "GET /compute/v2.1/servers/15c4de5f-2c34-4ed4-ab34-733ef307c3c6" status: 200 len: 1269 microversion: 2.1 time: 0.108537 Oct 19 04:24:06.493805 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4120/7765] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:24:06 2022] GET /compute/v2.1/servers/15c4de5f-2c34-4ed4-ab34-733ef307c3c6 => generated 1269 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:24:07.517824 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-af29d5ef-97cf-4442-97f2-3a5ef23044db tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:24:07.518484 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-af29d5ef-97cf-4442-97f2-3a5ef23044db tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] [instance: 15c4de5f-2c34-4ed4-ab34-733ef307c3c6] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:24:07.526159 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-af29d5ef-97cf-4442-97f2-3a5ef23044db tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:24:07.526583 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-af29d5ef-97cf-4442-97f2-3a5ef23044db tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:24:07.527033 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-af29d5ef-97cf-4442-97f2-3a5ef23044db tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:24:07.527749 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-af29d5ef-97cf-4442-97f2-3a5ef23044db tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:24:07.528211 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-af29d5ef-97cf-4442-97f2-3a5ef23044db tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:24:07.528646 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-af29d5ef-97cf-4442-97f2-3a5ef23044db tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:24:07.725165 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-af29d5ef-97cf-4442-97f2-3a5ef23044db tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc05ba037afe4b1e99d9da5b2bdb01b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3084e66b15b645e683a12ce6b94e6106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:24:07.733055 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-af29d5ef-97cf-4442-97f2-3a5ef23044db tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] 10.222.0.52 "GET /compute/v2.1/servers/15c4de5f-2c34-4ed4-ab34-733ef307c3c6" status: 200 len: 1317 microversion: 2.1 time: 0.219287 Oct 19 04:24:07.733674 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3646/7766] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:24:07 2022] GET /compute/v2.1/servers/15c4de5f-2c34-4ed4-ab34-733ef307c3c6 => generated 1317 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:24:08.422040 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-60cc4fd5-d74a-4d4d-b9a8-5f2ea41dff8b req-8d217c22-544e-40ee-9ae3-8f6664c5f153 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15c4de5f-2c34-4ed4-ab34-733ef307c3c6", "tag": "c2c80320-cd15-427b-921a-bf7dbbbda4e4"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:24:08.432679 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-60cc4fd5-d74a-4d4d-b9a8-5f2ea41dff8b req-8d217c22-544e-40ee-9ae3-8f6664c5f153 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:24:08.433225 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-60cc4fd5-d74a-4d4d-b9a8-5f2ea41dff8b req-8d217c22-544e-40ee-9ae3-8f6664c5f153 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:24:08.433717 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-60cc4fd5-d74a-4d4d-b9a8-5f2ea41dff8b req-8d217c22-544e-40ee-9ae3-8f6664c5f153 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:24:08.445503 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-60cc4fd5-d74a-4d4d-b9a8-5f2ea41dff8b req-8d217c22-544e-40ee-9ae3-8f6664c5f153 service nova] Creating event network-changed:c2c80320-cd15-427b-921a-bf7dbbbda4e4 for instance 15c4de5f-2c34-4ed4-ab34-733ef307c3c6 on n-h2-861333-8 Oct 19 04:24:08.451390 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-60cc4fd5-d74a-4d4d-b9a8-5f2ea41dff8b req-8d217c22-544e-40ee-9ae3-8f6664c5f153 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034243 Oct 19 04:24:08.453167 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4121/7767] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:24:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:24:08.756191 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9d24c915-5622-452f-b9a4-41007b8d267e tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:24:08.757502 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9d24c915-5622-452f-b9a4-41007b8d267e tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] [instance: 15c4de5f-2c34-4ed4-ab34-733ef307c3c6] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:24:08.764648 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9d24c915-5622-452f-b9a4-41007b8d267e tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:24:08.765152 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9d24c915-5622-452f-b9a4-41007b8d267e tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:24:08.765624 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9d24c915-5622-452f-b9a4-41007b8d267e tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:24:08.766338 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9d24c915-5622-452f-b9a4-41007b8d267e tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:24:08.766804 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9d24c915-5622-452f-b9a4-41007b8d267e tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:24:08.767245 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9d24c915-5622-452f-b9a4-41007b8d267e tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:24:08.987031 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-9d24c915-5622-452f-b9a4-41007b8d267e tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc05ba037afe4b1e99d9da5b2bdb01b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3084e66b15b645e683a12ce6b94e6106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:24:08.995413 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9d24c915-5622-452f-b9a4-41007b8d267e tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] 10.222.0.52 "GET /compute/v2.1/servers/15c4de5f-2c34-4ed4-ab34-733ef307c3c6" status: 200 len: 1317 microversion: 2.1 time: 0.242629 Oct 19 04:24:08.995996 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3647/7768] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:24:08 2022] GET /compute/v2.1/servers/15c4de5f-2c34-4ed4-ab34-733ef307c3c6 => generated 1317 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:24:10.019427 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-60ec042e-632f-4917-a026-9d646dd62f1b tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:24:10.020151 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-60ec042e-632f-4917-a026-9d646dd62f1b tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] [instance: 15c4de5f-2c34-4ed4-ab34-733ef307c3c6] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:24:10.028106 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-60ec042e-632f-4917-a026-9d646dd62f1b tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:24:10.028618 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-60ec042e-632f-4917-a026-9d646dd62f1b tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:24:10.029081 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-60ec042e-632f-4917-a026-9d646dd62f1b tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:24:10.029835 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-60ec042e-632f-4917-a026-9d646dd62f1b tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:24:10.030312 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-60ec042e-632f-4917-a026-9d646dd62f1b tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:24:10.030760 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-60ec042e-632f-4917-a026-9d646dd62f1b tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:24:10.158951 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-60ec042e-632f-4917-a026-9d646dd62f1b tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc05ba037afe4b1e99d9da5b2bdb01b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3084e66b15b645e683a12ce6b94e6106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:24:10.166507 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-60ec042e-632f-4917-a026-9d646dd62f1b tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] 10.222.0.52 "GET /compute/v2.1/servers/15c4de5f-2c34-4ed4-ab34-733ef307c3c6" status: 200 len: 1317 microversion: 2.1 time: 0.151461 Oct 19 04:24:10.167078 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4122/7769] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:24:10 2022] GET /compute/v2.1/servers/15c4de5f-2c34-4ed4-ab34-733ef307c3c6 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:24:11.189560 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d149bb5a-b176-41ea-a23b-3328ffd5e03e tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:24:11.190214 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d149bb5a-b176-41ea-a23b-3328ffd5e03e tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] [instance: 15c4de5f-2c34-4ed4-ab34-733ef307c3c6] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:24:11.196828 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d149bb5a-b176-41ea-a23b-3328ffd5e03e tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:24:11.197325 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d149bb5a-b176-41ea-a23b-3328ffd5e03e tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:24:11.198398 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d149bb5a-b176-41ea-a23b-3328ffd5e03e tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:24:11.199124 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d149bb5a-b176-41ea-a23b-3328ffd5e03e tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:24:11.199584 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d149bb5a-b176-41ea-a23b-3328ffd5e03e tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:24:11.200016 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d149bb5a-b176-41ea-a23b-3328ffd5e03e tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:24:11.331364 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d149bb5a-b176-41ea-a23b-3328ffd5e03e tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc05ba037afe4b1e99d9da5b2bdb01b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3084e66b15b645e683a12ce6b94e6106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:24:11.340298 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d149bb5a-b176-41ea-a23b-3328ffd5e03e tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] 10.222.0.52 "GET /compute/v2.1/servers/15c4de5f-2c34-4ed4-ab34-733ef307c3c6" status: 200 len: 1317 microversion: 2.1 time: 0.154779 Oct 19 04:24:11.340927 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3648/7770] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:24:11 2022] GET /compute/v2.1/servers/15c4de5f-2c34-4ed4-ab34-733ef307c3c6 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:24:12.364285 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-bf6a43e1-d6c1-45a6-8ccc-4f593ba53cb1 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:24:12.364925 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-bf6a43e1-d6c1-45a6-8ccc-4f593ba53cb1 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] [instance: 15c4de5f-2c34-4ed4-ab34-733ef307c3c6] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:24:12.371881 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bf6a43e1-d6c1-45a6-8ccc-4f593ba53cb1 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:24:12.372388 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bf6a43e1-d6c1-45a6-8ccc-4f593ba53cb1 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:24:12.378105 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bf6a43e1-d6c1-45a6-8ccc-4f593ba53cb1 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:24:12.378105 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bf6a43e1-d6c1-45a6-8ccc-4f593ba53cb1 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:24:12.378105 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bf6a43e1-d6c1-45a6-8ccc-4f593ba53cb1 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:24:12.378105 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bf6a43e1-d6c1-45a6-8ccc-4f593ba53cb1 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:24:12.505556 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-44718feb-c5d0-4885-906d-1b1a6baf41d6 req-f1a34211-88bb-441f-995d-fdc8f09ffd0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15c4de5f-2c34-4ed4-ab34-733ef307c3c6", "name": "network-vif-plugged", "status": "completed", "tag": "c2c80320-cd15-427b-921a-bf7dbbbda4e4"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:24:12.511949 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-bf6a43e1-d6c1-45a6-8ccc-4f593ba53cb1 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc05ba037afe4b1e99d9da5b2bdb01b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3084e66b15b645e683a12ce6b94e6106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:24:12.517111 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-44718feb-c5d0-4885-906d-1b1a6baf41d6 req-f1a34211-88bb-441f-995d-fdc8f09ffd0c service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:24:12.517626 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-44718feb-c5d0-4885-906d-1b1a6baf41d6 req-f1a34211-88bb-441f-995d-fdc8f09ffd0c service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:24:12.518245 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-44718feb-c5d0-4885-906d-1b1a6baf41d6 req-f1a34211-88bb-441f-995d-fdc8f09ffd0c service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:24:12.519991 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-bf6a43e1-d6c1-45a6-8ccc-4f593ba53cb1 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] 10.222.0.52 "GET /compute/v2.1/servers/15c4de5f-2c34-4ed4-ab34-733ef307c3c6" status: 200 len: 1317 microversion: 2.1 time: 0.159740 Oct 19 04:24:12.520621 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4123/7771] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:24:12 2022] GET /compute/v2.1/servers/15c4de5f-2c34-4ed4-ab34-733ef307c3c6 => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:24:12.530518 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-44718feb-c5d0-4885-906d-1b1a6baf41d6 req-f1a34211-88bb-441f-995d-fdc8f09ffd0c service nova] Creating event network-vif-plugged:c2c80320-cd15-427b-921a-bf7dbbbda4e4 for instance 15c4de5f-2c34-4ed4-ab34-733ef307c3c6 on n-h2-861333-8 Oct 19 04:24:12.538305 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-44718feb-c5d0-4885-906d-1b1a6baf41d6 req-f1a34211-88bb-441f-995d-fdc8f09ffd0c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036510 Oct 19 04:24:12.538893 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3649/7772] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:24:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 04:24:13.543827 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-62eaafba-00d3-4d35-b376-f76a273ba360 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:24:13.544474 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-62eaafba-00d3-4d35-b376-f76a273ba360 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] [instance: 15c4de5f-2c34-4ed4-ab34-733ef307c3c6] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:24:13.551372 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-62eaafba-00d3-4d35-b376-f76a273ba360 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:24:13.551878 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-62eaafba-00d3-4d35-b376-f76a273ba360 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:24:13.552338 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-62eaafba-00d3-4d35-b376-f76a273ba360 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:24:13.553053 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-62eaafba-00d3-4d35-b376-f76a273ba360 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:24:13.553560 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-62eaafba-00d3-4d35-b376-f76a273ba360 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:24:13.558156 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-62eaafba-00d3-4d35-b376-f76a273ba360 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:24:13.688961 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-62eaafba-00d3-4d35-b376-f76a273ba360 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc05ba037afe4b1e99d9da5b2bdb01b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3084e66b15b645e683a12ce6b94e6106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:24:13.696871 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-62eaafba-00d3-4d35-b376-f76a273ba360 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] 10.222.0.52 "GET /compute/v2.1/servers/15c4de5f-2c34-4ed4-ab34-733ef307c3c6" status: 200 len: 1317 microversion: 2.1 time: 0.156968 Oct 19 04:24:13.697482 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4124/7773] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:24:13 2022] GET /compute/v2.1/servers/15c4de5f-2c34-4ed4-ab34-733ef307c3c6 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:24:14.718733 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:24:14.719513 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=6 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:24:14.723579 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-013339d8-84b4-42ab-aa44-d976934484f1 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:24:14.728626 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-013339d8-84b4-42ab-aa44-d976934484f1 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] [instance: 15c4de5f-2c34-4ed4-ab34-733ef307c3c6] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:24:14.730472 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-013339d8-84b4-42ab-aa44-d976934484f1 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:24:14.730970 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-013339d8-84b4-42ab-aa44-d976934484f1 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:24:14.731416 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-013339d8-84b4-42ab-aa44-d976934484f1 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:24:14.732123 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-013339d8-84b4-42ab-aa44-d976934484f1 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:24:14.732592 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-013339d8-84b4-42ab-aa44-d976934484f1 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:24:14.733037 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-013339d8-84b4-42ab-aa44-d976934484f1 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:24:14.862990 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-013339d8-84b4-42ab-aa44-d976934484f1 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc05ba037afe4b1e99d9da5b2bdb01b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3084e66b15b645e683a12ce6b94e6106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:24:14.870758 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-013339d8-84b4-42ab-aa44-d976934484f1 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] 10.222.0.52 "GET /compute/v2.1/servers/15c4de5f-2c34-4ed4-ab34-733ef307c3c6" status: 200 len: 1504 microversion: 2.1 time: 0.153899 Oct 19 04:24:14.871339 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3650/7774] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:24:14 2022] GET /compute/v2.1/servers/15c4de5f-2c34-4ed4-ab34-733ef307c3c6 => generated 1504 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:24:14.935694 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5d47aad9-5ffa-407f-aef2-369a94f6a257 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2134425996", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "networks": [{"uuid": "2c9b9af8-1e27-4fc1-b4b0-1b1c6b64032f"}]}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:24:14.944272 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:24:14.989097 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-5d47aad9-5ffa-407f-aef2-369a94f6a257 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] validate_networks() for [('2c9b9af8-1e27-4fc1-b4b0-1b1c6b64032f', None, None, None, None, None)] {{(pid=121134) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 04:24:15.397948 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-5d47aad9-5ffa-407f-aef2-369a94f6a257 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Flavor limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 04:24:15.398395 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-5d47aad9-5ffa-407f-aef2-369a94f6a257 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Image limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 04:24:15.398890 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-5d47aad9-5ffa-407f-aef2-369a94f6a257 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Flavor pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 04:24:15.400162 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-5d47aad9-5ffa-407f-aef2-369a94f6a257 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Image pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 04:24:15.400162 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-5d47aad9-5ffa-407f-aef2-369a94f6a257 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 04:24:15.408894 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5d47aad9-5ffa-407f-aef2-369a94f6a257 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:24:15.409421 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5d47aad9-5ffa-407f-aef2-369a94f6a257 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:24:15.409883 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5d47aad9-5ffa-407f-aef2-369a94f6a257 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:24:15.410634 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5d47aad9-5ffa-407f-aef2-369a94f6a257 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:24:15.411106 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5d47aad9-5ffa-407f-aef2-369a94f6a257 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:24:15.411556 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5d47aad9-5ffa-407f-aef2-369a94f6a257 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:24:15.428776 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-5d47aad9-5ffa-407f-aef2-369a94f6a257 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Getting quotas for project 3084e66b15b645e683a12ce6b94e6106. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 04:24:15.434791 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-5d47aad9-5ffa-407f-aef2-369a94f6a257 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Getting quotas for user bc05ba037afe4b1e99d9da5b2bdb01b7 and project 3084e66b15b645e683a12ce6b94e6106. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 04:24:15.447161 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5d47aad9-5ffa-407f-aef2-369a94f6a257 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Going to run 1 instances... {{(pid=121134) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 04:24:15.449515 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5d47aad9-5ffa-407f-aef2-369a94f6a257 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] [instance: 6c72f4c6-ece9-4e44-82a6-f13e01f70153] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 04:24:15.573288 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5d47aad9-5ffa-407f-aef2-369a94f6a257 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.641809 Oct 19 04:24:15.574100 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4125/7775] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 04:24:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 643 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 04:24:15.585002 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c7106e76-b2ab-499f-9105-78cf118fd668 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:24:15.585661 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c7106e76-b2ab-499f-9105-78cf118fd668 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] [instance: 6c72f4c6-ece9-4e44-82a6-f13e01f70153] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:24:15.645893 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c7106e76-b2ab-499f-9105-78cf118fd668 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc05ba037afe4b1e99d9da5b2bdb01b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3084e66b15b645e683a12ce6b94e6106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:24:15.654568 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c7106e76-b2ab-499f-9105-78cf118fd668 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] 10.222.0.52 "GET /compute/v2.1/servers/6c72f4c6-ece9-4e44-82a6-f13e01f70153" status: 200 len: 1217 microversion: 2.1 time: 0.073426 Oct 19 04:24:15.657939 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3651/7776] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:24:15 2022] GET /compute/v2.1/servers/6c72f4c6-ece9-4e44-82a6-f13e01f70153 => generated 1217 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:24:16.678402 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5a3d300b-3cec-463a-af8b-5a36463d9bd5 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:24:16.679109 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5a3d300b-3cec-463a-af8b-5a36463d9bd5 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] [instance: 6c72f4c6-ece9-4e44-82a6-f13e01f70153] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:24:16.686387 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5a3d300b-3cec-463a-af8b-5a36463d9bd5 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:24:16.689996 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5a3d300b-3cec-463a-af8b-5a36463d9bd5 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:24:16.689996 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5a3d300b-3cec-463a-af8b-5a36463d9bd5 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:24:16.689996 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5a3d300b-3cec-463a-af8b-5a36463d9bd5 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:24:16.689996 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5a3d300b-3cec-463a-af8b-5a36463d9bd5 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:24:16.689996 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5a3d300b-3cec-463a-af8b-5a36463d9bd5 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:24:16.750521 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5a3d300b-3cec-463a-af8b-5a36463d9bd5 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc05ba037afe4b1e99d9da5b2bdb01b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3084e66b15b645e683a12ce6b94e6106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:24:16.758402 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5a3d300b-3cec-463a-af8b-5a36463d9bd5 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] 10.222.0.52 "GET /compute/v2.1/servers/6c72f4c6-ece9-4e44-82a6-f13e01f70153" status: 200 len: 1221 microversion: 2.1 time: 0.084921 Oct 19 04:24:16.758984 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4126/7777] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:24:16 2022] GET /compute/v2.1/servers/6c72f4c6-ece9-4e44-82a6-f13e01f70153 => generated 1221 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:24:17.783111 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-33840314-54da-4c9c-b961-7ae2a1b6ee8a tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:24:17.783740 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-33840314-54da-4c9c-b961-7ae2a1b6ee8a tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] [instance: 6c72f4c6-ece9-4e44-82a6-f13e01f70153] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:24:17.791678 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-33840314-54da-4c9c-b961-7ae2a1b6ee8a tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:24:17.792185 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-33840314-54da-4c9c-b961-7ae2a1b6ee8a tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:24:17.792634 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-33840314-54da-4c9c-b961-7ae2a1b6ee8a tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:24:17.793402 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-33840314-54da-4c9c-b961-7ae2a1b6ee8a tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:24:17.793888 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-33840314-54da-4c9c-b961-7ae2a1b6ee8a tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:24:17.794508 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-33840314-54da-4c9c-b961-7ae2a1b6ee8a tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:24:17.861249 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-33840314-54da-4c9c-b961-7ae2a1b6ee8a tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc05ba037afe4b1e99d9da5b2bdb01b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3084e66b15b645e683a12ce6b94e6106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:24:17.869074 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-33840314-54da-4c9c-b961-7ae2a1b6ee8a tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] 10.222.0.52 "GET /compute/v2.1/servers/6c72f4c6-ece9-4e44-82a6-f13e01f70153" status: 200 len: 1287 microversion: 2.1 time: 0.090154 Oct 19 04:24:17.869683 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3652/7778] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:24:17 2022] GET /compute/v2.1/servers/6c72f4c6-ece9-4e44-82a6-f13e01f70153 => generated 1287 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:24:18.892250 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-34f33628-c0d0-473c-a3fc-2b082e5633a0 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:24:18.893639 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-34f33628-c0d0-473c-a3fc-2b082e5633a0 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] [instance: 6c72f4c6-ece9-4e44-82a6-f13e01f70153] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:24:18.901326 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-34f33628-c0d0-473c-a3fc-2b082e5633a0 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:24:18.902084 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-34f33628-c0d0-473c-a3fc-2b082e5633a0 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:24:18.902536 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-34f33628-c0d0-473c-a3fc-2b082e5633a0 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:24:18.904443 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-34f33628-c0d0-473c-a3fc-2b082e5633a0 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:24:18.904914 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-34f33628-c0d0-473c-a3fc-2b082e5633a0 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:24:18.905357 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-34f33628-c0d0-473c-a3fc-2b082e5633a0 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:24:19.049583 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-34f33628-c0d0-473c-a3fc-2b082e5633a0 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc05ba037afe4b1e99d9da5b2bdb01b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3084e66b15b645e683a12ce6b94e6106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:24:19.059044 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-34f33628-c0d0-473c-a3fc-2b082e5633a0 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] 10.222.0.52 "GET /compute/v2.1/servers/6c72f4c6-ece9-4e44-82a6-f13e01f70153" status: 200 len: 1317 microversion: 2.1 time: 0.170733 Oct 19 04:24:19.059640 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4127/7779] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:24:18 2022] GET /compute/v2.1/servers/6c72f4c6-ece9-4e44-82a6-f13e01f70153 => generated 1317 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:24:19.525188 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-ef21a5b8-689e-40fe-aa8e-8bde7a60e47f req-f5856d09-39cc-4d40-8171-eeaccccd12dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c72f4c6-ece9-4e44-82a6-f13e01f70153", "tag": "a89248fc-e860-4807-97a4-bc9feda1475d"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:24:19.536432 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-ef21a5b8-689e-40fe-aa8e-8bde7a60e47f req-f5856d09-39cc-4d40-8171-eeaccccd12dc service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:24:19.536910 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-ef21a5b8-689e-40fe-aa8e-8bde7a60e47f req-f5856d09-39cc-4d40-8171-eeaccccd12dc service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:24:19.537354 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-ef21a5b8-689e-40fe-aa8e-8bde7a60e47f req-f5856d09-39cc-4d40-8171-eeaccccd12dc service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:24:19.548423 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-ef21a5b8-689e-40fe-aa8e-8bde7a60e47f req-f5856d09-39cc-4d40-8171-eeaccccd12dc service nova] Creating event network-changed:a89248fc-e860-4807-97a4-bc9feda1475d for instance 6c72f4c6-ece9-4e44-82a6-f13e01f70153 on n-h1-861333-8 Oct 19 04:24:19.553409 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-ef21a5b8-689e-40fe-aa8e-8bde7a60e47f req-f5856d09-39cc-4d40-8171-eeaccccd12dc service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038676 Oct 19 04:24:19.554017 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3653/7780] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:24:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 04:24:20.083570 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-47e15b6d-67d4-4b70-b217-4f0685079e45 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:24:20.084209 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-47e15b6d-67d4-4b70-b217-4f0685079e45 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] [instance: 6c72f4c6-ece9-4e44-82a6-f13e01f70153] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:24:20.091200 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-47e15b6d-67d4-4b70-b217-4f0685079e45 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:24:20.091706 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-47e15b6d-67d4-4b70-b217-4f0685079e45 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:24:20.092165 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-47e15b6d-67d4-4b70-b217-4f0685079e45 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:24:20.092884 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-47e15b6d-67d4-4b70-b217-4f0685079e45 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:24:20.093356 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-47e15b6d-67d4-4b70-b217-4f0685079e45 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:24:20.093827 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-47e15b6d-67d4-4b70-b217-4f0685079e45 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:24:20.224585 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-47e15b6d-67d4-4b70-b217-4f0685079e45 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc05ba037afe4b1e99d9da5b2bdb01b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3084e66b15b645e683a12ce6b94e6106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:24:20.233431 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-47e15b6d-67d4-4b70-b217-4f0685079e45 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] 10.222.0.52 "GET /compute/v2.1/servers/6c72f4c6-ece9-4e44-82a6-f13e01f70153" status: 200 len: 1317 microversion: 2.1 time: 0.153671 Oct 19 04:24:20.234035 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4128/7781] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:24:20 2022] GET /compute/v2.1/servers/6c72f4c6-ece9-4e44-82a6-f13e01f70153 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:24:21.258528 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-fd9611cd-d686-43bf-908f-610ca1631a2e tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:24:21.259225 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-fd9611cd-d686-43bf-908f-610ca1631a2e tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] [instance: 6c72f4c6-ece9-4e44-82a6-f13e01f70153] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:24:21.266085 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fd9611cd-d686-43bf-908f-610ca1631a2e tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:24:21.266566 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fd9611cd-d686-43bf-908f-610ca1631a2e tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:24:21.267001 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fd9611cd-d686-43bf-908f-610ca1631a2e tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:24:21.267686 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fd9611cd-d686-43bf-908f-610ca1631a2e tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:24:21.268138 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fd9611cd-d686-43bf-908f-610ca1631a2e tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:24:21.268565 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-fd9611cd-d686-43bf-908f-610ca1631a2e tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:24:21.397042 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-fd9611cd-d686-43bf-908f-610ca1631a2e tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc05ba037afe4b1e99d9da5b2bdb01b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3084e66b15b645e683a12ce6b94e6106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:24:21.405149 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-fd9611cd-d686-43bf-908f-610ca1631a2e tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] 10.222.0.52 "GET /compute/v2.1/servers/6c72f4c6-ece9-4e44-82a6-f13e01f70153" status: 200 len: 1317 microversion: 2.1 time: 0.151966 Oct 19 04:24:21.405749 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3654/7782] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:24:21 2022] GET /compute/v2.1/servers/6c72f4c6-ece9-4e44-82a6-f13e01f70153 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:24:22.428040 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e27ce84f-3c4a-4160-865a-26990c4ea144 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:24:22.428678 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e27ce84f-3c4a-4160-865a-26990c4ea144 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] [instance: 6c72f4c6-ece9-4e44-82a6-f13e01f70153] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:24:22.435944 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e27ce84f-3c4a-4160-865a-26990c4ea144 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:24:22.436445 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e27ce84f-3c4a-4160-865a-26990c4ea144 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:24:22.436893 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e27ce84f-3c4a-4160-865a-26990c4ea144 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:24:22.437627 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e27ce84f-3c4a-4160-865a-26990c4ea144 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:24:22.438092 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e27ce84f-3c4a-4160-865a-26990c4ea144 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:24:22.438532 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e27ce84f-3c4a-4160-865a-26990c4ea144 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:24:22.569647 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e27ce84f-3c4a-4160-865a-26990c4ea144 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc05ba037afe4b1e99d9da5b2bdb01b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3084e66b15b645e683a12ce6b94e6106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:24:22.578134 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e27ce84f-3c4a-4160-865a-26990c4ea144 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] 10.222.0.52 "GET /compute/v2.1/servers/6c72f4c6-ece9-4e44-82a6-f13e01f70153" status: 200 len: 1317 microversion: 2.1 time: 0.153977 Oct 19 04:24:22.578651 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4129/7783] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:24:22 2022] GET /compute/v2.1/servers/6c72f4c6-ece9-4e44-82a6-f13e01f70153 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:24:23.601193 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6898b783-75df-42bf-aa5f-4ed8382b54ad tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:24:23.601842 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6898b783-75df-42bf-aa5f-4ed8382b54ad tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] [instance: 6c72f4c6-ece9-4e44-82a6-f13e01f70153] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:24:23.609241 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6898b783-75df-42bf-aa5f-4ed8382b54ad tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:24:23.609876 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6898b783-75df-42bf-aa5f-4ed8382b54ad tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:24:23.610336 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6898b783-75df-42bf-aa5f-4ed8382b54ad tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:24:23.611037 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6898b783-75df-42bf-aa5f-4ed8382b54ad tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:24:23.611502 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6898b783-75df-42bf-aa5f-4ed8382b54ad tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:24:23.611933 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6898b783-75df-42bf-aa5f-4ed8382b54ad tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:24:23.740841 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-6898b783-75df-42bf-aa5f-4ed8382b54ad tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc05ba037afe4b1e99d9da5b2bdb01b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3084e66b15b645e683a12ce6b94e6106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:24:23.748568 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6898b783-75df-42bf-aa5f-4ed8382b54ad tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] 10.222.0.52 "GET /compute/v2.1/servers/6c72f4c6-ece9-4e44-82a6-f13e01f70153" status: 200 len: 1317 microversion: 2.1 time: 0.151423 Oct 19 04:24:23.749139 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3655/7784] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:24:23 2022] GET /compute/v2.1/servers/6c72f4c6-ece9-4e44-82a6-f13e01f70153 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:24:24.771064 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c5072eb8-7bc6-47d3-b26e-907eb9e703e9 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:24:24.771699 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c5072eb8-7bc6-47d3-b26e-907eb9e703e9 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] [instance: 6c72f4c6-ece9-4e44-82a6-f13e01f70153] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:24:24.779469 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c5072eb8-7bc6-47d3-b26e-907eb9e703e9 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:24:24.779979 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c5072eb8-7bc6-47d3-b26e-907eb9e703e9 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:24:24.780439 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c5072eb8-7bc6-47d3-b26e-907eb9e703e9 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:24:24.781150 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c5072eb8-7bc6-47d3-b26e-907eb9e703e9 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:24:24.781654 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c5072eb8-7bc6-47d3-b26e-907eb9e703e9 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:24:24.782106 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c5072eb8-7bc6-47d3-b26e-907eb9e703e9 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:24:24.918677 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c5072eb8-7bc6-47d3-b26e-907eb9e703e9 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc05ba037afe4b1e99d9da5b2bdb01b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3084e66b15b645e683a12ce6b94e6106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:24:24.926522 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c5072eb8-7bc6-47d3-b26e-907eb9e703e9 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] 10.222.0.52 "GET /compute/v2.1/servers/6c72f4c6-ece9-4e44-82a6-f13e01f70153" status: 200 len: 1317 microversion: 2.1 time: 0.159382 Oct 19 04:24:24.927115 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4130/7785] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:24:24 2022] GET /compute/v2.1/servers/6c72f4c6-ece9-4e44-82a6-f13e01f70153 => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:24:25.949245 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3795ce1d-2199-4ee1-b195-7ac58b4f56a5 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:24:25.950544 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-3795ce1d-2199-4ee1-b195-7ac58b4f56a5 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] [instance: 6c72f4c6-ece9-4e44-82a6-f13e01f70153] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:24:25.953434 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:24:25.958456 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3795ce1d-2199-4ee1-b195-7ac58b4f56a5 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:24:25.958955 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3795ce1d-2199-4ee1-b195-7ac58b4f56a5 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:24:25.959435 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3795ce1d-2199-4ee1-b195-7ac58b4f56a5 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:24:25.960108 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3795ce1d-2199-4ee1-b195-7ac58b4f56a5 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:24:25.960565 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3795ce1d-2199-4ee1-b195-7ac58b4f56a5 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:24:25.965161 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3795ce1d-2199-4ee1-b195-7ac58b4f56a5 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:24:26.092070 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-3795ce1d-2199-4ee1-b195-7ac58b4f56a5 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc05ba037afe4b1e99d9da5b2bdb01b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3084e66b15b645e683a12ce6b94e6106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:24:26.099845 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-3795ce1d-2199-4ee1-b195-7ac58b4f56a5 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] 10.222.0.52 "GET /compute/v2.1/servers/6c72f4c6-ece9-4e44-82a6-f13e01f70153" status: 200 len: 1317 microversion: 2.1 time: 0.154559 Oct 19 04:24:26.100409 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3656/7786] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:24:25 2022] GET /compute/v2.1/servers/6c72f4c6-ece9-4e44-82a6-f13e01f70153 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:24:26.327089 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-06991959-4097-408e-8ec3-e74bf9d2d27a req-fb2cd9c0-ea3b-4f7f-bfde-9434c7290074 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c72f4c6-ece9-4e44-82a6-f13e01f70153", "name": "network-vif-plugged", "status": "completed", "tag": "a89248fc-e860-4807-97a4-bc9feda1475d"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:24:26.334265 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:24:26.334954 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=6 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:24:26.339726 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-06991959-4097-408e-8ec3-e74bf9d2d27a req-fb2cd9c0-ea3b-4f7f-bfde-9434c7290074 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:24:26.340220 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-06991959-4097-408e-8ec3-e74bf9d2d27a req-fb2cd9c0-ea3b-4f7f-bfde-9434c7290074 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:24:26.340674 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-06991959-4097-408e-8ec3-e74bf9d2d27a req-fb2cd9c0-ea3b-4f7f-bfde-9434c7290074 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:24:26.352088 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-06991959-4097-408e-8ec3-e74bf9d2d27a req-fb2cd9c0-ea3b-4f7f-bfde-9434c7290074 service nova] Creating event network-vif-plugged:a89248fc-e860-4807-97a4-bc9feda1475d for instance 6c72f4c6-ece9-4e44-82a6-f13e01f70153 on n-h1-861333-8 Oct 19 04:24:26.358903 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-06991959-4097-408e-8ec3-e74bf9d2d27a req-fb2cd9c0-ea3b-4f7f-bfde-9434c7290074 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036801 Oct 19 04:24:26.360048 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4131/7787] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:24:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 04:24:27.123089 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-45aee064-7fe6-4c07-861b-17e3e8e2a9a8 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:24:27.123720 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-45aee064-7fe6-4c07-861b-17e3e8e2a9a8 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] [instance: 6c72f4c6-ece9-4e44-82a6-f13e01f70153] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:24:27.131034 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-45aee064-7fe6-4c07-861b-17e3e8e2a9a8 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:24:27.131552 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-45aee064-7fe6-4c07-861b-17e3e8e2a9a8 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:24:27.132003 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-45aee064-7fe6-4c07-861b-17e3e8e2a9a8 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:24:27.132707 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-45aee064-7fe6-4c07-861b-17e3e8e2a9a8 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:24:27.133170 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-45aee064-7fe6-4c07-861b-17e3e8e2a9a8 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:24:27.133642 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-45aee064-7fe6-4c07-861b-17e3e8e2a9a8 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:24:27.260041 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-45aee064-7fe6-4c07-861b-17e3e8e2a9a8 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc05ba037afe4b1e99d9da5b2bdb01b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3084e66b15b645e683a12ce6b94e6106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:24:27.268247 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-45aee064-7fe6-4c07-861b-17e3e8e2a9a8 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] 10.222.0.52 "GET /compute/v2.1/servers/6c72f4c6-ece9-4e44-82a6-f13e01f70153" status: 200 len: 1317 microversion: 2.1 time: 0.149355 Oct 19 04:24:27.268832 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3657/7788] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:24:27 2022] GET /compute/v2.1/servers/6c72f4c6-ece9-4e44-82a6-f13e01f70153 => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:24:28.294515 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-83c55292-9bb1-4933-8e46-af84a4c2f6ab tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:24:28.295241 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-83c55292-9bb1-4933-8e46-af84a4c2f6ab tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] [instance: 6c72f4c6-ece9-4e44-82a6-f13e01f70153] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:24:28.302160 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-83c55292-9bb1-4933-8e46-af84a4c2f6ab tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:24:28.302670 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-83c55292-9bb1-4933-8e46-af84a4c2f6ab tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:24:28.303163 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-83c55292-9bb1-4933-8e46-af84a4c2f6ab tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:24:28.303874 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-83c55292-9bb1-4933-8e46-af84a4c2f6ab tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:24:28.304351 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-83c55292-9bb1-4933-8e46-af84a4c2f6ab tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:24:28.304824 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-83c55292-9bb1-4933-8e46-af84a4c2f6ab tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:24:28.439746 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-83c55292-9bb1-4933-8e46-af84a4c2f6ab tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc05ba037afe4b1e99d9da5b2bdb01b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3084e66b15b645e683a12ce6b94e6106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:24:28.447650 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-83c55292-9bb1-4933-8e46-af84a4c2f6ab tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] 10.222.0.52 "GET /compute/v2.1/servers/6c72f4c6-ece9-4e44-82a6-f13e01f70153" status: 200 len: 1504 microversion: 2.1 time: 0.159344 Oct 19 04:24:28.448233 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4132/7789] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:24:28 2022] GET /compute/v2.1/servers/6c72f4c6-ece9-4e44-82a6-f13e01f70153 => generated 1504 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:24:28.474788 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-8226cf25-c735-4273-b527-4f417b891239 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:24:28.475303 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-8226cf25-c735-4273-b527-4f417b891239 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] [instance: 6c72f4c6-ece9-4e44-82a6-f13e01f70153] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:24:28.483095 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8226cf25-c735-4273-b527-4f417b891239 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:24:28.483586 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8226cf25-c735-4273-b527-4f417b891239 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:24:28.484031 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8226cf25-c735-4273-b527-4f417b891239 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:24:28.484728 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8226cf25-c735-4273-b527-4f417b891239 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:24:28.485225 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8226cf25-c735-4273-b527-4f417b891239 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:24:28.485686 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8226cf25-c735-4273-b527-4f417b891239 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:24:28.511170 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-8226cf25-c735-4273-b527-4f417b891239 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] [instance: 6c72f4c6-ece9-4e44-82a6-f13e01f70153] Going to try to terminate instance {{(pid=121135) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 04:24:28.773600 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-8226cf25-c735-4273-b527-4f417b891239 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] 10.222.0.52 "DELETE /compute/v2.1/servers/6c72f4c6-ece9-4e44-82a6-f13e01f70153" status: 204 len: 0 microversion: 2.1 time: 0.302367 Oct 19 04:24:28.774162 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3658/7790] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 04:24:28 2022] DELETE /compute/v2.1/servers/6c72f4c6-ece9-4e44-82a6-f13e01f70153 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 04:24:28.783128 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-09a41451-7485-4f19-8430-39149b1a543d tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:24:28.784743 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-09a41451-7485-4f19-8430-39149b1a543d tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] [instance: 6c72f4c6-ece9-4e44-82a6-f13e01f70153] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:24:28.789817 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-09a41451-7485-4f19-8430-39149b1a543d tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:24:28.790322 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-09a41451-7485-4f19-8430-39149b1a543d tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:24:28.790777 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-09a41451-7485-4f19-8430-39149b1a543d tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:24:28.791488 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-09a41451-7485-4f19-8430-39149b1a543d tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:24:28.791958 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-09a41451-7485-4f19-8430-39149b1a543d tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:24:28.792403 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-09a41451-7485-4f19-8430-39149b1a543d tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:24:28.919828 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-09a41451-7485-4f19-8430-39149b1a543d tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc05ba037afe4b1e99d9da5b2bdb01b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3084e66b15b645e683a12ce6b94e6106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:24:28.927773 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-09a41451-7485-4f19-8430-39149b1a543d tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] 10.222.0.52 "GET /compute/v2.1/servers/6c72f4c6-ece9-4e44-82a6-f13e01f70153" status: 200 len: 1510 microversion: 2.1 time: 0.149059 Oct 19 04:24:28.928335 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4133/7791] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:24:28 2022] GET /compute/v2.1/servers/6c72f4c6-ece9-4e44-82a6-f13e01f70153 => generated 1510 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:24:29.951337 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-511d558d-5936-4cf2-9487-3b655cd7519c tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:24:29.952040 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-511d558d-5936-4cf2-9487-3b655cd7519c tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] [instance: 6c72f4c6-ece9-4e44-82a6-f13e01f70153] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:24:29.958829 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-511d558d-5936-4cf2-9487-3b655cd7519c tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:24:29.959316 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-511d558d-5936-4cf2-9487-3b655cd7519c tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:24:29.959749 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-511d558d-5936-4cf2-9487-3b655cd7519c tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:24:29.960432 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-511d558d-5936-4cf2-9487-3b655cd7519c tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:24:29.960884 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-511d558d-5936-4cf2-9487-3b655cd7519c tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:24:29.961306 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-511d558d-5936-4cf2-9487-3b655cd7519c tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:24:30.095362 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-511d558d-5936-4cf2-9487-3b655cd7519c tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc05ba037afe4b1e99d9da5b2bdb01b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3084e66b15b645e683a12ce6b94e6106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:24:30.103126 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-511d558d-5936-4cf2-9487-3b655cd7519c tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] 10.222.0.52 "GET /compute/v2.1/servers/6c72f4c6-ece9-4e44-82a6-f13e01f70153" status: 200 len: 1510 microversion: 2.1 time: 0.156316 Oct 19 04:24:30.103704 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3659/7792] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:24:29 2022] GET /compute/v2.1/servers/6c72f4c6-ece9-4e44-82a6-f13e01f70153 => generated 1510 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:24:30.904198 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-26b24557-1ede-4acc-897d-6e3fa948d622 req-3c0a8d7b-e943-4ffe-8825-9d8709c952d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c72f4c6-ece9-4e44-82a6-f13e01f70153", "name": "network-vif-deleted", "tag": "a89248fc-e860-4807-97a4-bc9feda1475d"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:24:30.918600 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-26b24557-1ede-4acc-897d-6e3fa948d622 req-3c0a8d7b-e943-4ffe-8825-9d8709c952d7 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:24:30.919708 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-26b24557-1ede-4acc-897d-6e3fa948d622 req-3c0a8d7b-e943-4ffe-8825-9d8709c952d7 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:24:30.920237 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-26b24557-1ede-4acc-897d-6e3fa948d622 req-3c0a8d7b-e943-4ffe-8825-9d8709c952d7 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:24:30.933057 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-26b24557-1ede-4acc-897d-6e3fa948d622 req-3c0a8d7b-e943-4ffe-8825-9d8709c952d7 service nova] Creating event network-vif-deleted:a89248fc-e860-4807-97a4-bc9feda1475d for instance 6c72f4c6-ece9-4e44-82a6-f13e01f70153 on n-h1-861333-8 Oct 19 04:24:30.939617 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-26b24557-1ede-4acc-897d-6e3fa948d622 req-3c0a8d7b-e943-4ffe-8825-9d8709c952d7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039830 Oct 19 04:24:30.940608 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4134/7793] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:24:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:24:31.126322 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-060b6a2b-2fad-4366-8574-a71ca1c5264f tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:24:31.126847 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-060b6a2b-2fad-4366-8574-a71ca1c5264f tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] [instance: 6c72f4c6-ece9-4e44-82a6-f13e01f70153] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:24:31.133633 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-060b6a2b-2fad-4366-8574-a71ca1c5264f tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:24:31.134120 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-060b6a2b-2fad-4366-8574-a71ca1c5264f tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:24:31.134557 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-060b6a2b-2fad-4366-8574-a71ca1c5264f tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:24:31.135250 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-060b6a2b-2fad-4366-8574-a71ca1c5264f tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:24:31.135705 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-060b6a2b-2fad-4366-8574-a71ca1c5264f tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:24:31.136133 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-060b6a2b-2fad-4366-8574-a71ca1c5264f tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:24:31.198301 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-060b6a2b-2fad-4366-8574-a71ca1c5264f tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc05ba037afe4b1e99d9da5b2bdb01b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3084e66b15b645e683a12ce6b94e6106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:24:31.206652 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-060b6a2b-2fad-4366-8574-a71ca1c5264f tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] 10.222.0.52 "GET /compute/v2.1/servers/6c72f4c6-ece9-4e44-82a6-f13e01f70153" status: 200 len: 1302 microversion: 2.1 time: 0.084407 Oct 19 04:24:31.210540 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3660/7794] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:24:31 2022] GET /compute/v2.1/servers/6c72f4c6-ece9-4e44-82a6-f13e01f70153 => generated 1302 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:24:32.231288 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c52f1f2a-d5d1-4f72-9d0b-95e1ea42e9b5 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:24:32.232511 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c52f1f2a-d5d1-4f72-9d0b-95e1ea42e9b5 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] [instance: 6c72f4c6-ece9-4e44-82a6-f13e01f70153] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:24:32.238853 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c52f1f2a-d5d1-4f72-9d0b-95e1ea42e9b5 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:24:32.239365 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c52f1f2a-d5d1-4f72-9d0b-95e1ea42e9b5 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:24:32.239872 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c52f1f2a-d5d1-4f72-9d0b-95e1ea42e9b5 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:24:32.240584 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c52f1f2a-d5d1-4f72-9d0b-95e1ea42e9b5 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:24:32.241057 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c52f1f2a-d5d1-4f72-9d0b-95e1ea42e9b5 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:24:32.241538 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c52f1f2a-d5d1-4f72-9d0b-95e1ea42e9b5 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:24:32.255765 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-c52f1f2a-d5d1-4f72-9d0b-95e1ea42e9b5 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] HTTP exception thrown: Instance 6c72f4c6-ece9-4e44-82a6-f13e01f70153 could not be found. Oct 19 04:24:32.257418 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c52f1f2a-d5d1-4f72-9d0b-95e1ea42e9b5 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Request method failure captured: Oct 19 04:24:32.257418 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/6c72f4c6-ece9-4e44-82a6-f13e01f70153 HTTP/1.1 Oct 19 04:24:32.257418 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 04:24:32.257418 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 04:24:32.257418 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 04:24:32.257418 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 04:24:32.257418 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 04:24:32.257418 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 04:24:32.257418 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 04:24:32.257418 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 04:24:32.257418 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3vjQUONHu8cNau3l_0J1sdg9x8FfsPs0ITkTH7uOk0zWa-I99fPNtPv1UiddjgUXjzEkk0VOGHhJuQF5f639oTA3U9LJXMAZLgxpmijeHO841J_tni2vQMruvJBx9elrTYiAdUmRRZZZpE66WceqMDlw6piWujxwRUkZ15CMh8yZDY Oct 19 04:24:32.257418 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 04:24:32.257418 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 04:24:32.257418 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 04:24:32.257418 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 04:24:32.257418 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 04:24:32.257418 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 04:24:32.257418 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 3084e66b15b645e683a12ce6b94e6106 Oct 19 04:24:32.257418 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ServersNegativeTestJSON-1302512485 Oct 19 04:24:32.257418 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 04:24:32.257418 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 04:24:32.257418 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/3084e66b15b645e683a12ce6b94e6106"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3084e66b15b645e683a12ce6b94e6106"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3084e66b15b645e683a12ce6b94e6106"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_3084e66b15b645e683a12ce6b94e6106", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 04:24:32.257418 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ServersNegativeTestJSON-1302512485 Oct 19 04:24:32.257418 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 3084e66b15b645e683a12ce6b94e6106 Oct 19 04:24:32.257418 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1302512485 Oct 19 04:24:32.257418 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ServersNegativeTestJSON-1302512485-project Oct 19 04:24:32.257418 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 04:24:32.257418 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 04:24:32.257418 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: bc05ba037afe4b1e99d9da5b2bdb01b7 Oct 19 04:24:32.257418 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ServersNegativeTestJSON-1302512485-project Oct 19 04:24:32.257418 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 04:24:32.257418 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance 6c72f4c6-ece9-4e44-82a6-f13e01f70153 could not be found. Oct 19 04:24:32.257418 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '6c72f4c6-ece9-4e44-82a6-f13e01f70153'} Oct 19 04:24:32.257418 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 04:24:32.257418 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:24:32.257418 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 04:24:32.257418 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 04:24:32.257418 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 04:24:32.257418 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 04:24:32.257418 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 04:24:32.257418 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 04:24:32.257418 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 04:24:32.257418 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 04:24:32.257418 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c72f4c6-ece9-4e44-82a6-f13e01f70153 could not be found. Oct 19 04:24:32.257418 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:24:32.257418 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:24:32.257418 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:24:32.257418 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:24:32.257418 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:24:32.257418 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:24:32.257418 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 04:24:32.257418 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 04:24:32.257418 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 04:24:32.257418 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 04:24:32.257418 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 04:24:32.257418 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 04:24:32.257418 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 04:24:32.257418 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 04:24:32.257418 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 04:24:32.257418 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 04:24:32.257418 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c72f4c6-ece9-4e44-82a6-f13e01f70153 could not be found. Oct 19 04:24:32.257418 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:24:32.257418 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:24:32.257418 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:24:32.262729 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:24:32.262729 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:24:32.262729 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:24:32.262729 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 04:24:32.262729 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 04:24:32.262729 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c72f4c6-ece9-4e44-82a6-f13e01f70153 could not be found. Oct 19 04:24:32.262729 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:24:32.262729 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c52f1f2a-d5d1-4f72-9d0b-95e1ea42e9b5 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Returning 404 to user: Instance 6c72f4c6-ece9-4e44-82a6-f13e01f70153 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 04:24:32.262729 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c52f1f2a-d5d1-4f72-9d0b-95e1ea42e9b5 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] 10.222.0.52 "GET /compute/v2.1/servers/6c72f4c6-ece9-4e44-82a6-f13e01f70153" status: 404 len: 111 microversion: 2.1 time: 0.032771 Oct 19 04:24:32.262729 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4135/7795] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:24:32 2022] GET /compute/v2.1/servers/6c72f4c6-ece9-4e44-82a6-f13e01f70153 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 04:24:32.268038 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-51bc5d45-74ec-4734-bbb7-470210a40635 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:24:32.268677 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-51bc5d45-74ec-4734-bbb7-470210a40635 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] [instance: 15c4de5f-2c34-4ed4-ab34-733ef307c3c6] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:24:32.275824 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-51bc5d45-74ec-4734-bbb7-470210a40635 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:24:32.276313 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-51bc5d45-74ec-4734-bbb7-470210a40635 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:24:32.276758 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-51bc5d45-74ec-4734-bbb7-470210a40635 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:24:32.277482 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-51bc5d45-74ec-4734-bbb7-470210a40635 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:24:32.277947 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-51bc5d45-74ec-4734-bbb7-470210a40635 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:24:32.278379 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-51bc5d45-74ec-4734-bbb7-470210a40635 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:24:32.405254 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-51bc5d45-74ec-4734-bbb7-470210a40635 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc05ba037afe4b1e99d9da5b2bdb01b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3084e66b15b645e683a12ce6b94e6106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:24:32.408920 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:24:32.413646 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-51bc5d45-74ec-4734-bbb7-470210a40635 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] 10.222.0.52 "GET /compute/v2.1/servers/15c4de5f-2c34-4ed4-ab34-733ef307c3c6" status: 200 len: 1504 microversion: 2.1 time: 0.149544 Oct 19 04:24:32.414219 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3661/7796] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:24:32 2022] GET /compute/v2.1/servers/15c4de5f-2c34-4ed4-ab34-733ef307c3c6 => generated 1504 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:24:32.437239 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9c23b2b9-033a-4dc3-96ea-59d5fe32cd74 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:24:32.439716 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9c23b2b9-033a-4dc3-96ea-59d5fe32cd74 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] [instance: 79e4eb55-217f-4502-8467-f6290d47c4ec] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:24:32.445710 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-9c23b2b9-033a-4dc3-96ea-59d5fe32cd74 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] HTTP exception thrown: Instance 79e4eb55-217f-4502-8467-f6290d47c4ec could not be found. Oct 19 04:24:32.447276 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9c23b2b9-033a-4dc3-96ea-59d5fe32cd74 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Request method failure captured: Oct 19 04:24:32.447276 n-d-861333-8 devstack@n-api.service[121134]: request: POST /compute/v2.1/servers/79e4eb55-217f-4502-8467-f6290d47c4ec/action HTTP/1.1 Oct 19 04:24:32.447276 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 04:24:32.447276 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 04:24:32.447276 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 04:24:32.447276 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 32 Oct 19 04:24:32.447276 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 04:24:32.447276 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 04:24:32.447276 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 04:24:32.447276 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 04:24:32.447276 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3vjQUONHu8cNau3l_0J1sdg9x8FfsPs0ITkTH7uOk0zWa-I99fPNtPv1UiddjgUXjzEkk0VOGHhJuQF5f639oTA3U9LJXMAZLgxpmijeHO841J_tni2vQMruvJBx9elrTYiAdUmRRZZZpE66WceqMDlw6piWujxwRUkZ15CMh8yZDY Oct 19 04:24:32.447276 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 04:24:32.447276 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 04:24:32.447276 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 04:24:32.447276 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 04:24:32.447276 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 04:24:32.447276 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 04:24:32.447276 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 3084e66b15b645e683a12ce6b94e6106 Oct 19 04:24:32.447276 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ServersNegativeTestJSON-1302512485 Oct 19 04:24:32.447276 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 04:24:32.447276 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 04:24:32.447276 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/3084e66b15b645e683a12ce6b94e6106"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3084e66b15b645e683a12ce6b94e6106"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3084e66b15b645e683a12ce6b94e6106"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_3084e66b15b645e683a12ce6b94e6106", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 04:24:32.447276 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ServersNegativeTestJSON-1302512485 Oct 19 04:24:32.447276 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 3084e66b15b645e683a12ce6b94e6106 Oct 19 04:24:32.447276 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1302512485 Oct 19 04:24:32.447276 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ServersNegativeTestJSON-1302512485-project Oct 19 04:24:32.447276 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 04:24:32.447276 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 04:24:32.447276 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: bc05ba037afe4b1e99d9da5b2bdb01b7 Oct 19 04:24:32.447276 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ServersNegativeTestJSON-1302512485-project Oct 19 04:24:32.447276 n-d-861333-8 devstack@n-api.service[121134]: Oct 19 04:24:32.447276 n-d-861333-8 devstack@n-api.service[121134]: {"resize": {"flavorRef": "452"}} Oct 19 04:24:32.447276 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 04:24:32.447276 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance 79e4eb55-217f-4502-8467-f6290d47c4ec could not be found. Oct 19 04:24:32.447276 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '79e4eb55-217f-4502-8467-f6290d47c4ec', 'body': {'resize': {'flavorRef': '452'}}} Oct 19 04:24:32.447276 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 04:24:32.447276 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:24:32.447276 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 04:24:32.447276 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 04:24:32.447276 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 04:24:32.447276 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 04:24:32.447276 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 19 04:24:32.447276 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 19 04:24:32.447276 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79e4eb55-217f-4502-8467-f6290d47c4ec could not be found. Oct 19 04:24:32.447276 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:24:32.447276 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:24:32.447276 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:24:32.447276 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:24:32.447276 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:24:32.447276 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:24:32.447276 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 04:24:32.447276 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 04:24:32.447276 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 04:24:32.447276 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 04:24:32.447276 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 04:24:32.447276 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 04:24:32.447276 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 19 04:24:32.447276 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 19 04:24:32.447276 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Oct 19 04:24:32.447276 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Oct 19 04:24:32.447276 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 04:24:32.447276 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 04:24:32.447276 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 04:24:32.447276 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 04:24:32.452359 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79e4eb55-217f-4502-8467-f6290d47c4ec could not be found. Oct 19 04:24:32.452359 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:24:32.452359 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:24:32.452359 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:24:32.452359 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:24:32.452359 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:24:32.452359 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:24:32.452359 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 04:24:32.452359 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 04:24:32.452359 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79e4eb55-217f-4502-8467-f6290d47c4ec could not be found. Oct 19 04:24:32.452359 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:24:32.452359 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9c23b2b9-033a-4dc3-96ea-59d5fe32cd74 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Returning 404 to user: Instance 79e4eb55-217f-4502-8467-f6290d47c4ec could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 04:24:32.452359 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9c23b2b9-033a-4dc3-96ea-59d5fe32cd74 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] 10.222.0.52 "POST /compute/v2.1/servers/79e4eb55-217f-4502-8467-f6290d47c4ec/action" status: 404 len: 111 microversion: 2.1 time: 0.016289 Oct 19 04:24:32.452359 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4136/7797] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 04:24:32 2022] POST /compute/v2.1/servers/79e4eb55-217f-4502-8467-f6290d47c4ec/action => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 04:24:32.457100 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1418e38e-6eff-4eea-a72e-7e9853c839ee tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:24:32.457796 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1418e38e-6eff-4eea-a72e-7e9853c839ee tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] [instance: 15c4de5f-2c34-4ed4-ab34-733ef307c3c6] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:24:32.464549 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1418e38e-6eff-4eea-a72e-7e9853c839ee tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:24:32.465039 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1418e38e-6eff-4eea-a72e-7e9853c839ee tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:24:32.465511 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1418e38e-6eff-4eea-a72e-7e9853c839ee tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:24:32.466211 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1418e38e-6eff-4eea-a72e-7e9853c839ee tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:24:32.466672 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1418e38e-6eff-4eea-a72e-7e9853c839ee tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:24:32.467104 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1418e38e-6eff-4eea-a72e-7e9853c839ee tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:24:32.597331 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-1418e38e-6eff-4eea-a72e-7e9853c839ee tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc05ba037afe4b1e99d9da5b2bdb01b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3084e66b15b645e683a12ce6b94e6106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:24:32.605158 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1418e38e-6eff-4eea-a72e-7e9853c839ee tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] 10.222.0.52 "GET /compute/v2.1/servers/15c4de5f-2c34-4ed4-ab34-733ef307c3c6" status: 200 len: 1504 microversion: 2.1 time: 0.151870 Oct 19 04:24:32.605764 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3662/7798] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:24:32 2022] GET /compute/v2.1/servers/15c4de5f-2c34-4ed4-ab34-733ef307c3c6 => generated 1504 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:24:32.628716 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ffc98ab5-3968-4369-bb1d-d361df466ac2 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:24:32.629347 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ffc98ab5-3968-4369-bb1d-d361df466ac2 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] [instance: 15c4de5f-2c34-4ed4-ab34-733ef307c3c6] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:24:32.636278 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ffc98ab5-3968-4369-bb1d-d361df466ac2 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:24:32.636780 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ffc98ab5-3968-4369-bb1d-d361df466ac2 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:24:32.637239 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ffc98ab5-3968-4369-bb1d-d361df466ac2 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:24:32.638029 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ffc98ab5-3968-4369-bb1d-d361df466ac2 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:24:32.638504 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ffc98ab5-3968-4369-bb1d-d361df466ac2 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:24:32.638950 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ffc98ab5-3968-4369-bb1d-d361df466ac2 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:24:32.767790 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ffc98ab5-3968-4369-bb1d-d361df466ac2 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc05ba037afe4b1e99d9da5b2bdb01b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3084e66b15b645e683a12ce6b94e6106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:24:32.775777 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ffc98ab5-3968-4369-bb1d-d361df466ac2 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] 10.222.0.52 "GET /compute/v2.1/servers/15c4de5f-2c34-4ed4-ab34-733ef307c3c6" status: 200 len: 1504 microversion: 2.1 time: 0.150873 Oct 19 04:24:32.776343 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4137/7799] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:24:32 2022] GET /compute/v2.1/servers/15c4de5f-2c34-4ed4-ab34-733ef307c3c6 => generated 1504 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:24:32.798956 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-359f9b02-36be-4fce-943b-251c2081180f tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "bb0f92ff-621a-4d93-bdea-fe1aeb3ea56f"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:24:32.801215 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-359f9b02-36be-4fce-943b-251c2081180f tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] [instance: 15c4de5f-2c34-4ed4-ab34-733ef307c3c6] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:24:32.807204 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-359f9b02-36be-4fce-943b-251c2081180f tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:24:32.807686 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-359f9b02-36be-4fce-943b-251c2081180f tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:24:32.808121 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-359f9b02-36be-4fce-943b-251c2081180f tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:24:32.808804 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-359f9b02-36be-4fce-943b-251c2081180f tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:24:32.809256 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-359f9b02-36be-4fce-943b-251c2081180f tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:24:32.809709 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-359f9b02-36be-4fce-943b-251c2081180f tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:24:32.848623 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-359f9b02-36be-4fce-943b-251c2081180f tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'bc05ba037afe4b1e99d9da5b2bdb01b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3084e66b15b645e683a12ce6b94e6106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:24:32.853706 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-359f9b02-36be-4fce-943b-251c2081180f tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] HTTP exception thrown: Flavor bb0f92ff-621a-4d93-bdea-fe1aeb3ea56f could not be found. Oct 19 04:24:32.855578 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-359f9b02-36be-4fce-943b-251c2081180f tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Request method failure captured: Oct 19 04:24:32.855578 n-d-861333-8 devstack@n-api.service[121135]: request: POST /compute/v2.1/servers/15c4de5f-2c34-4ed4-ab34-733ef307c3c6/action HTTP/1.1 Oct 19 04:24:32.855578 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 04:24:32.855578 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 04:24:32.855578 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 04:24:32.855578 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 65 Oct 19 04:24:32.855578 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 04:24:32.855578 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 04:24:32.855578 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 04:24:32.855578 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 04:24:32.855578 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT3vjQUONHu8cNau3l_0J1sdg9x8FfsPs0ITkTH7uOk0zWa-I99fPNtPv1UiddjgUXjzEkk0VOGHhJuQF5f639oTA3U9LJXMAZLgxpmijeHO841J_tni2vQMruvJBx9elrTYiAdUmRRZZZpE66WceqMDlw6piWujxwRUkZ15CMh8yZDY Oct 19 04:24:32.855578 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 04:24:32.855578 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 04:24:32.855578 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 04:24:32.855578 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 04:24:32.855578 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 04:24:32.855578 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 04:24:32.855578 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 3084e66b15b645e683a12ce6b94e6106 Oct 19 04:24:32.855578 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ServersNegativeTestJSON-1302512485 Oct 19 04:24:32.855578 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 04:24:32.855578 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 04:24:32.855578 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/3084e66b15b645e683a12ce6b94e6106"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3084e66b15b645e683a12ce6b94e6106"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3084e66b15b645e683a12ce6b94e6106"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_3084e66b15b645e683a12ce6b94e6106", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 04:24:32.855578 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ServersNegativeTestJSON-1302512485 Oct 19 04:24:32.855578 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 3084e66b15b645e683a12ce6b94e6106 Oct 19 04:24:32.855578 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1302512485 Oct 19 04:24:32.855578 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ServersNegativeTestJSON-1302512485-project Oct 19 04:24:32.855578 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 04:24:32.855578 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 04:24:32.855578 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: bc05ba037afe4b1e99d9da5b2bdb01b7 Oct 19 04:24:32.855578 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ServersNegativeTestJSON-1302512485-project Oct 19 04:24:32.855578 n-d-861333-8 devstack@n-api.service[121135]: Oct 19 04:24:32.855578 n-d-861333-8 devstack@n-api.service[121135]: {"resize": {"flavorRef": "bb0f92ff-621a-4d93-bdea-fe1aeb3ea56f"}} Oct 19 04:24:32.855578 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 04:24:32.855578 n-d-861333-8 devstack@n-api.service[121135]: exception: Flavor bb0f92ff-621a-4d93-bdea-fe1aeb3ea56f could not be found. Oct 19 04:24:32.855578 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '15c4de5f-2c34-4ed4-ab34-733ef307c3c6', 'body': {'resize': {'flavorRef': 'bb0f92ff-621a-4d93-bdea-fe1aeb3ea56f'}}} Oct 19 04:24:32.855578 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 04:24:32.855578 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:24:32.855578 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 19 04:24:32.855578 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 19 04:24:32.855578 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 19 04:24:32.855578 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 19 04:24:32.855578 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 19 04:24:32.855578 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 19 04:24:32.855578 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 19 04:24:32.855578 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 19 04:24:32.855578 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 19 04:24:32.855578 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 19 04:24:32.855578 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 19 04:24:32.855578 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 19 04:24:32.855578 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 19 04:24:32.855578 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 19 04:24:32.855578 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4200, in resize Oct 19 04:24:32.855578 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Oct 19 04:24:32.855578 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 19 04:24:32.855578 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 19 04:24:32.855578 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 04:24:32.855578 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 04:24:32.855578 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 19 04:24:32.855578 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 19 04:24:32.855578 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 19 04:24:32.855578 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 04:24:32.855578 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 19 04:24:32.860760 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 19 04:24:32.860760 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor bb0f92ff-621a-4d93-bdea-fe1aeb3ea56f could not be found. Oct 19 04:24:32.860760 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:24:32.860760 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:24:32.860760 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:24:32.860760 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:24:32.860760 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:24:32.860760 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:24:32.860760 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 04:24:32.860760 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 04:24:32.860760 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 04:24:32.860760 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 04:24:32.860760 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 04:24:32.860760 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 04:24:32.860760 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 19 04:24:32.860760 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 19 04:24:32.860760 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Oct 19 04:24:32.860760 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 19 04:24:32.860760 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor bb0f92ff-621a-4d93-bdea-fe1aeb3ea56f could not be found. Oct 19 04:24:32.860760 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:24:32.860760 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:24:32.860760 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:24:32.860760 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:24:32.860760 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:24:32.860760 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:24:32.860760 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 04:24:32.860760 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 04:24:32.860760 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor bb0f92ff-621a-4d93-bdea-fe1aeb3ea56f could not be found. Oct 19 04:24:32.860760 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:24:32.860760 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-359f9b02-36be-4fce-943b-251c2081180f tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Returning 400 to user: Flavor bb0f92ff-621a-4d93-bdea-fe1aeb3ea56f could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 04:24:32.860760 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-359f9b02-36be-4fce-943b-251c2081180f tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] 10.222.0.52 "POST /compute/v2.1/servers/15c4de5f-2c34-4ed4-ab34-733ef307c3c6/action" status: 400 len: 107 microversion: 2.1 time: 0.062698 Oct 19 04:24:32.860760 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3663/7800] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 04:24:32 2022] POST /compute/v2.1/servers/15c4de5f-2c34-4ed4-ab34-733ef307c3c6/action => generated 107 bytes in 64 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 04:24:32.868299 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8082abd5-6ff1-41b2-a96e-53c2e7c0d202 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:24:32.868926 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8082abd5-6ff1-41b2-a96e-53c2e7c0d202 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] [instance: 15c4de5f-2c34-4ed4-ab34-733ef307c3c6] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:24:32.874840 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8082abd5-6ff1-41b2-a96e-53c2e7c0d202 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:24:32.875333 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8082abd5-6ff1-41b2-a96e-53c2e7c0d202 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:24:32.875783 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8082abd5-6ff1-41b2-a96e-53c2e7c0d202 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:24:32.876479 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8082abd5-6ff1-41b2-a96e-53c2e7c0d202 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:24:32.876945 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8082abd5-6ff1-41b2-a96e-53c2e7c0d202 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:24:32.877400 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8082abd5-6ff1-41b2-a96e-53c2e7c0d202 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:24:33.007887 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8082abd5-6ff1-41b2-a96e-53c2e7c0d202 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc05ba037afe4b1e99d9da5b2bdb01b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3084e66b15b645e683a12ce6b94e6106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:24:33.016107 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8082abd5-6ff1-41b2-a96e-53c2e7c0d202 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] 10.222.0.52 "GET /compute/v2.1/servers/15c4de5f-2c34-4ed4-ab34-733ef307c3c6" status: 200 len: 1504 microversion: 2.1 time: 0.151654 Oct 19 04:24:33.016674 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4138/7801] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:24:32 2022] GET /compute/v2.1/servers/15c4de5f-2c34-4ed4-ab34-733ef307c3c6 => generated 1504 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:24:33.039589 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ae6be6df-fe09-47f1-a216-f4be69a711ed tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:24:33.040210 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ae6be6df-fe09-47f1-a216-f4be69a711ed tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] [instance: 15c4de5f-2c34-4ed4-ab34-733ef307c3c6] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:24:33.046155 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ae6be6df-fe09-47f1-a216-f4be69a711ed tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:24:33.046642 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ae6be6df-fe09-47f1-a216-f4be69a711ed tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:24:33.047082 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ae6be6df-fe09-47f1-a216-f4be69a711ed tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:24:33.047770 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ae6be6df-fe09-47f1-a216-f4be69a711ed tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:24:33.048225 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ae6be6df-fe09-47f1-a216-f4be69a711ed tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:24:33.048652 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ae6be6df-fe09-47f1-a216-f4be69a711ed tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:24:33.176738 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ae6be6df-fe09-47f1-a216-f4be69a711ed tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc05ba037afe4b1e99d9da5b2bdb01b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3084e66b15b645e683a12ce6b94e6106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:24:33.184461 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ae6be6df-fe09-47f1-a216-f4be69a711ed tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] 10.222.0.52 "GET /compute/v2.1/servers/15c4de5f-2c34-4ed4-ab34-733ef307c3c6" status: 200 len: 1504 microversion: 2.1 time: 0.148713 Oct 19 04:24:33.185040 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3664/7802] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:24:33 2022] GET /compute/v2.1/servers/15c4de5f-2c34-4ed4-ab34-733ef307c3c6 => generated 1504 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:24:33.206758 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4c0c2f81-d8cc-46a4-9dd1-d6625eecf91e tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:24:33.210310 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4c0c2f81-d8cc-46a4-9dd1-d6625eecf91e tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Request method failure captured: Oct 19 04:24:33.210310 n-d-861333-8 devstack@n-api.service[121134]: request: POST /compute/v2.1/servers/15c4de5f-2c34-4ed4-ab34-733ef307c3c6/action HTTP/1.1 Oct 19 04:24:33.210310 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 04:24:33.210310 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 04:24:33.210310 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 04:24:33.210310 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 29 Oct 19 04:24:33.210310 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 04:24:33.210310 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 04:24:33.210310 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 04:24:33.210310 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 04:24:33.210310 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3vjQUONHu8cNau3l_0J1sdg9x8FfsPs0ITkTH7uOk0zWa-I99fPNtPv1UiddjgUXjzEkk0VOGHhJuQF5f639oTA3U9LJXMAZLgxpmijeHO841J_tni2vQMruvJBx9elrTYiAdUmRRZZZpE66WceqMDlw6piWujxwRUkZ15CMh8yZDY Oct 19 04:24:33.210310 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 04:24:33.210310 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 04:24:33.210310 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 04:24:33.210310 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 04:24:33.210310 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 04:24:33.210310 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 04:24:33.210310 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 3084e66b15b645e683a12ce6b94e6106 Oct 19 04:24:33.210310 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ServersNegativeTestJSON-1302512485 Oct 19 04:24:33.210310 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 04:24:33.210310 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 04:24:33.210310 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/3084e66b15b645e683a12ce6b94e6106"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3084e66b15b645e683a12ce6b94e6106"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3084e66b15b645e683a12ce6b94e6106"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_3084e66b15b645e683a12ce6b94e6106", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 04:24:33.210310 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ServersNegativeTestJSON-1302512485 Oct 19 04:24:33.210310 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 3084e66b15b645e683a12ce6b94e6106 Oct 19 04:24:33.210310 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1302512485 Oct 19 04:24:33.210310 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ServersNegativeTestJSON-1302512485-project Oct 19 04:24:33.210310 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 04:24:33.210310 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 04:24:33.210310 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: bc05ba037afe4b1e99d9da5b2bdb01b7 Oct 19 04:24:33.210310 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ServersNegativeTestJSON-1302512485-project Oct 19 04:24:33.210310 n-d-861333-8 devstack@n-api.service[121134]: Oct 19 04:24:33.210310 n-d-861333-8 devstack@n-api.service[121134]: {"resize": {"flavorRef": ""}} Oct 19 04:24:33.210310 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 04:24:33.210310 n-d-861333-8 devstack@n-api.service[121134]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 19 04:24:33.210310 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '15c4de5f-2c34-4ed4-ab34-733ef307c3c6', 'body': {'resize': {'flavorRef': ''}}} Oct 19 04:24:33.210310 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 04:24:33.210310 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:24:33.210310 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 04:24:33.210310 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 04:24:33.210310 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 04:24:33.210310 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise error Oct 19 04:24:33.210310 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 19 04:24:33.210310 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:24:33.210310 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Oct 19 04:24:33.210310 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Oct 19 04:24:33.210310 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:24:33.210310 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi On instance['resize']: Oct 19 04:24:33.210310 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi '' Oct 19 04:24:33.210310 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:24:33.210310 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:24:33.210310 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:24:33.210310 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:24:33.210310 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:24:33.210310 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:24:33.210310 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 04:24:33.210310 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 04:24:33.210310 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 04:24:33.210310 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 04:24:33.210310 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 04:24:33.210310 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 04:24:33.210310 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 04:24:33.210310 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 04:24:33.210310 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 04:24:33.210310 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 04:24:33.210310 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 19 04:24:33.210310 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:24:33.210310 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:24:33.214915 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:24:33.214915 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:24:33.214915 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:24:33.214915 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:24:33.214915 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 04:24:33.214915 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 04:24:33.214915 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 19 04:24:33.214915 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:24:33.214915 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4c0c2f81-d8cc-46a4-9dd1-d6625eecf91e tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 04:24:33.214915 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4c0c2f81-d8cc-46a4-9dd1-d6625eecf91e tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] 10.222.0.52 "POST /compute/v2.1/servers/15c4de5f-2c34-4ed4-ab34-733ef307c3c6/action" status: 400 len: 113 microversion: 2.1 time: 0.008857 Oct 19 04:24:33.214915 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4139/7803] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 04:24:33 2022] POST /compute/v2.1/servers/15c4de5f-2c34-4ed4-ab34-733ef307c3c6/action => generated 113 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 04:24:33.220114 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f04a73a1-45a0-4cbd-8aec-025fb5d81ae9 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:24:33.220723 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f04a73a1-45a0-4cbd-8aec-025fb5d81ae9 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] [instance: 15c4de5f-2c34-4ed4-ab34-733ef307c3c6] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:24:33.226558 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f04a73a1-45a0-4cbd-8aec-025fb5d81ae9 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:24:33.227046 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f04a73a1-45a0-4cbd-8aec-025fb5d81ae9 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:24:33.227484 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f04a73a1-45a0-4cbd-8aec-025fb5d81ae9 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:24:33.228172 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f04a73a1-45a0-4cbd-8aec-025fb5d81ae9 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:24:33.228629 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f04a73a1-45a0-4cbd-8aec-025fb5d81ae9 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:24:33.229055 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f04a73a1-45a0-4cbd-8aec-025fb5d81ae9 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:24:33.358591 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f04a73a1-45a0-4cbd-8aec-025fb5d81ae9 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc05ba037afe4b1e99d9da5b2bdb01b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3084e66b15b645e683a12ce6b94e6106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:24:33.366616 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f04a73a1-45a0-4cbd-8aec-025fb5d81ae9 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] 10.222.0.52 "GET /compute/v2.1/servers/15c4de5f-2c34-4ed4-ab34-733ef307c3c6" status: 200 len: 1504 microversion: 2.1 time: 0.150676 Oct 19 04:24:33.367188 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3665/7804] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:24:33 2022] GET /compute/v2.1/servers/15c4de5f-2c34-4ed4-ab34-733ef307c3c6 => generated 1504 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:24:33.393787 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-dc8438f5-56f7-42b2-9a58-06a4bf888123 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:24:33.394308 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-dc8438f5-56f7-42b2-9a58-06a4bf888123 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] [instance: 6c72f4c6-ece9-4e44-82a6-f13e01f70153] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:24:33.401595 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dc8438f5-56f7-42b2-9a58-06a4bf888123 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:24:33.402093 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dc8438f5-56f7-42b2-9a58-06a4bf888123 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:24:33.402567 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dc8438f5-56f7-42b2-9a58-06a4bf888123 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:24:33.403253 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dc8438f5-56f7-42b2-9a58-06a4bf888123 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:24:33.403723 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dc8438f5-56f7-42b2-9a58-06a4bf888123 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:24:33.404167 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dc8438f5-56f7-42b2-9a58-06a4bf888123 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:24:33.418964 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-dc8438f5-56f7-42b2-9a58-06a4bf888123 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] HTTP exception thrown: Instance 6c72f4c6-ece9-4e44-82a6-f13e01f70153 could not be found. Oct 19 04:24:33.420518 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-dc8438f5-56f7-42b2-9a58-06a4bf888123 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Request method failure captured: Oct 19 04:24:33.420518 n-d-861333-8 devstack@n-api.service[121134]: request: DELETE /compute/v2.1/servers/6c72f4c6-ece9-4e44-82a6-f13e01f70153 HTTP/1.1 Oct 19 04:24:33.420518 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 04:24:33.420518 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 04:24:33.420518 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 04:24:33.420518 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 04:24:33.420518 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 04:24:33.420518 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 04:24:33.420518 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 04:24:33.420518 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 04:24:33.420518 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3vjQUONHu8cNau3l_0J1sdg9x8FfsPs0ITkTH7uOk0zWa-I99fPNtPv1UiddjgUXjzEkk0VOGHhJuQF5f639oTA3U9LJXMAZLgxpmijeHO841J_tni2vQMruvJBx9elrTYiAdUmRRZZZpE66WceqMDlw6piWujxwRUkZ15CMh8yZDY Oct 19 04:24:33.420518 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 04:24:33.420518 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 04:24:33.420518 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 04:24:33.420518 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 04:24:33.420518 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 04:24:33.420518 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 04:24:33.420518 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 3084e66b15b645e683a12ce6b94e6106 Oct 19 04:24:33.420518 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-ServersNegativeTestJSON-1302512485 Oct 19 04:24:33.420518 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 04:24:33.420518 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 04:24:33.420518 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/3084e66b15b645e683a12ce6b94e6106"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3084e66b15b645e683a12ce6b94e6106"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3084e66b15b645e683a12ce6b94e6106"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_3084e66b15b645e683a12ce6b94e6106", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 04:24:33.420518 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-ServersNegativeTestJSON-1302512485 Oct 19 04:24:33.420518 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 3084e66b15b645e683a12ce6b94e6106 Oct 19 04:24:33.420518 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1302512485 Oct 19 04:24:33.420518 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-ServersNegativeTestJSON-1302512485-project Oct 19 04:24:33.420518 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 04:24:33.420518 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 04:24:33.420518 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: bc05ba037afe4b1e99d9da5b2bdb01b7 Oct 19 04:24:33.420518 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-ServersNegativeTestJSON-1302512485-project Oct 19 04:24:33.420518 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 04:24:33.420518 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance 6c72f4c6-ece9-4e44-82a6-f13e01f70153 could not be found. Oct 19 04:24:33.420518 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '6c72f4c6-ece9-4e44-82a6-f13e01f70153'} Oct 19 04:24:33.420518 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 04:24:33.420518 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:24:33.420518 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 04:24:33.420518 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 04:24:33.420518 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 04:24:33.420518 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 04:24:33.420518 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 04:24:33.420518 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 04:24:33.420518 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 04:24:33.420518 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 04:24:33.420518 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c72f4c6-ece9-4e44-82a6-f13e01f70153 could not be found. Oct 19 04:24:33.420518 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:24:33.420518 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:24:33.420518 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:24:33.420518 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:24:33.420518 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:24:33.420518 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:24:33.420518 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 04:24:33.420518 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 04:24:33.420518 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 04:24:33.420518 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 04:24:33.420518 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 04:24:33.420518 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 04:24:33.420518 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 04:24:33.420518 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 04:24:33.420518 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 04:24:33.420518 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 04:24:33.420518 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 04:24:33.420518 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 04:24:33.425086 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c72f4c6-ece9-4e44-82a6-f13e01f70153 could not be found. Oct 19 04:24:33.425086 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:24:33.425086 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:24:33.425086 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:24:33.425086 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:24:33.425086 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:24:33.425086 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:24:33.425086 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 04:24:33.425086 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 04:24:33.425086 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c72f4c6-ece9-4e44-82a6-f13e01f70153 could not be found. Oct 19 04:24:33.425086 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:24:33.425086 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-dc8438f5-56f7-42b2-9a58-06a4bf888123 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Returning 404 to user: Instance 6c72f4c6-ece9-4e44-82a6-f13e01f70153 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 04:24:33.425086 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-dc8438f5-56f7-42b2-9a58-06a4bf888123 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] 10.222.0.52 "DELETE /compute/v2.1/servers/6c72f4c6-ece9-4e44-82a6-f13e01f70153" status: 404 len: 111 microversion: 2.1 time: 0.033604 Oct 19 04:24:33.425086 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4140/7805] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 04:24:33 2022] DELETE /compute/v2.1/servers/6c72f4c6-ece9-4e44-82a6-f13e01f70153 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 04:24:33.430766 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-aac42cd7-fbf9-43f2-8e48-fe15094e786e tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:24:33.431395 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-aac42cd7-fbf9-43f2-8e48-fe15094e786e tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] [instance: 6c72f4c6-ece9-4e44-82a6-f13e01f70153] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:24:33.438015 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aac42cd7-fbf9-43f2-8e48-fe15094e786e tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:24:33.438514 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aac42cd7-fbf9-43f2-8e48-fe15094e786e tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:24:33.438963 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aac42cd7-fbf9-43f2-8e48-fe15094e786e tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:24:33.439676 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aac42cd7-fbf9-43f2-8e48-fe15094e786e tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:24:33.440145 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aac42cd7-fbf9-43f2-8e48-fe15094e786e tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:24:33.440582 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aac42cd7-fbf9-43f2-8e48-fe15094e786e tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:24:33.454917 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-aac42cd7-fbf9-43f2-8e48-fe15094e786e tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] HTTP exception thrown: Instance 6c72f4c6-ece9-4e44-82a6-f13e01f70153 could not be found. Oct 19 04:24:33.456452 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-aac42cd7-fbf9-43f2-8e48-fe15094e786e tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Request method failure captured: Oct 19 04:24:33.456452 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/6c72f4c6-ece9-4e44-82a6-f13e01f70153 HTTP/1.1 Oct 19 04:24:33.456452 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 04:24:33.456452 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 04:24:33.456452 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 04:24:33.456452 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 04:24:33.456452 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 04:24:33.456452 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 04:24:33.456452 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 04:24:33.456452 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 04:24:33.456452 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT3vjQUONHu8cNau3l_0J1sdg9x8FfsPs0ITkTH7uOk0zWa-I99fPNtPv1UiddjgUXjzEkk0VOGHhJuQF5f639oTA3U9LJXMAZLgxpmijeHO841J_tni2vQMruvJBx9elrTYiAdUmRRZZZpE66WceqMDlw6piWujxwRUkZ15CMh8yZDY Oct 19 04:24:33.456452 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 04:24:33.456452 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 04:24:33.456452 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 04:24:33.456452 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 04:24:33.456452 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 04:24:33.456452 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 04:24:33.456452 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 3084e66b15b645e683a12ce6b94e6106 Oct 19 04:24:33.456452 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ServersNegativeTestJSON-1302512485 Oct 19 04:24:33.456452 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 04:24:33.456452 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 04:24:33.456452 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/3084e66b15b645e683a12ce6b94e6106"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3084e66b15b645e683a12ce6b94e6106"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3084e66b15b645e683a12ce6b94e6106"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_3084e66b15b645e683a12ce6b94e6106", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 04:24:33.456452 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ServersNegativeTestJSON-1302512485 Oct 19 04:24:33.456452 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 3084e66b15b645e683a12ce6b94e6106 Oct 19 04:24:33.456452 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1302512485 Oct 19 04:24:33.456452 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ServersNegativeTestJSON-1302512485-project Oct 19 04:24:33.456452 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 04:24:33.456452 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 04:24:33.456452 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: bc05ba037afe4b1e99d9da5b2bdb01b7 Oct 19 04:24:33.456452 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ServersNegativeTestJSON-1302512485-project Oct 19 04:24:33.456452 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 04:24:33.456452 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance 6c72f4c6-ece9-4e44-82a6-f13e01f70153 could not be found. Oct 19 04:24:33.456452 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '6c72f4c6-ece9-4e44-82a6-f13e01f70153'} Oct 19 04:24:33.456452 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 04:24:33.456452 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:24:33.456452 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 04:24:33.456452 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 04:24:33.456452 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 04:24:33.456452 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 04:24:33.456452 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 04:24:33.456452 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 04:24:33.456452 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 04:24:33.456452 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 04:24:33.456452 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c72f4c6-ece9-4e44-82a6-f13e01f70153 could not be found. Oct 19 04:24:33.456452 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:24:33.456452 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:24:33.456452 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:24:33.456452 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:24:33.456452 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:24:33.456452 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:24:33.456452 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 04:24:33.456452 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 04:24:33.456452 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 04:24:33.456452 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 04:24:33.456452 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 04:24:33.456452 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 04:24:33.456452 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 04:24:33.456452 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 04:24:33.456452 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 04:24:33.456452 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 04:24:33.456452 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c72f4c6-ece9-4e44-82a6-f13e01f70153 could not be found. Oct 19 04:24:33.456452 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:24:33.456452 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:24:33.456452 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:24:33.461663 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:24:33.461663 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:24:33.461663 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:24:33.461663 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 04:24:33.461663 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 04:24:33.461663 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c72f4c6-ece9-4e44-82a6-f13e01f70153 could not be found. Oct 19 04:24:33.461663 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:24:33.461663 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-aac42cd7-fbf9-43f2-8e48-fe15094e786e tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Returning 404 to user: Instance 6c72f4c6-ece9-4e44-82a6-f13e01f70153 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 04:24:33.461663 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-aac42cd7-fbf9-43f2-8e48-fe15094e786e tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] 10.222.0.52 "GET /compute/v2.1/servers/6c72f4c6-ece9-4e44-82a6-f13e01f70153" status: 404 len: 111 microversion: 2.1 time: 0.031149 Oct 19 04:24:33.461663 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3666/7806] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:24:33 2022] GET /compute/v2.1/servers/6c72f4c6-ece9-4e44-82a6-f13e01f70153 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 04:24:33.466404 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9ffd5f51-501e-4665-9359-93a36089f921 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:24:33.466919 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9ffd5f51-501e-4665-9359-93a36089f921 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] [instance: 15c4de5f-2c34-4ed4-ab34-733ef307c3c6] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:24:33.472911 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9ffd5f51-501e-4665-9359-93a36089f921 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:24:33.474492 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9ffd5f51-501e-4665-9359-93a36089f921 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:24:33.474492 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9ffd5f51-501e-4665-9359-93a36089f921 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:24:33.474669 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9ffd5f51-501e-4665-9359-93a36089f921 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:24:33.475047 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9ffd5f51-501e-4665-9359-93a36089f921 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:24:33.475497 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9ffd5f51-501e-4665-9359-93a36089f921 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:24:33.500441 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9ffd5f51-501e-4665-9359-93a36089f921 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] [instance: 15c4de5f-2c34-4ed4-ab34-733ef307c3c6] Going to try to terminate instance {{(pid=121134) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 04:24:33.528530 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=100 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:24:33.779019 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9ffd5f51-501e-4665-9359-93a36089f921 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] 10.222.0.52 "DELETE /compute/v2.1/servers/15c4de5f-2c34-4ed4-ab34-733ef307c3c6" status: 204 len: 0 microversion: 2.1 time: 0.316130 Oct 19 04:24:33.780333 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4141/7807] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 04:24:33 2022] DELETE /compute/v2.1/servers/15c4de5f-2c34-4ed4-ab34-733ef307c3c6 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 04:24:33.788599 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a5ad2b1e-c1ea-4cc7-bf66-94aeeb5a59c4 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:24:33.789221 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a5ad2b1e-c1ea-4cc7-bf66-94aeeb5a59c4 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] [instance: 15c4de5f-2c34-4ed4-ab34-733ef307c3c6] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:24:33.791844 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:24:33.797390 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a5ad2b1e-c1ea-4cc7-bf66-94aeeb5a59c4 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:24:33.797876 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a5ad2b1e-c1ea-4cc7-bf66-94aeeb5a59c4 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:24:33.798314 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a5ad2b1e-c1ea-4cc7-bf66-94aeeb5a59c4 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:24:33.799005 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a5ad2b1e-c1ea-4cc7-bf66-94aeeb5a59c4 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:24:33.799598 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a5ad2b1e-c1ea-4cc7-bf66-94aeeb5a59c4 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:24:33.800028 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a5ad2b1e-c1ea-4cc7-bf66-94aeeb5a59c4 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:24:33.932002 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a5ad2b1e-c1ea-4cc7-bf66-94aeeb5a59c4 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc05ba037afe4b1e99d9da5b2bdb01b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3084e66b15b645e683a12ce6b94e6106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:24:33.939793 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a5ad2b1e-c1ea-4cc7-bf66-94aeeb5a59c4 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] 10.222.0.52 "GET /compute/v2.1/servers/15c4de5f-2c34-4ed4-ab34-733ef307c3c6" status: 200 len: 1510 microversion: 2.1 time: 0.155252 Oct 19 04:24:33.940377 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3667/7808] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:24:33 2022] GET /compute/v2.1/servers/15c4de5f-2c34-4ed4-ab34-733ef307c3c6 => generated 1510 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:24:34.963118 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c8b81ede-497a-4dad-9ee2-d48c141280f5 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:24:34.963851 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c8b81ede-497a-4dad-9ee2-d48c141280f5 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] [instance: 15c4de5f-2c34-4ed4-ab34-733ef307c3c6] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:24:34.970731 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c8b81ede-497a-4dad-9ee2-d48c141280f5 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:24:34.971237 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c8b81ede-497a-4dad-9ee2-d48c141280f5 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:24:34.971698 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c8b81ede-497a-4dad-9ee2-d48c141280f5 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:24:34.972414 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c8b81ede-497a-4dad-9ee2-d48c141280f5 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:24:34.972889 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c8b81ede-497a-4dad-9ee2-d48c141280f5 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:24:34.973394 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c8b81ede-497a-4dad-9ee2-d48c141280f5 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:24:35.109734 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c8b81ede-497a-4dad-9ee2-d48c141280f5 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc05ba037afe4b1e99d9da5b2bdb01b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3084e66b15b645e683a12ce6b94e6106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:24:35.117488 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c8b81ede-497a-4dad-9ee2-d48c141280f5 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] 10.222.0.52 "GET /compute/v2.1/servers/15c4de5f-2c34-4ed4-ab34-733ef307c3c6" status: 200 len: 1510 microversion: 2.1 time: 0.158736 Oct 19 04:24:35.118065 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4142/7809] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:24:34 2022] GET /compute/v2.1/servers/15c4de5f-2c34-4ed4-ab34-733ef307c3c6 => generated 1510 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:24:35.781632 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-1a000eff-dbef-4088-a651-5aec0d0e9c7e req-e868b465-ad41-4fa9-91d9-bea7613e0f64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15c4de5f-2c34-4ed4-ab34-733ef307c3c6", "name": "network-vif-deleted", "tag": "c2c80320-cd15-427b-921a-bf7dbbbda4e4"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:24:35.797925 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-1a000eff-dbef-4088-a651-5aec0d0e9c7e req-e868b465-ad41-4fa9-91d9-bea7613e0f64 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:24:35.797925 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-1a000eff-dbef-4088-a651-5aec0d0e9c7e req-e868b465-ad41-4fa9-91d9-bea7613e0f64 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:24:35.797925 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-1a000eff-dbef-4088-a651-5aec0d0e9c7e req-e868b465-ad41-4fa9-91d9-bea7613e0f64 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:24:35.807091 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-1a000eff-dbef-4088-a651-5aec0d0e9c7e req-e868b465-ad41-4fa9-91d9-bea7613e0f64 service nova] Creating event network-vif-deleted:c2c80320-cd15-427b-921a-bf7dbbbda4e4 for instance 15c4de5f-2c34-4ed4-ab34-733ef307c3c6 on n-h2-861333-8 Oct 19 04:24:35.813719 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-1a000eff-dbef-4088-a651-5aec0d0e9c7e req-e868b465-ad41-4fa9-91d9-bea7613e0f64 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035854 Oct 19 04:24:35.814749 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3668/7810] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:24:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:24:36.141505 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f9234a57-412c-4033-83fc-7a27ec2c9096 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:24:36.142075 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f9234a57-412c-4033-83fc-7a27ec2c9096 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] [instance: 15c4de5f-2c34-4ed4-ab34-733ef307c3c6] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:24:36.149357 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f9234a57-412c-4033-83fc-7a27ec2c9096 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:24:36.150155 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f9234a57-412c-4033-83fc-7a27ec2c9096 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:24:36.150617 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f9234a57-412c-4033-83fc-7a27ec2c9096 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:24:36.151483 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f9234a57-412c-4033-83fc-7a27ec2c9096 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:24:36.151963 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f9234a57-412c-4033-83fc-7a27ec2c9096 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:24:36.152415 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f9234a57-412c-4033-83fc-7a27ec2c9096 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:24:36.183767 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f9234a57-412c-4033-83fc-7a27ec2c9096 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:24:36.184268 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f9234a57-412c-4033-83fc-7a27ec2c9096 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:24:36.184726 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f9234a57-412c-4033-83fc-7a27ec2c9096 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:24:36.185191 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-f9234a57-412c-4033-83fc-7a27ec2c9096 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lazy-loading 'fault' on Instance uuid 15c4de5f-2c34-4ed4-ab34-733ef307c3c6 {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 04:24:36.227679 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-f9234a57-412c-4033-83fc-7a27ec2c9096 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc05ba037afe4b1e99d9da5b2bdb01b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3084e66b15b645e683a12ce6b94e6106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:24:36.235752 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f9234a57-412c-4033-83fc-7a27ec2c9096 tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] 10.222.0.52 "GET /compute/v2.1/servers/15c4de5f-2c34-4ed4-ab34-733ef307c3c6" status: 200 len: 1307 microversion: 2.1 time: 0.098853 Oct 19 04:24:36.236366 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4143/7811] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:24:36 2022] GET /compute/v2.1/servers/15c4de5f-2c34-4ed4-ab34-733ef307c3c6 => generated 1307 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:24:37.260049 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-88054fe9-6ba4-4b81-b19b-b130a290a54f tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:24:37.260754 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-88054fe9-6ba4-4b81-b19b-b130a290a54f tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] [instance: 15c4de5f-2c34-4ed4-ab34-733ef307c3c6] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:24:37.268603 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-88054fe9-6ba4-4b81-b19b-b130a290a54f tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:24:37.269090 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-88054fe9-6ba4-4b81-b19b-b130a290a54f tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:24:37.269566 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-88054fe9-6ba4-4b81-b19b-b130a290a54f tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:24:37.270259 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-88054fe9-6ba4-4b81-b19b-b130a290a54f tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:24:37.270715 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-88054fe9-6ba4-4b81-b19b-b130a290a54f tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:24:37.271172 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-88054fe9-6ba4-4b81-b19b-b130a290a54f tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:24:37.284708 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-88054fe9-6ba4-4b81-b19b-b130a290a54f tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] HTTP exception thrown: Instance 15c4de5f-2c34-4ed4-ab34-733ef307c3c6 could not be found. Oct 19 04:24:37.286338 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-88054fe9-6ba4-4b81-b19b-b130a290a54f tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Request method failure captured: Oct 19 04:24:37.286338 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/15c4de5f-2c34-4ed4-ab34-733ef307c3c6 HTTP/1.1 Oct 19 04:24:37.286338 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 04:24:37.286338 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 04:24:37.286338 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 04:24:37.286338 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 04:24:37.286338 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 04:24:37.286338 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 04:24:37.286338 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 04:24:37.286338 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 04:24:37.286338 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT3vjQUONHu8cNau3l_0J1sdg9x8FfsPs0ITkTH7uOk0zWa-I99fPNtPv1UiddjgUXjzEkk0VOGHhJuQF5f639oTA3U9LJXMAZLgxpmijeHO841J_tni2vQMruvJBx9elrTYiAdUmRRZZZpE66WceqMDlw6piWujxwRUkZ15CMh8yZDY Oct 19 04:24:37.286338 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 04:24:37.286338 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 04:24:37.286338 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 04:24:37.286338 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 04:24:37.286338 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 04:24:37.286338 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 04:24:37.286338 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 3084e66b15b645e683a12ce6b94e6106 Oct 19 04:24:37.286338 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-ServersNegativeTestJSON-1302512485 Oct 19 04:24:37.286338 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 04:24:37.286338 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 04:24:37.286338 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/3084e66b15b645e683a12ce6b94e6106"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3084e66b15b645e683a12ce6b94e6106"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3084e66b15b645e683a12ce6b94e6106"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_3084e66b15b645e683a12ce6b94e6106", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 04:24:37.286338 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-ServersNegativeTestJSON-1302512485 Oct 19 04:24:37.286338 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 3084e66b15b645e683a12ce6b94e6106 Oct 19 04:24:37.286338 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1302512485 Oct 19 04:24:37.286338 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-ServersNegativeTestJSON-1302512485-project Oct 19 04:24:37.286338 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 04:24:37.286338 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 04:24:37.286338 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: bc05ba037afe4b1e99d9da5b2bdb01b7 Oct 19 04:24:37.286338 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-ServersNegativeTestJSON-1302512485-project Oct 19 04:24:37.286338 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 04:24:37.286338 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance 15c4de5f-2c34-4ed4-ab34-733ef307c3c6 could not be found. Oct 19 04:24:37.286338 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '15c4de5f-2c34-4ed4-ab34-733ef307c3c6'} Oct 19 04:24:37.286338 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 04:24:37.286338 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:24:37.286338 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 04:24:37.286338 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 04:24:37.286338 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 04:24:37.286338 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 04:24:37.286338 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 04:24:37.286338 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 04:24:37.286338 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 04:24:37.286338 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 04:24:37.286338 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15c4de5f-2c34-4ed4-ab34-733ef307c3c6 could not be found. Oct 19 04:24:37.286338 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:24:37.286338 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:24:37.286338 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:24:37.286338 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:24:37.286338 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:24:37.286338 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:24:37.286338 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 04:24:37.286338 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 04:24:37.286338 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 04:24:37.286338 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 04:24:37.286338 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 04:24:37.286338 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 04:24:37.286338 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 04:24:37.286338 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 04:24:37.286338 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 04:24:37.286338 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 04:24:37.286338 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15c4de5f-2c34-4ed4-ab34-733ef307c3c6 could not be found. Oct 19 04:24:37.286338 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:24:37.286338 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:24:37.286338 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:24:37.290971 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:24:37.290971 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:24:37.290971 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:24:37.290971 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 04:24:37.290971 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 04:24:37.290971 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15c4de5f-2c34-4ed4-ab34-733ef307c3c6 could not be found. Oct 19 04:24:37.290971 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:24:37.290971 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-88054fe9-6ba4-4b81-b19b-b130a290a54f tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] Returning 404 to user: Instance 15c4de5f-2c34-4ed4-ab34-733ef307c3c6 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 04:24:37.290971 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-88054fe9-6ba4-4b81-b19b-b130a290a54f tempest-ServersNegativeTestJSON-1302512485 tempest-ServersNegativeTestJSON-1302512485-project] 10.222.0.52 "GET /compute/v2.1/servers/15c4de5f-2c34-4ed4-ab34-733ef307c3c6" status: 404 len: 111 microversion: 2.1 time: 0.031976 Oct 19 04:24:37.290971 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3669/7812] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:24:37 2022] GET /compute/v2.1/servers/15c4de5f-2c34-4ed4-ab34-733ef307c3c6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 04:25:21.152116 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:25:21.157604 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=18,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:25:21.354386 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0f7927c1-32df-4c51-a910-730994539727 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Action: 'create', calling method: .version_select at 0x7fc12b8c0c10>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-2025588255", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFRNzPQG5Zeki7QiAzjnPVKOJPoMesn4PUi7l5MsBstn01qTVLQk2F9ZNB024bFaBdMnDa9uVUcH2d9IukWeec+XOaF8bFY/7IqE5X1l6203pvC8dDxbbrvFYopwUPOMmQ=="}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:25:21.375904 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-0f7927c1-32df-4c51-a910-730994539727 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Getting quotas for project 5f5a48cb267249749641e9e7b9b55102. Resources: {'key_pairs'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 04:25:21.377962 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-0f7927c1-32df-4c51-a910-730994539727 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Getting quotas for user 48b2e87ad952416d814d03bfbb3c1ca1 and project 5f5a48cb267249749641e9e7b9b55102. Resources: {'key_pairs'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 04:25:21.478430 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0f7927c1-32df-4c51-a910-730994539727 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.331719 Oct 19 04:25:21.479160 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4144/7813] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Oct 19 04:25:21 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 04:25:21.535794 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-57165bf5-044a-4c57-b31a-8af9ec4ed430 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1035661034", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-2025588255", "networks": [{"uuid": "10995fe6-305c-4382-ad76-58b7897e9c0b"}]}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:25:21.545758 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=5 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:25:21.546664 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=34 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:25:21.596106 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.network.neutron [None req-57165bf5-044a-4c57-b31a-8af9ec4ed430 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] validate_networks() for [('10995fe6-305c-4382-ad76-58b7897e9c0b', None, None, None, None, None)] {{(pid=121135) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 04:25:22.086544 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-57165bf5-044a-4c57-b31a-8af9ec4ed430 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Flavor limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 04:25:22.086998 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-57165bf5-044a-4c57-b31a-8af9ec4ed430 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Image limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 04:25:22.087613 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-57165bf5-044a-4c57-b31a-8af9ec4ed430 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Flavor pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 04:25:22.087891 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-57165bf5-044a-4c57-b31a-8af9ec4ed430 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Image pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 04:25:22.088315 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-57165bf5-044a-4c57-b31a-8af9ec4ed430 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 04:25:22.098809 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-57165bf5-044a-4c57-b31a-8af9ec4ed430 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:25:22.099315 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-57165bf5-044a-4c57-b31a-8af9ec4ed430 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:25:22.099761 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-57165bf5-044a-4c57-b31a-8af9ec4ed430 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:25:22.100501 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-57165bf5-044a-4c57-b31a-8af9ec4ed430 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:25:22.100967 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-57165bf5-044a-4c57-b31a-8af9ec4ed430 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:25:22.101422 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-57165bf5-044a-4c57-b31a-8af9ec4ed430 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:25:22.121399 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-57165bf5-044a-4c57-b31a-8af9ec4ed430 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Getting quotas for project 5f5a48cb267249749641e9e7b9b55102. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 04:25:22.127452 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-57165bf5-044a-4c57-b31a-8af9ec4ed430 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Getting quotas for user 48b2e87ad952416d814d03bfbb3c1ca1 and project 5f5a48cb267249749641e9e7b9b55102. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 04:25:22.140388 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-57165bf5-044a-4c57-b31a-8af9ec4ed430 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Going to run 1 instances... {{(pid=121135) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 04:25:22.142758 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-57165bf5-044a-4c57-b31a-8af9ec4ed430 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] [instance: 8514c797-946c-4349-9281-8f83ba15c8e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121135) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 04:25:22.274320 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-57165bf5-044a-4c57-b31a-8af9ec4ed430 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.742850 Oct 19 04:25:22.274964 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3670/7814] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 04:25:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 744 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 04:25:22.289090 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-121c97b0-f4ec-41a8-a238-59561e0c7d36 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:25:22.291729 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-121c97b0-f4ec-41a8-a238-59561e0c7d36 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] [instance: 8514c797-946c-4349-9281-8f83ba15c8e2] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:25:22.347160 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-121c97b0-f4ec-41a8-a238-59561e0c7d36 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b2e87ad952416d814d03bfbb3c1ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5a48cb267249749641e9e7b9b55102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:25:22.355885 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-121c97b0-f4ec-41a8-a238-59561e0c7d36 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] 10.222.0.52 "GET /compute/v2.1/servers/8514c797-946c-4349-9281-8f83ba15c8e2" status: 200 len: 1263 microversion: 2.1 time: 0.073354 Oct 19 04:25:22.357686 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4145/7815] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:25:22 2022] GET /compute/v2.1/servers/8514c797-946c-4349-9281-8f83ba15c8e2 => generated 1263 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:25:23.380671 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-137d8983-2ae6-4b73-9e27-fdcfe64d9029 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:25:23.381301 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-137d8983-2ae6-4b73-9e27-fdcfe64d9029 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] [instance: 8514c797-946c-4349-9281-8f83ba15c8e2] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:25:23.436840 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-137d8983-2ae6-4b73-9e27-fdcfe64d9029 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b2e87ad952416d814d03bfbb3c1ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5a48cb267249749641e9e7b9b55102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:25:23.444037 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-137d8983-2ae6-4b73-9e27-fdcfe64d9029 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] 10.222.0.52 "GET /compute/v2.1/servers/8514c797-946c-4349-9281-8f83ba15c8e2" status: 200 len: 1263 microversion: 2.1 time: 0.068292 Oct 19 04:25:23.444624 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3671/7816] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:25:23 2022] GET /compute/v2.1/servers/8514c797-946c-4349-9281-8f83ba15c8e2 => generated 1263 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:25:24.467514 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b02f33fa-f0bc-4154-9c8a-a8f291f71af7 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:25:24.468833 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b02f33fa-f0bc-4154-9c8a-a8f291f71af7 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] [instance: 8514c797-946c-4349-9281-8f83ba15c8e2] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:25:24.476837 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b02f33fa-f0bc-4154-9c8a-a8f291f71af7 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:25:24.477578 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b02f33fa-f0bc-4154-9c8a-a8f291f71af7 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:25:24.478186 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b02f33fa-f0bc-4154-9c8a-a8f291f71af7 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:25:24.479098 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b02f33fa-f0bc-4154-9c8a-a8f291f71af7 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:25:24.479725 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b02f33fa-f0bc-4154-9c8a-a8f291f71af7 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:25:24.480320 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b02f33fa-f0bc-4154-9c8a-a8f291f71af7 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:25:24.628125 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b02f33fa-f0bc-4154-9c8a-a8f291f71af7 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b2e87ad952416d814d03bfbb3c1ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5a48cb267249749641e9e7b9b55102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:25:24.636904 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b02f33fa-f0bc-4154-9c8a-a8f291f71af7 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] 10.222.0.52 "GET /compute/v2.1/servers/8514c797-946c-4349-9281-8f83ba15c8e2" status: 200 len: 1315 microversion: 2.1 time: 0.173798 Oct 19 04:25:24.637515 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4146/7817] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:25:24 2022] GET /compute/v2.1/servers/8514c797-946c-4349-9281-8f83ba15c8e2 => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:25:25.660896 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-39b0825e-b80f-45c7-8617-c5c2c46ec6d1 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:25:25.662153 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-39b0825e-b80f-45c7-8617-c5c2c46ec6d1 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] [instance: 8514c797-946c-4349-9281-8f83ba15c8e2] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:25:25.669829 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-39b0825e-b80f-45c7-8617-c5c2c46ec6d1 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:25:25.670266 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-39b0825e-b80f-45c7-8617-c5c2c46ec6d1 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:25:25.670861 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-39b0825e-b80f-45c7-8617-c5c2c46ec6d1 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:25:25.671590 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-39b0825e-b80f-45c7-8617-c5c2c46ec6d1 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:25:25.672056 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-39b0825e-b80f-45c7-8617-c5c2c46ec6d1 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:25:25.672522 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-39b0825e-b80f-45c7-8617-c5c2c46ec6d1 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:25:25.938287 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-39b0825e-b80f-45c7-8617-c5c2c46ec6d1 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b2e87ad952416d814d03bfbb3c1ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5a48cb267249749641e9e7b9b55102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:25:25.946692 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-39b0825e-b80f-45c7-8617-c5c2c46ec6d1 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] 10.222.0.52 "GET /compute/v2.1/servers/8514c797-946c-4349-9281-8f83ba15c8e2" status: 200 len: 1363 microversion: 2.1 time: 0.289817 Oct 19 04:25:25.949324 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3672/7818] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:25:25 2022] GET /compute/v2.1/servers/8514c797-946c-4349-9281-8f83ba15c8e2 => generated 1363 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:25:26.510956 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-601366bb-2843-44e3-89ea-8aaaee20ff90 req-cf3fceba-f537-4f02-b5ec-35331ce83632 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8514c797-946c-4349-9281-8f83ba15c8e2", "tag": "b0946eb4-95b6-4e98-a651-918a3d9241c3"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:25:26.524104 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-601366bb-2843-44e3-89ea-8aaaee20ff90 req-cf3fceba-f537-4f02-b5ec-35331ce83632 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:25:26.524918 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-601366bb-2843-44e3-89ea-8aaaee20ff90 req-cf3fceba-f537-4f02-b5ec-35331ce83632 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:25:26.525491 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-601366bb-2843-44e3-89ea-8aaaee20ff90 req-cf3fceba-f537-4f02-b5ec-35331ce83632 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:25:26.538819 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-601366bb-2843-44e3-89ea-8aaaee20ff90 req-cf3fceba-f537-4f02-b5ec-35331ce83632 service nova] Creating event network-changed:b0946eb4-95b6-4e98-a651-918a3d9241c3 for instance 8514c797-946c-4349-9281-8f83ba15c8e2 on n-h2-861333-8 Oct 19 04:25:26.545108 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-601366bb-2843-44e3-89ea-8aaaee20ff90 req-cf3fceba-f537-4f02-b5ec-35331ce83632 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038558 Oct 19 04:25:26.546046 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4147/7819] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:25:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:25:26.974069 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-43b39ea2-5b32-4d09-b212-4baf69d3e71e tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:25:26.974692 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-43b39ea2-5b32-4d09-b212-4baf69d3e71e tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] [instance: 8514c797-946c-4349-9281-8f83ba15c8e2] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:25:26.982010 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-43b39ea2-5b32-4d09-b212-4baf69d3e71e tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:25:26.982510 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-43b39ea2-5b32-4d09-b212-4baf69d3e71e tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:25:26.982950 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-43b39ea2-5b32-4d09-b212-4baf69d3e71e tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:25:26.983641 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-43b39ea2-5b32-4d09-b212-4baf69d3e71e tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:25:26.984097 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-43b39ea2-5b32-4d09-b212-4baf69d3e71e tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:25:26.984527 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-43b39ea2-5b32-4d09-b212-4baf69d3e71e tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:25:27.203459 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-43b39ea2-5b32-4d09-b212-4baf69d3e71e tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b2e87ad952416d814d03bfbb3c1ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5a48cb267249749641e9e7b9b55102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:25:27.211495 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-43b39ea2-5b32-4d09-b212-4baf69d3e71e tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] 10.222.0.52 "GET /compute/v2.1/servers/8514c797-946c-4349-9281-8f83ba15c8e2" status: 200 len: 1363 microversion: 2.1 time: 0.241129 Oct 19 04:25:27.212157 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3673/7820] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:25:26 2022] GET /compute/v2.1/servers/8514c797-946c-4349-9281-8f83ba15c8e2 => generated 1363 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:25:28.236374 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e9d51ee6-55c2-4082-a40c-2da0100e37f4 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:25:28.237102 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e9d51ee6-55c2-4082-a40c-2da0100e37f4 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] [instance: 8514c797-946c-4349-9281-8f83ba15c8e2] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:25:28.243587 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e9d51ee6-55c2-4082-a40c-2da0100e37f4 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:25:28.244094 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e9d51ee6-55c2-4082-a40c-2da0100e37f4 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:25:28.244553 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e9d51ee6-55c2-4082-a40c-2da0100e37f4 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:25:28.245263 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e9d51ee6-55c2-4082-a40c-2da0100e37f4 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:25:28.245775 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e9d51ee6-55c2-4082-a40c-2da0100e37f4 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:25:28.246211 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e9d51ee6-55c2-4082-a40c-2da0100e37f4 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:25:28.381781 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e9d51ee6-55c2-4082-a40c-2da0100e37f4 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b2e87ad952416d814d03bfbb3c1ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5a48cb267249749641e9e7b9b55102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:25:28.394362 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e9d51ee6-55c2-4082-a40c-2da0100e37f4 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] 10.222.0.52 "GET /compute/v2.1/servers/8514c797-946c-4349-9281-8f83ba15c8e2" status: 200 len: 1363 microversion: 2.1 time: 0.163157 Oct 19 04:25:28.394956 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4148/7821] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:25:28 2022] GET /compute/v2.1/servers/8514c797-946c-4349-9281-8f83ba15c8e2 => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:25:29.417298 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-27c8bdea-dba1-47fe-ad84-21bb9bd75d7c tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:25:29.424413 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-27c8bdea-dba1-47fe-ad84-21bb9bd75d7c tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] [instance: 8514c797-946c-4349-9281-8f83ba15c8e2] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:25:29.424827 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-27c8bdea-dba1-47fe-ad84-21bb9bd75d7c tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:25:29.425329 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-27c8bdea-dba1-47fe-ad84-21bb9bd75d7c tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:25:29.425816 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-27c8bdea-dba1-47fe-ad84-21bb9bd75d7c tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:25:29.426522 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-27c8bdea-dba1-47fe-ad84-21bb9bd75d7c tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:25:29.426982 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-27c8bdea-dba1-47fe-ad84-21bb9bd75d7c tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:25:29.427464 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-27c8bdea-dba1-47fe-ad84-21bb9bd75d7c tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:25:29.557963 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-27c8bdea-dba1-47fe-ad84-21bb9bd75d7c tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b2e87ad952416d814d03bfbb3c1ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5a48cb267249749641e9e7b9b55102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:25:29.566237 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-27c8bdea-dba1-47fe-ad84-21bb9bd75d7c tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] 10.222.0.52 "GET /compute/v2.1/servers/8514c797-946c-4349-9281-8f83ba15c8e2" status: 200 len: 1363 microversion: 2.1 time: 0.152911 Oct 19 04:25:29.566835 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3674/7822] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:25:29 2022] GET /compute/v2.1/servers/8514c797-946c-4349-9281-8f83ba15c8e2 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:25:30.589935 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-22cd1428-0ac4-42aa-af28-8c3136344fee tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:25:30.590565 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-22cd1428-0ac4-42aa-af28-8c3136344fee tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] [instance: 8514c797-946c-4349-9281-8f83ba15c8e2] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:25:30.597217 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-22cd1428-0ac4-42aa-af28-8c3136344fee tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:25:30.597918 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-22cd1428-0ac4-42aa-af28-8c3136344fee tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:25:30.598386 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-22cd1428-0ac4-42aa-af28-8c3136344fee tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:25:30.599112 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-22cd1428-0ac4-42aa-af28-8c3136344fee tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:25:30.599748 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-22cd1428-0ac4-42aa-af28-8c3136344fee tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:25:30.600196 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-22cd1428-0ac4-42aa-af28-8c3136344fee tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:25:30.743544 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-22cd1428-0ac4-42aa-af28-8c3136344fee tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b2e87ad952416d814d03bfbb3c1ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5a48cb267249749641e9e7b9b55102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:25:30.752494 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-22cd1428-0ac4-42aa-af28-8c3136344fee tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] 10.222.0.52 "GET /compute/v2.1/servers/8514c797-946c-4349-9281-8f83ba15c8e2" status: 200 len: 1363 microversion: 2.1 time: 0.166682 Oct 19 04:25:30.753095 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4149/7823] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:25:30 2022] GET /compute/v2.1/servers/8514c797-946c-4349-9281-8f83ba15c8e2 => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:25:31.776448 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3254946e-acb1-45a0-b83d-2835ec1a13e6 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:25:31.777061 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-3254946e-acb1-45a0-b83d-2835ec1a13e6 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] [instance: 8514c797-946c-4349-9281-8f83ba15c8e2] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:25:31.784038 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3254946e-acb1-45a0-b83d-2835ec1a13e6 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:25:31.784560 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3254946e-acb1-45a0-b83d-2835ec1a13e6 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:25:31.784987 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3254946e-acb1-45a0-b83d-2835ec1a13e6 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:25:31.785728 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3254946e-acb1-45a0-b83d-2835ec1a13e6 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:25:31.786183 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3254946e-acb1-45a0-b83d-2835ec1a13e6 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:25:31.786611 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3254946e-acb1-45a0-b83d-2835ec1a13e6 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:25:31.915202 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-3254946e-acb1-45a0-b83d-2835ec1a13e6 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b2e87ad952416d814d03bfbb3c1ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5a48cb267249749641e9e7b9b55102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:25:31.922959 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-3254946e-acb1-45a0-b83d-2835ec1a13e6 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] 10.222.0.52 "GET /compute/v2.1/servers/8514c797-946c-4349-9281-8f83ba15c8e2" status: 200 len: 1363 microversion: 2.1 time: 0.150682 Oct 19 04:25:31.923529 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3675/7824] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:25:31 2022] GET /compute/v2.1/servers/8514c797-946c-4349-9281-8f83ba15c8e2 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:25:32.871584 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-5a064b77-0a56-4f13-8458-6da7c20a28a7 req-6d89331d-4895-4869-8c05-dbe52e74e888 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8514c797-946c-4349-9281-8f83ba15c8e2", "name": "network-vif-plugged", "status": "completed", "tag": "b0946eb4-95b6-4e98-a651-918a3d9241c3"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:25:32.878282 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=6 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:25:32.883524 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-5a064b77-0a56-4f13-8458-6da7c20a28a7 req-6d89331d-4895-4869-8c05-dbe52e74e888 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:25:32.884016 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-5a064b77-0a56-4f13-8458-6da7c20a28a7 req-6d89331d-4895-4869-8c05-dbe52e74e888 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:25:32.887112 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-5a064b77-0a56-4f13-8458-6da7c20a28a7 req-6d89331d-4895-4869-8c05-dbe52e74e888 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:25:32.895748 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-5a064b77-0a56-4f13-8458-6da7c20a28a7 req-6d89331d-4895-4869-8c05-dbe52e74e888 service nova] Creating event network-vif-plugged:b0946eb4-95b6-4e98-a651-918a3d9241c3 for instance 8514c797-946c-4349-9281-8f83ba15c8e2 on n-h2-861333-8 Oct 19 04:25:32.900977 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-5a064b77-0a56-4f13-8458-6da7c20a28a7 req-6d89331d-4895-4869-8c05-dbe52e74e888 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033027 Oct 19 04:25:32.901589 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4150/7825] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:25:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:25:32.946095 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4342ed85-536e-4fdf-a9ac-9dd1b4e33f39 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:25:32.946700 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4342ed85-536e-4fdf-a9ac-9dd1b4e33f39 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] [instance: 8514c797-946c-4349-9281-8f83ba15c8e2] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:25:32.948550 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:25:32.954580 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4342ed85-536e-4fdf-a9ac-9dd1b4e33f39 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:25:32.955280 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4342ed85-536e-4fdf-a9ac-9dd1b4e33f39 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:25:32.955725 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4342ed85-536e-4fdf-a9ac-9dd1b4e33f39 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:25:32.956432 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4342ed85-536e-4fdf-a9ac-9dd1b4e33f39 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:25:32.956890 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4342ed85-536e-4fdf-a9ac-9dd1b4e33f39 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:25:32.957314 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4342ed85-536e-4fdf-a9ac-9dd1b4e33f39 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:25:33.141305 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4342ed85-536e-4fdf-a9ac-9dd1b4e33f39 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b2e87ad952416d814d03bfbb3c1ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5a48cb267249749641e9e7b9b55102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:25:33.149255 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4342ed85-536e-4fdf-a9ac-9dd1b4e33f39 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] 10.222.0.52 "GET /compute/v2.1/servers/8514c797-946c-4349-9281-8f83ba15c8e2" status: 200 len: 1363 microversion: 2.1 time: 0.207060 Oct 19 04:25:33.149888 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3676/7826] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:25:32 2022] GET /compute/v2.1/servers/8514c797-946c-4349-9281-8f83ba15c8e2 => generated 1363 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:25:34.174030 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-424f9339-bba1-4188-9bb9-f2b27156d124 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:25:34.174752 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-424f9339-bba1-4188-9bb9-f2b27156d124 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] [instance: 8514c797-946c-4349-9281-8f83ba15c8e2] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:25:34.181261 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-424f9339-bba1-4188-9bb9-f2b27156d124 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:25:34.181793 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-424f9339-bba1-4188-9bb9-f2b27156d124 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:25:34.182249 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-424f9339-bba1-4188-9bb9-f2b27156d124 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:25:34.182967 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-424f9339-bba1-4188-9bb9-f2b27156d124 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:25:34.191572 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-424f9339-bba1-4188-9bb9-f2b27156d124 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:25:34.191572 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-424f9339-bba1-4188-9bb9-f2b27156d124 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:25:34.321389 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-424f9339-bba1-4188-9bb9-f2b27156d124 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b2e87ad952416d814d03bfbb3c1ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5a48cb267249749641e9e7b9b55102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:25:34.329787 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-424f9339-bba1-4188-9bb9-f2b27156d124 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] 10.222.0.52 "GET /compute/v2.1/servers/8514c797-946c-4349-9281-8f83ba15c8e2" status: 200 len: 1363 microversion: 2.1 time: 0.161289 Oct 19 04:25:34.330357 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4151/7827] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:25:34 2022] GET /compute/v2.1/servers/8514c797-946c-4349-9281-8f83ba15c8e2 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:25:35.352330 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-05866653-44ee-4719-baf3-40b3904235f4 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:25:35.352958 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-05866653-44ee-4719-baf3-40b3904235f4 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] [instance: 8514c797-946c-4349-9281-8f83ba15c8e2] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:25:35.354928 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=8 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:25:35.360714 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-05866653-44ee-4719-baf3-40b3904235f4 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:25:35.361208 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-05866653-44ee-4719-baf3-40b3904235f4 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:25:35.367111 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-05866653-44ee-4719-baf3-40b3904235f4 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:25:35.367111 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-05866653-44ee-4719-baf3-40b3904235f4 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:25:35.367111 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-05866653-44ee-4719-baf3-40b3904235f4 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:25:35.367111 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-05866653-44ee-4719-baf3-40b3904235f4 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:25:35.491812 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-05866653-44ee-4719-baf3-40b3904235f4 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b2e87ad952416d814d03bfbb3c1ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5a48cb267249749641e9e7b9b55102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:25:35.500078 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-05866653-44ee-4719-baf3-40b3904235f4 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] 10.222.0.52 "GET /compute/v2.1/servers/8514c797-946c-4349-9281-8f83ba15c8e2" status: 200 len: 1555 microversion: 2.1 time: 0.151797 Oct 19 04:25:35.500658 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3677/7828] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:25:35 2022] GET /compute/v2.1/servers/8514c797-946c-4349-9281-8f83ba15c8e2 => generated 1555 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:25:35.523073 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b834868f-1e9a-452a-adfb-b31b8565a87a tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:25:35.523697 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b834868f-1e9a-452a-adfb-b31b8565a87a tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] [instance: 8514c797-946c-4349-9281-8f83ba15c8e2] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:25:35.530806 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b834868f-1e9a-452a-adfb-b31b8565a87a tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:25:35.531303 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b834868f-1e9a-452a-adfb-b31b8565a87a tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:25:35.531760 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b834868f-1e9a-452a-adfb-b31b8565a87a tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:25:35.532464 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b834868f-1e9a-452a-adfb-b31b8565a87a tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:25:35.532924 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b834868f-1e9a-452a-adfb-b31b8565a87a tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:25:35.533357 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b834868f-1e9a-452a-adfb-b31b8565a87a tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:25:35.663519 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b834868f-1e9a-452a-adfb-b31b8565a87a tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b2e87ad952416d814d03bfbb3c1ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5a48cb267249749641e9e7b9b55102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:25:35.671562 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b834868f-1e9a-452a-adfb-b31b8565a87a tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] 10.222.0.52 "GET /compute/v2.1/servers/8514c797-946c-4349-9281-8f83ba15c8e2" status: 200 len: 1555 microversion: 2.1 time: 0.152431 Oct 19 04:25:35.672135 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4152/7829] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:25:35 2022] GET /compute/v2.1/servers/8514c797-946c-4349-9281-8f83ba15c8e2 => generated 1555 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:25:38.732282 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e90e4943-8aef-4860-80d3-364146753bfc tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4ebfb970-69a4-42a7-b8ec-2e3860c8a35f"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:25:38.734884 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e90e4943-8aef-4860-80d3-364146753bfc tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] [instance: 8514c797-946c-4349-9281-8f83ba15c8e2] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:25:38.741865 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e90e4943-8aef-4860-80d3-364146753bfc tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:25:38.742364 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e90e4943-8aef-4860-80d3-364146753bfc tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:25:38.742808 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e90e4943-8aef-4860-80d3-364146753bfc tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:25:38.743549 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e90e4943-8aef-4860-80d3-364146753bfc tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:25:38.744014 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e90e4943-8aef-4860-80d3-364146753bfc tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:25:38.744455 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e90e4943-8aef-4860-80d3-364146753bfc tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:25:39.457973 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e90e4943-8aef-4860-80d3-364146753bfc tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] 10.222.0.52 "POST /compute/v2.1/servers/8514c797-946c-4349-9281-8f83ba15c8e2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.730212 Oct 19 04:25:39.458632 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3678/7830] 10.222.0.52 () {60 vars in 1323 bytes} [Wed Oct 19 04:25:38 2022] POST /compute/v2.1/servers/8514c797-946c-4349-9281-8f83ba15c8e2/os-volume_attachments => generated 194 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:25:51.223119 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7f5075bf-f9a0-4106-b25a-ad38f58b94fe tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:25:51.223663 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7f5075bf-f9a0-4106-b25a-ad38f58b94fe tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] [instance: 8514c797-946c-4349-9281-8f83ba15c8e2] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:25:51.227113 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:25:51.227857 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=34 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:25:51.232571 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7f5075bf-f9a0-4106-b25a-ad38f58b94fe tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:25:51.234544 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7f5075bf-f9a0-4106-b25a-ad38f58b94fe tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:25:51.234544 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7f5075bf-f9a0-4106-b25a-ad38f58b94fe tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:25:51.234896 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7f5075bf-f9a0-4106-b25a-ad38f58b94fe tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:25:51.235362 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7f5075bf-f9a0-4106-b25a-ad38f58b94fe tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:25:51.235799 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7f5075bf-f9a0-4106-b25a-ad38f58b94fe tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:25:51.316552 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-7f5075bf-f9a0-4106-b25a-ad38f58b94fe tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lazy-loading 'services' on Instance uuid 8514c797-946c-4349-9281-8f83ba15c8e2 {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 04:25:51.532828 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7f5075bf-f9a0-4106-b25a-ad38f58b94fe tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] 10.222.0.52 "DELETE /compute/v2.1/servers/8514c797-946c-4349-9281-8f83ba15c8e2/os-volume_attachments/4ebfb970-69a4-42a7-b8ec-2e3860c8a35f" status: 202 len: 0 microversion: 2.1 time: 0.313378 Oct 19 04:25:51.533471 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4153/7831] 10.222.0.52 () {58 vars in 1416 bytes} [Wed Oct 19 04:25:51 2022] DELETE /compute/v2.1/servers/8514c797-946c-4349-9281-8f83ba15c8e2/os-volume_attachments/4ebfb970-69a4-42a7-b8ec-2e3860c8a35f => generated 0 bytes in 315 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 04:25:51.539909 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:25:51.540730 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:25:51.544951 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b8b2644e-7b9e-475e-add6-a3f4aab96636 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:25:51.547969 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b8b2644e-7b9e-475e-add6-a3f4aab96636 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] [instance: 8514c797-946c-4349-9281-8f83ba15c8e2] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:25:51.554087 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b8b2644e-7b9e-475e-add6-a3f4aab96636 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:25:51.554581 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b8b2644e-7b9e-475e-add6-a3f4aab96636 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:25:51.555025 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b8b2644e-7b9e-475e-add6-a3f4aab96636 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:25:51.555732 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b8b2644e-7b9e-475e-add6-a3f4aab96636 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:25:51.556193 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b8b2644e-7b9e-475e-add6-a3f4aab96636 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:25:51.556624 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b8b2644e-7b9e-475e-add6-a3f4aab96636 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:25:51.586867 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b8b2644e-7b9e-475e-add6-a3f4aab96636 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] 10.222.0.52 "GET /compute/v2.1/servers/8514c797-946c-4349-9281-8f83ba15c8e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048853 Oct 19 04:25:51.587432 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3679/7832] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Oct 19 04:25:51 2022] GET /compute/v2.1/servers/8514c797-946c-4349-9281-8f83ba15c8e2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:25:52.601140 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-30cdce04-704e-43d5-838f-d22da204bcb5 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:25:52.603439 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-30cdce04-704e-43d5-838f-d22da204bcb5 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] [instance: 8514c797-946c-4349-9281-8f83ba15c8e2] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:25:52.610290 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-30cdce04-704e-43d5-838f-d22da204bcb5 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:25:52.610799 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-30cdce04-704e-43d5-838f-d22da204bcb5 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:25:52.611260 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-30cdce04-704e-43d5-838f-d22da204bcb5 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:25:52.611975 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-30cdce04-704e-43d5-838f-d22da204bcb5 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:25:52.612447 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-30cdce04-704e-43d5-838f-d22da204bcb5 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:25:52.612895 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-30cdce04-704e-43d5-838f-d22da204bcb5 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:25:52.643360 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-30cdce04-704e-43d5-838f-d22da204bcb5 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] 10.222.0.52 "GET /compute/v2.1/servers/8514c797-946c-4349-9281-8f83ba15c8e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047452 Oct 19 04:25:52.644001 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4154/7833] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Oct 19 04:25:52 2022] GET /compute/v2.1/servers/8514c797-946c-4349-9281-8f83ba15c8e2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:25:53.656787 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-cfdb94c7-3464-47ff-9071-6d85e4d1a695 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:25:53.658908 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-cfdb94c7-3464-47ff-9071-6d85e4d1a695 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] [instance: 8514c797-946c-4349-9281-8f83ba15c8e2] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:25:53.666799 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cfdb94c7-3464-47ff-9071-6d85e4d1a695 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:25:53.667291 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cfdb94c7-3464-47ff-9071-6d85e4d1a695 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:25:53.667728 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cfdb94c7-3464-47ff-9071-6d85e4d1a695 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:25:53.668428 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cfdb94c7-3464-47ff-9071-6d85e4d1a695 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:25:53.669224 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cfdb94c7-3464-47ff-9071-6d85e4d1a695 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:25:53.669678 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cfdb94c7-3464-47ff-9071-6d85e4d1a695 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:25:53.707877 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-cfdb94c7-3464-47ff-9071-6d85e4d1a695 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] 10.222.0.52 "GET /compute/v2.1/servers/8514c797-946c-4349-9281-8f83ba15c8e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055536 Oct 19 04:25:53.708488 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3680/7834] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Oct 19 04:25:53 2022] GET /compute/v2.1/servers/8514c797-946c-4349-9281-8f83ba15c8e2/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:25:54.722401 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-050598b6-2ed2-4c5a-a252-93c485ef46f2 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:25:54.724616 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-050598b6-2ed2-4c5a-a252-93c485ef46f2 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] [instance: 8514c797-946c-4349-9281-8f83ba15c8e2] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:25:54.731540 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-050598b6-2ed2-4c5a-a252-93c485ef46f2 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:25:54.732041 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-050598b6-2ed2-4c5a-a252-93c485ef46f2 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:25:54.732500 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-050598b6-2ed2-4c5a-a252-93c485ef46f2 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:25:54.733212 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-050598b6-2ed2-4c5a-a252-93c485ef46f2 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:25:54.733713 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-050598b6-2ed2-4c5a-a252-93c485ef46f2 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:25:54.734160 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-050598b6-2ed2-4c5a-a252-93c485ef46f2 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:25:54.766407 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-050598b6-2ed2-4c5a-a252-93c485ef46f2 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] 10.222.0.52 "GET /compute/v2.1/servers/8514c797-946c-4349-9281-8f83ba15c8e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047998 Oct 19 04:25:54.766913 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4155/7835] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Oct 19 04:25:54 2022] GET /compute/v2.1/servers/8514c797-946c-4349-9281-8f83ba15c8e2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:25:55.780373 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-dda2c2b8-59ae-41da-bfa4-4ae979b3d998 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:25:55.782585 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-dda2c2b8-59ae-41da-bfa4-4ae979b3d998 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] [instance: 8514c797-946c-4349-9281-8f83ba15c8e2] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:25:55.790051 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dda2c2b8-59ae-41da-bfa4-4ae979b3d998 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:25:55.790549 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dda2c2b8-59ae-41da-bfa4-4ae979b3d998 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:25:55.790997 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dda2c2b8-59ae-41da-bfa4-4ae979b3d998 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:25:55.791703 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dda2c2b8-59ae-41da-bfa4-4ae979b3d998 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:25:55.792164 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dda2c2b8-59ae-41da-bfa4-4ae979b3d998 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:25:55.792598 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dda2c2b8-59ae-41da-bfa4-4ae979b3d998 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:25:55.823034 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-dda2c2b8-59ae-41da-bfa4-4ae979b3d998 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] 10.222.0.52 "GET /compute/v2.1/servers/8514c797-946c-4349-9281-8f83ba15c8e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048162 Oct 19 04:25:55.823618 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3681/7836] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Oct 19 04:25:55 2022] GET /compute/v2.1/servers/8514c797-946c-4349-9281-8f83ba15c8e2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:25:56.835524 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b6780b69-1ea5-4c40-b7c9-14c0b9613c2d tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:25:56.837728 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b6780b69-1ea5-4c40-b7c9-14c0b9613c2d tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] [instance: 8514c797-946c-4349-9281-8f83ba15c8e2] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:25:56.844517 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b6780b69-1ea5-4c40-b7c9-14c0b9613c2d tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:25:56.845011 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b6780b69-1ea5-4c40-b7c9-14c0b9613c2d tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:25:56.845486 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b6780b69-1ea5-4c40-b7c9-14c0b9613c2d tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:25:56.846187 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b6780b69-1ea5-4c40-b7c9-14c0b9613c2d tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:25:56.846650 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b6780b69-1ea5-4c40-b7c9-14c0b9613c2d tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:25:56.847088 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b6780b69-1ea5-4c40-b7c9-14c0b9613c2d tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:25:56.876230 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b6780b69-1ea5-4c40-b7c9-14c0b9613c2d tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] 10.222.0.52 "GET /compute/v2.1/servers/8514c797-946c-4349-9281-8f83ba15c8e2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044739 Oct 19 04:25:56.876945 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4156/7837] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Oct 19 04:25:56 2022] GET /compute/v2.1/servers/8514c797-946c-4349-9281-8f83ba15c8e2/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 04:25:56.887351 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f54b282e-1f93-429c-95f9-0adb010bd1d4 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:25:56.887892 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f54b282e-1f93-429c-95f9-0adb010bd1d4 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] [instance: 8514c797-946c-4349-9281-8f83ba15c8e2] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:25:56.894703 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f54b282e-1f93-429c-95f9-0adb010bd1d4 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:25:56.895196 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f54b282e-1f93-429c-95f9-0adb010bd1d4 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:25:56.895642 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f54b282e-1f93-429c-95f9-0adb010bd1d4 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:25:56.896343 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f54b282e-1f93-429c-95f9-0adb010bd1d4 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:25:56.896801 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f54b282e-1f93-429c-95f9-0adb010bd1d4 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:25:56.897236 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f54b282e-1f93-429c-95f9-0adb010bd1d4 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:25:56.971678 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-f54b282e-1f93-429c-95f9-0adb010bd1d4 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] HTTP exception thrown: Instance 8514c797-946c-4349-9281-8f83ba15c8e2 is not attached to volume 4ebfb970-69a4-42a7-b8ec-2e3860c8a35f Oct 19 04:25:56.978469 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f54b282e-1f93-429c-95f9-0adb010bd1d4 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Request method failure captured: Oct 19 04:25:56.978469 n-d-861333-8 devstack@n-api.service[121135]: request: DELETE /compute/v2.1/servers/8514c797-946c-4349-9281-8f83ba15c8e2/os-volume_attachments/4ebfb970-69a4-42a7-b8ec-2e3860c8a35f HTTP/1.1 Oct 19 04:25:56.978469 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 04:25:56.978469 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 04:25:56.978469 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 04:25:56.978469 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 04:25:56.978469 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 04:25:56.978469 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 04:25:56.978469 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 04:25:56.978469 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 04:25:56.978469 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT3wqdDgEMgqOfGYpo6UPsYZcytRnRNEpMS-DuFYGENN9V_1doRiaOtFv8ZT0wSClJ40kh1Yqz53GYAf0cdVMT9SDlEYk74QLchdmCrO9f6CgXoa9g1d4H8ZOMnPaRBBrxIY5BdprLz_aDJdf-AEFu-ThGLlzVHszbv67C-U8CHoGL6o Oct 19 04:25:56.978469 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 04:25:56.978469 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 04:25:56.978469 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 04:25:56.978469 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 04:25:56.978469 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 04:25:56.978469 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 04:25:56.978469 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 5f5a48cb267249749641e9e7b9b55102 Oct 19 04:25:56.978469 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-TestEncryptedCinderVolumes-383677399 Oct 19 04:25:56.978469 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 04:25:56.978469 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 04:25:56.978469 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5f5a48cb267249749641e9e7b9b55102"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5f5a48cb267249749641e9e7b9b55102"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5f5a48cb267249749641e9e7b9b55102"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5f5a48cb267249749641e9e7b9b55102", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 04:25:56.978469 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-TestEncryptedCinderVolumes-383677399 Oct 19 04:25:56.978469 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 5f5a48cb267249749641e9e7b9b55102 Oct 19 04:25:56.978469 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-383677399 Oct 19 04:25:56.978469 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-TestEncryptedCinderVolumes-383677399-project Oct 19 04:25:56.978469 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 04:25:56.978469 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 04:25:56.978469 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 48b2e87ad952416d814d03bfbb3c1ca1 Oct 19 04:25:56.978469 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-TestEncryptedCinderVolumes-383677399-project Oct 19 04:25:56.978469 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 04:25:56.978469 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance 8514c797-946c-4349-9281-8f83ba15c8e2 is not attached to volume 4ebfb970-69a4-42a7-b8ec-2e3860c8a35f Oct 19 04:25:56.978469 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'server_id': '8514c797-946c-4349-9281-8f83ba15c8e2', 'id': '4ebfb970-69a4-42a7-b8ec-2e3860c8a35f'} Oct 19 04:25:56.978469 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 04:25:56.978469 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:25:56.978469 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 19 04:25:56.978469 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 19 04:25:56.978469 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 04:25:56.978469 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 04:25:56.978469 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 19 04:25:56.978469 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 19 04:25:56.978469 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 4ebfb970-69a4-42a7-b8ec-2e3860c8a35f. Oct 19 04:25:56.978469 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:25:56.978469 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:25:56.978469 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:25:56.978469 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:25:56.978469 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:25:56.978469 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:25:56.978469 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 04:25:56.978469 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 04:25:56.978469 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 04:25:56.978469 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 04:25:56.978469 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 19 04:25:56.978469 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 19 04:25:56.978469 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8514c797-946c-4349-9281-8f83ba15c8e2 is not attached to volume 4ebfb970-69a4-42a7-b8ec-2e3860c8a35f Oct 19 04:25:56.978469 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:25:56.978469 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:25:56.978469 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:25:56.978469 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:25:56.978469 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:25:56.978469 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:25:56.984037 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 04:25:56.984037 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 04:25:56.984037 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8514c797-946c-4349-9281-8f83ba15c8e2 is not attached to volume 4ebfb970-69a4-42a7-b8ec-2e3860c8a35f Oct 19 04:25:56.984037 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:25:56.984037 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f54b282e-1f93-429c-95f9-0adb010bd1d4 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Returning 404 to user: Instance 8514c797-946c-4349-9281-8f83ba15c8e2 is not attached to volume 4ebfb970-69a4-42a7-b8ec-2e3860c8a35f {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 04:25:56.984037 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f54b282e-1f93-429c-95f9-0adb010bd1d4 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] 10.222.0.52 "DELETE /compute/v2.1/servers/8514c797-946c-4349-9281-8f83ba15c8e2/os-volume_attachments/4ebfb970-69a4-42a7-b8ec-2e3860c8a35f" status: 404 len: 154 microversion: 2.1 time: 0.096645 Oct 19 04:25:56.984037 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3682/7838] 10.222.0.52 () {58 vars in 1416 bytes} [Wed Oct 19 04:25:56 2022] DELETE /compute/v2.1/servers/8514c797-946c-4349-9281-8f83ba15c8e2/os-volume_attachments/4ebfb970-69a4-42a7-b8ec-2e3860c8a35f => generated 154 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 04:26:00.544297 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-87567b1e-90e7-4dab-a186-64b755ba918b tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:26:00.544824 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-87567b1e-90e7-4dab-a186-64b755ba918b tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] [instance: 8514c797-946c-4349-9281-8f83ba15c8e2] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:26:00.551705 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-87567b1e-90e7-4dab-a186-64b755ba918b tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:26:00.552214 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-87567b1e-90e7-4dab-a186-64b755ba918b tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:26:00.552694 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-87567b1e-90e7-4dab-a186-64b755ba918b tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:26:00.553428 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-87567b1e-90e7-4dab-a186-64b755ba918b tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:26:00.553907 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-87567b1e-90e7-4dab-a186-64b755ba918b tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:26:00.554354 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-87567b1e-90e7-4dab-a186-64b755ba918b tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:26:00.579788 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-87567b1e-90e7-4dab-a186-64b755ba918b tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] [instance: 8514c797-946c-4349-9281-8f83ba15c8e2] Going to try to terminate instance {{(pid=121134) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 04:26:00.857152 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-87567b1e-90e7-4dab-a186-64b755ba918b tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] 10.222.0.52 "DELETE /compute/v2.1/servers/8514c797-946c-4349-9281-8f83ba15c8e2" status: 204 len: 0 microversion: 2.1 time: 0.316588 Oct 19 04:26:00.858061 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4157/7839] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 04:26:00 2022] DELETE /compute/v2.1/servers/8514c797-946c-4349-9281-8f83ba15c8e2 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 04:26:00.866389 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-bf732232-ae1b-483c-90cf-027bf74ca4c4 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:26:00.867014 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-bf732232-ae1b-483c-90cf-027bf74ca4c4 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] [instance: 8514c797-946c-4349-9281-8f83ba15c8e2] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:26:00.873622 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bf732232-ae1b-483c-90cf-027bf74ca4c4 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:26:00.874119 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bf732232-ae1b-483c-90cf-027bf74ca4c4 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:26:00.874571 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bf732232-ae1b-483c-90cf-027bf74ca4c4 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:26:00.875275 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bf732232-ae1b-483c-90cf-027bf74ca4c4 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:26:00.875765 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bf732232-ae1b-483c-90cf-027bf74ca4c4 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:26:00.876193 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bf732232-ae1b-483c-90cf-027bf74ca4c4 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:26:01.017598 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-bf732232-ae1b-483c-90cf-027bf74ca4c4 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b2e87ad952416d814d03bfbb3c1ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5a48cb267249749641e9e7b9b55102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:26:01.025857 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-bf732232-ae1b-483c-90cf-027bf74ca4c4 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] 10.222.0.52 "GET /compute/v2.1/servers/8514c797-946c-4349-9281-8f83ba15c8e2" status: 200 len: 1561 microversion: 2.1 time: 0.163482 Oct 19 04:26:01.037427 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3683/7840] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:26:00 2022] GET /compute/v2.1/servers/8514c797-946c-4349-9281-8f83ba15c8e2 => generated 1561 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:26:02.050708 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-77459086-ca1f-4898-9061-6da8bf079e64 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:26:02.051362 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-77459086-ca1f-4898-9061-6da8bf079e64 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] [instance: 8514c797-946c-4349-9281-8f83ba15c8e2] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:26:02.058501 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-77459086-ca1f-4898-9061-6da8bf079e64 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:26:02.059005 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-77459086-ca1f-4898-9061-6da8bf079e64 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:26:02.059468 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-77459086-ca1f-4898-9061-6da8bf079e64 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:26:02.060184 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-77459086-ca1f-4898-9061-6da8bf079e64 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:26:02.060662 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-77459086-ca1f-4898-9061-6da8bf079e64 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:26:02.061117 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-77459086-ca1f-4898-9061-6da8bf079e64 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:26:02.208737 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-77459086-ca1f-4898-9061-6da8bf079e64 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b2e87ad952416d814d03bfbb3c1ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5a48cb267249749641e9e7b9b55102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:26:02.217899 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-77459086-ca1f-4898-9061-6da8bf079e64 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] 10.222.0.52 "GET /compute/v2.1/servers/8514c797-946c-4349-9281-8f83ba15c8e2" status: 200 len: 1561 microversion: 2.1 time: 0.171003 Oct 19 04:26:02.218485 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4158/7841] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:26:02 2022] GET /compute/v2.1/servers/8514c797-946c-4349-9281-8f83ba15c8e2 => generated 1561 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:26:03.084013 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-33b7bd4b-e7a1-47ac-aa42-d08edaf37cce req-dfabe881-88b6-4032-821c-b87c0cb2ed61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8514c797-946c-4349-9281-8f83ba15c8e2", "name": "network-vif-deleted", "tag": "b0946eb4-95b6-4e98-a651-918a3d9241c3"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:26:03.094401 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-33b7bd4b-e7a1-47ac-aa42-d08edaf37cce req-dfabe881-88b6-4032-821c-b87c0cb2ed61 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:26:03.094893 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-33b7bd4b-e7a1-47ac-aa42-d08edaf37cce req-dfabe881-88b6-4032-821c-b87c0cb2ed61 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:26:03.095335 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-33b7bd4b-e7a1-47ac-aa42-d08edaf37cce req-dfabe881-88b6-4032-821c-b87c0cb2ed61 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:26:03.106523 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-33b7bd4b-e7a1-47ac-aa42-d08edaf37cce req-dfabe881-88b6-4032-821c-b87c0cb2ed61 service nova] Creating event network-vif-deleted:b0946eb4-95b6-4e98-a651-918a3d9241c3 for instance 8514c797-946c-4349-9281-8f83ba15c8e2 on n-h2-861333-8 Oct 19 04:26:03.112037 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-33b7bd4b-e7a1-47ac-aa42-d08edaf37cce req-dfabe881-88b6-4032-821c-b87c0cb2ed61 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031792 Oct 19 04:26:03.112621 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3684/7842] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:26:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:26:03.243026 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ce094751-ae93-4e9b-aad8-83fce1c462ec tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:26:03.244290 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ce094751-ae93-4e9b-aad8-83fce1c462ec tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] [instance: 8514c797-946c-4349-9281-8f83ba15c8e2] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:26:03.251843 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ce094751-ae93-4e9b-aad8-83fce1c462ec tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:26:03.253897 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ce094751-ae93-4e9b-aad8-83fce1c462ec tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:26:03.253897 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ce094751-ae93-4e9b-aad8-83fce1c462ec tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:26:03.253897 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ce094751-ae93-4e9b-aad8-83fce1c462ec tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:26:03.254209 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ce094751-ae93-4e9b-aad8-83fce1c462ec tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:26:03.254782 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ce094751-ae93-4e9b-aad8-83fce1c462ec tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:26:03.318023 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ce094751-ae93-4e9b-aad8-83fce1c462ec tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b2e87ad952416d814d03bfbb3c1ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5a48cb267249749641e9e7b9b55102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:26:03.325991 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ce094751-ae93-4e9b-aad8-83fce1c462ec tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] 10.222.0.52 "GET /compute/v2.1/servers/8514c797-946c-4349-9281-8f83ba15c8e2" status: 200 len: 1348 microversion: 2.1 time: 0.088153 Oct 19 04:26:03.326625 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4159/7843] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:26:03 2022] GET /compute/v2.1/servers/8514c797-946c-4349-9281-8f83ba15c8e2 => generated 1348 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:26:04.351625 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-dd4ccee6-1136-41b2-8da8-b85071a1deea tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:26:04.352357 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-dd4ccee6-1136-41b2-8da8-b85071a1deea tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] [instance: 8514c797-946c-4349-9281-8f83ba15c8e2] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:26:04.358603 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dd4ccee6-1136-41b2-8da8-b85071a1deea tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:26:04.359106 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dd4ccee6-1136-41b2-8da8-b85071a1deea tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:26:04.359548 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dd4ccee6-1136-41b2-8da8-b85071a1deea tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:26:04.360236 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dd4ccee6-1136-41b2-8da8-b85071a1deea tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:26:04.360694 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dd4ccee6-1136-41b2-8da8-b85071a1deea tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:26:04.361118 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dd4ccee6-1136-41b2-8da8-b85071a1deea tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:26:04.374317 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-dd4ccee6-1136-41b2-8da8-b85071a1deea tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] HTTP exception thrown: Instance 8514c797-946c-4349-9281-8f83ba15c8e2 could not be found. Oct 19 04:26:04.375991 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-dd4ccee6-1136-41b2-8da8-b85071a1deea tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Request method failure captured: Oct 19 04:26:04.375991 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/8514c797-946c-4349-9281-8f83ba15c8e2 HTTP/1.1 Oct 19 04:26:04.375991 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 04:26:04.375991 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 04:26:04.375991 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 04:26:04.375991 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 04:26:04.375991 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 04:26:04.375991 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 04:26:04.375991 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 04:26:04.375991 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 04:26:04.375991 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT3wqdDgEMgqOfGYpo6UPsYZcytRnRNEpMS-DuFYGENN9V_1doRiaOtFv8ZT0wSClJ40kh1Yqz53GYAf0cdVMT9SDlEYk74QLchdmCrO9f6CgXoa9g1d4H8ZOMnPaRBBrxIY5BdprLz_aDJdf-AEFu-ThGLlzVHszbv67C-U8CHoGL6o Oct 19 04:26:04.375991 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 04:26:04.375991 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 04:26:04.375991 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 04:26:04.375991 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 04:26:04.375991 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 04:26:04.375991 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 04:26:04.375991 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 5f5a48cb267249749641e9e7b9b55102 Oct 19 04:26:04.375991 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-TestEncryptedCinderVolumes-383677399 Oct 19 04:26:04.375991 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 04:26:04.375991 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 04:26:04.375991 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5f5a48cb267249749641e9e7b9b55102"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5f5a48cb267249749641e9e7b9b55102"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5f5a48cb267249749641e9e7b9b55102"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5f5a48cb267249749641e9e7b9b55102", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 04:26:04.375991 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-TestEncryptedCinderVolumes-383677399 Oct 19 04:26:04.375991 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 5f5a48cb267249749641e9e7b9b55102 Oct 19 04:26:04.375991 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-383677399 Oct 19 04:26:04.375991 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-TestEncryptedCinderVolumes-383677399-project Oct 19 04:26:04.375991 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 04:26:04.375991 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 04:26:04.375991 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 48b2e87ad952416d814d03bfbb3c1ca1 Oct 19 04:26:04.375991 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-TestEncryptedCinderVolumes-383677399-project Oct 19 04:26:04.375991 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 04:26:04.375991 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance 8514c797-946c-4349-9281-8f83ba15c8e2 could not be found. Oct 19 04:26:04.375991 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '8514c797-946c-4349-9281-8f83ba15c8e2'} Oct 19 04:26:04.375991 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 04:26:04.375991 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:26:04.375991 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 04:26:04.375991 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 04:26:04.375991 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 04:26:04.375991 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 04:26:04.375991 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 04:26:04.375991 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 04:26:04.375991 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 04:26:04.375991 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 04:26:04.375991 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8514c797-946c-4349-9281-8f83ba15c8e2 could not be found. Oct 19 04:26:04.375991 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:26:04.375991 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:26:04.375991 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:26:04.375991 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:26:04.375991 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:26:04.375991 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:26:04.375991 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 04:26:04.375991 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 04:26:04.375991 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 04:26:04.375991 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 04:26:04.375991 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 04:26:04.375991 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 04:26:04.375991 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 04:26:04.375991 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 04:26:04.375991 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 04:26:04.375991 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 04:26:04.375991 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8514c797-946c-4349-9281-8f83ba15c8e2 could not be found. Oct 19 04:26:04.375991 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:26:04.375991 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:26:04.375991 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:26:04.380667 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:26:04.380667 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:26:04.380667 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:26:04.380667 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 04:26:04.380667 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 04:26:04.380667 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8514c797-946c-4349-9281-8f83ba15c8e2 could not be found. Oct 19 04:26:04.380667 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:26:04.380667 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-dd4ccee6-1136-41b2-8da8-b85071a1deea tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Returning 404 to user: Instance 8514c797-946c-4349-9281-8f83ba15c8e2 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 04:26:04.380667 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-dd4ccee6-1136-41b2-8da8-b85071a1deea tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] 10.222.0.52 "GET /compute/v2.1/servers/8514c797-946c-4349-9281-8f83ba15c8e2" status: 404 len: 111 microversion: 2.1 time: 0.031001 Oct 19 04:26:04.380667 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3685/7844] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:26:04 2022] GET /compute/v2.1/servers/8514c797-946c-4349-9281-8f83ba15c8e2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 04:26:04.386262 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-bd311f71-d294-489a-b58b-f50b8f7aa6fd tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Calling method '.version_select at 0x7fc131057820>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:26:04.471655 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-bd311f71-d294-489a-b58b-f50b8f7aa6fd tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-2025588255" status: 202 len: 0 microversion: 2.1 time: 0.089182 Oct 19 04:26:04.472238 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4160/7845] 10.222.0.52 () {58 vars in 1278 bytes} [Wed Oct 19 04:26:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-2025588255 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 19 04:26:04.489897 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-16431faf-7065-40de-a596-6b6339c2583f tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Action: 'create', calling method: .version_select at 0x7fc130c669d0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-358099171", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDV6BKmHOKvDtBgDrk8YawPkXLmKtMNr5THplHHiHI0CQkWbsmmQR1tew2OK7XdpapICBybl5ntsLAmoLbcWRQinh49Gn6yj2EB+lO2bCcnripnn98i+3gTDVINN7DQJIw=="}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:26:04.505063 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-16431faf-7065-40de-a596-6b6339c2583f tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Getting quotas for project 5f5a48cb267249749641e9e7b9b55102. Resources: {'key_pairs'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 04:26:04.510205 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-16431faf-7065-40de-a596-6b6339c2583f tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Getting quotas for user 48b2e87ad952416d814d03bfbb3c1ca1 and project 5f5a48cb267249749641e9e7b9b55102. Resources: {'key_pairs'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 04:26:04.578259 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-16431faf-7065-40de-a596-6b6339c2583f tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.092247 Oct 19 04:26:04.578847 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3686/7846] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Oct 19 04:26:04 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:26:04.628044 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8c74a7ea-32b3-4dc6-b45c-d67acc38fc0e tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1178418303", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-358099171", "networks": [{"uuid": "10995fe6-305c-4382-ad76-58b7897e9c0b"}]}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:26:04.681325 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-8c74a7ea-32b3-4dc6-b45c-d67acc38fc0e tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] validate_networks() for [('10995fe6-305c-4382-ad76-58b7897e9c0b', None, None, None, None, None)] {{(pid=121134) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 04:26:05.048213 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-8c74a7ea-32b3-4dc6-b45c-d67acc38fc0e tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Flavor limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 04:26:05.048687 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-8c74a7ea-32b3-4dc6-b45c-d67acc38fc0e tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Image limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 04:26:05.049209 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-8c74a7ea-32b3-4dc6-b45c-d67acc38fc0e tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Flavor pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 04:26:05.049696 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-8c74a7ea-32b3-4dc6-b45c-d67acc38fc0e tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Image pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 04:26:05.050133 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-8c74a7ea-32b3-4dc6-b45c-d67acc38fc0e tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 04:26:05.059095 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8c74a7ea-32b3-4dc6-b45c-d67acc38fc0e tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:26:05.059598 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8c74a7ea-32b3-4dc6-b45c-d67acc38fc0e tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:26:05.060056 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8c74a7ea-32b3-4dc6-b45c-d67acc38fc0e tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:26:05.060803 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8c74a7ea-32b3-4dc6-b45c-d67acc38fc0e tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:26:05.061907 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8c74a7ea-32b3-4dc6-b45c-d67acc38fc0e tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:26:05.062377 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8c74a7ea-32b3-4dc6-b45c-d67acc38fc0e tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:26:05.079550 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-8c74a7ea-32b3-4dc6-b45c-d67acc38fc0e tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Getting quotas for project 5f5a48cb267249749641e9e7b9b55102. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 04:26:05.084783 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-8c74a7ea-32b3-4dc6-b45c-d67acc38fc0e tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Getting quotas for user 48b2e87ad952416d814d03bfbb3c1ca1 and project 5f5a48cb267249749641e9e7b9b55102. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 04:26:05.097210 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8c74a7ea-32b3-4dc6-b45c-d67acc38fc0e tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Going to run 1 instances... {{(pid=121134) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 04:26:05.099568 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8c74a7ea-32b3-4dc6-b45c-d67acc38fc0e tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] [instance: ae4697e1-ee7f-4538-a6c8-d557908af09b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 04:26:05.201619 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8c74a7ea-32b3-4dc6-b45c-d67acc38fc0e tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.577376 Oct 19 04:26:05.202286 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4161/7847] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 04:26:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 579 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 04:26:05.213509 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-21adaefb-96b1-4514-9372-b9eb6fc44901 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:26:05.214068 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-21adaefb-96b1-4514-9372-b9eb6fc44901 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] [instance: ae4697e1-ee7f-4538-a6c8-d557908af09b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:26:05.274410 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-21adaefb-96b1-4514-9372-b9eb6fc44901 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b2e87ad952416d814d03bfbb3c1ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5a48cb267249749641e9e7b9b55102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:26:05.281924 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-21adaefb-96b1-4514-9372-b9eb6fc44901 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] 10.222.0.52 "GET /compute/v2.1/servers/ae4697e1-ee7f-4538-a6c8-d557908af09b" status: 200 len: 1262 microversion: 2.1 time: 0.072400 Oct 19 04:26:05.282577 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3687/7848] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:26:05 2022] GET /compute/v2.1/servers/ae4697e1-ee7f-4538-a6c8-d557908af09b => generated 1262 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:26:06.305810 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5057153c-d16e-47f8-b8c3-a039a3ac5256 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:26:06.306470 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5057153c-d16e-47f8-b8c3-a039a3ac5256 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] [instance: ae4697e1-ee7f-4538-a6c8-d557908af09b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:26:06.313164 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5057153c-d16e-47f8-b8c3-a039a3ac5256 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:26:06.313865 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5057153c-d16e-47f8-b8c3-a039a3ac5256 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:26:06.314126 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5057153c-d16e-47f8-b8c3-a039a3ac5256 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:26:06.314830 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5057153c-d16e-47f8-b8c3-a039a3ac5256 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:26:06.315299 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5057153c-d16e-47f8-b8c3-a039a3ac5256 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:26:06.315745 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5057153c-d16e-47f8-b8c3-a039a3ac5256 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:26:06.382418 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5057153c-d16e-47f8-b8c3-a039a3ac5256 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b2e87ad952416d814d03bfbb3c1ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5a48cb267249749641e9e7b9b55102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:26:06.385817 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5057153c-d16e-47f8-b8c3-a039a3ac5256 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] 10.222.0.52 "GET /compute/v2.1/servers/ae4697e1-ee7f-4538-a6c8-d557908af09b" status: 200 len: 1266 microversion: 2.1 time: 0.084810 Oct 19 04:26:06.386401 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4162/7849] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:26:06 2022] GET /compute/v2.1/servers/ae4697e1-ee7f-4538-a6c8-d557908af09b => generated 1266 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:26:07.408749 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-cadbfd1e-91f1-45ed-ae91-c630217568aa tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:26:07.410013 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-cadbfd1e-91f1-45ed-ae91-c630217568aa tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] [instance: ae4697e1-ee7f-4538-a6c8-d557908af09b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:26:07.417114 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cadbfd1e-91f1-45ed-ae91-c630217568aa tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:26:07.417717 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cadbfd1e-91f1-45ed-ae91-c630217568aa tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:26:07.418204 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cadbfd1e-91f1-45ed-ae91-c630217568aa tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:26:07.419126 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cadbfd1e-91f1-45ed-ae91-c630217568aa tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:26:07.419595 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cadbfd1e-91f1-45ed-ae91-c630217568aa tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:26:07.420033 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cadbfd1e-91f1-45ed-ae91-c630217568aa tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:26:07.491526 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-cadbfd1e-91f1-45ed-ae91-c630217568aa tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b2e87ad952416d814d03bfbb3c1ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5a48cb267249749641e9e7b9b55102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:26:07.500106 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-cadbfd1e-91f1-45ed-ae91-c630217568aa tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] 10.222.0.52 "GET /compute/v2.1/servers/ae4697e1-ee7f-4538-a6c8-d557908af09b" status: 200 len: 1322 microversion: 2.1 time: 0.095330 Oct 19 04:26:07.500873 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3688/7850] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:26:07 2022] GET /compute/v2.1/servers/ae4697e1-ee7f-4538-a6c8-d557908af09b => generated 1322 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:26:08.523759 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2ebae078-244f-4443-87ef-9a4268601e5f tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:26:08.524429 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2ebae078-244f-4443-87ef-9a4268601e5f tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] [instance: ae4697e1-ee7f-4538-a6c8-d557908af09b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:26:08.531692 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2ebae078-244f-4443-87ef-9a4268601e5f tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:26:08.532201 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2ebae078-244f-4443-87ef-9a4268601e5f tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:26:08.532662 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2ebae078-244f-4443-87ef-9a4268601e5f tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:26:08.533403 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2ebae078-244f-4443-87ef-9a4268601e5f tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:26:08.533885 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2ebae078-244f-4443-87ef-9a4268601e5f tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:26:08.534333 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2ebae078-244f-4443-87ef-9a4268601e5f tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:26:08.678087 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-2ebae078-244f-4443-87ef-9a4268601e5f tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b2e87ad952416d814d03bfbb3c1ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5a48cb267249749641e9e7b9b55102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:26:08.687079 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2ebae078-244f-4443-87ef-9a4268601e5f tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] 10.222.0.52 "GET /compute/v2.1/servers/ae4697e1-ee7f-4538-a6c8-d557908af09b" status: 200 len: 1362 microversion: 2.1 time: 0.166853 Oct 19 04:26:08.687861 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4163/7851] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:26:08 2022] GET /compute/v2.1/servers/ae4697e1-ee7f-4538-a6c8-d557908af09b => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:26:09.016642 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-30d46b3d-cab1-4fac-b069-df0fce24b8e5 req-cfbc07ab-7981-4a7a-8d04-6f030a855eb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae4697e1-ee7f-4538-a6c8-d557908af09b", "tag": "66e5f0fd-6d01-41b5-a4a7-1299a23a01b6"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:26:09.027825 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-30d46b3d-cab1-4fac-b069-df0fce24b8e5 req-cfbc07ab-7981-4a7a-8d04-6f030a855eb0 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:26:09.028316 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-30d46b3d-cab1-4fac-b069-df0fce24b8e5 req-cfbc07ab-7981-4a7a-8d04-6f030a855eb0 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:26:09.028759 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-30d46b3d-cab1-4fac-b069-df0fce24b8e5 req-cfbc07ab-7981-4a7a-8d04-6f030a855eb0 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:26:09.040146 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-30d46b3d-cab1-4fac-b069-df0fce24b8e5 req-cfbc07ab-7981-4a7a-8d04-6f030a855eb0 service nova] Creating event network-changed:66e5f0fd-6d01-41b5-a4a7-1299a23a01b6 for instance ae4697e1-ee7f-4538-a6c8-d557908af09b on n-h2-861333-8 Oct 19 04:26:09.046596 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-30d46b3d-cab1-4fac-b069-df0fce24b8e5 req-cfbc07ab-7981-4a7a-8d04-6f030a855eb0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032987 Oct 19 04:26:09.047321 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3689/7852] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:26:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:26:09.711047 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c31e1c60-4cdf-44de-8337-0739401dd4ee tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:26:09.711669 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c31e1c60-4cdf-44de-8337-0739401dd4ee tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] [instance: ae4697e1-ee7f-4538-a6c8-d557908af09b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:26:09.719013 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c31e1c60-4cdf-44de-8337-0739401dd4ee tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:26:09.719510 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c31e1c60-4cdf-44de-8337-0739401dd4ee tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:26:09.719961 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c31e1c60-4cdf-44de-8337-0739401dd4ee tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:26:09.720666 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c31e1c60-4cdf-44de-8337-0739401dd4ee tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:26:09.721134 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c31e1c60-4cdf-44de-8337-0739401dd4ee tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:26:09.721666 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c31e1c60-4cdf-44de-8337-0739401dd4ee tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:26:09.851474 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c31e1c60-4cdf-44de-8337-0739401dd4ee tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b2e87ad952416d814d03bfbb3c1ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5a48cb267249749641e9e7b9b55102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:26:09.859556 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c31e1c60-4cdf-44de-8337-0739401dd4ee tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] 10.222.0.52 "GET /compute/v2.1/servers/ae4697e1-ee7f-4538-a6c8-d557908af09b" status: 200 len: 1362 microversion: 2.1 time: 0.152501 Oct 19 04:26:09.860218 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4164/7853] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:26:09 2022] GET /compute/v2.1/servers/ae4697e1-ee7f-4538-a6c8-d557908af09b => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:26:10.883527 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-63dcc539-43e2-4aac-844e-0806b2d4aee8 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:26:10.884238 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-63dcc539-43e2-4aac-844e-0806b2d4aee8 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] [instance: ae4697e1-ee7f-4538-a6c8-d557908af09b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:26:10.891560 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-63dcc539-43e2-4aac-844e-0806b2d4aee8 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:26:10.892050 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-63dcc539-43e2-4aac-844e-0806b2d4aee8 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:26:10.892494 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-63dcc539-43e2-4aac-844e-0806b2d4aee8 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:26:10.893189 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-63dcc539-43e2-4aac-844e-0806b2d4aee8 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:26:10.893687 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-63dcc539-43e2-4aac-844e-0806b2d4aee8 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:26:10.894117 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-63dcc539-43e2-4aac-844e-0806b2d4aee8 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:26:11.025636 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-63dcc539-43e2-4aac-844e-0806b2d4aee8 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b2e87ad952416d814d03bfbb3c1ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5a48cb267249749641e9e7b9b55102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:26:11.033799 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-63dcc539-43e2-4aac-844e-0806b2d4aee8 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] 10.222.0.52 "GET /compute/v2.1/servers/ae4697e1-ee7f-4538-a6c8-d557908af09b" status: 200 len: 1362 microversion: 2.1 time: 0.154711 Oct 19 04:26:11.034378 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3690/7854] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:26:10 2022] GET /compute/v2.1/servers/ae4697e1-ee7f-4538-a6c8-d557908af09b => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:26:12.057468 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-742df240-f29c-4d97-9aa3-e8e4f237918a tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:26:12.058021 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-742df240-f29c-4d97-9aa3-e8e4f237918a tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] [instance: ae4697e1-ee7f-4538-a6c8-d557908af09b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:26:12.064971 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-742df240-f29c-4d97-9aa3-e8e4f237918a tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:26:12.065505 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-742df240-f29c-4d97-9aa3-e8e4f237918a tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:26:12.065966 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-742df240-f29c-4d97-9aa3-e8e4f237918a tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:26:12.066713 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-742df240-f29c-4d97-9aa3-e8e4f237918a tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:26:12.067188 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-742df240-f29c-4d97-9aa3-e8e4f237918a tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:26:12.067637 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-742df240-f29c-4d97-9aa3-e8e4f237918a tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:26:12.199417 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-742df240-f29c-4d97-9aa3-e8e4f237918a tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b2e87ad952416d814d03bfbb3c1ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5a48cb267249749641e9e7b9b55102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:26:12.207818 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-742df240-f29c-4d97-9aa3-e8e4f237918a tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] 10.222.0.52 "GET /compute/v2.1/servers/ae4697e1-ee7f-4538-a6c8-d557908af09b" status: 200 len: 1362 microversion: 2.1 time: 0.154356 Oct 19 04:26:12.208399 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4165/7855] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:26:12 2022] GET /compute/v2.1/servers/ae4697e1-ee7f-4538-a6c8-d557908af09b => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:26:13.230560 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d89bde44-b4ff-4416-a300-2985278f3fb2 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:26:13.231185 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d89bde44-b4ff-4416-a300-2985278f3fb2 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] [instance: ae4697e1-ee7f-4538-a6c8-d557908af09b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:26:13.239144 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d89bde44-b4ff-4416-a300-2985278f3fb2 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:26:13.239641 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d89bde44-b4ff-4416-a300-2985278f3fb2 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:26:13.240087 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d89bde44-b4ff-4416-a300-2985278f3fb2 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:26:13.240794 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d89bde44-b4ff-4416-a300-2985278f3fb2 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:26:13.241256 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d89bde44-b4ff-4416-a300-2985278f3fb2 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:26:13.241717 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d89bde44-b4ff-4416-a300-2985278f3fb2 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:26:13.371971 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d89bde44-b4ff-4416-a300-2985278f3fb2 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b2e87ad952416d814d03bfbb3c1ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5a48cb267249749641e9e7b9b55102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:26:13.379884 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d89bde44-b4ff-4416-a300-2985278f3fb2 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] 10.222.0.52 "GET /compute/v2.1/servers/ae4697e1-ee7f-4538-a6c8-d557908af09b" status: 200 len: 1362 microversion: 2.1 time: 0.153481 Oct 19 04:26:13.380473 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3691/7856] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:26:13 2022] GET /compute/v2.1/servers/ae4697e1-ee7f-4538-a6c8-d557908af09b => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:26:14.403389 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b0cefe53-6010-4ff1-8b2a-c1919d71ee50 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:26:14.404039 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b0cefe53-6010-4ff1-8b2a-c1919d71ee50 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] [instance: ae4697e1-ee7f-4538-a6c8-d557908af09b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:26:14.411636 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b0cefe53-6010-4ff1-8b2a-c1919d71ee50 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:26:14.412139 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b0cefe53-6010-4ff1-8b2a-c1919d71ee50 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:26:14.412596 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b0cefe53-6010-4ff1-8b2a-c1919d71ee50 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:26:14.413313 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b0cefe53-6010-4ff1-8b2a-c1919d71ee50 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:26:14.413816 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b0cefe53-6010-4ff1-8b2a-c1919d71ee50 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:26:14.414266 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b0cefe53-6010-4ff1-8b2a-c1919d71ee50 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:26:14.542720 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b0cefe53-6010-4ff1-8b2a-c1919d71ee50 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b2e87ad952416d814d03bfbb3c1ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5a48cb267249749641e9e7b9b55102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:26:14.550438 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b0cefe53-6010-4ff1-8b2a-c1919d71ee50 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] 10.222.0.52 "GET /compute/v2.1/servers/ae4697e1-ee7f-4538-a6c8-d557908af09b" status: 200 len: 1362 microversion: 2.1 time: 0.151220 Oct 19 04:26:14.551017 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4166/7857] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:26:14 2022] GET /compute/v2.1/servers/ae4697e1-ee7f-4538-a6c8-d557908af09b => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:26:15.050478 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-9bfc16e9-d62a-411a-abde-467e8efbc468 req-cbe471da-390d-427e-b1f7-b8ca95014378 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae4697e1-ee7f-4538-a6c8-d557908af09b", "name": "network-vif-plugged", "status": "completed", "tag": "66e5f0fd-6d01-41b5-a4a7-1299a23a01b6"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:26:15.060903 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-9bfc16e9-d62a-411a-abde-467e8efbc468 req-cbe471da-390d-427e-b1f7-b8ca95014378 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:26:15.063650 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-9bfc16e9-d62a-411a-abde-467e8efbc468 req-cbe471da-390d-427e-b1f7-b8ca95014378 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:26:15.063650 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-9bfc16e9-d62a-411a-abde-467e8efbc468 req-cbe471da-390d-427e-b1f7-b8ca95014378 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:26:15.073612 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-9bfc16e9-d62a-411a-abde-467e8efbc468 req-cbe471da-390d-427e-b1f7-b8ca95014378 service nova] Creating event network-vif-plugged:66e5f0fd-6d01-41b5-a4a7-1299a23a01b6 for instance ae4697e1-ee7f-4538-a6c8-d557908af09b on n-h2-861333-8 Oct 19 04:26:15.078898 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-9bfc16e9-d62a-411a-abde-467e8efbc468 req-cbe471da-390d-427e-b1f7-b8ca95014378 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032247 Oct 19 04:26:15.079580 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3692/7858] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:26:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:26:15.574169 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-939235cb-1268-48e3-9707-fd4b9db2bec0 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:26:15.574726 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-939235cb-1268-48e3-9707-fd4b9db2bec0 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] [instance: ae4697e1-ee7f-4538-a6c8-d557908af09b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:26:15.577201 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:26:15.577937 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=6 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:26:15.583547 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-939235cb-1268-48e3-9707-fd4b9db2bec0 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:26:15.584055 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-939235cb-1268-48e3-9707-fd4b9db2bec0 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:26:15.584510 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-939235cb-1268-48e3-9707-fd4b9db2bec0 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:26:15.585215 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-939235cb-1268-48e3-9707-fd4b9db2bec0 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:26:15.585713 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-939235cb-1268-48e3-9707-fd4b9db2bec0 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:26:15.589305 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-939235cb-1268-48e3-9707-fd4b9db2bec0 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:26:15.714272 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-939235cb-1268-48e3-9707-fd4b9db2bec0 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b2e87ad952416d814d03bfbb3c1ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5a48cb267249749641e9e7b9b55102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:26:15.722423 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-939235cb-1268-48e3-9707-fd4b9db2bec0 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] 10.222.0.52 "GET /compute/v2.1/servers/ae4697e1-ee7f-4538-a6c8-d557908af09b" status: 200 len: 1362 microversion: 2.1 time: 0.152339 Oct 19 04:26:15.722994 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4167/7859] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:26:15 2022] GET /compute/v2.1/servers/ae4697e1-ee7f-4538-a6c8-d557908af09b => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:26:16.745507 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5bb70816-f295-4ed2-9635-d85eb7f99a11 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:26:16.746237 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-5bb70816-f295-4ed2-9635-d85eb7f99a11 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] [instance: ae4697e1-ee7f-4538-a6c8-d557908af09b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:26:16.748179 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=6 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:26:16.754005 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5bb70816-f295-4ed2-9635-d85eb7f99a11 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:26:16.754487 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5bb70816-f295-4ed2-9635-d85eb7f99a11 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:26:16.754925 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5bb70816-f295-4ed2-9635-d85eb7f99a11 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:26:16.755610 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5bb70816-f295-4ed2-9635-d85eb7f99a11 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:26:16.756063 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5bb70816-f295-4ed2-9635-d85eb7f99a11 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:26:16.756489 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5bb70816-f295-4ed2-9635-d85eb7f99a11 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:26:16.886276 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-5bb70816-f295-4ed2-9635-d85eb7f99a11 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b2e87ad952416d814d03bfbb3c1ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5a48cb267249749641e9e7b9b55102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:26:16.893958 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5bb70816-f295-4ed2-9635-d85eb7f99a11 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] 10.222.0.52 "GET /compute/v2.1/servers/ae4697e1-ee7f-4538-a6c8-d557908af09b" status: 200 len: 1553 microversion: 2.1 time: 0.152712 Oct 19 04:26:16.894531 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3693/7860] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:26:16 2022] GET /compute/v2.1/servers/ae4697e1-ee7f-4538-a6c8-d557908af09b => generated 1553 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:26:16.916597 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-26d1546c-1bfd-49e4-885c-baa7fb380c10 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:26:16.917223 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-26d1546c-1bfd-49e4-885c-baa7fb380c10 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] [instance: ae4697e1-ee7f-4538-a6c8-d557908af09b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:26:16.925174 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-26d1546c-1bfd-49e4-885c-baa7fb380c10 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:26:16.925740 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-26d1546c-1bfd-49e4-885c-baa7fb380c10 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:26:16.926202 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-26d1546c-1bfd-49e4-885c-baa7fb380c10 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:26:16.926923 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-26d1546c-1bfd-49e4-885c-baa7fb380c10 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:26:16.927396 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-26d1546c-1bfd-49e4-885c-baa7fb380c10 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:26:16.927843 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-26d1546c-1bfd-49e4-885c-baa7fb380c10 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:26:17.054476 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-26d1546c-1bfd-49e4-885c-baa7fb380c10 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b2e87ad952416d814d03bfbb3c1ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5a48cb267249749641e9e7b9b55102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:26:17.057950 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:26:17.062568 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-26d1546c-1bfd-49e4-885c-baa7fb380c10 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] 10.222.0.52 "GET /compute/v2.1/servers/ae4697e1-ee7f-4538-a6c8-d557908af09b" status: 200 len: 1553 microversion: 2.1 time: 0.149983 Oct 19 04:26:17.063149 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4168/7861] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:26:16 2022] GET /compute/v2.1/servers/ae4697e1-ee7f-4538-a6c8-d557908af09b => generated 1553 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:26:20.046993 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-138c969d-5a8c-4644-9c73-7974649ce28f tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "806dfe3c-ebdd-47e1-9315-3faa02c9a01a"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:26:20.049358 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-138c969d-5a8c-4644-9c73-7974649ce28f tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] [instance: ae4697e1-ee7f-4538-a6c8-d557908af09b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:26:20.056192 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-138c969d-5a8c-4644-9c73-7974649ce28f tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:26:20.063375 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-138c969d-5a8c-4644-9c73-7974649ce28f tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:26:20.063375 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-138c969d-5a8c-4644-9c73-7974649ce28f tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:26:20.063375 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-138c969d-5a8c-4644-9c73-7974649ce28f tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:26:20.063375 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-138c969d-5a8c-4644-9c73-7974649ce28f tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:26:20.063375 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-138c969d-5a8c-4644-9c73-7974649ce28f tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:26:20.780477 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-138c969d-5a8c-4644-9c73-7974649ce28f tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] 10.222.0.52 "POST /compute/v2.1/servers/ae4697e1-ee7f-4538-a6c8-d557908af09b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.737902 Oct 19 04:26:20.781094 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3694/7862] 10.222.0.52 () {60 vars in 1323 bytes} [Wed Oct 19 04:26:20 2022] POST /compute/v2.1/servers/ae4697e1-ee7f-4538-a6c8-d557908af09b/os-volume_attachments => generated 194 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:26:32.548593 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a4ddd664-7a9c-4786-be39-23dfbf66f31c tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:26:32.549125 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a4ddd664-7a9c-4786-be39-23dfbf66f31c tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] [instance: ae4697e1-ee7f-4538-a6c8-d557908af09b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:26:32.551827 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:26:32.557014 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a4ddd664-7a9c-4786-be39-23dfbf66f31c tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:26:32.562912 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a4ddd664-7a9c-4786-be39-23dfbf66f31c tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:26:32.562912 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a4ddd664-7a9c-4786-be39-23dfbf66f31c tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:26:32.562912 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a4ddd664-7a9c-4786-be39-23dfbf66f31c tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:26:32.562912 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a4ddd664-7a9c-4786-be39-23dfbf66f31c tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:26:32.562912 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a4ddd664-7a9c-4786-be39-23dfbf66f31c tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:26:32.643292 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-a4ddd664-7a9c-4786-be39-23dfbf66f31c tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lazy-loading 'services' on Instance uuid ae4697e1-ee7f-4538-a6c8-d557908af09b {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 04:26:32.828703 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a4ddd664-7a9c-4786-be39-23dfbf66f31c tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ae4697e1-ee7f-4538-a6c8-d557908af09b/os-volume_attachments/806dfe3c-ebdd-47e1-9315-3faa02c9a01a" status: 202 len: 0 microversion: 2.1 time: 0.283936 Oct 19 04:26:32.829289 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4169/7863] 10.222.0.52 () {58 vars in 1416 bytes} [Wed Oct 19 04:26:32 2022] DELETE /compute/v2.1/servers/ae4697e1-ee7f-4538-a6c8-d557908af09b/os-volume_attachments/806dfe3c-ebdd-47e1-9315-3faa02c9a01a => generated 0 bytes in 285 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 04:26:32.837187 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:26:32.838009 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:26:32.842244 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0ecc210d-6ccf-4788-98c7-8a6414d7fd19 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:26:32.844639 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0ecc210d-6ccf-4788-98c7-8a6414d7fd19 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] [instance: ae4697e1-ee7f-4538-a6c8-d557908af09b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:26:32.851686 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0ecc210d-6ccf-4788-98c7-8a6414d7fd19 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:26:32.852183 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0ecc210d-6ccf-4788-98c7-8a6414d7fd19 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:26:32.852630 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0ecc210d-6ccf-4788-98c7-8a6414d7fd19 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:26:32.853335 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0ecc210d-6ccf-4788-98c7-8a6414d7fd19 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:26:32.853825 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0ecc210d-6ccf-4788-98c7-8a6414d7fd19 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:26:32.854271 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0ecc210d-6ccf-4788-98c7-8a6414d7fd19 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:26:32.884774 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0ecc210d-6ccf-4788-98c7-8a6414d7fd19 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] 10.222.0.52 "GET /compute/v2.1/servers/ae4697e1-ee7f-4538-a6c8-d557908af09b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050946 Oct 19 04:26:32.885338 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3695/7864] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Oct 19 04:26:32 2022] GET /compute/v2.1/servers/ae4697e1-ee7f-4538-a6c8-d557908af09b/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:26:33.899833 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9c412998-ae3e-4a0d-a736-3180d9d322c7 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:26:33.902474 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9c412998-ae3e-4a0d-a736-3180d9d322c7 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] [instance: ae4697e1-ee7f-4538-a6c8-d557908af09b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:26:33.909746 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9c412998-ae3e-4a0d-a736-3180d9d322c7 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:26:33.910240 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9c412998-ae3e-4a0d-a736-3180d9d322c7 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:26:33.910714 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9c412998-ae3e-4a0d-a736-3180d9d322c7 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:26:33.911429 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9c412998-ae3e-4a0d-a736-3180d9d322c7 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:26:33.911887 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9c412998-ae3e-4a0d-a736-3180d9d322c7 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:26:33.912327 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9c412998-ae3e-4a0d-a736-3180d9d322c7 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:26:33.942494 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9c412998-ae3e-4a0d-a736-3180d9d322c7 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] 10.222.0.52 "GET /compute/v2.1/servers/ae4697e1-ee7f-4538-a6c8-d557908af09b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048427 Oct 19 04:26:33.943060 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4170/7865] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Oct 19 04:26:33 2022] GET /compute/v2.1/servers/ae4697e1-ee7f-4538-a6c8-d557908af09b/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:26:34.955912 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3ab707d3-4918-4176-b7ef-b9dd8cb665b6 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:26:34.958224 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-3ab707d3-4918-4176-b7ef-b9dd8cb665b6 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] [instance: ae4697e1-ee7f-4538-a6c8-d557908af09b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:26:34.966397 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3ab707d3-4918-4176-b7ef-b9dd8cb665b6 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:26:34.966885 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3ab707d3-4918-4176-b7ef-b9dd8cb665b6 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:26:34.967327 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3ab707d3-4918-4176-b7ef-b9dd8cb665b6 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:26:34.968022 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3ab707d3-4918-4176-b7ef-b9dd8cb665b6 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:26:34.968476 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3ab707d3-4918-4176-b7ef-b9dd8cb665b6 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:26:34.968909 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3ab707d3-4918-4176-b7ef-b9dd8cb665b6 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:26:35.003324 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-3ab707d3-4918-4176-b7ef-b9dd8cb665b6 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] 10.222.0.52 "GET /compute/v2.1/servers/ae4697e1-ee7f-4538-a6c8-d557908af09b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051980 Oct 19 04:26:35.003931 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3696/7866] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Oct 19 04:26:34 2022] GET /compute/v2.1/servers/ae4697e1-ee7f-4538-a6c8-d557908af09b/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:26:36.016238 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7b71fc50-da07-4a1b-8996-17310f470dc6 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:26:36.018437 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7b71fc50-da07-4a1b-8996-17310f470dc6 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] [instance: ae4697e1-ee7f-4538-a6c8-d557908af09b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:26:36.025762 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7b71fc50-da07-4a1b-8996-17310f470dc6 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:26:36.026269 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7b71fc50-da07-4a1b-8996-17310f470dc6 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:26:36.026728 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7b71fc50-da07-4a1b-8996-17310f470dc6 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:26:36.027700 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7b71fc50-da07-4a1b-8996-17310f470dc6 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:26:36.028172 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7b71fc50-da07-4a1b-8996-17310f470dc6 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:26:36.028620 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7b71fc50-da07-4a1b-8996-17310f470dc6 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:26:36.059826 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7b71fc50-da07-4a1b-8996-17310f470dc6 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] 10.222.0.52 "GET /compute/v2.1/servers/ae4697e1-ee7f-4538-a6c8-d557908af09b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047623 Oct 19 04:26:36.060652 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4171/7867] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Oct 19 04:26:36 2022] GET /compute/v2.1/servers/ae4697e1-ee7f-4538-a6c8-d557908af09b/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:26:37.072658 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-713e87f2-91d8-460f-840e-3e02f9f3f84d tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:26:37.075022 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-713e87f2-91d8-460f-840e-3e02f9f3f84d tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] [instance: ae4697e1-ee7f-4538-a6c8-d557908af09b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:26:37.082812 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-713e87f2-91d8-460f-840e-3e02f9f3f84d tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:26:37.083298 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-713e87f2-91d8-460f-840e-3e02f9f3f84d tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:26:37.083745 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-713e87f2-91d8-460f-840e-3e02f9f3f84d tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:26:37.084443 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-713e87f2-91d8-460f-840e-3e02f9f3f84d tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:26:37.084904 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-713e87f2-91d8-460f-840e-3e02f9f3f84d tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:26:37.085333 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-713e87f2-91d8-460f-840e-3e02f9f3f84d tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:26:37.116517 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-713e87f2-91d8-460f-840e-3e02f9f3f84d tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] 10.222.0.52 "GET /compute/v2.1/servers/ae4697e1-ee7f-4538-a6c8-d557908af09b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048213 Oct 19 04:26:37.117091 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3697/7868] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Oct 19 04:26:37 2022] GET /compute/v2.1/servers/ae4697e1-ee7f-4538-a6c8-d557908af09b/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:26:38.128237 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a1ee1113-0d3d-4587-b2de-0375d229bd73 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:26:38.130421 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a1ee1113-0d3d-4587-b2de-0375d229bd73 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] [instance: ae4697e1-ee7f-4538-a6c8-d557908af09b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:26:38.137267 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a1ee1113-0d3d-4587-b2de-0375d229bd73 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:26:38.137794 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a1ee1113-0d3d-4587-b2de-0375d229bd73 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:26:38.138253 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a1ee1113-0d3d-4587-b2de-0375d229bd73 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:26:38.138954 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a1ee1113-0d3d-4587-b2de-0375d229bd73 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:26:38.139423 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a1ee1113-0d3d-4587-b2de-0375d229bd73 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:26:38.139870 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a1ee1113-0d3d-4587-b2de-0375d229bd73 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:26:38.169239 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a1ee1113-0d3d-4587-b2de-0375d229bd73 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] 10.222.0.52 "GET /compute/v2.1/servers/ae4697e1-ee7f-4538-a6c8-d557908af09b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045032 Oct 19 04:26:38.169987 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4172/7869] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Oct 19 04:26:38 2022] GET /compute/v2.1/servers/ae4697e1-ee7f-4538-a6c8-d557908af09b/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 04:26:38.180300 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-38da20a9-ee4e-454e-9a0b-8821d7d708c1 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:26:38.180795 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-38da20a9-ee4e-454e-9a0b-8821d7d708c1 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] [instance: ae4697e1-ee7f-4538-a6c8-d557908af09b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:26:38.187963 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-38da20a9-ee4e-454e-9a0b-8821d7d708c1 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:26:38.188445 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-38da20a9-ee4e-454e-9a0b-8821d7d708c1 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:26:38.188880 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-38da20a9-ee4e-454e-9a0b-8821d7d708c1 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:26:38.189601 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-38da20a9-ee4e-454e-9a0b-8821d7d708c1 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:26:38.190052 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-38da20a9-ee4e-454e-9a0b-8821d7d708c1 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:26:38.190476 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-38da20a9-ee4e-454e-9a0b-8821d7d708c1 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:26:38.266543 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-38da20a9-ee4e-454e-9a0b-8821d7d708c1 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] HTTP exception thrown: Instance ae4697e1-ee7f-4538-a6c8-d557908af09b is not attached to volume 806dfe3c-ebdd-47e1-9315-3faa02c9a01a Oct 19 04:26:38.267925 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-38da20a9-ee4e-454e-9a0b-8821d7d708c1 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Request method failure captured: Oct 19 04:26:38.267925 n-d-861333-8 devstack@n-api.service[121135]: request: DELETE /compute/v2.1/servers/ae4697e1-ee7f-4538-a6c8-d557908af09b/os-volume_attachments/806dfe3c-ebdd-47e1-9315-3faa02c9a01a HTTP/1.1 Oct 19 04:26:38.267925 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 04:26:38.267925 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 04:26:38.267925 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 04:26:38.267925 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 04:26:38.267925 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 04:26:38.267925 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 04:26:38.267925 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 04:26:38.267925 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 04:26:38.267925 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT3wqdDgEMgqOfGYpo6UPsYZcytRnRNEpMS-DuFYGENN9V_1doRiaOtFv8ZT0wSClJ40kh1Yqz53GYAf0cdVMT9SDlEYk74QLchdmCrO9f6CgXoa9g1d4H8ZOMnPaRBBrxIY5BdprLz_aDJdf-AEFu-ThGLlzVHszbv67C-U8CHoGL6o Oct 19 04:26:38.267925 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 04:26:38.267925 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 04:26:38.267925 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 04:26:38.267925 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 04:26:38.267925 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 04:26:38.267925 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 04:26:38.267925 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 5f5a48cb267249749641e9e7b9b55102 Oct 19 04:26:38.267925 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-TestEncryptedCinderVolumes-383677399 Oct 19 04:26:38.267925 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 04:26:38.267925 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 04:26:38.267925 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5f5a48cb267249749641e9e7b9b55102"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5f5a48cb267249749641e9e7b9b55102"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5f5a48cb267249749641e9e7b9b55102"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5f5a48cb267249749641e9e7b9b55102", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 04:26:38.267925 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-TestEncryptedCinderVolumes-383677399 Oct 19 04:26:38.267925 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 5f5a48cb267249749641e9e7b9b55102 Oct 19 04:26:38.267925 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-383677399 Oct 19 04:26:38.267925 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-TestEncryptedCinderVolumes-383677399-project Oct 19 04:26:38.267925 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 04:26:38.267925 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 04:26:38.267925 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 48b2e87ad952416d814d03bfbb3c1ca1 Oct 19 04:26:38.267925 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-TestEncryptedCinderVolumes-383677399-project Oct 19 04:26:38.267925 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 04:26:38.267925 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance ae4697e1-ee7f-4538-a6c8-d557908af09b is not attached to volume 806dfe3c-ebdd-47e1-9315-3faa02c9a01a Oct 19 04:26:38.267925 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'server_id': 'ae4697e1-ee7f-4538-a6c8-d557908af09b', 'id': '806dfe3c-ebdd-47e1-9315-3faa02c9a01a'} Oct 19 04:26:38.267925 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 04:26:38.267925 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:26:38.267925 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 19 04:26:38.267925 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 19 04:26:38.267925 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 04:26:38.267925 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 04:26:38.267925 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 19 04:26:38.267925 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 19 04:26:38.267925 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 806dfe3c-ebdd-47e1-9315-3faa02c9a01a. Oct 19 04:26:38.267925 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:26:38.267925 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:26:38.267925 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:26:38.267925 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:26:38.267925 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:26:38.267925 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:26:38.267925 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 04:26:38.267925 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 04:26:38.267925 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 04:26:38.267925 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 04:26:38.267925 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 19 04:26:38.267925 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 19 04:26:38.267925 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae4697e1-ee7f-4538-a6c8-d557908af09b is not attached to volume 806dfe3c-ebdd-47e1-9315-3faa02c9a01a Oct 19 04:26:38.267925 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:26:38.267925 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:26:38.267925 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:26:38.267925 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:26:38.267925 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:26:38.267925 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:26:38.272557 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 04:26:38.272557 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 04:26:38.272557 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae4697e1-ee7f-4538-a6c8-d557908af09b is not attached to volume 806dfe3c-ebdd-47e1-9315-3faa02c9a01a Oct 19 04:26:38.272557 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:26:38.272557 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-38da20a9-ee4e-454e-9a0b-8821d7d708c1 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Returning 404 to user: Instance ae4697e1-ee7f-4538-a6c8-d557908af09b is not attached to volume 806dfe3c-ebdd-47e1-9315-3faa02c9a01a {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 04:26:38.272557 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-38da20a9-ee4e-454e-9a0b-8821d7d708c1 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ae4697e1-ee7f-4538-a6c8-d557908af09b/os-volume_attachments/806dfe3c-ebdd-47e1-9315-3faa02c9a01a" status: 404 len: 154 microversion: 2.1 time: 0.093162 Oct 19 04:26:38.272557 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3698/7870] 10.222.0.52 () {58 vars in 1416 bytes} [Wed Oct 19 04:26:38 2022] DELETE /compute/v2.1/servers/ae4697e1-ee7f-4538-a6c8-d557908af09b/os-volume_attachments/806dfe3c-ebdd-47e1-9315-3faa02c9a01a => generated 154 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 04:26:41.787157 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a8785ed9-026d-4566-9457-baeb3b499b68 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:26:41.787662 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a8785ed9-026d-4566-9457-baeb3b499b68 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] [instance: ae4697e1-ee7f-4538-a6c8-d557908af09b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:26:41.794632 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a8785ed9-026d-4566-9457-baeb3b499b68 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:26:41.795136 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a8785ed9-026d-4566-9457-baeb3b499b68 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:26:41.795650 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a8785ed9-026d-4566-9457-baeb3b499b68 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:26:41.796370 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a8785ed9-026d-4566-9457-baeb3b499b68 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:26:41.796846 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a8785ed9-026d-4566-9457-baeb3b499b68 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:26:41.797295 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a8785ed9-026d-4566-9457-baeb3b499b68 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:26:41.824170 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a8785ed9-026d-4566-9457-baeb3b499b68 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] [instance: ae4697e1-ee7f-4538-a6c8-d557908af09b] Going to try to terminate instance {{(pid=121134) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 04:26:42.134023 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a8785ed9-026d-4566-9457-baeb3b499b68 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ae4697e1-ee7f-4538-a6c8-d557908af09b" status: 204 len: 0 microversion: 2.1 time: 0.350445 Oct 19 04:26:42.136936 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4173/7871] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 04:26:41 2022] DELETE /compute/v2.1/servers/ae4697e1-ee7f-4538-a6c8-d557908af09b => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 19 04:26:42.143144 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a81bb6d5-72d3-4a8e-a21f-765c7b8e8767 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:26:42.143862 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a81bb6d5-72d3-4a8e-a21f-765c7b8e8767 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] [instance: ae4697e1-ee7f-4538-a6c8-d557908af09b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:26:42.150994 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a81bb6d5-72d3-4a8e-a21f-765c7b8e8767 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:26:42.151561 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a81bb6d5-72d3-4a8e-a21f-765c7b8e8767 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:26:42.152317 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a81bb6d5-72d3-4a8e-a21f-765c7b8e8767 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:26:42.153087 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a81bb6d5-72d3-4a8e-a21f-765c7b8e8767 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:26:42.153638 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a81bb6d5-72d3-4a8e-a21f-765c7b8e8767 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:26:42.154284 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a81bb6d5-72d3-4a8e-a21f-765c7b8e8767 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:26:42.291810 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a81bb6d5-72d3-4a8e-a21f-765c7b8e8767 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b2e87ad952416d814d03bfbb3c1ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5a48cb267249749641e9e7b9b55102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:26:42.300285 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a81bb6d5-72d3-4a8e-a21f-765c7b8e8767 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] 10.222.0.52 "GET /compute/v2.1/servers/ae4697e1-ee7f-4538-a6c8-d557908af09b" status: 200 len: 1559 microversion: 2.1 time: 0.161194 Oct 19 04:26:42.300854 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3699/7872] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:26:42 2022] GET /compute/v2.1/servers/ae4697e1-ee7f-4538-a6c8-d557908af09b => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:26:43.324510 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ccabbed4-4f8a-405b-a3c6-b9ede6632f7c tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:26:43.325222 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ccabbed4-4f8a-405b-a3c6-b9ede6632f7c tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] [instance: ae4697e1-ee7f-4538-a6c8-d557908af09b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:26:43.332651 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ccabbed4-4f8a-405b-a3c6-b9ede6632f7c tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:26:43.333146 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ccabbed4-4f8a-405b-a3c6-b9ede6632f7c tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:26:43.333623 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ccabbed4-4f8a-405b-a3c6-b9ede6632f7c tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:26:43.334321 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ccabbed4-4f8a-405b-a3c6-b9ede6632f7c tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:26:43.334783 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ccabbed4-4f8a-405b-a3c6-b9ede6632f7c tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:26:43.335222 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ccabbed4-4f8a-405b-a3c6-b9ede6632f7c tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:26:43.465199 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ccabbed4-4f8a-405b-a3c6-b9ede6632f7c tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b2e87ad952416d814d03bfbb3c1ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5a48cb267249749641e9e7b9b55102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:26:43.473623 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ccabbed4-4f8a-405b-a3c6-b9ede6632f7c tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] 10.222.0.52 "GET /compute/v2.1/servers/ae4697e1-ee7f-4538-a6c8-d557908af09b" status: 200 len: 1559 microversion: 2.1 time: 0.153317 Oct 19 04:26:43.474213 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4174/7873] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:26:43 2022] GET /compute/v2.1/servers/ae4697e1-ee7f-4538-a6c8-d557908af09b => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:26:44.497241 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-10f8a721-457d-42a8-ae8e-5867c40f8152 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:26:44.497966 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-10f8a721-457d-42a8-ae8e-5867c40f8152 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] [instance: ae4697e1-ee7f-4538-a6c8-d557908af09b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:26:44.504922 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-10f8a721-457d-42a8-ae8e-5867c40f8152 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:26:44.507035 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-10f8a721-457d-42a8-ae8e-5867c40f8152 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:26:44.507035 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-10f8a721-457d-42a8-ae8e-5867c40f8152 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:26:44.507035 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-10f8a721-457d-42a8-ae8e-5867c40f8152 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:26:44.507035 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-10f8a721-457d-42a8-ae8e-5867c40f8152 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:26:44.507416 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-10f8a721-457d-42a8-ae8e-5867c40f8152 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:26:44.715793 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-10f8a721-457d-42a8-ae8e-5867c40f8152 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b2e87ad952416d814d03bfbb3c1ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5a48cb267249749641e9e7b9b55102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:26:44.728576 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-10f8a721-457d-42a8-ae8e-5867c40f8152 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] 10.222.0.52 "GET /compute/v2.1/servers/ae4697e1-ee7f-4538-a6c8-d557908af09b" status: 200 len: 1559 microversion: 2.1 time: 0.231519 Oct 19 04:26:44.728576 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3700/7874] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:26:44 2022] GET /compute/v2.1/servers/ae4697e1-ee7f-4538-a6c8-d557908af09b => generated 1559 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:26:44.742006 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-2354411d-6005-4db6-a5f9-00454d2bb6c3 req-fa5325c3-08db-4eb0-9bd2-b3d83bcdfb4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae4697e1-ee7f-4538-a6c8-d557908af09b", "name": "network-vif-deleted", "tag": "66e5f0fd-6d01-41b5-a4a7-1299a23a01b6"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:26:44.752474 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-2354411d-6005-4db6-a5f9-00454d2bb6c3 req-fa5325c3-08db-4eb0-9bd2-b3d83bcdfb4a service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:26:44.752911 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-2354411d-6005-4db6-a5f9-00454d2bb6c3 req-fa5325c3-08db-4eb0-9bd2-b3d83bcdfb4a service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:26:44.753868 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-2354411d-6005-4db6-a5f9-00454d2bb6c3 req-fa5325c3-08db-4eb0-9bd2-b3d83bcdfb4a service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:26:44.766329 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-2354411d-6005-4db6-a5f9-00454d2bb6c3 req-fa5325c3-08db-4eb0-9bd2-b3d83bcdfb4a service nova] Creating event network-vif-deleted:66e5f0fd-6d01-41b5-a4a7-1299a23a01b6 for instance ae4697e1-ee7f-4538-a6c8-d557908af09b on n-h2-861333-8 Oct 19 04:26:44.772083 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-2354411d-6005-4db6-a5f9-00454d2bb6c3 req-fa5325c3-08db-4eb0-9bd2-b3d83bcdfb4a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088474 Oct 19 04:26:44.773076 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4175/7875] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:26:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 04:26:45.748873 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-39a3efc3-655a-42d9-ab41-921bda1f742a tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:26:45.749610 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-39a3efc3-655a-42d9-ab41-921bda1f742a tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] [instance: ae4697e1-ee7f-4538-a6c8-d557908af09b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:26:45.757148 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-39a3efc3-655a-42d9-ab41-921bda1f742a tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:26:45.757674 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-39a3efc3-655a-42d9-ab41-921bda1f742a tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:26:45.758118 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-39a3efc3-655a-42d9-ab41-921bda1f742a tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:26:45.758820 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-39a3efc3-655a-42d9-ab41-921bda1f742a tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:26:45.759277 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-39a3efc3-655a-42d9-ab41-921bda1f742a tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:26:45.759709 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-39a3efc3-655a-42d9-ab41-921bda1f742a tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:26:45.773191 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-39a3efc3-655a-42d9-ab41-921bda1f742a tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] HTTP exception thrown: Instance ae4697e1-ee7f-4538-a6c8-d557908af09b could not be found. Oct 19 04:26:45.774794 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-39a3efc3-655a-42d9-ab41-921bda1f742a tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Request method failure captured: Oct 19 04:26:45.774794 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/ae4697e1-ee7f-4538-a6c8-d557908af09b HTTP/1.1 Oct 19 04:26:45.774794 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 04:26:45.774794 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 04:26:45.774794 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 04:26:45.774794 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 04:26:45.774794 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 04:26:45.774794 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 04:26:45.774794 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 04:26:45.774794 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 04:26:45.774794 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT3wqdDgEMgqOfGYpo6UPsYZcytRnRNEpMS-DuFYGENN9V_1doRiaOtFv8ZT0wSClJ40kh1Yqz53GYAf0cdVMT9SDlEYk74QLchdmCrO9f6CgXoa9g1d4H8ZOMnPaRBBrxIY5BdprLz_aDJdf-AEFu-ThGLlzVHszbv67C-U8CHoGL6o Oct 19 04:26:45.774794 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 04:26:45.774794 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 04:26:45.774794 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 04:26:45.774794 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 04:26:45.774794 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 04:26:45.774794 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 04:26:45.774794 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 5f5a48cb267249749641e9e7b9b55102 Oct 19 04:26:45.774794 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-TestEncryptedCinderVolumes-383677399 Oct 19 04:26:45.774794 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 04:26:45.774794 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 04:26:45.774794 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5f5a48cb267249749641e9e7b9b55102"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5f5a48cb267249749641e9e7b9b55102"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5f5a48cb267249749641e9e7b9b55102"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5f5a48cb267249749641e9e7b9b55102", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 04:26:45.774794 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-TestEncryptedCinderVolumes-383677399 Oct 19 04:26:45.774794 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 5f5a48cb267249749641e9e7b9b55102 Oct 19 04:26:45.774794 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-383677399 Oct 19 04:26:45.774794 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-TestEncryptedCinderVolumes-383677399-project Oct 19 04:26:45.774794 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 04:26:45.774794 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 04:26:45.774794 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 48b2e87ad952416d814d03bfbb3c1ca1 Oct 19 04:26:45.774794 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-TestEncryptedCinderVolumes-383677399-project Oct 19 04:26:45.774794 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 04:26:45.774794 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance ae4697e1-ee7f-4538-a6c8-d557908af09b could not be found. Oct 19 04:26:45.774794 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': 'ae4697e1-ee7f-4538-a6c8-d557908af09b'} Oct 19 04:26:45.774794 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 04:26:45.774794 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:26:45.774794 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 04:26:45.774794 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 04:26:45.774794 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 04:26:45.774794 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 04:26:45.774794 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 04:26:45.774794 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 04:26:45.774794 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 04:26:45.774794 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 04:26:45.774794 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae4697e1-ee7f-4538-a6c8-d557908af09b could not be found. Oct 19 04:26:45.774794 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:26:45.774794 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:26:45.774794 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:26:45.774794 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:26:45.774794 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:26:45.774794 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:26:45.774794 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 04:26:45.774794 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 04:26:45.774794 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 04:26:45.774794 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 04:26:45.774794 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 04:26:45.774794 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 04:26:45.774794 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 04:26:45.774794 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 04:26:45.774794 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 04:26:45.774794 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 04:26:45.774794 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae4697e1-ee7f-4538-a6c8-d557908af09b could not be found. Oct 19 04:26:45.774794 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:26:45.774794 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:26:45.774794 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:26:45.780072 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:26:45.780072 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:26:45.780072 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:26:45.780072 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 04:26:45.780072 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 04:26:45.780072 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae4697e1-ee7f-4538-a6c8-d557908af09b could not be found. Oct 19 04:26:45.780072 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:26:45.780072 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-39a3efc3-655a-42d9-ab41-921bda1f742a tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Returning 404 to user: Instance ae4697e1-ee7f-4538-a6c8-d557908af09b could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 04:26:45.780072 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-39a3efc3-655a-42d9-ab41-921bda1f742a tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] 10.222.0.52 "GET /compute/v2.1/servers/ae4697e1-ee7f-4538-a6c8-d557908af09b" status: 404 len: 111 microversion: 2.1 time: 0.031614 Oct 19 04:26:45.780072 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3701/7876] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:26:45 2022] GET /compute/v2.1/servers/ae4697e1-ee7f-4538-a6c8-d557908af09b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 04:26:45.786846 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-81ba44e1-d715-4ed7-b618-16e6eccd2a9c tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Calling method '.version_select at 0x7fc12b9aa430>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:26:45.880366 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-81ba44e1-d715-4ed7-b618-16e6eccd2a9c tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-358099171" status: 202 len: 0 microversion: 2.1 time: 0.098535 Oct 19 04:26:45.880971 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4176/7877] 10.222.0.52 () {58 vars in 1275 bytes} [Wed Oct 19 04:26:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-358099171 => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 04:26:45.898179 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a544a5be-cb1f-47fc-8803-30f5d0a4992b tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Action: 'create', calling method: .version_select at 0x7fc130d0b670>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-2057225205", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOgOaL+wgkohpBBZD7NaN0945TP5pya08ZH6lG+xm7frB9Z1N4NoniNIygJXfWuvTGbVQXU4sNz9y8B8MyaapapkKyH0eJQ9R3KIoSFwnfk+E0BfGifMV+cc/A8IWlj1NQ=="}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:26:45.914383 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-a544a5be-cb1f-47fc-8803-30f5d0a4992b tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Getting quotas for project 5f5a48cb267249749641e9e7b9b55102. Resources: {'key_pairs'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 04:26:45.920416 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-a544a5be-cb1f-47fc-8803-30f5d0a4992b tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Getting quotas for user 48b2e87ad952416d814d03bfbb3c1ca1 and project 5f5a48cb267249749641e9e7b9b55102. Resources: {'key_pairs'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 04:26:45.989837 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a544a5be-cb1f-47fc-8803-30f5d0a4992b tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.095461 Oct 19 04:26:45.990459 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3702/7878] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Oct 19 04:26:45 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:26:46.040753 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-886b001a-b6b4-4154-891b-1cde1d8f467b tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-558225179", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-2057225205", "networks": [{"uuid": "10995fe6-305c-4382-ad76-58b7897e9c0b"}]}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:26:46.095624 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-886b001a-b6b4-4154-891b-1cde1d8f467b tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] validate_networks() for [('10995fe6-305c-4382-ad76-58b7897e9c0b', None, None, None, None, None)] {{(pid=121134) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 04:26:46.469800 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-886b001a-b6b4-4154-891b-1cde1d8f467b tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Flavor limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 04:26:46.488839 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-886b001a-b6b4-4154-891b-1cde1d8f467b tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Image limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 04:26:46.488839 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-886b001a-b6b4-4154-891b-1cde1d8f467b tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Flavor pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 04:26:46.488839 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-886b001a-b6b4-4154-891b-1cde1d8f467b tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Image pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 04:26:46.488839 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-886b001a-b6b4-4154-891b-1cde1d8f467b tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 04:26:46.488839 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-886b001a-b6b4-4154-891b-1cde1d8f467b tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:26:46.488839 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-886b001a-b6b4-4154-891b-1cde1d8f467b tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:26:46.488839 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-886b001a-b6b4-4154-891b-1cde1d8f467b tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:26:46.488839 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-886b001a-b6b4-4154-891b-1cde1d8f467b tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:26:46.488839 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-886b001a-b6b4-4154-891b-1cde1d8f467b tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:26:46.488839 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-886b001a-b6b4-4154-891b-1cde1d8f467b tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:26:46.505957 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-886b001a-b6b4-4154-891b-1cde1d8f467b tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Getting quotas for project 5f5a48cb267249749641e9e7b9b55102. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 04:26:46.511300 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-886b001a-b6b4-4154-891b-1cde1d8f467b tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Getting quotas for user 48b2e87ad952416d814d03bfbb3c1ca1 and project 5f5a48cb267249749641e9e7b9b55102. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 04:26:46.524771 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-886b001a-b6b4-4154-891b-1cde1d8f467b tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Going to run 1 instances... {{(pid=121134) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 04:26:46.527859 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-886b001a-b6b4-4154-891b-1cde1d8f467b tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] [instance: c2d671a7-50ef-4218-b3a8-ef1004247bbd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 04:26:46.667530 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-886b001a-b6b4-4154-891b-1cde1d8f467b tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.630679 Oct 19 04:26:46.668210 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4177/7879] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 04:26:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 632 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 04:26:46.679723 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9ae9d65c-f513-480a-86d8-68d1067f6e3b tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:26:46.680678 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9ae9d65c-f513-480a-86d8-68d1067f6e3b tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] [instance: c2d671a7-50ef-4218-b3a8-ef1004247bbd] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:26:46.740230 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-9ae9d65c-f513-480a-86d8-68d1067f6e3b tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b2e87ad952416d814d03bfbb3c1ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5a48cb267249749641e9e7b9b55102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:26:46.747209 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9ae9d65c-f513-480a-86d8-68d1067f6e3b tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] 10.222.0.52 "GET /compute/v2.1/servers/c2d671a7-50ef-4218-b3a8-ef1004247bbd" status: 200 len: 1262 microversion: 2.1 time: 0.071645 Oct 19 04:26:46.747785 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3703/7880] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:26:46 2022] GET /compute/v2.1/servers/c2d671a7-50ef-4218-b3a8-ef1004247bbd => generated 1262 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:26:47.770946 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5b7b36bc-8756-4cd6-a38b-d2ad2cb89010 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:26:47.771888 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5b7b36bc-8756-4cd6-a38b-d2ad2cb89010 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] [instance: c2d671a7-50ef-4218-b3a8-ef1004247bbd] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:26:47.778547 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5b7b36bc-8756-4cd6-a38b-d2ad2cb89010 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:26:47.779052 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5b7b36bc-8756-4cd6-a38b-d2ad2cb89010 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:26:47.779521 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5b7b36bc-8756-4cd6-a38b-d2ad2cb89010 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:26:47.780236 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5b7b36bc-8756-4cd6-a38b-d2ad2cb89010 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:26:47.780715 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5b7b36bc-8756-4cd6-a38b-d2ad2cb89010 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:26:47.781161 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5b7b36bc-8756-4cd6-a38b-d2ad2cb89010 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:26:47.844054 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5b7b36bc-8756-4cd6-a38b-d2ad2cb89010 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b2e87ad952416d814d03bfbb3c1ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5a48cb267249749641e9e7b9b55102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:26:47.851882 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5b7b36bc-8756-4cd6-a38b-d2ad2cb89010 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] 10.222.0.52 "GET /compute/v2.1/servers/c2d671a7-50ef-4218-b3a8-ef1004247bbd" status: 200 len: 1266 microversion: 2.1 time: 0.086087 Oct 19 04:26:47.852487 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4178/7881] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:26:47 2022] GET /compute/v2.1/servers/c2d671a7-50ef-4218-b3a8-ef1004247bbd => generated 1266 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:26:48.876403 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b8e7c31b-63ac-44a4-bc45-0612bbc35b4d tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:26:48.877181 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b8e7c31b-63ac-44a4-bc45-0612bbc35b4d tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] [instance: c2d671a7-50ef-4218-b3a8-ef1004247bbd] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:26:48.883237 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b8e7c31b-63ac-44a4-bc45-0612bbc35b4d tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:26:48.883727 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b8e7c31b-63ac-44a4-bc45-0612bbc35b4d tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:26:48.884160 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b8e7c31b-63ac-44a4-bc45-0612bbc35b4d tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:26:48.884850 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b8e7c31b-63ac-44a4-bc45-0612bbc35b4d tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:26:48.885405 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b8e7c31b-63ac-44a4-bc45-0612bbc35b4d tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:26:48.885769 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b8e7c31b-63ac-44a4-bc45-0612bbc35b4d tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:26:48.983041 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b8e7c31b-63ac-44a4-bc45-0612bbc35b4d tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b2e87ad952416d814d03bfbb3c1ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5a48cb267249749641e9e7b9b55102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:26:48.991525 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b8e7c31b-63ac-44a4-bc45-0612bbc35b4d tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] 10.222.0.52 "GET /compute/v2.1/servers/c2d671a7-50ef-4218-b3a8-ef1004247bbd" status: 200 len: 1332 microversion: 2.1 time: 0.120117 Oct 19 04:26:48.992109 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3704/7882] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:26:48 2022] GET /compute/v2.1/servers/c2d671a7-50ef-4218-b3a8-ef1004247bbd => generated 1332 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:26:50.015054 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5cc21aa3-ebe9-4db0-a35b-0cd138d9dd0a tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:26:50.015849 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5cc21aa3-ebe9-4db0-a35b-0cd138d9dd0a tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] [instance: c2d671a7-50ef-4218-b3a8-ef1004247bbd] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:26:50.022752 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5cc21aa3-ebe9-4db0-a35b-0cd138d9dd0a tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:26:50.023262 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5cc21aa3-ebe9-4db0-a35b-0cd138d9dd0a tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:26:50.023722 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5cc21aa3-ebe9-4db0-a35b-0cd138d9dd0a tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:26:50.024438 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5cc21aa3-ebe9-4db0-a35b-0cd138d9dd0a tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:26:50.024914 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5cc21aa3-ebe9-4db0-a35b-0cd138d9dd0a tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:26:50.025361 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5cc21aa3-ebe9-4db0-a35b-0cd138d9dd0a tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:26:50.219460 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5cc21aa3-ebe9-4db0-a35b-0cd138d9dd0a tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b2e87ad952416d814d03bfbb3c1ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5a48cb267249749641e9e7b9b55102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:26:50.227308 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5cc21aa3-ebe9-4db0-a35b-0cd138d9dd0a tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] 10.222.0.52 "GET /compute/v2.1/servers/c2d671a7-50ef-4218-b3a8-ef1004247bbd" status: 200 len: 1362 microversion: 2.1 time: 0.216230 Oct 19 04:26:50.227893 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4179/7883] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:26:50 2022] GET /compute/v2.1/servers/c2d671a7-50ef-4218-b3a8-ef1004247bbd => generated 1362 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:26:50.362346 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-d88726c4-7ae8-446a-822f-504c8f0cde4b req-462afe8c-2ca1-4b3a-a912-2e367b494f01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2d671a7-50ef-4218-b3a8-ef1004247bbd", "tag": "3aa19a70-9c07-4f8a-88e4-a5612f32810e"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:26:50.372659 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-d88726c4-7ae8-446a-822f-504c8f0cde4b req-462afe8c-2ca1-4b3a-a912-2e367b494f01 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:26:50.373146 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-d88726c4-7ae8-446a-822f-504c8f0cde4b req-462afe8c-2ca1-4b3a-a912-2e367b494f01 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:26:50.373608 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-d88726c4-7ae8-446a-822f-504c8f0cde4b req-462afe8c-2ca1-4b3a-a912-2e367b494f01 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:26:50.388122 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-d88726c4-7ae8-446a-822f-504c8f0cde4b req-462afe8c-2ca1-4b3a-a912-2e367b494f01 service nova] Creating event network-changed:3aa19a70-9c07-4f8a-88e4-a5612f32810e for instance c2d671a7-50ef-4218-b3a8-ef1004247bbd on n-h2-861333-8 Oct 19 04:26:50.393249 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-d88726c4-7ae8-446a-822f-504c8f0cde4b req-462afe8c-2ca1-4b3a-a912-2e367b494f01 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035382 Oct 19 04:26:50.394126 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3705/7884] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:26:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 04:26:51.251261 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-be04a5a6-38af-4118-bcbc-f0b1b2b36b9a tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:26:51.251899 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-be04a5a6-38af-4118-bcbc-f0b1b2b36b9a tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] [instance: c2d671a7-50ef-4218-b3a8-ef1004247bbd] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:26:51.259364 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-be04a5a6-38af-4118-bcbc-f0b1b2b36b9a tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:26:51.259806 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-be04a5a6-38af-4118-bcbc-f0b1b2b36b9a tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:26:51.260268 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-be04a5a6-38af-4118-bcbc-f0b1b2b36b9a tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:26:51.260983 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-be04a5a6-38af-4118-bcbc-f0b1b2b36b9a tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:26:51.261488 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-be04a5a6-38af-4118-bcbc-f0b1b2b36b9a tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:26:51.261945 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-be04a5a6-38af-4118-bcbc-f0b1b2b36b9a tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:26:51.394482 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-be04a5a6-38af-4118-bcbc-f0b1b2b36b9a tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b2e87ad952416d814d03bfbb3c1ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5a48cb267249749641e9e7b9b55102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:26:51.402789 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-be04a5a6-38af-4118-bcbc-f0b1b2b36b9a tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] 10.222.0.52 "GET /compute/v2.1/servers/c2d671a7-50ef-4218-b3a8-ef1004247bbd" status: 200 len: 1362 microversion: 2.1 time: 0.155144 Oct 19 04:26:51.403381 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4180/7885] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:26:51 2022] GET /compute/v2.1/servers/c2d671a7-50ef-4218-b3a8-ef1004247bbd => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:26:52.427825 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-06c3a44f-b49e-4f5d-97bd-74bf27d65820 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:26:52.428551 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-06c3a44f-b49e-4f5d-97bd-74bf27d65820 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] [instance: c2d671a7-50ef-4218-b3a8-ef1004247bbd] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:26:52.434793 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-06c3a44f-b49e-4f5d-97bd-74bf27d65820 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:26:52.435272 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-06c3a44f-b49e-4f5d-97bd-74bf27d65820 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:26:52.435711 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-06c3a44f-b49e-4f5d-97bd-74bf27d65820 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:26:52.436395 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-06c3a44f-b49e-4f5d-97bd-74bf27d65820 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:26:52.436850 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-06c3a44f-b49e-4f5d-97bd-74bf27d65820 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:26:52.437278 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-06c3a44f-b49e-4f5d-97bd-74bf27d65820 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:26:52.564369 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-06c3a44f-b49e-4f5d-97bd-74bf27d65820 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b2e87ad952416d814d03bfbb3c1ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5a48cb267249749641e9e7b9b55102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:26:52.573001 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-06c3a44f-b49e-4f5d-97bd-74bf27d65820 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] 10.222.0.52 "GET /compute/v2.1/servers/c2d671a7-50ef-4218-b3a8-ef1004247bbd" status: 200 len: 1362 microversion: 2.1 time: 0.150316 Oct 19 04:26:52.573771 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3706/7886] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:26:52 2022] GET /compute/v2.1/servers/c2d671a7-50ef-4218-b3a8-ef1004247bbd => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:26:53.596162 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-31b32516-f78a-40f3-8be4-4f0634654e82 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:26:53.596796 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-31b32516-f78a-40f3-8be4-4f0634654e82 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] [instance: c2d671a7-50ef-4218-b3a8-ef1004247bbd] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:26:53.603801 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-31b32516-f78a-40f3-8be4-4f0634654e82 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:26:53.604307 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-31b32516-f78a-40f3-8be4-4f0634654e82 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:26:53.604770 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-31b32516-f78a-40f3-8be4-4f0634654e82 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:26:53.605508 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-31b32516-f78a-40f3-8be4-4f0634654e82 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:26:53.605987 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-31b32516-f78a-40f3-8be4-4f0634654e82 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:26:53.606432 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-31b32516-f78a-40f3-8be4-4f0634654e82 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:26:53.736260 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-31b32516-f78a-40f3-8be4-4f0634654e82 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b2e87ad952416d814d03bfbb3c1ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5a48cb267249749641e9e7b9b55102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:26:53.744503 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-31b32516-f78a-40f3-8be4-4f0634654e82 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] 10.222.0.52 "GET /compute/v2.1/servers/c2d671a7-50ef-4218-b3a8-ef1004247bbd" status: 200 len: 1362 microversion: 2.1 time: 0.152308 Oct 19 04:26:53.745087 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4181/7887] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:26:53 2022] GET /compute/v2.1/servers/c2d671a7-50ef-4218-b3a8-ef1004247bbd => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:26:54.767997 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e67982a1-7bef-4655-9b92-772f72d14ce3 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:26:54.768613 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e67982a1-7bef-4655-9b92-772f72d14ce3 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] [instance: c2d671a7-50ef-4218-b3a8-ef1004247bbd] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:26:54.775554 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e67982a1-7bef-4655-9b92-772f72d14ce3 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:26:54.776052 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e67982a1-7bef-4655-9b92-772f72d14ce3 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:26:54.776498 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e67982a1-7bef-4655-9b92-772f72d14ce3 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:26:54.777202 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e67982a1-7bef-4655-9b92-772f72d14ce3 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:26:54.777950 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e67982a1-7bef-4655-9b92-772f72d14ce3 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:26:54.778387 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e67982a1-7bef-4655-9b92-772f72d14ce3 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:26:54.905904 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-e67982a1-7bef-4655-9b92-772f72d14ce3 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b2e87ad952416d814d03bfbb3c1ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5a48cb267249749641e9e7b9b55102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:26:54.914173 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e67982a1-7bef-4655-9b92-772f72d14ce3 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] 10.222.0.52 "GET /compute/v2.1/servers/c2d671a7-50ef-4218-b3a8-ef1004247bbd" status: 200 len: 1362 microversion: 2.1 time: 0.150202 Oct 19 04:26:54.914757 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3707/7888] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:26:54 2022] GET /compute/v2.1/servers/c2d671a7-50ef-4218-b3a8-ef1004247bbd => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:26:55.937584 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-af92350e-5d05-41e0-854a-8f4f67779e53 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:26:55.938215 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-af92350e-5d05-41e0-854a-8f4f67779e53 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] [instance: c2d671a7-50ef-4218-b3a8-ef1004247bbd] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:26:55.945096 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-af92350e-5d05-41e0-854a-8f4f67779e53 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:26:55.945632 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-af92350e-5d05-41e0-854a-8f4f67779e53 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:26:55.946088 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-af92350e-5d05-41e0-854a-8f4f67779e53 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:26:55.946801 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-af92350e-5d05-41e0-854a-8f4f67779e53 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:26:55.947272 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-af92350e-5d05-41e0-854a-8f4f67779e53 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:26:55.947747 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-af92350e-5d05-41e0-854a-8f4f67779e53 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:26:56.078760 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-af92350e-5d05-41e0-854a-8f4f67779e53 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b2e87ad952416d814d03bfbb3c1ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5a48cb267249749641e9e7b9b55102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:26:56.087133 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-af92350e-5d05-41e0-854a-8f4f67779e53 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] 10.222.0.52 "GET /compute/v2.1/servers/c2d671a7-50ef-4218-b3a8-ef1004247bbd" status: 200 len: 1362 microversion: 2.1 time: 0.153505 Oct 19 04:26:56.087712 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4182/7889] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:26:55 2022] GET /compute/v2.1/servers/c2d671a7-50ef-4218-b3a8-ef1004247bbd => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:26:57.112069 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d896b339-a1bd-4dbf-a825-a33ed0e80242 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:26:57.112617 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d896b339-a1bd-4dbf-a825-a33ed0e80242 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] [instance: c2d671a7-50ef-4218-b3a8-ef1004247bbd] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:26:57.115457 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=6 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:26:57.120400 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d896b339-a1bd-4dbf-a825-a33ed0e80242 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:26:57.120897 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d896b339-a1bd-4dbf-a825-a33ed0e80242 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:26:57.121345 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d896b339-a1bd-4dbf-a825-a33ed0e80242 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:26:57.122216 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d896b339-a1bd-4dbf-a825-a33ed0e80242 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:26:57.122677 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d896b339-a1bd-4dbf-a825-a33ed0e80242 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:26:57.123115 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d896b339-a1bd-4dbf-a825-a33ed0e80242 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:26:57.254616 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d896b339-a1bd-4dbf-a825-a33ed0e80242 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b2e87ad952416d814d03bfbb3c1ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5a48cb267249749641e9e7b9b55102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:26:57.263215 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d896b339-a1bd-4dbf-a825-a33ed0e80242 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] 10.222.0.52 "GET /compute/v2.1/servers/c2d671a7-50ef-4218-b3a8-ef1004247bbd" status: 200 len: 1362 microversion: 2.1 time: 0.155367 Oct 19 04:26:57.263977 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3708/7890] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:26:57 2022] GET /compute/v2.1/servers/c2d671a7-50ef-4218-b3a8-ef1004247bbd => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:26:57.272762 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-d2f83bec-92ee-44f2-a484-e977a8089fba req-acc8d355-60bf-43ea-a138-f468564758a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2d671a7-50ef-4218-b3a8-ef1004247bbd", "name": "network-vif-plugged", "status": "completed", "tag": "3aa19a70-9c07-4f8a-88e4-a5612f32810e"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:26:57.278382 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:26:57.279074 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=6 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:26:57.289829 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-d2f83bec-92ee-44f2-a484-e977a8089fba req-acc8d355-60bf-43ea-a138-f468564758a8 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:26:57.290338 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-d2f83bec-92ee-44f2-a484-e977a8089fba req-acc8d355-60bf-43ea-a138-f468564758a8 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:26:57.290783 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-d2f83bec-92ee-44f2-a484-e977a8089fba req-acc8d355-60bf-43ea-a138-f468564758a8 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:26:57.301354 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-d2f83bec-92ee-44f2-a484-e977a8089fba req-acc8d355-60bf-43ea-a138-f468564758a8 service nova] Creating event network-vif-plugged:3aa19a70-9c07-4f8a-88e4-a5612f32810e for instance c2d671a7-50ef-4218-b3a8-ef1004247bbd on n-h2-861333-8 Oct 19 04:26:57.306569 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-d2f83bec-92ee-44f2-a484-e977a8089fba req-acc8d355-60bf-43ea-a138-f468564758a8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038141 Oct 19 04:26:57.307191 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4183/7891] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:26:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 04:26:58.286957 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1fd27e2c-1617-4715-bd8f-f0c41f0a4e8a tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:26:58.287583 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1fd27e2c-1617-4715-bd8f-f0c41f0a4e8a tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] [instance: c2d671a7-50ef-4218-b3a8-ef1004247bbd] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:26:58.294789 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1fd27e2c-1617-4715-bd8f-f0c41f0a4e8a tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:26:58.299385 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1fd27e2c-1617-4715-bd8f-f0c41f0a4e8a tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:26:58.299385 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1fd27e2c-1617-4715-bd8f-f0c41f0a4e8a tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:26:58.299385 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1fd27e2c-1617-4715-bd8f-f0c41f0a4e8a tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:26:58.299385 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1fd27e2c-1617-4715-bd8f-f0c41f0a4e8a tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:26:58.299385 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1fd27e2c-1617-4715-bd8f-f0c41f0a4e8a tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:26:58.432637 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-1fd27e2c-1617-4715-bd8f-f0c41f0a4e8a tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b2e87ad952416d814d03bfbb3c1ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5a48cb267249749641e9e7b9b55102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:26:58.440488 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1fd27e2c-1617-4715-bd8f-f0c41f0a4e8a tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] 10.222.0.52 "GET /compute/v2.1/servers/c2d671a7-50ef-4218-b3a8-ef1004247bbd" status: 200 len: 1362 microversion: 2.1 time: 0.157634 Oct 19 04:26:58.441063 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3709/7892] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:26:58 2022] GET /compute/v2.1/servers/c2d671a7-50ef-4218-b3a8-ef1004247bbd => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:26:59.465076 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b1a8ca7c-0aec-452a-bb67-601d86a00ab4 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:26:59.465820 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b1a8ca7c-0aec-452a-bb67-601d86a00ab4 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] [instance: c2d671a7-50ef-4218-b3a8-ef1004247bbd] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:26:59.472400 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b1a8ca7c-0aec-452a-bb67-601d86a00ab4 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:26:59.472898 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b1a8ca7c-0aec-452a-bb67-601d86a00ab4 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:26:59.473352 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b1a8ca7c-0aec-452a-bb67-601d86a00ab4 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:26:59.474068 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b1a8ca7c-0aec-452a-bb67-601d86a00ab4 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:26:59.474540 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b1a8ca7c-0aec-452a-bb67-601d86a00ab4 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:26:59.475011 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b1a8ca7c-0aec-452a-bb67-601d86a00ab4 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:26:59.602035 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b1a8ca7c-0aec-452a-bb67-601d86a00ab4 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b2e87ad952416d814d03bfbb3c1ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5a48cb267249749641e9e7b9b55102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:26:59.609809 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b1a8ca7c-0aec-452a-bb67-601d86a00ab4 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] 10.222.0.52 "GET /compute/v2.1/servers/c2d671a7-50ef-4218-b3a8-ef1004247bbd" status: 200 len: 1554 microversion: 2.1 time: 0.150523 Oct 19 04:26:59.610394 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4184/7893] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:26:59 2022] GET /compute/v2.1/servers/c2d671a7-50ef-4218-b3a8-ef1004247bbd => generated 1554 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:26:59.633030 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-29ae6d5e-45f8-4390-a8b3-1276a0d1ba87 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:26:59.633675 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-29ae6d5e-45f8-4390-a8b3-1276a0d1ba87 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] [instance: c2d671a7-50ef-4218-b3a8-ef1004247bbd] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:26:59.640138 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-29ae6d5e-45f8-4390-a8b3-1276a0d1ba87 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:26:59.640617 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-29ae6d5e-45f8-4390-a8b3-1276a0d1ba87 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:26:59.641053 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-29ae6d5e-45f8-4390-a8b3-1276a0d1ba87 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:26:59.641769 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-29ae6d5e-45f8-4390-a8b3-1276a0d1ba87 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:26:59.642221 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-29ae6d5e-45f8-4390-a8b3-1276a0d1ba87 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:26:59.642641 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-29ae6d5e-45f8-4390-a8b3-1276a0d1ba87 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:26:59.774796 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-29ae6d5e-45f8-4390-a8b3-1276a0d1ba87 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b2e87ad952416d814d03bfbb3c1ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5a48cb267249749641e9e7b9b55102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:26:59.783212 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-29ae6d5e-45f8-4390-a8b3-1276a0d1ba87 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] 10.222.0.52 "GET /compute/v2.1/servers/c2d671a7-50ef-4218-b3a8-ef1004247bbd" status: 200 len: 1554 microversion: 2.1 time: 0.154585 Oct 19 04:26:59.784048 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3710/7894] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:26:59 2022] GET /compute/v2.1/servers/c2d671a7-50ef-4218-b3a8-ef1004247bbd => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:27:02.809650 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1890698d-acf4-417f-ac58-ae4d4e0f00e4 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6ff5ee39-fd6f-4e4f-9aa5-4966115aa69b"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:27:02.812014 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1890698d-acf4-417f-ac58-ae4d4e0f00e4 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] [instance: c2d671a7-50ef-4218-b3a8-ef1004247bbd] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:27:02.818398 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1890698d-acf4-417f-ac58-ae4d4e0f00e4 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:27:02.818996 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1890698d-acf4-417f-ac58-ae4d4e0f00e4 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:27:02.819454 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1890698d-acf4-417f-ac58-ae4d4e0f00e4 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:27:02.820171 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1890698d-acf4-417f-ac58-ae4d4e0f00e4 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:27:02.820735 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1890698d-acf4-417f-ac58-ae4d4e0f00e4 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:27:02.821190 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1890698d-acf4-417f-ac58-ae4d4e0f00e4 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:27:02.823699 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:27:03.566513 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1890698d-acf4-417f-ac58-ae4d4e0f00e4 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] 10.222.0.52 "POST /compute/v2.1/servers/c2d671a7-50ef-4218-b3a8-ef1004247bbd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.760587 Oct 19 04:27:03.567176 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4185/7895] 10.222.0.52 () {60 vars in 1323 bytes} [Wed Oct 19 04:27:02 2022] POST /compute/v2.1/servers/c2d671a7-50ef-4218-b3a8-ef1004247bbd/os-volume_attachments => generated 194 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:27:15.351769 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a989f635-5731-4c34-b918-864bb0771b66 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:27:15.353759 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a989f635-5731-4c34-b918-864bb0771b66 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] [instance: c2d671a7-50ef-4218-b3a8-ef1004247bbd] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:27:15.356474 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:27:15.357139 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=76 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:27:15.360904 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a989f635-5731-4c34-b918-864bb0771b66 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:27:15.361421 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a989f635-5731-4c34-b918-864bb0771b66 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:27:15.361877 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a989f635-5731-4c34-b918-864bb0771b66 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:27:15.362576 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a989f635-5731-4c34-b918-864bb0771b66 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:27:15.363548 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a989f635-5731-4c34-b918-864bb0771b66 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:27:15.363981 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a989f635-5731-4c34-b918-864bb0771b66 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:27:15.448647 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-a989f635-5731-4c34-b918-864bb0771b66 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lazy-loading 'services' on Instance uuid c2d671a7-50ef-4218-b3a8-ef1004247bbd {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 04:27:15.669293 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a989f635-5731-4c34-b918-864bb0771b66 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] 10.222.0.52 "DELETE /compute/v2.1/servers/c2d671a7-50ef-4218-b3a8-ef1004247bbd/os-volume_attachments/6ff5ee39-fd6f-4e4f-9aa5-4966115aa69b" status: 202 len: 0 microversion: 2.1 time: 0.321591 Oct 19 04:27:15.669979 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3711/7896] 10.222.0.52 () {58 vars in 1416 bytes} [Wed Oct 19 04:27:15 2022] DELETE /compute/v2.1/servers/c2d671a7-50ef-4218-b3a8-ef1004247bbd/os-volume_attachments/6ff5ee39-fd6f-4e4f-9aa5-4966115aa69b => generated 0 bytes in 323 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 04:27:15.679761 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-59e4f402-2013-47e9-9cb1-2a5ef5324b25 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:27:15.682176 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-59e4f402-2013-47e9-9cb1-2a5ef5324b25 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] [instance: c2d671a7-50ef-4218-b3a8-ef1004247bbd] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:27:15.685134 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:27:15.685843 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=10,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:27:15.690839 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-59e4f402-2013-47e9-9cb1-2a5ef5324b25 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:27:15.691342 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-59e4f402-2013-47e9-9cb1-2a5ef5324b25 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:27:15.691801 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-59e4f402-2013-47e9-9cb1-2a5ef5324b25 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:27:15.692523 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-59e4f402-2013-47e9-9cb1-2a5ef5324b25 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:27:15.692992 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-59e4f402-2013-47e9-9cb1-2a5ef5324b25 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:27:15.693461 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-59e4f402-2013-47e9-9cb1-2a5ef5324b25 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:27:15.724333 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-59e4f402-2013-47e9-9cb1-2a5ef5324b25 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] 10.222.0.52 "GET /compute/v2.1/servers/c2d671a7-50ef-4218-b3a8-ef1004247bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049663 Oct 19 04:27:15.724899 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4186/7897] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Oct 19 04:27:15 2022] GET /compute/v2.1/servers/c2d671a7-50ef-4218-b3a8-ef1004247bbd/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:27:16.738987 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-dcfe5b7a-64d6-4206-8933-d750ec2482f6 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:27:16.741345 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-dcfe5b7a-64d6-4206-8933-d750ec2482f6 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] [instance: c2d671a7-50ef-4218-b3a8-ef1004247bbd] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:27:16.747685 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dcfe5b7a-64d6-4206-8933-d750ec2482f6 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:27:16.748175 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dcfe5b7a-64d6-4206-8933-d750ec2482f6 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:27:16.748620 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dcfe5b7a-64d6-4206-8933-d750ec2482f6 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:27:16.749311 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dcfe5b7a-64d6-4206-8933-d750ec2482f6 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:27:16.749808 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dcfe5b7a-64d6-4206-8933-d750ec2482f6 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:27:16.750235 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dcfe5b7a-64d6-4206-8933-d750ec2482f6 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:27:16.782514 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-dcfe5b7a-64d6-4206-8933-d750ec2482f6 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] 10.222.0.52 "GET /compute/v2.1/servers/c2d671a7-50ef-4218-b3a8-ef1004247bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049458 Oct 19 04:27:16.783228 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3712/7898] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Oct 19 04:27:16 2022] GET /compute/v2.1/servers/c2d671a7-50ef-4218-b3a8-ef1004247bbd/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:27:17.795999 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-84166390-a502-4650-8fae-6587bb09ac89 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:27:17.798209 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-84166390-a502-4650-8fae-6587bb09ac89 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] [instance: c2d671a7-50ef-4218-b3a8-ef1004247bbd] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:27:17.805577 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-84166390-a502-4650-8fae-6587bb09ac89 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:27:17.806121 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-84166390-a502-4650-8fae-6587bb09ac89 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:27:17.806578 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-84166390-a502-4650-8fae-6587bb09ac89 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:27:17.807281 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-84166390-a502-4650-8fae-6587bb09ac89 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:27:17.807748 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-84166390-a502-4650-8fae-6587bb09ac89 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:27:17.808194 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-84166390-a502-4650-8fae-6587bb09ac89 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:27:17.840785 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-84166390-a502-4650-8fae-6587bb09ac89 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] 10.222.0.52 "GET /compute/v2.1/servers/c2d671a7-50ef-4218-b3a8-ef1004247bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049368 Oct 19 04:27:17.841398 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4187/7899] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Oct 19 04:27:17 2022] GET /compute/v2.1/servers/c2d671a7-50ef-4218-b3a8-ef1004247bbd/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:27:18.854586 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9591c293-cab4-4256-abe0-c79b06fbc299 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:27:18.857527 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9591c293-cab4-4256-abe0-c79b06fbc299 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] [instance: c2d671a7-50ef-4218-b3a8-ef1004247bbd] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:27:18.864421 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9591c293-cab4-4256-abe0-c79b06fbc299 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:27:18.864911 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9591c293-cab4-4256-abe0-c79b06fbc299 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:27:18.865360 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9591c293-cab4-4256-abe0-c79b06fbc299 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:27:18.866083 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9591c293-cab4-4256-abe0-c79b06fbc299 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:27:18.866543 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9591c293-cab4-4256-abe0-c79b06fbc299 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:27:18.866971 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9591c293-cab4-4256-abe0-c79b06fbc299 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:27:18.897559 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9591c293-cab4-4256-abe0-c79b06fbc299 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] 10.222.0.52 "GET /compute/v2.1/servers/c2d671a7-50ef-4218-b3a8-ef1004247bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047009 Oct 19 04:27:18.898125 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3713/7900] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Oct 19 04:27:18 2022] GET /compute/v2.1/servers/c2d671a7-50ef-4218-b3a8-ef1004247bbd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:27:19.910631 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b529356e-963c-4130-97b5-2496265d49c4 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:27:19.912782 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b529356e-963c-4130-97b5-2496265d49c4 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] [instance: c2d671a7-50ef-4218-b3a8-ef1004247bbd] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:27:19.920532 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b529356e-963c-4130-97b5-2496265d49c4 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:27:19.921026 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b529356e-963c-4130-97b5-2496265d49c4 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:27:19.921502 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b529356e-963c-4130-97b5-2496265d49c4 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:27:19.922208 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b529356e-963c-4130-97b5-2496265d49c4 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:27:19.922670 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b529356e-963c-4130-97b5-2496265d49c4 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:27:19.923108 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b529356e-963c-4130-97b5-2496265d49c4 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:27:19.954015 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b529356e-963c-4130-97b5-2496265d49c4 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] 10.222.0.52 "GET /compute/v2.1/servers/c2d671a7-50ef-4218-b3a8-ef1004247bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047968 Oct 19 04:27:19.954612 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4188/7901] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Oct 19 04:27:19 2022] GET /compute/v2.1/servers/c2d671a7-50ef-4218-b3a8-ef1004247bbd/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:27:20.965544 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-05f86f1a-56ae-4309-b713-7a731777f608 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:27:20.967755 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-05f86f1a-56ae-4309-b713-7a731777f608 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] [instance: c2d671a7-50ef-4218-b3a8-ef1004247bbd] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:27:20.974754 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-05f86f1a-56ae-4309-b713-7a731777f608 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:27:20.975243 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-05f86f1a-56ae-4309-b713-7a731777f608 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:27:20.975685 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-05f86f1a-56ae-4309-b713-7a731777f608 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:27:20.976379 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-05f86f1a-56ae-4309-b713-7a731777f608 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:27:20.976839 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-05f86f1a-56ae-4309-b713-7a731777f608 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:27:20.977269 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-05f86f1a-56ae-4309-b713-7a731777f608 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:27:21.006839 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-05f86f1a-56ae-4309-b713-7a731777f608 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] 10.222.0.52 "GET /compute/v2.1/servers/c2d671a7-50ef-4218-b3a8-ef1004247bbd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045313 Oct 19 04:27:21.011988 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3714/7902] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Oct 19 04:27:20 2022] GET /compute/v2.1/servers/c2d671a7-50ef-4218-b3a8-ef1004247bbd/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 04:27:21.018991 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-22ea6480-9198-4594-9dba-6d6688bcee08 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:27:21.020116 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-22ea6480-9198-4594-9dba-6d6688bcee08 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] [instance: c2d671a7-50ef-4218-b3a8-ef1004247bbd] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:27:21.027291 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-22ea6480-9198-4594-9dba-6d6688bcee08 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:27:21.028054 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-22ea6480-9198-4594-9dba-6d6688bcee08 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:27:21.028584 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-22ea6480-9198-4594-9dba-6d6688bcee08 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:27:21.029300 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-22ea6480-9198-4594-9dba-6d6688bcee08 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:27:21.029811 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-22ea6480-9198-4594-9dba-6d6688bcee08 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:27:21.030262 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-22ea6480-9198-4594-9dba-6d6688bcee08 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:27:21.106173 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-22ea6480-9198-4594-9dba-6d6688bcee08 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] HTTP exception thrown: Instance c2d671a7-50ef-4218-b3a8-ef1004247bbd is not attached to volume 6ff5ee39-fd6f-4e4f-9aa5-4966115aa69b Oct 19 04:27:21.108179 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-22ea6480-9198-4594-9dba-6d6688bcee08 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Request method failure captured: Oct 19 04:27:21.108179 n-d-861333-8 devstack@n-api.service[121134]: request: DELETE /compute/v2.1/servers/c2d671a7-50ef-4218-b3a8-ef1004247bbd/os-volume_attachments/6ff5ee39-fd6f-4e4f-9aa5-4966115aa69b HTTP/1.1 Oct 19 04:27:21.108179 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 04:27:21.108179 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 04:27:21.108179 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 04:27:21.108179 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 04:27:21.108179 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 04:27:21.108179 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 04:27:21.108179 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 04:27:21.108179 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 04:27:21.108179 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3wqdDgEMgqOfGYpo6UPsYZcytRnRNEpMS-DuFYGENN9V_1doRiaOtFv8ZT0wSClJ40kh1Yqz53GYAf0cdVMT9SDlEYk74QLchdmCrO9f6CgXoa9g1d4H8ZOMnPaRBBrxIY5BdprLz_aDJdf-AEFu-ThGLlzVHszbv67C-U8CHoGL6o Oct 19 04:27:21.108179 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 04:27:21.108179 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 04:27:21.108179 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 04:27:21.108179 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 04:27:21.108179 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 04:27:21.108179 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 04:27:21.108179 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 5f5a48cb267249749641e9e7b9b55102 Oct 19 04:27:21.108179 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-TestEncryptedCinderVolumes-383677399 Oct 19 04:27:21.108179 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 04:27:21.108179 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 04:27:21.108179 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5f5a48cb267249749641e9e7b9b55102"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5f5a48cb267249749641e9e7b9b55102"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5f5a48cb267249749641e9e7b9b55102"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5f5a48cb267249749641e9e7b9b55102", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 04:27:21.108179 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-TestEncryptedCinderVolumes-383677399 Oct 19 04:27:21.108179 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 5f5a48cb267249749641e9e7b9b55102 Oct 19 04:27:21.108179 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-383677399 Oct 19 04:27:21.108179 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-TestEncryptedCinderVolumes-383677399-project Oct 19 04:27:21.108179 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 04:27:21.108179 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 04:27:21.108179 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 48b2e87ad952416d814d03bfbb3c1ca1 Oct 19 04:27:21.108179 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-TestEncryptedCinderVolumes-383677399-project Oct 19 04:27:21.108179 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 04:27:21.108179 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance c2d671a7-50ef-4218-b3a8-ef1004247bbd is not attached to volume 6ff5ee39-fd6f-4e4f-9aa5-4966115aa69b Oct 19 04:27:21.108179 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'server_id': 'c2d671a7-50ef-4218-b3a8-ef1004247bbd', 'id': '6ff5ee39-fd6f-4e4f-9aa5-4966115aa69b'} Oct 19 04:27:21.108179 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 04:27:21.108179 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:27:21.108179 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 19 04:27:21.108179 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 19 04:27:21.108179 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 04:27:21.108179 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 04:27:21.108179 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 19 04:27:21.108179 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 19 04:27:21.108179 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 6ff5ee39-fd6f-4e4f-9aa5-4966115aa69b. Oct 19 04:27:21.108179 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:27:21.108179 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:27:21.108179 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:27:21.108179 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:27:21.108179 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:27:21.108179 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:27:21.108179 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 04:27:21.108179 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 04:27:21.108179 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 04:27:21.108179 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 04:27:21.108179 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 19 04:27:21.108179 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 19 04:27:21.108179 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2d671a7-50ef-4218-b3a8-ef1004247bbd is not attached to volume 6ff5ee39-fd6f-4e4f-9aa5-4966115aa69b Oct 19 04:27:21.108179 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:27:21.108179 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:27:21.108179 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:27:21.108179 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:27:21.108179 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:27:21.108179 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:27:21.112709 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 04:27:21.112709 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 04:27:21.112709 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2d671a7-50ef-4218-b3a8-ef1004247bbd is not attached to volume 6ff5ee39-fd6f-4e4f-9aa5-4966115aa69b Oct 19 04:27:21.112709 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:27:21.112709 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-22ea6480-9198-4594-9dba-6d6688bcee08 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Returning 404 to user: Instance c2d671a7-50ef-4218-b3a8-ef1004247bbd is not attached to volume 6ff5ee39-fd6f-4e4f-9aa5-4966115aa69b {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 04:27:21.112709 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-22ea6480-9198-4594-9dba-6d6688bcee08 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] 10.222.0.52 "DELETE /compute/v2.1/servers/c2d671a7-50ef-4218-b3a8-ef1004247bbd/os-volume_attachments/6ff5ee39-fd6f-4e4f-9aa5-4966115aa69b" status: 404 len: 154 microversion: 2.1 time: 0.095614 Oct 19 04:27:21.112709 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4189/7903] 10.222.0.52 () {58 vars in 1416 bytes} [Wed Oct 19 04:27:21 2022] DELETE /compute/v2.1/servers/c2d671a7-50ef-4218-b3a8-ef1004247bbd/os-volume_attachments/6ff5ee39-fd6f-4e4f-9aa5-4966115aa69b => generated 154 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 04:27:24.612933 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-87287765-4619-4ae6-ac66-d71c7b6b74aa tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:27:24.613750 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-87287765-4619-4ae6-ac66-d71c7b6b74aa tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] [instance: c2d671a7-50ef-4218-b3a8-ef1004247bbd] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:27:24.620905 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-87287765-4619-4ae6-ac66-d71c7b6b74aa tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:27:24.621428 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-87287765-4619-4ae6-ac66-d71c7b6b74aa tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:27:24.621906 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-87287765-4619-4ae6-ac66-d71c7b6b74aa tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:27:24.622607 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-87287765-4619-4ae6-ac66-d71c7b6b74aa tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:27:24.623065 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-87287765-4619-4ae6-ac66-d71c7b6b74aa tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:27:24.623496 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-87287765-4619-4ae6-ac66-d71c7b6b74aa tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:27:24.650538 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-87287765-4619-4ae6-ac66-d71c7b6b74aa tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] [instance: c2d671a7-50ef-4218-b3a8-ef1004247bbd] Going to try to terminate instance {{(pid=121135) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 04:27:24.934205 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-87287765-4619-4ae6-ac66-d71c7b6b74aa tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] 10.222.0.52 "DELETE /compute/v2.1/servers/c2d671a7-50ef-4218-b3a8-ef1004247bbd" status: 204 len: 0 microversion: 2.1 time: 0.325269 Oct 19 04:27:24.936861 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3715/7904] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 04:27:24 2022] DELETE /compute/v2.1/servers/c2d671a7-50ef-4218-b3a8-ef1004247bbd => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 04:27:24.944073 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5d8f7e7a-e08e-4bee-b8dd-0c4e53ae4ddf tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:27:24.944703 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5d8f7e7a-e08e-4bee-b8dd-0c4e53ae4ddf tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] [instance: c2d671a7-50ef-4218-b3a8-ef1004247bbd] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:27:24.955933 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5d8f7e7a-e08e-4bee-b8dd-0c4e53ae4ddf tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:27:24.959878 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5d8f7e7a-e08e-4bee-b8dd-0c4e53ae4ddf tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:27:24.959878 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5d8f7e7a-e08e-4bee-b8dd-0c4e53ae4ddf tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:27:24.959878 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5d8f7e7a-e08e-4bee-b8dd-0c4e53ae4ddf tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:27:24.959878 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5d8f7e7a-e08e-4bee-b8dd-0c4e53ae4ddf tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:27:24.959878 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5d8f7e7a-e08e-4bee-b8dd-0c4e53ae4ddf tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:27:25.091735 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5d8f7e7a-e08e-4bee-b8dd-0c4e53ae4ddf tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b2e87ad952416d814d03bfbb3c1ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5a48cb267249749641e9e7b9b55102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:27:25.100418 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5d8f7e7a-e08e-4bee-b8dd-0c4e53ae4ddf tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] 10.222.0.52 "GET /compute/v2.1/servers/c2d671a7-50ef-4218-b3a8-ef1004247bbd" status: 200 len: 1560 microversion: 2.1 time: 0.160868 Oct 19 04:27:25.101003 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4190/7905] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:27:24 2022] GET /compute/v2.1/servers/c2d671a7-50ef-4218-b3a8-ef1004247bbd => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:27:26.124527 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c7602e2f-2c7a-4de1-8f73-db52814ff8a2 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:27:26.125225 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c7602e2f-2c7a-4de1-8f73-db52814ff8a2 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] [instance: c2d671a7-50ef-4218-b3a8-ef1004247bbd] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:27:26.132237 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c7602e2f-2c7a-4de1-8f73-db52814ff8a2 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:27:26.132722 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c7602e2f-2c7a-4de1-8f73-db52814ff8a2 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:27:26.133159 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c7602e2f-2c7a-4de1-8f73-db52814ff8a2 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:27:26.133877 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c7602e2f-2c7a-4de1-8f73-db52814ff8a2 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:27:26.134330 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c7602e2f-2c7a-4de1-8f73-db52814ff8a2 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:27:26.134756 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c7602e2f-2c7a-4de1-8f73-db52814ff8a2 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:27:26.343478 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c7602e2f-2c7a-4de1-8f73-db52814ff8a2 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b2e87ad952416d814d03bfbb3c1ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5a48cb267249749641e9e7b9b55102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:27:26.351988 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c7602e2f-2c7a-4de1-8f73-db52814ff8a2 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] 10.222.0.52 "GET /compute/v2.1/servers/c2d671a7-50ef-4218-b3a8-ef1004247bbd" status: 200 len: 1560 microversion: 2.1 time: 0.231736 Oct 19 04:27:26.352567 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3716/7906] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:27:26 2022] GET /compute/v2.1/servers/c2d671a7-50ef-4218-b3a8-ef1004247bbd => generated 1560 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:27:27.087820 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-2cf1f7e4-efab-43de-8a3b-aabbaa494025 req-0a338bd7-1653-478c-b06b-a98f78b529bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2d671a7-50ef-4218-b3a8-ef1004247bbd", "name": "network-vif-deleted", "tag": "3aa19a70-9c07-4f8a-88e4-a5612f32810e"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:27:27.098850 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-2cf1f7e4-efab-43de-8a3b-aabbaa494025 req-0a338bd7-1653-478c-b06b-a98f78b529bf service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:27:27.099347 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-2cf1f7e4-efab-43de-8a3b-aabbaa494025 req-0a338bd7-1653-478c-b06b-a98f78b529bf service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:27:27.099794 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-2cf1f7e4-efab-43de-8a3b-aabbaa494025 req-0a338bd7-1653-478c-b06b-a98f78b529bf service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:27:27.111153 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-2cf1f7e4-efab-43de-8a3b-aabbaa494025 req-0a338bd7-1653-478c-b06b-a98f78b529bf service nova] Creating event network-vif-deleted:3aa19a70-9c07-4f8a-88e4-a5612f32810e for instance c2d671a7-50ef-4218-b3a8-ef1004247bbd on n-h2-861333-8 Oct 19 04:27:27.116854 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-2cf1f7e4-efab-43de-8a3b-aabbaa494025 req-0a338bd7-1653-478c-b06b-a98f78b529bf service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032866 Oct 19 04:27:27.117494 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4191/7907] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:27:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:27:27.375665 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9cbc5fbf-56ee-47e3-8b07-8ba6052785da tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:27:27.377729 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9cbc5fbf-56ee-47e3-8b07-8ba6052785da tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] [instance: c2d671a7-50ef-4218-b3a8-ef1004247bbd] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:27:27.384763 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9cbc5fbf-56ee-47e3-8b07-8ba6052785da tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:27:27.385571 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9cbc5fbf-56ee-47e3-8b07-8ba6052785da tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:27:27.386057 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9cbc5fbf-56ee-47e3-8b07-8ba6052785da tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:27:27.386780 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9cbc5fbf-56ee-47e3-8b07-8ba6052785da tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:27:27.387242 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9cbc5fbf-56ee-47e3-8b07-8ba6052785da tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:27:27.387677 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9cbc5fbf-56ee-47e3-8b07-8ba6052785da tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:27:27.426216 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9cbc5fbf-56ee-47e3-8b07-8ba6052785da tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:27:27.427366 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9cbc5fbf-56ee-47e3-8b07-8ba6052785da tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:27:27.427806 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9cbc5fbf-56ee-47e3-8b07-8ba6052785da tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:27:27.428288 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-9cbc5fbf-56ee-47e3-8b07-8ba6052785da tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lazy-loading 'fault' on Instance uuid c2d671a7-50ef-4218-b3a8-ef1004247bbd {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 04:27:27.476238 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-9cbc5fbf-56ee-47e3-8b07-8ba6052785da tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b2e87ad952416d814d03bfbb3c1ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5a48cb267249749641e9e7b9b55102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:27:27.484350 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9cbc5fbf-56ee-47e3-8b07-8ba6052785da tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] 10.222.0.52 "GET /compute/v2.1/servers/c2d671a7-50ef-4218-b3a8-ef1004247bbd" status: 200 len: 1352 microversion: 2.1 time: 0.112710 Oct 19 04:27:27.484954 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3717/7908] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:27:27 2022] GET /compute/v2.1/servers/c2d671a7-50ef-4218-b3a8-ef1004247bbd => generated 1352 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:27:28.512545 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-40edeb6a-1c94-421a-9502-f9af4a386fac tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:27:28.513195 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-40edeb6a-1c94-421a-9502-f9af4a386fac tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] [instance: c2d671a7-50ef-4218-b3a8-ef1004247bbd] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:27:28.521167 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-40edeb6a-1c94-421a-9502-f9af4a386fac tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:27:28.521705 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-40edeb6a-1c94-421a-9502-f9af4a386fac tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:27:28.522169 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-40edeb6a-1c94-421a-9502-f9af4a386fac tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:27:28.522894 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-40edeb6a-1c94-421a-9502-f9af4a386fac tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:27:28.523365 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-40edeb6a-1c94-421a-9502-f9af4a386fac tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:27:28.523814 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-40edeb6a-1c94-421a-9502-f9af4a386fac tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:27:28.537505 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-40edeb6a-1c94-421a-9502-f9af4a386fac tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] HTTP exception thrown: Instance c2d671a7-50ef-4218-b3a8-ef1004247bbd could not be found. Oct 19 04:27:28.539130 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-40edeb6a-1c94-421a-9502-f9af4a386fac tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Request method failure captured: Oct 19 04:27:28.539130 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/c2d671a7-50ef-4218-b3a8-ef1004247bbd HTTP/1.1 Oct 19 04:27:28.539130 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 04:27:28.539130 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 04:27:28.539130 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 04:27:28.539130 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 04:27:28.539130 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 04:27:28.539130 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 04:27:28.539130 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 04:27:28.539130 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 04:27:28.539130 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3wqdDgEMgqOfGYpo6UPsYZcytRnRNEpMS-DuFYGENN9V_1doRiaOtFv8ZT0wSClJ40kh1Yqz53GYAf0cdVMT9SDlEYk74QLchdmCrO9f6CgXoa9g1d4H8ZOMnPaRBBrxIY5BdprLz_aDJdf-AEFu-ThGLlzVHszbv67C-U8CHoGL6o Oct 19 04:27:28.539130 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 04:27:28.539130 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 04:27:28.539130 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 04:27:28.539130 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 04:27:28.539130 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 04:27:28.539130 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 04:27:28.539130 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 5f5a48cb267249749641e9e7b9b55102 Oct 19 04:27:28.539130 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-TestEncryptedCinderVolumes-383677399 Oct 19 04:27:28.539130 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 04:27:28.539130 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 04:27:28.539130 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5f5a48cb267249749641e9e7b9b55102"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5f5a48cb267249749641e9e7b9b55102"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5f5a48cb267249749641e9e7b9b55102"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5f5a48cb267249749641e9e7b9b55102", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 04:27:28.539130 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-TestEncryptedCinderVolumes-383677399 Oct 19 04:27:28.539130 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 5f5a48cb267249749641e9e7b9b55102 Oct 19 04:27:28.539130 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-383677399 Oct 19 04:27:28.539130 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-TestEncryptedCinderVolumes-383677399-project Oct 19 04:27:28.539130 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 04:27:28.539130 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 04:27:28.539130 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 48b2e87ad952416d814d03bfbb3c1ca1 Oct 19 04:27:28.539130 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-TestEncryptedCinderVolumes-383677399-project Oct 19 04:27:28.539130 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 04:27:28.539130 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance c2d671a7-50ef-4218-b3a8-ef1004247bbd could not be found. Oct 19 04:27:28.539130 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': 'c2d671a7-50ef-4218-b3a8-ef1004247bbd'} Oct 19 04:27:28.539130 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 04:27:28.539130 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:27:28.539130 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 04:27:28.539130 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 04:27:28.539130 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 04:27:28.539130 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 04:27:28.539130 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 04:27:28.539130 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 04:27:28.539130 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 04:27:28.539130 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 04:27:28.539130 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2d671a7-50ef-4218-b3a8-ef1004247bbd could not be found. Oct 19 04:27:28.539130 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:27:28.539130 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:27:28.539130 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:27:28.539130 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:27:28.539130 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:27:28.539130 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:27:28.539130 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 04:27:28.539130 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 04:27:28.539130 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 04:27:28.539130 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 04:27:28.539130 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 04:27:28.539130 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 04:27:28.539130 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 04:27:28.539130 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 04:27:28.539130 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 04:27:28.539130 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 04:27:28.539130 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2d671a7-50ef-4218-b3a8-ef1004247bbd could not be found. Oct 19 04:27:28.539130 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:27:28.539130 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:27:28.539130 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:27:28.543430 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:27:28.543430 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:27:28.543430 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:27:28.543430 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 04:27:28.543430 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 04:27:28.543430 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2d671a7-50ef-4218-b3a8-ef1004247bbd could not be found. Oct 19 04:27:28.543430 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:27:28.543430 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-40edeb6a-1c94-421a-9502-f9af4a386fac tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Returning 404 to user: Instance c2d671a7-50ef-4218-b3a8-ef1004247bbd could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 04:27:28.543430 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-40edeb6a-1c94-421a-9502-f9af4a386fac tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] 10.222.0.52 "GET /compute/v2.1/servers/c2d671a7-50ef-4218-b3a8-ef1004247bbd" status: 404 len: 111 microversion: 2.1 time: 0.036199 Oct 19 04:27:28.543430 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4192/7909] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:27:28 2022] GET /compute/v2.1/servers/c2d671a7-50ef-4218-b3a8-ef1004247bbd => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 04:27:28.549329 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2030e2a8-9182-4076-bac9-7f2d4f731874 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] Calling method '.version_select at 0x7fc12bf483a0>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:27:28.632122 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2030e2a8-9182-4076-bac9-7f2d4f731874 tempest-TestEncryptedCinderVolumes-383677399 tempest-TestEncryptedCinderVolumes-383677399-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-2057225205" status: 202 len: 0 microversion: 2.1 time: 0.086587 Oct 19 04:27:28.632705 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3718/7910] 10.222.0.52 () {58 vars in 1278 bytes} [Wed Oct 19 04:27:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-2057225205 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 04:28:01.287696 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d86f297c-e820-4c2d-a69b-54a7e3aee8d5 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Action: 'create', calling method: .version_select at 0x7fc130b741f0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1336182853", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAWGAAirJ/Ve9cx01eK4WNl8cfa/JiSVbzDDk9KcEFcuW94jsobtD66hHzDwg4OtLrOCpD2JNdHI1sw/Co5i41ZjmoBD8DqjU/+D68QRNoEMdHT/i1q2wkmsuBItMAWnCA=="}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:28:01.294263 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=14 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:28:01.294933 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=34 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:28:01.305860 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-d86f297c-e820-4c2d-a69b-54a7e3aee8d5 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Getting quotas for project 0bb5ad698ae94dceabc0e4a5b39567a7. Resources: {'key_pairs'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 04:28:01.311892 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-d86f297c-e820-4c2d-a69b-54a7e3aee8d5 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Getting quotas for user 33c04ff6cc2c4fd5a51b1e2325c4c8de and project 0bb5ad698ae94dceabc0e4a5b39567a7. Resources: {'key_pairs'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 04:28:01.423605 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d86f297c-e820-4c2d-a69b-54a7e3aee8d5 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.140168 Oct 19 04:28:01.424231 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4193/7911] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Oct 19 04:28:01 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:28:01.472094 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:28:01.472888 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:28:01.476956 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-76c49ba5-c36f-45d4-b6e1-0065facb9cbb tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1018460835", "imageRef": "db6b92d7-fd9a-4250-9331-4622ad70dfb9", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1336182853", "networks": [{"uuid": "bef0c42e-c476-443a-8a1a-f4f4e18f608c"}]}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:28:01.529707 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.network.neutron [None req-76c49ba5-c36f-45d4-b6e1-0065facb9cbb tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] validate_networks() for [('bef0c42e-c476-443a-8a1a-f4f4e18f608c', None, None, None, None, None)] {{(pid=121135) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 04:28:01.896655 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-76c49ba5-c36f-45d4-b6e1-0065facb9cbb tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Flavor limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 04:28:01.897080 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-76c49ba5-c36f-45d4-b6e1-0065facb9cbb tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Image limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 04:28:01.897607 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-76c49ba5-c36f-45d4-b6e1-0065facb9cbb tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Flavor pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 04:28:01.898022 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-76c49ba5-c36f-45d4-b6e1-0065facb9cbb tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Image pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 04:28:01.898439 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-76c49ba5-c36f-45d4-b6e1-0065facb9cbb tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 04:28:01.907851 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-76c49ba5-c36f-45d4-b6e1-0065facb9cbb tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:28:01.908270 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-76c49ba5-c36f-45d4-b6e1-0065facb9cbb tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:28:01.908712 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-76c49ba5-c36f-45d4-b6e1-0065facb9cbb tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:28:01.909477 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-76c49ba5-c36f-45d4-b6e1-0065facb9cbb tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:28:01.910525 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-76c49ba5-c36f-45d4-b6e1-0065facb9cbb tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:28:01.910878 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-76c49ba5-c36f-45d4-b6e1-0065facb9cbb tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:28:01.928151 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-76c49ba5-c36f-45d4-b6e1-0065facb9cbb tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Getting quotas for project 0bb5ad698ae94dceabc0e4a5b39567a7. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 04:28:01.933529 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-76c49ba5-c36f-45d4-b6e1-0065facb9cbb tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Getting quotas for user 33c04ff6cc2c4fd5a51b1e2325c4c8de and project 0bb5ad698ae94dceabc0e4a5b39567a7. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 04:28:01.946004 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-76c49ba5-c36f-45d4-b6e1-0065facb9cbb tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Going to run 1 instances... {{(pid=121135) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 04:28:01.948326 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-76c49ba5-c36f-45d4-b6e1-0065facb9cbb tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] [instance: 4b29db1b-c3de-410a-b3ca-fec68fa11f60] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db6b92d7-fd9a-4250-9331-4622ad70dfb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121135) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 04:28:02.069284 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-76c49ba5-c36f-45d4-b6e1-0065facb9cbb tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.599286 Oct 19 04:28:02.069973 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3719/7912] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 04:28:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 601 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 04:28:02.081037 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-99510655-a119-41cd-8ed6-1e4ee9bee6e4 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:28:02.081825 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-99510655-a119-41cd-8ed6-1e4ee9bee6e4 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] [instance: 4b29db1b-c3de-410a-b3ca-fec68fa11f60] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:28:02.143444 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-99510655-a119-41cd-8ed6-1e4ee9bee6e4 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c04ff6cc2c4fd5a51b1e2325c4c8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb5ad698ae94dceabc0e4a5b39567a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:28:02.150837 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-99510655-a119-41cd-8ed6-1e4ee9bee6e4 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] 10.222.0.52 "GET /compute/v2.1/servers/4b29db1b-c3de-410a-b3ca-fec68fa11f60" status: 200 len: 1259 microversion: 2.1 time: 0.073710 Oct 19 04:28:02.151582 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4194/7913] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:28:02 2022] GET /compute/v2.1/servers/4b29db1b-c3de-410a-b3ca-fec68fa11f60 => generated 1259 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:28:03.174725 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3d49fc15-f9f6-4c5e-b2df-b60f38edda28 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:28:03.175339 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-3d49fc15-f9f6-4c5e-b2df-b60f38edda28 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] [instance: 4b29db1b-c3de-410a-b3ca-fec68fa11f60] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:28:03.231098 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-3d49fc15-f9f6-4c5e-b2df-b60f38edda28 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c04ff6cc2c4fd5a51b1e2325c4c8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb5ad698ae94dceabc0e4a5b39567a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:28:03.238076 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-3d49fc15-f9f6-4c5e-b2df-b60f38edda28 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] 10.222.0.52 "GET /compute/v2.1/servers/4b29db1b-c3de-410a-b3ca-fec68fa11f60" status: 200 len: 1259 microversion: 2.1 time: 0.067347 Oct 19 04:28:03.238665 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3720/7914] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:28:03 2022] GET /compute/v2.1/servers/4b29db1b-c3de-410a-b3ca-fec68fa11f60 => generated 1259 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:28:04.261201 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-28ef5d8c-1901-411c-b685-ab3a1dac2d9c tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:28:04.261794 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-28ef5d8c-1901-411c-b685-ab3a1dac2d9c tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] [instance: 4b29db1b-c3de-410a-b3ca-fec68fa11f60] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:28:04.268919 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-28ef5d8c-1901-411c-b685-ab3a1dac2d9c tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:28:04.269537 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-28ef5d8c-1901-411c-b685-ab3a1dac2d9c tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:28:04.270529 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-28ef5d8c-1901-411c-b685-ab3a1dac2d9c tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:28:04.271247 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-28ef5d8c-1901-411c-b685-ab3a1dac2d9c tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:28:04.271718 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-28ef5d8c-1901-411c-b685-ab3a1dac2d9c tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:28:04.272166 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-28ef5d8c-1901-411c-b685-ab3a1dac2d9c tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:28:04.335847 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-28ef5d8c-1901-411c-b685-ab3a1dac2d9c tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c04ff6cc2c4fd5a51b1e2325c4c8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb5ad698ae94dceabc0e4a5b39567a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:28:04.343711 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-28ef5d8c-1901-411c-b685-ab3a1dac2d9c tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] 10.222.0.52 "GET /compute/v2.1/servers/4b29db1b-c3de-410a-b3ca-fec68fa11f60" status: 200 len: 1311 microversion: 2.1 time: 0.086517 Oct 19 04:28:04.344294 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4195/7915] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:28:04 2022] GET /compute/v2.1/servers/4b29db1b-c3de-410a-b3ca-fec68fa11f60 => generated 1311 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:28:05.371130 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-666ce20f-6626-44d6-9fe0-fb1aa17d7d69 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:28:05.371703 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-666ce20f-6626-44d6-9fe0-fb1aa17d7d69 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] [instance: 4b29db1b-c3de-410a-b3ca-fec68fa11f60] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:28:05.389065 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-666ce20f-6626-44d6-9fe0-fb1aa17d7d69 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:28:05.390817 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-666ce20f-6626-44d6-9fe0-fb1aa17d7d69 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:28:05.391289 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-666ce20f-6626-44d6-9fe0-fb1aa17d7d69 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:28:05.402425 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-666ce20f-6626-44d6-9fe0-fb1aa17d7d69 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:28:05.402425 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-666ce20f-6626-44d6-9fe0-fb1aa17d7d69 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:28:05.402425 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-666ce20f-6626-44d6-9fe0-fb1aa17d7d69 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:28:05.594416 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-666ce20f-6626-44d6-9fe0-fb1aa17d7d69 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c04ff6cc2c4fd5a51b1e2325c4c8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb5ad698ae94dceabc0e4a5b39567a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:28:05.603617 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-666ce20f-6626-44d6-9fe0-fb1aa17d7d69 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] 10.222.0.52 "GET /compute/v2.1/servers/4b29db1b-c3de-410a-b3ca-fec68fa11f60" status: 200 len: 1359 microversion: 2.1 time: 0.236636 Oct 19 04:28:05.605268 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3721/7916] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:28:05 2022] GET /compute/v2.1/servers/4b29db1b-c3de-410a-b3ca-fec68fa11f60 => generated 1359 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:28:06.628200 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-cfc703ba-de02-44a0-832d-b76f01d827a6 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:28:06.629050 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-cfc703ba-de02-44a0-832d-b76f01d827a6 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] [instance: 4b29db1b-c3de-410a-b3ca-fec68fa11f60] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:28:06.636159 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cfc703ba-de02-44a0-832d-b76f01d827a6 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:28:06.636664 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cfc703ba-de02-44a0-832d-b76f01d827a6 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:28:06.637119 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cfc703ba-de02-44a0-832d-b76f01d827a6 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:28:06.637875 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cfc703ba-de02-44a0-832d-b76f01d827a6 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:28:06.638348 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cfc703ba-de02-44a0-832d-b76f01d827a6 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:28:06.639046 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-cfc703ba-de02-44a0-832d-b76f01d827a6 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:28:06.778688 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-cfc703ba-de02-44a0-832d-b76f01d827a6 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c04ff6cc2c4fd5a51b1e2325c4c8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb5ad698ae94dceabc0e4a5b39567a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:28:06.791150 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-cfc703ba-de02-44a0-832d-b76f01d827a6 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] 10.222.0.52 "GET /compute/v2.1/servers/4b29db1b-c3de-410a-b3ca-fec68fa11f60" status: 200 len: 1359 microversion: 2.1 time: 0.166900 Oct 19 04:28:06.792812 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4196/7917] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:28:06 2022] GET /compute/v2.1/servers/4b29db1b-c3de-410a-b3ca-fec68fa11f60 => generated 1359 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:28:07.816738 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1162af7f-e7ea-47bc-a099-86c0c65b4dc0 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:28:07.818104 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1162af7f-e7ea-47bc-a099-86c0c65b4dc0 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] [instance: 4b29db1b-c3de-410a-b3ca-fec68fa11f60] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:28:07.826815 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1162af7f-e7ea-47bc-a099-86c0c65b4dc0 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:28:07.827741 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1162af7f-e7ea-47bc-a099-86c0c65b4dc0 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:28:07.828627 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1162af7f-e7ea-47bc-a099-86c0c65b4dc0 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:28:07.829438 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1162af7f-e7ea-47bc-a099-86c0c65b4dc0 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:28:07.829971 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1162af7f-e7ea-47bc-a099-86c0c65b4dc0 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:28:07.830475 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1162af7f-e7ea-47bc-a099-86c0c65b4dc0 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:28:07.966279 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-1162af7f-e7ea-47bc-a099-86c0c65b4dc0 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c04ff6cc2c4fd5a51b1e2325c4c8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb5ad698ae94dceabc0e4a5b39567a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:28:07.975390 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1162af7f-e7ea-47bc-a099-86c0c65b4dc0 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] 10.222.0.52 "GET /compute/v2.1/servers/4b29db1b-c3de-410a-b3ca-fec68fa11f60" status: 200 len: 1359 microversion: 2.1 time: 0.162625 Oct 19 04:28:07.976717 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3722/7918] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:28:07 2022] GET /compute/v2.1/servers/4b29db1b-c3de-410a-b3ca-fec68fa11f60 => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:28:09.000712 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-79f260fb-7f3b-4b97-92d5-981b816ecf18 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:28:09.001683 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-79f260fb-7f3b-4b97-92d5-981b816ecf18 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] [instance: 4b29db1b-c3de-410a-b3ca-fec68fa11f60] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:28:09.008733 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-79f260fb-7f3b-4b97-92d5-981b816ecf18 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:28:09.009241 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-79f260fb-7f3b-4b97-92d5-981b816ecf18 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:28:09.009733 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-79f260fb-7f3b-4b97-92d5-981b816ecf18 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:28:09.010454 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-79f260fb-7f3b-4b97-92d5-981b816ecf18 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:28:09.010922 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-79f260fb-7f3b-4b97-92d5-981b816ecf18 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:28:09.011362 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-79f260fb-7f3b-4b97-92d5-981b816ecf18 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:28:09.148239 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-79f260fb-7f3b-4b97-92d5-981b816ecf18 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c04ff6cc2c4fd5a51b1e2325c4c8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb5ad698ae94dceabc0e4a5b39567a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:28:09.156303 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-79f260fb-7f3b-4b97-92d5-981b816ecf18 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] 10.222.0.52 "GET /compute/v2.1/servers/4b29db1b-c3de-410a-b3ca-fec68fa11f60" status: 200 len: 1359 microversion: 2.1 time: 0.160295 Oct 19 04:28:09.156887 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4197/7919] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:28:08 2022] GET /compute/v2.1/servers/4b29db1b-c3de-410a-b3ca-fec68fa11f60 => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:28:10.182423 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-cbb71edb-92d7-40aa-983f-b68cbdf4bea0 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:28:10.183214 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-cbb71edb-92d7-40aa-983f-b68cbdf4bea0 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] [instance: 4b29db1b-c3de-410a-b3ca-fec68fa11f60] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:28:10.190846 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cbb71edb-92d7-40aa-983f-b68cbdf4bea0 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:28:10.191534 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cbb71edb-92d7-40aa-983f-b68cbdf4bea0 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:28:10.192071 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cbb71edb-92d7-40aa-983f-b68cbdf4bea0 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:28:10.192865 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cbb71edb-92d7-40aa-983f-b68cbdf4bea0 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:28:10.193427 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cbb71edb-92d7-40aa-983f-b68cbdf4bea0 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:28:10.193922 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cbb71edb-92d7-40aa-983f-b68cbdf4bea0 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:28:10.337686 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-cbb71edb-92d7-40aa-983f-b68cbdf4bea0 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c04ff6cc2c4fd5a51b1e2325c4c8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb5ad698ae94dceabc0e4a5b39567a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:28:10.345640 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-cbb71edb-92d7-40aa-983f-b68cbdf4bea0 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] 10.222.0.52 "GET /compute/v2.1/servers/4b29db1b-c3de-410a-b3ca-fec68fa11f60" status: 200 len: 1359 microversion: 2.1 time: 0.167299 Oct 19 04:28:10.346230 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3723/7920] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:28:10 2022] GET /compute/v2.1/servers/4b29db1b-c3de-410a-b3ca-fec68fa11f60 => generated 1359 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:28:11.370606 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b72450db-b0ee-4a79-9bb0-f4045d11a30d tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:28:11.371286 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b72450db-b0ee-4a79-9bb0-f4045d11a30d tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] [instance: 4b29db1b-c3de-410a-b3ca-fec68fa11f60] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:28:11.380865 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b72450db-b0ee-4a79-9bb0-f4045d11a30d tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:28:11.381708 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b72450db-b0ee-4a79-9bb0-f4045d11a30d tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:28:11.382241 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b72450db-b0ee-4a79-9bb0-f4045d11a30d tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:28:11.383385 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b72450db-b0ee-4a79-9bb0-f4045d11a30d tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:28:11.384113 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b72450db-b0ee-4a79-9bb0-f4045d11a30d tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:28:11.384652 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b72450db-b0ee-4a79-9bb0-f4045d11a30d tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:28:11.556851 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b72450db-b0ee-4a79-9bb0-f4045d11a30d tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c04ff6cc2c4fd5a51b1e2325c4c8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb5ad698ae94dceabc0e4a5b39567a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:28:11.565209 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b72450db-b0ee-4a79-9bb0-f4045d11a30d tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] 10.222.0.52 "GET /compute/v2.1/servers/4b29db1b-c3de-410a-b3ca-fec68fa11f60" status: 200 len: 1359 microversion: 2.1 time: 0.198439 Oct 19 04:28:11.567917 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4198/7921] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:28:11 2022] GET /compute/v2.1/servers/4b29db1b-c3de-410a-b3ca-fec68fa11f60 => generated 1359 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:28:12.591270 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-da8a1686-0cb5-40fb-b2ee-b12f6c508318 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:28:12.592685 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-da8a1686-0cb5-40fb-b2ee-b12f6c508318 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] [instance: 4b29db1b-c3de-410a-b3ca-fec68fa11f60] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:28:12.596054 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:28:12.602217 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-da8a1686-0cb5-40fb-b2ee-b12f6c508318 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:28:12.604539 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-da8a1686-0cb5-40fb-b2ee-b12f6c508318 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:28:12.604539 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-da8a1686-0cb5-40fb-b2ee-b12f6c508318 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:28:12.604539 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-da8a1686-0cb5-40fb-b2ee-b12f6c508318 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:28:12.605462 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-da8a1686-0cb5-40fb-b2ee-b12f6c508318 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:28:12.605970 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-da8a1686-0cb5-40fb-b2ee-b12f6c508318 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:28:12.758137 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-da8a1686-0cb5-40fb-b2ee-b12f6c508318 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c04ff6cc2c4fd5a51b1e2325c4c8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb5ad698ae94dceabc0e4a5b39567a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:28:12.769795 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-da8a1686-0cb5-40fb-b2ee-b12f6c508318 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] 10.222.0.52 "GET /compute/v2.1/servers/4b29db1b-c3de-410a-b3ca-fec68fa11f60" status: 200 len: 1359 microversion: 2.1 time: 0.181643 Oct 19 04:28:12.770423 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3724/7922] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:28:12 2022] GET /compute/v2.1/servers/4b29db1b-c3de-410a-b3ca-fec68fa11f60 => generated 1359 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:28:13.799560 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1d0df968-bc10-4616-a4a4-ea59123a08cb tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:28:13.803745 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1d0df968-bc10-4616-a4a4-ea59123a08cb tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] [instance: 4b29db1b-c3de-410a-b3ca-fec68fa11f60] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:28:13.806785 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=6 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:28:13.815811 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1d0df968-bc10-4616-a4a4-ea59123a08cb tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:28:13.817788 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1d0df968-bc10-4616-a4a4-ea59123a08cb tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:28:13.818252 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1d0df968-bc10-4616-a4a4-ea59123a08cb tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:28:13.818998 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1d0df968-bc10-4616-a4a4-ea59123a08cb tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:28:13.819479 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1d0df968-bc10-4616-a4a4-ea59123a08cb tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:28:13.819930 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1d0df968-bc10-4616-a4a4-ea59123a08cb tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:28:14.197808 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-1d0df968-bc10-4616-a4a4-ea59123a08cb tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c04ff6cc2c4fd5a51b1e2325c4c8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb5ad698ae94dceabc0e4a5b39567a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:28:14.208467 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1d0df968-bc10-4616-a4a4-ea59123a08cb tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] 10.222.0.52 "GET /compute/v2.1/servers/4b29db1b-c3de-410a-b3ca-fec68fa11f60" status: 200 len: 1359 microversion: 2.1 time: 0.415703 Oct 19 04:28:14.209400 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4199/7923] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:28:13 2022] GET /compute/v2.1/servers/4b29db1b-c3de-410a-b3ca-fec68fa11f60 => generated 1359 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:28:14.956322 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-1ddb1c79-7f7d-44f0-9d3e-a793935c983a req-a7086a17-a8de-4e97-be98-0a05f94662c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b29db1b-c3de-410a-b3ca-fec68fa11f60", "tag": "929acdb0-a17d-4396-b4aa-81eba2606c14"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:28:14.962457 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=8 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:28:14.970415 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-1ddb1c79-7f7d-44f0-9d3e-a793935c983a req-a7086a17-a8de-4e97-be98-0a05f94662c1 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:28:14.970901 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-1ddb1c79-7f7d-44f0-9d3e-a793935c983a req-a7086a17-a8de-4e97-be98-0a05f94662c1 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:28:14.971344 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-1ddb1c79-7f7d-44f0-9d3e-a793935c983a req-a7086a17-a8de-4e97-be98-0a05f94662c1 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:28:14.983374 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-1ddb1c79-7f7d-44f0-9d3e-a793935c983a req-a7086a17-a8de-4e97-be98-0a05f94662c1 service nova] Creating event network-changed:929acdb0-a17d-4396-b4aa-81eba2606c14 for instance 4b29db1b-c3de-410a-b3ca-fec68fa11f60 on n-h2-861333-8 Oct 19 04:28:14.989082 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-1ddb1c79-7f7d-44f0-9d3e-a793935c983a req-a7086a17-a8de-4e97-be98-0a05f94662c1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036698 Oct 19 04:28:14.989728 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3725/7924] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:28:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 04:28:15.235564 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f60e5e58-9e97-4220-8a76-5b3e58560310 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:28:15.236218 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f60e5e58-9e97-4220-8a76-5b3e58560310 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] [instance: 4b29db1b-c3de-410a-b3ca-fec68fa11f60] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:28:15.243661 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f60e5e58-9e97-4220-8a76-5b3e58560310 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:28:15.244177 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f60e5e58-9e97-4220-8a76-5b3e58560310 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:28:15.244640 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f60e5e58-9e97-4220-8a76-5b3e58560310 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:28:15.245389 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f60e5e58-9e97-4220-8a76-5b3e58560310 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:28:15.245864 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f60e5e58-9e97-4220-8a76-5b3e58560310 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:28:15.246319 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f60e5e58-9e97-4220-8a76-5b3e58560310 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:28:15.468955 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-f60e5e58-9e97-4220-8a76-5b3e58560310 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c04ff6cc2c4fd5a51b1e2325c4c8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb5ad698ae94dceabc0e4a5b39567a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:28:15.476628 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f60e5e58-9e97-4220-8a76-5b3e58560310 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] 10.222.0.52 "GET /compute/v2.1/servers/4b29db1b-c3de-410a-b3ca-fec68fa11f60" status: 200 len: 1359 microversion: 2.1 time: 0.245292 Oct 19 04:28:15.477203 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4200/7925] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:28:15 2022] GET /compute/v2.1/servers/4b29db1b-c3de-410a-b3ca-fec68fa11f60 => generated 1359 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:28:16.501286 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-27158b1f-1ce0-457e-b978-7705bd3aaaec tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:28:16.502019 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-27158b1f-1ce0-457e-b978-7705bd3aaaec tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] [instance: 4b29db1b-c3de-410a-b3ca-fec68fa11f60] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:28:16.509150 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-27158b1f-1ce0-457e-b978-7705bd3aaaec tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:28:16.509657 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-27158b1f-1ce0-457e-b978-7705bd3aaaec tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:28:16.510095 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-27158b1f-1ce0-457e-b978-7705bd3aaaec tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:28:16.510786 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-27158b1f-1ce0-457e-b978-7705bd3aaaec tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:28:16.511238 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-27158b1f-1ce0-457e-b978-7705bd3aaaec tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:28:16.511661 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-27158b1f-1ce0-457e-b978-7705bd3aaaec tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:28:16.646844 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-27158b1f-1ce0-457e-b978-7705bd3aaaec tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c04ff6cc2c4fd5a51b1e2325c4c8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb5ad698ae94dceabc0e4a5b39567a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:28:16.654801 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-27158b1f-1ce0-457e-b978-7705bd3aaaec tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] 10.222.0.52 "GET /compute/v2.1/servers/4b29db1b-c3de-410a-b3ca-fec68fa11f60" status: 200 len: 1359 microversion: 2.1 time: 0.159203 Oct 19 04:28:16.655388 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3726/7926] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:28:16 2022] GET /compute/v2.1/servers/4b29db1b-c3de-410a-b3ca-fec68fa11f60 => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:28:17.677909 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a7ff2599-f0b7-42ff-a845-e607e21c9379 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:28:17.678548 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a7ff2599-f0b7-42ff-a845-e607e21c9379 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] [instance: 4b29db1b-c3de-410a-b3ca-fec68fa11f60] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:28:17.685398 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a7ff2599-f0b7-42ff-a845-e607e21c9379 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:28:17.685914 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a7ff2599-f0b7-42ff-a845-e607e21c9379 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:28:17.686369 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a7ff2599-f0b7-42ff-a845-e607e21c9379 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:28:17.687078 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a7ff2599-f0b7-42ff-a845-e607e21c9379 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:28:17.687547 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a7ff2599-f0b7-42ff-a845-e607e21c9379 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:28:17.687989 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a7ff2599-f0b7-42ff-a845-e607e21c9379 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:28:17.815435 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a7ff2599-f0b7-42ff-a845-e607e21c9379 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c04ff6cc2c4fd5a51b1e2325c4c8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb5ad698ae94dceabc0e4a5b39567a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:28:17.823773 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a7ff2599-f0b7-42ff-a845-e607e21c9379 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] 10.222.0.52 "GET /compute/v2.1/servers/4b29db1b-c3de-410a-b3ca-fec68fa11f60" status: 200 len: 1359 microversion: 2.1 time: 0.149911 Oct 19 04:28:17.824456 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4201/7927] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:28:17 2022] GET /compute/v2.1/servers/4b29db1b-c3de-410a-b3ca-fec68fa11f60 => generated 1359 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:28:18.847902 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0135219d-6498-42b3-9e6c-a2287d4aad2e tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:28:18.848598 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0135219d-6498-42b3-9e6c-a2287d4aad2e tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] [instance: 4b29db1b-c3de-410a-b3ca-fec68fa11f60] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:28:18.855572 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0135219d-6498-42b3-9e6c-a2287d4aad2e tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:28:18.856068 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0135219d-6498-42b3-9e6c-a2287d4aad2e tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:28:18.856517 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0135219d-6498-42b3-9e6c-a2287d4aad2e tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:28:18.857226 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0135219d-6498-42b3-9e6c-a2287d4aad2e tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:28:18.857714 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0135219d-6498-42b3-9e6c-a2287d4aad2e tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:28:18.858179 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0135219d-6498-42b3-9e6c-a2287d4aad2e tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:28:18.990157 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-0135219d-6498-42b3-9e6c-a2287d4aad2e tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c04ff6cc2c4fd5a51b1e2325c4c8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb5ad698ae94dceabc0e4a5b39567a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:28:18.998002 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0135219d-6498-42b3-9e6c-a2287d4aad2e tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] 10.222.0.52 "GET /compute/v2.1/servers/4b29db1b-c3de-410a-b3ca-fec68fa11f60" status: 200 len: 1359 microversion: 2.1 time: 0.154723 Oct 19 04:28:18.998581 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3727/7928] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:28:18 2022] GET /compute/v2.1/servers/4b29db1b-c3de-410a-b3ca-fec68fa11f60 => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:28:20.020209 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e5a86ec8-a948-4219-90dd-e93b780327e0 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:28:20.020841 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e5a86ec8-a948-4219-90dd-e93b780327e0 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] [instance: 4b29db1b-c3de-410a-b3ca-fec68fa11f60] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:28:20.028123 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e5a86ec8-a948-4219-90dd-e93b780327e0 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:28:20.028874 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e5a86ec8-a948-4219-90dd-e93b780327e0 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:28:20.029340 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e5a86ec8-a948-4219-90dd-e93b780327e0 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:28:20.030086 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e5a86ec8-a948-4219-90dd-e93b780327e0 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:28:20.030557 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e5a86ec8-a948-4219-90dd-e93b780327e0 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:28:20.031003 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e5a86ec8-a948-4219-90dd-e93b780327e0 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:28:20.163009 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e5a86ec8-a948-4219-90dd-e93b780327e0 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c04ff6cc2c4fd5a51b1e2325c4c8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb5ad698ae94dceabc0e4a5b39567a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:28:20.171001 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e5a86ec8-a948-4219-90dd-e93b780327e0 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] 10.222.0.52 "GET /compute/v2.1/servers/4b29db1b-c3de-410a-b3ca-fec68fa11f60" status: 200 len: 1359 microversion: 2.1 time: 0.154777 Oct 19 04:28:20.171580 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4202/7929] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:28:20 2022] GET /compute/v2.1/servers/4b29db1b-c3de-410a-b3ca-fec68fa11f60 => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:28:21.194804 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ec2d1725-6243-4f54-a0c4-3e4fc225e6c6 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:28:21.195473 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ec2d1725-6243-4f54-a0c4-3e4fc225e6c6 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] [instance: 4b29db1b-c3de-410a-b3ca-fec68fa11f60] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:28:21.202392 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ec2d1725-6243-4f54-a0c4-3e4fc225e6c6 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:28:21.202881 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ec2d1725-6243-4f54-a0c4-3e4fc225e6c6 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:28:21.203323 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ec2d1725-6243-4f54-a0c4-3e4fc225e6c6 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:28:21.204016 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ec2d1725-6243-4f54-a0c4-3e4fc225e6c6 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:28:21.204473 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ec2d1725-6243-4f54-a0c4-3e4fc225e6c6 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:28:21.204900 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ec2d1725-6243-4f54-a0c4-3e4fc225e6c6 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:28:21.332288 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ec2d1725-6243-4f54-a0c4-3e4fc225e6c6 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c04ff6cc2c4fd5a51b1e2325c4c8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb5ad698ae94dceabc0e4a5b39567a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:28:21.339988 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ec2d1725-6243-4f54-a0c4-3e4fc225e6c6 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] 10.222.0.52 "GET /compute/v2.1/servers/4b29db1b-c3de-410a-b3ca-fec68fa11f60" status: 200 len: 1359 microversion: 2.1 time: 0.149185 Oct 19 04:28:21.340569 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3728/7930] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:28:21 2022] GET /compute/v2.1/servers/4b29db1b-c3de-410a-b3ca-fec68fa11f60 => generated 1359 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:28:21.795681 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-78ff0351-bf3a-4c69-9352-a017a5d932f0 req-8f4420ff-d7b5-490d-b4da-eb2769b1c4bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b29db1b-c3de-410a-b3ca-fec68fa11f60", "name": "network-vif-plugged", "status": "completed", "tag": "929acdb0-a17d-4396-b4aa-81eba2606c14"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:28:21.805878 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-78ff0351-bf3a-4c69-9352-a017a5d932f0 req-8f4420ff-d7b5-490d-b4da-eb2769b1c4bf service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:28:21.806381 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-78ff0351-bf3a-4c69-9352-a017a5d932f0 req-8f4420ff-d7b5-490d-b4da-eb2769b1c4bf service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:28:21.806833 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-78ff0351-bf3a-4c69-9352-a017a5d932f0 req-8f4420ff-d7b5-490d-b4da-eb2769b1c4bf service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:28:21.818637 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-78ff0351-bf3a-4c69-9352-a017a5d932f0 req-8f4420ff-d7b5-490d-b4da-eb2769b1c4bf service nova] Creating event network-vif-plugged:929acdb0-a17d-4396-b4aa-81eba2606c14 for instance 4b29db1b-c3de-410a-b3ca-fec68fa11f60 on n-h2-861333-8 Oct 19 04:28:21.823587 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-78ff0351-bf3a-4c69-9352-a017a5d932f0 req-8f4420ff-d7b5-490d-b4da-eb2769b1c4bf service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149639 Oct 19 04:28:21.824195 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4203/7931] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:28:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:28:22.363283 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b5d91405-1986-45d4-8308-6c932c22afaf tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:28:22.364008 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b5d91405-1986-45d4-8308-6c932c22afaf tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] [instance: 4b29db1b-c3de-410a-b3ca-fec68fa11f60] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:28:22.370963 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b5d91405-1986-45d4-8308-6c932c22afaf tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:28:22.371454 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b5d91405-1986-45d4-8308-6c932c22afaf tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:28:22.371896 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b5d91405-1986-45d4-8308-6c932c22afaf tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:28:22.372596 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b5d91405-1986-45d4-8308-6c932c22afaf tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:28:22.373083 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b5d91405-1986-45d4-8308-6c932c22afaf tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:28:22.373557 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b5d91405-1986-45d4-8308-6c932c22afaf tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:28:22.501001 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b5d91405-1986-45d4-8308-6c932c22afaf tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c04ff6cc2c4fd5a51b1e2325c4c8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb5ad698ae94dceabc0e4a5b39567a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:28:22.509310 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b5d91405-1986-45d4-8308-6c932c22afaf tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] 10.222.0.52 "GET /compute/v2.1/servers/4b29db1b-c3de-410a-b3ca-fec68fa11f60" status: 200 len: 1359 microversion: 2.1 time: 0.149980 Oct 19 04:28:22.509945 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3729/7932] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:28:22 2022] GET /compute/v2.1/servers/4b29db1b-c3de-410a-b3ca-fec68fa11f60 => generated 1359 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:28:23.533739 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f6ed05cc-2b19-409f-a9de-8221054c2563 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:28:23.534521 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f6ed05cc-2b19-409f-a9de-8221054c2563 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] [instance: 4b29db1b-c3de-410a-b3ca-fec68fa11f60] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:28:23.540782 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f6ed05cc-2b19-409f-a9de-8221054c2563 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:28:23.541322 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f6ed05cc-2b19-409f-a9de-8221054c2563 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:28:23.541810 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f6ed05cc-2b19-409f-a9de-8221054c2563 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:28:23.542529 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f6ed05cc-2b19-409f-a9de-8221054c2563 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:28:23.543022 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f6ed05cc-2b19-409f-a9de-8221054c2563 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:28:23.543497 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f6ed05cc-2b19-409f-a9de-8221054c2563 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:28:23.676855 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-f6ed05cc-2b19-409f-a9de-8221054c2563 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c04ff6cc2c4fd5a51b1e2325c4c8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb5ad698ae94dceabc0e4a5b39567a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:28:23.684693 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f6ed05cc-2b19-409f-a9de-8221054c2563 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] 10.222.0.52 "GET /compute/v2.1/servers/4b29db1b-c3de-410a-b3ca-fec68fa11f60" status: 200 len: 1549 microversion: 2.1 time: 0.156331 Oct 19 04:28:23.685245 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4204/7933] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:28:23 2022] GET /compute/v2.1/servers/4b29db1b-c3de-410a-b3ca-fec68fa11f60 => generated 1549 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:28:23.706939 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-76ed17ea-9691-4028-9ff8-45000365e36b tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:28:23.707565 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-76ed17ea-9691-4028-9ff8-45000365e36b tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] [instance: 4b29db1b-c3de-410a-b3ca-fec68fa11f60] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:28:23.714691 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-76ed17ea-9691-4028-9ff8-45000365e36b tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:28:23.715181 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-76ed17ea-9691-4028-9ff8-45000365e36b tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:28:23.715618 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-76ed17ea-9691-4028-9ff8-45000365e36b tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:28:23.716353 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-76ed17ea-9691-4028-9ff8-45000365e36b tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:28:23.716810 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-76ed17ea-9691-4028-9ff8-45000365e36b tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:28:23.717242 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-76ed17ea-9691-4028-9ff8-45000365e36b tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:28:23.844415 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-76ed17ea-9691-4028-9ff8-45000365e36b tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c04ff6cc2c4fd5a51b1e2325c4c8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb5ad698ae94dceabc0e4a5b39567a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:28:23.852665 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-76ed17ea-9691-4028-9ff8-45000365e36b tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] 10.222.0.52 "GET /compute/v2.1/servers/4b29db1b-c3de-410a-b3ca-fec68fa11f60" status: 200 len: 1549 microversion: 2.1 time: 0.149719 Oct 19 04:28:23.853255 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3730/7934] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:28:23 2022] GET /compute/v2.1/servers/4b29db1b-c3de-410a-b3ca-fec68fa11f60 => generated 1549 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:28:23.874720 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4bc4dc90-77d7-4c75-80d3-d446a8121938 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:28:23.879447 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-4bc4dc90-77d7-4c75-80d3-d446a8121938 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '33c04ff6cc2c4fd5a51b1e2325c4c8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb5ad698ae94dceabc0e4a5b39567a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:28:23.880232 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4bc4dc90-77d7-4c75-80d3-d446a8121938 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Searching by: {'deleted': False, 'project_id': '0bb5ad698ae94dceabc0e4a5b39567a7'} {{(pid=121134) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 04:28:23.885532 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4bc4dc90-77d7-4c75-80d3-d446a8121938 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:28:23.886031 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4bc4dc90-77d7-4c75-80d3-d446a8121938 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:28:23.886483 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4bc4dc90-77d7-4c75-80d3-d446a8121938 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:28:23.887215 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4bc4dc90-77d7-4c75-80d3-d446a8121938 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:28:23.887679 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4bc4dc90-77d7-4c75-80d3-d446a8121938 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:28:23.888118 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4bc4dc90-77d7-4c75-80d3-d446a8121938 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:28:23.914842 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.multi_cell_list [None req-4bc4dc90-77d7-4c75-80d3-d446a8121938 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121134) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 04:28:23.941317 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4bc4dc90-77d7-4c75-80d3-d446a8121938 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] 10.222.0.52 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.070351 Oct 19 04:28:23.941871 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4205/7935] 10.222.0.52 () {58 vars in 1125 bytes} [Wed Oct 19 04:28:23 2022] GET /compute/v2.1/servers => generated 343 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:28:23.953838 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f5240f56-09b6-480d-b57a-f58bd93fb57a tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:28:23.954466 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f5240f56-09b6-480d-b57a-f58bd93fb57a tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] [instance: 4b29db1b-c3de-410a-b3ca-fec68fa11f60] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:28:23.960776 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f5240f56-09b6-480d-b57a-f58bd93fb57a tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:28:23.961265 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f5240f56-09b6-480d-b57a-f58bd93fb57a tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:28:23.961746 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f5240f56-09b6-480d-b57a-f58bd93fb57a tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:28:23.962444 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f5240f56-09b6-480d-b57a-f58bd93fb57a tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:28:23.962904 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f5240f56-09b6-480d-b57a-f58bd93fb57a tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:28:23.963342 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f5240f56-09b6-480d-b57a-f58bd93fb57a tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:28:24.090474 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f5240f56-09b6-480d-b57a-f58bd93fb57a tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c04ff6cc2c4fd5a51b1e2325c4c8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb5ad698ae94dceabc0e4a5b39567a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:28:24.098977 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f5240f56-09b6-480d-b57a-f58bd93fb57a tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] 10.222.0.52 "GET /compute/v2.1/servers/4b29db1b-c3de-410a-b3ca-fec68fa11f60" status: 200 len: 1549 microversion: 2.1 time: 0.149474 Oct 19 04:28:24.099542 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3731/7936] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:28:23 2022] GET /compute/v2.1/servers/4b29db1b-c3de-410a-b3ca-fec68fa11f60 => generated 1549 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:28:26.988811 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-583c9602-3c8c-4f7a-9b31-e4ed9c054e58 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ad6b2a2f-dae4-43e1-bc2c-23a60e097bc5"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:28:26.991192 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-583c9602-3c8c-4f7a-9b31-e4ed9c054e58 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] [instance: 4b29db1b-c3de-410a-b3ca-fec68fa11f60] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:28:26.998149 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-583c9602-3c8c-4f7a-9b31-e4ed9c054e58 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:28:26.998649 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-583c9602-3c8c-4f7a-9b31-e4ed9c054e58 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:28:26.999107 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-583c9602-3c8c-4f7a-9b31-e4ed9c054e58 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:28:26.999815 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-583c9602-3c8c-4f7a-9b31-e4ed9c054e58 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:28:27.000290 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-583c9602-3c8c-4f7a-9b31-e4ed9c054e58 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:28:27.000789 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-583c9602-3c8c-4f7a-9b31-e4ed9c054e58 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:28:27.642774 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-583c9602-3c8c-4f7a-9b31-e4ed9c054e58 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] 10.222.0.52 "POST /compute/v2.1/servers/4b29db1b-c3de-410a-b3ca-fec68fa11f60/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.657717 Oct 19 04:28:27.643393 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4206/7937] 10.222.0.52 () {60 vars in 1323 bytes} [Wed Oct 19 04:28:26 2022] POST /compute/v2.1/servers/4b29db1b-c3de-410a-b3ca-fec68fa11f60/os-volume_attachments => generated 194 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:28:42.042334 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-56ee54d6-38ae-4142-9693-5fbac3ee56fa tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:28:42.043250 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-56ee54d6-38ae-4142-9693-5fbac3ee56fa tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] [instance: 4b29db1b-c3de-410a-b3ca-fec68fa11f60] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:28:42.045464 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:28:42.046180 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=64 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:28:42.050906 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-56ee54d6-38ae-4142-9693-5fbac3ee56fa tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:28:42.051393 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-56ee54d6-38ae-4142-9693-5fbac3ee56fa tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:28:42.051830 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-56ee54d6-38ae-4142-9693-5fbac3ee56fa tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:28:42.052529 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-56ee54d6-38ae-4142-9693-5fbac3ee56fa tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:28:42.052990 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-56ee54d6-38ae-4142-9693-5fbac3ee56fa tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:28:42.053474 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-56ee54d6-38ae-4142-9693-5fbac3ee56fa tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:28:42.186643 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-56ee54d6-38ae-4142-9693-5fbac3ee56fa tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c04ff6cc2c4fd5a51b1e2325c4c8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb5ad698ae94dceabc0e4a5b39567a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:28:42.195088 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-56ee54d6-38ae-4142-9693-5fbac3ee56fa tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] 10.222.0.52 "GET /compute/v2.1/servers/4b29db1b-c3de-410a-b3ca-fec68fa11f60" status: 200 len: 1595 microversion: 2.1 time: 0.157028 Oct 19 04:28:42.199951 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3732/7938] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:28:42 2022] GET /compute/v2.1/servers/4b29db1b-c3de-410a-b3ca-fec68fa11f60 => generated 1595 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:28:44.150514 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:28:44.151378 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:28:44.152057 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:28:44.156493 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-0145cb65-765e-475f-99ab-8014be402375 req-5afc0472-4e6b-4940-b18e-eac699629ae6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b29db1b-c3de-410a-b3ca-fec68fa11f60", "tag": "929acdb0-a17d-4396-b4aa-81eba2606c14"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:28:44.166966 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-0145cb65-765e-475f-99ab-8014be402375 req-5afc0472-4e6b-4940-b18e-eac699629ae6 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:28:44.167595 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-0145cb65-765e-475f-99ab-8014be402375 req-5afc0472-4e6b-4940-b18e-eac699629ae6 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:28:44.168044 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-0145cb65-765e-475f-99ab-8014be402375 req-5afc0472-4e6b-4940-b18e-eac699629ae6 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:28:44.180167 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-0145cb65-765e-475f-99ab-8014be402375 req-5afc0472-4e6b-4940-b18e-eac699629ae6 service nova] Creating event network-changed:929acdb0-a17d-4396-b4aa-81eba2606c14 for instance 4b29db1b-c3de-410a-b3ca-fec68fa11f60 on n-h2-861333-8 Oct 19 04:28:44.185663 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-0145cb65-765e-475f-99ab-8014be402375 req-5afc0472-4e6b-4940-b18e-eac699629ae6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036711 Oct 19 04:28:44.185935 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4207/7939] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:28:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:28:46.512452 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f067f0ca-e897-4089-aacc-fd35f53cb12c tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1822272273"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:28:46.513051 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f067f0ca-e897-4089-aacc-fd35f53cb12c tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] [instance: 4b29db1b-c3de-410a-b3ca-fec68fa11f60] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:28:46.527732 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f067f0ca-e897-4089-aacc-fd35f53cb12c tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:28:46.528380 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f067f0ca-e897-4089-aacc-fd35f53cb12c tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:28:46.528917 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f067f0ca-e897-4089-aacc-fd35f53cb12c tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:28:46.529972 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f067f0ca-e897-4089-aacc-fd35f53cb12c tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:28:46.530466 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f067f0ca-e897-4089-aacc-fd35f53cb12c tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:28:46.531001 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f067f0ca-e897-4089-aacc-fd35f53cb12c tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:28:46.663678 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.network.security_group_api [None req-f067f0ca-e897-4089-aacc-fd35f53cb12c tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Adding security group 790dcc3a-dc63-470f-98da-93e2d4e3d472 to port 929acdb0-a17d-4396-b4aa-81eba2606c14 Oct 19 04:28:47.044832 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f067f0ca-e897-4089-aacc-fd35f53cb12c tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] 10.222.0.52 "POST /compute/v2.1/servers/4b29db1b-c3de-410a-b3ca-fec68fa11f60/action" status: 202 len: 0 microversion: 2.1 time: 0.536991 Oct 19 04:28:47.046141 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3733/7940] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 04:28:46 2022] POST /compute/v2.1/servers/4b29db1b-c3de-410a-b3ca-fec68fa11f60/action => generated 0 bytes in 539 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 19 04:28:47.055495 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-607e5ac9-df07-4db5-9e39-256c7686f8b1 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:28:47.056190 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-607e5ac9-df07-4db5-9e39-256c7686f8b1 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] [instance: 4b29db1b-c3de-410a-b3ca-fec68fa11f60] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:28:47.056865 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-c9243075-70b1-4a05-b603-a193f8783d39 req-6ff5f868-af9e-4d95-adab-213655715528 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b29db1b-c3de-410a-b3ca-fec68fa11f60", "tag": "929acdb0-a17d-4396-b4aa-81eba2606c14"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:28:47.063645 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-607e5ac9-df07-4db5-9e39-256c7686f8b1 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:28:47.066181 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-607e5ac9-df07-4db5-9e39-256c7686f8b1 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:28:47.067001 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-607e5ac9-df07-4db5-9e39-256c7686f8b1 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:28:47.068455 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-607e5ac9-df07-4db5-9e39-256c7686f8b1 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:28:47.069148 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-607e5ac9-df07-4db5-9e39-256c7686f8b1 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:28:47.069354 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-c9243075-70b1-4a05-b603-a193f8783d39 req-6ff5f868-af9e-4d95-adab-213655715528 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:28:47.070114 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-c9243075-70b1-4a05-b603-a193f8783d39 req-6ff5f868-af9e-4d95-adab-213655715528 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:28:47.070541 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-607e5ac9-df07-4db5-9e39-256c7686f8b1 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:28:47.071015 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-c9243075-70b1-4a05-b603-a193f8783d39 req-6ff5f868-af9e-4d95-adab-213655715528 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:28:47.088023 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-c9243075-70b1-4a05-b603-a193f8783d39 req-6ff5f868-af9e-4d95-adab-213655715528 service nova] Creating event network-changed:929acdb0-a17d-4396-b4aa-81eba2606c14 for instance 4b29db1b-c3de-410a-b3ca-fec68fa11f60 on n-h2-861333-8 Oct 19 04:28:47.095582 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-c9243075-70b1-4a05-b603-a193f8783d39 req-6ff5f868-af9e-4d95-adab-213655715528 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042944 Oct 19 04:28:47.097412 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4208/7941] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:28:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:28:47.334738 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-607e5ac9-df07-4db5-9e39-256c7686f8b1 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c04ff6cc2c4fd5a51b1e2325c4c8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb5ad698ae94dceabc0e4a5b39567a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:28:47.344959 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-607e5ac9-df07-4db5-9e39-256c7686f8b1 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] 10.222.0.52 "GET /compute/v2.1/servers/4b29db1b-c3de-410a-b3ca-fec68fa11f60" status: 200 len: 1761 microversion: 2.1 time: 0.293311 Oct 19 04:28:47.345395 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3734/7942] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:28:47 2022] GET /compute/v2.1/servers/4b29db1b-c3de-410a-b3ca-fec68fa11f60 => generated 1761 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:30:25.250753 n-d-861333-8 devstack@n-api.service[121134]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 04:30:25.251251 n-d-861333-8 devstack@n-api.service[121134]: Wed Oct 19 04:30:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4b29db1b-c3de-410a-b3ca-fec68fa11f60/action (ip 10.222.0.52) !!! Oct 19 04:30:25.256643 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-36e0fe38-0c77-4746-b739-5817b598edcb tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:30:25.259449 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-36e0fe38-0c77-4746-b739-5817b598edcb tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] [instance: 4b29db1b-c3de-410a-b3ca-fec68fa11f60] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:30:25.267785 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-36e0fe38-0c77-4746-b739-5817b598edcb tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:30:25.268282 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-36e0fe38-0c77-4746-b739-5817b598edcb tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:30:25.268736 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-36e0fe38-0c77-4746-b739-5817b598edcb tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:30:25.269479 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-36e0fe38-0c77-4746-b739-5817b598edcb tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:30:25.269951 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-36e0fe38-0c77-4746-b739-5817b598edcb tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:30:25.270396 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-36e0fe38-0c77-4746-b739-5817b598edcb tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:30:25.493903 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-36e0fe38-0c77-4746-b739-5817b598edcb tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] 10.222.0.52 "POST /compute/v2.1/servers/4b29db1b-c3de-410a-b3ca-fec68fa11f60/action" status: 202 len: 0 microversion: 2.1 time: 0.245812 Oct 19 04:30:25.494551 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4209/7943] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 04:30:25 2022] POST /compute/v2.1/servers/4b29db1b-c3de-410a-b3ca-fec68fa11f60/action => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 04:30:25.502814 n-d-861333-8 devstack@n-api.service[121135]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 19 04:30:25.503651 n-d-861333-8 devstack@n-api.service[121135]: Wed Oct 19 04:30:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4b29db1b-c3de-410a-b3ca-fec68fa11f60 (ip 10.222.0.52) !!! Oct 19 04:30:25.505421 n-d-861333-8 devstack@n-api.service[121135]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 19 04:30:25.505549 n-d-861333-8 devstack@n-api.service[121135]: Wed Oct 19 04:30:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4b29db1b-c3de-410a-b3ca-fec68fa11f60 (ip 10.222.0.52) !!! Oct 19 04:30:25.507416 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=6 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:30:25.507580 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=16 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:30:25.512278 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b6bf2936-f226-48ea-8001-fdc8a57558a6 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:30:25.512898 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b6bf2936-f226-48ea-8001-fdc8a57558a6 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] [instance: 4b29db1b-c3de-410a-b3ca-fec68fa11f60] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:30:25.530420 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b6bf2936-f226-48ea-8001-fdc8a57558a6 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:30:25.532384 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b6bf2936-f226-48ea-8001-fdc8a57558a6 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:30:25.532384 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b6bf2936-f226-48ea-8001-fdc8a57558a6 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:30:25.532384 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b6bf2936-f226-48ea-8001-fdc8a57558a6 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:30:25.532719 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b6bf2936-f226-48ea-8001-fdc8a57558a6 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:30:25.532948 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b6bf2936-f226-48ea-8001-fdc8a57558a6 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:30:25.729979 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b6bf2936-f226-48ea-8001-fdc8a57558a6 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c04ff6cc2c4fd5a51b1e2325c4c8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb5ad698ae94dceabc0e4a5b39567a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:30:25.738364 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b6bf2936-f226-48ea-8001-fdc8a57558a6 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] 10.222.0.52 "GET /compute/v2.1/servers/4b29db1b-c3de-410a-b3ca-fec68fa11f60" status: 200 len: 1763 microversion: 2.1 time: 0.239086 Oct 19 04:30:25.738942 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3735/7944] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:30:25 2022] GET /compute/v2.1/servers/4b29db1b-c3de-410a-b3ca-fec68fa11f60 => generated 1763 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:30:26.762598 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-10785dcd-72a3-4dcc-9907-4a173a4fba60 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:30:26.763324 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-10785dcd-72a3-4dcc-9907-4a173a4fba60 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] [instance: 4b29db1b-c3de-410a-b3ca-fec68fa11f60] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:30:26.772919 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-10785dcd-72a3-4dcc-9907-4a173a4fba60 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:30:26.773472 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-10785dcd-72a3-4dcc-9907-4a173a4fba60 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:30:26.773952 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-10785dcd-72a3-4dcc-9907-4a173a4fba60 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:30:26.774728 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-10785dcd-72a3-4dcc-9907-4a173a4fba60 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:30:26.775199 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-10785dcd-72a3-4dcc-9907-4a173a4fba60 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:30:26.775644 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-10785dcd-72a3-4dcc-9907-4a173a4fba60 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:30:26.970998 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-10785dcd-72a3-4dcc-9907-4a173a4fba60 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c04ff6cc2c4fd5a51b1e2325c4c8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb5ad698ae94dceabc0e4a5b39567a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:30:26.980108 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-10785dcd-72a3-4dcc-9907-4a173a4fba60 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] 10.222.0.52 "GET /compute/v2.1/servers/4b29db1b-c3de-410a-b3ca-fec68fa11f60" status: 200 len: 1768 microversion: 2.1 time: 0.221827 Oct 19 04:30:26.980683 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4210/7945] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:30:26 2022] GET /compute/v2.1/servers/4b29db1b-c3de-410a-b3ca-fec68fa11f60 => generated 1768 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:30:28.007364 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d7723dd5-d884-4a4c-af64-c92e9ac25c8e tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:30:28.007985 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d7723dd5-d884-4a4c-af64-c92e9ac25c8e tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] [instance: 4b29db1b-c3de-410a-b3ca-fec68fa11f60] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:30:28.015606 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d7723dd5-d884-4a4c-af64-c92e9ac25c8e tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:30:28.016094 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d7723dd5-d884-4a4c-af64-c92e9ac25c8e tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:30:28.016532 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d7723dd5-d884-4a4c-af64-c92e9ac25c8e tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:30:28.017224 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d7723dd5-d884-4a4c-af64-c92e9ac25c8e tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:30:28.017706 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d7723dd5-d884-4a4c-af64-c92e9ac25c8e tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:30:28.018136 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d7723dd5-d884-4a4c-af64-c92e9ac25c8e tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:30:28.165550 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d7723dd5-d884-4a4c-af64-c92e9ac25c8e tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c04ff6cc2c4fd5a51b1e2325c4c8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb5ad698ae94dceabc0e4a5b39567a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:30:28.174279 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d7723dd5-d884-4a4c-af64-c92e9ac25c8e tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] 10.222.0.52 "GET /compute/v2.1/servers/4b29db1b-c3de-410a-b3ca-fec68fa11f60" status: 200 len: 1761 microversion: 2.1 time: 0.170812 Oct 19 04:30:28.175446 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3736/7946] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:30:28 2022] GET /compute/v2.1/servers/4b29db1b-c3de-410a-b3ca-fec68fa11f60 => generated 1761 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:31:44.795264 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=8 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:31:44.796052 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=20,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:31:44.800095 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6e0a2a90-da87-49f2-9996-f20acce86c19 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1822272273"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:31:44.800641 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6e0a2a90-da87-49f2-9996-f20acce86c19 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] [instance: 4b29db1b-c3de-410a-b3ca-fec68fa11f60] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:31:44.807188 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6e0a2a90-da87-49f2-9996-f20acce86c19 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:31:44.807683 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6e0a2a90-da87-49f2-9996-f20acce86c19 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:31:44.808135 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6e0a2a90-da87-49f2-9996-f20acce86c19 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:31:44.808834 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6e0a2a90-da87-49f2-9996-f20acce86c19 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:31:44.809297 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6e0a2a90-da87-49f2-9996-f20acce86c19 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:31:44.809760 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6e0a2a90-da87-49f2-9996-f20acce86c19 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:31:44.945468 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.network.security_group_api [None req-6e0a2a90-da87-49f2-9996-f20acce86c19 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Removing security group 790dcc3a-dc63-470f-98da-93e2d4e3d472 from port 929acdb0-a17d-4396-b4aa-81eba2606c14 Oct 19 04:31:45.312316 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6e0a2a90-da87-49f2-9996-f20acce86c19 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] 10.222.0.52 "POST /compute/v2.1/servers/4b29db1b-c3de-410a-b3ca-fec68fa11f60/action" status: 202 len: 0 microversion: 2.1 time: 0.518777 Oct 19 04:31:45.316923 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4211/7947] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 04:31:44 2022] POST /compute/v2.1/servers/4b29db1b-c3de-410a-b3ca-fec68fa11f60/action => generated 0 bytes in 524 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 04:31:45.320335 n-d-861333-8 devstack@n-api.service[121135]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a4608907-9588-4b25-ac87-b956b6019667] AMQP server on 10.222.0.52:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 19 04:31:45.321626 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=4 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:31:45.322654 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=12 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:31:45.395236 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-03c80fbd-34d6-4aa0-a0f8-44bba63d08ad req-c376a9bd-1015-48ac-9be9-9388a5336140 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b29db1b-c3de-410a-b3ca-fec68fa11f60", "tag": "929acdb0-a17d-4396-b4aa-81eba2606c14"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:31:45.406558 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-03c80fbd-34d6-4aa0-a0f8-44bba63d08ad req-c376a9bd-1015-48ac-9be9-9388a5336140 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:31:45.407306 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-03c80fbd-34d6-4aa0-a0f8-44bba63d08ad req-c376a9bd-1015-48ac-9be9-9388a5336140 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:31:45.407522 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-03c80fbd-34d6-4aa0-a0f8-44bba63d08ad req-c376a9bd-1015-48ac-9be9-9388a5336140 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:31:45.421803 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-03c80fbd-34d6-4aa0-a0f8-44bba63d08ad req-c376a9bd-1015-48ac-9be9-9388a5336140 service nova] Creating event network-changed:929acdb0-a17d-4396-b4aa-81eba2606c14 for instance 4b29db1b-c3de-410a-b3ca-fec68fa11f60 on n-h2-861333-8 Oct 19 04:31:45.426622 n-d-861333-8 devstack@n-api.service[121135]: ERROR oslo.messaging._drivers.impl_rabbit [req-03c80fbd-34d6-4aa0-a0f8-44bba63d08ad req-c376a9bd-1015-48ac-9be9-9388a5336140 service nova] [09cb6902-d050-420b-8321-a83aa488bdfb] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 19 04:31:46.330583 n-d-861333-8 devstack@n-api.service[121135]: INFO oslo.messaging._drivers.impl_rabbit [-] [a4608907-9588-4b25-ac87-b956b6019667] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 34958. Oct 19 04:31:46.434850 n-d-861333-8 devstack@n-api.service[121135]: INFO oslo.messaging._drivers.impl_rabbit [req-03c80fbd-34d6-4aa0-a0f8-44bba63d08ad req-c376a9bd-1015-48ac-9be9-9388a5336140 service nova] [09cb6902-d050-420b-8321-a83aa488bdfb] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 34960. Oct 19 04:31:46.438677 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-03c80fbd-34d6-4aa0-a0f8-44bba63d08ad req-c376a9bd-1015-48ac-9be9-9388a5336140 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.120635 Oct 19 04:31:46.439295 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3737/7948] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:31:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:31:46.553823 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-afab24d4-03b1-4a53-ad4d-48f6455c3904 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:31:46.554606 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-afab24d4-03b1-4a53-ad4d-48f6455c3904 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] [instance: 4b29db1b-c3de-410a-b3ca-fec68fa11f60] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:31:46.561564 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-afab24d4-03b1-4a53-ad4d-48f6455c3904 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:31:46.562057 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-afab24d4-03b1-4a53-ad4d-48f6455c3904 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:31:46.562984 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-afab24d4-03b1-4a53-ad4d-48f6455c3904 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:31:46.563842 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-afab24d4-03b1-4a53-ad4d-48f6455c3904 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:31:46.564458 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-afab24d4-03b1-4a53-ad4d-48f6455c3904 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:31:46.565043 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-afab24d4-03b1-4a53-ad4d-48f6455c3904 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:31:46.574184 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-5330d701-84f9-494f-82b2-3f3c616a4c62 req-21abe8be-e524-4eed-ae1f-03331648c457 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b29db1b-c3de-410a-b3ca-fec68fa11f60", "tag": "929acdb0-a17d-4396-b4aa-81eba2606c14"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:31:46.597547 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-5330d701-84f9-494f-82b2-3f3c616a4c62 req-21abe8be-e524-4eed-ae1f-03331648c457 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:31:46.598308 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-5330d701-84f9-494f-82b2-3f3c616a4c62 req-21abe8be-e524-4eed-ae1f-03331648c457 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:31:46.598913 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-5330d701-84f9-494f-82b2-3f3c616a4c62 req-21abe8be-e524-4eed-ae1f-03331648c457 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:31:46.614775 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-5330d701-84f9-494f-82b2-3f3c616a4c62 req-21abe8be-e524-4eed-ae1f-03331648c457 service nova] Creating event network-changed:929acdb0-a17d-4396-b4aa-81eba2606c14 for instance 4b29db1b-c3de-410a-b3ca-fec68fa11f60 on n-h2-861333-8 Oct 19 04:31:46.629060 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-5330d701-84f9-494f-82b2-3f3c616a4c62 req-21abe8be-e524-4eed-ae1f-03331648c457 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128160 Oct 19 04:31:46.631048 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4212/7949] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:31:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:31:46.687155 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-afab24d4-03b1-4a53-ad4d-48f6455c3904 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lazy-loading 'services' on Instance uuid 4b29db1b-c3de-410a-b3ca-fec68fa11f60 {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 04:31:46.879644 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-afab24d4-03b1-4a53-ad4d-48f6455c3904 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] 10.222.0.52 "DELETE /compute/v2.1/servers/4b29db1b-c3de-410a-b3ca-fec68fa11f60/os-volume_attachments/ad6b2a2f-dae4-43e1-bc2c-23a60e097bc5" status: 202 len: 0 microversion: 2.1 time: 0.329914 Oct 19 04:31:46.880659 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3738/7950] 10.222.0.52 () {58 vars in 1416 bytes} [Wed Oct 19 04:31:46 2022] DELETE /compute/v2.1/servers/4b29db1b-c3de-410a-b3ca-fec68fa11f60/os-volume_attachments/ad6b2a2f-dae4-43e1-bc2c-23a60e097bc5 => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 19 04:31:46.891614 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ce4a9313-a116-425d-92fe-00217d5e0220 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:31:46.895650 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ce4a9313-a116-425d-92fe-00217d5e0220 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] [instance: 4b29db1b-c3de-410a-b3ca-fec68fa11f60] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:31:46.905151 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ce4a9313-a116-425d-92fe-00217d5e0220 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:31:46.912783 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ce4a9313-a116-425d-92fe-00217d5e0220 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:31:46.912783 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ce4a9313-a116-425d-92fe-00217d5e0220 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:31:46.912783 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ce4a9313-a116-425d-92fe-00217d5e0220 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:31:46.912783 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ce4a9313-a116-425d-92fe-00217d5e0220 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:31:46.912783 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ce4a9313-a116-425d-92fe-00217d5e0220 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:31:46.939562 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ce4a9313-a116-425d-92fe-00217d5e0220 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] 10.222.0.52 "GET /compute/v2.1/servers/4b29db1b-c3de-410a-b3ca-fec68fa11f60/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053665 Oct 19 04:31:46.943035 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4213/7951] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Oct 19 04:31:46 2022] GET /compute/v2.1/servers/4b29db1b-c3de-410a-b3ca-fec68fa11f60/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:31:47.953893 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7deb29fa-df90-4cc4-9cc0-604c39adc9b8 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:31:47.956257 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7deb29fa-df90-4cc4-9cc0-604c39adc9b8 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] [instance: 4b29db1b-c3de-410a-b3ca-fec68fa11f60] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:31:47.963590 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7deb29fa-df90-4cc4-9cc0-604c39adc9b8 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:31:47.964385 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7deb29fa-df90-4cc4-9cc0-604c39adc9b8 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:31:47.964920 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7deb29fa-df90-4cc4-9cc0-604c39adc9b8 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:31:47.965850 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7deb29fa-df90-4cc4-9cc0-604c39adc9b8 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:31:47.966309 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7deb29fa-df90-4cc4-9cc0-604c39adc9b8 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:31:47.966741 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7deb29fa-df90-4cc4-9cc0-604c39adc9b8 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:31:47.997654 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7deb29fa-df90-4cc4-9cc0-604c39adc9b8 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] 10.222.0.52 "GET /compute/v2.1/servers/4b29db1b-c3de-410a-b3ca-fec68fa11f60/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049139 Oct 19 04:31:47.998232 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3739/7952] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Oct 19 04:31:47 2022] GET /compute/v2.1/servers/4b29db1b-c3de-410a-b3ca-fec68fa11f60/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:31:49.010458 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ef38eeb8-c926-486c-9746-4616b30c6f46 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:31:49.012731 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ef38eeb8-c926-486c-9746-4616b30c6f46 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] [instance: 4b29db1b-c3de-410a-b3ca-fec68fa11f60] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:31:49.019724 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ef38eeb8-c926-486c-9746-4616b30c6f46 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:31:49.020231 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ef38eeb8-c926-486c-9746-4616b30c6f46 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:31:49.020699 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ef38eeb8-c926-486c-9746-4616b30c6f46 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:31:49.021442 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ef38eeb8-c926-486c-9746-4616b30c6f46 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:31:49.021919 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ef38eeb8-c926-486c-9746-4616b30c6f46 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:31:49.022365 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ef38eeb8-c926-486c-9746-4616b30c6f46 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:31:49.051998 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ef38eeb8-c926-486c-9746-4616b30c6f46 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] 10.222.0.52 "GET /compute/v2.1/servers/4b29db1b-c3de-410a-b3ca-fec68fa11f60/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045553 Oct 19 04:31:49.052576 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4214/7953] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Oct 19 04:31:49 2022] GET /compute/v2.1/servers/4b29db1b-c3de-410a-b3ca-fec68fa11f60/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:31:50.064329 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-387975f2-570a-4eee-8c4c-cb4b248e82eb tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:31:50.066563 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-387975f2-570a-4eee-8c4c-cb4b248e82eb tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] [instance: 4b29db1b-c3de-410a-b3ca-fec68fa11f60] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:31:50.074058 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-387975f2-570a-4eee-8c4c-cb4b248e82eb tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:31:50.074550 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-387975f2-570a-4eee-8c4c-cb4b248e82eb tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:31:50.074995 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-387975f2-570a-4eee-8c4c-cb4b248e82eb tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:31:50.075689 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-387975f2-570a-4eee-8c4c-cb4b248e82eb tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:31:50.076148 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-387975f2-570a-4eee-8c4c-cb4b248e82eb tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:31:50.076581 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-387975f2-570a-4eee-8c4c-cb4b248e82eb tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:31:50.109828 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-387975f2-570a-4eee-8c4c-cb4b248e82eb tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] 10.222.0.52 "GET /compute/v2.1/servers/4b29db1b-c3de-410a-b3ca-fec68fa11f60/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049387 Oct 19 04:31:50.110394 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3740/7954] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Oct 19 04:31:50 2022] GET /compute/v2.1/servers/4b29db1b-c3de-410a-b3ca-fec68fa11f60/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:31:51.123279 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a88349ad-9c47-49ec-b4fd-bfc17e8d8546 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:31:51.125394 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a88349ad-9c47-49ec-b4fd-bfc17e8d8546 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] [instance: 4b29db1b-c3de-410a-b3ca-fec68fa11f60] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:31:51.132396 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a88349ad-9c47-49ec-b4fd-bfc17e8d8546 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:31:51.133573 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a88349ad-9c47-49ec-b4fd-bfc17e8d8546 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:31:51.134046 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a88349ad-9c47-49ec-b4fd-bfc17e8d8546 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:31:51.134763 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a88349ad-9c47-49ec-b4fd-bfc17e8d8546 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:31:51.135241 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a88349ad-9c47-49ec-b4fd-bfc17e8d8546 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:31:51.135689 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a88349ad-9c47-49ec-b4fd-bfc17e8d8546 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:31:51.164874 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a88349ad-9c47-49ec-b4fd-bfc17e8d8546 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] 10.222.0.52 "GET /compute/v2.1/servers/4b29db1b-c3de-410a-b3ca-fec68fa11f60/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045648 Oct 19 04:31:51.169605 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4215/7955] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Oct 19 04:31:51 2022] GET /compute/v2.1/servers/4b29db1b-c3de-410a-b3ca-fec68fa11f60/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:31:52.177810 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-aeca849a-6518-4ac9-a661-e54ecc07da4a tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:31:52.180052 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-aeca849a-6518-4ac9-a661-e54ecc07da4a tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] [instance: 4b29db1b-c3de-410a-b3ca-fec68fa11f60] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:31:52.187154 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aeca849a-6518-4ac9-a661-e54ecc07da4a tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:31:52.187641 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aeca849a-6518-4ac9-a661-e54ecc07da4a tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:31:52.188083 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aeca849a-6518-4ac9-a661-e54ecc07da4a tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:31:52.188926 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aeca849a-6518-4ac9-a661-e54ecc07da4a tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:31:52.189400 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aeca849a-6518-4ac9-a661-e54ecc07da4a tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:31:52.189835 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aeca849a-6518-4ac9-a661-e54ecc07da4a tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:31:52.219348 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-aeca849a-6518-4ac9-a661-e54ecc07da4a tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] 10.222.0.52 "GET /compute/v2.1/servers/4b29db1b-c3de-410a-b3ca-fec68fa11f60/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045849 Oct 19 04:31:52.219910 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3741/7956] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Oct 19 04:31:52 2022] GET /compute/v2.1/servers/4b29db1b-c3de-410a-b3ca-fec68fa11f60/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 04:31:52.230448 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a64bac15-e35d-4402-9bfd-d563e5b93705 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:31:52.230967 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a64bac15-e35d-4402-9bfd-d563e5b93705 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] [instance: 4b29db1b-c3de-410a-b3ca-fec68fa11f60] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:31:52.237714 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a64bac15-e35d-4402-9bfd-d563e5b93705 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:31:52.238214 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a64bac15-e35d-4402-9bfd-d563e5b93705 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:31:52.238668 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a64bac15-e35d-4402-9bfd-d563e5b93705 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:31:52.239559 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a64bac15-e35d-4402-9bfd-d563e5b93705 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:31:52.240035 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a64bac15-e35d-4402-9bfd-d563e5b93705 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:31:52.240482 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a64bac15-e35d-4402-9bfd-d563e5b93705 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:31:52.315004 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-a64bac15-e35d-4402-9bfd-d563e5b93705 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] HTTP exception thrown: Instance 4b29db1b-c3de-410a-b3ca-fec68fa11f60 is not attached to volume ad6b2a2f-dae4-43e1-bc2c-23a60e097bc5 Oct 19 04:31:52.316646 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a64bac15-e35d-4402-9bfd-d563e5b93705 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Request method failure captured: Oct 19 04:31:52.316646 n-d-861333-8 devstack@n-api.service[121134]: request: DELETE /compute/v2.1/servers/4b29db1b-c3de-410a-b3ca-fec68fa11f60/os-volume_attachments/ad6b2a2f-dae4-43e1-bc2c-23a60e097bc5 HTTP/1.1 Oct 19 04:31:52.316646 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 04:31:52.316646 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 04:31:52.316646 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 04:31:52.316646 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 04:31:52.316646 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 04:31:52.316646 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 04:31:52.316646 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 04:31:52.316646 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 04:31:52.316646 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3y_zyB1g63gioa-ifJ0dkoCTOlZmZErF0CpNGrcb2_BcskDlnnNYkFtO29M-WCPkqGqIVquISfO6GJ6_e-H71yF3RJV0eU5D58xeW_lumD5wYAG8LS1HlVTXpqOhmM6Nv9MQIFa7rrVvNr0ThaLyhtWP-s68O0CxcGD9SQ5veJstWI Oct 19 04:31:52.316646 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 04:31:52.316646 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 04:31:52.316646 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 04:31:52.316646 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 04:31:52.316646 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 04:31:52.316646 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 04:31:52.316646 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 0bb5ad698ae94dceabc0e4a5b39567a7 Oct 19 04:31:52.316646 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-TestMinimumBasicScenario-1592269912 Oct 19 04:31:52.316646 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 04:31:52.316646 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 04:31:52.316646 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/0bb5ad698ae94dceabc0e4a5b39567a7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0bb5ad698ae94dceabc0e4a5b39567a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0bb5ad698ae94dceabc0e4a5b39567a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_0bb5ad698ae94dceabc0e4a5b39567a7", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 04:31:52.316646 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-TestMinimumBasicScenario-1592269912 Oct 19 04:31:52.316646 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 0bb5ad698ae94dceabc0e4a5b39567a7 Oct 19 04:31:52.316646 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1592269912 Oct 19 04:31:52.316646 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-TestMinimumBasicScenario-1592269912-project Oct 19 04:31:52.316646 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 04:31:52.316646 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 04:31:52.316646 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 33c04ff6cc2c4fd5a51b1e2325c4c8de Oct 19 04:31:52.316646 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-TestMinimumBasicScenario-1592269912-project Oct 19 04:31:52.316646 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 04:31:52.316646 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance 4b29db1b-c3de-410a-b3ca-fec68fa11f60 is not attached to volume ad6b2a2f-dae4-43e1-bc2c-23a60e097bc5 Oct 19 04:31:52.316646 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'server_id': '4b29db1b-c3de-410a-b3ca-fec68fa11f60', 'id': 'ad6b2a2f-dae4-43e1-bc2c-23a60e097bc5'} Oct 19 04:31:52.316646 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 04:31:52.316646 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:31:52.316646 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 19 04:31:52.316646 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 19 04:31:52.316646 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 04:31:52.316646 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 04:31:52.316646 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 19 04:31:52.316646 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 19 04:31:52.316646 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id ad6b2a2f-dae4-43e1-bc2c-23a60e097bc5. Oct 19 04:31:52.316646 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:31:52.316646 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:31:52.316646 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:31:52.316646 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:31:52.316646 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:31:52.316646 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:31:52.316646 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 04:31:52.316646 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 04:31:52.316646 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 04:31:52.316646 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 04:31:52.316646 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 19 04:31:52.316646 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 19 04:31:52.316646 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b29db1b-c3de-410a-b3ca-fec68fa11f60 is not attached to volume ad6b2a2f-dae4-43e1-bc2c-23a60e097bc5 Oct 19 04:31:52.316646 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:31:52.316646 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:31:52.316646 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:31:52.316646 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:31:52.316646 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:31:52.316646 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:31:52.321887 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 04:31:52.321887 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 04:31:52.321887 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b29db1b-c3de-410a-b3ca-fec68fa11f60 is not attached to volume ad6b2a2f-dae4-43e1-bc2c-23a60e097bc5 Oct 19 04:31:52.321887 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:31:52.321887 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a64bac15-e35d-4402-9bfd-d563e5b93705 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Returning 404 to user: Instance 4b29db1b-c3de-410a-b3ca-fec68fa11f60 is not attached to volume ad6b2a2f-dae4-43e1-bc2c-23a60e097bc5 {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 04:31:52.321887 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a64bac15-e35d-4402-9bfd-d563e5b93705 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] 10.222.0.52 "DELETE /compute/v2.1/servers/4b29db1b-c3de-410a-b3ca-fec68fa11f60/os-volume_attachments/ad6b2a2f-dae4-43e1-bc2c-23a60e097bc5" status: 404 len: 154 microversion: 2.1 time: 0.091672 Oct 19 04:31:52.321887 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4216/7957] 10.222.0.52 () {58 vars in 1416 bytes} [Wed Oct 19 04:31:52 2022] DELETE /compute/v2.1/servers/4b29db1b-c3de-410a-b3ca-fec68fa11f60/os-volume_attachments/ad6b2a2f-dae4-43e1-bc2c-23a60e097bc5 => generated 154 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 04:31:55.706377 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9bceaabf-2b6b-40c3-9fc1-71720c4cbb17 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:31:55.706867 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9bceaabf-2b6b-40c3-9fc1-71720c4cbb17 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] [instance: 4b29db1b-c3de-410a-b3ca-fec68fa11f60] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:31:55.715786 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9bceaabf-2b6b-40c3-9fc1-71720c4cbb17 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:31:55.716277 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9bceaabf-2b6b-40c3-9fc1-71720c4cbb17 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:31:55.716724 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9bceaabf-2b6b-40c3-9fc1-71720c4cbb17 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:31:55.717444 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9bceaabf-2b6b-40c3-9fc1-71720c4cbb17 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:31:55.717905 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9bceaabf-2b6b-40c3-9fc1-71720c4cbb17 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:31:55.718335 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9bceaabf-2b6b-40c3-9fc1-71720c4cbb17 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:31:55.744764 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9bceaabf-2b6b-40c3-9fc1-71720c4cbb17 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] [instance: 4b29db1b-c3de-410a-b3ca-fec68fa11f60] Going to try to terminate instance {{(pid=121135) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 04:31:56.026154 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9bceaabf-2b6b-40c3-9fc1-71720c4cbb17 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] 10.222.0.52 "DELETE /compute/v2.1/servers/4b29db1b-c3de-410a-b3ca-fec68fa11f60" status: 204 len: 0 microversion: 2.1 time: 0.323261 Oct 19 04:31:56.026757 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3742/7958] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 04:31:55 2022] DELETE /compute/v2.1/servers/4b29db1b-c3de-410a-b3ca-fec68fa11f60 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 04:31:56.035367 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1f88fc96-aa96-4ebe-899d-81b71725fe67 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:31:56.036002 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1f88fc96-aa96-4ebe-899d-81b71725fe67 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] [instance: 4b29db1b-c3de-410a-b3ca-fec68fa11f60] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:31:56.043645 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1f88fc96-aa96-4ebe-899d-81b71725fe67 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:31:56.044359 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1f88fc96-aa96-4ebe-899d-81b71725fe67 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:31:56.044819 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1f88fc96-aa96-4ebe-899d-81b71725fe67 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:31:56.045601 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1f88fc96-aa96-4ebe-899d-81b71725fe67 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:31:56.046048 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1f88fc96-aa96-4ebe-899d-81b71725fe67 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:31:56.046500 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1f88fc96-aa96-4ebe-899d-81b71725fe67 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:31:56.183109 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-1f88fc96-aa96-4ebe-899d-81b71725fe67 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c04ff6cc2c4fd5a51b1e2325c4c8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb5ad698ae94dceabc0e4a5b39567a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:31:56.191008 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1f88fc96-aa96-4ebe-899d-81b71725fe67 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] 10.222.0.52 "GET /compute/v2.1/servers/4b29db1b-c3de-410a-b3ca-fec68fa11f60" status: 200 len: 1555 microversion: 2.1 time: 0.159858 Oct 19 04:31:56.191571 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4217/7959] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:31:56 2022] GET /compute/v2.1/servers/4b29db1b-c3de-410a-b3ca-fec68fa11f60 => generated 1555 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:31:57.216019 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-786a1830-78bc-47bc-b253-88e035e1cb4b tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:31:57.216735 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-786a1830-78bc-47bc-b253-88e035e1cb4b tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] [instance: 4b29db1b-c3de-410a-b3ca-fec68fa11f60] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:31:57.223721 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-786a1830-78bc-47bc-b253-88e035e1cb4b tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:31:57.224210 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-786a1830-78bc-47bc-b253-88e035e1cb4b tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:31:57.224658 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-786a1830-78bc-47bc-b253-88e035e1cb4b tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:31:57.225354 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-786a1830-78bc-47bc-b253-88e035e1cb4b tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:31:57.225837 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-786a1830-78bc-47bc-b253-88e035e1cb4b tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:31:57.226268 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-786a1830-78bc-47bc-b253-88e035e1cb4b tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:31:57.358930 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-786a1830-78bc-47bc-b253-88e035e1cb4b tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c04ff6cc2c4fd5a51b1e2325c4c8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb5ad698ae94dceabc0e4a5b39567a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:31:57.366798 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-786a1830-78bc-47bc-b253-88e035e1cb4b tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] 10.222.0.52 "GET /compute/v2.1/servers/4b29db1b-c3de-410a-b3ca-fec68fa11f60" status: 200 len: 1555 microversion: 2.1 time: 0.155617 Oct 19 04:31:57.367375 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3743/7960] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:31:57 2022] GET /compute/v2.1/servers/4b29db1b-c3de-410a-b3ca-fec68fa11f60 => generated 1555 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:31:58.390624 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-fa17f2bc-c778-494b-b001-a27ffce46bef tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:31:58.391990 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-fa17f2bc-c778-494b-b001-a27ffce46bef tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] [instance: 4b29db1b-c3de-410a-b3ca-fec68fa11f60] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:31:58.400358 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fa17f2bc-c778-494b-b001-a27ffce46bef tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:31:58.400610 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fa17f2bc-c778-494b-b001-a27ffce46bef tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:31:58.401035 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fa17f2bc-c778-494b-b001-a27ffce46bef tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:31:58.401860 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fa17f2bc-c778-494b-b001-a27ffce46bef tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:31:58.402406 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fa17f2bc-c778-494b-b001-a27ffce46bef tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:31:58.402980 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fa17f2bc-c778-494b-b001-a27ffce46bef tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:31:58.419201 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-cd1332dd-0f03-4351-86f4-104a14332e83 req-e8c40f0d-73ce-43fa-b8ae-0b8d91abd4e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b29db1b-c3de-410a-b3ca-fec68fa11f60", "name": "network-vif-deleted", "tag": "929acdb0-a17d-4396-b4aa-81eba2606c14"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:31:58.430930 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-cd1332dd-0f03-4351-86f4-104a14332e83 req-e8c40f0d-73ce-43fa-b8ae-0b8d91abd4e2 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:31:58.431411 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-cd1332dd-0f03-4351-86f4-104a14332e83 req-e8c40f0d-73ce-43fa-b8ae-0b8d91abd4e2 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:31:58.431846 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-cd1332dd-0f03-4351-86f4-104a14332e83 req-e8c40f0d-73ce-43fa-b8ae-0b8d91abd4e2 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:31:58.443721 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-cd1332dd-0f03-4351-86f4-104a14332e83 req-e8c40f0d-73ce-43fa-b8ae-0b8d91abd4e2 service nova] Creating event network-vif-deleted:929acdb0-a17d-4396-b4aa-81eba2606c14 for instance 4b29db1b-c3de-410a-b3ca-fec68fa11f60 on n-h2-861333-8 Oct 19 04:31:58.449648 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-cd1332dd-0f03-4351-86f4-104a14332e83 req-e8c40f0d-73ce-43fa-b8ae-0b8d91abd4e2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034243 Oct 19 04:31:58.450249 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3744/7961] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:31:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 04:31:58.476373 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-fa17f2bc-c778-494b-b001-a27ffce46bef tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c04ff6cc2c4fd5a51b1e2325c4c8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb5ad698ae94dceabc0e4a5b39567a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:31:58.484437 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-fa17f2bc-c778-494b-b001-a27ffce46bef tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] 10.222.0.52 "GET /compute/v2.1/servers/4b29db1b-c3de-410a-b3ca-fec68fa11f60" status: 200 len: 1513 microversion: 2.1 time: 0.097904 Oct 19 04:31:58.487658 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4218/7962] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:31:58 2022] GET /compute/v2.1/servers/4b29db1b-c3de-410a-b3ca-fec68fa11f60 => generated 1513 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:31:59.510712 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ae66c347-40f8-4552-b958-0e6a5e8696ce tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:31:59.511427 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ae66c347-40f8-4552-b958-0e6a5e8696ce tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] [instance: 4b29db1b-c3de-410a-b3ca-fec68fa11f60] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:31:59.517767 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ae66c347-40f8-4552-b958-0e6a5e8696ce tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:31:59.518262 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ae66c347-40f8-4552-b958-0e6a5e8696ce tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:31:59.518710 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ae66c347-40f8-4552-b958-0e6a5e8696ce tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:31:59.519413 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ae66c347-40f8-4552-b958-0e6a5e8696ce tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:31:59.519874 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ae66c347-40f8-4552-b958-0e6a5e8696ce tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:31:59.520311 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ae66c347-40f8-4552-b958-0e6a5e8696ce tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:31:59.534504 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-ae66c347-40f8-4552-b958-0e6a5e8696ce tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] HTTP exception thrown: Instance 4b29db1b-c3de-410a-b3ca-fec68fa11f60 could not be found. Oct 19 04:31:59.536134 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ae66c347-40f8-4552-b958-0e6a5e8696ce tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Request method failure captured: Oct 19 04:31:59.536134 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/4b29db1b-c3de-410a-b3ca-fec68fa11f60 HTTP/1.1 Oct 19 04:31:59.536134 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 04:31:59.536134 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 04:31:59.536134 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 04:31:59.536134 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 04:31:59.536134 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 04:31:59.536134 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 04:31:59.536134 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 04:31:59.536134 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 04:31:59.536134 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT3y_zyB1g63gioa-ifJ0dkoCTOlZmZErF0CpNGrcb2_BcskDlnnNYkFtO29M-WCPkqGqIVquISfO6GJ6_e-H71yF3RJV0eU5D58xeW_lumD5wYAG8LS1HlVTXpqOhmM6Nv9MQIFa7rrVvNr0ThaLyhtWP-s68O0CxcGD9SQ5veJstWI Oct 19 04:31:59.536134 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 04:31:59.536134 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 04:31:59.536134 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 04:31:59.536134 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 04:31:59.536134 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 04:31:59.536134 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 04:31:59.536134 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 0bb5ad698ae94dceabc0e4a5b39567a7 Oct 19 04:31:59.536134 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-TestMinimumBasicScenario-1592269912 Oct 19 04:31:59.536134 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 04:31:59.536134 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 04:31:59.536134 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/0bb5ad698ae94dceabc0e4a5b39567a7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0bb5ad698ae94dceabc0e4a5b39567a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0bb5ad698ae94dceabc0e4a5b39567a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_0bb5ad698ae94dceabc0e4a5b39567a7", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 04:31:59.536134 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-TestMinimumBasicScenario-1592269912 Oct 19 04:31:59.536134 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 0bb5ad698ae94dceabc0e4a5b39567a7 Oct 19 04:31:59.536134 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1592269912 Oct 19 04:31:59.536134 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-TestMinimumBasicScenario-1592269912-project Oct 19 04:31:59.536134 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 04:31:59.536134 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 04:31:59.536134 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 33c04ff6cc2c4fd5a51b1e2325c4c8de Oct 19 04:31:59.536134 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-TestMinimumBasicScenario-1592269912-project Oct 19 04:31:59.536134 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 04:31:59.536134 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance 4b29db1b-c3de-410a-b3ca-fec68fa11f60 could not be found. Oct 19 04:31:59.536134 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '4b29db1b-c3de-410a-b3ca-fec68fa11f60'} Oct 19 04:31:59.536134 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 04:31:59.536134 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:31:59.536134 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 04:31:59.536134 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 04:31:59.536134 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 04:31:59.536134 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 04:31:59.536134 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 04:31:59.536134 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 04:31:59.536134 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 04:31:59.536134 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 04:31:59.536134 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b29db1b-c3de-410a-b3ca-fec68fa11f60 could not be found. Oct 19 04:31:59.536134 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:31:59.536134 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:31:59.536134 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:31:59.536134 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:31:59.536134 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:31:59.536134 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:31:59.536134 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 04:31:59.536134 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 04:31:59.536134 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 04:31:59.536134 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 04:31:59.536134 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 04:31:59.536134 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 04:31:59.536134 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 04:31:59.536134 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 04:31:59.536134 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 04:31:59.536134 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 04:31:59.536134 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b29db1b-c3de-410a-b3ca-fec68fa11f60 could not be found. Oct 19 04:31:59.536134 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:31:59.536134 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:31:59.536134 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:31:59.541631 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:31:59.541631 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:31:59.541631 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:31:59.541631 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 04:31:59.541631 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 04:31:59.541631 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b29db1b-c3de-410a-b3ca-fec68fa11f60 could not be found. Oct 19 04:31:59.541631 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:31:59.541631 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ae66c347-40f8-4552-b958-0e6a5e8696ce tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Returning 404 to user: Instance 4b29db1b-c3de-410a-b3ca-fec68fa11f60 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 04:31:59.541631 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ae66c347-40f8-4552-b958-0e6a5e8696ce tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] 10.222.0.52 "GET /compute/v2.1/servers/4b29db1b-c3de-410a-b3ca-fec68fa11f60" status: 404 len: 111 microversion: 2.1 time: 0.032625 Oct 19 04:31:59.541631 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3745/7963] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:31:59 2022] GET /compute/v2.1/servers/4b29db1b-c3de-410a-b3ca-fec68fa11f60 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 04:31:59.546484 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-faf744cd-cc53-400c-a4fd-776ede84bdc9 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Calling method '.version_select at 0x7fc12be9aaf0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:31:59.550883 n-d-861333-8 devstack@n-api.service[121134]: ERROR oslo.messaging._drivers.impl_rabbit [None req-faf744cd-cc53-400c-a4fd-776ede84bdc9 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] [19b0d749-bd61-471f-8efc-e4b656063a84] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 19 04:32:00.558467 n-d-861333-8 devstack@n-api.service[121134]: INFO oslo.messaging._drivers.impl_rabbit [None req-faf744cd-cc53-400c-a4fd-776ede84bdc9 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] [19b0d749-bd61-471f-8efc-e4b656063a84] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 35020. Oct 19 04:32:00.655665 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-faf744cd-cc53-400c-a4fd-776ede84bdc9 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1336182853" status: 202 len: 0 microversion: 2.1 time: 1.112891 Oct 19 04:32:00.656436 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4219/7964] 10.222.0.52 () {58 vars in 1272 bytes} [Wed Oct 19 04:31:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1336182853 => generated 0 bytes in 1114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 19 04:32:11.718033 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6804e978-db44-4b71-ab9c-b3f79ca562d4 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Action: 'create', calling method: .version_select at 0x7fc1305e1160>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1979659351", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE7EDNq0oUTXSKzY65VdcwkwTHS/zSCqxUJXbnjwC1pxEHOwpvaxosWbwoD/yy92K87SKPafnhteknaXQIOZbhZeFGOIxhreWo1yBuafSVT+B5KKZtzdcWyfHXubZJC08Q=="}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:32:11.726001 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:32:11.726681 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=53,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:32:11.738150 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-6804e978-db44-4b71-ab9c-b3f79ca562d4 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Getting quotas for project 0bb5ad698ae94dceabc0e4a5b39567a7. Resources: {'key_pairs'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 04:32:11.743426 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-6804e978-db44-4b71-ab9c-b3f79ca562d4 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Getting quotas for user 33c04ff6cc2c4fd5a51b1e2325c4c8de and project 0bb5ad698ae94dceabc0e4a5b39567a7. Resources: {'key_pairs'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 04:32:11.864890 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6804e978-db44-4b71-ab9c-b3f79ca562d4 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.150668 Oct 19 04:32:11.865551 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3746/7965] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Oct 19 04:32:11 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 04:32:11.914830 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=42 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:32:11.915612 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:32:11.920324 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d78b1dfa-73f4-499e-a64f-5a0839c914be tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1194424216", "imageRef": "087fb307-4216-4aec-859f-59e2921f7cb9", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1979659351", "networks": [{"uuid": "bef0c42e-c476-443a-8a1a-f4f4e18f608c"}]}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:32:11.978024 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-d78b1dfa-73f4-499e-a64f-5a0839c914be tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] validate_networks() for [('bef0c42e-c476-443a-8a1a-f4f4e18f608c', None, None, None, None, None)] {{(pid=121134) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 04:32:12.405140 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-d78b1dfa-73f4-499e-a64f-5a0839c914be tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Flavor limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 04:32:12.405616 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-d78b1dfa-73f4-499e-a64f-5a0839c914be tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Image limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 04:32:12.406113 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-d78b1dfa-73f4-499e-a64f-5a0839c914be tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Flavor pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 04:32:12.406870 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-d78b1dfa-73f4-499e-a64f-5a0839c914be tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Image pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 04:32:12.407303 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-d78b1dfa-73f4-499e-a64f-5a0839c914be tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 04:32:12.416271 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d78b1dfa-73f4-499e-a64f-5a0839c914be tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:32:12.416774 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d78b1dfa-73f4-499e-a64f-5a0839c914be tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:32:12.417230 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d78b1dfa-73f4-499e-a64f-5a0839c914be tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:32:12.418037 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d78b1dfa-73f4-499e-a64f-5a0839c914be tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:32:12.418512 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d78b1dfa-73f4-499e-a64f-5a0839c914be tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:32:12.418956 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d78b1dfa-73f4-499e-a64f-5a0839c914be tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:32:12.435732 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-d78b1dfa-73f4-499e-a64f-5a0839c914be tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Getting quotas for project 0bb5ad698ae94dceabc0e4a5b39567a7. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 04:32:12.440997 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-d78b1dfa-73f4-499e-a64f-5a0839c914be tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Getting quotas for user 33c04ff6cc2c4fd5a51b1e2325c4c8de and project 0bb5ad698ae94dceabc0e4a5b39567a7. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 04:32:12.453835 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d78b1dfa-73f4-499e-a64f-5a0839c914be tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Going to run 1 instances... {{(pid=121134) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 04:32:12.456074 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d78b1dfa-73f4-499e-a64f-5a0839c914be tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] [instance: 234605f1-0454-4056-8c71-fb0444c4e305] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='087fb307-4216-4aec-859f-59e2921f7cb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 04:32:12.598857 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d78b1dfa-73f4-499e-a64f-5a0839c914be tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.686349 Oct 19 04:32:12.599507 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4220/7966] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 04:32:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 688 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 04:32:12.610699 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-938fdcb0-127a-4b7f-b05f-aed84ce57975 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:32:12.611321 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-938fdcb0-127a-4b7f-b05f-aed84ce57975 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] [instance: 234605f1-0454-4056-8c71-fb0444c4e305] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:32:12.669571 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-938fdcb0-127a-4b7f-b05f-aed84ce57975 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c04ff6cc2c4fd5a51b1e2325c4c8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb5ad698ae94dceabc0e4a5b39567a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:32:12.676519 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-938fdcb0-127a-4b7f-b05f-aed84ce57975 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] 10.222.0.52 "GET /compute/v2.1/servers/234605f1-0454-4056-8c71-fb0444c4e305" status: 200 len: 1259 microversion: 2.1 time: 0.069905 Oct 19 04:32:12.677096 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3747/7967] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:32:12 2022] GET /compute/v2.1/servers/234605f1-0454-4056-8c71-fb0444c4e305 => generated 1259 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:32:13.700962 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-65dba54a-85d5-4893-b09b-1fcd38fa52b5 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:32:13.701715 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-65dba54a-85d5-4893-b09b-1fcd38fa52b5 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] [instance: 234605f1-0454-4056-8c71-fb0444c4e305] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:32:13.754442 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-65dba54a-85d5-4893-b09b-1fcd38fa52b5 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c04ff6cc2c4fd5a51b1e2325c4c8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb5ad698ae94dceabc0e4a5b39567a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:32:13.762915 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-65dba54a-85d5-4893-b09b-1fcd38fa52b5 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] 10.222.0.52 "GET /compute/v2.1/servers/234605f1-0454-4056-8c71-fb0444c4e305" status: 200 len: 1259 microversion: 2.1 time: 0.067248 Oct 19 04:32:13.763565 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4221/7968] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:32:13 2022] GET /compute/v2.1/servers/234605f1-0454-4056-8c71-fb0444c4e305 => generated 1259 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:32:14.788077 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2f860383-c96a-42bf-aec8-9801a12cb306 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:32:14.788713 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-2f860383-c96a-42bf-aec8-9801a12cb306 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] [instance: 234605f1-0454-4056-8c71-fb0444c4e305] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:32:14.846614 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-2f860383-c96a-42bf-aec8-9801a12cb306 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c04ff6cc2c4fd5a51b1e2325c4c8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb5ad698ae94dceabc0e4a5b39567a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:32:14.855454 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2f860383-c96a-42bf-aec8-9801a12cb306 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] 10.222.0.52 "GET /compute/v2.1/servers/234605f1-0454-4056-8c71-fb0444c4e305" status: 200 len: 1259 microversion: 2.1 time: 0.072683 Oct 19 04:32:14.856025 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3748/7969] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:32:14 2022] GET /compute/v2.1/servers/234605f1-0454-4056-8c71-fb0444c4e305 => generated 1259 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:32:15.878040 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-dba8b038-9085-4142-bd05-f1cbbbecd051 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:32:15.878665 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-dba8b038-9085-4142-bd05-f1cbbbecd051 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] [instance: 234605f1-0454-4056-8c71-fb0444c4e305] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:32:15.932229 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-dba8b038-9085-4142-bd05-f1cbbbecd051 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c04ff6cc2c4fd5a51b1e2325c4c8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb5ad698ae94dceabc0e4a5b39567a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:32:15.939176 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-dba8b038-9085-4142-bd05-f1cbbbecd051 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] 10.222.0.52 "GET /compute/v2.1/servers/234605f1-0454-4056-8c71-fb0444c4e305" status: 200 len: 1259 microversion: 2.1 time: 0.065114 Oct 19 04:32:15.939738 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4222/7970] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:32:15 2022] GET /compute/v2.1/servers/234605f1-0454-4056-8c71-fb0444c4e305 => generated 1259 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:32:16.962429 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9fa4f6dc-e996-4ee6-8005-1c0c8c18d2e6 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:32:16.963041 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9fa4f6dc-e996-4ee6-8005-1c0c8c18d2e6 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] [instance: 234605f1-0454-4056-8c71-fb0444c4e305] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:32:16.969415 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9fa4f6dc-e996-4ee6-8005-1c0c8c18d2e6 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:32:16.969907 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9fa4f6dc-e996-4ee6-8005-1c0c8c18d2e6 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:32:16.970374 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9fa4f6dc-e996-4ee6-8005-1c0c8c18d2e6 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:32:16.971072 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9fa4f6dc-e996-4ee6-8005-1c0c8c18d2e6 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:32:16.971525 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9fa4f6dc-e996-4ee6-8005-1c0c8c18d2e6 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:32:16.971951 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9fa4f6dc-e996-4ee6-8005-1c0c8c18d2e6 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:32:17.036831 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-9fa4f6dc-e996-4ee6-8005-1c0c8c18d2e6 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c04ff6cc2c4fd5a51b1e2325c4c8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb5ad698ae94dceabc0e4a5b39567a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:32:17.045211 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9fa4f6dc-e996-4ee6-8005-1c0c8c18d2e6 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] 10.222.0.52 "GET /compute/v2.1/servers/234605f1-0454-4056-8c71-fb0444c4e305" status: 200 len: 1263 microversion: 2.1 time: 0.086813 Oct 19 04:32:17.045829 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3749/7971] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:32:16 2022] GET /compute/v2.1/servers/234605f1-0454-4056-8c71-fb0444c4e305 => generated 1263 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:32:18.067656 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-19dbd017-1b9f-4154-acaf-faecbc40db38 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:32:18.068273 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-19dbd017-1b9f-4154-acaf-faecbc40db38 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] [instance: 234605f1-0454-4056-8c71-fb0444c4e305] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:32:18.075894 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-19dbd017-1b9f-4154-acaf-faecbc40db38 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:32:18.076414 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-19dbd017-1b9f-4154-acaf-faecbc40db38 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:32:18.076874 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-19dbd017-1b9f-4154-acaf-faecbc40db38 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:32:18.077631 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-19dbd017-1b9f-4154-acaf-faecbc40db38 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:32:18.078106 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-19dbd017-1b9f-4154-acaf-faecbc40db38 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:32:18.078555 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-19dbd017-1b9f-4154-acaf-faecbc40db38 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:32:18.139547 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-19dbd017-1b9f-4154-acaf-faecbc40db38 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c04ff6cc2c4fd5a51b1e2325c4c8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb5ad698ae94dceabc0e4a5b39567a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:32:18.147227 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-19dbd017-1b9f-4154-acaf-faecbc40db38 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] 10.222.0.52 "GET /compute/v2.1/servers/234605f1-0454-4056-8c71-fb0444c4e305" status: 200 len: 1311 microversion: 2.1 time: 0.083524 Oct 19 04:32:18.147807 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4223/7972] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:32:18 2022] GET /compute/v2.1/servers/234605f1-0454-4056-8c71-fb0444c4e305 => generated 1311 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:32:19.175302 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-bd18d3b4-af53-40d5-83af-b0ca58cb8eed tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:32:19.175930 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-bd18d3b4-af53-40d5-83af-b0ca58cb8eed tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] [instance: 234605f1-0454-4056-8c71-fb0444c4e305] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:32:19.183479 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bd18d3b4-af53-40d5-83af-b0ca58cb8eed tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:32:19.183977 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bd18d3b4-af53-40d5-83af-b0ca58cb8eed tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:32:19.184609 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bd18d3b4-af53-40d5-83af-b0ca58cb8eed tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:32:19.185321 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bd18d3b4-af53-40d5-83af-b0ca58cb8eed tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:32:19.185806 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bd18d3b4-af53-40d5-83af-b0ca58cb8eed tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:32:19.186239 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bd18d3b4-af53-40d5-83af-b0ca58cb8eed tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:32:19.284065 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-bd18d3b4-af53-40d5-83af-b0ca58cb8eed tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c04ff6cc2c4fd5a51b1e2325c4c8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb5ad698ae94dceabc0e4a5b39567a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:32:19.294218 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-bd18d3b4-af53-40d5-83af-b0ca58cb8eed tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] 10.222.0.52 "GET /compute/v2.1/servers/234605f1-0454-4056-8c71-fb0444c4e305" status: 200 len: 1317 microversion: 2.1 time: 0.122974 Oct 19 04:32:19.295090 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3750/7973] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:32:19 2022] GET /compute/v2.1/servers/234605f1-0454-4056-8c71-fb0444c4e305 => generated 1317 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:32:20.317832 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ddf920e0-6e71-42f9-ba5e-005a1af08be5 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:32:20.318665 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ddf920e0-6e71-42f9-ba5e-005a1af08be5 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] [instance: 234605f1-0454-4056-8c71-fb0444c4e305] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:32:20.326356 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ddf920e0-6e71-42f9-ba5e-005a1af08be5 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:32:20.326863 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ddf920e0-6e71-42f9-ba5e-005a1af08be5 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:32:20.327538 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ddf920e0-6e71-42f9-ba5e-005a1af08be5 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:32:20.328485 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ddf920e0-6e71-42f9-ba5e-005a1af08be5 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:32:20.328964 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ddf920e0-6e71-42f9-ba5e-005a1af08be5 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:32:20.329441 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ddf920e0-6e71-42f9-ba5e-005a1af08be5 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:32:20.471124 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ddf920e0-6e71-42f9-ba5e-005a1af08be5 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c04ff6cc2c4fd5a51b1e2325c4c8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb5ad698ae94dceabc0e4a5b39567a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:32:20.479454 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ddf920e0-6e71-42f9-ba5e-005a1af08be5 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] 10.222.0.52 "GET /compute/v2.1/servers/234605f1-0454-4056-8c71-fb0444c4e305" status: 200 len: 1359 microversion: 2.1 time: 0.165580 Oct 19 04:32:20.480106 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4224/7974] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:32:20 2022] GET /compute/v2.1/servers/234605f1-0454-4056-8c71-fb0444c4e305 => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:32:21.503342 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-64f56aa5-e70a-4dc0-94db-0d9825de338c tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:32:21.503948 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-64f56aa5-e70a-4dc0-94db-0d9825de338c tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] [instance: 234605f1-0454-4056-8c71-fb0444c4e305] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:32:21.511397 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-64f56aa5-e70a-4dc0-94db-0d9825de338c tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:32:21.511890 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-64f56aa5-e70a-4dc0-94db-0d9825de338c tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:32:21.512365 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-64f56aa5-e70a-4dc0-94db-0d9825de338c tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:32:21.513079 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-64f56aa5-e70a-4dc0-94db-0d9825de338c tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:32:21.521790 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-64f56aa5-e70a-4dc0-94db-0d9825de338c tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:32:21.522801 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-64f56aa5-e70a-4dc0-94db-0d9825de338c tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:32:21.671316 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-64f56aa5-e70a-4dc0-94db-0d9825de338c tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c04ff6cc2c4fd5a51b1e2325c4c8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb5ad698ae94dceabc0e4a5b39567a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:32:21.680347 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-64f56aa5-e70a-4dc0-94db-0d9825de338c tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] 10.222.0.52 "GET /compute/v2.1/servers/234605f1-0454-4056-8c71-fb0444c4e305" status: 200 len: 1359 microversion: 2.1 time: 0.180776 Oct 19 04:32:21.681045 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3751/7975] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:32:21 2022] GET /compute/v2.1/servers/234605f1-0454-4056-8c71-fb0444c4e305 => generated 1359 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:32:22.703578 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ad8faf4a-9710-4141-b4dc-b317750ad1e4 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:32:22.704211 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ad8faf4a-9710-4141-b4dc-b317750ad1e4 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] [instance: 234605f1-0454-4056-8c71-fb0444c4e305] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:32:22.706973 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:32:22.712229 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ad8faf4a-9710-4141-b4dc-b317750ad1e4 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:32:22.712759 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ad8faf4a-9710-4141-b4dc-b317750ad1e4 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:32:22.713385 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ad8faf4a-9710-4141-b4dc-b317750ad1e4 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:32:22.714123 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ad8faf4a-9710-4141-b4dc-b317750ad1e4 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:32:22.714600 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ad8faf4a-9710-4141-b4dc-b317750ad1e4 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:32:22.715114 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ad8faf4a-9710-4141-b4dc-b317750ad1e4 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:32:22.858969 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ad8faf4a-9710-4141-b4dc-b317750ad1e4 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c04ff6cc2c4fd5a51b1e2325c4c8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb5ad698ae94dceabc0e4a5b39567a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:32:22.867206 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ad8faf4a-9710-4141-b4dc-b317750ad1e4 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] 10.222.0.52 "GET /compute/v2.1/servers/234605f1-0454-4056-8c71-fb0444c4e305" status: 200 len: 1359 microversion: 2.1 time: 0.167466 Oct 19 04:32:22.868005 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4225/7976] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:32:22 2022] GET /compute/v2.1/servers/234605f1-0454-4056-8c71-fb0444c4e305 => generated 1359 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:32:23.892434 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f312302a-3b13-4626-be08-4e7a6810bf98 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:32:23.893052 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f312302a-3b13-4626-be08-4e7a6810bf98 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] [instance: 234605f1-0454-4056-8c71-fb0444c4e305] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:32:23.903117 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f312302a-3b13-4626-be08-4e7a6810bf98 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:32:23.904102 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f312302a-3b13-4626-be08-4e7a6810bf98 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:32:23.912520 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f312302a-3b13-4626-be08-4e7a6810bf98 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:32:23.913496 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f312302a-3b13-4626-be08-4e7a6810bf98 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:32:23.914278 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f312302a-3b13-4626-be08-4e7a6810bf98 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:32:23.914965 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f312302a-3b13-4626-be08-4e7a6810bf98 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:32:24.062286 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f312302a-3b13-4626-be08-4e7a6810bf98 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c04ff6cc2c4fd5a51b1e2325c4c8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb5ad698ae94dceabc0e4a5b39567a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:32:24.070513 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f312302a-3b13-4626-be08-4e7a6810bf98 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] 10.222.0.52 "GET /compute/v2.1/servers/234605f1-0454-4056-8c71-fb0444c4e305" status: 200 len: 1359 microversion: 2.1 time: 0.182702 Oct 19 04:32:24.071114 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3752/7977] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:32:23 2022] GET /compute/v2.1/servers/234605f1-0454-4056-8c71-fb0444c4e305 => generated 1359 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:32:25.129690 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6619cb03-ffce-4270-8192-398eed730a89 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:32:25.129690 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6619cb03-ffce-4270-8192-398eed730a89 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] [instance: 234605f1-0454-4056-8c71-fb0444c4e305] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:32:25.129690 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6619cb03-ffce-4270-8192-398eed730a89 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:32:25.129690 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6619cb03-ffce-4270-8192-398eed730a89 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:32:25.129690 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6619cb03-ffce-4270-8192-398eed730a89 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:32:25.129690 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6619cb03-ffce-4270-8192-398eed730a89 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:32:25.129690 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6619cb03-ffce-4270-8192-398eed730a89 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:32:25.129690 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6619cb03-ffce-4270-8192-398eed730a89 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:32:25.270118 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-6619cb03-ffce-4270-8192-398eed730a89 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c04ff6cc2c4fd5a51b1e2325c4c8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb5ad698ae94dceabc0e4a5b39567a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:32:25.279212 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6619cb03-ffce-4270-8192-398eed730a89 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] 10.222.0.52 "GET /compute/v2.1/servers/234605f1-0454-4056-8c71-fb0444c4e305" status: 200 len: 1359 microversion: 2.1 time: 0.188567 Oct 19 04:32:25.280004 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4226/7978] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:32:25 2022] GET /compute/v2.1/servers/234605f1-0454-4056-8c71-fb0444c4e305 => generated 1359 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:32:26.304879 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1d2df50f-79d2-4388-bdce-1414a66c851c tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:32:26.308901 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1d2df50f-79d2-4388-bdce-1414a66c851c tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] [instance: 234605f1-0454-4056-8c71-fb0444c4e305] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:32:26.308901 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=8 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:32:26.314692 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1d2df50f-79d2-4388-bdce-1414a66c851c tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:32:26.315341 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1d2df50f-79d2-4388-bdce-1414a66c851c tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:32:26.315943 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1d2df50f-79d2-4388-bdce-1414a66c851c tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:32:26.316802 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1d2df50f-79d2-4388-bdce-1414a66c851c tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:32:26.317329 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1d2df50f-79d2-4388-bdce-1414a66c851c tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:32:26.317862 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1d2df50f-79d2-4388-bdce-1414a66c851c tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:32:26.526142 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-1d2df50f-79d2-4388-bdce-1414a66c851c tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c04ff6cc2c4fd5a51b1e2325c4c8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb5ad698ae94dceabc0e4a5b39567a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:32:26.534399 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1d2df50f-79d2-4388-bdce-1414a66c851c tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] 10.222.0.52 "GET /compute/v2.1/servers/234605f1-0454-4056-8c71-fb0444c4e305" status: 200 len: 1359 microversion: 2.1 time: 0.233565 Oct 19 04:32:26.535000 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3753/7979] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:32:26 2022] GET /compute/v2.1/servers/234605f1-0454-4056-8c71-fb0444c4e305 => generated 1359 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:32:27.558457 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-fec05547-1aff-43cc-9fe0-dc1a92c2f2b5 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:32:27.559245 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-fec05547-1aff-43cc-9fe0-dc1a92c2f2b5 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] [instance: 234605f1-0454-4056-8c71-fb0444c4e305] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:32:27.561130 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=10 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:32:27.566785 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fec05547-1aff-43cc-9fe0-dc1a92c2f2b5 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:32:27.567725 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fec05547-1aff-43cc-9fe0-dc1a92c2f2b5 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:32:27.567903 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fec05547-1aff-43cc-9fe0-dc1a92c2f2b5 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:32:27.568472 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fec05547-1aff-43cc-9fe0-dc1a92c2f2b5 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:32:27.568950 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fec05547-1aff-43cc-9fe0-dc1a92c2f2b5 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:32:27.569423 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fec05547-1aff-43cc-9fe0-dc1a92c2f2b5 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:32:27.751955 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-fec05547-1aff-43cc-9fe0-dc1a92c2f2b5 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c04ff6cc2c4fd5a51b1e2325c4c8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb5ad698ae94dceabc0e4a5b39567a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:32:27.759707 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-fec05547-1aff-43cc-9fe0-dc1a92c2f2b5 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] 10.222.0.52 "GET /compute/v2.1/servers/234605f1-0454-4056-8c71-fb0444c4e305" status: 200 len: 1359 microversion: 2.1 time: 0.205647 Oct 19 04:32:27.760906 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4227/7980] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:32:27 2022] GET /compute/v2.1/servers/234605f1-0454-4056-8c71-fb0444c4e305 => generated 1359 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:32:28.228408 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-8b7d7f67-2693-4e9a-8554-a37ba8404bda req-cb21207e-7060-4f59-9668-e9bb97761d43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "234605f1-0454-4056-8c71-fb0444c4e305", "tag": "79042958-494d-4573-97d5-d29073d356ed"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:32:28.239485 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-8b7d7f67-2693-4e9a-8554-a37ba8404bda req-cb21207e-7060-4f59-9668-e9bb97761d43 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:32:28.242864 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-8b7d7f67-2693-4e9a-8554-a37ba8404bda req-cb21207e-7060-4f59-9668-e9bb97761d43 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:32:28.242864 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-8b7d7f67-2693-4e9a-8554-a37ba8404bda req-cb21207e-7060-4f59-9668-e9bb97761d43 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:32:28.252508 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-8b7d7f67-2693-4e9a-8554-a37ba8404bda req-cb21207e-7060-4f59-9668-e9bb97761d43 service nova] Creating event network-changed:79042958-494d-4573-97d5-d29073d356ed for instance 234605f1-0454-4056-8c71-fb0444c4e305 on n-h2-861333-8 Oct 19 04:32:28.257769 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-8b7d7f67-2693-4e9a-8554-a37ba8404bda req-cb21207e-7060-4f59-9668-e9bb97761d43 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033476 Oct 19 04:32:28.258530 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3754/7981] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:32:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:32:28.783431 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2429a045-3289-43b7-826a-833b0c6828cf tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:32:28.784049 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2429a045-3289-43b7-826a-833b0c6828cf tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] [instance: 234605f1-0454-4056-8c71-fb0444c4e305] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:32:28.790932 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2429a045-3289-43b7-826a-833b0c6828cf tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:32:28.791440 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2429a045-3289-43b7-826a-833b0c6828cf tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:32:28.791901 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2429a045-3289-43b7-826a-833b0c6828cf tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:32:28.792628 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2429a045-3289-43b7-826a-833b0c6828cf tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:32:28.793101 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2429a045-3289-43b7-826a-833b0c6828cf tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:32:28.793578 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2429a045-3289-43b7-826a-833b0c6828cf tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:32:28.997412 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-2429a045-3289-43b7-826a-833b0c6828cf tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c04ff6cc2c4fd5a51b1e2325c4c8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb5ad698ae94dceabc0e4a5b39567a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:32:29.005111 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2429a045-3289-43b7-826a-833b0c6828cf tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] 10.222.0.52 "GET /compute/v2.1/servers/234605f1-0454-4056-8c71-fb0444c4e305" status: 200 len: 1359 microversion: 2.1 time: 0.225953 Oct 19 04:32:29.005949 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4228/7982] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:32:28 2022] GET /compute/v2.1/servers/234605f1-0454-4056-8c71-fb0444c4e305 => generated 1359 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:32:30.026903 n-d-861333-8 devstack@n-api.service[121135]: ERROR oslo.messaging._drivers.impl_rabbit [-] [171e3f7c-7dfe-4dce-b74d-cf08e9363be7] AMQP server on 10.222.0.52:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Oct 19 04:32:30.030776 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-679ed9c7-fc86-4dab-868f-9de7deb8ff61 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:32:30.031788 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-679ed9c7-fc86-4dab-868f-9de7deb8ff61 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] [instance: 234605f1-0454-4056-8c71-fb0444c4e305] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:32:30.038069 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-679ed9c7-fc86-4dab-868f-9de7deb8ff61 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:32:30.038561 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-679ed9c7-fc86-4dab-868f-9de7deb8ff61 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:32:30.039008 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-679ed9c7-fc86-4dab-868f-9de7deb8ff61 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:32:30.039702 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-679ed9c7-fc86-4dab-868f-9de7deb8ff61 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:32:30.040164 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-679ed9c7-fc86-4dab-868f-9de7deb8ff61 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:32:30.040596 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-679ed9c7-fc86-4dab-868f-9de7deb8ff61 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:32:30.169701 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-679ed9c7-fc86-4dab-868f-9de7deb8ff61 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c04ff6cc2c4fd5a51b1e2325c4c8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb5ad698ae94dceabc0e4a5b39567a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:32:30.177567 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-679ed9c7-fc86-4dab-868f-9de7deb8ff61 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] 10.222.0.52 "GET /compute/v2.1/servers/234605f1-0454-4056-8c71-fb0444c4e305" status: 200 len: 1359 microversion: 2.1 time: 0.153113 Oct 19 04:32:30.178151 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3755/7983] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:32:30 2022] GET /compute/v2.1/servers/234605f1-0454-4056-8c71-fb0444c4e305 => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:32:31.200356 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-386cc637-e03c-436f-a0b9-639ec4be9247 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:32:31.200988 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-386cc637-e03c-436f-a0b9-639ec4be9247 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] [instance: 234605f1-0454-4056-8c71-fb0444c4e305] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:32:31.207093 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-386cc637-e03c-436f-a0b9-639ec4be9247 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:32:31.207592 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-386cc637-e03c-436f-a0b9-639ec4be9247 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:32:31.208046 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-386cc637-e03c-436f-a0b9-639ec4be9247 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:32:31.208752 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-386cc637-e03c-436f-a0b9-639ec4be9247 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:32:31.209220 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-386cc637-e03c-436f-a0b9-639ec4be9247 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:32:31.209699 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-386cc637-e03c-436f-a0b9-639ec4be9247 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:32:31.342344 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-386cc637-e03c-436f-a0b9-639ec4be9247 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c04ff6cc2c4fd5a51b1e2325c4c8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb5ad698ae94dceabc0e4a5b39567a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:32:31.350280 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-386cc637-e03c-436f-a0b9-639ec4be9247 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] 10.222.0.52 "GET /compute/v2.1/servers/234605f1-0454-4056-8c71-fb0444c4e305" status: 200 len: 1359 microversion: 2.1 time: 0.154109 Oct 19 04:32:31.350875 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4229/7984] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:32:31 2022] GET /compute/v2.1/servers/234605f1-0454-4056-8c71-fb0444c4e305 => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:32:32.374694 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-47a05425-3cb2-4d76-bcf0-7b3fbedf98b9 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:32:32.375249 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-47a05425-3cb2-4d76-bcf0-7b3fbedf98b9 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] [instance: 234605f1-0454-4056-8c71-fb0444c4e305] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:32:32.386907 n-d-861333-8 devstack@n-api.service[121135]: INFO oslo.messaging._drivers.impl_rabbit [-] [171e3f7c-7dfe-4dce-b74d-cf08e9363be7] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 35202. Oct 19 04:32:32.390984 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-47a05425-3cb2-4d76-bcf0-7b3fbedf98b9 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:32:32.391475 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-47a05425-3cb2-4d76-bcf0-7b3fbedf98b9 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:32:32.391923 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-47a05425-3cb2-4d76-bcf0-7b3fbedf98b9 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:32:32.392632 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-47a05425-3cb2-4d76-bcf0-7b3fbedf98b9 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:32:32.393096 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-47a05425-3cb2-4d76-bcf0-7b3fbedf98b9 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:32:32.393582 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-47a05425-3cb2-4d76-bcf0-7b3fbedf98b9 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:32:32.523446 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-47a05425-3cb2-4d76-bcf0-7b3fbedf98b9 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c04ff6cc2c4fd5a51b1e2325c4c8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb5ad698ae94dceabc0e4a5b39567a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:32:32.531255 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-47a05425-3cb2-4d76-bcf0-7b3fbedf98b9 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] 10.222.0.52 "GET /compute/v2.1/servers/234605f1-0454-4056-8c71-fb0444c4e305" status: 200 len: 1359 microversion: 2.1 time: 0.160566 Oct 19 04:32:32.532132 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3756/7985] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:32:32 2022] GET /compute/v2.1/servers/234605f1-0454-4056-8c71-fb0444c4e305 => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:32:33.013119 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-6bc30f4e-e7f2-4dc2-b140-586e3afafa95 req-1819e974-d434-4faf-bfa1-2f2867b03dbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "234605f1-0454-4056-8c71-fb0444c4e305", "name": "network-vif-plugged", "status": "completed", "tag": "79042958-494d-4573-97d5-d29073d356ed"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:32:33.023598 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-6bc30f4e-e7f2-4dc2-b140-586e3afafa95 req-1819e974-d434-4faf-bfa1-2f2867b03dbe service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:32:33.024097 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-6bc30f4e-e7f2-4dc2-b140-586e3afafa95 req-1819e974-d434-4faf-bfa1-2f2867b03dbe service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:32:33.024553 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-6bc30f4e-e7f2-4dc2-b140-586e3afafa95 req-1819e974-d434-4faf-bfa1-2f2867b03dbe service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:32:33.036749 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-6bc30f4e-e7f2-4dc2-b140-586e3afafa95 req-1819e974-d434-4faf-bfa1-2f2867b03dbe service nova] Creating event network-vif-plugged:79042958-494d-4573-97d5-d29073d356ed for instance 234605f1-0454-4056-8c71-fb0444c4e305 on n-h2-861333-8 Oct 19 04:32:33.042375 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-6bc30f4e-e7f2-4dc2-b140-586e3afafa95 req-1819e974-d434-4faf-bfa1-2f2867b03dbe service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033175 Oct 19 04:32:33.042971 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4230/7986] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:32:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:32:33.555287 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b65780f2-1958-42bf-b75e-291fe5a1d900 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:32:33.555932 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b65780f2-1958-42bf-b75e-291fe5a1d900 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] [instance: 234605f1-0454-4056-8c71-fb0444c4e305] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:32:33.563273 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b65780f2-1958-42bf-b75e-291fe5a1d900 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:32:33.563758 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b65780f2-1958-42bf-b75e-291fe5a1d900 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:32:33.564193 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b65780f2-1958-42bf-b75e-291fe5a1d900 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:32:33.564902 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b65780f2-1958-42bf-b75e-291fe5a1d900 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:32:33.565352 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b65780f2-1958-42bf-b75e-291fe5a1d900 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:32:33.565795 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b65780f2-1958-42bf-b75e-291fe5a1d900 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:32:33.692261 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b65780f2-1958-42bf-b75e-291fe5a1d900 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c04ff6cc2c4fd5a51b1e2325c4c8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb5ad698ae94dceabc0e4a5b39567a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:32:33.700784 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b65780f2-1958-42bf-b75e-291fe5a1d900 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] 10.222.0.52 "GET /compute/v2.1/servers/234605f1-0454-4056-8c71-fb0444c4e305" status: 200 len: 1359 microversion: 2.1 time: 0.149370 Oct 19 04:32:33.701394 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3757/7987] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:32:33 2022] GET /compute/v2.1/servers/234605f1-0454-4056-8c71-fb0444c4e305 => generated 1359 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:32:34.724738 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b3df4e65-1271-4b68-8f9e-6dbe8ede33e5 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:32:34.725548 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b3df4e65-1271-4b68-8f9e-6dbe8ede33e5 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] [instance: 234605f1-0454-4056-8c71-fb0444c4e305] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:32:34.731779 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b3df4e65-1271-4b68-8f9e-6dbe8ede33e5 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:32:34.732272 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b3df4e65-1271-4b68-8f9e-6dbe8ede33e5 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:32:34.732720 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b3df4e65-1271-4b68-8f9e-6dbe8ede33e5 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:32:34.733447 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b3df4e65-1271-4b68-8f9e-6dbe8ede33e5 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:32:34.733916 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b3df4e65-1271-4b68-8f9e-6dbe8ede33e5 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:32:34.734350 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b3df4e65-1271-4b68-8f9e-6dbe8ede33e5 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:32:34.865607 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b3df4e65-1271-4b68-8f9e-6dbe8ede33e5 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c04ff6cc2c4fd5a51b1e2325c4c8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb5ad698ae94dceabc0e4a5b39567a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:32:34.873750 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b3df4e65-1271-4b68-8f9e-6dbe8ede33e5 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] 10.222.0.52 "GET /compute/v2.1/servers/234605f1-0454-4056-8c71-fb0444c4e305" status: 200 len: 1549 microversion: 2.1 time: 0.153975 Oct 19 04:32:34.874331 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4231/7988] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:32:34 2022] GET /compute/v2.1/servers/234605f1-0454-4056-8c71-fb0444c4e305 => generated 1549 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:32:34.896628 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-88de1ab0-0e5a-4ee1-95a5-ff7dabbb613b tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:32:34.897265 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-88de1ab0-0e5a-4ee1-95a5-ff7dabbb613b tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] [instance: 234605f1-0454-4056-8c71-fb0444c4e305] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:32:34.905976 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-88de1ab0-0e5a-4ee1-95a5-ff7dabbb613b tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:32:34.906723 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-88de1ab0-0e5a-4ee1-95a5-ff7dabbb613b tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:32:34.907161 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-88de1ab0-0e5a-4ee1-95a5-ff7dabbb613b tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:32:34.907856 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-88de1ab0-0e5a-4ee1-95a5-ff7dabbb613b tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:32:34.908308 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-88de1ab0-0e5a-4ee1-95a5-ff7dabbb613b tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:32:34.908848 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-88de1ab0-0e5a-4ee1-95a5-ff7dabbb613b tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:32:35.036971 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-88de1ab0-0e5a-4ee1-95a5-ff7dabbb613b tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c04ff6cc2c4fd5a51b1e2325c4c8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb5ad698ae94dceabc0e4a5b39567a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:32:35.044726 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-88de1ab0-0e5a-4ee1-95a5-ff7dabbb613b tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] 10.222.0.52 "GET /compute/v2.1/servers/234605f1-0454-4056-8c71-fb0444c4e305" status: 200 len: 1549 microversion: 2.1 time: 0.152029 Oct 19 04:32:35.045295 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3758/7989] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:32:34 2022] GET /compute/v2.1/servers/234605f1-0454-4056-8c71-fb0444c4e305 => generated 1549 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:32:35.066524 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-29ce798c-c5b9-4665-a063-1618d5434215 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:32:35.071204 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-29ce798c-c5b9-4665-a063-1618d5434215 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '33c04ff6cc2c4fd5a51b1e2325c4c8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb5ad698ae94dceabc0e4a5b39567a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:32:35.071990 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-29ce798c-c5b9-4665-a063-1618d5434215 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Searching by: {'deleted': False, 'project_id': '0bb5ad698ae94dceabc0e4a5b39567a7'} {{(pid=121134) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 04:32:35.077994 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-29ce798c-c5b9-4665-a063-1618d5434215 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:32:35.078494 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-29ce798c-c5b9-4665-a063-1618d5434215 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:32:35.078948 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-29ce798c-c5b9-4665-a063-1618d5434215 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:32:35.079687 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-29ce798c-c5b9-4665-a063-1618d5434215 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:32:35.080160 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-29ce798c-c5b9-4665-a063-1618d5434215 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:32:35.080605 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-29ce798c-c5b9-4665-a063-1618d5434215 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:32:35.103504 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.multi_cell_list [None req-29ce798c-c5b9-4665-a063-1618d5434215 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121134) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 04:32:35.129830 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-29ce798c-c5b9-4665-a063-1618d5434215 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] 10.222.0.52 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.067154 Oct 19 04:32:35.130429 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4232/7990] 10.222.0.52 () {58 vars in 1125 bytes} [Wed Oct 19 04:32:35 2022] GET /compute/v2.1/servers => generated 343 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:32:35.142600 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5c1aa6b4-5475-4d29-9b1f-b69ea23a447f tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:32:35.143227 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-5c1aa6b4-5475-4d29-9b1f-b69ea23a447f tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] [instance: 234605f1-0454-4056-8c71-fb0444c4e305] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:32:35.149281 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5c1aa6b4-5475-4d29-9b1f-b69ea23a447f tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:32:35.149808 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5c1aa6b4-5475-4d29-9b1f-b69ea23a447f tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:32:35.150258 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5c1aa6b4-5475-4d29-9b1f-b69ea23a447f tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:32:35.150958 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5c1aa6b4-5475-4d29-9b1f-b69ea23a447f tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:32:35.151417 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5c1aa6b4-5475-4d29-9b1f-b69ea23a447f tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:32:35.151850 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5c1aa6b4-5475-4d29-9b1f-b69ea23a447f tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:32:35.277918 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-5c1aa6b4-5475-4d29-9b1f-b69ea23a447f tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c04ff6cc2c4fd5a51b1e2325c4c8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb5ad698ae94dceabc0e4a5b39567a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:32:35.285917 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5c1aa6b4-5475-4d29-9b1f-b69ea23a447f tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] 10.222.0.52 "GET /compute/v2.1/servers/234605f1-0454-4056-8c71-fb0444c4e305" status: 200 len: 1549 microversion: 2.1 time: 0.147183 Oct 19 04:32:35.286485 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3759/7991] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:32:35 2022] GET /compute/v2.1/servers/234605f1-0454-4056-8c71-fb0444c4e305 => generated 1549 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:32:38.075276 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e278ddbd-da1f-4594-aee6-d9b44b4f82ed tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "164cdc24-c9c8-45f8-98b1-83419be84ecf"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:32:38.077689 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e278ddbd-da1f-4594-aee6-d9b44b4f82ed tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] [instance: 234605f1-0454-4056-8c71-fb0444c4e305] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:32:38.084465 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e278ddbd-da1f-4594-aee6-d9b44b4f82ed tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:32:38.084955 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e278ddbd-da1f-4594-aee6-d9b44b4f82ed tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:32:38.085424 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e278ddbd-da1f-4594-aee6-d9b44b4f82ed tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:32:38.086125 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e278ddbd-da1f-4594-aee6-d9b44b4f82ed tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:32:38.086588 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e278ddbd-da1f-4594-aee6-d9b44b4f82ed tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:32:38.087028 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e278ddbd-da1f-4594-aee6-d9b44b4f82ed tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:32:38.725829 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e278ddbd-da1f-4594-aee6-d9b44b4f82ed tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] 10.222.0.52 "POST /compute/v2.1/servers/234605f1-0454-4056-8c71-fb0444c4e305/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.654918 Oct 19 04:32:38.726452 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4233/7992] 10.222.0.52 () {60 vars in 1323 bytes} [Wed Oct 19 04:32:38 2022] POST /compute/v2.1/servers/234605f1-0454-4056-8c71-fb0444c4e305/os-volume_attachments => generated 194 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:32:50.667179 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-72d27b2f-8d57-488d-92d8-f1e0c5158a86 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:32:50.668446 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-72d27b2f-8d57-488d-92d8-f1e0c5158a86 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] [instance: 234605f1-0454-4056-8c71-fb0444c4e305] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:32:50.671011 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:32:50.671681 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=62 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:32:50.676389 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-72d27b2f-8d57-488d-92d8-f1e0c5158a86 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:32:50.676932 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-72d27b2f-8d57-488d-92d8-f1e0c5158a86 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:32:50.677393 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-72d27b2f-8d57-488d-92d8-f1e0c5158a86 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:32:50.678092 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-72d27b2f-8d57-488d-92d8-f1e0c5158a86 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:32:50.678553 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-72d27b2f-8d57-488d-92d8-f1e0c5158a86 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:32:50.681178 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-72d27b2f-8d57-488d-92d8-f1e0c5158a86 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:32:50.815324 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-72d27b2f-8d57-488d-92d8-f1e0c5158a86 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c04ff6cc2c4fd5a51b1e2325c4c8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb5ad698ae94dceabc0e4a5b39567a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:32:50.823517 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-72d27b2f-8d57-488d-92d8-f1e0c5158a86 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] 10.222.0.52 "GET /compute/v2.1/servers/234605f1-0454-4056-8c71-fb0444c4e305" status: 200 len: 1595 microversion: 2.1 time: 0.160454 Oct 19 04:32:50.824101 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3760/7993] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:32:50 2022] GET /compute/v2.1/servers/234605f1-0454-4056-8c71-fb0444c4e305 => generated 1595 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:32:52.689423 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-efcdc47e-ef50-47fd-a138-85a526ac8069 req-9c48d6fd-69d2-4b68-a5c9-72ad6a4c8ce6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "234605f1-0454-4056-8c71-fb0444c4e305", "tag": "79042958-494d-4573-97d5-d29073d356ed"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:32:52.696604 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:32:52.697492 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:32:52.698081 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:32:52.703695 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-efcdc47e-ef50-47fd-a138-85a526ac8069 req-9c48d6fd-69d2-4b68-a5c9-72ad6a4c8ce6 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:32:52.704203 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-efcdc47e-ef50-47fd-a138-85a526ac8069 req-9c48d6fd-69d2-4b68-a5c9-72ad6a4c8ce6 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:32:52.705409 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-efcdc47e-ef50-47fd-a138-85a526ac8069 req-9c48d6fd-69d2-4b68-a5c9-72ad6a4c8ce6 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:32:52.716617 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-efcdc47e-ef50-47fd-a138-85a526ac8069 req-9c48d6fd-69d2-4b68-a5c9-72ad6a4c8ce6 service nova] Creating event network-changed:79042958-494d-4573-97d5-d29073d356ed for instance 234605f1-0454-4056-8c71-fb0444c4e305 on n-h2-861333-8 Oct 19 04:32:52.721994 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-efcdc47e-ef50-47fd-a138-85a526ac8069 req-9c48d6fd-69d2-4b68-a5c9-72ad6a4c8ce6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036810 Oct 19 04:32:52.723038 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4234/7994] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:32:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:32:54.845606 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5d148262-8470-4633-b189-00d04d825e3d tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1172215809"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:32:54.848624 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-5d148262-8470-4633-b189-00d04d825e3d tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] [instance: 234605f1-0454-4056-8c71-fb0444c4e305] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:32:54.853258 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5d148262-8470-4633-b189-00d04d825e3d tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:32:54.853802 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5d148262-8470-4633-b189-00d04d825e3d tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:32:54.854239 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5d148262-8470-4633-b189-00d04d825e3d tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:32:54.854937 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5d148262-8470-4633-b189-00d04d825e3d tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:32:54.855885 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5d148262-8470-4633-b189-00d04d825e3d tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:32:54.856433 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5d148262-8470-4633-b189-00d04d825e3d tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:32:54.983623 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.network.security_group_api [None req-5d148262-8470-4633-b189-00d04d825e3d tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Adding security group 7cbb66db-aff1-4eae-9279-ebcf40cc1a22 to port 79042958-494d-4573-97d5-d29073d356ed Oct 19 04:32:55.351915 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5d148262-8470-4633-b189-00d04d825e3d tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] 10.222.0.52 "POST /compute/v2.1/servers/234605f1-0454-4056-8c71-fb0444c4e305/action" status: 202 len: 0 microversion: 2.1 time: 0.510315 Oct 19 04:32:55.356811 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3761/7995] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 04:32:54 2022] POST /compute/v2.1/servers/234605f1-0454-4056-8c71-fb0444c4e305/action => generated 0 bytes in 512 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 04:32:55.367910 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-d761df98-5bde-48ef-b3c9-633c5325070e req-a6e84c8a-d6b5-496d-a73d-923d6b55f62f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "234605f1-0454-4056-8c71-fb0444c4e305", "tag": "79042958-494d-4573-97d5-d29073d356ed"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:32:55.370018 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-35d9a895-8110-4134-82b8-42a394422846 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:32:55.373646 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-35d9a895-8110-4134-82b8-42a394422846 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] [instance: 234605f1-0454-4056-8c71-fb0444c4e305] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:32:55.382006 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-d761df98-5bde-48ef-b3c9-633c5325070e req-a6e84c8a-d6b5-496d-a73d-923d6b55f62f service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:32:55.382243 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-35d9a895-8110-4134-82b8-42a394422846 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:32:55.382719 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-d761df98-5bde-48ef-b3c9-633c5325070e req-a6e84c8a-d6b5-496d-a73d-923d6b55f62f service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:32:55.383158 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-35d9a895-8110-4134-82b8-42a394422846 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:32:55.383330 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-d761df98-5bde-48ef-b3c9-633c5325070e req-a6e84c8a-d6b5-496d-a73d-923d6b55f62f service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:32:55.383965 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-35d9a895-8110-4134-82b8-42a394422846 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:32:55.384885 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-35d9a895-8110-4134-82b8-42a394422846 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:32:55.385640 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-35d9a895-8110-4134-82b8-42a394422846 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:32:55.386260 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-35d9a895-8110-4134-82b8-42a394422846 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:32:55.402866 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-d761df98-5bde-48ef-b3c9-633c5325070e req-a6e84c8a-d6b5-496d-a73d-923d6b55f62f service nova] Creating event network-changed:79042958-494d-4573-97d5-d29073d356ed for instance 234605f1-0454-4056-8c71-fb0444c4e305 on n-h2-861333-8 Oct 19 04:32:55.410594 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-d761df98-5bde-48ef-b3c9-633c5325070e req-a6e84c8a-d6b5-496d-a73d-923d6b55f62f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050887 Oct 19 04:32:55.412228 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3762/7996] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:32:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:32:55.636190 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-35d9a895-8110-4134-82b8-42a394422846 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c04ff6cc2c4fd5a51b1e2325c4c8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb5ad698ae94dceabc0e4a5b39567a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:32:55.645625 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-35d9a895-8110-4134-82b8-42a394422846 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] 10.222.0.52 "GET /compute/v2.1/servers/234605f1-0454-4056-8c71-fb0444c4e305" status: 200 len: 1761 microversion: 2.1 time: 0.287191 Oct 19 04:32:55.646303 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4235/7997] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:32:55 2022] GET /compute/v2.1/servers/234605f1-0454-4056-8c71-fb0444c4e305 => generated 1761 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:33:09.609633 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=6 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:33:09.610567 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=12 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:33:09.614832 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-35ef3de6-3a1c-465e-aa79-0adc1bfdd094 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:33:09.617214 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-35ef3de6-3a1c-465e-aa79-0adc1bfdd094 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] [instance: 234605f1-0454-4056-8c71-fb0444c4e305] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:33:09.623803 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-35ef3de6-3a1c-465e-aa79-0adc1bfdd094 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:33:09.624294 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-35ef3de6-3a1c-465e-aa79-0adc1bfdd094 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:33:09.624729 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-35ef3de6-3a1c-465e-aa79-0adc1bfdd094 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:33:09.625449 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-35ef3de6-3a1c-465e-aa79-0adc1bfdd094 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:33:09.626024 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-35ef3de6-3a1c-465e-aa79-0adc1bfdd094 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:33:09.626456 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-35ef3de6-3a1c-465e-aa79-0adc1bfdd094 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:33:09.872680 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-35ef3de6-3a1c-465e-aa79-0adc1bfdd094 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] 10.222.0.52 "POST /compute/v2.1/servers/234605f1-0454-4056-8c71-fb0444c4e305/action" status: 202 len: 0 microversion: 2.1 time: 0.264837 Oct 19 04:33:09.873380 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3763/7998] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 04:33:09 2022] POST /compute/v2.1/servers/234605f1-0454-4056-8c71-fb0444c4e305/action => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 04:33:09.881626 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1e034413-23bc-4cee-9800-16d301a31cac tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:33:09.882660 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1e034413-23bc-4cee-9800-16d301a31cac tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] [instance: 234605f1-0454-4056-8c71-fb0444c4e305] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:33:09.885103 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=4 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:33:09.885829 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=8 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:33:09.890628 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1e034413-23bc-4cee-9800-16d301a31cac tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:33:09.895979 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1e034413-23bc-4cee-9800-16d301a31cac tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:33:09.895979 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1e034413-23bc-4cee-9800-16d301a31cac tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:33:09.895979 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1e034413-23bc-4cee-9800-16d301a31cac tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:33:09.895979 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1e034413-23bc-4cee-9800-16d301a31cac tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:33:09.895979 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1e034413-23bc-4cee-9800-16d301a31cac tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:33:10.417378 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-1e034413-23bc-4cee-9800-16d301a31cac tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c04ff6cc2c4fd5a51b1e2325c4c8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb5ad698ae94dceabc0e4a5b39567a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:33:10.426835 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1e034413-23bc-4cee-9800-16d301a31cac tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] 10.222.0.52 "GET /compute/v2.1/servers/234605f1-0454-4056-8c71-fb0444c4e305" status: 200 len: 1753 microversion: 2.1 time: 0.549222 Oct 19 04:33:10.427437 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4236/7999] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:33:09 2022] GET /compute/v2.1/servers/234605f1-0454-4056-8c71-fb0444c4e305 => generated 1753 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:33:11.451149 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-74e91dd1-9e9f-4b2d-9b73-efb679e061cc tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:33:11.451864 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-74e91dd1-9e9f-4b2d-9b73-efb679e061cc tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] [instance: 234605f1-0454-4056-8c71-fb0444c4e305] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:33:11.458179 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-74e91dd1-9e9f-4b2d-9b73-efb679e061cc tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:33:11.458672 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-74e91dd1-9e9f-4b2d-9b73-efb679e061cc tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:33:11.459118 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-74e91dd1-9e9f-4b2d-9b73-efb679e061cc tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:33:11.459817 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-74e91dd1-9e9f-4b2d-9b73-efb679e061cc tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:33:11.460275 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-74e91dd1-9e9f-4b2d-9b73-efb679e061cc tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:33:11.460709 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-74e91dd1-9e9f-4b2d-9b73-efb679e061cc tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:33:11.609633 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-74e91dd1-9e9f-4b2d-9b73-efb679e061cc tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c04ff6cc2c4fd5a51b1e2325c4c8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb5ad698ae94dceabc0e4a5b39567a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:33:11.618329 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-74e91dd1-9e9f-4b2d-9b73-efb679e061cc tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] 10.222.0.52 "GET /compute/v2.1/servers/234605f1-0454-4056-8c71-fb0444c4e305" status: 200 len: 1758 microversion: 2.1 time: 0.172582 Oct 19 04:33:11.619615 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3764/8000] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:33:11 2022] GET /compute/v2.1/servers/234605f1-0454-4056-8c71-fb0444c4e305 => generated 1758 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:33:12.643251 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a96730eb-ddad-4ae5-a429-755084cca6ac tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:33:12.643878 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a96730eb-ddad-4ae5-a429-755084cca6ac tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] [instance: 234605f1-0454-4056-8c71-fb0444c4e305] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:33:12.650774 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a96730eb-ddad-4ae5-a429-755084cca6ac tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:33:12.651211 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a96730eb-ddad-4ae5-a429-755084cca6ac tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:33:12.651666 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a96730eb-ddad-4ae5-a429-755084cca6ac tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:33:12.652365 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a96730eb-ddad-4ae5-a429-755084cca6ac tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:33:12.652827 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a96730eb-ddad-4ae5-a429-755084cca6ac tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:33:12.653265 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a96730eb-ddad-4ae5-a429-755084cca6ac tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:33:12.796706 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a96730eb-ddad-4ae5-a429-755084cca6ac tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c04ff6cc2c4fd5a51b1e2325c4c8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb5ad698ae94dceabc0e4a5b39567a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:33:12.805002 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a96730eb-ddad-4ae5-a429-755084cca6ac tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] 10.222.0.52 "GET /compute/v2.1/servers/234605f1-0454-4056-8c71-fb0444c4e305" status: 200 len: 1758 microversion: 2.1 time: 0.165665 Oct 19 04:33:12.805616 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4237/8001] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:33:12 2022] GET /compute/v2.1/servers/234605f1-0454-4056-8c71-fb0444c4e305 => generated 1758 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:33:13.829810 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-81c378cd-8c0d-404e-a70a-f7e073098905 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:33:13.830434 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-81c378cd-8c0d-404e-a70a-f7e073098905 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] [instance: 234605f1-0454-4056-8c71-fb0444c4e305] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:33:13.837205 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-81c378cd-8c0d-404e-a70a-f7e073098905 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:33:13.837729 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-81c378cd-8c0d-404e-a70a-f7e073098905 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:33:13.838169 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-81c378cd-8c0d-404e-a70a-f7e073098905 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:33:13.838862 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-81c378cd-8c0d-404e-a70a-f7e073098905 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:33:13.839320 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-81c378cd-8c0d-404e-a70a-f7e073098905 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:33:13.839751 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-81c378cd-8c0d-404e-a70a-f7e073098905 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:33:13.979717 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-81c378cd-8c0d-404e-a70a-f7e073098905 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c04ff6cc2c4fd5a51b1e2325c4c8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb5ad698ae94dceabc0e4a5b39567a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:33:13.988083 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-81c378cd-8c0d-404e-a70a-f7e073098905 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] 10.222.0.52 "GET /compute/v2.1/servers/234605f1-0454-4056-8c71-fb0444c4e305" status: 200 len: 1758 microversion: 2.1 time: 0.162177 Oct 19 04:33:13.988669 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3765/8002] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:33:13 2022] GET /compute/v2.1/servers/234605f1-0454-4056-8c71-fb0444c4e305 => generated 1758 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:33:15.011261 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-69c757c5-ae67-4c96-941c-7d6d379bd637 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:33:15.011885 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-69c757c5-ae67-4c96-941c-7d6d379bd637 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] [instance: 234605f1-0454-4056-8c71-fb0444c4e305] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:33:15.018680 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-69c757c5-ae67-4c96-941c-7d6d379bd637 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:33:15.019179 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-69c757c5-ae67-4c96-941c-7d6d379bd637 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:33:15.019627 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-69c757c5-ae67-4c96-941c-7d6d379bd637 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:33:15.020327 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-69c757c5-ae67-4c96-941c-7d6d379bd637 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:33:15.020793 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-69c757c5-ae67-4c96-941c-7d6d379bd637 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:33:15.021232 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-69c757c5-ae67-4c96-941c-7d6d379bd637 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:33:15.167095 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-69c757c5-ae67-4c96-941c-7d6d379bd637 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c04ff6cc2c4fd5a51b1e2325c4c8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb5ad698ae94dceabc0e4a5b39567a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:33:15.175358 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-69c757c5-ae67-4c96-941c-7d6d379bd637 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] 10.222.0.52 "GET /compute/v2.1/servers/234605f1-0454-4056-8c71-fb0444c4e305" status: 200 len: 1758 microversion: 2.1 time: 0.168104 Oct 19 04:33:15.175921 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4238/8003] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:33:15 2022] GET /compute/v2.1/servers/234605f1-0454-4056-8c71-fb0444c4e305 => generated 1758 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:33:16.198410 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2cfdb56c-22db-40b7-bb3d-a675982bd3c6 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:33:16.199032 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-2cfdb56c-22db-40b7-bb3d-a675982bd3c6 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] [instance: 234605f1-0454-4056-8c71-fb0444c4e305] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:33:16.205931 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2cfdb56c-22db-40b7-bb3d-a675982bd3c6 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:33:16.206424 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2cfdb56c-22db-40b7-bb3d-a675982bd3c6 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:33:16.206881 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2cfdb56c-22db-40b7-bb3d-a675982bd3c6 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:33:16.207562 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2cfdb56c-22db-40b7-bb3d-a675982bd3c6 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:33:16.208024 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2cfdb56c-22db-40b7-bb3d-a675982bd3c6 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:33:16.208510 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2cfdb56c-22db-40b7-bb3d-a675982bd3c6 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:33:16.351606 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-2cfdb56c-22db-40b7-bb3d-a675982bd3c6 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c04ff6cc2c4fd5a51b1e2325c4c8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb5ad698ae94dceabc0e4a5b39567a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:33:16.360384 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2cfdb56c-22db-40b7-bb3d-a675982bd3c6 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] 10.222.0.52 "GET /compute/v2.1/servers/234605f1-0454-4056-8c71-fb0444c4e305" status: 200 len: 1758 microversion: 2.1 time: 0.165902 Oct 19 04:33:16.360953 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3766/8004] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:33:16 2022] GET /compute/v2.1/servers/234605f1-0454-4056-8c71-fb0444c4e305 => generated 1758 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:33:17.383448 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-527b9f11-606d-4d1e-b4db-d4cd8c4884db tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:33:17.384123 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-527b9f11-606d-4d1e-b4db-d4cd8c4884db tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] [instance: 234605f1-0454-4056-8c71-fb0444c4e305] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:33:17.391137 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-527b9f11-606d-4d1e-b4db-d4cd8c4884db tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:33:17.391667 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-527b9f11-606d-4d1e-b4db-d4cd8c4884db tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:33:17.392128 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-527b9f11-606d-4d1e-b4db-d4cd8c4884db tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:33:17.392851 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-527b9f11-606d-4d1e-b4db-d4cd8c4884db tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:33:17.393326 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-527b9f11-606d-4d1e-b4db-d4cd8c4884db tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:33:17.393806 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-527b9f11-606d-4d1e-b4db-d4cd8c4884db tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:33:17.540421 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-527b9f11-606d-4d1e-b4db-d4cd8c4884db tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c04ff6cc2c4fd5a51b1e2325c4c8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb5ad698ae94dceabc0e4a5b39567a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:33:17.549230 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-527b9f11-606d-4d1e-b4db-d4cd8c4884db tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] 10.222.0.52 "GET /compute/v2.1/servers/234605f1-0454-4056-8c71-fb0444c4e305" status: 200 len: 1758 microversion: 2.1 time: 0.169706 Oct 19 04:33:17.549840 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4239/8005] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:33:17 2022] GET /compute/v2.1/servers/234605f1-0454-4056-8c71-fb0444c4e305 => generated 1758 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:33:18.572710 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-53af9b29-15a9-4a16-82ad-6bcbf8197015 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:33:18.573378 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-53af9b29-15a9-4a16-82ad-6bcbf8197015 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] [instance: 234605f1-0454-4056-8c71-fb0444c4e305] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:33:18.580879 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-53af9b29-15a9-4a16-82ad-6bcbf8197015 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:33:18.581393 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-53af9b29-15a9-4a16-82ad-6bcbf8197015 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:33:18.581857 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-53af9b29-15a9-4a16-82ad-6bcbf8197015 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:33:18.582556 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-53af9b29-15a9-4a16-82ad-6bcbf8197015 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:33:18.583018 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-53af9b29-15a9-4a16-82ad-6bcbf8197015 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:33:18.583452 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-53af9b29-15a9-4a16-82ad-6bcbf8197015 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:33:18.723839 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-53af9b29-15a9-4a16-82ad-6bcbf8197015 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c04ff6cc2c4fd5a51b1e2325c4c8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb5ad698ae94dceabc0e4a5b39567a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:33:18.732054 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-53af9b29-15a9-4a16-82ad-6bcbf8197015 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] 10.222.0.52 "GET /compute/v2.1/servers/234605f1-0454-4056-8c71-fb0444c4e305" status: 200 len: 1758 microversion: 2.1 time: 0.163251 Oct 19 04:33:18.732626 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3767/8006] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:33:18 2022] GET /compute/v2.1/servers/234605f1-0454-4056-8c71-fb0444c4e305 => generated 1758 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:33:19.755648 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-74ec5031-66ce-425b-a6ae-8aed06269a03 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:33:19.756292 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-74ec5031-66ce-425b-a6ae-8aed06269a03 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] [instance: 234605f1-0454-4056-8c71-fb0444c4e305] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:33:19.764001 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-74ec5031-66ce-425b-a6ae-8aed06269a03 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:33:19.764505 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-74ec5031-66ce-425b-a6ae-8aed06269a03 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:33:19.764962 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-74ec5031-66ce-425b-a6ae-8aed06269a03 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:33:19.765716 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-74ec5031-66ce-425b-a6ae-8aed06269a03 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:33:19.766193 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-74ec5031-66ce-425b-a6ae-8aed06269a03 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:33:19.766671 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-74ec5031-66ce-425b-a6ae-8aed06269a03 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:33:19.906930 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-74ec5031-66ce-425b-a6ae-8aed06269a03 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c04ff6cc2c4fd5a51b1e2325c4c8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb5ad698ae94dceabc0e4a5b39567a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:33:19.915220 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-74ec5031-66ce-425b-a6ae-8aed06269a03 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] 10.222.0.52 "GET /compute/v2.1/servers/234605f1-0454-4056-8c71-fb0444c4e305" status: 200 len: 1758 microversion: 2.1 time: 0.163527 Oct 19 04:33:19.915802 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4240/8007] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:33:19 2022] GET /compute/v2.1/servers/234605f1-0454-4056-8c71-fb0444c4e305 => generated 1758 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:33:20.938436 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-12e07ef5-bb43-43c8-bdad-32d46190e95f tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:33:20.939060 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-12e07ef5-bb43-43c8-bdad-32d46190e95f tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] [instance: 234605f1-0454-4056-8c71-fb0444c4e305] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:33:20.946301 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-12e07ef5-bb43-43c8-bdad-32d46190e95f tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:33:20.946826 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-12e07ef5-bb43-43c8-bdad-32d46190e95f tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:33:20.947266 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-12e07ef5-bb43-43c8-bdad-32d46190e95f tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:33:20.947968 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-12e07ef5-bb43-43c8-bdad-32d46190e95f tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:33:20.948426 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-12e07ef5-bb43-43c8-bdad-32d46190e95f tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:33:20.948889 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-12e07ef5-bb43-43c8-bdad-32d46190e95f tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:33:21.095637 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-12e07ef5-bb43-43c8-bdad-32d46190e95f tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c04ff6cc2c4fd5a51b1e2325c4c8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb5ad698ae94dceabc0e4a5b39567a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:33:21.103918 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-12e07ef5-bb43-43c8-bdad-32d46190e95f tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] 10.222.0.52 "GET /compute/v2.1/servers/234605f1-0454-4056-8c71-fb0444c4e305" status: 200 len: 1758 microversion: 2.1 time: 0.169410 Oct 19 04:33:21.104500 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3768/8008] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:33:20 2022] GET /compute/v2.1/servers/234605f1-0454-4056-8c71-fb0444c4e305 => generated 1758 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:33:22.127658 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d056c010-06e6-44ae-a040-55f833f7bf06 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:33:22.128282 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d056c010-06e6-44ae-a040-55f833f7bf06 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] [instance: 234605f1-0454-4056-8c71-fb0444c4e305] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:33:22.135280 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d056c010-06e6-44ae-a040-55f833f7bf06 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:33:22.135794 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d056c010-06e6-44ae-a040-55f833f7bf06 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:33:22.136247 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d056c010-06e6-44ae-a040-55f833f7bf06 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:33:22.136960 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d056c010-06e6-44ae-a040-55f833f7bf06 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:33:22.137465 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d056c010-06e6-44ae-a040-55f833f7bf06 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:33:22.137917 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d056c010-06e6-44ae-a040-55f833f7bf06 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:33:22.279391 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d056c010-06e6-44ae-a040-55f833f7bf06 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c04ff6cc2c4fd5a51b1e2325c4c8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb5ad698ae94dceabc0e4a5b39567a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:33:22.287965 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d056c010-06e6-44ae-a040-55f833f7bf06 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] 10.222.0.52 "GET /compute/v2.1/servers/234605f1-0454-4056-8c71-fb0444c4e305" status: 200 len: 1761 microversion: 2.1 time: 0.164286 Oct 19 04:33:22.288542 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4241/8009] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:33:22 2022] GET /compute/v2.1/servers/234605f1-0454-4056-8c71-fb0444c4e305 => generated 1761 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:33:55.100154 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b749eb65-3897-4c7f-a54c-8a69546320fc tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1172215809"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:33:55.100805 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b749eb65-3897-4c7f-a54c-8a69546320fc tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] [instance: 234605f1-0454-4056-8c71-fb0444c4e305] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:33:55.103004 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=12 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:33:55.103671 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:33:55.104674 n-d-861333-8 devstack@n-api.service[121135]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 04:33:55.104820 n-d-861333-8 devstack@n-api.service[121135]: Wed Oct 19 04:33:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/234605f1-0454-4056-8c71-fb0444c4e305/action (ip 10.222.0.52) !!! Oct 19 04:33:55.114200 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b749eb65-3897-4c7f-a54c-8a69546320fc tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:33:55.114692 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b749eb65-3897-4c7f-a54c-8a69546320fc tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:33:55.115138 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b749eb65-3897-4c7f-a54c-8a69546320fc tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:33:55.115838 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b749eb65-3897-4c7f-a54c-8a69546320fc tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:33:55.116294 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b749eb65-3897-4c7f-a54c-8a69546320fc tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:33:55.116724 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b749eb65-3897-4c7f-a54c-8a69546320fc tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:33:55.244275 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.network.security_group_api [None req-b749eb65-3897-4c7f-a54c-8a69546320fc tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Removing security group 7cbb66db-aff1-4eae-9279-ebcf40cc1a22 from port 79042958-494d-4573-97d5-d29073d356ed Oct 19 04:33:55.608276 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b749eb65-3897-4c7f-a54c-8a69546320fc tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] 10.222.0.52 "POST /compute/v2.1/servers/234605f1-0454-4056-8c71-fb0444c4e305/action" status: 202 len: 0 microversion: 2.1 time: 0.512094 Oct 19 04:33:55.609097 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3769/8010] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 04:33:55 2022] POST /compute/v2.1/servers/234605f1-0454-4056-8c71-fb0444c4e305/action => generated 0 bytes in 514 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 04:33:55.615964 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-cf071561-3ff2-42dd-ac86-d6f95b7872d8 req-6cbc5315-dd08-4a63-8b7f-ab16d2576efc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "234605f1-0454-4056-8c71-fb0444c4e305", "tag": "79042958-494d-4573-97d5-d29073d356ed"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:33:55.626039 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=12 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:33:55.627279 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=36 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:33:55.630158 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-cf071561-3ff2-42dd-ac86-d6f95b7872d8 req-6cbc5315-dd08-4a63-8b7f-ab16d2576efc service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:33:55.630962 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-cf071561-3ff2-42dd-ac86-d6f95b7872d8 req-6cbc5315-dd08-4a63-8b7f-ab16d2576efc service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:33:55.631426 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-cf071561-3ff2-42dd-ac86-d6f95b7872d8 req-6cbc5315-dd08-4a63-8b7f-ab16d2576efc service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:33:55.644527 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-cf071561-3ff2-42dd-ac86-d6f95b7872d8 req-6cbc5315-dd08-4a63-8b7f-ab16d2576efc service nova] Creating event network-changed:79042958-494d-4573-97d5-d29073d356ed for instance 234605f1-0454-4056-8c71-fb0444c4e305 on n-h2-861333-8 Oct 19 04:33:55.651208 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-cf071561-3ff2-42dd-ac86-d6f95b7872d8 req-6cbc5315-dd08-4a63-8b7f-ab16d2576efc service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039268 Oct 19 04:33:55.652144 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4242/8011] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:33:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:33:56.812640 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-495dc770-a1d2-44c5-88ff-623fb4fa3a65 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:33:56.813174 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-495dc770-a1d2-44c5-88ff-623fb4fa3a65 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] [instance: 234605f1-0454-4056-8c71-fb0444c4e305] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:33:56.818138 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-fce37bfe-4c8a-4373-b682-21dc8050162d req-dd1b862a-0307-43d5-b7e1-13fd914f2210 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "234605f1-0454-4056-8c71-fb0444c4e305", "tag": "79042958-494d-4573-97d5-d29073d356ed"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:33:56.821314 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-495dc770-a1d2-44c5-88ff-623fb4fa3a65 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:33:56.821945 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-495dc770-a1d2-44c5-88ff-623fb4fa3a65 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:33:56.822470 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-495dc770-a1d2-44c5-88ff-623fb4fa3a65 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:33:56.823256 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-495dc770-a1d2-44c5-88ff-623fb4fa3a65 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:33:56.823788 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-495dc770-a1d2-44c5-88ff-623fb4fa3a65 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:33:56.824451 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-495dc770-a1d2-44c5-88ff-623fb4fa3a65 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:33:56.830621 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-fce37bfe-4c8a-4373-b682-21dc8050162d req-dd1b862a-0307-43d5-b7e1-13fd914f2210 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:33:56.830937 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-fce37bfe-4c8a-4373-b682-21dc8050162d req-dd1b862a-0307-43d5-b7e1-13fd914f2210 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:33:56.831388 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-fce37bfe-4c8a-4373-b682-21dc8050162d req-dd1b862a-0307-43d5-b7e1-13fd914f2210 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:33:56.845303 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-fce37bfe-4c8a-4373-b682-21dc8050162d req-dd1b862a-0307-43d5-b7e1-13fd914f2210 service nova] Creating event network-changed:79042958-494d-4573-97d5-d29073d356ed for instance 234605f1-0454-4056-8c71-fb0444c4e305 on n-h2-861333-8 Oct 19 04:33:56.851334 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-fce37bfe-4c8a-4373-b682-21dc8050162d req-dd1b862a-0307-43d5-b7e1-13fd914f2210 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040262 Oct 19 04:33:56.852828 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4243/8012] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:33:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 04:33:56.924171 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-495dc770-a1d2-44c5-88ff-623fb4fa3a65 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lazy-loading 'services' on Instance uuid 234605f1-0454-4056-8c71-fb0444c4e305 {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 04:33:57.135416 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-495dc770-a1d2-44c5-88ff-623fb4fa3a65 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] 10.222.0.52 "DELETE /compute/v2.1/servers/234605f1-0454-4056-8c71-fb0444c4e305/os-volume_attachments/164cdc24-c9c8-45f8-98b1-83419be84ecf" status: 202 len: 0 microversion: 2.1 time: 0.320747 Oct 19 04:33:57.135416 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3770/8013] 10.222.0.52 () {58 vars in 1416 bytes} [Wed Oct 19 04:33:56 2022] DELETE /compute/v2.1/servers/234605f1-0454-4056-8c71-fb0444c4e305/os-volume_attachments/164cdc24-c9c8-45f8-98b1-83419be84ecf => generated 0 bytes in 323 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 04:33:57.139764 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b1cc3e0b-7ab3-4a17-b6eb-dce433c3e6b5 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:33:57.142078 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b1cc3e0b-7ab3-4a17-b6eb-dce433c3e6b5 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] [instance: 234605f1-0454-4056-8c71-fb0444c4e305] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:33:57.149293 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b1cc3e0b-7ab3-4a17-b6eb-dce433c3e6b5 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:33:57.150073 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b1cc3e0b-7ab3-4a17-b6eb-dce433c3e6b5 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:33:57.150708 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b1cc3e0b-7ab3-4a17-b6eb-dce433c3e6b5 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:33:57.151604 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b1cc3e0b-7ab3-4a17-b6eb-dce433c3e6b5 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:33:57.152267 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b1cc3e0b-7ab3-4a17-b6eb-dce433c3e6b5 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:33:57.152861 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b1cc3e0b-7ab3-4a17-b6eb-dce433c3e6b5 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:33:57.185307 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b1cc3e0b-7ab3-4a17-b6eb-dce433c3e6b5 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] 10.222.0.52 "GET /compute/v2.1/servers/234605f1-0454-4056-8c71-fb0444c4e305/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050555 Oct 19 04:33:57.195446 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4244/8014] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Oct 19 04:33:57 2022] GET /compute/v2.1/servers/234605f1-0454-4056-8c71-fb0444c4e305/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:33:58.199314 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-163332c0-824b-423e-839e-40403c1b3fce tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:33:58.201732 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-163332c0-824b-423e-839e-40403c1b3fce tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] [instance: 234605f1-0454-4056-8c71-fb0444c4e305] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:33:58.208949 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-163332c0-824b-423e-839e-40403c1b3fce tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:33:58.209471 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-163332c0-824b-423e-839e-40403c1b3fce tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:33:58.209915 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-163332c0-824b-423e-839e-40403c1b3fce tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:33:58.210620 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-163332c0-824b-423e-839e-40403c1b3fce tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:33:58.211080 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-163332c0-824b-423e-839e-40403c1b3fce tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:33:58.211555 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-163332c0-824b-423e-839e-40403c1b3fce tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:33:58.243116 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-163332c0-824b-423e-839e-40403c1b3fce tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] 10.222.0.52 "GET /compute/v2.1/servers/234605f1-0454-4056-8c71-fb0444c4e305/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047519 Oct 19 04:33:58.243712 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3771/8015] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Oct 19 04:33:58 2022] GET /compute/v2.1/servers/234605f1-0454-4056-8c71-fb0444c4e305/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:33:59.255499 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b382624c-cb72-4634-90ff-fe2d0a9e784c tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:33:59.257743 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b382624c-cb72-4634-90ff-fe2d0a9e784c tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] [instance: 234605f1-0454-4056-8c71-fb0444c4e305] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:33:59.264675 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b382624c-cb72-4634-90ff-fe2d0a9e784c tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:33:59.265183 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b382624c-cb72-4634-90ff-fe2d0a9e784c tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:33:59.265725 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b382624c-cb72-4634-90ff-fe2d0a9e784c tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:33:59.266445 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b382624c-cb72-4634-90ff-fe2d0a9e784c tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:33:59.266917 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b382624c-cb72-4634-90ff-fe2d0a9e784c tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:33:59.267429 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b382624c-cb72-4634-90ff-fe2d0a9e784c tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:33:59.296899 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b382624c-cb72-4634-90ff-fe2d0a9e784c tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] 10.222.0.52 "GET /compute/v2.1/servers/234605f1-0454-4056-8c71-fb0444c4e305/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045327 Oct 19 04:33:59.297486 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4245/8016] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Oct 19 04:33:59 2022] GET /compute/v2.1/servers/234605f1-0454-4056-8c71-fb0444c4e305/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:34:00.310046 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-46f673ec-444e-4db8-9674-ab258c8c2d4f tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:34:00.312248 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-46f673ec-444e-4db8-9674-ab258c8c2d4f tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] [instance: 234605f1-0454-4056-8c71-fb0444c4e305] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:34:00.319221 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-46f673ec-444e-4db8-9674-ab258c8c2d4f tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:34:00.319709 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-46f673ec-444e-4db8-9674-ab258c8c2d4f tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:34:00.320146 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-46f673ec-444e-4db8-9674-ab258c8c2d4f tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:34:00.320838 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-46f673ec-444e-4db8-9674-ab258c8c2d4f tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:34:00.321316 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-46f673ec-444e-4db8-9674-ab258c8c2d4f tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:34:00.321763 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-46f673ec-444e-4db8-9674-ab258c8c2d4f tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:34:00.351478 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-46f673ec-444e-4db8-9674-ab258c8c2d4f tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] 10.222.0.52 "GET /compute/v2.1/servers/234605f1-0454-4056-8c71-fb0444c4e305/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045421 Oct 19 04:34:00.352046 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3772/8017] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Oct 19 04:34:00 2022] GET /compute/v2.1/servers/234605f1-0454-4056-8c71-fb0444c4e305/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:34:01.365057 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f39b77f1-45c9-476e-8a7d-34888a3fd9dc tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:34:01.367353 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f39b77f1-45c9-476e-8a7d-34888a3fd9dc tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] [instance: 234605f1-0454-4056-8c71-fb0444c4e305] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:34:01.373607 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f39b77f1-45c9-476e-8a7d-34888a3fd9dc tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:34:01.374123 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f39b77f1-45c9-476e-8a7d-34888a3fd9dc tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:34:01.374585 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f39b77f1-45c9-476e-8a7d-34888a3fd9dc tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:34:01.375308 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f39b77f1-45c9-476e-8a7d-34888a3fd9dc tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:34:01.375783 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f39b77f1-45c9-476e-8a7d-34888a3fd9dc tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:34:01.376234 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f39b77f1-45c9-476e-8a7d-34888a3fd9dc tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:34:01.406388 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f39b77f1-45c9-476e-8a7d-34888a3fd9dc tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] 10.222.0.52 "GET /compute/v2.1/servers/234605f1-0454-4056-8c71-fb0444c4e305/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046198 Oct 19 04:34:01.407425 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4246/8018] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Oct 19 04:34:01 2022] GET /compute/v2.1/servers/234605f1-0454-4056-8c71-fb0444c4e305/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:34:02.419618 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-21b8557a-3f91-475d-8e89-8b9d25870083 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:34:02.421819 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-21b8557a-3f91-475d-8e89-8b9d25870083 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] [instance: 234605f1-0454-4056-8c71-fb0444c4e305] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:34:02.428378 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-21b8557a-3f91-475d-8e89-8b9d25870083 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:34:02.428861 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-21b8557a-3f91-475d-8e89-8b9d25870083 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:34:02.429296 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-21b8557a-3f91-475d-8e89-8b9d25870083 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:34:02.430006 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-21b8557a-3f91-475d-8e89-8b9d25870083 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:34:02.430451 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-21b8557a-3f91-475d-8e89-8b9d25870083 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:34:02.430873 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-21b8557a-3f91-475d-8e89-8b9d25870083 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:34:02.459812 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-21b8557a-3f91-475d-8e89-8b9d25870083 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] 10.222.0.52 "GET /compute/v2.1/servers/234605f1-0454-4056-8c71-fb0444c4e305/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044192 Oct 19 04:34:02.460353 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3773/8019] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Oct 19 04:34:02 2022] GET /compute/v2.1/servers/234605f1-0454-4056-8c71-fb0444c4e305/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 04:34:02.471078 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2833854f-b354-4325-bbe1-7f244e0c82a7 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:34:02.471605 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2833854f-b354-4325-bbe1-7f244e0c82a7 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] [instance: 234605f1-0454-4056-8c71-fb0444c4e305] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:34:02.478445 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2833854f-b354-4325-bbe1-7f244e0c82a7 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:34:02.478950 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2833854f-b354-4325-bbe1-7f244e0c82a7 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:34:02.479409 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2833854f-b354-4325-bbe1-7f244e0c82a7 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:34:02.480123 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2833854f-b354-4325-bbe1-7f244e0c82a7 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:34:02.480599 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2833854f-b354-4325-bbe1-7f244e0c82a7 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:34:02.481049 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2833854f-b354-4325-bbe1-7f244e0c82a7 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:34:02.556244 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-2833854f-b354-4325-bbe1-7f244e0c82a7 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] HTTP exception thrown: Instance 234605f1-0454-4056-8c71-fb0444c4e305 is not attached to volume 164cdc24-c9c8-45f8-98b1-83419be84ecf Oct 19 04:34:02.557923 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2833854f-b354-4325-bbe1-7f244e0c82a7 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Request method failure captured: Oct 19 04:34:02.557923 n-d-861333-8 devstack@n-api.service[121134]: request: DELETE /compute/v2.1/servers/234605f1-0454-4056-8c71-fb0444c4e305/os-volume_attachments/164cdc24-c9c8-45f8-98b1-83419be84ecf HTTP/1.1 Oct 19 04:34:02.557923 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 04:34:02.557923 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 04:34:02.557923 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 04:34:02.557923 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 04:34:02.557923 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 04:34:02.557923 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 04:34:02.557923 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 04:34:02.557923 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 04:34:02.557923 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT3y_zyB1g63gioa-ifJ0dkoCTOlZmZErF0CpNGrcb2_BcskDlnnNYkFtO29M-WCPkqGqIVquISfO6GJ6_e-H71yF3RJV0eU5D58xeW_lumD5wYAG8LS1HlVTXpqOhmM6Nv9MQIFa7rrVvNr0ThaLyhtWP-s68O0CxcGD9SQ5veJstWI Oct 19 04:34:02.557923 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 04:34:02.557923 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 04:34:02.557923 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 04:34:02.557923 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 04:34:02.557923 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 04:34:02.557923 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 04:34:02.557923 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 0bb5ad698ae94dceabc0e4a5b39567a7 Oct 19 04:34:02.557923 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-TestMinimumBasicScenario-1592269912 Oct 19 04:34:02.557923 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 04:34:02.557923 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 04:34:02.557923 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/0bb5ad698ae94dceabc0e4a5b39567a7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0bb5ad698ae94dceabc0e4a5b39567a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0bb5ad698ae94dceabc0e4a5b39567a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_0bb5ad698ae94dceabc0e4a5b39567a7", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 04:34:02.557923 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-TestMinimumBasicScenario-1592269912 Oct 19 04:34:02.557923 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 0bb5ad698ae94dceabc0e4a5b39567a7 Oct 19 04:34:02.557923 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1592269912 Oct 19 04:34:02.557923 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-TestMinimumBasicScenario-1592269912-project Oct 19 04:34:02.557923 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 04:34:02.557923 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 04:34:02.557923 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 33c04ff6cc2c4fd5a51b1e2325c4c8de Oct 19 04:34:02.557923 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-TestMinimumBasicScenario-1592269912-project Oct 19 04:34:02.557923 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 04:34:02.557923 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance 234605f1-0454-4056-8c71-fb0444c4e305 is not attached to volume 164cdc24-c9c8-45f8-98b1-83419be84ecf Oct 19 04:34:02.557923 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'server_id': '234605f1-0454-4056-8c71-fb0444c4e305', 'id': '164cdc24-c9c8-45f8-98b1-83419be84ecf'} Oct 19 04:34:02.557923 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 04:34:02.557923 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:34:02.557923 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 19 04:34:02.557923 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 19 04:34:02.557923 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 04:34:02.557923 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 04:34:02.557923 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 19 04:34:02.557923 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 19 04:34:02.557923 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 164cdc24-c9c8-45f8-98b1-83419be84ecf. Oct 19 04:34:02.557923 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:34:02.557923 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:34:02.557923 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:34:02.557923 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:34:02.557923 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:34:02.557923 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:34:02.557923 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 04:34:02.557923 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 04:34:02.557923 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 04:34:02.557923 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 04:34:02.557923 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 19 04:34:02.557923 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 19 04:34:02.557923 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 234605f1-0454-4056-8c71-fb0444c4e305 is not attached to volume 164cdc24-c9c8-45f8-98b1-83419be84ecf Oct 19 04:34:02.557923 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:34:02.557923 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:34:02.557923 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:34:02.557923 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:34:02.557923 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:34:02.557923 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:34:02.562875 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 04:34:02.562875 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 04:34:02.562875 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 234605f1-0454-4056-8c71-fb0444c4e305 is not attached to volume 164cdc24-c9c8-45f8-98b1-83419be84ecf Oct 19 04:34:02.562875 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:34:02.562875 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2833854f-b354-4325-bbe1-7f244e0c82a7 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Returning 404 to user: Instance 234605f1-0454-4056-8c71-fb0444c4e305 is not attached to volume 164cdc24-c9c8-45f8-98b1-83419be84ecf {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 04:34:02.562875 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2833854f-b354-4325-bbe1-7f244e0c82a7 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] 10.222.0.52 "DELETE /compute/v2.1/servers/234605f1-0454-4056-8c71-fb0444c4e305/os-volume_attachments/164cdc24-c9c8-45f8-98b1-83419be84ecf" status: 404 len: 154 microversion: 2.1 time: 0.092399 Oct 19 04:34:02.562875 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4247/8020] 10.222.0.52 () {58 vars in 1416 bytes} [Wed Oct 19 04:34:02 2022] DELETE /compute/v2.1/servers/234605f1-0454-4056-8c71-fb0444c4e305/os-volume_attachments/164cdc24-c9c8-45f8-98b1-83419be84ecf => generated 154 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 04:34:05.976896 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4997f87b-2aa2-4d41-b358-b00a7954b938 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:34:05.977529 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4997f87b-2aa2-4d41-b358-b00a7954b938 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] [instance: 234605f1-0454-4056-8c71-fb0444c4e305] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:34:05.984247 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4997f87b-2aa2-4d41-b358-b00a7954b938 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:34:05.984740 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4997f87b-2aa2-4d41-b358-b00a7954b938 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:34:05.985179 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4997f87b-2aa2-4d41-b358-b00a7954b938 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:34:05.985917 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4997f87b-2aa2-4d41-b358-b00a7954b938 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:34:05.987104 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4997f87b-2aa2-4d41-b358-b00a7954b938 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:34:05.987542 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4997f87b-2aa2-4d41-b358-b00a7954b938 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:34:06.012640 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4997f87b-2aa2-4d41-b358-b00a7954b938 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] [instance: 234605f1-0454-4056-8c71-fb0444c4e305] Going to try to terminate instance {{(pid=121135) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 04:34:06.263731 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4997f87b-2aa2-4d41-b358-b00a7954b938 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] 10.222.0.52 "DELETE /compute/v2.1/servers/234605f1-0454-4056-8c71-fb0444c4e305" status: 204 len: 0 microversion: 2.1 time: 0.290317 Oct 19 04:34:06.264245 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3774/8021] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 04:34:05 2022] DELETE /compute/v2.1/servers/234605f1-0454-4056-8c71-fb0444c4e305 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 04:34:06.272469 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3bf5e270-c8ab-4155-ab68-a1b66f78f0e8 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:34:06.273100 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3bf5e270-c8ab-4155-ab68-a1b66f78f0e8 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] [instance: 234605f1-0454-4056-8c71-fb0444c4e305] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:34:06.280470 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3bf5e270-c8ab-4155-ab68-a1b66f78f0e8 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:34:06.284760 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3bf5e270-c8ab-4155-ab68-a1b66f78f0e8 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:34:06.284760 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3bf5e270-c8ab-4155-ab68-a1b66f78f0e8 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:34:06.284760 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3bf5e270-c8ab-4155-ab68-a1b66f78f0e8 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:34:06.284760 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3bf5e270-c8ab-4155-ab68-a1b66f78f0e8 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:34:06.284760 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3bf5e270-c8ab-4155-ab68-a1b66f78f0e8 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:34:06.420879 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-3bf5e270-c8ab-4155-ab68-a1b66f78f0e8 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c04ff6cc2c4fd5a51b1e2325c4c8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb5ad698ae94dceabc0e4a5b39567a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:34:06.429269 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3bf5e270-c8ab-4155-ab68-a1b66f78f0e8 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] 10.222.0.52 "GET /compute/v2.1/servers/234605f1-0454-4056-8c71-fb0444c4e305" status: 200 len: 1555 microversion: 2.1 time: 0.160629 Oct 19 04:34:06.429877 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4248/8022] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:34:06 2022] GET /compute/v2.1/servers/234605f1-0454-4056-8c71-fb0444c4e305 => generated 1555 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:34:07.452644 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-923cbbaf-7e3e-450c-85ef-84d1c47d9427 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:34:07.453359 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-923cbbaf-7e3e-450c-85ef-84d1c47d9427 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] [instance: 234605f1-0454-4056-8c71-fb0444c4e305] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:34:07.460999 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-923cbbaf-7e3e-450c-85ef-84d1c47d9427 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:34:07.461596 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-923cbbaf-7e3e-450c-85ef-84d1c47d9427 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:34:07.462040 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-923cbbaf-7e3e-450c-85ef-84d1c47d9427 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:34:07.462734 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-923cbbaf-7e3e-450c-85ef-84d1c47d9427 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:34:07.463198 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-923cbbaf-7e3e-450c-85ef-84d1c47d9427 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:34:07.463628 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-923cbbaf-7e3e-450c-85ef-84d1c47d9427 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:34:07.590889 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-923cbbaf-7e3e-450c-85ef-84d1c47d9427 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c04ff6cc2c4fd5a51b1e2325c4c8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb5ad698ae94dceabc0e4a5b39567a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:34:07.598830 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-923cbbaf-7e3e-450c-85ef-84d1c47d9427 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] 10.222.0.52 "GET /compute/v2.1/servers/234605f1-0454-4056-8c71-fb0444c4e305" status: 200 len: 1555 microversion: 2.1 time: 0.150482 Oct 19 04:34:07.599407 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3775/8023] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:34:07 2022] GET /compute/v2.1/servers/234605f1-0454-4056-8c71-fb0444c4e305 => generated 1555 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:34:08.622771 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f629afab-84b8-42e0-b06f-aa4fef04cb50 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:34:08.623463 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f629afab-84b8-42e0-b06f-aa4fef04cb50 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] [instance: 234605f1-0454-4056-8c71-fb0444c4e305] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:34:08.630992 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f629afab-84b8-42e0-b06f-aa4fef04cb50 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:34:08.635144 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f629afab-84b8-42e0-b06f-aa4fef04cb50 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:34:08.635144 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f629afab-84b8-42e0-b06f-aa4fef04cb50 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:34:08.635144 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f629afab-84b8-42e0-b06f-aa4fef04cb50 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:34:08.635144 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f629afab-84b8-42e0-b06f-aa4fef04cb50 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:34:08.635144 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f629afab-84b8-42e0-b06f-aa4fef04cb50 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:34:08.739087 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-f629afab-84b8-42e0-b06f-aa4fef04cb50 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c04ff6cc2c4fd5a51b1e2325c4c8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb5ad698ae94dceabc0e4a5b39567a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:34:08.747143 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f629afab-84b8-42e0-b06f-aa4fef04cb50 tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] 10.222.0.52 "GET /compute/v2.1/servers/234605f1-0454-4056-8c71-fb0444c4e305" status: 200 len: 1513 microversion: 2.1 time: 0.128426 Oct 19 04:34:08.747810 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4249/8024] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:34:08 2022] GET /compute/v2.1/servers/234605f1-0454-4056-8c71-fb0444c4e305 => generated 1513 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:34:08.773123 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-a65cd608-bbf6-42b6-8f33-54a3dd3561f3 req-e72ea1b3-2418-439c-a9b6-432b03c3d334 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "234605f1-0454-4056-8c71-fb0444c4e305", "name": "network-vif-deleted", "tag": "79042958-494d-4573-97d5-d29073d356ed"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:34:08.784645 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-a65cd608-bbf6-42b6-8f33-54a3dd3561f3 req-e72ea1b3-2418-439c-a9b6-432b03c3d334 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:34:08.785184 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-a65cd608-bbf6-42b6-8f33-54a3dd3561f3 req-e72ea1b3-2418-439c-a9b6-432b03c3d334 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:34:08.785644 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-a65cd608-bbf6-42b6-8f33-54a3dd3561f3 req-e72ea1b3-2418-439c-a9b6-432b03c3d334 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:34:08.796911 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-a65cd608-bbf6-42b6-8f33-54a3dd3561f3 req-e72ea1b3-2418-439c-a9b6-432b03c3d334 service nova] Creating event network-vif-deleted:79042958-494d-4573-97d5-d29073d356ed for instance 234605f1-0454-4056-8c71-fb0444c4e305 on n-h2-861333-8 Oct 19 04:34:08.802652 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-a65cd608-bbf6-42b6-8f33-54a3dd3561f3 req-e72ea1b3-2418-439c-a9b6-432b03c3d334 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033247 Oct 19 04:34:08.803336 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3776/8025] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:34:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 04:34:09.771517 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-30af8d7b-c308-4007-bb61-873ce0d4d2cd tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:34:09.772155 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-30af8d7b-c308-4007-bb61-873ce0d4d2cd tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] [instance: 234605f1-0454-4056-8c71-fb0444c4e305] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:34:09.779049 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-30af8d7b-c308-4007-bb61-873ce0d4d2cd tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:34:09.779536 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-30af8d7b-c308-4007-bb61-873ce0d4d2cd tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:34:09.779995 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-30af8d7b-c308-4007-bb61-873ce0d4d2cd tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:34:09.780711 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-30af8d7b-c308-4007-bb61-873ce0d4d2cd tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:34:09.781185 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-30af8d7b-c308-4007-bb61-873ce0d4d2cd tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:34:09.781659 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-30af8d7b-c308-4007-bb61-873ce0d4d2cd tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:34:09.813102 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-30af8d7b-c308-4007-bb61-873ce0d4d2cd tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:34:09.813706 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-30af8d7b-c308-4007-bb61-873ce0d4d2cd tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:34:09.814169 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-30af8d7b-c308-4007-bb61-873ce0d4d2cd tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:34:09.814640 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-30af8d7b-c308-4007-bb61-873ce0d4d2cd tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lazy-loading 'fault' on Instance uuid 234605f1-0454-4056-8c71-fb0444c4e305 {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 04:34:09.859165 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-30af8d7b-c308-4007-bb61-873ce0d4d2cd tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c04ff6cc2c4fd5a51b1e2325c4c8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb5ad698ae94dceabc0e4a5b39567a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:34:09.866750 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-30af8d7b-c308-4007-bb61-873ce0d4d2cd tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] 10.222.0.52 "GET /compute/v2.1/servers/234605f1-0454-4056-8c71-fb0444c4e305" status: 200 len: 1349 microversion: 2.1 time: 0.099220 Oct 19 04:34:09.867325 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4250/8026] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:34:09 2022] GET /compute/v2.1/servers/234605f1-0454-4056-8c71-fb0444c4e305 => generated 1349 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:34:10.892673 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f60ae737-ddeb-4c19-982d-6316e5d6a3ee tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:34:10.893466 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f60ae737-ddeb-4c19-982d-6316e5d6a3ee tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] [instance: 234605f1-0454-4056-8c71-fb0444c4e305] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:34:10.899782 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f60ae737-ddeb-4c19-982d-6316e5d6a3ee tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:34:10.900271 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f60ae737-ddeb-4c19-982d-6316e5d6a3ee tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:34:10.900721 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f60ae737-ddeb-4c19-982d-6316e5d6a3ee tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:34:10.901454 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f60ae737-ddeb-4c19-982d-6316e5d6a3ee tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:34:10.901917 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f60ae737-ddeb-4c19-982d-6316e5d6a3ee tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:34:10.902350 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f60ae737-ddeb-4c19-982d-6316e5d6a3ee tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:34:10.916677 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-f60ae737-ddeb-4c19-982d-6316e5d6a3ee tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] HTTP exception thrown: Instance 234605f1-0454-4056-8c71-fb0444c4e305 could not be found. Oct 19 04:34:10.918372 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f60ae737-ddeb-4c19-982d-6316e5d6a3ee tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Request method failure captured: Oct 19 04:34:10.918372 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/234605f1-0454-4056-8c71-fb0444c4e305 HTTP/1.1 Oct 19 04:34:10.918372 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 04:34:10.918372 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 04:34:10.918372 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 04:34:10.918372 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 04:34:10.918372 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 04:34:10.918372 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 04:34:10.918372 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 04:34:10.918372 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 04:34:10.918372 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT3y_zyB1g63gioa-ifJ0dkoCTOlZmZErF0CpNGrcb2_BcskDlnnNYkFtO29M-WCPkqGqIVquISfO6GJ6_e-H71yF3RJV0eU5D58xeW_lumD5wYAG8LS1HlVTXpqOhmM6Nv9MQIFa7rrVvNr0ThaLyhtWP-s68O0CxcGD9SQ5veJstWI Oct 19 04:34:10.918372 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 04:34:10.918372 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 04:34:10.918372 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 04:34:10.918372 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 04:34:10.918372 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 04:34:10.918372 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 04:34:10.918372 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 0bb5ad698ae94dceabc0e4a5b39567a7 Oct 19 04:34:10.918372 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-TestMinimumBasicScenario-1592269912 Oct 19 04:34:10.918372 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 04:34:10.918372 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 04:34:10.918372 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/0bb5ad698ae94dceabc0e4a5b39567a7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0bb5ad698ae94dceabc0e4a5b39567a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0bb5ad698ae94dceabc0e4a5b39567a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_0bb5ad698ae94dceabc0e4a5b39567a7", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 04:34:10.918372 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-TestMinimumBasicScenario-1592269912 Oct 19 04:34:10.918372 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 0bb5ad698ae94dceabc0e4a5b39567a7 Oct 19 04:34:10.918372 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1592269912 Oct 19 04:34:10.918372 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-TestMinimumBasicScenario-1592269912-project Oct 19 04:34:10.918372 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 04:34:10.918372 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 04:34:10.918372 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 33c04ff6cc2c4fd5a51b1e2325c4c8de Oct 19 04:34:10.918372 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-TestMinimumBasicScenario-1592269912-project Oct 19 04:34:10.918372 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 04:34:10.918372 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance 234605f1-0454-4056-8c71-fb0444c4e305 could not be found. Oct 19 04:34:10.918372 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '234605f1-0454-4056-8c71-fb0444c4e305'} Oct 19 04:34:10.918372 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 04:34:10.918372 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:34:10.918372 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 04:34:10.918372 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 04:34:10.918372 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 04:34:10.918372 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 04:34:10.918372 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 04:34:10.918372 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 04:34:10.918372 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 04:34:10.918372 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 04:34:10.918372 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 234605f1-0454-4056-8c71-fb0444c4e305 could not be found. Oct 19 04:34:10.918372 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:34:10.918372 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:34:10.918372 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:34:10.918372 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:34:10.918372 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:34:10.918372 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:34:10.918372 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 04:34:10.918372 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 04:34:10.918372 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 04:34:10.918372 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 04:34:10.918372 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 04:34:10.918372 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 04:34:10.918372 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 04:34:10.918372 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 04:34:10.918372 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 04:34:10.918372 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 04:34:10.918372 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 234605f1-0454-4056-8c71-fb0444c4e305 could not be found. Oct 19 04:34:10.918372 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:34:10.918372 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:34:10.918372 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:34:10.923239 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:34:10.923239 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:34:10.923239 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:34:10.923239 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 04:34:10.923239 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 04:34:10.923239 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 234605f1-0454-4056-8c71-fb0444c4e305 could not be found. Oct 19 04:34:10.923239 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:34:10.923239 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f60ae737-ddeb-4c19-982d-6316e5d6a3ee tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Returning 404 to user: Instance 234605f1-0454-4056-8c71-fb0444c4e305 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 04:34:10.923239 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f60ae737-ddeb-4c19-982d-6316e5d6a3ee tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] 10.222.0.52 "GET /compute/v2.1/servers/234605f1-0454-4056-8c71-fb0444c4e305" status: 404 len: 111 microversion: 2.1 time: 0.032749 Oct 19 04:34:10.923239 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3777/8027] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:34:10 2022] GET /compute/v2.1/servers/234605f1-0454-4056-8c71-fb0444c4e305 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 04:34:10.929349 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a7660e43-9151-4dd8-99e3-da1eed842f7a tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] Calling method '.version_select at 0x7fc12b977f70>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:34:11.001276 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a7660e43-9151-4dd8-99e3-da1eed842f7a tempest-TestMinimumBasicScenario-1592269912 tempest-TestMinimumBasicScenario-1592269912-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1979659351" status: 202 len: 0 microversion: 2.1 time: 0.075650 Oct 19 04:34:11.001921 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4251/8028] 10.222.0.52 () {58 vars in 1272 bytes} [Wed Oct 19 04:34:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1979659351 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 04:34:22.805050 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:34:22.805802 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:34:22.985320 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1d60acda-208a-4262-ab19-6c6d1bcd46b2 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Action: 'create', calling method: .version_select at 0x7fc12be21040>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1155972101", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDWtEGLih3Q8T4BW7hNr0yiVnntPPRA+h8q4SsSoNTJdHt7QP1H9Bf0WccvJT1+0a+PiyOdCizbQKnBvVKeuVOM+Vm8L7swxJ4ONSx3shK7mKs44KGzXDQh+07aPZZb4Fw=="}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:34:23.005485 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-1d60acda-208a-4262-ab19-6c6d1bcd46b2 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Getting quotas for project d31be961273b43ebb4c58e2350042660. Resources: {'key_pairs'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 04:34:23.010746 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-1d60acda-208a-4262-ab19-6c6d1bcd46b2 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Getting quotas for user 834b809f82734666a6d2aea092429cbd and project d31be961273b43ebb4c58e2350042660. Resources: {'key_pairs'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 04:34:23.127751 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1d60acda-208a-4262-ab19-6c6d1bcd46b2 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.328013 Oct 19 04:34:23.128570 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3778/8029] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Oct 19 04:34:22 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:34:31.595427 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-bf153faa-1fe7-41dd-8166-02d9ac1bae32 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-44384496", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "networks": [{"uuid": "47ee964b-d7fe-40e0-8d41-58ffd657ab62"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1155972101", "security_groups": [{"name": "tempest-secgroup-smoke-470293588"}]}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:34:31.623153 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=48 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:34:31.623847 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=23,nova_api:DELETE=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:34:31.755509 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-bf153faa-1fe7-41dd-8166-02d9ac1bae32 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] validate_networks() for [('47ee964b-d7fe-40e0-8d41-58ffd657ab62', None, None, None, None, None)] {{(pid=121134) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 04:34:32.183339 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-bf153faa-1fe7-41dd-8166-02d9ac1bae32 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Flavor limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 04:34:32.184050 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-bf153faa-1fe7-41dd-8166-02d9ac1bae32 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Image limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 04:34:32.184791 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-bf153faa-1fe7-41dd-8166-02d9ac1bae32 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Flavor pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 04:34:32.185488 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-bf153faa-1fe7-41dd-8166-02d9ac1bae32 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Image pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 04:34:32.188158 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-bf153faa-1fe7-41dd-8166-02d9ac1bae32 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 04:34:32.198830 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bf153faa-1fe7-41dd-8166-02d9ac1bae32 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:34:32.199692 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bf153faa-1fe7-41dd-8166-02d9ac1bae32 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:34:32.200391 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bf153faa-1fe7-41dd-8166-02d9ac1bae32 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:34:32.201463 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bf153faa-1fe7-41dd-8166-02d9ac1bae32 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:34:32.202154 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bf153faa-1fe7-41dd-8166-02d9ac1bae32 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:34:32.202850 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bf153faa-1fe7-41dd-8166-02d9ac1bae32 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:34:32.224873 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-bf153faa-1fe7-41dd-8166-02d9ac1bae32 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Getting quotas for project d31be961273b43ebb4c58e2350042660. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 04:34:32.230544 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-bf153faa-1fe7-41dd-8166-02d9ac1bae32 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Getting quotas for user 834b809f82734666a6d2aea092429cbd and project d31be961273b43ebb4c58e2350042660. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 04:34:32.244983 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-bf153faa-1fe7-41dd-8166-02d9ac1bae32 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Going to run 1 instances... {{(pid=121134) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 04:34:32.247545 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-bf153faa-1fe7-41dd-8166-02d9ac1bae32 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: b495cce1-15f0-405d-a72a-a36b8aa51033] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 04:34:32.355811 n-d-861333-8 devstack@n-api.service[121134]: ERROR oslo.messaging._drivers.impl_rabbit [None req-bf153faa-1fe7-41dd-8166-02d9ac1bae32 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [c05aef85-47e0-45f7-a28b-fdfe1b7df516] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 19 04:34:33.364808 n-d-861333-8 devstack@n-api.service[121134]: INFO oslo.messaging._drivers.impl_rabbit [None req-bf153faa-1fe7-41dd-8166-02d9ac1bae32 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [c05aef85-47e0-45f7-a28b-fdfe1b7df516] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 35586. Oct 19 04:34:33.372000 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-bf153faa-1fe7-41dd-8166-02d9ac1bae32 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.780947 Oct 19 04:34:33.379222 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4252/8030] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 04:34:31 2022] POST /compute/v2.1/servers => generated 405 bytes in 1783 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 04:34:33.382295 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=4 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:34:33.383329 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:34:33.388424 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-688f6545-d1a9-4676-8721-6b7327ee6cac tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:34:33.393488 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-688f6545-d1a9-4676-8721-6b7327ee6cac tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: b495cce1-15f0-405d-a72a-a36b8aa51033] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:34:33.480881 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-688f6545-d1a9-4676-8721-6b7327ee6cac tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:34:33.491452 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-688f6545-d1a9-4676-8721-6b7327ee6cac tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/b495cce1-15f0-405d-a72a-a36b8aa51033" status: 200 len: 1265 microversion: 2.1 time: 0.110719 Oct 19 04:34:33.492040 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3779/8031] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:34:33 2022] GET /compute/v2.1/servers/b495cce1-15f0-405d-a72a-a36b8aa51033 => generated 1265 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:34:34.515976 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b6f97b73-3292-465d-b96c-dce2b21c7691 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:34:34.516682 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b6f97b73-3292-465d-b96c-dce2b21c7691 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: b495cce1-15f0-405d-a72a-a36b8aa51033] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:34:34.570017 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b6f97b73-3292-465d-b96c-dce2b21c7691 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:34:34.577267 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b6f97b73-3292-465d-b96c-dce2b21c7691 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/b495cce1-15f0-405d-a72a-a36b8aa51033" status: 200 len: 1265 microversion: 2.1 time: 0.066178 Oct 19 04:34:34.577892 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4253/8032] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:34:34 2022] GET /compute/v2.1/servers/b495cce1-15f0-405d-a72a-a36b8aa51033 => generated 1265 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:34:35.599959 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a6a22bca-3b41-4e52-856f-b67c4cbf11f6 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:34:35.600501 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a6a22bca-3b41-4e52-856f-b67c4cbf11f6 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: b495cce1-15f0-405d-a72a-a36b8aa51033] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:34:35.608192 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a6a22bca-3b41-4e52-856f-b67c4cbf11f6 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:34:35.608715 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a6a22bca-3b41-4e52-856f-b67c4cbf11f6 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:34:35.609160 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a6a22bca-3b41-4e52-856f-b67c4cbf11f6 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:34:35.609890 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a6a22bca-3b41-4e52-856f-b67c4cbf11f6 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:34:35.610352 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a6a22bca-3b41-4e52-856f-b67c4cbf11f6 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:34:35.611326 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a6a22bca-3b41-4e52-856f-b67c4cbf11f6 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:34:35.673141 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a6a22bca-3b41-4e52-856f-b67c4cbf11f6 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:34:35.681648 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a6a22bca-3b41-4e52-856f-b67c4cbf11f6 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/b495cce1-15f0-405d-a72a-a36b8aa51033" status: 200 len: 1317 microversion: 2.1 time: 0.085681 Oct 19 04:34:35.682241 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3780/8033] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:34:35 2022] GET /compute/v2.1/servers/b495cce1-15f0-405d-a72a-a36b8aa51033 => generated 1317 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:34:36.704452 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c8355f7c-aa99-4dd7-b937-db5d7496df07 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:34:36.705838 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c8355f7c-aa99-4dd7-b937-db5d7496df07 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: b495cce1-15f0-405d-a72a-a36b8aa51033] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:34:36.715237 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c8355f7c-aa99-4dd7-b937-db5d7496df07 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:34:36.716731 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c8355f7c-aa99-4dd7-b937-db5d7496df07 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:34:36.717429 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c8355f7c-aa99-4dd7-b937-db5d7496df07 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:34:36.718209 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c8355f7c-aa99-4dd7-b937-db5d7496df07 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:34:36.718691 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c8355f7c-aa99-4dd7-b937-db5d7496df07 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:34:36.719524 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c8355f7c-aa99-4dd7-b937-db5d7496df07 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:34:36.880922 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c8355f7c-aa99-4dd7-b937-db5d7496df07 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:34:36.889068 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c8355f7c-aa99-4dd7-b937-db5d7496df07 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/b495cce1-15f0-405d-a72a-a36b8aa51033" status: 200 len: 1390 microversion: 2.1 time: 0.188707 Oct 19 04:34:36.889714 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4254/8034] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:34:36 2022] GET /compute/v2.1/servers/b495cce1-15f0-405d-a72a-a36b8aa51033 => generated 1390 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:34:37.913555 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9b4ba07b-b65e-41c5-9821-41c99df5540c tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:34:37.914217 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9b4ba07b-b65e-41c5-9821-41c99df5540c tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: b495cce1-15f0-405d-a72a-a36b8aa51033] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:34:37.921905 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9b4ba07b-b65e-41c5-9821-41c99df5540c tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:34:37.922414 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9b4ba07b-b65e-41c5-9821-41c99df5540c tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:34:37.922899 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9b4ba07b-b65e-41c5-9821-41c99df5540c tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:34:37.924184 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9b4ba07b-b65e-41c5-9821-41c99df5540c tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:34:37.924650 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9b4ba07b-b65e-41c5-9821-41c99df5540c tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:34:37.925087 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9b4ba07b-b65e-41c5-9821-41c99df5540c tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:34:38.102187 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-bf2fab02-350e-4897-9a88-16d366a59073 req-7fdc8cd5-f34c-424e-9d7e-88418e028307 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b495cce1-15f0-405d-a72a-a36b8aa51033", "tag": "feb79a55-ef70-428c-8a98-446d36edc637"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:34:38.105570 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-9b4ba07b-b65e-41c5-9821-41c99df5540c tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:34:38.113625 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-bf2fab02-350e-4897-9a88-16d366a59073 req-7fdc8cd5-f34c-424e-9d7e-88418e028307 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:34:38.114365 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-bf2fab02-350e-4897-9a88-16d366a59073 req-7fdc8cd5-f34c-424e-9d7e-88418e028307 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:34:38.115031 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-bf2fab02-350e-4897-9a88-16d366a59073 req-7fdc8cd5-f34c-424e-9d7e-88418e028307 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:34:38.115826 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9b4ba07b-b65e-41c5-9821-41c99df5540c tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/b495cce1-15f0-405d-a72a-a36b8aa51033" status: 200 len: 1390 microversion: 2.1 time: 0.206373 Oct 19 04:34:38.127189 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-bf2fab02-350e-4897-9a88-16d366a59073 req-7fdc8cd5-f34c-424e-9d7e-88418e028307 service nova] Creating event network-changed:feb79a55-ef70-428c-8a98-446d36edc637 for instance b495cce1-15f0-405d-a72a-a36b8aa51033 on n-h2-861333-8 Oct 19 04:34:38.132804 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-bf2fab02-350e-4897-9a88-16d366a59073 req-7fdc8cd5-f34c-424e-9d7e-88418e028307 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034447 Oct 19 04:34:38.133723 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4255/8035] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:34:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 04:34:38.139039 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3781/8036] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:34:37 2022] GET /compute/v2.1/servers/b495cce1-15f0-405d-a72a-a36b8aa51033 => generated 1390 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:34:39.139970 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0d4eba55-fbdf-4b61-b2ec-b46a2a40b550 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:34:39.140687 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0d4eba55-fbdf-4b61-b2ec-b46a2a40b550 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: b495cce1-15f0-405d-a72a-a36b8aa51033] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:34:39.147785 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0d4eba55-fbdf-4b61-b2ec-b46a2a40b550 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:34:39.148296 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0d4eba55-fbdf-4b61-b2ec-b46a2a40b550 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:34:39.148755 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0d4eba55-fbdf-4b61-b2ec-b46a2a40b550 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:34:39.149488 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0d4eba55-fbdf-4b61-b2ec-b46a2a40b550 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:34:39.149961 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0d4eba55-fbdf-4b61-b2ec-b46a2a40b550 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:34:39.150471 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0d4eba55-fbdf-4b61-b2ec-b46a2a40b550 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:34:39.283827 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0d4eba55-fbdf-4b61-b2ec-b46a2a40b550 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:34:39.291631 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0d4eba55-fbdf-4b61-b2ec-b46a2a40b550 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/b495cce1-15f0-405d-a72a-a36b8aa51033" status: 200 len: 1390 microversion: 2.1 time: 0.155958 Oct 19 04:34:39.292209 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4256/8037] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:34:39 2022] GET /compute/v2.1/servers/b495cce1-15f0-405d-a72a-a36b8aa51033 => generated 1390 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:34:40.315648 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-36f405b2-0836-471b-a673-e57556dfaa4c tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:34:40.316219 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-36f405b2-0836-471b-a673-e57556dfaa4c tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: b495cce1-15f0-405d-a72a-a36b8aa51033] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:34:40.323030 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-36f405b2-0836-471b-a673-e57556dfaa4c tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:34:40.323523 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-36f405b2-0836-471b-a673-e57556dfaa4c tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:34:40.323969 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-36f405b2-0836-471b-a673-e57556dfaa4c tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:34:40.324669 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-36f405b2-0836-471b-a673-e57556dfaa4c tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:34:40.325131 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-36f405b2-0836-471b-a673-e57556dfaa4c tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:34:40.325600 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-36f405b2-0836-471b-a673-e57556dfaa4c tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:34:40.456639 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-36f405b2-0836-471b-a673-e57556dfaa4c tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:34:40.464283 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-36f405b2-0836-471b-a673-e57556dfaa4c tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/b495cce1-15f0-405d-a72a-a36b8aa51033" status: 200 len: 1390 microversion: 2.1 time: 0.153283 Oct 19 04:34:40.464860 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3782/8038] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:34:40 2022] GET /compute/v2.1/servers/b495cce1-15f0-405d-a72a-a36b8aa51033 => generated 1390 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:34:41.487104 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8b49c462-c222-49a3-866e-2ff33e5ccff1 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:34:41.487738 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8b49c462-c222-49a3-866e-2ff33e5ccff1 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: b495cce1-15f0-405d-a72a-a36b8aa51033] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:34:41.494560 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8b49c462-c222-49a3-866e-2ff33e5ccff1 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:34:41.495061 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8b49c462-c222-49a3-866e-2ff33e5ccff1 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:34:41.495517 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8b49c462-c222-49a3-866e-2ff33e5ccff1 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:34:41.496223 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8b49c462-c222-49a3-866e-2ff33e5ccff1 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:34:41.496695 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8b49c462-c222-49a3-866e-2ff33e5ccff1 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:34:41.497178 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8b49c462-c222-49a3-866e-2ff33e5ccff1 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:34:41.636060 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8b49c462-c222-49a3-866e-2ff33e5ccff1 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:34:41.644672 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8b49c462-c222-49a3-866e-2ff33e5ccff1 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/b495cce1-15f0-405d-a72a-a36b8aa51033" status: 200 len: 1390 microversion: 2.1 time: 0.161502 Oct 19 04:34:41.645301 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4257/8039] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:34:41 2022] GET /compute/v2.1/servers/b495cce1-15f0-405d-a72a-a36b8aa51033 => generated 1390 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:34:42.667867 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-eded78eb-f151-4c19-8514-e4d99a8aed14 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:34:42.668488 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-eded78eb-f151-4c19-8514-e4d99a8aed14 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: b495cce1-15f0-405d-a72a-a36b8aa51033] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:34:42.675381 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-eded78eb-f151-4c19-8514-e4d99a8aed14 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:34:42.675870 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-eded78eb-f151-4c19-8514-e4d99a8aed14 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:34:42.676316 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-eded78eb-f151-4c19-8514-e4d99a8aed14 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:34:42.677008 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-eded78eb-f151-4c19-8514-e4d99a8aed14 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:34:42.677504 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-eded78eb-f151-4c19-8514-e4d99a8aed14 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:34:42.677937 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-eded78eb-f151-4c19-8514-e4d99a8aed14 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:34:42.812448 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-eded78eb-f151-4c19-8514-e4d99a8aed14 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:34:42.820266 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-eded78eb-f151-4c19-8514-e4d99a8aed14 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/b495cce1-15f0-405d-a72a-a36b8aa51033" status: 200 len: 1390 microversion: 2.1 time: 0.156280 Oct 19 04:34:42.820851 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3783/8040] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:34:42 2022] GET /compute/v2.1/servers/b495cce1-15f0-405d-a72a-a36b8aa51033 => generated 1390 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:34:43.653054 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:34:43.713072 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-97f81737-c0e2-41c9-9e06-12d2a399a7b8 req-fbb58f0c-3f41-4af4-a7f2-520bb2ed0383 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b495cce1-15f0-405d-a72a-a36b8aa51033", "name": "network-vif-plugged", "status": "completed", "tag": "feb79a55-ef70-428c-8a98-446d36edc637"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:34:43.722482 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-97f81737-c0e2-41c9-9e06-12d2a399a7b8 req-fbb58f0c-3f41-4af4-a7f2-520bb2ed0383 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:34:43.722974 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-97f81737-c0e2-41c9-9e06-12d2a399a7b8 req-fbb58f0c-3f41-4af4-a7f2-520bb2ed0383 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:34:43.723417 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-97f81737-c0e2-41c9-9e06-12d2a399a7b8 req-fbb58f0c-3f41-4af4-a7f2-520bb2ed0383 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:34:43.734304 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-97f81737-c0e2-41c9-9e06-12d2a399a7b8 req-fbb58f0c-3f41-4af4-a7f2-520bb2ed0383 service nova] Creating event network-vif-plugged:feb79a55-ef70-428c-8a98-446d36edc637 for instance b495cce1-15f0-405d-a72a-a36b8aa51033 on n-h2-861333-8 Oct 19 04:34:43.739717 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-97f81737-c0e2-41c9-9e06-12d2a399a7b8 req-fbb58f0c-3f41-4af4-a7f2-520bb2ed0383 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091193 Oct 19 04:34:43.740330 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4258/8041] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:34:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:34:43.844087 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-86f6892b-0e1f-4681-91df-fe8822be256a tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:34:43.844881 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-86f6892b-0e1f-4681-91df-fe8822be256a tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: b495cce1-15f0-405d-a72a-a36b8aa51033] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:34:43.848178 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:34:43.852633 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-86f6892b-0e1f-4681-91df-fe8822be256a tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:34:43.853128 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-86f6892b-0e1f-4681-91df-fe8822be256a tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:34:43.853605 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-86f6892b-0e1f-4681-91df-fe8822be256a tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:34:43.854314 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-86f6892b-0e1f-4681-91df-fe8822be256a tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:34:43.854802 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-86f6892b-0e1f-4681-91df-fe8822be256a tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:34:43.855234 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-86f6892b-0e1f-4681-91df-fe8822be256a tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:34:44.000893 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-86f6892b-0e1f-4681-91df-fe8822be256a tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:34:44.008512 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-86f6892b-0e1f-4681-91df-fe8822be256a tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/b495cce1-15f0-405d-a72a-a36b8aa51033" status: 200 len: 1390 microversion: 2.1 time: 0.168463 Oct 19 04:34:44.009082 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3784/8042] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:34:43 2022] GET /compute/v2.1/servers/b495cce1-15f0-405d-a72a-a36b8aa51033 => generated 1390 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:34:45.028352 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=8 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:34:45.034319 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-057a6c28-4566-41ff-ae67-3be0a83ae9dc tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:34:45.035045 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-057a6c28-4566-41ff-ae67-3be0a83ae9dc tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: b495cce1-15f0-405d-a72a-a36b8aa51033] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:34:45.041580 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-057a6c28-4566-41ff-ae67-3be0a83ae9dc tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:34:45.042091 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-057a6c28-4566-41ff-ae67-3be0a83ae9dc tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:34:45.042547 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-057a6c28-4566-41ff-ae67-3be0a83ae9dc tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:34:45.043256 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-057a6c28-4566-41ff-ae67-3be0a83ae9dc tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:34:45.043732 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-057a6c28-4566-41ff-ae67-3be0a83ae9dc tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:34:45.044183 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-057a6c28-4566-41ff-ae67-3be0a83ae9dc tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:34:45.176720 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-057a6c28-4566-41ff-ae67-3be0a83ae9dc tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:34:45.184921 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-057a6c28-4566-41ff-ae67-3be0a83ae9dc tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/b495cce1-15f0-405d-a72a-a36b8aa51033" status: 200 len: 1390 microversion: 2.1 time: 0.157525 Oct 19 04:34:45.185580 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4259/8043] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:34:45 2022] GET /compute/v2.1/servers/b495cce1-15f0-405d-a72a-a36b8aa51033 => generated 1390 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:34:46.208574 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c549a74a-5763-414f-be47-4198dcb04d2e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:34:46.209195 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c549a74a-5763-414f-be47-4198dcb04d2e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: b495cce1-15f0-405d-a72a-a36b8aa51033] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:34:46.216074 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c549a74a-5763-414f-be47-4198dcb04d2e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:34:46.216562 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c549a74a-5763-414f-be47-4198dcb04d2e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:34:46.217012 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c549a74a-5763-414f-be47-4198dcb04d2e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:34:46.217748 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c549a74a-5763-414f-be47-4198dcb04d2e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:34:46.218207 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c549a74a-5763-414f-be47-4198dcb04d2e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:34:46.218636 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c549a74a-5763-414f-be47-4198dcb04d2e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:34:46.353821 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c549a74a-5763-414f-be47-4198dcb04d2e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:34:46.361506 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c549a74a-5763-414f-be47-4198dcb04d2e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/b495cce1-15f0-405d-a72a-a36b8aa51033" status: 200 len: 1561 microversion: 2.1 time: 0.157460 Oct 19 04:34:46.362515 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3785/8044] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:34:46 2022] GET /compute/v2.1/servers/b495cce1-15f0-405d-a72a-a36b8aa51033 => generated 1561 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:34:46.384870 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-32ad8c97-58f8-49b7-896c-a10576bd75c2 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:34:46.385475 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-32ad8c97-58f8-49b7-896c-a10576bd75c2 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: b495cce1-15f0-405d-a72a-a36b8aa51033] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:34:46.392341 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-32ad8c97-58f8-49b7-896c-a10576bd75c2 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:34:46.392843 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-32ad8c97-58f8-49b7-896c-a10576bd75c2 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:34:46.394044 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-32ad8c97-58f8-49b7-896c-a10576bd75c2 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:34:46.394768 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-32ad8c97-58f8-49b7-896c-a10576bd75c2 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:34:46.395235 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-32ad8c97-58f8-49b7-896c-a10576bd75c2 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:34:46.395675 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-32ad8c97-58f8-49b7-896c-a10576bd75c2 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:34:46.528808 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-32ad8c97-58f8-49b7-896c-a10576bd75c2 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:34:46.536781 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-32ad8c97-58f8-49b7-896c-a10576bd75c2 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/b495cce1-15f0-405d-a72a-a36b8aa51033" status: 200 len: 1561 microversion: 2.1 time: 0.155880 Oct 19 04:34:46.537400 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4260/8045] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:34:46 2022] GET /compute/v2.1/servers/b495cce1-15f0-405d-a72a-a36b8aa51033 => generated 1561 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:34:48.418609 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-25aa6dce-3449-4a92-80a6-aa71a4c26df2 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:34:48.419384 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-25aa6dce-3449-4a92-80a6-aa71a4c26df2 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: b495cce1-15f0-405d-a72a-a36b8aa51033] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:34:48.421303 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-f12f7ab7-051a-427b-a489-dd09907e085e req-99ce792d-d1fd-458a-8083-323ded19a820 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b495cce1-15f0-405d-a72a-a36b8aa51033", "tag": "feb79a55-ef70-428c-8a98-446d36edc637"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:34:48.426528 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-25aa6dce-3449-4a92-80a6-aa71a4c26df2 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:34:48.427088 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-25aa6dce-3449-4a92-80a6-aa71a4c26df2 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:34:48.427536 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-25aa6dce-3449-4a92-80a6-aa71a4c26df2 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:34:48.428256 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-25aa6dce-3449-4a92-80a6-aa71a4c26df2 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:34:48.428788 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-25aa6dce-3449-4a92-80a6-aa71a4c26df2 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:34:48.429132 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-25aa6dce-3449-4a92-80a6-aa71a4c26df2 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:34:48.433460 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-f12f7ab7-051a-427b-a489-dd09907e085e req-99ce792d-d1fd-458a-8083-323ded19a820 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:34:48.434476 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-f12f7ab7-051a-427b-a489-dd09907e085e req-99ce792d-d1fd-458a-8083-323ded19a820 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:34:48.434790 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-f12f7ab7-051a-427b-a489-dd09907e085e req-99ce792d-d1fd-458a-8083-323ded19a820 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:34:48.446915 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-f12f7ab7-051a-427b-a489-dd09907e085e req-99ce792d-d1fd-458a-8083-323ded19a820 service nova] Creating event network-changed:feb79a55-ef70-428c-8a98-446d36edc637 for instance b495cce1-15f0-405d-a72a-a36b8aa51033 on n-h2-861333-8 Oct 19 04:34:48.452008 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-f12f7ab7-051a-427b-a489-dd09907e085e req-99ce792d-d1fd-458a-8083-323ded19a820 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034792 Oct 19 04:34:48.453459 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4261/8046] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:34:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:34:48.656828 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-25aa6dce-3449-4a92-80a6-aa71a4c26df2 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:34:48.666127 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-25aa6dce-3449-4a92-80a6-aa71a4c26df2 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/b495cce1-15f0-405d-a72a-a36b8aa51033" status: 200 len: 1561 microversion: 2.1 time: 0.251496 Oct 19 04:34:48.671254 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3786/8047] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:34:48 2022] GET /compute/v2.1/servers/b495cce1-15f0-405d-a72a-a36b8aa51033 => generated 1561 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:35:11.941025 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:35:11.942047 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=38 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:35:11.947116 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-538d1b22-8013-4c40-8dab-24fa9d613e70 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:35:11.949424 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-538d1b22-8013-4c40-8dab-24fa9d613e70 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: b495cce1-15f0-405d-a72a-a36b8aa51033] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:35:11.956152 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-538d1b22-8013-4c40-8dab-24fa9d613e70 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:35:11.956657 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-538d1b22-8013-4c40-8dab-24fa9d613e70 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:35:11.957105 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-538d1b22-8013-4c40-8dab-24fa9d613e70 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:35:11.958393 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-538d1b22-8013-4c40-8dab-24fa9d613e70 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:35:11.958913 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-538d1b22-8013-4c40-8dab-24fa9d613e70 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:35:11.959369 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-538d1b22-8013-4c40-8dab-24fa9d613e70 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:35:12.020013 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-538d1b22-8013-4c40-8dab-24fa9d613e70 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "POST /compute/v2.1/servers/b495cce1-15f0-405d-a72a-a36b8aa51033/action" status: 200 len: 24566 microversion: 2.1 time: 0.081301 Oct 19 04:35:12.021176 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4262/8048] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 04:35:11 2022] POST /compute/v2.1/servers/b495cce1-15f0-405d-a72a-a36b8aa51033/action => generated 24566 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 04:35:22.982488 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-450c23c2-84e3-4f35-9641-a59f729d99fd tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:35:22.983044 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-450c23c2-84e3-4f35-9641-a59f729d99fd tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: b495cce1-15f0-405d-a72a-a36b8aa51033] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:35:22.985123 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=18 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:35:22.985978 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=42 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:35:22.991344 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-450c23c2-84e3-4f35-9641-a59f729d99fd tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:35:22.997837 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-450c23c2-84e3-4f35-9641-a59f729d99fd tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:35:22.997837 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-450c23c2-84e3-4f35-9641-a59f729d99fd tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:35:22.997837 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-450c23c2-84e3-4f35-9641-a59f729d99fd tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:35:22.997837 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-450c23c2-84e3-4f35-9641-a59f729d99fd tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:35:22.997837 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-450c23c2-84e3-4f35-9641-a59f729d99fd tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:35:23.146087 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-450c23c2-84e3-4f35-9641-a59f729d99fd tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "POST /compute/v2.1/servers/b495cce1-15f0-405d-a72a-a36b8aa51033/action" status: 202 len: 0 microversion: 2.1 time: 0.167068 Oct 19 04:35:23.146960 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3787/8049] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 04:35:22 2022] POST /compute/v2.1/servers/b495cce1-15f0-405d-a72a-a36b8aa51033/action => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 04:35:23.155337 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-aa4b3dcd-bf2c-460b-bac1-e3fdc951177f tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:35:23.156138 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-aa4b3dcd-bf2c-460b-bac1-e3fdc951177f tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: b495cce1-15f0-405d-a72a-a36b8aa51033] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:35:23.165540 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-aa4b3dcd-bf2c-460b-bac1-e3fdc951177f tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:35:23.166048 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-aa4b3dcd-bf2c-460b-bac1-e3fdc951177f tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:35:23.166505 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-aa4b3dcd-bf2c-460b-bac1-e3fdc951177f tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:35:23.167220 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-aa4b3dcd-bf2c-460b-bac1-e3fdc951177f tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:35:23.167695 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-aa4b3dcd-bf2c-460b-bac1-e3fdc951177f tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:35:23.168146 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-aa4b3dcd-bf2c-460b-bac1-e3fdc951177f tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:35:23.305360 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-aa4b3dcd-bf2c-460b-bac1-e3fdc951177f tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:35:23.313124 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-aa4b3dcd-bf2c-460b-bac1-e3fdc951177f tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/b495cce1-15f0-405d-a72a-a36b8aa51033" status: 200 len: 1685 microversion: 2.1 time: 0.161975 Oct 19 04:35:23.313744 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4263/8050] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:35:23 2022] GET /compute/v2.1/servers/b495cce1-15f0-405d-a72a-a36b8aa51033 => generated 1685 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:35:24.338367 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-71253623-9e7f-4451-8af8-00678d1b01c7 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:35:24.339070 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-71253623-9e7f-4451-8af8-00678d1b01c7 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: b495cce1-15f0-405d-a72a-a36b8aa51033] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:35:24.345269 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-71253623-9e7f-4451-8af8-00678d1b01c7 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:35:24.345789 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-71253623-9e7f-4451-8af8-00678d1b01c7 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:35:24.346229 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-71253623-9e7f-4451-8af8-00678d1b01c7 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:35:24.346918 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-71253623-9e7f-4451-8af8-00678d1b01c7 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:35:24.347373 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-71253623-9e7f-4451-8af8-00678d1b01c7 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:35:24.347800 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-71253623-9e7f-4451-8af8-00678d1b01c7 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:35:24.480120 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-71253623-9e7f-4451-8af8-00678d1b01c7 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:35:24.487877 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-71253623-9e7f-4451-8af8-00678d1b01c7 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/b495cce1-15f0-405d-a72a-a36b8aa51033" status: 200 len: 1665 microversion: 2.1 time: 0.154973 Oct 19 04:35:24.488448 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3788/8051] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:35:24 2022] GET /compute/v2.1/servers/b495cce1-15f0-405d-a72a-a36b8aa51033 => generated 1665 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:35:25.584360 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a15aacaf-15df-4e90-a140-e096332e87cf tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:35:25.586472 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a15aacaf-15df-4e90-a140-e096332e87cf tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: b495cce1-15f0-405d-a72a-a36b8aa51033] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:35:25.593993 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a15aacaf-15df-4e90-a140-e096332e87cf tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:35:25.594491 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a15aacaf-15df-4e90-a140-e096332e87cf tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:35:25.594941 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a15aacaf-15df-4e90-a140-e096332e87cf tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:35:25.595673 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a15aacaf-15df-4e90-a140-e096332e87cf tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:35:25.596135 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a15aacaf-15df-4e90-a140-e096332e87cf tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:35:25.596577 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a15aacaf-15df-4e90-a140-e096332e87cf tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:35:25.662644 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a15aacaf-15df-4e90-a140-e096332e87cf tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "POST /compute/v2.1/servers/b495cce1-15f0-405d-a72a-a36b8aa51033/action" status: 200 len: 32634 microversion: 2.1 time: 0.082181 Oct 19 04:35:25.663312 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4264/8052] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 04:35:25 2022] POST /compute/v2.1/servers/b495cce1-15f0-405d-a72a-a36b8aa51033/action => generated 32634 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 04:35:25.674757 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-762f74ed-001f-484d-8138-24b16b0fe30e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:35:25.675303 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-762f74ed-001f-484d-8138-24b16b0fe30e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: b495cce1-15f0-405d-a72a-a36b8aa51033] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:35:25.682204 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-762f74ed-001f-484d-8138-24b16b0fe30e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:35:25.682698 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-762f74ed-001f-484d-8138-24b16b0fe30e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:35:25.683143 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-762f74ed-001f-484d-8138-24b16b0fe30e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:35:25.683840 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-762f74ed-001f-484d-8138-24b16b0fe30e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:35:25.684304 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-762f74ed-001f-484d-8138-24b16b0fe30e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:35:25.684739 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-762f74ed-001f-484d-8138-24b16b0fe30e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:35:25.892358 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-762f74ed-001f-484d-8138-24b16b0fe30e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "POST /compute/v2.1/servers/b495cce1-15f0-405d-a72a-a36b8aa51033/action" status: 202 len: 0 microversion: 2.1 time: 0.221260 Oct 19 04:35:25.892909 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3789/8053] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 04:35:25 2022] POST /compute/v2.1/servers/b495cce1-15f0-405d-a72a-a36b8aa51033/action => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 04:35:25.902388 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-875c6afc-14b6-4c11-b313-71ce84bdf339 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:35:25.904039 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-875c6afc-14b6-4c11-b313-71ce84bdf339 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: b495cce1-15f0-405d-a72a-a36b8aa51033] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:35:25.910585 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-875c6afc-14b6-4c11-b313-71ce84bdf339 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:35:25.911092 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-875c6afc-14b6-4c11-b313-71ce84bdf339 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:35:25.911554 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-875c6afc-14b6-4c11-b313-71ce84bdf339 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:35:25.912272 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-875c6afc-14b6-4c11-b313-71ce84bdf339 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:35:25.912746 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-875c6afc-14b6-4c11-b313-71ce84bdf339 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:35:25.913192 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-875c6afc-14b6-4c11-b313-71ce84bdf339 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:35:26.048898 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-875c6afc-14b6-4c11-b313-71ce84bdf339 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:35:26.056840 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-875c6afc-14b6-4c11-b313-71ce84bdf339 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/b495cce1-15f0-405d-a72a-a36b8aa51033" status: 200 len: 1672 microversion: 2.1 time: 0.158780 Oct 19 04:35:26.057473 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4265/8054] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:35:25 2022] GET /compute/v2.1/servers/b495cce1-15f0-405d-a72a-a36b8aa51033 => generated 1672 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:35:27.081437 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3991bd77-a1a1-46d3-921c-c80e8a29a56f tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:35:27.082072 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-3991bd77-a1a1-46d3-921c-c80e8a29a56f tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: b495cce1-15f0-405d-a72a-a36b8aa51033] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:35:27.089095 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3991bd77-a1a1-46d3-921c-c80e8a29a56f tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:35:27.089617 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3991bd77-a1a1-46d3-921c-c80e8a29a56f tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:35:27.090061 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3991bd77-a1a1-46d3-921c-c80e8a29a56f tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:35:27.090752 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3991bd77-a1a1-46d3-921c-c80e8a29a56f tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:35:27.091208 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3991bd77-a1a1-46d3-921c-c80e8a29a56f tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:35:27.091638 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3991bd77-a1a1-46d3-921c-c80e8a29a56f tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:35:27.227116 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-3991bd77-a1a1-46d3-921c-c80e8a29a56f tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:35:27.232058 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-3991bd77-a1a1-46d3-921c-c80e8a29a56f tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/b495cce1-15f0-405d-a72a-a36b8aa51033" status: 200 len: 1680 microversion: 2.1 time: 0.154956 Oct 19 04:35:27.232635 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3790/8055] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:35:27 2022] GET /compute/v2.1/servers/b495cce1-15f0-405d-a72a-a36b8aa51033 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:35:27.330974 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6c10a8ba-0aad-42c5-a1d7-fc1c3bd314d4 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:35:27.333332 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6c10a8ba-0aad-42c5-a1d7-fc1c3bd314d4 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: b495cce1-15f0-405d-a72a-a36b8aa51033] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:35:27.340849 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6c10a8ba-0aad-42c5-a1d7-fc1c3bd314d4 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:35:27.351015 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6c10a8ba-0aad-42c5-a1d7-fc1c3bd314d4 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:35:27.351015 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6c10a8ba-0aad-42c5-a1d7-fc1c3bd314d4 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:35:27.351015 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6c10a8ba-0aad-42c5-a1d7-fc1c3bd314d4 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:35:27.351015 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6c10a8ba-0aad-42c5-a1d7-fc1c3bd314d4 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:35:27.351015 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6c10a8ba-0aad-42c5-a1d7-fc1c3bd314d4 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:35:27.396334 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6c10a8ba-0aad-42c5-a1d7-fc1c3bd314d4 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "POST /compute/v2.1/servers/b495cce1-15f0-405d-a72a-a36b8aa51033/action" status: 200 len: 37422 microversion: 2.1 time: 0.069029 Oct 19 04:35:27.397026 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4266/8056] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 04:35:27 2022] POST /compute/v2.1/servers/b495cce1-15f0-405d-a72a-a36b8aa51033/action => generated 37422 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 04:35:28.838251 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-18a736ea-3413-4ded-a799-c8c90848128e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:35:28.838772 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-18a736ea-3413-4ded-a799-c8c90848128e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: b495cce1-15f0-405d-a72a-a36b8aa51033] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:35:28.840888 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-2dbd9077-65de-4878-aedb-f0d2331ee320 req-916d6803-e632-4624-b71e-4e83d8b277b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b495cce1-15f0-405d-a72a-a36b8aa51033", "tag": "feb79a55-ef70-428c-8a98-446d36edc637"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:35:28.845845 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-18a736ea-3413-4ded-a799-c8c90848128e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:35:28.846336 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-18a736ea-3413-4ded-a799-c8c90848128e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:35:28.846779 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-18a736ea-3413-4ded-a799-c8c90848128e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:35:28.847703 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-18a736ea-3413-4ded-a799-c8c90848128e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:35:28.848204 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-18a736ea-3413-4ded-a799-c8c90848128e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:35:28.848628 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-18a736ea-3413-4ded-a799-c8c90848128e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:35:28.852995 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-2dbd9077-65de-4878-aedb-f0d2331ee320 req-916d6803-e632-4624-b71e-4e83d8b277b1 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:35:28.856761 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-2dbd9077-65de-4878-aedb-f0d2331ee320 req-916d6803-e632-4624-b71e-4e83d8b277b1 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:35:28.856761 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-2dbd9077-65de-4878-aedb-f0d2331ee320 req-916d6803-e632-4624-b71e-4e83d8b277b1 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:35:28.866121 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-2dbd9077-65de-4878-aedb-f0d2331ee320 req-916d6803-e632-4624-b71e-4e83d8b277b1 service nova] Creating event network-changed:feb79a55-ef70-428c-8a98-446d36edc637 for instance b495cce1-15f0-405d-a72a-a36b8aa51033 on n-h2-861333-8 Oct 19 04:35:28.871181 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-2dbd9077-65de-4878-aedb-f0d2331ee320 req-916d6803-e632-4624-b71e-4e83d8b277b1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034507 Oct 19 04:35:28.872181 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4267/8057] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:35:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:35:28.880608 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-18a736ea-3413-4ded-a799-c8c90848128e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: b495cce1-15f0-405d-a72a-a36b8aa51033] Going to try to terminate instance {{(pid=121135) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 04:35:29.187810 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-18a736ea-3413-4ded-a799-c8c90848128e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "DELETE /compute/v2.1/servers/b495cce1-15f0-405d-a72a-a36b8aa51033" status: 204 len: 0 microversion: 2.1 time: 0.353448 Oct 19 04:35:29.188426 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3791/8058] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 04:35:28 2022] DELETE /compute/v2.1/servers/b495cce1-15f0-405d-a72a-a36b8aa51033 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 04:35:29.208272 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-178b8015-ad1c-4716-87ee-f17fa9bd2e38 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:35:29.209002 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-178b8015-ad1c-4716-87ee-f17fa9bd2e38 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: b495cce1-15f0-405d-a72a-a36b8aa51033] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:35:29.215433 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-178b8015-ad1c-4716-87ee-f17fa9bd2e38 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:35:29.215949 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-178b8015-ad1c-4716-87ee-f17fa9bd2e38 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:35:29.216411 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-178b8015-ad1c-4716-87ee-f17fa9bd2e38 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:35:29.217338 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-178b8015-ad1c-4716-87ee-f17fa9bd2e38 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:35:29.217843 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-178b8015-ad1c-4716-87ee-f17fa9bd2e38 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:35:29.220501 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-178b8015-ad1c-4716-87ee-f17fa9bd2e38 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:35:29.418658 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-178b8015-ad1c-4716-87ee-f17fa9bd2e38 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:35:29.427064 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-178b8015-ad1c-4716-87ee-f17fa9bd2e38 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/b495cce1-15f0-405d-a72a-a36b8aa51033" status: 200 len: 1686 microversion: 2.1 time: 0.223547 Oct 19 04:35:29.427903 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4268/8059] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:35:29 2022] GET /compute/v2.1/servers/b495cce1-15f0-405d-a72a-a36b8aa51033 => generated 1686 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:35:30.451920 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b23871b8-e110-4388-be16-746f6af281c7 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:35:30.452657 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b23871b8-e110-4388-be16-746f6af281c7 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: b495cce1-15f0-405d-a72a-a36b8aa51033] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:35:30.460193 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b23871b8-e110-4388-be16-746f6af281c7 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:35:30.460686 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b23871b8-e110-4388-be16-746f6af281c7 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:35:30.461135 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b23871b8-e110-4388-be16-746f6af281c7 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:35:30.461866 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b23871b8-e110-4388-be16-746f6af281c7 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:35:30.462332 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b23871b8-e110-4388-be16-746f6af281c7 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:35:30.462766 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b23871b8-e110-4388-be16-746f6af281c7 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:35:30.595896 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b23871b8-e110-4388-be16-746f6af281c7 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:35:30.603722 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b23871b8-e110-4388-be16-746f6af281c7 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/b495cce1-15f0-405d-a72a-a36b8aa51033" status: 200 len: 1686 microversion: 2.1 time: 0.156212 Oct 19 04:35:30.604294 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3792/8060] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:35:30 2022] GET /compute/v2.1/servers/b495cce1-15f0-405d-a72a-a36b8aa51033 => generated 1686 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:35:31.553390 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-d19f96ba-c338-4301-9e90-29d290d127a2 req-c19b42bd-d1e7-457a-8fea-5a1937b1fc77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b495cce1-15f0-405d-a72a-a36b8aa51033", "name": "network-vif-deleted", "tag": "feb79a55-ef70-428c-8a98-446d36edc637"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:35:31.563218 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-d19f96ba-c338-4301-9e90-29d290d127a2 req-c19b42bd-d1e7-457a-8fea-5a1937b1fc77 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:35:31.563715 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-d19f96ba-c338-4301-9e90-29d290d127a2 req-c19b42bd-d1e7-457a-8fea-5a1937b1fc77 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:35:31.564161 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-d19f96ba-c338-4301-9e90-29d290d127a2 req-c19b42bd-d1e7-457a-8fea-5a1937b1fc77 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:35:31.576253 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-d19f96ba-c338-4301-9e90-29d290d127a2 req-c19b42bd-d1e7-457a-8fea-5a1937b1fc77 service nova] Creating event network-vif-deleted:feb79a55-ef70-428c-8a98-446d36edc637 for instance b495cce1-15f0-405d-a72a-a36b8aa51033 on n-h2-861333-8 Oct 19 04:35:31.581257 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-d19f96ba-c338-4301-9e90-29d290d127a2 req-c19b42bd-d1e7-457a-8fea-5a1937b1fc77 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032291 Oct 19 04:35:31.581906 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4269/8061] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:35:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:35:31.627742 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1bda39cc-dc9a-4e41-b627-33e4126ff92f tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:35:31.628320 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1bda39cc-dc9a-4e41-b627-33e4126ff92f tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: b495cce1-15f0-405d-a72a-a36b8aa51033] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:35:31.635891 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1bda39cc-dc9a-4e41-b627-33e4126ff92f tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:35:31.636380 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1bda39cc-dc9a-4e41-b627-33e4126ff92f tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:35:31.636825 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1bda39cc-dc9a-4e41-b627-33e4126ff92f tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:35:31.637570 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1bda39cc-dc9a-4e41-b627-33e4126ff92f tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:35:31.638033 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1bda39cc-dc9a-4e41-b627-33e4126ff92f tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:35:31.638472 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1bda39cc-dc9a-4e41-b627-33e4126ff92f tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:35:31.702934 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-1bda39cc-dc9a-4e41-b627-33e4126ff92f tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:35:31.710767 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1bda39cc-dc9a-4e41-b627-33e4126ff92f tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/b495cce1-15f0-405d-a72a-a36b8aa51033" status: 200 len: 1500 microversion: 2.1 time: 0.087131 Oct 19 04:35:31.711347 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3793/8062] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:35:31 2022] GET /compute/v2.1/servers/b495cce1-15f0-405d-a72a-a36b8aa51033 => generated 1500 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:35:32.734024 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1ab3a718-14ae-4cb0-ae97-d2afe4d08137 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:35:32.734740 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1ab3a718-14ae-4cb0-ae97-d2afe4d08137 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: b495cce1-15f0-405d-a72a-a36b8aa51033] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:35:32.741913 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1ab3a718-14ae-4cb0-ae97-d2afe4d08137 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:35:32.744434 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1ab3a718-14ae-4cb0-ae97-d2afe4d08137 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:35:32.744434 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1ab3a718-14ae-4cb0-ae97-d2afe4d08137 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:35:32.744434 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1ab3a718-14ae-4cb0-ae97-d2afe4d08137 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:35:32.744434 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1ab3a718-14ae-4cb0-ae97-d2afe4d08137 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:35:32.744920 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1ab3a718-14ae-4cb0-ae97-d2afe4d08137 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:35:32.758430 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-1ab3a718-14ae-4cb0-ae97-d2afe4d08137 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] HTTP exception thrown: Instance b495cce1-15f0-405d-a72a-a36b8aa51033 could not be found. Oct 19 04:35:32.760101 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1ab3a718-14ae-4cb0-ae97-d2afe4d08137 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Request method failure captured: Oct 19 04:35:32.760101 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/b495cce1-15f0-405d-a72a-a36b8aa51033 HTTP/1.1 Oct 19 04:35:32.760101 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 04:35:32.760101 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 04:35:32.760101 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 04:35:32.760101 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 04:35:32.760101 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 04:35:32.760101 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 04:35:32.760101 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 04:35:32.760101 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 04:35:32.760101 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT35NpThLGkEnkUgxysLlsfJIyjHqx4L2LT0k6tcbhBDHVJc-wSjP3KeYxe20ELM4-EyhMTutgojR4K9EWIX4amldsFPPM0deHzYTPzrRD1C-x1vHinBbpM7CZBL8f9PKcXGCu_hivxaz25FuBZI0OCPMvGiPgwKv7T2jvjsl4ijCBYk Oct 19 04:35:32.760101 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 04:35:32.760101 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 04:35:32.760101 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 04:35:32.760101 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 04:35:32.760101 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 04:35:32.760101 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 04:35:32.760101 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: d31be961273b43ebb4c58e2350042660 Oct 19 04:35:32.760101 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1897523363 Oct 19 04:35:32.760101 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 04:35:32.760101 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 04:35:32.760101 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d31be961273b43ebb4c58e2350042660"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d31be961273b43ebb4c58e2350042660"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d31be961273b43ebb4c58e2350042660"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d31be961273b43ebb4c58e2350042660", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 04:35:32.760101 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1897523363 Oct 19 04:35:32.760101 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: d31be961273b43ebb4c58e2350042660 Oct 19 04:35:32.760101 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1897523363 Oct 19 04:35:32.760101 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-TestNetworkAdvancedServerOps-1897523363-project Oct 19 04:35:32.760101 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 04:35:32.760101 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 04:35:32.760101 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 834b809f82734666a6d2aea092429cbd Oct 19 04:35:32.760101 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1897523363-project Oct 19 04:35:32.760101 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 04:35:32.760101 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance b495cce1-15f0-405d-a72a-a36b8aa51033 could not be found. Oct 19 04:35:32.760101 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': 'b495cce1-15f0-405d-a72a-a36b8aa51033'} Oct 19 04:35:32.760101 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 04:35:32.760101 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:35:32.760101 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 04:35:32.760101 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 04:35:32.760101 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 04:35:32.760101 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 04:35:32.760101 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 04:35:32.760101 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 04:35:32.760101 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 04:35:32.760101 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 04:35:32.760101 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b495cce1-15f0-405d-a72a-a36b8aa51033 could not be found. Oct 19 04:35:32.760101 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:35:32.760101 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:35:32.760101 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:35:32.760101 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:35:32.760101 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:35:32.760101 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:35:32.760101 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 04:35:32.760101 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 04:35:32.760101 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 04:35:32.760101 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 04:35:32.760101 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 04:35:32.760101 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 04:35:32.760101 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 04:35:32.760101 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 04:35:32.760101 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 04:35:32.760101 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 04:35:32.760101 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b495cce1-15f0-405d-a72a-a36b8aa51033 could not be found. Oct 19 04:35:32.760101 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:35:32.760101 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:35:32.764978 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:35:32.764978 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:35:32.764978 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:35:32.764978 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:35:32.764978 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 04:35:32.764978 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 04:35:32.764978 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b495cce1-15f0-405d-a72a-a36b8aa51033 could not be found. Oct 19 04:35:32.764978 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:35:32.764978 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1ab3a718-14ae-4cb0-ae97-d2afe4d08137 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Returning 404 to user: Instance b495cce1-15f0-405d-a72a-a36b8aa51033 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 04:35:32.764978 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1ab3a718-14ae-4cb0-ae97-d2afe4d08137 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/b495cce1-15f0-405d-a72a-a36b8aa51033" status: 404 len: 111 microversion: 2.1 time: 0.031866 Oct 19 04:35:32.764978 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4270/8063] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:35:32 2022] GET /compute/v2.1/servers/b495cce1-15f0-405d-a72a-a36b8aa51033 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 04:35:36.645827 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c23934c5-6051-475f-a67f-a8a6b84aebd1 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '.version_select at 0x7fc130cd3550>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:35:36.728110 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c23934c5-6051-475f-a67f-a8a6b84aebd1 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1155972101" status: 202 len: 0 microversion: 2.1 time: 0.086725 Oct 19 04:35:36.732450 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3794/8064] 10.222.0.52 () {58 vars in 1284 bytes} [Wed Oct 19 04:35:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1155972101 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 04:35:36.758041 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d866f1da-918e-4a5f-a85a-8f1f33b99fa9 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Action: 'create', calling method: .version_select at 0x7fc1280481f0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2048340535", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGmWaf1RhcCzxW6GxEYPgtpuFh0wMe+v0rDtattTW9kC4Eajzr9jZotdfVSZfq2He6gpJ6TOi/o9eTykFU21J5Qe4UB1pJFrkECUevQHx02DrfCWJC6ihbKIWp5OdqPWYw=="}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:35:36.776027 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-d866f1da-918e-4a5f-a85a-8f1f33b99fa9 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Getting quotas for project d31be961273b43ebb4c58e2350042660. Resources: {'key_pairs'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 04:35:36.781184 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-d866f1da-918e-4a5f-a85a-8f1f33b99fa9 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Getting quotas for user 834b809f82734666a6d2aea092429cbd and project d31be961273b43ebb4c58e2350042660. Resources: {'key_pairs'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 04:35:36.863023 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d866f1da-918e-4a5f-a85a-8f1f33b99fa9 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.109570 Oct 19 04:35:36.864162 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4271/8065] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Oct 19 04:35:36 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:35:44.913874 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:35:44.918290 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4e64d1a4-5b35-4cf5-aaed-d288f3238c4e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1980510663", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "networks": [{"uuid": "5835939e-77a6-4d13-a07b-066ef1695359"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2048340535", "security_groups": [{"name": "tempest-secgroup-smoke-1392914463"}]}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:35:45.058842 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.network.neutron [None req-4e64d1a4-5b35-4cf5-aaed-d288f3238c4e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] validate_networks() for [('5835939e-77a6-4d13-a07b-066ef1695359', None, None, None, None, None)] {{(pid=121135) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 04:35:45.528500 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-4e64d1a4-5b35-4cf5-aaed-d288f3238c4e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Flavor limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 04:35:45.528969 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-4e64d1a4-5b35-4cf5-aaed-d288f3238c4e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Image limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 04:35:45.529599 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-4e64d1a4-5b35-4cf5-aaed-d288f3238c4e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Flavor pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 04:35:45.530050 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-4e64d1a4-5b35-4cf5-aaed-d288f3238c4e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Image pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 04:35:45.530471 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-4e64d1a4-5b35-4cf5-aaed-d288f3238c4e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 04:35:45.540208 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4e64d1a4-5b35-4cf5-aaed-d288f3238c4e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:35:45.540698 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4e64d1a4-5b35-4cf5-aaed-d288f3238c4e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:35:45.541140 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4e64d1a4-5b35-4cf5-aaed-d288f3238c4e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:35:45.542020 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4e64d1a4-5b35-4cf5-aaed-d288f3238c4e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:35:45.542425 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4e64d1a4-5b35-4cf5-aaed-d288f3238c4e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:35:45.542916 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4e64d1a4-5b35-4cf5-aaed-d288f3238c4e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:35:45.562415 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-4e64d1a4-5b35-4cf5-aaed-d288f3238c4e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Getting quotas for project d31be961273b43ebb4c58e2350042660. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 04:35:45.568771 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-4e64d1a4-5b35-4cf5-aaed-d288f3238c4e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Getting quotas for user 834b809f82734666a6d2aea092429cbd and project d31be961273b43ebb4c58e2350042660. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 04:35:45.581455 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4e64d1a4-5b35-4cf5-aaed-d288f3238c4e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Going to run 1 instances... {{(pid=121135) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 04:35:45.584332 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4e64d1a4-5b35-4cf5-aaed-d288f3238c4e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: ebe4ae1b-40d6-4159-ac26-f551a269e9a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121135) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 04:35:45.722636 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4e64d1a4-5b35-4cf5-aaed-d288f3238c4e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.810450 Oct 19 04:35:45.723565 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3795/8066] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 04:35:44 2022] POST /compute/v2.1/servers => generated 406 bytes in 812 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 04:35:45.734999 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d0f2d258-6f3f-45c8-8701-bb4e638700e4 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:35:45.736569 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d0f2d258-6f3f-45c8-8701-bb4e638700e4 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: ebe4ae1b-40d6-4159-ac26-f551a269e9a8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:35:45.740527 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=36 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:35:45.803103 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d0f2d258-6f3f-45c8-8701-bb4e638700e4 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:35:45.810965 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d0f2d258-6f3f-45c8-8701-bb4e638700e4 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/ebe4ae1b-40d6-4159-ac26-f551a269e9a8" status: 200 len: 1267 microversion: 2.1 time: 0.079960 Oct 19 04:35:45.811737 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4272/8067] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:35:45 2022] GET /compute/v2.1/servers/ebe4ae1b-40d6-4159-ac26-f551a269e9a8 => generated 1267 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:35:46.836307 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6cfb067e-7a3f-416f-8ba4-ddf837752e87 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:35:46.836971 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6cfb067e-7a3f-416f-8ba4-ddf837752e87 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: ebe4ae1b-40d6-4159-ac26-f551a269e9a8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:35:46.843976 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6cfb067e-7a3f-416f-8ba4-ddf837752e87 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:35:46.844558 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6cfb067e-7a3f-416f-8ba4-ddf837752e87 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:35:46.845306 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6cfb067e-7a3f-416f-8ba4-ddf837752e87 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:35:46.846221 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6cfb067e-7a3f-416f-8ba4-ddf837752e87 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:35:46.846965 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6cfb067e-7a3f-416f-8ba4-ddf837752e87 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:35:46.848297 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6cfb067e-7a3f-416f-8ba4-ddf837752e87 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:35:46.914979 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-6cfb067e-7a3f-416f-8ba4-ddf837752e87 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:35:46.924058 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6cfb067e-7a3f-416f-8ba4-ddf837752e87 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/ebe4ae1b-40d6-4159-ac26-f551a269e9a8" status: 200 len: 1271 microversion: 2.1 time: 0.093219 Oct 19 04:35:46.924852 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3796/8068] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:35:46 2022] GET /compute/v2.1/servers/ebe4ae1b-40d6-4159-ac26-f551a269e9a8 => generated 1271 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:35:47.950674 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5f36d1f2-1067-4b59-97f0-d06e9082dc2d tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:35:47.952360 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5f36d1f2-1067-4b59-97f0-d06e9082dc2d tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: ebe4ae1b-40d6-4159-ac26-f551a269e9a8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:35:47.960395 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5f36d1f2-1067-4b59-97f0-d06e9082dc2d tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:35:47.960902 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5f36d1f2-1067-4b59-97f0-d06e9082dc2d tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:35:47.961351 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5f36d1f2-1067-4b59-97f0-d06e9082dc2d tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:35:47.962233 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5f36d1f2-1067-4b59-97f0-d06e9082dc2d tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:35:47.962708 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5f36d1f2-1067-4b59-97f0-d06e9082dc2d tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:35:47.963152 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5f36d1f2-1067-4b59-97f0-d06e9082dc2d tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:35:48.035189 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5f36d1f2-1067-4b59-97f0-d06e9082dc2d tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:35:48.044922 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5f36d1f2-1067-4b59-97f0-d06e9082dc2d tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/ebe4ae1b-40d6-4159-ac26-f551a269e9a8" status: 200 len: 1327 microversion: 2.1 time: 0.098145 Oct 19 04:35:48.047728 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4273/8069] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:35:47 2022] GET /compute/v2.1/servers/ebe4ae1b-40d6-4159-ac26-f551a269e9a8 => generated 1327 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:35:49.072792 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d25c014d-8533-41f6-af1f-792df0e9bd0f tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:35:49.073398 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d25c014d-8533-41f6-af1f-792df0e9bd0f tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: ebe4ae1b-40d6-4159-ac26-f551a269e9a8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:35:49.080259 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d25c014d-8533-41f6-af1f-792df0e9bd0f tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:35:49.080749 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d25c014d-8533-41f6-af1f-792df0e9bd0f tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:35:49.081642 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d25c014d-8533-41f6-af1f-792df0e9bd0f tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:35:49.082566 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d25c014d-8533-41f6-af1f-792df0e9bd0f tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:35:49.083717 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d25c014d-8533-41f6-af1f-792df0e9bd0f tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:35:49.083717 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d25c014d-8533-41f6-af1f-792df0e9bd0f tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:35:49.228660 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d25c014d-8533-41f6-af1f-792df0e9bd0f tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:35:49.237266 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d25c014d-8533-41f6-af1f-792df0e9bd0f tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/ebe4ae1b-40d6-4159-ac26-f551a269e9a8" status: 200 len: 1393 microversion: 2.1 time: 0.168479 Oct 19 04:35:49.238028 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3797/8070] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:35:49 2022] GET /compute/v2.1/servers/ebe4ae1b-40d6-4159-ac26-f551a269e9a8 => generated 1393 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:35:49.942015 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-5c8d02ba-444d-4cde-8a04-94540c08c114 req-5896e4d1-7303-4a6f-857e-364d583b9470 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebe4ae1b-40d6-4159-ac26-f551a269e9a8", "tag": "35969517-6bf4-4947-b47d-ad955aa29e81"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:35:49.952409 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-5c8d02ba-444d-4cde-8a04-94540c08c114 req-5896e4d1-7303-4a6f-857e-364d583b9470 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:35:49.952918 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-5c8d02ba-444d-4cde-8a04-94540c08c114 req-5896e4d1-7303-4a6f-857e-364d583b9470 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:35:49.953452 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-5c8d02ba-444d-4cde-8a04-94540c08c114 req-5896e4d1-7303-4a6f-857e-364d583b9470 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:35:49.964518 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-5c8d02ba-444d-4cde-8a04-94540c08c114 req-5896e4d1-7303-4a6f-857e-364d583b9470 service nova] Creating event network-changed:35969517-6bf4-4947-b47d-ad955aa29e81 for instance ebe4ae1b-40d6-4159-ac26-f551a269e9a8 on n-h1-861333-8 Oct 19 04:35:49.969576 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-5c8d02ba-444d-4cde-8a04-94540c08c114 req-5896e4d1-7303-4a6f-857e-364d583b9470 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031667 Oct 19 04:35:49.970339 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4274/8071] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:35:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:35:50.264285 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5ae0c9eb-3324-4c0e-b42b-62eb4b836aff tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:35:50.264905 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-5ae0c9eb-3324-4c0e-b42b-62eb4b836aff tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: ebe4ae1b-40d6-4159-ac26-f551a269e9a8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:35:50.273724 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5ae0c9eb-3324-4c0e-b42b-62eb4b836aff tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:35:50.274236 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5ae0c9eb-3324-4c0e-b42b-62eb4b836aff tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:35:50.274689 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5ae0c9eb-3324-4c0e-b42b-62eb4b836aff tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:35:50.275434 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5ae0c9eb-3324-4c0e-b42b-62eb4b836aff tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:35:50.275905 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5ae0c9eb-3324-4c0e-b42b-62eb4b836aff tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:35:50.276344 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5ae0c9eb-3324-4c0e-b42b-62eb4b836aff tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:35:50.413407 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-5ae0c9eb-3324-4c0e-b42b-62eb4b836aff tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:35:50.421179 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5ae0c9eb-3324-4c0e-b42b-62eb4b836aff tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/ebe4ae1b-40d6-4159-ac26-f551a269e9a8" status: 200 len: 1393 microversion: 2.1 time: 0.161021 Oct 19 04:35:50.421789 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3798/8072] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:35:50 2022] GET /compute/v2.1/servers/ebe4ae1b-40d6-4159-ac26-f551a269e9a8 => generated 1393 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:35:51.445397 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7b27f26a-fdc5-44b7-ba0f-3f954bccf574 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:35:51.446119 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7b27f26a-fdc5-44b7-ba0f-3f954bccf574 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: ebe4ae1b-40d6-4159-ac26-f551a269e9a8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:35:51.452343 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7b27f26a-fdc5-44b7-ba0f-3f954bccf574 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:35:51.452885 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7b27f26a-fdc5-44b7-ba0f-3f954bccf574 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:35:51.453332 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7b27f26a-fdc5-44b7-ba0f-3f954bccf574 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:35:51.454064 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7b27f26a-fdc5-44b7-ba0f-3f954bccf574 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:35:51.454533 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7b27f26a-fdc5-44b7-ba0f-3f954bccf574 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:35:51.454977 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7b27f26a-fdc5-44b7-ba0f-3f954bccf574 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:35:51.842435 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-7b27f26a-fdc5-44b7-ba0f-3f954bccf574 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:35:51.850100 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7b27f26a-fdc5-44b7-ba0f-3f954bccf574 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/ebe4ae1b-40d6-4159-ac26-f551a269e9a8" status: 200 len: 1393 microversion: 2.1 time: 0.410339 Oct 19 04:35:51.850677 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4275/8073] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:35:51 2022] GET /compute/v2.1/servers/ebe4ae1b-40d6-4159-ac26-f551a269e9a8 => generated 1393 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:35:52.873492 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-da8b369a-2de3-4b17-9408-e67ea9268ea8 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:35:52.874038 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-da8b369a-2de3-4b17-9408-e67ea9268ea8 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: ebe4ae1b-40d6-4159-ac26-f551a269e9a8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:35:52.881630 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-da8b369a-2de3-4b17-9408-e67ea9268ea8 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:35:52.882123 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-da8b369a-2de3-4b17-9408-e67ea9268ea8 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:35:52.882568 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-da8b369a-2de3-4b17-9408-e67ea9268ea8 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:35:52.883273 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-da8b369a-2de3-4b17-9408-e67ea9268ea8 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:35:52.883729 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-da8b369a-2de3-4b17-9408-e67ea9268ea8 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:35:52.884155 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-da8b369a-2de3-4b17-9408-e67ea9268ea8 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:35:53.014837 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-da8b369a-2de3-4b17-9408-e67ea9268ea8 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:35:53.023163 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-da8b369a-2de3-4b17-9408-e67ea9268ea8 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/ebe4ae1b-40d6-4159-ac26-f551a269e9a8" status: 200 len: 1393 microversion: 2.1 time: 0.153678 Oct 19 04:35:53.023748 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3799/8074] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:35:52 2022] GET /compute/v2.1/servers/ebe4ae1b-40d6-4159-ac26-f551a269e9a8 => generated 1393 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:35:54.046403 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5b1c8aac-98f0-46dd-a828-9207baa3fed9 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:35:54.046979 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5b1c8aac-98f0-46dd-a828-9207baa3fed9 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: ebe4ae1b-40d6-4159-ac26-f551a269e9a8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:35:54.049858 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:35:54.055147 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5b1c8aac-98f0-46dd-a828-9207baa3fed9 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:35:54.055659 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5b1c8aac-98f0-46dd-a828-9207baa3fed9 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:35:54.056119 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5b1c8aac-98f0-46dd-a828-9207baa3fed9 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:35:54.056831 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5b1c8aac-98f0-46dd-a828-9207baa3fed9 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:35:54.057309 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5b1c8aac-98f0-46dd-a828-9207baa3fed9 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:35:54.057785 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5b1c8aac-98f0-46dd-a828-9207baa3fed9 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:35:54.194234 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5b1c8aac-98f0-46dd-a828-9207baa3fed9 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:35:54.201977 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5b1c8aac-98f0-46dd-a828-9207baa3fed9 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/ebe4ae1b-40d6-4159-ac26-f551a269e9a8" status: 200 len: 1393 microversion: 2.1 time: 0.159569 Oct 19 04:35:54.202576 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4276/8075] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:35:54 2022] GET /compute/v2.1/servers/ebe4ae1b-40d6-4159-ac26-f551a269e9a8 => generated 1393 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:35:55.224550 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9b66bb5d-53bb-4655-8f85-b1e5cb738424 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:35:55.225106 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9b66bb5d-53bb-4655-8f85-b1e5cb738424 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: ebe4ae1b-40d6-4159-ac26-f551a269e9a8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:35:55.227791 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:35:55.232513 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9b66bb5d-53bb-4655-8f85-b1e5cb738424 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:35:55.233011 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9b66bb5d-53bb-4655-8f85-b1e5cb738424 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:35:55.233477 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9b66bb5d-53bb-4655-8f85-b1e5cb738424 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:35:55.234188 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9b66bb5d-53bb-4655-8f85-b1e5cb738424 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:35:55.234650 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9b66bb5d-53bb-4655-8f85-b1e5cb738424 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:35:55.235114 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9b66bb5d-53bb-4655-8f85-b1e5cb738424 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:35:55.374996 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-9b66bb5d-53bb-4655-8f85-b1e5cb738424 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:35:55.384068 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9b66bb5d-53bb-4655-8f85-b1e5cb738424 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/ebe4ae1b-40d6-4159-ac26-f551a269e9a8" status: 200 len: 1393 microversion: 2.1 time: 0.163456 Oct 19 04:35:55.384646 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3800/8076] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:35:55 2022] GET /compute/v2.1/servers/ebe4ae1b-40d6-4159-ac26-f551a269e9a8 => generated 1393 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:35:56.408615 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4322a1e9-496f-4b1f-8a3a-2b8ea9e37005 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:35:56.409316 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4322a1e9-496f-4b1f-8a3a-2b8ea9e37005 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: ebe4ae1b-40d6-4159-ac26-f551a269e9a8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:35:56.412681 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=6 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:35:56.417530 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4322a1e9-496f-4b1f-8a3a-2b8ea9e37005 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:35:56.418039 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4322a1e9-496f-4b1f-8a3a-2b8ea9e37005 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:35:56.418497 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4322a1e9-496f-4b1f-8a3a-2b8ea9e37005 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:35:56.419206 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4322a1e9-496f-4b1f-8a3a-2b8ea9e37005 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:35:56.419679 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4322a1e9-496f-4b1f-8a3a-2b8ea9e37005 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:35:56.420138 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4322a1e9-496f-4b1f-8a3a-2b8ea9e37005 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:35:56.561090 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-4322a1e9-496f-4b1f-8a3a-2b8ea9e37005 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:35:56.568650 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4322a1e9-496f-4b1f-8a3a-2b8ea9e37005 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/ebe4ae1b-40d6-4159-ac26-f551a269e9a8" status: 200 len: 1393 microversion: 2.1 time: 0.164223 Oct 19 04:35:56.569219 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4277/8077] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:35:56 2022] GET /compute/v2.1/servers/ebe4ae1b-40d6-4159-ac26-f551a269e9a8 => generated 1393 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:35:57.464177 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-b08e02e8-d423-403b-8897-0e2f17e97ab0 req-25c94e89-0b3f-49d2-9ed4-55d04053150d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebe4ae1b-40d6-4159-ac26-f551a269e9a8", "name": "network-vif-plugged", "status": "completed", "tag": "35969517-6bf4-4947-b47d-ad955aa29e81"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:35:57.469419 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:35:57.470109 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=6 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:35:57.476208 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-b08e02e8-d423-403b-8897-0e2f17e97ab0 req-25c94e89-0b3f-49d2-9ed4-55d04053150d service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:35:57.476640 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-b08e02e8-d423-403b-8897-0e2f17e97ab0 req-25c94e89-0b3f-49d2-9ed4-55d04053150d service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:35:57.477072 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-b08e02e8-d423-403b-8897-0e2f17e97ab0 req-25c94e89-0b3f-49d2-9ed4-55d04053150d service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:35:57.488101 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-b08e02e8-d423-403b-8897-0e2f17e97ab0 req-25c94e89-0b3f-49d2-9ed4-55d04053150d service nova] Creating event network-vif-plugged:35969517-6bf4-4947-b47d-ad955aa29e81 for instance ebe4ae1b-40d6-4159-ac26-f551a269e9a8 on n-h1-861333-8 Oct 19 04:35:57.493076 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-b08e02e8-d423-403b-8897-0e2f17e97ab0 req-25c94e89-0b3f-49d2-9ed4-55d04053150d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032630 Oct 19 04:35:57.493906 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3801/8078] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:35:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:35:57.592199 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6262249f-103e-46c6-af09-1558f8d928eb tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:35:57.592971 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6262249f-103e-46c6-af09-1558f8d928eb tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: ebe4ae1b-40d6-4159-ac26-f551a269e9a8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:35:57.600254 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6262249f-103e-46c6-af09-1558f8d928eb tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:35:57.600772 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6262249f-103e-46c6-af09-1558f8d928eb tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:35:57.601239 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6262249f-103e-46c6-af09-1558f8d928eb tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:35:57.602159 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6262249f-103e-46c6-af09-1558f8d928eb tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:35:57.602647 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6262249f-103e-46c6-af09-1558f8d928eb tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:35:57.603094 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6262249f-103e-46c6-af09-1558f8d928eb tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:35:57.735071 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-6262249f-103e-46c6-af09-1558f8d928eb tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:35:57.742978 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6262249f-103e-46c6-af09-1558f8d928eb tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/ebe4ae1b-40d6-4159-ac26-f551a269e9a8" status: 200 len: 1393 microversion: 2.1 time: 0.154816 Oct 19 04:35:57.743561 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4278/8079] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:35:57 2022] GET /compute/v2.1/servers/ebe4ae1b-40d6-4159-ac26-f551a269e9a8 => generated 1393 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:35:58.767971 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-83c3c3fe-3e63-4bd2-aedd-98aa7e33b098 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:35:58.768694 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-83c3c3fe-3e63-4bd2-aedd-98aa7e33b098 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: ebe4ae1b-40d6-4159-ac26-f551a269e9a8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:35:58.776161 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-83c3c3fe-3e63-4bd2-aedd-98aa7e33b098 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:35:58.776642 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-83c3c3fe-3e63-4bd2-aedd-98aa7e33b098 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:35:58.777081 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-83c3c3fe-3e63-4bd2-aedd-98aa7e33b098 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:35:58.777788 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-83c3c3fe-3e63-4bd2-aedd-98aa7e33b098 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:35:58.778238 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-83c3c3fe-3e63-4bd2-aedd-98aa7e33b098 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:35:58.778660 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-83c3c3fe-3e63-4bd2-aedd-98aa7e33b098 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:35:58.909599 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-83c3c3fe-3e63-4bd2-aedd-98aa7e33b098 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:35:58.917358 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-83c3c3fe-3e63-4bd2-aedd-98aa7e33b098 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/ebe4ae1b-40d6-4159-ac26-f551a269e9a8" status: 200 len: 1393 microversion: 2.1 time: 0.154819 Oct 19 04:35:58.917953 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3802/8080] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:35:58 2022] GET /compute/v2.1/servers/ebe4ae1b-40d6-4159-ac26-f551a269e9a8 => generated 1393 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:35:59.940501 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6697b4e2-9820-47e6-b7a7-5f74957cdec3 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:35:59.941921 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6697b4e2-9820-47e6-b7a7-5f74957cdec3 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: ebe4ae1b-40d6-4159-ac26-f551a269e9a8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:35:59.948104 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6697b4e2-9820-47e6-b7a7-5f74957cdec3 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:35:59.948605 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6697b4e2-9820-47e6-b7a7-5f74957cdec3 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:35:59.949056 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6697b4e2-9820-47e6-b7a7-5f74957cdec3 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:35:59.949780 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6697b4e2-9820-47e6-b7a7-5f74957cdec3 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:35:59.950247 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6697b4e2-9820-47e6-b7a7-5f74957cdec3 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:35:59.951739 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6697b4e2-9820-47e6-b7a7-5f74957cdec3 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:36:00.086838 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-6697b4e2-9820-47e6-b7a7-5f74957cdec3 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:36:00.094566 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6697b4e2-9820-47e6-b7a7-5f74957cdec3 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/ebe4ae1b-40d6-4159-ac26-f551a269e9a8" status: 200 len: 1565 microversion: 2.1 time: 0.158291 Oct 19 04:36:00.095136 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4279/8081] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:35:59 2022] GET /compute/v2.1/servers/ebe4ae1b-40d6-4159-ac26-f551a269e9a8 => generated 1565 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:36:00.117139 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-26d60e10-7039-4d7b-8ecb-6311ebfb048b tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:36:00.117792 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-26d60e10-7039-4d7b-8ecb-6311ebfb048b tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: ebe4ae1b-40d6-4159-ac26-f551a269e9a8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:36:00.124572 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-26d60e10-7039-4d7b-8ecb-6311ebfb048b tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:36:00.125065 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-26d60e10-7039-4d7b-8ecb-6311ebfb048b tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:36:00.125575 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-26d60e10-7039-4d7b-8ecb-6311ebfb048b tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:36:00.126274 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-26d60e10-7039-4d7b-8ecb-6311ebfb048b tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:36:00.126736 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-26d60e10-7039-4d7b-8ecb-6311ebfb048b tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:36:00.127173 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-26d60e10-7039-4d7b-8ecb-6311ebfb048b tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:36:00.256512 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-26d60e10-7039-4d7b-8ecb-6311ebfb048b tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:36:00.264318 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-26d60e10-7039-4d7b-8ecb-6311ebfb048b tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/ebe4ae1b-40d6-4159-ac26-f551a269e9a8" status: 200 len: 1565 microversion: 2.1 time: 0.151696 Oct 19 04:36:00.264890 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3803/8082] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:36:00 2022] GET /compute/v2.1/servers/ebe4ae1b-40d6-4159-ac26-f551a269e9a8 => generated 1565 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:36:02.166736 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-f74dca60-67e3-452d-9475-d47b31e567e0 req-2331be1c-d4d8-4dc5-b593-b49d6da06040 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebe4ae1b-40d6-4159-ac26-f551a269e9a8", "tag": "35969517-6bf4-4947-b47d-ad955aa29e81"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:36:02.176297 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9306b4de-272d-4a73-b34e-d1f64a78b33f tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:36:02.176930 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9306b4de-272d-4a73-b34e-d1f64a78b33f tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: ebe4ae1b-40d6-4159-ac26-f551a269e9a8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:36:02.184346 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-f74dca60-67e3-452d-9475-d47b31e567e0 req-2331be1c-d4d8-4dc5-b593-b49d6da06040 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:36:02.184732 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9306b4de-272d-4a73-b34e-d1f64a78b33f tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:36:02.184869 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-f74dca60-67e3-452d-9475-d47b31e567e0 req-2331be1c-d4d8-4dc5-b593-b49d6da06040 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:36:02.185271 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-f74dca60-67e3-452d-9475-d47b31e567e0 req-2331be1c-d4d8-4dc5-b593-b49d6da06040 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:36:02.185500 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9306b4de-272d-4a73-b34e-d1f64a78b33f tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:36:02.186083 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9306b4de-272d-4a73-b34e-d1f64a78b33f tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:36:02.186953 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9306b4de-272d-4a73-b34e-d1f64a78b33f tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:36:02.187676 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9306b4de-272d-4a73-b34e-d1f64a78b33f tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:36:02.188188 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9306b4de-272d-4a73-b34e-d1f64a78b33f tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:36:02.197800 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-f74dca60-67e3-452d-9475-d47b31e567e0 req-2331be1c-d4d8-4dc5-b593-b49d6da06040 service nova] Creating event network-changed:35969517-6bf4-4947-b47d-ad955aa29e81 for instance ebe4ae1b-40d6-4159-ac26-f551a269e9a8 on n-h1-861333-8 Oct 19 04:36:02.203172 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-f74dca60-67e3-452d-9475-d47b31e567e0 req-2331be1c-d4d8-4dc5-b593-b49d6da06040 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040082 Oct 19 04:36:02.206221 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3804/8083] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:36:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:36:02.334873 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9306b4de-272d-4a73-b34e-d1f64a78b33f tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:36:02.343006 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9306b4de-272d-4a73-b34e-d1f64a78b33f tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/ebe4ae1b-40d6-4159-ac26-f551a269e9a8" status: 200 len: 1565 microversion: 2.1 time: 0.183208 Oct 19 04:36:02.344068 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4280/8084] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:36:02 2022] GET /compute/v2.1/servers/ebe4ae1b-40d6-4159-ac26-f551a269e9a8 => generated 1565 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:36:35.646592 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=9 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:36:35.647354 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=48 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:36:35.651632 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-508004b8-ae0e-4c14-87ba-de26cd42f9a7 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:36:35.653865 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-508004b8-ae0e-4c14-87ba-de26cd42f9a7 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: ebe4ae1b-40d6-4159-ac26-f551a269e9a8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:36:35.660223 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-508004b8-ae0e-4c14-87ba-de26cd42f9a7 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:36:35.660715 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-508004b8-ae0e-4c14-87ba-de26cd42f9a7 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:36:35.661161 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-508004b8-ae0e-4c14-87ba-de26cd42f9a7 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:36:35.661885 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-508004b8-ae0e-4c14-87ba-de26cd42f9a7 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:36:35.662349 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-508004b8-ae0e-4c14-87ba-de26cd42f9a7 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:36:35.662779 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-508004b8-ae0e-4c14-87ba-de26cd42f9a7 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:36:35.735019 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-508004b8-ae0e-4c14-87ba-de26cd42f9a7 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "POST /compute/v2.1/servers/ebe4ae1b-40d6-4159-ac26-f551a269e9a8/action" status: 200 len: 24562 microversion: 2.1 time: 0.090477 Oct 19 04:36:35.735674 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3805/8085] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 04:36:35 2022] POST /compute/v2.1/servers/ebe4ae1b-40d6-4159-ac26-f551a269e9a8/action => generated 24562 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 04:37:14.830789 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=9 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:37:14.831558 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=44 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:37:14.835559 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8ea6fb5a-71a7-4c25-91d6-23d37b380c64 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:37:14.837837 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8ea6fb5a-71a7-4c25-91d6-23d37b380c64 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: ebe4ae1b-40d6-4159-ac26-f551a269e9a8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:37:14.843694 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8ea6fb5a-71a7-4c25-91d6-23d37b380c64 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:37:14.849252 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8ea6fb5a-71a7-4c25-91d6-23d37b380c64 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:37:14.849252 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8ea6fb5a-71a7-4c25-91d6-23d37b380c64 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:37:14.849252 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8ea6fb5a-71a7-4c25-91d6-23d37b380c64 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:37:14.849252 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8ea6fb5a-71a7-4c25-91d6-23d37b380c64 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:37:14.849252 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8ea6fb5a-71a7-4c25-91d6-23d37b380c64 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:37:15.091640 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8ea6fb5a-71a7-4c25-91d6-23d37b380c64 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "POST /compute/v2.1/servers/ebe4ae1b-40d6-4159-ac26-f551a269e9a8/action" status: 202 len: 0 microversion: 2.1 time: 0.262998 Oct 19 04:37:15.092195 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4281/8086] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 04:37:14 2022] POST /compute/v2.1/servers/ebe4ae1b-40d6-4159-ac26-f551a269e9a8/action => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 04:37:15.102486 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1ff7af8c-3867-4185-add0-1fa9b9c48b25 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:37:15.103208 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1ff7af8c-3867-4185-add0-1fa9b9c48b25 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: ebe4ae1b-40d6-4159-ac26-f551a269e9a8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:37:15.105878 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:37:15.106532 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=4 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:37:15.112183 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1ff7af8c-3867-4185-add0-1fa9b9c48b25 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:37:15.112781 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1ff7af8c-3867-4185-add0-1fa9b9c48b25 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:37:15.113238 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1ff7af8c-3867-4185-add0-1fa9b9c48b25 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:37:15.113973 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1ff7af8c-3867-4185-add0-1fa9b9c48b25 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:37:15.114442 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1ff7af8c-3867-4185-add0-1fa9b9c48b25 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:37:15.114878 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1ff7af8c-3867-4185-add0-1fa9b9c48b25 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:37:15.254679 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-1ff7af8c-3867-4185-add0-1fa9b9c48b25 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:37:15.262864 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1ff7af8c-3867-4185-add0-1fa9b9c48b25 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/ebe4ae1b-40d6-4159-ac26-f551a269e9a8" status: 200 len: 1676 microversion: 2.1 time: 0.165336 Oct 19 04:37:15.278078 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3806/8087] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:37:15 2022] GET /compute/v2.1/servers/ebe4ae1b-40d6-4159-ac26-f551a269e9a8 => generated 1676 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:37:16.288470 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2f9d78f1-ac68-4976-9e69-6f4bf0a833ad tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:37:16.289230 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2f9d78f1-ac68-4976-9e69-6f4bf0a833ad tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: ebe4ae1b-40d6-4159-ac26-f551a269e9a8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:37:16.295493 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2f9d78f1-ac68-4976-9e69-6f4bf0a833ad tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:37:16.296016 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2f9d78f1-ac68-4976-9e69-6f4bf0a833ad tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:37:16.296506 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2f9d78f1-ac68-4976-9e69-6f4bf0a833ad tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:37:16.297214 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2f9d78f1-ac68-4976-9e69-6f4bf0a833ad tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:37:16.297726 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2f9d78f1-ac68-4976-9e69-6f4bf0a833ad tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:37:16.298172 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2f9d78f1-ac68-4976-9e69-6f4bf0a833ad tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:37:16.432819 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-2f9d78f1-ac68-4976-9e69-6f4bf0a833ad tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:37:16.441527 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2f9d78f1-ac68-4976-9e69-6f4bf0a833ad tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/ebe4ae1b-40d6-4159-ac26-f551a269e9a8" status: 200 len: 1681 microversion: 2.1 time: 0.158563 Oct 19 04:37:16.442130 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4282/8088] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:37:16 2022] GET /compute/v2.1/servers/ebe4ae1b-40d6-4159-ac26-f551a269e9a8 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:37:17.465339 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4e309a51-66af-4ff8-9b87-357aa49fbe6e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:37:17.465989 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4e309a51-66af-4ff8-9b87-357aa49fbe6e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: ebe4ae1b-40d6-4159-ac26-f551a269e9a8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:37:17.473939 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4e309a51-66af-4ff8-9b87-357aa49fbe6e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:37:17.474430 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4e309a51-66af-4ff8-9b87-357aa49fbe6e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:37:17.474876 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4e309a51-66af-4ff8-9b87-357aa49fbe6e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:37:17.475577 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4e309a51-66af-4ff8-9b87-357aa49fbe6e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:37:17.476037 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4e309a51-66af-4ff8-9b87-357aa49fbe6e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:37:17.476468 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4e309a51-66af-4ff8-9b87-357aa49fbe6e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:37:17.608795 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4e309a51-66af-4ff8-9b87-357aa49fbe6e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:37:17.616621 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4e309a51-66af-4ff8-9b87-357aa49fbe6e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/ebe4ae1b-40d6-4159-ac26-f551a269e9a8" status: 200 len: 1681 microversion: 2.1 time: 0.155219 Oct 19 04:37:17.617199 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3807/8089] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:37:17 2022] GET /compute/v2.1/servers/ebe4ae1b-40d6-4159-ac26-f551a269e9a8 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:37:18.640208 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-22b90a55-c75d-467b-90a3-96a4a65a1198 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:37:18.640836 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-22b90a55-c75d-467b-90a3-96a4a65a1198 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: ebe4ae1b-40d6-4159-ac26-f551a269e9a8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:37:18.648479 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-22b90a55-c75d-467b-90a3-96a4a65a1198 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:37:18.649071 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-22b90a55-c75d-467b-90a3-96a4a65a1198 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:37:18.649502 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-22b90a55-c75d-467b-90a3-96a4a65a1198 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:37:18.650212 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-22b90a55-c75d-467b-90a3-96a4a65a1198 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:37:18.650682 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-22b90a55-c75d-467b-90a3-96a4a65a1198 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:37:18.651128 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-22b90a55-c75d-467b-90a3-96a4a65a1198 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:37:18.781471 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-22b90a55-c75d-467b-90a3-96a4a65a1198 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:37:18.789600 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-22b90a55-c75d-467b-90a3-96a4a65a1198 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/ebe4ae1b-40d6-4159-ac26-f551a269e9a8" status: 200 len: 1681 microversion: 2.1 time: 0.153302 Oct 19 04:37:18.790169 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4283/8090] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:37:18 2022] GET /compute/v2.1/servers/ebe4ae1b-40d6-4159-ac26-f551a269e9a8 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:37:19.814269 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-8c9f0a9b-92fc-42ce-918d-fb9060dbaa72 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:37:19.814902 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-8c9f0a9b-92fc-42ce-918d-fb9060dbaa72 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: ebe4ae1b-40d6-4159-ac26-f551a269e9a8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:37:19.821955 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8c9f0a9b-92fc-42ce-918d-fb9060dbaa72 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:37:19.822453 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8c9f0a9b-92fc-42ce-918d-fb9060dbaa72 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:37:19.822902 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8c9f0a9b-92fc-42ce-918d-fb9060dbaa72 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:37:19.823730 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8c9f0a9b-92fc-42ce-918d-fb9060dbaa72 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:37:19.824195 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8c9f0a9b-92fc-42ce-918d-fb9060dbaa72 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:37:19.824633 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8c9f0a9b-92fc-42ce-918d-fb9060dbaa72 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:37:19.961536 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-8c9f0a9b-92fc-42ce-918d-fb9060dbaa72 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:37:19.969453 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-8c9f0a9b-92fc-42ce-918d-fb9060dbaa72 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/ebe4ae1b-40d6-4159-ac26-f551a269e9a8" status: 200 len: 1681 microversion: 2.1 time: 0.160126 Oct 19 04:37:19.970029 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3808/8091] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:37:19 2022] GET /compute/v2.1/servers/ebe4ae1b-40d6-4159-ac26-f551a269e9a8 => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:37:20.992515 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-766ec642-6ebe-4cf5-9e06-c539ee928b80 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:37:20.993123 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-766ec642-6ebe-4cf5-9e06-c539ee928b80 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: ebe4ae1b-40d6-4159-ac26-f551a269e9a8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:37:21.000160 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-766ec642-6ebe-4cf5-9e06-c539ee928b80 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:37:21.000698 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-766ec642-6ebe-4cf5-9e06-c539ee928b80 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:37:21.001148 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-766ec642-6ebe-4cf5-9e06-c539ee928b80 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:37:21.001881 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-766ec642-6ebe-4cf5-9e06-c539ee928b80 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:37:21.002349 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-766ec642-6ebe-4cf5-9e06-c539ee928b80 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:37:21.002796 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-766ec642-6ebe-4cf5-9e06-c539ee928b80 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:37:21.137432 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-766ec642-6ebe-4cf5-9e06-c539ee928b80 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:37:21.145900 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-766ec642-6ebe-4cf5-9e06-c539ee928b80 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/ebe4ae1b-40d6-4159-ac26-f551a269e9a8" status: 200 len: 1681 microversion: 2.1 time: 0.157536 Oct 19 04:37:21.146473 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4284/8092] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:37:20 2022] GET /compute/v2.1/servers/ebe4ae1b-40d6-4159-ac26-f551a269e9a8 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:37:22.170102 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-219483d2-71dd-41aa-86ac-b9ef8820963b tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:37:22.170735 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-219483d2-71dd-41aa-86ac-b9ef8820963b tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: ebe4ae1b-40d6-4159-ac26-f551a269e9a8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:37:22.177573 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-219483d2-71dd-41aa-86ac-b9ef8820963b tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:37:22.178063 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-219483d2-71dd-41aa-86ac-b9ef8820963b tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:37:22.178508 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-219483d2-71dd-41aa-86ac-b9ef8820963b tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:37:22.179203 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-219483d2-71dd-41aa-86ac-b9ef8820963b tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:37:22.179661 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-219483d2-71dd-41aa-86ac-b9ef8820963b tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:37:22.180092 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-219483d2-71dd-41aa-86ac-b9ef8820963b tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:37:22.311305 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-219483d2-71dd-41aa-86ac-b9ef8820963b tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:37:22.319617 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-219483d2-71dd-41aa-86ac-b9ef8820963b tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/ebe4ae1b-40d6-4159-ac26-f551a269e9a8" status: 200 len: 1681 microversion: 2.1 time: 0.153420 Oct 19 04:37:22.320194 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3809/8093] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:37:22 2022] GET /compute/v2.1/servers/ebe4ae1b-40d6-4159-ac26-f551a269e9a8 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:37:23.343741 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1606f9c3-654c-4095-b101-56c00f99a844 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:37:23.344441 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1606f9c3-654c-4095-b101-56c00f99a844 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: ebe4ae1b-40d6-4159-ac26-f551a269e9a8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:37:23.351334 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1606f9c3-654c-4095-b101-56c00f99a844 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:37:23.351840 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1606f9c3-654c-4095-b101-56c00f99a844 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:37:23.352295 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1606f9c3-654c-4095-b101-56c00f99a844 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:37:23.353001 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1606f9c3-654c-4095-b101-56c00f99a844 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:37:23.353508 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1606f9c3-654c-4095-b101-56c00f99a844 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:37:23.353958 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1606f9c3-654c-4095-b101-56c00f99a844 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:37:23.487537 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-1606f9c3-654c-4095-b101-56c00f99a844 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:37:23.495289 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1606f9c3-654c-4095-b101-56c00f99a844 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/ebe4ae1b-40d6-4159-ac26-f551a269e9a8" status: 200 len: 1681 microversion: 2.1 time: 0.155436 Oct 19 04:37:23.495868 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4285/8094] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:37:23 2022] GET /compute/v2.1/servers/ebe4ae1b-40d6-4159-ac26-f551a269e9a8 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:37:24.519555 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7fe6d0bf-ab39-4c83-ad3f-68793388d023 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:37:24.520183 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7fe6d0bf-ab39-4c83-ad3f-68793388d023 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: ebe4ae1b-40d6-4159-ac26-f551a269e9a8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:37:24.527214 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7fe6d0bf-ab39-4c83-ad3f-68793388d023 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:37:24.527697 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7fe6d0bf-ab39-4c83-ad3f-68793388d023 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:37:24.528144 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7fe6d0bf-ab39-4c83-ad3f-68793388d023 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:37:24.528841 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7fe6d0bf-ab39-4c83-ad3f-68793388d023 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:37:24.529318 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7fe6d0bf-ab39-4c83-ad3f-68793388d023 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:37:24.529838 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7fe6d0bf-ab39-4c83-ad3f-68793388d023 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:37:24.659916 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7fe6d0bf-ab39-4c83-ad3f-68793388d023 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:37:24.667715 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7fe6d0bf-ab39-4c83-ad3f-68793388d023 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/ebe4ae1b-40d6-4159-ac26-f551a269e9a8" status: 200 len: 1681 microversion: 2.1 time: 0.152676 Oct 19 04:37:24.668291 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3810/8095] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:37:24 2022] GET /compute/v2.1/servers/ebe4ae1b-40d6-4159-ac26-f551a269e9a8 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:37:25.691357 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2f007850-feb9-4f9b-8e82-8f1c59af5830 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:37:25.692013 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2f007850-feb9-4f9b-8e82-8f1c59af5830 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: ebe4ae1b-40d6-4159-ac26-f551a269e9a8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:37:25.698899 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2f007850-feb9-4f9b-8e82-8f1c59af5830 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:37:25.699396 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2f007850-feb9-4f9b-8e82-8f1c59af5830 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:37:25.699847 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2f007850-feb9-4f9b-8e82-8f1c59af5830 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:37:25.700546 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2f007850-feb9-4f9b-8e82-8f1c59af5830 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:37:25.701009 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2f007850-feb9-4f9b-8e82-8f1c59af5830 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:37:25.701485 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2f007850-feb9-4f9b-8e82-8f1c59af5830 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:37:25.837565 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-2f007850-feb9-4f9b-8e82-8f1c59af5830 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:37:25.845565 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2f007850-feb9-4f9b-8e82-8f1c59af5830 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/ebe4ae1b-40d6-4159-ac26-f551a269e9a8" status: 200 len: 1681 microversion: 2.1 time: 0.158090 Oct 19 04:37:25.846134 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4286/8096] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:37:25 2022] GET /compute/v2.1/servers/ebe4ae1b-40d6-4159-ac26-f551a269e9a8 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:37:26.868300 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-17f5a90a-8e25-44ff-be4e-5ddfd11d78f6 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:37:26.868926 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-17f5a90a-8e25-44ff-be4e-5ddfd11d78f6 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: ebe4ae1b-40d6-4159-ac26-f551a269e9a8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:37:26.876765 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-17f5a90a-8e25-44ff-be4e-5ddfd11d78f6 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:37:26.877247 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-17f5a90a-8e25-44ff-be4e-5ddfd11d78f6 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:37:26.877708 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-17f5a90a-8e25-44ff-be4e-5ddfd11d78f6 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:37:26.878399 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-17f5a90a-8e25-44ff-be4e-5ddfd11d78f6 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:37:26.878849 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-17f5a90a-8e25-44ff-be4e-5ddfd11d78f6 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:37:26.879273 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-17f5a90a-8e25-44ff-be4e-5ddfd11d78f6 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:37:27.074120 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-17f5a90a-8e25-44ff-be4e-5ddfd11d78f6 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:37:27.083147 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-17f5a90a-8e25-44ff-be4e-5ddfd11d78f6 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/ebe4ae1b-40d6-4159-ac26-f551a269e9a8" status: 200 len: 1681 microversion: 2.1 time: 0.217717 Oct 19 04:37:27.083147 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3811/8097] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:37:26 2022] GET /compute/v2.1/servers/ebe4ae1b-40d6-4159-ac26-f551a269e9a8 => generated 1681 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:37:28.105463 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-08790afa-f173-4a97-aa55-0d918ea84384 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:37:28.106085 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-08790afa-f173-4a97-aa55-0d918ea84384 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: ebe4ae1b-40d6-4159-ac26-f551a269e9a8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:37:28.113827 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-08790afa-f173-4a97-aa55-0d918ea84384 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:37:28.114383 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-08790afa-f173-4a97-aa55-0d918ea84384 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:37:28.114791 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-08790afa-f173-4a97-aa55-0d918ea84384 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:37:28.115524 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-08790afa-f173-4a97-aa55-0d918ea84384 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:37:28.115990 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-08790afa-f173-4a97-aa55-0d918ea84384 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:37:28.116449 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-08790afa-f173-4a97-aa55-0d918ea84384 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:37:28.252937 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-08790afa-f173-4a97-aa55-0d918ea84384 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:37:28.260753 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-08790afa-f173-4a97-aa55-0d918ea84384 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/ebe4ae1b-40d6-4159-ac26-f551a269e9a8" status: 200 len: 1681 microversion: 2.1 time: 0.159250 Oct 19 04:37:28.261333 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4287/8098] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:37:28 2022] GET /compute/v2.1/servers/ebe4ae1b-40d6-4159-ac26-f551a269e9a8 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:37:29.284566 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e655e310-867d-417f-a613-7083e4b7fe21 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:37:29.285189 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e655e310-867d-417f-a613-7083e4b7fe21 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: ebe4ae1b-40d6-4159-ac26-f551a269e9a8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:37:29.292058 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e655e310-867d-417f-a613-7083e4b7fe21 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:37:29.292558 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e655e310-867d-417f-a613-7083e4b7fe21 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:37:29.293002 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e655e310-867d-417f-a613-7083e4b7fe21 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:37:29.293725 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e655e310-867d-417f-a613-7083e4b7fe21 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:37:29.294190 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e655e310-867d-417f-a613-7083e4b7fe21 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:37:29.294624 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e655e310-867d-417f-a613-7083e4b7fe21 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:37:29.425832 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-e655e310-867d-417f-a613-7083e4b7fe21 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:37:29.433608 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e655e310-867d-417f-a613-7083e4b7fe21 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/ebe4ae1b-40d6-4159-ac26-f551a269e9a8" status: 200 len: 1681 microversion: 2.1 time: 0.153163 Oct 19 04:37:29.434194 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3812/8099] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:37:29 2022] GET /compute/v2.1/servers/ebe4ae1b-40d6-4159-ac26-f551a269e9a8 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:37:30.457683 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b3d29de0-0ba2-46d7-86a2-a9a2e7544265 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:37:30.458318 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b3d29de0-0ba2-46d7-86a2-a9a2e7544265 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: ebe4ae1b-40d6-4159-ac26-f551a269e9a8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:37:30.464384 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b3d29de0-0ba2-46d7-86a2-a9a2e7544265 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:37:30.464893 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b3d29de0-0ba2-46d7-86a2-a9a2e7544265 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:37:30.465350 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b3d29de0-0ba2-46d7-86a2-a9a2e7544265 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:37:30.466077 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b3d29de0-0ba2-46d7-86a2-a9a2e7544265 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:37:30.466548 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b3d29de0-0ba2-46d7-86a2-a9a2e7544265 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:37:30.466991 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b3d29de0-0ba2-46d7-86a2-a9a2e7544265 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:37:30.597899 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b3d29de0-0ba2-46d7-86a2-a9a2e7544265 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:37:30.605643 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b3d29de0-0ba2-46d7-86a2-a9a2e7544265 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/ebe4ae1b-40d6-4159-ac26-f551a269e9a8" status: 200 len: 1681 microversion: 2.1 time: 0.152826 Oct 19 04:37:30.606224 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4288/8100] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:37:30 2022] GET /compute/v2.1/servers/ebe4ae1b-40d6-4159-ac26-f551a269e9a8 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:37:31.629318 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-99619918-32f1-47f7-9107-3bc15b63f004 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:37:31.629969 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-99619918-32f1-47f7-9107-3bc15b63f004 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: ebe4ae1b-40d6-4159-ac26-f551a269e9a8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:37:31.636990 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-99619918-32f1-47f7-9107-3bc15b63f004 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:37:31.637514 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-99619918-32f1-47f7-9107-3bc15b63f004 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:37:31.637962 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-99619918-32f1-47f7-9107-3bc15b63f004 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:37:31.638660 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-99619918-32f1-47f7-9107-3bc15b63f004 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:37:31.639120 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-99619918-32f1-47f7-9107-3bc15b63f004 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:37:31.639555 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-99619918-32f1-47f7-9107-3bc15b63f004 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:37:31.773761 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-99619918-32f1-47f7-9107-3bc15b63f004 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:37:31.781591 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-99619918-32f1-47f7-9107-3bc15b63f004 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/ebe4ae1b-40d6-4159-ac26-f551a269e9a8" status: 200 len: 1681 microversion: 2.1 time: 0.156243 Oct 19 04:37:31.782177 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3813/8101] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:37:31 2022] GET /compute/v2.1/servers/ebe4ae1b-40d6-4159-ac26-f551a269e9a8 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:37:32.806264 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7d3ac5ec-a20f-43b6-89e4-cc99aa456371 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:37:32.806893 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7d3ac5ec-a20f-43b6-89e4-cc99aa456371 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: ebe4ae1b-40d6-4159-ac26-f551a269e9a8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:37:32.813789 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7d3ac5ec-a20f-43b6-89e4-cc99aa456371 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:37:32.814290 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7d3ac5ec-a20f-43b6-89e4-cc99aa456371 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:37:32.814747 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7d3ac5ec-a20f-43b6-89e4-cc99aa456371 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:37:32.815451 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7d3ac5ec-a20f-43b6-89e4-cc99aa456371 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:37:32.815922 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7d3ac5ec-a20f-43b6-89e4-cc99aa456371 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:37:32.816367 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7d3ac5ec-a20f-43b6-89e4-cc99aa456371 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:37:32.944958 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-7d3ac5ec-a20f-43b6-89e4-cc99aa456371 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:37:32.952616 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7d3ac5ec-a20f-43b6-89e4-cc99aa456371 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/ebe4ae1b-40d6-4159-ac26-f551a269e9a8" status: 200 len: 1684 microversion: 2.1 time: 0.150253 Oct 19 04:37:32.953717 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4289/8102] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:37:32 2022] GET /compute/v2.1/servers/ebe4ae1b-40d6-4159-ac26-f551a269e9a8 => generated 1684 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:38:07.176238 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-86dc8b1e-e7c4-4191-ae78-f9d6045f99cb tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:38:07.178769 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-86dc8b1e-e7c4-4191-ae78-f9d6045f99cb tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: ebe4ae1b-40d6-4159-ac26-f551a269e9a8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:38:07.181814 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=16 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:38:07.182071 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=48 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:38:07.186783 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-86dc8b1e-e7c4-4191-ae78-f9d6045f99cb tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:38:07.187401 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-86dc8b1e-e7c4-4191-ae78-f9d6045f99cb tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:38:07.187886 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-86dc8b1e-e7c4-4191-ae78-f9d6045f99cb tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:38:07.188590 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-86dc8b1e-e7c4-4191-ae78-f9d6045f99cb tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:38:07.189596 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-86dc8b1e-e7c4-4191-ae78-f9d6045f99cb tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:38:07.190043 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-86dc8b1e-e7c4-4191-ae78-f9d6045f99cb tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:38:07.265206 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-86dc8b1e-e7c4-4191-ae78-f9d6045f99cb tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "POST /compute/v2.1/servers/ebe4ae1b-40d6-4159-ac26-f551a269e9a8/action" status: 200 len: 69008 microversion: 2.1 time: 0.092803 Oct 19 04:38:07.265916 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3814/8103] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 04:38:07 2022] POST /compute/v2.1/servers/ebe4ae1b-40d6-4159-ac26-f551a269e9a8/action => generated 69008 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 04:38:31.213712 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8b6f8f85-a30c-4dee-b8f0-18e0c3bc3ae5 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:38:31.214247 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8b6f8f85-a30c-4dee-b8f0-18e0c3bc3ae5 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: ebe4ae1b-40d6-4159-ac26-f551a269e9a8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:38:31.217549 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=18 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:38:31.217974 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:38:31.218397 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:38:31.225133 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8b6f8f85-a30c-4dee-b8f0-18e0c3bc3ae5 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:38:31.225801 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8b6f8f85-a30c-4dee-b8f0-18e0c3bc3ae5 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:38:31.226256 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8b6f8f85-a30c-4dee-b8f0-18e0c3bc3ae5 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:38:31.227512 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8b6f8f85-a30c-4dee-b8f0-18e0c3bc3ae5 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:38:31.227823 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8b6f8f85-a30c-4dee-b8f0-18e0c3bc3ae5 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:38:31.228223 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8b6f8f85-a30c-4dee-b8f0-18e0c3bc3ae5 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:38:31.255473 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8b6f8f85-a30c-4dee-b8f0-18e0c3bc3ae5 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: ebe4ae1b-40d6-4159-ac26-f551a269e9a8] Going to try to terminate instance {{(pid=121134) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 04:38:31.304927 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-4ba0d060-53db-4ed8-81f6-5aa9c99a5daf req-f59b5542-2322-4675-a477-796eb9d08063 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebe4ae1b-40d6-4159-ac26-f551a269e9a8", "tag": "35969517-6bf4-4947-b47d-ad955aa29e81"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:38:31.320463 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-4ba0d060-53db-4ed8-81f6-5aa9c99a5daf req-f59b5542-2322-4675-a477-796eb9d08063 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:38:31.320463 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-4ba0d060-53db-4ed8-81f6-5aa9c99a5daf req-f59b5542-2322-4675-a477-796eb9d08063 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:38:31.320463 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-4ba0d060-53db-4ed8-81f6-5aa9c99a5daf req-f59b5542-2322-4675-a477-796eb9d08063 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:38:31.330277 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-4ba0d060-53db-4ed8-81f6-5aa9c99a5daf req-f59b5542-2322-4675-a477-796eb9d08063 service nova] Creating event network-changed:35969517-6bf4-4947-b47d-ad955aa29e81 for instance ebe4ae1b-40d6-4159-ac26-f551a269e9a8 on n-h1-861333-8 Oct 19 04:38:31.335503 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-4ba0d060-53db-4ed8-81f6-5aa9c99a5daf req-f59b5542-2322-4675-a477-796eb9d08063 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123677 Oct 19 04:38:31.336125 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3815/8104] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:38:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 04:38:31.574979 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8b6f8f85-a30c-4dee-b8f0-18e0c3bc3ae5 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ebe4ae1b-40d6-4159-ac26-f551a269e9a8" status: 204 len: 0 microversion: 2.1 time: 0.365443 Oct 19 04:38:31.577022 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4290/8105] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 04:38:31 2022] DELETE /compute/v2.1/servers/ebe4ae1b-40d6-4159-ac26-f551a269e9a8 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 04:38:31.585778 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-79840135-ae63-4ccf-8917-f49a03457a9e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:38:31.586497 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-79840135-ae63-4ccf-8917-f49a03457a9e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: ebe4ae1b-40d6-4159-ac26-f551a269e9a8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:38:31.593870 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-79840135-ae63-4ccf-8917-f49a03457a9e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:38:31.594369 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-79840135-ae63-4ccf-8917-f49a03457a9e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:38:31.594816 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-79840135-ae63-4ccf-8917-f49a03457a9e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:38:31.595525 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-79840135-ae63-4ccf-8917-f49a03457a9e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:38:31.595992 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-79840135-ae63-4ccf-8917-f49a03457a9e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:38:31.596420 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-79840135-ae63-4ccf-8917-f49a03457a9e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:38:31.734325 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-79840135-ae63-4ccf-8917-f49a03457a9e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:38:31.742739 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-79840135-ae63-4ccf-8917-f49a03457a9e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/ebe4ae1b-40d6-4159-ac26-f551a269e9a8" status: 200 len: 1690 microversion: 2.1 time: 0.161278 Oct 19 04:38:31.743391 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3816/8106] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:38:31 2022] GET /compute/v2.1/servers/ebe4ae1b-40d6-4159-ac26-f551a269e9a8 => generated 1690 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:38:32.770578 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1082a449-57de-41ee-a31d-a77ab0c6d488 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:38:32.771307 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1082a449-57de-41ee-a31d-a77ab0c6d488 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: ebe4ae1b-40d6-4159-ac26-f551a269e9a8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:38:32.777463 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1082a449-57de-41ee-a31d-a77ab0c6d488 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:38:32.777970 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1082a449-57de-41ee-a31d-a77ab0c6d488 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:38:32.778433 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1082a449-57de-41ee-a31d-a77ab0c6d488 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:38:32.779147 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1082a449-57de-41ee-a31d-a77ab0c6d488 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:38:32.779622 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1082a449-57de-41ee-a31d-a77ab0c6d488 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:38:32.780067 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1082a449-57de-41ee-a31d-a77ab0c6d488 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:38:32.913764 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-1082a449-57de-41ee-a31d-a77ab0c6d488 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:38:32.921745 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1082a449-57de-41ee-a31d-a77ab0c6d488 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/ebe4ae1b-40d6-4159-ac26-f551a269e9a8" status: 200 len: 1690 microversion: 2.1 time: 0.157232 Oct 19 04:38:32.922330 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4291/8107] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:38:32 2022] GET /compute/v2.1/servers/ebe4ae1b-40d6-4159-ac26-f551a269e9a8 => generated 1690 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:38:33.924711 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-30fcf4d1-fa45-498a-926d-b891058443b1 req-82a31d7d-b0e5-4e0c-8a3c-35cf022fb4f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebe4ae1b-40d6-4159-ac26-f551a269e9a8", "name": "network-vif-deleted", "tag": "35969517-6bf4-4947-b47d-ad955aa29e81"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:38:33.934141 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-30fcf4d1-fa45-498a-926d-b891058443b1 req-82a31d7d-b0e5-4e0c-8a3c-35cf022fb4f9 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:38:33.934774 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-30fcf4d1-fa45-498a-926d-b891058443b1 req-82a31d7d-b0e5-4e0c-8a3c-35cf022fb4f9 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:38:33.935051 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-30fcf4d1-fa45-498a-926d-b891058443b1 req-82a31d7d-b0e5-4e0c-8a3c-35cf022fb4f9 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:38:33.945701 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-096619d9-e96a-4ec5-b04c-98e4c2d02ce4 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:38:33.946426 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-096619d9-e96a-4ec5-b04c-98e4c2d02ce4 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: ebe4ae1b-40d6-4159-ac26-f551a269e9a8] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:38:33.947041 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-30fcf4d1-fa45-498a-926d-b891058443b1 req-82a31d7d-b0e5-4e0c-8a3c-35cf022fb4f9 service nova] Creating event network-vif-deleted:35969517-6bf4-4947-b47d-ad955aa29e81 for instance ebe4ae1b-40d6-4159-ac26-f551a269e9a8 on n-h1-861333-8 Oct 19 04:38:33.952256 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-30fcf4d1-fa45-498a-926d-b891058443b1 req-82a31d7d-b0e5-4e0c-8a3c-35cf022fb4f9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101765 Oct 19 04:38:33.952929 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3817/8108] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:38:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:38:33.953466 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-096619d9-e96a-4ec5-b04c-98e4c2d02ce4 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:38:33.953972 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-096619d9-e96a-4ec5-b04c-98e4c2d02ce4 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:38:33.954450 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-096619d9-e96a-4ec5-b04c-98e4c2d02ce4 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:38:33.956160 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-096619d9-e96a-4ec5-b04c-98e4c2d02ce4 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:38:33.956252 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-096619d9-e96a-4ec5-b04c-98e4c2d02ce4 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:38:33.956632 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-096619d9-e96a-4ec5-b04c-98e4c2d02ce4 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:38:34.299776 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-096619d9-e96a-4ec5-b04c-98e4c2d02ce4 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:38:34.307933 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-096619d9-e96a-4ec5-b04c-98e4c2d02ce4 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/ebe4ae1b-40d6-4159-ac26-f551a269e9a8" status: 200 len: 1503 microversion: 2.1 time: 0.366158 Oct 19 04:38:34.308514 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4292/8109] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:38:33 2022] GET /compute/v2.1/servers/ebe4ae1b-40d6-4159-ac26-f551a269e9a8 => generated 1503 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:38:35.333214 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ca3f3da8-5be0-4245-a11d-f61aa8422e22 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:38:35.333985 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ca3f3da8-5be0-4245-a11d-f61aa8422e22 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: ebe4ae1b-40d6-4159-ac26-f551a269e9a8] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:38:35.340251 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ca3f3da8-5be0-4245-a11d-f61aa8422e22 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:38:35.340744 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ca3f3da8-5be0-4245-a11d-f61aa8422e22 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:38:35.341197 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ca3f3da8-5be0-4245-a11d-f61aa8422e22 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:38:35.341933 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ca3f3da8-5be0-4245-a11d-f61aa8422e22 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:38:35.342398 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ca3f3da8-5be0-4245-a11d-f61aa8422e22 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:38:35.342833 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ca3f3da8-5be0-4245-a11d-f61aa8422e22 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:38:35.356014 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-ca3f3da8-5be0-4245-a11d-f61aa8422e22 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] HTTP exception thrown: Instance ebe4ae1b-40d6-4159-ac26-f551a269e9a8 could not be found. Oct 19 04:38:35.357665 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ca3f3da8-5be0-4245-a11d-f61aa8422e22 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Request method failure captured: Oct 19 04:38:35.357665 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/ebe4ae1b-40d6-4159-ac26-f551a269e9a8 HTTP/1.1 Oct 19 04:38:35.357665 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 04:38:35.357665 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 04:38:35.357665 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 04:38:35.357665 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 04:38:35.357665 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 04:38:35.357665 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 04:38:35.357665 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 04:38:35.357665 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 04:38:35.357665 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT35NpThLGkEnkUgxysLlsfJIyjHqx4L2LT0k6tcbhBDHVJc-wSjP3KeYxe20ELM4-EyhMTutgojR4K9EWIX4amldsFPPM0deHzYTPzrRD1C-x1vHinBbpM7CZBL8f9PKcXGCu_hivxaz25FuBZI0OCPMvGiPgwKv7T2jvjsl4ijCBYk Oct 19 04:38:35.357665 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 04:38:35.357665 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 04:38:35.357665 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 04:38:35.357665 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 04:38:35.357665 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 04:38:35.357665 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 04:38:35.357665 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: d31be961273b43ebb4c58e2350042660 Oct 19 04:38:35.357665 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1897523363 Oct 19 04:38:35.357665 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 04:38:35.357665 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 04:38:35.357665 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d31be961273b43ebb4c58e2350042660"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d31be961273b43ebb4c58e2350042660"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d31be961273b43ebb4c58e2350042660"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d31be961273b43ebb4c58e2350042660", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 04:38:35.357665 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1897523363 Oct 19 04:38:35.357665 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: d31be961273b43ebb4c58e2350042660 Oct 19 04:38:35.357665 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1897523363 Oct 19 04:38:35.357665 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-TestNetworkAdvancedServerOps-1897523363-project Oct 19 04:38:35.357665 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 04:38:35.357665 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 04:38:35.357665 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 834b809f82734666a6d2aea092429cbd Oct 19 04:38:35.357665 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1897523363-project Oct 19 04:38:35.357665 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 04:38:35.357665 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance ebe4ae1b-40d6-4159-ac26-f551a269e9a8 could not be found. Oct 19 04:38:35.357665 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': 'ebe4ae1b-40d6-4159-ac26-f551a269e9a8'} Oct 19 04:38:35.357665 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 04:38:35.357665 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:38:35.357665 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 04:38:35.357665 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 04:38:35.357665 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 04:38:35.357665 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 04:38:35.357665 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 04:38:35.357665 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 04:38:35.357665 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 04:38:35.357665 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 04:38:35.357665 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ebe4ae1b-40d6-4159-ac26-f551a269e9a8 could not be found. Oct 19 04:38:35.357665 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:38:35.357665 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:38:35.357665 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:38:35.357665 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:38:35.357665 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:38:35.357665 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:38:35.357665 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 04:38:35.357665 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 04:38:35.357665 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 04:38:35.357665 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 04:38:35.357665 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 04:38:35.357665 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 04:38:35.357665 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 04:38:35.357665 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 04:38:35.357665 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 04:38:35.357665 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 04:38:35.357665 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ebe4ae1b-40d6-4159-ac26-f551a269e9a8 could not be found. Oct 19 04:38:35.357665 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:38:35.357665 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:38:35.364142 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:38:35.364142 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:38:35.364142 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:38:35.364142 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:38:35.364142 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 04:38:35.364142 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 04:38:35.364142 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ebe4ae1b-40d6-4159-ac26-f551a269e9a8 could not be found. Oct 19 04:38:35.364142 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:38:35.364142 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ca3f3da8-5be0-4245-a11d-f61aa8422e22 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Returning 404 to user: Instance ebe4ae1b-40d6-4159-ac26-f551a269e9a8 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 04:38:35.364142 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ca3f3da8-5be0-4245-a11d-f61aa8422e22 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/ebe4ae1b-40d6-4159-ac26-f551a269e9a8" status: 404 len: 111 microversion: 2.1 time: 0.030974 Oct 19 04:38:35.364142 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3818/8110] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:38:35 2022] GET /compute/v2.1/servers/ebe4ae1b-40d6-4159-ac26-f551a269e9a8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 04:38:38.813328 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-76736a53-d5fc-4e09-8521-14a47b453a59 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '.version_select at 0x7fc12b93d700>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:38:38.819891 n-d-861333-8 devstack@n-api.service[121134]: ERROR oslo.messaging._drivers.impl_rabbit [None req-76736a53-d5fc-4e09-8521-14a47b453a59 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [19b0d749-bd61-471f-8efc-e4b656063a84] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 19 04:38:39.830196 n-d-861333-8 devstack@n-api.service[121134]: INFO oslo.messaging._drivers.impl_rabbit [None req-76736a53-d5fc-4e09-8521-14a47b453a59 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [19b0d749-bd61-471f-8efc-e4b656063a84] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 35940. Oct 19 04:38:39.911613 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-76736a53-d5fc-4e09-8521-14a47b453a59 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2048340535" status: 202 len: 0 microversion: 2.1 time: 1.103220 Oct 19 04:38:39.912226 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4293/8111] 10.222.0.52 () {58 vars in 1284 bytes} [Wed Oct 19 04:38:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2048340535 => generated 0 bytes in 1105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 04:38:39.943861 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-373da3cb-113f-46d5-a9a1-1095fd3eb4e2 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Action: 'create', calling method: .version_select at 0x7fc12bef1310>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1767798320", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLwct0Rd4maMD6j69cyQPGlY+pQ+e7NuRXNrCPW6QwcE4iW/a2NGp9AalbgqiNBDS+BcnnYOS/P34Y/euzcjAUJlM90EJIW47D0vOfi34kzdXRSKYAcStrEANC//RFG6sg=="}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:38:39.960960 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-373da3cb-113f-46d5-a9a1-1095fd3eb4e2 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Getting quotas for project d31be961273b43ebb4c58e2350042660. Resources: {'key_pairs'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 04:38:39.966111 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-373da3cb-113f-46d5-a9a1-1095fd3eb4e2 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Getting quotas for user 834b809f82734666a6d2aea092429cbd and project d31be961273b43ebb4c58e2350042660. Resources: {'key_pairs'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 04:38:39.979837 n-d-861333-8 devstack@n-api.service[121135]: ERROR oslo.messaging._drivers.impl_rabbit [None req-373da3cb-113f-46d5-a9a1-1095fd3eb4e2 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [466284c6-cbd7-4ef3-a024-7f40823a5c9c] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 19 04:38:40.986859 n-d-861333-8 devstack@n-api.service[121135]: INFO oslo.messaging._drivers.impl_rabbit [None req-373da3cb-113f-46d5-a9a1-1095fd3eb4e2 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [466284c6-cbd7-4ef3-a024-7f40823a5c9c] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 35944. Oct 19 04:38:41.054120 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-373da3cb-113f-46d5-a9a1-1095fd3eb4e2 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 1.114210 Oct 19 04:38:41.054877 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3819/8112] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Oct 19 04:38:39 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:38:49.163802 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:38:49.168410 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-45c799b9-96c7-422a-967c-105e4d534a9a tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-430001040", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "networks": [{"uuid": "ba0ba261-3bcf-4c13-8b5c-d9491a0d039f"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1767798320", "security_groups": [{"name": "tempest-secgroup-smoke-1842142886"}]}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:38:49.320042 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-45c799b9-96c7-422a-967c-105e4d534a9a tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] validate_networks() for [('ba0ba261-3bcf-4c13-8b5c-d9491a0d039f', None, None, None, None, None)] {{(pid=121134) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 04:38:49.797361 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-45c799b9-96c7-422a-967c-105e4d534a9a tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Flavor limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 04:38:49.797837 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-45c799b9-96c7-422a-967c-105e4d534a9a tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Image limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 04:38:49.798321 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-45c799b9-96c7-422a-967c-105e4d534a9a tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Flavor pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 04:38:49.799327 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-45c799b9-96c7-422a-967c-105e4d534a9a tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Image pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 04:38:49.799755 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-45c799b9-96c7-422a-967c-105e4d534a9a tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 04:38:49.808717 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-45c799b9-96c7-422a-967c-105e4d534a9a tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:38:49.809268 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-45c799b9-96c7-422a-967c-105e4d534a9a tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:38:49.809767 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-45c799b9-96c7-422a-967c-105e4d534a9a tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:38:49.810500 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-45c799b9-96c7-422a-967c-105e4d534a9a tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:38:49.810967 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-45c799b9-96c7-422a-967c-105e4d534a9a tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:38:49.811406 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-45c799b9-96c7-422a-967c-105e4d534a9a tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:38:49.831124 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-45c799b9-96c7-422a-967c-105e4d534a9a tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Getting quotas for project d31be961273b43ebb4c58e2350042660. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 04:38:49.836105 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-45c799b9-96c7-422a-967c-105e4d534a9a tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Getting quotas for user 834b809f82734666a6d2aea092429cbd and project d31be961273b43ebb4c58e2350042660. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 04:38:49.849187 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-45c799b9-96c7-422a-967c-105e4d534a9a tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Going to run 1 instances... {{(pid=121134) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 04:38:49.854661 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-45c799b9-96c7-422a-967c-105e4d534a9a tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: dfc0eca3-6cc0-4d96-9260-54bc814da794] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 04:38:49.968622 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-45c799b9-96c7-422a-967c-105e4d534a9a tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.806561 Oct 19 04:38:49.969306 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4294/8113] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 04:38:49 2022] POST /compute/v2.1/servers => generated 406 bytes in 808 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 04:38:49.981363 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-52d2d32a-7e62-4ae5-becd-903877faf105 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:38:49.982136 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-52d2d32a-7e62-4ae5-becd-903877faf105 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: dfc0eca3-6cc0-4d96-9260-54bc814da794] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:38:49.987818 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=16 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:38:49.987818 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=4 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:38:50.045535 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-52d2d32a-7e62-4ae5-becd-903877faf105 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:38:50.053825 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-52d2d32a-7e62-4ae5-becd-903877faf105 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/dfc0eca3-6cc0-4d96-9260-54bc814da794" status: 200 len: 1266 microversion: 2.1 time: 0.076414 Oct 19 04:38:50.054597 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3820/8114] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:38:49 2022] GET /compute/v2.1/servers/dfc0eca3-6cc0-4d96-9260-54bc814da794 => generated 1266 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:38:51.082272 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-63b0893f-c694-497d-8b0e-e0be21c85820 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:38:51.084980 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-63b0893f-c694-497d-8b0e-e0be21c85820 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: dfc0eca3-6cc0-4d96-9260-54bc814da794] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:38:51.091616 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-63b0893f-c694-497d-8b0e-e0be21c85820 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:38:51.092493 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-63b0893f-c694-497d-8b0e-e0be21c85820 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:38:51.093188 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-63b0893f-c694-497d-8b0e-e0be21c85820 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:38:51.094178 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-63b0893f-c694-497d-8b0e-e0be21c85820 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:38:51.094885 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-63b0893f-c694-497d-8b0e-e0be21c85820 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:38:51.095747 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-63b0893f-c694-497d-8b0e-e0be21c85820 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:38:51.185310 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-63b0893f-c694-497d-8b0e-e0be21c85820 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:38:51.193590 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-63b0893f-c694-497d-8b0e-e0be21c85820 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/dfc0eca3-6cc0-4d96-9260-54bc814da794" status: 200 len: 1270 microversion: 2.1 time: 0.118607 Oct 19 04:38:51.194684 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4295/8115] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:38:51 2022] GET /compute/v2.1/servers/dfc0eca3-6cc0-4d96-9260-54bc814da794 => generated 1270 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:38:52.216950 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-287a26a7-1ceb-4f12-bc15-c2ef3d40475f tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:38:52.218345 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-287a26a7-1ceb-4f12-bc15-c2ef3d40475f tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: dfc0eca3-6cc0-4d96-9260-54bc814da794] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:38:52.229790 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-287a26a7-1ceb-4f12-bc15-c2ef3d40475f tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:38:52.230280 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-287a26a7-1ceb-4f12-bc15-c2ef3d40475f tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:38:52.230946 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-287a26a7-1ceb-4f12-bc15-c2ef3d40475f tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:38:52.231830 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-287a26a7-1ceb-4f12-bc15-c2ef3d40475f tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:38:52.232281 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-287a26a7-1ceb-4f12-bc15-c2ef3d40475f tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:38:52.233076 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-287a26a7-1ceb-4f12-bc15-c2ef3d40475f tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:38:52.310000 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-287a26a7-1ceb-4f12-bc15-c2ef3d40475f tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:38:52.318781 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-287a26a7-1ceb-4f12-bc15-c2ef3d40475f tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/dfc0eca3-6cc0-4d96-9260-54bc814da794" status: 200 len: 1336 microversion: 2.1 time: 0.106519 Oct 19 04:38:52.319358 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3821/8116] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:38:52 2022] GET /compute/v2.1/servers/dfc0eca3-6cc0-4d96-9260-54bc814da794 => generated 1336 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:38:53.341880 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b4d3a88a-8e8e-4d68-8332-aee7bfc3a13a tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:38:53.342645 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b4d3a88a-8e8e-4d68-8332-aee7bfc3a13a tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: dfc0eca3-6cc0-4d96-9260-54bc814da794] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:38:53.349570 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b4d3a88a-8e8e-4d68-8332-aee7bfc3a13a tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:38:53.350080 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b4d3a88a-8e8e-4d68-8332-aee7bfc3a13a tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:38:53.350538 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b4d3a88a-8e8e-4d68-8332-aee7bfc3a13a tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:38:53.351253 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b4d3a88a-8e8e-4d68-8332-aee7bfc3a13a tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:38:53.352078 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b4d3a88a-8e8e-4d68-8332-aee7bfc3a13a tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:38:53.352936 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b4d3a88a-8e8e-4d68-8332-aee7bfc3a13a tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:38:53.576468 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b4d3a88a-8e8e-4d68-8332-aee7bfc3a13a tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:38:53.584518 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b4d3a88a-8e8e-4d68-8332-aee7bfc3a13a tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/dfc0eca3-6cc0-4d96-9260-54bc814da794" status: 200 len: 1392 microversion: 2.1 time: 0.246533 Oct 19 04:38:53.585242 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4296/8117] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:38:53 2022] GET /compute/v2.1/servers/dfc0eca3-6cc0-4d96-9260-54bc814da794 => generated 1392 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:38:53.854713 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-f2cdfbfa-5d59-4347-93c1-8072e3754e60 req-f8eb8257-b670-4e05-9d9a-360569d7ca69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfc0eca3-6cc0-4d96-9260-54bc814da794", "tag": "994f2cf7-9ffa-4b3f-939b-364fd6b99ea7"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:38:53.864881 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-f2cdfbfa-5d59-4347-93c1-8072e3754e60 req-f8eb8257-b670-4e05-9d9a-360569d7ca69 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:38:53.865408 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-f2cdfbfa-5d59-4347-93c1-8072e3754e60 req-f8eb8257-b670-4e05-9d9a-360569d7ca69 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:38:53.865846 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-f2cdfbfa-5d59-4347-93c1-8072e3754e60 req-f8eb8257-b670-4e05-9d9a-360569d7ca69 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:38:53.876935 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-f2cdfbfa-5d59-4347-93c1-8072e3754e60 req-f8eb8257-b670-4e05-9d9a-360569d7ca69 service nova] Creating event network-changed:994f2cf7-9ffa-4b3f-939b-364fd6b99ea7 for instance dfc0eca3-6cc0-4d96-9260-54bc814da794 on n-h2-861333-8 Oct 19 04:38:53.881902 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-f2cdfbfa-5d59-4347-93c1-8072e3754e60 req-f8eb8257-b670-4e05-9d9a-360569d7ca69 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032578 Oct 19 04:38:53.882686 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3822/8118] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:38:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:38:54.608261 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6e8af819-932d-4dca-ac20-db0dee65946c tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:38:54.608921 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6e8af819-932d-4dca-ac20-db0dee65946c tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: dfc0eca3-6cc0-4d96-9260-54bc814da794] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:38:54.616448 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6e8af819-932d-4dca-ac20-db0dee65946c tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:38:54.616960 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6e8af819-932d-4dca-ac20-db0dee65946c tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:38:54.617453 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6e8af819-932d-4dca-ac20-db0dee65946c tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:38:54.618171 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6e8af819-932d-4dca-ac20-db0dee65946c tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:38:54.618649 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6e8af819-932d-4dca-ac20-db0dee65946c tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:38:54.619101 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6e8af819-932d-4dca-ac20-db0dee65946c tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:38:54.755364 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-6e8af819-932d-4dca-ac20-db0dee65946c tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:38:54.763145 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6e8af819-932d-4dca-ac20-db0dee65946c tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/dfc0eca3-6cc0-4d96-9260-54bc814da794" status: 200 len: 1392 microversion: 2.1 time: 0.158876 Oct 19 04:38:54.763717 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4297/8119] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:38:54 2022] GET /compute/v2.1/servers/dfc0eca3-6cc0-4d96-9260-54bc814da794 => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:38:55.787641 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-467e8dbd-1d87-401a-9c70-d08231778d86 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:38:55.788380 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-467e8dbd-1d87-401a-9c70-d08231778d86 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: dfc0eca3-6cc0-4d96-9260-54bc814da794] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:38:55.794573 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-467e8dbd-1d87-401a-9c70-d08231778d86 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:38:55.795057 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-467e8dbd-1d87-401a-9c70-d08231778d86 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:38:55.795497 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-467e8dbd-1d87-401a-9c70-d08231778d86 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:38:55.796213 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-467e8dbd-1d87-401a-9c70-d08231778d86 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:38:55.796667 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-467e8dbd-1d87-401a-9c70-d08231778d86 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:38:55.797094 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-467e8dbd-1d87-401a-9c70-d08231778d86 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:38:55.929035 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-467e8dbd-1d87-401a-9c70-d08231778d86 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:38:55.936726 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-467e8dbd-1d87-401a-9c70-d08231778d86 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/dfc0eca3-6cc0-4d96-9260-54bc814da794" status: 200 len: 1392 microversion: 2.1 time: 0.154418 Oct 19 04:38:55.937298 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3823/8120] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:38:55 2022] GET /compute/v2.1/servers/dfc0eca3-6cc0-4d96-9260-54bc814da794 => generated 1392 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:38:56.960614 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e99ef9ae-9e8f-443e-95ac-6e58969cb846 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:38:56.961323 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e99ef9ae-9e8f-443e-95ac-6e58969cb846 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: dfc0eca3-6cc0-4d96-9260-54bc814da794] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:38:56.968210 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e99ef9ae-9e8f-443e-95ac-6e58969cb846 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:38:56.968705 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e99ef9ae-9e8f-443e-95ac-6e58969cb846 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:38:56.969153 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e99ef9ae-9e8f-443e-95ac-6e58969cb846 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:38:56.969881 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e99ef9ae-9e8f-443e-95ac-6e58969cb846 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:38:56.971016 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e99ef9ae-9e8f-443e-95ac-6e58969cb846 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:38:56.971462 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e99ef9ae-9e8f-443e-95ac-6e58969cb846 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:38:57.102378 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e99ef9ae-9e8f-443e-95ac-6e58969cb846 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:38:57.110221 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e99ef9ae-9e8f-443e-95ac-6e58969cb846 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/dfc0eca3-6cc0-4d96-9260-54bc814da794" status: 200 len: 1392 microversion: 2.1 time: 0.153529 Oct 19 04:38:57.110845 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4298/8121] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:38:56 2022] GET /compute/v2.1/servers/dfc0eca3-6cc0-4d96-9260-54bc814da794 => generated 1392 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:38:58.133657 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-be335174-0f44-4c01-9bed-53a39c70e7ca tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:38:58.134205 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-be335174-0f44-4c01-9bed-53a39c70e7ca tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: dfc0eca3-6cc0-4d96-9260-54bc814da794] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:38:58.137558 n-d-861333-8 devstack@n-api.service[121135]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 04:38:58.137717 n-d-861333-8 devstack@n-api.service[121135]: Wed Oct 19 04:38:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/dfc0eca3-6cc0-4d96-9260-54bc814da794 (ip 10.222.0.52) !!! Oct 19 04:38:58.144217 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-be335174-0f44-4c01-9bed-53a39c70e7ca tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:38:58.144710 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-be335174-0f44-4c01-9bed-53a39c70e7ca tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:38:58.145190 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-be335174-0f44-4c01-9bed-53a39c70e7ca tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:38:58.145929 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-be335174-0f44-4c01-9bed-53a39c70e7ca tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:38:58.146397 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-be335174-0f44-4c01-9bed-53a39c70e7ca tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:38:58.146831 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-be335174-0f44-4c01-9bed-53a39c70e7ca tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:38:58.280223 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-be335174-0f44-4c01-9bed-53a39c70e7ca tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:38:58.289060 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-be335174-0f44-4c01-9bed-53a39c70e7ca tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/dfc0eca3-6cc0-4d96-9260-54bc814da794" status: 200 len: 1392 microversion: 2.1 time: 0.159661 Oct 19 04:38:58.289679 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3824/8122] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:38:58 2022] GET /compute/v2.1/servers/dfc0eca3-6cc0-4d96-9260-54bc814da794 => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:38:59.312313 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f369cce0-9870-4521-a977-0de56599a897 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:38:59.312945 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f369cce0-9870-4521-a977-0de56599a897 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: dfc0eca3-6cc0-4d96-9260-54bc814da794] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:38:59.320377 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f369cce0-9870-4521-a977-0de56599a897 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:38:59.320883 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f369cce0-9870-4521-a977-0de56599a897 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:38:59.321343 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f369cce0-9870-4521-a977-0de56599a897 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:38:59.322080 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f369cce0-9870-4521-a977-0de56599a897 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:38:59.322555 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f369cce0-9870-4521-a977-0de56599a897 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:38:59.323007 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f369cce0-9870-4521-a977-0de56599a897 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:38:59.458210 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-f369cce0-9870-4521-a977-0de56599a897 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:38:59.466243 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f369cce0-9870-4521-a977-0de56599a897 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/dfc0eca3-6cc0-4d96-9260-54bc814da794" status: 200 len: 1392 microversion: 2.1 time: 0.157546 Oct 19 04:38:59.466498 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4299/8123] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:38:59 2022] GET /compute/v2.1/servers/dfc0eca3-6cc0-4d96-9260-54bc814da794 => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:39:00.489027 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0100252a-95f9-4ce0-ba73-1f7addf622e2 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:39:00.489727 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0100252a-95f9-4ce0-ba73-1f7addf622e2 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: dfc0eca3-6cc0-4d96-9260-54bc814da794] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:39:00.496764 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0100252a-95f9-4ce0-ba73-1f7addf622e2 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:39:00.497247 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0100252a-95f9-4ce0-ba73-1f7addf622e2 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:39:00.497738 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0100252a-95f9-4ce0-ba73-1f7addf622e2 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:39:00.498447 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0100252a-95f9-4ce0-ba73-1f7addf622e2 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:39:00.498902 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0100252a-95f9-4ce0-ba73-1f7addf622e2 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:39:00.499325 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0100252a-95f9-4ce0-ba73-1f7addf622e2 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:39:00.645889 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-0100252a-95f9-4ce0-ba73-1f7addf622e2 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:39:00.654177 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0100252a-95f9-4ce0-ba73-1f7addf622e2 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/dfc0eca3-6cc0-4d96-9260-54bc814da794" status: 200 len: 1392 microversion: 2.1 time: 0.169700 Oct 19 04:39:00.654784 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3825/8124] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:39:00 2022] GET /compute/v2.1/servers/dfc0eca3-6cc0-4d96-9260-54bc814da794 => generated 1392 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:39:00.671498 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-08e01082-08f5-41a7-ba05-b8f945f2f0aa req-a87cb596-6b42-4921-ba8f-6de4f5d62ed9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfc0eca3-6cc0-4d96-9260-54bc814da794", "name": "network-vif-plugged", "status": "completed", "tag": "994f2cf7-9ffa-4b3f-939b-364fd6b99ea7"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:39:00.679507 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:39:00.680732 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=6 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:39:00.684902 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-08e01082-08f5-41a7-ba05-b8f945f2f0aa req-a87cb596-6b42-4921-ba8f-6de4f5d62ed9 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:39:00.685423 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-08e01082-08f5-41a7-ba05-b8f945f2f0aa req-a87cb596-6b42-4921-ba8f-6de4f5d62ed9 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:39:00.690647 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-08e01082-08f5-41a7-ba05-b8f945f2f0aa req-a87cb596-6b42-4921-ba8f-6de4f5d62ed9 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:39:00.697617 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-08e01082-08f5-41a7-ba05-b8f945f2f0aa req-a87cb596-6b42-4921-ba8f-6de4f5d62ed9 service nova] Creating event network-vif-plugged:994f2cf7-9ffa-4b3f-939b-364fd6b99ea7 for instance dfc0eca3-6cc0-4d96-9260-54bc814da794 on n-h2-861333-8 Oct 19 04:39:00.702624 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-08e01082-08f5-41a7-ba05-b8f945f2f0aa req-a87cb596-6b42-4921-ba8f-6de4f5d62ed9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036373 Oct 19 04:39:00.703435 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4300/8125] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:39:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:39:01.677942 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-73b52152-b58b-493d-abbe-b2653f7b8980 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:39:01.678578 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-73b52152-b58b-493d-abbe-b2653f7b8980 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: dfc0eca3-6cc0-4d96-9260-54bc814da794] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:39:01.681276 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:39:01.686123 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-73b52152-b58b-493d-abbe-b2653f7b8980 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:39:01.686622 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-73b52152-b58b-493d-abbe-b2653f7b8980 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:39:01.687069 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-73b52152-b58b-493d-abbe-b2653f7b8980 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:39:01.687782 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-73b52152-b58b-493d-abbe-b2653f7b8980 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:39:01.688236 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-73b52152-b58b-493d-abbe-b2653f7b8980 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:39:01.688673 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-73b52152-b58b-493d-abbe-b2653f7b8980 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:39:01.823063 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-73b52152-b58b-493d-abbe-b2653f7b8980 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:39:01.831236 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-73b52152-b58b-493d-abbe-b2653f7b8980 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/dfc0eca3-6cc0-4d96-9260-54bc814da794" status: 200 len: 1392 microversion: 2.1 time: 0.157877 Oct 19 04:39:01.831813 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3826/8126] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:39:01 2022] GET /compute/v2.1/servers/dfc0eca3-6cc0-4d96-9260-54bc814da794 => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:39:02.855434 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1610bd0f-419a-44a2-9e42-4b29d0c72300 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:39:02.856147 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1610bd0f-419a-44a2-9e42-4b29d0c72300 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: dfc0eca3-6cc0-4d96-9260-54bc814da794] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:39:02.858672 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:39:02.863949 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1610bd0f-419a-44a2-9e42-4b29d0c72300 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:39:02.864444 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1610bd0f-419a-44a2-9e42-4b29d0c72300 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:39:02.864897 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1610bd0f-419a-44a2-9e42-4b29d0c72300 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:39:02.865630 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1610bd0f-419a-44a2-9e42-4b29d0c72300 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:39:02.866095 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1610bd0f-419a-44a2-9e42-4b29d0c72300 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:39:02.866533 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1610bd0f-419a-44a2-9e42-4b29d0c72300 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:39:02.998211 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-1610bd0f-419a-44a2-9e42-4b29d0c72300 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:39:03.005775 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1610bd0f-419a-44a2-9e42-4b29d0c72300 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/dfc0eca3-6cc0-4d96-9260-54bc814da794" status: 200 len: 1564 microversion: 2.1 time: 0.155396 Oct 19 04:39:03.006338 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4301/8127] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:39:02 2022] GET /compute/v2.1/servers/dfc0eca3-6cc0-4d96-9260-54bc814da794 => generated 1564 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:39:03.037091 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e865abd9-f170-43f1-8698-417f4ab91f29 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:39:03.037698 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e865abd9-f170-43f1-8698-417f4ab91f29 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: dfc0eca3-6cc0-4d96-9260-54bc814da794] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:39:03.040766 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:39:03.044772 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e865abd9-f170-43f1-8698-417f4ab91f29 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:39:03.045262 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e865abd9-f170-43f1-8698-417f4ab91f29 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:39:03.045736 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e865abd9-f170-43f1-8698-417f4ab91f29 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:39:03.046444 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e865abd9-f170-43f1-8698-417f4ab91f29 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:39:03.046904 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e865abd9-f170-43f1-8698-417f4ab91f29 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:39:03.047341 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e865abd9-f170-43f1-8698-417f4ab91f29 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:39:03.182440 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-e865abd9-f170-43f1-8698-417f4ab91f29 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:39:03.190968 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e865abd9-f170-43f1-8698-417f4ab91f29 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/dfc0eca3-6cc0-4d96-9260-54bc814da794" status: 200 len: 1564 microversion: 2.1 time: 0.158775 Oct 19 04:39:03.191563 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3827/8128] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:39:03 2022] GET /compute/v2.1/servers/dfc0eca3-6cc0-4d96-9260-54bc814da794 => generated 1564 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:39:05.269723 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-330bcad5-b7d2-47bd-ad1a-7101b6242034 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:39:05.270440 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-330bcad5-b7d2-47bd-ad1a-7101b6242034 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: dfc0eca3-6cc0-4d96-9260-54bc814da794] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:39:05.274381 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-773d4a1d-6f8f-47c3-9ac1-b1e9a4657ce3 req-5cded821-020b-438f-9392-2bdc86387242 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfc0eca3-6cc0-4d96-9260-54bc814da794", "tag": "994f2cf7-9ffa-4b3f-939b-364fd6b99ea7"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:39:05.281698 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-330bcad5-b7d2-47bd-ad1a-7101b6242034 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:39:05.282311 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-330bcad5-b7d2-47bd-ad1a-7101b6242034 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:39:05.284422 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-330bcad5-b7d2-47bd-ad1a-7101b6242034 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:39:05.285269 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-330bcad5-b7d2-47bd-ad1a-7101b6242034 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:39:05.285862 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-330bcad5-b7d2-47bd-ad1a-7101b6242034 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:39:05.286552 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-330bcad5-b7d2-47bd-ad1a-7101b6242034 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:39:05.288015 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-773d4a1d-6f8f-47c3-9ac1-b1e9a4657ce3 req-5cded821-020b-438f-9392-2bdc86387242 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:39:05.288490 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-773d4a1d-6f8f-47c3-9ac1-b1e9a4657ce3 req-5cded821-020b-438f-9392-2bdc86387242 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:39:05.288934 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-773d4a1d-6f8f-47c3-9ac1-b1e9a4657ce3 req-5cded821-020b-438f-9392-2bdc86387242 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:39:05.301606 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-773d4a1d-6f8f-47c3-9ac1-b1e9a4657ce3 req-5cded821-020b-438f-9392-2bdc86387242 service nova] Creating event network-changed:994f2cf7-9ffa-4b3f-939b-364fd6b99ea7 for instance dfc0eca3-6cc0-4d96-9260-54bc814da794 on n-h2-861333-8 Oct 19 04:39:05.306975 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-773d4a1d-6f8f-47c3-9ac1-b1e9a4657ce3 req-5cded821-020b-438f-9392-2bdc86387242 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036427 Oct 19 04:39:05.307996 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3828/8129] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:39:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 04:39:05.534332 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-330bcad5-b7d2-47bd-ad1a-7101b6242034 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:39:05.542890 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-330bcad5-b7d2-47bd-ad1a-7101b6242034 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/dfc0eca3-6cc0-4d96-9260-54bc814da794" status: 200 len: 1564 microversion: 2.1 time: 0.278161 Oct 19 04:39:05.543772 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4302/8130] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:39:05 2022] GET /compute/v2.1/servers/dfc0eca3-6cc0-4d96-9260-54bc814da794 => generated 1564 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:39:28.786929 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=5 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:39:28.787610 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=40 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:39:28.854563 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7dcfe444-da52-4be1-9b85-7ebc89eb1458 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:39:28.857012 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7dcfe444-da52-4be1-9b85-7ebc89eb1458 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: dfc0eca3-6cc0-4d96-9260-54bc814da794] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:39:28.863911 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7dcfe444-da52-4be1-9b85-7ebc89eb1458 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:39:28.864399 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7dcfe444-da52-4be1-9b85-7ebc89eb1458 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:39:28.864841 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7dcfe444-da52-4be1-9b85-7ebc89eb1458 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:39:28.865564 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7dcfe444-da52-4be1-9b85-7ebc89eb1458 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:39:28.866021 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7dcfe444-da52-4be1-9b85-7ebc89eb1458 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:39:28.866448 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7dcfe444-da52-4be1-9b85-7ebc89eb1458 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:39:28.918255 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7dcfe444-da52-4be1-9b85-7ebc89eb1458 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "POST /compute/v2.1/servers/dfc0eca3-6cc0-4d96-9260-54bc814da794/action" status: 200 len: 24572 microversion: 2.1 time: 0.133288 Oct 19 04:39:28.918885 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3829/8131] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 04:39:28 2022] POST /compute/v2.1/servers/dfc0eca3-6cc0-4d96-9260-54bc814da794/action => generated 24572 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 04:39:39.994069 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6725415e-fbb7-4828-b0a5-4b5362b597b1 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:39:39.996313 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6725415e-fbb7-4828-b0a5-4b5362b597b1 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: dfc0eca3-6cc0-4d96-9260-54bc814da794] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:39:39.998420 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=3 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:39:39.999249 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=46 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:39:40.003876 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6725415e-fbb7-4828-b0a5-4b5362b597b1 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:39:40.004379 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6725415e-fbb7-4828-b0a5-4b5362b597b1 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:39:40.004842 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6725415e-fbb7-4828-b0a5-4b5362b597b1 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:39:40.005593 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6725415e-fbb7-4828-b0a5-4b5362b597b1 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:39:40.006064 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6725415e-fbb7-4828-b0a5-4b5362b597b1 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:39:40.006509 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6725415e-fbb7-4828-b0a5-4b5362b597b1 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:39:40.046693 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-6725415e-fbb7-4828-b0a5-4b5362b597b1 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:39:40.053555 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6725415e-fbb7-4828-b0a5-4b5362b597b1 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: dfc0eca3-6cc0-4d96-9260-54bc814da794] Old instance type m1.heat2, new instance type m1.heat {{(pid=121134) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 19 04:39:40.060056 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-6725415e-fbb7-4828-b0a5-4b5362b597b1 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Flavor limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 04:39:40.060500 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-6725415e-fbb7-4828-b0a5-4b5362b597b1 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Image limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 04:39:40.060997 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-6725415e-fbb7-4828-b0a5-4b5362b597b1 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Flavor pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 04:39:40.061463 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-6725415e-fbb7-4828-b0a5-4b5362b597b1 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Image pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 04:39:40.061908 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-6725415e-fbb7-4828-b0a5-4b5362b597b1 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 04:39:40.255018 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6725415e-fbb7-4828-b0a5-4b5362b597b1 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "POST /compute/v2.1/servers/dfc0eca3-6cc0-4d96-9260-54bc814da794/action" status: 202 len: 0 microversion: 2.1 time: 0.265199 Oct 19 04:39:40.255593 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4303/8132] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 04:39:39 2022] POST /compute/v2.1/servers/dfc0eca3-6cc0-4d96-9260-54bc814da794/action => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 04:39:40.264475 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-020515d8-2d6f-4bfa-9c83-a2bf16a51ed5 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:39:40.265186 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-020515d8-2d6f-4bfa-9c83-a2bf16a51ed5 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: dfc0eca3-6cc0-4d96-9260-54bc814da794] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:39:40.268473 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:39:40.269147 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=4 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:39:40.274129 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-020515d8-2d6f-4bfa-9c83-a2bf16a51ed5 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:39:40.274621 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-020515d8-2d6f-4bfa-9c83-a2bf16a51ed5 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:39:40.275063 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-020515d8-2d6f-4bfa-9c83-a2bf16a51ed5 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:39:40.275762 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-020515d8-2d6f-4bfa-9c83-a2bf16a51ed5 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:39:40.276217 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-020515d8-2d6f-4bfa-9c83-a2bf16a51ed5 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:39:40.276653 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-020515d8-2d6f-4bfa-9c83-a2bf16a51ed5 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:39:40.417712 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-020515d8-2d6f-4bfa-9c83-a2bf16a51ed5 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:39:40.426037 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-020515d8-2d6f-4bfa-9c83-a2bf16a51ed5 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/dfc0eca3-6cc0-4d96-9260-54bc814da794" status: 200 len: 1692 microversion: 2.1 time: 0.165897 Oct 19 04:39:40.426616 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3830/8133] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:39:40 2022] GET /compute/v2.1/servers/dfc0eca3-6cc0-4d96-9260-54bc814da794 => generated 1692 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:39:41.450826 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-68f326c9-834f-4ee6-8ed1-b07cce05382e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:39:41.451496 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-68f326c9-834f-4ee6-8ed1-b07cce05382e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: dfc0eca3-6cc0-4d96-9260-54bc814da794] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:39:41.458273 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-68f326c9-834f-4ee6-8ed1-b07cce05382e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:39:41.458774 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-68f326c9-834f-4ee6-8ed1-b07cce05382e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:39:41.459229 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-68f326c9-834f-4ee6-8ed1-b07cce05382e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:39:41.459957 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-68f326c9-834f-4ee6-8ed1-b07cce05382e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:39:41.460432 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-68f326c9-834f-4ee6-8ed1-b07cce05382e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:39:41.460874 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-68f326c9-834f-4ee6-8ed1-b07cce05382e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:39:41.598294 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-68f326c9-834f-4ee6-8ed1-b07cce05382e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:39:41.606293 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-68f326c9-834f-4ee6-8ed1-b07cce05382e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/dfc0eca3-6cc0-4d96-9260-54bc814da794" status: 200 len: 1692 microversion: 2.1 time: 0.160514 Oct 19 04:39:41.607356 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4304/8134] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:39:41 2022] GET /compute/v2.1/servers/dfc0eca3-6cc0-4d96-9260-54bc814da794 => generated 1692 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:39:42.629814 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-87d1acad-d2a5-49c3-a34b-b236c7d383fd tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:39:42.630368 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-87d1acad-d2a5-49c3-a34b-b236c7d383fd tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: dfc0eca3-6cc0-4d96-9260-54bc814da794] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:39:42.637203 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-87d1acad-d2a5-49c3-a34b-b236c7d383fd tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:39:42.637721 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-87d1acad-d2a5-49c3-a34b-b236c7d383fd tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:39:42.638159 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-87d1acad-d2a5-49c3-a34b-b236c7d383fd tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:39:42.638847 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-87d1acad-d2a5-49c3-a34b-b236c7d383fd tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:39:42.639294 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-87d1acad-d2a5-49c3-a34b-b236c7d383fd tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:39:42.639717 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-87d1acad-d2a5-49c3-a34b-b236c7d383fd tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:39:42.822058 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-87d1acad-d2a5-49c3-a34b-b236c7d383fd tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:39:42.829803 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-87d1acad-d2a5-49c3-a34b-b236c7d383fd tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/dfc0eca3-6cc0-4d96-9260-54bc814da794" status: 200 len: 1692 microversion: 2.1 time: 0.204089 Oct 19 04:39:42.830878 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3831/8135] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:39:42 2022] GET /compute/v2.1/servers/dfc0eca3-6cc0-4d96-9260-54bc814da794 => generated 1692 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:39:43.854703 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2fe02aa0-5077-4cb9-b548-f313e0fd1b64 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:39:43.855351 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2fe02aa0-5077-4cb9-b548-f313e0fd1b64 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: dfc0eca3-6cc0-4d96-9260-54bc814da794] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:39:43.862783 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2fe02aa0-5077-4cb9-b548-f313e0fd1b64 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:39:43.863276 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2fe02aa0-5077-4cb9-b548-f313e0fd1b64 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:39:43.863749 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2fe02aa0-5077-4cb9-b548-f313e0fd1b64 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:39:43.864447 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2fe02aa0-5077-4cb9-b548-f313e0fd1b64 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:39:43.864913 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2fe02aa0-5077-4cb9-b548-f313e0fd1b64 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:39:43.865349 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2fe02aa0-5077-4cb9-b548-f313e0fd1b64 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:39:43.995413 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-2fe02aa0-5077-4cb9-b548-f313e0fd1b64 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:39:44.003156 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2fe02aa0-5077-4cb9-b548-f313e0fd1b64 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/dfc0eca3-6cc0-4d96-9260-54bc814da794" status: 200 len: 1697 microversion: 2.1 time: 0.152375 Oct 19 04:39:44.003732 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4305/8136] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:39:43 2022] GET /compute/v2.1/servers/dfc0eca3-6cc0-4d96-9260-54bc814da794 => generated 1697 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:39:45.027643 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-421c7171-3eb5-47c5-ab37-817f8d8cb823 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:39:45.028257 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-421c7171-3eb5-47c5-ab37-817f8d8cb823 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: dfc0eca3-6cc0-4d96-9260-54bc814da794] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:39:45.036079 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-421c7171-3eb5-47c5-ab37-817f8d8cb823 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:39:45.036573 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-421c7171-3eb5-47c5-ab37-817f8d8cb823 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:39:45.037026 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-421c7171-3eb5-47c5-ab37-817f8d8cb823 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:39:45.037756 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-421c7171-3eb5-47c5-ab37-817f8d8cb823 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:39:45.038219 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-421c7171-3eb5-47c5-ab37-817f8d8cb823 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:39:45.038652 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-421c7171-3eb5-47c5-ab37-817f8d8cb823 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:39:45.178272 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-421c7171-3eb5-47c5-ab37-817f8d8cb823 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:39:45.186803 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-421c7171-3eb5-47c5-ab37-817f8d8cb823 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/dfc0eca3-6cc0-4d96-9260-54bc814da794" status: 200 len: 1697 microversion: 2.1 time: 0.163199 Oct 19 04:39:45.187402 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3832/8137] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:39:45 2022] GET /compute/v2.1/servers/dfc0eca3-6cc0-4d96-9260-54bc814da794 => generated 1697 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:39:46.215232 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c90381c6-8061-458c-92f9-03603812ffc7 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:39:46.215856 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c90381c6-8061-458c-92f9-03603812ffc7 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: dfc0eca3-6cc0-4d96-9260-54bc814da794] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:39:46.222800 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c90381c6-8061-458c-92f9-03603812ffc7 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:39:46.223296 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c90381c6-8061-458c-92f9-03603812ffc7 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:39:46.223747 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c90381c6-8061-458c-92f9-03603812ffc7 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:39:46.224450 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c90381c6-8061-458c-92f9-03603812ffc7 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:39:46.224920 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c90381c6-8061-458c-92f9-03603812ffc7 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:39:46.225352 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c90381c6-8061-458c-92f9-03603812ffc7 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:39:46.364627 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c90381c6-8061-458c-92f9-03603812ffc7 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:39:46.373578 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c90381c6-8061-458c-92f9-03603812ffc7 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/dfc0eca3-6cc0-4d96-9260-54bc814da794" status: 200 len: 1697 microversion: 2.1 time: 0.162243 Oct 19 04:39:46.374168 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4306/8138] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:39:46 2022] GET /compute/v2.1/servers/dfc0eca3-6cc0-4d96-9260-54bc814da794 => generated 1697 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:39:47.402111 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4d4eb055-9ae8-48a4-9e8f-9a25564d1b54 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:39:47.403164 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4d4eb055-9ae8-48a4-9e8f-9a25564d1b54 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: dfc0eca3-6cc0-4d96-9260-54bc814da794] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:39:47.416129 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4d4eb055-9ae8-48a4-9e8f-9a25564d1b54 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:39:47.416647 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4d4eb055-9ae8-48a4-9e8f-9a25564d1b54 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:39:47.418915 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4d4eb055-9ae8-48a4-9e8f-9a25564d1b54 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:39:47.419686 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4d4eb055-9ae8-48a4-9e8f-9a25564d1b54 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:39:47.420162 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4d4eb055-9ae8-48a4-9e8f-9a25564d1b54 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:39:47.420727 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4d4eb055-9ae8-48a4-9e8f-9a25564d1b54 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:39:47.559143 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4d4eb055-9ae8-48a4-9e8f-9a25564d1b54 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:39:47.567471 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4d4eb055-9ae8-48a4-9e8f-9a25564d1b54 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/dfc0eca3-6cc0-4d96-9260-54bc814da794" status: 200 len: 1697 microversion: 2.1 time: 0.171462 Oct 19 04:39:47.568048 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3833/8139] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:39:47 2022] GET /compute/v2.1/servers/dfc0eca3-6cc0-4d96-9260-54bc814da794 => generated 1697 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:39:48.591402 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9817fdd8-b4ab-4154-b805-f0d175136ac6 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:39:48.592030 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9817fdd8-b4ab-4154-b805-f0d175136ac6 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: dfc0eca3-6cc0-4d96-9260-54bc814da794] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:39:48.599466 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9817fdd8-b4ab-4154-b805-f0d175136ac6 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:39:48.600025 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9817fdd8-b4ab-4154-b805-f0d175136ac6 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:39:48.600487 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9817fdd8-b4ab-4154-b805-f0d175136ac6 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:39:48.601207 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9817fdd8-b4ab-4154-b805-f0d175136ac6 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:39:48.601712 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9817fdd8-b4ab-4154-b805-f0d175136ac6 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:39:48.602161 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9817fdd8-b4ab-4154-b805-f0d175136ac6 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:39:48.731299 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9817fdd8-b4ab-4154-b805-f0d175136ac6 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:39:48.739188 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9817fdd8-b4ab-4154-b805-f0d175136ac6 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/dfc0eca3-6cc0-4d96-9260-54bc814da794" status: 200 len: 1697 microversion: 2.1 time: 0.151711 Oct 19 04:39:48.739777 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4307/8140] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:39:48 2022] GET /compute/v2.1/servers/dfc0eca3-6cc0-4d96-9260-54bc814da794 => generated 1697 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:39:49.762452 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0dcf188d-557f-4e73-a56c-790350990dcf tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:39:49.763056 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0dcf188d-557f-4e73-a56c-790350990dcf tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: dfc0eca3-6cc0-4d96-9260-54bc814da794] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:39:49.769877 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0dcf188d-557f-4e73-a56c-790350990dcf tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:39:49.770391 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0dcf188d-557f-4e73-a56c-790350990dcf tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:39:49.770832 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0dcf188d-557f-4e73-a56c-790350990dcf tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:39:49.771527 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0dcf188d-557f-4e73-a56c-790350990dcf tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:39:49.771984 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0dcf188d-557f-4e73-a56c-790350990dcf tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:39:49.772439 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0dcf188d-557f-4e73-a56c-790350990dcf tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:39:49.904315 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-0dcf188d-557f-4e73-a56c-790350990dcf tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:39:49.912711 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0dcf188d-557f-4e73-a56c-790350990dcf tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/dfc0eca3-6cc0-4d96-9260-54bc814da794" status: 200 len: 1697 microversion: 2.1 time: 0.154186 Oct 19 04:39:49.913295 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3834/8141] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:39:49 2022] GET /compute/v2.1/servers/dfc0eca3-6cc0-4d96-9260-54bc814da794 => generated 1697 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:39:50.936557 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c0397249-614a-4884-8d88-f559098aa01b tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:39:50.937147 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c0397249-614a-4884-8d88-f559098aa01b tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: dfc0eca3-6cc0-4d96-9260-54bc814da794] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:39:50.945109 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c0397249-614a-4884-8d88-f559098aa01b tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:39:50.945647 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c0397249-614a-4884-8d88-f559098aa01b tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:39:50.946211 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c0397249-614a-4884-8d88-f559098aa01b tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:39:50.946915 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c0397249-614a-4884-8d88-f559098aa01b tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:39:50.947389 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c0397249-614a-4884-8d88-f559098aa01b tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:39:50.947839 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c0397249-614a-4884-8d88-f559098aa01b tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:39:51.087388 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c0397249-614a-4884-8d88-f559098aa01b tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:39:51.095158 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c0397249-614a-4884-8d88-f559098aa01b tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/dfc0eca3-6cc0-4d96-9260-54bc814da794" status: 200 len: 1697 microversion: 2.1 time: 0.162986 Oct 19 04:39:51.096241 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4308/8142] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:39:50 2022] GET /compute/v2.1/servers/dfc0eca3-6cc0-4d96-9260-54bc814da794 => generated 1697 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:39:52.119819 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-daf0a05a-812b-49d1-86b6-1080b2f66925 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:39:52.120466 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-daf0a05a-812b-49d1-86b6-1080b2f66925 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: dfc0eca3-6cc0-4d96-9260-54bc814da794] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:39:52.127420 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-daf0a05a-812b-49d1-86b6-1080b2f66925 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:39:52.127904 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-daf0a05a-812b-49d1-86b6-1080b2f66925 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:39:52.128346 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-daf0a05a-812b-49d1-86b6-1080b2f66925 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:39:52.129043 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-daf0a05a-812b-49d1-86b6-1080b2f66925 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:39:52.129533 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-daf0a05a-812b-49d1-86b6-1080b2f66925 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:39:52.129953 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-daf0a05a-812b-49d1-86b6-1080b2f66925 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:39:52.261323 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-daf0a05a-812b-49d1-86b6-1080b2f66925 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:39:52.269750 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-daf0a05a-812b-49d1-86b6-1080b2f66925 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/dfc0eca3-6cc0-4d96-9260-54bc814da794" status: 200 len: 1697 microversion: 2.1 time: 0.153789 Oct 19 04:39:52.270324 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3835/8143] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:39:52 2022] GET /compute/v2.1/servers/dfc0eca3-6cc0-4d96-9260-54bc814da794 => generated 1697 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:39:53.293805 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-17e6bc45-51f3-4caa-a9f0-c6773f0c2ec7 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:39:53.294431 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-17e6bc45-51f3-4caa-a9f0-c6773f0c2ec7 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: dfc0eca3-6cc0-4d96-9260-54bc814da794] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:39:53.301758 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-17e6bc45-51f3-4caa-a9f0-c6773f0c2ec7 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:39:53.302251 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-17e6bc45-51f3-4caa-a9f0-c6773f0c2ec7 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:39:53.302699 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-17e6bc45-51f3-4caa-a9f0-c6773f0c2ec7 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:39:53.303394 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-17e6bc45-51f3-4caa-a9f0-c6773f0c2ec7 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:39:53.303859 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-17e6bc45-51f3-4caa-a9f0-c6773f0c2ec7 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:39:53.304294 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-17e6bc45-51f3-4caa-a9f0-c6773f0c2ec7 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:39:53.438956 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-17e6bc45-51f3-4caa-a9f0-c6773f0c2ec7 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:39:53.446634 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-17e6bc45-51f3-4caa-a9f0-c6773f0c2ec7 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/dfc0eca3-6cc0-4d96-9260-54bc814da794" status: 200 len: 1697 microversion: 2.1 time: 0.156704 Oct 19 04:39:53.447205 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4309/8144] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:39:53 2022] GET /compute/v2.1/servers/dfc0eca3-6cc0-4d96-9260-54bc814da794 => generated 1697 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:39:54.470579 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-04f75914-c720-4b3b-b067-7b825b2b396c tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:39:54.471207 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-04f75914-c720-4b3b-b067-7b825b2b396c tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: dfc0eca3-6cc0-4d96-9260-54bc814da794] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:39:54.478179 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-04f75914-c720-4b3b-b067-7b825b2b396c tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:39:54.478674 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-04f75914-c720-4b3b-b067-7b825b2b396c tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:39:54.479126 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-04f75914-c720-4b3b-b067-7b825b2b396c tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:39:54.479830 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-04f75914-c720-4b3b-b067-7b825b2b396c tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:39:54.480293 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-04f75914-c720-4b3b-b067-7b825b2b396c tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:39:54.480730 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-04f75914-c720-4b3b-b067-7b825b2b396c tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:39:54.612320 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-04f75914-c720-4b3b-b067-7b825b2b396c tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:39:54.620185 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-04f75914-c720-4b3b-b067-7b825b2b396c tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/dfc0eca3-6cc0-4d96-9260-54bc814da794" status: 200 len: 1697 microversion: 2.1 time: 0.153689 Oct 19 04:39:54.620762 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3836/8145] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:39:54 2022] GET /compute/v2.1/servers/dfc0eca3-6cc0-4d96-9260-54bc814da794 => generated 1697 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:39:55.644645 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8eb83f3f-29c0-45a5-ab2e-269e52c35d25 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:39:55.645263 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8eb83f3f-29c0-45a5-ab2e-269e52c35d25 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: dfc0eca3-6cc0-4d96-9260-54bc814da794] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:39:55.652264 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8eb83f3f-29c0-45a5-ab2e-269e52c35d25 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:39:55.652709 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8eb83f3f-29c0-45a5-ab2e-269e52c35d25 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:39:55.653168 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8eb83f3f-29c0-45a5-ab2e-269e52c35d25 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:39:55.653903 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8eb83f3f-29c0-45a5-ab2e-269e52c35d25 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:39:55.654382 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8eb83f3f-29c0-45a5-ab2e-269e52c35d25 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:39:55.654829 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8eb83f3f-29c0-45a5-ab2e-269e52c35d25 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:39:55.784047 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8eb83f3f-29c0-45a5-ab2e-269e52c35d25 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:39:55.791714 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8eb83f3f-29c0-45a5-ab2e-269e52c35d25 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/dfc0eca3-6cc0-4d96-9260-54bc814da794" status: 200 len: 1697 microversion: 2.1 time: 0.151642 Oct 19 04:39:55.792309 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4310/8146] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:39:55 2022] GET /compute/v2.1/servers/dfc0eca3-6cc0-4d96-9260-54bc814da794 => generated 1697 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:39:56.815708 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b1337ec7-a44b-4256-868c-75286b4b90c6 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:39:56.816344 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b1337ec7-a44b-4256-868c-75286b4b90c6 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: dfc0eca3-6cc0-4d96-9260-54bc814da794] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:39:56.823337 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b1337ec7-a44b-4256-868c-75286b4b90c6 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:39:56.823834 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b1337ec7-a44b-4256-868c-75286b4b90c6 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:39:56.824284 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b1337ec7-a44b-4256-868c-75286b4b90c6 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:39:56.825049 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b1337ec7-a44b-4256-868c-75286b4b90c6 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:39:56.825550 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b1337ec7-a44b-4256-868c-75286b4b90c6 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:39:56.825987 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b1337ec7-a44b-4256-868c-75286b4b90c6 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:39:56.958510 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b1337ec7-a44b-4256-868c-75286b4b90c6 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:39:56.966289 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b1337ec7-a44b-4256-868c-75286b4b90c6 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/dfc0eca3-6cc0-4d96-9260-54bc814da794" status: 200 len: 1697 microversion: 2.1 time: 0.155208 Oct 19 04:39:56.966868 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3837/8147] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:39:56 2022] GET /compute/v2.1/servers/dfc0eca3-6cc0-4d96-9260-54bc814da794 => generated 1697 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:39:57.989910 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4ce97a65-c6b1-44c2-94b7-d42d0a65243b tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:39:57.990529 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4ce97a65-c6b1-44c2-94b7-d42d0a65243b tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: dfc0eca3-6cc0-4d96-9260-54bc814da794] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:39:57.997401 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4ce97a65-c6b1-44c2-94b7-d42d0a65243b tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:39:57.997917 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4ce97a65-c6b1-44c2-94b7-d42d0a65243b tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:39:57.998374 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4ce97a65-c6b1-44c2-94b7-d42d0a65243b tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:39:57.999081 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4ce97a65-c6b1-44c2-94b7-d42d0a65243b tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:39:57.999553 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4ce97a65-c6b1-44c2-94b7-d42d0a65243b tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:39:57.999996 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4ce97a65-c6b1-44c2-94b7-d42d0a65243b tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:39:58.132166 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-4ce97a65-c6b1-44c2-94b7-d42d0a65243b tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:39:58.139990 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4ce97a65-c6b1-44c2-94b7-d42d0a65243b tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/dfc0eca3-6cc0-4d96-9260-54bc814da794" status: 200 len: 1697 microversion: 2.1 time: 0.154645 Oct 19 04:39:58.140566 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4311/8148] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:39:57 2022] GET /compute/v2.1/servers/dfc0eca3-6cc0-4d96-9260-54bc814da794 => generated 1697 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:39:59.165002 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1eeacfd3-e42c-423e-8b90-d46a62985f07 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:39:59.165694 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1eeacfd3-e42c-423e-8b90-d46a62985f07 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: dfc0eca3-6cc0-4d96-9260-54bc814da794] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:39:59.172767 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1eeacfd3-e42c-423e-8b90-d46a62985f07 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:39:59.173263 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1eeacfd3-e42c-423e-8b90-d46a62985f07 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:39:59.173739 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1eeacfd3-e42c-423e-8b90-d46a62985f07 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:39:59.174441 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1eeacfd3-e42c-423e-8b90-d46a62985f07 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:39:59.174902 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1eeacfd3-e42c-423e-8b90-d46a62985f07 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:39:59.175352 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1eeacfd3-e42c-423e-8b90-d46a62985f07 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:39:59.310347 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-1eeacfd3-e42c-423e-8b90-d46a62985f07 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:39:59.318802 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1eeacfd3-e42c-423e-8b90-d46a62985f07 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/dfc0eca3-6cc0-4d96-9260-54bc814da794" status: 200 len: 1697 microversion: 2.1 time: 0.158058 Oct 19 04:39:59.319427 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3838/8149] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:39:59 2022] GET /compute/v2.1/servers/dfc0eca3-6cc0-4d96-9260-54bc814da794 => generated 1697 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:40:00.342606 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ba9085f2-db06-44b3-9fc6-0a261ebc0ec0 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:40:00.343242 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ba9085f2-db06-44b3-9fc6-0a261ebc0ec0 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: dfc0eca3-6cc0-4d96-9260-54bc814da794] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:40:00.349317 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ba9085f2-db06-44b3-9fc6-0a261ebc0ec0 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:40:00.349859 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ba9085f2-db06-44b3-9fc6-0a261ebc0ec0 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:40:00.350318 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ba9085f2-db06-44b3-9fc6-0a261ebc0ec0 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:40:00.351030 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ba9085f2-db06-44b3-9fc6-0a261ebc0ec0 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:40:00.351543 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ba9085f2-db06-44b3-9fc6-0a261ebc0ec0 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:40:00.351988 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ba9085f2-db06-44b3-9fc6-0a261ebc0ec0 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:40:00.483308 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ba9085f2-db06-44b3-9fc6-0a261ebc0ec0 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:40:00.491614 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ba9085f2-db06-44b3-9fc6-0a261ebc0ec0 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/dfc0eca3-6cc0-4d96-9260-54bc814da794" status: 200 len: 1697 microversion: 2.1 time: 0.153229 Oct 19 04:40:00.492192 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4312/8150] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:40:00 2022] GET /compute/v2.1/servers/dfc0eca3-6cc0-4d96-9260-54bc814da794 => generated 1697 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:40:01.510158 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-bedae752-158c-4eaa-bca0-7ac43e9642b0 req-aee4dcc7-1e7c-44e2-a175-28195c04025b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfc0eca3-6cc0-4d96-9260-54bc814da794", "name": "network-vif-unplugged", "status": "completed", "tag": "994f2cf7-9ffa-4b3f-939b-364fd6b99ea7"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:40:01.515725 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b10454d7-63ac-4b7e-ba1c-87451669b06e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:40:01.516361 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b10454d7-63ac-4b7e-ba1c-87451669b06e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: dfc0eca3-6cc0-4d96-9260-54bc814da794] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:40:01.522204 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-bedae752-158c-4eaa-bca0-7ac43e9642b0 req-aee4dcc7-1e7c-44e2-a175-28195c04025b service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:40:01.522875 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-bedae752-158c-4eaa-bca0-7ac43e9642b0 req-aee4dcc7-1e7c-44e2-a175-28195c04025b service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:40:01.523318 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-bedae752-158c-4eaa-bca0-7ac43e9642b0 req-aee4dcc7-1e7c-44e2-a175-28195c04025b service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:40:01.523926 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b10454d7-63ac-4b7e-ba1c-87451669b06e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:40:01.524427 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b10454d7-63ac-4b7e-ba1c-87451669b06e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:40:01.524879 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b10454d7-63ac-4b7e-ba1c-87451669b06e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:40:01.525621 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b10454d7-63ac-4b7e-ba1c-87451669b06e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:40:01.526090 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b10454d7-63ac-4b7e-ba1c-87451669b06e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:40:01.526534 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b10454d7-63ac-4b7e-ba1c-87451669b06e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:40:01.536399 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-bedae752-158c-4eaa-bca0-7ac43e9642b0 req-aee4dcc7-1e7c-44e2-a175-28195c04025b service nova] Creating event network-vif-unplugged:994f2cf7-9ffa-4b3f-939b-364fd6b99ea7 for instance dfc0eca3-6cc0-4d96-9260-54bc814da794 on n-h1-861333-8 Oct 19 04:40:01.542125 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [req-bedae752-158c-4eaa-bca0-7ac43e9642b0 req-aee4dcc7-1e7c-44e2-a175-28195c04025b service nova] Instance dfc0eca3-6cc0-4d96-9260-54bc814da794 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-861333-8', 'n-h1-861333-8'} {{(pid=121135) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 04:40:01.553909 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-bedae752-158c-4eaa-bca0-7ac43e9642b0 req-aee4dcc7-1e7c-44e2-a175-28195c04025b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047221 Oct 19 04:40:01.554868 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3839/8151] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:40:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:40:01.667088 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b10454d7-63ac-4b7e-ba1c-87451669b06e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:40:01.674903 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b10454d7-63ac-4b7e-ba1c-87451669b06e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/dfc0eca3-6cc0-4d96-9260-54bc814da794" status: 200 len: 1696 microversion: 2.1 time: 0.163085 Oct 19 04:40:01.675870 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4313/8152] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:40:01 2022] GET /compute/v2.1/servers/dfc0eca3-6cc0-4d96-9260-54bc814da794 => generated 1696 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:40:02.699153 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0dc81ffc-9d1f-4917-9f82-c2e1577d90de tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:40:02.699859 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0dc81ffc-9d1f-4917-9f82-c2e1577d90de tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: dfc0eca3-6cc0-4d96-9260-54bc814da794] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:40:02.707177 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0dc81ffc-9d1f-4917-9f82-c2e1577d90de tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:40:02.707696 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0dc81ffc-9d1f-4917-9f82-c2e1577d90de tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:40:02.708106 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0dc81ffc-9d1f-4917-9f82-c2e1577d90de tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:40:02.708805 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0dc81ffc-9d1f-4917-9f82-c2e1577d90de tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:40:02.709286 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0dc81ffc-9d1f-4917-9f82-c2e1577d90de tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:40:02.709718 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0dc81ffc-9d1f-4917-9f82-c2e1577d90de tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:40:02.841758 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-0dc81ffc-9d1f-4917-9f82-c2e1577d90de tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:40:02.850969 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0dc81ffc-9d1f-4917-9f82-c2e1577d90de tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/dfc0eca3-6cc0-4d96-9260-54bc814da794" status: 200 len: 1696 microversion: 2.1 time: 0.156428 Oct 19 04:40:02.851552 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3840/8153] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:40:02 2022] GET /compute/v2.1/servers/dfc0eca3-6cc0-4d96-9260-54bc814da794 => generated 1696 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:40:03.569612 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-f6539aa2-5ae7-4855-a7eb-aa7e56974020 req-e92c82c9-5c3a-4b7f-ba4a-920e966f8f21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfc0eca3-6cc0-4d96-9260-54bc814da794", "tag": "994f2cf7-9ffa-4b3f-939b-364fd6b99ea7"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:40:03.579882 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-f6539aa2-5ae7-4855-a7eb-aa7e56974020 req-e92c82c9-5c3a-4b7f-ba4a-920e966f8f21 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:40:03.580379 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-f6539aa2-5ae7-4855-a7eb-aa7e56974020 req-e92c82c9-5c3a-4b7f-ba4a-920e966f8f21 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:40:03.580833 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-f6539aa2-5ae7-4855-a7eb-aa7e56974020 req-e92c82c9-5c3a-4b7f-ba4a-920e966f8f21 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:40:03.592447 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-f6539aa2-5ae7-4855-a7eb-aa7e56974020 req-e92c82c9-5c3a-4b7f-ba4a-920e966f8f21 service nova] Creating event network-changed:994f2cf7-9ffa-4b3f-939b-364fd6b99ea7 for instance dfc0eca3-6cc0-4d96-9260-54bc814da794 on n-h1-861333-8 Oct 19 04:40:03.597783 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [req-f6539aa2-5ae7-4855-a7eb-aa7e56974020 req-e92c82c9-5c3a-4b7f-ba4a-920e966f8f21 service nova] Instance dfc0eca3-6cc0-4d96-9260-54bc814da794 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-861333-8', 'n-h1-861333-8'} {{(pid=121134) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 04:40:03.608427 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-f6539aa2-5ae7-4855-a7eb-aa7e56974020 req-e92c82c9-5c3a-4b7f-ba4a-920e966f8f21 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042721 Oct 19 04:40:03.609005 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4314/8154] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:40:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:40:03.875221 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-de7d7eba-e4d5-4d62-9a9a-b0d073b64657 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:40:03.875846 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-de7d7eba-e4d5-4d62-9a9a-b0d073b64657 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: dfc0eca3-6cc0-4d96-9260-54bc814da794] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:40:03.883153 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-de7d7eba-e4d5-4d62-9a9a-b0d073b64657 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:40:03.883648 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-de7d7eba-e4d5-4d62-9a9a-b0d073b64657 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:40:03.884100 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-de7d7eba-e4d5-4d62-9a9a-b0d073b64657 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:40:03.884804 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-de7d7eba-e4d5-4d62-9a9a-b0d073b64657 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:40:03.885270 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-de7d7eba-e4d5-4d62-9a9a-b0d073b64657 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:40:03.885733 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-de7d7eba-e4d5-4d62-9a9a-b0d073b64657 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:40:04.091608 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-de7d7eba-e4d5-4d62-9a9a-b0d073b64657 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:40:04.099579 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-de7d7eba-e4d5-4d62-9a9a-b0d073b64657 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/dfc0eca3-6cc0-4d96-9260-54bc814da794" status: 200 len: 1694 microversion: 2.1 time: 0.228154 Oct 19 04:40:04.100208 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3841/8155] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:40:03 2022] GET /compute/v2.1/servers/dfc0eca3-6cc0-4d96-9260-54bc814da794 => generated 1694 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:40:05.124641 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9da27e51-5e9f-45ad-832c-0571c7a771cb tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:40:05.125395 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9da27e51-5e9f-45ad-832c-0571c7a771cb tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: dfc0eca3-6cc0-4d96-9260-54bc814da794] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:40:05.131562 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9da27e51-5e9f-45ad-832c-0571c7a771cb tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:40:05.132057 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9da27e51-5e9f-45ad-832c-0571c7a771cb tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:40:05.132508 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9da27e51-5e9f-45ad-832c-0571c7a771cb tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:40:05.133213 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9da27e51-5e9f-45ad-832c-0571c7a771cb tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:40:05.133715 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9da27e51-5e9f-45ad-832c-0571c7a771cb tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:40:05.134162 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9da27e51-5e9f-45ad-832c-0571c7a771cb tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:40:05.266302 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9da27e51-5e9f-45ad-832c-0571c7a771cb tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:40:05.274761 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9da27e51-5e9f-45ad-832c-0571c7a771cb tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/dfc0eca3-6cc0-4d96-9260-54bc814da794" status: 200 len: 1694 microversion: 2.1 time: 0.155221 Oct 19 04:40:05.275306 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4315/8156] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:40:05 2022] GET /compute/v2.1/servers/dfc0eca3-6cc0-4d96-9260-54bc814da794 => generated 1694 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:40:06.300248 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3285763c-d875-4bb8-9b83-ca1d9c24b5ae tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:40:06.300898 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-3285763c-d875-4bb8-9b83-ca1d9c24b5ae tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: dfc0eca3-6cc0-4d96-9260-54bc814da794] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:40:06.307347 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3285763c-d875-4bb8-9b83-ca1d9c24b5ae tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:40:06.307833 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3285763c-d875-4bb8-9b83-ca1d9c24b5ae tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:40:06.308274 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3285763c-d875-4bb8-9b83-ca1d9c24b5ae tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:40:06.308977 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3285763c-d875-4bb8-9b83-ca1d9c24b5ae tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:40:06.309461 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3285763c-d875-4bb8-9b83-ca1d9c24b5ae tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:40:06.309899 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3285763c-d875-4bb8-9b83-ca1d9c24b5ae tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:40:06.455077 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-3285763c-d875-4bb8-9b83-ca1d9c24b5ae tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:40:06.460049 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-3285763c-d875-4bb8-9b83-ca1d9c24b5ae tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/dfc0eca3-6cc0-4d96-9260-54bc814da794" status: 200 len: 1694 microversion: 2.1 time: 0.164338 Oct 19 04:40:06.460704 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3842/8157] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:40:06 2022] GET /compute/v2.1/servers/dfc0eca3-6cc0-4d96-9260-54bc814da794 => generated 1694 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:40:07.484096 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-869c7729-c9c3-4c11-b92c-d5dd8de1b7a9 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:40:07.484750 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-869c7729-c9c3-4c11-b92c-d5dd8de1b7a9 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: dfc0eca3-6cc0-4d96-9260-54bc814da794] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:40:07.491579 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-869c7729-c9c3-4c11-b92c-d5dd8de1b7a9 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:40:07.492072 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-869c7729-c9c3-4c11-b92c-d5dd8de1b7a9 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:40:07.492522 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-869c7729-c9c3-4c11-b92c-d5dd8de1b7a9 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:40:07.493222 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-869c7729-c9c3-4c11-b92c-d5dd8de1b7a9 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:40:07.493719 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-869c7729-c9c3-4c11-b92c-d5dd8de1b7a9 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:40:07.494163 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-869c7729-c9c3-4c11-b92c-d5dd8de1b7a9 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:40:07.624241 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-869c7729-c9c3-4c11-b92c-d5dd8de1b7a9 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:40:07.632515 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-869c7729-c9c3-4c11-b92c-d5dd8de1b7a9 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/dfc0eca3-6cc0-4d96-9260-54bc814da794" status: 200 len: 1691 microversion: 2.1 time: 0.152315 Oct 19 04:40:07.633099 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4316/8158] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:40:07 2022] GET /compute/v2.1/servers/dfc0eca3-6cc0-4d96-9260-54bc814da794 => generated 1691 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:40:07.655792 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f3685973-f629-42dd-aa2b-1dbe755b6fa5 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:40:07.656339 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f3685973-f629-42dd-aa2b-1dbe755b6fa5 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: dfc0eca3-6cc0-4d96-9260-54bc814da794] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:40:07.663365 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f3685973-f629-42dd-aa2b-1dbe755b6fa5 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:40:07.663861 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f3685973-f629-42dd-aa2b-1dbe755b6fa5 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:40:07.664312 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f3685973-f629-42dd-aa2b-1dbe755b6fa5 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:40:07.665012 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f3685973-f629-42dd-aa2b-1dbe755b6fa5 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:40:07.665509 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f3685973-f629-42dd-aa2b-1dbe755b6fa5 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:40:07.665948 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f3685973-f629-42dd-aa2b-1dbe755b6fa5 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:40:07.804791 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f3685973-f629-42dd-aa2b-1dbe755b6fa5 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "POST /compute/v2.1/servers/dfc0eca3-6cc0-4d96-9260-54bc814da794/action" status: 204 len: 0 microversion: 2.1 time: 0.152724 Oct 19 04:40:07.805494 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3843/8159] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 04:40:07 2022] POST /compute/v2.1/servers/dfc0eca3-6cc0-4d96-9260-54bc814da794/action => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 04:40:07.814122 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-61588a7c-d97a-4d0e-8351-c353e53ba653 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:40:07.815180 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-61588a7c-d97a-4d0e-8351-c353e53ba653 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: dfc0eca3-6cc0-4d96-9260-54bc814da794] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:40:07.821663 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-61588a7c-d97a-4d0e-8351-c353e53ba653 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:40:07.822172 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-61588a7c-d97a-4d0e-8351-c353e53ba653 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:40:07.822630 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-61588a7c-d97a-4d0e-8351-c353e53ba653 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:40:07.823349 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-61588a7c-d97a-4d0e-8351-c353e53ba653 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:40:07.823822 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-61588a7c-d97a-4d0e-8351-c353e53ba653 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:40:07.824267 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-61588a7c-d97a-4d0e-8351-c353e53ba653 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:40:08.037872 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-61588a7c-d97a-4d0e-8351-c353e53ba653 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:40:08.045872 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-61588a7c-d97a-4d0e-8351-c353e53ba653 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/dfc0eca3-6cc0-4d96-9260-54bc814da794" status: 200 len: 1691 microversion: 2.1 time: 0.236121 Oct 19 04:40:08.046465 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4317/8160] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:40:07 2022] GET /compute/v2.1/servers/dfc0eca3-6cc0-4d96-9260-54bc814da794 => generated 1691 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:40:08.070324 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2236ca87-be98-4b1a-aa97-2f2a923d93e7 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:40:08.074321 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-2236ca87-be98-4b1a-aa97-2f2a923d93e7 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: dfc0eca3-6cc0-4d96-9260-54bc814da794] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:40:08.077280 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2236ca87-be98-4b1a-aa97-2f2a923d93e7 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:40:08.077819 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2236ca87-be98-4b1a-aa97-2f2a923d93e7 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:40:08.078256 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2236ca87-be98-4b1a-aa97-2f2a923d93e7 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:40:08.078946 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2236ca87-be98-4b1a-aa97-2f2a923d93e7 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:40:08.079398 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2236ca87-be98-4b1a-aa97-2f2a923d93e7 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:40:08.079925 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2236ca87-be98-4b1a-aa97-2f2a923d93e7 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:40:08.574613 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-2236ca87-be98-4b1a-aa97-2f2a923d93e7 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:40:08.582569 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2236ca87-be98-4b1a-aa97-2f2a923d93e7 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/dfc0eca3-6cc0-4d96-9260-54bc814da794" status: 200 len: 1691 microversion: 2.1 time: 0.516853 Oct 19 04:40:08.586499 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3844/8161] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:40:08 2022] GET /compute/v2.1/servers/dfc0eca3-6cc0-4d96-9260-54bc814da794 => generated 1691 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:40:08.789117 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-ae0a90f3-1562-47e1-8afc-a08933d717b9 req-5b9c7f81-2bac-4fd4-a352-fdcc6227b10b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfc0eca3-6cc0-4d96-9260-54bc814da794", "name": "network-vif-plugged", "status": "completed", "tag": "994f2cf7-9ffa-4b3f-939b-364fd6b99ea7"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:40:08.798876 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-ae0a90f3-1562-47e1-8afc-a08933d717b9 req-5b9c7f81-2bac-4fd4-a352-fdcc6227b10b service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:40:08.799556 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-ae0a90f3-1562-47e1-8afc-a08933d717b9 req-5b9c7f81-2bac-4fd4-a352-fdcc6227b10b service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:40:08.799825 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-ae0a90f3-1562-47e1-8afc-a08933d717b9 req-5b9c7f81-2bac-4fd4-a352-fdcc6227b10b service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:40:08.812445 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-ae0a90f3-1562-47e1-8afc-a08933d717b9 req-5b9c7f81-2bac-4fd4-a352-fdcc6227b10b service nova] Creating event network-vif-plugged:994f2cf7-9ffa-4b3f-939b-364fd6b99ea7 for instance dfc0eca3-6cc0-4d96-9260-54bc814da794 on n-h1-861333-8 Oct 19 04:40:08.815695 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:40:08.819518 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [req-ae0a90f3-1562-47e1-8afc-a08933d717b9 req-5b9c7f81-2bac-4fd4-a352-fdcc6227b10b service nova] Instance dfc0eca3-6cc0-4d96-9260-54bc814da794 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-861333-8', 'n-h1-861333-8'} {{(pid=121134) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 04:40:08.835748 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-ae0a90f3-1562-47e1-8afc-a08933d717b9 req-5b9c7f81-2bac-4fd4-a352-fdcc6227b10b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096367 Oct 19 04:40:08.835748 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4318/8162] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:40:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:40:09.608208 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c9c34c0d-5ef9-498d-b6fa-8ccc7e8e3361 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:40:09.608780 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c9c34c0d-5ef9-498d-b6fa-8ccc7e8e3361 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: dfc0eca3-6cc0-4d96-9260-54bc814da794] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:40:09.616454 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c9c34c0d-5ef9-498d-b6fa-8ccc7e8e3361 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:40:09.616952 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c9c34c0d-5ef9-498d-b6fa-8ccc7e8e3361 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:40:09.617423 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c9c34c0d-5ef9-498d-b6fa-8ccc7e8e3361 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:40:09.618122 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c9c34c0d-5ef9-498d-b6fa-8ccc7e8e3361 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:40:09.618630 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c9c34c0d-5ef9-498d-b6fa-8ccc7e8e3361 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:40:09.619057 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c9c34c0d-5ef9-498d-b6fa-8ccc7e8e3361 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:40:09.754594 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c9c34c0d-5ef9-498d-b6fa-8ccc7e8e3361 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:40:09.756935 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:40:09.763146 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c9c34c0d-5ef9-498d-b6fa-8ccc7e8e3361 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/dfc0eca3-6cc0-4d96-9260-54bc814da794" status: 200 len: 1691 microversion: 2.1 time: 0.158969 Oct 19 04:40:09.765865 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3845/8163] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:40:09 2022] GET /compute/v2.1/servers/dfc0eca3-6cc0-4d96-9260-54bc814da794 => generated 1691 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:40:10.788872 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6a76608c-e76e-4100-bef9-11fe1d792b2f tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:40:10.792190 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6a76608c-e76e-4100-bef9-11fe1d792b2f tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: dfc0eca3-6cc0-4d96-9260-54bc814da794] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:40:10.792190 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=37 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:40:10.796769 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6a76608c-e76e-4100-bef9-11fe1d792b2f tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:40:10.797289 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6a76608c-e76e-4100-bef9-11fe1d792b2f tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:40:10.797762 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6a76608c-e76e-4100-bef9-11fe1d792b2f tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:40:10.798476 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6a76608c-e76e-4100-bef9-11fe1d792b2f tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:40:10.798945 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6a76608c-e76e-4100-bef9-11fe1d792b2f tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:40:10.799391 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6a76608c-e76e-4100-bef9-11fe1d792b2f tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:40:10.941415 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-6a76608c-e76e-4100-bef9-11fe1d792b2f tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:40:10.949433 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6a76608c-e76e-4100-bef9-11fe1d792b2f tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/dfc0eca3-6cc0-4d96-9260-54bc814da794" status: 200 len: 1683 microversion: 2.1 time: 0.166405 Oct 19 04:40:10.950014 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4319/8164] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:40:10 2022] GET /compute/v2.1/servers/dfc0eca3-6cc0-4d96-9260-54bc814da794 => generated 1683 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:40:41.161999 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b66dcb5f-849d-44d7-9444-f072ad107526 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:40:41.164190 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b66dcb5f-849d-44d7-9444-f072ad107526 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: dfc0eca3-6cc0-4d96-9260-54bc814da794] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:40:41.166709 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=32 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:40:41.172874 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b66dcb5f-849d-44d7-9444-f072ad107526 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:40:41.174808 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b66dcb5f-849d-44d7-9444-f072ad107526 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:40:41.174808 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b66dcb5f-849d-44d7-9444-f072ad107526 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:40:41.174808 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b66dcb5f-849d-44d7-9444-f072ad107526 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:40:41.175135 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b66dcb5f-849d-44d7-9444-f072ad107526 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:40:41.175358 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b66dcb5f-849d-44d7-9444-f072ad107526 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:40:41.243486 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b66dcb5f-849d-44d7-9444-f072ad107526 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "POST /compute/v2.1/servers/dfc0eca3-6cc0-4d96-9260-54bc814da794/action" status: 200 len: 24575 microversion: 2.1 time: 0.086397 Oct 19 04:40:41.244127 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3846/8165] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 04:40:41 2022] POST /compute/v2.1/servers/dfc0eca3-6cc0-4d96-9260-54bc814da794/action => generated 24575 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 04:41:05.098330 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-f3f51815-ac2f-471a-9fdf-852609f87bcc req-eb5e82c3-03b8-40c2-970a-34093180d891 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfc0eca3-6cc0-4d96-9260-54bc814da794", "tag": "994f2cf7-9ffa-4b3f-939b-364fd6b99ea7"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:41:05.102354 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e36da2e9-a333-4d9c-bda0-fd926f059872 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:41:05.102884 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e36da2e9-a333-4d9c-bda0-fd926f059872 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: dfc0eca3-6cc0-4d96-9260-54bc814da794] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:41:05.105091 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:41:05.106127 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=5 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:41:05.108779 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:41:05.109691 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=6 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:41:05.110670 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-f3f51815-ac2f-471a-9fdf-852609f87bcc req-eb5e82c3-03b8-40c2-970a-34093180d891 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:41:05.111226 n-d-861333-8 devstack@n-api.service[121134]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Oct 19 04:41:05.111480 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-f3f51815-ac2f-471a-9fdf-852609f87bcc req-eb5e82c3-03b8-40c2-970a-34093180d891 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:41:05.111728 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-f3f51815-ac2f-471a-9fdf-852609f87bcc req-eb5e82c3-03b8-40c2-970a-34093180d891 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:41:05.117572 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e36da2e9-a333-4d9c-bda0-fd926f059872 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:41:05.118349 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e36da2e9-a333-4d9c-bda0-fd926f059872 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:41:05.118816 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e36da2e9-a333-4d9c-bda0-fd926f059872 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:41:05.119551 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e36da2e9-a333-4d9c-bda0-fd926f059872 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:41:05.120031 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e36da2e9-a333-4d9c-bda0-fd926f059872 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:41:05.120478 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e36da2e9-a333-4d9c-bda0-fd926f059872 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:41:05.124218 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-f3f51815-ac2f-471a-9fdf-852609f87bcc req-eb5e82c3-03b8-40c2-970a-34093180d891 service nova] Creating event network-changed:994f2cf7-9ffa-4b3f-939b-364fd6b99ea7 for instance dfc0eca3-6cc0-4d96-9260-54bc814da794 on n-h1-861333-8 Oct 19 04:41:05.130366 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-f3f51815-ac2f-471a-9fdf-852609f87bcc req-eb5e82c3-03b8-40c2-970a-34093180d891 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035533 Oct 19 04:41:05.131066 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3847/8166] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:41:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:41:05.150840 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e36da2e9-a333-4d9c-bda0-fd926f059872 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: dfc0eca3-6cc0-4d96-9260-54bc814da794] Going to try to terminate instance {{(pid=121134) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 04:41:05.450051 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e36da2e9-a333-4d9c-bda0-fd926f059872 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "DELETE /compute/v2.1/servers/dfc0eca3-6cc0-4d96-9260-54bc814da794" status: 204 len: 0 microversion: 2.1 time: 0.358280 Oct 19 04:41:05.450749 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4320/8167] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 04:41:05 2022] DELETE /compute/v2.1/servers/dfc0eca3-6cc0-4d96-9260-54bc814da794 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 04:41:05.460953 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f85471d8-2e00-4328-a64d-bd818abea3cd tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:41:05.461695 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f85471d8-2e00-4328-a64d-bd818abea3cd tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: dfc0eca3-6cc0-4d96-9260-54bc814da794] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:41:05.468771 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f85471d8-2e00-4328-a64d-bd818abea3cd tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:41:05.469265 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f85471d8-2e00-4328-a64d-bd818abea3cd tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:41:05.469770 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f85471d8-2e00-4328-a64d-bd818abea3cd tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:41:05.470558 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f85471d8-2e00-4328-a64d-bd818abea3cd tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:41:05.471019 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f85471d8-2e00-4328-a64d-bd818abea3cd tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:41:05.471454 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f85471d8-2e00-4328-a64d-bd818abea3cd tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:41:05.611398 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f85471d8-2e00-4328-a64d-bd818abea3cd tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:41:05.619754 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f85471d8-2e00-4328-a64d-bd818abea3cd tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/dfc0eca3-6cc0-4d96-9260-54bc814da794" status: 200 len: 1689 microversion: 2.1 time: 0.164367 Oct 19 04:41:05.620337 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3848/8168] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:41:05 2022] GET /compute/v2.1/servers/dfc0eca3-6cc0-4d96-9260-54bc814da794 => generated 1689 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:41:06.643696 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f3520370-adda-430e-9cfb-9c73dd92ff64 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:41:06.644462 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f3520370-adda-430e-9cfb-9c73dd92ff64 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: dfc0eca3-6cc0-4d96-9260-54bc814da794] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:41:06.651565 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f3520370-adda-430e-9cfb-9c73dd92ff64 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:41:06.652069 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f3520370-adda-430e-9cfb-9c73dd92ff64 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:41:06.652522 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f3520370-adda-430e-9cfb-9c73dd92ff64 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:41:06.653232 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f3520370-adda-430e-9cfb-9c73dd92ff64 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:41:06.653727 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f3520370-adda-430e-9cfb-9c73dd92ff64 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:41:06.654172 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f3520370-adda-430e-9cfb-9c73dd92ff64 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:41:06.832431 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-f3520370-adda-430e-9cfb-9c73dd92ff64 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:41:06.840154 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f3520370-adda-430e-9cfb-9c73dd92ff64 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/dfc0eca3-6cc0-4d96-9260-54bc814da794" status: 200 len: 1689 microversion: 2.1 time: 0.200762 Oct 19 04:41:06.840725 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4321/8169] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:41:06 2022] GET /compute/v2.1/servers/dfc0eca3-6cc0-4d96-9260-54bc814da794 => generated 1689 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:41:07.569805 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-4c02b475-a668-49e4-8491-de9792763bf4 req-146227fa-df85-4c02-a529-8d8a76fb2d6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfc0eca3-6cc0-4d96-9260-54bc814da794", "name": "network-vif-deleted", "tag": "994f2cf7-9ffa-4b3f-939b-364fd6b99ea7"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:41:07.580147 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-4c02b475-a668-49e4-8491-de9792763bf4 req-146227fa-df85-4c02-a529-8d8a76fb2d6c service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:41:07.580635 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-4c02b475-a668-49e4-8491-de9792763bf4 req-146227fa-df85-4c02-a529-8d8a76fb2d6c service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:41:07.581072 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-4c02b475-a668-49e4-8491-de9792763bf4 req-146227fa-df85-4c02-a529-8d8a76fb2d6c service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:41:07.592705 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-4c02b475-a668-49e4-8491-de9792763bf4 req-146227fa-df85-4c02-a529-8d8a76fb2d6c service nova] Creating event network-vif-deleted:994f2cf7-9ffa-4b3f-939b-364fd6b99ea7 for instance dfc0eca3-6cc0-4d96-9260-54bc814da794 on n-h1-861333-8 Oct 19 04:41:07.597704 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-4c02b475-a668-49e4-8491-de9792763bf4 req-146227fa-df85-4c02-a529-8d8a76fb2d6c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031607 Oct 19 04:41:07.598308 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3849/8170] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:41:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:41:07.864237 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0e3d2044-e2c1-47cf-88cf-24e2033cd77d tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:41:07.864970 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0e3d2044-e2c1-47cf-88cf-24e2033cd77d tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: dfc0eca3-6cc0-4d96-9260-54bc814da794] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:41:07.875198 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0e3d2044-e2c1-47cf-88cf-24e2033cd77d tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:41:07.875989 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0e3d2044-e2c1-47cf-88cf-24e2033cd77d tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:41:07.876727 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0e3d2044-e2c1-47cf-88cf-24e2033cd77d tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:41:07.877187 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0e3d2044-e2c1-47cf-88cf-24e2033cd77d tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:41:07.877902 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0e3d2044-e2c1-47cf-88cf-24e2033cd77d tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:41:07.878324 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0e3d2044-e2c1-47cf-88cf-24e2033cd77d tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:41:07.914966 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0e3d2044-e2c1-47cf-88cf-24e2033cd77d tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:41:07.915535 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0e3d2044-e2c1-47cf-88cf-24e2033cd77d tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:41:07.915997 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0e3d2044-e2c1-47cf-88cf-24e2033cd77d tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:41:07.916473 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-0e3d2044-e2c1-47cf-88cf-24e2033cd77d tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lazy-loading 'fault' on Instance uuid dfc0eca3-6cc0-4d96-9260-54bc814da794 {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 04:41:07.960760 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0e3d2044-e2c1-47cf-88cf-24e2033cd77d tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:41:07.969148 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0e3d2044-e2c1-47cf-88cf-24e2033cd77d tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/dfc0eca3-6cc0-4d96-9260-54bc814da794" status: 200 len: 1356 microversion: 2.1 time: 0.108712 Oct 19 04:41:07.970455 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4322/8171] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:41:07 2022] GET /compute/v2.1/servers/dfc0eca3-6cc0-4d96-9260-54bc814da794 => generated 1356 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:41:08.995227 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-8ec85f23-386b-403e-9c6a-5fa4045e2d2e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:41:08.995937 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-8ec85f23-386b-403e-9c6a-5fa4045e2d2e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: dfc0eca3-6cc0-4d96-9260-54bc814da794] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:41:09.002169 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8ec85f23-386b-403e-9c6a-5fa4045e2d2e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:41:09.002658 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8ec85f23-386b-403e-9c6a-5fa4045e2d2e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:41:09.003101 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8ec85f23-386b-403e-9c6a-5fa4045e2d2e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:41:09.003793 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8ec85f23-386b-403e-9c6a-5fa4045e2d2e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:41:09.004252 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8ec85f23-386b-403e-9c6a-5fa4045e2d2e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:41:09.005174 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8ec85f23-386b-403e-9c6a-5fa4045e2d2e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:41:09.018517 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-8ec85f23-386b-403e-9c6a-5fa4045e2d2e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] HTTP exception thrown: Instance dfc0eca3-6cc0-4d96-9260-54bc814da794 could not be found. Oct 19 04:41:09.020151 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-8ec85f23-386b-403e-9c6a-5fa4045e2d2e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Request method failure captured: Oct 19 04:41:09.020151 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/dfc0eca3-6cc0-4d96-9260-54bc814da794 HTTP/1.1 Oct 19 04:41:09.020151 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 04:41:09.020151 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 04:41:09.020151 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 04:41:09.020151 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 04:41:09.020151 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 04:41:09.020151 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 04:41:09.020151 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 04:41:09.020151 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 04:41:09.020151 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT35NpThLGkEnkUgxysLlsfJIyjHqx4L2LT0k6tcbhBDHVJc-wSjP3KeYxe20ELM4-EyhMTutgojR4K9EWIX4amldsFPPM0deHzYTPzrRD1C-x1vHinBbpM7CZBL8f9PKcXGCu_hivxaz25FuBZI0OCPMvGiPgwKv7T2jvjsl4ijCBYk Oct 19 04:41:09.020151 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 04:41:09.020151 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 04:41:09.020151 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 04:41:09.020151 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 04:41:09.020151 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 04:41:09.020151 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 04:41:09.020151 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: d31be961273b43ebb4c58e2350042660 Oct 19 04:41:09.020151 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1897523363 Oct 19 04:41:09.020151 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 04:41:09.020151 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 04:41:09.020151 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d31be961273b43ebb4c58e2350042660"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d31be961273b43ebb4c58e2350042660"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d31be961273b43ebb4c58e2350042660"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d31be961273b43ebb4c58e2350042660", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 04:41:09.020151 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1897523363 Oct 19 04:41:09.020151 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: d31be961273b43ebb4c58e2350042660 Oct 19 04:41:09.020151 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1897523363 Oct 19 04:41:09.020151 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-TestNetworkAdvancedServerOps-1897523363-project Oct 19 04:41:09.020151 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 04:41:09.020151 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 04:41:09.020151 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 834b809f82734666a6d2aea092429cbd Oct 19 04:41:09.020151 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1897523363-project Oct 19 04:41:09.020151 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 04:41:09.020151 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance dfc0eca3-6cc0-4d96-9260-54bc814da794 could not be found. Oct 19 04:41:09.020151 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': 'dfc0eca3-6cc0-4d96-9260-54bc814da794'} Oct 19 04:41:09.020151 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 04:41:09.020151 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:41:09.020151 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 04:41:09.020151 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 04:41:09.020151 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 04:41:09.020151 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 04:41:09.020151 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 04:41:09.020151 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 04:41:09.020151 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 04:41:09.020151 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 04:41:09.020151 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfc0eca3-6cc0-4d96-9260-54bc814da794 could not be found. Oct 19 04:41:09.020151 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:41:09.020151 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:41:09.020151 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:41:09.020151 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:41:09.020151 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:41:09.020151 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:41:09.020151 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 04:41:09.020151 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 04:41:09.020151 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 04:41:09.020151 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 04:41:09.020151 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 04:41:09.020151 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 04:41:09.020151 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 04:41:09.020151 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 04:41:09.020151 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 04:41:09.020151 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 04:41:09.020151 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfc0eca3-6cc0-4d96-9260-54bc814da794 could not be found. Oct 19 04:41:09.020151 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:41:09.020151 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:41:09.026349 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:41:09.026349 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:41:09.026349 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:41:09.026349 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:41:09.026349 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 04:41:09.026349 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 04:41:09.026349 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfc0eca3-6cc0-4d96-9260-54bc814da794 could not be found. Oct 19 04:41:09.026349 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:41:09.026349 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-8ec85f23-386b-403e-9c6a-5fa4045e2d2e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Returning 404 to user: Instance dfc0eca3-6cc0-4d96-9260-54bc814da794 could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 04:41:09.026349 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-8ec85f23-386b-403e-9c6a-5fa4045e2d2e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/dfc0eca3-6cc0-4d96-9260-54bc814da794" status: 404 len: 111 microversion: 2.1 time: 0.032122 Oct 19 04:41:09.026349 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3850/8172] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:41:08 2022] GET /compute/v2.1/servers/dfc0eca3-6cc0-4d96-9260-54bc814da794 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 04:41:12.799418 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2d8d5b13-dfa6-47d6-b9ce-0ac7c9a8de75 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '.version_select at 0x7fc128048040>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:41:12.868397 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2d8d5b13-dfa6-47d6-b9ce-0ac7c9a8de75 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1767798320" status: 202 len: 0 microversion: 2.1 time: 0.073145 Oct 19 04:41:12.873881 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4323/8173] 10.222.0.52 () {58 vars in 1284 bytes} [Wed Oct 19 04:41:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1767798320 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 04:41:12.899506 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5ec12776-2500-493f-8754-b06163ef74eb tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Action: 'create', calling method: .version_select at 0x7fc12b97c1f0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1943843425", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPlKWu1gwlqEZadULhl97q8TLHF2yLu0srK1fnsNYL6rSXLTZEEcjSAAuhD3+xfgWHWh+UKkqNeS7qOKfxfOZjxUg7dt6+tbe60KNG4Dz1bgKXTxSg17PG4BvxTbenDkIA=="}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:41:12.917418 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-5ec12776-2500-493f-8754-b06163ef74eb tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Getting quotas for project d31be961273b43ebb4c58e2350042660. Resources: {'key_pairs'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 04:41:12.924972 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-5ec12776-2500-493f-8754-b06163ef74eb tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Getting quotas for user 834b809f82734666a6d2aea092429cbd and project d31be961273b43ebb4c58e2350042660. Resources: {'key_pairs'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 04:41:13.017019 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5ec12776-2500-493f-8754-b06163ef74eb tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.121894 Oct 19 04:41:13.017832 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3851/8174] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Oct 19 04:41:12 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 04:41:20.693695 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:41:20.697836 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f029b156-9665-4491-96c7-c5ffb0f8cd24 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1357503019", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "networks": [{"uuid": "681559bd-a7df-4c8a-a0fa-a14503fa3fd9"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1943843425", "security_groups": [{"name": "tempest-secgroup-smoke-436031541"}]}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:41:20.811573 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-f029b156-9665-4491-96c7-c5ffb0f8cd24 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] validate_networks() for [('681559bd-a7df-4c8a-a0fa-a14503fa3fd9', None, None, None, None, None)] {{(pid=121134) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 04:41:21.261575 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-f029b156-9665-4491-96c7-c5ffb0f8cd24 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Flavor limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 04:41:21.262032 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-f029b156-9665-4491-96c7-c5ffb0f8cd24 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Image limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 04:41:21.262597 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-f029b156-9665-4491-96c7-c5ffb0f8cd24 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Flavor pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 04:41:21.263028 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-f029b156-9665-4491-96c7-c5ffb0f8cd24 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Image pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 04:41:21.263489 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-f029b156-9665-4491-96c7-c5ffb0f8cd24 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 04:41:21.273470 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f029b156-9665-4491-96c7-c5ffb0f8cd24 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:41:21.274506 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f029b156-9665-4491-96c7-c5ffb0f8cd24 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:41:21.275375 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f029b156-9665-4491-96c7-c5ffb0f8cd24 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:41:21.276175 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f029b156-9665-4491-96c7-c5ffb0f8cd24 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:41:21.276666 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f029b156-9665-4491-96c7-c5ffb0f8cd24 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:41:21.277117 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f029b156-9665-4491-96c7-c5ffb0f8cd24 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:41:21.298324 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-f029b156-9665-4491-96c7-c5ffb0f8cd24 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Getting quotas for project d31be961273b43ebb4c58e2350042660. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 04:41:21.304897 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-f029b156-9665-4491-96c7-c5ffb0f8cd24 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Getting quotas for user 834b809f82734666a6d2aea092429cbd and project d31be961273b43ebb4c58e2350042660. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 04:41:21.319701 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f029b156-9665-4491-96c7-c5ffb0f8cd24 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Going to run 1 instances... {{(pid=121134) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 04:41:21.322453 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f029b156-9665-4491-96c7-c5ffb0f8cd24 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: 0a637112-2c47-4945-87bf-ca7634ce7c7b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 04:41:21.470640 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f029b156-9665-4491-96c7-c5ffb0f8cd24 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.779343 Oct 19 04:41:21.478899 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4324/8175] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 04:41:20 2022] POST /compute/v2.1/servers => generated 405 bytes in 788 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 04:41:21.482636 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=12 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:41:21.486890 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-52c41a69-aff2-487c-82f6-ddef8b41dde6 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:41:21.492905 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-52c41a69-aff2-487c-82f6-ddef8b41dde6 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: 0a637112-2c47-4945-87bf-ca7634ce7c7b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:41:21.560141 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-52c41a69-aff2-487c-82f6-ddef8b41dde6 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:41:21.571551 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-52c41a69-aff2-487c-82f6-ddef8b41dde6 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/0a637112-2c47-4945-87bf-ca7634ce7c7b" status: 200 len: 1267 microversion: 2.1 time: 0.090699 Oct 19 04:41:21.572853 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3852/8176] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:41:21 2022] GET /compute/v2.1/servers/0a637112-2c47-4945-87bf-ca7634ce7c7b => generated 1267 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:41:22.597265 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-154cfc38-e7b5-4b6f-a739-d111599ec84b tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:41:22.598499 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-154cfc38-e7b5-4b6f-a739-d111599ec84b tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: 0a637112-2c47-4945-87bf-ca7634ce7c7b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:41:22.618305 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-154cfc38-e7b5-4b6f-a739-d111599ec84b tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:41:22.618821 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-154cfc38-e7b5-4b6f-a739-d111599ec84b tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:41:22.619282 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-154cfc38-e7b5-4b6f-a739-d111599ec84b tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:41:22.620104 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-154cfc38-e7b5-4b6f-a739-d111599ec84b tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:41:22.620585 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-154cfc38-e7b5-4b6f-a739-d111599ec84b tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:41:22.621059 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-154cfc38-e7b5-4b6f-a739-d111599ec84b tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:41:22.686076 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-154cfc38-e7b5-4b6f-a739-d111599ec84b tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:41:22.694123 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-154cfc38-e7b5-4b6f-a739-d111599ec84b tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/0a637112-2c47-4945-87bf-ca7634ce7c7b" status: 200 len: 1271 microversion: 2.1 time: 0.101821 Oct 19 04:41:22.694709 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4325/8177] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:41:22 2022] GET /compute/v2.1/servers/0a637112-2c47-4945-87bf-ca7634ce7c7b => generated 1271 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:41:23.717841 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d0974948-1917-4f14-9e70-ae2d825606fb tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:41:23.718466 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d0974948-1917-4f14-9e70-ae2d825606fb tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: 0a637112-2c47-4945-87bf-ca7634ce7c7b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:41:23.726287 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d0974948-1917-4f14-9e70-ae2d825606fb tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:41:23.726785 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d0974948-1917-4f14-9e70-ae2d825606fb tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:41:23.727230 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d0974948-1917-4f14-9e70-ae2d825606fb tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:41:23.727934 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d0974948-1917-4f14-9e70-ae2d825606fb tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:41:23.728393 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d0974948-1917-4f14-9e70-ae2d825606fb tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:41:23.728824 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d0974948-1917-4f14-9e70-ae2d825606fb tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:41:23.796724 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d0974948-1917-4f14-9e70-ae2d825606fb tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:41:23.805263 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d0974948-1917-4f14-9e70-ae2d825606fb tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/0a637112-2c47-4945-87bf-ca7634ce7c7b" status: 200 len: 1263 microversion: 2.1 time: 0.091473 Oct 19 04:41:23.805879 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3853/8178] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:41:23 2022] GET /compute/v2.1/servers/0a637112-2c47-4945-87bf-ca7634ce7c7b => generated 1263 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:41:24.829396 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-27057fbe-df7d-4c69-867d-880d4170b963 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:41:24.830031 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-27057fbe-df7d-4c69-867d-880d4170b963 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: 0a637112-2c47-4945-87bf-ca7634ce7c7b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:41:24.837613 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-27057fbe-df7d-4c69-867d-880d4170b963 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:41:24.838187 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-27057fbe-df7d-4c69-867d-880d4170b963 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:41:24.838570 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-27057fbe-df7d-4c69-867d-880d4170b963 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:41:24.839280 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-27057fbe-df7d-4c69-867d-880d4170b963 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:41:24.839763 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-27057fbe-df7d-4c69-867d-880d4170b963 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:41:24.840186 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-27057fbe-df7d-4c69-867d-880d4170b963 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:41:24.909179 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-27057fbe-df7d-4c69-867d-880d4170b963 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:41:24.917893 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-27057fbe-df7d-4c69-867d-880d4170b963 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/0a637112-2c47-4945-87bf-ca7634ce7c7b" status: 200 len: 1325 microversion: 2.1 time: 0.092299 Oct 19 04:41:24.918483 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4326/8179] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:41:24 2022] GET /compute/v2.1/servers/0a637112-2c47-4945-87bf-ca7634ce7c7b => generated 1325 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:41:25.940642 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0fa80e40-8712-4c36-80ae-35e8767077b8 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:41:25.941267 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0fa80e40-8712-4c36-80ae-35e8767077b8 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: 0a637112-2c47-4945-87bf-ca7634ce7c7b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:41:25.948125 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0fa80e40-8712-4c36-80ae-35e8767077b8 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:41:25.948619 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0fa80e40-8712-4c36-80ae-35e8767077b8 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:41:25.949066 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0fa80e40-8712-4c36-80ae-35e8767077b8 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:41:25.951101 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0fa80e40-8712-4c36-80ae-35e8767077b8 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:41:25.951599 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0fa80e40-8712-4c36-80ae-35e8767077b8 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:41:25.952047 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0fa80e40-8712-4c36-80ae-35e8767077b8 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:41:26.080913 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-742d7e27-794d-4e1c-9a7b-dd7148b530b2 req-ef8b5506-36c2-4d9b-a5b3-417500f26208 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a637112-2c47-4945-87bf-ca7634ce7c7b", "tag": "e07d1261-beab-4164-af06-46d531723878"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:41:26.094314 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-742d7e27-794d-4e1c-9a7b-dd7148b530b2 req-ef8b5506-36c2-4d9b-a5b3-417500f26208 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:41:26.094902 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-742d7e27-794d-4e1c-9a7b-dd7148b530b2 req-ef8b5506-36c2-4d9b-a5b3-417500f26208 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:41:26.095434 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-742d7e27-794d-4e1c-9a7b-dd7148b530b2 req-ef8b5506-36c2-4d9b-a5b3-417500f26208 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:41:26.107834 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-742d7e27-794d-4e1c-9a7b-dd7148b530b2 req-ef8b5506-36c2-4d9b-a5b3-417500f26208 service nova] Creating event network-changed:e07d1261-beab-4164-af06-46d531723878 for instance 0a637112-2c47-4945-87bf-ca7634ce7c7b on n-h2-861333-8 Oct 19 04:41:26.112954 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-742d7e27-794d-4e1c-9a7b-dd7148b530b2 req-ef8b5506-36c2-4d9b-a5b3-417500f26208 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036634 Oct 19 04:41:26.114091 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4327/8180] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:41:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:41:26.143048 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-0fa80e40-8712-4c36-80ae-35e8767077b8 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:41:26.151507 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0fa80e40-8712-4c36-80ae-35e8767077b8 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/0a637112-2c47-4945-87bf-ca7634ce7c7b" status: 200 len: 1392 microversion: 2.1 time: 0.214753 Oct 19 04:41:26.152107 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3854/8181] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:41:25 2022] GET /compute/v2.1/servers/0a637112-2c47-4945-87bf-ca7634ce7c7b => generated 1392 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:41:27.176926 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c20e3455-c04b-44ed-84ea-040ce1d8659c tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:41:27.177673 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c20e3455-c04b-44ed-84ea-040ce1d8659c tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: 0a637112-2c47-4945-87bf-ca7634ce7c7b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:41:27.183874 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c20e3455-c04b-44ed-84ea-040ce1d8659c tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:41:27.184372 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c20e3455-c04b-44ed-84ea-040ce1d8659c tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:41:27.184825 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c20e3455-c04b-44ed-84ea-040ce1d8659c tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:41:27.185570 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c20e3455-c04b-44ed-84ea-040ce1d8659c tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:41:27.186040 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c20e3455-c04b-44ed-84ea-040ce1d8659c tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:41:27.186483 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c20e3455-c04b-44ed-84ea-040ce1d8659c tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:41:27.318943 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c20e3455-c04b-44ed-84ea-040ce1d8659c tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:41:27.326672 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c20e3455-c04b-44ed-84ea-040ce1d8659c tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/0a637112-2c47-4945-87bf-ca7634ce7c7b" status: 200 len: 1392 microversion: 2.1 time: 0.155463 Oct 19 04:41:27.327246 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4328/8182] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:41:27 2022] GET /compute/v2.1/servers/0a637112-2c47-4945-87bf-ca7634ce7c7b => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:41:28.349828 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-258f9eb8-bcfb-40a0-8a52-37972fe69632 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:41:28.350429 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-258f9eb8-bcfb-40a0-8a52-37972fe69632 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: 0a637112-2c47-4945-87bf-ca7634ce7c7b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:41:28.357219 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-258f9eb8-bcfb-40a0-8a52-37972fe69632 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:41:28.357738 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-258f9eb8-bcfb-40a0-8a52-37972fe69632 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:41:28.358175 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-258f9eb8-bcfb-40a0-8a52-37972fe69632 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:41:28.358861 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-258f9eb8-bcfb-40a0-8a52-37972fe69632 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:41:28.359314 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-258f9eb8-bcfb-40a0-8a52-37972fe69632 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:41:28.359740 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-258f9eb8-bcfb-40a0-8a52-37972fe69632 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:41:28.491501 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-258f9eb8-bcfb-40a0-8a52-37972fe69632 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:41:28.499195 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-258f9eb8-bcfb-40a0-8a52-37972fe69632 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/0a637112-2c47-4945-87bf-ca7634ce7c7b" status: 200 len: 1392 microversion: 2.1 time: 0.153262 Oct 19 04:41:28.499766 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3855/8183] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:41:28 2022] GET /compute/v2.1/servers/0a637112-2c47-4945-87bf-ca7634ce7c7b => generated 1392 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:41:29.522549 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-58a2937f-c1bb-4d58-8aed-fcb39235d870 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:41:29.523180 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-58a2937f-c1bb-4d58-8aed-fcb39235d870 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: 0a637112-2c47-4945-87bf-ca7634ce7c7b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:41:29.530001 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-58a2937f-c1bb-4d58-8aed-fcb39235d870 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:41:29.530524 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-58a2937f-c1bb-4d58-8aed-fcb39235d870 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:41:29.530977 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-58a2937f-c1bb-4d58-8aed-fcb39235d870 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:41:29.531686 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-58a2937f-c1bb-4d58-8aed-fcb39235d870 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:41:29.532155 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-58a2937f-c1bb-4d58-8aed-fcb39235d870 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:41:29.532597 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-58a2937f-c1bb-4d58-8aed-fcb39235d870 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:41:29.670535 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-58a2937f-c1bb-4d58-8aed-fcb39235d870 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:41:29.679099 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-58a2937f-c1bb-4d58-8aed-fcb39235d870 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/0a637112-2c47-4945-87bf-ca7634ce7c7b" status: 200 len: 1392 microversion: 2.1 time: 0.161096 Oct 19 04:41:29.679890 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4329/8184] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:41:29 2022] GET /compute/v2.1/servers/0a637112-2c47-4945-87bf-ca7634ce7c7b => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:41:30.702614 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7f6e6c9b-0f0a-496b-ae2c-04842190526a tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:41:30.703336 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7f6e6c9b-0f0a-496b-ae2c-04842190526a tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: 0a637112-2c47-4945-87bf-ca7634ce7c7b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:41:30.711119 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7f6e6c9b-0f0a-496b-ae2c-04842190526a tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:41:30.711617 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7f6e6c9b-0f0a-496b-ae2c-04842190526a tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:41:30.712053 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7f6e6c9b-0f0a-496b-ae2c-04842190526a tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:41:30.712811 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7f6e6c9b-0f0a-496b-ae2c-04842190526a tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:41:30.713263 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7f6e6c9b-0f0a-496b-ae2c-04842190526a tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:41:30.713794 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7f6e6c9b-0f0a-496b-ae2c-04842190526a tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:41:30.846814 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7f6e6c9b-0f0a-496b-ae2c-04842190526a tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:41:30.854622 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7f6e6c9b-0f0a-496b-ae2c-04842190526a tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/0a637112-2c47-4945-87bf-ca7634ce7c7b" status: 200 len: 1392 microversion: 2.1 time: 0.155956 Oct 19 04:41:30.855203 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3856/8185] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:41:30 2022] GET /compute/v2.1/servers/0a637112-2c47-4945-87bf-ca7634ce7c7b => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:41:31.301608 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-6158f67e-9b63-4f48-bf1b-995927e7bb9e req-c2007556-4a09-4a5f-bfba-206b4cd9ec0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a637112-2c47-4945-87bf-ca7634ce7c7b", "name": "network-vif-plugged", "status": "completed", "tag": "e07d1261-beab-4164-af06-46d531723878"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:41:31.304975 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:41:31.310371 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-6158f67e-9b63-4f48-bf1b-995927e7bb9e req-c2007556-4a09-4a5f-bfba-206b4cd9ec0a service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:41:31.310874 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-6158f67e-9b63-4f48-bf1b-995927e7bb9e req-c2007556-4a09-4a5f-bfba-206b4cd9ec0a service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:41:31.311327 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-6158f67e-9b63-4f48-bf1b-995927e7bb9e req-c2007556-4a09-4a5f-bfba-206b4cd9ec0a service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:41:31.315605 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=6 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:41:31.327787 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-6158f67e-9b63-4f48-bf1b-995927e7bb9e req-c2007556-4a09-4a5f-bfba-206b4cd9ec0a service nova] Creating event network-vif-plugged:e07d1261-beab-4164-af06-46d531723878 for instance 0a637112-2c47-4945-87bf-ca7634ce7c7b on n-h2-861333-8 Oct 19 04:41:31.328183 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-6158f67e-9b63-4f48-bf1b-995927e7bb9e req-c2007556-4a09-4a5f-bfba-206b4cd9ec0a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033409 Oct 19 04:41:31.328825 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4330/8186] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:41:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 04:41:31.884638 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-51741549-3553-4c55-9be8-78d521a85fe3 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:41:31.885290 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-51741549-3553-4c55-9be8-78d521a85fe3 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: 0a637112-2c47-4945-87bf-ca7634ce7c7b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:41:31.888481 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=6 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:41:31.893155 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-51741549-3553-4c55-9be8-78d521a85fe3 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:41:31.893684 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-51741549-3553-4c55-9be8-78d521a85fe3 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:41:31.894129 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-51741549-3553-4c55-9be8-78d521a85fe3 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:41:31.895368 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-51741549-3553-4c55-9be8-78d521a85fe3 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:41:31.896212 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-51741549-3553-4c55-9be8-78d521a85fe3 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:41:31.896552 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-51741549-3553-4c55-9be8-78d521a85fe3 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:41:32.036310 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-51741549-3553-4c55-9be8-78d521a85fe3 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:41:32.044116 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-51741549-3553-4c55-9be8-78d521a85fe3 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/0a637112-2c47-4945-87bf-ca7634ce7c7b" status: 200 len: 1392 microversion: 2.1 time: 0.163359 Oct 19 04:41:32.044697 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3857/8187] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:41:31 2022] GET /compute/v2.1/servers/0a637112-2c47-4945-87bf-ca7634ce7c7b => generated 1392 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:41:33.068431 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-20b44c9f-066d-4325-b744-6abf74261cfd tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:41:33.069154 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-20b44c9f-066d-4325-b744-6abf74261cfd tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: 0a637112-2c47-4945-87bf-ca7634ce7c7b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:41:33.076375 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-20b44c9f-066d-4325-b744-6abf74261cfd tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:41:33.076883 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-20b44c9f-066d-4325-b744-6abf74261cfd tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:41:33.077348 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-20b44c9f-066d-4325-b744-6abf74261cfd tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:41:33.078083 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-20b44c9f-066d-4325-b744-6abf74261cfd tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:41:33.078559 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-20b44c9f-066d-4325-b744-6abf74261cfd tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:41:33.079010 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-20b44c9f-066d-4325-b744-6abf74261cfd tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:41:33.210056 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-20b44c9f-066d-4325-b744-6abf74261cfd tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:41:33.217807 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-20b44c9f-066d-4325-b744-6abf74261cfd tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/0a637112-2c47-4945-87bf-ca7634ce7c7b" status: 200 len: 1564 microversion: 2.1 time: 0.154520 Oct 19 04:41:33.218389 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4331/8188] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:41:33 2022] GET /compute/v2.1/servers/0a637112-2c47-4945-87bf-ca7634ce7c7b => generated 1564 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:41:33.240917 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ecc4ea44-624d-44e8-b292-26870b401f12 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:41:33.241565 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ecc4ea44-624d-44e8-b292-26870b401f12 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: 0a637112-2c47-4945-87bf-ca7634ce7c7b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:41:33.247919 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ecc4ea44-624d-44e8-b292-26870b401f12 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:41:33.248402 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ecc4ea44-624d-44e8-b292-26870b401f12 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:41:33.248841 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ecc4ea44-624d-44e8-b292-26870b401f12 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:41:33.249564 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ecc4ea44-624d-44e8-b292-26870b401f12 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:41:33.250021 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ecc4ea44-624d-44e8-b292-26870b401f12 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:41:33.250444 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ecc4ea44-624d-44e8-b292-26870b401f12 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:41:33.659476 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ecc4ea44-624d-44e8-b292-26870b401f12 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:41:33.667888 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ecc4ea44-624d-44e8-b292-26870b401f12 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/0a637112-2c47-4945-87bf-ca7634ce7c7b" status: 200 len: 1564 microversion: 2.1 time: 0.431605 Oct 19 04:41:33.668463 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3858/8189] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:41:33 2022] GET /compute/v2.1/servers/0a637112-2c47-4945-87bf-ca7634ce7c7b => generated 1564 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:41:35.487157 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1314def5-2b29-4e93-ab65-6794c2442fc6 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:41:35.487785 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1314def5-2b29-4e93-ab65-6794c2442fc6 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: 0a637112-2c47-4945-87bf-ca7634ce7c7b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:41:35.494329 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-e2f2bc62-5cac-47bc-b9b2-3836a36c9db1 req-11c5ccf9-69f2-4cf7-8c3a-c92f70b128b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a637112-2c47-4945-87bf-ca7634ce7c7b", "tag": "e07d1261-beab-4164-af06-46d531723878"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:41:35.499922 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:41:35.502845 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:41:35.506035 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-e2f2bc62-5cac-47bc-b9b2-3836a36c9db1 req-11c5ccf9-69f2-4cf7-8c3a-c92f70b128b4 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:41:35.506636 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-e2f2bc62-5cac-47bc-b9b2-3836a36c9db1 req-11c5ccf9-69f2-4cf7-8c3a-c92f70b128b4 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:41:35.507516 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-e2f2bc62-5cac-47bc-b9b2-3836a36c9db1 req-11c5ccf9-69f2-4cf7-8c3a-c92f70b128b4 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:41:35.508375 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1314def5-2b29-4e93-ab65-6794c2442fc6 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:41:35.508876 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1314def5-2b29-4e93-ab65-6794c2442fc6 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:41:35.509335 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1314def5-2b29-4e93-ab65-6794c2442fc6 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:41:35.514481 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1314def5-2b29-4e93-ab65-6794c2442fc6 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:41:35.514481 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1314def5-2b29-4e93-ab65-6794c2442fc6 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:41:35.514481 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1314def5-2b29-4e93-ab65-6794c2442fc6 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:41:35.520952 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-e2f2bc62-5cac-47bc-b9b2-3836a36c9db1 req-11c5ccf9-69f2-4cf7-8c3a-c92f70b128b4 service nova] Creating event network-changed:e07d1261-beab-4164-af06-46d531723878 for instance 0a637112-2c47-4945-87bf-ca7634ce7c7b on n-h2-861333-8 Oct 19 04:41:35.527015 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-e2f2bc62-5cac-47bc-b9b2-3836a36c9db1 req-11c5ccf9-69f2-4cf7-8c3a-c92f70b128b4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035654 Oct 19 04:41:35.527755 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3859/8190] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:41:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:41:35.740943 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-1314def5-2b29-4e93-ab65-6794c2442fc6 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:41:35.749135 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1314def5-2b29-4e93-ab65-6794c2442fc6 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/0a637112-2c47-4945-87bf-ca7634ce7c7b" status: 200 len: 1564 microversion: 2.1 time: 0.266078 Oct 19 04:41:35.751509 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4332/8191] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:41:35 2022] GET /compute/v2.1/servers/0a637112-2c47-4945-87bf-ca7634ce7c7b => generated 1564 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:41:59.053789 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=38 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:41:59.058162 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d07ccbe7-4817-43ca-b802-a1bb8bc80af4 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:41:59.060474 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d07ccbe7-4817-43ca-b802-a1bb8bc80af4 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: 0a637112-2c47-4945-87bf-ca7634ce7c7b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:41:59.067170 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d07ccbe7-4817-43ca-b802-a1bb8bc80af4 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:41:59.067672 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d07ccbe7-4817-43ca-b802-a1bb8bc80af4 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:41:59.068202 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d07ccbe7-4817-43ca-b802-a1bb8bc80af4 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:41:59.068904 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d07ccbe7-4817-43ca-b802-a1bb8bc80af4 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:41:59.069386 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d07ccbe7-4817-43ca-b802-a1bb8bc80af4 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:41:59.084525 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d07ccbe7-4817-43ca-b802-a1bb8bc80af4 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:41:59.126157 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d07ccbe7-4817-43ca-b802-a1bb8bc80af4 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "POST /compute/v2.1/servers/0a637112-2c47-4945-87bf-ca7634ce7c7b/action" status: 200 len: 24565 microversion: 2.1 time: 0.069826 Oct 19 04:41:59.126157 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3860/8192] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 04:41:59 2022] POST /compute/v2.1/servers/0a637112-2c47-4945-87bf-ca7634ce7c7b/action => generated 24565 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 04:42:10.036662 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-184492b9-0120-4228-9e50-6a39a107effe tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:42:10.038744 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=42 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:42:10.043544 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-184492b9-0120-4228-9e50-6a39a107effe tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:42:10.044051 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-184492b9-0120-4228-9e50-6a39a107effe tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:42:10.044507 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-184492b9-0120-4228-9e50-6a39a107effe tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:42:10.066900 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-184492b9-0120-4228-9e50-6a39a107effe tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: 0a637112-2c47-4945-87bf-ca7634ce7c7b] Going to try to stop instance {{(pid=121134) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 19 04:42:10.182764 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-184492b9-0120-4228-9e50-6a39a107effe tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "POST /compute/v2.1/servers/0a637112-2c47-4945-87bf-ca7634ce7c7b/action" status: 202 len: 0 microversion: 2.1 time: 0.151289 Oct 19 04:42:10.183411 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4333/8193] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 04:42:10 2022] POST /compute/v2.1/servers/0a637112-2c47-4945-87bf-ca7634ce7c7b/action => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 04:42:10.192404 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e120a80e-baad-4148-9925-b2c726ac480f tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:42:10.197901 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e120a80e-baad-4148-9925-b2c726ac480f tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: 0a637112-2c47-4945-87bf-ca7634ce7c7b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:42:10.197901 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=4 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:42:10.201413 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e120a80e-baad-4148-9925-b2c726ac480f tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:42:10.201908 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e120a80e-baad-4148-9925-b2c726ac480f tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:42:10.202351 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e120a80e-baad-4148-9925-b2c726ac480f tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:42:10.203051 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e120a80e-baad-4148-9925-b2c726ac480f tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:42:10.203514 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e120a80e-baad-4148-9925-b2c726ac480f tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:42:10.203944 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e120a80e-baad-4148-9925-b2c726ac480f tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:42:10.344009 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-e120a80e-baad-4148-9925-b2c726ac480f tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:42:10.352481 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e120a80e-baad-4148-9925-b2c726ac480f tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/0a637112-2c47-4945-87bf-ca7634ce7c7b" status: 200 len: 1693 microversion: 2.1 time: 0.164412 Oct 19 04:42:10.353053 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3861/8194] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:42:10 2022] GET /compute/v2.1/servers/0a637112-2c47-4945-87bf-ca7634ce7c7b => generated 1693 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:42:11.377967 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d31111bd-db61-4ed1-830b-614fb78449c0 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:42:11.378827 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d31111bd-db61-4ed1-830b-614fb78449c0 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: 0a637112-2c47-4945-87bf-ca7634ce7c7b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:42:11.386809 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d31111bd-db61-4ed1-830b-614fb78449c0 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:42:11.387913 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d31111bd-db61-4ed1-830b-614fb78449c0 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:42:11.388449 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d31111bd-db61-4ed1-830b-614fb78449c0 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:42:11.389458 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d31111bd-db61-4ed1-830b-614fb78449c0 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:42:11.390012 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d31111bd-db61-4ed1-830b-614fb78449c0 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:42:11.390673 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d31111bd-db61-4ed1-830b-614fb78449c0 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:42:11.525405 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d31111bd-db61-4ed1-830b-614fb78449c0 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:42:11.533807 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d31111bd-db61-4ed1-830b-614fb78449c0 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/0a637112-2c47-4945-87bf-ca7634ce7c7b" status: 200 len: 1693 microversion: 2.1 time: 0.160977 Oct 19 04:42:11.534391 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4334/8195] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:42:11 2022] GET /compute/v2.1/servers/0a637112-2c47-4945-87bf-ca7634ce7c7b => generated 1693 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:42:12.564606 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1a9871ae-2e87-494f-a768-3833f2e385e0 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:42:12.565234 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1a9871ae-2e87-494f-a768-3833f2e385e0 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: 0a637112-2c47-4945-87bf-ca7634ce7c7b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:42:12.572916 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1a9871ae-2e87-494f-a768-3833f2e385e0 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:42:12.573473 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1a9871ae-2e87-494f-a768-3833f2e385e0 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:42:12.573923 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1a9871ae-2e87-494f-a768-3833f2e385e0 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:42:12.574631 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1a9871ae-2e87-494f-a768-3833f2e385e0 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:42:12.575089 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1a9871ae-2e87-494f-a768-3833f2e385e0 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:42:12.575525 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1a9871ae-2e87-494f-a768-3833f2e385e0 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:42:12.708456 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-1a9871ae-2e87-494f-a768-3833f2e385e0 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:42:12.716437 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1a9871ae-2e87-494f-a768-3833f2e385e0 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/0a637112-2c47-4945-87bf-ca7634ce7c7b" status: 200 len: 1693 microversion: 2.1 time: 0.155740 Oct 19 04:42:12.717016 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3862/8196] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:42:12 2022] GET /compute/v2.1/servers/0a637112-2c47-4945-87bf-ca7634ce7c7b => generated 1693 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:42:13.740104 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0d30f45f-150b-43c9-97fc-b738b2841cd8 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:42:13.740733 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0d30f45f-150b-43c9-97fc-b738b2841cd8 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: 0a637112-2c47-4945-87bf-ca7634ce7c7b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:42:13.747797 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0d30f45f-150b-43c9-97fc-b738b2841cd8 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:42:13.748309 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0d30f45f-150b-43c9-97fc-b738b2841cd8 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:42:13.748776 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0d30f45f-150b-43c9-97fc-b738b2841cd8 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:42:13.749525 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0d30f45f-150b-43c9-97fc-b738b2841cd8 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:42:13.750005 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0d30f45f-150b-43c9-97fc-b738b2841cd8 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:42:13.750457 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0d30f45f-150b-43c9-97fc-b738b2841cd8 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:42:13.884085 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0d30f45f-150b-43c9-97fc-b738b2841cd8 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:42:13.891985 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0d30f45f-150b-43c9-97fc-b738b2841cd8 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/0a637112-2c47-4945-87bf-ca7634ce7c7b" status: 200 len: 1693 microversion: 2.1 time: 0.155777 Oct 19 04:42:13.892559 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4335/8197] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:42:13 2022] GET /compute/v2.1/servers/0a637112-2c47-4945-87bf-ca7634ce7c7b => generated 1693 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:42:14.915928 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-568e6d45-b459-4d0c-b22a-d37d62382b09 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:42:14.916581 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-568e6d45-b459-4d0c-b22a-d37d62382b09 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: 0a637112-2c47-4945-87bf-ca7634ce7c7b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:42:14.923761 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-568e6d45-b459-4d0c-b22a-d37d62382b09 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:42:14.924249 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-568e6d45-b459-4d0c-b22a-d37d62382b09 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:42:14.924694 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-568e6d45-b459-4d0c-b22a-d37d62382b09 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:42:14.925468 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-568e6d45-b459-4d0c-b22a-d37d62382b09 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:42:14.925928 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-568e6d45-b459-4d0c-b22a-d37d62382b09 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:42:14.926362 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-568e6d45-b459-4d0c-b22a-d37d62382b09 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:42:15.061033 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-568e6d45-b459-4d0c-b22a-d37d62382b09 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:42:15.069349 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-568e6d45-b459-4d0c-b22a-d37d62382b09 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/0a637112-2c47-4945-87bf-ca7634ce7c7b" status: 200 len: 1693 microversion: 2.1 time: 0.157310 Oct 19 04:42:15.069969 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3863/8198] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:42:14 2022] GET /compute/v2.1/servers/0a637112-2c47-4945-87bf-ca7634ce7c7b => generated 1693 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:42:16.093326 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ef5f04ec-aa45-4d3f-908d-470bcefa3e8f tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:42:16.094004 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ef5f04ec-aa45-4d3f-908d-470bcefa3e8f tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: 0a637112-2c47-4945-87bf-ca7634ce7c7b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:42:16.101523 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ef5f04ec-aa45-4d3f-908d-470bcefa3e8f tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:42:16.102021 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ef5f04ec-aa45-4d3f-908d-470bcefa3e8f tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:42:16.102470 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ef5f04ec-aa45-4d3f-908d-470bcefa3e8f tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:42:16.103172 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ef5f04ec-aa45-4d3f-908d-470bcefa3e8f tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:42:16.103643 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ef5f04ec-aa45-4d3f-908d-470bcefa3e8f tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:42:16.104080 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ef5f04ec-aa45-4d3f-908d-470bcefa3e8f tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:42:16.239404 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ef5f04ec-aa45-4d3f-908d-470bcefa3e8f tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:42:16.247124 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ef5f04ec-aa45-4d3f-908d-470bcefa3e8f tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/0a637112-2c47-4945-87bf-ca7634ce7c7b" status: 200 len: 1693 microversion: 2.1 time: 0.157739 Oct 19 04:42:16.247701 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4336/8199] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:42:16 2022] GET /compute/v2.1/servers/0a637112-2c47-4945-87bf-ca7634ce7c7b => generated 1693 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:42:17.270662 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7e1c38c5-634f-40e6-babb-a8121d3aefd7 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:42:17.271248 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7e1c38c5-634f-40e6-babb-a8121d3aefd7 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: 0a637112-2c47-4945-87bf-ca7634ce7c7b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:42:17.278109 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7e1c38c5-634f-40e6-babb-a8121d3aefd7 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:42:17.278612 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7e1c38c5-634f-40e6-babb-a8121d3aefd7 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:42:17.279038 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7e1c38c5-634f-40e6-babb-a8121d3aefd7 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:42:17.279729 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7e1c38c5-634f-40e6-babb-a8121d3aefd7 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:42:17.280186 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7e1c38c5-634f-40e6-babb-a8121d3aefd7 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:42:17.280614 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7e1c38c5-634f-40e6-babb-a8121d3aefd7 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:42:17.412441 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7e1c38c5-634f-40e6-babb-a8121d3aefd7 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:42:17.420224 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7e1c38c5-634f-40e6-babb-a8121d3aefd7 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/0a637112-2c47-4945-87bf-ca7634ce7c7b" status: 200 len: 1693 microversion: 2.1 time: 0.153561 Oct 19 04:42:17.420797 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3864/8200] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:42:17 2022] GET /compute/v2.1/servers/0a637112-2c47-4945-87bf-ca7634ce7c7b => generated 1693 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:42:18.446284 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c2c6b1d6-6bd3-48da-8f46-83fff83e8e50 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:42:18.446976 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c2c6b1d6-6bd3-48da-8f46-83fff83e8e50 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: 0a637112-2c47-4945-87bf-ca7634ce7c7b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:42:18.454219 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c2c6b1d6-6bd3-48da-8f46-83fff83e8e50 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:42:18.454785 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c2c6b1d6-6bd3-48da-8f46-83fff83e8e50 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:42:18.455239 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c2c6b1d6-6bd3-48da-8f46-83fff83e8e50 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:42:18.456005 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c2c6b1d6-6bd3-48da-8f46-83fff83e8e50 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:42:18.456472 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c2c6b1d6-6bd3-48da-8f46-83fff83e8e50 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:42:18.456911 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c2c6b1d6-6bd3-48da-8f46-83fff83e8e50 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:42:18.597248 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c2c6b1d6-6bd3-48da-8f46-83fff83e8e50 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:42:18.605154 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c2c6b1d6-6bd3-48da-8f46-83fff83e8e50 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/0a637112-2c47-4945-87bf-ca7634ce7c7b" status: 200 len: 1693 microversion: 2.1 time: 0.164859 Oct 19 04:42:18.605765 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4337/8201] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:42:18 2022] GET /compute/v2.1/servers/0a637112-2c47-4945-87bf-ca7634ce7c7b => generated 1693 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:42:19.629426 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ad59f66c-734d-4c38-992c-9259e16d1198 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:42:19.630054 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ad59f66c-734d-4c38-992c-9259e16d1198 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: 0a637112-2c47-4945-87bf-ca7634ce7c7b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:42:19.636931 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ad59f66c-734d-4c38-992c-9259e16d1198 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:42:19.637467 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ad59f66c-734d-4c38-992c-9259e16d1198 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:42:19.637919 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ad59f66c-734d-4c38-992c-9259e16d1198 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:42:19.638616 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ad59f66c-734d-4c38-992c-9259e16d1198 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:42:19.639079 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ad59f66c-734d-4c38-992c-9259e16d1198 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:42:19.639515 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ad59f66c-734d-4c38-992c-9259e16d1198 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:42:19.769991 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ad59f66c-734d-4c38-992c-9259e16d1198 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:42:19.777662 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ad59f66c-734d-4c38-992c-9259e16d1198 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/0a637112-2c47-4945-87bf-ca7634ce7c7b" status: 200 len: 1693 microversion: 2.1 time: 0.152645 Oct 19 04:42:19.778232 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3865/8202] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:42:19 2022] GET /compute/v2.1/servers/0a637112-2c47-4945-87bf-ca7634ce7c7b => generated 1693 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:42:20.800856 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9130513c-20d1-412a-b060-82d3718a3807 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:42:20.801494 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9130513c-20d1-412a-b060-82d3718a3807 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: 0a637112-2c47-4945-87bf-ca7634ce7c7b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:42:20.808527 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9130513c-20d1-412a-b060-82d3718a3807 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:42:20.809031 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9130513c-20d1-412a-b060-82d3718a3807 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:42:20.809517 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9130513c-20d1-412a-b060-82d3718a3807 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:42:20.810234 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9130513c-20d1-412a-b060-82d3718a3807 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:42:20.810707 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9130513c-20d1-412a-b060-82d3718a3807 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:42:20.811191 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9130513c-20d1-412a-b060-82d3718a3807 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:42:20.947038 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9130513c-20d1-412a-b060-82d3718a3807 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:42:20.954919 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9130513c-20d1-412a-b060-82d3718a3807 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/0a637112-2c47-4945-87bf-ca7634ce7c7b" status: 200 len: 1670 microversion: 2.1 time: 0.158041 Oct 19 04:42:20.955506 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4338/8203] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:42:20 2022] GET /compute/v2.1/servers/0a637112-2c47-4945-87bf-ca7634ce7c7b => generated 1670 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:42:22.050497 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2f498ab5-d103-4579-9a3f-aad39218d09e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:42:22.052769 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-2f498ab5-d103-4579-9a3f-aad39218d09e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: 0a637112-2c47-4945-87bf-ca7634ce7c7b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:42:22.056058 n-d-861333-8 devstack@n-api.service[121135]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 04:42:22.056203 n-d-861333-8 devstack@n-api.service[121135]: Wed Oct 19 04:42:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0a637112-2c47-4945-87bf-ca7634ce7c7b/action (ip 10.222.0.52) !!! Oct 19 04:42:22.062773 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2f498ab5-d103-4579-9a3f-aad39218d09e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:42:22.063267 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2f498ab5-d103-4579-9a3f-aad39218d09e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:42:22.063714 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2f498ab5-d103-4579-9a3f-aad39218d09e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:42:22.064417 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2f498ab5-d103-4579-9a3f-aad39218d09e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:42:22.064880 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2f498ab5-d103-4579-9a3f-aad39218d09e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:42:22.065316 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2f498ab5-d103-4579-9a3f-aad39218d09e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:42:22.127404 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2f498ab5-d103-4579-9a3f-aad39218d09e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "POST /compute/v2.1/servers/0a637112-2c47-4945-87bf-ca7634ce7c7b/action" status: 200 len: 37022 microversion: 2.1 time: 0.081373 Oct 19 04:42:22.128050 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3866/8204] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 04:42:22 2022] POST /compute/v2.1/servers/0a637112-2c47-4945-87bf-ca7634ce7c7b/action => generated 37022 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 04:42:22.139875 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ebb18195-1a44-4cce-8d3e-f580238d3dee tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:42:22.147245 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ebb18195-1a44-4cce-8d3e-f580238d3dee tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:42:22.147746 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ebb18195-1a44-4cce-8d3e-f580238d3dee tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:42:22.148233 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ebb18195-1a44-4cce-8d3e-f580238d3dee tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:42:22.171025 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ebb18195-1a44-4cce-8d3e-f580238d3dee tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: 0a637112-2c47-4945-87bf-ca7634ce7c7b] Going to try to start instance {{(pid=121134) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 19 04:42:22.337798 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ebb18195-1a44-4cce-8d3e-f580238d3dee tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "POST /compute/v2.1/servers/0a637112-2c47-4945-87bf-ca7634ce7c7b/action" status: 202 len: 0 microversion: 2.1 time: 0.201260 Oct 19 04:42:22.338451 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4339/8205] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 04:42:22 2022] POST /compute/v2.1/servers/0a637112-2c47-4945-87bf-ca7634ce7c7b/action => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 04:42:22.348032 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-cab3d3bb-b609-44e6-9d8f-891f892615a6 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:42:22.348858 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-cab3d3bb-b609-44e6-9d8f-891f892615a6 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: 0a637112-2c47-4945-87bf-ca7634ce7c7b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:42:22.356205 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cab3d3bb-b609-44e6-9d8f-891f892615a6 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:42:22.356698 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cab3d3bb-b609-44e6-9d8f-891f892615a6 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:42:22.357145 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cab3d3bb-b609-44e6-9d8f-891f892615a6 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:42:22.357886 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cab3d3bb-b609-44e6-9d8f-891f892615a6 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:42:22.358344 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cab3d3bb-b609-44e6-9d8f-891f892615a6 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:42:22.358777 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cab3d3bb-b609-44e6-9d8f-891f892615a6 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:42:22.508097 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-cab3d3bb-b609-44e6-9d8f-891f892615a6 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:42:22.515929 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-cab3d3bb-b609-44e6-9d8f-891f892615a6 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/0a637112-2c47-4945-87bf-ca7634ce7c7b" status: 200 len: 1679 microversion: 2.1 time: 0.172931 Oct 19 04:42:22.516507 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3867/8206] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:42:22 2022] GET /compute/v2.1/servers/0a637112-2c47-4945-87bf-ca7634ce7c7b => generated 1679 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:42:23.541518 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-fdd2d9e2-6b77-4b4d-801e-561be7675679 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:42:23.542241 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-fdd2d9e2-6b77-4b4d-801e-561be7675679 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: 0a637112-2c47-4945-87bf-ca7634ce7c7b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:42:23.551019 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fdd2d9e2-6b77-4b4d-801e-561be7675679 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:42:23.551526 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fdd2d9e2-6b77-4b4d-801e-561be7675679 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:42:23.551989 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fdd2d9e2-6b77-4b4d-801e-561be7675679 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:42:23.552699 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fdd2d9e2-6b77-4b4d-801e-561be7675679 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:42:23.553170 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fdd2d9e2-6b77-4b4d-801e-561be7675679 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:42:23.553676 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fdd2d9e2-6b77-4b4d-801e-561be7675679 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:42:23.699093 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-fdd2d9e2-6b77-4b4d-801e-561be7675679 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:42:23.707298 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-fdd2d9e2-6b77-4b4d-801e-561be7675679 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/0a637112-2c47-4945-87bf-ca7634ce7c7b" status: 200 len: 1679 microversion: 2.1 time: 0.170118 Oct 19 04:42:23.707865 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4340/8207] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:42:23 2022] GET /compute/v2.1/servers/0a637112-2c47-4945-87bf-ca7634ce7c7b => generated 1679 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:42:24.731370 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5e4d1680-17c1-4854-96a2-60bdd9b97b9b tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:42:24.731979 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-5e4d1680-17c1-4854-96a2-60bdd9b97b9b tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: 0a637112-2c47-4945-87bf-ca7634ce7c7b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:42:24.738886 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5e4d1680-17c1-4854-96a2-60bdd9b97b9b tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:42:24.739377 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5e4d1680-17c1-4854-96a2-60bdd9b97b9b tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:42:24.739833 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5e4d1680-17c1-4854-96a2-60bdd9b97b9b tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:42:24.740533 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5e4d1680-17c1-4854-96a2-60bdd9b97b9b tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:42:24.740995 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5e4d1680-17c1-4854-96a2-60bdd9b97b9b tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:42:24.741463 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5e4d1680-17c1-4854-96a2-60bdd9b97b9b tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:42:24.869066 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-5e4d1680-17c1-4854-96a2-60bdd9b97b9b tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:42:24.876874 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5e4d1680-17c1-4854-96a2-60bdd9b97b9b tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/0a637112-2c47-4945-87bf-ca7634ce7c7b" status: 200 len: 1683 microversion: 2.1 time: 0.149494 Oct 19 04:42:24.877468 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3868/8208] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:42:24 2022] GET /compute/v2.1/servers/0a637112-2c47-4945-87bf-ca7634ce7c7b => generated 1683 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:42:51.076286 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2c056101-0d16-464a-afc0-7ccf5af0899f tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:42:51.078419 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2c056101-0d16-464a-afc0-7ccf5af0899f tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: 0a637112-2c47-4945-87bf-ca7634ce7c7b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:42:51.080586 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=17 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:42:51.081395 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:42:51.086685 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2c056101-0d16-464a-afc0-7ccf5af0899f tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:42:51.090453 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2c056101-0d16-464a-afc0-7ccf5af0899f tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:42:51.090453 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2c056101-0d16-464a-afc0-7ccf5af0899f tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:42:51.090453 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2c056101-0d16-464a-afc0-7ccf5af0899f tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:42:51.090453 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2c056101-0d16-464a-afc0-7ccf5af0899f tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:42:51.090453 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2c056101-0d16-464a-afc0-7ccf5af0899f tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:42:51.147140 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2c056101-0d16-464a-afc0-7ccf5af0899f tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "POST /compute/v2.1/servers/0a637112-2c47-4945-87bf-ca7634ce7c7b/action" status: 200 len: 61582 microversion: 2.1 time: 0.075023 Oct 19 04:42:51.147806 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4341/8209] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 04:42:51 2022] POST /compute/v2.1/servers/0a637112-2c47-4945-87bf-ca7634ce7c7b/action => generated 61582 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 04:42:58.214975 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6be5710f-8de7-4989-aa03-84f4767c0688 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:42:58.215541 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6be5710f-8de7-4989-aa03-84f4767c0688 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: 0a637112-2c47-4945-87bf-ca7634ce7c7b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:42:58.218366 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=19 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:42:58.219197 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=46 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:42:58.222842 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-38db8827-97a7-466c-9edc-cc250eb14d89 req-89823894-77b3-44aa-afae-1bcfa4c26466 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a637112-2c47-4945-87bf-ca7634ce7c7b", "tag": "e07d1261-beab-4164-af06-46d531723878"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:42:58.224909 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6be5710f-8de7-4989-aa03-84f4767c0688 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:42:58.225554 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6be5710f-8de7-4989-aa03-84f4767c0688 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:42:58.226038 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6be5710f-8de7-4989-aa03-84f4767c0688 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:42:58.226744 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6be5710f-8de7-4989-aa03-84f4767c0688 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:42:58.227197 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6be5710f-8de7-4989-aa03-84f4767c0688 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:42:58.227810 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6be5710f-8de7-4989-aa03-84f4767c0688 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:42:58.235540 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-38db8827-97a7-466c-9edc-cc250eb14d89 req-89823894-77b3-44aa-afae-1bcfa4c26466 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:42:58.236129 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-38db8827-97a7-466c-9edc-cc250eb14d89 req-89823894-77b3-44aa-afae-1bcfa4c26466 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:42:58.236644 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-38db8827-97a7-466c-9edc-cc250eb14d89 req-89823894-77b3-44aa-afae-1bcfa4c26466 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:42:58.248931 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-38db8827-97a7-466c-9edc-cc250eb14d89 req-89823894-77b3-44aa-afae-1bcfa4c26466 service nova] Creating event network-changed:e07d1261-beab-4164-af06-46d531723878 for instance 0a637112-2c47-4945-87bf-ca7634ce7c7b on n-h2-861333-8 Oct 19 04:42:58.254895 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-38db8827-97a7-466c-9edc-cc250eb14d89 req-89823894-77b3-44aa-afae-1bcfa4c26466 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035979 Oct 19 04:42:58.255591 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4342/8210] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:42:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:42:58.259050 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6be5710f-8de7-4989-aa03-84f4767c0688 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: 0a637112-2c47-4945-87bf-ca7634ce7c7b] Going to try to terminate instance {{(pid=121135) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 04:42:58.482140 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6be5710f-8de7-4989-aa03-84f4767c0688 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "DELETE /compute/v2.1/servers/0a637112-2c47-4945-87bf-ca7634ce7c7b" status: 204 len: 0 microversion: 2.1 time: 0.270773 Oct 19 04:42:58.482820 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3869/8211] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 04:42:58 2022] DELETE /compute/v2.1/servers/0a637112-2c47-4945-87bf-ca7634ce7c7b => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 04:42:58.493199 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-719f92f4-2ac0-4660-b364-5f86516b509f tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:42:58.494187 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-719f92f4-2ac0-4660-b364-5f86516b509f tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: 0a637112-2c47-4945-87bf-ca7634ce7c7b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:42:58.500722 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-719f92f4-2ac0-4660-b364-5f86516b509f tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:42:58.501411 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-719f92f4-2ac0-4660-b364-5f86516b509f tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:42:58.502573 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-719f92f4-2ac0-4660-b364-5f86516b509f tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:42:58.504208 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-719f92f4-2ac0-4660-b364-5f86516b509f tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:42:58.504891 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-719f92f4-2ac0-4660-b364-5f86516b509f tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:42:58.505457 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-719f92f4-2ac0-4660-b364-5f86516b509f tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:42:58.647184 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-719f92f4-2ac0-4660-b364-5f86516b509f tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:42:58.655033 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-719f92f4-2ac0-4660-b364-5f86516b509f tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/0a637112-2c47-4945-87bf-ca7634ce7c7b" status: 200 len: 1689 microversion: 2.1 time: 0.167659 Oct 19 04:42:58.655705 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4343/8212] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:42:58 2022] GET /compute/v2.1/servers/0a637112-2c47-4945-87bf-ca7634ce7c7b => generated 1689 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:42:59.680983 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c0a8364e-e487-4ce8-a508-6508c25637f0 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:42:59.681722 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c0a8364e-e487-4ce8-a508-6508c25637f0 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: 0a637112-2c47-4945-87bf-ca7634ce7c7b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:42:59.688527 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c0a8364e-e487-4ce8-a508-6508c25637f0 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:42:59.689016 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c0a8364e-e487-4ce8-a508-6508c25637f0 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:42:59.689488 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c0a8364e-e487-4ce8-a508-6508c25637f0 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:42:59.690189 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c0a8364e-e487-4ce8-a508-6508c25637f0 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:42:59.690645 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c0a8364e-e487-4ce8-a508-6508c25637f0 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:42:59.691075 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c0a8364e-e487-4ce8-a508-6508c25637f0 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:42:59.868696 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c0a8364e-e487-4ce8-a508-6508c25637f0 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:42:59.876458 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c0a8364e-e487-4ce8-a508-6508c25637f0 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/0a637112-2c47-4945-87bf-ca7634ce7c7b" status: 200 len: 1689 microversion: 2.1 time: 0.199800 Oct 19 04:42:59.877032 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3870/8213] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:42:59 2022] GET /compute/v2.1/servers/0a637112-2c47-4945-87bf-ca7634ce7c7b => generated 1689 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:43:00.763000 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-fefb36b6-7264-4f73-a225-f5d7396e4a3b req-6440ecb8-0398-4ef0-86a2-c1abe898610a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a637112-2c47-4945-87bf-ca7634ce7c7b", "name": "network-vif-deleted", "tag": "e07d1261-beab-4164-af06-46d531723878"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:43:00.773164 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-fefb36b6-7264-4f73-a225-f5d7396e4a3b req-6440ecb8-0398-4ef0-86a2-c1abe898610a service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:43:00.773704 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-fefb36b6-7264-4f73-a225-f5d7396e4a3b req-6440ecb8-0398-4ef0-86a2-c1abe898610a service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:43:00.774160 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-fefb36b6-7264-4f73-a225-f5d7396e4a3b req-6440ecb8-0398-4ef0-86a2-c1abe898610a service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:43:00.786249 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-fefb36b6-7264-4f73-a225-f5d7396e4a3b req-6440ecb8-0398-4ef0-86a2-c1abe898610a service nova] Creating event network-vif-deleted:e07d1261-beab-4164-af06-46d531723878 for instance 0a637112-2c47-4945-87bf-ca7634ce7c7b on n-h2-861333-8 Oct 19 04:43:00.791446 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-fefb36b6-7264-4f73-a225-f5d7396e4a3b req-6440ecb8-0398-4ef0-86a2-c1abe898610a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032372 Oct 19 04:43:00.792035 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4344/8214] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:43:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:43:00.899454 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4d903960-9cf3-4977-9d7e-a5a3373ca7d2 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:43:00.900357 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4d903960-9cf3-4977-9d7e-a5a3373ca7d2 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: 0a637112-2c47-4945-87bf-ca7634ce7c7b] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:43:00.907406 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4d903960-9cf3-4977-9d7e-a5a3373ca7d2 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:43:00.907898 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4d903960-9cf3-4977-9d7e-a5a3373ca7d2 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:43:00.908344 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4d903960-9cf3-4977-9d7e-a5a3373ca7d2 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:43:00.909297 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4d903960-9cf3-4977-9d7e-a5a3373ca7d2 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:43:00.909787 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4d903960-9cf3-4977-9d7e-a5a3373ca7d2 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:43:00.910255 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4d903960-9cf3-4977-9d7e-a5a3373ca7d2 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:43:00.973992 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4d903960-9cf3-4977-9d7e-a5a3373ca7d2 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:43:00.981812 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4d903960-9cf3-4977-9d7e-a5a3373ca7d2 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/0a637112-2c47-4945-87bf-ca7634ce7c7b" status: 200 len: 1352 microversion: 2.1 time: 0.086300 Oct 19 04:43:00.982390 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3871/8215] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:43:00 2022] GET /compute/v2.1/servers/0a637112-2c47-4945-87bf-ca7634ce7c7b => generated 1352 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:43:02.006780 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b1bd60e2-0f4b-44c9-a4c4-28fea85d2531 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:43:02.007505 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b1bd60e2-0f4b-44c9-a4c4-28fea85d2531 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: 0a637112-2c47-4945-87bf-ca7634ce7c7b] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:43:02.014929 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b1bd60e2-0f4b-44c9-a4c4-28fea85d2531 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:43:02.015442 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b1bd60e2-0f4b-44c9-a4c4-28fea85d2531 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:43:02.015899 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b1bd60e2-0f4b-44c9-a4c4-28fea85d2531 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:43:02.016613 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b1bd60e2-0f4b-44c9-a4c4-28fea85d2531 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:43:02.017087 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b1bd60e2-0f4b-44c9-a4c4-28fea85d2531 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:43:02.017578 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b1bd60e2-0f4b-44c9-a4c4-28fea85d2531 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:43:02.031431 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-b1bd60e2-0f4b-44c9-a4c4-28fea85d2531 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] HTTP exception thrown: Instance 0a637112-2c47-4945-87bf-ca7634ce7c7b could not be found. Oct 19 04:43:02.033056 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b1bd60e2-0f4b-44c9-a4c4-28fea85d2531 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Request method failure captured: Oct 19 04:43:02.033056 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/0a637112-2c47-4945-87bf-ca7634ce7c7b HTTP/1.1 Oct 19 04:43:02.033056 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 04:43:02.033056 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 04:43:02.033056 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 04:43:02.033056 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 04:43:02.033056 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 04:43:02.033056 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 04:43:02.033056 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 04:43:02.033056 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 04:43:02.033056 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT35NpThLGkEnkUgxysLlsfJIyjHqx4L2LT0k6tcbhBDHVJc-wSjP3KeYxe20ELM4-EyhMTutgojR4K9EWIX4amldsFPPM0deHzYTPzrRD1C-x1vHinBbpM7CZBL8f9PKcXGCu_hivxaz25FuBZI0OCPMvGiPgwKv7T2jvjsl4ijCBYk Oct 19 04:43:02.033056 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 04:43:02.033056 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 04:43:02.033056 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 04:43:02.033056 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 04:43:02.033056 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 04:43:02.033056 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 04:43:02.033056 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: d31be961273b43ebb4c58e2350042660 Oct 19 04:43:02.033056 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1897523363 Oct 19 04:43:02.033056 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 04:43:02.033056 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 04:43:02.033056 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d31be961273b43ebb4c58e2350042660"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d31be961273b43ebb4c58e2350042660"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d31be961273b43ebb4c58e2350042660"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d31be961273b43ebb4c58e2350042660", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 04:43:02.033056 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1897523363 Oct 19 04:43:02.033056 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: d31be961273b43ebb4c58e2350042660 Oct 19 04:43:02.033056 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1897523363 Oct 19 04:43:02.033056 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-TestNetworkAdvancedServerOps-1897523363-project Oct 19 04:43:02.033056 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 04:43:02.033056 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 04:43:02.033056 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 834b809f82734666a6d2aea092429cbd Oct 19 04:43:02.033056 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1897523363-project Oct 19 04:43:02.033056 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 04:43:02.033056 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance 0a637112-2c47-4945-87bf-ca7634ce7c7b could not be found. Oct 19 04:43:02.033056 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '0a637112-2c47-4945-87bf-ca7634ce7c7b'} Oct 19 04:43:02.033056 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 04:43:02.033056 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:43:02.033056 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 04:43:02.033056 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 04:43:02.033056 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 04:43:02.033056 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 04:43:02.033056 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 04:43:02.033056 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 04:43:02.033056 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 04:43:02.033056 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 04:43:02.033056 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a637112-2c47-4945-87bf-ca7634ce7c7b could not be found. Oct 19 04:43:02.033056 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:43:02.033056 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:43:02.033056 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:43:02.033056 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:43:02.033056 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:43:02.033056 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:43:02.033056 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 04:43:02.033056 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 04:43:02.033056 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 04:43:02.033056 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 04:43:02.033056 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 04:43:02.033056 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 04:43:02.033056 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 04:43:02.033056 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 04:43:02.033056 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 04:43:02.033056 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 04:43:02.033056 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a637112-2c47-4945-87bf-ca7634ce7c7b could not be found. Oct 19 04:43:02.033056 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:43:02.033056 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:43:02.039223 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:43:02.039223 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:43:02.039223 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:43:02.039223 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:43:02.039223 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 04:43:02.039223 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 04:43:02.039223 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a637112-2c47-4945-87bf-ca7634ce7c7b could not be found. Oct 19 04:43:02.039223 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:43:02.039223 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b1bd60e2-0f4b-44c9-a4c4-28fea85d2531 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Returning 404 to user: Instance 0a637112-2c47-4945-87bf-ca7634ce7c7b could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 04:43:02.039223 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b1bd60e2-0f4b-44c9-a4c4-28fea85d2531 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/0a637112-2c47-4945-87bf-ca7634ce7c7b" status: 404 len: 111 microversion: 2.1 time: 0.032939 Oct 19 04:43:02.039223 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4345/8216] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:43:02 2022] GET /compute/v2.1/servers/0a637112-2c47-4945-87bf-ca7634ce7c7b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 04:43:05.452737 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-fbdd70e3-a033-42cd-8f04-ba8771626ce5 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '.version_select at 0x7fc134f75c10>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:43:05.546009 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-fbdd70e3-a033-42cd-8f04-ba8771626ce5 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1943843425" status: 202 len: 0 microversion: 2.1 time: 0.097296 Oct 19 04:43:05.546609 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3872/8217] 10.222.0.52 () {58 vars in 1284 bytes} [Wed Oct 19 04:43:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1943843425 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 04:43:05.579053 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-306a2c5d-5008-4378-b038-bcfaf4c3d8c2 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Action: 'create', calling method: .version_select at 0x7fc1087f4dc0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-201634699", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC76GlZagIaUyAnXwLXpeeaI5zfw4kVi7g409h7UwT3jlPZD0O6eMHTeDCBQsJRE0rk6LhVOiAMKGkjLkK0SPA+R0BL++pWmuVR5X97VsVbZtPNtnt8a1CN1/o1qdOy5aA=="}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:43:05.595849 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-306a2c5d-5008-4378-b038-bcfaf4c3d8c2 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Getting quotas for project d31be961273b43ebb4c58e2350042660. Resources: {'key_pairs'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 04:43:05.601882 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-306a2c5d-5008-4378-b038-bcfaf4c3d8c2 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Getting quotas for user 834b809f82734666a6d2aea092429cbd and project d31be961273b43ebb4c58e2350042660. Resources: {'key_pairs'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 04:43:05.717354 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-306a2c5d-5008-4378-b038-bcfaf4c3d8c2 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.142233 Oct 19 04:43:05.717994 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4346/8218] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Oct 19 04:43:05 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:43:13.502437 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:43:13.506937 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-be81ef1a-282d-44be-b958-54668a46ce8b tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-214286933", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "networks": [{"uuid": "8b175aab-e5d8-42bb-b745-5294af284a4b"}], "key_name": "tempest-TestNetworkAdvancedServerOps-201634699", "security_groups": [{"name": "tempest-secgroup-smoke-1577234786"}]}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:43:13.636268 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.network.neutron [None req-be81ef1a-282d-44be-b958-54668a46ce8b tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] validate_networks() for [('8b175aab-e5d8-42bb-b745-5294af284a4b', None, None, None, None, None)] {{(pid=121135) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 04:43:14.114379 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-be81ef1a-282d-44be-b958-54668a46ce8b tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Flavor limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 04:43:14.115128 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-be81ef1a-282d-44be-b958-54668a46ce8b tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Image limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 04:43:14.115625 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-be81ef1a-282d-44be-b958-54668a46ce8b tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Flavor pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 04:43:14.116111 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-be81ef1a-282d-44be-b958-54668a46ce8b tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Image pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 04:43:14.116539 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-be81ef1a-282d-44be-b958-54668a46ce8b tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 04:43:14.126164 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-be81ef1a-282d-44be-b958-54668a46ce8b tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:43:14.126784 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-be81ef1a-282d-44be-b958-54668a46ce8b tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:43:14.127863 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-be81ef1a-282d-44be-b958-54668a46ce8b tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:43:14.128929 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-be81ef1a-282d-44be-b958-54668a46ce8b tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:43:14.129562 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-be81ef1a-282d-44be-b958-54668a46ce8b tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:43:14.130113 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-be81ef1a-282d-44be-b958-54668a46ce8b tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:43:14.152005 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-be81ef1a-282d-44be-b958-54668a46ce8b tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Getting quotas for project d31be961273b43ebb4c58e2350042660. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 04:43:14.158258 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-be81ef1a-282d-44be-b958-54668a46ce8b tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Getting quotas for user 834b809f82734666a6d2aea092429cbd and project d31be961273b43ebb4c58e2350042660. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 04:43:14.172897 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-be81ef1a-282d-44be-b958-54668a46ce8b tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Going to run 1 instances... {{(pid=121135) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 04:43:14.176094 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-be81ef1a-282d-44be-b958-54668a46ce8b tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: 63fd9c9a-b099-4642-ad88-443ad2a1260a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121135) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 04:43:14.304159 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-be81ef1a-282d-44be-b958-54668a46ce8b tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.803473 Oct 19 04:43:14.304966 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3873/8219] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 04:43:13 2022] POST /compute/v2.1/servers => generated 406 bytes in 805 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 04:43:14.315885 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=16 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:43:14.320348 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9c88e3a9-173d-480b-a789-2d6e884f4b6a tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:43:14.320972 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9c88e3a9-173d-480b-a789-2d6e884f4b6a tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: 63fd9c9a-b099-4642-ad88-443ad2a1260a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:43:14.400343 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9c88e3a9-173d-480b-a789-2d6e884f4b6a tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:43:14.408814 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9c88e3a9-173d-480b-a789-2d6e884f4b6a tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/63fd9c9a-b099-4642-ad88-443ad2a1260a" status: 200 len: 1265 microversion: 2.1 time: 0.096137 Oct 19 04:43:14.425260 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4347/8220] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:43:14 2022] GET /compute/v2.1/servers/63fd9c9a-b099-4642-ad88-443ad2a1260a => generated 1265 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:43:15.435273 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-bbc3f4a6-1200-4947-858c-eab9fdfa6e96 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:43:15.435910 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-bbc3f4a6-1200-4947-858c-eab9fdfa6e96 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: 63fd9c9a-b099-4642-ad88-443ad2a1260a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:43:15.442969 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bbc3f4a6-1200-4947-858c-eab9fdfa6e96 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:43:15.443560 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bbc3f4a6-1200-4947-858c-eab9fdfa6e96 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:43:15.443977 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bbc3f4a6-1200-4947-858c-eab9fdfa6e96 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:43:15.444656 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bbc3f4a6-1200-4947-858c-eab9fdfa6e96 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:43:15.445066 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bbc3f4a6-1200-4947-858c-eab9fdfa6e96 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:43:15.445536 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bbc3f4a6-1200-4947-858c-eab9fdfa6e96 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:43:15.824514 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-bbc3f4a6-1200-4947-858c-eab9fdfa6e96 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:43:15.833145 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-bbc3f4a6-1200-4947-858c-eab9fdfa6e96 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/63fd9c9a-b099-4642-ad88-443ad2a1260a" status: 200 len: 1269 microversion: 2.1 time: 0.402761 Oct 19 04:43:15.833953 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3874/8221] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:43:15 2022] GET /compute/v2.1/servers/63fd9c9a-b099-4642-ad88-443ad2a1260a => generated 1269 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:43:16.857187 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ee2ca75f-d7a7-46f2-bf7d-51efdbd9cd48 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:43:16.857845 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ee2ca75f-d7a7-46f2-bf7d-51efdbd9cd48 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: 63fd9c9a-b099-4642-ad88-443ad2a1260a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:43:16.865880 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ee2ca75f-d7a7-46f2-bf7d-51efdbd9cd48 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:43:16.866388 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ee2ca75f-d7a7-46f2-bf7d-51efdbd9cd48 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:43:16.866842 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ee2ca75f-d7a7-46f2-bf7d-51efdbd9cd48 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:43:16.867548 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ee2ca75f-d7a7-46f2-bf7d-51efdbd9cd48 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:43:16.868015 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ee2ca75f-d7a7-46f2-bf7d-51efdbd9cd48 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:43:16.868456 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ee2ca75f-d7a7-46f2-bf7d-51efdbd9cd48 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:43:16.942072 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ee2ca75f-d7a7-46f2-bf7d-51efdbd9cd48 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:43:16.951656 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ee2ca75f-d7a7-46f2-bf7d-51efdbd9cd48 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/63fd9c9a-b099-4642-ad88-443ad2a1260a" status: 200 len: 1323 microversion: 2.1 time: 0.098390 Oct 19 04:43:16.952249 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4348/8222] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:43:16 2022] GET /compute/v2.1/servers/63fd9c9a-b099-4642-ad88-443ad2a1260a => generated 1323 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:43:17.975120 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3a60d375-f25e-405a-a2b2-006b8f96a2bc tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:43:17.975774 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-3a60d375-f25e-405a-a2b2-006b8f96a2bc tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: 63fd9c9a-b099-4642-ad88-443ad2a1260a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:43:17.982384 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3a60d375-f25e-405a-a2b2-006b8f96a2bc tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:43:17.982883 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3a60d375-f25e-405a-a2b2-006b8f96a2bc tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:43:17.983326 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3a60d375-f25e-405a-a2b2-006b8f96a2bc tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:43:17.984030 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3a60d375-f25e-405a-a2b2-006b8f96a2bc tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:43:17.984494 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3a60d375-f25e-405a-a2b2-006b8f96a2bc tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:43:17.984928 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3a60d375-f25e-405a-a2b2-006b8f96a2bc tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:43:18.117976 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-3a60d375-f25e-405a-a2b2-006b8f96a2bc tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:43:18.125108 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-fe8ae00c-6aa2-4188-86ed-f5e374025abb req-19754cce-f181-4cfa-ab91-e03531cf6577 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63fd9c9a-b099-4642-ad88-443ad2a1260a", "tag": "ef97fdc3-e66b-4913-b0f3-63e9bc8eba71"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:43:18.126543 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-3a60d375-f25e-405a-a2b2-006b8f96a2bc tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/63fd9c9a-b099-4642-ad88-443ad2a1260a" status: 200 len: 1391 microversion: 2.1 time: 0.155431 Oct 19 04:43:18.127937 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3875/8223] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:43:17 2022] GET /compute/v2.1/servers/63fd9c9a-b099-4642-ad88-443ad2a1260a => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:43:18.146734 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-fe8ae00c-6aa2-4188-86ed-f5e374025abb req-19754cce-f181-4cfa-ab91-e03531cf6577 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:43:18.147311 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-fe8ae00c-6aa2-4188-86ed-f5e374025abb req-19754cce-f181-4cfa-ab91-e03531cf6577 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:43:18.147975 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-fe8ae00c-6aa2-4188-86ed-f5e374025abb req-19754cce-f181-4cfa-ab91-e03531cf6577 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:43:18.160501 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-fe8ae00c-6aa2-4188-86ed-f5e374025abb req-19754cce-f181-4cfa-ab91-e03531cf6577 service nova] Creating event network-changed:ef97fdc3-e66b-4913-b0f3-63e9bc8eba71 for instance 63fd9c9a-b099-4642-ad88-443ad2a1260a on n-h1-861333-8 Oct 19 04:43:18.165510 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-fe8ae00c-6aa2-4188-86ed-f5e374025abb req-19754cce-f181-4cfa-ab91-e03531cf6577 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044256 Oct 19 04:43:18.166154 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4349/8224] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:43:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:43:19.150471 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d75f6d48-167c-4c7f-8948-17e10244d5a7 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:43:19.151426 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d75f6d48-167c-4c7f-8948-17e10244d5a7 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: 63fd9c9a-b099-4642-ad88-443ad2a1260a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:43:19.158721 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d75f6d48-167c-4c7f-8948-17e10244d5a7 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:43:19.159209 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d75f6d48-167c-4c7f-8948-17e10244d5a7 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:43:19.159647 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d75f6d48-167c-4c7f-8948-17e10244d5a7 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:43:19.160350 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d75f6d48-167c-4c7f-8948-17e10244d5a7 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:43:19.160841 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d75f6d48-167c-4c7f-8948-17e10244d5a7 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:43:19.161443 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d75f6d48-167c-4c7f-8948-17e10244d5a7 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:43:19.299921 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d75f6d48-167c-4c7f-8948-17e10244d5a7 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:43:19.307662 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d75f6d48-167c-4c7f-8948-17e10244d5a7 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/63fd9c9a-b099-4642-ad88-443ad2a1260a" status: 200 len: 1391 microversion: 2.1 time: 0.161232 Oct 19 04:43:19.308245 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3876/8225] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:43:19 2022] GET /compute/v2.1/servers/63fd9c9a-b099-4642-ad88-443ad2a1260a => generated 1391 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:43:20.332529 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-fa039860-ac10-4dce-98d8-a08f2debb051 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:43:20.333402 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-fa039860-ac10-4dce-98d8-a08f2debb051 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: 63fd9c9a-b099-4642-ad88-443ad2a1260a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:43:20.340783 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fa039860-ac10-4dce-98d8-a08f2debb051 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:43:20.341421 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fa039860-ac10-4dce-98d8-a08f2debb051 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:43:20.341875 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fa039860-ac10-4dce-98d8-a08f2debb051 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:43:20.342671 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fa039860-ac10-4dce-98d8-a08f2debb051 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:43:20.343206 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fa039860-ac10-4dce-98d8-a08f2debb051 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:43:20.343650 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fa039860-ac10-4dce-98d8-a08f2debb051 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:43:20.480424 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-fa039860-ac10-4dce-98d8-a08f2debb051 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:43:20.488757 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-fa039860-ac10-4dce-98d8-a08f2debb051 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/63fd9c9a-b099-4642-ad88-443ad2a1260a" status: 200 len: 1391 microversion: 2.1 time: 0.162410 Oct 19 04:43:20.489327 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4350/8226] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:43:20 2022] GET /compute/v2.1/servers/63fd9c9a-b099-4642-ad88-443ad2a1260a => generated 1391 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:43:21.512257 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7dee8256-fa56-4afb-8345-a5f5707e0488 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:43:21.512867 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7dee8256-fa56-4afb-8345-a5f5707e0488 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: 63fd9c9a-b099-4642-ad88-443ad2a1260a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:43:21.519665 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7dee8256-fa56-4afb-8345-a5f5707e0488 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:43:21.520145 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7dee8256-fa56-4afb-8345-a5f5707e0488 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:43:21.520583 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7dee8256-fa56-4afb-8345-a5f5707e0488 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:43:21.521264 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7dee8256-fa56-4afb-8345-a5f5707e0488 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:43:21.521744 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7dee8256-fa56-4afb-8345-a5f5707e0488 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:43:21.522168 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7dee8256-fa56-4afb-8345-a5f5707e0488 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:43:21.656464 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7dee8256-fa56-4afb-8345-a5f5707e0488 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:43:21.664839 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7dee8256-fa56-4afb-8345-a5f5707e0488 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/63fd9c9a-b099-4642-ad88-443ad2a1260a" status: 200 len: 1391 microversion: 2.1 time: 0.156440 Oct 19 04:43:21.665425 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3877/8227] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:43:21 2022] GET /compute/v2.1/servers/63fd9c9a-b099-4642-ad88-443ad2a1260a => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:43:22.686758 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-40503cad-e2f8-45d3-bdab-7ef26cbb1ea8 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:43:22.687391 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-40503cad-e2f8-45d3-bdab-7ef26cbb1ea8 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: 63fd9c9a-b099-4642-ad88-443ad2a1260a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:43:22.690790 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:43:22.695550 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-40503cad-e2f8-45d3-bdab-7ef26cbb1ea8 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:43:22.696044 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-40503cad-e2f8-45d3-bdab-7ef26cbb1ea8 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:43:22.696570 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-40503cad-e2f8-45d3-bdab-7ef26cbb1ea8 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:43:22.697265 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-40503cad-e2f8-45d3-bdab-7ef26cbb1ea8 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:43:22.697758 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-40503cad-e2f8-45d3-bdab-7ef26cbb1ea8 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:43:22.701673 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-40503cad-e2f8-45d3-bdab-7ef26cbb1ea8 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:43:22.828202 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-40503cad-e2f8-45d3-bdab-7ef26cbb1ea8 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:43:22.836182 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-40503cad-e2f8-45d3-bdab-7ef26cbb1ea8 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/63fd9c9a-b099-4642-ad88-443ad2a1260a" status: 200 len: 1391 microversion: 2.1 time: 0.153336 Oct 19 04:43:22.836755 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4351/8228] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:43:22 2022] GET /compute/v2.1/servers/63fd9c9a-b099-4642-ad88-443ad2a1260a => generated 1391 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:43:23.859313 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6a0b0ded-dfdb-4b6a-9540-b7c4931ce8a9 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:43:23.859935 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6a0b0ded-dfdb-4b6a-9540-b7c4931ce8a9 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: 63fd9c9a-b099-4642-ad88-443ad2a1260a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:43:23.867413 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6a0b0ded-dfdb-4b6a-9540-b7c4931ce8a9 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:43:23.867898 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6a0b0ded-dfdb-4b6a-9540-b7c4931ce8a9 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:43:23.868335 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6a0b0ded-dfdb-4b6a-9540-b7c4931ce8a9 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:43:23.869024 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6a0b0ded-dfdb-4b6a-9540-b7c4931ce8a9 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:43:23.869499 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6a0b0ded-dfdb-4b6a-9540-b7c4931ce8a9 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:43:23.870017 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6a0b0ded-dfdb-4b6a-9540-b7c4931ce8a9 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:43:24.011667 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-6a0b0ded-dfdb-4b6a-9540-b7c4931ce8a9 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:43:24.020000 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6a0b0ded-dfdb-4b6a-9540-b7c4931ce8a9 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/63fd9c9a-b099-4642-ad88-443ad2a1260a" status: 200 len: 1391 microversion: 2.1 time: 0.164613 Oct 19 04:43:24.020726 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3878/8229] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:43:23 2022] GET /compute/v2.1/servers/63fd9c9a-b099-4642-ad88-443ad2a1260a => generated 1391 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:43:25.043805 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3a5522fc-ef8c-4013-b730-943e841ffaab tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:43:25.044446 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3a5522fc-ef8c-4013-b730-943e841ffaab tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: 63fd9c9a-b099-4642-ad88-443ad2a1260a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:43:25.047279 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=6 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:43:25.052594 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3a5522fc-ef8c-4013-b730-943e841ffaab tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:43:25.055669 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3a5522fc-ef8c-4013-b730-943e841ffaab tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:43:25.055669 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3a5522fc-ef8c-4013-b730-943e841ffaab tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:43:25.055669 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3a5522fc-ef8c-4013-b730-943e841ffaab tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:43:25.055669 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3a5522fc-ef8c-4013-b730-943e841ffaab tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:43:25.055669 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3a5522fc-ef8c-4013-b730-943e841ffaab tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:43:25.189818 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-3a5522fc-ef8c-4013-b730-943e841ffaab tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:43:25.197484 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3a5522fc-ef8c-4013-b730-943e841ffaab tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/63fd9c9a-b099-4642-ad88-443ad2a1260a" status: 200 len: 1391 microversion: 2.1 time: 0.157509 Oct 19 04:43:25.198072 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4352/8230] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:43:25 2022] GET /compute/v2.1/servers/63fd9c9a-b099-4642-ad88-443ad2a1260a => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:43:25.531315 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-6f651b63-0ee8-449e-bf0a-b6959e3071e0 req-99d2f043-6259-475b-b11f-24132a78b703 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63fd9c9a-b099-4642-ad88-443ad2a1260a", "name": "network-vif-plugged", "status": "completed", "tag": "ef97fdc3-e66b-4913-b0f3-63e9bc8eba71"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:43:25.537118 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:43:25.537818 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=6 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:43:25.543977 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-6f651b63-0ee8-449e-bf0a-b6959e3071e0 req-99d2f043-6259-475b-b11f-24132a78b703 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:43:25.544459 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-6f651b63-0ee8-449e-bf0a-b6959e3071e0 req-99d2f043-6259-475b-b11f-24132a78b703 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:43:25.544897 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-6f651b63-0ee8-449e-bf0a-b6959e3071e0 req-99d2f043-6259-475b-b11f-24132a78b703 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:43:25.556050 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-6f651b63-0ee8-449e-bf0a-b6959e3071e0 req-99d2f043-6259-475b-b11f-24132a78b703 service nova] Creating event network-vif-plugged:ef97fdc3-e66b-4913-b0f3-63e9bc8eba71 for instance 63fd9c9a-b099-4642-ad88-443ad2a1260a on n-h1-861333-8 Oct 19 04:43:25.561210 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-6f651b63-0ee8-449e-bf0a-b6959e3071e0 req-99d2f043-6259-475b-b11f-24132a78b703 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033776 Oct 19 04:43:25.561851 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3879/8231] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:43:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:43:26.220283 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ad8014ce-ae5e-4575-85ac-a83117c2f8d6 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:43:26.220841 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ad8014ce-ae5e-4575-85ac-a83117c2f8d6 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: 63fd9c9a-b099-4642-ad88-443ad2a1260a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:43:26.227724 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ad8014ce-ae5e-4575-85ac-a83117c2f8d6 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:43:26.228220 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ad8014ce-ae5e-4575-85ac-a83117c2f8d6 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:43:26.228671 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ad8014ce-ae5e-4575-85ac-a83117c2f8d6 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:43:26.229395 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ad8014ce-ae5e-4575-85ac-a83117c2f8d6 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:43:26.229861 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ad8014ce-ae5e-4575-85ac-a83117c2f8d6 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:43:26.230298 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ad8014ce-ae5e-4575-85ac-a83117c2f8d6 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:43:26.357935 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ad8014ce-ae5e-4575-85ac-a83117c2f8d6 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:43:26.366140 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ad8014ce-ae5e-4575-85ac-a83117c2f8d6 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/63fd9c9a-b099-4642-ad88-443ad2a1260a" status: 200 len: 1391 microversion: 2.1 time: 0.149790 Oct 19 04:43:26.366724 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4353/8232] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:43:26 2022] GET /compute/v2.1/servers/63fd9c9a-b099-4642-ad88-443ad2a1260a => generated 1391 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:43:27.391380 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-03a07e84-f6aa-4c6f-a75e-0d2373385451 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:43:27.392140 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-03a07e84-f6aa-4c6f-a75e-0d2373385451 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: 63fd9c9a-b099-4642-ad88-443ad2a1260a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:43:27.399612 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-03a07e84-f6aa-4c6f-a75e-0d2373385451 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:43:27.400067 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-03a07e84-f6aa-4c6f-a75e-0d2373385451 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:43:27.400513 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-03a07e84-f6aa-4c6f-a75e-0d2373385451 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:43:27.401217 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-03a07e84-f6aa-4c6f-a75e-0d2373385451 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:43:27.401701 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-03a07e84-f6aa-4c6f-a75e-0d2373385451 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:43:27.402164 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-03a07e84-f6aa-4c6f-a75e-0d2373385451 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:43:27.536322 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-03a07e84-f6aa-4c6f-a75e-0d2373385451 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:43:27.544117 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-03a07e84-f6aa-4c6f-a75e-0d2373385451 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/63fd9c9a-b099-4642-ad88-443ad2a1260a" status: 200 len: 1563 microversion: 2.1 time: 0.158522 Oct 19 04:43:27.544694 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3880/8233] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:43:27 2022] GET /compute/v2.1/servers/63fd9c9a-b099-4642-ad88-443ad2a1260a => generated 1563 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:43:27.567176 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1ea70dcc-2af7-4691-8943-d21f05a9c7f1 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:43:27.567937 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1ea70dcc-2af7-4691-8943-d21f05a9c7f1 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: 63fd9c9a-b099-4642-ad88-443ad2a1260a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:43:27.574807 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1ea70dcc-2af7-4691-8943-d21f05a9c7f1 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:43:27.575601 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1ea70dcc-2af7-4691-8943-d21f05a9c7f1 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:43:27.575855 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1ea70dcc-2af7-4691-8943-d21f05a9c7f1 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:43:27.576562 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1ea70dcc-2af7-4691-8943-d21f05a9c7f1 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:43:27.577033 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1ea70dcc-2af7-4691-8943-d21f05a9c7f1 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:43:27.577505 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1ea70dcc-2af7-4691-8943-d21f05a9c7f1 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:43:27.707226 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-1ea70dcc-2af7-4691-8943-d21f05a9c7f1 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:43:27.714947 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1ea70dcc-2af7-4691-8943-d21f05a9c7f1 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/63fd9c9a-b099-4642-ad88-443ad2a1260a" status: 200 len: 1563 microversion: 2.1 time: 0.152245 Oct 19 04:43:27.715524 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4354/8234] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:43:27 2022] GET /compute/v2.1/servers/63fd9c9a-b099-4642-ad88-443ad2a1260a => generated 1563 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:43:29.607978 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d2b76e8a-cda3-47e9-80e3-ef80e5f81b4c tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:43:29.613967 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-7abe8cde-0058-427e-b573-166e1a0cd0c4 req-c66ff4a7-f8fd-4d51-bd02-9f67a5c96b7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63fd9c9a-b099-4642-ad88-443ad2a1260a", "tag": "ef97fdc3-e66b-4913-b0f3-63e9bc8eba71"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:43:29.617974 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d2b76e8a-cda3-47e9-80e3-ef80e5f81b4c tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: 63fd9c9a-b099-4642-ad88-443ad2a1260a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:43:29.620885 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:43:29.625827 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d2b76e8a-cda3-47e9-80e3-ef80e5f81b4c tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:43:29.626431 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d2b76e8a-cda3-47e9-80e3-ef80e5f81b4c tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:43:29.627689 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d2b76e8a-cda3-47e9-80e3-ef80e5f81b4c tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:43:29.628399 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d2b76e8a-cda3-47e9-80e3-ef80e5f81b4c tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:43:29.628987 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d2b76e8a-cda3-47e9-80e3-ef80e5f81b4c tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:43:29.629449 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-7abe8cde-0058-427e-b573-166e1a0cd0c4 req-c66ff4a7-f8fd-4d51-bd02-9f67a5c96b7b service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:43:29.629726 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d2b76e8a-cda3-47e9-80e3-ef80e5f81b4c tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:43:29.629952 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-7abe8cde-0058-427e-b573-166e1a0cd0c4 req-c66ff4a7-f8fd-4d51-bd02-9f67a5c96b7b service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:43:29.633447 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-7abe8cde-0058-427e-b573-166e1a0cd0c4 req-c66ff4a7-f8fd-4d51-bd02-9f67a5c96b7b service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:43:29.643903 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-7abe8cde-0058-427e-b573-166e1a0cd0c4 req-c66ff4a7-f8fd-4d51-bd02-9f67a5c96b7b service nova] Creating event network-changed:ef97fdc3-e66b-4913-b0f3-63e9bc8eba71 for instance 63fd9c9a-b099-4642-ad88-443ad2a1260a on n-h1-861333-8 Oct 19 04:43:29.649255 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-7abe8cde-0058-427e-b573-166e1a0cd0c4 req-c66ff4a7-f8fd-4d51-bd02-9f67a5c96b7b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039735 Oct 19 04:43:29.649896 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4355/8235] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:43:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:43:29.776106 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d2b76e8a-cda3-47e9-80e3-ef80e5f81b4c tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:43:29.784748 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d2b76e8a-cda3-47e9-80e3-ef80e5f81b4c tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/63fd9c9a-b099-4642-ad88-443ad2a1260a" status: 200 len: 1563 microversion: 2.1 time: 0.180733 Oct 19 04:43:29.785597 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3881/8236] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:43:29 2022] GET /compute/v2.1/servers/63fd9c9a-b099-4642-ad88-443ad2a1260a => generated 1563 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:44:03.083398 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=9 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:44:03.084159 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=40 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:44:03.088322 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7d795a6e-beee-4950-8a55-da5e2cdf3d4e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:44:03.090624 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7d795a6e-beee-4950-8a55-da5e2cdf3d4e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: 63fd9c9a-b099-4642-ad88-443ad2a1260a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:44:03.096673 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7d795a6e-beee-4950-8a55-da5e2cdf3d4e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:44:03.101761 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7d795a6e-beee-4950-8a55-da5e2cdf3d4e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:44:03.101761 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7d795a6e-beee-4950-8a55-da5e2cdf3d4e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:44:03.101761 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7d795a6e-beee-4950-8a55-da5e2cdf3d4e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:44:03.101761 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7d795a6e-beee-4950-8a55-da5e2cdf3d4e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:44:03.101761 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7d795a6e-beee-4950-8a55-da5e2cdf3d4e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:44:03.167770 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7d795a6e-beee-4950-8a55-da5e2cdf3d4e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "POST /compute/v2.1/servers/63fd9c9a-b099-4642-ad88-443ad2a1260a/action" status: 200 len: 24556 microversion: 2.1 time: 0.086930 Oct 19 04:44:03.168395 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4356/8237] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 04:44:03 2022] POST /compute/v2.1/servers/63fd9c9a-b099-4642-ad88-443ad2a1260a/action => generated 24556 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 04:44:33.372622 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:44:33.373303 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=46 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:44:33.598166 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-91d429cb-5114-41d2-8967-8e8fa7526046 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:44:33.598730 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-91d429cb-5114-41d2-8967-8e8fa7526046 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: 63fd9c9a-b099-4642-ad88-443ad2a1260a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:44:33.604626 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-91d429cb-5114-41d2-8967-8e8fa7526046 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:44:33.605139 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-91d429cb-5114-41d2-8967-8e8fa7526046 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:44:33.605615 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-91d429cb-5114-41d2-8967-8e8fa7526046 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:44:33.606294 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-91d429cb-5114-41d2-8967-8e8fa7526046 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:44:33.606742 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-91d429cb-5114-41d2-8967-8e8fa7526046 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:44:33.607165 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-91d429cb-5114-41d2-8967-8e8fa7526046 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:44:33.629280 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-91d429cb-5114-41d2-8967-8e8fa7526046 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lazy-loading 'flavor' on Instance uuid 63fd9c9a-b099-4642-ad88-443ad2a1260a {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 04:44:33.850448 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-91d429cb-5114-41d2-8967-8e8fa7526046 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "POST /compute/v2.1/servers/63fd9c9a-b099-4642-ad88-443ad2a1260a/action" status: 202 len: 0 microversion: 2.1 time: 0.479645 Oct 19 04:44:33.851079 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3882/8238] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 04:44:33 2022] POST /compute/v2.1/servers/63fd9c9a-b099-4642-ad88-443ad2a1260a/action => generated 0 bytes in 481 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 04:44:33.871812 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5b17ee7b-f9ec-4354-8b9d-9166dfbf5bd6 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:44:33.872532 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5b17ee7b-f9ec-4354-8b9d-9166dfbf5bd6 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: 63fd9c9a-b099-4642-ad88-443ad2a1260a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:44:33.875126 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:44:33.875903 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=4 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:44:33.877011 n-d-861333-8 devstack@n-api.service[121134]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 04:44:33.877138 n-d-861333-8 devstack@n-api.service[121134]: Wed Oct 19 04:44:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/63fd9c9a-b099-4642-ad88-443ad2a1260a (ip 10.222.0.52) !!! Oct 19 04:44:33.890015 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5b17ee7b-f9ec-4354-8b9d-9166dfbf5bd6 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:44:33.890466 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5b17ee7b-f9ec-4354-8b9d-9166dfbf5bd6 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:44:33.890912 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5b17ee7b-f9ec-4354-8b9d-9166dfbf5bd6 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:44:33.891635 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5b17ee7b-f9ec-4354-8b9d-9166dfbf5bd6 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:44:33.892113 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5b17ee7b-f9ec-4354-8b9d-9166dfbf5bd6 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:44:33.892565 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5b17ee7b-f9ec-4354-8b9d-9166dfbf5bd6 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:44:34.029140 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5b17ee7b-f9ec-4354-8b9d-9166dfbf5bd6 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:44:34.037220 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5b17ee7b-f9ec-4354-8b9d-9166dfbf5bd6 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/63fd9c9a-b099-4642-ad88-443ad2a1260a" status: 200 len: 1690 microversion: 2.1 time: 0.169900 Oct 19 04:44:34.037822 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4357/8239] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:44:33 2022] GET /compute/v2.1/servers/63fd9c9a-b099-4642-ad88-443ad2a1260a => generated 1690 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:44:35.064918 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b6db92a9-2689-4a20-8308-b5b2a739b9e3 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:44:35.065663 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b6db92a9-2689-4a20-8308-b5b2a739b9e3 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: 63fd9c9a-b099-4642-ad88-443ad2a1260a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:44:35.071916 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b6db92a9-2689-4a20-8308-b5b2a739b9e3 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:44:35.072407 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b6db92a9-2689-4a20-8308-b5b2a739b9e3 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:44:35.072853 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b6db92a9-2689-4a20-8308-b5b2a739b9e3 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:44:35.073642 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b6db92a9-2689-4a20-8308-b5b2a739b9e3 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:44:35.074109 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b6db92a9-2689-4a20-8308-b5b2a739b9e3 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:44:35.074545 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b6db92a9-2689-4a20-8308-b5b2a739b9e3 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:44:35.210854 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b6db92a9-2689-4a20-8308-b5b2a739b9e3 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:44:35.219646 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b6db92a9-2689-4a20-8308-b5b2a739b9e3 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/63fd9c9a-b099-4642-ad88-443ad2a1260a" status: 200 len: 1690 microversion: 2.1 time: 0.160002 Oct 19 04:44:35.220235 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3883/8240] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:44:35 2022] GET /compute/v2.1/servers/63fd9c9a-b099-4642-ad88-443ad2a1260a => generated 1690 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:44:36.244248 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-abc884d9-0ca1-46f5-b50f-b6be66630e2c tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:44:36.244848 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-abc884d9-0ca1-46f5-b50f-b6be66630e2c tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: 63fd9c9a-b099-4642-ad88-443ad2a1260a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:44:36.251981 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-abc884d9-0ca1-46f5-b50f-b6be66630e2c tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:44:36.252501 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-abc884d9-0ca1-46f5-b50f-b6be66630e2c tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:44:36.252942 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-abc884d9-0ca1-46f5-b50f-b6be66630e2c tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:44:36.253731 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-abc884d9-0ca1-46f5-b50f-b6be66630e2c tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:44:36.254222 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-abc884d9-0ca1-46f5-b50f-b6be66630e2c tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:44:36.254672 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-abc884d9-0ca1-46f5-b50f-b6be66630e2c tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:44:36.387179 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-abc884d9-0ca1-46f5-b50f-b6be66630e2c tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:44:36.395255 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-abc884d9-0ca1-46f5-b50f-b6be66630e2c tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/63fd9c9a-b099-4642-ad88-443ad2a1260a" status: 200 len: 1673 microversion: 2.1 time: 0.155052 Oct 19 04:44:36.395848 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4358/8241] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:44:36 2022] GET /compute/v2.1/servers/63fd9c9a-b099-4642-ad88-443ad2a1260a => generated 1673 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:44:37.489184 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b717c502-8a2c-4b4d-867f-79e0db3bece9 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:44:37.491532 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b717c502-8a2c-4b4d-867f-79e0db3bece9 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: 63fd9c9a-b099-4642-ad88-443ad2a1260a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:44:37.498653 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b717c502-8a2c-4b4d-867f-79e0db3bece9 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:44:37.499142 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b717c502-8a2c-4b4d-867f-79e0db3bece9 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:44:37.499664 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b717c502-8a2c-4b4d-867f-79e0db3bece9 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:44:37.500355 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b717c502-8a2c-4b4d-867f-79e0db3bece9 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:44:37.500807 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b717c502-8a2c-4b4d-867f-79e0db3bece9 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:44:37.501232 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b717c502-8a2c-4b4d-867f-79e0db3bece9 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:44:37.563736 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b717c502-8a2c-4b4d-867f-79e0db3bece9 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "POST /compute/v2.1/servers/63fd9c9a-b099-4642-ad88-443ad2a1260a/action" status: 200 len: 38416 microversion: 2.1 time: 0.078822 Oct 19 04:44:37.564368 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3884/8242] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 04:44:37 2022] POST /compute/v2.1/servers/63fd9c9a-b099-4642-ad88-443ad2a1260a/action => generated 38416 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 04:44:37.576773 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a908ea56-d6b1-4156-ac2f-91cdbc2cf9be tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:44:37.577352 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a908ea56-d6b1-4156-ac2f-91cdbc2cf9be tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: 63fd9c9a-b099-4642-ad88-443ad2a1260a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:44:37.584280 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a908ea56-d6b1-4156-ac2f-91cdbc2cf9be tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:44:37.584803 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a908ea56-d6b1-4156-ac2f-91cdbc2cf9be tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:44:37.585240 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a908ea56-d6b1-4156-ac2f-91cdbc2cf9be tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:44:37.585973 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a908ea56-d6b1-4156-ac2f-91cdbc2cf9be tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:44:37.586443 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a908ea56-d6b1-4156-ac2f-91cdbc2cf9be tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:44:37.586887 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a908ea56-d6b1-4156-ac2f-91cdbc2cf9be tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:44:37.791319 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a908ea56-d6b1-4156-ac2f-91cdbc2cf9be tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "POST /compute/v2.1/servers/63fd9c9a-b099-4642-ad88-443ad2a1260a/action" status: 202 len: 0 microversion: 2.1 time: 0.218247 Oct 19 04:44:37.791996 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4359/8243] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 04:44:37 2022] POST /compute/v2.1/servers/63fd9c9a-b099-4642-ad88-443ad2a1260a/action => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 04:44:37.802279 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-802c7abd-eb11-425e-b12f-4630c555a379 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:44:37.804308 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-802c7abd-eb11-425e-b12f-4630c555a379 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: 63fd9c9a-b099-4642-ad88-443ad2a1260a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:44:37.810204 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-802c7abd-eb11-425e-b12f-4630c555a379 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:44:37.810702 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-802c7abd-eb11-425e-b12f-4630c555a379 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:44:37.811148 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-802c7abd-eb11-425e-b12f-4630c555a379 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:44:37.811861 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-802c7abd-eb11-425e-b12f-4630c555a379 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:44:37.812326 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-802c7abd-eb11-425e-b12f-4630c555a379 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:44:37.812762 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-802c7abd-eb11-425e-b12f-4630c555a379 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:44:37.952952 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-802c7abd-eb11-425e-b12f-4630c555a379 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:44:37.960850 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-802c7abd-eb11-425e-b12f-4630c555a379 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/63fd9c9a-b099-4642-ad88-443ad2a1260a" status: 200 len: 1679 microversion: 2.1 time: 0.163912 Oct 19 04:44:37.961444 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3885/8244] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:44:37 2022] GET /compute/v2.1/servers/63fd9c9a-b099-4642-ad88-443ad2a1260a => generated 1679 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:44:38.986905 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0f3a0b76-2329-45fe-9f33-7816d5d79138 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:44:38.987625 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0f3a0b76-2329-45fe-9f33-7816d5d79138 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: 63fd9c9a-b099-4642-ad88-443ad2a1260a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:44:38.994473 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0f3a0b76-2329-45fe-9f33-7816d5d79138 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:44:38.994977 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0f3a0b76-2329-45fe-9f33-7816d5d79138 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:44:38.995465 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0f3a0b76-2329-45fe-9f33-7816d5d79138 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:44:38.996174 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0f3a0b76-2329-45fe-9f33-7816d5d79138 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:44:38.996650 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0f3a0b76-2329-45fe-9f33-7816d5d79138 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:44:38.997093 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0f3a0b76-2329-45fe-9f33-7816d5d79138 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:44:39.127733 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0f3a0b76-2329-45fe-9f33-7816d5d79138 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:44:39.136129 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0f3a0b76-2329-45fe-9f33-7816d5d79138 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/63fd9c9a-b099-4642-ad88-443ad2a1260a" status: 200 len: 1679 microversion: 2.1 time: 0.154363 Oct 19 04:44:39.136700 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4360/8245] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:44:38 2022] GET /compute/v2.1/servers/63fd9c9a-b099-4642-ad88-443ad2a1260a => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:44:40.159831 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1a57f900-22c5-4b62-8b1c-865729004912 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:44:40.160446 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1a57f900-22c5-4b62-8b1c-865729004912 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: 63fd9c9a-b099-4642-ad88-443ad2a1260a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:44:40.167461 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1a57f900-22c5-4b62-8b1c-865729004912 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:44:40.167946 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1a57f900-22c5-4b62-8b1c-865729004912 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:44:40.168384 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1a57f900-22c5-4b62-8b1c-865729004912 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:44:40.169068 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1a57f900-22c5-4b62-8b1c-865729004912 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:44:40.169560 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1a57f900-22c5-4b62-8b1c-865729004912 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:44:40.169981 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1a57f900-22c5-4b62-8b1c-865729004912 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:44:40.303678 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-1a57f900-22c5-4b62-8b1c-865729004912 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:44:40.311663 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1a57f900-22c5-4b62-8b1c-865729004912 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/63fd9c9a-b099-4642-ad88-443ad2a1260a" status: 200 len: 1682 microversion: 2.1 time: 0.156064 Oct 19 04:44:40.312227 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3886/8246] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:44:40 2022] GET /compute/v2.1/servers/63fd9c9a-b099-4642-ad88-443ad2a1260a => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:44:40.406005 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-90ad8e6a-a55f-4a4d-add8-662e1b1bbc49 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:44:40.408206 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-90ad8e6a-a55f-4a4d-add8-662e1b1bbc49 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: 63fd9c9a-b099-4642-ad88-443ad2a1260a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:44:40.415982 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-90ad8e6a-a55f-4a4d-add8-662e1b1bbc49 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:44:40.416480 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-90ad8e6a-a55f-4a4d-add8-662e1b1bbc49 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:44:40.416936 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-90ad8e6a-a55f-4a4d-add8-662e1b1bbc49 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:44:40.417669 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-90ad8e6a-a55f-4a4d-add8-662e1b1bbc49 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:44:40.418139 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-90ad8e6a-a55f-4a4d-add8-662e1b1bbc49 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:44:40.418578 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-90ad8e6a-a55f-4a4d-add8-662e1b1bbc49 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:44:40.479141 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-90ad8e6a-a55f-4a4d-add8-662e1b1bbc49 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "POST /compute/v2.1/servers/63fd9c9a-b099-4642-ad88-443ad2a1260a/action" status: 200 len: 38416 microversion: 2.1 time: 0.077127 Oct 19 04:44:40.479759 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4361/8247] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 04:44:40 2022] POST /compute/v2.1/servers/63fd9c9a-b099-4642-ad88-443ad2a1260a/action => generated 38416 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 04:44:41.504598 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4b0f9d6b-da63-4cd2-a142-7c0155a94e4e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:44:41.505123 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4b0f9d6b-da63-4cd2-a142-7c0155a94e4e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: 63fd9c9a-b099-4642-ad88-443ad2a1260a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:44:41.512549 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4b0f9d6b-da63-4cd2-a142-7c0155a94e4e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:44:41.513247 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4b0f9d6b-da63-4cd2-a142-7c0155a94e4e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:44:41.513767 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4b0f9d6b-da63-4cd2-a142-7c0155a94e4e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:44:41.514469 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4b0f9d6b-da63-4cd2-a142-7c0155a94e4e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:44:41.514923 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4b0f9d6b-da63-4cd2-a142-7c0155a94e4e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:44:41.515353 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4b0f9d6b-da63-4cd2-a142-7c0155a94e4e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:44:41.543104 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4b0f9d6b-da63-4cd2-a142-7c0155a94e4e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: 63fd9c9a-b099-4642-ad88-443ad2a1260a] Going to try to terminate instance {{(pid=121135) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 04:44:41.561619 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-72126042-378a-46fd-82e4-00d9b826c0e6 req-fb776853-5474-44d0-81a2-8dcfce249615 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63fd9c9a-b099-4642-ad88-443ad2a1260a", "tag": "ef97fdc3-e66b-4913-b0f3-63e9bc8eba71"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:44:41.573453 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-72126042-378a-46fd-82e4-00d9b826c0e6 req-fb776853-5474-44d0-81a2-8dcfce249615 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:44:41.573963 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-72126042-378a-46fd-82e4-00d9b826c0e6 req-fb776853-5474-44d0-81a2-8dcfce249615 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:44:41.574545 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-72126042-378a-46fd-82e4-00d9b826c0e6 req-fb776853-5474-44d0-81a2-8dcfce249615 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:44:41.585537 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-72126042-378a-46fd-82e4-00d9b826c0e6 req-fb776853-5474-44d0-81a2-8dcfce249615 service nova] Creating event network-changed:ef97fdc3-e66b-4913-b0f3-63e9bc8eba71 for instance 63fd9c9a-b099-4642-ad88-443ad2a1260a on n-h1-861333-8 Oct 19 04:44:41.590392 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-72126042-378a-46fd-82e4-00d9b826c0e6 req-fb776853-5474-44d0-81a2-8dcfce249615 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087282 Oct 19 04:44:41.590992 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4362/8248] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:44:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:44:41.880479 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4b0f9d6b-da63-4cd2-a142-7c0155a94e4e tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "DELETE /compute/v2.1/servers/63fd9c9a-b099-4642-ad88-443ad2a1260a" status: 204 len: 0 microversion: 2.1 time: 0.379694 Oct 19 04:44:41.881312 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3887/8249] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 04:44:41 2022] DELETE /compute/v2.1/servers/63fd9c9a-b099-4642-ad88-443ad2a1260a => generated 0 bytes in 381 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 04:44:41.892063 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b4e8042a-aba5-4746-93a7-961d15e33633 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:44:41.892327 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b4e8042a-aba5-4746-93a7-961d15e33633 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: 63fd9c9a-b099-4642-ad88-443ad2a1260a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:44:41.901453 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b4e8042a-aba5-4746-93a7-961d15e33633 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:44:41.901713 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b4e8042a-aba5-4746-93a7-961d15e33633 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:44:41.902166 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b4e8042a-aba5-4746-93a7-961d15e33633 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:44:41.902882 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b4e8042a-aba5-4746-93a7-961d15e33633 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:44:41.903381 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b4e8042a-aba5-4746-93a7-961d15e33633 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:44:41.903819 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b4e8042a-aba5-4746-93a7-961d15e33633 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:44:42.040100 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b4e8042a-aba5-4746-93a7-961d15e33633 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:44:42.047970 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b4e8042a-aba5-4746-93a7-961d15e33633 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/63fd9c9a-b099-4642-ad88-443ad2a1260a" status: 200 len: 1688 microversion: 2.1 time: 0.161941 Oct 19 04:44:42.048549 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4363/8250] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:44:41 2022] GET /compute/v2.1/servers/63fd9c9a-b099-4642-ad88-443ad2a1260a => generated 1688 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:44:43.073155 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-651e9703-1398-45ad-9e40-0ed594556f13 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:44:43.073922 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-651e9703-1398-45ad-9e40-0ed594556f13 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: 63fd9c9a-b099-4642-ad88-443ad2a1260a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:44:43.080734 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-651e9703-1398-45ad-9e40-0ed594556f13 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:44:43.081227 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-651e9703-1398-45ad-9e40-0ed594556f13 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:44:43.081754 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-651e9703-1398-45ad-9e40-0ed594556f13 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:44:43.082455 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-651e9703-1398-45ad-9e40-0ed594556f13 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:44:43.082915 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-651e9703-1398-45ad-9e40-0ed594556f13 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:44:43.083346 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-651e9703-1398-45ad-9e40-0ed594556f13 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:44:43.222935 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-651e9703-1398-45ad-9e40-0ed594556f13 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:44:43.233612 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-651e9703-1398-45ad-9e40-0ed594556f13 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/63fd9c9a-b099-4642-ad88-443ad2a1260a" status: 200 len: 1688 microversion: 2.1 time: 0.164580 Oct 19 04:44:43.234235 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3888/8251] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:44:43 2022] GET /compute/v2.1/servers/63fd9c9a-b099-4642-ad88-443ad2a1260a => generated 1688 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:44:44.260691 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-05e5e380-6a0a-4fe2-87f6-89853cbc771c tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:44:44.261336 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-05e5e380-6a0a-4fe2-87f6-89853cbc771c tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: 63fd9c9a-b099-4642-ad88-443ad2a1260a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:44:44.268584 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-05e5e380-6a0a-4fe2-87f6-89853cbc771c tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:44:44.269139 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-05e5e380-6a0a-4fe2-87f6-89853cbc771c tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:44:44.269619 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-05e5e380-6a0a-4fe2-87f6-89853cbc771c tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:44:44.270335 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-05e5e380-6a0a-4fe2-87f6-89853cbc771c tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:44:44.270803 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-05e5e380-6a0a-4fe2-87f6-89853cbc771c tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:44:44.271247 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-05e5e380-6a0a-4fe2-87f6-89853cbc771c tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:44:44.500664 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-05e5e380-6a0a-4fe2-87f6-89853cbc771c tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:44:44.508521 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-05e5e380-6a0a-4fe2-87f6-89853cbc771c tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/63fd9c9a-b099-4642-ad88-443ad2a1260a" status: 200 len: 1688 microversion: 2.1 time: 0.251724 Oct 19 04:44:44.509090 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4364/8252] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:44:44 2022] GET /compute/v2.1/servers/63fd9c9a-b099-4642-ad88-443ad2a1260a => generated 1688 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:44:44.788726 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-30cc08c6-7e03-4bdc-9b8d-6aee65fbe582 req-78ed0f46-bf9a-4e23-9b55-afa05321ca8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63fd9c9a-b099-4642-ad88-443ad2a1260a", "name": "network-vif-deleted", "tag": "ef97fdc3-e66b-4913-b0f3-63e9bc8eba71"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:44:44.799344 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-30cc08c6-7e03-4bdc-9b8d-6aee65fbe582 req-78ed0f46-bf9a-4e23-9b55-afa05321ca8b service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:44:44.801603 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-30cc08c6-7e03-4bdc-9b8d-6aee65fbe582 req-78ed0f46-bf9a-4e23-9b55-afa05321ca8b service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:44:44.801603 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-30cc08c6-7e03-4bdc-9b8d-6aee65fbe582 req-78ed0f46-bf9a-4e23-9b55-afa05321ca8b service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:44:44.812426 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-30cc08c6-7e03-4bdc-9b8d-6aee65fbe582 req-78ed0f46-bf9a-4e23-9b55-afa05321ca8b service nova] Creating event network-vif-deleted:ef97fdc3-e66b-4913-b0f3-63e9bc8eba71 for instance 63fd9c9a-b099-4642-ad88-443ad2a1260a on n-h1-861333-8 Oct 19 04:44:44.817625 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-30cc08c6-7e03-4bdc-9b8d-6aee65fbe582 req-78ed0f46-bf9a-4e23-9b55-afa05321ca8b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032995 Oct 19 04:44:44.818225 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3889/8253] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:44:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:44:45.532206 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6ec96fc6-e3eb-440f-898a-dd4619d615bf tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:44:45.532839 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6ec96fc6-e3eb-440f-898a-dd4619d615bf tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: 63fd9c9a-b099-4642-ad88-443ad2a1260a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:44:45.540121 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6ec96fc6-e3eb-440f-898a-dd4619d615bf tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:44:45.540629 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6ec96fc6-e3eb-440f-898a-dd4619d615bf tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:44:45.541159 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6ec96fc6-e3eb-440f-898a-dd4619d615bf tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:44:45.541828 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6ec96fc6-e3eb-440f-898a-dd4619d615bf tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:44:45.542305 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6ec96fc6-e3eb-440f-898a-dd4619d615bf tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:44:45.542751 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6ec96fc6-e3eb-440f-898a-dd4619d615bf tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:44:45.576592 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6ec96fc6-e3eb-440f-898a-dd4619d615bf tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:44:45.577090 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6ec96fc6-e3eb-440f-898a-dd4619d615bf tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:44:45.577584 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6ec96fc6-e3eb-440f-898a-dd4619d615bf tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:44:45.578052 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-6ec96fc6-e3eb-440f-898a-dd4619d615bf tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lazy-loading 'fault' on Instance uuid 63fd9c9a-b099-4642-ad88-443ad2a1260a {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 04:44:45.619499 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-6ec96fc6-e3eb-440f-898a-dd4619d615bf tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b809f82734666a6d2aea092429cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31be961273b43ebb4c58e2350042660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:44:45.627400 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6ec96fc6-e3eb-440f-898a-dd4619d615bf tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/63fd9c9a-b099-4642-ad88-443ad2a1260a" status: 200 len: 1355 microversion: 2.1 time: 0.099230 Oct 19 04:44:45.627985 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4365/8254] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:44:45 2022] GET /compute/v2.1/servers/63fd9c9a-b099-4642-ad88-443ad2a1260a => generated 1355 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:44:46.653040 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-cdff76c7-e8ad-4bbf-ab8f-ed9870ee42f8 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:44:46.653780 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-cdff76c7-e8ad-4bbf-ab8f-ed9870ee42f8 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] [instance: 63fd9c9a-b099-4642-ad88-443ad2a1260a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:44:46.661775 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cdff76c7-e8ad-4bbf-ab8f-ed9870ee42f8 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:44:46.662271 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cdff76c7-e8ad-4bbf-ab8f-ed9870ee42f8 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:44:46.662720 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cdff76c7-e8ad-4bbf-ab8f-ed9870ee42f8 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:44:46.663418 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cdff76c7-e8ad-4bbf-ab8f-ed9870ee42f8 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:44:46.663879 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cdff76c7-e8ad-4bbf-ab8f-ed9870ee42f8 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:44:46.664313 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cdff76c7-e8ad-4bbf-ab8f-ed9870ee42f8 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:44:46.677634 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-cdff76c7-e8ad-4bbf-ab8f-ed9870ee42f8 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] HTTP exception thrown: Instance 63fd9c9a-b099-4642-ad88-443ad2a1260a could not be found. Oct 19 04:44:46.679260 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-cdff76c7-e8ad-4bbf-ab8f-ed9870ee42f8 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Request method failure captured: Oct 19 04:44:46.679260 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/63fd9c9a-b099-4642-ad88-443ad2a1260a HTTP/1.1 Oct 19 04:44:46.679260 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 04:44:46.679260 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 04:44:46.679260 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 04:44:46.679260 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 04:44:46.679260 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 04:44:46.679260 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 04:44:46.679260 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 04:44:46.679260 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 04:44:46.679260 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT35NpThLGkEnkUgxysLlsfJIyjHqx4L2LT0k6tcbhBDHVJc-wSjP3KeYxe20ELM4-EyhMTutgojR4K9EWIX4amldsFPPM0deHzYTPzrRD1C-x1vHinBbpM7CZBL8f9PKcXGCu_hivxaz25FuBZI0OCPMvGiPgwKv7T2jvjsl4ijCBYk Oct 19 04:44:46.679260 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 04:44:46.679260 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 04:44:46.679260 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 04:44:46.679260 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 04:44:46.679260 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 04:44:46.679260 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 04:44:46.679260 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: d31be961273b43ebb4c58e2350042660 Oct 19 04:44:46.679260 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1897523363 Oct 19 04:44:46.679260 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 04:44:46.679260 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 04:44:46.679260 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d31be961273b43ebb4c58e2350042660"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d31be961273b43ebb4c58e2350042660"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d31be961273b43ebb4c58e2350042660"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d31be961273b43ebb4c58e2350042660", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 04:44:46.679260 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1897523363 Oct 19 04:44:46.679260 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: d31be961273b43ebb4c58e2350042660 Oct 19 04:44:46.679260 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1897523363 Oct 19 04:44:46.679260 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-TestNetworkAdvancedServerOps-1897523363-project Oct 19 04:44:46.679260 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 04:44:46.679260 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 04:44:46.679260 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 834b809f82734666a6d2aea092429cbd Oct 19 04:44:46.679260 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1897523363-project Oct 19 04:44:46.679260 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 04:44:46.679260 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance 63fd9c9a-b099-4642-ad88-443ad2a1260a could not be found. Oct 19 04:44:46.679260 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': '63fd9c9a-b099-4642-ad88-443ad2a1260a'} Oct 19 04:44:46.679260 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 04:44:46.679260 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:44:46.679260 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 04:44:46.679260 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 04:44:46.679260 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 04:44:46.679260 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 04:44:46.679260 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 04:44:46.679260 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 04:44:46.679260 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 04:44:46.679260 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 04:44:46.679260 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63fd9c9a-b099-4642-ad88-443ad2a1260a could not be found. Oct 19 04:44:46.679260 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:44:46.679260 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:44:46.679260 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:44:46.679260 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:44:46.679260 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:44:46.679260 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:44:46.679260 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 04:44:46.679260 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 04:44:46.679260 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 04:44:46.679260 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 04:44:46.679260 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 04:44:46.679260 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 04:44:46.679260 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 04:44:46.679260 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 04:44:46.679260 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 04:44:46.679260 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 04:44:46.679260 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63fd9c9a-b099-4642-ad88-443ad2a1260a could not be found. Oct 19 04:44:46.679260 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:44:46.679260 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:44:46.685162 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:44:46.685162 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:44:46.685162 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:44:46.685162 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:44:46.685162 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 04:44:46.685162 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 04:44:46.685162 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63fd9c9a-b099-4642-ad88-443ad2a1260a could not be found. Oct 19 04:44:46.685162 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:44:46.685162 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-cdff76c7-e8ad-4bbf-ab8f-ed9870ee42f8 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Returning 404 to user: Instance 63fd9c9a-b099-4642-ad88-443ad2a1260a could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 04:44:46.685162 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-cdff76c7-e8ad-4bbf-ab8f-ed9870ee42f8 tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "GET /compute/v2.1/servers/63fd9c9a-b099-4642-ad88-443ad2a1260a" status: 404 len: 111 microversion: 2.1 time: 0.033240 Oct 19 04:44:46.685162 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3890/8255] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:44:46 2022] GET /compute/v2.1/servers/63fd9c9a-b099-4642-ad88-443ad2a1260a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 04:44:50.672913 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4e767e93-63fc-4d2f-a6ac-dbab45ee1cfb tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] Calling method '.version_select at 0x7fc12803d4c0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:44:50.754999 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4e767e93-63fc-4d2f-a6ac-dbab45ee1cfb tempest-TestNetworkAdvancedServerOps-1897523363 tempest-TestNetworkAdvancedServerOps-1897523363-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-201634699" status: 202 len: 0 microversion: 2.1 time: 0.086059 Oct 19 04:44:50.755898 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4366/8256] 10.222.0.52 () {58 vars in 1281 bytes} [Wed Oct 19 04:44:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-201634699 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 04:45:05.068453 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:45:05.070806 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:45:05.261039 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5f52a336-50d9-46ab-805c-bc757863f16e tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Action: 'create', calling method: .version_select at 0x7fc12b935280>, body: {"keypair": {"name": "tempest-TestShelveInstance-1764667233", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJNzY4ZmI5QzBTpJRZlcNUMmcAdgGzX289LUyiybqyi3a/d78H4ATr3mFiu0Eg2Pgdr0EKzE3xObxUcCV5PFFSGNls/tDpd+xegKwM9/CLKX0fYNUPwhzEaU6IiUNQfvYw=="}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:45:05.279039 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-5f52a336-50d9-46ab-805c-bc757863f16e tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Getting quotas for project 0484467f1f7e4f968e2c85ec615c8557. Resources: {'key_pairs'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 04:45:05.285393 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-5f52a336-50d9-46ab-805c-bc757863f16e tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Getting quotas for user 55ca1b7e70404198a6251b0babea4855 and project 0484467f1f7e4f968e2c85ec615c8557. Resources: {'key_pairs'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 04:45:05.413438 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5f52a336-50d9-46ab-805c-bc757863f16e tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.351551 Oct 19 04:45:05.414056 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3891/8257] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Oct 19 04:45:05 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:45:07.786904 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:45:07.787707 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=23,nova_api:DELETE=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:45:07.791957 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a8598632-effe-4071-a050-bed7dad8ce16 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-981466612", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1764667233", "security_groups": [{"name": "tempest-secgroup-smoke-442542810"}], "networks": [{"uuid": "34dfad40-621c-4c40-97dc-e6c23c65b306"}]}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:45:07.905193 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-a8598632-effe-4071-a050-bed7dad8ce16 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] validate_networks() for [('34dfad40-621c-4c40-97dc-e6c23c65b306', None, None, None, None, None)] {{(pid=121134) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 04:45:08.392929 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-a8598632-effe-4071-a050-bed7dad8ce16 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Flavor limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 04:45:08.393897 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-a8598632-effe-4071-a050-bed7dad8ce16 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Image limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 04:45:08.394388 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-a8598632-effe-4071-a050-bed7dad8ce16 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Flavor pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 04:45:08.394818 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-a8598632-effe-4071-a050-bed7dad8ce16 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Image pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 04:45:08.395241 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-a8598632-effe-4071-a050-bed7dad8ce16 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 04:45:08.404073 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a8598632-effe-4071-a050-bed7dad8ce16 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:45:08.404566 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a8598632-effe-4071-a050-bed7dad8ce16 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:45:08.405020 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a8598632-effe-4071-a050-bed7dad8ce16 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:45:08.405826 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a8598632-effe-4071-a050-bed7dad8ce16 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:45:08.406292 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a8598632-effe-4071-a050-bed7dad8ce16 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:45:08.406732 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a8598632-effe-4071-a050-bed7dad8ce16 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:45:08.432219 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-a8598632-effe-4071-a050-bed7dad8ce16 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Getting quotas for project 0484467f1f7e4f968e2c85ec615c8557. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 04:45:08.437797 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-a8598632-effe-4071-a050-bed7dad8ce16 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Getting quotas for user 55ca1b7e70404198a6251b0babea4855 and project 0484467f1f7e4f968e2c85ec615c8557. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 04:45:08.451101 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a8598632-effe-4071-a050-bed7dad8ce16 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Going to run 1 instances... {{(pid=121134) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 04:45:08.453496 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a8598632-effe-4071-a050-bed7dad8ce16 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 04:45:08.539488 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a8598632-effe-4071-a050-bed7dad8ce16 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.754614 Oct 19 04:45:08.540138 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4367/8258] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 04:45:07 2022] POST /compute/v2.1/servers => generated 405 bytes in 757 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 04:45:08.552703 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-86139afe-a1ac-4417-8c52-b7bb678b0fd7 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:45:08.553241 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-86139afe-a1ac-4417-8c52-b7bb678b0fd7 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:45:08.615372 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-86139afe-a1ac-4417-8c52-b7bb678b0fd7 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:45:08.623283 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-86139afe-a1ac-4417-8c52-b7bb678b0fd7 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a" status: 200 len: 1246 microversion: 2.1 time: 0.075431 Oct 19 04:45:08.623864 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3892/8259] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:45:08 2022] GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a => generated 1246 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:45:09.647500 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d3b76334-1275-469b-a1d6-1b7741e0708c tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:45:09.648161 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d3b76334-1275-469b-a1d6-1b7741e0708c tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:45:09.654671 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d3b76334-1275-469b-a1d6-1b7741e0708c tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:45:09.655164 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d3b76334-1275-469b-a1d6-1b7741e0708c tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:45:09.655614 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d3b76334-1275-469b-a1d6-1b7741e0708c tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:45:09.656314 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d3b76334-1275-469b-a1d6-1b7741e0708c tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:45:09.656779 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d3b76334-1275-469b-a1d6-1b7741e0708c tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:45:09.657213 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d3b76334-1275-469b-a1d6-1b7741e0708c tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:45:09.720532 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d3b76334-1275-469b-a1d6-1b7741e0708c tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:45:09.729008 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d3b76334-1275-469b-a1d6-1b7741e0708c tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a" status: 200 len: 1250 microversion: 2.1 time: 0.086871 Oct 19 04:45:09.729606 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4368/8260] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:45:09 2022] GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a => generated 1250 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:45:10.752103 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e5f35c43-aafb-4fa6-94ee-f43e498ef749 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:45:10.752726 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e5f35c43-aafb-4fa6-94ee-f43e498ef749 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:45:10.760706 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e5f35c43-aafb-4fa6-94ee-f43e498ef749 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:45:10.761218 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e5f35c43-aafb-4fa6-94ee-f43e498ef749 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:45:10.761696 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e5f35c43-aafb-4fa6-94ee-f43e498ef749 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:45:10.762420 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e5f35c43-aafb-4fa6-94ee-f43e498ef749 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:45:10.762874 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e5f35c43-aafb-4fa6-94ee-f43e498ef749 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:45:10.763511 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e5f35c43-aafb-4fa6-94ee-f43e498ef749 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:45:10.848330 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-e5f35c43-aafb-4fa6-94ee-f43e498ef749 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:45:10.857617 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e5f35c43-aafb-4fa6-94ee-f43e498ef749 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a" status: 200 len: 1316 microversion: 2.1 time: 0.109306 Oct 19 04:45:10.858582 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3893/8261] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:45:10 2022] GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a => generated 1316 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:45:11.882090 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-27f74be5-6823-4ff2-8bd3-ca0943bb2b06 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:45:11.882892 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-27f74be5-6823-4ff2-8bd3-ca0943bb2b06 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:45:11.890013 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-27f74be5-6823-4ff2-8bd3-ca0943bb2b06 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:45:11.890664 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-27f74be5-6823-4ff2-8bd3-ca0943bb2b06 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:45:11.891221 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-27f74be5-6823-4ff2-8bd3-ca0943bb2b06 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:45:11.892048 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-27f74be5-6823-4ff2-8bd3-ca0943bb2b06 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:45:11.892621 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-27f74be5-6823-4ff2-8bd3-ca0943bb2b06 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:45:11.893180 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-27f74be5-6823-4ff2-8bd3-ca0943bb2b06 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:45:12.028900 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-27f74be5-6823-4ff2-8bd3-ca0943bb2b06 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:45:12.037731 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-27f74be5-6823-4ff2-8bd3-ca0943bb2b06 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a" status: 200 len: 1371 microversion: 2.1 time: 0.160336 Oct 19 04:45:12.038331 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4369/8262] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:45:11 2022] GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a => generated 1371 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:45:12.438011 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-456d196d-8261-413f-a64e-9368963aa3eb req-672b7426-ac5a-4e47-83ad-0ba297b3f9a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a", "tag": "052ac849-729d-4a7d-8519-3ad5980bb2b4"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:45:12.447285 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-456d196d-8261-413f-a64e-9368963aa3eb req-672b7426-ac5a-4e47-83ad-0ba297b3f9a3 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:45:12.447739 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-456d196d-8261-413f-a64e-9368963aa3eb req-672b7426-ac5a-4e47-83ad-0ba297b3f9a3 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:45:12.448180 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-456d196d-8261-413f-a64e-9368963aa3eb req-672b7426-ac5a-4e47-83ad-0ba297b3f9a3 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:45:12.459167 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-456d196d-8261-413f-a64e-9368963aa3eb req-672b7426-ac5a-4e47-83ad-0ba297b3f9a3 service nova] Creating event network-changed:052ac849-729d-4a7d-8519-3ad5980bb2b4 for instance cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a on n-h2-861333-8 Oct 19 04:45:12.464151 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-456d196d-8261-413f-a64e-9368963aa3eb req-672b7426-ac5a-4e47-83ad-0ba297b3f9a3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091716 Oct 19 04:45:12.466251 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3894/8263] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:45:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 04:45:13.062425 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9ad98937-00c1-4f99-97ee-20fe3d4ef36b tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:45:13.063053 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9ad98937-00c1-4f99-97ee-20fe3d4ef36b tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:45:13.070448 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9ad98937-00c1-4f99-97ee-20fe3d4ef36b tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:45:13.070947 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9ad98937-00c1-4f99-97ee-20fe3d4ef36b tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:45:13.071400 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9ad98937-00c1-4f99-97ee-20fe3d4ef36b tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:45:13.072130 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9ad98937-00c1-4f99-97ee-20fe3d4ef36b tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:45:13.072603 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9ad98937-00c1-4f99-97ee-20fe3d4ef36b tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:45:13.073048 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9ad98937-00c1-4f99-97ee-20fe3d4ef36b tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:45:13.208783 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9ad98937-00c1-4f99-97ee-20fe3d4ef36b tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:45:13.216626 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9ad98937-00c1-4f99-97ee-20fe3d4ef36b tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a" status: 200 len: 1371 microversion: 2.1 time: 0.158181 Oct 19 04:45:13.217137 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4370/8264] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:45:13 2022] GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:45:14.241525 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6c132cb8-3f48-452c-8443-9a072d59bde4 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:45:14.242227 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6c132cb8-3f48-452c-8443-9a072d59bde4 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:45:14.248399 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6c132cb8-3f48-452c-8443-9a072d59bde4 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:45:14.248882 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6c132cb8-3f48-452c-8443-9a072d59bde4 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:45:14.249327 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6c132cb8-3f48-452c-8443-9a072d59bde4 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:45:14.250030 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6c132cb8-3f48-452c-8443-9a072d59bde4 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:45:14.250481 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6c132cb8-3f48-452c-8443-9a072d59bde4 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:45:14.250903 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6c132cb8-3f48-452c-8443-9a072d59bde4 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:45:14.383986 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-6c132cb8-3f48-452c-8443-9a072d59bde4 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:45:14.392038 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6c132cb8-3f48-452c-8443-9a072d59bde4 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a" status: 200 len: 1371 microversion: 2.1 time: 0.156169 Oct 19 04:45:14.392619 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3895/8265] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:45:14 2022] GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a => generated 1371 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:45:15.415969 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-dfa3e75b-38c3-43a0-a6f9-21a0a2b6e7e1 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:45:15.416604 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-dfa3e75b-38c3-43a0-a6f9-21a0a2b6e7e1 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:45:15.423525 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dfa3e75b-38c3-43a0-a6f9-21a0a2b6e7e1 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:45:15.424031 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dfa3e75b-38c3-43a0-a6f9-21a0a2b6e7e1 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:45:15.424485 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dfa3e75b-38c3-43a0-a6f9-21a0a2b6e7e1 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:45:15.425192 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dfa3e75b-38c3-43a0-a6f9-21a0a2b6e7e1 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:45:15.426347 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dfa3e75b-38c3-43a0-a6f9-21a0a2b6e7e1 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:45:15.426794 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-dfa3e75b-38c3-43a0-a6f9-21a0a2b6e7e1 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:45:15.561047 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-dfa3e75b-38c3-43a0-a6f9-21a0a2b6e7e1 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:45:15.568848 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-dfa3e75b-38c3-43a0-a6f9-21a0a2b6e7e1 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a" status: 200 len: 1371 microversion: 2.1 time: 0.156751 Oct 19 04:45:15.569417 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4371/8266] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:45:15 2022] GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a => generated 1371 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:45:16.592165 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4e5f30d5-c6f9-49a4-a5db-9569bdc2364e tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:45:16.592782 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-4e5f30d5-c6f9-49a4-a5db-9569bdc2364e tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:45:16.599452 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4e5f30d5-c6f9-49a4-a5db-9569bdc2364e tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:45:16.599938 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4e5f30d5-c6f9-49a4-a5db-9569bdc2364e tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:45:16.600378 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4e5f30d5-c6f9-49a4-a5db-9569bdc2364e tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:45:16.601067 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4e5f30d5-c6f9-49a4-a5db-9569bdc2364e tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:45:16.601621 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4e5f30d5-c6f9-49a4-a5db-9569bdc2364e tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:45:16.602053 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-4e5f30d5-c6f9-49a4-a5db-9569bdc2364e tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:45:16.732980 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-4e5f30d5-c6f9-49a4-a5db-9569bdc2364e tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:45:16.741156 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4e5f30d5-c6f9-49a4-a5db-9569bdc2364e tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a" status: 200 len: 1371 microversion: 2.1 time: 0.153231 Oct 19 04:45:16.741760 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3896/8267] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:45:16 2022] GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:45:17.764719 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-fc711e34-e570-4520-8b87-b0427947e6b6 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:45:17.765363 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-fc711e34-e570-4520-8b87-b0427947e6b6 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:45:17.772928 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fc711e34-e570-4520-8b87-b0427947e6b6 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:45:17.773483 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fc711e34-e570-4520-8b87-b0427947e6b6 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:45:17.773941 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fc711e34-e570-4520-8b87-b0427947e6b6 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:45:17.774651 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fc711e34-e570-4520-8b87-b0427947e6b6 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:45:17.775125 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fc711e34-e570-4520-8b87-b0427947e6b6 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:45:17.775572 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-fc711e34-e570-4520-8b87-b0427947e6b6 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:45:18.169745 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-fc711e34-e570-4520-8b87-b0427947e6b6 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:45:18.177540 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-fc711e34-e570-4520-8b87-b0427947e6b6 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a" status: 200 len: 1371 microversion: 2.1 time: 0.417010 Oct 19 04:45:18.178115 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4372/8268] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:45:17 2022] GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a => generated 1371 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:45:18.479620 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-9e296d2a-153b-43b5-bfcf-e89099791df4 req-b300d8a9-98f4-46e6-9196-86cb03d6d2d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a", "name": "network-vif-plugged", "status": "completed", "tag": "052ac849-729d-4a7d-8519-3ad5980bb2b4"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:45:18.489357 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-9e296d2a-153b-43b5-bfcf-e89099791df4 req-b300d8a9-98f4-46e6-9196-86cb03d6d2d7 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:45:18.489874 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-9e296d2a-153b-43b5-bfcf-e89099791df4 req-b300d8a9-98f4-46e6-9196-86cb03d6d2d7 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:45:18.490319 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-9e296d2a-153b-43b5-bfcf-e89099791df4 req-b300d8a9-98f4-46e6-9196-86cb03d6d2d7 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:45:18.505835 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-9e296d2a-153b-43b5-bfcf-e89099791df4 req-b300d8a9-98f4-46e6-9196-86cb03d6d2d7 service nova] Creating event network-vif-plugged:052ac849-729d-4a7d-8519-3ad5980bb2b4 for instance cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a on n-h2-861333-8 Oct 19 04:45:18.510888 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-9e296d2a-153b-43b5-bfcf-e89099791df4 req-b300d8a9-98f4-46e6-9196-86cb03d6d2d7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089405 Oct 19 04:45:18.512039 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3897/8269] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:45:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:45:19.200844 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4b0da3f0-7db9-41c5-bc1b-306911617413 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:45:19.201494 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4b0da3f0-7db9-41c5-bc1b-306911617413 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:45:19.203383 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:45:19.204182 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=6 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:45:19.210262 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4b0da3f0-7db9-41c5-bc1b-306911617413 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:45:19.210764 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4b0da3f0-7db9-41c5-bc1b-306911617413 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:45:19.211215 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4b0da3f0-7db9-41c5-bc1b-306911617413 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:45:19.211918 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4b0da3f0-7db9-41c5-bc1b-306911617413 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:45:19.212386 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4b0da3f0-7db9-41c5-bc1b-306911617413 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:45:19.212826 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4b0da3f0-7db9-41c5-bc1b-306911617413 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:45:19.344646 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-4b0da3f0-7db9-41c5-bc1b-306911617413 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:45:19.352389 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4b0da3f0-7db9-41c5-bc1b-306911617413 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a" status: 200 len: 1371 microversion: 2.1 time: 0.155516 Oct 19 04:45:19.352941 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4373/8270] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:45:19 2022] GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:45:20.375632 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0f674846-0595-405b-b2ce-8d48450f1617 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:45:20.376340 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0f674846-0595-405b-b2ce-8d48450f1617 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:45:20.378344 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=6 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:45:20.384183 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0f674846-0595-405b-b2ce-8d48450f1617 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:45:20.385798 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0f674846-0595-405b-b2ce-8d48450f1617 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:45:20.386390 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0f674846-0595-405b-b2ce-8d48450f1617 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:45:20.391782 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0f674846-0595-405b-b2ce-8d48450f1617 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:45:20.391782 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0f674846-0595-405b-b2ce-8d48450f1617 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:45:20.391782 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-0f674846-0595-405b-b2ce-8d48450f1617 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:45:20.519343 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-0f674846-0595-405b-b2ce-8d48450f1617 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:45:20.527578 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0f674846-0595-405b-b2ce-8d48450f1617 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a" status: 200 len: 1555 microversion: 2.1 time: 0.156253 Oct 19 04:45:20.528149 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3898/8271] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:45:20 2022] GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a => generated 1555 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:45:20.556174 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a575fe2b-d7ed-4413-95ae-0be76b562e02 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:45:20.556839 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a575fe2b-d7ed-4413-95ae-0be76b562e02 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:45:20.563648 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a575fe2b-d7ed-4413-95ae-0be76b562e02 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:45:20.564228 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a575fe2b-d7ed-4413-95ae-0be76b562e02 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:45:20.564686 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a575fe2b-d7ed-4413-95ae-0be76b562e02 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:45:20.565417 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a575fe2b-d7ed-4413-95ae-0be76b562e02 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:45:20.565900 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a575fe2b-d7ed-4413-95ae-0be76b562e02 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:45:20.566344 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a575fe2b-d7ed-4413-95ae-0be76b562e02 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:45:20.700425 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a575fe2b-d7ed-4413-95ae-0be76b562e02 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:45:20.708783 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a575fe2b-d7ed-4413-95ae-0be76b562e02 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a" status: 200 len: 1555 microversion: 2.1 time: 0.156559 Oct 19 04:45:20.709346 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4374/8272] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:45:20 2022] GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a => generated 1555 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:45:23.102320 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-3863961e-e827-49f9-8c61-c3439d045154 req-91d5e919-5472-4a7f-a7da-845988fc3a74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a", "tag": "052ac849-729d-4a7d-8519-3ad5980bb2b4"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:45:23.112867 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-3863961e-e827-49f9-8c61-c3439d045154 req-91d5e919-5472-4a7f-a7da-845988fc3a74 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:45:23.113358 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-3863961e-e827-49f9-8c61-c3439d045154 req-91d5e919-5472-4a7f-a7da-845988fc3a74 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:45:23.113929 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-3863961e-e827-49f9-8c61-c3439d045154 req-91d5e919-5472-4a7f-a7da-845988fc3a74 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:45:23.125626 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-3863961e-e827-49f9-8c61-c3439d045154 req-91d5e919-5472-4a7f-a7da-845988fc3a74 service nova] Creating event network-changed:052ac849-729d-4a7d-8519-3ad5980bb2b4 for instance cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a on n-h2-861333-8 Oct 19 04:45:23.130594 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-3863961e-e827-49f9-8c61-c3439d045154 req-91d5e919-5472-4a7f-a7da-845988fc3a74 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032627 Oct 19 04:45:23.131382 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3899/8273] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:45:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:47:20.583254 n-d-861333-8 devstack@n-api.service[121134]: ERROR oslo.messaging._drivers.impl_rabbit [-] [96947759-862b-4b0f-b2e1-828b2ec3f179] AMQP server on 10.222.0.52:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 19 04:47:20.584194 n-d-861333-8 devstack@n-api.service[121134]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1a02a1d9-5473-4a0a-ab8b-e198030a9897] AMQP server on 10.222.0.52:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 19 04:47:20.585044 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:47:20.585911 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=44 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:47:20.587628 n-d-861333-8 devstack@n-api.service[121134]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 19 04:47:20.587628 n-d-861333-8 devstack@n-api.service[121134]: Wed Oct 19 04:47:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a/action (ip 10.222.0.52) !!! Oct 19 04:47:20.591897 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-952c79a0-d52b-41de-b086-b226c41eee96 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:47:20.592446 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-952c79a0-d52b-41de-b086-b226c41eee96 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:47:20.599351 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-952c79a0-d52b-41de-b086-b226c41eee96 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:47:20.599847 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-952c79a0-d52b-41de-b086-b226c41eee96 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:47:20.600297 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-952c79a0-d52b-41de-b086-b226c41eee96 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:47:20.600998 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-952c79a0-d52b-41de-b086-b226c41eee96 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:47:20.601494 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-952c79a0-d52b-41de-b086-b226c41eee96 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:47:20.601939 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-952c79a0-d52b-41de-b086-b226c41eee96 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:47:20.625309 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-952c79a0-d52b-41de-b086-b226c41eee96 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lazy-loading 'flavor' on Instance uuid cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 04:47:21.198250 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-952c79a0-d52b-41de-b086-b226c41eee96 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "POST /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a/action" status: 202 len: 0 microversion: 2.1 time: 0.616564 Oct 19 04:47:21.198914 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4375/8274] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 04:47:20 2022] POST /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a/action => generated 0 bytes in 618 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 04:47:21.205571 n-d-861333-8 devstack@n-api.service[121135]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a4608907-9588-4b25-ac87-b956b6019667] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 19 04:47:21.206527 n-d-861333-8 devstack@n-api.service[121135]: ERROR oslo.messaging._drivers.impl_rabbit [-] [171e3f7c-7dfe-4dce-b74d-cf08e9363be7] AMQP server on 10.222.0.52:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 19 04:47:21.207159 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:47:21.207922 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=30 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:47:21.209486 n-d-861333-8 devstack@n-api.service[121135]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 04:47:21.209640 n-d-861333-8 devstack@n-api.service[121135]: Wed Oct 19 04:47:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a (ip 10.222.0.52) !!! Oct 19 04:47:21.215218 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-3dafd0f9-739f-434b-b392-84140484292a tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:47:21.215943 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-3dafd0f9-739f-434b-b392-84140484292a tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:47:21.223424 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3dafd0f9-739f-434b-b392-84140484292a tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:47:21.227278 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3dafd0f9-739f-434b-b392-84140484292a tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:47:21.227278 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3dafd0f9-739f-434b-b392-84140484292a tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:47:21.227278 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3dafd0f9-739f-434b-b392-84140484292a tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:47:21.227278 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3dafd0f9-739f-434b-b392-84140484292a tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:47:21.227278 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-3dafd0f9-739f-434b-b392-84140484292a tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:47:21.361830 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-3dafd0f9-739f-434b-b392-84140484292a tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:47:21.369555 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-3dafd0f9-739f-434b-b392-84140484292a tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a" status: 200 len: 1679 microversion: 2.1 time: 0.165879 Oct 19 04:47:21.370132 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3900/8275] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:47:21 2022] GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a => generated 1679 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:47:22.395189 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-647710df-04a4-4e27-9710-5612ddf645ec tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:47:22.395962 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-647710df-04a4-4e27-9710-5612ddf645ec tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:47:22.405183 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-647710df-04a4-4e27-9710-5612ddf645ec tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:47:22.405734 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-647710df-04a4-4e27-9710-5612ddf645ec tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:47:22.406199 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-647710df-04a4-4e27-9710-5612ddf645ec tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:47:22.406924 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-647710df-04a4-4e27-9710-5612ddf645ec tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:47:22.407398 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-647710df-04a4-4e27-9710-5612ddf645ec tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:47:22.407851 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-647710df-04a4-4e27-9710-5612ddf645ec tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:47:22.412490 n-d-861333-8 devstack@n-api.service[121134]: INFO oslo.messaging._drivers.impl_rabbit [-] [96947759-862b-4b0f-b2e1-828b2ec3f179] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 36844. Oct 19 04:47:22.414827 n-d-861333-8 devstack@n-api.service[121134]: INFO oslo.messaging._drivers.impl_rabbit [-] [1a02a1d9-5473-4a0a-ab8b-e198030a9897] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 36846. Oct 19 04:47:22.543999 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-647710df-04a4-4e27-9710-5612ddf645ec tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:47:22.552361 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-647710df-04a4-4e27-9710-5612ddf645ec tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a" status: 200 len: 1679 microversion: 2.1 time: 0.163387 Oct 19 04:47:22.552935 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4376/8276] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:47:22 2022] GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a => generated 1679 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:47:23.576434 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e2bbe0b1-eb0a-46e3-b5bd-eb92af2aa85c tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:47:23.577110 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e2bbe0b1-eb0a-46e3-b5bd-eb92af2aa85c tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:47:23.588225 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e2bbe0b1-eb0a-46e3-b5bd-eb92af2aa85c tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:47:23.588722 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e2bbe0b1-eb0a-46e3-b5bd-eb92af2aa85c tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:47:23.589179 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e2bbe0b1-eb0a-46e3-b5bd-eb92af2aa85c tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:47:23.589955 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e2bbe0b1-eb0a-46e3-b5bd-eb92af2aa85c tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:47:23.590407 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e2bbe0b1-eb0a-46e3-b5bd-eb92af2aa85c tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:47:23.590842 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e2bbe0b1-eb0a-46e3-b5bd-eb92af2aa85c tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:47:23.595970 n-d-861333-8 devstack@n-api.service[121135]: INFO oslo.messaging._drivers.impl_rabbit [-] [a4608907-9588-4b25-ac87-b956b6019667] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 36850. Oct 19 04:47:23.598478 n-d-861333-8 devstack@n-api.service[121135]: INFO oslo.messaging._drivers.impl_rabbit [-] [171e3f7c-7dfe-4dce-b74d-cf08e9363be7] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 36852. Oct 19 04:47:23.729661 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-e2bbe0b1-eb0a-46e3-b5bd-eb92af2aa85c tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:47:23.737725 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e2bbe0b1-eb0a-46e3-b5bd-eb92af2aa85c tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a" status: 200 len: 1679 microversion: 2.1 time: 0.165557 Oct 19 04:47:23.738303 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3901/8277] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:47:23 2022] GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a => generated 1679 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:47:24.762779 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e753483f-d76e-4670-b18d-972ec71f2375 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:47:24.763433 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e753483f-d76e-4670-b18d-972ec71f2375 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:47:24.770822 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e753483f-d76e-4670-b18d-972ec71f2375 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:47:24.771317 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e753483f-d76e-4670-b18d-972ec71f2375 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:47:24.771769 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e753483f-d76e-4670-b18d-972ec71f2375 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:47:24.772467 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e753483f-d76e-4670-b18d-972ec71f2375 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:47:24.772928 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e753483f-d76e-4670-b18d-972ec71f2375 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:47:24.773403 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e753483f-d76e-4670-b18d-972ec71f2375 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:47:24.907753 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e753483f-d76e-4670-b18d-972ec71f2375 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:47:24.915742 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e753483f-d76e-4670-b18d-972ec71f2375 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a" status: 200 len: 1679 microversion: 2.1 time: 0.156914 Oct 19 04:47:24.916315 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4377/8278] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:47:24 2022] GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:47:25.939259 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d8171770-4efd-4320-a629-d2f2a4c6f7a8 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:47:25.939863 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d8171770-4efd-4320-a629-d2f2a4c6f7a8 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:47:25.946819 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d8171770-4efd-4320-a629-d2f2a4c6f7a8 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:47:25.947311 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d8171770-4efd-4320-a629-d2f2a4c6f7a8 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:47:25.947758 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d8171770-4efd-4320-a629-d2f2a4c6f7a8 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:47:25.948453 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d8171770-4efd-4320-a629-d2f2a4c6f7a8 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:47:25.948917 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d8171770-4efd-4320-a629-d2f2a4c6f7a8 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:47:25.949351 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d8171770-4efd-4320-a629-d2f2a4c6f7a8 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:47:26.081349 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d8171770-4efd-4320-a629-d2f2a4c6f7a8 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:47:26.089200 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d8171770-4efd-4320-a629-d2f2a4c6f7a8 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a" status: 200 len: 1679 microversion: 2.1 time: 0.153854 Oct 19 04:47:26.089816 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3902/8279] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:47:25 2022] GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:47:27.113328 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b4372bc3-e2f7-43c3-85a9-3c30e11e9254 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:47:27.113981 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b4372bc3-e2f7-43c3-85a9-3c30e11e9254 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:47:27.120831 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b4372bc3-e2f7-43c3-85a9-3c30e11e9254 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:47:27.121335 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b4372bc3-e2f7-43c3-85a9-3c30e11e9254 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:47:27.121821 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b4372bc3-e2f7-43c3-85a9-3c30e11e9254 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:47:27.122528 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b4372bc3-e2f7-43c3-85a9-3c30e11e9254 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:47:27.123001 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b4372bc3-e2f7-43c3-85a9-3c30e11e9254 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:47:27.123452 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b4372bc3-e2f7-43c3-85a9-3c30e11e9254 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:47:27.253026 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b4372bc3-e2f7-43c3-85a9-3c30e11e9254 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:47:27.260964 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b4372bc3-e2f7-43c3-85a9-3c30e11e9254 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a" status: 200 len: 1679 microversion: 2.1 time: 0.151547 Oct 19 04:47:27.261871 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4378/8280] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:47:27 2022] GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:47:28.284811 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-257fbe30-875f-4127-9f2a-3cae44e23ff5 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:47:28.285452 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-257fbe30-875f-4127-9f2a-3cae44e23ff5 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:47:28.292233 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-257fbe30-875f-4127-9f2a-3cae44e23ff5 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:47:28.292718 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-257fbe30-875f-4127-9f2a-3cae44e23ff5 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:47:28.293153 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-257fbe30-875f-4127-9f2a-3cae44e23ff5 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:47:28.293868 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-257fbe30-875f-4127-9f2a-3cae44e23ff5 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:47:28.294328 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-257fbe30-875f-4127-9f2a-3cae44e23ff5 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:47:28.294750 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-257fbe30-875f-4127-9f2a-3cae44e23ff5 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:47:28.428741 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-257fbe30-875f-4127-9f2a-3cae44e23ff5 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:47:28.436506 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-257fbe30-875f-4127-9f2a-3cae44e23ff5 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a" status: 200 len: 1679 microversion: 2.1 time: 0.155864 Oct 19 04:47:28.437762 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3903/8281] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:47:28 2022] GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:47:29.459590 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-eccc0960-f8e8-48b8-adaf-9613ce292a30 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:47:29.460230 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-eccc0960-f8e8-48b8-adaf-9613ce292a30 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:47:29.467201 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eccc0960-f8e8-48b8-adaf-9613ce292a30 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:47:29.467709 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eccc0960-f8e8-48b8-adaf-9613ce292a30 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:47:29.468172 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eccc0960-f8e8-48b8-adaf-9613ce292a30 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:47:29.468889 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eccc0960-f8e8-48b8-adaf-9613ce292a30 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:47:29.469391 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eccc0960-f8e8-48b8-adaf-9613ce292a30 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:47:29.469844 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-eccc0960-f8e8-48b8-adaf-9613ce292a30 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:47:29.601865 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-eccc0960-f8e8-48b8-adaf-9613ce292a30 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:47:29.609837 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-eccc0960-f8e8-48b8-adaf-9613ce292a30 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a" status: 200 len: 1679 microversion: 2.1 time: 0.154130 Oct 19 04:47:29.610543 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4379/8282] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:47:29 2022] GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:47:30.633055 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-257fc3ee-162a-451e-bbe9-88ce5862cd4a tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:47:30.633700 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-257fc3ee-162a-451e-bbe9-88ce5862cd4a tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:47:30.641025 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-257fc3ee-162a-451e-bbe9-88ce5862cd4a tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:47:30.641535 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-257fc3ee-162a-451e-bbe9-88ce5862cd4a tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:47:30.641971 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-257fc3ee-162a-451e-bbe9-88ce5862cd4a tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:47:30.642654 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-257fc3ee-162a-451e-bbe9-88ce5862cd4a tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:47:30.643107 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-257fc3ee-162a-451e-bbe9-88ce5862cd4a tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:47:30.643531 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-257fc3ee-162a-451e-bbe9-88ce5862cd4a tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:47:30.779560 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-257fc3ee-162a-451e-bbe9-88ce5862cd4a tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:47:30.788188 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-257fc3ee-162a-451e-bbe9-88ce5862cd4a tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a" status: 200 len: 1679 microversion: 2.1 time: 0.159007 Oct 19 04:47:30.791466 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3904/8283] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:47:30 2022] GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:47:31.812244 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6c65c861-fe78-4687-ac53-3a4618f995c8 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:47:31.812885 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6c65c861-fe78-4687-ac53-3a4618f995c8 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:47:31.820168 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6c65c861-fe78-4687-ac53-3a4618f995c8 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:47:31.820670 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6c65c861-fe78-4687-ac53-3a4618f995c8 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:47:31.821121 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6c65c861-fe78-4687-ac53-3a4618f995c8 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:47:31.821862 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6c65c861-fe78-4687-ac53-3a4618f995c8 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:47:31.822326 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6c65c861-fe78-4687-ac53-3a4618f995c8 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:47:31.822765 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6c65c861-fe78-4687-ac53-3a4618f995c8 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:47:31.953476 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-6c65c861-fe78-4687-ac53-3a4618f995c8 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:47:31.961324 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6c65c861-fe78-4687-ac53-3a4618f995c8 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a" status: 200 len: 1700 microversion: 2.1 time: 0.153033 Oct 19 04:47:31.962153 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4380/8284] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:47:31 2022] GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a => generated 1700 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:47:32.986099 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1c7239d3-16be-4795-bc33-dfd816f579ab tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:47:32.986745 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1c7239d3-16be-4795-bc33-dfd816f579ab tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:47:32.995720 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1c7239d3-16be-4795-bc33-dfd816f579ab tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:47:32.996229 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1c7239d3-16be-4795-bc33-dfd816f579ab tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:47:32.996677 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1c7239d3-16be-4795-bc33-dfd816f579ab tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:47:32.998034 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1c7239d3-16be-4795-bc33-dfd816f579ab tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:47:32.998692 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1c7239d3-16be-4795-bc33-dfd816f579ab tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:47:32.999300 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1c7239d3-16be-4795-bc33-dfd816f579ab tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:47:33.150531 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-1c7239d3-16be-4795-bc33-dfd816f579ab tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:47:33.159634 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1c7239d3-16be-4795-bc33-dfd816f579ab tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a" status: 200 len: 1700 microversion: 2.1 time: 0.177898 Oct 19 04:47:33.161408 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3905/8285] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:47:32 2022] GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a => generated 1700 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:47:34.183239 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-2a0dd913-4505-46c3-b6d5-4093109afe20 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:47:34.183870 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-2a0dd913-4505-46c3-b6d5-4093109afe20 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:47:34.191239 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2a0dd913-4505-46c3-b6d5-4093109afe20 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:47:34.191737 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2a0dd913-4505-46c3-b6d5-4093109afe20 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:47:34.192190 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2a0dd913-4505-46c3-b6d5-4093109afe20 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:47:34.192895 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2a0dd913-4505-46c3-b6d5-4093109afe20 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:47:34.193397 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2a0dd913-4505-46c3-b6d5-4093109afe20 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:47:34.193848 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-2a0dd913-4505-46c3-b6d5-4093109afe20 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:47:34.332129 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-2a0dd913-4505-46c3-b6d5-4093109afe20 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:47:34.340110 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-2a0dd913-4505-46c3-b6d5-4093109afe20 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a" status: 200 len: 1695 microversion: 2.1 time: 0.160770 Oct 19 04:47:34.340687 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4381/8286] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:47:34 2022] GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a => generated 1695 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:47:35.038977 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-df668210-2d4d-4861-a755-e2e2d706d6a9 req-69c1319d-36b8-4676-a6ce-8203ce072c1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a", "name": "network-vif-plugged", "status": "completed", "tag": "052ac849-729d-4a7d-8519-3ad5980bb2b4"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:47:35.056417 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-df668210-2d4d-4861-a755-e2e2d706d6a9 req-69c1319d-36b8-4676-a6ce-8203ce072c1d service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:47:35.056911 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-df668210-2d4d-4861-a755-e2e2d706d6a9 req-69c1319d-36b8-4676-a6ce-8203ce072c1d service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:47:35.057345 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-df668210-2d4d-4861-a755-e2e2d706d6a9 req-69c1319d-36b8-4676-a6ce-8203ce072c1d service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:47:35.078085 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-df668210-2d4d-4861-a755-e2e2d706d6a9 req-69c1319d-36b8-4676-a6ce-8203ce072c1d service nova] Creating event network-vif-plugged:052ac849-729d-4a7d-8519-3ad5980bb2b4 for instance cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a on n-h2-861333-8 Oct 19 04:47:35.088445 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-df668210-2d4d-4861-a755-e2e2d706d6a9 req-69c1319d-36b8-4676-a6ce-8203ce072c1d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056741 Oct 19 04:47:35.089055 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3906/8287] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:47:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:47:35.364016 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1eb4f727-e47e-45ea-8c3c-28b8b79382ae tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:47:35.364601 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1eb4f727-e47e-45ea-8c3c-28b8b79382ae tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:47:35.371554 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1eb4f727-e47e-45ea-8c3c-28b8b79382ae tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:47:35.372062 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1eb4f727-e47e-45ea-8c3c-28b8b79382ae tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:47:35.372516 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1eb4f727-e47e-45ea-8c3c-28b8b79382ae tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:47:35.373228 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1eb4f727-e47e-45ea-8c3c-28b8b79382ae tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:47:35.373724 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1eb4f727-e47e-45ea-8c3c-28b8b79382ae tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:47:35.374173 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1eb4f727-e47e-45ea-8c3c-28b8b79382ae tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:47:35.523428 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-1eb4f727-e47e-45ea-8c3c-28b8b79382ae tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:47:35.531427 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1eb4f727-e47e-45ea-8c3c-28b8b79382ae tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a" status: 200 len: 1695 microversion: 2.1 time: 0.172261 Oct 19 04:47:35.532740 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4382/8288] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:47:35 2022] GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a => generated 1695 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:47:36.557046 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1abde0c2-66e6-4161-aa74-4658f0938b23 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:47:36.557794 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1abde0c2-66e6-4161-aa74-4658f0938b23 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:47:36.568364 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1abde0c2-66e6-4161-aa74-4658f0938b23 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:47:36.574906 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1abde0c2-66e6-4161-aa74-4658f0938b23 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:47:36.574906 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1abde0c2-66e6-4161-aa74-4658f0938b23 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:47:36.574906 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1abde0c2-66e6-4161-aa74-4658f0938b23 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:47:36.574906 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1abde0c2-66e6-4161-aa74-4658f0938b23 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:47:36.574906 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1abde0c2-66e6-4161-aa74-4658f0938b23 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:47:37.018138 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-1abde0c2-66e6-4161-aa74-4658f0938b23 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:47:37.026535 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1abde0c2-66e6-4161-aa74-4658f0938b23 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a" status: 200 len: 1695 microversion: 2.1 time: 0.474013 Oct 19 04:47:37.027112 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3907/8289] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:47:36 2022] GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a => generated 1695 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:47:38.051752 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6ff994bb-5b88-4a01-9929-45ffe903c2bc tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:47:38.053317 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6ff994bb-5b88-4a01-9929-45ffe903c2bc tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:47:38.062072 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6ff994bb-5b88-4a01-9929-45ffe903c2bc tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:47:38.062599 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6ff994bb-5b88-4a01-9929-45ffe903c2bc tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:47:38.063593 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6ff994bb-5b88-4a01-9929-45ffe903c2bc tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:47:38.064337 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6ff994bb-5b88-4a01-9929-45ffe903c2bc tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:47:38.065054 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6ff994bb-5b88-4a01-9929-45ffe903c2bc tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:47:38.065549 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6ff994bb-5b88-4a01-9929-45ffe903c2bc tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:47:38.222604 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-6ff994bb-5b88-4a01-9929-45ffe903c2bc tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:47:38.231137 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6ff994bb-5b88-4a01-9929-45ffe903c2bc tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a" status: 200 len: 1695 microversion: 2.1 time: 0.183956 Oct 19 04:47:38.247791 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4383/8290] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:47:38 2022] GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a => generated 1695 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:47:39.257600 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-bdd7c505-8df0-49ae-b123-5743e96e2ef8 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:47:39.258206 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-bdd7c505-8df0-49ae-b123-5743e96e2ef8 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:47:39.268449 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bdd7c505-8df0-49ae-b123-5743e96e2ef8 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:47:39.269080 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bdd7c505-8df0-49ae-b123-5743e96e2ef8 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:47:39.269761 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bdd7c505-8df0-49ae-b123-5743e96e2ef8 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:47:39.270467 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bdd7c505-8df0-49ae-b123-5743e96e2ef8 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:47:39.271098 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bdd7c505-8df0-49ae-b123-5743e96e2ef8 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:47:39.271816 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-bdd7c505-8df0-49ae-b123-5743e96e2ef8 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:47:39.436060 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-bdd7c505-8df0-49ae-b123-5743e96e2ef8 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:47:39.444716 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-bdd7c505-8df0-49ae-b123-5743e96e2ef8 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a" status: 200 len: 1695 microversion: 2.1 time: 0.191083 Oct 19 04:47:39.445411 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3908/8291] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:47:39 2022] GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a => generated 1695 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:47:40.468764 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6cfa6137-11bd-4e9b-a137-3c07b77842ba tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:47:40.469457 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6cfa6137-11bd-4e9b-a137-3c07b77842ba tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:47:40.476368 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6cfa6137-11bd-4e9b-a137-3c07b77842ba tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:47:40.476873 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6cfa6137-11bd-4e9b-a137-3c07b77842ba tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:47:40.477335 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6cfa6137-11bd-4e9b-a137-3c07b77842ba tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:47:40.478122 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6cfa6137-11bd-4e9b-a137-3c07b77842ba tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:47:40.478552 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6cfa6137-11bd-4e9b-a137-3c07b77842ba tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:47:40.480116 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6cfa6137-11bd-4e9b-a137-3c07b77842ba tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:47:40.623557 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-6cfa6137-11bd-4e9b-a137-3c07b77842ba tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:47:40.632937 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6cfa6137-11bd-4e9b-a137-3c07b77842ba tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a" status: 200 len: 1695 microversion: 2.1 time: 0.168116 Oct 19 04:47:40.633579 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4384/8292] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:47:40 2022] GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a => generated 1695 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:47:41.659372 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9e67a089-a924-402a-ba7d-009ed586ba58 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:47:41.660846 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9e67a089-a924-402a-ba7d-009ed586ba58 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:47:41.668797 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9e67a089-a924-402a-ba7d-009ed586ba58 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:47:41.669437 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9e67a089-a924-402a-ba7d-009ed586ba58 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:47:41.669956 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9e67a089-a924-402a-ba7d-009ed586ba58 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:47:41.670775 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9e67a089-a924-402a-ba7d-009ed586ba58 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:47:41.671302 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9e67a089-a924-402a-ba7d-009ed586ba58 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:47:41.671977 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9e67a089-a924-402a-ba7d-009ed586ba58 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:47:41.814679 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-9e67a089-a924-402a-ba7d-009ed586ba58 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:47:41.822810 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9e67a089-a924-402a-ba7d-009ed586ba58 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a" status: 200 len: 1695 microversion: 2.1 time: 0.168271 Oct 19 04:47:41.823866 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3909/8293] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:47:41 2022] GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a => generated 1695 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:47:42.846730 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-81e95a8a-6f0e-4a74-81c1-b059d0deeb11 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:47:42.848279 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-81e95a8a-6f0e-4a74-81c1-b059d0deeb11 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:47:42.856408 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-81e95a8a-6f0e-4a74-81c1-b059d0deeb11 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:47:42.857260 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-81e95a8a-6f0e-4a74-81c1-b059d0deeb11 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:47:42.857997 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-81e95a8a-6f0e-4a74-81c1-b059d0deeb11 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:47:42.858738 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-81e95a8a-6f0e-4a74-81c1-b059d0deeb11 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:47:42.859215 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-81e95a8a-6f0e-4a74-81c1-b059d0deeb11 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:47:42.859666 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-81e95a8a-6f0e-4a74-81c1-b059d0deeb11 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:47:43.004061 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-81e95a8a-6f0e-4a74-81c1-b059d0deeb11 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:47:43.015335 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-81e95a8a-6f0e-4a74-81c1-b059d0deeb11 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a" status: 200 len: 1695 microversion: 2.1 time: 0.172648 Oct 19 04:47:43.015930 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4385/8294] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:47:42 2022] GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a => generated 1695 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:47:44.041103 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-eacb92a7-4448-4740-bc1c-0e2cc7fea6fc tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:47:44.041731 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-eacb92a7-4448-4740-bc1c-0e2cc7fea6fc tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:47:44.048542 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-eacb92a7-4448-4740-bc1c-0e2cc7fea6fc tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:47:44.048974 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-eacb92a7-4448-4740-bc1c-0e2cc7fea6fc tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:47:44.049438 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-eacb92a7-4448-4740-bc1c-0e2cc7fea6fc tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:47:44.050351 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-eacb92a7-4448-4740-bc1c-0e2cc7fea6fc tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:47:44.051060 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-eacb92a7-4448-4740-bc1c-0e2cc7fea6fc tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:47:44.051672 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-eacb92a7-4448-4740-bc1c-0e2cc7fea6fc tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:47:44.202784 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-eacb92a7-4448-4740-bc1c-0e2cc7fea6fc tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:47:44.211239 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-eacb92a7-4448-4740-bc1c-0e2cc7fea6fc tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a" status: 200 len: 1695 microversion: 2.1 time: 0.175079 Oct 19 04:47:44.212018 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3910/8295] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:47:44 2022] GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a => generated 1695 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:47:45.235313 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-03f62818-f88e-4716-a572-065c091b30ab tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:47:45.235972 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-03f62818-f88e-4716-a572-065c091b30ab tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:47:45.242867 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-03f62818-f88e-4716-a572-065c091b30ab tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:47:45.243382 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-03f62818-f88e-4716-a572-065c091b30ab tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:47:45.243842 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-03f62818-f88e-4716-a572-065c091b30ab tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:47:45.244557 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-03f62818-f88e-4716-a572-065c091b30ab tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:47:45.245071 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-03f62818-f88e-4716-a572-065c091b30ab tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:47:45.245562 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-03f62818-f88e-4716-a572-065c091b30ab tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:47:45.381175 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-03f62818-f88e-4716-a572-065c091b30ab tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:47:45.389176 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-03f62818-f88e-4716-a572-065c091b30ab tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a" status: 200 len: 1695 microversion: 2.1 time: 0.157830 Oct 19 04:47:45.389795 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4386/8296] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:47:45 2022] GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a => generated 1695 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:47:46.413131 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e467b066-74ef-499b-a7aa-1b70fd29fbb0 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:47:46.413789 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e467b066-74ef-499b-a7aa-1b70fd29fbb0 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:47:46.420580 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e467b066-74ef-499b-a7aa-1b70fd29fbb0 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:47:46.421076 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e467b066-74ef-499b-a7aa-1b70fd29fbb0 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:47:46.421551 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e467b066-74ef-499b-a7aa-1b70fd29fbb0 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:47:46.422250 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e467b066-74ef-499b-a7aa-1b70fd29fbb0 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:47:46.422713 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e467b066-74ef-499b-a7aa-1b70fd29fbb0 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:47:46.423172 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e467b066-74ef-499b-a7aa-1b70fd29fbb0 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:47:46.554409 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-e467b066-74ef-499b-a7aa-1b70fd29fbb0 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:47:46.562231 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e467b066-74ef-499b-a7aa-1b70fd29fbb0 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a" status: 200 len: 1677 microversion: 2.1 time: 0.152987 Oct 19 04:47:46.562797 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3911/8297] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:47:46 2022] GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:47:47.591846 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b30e15f9-b225-458a-b4b7-4cc544d8b191 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:47:47.592488 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b30e15f9-b225-458a-b4b7-4cc544d8b191 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:47:47.600147 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b30e15f9-b225-458a-b4b7-4cc544d8b191 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:47:47.600654 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b30e15f9-b225-458a-b4b7-4cc544d8b191 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:47:47.601109 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b30e15f9-b225-458a-b4b7-4cc544d8b191 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:47:47.601889 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b30e15f9-b225-458a-b4b7-4cc544d8b191 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:47:47.602356 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b30e15f9-b225-458a-b4b7-4cc544d8b191 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:47:47.602799 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b30e15f9-b225-458a-b4b7-4cc544d8b191 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:47:47.740626 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-b30e15f9-b225-458a-b4b7-4cc544d8b191 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:47:47.749070 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b30e15f9-b225-458a-b4b7-4cc544d8b191 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a" status: 200 len: 1677 microversion: 2.1 time: 0.161031 Oct 19 04:47:47.750075 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4387/8298] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:47:47 2022] GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:47:48.773364 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9803a4e2-7422-4256-89c0-d8727446132b tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:47:48.774039 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9803a4e2-7422-4256-89c0-d8727446132b tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:47:48.780827 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9803a4e2-7422-4256-89c0-d8727446132b tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:47:48.781310 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9803a4e2-7422-4256-89c0-d8727446132b tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:47:48.781825 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9803a4e2-7422-4256-89c0-d8727446132b tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:47:48.782588 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9803a4e2-7422-4256-89c0-d8727446132b tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:47:48.783071 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9803a4e2-7422-4256-89c0-d8727446132b tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:47:48.783751 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9803a4e2-7422-4256-89c0-d8727446132b tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:47:48.913555 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-9803a4e2-7422-4256-89c0-d8727446132b tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:47:48.921341 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9803a4e2-7422-4256-89c0-d8727446132b tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a" status: 200 len: 1620 microversion: 2.1 time: 0.151970 Oct 19 04:47:48.922019 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3912/8299] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:47:48 2022] GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a => generated 1620 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:47:48.944566 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-45eae151-d5aa-4d8f-b112-08b3070c83b0 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:47:48.945185 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-45eae151-d5aa-4d8f-b112-08b3070c83b0 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:47:48.952276 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-45eae151-d5aa-4d8f-b112-08b3070c83b0 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:47:48.952785 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-45eae151-d5aa-4d8f-b112-08b3070c83b0 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:47:48.953245 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-45eae151-d5aa-4d8f-b112-08b3070c83b0 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:47:48.954055 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-45eae151-d5aa-4d8f-b112-08b3070c83b0 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:47:48.954533 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-45eae151-d5aa-4d8f-b112-08b3070c83b0 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:47:48.954981 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-45eae151-d5aa-4d8f-b112-08b3070c83b0 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:47:48.997115 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-45eae151-d5aa-4d8f-b112-08b3070c83b0 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121134) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 19 04:47:49.044615 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-5e18ac70-d6be-44fe-b93f-9d7406b508c0 req-aecfc024-62be-4bae-be95-54b1c1a4bea4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a", "name": "network-vif-unplugged", "status": "completed", "tag": "052ac849-729d-4a7d-8519-3ad5980bb2b4"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:47:49.054713 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-5e18ac70-d6be-44fe-b93f-9d7406b508c0 req-aecfc024-62be-4bae-be95-54b1c1a4bea4 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:47:49.055227 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-5e18ac70-d6be-44fe-b93f-9d7406b508c0 req-aecfc024-62be-4bae-be95-54b1c1a4bea4 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:47:49.055659 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-5e18ac70-d6be-44fe-b93f-9d7406b508c0 req-aecfc024-62be-4bae-be95-54b1c1a4bea4 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:47:49.066623 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.compute.server_external_events [req-5e18ac70-d6be-44fe-b93f-9d7406b508c0 req-aecfc024-62be-4bae-be95-54b1c1a4bea4 service nova] Unable to find a host for instance cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a. Dropping event network-vif-unplugged {{(pid=121135) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 19 04:47:49.067512 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-5e18ac70-d6be-44fe-b93f-9d7406b508c0 req-aecfc024-62be-4bae-be95-54b1c1a4bea4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.026968 Oct 19 04:47:49.068090 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3913/8300] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:47:49 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 28 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Oct 19 04:47:49.090977 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:47:49.242882 n-d-861333-8 devstack@n-api.service[121134]: ERROR oslo.messaging._drivers.impl_rabbit [None req-45eae151-d5aa-4d8f-b112-08b3070c83b0 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [c05aef85-47e0-45f7-a28b-fdfe1b7df516] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 19 04:47:50.251399 n-d-861333-8 devstack@n-api.service[121134]: INFO oslo.messaging._drivers.impl_rabbit [None req-45eae151-d5aa-4d8f-b112-08b3070c83b0 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [c05aef85-47e0-45f7-a28b-fdfe1b7df516] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 36958. Oct 19 04:47:50.255212 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-45eae151-d5aa-4d8f-b112-08b3070c83b0 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "POST /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a/action" status: 202 len: 0 microversion: 2.1 time: 1.314546 Oct 19 04:47:50.255850 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4388/8301] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 04:47:48 2022] POST /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a/action => generated 0 bytes in 1316 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 04:47:50.263994 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f4cd753c-15ae-4e6a-be33-3a114e9807b3 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:47:50.264619 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f4cd753c-15ae-4e6a-be33-3a114e9807b3 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:47:50.271500 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f4cd753c-15ae-4e6a-be33-3a114e9807b3 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:47:50.271994 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f4cd753c-15ae-4e6a-be33-3a114e9807b3 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:47:50.272440 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f4cd753c-15ae-4e6a-be33-3a114e9807b3 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:47:50.273145 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f4cd753c-15ae-4e6a-be33-3a114e9807b3 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:47:50.273630 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f4cd753c-15ae-4e6a-be33-3a114e9807b3 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:47:50.274072 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f4cd753c-15ae-4e6a-be33-3a114e9807b3 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:47:50.410026 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f4cd753c-15ae-4e6a-be33-3a114e9807b3 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:47:50.417842 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f4cd753c-15ae-4e6a-be33-3a114e9807b3 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a" status: 200 len: 1628 microversion: 2.1 time: 0.157664 Oct 19 04:47:50.418633 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3914/8302] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:47:50 2022] GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a => generated 1628 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:47:51.445988 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ba868b05-32c2-4fec-b900-7149534d563d tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:47:51.446651 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ba868b05-32c2-4fec-b900-7149534d563d tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:47:51.449395 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:47:51.454717 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ba868b05-32c2-4fec-b900-7149534d563d tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:47:51.455223 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ba868b05-32c2-4fec-b900-7149534d563d tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:47:51.455680 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ba868b05-32c2-4fec-b900-7149534d563d tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:47:51.456523 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ba868b05-32c2-4fec-b900-7149534d563d tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:47:51.456895 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ba868b05-32c2-4fec-b900-7149534d563d tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:47:51.457342 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ba868b05-32c2-4fec-b900-7149534d563d tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:47:51.596382 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ba868b05-32c2-4fec-b900-7149534d563d tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:47:51.604346 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ba868b05-32c2-4fec-b900-7149534d563d tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a" status: 200 len: 1628 microversion: 2.1 time: 0.163140 Oct 19 04:47:51.605148 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4389/8303] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:47:51 2022] GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a => generated 1628 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:47:52.628687 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-03f3ad33-6a23-413e-aa36-c8dee950f1c2 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:47:52.629286 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-03f3ad33-6a23-413e-aa36-c8dee950f1c2 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:47:52.632226 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=31 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:47:52.637108 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-03f3ad33-6a23-413e-aa36-c8dee950f1c2 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:47:52.637639 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-03f3ad33-6a23-413e-aa36-c8dee950f1c2 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:47:52.638090 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-03f3ad33-6a23-413e-aa36-c8dee950f1c2 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:47:52.638793 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-03f3ad33-6a23-413e-aa36-c8dee950f1c2 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:47:52.639256 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-03f3ad33-6a23-413e-aa36-c8dee950f1c2 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:47:52.639692 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-03f3ad33-6a23-413e-aa36-c8dee950f1c2 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:47:52.642904 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=83 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:47:52.777387 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-03f3ad33-6a23-413e-aa36-c8dee950f1c2 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:47:52.789692 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-03f3ad33-6a23-413e-aa36-c8dee950f1c2 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a" status: 200 len: 1686 microversion: 2.1 time: 0.161288 Oct 19 04:47:52.789692 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3915/8304] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:47:52 2022] GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a => generated 1686 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:47:53.810243 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-7f9743e6-1171-4193-a70e-ac5747a35605 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:47:53.811026 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-7f9743e6-1171-4193-a70e-ac5747a35605 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:47:53.818171 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7f9743e6-1171-4193-a70e-ac5747a35605 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:47:53.818883 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7f9743e6-1171-4193-a70e-ac5747a35605 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:47:53.819339 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7f9743e6-1171-4193-a70e-ac5747a35605 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:47:53.820058 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7f9743e6-1171-4193-a70e-ac5747a35605 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:47:53.820531 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7f9743e6-1171-4193-a70e-ac5747a35605 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:47:53.820974 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-7f9743e6-1171-4193-a70e-ac5747a35605 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:47:53.961587 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-7f9743e6-1171-4193-a70e-ac5747a35605 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:47:53.971566 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-7f9743e6-1171-4193-a70e-ac5747a35605 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a" status: 200 len: 1686 microversion: 2.1 time: 0.165699 Oct 19 04:47:53.972559 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4390/8305] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:47:53 2022] GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a => generated 1686 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:47:54.995758 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d65e49f2-f88d-4ac8-8584-2442f7f1ae7e tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:47:54.996372 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d65e49f2-f88d-4ac8-8584-2442f7f1ae7e tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:47:55.003661 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d65e49f2-f88d-4ac8-8584-2442f7f1ae7e tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:47:55.004164 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d65e49f2-f88d-4ac8-8584-2442f7f1ae7e tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:47:55.004606 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d65e49f2-f88d-4ac8-8584-2442f7f1ae7e tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:47:55.005483 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d65e49f2-f88d-4ac8-8584-2442f7f1ae7e tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:47:55.005974 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d65e49f2-f88d-4ac8-8584-2442f7f1ae7e tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:47:55.006771 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d65e49f2-f88d-4ac8-8584-2442f7f1ae7e tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:47:55.155314 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d65e49f2-f88d-4ac8-8584-2442f7f1ae7e tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:47:55.164274 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d65e49f2-f88d-4ac8-8584-2442f7f1ae7e tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a" status: 200 len: 1686 microversion: 2.1 time: 0.172767 Oct 19 04:47:55.165138 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3916/8306] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:47:54 2022] GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a => generated 1686 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:47:56.187930 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a476850b-eb91-49ba-9cc7-3b39c54a9a51 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:47:56.188798 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a476850b-eb91-49ba-9cc7-3b39c54a9a51 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:47:56.195651 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a476850b-eb91-49ba-9cc7-3b39c54a9a51 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:47:56.196162 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a476850b-eb91-49ba-9cc7-3b39c54a9a51 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:47:56.196622 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a476850b-eb91-49ba-9cc7-3b39c54a9a51 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:47:56.197346 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a476850b-eb91-49ba-9cc7-3b39c54a9a51 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:47:56.197853 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a476850b-eb91-49ba-9cc7-3b39c54a9a51 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:47:56.198301 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a476850b-eb91-49ba-9cc7-3b39c54a9a51 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:47:56.343790 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a476850b-eb91-49ba-9cc7-3b39c54a9a51 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:47:56.352340 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a476850b-eb91-49ba-9cc7-3b39c54a9a51 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a" status: 200 len: 1686 microversion: 2.1 time: 0.168430 Oct 19 04:47:56.361428 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4391/8307] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:47:56 2022] GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a => generated 1686 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:47:57.377274 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-07eadb28-2c4f-48a5-9402-44b7979b0b16 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:47:57.378886 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-07eadb28-2c4f-48a5-9402-44b7979b0b16 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:47:57.387012 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-07eadb28-2c4f-48a5-9402-44b7979b0b16 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:47:57.387541 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-07eadb28-2c4f-48a5-9402-44b7979b0b16 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:47:57.388060 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-07eadb28-2c4f-48a5-9402-44b7979b0b16 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:47:57.388864 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-07eadb28-2c4f-48a5-9402-44b7979b0b16 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:47:57.389420 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-07eadb28-2c4f-48a5-9402-44b7979b0b16 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:47:57.389923 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-07eadb28-2c4f-48a5-9402-44b7979b0b16 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:47:57.534814 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-07eadb28-2c4f-48a5-9402-44b7979b0b16 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:47:57.542998 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-07eadb28-2c4f-48a5-9402-44b7979b0b16 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a" status: 200 len: 1686 microversion: 2.1 time: 0.170414 Oct 19 04:47:57.543597 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3917/8308] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:47:57 2022] GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a => generated 1686 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:47:58.566796 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-85daf11a-20ec-4b2f-b857-ac8c756128f6 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:47:58.568223 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-85daf11a-20ec-4b2f-b857-ac8c756128f6 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:47:58.576223 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-85daf11a-20ec-4b2f-b857-ac8c756128f6 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:47:58.577067 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-85daf11a-20ec-4b2f-b857-ac8c756128f6 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:47:58.577555 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-85daf11a-20ec-4b2f-b857-ac8c756128f6 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:47:58.578778 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-85daf11a-20ec-4b2f-b857-ac8c756128f6 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:47:58.579253 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-85daf11a-20ec-4b2f-b857-ac8c756128f6 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:47:58.579704 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-85daf11a-20ec-4b2f-b857-ac8c756128f6 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:47:58.730233 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-85daf11a-20ec-4b2f-b857-ac8c756128f6 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:47:58.745546 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-85daf11a-20ec-4b2f-b857-ac8c756128f6 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a" status: 200 len: 1686 microversion: 2.1 time: 0.182830 Oct 19 04:47:58.746152 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4392/8309] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:47:58 2022] GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a => generated 1686 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:47:59.770790 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-68f62c1a-797d-4eee-b2a3-e1caaa834206 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:47:59.772056 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-68f62c1a-797d-4eee-b2a3-e1caaa834206 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:47:59.779289 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-68f62c1a-797d-4eee-b2a3-e1caaa834206 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:47:59.779789 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-68f62c1a-797d-4eee-b2a3-e1caaa834206 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:47:59.780229 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-68f62c1a-797d-4eee-b2a3-e1caaa834206 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:47:59.780934 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-68f62c1a-797d-4eee-b2a3-e1caaa834206 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:47:59.781585 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-68f62c1a-797d-4eee-b2a3-e1caaa834206 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:47:59.782000 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-68f62c1a-797d-4eee-b2a3-e1caaa834206 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:47:59.992991 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-68f62c1a-797d-4eee-b2a3-e1caaa834206 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:48:00.002236 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-68f62c1a-797d-4eee-b2a3-e1caaa834206 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a" status: 200 len: 1686 microversion: 2.1 time: 0.235087 Oct 19 04:48:00.003024 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3918/8310] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:47:59 2022] GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a => generated 1686 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:48:01.029623 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-803f75c6-7a08-4bbd-a8ee-edd2441ffee1 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:48:01.030203 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-803f75c6-7a08-4bbd-a8ee-edd2441ffee1 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:48:01.037907 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-803f75c6-7a08-4bbd-a8ee-edd2441ffee1 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:48:01.038407 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-803f75c6-7a08-4bbd-a8ee-edd2441ffee1 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:48:01.038886 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-803f75c6-7a08-4bbd-a8ee-edd2441ffee1 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:48:01.039589 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-803f75c6-7a08-4bbd-a8ee-edd2441ffee1 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:48:01.040056 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-803f75c6-7a08-4bbd-a8ee-edd2441ffee1 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:48:01.040497 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-803f75c6-7a08-4bbd-a8ee-edd2441ffee1 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:48:01.177221 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-803f75c6-7a08-4bbd-a8ee-edd2441ffee1 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:48:01.185058 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-803f75c6-7a08-4bbd-a8ee-edd2441ffee1 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a" status: 200 len: 1686 microversion: 2.1 time: 0.159439 Oct 19 04:48:01.185669 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4393/8311] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:48:01 2022] GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a => generated 1686 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:48:02.208330 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-89b5f26e-9a53-4112-bec3-3d65a0bb7003 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:48:02.208949 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-89b5f26e-9a53-4112-bec3-3d65a0bb7003 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:48:02.215498 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-89b5f26e-9a53-4112-bec3-3d65a0bb7003 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:48:02.215988 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-89b5f26e-9a53-4112-bec3-3d65a0bb7003 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:48:02.216592 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-89b5f26e-9a53-4112-bec3-3d65a0bb7003 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:48:02.217310 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-89b5f26e-9a53-4112-bec3-3d65a0bb7003 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:48:02.217796 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-89b5f26e-9a53-4112-bec3-3d65a0bb7003 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:48:02.218233 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-89b5f26e-9a53-4112-bec3-3d65a0bb7003 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:48:02.350330 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-89b5f26e-9a53-4112-bec3-3d65a0bb7003 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:48:02.357191 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-89b5f26e-9a53-4112-bec3-3d65a0bb7003 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a" status: 200 len: 1686 microversion: 2.1 time: 0.152853 Oct 19 04:48:02.357795 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3919/8312] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:48:02 2022] GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a => generated 1686 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:48:03.382009 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0e04f3b2-ae60-4f6e-888d-c38bdac02307 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:48:03.382602 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0e04f3b2-ae60-4f6e-888d-c38bdac02307 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:48:03.391598 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0e04f3b2-ae60-4f6e-888d-c38bdac02307 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:48:03.392150 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0e04f3b2-ae60-4f6e-888d-c38bdac02307 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:48:03.392645 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0e04f3b2-ae60-4f6e-888d-c38bdac02307 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:48:03.393832 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0e04f3b2-ae60-4f6e-888d-c38bdac02307 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:48:03.394652 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0e04f3b2-ae60-4f6e-888d-c38bdac02307 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:48:03.395367 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0e04f3b2-ae60-4f6e-888d-c38bdac02307 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:48:03.553017 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0e04f3b2-ae60-4f6e-888d-c38bdac02307 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:48:03.561698 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0e04f3b2-ae60-4f6e-888d-c38bdac02307 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a" status: 200 len: 1686 microversion: 2.1 time: 0.183635 Oct 19 04:48:03.563106 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4394/8313] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:48:03 2022] GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a => generated 1686 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:48:04.586204 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-409dd159-bf1c-42ab-9437-897b42b38dac tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:48:04.586844 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-409dd159-bf1c-42ab-9437-897b42b38dac tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:48:04.593839 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-409dd159-bf1c-42ab-9437-897b42b38dac tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:48:04.594336 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-409dd159-bf1c-42ab-9437-897b42b38dac tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:48:04.594770 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-409dd159-bf1c-42ab-9437-897b42b38dac tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:48:04.595457 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-409dd159-bf1c-42ab-9437-897b42b38dac tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:48:04.595908 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-409dd159-bf1c-42ab-9437-897b42b38dac tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:48:04.596334 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-409dd159-bf1c-42ab-9437-897b42b38dac tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:48:04.730822 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-409dd159-bf1c-42ab-9437-897b42b38dac tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:48:04.739183 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-409dd159-bf1c-42ab-9437-897b42b38dac tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a" status: 200 len: 1686 microversion: 2.1 time: 0.156846 Oct 19 04:48:04.739747 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3920/8314] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:48:04 2022] GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a => generated 1686 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:48:05.762354 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-58272046-51be-4436-a259-8d58e3784888 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:48:05.763097 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-58272046-51be-4436-a259-8d58e3784888 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:48:05.770574 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-58272046-51be-4436-a259-8d58e3784888 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:48:05.771086 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-58272046-51be-4436-a259-8d58e3784888 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:48:05.771546 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-58272046-51be-4436-a259-8d58e3784888 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:48:05.772260 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-58272046-51be-4436-a259-8d58e3784888 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:48:05.772735 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-58272046-51be-4436-a259-8d58e3784888 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:48:05.773180 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-58272046-51be-4436-a259-8d58e3784888 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:48:05.907108 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-58272046-51be-4436-a259-8d58e3784888 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:48:05.915159 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-58272046-51be-4436-a259-8d58e3784888 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a" status: 200 len: 1686 microversion: 2.1 time: 0.156756 Oct 19 04:48:05.919703 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4395/8315] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:48:05 2022] GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a => generated 1686 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:48:06.939570 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-673c779d-5f12-41ff-b941-10b763f890b1 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:48:06.940185 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-673c779d-5f12-41ff-b941-10b763f890b1 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:48:06.947080 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-673c779d-5f12-41ff-b941-10b763f890b1 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:48:06.947561 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-673c779d-5f12-41ff-b941-10b763f890b1 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:48:06.947999 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-673c779d-5f12-41ff-b941-10b763f890b1 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:48:06.948683 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-673c779d-5f12-41ff-b941-10b763f890b1 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:48:06.949134 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-673c779d-5f12-41ff-b941-10b763f890b1 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:48:06.949588 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-673c779d-5f12-41ff-b941-10b763f890b1 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:48:07.087207 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-673c779d-5f12-41ff-b941-10b763f890b1 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:48:07.096008 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-673c779d-5f12-41ff-b941-10b763f890b1 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a" status: 200 len: 1686 microversion: 2.1 time: 0.160299 Oct 19 04:48:07.096602 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3921/8316] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:48:06 2022] GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a => generated 1686 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:48:07.149547 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-7a75aca8-d715-4864-9878-f4b7b2453c9b req-23a06c89-dda6-41a9-8f83-b0732b899b93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a", "name": "network-vif-plugged", "status": "completed", "tag": "052ac849-729d-4a7d-8519-3ad5980bb2b4"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:48:07.162864 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-7a75aca8-d715-4864-9878-f4b7b2453c9b req-23a06c89-dda6-41a9-8f83-b0732b899b93 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:48:07.163360 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-7a75aca8-d715-4864-9878-f4b7b2453c9b req-23a06c89-dda6-41a9-8f83-b0732b899b93 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:48:07.163879 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-7a75aca8-d715-4864-9878-f4b7b2453c9b req-23a06c89-dda6-41a9-8f83-b0732b899b93 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:48:07.178398 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-7a75aca8-d715-4864-9878-f4b7b2453c9b req-23a06c89-dda6-41a9-8f83-b0732b899b93 service nova] Creating event network-vif-plugged:052ac849-729d-4a7d-8519-3ad5980bb2b4 for instance cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a on n-h2-861333-8 Oct 19 04:48:07.183934 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-7a75aca8-d715-4864-9878-f4b7b2453c9b req-23a06c89-dda6-41a9-8f83-b0732b899b93 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038265 Oct 19 04:48:07.184683 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4396/8317] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:48:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:48:08.120362 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d5c5f65b-6c72-45dd-8f5a-84a1bc9ce8f7 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:48:08.121019 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d5c5f65b-6c72-45dd-8f5a-84a1bc9ce8f7 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:48:08.128604 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d5c5f65b-6c72-45dd-8f5a-84a1bc9ce8f7 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:48:08.129097 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d5c5f65b-6c72-45dd-8f5a-84a1bc9ce8f7 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:48:08.129707 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d5c5f65b-6c72-45dd-8f5a-84a1bc9ce8f7 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:48:08.130407 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d5c5f65b-6c72-45dd-8f5a-84a1bc9ce8f7 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:48:08.130869 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d5c5f65b-6c72-45dd-8f5a-84a1bc9ce8f7 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:48:08.131325 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d5c5f65b-6c72-45dd-8f5a-84a1bc9ce8f7 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:48:08.262112 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d5c5f65b-6c72-45dd-8f5a-84a1bc9ce8f7 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:48:08.269830 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d5c5f65b-6c72-45dd-8f5a-84a1bc9ce8f7 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a" status: 200 len: 1686 microversion: 2.1 time: 0.153662 Oct 19 04:48:08.270416 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3922/8318] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:48:08 2022] GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a => generated 1686 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:48:09.294826 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-196538da-b705-4613-ae95-f423f10667a3 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:48:09.295458 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-196538da-b705-4613-ae95-f423f10667a3 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:48:09.302410 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-196538da-b705-4613-ae95-f423f10667a3 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:48:09.302907 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-196538da-b705-4613-ae95-f423f10667a3 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:48:09.303357 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-196538da-b705-4613-ae95-f423f10667a3 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:48:09.304061 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-196538da-b705-4613-ae95-f423f10667a3 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:48:09.304528 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-196538da-b705-4613-ae95-f423f10667a3 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:48:09.304967 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-196538da-b705-4613-ae95-f423f10667a3 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:48:09.443313 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-196538da-b705-4613-ae95-f423f10667a3 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:48:09.451402 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-196538da-b705-4613-ae95-f423f10667a3 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a" status: 200 len: 1686 microversion: 2.1 time: 0.161767 Oct 19 04:48:09.451991 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4397/8319] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:48:09 2022] GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a => generated 1686 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:48:10.475734 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1e7dc97d-6a9e-4277-91ca-f42dfe5e09f1 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:48:10.476393 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1e7dc97d-6a9e-4277-91ca-f42dfe5e09f1 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:48:10.483272 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1e7dc97d-6a9e-4277-91ca-f42dfe5e09f1 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:48:10.483765 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1e7dc97d-6a9e-4277-91ca-f42dfe5e09f1 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:48:10.484209 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1e7dc97d-6a9e-4277-91ca-f42dfe5e09f1 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:48:10.484902 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1e7dc97d-6a9e-4277-91ca-f42dfe5e09f1 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:48:10.485361 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1e7dc97d-6a9e-4277-91ca-f42dfe5e09f1 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:48:10.485817 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1e7dc97d-6a9e-4277-91ca-f42dfe5e09f1 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:48:10.617792 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-1e7dc97d-6a9e-4277-91ca-f42dfe5e09f1 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:48:10.626122 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1e7dc97d-6a9e-4277-91ca-f42dfe5e09f1 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a" status: 200 len: 1673 microversion: 2.1 time: 0.154339 Oct 19 04:48:10.626709 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3923/8320] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:48:10 2022] GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a => generated 1673 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:49:24.490737 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=17 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:49:24.494316 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=17 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:49:24.495056 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=53 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:49:24.496178 n-d-861333-8 devstack@n-api.service[121135]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 04:49:24.496499 n-d-861333-8 devstack@n-api.service[121135]: Wed Oct 19 04:49:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.52) !!! Oct 19 04:49:24.501156 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-8cd7939d-471c-4501-8674-9bdc16509213 req-cd788462-0f87-4556-98f9-d342b2d16661 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a", "tag": "052ac849-729d-4a7d-8519-3ad5980bb2b4"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:49:24.502374 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=51,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:49:24.503290 n-d-861333-8 devstack@n-api.service[121134]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 04:49:24.503416 n-d-861333-8 devstack@n-api.service[121134]: Wed Oct 19 04:49:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a (ip 10.222.0.52) !!! Oct 19 04:49:24.508717 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c751a440-c0c7-4a8a-a125-ad1ffbf0731a tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:49:24.509242 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c751a440-c0c7-4a8a-a125-ad1ffbf0731a tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:49:24.521539 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c751a440-c0c7-4a8a-a125-ad1ffbf0731a tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:49:24.524755 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c751a440-c0c7-4a8a-a125-ad1ffbf0731a tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:49:24.524755 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c751a440-c0c7-4a8a-a125-ad1ffbf0731a tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:49:24.524755 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c751a440-c0c7-4a8a-a125-ad1ffbf0731a tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:49:24.524755 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c751a440-c0c7-4a8a-a125-ad1ffbf0731a tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:49:24.525145 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-8cd7939d-471c-4501-8674-9bdc16509213 req-cd788462-0f87-4556-98f9-d342b2d16661 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:49:24.525248 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c751a440-c0c7-4a8a-a125-ad1ffbf0731a tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:49:24.525337 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-8cd7939d-471c-4501-8674-9bdc16509213 req-cd788462-0f87-4556-98f9-d342b2d16661 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:49:24.525536 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-8cd7939d-471c-4501-8674-9bdc16509213 req-cd788462-0f87-4556-98f9-d342b2d16661 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:49:24.540027 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-8cd7939d-471c-4501-8674-9bdc16509213 req-cd788462-0f87-4556-98f9-d342b2d16661 service nova] Creating event network-changed:052ac849-729d-4a7d-8519-3ad5980bb2b4 for instance cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a on n-h2-861333-8 Oct 19 04:49:24.545414 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-8cd7939d-471c-4501-8674-9bdc16509213 req-cd788462-0f87-4556-98f9-d342b2d16661 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052811 Oct 19 04:49:24.546059 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3924/8321] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:49:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:49:24.558038 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c751a440-c0c7-4a8a-a125-ad1ffbf0731a tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a] Going to try to terminate instance {{(pid=121134) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 04:49:24.847909 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c751a440-c0c7-4a8a-a125-ad1ffbf0731a tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "DELETE /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a" status: 204 len: 0 microversion: 2.1 time: 0.359172 Oct 19 04:49:24.848645 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4398/8322] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 04:49:24 2022] DELETE /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 04:49:24.859961 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-aabe3959-7b29-41b1-8d6e-bb489215b362 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:49:24.860681 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-aabe3959-7b29-41b1-8d6e-bb489215b362 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:49:24.866958 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aabe3959-7b29-41b1-8d6e-bb489215b362 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:49:24.867764 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aabe3959-7b29-41b1-8d6e-bb489215b362 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:49:24.868364 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aabe3959-7b29-41b1-8d6e-bb489215b362 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:49:24.869179 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aabe3959-7b29-41b1-8d6e-bb489215b362 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:49:24.869746 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aabe3959-7b29-41b1-8d6e-bb489215b362 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:49:24.870246 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aabe3959-7b29-41b1-8d6e-bb489215b362 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:49:25.010826 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-aabe3959-7b29-41b1-8d6e-bb489215b362 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:49:25.019501 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-aabe3959-7b29-41b1-8d6e-bb489215b362 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a" status: 200 len: 1679 microversion: 2.1 time: 0.166063 Oct 19 04:49:25.033435 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3925/8323] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:49:24 2022] GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a => generated 1679 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:49:26.044258 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-490137f0-3ff8-4354-ad10-323e1385a849 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:49:26.044988 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-490137f0-3ff8-4354-ad10-323e1385a849 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:49:26.052355 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-490137f0-3ff8-4354-ad10-323e1385a849 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:49:26.052862 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-490137f0-3ff8-4354-ad10-323e1385a849 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:49:26.053324 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-490137f0-3ff8-4354-ad10-323e1385a849 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:49:26.054176 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-490137f0-3ff8-4354-ad10-323e1385a849 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:49:26.054655 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-490137f0-3ff8-4354-ad10-323e1385a849 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:49:26.055105 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-490137f0-3ff8-4354-ad10-323e1385a849 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:49:26.194012 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-490137f0-3ff8-4354-ad10-323e1385a849 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:49:26.201846 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-490137f0-3ff8-4354-ad10-323e1385a849 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a" status: 200 len: 1679 microversion: 2.1 time: 0.161982 Oct 19 04:49:26.202431 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4399/8324] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:49:26 2022] GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:49:26.879023 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-ae1b3edc-b896-41da-9fb0-dc58379bd348 req-d8e90b2e-f767-4ac3-9055-1498be061310 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a", "name": "network-vif-deleted", "tag": "052ac849-729d-4a7d-8519-3ad5980bb2b4"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:49:26.889769 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-ae1b3edc-b896-41da-9fb0-dc58379bd348 req-d8e90b2e-f767-4ac3-9055-1498be061310 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:49:26.893026 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-ae1b3edc-b896-41da-9fb0-dc58379bd348 req-d8e90b2e-f767-4ac3-9055-1498be061310 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:49:26.893026 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-ae1b3edc-b896-41da-9fb0-dc58379bd348 req-d8e90b2e-f767-4ac3-9055-1498be061310 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:49:26.902112 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-ae1b3edc-b896-41da-9fb0-dc58379bd348 req-d8e90b2e-f767-4ac3-9055-1498be061310 service nova] Creating event network-vif-deleted:052ac849-729d-4a7d-8519-3ad5980bb2b4 for instance cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a on n-h2-861333-8 Oct 19 04:49:26.906997 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-ae1b3edc-b896-41da-9fb0-dc58379bd348 req-d8e90b2e-f767-4ac3-9055-1498be061310 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032336 Oct 19 04:49:26.907586 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3926/8325] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:49:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:49:27.225991 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-f508db36-7c59-422f-bc08-55f0776b3c19 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:49:27.226625 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-f508db36-7c59-422f-bc08-55f0776b3c19 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:49:27.235869 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f508db36-7c59-422f-bc08-55f0776b3c19 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:49:27.236715 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f508db36-7c59-422f-bc08-55f0776b3c19 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:49:27.237174 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f508db36-7c59-422f-bc08-55f0776b3c19 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:49:27.237931 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f508db36-7c59-422f-bc08-55f0776b3c19 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:49:27.238413 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f508db36-7c59-422f-bc08-55f0776b3c19 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:49:27.238931 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f508db36-7c59-422f-bc08-55f0776b3c19 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:49:27.272539 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f508db36-7c59-422f-bc08-55f0776b3c19 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:49:27.273050 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f508db36-7c59-422f-bc08-55f0776b3c19 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:49:27.273597 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-f508db36-7c59-422f-bc08-55f0776b3c19 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:49:27.274059 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-f508db36-7c59-422f-bc08-55f0776b3c19 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lazy-loading 'fault' on Instance uuid cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 04:49:27.331880 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-f508db36-7c59-422f-bc08-55f0776b3c19 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:49:27.331880 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-f508db36-7c59-422f-bc08-55f0776b3c19 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a" status: 200 len: 1336 microversion: 2.1 time: 0.104920 Oct 19 04:49:27.331880 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4400/8326] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:49:27 2022] GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a => generated 1336 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:49:28.350909 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1b7eda86-bac6-4e38-9b0d-e46093b824ab tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:49:28.351793 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1b7eda86-bac6-4e38-9b0d-e46093b824ab tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:49:28.358794 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1b7eda86-bac6-4e38-9b0d-e46093b824ab tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:49:28.359818 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1b7eda86-bac6-4e38-9b0d-e46093b824ab tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:49:28.360252 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1b7eda86-bac6-4e38-9b0d-e46093b824ab tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:49:28.360964 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1b7eda86-bac6-4e38-9b0d-e46093b824ab tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:49:28.361438 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1b7eda86-bac6-4e38-9b0d-e46093b824ab tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:49:28.361865 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1b7eda86-bac6-4e38-9b0d-e46093b824ab tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:49:28.375748 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-1b7eda86-bac6-4e38-9b0d-e46093b824ab tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] HTTP exception thrown: Instance cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a could not be found. Oct 19 04:49:28.377389 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1b7eda86-bac6-4e38-9b0d-e46093b824ab tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Request method failure captured: Oct 19 04:49:28.377389 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a HTTP/1.1 Oct 19 04:49:28.377389 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 04:49:28.377389 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 04:49:28.377389 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 04:49:28.377389 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 04:49:28.377389 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 04:49:28.377389 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 04:49:28.377389 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 04:49:28.377389 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 04:49:28.377389 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT4DKRZlUUxUb299c6yd826PYCvuB0nWTYSxIyPauaqEYX6ErtQXOEQAsxlCuRH6In1Vuq3V5NZ0Ve9zmlUZO2Vt3otRhuU86ynDH7tFFMAAmDc-gohpdMVTH1mk8b2RQGtgGPbQtPvrQVifKJ3bDlPu8cRlnvWxl0lwpPL3eEmAqnIA Oct 19 04:49:28.377389 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 04:49:28.377389 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 04:49:28.377389 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 04:49:28.377389 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 04:49:28.377389 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 04:49:28.377389 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 04:49:28.377389 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: 0484467f1f7e4f968e2c85ec615c8557 Oct 19 04:49:28.377389 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-TestShelveInstance-286992043 Oct 19 04:49:28.377389 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 04:49:28.377389 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 04:49:28.377389 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/0484467f1f7e4f968e2c85ec615c8557"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0484467f1f7e4f968e2c85ec615c8557"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0484467f1f7e4f968e2c85ec615c8557"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_0484467f1f7e4f968e2c85ec615c8557", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 04:49:28.377389 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-TestShelveInstance-286992043 Oct 19 04:49:28.377389 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: 0484467f1f7e4f968e2c85ec615c8557 Oct 19 04:49:28.377389 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-TestShelveInstance-286992043 Oct 19 04:49:28.377389 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-TestShelveInstance-286992043-project Oct 19 04:49:28.377389 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 04:49:28.377389 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 04:49:28.377389 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 55ca1b7e70404198a6251b0babea4855 Oct 19 04:49:28.377389 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-TestShelveInstance-286992043-project Oct 19 04:49:28.377389 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 04:49:28.377389 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a could not be found. Oct 19 04:49:28.377389 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': 'cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a'} Oct 19 04:49:28.377389 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 04:49:28.377389 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:49:28.377389 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 04:49:28.377389 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 04:49:28.377389 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 04:49:28.377389 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 04:49:28.377389 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 04:49:28.377389 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 04:49:28.377389 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 04:49:28.377389 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 04:49:28.377389 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a could not be found. Oct 19 04:49:28.377389 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:49:28.377389 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:49:28.377389 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:49:28.377389 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:49:28.377389 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:49:28.377389 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:49:28.377389 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 04:49:28.377389 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 04:49:28.377389 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 04:49:28.377389 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 04:49:28.377389 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 04:49:28.377389 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 04:49:28.377389 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 04:49:28.377389 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 04:49:28.377389 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 04:49:28.377389 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 04:49:28.377389 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a could not be found. Oct 19 04:49:28.377389 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:49:28.377389 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:49:28.377389 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:49:28.383372 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:49:28.383372 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:49:28.383372 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:49:28.383372 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 04:49:28.383372 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 04:49:28.383372 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a could not be found. Oct 19 04:49:28.383372 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 04:49:28.383372 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1b7eda86-bac6-4e38-9b0d-e46093b824ab tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Returning 404 to user: Instance cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 04:49:28.383372 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1b7eda86-bac6-4e38-9b0d-e46093b824ab tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a" status: 404 len: 111 microversion: 2.1 time: 0.032238 Oct 19 04:49:28.383372 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3927/8327] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:49:28 2022] GET /compute/v2.1/servers/cb2b7429-83f9-4ef8-b8b0-da7a5cc7fb2a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 04:49:28.599470 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e1c624a8-7731-4e8e-af62-66339978cce7 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '.version_select at 0x7fc12b93dc10>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:49:28.686831 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e1c624a8-7731-4e8e-af62-66339978cce7 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1764667233" status: 202 len: 0 microversion: 2.1 time: 0.091193 Oct 19 04:49:28.687432 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4401/8328] 10.222.0.52 () {58 vars in 1254 bytes} [Wed Oct 19 04:49:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1764667233 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 04:49:28.711446 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-4f40df94-cf9f-4739-80e3-84e6526e4b85 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Action: 'create', calling method: .version_select at 0x7fc12b916f70>, body: {"keypair": {"name": "tempest-TestShelveInstance-1416815630", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEI3hOSgKVzG6zL8bInO0n5H9RLdIiEcvaHpwPlBGk2CPrg/a8rLU5HvNZ63WCQF+I888n2c7cadhYVI6chCf/Udv12ecQsSgvaqmj8XsiskIJ6r7cK5bo2JxZ6Np3/0Hw=="}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:49:28.727027 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-4f40df94-cf9f-4739-80e3-84e6526e4b85 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Getting quotas for project 0484467f1f7e4f968e2c85ec615c8557. Resources: {'key_pairs'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 04:49:28.732038 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-4f40df94-cf9f-4739-80e3-84e6526e4b85 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Getting quotas for user 55ca1b7e70404198a6251b0babea4855 and project 0484467f1f7e4f968e2c85ec615c8557. Resources: {'key_pairs'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 04:49:28.835103 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-4f40df94-cf9f-4739-80e3-84e6526e4b85 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.127553 Oct 19 04:49:28.835691 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3928/8329] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Oct 19 04:49:28 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:49:52.167639 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:49:52.168509 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:49:52.173197 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5ff78d71-61a2-46c9-bc58-0d839986cd29 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1457319321", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1416815630", "security_groups": [{"name": "tempest-secgroup-smoke-1613846170"}], "networks": [{"uuid": "34dfad40-621c-4c40-97dc-e6c23c65b306"}], "block_device_mapping_v2": [{"uuid": "49854828-5cb1-4126-9125-95b5e64538e8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:49:52.286833 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-5ff78d71-61a2-46c9-bc58-0d839986cd29 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] validate_networks() for [('34dfad40-621c-4c40-97dc-e6c23c65b306', None, None, None, None, None)] {{(pid=121134) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 04:49:52.654474 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-5ff78d71-61a2-46c9-bc58-0d839986cd29 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Flavor limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 04:49:52.655422 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-5ff78d71-61a2-46c9-bc58-0d839986cd29 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Image limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 04:49:52.655916 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-5ff78d71-61a2-46c9-bc58-0d839986cd29 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Flavor pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 04:49:52.656349 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-5ff78d71-61a2-46c9-bc58-0d839986cd29 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Image pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 04:49:52.656776 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-5ff78d71-61a2-46c9-bc58-0d839986cd29 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 04:49:52.665791 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5ff78d71-61a2-46c9-bc58-0d839986cd29 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:49:52.666284 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5ff78d71-61a2-46c9-bc58-0d839986cd29 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:49:52.666739 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5ff78d71-61a2-46c9-bc58-0d839986cd29 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:49:52.667487 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5ff78d71-61a2-46c9-bc58-0d839986cd29 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:49:52.667961 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5ff78d71-61a2-46c9-bc58-0d839986cd29 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:49:52.668403 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5ff78d71-61a2-46c9-bc58-0d839986cd29 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:49:52.686723 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-5ff78d71-61a2-46c9-bc58-0d839986cd29 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Getting quotas for project 0484467f1f7e4f968e2c85ec615c8557. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 04:49:52.691981 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-5ff78d71-61a2-46c9-bc58-0d839986cd29 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Getting quotas for user 55ca1b7e70404198a6251b0babea4855 and project 0484467f1f7e4f968e2c85ec615c8557. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 04:49:52.749884 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5ff78d71-61a2-46c9-bc58-0d839986cd29 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Going to run 1 instances... {{(pid=121134) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 04:49:52.752099 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5ff78d71-61a2-46c9-bc58-0d839986cd29 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: 85b80fab-9bae-4a22-bfe5-d6976a0c7b7c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='49854828-5cb1-4126-9125-95b5e64538e8',volume_size=None,volume_type=None)] {{(pid=121134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 04:49:53.188947 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5ff78d71-61a2-46c9-bc58-0d839986cd29 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.023090 Oct 19 04:49:53.189921 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4402/8330] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 04:49:52 2022] POST /compute/v2.1/servers => generated 406 bytes in 1025 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 04:49:53.198813 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=12 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:49:53.199582 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=4 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:49:53.200216 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:49:53.204089 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6e0f66b4-39df-4375-9f9a-1019c4345647 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:49:53.205641 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6e0f66b4-39df-4375-9f9a-1019c4345647 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: 85b80fab-9bae-4a22-bfe5-d6976a0c7b7c] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:49:53.265564 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-6e0f66b4-39df-4375-9f9a-1019c4345647 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:49:53.272922 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6e0f66b4-39df-4375-9f9a-1019c4345647 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c" status: 200 len: 1089 microversion: 2.1 time: 0.075891 Oct 19 04:49:53.273541 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3929/8331] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:49:53 2022] GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c => generated 1089 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:49:54.297762 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-bc408be3-a46a-4e4a-a9e0-218c9727abf2 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:49:54.298552 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-bc408be3-a46a-4e4a-a9e0-218c9727abf2 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: 85b80fab-9bae-4a22-bfe5-d6976a0c7b7c] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:49:54.308177 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bc408be3-a46a-4e4a-a9e0-218c9727abf2 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:49:54.308689 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bc408be3-a46a-4e4a-a9e0-218c9727abf2 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:49:54.309152 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bc408be3-a46a-4e4a-a9e0-218c9727abf2 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:49:54.309941 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bc408be3-a46a-4e4a-a9e0-218c9727abf2 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:49:54.310421 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bc408be3-a46a-4e4a-a9e0-218c9727abf2 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:49:54.310877 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-bc408be3-a46a-4e4a-a9e0-218c9727abf2 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:49:54.372464 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-bc408be3-a46a-4e4a-a9e0-218c9727abf2 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:49:54.380451 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-bc408be3-a46a-4e4a-a9e0-218c9727abf2 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c" status: 200 len: 1139 microversion: 2.1 time: 0.088328 Oct 19 04:49:54.381022 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4403/8332] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:49:54 2022] GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c => generated 1139 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:49:55.404207 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7e4b6c58-501c-47b6-a429-4e79746eb062 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:49:55.405413 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7e4b6c58-501c-47b6-a429-4e79746eb062 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: 85b80fab-9bae-4a22-bfe5-d6976a0c7b7c] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:49:55.412011 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7e4b6c58-501c-47b6-a429-4e79746eb062 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:49:55.412452 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7e4b6c58-501c-47b6-a429-4e79746eb062 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:49:55.412894 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7e4b6c58-501c-47b6-a429-4e79746eb062 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:49:55.413629 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7e4b6c58-501c-47b6-a429-4e79746eb062 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:49:55.414109 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7e4b6c58-501c-47b6-a429-4e79746eb062 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:49:55.414522 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7e4b6c58-501c-47b6-a429-4e79746eb062 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:49:55.482667 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7e4b6c58-501c-47b6-a429-4e79746eb062 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:49:55.507665 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7e4b6c58-501c-47b6-a429-4e79746eb062 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c" status: 200 len: 1195 microversion: 2.1 time: 0.091891 Oct 19 04:49:55.507665 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3930/8333] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:49:55 2022] GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c => generated 1195 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:49:56.515872 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3948e55f-0183-4b4f-a1da-1bbc443ecbc5 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:49:56.516569 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3948e55f-0183-4b4f-a1da-1bbc443ecbc5 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: 85b80fab-9bae-4a22-bfe5-d6976a0c7b7c] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:49:56.524189 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3948e55f-0183-4b4f-a1da-1bbc443ecbc5 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:49:56.524991 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3948e55f-0183-4b4f-a1da-1bbc443ecbc5 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:49:56.525670 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3948e55f-0183-4b4f-a1da-1bbc443ecbc5 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:49:56.526448 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3948e55f-0183-4b4f-a1da-1bbc443ecbc5 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:49:56.526924 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3948e55f-0183-4b4f-a1da-1bbc443ecbc5 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:49:56.527372 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3948e55f-0183-4b4f-a1da-1bbc443ecbc5 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:49:56.675856 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-3948e55f-0183-4b4f-a1da-1bbc443ecbc5 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:49:56.684463 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3948e55f-0183-4b4f-a1da-1bbc443ecbc5 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c" status: 200 len: 1273 microversion: 2.1 time: 0.173212 Oct 19 04:49:56.689408 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4404/8334] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:49:56 2022] GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c => generated 1273 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:49:57.258514 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-e9970fdb-0d67-4c1c-9326-781435bbda2a req-0659c9c0-9e56-4038-bbe7-bf974d97a9de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85b80fab-9bae-4a22-bfe5-d6976a0c7b7c", "tag": "c1153617-b219-4ee6-b6b6-bffc34520fdb"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:49:57.269940 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-e9970fdb-0d67-4c1c-9326-781435bbda2a req-0659c9c0-9e56-4038-bbe7-bf974d97a9de service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:49:57.270583 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-e9970fdb-0d67-4c1c-9326-781435bbda2a req-0659c9c0-9e56-4038-bbe7-bf974d97a9de service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:49:57.271269 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-e9970fdb-0d67-4c1c-9326-781435bbda2a req-0659c9c0-9e56-4038-bbe7-bf974d97a9de service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:49:57.283570 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-e9970fdb-0d67-4c1c-9326-781435bbda2a req-0659c9c0-9e56-4038-bbe7-bf974d97a9de service nova] Creating event network-changed:c1153617-b219-4ee6-b6b6-bffc34520fdb for instance 85b80fab-9bae-4a22-bfe5-d6976a0c7b7c on n-h2-861333-8 Oct 19 04:49:57.289001 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-e9970fdb-0d67-4c1c-9326-781435bbda2a req-0659c9c0-9e56-4038-bbe7-bf974d97a9de service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034784 Oct 19 04:49:57.289960 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3931/8335] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:49:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:49:57.708661 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c856ae4d-dce4-421a-b71d-8194ba0194e7 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:49:57.709304 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c856ae4d-dce4-421a-b71d-8194ba0194e7 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: 85b80fab-9bae-4a22-bfe5-d6976a0c7b7c] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:49:57.716412 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c856ae4d-dce4-421a-b71d-8194ba0194e7 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:49:57.716932 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c856ae4d-dce4-421a-b71d-8194ba0194e7 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:49:57.718032 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c856ae4d-dce4-421a-b71d-8194ba0194e7 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:49:57.718765 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c856ae4d-dce4-421a-b71d-8194ba0194e7 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:49:57.719245 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c856ae4d-dce4-421a-b71d-8194ba0194e7 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:49:57.719697 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c856ae4d-dce4-421a-b71d-8194ba0194e7 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:49:57.858959 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c856ae4d-dce4-421a-b71d-8194ba0194e7 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:49:57.868452 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c856ae4d-dce4-421a-b71d-8194ba0194e7 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c" status: 200 len: 1273 microversion: 2.1 time: 0.163565 Oct 19 04:49:57.869057 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4405/8336] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:49:57 2022] GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c => generated 1273 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:49:58.893543 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-45088d9b-67a7-4b26-80e3-088eadfa0eb6 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:49:58.894255 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-45088d9b-67a7-4b26-80e3-088eadfa0eb6 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: 85b80fab-9bae-4a22-bfe5-d6976a0c7b7c] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:49:58.900601 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-45088d9b-67a7-4b26-80e3-088eadfa0eb6 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:49:58.901093 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-45088d9b-67a7-4b26-80e3-088eadfa0eb6 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:49:58.901569 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-45088d9b-67a7-4b26-80e3-088eadfa0eb6 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:49:58.902277 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-45088d9b-67a7-4b26-80e3-088eadfa0eb6 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:49:58.902734 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-45088d9b-67a7-4b26-80e3-088eadfa0eb6 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:49:58.903166 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-45088d9b-67a7-4b26-80e3-088eadfa0eb6 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:49:59.040548 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-45088d9b-67a7-4b26-80e3-088eadfa0eb6 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:49:59.048457 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-45088d9b-67a7-4b26-80e3-088eadfa0eb6 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c" status: 200 len: 1273 microversion: 2.1 time: 0.160066 Oct 19 04:49:59.049033 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3932/8337] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:49:58 2022] GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c => generated 1273 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:50:00.071567 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ba6d721e-fa61-4ec3-855a-ab5e2ce75ecd tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:50:00.072340 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ba6d721e-fa61-4ec3-855a-ab5e2ce75ecd tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: 85b80fab-9bae-4a22-bfe5-d6976a0c7b7c] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:50:00.079992 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ba6d721e-fa61-4ec3-855a-ab5e2ce75ecd tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:50:00.080577 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ba6d721e-fa61-4ec3-855a-ab5e2ce75ecd tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:50:00.081139 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ba6d721e-fa61-4ec3-855a-ab5e2ce75ecd tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:50:00.081960 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ba6d721e-fa61-4ec3-855a-ab5e2ce75ecd tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:50:00.082513 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ba6d721e-fa61-4ec3-855a-ab5e2ce75ecd tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:50:00.083035 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ba6d721e-fa61-4ec3-855a-ab5e2ce75ecd tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:50:00.216499 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ba6d721e-fa61-4ec3-855a-ab5e2ce75ecd tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:50:00.224649 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ba6d721e-fa61-4ec3-855a-ab5e2ce75ecd tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c" status: 200 len: 1273 microversion: 2.1 time: 0.157018 Oct 19 04:50:00.225237 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4406/8338] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:50:00 2022] GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c => generated 1273 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:50:01.246977 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-28811689-679a-4b89-8874-f2b7c9ba7d9e tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:50:01.247596 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-28811689-679a-4b89-8874-f2b7c9ba7d9e tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: 85b80fab-9bae-4a22-bfe5-d6976a0c7b7c] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:50:01.254498 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-28811689-679a-4b89-8874-f2b7c9ba7d9e tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:50:01.254987 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-28811689-679a-4b89-8874-f2b7c9ba7d9e tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:50:01.255427 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-28811689-679a-4b89-8874-f2b7c9ba7d9e tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:50:01.256116 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-28811689-679a-4b89-8874-f2b7c9ba7d9e tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:50:01.256571 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-28811689-679a-4b89-8874-f2b7c9ba7d9e tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:50:01.256999 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-28811689-679a-4b89-8874-f2b7c9ba7d9e tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:50:01.393919 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-28811689-679a-4b89-8874-f2b7c9ba7d9e tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:50:01.401999 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-28811689-679a-4b89-8874-f2b7c9ba7d9e tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c" status: 200 len: 1261 microversion: 2.1 time: 0.158952 Oct 19 04:50:01.402623 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3933/8339] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:50:01 2022] GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c => generated 1261 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:50:02.426734 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-259648db-d8c9-4a87-84fb-13341ddba410 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:50:02.427371 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-259648db-d8c9-4a87-84fb-13341ddba410 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: 85b80fab-9bae-4a22-bfe5-d6976a0c7b7c] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:50:02.434280 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-259648db-d8c9-4a87-84fb-13341ddba410 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:50:02.434785 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-259648db-d8c9-4a87-84fb-13341ddba410 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:50:02.435242 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-259648db-d8c9-4a87-84fb-13341ddba410 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:50:02.435956 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-259648db-d8c9-4a87-84fb-13341ddba410 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:50:02.436430 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-259648db-d8c9-4a87-84fb-13341ddba410 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:50:02.436878 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-259648db-d8c9-4a87-84fb-13341ddba410 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:50:02.566996 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-259648db-d8c9-4a87-84fb-13341ddba410 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:50:02.574799 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-259648db-d8c9-4a87-84fb-13341ddba410 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c" status: 200 len: 1261 microversion: 2.1 time: 0.152056 Oct 19 04:50:02.575399 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4407/8340] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:50:02 2022] GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c => generated 1261 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:50:03.597894 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-aabfac35-1544-43f9-8e73-7af25f5a5112 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:50:03.598496 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-aabfac35-1544-43f9-8e73-7af25f5a5112 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: 85b80fab-9bae-4a22-bfe5-d6976a0c7b7c] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:50:03.605401 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aabfac35-1544-43f9-8e73-7af25f5a5112 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:50:03.605889 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aabfac35-1544-43f9-8e73-7af25f5a5112 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:50:03.606325 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aabfac35-1544-43f9-8e73-7af25f5a5112 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:50:03.607012 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aabfac35-1544-43f9-8e73-7af25f5a5112 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:50:03.607464 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aabfac35-1544-43f9-8e73-7af25f5a5112 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:50:03.608422 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-aabfac35-1544-43f9-8e73-7af25f5a5112 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:50:03.742733 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-aabfac35-1544-43f9-8e73-7af25f5a5112 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:50:03.751071 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-aabfac35-1544-43f9-8e73-7af25f5a5112 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c" status: 200 len: 1261 microversion: 2.1 time: 0.157010 Oct 19 04:50:03.751649 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3934/8341] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:50:03 2022] GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c => generated 1261 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:50:04.773556 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-04bb5a98-c840-449f-95e1-857a2e1c2e99 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:50:04.774194 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-04bb5a98-c840-449f-95e1-857a2e1c2e99 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: 85b80fab-9bae-4a22-bfe5-d6976a0c7b7c] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:50:04.776044 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:50:04.776725 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=6 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:50:04.782525 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-04bb5a98-c840-449f-95e1-857a2e1c2e99 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:50:04.783050 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-04bb5a98-c840-449f-95e1-857a2e1c2e99 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:50:04.783765 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-04bb5a98-c840-449f-95e1-857a2e1c2e99 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:50:04.784479 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-04bb5a98-c840-449f-95e1-857a2e1c2e99 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:50:04.784953 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-04bb5a98-c840-449f-95e1-857a2e1c2e99 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:50:04.785419 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-04bb5a98-c840-449f-95e1-857a2e1c2e99 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:50:04.916675 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-04bb5a98-c840-449f-95e1-857a2e1c2e99 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:50:04.925079 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-04bb5a98-c840-449f-95e1-857a2e1c2e99 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c" status: 200 len: 1261 microversion: 2.1 time: 0.155482 Oct 19 04:50:04.925687 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4408/8342] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:50:04 2022] GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c => generated 1261 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:50:05.949832 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:50:05.997611 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-837ff448-a75c-4620-aab2-b5beb217eb6b tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:50:05.998230 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-837ff448-a75c-4620-aab2-b5beb217eb6b tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: 85b80fab-9bae-4a22-bfe5-d6976a0c7b7c] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:50:06.004142 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-837ff448-a75c-4620-aab2-b5beb217eb6b tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:50:06.004622 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-837ff448-a75c-4620-aab2-b5beb217eb6b tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:50:06.005059 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-837ff448-a75c-4620-aab2-b5beb217eb6b tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:50:06.005772 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-837ff448-a75c-4620-aab2-b5beb217eb6b tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:50:06.006224 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-837ff448-a75c-4620-aab2-b5beb217eb6b tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:50:06.006645 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-837ff448-a75c-4620-aab2-b5beb217eb6b tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:50:06.136245 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-837ff448-a75c-4620-aab2-b5beb217eb6b tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:50:06.144593 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-837ff448-a75c-4620-aab2-b5beb217eb6b tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c" status: 200 len: 1261 microversion: 2.1 time: 0.200397 Oct 19 04:50:06.145167 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3935/8343] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:50:05 2022] GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c => generated 1261 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:50:07.167235 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-306b9d91-3398-4eb4-9ee9-658ea25e8b25 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:50:07.167880 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-306b9d91-3398-4eb4-9ee9-658ea25e8b25 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: 85b80fab-9bae-4a22-bfe5-d6976a0c7b7c] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:50:07.175482 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-306b9d91-3398-4eb4-9ee9-658ea25e8b25 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:50:07.175989 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-306b9d91-3398-4eb4-9ee9-658ea25e8b25 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:50:07.176451 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-306b9d91-3398-4eb4-9ee9-658ea25e8b25 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:50:07.177166 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-306b9d91-3398-4eb4-9ee9-658ea25e8b25 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:50:07.177671 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-306b9d91-3398-4eb4-9ee9-658ea25e8b25 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:50:07.178123 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-306b9d91-3398-4eb4-9ee9-658ea25e8b25 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:50:07.316137 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-306b9d91-3398-4eb4-9ee9-658ea25e8b25 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:50:07.323909 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-306b9d91-3398-4eb4-9ee9-658ea25e8b25 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c" status: 200 len: 1261 microversion: 2.1 time: 0.160661 Oct 19 04:50:07.324491 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4409/8344] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:50:07 2022] GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c => generated 1261 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:50:08.347290 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-8b7ba90e-f037-46b5-8fd5-40a4cf2038ba tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:50:08.347907 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-8b7ba90e-f037-46b5-8fd5-40a4cf2038ba tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: 85b80fab-9bae-4a22-bfe5-d6976a0c7b7c] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:50:08.354782 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8b7ba90e-f037-46b5-8fd5-40a4cf2038ba tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:50:08.355269 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8b7ba90e-f037-46b5-8fd5-40a4cf2038ba tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:50:08.355708 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8b7ba90e-f037-46b5-8fd5-40a4cf2038ba tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:50:08.356405 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8b7ba90e-f037-46b5-8fd5-40a4cf2038ba tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:50:08.356861 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8b7ba90e-f037-46b5-8fd5-40a4cf2038ba tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:50:08.357289 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8b7ba90e-f037-46b5-8fd5-40a4cf2038ba tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:50:08.487646 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-8b7ba90e-f037-46b5-8fd5-40a4cf2038ba tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:50:08.495349 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-8b7ba90e-f037-46b5-8fd5-40a4cf2038ba tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c" status: 200 len: 1261 microversion: 2.1 time: 0.152028 Oct 19 04:50:08.495922 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3936/8345] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:50:08 2022] GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c => generated 1261 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:50:09.517772 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a032f304-c45d-4702-84c6-693a2f0a217e tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:50:09.518415 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a032f304-c45d-4702-84c6-693a2f0a217e tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: 85b80fab-9bae-4a22-bfe5-d6976a0c7b7c] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:50:09.525202 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a032f304-c45d-4702-84c6-693a2f0a217e tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:50:09.536504 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a032f304-c45d-4702-84c6-693a2f0a217e tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:50:09.536504 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a032f304-c45d-4702-84c6-693a2f0a217e tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:50:09.536504 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a032f304-c45d-4702-84c6-693a2f0a217e tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:50:09.536504 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a032f304-c45d-4702-84c6-693a2f0a217e tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:50:09.536504 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a032f304-c45d-4702-84c6-693a2f0a217e tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:50:09.664700 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a032f304-c45d-4702-84c6-693a2f0a217e tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:50:09.673593 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a032f304-c45d-4702-84c6-693a2f0a217e tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c" status: 200 len: 1261 microversion: 2.1 time: 0.159727 Oct 19 04:50:09.674189 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4410/8346] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:50:09 2022] GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c => generated 1261 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:50:10.697034 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9bb20c01-d3e3-4463-a80e-e879527aed90 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:50:10.697675 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9bb20c01-d3e3-4463-a80e-e879527aed90 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: 85b80fab-9bae-4a22-bfe5-d6976a0c7b7c] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:50:10.705186 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9bb20c01-d3e3-4463-a80e-e879527aed90 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:50:10.705755 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9bb20c01-d3e3-4463-a80e-e879527aed90 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:50:10.706326 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9bb20c01-d3e3-4463-a80e-e879527aed90 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:50:10.707019 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9bb20c01-d3e3-4463-a80e-e879527aed90 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:50:10.707475 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9bb20c01-d3e3-4463-a80e-e879527aed90 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:50:10.707902 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9bb20c01-d3e3-4463-a80e-e879527aed90 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:50:10.839910 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-9bb20c01-d3e3-4463-a80e-e879527aed90 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:50:10.847998 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9bb20c01-d3e3-4463-a80e-e879527aed90 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c" status: 200 len: 1261 microversion: 2.1 time: 0.154925 Oct 19 04:50:10.848729 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3937/8347] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:50:10 2022] GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c => generated 1261 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:50:11.842547 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-2959b74f-fc8f-4006-89fa-ae31062bd392 req-4f9037c9-f644-4253-a3fc-88d2ec6d4a4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85b80fab-9bae-4a22-bfe5-d6976a0c7b7c", "name": "network-vif-plugged", "status": "completed", "tag": "c1153617-b219-4ee6-b6b6-bffc34520fdb"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:50:11.852838 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-2959b74f-fc8f-4006-89fa-ae31062bd392 req-4f9037c9-f644-4253-a3fc-88d2ec6d4a4e service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:50:11.853334 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-2959b74f-fc8f-4006-89fa-ae31062bd392 req-4f9037c9-f644-4253-a3fc-88d2ec6d4a4e service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:50:11.853814 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-2959b74f-fc8f-4006-89fa-ae31062bd392 req-4f9037c9-f644-4253-a3fc-88d2ec6d4a4e service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:50:11.864605 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-2959b74f-fc8f-4006-89fa-ae31062bd392 req-4f9037c9-f644-4253-a3fc-88d2ec6d4a4e service nova] Creating event network-vif-plugged:c1153617-b219-4ee6-b6b6-bffc34520fdb for instance 85b80fab-9bae-4a22-bfe5-d6976a0c7b7c on n-h2-861333-8 Oct 19 04:50:11.870017 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-2959b74f-fc8f-4006-89fa-ae31062bd392 req-4f9037c9-f644-4253-a3fc-88d2ec6d4a4e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031800 Oct 19 04:50:11.870932 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4411/8348] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:50:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:50:11.871783 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-49ccd422-2121-4e51-bce2-c03556adbab3 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:50:11.872515 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-49ccd422-2121-4e51-bce2-c03556adbab3 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: 85b80fab-9bae-4a22-bfe5-d6976a0c7b7c] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:50:11.880062 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-49ccd422-2121-4e51-bce2-c03556adbab3 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:50:11.880559 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-49ccd422-2121-4e51-bce2-c03556adbab3 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:50:11.881494 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-49ccd422-2121-4e51-bce2-c03556adbab3 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:50:11.881969 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-49ccd422-2121-4e51-bce2-c03556adbab3 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:50:11.882469 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-49ccd422-2121-4e51-bce2-c03556adbab3 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:50:11.882895 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-49ccd422-2121-4e51-bce2-c03556adbab3 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:50:12.038800 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-49ccd422-2121-4e51-bce2-c03556adbab3 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:50:12.051641 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-49ccd422-2121-4e51-bce2-c03556adbab3 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c" status: 200 len: 1261 microversion: 2.1 time: 0.184105 Oct 19 04:50:12.053574 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3938/8349] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:50:11 2022] GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c => generated 1261 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:50:13.077357 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c92a32be-ce01-4cfa-8633-6a17d1b07d48 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:50:13.078109 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c92a32be-ce01-4cfa-8633-6a17d1b07d48 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: 85b80fab-9bae-4a22-bfe5-d6976a0c7b7c] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:50:13.084483 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c92a32be-ce01-4cfa-8633-6a17d1b07d48 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:50:13.085006 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c92a32be-ce01-4cfa-8633-6a17d1b07d48 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:50:13.085553 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c92a32be-ce01-4cfa-8633-6a17d1b07d48 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:50:13.086279 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c92a32be-ce01-4cfa-8633-6a17d1b07d48 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:50:13.086753 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c92a32be-ce01-4cfa-8633-6a17d1b07d48 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:50:13.087202 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c92a32be-ce01-4cfa-8633-6a17d1b07d48 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:50:13.225959 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c92a32be-ce01-4cfa-8633-6a17d1b07d48 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:50:13.233739 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c92a32be-ce01-4cfa-8633-6a17d1b07d48 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c" status: 200 len: 1261 microversion: 2.1 time: 0.161625 Oct 19 04:50:13.234318 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4412/8350] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:50:13 2022] GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c => generated 1261 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:50:14.257915 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-5c4a6181-9e29-4d8d-9129-eb6d955982a5 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:50:14.258523 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-5c4a6181-9e29-4d8d-9129-eb6d955982a5 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: 85b80fab-9bae-4a22-bfe5-d6976a0c7b7c] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:50:14.265689 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5c4a6181-9e29-4d8d-9129-eb6d955982a5 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:50:14.266027 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5c4a6181-9e29-4d8d-9129-eb6d955982a5 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:50:14.266475 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5c4a6181-9e29-4d8d-9129-eb6d955982a5 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:50:14.267173 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5c4a6181-9e29-4d8d-9129-eb6d955982a5 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:50:14.267635 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5c4a6181-9e29-4d8d-9129-eb6d955982a5 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:50:14.268067 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-5c4a6181-9e29-4d8d-9129-eb6d955982a5 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:50:14.405047 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-5c4a6181-9e29-4d8d-9129-eb6d955982a5 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:50:14.413251 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-5c4a6181-9e29-4d8d-9129-eb6d955982a5 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c" status: 200 len: 1445 microversion: 2.1 time: 0.159212 Oct 19 04:50:14.413872 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3939/8351] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:50:14 2022] GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c => generated 1445 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:50:14.436474 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9acc543c-212a-4acd-8750-423a5f0211f1 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:50:14.437138 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9acc543c-212a-4acd-8750-423a5f0211f1 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: 85b80fab-9bae-4a22-bfe5-d6976a0c7b7c] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:50:14.443990 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9acc543c-212a-4acd-8750-423a5f0211f1 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:50:14.444494 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9acc543c-212a-4acd-8750-423a5f0211f1 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:50:14.444951 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9acc543c-212a-4acd-8750-423a5f0211f1 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:50:14.445686 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9acc543c-212a-4acd-8750-423a5f0211f1 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:50:14.446156 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9acc543c-212a-4acd-8750-423a5f0211f1 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:50:14.446602 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9acc543c-212a-4acd-8750-423a5f0211f1 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:50:14.578736 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9acc543c-212a-4acd-8750-423a5f0211f1 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:50:14.586721 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9acc543c-212a-4acd-8750-423a5f0211f1 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c" status: 200 len: 1445 microversion: 2.1 time: 0.154144 Oct 19 04:50:14.587290 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4413/8352] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:50:14 2022] GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c => generated 1445 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:50:16.802456 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-613d9d2b-a1da-4bf8-b43b-854b1e356285 req-181abdbc-affd-4fb0-ad80-7e7c50dc210f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85b80fab-9bae-4a22-bfe5-d6976a0c7b7c", "tag": "c1153617-b219-4ee6-b6b6-bffc34520fdb"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:50:16.812563 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-613d9d2b-a1da-4bf8-b43b-854b1e356285 req-181abdbc-affd-4fb0-ad80-7e7c50dc210f service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:50:16.813117 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-613d9d2b-a1da-4bf8-b43b-854b1e356285 req-181abdbc-affd-4fb0-ad80-7e7c50dc210f service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:50:16.813663 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-613d9d2b-a1da-4bf8-b43b-854b1e356285 req-181abdbc-affd-4fb0-ad80-7e7c50dc210f service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:50:16.824611 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-613d9d2b-a1da-4bf8-b43b-854b1e356285 req-181abdbc-affd-4fb0-ad80-7e7c50dc210f service nova] Creating event network-changed:c1153617-b219-4ee6-b6b6-bffc34520fdb for instance 85b80fab-9bae-4a22-bfe5-d6976a0c7b7c on n-h2-861333-8 Oct 19 04:50:16.830365 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-613d9d2b-a1da-4bf8-b43b-854b1e356285 req-181abdbc-affd-4fb0-ad80-7e7c50dc210f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086096 Oct 19 04:50:16.830981 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3940/8353] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:50:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:52:41.981293 n-d-861333-8 devstack@n-api.service[121134]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1a02a1d9-5473-4a0a-ab8b-e198030a9897] AMQP server on 10.222.0.52:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 19 04:52:41.982291 n-d-861333-8 devstack@n-api.service[121134]: ERROR oslo.messaging._drivers.impl_rabbit [-] [96947759-862b-4b0f-b2e1-828b2ec3f179] AMQP server on 10.222.0.52:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 19 04:52:41.983120 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:52:41.983916 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=64 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:52:41.985155 n-d-861333-8 devstack@n-api.service[121134]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 19 04:52:41.985295 n-d-861333-8 devstack@n-api.service[121134]: Wed Oct 19 04:52:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c/action (ip 10.222.0.52) !!! Oct 19 04:52:41.986558 n-d-861333-8 devstack@n-api.service[121134]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 19 04:52:41.986716 n-d-861333-8 devstack@n-api.service[121134]: Wed Oct 19 04:52:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c/action (ip 10.222.0.52) !!! Oct 19 04:52:41.990885 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-052d746d-caab-4b23-a916-ea952b77cea0 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:52:41.991451 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-052d746d-caab-4b23-a916-ea952b77cea0 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: 85b80fab-9bae-4a22-bfe5-d6976a0c7b7c] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:52:42.003784 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-052d746d-caab-4b23-a916-ea952b77cea0 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:52:42.004238 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-052d746d-caab-4b23-a916-ea952b77cea0 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:52:42.004702 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-052d746d-caab-4b23-a916-ea952b77cea0 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:52:42.005459 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-052d746d-caab-4b23-a916-ea952b77cea0 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:52:42.005946 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-052d746d-caab-4b23-a916-ea952b77cea0 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:52:42.006401 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-052d746d-caab-4b23-a916-ea952b77cea0 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:52:42.031214 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.objects.instance [None req-052d746d-caab-4b23-a916-ea952b77cea0 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lazy-loading 'flavor' on Instance uuid 85b80fab-9bae-4a22-bfe5-d6976a0c7b7c {{(pid=121134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 04:52:42.285469 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-052d746d-caab-4b23-a916-ea952b77cea0 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "POST /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c/action" status: 202 len: 0 microversion: 2.1 time: 0.305972 Oct 19 04:52:42.285996 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4414/8354] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 04:52:41 2022] POST /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c/action => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 04:52:42.292438 n-d-861333-8 devstack@n-api.service[121135]: ERROR oslo.messaging._drivers.impl_rabbit [-] [171e3f7c-7dfe-4dce-b74d-cf08e9363be7] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 19 04:52:42.293282 n-d-861333-8 devstack@n-api.service[121135]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a4608907-9588-4b25-ac87-b956b6019667] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 19 04:52:42.293932 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=26 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:52:42.295053 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=58 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:52:42.296236 n-d-861333-8 devstack@n-api.service[121135]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 04:52:42.296392 n-d-861333-8 devstack@n-api.service[121135]: Wed Oct 19 04:52:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c (ip 10.222.0.52) !!! Oct 19 04:52:42.297590 n-d-861333-8 devstack@n-api.service[121135]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 19 04:52:42.297722 n-d-861333-8 devstack@n-api.service[121135]: Wed Oct 19 04:52:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c (ip 10.222.0.52) !!! Oct 19 04:52:42.302773 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1d7d0857-1d25-4d9f-8766-df14f5652b17 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:52:42.303494 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1d7d0857-1d25-4d9f-8766-df14f5652b17 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: 85b80fab-9bae-4a22-bfe5-d6976a0c7b7c] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:52:42.312757 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1d7d0857-1d25-4d9f-8766-df14f5652b17 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:52:42.313249 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1d7d0857-1d25-4d9f-8766-df14f5652b17 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:52:42.313718 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1d7d0857-1d25-4d9f-8766-df14f5652b17 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:52:42.314439 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1d7d0857-1d25-4d9f-8766-df14f5652b17 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:52:42.314881 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1d7d0857-1d25-4d9f-8766-df14f5652b17 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:52:42.315310 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1d7d0857-1d25-4d9f-8766-df14f5652b17 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:52:42.457694 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-1d7d0857-1d25-4d9f-8766-df14f5652b17 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:52:42.465894 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1d7d0857-1d25-4d9f-8766-df14f5652b17 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c" status: 200 len: 1570 microversion: 2.1 time: 0.175315 Oct 19 04:52:42.466470 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3941/8355] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:52:42 2022] GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c => generated 1570 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:52:43.492024 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4fd43909-9e59-4ae6-b5a8-752e927eb17c tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:52:43.492670 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4fd43909-9e59-4ae6-b5a8-752e927eb17c tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: 85b80fab-9bae-4a22-bfe5-d6976a0c7b7c] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:52:43.501021 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4fd43909-9e59-4ae6-b5a8-752e927eb17c tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:52:43.501534 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4fd43909-9e59-4ae6-b5a8-752e927eb17c tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:52:43.501981 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4fd43909-9e59-4ae6-b5a8-752e927eb17c tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:52:43.502675 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4fd43909-9e59-4ae6-b5a8-752e927eb17c tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:52:43.503139 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4fd43909-9e59-4ae6-b5a8-752e927eb17c tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:52:43.503574 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4fd43909-9e59-4ae6-b5a8-752e927eb17c tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:52:43.508315 n-d-861333-8 devstack@n-api.service[121134]: INFO oslo.messaging._drivers.impl_rabbit [-] [96947759-862b-4b0f-b2e1-828b2ec3f179] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 37422. Oct 19 04:52:43.514147 n-d-861333-8 devstack@n-api.service[121134]: INFO oslo.messaging._drivers.impl_rabbit [-] [1a02a1d9-5473-4a0a-ab8b-e198030a9897] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 37420. Oct 19 04:52:43.682703 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-4fd43909-9e59-4ae6-b5a8-752e927eb17c tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:52:43.690701 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4fd43909-9e59-4ae6-b5a8-752e927eb17c tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c" status: 200 len: 1570 microversion: 2.1 time: 0.204768 Oct 19 04:52:43.691283 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4415/8356] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:52:43 2022] GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c => generated 1570 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:52:44.714217 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d1625cd1-5d62-4c15-995d-ac253e67382e tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:52:44.714840 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d1625cd1-5d62-4c15-995d-ac253e67382e tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: 85b80fab-9bae-4a22-bfe5-d6976a0c7b7c] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:52:44.725798 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d1625cd1-5d62-4c15-995d-ac253e67382e tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:52:44.726288 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d1625cd1-5d62-4c15-995d-ac253e67382e tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:52:44.726729 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d1625cd1-5d62-4c15-995d-ac253e67382e tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:52:44.727455 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d1625cd1-5d62-4c15-995d-ac253e67382e tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:52:44.727918 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d1625cd1-5d62-4c15-995d-ac253e67382e tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:52:44.728376 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d1625cd1-5d62-4c15-995d-ac253e67382e tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:52:44.733184 n-d-861333-8 devstack@n-api.service[121135]: INFO oslo.messaging._drivers.impl_rabbit [-] [171e3f7c-7dfe-4dce-b74d-cf08e9363be7] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 37430. Oct 19 04:52:44.734039 n-d-861333-8 devstack@n-api.service[121135]: INFO oslo.messaging._drivers.impl_rabbit [-] [a4608907-9588-4b25-ac87-b956b6019667] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 37432. Oct 19 04:52:44.863173 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d1625cd1-5d62-4c15-995d-ac253e67382e tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:52:44.871608 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d1625cd1-5d62-4c15-995d-ac253e67382e tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c" status: 200 len: 1570 microversion: 2.1 time: 0.161245 Oct 19 04:52:44.872181 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3942/8357] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:52:44 2022] GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c => generated 1570 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:52:45.894588 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a5e7e97d-d4c5-414e-a5b8-8d4e5ebaf1e8 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:52:45.895229 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a5e7e97d-d4c5-414e-a5b8-8d4e5ebaf1e8 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: 85b80fab-9bae-4a22-bfe5-d6976a0c7b7c] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:52:45.902712 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a5e7e97d-d4c5-414e-a5b8-8d4e5ebaf1e8 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:52:45.903219 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a5e7e97d-d4c5-414e-a5b8-8d4e5ebaf1e8 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:52:45.903682 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a5e7e97d-d4c5-414e-a5b8-8d4e5ebaf1e8 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:52:45.904396 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a5e7e97d-d4c5-414e-a5b8-8d4e5ebaf1e8 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:52:45.904873 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a5e7e97d-d4c5-414e-a5b8-8d4e5ebaf1e8 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:52:45.905324 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a5e7e97d-d4c5-414e-a5b8-8d4e5ebaf1e8 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:52:46.036670 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a5e7e97d-d4c5-414e-a5b8-8d4e5ebaf1e8 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:52:46.045137 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a5e7e97d-d4c5-414e-a5b8-8d4e5ebaf1e8 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c" status: 200 len: 1570 microversion: 2.1 time: 0.154456 Oct 19 04:52:46.045755 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4416/8358] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:52:45 2022] GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:52:47.069340 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e26d3786-bad2-4fdc-801a-6e9e183b1da6 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:52:47.069987 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e26d3786-bad2-4fdc-801a-6e9e183b1da6 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: 85b80fab-9bae-4a22-bfe5-d6976a0c7b7c] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:52:47.077381 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e26d3786-bad2-4fdc-801a-6e9e183b1da6 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:52:47.077889 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e26d3786-bad2-4fdc-801a-6e9e183b1da6 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:52:47.078332 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e26d3786-bad2-4fdc-801a-6e9e183b1da6 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:52:47.079026 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e26d3786-bad2-4fdc-801a-6e9e183b1da6 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:52:47.079488 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e26d3786-bad2-4fdc-801a-6e9e183b1da6 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:52:47.079919 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e26d3786-bad2-4fdc-801a-6e9e183b1da6 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:52:47.212297 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-e26d3786-bad2-4fdc-801a-6e9e183b1da6 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:52:47.220737 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e26d3786-bad2-4fdc-801a-6e9e183b1da6 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c" status: 200 len: 1570 microversion: 2.1 time: 0.155265 Oct 19 04:52:47.221315 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3943/8359] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:52:47 2022] GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:52:48.243845 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d460e03e-bbc1-4941-a81d-f8bec07f8574 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:52:48.244515 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d460e03e-bbc1-4941-a81d-f8bec07f8574 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: 85b80fab-9bae-4a22-bfe5-d6976a0c7b7c] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:52:48.251413 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d460e03e-bbc1-4941-a81d-f8bec07f8574 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:52:48.251923 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d460e03e-bbc1-4941-a81d-f8bec07f8574 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:52:48.252388 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d460e03e-bbc1-4941-a81d-f8bec07f8574 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:52:48.253107 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d460e03e-bbc1-4941-a81d-f8bec07f8574 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:52:48.253615 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d460e03e-bbc1-4941-a81d-f8bec07f8574 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:52:48.254068 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d460e03e-bbc1-4941-a81d-f8bec07f8574 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:52:48.382640 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d460e03e-bbc1-4941-a81d-f8bec07f8574 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:52:48.390563 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d460e03e-bbc1-4941-a81d-f8bec07f8574 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c" status: 200 len: 1570 microversion: 2.1 time: 0.150594 Oct 19 04:52:48.391155 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4417/8360] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:52:48 2022] GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:52:49.414373 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7917ca89-03f2-471b-9017-8b497d93c9c9 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:52:49.415018 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7917ca89-03f2-471b-9017-8b497d93c9c9 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: 85b80fab-9bae-4a22-bfe5-d6976a0c7b7c] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:52:49.424373 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7917ca89-03f2-471b-9017-8b497d93c9c9 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:52:49.424857 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7917ca89-03f2-471b-9017-8b497d93c9c9 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:52:49.425311 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7917ca89-03f2-471b-9017-8b497d93c9c9 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:52:49.426007 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7917ca89-03f2-471b-9017-8b497d93c9c9 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:52:49.426459 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7917ca89-03f2-471b-9017-8b497d93c9c9 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:52:49.426882 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7917ca89-03f2-471b-9017-8b497d93c9c9 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:52:49.559921 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7917ca89-03f2-471b-9017-8b497d93c9c9 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:52:49.567928 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7917ca89-03f2-471b-9017-8b497d93c9c9 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c" status: 200 len: 1570 microversion: 2.1 time: 0.157417 Oct 19 04:52:49.568603 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3944/8361] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:52:49 2022] GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c => generated 1570 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:52:50.592741 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ab79ecec-fb90-49a5-b80a-3aab409160aa tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:52:50.593389 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ab79ecec-fb90-49a5-b80a-3aab409160aa tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: 85b80fab-9bae-4a22-bfe5-d6976a0c7b7c] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:52:50.600287 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ab79ecec-fb90-49a5-b80a-3aab409160aa tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:52:50.600792 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ab79ecec-fb90-49a5-b80a-3aab409160aa tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:52:50.601252 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ab79ecec-fb90-49a5-b80a-3aab409160aa tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:52:50.601987 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ab79ecec-fb90-49a5-b80a-3aab409160aa tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:52:50.602463 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ab79ecec-fb90-49a5-b80a-3aab409160aa tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:52:50.602911 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ab79ecec-fb90-49a5-b80a-3aab409160aa tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:52:50.732343 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ab79ecec-fb90-49a5-b80a-3aab409160aa tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:52:50.740361 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ab79ecec-fb90-49a5-b80a-3aab409160aa tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c" status: 200 len: 1570 microversion: 2.1 time: 0.152106 Oct 19 04:52:50.740945 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4418/8362] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:52:50 2022] GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:52:51.762761 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-982be049-fa60-44f7-905a-29924b6f82c4 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:52:51.763385 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-982be049-fa60-44f7-905a-29924b6f82c4 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: 85b80fab-9bae-4a22-bfe5-d6976a0c7b7c] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:52:51.770411 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-982be049-fa60-44f7-905a-29924b6f82c4 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:52:51.770903 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-982be049-fa60-44f7-905a-29924b6f82c4 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:52:51.771342 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-982be049-fa60-44f7-905a-29924b6f82c4 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:52:51.772036 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-982be049-fa60-44f7-905a-29924b6f82c4 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:52:51.772495 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-982be049-fa60-44f7-905a-29924b6f82c4 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:52:51.772925 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-982be049-fa60-44f7-905a-29924b6f82c4 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:52:51.908524 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-982be049-fa60-44f7-905a-29924b6f82c4 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:52:51.917185 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-982be049-fa60-44f7-905a-29924b6f82c4 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c" status: 200 len: 1570 microversion: 2.1 time: 0.157720 Oct 19 04:52:51.925336 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3945/8363] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:52:51 2022] GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c => generated 1570 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:52:52.940701 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-04c232bc-28d2-498e-baae-394a3d007611 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:52:52.941342 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-04c232bc-28d2-498e-baae-394a3d007611 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: 85b80fab-9bae-4a22-bfe5-d6976a0c7b7c] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:52:52.948440 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-04c232bc-28d2-498e-baae-394a3d007611 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:52:52.948955 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-04c232bc-28d2-498e-baae-394a3d007611 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:52:52.949442 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-04c232bc-28d2-498e-baae-394a3d007611 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:52:52.950170 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-04c232bc-28d2-498e-baae-394a3d007611 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:52:52.950651 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-04c232bc-28d2-498e-baae-394a3d007611 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:52:52.951102 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-04c232bc-28d2-498e-baae-394a3d007611 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:52:53.086187 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-04c232bc-28d2-498e-baae-394a3d007611 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:52:53.094070 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-04c232bc-28d2-498e-baae-394a3d007611 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c" status: 200 len: 1570 microversion: 2.1 time: 0.157799 Oct 19 04:52:53.094663 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4419/8364] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:52:52 2022] GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c => generated 1570 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:52:54.116877 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-65c272e9-eda6-472b-a1a0-5dd1b9fa2345 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:52:54.117515 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-65c272e9-eda6-472b-a1a0-5dd1b9fa2345 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: 85b80fab-9bae-4a22-bfe5-d6976a0c7b7c] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:52:54.124791 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-65c272e9-eda6-472b-a1a0-5dd1b9fa2345 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:52:54.125279 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-65c272e9-eda6-472b-a1a0-5dd1b9fa2345 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:52:54.125752 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-65c272e9-eda6-472b-a1a0-5dd1b9fa2345 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:52:54.126535 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-65c272e9-eda6-472b-a1a0-5dd1b9fa2345 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:52:54.126995 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-65c272e9-eda6-472b-a1a0-5dd1b9fa2345 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:52:54.127418 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-65c272e9-eda6-472b-a1a0-5dd1b9fa2345 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:52:54.255274 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-65c272e9-eda6-472b-a1a0-5dd1b9fa2345 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:52:54.263724 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-65c272e9-eda6-472b-a1a0-5dd1b9fa2345 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c" status: 200 len: 1570 microversion: 2.1 time: 0.150726 Oct 19 04:52:54.264304 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3946/8365] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:52:54 2022] GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:52:55.287357 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d0f7731d-677a-40b4-b2b2-ef7fc7760db8 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:52:55.287992 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d0f7731d-677a-40b4-b2b2-ef7fc7760db8 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: 85b80fab-9bae-4a22-bfe5-d6976a0c7b7c] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:52:55.295036 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d0f7731d-677a-40b4-b2b2-ef7fc7760db8 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:52:55.295548 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d0f7731d-677a-40b4-b2b2-ef7fc7760db8 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:52:55.296009 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d0f7731d-677a-40b4-b2b2-ef7fc7760db8 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:52:55.296737 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d0f7731d-677a-40b4-b2b2-ef7fc7760db8 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:52:55.297212 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d0f7731d-677a-40b4-b2b2-ef7fc7760db8 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:52:55.297740 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d0f7731d-677a-40b4-b2b2-ef7fc7760db8 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:52:55.434945 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d0f7731d-677a-40b4-b2b2-ef7fc7760db8 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:52:55.443172 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d0f7731d-677a-40b4-b2b2-ef7fc7760db8 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c" status: 200 len: 1570 microversion: 2.1 time: 0.160081 Oct 19 04:52:55.443977 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4420/8366] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:52:55 2022] GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c => generated 1570 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:52:56.468039 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-663e73e5-a9a4-4cbb-be5c-003016850312 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:52:56.468701 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-663e73e5-a9a4-4cbb-be5c-003016850312 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: 85b80fab-9bae-4a22-bfe5-d6976a0c7b7c] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:52:56.475665 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-663e73e5-a9a4-4cbb-be5c-003016850312 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:52:56.476160 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-663e73e5-a9a4-4cbb-be5c-003016850312 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:52:56.476610 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-663e73e5-a9a4-4cbb-be5c-003016850312 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:52:56.477317 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-663e73e5-a9a4-4cbb-be5c-003016850312 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:52:56.477814 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-663e73e5-a9a4-4cbb-be5c-003016850312 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:52:56.478251 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-663e73e5-a9a4-4cbb-be5c-003016850312 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:52:56.614543 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-663e73e5-a9a4-4cbb-be5c-003016850312 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:52:56.622864 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-663e73e5-a9a4-4cbb-be5c-003016850312 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c" status: 200 len: 1570 microversion: 2.1 time: 0.158833 Oct 19 04:52:56.636709 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3947/8367] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:52:56 2022] GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c => generated 1570 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:52:57.647145 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-0ce3a1c1-5893-47e6-84b7-d7a4f2a7af08 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:52:57.647713 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-0ce3a1c1-5893-47e6-84b7-d7a4f2a7af08 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: 85b80fab-9bae-4a22-bfe5-d6976a0c7b7c] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:52:57.654287 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0ce3a1c1-5893-47e6-84b7-d7a4f2a7af08 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:52:57.654799 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0ce3a1c1-5893-47e6-84b7-d7a4f2a7af08 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:52:57.655257 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0ce3a1c1-5893-47e6-84b7-d7a4f2a7af08 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:52:57.655979 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0ce3a1c1-5893-47e6-84b7-d7a4f2a7af08 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:52:57.656454 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0ce3a1c1-5893-47e6-84b7-d7a4f2a7af08 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:52:57.656901 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-0ce3a1c1-5893-47e6-84b7-d7a4f2a7af08 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:52:57.788556 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-0ce3a1c1-5893-47e6-84b7-d7a4f2a7af08 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:52:57.797088 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-0ce3a1c1-5893-47e6-84b7-d7a4f2a7af08 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c" status: 200 len: 1571 microversion: 2.1 time: 0.154742 Oct 19 04:52:57.797696 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4421/8368] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:52:57 2022] GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c => generated 1571 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:52:57.820269 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-dc22f805-f7e2-44fc-9a37-571ceb21f226 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:52:57.820876 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-dc22f805-f7e2-44fc-9a37-571ceb21f226 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: 85b80fab-9bae-4a22-bfe5-d6976a0c7b7c] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:52:57.827811 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dc22f805-f7e2-44fc-9a37-571ceb21f226 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:52:57.828298 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dc22f805-f7e2-44fc-9a37-571ceb21f226 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:52:57.828742 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dc22f805-f7e2-44fc-9a37-571ceb21f226 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:52:57.829472 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dc22f805-f7e2-44fc-9a37-571ceb21f226 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:52:57.829928 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dc22f805-f7e2-44fc-9a37-571ceb21f226 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:52:57.830360 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-dc22f805-f7e2-44fc-9a37-571ceb21f226 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:52:57.917920 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-dc22f805-f7e2-44fc-9a37-571ceb21f226 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: 85b80fab-9bae-4a22-bfe5-d6976a0c7b7c] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121135) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 19 04:52:58.160564 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-dc22f805-f7e2-44fc-9a37-571ceb21f226 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "POST /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c/action" status: 202 len: 0 microversion: 2.1 time: 0.343965 Oct 19 04:52:58.161226 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3948/8369] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 04:52:57 2022] POST /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c/action => generated 0 bytes in 345 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 04:52:58.170020 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a6555cae-7d23-4ae4-a09d-b410eb55004b tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:52:58.170657 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-a6555cae-7d23-4ae4-a09d-b410eb55004b tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: 85b80fab-9bae-4a22-bfe5-d6976a0c7b7c] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:52:58.176750 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a6555cae-7d23-4ae4-a09d-b410eb55004b tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:52:58.177263 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a6555cae-7d23-4ae4-a09d-b410eb55004b tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:52:58.177746 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a6555cae-7d23-4ae4-a09d-b410eb55004b tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:52:58.178674 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a6555cae-7d23-4ae4-a09d-b410eb55004b tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:52:58.179146 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a6555cae-7d23-4ae4-a09d-b410eb55004b tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:52:58.179598 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-a6555cae-7d23-4ae4-a09d-b410eb55004b tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:52:58.355293 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-a6555cae-7d23-4ae4-a09d-b410eb55004b tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:52:58.363500 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a6555cae-7d23-4ae4-a09d-b410eb55004b tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c" status: 200 len: 1519 microversion: 2.1 time: 0.198050 Oct 19 04:52:58.364091 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4422/8370] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:52:58 2022] GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c => generated 1519 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:52:58.811136 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-eb42cbe8-eb92-440b-8d2f-5d59fe5cf75b req-78d5a2e8-9c1a-4c01-a197-8a96a5264e3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85b80fab-9bae-4a22-bfe5-d6976a0c7b7c", "name": "network-vif-unplugged", "status": "completed", "tag": "c1153617-b219-4ee6-b6b6-bffc34520fdb"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:52:58.820522 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-eb42cbe8-eb92-440b-8d2f-5d59fe5cf75b req-78d5a2e8-9c1a-4c01-a197-8a96a5264e3f service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:52:58.821132 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-eb42cbe8-eb92-440b-8d2f-5d59fe5cf75b req-78d5a2e8-9c1a-4c01-a197-8a96a5264e3f service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:52:58.821451 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-eb42cbe8-eb92-440b-8d2f-5d59fe5cf75b req-78d5a2e8-9c1a-4c01-a197-8a96a5264e3f service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:52:58.833247 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.compute.server_external_events [req-eb42cbe8-eb92-440b-8d2f-5d59fe5cf75b req-78d5a2e8-9c1a-4c01-a197-8a96a5264e3f service nova] Unable to find a host for instance 85b80fab-9bae-4a22-bfe5-d6976a0c7b7c. Dropping event network-vif-unplugged {{(pid=121135) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 19 04:52:58.834137 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-eb42cbe8-eb92-440b-8d2f-5d59fe5cf75b req-78d5a2e8-9c1a-4c01-a197-8a96a5264e3f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.075450 Oct 19 04:52:58.834697 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3949/8371] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:52:58 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 77 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 19 04:52:59.386567 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-9cf09502-4760-4176-945e-19e6974a52f3 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:52:59.387206 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-9cf09502-4760-4176-945e-19e6974a52f3 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: 85b80fab-9bae-4a22-bfe5-d6976a0c7b7c] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:52:59.397035 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9cf09502-4760-4176-945e-19e6974a52f3 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:52:59.397035 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9cf09502-4760-4176-945e-19e6974a52f3 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:52:59.397035 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9cf09502-4760-4176-945e-19e6974a52f3 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:52:59.397035 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9cf09502-4760-4176-945e-19e6974a52f3 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:52:59.397035 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9cf09502-4760-4176-945e-19e6974a52f3 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:52:59.397035 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-9cf09502-4760-4176-945e-19e6974a52f3 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:52:59.534370 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-9cf09502-4760-4176-945e-19e6974a52f3 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:52:59.542891 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-9cf09502-4760-4176-945e-19e6974a52f3 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c" status: 200 len: 1521 microversion: 2.1 time: 0.160276 Oct 19 04:52:59.543641 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4423/8372] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:52:59 2022] GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:53:00.567051 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-8de484da-6d2b-4089-8f01-9e5a72bcc07d tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:53:00.567997 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-8de484da-6d2b-4089-8f01-9e5a72bcc07d tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: 85b80fab-9bae-4a22-bfe5-d6976a0c7b7c] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:53:00.576673 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8de484da-6d2b-4089-8f01-9e5a72bcc07d tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:53:00.577245 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8de484da-6d2b-4089-8f01-9e5a72bcc07d tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:53:00.577728 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8de484da-6d2b-4089-8f01-9e5a72bcc07d tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:53:00.578567 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8de484da-6d2b-4089-8f01-9e5a72bcc07d tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:53:00.579031 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8de484da-6d2b-4089-8f01-9e5a72bcc07d tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:53:00.579459 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8de484da-6d2b-4089-8f01-9e5a72bcc07d tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:53:00.759447 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-8de484da-6d2b-4089-8f01-9e5a72bcc07d tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:53:00.768258 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-8de484da-6d2b-4089-8f01-9e5a72bcc07d tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c" status: 200 len: 1521 microversion: 2.1 time: 0.205031 Oct 19 04:53:00.772260 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3950/8373] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:53:00 2022] GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c => generated 1521 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:53:01.793109 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-d59e9475-0509-47a1-ae8e-4cc3a8a049c1 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:53:01.793878 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-d59e9475-0509-47a1-ae8e-4cc3a8a049c1 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: 85b80fab-9bae-4a22-bfe5-d6976a0c7b7c] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:53:01.800840 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d59e9475-0509-47a1-ae8e-4cc3a8a049c1 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:53:01.801471 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d59e9475-0509-47a1-ae8e-4cc3a8a049c1 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:53:01.802001 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d59e9475-0509-47a1-ae8e-4cc3a8a049c1 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:53:01.802785 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d59e9475-0509-47a1-ae8e-4cc3a8a049c1 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:53:01.803327 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d59e9475-0509-47a1-ae8e-4cc3a8a049c1 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:53:01.803836 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-d59e9475-0509-47a1-ae8e-4cc3a8a049c1 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:53:01.942297 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-d59e9475-0509-47a1-ae8e-4cc3a8a049c1 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:53:01.950984 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-d59e9475-0509-47a1-ae8e-4cc3a8a049c1 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c" status: 200 len: 1521 microversion: 2.1 time: 0.162755 Oct 19 04:53:01.951812 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4424/8374] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:53:01 2022] GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:53:02.974493 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a42d580f-7e73-48c3-b53a-cb5e32bcca87 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:53:02.975100 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a42d580f-7e73-48c3-b53a-cb5e32bcca87 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: 85b80fab-9bae-4a22-bfe5-d6976a0c7b7c] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:53:02.982475 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a42d580f-7e73-48c3-b53a-cb5e32bcca87 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:53:02.982957 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a42d580f-7e73-48c3-b53a-cb5e32bcca87 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:53:02.983397 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a42d580f-7e73-48c3-b53a-cb5e32bcca87 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:53:02.984083 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a42d580f-7e73-48c3-b53a-cb5e32bcca87 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:53:02.984534 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a42d580f-7e73-48c3-b53a-cb5e32bcca87 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:53:02.984957 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a42d580f-7e73-48c3-b53a-cb5e32bcca87 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:53:03.116888 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a42d580f-7e73-48c3-b53a-cb5e32bcca87 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:53:03.124826 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a42d580f-7e73-48c3-b53a-cb5e32bcca87 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c" status: 200 len: 1521 microversion: 2.1 time: 0.154223 Oct 19 04:53:03.125419 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3951/8375] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:53:02 2022] GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:53:04.148312 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-035b6212-9085-45cf-8d50-26326188f356 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:53:04.148950 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-035b6212-9085-45cf-8d50-26326188f356 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: 85b80fab-9bae-4a22-bfe5-d6976a0c7b7c] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:53:04.156271 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-035b6212-9085-45cf-8d50-26326188f356 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:53:04.156936 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-035b6212-9085-45cf-8d50-26326188f356 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:53:04.157495 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-035b6212-9085-45cf-8d50-26326188f356 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:53:04.158730 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-035b6212-9085-45cf-8d50-26326188f356 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:53:04.159211 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-035b6212-9085-45cf-8d50-26326188f356 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:53:04.159666 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-035b6212-9085-45cf-8d50-26326188f356 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:53:04.304901 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-035b6212-9085-45cf-8d50-26326188f356 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:53:04.312439 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-035b6212-9085-45cf-8d50-26326188f356 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c" status: 200 len: 1521 microversion: 2.1 time: 0.168093 Oct 19 04:53:04.313019 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4425/8376] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:53:04 2022] GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:53:05.334951 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1065d7b2-5d24-43af-9b8e-ed6ab81fcfc4 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:53:05.335580 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1065d7b2-5d24-43af-9b8e-ed6ab81fcfc4 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: 85b80fab-9bae-4a22-bfe5-d6976a0c7b7c] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:53:05.342767 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1065d7b2-5d24-43af-9b8e-ed6ab81fcfc4 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:53:05.343197 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1065d7b2-5d24-43af-9b8e-ed6ab81fcfc4 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:53:05.343651 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1065d7b2-5d24-43af-9b8e-ed6ab81fcfc4 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:53:05.344342 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1065d7b2-5d24-43af-9b8e-ed6ab81fcfc4 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:53:05.344802 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1065d7b2-5d24-43af-9b8e-ed6ab81fcfc4 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:53:05.345311 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1065d7b2-5d24-43af-9b8e-ed6ab81fcfc4 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:53:05.556596 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-1065d7b2-5d24-43af-9b8e-ed6ab81fcfc4 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:53:05.565079 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1065d7b2-5d24-43af-9b8e-ed6ab81fcfc4 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c" status: 200 len: 1577 microversion: 2.1 time: 0.234008 Oct 19 04:53:05.565777 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3952/8377] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:53:05 2022] GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c => generated 1577 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:53:06.489385 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-ae8d3ec2-1dbf-47eb-b777-16e524025fe7 req-65c6b04d-46ef-4d55-8a28-fa0f8c6c8c8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85b80fab-9bae-4a22-bfe5-d6976a0c7b7c", "tag": "c1153617-b219-4ee6-b6b6-bffc34520fdb"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:53:06.499936 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-ae8d3ec2-1dbf-47eb-b777-16e524025fe7 req-65c6b04d-46ef-4d55-8a28-fa0f8c6c8c8d service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:53:06.500374 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-ae8d3ec2-1dbf-47eb-b777-16e524025fe7 req-65c6b04d-46ef-4d55-8a28-fa0f8c6c8c8d service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:53:06.500831 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-ae8d3ec2-1dbf-47eb-b777-16e524025fe7 req-65c6b04d-46ef-4d55-8a28-fa0f8c6c8c8d service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:53:06.514937 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-ae8d3ec2-1dbf-47eb-b777-16e524025fe7 req-65c6b04d-46ef-4d55-8a28-fa0f8c6c8c8d service nova] Creating event network-changed:c1153617-b219-4ee6-b6b6-bffc34520fdb for instance 85b80fab-9bae-4a22-bfe5-d6976a0c7b7c on n-h1-861333-8 Oct 19 04:53:06.520440 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-ae8d3ec2-1dbf-47eb-b777-16e524025fe7 req-65c6b04d-46ef-4d55-8a28-fa0f8c6c8c8d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034920 Oct 19 04:53:06.521599 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4426/8378] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:53:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:53:06.588931 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b33c6077-c082-43b1-8ed5-f4a8f1664210 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:53:06.590069 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b33c6077-c082-43b1-8ed5-f4a8f1664210 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: 85b80fab-9bae-4a22-bfe5-d6976a0c7b7c] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:53:06.598734 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b33c6077-c082-43b1-8ed5-f4a8f1664210 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:53:06.599257 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b33c6077-c082-43b1-8ed5-f4a8f1664210 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:53:06.599710 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b33c6077-c082-43b1-8ed5-f4a8f1664210 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:53:06.600430 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b33c6077-c082-43b1-8ed5-f4a8f1664210 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:53:06.600895 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b33c6077-c082-43b1-8ed5-f4a8f1664210 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:53:06.601325 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b33c6077-c082-43b1-8ed5-f4a8f1664210 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:53:06.811433 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-b33c6077-c082-43b1-8ed5-f4a8f1664210 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:53:06.819411 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b33c6077-c082-43b1-8ed5-f4a8f1664210 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c" status: 200 len: 1577 microversion: 2.1 time: 0.234419 Oct 19 04:53:06.833422 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3953/8379] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:53:06 2022] GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c => generated 1577 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:53:07.844308 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-51131b39-11d7-492e-8f18-d516f5353890 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:53:07.845144 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-51131b39-11d7-492e-8f18-d516f5353890 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: 85b80fab-9bae-4a22-bfe5-d6976a0c7b7c] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:53:07.851421 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-51131b39-11d7-492e-8f18-d516f5353890 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:53:07.851930 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-51131b39-11d7-492e-8f18-d516f5353890 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:53:07.852392 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-51131b39-11d7-492e-8f18-d516f5353890 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:53:07.853104 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-51131b39-11d7-492e-8f18-d516f5353890 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:53:07.853620 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-51131b39-11d7-492e-8f18-d516f5353890 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:53:07.854076 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-51131b39-11d7-492e-8f18-d516f5353890 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:53:07.983810 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-51131b39-11d7-492e-8f18-d516f5353890 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:53:07.991724 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-51131b39-11d7-492e-8f18-d516f5353890 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c" status: 200 len: 1577 microversion: 2.1 time: 0.152525 Oct 19 04:53:07.992309 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4427/8380] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:53:07 2022] GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c => generated 1577 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:53:09.016540 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1ce700cd-30f2-4455-8977-58d8319418c8 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:53:09.017165 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1ce700cd-30f2-4455-8977-58d8319418c8 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: 85b80fab-9bae-4a22-bfe5-d6976a0c7b7c] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:53:09.024249 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1ce700cd-30f2-4455-8977-58d8319418c8 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:53:09.024739 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1ce700cd-30f2-4455-8977-58d8319418c8 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:53:09.025208 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1ce700cd-30f2-4455-8977-58d8319418c8 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:53:09.025934 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1ce700cd-30f2-4455-8977-58d8319418c8 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:53:09.026394 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1ce700cd-30f2-4455-8977-58d8319418c8 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:53:09.026825 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1ce700cd-30f2-4455-8977-58d8319418c8 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:53:09.157588 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-1ce700cd-30f2-4455-8977-58d8319418c8 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:53:09.165651 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1ce700cd-30f2-4455-8977-58d8319418c8 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c" status: 200 len: 1577 microversion: 2.1 time: 0.153688 Oct 19 04:53:09.166241 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3954/8381] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:53:09 2022] GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c => generated 1577 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:53:10.188805 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-580c8e18-45df-46bd-82f3-54c116b695e1 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:53:10.189458 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-580c8e18-45df-46bd-82f3-54c116b695e1 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: 85b80fab-9bae-4a22-bfe5-d6976a0c7b7c] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:53:10.196348 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-580c8e18-45df-46bd-82f3-54c116b695e1 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:53:10.196844 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-580c8e18-45df-46bd-82f3-54c116b695e1 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:53:10.197294 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-580c8e18-45df-46bd-82f3-54c116b695e1 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:53:10.198021 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-580c8e18-45df-46bd-82f3-54c116b695e1 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:53:10.198487 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-580c8e18-45df-46bd-82f3-54c116b695e1 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:53:10.198925 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-580c8e18-45df-46bd-82f3-54c116b695e1 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:53:10.328310 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-580c8e18-45df-46bd-82f3-54c116b695e1 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:53:10.336086 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-580c8e18-45df-46bd-82f3-54c116b695e1 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c" status: 200 len: 1577 microversion: 2.1 time: 0.151202 Oct 19 04:53:10.336661 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4428/8382] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:53:10 2022] GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c => generated 1577 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:53:11.360799 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-6e0fd217-974e-4903-82d0-5e3711b74769 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:53:11.361444 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-6e0fd217-974e-4903-82d0-5e3711b74769 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: 85b80fab-9bae-4a22-bfe5-d6976a0c7b7c] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:53:11.368387 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6e0fd217-974e-4903-82d0-5e3711b74769 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:53:11.368881 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6e0fd217-974e-4903-82d0-5e3711b74769 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:53:11.369325 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6e0fd217-974e-4903-82d0-5e3711b74769 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:53:11.370094 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6e0fd217-974e-4903-82d0-5e3711b74769 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:53:11.370557 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6e0fd217-974e-4903-82d0-5e3711b74769 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:53:11.370993 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-6e0fd217-974e-4903-82d0-5e3711b74769 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:53:11.503437 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-6e0fd217-974e-4903-82d0-5e3711b74769 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:53:11.511489 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-6e0fd217-974e-4903-82d0-5e3711b74769 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c" status: 200 len: 1577 microversion: 2.1 time: 0.154675 Oct 19 04:53:11.512095 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3955/8383] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:53:11 2022] GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:53:12.535464 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c0f2389a-76c8-4f11-9b14-8489d3e9aceb tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:53:12.536016 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c0f2389a-76c8-4f11-9b14-8489d3e9aceb tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: 85b80fab-9bae-4a22-bfe5-d6976a0c7b7c] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:53:12.538859 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=31 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:53:12.544130 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c0f2389a-76c8-4f11-9b14-8489d3e9aceb tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:53:12.544627 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c0f2389a-76c8-4f11-9b14-8489d3e9aceb tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:53:12.545079 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c0f2389a-76c8-4f11-9b14-8489d3e9aceb tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:53:12.545806 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c0f2389a-76c8-4f11-9b14-8489d3e9aceb tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:53:12.546274 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c0f2389a-76c8-4f11-9b14-8489d3e9aceb tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:53:12.546714 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c0f2389a-76c8-4f11-9b14-8489d3e9aceb tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:53:12.550666 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:53:12.684542 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c0f2389a-76c8-4f11-9b14-8489d3e9aceb tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:53:12.692397 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c0f2389a-76c8-4f11-9b14-8489d3e9aceb tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c" status: 200 len: 1577 microversion: 2.1 time: 0.161191 Oct 19 04:53:12.692995 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4429/8384] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:53:12 2022] GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c => generated 1577 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:53:13.716173 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9c29068a-dafe-4ea7-88be-9ae2585ebd3d tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:53:13.716794 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9c29068a-dafe-4ea7-88be-9ae2585ebd3d tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: 85b80fab-9bae-4a22-bfe5-d6976a0c7b7c] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:53:13.719528 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:53:13.724307 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9c29068a-dafe-4ea7-88be-9ae2585ebd3d tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:53:13.724795 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9c29068a-dafe-4ea7-88be-9ae2585ebd3d tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:53:13.725253 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9c29068a-dafe-4ea7-88be-9ae2585ebd3d tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:53:13.725979 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9c29068a-dafe-4ea7-88be-9ae2585ebd3d tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:53:13.726442 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9c29068a-dafe-4ea7-88be-9ae2585ebd3d tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:53:13.726896 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9c29068a-dafe-4ea7-88be-9ae2585ebd3d tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:53:13.731459 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:53:13.857941 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-9c29068a-dafe-4ea7-88be-9ae2585ebd3d tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:53:13.865521 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9c29068a-dafe-4ea7-88be-9ae2585ebd3d tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c" status: 200 len: 1577 microversion: 2.1 time: 0.153720 Oct 19 04:53:13.866094 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3956/8385] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:53:13 2022] GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c => generated 1577 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:53:14.889748 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-31956ae4-8bd4-421b-974e-e69878c7d785 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:53:14.890385 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-31956ae4-8bd4-421b-974e-e69878c7d785 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: 85b80fab-9bae-4a22-bfe5-d6976a0c7b7c] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:53:14.896428 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-31956ae4-8bd4-421b-974e-e69878c7d785 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:53:14.896924 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-31956ae4-8bd4-421b-974e-e69878c7d785 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:53:14.897432 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-31956ae4-8bd4-421b-974e-e69878c7d785 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:53:14.898139 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-31956ae4-8bd4-421b-974e-e69878c7d785 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:53:14.898605 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-31956ae4-8bd4-421b-974e-e69878c7d785 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:53:14.899045 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-31956ae4-8bd4-421b-974e-e69878c7d785 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:53:15.032607 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-31956ae4-8bd4-421b-974e-e69878c7d785 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:53:15.040880 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-31956ae4-8bd4-421b-974e-e69878c7d785 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c" status: 200 len: 1577 microversion: 2.1 time: 0.155471 Oct 19 04:53:15.041499 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4430/8386] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:53:14 2022] GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:53:16.065083 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-37c3e597-5987-4cf4-8d8b-7815c65ce336 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:53:16.065729 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-37c3e597-5987-4cf4-8d8b-7815c65ce336 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: 85b80fab-9bae-4a22-bfe5-d6976a0c7b7c] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:53:16.072301 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-37c3e597-5987-4cf4-8d8b-7815c65ce336 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:53:16.072789 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-37c3e597-5987-4cf4-8d8b-7815c65ce336 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:53:16.073231 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-37c3e597-5987-4cf4-8d8b-7815c65ce336 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:53:16.073983 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-37c3e597-5987-4cf4-8d8b-7815c65ce336 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:53:16.074454 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-37c3e597-5987-4cf4-8d8b-7815c65ce336 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:53:16.074886 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-37c3e597-5987-4cf4-8d8b-7815c65ce336 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:53:16.205729 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-37c3e597-5987-4cf4-8d8b-7815c65ce336 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:53:16.213636 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-37c3e597-5987-4cf4-8d8b-7815c65ce336 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c" status: 200 len: 1577 microversion: 2.1 time: 0.152829 Oct 19 04:53:16.229393 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3957/8387] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:53:16 2022] GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c => generated 1577 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:53:17.237675 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-96dc6583-eb69-499a-b5d8-7709a636a2ab tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:53:17.238314 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-96dc6583-eb69-499a-b5d8-7709a636a2ab tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: 85b80fab-9bae-4a22-bfe5-d6976a0c7b7c] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:53:17.245272 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-96dc6583-eb69-499a-b5d8-7709a636a2ab tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:53:17.246435 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-96dc6583-eb69-499a-b5d8-7709a636a2ab tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:53:17.246923 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-96dc6583-eb69-499a-b5d8-7709a636a2ab tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:53:17.247638 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-96dc6583-eb69-499a-b5d8-7709a636a2ab tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:53:17.248133 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-96dc6583-eb69-499a-b5d8-7709a636a2ab tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:53:17.248561 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-96dc6583-eb69-499a-b5d8-7709a636a2ab tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:53:17.378184 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-96dc6583-eb69-499a-b5d8-7709a636a2ab tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:53:17.386040 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-96dc6583-eb69-499a-b5d8-7709a636a2ab tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c" status: 200 len: 1577 microversion: 2.1 time: 0.152376 Oct 19 04:53:17.386625 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4431/8388] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:53:17 2022] GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c => generated 1577 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:53:18.394616 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-e8d90886-495f-41db-ab4f-9a74d4c163d6 req-ae34dc29-9781-496b-8067-d35c5f39f0f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85b80fab-9bae-4a22-bfe5-d6976a0c7b7c", "name": "network-vif-plugged", "status": "completed", "tag": "c1153617-b219-4ee6-b6b6-bffc34520fdb"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:53:18.408941 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-e8d90886-495f-41db-ab4f-9a74d4c163d6 req-ae34dc29-9781-496b-8067-d35c5f39f0f8 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:53:18.409534 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-e8d90886-495f-41db-ab4f-9a74d4c163d6 req-ae34dc29-9781-496b-8067-d35c5f39f0f8 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:53:18.409675 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-21840fbf-1481-4ead-81a3-54bf79c9b963 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:53:18.410142 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-e8d90886-495f-41db-ab4f-9a74d4c163d6 req-ae34dc29-9781-496b-8067-d35c5f39f0f8 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:53:18.410489 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-21840fbf-1481-4ead-81a3-54bf79c9b963 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: 85b80fab-9bae-4a22-bfe5-d6976a0c7b7c] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:53:18.418084 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-21840fbf-1481-4ead-81a3-54bf79c9b963 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:53:18.421309 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-21840fbf-1481-4ead-81a3-54bf79c9b963 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:53:18.421309 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-21840fbf-1481-4ead-81a3-54bf79c9b963 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:53:18.421309 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-21840fbf-1481-4ead-81a3-54bf79c9b963 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:53:18.421309 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-21840fbf-1481-4ead-81a3-54bf79c9b963 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:53:18.421309 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-21840fbf-1481-4ead-81a3-54bf79c9b963 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:53:18.425199 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-e8d90886-495f-41db-ab4f-9a74d4c163d6 req-ae34dc29-9781-496b-8067-d35c5f39f0f8 service nova] Creating event network-vif-plugged:c1153617-b219-4ee6-b6b6-bffc34520fdb for instance 85b80fab-9bae-4a22-bfe5-d6976a0c7b7c on n-h1-861333-8 Oct 19 04:53:18.428831 n-d-861333-8 devstack@n-api.service[121135]: ERROR oslo.messaging._drivers.impl_rabbit [req-e8d90886-495f-41db-ab4f-9a74d4c163d6 req-ae34dc29-9781-496b-8067-d35c5f39f0f8 service nova] [09cb6902-d050-420b-8321-a83aa488bdfb] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 19 04:53:18.560293 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-21840fbf-1481-4ead-81a3-54bf79c9b963 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:53:18.568137 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-21840fbf-1481-4ead-81a3-54bf79c9b963 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c" status: 200 len: 1577 microversion: 2.1 time: 0.162981 Oct 19 04:53:18.568716 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4432/8389] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:53:18 2022] GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c => generated 1577 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:53:19.437063 n-d-861333-8 devstack@n-api.service[121135]: INFO oslo.messaging._drivers.impl_rabbit [req-e8d90886-495f-41db-ab4f-9a74d4c163d6 req-ae34dc29-9781-496b-8067-d35c5f39f0f8 service nova] [09cb6902-d050-420b-8321-a83aa488bdfb] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 37526. Oct 19 04:53:19.440863 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-e8d90886-495f-41db-ab4f-9a74d4c163d6 req-ae34dc29-9781-496b-8067-d35c5f39f0f8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.050221 Oct 19 04:53:19.441684 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3958/8390] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:53:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 04:53:19.591945 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-92dcab91-7006-47e2-a59e-48ffbe1ff4a1 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:53:19.592511 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-92dcab91-7006-47e2-a59e-48ffbe1ff4a1 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: 85b80fab-9bae-4a22-bfe5-d6976a0c7b7c] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:53:19.599543 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-92dcab91-7006-47e2-a59e-48ffbe1ff4a1 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:53:19.605092 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-92dcab91-7006-47e2-a59e-48ffbe1ff4a1 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:53:19.605092 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-92dcab91-7006-47e2-a59e-48ffbe1ff4a1 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:53:19.605092 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-92dcab91-7006-47e2-a59e-48ffbe1ff4a1 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:53:19.605092 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-92dcab91-7006-47e2-a59e-48ffbe1ff4a1 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:53:19.605092 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-92dcab91-7006-47e2-a59e-48ffbe1ff4a1 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:53:19.774327 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-92dcab91-7006-47e2-a59e-48ffbe1ff4a1 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:53:19.783168 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-92dcab91-7006-47e2-a59e-48ffbe1ff4a1 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c" status: 200 len: 1577 microversion: 2.1 time: 0.195829 Oct 19 04:53:19.783744 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4433/8391] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:53:19 2022] GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c => generated 1577 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:53:20.808361 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ed90cdc7-e27f-47ed-a0b4-7f08ba08035a tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:53:20.809108 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ed90cdc7-e27f-47ed-a0b4-7f08ba08035a tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: 85b80fab-9bae-4a22-bfe5-d6976a0c7b7c] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:53:20.815358 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ed90cdc7-e27f-47ed-a0b4-7f08ba08035a tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:53:20.815850 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ed90cdc7-e27f-47ed-a0b4-7f08ba08035a tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:53:20.816296 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ed90cdc7-e27f-47ed-a0b4-7f08ba08035a tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:53:20.816983 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ed90cdc7-e27f-47ed-a0b4-7f08ba08035a tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:53:20.817477 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ed90cdc7-e27f-47ed-a0b4-7f08ba08035a tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:53:20.817909 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ed90cdc7-e27f-47ed-a0b4-7f08ba08035a tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:53:21.217358 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ed90cdc7-e27f-47ed-a0b4-7f08ba08035a tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:53:21.225430 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ed90cdc7-e27f-47ed-a0b4-7f08ba08035a tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c" status: 200 len: 1577 microversion: 2.1 time: 0.422131 Oct 19 04:53:21.226309 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3959/8392] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:53:20 2022] GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c => generated 1577 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:53:22.249024 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-09f20cf3-2dac-4603-84ba-ab59edf2e4a3 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:53:22.249667 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-09f20cf3-2dac-4603-84ba-ab59edf2e4a3 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: 85b80fab-9bae-4a22-bfe5-d6976a0c7b7c] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:53:22.256559 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-09f20cf3-2dac-4603-84ba-ab59edf2e4a3 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:53:22.257067 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-09f20cf3-2dac-4603-84ba-ab59edf2e4a3 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:53:22.257558 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-09f20cf3-2dac-4603-84ba-ab59edf2e4a3 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:53:22.258277 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-09f20cf3-2dac-4603-84ba-ab59edf2e4a3 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:53:22.258752 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-09f20cf3-2dac-4603-84ba-ab59edf2e4a3 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:53:22.259204 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-09f20cf3-2dac-4603-84ba-ab59edf2e4a3 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:53:22.392896 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-09f20cf3-2dac-4603-84ba-ab59edf2e4a3 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:53:22.400783 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-09f20cf3-2dac-4603-84ba-ab59edf2e4a3 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c" status: 200 len: 1564 microversion: 2.1 time: 0.155875 Oct 19 04:53:22.401398 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4434/8393] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:53:22 2022] GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c => generated 1564 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:54:59.754723 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=11 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:54:59.755698 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d205eb91-24d5-4c97-81bf-661bb2768da8 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:54:59.756118 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=35 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:54:59.756220 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d205eb91-24d5-4c97-81bf-661bb2768da8 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: 85b80fab-9bae-4a22-bfe5-d6976a0c7b7c] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:54:59.756738 n-d-861333-8 devstack@n-api.service[121134]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 04:54:59.756884 n-d-861333-8 devstack@n-api.service[121134]: Wed Oct 19 04:54:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.52) !!! Oct 19 04:54:59.760336 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=7 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:54:59.761138 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=19 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:54:59.762276 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-f4d4cff6-95da-436b-8058-b361a9feb4b8 req-d2513150-90b5-4aad-abc2-2b5e485aa656 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85b80fab-9bae-4a22-bfe5-d6976a0c7b7c", "tag": "c1153617-b219-4ee6-b6b6-bffc34520fdb"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:54:59.765909 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d205eb91-24d5-4c97-81bf-661bb2768da8 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:54:59.766404 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d205eb91-24d5-4c97-81bf-661bb2768da8 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:54:59.766840 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d205eb91-24d5-4c97-81bf-661bb2768da8 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:54:59.768881 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d205eb91-24d5-4c97-81bf-661bb2768da8 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:54:59.769764 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d205eb91-24d5-4c97-81bf-661bb2768da8 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:54:59.770278 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d205eb91-24d5-4c97-81bf-661bb2768da8 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:54:59.775581 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-f4d4cff6-95da-436b-8058-b361a9feb4b8 req-d2513150-90b5-4aad-abc2-2b5e485aa656 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:54:59.777280 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-f4d4cff6-95da-436b-8058-b361a9feb4b8 req-d2513150-90b5-4aad-abc2-2b5e485aa656 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:54:59.777280 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-f4d4cff6-95da-436b-8058-b361a9feb4b8 req-d2513150-90b5-4aad-abc2-2b5e485aa656 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:54:59.789796 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-f4d4cff6-95da-436b-8058-b361a9feb4b8 req-d2513150-90b5-4aad-abc2-2b5e485aa656 service nova] Creating event network-changed:c1153617-b219-4ee6-b6b6-bffc34520fdb for instance 85b80fab-9bae-4a22-bfe5-d6976a0c7b7c on n-h1-861333-8 Oct 19 04:54:59.795018 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-f4d4cff6-95da-436b-8058-b361a9feb4b8 req-d2513150-90b5-4aad-abc2-2b5e485aa656 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042214 Oct 19 04:54:59.799814 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4435/8394] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:54:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:54:59.800427 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d205eb91-24d5-4c97-81bf-661bb2768da8 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: 85b80fab-9bae-4a22-bfe5-d6976a0c7b7c] Going to try to terminate instance {{(pid=121135) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 04:55:00.131411 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d205eb91-24d5-4c97-81bf-661bb2768da8 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "DELETE /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c" status: 204 len: 0 microversion: 2.1 time: 0.380316 Oct 19 04:55:00.135613 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3960/8395] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 04:54:59 2022] DELETE /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c => generated 0 bytes in 382 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 04:55:00.144199 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ba5604dd-4795-4f4c-845f-34a254cbdd4b tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:55:00.144199 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ba5604dd-4795-4f4c-845f-34a254cbdd4b tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: 85b80fab-9bae-4a22-bfe5-d6976a0c7b7c] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:55:00.150558 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ba5604dd-4795-4f4c-845f-34a254cbdd4b tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:55:00.151092 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ba5604dd-4795-4f4c-845f-34a254cbdd4b tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:55:00.151543 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ba5604dd-4795-4f4c-845f-34a254cbdd4b tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:55:00.152262 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ba5604dd-4795-4f4c-845f-34a254cbdd4b tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:55:00.152732 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ba5604dd-4795-4f4c-845f-34a254cbdd4b tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:55:00.153177 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ba5604dd-4795-4f4c-845f-34a254cbdd4b tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:55:00.299882 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ba5604dd-4795-4f4c-845f-34a254cbdd4b tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:55:00.307786 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ba5604dd-4795-4f4c-845f-34a254cbdd4b tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c" status: 200 len: 1570 microversion: 2.1 time: 0.170887 Oct 19 04:55:00.308387 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4436/8396] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:55:00 2022] GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c => generated 1570 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 04:55:01.332744 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-a1e5b515-5f7c-4186-b1a6-5ac03dfbaf8e tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:55:01.333491 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-a1e5b515-5f7c-4186-b1a6-5ac03dfbaf8e tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: 85b80fab-9bae-4a22-bfe5-d6976a0c7b7c] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:55:01.340410 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a1e5b515-5f7c-4186-b1a6-5ac03dfbaf8e tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:55:01.340943 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a1e5b515-5f7c-4186-b1a6-5ac03dfbaf8e tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:55:01.341407 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a1e5b515-5f7c-4186-b1a6-5ac03dfbaf8e tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:55:01.342119 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a1e5b515-5f7c-4186-b1a6-5ac03dfbaf8e tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:55:01.342588 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a1e5b515-5f7c-4186-b1a6-5ac03dfbaf8e tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:55:01.343022 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-a1e5b515-5f7c-4186-b1a6-5ac03dfbaf8e tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:55:01.500185 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-a1e5b515-5f7c-4186-b1a6-5ac03dfbaf8e tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:55:01.508718 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-a1e5b515-5f7c-4186-b1a6-5ac03dfbaf8e tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c" status: 200 len: 1570 microversion: 2.1 time: 0.180930 Oct 19 04:55:01.509226 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3961/8397] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:55:01 2022] GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c => generated 1570 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:55:02.447790 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-ef59aec5-db30-4210-b41f-025c4c783041 req-786f855a-7b31-49e5-a62f-5615e200f6c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85b80fab-9bae-4a22-bfe5-d6976a0c7b7c", "name": "network-vif-deleted", "tag": "c1153617-b219-4ee6-b6b6-bffc34520fdb"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:55:02.464551 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-ef59aec5-db30-4210-b41f-025c4c783041 req-786f855a-7b31-49e5-a62f-5615e200f6c4 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:55:02.465054 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-ef59aec5-db30-4210-b41f-025c4c783041 req-786f855a-7b31-49e5-a62f-5615e200f6c4 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:55:02.465650 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-ef59aec5-db30-4210-b41f-025c4c783041 req-786f855a-7b31-49e5-a62f-5615e200f6c4 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:55:02.477389 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-ef59aec5-db30-4210-b41f-025c4c783041 req-786f855a-7b31-49e5-a62f-5615e200f6c4 service nova] Creating event network-vif-deleted:c1153617-b219-4ee6-b6b6-bffc34520fdb for instance 85b80fab-9bae-4a22-bfe5-d6976a0c7b7c on n-h1-861333-8 Oct 19 04:55:02.482450 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-ef59aec5-db30-4210-b41f-025c4c783041 req-786f855a-7b31-49e5-a62f-5615e200f6c4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038708 Oct 19 04:55:02.483041 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4437/8398] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:55:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:55:02.532129 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-61b9ffbf-048a-444d-a035-922f65224139 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:55:02.533605 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-61b9ffbf-048a-444d-a035-922f65224139 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: 85b80fab-9bae-4a22-bfe5-d6976a0c7b7c] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:55:02.540516 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-61b9ffbf-048a-444d-a035-922f65224139 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:55:02.541012 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-61b9ffbf-048a-444d-a035-922f65224139 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:55:02.541492 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-61b9ffbf-048a-444d-a035-922f65224139 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:55:02.542198 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-61b9ffbf-048a-444d-a035-922f65224139 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:55:02.542662 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-61b9ffbf-048a-444d-a035-922f65224139 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:55:02.543099 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-61b9ffbf-048a-444d-a035-922f65224139 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:55:02.609208 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-61b9ffbf-048a-444d-a035-922f65224139 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:55:02.617770 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-61b9ffbf-048a-444d-a035-922f65224139 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c" status: 200 len: 1383 microversion: 2.1 time: 0.089557 Oct 19 04:55:02.618355 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3962/8399] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:55:02 2022] GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c => generated 1383 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:55:03.642044 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-e87bcde4-d0ea-440f-8eae-d776f37b73c7 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:55:03.643202 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-e87bcde4-d0ea-440f-8eae-d776f37b73c7 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: 85b80fab-9bae-4a22-bfe5-d6976a0c7b7c] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:55:03.649629 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e87bcde4-d0ea-440f-8eae-d776f37b73c7 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:55:03.650138 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e87bcde4-d0ea-440f-8eae-d776f37b73c7 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:55:03.650603 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e87bcde4-d0ea-440f-8eae-d776f37b73c7 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:55:03.651314 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e87bcde4-d0ea-440f-8eae-d776f37b73c7 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:55:03.651787 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e87bcde4-d0ea-440f-8eae-d776f37b73c7 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:55:03.652234 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-e87bcde4-d0ea-440f-8eae-d776f37b73c7 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:55:03.715014 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-e87bcde4-d0ea-440f-8eae-d776f37b73c7 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:55:03.723616 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-e87bcde4-d0ea-440f-8eae-d776f37b73c7 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c" status: 200 len: 1220 microversion: 2.1 time: 0.086879 Oct 19 04:55:03.724208 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4438/8400] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:55:03 2022] GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c => generated 1220 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:55:04.747988 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d64207c9-b3ff-49c2-9b15-96094820b897 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:55:04.748665 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d64207c9-b3ff-49c2-9b15-96094820b897 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: 85b80fab-9bae-4a22-bfe5-d6976a0c7b7c] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:55:04.760463 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d64207c9-b3ff-49c2-9b15-96094820b897 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:55:04.761078 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d64207c9-b3ff-49c2-9b15-96094820b897 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:55:04.761501 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d64207c9-b3ff-49c2-9b15-96094820b897 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:55:04.762660 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d64207c9-b3ff-49c2-9b15-96094820b897 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:55:04.763196 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d64207c9-b3ff-49c2-9b15-96094820b897 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:55:04.765703 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d64207c9-b3ff-49c2-9b15-96094820b897 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:55:04.835767 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d64207c9-b3ff-49c2-9b15-96094820b897 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:55:04.844143 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d64207c9-b3ff-49c2-9b15-96094820b897 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c" status: 200 len: 1220 microversion: 2.1 time: 0.101118 Oct 19 04:55:04.849416 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3963/8401] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:55:04 2022] GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c => generated 1220 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:55:06.088327 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8bc6a291-6cb1-4ad3-bb73-5c64059efb39 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:55:06.088955 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8bc6a291-6cb1-4ad3-bb73-5c64059efb39 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: 85b80fab-9bae-4a22-bfe5-d6976a0c7b7c] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:55:06.095125 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8bc6a291-6cb1-4ad3-bb73-5c64059efb39 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:55:06.095660 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8bc6a291-6cb1-4ad3-bb73-5c64059efb39 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:55:06.096113 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8bc6a291-6cb1-4ad3-bb73-5c64059efb39 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:55:06.096823 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8bc6a291-6cb1-4ad3-bb73-5c64059efb39 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:55:06.097289 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8bc6a291-6cb1-4ad3-bb73-5c64059efb39 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:55:06.097781 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8bc6a291-6cb1-4ad3-bb73-5c64059efb39 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:55:06.160191 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8bc6a291-6cb1-4ad3-bb73-5c64059efb39 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:55:06.168461 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8bc6a291-6cb1-4ad3-bb73-5c64059efb39 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c" status: 200 len: 1220 microversion: 2.1 time: 0.303768 Oct 19 04:55:06.169263 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4439/8402] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:55:05 2022] GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c => generated 1220 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:55:07.192841 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c6dae3a7-271d-4d6e-8099-20d8abe4c75a tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:55:07.193507 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c6dae3a7-271d-4d6e-8099-20d8abe4c75a tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: 85b80fab-9bae-4a22-bfe5-d6976a0c7b7c] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:55:07.200461 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c6dae3a7-271d-4d6e-8099-20d8abe4c75a tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:55:07.200962 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c6dae3a7-271d-4d6e-8099-20d8abe4c75a tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:55:07.201432 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c6dae3a7-271d-4d6e-8099-20d8abe4c75a tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:55:07.202212 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c6dae3a7-271d-4d6e-8099-20d8abe4c75a tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:55:07.202673 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c6dae3a7-271d-4d6e-8099-20d8abe4c75a tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:55:07.203111 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c6dae3a7-271d-4d6e-8099-20d8abe4c75a tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:55:07.237518 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c6dae3a7-271d-4d6e-8099-20d8abe4c75a tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:55:07.238035 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c6dae3a7-271d-4d6e-8099-20d8abe4c75a tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:55:07.238484 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c6dae3a7-271d-4d6e-8099-20d8abe4c75a tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:55:07.238928 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.objects.instance [None req-c6dae3a7-271d-4d6e-8099-20d8abe4c75a tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lazy-loading 'fault' on Instance uuid 85b80fab-9bae-4a22-bfe5-d6976a0c7b7c {{(pid=121135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 04:55:07.289017 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c6dae3a7-271d-4d6e-8099-20d8abe4c75a tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ca1b7e70404198a6251b0babea4855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0484467f1f7e4f968e2c85ec615c8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:55:07.297740 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c6dae3a7-271d-4d6e-8099-20d8abe4c75a tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c" status: 200 len: 1225 microversion: 2.1 time: 0.109374 Oct 19 04:55:07.298640 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3964/8403] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:55:07 2022] GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c => generated 1225 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:55:08.321644 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5ae72c70-9134-4ce2-927c-04108e055119 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:55:08.322275 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5ae72c70-9134-4ce2-927c-04108e055119 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] [instance: 85b80fab-9bae-4a22-bfe5-d6976a0c7b7c] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:55:08.328908 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5ae72c70-9134-4ce2-927c-04108e055119 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:55:08.329430 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5ae72c70-9134-4ce2-927c-04108e055119 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:55:08.329885 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5ae72c70-9134-4ce2-927c-04108e055119 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:55:08.330593 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5ae72c70-9134-4ce2-927c-04108e055119 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:55:08.331064 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5ae72c70-9134-4ce2-927c-04108e055119 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:55:08.331504 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5ae72c70-9134-4ce2-927c-04108e055119 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:55:08.345230 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-5ae72c70-9134-4ce2-927c-04108e055119 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] HTTP exception thrown: Instance 85b80fab-9bae-4a22-bfe5-d6976a0c7b7c could not be found. Oct 19 04:55:08.346946 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5ae72c70-9134-4ce2-927c-04108e055119 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Request method failure captured: Oct 19 04:55:08.346946 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c HTTP/1.1 Oct 19 04:55:08.346946 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 04:55:08.346946 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 04:55:08.346946 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 04:55:08.346946 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 04:55:08.346946 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 04:55:08.346946 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 04:55:08.346946 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 04:55:08.346946 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 04:55:08.346946 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT4DKRZlUUxUb299c6yd826PYCvuB0nWTYSxIyPauaqEYX6ErtQXOEQAsxlCuRH6In1Vuq3V5NZ0Ve9zmlUZO2Vt3otRhuU86ynDH7tFFMAAmDc-gohpdMVTH1mk8b2RQGtgGPbQtPvrQVifKJ3bDlPu8cRlnvWxl0lwpPL3eEmAqnIA Oct 19 04:55:08.346946 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 04:55:08.346946 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 04:55:08.346946 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 04:55:08.346946 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 04:55:08.346946 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 04:55:08.346946 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 04:55:08.346946 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: 0484467f1f7e4f968e2c85ec615c8557 Oct 19 04:55:08.346946 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-TestShelveInstance-286992043 Oct 19 04:55:08.346946 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 04:55:08.346946 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 04:55:08.346946 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/0484467f1f7e4f968e2c85ec615c8557"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0484467f1f7e4f968e2c85ec615c8557"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0484467f1f7e4f968e2c85ec615c8557"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_0484467f1f7e4f968e2c85ec615c8557", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 04:55:08.346946 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-TestShelveInstance-286992043 Oct 19 04:55:08.346946 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: 0484467f1f7e4f968e2c85ec615c8557 Oct 19 04:55:08.346946 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-TestShelveInstance-286992043 Oct 19 04:55:08.346946 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-TestShelveInstance-286992043-project Oct 19 04:55:08.346946 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 04:55:08.346946 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 04:55:08.346946 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 55ca1b7e70404198a6251b0babea4855 Oct 19 04:55:08.346946 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-TestShelveInstance-286992043-project Oct 19 04:55:08.346946 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 04:55:08.346946 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance 85b80fab-9bae-4a22-bfe5-d6976a0c7b7c could not be found. Oct 19 04:55:08.346946 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': '85b80fab-9bae-4a22-bfe5-d6976a0c7b7c'} Oct 19 04:55:08.346946 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 04:55:08.346946 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:55:08.346946 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 04:55:08.346946 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 04:55:08.346946 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 04:55:08.346946 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 04:55:08.346946 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 04:55:08.346946 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 04:55:08.346946 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 04:55:08.346946 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 04:55:08.346946 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85b80fab-9bae-4a22-bfe5-d6976a0c7b7c could not be found. Oct 19 04:55:08.346946 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:55:08.346946 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:55:08.346946 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:55:08.346946 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:55:08.346946 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:55:08.346946 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:55:08.346946 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 04:55:08.346946 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 04:55:08.346946 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 04:55:08.346946 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 04:55:08.346946 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 04:55:08.346946 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 04:55:08.346946 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 04:55:08.346946 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 04:55:08.346946 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 04:55:08.346946 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 04:55:08.346946 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85b80fab-9bae-4a22-bfe5-d6976a0c7b7c could not be found. Oct 19 04:55:08.346946 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:55:08.346946 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 04:55:08.346946 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:55:08.356034 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 04:55:08.356034 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 04:55:08.356034 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 04:55:08.356034 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 04:55:08.356034 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 04:55:08.356034 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85b80fab-9bae-4a22-bfe5-d6976a0c7b7c could not be found. Oct 19 04:55:08.356034 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 04:55:08.356034 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5ae72c70-9134-4ce2-927c-04108e055119 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Returning 404 to user: Instance 85b80fab-9bae-4a22-bfe5-d6976a0c7b7c could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 04:55:08.356034 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5ae72c70-9134-4ce2-927c-04108e055119 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c" status: 404 len: 111 microversion: 2.1 time: 0.030717 Oct 19 04:55:08.356034 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4440/8404] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:55:08 2022] GET /compute/v2.1/servers/85b80fab-9bae-4a22-bfe5-d6976a0c7b7c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 04:55:08.595670 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0714dece-3178-4764-928b-82f8ec848964 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] Calling method '.version_select at 0x7fc12bb87ca0>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:55:08.675146 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0714dece-3178-4764-928b-82f8ec848964 tempest-TestShelveInstance-286992043 tempest-TestShelveInstance-286992043-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1416815630" status: 202 len: 0 microversion: 2.1 time: 0.083517 Oct 19 04:55:08.675792 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3965/8405] 10.222.0.52 () {58 vars in 1254 bytes} [Wed Oct 19 04:55:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1416815630 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 04:55:30.844018 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=14 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:55:30.846708 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=24 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:55:31.017687 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-a348b0ee-910a-4e1c-ba18-f7e7828a1f78 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Action: 'create', calling method: .version_select at 0x7fc131066b80>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-1553798338", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHv86JG/wG5p/g4ajJQi97/FvD0W5GtWxAA/grHeeQM+J/LOiXOGrzKEh/KKPiLlRPjRIXbGeRjCBZfk5Nw9Eofj98LQ6KN+JijAh/phPhHpwU6IRN3IwPYWTQaOHuPkuA=="}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:55:31.034002 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-a348b0ee-910a-4e1c-ba18-f7e7828a1f78 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Getting quotas for project ba1d6461bf1e4cab9d25f44a7336b482. Resources: {'key_pairs'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 04:55:31.042870 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-a348b0ee-910a-4e1c-ba18-f7e7828a1f78 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Getting quotas for user 7578bec46d60497b9118124bd566490a and project ba1d6461bf1e4cab9d25f44a7336b482. Resources: {'key_pairs'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 04:55:31.126299 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-a348b0ee-910a-4e1c-ba18-f7e7828a1f78 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.287213 Oct 19 04:55:31.126901 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4441/8406] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Oct 19 04:55:30 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:55:33.665044 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-2e533db7-2875-40f7-b224-bbd1ebd3c7d2 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1385081508", "imageRef": "9e16d73e-70ea-4421-aee3-047d80396c02", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1553798338", "security_groups": [{"name": "tempest-secgroup-smoke-649455890"}], "networks": [{"uuid": "3529c710-573e-4e3e-83f0-63bedaff57b1"}]}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:55:33.675390 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:55:33.676052 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:55:33.787953 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.network.neutron [None req-2e533db7-2875-40f7-b224-bbd1ebd3c7d2 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] validate_networks() for [('3529c710-573e-4e3e-83f0-63bedaff57b1', None, None, None, None, None)] {{(pid=121135) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 04:55:34.187146 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-2e533db7-2875-40f7-b224-bbd1ebd3c7d2 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Flavor limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 04:55:34.187582 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-2e533db7-2875-40f7-b224-bbd1ebd3c7d2 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Image limits 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 04:55:34.188559 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-2e533db7-2875-40f7-b224-bbd1ebd3c7d2 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Flavor pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 04:55:34.188989 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-2e533db7-2875-40f7-b224-bbd1ebd3c7d2 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Image pref 0:0:0 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 04:55:34.189435 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.virt.hardware [None req-2e533db7-2875-40f7-b224-bbd1ebd3c7d2 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 04:55:34.198398 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2e533db7-2875-40f7-b224-bbd1ebd3c7d2 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:55:34.198836 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2e533db7-2875-40f7-b224-bbd1ebd3c7d2 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:55:34.199295 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2e533db7-2875-40f7-b224-bbd1ebd3c7d2 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:55:34.200035 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2e533db7-2875-40f7-b224-bbd1ebd3c7d2 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:55:34.200499 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2e533db7-2875-40f7-b224-bbd1ebd3c7d2 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:55:34.200935 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-2e533db7-2875-40f7-b224-bbd1ebd3c7d2 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:55:34.218305 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-2e533db7-2875-40f7-b224-bbd1ebd3c7d2 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Getting quotas for project ba1d6461bf1e4cab9d25f44a7336b482. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 04:55:34.223658 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.quota [None req-2e533db7-2875-40f7-b224-bbd1ebd3c7d2 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Getting quotas for user 7578bec46d60497b9118124bd566490a and project ba1d6461bf1e4cab9d25f44a7336b482. Resources: {'cores', 'ram', 'instances'} {{(pid=121135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 04:55:34.235956 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-2e533db7-2875-40f7-b224-bbd1ebd3c7d2 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Going to run 1 instances... {{(pid=121135) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 04:55:34.238320 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-2e533db7-2875-40f7-b224-bbd1ebd3c7d2 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] [instance: c5b743c2-0631-4b52-81d0-820260bf382f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e16d73e-70ea-4421-aee3-047d80396c02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121135) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 04:55:34.343756 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-2e533db7-2875-40f7-b224-bbd1ebd3c7d2 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.682785 Oct 19 04:55:34.344477 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3966/8407] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 04:55:33 2022] POST /compute/v2.1/servers => generated 405 bytes in 684 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 04:55:34.356785 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5493a321-ff2b-4e48-946c-34d43b89e570 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:55:34.357556 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5493a321-ff2b-4e48-946c-34d43b89e570 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] [instance: c5b743c2-0631-4b52-81d0-820260bf382f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:55:34.418846 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5493a321-ff2b-4e48-946c-34d43b89e570 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578bec46d60497b9118124bd566490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1d6461bf1e4cab9d25f44a7336b482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:55:34.426875 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5493a321-ff2b-4e48-946c-34d43b89e570 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] 10.222.0.52 "GET /compute/v2.1/servers/c5b743c2-0631-4b52-81d0-820260bf382f" status: 200 len: 1249 microversion: 2.1 time: 0.074804 Oct 19 04:55:34.427473 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4442/8408] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:55:34 2022] GET /compute/v2.1/servers/c5b743c2-0631-4b52-81d0-820260bf382f => generated 1249 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:55:35.450690 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-aa2412e3-d7e5-416e-b863-589006604e0a tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:55:35.452834 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-aa2412e3-d7e5-416e-b863-589006604e0a tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] [instance: c5b743c2-0631-4b52-81d0-820260bf382f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:55:35.507282 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-aa2412e3-d7e5-416e-b863-589006604e0a tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578bec46d60497b9118124bd566490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1d6461bf1e4cab9d25f44a7336b482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:55:35.514438 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-aa2412e3-d7e5-416e-b863-589006604e0a tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] 10.222.0.52 "GET /compute/v2.1/servers/c5b743c2-0631-4b52-81d0-820260bf382f" status: 200 len: 1249 microversion: 2.1 time: 0.068780 Oct 19 04:55:35.515028 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3967/8409] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:55:35 2022] GET /compute/v2.1/servers/c5b743c2-0631-4b52-81d0-820260bf382f => generated 1249 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:55:36.544141 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6f6319eb-2809-45f8-a3af-9c6b06e291d3 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:55:36.544818 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6f6319eb-2809-45f8-a3af-9c6b06e291d3 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] [instance: c5b743c2-0631-4b52-81d0-820260bf382f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:55:36.602770 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-6f6319eb-2809-45f8-a3af-9c6b06e291d3 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578bec46d60497b9118124bd566490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1d6461bf1e4cab9d25f44a7336b482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:55:36.610056 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6f6319eb-2809-45f8-a3af-9c6b06e291d3 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] 10.222.0.52 "GET /compute/v2.1/servers/c5b743c2-0631-4b52-81d0-820260bf382f" status: 200 len: 1249 microversion: 2.1 time: 0.069767 Oct 19 04:55:36.610637 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4443/8410] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:55:36 2022] GET /compute/v2.1/servers/c5b743c2-0631-4b52-81d0-820260bf382f => generated 1249 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:55:37.633161 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7e68c365-9afa-4ae0-8cbd-d13726ae87fb tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:55:37.633750 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7e68c365-9afa-4ae0-8cbd-d13726ae87fb tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] [instance: c5b743c2-0631-4b52-81d0-820260bf382f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:55:37.686702 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7e68c365-9afa-4ae0-8cbd-d13726ae87fb tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578bec46d60497b9118124bd566490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1d6461bf1e4cab9d25f44a7336b482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:55:37.694416 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7e68c365-9afa-4ae0-8cbd-d13726ae87fb tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] 10.222.0.52 "GET /compute/v2.1/servers/c5b743c2-0631-4b52-81d0-820260bf382f" status: 200 len: 1249 microversion: 2.1 time: 0.065318 Oct 19 04:55:37.694979 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3968/8411] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:55:37 2022] GET /compute/v2.1/servers/c5b743c2-0631-4b52-81d0-820260bf382f => generated 1249 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:55:38.717059 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1d55e178-e2bf-4805-a96f-868a830b8695 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:55:38.717725 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1d55e178-e2bf-4805-a96f-868a830b8695 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] [instance: c5b743c2-0631-4b52-81d0-820260bf382f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:55:38.725312 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1d55e178-e2bf-4805-a96f-868a830b8695 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:55:38.725851 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1d55e178-e2bf-4805-a96f-868a830b8695 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:55:38.726315 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1d55e178-e2bf-4805-a96f-868a830b8695 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:55:38.727030 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1d55e178-e2bf-4805-a96f-868a830b8695 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:55:38.727535 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1d55e178-e2bf-4805-a96f-868a830b8695 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:55:38.727988 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1d55e178-e2bf-4805-a96f-868a830b8695 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:55:38.792480 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-1d55e178-e2bf-4805-a96f-868a830b8695 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578bec46d60497b9118124bd566490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1d6461bf1e4cab9d25f44a7336b482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:55:38.800395 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1d55e178-e2bf-4805-a96f-868a830b8695 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] 10.222.0.52 "GET /compute/v2.1/servers/c5b743c2-0631-4b52-81d0-820260bf382f" status: 200 len: 1253 microversion: 2.1 time: 0.087295 Oct 19 04:55:38.804331 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4444/8412] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:55:38 2022] GET /compute/v2.1/servers/c5b743c2-0631-4b52-81d0-820260bf382f => generated 1253 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:55:39.823820 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-80e31323-0145-4b9e-9a0c-80b36f08ad50 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:55:39.824403 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-80e31323-0145-4b9e-9a0c-80b36f08ad50 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] [instance: c5b743c2-0631-4b52-81d0-820260bf382f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:55:39.832462 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-80e31323-0145-4b9e-9a0c-80b36f08ad50 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:55:39.832963 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-80e31323-0145-4b9e-9a0c-80b36f08ad50 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:55:39.838830 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-80e31323-0145-4b9e-9a0c-80b36f08ad50 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:55:39.838830 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-80e31323-0145-4b9e-9a0c-80b36f08ad50 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:55:39.838830 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-80e31323-0145-4b9e-9a0c-80b36f08ad50 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:55:39.838830 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-80e31323-0145-4b9e-9a0c-80b36f08ad50 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:55:39.897123 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-80e31323-0145-4b9e-9a0c-80b36f08ad50 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578bec46d60497b9118124bd566490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1d6461bf1e4cab9d25f44a7336b482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:55:39.904825 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-80e31323-0145-4b9e-9a0c-80b36f08ad50 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] 10.222.0.52 "GET /compute/v2.1/servers/c5b743c2-0631-4b52-81d0-820260bf382f" status: 200 len: 1253 microversion: 2.1 time: 0.085103 Oct 19 04:55:39.905431 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3969/8413] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:55:39 2022] GET /compute/v2.1/servers/c5b743c2-0631-4b52-81d0-820260bf382f => generated 1253 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:55:40.928817 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ed12b04e-16be-4627-b6f5-5990344e81e0 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:55:40.929561 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ed12b04e-16be-4627-b6f5-5990344e81e0 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] [instance: c5b743c2-0631-4b52-81d0-820260bf382f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:55:40.937355 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ed12b04e-16be-4627-b6f5-5990344e81e0 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:55:40.937935 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ed12b04e-16be-4627-b6f5-5990344e81e0 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:55:40.938436 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ed12b04e-16be-4627-b6f5-5990344e81e0 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:55:40.940436 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ed12b04e-16be-4627-b6f5-5990344e81e0 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:55:40.940923 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ed12b04e-16be-4627-b6f5-5990344e81e0 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:55:40.941392 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ed12b04e-16be-4627-b6f5-5990344e81e0 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:55:41.017719 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ed12b04e-16be-4627-b6f5-5990344e81e0 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578bec46d60497b9118124bd566490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1d6461bf1e4cab9d25f44a7336b482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:55:41.027022 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ed12b04e-16be-4627-b6f5-5990344e81e0 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] 10.222.0.52 "GET /compute/v2.1/servers/c5b743c2-0631-4b52-81d0-820260bf382f" status: 200 len: 1319 microversion: 2.1 time: 0.102030 Oct 19 04:55:41.028346 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4445/8414] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:55:40 2022] GET /compute/v2.1/servers/c5b743c2-0631-4b52-81d0-820260bf382f => generated 1319 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:55:42.053689 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-8f2f7208-6304-4c22-b0e2-a04f06b51658 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:55:42.054595 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-8f2f7208-6304-4c22-b0e2-a04f06b51658 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] [instance: c5b743c2-0631-4b52-81d0-820260bf382f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:55:42.063778 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8f2f7208-6304-4c22-b0e2-a04f06b51658 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:55:42.064306 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8f2f7208-6304-4c22-b0e2-a04f06b51658 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:55:42.064752 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8f2f7208-6304-4c22-b0e2-a04f06b51658 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:55:42.065760 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8f2f7208-6304-4c22-b0e2-a04f06b51658 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:55:42.066229 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8f2f7208-6304-4c22-b0e2-a04f06b51658 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:55:42.066664 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8f2f7208-6304-4c22-b0e2-a04f06b51658 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:55:42.202162 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-8f2f7208-6304-4c22-b0e2-a04f06b51658 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578bec46d60497b9118124bd566490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1d6461bf1e4cab9d25f44a7336b482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:55:42.213283 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-8f2f7208-6304-4c22-b0e2-a04f06b51658 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] 10.222.0.52 "GET /compute/v2.1/servers/c5b743c2-0631-4b52-81d0-820260bf382f" status: 200 len: 1374 microversion: 2.1 time: 0.163676 Oct 19 04:55:42.213972 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3970/8415] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:55:42 2022] GET /compute/v2.1/servers/c5b743c2-0631-4b52-81d0-820260bf382f => generated 1374 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:55:42.430690 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-ed6d57df-d7af-4439-bfed-d7115032ef65 req-b2105f87-6185-412e-8fc7-ff448ba58902 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5b743c2-0631-4b52-81d0-820260bf382f", "tag": "a5dfecd6-25ee-445c-ad0e-e2cbc8ed3588"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:55:42.440422 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-ed6d57df-d7af-4439-bfed-d7115032ef65 req-b2105f87-6185-412e-8fc7-ff448ba58902 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:55:42.441531 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-ed6d57df-d7af-4439-bfed-d7115032ef65 req-b2105f87-6185-412e-8fc7-ff448ba58902 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:55:42.441993 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-ed6d57df-d7af-4439-bfed-d7115032ef65 req-b2105f87-6185-412e-8fc7-ff448ba58902 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:55:42.456932 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-ed6d57df-d7af-4439-bfed-d7115032ef65 req-b2105f87-6185-412e-8fc7-ff448ba58902 service nova] Creating event network-changed:a5dfecd6-25ee-445c-ad0e-e2cbc8ed3588 for instance c5b743c2-0631-4b52-81d0-820260bf382f on n-h2-861333-8 Oct 19 04:55:42.462659 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-ed6d57df-d7af-4439-bfed-d7115032ef65 req-b2105f87-6185-412e-8fc7-ff448ba58902 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101772 Oct 19 04:55:42.463291 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4446/8416] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:55:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:55:43.238173 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1bf39104-f694-49e7-85fc-20614df3c8fd tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:55:43.238835 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1bf39104-f694-49e7-85fc-20614df3c8fd tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] [instance: c5b743c2-0631-4b52-81d0-820260bf382f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:55:43.245797 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1bf39104-f694-49e7-85fc-20614df3c8fd tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:55:43.246310 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1bf39104-f694-49e7-85fc-20614df3c8fd tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:55:43.247053 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1bf39104-f694-49e7-85fc-20614df3c8fd tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:55:43.247773 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1bf39104-f694-49e7-85fc-20614df3c8fd tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:55:43.248237 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1bf39104-f694-49e7-85fc-20614df3c8fd tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:55:43.248675 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1bf39104-f694-49e7-85fc-20614df3c8fd tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:55:43.388297 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-1bf39104-f694-49e7-85fc-20614df3c8fd tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578bec46d60497b9118124bd566490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1d6461bf1e4cab9d25f44a7336b482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:55:43.396737 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1bf39104-f694-49e7-85fc-20614df3c8fd tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] 10.222.0.52 "GET /compute/v2.1/servers/c5b743c2-0631-4b52-81d0-820260bf382f" status: 200 len: 1374 microversion: 2.1 time: 0.162460 Oct 19 04:55:43.397319 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3971/8417] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:55:43 2022] GET /compute/v2.1/servers/c5b743c2-0631-4b52-81d0-820260bf382f => generated 1374 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:55:44.420612 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-6df0a1d9-632a-4b43-8d7b-7fd04c56677f tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:55:44.421340 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-6df0a1d9-632a-4b43-8d7b-7fd04c56677f tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] [instance: c5b743c2-0631-4b52-81d0-820260bf382f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:55:44.427910 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6df0a1d9-632a-4b43-8d7b-7fd04c56677f tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:55:44.428415 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6df0a1d9-632a-4b43-8d7b-7fd04c56677f tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:55:44.428875 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6df0a1d9-632a-4b43-8d7b-7fd04c56677f tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:55:44.429650 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6df0a1d9-632a-4b43-8d7b-7fd04c56677f tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:55:44.430125 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6df0a1d9-632a-4b43-8d7b-7fd04c56677f tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:55:44.430577 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-6df0a1d9-632a-4b43-8d7b-7fd04c56677f tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:55:44.561940 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-6df0a1d9-632a-4b43-8d7b-7fd04c56677f tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578bec46d60497b9118124bd566490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1d6461bf1e4cab9d25f44a7336b482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:55:44.570185 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-6df0a1d9-632a-4b43-8d7b-7fd04c56677f tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] 10.222.0.52 "GET /compute/v2.1/servers/c5b743c2-0631-4b52-81d0-820260bf382f" status: 200 len: 1374 microversion: 2.1 time: 0.153907 Oct 19 04:55:44.570764 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4447/8418] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:55:44 2022] GET /compute/v2.1/servers/c5b743c2-0631-4b52-81d0-820260bf382f => generated 1374 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:55:45.597123 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-872efdb1-e37c-4fbe-b2c9-9ad2f74acc61 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:55:45.597694 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-872efdb1-e37c-4fbe-b2c9-9ad2f74acc61 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] [instance: c5b743c2-0631-4b52-81d0-820260bf382f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:55:45.599855 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:55:45.604672 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-872efdb1-e37c-4fbe-b2c9-9ad2f74acc61 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:55:45.605171 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-872efdb1-e37c-4fbe-b2c9-9ad2f74acc61 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:55:45.605664 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-872efdb1-e37c-4fbe-b2c9-9ad2f74acc61 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:55:45.606372 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-872efdb1-e37c-4fbe-b2c9-9ad2f74acc61 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:55:45.606880 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-872efdb1-e37c-4fbe-b2c9-9ad2f74acc61 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:55:45.607315 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-872efdb1-e37c-4fbe-b2c9-9ad2f74acc61 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:55:45.743920 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-872efdb1-e37c-4fbe-b2c9-9ad2f74acc61 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578bec46d60497b9118124bd566490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1d6461bf1e4cab9d25f44a7336b482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:55:45.751688 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-872efdb1-e37c-4fbe-b2c9-9ad2f74acc61 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] 10.222.0.52 "GET /compute/v2.1/servers/c5b743c2-0631-4b52-81d0-820260bf382f" status: 200 len: 1374 microversion: 2.1 time: 0.159233 Oct 19 04:55:45.752274 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3972/8419] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:55:45 2022] GET /compute/v2.1/servers/c5b743c2-0631-4b52-81d0-820260bf382f => generated 1374 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:55:46.774845 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5ae19d64-bdc2-4228-a6b3-d78abb2572a7 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:55:46.775481 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5ae19d64-bdc2-4228-a6b3-d78abb2572a7 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] [instance: c5b743c2-0631-4b52-81d0-820260bf382f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:55:46.778340 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=8 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:55:46.784172 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5ae19d64-bdc2-4228-a6b3-d78abb2572a7 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:55:46.784681 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5ae19d64-bdc2-4228-a6b3-d78abb2572a7 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:55:46.785142 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5ae19d64-bdc2-4228-a6b3-d78abb2572a7 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:55:46.785893 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5ae19d64-bdc2-4228-a6b3-d78abb2572a7 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:55:46.786374 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5ae19d64-bdc2-4228-a6b3-d78abb2572a7 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:55:46.786823 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5ae19d64-bdc2-4228-a6b3-d78abb2572a7 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:55:46.918415 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5ae19d64-bdc2-4228-a6b3-d78abb2572a7 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578bec46d60497b9118124bd566490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1d6461bf1e4cab9d25f44a7336b482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:55:46.926830 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5ae19d64-bdc2-4228-a6b3-d78abb2572a7 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] 10.222.0.52 "GET /compute/v2.1/servers/c5b743c2-0631-4b52-81d0-820260bf382f" status: 200 len: 1374 microversion: 2.1 time: 0.155886 Oct 19 04:55:46.927411 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4448/8420] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:55:46 2022] GET /compute/v2.1/servers/c5b743c2-0631-4b52-81d0-820260bf382f => generated 1374 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:55:47.426845 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-f1a51845-7713-4a16-a43e-3ddc23a578a9 req-d18b8fb2-ace3-4183-baa8-e70d2a262ceb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5b743c2-0631-4b52-81d0-820260bf382f", "name": "network-vif-plugged", "status": "completed", "tag": "a5dfecd6-25ee-445c-ad0e-e2cbc8ed3588"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:55:47.437622 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-f1a51845-7713-4a16-a43e-3ddc23a578a9 req-d18b8fb2-ace3-4183-baa8-e70d2a262ceb service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:55:47.438052 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-f1a51845-7713-4a16-a43e-3ddc23a578a9 req-d18b8fb2-ace3-4183-baa8-e70d2a262ceb service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:55:47.438592 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-f1a51845-7713-4a16-a43e-3ddc23a578a9 req-d18b8fb2-ace3-4183-baa8-e70d2a262ceb service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:55:47.450034 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-f1a51845-7713-4a16-a43e-3ddc23a578a9 req-d18b8fb2-ace3-4183-baa8-e70d2a262ceb service nova] Creating event network-vif-plugged:a5dfecd6-25ee-445c-ad0e-e2cbc8ed3588 for instance c5b743c2-0631-4b52-81d0-820260bf382f on n-h2-861333-8 Oct 19 04:55:47.455769 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-f1a51845-7713-4a16-a43e-3ddc23a578a9 req-d18b8fb2-ace3-4183-baa8-e70d2a262ceb service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032645 Oct 19 04:55:47.456424 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3973/8421] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:55:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:55:47.949738 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-5b1de220-35f6-4311-80c0-c638b6163427 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:55:47.950397 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-5b1de220-35f6-4311-80c0-c638b6163427 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] [instance: c5b743c2-0631-4b52-81d0-820260bf382f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:55:47.957626 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5b1de220-35f6-4311-80c0-c638b6163427 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:55:47.958128 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5b1de220-35f6-4311-80c0-c638b6163427 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:55:47.958582 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5b1de220-35f6-4311-80c0-c638b6163427 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:55:47.959288 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5b1de220-35f6-4311-80c0-c638b6163427 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:55:47.959762 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5b1de220-35f6-4311-80c0-c638b6163427 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:55:47.960206 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-5b1de220-35f6-4311-80c0-c638b6163427 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:55:48.093195 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-5b1de220-35f6-4311-80c0-c638b6163427 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578bec46d60497b9118124bd566490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1d6461bf1e4cab9d25f44a7336b482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:55:48.100979 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-5b1de220-35f6-4311-80c0-c638b6163427 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] 10.222.0.52 "GET /compute/v2.1/servers/c5b743c2-0631-4b52-81d0-820260bf382f" status: 200 len: 1374 microversion: 2.1 time: 0.155223 Oct 19 04:55:48.101596 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4449/8422] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:55:47 2022] GET /compute/v2.1/servers/c5b743c2-0631-4b52-81d0-820260bf382f => generated 1374 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:55:49.121572 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=10 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:55:49.127246 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-8d535d50-c444-4da3-9daa-7e89454ff306 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:55:49.127960 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-8d535d50-c444-4da3-9daa-7e89454ff306 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] [instance: c5b743c2-0631-4b52-81d0-820260bf382f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:55:49.134164 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8d535d50-c444-4da3-9daa-7e89454ff306 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:55:49.136125 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8d535d50-c444-4da3-9daa-7e89454ff306 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:55:49.136125 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8d535d50-c444-4da3-9daa-7e89454ff306 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:55:49.136125 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8d535d50-c444-4da3-9daa-7e89454ff306 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:55:49.136433 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8d535d50-c444-4da3-9daa-7e89454ff306 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:55:49.136717 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-8d535d50-c444-4da3-9daa-7e89454ff306 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:55:49.271362 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-8d535d50-c444-4da3-9daa-7e89454ff306 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578bec46d60497b9118124bd566490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1d6461bf1e4cab9d25f44a7336b482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:55:49.279286 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-8d535d50-c444-4da3-9daa-7e89454ff306 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] 10.222.0.52 "GET /compute/v2.1/servers/c5b743c2-0631-4b52-81d0-820260bf382f" status: 200 len: 1560 microversion: 2.1 time: 0.158709 Oct 19 04:55:49.280028 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3974/8423] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:55:49 2022] GET /compute/v2.1/servers/c5b743c2-0631-4b52-81d0-820260bf382f => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:55:49.301434 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-90ff8cfe-3636-4b12-9347-eda9f90afe38 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:55:49.302087 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-90ff8cfe-3636-4b12-9347-eda9f90afe38 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] [instance: c5b743c2-0631-4b52-81d0-820260bf382f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:55:49.308987 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-90ff8cfe-3636-4b12-9347-eda9f90afe38 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:55:49.309520 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-90ff8cfe-3636-4b12-9347-eda9f90afe38 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:55:49.309978 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-90ff8cfe-3636-4b12-9347-eda9f90afe38 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:55:49.310684 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-90ff8cfe-3636-4b12-9347-eda9f90afe38 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:55:49.311154 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-90ff8cfe-3636-4b12-9347-eda9f90afe38 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:55:49.311598 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-90ff8cfe-3636-4b12-9347-eda9f90afe38 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:55:49.444018 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-90ff8cfe-3636-4b12-9347-eda9f90afe38 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578bec46d60497b9118124bd566490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1d6461bf1e4cab9d25f44a7336b482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:55:49.451955 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-90ff8cfe-3636-4b12-9347-eda9f90afe38 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] 10.222.0.52 "GET /compute/v2.1/servers/c5b743c2-0631-4b52-81d0-820260bf382f" status: 200 len: 1560 microversion: 2.1 time: 0.154399 Oct 19 04:55:49.452538 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4450/8424] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:55:49 2022] GET /compute/v2.1/servers/c5b743c2-0631-4b52-81d0-820260bf382f => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:55:51.643125 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-ba4ec3fe-f84a-470d-afb5-5b875997128f req-24850f24-9bd9-4660-b50e-313998a74934 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5b743c2-0631-4b52-81d0-820260bf382f", "tag": "a5dfecd6-25ee-445c-ad0e-e2cbc8ed3588"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:55:51.653487 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-ba4ec3fe-f84a-470d-afb5-5b875997128f req-24850f24-9bd9-4660-b50e-313998a74934 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:55:51.659447 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-ba4ec3fe-f84a-470d-afb5-5b875997128f req-24850f24-9bd9-4660-b50e-313998a74934 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:55:51.659447 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-ba4ec3fe-f84a-470d-afb5-5b875997128f req-24850f24-9bd9-4660-b50e-313998a74934 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:55:51.665866 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-ba4ec3fe-f84a-470d-afb5-5b875997128f req-24850f24-9bd9-4660-b50e-313998a74934 service nova] Creating event network-changed:a5dfecd6-25ee-445c-ad0e-e2cbc8ed3588 for instance c5b743c2-0631-4b52-81d0-820260bf382f on n-h2-861333-8 Oct 19 04:55:51.671188 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-ba4ec3fe-f84a-470d-afb5-5b875997128f req-24850f24-9bd9-4660-b50e-313998a74934 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031825 Oct 19 04:55:51.672511 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3975/8425] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:55:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:57:48.922630 n-d-861333-8 devstack@n-api.service[121134]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1a02a1d9-5473-4a0a-ab8b-e198030a9897] AMQP server on 10.222.0.52:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 19 04:57:48.924317 n-d-861333-8 devstack@n-api.service[121134]: ERROR oslo.messaging._drivers.impl_rabbit [-] [96947759-862b-4b0f-b2e1-828b2ec3f179] AMQP server on 10.222.0.52:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 19 04:57:48.924900 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:57:48.925700 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=38 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:57:48.926616 n-d-861333-8 devstack@n-api.service[121134]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 19 04:57:48.926761 n-d-861333-8 devstack@n-api.service[121134]: Wed Oct 19 04:57:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c5b743c2-0631-4b52-81d0-820260bf382f/action (ip 10.222.0.52) !!! Oct 19 04:57:48.931650 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-68f2f6b7-305d-41fe-9b45-9cbfd3e4911d tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-85056866"}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:57:48.934077 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-68f2f6b7-305d-41fe-9b45-9cbfd3e4911d tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] [instance: c5b743c2-0631-4b52-81d0-820260bf382f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:57:48.949177 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-68f2f6b7-305d-41fe-9b45-9cbfd3e4911d tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:57:48.949177 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-68f2f6b7-305d-41fe-9b45-9cbfd3e4911d tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:57:48.949177 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-68f2f6b7-305d-41fe-9b45-9cbfd3e4911d tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:57:48.949177 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-68f2f6b7-305d-41fe-9b45-9cbfd3e4911d tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:57:48.949177 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-68f2f6b7-305d-41fe-9b45-9cbfd3e4911d tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:57:48.949177 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-68f2f6b7-305d-41fe-9b45-9cbfd3e4911d tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:57:49.461690 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-68f2f6b7-305d-41fe-9b45-9cbfd3e4911d tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] 10.222.0.52 "POST /compute/v2.1/servers/c5b743c2-0631-4b52-81d0-820260bf382f/action" status: 202 len: 0 microversion: 2.1 time: 0.540829 Oct 19 04:57:49.462355 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4451/8426] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 04:57:48 2022] POST /compute/v2.1/servers/c5b743c2-0631-4b52-81d0-820260bf382f/action => generated 0 bytes in 542 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 19 04:57:54.172684 n-d-861333-8 devstack@n-api.service[121135]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a4608907-9588-4b25-ac87-b956b6019667] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 19 04:57:54.174898 n-d-861333-8 devstack@n-api.service[121135]: ERROR oslo.messaging._drivers.impl_rabbit [-] [171e3f7c-7dfe-4dce-b74d-cf08e9363be7] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 19 04:57:54.175686 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:57:54.176752 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=36 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:57:54.178354 n-d-861333-8 devstack@n-api.service[121135]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 19 04:57:54.178712 n-d-861333-8 devstack@n-api.service[121135]: Wed Oct 19 04:57:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.52) !!! Oct 19 04:57:54.180064 n-d-861333-8 devstack@n-api.service[121135]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 19 04:57:54.180378 n-d-861333-8 devstack@n-api.service[121135]: Wed Oct 19 04:57:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.52) !!! Oct 19 04:57:54.186432 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-e707d9a0-451c-4741-a28c-444eef150c87 req-d1ae3006-d599-4154-b8d8-9ddcb3775630 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5b743c2-0631-4b52-81d0-820260bf382f", "name": "network-vif-plugged", "status": "completed", "tag": "a5dfecd6-25ee-445c-ad0e-e2cbc8ed3588"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:57:54.204961 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-e707d9a0-451c-4741-a28c-444eef150c87 req-d1ae3006-d599-4154-b8d8-9ddcb3775630 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:57:54.204961 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-e707d9a0-451c-4741-a28c-444eef150c87 req-d1ae3006-d599-4154-b8d8-9ddcb3775630 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:57:54.204961 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-e707d9a0-451c-4741-a28c-444eef150c87 req-d1ae3006-d599-4154-b8d8-9ddcb3775630 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:57:54.212577 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-e707d9a0-451c-4741-a28c-444eef150c87 req-d1ae3006-d599-4154-b8d8-9ddcb3775630 service nova] Creating event network-vif-plugged:a5dfecd6-25ee-445c-ad0e-e2cbc8ed3588 for instance c5b743c2-0631-4b52-81d0-820260bf382f on n-h2-861333-8 Oct 19 04:57:54.218009 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-e707d9a0-451c-4741-a28c-444eef150c87 req-d1ae3006-d599-4154-b8d8-9ddcb3775630 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046948 Oct 19 04:57:54.218899 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3976/8427] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:57:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:58:05.136192 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:58:05.137033 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:58:05.142275 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-db944ab4-29ed-4009-a13b-ccd95778a3ce tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-924852926", "imageRef": "c19236aa-ebaf-49ee-9b62-6d5d30097ff8", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1553798338", "security_groups": [{"name": "tempest-secgroup-smoke-649455890"}], "networks": [{"uuid": "3529c710-573e-4e3e-83f0-63bedaff57b1"}]}} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:58:05.165771 n-d-861333-8 devstack@n-api.service[121134]: INFO oslo.messaging._drivers.impl_rabbit [-] [96947759-862b-4b0f-b2e1-828b2ec3f179] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 37980. Oct 19 04:58:05.168172 n-d-861333-8 devstack@n-api.service[121134]: INFO oslo.messaging._drivers.impl_rabbit [-] [1a02a1d9-5473-4a0a-ab8b-e198030a9897] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 37978. Oct 19 04:58:05.255932 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.network.neutron [None req-db944ab4-29ed-4009-a13b-ccd95778a3ce tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] validate_networks() for [('3529c710-573e-4e3e-83f0-63bedaff57b1', None, None, None, None, None)] {{(pid=121134) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 04:58:05.739948 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-db944ab4-29ed-4009-a13b-ccd95778a3ce tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Flavor limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 04:58:05.740404 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-db944ab4-29ed-4009-a13b-ccd95778a3ce tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Image limits 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 04:58:05.740907 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-db944ab4-29ed-4009-a13b-ccd95778a3ce tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Flavor pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 04:58:05.741343 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-db944ab4-29ed-4009-a13b-ccd95778a3ce tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Image pref 0:0:0 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 04:58:05.741865 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.virt.hardware [None req-db944ab4-29ed-4009-a13b-ccd95778a3ce tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 04:58:05.751026 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-db944ab4-29ed-4009-a13b-ccd95778a3ce tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:58:05.752047 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-db944ab4-29ed-4009-a13b-ccd95778a3ce tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:58:05.752507 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-db944ab4-29ed-4009-a13b-ccd95778a3ce tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:58:05.753267 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-db944ab4-29ed-4009-a13b-ccd95778a3ce tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:58:05.753769 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-db944ab4-29ed-4009-a13b-ccd95778a3ce tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:58:05.754221 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-db944ab4-29ed-4009-a13b-ccd95778a3ce tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:58:05.775185 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-db944ab4-29ed-4009-a13b-ccd95778a3ce tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Getting quotas for project ba1d6461bf1e4cab9d25f44a7336b482. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 04:58:05.780422 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.quota [None req-db944ab4-29ed-4009-a13b-ccd95778a3ce tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Getting quotas for user 7578bec46d60497b9118124bd566490a and project ba1d6461bf1e4cab9d25f44a7336b482. Resources: {'cores', 'ram', 'instances'} {{(pid=121134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 04:58:05.793648 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-db944ab4-29ed-4009-a13b-ccd95778a3ce tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Going to run 1 instances... {{(pid=121134) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 04:58:05.796139 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-db944ab4-29ed-4009-a13b-ccd95778a3ce tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] [instance: d70be658-192f-4b01-93b9-c831c9df7797] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c19236aa-ebaf-49ee-9b62-6d5d30097ff8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 04:58:05.905093 n-d-861333-8 devstack@n-api.service[121134]: ERROR oslo.messaging._drivers.impl_rabbit [None req-db944ab4-29ed-4009-a13b-ccd95778a3ce tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] [c05aef85-47e0-45f7-a28b-fdfe1b7df516] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 19 04:58:06.913016 n-d-861333-8 devstack@n-api.service[121134]: INFO oslo.messaging._drivers.impl_rabbit [None req-db944ab4-29ed-4009-a13b-ccd95778a3ce tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] [c05aef85-47e0-45f7-a28b-fdfe1b7df516] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 37996. Oct 19 04:58:06.917447 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-db944ab4-29ed-4009-a13b-ccd95778a3ce tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.783458 Oct 19 04:58:06.918117 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4452/8428] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 19 04:58:05 2022] POST /compute/v2.1/servers => generated 405 bytes in 1785 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 04:58:06.935409 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-0a17d1ec-a8dd-40af-8b6e-a6b0a997373c tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:58:06.936142 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-0a17d1ec-a8dd-40af-8b6e-a6b0a997373c tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] [instance: d70be658-192f-4b01-93b9-c831c9df7797] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:58:06.957228 n-d-861333-8 devstack@n-api.service[121135]: INFO oslo.messaging._drivers.impl_rabbit [-] [a4608907-9588-4b25-ac87-b956b6019667] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 38000. Oct 19 04:58:06.959099 n-d-861333-8 devstack@n-api.service[121135]: INFO oslo.messaging._drivers.impl_rabbit [-] [171e3f7c-7dfe-4dce-b74d-cf08e9363be7] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 38002. Oct 19 04:58:07.055594 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-0a17d1ec-a8dd-40af-8b6e-a6b0a997373c tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578bec46d60497b9118124bd566490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1d6461bf1e4cab9d25f44a7336b482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:58:07.064301 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-0a17d1ec-a8dd-40af-8b6e-a6b0a997373c tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] 10.222.0.52 "GET /compute/v2.1/servers/d70be658-192f-4b01-93b9-c831c9df7797" status: 200 len: 1248 microversion: 2.1 time: 0.137722 Oct 19 04:58:07.064878 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3977/8429] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:58:06 2022] GET /compute/v2.1/servers/d70be658-192f-4b01-93b9-c831c9df7797 => generated 1248 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:58:08.088257 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-3d37f389-adc9-44e9-8220-9dfbc01b5364 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:58:08.089004 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-3d37f389-adc9-44e9-8220-9dfbc01b5364 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] [instance: d70be658-192f-4b01-93b9-c831c9df7797] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:58:08.096201 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3d37f389-adc9-44e9-8220-9dfbc01b5364 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:58:08.096712 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3d37f389-adc9-44e9-8220-9dfbc01b5364 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:58:08.097174 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3d37f389-adc9-44e9-8220-9dfbc01b5364 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:58:08.098041 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3d37f389-adc9-44e9-8220-9dfbc01b5364 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:58:08.098520 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3d37f389-adc9-44e9-8220-9dfbc01b5364 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:58:08.098966 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-3d37f389-adc9-44e9-8220-9dfbc01b5364 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:58:08.164376 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-3d37f389-adc9-44e9-8220-9dfbc01b5364 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578bec46d60497b9118124bd566490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1d6461bf1e4cab9d25f44a7336b482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:58:08.173006 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-3d37f389-adc9-44e9-8220-9dfbc01b5364 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] 10.222.0.52 "GET /compute/v2.1/servers/d70be658-192f-4b01-93b9-c831c9df7797" status: 200 len: 1252 microversion: 2.1 time: 0.089700 Oct 19 04:58:08.173995 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4453/8430] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:58:08 2022] GET /compute/v2.1/servers/d70be658-192f-4b01-93b9-c831c9df7797 => generated 1252 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:58:08.234696 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-3faa60fe-764d-4cd9-8477-cc58f3b98928 req-9e35bfd5-6990-4fe7-bbbe-77142fe0b002 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5b743c2-0631-4b52-81d0-820260bf382f", "name": "network-vif-unplugged", "status": "completed", "tag": "a5dfecd6-25ee-445c-ad0e-e2cbc8ed3588"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:58:08.244797 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-3faa60fe-764d-4cd9-8477-cc58f3b98928 req-9e35bfd5-6990-4fe7-bbbe-77142fe0b002 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:58:08.245275 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-3faa60fe-764d-4cd9-8477-cc58f3b98928 req-9e35bfd5-6990-4fe7-bbbe-77142fe0b002 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:58:08.245734 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-3faa60fe-764d-4cd9-8477-cc58f3b98928 req-9e35bfd5-6990-4fe7-bbbe-77142fe0b002 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:58:08.256866 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-3faa60fe-764d-4cd9-8477-cc58f3b98928 req-9e35bfd5-6990-4fe7-bbbe-77142fe0b002 service nova] Creating event network-vif-unplugged:a5dfecd6-25ee-445c-ad0e-e2cbc8ed3588 for instance c5b743c2-0631-4b52-81d0-820260bf382f on n-h2-861333-8 Oct 19 04:58:08.263005 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-3faa60fe-764d-4cd9-8477-cc58f3b98928 req-9e35bfd5-6990-4fe7-bbbe-77142fe0b002 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.093734 Oct 19 04:58:08.264182 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3978/8431] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:58:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 04:58:09.195386 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-8ac49030-0c3e-44dd-9821-7ce403796e6f tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:58:09.196057 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-8ac49030-0c3e-44dd-9821-7ce403796e6f tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] [instance: d70be658-192f-4b01-93b9-c831c9df7797] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:58:09.202920 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8ac49030-0c3e-44dd-9821-7ce403796e6f tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:58:09.203441 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8ac49030-0c3e-44dd-9821-7ce403796e6f tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:58:09.203901 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8ac49030-0c3e-44dd-9821-7ce403796e6f tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:58:09.205136 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8ac49030-0c3e-44dd-9821-7ce403796e6f tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:58:09.205674 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8ac49030-0c3e-44dd-9821-7ce403796e6f tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:58:09.206127 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-8ac49030-0c3e-44dd-9821-7ce403796e6f tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:58:09.288337 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-8ac49030-0c3e-44dd-9821-7ce403796e6f tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578bec46d60497b9118124bd566490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1d6461bf1e4cab9d25f44a7336b482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:58:09.296402 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-8ac49030-0c3e-44dd-9821-7ce403796e6f tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] 10.222.0.52 "GET /compute/v2.1/servers/d70be658-192f-4b01-93b9-c831c9df7797" status: 200 len: 1308 microversion: 2.1 time: 0.104944 Oct 19 04:58:09.297192 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4454/8432] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:58:09 2022] GET /compute/v2.1/servers/d70be658-192f-4b01-93b9-c831c9df7797 => generated 1308 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:58:10.320874 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-1669f05b-320a-4e18-aae1-865dd11266e4 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:58:10.322292 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-1669f05b-320a-4e18-aae1-865dd11266e4 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] [instance: d70be658-192f-4b01-93b9-c831c9df7797] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:58:10.338794 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1669f05b-320a-4e18-aae1-865dd11266e4 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:58:10.340098 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1669f05b-320a-4e18-aae1-865dd11266e4 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:58:10.340761 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1669f05b-320a-4e18-aae1-865dd11266e4 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:58:10.342030 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1669f05b-320a-4e18-aae1-865dd11266e4 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:58:10.343264 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1669f05b-320a-4e18-aae1-865dd11266e4 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:58:10.345079 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-1669f05b-320a-4e18-aae1-865dd11266e4 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:58:10.519284 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-1669f05b-320a-4e18-aae1-865dd11266e4 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578bec46d60497b9118124bd566490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1d6461bf1e4cab9d25f44a7336b482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:58:10.527372 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-1669f05b-320a-4e18-aae1-865dd11266e4 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] 10.222.0.52 "GET /compute/v2.1/servers/d70be658-192f-4b01-93b9-c831c9df7797" status: 200 len: 1373 microversion: 2.1 time: 0.211417 Oct 19 04:58:10.528228 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3979/8433] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:58:10 2022] GET /compute/v2.1/servers/d70be658-192f-4b01-93b9-c831c9df7797 => generated 1373 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:58:11.553964 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-248495b9-7e08-4c25-bcda-f9b7b4ffa7c2 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:58:11.555917 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-248495b9-7e08-4c25-bcda-f9b7b4ffa7c2 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] [instance: d70be658-192f-4b01-93b9-c831c9df7797] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:58:11.565312 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-248495b9-7e08-4c25-bcda-f9b7b4ffa7c2 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:58:11.566290 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-248495b9-7e08-4c25-bcda-f9b7b4ffa7c2 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:58:11.566933 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-248495b9-7e08-4c25-bcda-f9b7b4ffa7c2 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:58:11.567972 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-248495b9-7e08-4c25-bcda-f9b7b4ffa7c2 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:58:11.569052 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-248495b9-7e08-4c25-bcda-f9b7b4ffa7c2 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:58:11.569940 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-248495b9-7e08-4c25-bcda-f9b7b4ffa7c2 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:58:11.729309 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-248495b9-7e08-4c25-bcda-f9b7b4ffa7c2 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578bec46d60497b9118124bd566490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1d6461bf1e4cab9d25f44a7336b482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:58:11.739485 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-248495b9-7e08-4c25-bcda-f9b7b4ffa7c2 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] 10.222.0.52 "GET /compute/v2.1/servers/d70be658-192f-4b01-93b9-c831c9df7797" status: 200 len: 1373 microversion: 2.1 time: 0.190107 Oct 19 04:58:11.745192 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4455/8434] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:58:11 2022] GET /compute/v2.1/servers/d70be658-192f-4b01-93b9-c831c9df7797 => generated 1373 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:58:12.769115 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ddf72f01-4ff6-4ba7-b7dc-5a1775c032b1 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:58:12.770563 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ddf72f01-4ff6-4ba7-b7dc-5a1775c032b1 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] [instance: d70be658-192f-4b01-93b9-c831c9df7797] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:58:12.777958 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ddf72f01-4ff6-4ba7-b7dc-5a1775c032b1 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:58:12.778451 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ddf72f01-4ff6-4ba7-b7dc-5a1775c032b1 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:58:12.778897 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ddf72f01-4ff6-4ba7-b7dc-5a1775c032b1 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:58:12.779597 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ddf72f01-4ff6-4ba7-b7dc-5a1775c032b1 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:58:12.780051 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ddf72f01-4ff6-4ba7-b7dc-5a1775c032b1 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:58:12.780481 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ddf72f01-4ff6-4ba7-b7dc-5a1775c032b1 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:58:12.920627 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-ddf72f01-4ff6-4ba7-b7dc-5a1775c032b1 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578bec46d60497b9118124bd566490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1d6461bf1e4cab9d25f44a7336b482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:58:12.929360 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ddf72f01-4ff6-4ba7-b7dc-5a1775c032b1 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] 10.222.0.52 "GET /compute/v2.1/servers/d70be658-192f-4b01-93b9-c831c9df7797" status: 200 len: 1373 microversion: 2.1 time: 0.165110 Oct 19 04:58:12.930011 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3980/8435] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:58:12 2022] GET /compute/v2.1/servers/d70be658-192f-4b01-93b9-c831c9df7797 => generated 1373 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:58:13.955450 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-4bdd503a-ec09-4608-a492-9e807ebba3b6 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:58:13.956187 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-4bdd503a-ec09-4608-a492-9e807ebba3b6 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] [instance: d70be658-192f-4b01-93b9-c831c9df7797] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:58:13.963315 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4bdd503a-ec09-4608-a492-9e807ebba3b6 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:58:13.963828 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4bdd503a-ec09-4608-a492-9e807ebba3b6 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:58:13.964287 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4bdd503a-ec09-4608-a492-9e807ebba3b6 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:58:13.965254 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4bdd503a-ec09-4608-a492-9e807ebba3b6 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:58:13.965969 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4bdd503a-ec09-4608-a492-9e807ebba3b6 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:58:13.966487 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-4bdd503a-ec09-4608-a492-9e807ebba3b6 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:58:14.115137 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-4bdd503a-ec09-4608-a492-9e807ebba3b6 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578bec46d60497b9118124bd566490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1d6461bf1e4cab9d25f44a7336b482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:58:14.129651 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-4bdd503a-ec09-4608-a492-9e807ebba3b6 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] 10.222.0.52 "GET /compute/v2.1/servers/d70be658-192f-4b01-93b9-c831c9df7797" status: 200 len: 1373 microversion: 2.1 time: 0.178392 Oct 19 04:58:14.133412 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4456/8436] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:58:13 2022] GET /compute/v2.1/servers/d70be658-192f-4b01-93b9-c831c9df7797 => generated 1373 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:58:15.154684 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-c7dfa2ad-e828-42f9-8bd5-ef28456c98c2 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:58:15.155409 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-c7dfa2ad-e828-42f9-8bd5-ef28456c98c2 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] [instance: d70be658-192f-4b01-93b9-c831c9df7797] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:58:15.164147 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c7dfa2ad-e828-42f9-8bd5-ef28456c98c2 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:58:15.168384 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c7dfa2ad-e828-42f9-8bd5-ef28456c98c2 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:58:15.168384 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c7dfa2ad-e828-42f9-8bd5-ef28456c98c2 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:58:15.168384 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c7dfa2ad-e828-42f9-8bd5-ef28456c98c2 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:58:15.168384 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c7dfa2ad-e828-42f9-8bd5-ef28456c98c2 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:58:15.168384 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-c7dfa2ad-e828-42f9-8bd5-ef28456c98c2 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:58:15.317859 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-c7dfa2ad-e828-42f9-8bd5-ef28456c98c2 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578bec46d60497b9118124bd566490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1d6461bf1e4cab9d25f44a7336b482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:58:15.331798 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-c7dfa2ad-e828-42f9-8bd5-ef28456c98c2 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] 10.222.0.52 "GET /compute/v2.1/servers/d70be658-192f-4b01-93b9-c831c9df7797" status: 200 len: 1373 microversion: 2.1 time: 0.181820 Oct 19 04:58:15.341757 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3981/8437] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:58:15 2022] GET /compute/v2.1/servers/d70be658-192f-4b01-93b9-c831c9df7797 => generated 1373 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:58:16.359898 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-ac0a3c34-cfee-4d82-84c9-33973ec7f8c7 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:58:16.361016 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-ac0a3c34-cfee-4d82-84c9-33973ec7f8c7 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] [instance: d70be658-192f-4b01-93b9-c831c9df7797] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:58:16.370540 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=2 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:58:16.371587 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell0:SELECT=6 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:58:16.373429 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ac0a3c34-cfee-4d82-84c9-33973ec7f8c7 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:58:16.373962 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ac0a3c34-cfee-4d82-84c9-33973ec7f8c7 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:58:16.374720 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ac0a3c34-cfee-4d82-84c9-33973ec7f8c7 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:58:16.375467 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ac0a3c34-cfee-4d82-84c9-33973ec7f8c7 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:58:16.375967 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ac0a3c34-cfee-4d82-84c9-33973ec7f8c7 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:58:16.376441 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-ac0a3c34-cfee-4d82-84c9-33973ec7f8c7 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:58:16.538608 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-ac0a3c34-cfee-4d82-84c9-33973ec7f8c7 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578bec46d60497b9118124bd566490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1d6461bf1e4cab9d25f44a7336b482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:58:16.548617 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-ac0a3c34-cfee-4d82-84c9-33973ec7f8c7 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] 10.222.0.52 "GET /compute/v2.1/servers/d70be658-192f-4b01-93b9-c831c9df7797" status: 200 len: 1373 microversion: 2.1 time: 0.193559 Oct 19 04:58:16.551138 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4457/8438] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:58:16 2022] GET /compute/v2.1/servers/d70be658-192f-4b01-93b9-c831c9df7797 => generated 1373 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:58:17.572136 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-7689d4c9-d0b1-4268-b6a8-a00566036012 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:58:17.572768 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-7689d4c9-d0b1-4268-b6a8-a00566036012 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] [instance: d70be658-192f-4b01-93b9-c831c9df7797] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:58:17.575692 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell0:SELECT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 04:58:17.580542 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7689d4c9-d0b1-4268-b6a8-a00566036012 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:58:17.581041 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7689d4c9-d0b1-4268-b6a8-a00566036012 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:58:17.581524 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7689d4c9-d0b1-4268-b6a8-a00566036012 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:58:17.582228 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7689d4c9-d0b1-4268-b6a8-a00566036012 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:58:17.582695 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7689d4c9-d0b1-4268-b6a8-a00566036012 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:58:17.583129 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-7689d4c9-d0b1-4268-b6a8-a00566036012 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:58:17.720420 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-7689d4c9-d0b1-4268-b6a8-a00566036012 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578bec46d60497b9118124bd566490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1d6461bf1e4cab9d25f44a7336b482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:58:17.728190 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-7689d4c9-d0b1-4268-b6a8-a00566036012 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] 10.222.0.52 "GET /compute/v2.1/servers/d70be658-192f-4b01-93b9-c831c9df7797" status: 200 len: 1373 microversion: 2.1 time: 0.160002 Oct 19 04:58:17.728782 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3982/8439] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:58:17 2022] GET /compute/v2.1/servers/d70be658-192f-4b01-93b9-c831c9df7797 => generated 1373 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:58:18.751919 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-1574a156-a5e7-4c20-ba9c-a0ae7418cd00 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:58:18.752569 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-1574a156-a5e7-4c20-ba9c-a0ae7418cd00 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] [instance: d70be658-192f-4b01-93b9-c831c9df7797] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:58:18.759452 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1574a156-a5e7-4c20-ba9c-a0ae7418cd00 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:58:18.759948 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1574a156-a5e7-4c20-ba9c-a0ae7418cd00 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:58:18.760427 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1574a156-a5e7-4c20-ba9c-a0ae7418cd00 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:58:18.761129 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1574a156-a5e7-4c20-ba9c-a0ae7418cd00 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:58:18.761645 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1574a156-a5e7-4c20-ba9c-a0ae7418cd00 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:58:18.762089 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-1574a156-a5e7-4c20-ba9c-a0ae7418cd00 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:58:18.894161 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-1574a156-a5e7-4c20-ba9c-a0ae7418cd00 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578bec46d60497b9118124bd566490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1d6461bf1e4cab9d25f44a7336b482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:58:18.901857 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-1574a156-a5e7-4c20-ba9c-a0ae7418cd00 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] 10.222.0.52 "GET /compute/v2.1/servers/d70be658-192f-4b01-93b9-c831c9df7797" status: 200 len: 1373 microversion: 2.1 time: 0.154374 Oct 19 04:58:18.902451 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4458/8440] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:58:18 2022] GET /compute/v2.1/servers/d70be658-192f-4b01-93b9-c831c9df7797 => generated 1373 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:58:19.924302 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-72a6bc88-24b3-4414-90ba-b3681793827c tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:58:19.924919 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-72a6bc88-24b3-4414-90ba-b3681793827c tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] [instance: d70be658-192f-4b01-93b9-c831c9df7797] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:58:19.931737 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-72a6bc88-24b3-4414-90ba-b3681793827c tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:58:19.932228 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-72a6bc88-24b3-4414-90ba-b3681793827c tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:58:19.932667 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-72a6bc88-24b3-4414-90ba-b3681793827c tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:58:19.933360 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-72a6bc88-24b3-4414-90ba-b3681793827c tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:58:19.933837 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-72a6bc88-24b3-4414-90ba-b3681793827c tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:58:19.934267 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-72a6bc88-24b3-4414-90ba-b3681793827c tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:58:20.084678 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-72a6bc88-24b3-4414-90ba-b3681793827c tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578bec46d60497b9118124bd566490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1d6461bf1e4cab9d25f44a7336b482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:58:20.092549 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-72a6bc88-24b3-4414-90ba-b3681793827c tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] 10.222.0.52 "GET /compute/v2.1/servers/d70be658-192f-4b01-93b9-c831c9df7797" status: 200 len: 1373 microversion: 2.1 time: 0.172246 Oct 19 04:58:20.093057 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3983/8441] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:58:19 2022] GET /compute/v2.1/servers/d70be658-192f-4b01-93b9-c831c9df7797 => generated 1373 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:58:20.216144 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-f53d7654-7f4a-43d9-b917-a089fa54cefa req-ae240198-3b6c-4c09-9df1-0406f7ad137d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d70be658-192f-4b01-93b9-c831c9df7797", "tag": "0a00d28f-d596-4f5f-abe6-2f8d7a70ab5c"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:58:20.225685 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-f53d7654-7f4a-43d9-b917-a089fa54cefa req-ae240198-3b6c-4c09-9df1-0406f7ad137d service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:58:20.226187 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-f53d7654-7f4a-43d9-b917-a089fa54cefa req-ae240198-3b6c-4c09-9df1-0406f7ad137d service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:58:20.226808 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-f53d7654-7f4a-43d9-b917-a089fa54cefa req-ae240198-3b6c-4c09-9df1-0406f7ad137d service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:58:20.237828 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-f53d7654-7f4a-43d9-b917-a089fa54cefa req-ae240198-3b6c-4c09-9df1-0406f7ad137d service nova] Creating event network-changed:0a00d28f-d596-4f5f-abe6-2f8d7a70ab5c for instance d70be658-192f-4b01-93b9-c831c9df7797 on n-h1-861333-8 Oct 19 04:58:20.242632 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-f53d7654-7f4a-43d9-b917-a089fa54cefa req-ae240198-3b6c-4c09-9df1-0406f7ad137d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090569 Oct 19 04:58:20.243225 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4459/8442] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:58:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 04:58:21.116416 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-cfd3848e-a32f-468b-b949-4f3b5e99057e tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:58:21.117038 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-cfd3848e-a32f-468b-b949-4f3b5e99057e tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] [instance: d70be658-192f-4b01-93b9-c831c9df7797] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:58:21.124018 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cfd3848e-a32f-468b-b949-4f3b5e99057e tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:58:21.124446 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cfd3848e-a32f-468b-b949-4f3b5e99057e tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:58:21.124894 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cfd3848e-a32f-468b-b949-4f3b5e99057e tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:58:21.125629 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cfd3848e-a32f-468b-b949-4f3b5e99057e tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:58:21.126091 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cfd3848e-a32f-468b-b949-4f3b5e99057e tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:58:21.126523 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-cfd3848e-a32f-468b-b949-4f3b5e99057e tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:58:21.260080 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-cfd3848e-a32f-468b-b949-4f3b5e99057e tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578bec46d60497b9118124bd566490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1d6461bf1e4cab9d25f44a7336b482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:58:21.268922 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-cfd3848e-a32f-468b-b949-4f3b5e99057e tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] 10.222.0.52 "GET /compute/v2.1/servers/d70be658-192f-4b01-93b9-c831c9df7797" status: 200 len: 1373 microversion: 2.1 time: 0.157277 Oct 19 04:58:21.269566 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3984/8443] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:58:21 2022] GET /compute/v2.1/servers/d70be658-192f-4b01-93b9-c831c9df7797 => generated 1373 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:58:22.294485 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-52d23d0a-1e23-4e05-a312-175345773236 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:58:22.295213 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-52d23d0a-1e23-4e05-a312-175345773236 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] [instance: d70be658-192f-4b01-93b9-c831c9df7797] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:58:22.302904 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-52d23d0a-1e23-4e05-a312-175345773236 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:58:22.303412 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-52d23d0a-1e23-4e05-a312-175345773236 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:58:22.303871 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-52d23d0a-1e23-4e05-a312-175345773236 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:58:22.304587 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-52d23d0a-1e23-4e05-a312-175345773236 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:58:22.305102 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-52d23d0a-1e23-4e05-a312-175345773236 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:58:22.305588 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-52d23d0a-1e23-4e05-a312-175345773236 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:58:22.443128 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-52d23d0a-1e23-4e05-a312-175345773236 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578bec46d60497b9118124bd566490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1d6461bf1e4cab9d25f44a7336b482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:58:22.450916 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-52d23d0a-1e23-4e05-a312-175345773236 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] 10.222.0.52 "GET /compute/v2.1/servers/d70be658-192f-4b01-93b9-c831c9df7797" status: 200 len: 1373 microversion: 2.1 time: 0.162234 Oct 19 04:58:22.451501 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4460/8444] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:58:22 2022] GET /compute/v2.1/servers/d70be658-192f-4b01-93b9-c831c9df7797 => generated 1373 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:58:23.476399 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-9c4f3076-b7e2-4853-8744-28478d264491 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:58:23.477666 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-9c4f3076-b7e2-4853-8744-28478d264491 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] [instance: d70be658-192f-4b01-93b9-c831c9df7797] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:58:23.484851 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9c4f3076-b7e2-4853-8744-28478d264491 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:58:23.485426 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9c4f3076-b7e2-4853-8744-28478d264491 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:58:23.485884 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9c4f3076-b7e2-4853-8744-28478d264491 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:58:23.486987 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9c4f3076-b7e2-4853-8744-28478d264491 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:58:23.487108 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9c4f3076-b7e2-4853-8744-28478d264491 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:58:23.487491 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-9c4f3076-b7e2-4853-8744-28478d264491 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:58:23.710845 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-9c4f3076-b7e2-4853-8744-28478d264491 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578bec46d60497b9118124bd566490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1d6461bf1e4cab9d25f44a7336b482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:58:23.718572 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-9c4f3076-b7e2-4853-8744-28478d264491 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] 10.222.0.52 "GET /compute/v2.1/servers/d70be658-192f-4b01-93b9-c831c9df7797" status: 200 len: 1373 microversion: 2.1 time: 0.248935 Oct 19 04:58:23.719156 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3985/8445] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:58:23 2022] GET /compute/v2.1/servers/d70be658-192f-4b01-93b9-c831c9df7797 => generated 1373 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:58:24.742609 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c10fc879-2174-4761-9a50-b897a029cba9 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:58:24.743246 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c10fc879-2174-4761-9a50-b897a029cba9 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] [instance: d70be658-192f-4b01-93b9-c831c9df7797] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:58:24.750162 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c10fc879-2174-4761-9a50-b897a029cba9 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:58:24.750666 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c10fc879-2174-4761-9a50-b897a029cba9 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:58:24.751122 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c10fc879-2174-4761-9a50-b897a029cba9 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:58:24.751877 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c10fc879-2174-4761-9a50-b897a029cba9 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:58:24.752356 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c10fc879-2174-4761-9a50-b897a029cba9 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:58:24.752803 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c10fc879-2174-4761-9a50-b897a029cba9 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:58:24.886041 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c10fc879-2174-4761-9a50-b897a029cba9 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578bec46d60497b9118124bd566490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1d6461bf1e4cab9d25f44a7336b482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:58:24.894160 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c10fc879-2174-4761-9a50-b897a029cba9 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] 10.222.0.52 "GET /compute/v2.1/servers/d70be658-192f-4b01-93b9-c831c9df7797" status: 200 len: 1373 microversion: 2.1 time: 0.155494 Oct 19 04:58:24.894726 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4461/8446] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:58:24 2022] GET /compute/v2.1/servers/d70be658-192f-4b01-93b9-c831c9df7797 => generated 1373 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:58:25.557420 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [req-6c6f9b7e-5621-40d7-9356-f5b426465ed4 req-c0688bf7-bb84-4400-aae2-9b1d92659635 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d70be658-192f-4b01-93b9-c831c9df7797", "name": "network-vif-plugged", "status": "completed", "tag": "0a00d28f-d596-4f5f-abe6-2f8d7a70ab5c"}]} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:58:25.568639 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-6c6f9b7e-5621-40d7-9356-f5b426465ed4 req-c0688bf7-bb84-4400-aae2-9b1d92659635 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:58:25.569127 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-6c6f9b7e-5621-40d7-9356-f5b426465ed4 req-c0688bf7-bb84-4400-aae2-9b1d92659635 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:58:25.569600 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [req-6c6f9b7e-5621-40d7-9356-f5b426465ed4 req-c0688bf7-bb84-4400-aae2-9b1d92659635 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:58:25.581397 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.compute.server_external_events [req-6c6f9b7e-5621-40d7-9356-f5b426465ed4 req-c0688bf7-bb84-4400-aae2-9b1d92659635 service nova] Creating event network-vif-plugged:0a00d28f-d596-4f5f-abe6-2f8d7a70ab5c for instance d70be658-192f-4b01-93b9-c831c9df7797 on n-h1-861333-8 Oct 19 04:58:25.586635 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [req-6c6f9b7e-5621-40d7-9356-f5b426465ed4 req-c0688bf7-bb84-4400-aae2-9b1d92659635 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033157 Oct 19 04:58:25.587262 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3986/8447] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:58:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 04:58:25.917324 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c3a5d33f-4e09-48e3-bc8f-4dd99fa9ba53 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:58:25.917999 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c3a5d33f-4e09-48e3-bc8f-4dd99fa9ba53 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] [instance: d70be658-192f-4b01-93b9-c831c9df7797] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:58:25.925325 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c3a5d33f-4e09-48e3-bc8f-4dd99fa9ba53 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:58:25.925860 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c3a5d33f-4e09-48e3-bc8f-4dd99fa9ba53 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:58:25.926329 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c3a5d33f-4e09-48e3-bc8f-4dd99fa9ba53 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:58:25.927041 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c3a5d33f-4e09-48e3-bc8f-4dd99fa9ba53 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:58:25.927517 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c3a5d33f-4e09-48e3-bc8f-4dd99fa9ba53 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:58:25.927965 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c3a5d33f-4e09-48e3-bc8f-4dd99fa9ba53 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:58:26.061450 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c3a5d33f-4e09-48e3-bc8f-4dd99fa9ba53 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578bec46d60497b9118124bd566490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1d6461bf1e4cab9d25f44a7336b482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:58:26.069337 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c3a5d33f-4e09-48e3-bc8f-4dd99fa9ba53 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] 10.222.0.52 "GET /compute/v2.1/servers/d70be658-192f-4b01-93b9-c831c9df7797" status: 200 len: 1373 microversion: 2.1 time: 0.155968 Oct 19 04:58:26.071051 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4462/8448] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:58:25 2022] GET /compute/v2.1/servers/d70be658-192f-4b01-93b9-c831c9df7797 => generated 1373 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:58:27.093518 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-068b91a4-0655-4c95-8e90-c34330bdea44 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:58:27.094294 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-068b91a4-0655-4c95-8e90-c34330bdea44 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] [instance: d70be658-192f-4b01-93b9-c831c9df7797] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:58:27.100524 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-068b91a4-0655-4c95-8e90-c34330bdea44 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:58:27.101019 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-068b91a4-0655-4c95-8e90-c34330bdea44 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:58:27.101488 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-068b91a4-0655-4c95-8e90-c34330bdea44 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:58:27.102183 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-068b91a4-0655-4c95-8e90-c34330bdea44 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:58:27.102648 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-068b91a4-0655-4c95-8e90-c34330bdea44 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:58:27.103079 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-068b91a4-0655-4c95-8e90-c34330bdea44 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:58:27.244774 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-068b91a4-0655-4c95-8e90-c34330bdea44 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578bec46d60497b9118124bd566490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1d6461bf1e4cab9d25f44a7336b482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:58:27.253107 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-068b91a4-0655-4c95-8e90-c34330bdea44 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] 10.222.0.52 "GET /compute/v2.1/servers/d70be658-192f-4b01-93b9-c831c9df7797" status: 200 len: 1373 microversion: 2.1 time: 0.164765 Oct 19 04:58:27.253733 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3987/8449] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:58:27 2022] GET /compute/v2.1/servers/d70be658-192f-4b01-93b9-c831c9df7797 => generated 1373 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:58:28.276492 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-062d3d74-bb9c-42ea-945c-7a88c6a492fb tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:58:28.277296 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-062d3d74-bb9c-42ea-945c-7a88c6a492fb tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] [instance: d70be658-192f-4b01-93b9-c831c9df7797] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:58:28.285241 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-062d3d74-bb9c-42ea-945c-7a88c6a492fb tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:58:28.285778 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-062d3d74-bb9c-42ea-945c-7a88c6a492fb tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:58:28.286374 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-062d3d74-bb9c-42ea-945c-7a88c6a492fb tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:58:28.287089 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-062d3d74-bb9c-42ea-945c-7a88c6a492fb tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:58:28.287568 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-062d3d74-bb9c-42ea-945c-7a88c6a492fb tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:58:28.288018 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-062d3d74-bb9c-42ea-945c-7a88c6a492fb tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:58:28.420975 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-062d3d74-bb9c-42ea-945c-7a88c6a492fb tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578bec46d60497b9118124bd566490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1d6461bf1e4cab9d25f44a7336b482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:58:28.429498 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-062d3d74-bb9c-42ea-945c-7a88c6a492fb tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] 10.222.0.52 "GET /compute/v2.1/servers/d70be658-192f-4b01-93b9-c831c9df7797" status: 200 len: 1559 microversion: 2.1 time: 0.156985 Oct 19 04:58:28.430082 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4463/8450] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:58:28 2022] GET /compute/v2.1/servers/d70be658-192f-4b01-93b9-c831c9df7797 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:58:28.451896 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-d7b91a15-5d81-4856-a8b4-5ff988bcf2ba tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 04:58:28.452526 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-d7b91a15-5d81-4856-a8b4-5ff988bcf2ba tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] [instance: d70be658-192f-4b01-93b9-c831c9df7797] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 04:58:28.459466 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d7b91a15-5d81-4856-a8b4-5ff988bcf2ba tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:58:28.459963 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d7b91a15-5d81-4856-a8b4-5ff988bcf2ba tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:58:28.460414 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d7b91a15-5d81-4856-a8b4-5ff988bcf2ba tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:58:28.461119 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d7b91a15-5d81-4856-a8b4-5ff988bcf2ba tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:58:28.461614 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d7b91a15-5d81-4856-a8b4-5ff988bcf2ba tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:58:28.462055 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-d7b91a15-5d81-4856-a8b4-5ff988bcf2ba tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:58:28.596315 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-d7b91a15-5d81-4856-a8b4-5ff988bcf2ba tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578bec46d60497b9118124bd566490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1d6461bf1e4cab9d25f44a7336b482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 04:58:28.604247 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-d7b91a15-5d81-4856-a8b4-5ff988bcf2ba tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] 10.222.0.52 "GET /compute/v2.1/servers/d70be658-192f-4b01-93b9-c831c9df7797" status: 200 len: 1559 microversion: 2.1 time: 0.156301 Oct 19 04:58:28.604830 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3988/8451] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 04:58:28 2022] GET /compute/v2.1/servers/d70be658-192f-4b01-93b9-c831c9df7797 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 04:58:30.477133 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-72c0c30a-25b0-42da-b883-354db4d54750 req-edb5fc43-af25-4b47-8caf-90038193e4f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d70be658-192f-4b01-93b9-c831c9df7797", "tag": "0a00d28f-d596-4f5f-abe6-2f8d7a70ab5c"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 04:58:30.487040 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-72c0c30a-25b0-42da-b883-354db4d54750 req-edb5fc43-af25-4b47-8caf-90038193e4f9 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 04:58:30.487621 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-72c0c30a-25b0-42da-b883-354db4d54750 req-edb5fc43-af25-4b47-8caf-90038193e4f9 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 04:58:30.488147 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-72c0c30a-25b0-42da-b883-354db4d54750 req-edb5fc43-af25-4b47-8caf-90038193e4f9 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 04:58:30.499617 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-72c0c30a-25b0-42da-b883-354db4d54750 req-edb5fc43-af25-4b47-8caf-90038193e4f9 service nova] Creating event network-changed:0a00d28f-d596-4f5f-abe6-2f8d7a70ab5c for instance d70be658-192f-4b01-93b9-c831c9df7797 on n-h1-861333-8 Oct 19 04:58:30.505292 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-72c0c30a-25b0-42da-b883-354db4d54750 req-edb5fc43-af25-4b47-8caf-90038193e4f9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032514 Oct 19 04:58:30.506032 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4464/8452] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 04:58:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 05:00:33.684317 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=28 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 05:00:33.685546 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=60 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 05:00:33.750515 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f49bbd74-36b2-4968-a3f9-027c579af38a tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-417459602"}} {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 05:00:33.752919 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f49bbd74-36b2-4968-a3f9-027c579af38a tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] [instance: d70be658-192f-4b01-93b9-c831c9df7797] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 05:00:33.760151 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f49bbd74-36b2-4968-a3f9-027c579af38a tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 05:00:33.760647 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f49bbd74-36b2-4968-a3f9-027c579af38a tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 05:00:33.761091 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f49bbd74-36b2-4968-a3f9-027c579af38a tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 05:00:33.761815 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f49bbd74-36b2-4968-a3f9-027c579af38a tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 05:00:33.762278 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f49bbd74-36b2-4968-a3f9-027c579af38a tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 05:00:33.762709 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f49bbd74-36b2-4968-a3f9-027c579af38a tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 05:00:34.152011 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f49bbd74-36b2-4968-a3f9-027c579af38a tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] 10.222.0.52 "POST /compute/v2.1/servers/d70be658-192f-4b01-93b9-c831c9df7797/action" status: 202 len: 0 microversion: 2.1 time: 0.469580 Oct 19 05:00:34.152678 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3989/8453] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 19 05:00:33 2022] POST /compute/v2.1/servers/d70be658-192f-4b01-93b9-c831c9df7797/action => generated 0 bytes in 471 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 19 05:00:42.165844 n-d-861333-8 devstack@n-api.service[121134]: ERROR oslo.messaging._drivers.impl_rabbit [-] [96947759-862b-4b0f-b2e1-828b2ec3f179] AMQP server on 10.222.0.52:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 19 05:00:42.167360 n-d-861333-8 devstack@n-api.service[121134]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1a02a1d9-5473-4a0a-ab8b-e198030a9897] AMQP server on 10.222.0.52:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 19 05:00:42.168165 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 05:00:42.168940 n-d-861333-8 devstack@n-api.service[121134]: DEBUG dbcounter [-] [121134] Writing DB stats nova_cell1:SELECT=66 {{(pid=121134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 05:00:42.169938 n-d-861333-8 devstack@n-api.service[121134]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 19 05:00:42.170085 n-d-861333-8 devstack@n-api.service[121134]: Wed Oct 19 05:00:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.52) !!! Oct 19 05:00:42.176154 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-764f0f1f-46d6-4e70-bb49-ff993eeaaf31 req-a5c7274f-3c5b-49c9-9d28-0eb0c4161e51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d70be658-192f-4b01-93b9-c831c9df7797", "name": "network-vif-plugged", "status": "completed", "tag": "0a00d28f-d596-4f5f-abe6-2f8d7a70ab5c"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 05:00:42.187339 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-764f0f1f-46d6-4e70-bb49-ff993eeaaf31 req-a5c7274f-3c5b-49c9-9d28-0eb0c4161e51 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 05:00:42.187829 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-764f0f1f-46d6-4e70-bb49-ff993eeaaf31 req-a5c7274f-3c5b-49c9-9d28-0eb0c4161e51 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 05:00:42.188279 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-764f0f1f-46d6-4e70-bb49-ff993eeaaf31 req-a5c7274f-3c5b-49c9-9d28-0eb0c4161e51 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 05:00:42.198879 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-764f0f1f-46d6-4e70-bb49-ff993eeaaf31 req-a5c7274f-3c5b-49c9-9d28-0eb0c4161e51 service nova] Creating event network-vif-plugged:0a00d28f-d596-4f5f-abe6-2f8d7a70ab5c for instance d70be658-192f-4b01-93b9-c831c9df7797 on n-h1-861333-8 Oct 19 05:00:42.204586 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-764f0f1f-46d6-4e70-bb49-ff993eeaaf31 req-a5c7274f-3c5b-49c9-9d28-0eb0c4161e51 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040550 Oct 19 05:00:42.209411 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4465/8454] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 05:00:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 05:00:55.782876 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_api:SELECT=2 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 05:00:55.782876 n-d-861333-8 devstack@n-api.service[121135]: DEBUG dbcounter [-] [121135] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 05:00:55.794470 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b1092bb9-7d3f-409e-940a-a18b490bf5a6 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 05:00:55.794625 n-d-861333-8 devstack@n-api.service[121134]: INFO oslo.messaging._drivers.impl_rabbit [-] [1a02a1d9-5473-4a0a-ab8b-e198030a9897] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 38358. Oct 19 05:00:55.795352 n-d-861333-8 devstack@n-api.service[121134]: INFO oslo.messaging._drivers.impl_rabbit [-] [96947759-862b-4b0f-b2e1-828b2ec3f179] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 38356. Oct 19 05:00:55.796599 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b1092bb9-7d3f-409e-940a-a18b490bf5a6 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] [instance: d70be658-192f-4b01-93b9-c831c9df7797] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 05:00:55.803247 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b1092bb9-7d3f-409e-940a-a18b490bf5a6 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 05:00:55.804405 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b1092bb9-7d3f-409e-940a-a18b490bf5a6 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 05:00:55.804853 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b1092bb9-7d3f-409e-940a-a18b490bf5a6 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 05:00:55.805871 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b1092bb9-7d3f-409e-940a-a18b490bf5a6 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 05:00:55.806599 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b1092bb9-7d3f-409e-940a-a18b490bf5a6 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 05:00:55.807033 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b1092bb9-7d3f-409e-940a-a18b490bf5a6 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 05:00:55.834950 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b1092bb9-7d3f-409e-940a-a18b490bf5a6 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] [instance: d70be658-192f-4b01-93b9-c831c9df7797] Going to try to terminate instance {{(pid=121135) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 05:00:55.846977 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-c215881a-dcc8-451c-b24f-ea5192ba4a4e req-d49a38b1-9349-4bf0-963e-ecc332d3b9c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d70be658-192f-4b01-93b9-c831c9df7797", "tag": "0a00d28f-d596-4f5f-abe6-2f8d7a70ab5c"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 05:00:55.861506 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-c215881a-dcc8-451c-b24f-ea5192ba4a4e req-d49a38b1-9349-4bf0-963e-ecc332d3b9c0 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 05:00:55.862014 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-c215881a-dcc8-451c-b24f-ea5192ba4a4e req-d49a38b1-9349-4bf0-963e-ecc332d3b9c0 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 05:00:55.862468 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-c215881a-dcc8-451c-b24f-ea5192ba4a4e req-d49a38b1-9349-4bf0-963e-ecc332d3b9c0 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 05:00:55.874510 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-c215881a-dcc8-451c-b24f-ea5192ba4a4e req-d49a38b1-9349-4bf0-963e-ecc332d3b9c0 service nova] Creating event network-changed:0a00d28f-d596-4f5f-abe6-2f8d7a70ab5c for instance d70be658-192f-4b01-93b9-c831c9df7797 on n-h1-861333-8 Oct 19 05:00:55.879794 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-c215881a-dcc8-451c-b24f-ea5192ba4a4e req-d49a38b1-9349-4bf0-963e-ecc332d3b9c0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100477 Oct 19 05:00:55.884522 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4466/8455] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 05:00:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 05:00:56.165153 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b1092bb9-7d3f-409e-940a-a18b490bf5a6 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] 10.222.0.52 "DELETE /compute/v2.1/servers/d70be658-192f-4b01-93b9-c831c9df7797" status: 204 len: 0 microversion: 2.1 time: 0.388220 Oct 19 05:00:56.166199 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3990/8456] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 05:00:55 2022] DELETE /compute/v2.1/servers/d70be658-192f-4b01-93b9-c831c9df7797 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 05:00:56.175813 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-c104c341-ec73-4cc5-88b1-a6bfe6949710 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 05:00:56.176550 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-c104c341-ec73-4cc5-88b1-a6bfe6949710 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] [instance: d70be658-192f-4b01-93b9-c831c9df7797] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 05:00:56.183967 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c104c341-ec73-4cc5-88b1-a6bfe6949710 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 05:00:56.184596 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c104c341-ec73-4cc5-88b1-a6bfe6949710 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 05:00:56.185063 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c104c341-ec73-4cc5-88b1-a6bfe6949710 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 05:00:56.185838 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c104c341-ec73-4cc5-88b1-a6bfe6949710 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 05:00:56.186315 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c104c341-ec73-4cc5-88b1-a6bfe6949710 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 05:00:56.186771 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-c104c341-ec73-4cc5-88b1-a6bfe6949710 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 05:00:56.325527 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-c104c341-ec73-4cc5-88b1-a6bfe6949710 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578bec46d60497b9118124bd566490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1d6461bf1e4cab9d25f44a7336b482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 05:00:56.333634 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-c104c341-ec73-4cc5-88b1-a6bfe6949710 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] 10.222.0.52 "GET /compute/v2.1/servers/d70be658-192f-4b01-93b9-c831c9df7797" status: 200 len: 1684 microversion: 2.1 time: 0.162699 Oct 19 05:00:56.334164 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4467/8457] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 05:00:56 2022] GET /compute/v2.1/servers/d70be658-192f-4b01-93b9-c831c9df7797 => generated 1684 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 05:00:57.359269 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-10d0c52c-8f89-442b-9662-ecc60ff91d18 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 05:00:57.359993 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-10d0c52c-8f89-442b-9662-ecc60ff91d18 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] [instance: d70be658-192f-4b01-93b9-c831c9df7797] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 05:00:57.367466 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-10d0c52c-8f89-442b-9662-ecc60ff91d18 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 05:00:57.367960 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-10d0c52c-8f89-442b-9662-ecc60ff91d18 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 05:00:57.368464 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-10d0c52c-8f89-442b-9662-ecc60ff91d18 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 05:00:57.369106 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-10d0c52c-8f89-442b-9662-ecc60ff91d18 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 05:00:57.369593 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-10d0c52c-8f89-442b-9662-ecc60ff91d18 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 05:00:57.370076 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-10d0c52c-8f89-442b-9662-ecc60ff91d18 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 05:00:57.510566 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-10d0c52c-8f89-442b-9662-ecc60ff91d18 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578bec46d60497b9118124bd566490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1d6461bf1e4cab9d25f44a7336b482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 05:00:57.518417 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-10d0c52c-8f89-442b-9662-ecc60ff91d18 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] 10.222.0.52 "GET /compute/v2.1/servers/d70be658-192f-4b01-93b9-c831c9df7797" status: 200 len: 1684 microversion: 2.1 time: 0.163476 Oct 19 05:00:57.518999 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3991/8458] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 05:00:57 2022] GET /compute/v2.1/servers/d70be658-192f-4b01-93b9-c831c9df7797 => generated 1684 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 05:00:58.233283 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-108477f8-eeec-4972-8e76-e6253522ca06 req-ce352e80-77af-4497-aff8-3a7e931cdd35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d70be658-192f-4b01-93b9-c831c9df7797", "name": "network-vif-unplugged", "status": "completed", "tag": "0a00d28f-d596-4f5f-abe6-2f8d7a70ab5c"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 05:00:58.244550 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-108477f8-eeec-4972-8e76-e6253522ca06 req-ce352e80-77af-4497-aff8-3a7e931cdd35 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 05:00:58.245056 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-108477f8-eeec-4972-8e76-e6253522ca06 req-ce352e80-77af-4497-aff8-3a7e931cdd35 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 05:00:58.245536 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-108477f8-eeec-4972-8e76-e6253522ca06 req-ce352e80-77af-4497-aff8-3a7e931cdd35 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 05:00:58.257600 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-108477f8-eeec-4972-8e76-e6253522ca06 req-ce352e80-77af-4497-aff8-3a7e931cdd35 service nova] Creating event network-vif-unplugged:0a00d28f-d596-4f5f-abe6-2f8d7a70ab5c for instance d70be658-192f-4b01-93b9-c831c9df7797 on n-h1-861333-8 Oct 19 05:00:58.263410 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-108477f8-eeec-4972-8e76-e6253522ca06 req-ce352e80-77af-4497-aff8-3a7e931cdd35 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033544 Oct 19 05:00:58.264016 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4468/8459] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 05:00:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 05:00:58.542872 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-f41cfa8e-dd24-4c89-90c7-77f2d0249b64 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 05:00:58.543432 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-f41cfa8e-dd24-4c89-90c7-77f2d0249b64 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] [instance: d70be658-192f-4b01-93b9-c831c9df7797] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 05:00:58.545686 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-f0a4e808-e882-43dd-b02a-dcadd03232b4 req-f2c72249-275c-4f5b-bf5d-63ee44685931 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d70be658-192f-4b01-93b9-c831c9df7797", "name": "network-vif-deleted", "tag": "0a00d28f-d596-4f5f-abe6-2f8d7a70ab5c"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 05:00:58.550114 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f41cfa8e-dd24-4c89-90c7-77f2d0249b64 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 05:00:58.550609 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f41cfa8e-dd24-4c89-90c7-77f2d0249b64 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 05:00:58.551075 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f41cfa8e-dd24-4c89-90c7-77f2d0249b64 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 05:00:58.551756 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f41cfa8e-dd24-4c89-90c7-77f2d0249b64 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 05:00:58.553017 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f41cfa8e-dd24-4c89-90c7-77f2d0249b64 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 05:00:58.553980 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-f41cfa8e-dd24-4c89-90c7-77f2d0249b64 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 05:00:58.557041 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-f0a4e808-e882-43dd-b02a-dcadd03232b4 req-f2c72249-275c-4f5b-bf5d-63ee44685931 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 05:00:58.557041 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-f0a4e808-e882-43dd-b02a-dcadd03232b4 req-f2c72249-275c-4f5b-bf5d-63ee44685931 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 05:00:58.557307 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-f0a4e808-e882-43dd-b02a-dcadd03232b4 req-f2c72249-275c-4f5b-bf5d-63ee44685931 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 05:00:58.568280 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-f0a4e808-e882-43dd-b02a-dcadd03232b4 req-f2c72249-275c-4f5b-bf5d-63ee44685931 service nova] Creating event network-vif-deleted:0a00d28f-d596-4f5f-abe6-2f8d7a70ab5c for instance d70be658-192f-4b01-93b9-c831c9df7797 on n-h1-861333-8 Oct 19 05:00:58.574265 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-f0a4e808-e882-43dd-b02a-dcadd03232b4 req-f2c72249-275c-4f5b-bf5d-63ee44685931 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032665 Oct 19 05:00:58.574929 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4469/8460] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 05:00:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 05:00:58.618327 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-f41cfa8e-dd24-4c89-90c7-77f2d0249b64 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578bec46d60497b9118124bd566490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1d6461bf1e4cab9d25f44a7336b482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 05:00:58.626202 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-f41cfa8e-dd24-4c89-90c7-77f2d0249b64 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] 10.222.0.52 "GET /compute/v2.1/servers/d70be658-192f-4b01-93b9-c831c9df7797" status: 200 len: 1498 microversion: 2.1 time: 0.087425 Oct 19 05:00:58.626785 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3992/8461] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 05:00:58 2022] GET /compute/v2.1/servers/d70be658-192f-4b01-93b9-c831c9df7797 => generated 1498 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 05:00:59.651867 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b39eb823-96c0-432d-b28f-6df58631a7a3 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 05:00:59.652545 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-b39eb823-96c0-432d-b28f-6df58631a7a3 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] [instance: d70be658-192f-4b01-93b9-c831c9df7797] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 05:00:59.658937 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b39eb823-96c0-432d-b28f-6df58631a7a3 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 05:00:59.659447 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b39eb823-96c0-432d-b28f-6df58631a7a3 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 05:00:59.659952 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b39eb823-96c0-432d-b28f-6df58631a7a3 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 05:00:59.660666 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b39eb823-96c0-432d-b28f-6df58631a7a3 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 05:00:59.661143 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b39eb823-96c0-432d-b28f-6df58631a7a3 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 05:00:59.661628 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-b39eb823-96c0-432d-b28f-6df58631a7a3 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 05:00:59.675786 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.wsgi [None req-b39eb823-96c0-432d-b28f-6df58631a7a3 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] HTTP exception thrown: Instance d70be658-192f-4b01-93b9-c831c9df7797 could not be found. Oct 19 05:00:59.677473 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b39eb823-96c0-432d-b28f-6df58631a7a3 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Request method failure captured: Oct 19 05:00:59.677473 n-d-861333-8 devstack@n-api.service[121134]: request: GET /compute/v2.1/servers/d70be658-192f-4b01-93b9-c831c9df7797 HTTP/1.1 Oct 19 05:00:59.677473 n-d-861333-8 devstack@n-api.service[121134]: Accept: application/json Oct 19 05:00:59.677473 n-d-861333-8 devstack@n-api.service[121134]: Accept-Encoding: identity Oct 19 05:00:59.677473 n-d-861333-8 devstack@n-api.service[121134]: Connection: close Oct 19 05:00:59.677473 n-d-861333-8 devstack@n-api.service[121134]: Content-Length: 0 Oct 19 05:00:59.677473 n-d-861333-8 devstack@n-api.service[121134]: Content-Type: application/json Oct 19 05:00:59.677473 n-d-861333-8 devstack@n-api.service[121134]: Host: 10.222.0.52 Oct 19 05:00:59.677473 n-d-861333-8 devstack@n-api.service[121134]: Openstack-System-Scope: None Oct 19 05:00:59.677473 n-d-861333-8 devstack@n-api.service[121134]: User-Agent: python-urllib3/1.26.12 Oct 19 05:00:59.677473 n-d-861333-8 devstack@n-api.service[121134]: X-Auth-Token: gAAAAABjT4M8pJhHNQDx_Z1VP36ChpbDrg9UWbma6sg9mjdgs4-boNuUUNgwp_P7YeykMxayyVzAnOe1o34mobdQDX_kN5TuwkjF5gZ9_z29ov4zCrau56qWLblURLamJWo92NyYOPP2pVvLPbDRJpZBdoyDrHyoVapR_3bfLa6mXFiK8ZXzsCs Oct 19 05:00:59.677473 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Id: None Oct 19 05:00:59.677473 n-d-861333-8 devstack@n-api.service[121134]: X-Domain-Name: None Oct 19 05:00:59.677473 n-d-861333-8 devstack@n-api.service[121134]: X-Identity-Status: Confirmed Oct 19 05:00:59.677473 n-d-861333-8 devstack@n-api.service[121134]: X-Is-Admin-Project: True Oct 19 05:00:59.677473 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Id: default Oct 19 05:00:59.677473 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Domain-Name: Default Oct 19 05:00:59.677473 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Id: ba1d6461bf1e4cab9d25f44a7336b482 Oct 19 05:00:59.677473 n-d-861333-8 devstack@n-api.service[121134]: X-Project-Name: tempest-TestSnapshotPattern-861727073 Oct 19 05:00:59.677473 n-d-861333-8 devstack@n-api.service[121134]: X-Role: reader,member Oct 19 05:00:59.677473 n-d-861333-8 devstack@n-api.service[121134]: X-Roles: reader,member Oct 19 05:00:59.677473 n-d-861333-8 devstack@n-api.service[121134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ba1d6461bf1e4cab9d25f44a7336b482"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ba1d6461bf1e4cab9d25f44a7336b482"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ba1d6461bf1e4cab9d25f44a7336b482"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ba1d6461bf1e4cab9d25f44a7336b482", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 05:00:59.677473 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant: tempest-TestSnapshotPattern-861727073 Oct 19 05:00:59.677473 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Id: ba1d6461bf1e4cab9d25f44a7336b482 Oct 19 05:00:59.677473 n-d-861333-8 devstack@n-api.service[121134]: X-Tenant-Name: tempest-TestSnapshotPattern-861727073 Oct 19 05:00:59.677473 n-d-861333-8 devstack@n-api.service[121134]: X-User: tempest-TestSnapshotPattern-861727073-project Oct 19 05:00:59.677473 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Id: default Oct 19 05:00:59.677473 n-d-861333-8 devstack@n-api.service[121134]: X-User-Domain-Name: Default Oct 19 05:00:59.677473 n-d-861333-8 devstack@n-api.service[121134]: X-User-Id: 7578bec46d60497b9118124bd566490a Oct 19 05:00:59.677473 n-d-861333-8 devstack@n-api.service[121134]: X-User-Name: tempest-TestSnapshotPattern-861727073-project Oct 19 05:00:59.677473 n-d-861333-8 devstack@n-api.service[121134]: method: > Oct 19 05:00:59.677473 n-d-861333-8 devstack@n-api.service[121134]: exception: Instance d70be658-192f-4b01-93b9-c831c9df7797 could not be found. Oct 19 05:00:59.677473 n-d-861333-8 devstack@n-api.service[121134]: action_args: {'id': 'd70be658-192f-4b01-93b9-c831c9df7797'} Oct 19 05:00:59.677473 n-d-861333-8 devstack@n-api.service[121134]: {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 05:00:59.677473 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 05:00:59.677473 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 05:00:59.677473 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 05:00:59.677473 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 05:00:59.677473 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 05:00:59.677473 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 05:00:59.677473 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 05:00:59.677473 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 05:00:59.677473 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 05:00:59.677473 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d70be658-192f-4b01-93b9-c831c9df7797 could not be found. Oct 19 05:00:59.677473 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 05:00:59.677473 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 05:00:59.677473 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 05:00:59.677473 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 05:00:59.677473 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 05:00:59.677473 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 05:00:59.677473 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 05:00:59.677473 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 05:00:59.677473 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 05:00:59.677473 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 05:00:59.677473 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 05:00:59.677473 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 05:00:59.677473 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 05:00:59.677473 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 05:00:59.677473 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 05:00:59.677473 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 05:00:59.677473 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d70be658-192f-4b01-93b9-c831c9df7797 could not be found. Oct 19 05:00:59.677473 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 05:00:59.677473 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 05:00:59.677473 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 05:00:59.681280 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 05:00:59.681280 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 05:00:59.681280 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 05:00:59.681280 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 05:00:59.681280 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 05:00:59.681280 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d70be658-192f-4b01-93b9-c831c9df7797 could not be found. Oct 19 05:00:59.681280 n-d-861333-8 devstack@n-api.service[121134]: ERROR nova.api.openstack.wsgi Oct 19 05:00:59.681280 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b39eb823-96c0-432d-b28f-6df58631a7a3 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Returning 404 to user: Instance d70be658-192f-4b01-93b9-c831c9df7797 could not be found. {{(pid=121134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 05:00:59.681280 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b39eb823-96c0-432d-b28f-6df58631a7a3 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] 10.222.0.52 "GET /compute/v2.1/servers/d70be658-192f-4b01-93b9-c831c9df7797" status: 404 len: 111 microversion: 2.1 time: 0.033051 Oct 19 05:00:59.681280 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4470/8462] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 05:00:59 2022] GET /compute/v2.1/servers/d70be658-192f-4b01-93b9-c831c9df7797 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 05:01:01.818296 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-ec4dad59-a82d-48c8-a572-403ceccaeca4 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 05:01:01.818791 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ec4dad59-a82d-48c8-a572-403ceccaeca4 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] [instance: c5b743c2-0631-4b52-81d0-820260bf382f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 05:01:01.821451 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-20a2b635-fe07-4d50-afc8-2d1904fa298f req-a5f6cf90-f514-4a5f-af5a-ed4e7d9fea91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5b743c2-0631-4b52-81d0-820260bf382f", "tag": "a5dfecd6-25ee-445c-ad0e-e2cbc8ed3588"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 05:01:01.826368 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ec4dad59-a82d-48c8-a572-403ceccaeca4 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 05:01:01.826868 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ec4dad59-a82d-48c8-a572-403ceccaeca4 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 05:01:01.827530 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ec4dad59-a82d-48c8-a572-403ceccaeca4 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 05:01:01.828252 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ec4dad59-a82d-48c8-a572-403ceccaeca4 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 05:01:01.828718 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ec4dad59-a82d-48c8-a572-403ceccaeca4 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 05:01:01.829173 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-ec4dad59-a82d-48c8-a572-403ceccaeca4 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 05:01:01.832584 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-20a2b635-fe07-4d50-afc8-2d1904fa298f req-a5f6cf90-f514-4a5f-af5a-ed4e7d9fea91 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 05:01:01.833082 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-20a2b635-fe07-4d50-afc8-2d1904fa298f req-a5f6cf90-f514-4a5f-af5a-ed4e7d9fea91 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 05:01:01.833811 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-20a2b635-fe07-4d50-afc8-2d1904fa298f req-a5f6cf90-f514-4a5f-af5a-ed4e7d9fea91 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 05:01:01.845653 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-20a2b635-fe07-4d50-afc8-2d1904fa298f req-a5f6cf90-f514-4a5f-af5a-ed4e7d9fea91 service nova] Creating event network-changed:a5dfecd6-25ee-445c-ad0e-e2cbc8ed3588 for instance c5b743c2-0631-4b52-81d0-820260bf382f on n-h2-861333-8 Oct 19 05:01:01.852357 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-20a2b635-fe07-4d50-afc8-2d1904fa298f req-a5f6cf90-f514-4a5f-af5a-ed4e7d9fea91 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035394 Oct 19 05:01:01.853574 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4471/8463] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 05:01:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 05:01:01.856865 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-ec4dad59-a82d-48c8-a572-403ceccaeca4 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] [instance: c5b743c2-0631-4b52-81d0-820260bf382f] Going to try to terminate instance {{(pid=121135) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 05:01:02.205557 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-ec4dad59-a82d-48c8-a572-403ceccaeca4 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] 10.222.0.52 "DELETE /compute/v2.1/servers/c5b743c2-0631-4b52-81d0-820260bf382f" status: 204 len: 0 microversion: 2.1 time: 0.391054 Oct 19 05:01:02.206155 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3993/8464] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 19 05:01:01 2022] DELETE /compute/v2.1/servers/c5b743c2-0631-4b52-81d0-820260bf382f => generated 0 bytes in 393 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 05:01:02.215563 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-68edaa57-4469-4ff5-b727-05fc10c75394 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Calling method '>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 05:01:02.221930 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.compute.api [None req-68edaa57-4469-4ff5-b727-05fc10c75394 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] [instance: c5b743c2-0631-4b52-81d0-820260bf382f] Fetching instance by UUID {{(pid=121134) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 05:01:02.222858 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-68edaa57-4469-4ff5-b727-05fc10c75394 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 05:01:02.223358 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-68edaa57-4469-4ff5-b727-05fc10c75394 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 05:01:02.223810 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-68edaa57-4469-4ff5-b727-05fc10c75394 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 05:01:02.224522 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-68edaa57-4469-4ff5-b727-05fc10c75394 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 05:01:02.225041 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-68edaa57-4469-4ff5-b727-05fc10c75394 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 05:01:02.225512 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [None req-68edaa57-4469-4ff5-b727-05fc10c75394 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 05:01:02.363648 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.policy [None req-68edaa57-4469-4ff5-b727-05fc10c75394 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578bec46d60497b9118124bd566490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1d6461bf1e4cab9d25f44a7336b482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121134) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 05:01:02.372220 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-68edaa57-4469-4ff5-b727-05fc10c75394 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] 10.222.0.52 "GET /compute/v2.1/servers/c5b743c2-0631-4b52-81d0-820260bf382f" status: 200 len: 1685 microversion: 2.1 time: 0.161531 Oct 19 05:01:02.372813 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4472/8465] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 05:01:02 2022] GET /compute/v2.1/servers/c5b743c2-0631-4b52-81d0-820260bf382f => generated 1685 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 05:01:03.397532 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-e21f686a-cd78-4cc9-a6e0-9337d33bdd19 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 05:01:03.398170 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-e21f686a-cd78-4cc9-a6e0-9337d33bdd19 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] [instance: c5b743c2-0631-4b52-81d0-820260bf382f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 05:01:03.405089 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e21f686a-cd78-4cc9-a6e0-9337d33bdd19 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 05:01:03.405621 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e21f686a-cd78-4cc9-a6e0-9337d33bdd19 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 05:01:03.406064 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e21f686a-cd78-4cc9-a6e0-9337d33bdd19 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 05:01:03.406759 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e21f686a-cd78-4cc9-a6e0-9337d33bdd19 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 05:01:03.407214 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e21f686a-cd78-4cc9-a6e0-9337d33bdd19 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 05:01:03.407645 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-e21f686a-cd78-4cc9-a6e0-9337d33bdd19 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 05:01:03.478320 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.policy [None req-e21f686a-cd78-4cc9-a6e0-9337d33bdd19 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578bec46d60497b9118124bd566490a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1d6461bf1e4cab9d25f44a7336b482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121135) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 05:01:03.486212 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-e21f686a-cd78-4cc9-a6e0-9337d33bdd19 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] 10.222.0.52 "GET /compute/v2.1/servers/c5b743c2-0631-4b52-81d0-820260bf382f" status: 200 len: 1499 microversion: 2.1 time: 0.093744 Oct 19 05:01:03.486999 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3994/8466] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 05:01:03 2022] GET /compute/v2.1/servers/c5b743c2-0631-4b52-81d0-820260bf382f => generated 1499 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 05:01:03.868133 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [req-77c821b4-2606-4c5f-94f2-5a6f0d5dd082 req-9889c182-3c2e-4898-b9f7-1422f4ab2b74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5b743c2-0631-4b52-81d0-820260bf382f", "name": "network-vif-deleted", "tag": "a5dfecd6-25ee-445c-ad0e-e2cbc8ed3588"}]} {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 05:01:03.879155 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-77c821b4-2606-4c5f-94f2-5a6f0d5dd082 req-9889c182-3c2e-4898-b9f7-1422f4ab2b74 service nova] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 05:01:03.880007 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-77c821b4-2606-4c5f-94f2-5a6f0d5dd082 req-9889c182-3c2e-4898-b9f7-1422f4ab2b74 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 05:01:03.880536 n-d-861333-8 devstack@n-api.service[121134]: DEBUG oslo_concurrency.lockutils [req-77c821b4-2606-4c5f-94f2-5a6f0d5dd082 req-9889c182-3c2e-4898-b9f7-1422f4ab2b74 service nova] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 05:01:03.893316 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.compute.server_external_events [req-77c821b4-2606-4c5f-94f2-5a6f0d5dd082 req-9889c182-3c2e-4898-b9f7-1422f4ab2b74 service nova] Creating event network-vif-deleted:a5dfecd6-25ee-445c-ad0e-e2cbc8ed3588 for instance c5b743c2-0631-4b52-81d0-820260bf382f on n-h2-861333-8 Oct 19 05:01:03.898405 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [req-77c821b4-2606-4c5f-94f2-5a6f0d5dd082 req-9889c182-3c2e-4898-b9f7-1422f4ab2b74 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034922 Oct 19 05:01:03.899103 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4473/8467] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 19 05:01:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 05:01:04.510110 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b110c1e1-fccc-45f3-bc30-4dcccdb1f540 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Calling method '>' {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 05:01:04.510758 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.compute.api [None req-b110c1e1-fccc-45f3-bc30-4dcccdb1f540 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] [instance: c5b743c2-0631-4b52-81d0-820260bf382f] Fetching instance by UUID {{(pid=121135) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 05:01:04.517629 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b110c1e1-fccc-45f3-bc30-4dcccdb1f540 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 05:01:04.518114 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b110c1e1-fccc-45f3-bc30-4dcccdb1f540 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 05:01:04.518555 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b110c1e1-fccc-45f3-bc30-4dcccdb1f540 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 05:01:04.519242 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b110c1e1-fccc-45f3-bc30-4dcccdb1f540 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Acquiring lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 05:01:04.519694 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b110c1e1-fccc-45f3-bc30-4dcccdb1f540 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 05:01:04.520122 n-d-861333-8 devstack@n-api.service[121135]: DEBUG oslo_concurrency.lockutils [None req-b110c1e1-fccc-45f3-bc30-4dcccdb1f540 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Lock "d204a9a6-30d3-4569-8922-0d4cbe966b78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 05:01:04.535148 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.wsgi [None req-b110c1e1-fccc-45f3-bc30-4dcccdb1f540 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] HTTP exception thrown: Instance c5b743c2-0631-4b52-81d0-820260bf382f could not be found. Oct 19 05:01:04.538200 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b110c1e1-fccc-45f3-bc30-4dcccdb1f540 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Request method failure captured: Oct 19 05:01:04.538200 n-d-861333-8 devstack@n-api.service[121135]: request: GET /compute/v2.1/servers/c5b743c2-0631-4b52-81d0-820260bf382f HTTP/1.1 Oct 19 05:01:04.538200 n-d-861333-8 devstack@n-api.service[121135]: Accept: application/json Oct 19 05:01:04.538200 n-d-861333-8 devstack@n-api.service[121135]: Accept-Encoding: identity Oct 19 05:01:04.538200 n-d-861333-8 devstack@n-api.service[121135]: Connection: close Oct 19 05:01:04.538200 n-d-861333-8 devstack@n-api.service[121135]: Content-Length: 0 Oct 19 05:01:04.538200 n-d-861333-8 devstack@n-api.service[121135]: Content-Type: application/json Oct 19 05:01:04.538200 n-d-861333-8 devstack@n-api.service[121135]: Host: 10.222.0.52 Oct 19 05:01:04.538200 n-d-861333-8 devstack@n-api.service[121135]: Openstack-System-Scope: None Oct 19 05:01:04.538200 n-d-861333-8 devstack@n-api.service[121135]: User-Agent: python-urllib3/1.26.12 Oct 19 05:01:04.538200 n-d-861333-8 devstack@n-api.service[121135]: X-Auth-Token: gAAAAABjT4M8pJhHNQDx_Z1VP36ChpbDrg9UWbma6sg9mjdgs4-boNuUUNgwp_P7YeykMxayyVzAnOe1o34mobdQDX_kN5TuwkjF5gZ9_z29ov4zCrau56qWLblURLamJWo92NyYOPP2pVvLPbDRJpZBdoyDrHyoVapR_3bfLa6mXFiK8ZXzsCs Oct 19 05:01:04.538200 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Id: None Oct 19 05:01:04.538200 n-d-861333-8 devstack@n-api.service[121135]: X-Domain-Name: None Oct 19 05:01:04.538200 n-d-861333-8 devstack@n-api.service[121135]: X-Identity-Status: Confirmed Oct 19 05:01:04.538200 n-d-861333-8 devstack@n-api.service[121135]: X-Is-Admin-Project: True Oct 19 05:01:04.538200 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Id: default Oct 19 05:01:04.538200 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Domain-Name: Default Oct 19 05:01:04.538200 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Id: ba1d6461bf1e4cab9d25f44a7336b482 Oct 19 05:01:04.538200 n-d-861333-8 devstack@n-api.service[121135]: X-Project-Name: tempest-TestSnapshotPattern-861727073 Oct 19 05:01:04.538200 n-d-861333-8 devstack@n-api.service[121135]: X-Role: reader,member Oct 19 05:01:04.538200 n-d-861333-8 devstack@n-api.service[121135]: X-Roles: reader,member Oct 19 05:01:04.538200 n-d-861333-8 devstack@n-api.service[121135]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ba1d6461bf1e4cab9d25f44a7336b482"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ba1d6461bf1e4cab9d25f44a7336b482"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ba1d6461bf1e4cab9d25f44a7336b482"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ba1d6461bf1e4cab9d25f44a7336b482", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Oct 19 05:01:04.538200 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant: tempest-TestSnapshotPattern-861727073 Oct 19 05:01:04.538200 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Id: ba1d6461bf1e4cab9d25f44a7336b482 Oct 19 05:01:04.538200 n-d-861333-8 devstack@n-api.service[121135]: X-Tenant-Name: tempest-TestSnapshotPattern-861727073 Oct 19 05:01:04.538200 n-d-861333-8 devstack@n-api.service[121135]: X-User: tempest-TestSnapshotPattern-861727073-project Oct 19 05:01:04.538200 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Id: default Oct 19 05:01:04.538200 n-d-861333-8 devstack@n-api.service[121135]: X-User-Domain-Name: Default Oct 19 05:01:04.538200 n-d-861333-8 devstack@n-api.service[121135]: X-User-Id: 7578bec46d60497b9118124bd566490a Oct 19 05:01:04.538200 n-d-861333-8 devstack@n-api.service[121135]: X-User-Name: tempest-TestSnapshotPattern-861727073-project Oct 19 05:01:04.538200 n-d-861333-8 devstack@n-api.service[121135]: method: > Oct 19 05:01:04.538200 n-d-861333-8 devstack@n-api.service[121135]: exception: Instance c5b743c2-0631-4b52-81d0-820260bf382f could not be found. Oct 19 05:01:04.538200 n-d-861333-8 devstack@n-api.service[121135]: action_args: {'id': 'c5b743c2-0631-4b52-81d0-820260bf382f'} Oct 19 05:01:04.538200 n-d-861333-8 devstack@n-api.service[121135]: {{(pid=121135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 05:01:04.538200 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 05:01:04.538200 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 05:01:04.538200 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 05:01:04.538200 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 05:01:04.538200 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 05:01:04.538200 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 05:01:04.538200 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 05:01:04.538200 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 05:01:04.538200 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 05:01:04.538200 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5b743c2-0631-4b52-81d0-820260bf382f could not be found. Oct 19 05:01:04.538200 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 05:01:04.538200 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 05:01:04.538200 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 05:01:04.538200 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 05:01:04.538200 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 05:01:04.538200 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 05:01:04.538200 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 05:01:04.538200 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 05:01:04.538200 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 05:01:04.538200 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 05:01:04.538200 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 05:01:04.538200 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 05:01:04.538200 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 05:01:04.538200 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 05:01:04.538200 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 05:01:04.538200 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 05:01:04.538200 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5b743c2-0631-4b52-81d0-820260bf382f could not be found. Oct 19 05:01:04.538200 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 05:01:04.538200 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 05:01:04.538200 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 05:01:04.541409 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 05:01:04.541409 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 05:01:04.541409 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 05:01:04.541409 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 05:01:04.541409 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 05:01:04.541409 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5b743c2-0631-4b52-81d0-820260bf382f could not be found. Oct 19 05:01:04.541409 n-d-861333-8 devstack@n-api.service[121135]: ERROR nova.api.openstack.wsgi Oct 19 05:01:04.541409 n-d-861333-8 devstack@n-api.service[121135]: DEBUG nova.api.openstack.wsgi [None req-b110c1e1-fccc-45f3-bc30-4dcccdb1f540 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Returning 404 to user: Instance c5b743c2-0631-4b52-81d0-820260bf382f could not be found. {{(pid=121135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 05:01:04.541409 n-d-861333-8 devstack@n-api.service[121135]: INFO nova.api.openstack.requestlog [None req-b110c1e1-fccc-45f3-bc30-4dcccdb1f540 tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] 10.222.0.52 "GET /compute/v2.1/servers/c5b743c2-0631-4b52-81d0-820260bf382f" status: 404 len: 111 microversion: 2.1 time: 0.033543 Oct 19 05:01:04.541409 n-d-861333-8 devstack@n-api.service[121135]: [pid: 121135|app: 0|req: 3995/8468] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 19 05:01:04 2022] GET /compute/v2.1/servers/c5b743c2-0631-4b52-81d0-820260bf382f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 05:01:04.755629 n-d-861333-8 devstack@n-api.service[121134]: DEBUG nova.api.openstack.wsgi [None req-b7c9e39d-47d2-4076-9892-0b787f54f86e tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] Calling method '.version_select at 0x7fc130af7af0>' {{(pid=121134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 05:01:04.760114 n-d-861333-8 devstack@n-api.service[121134]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b7c9e39d-47d2-4076-9892-0b787f54f86e tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] [19b0d749-bd61-471f-8efc-e4b656063a84] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 19 05:01:05.767692 n-d-861333-8 devstack@n-api.service[121134]: INFO oslo.messaging._drivers.impl_rabbit [None req-b7c9e39d-47d2-4076-9892-0b787f54f86e tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] [19b0d749-bd61-471f-8efc-e4b656063a84] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 38432. Oct 19 05:01:05.856605 n-d-861333-8 devstack@n-api.service[121134]: INFO nova.api.openstack.requestlog [None req-b7c9e39d-47d2-4076-9892-0b787f54f86e tempest-TestSnapshotPattern-861727073 tempest-TestSnapshotPattern-861727073-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1553798338" status: 202 len: 0 microversion: 2.1 time: 1.105191 Oct 19 05:01:05.857200 n-d-861333-8 devstack@n-api.service[121134]: [pid: 121134|app: 0|req: 4474/8469] 10.222.0.52 () {58 vars in 1257 bytes} [Wed Oct 19 05:01:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1553798338 => generated 0 bytes in 1107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)